2023-08-17T17:16:10.621 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-17T17:16:10.623 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890 --owner scheduled_yuriw@teuthology --name yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --verbose -- /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890/orig.config.yaml 2023-08-17T17:16:10.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T17:16:10.758 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890 branch: wip-yuri2-testing-2023-08-16-1142-pacific description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: null first_in_suite: false job_id: '7371890' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri2-testing-2023-08-16-1142-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2023-08-16-1142-pacific sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9687 sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri2-testing-2023-08-16-1142-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_23c07d8f91d3210fa9df54a2a13a9637958c6088/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 targets: smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsDGtIqaxjr03N79mLKJ8UPJGouDKoCJ1LKv7RoXHRxbRSRaafkGgQHYccvzwL3C7FkR0DB9llVzsImWBEK+MYsJOUPu+lpP1WDGLDuLCEoqBkZkGhuYc1kN0Dr7ClhWywWMkt8QTryRdL7aHQFCXmtC5J5sb7D8mexu8098EXB/f1Df36Yax08PEyuy8VM+XAwFQ1GVhRMn9FXoIoM8XaNdGQc2g7pcaKk6CDUH+il2Hqm5knxiVDo0yGzlTcLRbUk+Zyj8WOX7QTynRr7g00SQ8OcXAt1xfnUoh85+XUZA1tERmQ4JdXXkBFJLKRQ8Df5rNpZwFZp8WsWdnawcBprodP7Eehw32STaO8g6TqzsU9yt+3VLq+awBP/TMhoToA934h0l2D/YjvklOoZ+BNuEI9ohmhmiim7VViuvr6yqoR1VtIiC5XT2l3VQQYRChqShiQiHRPM3ZNwNgVutmoO+cz/MzEYNbkFOhPBKIw8J4mJAKWNJDqKktplH+Zhmk= smithi150.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVjfehMjwxiIvigPtEzGMQN7B7FPvL9sTrJPt5rST2Xv2secLTpMre3TkGT1HZmD6kF04/gNrLbfkGICXrv6k47U7f6+J6zui0Os7XlyystDRH161BOCo4ak1qQ9ZcvXJHxM0qzMIZMpS7mjQVsBqnGJDV2kcUxd7YfKgJk7UsgEhDZL87rozi65LqZuYhxMkKJ0P7bQYU12OeOlDtYBHud/f8rw56TZsICtu1hseD68COo4RW7fW5qflbg+1wfgG6ZdtaZcqdX/qH3SXjLcqieUkdha1eYtxpY+ezjMdIPr+Vj4ORHmJHX6S67+4C2V7gOSQ4Hx6wONibawOzATh8NCGj9Mb27eZVzlW9N8NeayqqXiq5b8CB2Ix1HElXhExpHwd69UNpwRjIPdmRGQbnK8IzEBLt9/MNqwPYxND/OL+WeMlu4fon4LEUr12DESnFw62EHFGKlPJvk8LBVdlJUmRDX1Do5PXCRybeXgng57dMRGea2/hMDC5qUEoVPmE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-17_17:05:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-17T17:16:10.759 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_23c07d8f91d3210fa9df54a2a13a9637958c6088/qa; will attempt to use it 2023-08-17T17:16:10.759 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_23c07d8f91d3210fa9df54a2a13a9637958c6088/qa/tasks 2023-08-17T17:16:10.760 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-17T17:16:10.761 INFO:teuthology.task.internal:Checking packages... 2023-08-17T17:16:10.791 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '23c07d8f91d3210fa9df54a2a13a9637958c6088' 2023-08-17T17:16:10.791 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-17T17:16:10.792 INFO:teuthology.packaging:ref: None 2023-08-17T17:16:10.792 INFO:teuthology.packaging:tag: None 2023-08-17T17:16:10.792 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-08-16-1142-pacific 2023-08-17T17:16:10.793 INFO:teuthology.packaging:sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 2023-08-17T17:16:10.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2023-08-16-1142-pacific 2023-08-17T17:16:10.932 INFO:teuthology.task.internal:Found packages for ceph version 16.2.13-522.g23c07d8f 2023-08-17T17:16:10.933 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-17T17:16:10.940 INFO:teuthology.task.internal:no buildpackages task found 2023-08-17T17:16:10.941 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-17T17:16:10.947 INFO:teuthology.task.internal:Saving configuration 2023-08-17T17:16:10.970 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-17T17:16:10.975 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-17T17:16:11.004 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 17:06:44.760025', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLP05oCOXMftqm2a6imBB4TPH7Zhy9pPF2xLziiRwAZ0CuKILUFlNkqGw/X6gq3fZKaJEZAjwxuOQSzfFChqfHA='} 2023-08-17T17:16:11.023 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 17:06:44.761664', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlQprf/a/Y4YHF63l6ZH4rNU8Db91BnyB5cktaTlscwmX62t5fGZ6KhYdRfUcPntsZXw/Hc3ivQ1N0+BE+SPk4='} 2023-08-17T17:16:11.024 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-17T17:16:11.029 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-17T17:16:11.030 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-17T17:16:11.030 INFO:teuthology.run_tasks:Running task console_log... 2023-08-17T17:16:11.114 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f30fdf69040>, signals=[15]) 2023-08-17T17:16:11.116 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-17T17:16:11.123 INFO:teuthology.task.internal:Opening connections... 2023-08-17T17:16:11.123 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:16:11.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:16:11.197 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T17:16:11.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:16:11.268 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-17T17:16:11.286 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-08-17T17:16:11.306 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-08-17T17:16:11.306 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-08-17T17:16:11.363 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-08-17T17:16:11.363 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.4 (Ootpa)" 2023-08-17T17:16:11.363 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-08-17T17:16:11.363 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-08-17T17:16:11.363 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.4" 2023-08-17T17:16:11.364 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-08-17T17:16:11.364 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-17T17:16:11.364 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-08-17T17:16:11.364 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-17T17:16:11.364 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-08-17T17:16:11.364 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-17T17:16:11.364 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-17T17:16:11.365 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:16:11.365 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-17T17:16:11.365 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-17T17:16:11.365 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-17T17:16:11.365 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-17T17:16:11.366 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-08-17T17:16:11.384 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2023-08-17T17:16:11.402 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2023-08-17T17:16:11.403 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-08-17T17:16:11.467 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2023-08-17T17:16:11.468 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.4 (Ootpa)" 2023-08-17T17:16:11.468 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2023-08-17T17:16:11.469 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2023-08-17T17:16:11.469 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.4" 2023-08-17T17:16:11.469 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2023-08-17T17:16:11.469 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-17T17:16:11.469 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-08-17T17:16:11.469 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-17T17:16:11.470 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2023-08-17T17:16:11.470 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-17T17:16:11.470 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-17T17:16:11.470 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:16:11.470 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-17T17:16:11.470 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-17T17:16:11.470 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-17T17:16:11.470 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-17T17:16:11.471 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-08-17T17:16:11.493 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-17T17:16:11.504 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-17T17:16:11.513 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-17T17:16:11.513 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2023-08-17T17:16:11.516 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2023-08-17T17:16:11.532 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-17T17:16:11.537 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-17T17:16:11.538 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2023-08-17T17:16:11.572 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2023-08-17T17:16:11.587 INFO:teuthology.orchestra.run.smithi078.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-08-17T17:16:11.589 INFO:teuthology.orchestra.run.smithi150.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-08-17T17:16:11.590 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-17T17:16:11.642 INFO:teuthology.run_tasks:Running task kernel... 2023-08-17T17:16:11.660 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-08-17T17:16:11.661 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-08-17T17:16:11.662 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-08-17T17:16:11.663 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-17T17:16:11.663 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-17T17:16:11.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T17:16:11.679 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2023-08-17T17:16:11.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T17:16:11.681 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-08-17T17:16:11.735 INFO:teuthology.orchestra.run.smithi150.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-08-17T17:16:11.735 INFO:teuthology.task.kernel:Running kernel on smithi150: 4.18.0-305.25.1.el8_4.x86_64 2023-08-17T17:16:11.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum install -y kernel 2023-08-17T17:16:11.737 INFO:teuthology.orchestra.run.smithi078.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-08-17T17:16:11.738 INFO:teuthology.task.kernel:Running kernel on smithi078: 4.18.0-305.25.1.el8_4.x86_64 2023-08-17T17:16:11.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2023-08-17T17:16:13.109 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2023-08-17T17:16:13.110 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2023-08-17T17:16:13.242 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-08-17T17:16:13.243 INFO:teuthology.orchestra.run.smithi078.stdout:Unable to read consumer identity 2023-08-17T17:16:14.571 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-08-17T17:16:14.590 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-08-17T17:16:15.198 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 27 MB/s | 16 MB 00:00 2023-08-17T17:16:15.215 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 26 MB/s | 16 MB 00:00 2023-08-17T17:16:18.432 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-08-17T17:16:18.537 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 4.8 MB/s | 24 kB 00:00 2023-08-17T17:16:19.142 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-08-17T17:16:19.142 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-08-17T17:16:19.142 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-08-17T17:16:19.244 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-08-17T17:16:19.245 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-08-17T17:16:19.245 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-08-17T17:16:19.286 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-08-17T17:16:19.287 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-08-17T17:16:19.287 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-08-17T17:16:19.382 DEBUG:teuthology.orchestra.run.smithi150:> echo no | sudo yum reinstall kernel || true 2023-08-17T17:16:19.403 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2023-08-17T17:16:19.404 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2023-08-17T17:16:19.404 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2023-08-17T17:16:19.515 DEBUG:teuthology.orchestra.run.smithi078:> echo no | sudo yum reinstall kernel || true 2023-08-17T17:16:19.728 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2023-08-17T17:16:19.729 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2023-08-17T17:16:19.858 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-08-17T17:16:19.858 INFO:teuthology.orchestra.run.smithi078.stdout:Unable to read consumer identity 2023-08-17T17:16:20.017 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:02 ago on Thu 17 Aug 2023 05:16:18 PM UTC. 2023-08-17T17:16:20.140 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:02 ago on Thu 17 Aug 2023 05:16:18 PM UTC. 2023-08-17T17:16:20.142 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-08-17T17:16:20.142 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-08-17T17:16:20.142 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-08-17T17:16:20.174 INFO:teuthology.orchestra.run.smithi150.stderr:Error: No packages marked for reinstall. 2023-08-17T17:16:20.224 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum reinstall -y kernel || true 2023-08-17T17:16:20.275 INFO:teuthology.orchestra.run.smithi078.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-08-17T17:16:20.275 INFO:teuthology.orchestra.run.smithi078.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-08-17T17:16:20.275 INFO:teuthology.orchestra.run.smithi078.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-08-17T17:16:20.304 INFO:teuthology.orchestra.run.smithi078.stderr:Error: No packages marked for reinstall. 2023-08-17T17:16:20.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum reinstall -y kernel || true 2023-08-17T17:16:20.567 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2023-08-17T17:16:20.568 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2023-08-17T17:16:20.695 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-08-17T17:16:20.695 INFO:teuthology.orchestra.run.smithi078.stdout:Unable to read consumer identity 2023-08-17T17:16:20.847 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:02 ago on Thu 17 Aug 2023 05:16:18 PM UTC. 2023-08-17T17:16:20.973 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:02 ago on Thu 17 Aug 2023 05:16:18 PM UTC. 2023-08-17T17:16:20.974 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-08-17T17:16:20.975 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-08-17T17:16:20.975 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-08-17T17:16:20.990 INFO:teuthology.orchestra.run.smithi150.stderr:Error: No packages marked for reinstall. 2023-08-17T17:16:21.040 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2023-08-17T17:16:21.098 INFO:teuthology.orchestra.run.smithi078.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-08-17T17:16:21.099 INFO:teuthology.orchestra.run.smithi078.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-08-17T17:16:21.099 INFO:teuthology.orchestra.run.smithi078.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-08-17T17:16:21.112 INFO:teuthology.orchestra.run.smithi078.stderr:Error: No packages marked for reinstall. 2023-08-17T17:16:21.163 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2023-08-17T17:16:21.166 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.167 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.167 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.167 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-08-17T17:16:21.167 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-08-17T17:16:21.167 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-08-17T17:16:21.168 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2023-08-17T17:16:21.168 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2023-08-17T17:16:21.287 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.288 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.288 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.288 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-08-17T17:16:21.288 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-08-17T17:16:21.289 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-08-17T17:16:21.289 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2023-08-17T17:16:21.289 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2023-08-17T17:16:21.293 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.293 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.293 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2-tools 2023-08-17T17:16:21.320 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2-tools 2023-08-17T17:16:21.321 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2023-08-17T17:16:21.321 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.02 2023-08-17T17:16:21.321 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 99.el8_4.1 2023-08-17T17:16:21.321 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2023-08-17T17:16:21.321 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-08-17T17:16:21.321 INFO:teuthology.orchestra.run.smithi150.stdout:Group : System Environment/Base 2023-08-17T17:16:21.321 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 9264631 2023-08-17T17:16:21.322 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2023-08-17T17:16:21.322 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-08-17T17:16:21.322 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-08-17T17:16:21.322 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-08-17T17:16:21.322 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-08-17T17:16:21.322 INFO:teuthology.orchestra.run.smithi150.stdout:Relocations : (not relocatable) 2023-08-17T17:16:21.323 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : Red Hat, Inc. 2023-08-17T17:16:21.323 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : Red Hat, Inc. 2023-08-17T17:16:21.323 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-17T17:16:21.323 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Support tools for GRUB. 2023-08-17T17:16:21.323 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2023-08-17T17:16:21.323 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:16:21.324 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-17T17:16:21.324 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-17T17:16:21.324 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-17T17:16:21.324 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2023-08-17T17:16:21.324 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:16:21.325 INFO:teuthology.orchestra.run.smithi150.stdout:This subpackage provides tools for support of all platforms. 2023-08-17T17:16:21.326 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-17T17:16:21.326 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.326 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-17T17:16:21.415 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.415 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.415 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2023-08-17T17:16:21.442 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2023-08-17T17:16:21.443 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2023-08-17T17:16:21.443 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.02 2023-08-17T17:16:21.443 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 99.el8_4.1 2023-08-17T17:16:21.443 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2023-08-17T17:16:21.443 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-08-17T17:16:21.444 INFO:teuthology.orchestra.run.smithi078.stdout:Group : System Environment/Base 2023-08-17T17:16:21.444 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 9264631 2023-08-17T17:16:21.444 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2023-08-17T17:16:21.444 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-08-17T17:16:21.444 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-08-17T17:16:21.444 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-08-17T17:16:21.445 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-08-17T17:16:21.445 INFO:teuthology.orchestra.run.smithi078.stdout:Relocations : (not relocatable) 2023-08-17T17:16:21.445 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : Red Hat, Inc. 2023-08-17T17:16:21.445 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : Red Hat, Inc. 2023-08-17T17:16:21.445 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-17T17:16:21.445 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2023-08-17T17:16:21.445 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2023-08-17T17:16:21.445 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:16:21.446 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-17T17:16:21.446 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-17T17:16:21.446 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-17T17:16:21.446 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2023-08-17T17:16:21.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:16:21.446 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2023-08-17T17:16:21.447 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-17T17:16:21.447 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:21.448 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-17T17:16:22.705 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2023-08-17T17:16:22.737 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2023-08-17T17:16:24.664 INFO:teuthology.orchestra.run.smithi078.stderr:done 2023-08-17T17:16:24.676 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-08-17T17:16:24.716 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.WKvZMXemrm 2023-08-17T17:16:24.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WKvZMXemrm 2023-08-17T17:16:24.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.WKvZMXemrm 2023-08-17T17:16:24.949 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.WKvZMXemrm is 6KB 2023-08-17T17:16:24.954 INFO:teuthology.orchestra.run.smithi150.stderr:done 2023-08-17T17:16:24.956 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2023-08-17T17:16:24.966 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.WKvZMXemrm 2023-08-17T17:16:24.970 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.xJdmGwErlC 2023-08-17T17:16:24.970 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xJdmGwErlC 2023-08-17T17:16:24.979 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2023-08-17T17:16:25.043 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.xJdmGwErlC 2023-08-17T17:16:25.048 INFO:teuthology.orchestra.run.smithi078.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-08-17T17:16:25.049 INFO:teuthology.orchestra.run.smithi078.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-08-17T17:16:25.049 INFO:teuthology.orchestra.run.smithi078.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-08-17T17:16:25.049 INFO:teuthology.orchestra.run.smithi078.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-08-17T17:16:25.050 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:25.199 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.xJdmGwErlC is 6KB 2023-08-17T17:16:25.247 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.xJdmGwErlC 2023-08-17T17:16:25.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2023-08-17T17:16:25.262 DEBUG:teuthology.orchestra.run.smithi150:> sudo /bin/ls /boot/loader/entries || true 2023-08-17T17:16:25.351 INFO:teuthology.orchestra.run.smithi150.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-08-17T17:16:25.351 INFO:teuthology.orchestra.run.smithi150.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-08-17T17:16:25.352 INFO:teuthology.orchestra.run.smithi150.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-08-17T17:16:25.352 INFO:teuthology.orchestra.run.smithi150.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-08-17T17:16:25.353 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-08-17T17:16:25.462 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2023-08-17T17:16:55.280 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-08-17T17:16:55.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-08-17T17:16:55.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:16:55.466 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-08-17T17:16:55.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-08-17T17:16:55.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:17:13.712 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-17T17:17:13.969 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-08-17T17:17:22.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-08-17T17:17:22.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:17:22.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-08-17T17:17:22.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:17:25.808 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-17T17:17:26.032 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-08-17T17:17:37.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-08-17T17:17:37.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:17:38.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-08-17T17:17:38.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:18:09.663 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-08-17T17:18:09.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-08-17T17:18:09.961 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-08-17T17:18:09.961 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-08-17T17:18:10.027 INFO:teuthology.orchestra.run.smithi078.stdout:4.18.0-425.3.1.el8.x86_64 2023-08-17T17:18:10.033 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-08-17T17:18:10.033 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-17T17:18:10.034 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-08-17T17:18:11.037 DEBUG:teuthology.parallel:result is None 2023-08-17T17:18:38.037 DEBUG:teuthology.orchestra.remote:timed out 2023-08-17T17:18:53.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-08-17T17:18:53.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:18:53.419 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-08-17T17:18:53.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-08-17T17:18:53.796 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-08-17T17:18:53.796 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2023-08-17T17:18:53.861 INFO:teuthology.orchestra.run.smithi150.stdout:4.18.0-425.3.1.el8.x86_64 2023-08-17T17:18:53.862 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-08-17T17:18:53.862 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-17T17:18:53.862 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-08-17T17:18:54.870 DEBUG:teuthology.parallel:result is None 2023-08-17T17:18:54.871 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-17T17:18:54.930 INFO:teuthology.task.internal:Creating test directory... 2023-08-17T17:18:54.934 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-17T17:18:54.945 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-17T17:18:54.980 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-17T17:18:55.002 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-17T17:18:55.043 INFO:teuthology.task.internal:Creating archive directory... 2023-08-17T17:18:55.046 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-17T17:18:55.069 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-17T17:18:55.338 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-17T17:18:55.414 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-17T17:18:55.497 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-17T17:18:55.500 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-17T17:18:55.584 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-17T17:18:55.598 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-17T17:18:55.629 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-17T17:18:55.630 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-17T17:18:55.630 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-17T17:18:55.704 INFO:teuthology.task.internal:Configuring sudo... 2023-08-17T17:18:55.710 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-17T17:18:55.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-17T17:18:55.856 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-17T17:18:55.874 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-17T17:18:55.875 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-17T17:18:55.914 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-17T17:18:55.986 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-17T17:18:56.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-17T17:18:56.290 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-17T17:18:56.470 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-17T17:18:56.507 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:18:56.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-17T17:18:56.612 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-17T17:18:56.775 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-17T17:18:56.887 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-17T17:18:57.256 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-17T17:18:57.306 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:18:57.306 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-17T17:18:57.437 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2023-08-17T17:18:57.500 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2023-08-17T17:18:57.544 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-17T17:18:57.582 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-17T17:18:57.890 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-17T17:18:57.911 INFO:teuthology.task.internal:Starting timer... 2023-08-17T17:18:57.930 INFO:teuthology.run_tasks:Running task pcp... 2023-08-17T17:18:57.986 INFO:teuthology.run_tasks:Running task selinux... 2023-08-17T17:18:58.043 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-08-17T17:18:58.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2023-08-17T17:18:58.197 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: [ OK ] 2023-08-17T17:18:58.208 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2023-08-17T17:18:58.373 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: [ OK ] 2023-08-17T17:18:58.418 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-17T17:18:58.418 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2023-08-17T17:18:58.493 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2023-08-17T17:18:58.494 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2023-08-17T17:18:58.581 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2023-08-17T17:18:58.582 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi078.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive'} 2023-08-17T17:18:58.582 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-17T17:18:58.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T17:18:58.687 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-17T17:18:58.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T17:18:58.758 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-17T17:18:58.797 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2023-08-17T17:18:58.833 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2023-08-17T17:18:58.934 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-17T17:18:59.376 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-17T17:18:59.420 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-17T17:18:59.863 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-17T17:18:59.897 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-17T17:30:52.412 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2023-08-17T17:30:52.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-08-17T17:30:52.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:30:52.484 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-08-17T17:30:52.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-08-17T17:30:52.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-08-17T17:30:52.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T17:30:52.613 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-08-17T17:30:52.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-08-17T17:30:52.679 INFO:teuthology.run_tasks:Running task clock... 2023-08-17T17:30:52.691 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-17T17:30:52.692 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-17T17:30:52.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-17T17:30:52.694 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-17T17:30:52.695 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-17T17:30:52.721 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-17T17:30:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-17T17:30:52.747 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-17T17:30:52.762 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-17T17:30:52.772 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2023-08-17T17:30:52.783 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2023-08-17T17:30:52.796 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-17T17:30:52.799 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2023-08-17T17:30:52.810 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2023-08-17T17:30:52.810 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-17T17:30:52.824 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-17T17:30:52.837 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-17T17:30:52.876 INFO:teuthology.orchestra.run.smithi078.stderr:bash: ntpq: command not found 2023-08-17T17:30:52.879 INFO:teuthology.orchestra.run.smithi078.stdout:210 Number of sources = 4 2023-08-17T17:30:52.879 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-17T17:30:52.879 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2023-08-17T17:30:52.879 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-17T17:30:52.879 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-17T17:30:52.879 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-17T17:30:52.880 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-17T17:30:52.903 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2023-08-17T17:30:52.906 INFO:teuthology.orchestra.run.smithi150.stdout:210 Number of sources = 4 2023-08-17T17:30:52.906 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-17T17:30:52.906 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2023-08-17T17:30:52.906 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-17T17:30:52.907 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-17T17:30:52.907 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-17T17:30:52.907 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-17T17:30:52.908 INFO:teuthology.run_tasks:Running task install... 2023-08-17T17:30:52.916 DEBUG:teuthology.task.install:project ceph 2023-08-17T17:30:52.916 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'}} 2023-08-17T17:30:52.916 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'} 2023-08-17T17:30:52.917 INFO:teuthology.task.install:Using flavor: default 2023-08-17T17:30:52.922 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-17T17:30:52.922 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-17T17:30:52.923 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088', 'tag': None, 'wait_for_package': False} 2023-08-17T17:30:52.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=23c07d8f91d3210fa9df54a2a13a9637958c6088 2023-08-17T17:30:52.925 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088', 'tag': None, 'wait_for_package': False} 2023-08-17T17:30:52.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=23c07d8f91d3210fa9df54a2a13a9637958c6088 2023-08-17T17:30:53.063 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/centos/8/flavors/default/ 2023-08-17T17:30:53.064 INFO:teuthology.task.install.rpm:Package version is 16.2.13-522.g23c07d8f 2023-08-17T17:30:53.067 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/centos/8/flavors/default/ 2023-08-17T17:30:53.068 INFO:teuthology.task.install.rpm:Package version is 16.2.13-522.g23c07d8f 2023-08-17T17:30:53.205 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-17T17:30:53.205 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:30:53.205 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-17T17:30:53.231 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-08-17T17:30:53.231 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/23c07d8f91d3210fa9df54a2a13a9637958c6088/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-17T17:30:53.296 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-17T17:30:53.302 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-17T17:30:53.303 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:30:53.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-17T17:30:53.329 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-08-17T17:30:53.329 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/23c07d8f91d3210fa9df54a2a13a9637958c6088/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-17T17:30:53.370 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-17T17:30:53.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-17T17:30:53.433 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2023-08-17T17:30:53.434 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2023-08-17T17:30:53.469 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-17T17:30:53.533 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2023-08-17T17:30:53.534 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2023-08-17T17:30:53.825 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2023-08-17T17:30:53.923 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-08-17T17:30:54.129 INFO:teuthology.orchestra.run.smithi150.stdout:44 files removed 2023-08-17T17:30:54.185 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-08-17T17:30:54.204 INFO:teuthology.orchestra.run.smithi078.stdout:44 files removed 2023-08-17T17:30:54.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-08-17T17:30:54.535 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2023-08-17T17:30:54.602 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-08-17T17:30:55.309 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 342 kB/s | 76 kB 00:00 2023-08-17T17:30:55.503 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 203 kB/s | 76 kB 00:00 2023-08-17T17:30:55.652 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 51 kB/s | 15 kB 00:00 2023-08-17T17:30:55.792 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 61 kB/s | 15 kB 00:00 2023-08-17T17:30:55.990 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 4.7 kB/s | 1.4 kB 00:00 2023-08-17T17:30:56.097 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2023-08-17T17:30:56.127 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 4.7 kB/s | 1.4 kB 00:00 2023-08-17T17:30:56.234 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2023-08-17T17:30:57.172 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-08-17T17:30:57.864 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 16 MB 00:01 2023-08-17T17:31:00.427 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-08-17T17:31:00.825 INFO:teuthology.orchestra.run.smithi078.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 121 MB/s | 38 MB 00:00 2023-08-17T17:31:01.152 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-08-17T17:31:01.552 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 120 MB/s | 38 MB 00:00 2023-08-17T17:31:06.410 INFO:teuthology.orchestra.run.smithi078.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 122 MB/s | 33 MB 00:00 2023-08-17T17:31:07.061 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 115 MB/s | 33 MB 00:00 2023-08-17T17:31:14.186 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-17T17:31:14.187 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-17T17:31:14.197 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-08-17T17:31:14.198 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-08-17T17:31:14.199 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-08-17T17:31:14.200 INFO:teuthology.orchestra.run.smithi078.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-17T17:31:14.201 INFO:teuthology.orchestra.run.smithi078.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-17T17:31:14.203 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-08-17T17:31:14.204 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-08-17T17:31:14.687 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2023-08-17T17:31:14.698 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================================================== 2023-08-17T17:31:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2023-08-17T17:31:14.698 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================================================== 2023-08-17T17:31:14.699 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2023-08-17T17:31:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-17T17:31:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 6.4 k 2023-08-17T17:31:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 6.1 M 2023-08-17T17:31:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 910 k 2023-08-17T17:31:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 161 k 2023-08-17T17:31:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 1.6 M 2023-08-17T17:31:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 116 k 2023-08-17T17:31:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 3.1 M 2023-08-17T17:31:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 8.6 M 2023-08-17T17:31:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 27 k 2023-08-17T17:31:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 12 M 2023-08-17T17:31:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 52 M 2023-08-17T17:31:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 84 k 2023-08-17T17:31:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 256 k 2023-08-17T17:31:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 19 k 2023-08-17T17:31:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-08-17T17:31:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-17T17:31:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-17T17:31:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 25 k 2023-08-17T17:31:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 824 k 2023-08-17T17:31:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 131 k 2023-08-17T17:31:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-17T17:31:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-08-17T17:31:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-17T17:31:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 215 k 2023-08-17T17:31:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 389 k 2023-08-17T17:31:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 369 k 2023-08-17T17:31:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 114 k 2023-08-17T17:31:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 88 k 2023-08-17T17:31:14.705 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 3.7 M 2023-08-17T17:31:14.705 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 173 k 2023-08-17T17:31:14.705 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-08-17T17:31:14.705 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2023-08-17T17:31:14.705 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 3.7 M 2023-08-17T17:31:14.706 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 4.2 M 2023-08-17T17:31:14.706 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2023-08-17T17:31:14.706 INFO:teuthology.orchestra.run.smithi078.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-17T17:31:14.706 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 24 M 2023-08-17T17:31:14.706 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 24 k 2023-08-17T17:31:14.706 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 2.4 M 2023-08-17T17:31:14.706 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 244 k 2023-08-17T17:31:14.707 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 5.0 M 2023-08-17T17:31:14.707 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 18 M 2023-08-17T17:31:14.707 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 15 k 2023-08-17T17:31:14.707 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 26 k 2023-08-17T17:31:14.707 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-17T17:31:14.707 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-17T17:31:14.707 INFO:teuthology.orchestra.run.smithi078.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-08-17T17:31:14.708 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-17T17:31:14.708 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-17T17:31:14.708 INFO:teuthology.orchestra.run.smithi078.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-08-17T17:31:14.708 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 174 k 2023-08-17T17:31:14.708 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-08-17T17:31:14.708 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-08-17T17:31:14.708 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-17T17:31:14.709 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-08-17T17:31:14.709 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-17T17:31:14.709 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 493 k 2023-08-17T17:31:14.709 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-08-17T17:31:14.709 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 3.8 M 2023-08-17T17:31:14.709 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-17T17:31:14.709 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-08-17T17:31:14.709 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-17T17:31:14.710 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-17T17:31:14.710 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-17T17:31:14.710 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-17T17:31:14.710 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-08-17T17:31:14.710 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-17T17:31:14.710 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-17T17:31:14.710 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-17T17:31:14.711 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-17T17:31:14.711 INFO:teuthology.orchestra.run.smithi078.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-08-17T17:31:14.711 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-17T17:31:14.711 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-17T17:31:14.711 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-17T17:31:14.711 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-17T17:31:14.711 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 45 k 2023-08-17T17:31:14.711 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 98 k 2023-08-17T17:31:14.712 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-17T17:31:14.712 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-17T17:31:14.712 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-17T17:31:14.712 INFO:teuthology.orchestra.run.smithi078.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-08-17T17:31:14.712 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-17T17:31:14.712 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-17T17:31:14.712 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-17T17:31:14.713 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-17T17:31:14.713 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-17T17:31:14.713 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-17T17:31:14.713 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-17T17:31:14.713 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-17T17:31:14.713 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-17T17:31:14.713 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-17T17:31:14.713 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-17T17:31:14.714 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-17T17:31:14.714 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-17T17:31:14.714 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-17T17:31:14.714 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-17T17:31:14.714 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-17T17:31:14.714 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-17T17:31:14.715 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-17T17:31:14.715 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-17T17:31:14.715 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-17T17:31:14.715 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-17T17:31:14.715 INFO:teuthology.orchestra.run.smithi078.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-08-17T17:31:14.715 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-17T17:31:14.715 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-17T17:31:14.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-17T17:31:14.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-17T17:31:14.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-08-17T17:31:14.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-17T17:31:14.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-17T17:31:14.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-17T17:31:14.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-17T17:31:14.717 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-17T17:31:14.717 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-17T17:31:14.717 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-17T17:31:14.717 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-17T17:31:14.717 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-17T17:31:14.717 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-17T17:31:14.717 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-08-17T17:31:14.718 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-17T17:31:14.718 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-17T17:31:14.718 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:31:14.718 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2023-08-17T17:31:14.718 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================================================== 2023-08-17T17:31:14.718 INFO:teuthology.orchestra.run.smithi078.stdout:Install 118 Packages 2023-08-17T17:31:14.718 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 2 Packages 2023-08-17T17:31:14.718 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:31:14.719 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 201 M 2023-08-17T17:31:14.719 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2023-08-17T17:31:14.996 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-17T17:31:14.997 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-17T17:31:15.008 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-08-17T17:31:15.008 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-08-17T17:31:15.009 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-08-17T17:31:15.010 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-17T17:31:15.012 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-17T17:31:15.014 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-08-17T17:31:15.015 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-08-17T17:31:15.325 INFO:teuthology.orchestra.run.smithi078.stdout:(1/120): ceph-16.2.13-522.g23c07d8f.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-08-17T17:31:15.520 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-08-17T17:31:15.531 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================================================== 2023-08-17T17:31:15.531 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-08-17T17:31:15.531 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================================================== 2023-08-17T17:31:15.531 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-08-17T17:31:15.532 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-17T17:31:15.532 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 6.4 k 2023-08-17T17:31:15.532 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 6.1 M 2023-08-17T17:31:15.532 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 910 k 2023-08-17T17:31:15.532 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 161 k 2023-08-17T17:31:15.532 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 1.6 M 2023-08-17T17:31:15.533 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 116 k 2023-08-17T17:31:15.533 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 3.1 M 2023-08-17T17:31:15.533 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 8.6 M 2023-08-17T17:31:15.533 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 27 k 2023-08-17T17:31:15.533 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 12 M 2023-08-17T17:31:15.533 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 52 M 2023-08-17T17:31:15.533 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 84 k 2023-08-17T17:31:15.534 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 256 k 2023-08-17T17:31:15.534 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 19 k 2023-08-17T17:31:15.534 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-08-17T17:31:15.534 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-17T17:31:15.534 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-17T17:31:15.534 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 25 k 2023-08-17T17:31:15.534 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 824 k 2023-08-17T17:31:15.535 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 131 k 2023-08-17T17:31:15.535 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-17T17:31:15.535 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-08-17T17:31:15.535 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-17T17:31:15.535 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 215 k 2023-08-17T17:31:15.535 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 389 k 2023-08-17T17:31:15.535 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 369 k 2023-08-17T17:31:15.536 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 114 k 2023-08-17T17:31:15.536 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 88 k 2023-08-17T17:31:15.536 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 3.7 M 2023-08-17T17:31:15.536 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 173 k 2023-08-17T17:31:15.536 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-08-17T17:31:15.536 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2023-08-17T17:31:15.536 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 3.7 M 2023-08-17T17:31:15.537 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 4.2 M 2023-08-17T17:31:15.537 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-08-17T17:31:15.537 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-17T17:31:15.537 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 24 M 2023-08-17T17:31:15.537 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 24 k 2023-08-17T17:31:15.537 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 2.4 M 2023-08-17T17:31:15.537 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 244 k 2023-08-17T17:31:15.538 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 5.0 M 2023-08-17T17:31:15.538 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 18 M 2023-08-17T17:31:15.538 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:16.2.13-522.g23c07d8f.el8 ceph-noarch 15 k 2023-08-17T17:31:15.538 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 26 k 2023-08-17T17:31:15.538 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-17T17:31:15.538 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-17T17:31:15.538 INFO:teuthology.orchestra.run.smithi150.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-08-17T17:31:15.539 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-17T17:31:15.539 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-17T17:31:15.539 INFO:teuthology.orchestra.run.smithi150.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-08-17T17:31:15.539 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 174 k 2023-08-17T17:31:15.539 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-08-17T17:31:15.539 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-08-17T17:31:15.539 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-17T17:31:15.540 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-08-17T17:31:15.540 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-17T17:31:15.540 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 493 k 2023-08-17T17:31:15.540 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-08-17T17:31:15.540 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 3.8 M 2023-08-17T17:31:15.540 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-17T17:31:15.540 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-08-17T17:31:15.541 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-17T17:31:15.541 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-17T17:31:15.541 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-17T17:31:15.541 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-17T17:31:15.541 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-08-17T17:31:15.541 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-17T17:31:15.542 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-17T17:31:15.542 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-17T17:31:15.542 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-17T17:31:15.542 INFO:teuthology.orchestra.run.smithi150.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-08-17T17:31:15.542 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-17T17:31:15.542 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-17T17:31:15.542 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-17T17:31:15.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-17T17:31:15.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 45 k 2023-08-17T17:31:15.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:16.2.13-522.g23c07d8f.el8 ceph 98 k 2023-08-17T17:31:15.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-17T17:31:15.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-17T17:31:15.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-17T17:31:15.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-08-17T17:31:15.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-17T17:31:15.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-17T17:31:15.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-17T17:31:15.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-17T17:31:15.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-17T17:31:15.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-17T17:31:15.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-17T17:31:15.545 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-17T17:31:15.545 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-17T17:31:15.545 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-17T17:31:15.545 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-17T17:31:15.545 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-17T17:31:15.545 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-17T17:31:15.545 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-17T17:31:15.546 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-17T17:31:15.546 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-17T17:31:15.546 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-17T17:31:15.546 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-17T17:31:15.546 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-17T17:31:15.546 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-17T17:31:15.546 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-17T17:31:15.546 INFO:teuthology.orchestra.run.smithi150.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-08-17T17:31:15.547 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-17T17:31:15.547 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-17T17:31:15.547 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-17T17:31:15.547 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-17T17:31:15.547 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-08-17T17:31:15.547 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-17T17:31:15.547 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-17T17:31:15.548 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-17T17:31:15.548 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-17T17:31:15.548 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-17T17:31:15.548 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-17T17:31:15.548 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-17T17:31:15.548 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-17T17:31:15.548 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-17T17:31:15.549 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-17T17:31:15.549 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-08-17T17:31:15.549 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-17T17:31:15.549 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-17T17:31:15.549 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:31:15.549 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-08-17T17:31:15.549 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================================================== 2023-08-17T17:31:15.550 INFO:teuthology.orchestra.run.smithi150.stdout:Install 118 Packages 2023-08-17T17:31:15.550 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 2 Packages 2023-08-17T17:31:15.550 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:31:15.550 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 201 M 2023-08-17T17:31:15.551 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-08-17T17:31:16.001 INFO:teuthology.orchestra.run.smithi150.stdout:(1/120): ceph-16.2.13-522.g23c07d8f.el8.x86_64. 15 kB/s | 6.4 kB 00:00 2023-08-17T17:31:16.081 INFO:teuthology.orchestra.run.smithi078.stdout:(2/120): ceph-fuse-16.2.13-522.g23c07d8f.el8.x8 1.2 MB/s | 910 kB 00:00 2023-08-17T17:31:16.228 INFO:teuthology.orchestra.run.smithi078.stdout:(3/120): ceph-immutable-object-cache-16.2.13-52 1.1 MB/s | 161 kB 00:00 2023-08-17T17:31:16.719 INFO:teuthology.orchestra.run.smithi150.stdout:(2/120): ceph-fuse-16.2.13-522.g23c07d8f.el8.x8 1.2 MB/s | 910 kB 00:00 2023-08-17T17:31:16.837 INFO:teuthology.orchestra.run.smithi150.stdout:(3/120): ceph-immutable-object-cache-16.2.13-52 1.3 MB/s | 161 kB 00:00 2023-08-17T17:31:17.555 INFO:teuthology.orchestra.run.smithi150.stdout:(4/120): ceph-mds-16.2.13-522.g23c07d8f.el8.x86 3.4 MB/s | 2.4 MB 00:00 2023-08-17T17:31:17.858 INFO:teuthology.orchestra.run.smithi078.stdout:(4/120): ceph-mds-16.2.13-522.g23c07d8f.el8.x86 1.5 MB/s | 2.4 MB 00:01 2023-08-17T17:31:17.937 INFO:teuthology.orchestra.run.smithi150.stdout:(5/120): ceph-mgr-16.2.13-522.g23c07d8f.el8.x86 4.2 MB/s | 1.6 MB 00:00 2023-08-17T17:31:18.697 INFO:teuthology.orchestra.run.smithi078.stdout:(5/120): ceph-base-16.2.13-522.g23c07d8f.el8.x8 1.7 MB/s | 6.1 MB 00:03 2023-08-17T17:31:18.861 INFO:teuthology.orchestra.run.smithi078.stdout:(6/120): ceph-mgr-16.2.13-522.g23c07d8f.el8.x86 1.6 MB/s | 1.6 MB 00:01 2023-08-17T17:31:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:(6/120): ceph-mon-16.2.13-522.g23c07d8f.el8.x86 5.3 MB/s | 5.0 MB 00:00 2023-08-17T17:31:19.463 INFO:teuthology.orchestra.run.smithi150.stdout:(7/120): ceph-base-16.2.13-522.g23c07d8f.el8.x8 1.6 MB/s | 6.1 MB 00:03 2023-08-17T17:31:20.294 INFO:teuthology.orchestra.run.smithi150.stdout:(8/120): ceph-common-16.2.13-522.g23c07d8f.el8. 5.1 MB/s | 24 MB 00:04 2023-08-17T17:31:20.351 INFO:teuthology.orchestra.run.smithi150.stdout:(9/120): ceph-selinux-16.2.13-522.g23c07d8f.el8 445 kB/s | 26 kB 00:00 2023-08-17T17:31:21.114 INFO:teuthology.orchestra.run.smithi078.stdout:(7/120): ceph-mon-16.2.13-522.g23c07d8f.el8.x86 2.1 MB/s | 5.0 MB 00:02 2023-08-17T17:31:22.708 INFO:teuthology.orchestra.run.smithi150.stdout:(10/120): ceph-osd-16.2.13-522.g23c07d8f.el8.x8 4.8 MB/s | 18 MB 00:03 2023-08-17T17:31:22.814 INFO:teuthology.orchestra.run.smithi150.stdout:(11/120): cephfs-mirror-16.2.13-522.g23c07d8f.e 2.4 MB/s | 256 kB 00:00 2023-08-17T17:31:22.910 INFO:teuthology.orchestra.run.smithi150.stdout:(12/120): libcephfs-devel-16.2.13-522.g23c07d8f 268 kB/s | 25 kB 00:00 2023-08-17T17:31:23.224 INFO:teuthology.orchestra.run.smithi150.stdout:(13/120): libcephfs2-16.2.13-522.g23c07d8f.el8. 2.6 MB/s | 824 kB 00:00 2023-08-17T17:31:23.325 INFO:teuthology.orchestra.run.smithi150.stdout:(14/120): libcephsqlite-16.2.13-522.g23c07d8f.e 1.7 MB/s | 174 kB 00:00 2023-08-17T17:31:23.419 INFO:teuthology.orchestra.run.smithi150.stdout:(15/120): librados-devel-16.2.13-522.g23c07d8f. 1.4 MB/s | 131 kB 00:00 2023-08-17T17:31:23.611 INFO:teuthology.orchestra.run.smithi150.stdout:(16/120): libradosstriper1-16.2.13-522.g23c07d8 2.5 MB/s | 493 kB 00:00 2023-08-17T17:31:24.567 INFO:teuthology.orchestra.run.smithi150.stdout:(17/120): librgw2-16.2.13-522.g23c07d8f.el8.x86 3.9 MB/s | 3.8 MB 00:00 2023-08-17T17:31:24.633 INFO:teuthology.orchestra.run.smithi150.stdout:(18/120): python3-ceph-argparse-16.2.13-522.g23 682 kB/s | 45 kB 00:00 2023-08-17T17:31:24.677 INFO:teuthology.orchestra.run.smithi078.stdout:(8/120): ceph-common-16.2.13-522.g23c07d8f.el8. 2.5 MB/s | 24 MB 00:09 2023-08-17T17:31:24.695 INFO:teuthology.orchestra.run.smithi150.stdout:(19/120): python3-ceph-common-16.2.13-522.g23c0 1.6 MB/s | 98 kB 00:00 2023-08-17T17:31:24.717 INFO:teuthology.orchestra.run.smithi078.stdout:(9/120): ceph-selinux-16.2.13-522.g23c07d8f.el8 639 kB/s | 26 kB 00:00 2023-08-17T17:31:24.764 INFO:teuthology.orchestra.run.smithi150.stdout:(20/120): python3-cephfs-16.2.13-522.g23c07d8f. 3.1 MB/s | 215 kB 00:00 2023-08-17T17:31:24.855 INFO:teuthology.orchestra.run.smithi150.stdout:(21/120): python3-rados-16.2.13-522.g23c07d8f.e 4.2 MB/s | 389 kB 00:00 2023-08-17T17:31:24.941 INFO:teuthology.orchestra.run.smithi150.stdout:(22/120): python3-rbd-16.2.13-522.g23c07d8f.el8 4.2 MB/s | 369 kB 00:00 2023-08-17T17:31:25.013 INFO:teuthology.orchestra.run.smithi150.stdout:(23/120): python3-rgw-16.2.13-522.g23c07d8f.el8 1.5 MB/s | 114 kB 00:00 2023-08-17T17:31:25.089 INFO:teuthology.orchestra.run.smithi150.stdout:(24/120): rbd-fuse-16.2.13-522.g23c07d8f.el8.x8 1.1 MB/s | 88 kB 00:00 2023-08-17T17:31:25.640 INFO:teuthology.orchestra.run.smithi150.stdout:(25/120): ceph-radosgw-16.2.13-522.g23c07d8f.el 1.9 MB/s | 12 MB 00:06 2023-08-17T17:31:25.714 INFO:teuthology.orchestra.run.smithi150.stdout:(26/120): rbd-nbd-16.2.13-522.g23c07d8f.el8.x86 2.3 MB/s | 173 kB 00:00 2023-08-17T17:31:25.782 INFO:teuthology.orchestra.run.smithi150.stdout:(27/120): ceph-grafana-dashboards-16.2.13-522.g 364 kB/s | 24 kB 00:00 2023-08-17T17:31:25.793 INFO:teuthology.orchestra.run.smithi150.stdout:(28/120): rbd-mirror-16.2.13-522.g23c07d8f.el8. 5.2 MB/s | 3.7 MB 00:00 2023-08-17T17:31:25.837 INFO:teuthology.orchestra.run.smithi150.stdout:(29/120): ceph-mgr-cephadm-16.2.13-522.g23c07d8 2.0 MB/s | 116 kB 00:00 2023-08-17T17:31:26.395 INFO:teuthology.orchestra.run.smithi150.stdout:(30/120): ceph-mgr-dashboard-16.2.13-522.g23c07 5.2 MB/s | 3.1 MB 00:00 2023-08-17T17:31:26.405 INFO:teuthology.orchestra.run.smithi078.stdout:(10/120): ceph-radosgw-16.2.13-522.g23c07d8f.el 2.2 MB/s | 12 MB 00:05 2023-08-17T17:31:26.464 INFO:teuthology.orchestra.run.smithi150.stdout:(31/120): ceph-mgr-modules-core-16.2.13-522.g23 3.5 MB/s | 244 kB 00:00 2023-08-17T17:31:26.534 INFO:teuthology.orchestra.run.smithi150.stdout:(32/120): ceph-mgr-rook-16.2.13-522.g23c07d8f.e 390 kB/s | 27 kB 00:00 2023-08-17T17:31:26.586 INFO:teuthology.orchestra.run.smithi078.stdout:(11/120): cephfs-mirror-16.2.13-522.g23c07d8f.e 1.4 MB/s | 256 kB 00:00 2023-08-17T17:31:26.596 INFO:teuthology.orchestra.run.smithi150.stdout:(33/120): ceph-prometheus-alerts-16.2.13-522.g2 240 kB/s | 15 kB 00:00 2023-08-17T17:31:26.651 INFO:teuthology.orchestra.run.smithi078.stdout:(12/120): libcephfs-devel-16.2.13-522.g23c07d8f 395 kB/s | 25 kB 00:00 2023-08-17T17:31:26.660 INFO:teuthology.orchestra.run.smithi150.stdout:(34/120): cephadm-16.2.13-522.g23c07d8f.el8.noa 1.3 MB/s | 84 kB 00:00 2023-08-17T17:31:26.731 INFO:teuthology.orchestra.run.smithi150.stdout:(35/120): cephfs-top-16.2.13-522.g23c07d8f.el8. 262 kB/s | 19 kB 00:00 2023-08-17T17:31:26.940 INFO:teuthology.orchestra.run.smithi078.stdout:(13/120): libcephfs2-16.2.13-522.g23c07d8f.el8. 2.8 MB/s | 824 kB 00:00 2023-08-17T17:31:26.997 INFO:teuthology.orchestra.run.smithi150.stdout:(36/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-08-17T17:31:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:(14/120): libcephsqlite-16.2.13-522.g23c07d8f.e 2.2 MB/s | 174 kB 00:00 2023-08-17T17:31:27.036 INFO:teuthology.orchestra.run.smithi150.stdout:(37/120): leveldb-1.22-1.el8.x86_64.rpm 4.6 MB/s | 181 kB 00:00 2023-08-17T17:31:27.072 INFO:teuthology.orchestra.run.smithi150.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.6 MB/s | 59 kB 00:00 2023-08-17T17:31:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:(15/120): librados-devel-16.2.13-522.g23c07d8f. 1.6 MB/s | 131 kB 00:00 2023-08-17T17:31:27.110 INFO:teuthology.orchestra.run.smithi150.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.9 MB/s | 75 kB 00:00 2023-08-17T17:31:27.146 INFO:teuthology.orchestra.run.smithi150.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 599 kB/s | 21 kB 00:00 2023-08-17T17:31:27.183 INFO:teuthology.orchestra.run.smithi150.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.1 MB/s | 44 kB 00:00 2023-08-17T17:31:27.225 INFO:teuthology.orchestra.run.smithi150.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 4.3 MB/s | 185 kB 00:00 2023-08-17T17:31:27.257 INFO:teuthology.orchestra.run.smithi150.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.0 MB/s | 33 kB 00:00 2023-08-17T17:31:27.294 INFO:teuthology.orchestra.run.smithi150.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 453 kB/s | 16 kB 00:00 2023-08-17T17:31:27.344 INFO:teuthology.orchestra.run.smithi078.stdout:(16/120): libradosstriper1-16.2.13-522.g23c07d8 2.0 MB/s | 493 kB 00:00 2023-08-17T17:31:27.369 INFO:teuthology.orchestra.run.smithi150.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-08-17T17:31:27.458 INFO:teuthology.orchestra.run.smithi150.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 4.2 MB/s | 384 kB 00:00 2023-08-17T17:31:27.502 INFO:teuthology.orchestra.run.smithi150.stdout:(47/120): python3-execnet-1.7.1-1.el8.noarch.rp 8.0 MB/s | 355 kB 00:00 2023-08-17T17:31:27.543 INFO:teuthology.orchestra.run.smithi150.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-08-17T17:31:27.584 INFO:teuthology.orchestra.run.smithi150.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 274 kB/s | 11 kB 00:00 2023-08-17T17:31:27.631 INFO:teuthology.orchestra.run.smithi150.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 374 kB/s | 18 kB 00:00 2023-08-17T17:31:27.631 INFO:teuthology.orchestra.run.smithi078.stdout:(17/120): ceph-osd-16.2.13-522.g23c07d8f.el8.x8 2.1 MB/s | 18 MB 00:08 2023-08-17T17:31:27.672 INFO:teuthology.orchestra.run.smithi078.stdout:(18/120): python3-ceph-argparse-16.2.13-522.g23 1.1 MB/s | 45 kB 00:00 2023-08-17T17:31:27.723 INFO:teuthology.orchestra.run.smithi078.stdout:(19/120): python3-ceph-common-16.2.13-522.g23c0 1.9 MB/s | 98 kB 00:00 2023-08-17T17:31:27.815 INFO:teuthology.orchestra.run.smithi078.stdout:(20/120): python3-cephfs-16.2.13-522.g23c07d8f. 2.3 MB/s | 215 kB 00:00 2023-08-17T17:31:27.867 INFO:teuthology.orchestra.run.smithi150.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 4.9 MB/s | 1.2 MB 00:00 2023-08-17T17:31:27.910 INFO:teuthology.orchestra.run.smithi150.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-08-17T17:31:27.937 INFO:teuthology.orchestra.run.smithi078.stdout:(21/120): python3-rados-16.2.13-522.g23c07d8f.e 3.1 MB/s | 389 kB 00:00 2023-08-17T17:31:27.950 INFO:teuthology.orchestra.run.smithi150.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.5 MB/s | 59 kB 00:00 2023-08-17T17:31:28.034 INFO:teuthology.orchestra.run.smithi150.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-08-17T17:31:28.057 INFO:teuthology.orchestra.run.smithi078.stdout:(22/120): python3-rbd-16.2.13-522.g23c07d8f.el8 3.0 MB/s | 369 kB 00:00 2023-08-17T17:31:28.074 INFO:teuthology.orchestra.run.smithi150.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 390 kB/s | 16 kB 00:00 2023-08-17T17:31:28.097 INFO:teuthology.orchestra.run.smithi078.stdout:(23/120): python3-rgw-16.2.13-522.g23c07d8f.el8 2.8 MB/s | 114 kB 00:00 2023-08-17T17:31:28.114 INFO:teuthology.orchestra.run.smithi150.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 1.2 MB/s | 49 kB 00:00 2023-08-17T17:31:28.138 INFO:teuthology.orchestra.run.smithi078.stdout:(24/120): rbd-fuse-16.2.13-522.g23c07d8f.el8.x8 2.1 MB/s | 88 kB 00:00 2023-08-17T17:31:28.156 INFO:teuthology.orchestra.run.smithi150.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 814 kB/s | 34 kB 00:00 2023-08-17T17:31:28.203 INFO:teuthology.orchestra.run.smithi150.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 4.1 MB/s | 196 kB 00:00 2023-08-17T17:31:28.247 INFO:teuthology.orchestra.run.smithi150.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.4 MB/s | 64 kB 00:00 2023-08-17T17:31:28.288 INFO:teuthology.orchestra.run.smithi150.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 460 kB/s | 19 kB 00:00 2023-08-17T17:31:28.328 INFO:teuthology.orchestra.run.smithi150.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 609 kB/s | 24 kB 00:00 2023-08-17T17:31:28.367 INFO:teuthology.orchestra.run.smithi150.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 740 kB/s | 29 kB 00:00 2023-08-17T17:31:28.406 INFO:teuthology.orchestra.run.smithi150.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 710 kB/s | 27 kB 00:00 2023-08-17T17:31:28.458 INFO:teuthology.orchestra.run.smithi150.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 4.8 MB/s | 255 kB 00:00 2023-08-17T17:31:28.506 INFO:teuthology.orchestra.run.smithi150.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 5.1 MB/s | 251 kB 00:00 2023-08-17T17:31:28.547 INFO:teuthology.orchestra.run.smithi150.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.5 MB/s | 61 kB 00:00 2023-08-17T17:31:28.590 INFO:teuthology.orchestra.run.smithi150.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.9 MB/s | 85 kB 00:00 2023-08-17T17:31:28.634 INFO:teuthology.orchestra.run.smithi150.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 526 kB/s | 23 kB 00:00 2023-08-17T17:31:28.637 INFO:teuthology.orchestra.run.smithi078.stdout:(25/120): librgw2-16.2.13-522.g23c07d8f.el8.x86 2.9 MB/s | 3.8 MB 00:01 2023-08-17T17:31:28.638 INFO:teuthology.orchestra.run.smithi150.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-08-17T17:31:28.666 INFO:teuthology.orchestra.run.smithi150.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 692 kB/s | 19 kB 00:00 2023-08-17T17:31:28.678 INFO:teuthology.orchestra.run.smithi150.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.4 MB/s | 43 kB 00:00 2023-08-17T17:31:28.692 INFO:teuthology.orchestra.run.smithi150.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 11 MB/s | 155 kB 00:00 2023-08-17T17:31:28.704 INFO:teuthology.orchestra.run.smithi078.stdout:(26/120): rbd-nbd-16.2.13-522.g23c07d8f.el8.x86 2.6 MB/s | 173 kB 00:00 2023-08-17T17:31:28.707 INFO:teuthology.orchestra.run.smithi150.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 15 MB/s | 220 kB 00:00 2023-08-17T17:31:28.719 INFO:teuthology.orchestra.run.smithi150.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.9 MB/s | 48 kB 00:00 2023-08-17T17:31:28.734 INFO:teuthology.orchestra.run.smithi150.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 16 MB/s | 229 kB 00:00 2023-08-17T17:31:28.746 INFO:teuthology.orchestra.run.smithi150.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.5 MB/s | 43 kB 00:00 2023-08-17T17:31:28.767 INFO:teuthology.orchestra.run.smithi078.stdout:(27/120): ceph-grafana-dashboards-16.2.13-522.g 386 kB/s | 24 kB 00:00 2023-08-17T17:31:28.801 INFO:teuthology.orchestra.run.smithi150.stdout:(77/120): ceph-mgr-diskprediction-local-16.2.13 2.9 MB/s | 8.6 MB 00:02 2023-08-17T17:31:28.808 INFO:teuthology.orchestra.run.smithi150.stdout:(78/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 37 MB/s | 2.3 MB 00:00 2023-08-17T17:31:28.829 INFO:teuthology.orchestra.run.smithi150.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 30 MB/s | 605 kB 00:00 2023-08-17T17:31:28.831 INFO:teuthology.orchestra.run.smithi150.stdout:(80/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 594 kB/s | 18 kB 00:00 2023-08-17T17:31:28.834 INFO:teuthology.orchestra.run.smithi078.stdout:(28/120): ceph-mgr-cephadm-16.2.13-522.g23c07d8 1.7 MB/s | 116 kB 00:00 2023-08-17T17:31:28.894 INFO:teuthology.orchestra.run.smithi078.stdout:(29/120): rbd-mirror-16.2.13-522.g23c07d8f.el8. 4.9 MB/s | 3.7 MB 00:00 2023-08-17T17:31:29.218 INFO:teuthology.orchestra.run.smithi150.stdout:(81/120): ceph-test-16.2.13-522.g23c07d8f.el8.x 5.8 MB/s | 52 MB 00:08 2023-08-17T17:31:29.220 INFO:teuthology.orchestra.run.smithi150.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 151 kB/s | 59 kB 00:00 2023-08-17T17:31:29.221 INFO:teuthology.orchestra.run.smithi150.stdout:(83/120): fuse-2.9.7-12.el8.x86_64.rpm 210 kB/s | 83 kB 00:00 2023-08-17T17:31:29.234 INFO:teuthology.orchestra.run.smithi150.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.7 MB/s | 38 kB 00:00 2023-08-17T17:31:29.237 INFO:teuthology.orchestra.run.smithi150.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.5 MB/s | 86 kB 00:00 2023-08-17T17:31:29.248 INFO:teuthology.orchestra.run.smithi150.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.0 MB/s | 58 kB 00:00 2023-08-17T17:31:29.251 INFO:teuthology.orchestra.run.smithi150.stdout:(87/120): libquadmath-8.4.1-1.el8.x86_64.rpm 5.0 MB/s | 169 kB 00:00 2023-08-17T17:31:29.252 INFO:teuthology.orchestra.run.smithi150.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.0 MB/s | 47 kB 00:00 2023-08-17T17:31:29.275 INFO:teuthology.orchestra.run.smithi150.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 3.1 MB/s | 70 kB 00:00 2023-08-17T17:31:29.277 INFO:teuthology.orchestra.run.smithi150.stdout:(90/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 19 MB/s | 559 kB 00:00 2023-08-17T17:31:29.279 INFO:teuthology.orchestra.run.smithi150.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 22 MB/s | 639 kB 00:00 2023-08-17T17:31:29.291 INFO:teuthology.orchestra.run.smithi150.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 12 MB/s | 200 kB 00:00 2023-08-17T17:31:29.293 INFO:teuthology.orchestra.run.smithi150.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 6.1 MB/s | 97 kB 00:00 2023-08-17T17:31:29.305 INFO:teuthology.orchestra.run.smithi150.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 3.1 MB/s | 44 kB 00:00 2023-08-17T17:31:29.306 INFO:teuthology.orchestra.run.smithi150.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.0 MB/s | 27 kB 00:00 2023-08-17T17:31:29.322 INFO:teuthology.orchestra.run.smithi150.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 9.2 MB/s | 161 kB 00:00 2023-08-17T17:31:29.325 INFO:teuthology.orchestra.run.smithi150.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-08-17T17:31:29.344 INFO:teuthology.orchestra.run.smithi150.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 20 MB/s | 457 kB 00:00 2023-08-17T17:31:29.358 INFO:teuthology.orchestra.run.smithi150.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-08-17T17:31:29.383 INFO:teuthology.orchestra.run.smithi150.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 27 MB/s | 688 kB 00:00 2023-08-17T17:31:29.400 INFO:teuthology.orchestra.run.smithi150.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 15 MB/s | 259 kB 00:00 2023-08-17T17:31:29.427 INFO:teuthology.orchestra.run.smithi150.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 47 MB/s | 4.8 MB 00:00 2023-08-17T17:31:29.428 INFO:teuthology.orchestra.run.smithi150.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 7.8 MB/s | 225 kB 00:00 2023-08-17T17:31:29.443 INFO:teuthology.orchestra.run.smithi150.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.1 MB/s | 126 kB 00:00 2023-08-17T17:31:29.460 INFO:teuthology.orchestra.run.smithi150.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-08-17T17:31:29.480 INFO:teuthology.orchestra.run.smithi150.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 25 MB/s | 538 kB 00:00 2023-08-17T17:31:29.504 INFO:teuthology.orchestra.run.smithi150.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 49 MB/s | 3.7 MB 00:00 2023-08-17T17:31:29.507 INFO:teuthology.orchestra.run.smithi150.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 11 MB/s | 302 kB 00:00 2023-08-17T17:31:29.614 INFO:teuthology.orchestra.run.smithi150.stdout:(109/120): python3-scipy-1.0.0-20.module+el8.1. 44 MB/s | 15 MB 00:00 2023-08-17T17:31:29.616 INFO:teuthology.orchestra.run.smithi150.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 1.0 MB/s | 110 kB 00:00 2023-08-17T17:31:29.617 INFO:teuthology.orchestra.run.smithi150.stdout:(111/120): python3-mako-1.0.6-13.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2023-08-17T17:31:29.628 INFO:teuthology.orchestra.run.smithi078.stdout:(30/120): ceph-mgr-dashboard-16.2.13-522.g23c07 3.9 MB/s | 3.1 MB 00:00 2023-08-17T17:31:29.630 INFO:teuthology.orchestra.run.smithi150.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.4 MB/s | 20 kB 00:00 2023-08-17T17:31:29.632 INFO:teuthology.orchestra.run.smithi150.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 20 MB/s | 353 kB 00:00 2023-08-17T17:31:29.640 INFO:teuthology.orchestra.run.smithi150.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 31 MB/s | 709 kB 00:00 2023-08-17T17:31:29.643 INFO:teuthology.orchestra.run.smithi150.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.0 MB/s | 54 kB 00:00 2023-08-17T17:31:29.670 INFO:teuthology.orchestra.run.smithi150.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 27 MB/s | 713 kB 00:00 2023-08-17T17:31:29.689 INFO:teuthology.orchestra.run.smithi078.stdout:(31/120): ceph-mgr-modules-core-16.2.13-522.g23 3.9 MB/s | 244 kB 00:00 2023-08-17T17:31:29.716 INFO:teuthology.orchestra.run.smithi150.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 56 MB/s | 4.7 MB 00:00 2023-08-17T17:31:29.736 INFO:teuthology.orchestra.run.smithi150.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 48 MB/s | 4.6 MB 00:00 2023-08-17T17:31:29.743 INFO:teuthology.orchestra.run.smithi078.stdout:(32/120): ceph-mgr-rook-16.2.13-522.g23c07d8f.e 511 kB/s | 27 kB 00:00 2023-08-17T17:31:29.813 INFO:teuthology.orchestra.run.smithi078.stdout:(33/120): ceph-mgr-diskprediction-local-16.2.13 9.3 MB/s | 8.6 MB 00:00 2023-08-17T17:31:29.814 INFO:teuthology.orchestra.run.smithi078.stdout:(34/120): ceph-prometheus-alerts-16.2.13-522.g2 210 kB/s | 15 kB 00:00 2023-08-17T17:31:29.837 INFO:teuthology.orchestra.run.smithi078.stdout:(35/120): cephadm-16.2.13-522.g23c07d8f.el8.noa 3.5 MB/s | 84 kB 00:00 2023-08-17T17:31:29.868 INFO:teuthology.orchestra.run.smithi078.stdout:(36/120): cephfs-top-16.2.13-522.g23c07d8f.el8. 348 kB/s | 19 kB 00:00 2023-08-17T17:31:30.427 INFO:teuthology.orchestra.run.smithi150.stdout:(119/120): librados2-16.2.13-522.g23c07d8f.el8. 4.9 MB/s | 3.7 MB 00:00 2023-08-17T17:31:30.848 INFO:teuthology.orchestra.run.smithi150.stdout:(120/120): librbd1-16.2.13-522.g23c07d8f.el8.x8 3.7 MB/s | 4.2 MB 00:01 2023-08-17T17:31:30.854 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-08-17T17:31:30.854 INFO:teuthology.orchestra.run.smithi150.stdout:Total 13 MB/s | 201 MB 00:15 2023-08-17T17:31:30.904 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-08-17T17:31:31.018 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-08-17T17:31:31.018 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-08-17T17:31:31.524 INFO:teuthology.orchestra.run.smithi078.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 182 kB/s | 306 kB 00:01 2023-08-17T17:31:32.388 INFO:teuthology.orchestra.run.smithi078.stdout:(38/120): ceph-test-16.2.13-522.g23c07d8f.el8.x 6.7 MB/s | 52 MB 00:07 2023-08-17T17:31:33.117 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-08-17T17:31:33.121 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-08-17T17:31:34.464 INFO:teuthology.orchestra.run.smithi078.stdout:(39/120): leveldb-1.22-1.el8.x86_64.rpm 39 kB/s | 181 kB 00:04 2023-08-17T17:31:37.848 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-08-17T17:31:38.058 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-08-17T17:31:38.832 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-08-17T17:31:39.014 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-08-17T17:31:39.104 INFO:teuthology.orchestra.run.smithi078.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 4.6 kB/s | 21 kB 00:04 2023-08-17T17:31:39.177 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-08-17T17:31:39.431 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-08-17T17:31:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:(41/120): liboath-2.6.2-3.el8.x86_64.rpm 7.2 kB/s | 59 kB 00:08 2023-08-17T17:31:39.808 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-08-17T17:31:40.056 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:16.2.13-522.g23c07d8f.el8.x86_64 5/122 2023-08-17T17:31:40.473 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:16.2.13-522.g23c07d8f.el8.x86_64 5/122 2023-08-17T17:31:40.608 INFO:teuthology.orchestra.run.smithi078.stdout:(42/120): libunwind-1.3.1-3.el8.x86_64.rpm 9.1 kB/s | 75 kB 00:08 2023-08-17T17:31:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:16.2.13-522.g23c07d8f.el8.x86_64 6/122 2023-08-17T17:31:40.841 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:16.2.13-522.g23c07d8f.el8.x86_64 6/122 2023-08-17T17:31:41.056 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:16.2.13-522.g23c07d8f.el8.x86_64 7/122 2023-08-17T17:31:41.138 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:16.2.13-522.g23c07d8f.el8.x86_64 7/122 2023-08-17T17:31:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:(43/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 20 kB/s | 44 kB 00:02 2023-08-17T17:31:41.292 INFO:teuthology.orchestra.run.smithi078.stdout:(44/120): python3-beautifulsoup4-4.6.3-2.el8.1. 112 kB/s | 185 kB 00:01 2023-08-17T17:31:41.369 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:16.2.13-522.g23c07d8f.el8.x86_64 8/122 2023-08-17T17:31:41.886 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/122 2023-08-17T17:31:42.055 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:16.2.13-522.g23c07d8f.el8.x86_64 10/122 2023-08-17T17:31:42.211 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:16.2.13-522.g23c07d8f.el8.x86_64 10/122 2023-08-17T17:31:42.510 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-08-17T17:31:42.726 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-08-17T17:31:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:16.2.13-522.g23c07d8f.el8.x86_64 13/122 2023-08-17T17:31:42.999 INFO:teuthology.orchestra.run.smithi078.stdout:(45/120): python3-cachetools-3.1.1-4.el8.noarch 14 kB/s | 33 kB 00:02 2023-08-17T17:31:43.053 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:16.2.13-522.g23c07d8f.el8.x86_64 13/122 2023-08-17T17:31:43.205 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:16.2.13-522.g23c07d8f.el8.x86 14/122 2023-08-17T17:31:43.282 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:16.2.13-522.g23c07d8f.el8.x86 14/122 2023-08-17T17:31:43.300 INFO:teuthology.orchestra.run.smithi078.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 86 kB/s | 173 kB 00:02 2023-08-17T17:31:43.493 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-08-17T17:31:43.843 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-08-17T17:31:44.371 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-08-17T17:31:44.499 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-08-17T17:31:44.595 INFO:teuthology.orchestra.run.smithi078.stdout:(47/120): python3-certifi-2018.10.15-7.el8.noar 4.9 kB/s | 16 kB 00:03 2023-08-17T17:31:44.664 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-08-17T17:31:44.802 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-08-17T17:31:44.988 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-08-17T17:31:45.535 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-08-17T17:31:45.673 INFO:teuthology.orchestra.run.smithi078.stdout:(48/120): python3-execnet-1.7.1-1.el8.noarch.rp 150 kB/s | 355 kB 00:02 2023-08-17T17:31:45.705 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-08-17T17:31:45.813 INFO:teuthology.orchestra.run.smithi078.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 80 kB/s | 11 kB 00:00 2023-08-17T17:31:46.260 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-08-17T17:31:46.463 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-08-17T17:31:46.592 INFO:teuthology.orchestra.run.smithi078.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 23 kB/s | 18 kB 00:00 2023-08-17T17:31:47.183 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-08-17T17:31:47.467 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-08-17T17:31:47.740 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-08-17T17:31:48.002 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-08-17T17:31:48.049 INFO:teuthology.orchestra.run.smithi078.stdout:(51/120): python3-google-auth-1.1.1-10.el8.noar 24 kB/s | 81 kB 00:03 2023-08-17T17:31:48.161 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:16.2.13-522.g23c07d8f.el8. 26/122 2023-08-17T17:31:48.328 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:16.2.13-522.g23c07d8f.el 27/122 2023-08-17T17:31:48.630 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:16.2.13-522.g23c07d8f.el8.x86_6 28/122 2023-08-17T17:31:48.903 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-08-17T17:31:49.204 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-08-17T17:31:49.463 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-08-17T17:31:51.516 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-08-17T17:31:51.895 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-08-17T17:31:52.039 INFO:teuthology.orchestra.run.smithi078.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 219 kB/s | 1.2 MB 00:05 2023-08-17T17:31:52.212 INFO:teuthology.orchestra.run.smithi078.stdout:(53/120): python3-logutils-0.3.5-11.el8.noarch. 12 kB/s | 49 kB 00:04 2023-08-17T17:31:52.916 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-08-17T17:31:53.308 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-08-17T17:31:53.514 INFO:teuthology.orchestra.run.smithi078.stdout:(54/120): python3-cherrypy-18.4.0-1.el8.noarch. 37 kB/s | 384 kB 00:10 2023-08-17T17:31:53.583 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-08-17T17:31:53.852 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-08-17T17:31:54.083 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-08-17T17:31:54.322 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:16.2.13-522.g23c07d8f.el8.x86_64 38/122 2023-08-17T17:31:54.550 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:16.2.13-522.g23c07d8f.el8.x86_64 39/122 2023-08-17T17:31:54.816 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:16.2.13-522.g23c07d8f.el8.x86_6 40/122 2023-08-17T17:31:55.035 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-08-17T17:31:55.245 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-08-17T17:31:55.451 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-08-17T17:31:55.657 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-08-17T17:31:55.768 INFO:teuthology.orchestra.run.smithi078.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 6.9 kB/s | 16 kB 00:02 2023-08-17T17:31:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-08-17T17:31:55.940 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-08-17T17:31:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-08-17T17:31:56.187 INFO:teuthology.orchestra.run.smithi078.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 117 kB/s | 49 kB 00:00 2023-08-17T17:31:56.313 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-08-17T17:31:56.460 INFO:teuthology.orchestra.run.smithi078.stdout:(57/120): python3-more-itertools-7.2.0-3.el8.no 13 kB/s | 59 kB 00:04 2023-08-17T17:31:56.483 INFO:teuthology.orchestra.run.smithi078.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 114 kB/s | 34 kB 00:00 2023-08-17T17:31:56.536 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-08-17T17:31:56.735 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-08-17T17:31:56.880 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-08-17T17:31:57.064 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-08-17T17:31:57.191 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-08-17T17:31:57.368 INFO:teuthology.orchestra.run.smithi078.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 73 kB/s | 64 kB 00:00 2023-08-17T17:31:57.404 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-08-17T17:31:57.549 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-08-17T17:31:57.743 INFO:teuthology.orchestra.run.smithi078.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 50 kB/s | 19 kB 00:00 2023-08-17T17:31:57.898 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-08-17T17:31:58.175 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-08-17T17:31:58.463 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-08-17T17:31:58.736 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-08-17T17:31:58.920 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-08-17T17:31:59.083 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-08-17T17:31:59.337 INFO:teuthology.orchestra.run.smithi078.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 15 kB/s | 24 kB 00:01 2023-08-17T17:31:59.375 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-08-17T17:31:59.628 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-08-17T17:31:59.641 INFO:teuthology.orchestra.run.smithi078.stdout:(62/120): python3-routes-2.4.1-12.el8.noarch.rp 62 kB/s | 196 kB 00:03 2023-08-17T17:31:59.672 INFO:teuthology.orchestra.run.smithi078.stdout:(63/120): python3-pecan-1.3.2-9.el8.noarch.rpm 38 kB/s | 283 kB 00:07 2023-08-17T17:31:59.877 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-08-17T17:32:00.025 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-08-17T17:32:00.206 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-08-17T17:32:00.447 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-08-17T17:32:00.700 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-08-17T17:32:00.874 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-08-17T17:32:00.917 INFO:teuthology.orchestra.run.smithi078.stdout:(64/120): python3-tempora-1.14.1-5.el8.noarch.r 18 kB/s | 29 kB 00:01 2023-08-17T17:32:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-08-17T17:32:01.345 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-08-17T17:32:01.514 INFO:teuthology.orchestra.run.smithi078.stdout:(65/120): python3-trustme-0.6.0-4.el8.noarch.rp 15 kB/s | 27 kB 00:01 2023-08-17T17:32:01.534 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-08-17T17:32:01.536 INFO:teuthology.orchestra.run.smithi078.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 2.6 MB/s | 61 kB 00:00 2023-08-17T17:32:01.751 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-08-17T17:32:02.077 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-08-17T17:32:02.370 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-08-17T17:32:02.579 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-08-17T17:32:02.865 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-08-17T17:32:03.500 INFO:teuthology.orchestra.run.smithi078.stdout:(67/120): python3-waitress-1.4.3-1.el8.noarch.r 67 kB/s | 255 kB 00:03 2023-08-17T17:32:04.021 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-08-17T17:32:04.216 INFO:teuthology.orchestra.run.smithi078.stdout:(68/120): python3-webob-1.8.5-1.el8.1.noarch.rp 76 kB/s | 251 kB 00:03 2023-08-17T17:32:04.221 INFO:teuthology.orchestra.run.smithi078.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-08-17T17:32:04.252 INFO:teuthology.orchestra.run.smithi078.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 609 kB/s | 19 kB 00:00 2023-08-17T17:32:04.266 INFO:teuthology.orchestra.run.smithi078.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.0 MB/s | 43 kB 00:00 2023-08-17T17:32:04.282 INFO:teuthology.orchestra.run.smithi078.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 10 MB/s | 155 kB 00:00 2023-08-17T17:32:04.297 INFO:teuthology.orchestra.run.smithi078.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 14 MB/s | 220 kB 00:00 2023-08-17T17:32:04.310 INFO:teuthology.orchestra.run.smithi078.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.6 MB/s | 48 kB 00:00 2023-08-17T17:32:04.325 INFO:teuthology.orchestra.run.smithi078.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-08-17T17:32:04.334 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-08-17T17:32:04.339 INFO:teuthology.orchestra.run.smithi078.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.1 MB/s | 43 kB 00:00 2023-08-17T17:32:04.378 INFO:teuthology.orchestra.run.smithi078.stdout:(77/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 59 MB/s | 2.3 MB 00:00 2023-08-17T17:32:04.391 INFO:teuthology.orchestra.run.smithi078.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.4 MB/s | 18 kB 00:00 2023-08-17T17:32:04.410 INFO:teuthology.orchestra.run.smithi078.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 33 MB/s | 605 kB 00:00 2023-08-17T17:32:04.423 INFO:teuthology.orchestra.run.smithi078.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 6.3 MB/s | 83 kB 00:00 2023-08-17T17:32:04.435 INFO:teuthology.orchestra.run.smithi078.stdout:(81/120): elfutils-libelf-devel-0.182-3.el8.x86 4.8 MB/s | 59 kB 00:00 2023-08-17T17:32:04.449 INFO:teuthology.orchestra.run.smithi078.stdout:(82/120): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2023-08-17T17:32:04.461 INFO:teuthology.orchestra.run.smithi078.stdout:(83/120): libcom_err-devel-1.45.6-1.el8.x86_64. 3.1 MB/s | 38 kB 00:00 2023-08-17T17:32:04.474 INFO:teuthology.orchestra.run.smithi078.stdout:(84/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.8 MB/s | 86 kB 00:00 2023-08-17T17:32:04.488 INFO:teuthology.orchestra.run.smithi078.stdout:(85/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.9 MB/s | 58 kB 00:00 2023-08-17T17:32:04.502 INFO:teuthology.orchestra.run.smithi078.stdout:(86/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.3 MB/s | 47 kB 00:00 2023-08-17T17:32:04.522 INFO:teuthology.orchestra.run.smithi078.stdout:(87/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 28 MB/s | 559 kB 00:00 2023-08-17T17:32:04.542 INFO:teuthology.orchestra.run.smithi078.stdout:(88/120): libgfortran-8.4.1-1.el8.x86_64.rpm 32 MB/s | 639 kB 00:00 2023-08-17T17:32:04.554 INFO:teuthology.orchestra.run.smithi078.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.5 MB/s | 70 kB 00:00 2023-08-17T17:32:04.568 INFO:teuthology.orchestra.run.smithi078.stdout:(90/120): libselinux-devel-2.9-5.el8.x86_64.rpm 14 MB/s | 200 kB 00:00 2023-08-17T17:32:04.581 INFO:teuthology.orchestra.run.smithi078.stdout:(91/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 7.4 MB/s | 97 kB 00:00 2023-08-17T17:32:04.605 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-08-17T17:32:04.831 INFO:teuthology.orchestra.run.smithi078.stdout:(92/120): python3-scipy-1.0.0-20.module+el8.1.0 58 MB/s | 15 MB 00:00 2023-08-17T17:32:04.844 INFO:teuthology.orchestra.run.smithi078.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.4 MB/s | 44 kB 00:00 2023-08-17T17:32:04.856 INFO:teuthology.orchestra.run.smithi078.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.2 MB/s | 27 kB 00:00 2023-08-17T17:32:04.868 INFO:teuthology.orchestra.run.smithi078.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 13 MB/s | 161 kB 00:00 2023-08-17T17:32:04.883 INFO:teuthology.orchestra.run.smithi078.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 22 MB/s | 320 kB 00:00 2023-08-17T17:32:04.899 INFO:teuthology.orchestra.run.smithi078.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 29 MB/s | 457 kB 00:00 2023-08-17T17:32:04.961 INFO:teuthology.orchestra.run.smithi078.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 77 MB/s | 4.8 MB 00:00 2023-08-17T17:32:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-08-17T17:32:04.973 INFO:teuthology.orchestra.run.smithi078.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.2 MB/s | 39 kB 00:00 2023-08-17T17:32:04.991 INFO:teuthology.orchestra.run.smithi078.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 38 MB/s | 688 kB 00:00 2023-08-17T17:32:05.006 INFO:teuthology.orchestra.run.smithi078.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 18 MB/s | 259 kB 00:00 2023-08-17T17:32:05.020 INFO:teuthology.orchestra.run.smithi078.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 16 MB/s | 225 kB 00:00 2023-08-17T17:32:05.032 INFO:teuthology.orchestra.run.smithi078.stdout:(103/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 9.9 MB/s | 126 kB 00:00 2023-08-17T17:32:05.082 INFO:teuthology.orchestra.run.smithi078.stdout:(104/120): python3-numpy-1.14.3-9.el8.x86_64.rp 76 MB/s | 3.7 MB 00:00 2023-08-17T17:32:05.096 INFO:teuthology.orchestra.run.smithi078.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-08-17T17:32:05.112 INFO:teuthology.orchestra.run.smithi078.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 33 MB/s | 538 kB 00:00 2023-08-17T17:32:05.127 INFO:teuthology.orchestra.run.smithi078.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 21 MB/s | 302 kB 00:00 2023-08-17T17:32:05.138 INFO:teuthology.orchestra.run.smithi078.stdout:(108/120): python3-mako-1.0.6-13.el8.noarch.rpm 12 MB/s | 157 kB 00:00 2023-08-17T17:32:05.152 INFO:teuthology.orchestra.run.smithi078.stdout:(109/120): python3-pyasn1-modules-0.3.7-6.el8.n 8.0 MB/s | 110 kB 00:00 2023-08-17T17:32:05.168 INFO:teuthology.orchestra.run.smithi078.stdout:(110/120): librdkafka-0.11.4-1.el8.x86_64.rpm 22 MB/s | 353 kB 00:00 2023-08-17T17:32:05.180 INFO:teuthology.orchestra.run.smithi078.stdout:(111/120): python3-jsonpointer-1.10-11.el8.noar 1.6 MB/s | 20 kB 00:00 2023-08-17T17:32:05.199 INFO:teuthology.orchestra.run.smithi078.stdout:(112/120): libtool-2.4.6-25.el8.x86_64.rpm 37 MB/s | 709 kB 00:00 2023-08-17T17:32:05.212 INFO:teuthology.orchestra.run.smithi078.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.2 MB/s | 54 kB 00:00 2023-08-17T17:32:05.272 INFO:teuthology.orchestra.run.smithi078.stdout:(114/120): openblas-threads-0.3.12-1.el8.x86_64 78 MB/s | 4.7 MB 00:00 2023-08-17T17:32:05.279 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-08-17T17:32:05.332 INFO:teuthology.orchestra.run.smithi078.stdout:(115/120): openblas-0.3.12-1.el8.x86_64.rpm 78 MB/s | 4.6 MB 00:00 2023-08-17T17:32:05.348 INFO:teuthology.orchestra.run.smithi078.stdout:(116/120): python3-webtest-2.0.33-1.el8.noarch. 22 kB/s | 85 kB 00:03 2023-08-17T17:32:05.352 INFO:teuthology.orchestra.run.smithi078.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 34 MB/s | 713 kB 00:00 2023-08-17T17:32:05.543 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-08-17T17:32:05.597 INFO:teuthology.orchestra.run.smithi078.stdout:(118/120): python3-zc-lockfile-2.0-2.el8.noarch 11 kB/s | 23 kB 00:02 2023-08-17T17:32:05.785 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-08-17T17:32:05.839 INFO:teuthology.orchestra.run.smithi078.stdout:(119/120): librados2-16.2.13-522.g23c07d8f.el8. 7.6 MB/s | 3.7 MB 00:00 2023-08-17T17:32:06.051 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-08-17T17:32:06.149 INFO:teuthology.orchestra.run.smithi078.stdout:(120/120): librbd1-16.2.13-522.g23c07d8f.el8.x8 5.2 MB/s | 4.2 MB 00:00 2023-08-17T17:32:06.152 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2023-08-17T17:32:06.152 INFO:teuthology.orchestra.run.smithi078.stdout:Total 3.9 MB/s | 201 MB 00:51 2023-08-17T17:32:06.198 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2023-08-17T17:32:06.252 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-08-17T17:32:06.310 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2023-08-17T17:32:06.310 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2023-08-17T17:32:06.453 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-08-17T17:32:06.686 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-08-17T17:32:08.050 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2023-08-17T17:32:08.055 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2023-08-17T17:32:11.821 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 88/122 2023-08-17T17:32:12.097 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 88/122 2023-08-17T17:32:12.558 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2023-08-17T17:32:12.784 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-08-17T17:32:12.819 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 88/122 2023-08-17T17:32:13.035 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-08-17T17:32:13.194 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:16.2.13-522.g23c07d8f.el8.x86_64 89/122 2023-08-17T17:32:13.203 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-08-17T17:32:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:16.2.13-522.g23c07d8f.el8.x86_64 89/122 2023-08-17T17:32:13.338 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-08-17T17:32:13.435 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:16.2.13-522.g23c07d8f.el8.x86_64 90/122 2023-08-17T17:32:13.545 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-08-17T17:32:13.926 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-08-17T17:32:14.136 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:16.2.13-522.g23c07d8f.el8.x86_64 5/122 2023-08-17T17:32:14.550 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.13-522.g23c07d8f.el8.x86_64 5/122 2023-08-17T17:32:14.761 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:16.2.13-522.g23c07d8f.el8.x86_64 6/122 2023-08-17T17:32:14.879 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.2.13-522.g23c07d8f.el8.x86_64 6/122 2023-08-17T17:32:15.103 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:16.2.13-522.g23c07d8f.el8.x86_64 7/122 2023-08-17T17:32:15.200 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:16.2.13-522.g23c07d8f.el8.x86_64 7/122 2023-08-17T17:32:15.391 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:16.2.13-522.g23c07d8f.el8.x86_64 8/122 2023-08-17T17:32:15.899 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/122 2023-08-17T17:32:16.086 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:16.2.13-522.g23c07d8f.el8.x86_64 10/122 2023-08-17T17:32:16.198 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:16.2.13-522.g23c07d8f.el8.x86_64 10/122 2023-08-17T17:32:16.431 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-08-17T17:32:16.640 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-08-17T17:32:16.820 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:16.2.13-522.g23c07d8f.el8.x86_64 13/122 2023-08-17T17:32:16.920 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:16.2.13-522.g23c07d8f.el8.x86_64 13/122 2023-08-17T17:32:17.094 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:16.2.13-522.g23c07d8f.el8.x86 14/122 2023-08-17T17:32:17.169 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:16.2.13-522.g23c07d8f.el8.x86 14/122 2023-08-17T17:32:17.348 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-08-17T17:32:17.640 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-08-17T17:32:17.844 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-08-17T17:32:17.999 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-08-17T17:32:18.169 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-08-17T17:32:18.307 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-08-17T17:32:18.453 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-08-17T17:32:18.991 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-08-17T17:32:19.186 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-08-17T17:32:19.710 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-08-17T17:32:19.886 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-08-17T17:32:20.603 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-08-17T17:32:20.871 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-08-17T17:32:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-08-17T17:32:21.341 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-08-17T17:32:21.500 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:16.2.13-522.g23c07d8f.el8. 26/122 2023-08-17T17:32:21.675 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:16.2.13-522.g23c07d8f.el 27/122 2023-08-17T17:32:21.918 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:16.2.13-522.g23c07d8f.el8.x86_6 28/122 2023-08-17T17:32:22.166 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-08-17T17:32:22.433 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-08-17T17:32:22.710 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-08-17T17:32:24.752 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-08-17T17:32:25.115 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-08-17T17:32:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-08-17T17:32:26.470 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-08-17T17:32:26.696 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-08-17T17:32:26.930 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-08-17T17:32:27.129 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-08-17T17:32:27.382 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:16.2.13-522.g23c07d8f.el8.x86_64 38/122 2023-08-17T17:32:27.598 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:16.2.13-522.g23c07d8f.el8.x86_64 39/122 2023-08-17T17:32:27.892 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:16.2.13-522.g23c07d8f.el8.x86_6 40/122 2023-08-17T17:32:28.109 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-08-17T17:32:28.308 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-08-17T17:32:28.505 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-08-17T17:32:28.683 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-08-17T17:32:28.884 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-08-17T17:32:28.959 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-08-17T17:32:29.143 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-08-17T17:32:29.337 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-08-17T17:32:29.500 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-08-17T17:32:29.673 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-08-17T17:32:29.878 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-08-17T17:32:30.045 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-08-17T17:32:30.181 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-08-17T17:32:30.408 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-08-17T17:32:30.554 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-08-17T17:32:30.859 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-08-17T17:32:31.104 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-08-17T17:32:31.135 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:16.2.13-522.g23c07d8f.el8.x86_64 90/122 2023-08-17T17:32:31.136 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2023-08-17T17:32:31.136 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2023-08-17T17:32:31.136 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2023-08-17T17:32:31.136 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /run 2023-08-17T17:32:31.136 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2023-08-17T17:32:31.136 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2023-08-17T17:32:31.136 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2023-08-17T17:32:31.137 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2023-08-17T17:32:31.137 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2023-08-17T17:32:31.137 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:32:31.387 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-08-17T17:32:31.499 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:16.2.13-522.g23c07d8f.el8.x86_64 91/122 2023-08-17T17:32:31.638 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-08-17T17:32:31.837 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-08-17T17:32:31.944 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:16.2.13-522.g23c07d8f.el8.x86_64 91/122 2023-08-17T17:32:32.004 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-08-17T17:32:32.099 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:16.2.13-522.g23c07d8f.el8.x86_64 92/122 2023-08-17T17:32:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-08-17T17:32:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-08-17T17:32:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-08-17T17:32:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-08-17T17:32:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-08-17T17:32:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-08-17T17:32:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-08-17T17:32:33.611 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:16.2.13-522.g23c07d8f.el8.x86_64 92/122 2023-08-17T17:32:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-08-17T17:32:33.807 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:16.2.13-522.g23c07d8f.el8.x86_64 93/122 2023-08-17T17:32:33.829 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:16.2.13-522.g23c07d8f.el8.x86_64 93/122 2023-08-17T17:32:33.848 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-08-17T17:32:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-08-17T17:32:34.336 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-08-17T17:32:34.564 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-08-17T17:32:34.826 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-08-17T17:32:35.099 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-08-17T17:32:35.290 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-08-17T17:32:35.581 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-08-17T17:32:36.685 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-08-17T17:32:36.878 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:16.2.13-522.g23c07d8f.el8.noarch 94/122 2023-08-17T17:32:36.972 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-08-17T17:32:37.002 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:16.2.13-522.g23c07d8f.el8.noarch 94/122 2023-08-17T17:32:37.218 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-08-17T17:32:37.288 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:16.2.13-522.g23c07d8f.e 95/122 2023-08-17T17:32:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:16.2.13-522.g23c07d8f. 96/122 2023-08-17T17:32:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-08-17T17:32:37.673 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:16.2.13-522.g23c07d8f.el8.noa 97/122 2023-08-17T17:32:37.802 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-08-17T17:32:38.057 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-08-17T17:32:38.305 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-08-17T17:32:38.630 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.13-522.g23c07d8f.el8.noa 97/122 2023-08-17T17:32:38.631 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-08-17T17:32:38.830 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-08-17T17:32:38.915 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:16.2.13-522.g23c07d8f.el8.n 98/122 2023-08-17T17:32:39.033 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-08-17T17:32:39.250 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-08-17T17:32:39.964 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.13-522.g23c07d8f.el8.n 98/122 2023-08-17T17:32:40.156 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.13-522.g23c 99/122 2023-08-17T17:32:40.253 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.13-522.g23c 99/122 2023-08-17T17:32:40.641 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:16.2.13-522.g23c07d8f.el 100/122 2023-08-17T17:32:40.857 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:16.2.13-522.g23c07d8f.el8.x86_64 101/122 2023-08-17T17:32:40.883 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:16.2.13-522.g23c07d8f.el8.x86_64 101/122 2023-08-17T17:32:41.031 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:16.2.13-522.g23c07d8f.el8.noarch 102/122 2023-08-17T17:32:41.043 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.13-522.g23c07d8f.el8.noarch 102/122 2023-08-17T17:32:42.088 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:16.2.13-522.g23c07d8f.el8.x86_64 103/122 2023-08-17T17:32:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:16.2.13-522.g23c07d8f.el8.x86_64 104/122 2023-08-17T17:32:42.398 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:16.2.13-522.g23c07d8f.el8.x86_64 104/122 2023-08-17T17:32:42.565 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:16.2.13-522.g23c07 105/122 2023-08-17T17:32:42.607 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.13-522.g23c07 105/122 2023-08-17T17:32:42.756 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 106/122 2023-08-17T17:32:43.114 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephfs-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 106/122 2023-08-17T17:32:43.281 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 107/122 2023-08-17T17:32:44.083 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 88/122 2023-08-17T17:32:44.360 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 88/122 2023-08-17T17:32:45.077 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 88/122 2023-08-17T17:32:45.536 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:16.2.13-522.g23c07d8f.el8.x86_64 89/122 2023-08-17T17:32:45.624 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:16.2.13-522.g23c07d8f.el8.x86_64 89/122 2023-08-17T17:32:45.791 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:16.2.13-522.g23c07d8f.el8.x86_64 90/122 2023-08-17T17:32:47.830 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 107/122 2023-08-17T17:32:48.787 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:16.2.13-522.g23c07d8f.el8.x86_64 108/122 2023-08-17T17:32:49.130 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-08-17T17:32:49.308 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 110/122 2023-08-17T17:32:49.583 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-08-17T17:32:49.788 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-08-17T17:32:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-08-17T17:32:49.975 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:16.2.13-522.g23c07d8f.el8.x86_ 113/122 2023-08-17T17:32:50.160 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-08-17T17:32:50.372 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-top-2:16.2.13-522.g23c07d8f.el8.noarch 115/122 2023-08-17T17:32:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 116/122 2023-08-17T17:32:50.810 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:16.2.13-522.g23c07d8f.el8.x86_64 117/122 2023-08-17T17:32:51.004 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-08-17T17:32:51.065 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-08-17T17:32:51.271 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-08-17T17:32:51.280 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-08-17T17:32:51.398 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-08-17T17:32:51.399 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-08-17T17:32:51.633 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-08-17T17:32:51.633 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-08-17T17:32:52.534 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-08-17T17:32:52.535 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:16.2.13-522.g23c07d8f.el8.x86_64 1/122 2023-08-17T17:32:52.535 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:16.2.13-522.g23c07d8f.el8.x86_64 2/122 2023-08-17T17:32:52.535 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 3/122 2023-08-17T17:32:52.535 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 4/122 2023-08-17T17:32:52.535 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:16.2.13-522.g23c07 5/122 2023-08-17T17:32:52.535 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:16.2.13-522.g23c07d8f.el8.x86_64 6/122 2023-08-17T17:32:52.536 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:16.2.13-522.g23c07d8f.el8.x86_64 7/122 2023-08-17T17:32:52.536 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:16.2.13-522.g23c07d8f.el8.x86_64 8/122 2023-08-17T17:32:52.536 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:16.2.13-522.g23c07d8f.el8.x86_64 9/122 2023-08-17T17:32:52.536 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:16.2.13-522.g23c07d8f.el8.x86_64 10/122 2023-08-17T17:32:52.536 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:16.2.13-522.g23c07d8f.el8.x86_64 11/122 2023-08-17T17:32:52.536 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:16.2.13-522.g23c07d8f.el8.x86_64 12/122 2023-08-17T17:32:52.536 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 13/122 2023-08-17T17:32:52.537 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:16.2.13-522.g23c07d8f.el8.x86_ 14/122 2023-08-17T17:32:52.537 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:16.2.13-522.g23c07d8f.el8.x86_64 15/122 2023-08-17T17:32:52.537 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:16.2.13-522.g23c07d8f.el8.x86_64 16/122 2023-08-17T17:32:52.537 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:16.2.13-522.g23c07d8f.el8.x86_6 17/122 2023-08-17T17:32:52.537 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:16.2.13-522.g23c07d8f.el8.x86 18/122 2023-08-17T17:32:52.537 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:16.2.13-522.g23c07d8f.el8.x86_64 19/122 2023-08-17T17:32:52.537 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:16.2.13-522.g23c07d8f.el 20/122 2023-08-17T17:32:52.538 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:16.2.13-522.g23c07d8f.el8. 21/122 2023-08-17T17:32:52.538 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:16.2.13-522.g23c07d8f.el8.x86_6 22/122 2023-08-17T17:32:52.538 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:16.2.13-522.g23c07d8f.el8.x86_64 23/122 2023-08-17T17:32:52.538 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:16.2.13-522.g23c07d8f.el8.x86_64 24/122 2023-08-17T17:32:52.538 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:16.2.13-522.g23c07d8f.el8.x86_64 25/122 2023-08-17T17:32:52.538 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 26/122 2023-08-17T17:32:52.538 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 27/122 2023-08-17T17:32:52.545 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:16.2.13-522.g23c07d8f.el8.x86_64 28/122 2023-08-17T17:32:52.545 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:16.2.13-522.g23c07d8f. 29/122 2023-08-17T17:32:52.545 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:16.2.13-522.g23c07d8f.el8.noa 30/122 2023-08-17T17:32:52.545 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:16.2.13-522.g23c07d8f.el8.n 31/122 2023-08-17T17:32:52.546 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.13-522.g23c 32/122 2023-08-17T17:32:52.546 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:16.2.13-522.g23c07d8f.el 33/122 2023-08-17T17:32:52.546 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:16.2.13-522.g23c07d8f.el8.noarch 34/122 2023-08-17T17:32:52.546 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:16.2.13-522.g23c07d8f.e 35/122 2023-08-17T17:32:52.546 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:16.2.13-522.g23c07d8f.el8.noarch 36/122 2023-08-17T17:32:52.546 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-top-2:16.2.13-522.g23c07d8f.el8.noarch 37/122 2023-08-17T17:32:52.546 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-08-17T17:32:52.547 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-08-17T17:32:52.547 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-08-17T17:32:52.547 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-08-17T17:32:52.547 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-08-17T17:32:52.547 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-08-17T17:32:52.547 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-08-17T17:32:52.547 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-08-17T17:32:52.548 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-08-17T17:32:52.548 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-08-17T17:32:52.548 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-08-17T17:32:52.548 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-08-17T17:32:52.548 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-08-17T17:32:52.548 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-08-17T17:32:52.548 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-08-17T17:32:52.549 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-08-17T17:32:52.549 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-08-17T17:32:52.549 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-08-17T17:32:52.549 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-08-17T17:32:52.549 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-08-17T17:32:52.549 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-08-17T17:32:52.549 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-08-17T17:32:52.550 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-08-17T17:32:52.550 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-08-17T17:32:52.550 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-08-17T17:32:52.550 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-08-17T17:32:52.550 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-08-17T17:32:52.550 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-08-17T17:32:52.550 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-08-17T17:32:52.551 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-08-17T17:32:52.551 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-08-17T17:32:52.551 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-08-17T17:32:52.551 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-08-17T17:32:52.551 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-08-17T17:32:52.551 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-08-17T17:32:52.551 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-08-17T17:32:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-08-17T17:32:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-08-17T17:32:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-08-17T17:32:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-08-17T17:32:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-08-17T17:32:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-08-17T17:32:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-08-17T17:32:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-08-17T17:32:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-08-17T17:32:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-08-17T17:32:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-08-17T17:32:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-08-17T17:32:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-08-17T17:32:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-08-17T17:32:52.554 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-08-17T17:32:52.554 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-08-17T17:32:52.554 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-08-17T17:32:52.554 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-08-17T17:32:52.554 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-08-17T17:32:52.554 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-08-17T17:32:52.554 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-08-17T17:32:52.555 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-08-17T17:32:52.555 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-08-17T17:32:52.555 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-08-17T17:32:52.555 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-08-17T17:32:52.555 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-08-17T17:32:52.555 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-08-17T17:32:52.555 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-08-17T17:32:52.556 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-08-17T17:32:52.556 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-08-17T17:32:52.556 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-08-17T17:32:52.556 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-08-17T17:32:52.556 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-08-17T17:32:52.556 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-08-17T17:32:52.556 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-08-17T17:32:52.557 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-08-17T17:32:52.557 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-08-17T17:32:52.557 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-08-17T17:32:52.557 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-08-17T17:32:52.557 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-08-17T17:32:52.557 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-08-17T17:32:52.557 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-08-17T17:32:52.557 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-08-17T17:32:52.558 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-08-17T17:32:52.558 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-08-17T17:32:52.558 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:16.2.13-522.g23c07d8f.el8.x86_64 119/122 2023-08-17T17:32:52.558 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-08-17T17:32:52.558 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:16.2.13-522.g23c07d8f.el8.x86_64 121/122 2023-08-17T17:32:54.742 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-08-17T17:32:54.742 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:48 ago on Thu 17 Aug 2023 05:31:06 PM UTC. 2023-08-17T17:32:56.781 INFO:teuthology.orchestra.run.smithi150.stdout:Installed products updated. 2023-08-17T17:32:56.929 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:32:56.929 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2023-08-17T17:32:56.929 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.929 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.929 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-08-17T17:32:56.930 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.1-7.el8.noarch 2023-08-17T17:32:56.930 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.0.4-10.el8.x86_64 2023-08-17T17:32:56.930 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.930 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.930 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.930 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.930 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:32:56.931 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.931 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.931 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.931 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:32:56.931 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:32:56.931 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:32:56.931 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:32:56.931 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:32:56.932 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.932 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.932 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:32:56.932 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.932 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.932 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.932 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:32:56.933 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.933 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:32:56.933 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-08-17T17:32:56.933 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.1-9.el8.x86_64 2023-08-17T17:32:56.933 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.7-12.el8.x86_64 2023-08-17T17:32:56.933 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-17T17:32:56.933 INFO:teuthology.orchestra.run.smithi150.stdout: jq-1.5-12.el8.x86_64 2023-08-17T17:32:56.933 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-08-17T17:32:56.934 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-08-17T17:32:56.934 INFO:teuthology.orchestra.run.smithi150.stdout: leveldb-1.22-1.el8.x86_64 2023-08-17T17:32:56.934 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-17T17:32:56.934 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.934 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.934 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.934 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-08-17T17:32:56.934 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-08-17T17:32:56.935 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-17T17:32:56.935 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-08-17T17:32:56.935 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-17T17:32:56.935 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.935 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.935 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-08-17T17:32:56.935 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.936 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-17T17:32:56.936 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-08-17T17:32:56.936 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-17T17:32:56.936 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-17T17:32:56.936 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-08-17T17:32:56.936 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-17T17:32:56.936 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-17T17:32:56.936 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-17T17:32:56.937 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.12-1.el8.x86_64 2023-08-17T17:32:56.937 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-08-17T17:32:56.937 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-08-17T17:32:56.937 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-17T17:32:56.937 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-17T17:32:56.937 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-17T17:32:56.937 INFO:teuthology.orchestra.run.smithi150.stdout: python3-apipkg-1.5-6.el8.noarch 2023-08-17T17:32:56.937 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.5.1-5.el8.noarch 2023-08-17T17:32:56.938 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-17T17:32:56.938 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-17T17:32:56.938 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-17T17:32:56.938 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.938 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.938 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.938 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-17T17:32:56.938 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-17T17:32:56.939 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-17T17:32:56.939 INFO:teuthology.orchestra.run.smithi150.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-08-17T17:32:56.939 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-17T17:32:56.939 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-17T17:32:56.939 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-17T17:32:56.939 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-08-17T17:32:56.939 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-17T17:32:56.940 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-17T17:32:56.940 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-17T17:32:56.940 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-17T17:32:56.940 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-17T17:32:56.940 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-17T17:32:56.940 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-17T17:32:56.940 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-17T17:32:56.940 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-08-17T17:32:56.941 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-08-17T17:32:56.941 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-17T17:32:56.941 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-17T17:32:56.941 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-2.6-1.el8.noarch 2023-08-17T17:32:56.941 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-17T17:32:56.941 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-17T17:32:56.941 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-17T17:32:56.941 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-17T17:32:56.942 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.942 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.942 INFO:teuthology.orchestra.run.smithi150.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-08-17T17:32:56.942 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-17T17:32:56.942 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-17T17:32:56.942 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.942 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-17T17:32:56.943 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-17T17:32:56.943 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-08-17T17:32:56.943 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-17T17:32:56.943 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-17T17:32:56.943 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-17T17:32:56.943 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-17T17:32:56.943 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-17T17:32:56.943 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-17T17:32:56.944 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-17T17:32:56.944 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-17T17:32:56.944 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-17T17:32:56.944 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-17T17:32:56.944 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.944 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.944 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:32:56.944 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.3.3-2.el8.x86_64 2023-08-17T17:32:56.945 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-08-17T17:32:56.945 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-17T17:32:56.945 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-08-17T17:32:56.945 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:32:56.946 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-08-17T17:32:57.161 DEBUG:teuthology.parallel:result is None 2023-08-17T17:33:03.330 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:16.2.13-522.g23c07d8f.el8.x86_64 90/122 2023-08-17T17:33:03.330 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2023-08-17T17:33:03.331 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2023-08-17T17:33:03.331 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2023-08-17T17:33:03.331 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /run 2023-08-17T17:33:03.331 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2023-08-17T17:33:03.331 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2023-08-17T17:33:03.331 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2023-08-17T17:33:03.331 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2023-08-17T17:33:03.332 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2023-08-17T17:33:03.332 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:03.697 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:16.2.13-522.g23c07d8f.el8.x86_64 91/122 2023-08-17T17:33:04.139 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:16.2.13-522.g23c07d8f.el8.x86_64 91/122 2023-08-17T17:33:04.305 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:16.2.13-522.g23c07d8f.el8.x86_64 92/122 2023-08-17T17:33:05.806 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:16.2.13-522.g23c07d8f.el8.x86_64 92/122 2023-08-17T17:33:05.963 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:16.2.13-522.g23c07d8f.el8.x86_64 93/122 2023-08-17T17:33:05.983 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:16.2.13-522.g23c07d8f.el8.x86_64 93/122 2023-08-17T17:33:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:16.2.13-522.g23c07d8f.el8.noarch 94/122 2023-08-17T17:33:08.852 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:16.2.13-522.g23c07d8f.el8.noarch 94/122 2023-08-17T17:33:09.069 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:16.2.13-522.g23c07d8f.e 95/122 2023-08-17T17:33:09.240 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:16.2.13-522.g23c07d8f. 96/122 2023-08-17T17:33:09.421 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:16.2.13-522.g23c07d8f.el8.noa 97/122 2023-08-17T17:33:10.371 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.13-522.g23c07d8f.el8.noa 97/122 2023-08-17T17:33:10.648 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:16.2.13-522.g23c07d8f.el8.n 98/122 2023-08-17T17:33:11.690 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.13-522.g23c07d8f.el8.n 98/122 2023-08-17T17:33:11.887 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.13-522.g23c 99/122 2023-08-17T17:33:11.982 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.13-522.g23c 99/122 2023-08-17T17:33:12.366 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:16.2.13-522.g23c07d8f.el 100/122 2023-08-17T17:33:12.540 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:16.2.13-522.g23c07d8f.el8.x86_64 101/122 2023-08-17T17:33:12.565 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:16.2.13-522.g23c07d8f.el8.x86_64 101/122 2023-08-17T17:33:12.729 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:16.2.13-522.g23c07d8f.el8.noarch 102/122 2023-08-17T17:33:12.739 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.13-522.g23c07d8f.el8.noarch 102/122 2023-08-17T17:33:13.774 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:16.2.13-522.g23c07d8f.el8.x86_64 103/122 2023-08-17T17:33:13.990 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:16.2.13-522.g23c07d8f.el8.x86_64 104/122 2023-08-17T17:33:14.088 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:16.2.13-522.g23c07d8f.el8.x86_64 104/122 2023-08-17T17:33:14.270 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:16.2.13-522.g23c07 105/122 2023-08-17T17:33:14.312 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.13-522.g23c07 105/122 2023-08-17T17:33:14.462 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 106/122 2023-08-17T17:33:14.807 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephfs-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 106/122 2023-08-17T17:33:14.978 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 107/122 2023-08-17T17:33:19.507 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 107/122 2023-08-17T17:33:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:16.2.13-522.g23c07d8f.el8.x86_64 108/122 2023-08-17T17:33:20.811 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-08-17T17:33:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 110/122 2023-08-17T17:33:21.233 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-08-17T17:33:21.444 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-08-17T17:33:21.455 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-08-17T17:33:21.624 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:16.2.13-522.g23c07d8f.el8.x86_ 113/122 2023-08-17T17:33:21.774 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-08-17T17:33:21.996 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-top-2:16.2.13-522.g23c07d8f.el8.noarch 115/122 2023-08-17T17:33:22.169 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 116/122 2023-08-17T17:33:22.455 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:16.2.13-522.g23c07d8f.el8.x86_64 117/122 2023-08-17T17:33:22.644 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-08-17T17:33:22.701 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-08-17T17:33:22.902 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-08-17T17:33:22.910 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-08-17T17:33:23.038 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-08-17T17:33:23.038 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-08-17T17:33:23.247 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-08-17T17:33:23.247 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-08-17T17:33:24.184 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-08-17T17:33:24.184 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:16.2.13-522.g23c07d8f.el8.x86_64 1/122 2023-08-17T17:33:24.184 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:16.2.13-522.g23c07d8f.el8.x86_64 2/122 2023-08-17T17:33:24.184 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 3/122 2023-08-17T17:33:24.185 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 4/122 2023-08-17T17:33:24.185 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:16.2.13-522.g23c07 5/122 2023-08-17T17:33:24.185 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:16.2.13-522.g23c07d8f.el8.x86_64 6/122 2023-08-17T17:33:24.185 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:16.2.13-522.g23c07d8f.el8.x86_64 7/122 2023-08-17T17:33:24.185 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:16.2.13-522.g23c07d8f.el8.x86_64 8/122 2023-08-17T17:33:24.185 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:16.2.13-522.g23c07d8f.el8.x86_64 9/122 2023-08-17T17:33:24.185 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:16.2.13-522.g23c07d8f.el8.x86_64 10/122 2023-08-17T17:33:24.186 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:16.2.13-522.g23c07d8f.el8.x86_64 11/122 2023-08-17T17:33:24.186 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:16.2.13-522.g23c07d8f.el8.x86_64 12/122 2023-08-17T17:33:24.186 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 13/122 2023-08-17T17:33:24.186 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:16.2.13-522.g23c07d8f.el8.x86_ 14/122 2023-08-17T17:33:24.186 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:16.2.13-522.g23c07d8f.el8.x86_64 15/122 2023-08-17T17:33:24.186 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:16.2.13-522.g23c07d8f.el8.x86_64 16/122 2023-08-17T17:33:24.187 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:16.2.13-522.g23c07d8f.el8.x86_6 17/122 2023-08-17T17:33:24.187 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:16.2.13-522.g23c07d8f.el8.x86 18/122 2023-08-17T17:33:24.187 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:16.2.13-522.g23c07d8f.el8.x86_64 19/122 2023-08-17T17:33:24.187 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:16.2.13-522.g23c07d8f.el 20/122 2023-08-17T17:33:24.187 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:16.2.13-522.g23c07d8f.el8. 21/122 2023-08-17T17:33:24.187 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:16.2.13-522.g23c07d8f.el8.x86_6 22/122 2023-08-17T17:33:24.187 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:16.2.13-522.g23c07d8f.el8.x86_64 23/122 2023-08-17T17:33:24.187 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:16.2.13-522.g23c07d8f.el8.x86_64 24/122 2023-08-17T17:33:24.188 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:16.2.13-522.g23c07d8f.el8.x86_64 25/122 2023-08-17T17:33:24.188 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 26/122 2023-08-17T17:33:24.188 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 27/122 2023-08-17T17:33:24.188 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:16.2.13-522.g23c07d8f.el8.x86_64 28/122 2023-08-17T17:33:24.188 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:16.2.13-522.g23c07d8f. 29/122 2023-08-17T17:33:24.188 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:16.2.13-522.g23c07d8f.el8.noa 30/122 2023-08-17T17:33:24.194 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:16.2.13-522.g23c07d8f.el8.n 31/122 2023-08-17T17:33:24.194 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.13-522.g23c 32/122 2023-08-17T17:33:24.195 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:16.2.13-522.g23c07d8f.el 33/122 2023-08-17T17:33:24.195 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:16.2.13-522.g23c07d8f.el8.noarch 34/122 2023-08-17T17:33:24.195 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:16.2.13-522.g23c07d8f.e 35/122 2023-08-17T17:33:24.195 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:16.2.13-522.g23c07d8f.el8.noarch 36/122 2023-08-17T17:33:24.195 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-top-2:16.2.13-522.g23c07d8f.el8.noarch 37/122 2023-08-17T17:33:24.195 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-08-17T17:33:24.195 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-08-17T17:33:24.196 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-08-17T17:33:24.196 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-08-17T17:33:24.196 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-08-17T17:33:24.196 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-08-17T17:33:24.196 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-08-17T17:33:24.196 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-08-17T17:33:24.196 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-08-17T17:33:24.197 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-08-17T17:33:24.197 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-08-17T17:33:24.197 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-08-17T17:33:24.197 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-08-17T17:33:24.197 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-08-17T17:33:24.197 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-08-17T17:33:24.197 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-08-17T17:33:24.197 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-08-17T17:33:24.198 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-08-17T17:33:24.198 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-08-17T17:33:24.198 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-08-17T17:33:24.198 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-08-17T17:33:24.198 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-08-17T17:33:24.198 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-08-17T17:33:24.199 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-08-17T17:33:24.199 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-08-17T17:33:24.199 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-08-17T17:33:24.199 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-08-17T17:33:24.199 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-08-17T17:33:24.199 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-08-17T17:33:24.199 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-08-17T17:33:24.200 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-08-17T17:33:24.200 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-08-17T17:33:24.200 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-08-17T17:33:24.200 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-08-17T17:33:24.200 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-08-17T17:33:24.200 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-08-17T17:33:24.200 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-08-17T17:33:24.200 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-08-17T17:33:24.201 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-08-17T17:33:24.201 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-08-17T17:33:24.201 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-08-17T17:33:24.201 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-08-17T17:33:24.201 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-08-17T17:33:24.201 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-08-17T17:33:24.201 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-08-17T17:33:24.202 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-08-17T17:33:24.202 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-08-17T17:33:24.202 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-08-17T17:33:24.202 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-08-17T17:33:24.202 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-08-17T17:33:24.202 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-08-17T17:33:24.202 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-08-17T17:33:24.203 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-08-17T17:33:24.203 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-08-17T17:33:24.203 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-08-17T17:33:24.203 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-08-17T17:33:24.203 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-08-17T17:33:24.203 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-08-17T17:33:24.203 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-08-17T17:33:24.203 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-08-17T17:33:24.204 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-08-17T17:33:24.204 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-08-17T17:33:24.204 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-08-17T17:33:24.204 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-08-17T17:33:24.204 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-08-17T17:33:24.204 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-08-17T17:33:24.204 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-08-17T17:33:24.204 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-08-17T17:33:24.205 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-08-17T17:33:24.205 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-08-17T17:33:24.205 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-08-17T17:33:24.205 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-08-17T17:33:24.205 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-08-17T17:33:24.205 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-08-17T17:33:24.205 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-08-17T17:33:24.206 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-08-17T17:33:24.206 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-08-17T17:33:24.206 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-08-17T17:33:24.206 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-08-17T17:33:24.206 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-08-17T17:33:24.206 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-08-17T17:33:24.206 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.2.13-522.g23c07d8f.el8.x86_64 119/122 2023-08-17T17:33:24.206 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-08-17T17:33:24.207 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.2.13-522.g23c07d8f.el8.x86_64 121/122 2023-08-17T17:33:26.303 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-08-17T17:33:26.303 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:02:20 ago on Thu 17 Aug 2023 05:31:06 PM UTC. 2023-08-17T17:33:28.308 INFO:teuthology.orchestra.run.smithi078.stdout:Installed products updated. 2023-08-17T17:33:28.435 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:28.435 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2023-08-17T17:33:28.435 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.436 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.436 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2023-08-17T17:33:28.436 INFO:teuthology.orchestra.run.smithi078.stdout: automake-1.16.1-7.el8.noarch 2023-08-17T17:33:28.436 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.0.4-10.el8.x86_64 2023-08-17T17:33:28.436 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.436 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.436 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.437 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.437 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:33:28.437 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.437 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.437 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.437 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:33:28.437 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:33:28.437 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:33:28.438 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:33:28.438 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:33:28.438 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.438 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.438 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:33:28.438 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.438 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.439 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.439 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:33:28.439 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.439 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top-2:16.2.13-522.g23c07d8f.el8.noarch 2023-08-17T17:33:28.439 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-08-17T17:33:28.439 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.1-9.el8.x86_64 2023-08-17T17:33:28.439 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.7-12.el8.x86_64 2023-08-17T17:33:28.439 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-17T17:33:28.440 INFO:teuthology.orchestra.run.smithi078.stdout: jq-1.5-12.el8.x86_64 2023-08-17T17:33:28.440 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-08-17T17:33:28.440 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-08-17T17:33:28.440 INFO:teuthology.orchestra.run.smithi078.stdout: leveldb-1.22-1.el8.x86_64 2023-08-17T17:33:28.440 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-17T17:33:28.440 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.440 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.441 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.441 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-08-17T17:33:28.441 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-08-17T17:33:28.441 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-17T17:33:28.441 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-08-17T17:33:28.441 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-17T17:33:28.441 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.441 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.442 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-08-17T17:33:28.442 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.442 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-17T17:33:28.442 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-08-17T17:33:28.442 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-17T17:33:28.442 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-17T17:33:28.442 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-08-17T17:33:28.442 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-17T17:33:28.443 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-17T17:33:28.443 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-17T17:33:28.443 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.12-1.el8.x86_64 2023-08-17T17:33:28.443 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-08-17T17:33:28.443 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-08-17T17:33:28.443 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-17T17:33:28.443 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-17T17:33:28.443 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-17T17:33:28.444 INFO:teuthology.orchestra.run.smithi078.stdout: python3-apipkg-1.5-6.el8.noarch 2023-08-17T17:33:28.444 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.5.1-5.el8.noarch 2023-08-17T17:33:28.444 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-17T17:33:28.444 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-17T17:33:28.444 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-17T17:33:28.444 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.444 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.445 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.445 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-17T17:33:28.445 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-17T17:33:28.445 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-17T17:33:28.445 INFO:teuthology.orchestra.run.smithi078.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-08-17T17:33:28.445 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-17T17:33:28.445 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-17T17:33:28.445 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-17T17:33:28.446 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-08-17T17:33:28.446 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-17T17:33:28.446 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-17T17:33:28.446 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-17T17:33:28.446 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-17T17:33:28.446 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-17T17:33:28.447 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-17T17:33:28.447 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-17T17:33:28.447 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-17T17:33:28.447 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-08-17T17:33:28.447 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-08-17T17:33:28.447 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-17T17:33:28.447 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-17T17:33:28.447 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-2.6-1.el8.noarch 2023-08-17T17:33:28.448 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-17T17:33:28.448 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-17T17:33:28.448 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-17T17:33:28.448 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-17T17:33:28.448 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.448 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.448 INFO:teuthology.orchestra.run.smithi078.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-08-17T17:33:28.448 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-17T17:33:28.449 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-17T17:33:28.449 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.449 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-17T17:33:28.449 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-17T17:33:28.449 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-08-17T17:33:28.449 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-17T17:33:28.449 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-17T17:33:28.450 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-17T17:33:28.450 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-17T17:33:28.450 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-17T17:33:28.450 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-17T17:33:28.450 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-17T17:33:28.450 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-17T17:33:28.450 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-17T17:33:28.450 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-17T17:33:28.451 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.451 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.451 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:16.2.13-522.g23c07d8f.el8.x86_64 2023-08-17T17:33:28.451 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.3.3-2.el8.x86_64 2023-08-17T17:33:28.451 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-08-17T17:33:28.451 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-17T17:33:28.452 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-08-17T17:33:28.452 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:28.452 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2023-08-17T17:33:28.670 DEBUG:teuthology.parallel:result is None 2023-08-17T17:33:28.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=23c07d8f91d3210fa9df54a2a13a9637958c6088 2023-08-17T17:33:28.907 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-17T17:33:28.927 INFO:teuthology.orchestra.run.smithi078.stdout:16.2.13-522.g23c07d8f.el8 2023-08-17T17:33:28.928 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-522.g23c07d8f.el8 2023-08-17T17:33:28.928 INFO:teuthology.task.install:The correct ceph version 16.2.13-522.g23c07d8f is installed. 2023-08-17T17:33:28.929 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=23c07d8f91d3210fa9df54a2a13a9637958c6088 2023-08-17T17:33:29.145 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-17T17:33:29.168 INFO:teuthology.orchestra.run.smithi150.stdout:16.2.13-522.g23c07d8f.el8 2023-08-17T17:33:29.168 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-522.g23c07d8f.el8 2023-08-17T17:33:29.168 INFO:teuthology.task.install:The correct ceph version 16.2.13-522.g23c07d8f is installed. 2023-08-17T17:33:29.169 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-17T17:33:29.169 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:29.169 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-17T17:33:29.208 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:33:29.209 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-17T17:33:29.248 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-17T17:33:29.249 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:29.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2023-08-17T17:33:29.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-17T17:33:29.338 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:33:29.338 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2023-08-17T17:33:29.362 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-17T17:33:29.426 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-17T17:33:29.427 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:29.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-17T17:33:29.451 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-17T17:33:29.514 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:33:29.515 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-17T17:33:29.538 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-17T17:33:29.601 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-17T17:33:29.602 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:29.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2023-08-17T17:33:29.626 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-17T17:33:29.689 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:33:29.690 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2023-08-17T17:33:29.713 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-17T17:33:29.777 INFO:teuthology.run_tasks:Running task ceph... 2023-08-17T17:33:29.844 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-17T17:33:29.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2023-08-17T17:33:29.846 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2023-08-17T17:33:29.869 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-17T17:33:29.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-17T17:33:29.910 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-17T17:33:29.933 INFO:tasks.ceph:Creating extra log directories... 2023-08-17T17:33:29.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-17T17:33:29.974 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-17T17:33:30.003 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-17T17:33:30.004 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-17T17:33:30.004 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-17T17:33:30.004 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:30.005 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-17T17:33:30.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-17T17:33:30.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-17T17:33:30.185 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:33:30.185 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-17T17:33:30.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-17T17:33:30.308 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-17T17:33:30.337 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-17T17:33:30.337 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-17T17:33:30.338 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890', 'branch': 'wip-yuri2-testing-2023-08-16-1142-pacific', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': None, 'first_in_suite': False, 'job_id': '7371890', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2023-08-16-1142-pacific'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2023-08-16-1142-pacific', 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9687, 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri2-testing-2023-08-16-1142-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_23c07d8f91d3210fa9df54a2a13a9637958c6088/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088', 'targets': {'smithi078.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsDGtIqaxjr03N79mLKJ8UPJGouDKoCJ1LKv7RoXHRxbRSRaafkGgQHYccvzwL3C7FkR0DB9llVzsImWBEK+MYsJOUPu+lpP1WDGLDuLCEoqBkZkGhuYc1kN0Dr7ClhWywWMkt8QTryRdL7aHQFCXmtC5J5sb7D8mexu8098EXB/f1Df36Yax08PEyuy8VM+XAwFQ1GVhRMn9FXoIoM8XaNdGQc2g7pcaKk6CDUH+il2Hqm5knxiVDo0yGzlTcLRbUk+Zyj8WOX7QTynRr7g00SQ8OcXAt1xfnUoh85+XUZA1tERmQ4JdXXkBFJLKRQ8Df5rNpZwFZp8WsWdnawcBprodP7Eehw32STaO8g6TqzsU9yt+3VLq+awBP/TMhoToA934h0l2D/YjvklOoZ+BNuEI9ohmhmiim7VViuvr6yqoR1VtIiC5XT2l3VQQYRChqShiQiHRPM3ZNwNgVutmoO+cz/MzEYNbkFOhPBKIw8J4mJAKWNJDqKktplH+Zhmk=', 'smithi150.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVjfehMjwxiIvigPtEzGMQN7B7FPvL9sTrJPt5rST2Xv2secLTpMre3TkGT1HZmD6kF04/gNrLbfkGICXrv6k47U7f6+J6zui0Os7XlyystDRH161BOCo4ak1qQ9ZcvXJHxM0qzMIZMpS7mjQVsBqnGJDV2kcUxd7YfKgJk7UsgEhDZL87rozi65LqZuYhxMkKJ0P7bQYU12OeOlDtYBHud/f8rw56TZsICtu1hseD68COo4RW7fW5qflbg+1wfgG6ZdtaZcqdX/qH3SXjLcqieUkdha1eYtxpY+ezjMdIPr+Vj4ORHmJHX6S67+4C2V7gOSQ4Hx6wONibawOzATh8NCGj9Mb27eZVzlW9N8NeayqqXiq5b8CB2Ix1HElXhExpHwd69UNpwRjIPdmRGQbnK8IzEBLt9/MNqwPYxND/OL+WeMlu4fon4LEUr12DESnFw62EHFGKlPJvk8LBVdlJUmRDX1Do5PXCRybeXgng57dMRGea2/hMDC5qUEoVPmE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-17_17:05:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-17T17:33:30.338 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-17T17:33:30.340 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-17T17:33:30.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2023-08-17T17:33:30.394 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2023-08-17T17:33:30.450 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:30.451 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2023-08-17T17:33:30.470 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-17T17:33:30.470 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2023-08-17T17:33:30.524 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-17T17:33:30.524 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T17:33:30.525 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 210496 Links: 1 2023-08-17T17:33:30.525 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T17:33:30.525 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-08-17T17:33:30.525 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-08-17 17:33:23.739635731 +0000 2023-08-17T17:33:30.525 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-08-17 17:30:21.904341112 +0000 2023-08-17T17:33:30.525 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-08-17 17:30:21.904341112 +0000 2023-08-17T17:33:30.525 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-08-17T17:33:30.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-17T17:33:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-08-17T17:33:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-08-17T17:33:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000240767 s, 2.1 MB/s 2023-08-17T17:33:30.589 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-17T17:33:30.645 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2023-08-17T17:33:30.699 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-17T17:33:30.700 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T17:33:30.700 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 219320 Links: 1 2023-08-17T17:33:30.700 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T17:33:30.700 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-08-17T17:33:30.700 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-08-17 17:33:23.739635731 +0000 2023-08-17T17:33:30.700 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-08-17 17:30:22.396333152 +0000 2023-08-17T17:33:30.700 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-08-17 17:30:22.396333152 +0000 2023-08-17T17:33:30.701 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-08-17T17:33:30.701 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-17T17:33:30.762 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-08-17T17:33:30.762 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-08-17T17:33:30.762 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000203247 s, 2.5 MB/s 2023-08-17T17:33:30.763 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-17T17:33:30.818 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2023-08-17T17:33:30.873 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-17T17:33:30.874 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T17:33:30.874 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 219492 Links: 1 2023-08-17T17:33:30.874 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T17:33:30.874 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-08-17T17:33:30.874 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-08-17 17:33:23.740635715 +0000 2023-08-17T17:33:30.874 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-08-17 17:30:22.905324916 +0000 2023-08-17T17:33:30.875 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-08-17 17:30:22.905324916 +0000 2023-08-17T17:33:30.875 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-08-17T17:33:30.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-17T17:33:30.937 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-08-17T17:33:30.937 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-08-17T17:33:30.937 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000225761 s, 2.3 MB/s 2023-08-17T17:33:30.938 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-17T17:33:30.994 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2023-08-17T17:33:31.049 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-17T17:33:31.049 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T17:33:31.050 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 219673 Links: 1 2023-08-17T17:33:31.050 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T17:33:31.050 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-08-17T17:33:31.050 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-08-17 17:33:23.740635715 +0000 2023-08-17T17:33:31.050 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-08-17 17:30:23.414316680 +0000 2023-08-17T17:33:31.050 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-08-17 17:30:23.414316680 +0000 2023-08-17T17:33:31.050 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-08-17T17:33:31.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-17T17:33:31.113 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-08-17T17:33:31.113 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-08-17T17:33:31.113 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000173029 s, 3.0 MB/s 2023-08-17T17:33:31.114 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-17T17:33:31.169 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-17T17:33:31.169 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:33:31.169 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2023-08-17T17:33:31.184 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-17T17:33:31.184 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2023-08-17T17:33:31.238 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-17T17:33:31.238 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T17:33:31.239 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 218173 Links: 1 2023-08-17T17:33:31.239 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T17:33:31.239 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-08-17T17:33:31.239 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-08-17 17:32:52.114088472 +0000 2023-08-17T17:33:31.239 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-08-17 17:30:21.951285758 +0000 2023-08-17T17:33:31.239 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-08-17 17:30:21.951285758 +0000 2023-08-17T17:33:31.239 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-08-17T17:33:31.240 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-17T17:33:31.301 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-08-17T17:33:31.302 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-08-17T17:33:31.302 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000248493 s, 2.1 MB/s 2023-08-17T17:33:31.302 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-17T17:33:31.358 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2023-08-17T17:33:31.412 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-17T17:33:31.412 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T17:33:31.412 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 220256 Links: 1 2023-08-17T17:33:31.412 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T17:33:31.412 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-08-17T17:33:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-08-17 17:32:52.114088472 +0000 2023-08-17T17:33:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-08-17 17:30:22.450275238 +0000 2023-08-17T17:33:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-08-17 17:30:22.450275238 +0000 2023-08-17T17:33:31.413 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-08-17T17:33:31.413 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-17T17:33:31.474 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-08-17T17:33:31.474 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-08-17T17:33:31.474 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000222166 s, 2.3 MB/s 2023-08-17T17:33:31.475 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-17T17:33:31.530 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2023-08-17T17:33:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-17T17:33:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T17:33:31.584 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 221283 Links: 1 2023-08-17T17:33:31.584 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T17:33:31.584 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-08-17T17:33:31.585 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-08-17 17:32:52.114088472 +0000 2023-08-17T17:33:31.585 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-08-17 17:30:22.960264486 +0000 2023-08-17T17:33:31.585 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-08-17 17:30:22.960264486 +0000 2023-08-17T17:33:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-08-17T17:33:31.585 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-17T17:33:31.646 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-08-17T17:33:31.646 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-08-17T17:33:31.646 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000243912 s, 2.1 MB/s 2023-08-17T17:33:31.647 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-17T17:33:31.702 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2023-08-17T17:33:31.756 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-17T17:33:31.756 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T17:33:31.756 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 215860 Links: 1 2023-08-17T17:33:31.756 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T17:33:31.757 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-08-17T17:33:31.757 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-08-17 17:32:52.114088472 +0000 2023-08-17T17:33:31.757 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-08-17 17:30:23.477253587 +0000 2023-08-17T17:33:31.757 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-08-17 17:30:23.477253587 +0000 2023-08-17T17:33:31.757 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-08-17T17:33:31.757 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-17T17:33:31.818 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-08-17T17:33:31.818 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-08-17T17:33:31.818 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000217724 s, 2.4 MB/s 2023-08-17T17:33:31.819 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-17T17:33:31.874 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-17T17:33:31.874 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-17T17:33:31.874 INFO:tasks.ceph:Generating config... 2023-08-17T17:33:31.876 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-17T17:33:31.876 INFO:tasks.ceph:[client] debug client = 20 2023-08-17T17:33:31.876 INFO:tasks.ceph:[client] debug ms = 1 2023-08-17T17:33:31.876 INFO:tasks.ceph:[client] pid file = 2023-08-17T17:33:31.876 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-17T17:33:31.877 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-17T17:33:31.877 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-17T17:33:31.877 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-17T17:33:31.877 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-17T17:33:31.877 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-17T17:33:31.878 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-17T17:33:31.878 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-17T17:33:31.878 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-17T17:33:31.878 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-17T17:33:31.878 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-17T17:33:31.879 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-17T17:33:31.879 INFO:tasks.ceph:[mgr] debug client = 20 2023-08-17T17:33:31.879 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-08-17T17:33:31.879 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-17T17:33:31.879 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-17T17:33:31.880 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-17T17:33:31.880 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-17T17:33:31.880 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-17T17:33:31.880 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-17T17:33:31.880 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-17T17:33:31.880 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-17T17:33:31.881 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-17T17:33:31.881 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-17T17:33:31.881 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-17T17:33:31.881 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-17T17:33:31.881 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-17T17:33:31.882 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-17T17:33:31.882 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-17T17:33:31.882 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-17T17:33:31.882 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-17T17:33:31.882 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-17T17:33:31.883 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-17T17:33:31.883 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-17T17:33:31.883 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-17T17:33:31.883 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-17T17:33:31.883 INFO:tasks.ceph:Setting up mon.a... 2023-08-17T17:33:31.884 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-17T17:33:31.955 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2023-08-17T17:33:31.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-17T17:33:31.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-17T17:33:32.060 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '172.21.15.150'), ('mon.c', '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]')] 2023-08-17T17:33:32.060 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-17T17:33:32.061 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:32.062 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-17T17:33:32.113 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --add b 172.21.15.150 --addv c '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:32.194 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:32.195 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid c71a8d58-9c80-42ad-9365-61f3329fa340 2023-08-17T17:33:32.195 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2023-08-17T17:33:32.195 INFO:teuthology.orchestra.run.smithi078.stdout:fsid c71a8d58-9c80-42ad-9365-61f3329fa340 2023-08-17T17:33:32.195 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2023-08-17T17:33:32.194522+0000 2023-08-17T17:33:32.195 INFO:teuthology.orchestra.run.smithi078.stdout:created 2023-08-17T17:33:32.194522+0000 2023-08-17T17:33:32.195 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 0 (unknown) 2023-08-17T17:33:32.195 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2023-08-17T17:33:32.196 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2023-08-17T17:33:32.196 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2023-08-17T17:33:32.196 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] mon.c 2023-08-17T17:33:32.196 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-17T17:33:32.197 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-17T17:33:32.250 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c71a8d58-9c80-42ad-9365-61f3329fa340... 2023-08-17T17:33:32.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T17:33:32.293 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T17:33:32.335 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2023-08-17T17:33:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2023-08-17T17:33:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T17:33:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2023-08-17T17:33:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2023-08-17T17:33:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2023-08-17T17:33:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2023-08-17T17:33:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2023-08-17T17:33:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2023-08-17T17:33:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2023-08-17T17:33:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T17:33:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2023-08-17T17:33:32.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.338 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T17:33:32.338 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T17:33:32.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.338 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2023-08-17T17:33:32.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.338 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2023-08-17T17:33:32.338 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2023-08-17T17:33:32.339 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2023-08-17T17:33:32.339 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2023-08-17T17:33:32.339 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2023-08-17T17:33:32.339 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2023-08-17T17:33:32.339 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2023-08-17T17:33:32.339 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T17:33:32.339 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T17:33:32.340 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2023-08-17T17:33:32.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.340 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T17:33:32.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.340 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2023-08-17T17:33:32.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.340 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2023-08-17T17:33:32.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2023-08-17T17:33:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2023-08-17T17:33:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2023-08-17T17:33:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2023-08-17T17:33:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on skipped message = False 2023-08-17T17:33:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = c71a8d58-9c80-42ad-9365-61f3329fa340 2023-08-17T17:33:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.341 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2023-08-17T17:33:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2023-08-17T17:33:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2023-08-17T17:33:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2023-08-17T17:33:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2023-08-17T17:33:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2023-08-17T17:33:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2023-08-17T17:33:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2023-08-17T17:33:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2023-08-17T17:33:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2023-08-17T17:33:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2023-08-17T17:33:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2023-08-17T17:33:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2023-08-17T17:33:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2023-08-17T17:33:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2023-08-17T17:33:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2023-08-17T17:33:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2023-08-17T17:33:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2023-08-17T17:33:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2023-08-17T17:33:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2023-08-17T17:33:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2023-08-17T17:33:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2023-08-17T17:33:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2023-08-17T17:33:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2023-08-17T17:33:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2023-08-17T17:33:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-08-17T17:33:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2023-08-17T17:33:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2023-08-17T17:33:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T17:33:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2023-08-17T17:33:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2023-08-17T17:33:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2023-08-17T17:33:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2023-08-17T17:33:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-08-17T17:33:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.347 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2023-08-17T17:33:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-08-17T17:33:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2023-08-17T17:33:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-08-17T17:33:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-08-17T17:33:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-08-17T17:33:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-08-17T17:33:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2023-08-17T17:33:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2023-08-17T17:33:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: debug finisher = 20 2023-08-17T17:33:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.348 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2023-08-17T17:33:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-08-17T17:33:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-08-17T17:33:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2023-08-17T17:33:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-08-17T17:33:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2023-08-17T17:33:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2023-08-17T17:33:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-08-17T17:33:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2023-08-17T17:33:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2023-08-17T17:33:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-08-17T17:33:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T17:33:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T17:33:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T17:33:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T17:33:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T17:33:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T17:33:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2023-08-17T17:33:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:33:32.351 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2023-08-17T17:33:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2023-08-17T17:33:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2023-08-17T17:33:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2023-08-17T17:33:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T17:33:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T17:33:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2023-08-17T17:33:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2023-08-17T17:33:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-08-17T17:33:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = "" 2023-08-17T17:33:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-08-17T17:33:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-08-17T17:33:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2023-08-17T17:33:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2023-08-17T17:33:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2023-08-17T17:33:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-08-17T17:33:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-08-17T17:33:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-08-17T17:33:32.353 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-08-17T17:33:32.354 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2023-08-17T17:33:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2023-08-17T17:33:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-08-17T17:33:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2023-08-17T17:33:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2023-08-17T17:33:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2023-08-17T17:33:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2023-08-17T17:33:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-08-17T17:33:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-08-17T17:33:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-08-17T17:33:32.356 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2023-08-17T17:33:32.356 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2023-08-17T17:33:32.356 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T17:33:32.356 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2023-08-17T17:33:32.356 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.357 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2023-08-17T17:33:32.357 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.357 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2023-08-17T17:33:32.357 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.357 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2023-08-17T17:33:32.357 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2023-08-17T17:33:32.357 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.358 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2023-08-17T17:33:32.358 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2023-08-17T17:33:32.358 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.358 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T17:33:32.358 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2023-08-17T17:33:32.358 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.358 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T17:33:32.358 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T17:33:32.359 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.359 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2023-08-17T17:33:32.359 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.359 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2023-08-17T17:33:32.359 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2023-08-17T17:33:32.359 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2023-08-17T17:33:32.359 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2023-08-17T17:33:32.359 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2023-08-17T17:33:32.360 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2023-08-17T17:33:32.360 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2023-08-17T17:33:32.360 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T17:33:32.360 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T17:33:32.360 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2023-08-17T17:33:32.360 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.360 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T17:33:32.361 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.361 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2023-08-17T17:33:32.361 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.361 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2023-08-17T17:33:32.361 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.361 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2023-08-17T17:33:32.361 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2023-08-17T17:33:32.361 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2023-08-17T17:33:32.362 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.78,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2023-08-17T17:33:32.362 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on skipped message = False 2023-08-17T17:33:32.362 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = c71a8d58-9c80-42ad-9365-61f3329fa340 2023-08-17T17:33:32.362 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.362 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2023-08-17T17:33:32.362 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2023-08-17T17:33:32.362 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.362 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2023-08-17T17:33:32.363 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2023-08-17T17:33:32.363 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.363 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2023-08-17T17:33:32.363 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2023-08-17T17:33:32.363 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.363 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2023-08-17T17:33:32.363 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2023-08-17T17:33:32.363 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2023-08-17T17:33:32.364 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.364 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2023-08-17T17:33:32.364 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2023-08-17T17:33:32.364 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.364 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2023-08-17T17:33:32.364 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.364 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2023-08-17T17:33:32.364 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.365 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2023-08-17T17:33:32.365 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.365 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2023-08-17T17:33:32.365 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2023-08-17T17:33:32.365 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.365 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2023-08-17T17:33:32.365 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2023-08-17T17:33:32.365 INFO:teuthology.orchestra.run.smithi150.stdout: bdev async discard = True 2023-08-17T17:33:32.366 INFO:teuthology.orchestra.run.smithi150.stdout: bdev enable discard = True 2023-08-17T17:33:32.366 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore allocator = bitmap 2023-08-17T17:33:32.366 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2023-08-17T17:33:32.366 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2023-08-17T17:33:32.366 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 1/20 2023-08-17T17:33:32.366 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 1/20 2023-08-17T17:33:32.366 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-08-17T17:33:32.366 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2023-08-17T17:33:32.367 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 4/10 2023-08-17T17:33:32.367 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T17:33:32.367 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2023-08-17T17:33:32.367 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2023-08-17T17:33:32.367 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2023-08-17T17:33:32.367 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2023-08-17T17:33:32.367 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2023-08-17T17:33:32.367 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.368 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2023-08-17T17:33:32.368 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-08-17T17:33:32.368 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2023-08-17T17:33:32.368 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2023-08-17T17:33:32.368 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2023-08-17T17:33:32.368 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2023-08-17T17:33:32.368 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2023-08-17T17:33:32.369 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2023-08-17T17:33:32.369 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2023-08-17T17:33:32.369 INFO:teuthology.orchestra.run.smithi150.stdout: debug finisher = 20 2023-08-17T17:33:32.369 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.369 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2023-08-17T17:33:32.369 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-08-17T17:33:32.369 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2023-08-17T17:33:32.369 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2023-08-17T17:33:32.370 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2023-08-17T17:33:32.370 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2023-08-17T17:33:32.370 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2023-08-17T17:33:32.370 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2023-08-17T17:33:32.370 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2023-08-17T17:33:32.370 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2023-08-17T17:33:32.370 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2023-08-17T17:33:32.370 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.371 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T17:33:32.371 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T17:33:32.371 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T17:33:32.371 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.371 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T17:33:32.371 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T17:33:32.371 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T17:33:32.371 INFO:teuthology.orchestra.run.smithi150.stdout: mon op complaint time = 120 2023-08-17T17:33:32.372 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-08-17T17:33:32.372 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2023-08-17T17:33:32.372 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2023-08-17T17:33:32.372 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2023-08-17T17:33:32.372 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2023-08-17T17:33:32.372 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T17:33:32.372 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T17:33:32.372 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 600 2023-08-17T17:33:32.373 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2023-08-17T17:33:32.373 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-08-17T17:33:32.373 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = "" 2023-08-17T17:33:32.373 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2023-08-17T17:33:32.373 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2023-08-17T17:33:32.373 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2023-08-17T17:33:32.373 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2023-08-17T17:33:32.374 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2023-08-17T17:33:32.374 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2023-08-17T17:33:32.374 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2023-08-17T17:33:32.374 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2023-08-17T17:33:32.374 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2023-08-17T17:33:32.374 INFO:teuthology.orchestra.run.smithi150.stdout:[mds] 2023-08-17T17:33:32.374 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds = 20 2023-08-17T17:33:32.374 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-08-17T17:33:32.374 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug frag = True 2023-08-17T17:33:32.375 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug scatterstat = True 2023-08-17T17:33:32.375 INFO:teuthology.orchestra.run.smithi150.stdout: mds op complaint time = 180 2023-08-17T17:33:32.375 INFO:teuthology.orchestra.run.smithi150.stdout: mds verify scatter = True 2023-08-17T17:33:32.375 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2023-08-17T17:33:32.375 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2023-08-17T17:33:32.375 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2023-08-17T17:33:32.375 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-17T17:33:32.376 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-17T17:33:32.450 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-17T17:33:32.450 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:32.451 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-17T17:33:32.464 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:32.465 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-17T17:33:32.518 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:33:32.518 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:32.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-17T17:33:32.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-17T17:33:32.594 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:33:32.594 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:32.648 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T17:33:32.648 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:33:32.648 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-17T17:33:32.649 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-17T17:33:32.682 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:33:32.683 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:32.737 INFO:tasks.ceph:Setting up mon nodes... 2023-08-17T17:33:32.737 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-17T17:33:32.737 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-17T17:33:32.786 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-17T17:33:32.788 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-17T17:33:32.867 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-17T17:33:32.869 INFO:tasks.ceph:Setting up mds nodes... 2023-08-17T17:33:32.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-17T17:33:32.920 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-17T17:33:32.923 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-17T17:33:32.947 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-17T17:33:33.034 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-17T17:33:33.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-17T17:33:33.061 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-17T17:33:33.108 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-17T17:33:33.110 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-17T17:33:33.134 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-17T17:33:33.220 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-17T17:33:33.222 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-17T17:33:33.246 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-17T17:33:33.247 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-17T17:33:33.284 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-17T17:33:33.297 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-17T17:33:33.373 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-17T17:33:33.386 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-17T17:33:33.422 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-17T17:33:33.435 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-17T17:33:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-17T17:33:33.523 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-17T17:33:33.524 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-17T17:33:33.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-17T17:33:33.549 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-17T17:33:33.549 INFO:tasks.ceph:role: osd.0 2023-08-17T17:33:33.549 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:33:33.550 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-17T17:33:33.620 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T17:33:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T17:33:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T17:33:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2023-08-17T17:33:33.621 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T17:33:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-08-17T17:33:33.621 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T17:33:33.621 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T17:33:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T17:33:33.621 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T17:33:34.056 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-08-17T17:33:34.057 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-08-17T17:33:34.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-17T17:33:34.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-17T17:33:34.245 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-17T17:33:34.309 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-17T17:33:34.309 INFO:tasks.ceph:role: osd.1 2023-08-17T17:33:34.310 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:33:34.310 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-17T17:33:34.381 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T17:33:34.382 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T17:33:34.382 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T17:33:34.382 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2023-08-17T17:33:34.382 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T17:33:34.382 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-08-17T17:33:34.382 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T17:33:34.383 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T17:33:34.383 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T17:33:34.383 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T17:33:34.795 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-08-17T17:33:34.797 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-08-17T17:33:34.797 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-17T17:33:34.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-17T17:33:34.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-17T17:33:35.005 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-17T17:33:35.005 INFO:tasks.ceph:role: osd.2 2023-08-17T17:33:35.005 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:33:35.005 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-17T17:33:35.077 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T17:33:35.077 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T17:33:35.077 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T17:33:35.077 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2023-08-17T17:33:35.077 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T17:33:35.078 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-08-17T17:33:35.078 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T17:33:35.078 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T17:33:35.078 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T17:33:35.078 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T17:33:35.530 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-08-17T17:33:35.532 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-08-17T17:33:35.532 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-17T17:33:35.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-17T17:33:35.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-17T17:33:35.777 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-17T17:33:35.777 INFO:tasks.ceph:role: osd.3 2023-08-17T17:33:35.777 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:33:35.777 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-17T17:33:35.847 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T17:33:35.848 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T17:33:35.848 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T17:33:35.848 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2023-08-17T17:33:35.848 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T17:33:35.849 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-08-17T17:33:35.849 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T17:33:35.849 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T17:33:35.849 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T17:33:35.849 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T17:33:36.292 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-08-17T17:33:36.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-08-17T17:33:36.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-17T17:33:36.450 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-17T17:33:36.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:36.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:36.579+0000 7f06ab841200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-17T17:33:36.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:36.579+0000 7f06ab841200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-17T17:33:36.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:36.579+0000 7f06ab841200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-17T17:33:36.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:36.579+0000 7f06ab841200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-17T17:33:36.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:36.579+0000 7f06ab841200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-17T17:33:36.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:36.580+0000 7f06ab841200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-17T17:33:39.469 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-17T17:33:39.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:39.570+0000 7fa54cab0200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-17T17:33:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:39.570+0000 7fa54cab0200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-17T17:33:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:39.570+0000 7fa54cab0200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-17T17:33:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:39.570+0000 7fa54cab0200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-17T17:33:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:39.570+0000 7fa54cab0200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-17T17:33:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:39.571+0000 7fa54cab0200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-17T17:33:42.470 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-17T17:33:42.535 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:42.616+0000 7f7021895200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-17T17:33:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:42.616+0000 7f7021895200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-17T17:33:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:42.616+0000 7f7021895200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-17T17:33:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:42.616+0000 7f7021895200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-17T17:33:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:42.616+0000 7f7021895200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-17T17:33:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:42.617+0000 7f7021895200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-17T17:33:45.503 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-17T17:33:45.529 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:45.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:45.609+0000 7f50eab0e200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-17T17:33:45.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:45.609+0000 7f50eab0e200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-17T17:33:45.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:45.609+0000 7f50eab0e200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-17T17:33:45.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:45.609+0000 7f50eab0e200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-17T17:33:45.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:45.609+0000 7f50eab0e200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-17T17:33:45.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:33:45.610+0000 7f50eab0e200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-17T17:33:48.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-17T17:33:48.564 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-17T17:33:48.591 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-17T17:33:48.591 INFO:tasks.ceph:role: osd.4 2023-08-17T17:33:48.591 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T17:33:48.592 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-17T17:33:48.663 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T17:33:48.664 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T17:33:48.664 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T17:33:48.664 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-08-17T17:33:48.664 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T17:33:48.664 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-08-17T17:33:48.664 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T17:33:48.664 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T17:33:48.665 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T17:33:48.665 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T17:33:49.100 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2023-08-17T17:33:49.102 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-08-17T17:33:49.102 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-17T17:33:49.288 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-17T17:33:49.319 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-17T17:33:49.386 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-17T17:33:49.386 INFO:tasks.ceph:role: osd.5 2023-08-17T17:33:49.386 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T17:33:49.386 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-17T17:33:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T17:33:49.458 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T17:33:49.458 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T17:33:49.458 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-08-17T17:33:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T17:33:49.458 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-08-17T17:33:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T17:33:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T17:33:49.459 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T17:33:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T17:33:49.878 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2023-08-17T17:33:49.880 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-08-17T17:33:49.880 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-17T17:33:49.993 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-17T17:33:50.022 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-17T17:33:50.086 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-17T17:33:50.086 INFO:tasks.ceph:role: osd.6 2023-08-17T17:33:50.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T17:33:50.087 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-17T17:33:50.158 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T17:33:50.158 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T17:33:50.158 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T17:33:50.159 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-08-17T17:33:50.159 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T17:33:50.159 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-08-17T17:33:50.159 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T17:33:50.159 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T17:33:50.159 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T17:33:50.159 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T17:33:50.604 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2023-08-17T17:33:50.606 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-08-17T17:33:50.606 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-17T17:33:50.766 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-17T17:33:50.795 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-17T17:33:50.860 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-17T17:33:50.860 INFO:tasks.ceph:role: osd.7 2023-08-17T17:33:50.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T17:33:50.861 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-17T17:33:50.932 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T17:33:50.932 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T17:33:50.932 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T17:33:50.932 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-08-17T17:33:50.933 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T17:33:50.933 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-08-17T17:33:50.933 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T17:33:50.933 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T17:33:50.933 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T17:33:50.933 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T17:33:51.378 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2023-08-17T17:33:51.379 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-08-17T17:33:51.380 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-17T17:33:51.539 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-17T17:33:51.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:51.660 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:51.658+0000 7f67aa68c200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-17T17:33:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:51.658+0000 7f67aa68c200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-17T17:33:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:51.658+0000 7f67aa68c200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-17T17:33:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:51.658+0000 7f67aa68c200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-17T17:33:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:51.658+0000 7f67aa68c200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-17T17:33:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:51.659+0000 7f67aa68c200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-17T17:33:54.503 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-17T17:33:54.531 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:54.615 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:54.612+0000 7f8d299fd200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-17T17:33:54.615 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:54.612+0000 7f8d299fd200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-17T17:33:54.615 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:54.612+0000 7f8d299fd200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-17T17:33:54.615 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:54.612+0000 7f8d299fd200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-17T17:33:54.615 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:54.612+0000 7f8d299fd200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-17T17:33:54.616 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:54.613+0000 7f8d299fd200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-17T17:33:57.466 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-17T17:33:57.532 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:33:57.615 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:57.612+0000 7f5c039b3200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-17T17:33:57.615 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:57.613+0000 7f5c039b3200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-17T17:33:57.615 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:57.613+0000 7f5c039b3200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-17T17:33:57.615 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:57.613+0000 7f5c039b3200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-17T17:33:57.615 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:57.613+0000 7f5c039b3200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-17T17:33:57.616 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:33:57.613+0000 7f5c039b3200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-17T17:34:00.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:34:00.343 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:34:00.466 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-17T17:34:00.531 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:34:00.611 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:00.609+0000 7fb46660b200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-17T17:34:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:00.609+0000 7fb46660b200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-17T17:34:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:00.609+0000 7fb46660b200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-17T17:34:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:00.609+0000 7fb46660b200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-17T17:34:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:00.609+0000 7fb46660b200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-17T17:34:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:00.610+0000 7fb46660b200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-17T17:34:03.451 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-17T17:34:03.517 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-17T17:34:03.518 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:03.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-17T17:34:03.544 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:03.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-17T17:34:03.608 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:03.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-17T17:34:03.671 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:03.672 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-17T17:34:03.735 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:03.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-17T17:34:03.799 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:03.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-17T17:34:03.862 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:03.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-17T17:34:03.925 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:03.926 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-17T17:34:03.951 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:03.951 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-17T17:34:04.015 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:04.016 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-17T17:34:04.080 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:04.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-17T17:34:04.144 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:04.145 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-17T17:34:04.209 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:04.209 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-17T17:34:04.273 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:04.273 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-17T17:34:04.337 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:04.337 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-17T17:34:04.353 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:04.353 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-17T17:34:04.407 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:04.408 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-17T17:34:04.423 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:04.423 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-17T17:34:04.477 INFO:tasks.ceph:Adding keys to all mons... 2023-08-17T17:34:04.477 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-17T17:34:04.479 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-17T17:34:04.520 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2023-08-17T17:34:04.520 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA== 2023-08-17T17:34:04.520 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-08-17T17:34:04.520 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA== 2023-08-17T17:34:04.520 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-08-17T17:34:04.521 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw== 2023-08-17T17:34:04.521 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2023-08-17T17:34:04.521 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg== 2023-08-17T17:34:04.521 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2023-08-17T17:34:04.521 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw== 2023-08-17T17:34:04.521 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2023-08-17T17:34:04.521 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA== 2023-08-17T17:34:04.521 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2023-08-17T17:34:04.522 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ== 2023-08-17T17:34:04.522 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2023-08-17T17:34:04.522 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg== 2023-08-17T17:34:04.522 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-08-17T17:34:04.522 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g== 2023-08-17T17:34:04.522 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-08-17T17:34:04.522 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg== 2023-08-17T17:34:04.523 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2023-08-17T17:34:04.523 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA== 2023-08-17T17:34:04.523 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2023-08-17T17:34:04.523 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q== 2023-08-17T17:34:04.523 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2023-08-17T17:34:04.523 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw== 2023-08-17T17:34:04.523 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2023-08-17T17:34:04.523 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg== 2023-08-17T17:34:04.524 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-08-17T17:34:04.524 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA== 2023-08-17T17:34:04.524 INFO:teuthology.orchestra.run.smithi078.stdout:[client.2] 2023-08-17T17:34:04.524 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ== 2023-08-17T17:34:04.524 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2023-08-17T17:34:04.524 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ== 2023-08-17T17:34:04.524 INFO:teuthology.orchestra.run.smithi078.stdout:[client.3] 2023-08-17T17:34:04.525 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw== 2023-08-17T17:34:04.539 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2023-08-17T17:34:04.540 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA== 2023-08-17T17:34:04.540 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2023-08-17T17:34:04.540 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA== 2023-08-17T17:34:04.540 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2023-08-17T17:34:04.540 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw== 2023-08-17T17:34:04.540 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2023-08-17T17:34:04.540 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg== 2023-08-17T17:34:04.541 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2023-08-17T17:34:04.541 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw== 2023-08-17T17:34:04.541 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2023-08-17T17:34:04.541 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA== 2023-08-17T17:34:04.541 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2023-08-17T17:34:04.541 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ== 2023-08-17T17:34:04.541 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2023-08-17T17:34:04.542 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg== 2023-08-17T17:34:04.542 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2023-08-17T17:34:04.542 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g== 2023-08-17T17:34:04.542 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2023-08-17T17:34:04.542 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg== 2023-08-17T17:34:04.542 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2023-08-17T17:34:04.542 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA== 2023-08-17T17:34:04.542 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2023-08-17T17:34:04.543 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q== 2023-08-17T17:34:04.543 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2023-08-17T17:34:04.543 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw== 2023-08-17T17:34:04.543 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2023-08-17T17:34:04.543 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg== 2023-08-17T17:34:04.543 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2023-08-17T17:34:04.543 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA== 2023-08-17T17:34:04.544 INFO:teuthology.orchestra.run.smithi150.stdout:[client.2] 2023-08-17T17:34:04.544 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ== 2023-08-17T17:34:04.544 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2023-08-17T17:34:04.544 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ== 2023-08-17T17:34:04.544 INFO:teuthology.orchestra.run.smithi150.stdout:[client.3] 2023-08-17T17:34:04.544 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw== 2023-08-17T17:34:04.545 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-17T17:34:04.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-17T17:34:04.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T17:34:04.634 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T17:34:04.682 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T17:34:04.685 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T17:34:04.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:04.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:04.781 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:04.783 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:04.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:04.831 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:04.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:04.879 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:04.924 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-17T17:34:04.927 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-17T17:34:04.972 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T17:34:04.974 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T17:34:05.023 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T17:34:05.025 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T17:34:05.073 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:05.075 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:05.121 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:05.123 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:05.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:05.170 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:05.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:05.218 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T17:34:05.263 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T17:34:05.265 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T17:34:05.313 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T17:34:05.315 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T17:34:05.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T17:34:05.366 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T17:34:05.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T17:34:05.416 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T17:34:05.464 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-17T17:34:05.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-17T17:34:05.488 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-17T17:34:05.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-17T17:34:05.602 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-17T17:34:05.627 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-17T17:34:05.717 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-17T17:34:05.741 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-17T17:34:05.805 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-17T17:34:05.896 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-17T17:34:05.920 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:34:05.922 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-17T17:34:05.974 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-17T17:34:05.974 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-17T17:34:05.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-17T17:34:05.977 INFO:tasks.ceph.mon.a:Started 2023-08-17T17:34:05.977 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-17T17:34:05.977 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-17T17:34:06.015 INFO:tasks.ceph.mon.b:Started 2023-08-17T17:34:06.016 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-17T17:34:06.016 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-17T17:34:06.018 INFO:tasks.ceph.mon.c:Started 2023-08-17T17:34:06.018 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-17T17:34:06.018 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-17T17:34:06.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-17T17:34:06.020 INFO:tasks.ceph.mgr.y:Started 2023-08-17T17:34:06.021 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-17T17:34:06.021 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-17T17:34:06.022 INFO:tasks.ceph.mgr.x:Started 2023-08-17T17:34:06.023 INFO:tasks.ceph:Setting crush tunables to default 2023-08-17T17:34:06.023 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2023-08-17T17:34:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.135+0000 7f15814f6700 1 Processor -- start 2023-08-17T17:34:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.135+0000 7f15814f6700 1 -- start start 2023-08-17T17:34:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.136+0000 7f15814f6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f157c063aa0 0x7f157c0c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.136+0000 7f15814f6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c0bcc80 con 0x7f157c0c37f0 2023-08-17T17:34:06.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.136+0000 7f15814f6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c0bced0 con 0x7f157c0c2810 2023-08-17T17:34:06.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.136+0000 7f15814f6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c0bd1b0 con 0x7f157c063aa0 2023-08-17T17:34:06.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.136+0000 7f157b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f157c0c37f0 0x7f157c15aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45124/0 (socket says 172.21.15.78:45124) 2023-08-17T17:34:06.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.136+0000 7f157b7fe700 1 -- 172.21.15.78:0/434323373 learned_addr learned my addr 172.21.15.78:0/434323373 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:06.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.136+0000 7f157a7fc700 1 --2- 172.21.15.78:0/434323373 >> v2:172.21.15.150:3300/0 conn(0x7f157c063aa0 0x7f157c0c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:06.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.137+0000 7f157a7fc700 1 -- 172.21.15.78:0/434323373 >> v2:172.21.15.150:3300/0 conn(0x7f157c063aa0 msgr2=0x7f157c0c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T17:34:06.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.137+0000 7f157a7fc700 1 -- 172.21.15.78:0/434323373 >> v2:172.21.15.150:3300/0 conn(0x7f157c063aa0 msgr2=0x7f157c0c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T17:34:06.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.137+0000 7f157a7fc700 1 --2- 172.21.15.78:0/434323373 >> v2:172.21.15.150:3300/0 conn(0x7f157c063aa0 0x7f157c0c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T17:34:06.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.137+0000 7f157a7fc700 1 --2- 172.21.15.78:0/434323373 >> v2:172.21.15.150:3300/0 conn(0x7f157c063aa0 0x7f157c0c3300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:34:06.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.334+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880905062 0 0) 0x7f157c0bcc80 con 0x7f157c0c37f0 2023-08-17T17:34:06.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.334+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15640033f0 con 0x7f157c0c37f0 2023-08-17T17:34:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1691666985 0 0) 0x7f15640033f0 con 0x7f157c0c37f0 2023-08-17T17:34:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 >> v2:172.21.15.150:3300/0 conn(0x7f157c063aa0 msgr2=0x7f157c0c3300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-17T17:34:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 --2- 172.21.15.78:0/434323373 >> v2:172.21.15.150:3300/0 conn(0x7f157c063aa0 0x7f157c0c3300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 >> v1:172.21.15.150:6789/0 conn(0x7f157c0c2810 legacy=0x7f157c0c2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0bd490 con 0x7f157c0c37f0 2023-08-17T17:34:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f15740017f0 con 0x7f157c0c37f0 2023-08-17T17:34:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 >> v1:172.21.15.78:6789/0 conn(0x7f157c0c37f0 legacy=0x7f157c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15640038e0 0x7f1564003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1564004690 0x7f1564004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1564005050 0x7f156400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0bd1b0 con 0x7f15640038e0 2023-08-17T17:34:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156400e1f0 con 0x7f1564005050 2023-08-17T17:34:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.335+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156400e3b0 con 0x7f1564004690 2023-08-17T17:34:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157a7fc700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1564004690 0x7f1564004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157b7fe700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1564005050 0x7f156400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157affd700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15640038e0 0x7f1564003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157a7fc700 1 -- 172.21.15.78:0/434323373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1564005050 msgr2=0x7f156400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157a7fc700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1564005050 0x7f156400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157a7fc700 1 -- 172.21.15.78:0/434323373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15640038e0 msgr2=0x7f1564003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157a7fc700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15640038e0 0x7f1564003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157b7fe700 1 -- 172.21.15.78:0/434323373 reap_dead start 2023-08-17T17:34:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157a7fc700 1 -- 172.21.15.78:0/434323373 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640033f0 con 0x7f1564004690 2023-08-17T17:34:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157affd700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15640038e0 0x7f1564003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.336+0000 7f157a7fc700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1564004690 0x7f1564004b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1570006db0 tx=0x7f1570008040).ready entity=mon.2 client_cookie=826ead5cd6b6c392 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.338+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570013480 con 0x7f1564004690 2023-08-17T17:34:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.339+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15700135e0 con 0x7f1564004690 2023-08-17T17:34:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.339+0000 7f1579ffb700 1 -- 172.21.15.78:0/434323373 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570013980 con 0x7f1564004690 2023-08-17T17:34:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.339+0000 7f15814f6700 1 -- 172.21.15.78:0/434323373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1564004690 msgr2=0x7f1564004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.339+0000 7f15814f6700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1564004690 0x7f1564004b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1570006db0 tx=0x7f1570008040).stop 2023-08-17T17:34:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.339+0000 7f15814f6700 1 -- 172.21.15.78:0/434323373 shutdown_connections 2023-08-17T17:34:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.339+0000 7f15814f6700 1 --2- 172.21.15.78:0/434323373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1564004690 0x7f1564004b10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.339+0000 7f15814f6700 1 -- 172.21.15.78:0/434323373 >> 172.21.15.78:0/434323373 conn(0x7f157c0c3db0 msgr2=0x7f157c0c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.339+0000 7f15814f6700 1 -- 172.21.15.78:0/434323373 shutdown_connections 2023-08-17T17:34:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.339+0000 7f15814f6700 1 -- 172.21.15.78:0/434323373 wait complete. 2023-08-17T17:34:06.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.341+0000 7f15814f6700 1 Processor -- start 2023-08-17T17:34:06.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.341+0000 7f15814f6700 1 -- start start 2023-08-17T17:34:06.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.341+0000 7f15814f6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1564004690 0x7f157c0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:06.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.341+0000 7f15814f6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c14e190 0x7f157c0a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:06.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.341+0000 7f15814f6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f157c14e610 0x7f157c0a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:06.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.341+0000 7f15814f6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0ad320 con 0x7f1564004690 2023-08-17T17:34:06.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.341+0000 7f15814f6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c14dd00 con 0x7f157c14e190 2023-08-17T17:34:06.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.341+0000 7f15814f6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c14d0f0 con 0x7f157c14e610 2023-08-17T17:34:06.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1564004690 0x7f157c0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:06.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1564004690 0x7f157c0ace30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47390/0 (socket says 172.21.15.78:47390) 2023-08-17T17:34:06.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157affd700 1 -- 172.21.15.78:0/4039073260 learned_addr learned my addr 172.21.15.78:0/4039073260 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:06.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157b7fe700 1 --2- 172.21.15.78:0/4039073260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f157c14e610 0x7f157c0a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:06.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157a7fc700 1 --2- 172.21.15.78:0/4039073260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c14e190 0x7f157c0a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:06.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157affd700 1 -- 172.21.15.78:0/4039073260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f157c14e610 msgr2=0x7f157c0a5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:06.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157affd700 1 --2- 172.21.15.78:0/4039073260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f157c14e610 0x7f157c0a5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:06.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157affd700 1 -- 172.21.15.78:0/4039073260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c14e190 msgr2=0x7f157c0a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:06.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157affd700 1 --2- 172.21.15.78:0/4039073260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c14e190 0x7f157c0a59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:06.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157affd700 1 -- 172.21.15.78:0/4039073260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c14d3d0 con 0x7f1564004690 2023-08-17T17:34:06.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f157affd700 1 --2- 172.21.15.78:0/4039073260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1564004690 0x7f157c0ace30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f156c00f8e0 tx=0x7f156c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:06.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f1562ffd700 1 -- 172.21.15.78:0/4039073260 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c011590 con 0x7f1564004690 2023-08-17T17:34:06.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f1562ffd700 1 -- 172.21.15.78:0/4039073260 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c0116f0 con 0x7f1564004690 2023-08-17T17:34:06.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f15814f6700 1 -- 172.21.15.78:0/4039073260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157c14d6b0 con 0x7f1564004690 2023-08-17T17:34:06.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f1562ffd700 1 -- 172.21.15.78:0/4039073260 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c011a70 con 0x7f1564004690 2023-08-17T17:34:06.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f15814f6700 1 -- 172.21.15.78:0/4039073260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c14cd10 con 0x7f1564004690 2023-08-17T17:34:06.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.342+0000 7f1562ffd700 1 -- 172.21.15.78:0/4039073260 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f156c01a030 con 0x7f1564004690 2023-08-17T17:34:06.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.343+0000 7f1562ffd700 1 -- 172.21.15.78:0/4039073260 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f156c013760 con 0x7f1564004690 2023-08-17T17:34:06.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.343+0000 7f15814f6700 1 -- 172.21.15.78:0/4039073260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157c14dfe0 con 0x7f1564004690 2023-08-17T17:34:06.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.347+0000 7f1562ffd700 1 -- 172.21.15.78:0/4039073260 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f156c018070 con 0x7f1564004690 2023-08-17T17:34:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.421+0000 7f15814f6700 1 -- 172.21.15.78:0/4039073260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f157c0c48d0 con 0x7f1564004690 2023-08-17T17:34:06.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.424+0000 7f1562ffd700 1 -- 172.21.15.78:0/4039073260 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f156c011e60 con 0x7f1564004690 2023-08-17T17:34:06.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.425+0000 7f15814f6700 1 -- 172.21.15.78:0/4039073260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1564004690 msgr2=0x7f157c0ace30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:06.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.425+0000 7f15814f6700 1 --2- 172.21.15.78:0/4039073260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1564004690 0x7f157c0ace30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f156c00f8e0 tx=0x7f156c009040).stop 2023-08-17T17:34:06.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.425+0000 7f15814f6700 1 -- 172.21.15.78:0/4039073260 shutdown_connections 2023-08-17T17:34:06.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.425+0000 7f15814f6700 1 --2- 172.21.15.78:0/4039073260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f157c14e610 0x7f157c0a5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:06.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.425+0000 7f15814f6700 1 --2- 172.21.15.78:0/4039073260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1564004690 0x7f157c0ace30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:06.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.425+0000 7f15814f6700 1 --2- 172.21.15.78:0/4039073260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f157c14e190 0x7f157c0a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:06.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.425+0000 7f15814f6700 1 -- 172.21.15.78:0/4039073260 >> 172.21.15.78:0/4039073260 conn(0x7f157c0c3db0 msgr2=0x7f157c068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:06.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.425+0000 7f15814f6700 1 -- 172.21.15.78:0/4039073260 shutdown_connections 2023-08-17T17:34:06.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:06.425+0000 7f15814f6700 1 -- 172.21.15.78:0/4039073260 wait complete. 2023-08-17T17:34:06.428 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2023-08-17T17:34:06.438 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-17T17:34:06.439 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:06.439 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-17T17:34:06.463 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:06.463 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-17T17:34:06.470 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:06.470+0000 7f1ff58aa680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:34:06.482 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:06.480+0000 7f257684a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:34:06.507 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:06.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-17T17:34:06.540 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:06.539+0000 7f1ff58aa680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:34:06.556 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:06.555+0000 7f257684a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:34:06.573 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-08-17T17:34:06.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-17T17:34:06.637 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:06.638 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-17T17:34:06.663 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:06.663 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-17T17:34:06.727 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:06.728 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-17T17:34:06.792 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-08-17T17:34:06.792 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-17T17:34:06.856 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 42c2b385-06e5-4d89-97bd-8c3dccec45d7 0 2023-08-17T17:34:07.011 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.010+0000 7f0b21c84700 1 Processor -- start 2023-08-17T17:34:07.011 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.010+0000 7f0b21c84700 1 -- start start 2023-08-17T17:34:07.012 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.010+0000 7f0b21c84700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0b1c0aa0f0 0x7f0b1c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.012 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.010+0000 7f0b21c84700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1c0649b0 con 0x7f0b1c0c5810 2023-08-17T17:34:07.012 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.010+0000 7f0b21c84700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1c063420 con 0x7f0b1c0aa4d0 2023-08-17T17:34:07.013 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.010+0000 7f0b21c84700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1c063700 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.013 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.011+0000 7f0b1b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0b1c0aa0f0 0x7f0b1c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.013 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.011+0000 7f0b1b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0b1c0aa0f0 0x7f0b1c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59310/0 (socket says 172.21.15.150:59310) 2023-08-17T17:34:07.013 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.011+0000 7f0b1b7fe700 1 -- 172.21.15.150:0/1823237456 learned_addr learned my addr 172.21.15.150:0/1823237456 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:07.013 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.011+0000 7f0b1b7fe700 1 -- 172.21.15.150:0/1823237456 >> v1:172.21.15.150:6789/0 conn(0x7f0b1c0aa4d0 legacy=0x7f0b1c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.013 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.011+0000 7f0b1b7fe700 1 -- 172.21.15.150:0/1823237456 >> v1:172.21.15.78:6789/0 conn(0x7f0b1c0c5810 legacy=0x7f0b1c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.013 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.011+0000 7f0b1b7fe700 1 -- 172.21.15.150:0/1823237456 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c0639e0 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.011+0000 7f0b1b7fe700 1 --2- 172.21.15.150:0/1823237456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 0x7f0b1c0644c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0b0c006fd0 tx=0x7f0b0c0090f0).ready entity=mon.1 client_cookie=95229ea2d331a8a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.011+0000 7f0b1affd700 1 -- 172.21.15.150:0/1823237456 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00b600 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.011+0000 7f0b1affd700 1 -- 172.21.15.150:0/1823237456 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c00b760 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.014 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.011+0000 7f0b1affd700 1 -- 172.21.15.150:0/1823237456 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00bae0 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.016 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.012+0000 7f0b21c84700 1 -- 172.21.15.150:0/1823237456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 msgr2=0x7f0b1c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.016 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.012+0000 7f0b21c84700 1 --2- 172.21.15.150:0/1823237456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 0x7f0b1c0644c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0b0c006fd0 tx=0x7f0b0c0090f0).stop 2023-08-17T17:34:07.017 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.012+0000 7f0b21c84700 1 -- 172.21.15.150:0/1823237456 shutdown_connections 2023-08-17T17:34:07.017 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.012+0000 7f0b21c84700 1 --2- 172.21.15.150:0/1823237456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 0x7f0b1c0644c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.017 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.012+0000 7f0b21c84700 1 -- 172.21.15.150:0/1823237456 >> 172.21.15.150:0/1823237456 conn(0x7f0b1c06a6a0 msgr2=0x7f0b1c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:07.017 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.012+0000 7f0b21c84700 1 -- 172.21.15.150:0/1823237456 shutdown_connections 2023-08-17T17:34:07.017 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.012+0000 7f0b21c84700 1 -- 172.21.15.150:0/1823237456 wait complete. 2023-08-17T17:34:07.017 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.013+0000 7f0b21c84700 1 Processor -- start 2023-08-17T17:34:07.017 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.013+0000 7f0b21c84700 1 -- start start 2023-08-17T17:34:07.018 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b21c84700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 0x7f0b1c0c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.018 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b21c84700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b1c0aa4d0 0x7f0b1c0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.018 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b21c84700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b1c0c5810 0x7f0b1c0acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.018 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b21c84700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0aba20 con 0x7f0b1c0aa4d0 2023-08-17T17:34:07.018 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b21c84700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0abd00 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.018 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b21c84700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0abfe0 con 0x7f0b1c0c5810 2023-08-17T17:34:07.018 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b1b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 0x7f0b1c0c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.018 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b1b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 0x7f0b1c0c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59316/0 (socket says 172.21.15.150:59316) 2023-08-17T17:34:07.019 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b1b7fe700 1 -- 172.21.15.150:0/2688303918 learned_addr learned my addr 172.21.15.150:0/2688303918 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:07.019 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b1bfff700 1 --2- 172.21.15.150:0/2688303918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b1c0c5810 0x7f0b1c0acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.019 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b13fff700 1 --2- 172.21.15.150:0/2688303918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b1c0aa4d0 0x7f0b1c0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.019 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b1b7fe700 1 -- 172.21.15.150:0/2688303918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b1c0c5810 msgr2=0x7f0b1c0acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.019 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b1b7fe700 1 --2- 172.21.15.150:0/2688303918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b1c0c5810 0x7f0b1c0acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.019 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b1b7fe700 1 -- 172.21.15.150:0/2688303918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b1c0aa4d0 msgr2=0x7f0b1c0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.019 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b1b7fe700 1 --2- 172.21.15.150:0/2688303918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b1c0aa4d0 0x7f0b1c0c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.019 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b1b7fe700 1 -- 172.21.15.150:0/2688303918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c009370 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.020 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b1b7fe700 1 --2- 172.21.15.150:0/2688303918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 0x7f0b1c0c3180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0b1c05e180 tx=0x7f0b0c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:07.020 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.014+0000 7f0b137fe700 1 -- 172.21.15.150:0/2688303918 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00b8d0 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.020 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.015+0000 7f0b137fe700 1 -- 172.21.15.150:0/2688303918 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c00ba30 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.020 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.015+0000 7f0b21c84700 1 -- 172.21.15.150:0/2688303918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c0ac2c0 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.020 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.015+0000 7f0b137fe700 1 -- 172.21.15.150:0/2688303918 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c01c670 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.020 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.015+0000 7f0b21c84700 1 -- 172.21.15.150:0/2688303918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c0c23b0 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.020 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.015+0000 7f0b137fe700 1 -- 172.21.15.150:0/2688303918 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f0b0c02c070 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.021 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.015+0000 7f0b137fe700 1 -- 172.21.15.150:0/2688303918 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0b0c025450 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.021 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.015+0000 7f0b21c84700 1 -- 172.21.15.150:0/2688303918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c083980 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.021 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.018+0000 7f0b137fe700 1 -- 172.21.15.150:0/2688303918 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f0b0c044e50 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.022 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:07.020+0000 7f257684a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:34:07.042 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:07.041+0000 7f1ff58aa680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:34:07.099 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.098+0000 7f0b21c84700 1 -- 172.21.15.150:0/2688303918 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "42c2b385-06e5-4d89-97bd-8c3dccec45d7", "id": 0} v 0) v1 -- 0x7f0b1c046af0 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.106 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.105+0000 7f0b137fe700 1 -- 172.21.15.150:0/2688303918 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42c2b385-06e5-4d89-97bd-8c3dccec45d7", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b0c033030 con 0x7f0b1c0aa0f0 2023-08-17T17:34:07.106 INFO:teuthology.orchestra.run.smithi150.stdout:0 2023-08-17T17:34:07.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.106+0000 7f0b21c84700 1 -- 172.21.15.150:0/2688303918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 msgr2=0x7f0b1c0c3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.106+0000 7f0b21c84700 1 --2- 172.21.15.150:0/2688303918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 0x7f0b1c0c3180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0b1c05e180 tx=0x7f0b0c017000).stop 2023-08-17T17:34:07.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.106+0000 7f0b21c84700 1 -- 172.21.15.150:0/2688303918 shutdown_connections 2023-08-17T17:34:07.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.106+0000 7f0b21c84700 1 --2- 172.21.15.150:0/2688303918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b1c0c5810 0x7f0b1c0acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.106+0000 7f0b21c84700 1 --2- 172.21.15.150:0/2688303918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b1c0aa0f0 0x7f0b1c0c3180 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.106+0000 7f0b21c84700 1 --2- 172.21.15.150:0/2688303918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b1c0aa4d0 0x7f0b1c0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.106+0000 7f0b21c84700 1 -- 172.21.15.150:0/2688303918 >> 172.21.15.150:0/2688303918 conn(0x7f0b1c06a6a0 msgr2=0x7f0b1c0a8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:07.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.106+0000 7f0b21c84700 1 -- 172.21.15.150:0/2688303918 shutdown_connections 2023-08-17T17:34:07.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.106+0000 7f0b21c84700 1 -- 172.21.15.150:0/2688303918 wait complete. 2023-08-17T17:34:07.119 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 4ac7311a-0a2a-4db4-b60e-0b6158830160 1 2023-08-17T17:34:07.234 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.233+0000 7f3cb9fda700 1 Processor -- start 2023-08-17T17:34:07.234 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.233+0000 7f3cb9fda700 1 -- start start 2023-08-17T17:34:07.235 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb9fda700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3cb40aa0f0 0x7f3cb40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.235 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb9fda700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb40649b0 con 0x7f3cb40aa4d0 2023-08-17T17:34:07.236 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb9fda700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb4063420 con 0x7f3cb40c5810 2023-08-17T17:34:07.236 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb9fda700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb4063700 con 0x7f3cb40aa0f0 2023-08-17T17:34:07.236 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb37fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3cb40aa0f0 0x7f3cb40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.236 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb37fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3cb40aa0f0 0x7f3cb40644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59322/0 (socket says 172.21.15.150:59322) 2023-08-17T17:34:07.236 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb37fe700 1 -- 172.21.15.150:0/2982122916 learned_addr learned my addr 172.21.15.150:0/2982122916 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:07.236 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb37fe700 1 -- 172.21.15.150:0/2982122916 >> v1:172.21.15.150:6789/0 conn(0x7f3cb40c5810 legacy=0x7f3cb40a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.236 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb37fe700 1 -- 172.21.15.150:0/2982122916 >> v1:172.21.15.78:6789/0 conn(0x7f3cb40aa4d0 legacy=0x7f3cb40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb37fe700 1 -- 172.21.15.150:0/2982122916 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40639e0 con 0x7f3cb40aa0f0 2023-08-17T17:34:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb37fe700 1 --2- 172.21.15.150:0/2982122916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40aa0f0 0x7f3cb40644c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3ca4006fd0 tx=0x7f3ca40090f0).ready entity=mon.1 client_cookie=7a4247bb41df745a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb27fc700 1 -- 172.21.15.150:0/2982122916 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400b600 con 0x7f3cb40aa0f0 2023-08-17T17:34:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb27fc700 1 -- 172.21.15.150:0/2982122916 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca400b760 con 0x7f3cb40aa0f0 2023-08-17T17:34:07.237 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.234+0000 7f3cb27fc700 1 -- 172.21.15.150:0/2982122916 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400bae0 con 0x7f3cb40aa0f0 2023-08-17T17:34:07.239 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.235+0000 7f3cb9fda700 1 -- 172.21.15.150:0/2982122916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40aa0f0 msgr2=0x7f3cb40644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.239 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.235+0000 7f3cb9fda700 1 --2- 172.21.15.150:0/2982122916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40aa0f0 0x7f3cb40644c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3ca4006fd0 tx=0x7f3ca40090f0).stop 2023-08-17T17:34:07.240 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.235+0000 7f3cb9fda700 1 -- 172.21.15.150:0/2982122916 shutdown_connections 2023-08-17T17:34:07.240 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.235+0000 7f3cb9fda700 1 --2- 172.21.15.150:0/2982122916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40aa0f0 0x7f3cb40644c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.240 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.235+0000 7f3cb9fda700 1 -- 172.21.15.150:0/2982122916 >> 172.21.15.150:0/2982122916 conn(0x7f3cb406a6a0 msgr2=0x7f3cb40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:07.240 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.235+0000 7f3cb9fda700 1 -- 172.21.15.150:0/2982122916 shutdown_connections 2023-08-17T17:34:07.240 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.235+0000 7f3cb9fda700 1 -- 172.21.15.150:0/2982122916 wait complete. 2023-08-17T17:34:07.240 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.236+0000 7f3cb9fda700 1 Processor -- start 2023-08-17T17:34:07.240 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.236+0000 7f3cb9fda700 1 -- start start 2023-08-17T17:34:07.241 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb9fda700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40aa0f0 0x7f3cb4142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.241 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb9fda700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb40aa4d0 0x7f3cb40c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.241 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb9fda700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40c5810 0x7f3cb40af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.241 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb9fda700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40c2870 con 0x7f3cb40aa4d0 2023-08-17T17:34:07.241 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb9fda700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40c1c60 con 0x7f3cb40c5810 2023-08-17T17:34:07.241 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb9fda700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40c1f40 con 0x7f3cb40aa0f0 2023-08-17T17:34:07.241 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb37fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40aa0f0 0x7f3cb4142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.241 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40c5810 0x7f3cb40af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb37fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40aa0f0 0x7f3cb4142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:43054/0 (socket says 172.21.15.150:43054) 2023-08-17T17:34:07.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40c5810 0x7f3cb40af400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59336/0 (socket says 172.21.15.150:59336) 2023-08-17T17:34:07.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb37fe700 1 -- 172.21.15.150:0/3033001178 learned_addr learned my addr 172.21.15.150:0/3033001178 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:07.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb2ffd700 1 --2- 172.21.15.150:0/3033001178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb40aa4d0 0x7f3cb40c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb3fff700 1 -- 172.21.15.150:0/3033001178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40aa0f0 msgr2=0x7f3cb4142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb3fff700 1 --2- 172.21.15.150:0/3033001178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40aa0f0 0x7f3cb4142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb3fff700 1 -- 172.21.15.150:0/3033001178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb40aa4d0 msgr2=0x7f3cb40c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb3fff700 1 --2- 172.21.15.150:0/3033001178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb40aa4d0 0x7f3cb40c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb3fff700 1 -- 172.21.15.150:0/3033001178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4009370 con 0x7f3cb40c5810 2023-08-17T17:34:07.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.237+0000 7f3cb37fe700 1 --2- 172.21.15.150:0/3033001178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40aa0f0 0x7f3cb4142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:07.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.238+0000 7f3cb3fff700 1 --2- 172.21.15.150:0/3033001178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40c5810 0x7f3cb40af400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3cac00c790 tx=0x7f3cac001460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:07.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.238+0000 7f3c9b7fe700 1 -- 172.21.15.150:0/3033001178 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00f470 con 0x7f3cb40c5810 2023-08-17T17:34:07.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.238+0000 7f3c9b7fe700 1 -- 172.21.15.150:0/3033001178 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac00f5d0 con 0x7f3cb40c5810 2023-08-17T17:34:07.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.238+0000 7f3cb9fda700 1 -- 172.21.15.150:0/3033001178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb40c2220 con 0x7f3cb40c5810 2023-08-17T17:34:07.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.238+0000 7f3c9b7fe700 1 -- 172.21.15.150:0/3033001178 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00f950 con 0x7f3cb40c5810 2023-08-17T17:34:07.244 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.238+0000 7f3cb9fda700 1 -- 172.21.15.150:0/3033001178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb4151530 con 0x7f3cb40c5810 2023-08-17T17:34:07.244 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.238+0000 7f3c9b7fe700 1 -- 172.21.15.150:0/3033001178 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f3cac019030 con 0x7f3cb40c5810 2023-08-17T17:34:07.244 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.238+0000 7f3c9b7fe700 1 -- 172.21.15.150:0/3033001178 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f3cac01ca60 con 0x7f3cb40c5810 2023-08-17T17:34:07.244 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.239+0000 7f3cb9fda700 1 -- 172.21.15.150:0/3033001178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb40c29e0 con 0x7f3cb40c5810 2023-08-17T17:34:07.244 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.241+0000 7f3c9b7fe700 1 -- 172.21.15.150:0/3033001178 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3cac021060 con 0x7f3cb40c5810 2023-08-17T17:34:07.323 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.322+0000 7f3cb9fda700 1 -- 172.21.15.150:0/3033001178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4ac7311a-0a2a-4db4-b60e-0b6158830160", "id": 1} v 0) v1 -- 0x7f3cb4046af0 con 0x7f3cb40c5810 2023-08-17T17:34:07.330 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.329+0000 7f3c9b7fe700 1 -- 172.21.15.150:0/3033001178 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ac7311a-0a2a-4db4-b60e-0b6158830160", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3cac017070 con 0x7f3cb40c5810 2023-08-17T17:34:07.331 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-08-17T17:34:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.330+0000 7f3cb9fda700 1 -- 172.21.15.150:0/3033001178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40c5810 msgr2=0x7f3cb40af400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.330+0000 7f3cb9fda700 1 --2- 172.21.15.150:0/3033001178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40c5810 0x7f3cb40af400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3cac00c790 tx=0x7f3cac001460).stop 2023-08-17T17:34:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.330+0000 7f3cb9fda700 1 -- 172.21.15.150:0/3033001178 shutdown_connections 2023-08-17T17:34:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.330+0000 7f3cb9fda700 1 --2- 172.21.15.150:0/3033001178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40c5810 0x7f3cb40af400 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.330+0000 7f3cb9fda700 1 --2- 172.21.15.150:0/3033001178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40aa0f0 0x7f3cb4142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.332 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.330+0000 7f3cb9fda700 1 --2- 172.21.15.150:0/3033001178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb40aa4d0 0x7f3cb40c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.333 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.331+0000 7f3cb9fda700 1 -- 172.21.15.150:0/3033001178 >> 172.21.15.150:0/3033001178 conn(0x7f3cb406a6a0 msgr2=0x7f3cb40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:07.333 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.331+0000 7f3cb9fda700 1 -- 172.21.15.150:0/3033001178 shutdown_connections 2023-08-17T17:34:07.333 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.331+0000 7f3cb9fda700 1 -- 172.21.15.150:0/3033001178 wait complete. 2023-08-17T17:34:07.343 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 2a1affbb-4a49-4cb8-8b99-b250458ee6d1 2 2023-08-17T17:34:07.460 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.459+0000 7f1bbc584700 1 Processor -- start 2023-08-17T17:34:07.460 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.459+0000 7f1bbc584700 1 -- start start 2023-08-17T17:34:07.462 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bbc584700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1bb40aa0f0 0x7f1bb40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.462 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bbc584700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1bb40aa4d0 0x7f1bb40c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.462 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bbc584700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb40649b0 con 0x7f1bb40c5810 2023-08-17T17:34:07.462 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bbc584700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb4063420 con 0x7f1bb40aa4d0 2023-08-17T17:34:07.462 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bbc584700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb4063700 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bba320700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1bb40aa0f0 0x7f1bb40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bba320700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1bb40aa0f0 0x7f1bb40644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59350/0 (socket says 172.21.15.150:59350) 2023-08-17T17:34:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bba320700 1 -- 172.21.15.150:0/3695125997 learned_addr learned my addr 172.21.15.150:0/3695125997 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bb9b1f700 1 --2- 172.21.15.150:0/3695125997 >> v2:172.21.15.78:3300/0 conn(0x7f1bb40aa4d0 0x7f1bb40c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bba320700 1 -- 172.21.15.150:0/3695125997 >> v2:172.21.15.78:3300/0 conn(0x7f1bb40aa4d0 msgr2=0x7f1bb40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.460+0000 7f1bba320700 1 --2- 172.21.15.150:0/3695125997 >> v2:172.21.15.78:3300/0 conn(0x7f1bb40aa4d0 0x7f1bb40c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.463 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bba320700 1 -- 172.21.15.150:0/3695125997 >> v1:172.21.15.78:6789/0 conn(0x7f1bb40c5810 legacy=0x7f1bb40a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bba320700 1 -- 172.21.15.150:0/3695125997 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40639e0 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bb9b1f700 1 --2- 172.21.15.150:0/3695125997 >> v2:172.21.15.78:3300/0 conn(0x7f1bb40aa4d0 0x7f1bb40c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bba320700 1 --2- 172.21.15.150:0/3695125997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb40aa0f0 0x7f1bb40644c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f1bb40cade0 tx=0x7f1ba40090f0).ready entity=mon.1 client_cookie=f11e080c90d08293 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bb931e700 1 -- 172.21.15.150:0/3695125997 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400b600 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bb931e700 1 -- 172.21.15.150:0/3695125997 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba400b760 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.464 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bb931e700 1 -- 172.21.15.150:0/3695125997 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400bae0 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.466 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bbc584700 1 -- 172.21.15.150:0/3695125997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb40aa0f0 msgr2=0x7f1bb40644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bbc584700 1 --2- 172.21.15.150:0/3695125997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb40aa0f0 0x7f1bb40644c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f1bb40cade0 tx=0x7f1ba40090f0).stop 2023-08-17T17:34:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bbc584700 1 -- 172.21.15.150:0/3695125997 shutdown_connections 2023-08-17T17:34:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bbc584700 1 --2- 172.21.15.150:0/3695125997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb40aa0f0 0x7f1bb40644c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bbc584700 1 --2- 172.21.15.150:0/3695125997 >> v2:172.21.15.78:3300/0 conn(0x7f1bb40aa4d0 0x7f1bb40c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bbc584700 1 -- 172.21.15.150:0/3695125997 >> 172.21.15.150:0/3695125997 conn(0x7f1bb406a6a0 msgr2=0x7f1bb40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bbc584700 1 -- 172.21.15.150:0/3695125997 shutdown_connections 2023-08-17T17:34:07.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.461+0000 7f1bbc584700 1 -- 172.21.15.150:0/3695125997 wait complete. 2023-08-17T17:34:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.463+0000 7f1bbc584700 1 Processor -- start 2023-08-17T17:34:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.463+0000 7f1bbc584700 1 -- start start 2023-08-17T17:34:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.463+0000 7f1bbc584700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb40aa0f0 0x7f1bb40c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.463+0000 7f1bbc584700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb40aa4d0 0x7f1bb40ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.463+0000 7f1bbc584700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb40c5810 0x7f1bb4167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.463+0000 7f1bbc584700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40abed0 con 0x7f1bb40aa4d0 2023-08-17T17:34:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.463+0000 7f1bbc584700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40ac1b0 con 0x7f1bb40c5810 2023-08-17T17:34:07.468 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.463+0000 7f1bbc584700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40ac490 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.463+0000 7f1bba320700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb40aa0f0 0x7f1bb40c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.463+0000 7f1bbab21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb40c5810 0x7f1bb4167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bba320700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb40aa0f0 0x7f1bb40c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:43066/0 (socket says 172.21.15.150:43066) 2023-08-17T17:34:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bba320700 1 -- 172.21.15.150:0/435444925 learned_addr learned my addr 172.21.15.150:0/435444925 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bb9b1f700 1 --2- 172.21.15.150:0/435444925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb40aa4d0 0x7f1bb40ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bba320700 1 -- 172.21.15.150:0/435444925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb40c5810 msgr2=0x7f1bb4167f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.469 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bba320700 1 --2- 172.21.15.150:0/435444925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb40c5810 0x7f1bb4167f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bba320700 1 -- 172.21.15.150:0/435444925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb40aa4d0 msgr2=0x7f1bb40ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bba320700 1 --2- 172.21.15.150:0/435444925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb40aa4d0 0x7f1bb40ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bba320700 1 -- 172.21.15.150:0/435444925 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba4009370 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bbab21700 1 --2- 172.21.15.150:0/435444925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb40c5810 0x7f1bb4167f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bba320700 1 --2- 172.21.15.150:0/435444925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb40aa0f0 0x7f1bb40c3ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1ba4009fd0 tx=0x7f1ba4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1baa7fc700 1 -- 172.21.15.150:0/435444925 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400b8d0 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1baa7fc700 1 -- 172.21.15.150:0/435444925 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba400ba30 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bbc584700 1 -- 172.21.15.150:0/435444925 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb40ac770 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1baa7fc700 1 -- 172.21.15.150:0/435444925 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba401b660 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1bbc584700 1 -- 172.21.15.150:0/435444925 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb40c43c0 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1baa7fc700 1 -- 172.21.15.150:0/435444925 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f1ba402b070 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.464+0000 7f1baa7fc700 1 -- 172.21.15.150:0/435444925 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f1ba40248a0 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.465+0000 7f1bbc584700 1 -- 172.21.15.150:0/435444925 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb40acc10 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.471 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.467+0000 7f1baa7fc700 1 -- 172.21.15.150:0/435444925 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f1ba4043e50 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.548 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.547+0000 7f1bbc584700 1 -- 172.21.15.150:0/435444925 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2a1affbb-4a49-4cb8-8b99-b250458ee6d1", "id": 2} v 0) v1 -- 0x7f1bb4154290 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.555 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.554+0000 7f1baa7fc700 1 -- 172.21.15.150:0/435444925 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2a1affbb-4a49-4cb8-8b99-b250458ee6d1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ba4032070 con 0x7f1bb40aa0f0 2023-08-17T17:34:07.556 INFO:teuthology.orchestra.run.smithi150.stdout:2 2023-08-17T17:34:07.556 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.555+0000 7f1bbc584700 1 -- 172.21.15.150:0/435444925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb40aa0f0 msgr2=0x7f1bb40c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.555+0000 7f1bbc584700 1 --2- 172.21.15.150:0/435444925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb40aa0f0 0x7f1bb40c3ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1ba4009fd0 tx=0x7f1ba4017000).stop 2023-08-17T17:34:07.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.555+0000 7f1bbc584700 1 -- 172.21.15.150:0/435444925 shutdown_connections 2023-08-17T17:34:07.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.555+0000 7f1bbc584700 1 --2- 172.21.15.150:0/435444925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb40c5810 0x7f1bb4167f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.555+0000 7f1bbc584700 1 --2- 172.21.15.150:0/435444925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb40aa0f0 0x7f1bb40c3ed0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.555+0000 7f1bbc584700 1 --2- 172.21.15.150:0/435444925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb40aa4d0 0x7f1bb40ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.555+0000 7f1bbc584700 1 -- 172.21.15.150:0/435444925 >> 172.21.15.150:0/435444925 conn(0x7f1bb406a6a0 msgr2=0x7f1bb40c03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:07.558 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.555+0000 7f1bbc584700 1 -- 172.21.15.150:0/435444925 shutdown_connections 2023-08-17T17:34:07.558 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.555+0000 7f1bbc584700 1 -- 172.21.15.150:0/435444925 wait complete. 2023-08-17T17:34:07.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 0cf5f55a-5d37-4964-97db-0a93a0aa12b2 3 2023-08-17T17:34:07.683 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.682+0000 7f71d695e700 1 Processor -- start 2023-08-17T17:34:07.684 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.682+0000 7f71d695e700 1 -- start start 2023-08-17T17:34:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.683+0000 7f71d695e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f71d00aa0f0 0x7f71d00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.683+0000 7f71d695e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f71d00c5810 0x7f71d00c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.685 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.683+0000 7f71d695e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d00649b0 con 0x7f71d00aa4d0 2023-08-17T17:34:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.683+0000 7f71d695e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d00c6170 con 0x7f71d00c5810 2023-08-17T17:34:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.683+0000 7f71d695e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d0063420 con 0x7f71d00aa0f0 2023-08-17T17:34:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.683+0000 7f71cffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f71d00aa0f0 0x7f71d00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.683+0000 7f71cffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f71d00aa0f0 0x7f71d00644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59378/0 (socket says 172.21.15.150:59378) 2023-08-17T17:34:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.683+0000 7f71cffff700 1 -- 172.21.15.150:0/1419743196 learned_addr learned my addr 172.21.15.150:0/1419743196 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.684+0000 7f71d4efb700 1 --2- 172.21.15.150:0/1419743196 >> v2:172.21.15.78:3300/0 conn(0x7f71d00c5810 0x7f71d00c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.686 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.684+0000 7f71cffff700 1 -- 172.21.15.150:0/1419743196 >> v2:172.21.15.78:3300/0 conn(0x7f71d00c5810 msgr2=0x7f71d00c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.684+0000 7f71cffff700 1 --2- 172.21.15.150:0/1419743196 >> v2:172.21.15.78:3300/0 conn(0x7f71d00c5810 0x7f71d00c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.684+0000 7f71cffff700 1 -- 172.21.15.150:0/1419743196 >> v1:172.21.15.150:6789/0 conn(0x7f71d00aa4d0 legacy=0x7f71d00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.684+0000 7f71cffff700 1 -- 172.21.15.150:0/1419743196 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0063700 con 0x7f71d00aa0f0 2023-08-17T17:34:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.684+0000 7f71cffff700 1 --2- 172.21.15.150:0/1419743196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa0f0 0x7f71d00644c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f71d00cade0 tx=0x7f71c40090f0).ready entity=mon.1 client_cookie=6a6d1736166b0d05 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.684+0000 7f71ceffd700 1 -- 172.21.15.150:0/1419743196 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400b520 con 0x7f71d00aa0f0 2023-08-17T17:34:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.684+0000 7f71ceffd700 1 -- 172.21.15.150:0/1419743196 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c400b680 con 0x7f71d00aa0f0 2023-08-17T17:34:07.687 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.684+0000 7f71ceffd700 1 -- 172.21.15.150:0/1419743196 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400ba00 con 0x7f71d00aa0f0 2023-08-17T17:34:07.690 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.685+0000 7f71d695e700 1 -- 172.21.15.150:0/1419743196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa0f0 msgr2=0x7f71d00644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.690 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.685+0000 7f71d695e700 1 --2- 172.21.15.150:0/1419743196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa0f0 0x7f71d00644c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f71d00cade0 tx=0x7f71c40090f0).stop 2023-08-17T17:34:07.690 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.685+0000 7f71d695e700 1 -- 172.21.15.150:0/1419743196 shutdown_connections 2023-08-17T17:34:07.690 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.685+0000 7f71d695e700 1 --2- 172.21.15.150:0/1419743196 >> v2:172.21.15.78:3300/0 conn(0x7f71d00c5810 0x7f71d00c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.690 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.685+0000 7f71d695e700 1 --2- 172.21.15.150:0/1419743196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa0f0 0x7f71d00644c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.690 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.685+0000 7f71d695e700 1 -- 172.21.15.150:0/1419743196 >> 172.21.15.150:0/1419743196 conn(0x7f71d006a6a0 msgr2=0x7f71d00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:07.690 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.685+0000 7f71d695e700 1 -- 172.21.15.150:0/1419743196 shutdown_connections 2023-08-17T17:34:07.691 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.685+0000 7f71d695e700 1 -- 172.21.15.150:0/1419743196 wait complete. 2023-08-17T17:34:07.691 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.686+0000 7f71d695e700 1 Processor -- start 2023-08-17T17:34:07.691 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.686+0000 7f71d695e700 1 -- start start 2023-08-17T17:34:07.691 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71d695e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71d00aa0f0 0x7f71d00acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.691 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71d695e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa4d0 0x7f71d00ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.691 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71d695e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71d00c5810 0x7f71d0151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.691 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71d695e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d01521d0 con 0x7f71d00aa0f0 2023-08-17T17:34:07.691 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71d695e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0164510 con 0x7f71d00aa4d0 2023-08-17T17:34:07.692 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71d695e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00ab930 con 0x7f71d00c5810 2023-08-17T17:34:07.692 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71cf7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa4d0 0x7f71d00ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.692 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71d4efb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71d00c5810 0x7f71d0151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.692 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71cf7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa4d0 0x7f71d00ab370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59386/0 (socket says 172.21.15.150:59386) 2023-08-17T17:34:07.692 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71cf7fe700 1 -- 172.21.15.150:0/1007839204 learned_addr learned my addr 172.21.15.150:0/1007839204 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:07.692 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71cffff700 1 --2- 172.21.15.150:0/1007839204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71d00aa0f0 0x7f71d00acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.692 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71cf7fe700 1 -- 172.21.15.150:0/1007839204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71d00c5810 msgr2=0x7f71d0151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.693 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71cf7fe700 1 --2- 172.21.15.150:0/1007839204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71d00c5810 0x7f71d0151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.693 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71cf7fe700 1 -- 172.21.15.150:0/1007839204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71d00aa0f0 msgr2=0x7f71d00acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.693 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71cf7fe700 1 --2- 172.21.15.150:0/1007839204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71d00aa0f0 0x7f71d00acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.693 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71cf7fe700 1 -- 172.21.15.150:0/1007839204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009370 con 0x7f71d00aa4d0 2023-08-17T17:34:07.693 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71d4efb700 1 --2- 172.21.15.150:0/1007839204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71d00c5810 0x7f71d0151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:07.693 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71cf7fe700 1 --2- 172.21.15.150:0/1007839204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa4d0 0x7f71d00ab370 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f71c000c4c0 tx=0x7f71c0007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:07.693 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71b7fff700 1 -- 172.21.15.150:0/1007839204 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000ce10 con 0x7f71d00aa4d0 2023-08-17T17:34:07.693 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71b7fff700 1 -- 172.21.15.150:0/1007839204 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c0007020 con 0x7f71d00aa4d0 2023-08-17T17:34:07.694 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71d695e700 1 -- 172.21.15.150:0/1007839204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d00abc10 con 0x7f71d00aa4d0 2023-08-17T17:34:07.694 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.687+0000 7f71b7fff700 1 -- 172.21.15.150:0/1007839204 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c00073c0 con 0x7f71d00aa4d0 2023-08-17T17:34:07.694 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.688+0000 7f71d695e700 1 -- 172.21.15.150:0/1007839204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d00ac1d0 con 0x7f71d00aa4d0 2023-08-17T17:34:07.694 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.688+0000 7f71b7fff700 1 -- 172.21.15.150:0/1007839204 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f71c0010070 con 0x7f71d00aa4d0 2023-08-17T17:34:07.694 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.688+0000 7f71b7fff700 1 -- 172.21.15.150:0/1007839204 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f71c000f930 con 0x7f71d00aa4d0 2023-08-17T17:34:07.694 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.688+0000 7f71d695e700 1 -- 172.21.15.150:0/1007839204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d0083980 con 0x7f71d00aa4d0 2023-08-17T17:34:07.695 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.692+0000 7f71b7fff700 1 -- 172.21.15.150:0/1007839204 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f71c0020060 con 0x7f71d00aa4d0 2023-08-17T17:34:07.737 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:07.736+0000 7f257684a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:34:07.801 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.800+0000 7f71d695e700 1 -- 172.21.15.150:0/1007839204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0cf5f55a-5d37-4964-97db-0a93a0aa12b2", "id": 3} v 0) v1 -- 0x7f71d00cbd40 con 0x7f71d00aa4d0 2023-08-17T17:34:07.805 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:07.803+0000 7f257684a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:34:07.809 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.808+0000 7f71b7fff700 1 -- 172.21.15.150:0/1007839204 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0cf5f55a-5d37-4964-97db-0a93a0aa12b2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f71c0006db0 con 0x7f71d00aa4d0 2023-08-17T17:34:07.810 INFO:teuthology.orchestra.run.smithi150.stdout:3 2023-08-17T17:34:07.814 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.813+0000 7f71d695e700 1 -- 172.21.15.150:0/1007839204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa4d0 msgr2=0x7f71d00ab370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.814 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.813+0000 7f71d695e700 1 --2- 172.21.15.150:0/1007839204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa4d0 0x7f71d00ab370 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f71c000c4c0 tx=0x7f71c0007dd0).stop 2023-08-17T17:34:07.814 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.813+0000 7f71d695e700 1 -- 172.21.15.150:0/1007839204 shutdown_connections 2023-08-17T17:34:07.814 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.813+0000 7f71d695e700 1 --2- 172.21.15.150:0/1007839204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71d00c5810 0x7f71d0151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.814 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.813+0000 7f71d695e700 1 --2- 172.21.15.150:0/1007839204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71d00aa0f0 0x7f71d00acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.815 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.813+0000 7f71d695e700 1 --2- 172.21.15.150:0/1007839204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71d00aa4d0 0x7f71d00ab370 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.815 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.813+0000 7f71d695e700 1 -- 172.21.15.150:0/1007839204 >> 172.21.15.150:0/1007839204 conn(0x7f71d006a6a0 msgr2=0x7f71d00a8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:07.815 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.813+0000 7f71d695e700 1 -- 172.21.15.150:0/1007839204 shutdown_connections 2023-08-17T17:34:07.815 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.813+0000 7f71d695e700 1 -- 172.21.15.150:0/1007839204 wait complete. 2023-08-17T17:34:07.819 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:07.818+0000 7f1ff58aa680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:34:07.826 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new c7a4f57f-b4d3-4269-817e-b37ec5fe07eb 4 2023-08-17T17:34:07.890 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:07.889+0000 7f1ff58aa680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:34:07.941 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.940+0000 7f9b74e26700 1 Processor -- start 2023-08-17T17:34:07.941 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.940+0000 7f9b74e26700 1 -- start start 2023-08-17T17:34:07.943 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b74e26700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b700aa0f0 0x7f9b700644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.943 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b74e26700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b700aa4d0 0x7f9b700c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.943 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b74e26700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b700649b0 con 0x7f9b700c5810 2023-08-17T17:34:07.943 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b74e26700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b70063420 con 0x7f9b700aa0f0 2023-08-17T17:34:07.943 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b74e26700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b70063700 con 0x7f9b700aa4d0 2023-08-17T17:34:07.943 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b6dd9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b700aa4d0 0x7f9b700c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.944 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b6dd9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b700aa4d0 0x7f9b700c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59392/0 (socket says 172.21.15.150:59392) 2023-08-17T17:34:07.944 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b6dd9b700 1 -- 172.21.15.150:0/1463377960 learned_addr learned my addr 172.21.15.150:0/1463377960 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:07.944 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b6e59c700 1 --2- 172.21.15.150:0/1463377960 >> v2:172.21.15.78:3300/0 conn(0x7f9b700aa0f0 0x7f9b700644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.944 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b6dd9b700 1 -- 172.21.15.150:0/1463377960 >> v2:172.21.15.78:3300/0 conn(0x7f9b700aa0f0 msgr2=0x7f9b700644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:07.944 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b6dd9b700 1 --2- 172.21.15.150:0/1463377960 >> v2:172.21.15.78:3300/0 conn(0x7f9b700aa0f0 0x7f9b700644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.944 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.941+0000 7f9b6dd9b700 1 -- 172.21.15.150:0/1463377960 >> v1:172.21.15.150:6789/0 conn(0x7f9b700c5810 legacy=0x7f9b700a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.944 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.942+0000 7f9b6dd9b700 1 -- 172.21.15.150:0/1463377960 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b700639e0 con 0x7f9b700aa4d0 2023-08-17T17:34:07.945 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.942+0000 7f9b6dd9b700 1 --2- 172.21.15.150:0/1463377960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700aa4d0 0x7f9b700c0e10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9b70159060 tx=0x7f9b600090f0).ready entity=mon.1 client_cookie=2e4a28b154434a97 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:07.945 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.942+0000 7f9b6d59a700 1 -- 172.21.15.150:0/1463377960 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000b520 con 0x7f9b700aa4d0 2023-08-17T17:34:07.945 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.942+0000 7f9b6d59a700 1 -- 172.21.15.150:0/1463377960 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6000b680 con 0x7f9b700aa4d0 2023-08-17T17:34:07.945 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.942+0000 7f9b6d59a700 1 -- 172.21.15.150:0/1463377960 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000ba00 con 0x7f9b700aa4d0 2023-08-17T17:34:07.947 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.942+0000 7f9b74e26700 1 -- 172.21.15.150:0/1463377960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700aa4d0 msgr2=0x7f9b700c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.947 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.942+0000 7f9b74e26700 1 --2- 172.21.15.150:0/1463377960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700aa4d0 0x7f9b700c0e10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9b70159060 tx=0x7f9b600090f0).stop 2023-08-17T17:34:07.947 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.943+0000 7f9b74e26700 1 -- 172.21.15.150:0/1463377960 shutdown_connections 2023-08-17T17:34:07.948 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.943+0000 7f9b74e26700 1 --2- 172.21.15.150:0/1463377960 >> v2:172.21.15.78:3300/0 conn(0x7f9b700aa0f0 0x7f9b700644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.948 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.943+0000 7f9b74e26700 1 --2- 172.21.15.150:0/1463377960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700aa4d0 0x7f9b700c0e10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.948 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.943+0000 7f9b74e26700 1 -- 172.21.15.150:0/1463377960 >> 172.21.15.150:0/1463377960 conn(0x7f9b7006a6a0 msgr2=0x7f9b700caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:07.948 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.943+0000 7f9b74e26700 1 -- 172.21.15.150:0/1463377960 shutdown_connections 2023-08-17T17:34:07.948 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.943+0000 7f9b74e26700 1 -- 172.21.15.150:0/1463377960 wait complete. 2023-08-17T17:34:07.948 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.944+0000 7f9b74e26700 1 Processor -- start 2023-08-17T17:34:07.948 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.944+0000 7f9b74e26700 1 -- start start 2023-08-17T17:34:07.949 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.944+0000 7f9b74e26700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700aa0f0 0x7f9b701652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.949 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b74e26700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b700aa4d0 0x7f9b70151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.949 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b74e26700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c5810 0x7f9b700acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:07.949 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b74e26700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b70164e50 con 0x7f9b700aa4d0 2023-08-17T17:34:07.949 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b74e26700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b70152230 con 0x7f9b700c5810 2023-08-17T17:34:07.949 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b74e26700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700ad490 con 0x7f9b700aa0f0 2023-08-17T17:34:07.949 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c5810 0x7f9b700acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6e59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700aa0f0 0x7f9b701652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6e59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700aa0f0 0x7f9b701652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:43086/0 (socket says 172.21.15.150:43086) 2023-08-17T17:34:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c5810 0x7f9b700acbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59402/0 (socket says 172.21.15.150:59402) 2023-08-17T17:34:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6e59c700 1 -- 172.21.15.150:0/3489297181 learned_addr learned my addr 172.21.15.150:0/3489297181 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6dd9b700 1 --2- 172.21.15.150:0/3489297181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b700aa4d0 0x7f9b70151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6e59c700 1 -- 172.21.15.150:0/3489297181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c5810 msgr2=0x7f9b700acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6e59c700 1 --2- 172.21.15.150:0/3489297181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c5810 0x7f9b700acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6e59c700 1 -- 172.21.15.150:0/3489297181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b700aa4d0 msgr2=0x7f9b70151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:07.951 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6e59c700 1 --2- 172.21.15.150:0/3489297181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b700aa4d0 0x7f9b70151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:07.951 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6e59c700 1 -- 172.21.15.150:0/3489297181 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b60009370 con 0x7f9b700aa0f0 2023-08-17T17:34:07.951 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6dd9b700 1 --2- 172.21.15.150:0/3489297181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b700aa4d0 0x7f9b70151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:07.951 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6ed9d700 1 --2- 172.21.15.150:0/3489297181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c5810 0x7f9b700acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:07.951 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b6e59c700 1 --2- 172.21.15.150:0/3489297181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700aa0f0 0x7f9b701652e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f9b6400e950 tx=0x7f9b64009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:07.951 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b5e7fc700 1 -- 172.21.15.150:0/3489297181 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64009530 con 0x7f9b700aa0f0 2023-08-17T17:34:07.951 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b5e7fc700 1 -- 172.21.15.150:0/3489297181 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b64012600 con 0x7f9b700aa0f0 2023-08-17T17:34:07.951 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b74e26700 1 -- 172.21.15.150:0/3489297181 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b700ad770 con 0x7f9b700aa0f0 2023-08-17T17:34:07.952 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b5e7fc700 1 -- 172.21.15.150:0/3489297181 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64012980 con 0x7f9b700aa0f0 2023-08-17T17:34:07.952 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.945+0000 7f9b74e26700 1 -- 172.21.15.150:0/3489297181 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b701647e0 con 0x7f9b700aa0f0 2023-08-17T17:34:07.952 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.946+0000 7f9b5e7fc700 1 -- 172.21.15.150:0/3489297181 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f9b64022070 con 0x7f9b700aa0f0 2023-08-17T17:34:07.952 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.946+0000 7f9b5e7fc700 1 -- 172.21.15.150:0/3489297181 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f9b6401bb10 con 0x7f9b700aa0f0 2023-08-17T17:34:07.952 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.946+0000 7f9b74e26700 1 -- 172.21.15.150:0/3489297181 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b70083980 con 0x7f9b700aa0f0 2023-08-17T17:34:07.952 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:07.949+0000 7f9b5e7fc700 1 -- 172.21.15.150:0/3489297181 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9b6403ae50 con 0x7f9b700aa0f0 2023-08-17T17:34:07.995 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:07.993+0000 7f257684a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:34:08.030 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.029+0000 7f9b74e26700 1 -- 172.21.15.150:0/3489297181 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c7a4f57f-b4d3-4269-817e-b37ec5fe07eb", "id": 4} v 0) v1 -- 0x7f9b70046af0 con 0x7f9b700aa0f0 2023-08-17T17:34:08.038 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.038+0000 7f9b5e7fc700 1 -- 172.21.15.150:0/3489297181 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7a4f57f-b4d3-4269-817e-b37ec5fe07eb", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b64029030 con 0x7f9b700aa0f0 2023-08-17T17:34:08.039 INFO:teuthology.orchestra.run.smithi150.stdout:4 2023-08-17T17:34:08.040 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.039+0000 7f9b74e26700 1 -- 172.21.15.150:0/3489297181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700aa0f0 msgr2=0x7f9b701652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.040 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.039+0000 7f9b74e26700 1 --2- 172.21.15.150:0/3489297181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700aa0f0 0x7f9b701652e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f9b6400e950 tx=0x7f9b64009060).stop 2023-08-17T17:34:08.040 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.039+0000 7f9b74e26700 1 -- 172.21.15.150:0/3489297181 shutdown_connections 2023-08-17T17:34:08.040 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.039+0000 7f9b74e26700 1 --2- 172.21.15.150:0/3489297181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c5810 0x7f9b700acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.040 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.039+0000 7f9b74e26700 1 --2- 172.21.15.150:0/3489297181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700aa0f0 0x7f9b701652e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.041 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.039+0000 7f9b74e26700 1 --2- 172.21.15.150:0/3489297181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b700aa4d0 0x7f9b70151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.041 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.039+0000 7f9b74e26700 1 -- 172.21.15.150:0/3489297181 >> 172.21.15.150:0/3489297181 conn(0x7f9b7006a6a0 msgr2=0x7f9b700a80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:08.041 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.039+0000 7f9b74e26700 1 -- 172.21.15.150:0/3489297181 shutdown_connections 2023-08-17T17:34:08.041 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.039+0000 7f9b74e26700 1 -- 172.21.15.150:0/3489297181 wait complete. 2023-08-17T17:34:08.051 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new a6a24c9a-ea70-4685-90bc-2f4c8c05e248 5 2023-08-17T17:34:08.089 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:08.088+0000 7f1ff58aa680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:34:08.165 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.164+0000 7f6c53ba7700 1 Processor -- start 2023-08-17T17:34:08.165 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.164+0000 7f6c53ba7700 1 -- start start 2023-08-17T17:34:08.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c53ba7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c4c062c00 0x7f6c4c069f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c53ba7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c069b00 con 0x7f6c4c1545e0 2023-08-17T17:34:08.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c53ba7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c13ab20 con 0x7f6c4c13a740 2023-08-17T17:34:08.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c53ba7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c155640 con 0x7f6c4c062c00 2023-08-17T17:34:08.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c51943700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6c4c13a740 0x7f6c4c0624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:34790/0 (socket says 172.21.15.150:34790) 2023-08-17T17:34:08.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c51943700 1 -- 172.21.15.150:0/3071725613 learned_addr learned my addr 172.21.15.150:0/3071725613 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-08-17T17:34:08.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c51142700 1 --2- 172.21.15.150:0/3071725613 >> v2:172.21.15.78:3300/0 conn(0x7f6c4c062c00 0x7f6c4c069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c50941700 1 -- 172.21.15.150:0/3071725613 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314546469 0 0) 0x7f6c4c13ab20 con 0x7f6c4c13a740 2023-08-17T17:34:08.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c50941700 1 -- 172.21.15.150:0/3071725613 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c380033f0 con 0x7f6c4c13a740 2023-08-17T17:34:08.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c50941700 1 -- 172.21.15.150:0/3071725613 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164786646 0 0) 0x7f6c4c069b00 con 0x7f6c4c1545e0 2023-08-17T17:34:08.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c50941700 1 -- 172.21.15.150:0/3071725613 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c4c13ab20 con 0x7f6c4c1545e0 2023-08-17T17:34:08.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c50941700 1 -- 172.21.15.150:0/3071725613 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3570162660 0 0) 0x7f6c380033f0 con 0x7f6c4c13a740 2023-08-17T17:34:08.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c51142700 1 -- 172.21.15.150:0/3071725613 >> v1:172.21.15.150:6789/0 conn(0x7f6c4c13a740 legacy=0x7f6c4c0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c51142700 1 -- 172.21.15.150:0/3071725613 >> v1:172.21.15.78:6789/0 conn(0x7f6c4c1545e0 legacy=0x7f6c4c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c51142700 1 -- 172.21.15.150:0/3071725613 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c155360 con 0x7f6c4c062c00 2023-08-17T17:34:08.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.165+0000 7f6c51142700 1 --2- 172.21.15.150:0/3071725613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c062c00 0x7f6c4c069f90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f6c480096e0 tx=0x7f6c48009060).ready entity=mon.0 client_cookie=d9fbf6d3f227455e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:08.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.166+0000 7f6c50941700 1 -- 172.21.15.150:0/3071725613 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c001470 con 0x7f6c4c062c00 2023-08-17T17:34:08.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.166+0000 7f6c50941700 1 -- 172.21.15.150:0/3071725613 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c48011400 con 0x7f6c4c062c00 2023-08-17T17:34:08.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.166+0000 7f6c50941700 1 -- 172.21.15.150:0/3071725613 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48011780 con 0x7f6c4c062c00 2023-08-17T17:34:08.171 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.166+0000 7f6c53ba7700 1 -- 172.21.15.150:0/3071725613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c062c00 msgr2=0x7f6c4c069f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.166+0000 7f6c53ba7700 1 --2- 172.21.15.150:0/3071725613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c062c00 0x7f6c4c069f90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f6c480096e0 tx=0x7f6c48009060).stop 2023-08-17T17:34:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.166+0000 7f6c53ba7700 1 -- 172.21.15.150:0/3071725613 shutdown_connections 2023-08-17T17:34:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.166+0000 7f6c53ba7700 1 --2- 172.21.15.150:0/3071725613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c062c00 0x7f6c4c069f90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.166+0000 7f6c53ba7700 1 -- 172.21.15.150:0/3071725613 >> 172.21.15.150:0/3071725613 conn(0x7f6c4c0c7b80 msgr2=0x7f6c4c0c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.166+0000 7f6c53ba7700 1 -- 172.21.15.150:0/3071725613 shutdown_connections 2023-08-17T17:34:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.166+0000 7f6c53ba7700 1 -- 172.21.15.150:0/3071725613 wait complete. 2023-08-17T17:34:08.172 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.167+0000 7f6c53ba7700 1 Processor -- start 2023-08-17T17:34:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.167+0000 7f6c53ba7700 1 -- start start 2023-08-17T17:34:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c53ba7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c062c00 0x7f6c4c0ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c53ba7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c13a740 0x7f6c4c139600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c53ba7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c4c1545e0 0x7f6c4c0bf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c53ba7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0bec20 con 0x7f6c4c13a740 2023-08-17T17:34:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c53ba7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c139af0 con 0x7f6c4c1545e0 2023-08-17T17:34:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c53ba7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0ad860 con 0x7f6c4c062c00 2023-08-17T17:34:08.173 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c51943700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c062c00 0x7f6c4c0ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.174 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c52144700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c4c1545e0 0x7f6c4c0bf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.174 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c51943700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c062c00 0x7f6c4c0ab670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:43096/0 (socket says 172.21.15.150:43096) 2023-08-17T17:34:08.174 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c52144700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c4c1545e0 0x7f6c4c0bf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59408/0 (socket says 172.21.15.150:59408) 2023-08-17T17:34:08.174 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c51943700 1 -- 172.21.15.150:0/512786839 learned_addr learned my addr 172.21.15.150:0/512786839 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:08.174 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.168+0000 7f6c51142700 1 --2- 172.21.15.150:0/512786839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c13a740 0x7f6c4c139600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.174 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c51142700 1 -- 172.21.15.150:0/512786839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c062c00 msgr2=0x7f6c4c0ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.174 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c51142700 1 --2- 172.21.15.150:0/512786839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c062c00 0x7f6c4c0ab670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c51142700 1 -- 172.21.15.150:0/512786839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c4c1545e0 msgr2=0x7f6c4c0bf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c51142700 1 --2- 172.21.15.150:0/512786839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c4c1545e0 0x7f6c4c0bf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c51142700 1 -- 172.21.15.150:0/512786839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c480092a0 con 0x7f6c4c13a740 2023-08-17T17:34:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c51943700 1 --2- 172.21.15.150:0/512786839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c062c00 0x7f6c4c0ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c52144700 1 --2- 172.21.15.150:0/512786839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c4c1545e0 0x7f6c4c0bf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c51142700 1 --2- 172.21.15.150:0/512786839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c13a740 0x7f6c4c139600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f6c48013000 tx=0x7f6c48016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c41ffb700 1 -- 172.21.15.150:0/512786839 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c480106c0 con 0x7f6c4c13a740 2023-08-17T17:34:08.175 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c41ffb700 1 -- 172.21.15.150:0/512786839 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c48010820 con 0x7f6c4c13a740 2023-08-17T17:34:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c53ba7700 1 -- 172.21.15.150:0/512786839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c0adb40 con 0x7f6c4c13a740 2023-08-17T17:34:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c41ffb700 1 -- 172.21.15.150:0/512786839 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48010ba0 con 0x7f6c4c13a740 2023-08-17T17:34:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c53ba7700 1 -- 172.21.15.150:0/512786839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c0bf1a0 con 0x7f6c4c13a740 2023-08-17T17:34:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c41ffb700 1 -- 172.21.15.150:0/512786839 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f6c4800f070 con 0x7f6c4c13a740 2023-08-17T17:34:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.169+0000 7f6c41ffb700 1 -- 172.21.15.150:0/512786839 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f6c4801d430 con 0x7f6c4c13a740 2023-08-17T17:34:08.176 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.170+0000 7f6c53ba7700 1 -- 172.21.15.150:0/512786839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c068270 con 0x7f6c4c13a740 2023-08-17T17:34:08.177 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.172+0000 7f6c41ffb700 1 -- 172.21.15.150:0/512786839 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f6c48016070 con 0x7f6c4c13a740 2023-08-17T17:34:08.253 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.252+0000 7f6c53ba7700 1 -- 172.21.15.150:0/512786839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a6a24c9a-ea70-4685-90bc-2f4c8c05e248", "id": 5} v 0) v1 -- 0x7f6c4c0bf390 con 0x7f6c4c13a740 2023-08-17T17:34:08.261 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.260+0000 7f6c41ffb700 1 -- 172.21.15.150:0/512786839 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6a24c9a-ea70-4685-90bc-2f4c8c05e248", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6c480278c0 con 0x7f6c4c13a740 2023-08-17T17:34:08.261 INFO:teuthology.orchestra.run.smithi150.stdout:5 2023-08-17T17:34:08.262 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.261+0000 7f6c53ba7700 1 -- 172.21.15.150:0/512786839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c13a740 msgr2=0x7f6c4c139600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.263 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.261+0000 7f6c53ba7700 1 --2- 172.21.15.150:0/512786839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c13a740 0x7f6c4c139600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f6c48013000 tx=0x7f6c48016000).stop 2023-08-17T17:34:08.263 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.261+0000 7f6c53ba7700 1 -- 172.21.15.150:0/512786839 shutdown_connections 2023-08-17T17:34:08.263 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.261+0000 7f6c53ba7700 1 --2- 172.21.15.150:0/512786839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c4c1545e0 0x7f6c4c0bf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.263 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.261+0000 7f6c53ba7700 1 --2- 172.21.15.150:0/512786839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c062c00 0x7f6c4c0ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.263 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.261+0000 7f6c53ba7700 1 --2- 172.21.15.150:0/512786839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c13a740 0x7f6c4c139600 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.263 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.261+0000 7f6c53ba7700 1 -- 172.21.15.150:0/512786839 >> 172.21.15.150:0/512786839 conn(0x7f6c4c0c7b80 msgr2=0x7f6c4c0624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:08.263 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.261+0000 7f6c53ba7700 1 -- 172.21.15.150:0/512786839 shutdown_connections 2023-08-17T17:34:08.264 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.261+0000 7f6c53ba7700 1 -- 172.21.15.150:0/512786839 wait complete. 2023-08-17T17:34:08.274 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 6c04079f-c4fe-4202-85a6-ca205083bdb6 6 2023-08-17T17:34:08.429 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.428+0000 7f7440db7700 1 Processor -- start 2023-08-17T17:34:08.430 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.428+0000 7f7440db7700 1 -- start start 2023-08-17T17:34:08.431 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.429+0000 7f7440db7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f743c13b890 0x7f743c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.431 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.429+0000 7f7440db7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f743c13bc70 0x7f743c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.431 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.429+0000 7f7440db7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c0a5a20 con 0x7f743c1566b0 2023-08-17T17:34:08.432 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.429+0000 7f7440db7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0c32d0 con 0x7f743c13b890 2023-08-17T17:34:08.432 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.429+0000 7f7440db7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0c3570 con 0x7f743c13bc70 2023-08-17T17:34:08.432 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f7439d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f743c13bc70 0x7f743c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.432 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f7439d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f743c13bc70 0x7f743c1561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59420/0 (socket says 172.21.15.150:59420) 2023-08-17T17:34:08.432 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f7439d9b700 1 -- 172.21.15.150:0/2926461116 learned_addr learned my addr 172.21.15.150:0/2926461116 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:08.432 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f743a59c700 1 --2- 172.21.15.150:0/2926461116 >> v2:172.21.15.78:3300/0 conn(0x7f743c13b890 0x7f743c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.432 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f7439d9b700 1 -- 172.21.15.150:0/2926461116 >> v2:172.21.15.78:3300/0 conn(0x7f743c13b890 msgr2=0x7f743c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f7439d9b700 1 --2- 172.21.15.150:0/2926461116 >> v2:172.21.15.78:3300/0 conn(0x7f743c13b890 0x7f743c155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f7439d9b700 1 -- 172.21.15.150:0/2926461116 >> v1:172.21.15.150:6789/0 conn(0x7f743c1566b0 legacy=0x7f743c0c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f7439d9b700 1 -- 172.21.15.150:0/2926461116 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0bfad0 con 0x7f743c13bc70 2023-08-17T17:34:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f7439d9b700 1 --2- 172.21.15.150:0/2926461116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 0x7f743c1561c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f743c0c8ca0 tx=0x7f742c0090f0).ready entity=mon.1 client_cookie=dccd155945386b59 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f743959a700 1 -- 172.21.15.150:0/2926461116 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00b520 con 0x7f743c13bc70 2023-08-17T17:34:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f743959a700 1 -- 172.21.15.150:0/2926461116 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c00b680 con 0x7f743c13bc70 2023-08-17T17:34:08.433 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.430+0000 7f743959a700 1 -- 172.21.15.150:0/2926461116 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00ba00 con 0x7f743c13bc70 2023-08-17T17:34:08.434 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:08.432+0000 7f257684a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:34:08.436 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.431+0000 7f7440db7700 1 -- 172.21.15.150:0/2926461116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 msgr2=0x7f743c1561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.436 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.431+0000 7f7440db7700 1 --2- 172.21.15.150:0/2926461116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 0x7f743c1561c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f743c0c8ca0 tx=0x7f742c0090f0).stop 2023-08-17T17:34:08.436 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.431+0000 7f7440db7700 1 -- 172.21.15.150:0/2926461116 shutdown_connections 2023-08-17T17:34:08.437 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.431+0000 7f7440db7700 1 --2- 172.21.15.150:0/2926461116 >> v2:172.21.15.78:3300/0 conn(0x7f743c13b890 0x7f743c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.437 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.431+0000 7f7440db7700 1 --2- 172.21.15.150:0/2926461116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 0x7f743c1561c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.437 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.431+0000 7f7440db7700 1 -- 172.21.15.150:0/2926461116 >> 172.21.15.150:0/2926461116 conn(0x7f743c062f80 msgr2=0x7f743c0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:08.437 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.431+0000 7f7440db7700 1 -- 172.21.15.150:0/2926461116 shutdown_connections 2023-08-17T17:34:08.437 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.431+0000 7f7440db7700 1 -- 172.21.15.150:0/2926461116 wait complete. 2023-08-17T17:34:08.437 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.432+0000 7f7440db7700 1 Processor -- start 2023-08-17T17:34:08.437 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.432+0000 7f7440db7700 1 -- start start 2023-08-17T17:34:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f7440db7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f743c13b890 0x7f743c164ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f7440db7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 0x7f743c095e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f7440db7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c1566b0 0x7f743c096300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f7440db7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0967f0 con 0x7f743c1566b0 2023-08-17T17:34:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f7440db7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0a87b0 con 0x7f743c13bc70 2023-08-17T17:34:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f7440db7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c1658f0 con 0x7f743c13b890 2023-08-17T17:34:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f743a59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f743c13b890 0x7f743c164ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.438 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f7439d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 0x7f743c095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.439 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f743a59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f743c13b890 0x7f743c164ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:43112/0 (socket says 172.21.15.150:43112) 2023-08-17T17:34:08.439 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f7439d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 0x7f743c095e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59422/0 (socket says 172.21.15.150:59422) 2023-08-17T17:34:08.439 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f743a59c700 1 -- 172.21.15.150:0/241241186 learned_addr learned my addr 172.21.15.150:0/241241186 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:08.439 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f743ad9d700 1 --2- 172.21.15.150:0/241241186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c1566b0 0x7f743c096300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.439 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f743a59c700 1 -- 172.21.15.150:0/241241186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 msgr2=0x7f743c095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.439 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f743a59c700 1 --2- 172.21.15.150:0/241241186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 0x7f743c095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.439 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f743a59c700 1 -- 172.21.15.150:0/241241186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c1566b0 msgr2=0x7f743c096300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.439 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f743a59c700 1 --2- 172.21.15.150:0/241241186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c1566b0 0x7f743c096300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.440 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f743a59c700 1 -- 172.21.15.150:0/241241186 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c009370 con 0x7f743c13b890 2023-08-17T17:34:08.440 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f7439d9b700 1 --2- 172.21.15.150:0/241241186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 0x7f743c095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:08.440 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f743a59c700 1 --2- 172.21.15.150:0/241241186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f743c13b890 0x7f743c164ea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f743000e980 tx=0x7f7430009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:08.440 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f742a7fc700 1 -- 172.21.15.150:0/241241186 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743000ee70 con 0x7f743c13b890 2023-08-17T17:34:08.440 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.433+0000 7f742a7fc700 1 -- 172.21.15.150:0/241241186 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743000c850 con 0x7f743c13b890 2023-08-17T17:34:08.440 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.434+0000 7f7440db7700 1 -- 172.21.15.150:0/241241186 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c165bd0 con 0x7f743c13b890 2023-08-17T17:34:08.440 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.434+0000 7f742a7fc700 1 -- 172.21.15.150:0/241241186 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743000cbd0 con 0x7f743c13b890 2023-08-17T17:34:08.441 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.434+0000 7f7440db7700 1 -- 172.21.15.150:0/241241186 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c063a60 con 0x7f743c13b890 2023-08-17T17:34:08.441 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.434+0000 7f742a7fc700 1 -- 172.21.15.150:0/241241186 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f7430022070 con 0x7f743c13b890 2023-08-17T17:34:08.441 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.434+0000 7f742a7fc700 1 -- 172.21.15.150:0/241241186 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f7430012a10 con 0x7f743c13b890 2023-08-17T17:34:08.441 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.434+0000 7f7440db7700 1 -- 172.21.15.150:0/241241186 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c165e10 con 0x7f743c13b890 2023-08-17T17:34:08.441 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.437+0000 7f742a7fc700 1 -- 172.21.15.150:0/241241186 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f743003ae50 con 0x7f743c13b890 2023-08-17T17:34:08.517 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.516+0000 7f7440db7700 1 -- 172.21.15.150:0/241241186 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6c04079f-c4fe-4202-85a6-ca205083bdb6", "id": 6} v 0) v1 -- 0x7f743c063c50 con 0x7f743c13b890 2023-08-17T17:34:08.525 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.524+0000 7f742a7fc700 1 -- 172.21.15.150:0/241241186 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6c04079f-c4fe-4202-85a6-ca205083bdb6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7430029030 con 0x7f743c13b890 2023-08-17T17:34:08.525 INFO:teuthology.orchestra.run.smithi150.stdout:6 2023-08-17T17:34:08.526 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.525+0000 7f7440db7700 1 -- 172.21.15.150:0/241241186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f743c13b890 msgr2=0x7f743c164ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.525+0000 7f7440db7700 1 --2- 172.21.15.150:0/241241186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f743c13b890 0x7f743c164ea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f743000e980 tx=0x7f7430009060).stop 2023-08-17T17:34:08.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.525+0000 7f7440db7700 1 -- 172.21.15.150:0/241241186 shutdown_connections 2023-08-17T17:34:08.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.525+0000 7f7440db7700 1 --2- 172.21.15.150:0/241241186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c1566b0 0x7f743c096300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.525+0000 7f7440db7700 1 --2- 172.21.15.150:0/241241186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f743c13b890 0x7f743c164ea0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.525+0000 7f7440db7700 1 --2- 172.21.15.150:0/241241186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c13bc70 0x7f743c095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.525+0000 7f7440db7700 1 -- 172.21.15.150:0/241241186 >> 172.21.15.150:0/241241186 conn(0x7f743c062f80 msgr2=0x7f743c0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:08.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.525+0000 7f7440db7700 1 -- 172.21.15.150:0/241241186 shutdown_connections 2023-08-17T17:34:08.528 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.525+0000 7f7440db7700 1 -- 172.21.15.150:0/241241186 wait complete. 2023-08-17T17:34:08.536 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:08.535+0000 7f257684a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:34:08.538 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 2718c194-480c-47c9-8b27-4880105bce34 7 2023-08-17T17:34:08.551 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:08.550+0000 7f1ff58aa680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:34:08.652 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.651+0000 7f9d881da700 1 Processor -- start 2023-08-17T17:34:08.652 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.651+0000 7f9d881da700 1 -- start start 2023-08-17T17:34:08.653 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d881da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d80154440 0x7f9d800a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.653 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d881da700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d800c9d80 con 0x7f9d800bfea0 2023-08-17T17:34:08.654 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d881da700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d800c9170 con 0x7f9d800ca920 2023-08-17T17:34:08.654 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d881da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800c9450 con 0x7f9d80154440 2023-08-17T17:34:08.654 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d85f76700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d80154440 0x7f9d800a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.654 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d86777700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9d800ca920 0x7f9d800c6f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:34062/0 (socket says 172.21.15.150:34062) 2023-08-17T17:34:08.654 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d86777700 1 -- 172.21.15.150:0/2744815782 learned_addr learned my addr 172.21.15.150:0/2744815782 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-08-17T17:34:08.654 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d84f74700 1 -- 172.21.15.150:0/2744815782 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502331846 0 0) 0x7f9d800c9170 con 0x7f9d800ca920 2023-08-17T17:34:08.654 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d84f74700 1 -- 172.21.15.150:0/2744815782 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d6c0033f0 con 0x7f9d800ca920 2023-08-17T17:34:08.655 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d85f76700 1 -- 172.21.15.150:0/2744815782 >> v1:172.21.15.150:6789/0 conn(0x7f9d800ca920 legacy=0x7f9d800c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.655 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d85f76700 1 -- 172.21.15.150:0/2744815782 >> v1:172.21.15.78:6789/0 conn(0x7f9d800bfea0 legacy=0x7f9d800ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.655 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d85f76700 1 -- 172.21.15.150:0/2744815782 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800c9730 con 0x7f9d80154440 2023-08-17T17:34:08.655 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d85f76700 1 --2- 172.21.15.150:0/2744815782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d80154440 0x7f9d800a7d70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9d70009790 tx=0x7f9d70009060).ready entity=mon.2 client_cookie=43218cdc12c8970d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:08.655 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d84f74700 1 -- 172.21.15.150:0/2744815782 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000f510 con 0x7f9d80154440 2023-08-17T17:34:08.655 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d84f74700 1 -- 172.21.15.150:0/2744815782 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7000f670 con 0x7f9d80154440 2023-08-17T17:34:08.655 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.652+0000 7f9d84f74700 1 -- 172.21.15.150:0/2744815782 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000f9f0 con 0x7f9d80154440 2023-08-17T17:34:08.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.653+0000 7f9d881da700 1 -- 172.21.15.150:0/2744815782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d80154440 msgr2=0x7f9d800a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.653+0000 7f9d881da700 1 --2- 172.21.15.150:0/2744815782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d80154440 0x7f9d800a7d70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9d70009790 tx=0x7f9d70009060).stop 2023-08-17T17:34:08.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.653+0000 7f9d881da700 1 -- 172.21.15.150:0/2744815782 shutdown_connections 2023-08-17T17:34:08.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.653+0000 7f9d881da700 1 --2- 172.21.15.150:0/2744815782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d80154440 0x7f9d800a7d70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.653+0000 7f9d881da700 1 -- 172.21.15.150:0/2744815782 >> 172.21.15.150:0/2744815782 conn(0x7f9d8006a400 msgr2=0x7f9d800caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:08.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.653+0000 7f9d881da700 1 -- 172.21.15.150:0/2744815782 shutdown_connections 2023-08-17T17:34:08.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.653+0000 7f9d881da700 1 -- 172.21.15.150:0/2744815782 wait complete. 2023-08-17T17:34:08.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.654+0000 7f9d881da700 1 Processor -- start 2023-08-17T17:34:08.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.654+0000 7f9d881da700 1 -- start start 2023-08-17T17:34:08.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d881da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d800bfea0 0x7f9d800b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d881da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d800ca920 0x7f9d80097610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d881da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d80154440 0x7f9d80097b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d881da700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80164620 con 0x7f9d80154440 2023-08-17T17:34:08.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d881da700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80097ff0 con 0x7f9d800bfea0 2023-08-17T17:34:08.660 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d881da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80164e60 con 0x7f9d800ca920 2023-08-17T17:34:08.660 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85f76700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d800bfea0 0x7f9d800b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.660 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85775700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d800ca920 0x7f9d80097610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.660 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85f76700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d800bfea0 0x7f9d800b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36918/0 (socket says 172.21.15.150:36918) 2023-08-17T17:34:08.660 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85775700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d800ca920 0x7f9d80097610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:54672/0 (socket says 172.21.15.150:54672) 2023-08-17T17:34:08.660 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85f76700 1 -- 172.21.15.150:0/2270547600 learned_addr learned my addr 172.21.15.150:0/2270547600 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:08.660 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d86777700 1 --2- 172.21.15.150:0/2270547600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d80154440 0x7f9d80097b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85f76700 1 -- 172.21.15.150:0/2270547600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d800ca920 msgr2=0x7f9d80097610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85f76700 1 --2- 172.21.15.150:0/2270547600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d800ca920 0x7f9d80097610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85f76700 1 -- 172.21.15.150:0/2270547600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d80154440 msgr2=0x7f9d80097b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85f76700 1 --2- 172.21.15.150:0/2270547600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d80154440 0x7f9d80097b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85f76700 1 -- 172.21.15.150:0/2270547600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700092a0 con 0x7f9d800bfea0 2023-08-17T17:34:08.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.655+0000 7f9d85775700 1 --2- 172.21.15.150:0/2270547600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d800ca920 0x7f9d80097610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:08.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.656+0000 7f9d85f76700 1 --2- 172.21.15.150:0/2270547600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d800bfea0 0x7f9d800b0490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9d70009e30 tx=0x7f9d70017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:08.661 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.656+0000 7f9d75ffb700 1 -- 172.21.15.150:0/2270547600 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70000bc0 con 0x7f9d800bfea0 2023-08-17T17:34:08.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.656+0000 7f9d75ffb700 1 -- 172.21.15.150:0/2270547600 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7000f7e0 con 0x7f9d800bfea0 2023-08-17T17:34:08.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.656+0000 7f9d881da700 1 -- 172.21.15.150:0/2270547600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d80168920 con 0x7f9d800bfea0 2023-08-17T17:34:08.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.656+0000 7f9d75ffb700 1 -- 172.21.15.150:0/2270547600 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70000d20 con 0x7f9d800bfea0 2023-08-17T17:34:08.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.656+0000 7f9d881da700 1 -- 172.21.15.150:0/2270547600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d80164af0 con 0x7f9d800bfea0 2023-08-17T17:34:08.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.656+0000 7f9d75ffb700 1 -- 172.21.15.150:0/2270547600 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f9d7000f070 con 0x7f9d800bfea0 2023-08-17T17:34:08.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.656+0000 7f9d75ffb700 1 -- 172.21.15.150:0/2270547600 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f9d70023a90 con 0x7f9d800bfea0 2023-08-17T17:34:08.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.657+0000 7f9d881da700 1 -- 172.21.15.150:0/2270547600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d80065620 con 0x7f9d800bfea0 2023-08-17T17:34:08.663 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:08.658+0000 7f1ff58aa680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:34:08.663 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.659+0000 7f9d75ffb700 1 -- 172.21.15.150:0/2270547600 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9d70023d70 con 0x7f9d800bfea0 2023-08-17T17:34:08.687 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:08.685+0000 7f257684a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:34:08.741 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.740+0000 7f9d881da700 1 -- 172.21.15.150:0/2270547600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2718c194-480c-47c9-8b27-4880105bce34", "id": 7} v 0) v1 -- 0x7f9d80065140 con 0x7f9d800bfea0 2023-08-17T17:34:08.749 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.748+0000 7f9d75ffb700 1 -- 172.21.15.150:0/2270547600 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2718c194-480c-47c9-8b27-4880105bce34", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9d7001bc80 con 0x7f9d800bfea0 2023-08-17T17:34:08.749 INFO:teuthology.orchestra.run.smithi150.stdout:7 2023-08-17T17:34:08.750 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.749+0000 7f9d881da700 1 -- 172.21.15.150:0/2270547600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d800bfea0 msgr2=0x7f9d800b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.749+0000 7f9d881da700 1 --2- 172.21.15.150:0/2270547600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d800bfea0 0x7f9d800b0490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9d70009e30 tx=0x7f9d70017000).stop 2023-08-17T17:34:08.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.749+0000 7f9d881da700 1 -- 172.21.15.150:0/2270547600 shutdown_connections 2023-08-17T17:34:08.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.749+0000 7f9d881da700 1 --2- 172.21.15.150:0/2270547600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d80154440 0x7f9d80097b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.749+0000 7f9d881da700 1 --2- 172.21.15.150:0/2270547600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d800bfea0 0x7f9d800b0490 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.749+0000 7f9d881da700 1 --2- 172.21.15.150:0/2270547600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d800ca920 0x7f9d80097610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.749+0000 7f9d881da700 1 -- 172.21.15.150:0/2270547600 >> 172.21.15.150:0/2270547600 conn(0x7f9d8006a400 msgr2=0x7f9d800c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:08.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.749+0000 7f9d881da700 1 -- 172.21.15.150:0/2270547600 shutdown_connections 2023-08-17T17:34:08.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:08.749+0000 7f9d881da700 1 -- 172.21.15.150:0/2270547600 wait complete. 2023-08-17T17:34:08.763 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-17T17:34:08.763 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-17T17:34:08.765 INFO:tasks.ceph.osd.0:Started 2023-08-17T17:34:08.766 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-17T17:34:08.766 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-17T17:34:08.766 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:08.763+0000 7f257684a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:34:08.768 INFO:tasks.ceph.osd.1:Started 2023-08-17T17:34:08.768 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-17T17:34:08.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-17T17:34:08.770 INFO:tasks.ceph.osd.2:Started 2023-08-17T17:34:08.770 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-17T17:34:08.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-17T17:34:08.772 INFO:tasks.ceph.osd.3:Started 2023-08-17T17:34:08.773 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-17T17:34:08.773 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-17T17:34:08.805 INFO:tasks.ceph.osd.4:Started 2023-08-17T17:34:08.805 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-17T17:34:08.805 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-17T17:34:08.807 INFO:tasks.ceph.osd.5:Started 2023-08-17T17:34:08.807 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-17T17:34:08.808 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-17T17:34:08.809 INFO:tasks.ceph.osd.6:Started 2023-08-17T17:34:08.810 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-17T17:34:08.810 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-17T17:34:08.812 INFO:tasks.ceph.osd.7:Started 2023-08-17T17:34:08.812 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:08.822 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:08.821+0000 7f1ff58aa680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:34:08.852 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:08.851+0000 7f257684a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:34:08.930 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:08.929+0000 7f1ff58aa680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:34:08.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.945+0000 7fa3b30e9700 1 Processor -- start 2023-08-17T17:34:08.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.945+0000 7fa3b30e9700 1 -- start start 2023-08-17T17:34:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3b30e9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac13a640 0x7fa3ac154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3b30e9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa3ac069760 0x7fa3ac0c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3b30e9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac0c2c10 con 0x7fa3ac06a2c0 2023-08-17T17:34:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3b30e9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac155010 con 0x7fa3ac069760 2023-08-17T17:34:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3b30e9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac1552e0 con 0x7fa3ac13a640 2023-08-17T17:34:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3abfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa3ac06a2c0 0x7fa3ac069050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56200/0 (socket says 172.21.15.78:56200) 2023-08-17T17:34:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3abfff700 1 -- 172.21.15.78:0/4197388267 learned_addr learned my addr 172.21.15.78:0/4197388267 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:08.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3b0e85700 1 --2- 172.21.15.78:0/4197388267 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac13a640 0x7fa3ac154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3b1686700 1 --2- 172.21.15.78:0/4197388267 >> v2:172.21.15.150:3300/0 conn(0x7fa3ac069760 0x7fa3ac0c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3ab7fe700 1 -- 172.21.15.78:0/4197388267 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844726539 0 0) 0x7fa3ac0c2c10 con 0x7fa3ac06a2c0 2023-08-17T17:34:08.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.946+0000 7fa3ab7fe700 1 -- 172.21.15.78:0/4197388267 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa39c0033f0 con 0x7fa3ac06a2c0 2023-08-17T17:34:08.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.947+0000 7fa3b0e85700 1 -- 172.21.15.78:0/4197388267 >> v2:172.21.15.150:3300/0 conn(0x7fa3ac069760 msgr2=0x7fa3ac0c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:08.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.947+0000 7fa3b0e85700 1 --2- 172.21.15.78:0/4197388267 >> v2:172.21.15.150:3300/0 conn(0x7fa3ac069760 0x7fa3ac0c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.947+0000 7fa3b0e85700 1 -- 172.21.15.78:0/4197388267 >> v1:172.21.15.78:6789/0 conn(0x7fa3ac06a2c0 legacy=0x7fa3ac069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.947+0000 7fa3b0e85700 1 -- 172.21.15.78:0/4197388267 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac1555c0 con 0x7fa3ac13a640 2023-08-17T17:34:08.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.947+0000 7fa3b1686700 1 --2- 172.21.15.78:0/4197388267 >> v2:172.21.15.150:3300/0 conn(0x7fa3ac069760 0x7fa3ac0c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:08.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.947+0000 7fa3b0e85700 1 --2- 172.21.15.78:0/4197388267 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac13a640 0x7fa3ac154b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fa3a0009760 tx=0x7fa3a0009060).ready entity=mon.2 client_cookie=f75e11912432586f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:08.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.947+0000 7fa3ab7fe700 1 -- 172.21.15.78:0/4197388267 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000d4a0 con 0x7fa3ac13a640 2023-08-17T17:34:08.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.947+0000 7fa3ab7fe700 1 -- 172.21.15.78:0/4197388267 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a000d600 con 0x7fa3ac13a640 2023-08-17T17:34:08.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.947+0000 7fa3ab7fe700 1 -- 172.21.15.78:0/4197388267 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000d980 con 0x7fa3ac13a640 2023-08-17T17:34:08.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.948+0000 7fa3b30e9700 1 -- 172.21.15.78:0/4197388267 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac13a640 msgr2=0x7fa3ac154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.948+0000 7fa3b30e9700 1 --2- 172.21.15.78:0/4197388267 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac13a640 0x7fa3ac154b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fa3a0009760 tx=0x7fa3a0009060).stop 2023-08-17T17:34:08.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.948+0000 7fa3b30e9700 1 -- 172.21.15.78:0/4197388267 shutdown_connections 2023-08-17T17:34:08.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.948+0000 7fa3b30e9700 1 --2- 172.21.15.78:0/4197388267 >> v2:172.21.15.150:3300/0 conn(0x7fa3ac069760 0x7fa3ac0c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.948+0000 7fa3b30e9700 1 --2- 172.21.15.78:0/4197388267 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac13a640 0x7fa3ac154b20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.948+0000 7fa3b30e9700 1 -- 172.21.15.78:0/4197388267 >> 172.21.15.78:0/4197388267 conn(0x7fa3ac0c7b00 msgr2=0x7fa3ac0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:08.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.948+0000 7fa3b30e9700 1 -- 172.21.15.78:0/4197388267 shutdown_connections 2023-08-17T17:34:08.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.948+0000 7fa3b30e9700 1 -- 172.21.15.78:0/4197388267 wait complete. 2023-08-17T17:34:08.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.950+0000 7fa3b30e9700 1 Processor -- start 2023-08-17T17:34:08.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.950+0000 7fa3b30e9700 1 -- start start 2023-08-17T17:34:08.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3b30e9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3ac069760 0x7fa3ac0ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3b30e9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac06a2c0 0x7fa3ac1611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3b30e9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac13a640 0x7fa3ac0c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:08.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3b30e9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac1625a0 con 0x7fa3ac13a640 2023-08-17T17:34:08.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3b30e9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac136a60 con 0x7fa3ac069760 2023-08-17T17:34:08.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3b30e9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac1616b0 con 0x7fa3ac06a2c0 2023-08-17T17:34:08.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3b1686700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac13a640 0x7fa3ac0c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3b1686700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac13a640 0x7fa3ac0c1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43496/0 (socket says 172.21.15.78:43496) 2023-08-17T17:34:08.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3b1686700 1 -- 172.21.15.78:0/1282844870 learned_addr learned my addr 172.21.15.78:0/1282844870 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:08.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3b0e85700 1 --2- 172.21.15.78:0/1282844870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3ac069760 0x7fa3ac0ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.951+0000 7fa3abfff700 1 --2- 172.21.15.78:0/1282844870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac06a2c0 0x7fa3ac1611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:08.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3b0e85700 1 -- 172.21.15.78:0/1282844870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac06a2c0 msgr2=0x7fa3ac1611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3b0e85700 1 --2- 172.21.15.78:0/1282844870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac06a2c0 0x7fa3ac1611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3b0e85700 1 -- 172.21.15.78:0/1282844870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac13a640 msgr2=0x7fa3ac0c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:08.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3b0e85700 1 --2- 172.21.15.78:0/1282844870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac13a640 0x7fa3ac0c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:08.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3b0e85700 1 -- 172.21.15.78:0/1282844870 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4009a20 con 0x7fa3ac069760 2023-08-17T17:34:08.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3b0e85700 1 --2- 172.21.15.78:0/1282844870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3ac069760 0x7fa3ac0ad470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa3a0013000 tx=0x7fa3a0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:08.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3a8ff9700 1 -- 172.21.15.78:0/1282844870 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0009d80 con 0x7fa3ac069760 2023-08-17T17:34:08.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3a8ff9700 1 -- 172.21.15.78:0/1282844870 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a000dd40 con 0x7fa3ac069760 2023-08-17T17:34:08.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3b30e9700 1 -- 172.21.15.78:0/1282844870 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a00092a0 con 0x7fa3ac069760 2023-08-17T17:34:08.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3a8ff9700 1 -- 172.21.15.78:0/1282844870 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000d980 con 0x7fa3ac069760 2023-08-17T17:34:08.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3b30e9700 1 -- 172.21.15.78:0/1282844870 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac0c1960 con 0x7fa3ac069760 2023-08-17T17:34:08.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3a8ff9700 1 -- 172.21.15.78:0/1282844870 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fa3a000f070 con 0x7fa3ac069760 2023-08-17T17:34:08.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.952+0000 7fa3a8ff9700 1 -- 172.21.15.78:0/1282844870 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fa3a001d640 con 0x7fa3ac069760 2023-08-17T17:34:08.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.953+0000 7fa3b30e9700 1 -- 172.21.15.78:0/1282844870 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac047350 con 0x7fa3ac069760 2023-08-17T17:34:08.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:08.955+0000 7fa3a8ff9700 1 -- 172.21.15.78:0/1282844870 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa3a0016070 con 0x7fa3ac069760 2023-08-17T17:34:09.002 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:09.001+0000 7f1ff58aa680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:34:09.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.021+0000 7fa3b30e9700 1 -- 172.21.15.78:0/1282844870 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3ac162010 con 0x7fa3ac069760 2023-08-17T17:34:09.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.022+0000 7fa3a8ff9700 1 -- 172.21.15.78:0/1282844870 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7fa3ac162010 con 0x7fa3ac069760 2023-08-17T17:34:09.024 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:09.024 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:08.741737+0000","last_up_change":"0.000000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:09.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.023+0000 7fa3b30e9700 1 -- 172.21.15.78:0/1282844870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3ac069760 msgr2=0x7fa3ac0ad470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:09.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.023+0000 7fa3b30e9700 1 --2- 172.21.15.78:0/1282844870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3ac069760 0x7fa3ac0ad470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa3a0013000 tx=0x7fa3a0016000).stop 2023-08-17T17:34:09.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.023+0000 7fa3b30e9700 1 -- 172.21.15.78:0/1282844870 shutdown_connections 2023-08-17T17:34:09.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.023+0000 7fa3b30e9700 1 --2- 172.21.15.78:0/1282844870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac13a640 0x7fa3ac0c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:09.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.023+0000 7fa3b30e9700 1 --2- 172.21.15.78:0/1282844870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3ac069760 0x7fa3ac0ad470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:09.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.023+0000 7fa3b30e9700 1 --2- 172.21.15.78:0/1282844870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3ac06a2c0 0x7fa3ac1611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:09.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.023+0000 7fa3b30e9700 1 -- 172.21.15.78:0/1282844870 >> 172.21.15.78:0/1282844870 conn(0x7fa3ac0c7b00 msgr2=0x7fa3ac137520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:09.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.023+0000 7fa3b30e9700 1 -- 172.21.15.78:0/1282844870 shutdown_connections 2023-08-17T17:34:09.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:09.023+0000 7fa3b30e9700 1 -- 172.21.15.78:0/1282844870 wait complete. 2023-08-17T17:34:09.036 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-17T17:34:09.036 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-17T17:34:09.132 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:09.131+0000 7f257684a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:34:09.271 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:09.270+0000 7f1ff58aa680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:34:09.329 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:09.328+0000 7f257684a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:34:09.366 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-08-17T17:34:09.364+0000 7f1507f51200 -1 Falling back to public interface 2023-08-17T17:34:09.379 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-08-17T17:34:09.377+0000 7fed17956200 -1 Falling back to public interface 2023-08-17T17:34:09.397 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-08-17T17:34:09.395+0000 7f8730be1200 -1 Falling back to public interface 2023-08-17T17:34:09.401 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-08-17T17:34:09.400+0000 7f361aaea200 -1 Falling back to public interface 2023-08-17T17:34:09.403 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-08-17T17:34:09.401+0000 7f707e76a200 -1 Falling back to public interface 2023-08-17T17:34:09.403 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-08-17T17:34:09.402+0000 7fcc0c255200 -1 Falling back to public interface 2023-08-17T17:34:09.408 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-08-17T17:34:09.408+0000 7f377ca52200 -1 Falling back to public interface 2023-08-17T17:34:09.419 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-08-17T17:34:09.419+0000 7f7b74c78200 -1 Falling back to public interface 2023-08-17T17:34:09.473 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:09.472+0000 7f1ff58aa680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:34:09.842 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:09.951 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.949+0000 7f4b4281b700 1 Processor -- start 2023-08-17T17:34:09.951 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.949+0000 7f4b4281b700 1 -- start start 2023-08-17T17:34:09.953 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.950+0000 7f4b4281b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 0x7f4b3c154450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:09.953 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.950+0000 7f4b4281b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3c0a9320 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.953 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.950+0000 7f4b4281b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3c0a87c0 con 0x7f4b3c0aa730 2023-08-17T17:34:09.953 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.950+0000 7f4b4281b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0a8a30 con 0x7f4b3c154070 2023-08-17T17:34:09.953 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.950+0000 7f4b3b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4b3c0a97b0 0x7f4b3c0aa020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56206/0 (socket says 172.21.15.78:56206) 2023-08-17T17:34:09.954 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.950+0000 7f4b3b7fe700 1 -- 172.21.15.78:0/34800921 learned_addr learned my addr 172.21.15.78:0/34800921 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:09.954 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.950+0000 7f4b3bfff700 1 --2- 172.21.15.78:0/34800921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 0x7f4b3c154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:09.954 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3affd700 1 -- 172.21.15.78:0/34800921 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677491793 0 0) 0x7f4b3c0a9320 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.954 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3affd700 1 -- 172.21.15.78:0/34800921 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b240033f0 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.954 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3affd700 1 -- 172.21.15.78:0/34800921 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755585389 0 0) 0x7f4b3c0a87c0 con 0x7f4b3c0aa730 2023-08-17T17:34:09.954 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3affd700 1 -- 172.21.15.78:0/34800921 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b3c0a9320 con 0x7f4b3c0aa730 2023-08-17T17:34:09.954 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3bfff700 1 -- 172.21.15.78:0/34800921 >> v1:172.21.15.150:6789/0 conn(0x7f4b3c0aa730 legacy=0x7f4b3c0c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:09.955 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3bfff700 1 -- 172.21.15.78:0/34800921 >> v1:172.21.15.78:6789/0 conn(0x7f4b3c0a97b0 legacy=0x7f4b3c0aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:09.955 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3bfff700 1 -- 172.21.15.78:0/34800921 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c0a8cd0 con 0x7f4b3c154070 2023-08-17T17:34:09.955 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3bfff700 1 --2- 172.21.15.78:0/34800921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 0x7f4b3c154450 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f4b300097c0 tx=0x7f4b30009060).ready entity=mon.2 client_cookie=f0de853bfe84008d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:09.955 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3affd700 1 -- 172.21.15.78:0/34800921 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000d4a0 con 0x7f4b3c154070 2023-08-17T17:34:09.955 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3affd700 1 -- 172.21.15.78:0/34800921 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3000d600 con 0x7f4b3c154070 2023-08-17T17:34:09.955 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.951+0000 7f4b3affd700 1 -- 172.21.15.78:0/34800921 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000d980 con 0x7f4b3c154070 2023-08-17T17:34:09.957 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.952+0000 7f4b4281b700 1 -- 172.21.15.78:0/34800921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 msgr2=0x7f4b3c154450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:09.957 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.952+0000 7f4b4281b700 1 --2- 172.21.15.78:0/34800921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 0x7f4b3c154450 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f4b300097c0 tx=0x7f4b30009060).stop 2023-08-17T17:34:09.958 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.952+0000 7f4b4281b700 1 -- 172.21.15.78:0/34800921 shutdown_connections 2023-08-17T17:34:09.958 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.952+0000 7f4b4281b700 1 --2- 172.21.15.78:0/34800921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 0x7f4b3c154450 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:09.958 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.952+0000 7f4b4281b700 1 -- 172.21.15.78:0/34800921 >> 172.21.15.78:0/34800921 conn(0x7f4b3c094730 msgr2=0x7f4b3c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:09.958 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.952+0000 7f4b4281b700 1 -- 172.21.15.78:0/34800921 shutdown_connections 2023-08-17T17:34:09.958 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.952+0000 7f4b4281b700 1 -- 172.21.15.78:0/34800921 wait complete. 2023-08-17T17:34:09.958 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.953+0000 7f4b4281b700 1 Processor -- start 2023-08-17T17:34:09.958 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.953+0000 7f4b4281b700 1 -- start start 2023-08-17T17:34:09.959 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b4281b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b3c0a97b0 0x7f4b3c0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:09.959 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b4281b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b3c0aa730 0x7f4b3c0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:09.959 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b4281b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 0x7f4b3c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:09.959 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b4281b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0c7c10 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.959 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b4281b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0aaef0 con 0x7f4b3c0aa730 2023-08-17T17:34:09.959 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b4281b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0ab1d0 con 0x7f4b3c154070 2023-08-17T17:34:09.959 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b3bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b3c0a97b0 0x7f4b3c0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:09.959 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b3bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b3c0a97b0 0x7f4b3c0abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43500/0 (socket says 172.21.15.78:43500) 2023-08-17T17:34:09.960 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b3bfff700 1 -- 172.21.15.78:0/793030446 learned_addr learned my addr 172.21.15.78:0/793030446 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:09.960 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b3b7fe700 1 --2- 172.21.15.78:0/793030446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b3c0aa730 0x7f4b3c0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:09.960 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b40db8700 1 --2- 172.21.15.78:0/793030446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 0x7f4b3c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:09.960 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b3bfff700 1 -- 172.21.15.78:0/793030446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 msgr2=0x7f4b3c1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:09.960 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b3bfff700 1 --2- 172.21.15.78:0/793030446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 0x7f4b3c1555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:09.960 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b3bfff700 1 -- 172.21.15.78:0/793030446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b3c0aa730 msgr2=0x7f4b3c0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:09.960 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b3bfff700 1 --2- 172.21.15.78:0/793030446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b3c0aa730 0x7f4b3c0c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:09.961 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b3bfff700 1 -- 172.21.15.78:0/793030446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300092a0 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.961 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b3bfff700 1 --2- 172.21.15.78:0/793030446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b3c0a97b0 0x7f4b3c0abf90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4b30009db0 tx=0x7f4b30016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:09.961 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b23fff700 1 -- 172.21.15.78:0/793030446 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000dcf0 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.961 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.954+0000 7f4b23fff700 1 -- 172.21.15.78:0/793030446 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3000de50 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.961 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.955+0000 7f4b23fff700 1 -- 172.21.15.78:0/793030446 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3001d430 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.961 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.955+0000 7f4b4281b700 1 -- 172.21.15.78:0/793030446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3c0ab4b0 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.961 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.955+0000 7f4b4281b700 1 -- 172.21.15.78:0/793030446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3c0aba70 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.961 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.956+0000 7f4b23fff700 1 -- 172.21.15.78:0/793030446 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f4b3000f070 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.962 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.956+0000 7f4b23fff700 1 -- 172.21.15.78:0/793030446 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f4b30027b60 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.962 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.956+0000 7f4b4281b700 1 -- 172.21.15.78:0/793030446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3c047350 con 0x7f4b3c0a97b0 2023-08-17T17:34:09.962 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:09.958+0000 7f4b23fff700 1 -- 172.21.15.78:0/793030446 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f4b30016070 con 0x7f4b3c0a97b0 2023-08-17T17:34:10.004 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:10.003+0000 7f257684a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:34:10.027 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.025+0000 7f4b4281b700 1 -- 172.21.15.78:0/793030446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b3c0a8fb0 con 0x7f4b3c0a97b0 2023-08-17T17:34:10.027 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.026+0000 7f4b23fff700 1 -- 172.21.15.78:0/793030446 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f4b30027e40 con 0x7f4b3c0a97b0 2023-08-17T17:34:10.028 INFO:teuthology.misc.health.smithi078.stdout: 2023-08-17T17:34:10.028 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:08.741737+0000","last_up_change":"0.000000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:10.029 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.027+0000 7f4b4281b700 1 -- 172.21.15.78:0/793030446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b3c0a97b0 msgr2=0x7f4b3c0abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:10.029 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.027+0000 7f4b4281b700 1 --2- 172.21.15.78:0/793030446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b3c0a97b0 0x7f4b3c0abf90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4b30009db0 tx=0x7f4b30016000).stop 2023-08-17T17:34:10.029 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.027+0000 7f4b4281b700 1 -- 172.21.15.78:0/793030446 shutdown_connections 2023-08-17T17:34:10.029 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.027+0000 7f4b4281b700 1 --2- 172.21.15.78:0/793030446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3c154070 0x7f4b3c1555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:10.029 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.027+0000 7f4b4281b700 1 --2- 172.21.15.78:0/793030446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b3c0a97b0 0x7f4b3c0abf90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:10.030 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.027+0000 7f4b4281b700 1 --2- 172.21.15.78:0/793030446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b3c0aa730 0x7f4b3c0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:10.030 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.027+0000 7f4b4281b700 1 -- 172.21.15.78:0/793030446 >> 172.21.15.78:0/793030446 conn(0x7f4b3c094730 msgr2=0x7f4b3c0c0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:10.030 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.027+0000 7f4b4281b700 1 -- 172.21.15.78:0/793030446 shutdown_connections 2023-08-17T17:34:10.030 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:10.027+0000 7f4b4281b700 1 -- 172.21.15.78:0/793030446 wait complete. 2023-08-17T17:34:10.039 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-17T17:34:10.077 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:10.075+0000 7f257684a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:34:10.143 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:10.142+0000 7f1ff58aa680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:34:10.155 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:10.154+0000 7f257684a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:34:10.212 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:10.211+0000 7f1ff58aa680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:34:10.293 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:10.292+0000 7f1ff58aa680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:34:10.305 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:10.303+0000 7f257684a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:34:10.377 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:10.375+0000 7f257684a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:34:10.440 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:10.439+0000 7f1ff58aa680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:34:10.494 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:10.492+0000 7f257684a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:34:10.511 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:10.510+0000 7f1ff58aa680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:34:10.601 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:10.600+0000 7f257684a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:34:10.629 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:10.629+0000 7f1ff58aa680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:34:10.740 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:10.735+0000 7f1ff58aa680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:34:10.919 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:10.918+0000 7f257684a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:34:10.990 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:10.988+0000 7f257684a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:34:11.066 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:11.065+0000 7f1ff58aa680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:34:11.139 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:34:11.138+0000 7f1ff58aa680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:34:12.012 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:12.010+0000 7f252ca92700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-17T17:34:12.012 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:34:12.010+0000 7f252ca92700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-17T17:34:12.844 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-08-17T17:34:12.843+0000 7f1507f51200 -1 osd.0 0 log_to_monitors {default=true} 2023-08-17T17:34:12.882 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-08-17T17:34:12.881+0000 7f361aaea200 -1 osd.6 0 log_to_monitors {default=true} 2023-08-17T17:34:12.901 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-08-17T17:34:12.900+0000 7f707e76a200 -1 osd.3 0 log_to_monitors {default=true} 2023-08-17T17:34:12.902 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-08-17T17:34:12.901+0000 7fed17956200 -1 osd.2 0 log_to_monitors {default=true} 2023-08-17T17:34:12.911 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-08-17T17:34:12.910+0000 7f7b74c78200 -1 osd.5 0 log_to_monitors {default=true} 2023-08-17T17:34:12.939 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-08-17T17:34:12.937+0000 7f8730be1200 -1 osd.1 0 log_to_monitors {default=true} 2023-08-17T17:34:12.957 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-08-17T17:34:12.956+0000 7fcc0c255200 -1 osd.4 0 log_to_monitors {default=true} 2023-08-17T17:34:12.960 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-08-17T17:34:12.959+0000 7f377ca52200 -1 osd.7 0 log_to_monitors {default=true} 2023-08-17T17:34:14.015 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-08-17T17:34:14.014+0000 7f36114a8700 -1 osd.6 0 waiting for initial osdmap 2023-08-17T17:34:14.016 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-08-17T17:34:14.015+0000 7f3773410700 -1 osd.7 0 waiting for initial osdmap 2023-08-17T17:34:14.016 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-08-17T17:34:14.015+0000 7f7b6b636700 -1 osd.5 0 waiting for initial osdmap 2023-08-17T17:34:14.018 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-08-17T17:34:14.017+0000 7f7075128700 -1 osd.3 0 waiting for initial osdmap 2023-08-17T17:34:14.019 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-08-17T17:34:14.017+0000 7f1500112700 -1 osd.0 0 waiting for initial osdmap 2023-08-17T17:34:14.019 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-08-17T17:34:14.017+0000 7fed0e314700 -1 osd.2 0 waiting for initial osdmap 2023-08-17T17:34:14.019 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-08-17T17:34:14.017+0000 7f872759f700 -1 osd.1 0 waiting for initial osdmap 2023-08-17T17:34:14.021 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-08-17T17:34:14.020+0000 7fcc02c13700 -1 osd.4 0 waiting for initial osdmap 2023-08-17T17:34:14.022 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-08-17T17:34:14.021+0000 7f360dc24700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T17:34:14.023 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-08-17T17:34:14.022+0000 7f7b67db2700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T17:34:14.023 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-08-17T17:34:14.023+0000 7f376fb8c700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T17:34:14.028 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-08-17T17:34:14.027+0000 7fcbff38f700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T17:34:14.030 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-08-17T17:34:14.028+0000 7f8723d1b700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T17:34:14.030 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-08-17T17:34:14.028+0000 7fed0aa90700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T17:34:14.030 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-08-17T17:34:14.028+0000 7f70718a4700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T17:34:14.031 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-08-17T17:34:14.030+0000 7f14fb08b700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T17:34:16.844 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:16.960 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.960+0000 7ff910ed0700 1 Processor -- start 2023-08-17T17:34:16.960 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.960+0000 7ff910ed0700 1 -- start start 2023-08-17T17:34:16.962 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.960+0000 7ff910ed0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff90c14fc20 0x7ff90c0bc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:16.962 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff910ed0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff90c064bb0 0x7ff90c0624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:16.962 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff910ed0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff90c066380 con 0x7ff90c1530d0 2023-08-17T17:34:16.962 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff910ed0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90c06b440 con 0x7ff90c064bb0 2023-08-17T17:34:16.962 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff910ed0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90c06b890 con 0x7ff90c14fc20 2023-08-17T17:34:16.962 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff90ad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff90c064bb0 0x7ff90c0624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:16.963 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff90ad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff90c064bb0 0x7ff90c0624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43576/0 (socket says 172.21.15.78:43576) 2023-08-17T17:34:16.963 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff90ad9d700 1 -- 172.21.15.78:0/4208015189 learned_addr learned my addr 172.21.15.78:0/4208015189 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:16.963 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff90a59c700 1 --2- 172.21.15.78:0/4208015189 >> v2:172.21.15.150:3300/0 conn(0x7ff90c14fc20 0x7ff90c0bc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:16.963 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff90ad9d700 1 -- 172.21.15.78:0/4208015189 >> v2:172.21.15.150:3300/0 conn(0x7ff90c14fc20 msgr2=0x7ff90c0bc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:16.963 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff90ad9d700 1 --2- 172.21.15.78:0/4208015189 >> v2:172.21.15.150:3300/0 conn(0x7ff90c14fc20 0x7ff90c0bc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:16.963 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff90ad9d700 1 -- 172.21.15.78:0/4208015189 >> v1:172.21.15.150:6789/0 conn(0x7ff90c1530d0 legacy=0x7ff90c0644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:16.963 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff90ad9d700 1 -- 172.21.15.78:0/4208015189 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c065dc0 con 0x7ff90c064bb0 2023-08-17T17:34:16.963 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff90ad9d700 1 --2- 172.21.15.78:0/4208015189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c064bb0 0x7ff90c0624f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff90c0679d0 tx=0x7ff904009840).ready entity=mon.0 client_cookie=8b0b82e2154fd57f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:16.964 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff909d9b700 1 -- 172.21.15.78:0/4208015189 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90400e070 con 0x7ff90c064bb0 2023-08-17T17:34:16.964 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff909d9b700 1 -- 172.21.15.78:0/4208015189 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90400ba10 con 0x7ff90c064bb0 2023-08-17T17:34:16.964 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.961+0000 7ff909d9b700 1 -- 172.21.15.78:0/4208015189 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90400bd90 con 0x7ff90c064bb0 2023-08-17T17:34:16.966 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.962+0000 7ff910ed0700 1 -- 172.21.15.78:0/4208015189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c064bb0 msgr2=0x7ff90c0624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:16.966 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.962+0000 7ff910ed0700 1 --2- 172.21.15.78:0/4208015189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c064bb0 0x7ff90c0624f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff90c0679d0 tx=0x7ff904009840).stop 2023-08-17T17:34:16.966 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.962+0000 7ff910ed0700 1 -- 172.21.15.78:0/4208015189 shutdown_connections 2023-08-17T17:34:16.966 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.962+0000 7ff910ed0700 1 --2- 172.21.15.78:0/4208015189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c064bb0 0x7ff90c0624f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:16.967 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.962+0000 7ff910ed0700 1 --2- 172.21.15.78:0/4208015189 >> v2:172.21.15.150:3300/0 conn(0x7ff90c14fc20 0x7ff90c0bc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:16.967 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.962+0000 7ff910ed0700 1 -- 172.21.15.78:0/4208015189 >> 172.21.15.78:0/4208015189 conn(0x7ff90c0c3d50 msgr2=0x7ff90c0c4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:16.967 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.962+0000 7ff910ed0700 1 -- 172.21.15.78:0/4208015189 shutdown_connections 2023-08-17T17:34:16.967 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.962+0000 7ff910ed0700 1 -- 172.21.15.78:0/4208015189 wait complete. 2023-08-17T17:34:16.967 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.963+0000 7ff910ed0700 1 Processor -- start 2023-08-17T17:34:16.967 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.963+0000 7ff910ed0700 1 -- start start 2023-08-17T17:34:16.967 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff910ed0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff90c064bb0 0x7ff90c0a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:16.967 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff910ed0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff90c14fc20 0x7ff90c143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:16.968 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff910ed0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c1530d0 0x7ff90c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:16.968 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff910ed0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c0a5c40 con 0x7ff90c1530d0 2023-08-17T17:34:16.968 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff910ed0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c0a50c0 con 0x7ff90c064bb0 2023-08-17T17:34:16.968 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff910ed0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c0a53a0 con 0x7ff90c14fc20 2023-08-17T17:34:16.968 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff90ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c1530d0 0x7ff90c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:16.968 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff90ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c1530d0 0x7ff90c1535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43588/0 (socket says 172.21.15.78:43588) 2023-08-17T17:34:16.968 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff90ad9d700 1 -- 172.21.15.78:0/1376743316 learned_addr learned my addr 172.21.15.78:0/1376743316 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:16.969 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff90ad9d700 1 -- 172.21.15.78:0/1376743316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff90c14fc20 msgr2=0x7ff90c143e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:16.969 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff90ad9d700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff90c14fc20 0x7ff90c143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:16.969 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff90ad9d700 1 -- 172.21.15.78:0/1376743316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff90c064bb0 msgr2=0x7ff90c0a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:16.969 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff90a59c700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff90c064bb0 0x7ff90c0a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:16.969 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff90ad9d700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff90c064bb0 0x7ff90c0a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:16.969 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff90ad9d700 1 -- 172.21.15.78:0/1376743316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff904009ae0 con 0x7ff90c1530d0 2023-08-17T17:34:16.969 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff90ad9d700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c1530d0 0x7ff90c1535b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff90c064040 tx=0x7ff904009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:16.969 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff9027fc700 1 -- 172.21.15.78:0/1376743316 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040092e0 con 0x7ff90c1530d0 2023-08-17T17:34:16.970 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff9027fc700 1 -- 172.21.15.78:0/1376743316 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90401d410 con 0x7ff90c1530d0 2023-08-17T17:34:16.970 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff910ed0700 1 -- 172.21.15.78:0/1376743316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90c0a5680 con 0x7ff90c1530d0 2023-08-17T17:34:16.970 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.964+0000 7ff9027fc700 1 -- 172.21.15.78:0/1376743316 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90401d7b0 con 0x7ff90c1530d0 2023-08-17T17:34:16.970 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.965+0000 7ff910ed0700 1 -- 172.21.15.78:0/1376743316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90c0a4d60 con 0x7ff90c1530d0 2023-08-17T17:34:16.970 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.965+0000 7ff910ed0700 1 -- 172.21.15.78:0/1376743316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90c047350 con 0x7ff90c1530d0 2023-08-17T17:34:16.971 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.966+0000 7ff9027fc700 1 -- 172.21.15.78:0/1376743316 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff90401b040 con 0x7ff90c1530d0 2023-08-17T17:34:16.971 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.966+0000 7ff9027fc700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8ec05edc0 0x7ff8ec061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:16.971 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.966+0000 7ff9027fc700 1 -- 172.21.15.78:0/1376743316 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7ff90407b190 con 0x7ff90c1530d0 2023-08-17T17:34:16.971 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.966+0000 7ff90a59c700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8ec05edc0 0x7ff8ec061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:16.971 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.967+0000 7ff90a59c700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8ec05edc0 0x7ff8ec061280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff8fc006fd0 tx=0x7ff8fc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:16.972 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:16.971+0000 7ff9027fc700 1 -- 172.21.15.78:0/1376743316 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff90404ccb0 con 0x7ff90c1530d0 2023-08-17T17:34:17.144 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.144+0000 7ff910ed0700 1 -- 172.21.15.78:0/1376743316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff90c047350 con 0x7ff90c1530d0 2023-08-17T17:34:17.145 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.144+0000 7ff9027fc700 1 -- 172.21.15.78:0/1376743316 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12250 (secure 0 0 0) 0x7ff9040502d0 con 0x7ff90c1530d0 2023-08-17T17:34:17.145 INFO:teuthology.misc.health.smithi078.stdout: 2023-08-17T17:34:17.145 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":15,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:17.036780+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:17.147 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 -- 172.21.15.78:0/1376743316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8ec05edc0 msgr2=0x7ff8ec061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:17.147 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8ec05edc0 0x7ff8ec061280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff8fc006fd0 tx=0x7ff8fc008040).stop 2023-08-17T17:34:17.147 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 -- 172.21.15.78:0/1376743316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c1530d0 msgr2=0x7ff90c1535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:17.147 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c1530d0 0x7ff90c1535b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff90c064040 tx=0x7ff904009840).stop 2023-08-17T17:34:17.148 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 -- 172.21.15.78:0/1376743316 shutdown_connections 2023-08-17T17:34:17.148 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8ec05edc0 0x7ff8ec061280 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:17.148 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff90c1530d0 0x7ff90c1535b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:17.148 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff90c064bb0 0x7ff90c0a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:17.148 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 --2- 172.21.15.78:0/1376743316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff90c14fc20 0x7ff90c143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:17.148 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 -- 172.21.15.78:0/1376743316 >> 172.21.15.78:0/1376743316 conn(0x7ff90c0c3d50 msgr2=0x7ff90c1545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:17.148 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 -- 172.21.15.78:0/1376743316 shutdown_connections 2023-08-17T17:34:17.148 INFO:teuthology.misc.health.smithi078.stderr:2023-08-17T17:34:17.146+0000 7ff910ed0700 1 -- 172.21.15.78:0/1376743316 wait complete. 2023-08-17T17:34:17.157 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-17T17:34:17.158 INFO:tasks.ceph:Creating RBD pool 2023-08-17T17:34:17.158 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-17T17:34:17.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.270+0000 7f2325f7b700 1 Processor -- start 2023-08-17T17:34:17.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.270+0000 7f2325f7b700 1 -- start start 2023-08-17T17:34:17.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.271+0000 7f2325f7b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2320138410 0x7f23201387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:17.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.271+0000 7f2325f7b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23200a7780 0x7f23200624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:17.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.271+0000 7f2325f7b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23200beb60 con 0x7f23200c86c0 2023-08-17T17:34:17.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.271+0000 7f2325f7b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2320065630 con 0x7f2320138410 2023-08-17T17:34:17.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.271+0000 7f2325f7b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200bcbd0 con 0x7f23200a7780 2023-08-17T17:34:17.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.271+0000 7f2317fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f23200c86c0 0x7f23201564c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56212/0 (socket says 172.21.15.78:56212) 2023-08-17T17:34:17.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.271+0000 7f2317fff700 1 -- 172.21.15.78:0/316165727 learned_addr learned my addr 172.21.15.78:0/316165727 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:17.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231ffff700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23200a7780 0x7f23200624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:17.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231f7fe700 1 --2- 172.21.15.78:0/316165727 >> v2:172.21.15.150:3300/0 conn(0x7f2320138410 0x7f23201387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:17.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113694690 0 0) 0x7f23200beb60 con 0x7f23200c86c0 2023-08-17T17:34:17.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f230c0033f0 con 0x7f23200c86c0 2023-08-17T17:34:17.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896933958 0 0) 0x7f230c0033f0 con 0x7f23200c86c0 2023-08-17T17:34:17.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23200a7780 msgr2=0x7f23200624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:17.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23200a7780 0x7f23200624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:17.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 >> v2:172.21.15.150:3300/0 conn(0x7f2320138410 msgr2=0x7f23201387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 --2- 172.21.15.78:0/316165727 >> v2:172.21.15.150:3300/0 conn(0x7f2320138410 0x7f23201387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200bceb0 con 0x7f23200c86c0 2023-08-17T17:34:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f2308001470 con 0x7f23200c86c0 2023-08-17T17:34:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 >> v1:172.21.15.78:6789/0 conn(0x7f23200c86c0 legacy=0x7f23201564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 0x7f230c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f230c004690 0x7f230c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23200a7780 0x7f230c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320065630 con 0x7f230c0038e0 2023-08-17T17:34:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200bcbd0 con 0x7f230c004690 2023-08-17T17:34:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c00b8e0 con 0x7f23200a7780 2023-08-17T17:34:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231f7fe700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 0x7f230c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231ffff700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23200a7780 0x7f230c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f2317fff700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f230c004690 0x7f230c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231f7fe700 1 -- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23200a7780 msgr2=0x7f230c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231f7fe700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23200a7780 0x7f230c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231f7fe700 1 -- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f230c004690 msgr2=0x7f230c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231f7fe700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f230c004690 0x7f230c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231f7fe700 1 -- 172.21.15.78:0/316165727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0033f0 con 0x7f230c0038e0 2023-08-17T17:34:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.272+0000 7f231f7fe700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 0x7f230c003d00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2310009a80 tx=0x7f2310009060).ready entity=mon.0 client_cookie=c6a76511951e87d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.273+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310009430 con 0x7f230c0038e0 2023-08-17T17:34:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.273+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000e640 con 0x7f230c0038e0 2023-08-17T17:34:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.273+0000 7f231effd700 1 -- 172.21.15.78:0/316165727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000e9c0 con 0x7f230c0038e0 2023-08-17T17:34:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.273+0000 7f2325f7b700 1 -- 172.21.15.78:0/316165727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 msgr2=0x7f230c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.273+0000 7f2325f7b700 1 --2- 172.21.15.78:0/316165727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 0x7f230c003d00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2310009a80 tx=0x7f2310009060).stop 2023-08-17T17:34:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.273+0000 7f231ffff700 1 -- 172.21.15.78:0/316165727 reap_dead start 2023-08-17T17:34:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.273+0000 7f2325f7b700 1 -- 172.21.15.78:0/316165727 shutdown_connections 2023-08-17T17:34:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.273+0000 7f2325f7b700 1 -- 172.21.15.78:0/316165727 >> 172.21.15.78:0/316165727 conn(0x7f23200c7bd0 msgr2=0x7f23200c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.273+0000 7f2325f7b700 1 -- 172.21.15.78:0/316165727 shutdown_connections 2023-08-17T17:34:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.273+0000 7f2325f7b700 1 -- 172.21.15.78:0/316165727 wait complete. 2023-08-17T17:34:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.274+0000 7f2325f7b700 1 Processor -- start 2023-08-17T17:34:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.274+0000 7f2325f7b700 1 -- start start 2023-08-17T17:34:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f2325f7b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 0x7f232012b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f2325f7b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232012b8d0 0x7f2320129760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f2325f7b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23201627f0 0x7f2320129c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f2325f7b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232012a140 con 0x7f230c0038e0 2023-08-17T17:34:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f2325f7b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232012af50 con 0x7f232012b8d0 2023-08-17T17:34:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f2325f7b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232012a340 con 0x7f23201627f0 2023-08-17T17:34:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f231f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 0x7f232012b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f231f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 0x7f232012b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43600/0 (socket says 172.21.15.78:43600) 2023-08-17T17:34:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f231f7fe700 1 -- 172.21.15.78:0/2564079868 learned_addr learned my addr 172.21.15.78:0/2564079868 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f231ffff700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23201627f0 0x7f2320129c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f2317fff700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232012b8d0 0x7f2320129760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f231f7fe700 1 -- 172.21.15.78:0/2564079868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23201627f0 msgr2=0x7f2320129c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f231f7fe700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23201627f0 0x7f2320129c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f231f7fe700 1 -- 172.21.15.78:0/2564079868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232012b8d0 msgr2=0x7f2320129760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f231f7fe700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232012b8d0 0x7f2320129760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:17.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.275+0000 7f231f7fe700 1 -- 172.21.15.78:0/2564079868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232012a620 con 0x7f230c0038e0 2023-08-17T17:34:17.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.276+0000 7f231f7fe700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 0x7f232012b3e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f230c0044b0 tx=0x7f231001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:17.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.276+0000 7f23177fe700 1 -- 172.21.15.78:0/2564079868 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310009ec0 con 0x7f230c0038e0 2023-08-17T17:34:17.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.276+0000 7f23177fe700 1 -- 172.21.15.78:0/2564079868 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000ed30 con 0x7f230c0038e0 2023-08-17T17:34:17.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.276+0000 7f2325f7b700 1 -- 172.21.15.78:0/2564079868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232012a900 con 0x7f230c0038e0 2023-08-17T17:34:17.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.276+0000 7f23177fe700 1 -- 172.21.15.78:0/2564079868 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000eea0 con 0x7f230c0038e0 2023-08-17T17:34:17.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.276+0000 7f2325f7b700 1 -- 172.21.15.78:0/2564079868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320166170 con 0x7f230c0038e0 2023-08-17T17:34:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.277+0000 7f2325f7b700 1 -- 172.21.15.78:0/2564079868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23200c57d0 con 0x7f230c0038e0 2023-08-17T17:34:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.277+0000 7f23177fe700 1 -- 172.21.15.78:0/2564079868 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f231002c020 con 0x7f230c0038e0 2023-08-17T17:34:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.277+0000 7f23177fe700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f230005ed90 0x7f2300061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.277+0000 7f23177fe700 1 -- 172.21.15.78:0/2564079868 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4916+0+0 (secure 0 0 0) 0x7f231007b0c0 con 0x7f230c0038e0 2023-08-17T17:34:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.277+0000 7f2317fff700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f230005ed90 0x7f2300061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.278+0000 7f2317fff700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f230005ed90 0x7f2300061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f23080016e0 tx=0x7f23200655a0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:17.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.281+0000 7f23177fe700 1 -- 172.21.15.78:0/2564079868 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f231004cb10 con 0x7f230c0038e0 2023-08-17T17:34:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:17.443+0000 7f2325f7b700 1 -- 172.21.15.78:0/2564079868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f232012ada0 con 0x7f230c0038e0 2023-08-17T17:34:18.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.053+0000 7f23177fe700 1 -- 172.21.15.78:0/2564079868 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f2310016020 con 0x7f230c0038e0 2023-08-17T17:34:18.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.055+0000 7f2325f7b700 1 -- 172.21.15.78:0/2564079868 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f230005ed90 msgr2=0x7f2300061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:18.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.055+0000 7f2325f7b700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f230005ed90 0x7f2300061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f23080016e0 tx=0x7f23200655a0).stop 2023-08-17T17:34:18.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.055+0000 7f2325f7b700 1 -- 172.21.15.78:0/2564079868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 msgr2=0x7f232012b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:18.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.055+0000 7f2325f7b700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 0x7f232012b3e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f230c0044b0 tx=0x7f231001a000).stop 2023-08-17T17:34:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.056+0000 7f2325f7b700 1 -- 172.21.15.78:0/2564079868 shutdown_connections 2023-08-17T17:34:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.056+0000 7f2325f7b700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f230005ed90 0x7f2300061250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.056+0000 7f2325f7b700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23201627f0 0x7f2320129c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.056+0000 7f2325f7b700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c0038e0 0x7f232012b3e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.056+0000 7f2325f7b700 1 --2- 172.21.15.78:0/2564079868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f232012b8d0 0x7f2320129760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.056+0000 7f2325f7b700 1 -- 172.21.15.78:0/2564079868 >> 172.21.15.78:0/2564079868 conn(0x7f23200c7bd0 msgr2=0x7f23200a7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.056+0000 7f2325f7b700 1 -- 172.21.15.78:0/2564079868 shutdown_connections 2023-08-17T17:34:18.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.056+0000 7f2325f7b700 1 -- 172.21.15.78:0/2564079868 wait complete. 2023-08-17T17:34:18.058 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'rbd' created 2023-08-17T17:34:18.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-17T17:34:18.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.182+0000 7fcc85114700 1 Processor -- start 2023-08-17T17:34:18.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.182+0000 7fcc85114700 1 -- start start 2023-08-17T17:34:18.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.183+0000 7fcc85114700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 0x7fcc800c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:18.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.183+0000 7fcc85114700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc80063aa0 0x7fcc800c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:18.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.183+0000 7fcc85114700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800bcc80 con 0x7fcc800c35d0 2023-08-17T17:34:18.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.183+0000 7fcc85114700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800bced0 con 0x7fcc80063aa0 2023-08-17T17:34:18.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.183+0000 7fcc85114700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800bd1b0 con 0x7fcc800c2810 2023-08-17T17:34:18.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.183+0000 7fcc7ed9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 0x7fcc800c2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:18.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.183+0000 7fcc7e59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc80063aa0 0x7fcc800c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:18.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.183+0000 7fcc7f59e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fcc800c35d0 0x7fcc800649f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:49288/0 (socket says 172.21.15.78:49288) 2023-08-17T17:34:18.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.183+0000 7fcc7f59e700 1 -- 172.21.15.78:0/3735286642 learned_addr learned my addr 172.21.15.78:0/3735286642 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:18.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc7e59c700 1 -- 172.21.15.78:0/3735286642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 msgr2=0x7fcc800c2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:18.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc7e59c700 1 --2- 172.21.15.78:0/3735286642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 0x7fcc800c2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:18.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc7e59c700 1 -- 172.21.15.78:0/3735286642 >> v1:172.21.15.150:6789/0 conn(0x7fcc800c35d0 legacy=0x7fcc800649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:18.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc7e59c700 1 -- 172.21.15.78:0/3735286642 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800bd490 con 0x7fcc80063aa0 2023-08-17T17:34:18.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc7dd9b700 1 -- 172.21.15.78:0/3735286642 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727408056 0 0) 0x7fcc800bcc80 con 0x7fcc800c35d0 2023-08-17T17:34:18.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc7ed9d700 1 --2- 172.21.15.78:0/3735286642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 0x7fcc800c2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:18.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc7e59c700 1 --2- 172.21.15.78:0/3735286642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc80063aa0 0x7fcc800c30e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fcc74009760 tx=0x7fcc74009060).ready entity=mon.1 client_cookie=70e62f526cc2a166 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:18.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc7dd9b700 1 -- 172.21.15.78:0/3735286642 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400f510 con 0x7fcc80063aa0 2023-08-17T17:34:18.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc7dd9b700 1 -- 172.21.15.78:0/3735286642 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7400f670 con 0x7fcc80063aa0 2023-08-17T17:34:18.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc7dd9b700 1 -- 172.21.15.78:0/3735286642 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400f9f0 con 0x7fcc80063aa0 2023-08-17T17:34:18.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc85114700 1 -- 172.21.15.78:0/3735286642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc80063aa0 msgr2=0x7fcc800c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:18.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc85114700 1 --2- 172.21.15.78:0/3735286642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc80063aa0 0x7fcc800c30e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fcc74009760 tx=0x7fcc74009060).stop 2023-08-17T17:34:18.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc85114700 1 -- 172.21.15.78:0/3735286642 shutdown_connections 2023-08-17T17:34:18.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc85114700 1 --2- 172.21.15.78:0/3735286642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 0x7fcc800c2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:18.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc85114700 1 --2- 172.21.15.78:0/3735286642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc80063aa0 0x7fcc800c30e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:18.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc85114700 1 -- 172.21.15.78:0/3735286642 >> 172.21.15.78:0/3735286642 conn(0x7fcc800c3db0 msgr2=0x7fcc800c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:18.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc85114700 1 -- 172.21.15.78:0/3735286642 shutdown_connections 2023-08-17T17:34:18.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.184+0000 7fcc85114700 1 -- 172.21.15.78:0/3735286642 wait complete. 2023-08-17T17:34:18.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.186+0000 7fcc85114700 1 Processor -- start 2023-08-17T17:34:18.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.186+0000 7fcc85114700 1 -- start start 2023-08-17T17:34:18.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.186+0000 7fcc85114700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc80063aa0 0x7fcc80153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.186+0000 7fcc85114700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 0x7fcc800a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.186+0000 7fcc85114700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc800c35d0 0x7fcc8013de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.186+0000 7fcc85114700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80153a40 con 0x7fcc80063aa0 2023-08-17T17:34:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.186+0000 7fcc85114700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800a9f00 con 0x7fcc800c35d0 2023-08-17T17:34:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.186+0000 7fcc85114700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800a97d0 con 0x7fcc800c2810 2023-08-17T17:34:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc80063aa0 0x7fcc80153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc80063aa0 0x7fcc80153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43608/0 (socket says 172.21.15.78:43608) 2023-08-17T17:34:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7ed9d700 1 -- 172.21.15.78:0/2060405852 learned_addr learned my addr 172.21.15.78:0/2060405852 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7e59c700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 0x7fcc800a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7f59e700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc800c35d0 0x7fcc8013de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7ed9d700 1 -- 172.21.15.78:0/2060405852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 msgr2=0x7fcc800a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7ed9d700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 0x7fcc800a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7ed9d700 1 -- 172.21.15.78:0/2060405852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc800c35d0 msgr2=0x7fcc8013de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7ed9d700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc800c35d0 0x7fcc8013de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7ed9d700 1 -- 172.21.15.78:0/2060405852 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc70009250 con 0x7fcc80063aa0 2023-08-17T17:34:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7f59e700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc800c35d0 0x7fcc8013de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7e59c700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 0x7fcc800a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc7ed9d700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc80063aa0 0x7fcc80153550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcc7000ea20 tx=0x7fcc70006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc66ffd700 1 -- 172.21.15.78:0/2060405852 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000ee60 con 0x7fcc80063aa0 2023-08-17T17:34:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc66ffd700 1 -- 172.21.15.78:0/2060405852 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc70005880 con 0x7fcc80063aa0 2023-08-17T17:34:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc85114700 1 -- 172.21.15.78:0/2060405852 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc740092a0 con 0x7fcc80063aa0 2023-08-17T17:34:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc66ffd700 1 -- 172.21.15.78:0/2060405852 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70005c00 con 0x7fcc80063aa0 2023-08-17T17:34:18.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.187+0000 7fcc85114700 1 -- 172.21.15.78:0/2060405852 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc800a7140 con 0x7fcc80063aa0 2023-08-17T17:34:18.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.188+0000 7fcc85114700 1 -- 172.21.15.78:0/2060405852 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc800676a0 con 0x7fcc80063aa0 2023-08-17T17:34:18.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.189+0000 7fcc66ffd700 1 -- 172.21.15.78:0/2060405852 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcc7000c850 con 0x7fcc80063aa0 2023-08-17T17:34:18.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.189+0000 7fcc66ffd700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc6c05ed90 0x7fcc6c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:18.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.189+0000 7fcc66ffd700 1 -- 172.21.15.78:0/2060405852 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7fcc700799b0 con 0x7fcc80063aa0 2023-08-17T17:34:18.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.189+0000 7fcc7e59c700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc6c05ed90 0x7fcc6c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:18.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.189+0000 7fcc7e59c700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc6c05ed90 0x7fcc6c061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fcc74009760 tx=0x7fcc74017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:18.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.193+0000 7fcc66ffd700 1 -- 172.21.15.78:0/2060405852 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc7004b250 con 0x7fcc80063aa0 2023-08-17T17:34:18.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:18.356+0000 7fcc85114700 1 -- 172.21.15.78:0/2060405852 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcc800a7420 con 0x7fcc80063aa0 2023-08-17T17:34:19.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.057+0000 7fcc66ffd700 1 -- 172.21.15.78:0/2060405852 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcc70016070 con 0x7fcc80063aa0 2023-08-17T17:34:19.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 -- 172.21.15.78:0/2060405852 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc6c05ed90 msgr2=0x7fcc6c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc6c05ed90 0x7fcc6c061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fcc74009760 tx=0x7fcc74017000).stop 2023-08-17T17:34:19.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 -- 172.21.15.78:0/2060405852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc80063aa0 msgr2=0x7fcc80153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc80063aa0 0x7fcc80153550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcc7000ea20 tx=0x7fcc70006f40).stop 2023-08-17T17:34:19.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 -- 172.21.15.78:0/2060405852 shutdown_connections 2023-08-17T17:34:19.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc6c05ed90 0x7fcc6c061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc800c35d0 0x7fcc8013de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc80063aa0 0x7fcc80153550 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 --2- 172.21.15.78:0/2060405852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc800c2810 0x7fcc800a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 -- 172.21.15.78:0/2060405852 >> 172.21.15.78:0/2060405852 conn(0x7fcc800c3db0 msgr2=0x7fcc800ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:19.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 -- 172.21.15.78:0/2060405852 shutdown_connections 2023-08-17T17:34:19.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.061+0000 7fcc85114700 1 -- 172.21.15.78:0/2060405852 wait complete. 2023-08-17T17:34:19.063 INFO:teuthology.orchestra.run.smithi078.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-17T17:34:19.075 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-17T17:34:19.075 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T17:34:19.076 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T17:34:19.078 INFO:tasks.ceph.mds.a:Started 2023-08-17T17:34:19.078 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T17:34:19.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T17:34:19.081 INFO:tasks.ceph.mds.c:Started 2023-08-17T17:34:19.081 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T17:34:19.081 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T17:34:19.083 INFO:tasks.ceph.mds.b:Started 2023-08-17T17:34:19.084 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T17:34:19.084 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T17:34:19.086 INFO:tasks.ceph.mds.d:Started 2023-08-17T17:34:19.086 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-17T17:34:19.086 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:19.151 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T17:34:19.154 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:34:19.164 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T17:34:19.164 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:34:19.164 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-08-17T17:34:19.163+0000 7fd4642c2700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-08-17T17:34:19.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.205+0000 7ff20d067700 1 Processor -- start 2023-08-17T17:34:19.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.205+0000 7ff20d067700 1 -- start start 2023-08-17T17:34:19.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20d067700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff208154140 0x7ff2080c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20d067700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff208154520 con 0x7ff2080c1010 2023-08-17T17:34:19.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20d067700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2080c91e0 con 0x7ff2080a7c40 2023-08-17T17:34:19.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20d067700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2080c94c0 con 0x7ff208154140 2023-08-17T17:34:19.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20759e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff2080c1010 0x7ff2080ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36246/0 (socket says 172.21.15.78:36246) 2023-08-17T17:34:19.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20759e700 1 -- 172.21.15.78:0/3476145506 learned_addr learned my addr 172.21.15.78:0/3476145506 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:19.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885296662 0 0) 0x7ff208154520 con 0x7ff2080c1010 2023-08-17T17:34:19.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f40033f0 con 0x7ff2080c1010 2023-08-17T17:34:19.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff206d9d700 1 --2- 172.21.15.78:0/3476145506 >> v2:172.21.15.150:3300/0 conn(0x7ff208154140 0x7ff2080c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2875902481 0 0) 0x7ff1f40033f0 con 0x7ff2080c1010 2023-08-17T17:34:19.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 >> v2:172.21.15.150:3300/0 conn(0x7ff208154140 msgr2=0x7ff2080c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:19.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20659c700 1 --2- 172.21.15.78:0/3476145506 >> v2:172.21.15.150:3300/0 conn(0x7ff208154140 0x7ff2080c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 >> v1:172.21.15.150:6789/0 conn(0x7ff2080a7c40 legacy=0x7ff2080c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2080c97a0 con 0x7ff2080c1010 2023-08-17T17:34:19.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7ff2000017f0 con 0x7ff2080c1010 2023-08-17T17:34:19.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 >> v1:172.21.15.78:6789/0 conn(0x7ff2080c1010 legacy=0x7ff2080ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.206+0000 7ff20659c700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f40038e0 0x7ff1f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20659c700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1f4004690 0x7ff1f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20659c700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff1f400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080c94c0 con 0x7ff1f4005000 2023-08-17T17:34:19.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f400bf60 con 0x7ff1f4004690 2023-08-17T17:34:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f400c0f0 con 0x7ff1f40038e0 2023-08-17T17:34:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20759e700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff1f400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff206d9d700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f40038e0 0x7ff1f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff1fe59c700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1f4004690 0x7ff1f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20759e700 1 -- 172.21.15.78:0/3476145506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f40038e0 msgr2=0x7ff1f4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20759e700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f40038e0 0x7ff1f4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20759e700 1 -- 172.21.15.78:0/3476145506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1f4004690 msgr2=0x7ff1f4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20759e700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1f4004690 0x7ff1f4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20759e700 1 -- 172.21.15.78:0/3476145506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40033f0 con 0x7ff1f4005000 2023-08-17T17:34:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20759e700 1 -- 172.21.15.78:0/3476145506 reap_dead start 2023-08-17T17:34:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20759e700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff1f400b8e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff20000c480 tx=0x7ff20000c790).ready entity=mon.0 client_cookie=5b96478fe010c42b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200002030 con 0x7ff1f4005000 2023-08-17T17:34:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20000ce20 con 0x7ff1f4005000 2023-08-17T17:34:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.207+0000 7ff20659c700 1 -- 172.21.15.78:0/3476145506 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200005d30 con 0x7ff1f4005000 2023-08-17T17:34:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.208+0000 7ff20d067700 1 -- 172.21.15.78:0/3476145506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 msgr2=0x7ff1f400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.208+0000 7ff20d067700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff1f400b8e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff20000c480 tx=0x7ff20000c790).stop 2023-08-17T17:34:19.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.208+0000 7ff20d067700 1 -- 172.21.15.78:0/3476145506 shutdown_connections 2023-08-17T17:34:19.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.208+0000 7ff20d067700 1 --2- 172.21.15.78:0/3476145506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff1f400b8e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.208+0000 7ff20d067700 1 -- 172.21.15.78:0/3476145506 >> 172.21.15.78:0/3476145506 conn(0x7ff208094510 msgr2=0x7ff20806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:19.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.208+0000 7ff20d067700 1 -- 172.21.15.78:0/3476145506 shutdown_connections 2023-08-17T17:34:19.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.208+0000 7ff20d067700 1 -- 172.21.15.78:0/3476145506 wait complete. 2023-08-17T17:34:19.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.209+0000 7ff20d067700 1 Processor -- start 2023-08-17T17:34:19.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.209+0000 7ff20d067700 1 -- start start 2023-08-17T17:34:19.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff20d067700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff2080af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff20d067700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208150ea0 0x7ff2080c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff20d067700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff20815a380 0x7ff2081583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff20d067700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20815ac20 con 0x7ff1f4005000 2023-08-17T17:34:19.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff20d067700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2081568b0 con 0x7ff208150ea0 2023-08-17T17:34:19.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff20d067700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff208156b90 con 0x7ff20815a380 2023-08-17T17:34:19.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff206d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff2080af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff206d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff2080af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53992/0 (socket says 172.21.15.78:53992) 2023-08-17T17:34:19.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff206d9d700 1 -- 172.21.15.78:0/3798274844 learned_addr learned my addr 172.21.15.78:0/3798274844 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:19.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff1fe59c700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208150ea0 0x7ff2080c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff20759e700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff20815a380 0x7ff2081583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff206d9d700 1 -- 172.21.15.78:0/3798274844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff20815a380 msgr2=0x7ff2081583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff206d9d700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff20815a380 0x7ff2081583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff206d9d700 1 -- 172.21.15.78:0/3798274844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208150ea0 msgr2=0x7ff2080c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff206d9d700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208150ea0 0x7ff2080c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff206d9d700 1 -- 172.21.15.78:0/3798274844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208156e70 con 0x7ff1f4005000 2023-08-17T17:34:19.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff206d9d700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff2080af290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff1f80119c0 tx=0x7ff1f8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:19.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff1ff7fe700 1 -- 172.21.15.78:0/3798274844 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800f940 con 0x7ff1f4005000 2023-08-17T17:34:19.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff1ff7fe700 1 -- 172.21.15.78:0/3798274844 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f800faa0 con 0x7ff1f4005000 2023-08-17T17:34:19.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff20d067700 1 -- 172.21.15.78:0/3798274844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff208157150 con 0x7ff1f4005000 2023-08-17T17:34:19.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff1ff7fe700 1 -- 172.21.15.78:0/3798274844 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800fe60 con 0x7ff1f4005000 2023-08-17T17:34:19.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.210+0000 7ff20d067700 1 -- 172.21.15.78:0/3798274844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20815a800 con 0x7ff1f4005000 2023-08-17T17:34:19.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.211+0000 7ff20d067700 1 -- 172.21.15.78:0/3798274844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2081574c0 con 0x7ff1f4005000 2023-08-17T17:34:19.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.211+0000 7ff1ff7fe700 1 -- 172.21.15.78:0/3798274844 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff1f8024070 con 0x7ff1f4005000 2023-08-17T17:34:19.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.212+0000 7ff1ff7fe700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e805ed90 0x7ff1e8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.212+0000 7ff1ff7fe700 1 -- 172.21.15.78:0/3798274844 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff1f807a240 con 0x7ff1f4005000 2023-08-17T17:34:19.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.212+0000 7ff1fe59c700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e805ed90 0x7ff1e8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.212+0000 7ff1fe59c700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e805ed90 0x7ff1e8061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff208151280 tx=0x7ff1f0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:19.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.216+0000 7ff1ff7fe700 1 -- 172.21.15.78:0/3798274844 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff1f804bbb0 con 0x7ff1f4005000 2023-08-17T17:34:19.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.379+0000 7ff20d067700 1 -- 172.21.15.78:0/3798274844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff208047350 con 0x7ff1f4005000 2023-08-17T17:34:19.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.380+0000 7ff1ff7fe700 1 -- 172.21.15.78:0/3798274844 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13770 (secure 0 0 0) 0x7ff1f804f150 con 0x7ff1f4005000 2023-08-17T17:34:19.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:19.381 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:19.052153+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:19.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 -- 172.21.15.78:0/3798274844 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e805ed90 msgr2=0x7ff1e8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e805ed90 0x7ff1e8061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff208151280 tx=0x7ff1f0009040).stop 2023-08-17T17:34:19.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 -- 172.21.15.78:0/3798274844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 msgr2=0x7ff2080af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff2080af290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff1f80119c0 tx=0x7ff1f8009060).stop 2023-08-17T17:34:19.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 -- 172.21.15.78:0/3798274844 shutdown_connections 2023-08-17T17:34:19.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e805ed90 0x7ff1e8061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff20815a380 0x7ff2081583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f4005000 0x7ff2080af290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 --2- 172.21.15.78:0/3798274844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208150ea0 0x7ff2080c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 -- 172.21.15.78:0/3798274844 >> 172.21.15.78:0/3798274844 conn(0x7ff208094510 msgr2=0x7ff2080634e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 -- 172.21.15.78:0/3798274844 shutdown_connections 2023-08-17T17:34:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.382+0000 7ff20d067700 1 -- 172.21.15.78:0/3798274844 wait complete. 2023-08-17T17:34:19.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T17:34:19.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:34:19.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.509+0000 7fc509bf3700 1 Processor -- start 2023-08-17T17:34:19.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.509+0000 7fc509bf3700 1 -- start start 2023-08-17T17:34:19.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.510+0000 7fc509bf3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 0x7fc5040644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.510+0000 7fc509bf3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5040aa4d0 0x7fc5040c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.510+0000 7fc509bf3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5040649b0 con 0x7fc5040c5810 2023-08-17T17:34:19.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.510+0000 7fc509bf3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc504063420 con 0x7fc5040aa4d0 2023-08-17T17:34:19.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.510+0000 7fc509bf3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc504063700 con 0x7fc5040aa0f0 2023-08-17T17:34:19.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.510+0000 7fc502ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5040aa4d0 0x7fc5040c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.510+0000 7fc502ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5040aa4d0 0x7fc5040c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53998/0 (socket says 172.21.15.78:53998) 2023-08-17T17:34:19.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.510+0000 7fc502ffd700 1 -- 172.21.15.78:0/3811073513 learned_addr learned my addr 172.21.15.78:0/3811073513 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:19.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.510+0000 7fc5037fe700 1 --2- 172.21.15.78:0/3811073513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 0x7fc5040644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc502ffd700 1 -- 172.21.15.78:0/3811073513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 msgr2=0x7fc5040644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:19.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc502ffd700 1 --2- 172.21.15.78:0/3811073513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 0x7fc5040644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc502ffd700 1 -- 172.21.15.78:0/3811073513 >> v1:172.21.15.150:6789/0 conn(0x7fc5040c5810 legacy=0x7fc5040a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc5027fc700 1 -- 172.21.15.78:0/3811073513 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563414861 0 0) 0x7fc5040649b0 con 0x7fc5040c5810 2023-08-17T17:34:19.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc502ffd700 1 -- 172.21.15.78:0/3811073513 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5040639e0 con 0x7fc5040aa4d0 2023-08-17T17:34:19.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc5037fe700 1 --2- 172.21.15.78:0/3811073513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 0x7fc5040644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:19.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc502ffd700 1 --2- 172.21.15.78:0/3811073513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 0x7fc5040c0e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc4f8006fd0 tx=0x7fc4f80090f0).ready entity=mon.0 client_cookie=37a78a82524f8d9c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:19.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc5027fc700 1 -- 172.21.15.78:0/3811073513 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800b580 con 0x7fc5040aa4d0 2023-08-17T17:34:19.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc5027fc700 1 -- 172.21.15.78:0/3811073513 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f800b6e0 con 0x7fc5040aa4d0 2023-08-17T17:34:19.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc5027fc700 1 -- 172.21.15.78:0/3811073513 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800ba60 con 0x7fc5040aa4d0 2023-08-17T17:34:19.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc509bf3700 1 -- 172.21.15.78:0/3811073513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 msgr2=0x7fc5040c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc509bf3700 1 --2- 172.21.15.78:0/3811073513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 0x7fc5040c0e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc4f8006fd0 tx=0x7fc4f80090f0).stop 2023-08-17T17:34:19.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc509bf3700 1 -- 172.21.15.78:0/3811073513 shutdown_connections 2023-08-17T17:34:19.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc509bf3700 1 --2- 172.21.15.78:0/3811073513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 0x7fc5040644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc509bf3700 1 --2- 172.21.15.78:0/3811073513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 0x7fc5040c0e10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc509bf3700 1 -- 172.21.15.78:0/3811073513 >> 172.21.15.78:0/3811073513 conn(0x7fc50406a6a0 msgr2=0x7fc5040caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:19.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc509bf3700 1 -- 172.21.15.78:0/3811073513 shutdown_connections 2023-08-17T17:34:19.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.511+0000 7fc509bf3700 1 -- 172.21.15.78:0/3811073513 wait complete. 2023-08-17T17:34:19.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc509bf3700 1 Processor -- start 2023-08-17T17:34:19.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc509bf3700 1 -- start start 2023-08-17T17:34:19.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc509bf3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 0x7fc5040ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc509bf3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 0x7fc5040abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc509bf3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5040c5810 0x7fc5040c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc509bf3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040c4f30 con 0x7fc5040aa4d0 2023-08-17T17:34:19.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc509bf3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040aaec0 con 0x7fc5040c5810 2023-08-17T17:34:19.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc509bf3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040c4970 con 0x7fc5040aa0f0 2023-08-17T17:34:19.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc502ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 0x7fc5040abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc502ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 0x7fc5040abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54008/0 (socket says 172.21.15.78:54008) 2023-08-17T17:34:19.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc502ffd700 1 -- 172.21.15.78:0/832501260 learned_addr learned my addr 172.21.15.78:0/832501260 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:19.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc5037fe700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 0x7fc5040ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.513+0000 7fc503fff700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5040c5810 0x7fc5040c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc502ffd700 1 -- 172.21.15.78:0/832501260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 msgr2=0x7fc5040ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc502ffd700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 0x7fc5040ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc502ffd700 1 -- 172.21.15.78:0/832501260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5040c5810 msgr2=0x7fc5040c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc502ffd700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5040c5810 0x7fc5040c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc502ffd700 1 -- 172.21.15.78:0/832501260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f40092a0 con 0x7fc5040aa4d0 2023-08-17T17:34:19.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc503fff700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5040c5810 0x7fc5040c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:19.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc5037fe700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 0x7fc5040ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:19.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc502ffd700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 0x7fc5040abe90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc4f8009fd0 tx=0x7fc4f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:19.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc4eb7fe700 1 -- 172.21.15.78:0/832501260 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8000bc0 con 0x7fc5040aa4d0 2023-08-17T17:34:19.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc4eb7fe700 1 -- 172.21.15.78:0/832501260 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f800b850 con 0x7fc5040aa4d0 2023-08-17T17:34:19.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc509bf3700 1 -- 172.21.15.78:0/832501260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f8009370 con 0x7fc5040aa4d0 2023-08-17T17:34:19.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc4eb7fe700 1 -- 172.21.15.78:0/832501260 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8000d20 con 0x7fc5040aa4d0 2023-08-17T17:34:19.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.514+0000 7fc509bf3700 1 -- 172.21.15.78:0/832501260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5040aab50 con 0x7fc5040aa4d0 2023-08-17T17:34:19.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.515+0000 7fc509bf3700 1 -- 172.21.15.78:0/832501260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5040aace0 con 0x7fc5040aa4d0 2023-08-17T17:34:19.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.515+0000 7fc4eb7fe700 1 -- 172.21.15.78:0/832501260 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc4f802c070 con 0x7fc5040aa4d0 2023-08-17T17:34:19.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.516+0000 7fc4eb7fe700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4f005ed90 0x7fc4f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.516+0000 7fc4eb7fe700 1 -- 172.21.15.78:0/832501260 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc4f807b5e0 con 0x7fc5040aa4d0 2023-08-17T17:34:19.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.516+0000 7fc5037fe700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4f005ed90 0x7fc4f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.516+0000 7fc5037fe700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4f005ed90 0x7fc4f0061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc5040ca2e0 tx=0x7fc4f4009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:19.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.520+0000 7fc4eb7fe700 1 -- 172.21.15.78:0/832501260 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4f804ced0 con 0x7fc5040aa4d0 2023-08-17T17:34:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.683+0000 7fc509bf3700 1 -- 172.21.15.78:0/832501260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc5040ab030 con 0x7fc5040aa4d0 2023-08-17T17:34:19.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.683+0000 7fc4eb7fe700 1 -- 172.21.15.78:0/832501260 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc4f802a070 con 0x7fc5040aa4d0 2023-08-17T17:34:19.684 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:34:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 -- 172.21.15.78:0/832501260 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4f005ed90 msgr2=0x7fc4f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4f005ed90 0x7fc4f0061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc5040ca2e0 tx=0x7fc4f4009060).stop 2023-08-17T17:34:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 -- 172.21.15.78:0/832501260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 msgr2=0x7fc5040abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 0x7fc5040abe90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc4f8009fd0 tx=0x7fc4f8017000).stop 2023-08-17T17:34:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 -- 172.21.15.78:0/832501260 shutdown_connections 2023-08-17T17:34:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4f005ed90 0x7fc4f0061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5040c5810 0x7fc5040c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5040aa0f0 0x7fc5040ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 --2- 172.21.15.78:0/832501260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5040aa4d0 0x7fc5040abe90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 -- 172.21.15.78:0/832501260 >> 172.21.15.78:0/832501260 conn(0x7fc50406a6a0 msgr2=0x7fc504152f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 -- 172.21.15.78:0/832501260 shutdown_connections 2023-08-17T17:34:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.685+0000 7fc509bf3700 1 -- 172.21.15.78:0/832501260 wait complete. 2023-08-17T17:34:19.697 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:34:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.813+0000 7ff79addb700 1 Processor -- start 2023-08-17T17:34:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.813+0000 7ff79addb700 1 -- start start 2023-08-17T17:34:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79addb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff794151a40 0x7ff7940c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79addb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794157be0 0x7ff794158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79addb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff794158560 con 0x7ff794151e20 2023-08-17T17:34:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79addb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7940c6620 con 0x7ff794151a40 2023-08-17T17:34:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79addb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940c6900 con 0x7ff794157be0 2023-08-17T17:34:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff7995d8700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff794151e20 0x7ff7940c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36252/0 (socket says 172.21.15.78:36252) 2023-08-17T17:34:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff7995d8700 1 -- 172.21.15.78:0/3584158391 learned_addr learned my addr 172.21.15.78:0/3584158391 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79a5da700 1 --2- 172.21.15.78:0/3584158391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794157be0 0x7ff794158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff799dd9700 1 --2- 172.21.15.78:0/3584158391 >> v2:172.21.15.150:3300/0 conn(0x7ff794151a40 0x7ff7940c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff798dd7700 1 -- 172.21.15.78:0/3584158391 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141476281 0 0) 0x7ff794158560 con 0x7ff794151e20 2023-08-17T17:34:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff798dd7700 1 -- 172.21.15.78:0/3584158391 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7800033f0 con 0x7ff794151e20 2023-08-17T17:34:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff798dd7700 1 -- 172.21.15.78:0/3584158391 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2459699080 0 0) 0x7ff7800033f0 con 0x7ff794151e20 2023-08-17T17:34:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79a5da700 1 -- 172.21.15.78:0/3584158391 >> v2:172.21.15.150:3300/0 conn(0x7ff794151a40 msgr2=0x7ff7940c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79a5da700 1 --2- 172.21.15.78:0/3584158391 >> v2:172.21.15.150:3300/0 conn(0x7ff794151a40 0x7ff7940c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79a5da700 1 -- 172.21.15.78:0/3584158391 >> v1:172.21.15.78:6789/0 conn(0x7ff794151e20 legacy=0x7ff7940c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79a5da700 1 -- 172.21.15.78:0/3584158391 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7940c6be0 con 0x7ff794157be0 2023-08-17T17:34:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff799dd9700 1 --2- 172.21.15.78:0/3584158391 >> v2:172.21.15.150:3300/0 conn(0x7ff794151a40 0x7ff7940c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.814+0000 7ff79a5da700 1 --2- 172.21.15.78:0/3584158391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794157be0 0x7ff794158070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7ff78c009e60 tx=0x7ff78c009780).ready entity=mon.2 client_cookie=5f2ba23dd6a40824 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff798dd7700 1 -- 172.21.15.78:0/3584158391 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00e070 con 0x7ff794157be0 2023-08-17T17:34:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff798dd7700 1 -- 172.21.15.78:0/3584158391 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c00b7a0 con 0x7ff794157be0 2023-08-17T17:34:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff798dd7700 1 -- 172.21.15.78:0/3584158391 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840015f0 con 0x7ff794157be0 2023-08-17T17:34:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff79addb700 1 -- 172.21.15.78:0/3584158391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794157be0 msgr2=0x7ff794158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff79addb700 1 --2- 172.21.15.78:0/3584158391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794157be0 0x7ff794158070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7ff78c009e60 tx=0x7ff78c009780).stop 2023-08-17T17:34:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff79addb700 1 -- 172.21.15.78:0/3584158391 shutdown_connections 2023-08-17T17:34:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff79addb700 1 --2- 172.21.15.78:0/3584158391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794157be0 0x7ff794158070 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff79addb700 1 --2- 172.21.15.78:0/3584158391 >> v2:172.21.15.150:3300/0 conn(0x7ff794151a40 0x7ff7940c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff79addb700 1 -- 172.21.15.78:0/3584158391 >> 172.21.15.78:0/3584158391 conn(0x7ff7940943b0 msgr2=0x7ff79406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff79addb700 1 -- 172.21.15.78:0/3584158391 shutdown_connections 2023-08-17T17:34:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.815+0000 7ff79addb700 1 -- 172.21.15.78:0/3584158391 wait complete. 2023-08-17T17:34:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.816+0000 7ff79addb700 1 Processor -- start 2023-08-17T17:34:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.816+0000 7ff79addb700 1 -- start start 2023-08-17T17:34:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79addb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794151a40 0x7ff79414c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79addb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff794151e20 0x7ff79414d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79addb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff794157be0 0x7ff7940a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79addb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940c3cc0 con 0x7ff794157be0 2023-08-17T17:34:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79addb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940abf20 con 0x7ff794151e20 2023-08-17T17:34:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79addb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940c3390 con 0x7ff794151a40 2023-08-17T17:34:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79a5da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff794157be0 0x7ff7940a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79a5da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff794157be0 0x7ff7940a8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54014/0 (socket says 172.21.15.78:54014) 2023-08-17T17:34:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79a5da700 1 -- 172.21.15.78:0/340542677 learned_addr learned my addr 172.21.15.78:0/340542677 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff799dd9700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794151a40 0x7ff79414c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff7995d8700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff794151e20 0x7ff79414d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79a5da700 1 -- 172.21.15.78:0/340542677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794151a40 msgr2=0x7ff79414c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79a5da700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794151a40 0x7ff79414c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79a5da700 1 -- 172.21.15.78:0/340542677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff794151e20 msgr2=0x7ff79414d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79a5da700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff794151e20 0x7ff79414d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79a5da700 1 -- 172.21.15.78:0/340542677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790009250 con 0x7ff794157be0 2023-08-17T17:34:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.817+0000 7ff79a5da700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff794157be0 0x7ff7940a8a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff78c00b610 tx=0x7ff78c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.818+0000 7ff789ffb700 1 -- 172.21.15.78:0/340542677 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c01d420 con 0x7ff794157be0 2023-08-17T17:34:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.818+0000 7ff789ffb700 1 -- 172.21.15.78:0/340542677 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c01d580 con 0x7ff794157be0 2023-08-17T17:34:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.818+0000 7ff79addb700 1 -- 172.21.15.78:0/340542677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c009a20 con 0x7ff794157be0 2023-08-17T17:34:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.818+0000 7ff789ffb700 1 -- 172.21.15.78:0/340542677 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c01d940 con 0x7ff794157be0 2023-08-17T17:34:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.818+0000 7ff79addb700 1 -- 172.21.15.78:0/340542677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7940c3950 con 0x7ff794157be0 2023-08-17T17:34:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.819+0000 7ff79addb700 1 -- 172.21.15.78:0/340542677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff794082f90 con 0x7ff794157be0 2023-08-17T17:34:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.819+0000 7ff789ffb700 1 -- 172.21.15.78:0/340542677 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff78c01dd30 con 0x7ff794157be0 2023-08-17T17:34:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.819+0000 7ff789ffb700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff77805ed90 0x7ff778061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.820+0000 7ff789ffb700 1 -- 172.21.15.78:0/340542677 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff78c07b7d0 con 0x7ff794157be0 2023-08-17T17:34:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.820+0000 7ff799dd9700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff77805ed90 0x7ff778061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.820+0000 7ff799dd9700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff77805ed90 0x7ff778061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff790006fd0 tx=0x7ff790006f40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.824+0000 7ff789ffb700 1 -- 172.21.15.78:0/340542677 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff78c04cfb0 con 0x7ff794157be0 2023-08-17T17:34:19.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.986+0000 7ff79addb700 1 -- 172.21.15.78:0/340542677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff79405f910 con 0x7ff794157be0 2023-08-17T17:34:19.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.986+0000 7ff789ffb700 1 -- 172.21.15.78:0/340542677 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff78c009880 con 0x7ff794157be0 2023-08-17T17:34:19.987 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:34:19.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 -- 172.21.15.78:0/340542677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff77805ed90 msgr2=0x7ff778061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff77805ed90 0x7ff778061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff790006fd0 tx=0x7ff790006f40).stop 2023-08-17T17:34:19.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 -- 172.21.15.78:0/340542677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff794157be0 msgr2=0x7ff7940a8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:19.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff794157be0 0x7ff7940a8a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff78c00b610 tx=0x7ff78c009780).stop 2023-08-17T17:34:19.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 -- 172.21.15.78:0/340542677 shutdown_connections 2023-08-17T17:34:19.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff77805ed90 0x7ff778061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff794157be0 0x7ff7940a8a40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff794151a40 0x7ff79414c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 --2- 172.21.15.78:0/340542677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff794151e20 0x7ff79414d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:19.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 -- 172.21.15.78:0/340542677 >> 172.21.15.78:0/340542677 conn(0x7ff7940943b0 msgr2=0x7ff794063000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:19.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 -- 172.21.15.78:0/340542677 shutdown_connections 2023-08-17T17:34:19.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:19.988+0000 7ff79addb700 1 -- 172.21.15.78:0/340542677 wait complete. 2023-08-17T17:34:20.000 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:34:20.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.114+0000 7fa5c759e700 1 Processor -- start 2023-08-17T17:34:20.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.114+0000 7fa5c759e700 1 -- start start 2023-08-17T17:34:20.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5c8157be0 0x7fa5c80c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 0x7fa5c813a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c80bc900 con 0x7fa5c8157fc0 2023-08-17T17:34:20.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c81583e0 con 0x7fa5c8157be0 2023-08-17T17:34:20.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c813a950 con 0x7fa5c8139fd0 2023-08-17T17:34:20.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5c8157be0 0x7fa5c80c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c6d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 0x7fa5c813a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c5d9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa5c8157fc0 0x7fa5c80699e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:51498/0 (socket says 172.21.15.78:51498) 2023-08-17T17:34:20.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c5d9b700 1 -- 172.21.15.78:0/3816552046 learned_addr learned my addr 172.21.15.78:0/3816552046 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:20.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c6d9d700 1 -- 172.21.15.78:0/3816552046 >> v2:172.21.15.150:3300/0 conn(0x7fa5c8157be0 msgr2=0x7fa5c80c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:20.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c6d9d700 1 --2- 172.21.15.78:0/3816552046 >> v2:172.21.15.150:3300/0 conn(0x7fa5c8157be0 0x7fa5c80c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.115+0000 7fa5c6d9d700 1 -- 172.21.15.78:0/3816552046 >> v1:172.21.15.150:6789/0 conn(0x7fa5c8157fc0 legacy=0x7fa5c80699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c6d9d700 1 -- 172.21.15.78:0/3816552046 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c80c55a0 con 0x7fa5c8139fd0 2023-08-17T17:34:20.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c659c700 1 --2- 172.21.15.78:0/3816552046 >> v2:172.21.15.150:3300/0 conn(0x7fa5c8157be0 0x7fa5c80c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:20.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c6d9d700 1 --2- 172.21.15.78:0/3816552046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 0x7fa5c813a460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa5b8009760 tx=0x7fa5b8009060).ready entity=mon.2 client_cookie=2f216bfeb9ed26b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:20.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c559a700 1 -- 172.21.15.78:0/3816552046 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800f510 con 0x7fa5c8139fd0 2023-08-17T17:34:20.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c559a700 1 -- 172.21.15.78:0/3816552046 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b800f670 con 0x7fa5c8139fd0 2023-08-17T17:34:20.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c559a700 1 -- 172.21.15.78:0/3816552046 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800f9f0 con 0x7fa5c8139fd0 2023-08-17T17:34:20.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c759e700 1 -- 172.21.15.78:0/3816552046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 msgr2=0x7fa5c813a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c759e700 1 --2- 172.21.15.78:0/3816552046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 0x7fa5c813a460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa5b8009760 tx=0x7fa5b8009060).stop 2023-08-17T17:34:20.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c759e700 1 -- 172.21.15.78:0/3816552046 shutdown_connections 2023-08-17T17:34:20.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c759e700 1 --2- 172.21.15.78:0/3816552046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 0x7fa5c813a460 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c759e700 1 --2- 172.21.15.78:0/3816552046 >> v2:172.21.15.150:3300/0 conn(0x7fa5c8157be0 0x7fa5c80c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c759e700 1 -- 172.21.15.78:0/3816552046 >> 172.21.15.78:0/3816552046 conn(0x7fa5c80c4440 msgr2=0x7fa5c80c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c759e700 1 -- 172.21.15.78:0/3816552046 shutdown_connections 2023-08-17T17:34:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.116+0000 7fa5c759e700 1 -- 172.21.15.78:0/3816552046 wait complete. 2023-08-17T17:34:20.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c759e700 1 Processor -- start 2023-08-17T17:34:20.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c759e700 1 -- start start 2023-08-17T17:34:20.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 0x7fa5c8164040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8157be0 0x7fa5c80a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c8157fc0 0x7fa5c80a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80bf610 con 0x7fa5c8157be0 2023-08-17T17:34:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8164530 con 0x7fa5c8157fc0 2023-08-17T17:34:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80bea40 con 0x7fa5c8139fd0 2023-08-17T17:34:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8157be0 0x7fa5c80a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8157be0 0x7fa5c80a8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54024/0 (socket says 172.21.15.78:54024) 2023-08-17T17:34:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.118+0000 7fa5c5d9b700 1 -- 172.21.15.78:0/1911958108 learned_addr learned my addr 172.21.15.78:0/1911958108 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5c6d9d700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c8157fc0 0x7fa5c80a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5c659c700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 0x7fa5c8164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5c5d9b700 1 -- 172.21.15.78:0/1911958108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 msgr2=0x7fa5c8164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5c5d9b700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 0x7fa5c8164040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5c5d9b700 1 -- 172.21.15.78:0/1911958108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c8157fc0 msgr2=0x7fa5c80a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5c5d9b700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c8157fc0 0x7fa5c80a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5c5d9b700 1 -- 172.21.15.78:0/1911958108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0009a20 con 0x7fa5c8157be0 2023-08-17T17:34:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5c5d9b700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8157be0 0x7fa5c80a8e60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa5b000c410 tx=0x7fa5b0007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5be7fc700 1 -- 172.21.15.78:0/1911958108 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00070d0 con 0x7fa5c8157be0 2023-08-17T17:34:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5be7fc700 1 -- 172.21.15.78:0/1911958108 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0007230 con 0x7fa5c8157be0 2023-08-17T17:34:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5c759e700 1 -- 172.21.15.78:0/1911958108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b80092a0 con 0x7fa5c8157be0 2023-08-17T17:34:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5be7fc700 1 -- 172.21.15.78:0/1911958108 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00075d0 con 0x7fa5c8157be0 2023-08-17T17:34:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.119+0000 7fa5c759e700 1 -- 172.21.15.78:0/1911958108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c80bf040 con 0x7fa5c8157be0 2023-08-17T17:34:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.120+0000 7fa5c759e700 1 -- 172.21.15.78:0/1911958108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c80bf7c0 con 0x7fa5c8157be0 2023-08-17T17:34:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.120+0000 7fa5be7fc700 1 -- 172.21.15.78:0/1911958108 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa5b0010070 con 0x7fa5c8157be0 2023-08-17T17:34:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.121+0000 7fa5be7fc700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa5a805ed90 0x7fa5a8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.121+0000 7fa5c659c700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa5a805ed90 0x7fa5a8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.121+0000 7fa5be7fc700 1 -- 172.21.15.78:0/1911958108 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa5b0078cb0 con 0x7fa5c8157be0 2023-08-17T17:34:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.121+0000 7fa5c659c700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa5a805ed90 0x7fa5a8061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa5c0009fd0 tx=0x7fa5c000b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.125+0000 7fa5be7fc700 1 -- 172.21.15.78:0/1911958108 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5c80bf7c0 con 0x7fa5c8157be0 2023-08-17T17:34:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.329+0000 7fa5c759e700 1 -- 172.21.15.78:0/1911958108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5c80bf7c0 con 0x7fa5c8157be0 2023-08-17T17:34:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.330+0000 7fa5be7fc700 1 -- 172.21.15.78:0/1911958108 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fa5c80bf7c0 con 0x7fa5c8157be0 2023-08-17T17:34:20.331 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:20.331 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4150014676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4150014676},{"type":"v1","addr":"172.21.15.150:6834","nonce":4150014676}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1895700227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1895700227},{"type":"v1","addr":"172.21.15.150:6835","nonce":1895700227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3007671664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3007671664},{"type":"v1","addr":"172.21.15.78:6835","nonce":3007671664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2283193122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2283193122},{"type":"v1","addr":"172.21.15.78:6837","nonce":2283193122}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-08-17T17:34:20.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 -- 172.21.15.78:0/1911958108 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa5a805ed90 msgr2=0x7fa5a8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa5a805ed90 0x7fa5a8061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa5c0009fd0 tx=0x7fa5c000b040).stop 2023-08-17T17:34:20.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 -- 172.21.15.78:0/1911958108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8157be0 msgr2=0x7fa5c80a8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8157be0 0x7fa5c80a8e60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa5b000c410 tx=0x7fa5b0007e50).stop 2023-08-17T17:34:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 -- 172.21.15.78:0/1911958108 shutdown_connections 2023-08-17T17:34:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa5a805ed90 0x7fa5a8061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c8157fc0 0x7fa5c80a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5c8139fd0 0x7fa5c8164040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 --2- 172.21.15.78:0/1911958108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8157be0 0x7fa5c80a8e60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 -- 172.21.15.78:0/1911958108 >> 172.21.15.78:0/1911958108 conn(0x7fa5c80c4440 msgr2=0x7fa5c8063a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:20.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 -- 172.21.15.78:0/1911958108 shutdown_connections 2023-08-17T17:34:20.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.332+0000 7fa5c759e700 1 -- 172.21.15.78:0/1911958108 wait complete. 2023-08-17T17:34:20.334 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2023-08-17T17:34:20.344 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:20.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.456+0000 7fa489f5a700 1 Processor -- start 2023-08-17T17:34:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.456+0000 7fa489f5a700 1 -- start start 2023-08-17T17:34:20.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa489f5a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4840a7bd0 0x7fa484063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa489f5a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4840a8050 0x7fa4840642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa489f5a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa484063960 con 0x7fa4840c01b0 2023-08-17T17:34:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa489f5a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa484063030 con 0x7fa4840a7bd0 2023-08-17T17:34:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa489f5a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa484063310 con 0x7fa4840a8050 2023-08-17T17:34:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa483fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4840a7bd0 0x7fa484063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa488f58700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa4840c01b0 0x7fa4840c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36260/0 (socket says 172.21.15.78:36260) 2023-08-17T17:34:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa488f58700 1 -- 172.21.15.78:0/1241398000 learned_addr learned my addr 172.21.15.78:0/1241398000 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa483fff700 1 -- 172.21.15.78:0/1241398000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4840a8050 msgr2=0x7fa4840642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa489759700 1 --2- 172.21.15.78:0/1241398000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4840a8050 0x7fa4840642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa483fff700 1 --2- 172.21.15.78:0/1241398000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4840a8050 0x7fa4840642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa483fff700 1 -- 172.21.15.78:0/1241398000 >> v1:172.21.15.78:6789/0 conn(0x7fa4840c01b0 legacy=0x7fa4840c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa483fff700 1 -- 172.21.15.78:0/1241398000 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840635f0 con 0x7fa4840a7bd0 2023-08-17T17:34:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa4837fe700 1 -- 172.21.15.78:0/1241398000 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630661675 0 0) 0x7fa484063960 con 0x7fa4840c01b0 2023-08-17T17:34:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa483fff700 1 --2- 172.21.15.78:0/1241398000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a7bd0 0x7fa484063df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa46c009760 tx=0x7fa46c009060).ready entity=mon.0 client_cookie=a78732f41c2a4f90 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.457+0000 7fa4837fe700 1 -- 172.21.15.78:0/1241398000 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c00b580 con 0x7fa4840a7bd0 2023-08-17T17:34:20.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.458+0000 7fa4837fe700 1 -- 172.21.15.78:0/1241398000 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c00b6e0 con 0x7fa4840a7bd0 2023-08-17T17:34:20.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.458+0000 7fa4837fe700 1 -- 172.21.15.78:0/1241398000 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c00ba60 con 0x7fa4840a7bd0 2023-08-17T17:34:20.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.458+0000 7fa489f5a700 1 -- 172.21.15.78:0/1241398000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a7bd0 msgr2=0x7fa484063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.458+0000 7fa489f5a700 1 --2- 172.21.15.78:0/1241398000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a7bd0 0x7fa484063df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa46c009760 tx=0x7fa46c009060).stop 2023-08-17T17:34:20.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.458+0000 7fa489f5a700 1 -- 172.21.15.78:0/1241398000 shutdown_connections 2023-08-17T17:34:20.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.458+0000 7fa489f5a700 1 --2- 172.21.15.78:0/1241398000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4840a8050 0x7fa4840642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.458+0000 7fa489f5a700 1 --2- 172.21.15.78:0/1241398000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a7bd0 0x7fa484063df0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.458+0000 7fa489f5a700 1 -- 172.21.15.78:0/1241398000 >> 172.21.15.78:0/1241398000 conn(0x7fa48406a6c0 msgr2=0x7fa4840cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:20.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.458+0000 7fa489f5a700 1 -- 172.21.15.78:0/1241398000 shutdown_connections 2023-08-17T17:34:20.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.458+0000 7fa489f5a700 1 -- 172.21.15.78:0/1241398000 wait complete. 2023-08-17T17:34:20.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.459+0000 7fa489f5a700 1 Processor -- start 2023-08-17T17:34:20.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.459+0000 7fa489f5a700 1 -- start start 2023-08-17T17:34:20.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa489f5a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4840a7bd0 0x7fa4841656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa489f5a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a8050 0x7fa4841672a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa489f5a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4840c01b0 0x7fa4840aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa489f5a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840aee70 con 0x7fa4840a8050 2023-08-17T17:34:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa489f5a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840af710 con 0x7fa4840a7bd0 2023-08-17T17:34:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa489f5a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa484165bb0 con 0x7fa4840c01b0 2023-08-17T17:34:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa483fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a8050 0x7fa4841672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa483fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a8050 0x7fa4841672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54028/0 (socket says 172.21.15.78:54028) 2023-08-17T17:34:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa483fff700 1 -- 172.21.15.78:0/2142079478 learned_addr learned my addr 172.21.15.78:0/2142079478 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa489759700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4840c01b0 0x7fa4840aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa488f58700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4840a7bd0 0x7fa4841656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa483fff700 1 -- 172.21.15.78:0/2142079478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4840c01b0 msgr2=0x7fa4840aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa483fff700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4840c01b0 0x7fa4840aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa483fff700 1 -- 172.21.15.78:0/2142079478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4840a7bd0 msgr2=0x7fa4841656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa483fff700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4840a7bd0 0x7fa4841656c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.460+0000 7fa483fff700 1 -- 172.21.15.78:0/2142079478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c0092a0 con 0x7fa4840a8050 2023-08-17T17:34:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.461+0000 7fa483fff700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a8050 0x7fa4841672a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa46c006df0 tx=0x7fa46c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.461+0000 7fa480ff9700 1 -- 172.21.15.78:0/2142079478 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c00b850 con 0x7fa4840a8050 2023-08-17T17:34:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.461+0000 7fa480ff9700 1 -- 172.21.15.78:0/2142079478 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c00b9b0 con 0x7fa4840a8050 2023-08-17T17:34:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.461+0000 7fa480ff9700 1 -- 172.21.15.78:0/2142079478 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c01b660 con 0x7fa4840a8050 2023-08-17T17:34:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.461+0000 7fa489f5a700 1 -- 172.21.15.78:0/2142079478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4840ad6a0 con 0x7fa4840a8050 2023-08-17T17:34:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.461+0000 7fa489f5a700 1 -- 172.21.15.78:0/2142079478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4840af3a0 con 0x7fa4840a8050 2023-08-17T17:34:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.462+0000 7fa489f5a700 1 -- 172.21.15.78:0/2142079478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa484083af0 con 0x7fa4840a8050 2023-08-17T17:34:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.462+0000 7fa480ff9700 1 -- 172.21.15.78:0/2142079478 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa46c02b070 con 0x7fa4840a8050 2023-08-17T17:34:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.462+0000 7fa480ff9700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa46405ed90 0x7fa464061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.462+0000 7fa480ff9700 1 -- 172.21.15.78:0/2142079478 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa46c07b180 con 0x7fa4840a8050 2023-08-17T17:34:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.462+0000 7fa488f58700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa46405ed90 0x7fa464061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.463+0000 7fa488f58700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa46405ed90 0x7fa464061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa47c001a90 tx=0x7fa47c0014d0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.467+0000 7fa480ff9700 1 -- 172.21.15.78:0/2142079478 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa46c04ca70 con 0x7fa4840a8050 2023-08-17T17:34:20.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.632+0000 7fa489f5a700 1 -- 172.21.15.78:0/2142079478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4840c63e0 con 0x7fa4840a8050 2023-08-17T17:34:20.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.633+0000 7fa480ff9700 1 -- 172.21.15.78:0/2142079478 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13757 (secure 0 0 0) 0x7fa46c01f090 con 0x7fa4840a8050 2023-08-17T17:34:20.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:20.634 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:20.055978+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:20.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 -- 172.21.15.78:0/2142079478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa46405ed90 msgr2=0x7fa464061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa46405ed90 0x7fa464061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa47c001a90 tx=0x7fa47c0014d0).stop 2023-08-17T17:34:20.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 -- 172.21.15.78:0/2142079478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a8050 msgr2=0x7fa4841672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a8050 0x7fa4841672a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa46c006df0 tx=0x7fa46c017000).stop 2023-08-17T17:34:20.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 -- 172.21.15.78:0/2142079478 shutdown_connections 2023-08-17T17:34:20.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa46405ed90 0x7fa464061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4840c01b0 0x7fa4840aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4840a7bd0 0x7fa4841656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 --2- 172.21.15.78:0/2142079478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4840a8050 0x7fa4841672a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 -- 172.21.15.78:0/2142079478 >> 172.21.15.78:0/2142079478 conn(0x7fa48406a6c0 msgr2=0x7fa4840a9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:20.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 -- 172.21.15.78:0/2142079478 shutdown_connections 2023-08-17T17:34:20.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.635+0000 7fa489f5a700 1 -- 172.21.15.78:0/2142079478 wait complete. 2023-08-17T17:34:20.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T17:34:20.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:34:20.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.764+0000 7fc2d7fff700 1 Processor -- start 2023-08-17T17:34:20.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.764+0000 7fc2d7fff700 1 -- start start 2023-08-17T17:34:20.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc2d8062cd0 0x7fc2d8064a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d7fff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d8155400 con 0x7fc2d80c4790 2023-08-17T17:34:20.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d7fff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d80c30d0 con 0x7fc2d80c5a10 2023-08-17T17:34:20.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d7fff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d81547f0 con 0x7fc2d8062cd0 2023-08-17T17:34:20.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d6ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc2d80c4790 0x7fc2d80c5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36262/0 (socket says 172.21.15.78:36262) 2023-08-17T17:34:20.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d6ffd700 1 -- 172.21.15.78:0/1085689536 learned_addr learned my addr 172.21.15.78:0/1085689536 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:20.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d77fe700 1 --2- 172.21.15.78:0/1085689536 >> v2:172.21.15.78:3300/0 conn(0x7fc2d8062cd0 0x7fc2d8064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d67fc700 1 -- 172.21.15.78:0/1085689536 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392020855 0 0) 0x7fc2d8155400 con 0x7fc2d80c4790 2023-08-17T17:34:20.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d67fc700 1 -- 172.21.15.78:0/1085689536 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2c40033f0 con 0x7fc2d80c4790 2023-08-17T17:34:20.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d77fe700 1 -- 172.21.15.78:0/1085689536 >> v1:172.21.15.150:6789/0 conn(0x7fc2d80c5a10 legacy=0x7fc2d8151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:20.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d77fe700 1 -- 172.21.15.78:0/1085689536 >> v1:172.21.15.78:6789/0 conn(0x7fc2d80c4790 legacy=0x7fc2d80c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d77fe700 1 -- 172.21.15.78:0/1085689536 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8154ad0 con 0x7fc2d8062cd0 2023-08-17T17:34:20.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.765+0000 7fc2d77fe700 1 --2- 172.21.15.78:0/1085689536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8062cd0 0x7fc2d8064a90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc2d0009e60 tx=0x7fc2d0009780).ready entity=mon.0 client_cookie=5ca569076c90984c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:20.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.766+0000 7fc2d67fc700 1 -- 172.21.15.78:0/1085689536 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d000e070 con 0x7fc2d8062cd0 2023-08-17T17:34:20.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.766+0000 7fc2d67fc700 1 -- 172.21.15.78:0/1085689536 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d000bb60 con 0x7fc2d8062cd0 2023-08-17T17:34:20.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.766+0000 7fc2d67fc700 1 -- 172.21.15.78:0/1085689536 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0012410 con 0x7fc2d8062cd0 2023-08-17T17:34:20.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.766+0000 7fc2d7fff700 1 -- 172.21.15.78:0/1085689536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8062cd0 msgr2=0x7fc2d8064a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.766+0000 7fc2d7fff700 1 --2- 172.21.15.78:0/1085689536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8062cd0 0x7fc2d8064a90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc2d0009e60 tx=0x7fc2d0009780).stop 2023-08-17T17:34:20.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.766+0000 7fc2d7fff700 1 -- 172.21.15.78:0/1085689536 shutdown_connections 2023-08-17T17:34:20.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.766+0000 7fc2d7fff700 1 --2- 172.21.15.78:0/1085689536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8062cd0 0x7fc2d8064a90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.766+0000 7fc2d7fff700 1 -- 172.21.15.78:0/1085689536 >> 172.21.15.78:0/1085689536 conn(0x7fc2d806a660 msgr2=0x7fc2d80921a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:20.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.766+0000 7fc2d7fff700 1 -- 172.21.15.78:0/1085689536 shutdown_connections 2023-08-17T17:34:20.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.766+0000 7fc2d7fff700 1 -- 172.21.15.78:0/1085689536 wait complete. 2023-08-17T17:34:20.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.767+0000 7fc2d7fff700 1 Processor -- start 2023-08-17T17:34:20.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.767+0000 7fc2d7fff700 1 -- start start 2023-08-17T17:34:20.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2d7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2d8062cd0 0x7fc2d80c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d80c4790 0x7fc2d80ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2d7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d80c5a10 0x7fc2d80a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2d7fff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8153320 con 0x7fc2d80c4790 2023-08-17T17:34:20.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2d7fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80a9510 con 0x7fc2d80c5a10 2023-08-17T17:34:20.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2d7fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80acb50 con 0x7fc2d8062cd0 2023-08-17T17:34:20.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2ce7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d80c4790 0x7fc2d80ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2ce7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d80c4790 0x7fc2d80ac660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54046/0 (socket says 172.21.15.78:54046) 2023-08-17T17:34:20.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2ce7fc700 1 -- 172.21.15.78:0/829444441 learned_addr learned my addr 172.21.15.78:0/829444441 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:20.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2d77fe700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d80c5a10 0x7fc2d80a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2d6ffd700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2d8062cd0 0x7fc2d80c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2ce7fc700 1 -- 172.21.15.78:0/829444441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2d8062cd0 msgr2=0x7fc2d80c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2ce7fc700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2d8062cd0 0x7fc2d80c2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2ce7fc700 1 -- 172.21.15.78:0/829444441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d80c5a10 msgr2=0x7fc2d80a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.768+0000 7fc2ce7fc700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d80c5a10 0x7fc2d80a6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.769+0000 7fc2ce7fc700 1 -- 172.21.15.78:0/829444441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0009a20 con 0x7fc2d80c4790 2023-08-17T17:34:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.769+0000 7fc2ce7fc700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d80c4790 0x7fc2d80ac660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc2c000c490 tx=0x7fc2c0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.769+0000 7fc2cf7fe700 1 -- 172.21.15.78:0/829444441 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c000f470 con 0x7fc2d80c4790 2023-08-17T17:34:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.769+0000 7fc2cf7fe700 1 -- 172.21.15.78:0/829444441 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c000f5d0 con 0x7fc2d80c4790 2023-08-17T17:34:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.769+0000 7fc2d7fff700 1 -- 172.21.15.78:0/829444441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d80a8900 con 0x7fc2d80c4790 2023-08-17T17:34:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.769+0000 7fc2cf7fe700 1 -- 172.21.15.78:0/829444441 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c000f990 con 0x7fc2d80c4790 2023-08-17T17:34:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.769+0000 7fc2d7fff700 1 -- 172.21.15.78:0/829444441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d80a8ec0 con 0x7fc2d80c4790 2023-08-17T17:34:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.770+0000 7fc2d7fff700 1 -- 172.21.15.78:0/829444441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d805f910 con 0x7fc2d80c4790 2023-08-17T17:34:20.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.770+0000 7fc2cf7fe700 1 -- 172.21.15.78:0/829444441 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc2c0019030 con 0x7fc2d80c4790 2023-08-17T17:34:20.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.770+0000 7fc2cf7fe700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc2b805ed90 0x7fc2b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:20.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.771+0000 7fc2cf7fe700 1 -- 172.21.15.78:0/829444441 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc2c0078b30 con 0x7fc2d80c4790 2023-08-17T17:34:20.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.771+0000 7fc2d6ffd700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc2b805ed90 0x7fc2b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:20.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.771+0000 7fc2d6ffd700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc2b805ed90 0x7fc2b8061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc2c8001360 tx=0x7fc2c8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:20.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.774+0000 7fc2cf7fe700 1 -- 172.21.15.78:0/829444441 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc2c00488f0 con 0x7fc2d80c4790 2023-08-17T17:34:20.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.936+0000 7fc2d7fff700 1 -- 172.21.15.78:0/829444441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc2d8154db0 con 0x7fc2d80c4790 2023-08-17T17:34:20.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.937+0000 7fc2cf7fe700 1 -- 172.21.15.78:0/829444441 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc2c0017030 con 0x7fc2d80c4790 2023-08-17T17:34:20.938 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:34:20.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.938+0000 7fc2d7fff700 1 -- 172.21.15.78:0/829444441 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc2b805ed90 msgr2=0x7fc2b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.938+0000 7fc2d7fff700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc2b805ed90 0x7fc2b8061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc2c8001360 tx=0x7fc2c8009040).stop 2023-08-17T17:34:20.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.938+0000 7fc2d7fff700 1 -- 172.21.15.78:0/829444441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d80c4790 msgr2=0x7fc2d80ac660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.938+0000 7fc2d7fff700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d80c4790 0x7fc2d80ac660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc2c000c490 tx=0x7fc2c0007db0).stop 2023-08-17T17:34:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.939+0000 7fc2d7fff700 1 -- 172.21.15.78:0/829444441 shutdown_connections 2023-08-17T17:34:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.939+0000 7fc2d7fff700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc2b805ed90 0x7fc2b8061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.939+0000 7fc2d7fff700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d80c5a10 0x7fc2d80a6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.939+0000 7fc2d7fff700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2d8062cd0 0x7fc2d80c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.939+0000 7fc2d7fff700 1 --2- 172.21.15.78:0/829444441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d80c4790 0x7fc2d80ac660 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.939+0000 7fc2d7fff700 1 -- 172.21.15.78:0/829444441 >> 172.21.15.78:0/829444441 conn(0x7fc2d806a660 msgr2=0x7fc2d8067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:20.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.939+0000 7fc2d7fff700 1 -- 172.21.15.78:0/829444441 shutdown_connections 2023-08-17T17:34:20.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:20.939+0000 7fc2d7fff700 1 -- 172.21.15.78:0/829444441 wait complete. 2023-08-17T17:34:20.951 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:34:21.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.068+0000 7fd9160d9700 1 Processor -- start 2023-08-17T17:34:21.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.068+0000 7fd9160d9700 1 -- start start 2023-08-17T17:34:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd9160d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9100c5f20 0x7fd9100644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd9160d9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9100649b0 con 0x7fd9100aa0f0 2023-08-17T17:34:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd9160d9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd910063420 con 0x7fd9100aa4d0 2023-08-17T17:34:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd9160d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd910063700 con 0x7fd9100c5f20 2023-08-17T17:34:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd9100aa0f0 0x7fd9100c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36270/0 (socket says 172.21.15.78:36270) 2023-08-17T17:34:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90f7fe700 1 -- 172.21.15.78:0/4094984295 learned_addr learned my addr 172.21.15.78:0/4094984295 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90ffff700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9100c5f20 0x7fd9100644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514365401 0 0) 0x7fd9100649b0 con 0x7fd9100aa0f0 2023-08-17T17:34:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f80033f0 con 0x7fd9100aa0f0 2023-08-17T17:34:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1248825075 0 0) 0x7fd8f80033f0 con 0x7fd9100aa0f0 2023-08-17T17:34:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9100c5f20 msgr2=0x7fd9100644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9100c5f20 0x7fd9100644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 >> v1:172.21.15.150:6789/0 conn(0x7fd9100aa4d0 legacy=0x7fd9100c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9100639e0 con 0x7fd9100aa0f0 2023-08-17T17:34:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fd904001470 con 0x7fd9100aa0f0 2023-08-17T17:34:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 >> v1:172.21.15.78:6789/0 conn(0x7fd9100aa0f0 legacy=0x7fd9100c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9100c5f20 0x7fd8f8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f8003e00 0x7fd8f8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f8004b80 0x7fd8f8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd910063700 con 0x7fd8f8004b80 2023-08-17T17:34:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f800b8e0 con 0x7fd8f8003e00 2023-08-17T17:34:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f800baa0 con 0x7fd9100c5f20 2023-08-17T17:34:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90ffff700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f8004b80 0x7fd8f8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90f7fe700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9100c5f20 0x7fd8f8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.069+0000 7fd90effd700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f8003e00 0x7fd8f8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd90ffff700 1 -- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9100c5f20 msgr2=0x7fd8f8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd90ffff700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9100c5f20 0x7fd8f8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd90ffff700 1 -- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f8003e00 msgr2=0x7fd8f8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd90ffff700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f8003e00 0x7fd8f8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd90ffff700 1 -- 172.21.15.78:0/4094984295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f80033f0 con 0x7fd8f8004b80 2023-08-17T17:34:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd90ffff700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f8004b80 0x7fd8f8005000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd90800e210 tx=0x7fd90800b040).ready entity=mon.0 client_cookie=d768f7657af3e149 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908009ac0 con 0x7fd8f8004b80 2023-08-17T17:34:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90800f040 con 0x7fd8f8004b80 2023-08-17T17:34:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd90e7fc700 1 -- 172.21.15.78:0/4094984295 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800ecd0 con 0x7fd8f8004b80 2023-08-17T17:34:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd9160d9700 1 -- 172.21.15.78:0/4094984295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f8004b80 msgr2=0x7fd8f8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd9160d9700 1 --2- 172.21.15.78:0/4094984295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f8004b80 0x7fd8f8005000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd90800e210 tx=0x7fd90800b040).stop 2023-08-17T17:34:21.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd90ffff700 1 -- 172.21.15.78:0/4094984295 reap_dead start 2023-08-17T17:34:21.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd9160d9700 1 -- 172.21.15.78:0/4094984295 shutdown_connections 2023-08-17T17:34:21.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.070+0000 7fd9160d9700 1 -- 172.21.15.78:0/4094984295 >> 172.21.15.78:0/4094984295 conn(0x7fd91006a6a0 msgr2=0x7fd9100caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:21.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.071+0000 7fd9160d9700 1 -- 172.21.15.78:0/4094984295 shutdown_connections 2023-08-17T17:34:21.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.071+0000 7fd9160d9700 1 -- 172.21.15.78:0/4094984295 wait complete. 2023-08-17T17:34:21.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.072+0000 7fd9160d9700 1 Processor -- start 2023-08-17T17:34:21.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.072+0000 7fd9160d9700 1 -- start start 2023-08-17T17:34:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd9160d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd910151fd0 0x7fd9100c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd9160d9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9100c4c10 0x7fd9100c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd9160d9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9101523b0 0x7fd9100c2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd9160d9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100c2d80 con 0x7fd9101523b0 2023-08-17T17:34:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd9160d9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100c4780 con 0x7fd9100c4c10 2023-08-17T17:34:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd9160d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100c3b70 con 0x7fd910151fd0 2023-08-17T17:34:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9101523b0 0x7fd9100c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9101523b0 0x7fd9100c2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54050/0 (socket says 172.21.15.78:54050) 2023-08-17T17:34:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90ffff700 1 -- 172.21.15.78:0/2878186503 learned_addr learned my addr 172.21.15.78:0/2878186503 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90effd700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9100c4c10 0x7fd9100c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90f7fe700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd910151fd0 0x7fd9100c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90ffff700 1 -- 172.21.15.78:0/2878186503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd910151fd0 msgr2=0x7fd9100c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90ffff700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd910151fd0 0x7fd9100c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90ffff700 1 -- 172.21.15.78:0/2878186503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9100c4c10 msgr2=0x7fd9100c23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90ffff700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9100c4c10 0x7fd9100c23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90ffff700 1 -- 172.21.15.78:0/2878186503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9100c3e50 con 0x7fd9101523b0 2023-08-17T17:34:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90f7fe700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd910151fd0 0x7fd9100c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd90ffff700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9101523b0 0x7fd9100c2890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd8f8004610 tx=0x7fd90801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd8f77fe700 1 -- 172.21.15.78:0/2878186503 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908009ac0 con 0x7fd9101523b0 2023-08-17T17:34:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd8f77fe700 1 -- 172.21.15.78:0/2878186503 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908013c20 con 0x7fd9101523b0 2023-08-17T17:34:21.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd8f77fe700 1 -- 172.21.15.78:0/2878186503 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90801d400 con 0x7fd9101523b0 2023-08-17T17:34:21.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd9160d9700 1 -- 172.21.15.78:0/2878186503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9100c4130 con 0x7fd9101523b0 2023-08-17T17:34:21.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.073+0000 7fd9160d9700 1 -- 172.21.15.78:0/2878186503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9100c2070 con 0x7fd9101523b0 2023-08-17T17:34:21.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.074+0000 7fd9160d9700 1 -- 172.21.15.78:0/2878186503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9100c4910 con 0x7fd9101523b0 2023-08-17T17:34:21.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.075+0000 7fd8f77fe700 1 -- 172.21.15.78:0/2878186503 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd90801d770 con 0x7fd9101523b0 2023-08-17T17:34:21.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.075+0000 7fd8f77fe700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8fc05ed60 0x7fd8fc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.075+0000 7fd8f77fe700 1 -- 172.21.15.78:0/2878186503 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd90807b020 con 0x7fd9101523b0 2023-08-17T17:34:21.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.075+0000 7fd90f7fe700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8fc05ed60 0x7fd8fc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.075+0000 7fd90f7fe700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8fc05ed60 0x7fd8fc061220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd904001120 tx=0x7fd904009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:21.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.079+0000 7fd8f77fe700 1 -- 172.21.15.78:0/2878186503 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd90804c910 con 0x7fd9101523b0 2023-08-17T17:34:21.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.243+0000 7fd9160d9700 1 -- 172.21.15.78:0/2878186503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd910046af0 con 0x7fd9101523b0 2023-08-17T17:34:21.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.243+0000 7fd8f77fe700 1 -- 172.21.15.78:0/2878186503 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd90804ff30 con 0x7fd9101523b0 2023-08-17T17:34:21.244 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:34:21.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 -- 172.21.15.78:0/2878186503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8fc05ed60 msgr2=0x7fd8fc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8fc05ed60 0x7fd8fc061220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd904001120 tx=0x7fd904009040).stop 2023-08-17T17:34:21.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 -- 172.21.15.78:0/2878186503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9101523b0 msgr2=0x7fd9100c2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9101523b0 0x7fd9100c2890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd8f8004610 tx=0x7fd90801a000).stop 2023-08-17T17:34:21.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 -- 172.21.15.78:0/2878186503 shutdown_connections 2023-08-17T17:34:21.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8fc05ed60 0x7fd8fc061220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9101523b0 0x7fd9100c2890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd910151fd0 0x7fd9100c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 --2- 172.21.15.78:0/2878186503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9100c4c10 0x7fd9100c23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 -- 172.21.15.78:0/2878186503 >> 172.21.15.78:0/2878186503 conn(0x7fd91006a6a0 msgr2=0x7fd910152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:21.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 -- 172.21.15.78:0/2878186503 shutdown_connections 2023-08-17T17:34:21.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.245+0000 7fd9160d9700 1 -- 172.21.15.78:0/2878186503 wait complete. 2023-08-17T17:34:21.258 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T17:34:21.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.367+0000 7f55929f1700 1 Processor -- start 2023-08-17T17:34:21.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.368+0000 7f55929f1700 1 -- start start 2023-08-17T17:34:21.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.368+0000 7f55929f1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f558c14f9b0 0x7f558c0bf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55929f1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c066220 0x7f558c0666b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55929f1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558c1532b0 con 0x7f558c152270 2023-08-17T17:34:21.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55929f1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c14fd90 con 0x7f558c14f9b0 2023-08-17T17:34:21.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55929f1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c0bdcd0 con 0x7f558c066220 2023-08-17T17:34:21.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55911ee700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f558c152270 0x7f558c0c4930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36286/0 (socket says 172.21.15.78:36286) 2023-08-17T17:34:21.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55911ee700 1 -- 172.21.15.78:0/2154721216 learned_addr learned my addr 172.21.15.78:0/2154721216 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:21.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943488750 0 0) 0x7f557c001110 con 0x7f558c152270 2023-08-17T17:34:21.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55921f0700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c066220 0x7f558c0666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55780033f0 con 0x7f558c152270 2023-08-17T17:34:21.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55919ef700 1 --2- 172.21.15.78:0/2154721216 >> v2:172.21.15.150:3300/0 conn(0x7f558c14f9b0 0x7f558c0bf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3258550209 0 0) 0x7f55780033f0 con 0x7f558c152270 2023-08-17T17:34:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c066220 msgr2=0x7f558c0666b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c066220 0x7f558c0666b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 >> v2:172.21.15.150:3300/0 conn(0x7f558c14f9b0 msgr2=0x7f558c0bf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 --2- 172.21.15.78:0/2154721216 >> v2:172.21.15.150:3300/0 conn(0x7f558c14f9b0 0x7f558c0bf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c066ba0 con 0x7f558c152270 2023-08-17T17:34:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f557c001600 con 0x7f558c152270 2023-08-17T17:34:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55921f0700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c066220 0x7f558c0666b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 >> v1:172.21.15.78:6789/0 conn(0x7f558c152270 legacy=0x7f558c0c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55780038e0 0x7f5578003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 0x7f5578004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c066220 0x7f5578005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c14fd90 con 0x7f5578004690 2023-08-17T17:34:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c0bdcd0 con 0x7f55780038e0 2023-08-17T17:34:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557800b910 con 0x7f558c066220 2023-08-17T17:34:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55911ee700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 0x7f5578004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55919ef700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55780038e0 0x7f5578003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.369+0000 7f55921f0700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c066220 0x7f5578005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55911ee700 1 -- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c066220 msgr2=0x7f5578005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:21.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55911ee700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c066220 0x7f5578005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55911ee700 1 -- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55780038e0 msgr2=0x7f5578003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:21.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55911ee700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55780038e0 0x7f5578003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55911ee700 1 -- 172.21.15.78:0/2154721216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780033f0 con 0x7f5578004690 2023-08-17T17:34:21.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55911ee700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 0x7f5578004b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f557c00c390 tx=0x7f557c0078d0).ready entity=mon.0 client_cookie=fc7cc6f555e4f897 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c00cc60 con 0x7f5578004690 2023-08-17T17:34:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c00cdc0 con 0x7f5578004690 2023-08-17T17:34:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55909ed700 1 -- 172.21.15.78:0/2154721216 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c007320 con 0x7f5578004690 2023-08-17T17:34:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55929f1700 1 -- 172.21.15.78:0/2154721216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 msgr2=0x7f5578004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55929f1700 1 --2- 172.21.15.78:0/2154721216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 0x7f5578004b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f557c00c390 tx=0x7f557c0078d0).stop 2023-08-17T17:34:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55921f0700 1 -- 172.21.15.78:0/2154721216 reap_dead start 2023-08-17T17:34:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55929f1700 1 -- 172.21.15.78:0/2154721216 shutdown_connections 2023-08-17T17:34:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.370+0000 7f55929f1700 1 -- 172.21.15.78:0/2154721216 >> 172.21.15.78:0/2154721216 conn(0x7f558c0624f0 msgr2=0x7f558c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.371+0000 7f55929f1700 1 -- 172.21.15.78:0/2154721216 shutdown_connections 2023-08-17T17:34:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.371+0000 7f55929f1700 1 -- 172.21.15.78:0/2154721216 wait complete. 2023-08-17T17:34:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55929f1700 1 Processor -- start 2023-08-17T17:34:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55929f1700 1 -- start start 2023-08-17T17:34:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55929f1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 0x7f558c14b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55929f1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c0ae300 0x7f558c0ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55929f1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c0ac230 0x7f558c0ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55929f1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c14c590 con 0x7f5578004690 2023-08-17T17:34:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55929f1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c14def0 con 0x7f558c0ac230 2023-08-17T17:34:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55929f1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c0acba0 con 0x7f558c0ae300 2023-08-17T17:34:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55919ef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 0x7f558c14b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55919ef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 0x7f558c14b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54078/0 (socket says 172.21.15.78:54078) 2023-08-17T17:34:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55919ef700 1 -- 172.21.15.78:0/2410597334 learned_addr learned my addr 172.21.15.78:0/2410597334 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.372+0000 7f55911ee700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c0ae300 0x7f558c0ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55921f0700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c0ac230 0x7f558c0ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55919ef700 1 -- 172.21.15.78:0/2410597334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c0ae300 msgr2=0x7f558c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55919ef700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c0ae300 0x7f558c0ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55919ef700 1 -- 172.21.15.78:0/2410597334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c0ac230 msgr2=0x7f558c0ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55919ef700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c0ac230 0x7f558c0ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55919ef700 1 -- 172.21.15.78:0/2410597334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c14b6a0 con 0x7f5578004690 2023-08-17T17:34:21.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55911ee700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c0ae300 0x7f558c0ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55921f0700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c0ac230 0x7f558c0ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55919ef700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 0x7f558c14b110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5588002630 tx=0x7f5588009710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f5581ffb700 1 -- 172.21.15.78:0/2410597334 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588012450 con 0x7f5578004690 2023-08-17T17:34:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f5581ffb700 1 -- 172.21.15.78:0/2410597334 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55880125b0 con 0x7f5578004690 2023-08-17T17:34:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55929f1700 1 -- 172.21.15.78:0/2410597334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558c14b980 con 0x7f5578004690 2023-08-17T17:34:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f5581ffb700 1 -- 172.21.15.78:0/2410597334 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588012930 con 0x7f5578004690 2023-08-17T17:34:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.373+0000 7f55929f1700 1 -- 172.21.15.78:0/2410597334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558c14bf40 con 0x7f5578004690 2023-08-17T17:34:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.374+0000 7f5581ffb700 1 -- 172.21.15.78:0/2410597334 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5588012d20 con 0x7f5578004690 2023-08-17T17:34:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.374+0000 7f55929f1700 1 -- 172.21.15.78:0/2410597334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558c14c870 con 0x7f5578004690 2023-08-17T17:34:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.374+0000 7f5581ffb700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f557005ed90 0x7f5570061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.374+0000 7f5581ffb700 1 -- 172.21.15.78:0/2410597334 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f558807a7e0 con 0x7f5578004690 2023-08-17T17:34:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.375+0000 7f55911ee700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f557005ed90 0x7f5570061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.375+0000 7f55911ee700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f557005ed90 0x7f5570061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f558c14e6b0 tx=0x7f557c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.379+0000 7f5581ffb700 1 -- 172.21.15.78:0/2410597334 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f558804c0d0 con 0x7f5578004690 2023-08-17T17:34:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.545+0000 7f55929f1700 1 -- 172.21.15.78:0/2410597334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f558c0c37d0 con 0x7f5578004690 2023-08-17T17:34:21.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.545+0000 7f5581ffb700 1 -- 172.21.15.78:0/2410597334 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f558804f6f0 con 0x7f5578004690 2023-08-17T17:34:21.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:21.547 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:34:21.547 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:34:21.548 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T17:34:21.548 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T17:34:21.548 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:34:21.548 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:34:21.548 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T17:34:21.548 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T17:34:21.548 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:34:21.549 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:34:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.547+0000 7f55929f1700 1 -- 172.21.15.78:0/2410597334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f557005ed90 msgr2=0x7f5570061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.547+0000 7f55929f1700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f557005ed90 0x7f5570061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f558c14e6b0 tx=0x7f557c015000).stop 2023-08-17T17:34:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.547+0000 7f55929f1700 1 -- 172.21.15.78:0/2410597334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 msgr2=0x7f558c14b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.547+0000 7f55929f1700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 0x7f558c14b110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5588002630 tx=0x7f5588009710).stop 2023-08-17T17:34:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.547+0000 7f55929f1700 1 -- 172.21.15.78:0/2410597334 shutdown_connections 2023-08-17T17:34:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.547+0000 7f55929f1700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f557005ed90 0x7f5570061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.547+0000 7f55929f1700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c0ac230 0x7f558c0ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.547+0000 7f55929f1700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5578004690 0x7f558c14b110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.547+0000 7f55929f1700 1 --2- 172.21.15.78:0/2410597334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c0ae300 0x7f558c0ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.547+0000 7f55929f1700 1 -- 172.21.15.78:0/2410597334 >> 172.21.15.78:0/2410597334 conn(0x7f558c0624f0 msgr2=0x7f558c0c5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.548+0000 7f55929f1700 1 -- 172.21.15.78:0/2410597334 shutdown_connections 2023-08-17T17:34:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.548+0000 7f55929f1700 1 -- 172.21.15.78:0/2410597334 wait complete. 2023-08-17T17:34:21.560 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T17:34:21.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T17:34:21.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.675+0000 7f256ef1f700 1 Processor -- start 2023-08-17T17:34:21.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.676+0000 7f256ef1f700 1 -- start start 2023-08-17T17:34:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.676+0000 7f256ef1f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f256814ea30 0x7f256806b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256ef1f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25680bd260 con 0x7f2568063600 2023-08-17T17:34:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256ef1f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2568151d70 con 0x7f25680c51b0 2023-08-17T17:34:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256ef1f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2568152050 con 0x7f256814ea30 2023-08-17T17:34:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256e71e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2568063600 0x7f25680bd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36288/0 (socket says 172.21.15.78:36288) 2023-08-17T17:34:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256e71e700 1 -- 172.21.15.78:0/2679893492 learned_addr learned my addr 172.21.15.78:0/2679893492 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256df1d700 1 --2- 172.21.15.78:0/2679893492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f256814ea30 0x7f256806b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256cf1b700 1 -- 172.21.15.78:0/2679893492 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927319600 0 0) 0x7f25680bd260 con 0x7f2568063600 2023-08-17T17:34:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256cf1b700 1 -- 172.21.15.78:0/2679893492 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25540033f0 con 0x7f2568063600 2023-08-17T17:34:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256cf1b700 1 -- 172.21.15.78:0/2679893492 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929006663 0 0) 0x7f25540033f0 con 0x7f2568063600 2023-08-17T17:34:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256df1d700 1 -- 172.21.15.78:0/2679893492 >> v1:172.21.15.150:6789/0 conn(0x7f25680c51b0 legacy=0x7f25681514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256df1d700 1 -- 172.21.15.78:0/2679893492 >> v1:172.21.15.78:6789/0 conn(0x7f2568063600 legacy=0x7f25680bd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256df1d700 1 -- 172.21.15.78:0/2679893492 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568152330 con 0x7f256814ea30 2023-08-17T17:34:21.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256df1d700 1 --2- 172.21.15.78:0/2679893492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f256814ea30 0x7f256806b280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2564009e90 tx=0x7f2564009780).ready entity=mon.2 client_cookie=315f048564c85508 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:21.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256cf1b700 1 -- 172.21.15.78:0/2679893492 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256400e070 con 0x7f256814ea30 2023-08-17T17:34:21.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256cf1b700 1 -- 172.21.15.78:0/2679893492 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256400b850 con 0x7f256814ea30 2023-08-17T17:34:21.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.677+0000 7f256cf1b700 1 -- 172.21.15.78:0/2679893492 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560001470 con 0x7f256814ea30 2023-08-17T17:34:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.678+0000 7f256ef1f700 1 -- 172.21.15.78:0/2679893492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f256814ea30 msgr2=0x7f256806b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.678+0000 7f256ef1f700 1 --2- 172.21.15.78:0/2679893492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f256814ea30 0x7f256806b280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2564009e90 tx=0x7f2564009780).stop 2023-08-17T17:34:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.678+0000 7f256ef1f700 1 -- 172.21.15.78:0/2679893492 shutdown_connections 2023-08-17T17:34:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.678+0000 7f256ef1f700 1 --2- 172.21.15.78:0/2679893492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f256814ea30 0x7f256806b280 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.678+0000 7f256ef1f700 1 -- 172.21.15.78:0/2679893492 >> 172.21.15.78:0/2679893492 conn(0x7f25680c3e20 msgr2=0x7f25680c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.678+0000 7f256ef1f700 1 -- 172.21.15.78:0/2679893492 shutdown_connections 2023-08-17T17:34:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.678+0000 7f256ef1f700 1 -- 172.21.15.78:0/2679893492 wait complete. 2023-08-17T17:34:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.679+0000 7f256ef1f700 1 Processor -- start 2023-08-17T17:34:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.679+0000 7f256ef1f700 1 -- start start 2023-08-17T17:34:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256ef1f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2568063600 0x7f2568143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256ef1f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25680c51b0 0x7f25680c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256ef1f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256814ea30 0x7f25680a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256ef1f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2568144400 con 0x7f256814ea30 2023-08-17T17:34:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256ef1f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680c1850 con 0x7f25680c51b0 2023-08-17T17:34:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256ef1f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25680c0c40 con 0x7f2568063600 2023-08-17T17:34:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256e71e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256814ea30 0x7f25680a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256e71e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256814ea30 0x7f25680a8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54080/0 (socket says 172.21.15.78:54080) 2023-08-17T17:34:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256e71e700 1 -- 172.21.15.78:0/2537886400 learned_addr learned my addr 172.21.15.78:0/2537886400 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256df1d700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2568063600 0x7f2568143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256d71c700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25680c51b0 0x7f25680c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256e71e700 1 -- 172.21.15.78:0/2537886400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2568063600 msgr2=0x7f2568143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256e71e700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2568063600 0x7f2568143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256e71e700 1 -- 172.21.15.78:0/2537886400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25680c51b0 msgr2=0x7f25680c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256e71e700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25680c51b0 0x7f25680c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256e71e700 1 -- 172.21.15.78:0/2537886400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564009a20 con 0x7f256814ea30 2023-08-17T17:34:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.680+0000 7f256e71e700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256814ea30 0x7f25680a8d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f256000c7e0 tx=0x7f2560001a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.681+0000 7f255dffb700 1 -- 172.21.15.78:0/2537886400 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560007170 con 0x7f256814ea30 2023-08-17T17:34:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.681+0000 7f255dffb700 1 -- 172.21.15.78:0/2537886400 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25600072f0 con 0x7f256814ea30 2023-08-17T17:34:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.681+0000 7f256ef1f700 1 -- 172.21.15.78:0/2537886400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25680c0f20 con 0x7f256814ea30 2023-08-17T17:34:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.681+0000 7f255dffb700 1 -- 172.21.15.78:0/2537886400 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600048c0 con 0x7f256814ea30 2023-08-17T17:34:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.681+0000 7f256ef1f700 1 -- 172.21.15.78:0/2537886400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25680c14e0 con 0x7f256814ea30 2023-08-17T17:34:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.682+0000 7f256ef1f700 1 -- 172.21.15.78:0/2537886400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256805f910 con 0x7f256814ea30 2023-08-17T17:34:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.682+0000 7f255dffb700 1 -- 172.21.15.78:0/2537886400 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2560004c30 con 0x7f256814ea30 2023-08-17T17:34:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.682+0000 7f255dffb700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f254c05ed90 0x7f254c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.683+0000 7f255dffb700 1 -- 172.21.15.78:0/2537886400 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2560079320 con 0x7f256814ea30 2023-08-17T17:34:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.683+0000 7f256df1d700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f254c05ed90 0x7f254c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.683+0000 7f256df1d700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f254c05ed90 0x7f254c061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2564009de0 tx=0x7f25680c5050).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.687+0000 7f255dffb700 1 -- 172.21.15.78:0/2537886400 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f256004ac10 con 0x7f256814ea30 2023-08-17T17:34:21.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:21.851+0000 7f256ef1f700 1 -- 172.21.15.78:0/2537886400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f25680c1990 con 0x7f256814ea30 2023-08-17T17:34:22.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.167+0000 7f255dffb700 1 -- 172.21.15.78:0/2537886400 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7f256004e230 con 0x7f256814ea30 2023-08-17T17:34:22.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.173+0000 7f256ef1f700 1 -- 172.21.15.78:0/2537886400 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f254c05ed90 msgr2=0x7f254c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:22.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.173+0000 7f256ef1f700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f254c05ed90 0x7f254c061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2564009de0 tx=0x7f25680c5050).stop 2023-08-17T17:34:22.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.173+0000 7f256ef1f700 1 -- 172.21.15.78:0/2537886400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256814ea30 msgr2=0x7f25680a8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:22.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.173+0000 7f256ef1f700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256814ea30 0x7f25680a8d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f256000c7e0 tx=0x7f2560001a10).stop 2023-08-17T17:34:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.174+0000 7f256ef1f700 1 -- 172.21.15.78:0/2537886400 shutdown_connections 2023-08-17T17:34:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.174+0000 7f256ef1f700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f254c05ed90 0x7f254c061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.174+0000 7f256ef1f700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256814ea30 0x7f25680a8d90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.174+0000 7f256ef1f700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2568063600 0x7f2568143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.174+0000 7f256ef1f700 1 --2- 172.21.15.78:0/2537886400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25680c51b0 0x7f25680c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.174+0000 7f256ef1f700 1 -- 172.21.15.78:0/2537886400 >> 172.21.15.78:0/2537886400 conn(0x7f25680c3e20 msgr2=0x7f2568151080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.174+0000 7f256ef1f700 1 -- 172.21.15.78:0/2537886400 shutdown_connections 2023-08-17T17:34:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.174+0000 7f256ef1f700 1 -- 172.21.15.78:0/2537886400 wait complete. 2023-08-17T17:34:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T17:34:22.188 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T17:34:22.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.306+0000 7ff12ca5c700 1 Processor -- start 2023-08-17T17:34:22.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.306+0000 7ff12ca5c700 1 -- start start 2023-08-17T17:34:22.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.306+0000 7ff12ca5c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff1280c0f10 0x7ff1280c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:22.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.306+0000 7ff12ca5c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1280c7e10 0x7ff1280ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:22.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.306+0000 7ff12ca5c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1280c6970 con 0x7ff128154110 2023-08-17T17:34:22.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.306+0000 7ff12ca5c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1280cac90 con 0x7ff1280c0f10 2023-08-17T17:34:22.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.306+0000 7ff12ca5c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280c6040 con 0x7ff1280c7e10 2023-08-17T17:34:22.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff12659c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff128154110 0x7ff1280c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36292/0 (socket says 172.21.15.78:36292) 2023-08-17T17:34:22.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff12659c700 1 -- 172.21.15.78:0/89731470 learned_addr learned my addr 172.21.15.78:0/89731470 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:22.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102962694 0 0) 0x7ff1280c6970 con 0x7ff128154110 2023-08-17T17:34:22.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1140033f0 con 0x7ff128154110 2023-08-17T17:34:22.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff11dd9b700 1 --2- 172.21.15.78:0/89731470 >> v2:172.21.15.150:3300/0 conn(0x7ff1280c0f10 0x7ff1280c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:22.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff126d9d700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1280c7e10 0x7ff1280ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:22.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3239922131 0 0) 0x7ff1140033f0 con 0x7ff128154110 2023-08-17T17:34:22.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1280c7e10 msgr2=0x7ff1280ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:22.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1280c7e10 0x7ff1280ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:22.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 >> v2:172.21.15.150:3300/0 conn(0x7ff1280c0f10 msgr2=0x7ff1280c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:22.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 --2- 172.21.15.78:0/89731470 >> v2:172.21.15.150:3300/0 conn(0x7ff1280c0f10 0x7ff1280c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:22.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280c6320 con 0x7ff128154110 2023-08-17T17:34:22.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7ff118001470 con 0x7ff128154110 2023-08-17T17:34:22.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff11dd9b700 1 --2- 172.21.15.78:0/89731470 >> v2:172.21.15.150:3300/0 conn(0x7ff1280c0f10 0x7ff1280c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:22.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff126d9d700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1280c7e10 0x7ff1280ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:22.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 >> v1:172.21.15.78:6789/0 conn(0x7ff128154110 legacy=0x7ff1280c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:22.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1140038e0 0x7ff114003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:22.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff114004690 0x7ff114004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:22.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1280c7e10 0x7ff114005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:22.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280cac90 con 0x7ff114004690 2023-08-17T17:34:22.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280c6040 con 0x7ff1140038e0 2023-08-17T17:34:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11400b930 con 0x7ff1280c7e10 2023-08-17T17:34:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff11dd9b700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff114004690 0x7ff114004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff12659c700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1140038e0 0x7ff114003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.307+0000 7ff126d9d700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1280c7e10 0x7ff114005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff11dd9b700 1 -- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1280c7e10 msgr2=0x7ff114005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff11dd9b700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1280c7e10 0x7ff114005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff11dd9b700 1 -- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1140038e0 msgr2=0x7ff114003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff11dd9b700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1140038e0 0x7ff114003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff11dd9b700 1 -- 172.21.15.78:0/89731470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140033f0 con 0x7ff114004690 2023-08-17T17:34:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff11dd9b700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff114004690 0x7ff114004b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ff11000bad0 tx=0x7ff110008040).ready entity=mon.0 client_cookie=5cbdb6b8e358e234 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000b410 con 0x7ff114004690 2023-08-17T17:34:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11000d5d0 con 0x7ff114004690 2023-08-17T17:34:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff125d9b700 1 -- 172.21.15.78:0/89731470 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000d950 con 0x7ff114004690 2023-08-17T17:34:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff12ca5c700 1 -- 172.21.15.78:0/89731470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff114004690 msgr2=0x7ff114004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff12ca5c700 1 --2- 172.21.15.78:0/89731470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff114004690 0x7ff114004b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ff11000bad0 tx=0x7ff110008040).stop 2023-08-17T17:34:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff126d9d700 1 -- 172.21.15.78:0/89731470 reap_dead start 2023-08-17T17:34:22.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff12ca5c700 1 -- 172.21.15.78:0/89731470 shutdown_connections 2023-08-17T17:34:22.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff12ca5c700 1 -- 172.21.15.78:0/89731470 >> 172.21.15.78:0/89731470 conn(0x7ff128094650 msgr2=0x7ff12806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:22.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff12ca5c700 1 -- 172.21.15.78:0/89731470 shutdown_connections 2023-08-17T17:34:22.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.308+0000 7ff12ca5c700 1 -- 172.21.15.78:0/89731470 wait complete. 2023-08-17T17:34:22.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.309+0000 7ff12ca5c700 1 Processor -- start 2023-08-17T17:34:22.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff12ca5c700 1 -- start start 2023-08-17T17:34:22.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff12ca5c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff114004690 0x7ff12814efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:22.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff12ca5c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1280c2b00 0x7ff1280c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:22.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff12ca5c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff128150da0 0x7ff128151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:22.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff12ca5c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280adf10 con 0x7ff1280c2b00 2023-08-17T17:34:22.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff12ca5c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280aed70 con 0x7ff128150da0 2023-08-17T17:34:22.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff12ca5c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280ae160 con 0x7ff114004690 2023-08-17T17:34:22.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff11dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1280c2b00 0x7ff1280c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:22.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff11dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1280c2b00 0x7ff1280c2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54098/0 (socket says 172.21.15.78:54098) 2023-08-17T17:34:22.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff11dd9b700 1 -- 172.21.15.78:0/3269237511 learned_addr learned my addr 172.21.15.78:0/3269237511 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:22.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff12659c700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff114004690 0x7ff12814efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:22.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.310+0000 7ff126d9d700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff128150da0 0x7ff128151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:22.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff11dd9b700 1 -- 172.21.15.78:0/3269237511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff114004690 msgr2=0x7ff12814efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:22.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff11dd9b700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff114004690 0x7ff12814efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:22.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff11dd9b700 1 -- 172.21.15.78:0/3269237511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff128150da0 msgr2=0x7ff128151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:22.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff11dd9b700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff128150da0 0x7ff128151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:22.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff11dd9b700 1 -- 172.21.15.78:0/3269237511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280ae440 con 0x7ff1280c2b00 2023-08-17T17:34:22.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff11dd9b700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1280c2b00 0x7ff1280c2f80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ff110012fd0 tx=0x7ff110008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:22.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff11effd700 1 -- 172.21.15.78:0/3269237511 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000d740 con 0x7ff1280c2b00 2023-08-17T17:34:22.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff11effd700 1 -- 172.21.15.78:0/3269237511 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff110021070 con 0x7ff1280c2b00 2023-08-17T17:34:22.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff12ca5c700 1 -- 172.21.15.78:0/3269237511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1280ae720 con 0x7ff1280c2b00 2023-08-17T17:34:22.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff11effd700 1 -- 172.21.15.78:0/3269237511 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000d8a0 con 0x7ff1280c2b00 2023-08-17T17:34:22.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.311+0000 7ff12ca5c700 1 -- 172.21.15.78:0/3269237511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12814f4a0 con 0x7ff1280c2b00 2023-08-17T17:34:22.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.312+0000 7ff12ca5c700 1 -- 172.21.15.78:0/3269237511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1280aebc0 con 0x7ff1280c2b00 2023-08-17T17:34:22.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.312+0000 7ff11effd700 1 -- 172.21.15.78:0/3269237511 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff11002d070 con 0x7ff1280c2b00 2023-08-17T17:34:22.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.313+0000 7ff11effd700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff10805ed90 0x7ff108061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:22.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.313+0000 7ff11effd700 1 -- 172.21.15.78:0/3269237511 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7ff11007ad90 con 0x7ff1280c2b00 2023-08-17T17:34:22.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.313+0000 7ff12659c700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff10805ed90 0x7ff108061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:22.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.313+0000 7ff12659c700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff10805ed90 0x7ff108061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff118007d30 tx=0x7ff118001e90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:22.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.317+0000 7ff11effd700 1 -- 172.21.15.78:0/3269237511 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff11004c510 con 0x7ff1280c2b00 2023-08-17T17:34:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:22.478+0000 7ff12ca5c700 1 -- 172.21.15.78:0/3269237511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff1280aef00 con 0x7ff1280c2b00 2023-08-17T17:34:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.168+0000 7ff11effd700 1 -- 172.21.15.78:0/3269237511 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff11002b030 con 0x7ff1280c2b00 2023-08-17T17:34:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.172+0000 7ff12ca5c700 1 -- 172.21.15.78:0/3269237511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff10805ed90 msgr2=0x7ff108061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.172+0000 7ff12ca5c700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff10805ed90 0x7ff108061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff118007d30 tx=0x7ff118001e90).stop 2023-08-17T17:34:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.172+0000 7ff12ca5c700 1 -- 172.21.15.78:0/3269237511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1280c2b00 msgr2=0x7ff1280c2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.172+0000 7ff12ca5c700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1280c2b00 0x7ff1280c2f80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ff110012fd0 tx=0x7ff110008040).stop 2023-08-17T17:34:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.173+0000 7ff12ca5c700 1 -- 172.21.15.78:0/3269237511 shutdown_connections 2023-08-17T17:34:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.173+0000 7ff12ca5c700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff10805ed90 0x7ff108061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.173+0000 7ff12ca5c700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff128150da0 0x7ff128151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.173+0000 7ff12ca5c700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff114004690 0x7ff12814efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.173+0000 7ff12ca5c700 1 --2- 172.21.15.78:0/3269237511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1280c2b00 0x7ff1280c2f80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.173+0000 7ff12ca5c700 1 -- 172.21.15.78:0/3269237511 >> 172.21.15.78:0/3269237511 conn(0x7ff128094650 msgr2=0x7ff1280c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.173+0000 7ff12ca5c700 1 -- 172.21.15.78:0/3269237511 shutdown_connections 2023-08-17T17:34:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.173+0000 7ff12ca5c700 1 -- 172.21.15.78:0/3269237511 wait complete. 2023-08-17T17:34:23.181 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T17:34:23.199 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T17:34:23.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.314+0000 7f54a6e89700 1 Processor -- start 2023-08-17T17:34:23.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.314+0000 7f54a6e89700 1 -- start start 2023-08-17T17:34:23.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a6e89700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f54a00aa0f0 0x7f54a00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a6e89700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54a00c5810 0x7f54a00c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a6e89700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00649b0 con 0x7f54a00aa4d0 2023-08-17T17:34:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a6e89700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a00c6170 con 0x7f54a00aa0f0 2023-08-17T17:34:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a6e89700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a0063420 con 0x7f54a00c5810 2023-08-17T17:34:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a4c25700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f54a00aa0f0 0x7f54a00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a4c25700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f54a00aa0f0 0x7f54a00644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54106/0 (socket says 172.21.15.78:54106) 2023-08-17T17:34:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a4c25700 1 -- 172.21.15.78:0/4016005961 learned_addr learned my addr 172.21.15.78:0/4016005961 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a4c25700 1 -- 172.21.15.78:0/4016005961 >> v2:172.21.15.150:3300/0 conn(0x7f54a00c5810 msgr2=0x7f54a00c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a4c25700 1 --2- 172.21.15.78:0/4016005961 >> v2:172.21.15.150:3300/0 conn(0x7f54a00c5810 0x7f54a00c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a4c25700 1 -- 172.21.15.78:0/4016005961 >> v1:172.21.15.150:6789/0 conn(0x7f54a00aa4d0 legacy=0x7f54a00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.315+0000 7f54a4c25700 1 -- 172.21.15.78:0/4016005961 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0063700 con 0x7f54a00aa0f0 2023-08-17T17:34:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54a4c25700 1 --2- 172.21.15.78:0/4016005961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa0f0 0x7f54a00644c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f54a0159090 tx=0x7f549c0090f0).ready entity=mon.0 client_cookie=56056e58250a4c45 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54977fe700 1 -- 172.21.15.78:0/4016005961 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00b5a0 con 0x7f54a00aa0f0 2023-08-17T17:34:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54977fe700 1 -- 172.21.15.78:0/4016005961 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c00b700 con 0x7f54a00aa0f0 2023-08-17T17:34:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54977fe700 1 -- 172.21.15.78:0/4016005961 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00ba80 con 0x7f54a00aa0f0 2023-08-17T17:34:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54a6e89700 1 -- 172.21.15.78:0/4016005961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa0f0 msgr2=0x7f54a00644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54a6e89700 1 --2- 172.21.15.78:0/4016005961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa0f0 0x7f54a00644c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f54a0159090 tx=0x7f549c0090f0).stop 2023-08-17T17:34:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54a6e89700 1 -- 172.21.15.78:0/4016005961 shutdown_connections 2023-08-17T17:34:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54a6e89700 1 --2- 172.21.15.78:0/4016005961 >> v2:172.21.15.150:3300/0 conn(0x7f54a00c5810 0x7f54a00c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54a6e89700 1 --2- 172.21.15.78:0/4016005961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa0f0 0x7f54a00644c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54a6e89700 1 -- 172.21.15.78:0/4016005961 >> 172.21.15.78:0/4016005961 conn(0x7f54a006a6a0 msgr2=0x7f54a00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54a6e89700 1 -- 172.21.15.78:0/4016005961 shutdown_connections 2023-08-17T17:34:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.316+0000 7f54a6e89700 1 -- 172.21.15.78:0/4016005961 wait complete. 2023-08-17T17:34:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.317+0000 7f54a6e89700 1 Processor -- start 2023-08-17T17:34:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.318+0000 7f54a6e89700 1 -- start start 2023-08-17T17:34:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.318+0000 7f54a6e89700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a00aa0f0 0x7f54a0150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.318+0000 7f54a6e89700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa4d0 0x7f54a00abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.318+0000 7f54a6e89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a00c5810 0x7f54a00c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.318+0000 7f54a6e89700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00af360 con 0x7f54a00aa4d0 2023-08-17T17:34:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.318+0000 7f54a6e89700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00ac620 con 0x7f54a00aa0f0 2023-08-17T17:34:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.318+0000 7f54a6e89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00ac900 con 0x7f54a00c5810 2023-08-17T17:34:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.318+0000 7f5497fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa4d0 0x7f54a00abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.318+0000 7f5497fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa4d0 0x7f54a00abcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54110/0 (socket says 172.21.15.78:54110) 2023-08-17T17:34:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.318+0000 7f5497fff700 1 -- 172.21.15.78:0/2311031186 learned_addr learned my addr 172.21.15.78:0/2311031186 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f54a4c25700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a00aa0f0 0x7f54a0150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f54a5426700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a00c5810 0x7f54a00c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f5497fff700 1 -- 172.21.15.78:0/2311031186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a00c5810 msgr2=0x7f54a00c25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f5497fff700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a00c5810 0x7f54a00c25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f5497fff700 1 -- 172.21.15.78:0/2311031186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a00aa0f0 msgr2=0x7f54a0150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f5497fff700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a00aa0f0 0x7f54a0150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f5497fff700 1 -- 172.21.15.78:0/2311031186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c009370 con 0x7f54a00aa4d0 2023-08-17T17:34:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f5497fff700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa4d0 0x7f54a00abcb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f549000b470 tx=0x7f5490006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f5494ff9700 1 -- 172.21.15.78:0/2311031186 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000be20 con 0x7f54a00aa4d0 2023-08-17T17:34:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f5494ff9700 1 -- 172.21.15.78:0/2311031186 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5490012410 con 0x7f54a00aa4d0 2023-08-17T17:34:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f54a6e89700 1 -- 172.21.15.78:0/2311031186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a00acbe0 con 0x7f54a00aa4d0 2023-08-17T17:34:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f5494ff9700 1 -- 172.21.15.78:0/2311031186 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54900127d0 con 0x7f54a00aa4d0 2023-08-17T17:34:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.319+0000 7f54a6e89700 1 -- 172.21.15.78:0/2311031186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a0151030 con 0x7f54a00aa4d0 2023-08-17T17:34:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.320+0000 7f54a6e89700 1 -- 172.21.15.78:0/2311031186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a0151250 con 0x7f54a00aa4d0 2023-08-17T17:34:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.320+0000 7f5494ff9700 1 -- 172.21.15.78:0/2311031186 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f549000f030 con 0x7f54a00aa4d0 2023-08-17T17:34:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.321+0000 7f5494ff9700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f548c05ed90 0x7f548c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.321+0000 7f5494ff9700 1 -- 172.21.15.78:0/2311031186 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f5490079580 con 0x7f54a00aa4d0 2023-08-17T17:34:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.321+0000 7f54a4c25700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f548c05ed90 0x7f548c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.321+0000 7f54a4c25700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f548c05ed90 0x7f548c061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f549c009130 tx=0x7f549c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.325+0000 7f5494ff9700 1 -- 172.21.15.78:0/2311031186 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54a0151250 con 0x7f54a00aa4d0 2023-08-17T17:34:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.527+0000 7f54a6e89700 1 -- 172.21.15.78:0/2311031186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f54a0151250 con 0x7f54a00aa4d0 2023-08-17T17:34:23.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.533+0000 7f5494ff9700 1 -- 172.21.15.78:0/2311031186 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f54a0151250 con 0x7f54a00aa4d0 2023-08-17T17:34:23.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.537+0000 7f54a6e89700 1 -- 172.21.15.78:0/2311031186 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f548c05ed90 msgr2=0x7f548c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.537+0000 7f54a6e89700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f548c05ed90 0x7f548c061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f549c009130 tx=0x7f549c015000).stop 2023-08-17T17:34:23.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.537+0000 7f54a6e89700 1 -- 172.21.15.78:0/2311031186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa4d0 msgr2=0x7f54a00abcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.537+0000 7f54a6e89700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa4d0 0x7f54a00abcb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f549000b470 tx=0x7f5490006f90).stop 2023-08-17T17:34:23.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.538+0000 7f54a6e89700 1 -- 172.21.15.78:0/2311031186 shutdown_connections 2023-08-17T17:34:23.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.538+0000 7f54a6e89700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f548c05ed90 0x7f548c061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.538+0000 7f54a6e89700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a00c5810 0x7f54a00c25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.538+0000 7f54a6e89700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a00aa0f0 0x7f54a0150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.538+0000 7f54a6e89700 1 --2- 172.21.15.78:0/2311031186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54a00aa4d0 0x7f54a00abcb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.538+0000 7f54a6e89700 1 -- 172.21.15.78:0/2311031186 >> 172.21.15.78:0/2311031186 conn(0x7f54a006a6a0 msgr2=0x7f54a0151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:23.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.538+0000 7f54a6e89700 1 -- 172.21.15.78:0/2311031186 shutdown_connections 2023-08-17T17:34:23.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.538+0000 7f54a6e89700 1 -- 172.21.15.78:0/2311031186 wait complete. 2023-08-17T17:34:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 3 and data pool 4 2023-08-17T17:34:23.560 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.671+0000 7f30166c1700 1 Processor -- start 2023-08-17T17:34:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.671+0000 7f30166c1700 1 -- start start 2023-08-17T17:34:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f30166c1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30100c6ee0 0x7f30100c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f30166c1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30100c7350 con 0x7f30100c0df0 2023-08-17T17:34:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f30166c1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30100a8350 con 0x7f3010154140 2023-08-17T17:34:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f30166c1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30100c1240 con 0x7f30100c6ee0 2023-08-17T17:34:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f3014c5e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f30100c0df0 0x7f30100ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36304/0 (socket says 172.21.15.78:36304) 2023-08-17T17:34:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f3014c5e700 1 -- 172.21.15.78:0/3292627669 learned_addr learned my addr 172.21.15.78:0/3292627669 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321494729 0 0) 0x7f30100c7350 con 0x7f30100c0df0 2023-08-17T17:34:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f300f7fe700 1 --2- 172.21.15.78:0/3292627669 >> v2:172.21.15.150:3300/0 conn(0x7f30100c6ee0 0x7f30100c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff80033f0 con 0x7f30100c0df0 2023-08-17T17:34:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3020556053 0 0) 0x7f2ff80033f0 con 0x7f30100c0df0 2023-08-17T17:34:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 >> v2:172.21.15.150:3300/0 conn(0x7f30100c6ee0 msgr2=0x7f30100c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f300effd700 1 --2- 172.21.15.78:0/3292627669 >> v2:172.21.15.150:3300/0 conn(0x7f30100c6ee0 0x7f30100c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 >> v1:172.21.15.150:6789/0 conn(0x7f3010154140 legacy=0x7f30100a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.672+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010154520 con 0x7f30100c0df0 2023-08-17T17:34:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f30080017f0 con 0x7f30100c0df0 2023-08-17T17:34:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 >> v1:172.21.15.78:6789/0 conn(0x7f30100c0df0 legacy=0x7f30100ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff80038e0 0x7f2ff8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8004690 0x7f2ff8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ff8005000 0x7f2ff800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30100c1240 con 0x7f2ff8005000 2023-08-17T17:34:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff800bf60 con 0x7f2ff80038e0 2023-08-17T17:34:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff800c0f0 con 0x7f2ff8004690 2023-08-17T17:34:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f3014c5e700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ff8005000 0x7f2ff800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300ffff700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff80038e0 0x7f2ff8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300f7fe700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8004690 0x7f2ff8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f3014c5e700 1 -- 172.21.15.78:0/3292627669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8004690 msgr2=0x7f2ff8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f3014c5e700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8004690 0x7f2ff8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f3014c5e700 1 -- 172.21.15.78:0/3292627669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff80038e0 msgr2=0x7f2ff8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f3014c5e700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff80038e0 0x7f2ff8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f3014c5e700 1 -- 172.21.15.78:0/3292627669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff80033f0 con 0x7f2ff8005000 2023-08-17T17:34:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f3014c5e700 1 -- 172.21.15.78:0/3292627669 reap_dead start 2023-08-17T17:34:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f3014c5e700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ff8005000 0x7f2ff800b8e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f300800c480 tx=0x7f300800c790).ready entity=mon.0 client_cookie=789766b955566210 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3008002030 con 0x7f2ff8005000 2023-08-17T17:34:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800ce20 con 0x7f2ff8005000 2023-08-17T17:34:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.673+0000 7f300effd700 1 -- 172.21.15.78:0/3292627669 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3008005d30 con 0x7f2ff8005000 2023-08-17T17:34:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.674+0000 7f30166c1700 1 -- 172.21.15.78:0/3292627669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ff8005000 msgr2=0x7f2ff800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.674+0000 7f30166c1700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ff8005000 0x7f2ff800b8e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f300800c480 tx=0x7f300800c790).stop 2023-08-17T17:34:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.674+0000 7f30166c1700 1 -- 172.21.15.78:0/3292627669 shutdown_connections 2023-08-17T17:34:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.674+0000 7f30166c1700 1 --2- 172.21.15.78:0/3292627669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ff8005000 0x7f2ff800b8e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.674+0000 7f30166c1700 1 -- 172.21.15.78:0/3292627669 >> 172.21.15.78:0/3292627669 conn(0x7f3010094510 msgr2=0x7f301006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.674+0000 7f30166c1700 1 -- 172.21.15.78:0/3292627669 shutdown_connections 2023-08-17T17:34:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.674+0000 7f30166c1700 1 -- 172.21.15.78:0/3292627669 wait complete. 2023-08-17T17:34:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.675+0000 7f30166c1700 1 Processor -- start 2023-08-17T17:34:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.675+0000 7f30166c1700 1 -- start start 2023-08-17T17:34:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f30166c1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8005000 0x7f30100ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f30166c1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3010150780 0x7f3010150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f30166c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30100c2160 0x7f30100c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f30166c1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30100c2ed0 con 0x7f30100c2160 2023-08-17T17:34:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f30166c1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3010165630 con 0x7f3010150780 2023-08-17T17:34:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f30166c1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30101651a0 con 0x7f2ff8005000 2023-08-17T17:34:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f3014c5e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30100c2160 0x7f30100c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f3014c5e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30100c2160 0x7f30100c25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54132/0 (socket says 172.21.15.78:54132) 2023-08-17T17:34:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f3014c5e700 1 -- 172.21.15.78:0/3464623566 learned_addr learned my addr 172.21.15.78:0/3464623566 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f300f7fe700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3010150780 0x7f3010150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f300ffff700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8005000 0x7f30100ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f3014c5e700 1 -- 172.21.15.78:0/3464623566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8005000 msgr2=0x7f30100ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f3014c5e700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8005000 0x7f30100ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f3014c5e700 1 -- 172.21.15.78:0/3464623566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3010150780 msgr2=0x7f3010150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f3014c5e700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3010150780 0x7f3010150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f3014c5e700 1 -- 172.21.15.78:0/3464623566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30101510f0 con 0x7f30100c2160 2023-08-17T17:34:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f3014c5e700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30100c2160 0x7f30100c25e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f300800c7d0 tx=0x7f3008015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f2ff7fff700 1 -- 172.21.15.78:0/3464623566 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3008002030 con 0x7f30100c2160 2023-08-17T17:34:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f2ff7fff700 1 -- 172.21.15.78:0/3464623566 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30080017b0 con 0x7f30100c2160 2023-08-17T17:34:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f2ff7fff700 1 -- 172.21.15.78:0/3464623566 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30080138b0 con 0x7f30100c2160 2023-08-17T17:34:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f30166c1700 1 -- 172.21.15.78:0/3464623566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30101645c0 con 0x7f30100c2160 2023-08-17T17:34:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.676+0000 7f30166c1700 1 -- 172.21.15.78:0/3464623566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3010164b50 con 0x7f30100c2160 2023-08-17T17:34:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.677+0000 7f30166c1700 1 -- 172.21.15.78:0/3464623566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30100c6ce0 con 0x7f30100c2160 2023-08-17T17:34:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.678+0000 7f2ff7fff700 1 -- 172.21.15.78:0/3464623566 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f300801d070 con 0x7f30100c2160 2023-08-17T17:34:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.678+0000 7f2ff7fff700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ffc05ed90 0x7f2ffc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.678+0000 7f2ff7fff700 1 -- 172.21.15.78:0/3464623566 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f300807adc0 con 0x7f30100c2160 2023-08-17T17:34:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.678+0000 7f300ffff700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ffc05ed90 0x7f2ffc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.678+0000 7f300ffff700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ffc05ed90 0x7f2ffc061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3000000c00 tx=0x7f3000009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.682+0000 7f2ff7fff700 1 -- 172.21.15.78:0/3464623566 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f300804c3e0 con 0x7f30100c2160 2023-08-17T17:34:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.844+0000 7f30166c1700 1 -- 172.21.15.78:0/3464623566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30100c8c00 con 0x7f30100c2160 2023-08-17T17:34:23.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.845+0000 7f2ff7fff700 1 -- 172.21.15.78:0/3464623566 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f300801a070 con 0x7f30100c2160 2023-08-17T17:34:23.847 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:23.847 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:23.529136+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:23.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.846+0000 7f30166c1700 1 -- 172.21.15.78:0/3464623566 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ffc05ed90 msgr2=0x7f2ffc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.846+0000 7f30166c1700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ffc05ed90 0x7f2ffc061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3000000c00 tx=0x7f3000009040).stop 2023-08-17T17:34:23.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.846+0000 7f30166c1700 1 -- 172.21.15.78:0/3464623566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30100c2160 msgr2=0x7f30100c25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.846+0000 7f30166c1700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30100c2160 0x7f30100c25e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f300800c7d0 tx=0x7f3008015000).stop 2023-08-17T17:34:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.846+0000 7f30166c1700 1 -- 172.21.15.78:0/3464623566 shutdown_connections 2023-08-17T17:34:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.846+0000 7f30166c1700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ffc05ed90 0x7f2ffc061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.846+0000 7f30166c1700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30100c2160 0x7f30100c25e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.846+0000 7f30166c1700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8005000 0x7f30100ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.846+0000 7f30166c1700 1 --2- 172.21.15.78:0/3464623566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3010150780 0x7f3010150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.846+0000 7f30166c1700 1 -- 172.21.15.78:0/3464623566 >> 172.21.15.78:0/3464623566 conn(0x7f3010094510 msgr2=0x7f30100c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.847+0000 7f30166c1700 1 -- 172.21.15.78:0/3464623566 shutdown_connections 2023-08-17T17:34:23.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.847+0000 7f30166c1700 1 -- 172.21.15.78:0/3464623566 wait complete. 2023-08-17T17:34:23.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.971+0000 7f83e91b1700 1 Processor -- start 2023-08-17T17:34:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.972+0000 7f83e91b1700 1 -- start start 2023-08-17T17:34:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.972+0000 7f83e91b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e4151e40 0x7f83e4152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.972+0000 7f83e91b1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83e40a7c90 0x7f83e40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.972+0000 7f83e91b1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e40bf210 con 0x7f83e40be4d0 2023-08-17T17:34:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.972+0000 7f83e91b1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e40c5a80 con 0x7f83e40a7c90 2023-08-17T17:34:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.972+0000 7f83e91b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40c5450 con 0x7f83e4151e40 2023-08-17T17:34:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83dbfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83e40a7c90 0x7f83e40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83e359e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f83e40be4d0 0x7f83e40c3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36308/0 (socket says 172.21.15.78:36308) 2023-08-17T17:34:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83e359e700 1 -- 172.21.15.78:0/64258484 learned_addr learned my addr 172.21.15.78:0/64258484 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83e2d9d700 1 --2- 172.21.15.78:0/64258484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e4151e40 0x7f83e4152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83dbfff700 1 -- 172.21.15.78:0/64258484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e4151e40 msgr2=0x7f83e4152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83dbfff700 1 --2- 172.21.15.78:0/64258484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e4151e40 0x7f83e4152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83dbfff700 1 -- 172.21.15.78:0/64258484 >> v1:172.21.15.78:6789/0 conn(0x7f83e40be4d0 legacy=0x7f83e40c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83dbfff700 1 -- 172.21.15.78:0/64258484 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e41533f0 con 0x7f83e40a7c90 2023-08-17T17:34:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83e259c700 1 -- 172.21.15.78:0/64258484 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015231323 0 0) 0x7f83e40bf210 con 0x7f83e40be4d0 2023-08-17T17:34:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83e2d9d700 1 --2- 172.21.15.78:0/64258484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e4151e40 0x7f83e4152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:23.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83dbfff700 1 --2- 172.21.15.78:0/64258484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 0x7f83e40c5f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f83cc009760 tx=0x7f83cc009060).ready entity=mon.0 client_cookie=2766f2ab11f05225 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:23.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83e259c700 1 -- 172.21.15.78:0/64258484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00b580 con 0x7f83e40a7c90 2023-08-17T17:34:23.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83e259c700 1 -- 172.21.15.78:0/64258484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc00b6e0 con 0x7f83e40a7c90 2023-08-17T17:34:23.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83e259c700 1 -- 172.21.15.78:0/64258484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00ba60 con 0x7f83e40a7c90 2023-08-17T17:34:23.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.973+0000 7f83e91b1700 1 -- 172.21.15.78:0/64258484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 msgr2=0x7f83e40c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.974+0000 7f83e91b1700 1 --2- 172.21.15.78:0/64258484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 0x7f83e40c5f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f83cc009760 tx=0x7f83cc009060).stop 2023-08-17T17:34:23.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.974+0000 7f83e91b1700 1 -- 172.21.15.78:0/64258484 shutdown_connections 2023-08-17T17:34:23.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.974+0000 7f83e91b1700 1 --2- 172.21.15.78:0/64258484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e4151e40 0x7f83e4152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.974+0000 7f83e91b1700 1 --2- 172.21.15.78:0/64258484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 0x7f83e40c5f10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.974+0000 7f83e91b1700 1 -- 172.21.15.78:0/64258484 >> 172.21.15.78:0/64258484 conn(0x7f83e4092330 msgr2=0x7f83e4062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:23.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.974+0000 7f83e91b1700 1 -- 172.21.15.78:0/64258484 shutdown_connections 2023-08-17T17:34:23.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.974+0000 7f83e91b1700 1 -- 172.21.15.78:0/64258484 wait complete. 2023-08-17T17:34:23.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.975+0000 7f83e91b1700 1 Processor -- start 2023-08-17T17:34:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.975+0000 7f83e91b1700 1 -- start start 2023-08-17T17:34:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.975+0000 7f83e91b1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 0x7f83e40aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.975+0000 7f83e91b1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83e40be4d0 0x7f83e40a9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.975+0000 7f83e91b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e4151e40 0x7f83e414c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.975+0000 7f83e91b1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40ab580 con 0x7f83e40a7c90 2023-08-17T17:34:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.975+0000 7f83e91b1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40aa970 con 0x7f83e40be4d0 2023-08-17T17:34:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.975+0000 7f83e91b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40aac50 con 0x7f83e4151e40 2023-08-17T17:34:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e2d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 0x7f83e40aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e2d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 0x7f83e40aa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54148/0 (socket says 172.21.15.78:54148) 2023-08-17T17:34:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e2d9d700 1 -- 172.21.15.78:0/2089399487 learned_addr learned my addr 172.21.15.78:0/2089399487 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83dbfff700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83e40be4d0 0x7f83e40a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e2d9d700 1 -- 172.21.15.78:0/2089399487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e4151e40 msgr2=0x7f83e414c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e2d9d700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e4151e40 0x7f83e414c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e2d9d700 1 -- 172.21.15.78:0/2089399487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83e40be4d0 msgr2=0x7f83e40a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e2d9d700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83e40be4d0 0x7f83e40a9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e2d9d700 1 -- 172.21.15.78:0/2089399487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc0092a0 con 0x7f83e40a7c90 2023-08-17T17:34:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83dbfff700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83e40be4d0 0x7f83e40a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e2d9d700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 0x7f83e40aa390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f83d400c880 tx=0x7f83d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83daffd700 1 -- 172.21.15.78:0/2089399487 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4010580 con 0x7f83e40a7c90 2023-08-17T17:34:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83daffd700 1 -- 172.21.15.78:0/2089399487 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d40106e0 con 0x7f83e40a7c90 2023-08-17T17:34:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e91b1700 1 -- 172.21.15.78:0/2089399487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e40aaf30 con 0x7f83e40a7c90 2023-08-17T17:34:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83daffd700 1 -- 172.21.15.78:0/2089399487 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4010a60 con 0x7f83e40a7c90 2023-08-17T17:34:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.976+0000 7f83e91b1700 1 -- 172.21.15.78:0/2089399487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e40a9e30 con 0x7f83e40a7c90 2023-08-17T17:34:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.977+0000 7f83e91b1700 1 -- 172.21.15.78:0/2089399487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e40ad270 con 0x7f83e40a7c90 2023-08-17T17:34:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.977+0000 7f83daffd700 1 -- 172.21.15.78:0/2089399487 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f83d401b460 con 0x7f83e40a7c90 2023-08-17T17:34:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.978+0000 7f83daffd700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f83c405ed90 0x7f83c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.978+0000 7f83daffd700 1 -- 172.21.15.78:0/2089399487 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f83d4079cc0 con 0x7f83e40a7c90 2023-08-17T17:34:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.978+0000 7f83dbfff700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f83c405ed90 0x7f83c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.978+0000 7f83dbfff700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f83c405ed90 0x7f83c4061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f83cc009760 tx=0x7f83cc017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:23.982+0000 7f83daffd700 1 -- 172.21.15.78:0/2089399487 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f83d404b200 con 0x7f83e40a7c90 2023-08-17T17:34:24.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.146+0000 7f83e91b1700 1 -- 172.21.15.78:0/2089399487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83e4047350 con 0x7f83e40a7c90 2023-08-17T17:34:24.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.147+0000 7f83daffd700 1 -- 172.21.15.78:0/2089399487 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f83d404e820 con 0x7f83e40a7c90 2023-08-17T17:34:24.149 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:24.149 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:23.529136+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:24.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 -- 172.21.15.78:0/2089399487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f83c405ed90 msgr2=0x7f83c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f83c405ed90 0x7f83c4061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f83cc009760 tx=0x7f83cc017000).stop 2023-08-17T17:34:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 -- 172.21.15.78:0/2089399487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 msgr2=0x7f83e40aa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 0x7f83e40aa390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f83d400c880 tx=0x7f83d4008040).stop 2023-08-17T17:34:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 -- 172.21.15.78:0/2089399487 shutdown_connections 2023-08-17T17:34:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f83c405ed90 0x7f83c4061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e4151e40 0x7f83e414c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40a7c90 0x7f83e40aa390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 --2- 172.21.15.78:0/2089399487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83e40be4d0 0x7f83e40a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 -- 172.21.15.78:0/2089399487 >> 172.21.15.78:0/2089399487 conn(0x7f83e4092330 msgr2=0x7f83e40a5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 -- 172.21.15.78:0/2089399487 shutdown_connections 2023-08-17T17:34:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.149+0000 7f83e91b1700 1 -- 172.21.15.78:0/2089399487 wait complete. 2023-08-17T17:34:24.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T17:34:24.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.277+0000 7f604364f700 1 Processor -- start 2023-08-17T17:34:24.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.277+0000 7f604364f700 1 -- start start 2023-08-17T17:34:24.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f604364f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f603c0aa4d0 0x7f603c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f604364f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c0649b0 con 0x7f603c0aa0f0 2023-08-17T17:34:24.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f604364f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c063420 con 0x7f603c0c5810 2023-08-17T17:34:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f604364f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c063700 con 0x7f603c0aa4d0 2023-08-17T17:34:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f60413eb700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f603c0aa0f0 0x7f603c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36322/0 (socket says 172.21.15.78:36322) 2023-08-17T17:34:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f60413eb700 1 -- 172.21.15.78:0/3464196872 learned_addr learned my addr 172.21.15.78:0/3464196872 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f6040bea700 1 --2- 172.21.15.78:0/3464196872 >> v2:172.21.15.78:3300/0 conn(0x7f603c0aa4d0 0x7f603c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f6033fff700 1 -- 172.21.15.78:0/3464196872 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633254874 0 0) 0x7f603c0649b0 con 0x7f603c0aa0f0 2023-08-17T17:34:24.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f6033fff700 1 -- 172.21.15.78:0/3464196872 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60280033f0 con 0x7f603c0aa0f0 2023-08-17T17:34:24.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f6040bea700 1 -- 172.21.15.78:0/3464196872 >> v1:172.21.15.150:6789/0 conn(0x7f603c0c5810 legacy=0x7f603c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:24.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f6040bea700 1 -- 172.21.15.78:0/3464196872 >> v1:172.21.15.78:6789/0 conn(0x7f603c0aa0f0 legacy=0x7f603c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.278+0000 7f6040bea700 1 -- 172.21.15.78:0/3464196872 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c0639e0 con 0x7f603c0aa4d0 2023-08-17T17:34:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f6040bea700 1 --2- 172.21.15.78:0/3464196872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa4d0 0x7f603c0644c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f602c009760 tx=0x7f602c009060).ready entity=mon.0 client_cookie=29a2e9ed66ccd529 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f6033fff700 1 -- 172.21.15.78:0/3464196872 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c00f510 con 0x7f603c0aa4d0 2023-08-17T17:34:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f6033fff700 1 -- 172.21.15.78:0/3464196872 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c00f670 con 0x7f603c0aa4d0 2023-08-17T17:34:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f6033fff700 1 -- 172.21.15.78:0/3464196872 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c00f9f0 con 0x7f603c0aa4d0 2023-08-17T17:34:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f604364f700 1 -- 172.21.15.78:0/3464196872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa4d0 msgr2=0x7f603c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f604364f700 1 --2- 172.21.15.78:0/3464196872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa4d0 0x7f603c0644c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f602c009760 tx=0x7f602c009060).stop 2023-08-17T17:34:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f604364f700 1 -- 172.21.15.78:0/3464196872 shutdown_connections 2023-08-17T17:34:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f604364f700 1 --2- 172.21.15.78:0/3464196872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa4d0 0x7f603c0644c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f604364f700 1 -- 172.21.15.78:0/3464196872 >> 172.21.15.78:0/3464196872 conn(0x7f603c06a6a0 msgr2=0x7f603c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:24.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f604364f700 1 -- 172.21.15.78:0/3464196872 shutdown_connections 2023-08-17T17:34:24.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.279+0000 7f604364f700 1 -- 172.21.15.78:0/3464196872 wait complete. 2023-08-17T17:34:24.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.280+0000 7f604364f700 1 Processor -- start 2023-08-17T17:34:24.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.281+0000 7f604364f700 1 -- start start 2023-08-17T17:34:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.281+0000 7f604364f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa0f0 0x7f603c1500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.281+0000 7f604364f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f603c0aa4d0 0x7f603c0c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.281+0000 7f604364f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f603c0c5810 0x7f603c0ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.281+0000 7f604364f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c158b70 con 0x7f603c0aa0f0 2023-08-17T17:34:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.281+0000 7f604364f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0ab180 con 0x7f603c0c5810 2023-08-17T17:34:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.281+0000 7f604364f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c1505d0 con 0x7f603c0aa4d0 2023-08-17T17:34:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.281+0000 7f60413eb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa0f0 0x7f603c1500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60413eb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa0f0 0x7f603c1500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54172/0 (socket says 172.21.15.78:54172) 2023-08-17T17:34:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60413eb700 1 -- 172.21.15.78:0/1908203859 learned_addr learned my addr 172.21.15.78:0/1908203859 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f6040bea700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f603c0aa4d0 0x7f603c0c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f6041bec700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f603c0c5810 0x7f603c0ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60413eb700 1 -- 172.21.15.78:0/1908203859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f603c0aa4d0 msgr2=0x7f603c0c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60413eb700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f603c0aa4d0 0x7f603c0c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60413eb700 1 -- 172.21.15.78:0/1908203859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f603c0c5810 msgr2=0x7f603c0ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60413eb700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f603c0c5810 0x7f603c0ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60413eb700 1 -- 172.21.15.78:0/1908203859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c0092a0 con 0x7f603c0aa0f0 2023-08-17T17:34:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f6041bec700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f603c0c5810 0x7f603c0ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60413eb700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa0f0 0x7f603c1500e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f603800c590 tx=0x7f6038007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60317fa700 1 -- 172.21.15.78:0/1908203859 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038007e40 con 0x7f603c0aa0f0 2023-08-17T17:34:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60317fa700 1 -- 172.21.15.78:0/1908203859 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60380072e0 con 0x7f603c0aa0f0 2023-08-17T17:34:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f604364f700 1 -- 172.21.15.78:0/1908203859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c0c2940 con 0x7f603c0aa0f0 2023-08-17T17:34:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f60317fa700 1 -- 172.21.15.78:0/1908203859 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380057a0 con 0x7f603c0aa0f0 2023-08-17T17:34:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.282+0000 7f604364f700 1 -- 172.21.15.78:0/1908203859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c0aae10 con 0x7f603c0aa0f0 2023-08-17T17:34:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.283+0000 7f604364f700 1 -- 172.21.15.78:0/1908203859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c0ab460 con 0x7f603c0aa0f0 2023-08-17T17:34:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.283+0000 7f60317fa700 1 -- 172.21.15.78:0/1908203859 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f603801a060 con 0x7f603c0aa0f0 2023-08-17T17:34:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.283+0000 7f60317fa700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f602005ed90 0x7f6020061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.284+0000 7f60317fa700 1 -- 172.21.15.78:0/1908203859 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6038078fa0 con 0x7f603c0aa0f0 2023-08-17T17:34:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.284+0000 7f6040bea700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f602005ed90 0x7f6020061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.284+0000 7f6040bea700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f602005ed90 0x7f6020061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f602c009760 tx=0x7f602c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.287+0000 7f60317fa700 1 -- 172.21.15.78:0/1908203859 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f603804a540 con 0x7f603c0aa0f0 2023-08-17T17:34:24.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.492+0000 7f604364f700 1 -- 172.21.15.78:0/1908203859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f603c046af0 con 0x7f603c0aa0f0 2023-08-17T17:34:24.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.532+0000 7f60317fa700 1 -- 172.21.15.78:0/1908203859 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6038018070 con 0x7f603c0aa0f0 2023-08-17T17:34:24.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 -- 172.21.15.78:0/1908203859 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f602005ed90 msgr2=0x7f6020061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f602005ed90 0x7f6020061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f602c009760 tx=0x7f602c017000).stop 2023-08-17T17:34:24.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 -- 172.21.15.78:0/1908203859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa0f0 msgr2=0x7f603c1500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa0f0 0x7f603c1500e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f603800c590 tx=0x7f6038007c80).stop 2023-08-17T17:34:24.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 -- 172.21.15.78:0/1908203859 shutdown_connections 2023-08-17T17:34:24.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f602005ed90 0x7f6020061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f603c0c5810 0x7f603c0ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0aa0f0 0x7f603c1500e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 --2- 172.21.15.78:0/1908203859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f603c0aa4d0 0x7f603c0c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 -- 172.21.15.78:0/1908203859 >> 172.21.15.78:0/1908203859 conn(0x7f603c06a6a0 msgr2=0x7f603c064310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:24.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 -- 172.21.15.78:0/1908203859 shutdown_connections 2023-08-17T17:34:24.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.534+0000 7f604364f700 1 -- 172.21.15.78:0/1908203859 wait complete. 2023-08-17T17:34:24.547 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T17:34:24.548 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T17:34:24.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.661+0000 7f6c613a9700 1 Processor -- start 2023-08-17T17:34:24.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.661+0000 7f6c613a9700 1 -- start start 2023-08-17T17:34:24.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c613a9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6c5c0aa0f0 0x7f6c5c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c613a9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5c0649b0 con 0x7f6c5c0aa4d0 2023-08-17T17:34:24.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c613a9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5c063420 con 0x7f6c5c0c5810 2023-08-17T17:34:24.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c613a9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5c063700 con 0x7f6c5c0aa0f0 2023-08-17T17:34:24.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c527fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6c5c0aa4d0 0x7f6c5c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36338/0 (socket says 172.21.15.78:36338) 2023-08-17T17:34:24.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c527fc700 1 -- 172.21.15.78:0/1606458353 learned_addr learned my addr 172.21.15.78:0/1606458353 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:24.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c5affd700 1 --2- 172.21.15.78:0/1606458353 >> v2:172.21.15.150:3300/0 conn(0x7f6c5c0aa0f0 0x7f6c5c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647289084 0 0) 0x7f6c5c0649b0 con 0x7f6c5c0aa4d0 2023-08-17T17:34:24.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c480033f0 con 0x7f6c5c0aa4d0 2023-08-17T17:34:24.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3239279351 0 0) 0x7f6c480033f0 con 0x7f6c5c0aa4d0 2023-08-17T17:34:24.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 >> v2:172.21.15.150:3300/0 conn(0x7f6c5c0aa0f0 msgr2=0x7f6c5c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:24.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c5a7fc700 1 --2- 172.21.15.78:0/1606458353 >> v2:172.21.15.150:3300/0 conn(0x7f6c5c0aa0f0 0x7f6c5c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 >> v1:172.21.15.150:6789/0 conn(0x7f6c5c0c5810 legacy=0x7f6c5c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c0639e0 con 0x7f6c5c0aa4d0 2023-08-17T17:34:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f6c44001470 con 0x7f6c5c0aa4d0 2023-08-17T17:34:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.662+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 >> v1:172.21.15.78:6789/0 conn(0x7f6c5c0aa4d0 legacy=0x7f6c5c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5a7fc700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c480038e0 0x7f6c48003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5a7fc700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c48004690 0x7f6c48004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5a7fc700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c48005000 0x7f6c4800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c063700 con 0x7f6c480038e0 2023-08-17T17:34:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4800beb0 con 0x7f6c48005000 2023-08-17T17:34:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4800c070 con 0x7f6c48004690 2023-08-17T17:34:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5affd700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c480038e0 0x7f6c48003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5b7fe700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c48005000 0x7f6c4800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c527fc700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c48004690 0x7f6c48004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5affd700 1 -- 172.21.15.78:0/1606458353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c48004690 msgr2=0x7f6c48004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5affd700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c48004690 0x7f6c48004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5affd700 1 -- 172.21.15.78:0/1606458353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c48005000 msgr2=0x7f6c4800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:24.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5affd700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c48005000 0x7f6c4800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5b7fe700 1 -- 172.21.15.78:0/1606458353 reap_dead start 2023-08-17T17:34:24.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5affd700 1 -- 172.21.15.78:0/1606458353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c480033f0 con 0x7f6c480038e0 2023-08-17T17:34:24.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c527fc700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c48004690 0x7f6c48004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:24.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5affd700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c480038e0 0x7f6c48003d00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6c4c009a80 tx=0x7f6c4c009060).ready entity=mon.0 client_cookie=69b5310e467c0cb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:24.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c009430 con 0x7f6c480038e0 2023-08-17T17:34:24.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00e640 con 0x7f6c480038e0 2023-08-17T17:34:24.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.663+0000 7f6c5a7fc700 1 -- 172.21.15.78:0/1606458353 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00e9c0 con 0x7f6c480038e0 2023-08-17T17:34:24.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.664+0000 7f6c613a9700 1 -- 172.21.15.78:0/1606458353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c480038e0 msgr2=0x7f6c48003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.664+0000 7f6c613a9700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c480038e0 0x7f6c48003d00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6c4c009a80 tx=0x7f6c4c009060).stop 2023-08-17T17:34:24.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.664+0000 7f6c613a9700 1 -- 172.21.15.78:0/1606458353 shutdown_connections 2023-08-17T17:34:24.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.664+0000 7f6c613a9700 1 --2- 172.21.15.78:0/1606458353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c480038e0 0x7f6c48003d00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.664+0000 7f6c613a9700 1 -- 172.21.15.78:0/1606458353 >> 172.21.15.78:0/1606458353 conn(0x7f6c5c06a6a0 msgr2=0x7f6c5c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:24.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.664+0000 7f6c613a9700 1 -- 172.21.15.78:0/1606458353 shutdown_connections 2023-08-17T17:34:24.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.664+0000 7f6c613a9700 1 -- 172.21.15.78:0/1606458353 wait complete. 2023-08-17T17:34:24.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.665+0000 7f6c613a9700 1 Processor -- start 2023-08-17T17:34:24.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.665+0000 7f6c613a9700 1 -- start start 2023-08-17T17:34:24.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c613a9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c480038e0 0x7f6c5c1561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c613a9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c5c0ab380 0x7f6c5c1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c613a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c5c151cd0 0x7f6c5c1681f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c613a9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c0c21b0 con 0x7f6c5c151cd0 2023-08-17T17:34:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c613a9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c0abbf0 con 0x7f6c5c0ab380 2023-08-17T17:34:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c613a9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c0abed0 con 0x7f6c480038e0 2023-08-17T17:34:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c5c151cd0 0x7f6c5c1681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c5c151cd0 0x7f6c5c1681f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54188/0 (socket says 172.21.15.78:54188) 2023-08-17T17:34:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5b7fe700 1 -- 172.21.15.78:0/1933286717 learned_addr learned my addr 172.21.15.78:0/1933286717 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5affd700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c480038e0 0x7f6c5c1561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5b7fe700 1 -- 172.21.15.78:0/1933286717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c480038e0 msgr2=0x7f6c5c1561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c527fc700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c5c0ab380 0x7f6c5c1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5b7fe700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c480038e0 0x7f6c5c1561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5b7fe700 1 -- 172.21.15.78:0/1933286717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c5c0ab380 msgr2=0x7f6c5c1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5b7fe700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c5c0ab380 0x7f6c5c1517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5b7fe700 1 -- 172.21.15.78:0/1933286717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c0c1b60 con 0x7f6c5c151cd0 2023-08-17T17:34:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5affd700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c480038e0 0x7f6c5c1561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c527fc700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c5c0ab380 0x7f6c5c1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c5b7fe700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c5c151cd0 0x7f6c5c1681f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6c5c0c6e90 tx=0x7f6c54009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c537fe700 1 -- 172.21.15.78:0/1933286717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54003030 con 0x7f6c5c151cd0 2023-08-17T17:34:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c537fe700 1 -- 172.21.15.78:0/1933286717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c54003190 con 0x7f6c5c151cd0 2023-08-17T17:34:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c613a9700 1 -- 172.21.15.78:0/1933286717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5c0c1e40 con 0x7f6c5c151cd0 2023-08-17T17:34:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c537fe700 1 -- 172.21.15.78:0/1933286717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54003510 con 0x7f6c5c151cd0 2023-08-17T17:34:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.666+0000 7f6c613a9700 1 -- 172.21.15.78:0/1933286717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5c0ab7e0 con 0x7f6c5c151cd0 2023-08-17T17:34:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.667+0000 7f6c613a9700 1 -- 172.21.15.78:0/1933286717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5c0c1fd0 con 0x7f6c5c151cd0 2023-08-17T17:34:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.667+0000 7f6c537fe700 1 -- 172.21.15.78:0/1933286717 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6c5401c060 con 0x7f6c5c151cd0 2023-08-17T17:34:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.668+0000 7f6c537fe700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c3c05ed90 0x7f6c3c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.668+0000 7f6c537fe700 1 -- 172.21.15.78:0/1933286717 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6c540793f0 con 0x7f6c5c151cd0 2023-08-17T17:34:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.668+0000 7f6c5affd700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c3c05ed90 0x7f6c3c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.668+0000 7f6c5affd700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c3c05ed90 0x7f6c3c061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6c4c006d50 tx=0x7f6c4c01a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.672+0000 7f6c537fe700 1 -- 172.21.15.78:0/1933286717 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c5c0c1fd0 con 0x7f6c5c151cd0 2023-08-17T17:34:24.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:24.875+0000 7f6c613a9700 1 -- 172.21.15.78:0/1933286717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6c5c0c1fd0 con 0x7f6c5c151cd0 2023-08-17T17:34:25.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.538+0000 7f6c537fe700 1 -- 172.21.15.78:0/1933286717 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6c5c0c1fd0 con 0x7f6c5c151cd0 2023-08-17T17:34:25.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 -- 172.21.15.78:0/1933286717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c3c05ed90 msgr2=0x7f6c3c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:25.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c3c05ed90 0x7f6c3c061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6c4c006d50 tx=0x7f6c4c01a000).stop 2023-08-17T17:34:25.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 -- 172.21.15.78:0/1933286717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c5c151cd0 msgr2=0x7f6c5c1681f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:25.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c5c151cd0 0x7f6c5c1681f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6c5c0c6e90 tx=0x7f6c54009040).stop 2023-08-17T17:34:25.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 -- 172.21.15.78:0/1933286717 shutdown_connections 2023-08-17T17:34:25.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c3c05ed90 0x7f6c3c061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c5c151cd0 0x7f6c5c1681f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c480038e0 0x7f6c5c1561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 --2- 172.21.15.78:0/1933286717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c5c0ab380 0x7f6c5c1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 -- 172.21.15.78:0/1933286717 >> 172.21.15.78:0/1933286717 conn(0x7f6c5c06a6a0 msgr2=0x7f6c5c0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:25.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.540+0000 7f6c613a9700 1 -- 172.21.15.78:0/1933286717 shutdown_connections 2023-08-17T17:34:25.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.541+0000 7f6c613a9700 1 -- 172.21.15.78:0/1933286717 wait complete. 2023-08-17T17:34:25.554 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T17:34:25.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:34:25.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.666+0000 7fdaeed13700 1 Processor -- start 2023-08-17T17:34:25.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.666+0000 7fdaeed13700 1 -- start start 2023-08-17T17:34:25.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.667+0000 7fdaeed13700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdae8154140 0x7fdae80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:25.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.667+0000 7fdaeed13700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdae80a7c40 0x7fdae80c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:25.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.667+0000 7fdaeed13700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae8154520 con 0x7fdae80a80b0 2023-08-17T17:34:25.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.667+0000 7fdaeed13700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80c91e0 con 0x7fdae8154140 2023-08-17T17:34:25.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.667+0000 7fdaeed13700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80c94c0 con 0x7fdae80a7c40 2023-08-17T17:34:25.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.667+0000 7fdaecaaf700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdae8154140 0x7fdae80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:25.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.667+0000 7fdaecaaf700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdae8154140 0x7fdae80c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54190/0 (socket says 172.21.15.78:54190) 2023-08-17T17:34:25.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.667+0000 7fdaecaaf700 1 -- 172.21.15.78:0/836419276 learned_addr learned my addr 172.21.15.78:0/836419276 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:25.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaecaaf700 1 -- 172.21.15.78:0/836419276 >> v2:172.21.15.150:3300/0 conn(0x7fdae80a7c40 msgr2=0x7fdae80c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:25.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaecaaf700 1 --2- 172.21.15.78:0/836419276 >> v2:172.21.15.150:3300/0 conn(0x7fdae80a7c40 0x7fdae80c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:25.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaecaaf700 1 -- 172.21.15.78:0/836419276 >> v1:172.21.15.150:6789/0 conn(0x7fdae80a80b0 legacy=0x7fdae80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:25.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaecaaf700 1 -- 172.21.15.78:0/836419276 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80c97a0 con 0x7fdae8154140 2023-08-17T17:34:25.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaecaaf700 1 --2- 172.21.15.78:0/836419276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 0x7fdae80c6ee0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fdae80652a0 tx=0x7fdadc0090f0).ready entity=mon.0 client_cookie=2b074693a9389092 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:25.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdae77fe700 1 -- 172.21.15.78:0/836419276 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc00b5a0 con 0x7fdae8154140 2023-08-17T17:34:25.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdae77fe700 1 -- 172.21.15.78:0/836419276 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc00b700 con 0x7fdae8154140 2023-08-17T17:34:25.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdae77fe700 1 -- 172.21.15.78:0/836419276 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc00ba80 con 0x7fdae8154140 2023-08-17T17:34:25.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaeed13700 1 -- 172.21.15.78:0/836419276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 msgr2=0x7fdae80c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:25.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaeed13700 1 --2- 172.21.15.78:0/836419276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 0x7fdae80c6ee0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fdae80652a0 tx=0x7fdadc0090f0).stop 2023-08-17T17:34:25.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaeed13700 1 -- 172.21.15.78:0/836419276 shutdown_connections 2023-08-17T17:34:25.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaeed13700 1 --2- 172.21.15.78:0/836419276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 0x7fdae80c6ee0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaeed13700 1 --2- 172.21.15.78:0/836419276 >> v2:172.21.15.150:3300/0 conn(0x7fdae80a7c40 0x7fdae80c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:25.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaeed13700 1 -- 172.21.15.78:0/836419276 >> 172.21.15.78:0/836419276 conn(0x7fdae8094510 msgr2=0x7fdae806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:25.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaeed13700 1 -- 172.21.15.78:0/836419276 shutdown_connections 2023-08-17T17:34:25.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.668+0000 7fdaeed13700 1 -- 172.21.15.78:0/836419276 wait complete. 2023-08-17T17:34:25.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.669+0000 7fdaeed13700 1 Processor -- start 2023-08-17T17:34:25.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.670+0000 7fdaeed13700 1 -- start start 2023-08-17T17:34:25.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.670+0000 7fdaeed13700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdae80a7c40 0x7fdae80b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:25.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.670+0000 7fdaeed13700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdae80a80b0 0x7fdae80ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:25.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaeed13700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 0x7fdae814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:25.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaeed13700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80c3330 con 0x7fdae8154140 2023-08-17T17:34:25.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaeed13700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80ae620 con 0x7fdae80a80b0 2023-08-17T17:34:25.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaeed13700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80ae900 con 0x7fdae80a7c40 2023-08-17T17:34:25.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaed2b0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 0x7fdae814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:25.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaed2b0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 0x7fdae814ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54200/0 (socket says 172.21.15.78:54200) 2023-08-17T17:34:25.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaed2b0700 1 -- 172.21.15.78:0/521579043 learned_addr learned my addr 172.21.15.78:0/521579043 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:25.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaecaaf700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdae80a7c40 0x7fdae80b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:25.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdae7fff700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdae80a80b0 0x7fdae80ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:25.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaed2b0700 1 -- 172.21.15.78:0/521579043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdae80a7c40 msgr2=0x7fdae80b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:25.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaed2b0700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdae80a7c40 0x7fdae80b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaed2b0700 1 -- 172.21.15.78:0/521579043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdae80a80b0 msgr2=0x7fdae80ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:25.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaed2b0700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdae80a80b0 0x7fdae80ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaed2b0700 1 -- 172.21.15.78:0/521579043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc009370 con 0x7fdae8154140 2023-08-17T17:34:25.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaed2b0700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 0x7fdae814ff60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdae000b7e0 tx=0x7fdae0009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:25.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdae4ff9700 1 -- 172.21.15.78:0/521579043 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000d620 con 0x7fdae8154140 2023-08-17T17:34:25.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdae4ff9700 1 -- 172.21.15.78:0/521579043 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000d7e0 con 0x7fdae8154140 2023-08-17T17:34:25.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdae4ff9700 1 -- 172.21.15.78:0/521579043 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000dba0 con 0x7fdae8154140 2023-08-17T17:34:25.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaeed13700 1 -- 172.21.15.78:0/521579043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae80aebe0 con 0x7fdae8154140 2023-08-17T17:34:25.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.671+0000 7fdaeed13700 1 -- 172.21.15.78:0/521579043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae80ae330 con 0x7fdae8154140 2023-08-17T17:34:25.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.672+0000 7fdaeed13700 1 -- 172.21.15.78:0/521579043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae80c34c0 con 0x7fdae8154140 2023-08-17T17:34:25.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.672+0000 7fdae4ff9700 1 -- 172.21.15.78:0/521579043 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdae000f480 con 0x7fdae8154140 2023-08-17T17:34:25.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.673+0000 7fdae4ff9700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdacc05ed90 0x7fdacc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:25.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.673+0000 7fdae4ff9700 1 -- 172.21.15.78:0/521579043 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdae0079dd0 con 0x7fdae8154140 2023-08-17T17:34:25.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.673+0000 7fdaecaaf700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdacc05ed90 0x7fdacc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:25.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.673+0000 7fdaecaaf700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdacc05ed90 0x7fdacc061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdadc009130 tx=0x7fdadc015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:25.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.677+0000 7fdae4ff9700 1 -- 172.21.15.78:0/521579043 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdae004b310 con 0x7fdae8154140 2023-08-17T17:34:25.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.880+0000 7fdaeed13700 1 -- 172.21.15.78:0/521579043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdae8047350 con 0x7fdae8154140 2023-08-17T17:34:25.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.881+0000 7fdae4ff9700 1 -- 172.21.15.78:0/521579043 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7fdae004e930 con 0x7fdae8154140 2023-08-17T17:34:25.883 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:25.883 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4150014676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4150014676},{"type":"v1","addr":"172.21.15.150:6834","nonce":4150014676}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1895700227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1895700227},{"type":"v1","addr":"172.21.15.150:6835","nonce":1895700227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3007671664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3007671664},{"type":"v1","addr":"172.21.15.78:6835","nonce":3007671664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:34:23.529472+0000","modified":"2023-08-17T17:34:25.535687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/2283193122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2283193122},{"type":"v1","addr":"172.21.15.78:6837","nonce":2283193122}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T17:34:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 -- 172.21.15.78:0/521579043 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdacc05ed90 msgr2=0x7fdacc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdacc05ed90 0x7fdacc061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdadc009130 tx=0x7fdadc015000).stop 2023-08-17T17:34:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 -- 172.21.15.78:0/521579043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 msgr2=0x7fdae814ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 0x7fdae814ff60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdae000b7e0 tx=0x7fdae0009310).stop 2023-08-17T17:34:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 -- 172.21.15.78:0/521579043 shutdown_connections 2023-08-17T17:34:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdacc05ed90 0x7fdacc061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae8154140 0x7fdae814ff60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdae80a7c40 0x7fdae80b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 --2- 172.21.15.78:0/521579043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdae80a80b0 0x7fdae80ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 -- 172.21.15.78:0/521579043 >> 172.21.15.78:0/521579043 conn(0x7fdae8094510 msgr2=0x7fdae8063c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 -- 172.21.15.78:0/521579043 shutdown_connections 2023-08-17T17:34:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:25.883+0000 7fdaeed13700 1 -- 172.21.15.78:0/521579043 wait complete. 2023-08-17T17:34:25.887 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2023-08-17T17:34:25.896 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:26.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.008+0000 7faaadfc3700 1 Processor -- start 2023-08-17T17:34:26.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.008+0000 7faaadfc3700 1 -- start start 2023-08-17T17:34:26.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaadfc3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa8066660 0x7faaa80c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaadfc3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faaa8066a40 0x7faaa8151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaadfc3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa80c6040 con 0x7faaa80c5b50 2023-08-17T17:34:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaadfc3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa8069b00 con 0x7faaa8066a40 2023-08-17T17:34:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaadfc3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa8069f90 con 0x7faaa8066660 2023-08-17T17:34:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa6ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7faaa80c5b50 0x7faaa80624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36344/0 (socket says 172.21.15.78:36344) 2023-08-17T17:34:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa6ffd700 1 -- 172.21.15.78:0/2569077314 learned_addr learned my addr 172.21.15.78:0/2569077314 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa7fff700 1 --2- 172.21.15.78:0/2569077314 >> v2:172.21.15.150:3300/0 conn(0x7faaa8066a40 0x7faaa8151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa77fe700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa8066660 0x7faaa80c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408348191 0 0) 0x7faa9c001110 con 0x7faaa80c5b50 2023-08-17T17:34:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa900033f0 con 0x7faaa80c5b50 2023-08-17T17:34:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2495023276 0 0) 0x7faa900033f0 con 0x7faaa80c5b50 2023-08-17T17:34:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa8066660 msgr2=0x7faaa80c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa8066660 0x7faaa80c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 >> v2:172.21.15.150:3300/0 conn(0x7faaa8066a40 msgr2=0x7faaa8151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 --2- 172.21.15.78:0/2569077314 >> v2:172.21.15.150:3300/0 conn(0x7faaa8066a40 0x7faaa8151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa80691d0 con 0x7faaa80c5b50 2023-08-17T17:34:26.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7faa9c001600 con 0x7faaa80c5b50 2023-08-17T17:34:26.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 >> v1:172.21.15.78:6789/0 conn(0x7faaa80c5b50 legacy=0x7faaa80624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 0x7faa90003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa90004690 0x7faa90004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa8066660 0x7faa90005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa8069b00 con 0x7faa900038e0 2023-08-17T17:34:26.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa8069f90 con 0x7faa90004690 2023-08-17T17:34:26.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9000b8e0 con 0x7faaa8066660 2023-08-17T17:34:26.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.009+0000 7faaa77fe700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 0x7faa90003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa6ffd700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa90004690 0x7faa90004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa7fff700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa8066660 0x7faa90005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa77fe700 1 -- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa8066660 msgr2=0x7faa90005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa77fe700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa8066660 0x7faa90005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa77fe700 1 -- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa90004690 msgr2=0x7faa90004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa77fe700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa90004690 0x7faa90004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa77fe700 1 -- 172.21.15.78:0/2569077314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa900033f0 con 0x7faa900038e0 2023-08-17T17:34:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa6ffd700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa90004690 0x7faa90004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:26.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa7fff700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa8066660 0x7faa90005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:26.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa77fe700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 0x7faa90003d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7faa98009a80 tx=0x7faa98009060).ready entity=mon.0 client_cookie=9c3fbd6148580e80 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:26.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98009430 con 0x7faa900038e0 2023-08-17T17:34:26.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9800e640 con 0x7faa900038e0 2023-08-17T17:34:26.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa67fc700 1 -- 172.21.15.78:0/2569077314 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9800e9c0 con 0x7faa900038e0 2023-08-17T17:34:26.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaadfc3700 1 -- 172.21.15.78:0/2569077314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 msgr2=0x7faa90003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaadfc3700 1 --2- 172.21.15.78:0/2569077314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 0x7faa90003d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7faa98009a80 tx=0x7faa98009060).stop 2023-08-17T17:34:26.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaa7fff700 1 -- 172.21.15.78:0/2569077314 reap_dead start 2023-08-17T17:34:26.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaadfc3700 1 -- 172.21.15.78:0/2569077314 shutdown_connections 2023-08-17T17:34:26.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaadfc3700 1 -- 172.21.15.78:0/2569077314 >> 172.21.15.78:0/2569077314 conn(0x7faaa80c7b00 msgr2=0x7faaa80c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:26.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaadfc3700 1 -- 172.21.15.78:0/2569077314 shutdown_connections 2023-08-17T17:34:26.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.010+0000 7faaadfc3700 1 -- 172.21.15.78:0/2569077314 wait complete. 2023-08-17T17:34:26.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.012+0000 7faaadfc3700 1 Processor -- start 2023-08-17T17:34:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.012+0000 7faaadfc3700 1 -- start start 2023-08-17T17:34:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.012+0000 7faaadfc3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 0x7faaa8150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.012+0000 7faaadfc3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa80c1810 0x7faaa81649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.012+0000 7faaadfc3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaa8164ec0 0x7faaa8155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.012+0000 7faaadfc3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa80bf900 con 0x7faa900038e0 2023-08-17T17:34:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.012+0000 7faaadfc3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa8165320 con 0x7faaa8164ec0 2023-08-17T17:34:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.012+0000 7faaadfc3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa81514e0 con 0x7faaa80c1810 2023-08-17T17:34:26.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.012+0000 7faaa77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 0x7faaa8150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaa77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 0x7faaa8150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54230/0 (socket says 172.21.15.78:54230) 2023-08-17T17:34:26.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaa77fe700 1 -- 172.21.15.78:0/166880760 learned_addr learned my addr 172.21.15.78:0/166880760 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:26.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaa7fff700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaa8164ec0 0x7faaa8155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaa6ffd700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa80c1810 0x7faaa81649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaa77fe700 1 -- 172.21.15.78:0/166880760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa80c1810 msgr2=0x7faaa81649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaa77fe700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa80c1810 0x7faaa81649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaa77fe700 1 -- 172.21.15.78:0/166880760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaa8164ec0 msgr2=0x7faaa8155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaa77fe700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaa8164ec0 0x7faaa8155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaa77fe700 1 -- 172.21.15.78:0/166880760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa8165530 con 0x7faa900038e0 2023-08-17T17:34:26.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaa77fe700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 0x7faaa8150ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7faa90004480 tx=0x7faa9801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:26.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faa8f7fe700 1 -- 172.21.15.78:0/166880760 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9800ed30 con 0x7faa900038e0 2023-08-17T17:34:26.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faa8f7fe700 1 -- 172.21.15.78:0/166880760 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9800eeb0 con 0x7faa900038e0 2023-08-17T17:34:26.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaadfc3700 1 -- 172.21.15.78:0/166880760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa8165810 con 0x7faa900038e0 2023-08-17T17:34:26.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faa8f7fe700 1 -- 172.21.15.78:0/166880760 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9801b450 con 0x7faa900038e0 2023-08-17T17:34:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.013+0000 7faaadfc3700 1 -- 172.21.15.78:0/166880760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa80c12f0 con 0x7faa900038e0 2023-08-17T17:34:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.014+0000 7faaadfc3700 1 -- 172.21.15.78:0/166880760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa80c1660 con 0x7faa900038e0 2023-08-17T17:34:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.014+0000 7faa8f7fe700 1 -- 172.21.15.78:0/166880760 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faa9801b800 con 0x7faa900038e0 2023-08-17T17:34:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.015+0000 7faa8f7fe700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9405ed90 0x7faa94061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.015+0000 7faa8f7fe700 1 -- 172.21.15.78:0/166880760 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa9807b6c0 con 0x7faa900038e0 2023-08-17T17:34:26.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.015+0000 7faaa6ffd700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9405ed90 0x7faa94061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.015+0000 7faaa6ffd700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9405ed90 0x7faa94061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7faa9c000e10 tx=0x7faa9c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:26.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.019+0000 7faa8f7fe700 1 -- 172.21.15.78:0/166880760 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa9804cc00 con 0x7faa900038e0 2023-08-17T17:34:26.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.184+0000 7faaadfc3700 1 -- 172.21.15.78:0/166880760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaa8047350 con 0x7faa900038e0 2023-08-17T17:34:26.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.185+0000 7faa8f7fe700 1 -- 172.21.15.78:0/166880760 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7faa98016070 con 0x7faa900038e0 2023-08-17T17:34:26.187 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:26.187 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:26.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 -- 172.21.15.78:0/166880760 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9405ed90 msgr2=0x7faa94061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9405ed90 0x7faa94061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7faa9c000e10 tx=0x7faa9c009040).stop 2023-08-17T17:34:26.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 -- 172.21.15.78:0/166880760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 msgr2=0x7faaa8150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 0x7faaa8150ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7faa90004480 tx=0x7faa9801a000).stop 2023-08-17T17:34:26.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 -- 172.21.15.78:0/166880760 shutdown_connections 2023-08-17T17:34:26.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9405ed90 0x7faa94061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaa8164ec0 0x7faaa8155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa900038e0 0x7faaa8150ff0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 --2- 172.21.15.78:0/166880760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaa80c1810 0x7faaa81649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 -- 172.21.15.78:0/166880760 >> 172.21.15.78:0/166880760 conn(0x7faaa80c7b00 msgr2=0x7faaa8156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:26.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 -- 172.21.15.78:0/166880760 shutdown_connections 2023-08-17T17:34:26.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.187+0000 7faaadfc3700 1 -- 172.21.15.78:0/166880760 wait complete. 2023-08-17T17:34:26.201 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T17:34:26.201 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:34:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.313+0000 7f7605c09700 1 Processor -- start 2023-08-17T17:34:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.313+0000 7f7605c09700 1 -- start start 2023-08-17T17:34:26.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.314+0000 7f7605c09700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76000c01b0 0x7f76000c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.314+0000 7f7605c09700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76000a7bd0 0x7f7600063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.314+0000 7f7605c09700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7600063960 con 0x7f76000a8050 2023-08-17T17:34:26.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.314+0000 7f7605c09700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76000649f0 con 0x7f76000c01b0 2023-08-17T17:34:26.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.314+0000 7f7605c09700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7600063030 con 0x7f76000a7bd0 2023-08-17T17:34:26.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.314+0000 7f7605408700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f76000a8050 0x7f76000642e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36358/0 (socket says 172.21.15.78:36358) 2023-08-17T17:34:26.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.314+0000 7f7605408700 1 -- 172.21.15.78:0/1585963788 learned_addr learned my addr 172.21.15.78:0/1585963788 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:26.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.314+0000 7f7604c07700 1 --2- 172.21.15.78:0/1585963788 >> v2:172.21.15.78:3300/0 conn(0x7f76000c01b0 0x7f76000c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.314+0000 7f75fffff700 1 --2- 172.21.15.78:0/1585963788 >> v2:172.21.15.150:3300/0 conn(0x7f76000a7bd0 0x7f7600063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.315+0000 7f75ff7fe700 1 -- 172.21.15.78:0/1585963788 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043474790 0 0) 0x7f7600063960 con 0x7f76000a8050 2023-08-17T17:34:26.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.315+0000 7f75ff7fe700 1 -- 172.21.15.78:0/1585963788 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f00033f0 con 0x7f76000a8050 2023-08-17T17:34:26.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.315+0000 7f75fffff700 1 -- 172.21.15.78:0/1585963788 >> v2:172.21.15.78:3300/0 conn(0x7f76000c01b0 msgr2=0x7f76000c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:26.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.315+0000 7f75fffff700 1 --2- 172.21.15.78:0/1585963788 >> v2:172.21.15.78:3300/0 conn(0x7f76000c01b0 0x7f76000c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.315+0000 7f75fffff700 1 -- 172.21.15.78:0/1585963788 >> v1:172.21.15.78:6789/0 conn(0x7f76000a8050 legacy=0x7f76000642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.315+0000 7f75fffff700 1 -- 172.21.15.78:0/1585963788 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600063310 con 0x7f76000a7bd0 2023-08-17T17:34:26.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.315+0000 7f7604c07700 1 --2- 172.21.15.78:0/1585963788 >> v2:172.21.15.78:3300/0 conn(0x7f76000c01b0 0x7f76000c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:26.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.316+0000 7f75fffff700 1 --2- 172.21.15.78:0/1585963788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76000a7bd0 0x7f7600063df0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7600098d60 tx=0x7f75ec009060).ready entity=mon.1 client_cookie=fd849d7ca4f05351 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:26.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.317+0000 7f75ff7fe700 1 -- 172.21.15.78:0/1585963788 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec00d4a0 con 0x7f76000a7bd0 2023-08-17T17:34:26.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.317+0000 7f75ff7fe700 1 -- 172.21.15.78:0/1585963788 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec00d600 con 0x7f76000a7bd0 2023-08-17T17:34:26.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.317+0000 7f75ff7fe700 1 -- 172.21.15.78:0/1585963788 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec00d980 con 0x7f76000a7bd0 2023-08-17T17:34:26.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.318+0000 7f7605c09700 1 -- 172.21.15.78:0/1585963788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76000a7bd0 msgr2=0x7f7600063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.318+0000 7f7605c09700 1 --2- 172.21.15.78:0/1585963788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76000a7bd0 0x7f7600063df0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7600098d60 tx=0x7f75ec009060).stop 2023-08-17T17:34:26.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.318+0000 7f7605c09700 1 -- 172.21.15.78:0/1585963788 shutdown_connections 2023-08-17T17:34:26.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.318+0000 7f7605c09700 1 --2- 172.21.15.78:0/1585963788 >> v2:172.21.15.78:3300/0 conn(0x7f76000c01b0 0x7f76000c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.318+0000 7f7605c09700 1 --2- 172.21.15.78:0/1585963788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76000a7bd0 0x7f7600063df0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.318+0000 7f7605c09700 1 -- 172.21.15.78:0/1585963788 >> 172.21.15.78:0/1585963788 conn(0x7f760006a6c0 msgr2=0x7f76000cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:26.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.318+0000 7f7605c09700 1 -- 172.21.15.78:0/1585963788 shutdown_connections 2023-08-17T17:34:26.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.318+0000 7f7605c09700 1 -- 172.21.15.78:0/1585963788 wait complete. 2023-08-17T17:34:26.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.319+0000 7f7605c09700 1 Processor -- start 2023-08-17T17:34:26.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.319+0000 7f7605c09700 1 -- start start 2023-08-17T17:34:26.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f7605c09700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76000a7bd0 0x7f760014e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f7605c09700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76000a8050 0x7f7600164380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f7605c09700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76000c01b0 0x7f76000c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f7605c09700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600155370 con 0x7f76000a8050 2023-08-17T17:34:26.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f7605c09700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76001652b0 con 0x7f76000c01b0 2023-08-17T17:34:26.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f7605c09700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7600164cf0 con 0x7f76000a7bd0 2023-08-17T17:34:26.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f75fffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76000a8050 0x7f7600164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f75fffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76000a8050 0x7f7600164380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54258/0 (socket says 172.21.15.78:54258) 2023-08-17T17:34:26.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f75fffff700 1 -- 172.21.15.78:0/3098648960 learned_addr learned my addr 172.21.15.78:0/3098648960 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:26.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f7605408700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76000c01b0 0x7f76000c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f7604c07700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76000a7bd0 0x7f760014e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f75fffff700 1 -- 172.21.15.78:0/3098648960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76000a7bd0 msgr2=0x7f760014e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f75fffff700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76000a7bd0 0x7f760014e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f75fffff700 1 -- 172.21.15.78:0/3098648960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76000c01b0 msgr2=0x7f76000c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f75fffff700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76000c01b0 0x7f76000c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.320+0000 7f75fffff700 1 -- 172.21.15.78:0/3098648960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f40092a0 con 0x7f76000a8050 2023-08-17T17:34:26.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.321+0000 7f75fffff700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76000a8050 0x7f7600164380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f75ec011fb0 tx=0x7f75ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:26.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.321+0000 7f75fcff9700 1 -- 172.21.15.78:0/3098648960 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec021070 con 0x7f76000a8050 2023-08-17T17:34:26.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.321+0000 7f75fcff9700 1 -- 172.21.15.78:0/3098648960 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec000c90 con 0x7f76000a8050 2023-08-17T17:34:26.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.321+0000 7f7605c09700 1 -- 172.21.15.78:0/3098648960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec0092a0 con 0x7f76000a8050 2023-08-17T17:34:26.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.321+0000 7f75fcff9700 1 -- 172.21.15.78:0/3098648960 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec00d9a0 con 0x7f76000a8050 2023-08-17T17:34:26.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.321+0000 7f7605c09700 1 -- 172.21.15.78:0/3098648960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76000aba80 con 0x7f76000a8050 2023-08-17T17:34:26.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.322+0000 7f7605c09700 1 -- 172.21.15.78:0/3098648960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7600083af0 con 0x7f76000a8050 2023-08-17T17:34:26.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.322+0000 7f75fcff9700 1 -- 172.21.15.78:0/3098648960 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f75ec00f070 con 0x7f76000a8050 2023-08-17T17:34:26.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.322+0000 7f75fcff9700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75e405ed60 0x7f75e4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.322+0000 7f7604c07700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75e405ed60 0x7f75e4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.322+0000 7f75fcff9700 1 -- 172.21.15.78:0/3098648960 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f75ec07ace0 con 0x7f76000a8050 2023-08-17T17:34:26.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.323+0000 7f7604c07700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75e405ed60 0x7f75e4061220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f75f4009d00 tx=0x7f75f4009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:26.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.326+0000 7f75fcff9700 1 -- 172.21.15.78:0/3098648960 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75ec04c280 con 0x7f76000a8050 2023-08-17T17:34:26.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.485+0000 7f7605c09700 1 -- 172.21.15.78:0/3098648960 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76000635f0 con 0x7f75e405ed60 2023-08-17T17:34:26.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.494+0000 7f75fcff9700 1 -- 172.21.15.78:0/3098648960 <== mgr.4104 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325242 (secure 0 0 0) 0x7f76000635f0 con 0x7f75e405ed60 2023-08-17T17:34:26.498 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:26.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 -- 172.21.15.78:0/3098648960 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75e405ed60 msgr2=0x7f75e4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75e405ed60 0x7f75e4061220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f75f4009d00 tx=0x7f75f4009060).stop 2023-08-17T17:34:26.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 -- 172.21.15.78:0/3098648960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76000a8050 msgr2=0x7f7600164380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76000a8050 0x7f7600164380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f75ec011fb0 tx=0x7f75ec016000).stop 2023-08-17T17:34:26.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 -- 172.21.15.78:0/3098648960 shutdown_connections 2023-08-17T17:34:26.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75e405ed60 0x7f75e4061220 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76000c01b0 0x7f76000c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76000a7bd0 0x7f760014e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 --2- 172.21.15.78:0/3098648960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76000a8050 0x7f7600164380 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 -- 172.21.15.78:0/3098648960 >> 172.21.15.78:0/3098648960 conn(0x7f760006a6c0 msgr2=0x7f76000c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:26.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 -- 172.21.15.78:0/3098648960 shutdown_connections 2023-08-17T17:34:26.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.497+0000 7f7605c09700 1 -- 172.21.15.78:0/3098648960 wait complete. 2023-08-17T17:34:26.501 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:34:26.510 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-17T17:34:25.008719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2378092,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596628,"statfs":{"total":773094113280,"available":770658947072,"internally_reserved":0,"allocated":1355776,"data_stored":427831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.071908+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:34:19.071908+0000","last_peered":"2023-08-17T17:34:19.071908+0000","last_clean":"2023-08-17T17:34:19.071908+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:34:19.071908+0000","last_undegraded":"2023-08-17T17:34:19.071908+0000","last_fullsized":"2023-08-17T17:34:19.071908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.073428+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:34:19.073428+0000","last_peered":"2023-08-17T17:34:19.073428+0000","last_clean":"2023-08-17T17:34:19.073428+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:34:19.073428+0000","last_undegraded":"2023-08-17T17:34:19.073428+0000","last_fullsized":"2023-08-17T17:34:19.073428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.804074+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:34:19.804074+0000","last_peered":"2023-08-17T17:34:19.804074+0000","last_clean":"2023-08-17T17:34:19.804074+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:34:19.804074+0000","last_undegraded":"2023-08-17T17:34:19.804074+0000","last_fullsized":"2023-08-17T17:34:19.804074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.067736+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:34:19.067736+0000","last_peered":"2023-08-17T17:34:19.067736+0000","last_clean":"2023-08-17T17:34:19.067736+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:34:19.067736+0000","last_undegraded":"2023-08-17T17:34:19.067736+0000","last_fullsized":"2023-08-17T17:34:19.067736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-17T17:34:18.065356+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:34:18.065356+0000","last_peered":"2023-08-17T17:34:18.065356+0000","last_clean":"2023-08-17T17:34:18.065356+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:34:18.065356+0000","last_undegraded":"2023-08-17T17:34:18.065356+0000","last_fullsized":"2023-08-17T17:34:18.065356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.062857+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:34:19.062857+0000","last_peered":"2023-08-17T17:34:19.062857+0000","last_clean":"2023-08-17T17:34:19.062857+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:34:19.062857+0000","last_undegraded":"2023-08-17T17:34:19.062857+0000","last_fullsized":"2023-08-17T17:34:19.062857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.061686+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:34:19.061686+0000","last_peered":"2023-08-17T17:34:19.061686+0000","last_clean":"2023-08-17T17:34:19.061686+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:34:19.061686+0000","last_undegraded":"2023-08-17T17:34:19.061686+0000","last_fullsized":"2023-08-17T17:34:19.061686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.071930+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:34:19.071930+0000","last_peered":"2023-08-17T17:34:19.071930+0000","last_clean":"2023-08-17T17:34:19.071930+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:34:19.071930+0000","last_undegraded":"2023-08-17T17:34:19.071930+0000","last_fullsized":"2023-08-17T17:34:19.071930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.062757+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:34:19.062757+0000","last_peered":"2023-08-17T17:34:19.062757+0000","last_clean":"2023-08-17T17:34:19.062757+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:34:19.062757+0000","last_undegraded":"2023-08-17T17:34:19.062757+0000","last_fullsized":"2023-08-17T17:34:19.062757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":46920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:34:26.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:34:26.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.661+0000 7f56847b5700 1 Processor -- start 2023-08-17T17:34:26.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.661+0000 7f56847b5700 1 -- start start 2023-08-17T17:34:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.662+0000 7f56847b5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f567c154140 0x7f567c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.662+0000 7f56847b5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f567c0c1010 0x7f567c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.662+0000 7f56847b5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567c154520 con 0x7f567c0a7c40 2023-08-17T17:34:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.662+0000 7f56847b5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c0c91e0 con 0x7f567c0c1010 2023-08-17T17:34:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.662+0000 7f56847b5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c0c94c0 con 0x7f567c154140 2023-08-17T17:34:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.662+0000 7f5682d52700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f567c0c1010 0x7f567c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.662+0000 7f5681d50700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f567c0a7c40 0x7f567c0c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36368/0 (socket says 172.21.15.78:36368) 2023-08-17T17:34:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.662+0000 7f5681d50700 1 -- 172.21.15.78:0/2093389534 learned_addr learned my addr 172.21.15.78:0/2093389534 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.662+0000 7f5682551700 1 --2- 172.21.15.78:0/2093389534 >> v2:172.21.15.150:3300/0 conn(0x7f567c154140 0x7f567c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f5682d52700 1 -- 172.21.15.78:0/2093389534 >> v2:172.21.15.150:3300/0 conn(0x7f567c154140 msgr2=0x7f567c0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f5682d52700 1 --2- 172.21.15.78:0/2093389534 >> v2:172.21.15.150:3300/0 conn(0x7f567c154140 0x7f567c0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f5682d52700 1 -- 172.21.15.78:0/2093389534 >> v1:172.21.15.78:6789/0 conn(0x7f567c0a7c40 legacy=0x7f567c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f568154f700 1 -- 172.21.15.78:0/2093389534 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680556618 0 0) 0x7f567c154520 con 0x7f567c0a7c40 2023-08-17T17:34:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f5682d52700 1 -- 172.21.15.78:0/2093389534 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c0c97a0 con 0x7f567c0c1010 2023-08-17T17:34:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f5682d52700 1 --2- 172.21.15.78:0/2093389534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 0x7f567c0ca280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f567c0625b0 tx=0x7f5674009780).ready entity=mon.0 client_cookie=4d2c44cff603a9e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f568154f700 1 -- 172.21.15.78:0/2093389534 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567400e070 con 0x7f567c0c1010 2023-08-17T17:34:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f568154f700 1 -- 172.21.15.78:0/2093389534 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567400bb60 con 0x7f567c0c1010 2023-08-17T17:34:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f568154f700 1 -- 172.21.15.78:0/2093389534 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674012410 con 0x7f567c0c1010 2023-08-17T17:34:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f56847b5700 1 -- 172.21.15.78:0/2093389534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 msgr2=0x7f567c0ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.663+0000 7f56847b5700 1 --2- 172.21.15.78:0/2093389534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 0x7f567c0ca280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f567c0625b0 tx=0x7f5674009780).stop 2023-08-17T17:34:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.664+0000 7f56847b5700 1 -- 172.21.15.78:0/2093389534 shutdown_connections 2023-08-17T17:34:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.664+0000 7f56847b5700 1 --2- 172.21.15.78:0/2093389534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 0x7f567c0ca280 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.664+0000 7f56847b5700 1 --2- 172.21.15.78:0/2093389534 >> v2:172.21.15.150:3300/0 conn(0x7f567c154140 0x7f567c0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.664+0000 7f56847b5700 1 -- 172.21.15.78:0/2093389534 >> 172.21.15.78:0/2093389534 conn(0x7f567c094510 msgr2=0x7f567c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.664+0000 7f56847b5700 1 -- 172.21.15.78:0/2093389534 shutdown_connections 2023-08-17T17:34:26.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.664+0000 7f56847b5700 1 -- 172.21.15.78:0/2093389534 wait complete. 2023-08-17T17:34:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f56847b5700 1 Processor -- start 2023-08-17T17:34:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f56847b5700 1 -- start start 2023-08-17T17:34:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f56847b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f567c0a7c40 0x7f567c0c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f56847b5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 0x7f567c0965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f56847b5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f567c154140 0x7f567c096aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f56847b5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c0c5250 con 0x7f567c0c1010 2023-08-17T17:34:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f56847b5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c0b0280 con 0x7f567c154140 2023-08-17T17:34:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f56847b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c0af950 con 0x7f567c0a7c40 2023-08-17T17:34:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f5681d50700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 0x7f567c0965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f5681d50700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 0x7f567c0965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54268/0 (socket says 172.21.15.78:54268) 2023-08-17T17:34:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.665+0000 7f5681d50700 1 -- 172.21.15.78:0/1635796803 learned_addr learned my addr 172.21.15.78:0/1635796803 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f5682551700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f567c0a7c40 0x7f567c0c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f5682d52700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f567c154140 0x7f567c096aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f5681d50700 1 -- 172.21.15.78:0/1635796803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f567c0a7c40 msgr2=0x7f567c0c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f5681d50700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f567c0a7c40 0x7f567c0c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f5681d50700 1 -- 172.21.15.78:0/1635796803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f567c154140 msgr2=0x7f567c096aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f5681d50700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f567c154140 0x7f567c096aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f5681d50700 1 -- 172.21.15.78:0/1635796803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5674009a20 con 0x7f567c0c1010 2023-08-17T17:34:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f5682d52700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f567c154140 0x7f567c096aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:26.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f5681d50700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 0x7f567c0965b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f566c001eb0 tx=0x7f566c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:26.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f56727fc700 1 -- 172.21.15.78:0/1635796803 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0072e0 con 0x7f567c0c1010 2023-08-17T17:34:26.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f56727fc700 1 -- 172.21.15.78:0/1635796803 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c007440 con 0x7f567c0c1010 2023-08-17T17:34:26.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f56847b5700 1 -- 172.21.15.78:0/1635796803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567c0afc30 con 0x7f567c0c1010 2023-08-17T17:34:26.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f56727fc700 1 -- 172.21.15.78:0/1635796803 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0057a0 con 0x7f567c0c1010 2023-08-17T17:34:26.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.666+0000 7f56847b5700 1 -- 172.21.15.78:0/1635796803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c0c4f10 con 0x7f567c0c1010 2023-08-17T17:34:26.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.667+0000 7f56847b5700 1 -- 172.21.15.78:0/1635796803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567c047350 con 0x7f567c0c1010 2023-08-17T17:34:26.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.667+0000 7f56727fc700 1 -- 172.21.15.78:0/1635796803 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f566c01a060 con 0x7f567c0c1010 2023-08-17T17:34:26.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.667+0000 7f56727fc700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f566005ed90 0x7f5660061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:26.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.668+0000 7f56727fc700 1 -- 172.21.15.78:0/1635796803 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f566c0792c0 con 0x7f567c0c1010 2023-08-17T17:34:26.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.668+0000 7f5682551700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f566005ed90 0x7f5660061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:26.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.668+0000 7f5682551700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f566005ed90 0x7f5660061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5678009bc0 tx=0x7f5678008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.672+0000 7f56727fc700 1 -- 172.21.15.78:0/1635796803 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f566c04a860 con 0x7f567c0c1010 2023-08-17T17:34:26.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.831+0000 7f56847b5700 1 -- 172.21.15.78:0/1635796803 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f567c0b0830 con 0x7f566005ed90 2023-08-17T17:34:26.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.839+0000 7f56727fc700 1 -- 172.21.15.78:0/1635796803 <== mgr.4104 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325242 (secure 0 0 0) 0x7f567c0b0830 con 0x7f566005ed90 2023-08-17T17:34:26.844 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:26.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 -- 172.21.15.78:0/1635796803 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f566005ed90 msgr2=0x7f5660061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f566005ed90 0x7f5660061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5678009bc0 tx=0x7f5678008040).stop 2023-08-17T17:34:26.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 -- 172.21.15.78:0/1635796803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 msgr2=0x7f567c0965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:26.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 0x7f567c0965b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f566c001eb0 tx=0x7f566c007e90).stop 2023-08-17T17:34:26.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 -- 172.21.15.78:0/1635796803 shutdown_connections 2023-08-17T17:34:26.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f566005ed90 0x7f5660061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f567c154140 0x7f567c096aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f567c0a7c40 0x7f567c0c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 --2- 172.21.15.78:0/1635796803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f567c0c1010 0x7f567c0965b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:26.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 -- 172.21.15.78:0/1635796803 >> 172.21.15.78:0/1635796803 conn(0x7f567c094510 msgr2=0x7f567c0c04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:26.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 -- 172.21.15.78:0/1635796803 shutdown_connections 2023-08-17T17:34:26.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:26.843+0000 7f56847b5700 1 -- 172.21.15.78:0/1635796803 wait complete. 2023-08-17T17:34:26.847 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:34:26.856 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-17T17:34:25.008719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2378092,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596628,"statfs":{"total":773094113280,"available":770658947072,"internally_reserved":0,"allocated":1355776,"data_stored":427831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.071908+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:34:19.071908+0000","last_peered":"2023-08-17T17:34:19.071908+0000","last_clean":"2023-08-17T17:34:19.071908+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:34:19.071908+0000","last_undegraded":"2023-08-17T17:34:19.071908+0000","last_fullsized":"2023-08-17T17:34:19.071908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.073428+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:34:19.073428+0000","last_peered":"2023-08-17T17:34:19.073428+0000","last_clean":"2023-08-17T17:34:19.073428+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:34:19.073428+0000","last_undegraded":"2023-08-17T17:34:19.073428+0000","last_fullsized":"2023-08-17T17:34:19.073428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.804074+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:34:19.804074+0000","last_peered":"2023-08-17T17:34:19.804074+0000","last_clean":"2023-08-17T17:34:19.804074+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:34:19.804074+0000","last_undegraded":"2023-08-17T17:34:19.804074+0000","last_fullsized":"2023-08-17T17:34:19.804074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.067736+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:34:19.067736+0000","last_peered":"2023-08-17T17:34:19.067736+0000","last_clean":"2023-08-17T17:34:19.067736+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:34:19.067736+0000","last_undegraded":"2023-08-17T17:34:19.067736+0000","last_fullsized":"2023-08-17T17:34:19.067736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-17T17:34:18.065356+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:34:18.065356+0000","last_peered":"2023-08-17T17:34:18.065356+0000","last_clean":"2023-08-17T17:34:18.065356+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:34:18.065356+0000","last_undegraded":"2023-08-17T17:34:18.065356+0000","last_fullsized":"2023-08-17T17:34:18.065356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.062857+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:34:19.062857+0000","last_peered":"2023-08-17T17:34:19.062857+0000","last_clean":"2023-08-17T17:34:19.062857+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:34:19.062857+0000","last_undegraded":"2023-08-17T17:34:19.062857+0000","last_fullsized":"2023-08-17T17:34:19.062857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.061686+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:34:19.061686+0000","last_peered":"2023-08-17T17:34:19.061686+0000","last_clean":"2023-08-17T17:34:19.061686+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:34:19.061686+0000","last_undegraded":"2023-08-17T17:34:19.061686+0000","last_fullsized":"2023-08-17T17:34:19.061686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.071930+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:34:19.071930+0000","last_peered":"2023-08-17T17:34:19.071930+0000","last_clean":"2023-08-17T17:34:19.071930+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:34:19.071930+0000","last_undegraded":"2023-08-17T17:34:19.071930+0000","last_fullsized":"2023-08-17T17:34:19.071930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-17T17:34:19.062757+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:34:19.062757+0000","last_peered":"2023-08-17T17:34:19.062757+0000","last_clean":"2023-08-17T17:34:19.062757+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:34:19.062757+0000","last_undegraded":"2023-08-17T17:34:19.062757+0000","last_fullsized":"2023-08-17T17:34:19.062757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:23.163284+0000","last_change":"2023-08-17T17:34:23.163284+0000","last_active":"2023-08-17T17:34:23.163284+0000","last_peered":"2023-08-17T17:34:23.163284+0000","last_clean":"2023-08-17T17:34:23.163284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:23.163284+0000","last_undegraded":"2023-08-17T17:34:23.163284+0000","last_fullsized":"2023-08-17T17:34:23.163284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:34:22.161581+0000","last_change":"2023-08-17T17:34:22.161581+0000","last_active":"2023-08-17T17:34:22.161581+0000","last_peered":"2023-08-17T17:34:22.161581+0000","last_clean":"2023-08-17T17:34:22.161581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:34:22.161581+0000","last_undegraded":"2023-08-17T17:34:22.161581+0000","last_fullsized":"2023-08-17T17:34:22.161581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":46920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:34:26.864 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:34:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.007+0000 7f63dfba8700 1 Processor -- start 2023-08-17T17:34:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.007+0000 7f63dfba8700 1 -- start start 2023-08-17T17:34:27.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.008+0000 7f63dfba8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63d8154140 0x7f63d80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.008+0000 7f63dfba8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63d80a7c40 0x7f63d80c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.008+0000 7f63dfba8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d8154520 con 0x7f63d80a8080 2023-08-17T17:34:27.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.008+0000 7f63dfba8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d80c91e0 con 0x7f63d80a7c40 2023-08-17T17:34:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.008+0000 7f63dfba8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80c94c0 con 0x7f63d8154140 2023-08-17T17:34:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.008+0000 7f63dd143700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63d80a7c40 0x7f63d80c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.008+0000 7f63dd143700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63d80a7c40 0x7f63d80c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54278/0 (socket says 172.21.15.78:54278) 2023-08-17T17:34:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.008+0000 7f63dd143700 1 -- 172.21.15.78:0/3465477139 learned_addr learned my addr 172.21.15.78:0/3465477139 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.008+0000 7f63dd944700 1 --2- 172.21.15.78:0/3465477139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63d8154140 0x7f63d80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dd143700 1 -- 172.21.15.78:0/3465477139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63d8154140 msgr2=0x7f63d80c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dd143700 1 --2- 172.21.15.78:0/3465477139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63d8154140 0x7f63d80c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dd143700 1 -- 172.21.15.78:0/3465477139 >> v1:172.21.15.150:6789/0 conn(0x7f63d80a8080 legacy=0x7f63d80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dd143700 1 -- 172.21.15.78:0/3465477139 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d80c97a0 con 0x7f63d80a7c40 2023-08-17T17:34:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dd143700 1 --2- 172.21.15.78:0/3465477139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a7c40 0x7f63d80c0900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f63c8006fd0 tx=0x7f63c80090f0).ready entity=mon.0 client_cookie=105516e2434ed761 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dc942700 1 -- 172.21.15.78:0/3465477139 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800b580 con 0x7f63d80a7c40 2023-08-17T17:34:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dc942700 1 -- 172.21.15.78:0/3465477139 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c800b6e0 con 0x7f63d80a7c40 2023-08-17T17:34:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dc942700 1 -- 172.21.15.78:0/3465477139 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800ba60 con 0x7f63d80a7c40 2023-08-17T17:34:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dfba8700 1 -- 172.21.15.78:0/3465477139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a7c40 msgr2=0x7f63d80c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dfba8700 1 --2- 172.21.15.78:0/3465477139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a7c40 0x7f63d80c0900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f63c8006fd0 tx=0x7f63c80090f0).stop 2023-08-17T17:34:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dfba8700 1 -- 172.21.15.78:0/3465477139 shutdown_connections 2023-08-17T17:34:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dfba8700 1 --2- 172.21.15.78:0/3465477139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63d8154140 0x7f63d80c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dfba8700 1 --2- 172.21.15.78:0/3465477139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a7c40 0x7f63d80c0900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dfba8700 1 -- 172.21.15.78:0/3465477139 >> 172.21.15.78:0/3465477139 conn(0x7f63d8094510 msgr2=0x7f63d806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.009+0000 7f63dfba8700 1 -- 172.21.15.78:0/3465477139 shutdown_connections 2023-08-17T17:34:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.010+0000 7f63dfba8700 1 -- 172.21.15.78:0/3465477139 wait complete. 2023-08-17T17:34:27.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.011+0000 7f63dfba8700 1 Processor -- start 2023-08-17T17:34:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.011+0000 7f63dfba8700 1 -- start start 2023-08-17T17:34:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.011+0000 7f63dfba8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63d80a7c40 0x7f63d814ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.011+0000 7f63dfba8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a8080 0x7f63d80ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dfba8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63d8154140 0x7f63d81506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dfba8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80ab720 con 0x7f63d80a8080 2023-08-17T17:34:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dfba8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80aab10 con 0x7f63d8154140 2023-08-17T17:34:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dfba8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80aadf0 con 0x7f63d80a7c40 2023-08-17T17:34:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dd143700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a8080 0x7f63d80ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dd143700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a8080 0x7f63d80ac500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54294/0 (socket says 172.21.15.78:54294) 2023-08-17T17:34:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dd143700 1 -- 172.21.15.78:0/228391505 learned_addr learned my addr 172.21.15.78:0/228391505 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63de145700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63d8154140 0x7f63d81506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dd944700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63d80a7c40 0x7f63d814ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dd143700 1 -- 172.21.15.78:0/228391505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63d80a7c40 msgr2=0x7f63d814ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dd143700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63d80a7c40 0x7f63d814ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dd143700 1 -- 172.21.15.78:0/228391505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63d8154140 msgr2=0x7f63d81506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dd143700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63d8154140 0x7f63d81506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dd143700 1 -- 172.21.15.78:0/228391505 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8009370 con 0x7f63d80a8080 2023-08-17T17:34:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dd143700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a8080 0x7f63d80ac500 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f63c8009130 tx=0x7f63c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63cdffb700 1 -- 172.21.15.78:0/228391505 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800b850 con 0x7f63d80a8080 2023-08-17T17:34:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63cdffb700 1 -- 172.21.15.78:0/228391505 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c800b9b0 con 0x7f63d80a8080 2023-08-17T17:34:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dfba8700 1 -- 172.21.15.78:0/228391505 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d80ab0d0 con 0x7f63d80a8080 2023-08-17T17:34:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63cdffb700 1 -- 172.21.15.78:0/228391505 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c801c670 con 0x7f63d80a8080 2023-08-17T17:34:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.012+0000 7f63dfba8700 1 -- 172.21.15.78:0/228391505 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d814ef40 con 0x7f63d80a8080 2023-08-17T17:34:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.013+0000 7f63dfba8700 1 -- 172.21.15.78:0/228391505 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d80ab890 con 0x7f63d80a8080 2023-08-17T17:34:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.014+0000 7f63cdffb700 1 -- 172.21.15.78:0/228391505 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f63c802c070 con 0x7f63d80a8080 2023-08-17T17:34:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.014+0000 7f63cdffb700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f63bc05ed90 0x7f63bc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.014+0000 7f63cdffb700 1 -- 172.21.15.78:0/228391505 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f63c807b6d0 con 0x7f63d80a8080 2023-08-17T17:34:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.014+0000 7f63dd944700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f63bc05ed90 0x7f63bc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.014+0000 7f63dd944700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f63bc05ed90 0x7f63bc061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f63d8153050 tx=0x7f63d400b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:27.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.018+0000 7f63cdffb700 1 -- 172.21.15.78:0/228391505 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63c804cc70 con 0x7f63d80a8080 2023-08-17T17:34:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.178+0000 7f63dfba8700 1 -- 172.21.15.78:0/228391505 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63d8047350 con 0x7f63bc05ed90 2023-08-17T17:34:27.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.187+0000 7f63cdffb700 1 -- 172.21.15.78:0/228391505 <== mgr.4104 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336402 (secure 0 0 0) 0x7f63d8047350 con 0x7f63bc05ed90 2023-08-17T17:34:27.192 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 -- 172.21.15.78:0/228391505 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f63bc05ed90 msgr2=0x7f63bc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f63bc05ed90 0x7f63bc061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f63d8153050 tx=0x7f63d400b040).stop 2023-08-17T17:34:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 -- 172.21.15.78:0/228391505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a8080 msgr2=0x7f63d80ac500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a8080 0x7f63d80ac500 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f63c8009130 tx=0x7f63c8017000).stop 2023-08-17T17:34:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 -- 172.21.15.78:0/228391505 shutdown_connections 2023-08-17T17:34:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f63bc05ed90 0x7f63bc061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63d8154140 0x7f63d81506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63d80a7c40 0x7f63d814ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 --2- 172.21.15.78:0/228391505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d80a8080 0x7f63d80ac500 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 -- 172.21.15.78:0/228391505 >> 172.21.15.78:0/228391505 conn(0x7f63d8094510 msgr2=0x7f63d81530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 -- 172.21.15.78:0/228391505 shutdown_connections 2023-08-17T17:34:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.190+0000 7f63dfba8700 1 -- 172.21.15.78:0/228391505 wait complete. 2023-08-17T17:34:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:34:27.203 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:34:27.009043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378552,"kb_used_data":1784,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596168,"statfs":{"total":773094113280,"available":770658476032,"internally_reserved":0,"allocated":1826816,"data_stored":647116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557678+0000","last_change":"2023-08-17T17:34:23.557678+0000","last_active":"2023-08-17T17:34:23.557678+0000","last_peered":"2023-08-17T17:34:23.557678+0000","last_clean":"2023-08-17T17:34:23.557678+0000","last_became_active":"2023-08-17T17:34:23.555333+0000","last_became_peered":"2023-08-17T17:34:23.555333+0000","last_unstale":"2023-08-17T17:34:23.557678+0000","last_undegraded":"2023-08-17T17:34:23.557678+0000","last_fullsized":"2023-08-17T17:34:23.557678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.197613+0000","last_change":"2023-08-17T17:34:23.190017+0000","last_active":"2023-08-17T17:34:23.197613+0000","last_peered":"2023-08-17T17:34:23.197613+0000","last_clean":"2023-08-17T17:34:23.197613+0000","last_became_active":"2023-08-17T17:34:23.189552+0000","last_became_peered":"2023-08-17T17:34:23.189552+0000","last_unstale":"2023-08-17T17:34:23.197613+0000","last_undegraded":"2023-08-17T17:34:23.197613+0000","last_fullsized":"2023-08-17T17:34:23.197613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547846+0000","last_change":"2023-08-17T17:34:23.547846+0000","last_active":"2023-08-17T17:34:23.547846+0000","last_peered":"2023-08-17T17:34:23.547846+0000","last_clean":"2023-08-17T17:34:23.547846+0000","last_became_active":"2023-08-17T17:34:23.547522+0000","last_became_peered":"2023-08-17T17:34:23.547522+0000","last_unstale":"2023-08-17T17:34:23.547846+0000","last_undegraded":"2023-08-17T17:34:23.547846+0000","last_fullsized":"2023-08-17T17:34:23.547846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199221+0000","last_change":"2023-08-17T17:34:23.196197+0000","last_active":"2023-08-17T17:34:23.199221+0000","last_peered":"2023-08-17T17:34:23.199221+0000","last_clean":"2023-08-17T17:34:23.199221+0000","last_became_active":"2023-08-17T17:34:23.195910+0000","last_became_peered":"2023-08-17T17:34:23.195910+0000","last_unstale":"2023-08-17T17:34:23.199221+0000","last_undegraded":"2023-08-17T17:34:23.199221+0000","last_fullsized":"2023-08-17T17:34:23.199221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550439+0000","last_change":"2023-08-17T17:34:23.550439+0000","last_active":"2023-08-17T17:34:23.550439+0000","last_peered":"2023-08-17T17:34:23.550439+0000","last_clean":"2023-08-17T17:34:23.550439+0000","last_became_active":"2023-08-17T17:34:23.550192+0000","last_became_peered":"2023-08-17T17:34:23.550192+0000","last_unstale":"2023-08-17T17:34:23.550439+0000","last_undegraded":"2023-08-17T17:34:23.550439+0000","last_fullsized":"2023-08-17T17:34:23.550439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195568+0000","last_change":"2023-08-17T17:34:23.186362+0000","last_active":"2023-08-17T17:34:23.195568+0000","last_peered":"2023-08-17T17:34:23.195568+0000","last_clean":"2023-08-17T17:34:23.195568+0000","last_became_active":"2023-08-17T17:34:23.186076+0000","last_became_peered":"2023-08-17T17:34:23.186076+0000","last_unstale":"2023-08-17T17:34:23.195568+0000","last_undegraded":"2023-08-17T17:34:23.195568+0000","last_fullsized":"2023-08-17T17:34:23.195568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558066+0000","last_change":"2023-08-17T17:34:23.558066+0000","last_active":"2023-08-17T17:34:23.558066+0000","last_peered":"2023-08-17T17:34:23.558066+0000","last_clean":"2023-08-17T17:34:23.558066+0000","last_became_active":"2023-08-17T17:34:23.557750+0000","last_became_peered":"2023-08-17T17:34:23.557750+0000","last_unstale":"2023-08-17T17:34:23.558066+0000","last_undegraded":"2023-08-17T17:34:23.558066+0000","last_fullsized":"2023-08-17T17:34:23.558066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193455+0000","last_change":"2023-08-17T17:34:23.185772+0000","last_active":"2023-08-17T17:34:23.193455+0000","last_peered":"2023-08-17T17:34:23.193455+0000","last_clean":"2023-08-17T17:34:23.193455+0000","last_became_active":"2023-08-17T17:34:23.185206+0000","last_became_peered":"2023-08-17T17:34:23.185206+0000","last_unstale":"2023-08-17T17:34:23.193455+0000","last_undegraded":"2023-08-17T17:34:23.193455+0000","last_fullsized":"2023-08-17T17:34:23.193455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558454+0000","last_change":"2023-08-17T17:34:23.558454+0000","last_active":"2023-08-17T17:34:23.558454+0000","last_peered":"2023-08-17T17:34:23.558454+0000","last_clean":"2023-08-17T17:34:23.558454+0000","last_became_active":"2023-08-17T17:34:23.558213+0000","last_became_peered":"2023-08-17T17:34:23.558213+0000","last_unstale":"2023-08-17T17:34:23.558454+0000","last_undegraded":"2023-08-17T17:34:23.558454+0000","last_fullsized":"2023-08-17T17:34:23.558454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538249+0000","last_change":"2023-08-17T17:34:23.188666+0000","last_active":"2023-08-17T17:34:23.538249+0000","last_peered":"2023-08-17T17:34:23.538249+0000","last_clean":"2023-08-17T17:34:23.538249+0000","last_became_active":"2023-08-17T17:34:23.188351+0000","last_became_peered":"2023-08-17T17:34:23.188351+0000","last_unstale":"2023-08-17T17:34:23.538249+0000","last_undegraded":"2023-08-17T17:34:23.538249+0000","last_fullsized":"2023-08-17T17:34:23.538249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550268+0000","last_change":"2023-08-17T17:34:23.550268+0000","last_active":"2023-08-17T17:34:23.550268+0000","last_peered":"2023-08-17T17:34:23.550268+0000","last_clean":"2023-08-17T17:34:23.550268+0000","last_became_active":"2023-08-17T17:34:23.549994+0000","last_became_peered":"2023-08-17T17:34:23.549994+0000","last_unstale":"2023-08-17T17:34:23.550268+0000","last_undegraded":"2023-08-17T17:34:23.550268+0000","last_fullsized":"2023-08-17T17:34:23.550268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561285+0000","last_change":"2023-08-17T17:34:23.187424+0000","last_active":"2023-08-17T17:34:23.561285+0000","last_peered":"2023-08-17T17:34:23.561285+0000","last_clean":"2023-08-17T17:34:23.561285+0000","last_became_active":"2023-08-17T17:34:23.187090+0000","last_became_peered":"2023-08-17T17:34:23.187090+0000","last_unstale":"2023-08-17T17:34:23.561285+0000","last_undegraded":"2023-08-17T17:34:23.561285+0000","last_fullsized":"2023-08-17T17:34:23.561285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550226+0000","last_change":"2023-08-17T17:34:23.550226+0000","last_active":"2023-08-17T17:34:23.550226+0000","last_peered":"2023-08-17T17:34:23.550226+0000","last_clean":"2023-08-17T17:34:23.550226+0000","last_became_active":"2023-08-17T17:34:23.549894+0000","last_became_peered":"2023-08-17T17:34:23.549894+0000","last_unstale":"2023-08-17T17:34:23.550226+0000","last_undegraded":"2023-08-17T17:34:23.550226+0000","last_fullsized":"2023-08-17T17:34:23.550226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557544+0000","last_change":"2023-08-17T17:34:23.191048+0000","last_active":"2023-08-17T17:34:23.557544+0000","last_peered":"2023-08-17T17:34:23.557544+0000","last_clean":"2023-08-17T17:34:23.557544+0000","last_became_active":"2023-08-17T17:34:23.189624+0000","last_became_peered":"2023-08-17T17:34:23.189624+0000","last_unstale":"2023-08-17T17:34:23.557544+0000","last_undegraded":"2023-08-17T17:34:23.557544+0000","last_fullsized":"2023-08-17T17:34:23.557544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.560468+0000","last_change":"2023-08-17T17:34:23.560468+0000","last_active":"2023-08-17T17:34:23.560468+0000","last_peered":"2023-08-17T17:34:23.560468+0000","last_clean":"2023-08-17T17:34:23.560468+0000","last_became_active":"2023-08-17T17:34:23.560200+0000","last_became_peered":"2023-08-17T17:34:23.560200+0000","last_unstale":"2023-08-17T17:34:23.560468+0000","last_undegraded":"2023-08-17T17:34:23.560468+0000","last_fullsized":"2023-08-17T17:34:23.560468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541621+0000","last_change":"2023-08-17T17:34:23.192628+0000","last_active":"2023-08-17T17:34:23.541621+0000","last_peered":"2023-08-17T17:34:23.541621+0000","last_clean":"2023-08-17T17:34:23.541621+0000","last_became_active":"2023-08-17T17:34:23.192359+0000","last_became_peered":"2023-08-17T17:34:23.192359+0000","last_unstale":"2023-08-17T17:34:23.541621+0000","last_undegraded":"2023-08-17T17:34:23.541621+0000","last_fullsized":"2023-08-17T17:34:23.541621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554345+0000","last_change":"2023-08-17T17:34:23.549337+0000","last_active":"2023-08-17T17:34:23.554345+0000","last_peered":"2023-08-17T17:34:23.554345+0000","last_clean":"2023-08-17T17:34:23.554345+0000","last_became_active":"2023-08-17T17:34:23.547732+0000","last_became_peered":"2023-08-17T17:34:23.547732+0000","last_unstale":"2023-08-17T17:34:23.554345+0000","last_undegraded":"2023-08-17T17:34:23.554345+0000","last_fullsized":"2023-08-17T17:34:23.554345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195523+0000","last_change":"2023-08-17T17:34:23.189436+0000","last_active":"2023-08-17T17:34:23.195523+0000","last_peered":"2023-08-17T17:34:23.195523+0000","last_clean":"2023-08-17T17:34:23.195523+0000","last_became_active":"2023-08-17T17:34:23.189166+0000","last_became_peered":"2023-08-17T17:34:23.189166+0000","last_unstale":"2023-08-17T17:34:23.195523+0000","last_undegraded":"2023-08-17T17:34:23.195523+0000","last_fullsized":"2023-08-17T17:34:23.195523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551604+0000","last_change":"2023-08-17T17:34:23.551604+0000","last_active":"2023-08-17T17:34:23.551604+0000","last_peered":"2023-08-17T17:34:23.551604+0000","last_clean":"2023-08-17T17:34:23.551604+0000","last_became_active":"2023-08-17T17:34:23.551329+0000","last_became_peered":"2023-08-17T17:34:23.551329+0000","last_unstale":"2023-08-17T17:34:23.551604+0000","last_undegraded":"2023-08-17T17:34:23.551604+0000","last_fullsized":"2023-08-17T17:34:23.551604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198347+0000","last_change":"2023-08-17T17:34:23.190730+0000","last_active":"2023-08-17T17:34:23.198347+0000","last_peered":"2023-08-17T17:34:23.198347+0000","last_clean":"2023-08-17T17:34:23.198347+0000","last_became_active":"2023-08-17T17:34:23.190449+0000","last_became_peered":"2023-08-17T17:34:23.190449+0000","last_unstale":"2023-08-17T17:34:23.198347+0000","last_undegraded":"2023-08-17T17:34:23.198347+0000","last_fullsized":"2023-08-17T17:34:23.198347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558813+0000","last_change":"2023-08-17T17:34:23.558813+0000","last_active":"2023-08-17T17:34:23.558813+0000","last_peered":"2023-08-17T17:34:23.558813+0000","last_clean":"2023-08-17T17:34:23.558813+0000","last_became_active":"2023-08-17T17:34:23.558310+0000","last_became_peered":"2023-08-17T17:34:23.558310+0000","last_unstale":"2023-08-17T17:34:23.558813+0000","last_undegraded":"2023-08-17T17:34:23.558813+0000","last_fullsized":"2023-08-17T17:34:23.558813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555179+0000","last_change":"2023-08-17T17:34:23.185442+0000","last_active":"2023-08-17T17:34:23.555179+0000","last_peered":"2023-08-17T17:34:23.555179+0000","last_clean":"2023-08-17T17:34:23.555179+0000","last_became_active":"2023-08-17T17:34:23.185159+0000","last_became_peered":"2023-08-17T17:34:23.185159+0000","last_unstale":"2023-08-17T17:34:23.555179+0000","last_undegraded":"2023-08-17T17:34:23.555179+0000","last_fullsized":"2023-08-17T17:34:23.555179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550463+0000","last_change":"2023-08-17T17:34:23.547815+0000","last_active":"2023-08-17T17:34:23.550463+0000","last_peered":"2023-08-17T17:34:23.550463+0000","last_clean":"2023-08-17T17:34:23.550463+0000","last_became_active":"2023-08-17T17:34:23.547492+0000","last_became_peered":"2023-08-17T17:34:23.547492+0000","last_unstale":"2023-08-17T17:34:23.550463+0000","last_undegraded":"2023-08-17T17:34:23.550463+0000","last_fullsized":"2023-08-17T17:34:23.550463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541589+0000","last_change":"2023-08-17T17:34:23.192604+0000","last_active":"2023-08-17T17:34:23.541589+0000","last_peered":"2023-08-17T17:34:23.541589+0000","last_clean":"2023-08-17T17:34:23.541589+0000","last_became_active":"2023-08-17T17:34:23.192411+0000","last_became_peered":"2023-08-17T17:34:23.192411+0000","last_unstale":"2023-08-17T17:34:23.541589+0000","last_undegraded":"2023-08-17T17:34:23.541589+0000","last_fullsized":"2023-08-17T17:34:23.541589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.548701+0000","last_change":"2023-08-17T17:34:23.548701+0000","last_active":"2023-08-17T17:34:23.548701+0000","last_peered":"2023-08-17T17:34:23.548701+0000","last_clean":"2023-08-17T17:34:23.548701+0000","last_became_active":"2023-08-17T17:34:23.548165+0000","last_became_peered":"2023-08-17T17:34:23.548165+0000","last_unstale":"2023-08-17T17:34:23.548701+0000","last_undegraded":"2023-08-17T17:34:23.548701+0000","last_fullsized":"2023-08-17T17:34:23.548701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556955+0000","last_change":"2023-08-17T17:34:23.193961+0000","last_active":"2023-08-17T17:34:23.556955+0000","last_peered":"2023-08-17T17:34:23.556955+0000","last_clean":"2023-08-17T17:34:23.556955+0000","last_became_active":"2023-08-17T17:34:23.193712+0000","last_became_peered":"2023-08-17T17:34:23.193712+0000","last_unstale":"2023-08-17T17:34:23.556955+0000","last_undegraded":"2023-08-17T17:34:23.556955+0000","last_fullsized":"2023-08-17T17:34:23.556955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.559424+0000","last_change":"2023-08-17T17:34:23.559424+0000","last_active":"2023-08-17T17:34:23.559424+0000","last_peered":"2023-08-17T17:34:23.559424+0000","last_clean":"2023-08-17T17:34:23.559424+0000","last_became_active":"2023-08-17T17:34:23.559157+0000","last_became_peered":"2023-08-17T17:34:23.559157+0000","last_unstale":"2023-08-17T17:34:23.559424+0000","last_undegraded":"2023-08-17T17:34:23.559424+0000","last_fullsized":"2023-08-17T17:34:23.559424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199092+0000","last_change":"2023-08-17T17:34:23.198227+0000","last_active":"2023-08-17T17:34:23.199092+0000","last_peered":"2023-08-17T17:34:23.199092+0000","last_clean":"2023-08-17T17:34:23.199092+0000","last_became_active":"2023-08-17T17:34:23.197944+0000","last_became_peered":"2023-08-17T17:34:23.197944+0000","last_unstale":"2023-08-17T17:34:23.199092+0000","last_undegraded":"2023-08-17T17:34:23.199092+0000","last_fullsized":"2023-08-17T17:34:23.199092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547115+0000","last_change":"2023-08-17T17:34:23.547115+0000","last_active":"2023-08-17T17:34:23.547115+0000","last_peered":"2023-08-17T17:34:23.547115+0000","last_clean":"2023-08-17T17:34:23.547115+0000","last_became_active":"2023-08-17T17:34:23.546829+0000","last_became_peered":"2023-08-17T17:34:23.546829+0000","last_unstale":"2023-08-17T17:34:23.547115+0000","last_undegraded":"2023-08-17T17:34:23.547115+0000","last_fullsized":"2023-08-17T17:34:23.547115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537300+0000","last_change":"2023-08-17T17:34:23.187589+0000","last_active":"2023-08-17T17:34:23.537300+0000","last_peered":"2023-08-17T17:34:23.537300+0000","last_clean":"2023-08-17T17:34:23.537300+0000","last_became_active":"2023-08-17T17:34:23.187290+0000","last_became_peered":"2023-08-17T17:34:23.187290+0000","last_unstale":"2023-08-17T17:34:23.537300+0000","last_undegraded":"2023-08-17T17:34:23.537300+0000","last_fullsized":"2023-08-17T17:34:23.537300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554129+0000","last_change":"2023-08-17T17:34:23.554129+0000","last_active":"2023-08-17T17:34:23.554129+0000","last_peered":"2023-08-17T17:34:23.554129+0000","last_clean":"2023-08-17T17:34:23.554129+0000","last_became_active":"2023-08-17T17:34:23.553850+0000","last_became_peered":"2023-08-17T17:34:23.553850+0000","last_unstale":"2023-08-17T17:34:23.554129+0000","last_undegraded":"2023-08-17T17:34:23.554129+0000","last_fullsized":"2023-08-17T17:34:23.554129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553604+0000","last_change":"2023-08-17T17:34:23.186710+0000","last_active":"2023-08-17T17:34:23.553604+0000","last_peered":"2023-08-17T17:34:23.553604+0000","last_clean":"2023-08-17T17:34:23.553604+0000","last_became_active":"2023-08-17T17:34:23.186445+0000","last_became_peered":"2023-08-17T17:34:23.186445+0000","last_unstale":"2023-08-17T17:34:23.553604+0000","last_undegraded":"2023-08-17T17:34:23.553604+0000","last_fullsized":"2023-08-17T17:34:23.553604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550750+0000","last_change":"2023-08-17T17:34:23.550750+0000","last_active":"2023-08-17T17:34:23.550750+0000","last_peered":"2023-08-17T17:34:23.550750+0000","last_clean":"2023-08-17T17:34:23.550750+0000","last_became_active":"2023-08-17T17:34:23.550414+0000","last_became_peered":"2023-08-17T17:34:23.550414+0000","last_unstale":"2023-08-17T17:34:23.550750+0000","last_undegraded":"2023-08-17T17:34:23.550750+0000","last_fullsized":"2023-08-17T17:34:23.550750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.197495+0000","last_change":"2023-08-17T17:34:23.191770+0000","last_active":"2023-08-17T17:34:23.197495+0000","last_peered":"2023-08-17T17:34:23.197495+0000","last_clean":"2023-08-17T17:34:23.197495+0000","last_became_active":"2023-08-17T17:34:23.191496+0000","last_became_peered":"2023-08-17T17:34:23.191496+0000","last_unstale":"2023-08-17T17:34:23.197495+0000","last_undegraded":"2023-08-17T17:34:23.197495+0000","last_fullsized":"2023-08-17T17:34:23.197495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555082+0000","last_change":"2023-08-17T17:34:23.555082+0000","last_active":"2023-08-17T17:34:23.555082+0000","last_peered":"2023-08-17T17:34:23.555082+0000","last_clean":"2023-08-17T17:34:23.555082+0000","last_became_active":"2023-08-17T17:34:23.554787+0000","last_became_peered":"2023-08-17T17:34:23.554787+0000","last_unstale":"2023-08-17T17:34:23.555082+0000","last_undegraded":"2023-08-17T17:34:23.555082+0000","last_fullsized":"2023-08-17T17:34:23.555082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.190949+0000","last_change":"2023-08-17T17:34:23.186144+0000","last_active":"2023-08-17T17:34:23.190949+0000","last_peered":"2023-08-17T17:34:23.190949+0000","last_clean":"2023-08-17T17:34:23.190949+0000","last_became_active":"2023-08-17T17:34:23.185783+0000","last_became_peered":"2023-08-17T17:34:23.185783+0000","last_unstale":"2023-08-17T17:34:23.190949+0000","last_undegraded":"2023-08-17T17:34:23.190949+0000","last_fullsized":"2023-08-17T17:34:23.190949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556916+0000","last_change":"2023-08-17T17:34:23.556916+0000","last_active":"2023-08-17T17:34:23.556916+0000","last_peered":"2023-08-17T17:34:23.556916+0000","last_clean":"2023-08-17T17:34:23.556916+0000","last_became_active":"2023-08-17T17:34:23.556648+0000","last_became_peered":"2023-08-17T17:34:23.556648+0000","last_unstale":"2023-08-17T17:34:23.556916+0000","last_undegraded":"2023-08-17T17:34:23.556916+0000","last_fullsized":"2023-08-17T17:34:23.556916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195547+0000","last_change":"2023-08-17T17:34:23.186198+0000","last_active":"2023-08-17T17:34:23.195547+0000","last_peered":"2023-08-17T17:34:23.195547+0000","last_clean":"2023-08-17T17:34:23.195547+0000","last_became_active":"2023-08-17T17:34:23.185926+0000","last_became_peered":"2023-08-17T17:34:23.185926+0000","last_unstale":"2023-08-17T17:34:23.195547+0000","last_undegraded":"2023-08-17T17:34:23.195547+0000","last_fullsized":"2023-08-17T17:34:23.195547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.182041+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:34:23.182041+0000","last_peered":"2023-08-17T17:34:23.182041+0000","last_clean":"2023-08-17T17:34:23.182041+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:34:23.182041+0000","last_undegraded":"2023-08-17T17:34:23.182041+0000","last_fullsized":"2023-08-17T17:34:23.182041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537500+0000","last_change":"2023-08-17T17:34:23.184771+0000","last_active":"2023-08-17T17:34:23.537500+0000","last_peered":"2023-08-17T17:34:23.537500+0000","last_clean":"2023-08-17T17:34:23.537500+0000","last_became_active":"2023-08-17T17:34:23.184315+0000","last_became_peered":"2023-08-17T17:34:23.184315+0000","last_unstale":"2023-08-17T17:34:23.537500+0000","last_undegraded":"2023-08-17T17:34:23.537500+0000","last_fullsized":"2023-08-17T17:34:23.537500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.542863+0000","last_change":"2023-08-17T17:34:23.542863+0000","last_active":"2023-08-17T17:34:23.542863+0000","last_peered":"2023-08-17T17:34:23.542863+0000","last_clean":"2023-08-17T17:34:23.542863+0000","last_became_active":"2023-08-17T17:34:23.542602+0000","last_became_peered":"2023-08-17T17:34:23.542602+0000","last_unstale":"2023-08-17T17:34:23.542863+0000","last_undegraded":"2023-08-17T17:34:23.542863+0000","last_fullsized":"2023-08-17T17:34:23.542863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536939+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:34:23.536939+0000","last_peered":"2023-08-17T17:34:23.536939+0000","last_clean":"2023-08-17T17:34:23.536939+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:34:23.536939+0000","last_undegraded":"2023-08-17T17:34:23.536939+0000","last_fullsized":"2023-08-17T17:34:23.536939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193340+0000","last_change":"2023-08-17T17:34:23.187110+0000","last_active":"2023-08-17T17:34:23.193340+0000","last_peered":"2023-08-17T17:34:23.193340+0000","last_clean":"2023-08-17T17:34:23.193340+0000","last_became_active":"2023-08-17T17:34:23.186796+0000","last_became_peered":"2023-08-17T17:34:23.186796+0000","last_unstale":"2023-08-17T17:34:23.193340+0000","last_undegraded":"2023-08-17T17:34:23.193340+0000","last_fullsized":"2023-08-17T17:34:23.193340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.542382+0000","last_change":"2023-08-17T17:34:23.542382+0000","last_active":"2023-08-17T17:34:23.542382+0000","last_peered":"2023-08-17T17:34:23.542382+0000","last_clean":"2023-08-17T17:34:23.542382+0000","last_became_active":"2023-08-17T17:34:23.542108+0000","last_became_peered":"2023-08-17T17:34:23.542108+0000","last_unstale":"2023-08-17T17:34:23.542382+0000","last_undegraded":"2023-08-17T17:34:23.542382+0000","last_fullsized":"2023-08-17T17:34:23.542382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543037+0000","last_change":"2023-08-17T17:34:23.543037+0000","last_active":"2023-08-17T17:34:23.543037+0000","last_peered":"2023-08-17T17:34:23.543037+0000","last_clean":"2023-08-17T17:34:23.543037+0000","last_became_active":"2023-08-17T17:34:23.542776+0000","last_became_peered":"2023-08-17T17:34:23.542776+0000","last_unstale":"2023-08-17T17:34:23.543037+0000","last_undegraded":"2023-08-17T17:34:23.543037+0000","last_fullsized":"2023-08-17T17:34:23.543037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535248+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:34:23.535248+0000","last_peered":"2023-08-17T17:34:23.535248+0000","last_clean":"2023-08-17T17:34:23.535248+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:34:23.535248+0000","last_undegraded":"2023-08-17T17:34:23.535248+0000","last_fullsized":"2023-08-17T17:34:23.535248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193425+0000","last_change":"2023-08-17T17:34:23.189586+0000","last_active":"2023-08-17T17:34:23.193425+0000","last_peered":"2023-08-17T17:34:23.193425+0000","last_clean":"2023-08-17T17:34:23.193425+0000","last_became_active":"2023-08-17T17:34:23.189430+0000","last_became_peered":"2023-08-17T17:34:23.189430+0000","last_unstale":"2023-08-17T17:34:23.193425+0000","last_undegraded":"2023-08-17T17:34:23.193425+0000","last_fullsized":"2023-08-17T17:34:23.193425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553467+0000","last_change":"2023-08-17T17:34:23.553467+0000","last_active":"2023-08-17T17:34:23.553467+0000","last_peered":"2023-08-17T17:34:23.553467+0000","last_clean":"2023-08-17T17:34:23.553467+0000","last_became_active":"2023-08-17T17:34:23.553182+0000","last_became_peered":"2023-08-17T17:34:23.553182+0000","last_unstale":"2023-08-17T17:34:23.553467+0000","last_undegraded":"2023-08-17T17:34:23.553467+0000","last_fullsized":"2023-08-17T17:34:23.553467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537185+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:34:23.537185+0000","last_peered":"2023-08-17T17:34:23.537185+0000","last_clean":"2023-08-17T17:34:23.537185+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:34:23.537185+0000","last_undegraded":"2023-08-17T17:34:23.537185+0000","last_fullsized":"2023-08-17T17:34:23.537185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.178328+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:34:23.178328+0000","last_peered":"2023-08-17T17:34:23.178328+0000","last_clean":"2023-08-17T17:34:23.178328+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:34:23.178328+0000","last_undegraded":"2023-08-17T17:34:23.178328+0000","last_fullsized":"2023-08-17T17:34:23.178328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.185276+0000","last_change":"2023-08-17T17:34:23.182606+0000","last_active":"2023-08-17T17:34:23.185276+0000","last_peered":"2023-08-17T17:34:23.185276+0000","last_clean":"2023-08-17T17:34:23.185276+0000","last_became_active":"2023-08-17T17:34:23.182335+0000","last_became_peered":"2023-08-17T17:34:23.182335+0000","last_unstale":"2023-08-17T17:34:23.185276+0000","last_undegraded":"2023-08-17T17:34:23.185276+0000","last_fullsized":"2023-08-17T17:34:23.185276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547812+0000","last_change":"2023-08-17T17:34:23.547812+0000","last_active":"2023-08-17T17:34:23.547812+0000","last_peered":"2023-08-17T17:34:23.547812+0000","last_clean":"2023-08-17T17:34:23.547812+0000","last_became_active":"2023-08-17T17:34:23.547532+0000","last_became_peered":"2023-08-17T17:34:23.547532+0000","last_unstale":"2023-08-17T17:34:23.547812+0000","last_undegraded":"2023-08-17T17:34:23.547812+0000","last_fullsized":"2023-08-17T17:34:23.547812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.178366+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:34:23.178366+0000","last_peered":"2023-08-17T17:34:23.178366+0000","last_clean":"2023-08-17T17:34:23.178366+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:34:23.178366+0000","last_undegraded":"2023-08-17T17:34:23.178366+0000","last_fullsized":"2023-08-17T17:34:23.178366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195410+0000","last_change":"2023-08-17T17:34:23.187849+0000","last_active":"2023-08-17T17:34:23.195410+0000","last_peered":"2023-08-17T17:34:23.195410+0000","last_clean":"2023-08-17T17:34:23.195410+0000","last_became_active":"2023-08-17T17:34:23.187578+0000","last_became_peered":"2023-08-17T17:34:23.187578+0000","last_unstale":"2023-08-17T17:34:23.195410+0000","last_undegraded":"2023-08-17T17:34:23.195410+0000","last_fullsized":"2023-08-17T17:34:23.195410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.179921+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:34:23.179921+0000","last_peered":"2023-08-17T17:34:23.179921+0000","last_clean":"2023-08-17T17:34:23.179921+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:34:23.179921+0000","last_undegraded":"2023-08-17T17:34:23.179921+0000","last_fullsized":"2023-08-17T17:34:23.179921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199149+0000","last_change":"2023-08-17T17:34:23.191992+0000","last_active":"2023-08-17T17:34:23.199149+0000","last_peered":"2023-08-17T17:34:23.199149+0000","last_clean":"2023-08-17T17:34:23.199149+0000","last_became_active":"2023-08-17T17:34:23.191711+0000","last_became_peered":"2023-08-17T17:34:23.191711+0000","last_unstale":"2023-08-17T17:34:23.199149+0000","last_undegraded":"2023-08-17T17:34:23.199149+0000","last_fullsized":"2023-08-17T17:34:23.199149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541695+0000","last_change":"2023-08-17T17:34:23.541695+0000","last_active":"2023-08-17T17:34:23.541695+0000","last_peered":"2023-08-17T17:34:23.541695+0000","last_clean":"2023-08-17T17:34:23.541695+0000","last_became_active":"2023-08-17T17:34:23.541430+0000","last_became_peered":"2023-08-17T17:34:23.541430+0000","last_unstale":"2023-08-17T17:34:23.541695+0000","last_undegraded":"2023-08-17T17:34:23.541695+0000","last_fullsized":"2023-08-17T17:34:23.541695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561244+0000","last_change":"2023-08-17T17:34:23.188530+0000","last_active":"2023-08-17T17:34:23.561244+0000","last_peered":"2023-08-17T17:34:23.561244+0000","last_clean":"2023-08-17T17:34:23.561244+0000","last_became_active":"2023-08-17T17:34:23.188237+0000","last_became_peered":"2023-08-17T17:34:23.188237+0000","last_unstale":"2023-08-17T17:34:23.561244+0000","last_undegraded":"2023-08-17T17:34:23.561244+0000","last_fullsized":"2023-08-17T17:34:23.561244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.179737+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:34:23.179737+0000","last_peered":"2023-08-17T17:34:23.179737+0000","last_clean":"2023-08-17T17:34:23.179737+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:34:23.179737+0000","last_undegraded":"2023-08-17T17:34:23.179737+0000","last_fullsized":"2023-08-17T17:34:23.179737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557366+0000","last_change":"2023-08-17T17:34:23.557366+0000","last_active":"2023-08-17T17:34:23.557366+0000","last_peered":"2023-08-17T17:34:23.557366+0000","last_clean":"2023-08-17T17:34:23.557366+0000","last_became_active":"2023-08-17T17:34:23.555195+0000","last_became_peered":"2023-08-17T17:34:23.555195+0000","last_unstale":"2023-08-17T17:34:23.557366+0000","last_undegraded":"2023-08-17T17:34:23.557366+0000","last_fullsized":"2023-08-17T17:34:23.557366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.182581+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:34:23.182581+0000","last_peered":"2023-08-17T17:34:23.182581+0000","last_clean":"2023-08-17T17:34:23.182581+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:34:23.182581+0000","last_undegraded":"2023-08-17T17:34:23.182581+0000","last_fullsized":"2023-08-17T17:34:23.182581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.196081+0000","last_change":"2023-08-17T17:34:23.191591+0000","last_active":"2023-08-17T17:34:23.196081+0000","last_peered":"2023-08-17T17:34:23.196081+0000","last_clean":"2023-08-17T17:34:23.196081+0000","last_became_active":"2023-08-17T17:34:23.190831+0000","last_became_peered":"2023-08-17T17:34:23.190831+0000","last_unstale":"2023-08-17T17:34:23.196081+0000","last_undegraded":"2023-08-17T17:34:23.196081+0000","last_fullsized":"2023-08-17T17:34:23.196081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.542994+0000","last_change":"2023-08-17T17:34:23.542994+0000","last_active":"2023-08-17T17:34:23.542994+0000","last_peered":"2023-08-17T17:34:23.542994+0000","last_clean":"2023-08-17T17:34:23.542994+0000","last_became_active":"2023-08-17T17:34:23.542731+0000","last_became_peered":"2023-08-17T17:34:23.542731+0000","last_unstale":"2023-08-17T17:34:23.542994+0000","last_undegraded":"2023-08-17T17:34:23.542994+0000","last_fullsized":"2023-08-17T17:34:23.542994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550786+0000","last_change":"2023-08-17T17:34:23.547644+0000","last_active":"2023-08-17T17:34:23.550786+0000","last_peered":"2023-08-17T17:34:23.550786+0000","last_clean":"2023-08-17T17:34:23.550786+0000","last_became_active":"2023-08-17T17:34:23.547383+0000","last_became_peered":"2023-08-17T17:34:23.547383+0000","last_unstale":"2023-08-17T17:34:23.550786+0000","last_undegraded":"2023-08-17T17:34:23.550786+0000","last_fullsized":"2023-08-17T17:34:23.550786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195756+0000","last_change":"2023-08-17T17:34:23.190255+0000","last_active":"2023-08-17T17:34:23.195756+0000","last_peered":"2023-08-17T17:34:23.195756+0000","last_clean":"2023-08-17T17:34:23.195756+0000","last_became_active":"2023-08-17T17:34:23.189984+0000","last_became_peered":"2023-08-17T17:34:23.189984+0000","last_unstale":"2023-08-17T17:34:23.195756+0000","last_undegraded":"2023-08-17T17:34:23.195756+0000","last_fullsized":"2023-08-17T17:34:23.195756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552719+0000","last_change":"2023-08-17T17:34:23.552719+0000","last_active":"2023-08-17T17:34:23.552719+0000","last_peered":"2023-08-17T17:34:23.552719+0000","last_clean":"2023-08-17T17:34:23.552719+0000","last_became_active":"2023-08-17T17:34:23.552438+0000","last_became_peered":"2023-08-17T17:34:23.552438+0000","last_unstale":"2023-08-17T17:34:23.552719+0000","last_undegraded":"2023-08-17T17:34:23.552719+0000","last_fullsized":"2023-08-17T17:34:23.552719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537344+0000","last_change":"2023-08-17T17:34:23.190817+0000","last_active":"2023-08-17T17:34:23.537344+0000","last_peered":"2023-08-17T17:34:23.537344+0000","last_clean":"2023-08-17T17:34:23.537344+0000","last_became_active":"2023-08-17T17:34:23.190559+0000","last_became_peered":"2023-08-17T17:34:23.190559+0000","last_unstale":"2023-08-17T17:34:23.537344+0000","last_undegraded":"2023-08-17T17:34:23.537344+0000","last_fullsized":"2023-08-17T17:34:23.537344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553414+0000","last_change":"2023-08-17T17:34:23.553414+0000","last_active":"2023-08-17T17:34:23.553414+0000","last_peered":"2023-08-17T17:34:23.553414+0000","last_clean":"2023-08-17T17:34:23.553414+0000","last_became_active":"2023-08-17T17:34:23.552895+0000","last_became_peered":"2023-08-17T17:34:23.552895+0000","last_unstale":"2023-08-17T17:34:23.553414+0000","last_undegraded":"2023-08-17T17:34:23.553414+0000","last_fullsized":"2023-08-17T17:34:23.553414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553204+0000","last_change":"2023-08-17T17:34:23.190779+0000","last_active":"2023-08-17T17:34:23.553204+0000","last_peered":"2023-08-17T17:34:23.553204+0000","last_clean":"2023-08-17T17:34:23.553204+0000","last_became_active":"2023-08-17T17:34:23.190512+0000","last_became_peered":"2023-08-17T17:34:23.190512+0000","last_unstale":"2023-08-17T17:34:23.553204+0000","last_undegraded":"2023-08-17T17:34:23.553204+0000","last_fullsized":"2023-08-17T17:34:23.553204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.549278+0000","last_change":"2023-08-17T17:34:23.549278+0000","last_active":"2023-08-17T17:34:23.549278+0000","last_peered":"2023-08-17T17:34:23.549278+0000","last_clean":"2023-08-17T17:34:23.549278+0000","last_became_active":"2023-08-17T17:34:23.548986+0000","last_became_peered":"2023-08-17T17:34:23.548986+0000","last_unstale":"2023-08-17T17:34:23.549278+0000","last_undegraded":"2023-08-17T17:34:23.549278+0000","last_fullsized":"2023-08-17T17:34:23.549278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551680+0000","last_change":"2023-08-17T17:34:23.186530+0000","last_active":"2023-08-17T17:34:23.551680+0000","last_peered":"2023-08-17T17:34:23.551680+0000","last_clean":"2023-08-17T17:34:23.551680+0000","last_became_active":"2023-08-17T17:34:23.186269+0000","last_became_peered":"2023-08-17T17:34:23.186269+0000","last_unstale":"2023-08-17T17:34:23.551680+0000","last_undegraded":"2023-08-17T17:34:23.551680+0000","last_fullsized":"2023-08-17T17:34:23.551680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.549760+0000","last_change":"2023-08-17T17:34:23.549760+0000","last_active":"2023-08-17T17:34:23.549760+0000","last_peered":"2023-08-17T17:34:23.549760+0000","last_clean":"2023-08-17T17:34:23.549760+0000","last_became_active":"2023-08-17T17:34:23.549485+0000","last_became_peered":"2023-08-17T17:34:23.549485+0000","last_unstale":"2023-08-17T17:34:23.549760+0000","last_undegraded":"2023-08-17T17:34:23.549760+0000","last_fullsized":"2023-08-17T17:34:23.549760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538201+0000","last_change":"2023-08-17T17:34:23.185767+0000","last_active":"2023-08-17T17:34:23.538201+0000","last_peered":"2023-08-17T17:34:23.538201+0000","last_clean":"2023-08-17T17:34:23.538201+0000","last_became_active":"2023-08-17T17:34:23.185523+0000","last_became_peered":"2023-08-17T17:34:23.185523+0000","last_unstale":"2023-08-17T17:34:23.538201+0000","last_undegraded":"2023-08-17T17:34:23.538201+0000","last_fullsized":"2023-08-17T17:34:23.538201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550201+0000","last_change":"2023-08-17T17:34:23.550201+0000","last_active":"2023-08-17T17:34:23.550201+0000","last_peered":"2023-08-17T17:34:23.550201+0000","last_clean":"2023-08-17T17:34:23.550201+0000","last_became_active":"2023-08-17T17:34:23.550017+0000","last_became_peered":"2023-08-17T17:34:23.550017+0000","last_unstale":"2023-08-17T17:34:23.550201+0000","last_undegraded":"2023-08-17T17:34:23.550201+0000","last_fullsized":"2023-08-17T17:34:23.550201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.190798+0000","last_change":"2023-08-17T17:34:23.184375+0000","last_active":"2023-08-17T17:34:23.190798+0000","last_peered":"2023-08-17T17:34:23.190798+0000","last_clean":"2023-08-17T17:34:23.190798+0000","last_became_active":"2023-08-17T17:34:23.184095+0000","last_became_peered":"2023-08-17T17:34:23.184095+0000","last_unstale":"2023-08-17T17:34:23.190798+0000","last_undegraded":"2023-08-17T17:34:23.190798+0000","last_fullsized":"2023-08-17T17:34:23.190798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.544840+0000","last_change":"2023-08-17T17:34:23.544840+0000","last_active":"2023-08-17T17:34:23.544840+0000","last_peered":"2023-08-17T17:34:23.544840+0000","last_clean":"2023-08-17T17:34:23.544840+0000","last_became_active":"2023-08-17T17:34:23.544381+0000","last_became_peered":"2023-08-17T17:34:23.544381+0000","last_unstale":"2023-08-17T17:34:23.544840+0000","last_undegraded":"2023-08-17T17:34:23.544840+0000","last_fullsized":"2023-08-17T17:34:23.544840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535353+0000","last_change":"2023-08-17T17:34:23.181210+0000","last_active":"2023-08-17T17:34:23.535353+0000","last_peered":"2023-08-17T17:34:23.535353+0000","last_clean":"2023-08-17T17:34:23.535353+0000","last_became_active":"2023-08-17T17:34:23.180969+0000","last_became_peered":"2023-08-17T17:34:23.180969+0000","last_unstale":"2023-08-17T17:34:23.535353+0000","last_undegraded":"2023-08-17T17:34:23.535353+0000","last_fullsized":"2023-08-17T17:34:23.535353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550540+0000","last_change":"2023-08-17T17:34:23.548247+0000","last_active":"2023-08-17T17:34:23.550540+0000","last_peered":"2023-08-17T17:34:23.550540+0000","last_clean":"2023-08-17T17:34:23.550540+0000","last_became_active":"2023-08-17T17:34:23.547379+0000","last_became_peered":"2023-08-17T17:34:23.547379+0000","last_unstale":"2023-08-17T17:34:23.550540+0000","last_undegraded":"2023-08-17T17:34:23.550540+0000","last_fullsized":"2023-08-17T17:34:23.550540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536842+0000","last_change":"2023-08-17T17:34:23.185419+0000","last_active":"2023-08-17T17:34:23.536842+0000","last_peered":"2023-08-17T17:34:23.536842+0000","last_clean":"2023-08-17T17:34:23.536842+0000","last_became_active":"2023-08-17T17:34:23.184865+0000","last_became_peered":"2023-08-17T17:34:23.184865+0000","last_unstale":"2023-08-17T17:34:23.536842+0000","last_undegraded":"2023-08-17T17:34:23.536842+0000","last_fullsized":"2023-08-17T17:34:23.536842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.544643+0000","last_change":"2023-08-17T17:34:23.544643+0000","last_active":"2023-08-17T17:34:23.544643+0000","last_peered":"2023-08-17T17:34:23.544643+0000","last_clean":"2023-08-17T17:34:23.544643+0000","last_became_active":"2023-08-17T17:34:23.544406+0000","last_became_peered":"2023-08-17T17:34:23.544406+0000","last_unstale":"2023-08-17T17:34:23.544643+0000","last_undegraded":"2023-08-17T17:34:23.544643+0000","last_fullsized":"2023-08-17T17:34:23.544643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193494+0000","last_change":"2023-08-17T17:34:23.186776+0000","last_active":"2023-08-17T17:34:23.193494+0000","last_peered":"2023-08-17T17:34:23.193494+0000","last_clean":"2023-08-17T17:34:23.193494+0000","last_became_active":"2023-08-17T17:34:23.186521+0000","last_became_peered":"2023-08-17T17:34:23.186521+0000","last_unstale":"2023-08-17T17:34:23.193494+0000","last_undegraded":"2023-08-17T17:34:23.193494+0000","last_fullsized":"2023-08-17T17:34:23.193494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.560630+0000","last_change":"2023-08-17T17:34:23.560630+0000","last_active":"2023-08-17T17:34:23.560630+0000","last_peered":"2023-08-17T17:34:23.560630+0000","last_clean":"2023-08-17T17:34:23.560630+0000","last_became_active":"2023-08-17T17:34:23.560282+0000","last_became_peered":"2023-08-17T17:34:23.560282+0000","last_unstale":"2023-08-17T17:34:23.560630+0000","last_undegraded":"2023-08-17T17:34:23.560630+0000","last_fullsized":"2023-08-17T17:34:23.560630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199023+0000","last_change":"2023-08-17T17:34:23.191397+0000","last_active":"2023-08-17T17:34:23.199023+0000","last_peered":"2023-08-17T17:34:23.199023+0000","last_clean":"2023-08-17T17:34:23.199023+0000","last_became_active":"2023-08-17T17:34:23.191058+0000","last_became_peered":"2023-08-17T17:34:23.191058+0000","last_unstale":"2023-08-17T17:34:23.199023+0000","last_undegraded":"2023-08-17T17:34:23.199023+0000","last_fullsized":"2023-08-17T17:34:23.199023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553590+0000","last_change":"2023-08-17T17:34:23.553590+0000","last_active":"2023-08-17T17:34:23.553590+0000","last_peered":"2023-08-17T17:34:23.553590+0000","last_clean":"2023-08-17T17:34:23.553590+0000","last_became_active":"2023-08-17T17:34:23.552092+0000","last_became_peered":"2023-08-17T17:34:23.552092+0000","last_unstale":"2023-08-17T17:34:23.553590+0000","last_undegraded":"2023-08-17T17:34:23.553590+0000","last_fullsized":"2023-08-17T17:34:23.553590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199058+0000","last_change":"2023-08-17T17:34:23.191260+0000","last_active":"2023-08-17T17:34:23.199058+0000","last_peered":"2023-08-17T17:34:23.199058+0000","last_clean":"2023-08-17T17:34:23.199058+0000","last_became_active":"2023-08-17T17:34:23.190994+0000","last_became_peered":"2023-08-17T17:34:23.190994+0000","last_unstale":"2023-08-17T17:34:23.199058+0000","last_undegraded":"2023-08-17T17:34:23.199058+0000","last_fullsized":"2023-08-17T17:34:23.199058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556967+0000","last_change":"2023-08-17T17:34:23.556967+0000","last_active":"2023-08-17T17:34:23.556967+0000","last_peered":"2023-08-17T17:34:23.556967+0000","last_clean":"2023-08-17T17:34:23.556967+0000","last_became_active":"2023-08-17T17:34:23.556712+0000","last_became_peered":"2023-08-17T17:34:23.556712+0000","last_unstale":"2023-08-17T17:34:23.556967+0000","last_undegraded":"2023-08-17T17:34:23.556967+0000","last_fullsized":"2023-08-17T17:34:23.556967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193265+0000","last_change":"2023-08-17T17:34:23.189238+0000","last_active":"2023-08-17T17:34:23.193265+0000","last_peered":"2023-08-17T17:34:23.193265+0000","last_clean":"2023-08-17T17:34:23.193265+0000","last_became_active":"2023-08-17T17:34:23.188964+0000","last_became_peered":"2023-08-17T17:34:23.188964+0000","last_unstale":"2023-08-17T17:34:23.193265+0000","last_undegraded":"2023-08-17T17:34:23.193265+0000","last_fullsized":"2023-08-17T17:34:23.193265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.549243+0000","last_change":"2023-08-17T17:34:23.549243+0000","last_active":"2023-08-17T17:34:23.549243+0000","last_peered":"2023-08-17T17:34:23.549243+0000","last_clean":"2023-08-17T17:34:23.549243+0000","last_became_active":"2023-08-17T17:34:23.548966+0000","last_became_peered":"2023-08-17T17:34:23.548966+0000","last_unstale":"2023-08-17T17:34:23.549243+0000","last_undegraded":"2023-08-17T17:34:23.549243+0000","last_fullsized":"2023-08-17T17:34:23.549243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195835+0000","last_change":"2023-08-17T17:34:23.189039+0000","last_active":"2023-08-17T17:34:23.195835+0000","last_peered":"2023-08-17T17:34:23.195835+0000","last_clean":"2023-08-17T17:34:23.195835+0000","last_became_active":"2023-08-17T17:34:23.188785+0000","last_became_peered":"2023-08-17T17:34:23.188785+0000","last_unstale":"2023-08-17T17:34:23.195835+0000","last_undegraded":"2023-08-17T17:34:23.195835+0000","last_fullsized":"2023-08-17T17:34:23.195835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555845+0000","last_change":"2023-08-17T17:34:23.555845+0000","last_active":"2023-08-17T17:34:23.555845+0000","last_peered":"2023-08-17T17:34:23.555845+0000","last_clean":"2023-08-17T17:34:23.555845+0000","last_became_active":"2023-08-17T17:34:23.555604+0000","last_became_peered":"2023-08-17T17:34:23.555604+0000","last_unstale":"2023-08-17T17:34:23.555845+0000","last_undegraded":"2023-08-17T17:34:23.555845+0000","last_fullsized":"2023-08-17T17:34:23.555845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538052+0000","last_change":"2023-08-17T17:34:23.187717+0000","last_active":"2023-08-17T17:34:23.538052+0000","last_peered":"2023-08-17T17:34:23.538052+0000","last_clean":"2023-08-17T17:34:23.538052+0000","last_became_active":"2023-08-17T17:34:23.184648+0000","last_became_peered":"2023-08-17T17:34:23.184648+0000","last_unstale":"2023-08-17T17:34:23.538052+0000","last_undegraded":"2023-08-17T17:34:23.538052+0000","last_fullsized":"2023-08-17T17:34:23.538052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552413+0000","last_change":"2023-08-17T17:34:23.552413+0000","last_active":"2023-08-17T17:34:23.552413+0000","last_peered":"2023-08-17T17:34:23.552413+0000","last_clean":"2023-08-17T17:34:23.552413+0000","last_became_active":"2023-08-17T17:34:23.552087+0000","last_became_peered":"2023-08-17T17:34:23.552087+0000","last_unstale":"2023-08-17T17:34:23.552413+0000","last_undegraded":"2023-08-17T17:34:23.552413+0000","last_fullsized":"2023-08-17T17:34:23.552413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195839+0000","last_change":"2023-08-17T17:34:23.189135+0000","last_active":"2023-08-17T17:34:23.195839+0000","last_peered":"2023-08-17T17:34:23.195839+0000","last_clean":"2023-08-17T17:34:23.195839+0000","last_became_active":"2023-08-17T17:34:23.188880+0000","last_became_peered":"2023-08-17T17:34:23.188880+0000","last_unstale":"2023-08-17T17:34:23.195839+0000","last_undegraded":"2023-08-17T17:34:23.195839+0000","last_fullsized":"2023-08-17T17:34:23.195839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551405+0000","last_change":"2023-08-17T17:34:23.549370+0000","last_active":"2023-08-17T17:34:23.551405+0000","last_peered":"2023-08-17T17:34:23.551405+0000","last_clean":"2023-08-17T17:34:23.551405+0000","last_became_active":"2023-08-17T17:34:23.549106+0000","last_became_peered":"2023-08-17T17:34:23.549106+0000","last_unstale":"2023-08-17T17:34:23.551405+0000","last_undegraded":"2023-08-17T17:34:23.551405+0000","last_fullsized":"2023-08-17T17:34:23.551405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537049+0000","last_change":"2023-08-17T17:34:23.188935+0000","last_active":"2023-08-17T17:34:23.537049+0000","last_peered":"2023-08-17T17:34:23.537049+0000","last_clean":"2023-08-17T17:34:23.537049+0000","last_became_active":"2023-08-17T17:34:23.188377+0000","last_became_peered":"2023-08-17T17:34:23.188377+0000","last_unstale":"2023-08-17T17:34:23.537049+0000","last_undegraded":"2023-08-17T17:34:23.537049+0000","last_fullsized":"2023-08-17T17:34:23.537049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555082+0000","last_change":"2023-08-17T17:34:23.555082+0000","last_active":"2023-08-17T17:34:23.555082+0000","last_peered":"2023-08-17T17:34:23.555082+0000","last_clean":"2023-08-17T17:34:23.555082+0000","last_became_active":"2023-08-17T17:34:23.554814+0000","last_became_peered":"2023-08-17T17:34:23.554814+0000","last_unstale":"2023-08-17T17:34:23.555082+0000","last_undegraded":"2023-08-17T17:34:23.555082+0000","last_fullsized":"2023-08-17T17:34:23.555082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536557+0000","last_change":"2023-08-17T17:34:23.190120+0000","last_active":"2023-08-17T17:34:23.536557+0000","last_peered":"2023-08-17T17:34:23.536557+0000","last_clean":"2023-08-17T17:34:23.536557+0000","last_became_active":"2023-08-17T17:34:23.189569+0000","last_became_peered":"2023-08-17T17:34:23.189569+0000","last_unstale":"2023-08-17T17:34:23.536557+0000","last_undegraded":"2023-08-17T17:34:23.536557+0000","last_fullsized":"2023-08-17T17:34:23.536557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561106+0000","last_change":"2023-08-17T17:34:23.561106+0000","last_active":"2023-08-17T17:34:23.561106+0000","last_peered":"2023-08-17T17:34:23.561106+0000","last_clean":"2023-08-17T17:34:23.561106+0000","last_became_active":"2023-08-17T17:34:23.560898+0000","last_became_peered":"2023-08-17T17:34:23.560898+0000","last_unstale":"2023-08-17T17:34:23.561106+0000","last_undegraded":"2023-08-17T17:34:23.561106+0000","last_fullsized":"2023-08-17T17:34:23.561106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198889+0000","last_change":"2023-08-17T17:34:23.198065+0000","last_active":"2023-08-17T17:34:23.198889+0000","last_peered":"2023-08-17T17:34:23.198889+0000","last_clean":"2023-08-17T17:34:23.198889+0000","last_became_active":"2023-08-17T17:34:23.197731+0000","last_became_peered":"2023-08-17T17:34:23.197731+0000","last_unstale":"2023-08-17T17:34:23.198889+0000","last_undegraded":"2023-08-17T17:34:23.198889+0000","last_fullsized":"2023-08-17T17:34:23.198889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547875+0000","last_change":"2023-08-17T17:34:23.547875+0000","last_active":"2023-08-17T17:34:23.547875+0000","last_peered":"2023-08-17T17:34:23.547875+0000","last_clean":"2023-08-17T17:34:23.547875+0000","last_became_active":"2023-08-17T17:34:23.547593+0000","last_became_peered":"2023-08-17T17:34:23.547593+0000","last_unstale":"2023-08-17T17:34:23.547875+0000","last_undegraded":"2023-08-17T17:34:23.547875+0000","last_fullsized":"2023-08-17T17:34:23.547875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541748+0000","last_change":"2023-08-17T17:34:23.190210+0000","last_active":"2023-08-17T17:34:23.541748+0000","last_peered":"2023-08-17T17:34:23.541748+0000","last_clean":"2023-08-17T17:34:23.541748+0000","last_became_active":"2023-08-17T17:34:23.189745+0000","last_became_peered":"2023-08-17T17:34:23.189745+0000","last_unstale":"2023-08-17T17:34:23.541748+0000","last_undegraded":"2023-08-17T17:34:23.541748+0000","last_fullsized":"2023-08-17T17:34:23.541748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555242+0000","last_change":"2023-08-17T17:34:23.555242+0000","last_active":"2023-08-17T17:34:23.555242+0000","last_peered":"2023-08-17T17:34:23.555242+0000","last_clean":"2023-08-17T17:34:23.555242+0000","last_became_active":"2023-08-17T17:34:23.554975+0000","last_became_peered":"2023-08-17T17:34:23.554975+0000","last_unstale":"2023-08-17T17:34:23.555242+0000","last_undegraded":"2023-08-17T17:34:23.555242+0000","last_fullsized":"2023-08-17T17:34:23.555242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535659+0000","last_change":"2023-08-17T17:34:23.186514+0000","last_active":"2023-08-17T17:34:23.535659+0000","last_peered":"2023-08-17T17:34:23.535659+0000","last_clean":"2023-08-17T17:34:23.535659+0000","last_became_active":"2023-08-17T17:34:23.186237+0000","last_became_peered":"2023-08-17T17:34:23.186237+0000","last_unstale":"2023-08-17T17:34:23.535659+0000","last_undegraded":"2023-08-17T17:34:23.535659+0000","last_fullsized":"2023-08-17T17:34:23.535659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556160+0000","last_change":"2023-08-17T17:34:23.556160+0000","last_active":"2023-08-17T17:34:23.556160+0000","last_peered":"2023-08-17T17:34:23.556160+0000","last_clean":"2023-08-17T17:34:23.556160+0000","last_became_active":"2023-08-17T17:34:23.555906+0000","last_became_peered":"2023-08-17T17:34:23.555906+0000","last_unstale":"2023-08-17T17:34:23.556160+0000","last_undegraded":"2023-08-17T17:34:23.556160+0000","last_fullsized":"2023-08-17T17:34:23.556160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537668+0000","last_change":"2023-08-17T17:34:23.188736+0000","last_active":"2023-08-17T17:34:23.537668+0000","last_peered":"2023-08-17T17:34:23.537668+0000","last_clean":"2023-08-17T17:34:23.537668+0000","last_became_active":"2023-08-17T17:34:23.188463+0000","last_became_peered":"2023-08-17T17:34:23.188463+0000","last_unstale":"2023-08-17T17:34:23.537668+0000","last_undegraded":"2023-08-17T17:34:23.537668+0000","last_fullsized":"2023-08-17T17:34:23.537668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556037+0000","last_change":"2023-08-17T17:34:23.556037+0000","last_active":"2023-08-17T17:34:23.556037+0000","last_peered":"2023-08-17T17:34:23.556037+0000","last_clean":"2023-08-17T17:34:23.556037+0000","last_became_active":"2023-08-17T17:34:23.555773+0000","last_became_peered":"2023-08-17T17:34:23.555773+0000","last_unstale":"2023-08-17T17:34:23.556037+0000","last_undegraded":"2023-08-17T17:34:23.556037+0000","last_fullsized":"2023-08-17T17:34:23.556037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555701+0000","last_change":"2023-08-17T17:34:23.182339+0000","last_active":"2023-08-17T17:34:23.555701+0000","last_peered":"2023-08-17T17:34:23.555701+0000","last_clean":"2023-08-17T17:34:23.555701+0000","last_became_active":"2023-08-17T17:34:23.182072+0000","last_became_peered":"2023-08-17T17:34:23.182072+0000","last_unstale":"2023-08-17T17:34:23.555701+0000","last_undegraded":"2023-08-17T17:34:23.555701+0000","last_fullsized":"2023-08-17T17:34:23.555701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547106+0000","last_change":"2023-08-17T17:34:23.540248+0000","last_active":"2023-08-17T17:34:23.547106+0000","last_peered":"2023-08-17T17:34:23.547106+0000","last_clean":"2023-08-17T17:34:23.547106+0000","last_became_active":"2023-08-17T17:34:23.539612+0000","last_became_peered":"2023-08-17T17:34:23.539612+0000","last_unstale":"2023-08-17T17:34:23.547106+0000","last_undegraded":"2023-08-17T17:34:23.547106+0000","last_fullsized":"2023-08-17T17:34:23.547106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199100+0000","last_change":"2023-08-17T17:34:23.191957+0000","last_active":"2023-08-17T17:34:23.199100+0000","last_peered":"2023-08-17T17:34:23.199100+0000","last_clean":"2023-08-17T17:34:23.199100+0000","last_became_active":"2023-08-17T17:34:23.191666+0000","last_became_peered":"2023-08-17T17:34:23.191666+0000","last_unstale":"2023-08-17T17:34:23.199100+0000","last_undegraded":"2023-08-17T17:34:23.199100+0000","last_fullsized":"2023-08-17T17:34:23.199100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553646+0000","last_change":"2023-08-17T17:34:23.553646+0000","last_active":"2023-08-17T17:34:23.553646+0000","last_peered":"2023-08-17T17:34:23.553646+0000","last_clean":"2023-08-17T17:34:23.553646+0000","last_became_active":"2023-08-17T17:34:23.553378+0000","last_became_peered":"2023-08-17T17:34:23.553378+0000","last_unstale":"2023-08-17T17:34:23.553646+0000","last_undegraded":"2023-08-17T17:34:23.553646+0000","last_fullsized":"2023-08-17T17:34:23.553646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.196120+0000","last_change":"2023-08-17T17:34:23.191017+0000","last_active":"2023-08-17T17:34:23.196120+0000","last_peered":"2023-08-17T17:34:23.196120+0000","last_clean":"2023-08-17T17:34:23.196120+0000","last_became_active":"2023-08-17T17:34:23.190761+0000","last_became_peered":"2023-08-17T17:34:23.190761+0000","last_unstale":"2023-08-17T17:34:23.196120+0000","last_undegraded":"2023-08-17T17:34:23.196120+0000","last_fullsized":"2023-08-17T17:34:23.196120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556028+0000","last_change":"2023-08-17T17:34:23.552814+0000","last_active":"2023-08-17T17:34:23.556028+0000","last_peered":"2023-08-17T17:34:23.556028+0000","last_clean":"2023-08-17T17:34:23.556028+0000","last_became_active":"2023-08-17T17:34:23.552549+0000","last_became_peered":"2023-08-17T17:34:23.552549+0000","last_unstale":"2023-08-17T17:34:23.556028+0000","last_undegraded":"2023-08-17T17:34:23.556028+0000","last_fullsized":"2023-08-17T17:34:23.556028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553788+0000","last_change":"2023-08-17T17:34:23.184359+0000","last_active":"2023-08-17T17:34:23.553788+0000","last_peered":"2023-08-17T17:34:23.553788+0000","last_clean":"2023-08-17T17:34:23.553788+0000","last_became_active":"2023-08-17T17:34:23.183723+0000","last_became_peered":"2023-08-17T17:34:23.183723+0000","last_unstale":"2023-08-17T17:34:23.553788+0000","last_undegraded":"2023-08-17T17:34:23.553788+0000","last_fullsized":"2023-08-17T17:34:23.553788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555985+0000","last_change":"2023-08-17T17:34:23.551730+0000","last_active":"2023-08-17T17:34:23.555985+0000","last_peered":"2023-08-17T17:34:23.555985+0000","last_clean":"2023-08-17T17:34:23.555985+0000","last_became_active":"2023-08-17T17:34:23.551463+0000","last_became_peered":"2023-08-17T17:34:23.551463+0000","last_unstale":"2023-08-17T17:34:23.555985+0000","last_undegraded":"2023-08-17T17:34:23.555985+0000","last_fullsized":"2023-08-17T17:34:23.555985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556856+0000","last_change":"2023-08-17T17:34:23.189962+0000","last_active":"2023-08-17T17:34:23.556856+0000","last_peered":"2023-08-17T17:34:23.556856+0000","last_clean":"2023-08-17T17:34:23.556856+0000","last_became_active":"2023-08-17T17:34:23.189247+0000","last_became_peered":"2023-08-17T17:34:23.189247+0000","last_unstale":"2023-08-17T17:34:23.556856+0000","last_undegraded":"2023-08-17T17:34:23.556856+0000","last_fullsized":"2023-08-17T17:34:23.556856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547521+0000","last_change":"2023-08-17T17:34:23.542831+0000","last_active":"2023-08-17T17:34:23.547521+0000","last_peered":"2023-08-17T17:34:23.547521+0000","last_clean":"2023-08-17T17:34:23.547521+0000","last_became_active":"2023-08-17T17:34:23.542564+0000","last_became_peered":"2023-08-17T17:34:23.542564+0000","last_unstale":"2023-08-17T17:34:23.547521+0000","last_undegraded":"2023-08-17T17:34:23.547521+0000","last_fullsized":"2023-08-17T17:34:23.547521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198338+0000","last_change":"2023-08-17T17:34:23.193784+0000","last_active":"2023-08-17T17:34:23.198338+0000","last_peered":"2023-08-17T17:34:23.198338+0000","last_clean":"2023-08-17T17:34:23.198338+0000","last_became_active":"2023-08-17T17:34:23.193515+0000","last_became_peered":"2023-08-17T17:34:23.193515+0000","last_unstale":"2023-08-17T17:34:23.198338+0000","last_undegraded":"2023-08-17T17:34:23.198338+0000","last_fullsized":"2023-08-17T17:34:23.198338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.559293+0000","last_change":"2023-08-17T17:34:23.559293+0000","last_active":"2023-08-17T17:34:23.559293+0000","last_peered":"2023-08-17T17:34:23.559293+0000","last_clean":"2023-08-17T17:34:23.559293+0000","last_became_active":"2023-08-17T17:34:23.559072+0000","last_became_peered":"2023-08-17T17:34:23.559072+0000","last_unstale":"2023-08-17T17:34:23.559293+0000","last_undegraded":"2023-08-17T17:34:23.559293+0000","last_fullsized":"2023-08-17T17:34:23.559293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.197608+0000","last_change":"2023-08-17T17:34:23.191570+0000","last_active":"2023-08-17T17:34:23.197608+0000","last_peered":"2023-08-17T17:34:23.197608+0000","last_clean":"2023-08-17T17:34:23.197608+0000","last_became_active":"2023-08-17T17:34:23.191127+0000","last_became_peered":"2023-08-17T17:34:23.191127+0000","last_unstale":"2023-08-17T17:34:23.197608+0000","last_undegraded":"2023-08-17T17:34:23.197608+0000","last_fullsized":"2023-08-17T17:34:23.197608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.548523+0000","last_change":"2023-08-17T17:34:23.548523+0000","last_active":"2023-08-17T17:34:23.548523+0000","last_peered":"2023-08-17T17:34:23.548523+0000","last_clean":"2023-08-17T17:34:23.548523+0000","last_became_active":"2023-08-17T17:34:23.548180+0000","last_became_peered":"2023-08-17T17:34:23.548180+0000","last_unstale":"2023-08-17T17:34:23.548523+0000","last_undegraded":"2023-08-17T17:34:23.548523+0000","last_fullsized":"2023-08-17T17:34:23.548523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198636+0000","last_change":"2023-08-17T17:34:23.193931+0000","last_active":"2023-08-17T17:34:23.198636+0000","last_peered":"2023-08-17T17:34:23.198636+0000","last_clean":"2023-08-17T17:34:23.198636+0000","last_became_active":"2023-08-17T17:34:23.193104+0000","last_became_peered":"2023-08-17T17:34:23.193104+0000","last_unstale":"2023-08-17T17:34:23.198636+0000","last_undegraded":"2023-08-17T17:34:23.198636+0000","last_fullsized":"2023-08-17T17:34:23.198636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555975+0000","last_change":"2023-08-17T17:34:23.551080+0000","last_active":"2023-08-17T17:34:23.555975+0000","last_peered":"2023-08-17T17:34:23.555975+0000","last_clean":"2023-08-17T17:34:23.555975+0000","last_became_active":"2023-08-17T17:34:23.550830+0000","last_became_peered":"2023-08-17T17:34:23.550830+0000","last_unstale":"2023-08-17T17:34:23.555975+0000","last_undegraded":"2023-08-17T17:34:23.555975+0000","last_fullsized":"2023-08-17T17:34:23.555975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.185609+0000","last_change":"2023-08-17T17:34:23.182626+0000","last_active":"2023-08-17T17:34:23.185609+0000","last_peered":"2023-08-17T17:34:23.185609+0000","last_clean":"2023-08-17T17:34:23.185609+0000","last_became_active":"2023-08-17T17:34:23.182368+0000","last_became_peered":"2023-08-17T17:34:23.182368+0000","last_unstale":"2023-08-17T17:34:23.185609+0000","last_undegraded":"2023-08-17T17:34:23.185609+0000","last_fullsized":"2023-08-17T17:34:23.185609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547126+0000","last_change":"2023-08-17T17:34:23.540567+0000","last_active":"2023-08-17T17:34:23.547126+0000","last_peered":"2023-08-17T17:34:23.547126+0000","last_clean":"2023-08-17T17:34:23.547126+0000","last_became_active":"2023-08-17T17:34:23.539925+0000","last_became_peered":"2023-08-17T17:34:23.539925+0000","last_unstale":"2023-08-17T17:34:23.547126+0000","last_undegraded":"2023-08-17T17:34:23.547126+0000","last_fullsized":"2023-08-17T17:34:23.547126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198753+0000","last_change":"2023-08-17T17:34:23.194479+0000","last_active":"2023-08-17T17:34:23.198753+0000","last_peered":"2023-08-17T17:34:23.198753+0000","last_clean":"2023-08-17T17:34:23.198753+0000","last_became_active":"2023-08-17T17:34:23.194196+0000","last_became_peered":"2023-08-17T17:34:23.194196+0000","last_unstale":"2023-08-17T17:34:23.198753+0000","last_undegraded":"2023-08-17T17:34:23.198753+0000","last_fullsized":"2023-08-17T17:34:23.198753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553805+0000","last_change":"2023-08-17T17:34:23.553805+0000","last_active":"2023-08-17T17:34:23.553805+0000","last_peered":"2023-08-17T17:34:23.553805+0000","last_clean":"2023-08-17T17:34:23.553805+0000","last_became_active":"2023-08-17T17:34:23.553524+0000","last_became_peered":"2023-08-17T17:34:23.553524+0000","last_unstale":"2023-08-17T17:34:23.553805+0000","last_undegraded":"2023-08-17T17:34:23.553805+0000","last_fullsized":"2023-08-17T17:34:23.553805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553107+0000","last_change":"2023-08-17T17:34:23.184707+0000","last_active":"2023-08-17T17:34:23.553107+0000","last_peered":"2023-08-17T17:34:23.553107+0000","last_clean":"2023-08-17T17:34:23.553107+0000","last_became_active":"2023-08-17T17:34:23.184244+0000","last_became_peered":"2023-08-17T17:34:23.184244+0000","last_unstale":"2023-08-17T17:34:23.553107+0000","last_undegraded":"2023-08-17T17:34:23.553107+0000","last_fullsized":"2023-08-17T17:34:23.553107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558704+0000","last_change":"2023-08-17T17:34:23.558704+0000","last_active":"2023-08-17T17:34:23.558704+0000","last_peered":"2023-08-17T17:34:23.558704+0000","last_clean":"2023-08-17T17:34:23.558704+0000","last_became_active":"2023-08-17T17:34:23.558374+0000","last_became_peered":"2023-08-17T17:34:23.558374+0000","last_unstale":"2023-08-17T17:34:23.558704+0000","last_undegraded":"2023-08-17T17:34:23.558704+0000","last_fullsized":"2023-08-17T17:34:23.558704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541721+0000","last_change":"2023-08-17T17:34:23.190318+0000","last_active":"2023-08-17T17:34:23.541721+0000","last_peered":"2023-08-17T17:34:23.541721+0000","last_clean":"2023-08-17T17:34:23.541721+0000","last_became_active":"2023-08-17T17:34:23.190011+0000","last_became_peered":"2023-08-17T17:34:23.190011+0000","last_unstale":"2023-08-17T17:34:23.541721+0000","last_undegraded":"2023-08-17T17:34:23.541721+0000","last_fullsized":"2023-08-17T17:34:23.541721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552175+0000","last_change":"2023-08-17T17:34:23.552175+0000","last_active":"2023-08-17T17:34:23.552175+0000","last_peered":"2023-08-17T17:34:23.552175+0000","last_clean":"2023-08-17T17:34:23.552175+0000","last_became_active":"2023-08-17T17:34:23.551927+0000","last_became_peered":"2023-08-17T17:34:23.551927+0000","last_unstale":"2023-08-17T17:34:23.552175+0000","last_undegraded":"2023-08-17T17:34:23.552175+0000","last_fullsized":"2023-08-17T17:34:23.552175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561308+0000","last_change":"2023-08-17T17:34:23.184913+0000","last_active":"2023-08-17T17:34:23.561308+0000","last_peered":"2023-08-17T17:34:23.561308+0000","last_clean":"2023-08-17T17:34:23.561308+0000","last_became_active":"2023-08-17T17:34:23.184622+0000","last_became_peered":"2023-08-17T17:34:23.184622+0000","last_unstale":"2023-08-17T17:34:23.561308+0000","last_undegraded":"2023-08-17T17:34:23.561308+0000","last_fullsized":"2023-08-17T17:34:23.561308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555151+0000","last_change":"2023-08-17T17:34:23.555151+0000","last_active":"2023-08-17T17:34:23.555151+0000","last_peered":"2023-08-17T17:34:23.555151+0000","last_clean":"2023-08-17T17:34:23.555151+0000","last_became_active":"2023-08-17T17:34:23.554868+0000","last_became_peered":"2023-08-17T17:34:23.554868+0000","last_unstale":"2023-08-17T17:34:23.555151+0000","last_undegraded":"2023-08-17T17:34:23.555151+0000","last_fullsized":"2023-08-17T17:34:23.555151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195535+0000","last_change":"2023-08-17T17:34:23.189742+0000","last_active":"2023-08-17T17:34:23.195535+0000","last_peered":"2023-08-17T17:34:23.195535+0000","last_clean":"2023-08-17T17:34:23.195535+0000","last_became_active":"2023-08-17T17:34:23.189466+0000","last_became_peered":"2023-08-17T17:34:23.189466+0000","last_unstale":"2023-08-17T17:34:23.195535+0000","last_undegraded":"2023-08-17T17:34:23.195535+0000","last_fullsized":"2023-08-17T17:34:23.195535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553968+0000","last_change":"2023-08-17T17:34:23.553968+0000","last_active":"2023-08-17T17:34:23.553968+0000","last_peered":"2023-08-17T17:34:23.553968+0000","last_clean":"2023-08-17T17:34:23.553968+0000","last_became_active":"2023-08-17T17:34:23.552409+0000","last_became_peered":"2023-08-17T17:34:23.552409+0000","last_unstale":"2023-08-17T17:34:23.553968+0000","last_undegraded":"2023-08-17T17:34:23.553968+0000","last_fullsized":"2023-08-17T17:34:23.553968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193391+0000","last_change":"2023-08-17T17:34:23.189070+0000","last_active":"2023-08-17T17:34:23.193391+0000","last_peered":"2023-08-17T17:34:23.193391+0000","last_clean":"2023-08-17T17:34:23.193391+0000","last_became_active":"2023-08-17T17:34:23.188771+0000","last_became_peered":"2023-08-17T17:34:23.188771+0000","last_unstale":"2023-08-17T17:34:23.193391+0000","last_undegraded":"2023-08-17T17:34:23.193391+0000","last_fullsized":"2023-08-17T17:34:23.193391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554378+0000","last_change":"2023-08-17T17:34:23.549482+0000","last_active":"2023-08-17T17:34:23.554378+0000","last_peered":"2023-08-17T17:34:23.554378+0000","last_clean":"2023-08-17T17:34:23.554378+0000","last_became_active":"2023-08-17T17:34:23.549214+0000","last_became_peered":"2023-08-17T17:34:23.549214+0000","last_unstale":"2023-08-17T17:34:23.554378+0000","last_undegraded":"2023-08-17T17:34:23.554378+0000","last_fullsized":"2023-08-17T17:34:23.554378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557177+0000","last_change":"2023-08-17T17:34:23.191534+0000","last_active":"2023-08-17T17:34:23.557177+0000","last_peered":"2023-08-17T17:34:23.557177+0000","last_clean":"2023-08-17T17:34:23.557177+0000","last_became_active":"2023-08-17T17:34:23.191251+0000","last_became_peered":"2023-08-17T17:34:23.191251+0000","last_unstale":"2023-08-17T17:34:23.557177+0000","last_undegraded":"2023-08-17T17:34:23.557177+0000","last_fullsized":"2023-08-17T17:34:23.557177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":80051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":80083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":78727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":80229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:34:27.211 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T17:34:27.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.353+0000 7f17be5e3700 1 Processor -- start 2023-08-17T17:34:27.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.353+0000 7f17be5e3700 1 -- start start 2023-08-17T17:34:27.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17be5e3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f17b80c01b0 0x7f17b80c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17be5e3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17b80a7bd0 0x7f17b8063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17be5e3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b8063960 con 0x7f17b80a8050 2023-08-17T17:34:27.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17be5e3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b80649f0 con 0x7f17b80a7bd0 2023-08-17T17:34:27.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17be5e3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b8063030 con 0x7f17b80c01b0 2023-08-17T17:34:27.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17bcde0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17b80a7bd0 0x7f17b8063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17bcde0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17b80a7bd0 0x7f17b8063df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54298/0 (socket says 172.21.15.78:54298) 2023-08-17T17:34:27.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17bcde0700 1 -- 172.21.15.78:0/2192041907 learned_addr learned my addr 172.21.15.78:0/2192041907 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:27.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17bcde0700 1 -- 172.21.15.78:0/2192041907 >> v2:172.21.15.150:3300/0 conn(0x7f17b80c01b0 msgr2=0x7f17b80c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:27.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17bcde0700 1 --2- 172.21.15.78:0/2192041907 >> v2:172.21.15.150:3300/0 conn(0x7f17b80c01b0 0x7f17b80c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:27.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17bcde0700 1 -- 172.21.15.78:0/2192041907 >> v1:172.21.15.150:6789/0 conn(0x7f17b80a8050 legacy=0x7f17b80642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:27.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17bcde0700 1 -- 172.21.15.78:0/2192041907 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8063310 con 0x7f17b80a7bd0 2023-08-17T17:34:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.354+0000 7f17bcde0700 1 --2- 172.21.15.78:0/2192041907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 0x7f17b8063df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f17b805e020 tx=0x7f17a80090f0).ready entity=mon.0 client_cookie=684655f622536e50 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17affff700 1 -- 172.21.15.78:0/2192041907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a800b5a0 con 0x7f17b80a7bd0 2023-08-17T17:34:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17affff700 1 -- 172.21.15.78:0/2192041907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a800b700 con 0x7f17b80a7bd0 2023-08-17T17:34:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17affff700 1 -- 172.21.15.78:0/2192041907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a800ba80 con 0x7f17b80a7bd0 2023-08-17T17:34:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17be5e3700 1 -- 172.21.15.78:0/2192041907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 msgr2=0x7f17b8063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17be5e3700 1 --2- 172.21.15.78:0/2192041907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 0x7f17b8063df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f17b805e020 tx=0x7f17a80090f0).stop 2023-08-17T17:34:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17be5e3700 1 -- 172.21.15.78:0/2192041907 shutdown_connections 2023-08-17T17:34:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17be5e3700 1 --2- 172.21.15.78:0/2192041907 >> v2:172.21.15.150:3300/0 conn(0x7f17b80c01b0 0x7f17b80c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17be5e3700 1 --2- 172.21.15.78:0/2192041907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 0x7f17b8063df0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17be5e3700 1 -- 172.21.15.78:0/2192041907 >> 172.21.15.78:0/2192041907 conn(0x7f17b806a6c0 msgr2=0x7f17b80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17be5e3700 1 -- 172.21.15.78:0/2192041907 shutdown_connections 2023-08-17T17:34:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.355+0000 7f17be5e3700 1 -- 172.21.15.78:0/2192041907 wait complete. 2023-08-17T17:34:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.356+0000 7f17be5e3700 1 Processor -- start 2023-08-17T17:34:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.356+0000 7f17be5e3700 1 -- start start 2023-08-17T17:34:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.357+0000 7f17be5e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 0x7f17b80ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.357+0000 7f17be5e3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17b80a8050 0x7f17b80ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.357+0000 7f17be5e3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b80c01b0 0x7f17b8167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.357+0000 7f17be5e3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80c50c0 con 0x7f17b80a7bd0 2023-08-17T17:34:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.357+0000 7f17be5e3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80c4480 con 0x7f17b80a8050 2023-08-17T17:34:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.357+0000 7f17be5e3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80c4720 con 0x7f17b80c01b0 2023-08-17T17:34:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.357+0000 7f17bd5e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 0x7f17b80ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.357+0000 7f17bd5e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 0x7f17b80ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54308/0 (socket says 172.21.15.78:54308) 2023-08-17T17:34:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.357+0000 7f17bd5e1700 1 -- 172.21.15.78:0/1277363569 learned_addr learned my addr 172.21.15.78:0/1277363569 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.357+0000 7f17bcde0700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17b80a8050 0x7f17b80ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17bdde2700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b80c01b0 0x7f17b8167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17bd5e1700 1 -- 172.21.15.78:0/1277363569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b80c01b0 msgr2=0x7f17b8167ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17bd5e1700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b80c01b0 0x7f17b8167ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17bd5e1700 1 -- 172.21.15.78:0/1277363569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17b80a8050 msgr2=0x7f17b80ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17bd5e1700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17b80a8050 0x7f17b80ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17bd5e1700 1 -- 172.21.15.78:0/1277363569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8009370 con 0x7f17b80a7bd0 2023-08-17T17:34:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17bdde2700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b80c01b0 0x7f17b8167ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17bd5e1700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 0x7f17b80ad180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f17b400b490 tx=0x7f17b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17ad7fa700 1 -- 172.21.15.78:0/1277363569 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4002320 con 0x7f17b80a7bd0 2023-08-17T17:34:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17ad7fa700 1 -- 172.21.15.78:0/1277363569 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b4002480 con 0x7f17b80a7bd0 2023-08-17T17:34:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17be5e3700 1 -- 172.21.15.78:0/1277363569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b80c4a00 con 0x7f17b80a7bd0 2023-08-17T17:34:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17ad7fa700 1 -- 172.21.15.78:0/1277363569 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4002840 con 0x7f17b80a7bd0 2023-08-17T17:34:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.358+0000 7f17be5e3700 1 -- 172.21.15.78:0/1277363569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b80ad670 con 0x7f17b80a7bd0 2023-08-17T17:34:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.359+0000 7f17be5e3700 1 -- 172.21.15.78:0/1277363569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b80c54c0 con 0x7f17b80a7bd0 2023-08-17T17:34:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.359+0000 7f17ad7fa700 1 -- 172.21.15.78:0/1277363569 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f17b400f030 con 0x7f17b80a7bd0 2023-08-17T17:34:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.359+0000 7f17ad7fa700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f179c05ed90 0x7f179c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.359+0000 7f17ad7fa700 1 -- 172.21.15.78:0/1277363569 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f17b40797b0 con 0x7f17b80a7bd0 2023-08-17T17:34:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.359+0000 7f17bcde0700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f179c05ed90 0x7f179c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.360+0000 7f17bcde0700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f179c05ed90 0x7f179c061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f17a8009130 tx=0x7f17a8015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:27.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.363+0000 7f17ad7fa700 1 -- 172.21.15.78:0/1277363569 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17b404ad50 con 0x7f17b80a7bd0 2023-08-17T17:34:27.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.591+0000 7f17be5e3700 1 -- 172.21.15.78:0/1277363569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f17b8083af0 con 0x7f17b80a7bd0 2023-08-17T17:34:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.592+0000 7f17ad7fa700 1 -- 172.21.15.78:0/1277363569 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+950 (secure 0 0 0) 0x7f17b404e370 con 0x7f17b80a7bd0 2023-08-17T17:34:27.593 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:27.594 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1692293655,"num_in_osds":8,"osd_in_since":1692293648,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2435637248,"bytes_avail":770658476032,"bytes_total":773094113280},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4266}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-08-17T17:34:06.319023+0000","services":{}},"progress_events":{}} 2023-08-17T17:34:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 -- 172.21.15.78:0/1277363569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f179c05ed90 msgr2=0x7f179c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f179c05ed90 0x7f179c061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f17a8009130 tx=0x7f17a8015000).stop 2023-08-17T17:34:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 -- 172.21.15.78:0/1277363569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 msgr2=0x7f17b80ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 0x7f17b80ad180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f17b400b490 tx=0x7f17b4009060).stop 2023-08-17T17:34:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 -- 172.21.15.78:0/1277363569 shutdown_connections 2023-08-17T17:34:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f179c05ed90 0x7f179c061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17b80c01b0 0x7f17b8167ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b80a7bd0 0x7f17b80ad180 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 --2- 172.21.15.78:0/1277363569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17b80a8050 0x7f17b80ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 -- 172.21.15.78:0/1277363569 >> 172.21.15.78:0/1277363569 conn(0x7f17b806a6c0 msgr2=0x7f17b80c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 -- 172.21.15.78:0/1277363569 shutdown_connections 2023-08-17T17:34:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.594+0000 7f17be5e3700 1 -- 172.21.15.78:0/1277363569 wait complete. 2023-08-17T17:34:27.607 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-17T17:34:27.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:34:27.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.718+0000 7fc7ea17d700 1 Processor -- start 2023-08-17T17:34:27.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.719+0000 7fc7ea17d700 1 -- start start 2023-08-17T17:34:27.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.719+0000 7fc7ea17d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7e40a7fe0 0x7fc7e4064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.719+0000 7fc7ea17d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e40c4040 con 0x7fc7e4065140 2023-08-17T17:34:27.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.719+0000 7fc7ea17d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e40c3430 con 0x7fc7e40bef00 2023-08-17T17:34:27.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.719+0000 7fc7ea17d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e40c3710 con 0x7fc7e40a7fe0 2023-08-17T17:34:27.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7e40a7fe0 0x7fc7e4064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e2ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc7e4065140 0x7fc7e40be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36374/0 (socket says 172.21.15.78:36374) 2023-08-17T17:34:27.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e2ffd700 1 -- 172.21.15.78:0/3111798628 learned_addr learned my addr 172.21.15.78:0/3111798628 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:27.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e37fe700 1 -- 172.21.15.78:0/3111798628 >> v1:172.21.15.150:6789/0 conn(0x7fc7e40bef00 legacy=0x7fc7e40c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e37fe700 1 -- 172.21.15.78:0/3111798628 >> v1:172.21.15.78:6789/0 conn(0x7fc7e4065140 legacy=0x7fc7e40be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e27fc700 1 -- 172.21.15.78:0/3111798628 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695025043 0 0) 0x7fc7e40c4040 con 0x7fc7e4065140 2023-08-17T17:34:27.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e37fe700 1 -- 172.21.15.78:0/3111798628 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e40c39f0 con 0x7fc7e40a7fe0 2023-08-17T17:34:27.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e37fe700 1 --2- 172.21.15.78:0/3111798628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40a7fe0 0x7fc7e4064180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc7d4009e60 tx=0x7fc7d4009780).ready entity=mon.0 client_cookie=1e9daaee880c1725 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:27.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e27fc700 1 -- 172.21.15.78:0/3111798628 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d400e070 con 0x7fc7e40a7fe0 2023-08-17T17:34:27.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e27fc700 1 -- 172.21.15.78:0/3111798628 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d400bc30 con 0x7fc7e40a7fe0 2023-08-17T17:34:27.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.720+0000 7fc7e27fc700 1 -- 172.21.15.78:0/3111798628 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4012410 con 0x7fc7e40a7fe0 2023-08-17T17:34:27.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.721+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3111798628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40a7fe0 msgr2=0x7fc7e4064180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.721+0000 7fc7ea17d700 1 --2- 172.21.15.78:0/3111798628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40a7fe0 0x7fc7e4064180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc7d4009e60 tx=0x7fc7d4009780).stop 2023-08-17T17:34:27.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.721+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3111798628 shutdown_connections 2023-08-17T17:34:27.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.721+0000 7fc7ea17d700 1 --2- 172.21.15.78:0/3111798628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40a7fe0 0x7fc7e4064180 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.721+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3111798628 >> 172.21.15.78:0/3111798628 conn(0x7fc7e4092330 msgr2=0x7fc7e4062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:27.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.721+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3111798628 shutdown_connections 2023-08-17T17:34:27.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.721+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3111798628 wait complete. 2023-08-17T17:34:27.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.722+0000 7fc7ea17d700 1 Processor -- start 2023-08-17T17:34:27.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.722+0000 7fc7ea17d700 1 -- start start 2023-08-17T17:34:27.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7ea17d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e4065140 0x7fc7e4154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7ea17d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e40a7fe0 0x7fc7e40a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7ea17d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40bef00 0x7fc7e40ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7ea17d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e4154eb0 con 0x7fc7e40bef00 2023-08-17T17:34:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7ea17d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e4155190 con 0x7fc7e4065140 2023-08-17T17:34:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7ea17d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e4155470 con 0x7fc7e40a7fe0 2023-08-17T17:34:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40bef00 0x7fc7e40ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40bef00 0x7fc7e40ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54330/0 (socket says 172.21.15.78:54330) 2023-08-17T17:34:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e3fff700 1 -- 172.21.15.78:0/3445302091 learned_addr learned my addr 172.21.15.78:0/3445302091 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:27.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e37fe700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e4065140 0x7fc7e4154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e2ffd700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e40a7fe0 0x7fc7e40a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e3fff700 1 -- 172.21.15.78:0/3445302091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e40a7fe0 msgr2=0x7fc7e40a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e3fff700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e40a7fe0 0x7fc7e40a91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e3fff700 1 -- 172.21.15.78:0/3445302091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e4065140 msgr2=0x7fc7e4154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e3fff700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e4065140 0x7fc7e4154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e3fff700 1 -- 172.21.15.78:0/3445302091 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d4009a20 con 0x7fc7e40bef00 2023-08-17T17:34:27.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e37fe700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e4065140 0x7fc7e4154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:27.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e2ffd700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e40a7fe0 0x7fc7e40a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:27.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7e3fff700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40bef00 0x7fc7e40ae680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fc7dc00c440 tx=0x7fc7dc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:27.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7db7fe700 1 -- 172.21.15.78:0/3445302091 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00ce20 con 0x7fc7e40bef00 2023-08-17T17:34:27.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7db7fe700 1 -- 172.21.15.78:0/3445302091 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00f470 con 0x7fc7e40bef00 2023-08-17T17:34:27.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3445302091 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e4155750 con 0x7fc7e40bef00 2023-08-17T17:34:27.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7db7fe700 1 -- 172.21.15.78:0/3445302091 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00f7f0 con 0x7fc7e40bef00 2023-08-17T17:34:27.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.723+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3445302091 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e4155a30 con 0x7fc7e40bef00 2023-08-17T17:34:27.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.724+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3445302091 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e4047350 con 0x7fc7e40bef00 2023-08-17T17:34:27.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.724+0000 7fc7db7fe700 1 -- 172.21.15.78:0/3445302091 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc7dc010070 con 0x7fc7e40bef00 2023-08-17T17:34:27.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.725+0000 7fc7db7fe700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc7c405ed90 0x7fc7c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:27.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.725+0000 7fc7db7fe700 1 -- 172.21.15.78:0/3445302091 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc7dc078e20 con 0x7fc7e40bef00 2023-08-17T17:34:27.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.725+0000 7fc7e37fe700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc7c405ed90 0x7fc7c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:27.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.725+0000 7fc7e37fe700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc7c405ed90 0x7fc7c4061250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc7e40ab540 tx=0x7fc7e40c3fb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:27.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.729+0000 7fc7db7fe700 1 -- 172.21.15.78:0/3445302091 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc7dc0478f0 con 0x7fc7e40bef00 2023-08-17T17:34:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.888+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3445302091 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7e405f410 con 0x7fc7c405ed90 2023-08-17T17:34:27.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.897+0000 7fc7db7fe700 1 -- 172.21.15.78:0/3445302091 <== mgr.4104 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336402 (secure 0 0 0) 0x7fc7e405f410 con 0x7fc7c405ed90 2023-08-17T17:34:27.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:27.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3445302091 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc7c405ed90 msgr2=0x7fc7c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc7c405ed90 0x7fc7c4061250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc7e40ab540 tx=0x7fc7e40c3fb0).stop 2023-08-17T17:34:27.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3445302091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40bef00 msgr2=0x7fc7e40ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:27.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40bef00 0x7fc7e40ae680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fc7dc00c440 tx=0x7fc7dc007d70).stop 2023-08-17T17:34:27.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3445302091 shutdown_connections 2023-08-17T17:34:27.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc7c405ed90 0x7fc7c4061250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e40bef00 0x7fc7e40ae680 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e4065140 0x7fc7e4154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 --2- 172.21.15.78:0/3445302091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e40a7fe0 0x7fc7e40a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:27.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3445302091 >> 172.21.15.78:0/3445302091 conn(0x7fc7e4092330 msgr2=0x7fc7e40a5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:27.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3445302091 shutdown_connections 2023-08-17T17:34:27.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:27.900+0000 7fc7ea17d700 1 -- 172.21.15.78:0/3445302091 wait complete. 2023-08-17T17:34:27.910 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:34:27.913 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:34:27.009043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378552,"kb_used_data":1784,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596168,"statfs":{"total":773094113280,"available":770658476032,"internally_reserved":0,"allocated":1826816,"data_stored":647116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557678+0000","last_change":"2023-08-17T17:34:23.557678+0000","last_active":"2023-08-17T17:34:23.557678+0000","last_peered":"2023-08-17T17:34:23.557678+0000","last_clean":"2023-08-17T17:34:23.557678+0000","last_became_active":"2023-08-17T17:34:23.555333+0000","last_became_peered":"2023-08-17T17:34:23.555333+0000","last_unstale":"2023-08-17T17:34:23.557678+0000","last_undegraded":"2023-08-17T17:34:23.557678+0000","last_fullsized":"2023-08-17T17:34:23.557678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.197613+0000","last_change":"2023-08-17T17:34:23.190017+0000","last_active":"2023-08-17T17:34:23.197613+0000","last_peered":"2023-08-17T17:34:23.197613+0000","last_clean":"2023-08-17T17:34:23.197613+0000","last_became_active":"2023-08-17T17:34:23.189552+0000","last_became_peered":"2023-08-17T17:34:23.189552+0000","last_unstale":"2023-08-17T17:34:23.197613+0000","last_undegraded":"2023-08-17T17:34:23.197613+0000","last_fullsized":"2023-08-17T17:34:23.197613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547846+0000","last_change":"2023-08-17T17:34:23.547846+0000","last_active":"2023-08-17T17:34:23.547846+0000","last_peered":"2023-08-17T17:34:23.547846+0000","last_clean":"2023-08-17T17:34:23.547846+0000","last_became_active":"2023-08-17T17:34:23.547522+0000","last_became_peered":"2023-08-17T17:34:23.547522+0000","last_unstale":"2023-08-17T17:34:23.547846+0000","last_undegraded":"2023-08-17T17:34:23.547846+0000","last_fullsized":"2023-08-17T17:34:23.547846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199221+0000","last_change":"2023-08-17T17:34:23.196197+0000","last_active":"2023-08-17T17:34:23.199221+0000","last_peered":"2023-08-17T17:34:23.199221+0000","last_clean":"2023-08-17T17:34:23.199221+0000","last_became_active":"2023-08-17T17:34:23.195910+0000","last_became_peered":"2023-08-17T17:34:23.195910+0000","last_unstale":"2023-08-17T17:34:23.199221+0000","last_undegraded":"2023-08-17T17:34:23.199221+0000","last_fullsized":"2023-08-17T17:34:23.199221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550439+0000","last_change":"2023-08-17T17:34:23.550439+0000","last_active":"2023-08-17T17:34:23.550439+0000","last_peered":"2023-08-17T17:34:23.550439+0000","last_clean":"2023-08-17T17:34:23.550439+0000","last_became_active":"2023-08-17T17:34:23.550192+0000","last_became_peered":"2023-08-17T17:34:23.550192+0000","last_unstale":"2023-08-17T17:34:23.550439+0000","last_undegraded":"2023-08-17T17:34:23.550439+0000","last_fullsized":"2023-08-17T17:34:23.550439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195568+0000","last_change":"2023-08-17T17:34:23.186362+0000","last_active":"2023-08-17T17:34:23.195568+0000","last_peered":"2023-08-17T17:34:23.195568+0000","last_clean":"2023-08-17T17:34:23.195568+0000","last_became_active":"2023-08-17T17:34:23.186076+0000","last_became_peered":"2023-08-17T17:34:23.186076+0000","last_unstale":"2023-08-17T17:34:23.195568+0000","last_undegraded":"2023-08-17T17:34:23.195568+0000","last_fullsized":"2023-08-17T17:34:23.195568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558066+0000","last_change":"2023-08-17T17:34:23.558066+0000","last_active":"2023-08-17T17:34:23.558066+0000","last_peered":"2023-08-17T17:34:23.558066+0000","last_clean":"2023-08-17T17:34:23.558066+0000","last_became_active":"2023-08-17T17:34:23.557750+0000","last_became_peered":"2023-08-17T17:34:23.557750+0000","last_unstale":"2023-08-17T17:34:23.558066+0000","last_undegraded":"2023-08-17T17:34:23.558066+0000","last_fullsized":"2023-08-17T17:34:23.558066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193455+0000","last_change":"2023-08-17T17:34:23.185772+0000","last_active":"2023-08-17T17:34:23.193455+0000","last_peered":"2023-08-17T17:34:23.193455+0000","last_clean":"2023-08-17T17:34:23.193455+0000","last_became_active":"2023-08-17T17:34:23.185206+0000","last_became_peered":"2023-08-17T17:34:23.185206+0000","last_unstale":"2023-08-17T17:34:23.193455+0000","last_undegraded":"2023-08-17T17:34:23.193455+0000","last_fullsized":"2023-08-17T17:34:23.193455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558454+0000","last_change":"2023-08-17T17:34:23.558454+0000","last_active":"2023-08-17T17:34:23.558454+0000","last_peered":"2023-08-17T17:34:23.558454+0000","last_clean":"2023-08-17T17:34:23.558454+0000","last_became_active":"2023-08-17T17:34:23.558213+0000","last_became_peered":"2023-08-17T17:34:23.558213+0000","last_unstale":"2023-08-17T17:34:23.558454+0000","last_undegraded":"2023-08-17T17:34:23.558454+0000","last_fullsized":"2023-08-17T17:34:23.558454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538249+0000","last_change":"2023-08-17T17:34:23.188666+0000","last_active":"2023-08-17T17:34:23.538249+0000","last_peered":"2023-08-17T17:34:23.538249+0000","last_clean":"2023-08-17T17:34:23.538249+0000","last_became_active":"2023-08-17T17:34:23.188351+0000","last_became_peered":"2023-08-17T17:34:23.188351+0000","last_unstale":"2023-08-17T17:34:23.538249+0000","last_undegraded":"2023-08-17T17:34:23.538249+0000","last_fullsized":"2023-08-17T17:34:23.538249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550268+0000","last_change":"2023-08-17T17:34:23.550268+0000","last_active":"2023-08-17T17:34:23.550268+0000","last_peered":"2023-08-17T17:34:23.550268+0000","last_clean":"2023-08-17T17:34:23.550268+0000","last_became_active":"2023-08-17T17:34:23.549994+0000","last_became_peered":"2023-08-17T17:34:23.549994+0000","last_unstale":"2023-08-17T17:34:23.550268+0000","last_undegraded":"2023-08-17T17:34:23.550268+0000","last_fullsized":"2023-08-17T17:34:23.550268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561285+0000","last_change":"2023-08-17T17:34:23.187424+0000","last_active":"2023-08-17T17:34:23.561285+0000","last_peered":"2023-08-17T17:34:23.561285+0000","last_clean":"2023-08-17T17:34:23.561285+0000","last_became_active":"2023-08-17T17:34:23.187090+0000","last_became_peered":"2023-08-17T17:34:23.187090+0000","last_unstale":"2023-08-17T17:34:23.561285+0000","last_undegraded":"2023-08-17T17:34:23.561285+0000","last_fullsized":"2023-08-17T17:34:23.561285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550226+0000","last_change":"2023-08-17T17:34:23.550226+0000","last_active":"2023-08-17T17:34:23.550226+0000","last_peered":"2023-08-17T17:34:23.550226+0000","last_clean":"2023-08-17T17:34:23.550226+0000","last_became_active":"2023-08-17T17:34:23.549894+0000","last_became_peered":"2023-08-17T17:34:23.549894+0000","last_unstale":"2023-08-17T17:34:23.550226+0000","last_undegraded":"2023-08-17T17:34:23.550226+0000","last_fullsized":"2023-08-17T17:34:23.550226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557544+0000","last_change":"2023-08-17T17:34:23.191048+0000","last_active":"2023-08-17T17:34:23.557544+0000","last_peered":"2023-08-17T17:34:23.557544+0000","last_clean":"2023-08-17T17:34:23.557544+0000","last_became_active":"2023-08-17T17:34:23.189624+0000","last_became_peered":"2023-08-17T17:34:23.189624+0000","last_unstale":"2023-08-17T17:34:23.557544+0000","last_undegraded":"2023-08-17T17:34:23.557544+0000","last_fullsized":"2023-08-17T17:34:23.557544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.560468+0000","last_change":"2023-08-17T17:34:23.560468+0000","last_active":"2023-08-17T17:34:23.560468+0000","last_peered":"2023-08-17T17:34:23.560468+0000","last_clean":"2023-08-17T17:34:23.560468+0000","last_became_active":"2023-08-17T17:34:23.560200+0000","last_became_peered":"2023-08-17T17:34:23.560200+0000","last_unstale":"2023-08-17T17:34:23.560468+0000","last_undegraded":"2023-08-17T17:34:23.560468+0000","last_fullsized":"2023-08-17T17:34:23.560468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541621+0000","last_change":"2023-08-17T17:34:23.192628+0000","last_active":"2023-08-17T17:34:23.541621+0000","last_peered":"2023-08-17T17:34:23.541621+0000","last_clean":"2023-08-17T17:34:23.541621+0000","last_became_active":"2023-08-17T17:34:23.192359+0000","last_became_peered":"2023-08-17T17:34:23.192359+0000","last_unstale":"2023-08-17T17:34:23.541621+0000","last_undegraded":"2023-08-17T17:34:23.541621+0000","last_fullsized":"2023-08-17T17:34:23.541621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554345+0000","last_change":"2023-08-17T17:34:23.549337+0000","last_active":"2023-08-17T17:34:23.554345+0000","last_peered":"2023-08-17T17:34:23.554345+0000","last_clean":"2023-08-17T17:34:23.554345+0000","last_became_active":"2023-08-17T17:34:23.547732+0000","last_became_peered":"2023-08-17T17:34:23.547732+0000","last_unstale":"2023-08-17T17:34:23.554345+0000","last_undegraded":"2023-08-17T17:34:23.554345+0000","last_fullsized":"2023-08-17T17:34:23.554345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195523+0000","last_change":"2023-08-17T17:34:23.189436+0000","last_active":"2023-08-17T17:34:23.195523+0000","last_peered":"2023-08-17T17:34:23.195523+0000","last_clean":"2023-08-17T17:34:23.195523+0000","last_became_active":"2023-08-17T17:34:23.189166+0000","last_became_peered":"2023-08-17T17:34:23.189166+0000","last_unstale":"2023-08-17T17:34:23.195523+0000","last_undegraded":"2023-08-17T17:34:23.195523+0000","last_fullsized":"2023-08-17T17:34:23.195523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551604+0000","last_change":"2023-08-17T17:34:23.551604+0000","last_active":"2023-08-17T17:34:23.551604+0000","last_peered":"2023-08-17T17:34:23.551604+0000","last_clean":"2023-08-17T17:34:23.551604+0000","last_became_active":"2023-08-17T17:34:23.551329+0000","last_became_peered":"2023-08-17T17:34:23.551329+0000","last_unstale":"2023-08-17T17:34:23.551604+0000","last_undegraded":"2023-08-17T17:34:23.551604+0000","last_fullsized":"2023-08-17T17:34:23.551604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198347+0000","last_change":"2023-08-17T17:34:23.190730+0000","last_active":"2023-08-17T17:34:23.198347+0000","last_peered":"2023-08-17T17:34:23.198347+0000","last_clean":"2023-08-17T17:34:23.198347+0000","last_became_active":"2023-08-17T17:34:23.190449+0000","last_became_peered":"2023-08-17T17:34:23.190449+0000","last_unstale":"2023-08-17T17:34:23.198347+0000","last_undegraded":"2023-08-17T17:34:23.198347+0000","last_fullsized":"2023-08-17T17:34:23.198347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558813+0000","last_change":"2023-08-17T17:34:23.558813+0000","last_active":"2023-08-17T17:34:23.558813+0000","last_peered":"2023-08-17T17:34:23.558813+0000","last_clean":"2023-08-17T17:34:23.558813+0000","last_became_active":"2023-08-17T17:34:23.558310+0000","last_became_peered":"2023-08-17T17:34:23.558310+0000","last_unstale":"2023-08-17T17:34:23.558813+0000","last_undegraded":"2023-08-17T17:34:23.558813+0000","last_fullsized":"2023-08-17T17:34:23.558813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555179+0000","last_change":"2023-08-17T17:34:23.185442+0000","last_active":"2023-08-17T17:34:23.555179+0000","last_peered":"2023-08-17T17:34:23.555179+0000","last_clean":"2023-08-17T17:34:23.555179+0000","last_became_active":"2023-08-17T17:34:23.185159+0000","last_became_peered":"2023-08-17T17:34:23.185159+0000","last_unstale":"2023-08-17T17:34:23.555179+0000","last_undegraded":"2023-08-17T17:34:23.555179+0000","last_fullsized":"2023-08-17T17:34:23.555179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550463+0000","last_change":"2023-08-17T17:34:23.547815+0000","last_active":"2023-08-17T17:34:23.550463+0000","last_peered":"2023-08-17T17:34:23.550463+0000","last_clean":"2023-08-17T17:34:23.550463+0000","last_became_active":"2023-08-17T17:34:23.547492+0000","last_became_peered":"2023-08-17T17:34:23.547492+0000","last_unstale":"2023-08-17T17:34:23.550463+0000","last_undegraded":"2023-08-17T17:34:23.550463+0000","last_fullsized":"2023-08-17T17:34:23.550463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541589+0000","last_change":"2023-08-17T17:34:23.192604+0000","last_active":"2023-08-17T17:34:23.541589+0000","last_peered":"2023-08-17T17:34:23.541589+0000","last_clean":"2023-08-17T17:34:23.541589+0000","last_became_active":"2023-08-17T17:34:23.192411+0000","last_became_peered":"2023-08-17T17:34:23.192411+0000","last_unstale":"2023-08-17T17:34:23.541589+0000","last_undegraded":"2023-08-17T17:34:23.541589+0000","last_fullsized":"2023-08-17T17:34:23.541589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.548701+0000","last_change":"2023-08-17T17:34:23.548701+0000","last_active":"2023-08-17T17:34:23.548701+0000","last_peered":"2023-08-17T17:34:23.548701+0000","last_clean":"2023-08-17T17:34:23.548701+0000","last_became_active":"2023-08-17T17:34:23.548165+0000","last_became_peered":"2023-08-17T17:34:23.548165+0000","last_unstale":"2023-08-17T17:34:23.548701+0000","last_undegraded":"2023-08-17T17:34:23.548701+0000","last_fullsized":"2023-08-17T17:34:23.548701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556955+0000","last_change":"2023-08-17T17:34:23.193961+0000","last_active":"2023-08-17T17:34:23.556955+0000","last_peered":"2023-08-17T17:34:23.556955+0000","last_clean":"2023-08-17T17:34:23.556955+0000","last_became_active":"2023-08-17T17:34:23.193712+0000","last_became_peered":"2023-08-17T17:34:23.193712+0000","last_unstale":"2023-08-17T17:34:23.556955+0000","last_undegraded":"2023-08-17T17:34:23.556955+0000","last_fullsized":"2023-08-17T17:34:23.556955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.559424+0000","last_change":"2023-08-17T17:34:23.559424+0000","last_active":"2023-08-17T17:34:23.559424+0000","last_peered":"2023-08-17T17:34:23.559424+0000","last_clean":"2023-08-17T17:34:23.559424+0000","last_became_active":"2023-08-17T17:34:23.559157+0000","last_became_peered":"2023-08-17T17:34:23.559157+0000","last_unstale":"2023-08-17T17:34:23.559424+0000","last_undegraded":"2023-08-17T17:34:23.559424+0000","last_fullsized":"2023-08-17T17:34:23.559424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199092+0000","last_change":"2023-08-17T17:34:23.198227+0000","last_active":"2023-08-17T17:34:23.199092+0000","last_peered":"2023-08-17T17:34:23.199092+0000","last_clean":"2023-08-17T17:34:23.199092+0000","last_became_active":"2023-08-17T17:34:23.197944+0000","last_became_peered":"2023-08-17T17:34:23.197944+0000","last_unstale":"2023-08-17T17:34:23.199092+0000","last_undegraded":"2023-08-17T17:34:23.199092+0000","last_fullsized":"2023-08-17T17:34:23.199092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547115+0000","last_change":"2023-08-17T17:34:23.547115+0000","last_active":"2023-08-17T17:34:23.547115+0000","last_peered":"2023-08-17T17:34:23.547115+0000","last_clean":"2023-08-17T17:34:23.547115+0000","last_became_active":"2023-08-17T17:34:23.546829+0000","last_became_peered":"2023-08-17T17:34:23.546829+0000","last_unstale":"2023-08-17T17:34:23.547115+0000","last_undegraded":"2023-08-17T17:34:23.547115+0000","last_fullsized":"2023-08-17T17:34:23.547115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537300+0000","last_change":"2023-08-17T17:34:23.187589+0000","last_active":"2023-08-17T17:34:23.537300+0000","last_peered":"2023-08-17T17:34:23.537300+0000","last_clean":"2023-08-17T17:34:23.537300+0000","last_became_active":"2023-08-17T17:34:23.187290+0000","last_became_peered":"2023-08-17T17:34:23.187290+0000","last_unstale":"2023-08-17T17:34:23.537300+0000","last_undegraded":"2023-08-17T17:34:23.537300+0000","last_fullsized":"2023-08-17T17:34:23.537300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554129+0000","last_change":"2023-08-17T17:34:23.554129+0000","last_active":"2023-08-17T17:34:23.554129+0000","last_peered":"2023-08-17T17:34:23.554129+0000","last_clean":"2023-08-17T17:34:23.554129+0000","last_became_active":"2023-08-17T17:34:23.553850+0000","last_became_peered":"2023-08-17T17:34:23.553850+0000","last_unstale":"2023-08-17T17:34:23.554129+0000","last_undegraded":"2023-08-17T17:34:23.554129+0000","last_fullsized":"2023-08-17T17:34:23.554129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553604+0000","last_change":"2023-08-17T17:34:23.186710+0000","last_active":"2023-08-17T17:34:23.553604+0000","last_peered":"2023-08-17T17:34:23.553604+0000","last_clean":"2023-08-17T17:34:23.553604+0000","last_became_active":"2023-08-17T17:34:23.186445+0000","last_became_peered":"2023-08-17T17:34:23.186445+0000","last_unstale":"2023-08-17T17:34:23.553604+0000","last_undegraded":"2023-08-17T17:34:23.553604+0000","last_fullsized":"2023-08-17T17:34:23.553604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550750+0000","last_change":"2023-08-17T17:34:23.550750+0000","last_active":"2023-08-17T17:34:23.550750+0000","last_peered":"2023-08-17T17:34:23.550750+0000","last_clean":"2023-08-17T17:34:23.550750+0000","last_became_active":"2023-08-17T17:34:23.550414+0000","last_became_peered":"2023-08-17T17:34:23.550414+0000","last_unstale":"2023-08-17T17:34:23.550750+0000","last_undegraded":"2023-08-17T17:34:23.550750+0000","last_fullsized":"2023-08-17T17:34:23.550750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.197495+0000","last_change":"2023-08-17T17:34:23.191770+0000","last_active":"2023-08-17T17:34:23.197495+0000","last_peered":"2023-08-17T17:34:23.197495+0000","last_clean":"2023-08-17T17:34:23.197495+0000","last_became_active":"2023-08-17T17:34:23.191496+0000","last_became_peered":"2023-08-17T17:34:23.191496+0000","last_unstale":"2023-08-17T17:34:23.197495+0000","last_undegraded":"2023-08-17T17:34:23.197495+0000","last_fullsized":"2023-08-17T17:34:23.197495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555082+0000","last_change":"2023-08-17T17:34:23.555082+0000","last_active":"2023-08-17T17:34:23.555082+0000","last_peered":"2023-08-17T17:34:23.555082+0000","last_clean":"2023-08-17T17:34:23.555082+0000","last_became_active":"2023-08-17T17:34:23.554787+0000","last_became_peered":"2023-08-17T17:34:23.554787+0000","last_unstale":"2023-08-17T17:34:23.555082+0000","last_undegraded":"2023-08-17T17:34:23.555082+0000","last_fullsized":"2023-08-17T17:34:23.555082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.190949+0000","last_change":"2023-08-17T17:34:23.186144+0000","last_active":"2023-08-17T17:34:23.190949+0000","last_peered":"2023-08-17T17:34:23.190949+0000","last_clean":"2023-08-17T17:34:23.190949+0000","last_became_active":"2023-08-17T17:34:23.185783+0000","last_became_peered":"2023-08-17T17:34:23.185783+0000","last_unstale":"2023-08-17T17:34:23.190949+0000","last_undegraded":"2023-08-17T17:34:23.190949+0000","last_fullsized":"2023-08-17T17:34:23.190949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556916+0000","last_change":"2023-08-17T17:34:23.556916+0000","last_active":"2023-08-17T17:34:23.556916+0000","last_peered":"2023-08-17T17:34:23.556916+0000","last_clean":"2023-08-17T17:34:23.556916+0000","last_became_active":"2023-08-17T17:34:23.556648+0000","last_became_peered":"2023-08-17T17:34:23.556648+0000","last_unstale":"2023-08-17T17:34:23.556916+0000","last_undegraded":"2023-08-17T17:34:23.556916+0000","last_fullsized":"2023-08-17T17:34:23.556916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195547+0000","last_change":"2023-08-17T17:34:23.186198+0000","last_active":"2023-08-17T17:34:23.195547+0000","last_peered":"2023-08-17T17:34:23.195547+0000","last_clean":"2023-08-17T17:34:23.195547+0000","last_became_active":"2023-08-17T17:34:23.185926+0000","last_became_peered":"2023-08-17T17:34:23.185926+0000","last_unstale":"2023-08-17T17:34:23.195547+0000","last_undegraded":"2023-08-17T17:34:23.195547+0000","last_fullsized":"2023-08-17T17:34:23.195547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.182041+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:34:23.182041+0000","last_peered":"2023-08-17T17:34:23.182041+0000","last_clean":"2023-08-17T17:34:23.182041+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:34:23.182041+0000","last_undegraded":"2023-08-17T17:34:23.182041+0000","last_fullsized":"2023-08-17T17:34:23.182041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537500+0000","last_change":"2023-08-17T17:34:23.184771+0000","last_active":"2023-08-17T17:34:23.537500+0000","last_peered":"2023-08-17T17:34:23.537500+0000","last_clean":"2023-08-17T17:34:23.537500+0000","last_became_active":"2023-08-17T17:34:23.184315+0000","last_became_peered":"2023-08-17T17:34:23.184315+0000","last_unstale":"2023-08-17T17:34:23.537500+0000","last_undegraded":"2023-08-17T17:34:23.537500+0000","last_fullsized":"2023-08-17T17:34:23.537500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.542863+0000","last_change":"2023-08-17T17:34:23.542863+0000","last_active":"2023-08-17T17:34:23.542863+0000","last_peered":"2023-08-17T17:34:23.542863+0000","last_clean":"2023-08-17T17:34:23.542863+0000","last_became_active":"2023-08-17T17:34:23.542602+0000","last_became_peered":"2023-08-17T17:34:23.542602+0000","last_unstale":"2023-08-17T17:34:23.542863+0000","last_undegraded":"2023-08-17T17:34:23.542863+0000","last_fullsized":"2023-08-17T17:34:23.542863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536939+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:34:23.536939+0000","last_peered":"2023-08-17T17:34:23.536939+0000","last_clean":"2023-08-17T17:34:23.536939+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:34:23.536939+0000","last_undegraded":"2023-08-17T17:34:23.536939+0000","last_fullsized":"2023-08-17T17:34:23.536939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193340+0000","last_change":"2023-08-17T17:34:23.187110+0000","last_active":"2023-08-17T17:34:23.193340+0000","last_peered":"2023-08-17T17:34:23.193340+0000","last_clean":"2023-08-17T17:34:23.193340+0000","last_became_active":"2023-08-17T17:34:23.186796+0000","last_became_peered":"2023-08-17T17:34:23.186796+0000","last_unstale":"2023-08-17T17:34:23.193340+0000","last_undegraded":"2023-08-17T17:34:23.193340+0000","last_fullsized":"2023-08-17T17:34:23.193340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.542382+0000","last_change":"2023-08-17T17:34:23.542382+0000","last_active":"2023-08-17T17:34:23.542382+0000","last_peered":"2023-08-17T17:34:23.542382+0000","last_clean":"2023-08-17T17:34:23.542382+0000","last_became_active":"2023-08-17T17:34:23.542108+0000","last_became_peered":"2023-08-17T17:34:23.542108+0000","last_unstale":"2023-08-17T17:34:23.542382+0000","last_undegraded":"2023-08-17T17:34:23.542382+0000","last_fullsized":"2023-08-17T17:34:23.542382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543037+0000","last_change":"2023-08-17T17:34:23.543037+0000","last_active":"2023-08-17T17:34:23.543037+0000","last_peered":"2023-08-17T17:34:23.543037+0000","last_clean":"2023-08-17T17:34:23.543037+0000","last_became_active":"2023-08-17T17:34:23.542776+0000","last_became_peered":"2023-08-17T17:34:23.542776+0000","last_unstale":"2023-08-17T17:34:23.543037+0000","last_undegraded":"2023-08-17T17:34:23.543037+0000","last_fullsized":"2023-08-17T17:34:23.543037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535248+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:34:23.535248+0000","last_peered":"2023-08-17T17:34:23.535248+0000","last_clean":"2023-08-17T17:34:23.535248+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:34:23.535248+0000","last_undegraded":"2023-08-17T17:34:23.535248+0000","last_fullsized":"2023-08-17T17:34:23.535248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193425+0000","last_change":"2023-08-17T17:34:23.189586+0000","last_active":"2023-08-17T17:34:23.193425+0000","last_peered":"2023-08-17T17:34:23.193425+0000","last_clean":"2023-08-17T17:34:23.193425+0000","last_became_active":"2023-08-17T17:34:23.189430+0000","last_became_peered":"2023-08-17T17:34:23.189430+0000","last_unstale":"2023-08-17T17:34:23.193425+0000","last_undegraded":"2023-08-17T17:34:23.193425+0000","last_fullsized":"2023-08-17T17:34:23.193425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553467+0000","last_change":"2023-08-17T17:34:23.553467+0000","last_active":"2023-08-17T17:34:23.553467+0000","last_peered":"2023-08-17T17:34:23.553467+0000","last_clean":"2023-08-17T17:34:23.553467+0000","last_became_active":"2023-08-17T17:34:23.553182+0000","last_became_peered":"2023-08-17T17:34:23.553182+0000","last_unstale":"2023-08-17T17:34:23.553467+0000","last_undegraded":"2023-08-17T17:34:23.553467+0000","last_fullsized":"2023-08-17T17:34:23.553467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537185+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:34:23.537185+0000","last_peered":"2023-08-17T17:34:23.537185+0000","last_clean":"2023-08-17T17:34:23.537185+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:34:23.537185+0000","last_undegraded":"2023-08-17T17:34:23.537185+0000","last_fullsized":"2023-08-17T17:34:23.537185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.178328+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:34:23.178328+0000","last_peered":"2023-08-17T17:34:23.178328+0000","last_clean":"2023-08-17T17:34:23.178328+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:34:23.178328+0000","last_undegraded":"2023-08-17T17:34:23.178328+0000","last_fullsized":"2023-08-17T17:34:23.178328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.185276+0000","last_change":"2023-08-17T17:34:23.182606+0000","last_active":"2023-08-17T17:34:23.185276+0000","last_peered":"2023-08-17T17:34:23.185276+0000","last_clean":"2023-08-17T17:34:23.185276+0000","last_became_active":"2023-08-17T17:34:23.182335+0000","last_became_peered":"2023-08-17T17:34:23.182335+0000","last_unstale":"2023-08-17T17:34:23.185276+0000","last_undegraded":"2023-08-17T17:34:23.185276+0000","last_fullsized":"2023-08-17T17:34:23.185276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547812+0000","last_change":"2023-08-17T17:34:23.547812+0000","last_active":"2023-08-17T17:34:23.547812+0000","last_peered":"2023-08-17T17:34:23.547812+0000","last_clean":"2023-08-17T17:34:23.547812+0000","last_became_active":"2023-08-17T17:34:23.547532+0000","last_became_peered":"2023-08-17T17:34:23.547532+0000","last_unstale":"2023-08-17T17:34:23.547812+0000","last_undegraded":"2023-08-17T17:34:23.547812+0000","last_fullsized":"2023-08-17T17:34:23.547812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.178366+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:34:23.178366+0000","last_peered":"2023-08-17T17:34:23.178366+0000","last_clean":"2023-08-17T17:34:23.178366+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:34:23.178366+0000","last_undegraded":"2023-08-17T17:34:23.178366+0000","last_fullsized":"2023-08-17T17:34:23.178366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195410+0000","last_change":"2023-08-17T17:34:23.187849+0000","last_active":"2023-08-17T17:34:23.195410+0000","last_peered":"2023-08-17T17:34:23.195410+0000","last_clean":"2023-08-17T17:34:23.195410+0000","last_became_active":"2023-08-17T17:34:23.187578+0000","last_became_peered":"2023-08-17T17:34:23.187578+0000","last_unstale":"2023-08-17T17:34:23.195410+0000","last_undegraded":"2023-08-17T17:34:23.195410+0000","last_fullsized":"2023-08-17T17:34:23.195410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.179921+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:34:23.179921+0000","last_peered":"2023-08-17T17:34:23.179921+0000","last_clean":"2023-08-17T17:34:23.179921+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:34:23.179921+0000","last_undegraded":"2023-08-17T17:34:23.179921+0000","last_fullsized":"2023-08-17T17:34:23.179921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199149+0000","last_change":"2023-08-17T17:34:23.191992+0000","last_active":"2023-08-17T17:34:23.199149+0000","last_peered":"2023-08-17T17:34:23.199149+0000","last_clean":"2023-08-17T17:34:23.199149+0000","last_became_active":"2023-08-17T17:34:23.191711+0000","last_became_peered":"2023-08-17T17:34:23.191711+0000","last_unstale":"2023-08-17T17:34:23.199149+0000","last_undegraded":"2023-08-17T17:34:23.199149+0000","last_fullsized":"2023-08-17T17:34:23.199149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541695+0000","last_change":"2023-08-17T17:34:23.541695+0000","last_active":"2023-08-17T17:34:23.541695+0000","last_peered":"2023-08-17T17:34:23.541695+0000","last_clean":"2023-08-17T17:34:23.541695+0000","last_became_active":"2023-08-17T17:34:23.541430+0000","last_became_peered":"2023-08-17T17:34:23.541430+0000","last_unstale":"2023-08-17T17:34:23.541695+0000","last_undegraded":"2023-08-17T17:34:23.541695+0000","last_fullsized":"2023-08-17T17:34:23.541695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561244+0000","last_change":"2023-08-17T17:34:23.188530+0000","last_active":"2023-08-17T17:34:23.561244+0000","last_peered":"2023-08-17T17:34:23.561244+0000","last_clean":"2023-08-17T17:34:23.561244+0000","last_became_active":"2023-08-17T17:34:23.188237+0000","last_became_peered":"2023-08-17T17:34:23.188237+0000","last_unstale":"2023-08-17T17:34:23.561244+0000","last_undegraded":"2023-08-17T17:34:23.561244+0000","last_fullsized":"2023-08-17T17:34:23.561244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.179737+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:34:23.179737+0000","last_peered":"2023-08-17T17:34:23.179737+0000","last_clean":"2023-08-17T17:34:23.179737+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:34:23.179737+0000","last_undegraded":"2023-08-17T17:34:23.179737+0000","last_fullsized":"2023-08-17T17:34:23.179737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557366+0000","last_change":"2023-08-17T17:34:23.557366+0000","last_active":"2023-08-17T17:34:23.557366+0000","last_peered":"2023-08-17T17:34:23.557366+0000","last_clean":"2023-08-17T17:34:23.557366+0000","last_became_active":"2023-08-17T17:34:23.555195+0000","last_became_peered":"2023-08-17T17:34:23.555195+0000","last_unstale":"2023-08-17T17:34:23.557366+0000","last_undegraded":"2023-08-17T17:34:23.557366+0000","last_fullsized":"2023-08-17T17:34:23.557366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.182581+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:34:23.182581+0000","last_peered":"2023-08-17T17:34:23.182581+0000","last_clean":"2023-08-17T17:34:23.182581+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:34:23.182581+0000","last_undegraded":"2023-08-17T17:34:23.182581+0000","last_fullsized":"2023-08-17T17:34:23.182581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.196081+0000","last_change":"2023-08-17T17:34:23.191591+0000","last_active":"2023-08-17T17:34:23.196081+0000","last_peered":"2023-08-17T17:34:23.196081+0000","last_clean":"2023-08-17T17:34:23.196081+0000","last_became_active":"2023-08-17T17:34:23.190831+0000","last_became_peered":"2023-08-17T17:34:23.190831+0000","last_unstale":"2023-08-17T17:34:23.196081+0000","last_undegraded":"2023-08-17T17:34:23.196081+0000","last_fullsized":"2023-08-17T17:34:23.196081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.542994+0000","last_change":"2023-08-17T17:34:23.542994+0000","last_active":"2023-08-17T17:34:23.542994+0000","last_peered":"2023-08-17T17:34:23.542994+0000","last_clean":"2023-08-17T17:34:23.542994+0000","last_became_active":"2023-08-17T17:34:23.542731+0000","last_became_peered":"2023-08-17T17:34:23.542731+0000","last_unstale":"2023-08-17T17:34:23.542994+0000","last_undegraded":"2023-08-17T17:34:23.542994+0000","last_fullsized":"2023-08-17T17:34:23.542994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550786+0000","last_change":"2023-08-17T17:34:23.547644+0000","last_active":"2023-08-17T17:34:23.550786+0000","last_peered":"2023-08-17T17:34:23.550786+0000","last_clean":"2023-08-17T17:34:23.550786+0000","last_became_active":"2023-08-17T17:34:23.547383+0000","last_became_peered":"2023-08-17T17:34:23.547383+0000","last_unstale":"2023-08-17T17:34:23.550786+0000","last_undegraded":"2023-08-17T17:34:23.550786+0000","last_fullsized":"2023-08-17T17:34:23.550786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195756+0000","last_change":"2023-08-17T17:34:23.190255+0000","last_active":"2023-08-17T17:34:23.195756+0000","last_peered":"2023-08-17T17:34:23.195756+0000","last_clean":"2023-08-17T17:34:23.195756+0000","last_became_active":"2023-08-17T17:34:23.189984+0000","last_became_peered":"2023-08-17T17:34:23.189984+0000","last_unstale":"2023-08-17T17:34:23.195756+0000","last_undegraded":"2023-08-17T17:34:23.195756+0000","last_fullsized":"2023-08-17T17:34:23.195756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552719+0000","last_change":"2023-08-17T17:34:23.552719+0000","last_active":"2023-08-17T17:34:23.552719+0000","last_peered":"2023-08-17T17:34:23.552719+0000","last_clean":"2023-08-17T17:34:23.552719+0000","last_became_active":"2023-08-17T17:34:23.552438+0000","last_became_peered":"2023-08-17T17:34:23.552438+0000","last_unstale":"2023-08-17T17:34:23.552719+0000","last_undegraded":"2023-08-17T17:34:23.552719+0000","last_fullsized":"2023-08-17T17:34:23.552719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537344+0000","last_change":"2023-08-17T17:34:23.190817+0000","last_active":"2023-08-17T17:34:23.537344+0000","last_peered":"2023-08-17T17:34:23.537344+0000","last_clean":"2023-08-17T17:34:23.537344+0000","last_became_active":"2023-08-17T17:34:23.190559+0000","last_became_peered":"2023-08-17T17:34:23.190559+0000","last_unstale":"2023-08-17T17:34:23.537344+0000","last_undegraded":"2023-08-17T17:34:23.537344+0000","last_fullsized":"2023-08-17T17:34:23.537344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553414+0000","last_change":"2023-08-17T17:34:23.553414+0000","last_active":"2023-08-17T17:34:23.553414+0000","last_peered":"2023-08-17T17:34:23.553414+0000","last_clean":"2023-08-17T17:34:23.553414+0000","last_became_active":"2023-08-17T17:34:23.552895+0000","last_became_peered":"2023-08-17T17:34:23.552895+0000","last_unstale":"2023-08-17T17:34:23.553414+0000","last_undegraded":"2023-08-17T17:34:23.553414+0000","last_fullsized":"2023-08-17T17:34:23.553414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553204+0000","last_change":"2023-08-17T17:34:23.190779+0000","last_active":"2023-08-17T17:34:23.553204+0000","last_peered":"2023-08-17T17:34:23.553204+0000","last_clean":"2023-08-17T17:34:23.553204+0000","last_became_active":"2023-08-17T17:34:23.190512+0000","last_became_peered":"2023-08-17T17:34:23.190512+0000","last_unstale":"2023-08-17T17:34:23.553204+0000","last_undegraded":"2023-08-17T17:34:23.553204+0000","last_fullsized":"2023-08-17T17:34:23.553204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.549278+0000","last_change":"2023-08-17T17:34:23.549278+0000","last_active":"2023-08-17T17:34:23.549278+0000","last_peered":"2023-08-17T17:34:23.549278+0000","last_clean":"2023-08-17T17:34:23.549278+0000","last_became_active":"2023-08-17T17:34:23.548986+0000","last_became_peered":"2023-08-17T17:34:23.548986+0000","last_unstale":"2023-08-17T17:34:23.549278+0000","last_undegraded":"2023-08-17T17:34:23.549278+0000","last_fullsized":"2023-08-17T17:34:23.549278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551680+0000","last_change":"2023-08-17T17:34:23.186530+0000","last_active":"2023-08-17T17:34:23.551680+0000","last_peered":"2023-08-17T17:34:23.551680+0000","last_clean":"2023-08-17T17:34:23.551680+0000","last_became_active":"2023-08-17T17:34:23.186269+0000","last_became_peered":"2023-08-17T17:34:23.186269+0000","last_unstale":"2023-08-17T17:34:23.551680+0000","last_undegraded":"2023-08-17T17:34:23.551680+0000","last_fullsized":"2023-08-17T17:34:23.551680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.549760+0000","last_change":"2023-08-17T17:34:23.549760+0000","last_active":"2023-08-17T17:34:23.549760+0000","last_peered":"2023-08-17T17:34:23.549760+0000","last_clean":"2023-08-17T17:34:23.549760+0000","last_became_active":"2023-08-17T17:34:23.549485+0000","last_became_peered":"2023-08-17T17:34:23.549485+0000","last_unstale":"2023-08-17T17:34:23.549760+0000","last_undegraded":"2023-08-17T17:34:23.549760+0000","last_fullsized":"2023-08-17T17:34:23.549760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538201+0000","last_change":"2023-08-17T17:34:23.185767+0000","last_active":"2023-08-17T17:34:23.538201+0000","last_peered":"2023-08-17T17:34:23.538201+0000","last_clean":"2023-08-17T17:34:23.538201+0000","last_became_active":"2023-08-17T17:34:23.185523+0000","last_became_peered":"2023-08-17T17:34:23.185523+0000","last_unstale":"2023-08-17T17:34:23.538201+0000","last_undegraded":"2023-08-17T17:34:23.538201+0000","last_fullsized":"2023-08-17T17:34:23.538201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550201+0000","last_change":"2023-08-17T17:34:23.550201+0000","last_active":"2023-08-17T17:34:23.550201+0000","last_peered":"2023-08-17T17:34:23.550201+0000","last_clean":"2023-08-17T17:34:23.550201+0000","last_became_active":"2023-08-17T17:34:23.550017+0000","last_became_peered":"2023-08-17T17:34:23.550017+0000","last_unstale":"2023-08-17T17:34:23.550201+0000","last_undegraded":"2023-08-17T17:34:23.550201+0000","last_fullsized":"2023-08-17T17:34:23.550201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.190798+0000","last_change":"2023-08-17T17:34:23.184375+0000","last_active":"2023-08-17T17:34:23.190798+0000","last_peered":"2023-08-17T17:34:23.190798+0000","last_clean":"2023-08-17T17:34:23.190798+0000","last_became_active":"2023-08-17T17:34:23.184095+0000","last_became_peered":"2023-08-17T17:34:23.184095+0000","last_unstale":"2023-08-17T17:34:23.190798+0000","last_undegraded":"2023-08-17T17:34:23.190798+0000","last_fullsized":"2023-08-17T17:34:23.190798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.544840+0000","last_change":"2023-08-17T17:34:23.544840+0000","last_active":"2023-08-17T17:34:23.544840+0000","last_peered":"2023-08-17T17:34:23.544840+0000","last_clean":"2023-08-17T17:34:23.544840+0000","last_became_active":"2023-08-17T17:34:23.544381+0000","last_became_peered":"2023-08-17T17:34:23.544381+0000","last_unstale":"2023-08-17T17:34:23.544840+0000","last_undegraded":"2023-08-17T17:34:23.544840+0000","last_fullsized":"2023-08-17T17:34:23.544840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535353+0000","last_change":"2023-08-17T17:34:23.181210+0000","last_active":"2023-08-17T17:34:23.535353+0000","last_peered":"2023-08-17T17:34:23.535353+0000","last_clean":"2023-08-17T17:34:23.535353+0000","last_became_active":"2023-08-17T17:34:23.180969+0000","last_became_peered":"2023-08-17T17:34:23.180969+0000","last_unstale":"2023-08-17T17:34:23.535353+0000","last_undegraded":"2023-08-17T17:34:23.535353+0000","last_fullsized":"2023-08-17T17:34:23.535353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550540+0000","last_change":"2023-08-17T17:34:23.548247+0000","last_active":"2023-08-17T17:34:23.550540+0000","last_peered":"2023-08-17T17:34:23.550540+0000","last_clean":"2023-08-17T17:34:23.550540+0000","last_became_active":"2023-08-17T17:34:23.547379+0000","last_became_peered":"2023-08-17T17:34:23.547379+0000","last_unstale":"2023-08-17T17:34:23.550540+0000","last_undegraded":"2023-08-17T17:34:23.550540+0000","last_fullsized":"2023-08-17T17:34:23.550540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536842+0000","last_change":"2023-08-17T17:34:23.185419+0000","last_active":"2023-08-17T17:34:23.536842+0000","last_peered":"2023-08-17T17:34:23.536842+0000","last_clean":"2023-08-17T17:34:23.536842+0000","last_became_active":"2023-08-17T17:34:23.184865+0000","last_became_peered":"2023-08-17T17:34:23.184865+0000","last_unstale":"2023-08-17T17:34:23.536842+0000","last_undegraded":"2023-08-17T17:34:23.536842+0000","last_fullsized":"2023-08-17T17:34:23.536842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.544643+0000","last_change":"2023-08-17T17:34:23.544643+0000","last_active":"2023-08-17T17:34:23.544643+0000","last_peered":"2023-08-17T17:34:23.544643+0000","last_clean":"2023-08-17T17:34:23.544643+0000","last_became_active":"2023-08-17T17:34:23.544406+0000","last_became_peered":"2023-08-17T17:34:23.544406+0000","last_unstale":"2023-08-17T17:34:23.544643+0000","last_undegraded":"2023-08-17T17:34:23.544643+0000","last_fullsized":"2023-08-17T17:34:23.544643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193494+0000","last_change":"2023-08-17T17:34:23.186776+0000","last_active":"2023-08-17T17:34:23.193494+0000","last_peered":"2023-08-17T17:34:23.193494+0000","last_clean":"2023-08-17T17:34:23.193494+0000","last_became_active":"2023-08-17T17:34:23.186521+0000","last_became_peered":"2023-08-17T17:34:23.186521+0000","last_unstale":"2023-08-17T17:34:23.193494+0000","last_undegraded":"2023-08-17T17:34:23.193494+0000","last_fullsized":"2023-08-17T17:34:23.193494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.560630+0000","last_change":"2023-08-17T17:34:23.560630+0000","last_active":"2023-08-17T17:34:23.560630+0000","last_peered":"2023-08-17T17:34:23.560630+0000","last_clean":"2023-08-17T17:34:23.560630+0000","last_became_active":"2023-08-17T17:34:23.560282+0000","last_became_peered":"2023-08-17T17:34:23.560282+0000","last_unstale":"2023-08-17T17:34:23.560630+0000","last_undegraded":"2023-08-17T17:34:23.560630+0000","last_fullsized":"2023-08-17T17:34:23.560630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199023+0000","last_change":"2023-08-17T17:34:23.191397+0000","last_active":"2023-08-17T17:34:23.199023+0000","last_peered":"2023-08-17T17:34:23.199023+0000","last_clean":"2023-08-17T17:34:23.199023+0000","last_became_active":"2023-08-17T17:34:23.191058+0000","last_became_peered":"2023-08-17T17:34:23.191058+0000","last_unstale":"2023-08-17T17:34:23.199023+0000","last_undegraded":"2023-08-17T17:34:23.199023+0000","last_fullsized":"2023-08-17T17:34:23.199023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553590+0000","last_change":"2023-08-17T17:34:23.553590+0000","last_active":"2023-08-17T17:34:23.553590+0000","last_peered":"2023-08-17T17:34:23.553590+0000","last_clean":"2023-08-17T17:34:23.553590+0000","last_became_active":"2023-08-17T17:34:23.552092+0000","last_became_peered":"2023-08-17T17:34:23.552092+0000","last_unstale":"2023-08-17T17:34:23.553590+0000","last_undegraded":"2023-08-17T17:34:23.553590+0000","last_fullsized":"2023-08-17T17:34:23.553590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199058+0000","last_change":"2023-08-17T17:34:23.191260+0000","last_active":"2023-08-17T17:34:23.199058+0000","last_peered":"2023-08-17T17:34:23.199058+0000","last_clean":"2023-08-17T17:34:23.199058+0000","last_became_active":"2023-08-17T17:34:23.190994+0000","last_became_peered":"2023-08-17T17:34:23.190994+0000","last_unstale":"2023-08-17T17:34:23.199058+0000","last_undegraded":"2023-08-17T17:34:23.199058+0000","last_fullsized":"2023-08-17T17:34:23.199058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556967+0000","last_change":"2023-08-17T17:34:23.556967+0000","last_active":"2023-08-17T17:34:23.556967+0000","last_peered":"2023-08-17T17:34:23.556967+0000","last_clean":"2023-08-17T17:34:23.556967+0000","last_became_active":"2023-08-17T17:34:23.556712+0000","last_became_peered":"2023-08-17T17:34:23.556712+0000","last_unstale":"2023-08-17T17:34:23.556967+0000","last_undegraded":"2023-08-17T17:34:23.556967+0000","last_fullsized":"2023-08-17T17:34:23.556967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193265+0000","last_change":"2023-08-17T17:34:23.189238+0000","last_active":"2023-08-17T17:34:23.193265+0000","last_peered":"2023-08-17T17:34:23.193265+0000","last_clean":"2023-08-17T17:34:23.193265+0000","last_became_active":"2023-08-17T17:34:23.188964+0000","last_became_peered":"2023-08-17T17:34:23.188964+0000","last_unstale":"2023-08-17T17:34:23.193265+0000","last_undegraded":"2023-08-17T17:34:23.193265+0000","last_fullsized":"2023-08-17T17:34:23.193265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.549243+0000","last_change":"2023-08-17T17:34:23.549243+0000","last_active":"2023-08-17T17:34:23.549243+0000","last_peered":"2023-08-17T17:34:23.549243+0000","last_clean":"2023-08-17T17:34:23.549243+0000","last_became_active":"2023-08-17T17:34:23.548966+0000","last_became_peered":"2023-08-17T17:34:23.548966+0000","last_unstale":"2023-08-17T17:34:23.549243+0000","last_undegraded":"2023-08-17T17:34:23.549243+0000","last_fullsized":"2023-08-17T17:34:23.549243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195835+0000","last_change":"2023-08-17T17:34:23.189039+0000","last_active":"2023-08-17T17:34:23.195835+0000","last_peered":"2023-08-17T17:34:23.195835+0000","last_clean":"2023-08-17T17:34:23.195835+0000","last_became_active":"2023-08-17T17:34:23.188785+0000","last_became_peered":"2023-08-17T17:34:23.188785+0000","last_unstale":"2023-08-17T17:34:23.195835+0000","last_undegraded":"2023-08-17T17:34:23.195835+0000","last_fullsized":"2023-08-17T17:34:23.195835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555845+0000","last_change":"2023-08-17T17:34:23.555845+0000","last_active":"2023-08-17T17:34:23.555845+0000","last_peered":"2023-08-17T17:34:23.555845+0000","last_clean":"2023-08-17T17:34:23.555845+0000","last_became_active":"2023-08-17T17:34:23.555604+0000","last_became_peered":"2023-08-17T17:34:23.555604+0000","last_unstale":"2023-08-17T17:34:23.555845+0000","last_undegraded":"2023-08-17T17:34:23.555845+0000","last_fullsized":"2023-08-17T17:34:23.555845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538052+0000","last_change":"2023-08-17T17:34:23.187717+0000","last_active":"2023-08-17T17:34:23.538052+0000","last_peered":"2023-08-17T17:34:23.538052+0000","last_clean":"2023-08-17T17:34:23.538052+0000","last_became_active":"2023-08-17T17:34:23.184648+0000","last_became_peered":"2023-08-17T17:34:23.184648+0000","last_unstale":"2023-08-17T17:34:23.538052+0000","last_undegraded":"2023-08-17T17:34:23.538052+0000","last_fullsized":"2023-08-17T17:34:23.538052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552413+0000","last_change":"2023-08-17T17:34:23.552413+0000","last_active":"2023-08-17T17:34:23.552413+0000","last_peered":"2023-08-17T17:34:23.552413+0000","last_clean":"2023-08-17T17:34:23.552413+0000","last_became_active":"2023-08-17T17:34:23.552087+0000","last_became_peered":"2023-08-17T17:34:23.552087+0000","last_unstale":"2023-08-17T17:34:23.552413+0000","last_undegraded":"2023-08-17T17:34:23.552413+0000","last_fullsized":"2023-08-17T17:34:23.552413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195839+0000","last_change":"2023-08-17T17:34:23.189135+0000","last_active":"2023-08-17T17:34:23.195839+0000","last_peered":"2023-08-17T17:34:23.195839+0000","last_clean":"2023-08-17T17:34:23.195839+0000","last_became_active":"2023-08-17T17:34:23.188880+0000","last_became_peered":"2023-08-17T17:34:23.188880+0000","last_unstale":"2023-08-17T17:34:23.195839+0000","last_undegraded":"2023-08-17T17:34:23.195839+0000","last_fullsized":"2023-08-17T17:34:23.195839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551405+0000","last_change":"2023-08-17T17:34:23.549370+0000","last_active":"2023-08-17T17:34:23.551405+0000","last_peered":"2023-08-17T17:34:23.551405+0000","last_clean":"2023-08-17T17:34:23.551405+0000","last_became_active":"2023-08-17T17:34:23.549106+0000","last_became_peered":"2023-08-17T17:34:23.549106+0000","last_unstale":"2023-08-17T17:34:23.551405+0000","last_undegraded":"2023-08-17T17:34:23.551405+0000","last_fullsized":"2023-08-17T17:34:23.551405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537049+0000","last_change":"2023-08-17T17:34:23.188935+0000","last_active":"2023-08-17T17:34:23.537049+0000","last_peered":"2023-08-17T17:34:23.537049+0000","last_clean":"2023-08-17T17:34:23.537049+0000","last_became_active":"2023-08-17T17:34:23.188377+0000","last_became_peered":"2023-08-17T17:34:23.188377+0000","last_unstale":"2023-08-17T17:34:23.537049+0000","last_undegraded":"2023-08-17T17:34:23.537049+0000","last_fullsized":"2023-08-17T17:34:23.537049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555082+0000","last_change":"2023-08-17T17:34:23.555082+0000","last_active":"2023-08-17T17:34:23.555082+0000","last_peered":"2023-08-17T17:34:23.555082+0000","last_clean":"2023-08-17T17:34:23.555082+0000","last_became_active":"2023-08-17T17:34:23.554814+0000","last_became_peered":"2023-08-17T17:34:23.554814+0000","last_unstale":"2023-08-17T17:34:23.555082+0000","last_undegraded":"2023-08-17T17:34:23.555082+0000","last_fullsized":"2023-08-17T17:34:23.555082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536557+0000","last_change":"2023-08-17T17:34:23.190120+0000","last_active":"2023-08-17T17:34:23.536557+0000","last_peered":"2023-08-17T17:34:23.536557+0000","last_clean":"2023-08-17T17:34:23.536557+0000","last_became_active":"2023-08-17T17:34:23.189569+0000","last_became_peered":"2023-08-17T17:34:23.189569+0000","last_unstale":"2023-08-17T17:34:23.536557+0000","last_undegraded":"2023-08-17T17:34:23.536557+0000","last_fullsized":"2023-08-17T17:34:23.536557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561106+0000","last_change":"2023-08-17T17:34:23.561106+0000","last_active":"2023-08-17T17:34:23.561106+0000","last_peered":"2023-08-17T17:34:23.561106+0000","last_clean":"2023-08-17T17:34:23.561106+0000","last_became_active":"2023-08-17T17:34:23.560898+0000","last_became_peered":"2023-08-17T17:34:23.560898+0000","last_unstale":"2023-08-17T17:34:23.561106+0000","last_undegraded":"2023-08-17T17:34:23.561106+0000","last_fullsized":"2023-08-17T17:34:23.561106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198889+0000","last_change":"2023-08-17T17:34:23.198065+0000","last_active":"2023-08-17T17:34:23.198889+0000","last_peered":"2023-08-17T17:34:23.198889+0000","last_clean":"2023-08-17T17:34:23.198889+0000","last_became_active":"2023-08-17T17:34:23.197731+0000","last_became_peered":"2023-08-17T17:34:23.197731+0000","last_unstale":"2023-08-17T17:34:23.198889+0000","last_undegraded":"2023-08-17T17:34:23.198889+0000","last_fullsized":"2023-08-17T17:34:23.198889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547875+0000","last_change":"2023-08-17T17:34:23.547875+0000","last_active":"2023-08-17T17:34:23.547875+0000","last_peered":"2023-08-17T17:34:23.547875+0000","last_clean":"2023-08-17T17:34:23.547875+0000","last_became_active":"2023-08-17T17:34:23.547593+0000","last_became_peered":"2023-08-17T17:34:23.547593+0000","last_unstale":"2023-08-17T17:34:23.547875+0000","last_undegraded":"2023-08-17T17:34:23.547875+0000","last_fullsized":"2023-08-17T17:34:23.547875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541748+0000","last_change":"2023-08-17T17:34:23.190210+0000","last_active":"2023-08-17T17:34:23.541748+0000","last_peered":"2023-08-17T17:34:23.541748+0000","last_clean":"2023-08-17T17:34:23.541748+0000","last_became_active":"2023-08-17T17:34:23.189745+0000","last_became_peered":"2023-08-17T17:34:23.189745+0000","last_unstale":"2023-08-17T17:34:23.541748+0000","last_undegraded":"2023-08-17T17:34:23.541748+0000","last_fullsized":"2023-08-17T17:34:23.541748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555242+0000","last_change":"2023-08-17T17:34:23.555242+0000","last_active":"2023-08-17T17:34:23.555242+0000","last_peered":"2023-08-17T17:34:23.555242+0000","last_clean":"2023-08-17T17:34:23.555242+0000","last_became_active":"2023-08-17T17:34:23.554975+0000","last_became_peered":"2023-08-17T17:34:23.554975+0000","last_unstale":"2023-08-17T17:34:23.555242+0000","last_undegraded":"2023-08-17T17:34:23.555242+0000","last_fullsized":"2023-08-17T17:34:23.555242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535659+0000","last_change":"2023-08-17T17:34:23.186514+0000","last_active":"2023-08-17T17:34:23.535659+0000","last_peered":"2023-08-17T17:34:23.535659+0000","last_clean":"2023-08-17T17:34:23.535659+0000","last_became_active":"2023-08-17T17:34:23.186237+0000","last_became_peered":"2023-08-17T17:34:23.186237+0000","last_unstale":"2023-08-17T17:34:23.535659+0000","last_undegraded":"2023-08-17T17:34:23.535659+0000","last_fullsized":"2023-08-17T17:34:23.535659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556160+0000","last_change":"2023-08-17T17:34:23.556160+0000","last_active":"2023-08-17T17:34:23.556160+0000","last_peered":"2023-08-17T17:34:23.556160+0000","last_clean":"2023-08-17T17:34:23.556160+0000","last_became_active":"2023-08-17T17:34:23.555906+0000","last_became_peered":"2023-08-17T17:34:23.555906+0000","last_unstale":"2023-08-17T17:34:23.556160+0000","last_undegraded":"2023-08-17T17:34:23.556160+0000","last_fullsized":"2023-08-17T17:34:23.556160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537668+0000","last_change":"2023-08-17T17:34:23.188736+0000","last_active":"2023-08-17T17:34:23.537668+0000","last_peered":"2023-08-17T17:34:23.537668+0000","last_clean":"2023-08-17T17:34:23.537668+0000","last_became_active":"2023-08-17T17:34:23.188463+0000","last_became_peered":"2023-08-17T17:34:23.188463+0000","last_unstale":"2023-08-17T17:34:23.537668+0000","last_undegraded":"2023-08-17T17:34:23.537668+0000","last_fullsized":"2023-08-17T17:34:23.537668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556037+0000","last_change":"2023-08-17T17:34:23.556037+0000","last_active":"2023-08-17T17:34:23.556037+0000","last_peered":"2023-08-17T17:34:23.556037+0000","last_clean":"2023-08-17T17:34:23.556037+0000","last_became_active":"2023-08-17T17:34:23.555773+0000","last_became_peered":"2023-08-17T17:34:23.555773+0000","last_unstale":"2023-08-17T17:34:23.556037+0000","last_undegraded":"2023-08-17T17:34:23.556037+0000","last_fullsized":"2023-08-17T17:34:23.556037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555701+0000","last_change":"2023-08-17T17:34:23.182339+0000","last_active":"2023-08-17T17:34:23.555701+0000","last_peered":"2023-08-17T17:34:23.555701+0000","last_clean":"2023-08-17T17:34:23.555701+0000","last_became_active":"2023-08-17T17:34:23.182072+0000","last_became_peered":"2023-08-17T17:34:23.182072+0000","last_unstale":"2023-08-17T17:34:23.555701+0000","last_undegraded":"2023-08-17T17:34:23.555701+0000","last_fullsized":"2023-08-17T17:34:23.555701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547106+0000","last_change":"2023-08-17T17:34:23.540248+0000","last_active":"2023-08-17T17:34:23.547106+0000","last_peered":"2023-08-17T17:34:23.547106+0000","last_clean":"2023-08-17T17:34:23.547106+0000","last_became_active":"2023-08-17T17:34:23.539612+0000","last_became_peered":"2023-08-17T17:34:23.539612+0000","last_unstale":"2023-08-17T17:34:23.547106+0000","last_undegraded":"2023-08-17T17:34:23.547106+0000","last_fullsized":"2023-08-17T17:34:23.547106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199100+0000","last_change":"2023-08-17T17:34:23.191957+0000","last_active":"2023-08-17T17:34:23.199100+0000","last_peered":"2023-08-17T17:34:23.199100+0000","last_clean":"2023-08-17T17:34:23.199100+0000","last_became_active":"2023-08-17T17:34:23.191666+0000","last_became_peered":"2023-08-17T17:34:23.191666+0000","last_unstale":"2023-08-17T17:34:23.199100+0000","last_undegraded":"2023-08-17T17:34:23.199100+0000","last_fullsized":"2023-08-17T17:34:23.199100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553646+0000","last_change":"2023-08-17T17:34:23.553646+0000","last_active":"2023-08-17T17:34:23.553646+0000","last_peered":"2023-08-17T17:34:23.553646+0000","last_clean":"2023-08-17T17:34:23.553646+0000","last_became_active":"2023-08-17T17:34:23.553378+0000","last_became_peered":"2023-08-17T17:34:23.553378+0000","last_unstale":"2023-08-17T17:34:23.553646+0000","last_undegraded":"2023-08-17T17:34:23.553646+0000","last_fullsized":"2023-08-17T17:34:23.553646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.196120+0000","last_change":"2023-08-17T17:34:23.191017+0000","last_active":"2023-08-17T17:34:23.196120+0000","last_peered":"2023-08-17T17:34:23.196120+0000","last_clean":"2023-08-17T17:34:23.196120+0000","last_became_active":"2023-08-17T17:34:23.190761+0000","last_became_peered":"2023-08-17T17:34:23.190761+0000","last_unstale":"2023-08-17T17:34:23.196120+0000","last_undegraded":"2023-08-17T17:34:23.196120+0000","last_fullsized":"2023-08-17T17:34:23.196120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556028+0000","last_change":"2023-08-17T17:34:23.552814+0000","last_active":"2023-08-17T17:34:23.556028+0000","last_peered":"2023-08-17T17:34:23.556028+0000","last_clean":"2023-08-17T17:34:23.556028+0000","last_became_active":"2023-08-17T17:34:23.552549+0000","last_became_peered":"2023-08-17T17:34:23.552549+0000","last_unstale":"2023-08-17T17:34:23.556028+0000","last_undegraded":"2023-08-17T17:34:23.556028+0000","last_fullsized":"2023-08-17T17:34:23.556028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553788+0000","last_change":"2023-08-17T17:34:23.184359+0000","last_active":"2023-08-17T17:34:23.553788+0000","last_peered":"2023-08-17T17:34:23.553788+0000","last_clean":"2023-08-17T17:34:23.553788+0000","last_became_active":"2023-08-17T17:34:23.183723+0000","last_became_peered":"2023-08-17T17:34:23.183723+0000","last_unstale":"2023-08-17T17:34:23.553788+0000","last_undegraded":"2023-08-17T17:34:23.553788+0000","last_fullsized":"2023-08-17T17:34:23.553788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555985+0000","last_change":"2023-08-17T17:34:23.551730+0000","last_active":"2023-08-17T17:34:23.555985+0000","last_peered":"2023-08-17T17:34:23.555985+0000","last_clean":"2023-08-17T17:34:23.555985+0000","last_became_active":"2023-08-17T17:34:23.551463+0000","last_became_peered":"2023-08-17T17:34:23.551463+0000","last_unstale":"2023-08-17T17:34:23.555985+0000","last_undegraded":"2023-08-17T17:34:23.555985+0000","last_fullsized":"2023-08-17T17:34:23.555985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556856+0000","last_change":"2023-08-17T17:34:23.189962+0000","last_active":"2023-08-17T17:34:23.556856+0000","last_peered":"2023-08-17T17:34:23.556856+0000","last_clean":"2023-08-17T17:34:23.556856+0000","last_became_active":"2023-08-17T17:34:23.189247+0000","last_became_peered":"2023-08-17T17:34:23.189247+0000","last_unstale":"2023-08-17T17:34:23.556856+0000","last_undegraded":"2023-08-17T17:34:23.556856+0000","last_fullsized":"2023-08-17T17:34:23.556856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547521+0000","last_change":"2023-08-17T17:34:23.542831+0000","last_active":"2023-08-17T17:34:23.547521+0000","last_peered":"2023-08-17T17:34:23.547521+0000","last_clean":"2023-08-17T17:34:23.547521+0000","last_became_active":"2023-08-17T17:34:23.542564+0000","last_became_peered":"2023-08-17T17:34:23.542564+0000","last_unstale":"2023-08-17T17:34:23.547521+0000","last_undegraded":"2023-08-17T17:34:23.547521+0000","last_fullsized":"2023-08-17T17:34:23.547521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198338+0000","last_change":"2023-08-17T17:34:23.193784+0000","last_active":"2023-08-17T17:34:23.198338+0000","last_peered":"2023-08-17T17:34:23.198338+0000","last_clean":"2023-08-17T17:34:23.198338+0000","last_became_active":"2023-08-17T17:34:23.193515+0000","last_became_peered":"2023-08-17T17:34:23.193515+0000","last_unstale":"2023-08-17T17:34:23.198338+0000","last_undegraded":"2023-08-17T17:34:23.198338+0000","last_fullsized":"2023-08-17T17:34:23.198338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.559293+0000","last_change":"2023-08-17T17:34:23.559293+0000","last_active":"2023-08-17T17:34:23.559293+0000","last_peered":"2023-08-17T17:34:23.559293+0000","last_clean":"2023-08-17T17:34:23.559293+0000","last_became_active":"2023-08-17T17:34:23.559072+0000","last_became_peered":"2023-08-17T17:34:23.559072+0000","last_unstale":"2023-08-17T17:34:23.559293+0000","last_undegraded":"2023-08-17T17:34:23.559293+0000","last_fullsized":"2023-08-17T17:34:23.559293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.197608+0000","last_change":"2023-08-17T17:34:23.191570+0000","last_active":"2023-08-17T17:34:23.197608+0000","last_peered":"2023-08-17T17:34:23.197608+0000","last_clean":"2023-08-17T17:34:23.197608+0000","last_became_active":"2023-08-17T17:34:23.191127+0000","last_became_peered":"2023-08-17T17:34:23.191127+0000","last_unstale":"2023-08-17T17:34:23.197608+0000","last_undegraded":"2023-08-17T17:34:23.197608+0000","last_fullsized":"2023-08-17T17:34:23.197608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.548523+0000","last_change":"2023-08-17T17:34:23.548523+0000","last_active":"2023-08-17T17:34:23.548523+0000","last_peered":"2023-08-17T17:34:23.548523+0000","last_clean":"2023-08-17T17:34:23.548523+0000","last_became_active":"2023-08-17T17:34:23.548180+0000","last_became_peered":"2023-08-17T17:34:23.548180+0000","last_unstale":"2023-08-17T17:34:23.548523+0000","last_undegraded":"2023-08-17T17:34:23.548523+0000","last_fullsized":"2023-08-17T17:34:23.548523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198636+0000","last_change":"2023-08-17T17:34:23.193931+0000","last_active":"2023-08-17T17:34:23.198636+0000","last_peered":"2023-08-17T17:34:23.198636+0000","last_clean":"2023-08-17T17:34:23.198636+0000","last_became_active":"2023-08-17T17:34:23.193104+0000","last_became_peered":"2023-08-17T17:34:23.193104+0000","last_unstale":"2023-08-17T17:34:23.198636+0000","last_undegraded":"2023-08-17T17:34:23.198636+0000","last_fullsized":"2023-08-17T17:34:23.198636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555975+0000","last_change":"2023-08-17T17:34:23.551080+0000","last_active":"2023-08-17T17:34:23.555975+0000","last_peered":"2023-08-17T17:34:23.555975+0000","last_clean":"2023-08-17T17:34:23.555975+0000","last_became_active":"2023-08-17T17:34:23.550830+0000","last_became_peered":"2023-08-17T17:34:23.550830+0000","last_unstale":"2023-08-17T17:34:23.555975+0000","last_undegraded":"2023-08-17T17:34:23.555975+0000","last_fullsized":"2023-08-17T17:34:23.555975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.185609+0000","last_change":"2023-08-17T17:34:23.182626+0000","last_active":"2023-08-17T17:34:23.185609+0000","last_peered":"2023-08-17T17:34:23.185609+0000","last_clean":"2023-08-17T17:34:23.185609+0000","last_became_active":"2023-08-17T17:34:23.182368+0000","last_became_peered":"2023-08-17T17:34:23.182368+0000","last_unstale":"2023-08-17T17:34:23.185609+0000","last_undegraded":"2023-08-17T17:34:23.185609+0000","last_fullsized":"2023-08-17T17:34:23.185609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547126+0000","last_change":"2023-08-17T17:34:23.540567+0000","last_active":"2023-08-17T17:34:23.547126+0000","last_peered":"2023-08-17T17:34:23.547126+0000","last_clean":"2023-08-17T17:34:23.547126+0000","last_became_active":"2023-08-17T17:34:23.539925+0000","last_became_peered":"2023-08-17T17:34:23.539925+0000","last_unstale":"2023-08-17T17:34:23.547126+0000","last_undegraded":"2023-08-17T17:34:23.547126+0000","last_fullsized":"2023-08-17T17:34:23.547126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198753+0000","last_change":"2023-08-17T17:34:23.194479+0000","last_active":"2023-08-17T17:34:23.198753+0000","last_peered":"2023-08-17T17:34:23.198753+0000","last_clean":"2023-08-17T17:34:23.198753+0000","last_became_active":"2023-08-17T17:34:23.194196+0000","last_became_peered":"2023-08-17T17:34:23.194196+0000","last_unstale":"2023-08-17T17:34:23.198753+0000","last_undegraded":"2023-08-17T17:34:23.198753+0000","last_fullsized":"2023-08-17T17:34:23.198753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553805+0000","last_change":"2023-08-17T17:34:23.553805+0000","last_active":"2023-08-17T17:34:23.553805+0000","last_peered":"2023-08-17T17:34:23.553805+0000","last_clean":"2023-08-17T17:34:23.553805+0000","last_became_active":"2023-08-17T17:34:23.553524+0000","last_became_peered":"2023-08-17T17:34:23.553524+0000","last_unstale":"2023-08-17T17:34:23.553805+0000","last_undegraded":"2023-08-17T17:34:23.553805+0000","last_fullsized":"2023-08-17T17:34:23.553805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553107+0000","last_change":"2023-08-17T17:34:23.184707+0000","last_active":"2023-08-17T17:34:23.553107+0000","last_peered":"2023-08-17T17:34:23.553107+0000","last_clean":"2023-08-17T17:34:23.553107+0000","last_became_active":"2023-08-17T17:34:23.184244+0000","last_became_peered":"2023-08-17T17:34:23.184244+0000","last_unstale":"2023-08-17T17:34:23.553107+0000","last_undegraded":"2023-08-17T17:34:23.553107+0000","last_fullsized":"2023-08-17T17:34:23.553107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558704+0000","last_change":"2023-08-17T17:34:23.558704+0000","last_active":"2023-08-17T17:34:23.558704+0000","last_peered":"2023-08-17T17:34:23.558704+0000","last_clean":"2023-08-17T17:34:23.558704+0000","last_became_active":"2023-08-17T17:34:23.558374+0000","last_became_peered":"2023-08-17T17:34:23.558374+0000","last_unstale":"2023-08-17T17:34:23.558704+0000","last_undegraded":"2023-08-17T17:34:23.558704+0000","last_fullsized":"2023-08-17T17:34:23.558704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541721+0000","last_change":"2023-08-17T17:34:23.190318+0000","last_active":"2023-08-17T17:34:23.541721+0000","last_peered":"2023-08-17T17:34:23.541721+0000","last_clean":"2023-08-17T17:34:23.541721+0000","last_became_active":"2023-08-17T17:34:23.190011+0000","last_became_peered":"2023-08-17T17:34:23.190011+0000","last_unstale":"2023-08-17T17:34:23.541721+0000","last_undegraded":"2023-08-17T17:34:23.541721+0000","last_fullsized":"2023-08-17T17:34:23.541721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552175+0000","last_change":"2023-08-17T17:34:23.552175+0000","last_active":"2023-08-17T17:34:23.552175+0000","last_peered":"2023-08-17T17:34:23.552175+0000","last_clean":"2023-08-17T17:34:23.552175+0000","last_became_active":"2023-08-17T17:34:23.551927+0000","last_became_peered":"2023-08-17T17:34:23.551927+0000","last_unstale":"2023-08-17T17:34:23.552175+0000","last_undegraded":"2023-08-17T17:34:23.552175+0000","last_fullsized":"2023-08-17T17:34:23.552175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561308+0000","last_change":"2023-08-17T17:34:23.184913+0000","last_active":"2023-08-17T17:34:23.561308+0000","last_peered":"2023-08-17T17:34:23.561308+0000","last_clean":"2023-08-17T17:34:23.561308+0000","last_became_active":"2023-08-17T17:34:23.184622+0000","last_became_peered":"2023-08-17T17:34:23.184622+0000","last_unstale":"2023-08-17T17:34:23.561308+0000","last_undegraded":"2023-08-17T17:34:23.561308+0000","last_fullsized":"2023-08-17T17:34:23.561308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555151+0000","last_change":"2023-08-17T17:34:23.555151+0000","last_active":"2023-08-17T17:34:23.555151+0000","last_peered":"2023-08-17T17:34:23.555151+0000","last_clean":"2023-08-17T17:34:23.555151+0000","last_became_active":"2023-08-17T17:34:23.554868+0000","last_became_peered":"2023-08-17T17:34:23.554868+0000","last_unstale":"2023-08-17T17:34:23.555151+0000","last_undegraded":"2023-08-17T17:34:23.555151+0000","last_fullsized":"2023-08-17T17:34:23.555151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195535+0000","last_change":"2023-08-17T17:34:23.189742+0000","last_active":"2023-08-17T17:34:23.195535+0000","last_peered":"2023-08-17T17:34:23.195535+0000","last_clean":"2023-08-17T17:34:23.195535+0000","last_became_active":"2023-08-17T17:34:23.189466+0000","last_became_peered":"2023-08-17T17:34:23.189466+0000","last_unstale":"2023-08-17T17:34:23.195535+0000","last_undegraded":"2023-08-17T17:34:23.195535+0000","last_fullsized":"2023-08-17T17:34:23.195535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553968+0000","last_change":"2023-08-17T17:34:23.553968+0000","last_active":"2023-08-17T17:34:23.553968+0000","last_peered":"2023-08-17T17:34:23.553968+0000","last_clean":"2023-08-17T17:34:23.553968+0000","last_became_active":"2023-08-17T17:34:23.552409+0000","last_became_peered":"2023-08-17T17:34:23.552409+0000","last_unstale":"2023-08-17T17:34:23.553968+0000","last_undegraded":"2023-08-17T17:34:23.553968+0000","last_fullsized":"2023-08-17T17:34:23.553968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193391+0000","last_change":"2023-08-17T17:34:23.189070+0000","last_active":"2023-08-17T17:34:23.193391+0000","last_peered":"2023-08-17T17:34:23.193391+0000","last_clean":"2023-08-17T17:34:23.193391+0000","last_became_active":"2023-08-17T17:34:23.188771+0000","last_became_peered":"2023-08-17T17:34:23.188771+0000","last_unstale":"2023-08-17T17:34:23.193391+0000","last_undegraded":"2023-08-17T17:34:23.193391+0000","last_fullsized":"2023-08-17T17:34:23.193391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554378+0000","last_change":"2023-08-17T17:34:23.549482+0000","last_active":"2023-08-17T17:34:23.554378+0000","last_peered":"2023-08-17T17:34:23.554378+0000","last_clean":"2023-08-17T17:34:23.554378+0000","last_became_active":"2023-08-17T17:34:23.549214+0000","last_became_peered":"2023-08-17T17:34:23.549214+0000","last_unstale":"2023-08-17T17:34:23.554378+0000","last_undegraded":"2023-08-17T17:34:23.554378+0000","last_fullsized":"2023-08-17T17:34:23.554378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557177+0000","last_change":"2023-08-17T17:34:23.191534+0000","last_active":"2023-08-17T17:34:23.557177+0000","last_peered":"2023-08-17T17:34:23.557177+0000","last_clean":"2023-08-17T17:34:23.557177+0000","last_became_active":"2023-08-17T17:34:23.191251+0000","last_became_peered":"2023-08-17T17:34:23.191251+0000","last_unstale":"2023-08-17T17:34:23.557177+0000","last_undegraded":"2023-08-17T17:34:23.557177+0000","last_fullsized":"2023-08-17T17:34:23.557177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":80051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":80083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":78727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":80229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:34:29.163 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:34:29.161+0000 7fbce32fb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:34:30.437 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:34:30.440 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:34:30.921 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:34:31.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.044+0000 7f8bb759e700 1 Processor -- start 2023-08-17T17:34:31.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.044+0000 7f8bb759e700 1 -- start start 2023-08-17T17:34:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.045+0000 7f8bb759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8bb80a7bd0 0x7f8bb8063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.045+0000 7f8bb759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80a8050 0x7f8bb80642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.045+0000 7f8bb759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb8063960 con 0x7f8bb80c01b0 2023-08-17T17:34:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.045+0000 7f8bb759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb8063030 con 0x7f8bb80a7bd0 2023-08-17T17:34:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.045+0000 7f8bb759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8063310 con 0x7f8bb80a8050 2023-08-17T17:34:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb5d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8bb80a7bd0 0x7f8bb8063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb6d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80a8050 0x7f8bb80642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb659c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8bb80c01b0 0x7f8bb80c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:57676/0 (socket says 172.21.15.78:57676) 2023-08-17T17:34:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb5d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8bb80a7bd0 0x7f8bb8063df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:37764/0 (socket says 172.21.15.78:37764) 2023-08-17T17:34:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb6d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80a8050 0x7f8bb80642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:38622/0 (socket says 172.21.15.78:38622) 2023-08-17T17:34:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb659c700 1 -- 172.21.15.78:0/3158313038 learned_addr learned my addr 172.21.15.78:0/3158313038 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb5d9b700 1 -- 172.21.15.78:0/3158313038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80a8050 msgr2=0x7f8bb80642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb5d9b700 1 --2- 172.21.15.78:0/3158313038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80a8050 0x7f8bb80642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb5d9b700 1 -- 172.21.15.78:0/3158313038 >> v1:172.21.15.150:6789/0 conn(0x7f8bb80c01b0 legacy=0x7f8bb80c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb5d9b700 1 -- 172.21.15.78:0/3158313038 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80635f0 con 0x7f8bb80a7bd0 2023-08-17T17:34:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb559a700 1 -- 172.21.15.78:0/3158313038 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149125301 0 0) 0x7f8bb8063960 con 0x7f8bb80c01b0 2023-08-17T17:34:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb6d9d700 1 --2- 172.21.15.78:0/3158313038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80a8050 0x7f8bb80642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb5d9b700 1 --2- 172.21.15.78:0/3158313038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb80a7bd0 0x7f8bb8063df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8ba0009760 tx=0x7f8ba0009060).ready entity=mon.1 client_cookie=9d6ef57f49b5a263 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb559a700 1 -- 172.21.15.78:0/3158313038 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba000f510 con 0x7f8bb80a7bd0 2023-08-17T17:34:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb559a700 1 -- 172.21.15.78:0/3158313038 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba000f670 con 0x7f8bb80a7bd0 2023-08-17T17:34:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.046+0000 7f8bb559a700 1 -- 172.21.15.78:0/3158313038 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba000f9f0 con 0x7f8bb80a7bd0 2023-08-17T17:34:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.047+0000 7f8bb759e700 1 -- 172.21.15.78:0/3158313038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb80a7bd0 msgr2=0x7f8bb8063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.047+0000 7f8bb759e700 1 --2- 172.21.15.78:0/3158313038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb80a7bd0 0x7f8bb8063df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8ba0009760 tx=0x7f8ba0009060).stop 2023-08-17T17:34:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.047+0000 7f8bb759e700 1 -- 172.21.15.78:0/3158313038 shutdown_connections 2023-08-17T17:34:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.047+0000 7f8bb759e700 1 --2- 172.21.15.78:0/3158313038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80a8050 0x7f8bb80642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.047+0000 7f8bb759e700 1 --2- 172.21.15.78:0/3158313038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb80a7bd0 0x7f8bb8063df0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.047+0000 7f8bb759e700 1 -- 172.21.15.78:0/3158313038 >> 172.21.15.78:0/3158313038 conn(0x7f8bb806a6c0 msgr2=0x7f8bb80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.047+0000 7f8bb759e700 1 -- 172.21.15.78:0/3158313038 shutdown_connections 2023-08-17T17:34:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.047+0000 7f8bb759e700 1 -- 172.21.15.78:0/3158313038 wait complete. 2023-08-17T17:34:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.048+0000 7f8bb759e700 1 Processor -- start 2023-08-17T17:34:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.048+0000 7f8bb759e700 1 -- start start 2023-08-17T17:34:31.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb80a7bd0 0x7f8bb81656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb80a8050 0x7f8bb81672a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80c01b0 0x7f8bb80aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80aee70 con 0x7f8bb80a8050 2023-08-17T17:34:31.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80af710 con 0x7f8bb80a7bd0 2023-08-17T17:34:31.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8165bb0 con 0x7f8bb80c01b0 2023-08-17T17:34:31.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb80a8050 0x7f8bb81672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb80a8050 0x7f8bb81672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46718/0 (socket says 172.21.15.78:46718) 2023-08-17T17:34:31.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb5d9b700 1 -- 172.21.15.78:0/342638709 learned_addr learned my addr 172.21.15.78:0/342638709 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:31.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb659c700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb80a7bd0 0x7f8bb81656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb6d9d700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80c01b0 0x7f8bb80aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb5d9b700 1 -- 172.21.15.78:0/342638709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80c01b0 msgr2=0x7f8bb80aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb5d9b700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80c01b0 0x7f8bb80aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb5d9b700 1 -- 172.21.15.78:0/342638709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb80a7bd0 msgr2=0x7f8bb81656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.049+0000 7f8bb5d9b700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb80a7bd0 0x7f8bb81656c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.050+0000 7f8bb5d9b700 1 -- 172.21.15.78:0/342638709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8009a20 con 0x7f8bb80a8050 2023-08-17T17:34:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.050+0000 7f8bb5d9b700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb80a8050 0x7f8bb81672a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8ba000f610 tx=0x7f8ba0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.050+0000 7f8bae7fc700 1 -- 172.21.15.78:0/342638709 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba000f7e0 con 0x7f8bb80a8050 2023-08-17T17:34:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.050+0000 7f8bae7fc700 1 -- 172.21.15.78:0/342638709 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba000f940 con 0x7f8bb80a8050 2023-08-17T17:34:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.050+0000 7f8bb759e700 1 -- 172.21.15.78:0/342638709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba00092a0 con 0x7f8bb80a8050 2023-08-17T17:34:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.050+0000 7f8bae7fc700 1 -- 172.21.15.78:0/342638709 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba001b660 con 0x7f8bb80a8050 2023-08-17T17:34:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.050+0000 7f8bb759e700 1 -- 172.21.15.78:0/342638709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb80af0c0 con 0x7f8bb80a8050 2023-08-17T17:34:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.051+0000 7f8bb759e700 1 -- 172.21.15.78:0/342638709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb8083af0 con 0x7f8bb80a8050 2023-08-17T17:34:31.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.051+0000 7f8bae7fc700 1 -- 172.21.15.78:0/342638709 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8ba000f070 con 0x7f8bb80a8050 2023-08-17T17:34:31.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.052+0000 7f8bae7fc700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8b9805ed90 0x7f8b98061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.052+0000 7f8bb659c700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8b9805ed90 0x7f8b98061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.052+0000 7f8bae7fc700 1 -- 172.21.15.78:0/342638709 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ba007b550 con 0x7f8bb80a8050 2023-08-17T17:34:31.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.052+0000 7f8bb659c700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8b9805ed90 0x7f8b98061250 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8bb000c7d0 tx=0x7f8bb0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:31.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.056+0000 7f8bae7fc700 1 -- 172.21.15.78:0/342638709 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ba004cba0 con 0x7f8bb80a8050 2023-08-17T17:34:31.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.220+0000 7f8bb759e700 1 -- 172.21.15.78:0/342638709 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8bb80c63e0 con 0x7f8b9805ed90 2023-08-17T17:34:31.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.229+0000 7f8bae7fc700 1 -- 172.21.15.78:0/342638709 <== mgr.4104 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336402 (secure 0 0 0) 0x7f8bb80c63e0 con 0x7f8b9805ed90 2023-08-17T17:34:31.234 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.232+0000 7f8bb759e700 1 -- 172.21.15.78:0/342638709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8b9805ed90 msgr2=0x7f8b98061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.232+0000 7f8bb759e700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8b9805ed90 0x7f8b98061250 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8bb000c7d0 tx=0x7f8bb0009040).stop 2023-08-17T17:34:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.233+0000 7f8bb759e700 1 -- 172.21.15.78:0/342638709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb80a8050 msgr2=0x7f8bb81672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.233+0000 7f8bb759e700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb80a8050 0x7f8bb81672a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8ba000f610 tx=0x7f8ba0017000).stop 2023-08-17T17:34:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.233+0000 7f8bb759e700 1 -- 172.21.15.78:0/342638709 shutdown_connections 2023-08-17T17:34:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.233+0000 7f8bb759e700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8b9805ed90 0x7f8b98061250 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.233+0000 7f8bb759e700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb80c01b0 0x7f8bb80aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.233+0000 7f8bb759e700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb80a7bd0 0x7f8bb81656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.233+0000 7f8bb759e700 1 --2- 172.21.15.78:0/342638709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb80a8050 0x7f8bb81672a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.233+0000 7f8bb759e700 1 -- 172.21.15.78:0/342638709 >> 172.21.15.78:0/342638709 conn(0x7f8bb806a6c0 msgr2=0x7f8bb80a9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:31.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.233+0000 7f8bb759e700 1 -- 172.21.15.78:0/342638709 shutdown_connections 2023-08-17T17:34:31.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.233+0000 7f8bb759e700 1 -- 172.21.15.78:0/342638709 wait complete. 2023-08-17T17:34:31.238 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:34:31.246 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-17T17:34:31.009841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378552,"kb_used_data":1784,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596168,"statfs":{"total":773094113280,"available":770658476032,"internally_reserved":0,"allocated":1826816,"data_stored":647116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000797"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557678+0000","last_change":"2023-08-17T17:34:23.557678+0000","last_active":"2023-08-17T17:34:23.557678+0000","last_peered":"2023-08-17T17:34:23.557678+0000","last_clean":"2023-08-17T17:34:23.557678+0000","last_became_active":"2023-08-17T17:34:23.555333+0000","last_became_peered":"2023-08-17T17:34:23.555333+0000","last_unstale":"2023-08-17T17:34:23.557678+0000","last_undegraded":"2023-08-17T17:34:23.557678+0000","last_fullsized":"2023-08-17T17:34:23.557678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.197613+0000","last_change":"2023-08-17T17:34:23.190017+0000","last_active":"2023-08-17T17:34:23.197613+0000","last_peered":"2023-08-17T17:34:23.197613+0000","last_clean":"2023-08-17T17:34:23.197613+0000","last_became_active":"2023-08-17T17:34:23.189552+0000","last_became_peered":"2023-08-17T17:34:23.189552+0000","last_unstale":"2023-08-17T17:34:23.197613+0000","last_undegraded":"2023-08-17T17:34:23.197613+0000","last_fullsized":"2023-08-17T17:34:23.197613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547846+0000","last_change":"2023-08-17T17:34:23.547846+0000","last_active":"2023-08-17T17:34:23.547846+0000","last_peered":"2023-08-17T17:34:23.547846+0000","last_clean":"2023-08-17T17:34:23.547846+0000","last_became_active":"2023-08-17T17:34:23.547522+0000","last_became_peered":"2023-08-17T17:34:23.547522+0000","last_unstale":"2023-08-17T17:34:23.547846+0000","last_undegraded":"2023-08-17T17:34:23.547846+0000","last_fullsized":"2023-08-17T17:34:23.547846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199221+0000","last_change":"2023-08-17T17:34:23.196197+0000","last_active":"2023-08-17T17:34:23.199221+0000","last_peered":"2023-08-17T17:34:23.199221+0000","last_clean":"2023-08-17T17:34:23.199221+0000","last_became_active":"2023-08-17T17:34:23.195910+0000","last_became_peered":"2023-08-17T17:34:23.195910+0000","last_unstale":"2023-08-17T17:34:23.199221+0000","last_undegraded":"2023-08-17T17:34:23.199221+0000","last_fullsized":"2023-08-17T17:34:23.199221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550439+0000","last_change":"2023-08-17T17:34:23.550439+0000","last_active":"2023-08-17T17:34:23.550439+0000","last_peered":"2023-08-17T17:34:23.550439+0000","last_clean":"2023-08-17T17:34:23.550439+0000","last_became_active":"2023-08-17T17:34:23.550192+0000","last_became_peered":"2023-08-17T17:34:23.550192+0000","last_unstale":"2023-08-17T17:34:23.550439+0000","last_undegraded":"2023-08-17T17:34:23.550439+0000","last_fullsized":"2023-08-17T17:34:23.550439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195568+0000","last_change":"2023-08-17T17:34:23.186362+0000","last_active":"2023-08-17T17:34:23.195568+0000","last_peered":"2023-08-17T17:34:23.195568+0000","last_clean":"2023-08-17T17:34:23.195568+0000","last_became_active":"2023-08-17T17:34:23.186076+0000","last_became_peered":"2023-08-17T17:34:23.186076+0000","last_unstale":"2023-08-17T17:34:23.195568+0000","last_undegraded":"2023-08-17T17:34:23.195568+0000","last_fullsized":"2023-08-17T17:34:23.195568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558066+0000","last_change":"2023-08-17T17:34:23.558066+0000","last_active":"2023-08-17T17:34:23.558066+0000","last_peered":"2023-08-17T17:34:23.558066+0000","last_clean":"2023-08-17T17:34:23.558066+0000","last_became_active":"2023-08-17T17:34:23.557750+0000","last_became_peered":"2023-08-17T17:34:23.557750+0000","last_unstale":"2023-08-17T17:34:23.558066+0000","last_undegraded":"2023-08-17T17:34:23.558066+0000","last_fullsized":"2023-08-17T17:34:23.558066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193455+0000","last_change":"2023-08-17T17:34:23.185772+0000","last_active":"2023-08-17T17:34:23.193455+0000","last_peered":"2023-08-17T17:34:23.193455+0000","last_clean":"2023-08-17T17:34:23.193455+0000","last_became_active":"2023-08-17T17:34:23.185206+0000","last_became_peered":"2023-08-17T17:34:23.185206+0000","last_unstale":"2023-08-17T17:34:23.193455+0000","last_undegraded":"2023-08-17T17:34:23.193455+0000","last_fullsized":"2023-08-17T17:34:23.193455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558454+0000","last_change":"2023-08-17T17:34:23.558454+0000","last_active":"2023-08-17T17:34:23.558454+0000","last_peered":"2023-08-17T17:34:23.558454+0000","last_clean":"2023-08-17T17:34:23.558454+0000","last_became_active":"2023-08-17T17:34:23.558213+0000","last_became_peered":"2023-08-17T17:34:23.558213+0000","last_unstale":"2023-08-17T17:34:23.558454+0000","last_undegraded":"2023-08-17T17:34:23.558454+0000","last_fullsized":"2023-08-17T17:34:23.558454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538249+0000","last_change":"2023-08-17T17:34:23.188666+0000","last_active":"2023-08-17T17:34:23.538249+0000","last_peered":"2023-08-17T17:34:23.538249+0000","last_clean":"2023-08-17T17:34:23.538249+0000","last_became_active":"2023-08-17T17:34:23.188351+0000","last_became_peered":"2023-08-17T17:34:23.188351+0000","last_unstale":"2023-08-17T17:34:23.538249+0000","last_undegraded":"2023-08-17T17:34:23.538249+0000","last_fullsized":"2023-08-17T17:34:23.538249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550268+0000","last_change":"2023-08-17T17:34:23.550268+0000","last_active":"2023-08-17T17:34:23.550268+0000","last_peered":"2023-08-17T17:34:23.550268+0000","last_clean":"2023-08-17T17:34:23.550268+0000","last_became_active":"2023-08-17T17:34:23.549994+0000","last_became_peered":"2023-08-17T17:34:23.549994+0000","last_unstale":"2023-08-17T17:34:23.550268+0000","last_undegraded":"2023-08-17T17:34:23.550268+0000","last_fullsized":"2023-08-17T17:34:23.550268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561285+0000","last_change":"2023-08-17T17:34:23.187424+0000","last_active":"2023-08-17T17:34:23.561285+0000","last_peered":"2023-08-17T17:34:23.561285+0000","last_clean":"2023-08-17T17:34:23.561285+0000","last_became_active":"2023-08-17T17:34:23.187090+0000","last_became_peered":"2023-08-17T17:34:23.187090+0000","last_unstale":"2023-08-17T17:34:23.561285+0000","last_undegraded":"2023-08-17T17:34:23.561285+0000","last_fullsized":"2023-08-17T17:34:23.561285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550226+0000","last_change":"2023-08-17T17:34:23.550226+0000","last_active":"2023-08-17T17:34:23.550226+0000","last_peered":"2023-08-17T17:34:23.550226+0000","last_clean":"2023-08-17T17:34:23.550226+0000","last_became_active":"2023-08-17T17:34:23.549894+0000","last_became_peered":"2023-08-17T17:34:23.549894+0000","last_unstale":"2023-08-17T17:34:23.550226+0000","last_undegraded":"2023-08-17T17:34:23.550226+0000","last_fullsized":"2023-08-17T17:34:23.550226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557544+0000","last_change":"2023-08-17T17:34:23.191048+0000","last_active":"2023-08-17T17:34:23.557544+0000","last_peered":"2023-08-17T17:34:23.557544+0000","last_clean":"2023-08-17T17:34:23.557544+0000","last_became_active":"2023-08-17T17:34:23.189624+0000","last_became_peered":"2023-08-17T17:34:23.189624+0000","last_unstale":"2023-08-17T17:34:23.557544+0000","last_undegraded":"2023-08-17T17:34:23.557544+0000","last_fullsized":"2023-08-17T17:34:23.557544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.560468+0000","last_change":"2023-08-17T17:34:23.560468+0000","last_active":"2023-08-17T17:34:23.560468+0000","last_peered":"2023-08-17T17:34:23.560468+0000","last_clean":"2023-08-17T17:34:23.560468+0000","last_became_active":"2023-08-17T17:34:23.560200+0000","last_became_peered":"2023-08-17T17:34:23.560200+0000","last_unstale":"2023-08-17T17:34:23.560468+0000","last_undegraded":"2023-08-17T17:34:23.560468+0000","last_fullsized":"2023-08-17T17:34:23.560468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541621+0000","last_change":"2023-08-17T17:34:23.192628+0000","last_active":"2023-08-17T17:34:23.541621+0000","last_peered":"2023-08-17T17:34:23.541621+0000","last_clean":"2023-08-17T17:34:23.541621+0000","last_became_active":"2023-08-17T17:34:23.192359+0000","last_became_peered":"2023-08-17T17:34:23.192359+0000","last_unstale":"2023-08-17T17:34:23.541621+0000","last_undegraded":"2023-08-17T17:34:23.541621+0000","last_fullsized":"2023-08-17T17:34:23.541621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554345+0000","last_change":"2023-08-17T17:34:23.549337+0000","last_active":"2023-08-17T17:34:23.554345+0000","last_peered":"2023-08-17T17:34:23.554345+0000","last_clean":"2023-08-17T17:34:23.554345+0000","last_became_active":"2023-08-17T17:34:23.547732+0000","last_became_peered":"2023-08-17T17:34:23.547732+0000","last_unstale":"2023-08-17T17:34:23.554345+0000","last_undegraded":"2023-08-17T17:34:23.554345+0000","last_fullsized":"2023-08-17T17:34:23.554345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195523+0000","last_change":"2023-08-17T17:34:23.189436+0000","last_active":"2023-08-17T17:34:23.195523+0000","last_peered":"2023-08-17T17:34:23.195523+0000","last_clean":"2023-08-17T17:34:23.195523+0000","last_became_active":"2023-08-17T17:34:23.189166+0000","last_became_peered":"2023-08-17T17:34:23.189166+0000","last_unstale":"2023-08-17T17:34:23.195523+0000","last_undegraded":"2023-08-17T17:34:23.195523+0000","last_fullsized":"2023-08-17T17:34:23.195523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551604+0000","last_change":"2023-08-17T17:34:23.551604+0000","last_active":"2023-08-17T17:34:23.551604+0000","last_peered":"2023-08-17T17:34:23.551604+0000","last_clean":"2023-08-17T17:34:23.551604+0000","last_became_active":"2023-08-17T17:34:23.551329+0000","last_became_peered":"2023-08-17T17:34:23.551329+0000","last_unstale":"2023-08-17T17:34:23.551604+0000","last_undegraded":"2023-08-17T17:34:23.551604+0000","last_fullsized":"2023-08-17T17:34:23.551604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198347+0000","last_change":"2023-08-17T17:34:23.190730+0000","last_active":"2023-08-17T17:34:23.198347+0000","last_peered":"2023-08-17T17:34:23.198347+0000","last_clean":"2023-08-17T17:34:23.198347+0000","last_became_active":"2023-08-17T17:34:23.190449+0000","last_became_peered":"2023-08-17T17:34:23.190449+0000","last_unstale":"2023-08-17T17:34:23.198347+0000","last_undegraded":"2023-08-17T17:34:23.198347+0000","last_fullsized":"2023-08-17T17:34:23.198347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558813+0000","last_change":"2023-08-17T17:34:23.558813+0000","last_active":"2023-08-17T17:34:23.558813+0000","last_peered":"2023-08-17T17:34:23.558813+0000","last_clean":"2023-08-17T17:34:23.558813+0000","last_became_active":"2023-08-17T17:34:23.558310+0000","last_became_peered":"2023-08-17T17:34:23.558310+0000","last_unstale":"2023-08-17T17:34:23.558813+0000","last_undegraded":"2023-08-17T17:34:23.558813+0000","last_fullsized":"2023-08-17T17:34:23.558813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555179+0000","last_change":"2023-08-17T17:34:23.185442+0000","last_active":"2023-08-17T17:34:23.555179+0000","last_peered":"2023-08-17T17:34:23.555179+0000","last_clean":"2023-08-17T17:34:23.555179+0000","last_became_active":"2023-08-17T17:34:23.185159+0000","last_became_peered":"2023-08-17T17:34:23.185159+0000","last_unstale":"2023-08-17T17:34:23.555179+0000","last_undegraded":"2023-08-17T17:34:23.555179+0000","last_fullsized":"2023-08-17T17:34:23.555179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550463+0000","last_change":"2023-08-17T17:34:23.547815+0000","last_active":"2023-08-17T17:34:23.550463+0000","last_peered":"2023-08-17T17:34:23.550463+0000","last_clean":"2023-08-17T17:34:23.550463+0000","last_became_active":"2023-08-17T17:34:23.547492+0000","last_became_peered":"2023-08-17T17:34:23.547492+0000","last_unstale":"2023-08-17T17:34:23.550463+0000","last_undegraded":"2023-08-17T17:34:23.550463+0000","last_fullsized":"2023-08-17T17:34:23.550463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541589+0000","last_change":"2023-08-17T17:34:23.192604+0000","last_active":"2023-08-17T17:34:23.541589+0000","last_peered":"2023-08-17T17:34:23.541589+0000","last_clean":"2023-08-17T17:34:23.541589+0000","last_became_active":"2023-08-17T17:34:23.192411+0000","last_became_peered":"2023-08-17T17:34:23.192411+0000","last_unstale":"2023-08-17T17:34:23.541589+0000","last_undegraded":"2023-08-17T17:34:23.541589+0000","last_fullsized":"2023-08-17T17:34:23.541589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.548701+0000","last_change":"2023-08-17T17:34:23.548701+0000","last_active":"2023-08-17T17:34:23.548701+0000","last_peered":"2023-08-17T17:34:23.548701+0000","last_clean":"2023-08-17T17:34:23.548701+0000","last_became_active":"2023-08-17T17:34:23.548165+0000","last_became_peered":"2023-08-17T17:34:23.548165+0000","last_unstale":"2023-08-17T17:34:23.548701+0000","last_undegraded":"2023-08-17T17:34:23.548701+0000","last_fullsized":"2023-08-17T17:34:23.548701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556955+0000","last_change":"2023-08-17T17:34:23.193961+0000","last_active":"2023-08-17T17:34:23.556955+0000","last_peered":"2023-08-17T17:34:23.556955+0000","last_clean":"2023-08-17T17:34:23.556955+0000","last_became_active":"2023-08-17T17:34:23.193712+0000","last_became_peered":"2023-08-17T17:34:23.193712+0000","last_unstale":"2023-08-17T17:34:23.556955+0000","last_undegraded":"2023-08-17T17:34:23.556955+0000","last_fullsized":"2023-08-17T17:34:23.556955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.559424+0000","last_change":"2023-08-17T17:34:23.559424+0000","last_active":"2023-08-17T17:34:23.559424+0000","last_peered":"2023-08-17T17:34:23.559424+0000","last_clean":"2023-08-17T17:34:23.559424+0000","last_became_active":"2023-08-17T17:34:23.559157+0000","last_became_peered":"2023-08-17T17:34:23.559157+0000","last_unstale":"2023-08-17T17:34:23.559424+0000","last_undegraded":"2023-08-17T17:34:23.559424+0000","last_fullsized":"2023-08-17T17:34:23.559424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199092+0000","last_change":"2023-08-17T17:34:23.198227+0000","last_active":"2023-08-17T17:34:23.199092+0000","last_peered":"2023-08-17T17:34:23.199092+0000","last_clean":"2023-08-17T17:34:23.199092+0000","last_became_active":"2023-08-17T17:34:23.197944+0000","last_became_peered":"2023-08-17T17:34:23.197944+0000","last_unstale":"2023-08-17T17:34:23.199092+0000","last_undegraded":"2023-08-17T17:34:23.199092+0000","last_fullsized":"2023-08-17T17:34:23.199092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547115+0000","last_change":"2023-08-17T17:34:23.547115+0000","last_active":"2023-08-17T17:34:23.547115+0000","last_peered":"2023-08-17T17:34:23.547115+0000","last_clean":"2023-08-17T17:34:23.547115+0000","last_became_active":"2023-08-17T17:34:23.546829+0000","last_became_peered":"2023-08-17T17:34:23.546829+0000","last_unstale":"2023-08-17T17:34:23.547115+0000","last_undegraded":"2023-08-17T17:34:23.547115+0000","last_fullsized":"2023-08-17T17:34:23.547115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537300+0000","last_change":"2023-08-17T17:34:23.187589+0000","last_active":"2023-08-17T17:34:23.537300+0000","last_peered":"2023-08-17T17:34:23.537300+0000","last_clean":"2023-08-17T17:34:23.537300+0000","last_became_active":"2023-08-17T17:34:23.187290+0000","last_became_peered":"2023-08-17T17:34:23.187290+0000","last_unstale":"2023-08-17T17:34:23.537300+0000","last_undegraded":"2023-08-17T17:34:23.537300+0000","last_fullsized":"2023-08-17T17:34:23.537300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554129+0000","last_change":"2023-08-17T17:34:23.554129+0000","last_active":"2023-08-17T17:34:23.554129+0000","last_peered":"2023-08-17T17:34:23.554129+0000","last_clean":"2023-08-17T17:34:23.554129+0000","last_became_active":"2023-08-17T17:34:23.553850+0000","last_became_peered":"2023-08-17T17:34:23.553850+0000","last_unstale":"2023-08-17T17:34:23.554129+0000","last_undegraded":"2023-08-17T17:34:23.554129+0000","last_fullsized":"2023-08-17T17:34:23.554129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553604+0000","last_change":"2023-08-17T17:34:23.186710+0000","last_active":"2023-08-17T17:34:23.553604+0000","last_peered":"2023-08-17T17:34:23.553604+0000","last_clean":"2023-08-17T17:34:23.553604+0000","last_became_active":"2023-08-17T17:34:23.186445+0000","last_became_peered":"2023-08-17T17:34:23.186445+0000","last_unstale":"2023-08-17T17:34:23.553604+0000","last_undegraded":"2023-08-17T17:34:23.553604+0000","last_fullsized":"2023-08-17T17:34:23.553604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550750+0000","last_change":"2023-08-17T17:34:23.550750+0000","last_active":"2023-08-17T17:34:23.550750+0000","last_peered":"2023-08-17T17:34:23.550750+0000","last_clean":"2023-08-17T17:34:23.550750+0000","last_became_active":"2023-08-17T17:34:23.550414+0000","last_became_peered":"2023-08-17T17:34:23.550414+0000","last_unstale":"2023-08-17T17:34:23.550750+0000","last_undegraded":"2023-08-17T17:34:23.550750+0000","last_fullsized":"2023-08-17T17:34:23.550750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.197495+0000","last_change":"2023-08-17T17:34:23.191770+0000","last_active":"2023-08-17T17:34:23.197495+0000","last_peered":"2023-08-17T17:34:23.197495+0000","last_clean":"2023-08-17T17:34:23.197495+0000","last_became_active":"2023-08-17T17:34:23.191496+0000","last_became_peered":"2023-08-17T17:34:23.191496+0000","last_unstale":"2023-08-17T17:34:23.197495+0000","last_undegraded":"2023-08-17T17:34:23.197495+0000","last_fullsized":"2023-08-17T17:34:23.197495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555082+0000","last_change":"2023-08-17T17:34:23.555082+0000","last_active":"2023-08-17T17:34:23.555082+0000","last_peered":"2023-08-17T17:34:23.555082+0000","last_clean":"2023-08-17T17:34:23.555082+0000","last_became_active":"2023-08-17T17:34:23.554787+0000","last_became_peered":"2023-08-17T17:34:23.554787+0000","last_unstale":"2023-08-17T17:34:23.555082+0000","last_undegraded":"2023-08-17T17:34:23.555082+0000","last_fullsized":"2023-08-17T17:34:23.555082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.190949+0000","last_change":"2023-08-17T17:34:23.186144+0000","last_active":"2023-08-17T17:34:23.190949+0000","last_peered":"2023-08-17T17:34:23.190949+0000","last_clean":"2023-08-17T17:34:23.190949+0000","last_became_active":"2023-08-17T17:34:23.185783+0000","last_became_peered":"2023-08-17T17:34:23.185783+0000","last_unstale":"2023-08-17T17:34:23.190949+0000","last_undegraded":"2023-08-17T17:34:23.190949+0000","last_fullsized":"2023-08-17T17:34:23.190949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556916+0000","last_change":"2023-08-17T17:34:23.556916+0000","last_active":"2023-08-17T17:34:23.556916+0000","last_peered":"2023-08-17T17:34:23.556916+0000","last_clean":"2023-08-17T17:34:23.556916+0000","last_became_active":"2023-08-17T17:34:23.556648+0000","last_became_peered":"2023-08-17T17:34:23.556648+0000","last_unstale":"2023-08-17T17:34:23.556916+0000","last_undegraded":"2023-08-17T17:34:23.556916+0000","last_fullsized":"2023-08-17T17:34:23.556916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195547+0000","last_change":"2023-08-17T17:34:23.186198+0000","last_active":"2023-08-17T17:34:23.195547+0000","last_peered":"2023-08-17T17:34:23.195547+0000","last_clean":"2023-08-17T17:34:23.195547+0000","last_became_active":"2023-08-17T17:34:23.185926+0000","last_became_peered":"2023-08-17T17:34:23.185926+0000","last_unstale":"2023-08-17T17:34:23.195547+0000","last_undegraded":"2023-08-17T17:34:23.195547+0000","last_fullsized":"2023-08-17T17:34:23.195547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.182041+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:34:23.182041+0000","last_peered":"2023-08-17T17:34:23.182041+0000","last_clean":"2023-08-17T17:34:23.182041+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:34:23.182041+0000","last_undegraded":"2023-08-17T17:34:23.182041+0000","last_fullsized":"2023-08-17T17:34:23.182041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537500+0000","last_change":"2023-08-17T17:34:23.184771+0000","last_active":"2023-08-17T17:34:23.537500+0000","last_peered":"2023-08-17T17:34:23.537500+0000","last_clean":"2023-08-17T17:34:23.537500+0000","last_became_active":"2023-08-17T17:34:23.184315+0000","last_became_peered":"2023-08-17T17:34:23.184315+0000","last_unstale":"2023-08-17T17:34:23.537500+0000","last_undegraded":"2023-08-17T17:34:23.537500+0000","last_fullsized":"2023-08-17T17:34:23.537500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.542863+0000","last_change":"2023-08-17T17:34:23.542863+0000","last_active":"2023-08-17T17:34:23.542863+0000","last_peered":"2023-08-17T17:34:23.542863+0000","last_clean":"2023-08-17T17:34:23.542863+0000","last_became_active":"2023-08-17T17:34:23.542602+0000","last_became_peered":"2023-08-17T17:34:23.542602+0000","last_unstale":"2023-08-17T17:34:23.542863+0000","last_undegraded":"2023-08-17T17:34:23.542863+0000","last_fullsized":"2023-08-17T17:34:23.542863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536939+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:34:23.536939+0000","last_peered":"2023-08-17T17:34:23.536939+0000","last_clean":"2023-08-17T17:34:23.536939+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:34:23.536939+0000","last_undegraded":"2023-08-17T17:34:23.536939+0000","last_fullsized":"2023-08-17T17:34:23.536939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193340+0000","last_change":"2023-08-17T17:34:23.187110+0000","last_active":"2023-08-17T17:34:23.193340+0000","last_peered":"2023-08-17T17:34:23.193340+0000","last_clean":"2023-08-17T17:34:23.193340+0000","last_became_active":"2023-08-17T17:34:23.186796+0000","last_became_peered":"2023-08-17T17:34:23.186796+0000","last_unstale":"2023-08-17T17:34:23.193340+0000","last_undegraded":"2023-08-17T17:34:23.193340+0000","last_fullsized":"2023-08-17T17:34:23.193340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.542382+0000","last_change":"2023-08-17T17:34:23.542382+0000","last_active":"2023-08-17T17:34:23.542382+0000","last_peered":"2023-08-17T17:34:23.542382+0000","last_clean":"2023-08-17T17:34:23.542382+0000","last_became_active":"2023-08-17T17:34:23.542108+0000","last_became_peered":"2023-08-17T17:34:23.542108+0000","last_unstale":"2023-08-17T17:34:23.542382+0000","last_undegraded":"2023-08-17T17:34:23.542382+0000","last_fullsized":"2023-08-17T17:34:23.542382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543037+0000","last_change":"2023-08-17T17:34:23.543037+0000","last_active":"2023-08-17T17:34:23.543037+0000","last_peered":"2023-08-17T17:34:23.543037+0000","last_clean":"2023-08-17T17:34:23.543037+0000","last_became_active":"2023-08-17T17:34:23.542776+0000","last_became_peered":"2023-08-17T17:34:23.542776+0000","last_unstale":"2023-08-17T17:34:23.543037+0000","last_undegraded":"2023-08-17T17:34:23.543037+0000","last_fullsized":"2023-08-17T17:34:23.543037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535248+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:34:23.535248+0000","last_peered":"2023-08-17T17:34:23.535248+0000","last_clean":"2023-08-17T17:34:23.535248+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:34:23.535248+0000","last_undegraded":"2023-08-17T17:34:23.535248+0000","last_fullsized":"2023-08-17T17:34:23.535248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193425+0000","last_change":"2023-08-17T17:34:23.189586+0000","last_active":"2023-08-17T17:34:23.193425+0000","last_peered":"2023-08-17T17:34:23.193425+0000","last_clean":"2023-08-17T17:34:23.193425+0000","last_became_active":"2023-08-17T17:34:23.189430+0000","last_became_peered":"2023-08-17T17:34:23.189430+0000","last_unstale":"2023-08-17T17:34:23.193425+0000","last_undegraded":"2023-08-17T17:34:23.193425+0000","last_fullsized":"2023-08-17T17:34:23.193425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553467+0000","last_change":"2023-08-17T17:34:23.553467+0000","last_active":"2023-08-17T17:34:23.553467+0000","last_peered":"2023-08-17T17:34:23.553467+0000","last_clean":"2023-08-17T17:34:23.553467+0000","last_became_active":"2023-08-17T17:34:23.553182+0000","last_became_peered":"2023-08-17T17:34:23.553182+0000","last_unstale":"2023-08-17T17:34:23.553467+0000","last_undegraded":"2023-08-17T17:34:23.553467+0000","last_fullsized":"2023-08-17T17:34:23.553467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537185+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:34:23.537185+0000","last_peered":"2023-08-17T17:34:23.537185+0000","last_clean":"2023-08-17T17:34:23.537185+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:34:23.537185+0000","last_undegraded":"2023-08-17T17:34:23.537185+0000","last_fullsized":"2023-08-17T17:34:23.537185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.178328+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:34:23.178328+0000","last_peered":"2023-08-17T17:34:23.178328+0000","last_clean":"2023-08-17T17:34:23.178328+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:34:23.178328+0000","last_undegraded":"2023-08-17T17:34:23.178328+0000","last_fullsized":"2023-08-17T17:34:23.178328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.185276+0000","last_change":"2023-08-17T17:34:23.182606+0000","last_active":"2023-08-17T17:34:23.185276+0000","last_peered":"2023-08-17T17:34:23.185276+0000","last_clean":"2023-08-17T17:34:23.185276+0000","last_became_active":"2023-08-17T17:34:23.182335+0000","last_became_peered":"2023-08-17T17:34:23.182335+0000","last_unstale":"2023-08-17T17:34:23.185276+0000","last_undegraded":"2023-08-17T17:34:23.185276+0000","last_fullsized":"2023-08-17T17:34:23.185276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547812+0000","last_change":"2023-08-17T17:34:23.547812+0000","last_active":"2023-08-17T17:34:23.547812+0000","last_peered":"2023-08-17T17:34:23.547812+0000","last_clean":"2023-08-17T17:34:23.547812+0000","last_became_active":"2023-08-17T17:34:23.547532+0000","last_became_peered":"2023-08-17T17:34:23.547532+0000","last_unstale":"2023-08-17T17:34:23.547812+0000","last_undegraded":"2023-08-17T17:34:23.547812+0000","last_fullsized":"2023-08-17T17:34:23.547812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.178366+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:34:23.178366+0000","last_peered":"2023-08-17T17:34:23.178366+0000","last_clean":"2023-08-17T17:34:23.178366+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:34:23.178366+0000","last_undegraded":"2023-08-17T17:34:23.178366+0000","last_fullsized":"2023-08-17T17:34:23.178366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195410+0000","last_change":"2023-08-17T17:34:23.187849+0000","last_active":"2023-08-17T17:34:23.195410+0000","last_peered":"2023-08-17T17:34:23.195410+0000","last_clean":"2023-08-17T17:34:23.195410+0000","last_became_active":"2023-08-17T17:34:23.187578+0000","last_became_peered":"2023-08-17T17:34:23.187578+0000","last_unstale":"2023-08-17T17:34:23.195410+0000","last_undegraded":"2023-08-17T17:34:23.195410+0000","last_fullsized":"2023-08-17T17:34:23.195410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.179921+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:34:23.179921+0000","last_peered":"2023-08-17T17:34:23.179921+0000","last_clean":"2023-08-17T17:34:23.179921+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:34:23.179921+0000","last_undegraded":"2023-08-17T17:34:23.179921+0000","last_fullsized":"2023-08-17T17:34:23.179921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199149+0000","last_change":"2023-08-17T17:34:23.191992+0000","last_active":"2023-08-17T17:34:23.199149+0000","last_peered":"2023-08-17T17:34:23.199149+0000","last_clean":"2023-08-17T17:34:23.199149+0000","last_became_active":"2023-08-17T17:34:23.191711+0000","last_became_peered":"2023-08-17T17:34:23.191711+0000","last_unstale":"2023-08-17T17:34:23.199149+0000","last_undegraded":"2023-08-17T17:34:23.199149+0000","last_fullsized":"2023-08-17T17:34:23.199149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541695+0000","last_change":"2023-08-17T17:34:23.541695+0000","last_active":"2023-08-17T17:34:23.541695+0000","last_peered":"2023-08-17T17:34:23.541695+0000","last_clean":"2023-08-17T17:34:23.541695+0000","last_became_active":"2023-08-17T17:34:23.541430+0000","last_became_peered":"2023-08-17T17:34:23.541430+0000","last_unstale":"2023-08-17T17:34:23.541695+0000","last_undegraded":"2023-08-17T17:34:23.541695+0000","last_fullsized":"2023-08-17T17:34:23.541695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561244+0000","last_change":"2023-08-17T17:34:23.188530+0000","last_active":"2023-08-17T17:34:23.561244+0000","last_peered":"2023-08-17T17:34:23.561244+0000","last_clean":"2023-08-17T17:34:23.561244+0000","last_became_active":"2023-08-17T17:34:23.188237+0000","last_became_peered":"2023-08-17T17:34:23.188237+0000","last_unstale":"2023-08-17T17:34:23.561244+0000","last_undegraded":"2023-08-17T17:34:23.561244+0000","last_fullsized":"2023-08-17T17:34:23.561244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.179737+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:34:23.179737+0000","last_peered":"2023-08-17T17:34:23.179737+0000","last_clean":"2023-08-17T17:34:23.179737+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:34:23.179737+0000","last_undegraded":"2023-08-17T17:34:23.179737+0000","last_fullsized":"2023-08-17T17:34:23.179737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557366+0000","last_change":"2023-08-17T17:34:23.557366+0000","last_active":"2023-08-17T17:34:23.557366+0000","last_peered":"2023-08-17T17:34:23.557366+0000","last_clean":"2023-08-17T17:34:23.557366+0000","last_became_active":"2023-08-17T17:34:23.555195+0000","last_became_peered":"2023-08-17T17:34:23.555195+0000","last_unstale":"2023-08-17T17:34:23.557366+0000","last_undegraded":"2023-08-17T17:34:23.557366+0000","last_fullsized":"2023-08-17T17:34:23.557366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.182581+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:34:23.182581+0000","last_peered":"2023-08-17T17:34:23.182581+0000","last_clean":"2023-08-17T17:34:23.182581+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:34:23.182581+0000","last_undegraded":"2023-08-17T17:34:23.182581+0000","last_fullsized":"2023-08-17T17:34:23.182581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.196081+0000","last_change":"2023-08-17T17:34:23.191591+0000","last_active":"2023-08-17T17:34:23.196081+0000","last_peered":"2023-08-17T17:34:23.196081+0000","last_clean":"2023-08-17T17:34:23.196081+0000","last_became_active":"2023-08-17T17:34:23.190831+0000","last_became_peered":"2023-08-17T17:34:23.190831+0000","last_unstale":"2023-08-17T17:34:23.196081+0000","last_undegraded":"2023-08-17T17:34:23.196081+0000","last_fullsized":"2023-08-17T17:34:23.196081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.542994+0000","last_change":"2023-08-17T17:34:23.542994+0000","last_active":"2023-08-17T17:34:23.542994+0000","last_peered":"2023-08-17T17:34:23.542994+0000","last_clean":"2023-08-17T17:34:23.542994+0000","last_became_active":"2023-08-17T17:34:23.542731+0000","last_became_peered":"2023-08-17T17:34:23.542731+0000","last_unstale":"2023-08-17T17:34:23.542994+0000","last_undegraded":"2023-08-17T17:34:23.542994+0000","last_fullsized":"2023-08-17T17:34:23.542994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550786+0000","last_change":"2023-08-17T17:34:23.547644+0000","last_active":"2023-08-17T17:34:23.550786+0000","last_peered":"2023-08-17T17:34:23.550786+0000","last_clean":"2023-08-17T17:34:23.550786+0000","last_became_active":"2023-08-17T17:34:23.547383+0000","last_became_peered":"2023-08-17T17:34:23.547383+0000","last_unstale":"2023-08-17T17:34:23.550786+0000","last_undegraded":"2023-08-17T17:34:23.550786+0000","last_fullsized":"2023-08-17T17:34:23.550786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195756+0000","last_change":"2023-08-17T17:34:23.190255+0000","last_active":"2023-08-17T17:34:23.195756+0000","last_peered":"2023-08-17T17:34:23.195756+0000","last_clean":"2023-08-17T17:34:23.195756+0000","last_became_active":"2023-08-17T17:34:23.189984+0000","last_became_peered":"2023-08-17T17:34:23.189984+0000","last_unstale":"2023-08-17T17:34:23.195756+0000","last_undegraded":"2023-08-17T17:34:23.195756+0000","last_fullsized":"2023-08-17T17:34:23.195756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552719+0000","last_change":"2023-08-17T17:34:23.552719+0000","last_active":"2023-08-17T17:34:23.552719+0000","last_peered":"2023-08-17T17:34:23.552719+0000","last_clean":"2023-08-17T17:34:23.552719+0000","last_became_active":"2023-08-17T17:34:23.552438+0000","last_became_peered":"2023-08-17T17:34:23.552438+0000","last_unstale":"2023-08-17T17:34:23.552719+0000","last_undegraded":"2023-08-17T17:34:23.552719+0000","last_fullsized":"2023-08-17T17:34:23.552719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537344+0000","last_change":"2023-08-17T17:34:23.190817+0000","last_active":"2023-08-17T17:34:23.537344+0000","last_peered":"2023-08-17T17:34:23.537344+0000","last_clean":"2023-08-17T17:34:23.537344+0000","last_became_active":"2023-08-17T17:34:23.190559+0000","last_became_peered":"2023-08-17T17:34:23.190559+0000","last_unstale":"2023-08-17T17:34:23.537344+0000","last_undegraded":"2023-08-17T17:34:23.537344+0000","last_fullsized":"2023-08-17T17:34:23.537344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553414+0000","last_change":"2023-08-17T17:34:23.553414+0000","last_active":"2023-08-17T17:34:23.553414+0000","last_peered":"2023-08-17T17:34:23.553414+0000","last_clean":"2023-08-17T17:34:23.553414+0000","last_became_active":"2023-08-17T17:34:23.552895+0000","last_became_peered":"2023-08-17T17:34:23.552895+0000","last_unstale":"2023-08-17T17:34:23.553414+0000","last_undegraded":"2023-08-17T17:34:23.553414+0000","last_fullsized":"2023-08-17T17:34:23.553414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553204+0000","last_change":"2023-08-17T17:34:23.190779+0000","last_active":"2023-08-17T17:34:23.553204+0000","last_peered":"2023-08-17T17:34:23.553204+0000","last_clean":"2023-08-17T17:34:23.553204+0000","last_became_active":"2023-08-17T17:34:23.190512+0000","last_became_peered":"2023-08-17T17:34:23.190512+0000","last_unstale":"2023-08-17T17:34:23.553204+0000","last_undegraded":"2023-08-17T17:34:23.553204+0000","last_fullsized":"2023-08-17T17:34:23.553204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.549278+0000","last_change":"2023-08-17T17:34:23.549278+0000","last_active":"2023-08-17T17:34:23.549278+0000","last_peered":"2023-08-17T17:34:23.549278+0000","last_clean":"2023-08-17T17:34:23.549278+0000","last_became_active":"2023-08-17T17:34:23.548986+0000","last_became_peered":"2023-08-17T17:34:23.548986+0000","last_unstale":"2023-08-17T17:34:23.549278+0000","last_undegraded":"2023-08-17T17:34:23.549278+0000","last_fullsized":"2023-08-17T17:34:23.549278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551680+0000","last_change":"2023-08-17T17:34:23.186530+0000","last_active":"2023-08-17T17:34:23.551680+0000","last_peered":"2023-08-17T17:34:23.551680+0000","last_clean":"2023-08-17T17:34:23.551680+0000","last_became_active":"2023-08-17T17:34:23.186269+0000","last_became_peered":"2023-08-17T17:34:23.186269+0000","last_unstale":"2023-08-17T17:34:23.551680+0000","last_undegraded":"2023-08-17T17:34:23.551680+0000","last_fullsized":"2023-08-17T17:34:23.551680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.549760+0000","last_change":"2023-08-17T17:34:23.549760+0000","last_active":"2023-08-17T17:34:23.549760+0000","last_peered":"2023-08-17T17:34:23.549760+0000","last_clean":"2023-08-17T17:34:23.549760+0000","last_became_active":"2023-08-17T17:34:23.549485+0000","last_became_peered":"2023-08-17T17:34:23.549485+0000","last_unstale":"2023-08-17T17:34:23.549760+0000","last_undegraded":"2023-08-17T17:34:23.549760+0000","last_fullsized":"2023-08-17T17:34:23.549760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538201+0000","last_change":"2023-08-17T17:34:23.185767+0000","last_active":"2023-08-17T17:34:23.538201+0000","last_peered":"2023-08-17T17:34:23.538201+0000","last_clean":"2023-08-17T17:34:23.538201+0000","last_became_active":"2023-08-17T17:34:23.185523+0000","last_became_peered":"2023-08-17T17:34:23.185523+0000","last_unstale":"2023-08-17T17:34:23.538201+0000","last_undegraded":"2023-08-17T17:34:23.538201+0000","last_fullsized":"2023-08-17T17:34:23.538201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550201+0000","last_change":"2023-08-17T17:34:23.550201+0000","last_active":"2023-08-17T17:34:23.550201+0000","last_peered":"2023-08-17T17:34:23.550201+0000","last_clean":"2023-08-17T17:34:23.550201+0000","last_became_active":"2023-08-17T17:34:23.550017+0000","last_became_peered":"2023-08-17T17:34:23.550017+0000","last_unstale":"2023-08-17T17:34:23.550201+0000","last_undegraded":"2023-08-17T17:34:23.550201+0000","last_fullsized":"2023-08-17T17:34:23.550201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.190798+0000","last_change":"2023-08-17T17:34:23.184375+0000","last_active":"2023-08-17T17:34:23.190798+0000","last_peered":"2023-08-17T17:34:23.190798+0000","last_clean":"2023-08-17T17:34:23.190798+0000","last_became_active":"2023-08-17T17:34:23.184095+0000","last_became_peered":"2023-08-17T17:34:23.184095+0000","last_unstale":"2023-08-17T17:34:23.190798+0000","last_undegraded":"2023-08-17T17:34:23.190798+0000","last_fullsized":"2023-08-17T17:34:23.190798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.544840+0000","last_change":"2023-08-17T17:34:23.544840+0000","last_active":"2023-08-17T17:34:23.544840+0000","last_peered":"2023-08-17T17:34:23.544840+0000","last_clean":"2023-08-17T17:34:23.544840+0000","last_became_active":"2023-08-17T17:34:23.544381+0000","last_became_peered":"2023-08-17T17:34:23.544381+0000","last_unstale":"2023-08-17T17:34:23.544840+0000","last_undegraded":"2023-08-17T17:34:23.544840+0000","last_fullsized":"2023-08-17T17:34:23.544840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535353+0000","last_change":"2023-08-17T17:34:23.181210+0000","last_active":"2023-08-17T17:34:23.535353+0000","last_peered":"2023-08-17T17:34:23.535353+0000","last_clean":"2023-08-17T17:34:23.535353+0000","last_became_active":"2023-08-17T17:34:23.180969+0000","last_became_peered":"2023-08-17T17:34:23.180969+0000","last_unstale":"2023-08-17T17:34:23.535353+0000","last_undegraded":"2023-08-17T17:34:23.535353+0000","last_fullsized":"2023-08-17T17:34:23.535353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550540+0000","last_change":"2023-08-17T17:34:23.548247+0000","last_active":"2023-08-17T17:34:23.550540+0000","last_peered":"2023-08-17T17:34:23.550540+0000","last_clean":"2023-08-17T17:34:23.550540+0000","last_became_active":"2023-08-17T17:34:23.547379+0000","last_became_peered":"2023-08-17T17:34:23.547379+0000","last_unstale":"2023-08-17T17:34:23.550540+0000","last_undegraded":"2023-08-17T17:34:23.550540+0000","last_fullsized":"2023-08-17T17:34:23.550540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536842+0000","last_change":"2023-08-17T17:34:23.185419+0000","last_active":"2023-08-17T17:34:23.536842+0000","last_peered":"2023-08-17T17:34:23.536842+0000","last_clean":"2023-08-17T17:34:23.536842+0000","last_became_active":"2023-08-17T17:34:23.184865+0000","last_became_peered":"2023-08-17T17:34:23.184865+0000","last_unstale":"2023-08-17T17:34:23.536842+0000","last_undegraded":"2023-08-17T17:34:23.536842+0000","last_fullsized":"2023-08-17T17:34:23.536842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.544643+0000","last_change":"2023-08-17T17:34:23.544643+0000","last_active":"2023-08-17T17:34:23.544643+0000","last_peered":"2023-08-17T17:34:23.544643+0000","last_clean":"2023-08-17T17:34:23.544643+0000","last_became_active":"2023-08-17T17:34:23.544406+0000","last_became_peered":"2023-08-17T17:34:23.544406+0000","last_unstale":"2023-08-17T17:34:23.544643+0000","last_undegraded":"2023-08-17T17:34:23.544643+0000","last_fullsized":"2023-08-17T17:34:23.544643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193494+0000","last_change":"2023-08-17T17:34:23.186776+0000","last_active":"2023-08-17T17:34:23.193494+0000","last_peered":"2023-08-17T17:34:23.193494+0000","last_clean":"2023-08-17T17:34:23.193494+0000","last_became_active":"2023-08-17T17:34:23.186521+0000","last_became_peered":"2023-08-17T17:34:23.186521+0000","last_unstale":"2023-08-17T17:34:23.193494+0000","last_undegraded":"2023-08-17T17:34:23.193494+0000","last_fullsized":"2023-08-17T17:34:23.193494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.560630+0000","last_change":"2023-08-17T17:34:23.560630+0000","last_active":"2023-08-17T17:34:23.560630+0000","last_peered":"2023-08-17T17:34:23.560630+0000","last_clean":"2023-08-17T17:34:23.560630+0000","last_became_active":"2023-08-17T17:34:23.560282+0000","last_became_peered":"2023-08-17T17:34:23.560282+0000","last_unstale":"2023-08-17T17:34:23.560630+0000","last_undegraded":"2023-08-17T17:34:23.560630+0000","last_fullsized":"2023-08-17T17:34:23.560630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199023+0000","last_change":"2023-08-17T17:34:23.191397+0000","last_active":"2023-08-17T17:34:23.199023+0000","last_peered":"2023-08-17T17:34:23.199023+0000","last_clean":"2023-08-17T17:34:23.199023+0000","last_became_active":"2023-08-17T17:34:23.191058+0000","last_became_peered":"2023-08-17T17:34:23.191058+0000","last_unstale":"2023-08-17T17:34:23.199023+0000","last_undegraded":"2023-08-17T17:34:23.199023+0000","last_fullsized":"2023-08-17T17:34:23.199023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553590+0000","last_change":"2023-08-17T17:34:23.553590+0000","last_active":"2023-08-17T17:34:23.553590+0000","last_peered":"2023-08-17T17:34:23.553590+0000","last_clean":"2023-08-17T17:34:23.553590+0000","last_became_active":"2023-08-17T17:34:23.552092+0000","last_became_peered":"2023-08-17T17:34:23.552092+0000","last_unstale":"2023-08-17T17:34:23.553590+0000","last_undegraded":"2023-08-17T17:34:23.553590+0000","last_fullsized":"2023-08-17T17:34:23.553590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199058+0000","last_change":"2023-08-17T17:34:23.191260+0000","last_active":"2023-08-17T17:34:23.199058+0000","last_peered":"2023-08-17T17:34:23.199058+0000","last_clean":"2023-08-17T17:34:23.199058+0000","last_became_active":"2023-08-17T17:34:23.190994+0000","last_became_peered":"2023-08-17T17:34:23.190994+0000","last_unstale":"2023-08-17T17:34:23.199058+0000","last_undegraded":"2023-08-17T17:34:23.199058+0000","last_fullsized":"2023-08-17T17:34:23.199058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556967+0000","last_change":"2023-08-17T17:34:23.556967+0000","last_active":"2023-08-17T17:34:23.556967+0000","last_peered":"2023-08-17T17:34:23.556967+0000","last_clean":"2023-08-17T17:34:23.556967+0000","last_became_active":"2023-08-17T17:34:23.556712+0000","last_became_peered":"2023-08-17T17:34:23.556712+0000","last_unstale":"2023-08-17T17:34:23.556967+0000","last_undegraded":"2023-08-17T17:34:23.556967+0000","last_fullsized":"2023-08-17T17:34:23.556967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193265+0000","last_change":"2023-08-17T17:34:23.189238+0000","last_active":"2023-08-17T17:34:23.193265+0000","last_peered":"2023-08-17T17:34:23.193265+0000","last_clean":"2023-08-17T17:34:23.193265+0000","last_became_active":"2023-08-17T17:34:23.188964+0000","last_became_peered":"2023-08-17T17:34:23.188964+0000","last_unstale":"2023-08-17T17:34:23.193265+0000","last_undegraded":"2023-08-17T17:34:23.193265+0000","last_fullsized":"2023-08-17T17:34:23.193265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.549243+0000","last_change":"2023-08-17T17:34:23.549243+0000","last_active":"2023-08-17T17:34:23.549243+0000","last_peered":"2023-08-17T17:34:23.549243+0000","last_clean":"2023-08-17T17:34:23.549243+0000","last_became_active":"2023-08-17T17:34:23.548966+0000","last_became_peered":"2023-08-17T17:34:23.548966+0000","last_unstale":"2023-08-17T17:34:23.549243+0000","last_undegraded":"2023-08-17T17:34:23.549243+0000","last_fullsized":"2023-08-17T17:34:23.549243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195835+0000","last_change":"2023-08-17T17:34:23.189039+0000","last_active":"2023-08-17T17:34:23.195835+0000","last_peered":"2023-08-17T17:34:23.195835+0000","last_clean":"2023-08-17T17:34:23.195835+0000","last_became_active":"2023-08-17T17:34:23.188785+0000","last_became_peered":"2023-08-17T17:34:23.188785+0000","last_unstale":"2023-08-17T17:34:23.195835+0000","last_undegraded":"2023-08-17T17:34:23.195835+0000","last_fullsized":"2023-08-17T17:34:23.195835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555845+0000","last_change":"2023-08-17T17:34:23.555845+0000","last_active":"2023-08-17T17:34:23.555845+0000","last_peered":"2023-08-17T17:34:23.555845+0000","last_clean":"2023-08-17T17:34:23.555845+0000","last_became_active":"2023-08-17T17:34:23.555604+0000","last_became_peered":"2023-08-17T17:34:23.555604+0000","last_unstale":"2023-08-17T17:34:23.555845+0000","last_undegraded":"2023-08-17T17:34:23.555845+0000","last_fullsized":"2023-08-17T17:34:23.555845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538052+0000","last_change":"2023-08-17T17:34:23.187717+0000","last_active":"2023-08-17T17:34:23.538052+0000","last_peered":"2023-08-17T17:34:23.538052+0000","last_clean":"2023-08-17T17:34:23.538052+0000","last_became_active":"2023-08-17T17:34:23.184648+0000","last_became_peered":"2023-08-17T17:34:23.184648+0000","last_unstale":"2023-08-17T17:34:23.538052+0000","last_undegraded":"2023-08-17T17:34:23.538052+0000","last_fullsized":"2023-08-17T17:34:23.538052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552413+0000","last_change":"2023-08-17T17:34:23.552413+0000","last_active":"2023-08-17T17:34:23.552413+0000","last_peered":"2023-08-17T17:34:23.552413+0000","last_clean":"2023-08-17T17:34:23.552413+0000","last_became_active":"2023-08-17T17:34:23.552087+0000","last_became_peered":"2023-08-17T17:34:23.552087+0000","last_unstale":"2023-08-17T17:34:23.552413+0000","last_undegraded":"2023-08-17T17:34:23.552413+0000","last_fullsized":"2023-08-17T17:34:23.552413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195839+0000","last_change":"2023-08-17T17:34:23.189135+0000","last_active":"2023-08-17T17:34:23.195839+0000","last_peered":"2023-08-17T17:34:23.195839+0000","last_clean":"2023-08-17T17:34:23.195839+0000","last_became_active":"2023-08-17T17:34:23.188880+0000","last_became_peered":"2023-08-17T17:34:23.188880+0000","last_unstale":"2023-08-17T17:34:23.195839+0000","last_undegraded":"2023-08-17T17:34:23.195839+0000","last_fullsized":"2023-08-17T17:34:23.195839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551405+0000","last_change":"2023-08-17T17:34:23.549370+0000","last_active":"2023-08-17T17:34:23.551405+0000","last_peered":"2023-08-17T17:34:23.551405+0000","last_clean":"2023-08-17T17:34:23.551405+0000","last_became_active":"2023-08-17T17:34:23.549106+0000","last_became_peered":"2023-08-17T17:34:23.549106+0000","last_unstale":"2023-08-17T17:34:23.551405+0000","last_undegraded":"2023-08-17T17:34:23.551405+0000","last_fullsized":"2023-08-17T17:34:23.551405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537049+0000","last_change":"2023-08-17T17:34:23.188935+0000","last_active":"2023-08-17T17:34:23.537049+0000","last_peered":"2023-08-17T17:34:23.537049+0000","last_clean":"2023-08-17T17:34:23.537049+0000","last_became_active":"2023-08-17T17:34:23.188377+0000","last_became_peered":"2023-08-17T17:34:23.188377+0000","last_unstale":"2023-08-17T17:34:23.537049+0000","last_undegraded":"2023-08-17T17:34:23.537049+0000","last_fullsized":"2023-08-17T17:34:23.537049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555082+0000","last_change":"2023-08-17T17:34:23.555082+0000","last_active":"2023-08-17T17:34:23.555082+0000","last_peered":"2023-08-17T17:34:23.555082+0000","last_clean":"2023-08-17T17:34:23.555082+0000","last_became_active":"2023-08-17T17:34:23.554814+0000","last_became_peered":"2023-08-17T17:34:23.554814+0000","last_unstale":"2023-08-17T17:34:23.555082+0000","last_undegraded":"2023-08-17T17:34:23.555082+0000","last_fullsized":"2023-08-17T17:34:23.555082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536557+0000","last_change":"2023-08-17T17:34:23.190120+0000","last_active":"2023-08-17T17:34:23.536557+0000","last_peered":"2023-08-17T17:34:23.536557+0000","last_clean":"2023-08-17T17:34:23.536557+0000","last_became_active":"2023-08-17T17:34:23.189569+0000","last_became_peered":"2023-08-17T17:34:23.189569+0000","last_unstale":"2023-08-17T17:34:23.536557+0000","last_undegraded":"2023-08-17T17:34:23.536557+0000","last_fullsized":"2023-08-17T17:34:23.536557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561106+0000","last_change":"2023-08-17T17:34:23.561106+0000","last_active":"2023-08-17T17:34:23.561106+0000","last_peered":"2023-08-17T17:34:23.561106+0000","last_clean":"2023-08-17T17:34:23.561106+0000","last_became_active":"2023-08-17T17:34:23.560898+0000","last_became_peered":"2023-08-17T17:34:23.560898+0000","last_unstale":"2023-08-17T17:34:23.561106+0000","last_undegraded":"2023-08-17T17:34:23.561106+0000","last_fullsized":"2023-08-17T17:34:23.561106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198889+0000","last_change":"2023-08-17T17:34:23.198065+0000","last_active":"2023-08-17T17:34:23.198889+0000","last_peered":"2023-08-17T17:34:23.198889+0000","last_clean":"2023-08-17T17:34:23.198889+0000","last_became_active":"2023-08-17T17:34:23.197731+0000","last_became_peered":"2023-08-17T17:34:23.197731+0000","last_unstale":"2023-08-17T17:34:23.198889+0000","last_undegraded":"2023-08-17T17:34:23.198889+0000","last_fullsized":"2023-08-17T17:34:23.198889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547875+0000","last_change":"2023-08-17T17:34:23.547875+0000","last_active":"2023-08-17T17:34:23.547875+0000","last_peered":"2023-08-17T17:34:23.547875+0000","last_clean":"2023-08-17T17:34:23.547875+0000","last_became_active":"2023-08-17T17:34:23.547593+0000","last_became_peered":"2023-08-17T17:34:23.547593+0000","last_unstale":"2023-08-17T17:34:23.547875+0000","last_undegraded":"2023-08-17T17:34:23.547875+0000","last_fullsized":"2023-08-17T17:34:23.547875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541748+0000","last_change":"2023-08-17T17:34:23.190210+0000","last_active":"2023-08-17T17:34:23.541748+0000","last_peered":"2023-08-17T17:34:23.541748+0000","last_clean":"2023-08-17T17:34:23.541748+0000","last_became_active":"2023-08-17T17:34:23.189745+0000","last_became_peered":"2023-08-17T17:34:23.189745+0000","last_unstale":"2023-08-17T17:34:23.541748+0000","last_undegraded":"2023-08-17T17:34:23.541748+0000","last_fullsized":"2023-08-17T17:34:23.541748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555242+0000","last_change":"2023-08-17T17:34:23.555242+0000","last_active":"2023-08-17T17:34:23.555242+0000","last_peered":"2023-08-17T17:34:23.555242+0000","last_clean":"2023-08-17T17:34:23.555242+0000","last_became_active":"2023-08-17T17:34:23.554975+0000","last_became_peered":"2023-08-17T17:34:23.554975+0000","last_unstale":"2023-08-17T17:34:23.555242+0000","last_undegraded":"2023-08-17T17:34:23.555242+0000","last_fullsized":"2023-08-17T17:34:23.555242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535659+0000","last_change":"2023-08-17T17:34:23.186514+0000","last_active":"2023-08-17T17:34:23.535659+0000","last_peered":"2023-08-17T17:34:23.535659+0000","last_clean":"2023-08-17T17:34:23.535659+0000","last_became_active":"2023-08-17T17:34:23.186237+0000","last_became_peered":"2023-08-17T17:34:23.186237+0000","last_unstale":"2023-08-17T17:34:23.535659+0000","last_undegraded":"2023-08-17T17:34:23.535659+0000","last_fullsized":"2023-08-17T17:34:23.535659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556160+0000","last_change":"2023-08-17T17:34:23.556160+0000","last_active":"2023-08-17T17:34:23.556160+0000","last_peered":"2023-08-17T17:34:23.556160+0000","last_clean":"2023-08-17T17:34:23.556160+0000","last_became_active":"2023-08-17T17:34:23.555906+0000","last_became_peered":"2023-08-17T17:34:23.555906+0000","last_unstale":"2023-08-17T17:34:23.556160+0000","last_undegraded":"2023-08-17T17:34:23.556160+0000","last_fullsized":"2023-08-17T17:34:23.556160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537668+0000","last_change":"2023-08-17T17:34:23.188736+0000","last_active":"2023-08-17T17:34:23.537668+0000","last_peered":"2023-08-17T17:34:23.537668+0000","last_clean":"2023-08-17T17:34:23.537668+0000","last_became_active":"2023-08-17T17:34:23.188463+0000","last_became_peered":"2023-08-17T17:34:23.188463+0000","last_unstale":"2023-08-17T17:34:23.537668+0000","last_undegraded":"2023-08-17T17:34:23.537668+0000","last_fullsized":"2023-08-17T17:34:23.537668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556037+0000","last_change":"2023-08-17T17:34:23.556037+0000","last_active":"2023-08-17T17:34:23.556037+0000","last_peered":"2023-08-17T17:34:23.556037+0000","last_clean":"2023-08-17T17:34:23.556037+0000","last_became_active":"2023-08-17T17:34:23.555773+0000","last_became_peered":"2023-08-17T17:34:23.555773+0000","last_unstale":"2023-08-17T17:34:23.556037+0000","last_undegraded":"2023-08-17T17:34:23.556037+0000","last_fullsized":"2023-08-17T17:34:23.556037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555701+0000","last_change":"2023-08-17T17:34:23.182339+0000","last_active":"2023-08-17T17:34:23.555701+0000","last_peered":"2023-08-17T17:34:23.555701+0000","last_clean":"2023-08-17T17:34:23.555701+0000","last_became_active":"2023-08-17T17:34:23.182072+0000","last_became_peered":"2023-08-17T17:34:23.182072+0000","last_unstale":"2023-08-17T17:34:23.555701+0000","last_undegraded":"2023-08-17T17:34:23.555701+0000","last_fullsized":"2023-08-17T17:34:23.555701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547106+0000","last_change":"2023-08-17T17:34:23.540248+0000","last_active":"2023-08-17T17:34:23.547106+0000","last_peered":"2023-08-17T17:34:23.547106+0000","last_clean":"2023-08-17T17:34:23.547106+0000","last_became_active":"2023-08-17T17:34:23.539612+0000","last_became_peered":"2023-08-17T17:34:23.539612+0000","last_unstale":"2023-08-17T17:34:23.547106+0000","last_undegraded":"2023-08-17T17:34:23.547106+0000","last_fullsized":"2023-08-17T17:34:23.547106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.199100+0000","last_change":"2023-08-17T17:34:23.191957+0000","last_active":"2023-08-17T17:34:23.199100+0000","last_peered":"2023-08-17T17:34:23.199100+0000","last_clean":"2023-08-17T17:34:23.199100+0000","last_became_active":"2023-08-17T17:34:23.191666+0000","last_became_peered":"2023-08-17T17:34:23.191666+0000","last_unstale":"2023-08-17T17:34:23.199100+0000","last_undegraded":"2023-08-17T17:34:23.199100+0000","last_fullsized":"2023-08-17T17:34:23.199100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553646+0000","last_change":"2023-08-17T17:34:23.553646+0000","last_active":"2023-08-17T17:34:23.553646+0000","last_peered":"2023-08-17T17:34:23.553646+0000","last_clean":"2023-08-17T17:34:23.553646+0000","last_became_active":"2023-08-17T17:34:23.553378+0000","last_became_peered":"2023-08-17T17:34:23.553378+0000","last_unstale":"2023-08-17T17:34:23.553646+0000","last_undegraded":"2023-08-17T17:34:23.553646+0000","last_fullsized":"2023-08-17T17:34:23.553646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.196120+0000","last_change":"2023-08-17T17:34:23.191017+0000","last_active":"2023-08-17T17:34:23.196120+0000","last_peered":"2023-08-17T17:34:23.196120+0000","last_clean":"2023-08-17T17:34:23.196120+0000","last_became_active":"2023-08-17T17:34:23.190761+0000","last_became_peered":"2023-08-17T17:34:23.190761+0000","last_unstale":"2023-08-17T17:34:23.196120+0000","last_undegraded":"2023-08-17T17:34:23.196120+0000","last_fullsized":"2023-08-17T17:34:23.196120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556028+0000","last_change":"2023-08-17T17:34:23.552814+0000","last_active":"2023-08-17T17:34:23.556028+0000","last_peered":"2023-08-17T17:34:23.556028+0000","last_clean":"2023-08-17T17:34:23.556028+0000","last_became_active":"2023-08-17T17:34:23.552549+0000","last_became_peered":"2023-08-17T17:34:23.552549+0000","last_unstale":"2023-08-17T17:34:23.556028+0000","last_undegraded":"2023-08-17T17:34:23.556028+0000","last_fullsized":"2023-08-17T17:34:23.556028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553788+0000","last_change":"2023-08-17T17:34:23.184359+0000","last_active":"2023-08-17T17:34:23.553788+0000","last_peered":"2023-08-17T17:34:23.553788+0000","last_clean":"2023-08-17T17:34:23.553788+0000","last_became_active":"2023-08-17T17:34:23.183723+0000","last_became_peered":"2023-08-17T17:34:23.183723+0000","last_unstale":"2023-08-17T17:34:23.553788+0000","last_undegraded":"2023-08-17T17:34:23.553788+0000","last_fullsized":"2023-08-17T17:34:23.553788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555985+0000","last_change":"2023-08-17T17:34:23.551730+0000","last_active":"2023-08-17T17:34:23.555985+0000","last_peered":"2023-08-17T17:34:23.555985+0000","last_clean":"2023-08-17T17:34:23.555985+0000","last_became_active":"2023-08-17T17:34:23.551463+0000","last_became_peered":"2023-08-17T17:34:23.551463+0000","last_unstale":"2023-08-17T17:34:23.555985+0000","last_undegraded":"2023-08-17T17:34:23.555985+0000","last_fullsized":"2023-08-17T17:34:23.555985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556856+0000","last_change":"2023-08-17T17:34:23.189962+0000","last_active":"2023-08-17T17:34:23.556856+0000","last_peered":"2023-08-17T17:34:23.556856+0000","last_clean":"2023-08-17T17:34:23.556856+0000","last_became_active":"2023-08-17T17:34:23.189247+0000","last_became_peered":"2023-08-17T17:34:23.189247+0000","last_unstale":"2023-08-17T17:34:23.556856+0000","last_undegraded":"2023-08-17T17:34:23.556856+0000","last_fullsized":"2023-08-17T17:34:23.556856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547521+0000","last_change":"2023-08-17T17:34:23.542831+0000","last_active":"2023-08-17T17:34:23.547521+0000","last_peered":"2023-08-17T17:34:23.547521+0000","last_clean":"2023-08-17T17:34:23.547521+0000","last_became_active":"2023-08-17T17:34:23.542564+0000","last_became_peered":"2023-08-17T17:34:23.542564+0000","last_unstale":"2023-08-17T17:34:23.547521+0000","last_undegraded":"2023-08-17T17:34:23.547521+0000","last_fullsized":"2023-08-17T17:34:23.547521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198338+0000","last_change":"2023-08-17T17:34:23.193784+0000","last_active":"2023-08-17T17:34:23.198338+0000","last_peered":"2023-08-17T17:34:23.198338+0000","last_clean":"2023-08-17T17:34:23.198338+0000","last_became_active":"2023-08-17T17:34:23.193515+0000","last_became_peered":"2023-08-17T17:34:23.193515+0000","last_unstale":"2023-08-17T17:34:23.198338+0000","last_undegraded":"2023-08-17T17:34:23.198338+0000","last_fullsized":"2023-08-17T17:34:23.198338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.559293+0000","last_change":"2023-08-17T17:34:23.559293+0000","last_active":"2023-08-17T17:34:23.559293+0000","last_peered":"2023-08-17T17:34:23.559293+0000","last_clean":"2023-08-17T17:34:23.559293+0000","last_became_active":"2023-08-17T17:34:23.559072+0000","last_became_peered":"2023-08-17T17:34:23.559072+0000","last_unstale":"2023-08-17T17:34:23.559293+0000","last_undegraded":"2023-08-17T17:34:23.559293+0000","last_fullsized":"2023-08-17T17:34:23.559293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.197608+0000","last_change":"2023-08-17T17:34:23.191570+0000","last_active":"2023-08-17T17:34:23.197608+0000","last_peered":"2023-08-17T17:34:23.197608+0000","last_clean":"2023-08-17T17:34:23.197608+0000","last_became_active":"2023-08-17T17:34:23.191127+0000","last_became_peered":"2023-08-17T17:34:23.191127+0000","last_unstale":"2023-08-17T17:34:23.197608+0000","last_undegraded":"2023-08-17T17:34:23.197608+0000","last_fullsized":"2023-08-17T17:34:23.197608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.548523+0000","last_change":"2023-08-17T17:34:23.548523+0000","last_active":"2023-08-17T17:34:23.548523+0000","last_peered":"2023-08-17T17:34:23.548523+0000","last_clean":"2023-08-17T17:34:23.548523+0000","last_became_active":"2023-08-17T17:34:23.548180+0000","last_became_peered":"2023-08-17T17:34:23.548180+0000","last_unstale":"2023-08-17T17:34:23.548523+0000","last_undegraded":"2023-08-17T17:34:23.548523+0000","last_fullsized":"2023-08-17T17:34:23.548523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198636+0000","last_change":"2023-08-17T17:34:23.193931+0000","last_active":"2023-08-17T17:34:23.198636+0000","last_peered":"2023-08-17T17:34:23.198636+0000","last_clean":"2023-08-17T17:34:23.198636+0000","last_became_active":"2023-08-17T17:34:23.193104+0000","last_became_peered":"2023-08-17T17:34:23.193104+0000","last_unstale":"2023-08-17T17:34:23.198636+0000","last_undegraded":"2023-08-17T17:34:23.198636+0000","last_fullsized":"2023-08-17T17:34:23.198636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555975+0000","last_change":"2023-08-17T17:34:23.551080+0000","last_active":"2023-08-17T17:34:23.555975+0000","last_peered":"2023-08-17T17:34:23.555975+0000","last_clean":"2023-08-17T17:34:23.555975+0000","last_became_active":"2023-08-17T17:34:23.550830+0000","last_became_peered":"2023-08-17T17:34:23.550830+0000","last_unstale":"2023-08-17T17:34:23.555975+0000","last_undegraded":"2023-08-17T17:34:23.555975+0000","last_fullsized":"2023-08-17T17:34:23.555975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.185609+0000","last_change":"2023-08-17T17:34:23.182626+0000","last_active":"2023-08-17T17:34:23.185609+0000","last_peered":"2023-08-17T17:34:23.185609+0000","last_clean":"2023-08-17T17:34:23.185609+0000","last_became_active":"2023-08-17T17:34:23.182368+0000","last_became_peered":"2023-08-17T17:34:23.182368+0000","last_unstale":"2023-08-17T17:34:23.185609+0000","last_undegraded":"2023-08-17T17:34:23.185609+0000","last_fullsized":"2023-08-17T17:34:23.185609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547126+0000","last_change":"2023-08-17T17:34:23.540567+0000","last_active":"2023-08-17T17:34:23.547126+0000","last_peered":"2023-08-17T17:34:23.547126+0000","last_clean":"2023-08-17T17:34:23.547126+0000","last_became_active":"2023-08-17T17:34:23.539925+0000","last_became_peered":"2023-08-17T17:34:23.539925+0000","last_unstale":"2023-08-17T17:34:23.547126+0000","last_undegraded":"2023-08-17T17:34:23.547126+0000","last_fullsized":"2023-08-17T17:34:23.547126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.198753+0000","last_change":"2023-08-17T17:34:23.194479+0000","last_active":"2023-08-17T17:34:23.198753+0000","last_peered":"2023-08-17T17:34:23.198753+0000","last_clean":"2023-08-17T17:34:23.198753+0000","last_became_active":"2023-08-17T17:34:23.194196+0000","last_became_peered":"2023-08-17T17:34:23.194196+0000","last_unstale":"2023-08-17T17:34:23.198753+0000","last_undegraded":"2023-08-17T17:34:23.198753+0000","last_fullsized":"2023-08-17T17:34:23.198753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553805+0000","last_change":"2023-08-17T17:34:23.553805+0000","last_active":"2023-08-17T17:34:23.553805+0000","last_peered":"2023-08-17T17:34:23.553805+0000","last_clean":"2023-08-17T17:34:23.553805+0000","last_became_active":"2023-08-17T17:34:23.553524+0000","last_became_peered":"2023-08-17T17:34:23.553524+0000","last_unstale":"2023-08-17T17:34:23.553805+0000","last_undegraded":"2023-08-17T17:34:23.553805+0000","last_fullsized":"2023-08-17T17:34:23.553805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553107+0000","last_change":"2023-08-17T17:34:23.184707+0000","last_active":"2023-08-17T17:34:23.553107+0000","last_peered":"2023-08-17T17:34:23.553107+0000","last_clean":"2023-08-17T17:34:23.553107+0000","last_became_active":"2023-08-17T17:34:23.184244+0000","last_became_peered":"2023-08-17T17:34:23.184244+0000","last_unstale":"2023-08-17T17:34:23.553107+0000","last_undegraded":"2023-08-17T17:34:23.553107+0000","last_fullsized":"2023-08-17T17:34:23.553107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558704+0000","last_change":"2023-08-17T17:34:23.558704+0000","last_active":"2023-08-17T17:34:23.558704+0000","last_peered":"2023-08-17T17:34:23.558704+0000","last_clean":"2023-08-17T17:34:23.558704+0000","last_became_active":"2023-08-17T17:34:23.558374+0000","last_became_peered":"2023-08-17T17:34:23.558374+0000","last_unstale":"2023-08-17T17:34:23.558704+0000","last_undegraded":"2023-08-17T17:34:23.558704+0000","last_fullsized":"2023-08-17T17:34:23.558704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541721+0000","last_change":"2023-08-17T17:34:23.190318+0000","last_active":"2023-08-17T17:34:23.541721+0000","last_peered":"2023-08-17T17:34:23.541721+0000","last_clean":"2023-08-17T17:34:23.541721+0000","last_became_active":"2023-08-17T17:34:23.190011+0000","last_became_peered":"2023-08-17T17:34:23.190011+0000","last_unstale":"2023-08-17T17:34:23.541721+0000","last_undegraded":"2023-08-17T17:34:23.541721+0000","last_fullsized":"2023-08-17T17:34:23.541721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552175+0000","last_change":"2023-08-17T17:34:23.552175+0000","last_active":"2023-08-17T17:34:23.552175+0000","last_peered":"2023-08-17T17:34:23.552175+0000","last_clean":"2023-08-17T17:34:23.552175+0000","last_became_active":"2023-08-17T17:34:23.551927+0000","last_became_peered":"2023-08-17T17:34:23.551927+0000","last_unstale":"2023-08-17T17:34:23.552175+0000","last_undegraded":"2023-08-17T17:34:23.552175+0000","last_fullsized":"2023-08-17T17:34:23.552175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561308+0000","last_change":"2023-08-17T17:34:23.184913+0000","last_active":"2023-08-17T17:34:23.561308+0000","last_peered":"2023-08-17T17:34:23.561308+0000","last_clean":"2023-08-17T17:34:23.561308+0000","last_became_active":"2023-08-17T17:34:23.184622+0000","last_became_peered":"2023-08-17T17:34:23.184622+0000","last_unstale":"2023-08-17T17:34:23.561308+0000","last_undegraded":"2023-08-17T17:34:23.561308+0000","last_fullsized":"2023-08-17T17:34:23.561308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555151+0000","last_change":"2023-08-17T17:34:23.555151+0000","last_active":"2023-08-17T17:34:23.555151+0000","last_peered":"2023-08-17T17:34:23.555151+0000","last_clean":"2023-08-17T17:34:23.555151+0000","last_became_active":"2023-08-17T17:34:23.554868+0000","last_became_peered":"2023-08-17T17:34:23.554868+0000","last_unstale":"2023-08-17T17:34:23.555151+0000","last_undegraded":"2023-08-17T17:34:23.555151+0000","last_fullsized":"2023-08-17T17:34:23.555151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.195535+0000","last_change":"2023-08-17T17:34:23.189742+0000","last_active":"2023-08-17T17:34:23.195535+0000","last_peered":"2023-08-17T17:34:23.195535+0000","last_clean":"2023-08-17T17:34:23.195535+0000","last_became_active":"2023-08-17T17:34:23.189466+0000","last_became_peered":"2023-08-17T17:34:23.189466+0000","last_unstale":"2023-08-17T17:34:23.195535+0000","last_undegraded":"2023-08-17T17:34:23.195535+0000","last_fullsized":"2023-08-17T17:34:23.195535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553968+0000","last_change":"2023-08-17T17:34:23.553968+0000","last_active":"2023-08-17T17:34:23.553968+0000","last_peered":"2023-08-17T17:34:23.553968+0000","last_clean":"2023-08-17T17:34:23.553968+0000","last_became_active":"2023-08-17T17:34:23.552409+0000","last_became_peered":"2023-08-17T17:34:23.552409+0000","last_unstale":"2023-08-17T17:34:23.553968+0000","last_undegraded":"2023-08-17T17:34:23.553968+0000","last_fullsized":"2023-08-17T17:34:23.553968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.193391+0000","last_change":"2023-08-17T17:34:23.189070+0000","last_active":"2023-08-17T17:34:23.193391+0000","last_peered":"2023-08-17T17:34:23.193391+0000","last_clean":"2023-08-17T17:34:23.193391+0000","last_became_active":"2023-08-17T17:34:23.188771+0000","last_became_peered":"2023-08-17T17:34:23.188771+0000","last_unstale":"2023-08-17T17:34:23.193391+0000","last_undegraded":"2023-08-17T17:34:23.193391+0000","last_fullsized":"2023-08-17T17:34:23.193391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554378+0000","last_change":"2023-08-17T17:34:23.549482+0000","last_active":"2023-08-17T17:34:23.554378+0000","last_peered":"2023-08-17T17:34:23.554378+0000","last_clean":"2023-08-17T17:34:23.554378+0000","last_became_active":"2023-08-17T17:34:23.549214+0000","last_became_peered":"2023-08-17T17:34:23.549214+0000","last_unstale":"2023-08-17T17:34:23.554378+0000","last_undegraded":"2023-08-17T17:34:23.554378+0000","last_fullsized":"2023-08-17T17:34:23.554378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557177+0000","last_change":"2023-08-17T17:34:23.191534+0000","last_active":"2023-08-17T17:34:23.557177+0000","last_peered":"2023-08-17T17:34:23.557177+0000","last_clean":"2023-08-17T17:34:23.557177+0000","last_became_active":"2023-08-17T17:34:23.191251+0000","last_became_peered":"2023-08-17T17:34:23.191251+0000","last_unstale":"2023-08-17T17:34:23.557177+0000","last_undegraded":"2023-08-17T17:34:23.557177+0000","last_fullsized":"2023-08-17T17:34:23.557177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":80051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":80083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":78637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":78727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":80229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:34:31.253 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T17:34:31.254 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-17T17:34:31.254 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-17T17:34:31.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-17T17:34:31.255 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-17T17:34:31.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.398+0000 7f4f6a391700 1 Processor -- start 2023-08-17T17:34:31.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.398+0000 7f4f6a391700 1 -- start start 2023-08-17T17:34:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f6a391700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640bf5a0 0x7f4f64152270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f6a391700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4f64066220 0x7f4f640666b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f6a391700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f641532b0 con 0x7f4f6414f9b0 2023-08-17T17:34:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f6a391700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6414fd90 con 0x7f4f64066220 2023-08-17T17:34:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f6a391700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640bdcd0 con 0x7f4f640bf5a0 2023-08-17T17:34:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f6938f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4f6414f9b0 0x7f4f640c4930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38188/0 (socket says 172.21.15.78:38188) 2023-08-17T17:34:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f6938f700 1 -- 172.21.15.78:0/1844713693 learned_addr learned my addr 172.21.15.78:0/1844713693 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157005107 0 0) 0x7f4f60001110 con 0x7f4f6414f9b0 2023-08-17T17:34:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f68b8e700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640bf5a0 0x7f4f64152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f69b90700 1 --2- 172.21.15.78:0/1844713693 >> v2:172.21.15.150:3300/0 conn(0x7f4f64066220 0x7f4f640666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f500033f0 con 0x7f4f6414f9b0 2023-08-17T17:34:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.399+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1694188929 0 0) 0x7f4f500033f0 con 0x7f4f6414f9b0 2023-08-17T17:34:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640bf5a0 msgr2=0x7f4f64152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640bf5a0 0x7f4f64152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 >> v2:172.21.15.150:3300/0 conn(0x7f4f64066220 msgr2=0x7f4f640666b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 --2- 172.21.15.78:0/1844713693 >> v2:172.21.15.150:3300/0 conn(0x7f4f64066220 0x7f4f640666b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f64066ba0 con 0x7f4f6414f9b0 2023-08-17T17:34:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f4f60001600 con 0x7f4f6414f9b0 2023-08-17T17:34:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 >> v1:172.21.15.78:6789/0 conn(0x7f4f6414f9b0 legacy=0x7f4f640c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 0x7f4f50003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f50004690 0x7f4f50004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640bf5a0 0x7f4f50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6414fd90 con 0x7f4f500038e0 2023-08-17T17:34:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640bdcd0 con 0x7f4f50004690 2023-08-17T17:34:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5000b8e0 con 0x7f4f640bf5a0 2023-08-17T17:34:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f6938f700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 0x7f4f50003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f69b90700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640bf5a0 0x7f4f50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f68b8e700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f50004690 0x7f4f50004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f6938f700 1 -- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640bf5a0 msgr2=0x7f4f50005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f6938f700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640bf5a0 0x7f4f50005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f6938f700 1 -- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f50004690 msgr2=0x7f4f50004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f6938f700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f50004690 0x7f4f50004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f6938f700 1 -- 172.21.15.78:0/1844713693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f500033f0 con 0x7f4f500038e0 2023-08-17T17:34:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f6938f700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 0x7f4f50003d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4f6000c340 tx=0x7f4f60007900).ready entity=mon.0 client_cookie=55d96c18932b273d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60007bf0 con 0x7f4f500038e0 2023-08-17T17:34:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6000cc70 con 0x7f4f500038e0 2023-08-17T17:34:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.400+0000 7f4f5bfff700 1 -- 172.21.15.78:0/1844713693 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f600070d0 con 0x7f4f500038e0 2023-08-17T17:34:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.401+0000 7f4f6a391700 1 -- 172.21.15.78:0/1844713693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 msgr2=0x7f4f50003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.401+0000 7f4f6a391700 1 --2- 172.21.15.78:0/1844713693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 0x7f4f50003d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4f6000c340 tx=0x7f4f60007900).stop 2023-08-17T17:34:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.401+0000 7f4f69b90700 1 -- 172.21.15.78:0/1844713693 reap_dead start 2023-08-17T17:34:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.401+0000 7f4f6a391700 1 -- 172.21.15.78:0/1844713693 shutdown_connections 2023-08-17T17:34:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.401+0000 7f4f6a391700 1 -- 172.21.15.78:0/1844713693 >> 172.21.15.78:0/1844713693 conn(0x7f4f640624f0 msgr2=0x7f4f64062900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.401+0000 7f4f6a391700 1 -- 172.21.15.78:0/1844713693 shutdown_connections 2023-08-17T17:34:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.401+0000 7f4f6a391700 1 -- 172.21.15.78:0/1844713693 wait complete. 2023-08-17T17:34:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.402+0000 7f4f6a391700 1 Processor -- start 2023-08-17T17:34:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.402+0000 7f4f6a391700 1 -- start start 2023-08-17T17:34:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6a391700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 0x7f4f64143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6a391700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640abaf0 0x7f4f640abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6a391700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f64154550 0x7f4f641549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6a391700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64154ec0 con 0x7f4f500038e0 2023-08-17T17:34:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6a391700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6414d710 con 0x7f4f64154550 2023-08-17T17:34:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6a391700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640c0380 con 0x7f4f640abaf0 2023-08-17T17:34:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6938f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 0x7f4f64143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6938f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 0x7f4f64143500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46740/0 (socket says 172.21.15.78:46740) 2023-08-17T17:34:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6938f700 1 -- 172.21.15.78:0/3915340892 learned_addr learned my addr 172.21.15.78:0/3915340892 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6938f700 1 -- 172.21.15.78:0/3915340892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640abaf0 msgr2=0x7f4f640abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f69b90700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f64154550 0x7f4f641549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f68b8e700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640abaf0 0x7f4f640abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6938f700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640abaf0 0x7f4f640abf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6938f700 1 -- 172.21.15.78:0/3915340892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f64154550 msgr2=0x7f4f641549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6938f700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f64154550 0x7f4f641549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6938f700 1 -- 172.21.15.78:0/3915340892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640bfdc0 con 0x7f4f500038e0 2023-08-17T17:34:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f69b90700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f64154550 0x7f4f641549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6938f700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 0x7f4f64143500 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f4f6000c930 tx=0x7f4f60015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f597fa700 1 -- 172.21.15.78:0/3915340892 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f600048c0 con 0x7f4f500038e0 2023-08-17T17:34:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f597fa700 1 -- 172.21.15.78:0/3915340892 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f60004a20 con 0x7f4f500038e0 2023-08-17T17:34:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6a391700 1 -- 172.21.15.78:0/3915340892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f640c00a0 con 0x7f4f500038e0 2023-08-17T17:34:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f597fa700 1 -- 172.21.15.78:0/3915340892 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60004da0 con 0x7f4f500038e0 2023-08-17T17:34:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.403+0000 7f4f6a391700 1 -- 172.21.15.78:0/3915340892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f640a7810 con 0x7f4f500038e0 2023-08-17T17:34:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.404+0000 7f4f6a391700 1 -- 172.21.15.78:0/3915340892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6414dd20 con 0x7f4f500038e0 2023-08-17T17:34:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.405+0000 7f4f597fa700 1 -- 172.21.15.78:0/3915340892 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4f60028030 con 0x7f4f500038e0 2023-08-17T17:34:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.405+0000 7f4f597fa700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4805ed90 0x7f4f48061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.405+0000 7f4f597fa700 1 -- 172.21.15.78:0/3915340892 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f6007aca0 con 0x7f4f500038e0 2023-08-17T17:34:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.405+0000 7f4f68b8e700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4805ed90 0x7f4f48061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.405+0000 7f4f68b8e700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4805ed90 0x7f4f48061250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4f54006d80 tx=0x7f4f54008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.409+0000 7f4f597fa700 1 -- 172.21.15.78:0/3915340892 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f6004c240 con 0x7f4f500038e0 2023-08-17T17:34:31.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.619+0000 7f4f6a391700 1 -- 172.21.15.78:0/3915340892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4f64153a80 con 0x7f4f500038e0 2023-08-17T17:34:31.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.622+0000 7f4f597fa700 1 -- 172.21.15.78:0/3915340892 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148521 (secure 0 0 0) 0x7f4f64153a80 con 0x7f4f500038e0 2023-08-17T17:34:31.624 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:31.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.624+0000 7f4f6a391700 1 -- 172.21.15.78:0/3915340892 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4805ed90 msgr2=0x7f4f48061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.624+0000 7f4f6a391700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4805ed90 0x7f4f48061250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4f54006d80 tx=0x7f4f54008040).stop 2023-08-17T17:34:31.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.624+0000 7f4f6a391700 1 -- 172.21.15.78:0/3915340892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 msgr2=0x7f4f64143500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.624+0000 7f4f6a391700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 0x7f4f64143500 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f4f6000c930 tx=0x7f4f60015000).stop 2023-08-17T17:34:31.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.625+0000 7f4f6a391700 1 -- 172.21.15.78:0/3915340892 shutdown_connections 2023-08-17T17:34:31.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.625+0000 7f4f6a391700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4805ed90 0x7f4f48061250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.625+0000 7f4f6a391700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f64154550 0x7f4f641549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.625+0000 7f4f6a391700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f500038e0 0x7f4f64143500 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.625+0000 7f4f6a391700 1 --2- 172.21.15.78:0/3915340892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f640abaf0 0x7f4f640abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.625+0000 7f4f6a391700 1 -- 172.21.15.78:0/3915340892 >> 172.21.15.78:0/3915340892 conn(0x7f4f640624f0 msgr2=0x7f4f640c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:31.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.625+0000 7f4f6a391700 1 -- 172.21.15.78:0/3915340892 shutdown_connections 2023-08-17T17:34:31.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.625+0000 7f4f6a391700 1 -- 172.21.15.78:0/3915340892 wait complete. 2023-08-17T17:34:31.637 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":4,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":119464},{"type":"v1","addr":"172.21.15.78:6833","nonce":119464}]},"active_addr":"172.21.15.78:6833/119464","active_change":"2023-08-17T17:34:11.001990+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3495218499}]},{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3252365413}]}]} 2023-08-17T17:34:31.641 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-17T17:34:31.642 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-17T17:34:31.642 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:31.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.753+0000 7efcca6c6700 1 Processor -- start 2023-08-17T17:34:31.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.753+0000 7efcca6c6700 1 -- start start 2023-08-17T17:34:31.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.753+0000 7efcca6c6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efcc40c6ee0 0x7efcc40c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcca6c6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efcc40c0df0 0x7efcc40ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcca6c6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc40c7350 con 0x7efcc4154140 2023-08-17T17:34:31.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcca6c6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc40a8350 con 0x7efcc40c6ee0 2023-08-17T17:34:31.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcca6c6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc40c1240 con 0x7efcc40c0df0 2023-08-17T17:34:31.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efcc40c6ee0 0x7efcc40c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc3fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efcc4154140 0x7efcc40a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38190/0 (socket says 172.21.15.78:38190) 2023-08-17T17:34:31.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc3fff700 1 -- 172.21.15.78:0/1293296243 learned_addr learned my addr 172.21.15.78:0/1293296243 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:31.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc8c63700 1 --2- 172.21.15.78:0/1293296243 >> v2:172.21.15.150:3300/0 conn(0x7efcc40c0df0 0x7efcc40ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc37fe700 1 -- 172.21.15.78:0/1293296243 >> v2:172.21.15.150:3300/0 conn(0x7efcc40c0df0 msgr2=0x7efcc40ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc37fe700 1 --2- 172.21.15.78:0/1293296243 >> v2:172.21.15.150:3300/0 conn(0x7efcc40c0df0 0x7efcc40ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc37fe700 1 -- 172.21.15.78:0/1293296243 >> v1:172.21.15.78:6789/0 conn(0x7efcc4154140 legacy=0x7efcc40a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc37fe700 1 -- 172.21.15.78:0/1293296243 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4154520 con 0x7efcc40c6ee0 2023-08-17T17:34:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc2ffd700 1 -- 172.21.15.78:0/1293296243 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723156831 0 0) 0x7efcc40c7350 con 0x7efcc4154140 2023-08-17T17:34:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc37fe700 1 --2- 172.21.15.78:0/1293296243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c6ee0 0x7efcc40c0900 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7efcc40c00d0 tx=0x7efcb4009060).ready entity=mon.0 client_cookie=d619ba060da443d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc2ffd700 1 -- 172.21.15.78:0/1293296243 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400b580 con 0x7efcc40c6ee0 2023-08-17T17:34:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc2ffd700 1 -- 172.21.15.78:0/1293296243 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb400b6e0 con 0x7efcc40c6ee0 2023-08-17T17:34:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.754+0000 7efcc2ffd700 1 -- 172.21.15.78:0/1293296243 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400ba60 con 0x7efcc40c6ee0 2023-08-17T17:34:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.755+0000 7efcca6c6700 1 -- 172.21.15.78:0/1293296243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c6ee0 msgr2=0x7efcc40c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.755+0000 7efcca6c6700 1 --2- 172.21.15.78:0/1293296243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c6ee0 0x7efcc40c0900 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7efcc40c00d0 tx=0x7efcb4009060).stop 2023-08-17T17:34:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.755+0000 7efcca6c6700 1 -- 172.21.15.78:0/1293296243 shutdown_connections 2023-08-17T17:34:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.755+0000 7efcca6c6700 1 --2- 172.21.15.78:0/1293296243 >> v2:172.21.15.150:3300/0 conn(0x7efcc40c0df0 0x7efcc40ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.755+0000 7efcca6c6700 1 --2- 172.21.15.78:0/1293296243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c6ee0 0x7efcc40c0900 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.755+0000 7efcca6c6700 1 -- 172.21.15.78:0/1293296243 >> 172.21.15.78:0/1293296243 conn(0x7efcc4094510 msgr2=0x7efcc406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:31.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.755+0000 7efcca6c6700 1 -- 172.21.15.78:0/1293296243 shutdown_connections 2023-08-17T17:34:31.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.755+0000 7efcca6c6700 1 -- 172.21.15.78:0/1293296243 wait complete. 2023-08-17T17:34:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.756+0000 7efcca6c6700 1 Processor -- start 2023-08-17T17:34:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.756+0000 7efcca6c6700 1 -- start start 2023-08-17T17:34:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcca6c6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c0df0 0x7efcc40c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcca6c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcc40c6ee0 0x7efcc40c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcca6c6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efcc4154140 0x7efcc40c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcca6c6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40c34f0 con 0x7efcc40c0df0 2023-08-17T17:34:31.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcca6c6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40ad9b0 con 0x7efcc40c6ee0 2023-08-17T17:34:31.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcca6c6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40c4100 con 0x7efcc4154140 2023-08-17T17:34:31.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c0df0 0x7efcc40c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c0df0 0x7efcc40c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46752/0 (socket says 172.21.15.78:46752) 2023-08-17T17:34:31.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcc3fff700 1 -- 172.21.15.78:0/1733376808 learned_addr learned my addr 172.21.15.78:0/1733376808 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:31.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcc3fff700 1 -- 172.21.15.78:0/1733376808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efcc4154140 msgr2=0x7efcc40c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcc3fff700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efcc4154140 0x7efcc40c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:31.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcc3fff700 1 -- 172.21.15.78:0/1733376808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcc40c6ee0 msgr2=0x7efcc40c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcc3fff700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcc40c6ee0 0x7efcc40c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:31.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcc3fff700 1 -- 172.21.15.78:0/1733376808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb40092a0 con 0x7efcc40c0df0 2023-08-17T17:34:31.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcc3fff700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c0df0 0x7efcc40c3000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7efcb8001eb0 tx=0x7efcb8007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:31.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcabfff700 1 -- 172.21.15.78:0/1733376808 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb80072e0 con 0x7efcc40c0df0 2023-08-17T17:34:31.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcabfff700 1 -- 172.21.15.78:0/1733376808 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb8007440 con 0x7efcc40c0df0 2023-08-17T17:34:31.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcca6c6700 1 -- 172.21.15.78:0/1733376808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc40acb20 con 0x7efcc40c0df0 2023-08-17T17:34:31.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcabfff700 1 -- 172.21.15.78:0/1733376808 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb80057a0 con 0x7efcc40c0df0 2023-08-17T17:34:31.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.757+0000 7efcca6c6700 1 -- 172.21.15.78:0/1733376808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc40ad080 con 0x7efcc40c0df0 2023-08-17T17:34:31.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.758+0000 7efcca6c6700 1 -- 172.21.15.78:0/1733376808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc4047350 con 0x7efcc40c0df0 2023-08-17T17:34:31.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.759+0000 7efcabfff700 1 -- 172.21.15.78:0/1733376808 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efcb8010070 con 0x7efcc40c0df0 2023-08-17T17:34:31.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.759+0000 7efcabfff700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efcb005edc0 0x7efcb0061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:31.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.759+0000 7efcabfff700 1 -- 172.21.15.78:0/1733376808 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efcb80791a0 con 0x7efcc40c0df0 2023-08-17T17:34:31.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.759+0000 7efcc37fe700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efcb005edc0 0x7efcb0061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:31.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.759+0000 7efcc37fe700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efcb005edc0 0x7efcb0061280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7efcc40c50d0 tx=0x7efcb4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:31.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.763+0000 7efcabfff700 1 -- 172.21.15.78:0/1733376808 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efcb804a740 con 0x7efcc40c0df0 2023-08-17T17:34:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.927+0000 7efcca6c6700 1 -- 172.21.15.78:0/1733376808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcc40c91e0 con 0x7efcc40c0df0 2023-08-17T17:34:31.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.928+0000 7efcabfff700 1 -- 172.21.15.78:0/1733376808 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7efcb804dd60 con 0x7efcc40c0df0 2023-08-17T17:34:31.930 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:31.930 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:31.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 -- 172.21.15.78:0/1733376808 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efcb005edc0 msgr2=0x7efcb0061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efcb005edc0 0x7efcb0061280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7efcc40c50d0 tx=0x7efcb4017000).stop 2023-08-17T17:34:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 -- 172.21.15.78:0/1733376808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c0df0 msgr2=0x7efcc40c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c0df0 0x7efcc40c3000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7efcb8001eb0 tx=0x7efcb8007e90).stop 2023-08-17T17:34:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 -- 172.21.15.78:0/1733376808 shutdown_connections 2023-08-17T17:34:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efcb005edc0 0x7efcb0061280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efcc4154140 0x7efcc40c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcc40c0df0 0x7efcc40c3000 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 --2- 172.21.15.78:0/1733376808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcc40c6ee0 0x7efcc40c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 -- 172.21.15.78:0/1733376808 >> 172.21.15.78:0/1733376808 conn(0x7efcc4094510 msgr2=0x7efcc40ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 -- 172.21.15.78:0/1733376808 shutdown_connections 2023-08-17T17:34:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:31.930+0000 7efcca6c6700 1 -- 172.21.15.78:0/1733376808 wait complete. 2023-08-17T17:34:31.943 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-17T17:34:31.944 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:32.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.054+0000 7fed5dab3700 1 Processor -- start 2023-08-17T17:34:32.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.054+0000 7fed5dab3700 1 -- start start 2023-08-17T17:34:32.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.055+0000 7fed5dab3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fed58151e40 0x7fed58152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.055+0000 7fed5dab3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed580a7c90 0x7fed580c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.055+0000 7fed5dab3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed580bf210 con 0x7fed580be4d0 2023-08-17T17:34:32.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.055+0000 7fed5dab3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed580c5a80 con 0x7fed580a7c90 2023-08-17T17:34:32.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.055+0000 7fed5dab3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed580c5450 con 0x7fed58151e40 2023-08-17T17:34:32.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.055+0000 7fed56ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed580a7c90 0x7fed580c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.055+0000 7fed56ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed580a7c90 0x7fed580c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46766/0 (socket says 172.21.15.78:46766) 2023-08-17T17:34:32.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.055+0000 7fed56ffd700 1 -- 172.21.15.78:0/998667802 learned_addr learned my addr 172.21.15.78:0/998667802 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:32.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed577fe700 1 --2- 172.21.15.78:0/998667802 >> v2:172.21.15.150:3300/0 conn(0x7fed58151e40 0x7fed58152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed56ffd700 1 -- 172.21.15.78:0/998667802 >> v2:172.21.15.150:3300/0 conn(0x7fed58151e40 msgr2=0x7fed58152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed56ffd700 1 --2- 172.21.15.78:0/998667802 >> v2:172.21.15.150:3300/0 conn(0x7fed58151e40 0x7fed58152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed56ffd700 1 -- 172.21.15.78:0/998667802 >> v1:172.21.15.150:6789/0 conn(0x7fed580be4d0 legacy=0x7fed580be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed56ffd700 1 -- 172.21.15.78:0/998667802 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed581533f0 con 0x7fed580a7c90 2023-08-17T17:34:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed577fe700 1 --2- 172.21.15.78:0/998667802 >> v2:172.21.15.150:3300/0 conn(0x7fed58151e40 0x7fed58152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed56ffd700 1 --2- 172.21.15.78:0/998667802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed580a7c90 0x7fed580c5f10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fed580685c0 tx=0x7fed4c0090f0).ready entity=mon.0 client_cookie=2aab005156987b20 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed567fc700 1 -- 172.21.15.78:0/998667802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00b5a0 con 0x7fed580a7c90 2023-08-17T17:34:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed567fc700 1 -- 172.21.15.78:0/998667802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c00b700 con 0x7fed580a7c90 2023-08-17T17:34:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed567fc700 1 -- 172.21.15.78:0/998667802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00ba80 con 0x7fed580a7c90 2023-08-17T17:34:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed5dab3700 1 -- 172.21.15.78:0/998667802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed580a7c90 msgr2=0x7fed580c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.056+0000 7fed5dab3700 1 --2- 172.21.15.78:0/998667802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed580a7c90 0x7fed580c5f10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fed580685c0 tx=0x7fed4c0090f0).stop 2023-08-17T17:34:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.057+0000 7fed5dab3700 1 -- 172.21.15.78:0/998667802 shutdown_connections 2023-08-17T17:34:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.057+0000 7fed5dab3700 1 --2- 172.21.15.78:0/998667802 >> v2:172.21.15.150:3300/0 conn(0x7fed58151e40 0x7fed58152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.057+0000 7fed5dab3700 1 --2- 172.21.15.78:0/998667802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed580a7c90 0x7fed580c5f10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.057+0000 7fed5dab3700 1 -- 172.21.15.78:0/998667802 >> 172.21.15.78:0/998667802 conn(0x7fed58092330 msgr2=0x7fed58062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.057+0000 7fed5dab3700 1 -- 172.21.15.78:0/998667802 shutdown_connections 2023-08-17T17:34:32.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.057+0000 7fed5dab3700 1 -- 172.21.15.78:0/998667802 wait complete. 2023-08-17T17:34:32.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.058+0000 7fed5dab3700 1 Processor -- start 2023-08-17T17:34:32.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.058+0000 7fed5dab3700 1 -- start start 2023-08-17T17:34:32.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed5dab3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed580a7c90 0x7fed5814b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed5dab3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed580be4d0 0x7fed580c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed5dab3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed58151e40 0x7fed580ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed5dab3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580ada40 con 0x7fed58151e40 2023-08-17T17:34:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed5dab3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580acb40 con 0x7fed580a7c90 2023-08-17T17:34:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed5dab3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed580acdc0 con 0x7fed580be4d0 2023-08-17T17:34:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed57fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed58151e40 0x7fed580ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed57fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed58151e40 0x7fed580ac650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46780/0 (socket says 172.21.15.78:46780) 2023-08-17T17:34:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed57fff700 1 -- 172.21.15.78:0/3784690211 learned_addr learned my addr 172.21.15.78:0/3784690211 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed577fe700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed580a7c90 0x7fed5814b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed56ffd700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed580be4d0 0x7fed580c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed57fff700 1 -- 172.21.15.78:0/3784690211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed580be4d0 msgr2=0x7fed580c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed57fff700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed580be4d0 0x7fed580c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed57fff700 1 -- 172.21.15.78:0/3784690211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed580a7c90 msgr2=0x7fed5814b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed57fff700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed580a7c90 0x7fed5814b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed57fff700 1 -- 172.21.15.78:0/3784690211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c009370 con 0x7fed58151e40 2023-08-17T17:34:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed577fe700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed580a7c90 0x7fed5814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed57fff700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed58151e40 0x7fed580ac650 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fed5000b490 tx=0x7fed50006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed3f7fe700 1 -- 172.21.15.78:0/3784690211 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50012410 con 0x7fed58151e40 2023-08-17T17:34:32.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed3f7fe700 1 -- 172.21.15.78:0/3784690211 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed500125b0 con 0x7fed58151e40 2023-08-17T17:34:32.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed3f7fe700 1 -- 172.21.15.78:0/3784690211 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50012970 con 0x7fed58151e40 2023-08-17T17:34:32.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed5dab3700 1 -- 172.21.15.78:0/3784690211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed580ad0a0 con 0x7fed58151e40 2023-08-17T17:34:32.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.059+0000 7fed5dab3700 1 -- 172.21.15.78:0/3784690211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed580ad660 con 0x7fed58151e40 2023-08-17T17:34:32.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.060+0000 7fed5dab3700 1 -- 172.21.15.78:0/3784690211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed580adb80 con 0x7fed58151e40 2023-08-17T17:34:32.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.061+0000 7fed3f7fe700 1 -- 172.21.15.78:0/3784690211 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fed5000f030 con 0x7fed58151e40 2023-08-17T17:34:32.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.061+0000 7fed3f7fe700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed4405ed90 0x7fed44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.061+0000 7fed3f7fe700 1 -- 172.21.15.78:0/3784690211 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fed500796f0 con 0x7fed58151e40 2023-08-17T17:34:32.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.061+0000 7fed577fe700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed4405ed90 0x7fed44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.061+0000 7fed577fe700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed4405ed90 0x7fed44061250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fed4800e4c0 tx=0x7fed48007700).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.065+0000 7fed3f7fe700 1 -- 172.21.15.78:0/3784690211 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed580adb80 con 0x7fed58151e40 2023-08-17T17:34:32.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.230+0000 7fed5dab3700 1 -- 172.21.15.78:0/3784690211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed580adb80 con 0x7fed58151e40 2023-08-17T17:34:32.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.231+0000 7fed3f7fe700 1 -- 172.21.15.78:0/3784690211 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fed580adb80 con 0x7fed58151e40 2023-08-17T17:34:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:32.233 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:32.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 -- 172.21.15.78:0/3784690211 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed4405ed90 msgr2=0x7fed44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed4405ed90 0x7fed44061250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fed4800e4c0 tx=0x7fed48007700).stop 2023-08-17T17:34:32.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 -- 172.21.15.78:0/3784690211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed58151e40 msgr2=0x7fed580ac650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed58151e40 0x7fed580ac650 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fed5000b490 tx=0x7fed50006f20).stop 2023-08-17T17:34:32.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 -- 172.21.15.78:0/3784690211 shutdown_connections 2023-08-17T17:34:32.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed4405ed90 0x7fed44061250 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed58151e40 0x7fed580ac650 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed580a7c90 0x7fed5814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 --2- 172.21.15.78:0/3784690211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed580be4d0 0x7fed580c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 -- 172.21.15.78:0/3784690211 >> 172.21.15.78:0/3784690211 conn(0x7fed58092330 msgr2=0x7fed58152220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 -- 172.21.15.78:0/3784690211 shutdown_connections 2023-08-17T17:34:32.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.233+0000 7fed5dab3700 1 -- 172.21.15.78:0/3784690211 wait complete. 2023-08-17T17:34:32.247 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-17T17:34:32.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.359+0000 7fd5efc47700 1 Processor -- start 2023-08-17T17:34:32.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.359+0000 7fd5efc47700 1 -- start start 2023-08-17T17:34:32.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5efc47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5e81541a0 0x7fd5e80a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5efc47700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd5e8154580 0x7fd5e80bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5efc47700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e80c8df0 con 0x7fd5e80c0340 2023-08-17T17:34:32.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5efc47700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e80a8190 con 0x7fd5e8154580 2023-08-17T17:34:32.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5efc47700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80c9970 con 0x7fd5e81541a0 2023-08-17T17:34:32.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ed1e2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd5e8154580 0x7fd5e80bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ed9e3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5e81541a0 0x7fd5e80a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ee1e4700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd5e80c0340 0x7fd5e80c9e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:57690/0 (socket says 172.21.15.78:57690) 2023-08-17T17:34:32.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ee1e4700 1 -- 172.21.15.78:0/2481507035 learned_addr learned my addr 172.21.15.78:0/2481507035 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:32.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ec9e1700 1 -- 172.21.15.78:0/2481507035 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340455550 0 0) 0x7fd5e80c8df0 con 0x7fd5e80c0340 2023-08-17T17:34:32.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ec9e1700 1 -- 172.21.15.78:0/2481507035 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d40033f0 con 0x7fd5e80c0340 2023-08-17T17:34:32.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ed9e3700 1 -- 172.21.15.78:0/2481507035 >> v2:172.21.15.150:3300/0 conn(0x7fd5e8154580 msgr2=0x7fd5e80bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:32.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ed9e3700 1 --2- 172.21.15.78:0/2481507035 >> v2:172.21.15.150:3300/0 conn(0x7fd5e8154580 0x7fd5e80bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ed9e3700 1 -- 172.21.15.78:0/2481507035 >> v1:172.21.15.150:6789/0 conn(0x7fd5e80c0340 legacy=0x7fd5e80c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ed9e3700 1 -- 172.21.15.78:0/2481507035 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e80c0770 con 0x7fd5e81541a0 2023-08-17T17:34:32.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.360+0000 7fd5ed1e2700 1 --2- 172.21.15.78:0/2481507035 >> v2:172.21.15.150:3300/0 conn(0x7fd5e8154580 0x7fd5e80bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:32.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5ed9e3700 1 --2- 172.21.15.78:0/2481507035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5e81541a0 0x7fd5e80a7ca0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd5e4009760 tx=0x7fd5e4009060).ready entity=mon.2 client_cookie=93d433a051c67e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5ec9e1700 1 -- 172.21.15.78:0/2481507035 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40090d0 con 0x7fd5e81541a0 2023-08-17T17:34:32.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5ec9e1700 1 -- 172.21.15.78:0/2481507035 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e400d4a0 con 0x7fd5e81541a0 2023-08-17T17:34:32.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5ec9e1700 1 -- 172.21.15.78:0/2481507035 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e400d820 con 0x7fd5e81541a0 2023-08-17T17:34:32.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5efc47700 1 -- 172.21.15.78:0/2481507035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5e81541a0 msgr2=0x7fd5e80a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5efc47700 1 --2- 172.21.15.78:0/2481507035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5e81541a0 0x7fd5e80a7ca0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd5e4009760 tx=0x7fd5e4009060).stop 2023-08-17T17:34:32.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5efc47700 1 -- 172.21.15.78:0/2481507035 shutdown_connections 2023-08-17T17:34:32.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5efc47700 1 --2- 172.21.15.78:0/2481507035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5e81541a0 0x7fd5e80a7ca0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5efc47700 1 --2- 172.21.15.78:0/2481507035 >> v2:172.21.15.150:3300/0 conn(0x7fd5e8154580 0x7fd5e80bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5efc47700 1 -- 172.21.15.78:0/2481507035 >> 172.21.15.78:0/2481507035 conn(0x7fd5e806a400 msgr2=0x7fd5e80caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5efc47700 1 -- 172.21.15.78:0/2481507035 shutdown_connections 2023-08-17T17:34:32.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.361+0000 7fd5efc47700 1 -- 172.21.15.78:0/2481507035 wait complete. 2023-08-17T17:34:32.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.363+0000 7fd5efc47700 1 Processor -- start 2023-08-17T17:34:32.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.363+0000 7fd5efc47700 1 -- start start 2023-08-17T17:34:32.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.363+0000 7fd5efc47700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e80c0340 0x7fd5e8140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.363+0000 7fd5efc47700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e81541a0 0x7fd5e81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.363+0000 7fd5efc47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5e8154580 0x7fd5e8158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.363+0000 7fd5efc47700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80ae470 con 0x7fd5e81541a0 2023-08-17T17:34:32.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.363+0000 7fd5efc47700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e8159120 con 0x7fd5e80c0340 2023-08-17T17:34:32.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.363+0000 7fd5efc47700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e8159400 con 0x7fd5e8154580 2023-08-17T17:34:32.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ed1e2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e81541a0 0x7fd5e81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ed1e2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e81541a0 0x7fd5e81585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46782/0 (socket says 172.21.15.78:46782) 2023-08-17T17:34:32.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ed1e2700 1 -- 172.21.15.78:0/427791536 learned_addr learned my addr 172.21.15.78:0/427791536 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:32.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ee1e4700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5e8154580 0x7fd5e8158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ed9e3700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e80c0340 0x7fd5e8140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ed1e2700 1 -- 172.21.15.78:0/427791536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5e8154580 msgr2=0x7fd5e8158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ed1e2700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5e8154580 0x7fd5e8158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ed1e2700 1 -- 172.21.15.78:0/427791536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e80c0340 msgr2=0x7fd5e8140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ed1e2700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5e80c0340 0x7fd5e8140ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ed1e2700 1 -- 172.21.15.78:0/427791536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80092a0 con 0x7fd5e81541a0 2023-08-17T17:34:32.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ed1e2700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e81541a0 0x7fd5e81585f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fd5d800e960 tx=0x7fd5d8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ddffb700 1 -- 172.21.15.78:0/427791536 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8012600 con 0x7fd5e81541a0 2023-08-17T17:34:32.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ddffb700 1 -- 172.21.15.78:0/427791536 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d8012760 con 0x7fd5e81541a0 2023-08-17T17:34:32.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5ddffb700 1 -- 172.21.15.78:0/427791536 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8012ae0 con 0x7fd5e81541a0 2023-08-17T17:34:32.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e40092a0 con 0x7fd5e81541a0 2023-08-17T17:34:32.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.364+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e81599c0 con 0x7fd5e81541a0 2023-08-17T17:34:32.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.365+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5e8047350 con 0x7fd5e81541a0 2023-08-17T17:34:32.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.365+0000 7fd5ddffb700 1 -- 172.21.15.78:0/427791536 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd5d8022070 con 0x7fd5e81541a0 2023-08-17T17:34:32.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.366+0000 7fd5ddffb700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd5cc05ed90 0x7fd5cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.366+0000 7fd5ddffb700 1 -- 172.21.15.78:0/427791536 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd5d8079fa0 con 0x7fd5e81541a0 2023-08-17T17:34:32.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.366+0000 7fd5ed9e3700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd5cc05ed90 0x7fd5cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.366+0000 7fd5ddffb700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] conn(0x7fd5cc068130 0x7fd5cc06a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.366+0000 7fd5ddffb700 1 -- 172.21.15.78:0/427791536 --> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5cc06ac10 con 0x7fd5cc068130 2023-08-17T17:34:32.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.366+0000 7fd5ddffb700 1 -- 172.21.15.78:0/427791536 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5d807c520 con 0x7fd5e81541a0 2023-08-17T17:34:32.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.366+0000 7fd5ee1e4700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] conn(0x7fd5cc068130 0x7fd5cc06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.366+0000 7fd5ed9e3700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd5cc05ed90 0x7fd5cc061250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd5e400d260 tx=0x7fd5e4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.366+0000 7fd5ee1e4700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] conn(0x7fd5cc068130 0x7fd5cc06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.367+0000 7fd5ddffb700 1 -- 172.21.15.78:0/427791536 <== osd.0 v2:172.21.15.78:6800/119685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd5cc06ac10 con 0x7fd5cc068130 2023-08-17T17:34:32.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.381+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 --> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd5e80c9040 con 0x7fd5cc068130 2023-08-17T17:34:32.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5ddffb700 1 -- 172.21.15.78:0/427791536 <== osd.0 v2:172.21.15.78:6800/119685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd5e80c9040 con 0x7fd5cc068130 2023-08-17T17:34:32.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] conn(0x7fd5cc068130 msgr2=0x7fd5cc06a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5efc47700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] conn(0x7fd5cc068130 0x7fd5cc06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd5cc05ed90 msgr2=0x7fd5cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5efc47700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd5cc05ed90 0x7fd5cc061250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd5e400d260 tx=0x7fd5e4016000).stop 2023-08-17T17:34:32.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e81541a0 msgr2=0x7fd5e81585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5efc47700 1 --2- 172.21.15.78:0/427791536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e81541a0 0x7fd5e81585f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fd5d800e960 tx=0x7fd5d8009060).stop 2023-08-17T17:34:32.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5ee1e4700 1 -- 172.21.15.78:0/427791536 reap_dead start 2023-08-17T17:34:32.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 shutdown_connections 2023-08-17T17:34:32.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 >> 172.21.15.78:0/427791536 conn(0x7fd5e806a400 msgr2=0x7fd5e8152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 shutdown_connections 2023-08-17T17:34:32.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.382+0000 7fd5efc47700 1 -- 172.21.15.78:0/427791536 wait complete. 2023-08-17T17:34:32.395 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-08-17T17:34:32.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-17T17:34:32.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.507+0000 7fa90e115700 1 Processor -- start 2023-08-17T17:34:32.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.507+0000 7fa90e115700 1 -- start start 2023-08-17T17:34:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.508+0000 7fa90e115700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa908064340 0x7fa908064720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.508+0000 7fa90e115700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa9080bec60 0x7fa9080c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.508+0000 7fa90e115700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9080c7860 con 0x7fa9080c98b0 2023-08-17T17:34:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.508+0000 7fa90e115700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9080638b0 con 0x7fa908064340 2023-08-17T17:34:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.508+0000 7fa90e115700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9080a8680 con 0x7fa9080bec60 2023-08-17T17:34:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.508+0000 7fa9077fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa908064340 0x7fa908064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.508+0000 7fa9077fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa908064340 0x7fa908064720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46794/0 (socket says 172.21.15.78:46794) 2023-08-17T17:34:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.508+0000 7fa9077fe700 1 -- 172.21.15.78:0/4080869225 learned_addr learned my addr 172.21.15.78:0/4080869225 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.508+0000 7fa907fff700 1 --2- 172.21.15.78:0/4080869225 >> v2:172.21.15.150:3300/0 conn(0x7fa9080bec60 0x7fa9080c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa9077fe700 1 -- 172.21.15.78:0/4080869225 >> v2:172.21.15.150:3300/0 conn(0x7fa9080bec60 msgr2=0x7fa9080c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa9077fe700 1 --2- 172.21.15.78:0/4080869225 >> v2:172.21.15.150:3300/0 conn(0x7fa9080bec60 0x7fa9080c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa9077fe700 1 -- 172.21.15.78:0/4080869225 >> v1:172.21.15.150:6789/0 conn(0x7fa9080c98b0 legacy=0x7fa9080c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:32.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa9077fe700 1 -- 172.21.15.78:0/4080869225 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080c6c90 con 0x7fa908064340 2023-08-17T17:34:32.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa907fff700 1 --2- 172.21.15.78:0/4080869225 >> v2:172.21.15.150:3300/0 conn(0x7fa9080bec60 0x7fa9080c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:32.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa9077fe700 1 --2- 172.21.15.78:0/4080869225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa908064340 0x7fa908064720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fa908063e50 tx=0x7fa8f8009840).ready entity=mon.0 client_cookie=2e91c21a0c761c95 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa9067fc700 1 -- 172.21.15.78:0/4080869225 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800e070 con 0x7fa908064340 2023-08-17T17:34:32.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa9067fc700 1 -- 172.21.15.78:0/4080869225 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f800ba10 con 0x7fa908064340 2023-08-17T17:34:32.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa9067fc700 1 -- 172.21.15.78:0/4080869225 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800bd90 con 0x7fa908064340 2023-08-17T17:34:32.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa90e115700 1 -- 172.21.15.78:0/4080869225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa908064340 msgr2=0x7fa908064720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa90e115700 1 --2- 172.21.15.78:0/4080869225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa908064340 0x7fa908064720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fa908063e50 tx=0x7fa8f8009840).stop 2023-08-17T17:34:32.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa90e115700 1 -- 172.21.15.78:0/4080869225 shutdown_connections 2023-08-17T17:34:32.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa90e115700 1 --2- 172.21.15.78:0/4080869225 >> v2:172.21.15.150:3300/0 conn(0x7fa9080bec60 0x7fa9080c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa90e115700 1 --2- 172.21.15.78:0/4080869225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa908064340 0x7fa908064720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa90e115700 1 -- 172.21.15.78:0/4080869225 >> 172.21.15.78:0/4080869225 conn(0x7fa908062cd0 msgr2=0x7fa9080c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa90e115700 1 -- 172.21.15.78:0/4080869225 shutdown_connections 2023-08-17T17:34:32.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.509+0000 7fa90e115700 1 -- 172.21.15.78:0/4080869225 wait complete. 2023-08-17T17:34:32.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa90e115700 1 Processor -- start 2023-08-17T17:34:32.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa90e115700 1 -- start start 2023-08-17T17:34:32.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa90e115700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa908064340 0x7fa908142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa90e115700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9080bec60 0x7fa9080a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa90e115700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9080c98b0 0x7fa908155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa90e115700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080ac010 con 0x7fa9080bec60 2023-08-17T17:34:32.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa90e115700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080a9ff0 con 0x7fa908064340 2023-08-17T17:34:32.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa90e115700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080aa2d0 con 0x7fa9080c98b0 2023-08-17T17:34:32.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa906ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9080bec60 0x7fa9080a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa906ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9080bec60 0x7fa9080a97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46802/0 (socket says 172.21.15.78:46802) 2023-08-17T17:34:32.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.511+0000 7fa906ffd700 1 -- 172.21.15.78:0/698156779 learned_addr learned my addr 172.21.15.78:0/698156779 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:32.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa9077fe700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa908064340 0x7fa908142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa907fff700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9080c98b0 0x7fa908155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa906ffd700 1 -- 172.21.15.78:0/698156779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9080c98b0 msgr2=0x7fa908155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa906ffd700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9080c98b0 0x7fa908155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa906ffd700 1 -- 172.21.15.78:0/698156779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa908064340 msgr2=0x7fa908142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa906ffd700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa908064340 0x7fa908142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa906ffd700 1 -- 172.21.15.78:0/698156779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8009ae0 con 0x7fa9080bec60 2023-08-17T17:34:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa906ffd700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9080bec60 0x7fa9080a97a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fa8fc00b490 tx=0x7fa8fc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa8ef7fe700 1 -- 172.21.15.78:0/698156779 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc00be90 con 0x7fa9080bec60 2023-08-17T17:34:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa8ef7fe700 1 -- 172.21.15.78:0/698156779 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc012410 con 0x7fa9080bec60 2023-08-17T17:34:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9080aa5b0 con 0x7fa9080bec60 2023-08-17T17:34:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa8ef7fe700 1 -- 172.21.15.78:0/698156779 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0127b0 con 0x7fa9080bec60 2023-08-17T17:34:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.512+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9080a9c90 con 0x7fa9080bec60 2023-08-17T17:34:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.513+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa908047350 con 0x7fa9080bec60 2023-08-17T17:34:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.513+0000 7fa8ef7fe700 1 -- 172.21.15.78:0/698156779 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa8fc00f030 con 0x7fa9080bec60 2023-08-17T17:34:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.514+0000 7fa8ef7fe700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa8f405ed90 0x7fa8f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.514+0000 7fa8ef7fe700 1 -- 172.21.15.78:0/698156779 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa8fc0796d0 con 0x7fa9080bec60 2023-08-17T17:34:32.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.514+0000 7fa9077fe700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa8f405ed90 0x7fa8f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.514+0000 7fa8ef7fe700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] conn(0x7fa8f4067fc0 0x7fa8f406a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.514+0000 7fa8ef7fe700 1 -- 172.21.15.78:0/698156779 --> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8f406aaa0 con 0x7fa8f4067fc0 2023-08-17T17:34:32.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.514+0000 7fa8ef7fe700 1 -- 172.21.15.78:0/698156779 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8fc07bd40 con 0x7fa9080bec60 2023-08-17T17:34:32.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.514+0000 7fa907fff700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] conn(0x7fa8f4067fc0 0x7fa8f406a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.514+0000 7fa9077fe700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa8f405ed90 0x7fa8f4061250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa8f8009880 tx=0x7fa9080c6e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.514+0000 7fa907fff700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] conn(0x7fa8f4067fc0 0x7fa8f406a420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.515+0000 7fa8ef7fe700 1 -- 172.21.15.78:0/698156779 <== osd.1 v2:172.21.15.78:6816/119710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa8f406aaa0 con 0x7fa8f4067fc0 2023-08-17T17:34:32.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 --> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9080ac150 con 0x7fa8f4067fc0 2023-08-17T17:34:32.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa8ef7fe700 1 -- 172.21.15.78:0/698156779 <== osd.1 v2:172.21.15.78:6816/119710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa9080ac150 con 0x7fa8f4067fc0 2023-08-17T17:34:32.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] conn(0x7fa8f4067fc0 msgr2=0x7fa8f406a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] conn(0x7fa8f4067fc0 0x7fa8f406a420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa8f405ed90 msgr2=0x7fa8f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa8f405ed90 0x7fa8f4061250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa8f8009880 tx=0x7fa9080c6e20).stop 2023-08-17T17:34:32.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9080bec60 msgr2=0x7fa9080a97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 --2- 172.21.15.78:0/698156779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9080bec60 0x7fa9080a97a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fa8fc00b490 tx=0x7fa8fc006ef0).stop 2023-08-17T17:34:32.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa907fff700 1 -- 172.21.15.78:0/698156779 reap_dead start 2023-08-17T17:34:32.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 shutdown_connections 2023-08-17T17:34:32.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 >> 172.21.15.78:0/698156779 conn(0x7fa908062cd0 msgr2=0x7fa908064ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 shutdown_connections 2023-08-17T17:34:32.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.529+0000 7fa90e115700 1 -- 172.21.15.78:0/698156779 wait complete. 2023-08-17T17:34:32.542 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-08-17T17:34:32.542 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-17T17:34:32.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.654+0000 7f872befd700 1 Processor -- start 2023-08-17T17:34:32.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.654+0000 7f872befd700 1 -- start start 2023-08-17T17:34:32.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f872befd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f87240c0560 0x7f87240a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f872befd700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87240c7690 con 0x7f8724154580 2023-08-17T17:34:32.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f872befd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87240c8df0 con 0x7f87241541a0 2023-08-17T17:34:32.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f872befd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87240a8190 con 0x7f87240c0560 2023-08-17T17:34:32.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f8729498700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8724154580 0x7f87240c6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38194/0 (socket says 172.21.15.78:38194) 2023-08-17T17:34:32.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f8729498700 1 -- 172.21.15.78:0/1528718 learned_addr learned my addr 172.21.15.78:0/1528718 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:32.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f872a49a700 1 --2- 172.21.15.78:0/1528718 >> v2:172.21.15.150:3300/0 conn(0x7f87240c0560 0x7f87240a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f8728c97700 1 -- 172.21.15.78:0/1528718 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444995643 0 0) 0x7f8714001110 con 0x7f8724154580 2023-08-17T17:34:32.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f8728c97700 1 -- 172.21.15.78:0/1528718 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87100033f0 con 0x7f8724154580 2023-08-17T17:34:32.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f8728c97700 1 -- 172.21.15.78:0/1528718 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411088858 0 0) 0x7f87240c8df0 con 0x7f87241541a0 2023-08-17T17:34:32.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.655+0000 7f8728c97700 1 -- 172.21.15.78:0/1528718 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8714001110 con 0x7f87241541a0 2023-08-17T17:34:32.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872a49a700 1 -- 172.21.15.78:0/1528718 >> v1:172.21.15.150:6789/0 conn(0x7f87241541a0 legacy=0x7f87240bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872a49a700 1 -- 172.21.15.78:0/1528718 >> v1:172.21.15.78:6789/0 conn(0x7f8724154580 legacy=0x7f87240c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872a49a700 1 -- 172.21.15.78:0/1528718 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240c9970 con 0x7f87240c0560 2023-08-17T17:34:32.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872a49a700 1 --2- 172.21.15.78:0/1528718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87240c0560 0x7f87240a7ca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f871c009e60 tx=0x7f871c009780).ready entity=mon.1 client_cookie=1242b8ee6bebd4d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f8728c97700 1 -- 172.21.15.78:0/1528718 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00e070 con 0x7f87240c0560 2023-08-17T17:34:32.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f8728c97700 1 -- 172.21.15.78:0/1528718 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c00bab0 con 0x7f87240c0560 2023-08-17T17:34:32.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f8728c97700 1 -- 172.21.15.78:0/1528718 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00be30 con 0x7f87240c0560 2023-08-17T17:34:32.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872befd700 1 -- 172.21.15.78:0/1528718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87240c0560 msgr2=0x7f87240a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872befd700 1 --2- 172.21.15.78:0/1528718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87240c0560 0x7f87240a7ca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f871c009e60 tx=0x7f871c009780).stop 2023-08-17T17:34:32.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872befd700 1 -- 172.21.15.78:0/1528718 shutdown_connections 2023-08-17T17:34:32.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872befd700 1 --2- 172.21.15.78:0/1528718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87240c0560 0x7f87240a7ca0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872befd700 1 -- 172.21.15.78:0/1528718 >> 172.21.15.78:0/1528718 conn(0x7f872406a400 msgr2=0x7f87240caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872befd700 1 -- 172.21.15.78:0/1528718 shutdown_connections 2023-08-17T17:34:32.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.656+0000 7f872befd700 1 -- 172.21.15.78:0/1528718 wait complete. 2023-08-17T17:34:32.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f872befd700 1 Processor -- start 2023-08-17T17:34:32.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f872befd700 1 -- start start 2023-08-17T17:34:32.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f872befd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87240c0560 0x7f87241499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f872befd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87241541a0 0x7f87240afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f872befd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8724154580 0x7f872414b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f872befd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8724163e10 con 0x7f87241541a0 2023-08-17T17:34:32.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f872befd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240aedb0 con 0x7f8724154580 2023-08-17T17:34:32.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f872befd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87240af090 con 0x7f87240c0560 2023-08-17T17:34:32.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f8729498700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87241541a0 0x7f87240afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f8729498700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87241541a0 0x7f87240afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46812/0 (socket says 172.21.15.78:46812) 2023-08-17T17:34:32.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f8729498700 1 -- 172.21.15.78:0/1506094773 learned_addr learned my addr 172.21.15.78:0/1506094773 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:32.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f872a49a700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8724154580 0x7f872414b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.658+0000 7f8729c99700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87240c0560 0x7f87241499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f8729498700 1 -- 172.21.15.78:0/1506094773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87240c0560 msgr2=0x7f87241499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f8729498700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87240c0560 0x7f87241499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f8729498700 1 -- 172.21.15.78:0/1506094773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8724154580 msgr2=0x7f872414b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f8729498700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8724154580 0x7f872414b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f8729498700 1 -- 172.21.15.78:0/1506094773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c009a20 con 0x7f87241541a0 2023-08-17T17:34:32.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f872a49a700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8724154580 0x7f872414b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:32.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f8729498700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87241541a0 0x7f87240afd70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f871400c790 tx=0x7f8714007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f8719ffb700 1 -- 172.21.15.78:0/1506094773 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140072e0 con 0x7f87241541a0 2023-08-17T17:34:32.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f8719ffb700 1 -- 172.21.15.78:0/1506094773 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8714007440 con 0x7f87241541a0 2023-08-17T17:34:32.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87240af370 con 0x7f87241541a0 2023-08-17T17:34:32.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f8719ffb700 1 -- 172.21.15.78:0/1506094773 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140057a0 con 0x7f87241541a0 2023-08-17T17:34:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.659+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8724149eb0 con 0x7f87241541a0 2023-08-17T17:34:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.660+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8724047350 con 0x7f87241541a0 2023-08-17T17:34:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.660+0000 7f8719ffb700 1 -- 172.21.15.78:0/1506094773 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8714010070 con 0x7f87241541a0 2023-08-17T17:34:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.661+0000 7f8719ffb700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870805ed60 0x7f8708061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.661+0000 7f8719ffb700 1 -- 172.21.15.78:0/1506094773 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f87140790e0 con 0x7f87241541a0 2023-08-17T17:34:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.661+0000 7f8729c99700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870805ed60 0x7f8708061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.661+0000 7f8719ffb700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] conn(0x7f8708068100 0x7f870806a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.661+0000 7f8719ffb700 1 -- 172.21.15.78:0/1506094773 --> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f870806abe0 con 0x7f8708068100 2023-08-17T17:34:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.661+0000 7f8719ffb700 1 -- 172.21.15.78:0/1506094773 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f871407b750 con 0x7f87241541a0 2023-08-17T17:34:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.661+0000 7f872a49a700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] conn(0x7f8708068100 0x7f870806a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.661+0000 7f8729c99700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870805ed60 0x7f8708061220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f8720003920 tx=0x7f8720007b90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.661+0000 7f872a49a700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] conn(0x7f8708068100 0x7f870806a560 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.662+0000 7f8719ffb700 1 -- 172.21.15.78:0/1506094773 <== osd.2 v2:172.21.15.78:6808/119693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f870806abe0 con 0x7f8708068100 2023-08-17T17:34:32.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 --> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f872405f3f0 con 0x7f8708068100 2023-08-17T17:34:32.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f8719ffb700 1 -- 172.21.15.78:0/1506094773 <== osd.2 v2:172.21.15.78:6808/119693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f872405f3f0 con 0x7f8708068100 2023-08-17T17:34:32.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] conn(0x7f8708068100 msgr2=0x7f870806a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f872befd700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] conn(0x7f8708068100 0x7f870806a560 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870805ed60 msgr2=0x7f8708061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f872befd700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870805ed60 0x7f8708061220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f8720003920 tx=0x7f8720007b90).stop 2023-08-17T17:34:32.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87241541a0 msgr2=0x7f87240afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f872befd700 1 --2- 172.21.15.78:0/1506094773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87241541a0 0x7f87240afd70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f871400c790 tx=0x7f8714007c90).stop 2023-08-17T17:34:32.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f872a49a700 1 -- 172.21.15.78:0/1506094773 reap_dead start 2023-08-17T17:34:32.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 shutdown_connections 2023-08-17T17:34:32.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.676+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 >> 172.21.15.78:0/1506094773 conn(0x7f872406a400 msgr2=0x7f8724064940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.677+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 shutdown_connections 2023-08-17T17:34:32.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.677+0000 7f872befd700 1 -- 172.21.15.78:0/1506094773 wait complete. 2023-08-17T17:34:32.689 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-08-17T17:34:32.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-17T17:34:32.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.802+0000 7f0e1f582700 1 Processor -- start 2023-08-17T17:34:32.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.802+0000 7f0e1f582700 1 -- start start 2023-08-17T17:34:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.803+0000 7f0e1f582700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e181541a0 0x7f0e180a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.803+0000 7f0e1f582700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e180c0560 0x7f0e180c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.803+0000 7f0e1f582700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180c8df0 con 0x7f0e18154580 2023-08-17T17:34:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.803+0000 7f0e1f582700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180a8190 con 0x7f0e181541a0 2023-08-17T17:34:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.803+0000 7f0e1f582700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180c9970 con 0x7f0e180c0560 2023-08-17T17:34:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.803+0000 7f0e1cb1d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0e18154580 0x7f0e180bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38198/0 (socket says 172.21.15.78:38198) 2023-08-17T17:34:32.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.803+0000 7f0e1cb1d700 1 -- 172.21.15.78:0/215129755 learned_addr learned my addr 172.21.15.78:0/215129755 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:32.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e1db1f700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e180c0560 0x7f0e180c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e1d31e700 1 --2- 172.21.15.78:0/215129755 >> v2:172.21.15.150:3300/0 conn(0x7f0e181541a0 0x7f0e180a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347624385 0 0) 0x7f0e180c8df0 con 0x7f0e18154580 2023-08-17T17:34:32.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e040033f0 con 0x7f0e18154580 2023-08-17T17:34:32.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1171905665 0 0) 0x7f0e040033f0 con 0x7f0e18154580 2023-08-17T17:34:32.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e180c0560 msgr2=0x7f0e180c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e180c0560 0x7f0e180c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 >> v2:172.21.15.150:3300/0 conn(0x7f0e181541a0 msgr2=0x7f0e180a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 --2- 172.21.15.78:0/215129755 >> v2:172.21.15.150:3300/0 conn(0x7f0e181541a0 0x7f0e180a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180c9040 con 0x7f0e18154580 2023-08-17T17:34:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f0e08001470 con 0x7f0e18154580 2023-08-17T17:34:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 >> v1:172.21.15.78:6789/0 conn(0x7f0e18154580 legacy=0x7f0e180bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e040038e0 0x7f0e04003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e04004690 0x7f0e04004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e180c0560 0x7f0e04005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180a8190 con 0x7f0e040038e0 2023-08-17T17:34:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180c9970 con 0x7f0e04004690 2023-08-17T17:34:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0400b8e0 con 0x7f0e180c0560 2023-08-17T17:34:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e1d31e700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e040038e0 0x7f0e04003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e1cb1d700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e04004690 0x7f0e04004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e1db1f700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e180c0560 0x7f0e04005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e1d31e700 1 -- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e180c0560 msgr2=0x7f0e04005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:32.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e1d31e700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e180c0560 0x7f0e04005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e1d31e700 1 -- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e04004690 msgr2=0x7f0e04004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:32.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e1d31e700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e04004690 0x7f0e04004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.804+0000 7f0e1d31e700 1 -- 172.21.15.78:0/215129755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e040033f0 con 0x7f0e040038e0 2023-08-17T17:34:32.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e1d31e700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e040038e0 0x7f0e04003d00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f0e14009a80 tx=0x7f0e14009060).ready entity=mon.0 client_cookie=9c0f8d2511bb68f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14009430 con 0x7f0e040038e0 2023-08-17T17:34:32.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1400e640 con 0x7f0e040038e0 2023-08-17T17:34:32.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e0ffff700 1 -- 172.21.15.78:0/215129755 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1400e9c0 con 0x7f0e040038e0 2023-08-17T17:34:32.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e1f582700 1 -- 172.21.15.78:0/215129755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e040038e0 msgr2=0x7f0e04003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e1f582700 1 --2- 172.21.15.78:0/215129755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e040038e0 0x7f0e04003d00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f0e14009a80 tx=0x7f0e14009060).stop 2023-08-17T17:34:32.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e1db1f700 1 -- 172.21.15.78:0/215129755 reap_dead start 2023-08-17T17:34:32.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e1f582700 1 -- 172.21.15.78:0/215129755 shutdown_connections 2023-08-17T17:34:32.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e1f582700 1 -- 172.21.15.78:0/215129755 >> 172.21.15.78:0/215129755 conn(0x7f0e1806a400 msgr2=0x7f0e180caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e1f582700 1 -- 172.21.15.78:0/215129755 shutdown_connections 2023-08-17T17:34:32.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.805+0000 7f0e1f582700 1 -- 172.21.15.78:0/215129755 wait complete. 2023-08-17T17:34:32.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.806+0000 7f0e1f582700 1 Processor -- start 2023-08-17T17:34:32.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.806+0000 7f0e1f582700 1 -- start start 2023-08-17T17:34:32.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1f582700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e040038e0 0x7f0e181677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1f582700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e180ae740 0x7f0e180c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1f582700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e18149e20 0x7f0e180c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1f582700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18155cb0 con 0x7f0e180ae740 2023-08-17T17:34:32.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1f582700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18167d90 con 0x7f0e040038e0 2023-08-17T17:34:32.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1f582700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18168070 con 0x7f0e18149e20 2023-08-17T17:34:32.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1cb1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e180ae740 0x7f0e180c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1cb1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e180ae740 0x7f0e180c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46824/0 (socket says 172.21.15.78:46824) 2023-08-17T17:34:32.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1cb1d700 1 -- 172.21.15.78:0/410109955 learned_addr learned my addr 172.21.15.78:0/410109955 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:32.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1d31e700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e040038e0 0x7f0e181677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.807+0000 7f0e1db1f700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e18149e20 0x7f0e180c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e1cb1d700 1 -- 172.21.15.78:0/410109955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e18149e20 msgr2=0x7f0e180c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e1cb1d700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e18149e20 0x7f0e180c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e1cb1d700 1 -- 172.21.15.78:0/410109955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e040038e0 msgr2=0x7f0e181677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e1cb1d700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e040038e0 0x7f0e181677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e1cb1d700 1 -- 172.21.15.78:0/410109955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18168350 con 0x7f0e180ae740 2023-08-17T17:34:32.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e1cb1d700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e180ae740 0x7f0e180c3930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0e08000fd0 tx=0x7f0e08001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e0d7fa700 1 -- 172.21.15.78:0/410109955 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08011590 con 0x7f0e180ae740 2023-08-17T17:34:32.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e0d7fa700 1 -- 172.21.15.78:0/410109955 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e080116f0 con 0x7f0e180ae740 2023-08-17T17:34:32.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e0d7fa700 1 -- 172.21.15.78:0/410109955 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08011a70 con 0x7f0e180ae740 2023-08-17T17:34:32.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e180c3e20 con 0x7f0e180ae740 2023-08-17T17:34:32.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.808+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1814a2a0 con 0x7f0e180ae740 2023-08-17T17:34:32.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.809+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e18047350 con 0x7f0e180ae740 2023-08-17T17:34:32.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.809+0000 7f0e0d7fa700 1 -- 172.21.15.78:0/410109955 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0e0801b030 con 0x7f0e180ae740 2023-08-17T17:34:32.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.809+0000 7f0e0d7fa700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0dfc05ed90 0x7f0dfc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.810+0000 7f0e0d7fa700 1 -- 172.21.15.78:0/410109955 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0e08079400 con 0x7f0e180ae740 2023-08-17T17:34:32.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.810+0000 7f0e1d31e700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0dfc05ed90 0x7f0dfc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.810+0000 7f0e0d7fa700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] conn(0x7f0dfc068130 0x7f0dfc06a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.810+0000 7f0e0d7fa700 1 -- 172.21.15.78:0/410109955 --> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0dfc06ac10 con 0x7f0dfc068130 2023-08-17T17:34:32.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.810+0000 7f0e0d7fa700 1 -- 172.21.15.78:0/410109955 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e0807b960 con 0x7f0e180ae740 2023-08-17T17:34:32.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.810+0000 7f0e1db1f700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] conn(0x7f0dfc068130 0x7f0dfc06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.810+0000 7f0e1d31e700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0dfc05ed90 0x7f0dfc061250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0e14006d50 tx=0x7f0e1401a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.810+0000 7f0e1db1f700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] conn(0x7f0dfc068130 0x7f0dfc06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.811+0000 7f0e0d7fa700 1 -- 172.21.15.78:0/410109955 <== osd.3 v2:172.21.15.78:6824/119728 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f0dfc06ac10 con 0x7f0dfc068130 2023-08-17T17:34:32.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 --> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e18155df0 con 0x7f0dfc068130 2023-08-17T17:34:32.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e0d7fa700 1 -- 172.21.15.78:0/410109955 <== osd.3 v2:172.21.15.78:6824/119728 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e18155df0 con 0x7f0dfc068130 2023-08-17T17:34:32.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] conn(0x7f0dfc068130 msgr2=0x7f0dfc06a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] conn(0x7f0dfc068130 0x7f0dfc06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0dfc05ed90 msgr2=0x7f0dfc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0dfc05ed90 0x7f0dfc061250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0e14006d50 tx=0x7f0e1401a000).stop 2023-08-17T17:34:32.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e180ae740 msgr2=0x7f0e180c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 --2- 172.21.15.78:0/410109955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e180ae740 0x7f0e180c3930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0e08000fd0 tx=0x7f0e08001e90).stop 2023-08-17T17:34:32.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1db1f700 1 -- 172.21.15.78:0/410109955 reap_dead start 2023-08-17T17:34:32.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 shutdown_connections 2023-08-17T17:34:32.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 >> 172.21.15.78:0/410109955 conn(0x7f0e1806a400 msgr2=0x7f0e180c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 shutdown_connections 2023-08-17T17:34:32.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.825+0000 7f0e1f582700 1 -- 172.21.15.78:0/410109955 wait complete. 2023-08-17T17:34:32.838 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-08-17T17:34:32.838 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-17T17:34:32.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.950+0000 7f958371f700 1 Processor -- start 2023-08-17T17:34:32.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.951+0000 7f958371f700 1 -- start start 2023-08-17T17:34:32.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.951+0000 7f958371f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f957c1541a0 0x7f957c0a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.951+0000 7f958371f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f957c0c0560 0x7f957c0c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.951+0000 7f958371f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957c0c8df0 con 0x7f957c154580 2023-08-17T17:34:32.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.951+0000 7f958371f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957c0a8190 con 0x7f957c1541a0 2023-08-17T17:34:32.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.951+0000 7f958371f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957c0c9970 con 0x7f957c0c0560 2023-08-17T17:34:32.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f95814bb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f957c1541a0 0x7f957c0a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f95814bb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f957c1541a0 0x7f957c0a7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46840/0 (socket says 172.21.15.78:46840) 2023-08-17T17:34:32.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f95814bb700 1 -- 172.21.15.78:0/550117912 learned_addr learned my addr 172.21.15.78:0/550117912 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:32.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f9581cbc700 1 --2- 172.21.15.78:0/550117912 >> v2:172.21.15.150:3300/0 conn(0x7f957c0c0560 0x7f957c0c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f95814bb700 1 -- 172.21.15.78:0/550117912 >> v2:172.21.15.150:3300/0 conn(0x7f957c0c0560 msgr2=0x7f957c0c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:32.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f95814bb700 1 --2- 172.21.15.78:0/550117912 >> v2:172.21.15.150:3300/0 conn(0x7f957c0c0560 0x7f957c0c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f95814bb700 1 -- 172.21.15.78:0/550117912 >> v1:172.21.15.150:6789/0 conn(0x7f957c154580 legacy=0x7f957c0bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f95814bb700 1 -- 172.21.15.78:0/550117912 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c0c9040 con 0x7f957c1541a0 2023-08-17T17:34:32.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f95814bb700 1 --2- 172.21.15.78:0/550117912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c1541a0 0x7f957c0a7ca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f957c157d80 tx=0x7f95780090f0).ready entity=mon.0 client_cookie=e76e519d59aaade8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f9573fff700 1 -- 172.21.15.78:0/550117912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957800b600 con 0x7f957c1541a0 2023-08-17T17:34:32.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f9573fff700 1 -- 172.21.15.78:0/550117912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957800b760 con 0x7f957c1541a0 2023-08-17T17:34:32.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.952+0000 7f9573fff700 1 -- 172.21.15.78:0/550117912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957800bb00 con 0x7f957c1541a0 2023-08-17T17:34:32.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.953+0000 7f958371f700 1 -- 172.21.15.78:0/550117912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c1541a0 msgr2=0x7f957c0a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.953+0000 7f958371f700 1 --2- 172.21.15.78:0/550117912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c1541a0 0x7f957c0a7ca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f957c157d80 tx=0x7f95780090f0).stop 2023-08-17T17:34:32.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.953+0000 7f958371f700 1 -- 172.21.15.78:0/550117912 shutdown_connections 2023-08-17T17:34:32.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.953+0000 7f958371f700 1 --2- 172.21.15.78:0/550117912 >> v2:172.21.15.150:3300/0 conn(0x7f957c0c0560 0x7f957c0c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.953+0000 7f958371f700 1 --2- 172.21.15.78:0/550117912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c1541a0 0x7f957c0a7ca0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.953+0000 7f958371f700 1 -- 172.21.15.78:0/550117912 >> 172.21.15.78:0/550117912 conn(0x7f957c06a400 msgr2=0x7f957c0caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.953+0000 7f958371f700 1 -- 172.21.15.78:0/550117912 shutdown_connections 2023-08-17T17:34:32.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.953+0000 7f958371f700 1 -- 172.21.15.78:0/550117912 wait complete. 2023-08-17T17:34:32.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.954+0000 7f958371f700 1 Processor -- start 2023-08-17T17:34:32.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.954+0000 7f958371f700 1 -- start start 2023-08-17T17:34:32.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f958371f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f957c0c0560 0x7f957c14d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f958371f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f957c1541a0 0x7f957c164320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f958371f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c154580 0x7f957c14e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f958371f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c0aeed0 con 0x7f957c154580 2023-08-17T17:34:32.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f958371f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c0afcf0 con 0x7f957c0c0560 2023-08-17T17:34:32.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f958371f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957c0af0e0 con 0x7f957c1541a0 2023-08-17T17:34:32.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f9581cbc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c154580 0x7f957c14e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f9581cbc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c154580 0x7f957c14e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46852/0 (socket says 172.21.15.78:46852) 2023-08-17T17:34:32.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f9581cbc700 1 -- 172.21.15.78:0/1354650497 learned_addr learned my addr 172.21.15.78:0/1354650497 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f95814bb700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f957c0c0560 0x7f957c14d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f9580cba700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f957c1541a0 0x7f957c164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f9581cbc700 1 -- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f957c1541a0 msgr2=0x7f957c164320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f9581cbc700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f957c1541a0 0x7f957c164320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f9581cbc700 1 -- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f957c0c0560 msgr2=0x7f957c14d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f9581cbc700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f957c0c0560 0x7f957c14d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f9581cbc700 1 -- 172.21.15.78:0/1354650497 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578009370 con 0x7f957c154580 2023-08-17T17:34:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f9581cbc700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c154580 0x7f957c14e2d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f9574007f50 tx=0x7f9574009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f95717fa700 1 -- 172.21.15.78:0/1354650497 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957400ecd0 con 0x7f957c154580 2023-08-17T17:34:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f95717fa700 1 -- 172.21.15.78:0/1354650497 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957400ee30 con 0x7f957c154580 2023-08-17T17:34:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957c0af3c0 con 0x7f957c154580 2023-08-17T17:34:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.955+0000 7f95717fa700 1 -- 172.21.15.78:0/1354650497 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574014610 con 0x7f957c154580 2023-08-17T17:34:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.956+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957c0af980 con 0x7f957c154580 2023-08-17T17:34:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.956+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f957c047350 con 0x7f957c154580 2023-08-17T17:34:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.957+0000 7f95717fa700 1 -- 172.21.15.78:0/1354650497 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f957401b030 con 0x7f957c154580 2023-08-17T17:34:32.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.957+0000 7f95717fa700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f956005ed90 0x7f9560061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.957+0000 7f95717fa700 1 -- 172.21.15.78:0/1354650497 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f957407a7a0 con 0x7f957c154580 2023-08-17T17:34:32.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.957+0000 7f95814bb700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f956005ed90 0x7f9560061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.957+0000 7f95717fa700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] conn(0x7f95600681b0 0x7f956006a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:32.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.957+0000 7f95717fa700 1 -- 172.21.15.78:0/1354650497 --> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f956006ac90 con 0x7f95600681b0 2023-08-17T17:34:32.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.957+0000 7f95717fa700 1 -- 172.21.15.78:0/1354650497 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f957407aad0 con 0x7f957c154580 2023-08-17T17:34:32.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.958+0000 7f95814bb700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f956005ed90 0x7f9560061250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f957c156e00 tx=0x7f9578017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.958+0000 7f9580cba700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] conn(0x7f95600681b0 0x7f956006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:32.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.958+0000 7f9580cba700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] conn(0x7f95600681b0 0x7f956006a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:32.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.959+0000 7f95717fa700 1 -- 172.21.15.78:0/1354650497 <== osd.4 v2:172.21.15.150:6808/90933 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f956006ac90 con 0x7f95600681b0 2023-08-17T17:34:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.973+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 --> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f957c0c9320 con 0x7f95600681b0 2023-08-17T17:34:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.973+0000 7f95717fa700 1 -- 172.21.15.78:0/1354650497 <== osd.4 v2:172.21.15.150:6808/90933 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f957c0c9320 con 0x7f95600681b0 2023-08-17T17:34:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.973+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] conn(0x7f95600681b0 msgr2=0x7f956006a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.974+0000 7f958371f700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] conn(0x7f95600681b0 0x7f956006a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.974+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f956005ed90 msgr2=0x7f9560061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.974+0000 7f958371f700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f956005ed90 0x7f9560061250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f957c156e00 tx=0x7f9578017000).stop 2023-08-17T17:34:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.974+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c154580 msgr2=0x7f957c14e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.974+0000 7f958371f700 1 --2- 172.21.15.78:0/1354650497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c154580 0x7f957c14e2d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f9574007f50 tx=0x7f9574009860).stop 2023-08-17T17:34:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.974+0000 7f9581cbc700 1 -- 172.21.15.78:0/1354650497 reap_dead start 2023-08-17T17:34:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.974+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 shutdown_connections 2023-08-17T17:34:32.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.974+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 >> 172.21.15.78:0/1354650497 conn(0x7f957c06a400 msgr2=0x7f957c14f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:32.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.974+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 shutdown_connections 2023-08-17T17:34:32.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:32.974+0000 7f958371f700 1 -- 172.21.15.78:0/1354650497 wait complete. 2023-08-17T17:34:32.986 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-08-17T17:34:32.987 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-17T17:34:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.098+0000 7f7bcb443700 1 Processor -- start 2023-08-17T17:34:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.098+0000 7f7bcb443700 1 -- start start 2023-08-17T17:34:33.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.099+0000 7f7bcb443700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7bc41541a0 0x7f7bc40a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.099+0000 7f7bcb443700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7bc40c0560 0x7f7bc40c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.099+0000 7f7bcb443700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc40c8df0 con 0x7f7bc4154580 2023-08-17T17:34:33.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.099+0000 7f7bcb443700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40a8190 con 0x7f7bc40c0560 2023-08-17T17:34:33.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.099+0000 7f7bcb443700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40c9970 con 0x7f7bc41541a0 2023-08-17T17:34:33.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.099+0000 7f7bc99e0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7bc40c0560 0x7f7bc40c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.099+0000 7f7bc99e0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7bc40c0560 0x7f7bc40c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46858/0 (socket says 172.21.15.78:46858) 2023-08-17T17:34:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.099+0000 7f7bc99e0700 1 -- 172.21.15.78:0/1626361631 learned_addr learned my addr 172.21.15.78:0/1626361631 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.099+0000 7f7bc91df700 1 --2- 172.21.15.78:0/1626361631 >> v2:172.21.15.150:3300/0 conn(0x7f7bc41541a0 0x7f7bc40a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bc99e0700 1 -- 172.21.15.78:0/1626361631 >> v2:172.21.15.150:3300/0 conn(0x7f7bc41541a0 msgr2=0x7f7bc40a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bc99e0700 1 --2- 172.21.15.78:0/1626361631 >> v2:172.21.15.150:3300/0 conn(0x7f7bc41541a0 0x7f7bc40a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bc99e0700 1 -- 172.21.15.78:0/1626361631 >> v1:172.21.15.150:6789/0 conn(0x7f7bc4154580 legacy=0x7f7bc40bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bc99e0700 1 -- 172.21.15.78:0/1626361631 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc40c9040 con 0x7f7bc40c0560 2023-08-17T17:34:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bc91df700 1 --2- 172.21.15.78:0/1626361631 >> v2:172.21.15.150:3300/0 conn(0x7f7bc41541a0 0x7f7bc40a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bc99e0700 1 --2- 172.21.15.78:0/1626361631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc40c0560 0x7f7bc40c6f80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7bc40cae50 tx=0x7f7bbc0090f0).ready entity=mon.0 client_cookie=58cde99c8a11fe6d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bbbfff700 1 -- 172.21.15.78:0/1626361631 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00b520 con 0x7f7bc40c0560 2023-08-17T17:34:33.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bbbfff700 1 -- 172.21.15.78:0/1626361631 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00b680 con 0x7f7bc40c0560 2023-08-17T17:34:33.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bbbfff700 1 -- 172.21.15.78:0/1626361631 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00ba20 con 0x7f7bc40c0560 2023-08-17T17:34:33.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bcb443700 1 -- 172.21.15.78:0/1626361631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc40c0560 msgr2=0x7f7bc40c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.100+0000 7f7bcb443700 1 --2- 172.21.15.78:0/1626361631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc40c0560 0x7f7bc40c6f80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7bc40cae50 tx=0x7f7bbc0090f0).stop 2023-08-17T17:34:33.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.101+0000 7f7bcb443700 1 -- 172.21.15.78:0/1626361631 shutdown_connections 2023-08-17T17:34:33.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.101+0000 7f7bcb443700 1 --2- 172.21.15.78:0/1626361631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc40c0560 0x7f7bc40c6f80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.101+0000 7f7bcb443700 1 --2- 172.21.15.78:0/1626361631 >> v2:172.21.15.150:3300/0 conn(0x7f7bc41541a0 0x7f7bc40a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.101+0000 7f7bcb443700 1 -- 172.21.15.78:0/1626361631 >> 172.21.15.78:0/1626361631 conn(0x7f7bc406a400 msgr2=0x7f7bc40caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:33.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.101+0000 7f7bcb443700 1 -- 172.21.15.78:0/1626361631 shutdown_connections 2023-08-17T17:34:33.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.101+0000 7f7bcb443700 1 -- 172.21.15.78:0/1626361631 wait complete. 2023-08-17T17:34:33.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.102+0000 7f7bcb443700 1 Processor -- start 2023-08-17T17:34:33.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.102+0000 7f7bcb443700 1 -- start start 2023-08-17T17:34:33.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bcb443700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bc40c0560 0x7f7bc4147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bcb443700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc41541a0 0x7f7bc40c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bcb443700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc4154580 0x7f7bc40c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bcb443700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40c8340 con 0x7f7bc41541a0 2023-08-17T17:34:33.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bcb443700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40b0fa0 con 0x7f7bc4154580 2023-08-17T17:34:33.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bcb443700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc414d3d0 con 0x7f7bc40c0560 2023-08-17T17:34:33.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc89de700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc41541a0 0x7f7bc40c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc89de700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc41541a0 0x7f7bc40c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46864/0 (socket says 172.21.15.78:46864) 2023-08-17T17:34:33.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc89de700 1 -- 172.21.15.78:0/4001438303 learned_addr learned my addr 172.21.15.78:0/4001438303 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:33.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc91df700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bc40c0560 0x7f7bc4147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc99e0700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc4154580 0x7f7bc40c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc89de700 1 -- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bc40c0560 msgr2=0x7f7bc4147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc89de700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bc40c0560 0x7f7bc4147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc89de700 1 -- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc4154580 msgr2=0x7f7bc40c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc89de700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bc4154580 0x7f7bc40c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc89de700 1 -- 172.21.15.78:0/4001438303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0009a20 con 0x7f7bc41541a0 2023-08-17T17:34:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bc89de700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc41541a0 0x7f7bc40c7960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f7bb400c440 tx=0x7f7bb4007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bb97fa700 1 -- 172.21.15.78:0/4001438303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4007020 con 0x7f7bc41541a0 2023-08-17T17:34:33.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bb97fa700 1 -- 172.21.15.78:0/4001438303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4007180 con 0x7f7bc41541a0 2023-08-17T17:34:33.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bbc009370 con 0x7f7bc41541a0 2023-08-17T17:34:33.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bb97fa700 1 -- 172.21.15.78:0/4001438303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4007540 con 0x7f7bc41541a0 2023-08-17T17:34:33.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.103+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc4148230 con 0x7f7bc41541a0 2023-08-17T17:34:33.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.104+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7bc4047350 con 0x7f7bc41541a0 2023-08-17T17:34:33.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.105+0000 7f7bb97fa700 1 -- 172.21.15.78:0/4001438303 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7bb4010070 con 0x7f7bc41541a0 2023-08-17T17:34:33.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.105+0000 7f7bb97fa700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ba805ed60 0x7f7ba8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.105+0000 7f7bb97fa700 1 -- 172.21.15.78:0/4001438303 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7bb4078be0 con 0x7f7bc41541a0 2023-08-17T17:34:33.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.105+0000 7f7bc91df700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ba805ed60 0x7f7ba8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.105+0000 7f7bb97fa700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] conn(0x7f7ba8068100 0x7f7ba806a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.105+0000 7f7bb97fa700 1 -- 172.21.15.78:0/4001438303 --> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ba806abe0 con 0x7f7ba8068100 2023-08-17T17:34:33.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.105+0000 7f7bb97fa700 1 -- 172.21.15.78:0/4001438303 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bb407b250 con 0x7f7bc41541a0 2023-08-17T17:34:33.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.105+0000 7f7bc91df700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ba805ed60 0x7f7ba8061220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7bc0009fd0 tx=0x7f7bc000b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.105+0000 7f7bc99e0700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] conn(0x7f7ba8068100 0x7f7ba806a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.106+0000 7f7bc99e0700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] conn(0x7f7ba8068100 0x7f7ba806a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.106+0000 7f7bb97fa700 1 -- 172.21.15.78:0/4001438303 <== osd.5 v2:172.21.15.150:6824/90972 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f7ba806abe0 con 0x7f7ba8068100 2023-08-17T17:34:33.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.120+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 --> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7bc414d510 con 0x7f7ba8068100 2023-08-17T17:34:33.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.121+0000 7f7bb97fa700 1 -- 172.21.15.78:0/4001438303 <== osd.5 v2:172.21.15.150:6824/90972 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7bc414d510 con 0x7f7ba8068100 2023-08-17T17:34:33.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.121+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] conn(0x7f7ba8068100 msgr2=0x7f7ba806a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.121+0000 7f7bcb443700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] conn(0x7f7ba8068100 0x7f7ba806a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.121+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ba805ed60 msgr2=0x7f7ba8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.121+0000 7f7bcb443700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ba805ed60 0x7f7ba8061220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7bc0009fd0 tx=0x7f7bc000b040).stop 2023-08-17T17:34:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.121+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc41541a0 msgr2=0x7f7bc40c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.121+0000 7f7bcb443700 1 --2- 172.21.15.78:0/4001438303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc41541a0 0x7f7bc40c7960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f7bb400c440 tx=0x7f7bb4007da0).stop 2023-08-17T17:34:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.121+0000 7f7bc99e0700 1 -- 172.21.15.78:0/4001438303 reap_dead start 2023-08-17T17:34:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.121+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 shutdown_connections 2023-08-17T17:34:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.121+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 >> 172.21.15.78:0/4001438303 conn(0x7f7bc406a400 msgr2=0x7f7bc4149b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.122+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 shutdown_connections 2023-08-17T17:34:33.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.122+0000 7f7bcb443700 1 -- 172.21.15.78:0/4001438303 wait complete. 2023-08-17T17:34:33.134 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-08-17T17:34:33.134 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-17T17:34:33.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.248+0000 7f07a88a3700 1 Processor -- start 2023-08-17T17:34:33.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.248+0000 7f07a88a3700 1 -- start start 2023-08-17T17:34:33.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.249+0000 7f07a88a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a41541a0 0x7f07a40a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.249+0000 7f07a88a3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f07a40c0560 0x7f07a40c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.249+0000 7f07a88a3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a40c8df0 con 0x7f07a4154580 2023-08-17T17:34:33.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.249+0000 7f07a88a3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a40a8190 con 0x7f07a40c0560 2023-08-17T17:34:33.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.249+0000 7f07a88a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40c9970 con 0x7f07a41541a0 2023-08-17T17:34:33.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a1d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f07a4154580 0x7f07a40bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38210/0 (socket says 172.21.15.78:38210) 2023-08-17T17:34:33.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a1d9b700 1 -- 172.21.15.78:0/504467717 learned_addr learned my addr 172.21.15.78:0/504467717 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:33.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784312804 0 0) 0x7f07a40c8df0 con 0x7f07a4154580 2023-08-17T17:34:33.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a259c700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a41541a0 0x7f07a40a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a2d9d700 1 --2- 172.21.15.78:0/504467717 >> v2:172.21.15.150:3300/0 conn(0x7f07a40c0560 0x7f07a40c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07900033f0 con 0x7f07a4154580 2023-08-17T17:34:33.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 899368830 0 0) 0x7f07900033f0 con 0x7f07a4154580 2023-08-17T17:34:33.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a41541a0 msgr2=0x7f07a40a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a41541a0 0x7f07a40a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 >> v2:172.21.15.150:3300/0 conn(0x7f07a40c0560 msgr2=0x7f07a40c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 --2- 172.21.15.78:0/504467717 >> v2:172.21.15.150:3300/0 conn(0x7f07a40c0560 0x7f07a40c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a40c9040 con 0x7f07a4154580 2023-08-17T17:34:33.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f078c001470 con 0x7f07a4154580 2023-08-17T17:34:33.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a2d9d700 1 --2- 172.21.15.78:0/504467717 >> v2:172.21.15.150:3300/0 conn(0x7f07a40c0560 0x7f07a40c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:33.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 >> v1:172.21.15.78:6789/0 conn(0x7f07a4154580 legacy=0x7f07a40bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07900038e0 0x7f0790003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a41541a0 0x7f0790004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0790004b80 0x7f0790005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40a8190 con 0x7f07900038e0 2023-08-17T17:34:33.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40c9970 con 0x7f0790004b80 2023-08-17T17:34:33.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079000b960 con 0x7f07a41541a0 2023-08-17T17:34:33.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a259c700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07900038e0 0x7f0790003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a1d9b700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a41541a0 0x7f0790004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a2d9d700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0790004b80 0x7f0790005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a259c700 1 -- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a41541a0 msgr2=0x7f0790004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a259c700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a41541a0 0x7f0790004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a259c700 1 -- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0790004b80 msgr2=0x7f0790005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a259c700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0790004b80 0x7f0790005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a259c700 1 -- 172.21.15.78:0/504467717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07900033f0 con 0x7f07900038e0 2023-08-17T17:34:33.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.250+0000 7f07a2d9d700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0790004b80 0x7f0790005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:33.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a259c700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07900038e0 0x7f0790003d00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f079400e210 tx=0x7f079400b040).ready entity=mon.0 client_cookie=87abc2fe9c70efc6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794009ac0 con 0x7f07900038e0 2023-08-17T17:34:33.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079400f040 con 0x7f07900038e0 2023-08-17T17:34:33.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a159a700 1 -- 172.21.15.78:0/504467717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079400ecd0 con 0x7f07900038e0 2023-08-17T17:34:33.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a88a3700 1 -- 172.21.15.78:0/504467717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07900038e0 msgr2=0x7f0790003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a88a3700 1 --2- 172.21.15.78:0/504467717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07900038e0 0x7f0790003d00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f079400e210 tx=0x7f079400b040).stop 2023-08-17T17:34:33.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a2d9d700 1 -- 172.21.15.78:0/504467717 reap_dead start 2023-08-17T17:34:33.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a88a3700 1 -- 172.21.15.78:0/504467717 shutdown_connections 2023-08-17T17:34:33.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a88a3700 1 -- 172.21.15.78:0/504467717 >> 172.21.15.78:0/504467717 conn(0x7f07a406a400 msgr2=0x7f07a40caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:33.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a88a3700 1 -- 172.21.15.78:0/504467717 shutdown_connections 2023-08-17T17:34:33.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.251+0000 7f07a88a3700 1 -- 172.21.15.78:0/504467717 wait complete. 2023-08-17T17:34:33.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.252+0000 7f07a88a3700 1 Processor -- start 2023-08-17T17:34:33.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.252+0000 7f07a88a3700 1 -- start start 2023-08-17T17:34:33.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a88a3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07900038e0 0x7f07a41460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a88a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a415a920 0x7f07a4159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a88a3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a40ae720 0x7f07a40aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a88a3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40af090 con 0x7f07a40ae720 2023-08-17T17:34:33.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a88a3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40c35b0 con 0x7f07900038e0 2023-08-17T17:34:33.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a88a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40c2c80 con 0x7f07a415a920 2023-08-17T17:34:33.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a2d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a40ae720 0x7f07a40aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a2d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a40ae720 0x7f07a40aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46868/0 (socket says 172.21.15.78:46868) 2023-08-17T17:34:33.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a2d9d700 1 -- 172.21.15.78:0/659590820 learned_addr learned my addr 172.21.15.78:0/659590820 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:33.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a259c700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07900038e0 0x7f07a41460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.253+0000 7f07a1d9b700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a415a920 0x7f07a4159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f07a2d9d700 1 -- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a415a920 msgr2=0x7f07a4159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f07a2d9d700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07a415a920 0x7f07a4159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f07a2d9d700 1 -- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07900038e0 msgr2=0x7f07a41460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f07a2d9d700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07900038e0 0x7f07a41460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f07a2d9d700 1 -- 172.21.15.78:0/659590820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a40c2f60 con 0x7f07a40ae720 2023-08-17T17:34:33.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f07a2d9d700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a40ae720 0x7f07a40aeba0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f07a40c5480 tx=0x7f079c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f079a7fc700 1 -- 172.21.15.78:0/659590820 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c00fd60 con 0x7f07a40ae720 2023-08-17T17:34:33.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f079a7fc700 1 -- 172.21.15.78:0/659590820 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c00fec0 con 0x7f07a40ae720 2023-08-17T17:34:33.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a40c3240 con 0x7f07a40ae720 2023-08-17T17:34:33.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f079a7fc700 1 -- 172.21.15.78:0/659590820 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c013630 con 0x7f07a40ae720 2023-08-17T17:34:33.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a41465d0 con 0x7f07a40ae720 2023-08-17T17:34:33.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.254+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07a4047350 con 0x7f07a40ae720 2023-08-17T17:34:33.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.255+0000 7f079a7fc700 1 -- 172.21.15.78:0/659590820 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f079c0139a0 con 0x7f07a40ae720 2023-08-17T17:34:33.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.255+0000 7f079a7fc700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f078405ed90 0x7f0784061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.255+0000 7f079a7fc700 1 -- 172.21.15.78:0/659590820 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f079c07a250 con 0x7f07a40ae720 2023-08-17T17:34:33.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.256+0000 7f07a259c700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f078405ed90 0x7f0784061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.256+0000 7f079a7fc700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] conn(0x7f0784068130 0x7f078406a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.256+0000 7f079a7fc700 1 -- 172.21.15.78:0/659590820 --> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f078406ac10 con 0x7f0784068130 2023-08-17T17:34:33.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.256+0000 7f079a7fc700 1 -- 172.21.15.78:0/659590820 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f079c07a650 con 0x7f07a40ae720 2023-08-17T17:34:33.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.256+0000 7f07a259c700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f078405ed90 0x7f0784061250 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f079400afd0 tx=0x7f079401a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.256+0000 7f07a1d9b700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] conn(0x7f0784068130 0x7f078406a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.256+0000 7f07a1d9b700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] conn(0x7f0784068130 0x7f078406a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.257+0000 7f079a7fc700 1 -- 172.21.15.78:0/659590820 <== osd.6 v2:172.21.15.150:6800/90934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f078406ac10 con 0x7f0784068130 2023-08-17T17:34:33.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.271+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 --> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f07a40c9320 con 0x7f0784068130 2023-08-17T17:34:33.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f079a7fc700 1 -- 172.21.15.78:0/659590820 <== osd.6 v2:172.21.15.150:6800/90934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f07a40c9320 con 0x7f0784068130 2023-08-17T17:34:33.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] conn(0x7f0784068130 msgr2=0x7f078406a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a88a3700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] conn(0x7f0784068130 0x7f078406a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f078405ed90 msgr2=0x7f0784061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a88a3700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f078405ed90 0x7f0784061250 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f079400afd0 tx=0x7f079401a000).stop 2023-08-17T17:34:33.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a40ae720 msgr2=0x7f07a40aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a88a3700 1 --2- 172.21.15.78:0/659590820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a40ae720 0x7f07a40aeba0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f07a40c5480 tx=0x7f079c008040).stop 2023-08-17T17:34:33.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a2d9d700 1 -- 172.21.15.78:0/659590820 reap_dead start 2023-08-17T17:34:33.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 shutdown_connections 2023-08-17T17:34:33.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 >> 172.21.15.78:0/659590820 conn(0x7f07a406a400 msgr2=0x7f07a41528a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:33.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 shutdown_connections 2023-08-17T17:34:33.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.272+0000 7f07a88a3700 1 -- 172.21.15.78:0/659590820 wait complete. 2023-08-17T17:34:33.285 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-08-17T17:34:33.285 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-17T17:34:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.397+0000 7f6738a99700 1 Processor -- start 2023-08-17T17:34:33.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.397+0000 7f6738a99700 1 -- start start 2023-08-17T17:34:33.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.398+0000 7f6738a99700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f67340c0e30 0x7f67340c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.398+0000 7f6738a99700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67340c9ca0 con 0x7f6734153f80 2023-08-17T17:34:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.398+0000 7f6738a99700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67340c96b0 con 0x7f67340cb890 2023-08-17T17:34:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.398+0000 7f6738a99700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67340a8290 con 0x7f67340c0e30 2023-08-17T17:34:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.398+0000 7f67337fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6734153f80 0x7f67340a7b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38216/0 (socket says 172.21.15.78:38216) 2023-08-17T17:34:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.398+0000 7f67337fe700 1 -- 172.21.15.78:0/3058147178 learned_addr learned my addr 172.21.15.78:0/3058147178 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.398+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680931626 0 0) 0x7f67340c9ca0 con 0x7f6734153f80 2023-08-17T17:34:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.398+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f671c0033f0 con 0x7f6734153f80 2023-08-17T17:34:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.398+0000 7f6733fff700 1 --2- 172.21.15.78:0/3058147178 >> v2:172.21.15.150:3300/0 conn(0x7f67340c0e30 0x7f67340c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3952679987 0 0) 0x7f671c0033f0 con 0x7f6734153f80 2023-08-17T17:34:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 >> v2:172.21.15.150:3300/0 conn(0x7f67340c0e30 msgr2=0x7f67340c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 --2- 172.21.15.78:0/3058147178 >> v2:172.21.15.150:3300/0 conn(0x7f67340c0e30 0x7f67340c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 >> v1:172.21.15.150:6789/0 conn(0x7f67340cb890 legacy=0x7f67340c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67340c0080 con 0x7f6734153f80 2023-08-17T17:34:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f67240015f0 con 0x7f6734153f80 2023-08-17T17:34:33.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 >> v1:172.21.15.78:6789/0 conn(0x7f6734153f80 legacy=0x7f67340a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c0038e0 0x7f671c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f671c004690 0x7f671c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f671c005000 0x7f671c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67340a8290 con 0x7f671c0038e0 2023-08-17T17:34:33.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c00bf60 con 0x7f671c005000 2023-08-17T17:34:33.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c00c0f0 con 0x7f671c004690 2023-08-17T17:34:33.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67337fe700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c0038e0 0x7f671c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f6733fff700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f671c005000 0x7f671c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f6732ffd700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f671c004690 0x7f671c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67337fe700 1 -- 172.21.15.78:0/3058147178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f671c004690 msgr2=0x7f671c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67337fe700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f671c004690 0x7f671c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67337fe700 1 -- 172.21.15.78:0/3058147178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f671c005000 msgr2=0x7f671c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67337fe700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f671c005000 0x7f671c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67337fe700 1 -- 172.21.15.78:0/3058147178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c0033f0 con 0x7f671c0038e0 2023-08-17T17:34:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f6733fff700 1 -- 172.21.15.78:0/3058147178 reap_dead start 2023-08-17T17:34:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f6732ffd700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f671c004690 0x7f671c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67337fe700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c0038e0 0x7f671c003d00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f672400c160 tx=0x7f67240077a0).ready entity=mon.0 client_cookie=f02d3e9c94250b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67240079d0 con 0x7f671c0038e0 2023-08-17T17:34:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67240070d0 con 0x7f671c0038e0 2023-08-17T17:34:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.399+0000 7f67327fc700 1 -- 172.21.15.78:0/3058147178 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724007490 con 0x7f671c0038e0 2023-08-17T17:34:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.400+0000 7f6738a99700 1 -- 172.21.15.78:0/3058147178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c0038e0 msgr2=0x7f671c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.400+0000 7f6738a99700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c0038e0 0x7f671c003d00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f672400c160 tx=0x7f67240077a0).stop 2023-08-17T17:34:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.400+0000 7f6738a99700 1 -- 172.21.15.78:0/3058147178 shutdown_connections 2023-08-17T17:34:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.400+0000 7f6738a99700 1 --2- 172.21.15.78:0/3058147178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c0038e0 0x7f671c003d00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.400+0000 7f6738a99700 1 -- 172.21.15.78:0/3058147178 >> 172.21.15.78:0/3058147178 conn(0x7f673406a400 msgr2=0x7f67340cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.400+0000 7f6738a99700 1 -- 172.21.15.78:0/3058147178 shutdown_connections 2023-08-17T17:34:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.400+0000 7f6738a99700 1 -- 172.21.15.78:0/3058147178 wait complete. 2023-08-17T17:34:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.401+0000 7f6738a99700 1 Processor -- start 2023-08-17T17:34:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.401+0000 7f6738a99700 1 -- start start 2023-08-17T17:34:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6738a99700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f671c0038e0 0x7f6734167820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6738a99700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67340c40b0 0x7f67341428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6738a99700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f673414f490 0x7f673414f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6738a99700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67340c4530 con 0x7f673414f490 2023-08-17T17:34:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6738a99700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67340adeb0 con 0x7f671c0038e0 2023-08-17T17:34:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6738a99700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673414fe00 con 0x7f67340c40b0 2023-08-17T17:34:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6733fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f673414f490 0x7f673414f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6733fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f673414f490 0x7f673414f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46884/0 (socket says 172.21.15.78:46884) 2023-08-17T17:34:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6733fff700 1 -- 172.21.15.78:0/2521246994 learned_addr learned my addr 172.21.15.78:0/2521246994 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f67337fe700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f671c0038e0 0x7f6734167820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6732ffd700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67340c40b0 0x7f67341428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6733fff700 1 -- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67340c40b0 msgr2=0x7f67341428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6733fff700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67340c40b0 0x7f67341428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6733fff700 1 -- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f671c0038e0 msgr2=0x7f6734167820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6733fff700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f671c0038e0 0x7f6734167820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6733fff700 1 -- 172.21.15.78:0/2521246994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734142db0 con 0x7f673414f490 2023-08-17T17:34:33.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f67337fe700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f671c0038e0 0x7f6734167820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:33.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.402+0000 7f6733fff700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f673414f490 0x7f673414f910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f672c009d70 tx=0x7f672c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.403+0000 7f671b7fe700 1 -- 172.21.15.78:0/2521246994 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c00e040 con 0x7f673414f490 2023-08-17T17:34:33.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.403+0000 7f671b7fe700 1 -- 172.21.15.78:0/2521246994 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c00f040 con 0x7f673414f490 2023-08-17T17:34:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.403+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6734167de0 con 0x7f673414f490 2023-08-17T17:34:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.403+0000 7f671b7fe700 1 -- 172.21.15.78:0/2521246994 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c00fe50 con 0x7f673414f490 2023-08-17T17:34:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.403+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67341683a0 con 0x7f673414f490 2023-08-17T17:34:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.403+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6734157af0 con 0x7f673414f490 2023-08-17T17:34:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.404+0000 7f671b7fe700 1 -- 172.21.15.78:0/2521246994 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f672c015660 con 0x7f673414f490 2023-08-17T17:34:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.404+0000 7f671b7fe700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f672005ed90 0x7f6720061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.404+0000 7f671b7fe700 1 -- 172.21.15.78:0/2521246994 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f672c07a710 con 0x7f673414f490 2023-08-17T17:34:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.404+0000 7f67337fe700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f672005ed90 0x7f6720061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.404+0000 7f671b7fe700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] conn(0x7f6720068130 0x7f672006a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.404+0000 7f671b7fe700 1 -- 172.21.15.78:0/2521246994 --> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f672006ac10 con 0x7f6720068130 2023-08-17T17:34:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.404+0000 7f671b7fe700 1 -- 172.21.15.78:0/2521246994 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f672c07cd80 con 0x7f673414f490 2023-08-17T17:34:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.405+0000 7f67337fe700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f672005ed90 0x7f6720061250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6724000ef0 tx=0x7f6724015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.405+0000 7f6732ffd700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] conn(0x7f6720068130 0x7f672006a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.405+0000 7f6732ffd700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] conn(0x7f6720068130 0x7f672006a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.406+0000 7f671b7fe700 1 -- 172.21.15.78:0/2521246994 <== osd.7 v2:172.21.15.150:6816/90935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f672006ac10 con 0x7f6720068130 2023-08-17T17:34:33.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.420+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 --> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f67340c6f70 con 0x7f6720068130 2023-08-17T17:34:33.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.420+0000 7f671b7fe700 1 -- 172.21.15.78:0/2521246994 <== osd.7 v2:172.21.15.150:6816/90935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f67340c6f70 con 0x7f6720068130 2023-08-17T17:34:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] conn(0x7f6720068130 msgr2=0x7f672006a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6738a99700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] conn(0x7f6720068130 0x7f672006a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f672005ed90 msgr2=0x7f6720061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6738a99700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f672005ed90 0x7f6720061250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6724000ef0 tx=0x7f6724015000).stop 2023-08-17T17:34:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f673414f490 msgr2=0x7f673414f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6738a99700 1 --2- 172.21.15.78:0/2521246994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f673414f490 0x7f673414f910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f672c009d70 tx=0x7f672c00b040).stop 2023-08-17T17:34:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6733fff700 1 -- 172.21.15.78:0/2521246994 reap_dead start 2023-08-17T17:34:33.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 shutdown_connections 2023-08-17T17:34:33.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 >> 172.21.15.78:0/2521246994 conn(0x7f673406a400 msgr2=0x7f67340a7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:33.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 shutdown_connections 2023-08-17T17:34:33.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.421+0000 7f6738a99700 1 -- 172.21.15.78:0/2521246994 wait complete. 2023-08-17T17:34:33.433 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-08-17T17:34:33.434 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-17T17:34:33.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.545+0000 7f4ca7f68700 1 Processor -- start 2023-08-17T17:34:33.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.545+0000 7f4ca7f68700 1 -- start start 2023-08-17T17:34:33.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.546+0000 7f4ca7f68700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4ca01541a0 0x7f4ca00a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.546+0000 7f4ca7f68700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca00c7690 con 0x7f4ca00c0560 2023-08-17T17:34:33.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.546+0000 7f4ca7f68700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca00c8df0 con 0x7f4ca0154580 2023-08-17T17:34:33.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.546+0000 7f4ca7f68700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca00a8190 con 0x7f4ca01541a0 2023-08-17T17:34:33.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.546+0000 7f4ca6505700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4ca00c0560 0x7f4ca00c6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38232/0 (socket says 172.21.15.78:38232) 2023-08-17T17:34:33.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.546+0000 7f4ca6505700 1 -- 172.21.15.78:0/2123187574 learned_addr learned my addr 172.21.15.78:0/2123187574 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:33.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599068546 0 0) 0x7f4c98001110 con 0x7f4ca00c0560 2023-08-17T17:34:33.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca5d04700 1 --2- 172.21.15.78:0/2123187574 >> v2:172.21.15.150:3300/0 conn(0x7f4ca01541a0 0x7f4ca00a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c8c0033f0 con 0x7f4ca00c0560 2023-08-17T17:34:33.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2082822558 0 0) 0x7f4c8c0033f0 con 0x7f4ca00c0560 2023-08-17T17:34:33.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 >> v2:172.21.15.150:3300/0 conn(0x7f4ca01541a0 msgr2=0x7f4ca00a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 --2- 172.21.15.78:0/2123187574 >> v2:172.21.15.150:3300/0 conn(0x7f4ca01541a0 0x7f4ca00a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 >> v1:172.21.15.150:6789/0 conn(0x7f4ca0154580 legacy=0x7f4ca00bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00c9970 con 0x7f4ca00c0560 2023-08-17T17:34:33.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f4c98001600 con 0x7f4ca00c0560 2023-08-17T17:34:33.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 >> v1:172.21.15.78:6789/0 conn(0x7f4ca00c0560 legacy=0x7f4ca00c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0038e0 0x7f4c8c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c8c004690 0x7f4c8c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c8c005050 0x7f4c8c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00a8190 con 0x7f4c8c0038e0 2023-08-17T17:34:33.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c00bfe0 con 0x7f4c8c005050 2023-08-17T17:34:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c00c1a0 con 0x7f4c8c004690 2023-08-17T17:34:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca5d04700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0038e0 0x7f4c8c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca6505700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c8c005050 0x7f4c8c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca5503700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c8c004690 0x7f4c8c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca5d04700 1 -- 172.21.15.78:0/2123187574 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c8c004690 msgr2=0x7f4c8c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca5d04700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c8c004690 0x7f4c8c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca5d04700 1 -- 172.21.15.78:0/2123187574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c8c005050 msgr2=0x7f4c8c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca5d04700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c8c005050 0x7f4c8c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca6505700 1 -- 172.21.15.78:0/2123187574 reap_dead start 2023-08-17T17:34:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca5d04700 1 -- 172.21.15.78:0/2123187574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0033f0 con 0x7f4c8c0038e0 2023-08-17T17:34:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca5503700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c8c004690 0x7f4c8c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca5d04700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0038e0 0x7f4c8c003d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f4c9c0094d0 tx=0x7f4c9c00b040).ready entity=mon.0 client_cookie=58fdf569adff9086 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.547+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c00e9e0 con 0x7f4c8c0038e0 2023-08-17T17:34:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.548+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c00f040 con 0x7f4c8c0038e0 2023-08-17T17:34:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.548+0000 7f4ca4d02700 1 -- 172.21.15.78:0/2123187574 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c00ed90 con 0x7f4c8c0038e0 2023-08-17T17:34:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.548+0000 7f4ca7f68700 1 -- 172.21.15.78:0/2123187574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0038e0 msgr2=0x7f4c8c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.548+0000 7f4ca7f68700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0038e0 0x7f4c8c003d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f4c9c0094d0 tx=0x7f4c9c00b040).stop 2023-08-17T17:34:33.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.548+0000 7f4ca7f68700 1 -- 172.21.15.78:0/2123187574 shutdown_connections 2023-08-17T17:34:33.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.548+0000 7f4ca7f68700 1 --2- 172.21.15.78:0/2123187574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0038e0 0x7f4c8c003d00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.548+0000 7f4ca7f68700 1 -- 172.21.15.78:0/2123187574 >> 172.21.15.78:0/2123187574 conn(0x7f4ca006a400 msgr2=0x7f4ca00caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:33.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.548+0000 7f4ca7f68700 1 -- 172.21.15.78:0/2123187574 shutdown_connections 2023-08-17T17:34:33.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.548+0000 7f4ca7f68700 1 -- 172.21.15.78:0/2123187574 wait complete. 2023-08-17T17:34:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.549+0000 7f4ca7f68700 1 Processor -- start 2023-08-17T17:34:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.549+0000 7f4ca7f68700 1 -- start start 2023-08-17T17:34:33.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca7f68700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c8c0038e0 0x7f4ca0149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca7f68700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ca0153190 0x7f4ca00c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca7f68700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ca0153610 0x7f4ca00c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca7f68700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca0164960 con 0x7f4ca0153610 2023-08-17T17:34:33.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca7f68700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00c35b0 con 0x7f4c8c0038e0 2023-08-17T17:34:33.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca7f68700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca0165200 con 0x7f4ca0153190 2023-08-17T17:34:33.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca6505700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ca0153610 0x7f4ca00c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca6505700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ca0153610 0x7f4ca00c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46896/0 (socket says 172.21.15.78:46896) 2023-08-17T17:34:33.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca6505700 1 -- 172.21.15.78:0/808973697 learned_addr learned my addr 172.21.15.78:0/808973697 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:33.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca5503700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ca0153190 0x7f4ca00c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca5d04700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c8c0038e0 0x7f4ca0149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca6505700 1 -- 172.21.15.78:0/808973697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ca0153190 msgr2=0x7f4ca00c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca6505700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ca0153190 0x7f4ca00c2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca6505700 1 -- 172.21.15.78:0/808973697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c8c0038e0 msgr2=0x7f4ca0149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca6505700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c8c0038e0 0x7f4ca0149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca6505700 1 -- 172.21.15.78:0/808973697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca0164bf0 con 0x7f4ca0153610 2023-08-17T17:34:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.550+0000 7f4ca6505700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ca0153610 0x7f4ca00c30c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4ca00adbf0 tx=0x7f4c980078d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.551+0000 7f4c95ffb700 1 -- 172.21.15.78:0/808973697 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800f840 con 0x7f4ca0153610 2023-08-17T17:34:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.551+0000 7f4c95ffb700 1 -- 172.21.15.78:0/808973697 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9800f9a0 con 0x7f4ca0153610 2023-08-17T17:34:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.551+0000 7f4c95ffb700 1 -- 172.21.15.78:0/808973697 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800fd20 con 0x7f4ca0153610 2023-08-17T17:34:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.551+0000 7f4ca7f68700 1 -- 172.21.15.78:0/808973697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca00c2590 con 0x7f4ca0153610 2023-08-17T17:34:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.551+0000 7f4ca7f68700 1 -- 172.21.15.78:0/808973697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca0149f40 con 0x7f4ca0153610 2023-08-17T17:34:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.552+0000 7f4ca7f68700 1 -- 172.21.15.78:0/808973697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca01653b0 con 0x7f4ca0153610 2023-08-17T17:34:33.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.552+0000 7f4c95ffb700 1 -- 172.21.15.78:0/808973697 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4c98004d70 con 0x7f4ca0153610 2023-08-17T17:34:33.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.552+0000 7f4c95ffb700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4c8405ed90 0x7f4c84061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.552+0000 7f4c95ffb700 1 -- 172.21.15.78:0/808973697 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4c98078dd0 con 0x7f4ca0153610 2023-08-17T17:34:33.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.552+0000 7f4ca5d04700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4c8405ed90 0x7f4c84061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.553+0000 7f4ca5d04700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4c8405ed90 0x7f4c84061250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4c9c0099d0 tx=0x7f4c9c01a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.556+0000 7f4c95ffb700 1 -- 172.21.15.78:0/808973697 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ca01653b0 con 0x7f4ca0153610 2023-08-17T17:34:33.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.718+0000 7f4ca7f68700 1 -- 172.21.15.78:0/808973697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ca00c7690 con 0x7f4ca0153610 2023-08-17T17:34:33.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.719+0000 7f4c95ffb700 1 -- 172.21.15.78:0/808973697 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ca00c7690 con 0x7f4ca0153610 2023-08-17T17:34:33.721 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-08-17T17:34:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 -- 172.21.15.78:0/808973697 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4c8405ed90 msgr2=0x7f4c84061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4c8405ed90 0x7f4c84061250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4c9c0099d0 tx=0x7f4c9c01a000).stop 2023-08-17T17:34:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 -- 172.21.15.78:0/808973697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ca0153610 msgr2=0x7f4ca00c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ca0153610 0x7f4ca00c30c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4ca00adbf0 tx=0x7f4c980078d0).stop 2023-08-17T17:34:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 -- 172.21.15.78:0/808973697 shutdown_connections 2023-08-17T17:34:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4c8405ed90 0x7f4c84061250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ca0153610 0x7f4ca00c30c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c8c0038e0 0x7f4ca0149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 --2- 172.21.15.78:0/808973697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ca0153190 0x7f4ca00c2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 -- 172.21.15.78:0/808973697 >> 172.21.15.78:0/808973697 conn(0x7f4ca006a400 msgr2=0x7f4ca00c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:33.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 -- 172.21.15.78:0/808973697 shutdown_connections 2023-08-17T17:34:33.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.721+0000 7f4ca7f68700 1 -- 172.21.15.78:0/808973697 wait complete. 2023-08-17T17:34:33.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-08-17T17:34:33.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-17T17:34:33.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.846+0000 7fcf94e12700 1 Processor -- start 2023-08-17T17:34:33.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.846+0000 7fcf94e12700 1 -- start start 2023-08-17T17:34:33.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.847+0000 7fcf94e12700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf90151fa0 0x7fcf900c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.847+0000 7fcf94e12700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf90152380 0x7fcf900c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.847+0000 7fcf94e12700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 0x7fcf900c7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.847+0000 7fcf94e12700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf900c49c0 con 0x7fcf90151fa0 2023-08-17T17:34:33.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.847+0000 7fcf94e12700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf900c72e0 con 0x7fcf90152380 2023-08-17T17:34:33.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.847+0000 7fcf94e12700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900c4bb0 con 0x7fcf900c4570 2023-08-17T17:34:33.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.847+0000 7fcf8e59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf90151fa0 0x7fcf900c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8e59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf90151fa0 0x7fcf900c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46912/0 (socket says 172.21.15.78:46912) 2023-08-17T17:34:33.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8e59c700 1 -- 172.21.15.78:0/1165360364 learned_addr learned my addr 172.21.15.78:0/1165360364 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:33.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8ed9d700 1 --2- 172.21.15.78:0/1165360364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 0x7fcf900c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8dd9b700 1 --2- 172.21.15.78:0/1165360364 >> v2:172.21.15.150:3300/0 conn(0x7fcf90152380 0x7fcf900c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8e59c700 1 -- 172.21.15.78:0/1165360364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 msgr2=0x7fcf900c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8e59c700 1 --2- 172.21.15.78:0/1165360364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 0x7fcf900c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8e59c700 1 -- 172.21.15.78:0/1165360364 >> v2:172.21.15.150:3300/0 conn(0x7fcf90152380 msgr2=0x7fcf900c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:33.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8e59c700 1 --2- 172.21.15.78:0/1165360364 >> v2:172.21.15.150:3300/0 conn(0x7fcf90152380 0x7fcf900c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8e59c700 1 -- 172.21.15.78:0/1165360364 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900c4e90 con 0x7fcf90151fa0 2023-08-17T17:34:33.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8e59c700 1 --2- 172.21.15.78:0/1165360364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 0x7fcf900c3b90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fcf90068aa0 tx=0x7fcf80009840).ready entity=mon.0 client_cookie=df36647cdb287895 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8d59a700 1 -- 172.21.15.78:0/1165360364 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000e070 con 0x7fcf90151fa0 2023-08-17T17:34:33.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8d59a700 1 -- 172.21.15.78:0/1165360364 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8000b970 con 0x7fcf90151fa0 2023-08-17T17:34:33.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf8d59a700 1 -- 172.21.15.78:0/1165360364 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000bcf0 con 0x7fcf90151fa0 2023-08-17T17:34:33.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf94e12700 1 -- 172.21.15.78:0/1165360364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 msgr2=0x7fcf900c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.848+0000 7fcf94e12700 1 --2- 172.21.15.78:0/1165360364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 0x7fcf900c3b90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fcf90068aa0 tx=0x7fcf80009840).stop 2023-08-17T17:34:33.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.849+0000 7fcf94e12700 1 -- 172.21.15.78:0/1165360364 shutdown_connections 2023-08-17T17:34:33.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.849+0000 7fcf94e12700 1 --2- 172.21.15.78:0/1165360364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 0x7fcf900c3b90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.849+0000 7fcf94e12700 1 --2- 172.21.15.78:0/1165360364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 0x7fcf900c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.849+0000 7fcf94e12700 1 --2- 172.21.15.78:0/1165360364 >> v2:172.21.15.150:3300/0 conn(0x7fcf90152380 0x7fcf900c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.849+0000 7fcf94e12700 1 -- 172.21.15.78:0/1165360364 >> 172.21.15.78:0/1165360364 conn(0x7fcf90062cd0 msgr2=0x7fcf900c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:33.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.849+0000 7fcf94e12700 1 -- 172.21.15.78:0/1165360364 shutdown_connections 2023-08-17T17:34:33.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.849+0000 7fcf94e12700 1 -- 172.21.15.78:0/1165360364 wait complete. 2023-08-17T17:34:33.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.850+0000 7fcf94e12700 1 Processor -- start 2023-08-17T17:34:33.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.850+0000 7fcf94e12700 1 -- start start 2023-08-17T17:34:33.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.850+0000 7fcf94e12700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 0x7fcf900ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.850+0000 7fcf94e12700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 0x7fcf900ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.850+0000 7fcf94e12700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf90152380 0x7fcf90141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.850+0000 7fcf94e12700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900ab7b0 con 0x7fcf90151fa0 2023-08-17T17:34:33.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.850+0000 7fcf94e12700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900a87f0 con 0x7fcf90152380 2023-08-17T17:34:33.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.850+0000 7fcf94e12700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900acb80 con 0x7fcf900c4570 2023-08-17T17:34:33.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.850+0000 7fcf8dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 0x7fcf900ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 0x7fcf900ac690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46916/0 (socket says 172.21.15.78:46916) 2023-08-17T17:34:33.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8dd9b700 1 -- 172.21.15.78:0/1626693057 learned_addr learned my addr 172.21.15.78:0/1626693057 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:33.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8e59c700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 0x7fcf900ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8ed9d700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf90152380 0x7fcf90141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8dd9b700 1 -- 172.21.15.78:0/1626693057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 msgr2=0x7fcf900ab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8dd9b700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 0x7fcf900ab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8dd9b700 1 -- 172.21.15.78:0/1626693057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf90152380 msgr2=0x7fcf90141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8dd9b700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf90152380 0x7fcf90141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8dd9b700 1 -- 172.21.15.78:0/1626693057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80009ae0 con 0x7fcf90151fa0 2023-08-17T17:34:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8e59c700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 0x7fcf900ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf8dd9b700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 0x7fcf900ac690 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fcf8400e930 tx=0x7fcf84009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf7e7fc700 1 -- 172.21.15.78:0/1626693057 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400eed0 con 0x7fcf90151fa0 2023-08-17T17:34:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf7e7fc700 1 -- 172.21.15.78:0/1626693057 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8400c850 con 0x7fcf90151fa0 2023-08-17T17:34:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf94e12700 1 -- 172.21.15.78:0/1626693057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf900ace00 con 0x7fcf90151fa0 2023-08-17T17:34:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf7e7fc700 1 -- 172.21.15.78:0/1626693057 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400cbd0 con 0x7fcf90151fa0 2023-08-17T17:34:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.851+0000 7fcf94e12700 1 -- 172.21.15.78:0/1626693057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf900a8b10 con 0x7fcf90151fa0 2023-08-17T17:34:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.852+0000 7fcf94e12700 1 -- 172.21.15.78:0/1626693057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf900ad1d0 con 0x7fcf90151fa0 2023-08-17T17:34:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.852+0000 7fcf7e7fc700 1 -- 172.21.15.78:0/1626693057 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcf84022070 con 0x7fcf90151fa0 2023-08-17T17:34:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.853+0000 7fcf7e7fc700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf7005ed90 0x7fcf70061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.853+0000 7fcf7e7fc700 1 -- 172.21.15.78:0/1626693057 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcf84079f90 con 0x7fcf90151fa0 2023-08-17T17:34:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.853+0000 7fcf8e59c700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf7005ed90 0x7fcf70061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.853+0000 7fcf8e59c700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf7005ed90 0x7fcf70061250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fcf8000b940 tx=0x7fcf80009840).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:33.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:33.857+0000 7fcf7e7fc700 1 -- 172.21.15.78:0/1626693057 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf8404b530 con 0x7fcf90151fa0 2023-08-17T17:34:34.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.021+0000 7fcf94e12700 1 -- 172.21.15.78:0/1626693057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf90047350 con 0x7fcf90151fa0 2023-08-17T17:34:34.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.021+0000 7fcf7e7fc700 1 -- 172.21.15.78:0/1626693057 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf8404eb50 con 0x7fcf90151fa0 2023-08-17T17:34:34.023 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-08-17T17:34:34.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 -- 172.21.15.78:0/1626693057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf7005ed90 msgr2=0x7fcf70061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf7005ed90 0x7fcf70061250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fcf8000b940 tx=0x7fcf80009840).stop 2023-08-17T17:34:34.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 -- 172.21.15.78:0/1626693057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 msgr2=0x7fcf900ac690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 0x7fcf900ac690 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fcf8400e930 tx=0x7fcf84009060).stop 2023-08-17T17:34:34.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 -- 172.21.15.78:0/1626693057 shutdown_connections 2023-08-17T17:34:34.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf7005ed90 0x7fcf70061250 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf90152380 0x7fcf90141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf900c4570 0x7fcf900ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 --2- 172.21.15.78:0/1626693057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf90151fa0 0x7fcf900ac690 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 -- 172.21.15.78:0/1626693057 >> 172.21.15.78:0/1626693057 conn(0x7fcf90062cd0 msgr2=0x7fcf9014e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:34.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 -- 172.21.15.78:0/1626693057 shutdown_connections 2023-08-17T17:34:34.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.023+0000 7fcf94e12700 1 -- 172.21.15.78:0/1626693057 wait complete. 2023-08-17T17:34:34.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-08-17T17:34:34.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-17T17:34:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.149+0000 7fe5111da700 1 Processor -- start 2023-08-17T17:34:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.149+0000 7fe5111da700 1 -- start start 2023-08-17T17:34:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.149+0000 7fe5111da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c151db0 0x7fe50c0c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.149+0000 7fe5111da700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50c0c4500 con 0x7fe50c0c4990 2023-08-17T17:34:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.149+0000 7fe5111da700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50c0a8390 con 0x7fe50c0a7c20 2023-08-17T17:34:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.149+0000 7fe5111da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0c66a0 con 0x7fe50c151db0 2023-08-17T17:34:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe5109d9700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe50c0c4990 0x7fe50c0be3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38240/0 (socket says 172.21.15.78:38240) 2023-08-17T17:34:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe5109d9700 1 -- 172.21.15.78:0/1871298778 learned_addr learned my addr 172.21.15.78:0/1871298778 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50bfff700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c151db0 0x7fe50c0c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429746246 0 0) 0x7fe50c0c4500 con 0x7fe50c0c4990 2023-08-17T17:34:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f80033f0 con 0x7fe50c0c4990 2023-08-17T17:34:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1161472917 0 0) 0x7fe4f80033f0 con 0x7fe50c0c4990 2023-08-17T17:34:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c151db0 msgr2=0x7fe50c0c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c151db0 0x7fe50c0c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 >> v1:172.21.15.150:6789/0 conn(0x7fe50c0a7c20 legacy=0x7fe50c0a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0c3eb0 con 0x7fe50c0c4990 2023-08-17T17:34:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fe5040017f0 con 0x7fe50c0c4990 2023-08-17T17:34:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 >> v1:172.21.15.78:6789/0 conn(0x7fe50c0c4990 legacy=0x7fe50c0be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8003910 0x7fe4f8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c151db0 0x7fe4f8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4f8004b80 0x7fe4f8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0c66a0 con 0x7fe4f8004b80 2023-08-17T17:34:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f800b910 con 0x7fe4f8003910 2023-08-17T17:34:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f800bad0 con 0x7fe50c151db0 2023-08-17T17:34:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe5109d9700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4f8004b80 0x7fe4f8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe50bfff700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8003910 0x7fe4f8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.150+0000 7fe503fff700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c151db0 0x7fe4f8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5109d9700 1 -- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c151db0 msgr2=0x7fe4f8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5109d9700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c151db0 0x7fe4f8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5109d9700 1 -- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8003910 msgr2=0x7fe4f8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5109d9700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8003910 0x7fe4f8003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5109d9700 1 -- 172.21.15.78:0/1871298778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80033f0 con 0x7fe4f8004b80 2023-08-17T17:34:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5109d9700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4f8004b80 0x7fe4f8005000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fe50400c480 tx=0x7fe50400c790).ready entity=mon.0 client_cookie=b1700ce2a0fe642b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504002030 con 0x7fe4f8004b80 2023-08-17T17:34:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50400ce20 con 0x7fe4f8004b80 2023-08-17T17:34:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe50b7fe700 1 -- 172.21.15.78:0/1871298778 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504005d30 con 0x7fe4f8004b80 2023-08-17T17:34:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5111da700 1 -- 172.21.15.78:0/1871298778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4f8004b80 msgr2=0x7fe4f8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5111da700 1 --2- 172.21.15.78:0/1871298778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4f8004b80 0x7fe4f8005000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fe50400c480 tx=0x7fe50400c790).stop 2023-08-17T17:34:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5109d9700 1 -- 172.21.15.78:0/1871298778 reap_dead start 2023-08-17T17:34:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5111da700 1 -- 172.21.15.78:0/1871298778 shutdown_connections 2023-08-17T17:34:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5111da700 1 -- 172.21.15.78:0/1871298778 >> 172.21.15.78:0/1871298778 conn(0x7fe50c0922c0 msgr2=0x7fe50c062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.151+0000 7fe5111da700 1 -- 172.21.15.78:0/1871298778 shutdown_connections 2023-08-17T17:34:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.152+0000 7fe5111da700 1 -- 172.21.15.78:0/1871298778 wait complete. 2023-08-17T17:34:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5111da700 1 Processor -- start 2023-08-17T17:34:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5111da700 1 -- start start 2023-08-17T17:34:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5111da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8004b80 0x7fe50c14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5111da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c0c2170 0x7fe50c0c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5111da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50c165110 0x7fe50c165570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5111da700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0c1a30 con 0x7fe50c165110 2023-08-17T17:34:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5111da700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c166070 con 0x7fe4f8004b80 2023-08-17T17:34:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5111da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0c7190 con 0x7fe50c0c2170 2023-08-17T17:34:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5109d9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50c165110 0x7fe50c165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5109d9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50c165110 0x7fe50c165570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46938/0 (socket says 172.21.15.78:46938) 2023-08-17T17:34:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.153+0000 7fe5109d9700 1 -- 172.21.15.78:0/3307618802 learned_addr learned my addr 172.21.15.78:0/3307618802 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:34.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe503fff700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c0c2170 0x7fe50c0c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe50bfff700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8004b80 0x7fe50c14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe5109d9700 1 -- 172.21.15.78:0/3307618802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c0c2170 msgr2=0x7fe50c0c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe5109d9700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c0c2170 0x7fe50c0c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe5109d9700 1 -- 172.21.15.78:0/3307618802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8004b80 msgr2=0x7fe50c14ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe5109d9700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8004b80 0x7fe50c14ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe5109d9700 1 -- 172.21.15.78:0/3307618802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0c2ae0 con 0x7fe50c165110 2023-08-17T17:34:34.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe5109d9700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50c165110 0x7fe50c165570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe50400a000 tx=0x7fe504015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:34.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe508ff9700 1 -- 172.21.15.78:0/3307618802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504002030 con 0x7fe50c165110 2023-08-17T17:34:34.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe508ff9700 1 -- 172.21.15.78:0/3307618802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5040017b0 con 0x7fe50c165110 2023-08-17T17:34:34.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe5111da700 1 -- 172.21.15.78:0/3307618802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50c165d90 con 0x7fe50c165110 2023-08-17T17:34:34.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe508ff9700 1 -- 172.21.15.78:0/3307618802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504013450 con 0x7fe50c165110 2023-08-17T17:34:34.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.154+0000 7fe5111da700 1 -- 172.21.15.78:0/3307618802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c0c6e20 con 0x7fe50c165110 2023-08-17T17:34:34.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.155+0000 7fe5111da700 1 -- 172.21.15.78:0/3307618802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c0c6800 con 0x7fe50c165110 2023-08-17T17:34:34.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.155+0000 7fe508ff9700 1 -- 172.21.15.78:0/3307618802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe50401d070 con 0x7fe50c165110 2023-08-17T17:34:34.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.156+0000 7fe508ff9700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4ec05ed90 0x7fe4ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.156+0000 7fe508ff9700 1 -- 172.21.15.78:0/3307618802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe50407a880 con 0x7fe50c165110 2023-08-17T17:34:34.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.156+0000 7fe50bfff700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4ec05ed90 0x7fe4ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.156+0000 7fe50bfff700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4ec05ed90 0x7fe4ec061250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe4fc006d80 tx=0x7fe4fc009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:34.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.160+0000 7fe508ff9700 1 -- 172.21.15.78:0/3307618802 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe50404be00 con 0x7fe50c165110 2023-08-17T17:34:34.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.323+0000 7fe5111da700 1 -- 172.21.15.78:0/3307618802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe50c0c4190 con 0x7fe50c165110 2023-08-17T17:34:34.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.323+0000 7fe508ff9700 1 -- 172.21.15.78:0/3307618802 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe50401a070 con 0x7fe50c165110 2023-08-17T17:34:34.325 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-08-17T17:34:34.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 -- 172.21.15.78:0/3307618802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4ec05ed90 msgr2=0x7fe4ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4ec05ed90 0x7fe4ec061250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe4fc006d80 tx=0x7fe4fc009060).stop 2023-08-17T17:34:34.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 -- 172.21.15.78:0/3307618802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50c165110 msgr2=0x7fe50c165570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50c165110 0x7fe50c165570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe50400a000 tx=0x7fe504015000).stop 2023-08-17T17:34:34.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 -- 172.21.15.78:0/3307618802 shutdown_connections 2023-08-17T17:34:34.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4ec05ed90 0x7fe4ec061250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50c165110 0x7fe50c165570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8004b80 0x7fe50c14ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 --2- 172.21.15.78:0/3307618802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe50c0c2170 0x7fe50c0c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 -- 172.21.15.78:0/3307618802 >> 172.21.15.78:0/3307618802 conn(0x7fe50c0922c0 msgr2=0x7fe50c0abb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:34.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 -- 172.21.15.78:0/3307618802 shutdown_connections 2023-08-17T17:34:34.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.325+0000 7fe5111da700 1 -- 172.21.15.78:0/3307618802 wait complete. 2023-08-17T17:34:34.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-08-17T17:34:34.338 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-17T17:34:34.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.450+0000 7f3d685ac700 1 Processor -- start 2023-08-17T17:34:34.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.450+0000 7f3d685ac700 1 -- start start 2023-08-17T17:34:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.451+0000 7f3d685ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d60152380 0x7f3d600c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.451+0000 7f3d685ac700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600c72e0 con 0x7f3d60151fa0 2023-08-17T17:34:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.451+0000 7f3d685ac700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600c4bb0 con 0x7f3d600c8780 2023-08-17T17:34:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.451+0000 7f3d685ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600c4e90 con 0x7f3d60152380 2023-08-17T17:34:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.451+0000 7f3d66348700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3d60151fa0 0x7f3d600c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38250/0 (socket says 172.21.15.78:38250) 2023-08-17T17:34:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.451+0000 7f3d66348700 1 -- 172.21.15.78:0/14205319 learned_addr learned my addr 172.21.15.78:0/14205319 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:34.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961823628 0 0) 0x7f3d600c72e0 con 0x7f3d60151fa0 2023-08-17T17:34:34.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d480033f0 con 0x7f3d60151fa0 2023-08-17T17:34:34.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65b47700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d60152380 0x7f3d600c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929909511 0 0) 0x7f3d480033f0 con 0x7f3d60151fa0 2023-08-17T17:34:34.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d60152380 msgr2=0x7f3d600c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:34.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d60152380 0x7f3d600c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 >> v1:172.21.15.150:6789/0 conn(0x7f3d600c8780 legacy=0x7f3d600bdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600c6c90 con 0x7f3d60151fa0 2023-08-17T17:34:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3d500017f0 con 0x7f3d60151fa0 2023-08-17T17:34:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 >> v1:172.21.15.78:6789/0 conn(0x7f3d60151fa0 legacy=0x7f3d600c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d48003910 0x7f3d48003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d48004690 0x7f3d48004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d60152380 0x7f3d48005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600c4e90 con 0x7f3d48003910 2023-08-17T17:34:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4800b9c0 con 0x7f3d48004690 2023-08-17T17:34:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4800bb80 con 0x7f3d60152380 2023-08-17T17:34:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d66348700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d48003910 0x7f3d48003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65b47700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d48004690 0x7f3d48004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d66b49700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d60152380 0x7f3d48005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d66348700 1 -- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d60152380 msgr2=0x7f3d48005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d66348700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d60152380 0x7f3d48005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d66348700 1 -- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d48004690 msgr2=0x7f3d48004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d66348700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d48004690 0x7f3d48004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d66348700 1 -- 172.21.15.78:0/14205319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480033f0 con 0x7f3d48003910 2023-08-17T17:34:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d65b47700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d48004690 0x7f3d48004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.452+0000 7f3d66348700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d48003910 0x7f3d48003d30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3d5000c480 tx=0x7f3d5000c790).ready entity=mon.0 client_cookie=e358ce4da941063d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.453+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50002030 con 0x7f3d48003910 2023-08-17T17:34:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.453+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5000ce20 con 0x7f3d48003910 2023-08-17T17:34:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.453+0000 7f3d65346700 1 -- 172.21.15.78:0/14205319 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50005d30 con 0x7f3d48003910 2023-08-17T17:34:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.453+0000 7f3d685ac700 1 -- 172.21.15.78:0/14205319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d48003910 msgr2=0x7f3d48003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.453+0000 7f3d685ac700 1 --2- 172.21.15.78:0/14205319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d48003910 0x7f3d48003d30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3d5000c480 tx=0x7f3d5000c790).stop 2023-08-17T17:34:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.453+0000 7f3d66b49700 1 -- 172.21.15.78:0/14205319 reap_dead start 2023-08-17T17:34:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.453+0000 7f3d685ac700 1 -- 172.21.15.78:0/14205319 shutdown_connections 2023-08-17T17:34:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.453+0000 7f3d685ac700 1 -- 172.21.15.78:0/14205319 >> 172.21.15.78:0/14205319 conn(0x7f3d60062cd0 msgr2=0x7f3d600c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.453+0000 7f3d685ac700 1 -- 172.21.15.78:0/14205319 shutdown_connections 2023-08-17T17:34:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.453+0000 7f3d685ac700 1 -- 172.21.15.78:0/14205319 wait complete. 2023-08-17T17:34:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.454+0000 7f3d685ac700 1 Processor -- start 2023-08-17T17:34:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.454+0000 7f3d685ac700 1 -- start start 2023-08-17T17:34:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d685ac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d48003910 0x7f3d600aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d685ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d600a96f0 0x7f3d6014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d685ac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d600c5790 0x7f3d600c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d685ac700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600a9b70 con 0x7f3d600c5790 2023-08-17T17:34:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d685ac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600a8b20 con 0x7f3d48003910 2023-08-17T17:34:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d685ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600ab380 con 0x7f3d600a96f0 2023-08-17T17:34:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d66b49700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d600c5790 0x7f3d600c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d66b49700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d600c5790 0x7f3d600c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46954/0 (socket says 172.21.15.78:46954) 2023-08-17T17:34:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d66b49700 1 -- 172.21.15.78:0/3901997205 learned_addr learned my addr 172.21.15.78:0/3901997205 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d66348700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d48003910 0x7f3d600aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d65b47700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d600a96f0 0x7f3d6014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d66b49700 1 -- 172.21.15.78:0/3901997205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d600a96f0 msgr2=0x7f3d6014dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d66b49700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d600a96f0 0x7f3d6014dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d66b49700 1 -- 172.21.15.78:0/3901997205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d48003910 msgr2=0x7f3d600aa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d66b49700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d48003910 0x7f3d600aa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d66b49700 1 -- 172.21.15.78:0/3901997205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600c6100 con 0x7f3d600c5790 2023-08-17T17:34:34.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.455+0000 7f3d66b49700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d600c5790 0x7f3d600c5c10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f3d600693c0 tx=0x7f3d58009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:34.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.456+0000 7f3d5e7fc700 1 -- 172.21.15.78:0/3901997205 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800ecc0 con 0x7f3d600c5790 2023-08-17T17:34:34.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.456+0000 7f3d5e7fc700 1 -- 172.21.15.78:0/3901997205 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5800ee20 con 0x7f3d600c5790 2023-08-17T17:34:34.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.456+0000 7f3d5e7fc700 1 -- 172.21.15.78:0/3901997205 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58007260 con 0x7f3d600c5790 2023-08-17T17:34:34.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.456+0000 7f3d685ac700 1 -- 172.21.15.78:0/3901997205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d600aa770 con 0x7f3d600c5790 2023-08-17T17:34:34.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.456+0000 7f3d685ac700 1 -- 172.21.15.78:0/3901997205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d600aad30 con 0x7f3d600c5790 2023-08-17T17:34:34.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.456+0000 7f3d685ac700 1 -- 172.21.15.78:0/3901997205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d60047350 con 0x7f3d600c5790 2023-08-17T17:34:34.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.457+0000 7f3d5e7fc700 1 -- 172.21.15.78:0/3901997205 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3d5801f070 con 0x7f3d600c5790 2023-08-17T17:34:34.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.457+0000 7f3d5e7fc700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d4c05ed90 0x7f3d4c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.457+0000 7f3d5e7fc700 1 -- 172.21.15.78:0/3901997205 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d58078b70 con 0x7f3d600c5790 2023-08-17T17:34:34.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.457+0000 7f3d66348700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d4c05ed90 0x7f3d4c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.457+0000 7f3d66348700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d4c05ed90 0x7f3d4c061250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3d5000c7d0 tx=0x7f3d50015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:34.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.461+0000 7f3d5e7fc700 1 -- 172.21.15.78:0/3901997205 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d5804a110 con 0x7f3d600c5790 2023-08-17T17:34:34.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.623+0000 7f3d685ac700 1 -- 172.21.15.78:0/3901997205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d600c6f70 con 0x7f3d600c5790 2023-08-17T17:34:34.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.624+0000 7f3d5e7fc700 1 -- 172.21.15.78:0/3901997205 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d5801d030 con 0x7f3d600c5790 2023-08-17T17:34:34.626 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-08-17T17:34:34.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.625+0000 7f3d685ac700 1 -- 172.21.15.78:0/3901997205 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d4c05ed90 msgr2=0x7f3d4c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.625+0000 7f3d685ac700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d4c05ed90 0x7f3d4c061250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3d5000c7d0 tx=0x7f3d50015000).stop 2023-08-17T17:34:34.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.625+0000 7f3d685ac700 1 -- 172.21.15.78:0/3901997205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d600c5790 msgr2=0x7f3d600c5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.625+0000 7f3d685ac700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d600c5790 0x7f3d600c5c10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f3d600693c0 tx=0x7f3d58009040).stop 2023-08-17T17:34:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.625+0000 7f3d685ac700 1 -- 172.21.15.78:0/3901997205 shutdown_connections 2023-08-17T17:34:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.625+0000 7f3d685ac700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d4c05ed90 0x7f3d4c061250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.625+0000 7f3d685ac700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d600c5790 0x7f3d600c5c10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.625+0000 7f3d685ac700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d48003910 0x7f3d600aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.625+0000 7f3d685ac700 1 --2- 172.21.15.78:0/3901997205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d600a96f0 0x7f3d6014dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.625+0000 7f3d685ac700 1 -- 172.21.15.78:0/3901997205 >> 172.21.15.78:0/3901997205 conn(0x7f3d60062cd0 msgr2=0x7f3d60066d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.626+0000 7f3d685ac700 1 -- 172.21.15.78:0/3901997205 shutdown_connections 2023-08-17T17:34:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.626+0000 7f3d685ac700 1 -- 172.21.15.78:0/3901997205 wait complete. 2023-08-17T17:34:34.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-08-17T17:34:34.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-17T17:34:34.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.750+0000 7f8657702700 1 Processor -- start 2023-08-17T17:34:34.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.750+0000 7f8657702700 1 -- start start 2023-08-17T17:34:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8657702700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8650064340 0x7f8650064720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8657702700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86500c98b0 0x7f86500c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8657702700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f86500c81e0 0x7f86500c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8657702700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86500638b0 con 0x7f86500c98b0 2023-08-17T17:34:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8657702700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86500a8680 con 0x7f86500c81e0 2023-08-17T17:34:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8657702700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86500c7860 con 0x7f8650064340 2023-08-17T17:34:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8654c9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86500c98b0 0x7f86500c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8654c9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86500c98b0 0x7f86500c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46958/0 (socket says 172.21.15.78:46958) 2023-08-17T17:34:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8654c9d700 1 -- 172.21.15.78:0/4062042481 learned_addr learned my addr 172.21.15.78:0/4062042481 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8654c9d700 1 -- 172.21.15.78:0/4062042481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8650064340 msgr2=0x7f8650064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.751+0000 7f8654c9d700 1 --2- 172.21.15.78:0/4062042481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8650064340 0x7f8650064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8654c9d700 1 -- 172.21.15.78:0/4062042481 >> v2:172.21.15.150:3300/0 conn(0x7f86500c81e0 msgr2=0x7f86500c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8655c9f700 1 --2- 172.21.15.78:0/4062042481 >> v2:172.21.15.150:3300/0 conn(0x7f86500c81e0 0x7f86500c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8654c9d700 1 --2- 172.21.15.78:0/4062042481 >> v2:172.21.15.150:3300/0 conn(0x7f86500c81e0 0x7f86500c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8654c9d700 1 -- 172.21.15.78:0/4062042481 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500c6c90 con 0x7f86500c98b0 2023-08-17T17:34:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8655c9f700 1 --2- 172.21.15.78:0/4062042481 >> v2:172.21.15.150:3300/0 conn(0x7f86500c81e0 0x7f86500c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8654c9d700 1 --2- 172.21.15.78:0/4062042481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86500c98b0 0x7f86500c7cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f86500634f0 tx=0x7f86440090f0).ready entity=mon.0 client_cookie=d98e59ed3b2df6cd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f864ffff700 1 -- 172.21.15.78:0/4062042481 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864400b600 con 0x7f86500c98b0 2023-08-17T17:34:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f864ffff700 1 -- 172.21.15.78:0/4062042481 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864400b760 con 0x7f86500c98b0 2023-08-17T17:34:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f864ffff700 1 -- 172.21.15.78:0/4062042481 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864400bae0 con 0x7f86500c98b0 2023-08-17T17:34:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8657702700 1 -- 172.21.15.78:0/4062042481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86500c98b0 msgr2=0x7f86500c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8657702700 1 --2- 172.21.15.78:0/4062042481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86500c98b0 0x7f86500c7cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f86500634f0 tx=0x7f86440090f0).stop 2023-08-17T17:34:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8657702700 1 -- 172.21.15.78:0/4062042481 shutdown_connections 2023-08-17T17:34:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8657702700 1 --2- 172.21.15.78:0/4062042481 >> v2:172.21.15.150:3300/0 conn(0x7f86500c81e0 0x7f86500c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8657702700 1 --2- 172.21.15.78:0/4062042481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8650064340 0x7f8650064720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8657702700 1 --2- 172.21.15.78:0/4062042481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86500c98b0 0x7f86500c7cf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8657702700 1 -- 172.21.15.78:0/4062042481 >> 172.21.15.78:0/4062042481 conn(0x7f8650062cd0 msgr2=0x7f86500c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:34.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8657702700 1 -- 172.21.15.78:0/4062042481 shutdown_connections 2023-08-17T17:34:34.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.752+0000 7f8657702700 1 -- 172.21.15.78:0/4062042481 wait complete. 2023-08-17T17:34:34.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.753+0000 7f8657702700 1 Processor -- start 2023-08-17T17:34:34.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.753+0000 7f8657702700 1 -- start start 2023-08-17T17:34:34.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.754+0000 7f8657702700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650064340 0x7f8650144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.754+0000 7f8657702700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86500c81e0 0x7f8650157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.754+0000 7f8657702700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86500c98b0 0x7f86500a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.754+0000 7f8657702700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8650168600 con 0x7f8650064340 2023-08-17T17:34:34.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.754+0000 7f8657702700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8650167d10 con 0x7f86500c81e0 2023-08-17T17:34:34.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.754+0000 7f8657702700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86501583c0 con 0x7f86500c98b0 2023-08-17T17:34:34.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.754+0000 7f865549e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650064340 0x7f8650144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.754+0000 7f865549e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650064340 0x7f8650144a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46970/0 (socket says 172.21.15.78:46970) 2023-08-17T17:34:34.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.754+0000 7f865549e700 1 -- 172.21.15.78:0/3395331775 learned_addr learned my addr 172.21.15.78:0/3395331775 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:34.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f8654c9d700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86500c81e0 0x7f8650157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f8655c9f700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86500c98b0 0x7f86500a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f865549e700 1 -- 172.21.15.78:0/3395331775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86500c98b0 msgr2=0x7f86500a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f865549e700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86500c98b0 0x7f86500a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f865549e700 1 -- 172.21.15.78:0/3395331775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86500c81e0 msgr2=0x7f8650157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f865549e700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86500c81e0 0x7f8650157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f865549e700 1 -- 172.21.15.78:0/3395331775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8644009370 con 0x7f8650064340 2023-08-17T17:34:34.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f865549e700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650064340 0x7f8650144a90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f864000bc30 tx=0x7f8640009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:34.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f864d7fa700 1 -- 172.21.15.78:0/3395331775 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864000c7a0 con 0x7f8650064340 2023-08-17T17:34:34.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f864d7fa700 1 -- 172.21.15.78:0/3395331775 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8640010070 con 0x7f8650064340 2023-08-17T17:34:34.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f8657702700 1 -- 172.21.15.78:0/3395331775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8650167fb0 con 0x7f8650064340 2023-08-17T17:34:34.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f864d7fa700 1 -- 172.21.15.78:0/3395331775 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864000c960 con 0x7f8650064340 2023-08-17T17:34:34.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.755+0000 7f8657702700 1 -- 172.21.15.78:0/3395331775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86500ad5a0 con 0x7f8650064340 2023-08-17T17:34:34.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.756+0000 7f8657702700 1 -- 172.21.15.78:0/3395331775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8650047350 con 0x7f8650064340 2023-08-17T17:34:34.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.756+0000 7f864d7fa700 1 -- 172.21.15.78:0/3395331775 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f864001c070 con 0x7f8650064340 2023-08-17T17:34:34.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.757+0000 7f864d7fa700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f863c05ed90 0x7f863c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:34.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.757+0000 7f864d7fa700 1 -- 172.21.15.78:0/3395331775 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f86400792b0 con 0x7f8650064340 2023-08-17T17:34:34.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.757+0000 7f8654c9d700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f863c05ed90 0x7f863c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:34.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.757+0000 7f8654c9d700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f863c05ed90 0x7f863c061250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f86500634f0 tx=0x7f8644017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:34.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.761+0000 7f864d7fa700 1 -- 172.21.15.78:0/3395331775 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f864004a850 con 0x7f8650064340 2023-08-17T17:34:34.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.923+0000 7f8657702700 1 -- 172.21.15.78:0/3395331775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f86500c6f30 con 0x7f8650064340 2023-08-17T17:34:34.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.923+0000 7f864d7fa700 1 -- 172.21.15.78:0/3395331775 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f864001a070 con 0x7f8650064340 2023-08-17T17:34:34.925 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-08-17T17:34:34.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 -- 172.21.15.78:0/3395331775 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f863c05ed90 msgr2=0x7f863c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f863c05ed90 0x7f863c061250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f86500634f0 tx=0x7f8644017000).stop 2023-08-17T17:34:34.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 -- 172.21.15.78:0/3395331775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650064340 msgr2=0x7f8650144a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:34.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650064340 0x7f8650144a90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f864000bc30 tx=0x7f8640009840).stop 2023-08-17T17:34:34.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 -- 172.21.15.78:0/3395331775 shutdown_connections 2023-08-17T17:34:34.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f863c05ed90 0x7f863c061250 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86500c98b0 0x7f86500a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650064340 0x7f8650144a90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 --2- 172.21.15.78:0/3395331775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86500c81e0 0x7f8650157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:34.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 -- 172.21.15.78:0/3395331775 >> 172.21.15.78:0/3395331775 conn(0x7f8650062cd0 msgr2=0x7f8650155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:34.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 -- 172.21.15.78:0/3395331775 shutdown_connections 2023-08-17T17:34:34.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:34.925+0000 7f8657702700 1 -- 172.21.15.78:0/3395331775 wait complete. 2023-08-17T17:34:34.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-08-17T17:34:34.938 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-17T17:34:35.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.050+0000 7f9f7e222700 1 Processor -- start 2023-08-17T17:34:35.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.050+0000 7f9f7e222700 1 -- start start 2023-08-17T17:34:35.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.051+0000 7f9f7e222700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9f78154580 0x7f9f780a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.051+0000 7f9f7e222700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780c7690 con 0x7f9f780c0560 2023-08-17T17:34:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.051+0000 7f9f7e222700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780c8df0 con 0x7f9f781541a0 2023-08-17T17:34:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.051+0000 7f9f7e222700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f780a8190 con 0x7f9f78154580 2023-08-17T17:34:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.051+0000 7f9f77fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9f780c0560 0x7f9f780c6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38260/0 (socket says 172.21.15.78:38260) 2023-08-17T17:34:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.051+0000 7f9f77fff700 1 -- 172.21.15.78:0/3350654137 learned_addr learned my addr 172.21.15.78:0/3350654137 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.051+0000 7f9f76ffd700 1 --2- 172.21.15.78:0/3350654137 >> v2:172.21.15.150:3300/0 conn(0x7f9f78154580 0x7f9f780a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.051+0000 7f9f767fc700 1 -- 172.21.15.78:0/3350654137 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913017390 0 0) 0x7f9f70001110 con 0x7f9f780c0560 2023-08-17T17:34:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f767fc700 1 -- 172.21.15.78:0/3350654137 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f600033f0 con 0x7f9f780c0560 2023-08-17T17:34:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f767fc700 1 -- 172.21.15.78:0/3350654137 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907856134 0 0) 0x7f9f780c8df0 con 0x7f9f781541a0 2023-08-17T17:34:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f767fc700 1 -- 172.21.15.78:0/3350654137 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f70001110 con 0x7f9f781541a0 2023-08-17T17:34:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f76ffd700 1 -- 172.21.15.78:0/3350654137 >> v1:172.21.15.150:6789/0 conn(0x7f9f781541a0 legacy=0x7f9f780bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f767fc700 1 -- 172.21.15.78:0/3350654137 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176619834 0 0) 0x7f9f600033f0 con 0x7f9f780c0560 2023-08-17T17:34:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f76ffd700 1 -- 172.21.15.78:0/3350654137 >> v1:172.21.15.78:6789/0 conn(0x7f9f780c0560 legacy=0x7f9f780c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f76ffd700 1 -- 172.21.15.78:0/3350654137 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780c9970 con 0x7f9f78154580 2023-08-17T17:34:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f76ffd700 1 --2- 172.21.15.78:0/3350654137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f78154580 0x7f9f780a7ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f9f6c009760 tx=0x7f9f6c009060).ready entity=mon.1 client_cookie=238cd81b594efdd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f767fc700 1 -- 172.21.15.78:0/3350654137 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70001600 con 0x7f9f78154580 2023-08-17T17:34:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f767fc700 1 -- 172.21.15.78:0/3350654137 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c0090d0 con 0x7f9f78154580 2023-08-17T17:34:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f767fc700 1 -- 172.21.15.78:0/3350654137 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c011610 con 0x7f9f78154580 2023-08-17T17:34:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f7e222700 1 -- 172.21.15.78:0/3350654137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f78154580 msgr2=0x7f9f780a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.052+0000 7f9f7e222700 1 --2- 172.21.15.78:0/3350654137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f78154580 0x7f9f780a7ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f9f6c009760 tx=0x7f9f6c009060).stop 2023-08-17T17:34:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.053+0000 7f9f7e222700 1 -- 172.21.15.78:0/3350654137 shutdown_connections 2023-08-17T17:34:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.053+0000 7f9f7e222700 1 --2- 172.21.15.78:0/3350654137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f78154580 0x7f9f780a7ca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.053+0000 7f9f7e222700 1 -- 172.21.15.78:0/3350654137 >> 172.21.15.78:0/3350654137 conn(0x7f9f7806a400 msgr2=0x7f9f780caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.053+0000 7f9f7e222700 1 -- 172.21.15.78:0/3350654137 shutdown_connections 2023-08-17T17:34:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.053+0000 7f9f7e222700 1 -- 172.21.15.78:0/3350654137 wait complete. 2023-08-17T17:34:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.054+0000 7f9f7e222700 1 Processor -- start 2023-08-17T17:34:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.054+0000 7f9f7e222700 1 -- start start 2023-08-17T17:34:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.054+0000 7f9f7e222700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f780c0560 0x7f9f7814ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.054+0000 7f9f7e222700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f781541a0 0x7f9f78155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.054+0000 7f9f7e222700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f78154580 0x7f9f78155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f7e222700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f78156780 con 0x7f9f78154580 2023-08-17T17:34:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f7e222700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f78150190 con 0x7f9f780c0560 2023-08-17T17:34:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f7e222700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f78150430 con 0x7f9f781541a0 2023-08-17T17:34:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f77fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f78154580 0x7f9f78155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f77fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f78154580 0x7f9f78155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46974/0 (socket says 172.21.15.78:46974) 2023-08-17T17:34:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f77fff700 1 -- 172.21.15.78:0/1041937673 learned_addr learned my addr 172.21.15.78:0/1041937673 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f76ffd700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f781541a0 0x7f9f78155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f777fe700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f780c0560 0x7f9f7814ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f77fff700 1 -- 172.21.15.78:0/1041937673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f781541a0 msgr2=0x7f9f78155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f77fff700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f781541a0 0x7f9f78155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f77fff700 1 -- 172.21.15.78:0/1041937673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f780c0560 msgr2=0x7f9f7814ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f77fff700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f780c0560 0x7f9f7814ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f77fff700 1 -- 172.21.15.78:0/1041937673 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c0092a0 con 0x7f9f78154580 2023-08-17T17:34:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f77fff700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f78154580 0x7f9f78155860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f9f7000c960 tx=0x7f9f70001c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f5f7fe700 1 -- 172.21.15.78:0/1041937673 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70007170 con 0x7f9f78154580 2023-08-17T17:34:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f5f7fe700 1 -- 172.21.15.78:0/1041937673 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f700072d0 con 0x7f9f78154580 2023-08-17T17:34:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f5f7fe700 1 -- 172.21.15.78:0/1041937673 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700048c0 con 0x7f9f78154580 2023-08-17T17:34:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f7e222700 1 -- 172.21.15.78:0/1041937673 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f780afc30 con 0x7f9f78154580 2023-08-17T17:34:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.055+0000 7f9f7e222700 1 -- 172.21.15.78:0/1041937673 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f78155ee0 con 0x7f9f78154580 2023-08-17T17:34:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.056+0000 7f9f7e222700 1 -- 172.21.15.78:0/1041937673 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f781505a0 con 0x7f9f78154580 2023-08-17T17:34:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.057+0000 7f9f5f7fe700 1 -- 172.21.15.78:0/1041937673 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9f70010070 con 0x7f9f78154580 2023-08-17T17:34:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.057+0000 7f9f5f7fe700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9f6405ed90 0x7f9f64061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.057+0000 7f9f5f7fe700 1 -- 172.21.15.78:0/1041937673 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9f70079440 con 0x7f9f78154580 2023-08-17T17:34:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.057+0000 7f9f777fe700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9f6405ed90 0x7f9f64061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.057+0000 7f9f777fe700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9f6405ed90 0x7f9f64061250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9f68003fc0 tx=0x7f9f68007f10).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.061+0000 7f9f5f7fe700 1 -- 172.21.15.78:0/1041937673 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f7004a9e0 con 0x7f9f78154580 2023-08-17T17:34:35.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.227+0000 7f9f7e222700 1 -- 172.21.15.78:0/1041937673 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9f781565e0 con 0x7f9f78154580 2023-08-17T17:34:35.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.227+0000 7f9f5f7fe700 1 -- 172.21.15.78:0/1041937673 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f781565e0 con 0x7f9f78154580 2023-08-17T17:34:35.229 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-08-17T17:34:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 -- 172.21.15.78:0/1041937673 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9f6405ed90 msgr2=0x7f9f64061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9f6405ed90 0x7f9f64061250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9f68003fc0 tx=0x7f9f68007f10).stop 2023-08-17T17:34:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 -- 172.21.15.78:0/1041937673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f78154580 msgr2=0x7f9f78155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f78154580 0x7f9f78155860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f9f7000c960 tx=0x7f9f70001c90).stop 2023-08-17T17:34:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 -- 172.21.15.78:0/1041937673 shutdown_connections 2023-08-17T17:34:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9f6405ed90 0x7f9f64061250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f78154580 0x7f9f78155860 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f780c0560 0x7f9f7814ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 --2- 172.21.15.78:0/1041937673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f781541a0 0x7f9f78155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 -- 172.21.15.78:0/1041937673 >> 172.21.15.78:0/1041937673 conn(0x7f9f7806a400 msgr2=0x7f9f780638b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 -- 172.21.15.78:0/1041937673 shutdown_connections 2023-08-17T17:34:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.229+0000 7f9f7e222700 1 -- 172.21.15.78:0/1041937673 wait complete. 2023-08-17T17:34:35.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-08-17T17:34:35.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-17T17:34:35.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.355+0000 7f48bdf3c700 1 Processor -- start 2023-08-17T17:34:35.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.355+0000 7f48bdf3c700 1 -- start start 2023-08-17T17:34:35.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.356+0000 7f48bdf3c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b81541a0 0x7f48b80a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.356+0000 7f48bdf3c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b80c7690 con 0x7f48b80c0560 2023-08-17T17:34:35.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.356+0000 7f48bdf3c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b80c8df0 con 0x7f48b8154580 2023-08-17T17:34:35.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.356+0000 7f48bdf3c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80a8190 con 0x7f48b81541a0 2023-08-17T17:34:35.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.356+0000 7f48b7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f48b80c0560 0x7f48b80c6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38266/0 (socket says 172.21.15.78:38266) 2023-08-17T17:34:35.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.356+0000 7f48b7fff700 1 -- 172.21.15.78:0/4234840286 learned_addr learned my addr 172.21.15.78:0/4234840286 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:35.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.356+0000 7f48b77fe700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b81541a0 0x7f48b80a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.356+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133284580 0 0) 0x7f48b0001490 con 0x7f48b80c0560 2023-08-17T17:34:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a40033f0 con 0x7f48b80c0560 2023-08-17T17:34:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3140158370 0 0) 0x7f48a40033f0 con 0x7f48b80c0560 2023-08-17T17:34:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b81541a0 msgr2=0x7f48b80a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b81541a0 0x7f48b80a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 >> v1:172.21.15.150:6789/0 conn(0x7f48b8154580 legacy=0x7f48b80bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80c9970 con 0x7f48b80c0560 2023-08-17T17:34:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f48b0001980 con 0x7f48b80c0560 2023-08-17T17:34:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 >> v1:172.21.15.78:6789/0 conn(0x7f48b80c0560 legacy=0x7f48b80c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 0x7f48a4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48a4004690 0x7f48a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b81541a0 0x7f48a40050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80a8190 con 0x7f48a4003910 2023-08-17T17:34:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a400b9c0 con 0x7f48a4004690 2023-08-17T17:34:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a400bb80 con 0x7f48b81541a0 2023-08-17T17:34:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b77fe700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 0x7f48a4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48aeffd700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48a4004690 0x7f48a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b7fff700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b81541a0 0x7f48a40050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b77fe700 1 -- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b81541a0 msgr2=0x7f48a40050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b77fe700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b81541a0 0x7f48a40050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b77fe700 1 -- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48a4004690 msgr2=0x7f48a4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b77fe700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48a4004690 0x7f48a4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b77fe700 1 -- 172.21.15.78:0/4234840286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40033f0 con 0x7f48a4003910 2023-08-17T17:34:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b77fe700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 0x7f48a4003d30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f48a8009a80 tx=0x7f48a8009060).ready entity=mon.0 client_cookie=ad88d36badbfdec4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8009430 con 0x7f48a4003910 2023-08-17T17:34:35.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a800e640 con 0x7f48a4003910 2023-08-17T17:34:35.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.357+0000 7f48b6ffd700 1 -- 172.21.15.78:0/4234840286 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800e9c0 con 0x7f48a4003910 2023-08-17T17:34:35.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.358+0000 7f48bdf3c700 1 -- 172.21.15.78:0/4234840286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 msgr2=0x7f48a4003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.358+0000 7f48bdf3c700 1 --2- 172.21.15.78:0/4234840286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 0x7f48a4003d30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f48a8009a80 tx=0x7f48a8009060).stop 2023-08-17T17:34:35.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.358+0000 7f48b7fff700 1 -- 172.21.15.78:0/4234840286 reap_dead start 2023-08-17T17:34:35.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.358+0000 7f48bdf3c700 1 -- 172.21.15.78:0/4234840286 shutdown_connections 2023-08-17T17:34:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.358+0000 7f48bdf3c700 1 -- 172.21.15.78:0/4234840286 >> 172.21.15.78:0/4234840286 conn(0x7f48b806a400 msgr2=0x7f48b80caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.358+0000 7f48bdf3c700 1 -- 172.21.15.78:0/4234840286 shutdown_connections 2023-08-17T17:34:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.358+0000 7f48bdf3c700 1 -- 172.21.15.78:0/4234840286 wait complete. 2023-08-17T17:34:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.359+0000 7f48bdf3c700 1 Processor -- start 2023-08-17T17:34:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.359+0000 7f48bdf3c700 1 -- start start 2023-08-17T17:34:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48bdf3c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 0x7f48b80b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48bdf3c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b80c1f90 0x7f48b80caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48bdf3c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b80cb190 0x7f48b814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48bdf3c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80cb610 con 0x7f48a4003910 2023-08-17T17:34:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48bdf3c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80c2500 con 0x7f48b80c1f90 2023-08-17T17:34:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48bdf3c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80c27e0 con 0x7f48b80cb190 2023-08-17T17:34:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48b77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 0x7f48b80b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48b77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 0x7f48b80b0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46992/0 (socket says 172.21.15.78:46992) 2023-08-17T17:34:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48b77fe700 1 -- 172.21.15.78:0/3179823481 learned_addr learned my addr 172.21.15.78:0/3179823481 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48aeffd700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b80c1f90 0x7f48b80caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48b7fff700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b80cb190 0x7f48b814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48b77fe700 1 -- 172.21.15.78:0/3179823481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b80cb190 msgr2=0x7f48b814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48b77fe700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b80cb190 0x7f48b814de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48b77fe700 1 -- 172.21.15.78:0/3179823481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b80c1f90 msgr2=0x7f48b80caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48b77fe700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b80c1f90 0x7f48b80caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48b77fe700 1 -- 172.21.15.78:0/3179823481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80c2ac0 con 0x7f48a4003910 2023-08-17T17:34:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.360+0000 7f48b7fff700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b80cb190 0x7f48b814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.361+0000 7f48b77fe700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 0x7f48b80b0470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f48a400b990 tx=0x7f48a801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.361+0000 7f48affff700 1 -- 172.21.15.78:0/3179823481 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800ed30 con 0x7f48a4003910 2023-08-17T17:34:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.361+0000 7f48affff700 1 -- 172.21.15.78:0/3179823481 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a800ee90 con 0x7f48a4003910 2023-08-17T17:34:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.361+0000 7f48bdf3c700 1 -- 172.21.15.78:0/3179823481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b80c2da0 con 0x7f48a4003910 2023-08-17T17:34:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.361+0000 7f48affff700 1 -- 172.21.15.78:0/3179823481 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8026440 con 0x7f48a4003910 2023-08-17T17:34:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.361+0000 7f48bdf3c700 1 -- 172.21.15.78:0/3179823481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b8146ec0 con 0x7f48a4003910 2023-08-17T17:34:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.362+0000 7f48bdf3c700 1 -- 172.21.15.78:0/3179823481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b80c12f0 con 0x7f48a4003910 2023-08-17T17:34:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.362+0000 7f48affff700 1 -- 172.21.15.78:0/3179823481 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f48a802c020 con 0x7f48a4003910 2023-08-17T17:34:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.362+0000 7f48affff700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f489805ed90 0x7f4898061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.362+0000 7f48aeffd700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f489805ed90 0x7f4898061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.362+0000 7f48affff700 1 -- 172.21.15.78:0/3179823481 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f48a807b670 con 0x7f48a4003910 2023-08-17T17:34:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.363+0000 7f48aeffd700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f489805ed90 0x7f4898061250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f48b8064d70 tx=0x7f48a0007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.366+0000 7f48affff700 1 -- 172.21.15.78:0/3179823481 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f48a804cc90 con 0x7f48a4003910 2023-08-17T17:34:35.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.528+0000 7f48bdf3c700 1 -- 172.21.15.78:0/3179823481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f48b8047350 con 0x7f48a4003910 2023-08-17T17:34:35.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.528+0000 7f48affff700 1 -- 172.21.15.78:0/3179823481 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48a8016020 con 0x7f48a4003910 2023-08-17T17:34:35.530 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-08-17T17:34:35.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 -- 172.21.15.78:0/3179823481 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f489805ed90 msgr2=0x7f4898061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f489805ed90 0x7f4898061250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f48b8064d70 tx=0x7f48a0007bb0).stop 2023-08-17T17:34:35.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 -- 172.21.15.78:0/3179823481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 msgr2=0x7f48b80b0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 0x7f48b80b0470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f48a400b990 tx=0x7f48a801a000).stop 2023-08-17T17:34:35.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 -- 172.21.15.78:0/3179823481 shutdown_connections 2023-08-17T17:34:35.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f489805ed90 0x7f4898061250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b80cb190 0x7f48b814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48a4003910 0x7f48b80b0470 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 --2- 172.21.15.78:0/3179823481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b80c1f90 0x7f48b80caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 -- 172.21.15.78:0/3179823481 >> 172.21.15.78:0/3179823481 conn(0x7f48b806a400 msgr2=0x7f48b8063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:35.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 -- 172.21.15.78:0/3179823481 shutdown_connections 2023-08-17T17:34:35.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.530+0000 7f48bdf3c700 1 -- 172.21.15.78:0/3179823481 wait complete. 2023-08-17T17:34:35.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-08-17T17:34:35.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-17T17:34:35.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.655+0000 7f9e3892f700 1 Processor -- start 2023-08-17T17:34:35.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.655+0000 7f9e3892f700 1 -- start start 2023-08-17T17:34:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.656+0000 7f9e3892f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e34062c00 0x7f9e34065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.656+0000 7f9e3892f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e34065890 con 0x7f9e340a77c0 2023-08-17T17:34:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.656+0000 7f9e3892f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e340a7c50 con 0x7f9e341555d0 2023-08-17T17:34:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.656+0000 7f9e3892f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340c3b90 con 0x7f9e34062c00 2023-08-17T17:34:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.656+0000 7f9e29d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9e340a77c0 0x7f9e340624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38268/0 (socket says 172.21.15.78:38268) 2023-08-17T17:34:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.656+0000 7f9e29d9b700 1 -- 172.21.15.78:0/2819078573 learned_addr learned my addr 172.21.15.78:0/2819078573 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e32d9d700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e34062c00 0x7f9e34065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129968444 0 0) 0x7f9e34065890 con 0x7f9e340a77c0 2023-08-17T17:34:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e200033f0 con 0x7f9e340a77c0 2023-08-17T17:34:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174822109 0 0) 0x7f9e340a7c50 con 0x7f9e341555d0 2023-08-17T17:34:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e34065890 con 0x7f9e341555d0 2023-08-17T17:34:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965094877 0 0) 0x7f9e200033f0 con 0x7f9e340a77c0 2023-08-17T17:34:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e34062c00 msgr2=0x7f9e34065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e34062c00 0x7f9e34065d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 >> v1:172.21.15.150:6789/0 conn(0x7f9e341555d0 legacy=0x7f9e34069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e340c5230 con 0x7f9e340a77c0 2023-08-17T17:34:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f9e1c001470 con 0x7f9e340a77c0 2023-08-17T17:34:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 >> v1:172.21.15.78:6789/0 conn(0x7f9e340a77c0 legacy=0x7f9e340624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e34062c00 0x7f9e20003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e20003fb0 0x7f9e20004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e20004b80 0x7f9e20005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340c3b90 con 0x7f9e20004b80 2023-08-17T17:34:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2000b990 con 0x7f9e20003fb0 2023-08-17T17:34:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2000bb50 con 0x7f9e34062c00 2023-08-17T17:34:35.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e32d9d700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e20004b80 0x7f9e20005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e29d9b700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e20003fb0 0x7f9e20004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e3259c700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e34062c00 0x7f9e20003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e32d9d700 1 -- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e34062c00 msgr2=0x7f9e20003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:35.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e32d9d700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e34062c00 0x7f9e20003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e32d9d700 1 -- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e20003fb0 msgr2=0x7f9e20004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:35.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e32d9d700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e20003fb0 0x7f9e20004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e32d9d700 1 -- 172.21.15.78:0/2819078573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200033f0 con 0x7f9e20004b80 2023-08-17T17:34:35.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e3259c700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e34062c00 0x7f9e20003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:35.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.657+0000 7f9e32d9d700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e20004b80 0x7f9e20005000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f9e340a76c0 tx=0x7f9e2c00b040).ready entity=mon.0 client_cookie=b6db363b0820a6cf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.658+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c017070 con 0x7f9e20004b80 2023-08-17T17:34:35.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.658+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c00f040 con 0x7f9e20004b80 2023-08-17T17:34:35.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.658+0000 7f9e31d9b700 1 -- 172.21.15.78:0/2819078573 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00ec60 con 0x7f9e20004b80 2023-08-17T17:34:35.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.658+0000 7f9e3892f700 1 -- 172.21.15.78:0/2819078573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e20004b80 msgr2=0x7f9e20005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.658+0000 7f9e3892f700 1 --2- 172.21.15.78:0/2819078573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e20004b80 0x7f9e20005000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f9e340a76c0 tx=0x7f9e2c00b040).stop 2023-08-17T17:34:35.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.658+0000 7f9e32d9d700 1 -- 172.21.15.78:0/2819078573 reap_dead start 2023-08-17T17:34:35.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.658+0000 7f9e3892f700 1 -- 172.21.15.78:0/2819078573 shutdown_connections 2023-08-17T17:34:35.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.658+0000 7f9e3892f700 1 -- 172.21.15.78:0/2819078573 >> 172.21.15.78:0/2819078573 conn(0x7f9e340c8680 msgr2=0x7f9e340c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:35.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.658+0000 7f9e3892f700 1 -- 172.21.15.78:0/2819078573 shutdown_connections 2023-08-17T17:34:35.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.658+0000 7f9e3892f700 1 -- 172.21.15.78:0/2819078573 wait complete. 2023-08-17T17:34:35.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.659+0000 7f9e3892f700 1 Processor -- start 2023-08-17T17:34:35.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.659+0000 7f9e3892f700 1 -- start start 2023-08-17T17:34:35.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e3892f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e20004b80 0x7f9e340a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e3892f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e34154310 0x7f9e340a63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e3892f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3413aba0 0x7f9e3413b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e3892f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340bfd50 con 0x7f9e34154310 2023-08-17T17:34:35.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e3892f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3413b510 con 0x7f9e3413aba0 2023-08-17T17:34:35.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e3892f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340a6be0 con 0x7f9e20004b80 2023-08-17T17:34:35.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e29d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e34154310 0x7f9e340a63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e29d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e34154310 0x7f9e340a63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47010/0 (socket says 172.21.15.78:47010) 2023-08-17T17:34:35.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e29d9b700 1 -- 172.21.15.78:0/382173776 learned_addr learned my addr 172.21.15.78:0/382173776 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:35.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e32d9d700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3413aba0 0x7f9e3413b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e3259c700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e20004b80 0x7f9e340a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e29d9b700 1 -- 172.21.15.78:0/382173776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e20004b80 msgr2=0x7f9e340a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e29d9b700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e20004b80 0x7f9e340a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e29d9b700 1 -- 172.21.15.78:0/382173776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3413aba0 msgr2=0x7f9e3413b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e29d9b700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3413aba0 0x7f9e3413b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e29d9b700 1 -- 172.21.15.78:0/382173776 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e340a6ec0 con 0x7f9e34154310 2023-08-17T17:34:35.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e32d9d700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3413aba0 0x7f9e3413b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:35.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.660+0000 7f9e29d9b700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e34154310 0x7f9e340a63b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f9e1c004a40 tx=0x7f9e1c001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.661+0000 7f9e2affd700 1 -- 172.21.15.78:0/382173776 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00f8d0 con 0x7f9e34154310 2023-08-17T17:34:35.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.661+0000 7f9e2affd700 1 -- 172.21.15.78:0/382173776 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c00fa30 con 0x7f9e34154310 2023-08-17T17:34:35.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.661+0000 7f9e3892f700 1 -- 172.21.15.78:0/382173776 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e340a71a0 con 0x7f9e34154310 2023-08-17T17:34:35.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.661+0000 7f9e2affd700 1 -- 172.21.15.78:0/382173776 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00fdf0 con 0x7f9e34154310 2023-08-17T17:34:35.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.661+0000 7f9e3892f700 1 -- 172.21.15.78:0/382173776 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e34154790 con 0x7f9e34154310 2023-08-17T17:34:35.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.661+0000 7f9e3892f700 1 -- 172.21.15.78:0/382173776 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e34064490 con 0x7f9e34154310 2023-08-17T17:34:35.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.662+0000 7f9e2affd700 1 -- 172.21.15.78:0/382173776 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9e1c01b030 con 0x7f9e34154310 2023-08-17T17:34:35.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.662+0000 7f9e2affd700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e1405ed90 0x7f9e14061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.662+0000 7f9e2affd700 1 -- 172.21.15.78:0/382173776 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9e1c079570 con 0x7f9e34154310 2023-08-17T17:34:35.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.662+0000 7f9e3259c700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e1405ed90 0x7f9e14061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.663+0000 7f9e3259c700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e1405ed90 0x7f9e14061250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9e24007a40 tx=0x7f9e24009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.666+0000 7f9e2affd700 1 -- 172.21.15.78:0/382173776 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e1c04ab10 con 0x7f9e34154310 2023-08-17T17:34:35.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.829+0000 7f9e3892f700 1 -- 172.21.15.78:0/382173776 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9e34047350 con 0x7f9e34154310 2023-08-17T17:34:35.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.829+0000 7f9e2affd700 1 -- 172.21.15.78:0/382173776 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e1c019020 con 0x7f9e34154310 2023-08-17T17:34:35.831 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-08-17T17:34:35.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 -- 172.21.15.78:0/382173776 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e1405ed90 msgr2=0x7f9e14061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e1405ed90 0x7f9e14061250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9e24007a40 tx=0x7f9e24009040).stop 2023-08-17T17:34:35.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 -- 172.21.15.78:0/382173776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e34154310 msgr2=0x7f9e340a63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e34154310 0x7f9e340a63b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f9e1c004a40 tx=0x7f9e1c001e10).stop 2023-08-17T17:34:35.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 -- 172.21.15.78:0/382173776 shutdown_connections 2023-08-17T17:34:35.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e1405ed90 0x7f9e14061250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3413aba0 0x7f9e3413b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e20004b80 0x7f9e340a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 --2- 172.21.15.78:0/382173776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e34154310 0x7f9e340a63b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 -- 172.21.15.78:0/382173776 >> 172.21.15.78:0/382173776 conn(0x7f9e340c8680 msgr2=0x7f9e340c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:35.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 -- 172.21.15.78:0/382173776 shutdown_connections 2023-08-17T17:34:35.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.831+0000 7f9e3892f700 1 -- 172.21.15.78:0/382173776 wait complete. 2023-08-17T17:34:35.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-08-17T17:34:35.844 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-17T17:34:35.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:34:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.955+0000 7fa0ff5d7700 1 Processor -- start 2023-08-17T17:34:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.955+0000 7fa0ff5d7700 1 -- start start 2023-08-17T17:34:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.956+0000 7fa0ff5d7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f813a640 0x7fa0f8154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.956+0000 7fa0ff5d7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa0f8069760 0x7fa0f80c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.956+0000 7fa0ff5d7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f80c2c10 con 0x7fa0f806a2c0 2023-08-17T17:34:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.956+0000 7fa0ff5d7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f8155010 con 0x7fa0f8069760 2023-08-17T17:34:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.956+0000 7fa0ff5d7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f81552e0 con 0x7fa0f813a640 2023-08-17T17:34:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.956+0000 7fa0fcb72700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa0f806a2c0 0x7fa0f8069050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38270/0 (socket says 172.21.15.78:38270) 2023-08-17T17:34:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.956+0000 7fa0fcb72700 1 -- 172.21.15.78:0/3662541061 learned_addr learned my addr 172.21.15.78:0/3662541061 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0fdb74700 1 --2- 172.21.15.78:0/3662541061 >> v2:172.21.15.150:3300/0 conn(0x7fa0f8069760 0x7fa0f80c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0fd373700 1 --2- 172.21.15.78:0/3662541061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f813a640 0x7fa0f8154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0effff700 1 -- 172.21.15.78:0/3662541061 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888147778 0 0) 0x7fa0f80c2c10 con 0x7fa0f806a2c0 2023-08-17T17:34:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0effff700 1 -- 172.21.15.78:0/3662541061 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e40033f0 con 0x7fa0f806a2c0 2023-08-17T17:34:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0effff700 1 -- 172.21.15.78:0/3662541061 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4121431084 0 0) 0x7fa0e40033f0 con 0x7fa0f806a2c0 2023-08-17T17:34:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0fdb74700 1 -- 172.21.15.78:0/3662541061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f813a640 msgr2=0x7fa0f8154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0fdb74700 1 --2- 172.21.15.78:0/3662541061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f813a640 0x7fa0f8154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0fdb74700 1 -- 172.21.15.78:0/3662541061 >> v1:172.21.15.78:6789/0 conn(0x7fa0f806a2c0 legacy=0x7fa0f8069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0fdb74700 1 -- 172.21.15.78:0/3662541061 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f81555c0 con 0x7fa0f8069760 2023-08-17T17:34:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0fdb74700 1 --2- 172.21.15.78:0/3662541061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8069760 0x7fa0f80c33b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa0f0009e60 tx=0x7fa0f0009780).ready entity=mon.1 client_cookie=421f28430e9d36ca server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0effff700 1 -- 172.21.15.78:0/3662541061 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000e070 con 0x7fa0f8069760 2023-08-17T17:34:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0effff700 1 -- 172.21.15.78:0/3662541061 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f000b7a0 con 0x7fa0f8069760 2023-08-17T17:34:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.957+0000 7fa0effff700 1 -- 172.21.15.78:0/3662541061 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8001470 con 0x7fa0f8069760 2023-08-17T17:34:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.958+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/3662541061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8069760 msgr2=0x7fa0f80c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.958+0000 7fa0ff5d7700 1 --2- 172.21.15.78:0/3662541061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8069760 0x7fa0f80c33b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa0f0009e60 tx=0x7fa0f0009780).stop 2023-08-17T17:34:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.958+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/3662541061 shutdown_connections 2023-08-17T17:34:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.958+0000 7fa0ff5d7700 1 --2- 172.21.15.78:0/3662541061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8069760 0x7fa0f80c33b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.958+0000 7fa0ff5d7700 1 --2- 172.21.15.78:0/3662541061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f813a640 0x7fa0f8154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.958+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/3662541061 >> 172.21.15.78:0/3662541061 conn(0x7fa0f80c7b00 msgr2=0x7fa0f80c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.958+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/3662541061 shutdown_connections 2023-08-17T17:34:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.958+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/3662541061 wait complete. 2023-08-17T17:34:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.959+0000 7fa0ff5d7700 1 Processor -- start 2023-08-17T17:34:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.959+0000 7fa0ff5d7700 1 -- start start 2023-08-17T17:34:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0ff5d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8069760 0x7fa0f80aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0ff5d7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806a2c0 0x7fa0f80c0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0ff5d7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f813a640 0x7fa0f80ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0ff5d7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c1a00 con 0x7fa0f813a640 2023-08-17T17:34:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0ff5d7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80aa5e0 con 0x7fa0f8069760 2023-08-17T17:34:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0ff5d7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c0df0 con 0x7fa0f806a2c0 2023-08-17T17:34:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fdb74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f813a640 0x7fa0f80ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fdb74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f813a640 0x7fa0f80ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47020/0 (socket says 172.21.15.78:47020) 2023-08-17T17:34:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fdb74700 1 -- 172.21.15.78:0/344041045 learned_addr learned my addr 172.21.15.78:0/344041045 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fd373700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8069760 0x7fa0f80aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fcb72700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806a2c0 0x7fa0f80c0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fdb74700 1 -- 172.21.15.78:0/344041045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806a2c0 msgr2=0x7fa0f80c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fdb74700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806a2c0 0x7fa0f80c0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fdb74700 1 -- 172.21.15.78:0/344041045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8069760 msgr2=0x7fa0f80aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fdb74700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8069760 0x7fa0f80aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fdb74700 1 -- 172.21.15.78:0/344041045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0009a20 con 0x7fa0f813a640 2023-08-17T17:34:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fcb72700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806a2c0 0x7fa0f80c0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0fdb74700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f813a640 0x7fa0f80ac640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa0f805f3a0 tx=0x7fa0f0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0ed7fa700 1 -- 172.21.15.78:0/344041045 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f001d420 con 0x7fa0f813a640 2023-08-17T17:34:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0ed7fa700 1 -- 172.21.15.78:0/344041045 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f001d580 con 0x7fa0f813a640 2023-08-17T17:34:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/344041045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f80c10d0 con 0x7fa0f813a640 2023-08-17T17:34:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.960+0000 7fa0ed7fa700 1 -- 172.21.15.78:0/344041045 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f001d940 con 0x7fa0f813a640 2023-08-17T17:34:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.961+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/344041045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f80c1690 con 0x7fa0f813a640 2023-08-17T17:34:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.961+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/344041045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f8064610 con 0x7fa0f813a640 2023-08-17T17:34:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.962+0000 7fa0ed7fa700 1 -- 172.21.15.78:0/344041045 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa0f001dd30 con 0x7fa0f813a640 2023-08-17T17:34:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.962+0000 7fa0ed7fa700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed90 0x7fa0dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.962+0000 7fa0ed7fa700 1 -- 172.21.15.78:0/344041045 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa0f007bb10 con 0x7fa0f813a640 2023-08-17T17:34:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.962+0000 7fa0fd373700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed90 0x7fa0dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.962+0000 7fa0fd373700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed90 0x7fa0dc061250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa0f4009b90 tx=0x7fa0f4009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:35.966+0000 7fa0ed7fa700 1 -- 172.21.15.78:0/344041045 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa0f8064610 con 0x7fa0f813a640 2023-08-17T17:34:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.128+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/344041045 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0f8064610 con 0x7fa0dc05ed90 2023-08-17T17:34:36.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.137+0000 7fa0ed7fa700 1 -- 172.21.15.78:0/344041045 <== mgr.4104 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336282 (secure 0 0 0) 0x7fa0f8064610 con 0x7fa0dc05ed90 2023-08-17T17:34:36.141 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:36.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.140+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/344041045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed90 msgr2=0x7fa0dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.140+0000 7fa0ff5d7700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed90 0x7fa0dc061250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa0f4009b90 tx=0x7fa0f4009060).stop 2023-08-17T17:34:36.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.140+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/344041045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f813a640 msgr2=0x7fa0f80ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.140+0000 7fa0ff5d7700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f813a640 0x7fa0f80ac640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa0f805f3a0 tx=0x7fa0f0009780).stop 2023-08-17T17:34:36.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.140+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/344041045 shutdown_connections 2023-08-17T17:34:36.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.140+0000 7fa0ff5d7700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed90 0x7fa0dc061250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.140+0000 7fa0ff5d7700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f813a640 0x7fa0f80ac640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.140+0000 7fa0ff5d7700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8069760 0x7fa0f80aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.140+0000 7fa0ff5d7700 1 --2- 172.21.15.78:0/344041045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806a2c0 0x7fa0f80c0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.141+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/344041045 >> 172.21.15.78:0/344041045 conn(0x7fa0f80c7b00 msgr2=0x7fa0f8138960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:36.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.141+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/344041045 shutdown_connections 2023-08-17T17:34:36.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.141+0000 7fa0ff5d7700 1 -- 172.21.15.78:0/344041045 wait complete. 2023-08-17T17:34:36.145 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:34:36.154 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-17T17:34:35.010650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378624,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596096,"statfs":{"total":773094113280,"available":770658402304,"internally_reserved":0,"allocated":1900544,"data_stored":687340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001606"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561594+0000","last_change":"2023-08-17T17:34:23.557678+0000","last_active":"2023-08-17T17:34:23.561594+0000","last_peered":"2023-08-17T17:34:23.561594+0000","last_clean":"2023-08-17T17:34:23.561594+0000","last_became_active":"2023-08-17T17:34:23.555333+0000","last_became_peered":"2023-08-17T17:34:23.555333+0000","last_unstale":"2023-08-17T17:34:23.561594+0000","last_undegraded":"2023-08-17T17:34:23.561594+0000","last_fullsized":"2023-08-17T17:34:23.561594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.539074+0000","last_change":"2023-08-17T17:34:23.190017+0000","last_active":"2023-08-17T17:34:23.539074+0000","last_peered":"2023-08-17T17:34:23.539074+0000","last_clean":"2023-08-17T17:34:23.539074+0000","last_became_active":"2023-08-17T17:34:23.189552+0000","last_became_peered":"2023-08-17T17:34:23.189552+0000","last_unstale":"2023-08-17T17:34:23.539074+0000","last_undegraded":"2023-08-17T17:34:23.539074+0000","last_fullsized":"2023-08-17T17:34:23.539074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553264+0000","last_change":"2023-08-17T17:34:23.547846+0000","last_active":"2023-08-17T17:34:23.553264+0000","last_peered":"2023-08-17T17:34:23.553264+0000","last_clean":"2023-08-17T17:34:23.553264+0000","last_became_active":"2023-08-17T17:34:23.547522+0000","last_became_peered":"2023-08-17T17:34:23.547522+0000","last_unstale":"2023-08-17T17:34:23.553264+0000","last_undegraded":"2023-08-17T17:34:23.553264+0000","last_fullsized":"2023-08-17T17:34:23.553264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533143+0000","last_change":"2023-08-17T17:34:23.196197+0000","last_active":"2023-08-17T17:34:23.533143+0000","last_peered":"2023-08-17T17:34:23.533143+0000","last_clean":"2023-08-17T17:34:23.533143+0000","last_became_active":"2023-08-17T17:34:23.195910+0000","last_became_peered":"2023-08-17T17:34:23.195910+0000","last_unstale":"2023-08-17T17:34:23.533143+0000","last_undegraded":"2023-08-17T17:34:23.533143+0000","last_fullsized":"2023-08-17T17:34:23.533143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556574+0000","last_change":"2023-08-17T17:34:23.550439+0000","last_active":"2023-08-17T17:34:23.556574+0000","last_peered":"2023-08-17T17:34:23.556574+0000","last_clean":"2023-08-17T17:34:23.556574+0000","last_became_active":"2023-08-17T17:34:23.550192+0000","last_became_peered":"2023-08-17T17:34:23.550192+0000","last_unstale":"2023-08-17T17:34:23.556574+0000","last_undegraded":"2023-08-17T17:34:23.556574+0000","last_fullsized":"2023-08-17T17:34:23.556574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553151+0000","last_change":"2023-08-17T17:34:23.186362+0000","last_active":"2023-08-17T17:34:23.553151+0000","last_peered":"2023-08-17T17:34:23.553151+0000","last_clean":"2023-08-17T17:34:23.553151+0000","last_became_active":"2023-08-17T17:34:23.186076+0000","last_became_peered":"2023-08-17T17:34:23.186076+0000","last_unstale":"2023-08-17T17:34:23.553151+0000","last_undegraded":"2023-08-17T17:34:23.553151+0000","last_fullsized":"2023-08-17T17:34:23.553151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561724+0000","last_change":"2023-08-17T17:34:23.558066+0000","last_active":"2023-08-17T17:34:23.561724+0000","last_peered":"2023-08-17T17:34:23.561724+0000","last_clean":"2023-08-17T17:34:23.561724+0000","last_became_active":"2023-08-17T17:34:23.557750+0000","last_became_peered":"2023-08-17T17:34:23.557750+0000","last_unstale":"2023-08-17T17:34:23.561724+0000","last_undegraded":"2023-08-17T17:34:23.561724+0000","last_fullsized":"2023-08-17T17:34:23.561724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538164+0000","last_change":"2023-08-17T17:34:23.185772+0000","last_active":"2023-08-17T17:34:23.538164+0000","last_peered":"2023-08-17T17:34:23.538164+0000","last_clean":"2023-08-17T17:34:23.538164+0000","last_became_active":"2023-08-17T17:34:23.185206+0000","last_became_peered":"2023-08-17T17:34:23.185206+0000","last_unstale":"2023-08-17T17:34:23.538164+0000","last_undegraded":"2023-08-17T17:34:23.538164+0000","last_fullsized":"2023-08-17T17:34:23.538164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561741+0000","last_change":"2023-08-17T17:34:23.558454+0000","last_active":"2023-08-17T17:34:23.561741+0000","last_peered":"2023-08-17T17:34:23.561741+0000","last_clean":"2023-08-17T17:34:23.561741+0000","last_became_active":"2023-08-17T17:34:23.558213+0000","last_became_peered":"2023-08-17T17:34:23.558213+0000","last_unstale":"2023-08-17T17:34:23.561741+0000","last_undegraded":"2023-08-17T17:34:23.561741+0000","last_fullsized":"2023-08-17T17:34:23.561741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538249+0000","last_change":"2023-08-17T17:34:23.188666+0000","last_active":"2023-08-17T17:34:23.538249+0000","last_peered":"2023-08-17T17:34:23.538249+0000","last_clean":"2023-08-17T17:34:23.538249+0000","last_became_active":"2023-08-17T17:34:23.188351+0000","last_became_peered":"2023-08-17T17:34:23.188351+0000","last_unstale":"2023-08-17T17:34:23.538249+0000","last_undegraded":"2023-08-17T17:34:23.538249+0000","last_fullsized":"2023-08-17T17:34:23.538249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553062+0000","last_change":"2023-08-17T17:34:23.550268+0000","last_active":"2023-08-17T17:34:23.553062+0000","last_peered":"2023-08-17T17:34:23.553062+0000","last_clean":"2023-08-17T17:34:23.553062+0000","last_became_active":"2023-08-17T17:34:23.549994+0000","last_became_peered":"2023-08-17T17:34:23.549994+0000","last_unstale":"2023-08-17T17:34:23.553062+0000","last_undegraded":"2023-08-17T17:34:23.553062+0000","last_fullsized":"2023-08-17T17:34:23.553062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561548+0000","last_change":"2023-08-17T17:34:23.187424+0000","last_active":"2023-08-17T17:34:23.561548+0000","last_peered":"2023-08-17T17:34:23.561548+0000","last_clean":"2023-08-17T17:34:23.561548+0000","last_became_active":"2023-08-17T17:34:23.187090+0000","last_became_peered":"2023-08-17T17:34:23.187090+0000","last_unstale":"2023-08-17T17:34:23.561548+0000","last_undegraded":"2023-08-17T17:34:23.561548+0000","last_fullsized":"2023-08-17T17:34:23.561548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555838+0000","last_change":"2023-08-17T17:34:23.550226+0000","last_active":"2023-08-17T17:34:23.555838+0000","last_peered":"2023-08-17T17:34:23.555838+0000","last_clean":"2023-08-17T17:34:23.555838+0000","last_became_active":"2023-08-17T17:34:23.549894+0000","last_became_peered":"2023-08-17T17:34:23.549894+0000","last_unstale":"2023-08-17T17:34:23.555838+0000","last_undegraded":"2023-08-17T17:34:23.555838+0000","last_fullsized":"2023-08-17T17:34:23.555838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557712+0000","last_change":"2023-08-17T17:34:23.191048+0000","last_active":"2023-08-17T17:34:23.557712+0000","last_peered":"2023-08-17T17:34:23.557712+0000","last_clean":"2023-08-17T17:34:23.557712+0000","last_became_active":"2023-08-17T17:34:23.189624+0000","last_became_peered":"2023-08-17T17:34:23.189624+0000","last_unstale":"2023-08-17T17:34:23.557712+0000","last_undegraded":"2023-08-17T17:34:23.557712+0000","last_fullsized":"2023-08-17T17:34:23.557712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561649+0000","last_change":"2023-08-17T17:34:23.560468+0000","last_active":"2023-08-17T17:34:23.561649+0000","last_peered":"2023-08-17T17:34:23.561649+0000","last_clean":"2023-08-17T17:34:23.561649+0000","last_became_active":"2023-08-17T17:34:23.560200+0000","last_became_peered":"2023-08-17T17:34:23.560200+0000","last_unstale":"2023-08-17T17:34:23.561649+0000","last_undegraded":"2023-08-17T17:34:23.561649+0000","last_fullsized":"2023-08-17T17:34:23.561649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557231+0000","last_change":"2023-08-17T17:34:23.192628+0000","last_active":"2023-08-17T17:34:23.557231+0000","last_peered":"2023-08-17T17:34:23.557231+0000","last_clean":"2023-08-17T17:34:23.557231+0000","last_became_active":"2023-08-17T17:34:23.192359+0000","last_became_peered":"2023-08-17T17:34:23.192359+0000","last_unstale":"2023-08-17T17:34:23.557231+0000","last_undegraded":"2023-08-17T17:34:23.557231+0000","last_fullsized":"2023-08-17T17:34:23.557231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554345+0000","last_change":"2023-08-17T17:34:23.549337+0000","last_active":"2023-08-17T17:34:23.554345+0000","last_peered":"2023-08-17T17:34:23.554345+0000","last_clean":"2023-08-17T17:34:23.554345+0000","last_became_active":"2023-08-17T17:34:23.547732+0000","last_became_peered":"2023-08-17T17:34:23.547732+0000","last_unstale":"2023-08-17T17:34:23.554345+0000","last_undegraded":"2023-08-17T17:34:23.554345+0000","last_fullsized":"2023-08-17T17:34:23.554345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536787+0000","last_change":"2023-08-17T17:34:23.189436+0000","last_active":"2023-08-17T17:34:23.536787+0000","last_peered":"2023-08-17T17:34:23.536787+0000","last_clean":"2023-08-17T17:34:23.536787+0000","last_became_active":"2023-08-17T17:34:23.189166+0000","last_became_peered":"2023-08-17T17:34:23.189166+0000","last_unstale":"2023-08-17T17:34:23.536787+0000","last_undegraded":"2023-08-17T17:34:23.536787+0000","last_fullsized":"2023-08-17T17:34:23.536787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553613+0000","last_change":"2023-08-17T17:34:23.551604+0000","last_active":"2023-08-17T17:34:23.553613+0000","last_peered":"2023-08-17T17:34:23.553613+0000","last_clean":"2023-08-17T17:34:23.553613+0000","last_became_active":"2023-08-17T17:34:23.551329+0000","last_became_peered":"2023-08-17T17:34:23.551329+0000","last_unstale":"2023-08-17T17:34:23.553613+0000","last_undegraded":"2023-08-17T17:34:23.553613+0000","last_fullsized":"2023-08-17T17:34:23.553613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541261+0000","last_change":"2023-08-17T17:34:23.190730+0000","last_active":"2023-08-17T17:34:23.541261+0000","last_peered":"2023-08-17T17:34:23.541261+0000","last_clean":"2023-08-17T17:34:23.541261+0000","last_became_active":"2023-08-17T17:34:23.190449+0000","last_became_peered":"2023-08-17T17:34:23.190449+0000","last_unstale":"2023-08-17T17:34:23.541261+0000","last_undegraded":"2023-08-17T17:34:23.541261+0000","last_fullsized":"2023-08-17T17:34:23.541261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561770+0000","last_change":"2023-08-17T17:34:23.558813+0000","last_active":"2023-08-17T17:34:23.561770+0000","last_peered":"2023-08-17T17:34:23.561770+0000","last_clean":"2023-08-17T17:34:23.561770+0000","last_became_active":"2023-08-17T17:34:23.558310+0000","last_became_peered":"2023-08-17T17:34:23.558310+0000","last_unstale":"2023-08-17T17:34:23.561770+0000","last_undegraded":"2023-08-17T17:34:23.561770+0000","last_fullsized":"2023-08-17T17:34:23.561770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555952+0000","last_change":"2023-08-17T17:34:23.185442+0000","last_active":"2023-08-17T17:34:23.555952+0000","last_peered":"2023-08-17T17:34:23.555952+0000","last_clean":"2023-08-17T17:34:23.555952+0000","last_became_active":"2023-08-17T17:34:23.185159+0000","last_became_peered":"2023-08-17T17:34:23.185159+0000","last_unstale":"2023-08-17T17:34:23.555952+0000","last_undegraded":"2023-08-17T17:34:23.555952+0000","last_fullsized":"2023-08-17T17:34:23.555952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550463+0000","last_change":"2023-08-17T17:34:23.547815+0000","last_active":"2023-08-17T17:34:23.550463+0000","last_peered":"2023-08-17T17:34:23.550463+0000","last_clean":"2023-08-17T17:34:23.550463+0000","last_became_active":"2023-08-17T17:34:23.547492+0000","last_became_peered":"2023-08-17T17:34:23.547492+0000","last_unstale":"2023-08-17T17:34:23.550463+0000","last_undegraded":"2023-08-17T17:34:23.550463+0000","last_fullsized":"2023-08-17T17:34:23.550463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557254+0000","last_change":"2023-08-17T17:34:23.192604+0000","last_active":"2023-08-17T17:34:23.557254+0000","last_peered":"2023-08-17T17:34:23.557254+0000","last_clean":"2023-08-17T17:34:23.557254+0000","last_became_active":"2023-08-17T17:34:23.192411+0000","last_became_peered":"2023-08-17T17:34:23.192411+0000","last_unstale":"2023-08-17T17:34:23.557254+0000","last_undegraded":"2023-08-17T17:34:23.557254+0000","last_fullsized":"2023-08-17T17:34:23.557254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554087+0000","last_change":"2023-08-17T17:34:23.548701+0000","last_active":"2023-08-17T17:34:23.554087+0000","last_peered":"2023-08-17T17:34:23.554087+0000","last_clean":"2023-08-17T17:34:23.554087+0000","last_became_active":"2023-08-17T17:34:23.548165+0000","last_became_peered":"2023-08-17T17:34:23.548165+0000","last_unstale":"2023-08-17T17:34:23.554087+0000","last_undegraded":"2023-08-17T17:34:23.554087+0000","last_fullsized":"2023-08-17T17:34:23.554087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557058+0000","last_change":"2023-08-17T17:34:23.193961+0000","last_active":"2023-08-17T17:34:23.557058+0000","last_peered":"2023-08-17T17:34:23.557058+0000","last_clean":"2023-08-17T17:34:23.557058+0000","last_became_active":"2023-08-17T17:34:23.193712+0000","last_became_peered":"2023-08-17T17:34:23.193712+0000","last_unstale":"2023-08-17T17:34:23.557058+0000","last_undegraded":"2023-08-17T17:34:23.557058+0000","last_fullsized":"2023-08-17T17:34:23.557058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.562714+0000","last_change":"2023-08-17T17:34:23.559424+0000","last_active":"2023-08-17T17:34:23.562714+0000","last_peered":"2023-08-17T17:34:23.562714+0000","last_clean":"2023-08-17T17:34:23.562714+0000","last_became_active":"2023-08-17T17:34:23.559157+0000","last_became_peered":"2023-08-17T17:34:23.559157+0000","last_unstale":"2023-08-17T17:34:23.562714+0000","last_undegraded":"2023-08-17T17:34:23.562714+0000","last_fullsized":"2023-08-17T17:34:23.562714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541905+0000","last_change":"2023-08-17T17:34:23.198227+0000","last_active":"2023-08-17T17:34:23.541905+0000","last_peered":"2023-08-17T17:34:23.541905+0000","last_clean":"2023-08-17T17:34:23.541905+0000","last_became_active":"2023-08-17T17:34:23.197944+0000","last_became_peered":"2023-08-17T17:34:23.197944+0000","last_unstale":"2023-08-17T17:34:23.541905+0000","last_undegraded":"2023-08-17T17:34:23.541905+0000","last_fullsized":"2023-08-17T17:34:23.541905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552923+0000","last_change":"2023-08-17T17:34:23.547115+0000","last_active":"2023-08-17T17:34:23.552923+0000","last_peered":"2023-08-17T17:34:23.552923+0000","last_clean":"2023-08-17T17:34:23.552923+0000","last_became_active":"2023-08-17T17:34:23.546829+0000","last_became_peered":"2023-08-17T17:34:23.546829+0000","last_unstale":"2023-08-17T17:34:23.552923+0000","last_undegraded":"2023-08-17T17:34:23.552923+0000","last_fullsized":"2023-08-17T17:34:23.552923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537300+0000","last_change":"2023-08-17T17:34:23.187589+0000","last_active":"2023-08-17T17:34:23.537300+0000","last_peered":"2023-08-17T17:34:23.537300+0000","last_clean":"2023-08-17T17:34:23.537300+0000","last_became_active":"2023-08-17T17:34:23.187290+0000","last_became_peered":"2023-08-17T17:34:23.187290+0000","last_unstale":"2023-08-17T17:34:23.537300+0000","last_undegraded":"2023-08-17T17:34:23.537300+0000","last_fullsized":"2023-08-17T17:34:23.537300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556397+0000","last_change":"2023-08-17T17:34:23.554129+0000","last_active":"2023-08-17T17:34:23.556397+0000","last_peered":"2023-08-17T17:34:23.556397+0000","last_clean":"2023-08-17T17:34:23.556397+0000","last_became_active":"2023-08-17T17:34:23.553850+0000","last_became_peered":"2023-08-17T17:34:23.553850+0000","last_unstale":"2023-08-17T17:34:23.556397+0000","last_undegraded":"2023-08-17T17:34:23.556397+0000","last_fullsized":"2023-08-17T17:34:23.556397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561125+0000","last_change":"2023-08-17T17:34:23.186710+0000","last_active":"2023-08-17T17:34:23.561125+0000","last_peered":"2023-08-17T17:34:23.561125+0000","last_clean":"2023-08-17T17:34:23.561125+0000","last_became_active":"2023-08-17T17:34:23.186445+0000","last_became_peered":"2023-08-17T17:34:23.186445+0000","last_unstale":"2023-08-17T17:34:23.561125+0000","last_undegraded":"2023-08-17T17:34:23.561125+0000","last_fullsized":"2023-08-17T17:34:23.561125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556303+0000","last_change":"2023-08-17T17:34:23.550750+0000","last_active":"2023-08-17T17:34:23.556303+0000","last_peered":"2023-08-17T17:34:23.556303+0000","last_clean":"2023-08-17T17:34:23.556303+0000","last_became_active":"2023-08-17T17:34:23.550414+0000","last_became_peered":"2023-08-17T17:34:23.550414+0000","last_unstale":"2023-08-17T17:34:23.556303+0000","last_undegraded":"2023-08-17T17:34:23.556303+0000","last_fullsized":"2023-08-17T17:34:23.556303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543904+0000","last_change":"2023-08-17T17:34:23.191770+0000","last_active":"2023-08-17T17:34:23.543904+0000","last_peered":"2023-08-17T17:34:23.543904+0000","last_clean":"2023-08-17T17:34:23.543904+0000","last_became_active":"2023-08-17T17:34:23.191496+0000","last_became_peered":"2023-08-17T17:34:23.191496+0000","last_unstale":"2023-08-17T17:34:23.543904+0000","last_undegraded":"2023-08-17T17:34:23.543904+0000","last_fullsized":"2023-08-17T17:34:23.543904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556458+0000","last_change":"2023-08-17T17:34:23.555082+0000","last_active":"2023-08-17T17:34:23.556458+0000","last_peered":"2023-08-17T17:34:23.556458+0000","last_clean":"2023-08-17T17:34:23.556458+0000","last_became_active":"2023-08-17T17:34:23.554787+0000","last_became_peered":"2023-08-17T17:34:23.554787+0000","last_unstale":"2023-08-17T17:34:23.556458+0000","last_undegraded":"2023-08-17T17:34:23.556458+0000","last_fullsized":"2023-08-17T17:34:23.556458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.539343+0000","last_change":"2023-08-17T17:34:23.186144+0000","last_active":"2023-08-17T17:34:23.539343+0000","last_peered":"2023-08-17T17:34:23.539343+0000","last_clean":"2023-08-17T17:34:23.539343+0000","last_became_active":"2023-08-17T17:34:23.185783+0000","last_became_peered":"2023-08-17T17:34:23.185783+0000","last_unstale":"2023-08-17T17:34:23.539343+0000","last_undegraded":"2023-08-17T17:34:23.539343+0000","last_fullsized":"2023-08-17T17:34:23.539343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558748+0000","last_change":"2023-08-17T17:34:23.556916+0000","last_active":"2023-08-17T17:34:23.558748+0000","last_peered":"2023-08-17T17:34:23.558748+0000","last_clean":"2023-08-17T17:34:23.558748+0000","last_became_active":"2023-08-17T17:34:23.556648+0000","last_became_peered":"2023-08-17T17:34:23.556648+0000","last_unstale":"2023-08-17T17:34:23.558748+0000","last_undegraded":"2023-08-17T17:34:23.558748+0000","last_fullsized":"2023-08-17T17:34:23.558748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553011+0000","last_change":"2023-08-17T17:34:23.186198+0000","last_active":"2023-08-17T17:34:23.553011+0000","last_peered":"2023-08-17T17:34:23.553011+0000","last_clean":"2023-08-17T17:34:23.553011+0000","last_became_active":"2023-08-17T17:34:23.185926+0000","last_became_peered":"2023-08-17T17:34:23.185926+0000","last_unstale":"2023-08-17T17:34:23.553011+0000","last_undegraded":"2023-08-17T17:34:23.553011+0000","last_fullsized":"2023-08-17T17:34:23.553011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533588+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:34:23.533588+0000","last_peered":"2023-08-17T17:34:23.533588+0000","last_clean":"2023-08-17T17:34:23.533588+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:34:23.533588+0000","last_undegraded":"2023-08-17T17:34:23.533588+0000","last_fullsized":"2023-08-17T17:34:23.533588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537500+0000","last_change":"2023-08-17T17:34:23.184771+0000","last_active":"2023-08-17T17:34:23.537500+0000","last_peered":"2023-08-17T17:34:23.537500+0000","last_clean":"2023-08-17T17:34:23.537500+0000","last_became_active":"2023-08-17T17:34:23.184315+0000","last_became_peered":"2023-08-17T17:34:23.184315+0000","last_unstale":"2023-08-17T17:34:23.537500+0000","last_undegraded":"2023-08-17T17:34:23.537500+0000","last_fullsized":"2023-08-17T17:34:23.537500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552062+0000","last_change":"2023-08-17T17:34:23.542863+0000","last_active":"2023-08-17T17:34:23.552062+0000","last_peered":"2023-08-17T17:34:23.552062+0000","last_clean":"2023-08-17T17:34:23.552062+0000","last_became_active":"2023-08-17T17:34:23.542602+0000","last_became_peered":"2023-08-17T17:34:23.542602+0000","last_unstale":"2023-08-17T17:34:23.552062+0000","last_undegraded":"2023-08-17T17:34:23.552062+0000","last_fullsized":"2023-08-17T17:34:23.552062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536939+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:34:23.536939+0000","last_peered":"2023-08-17T17:34:23.536939+0000","last_clean":"2023-08-17T17:34:23.536939+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:34:23.536939+0000","last_undegraded":"2023-08-17T17:34:23.536939+0000","last_fullsized":"2023-08-17T17:34:23.536939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.545603+0000","last_change":"2023-08-17T17:34:23.187110+0000","last_active":"2023-08-17T17:34:23.545603+0000","last_peered":"2023-08-17T17:34:23.545603+0000","last_clean":"2023-08-17T17:34:23.545603+0000","last_became_active":"2023-08-17T17:34:23.186796+0000","last_became_peered":"2023-08-17T17:34:23.186796+0000","last_unstale":"2023-08-17T17:34:23.545603+0000","last_undegraded":"2023-08-17T17:34:23.545603+0000","last_fullsized":"2023-08-17T17:34:23.545603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552439+0000","last_change":"2023-08-17T17:34:23.542382+0000","last_active":"2023-08-17T17:34:23.552439+0000","last_peered":"2023-08-17T17:34:23.552439+0000","last_clean":"2023-08-17T17:34:23.552439+0000","last_became_active":"2023-08-17T17:34:23.542108+0000","last_became_peered":"2023-08-17T17:34:23.542108+0000","last_unstale":"2023-08-17T17:34:23.552439+0000","last_undegraded":"2023-08-17T17:34:23.552439+0000","last_fullsized":"2023-08-17T17:34:23.552439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552089+0000","last_change":"2023-08-17T17:34:23.543037+0000","last_active":"2023-08-17T17:34:23.552089+0000","last_peered":"2023-08-17T17:34:23.552089+0000","last_clean":"2023-08-17T17:34:23.552089+0000","last_became_active":"2023-08-17T17:34:23.542776+0000","last_became_peered":"2023-08-17T17:34:23.542776+0000","last_unstale":"2023-08-17T17:34:23.552089+0000","last_undegraded":"2023-08-17T17:34:23.552089+0000","last_fullsized":"2023-08-17T17:34:23.552089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535248+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:34:23.535248+0000","last_peered":"2023-08-17T17:34:23.535248+0000","last_clean":"2023-08-17T17:34:23.535248+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:34:23.535248+0000","last_undegraded":"2023-08-17T17:34:23.535248+0000","last_fullsized":"2023-08-17T17:34:23.535248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533154+0000","last_change":"2023-08-17T17:34:23.189586+0000","last_active":"2023-08-17T17:34:23.533154+0000","last_peered":"2023-08-17T17:34:23.533154+0000","last_clean":"2023-08-17T17:34:23.533154+0000","last_became_active":"2023-08-17T17:34:23.189430+0000","last_became_peered":"2023-08-17T17:34:23.189430+0000","last_unstale":"2023-08-17T17:34:23.533154+0000","last_undegraded":"2023-08-17T17:34:23.533154+0000","last_fullsized":"2023-08-17T17:34:23.533154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557368+0000","last_change":"2023-08-17T17:34:23.553467+0000","last_active":"2023-08-17T17:34:23.557368+0000","last_peered":"2023-08-17T17:34:23.557368+0000","last_clean":"2023-08-17T17:34:23.557368+0000","last_became_active":"2023-08-17T17:34:23.553182+0000","last_became_peered":"2023-08-17T17:34:23.553182+0000","last_unstale":"2023-08-17T17:34:23.557368+0000","last_undegraded":"2023-08-17T17:34:23.557368+0000","last_fullsized":"2023-08-17T17:34:23.557368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537185+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:34:23.537185+0000","last_peered":"2023-08-17T17:34:23.537185+0000","last_clean":"2023-08-17T17:34:23.537185+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:34:23.537185+0000","last_undegraded":"2023-08-17T17:34:23.537185+0000","last_fullsized":"2023-08-17T17:34:23.537185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.540641+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:34:23.540641+0000","last_peered":"2023-08-17T17:34:23.540641+0000","last_clean":"2023-08-17T17:34:23.540641+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:34:23.540641+0000","last_undegraded":"2023-08-17T17:34:23.540641+0000","last_fullsized":"2023-08-17T17:34:23.540641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551649+0000","last_change":"2023-08-17T17:34:23.182606+0000","last_active":"2023-08-17T17:34:23.551649+0000","last_peered":"2023-08-17T17:34:23.551649+0000","last_clean":"2023-08-17T17:34:23.551649+0000","last_became_active":"2023-08-17T17:34:23.182335+0000","last_became_peered":"2023-08-17T17:34:23.182335+0000","last_unstale":"2023-08-17T17:34:23.551649+0000","last_undegraded":"2023-08-17T17:34:23.551649+0000","last_fullsized":"2023-08-17T17:34:23.551649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553244+0000","last_change":"2023-08-17T17:34:23.547812+0000","last_active":"2023-08-17T17:34:23.553244+0000","last_peered":"2023-08-17T17:34:23.553244+0000","last_clean":"2023-08-17T17:34:23.553244+0000","last_became_active":"2023-08-17T17:34:23.547532+0000","last_became_peered":"2023-08-17T17:34:23.547532+0000","last_unstale":"2023-08-17T17:34:23.553244+0000","last_undegraded":"2023-08-17T17:34:23.553244+0000","last_fullsized":"2023-08-17T17:34:23.553244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541070+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:34:23.541070+0000","last_peered":"2023-08-17T17:34:23.541070+0000","last_clean":"2023-08-17T17:34:23.541070+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:34:23.541070+0000","last_undegraded":"2023-08-17T17:34:23.541070+0000","last_fullsized":"2023-08-17T17:34:23.541070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536221+0000","last_change":"2023-08-17T17:34:23.187849+0000","last_active":"2023-08-17T17:34:23.536221+0000","last_peered":"2023-08-17T17:34:23.536221+0000","last_clean":"2023-08-17T17:34:23.536221+0000","last_became_active":"2023-08-17T17:34:23.187578+0000","last_became_peered":"2023-08-17T17:34:23.187578+0000","last_unstale":"2023-08-17T17:34:23.536221+0000","last_undegraded":"2023-08-17T17:34:23.536221+0000","last_fullsized":"2023-08-17T17:34:23.536221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541946+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:34:23.541946+0000","last_peered":"2023-08-17T17:34:23.541946+0000","last_clean":"2023-08-17T17:34:23.541946+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:34:23.541946+0000","last_undegraded":"2023-08-17T17:34:23.541946+0000","last_fullsized":"2023-08-17T17:34:23.541946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533816+0000","last_change":"2023-08-17T17:34:23.191992+0000","last_active":"2023-08-17T17:34:23.533816+0000","last_peered":"2023-08-17T17:34:23.533816+0000","last_clean":"2023-08-17T17:34:23.533816+0000","last_became_active":"2023-08-17T17:34:23.191711+0000","last_became_peered":"2023-08-17T17:34:23.191711+0000","last_unstale":"2023-08-17T17:34:23.533816+0000","last_undegraded":"2023-08-17T17:34:23.533816+0000","last_fullsized":"2023-08-17T17:34:23.533816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550945+0000","last_change":"2023-08-17T17:34:23.541695+0000","last_active":"2023-08-17T17:34:23.550945+0000","last_peered":"2023-08-17T17:34:23.550945+0000","last_clean":"2023-08-17T17:34:23.550945+0000","last_became_active":"2023-08-17T17:34:23.541430+0000","last_became_peered":"2023-08-17T17:34:23.541430+0000","last_unstale":"2023-08-17T17:34:23.550945+0000","last_undegraded":"2023-08-17T17:34:23.550945+0000","last_fullsized":"2023-08-17T17:34:23.550945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561299+0000","last_change":"2023-08-17T17:34:23.188530+0000","last_active":"2023-08-17T17:34:23.561299+0000","last_peered":"2023-08-17T17:34:23.561299+0000","last_clean":"2023-08-17T17:34:23.561299+0000","last_became_active":"2023-08-17T17:34:23.188237+0000","last_became_peered":"2023-08-17T17:34:23.188237+0000","last_unstale":"2023-08-17T17:34:23.561299+0000","last_undegraded":"2023-08-17T17:34:23.561299+0000","last_fullsized":"2023-08-17T17:34:23.561299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533756+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:34:23.533756+0000","last_peered":"2023-08-17T17:34:23.533756+0000","last_clean":"2023-08-17T17:34:23.533756+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:34:23.533756+0000","last_undegraded":"2023-08-17T17:34:23.533756+0000","last_fullsized":"2023-08-17T17:34:23.533756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561250+0000","last_change":"2023-08-17T17:34:23.557366+0000","last_active":"2023-08-17T17:34:23.561250+0000","last_peered":"2023-08-17T17:34:23.561250+0000","last_clean":"2023-08-17T17:34:23.561250+0000","last_became_active":"2023-08-17T17:34:23.555195+0000","last_became_peered":"2023-08-17T17:34:23.555195+0000","last_unstale":"2023-08-17T17:34:23.561250+0000","last_undegraded":"2023-08-17T17:34:23.561250+0000","last_fullsized":"2023-08-17T17:34:23.561250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543361+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:34:23.543361+0000","last_peered":"2023-08-17T17:34:23.543361+0000","last_clean":"2023-08-17T17:34:23.543361+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:34:23.543361+0000","last_undegraded":"2023-08-17T17:34:23.543361+0000","last_fullsized":"2023-08-17T17:34:23.543361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537218+0000","last_change":"2023-08-17T17:34:23.191591+0000","last_active":"2023-08-17T17:34:23.537218+0000","last_peered":"2023-08-17T17:34:23.537218+0000","last_clean":"2023-08-17T17:34:23.537218+0000","last_became_active":"2023-08-17T17:34:23.190831+0000","last_became_peered":"2023-08-17T17:34:23.190831+0000","last_unstale":"2023-08-17T17:34:23.537218+0000","last_undegraded":"2023-08-17T17:34:23.537218+0000","last_fullsized":"2023-08-17T17:34:23.537218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551876+0000","last_change":"2023-08-17T17:34:23.542994+0000","last_active":"2023-08-17T17:34:23.551876+0000","last_peered":"2023-08-17T17:34:23.551876+0000","last_clean":"2023-08-17T17:34:23.551876+0000","last_became_active":"2023-08-17T17:34:23.542731+0000","last_became_peered":"2023-08-17T17:34:23.542731+0000","last_unstale":"2023-08-17T17:34:23.551876+0000","last_undegraded":"2023-08-17T17:34:23.551876+0000","last_fullsized":"2023-08-17T17:34:23.551876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550786+0000","last_change":"2023-08-17T17:34:23.547644+0000","last_active":"2023-08-17T17:34:23.550786+0000","last_peered":"2023-08-17T17:34:23.550786+0000","last_clean":"2023-08-17T17:34:23.550786+0000","last_became_active":"2023-08-17T17:34:23.547383+0000","last_became_peered":"2023-08-17T17:34:23.547383+0000","last_unstale":"2023-08-17T17:34:23.550786+0000","last_undegraded":"2023-08-17T17:34:23.550786+0000","last_fullsized":"2023-08-17T17:34:23.550786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537092+0000","last_change":"2023-08-17T17:34:23.190255+0000","last_active":"2023-08-17T17:34:23.537092+0000","last_peered":"2023-08-17T17:34:23.537092+0000","last_clean":"2023-08-17T17:34:23.537092+0000","last_became_active":"2023-08-17T17:34:23.189984+0000","last_became_peered":"2023-08-17T17:34:23.189984+0000","last_unstale":"2023-08-17T17:34:23.537092+0000","last_undegraded":"2023-08-17T17:34:23.537092+0000","last_fullsized":"2023-08-17T17:34:23.537092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555854+0000","last_change":"2023-08-17T17:34:23.552719+0000","last_active":"2023-08-17T17:34:23.555854+0000","last_peered":"2023-08-17T17:34:23.555854+0000","last_clean":"2023-08-17T17:34:23.555854+0000","last_became_active":"2023-08-17T17:34:23.552438+0000","last_became_peered":"2023-08-17T17:34:23.552438+0000","last_unstale":"2023-08-17T17:34:23.555854+0000","last_undegraded":"2023-08-17T17:34:23.555854+0000","last_fullsized":"2023-08-17T17:34:23.555854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537344+0000","last_change":"2023-08-17T17:34:23.190817+0000","last_active":"2023-08-17T17:34:23.537344+0000","last_peered":"2023-08-17T17:34:23.537344+0000","last_clean":"2023-08-17T17:34:23.537344+0000","last_became_active":"2023-08-17T17:34:23.190559+0000","last_became_peered":"2023-08-17T17:34:23.190559+0000","last_unstale":"2023-08-17T17:34:23.537344+0000","last_undegraded":"2023-08-17T17:34:23.537344+0000","last_fullsized":"2023-08-17T17:34:23.537344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556048+0000","last_change":"2023-08-17T17:34:23.553414+0000","last_active":"2023-08-17T17:34:23.556048+0000","last_peered":"2023-08-17T17:34:23.556048+0000","last_clean":"2023-08-17T17:34:23.556048+0000","last_became_active":"2023-08-17T17:34:23.552895+0000","last_became_peered":"2023-08-17T17:34:23.552895+0000","last_unstale":"2023-08-17T17:34:23.556048+0000","last_undegraded":"2023-08-17T17:34:23.556048+0000","last_fullsized":"2023-08-17T17:34:23.556048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553204+0000","last_change":"2023-08-17T17:34:23.190779+0000","last_active":"2023-08-17T17:34:23.553204+0000","last_peered":"2023-08-17T17:34:23.553204+0000","last_clean":"2023-08-17T17:34:23.553204+0000","last_became_active":"2023-08-17T17:34:23.190512+0000","last_became_peered":"2023-08-17T17:34:23.190512+0000","last_unstale":"2023-08-17T17:34:23.553204+0000","last_undegraded":"2023-08-17T17:34:23.553204+0000","last_fullsized":"2023-08-17T17:34:23.553204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551327+0000","last_change":"2023-08-17T17:34:23.549278+0000","last_active":"2023-08-17T17:34:23.551327+0000","last_peered":"2023-08-17T17:34:23.551327+0000","last_clean":"2023-08-17T17:34:23.551327+0000","last_became_active":"2023-08-17T17:34:23.548986+0000","last_became_peered":"2023-08-17T17:34:23.548986+0000","last_unstale":"2023-08-17T17:34:23.551327+0000","last_undegraded":"2023-08-17T17:34:23.551327+0000","last_fullsized":"2023-08-17T17:34:23.551327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.559755+0000","last_change":"2023-08-17T17:34:23.186530+0000","last_active":"2023-08-17T17:34:23.559755+0000","last_peered":"2023-08-17T17:34:23.559755+0000","last_clean":"2023-08-17T17:34:23.559755+0000","last_became_active":"2023-08-17T17:34:23.186269+0000","last_became_peered":"2023-08-17T17:34:23.186269+0000","last_unstale":"2023-08-17T17:34:23.559755+0000","last_undegraded":"2023-08-17T17:34:23.559755+0000","last_fullsized":"2023-08-17T17:34:23.559755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554062+0000","last_change":"2023-08-17T17:34:23.549760+0000","last_active":"2023-08-17T17:34:23.554062+0000","last_peered":"2023-08-17T17:34:23.554062+0000","last_clean":"2023-08-17T17:34:23.554062+0000","last_became_active":"2023-08-17T17:34:23.549485+0000","last_became_peered":"2023-08-17T17:34:23.549485+0000","last_unstale":"2023-08-17T17:34:23.554062+0000","last_undegraded":"2023-08-17T17:34:23.554062+0000","last_fullsized":"2023-08-17T17:34:23.554062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547751+0000","last_change":"2023-08-17T17:34:23.185767+0000","last_active":"2023-08-17T17:34:23.547751+0000","last_peered":"2023-08-17T17:34:23.547751+0000","last_clean":"2023-08-17T17:34:23.547751+0000","last_became_active":"2023-08-17T17:34:23.185523+0000","last_became_peered":"2023-08-17T17:34:23.185523+0000","last_unstale":"2023-08-17T17:34:23.547751+0000","last_undegraded":"2023-08-17T17:34:23.547751+0000","last_fullsized":"2023-08-17T17:34:23.547751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552869+0000","last_change":"2023-08-17T17:34:23.550201+0000","last_active":"2023-08-17T17:34:23.552869+0000","last_peered":"2023-08-17T17:34:23.552869+0000","last_clean":"2023-08-17T17:34:23.552869+0000","last_became_active":"2023-08-17T17:34:23.550017+0000","last_became_peered":"2023-08-17T17:34:23.550017+0000","last_unstale":"2023-08-17T17:34:23.552869+0000","last_undegraded":"2023-08-17T17:34:23.552869+0000","last_fullsized":"2023-08-17T17:34:23.552869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.544892+0000","last_change":"2023-08-17T17:34:23.184375+0000","last_active":"2023-08-17T17:34:23.544892+0000","last_peered":"2023-08-17T17:34:23.544892+0000","last_clean":"2023-08-17T17:34:23.544892+0000","last_became_active":"2023-08-17T17:34:23.184095+0000","last_became_peered":"2023-08-17T17:34:23.184095+0000","last_unstale":"2023-08-17T17:34:23.544892+0000","last_undegraded":"2023-08-17T17:34:23.544892+0000","last_fullsized":"2023-08-17T17:34:23.544892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557463+0000","last_change":"2023-08-17T17:34:23.544840+0000","last_active":"2023-08-17T17:34:23.557463+0000","last_peered":"2023-08-17T17:34:23.557463+0000","last_clean":"2023-08-17T17:34:23.557463+0000","last_became_active":"2023-08-17T17:34:23.544381+0000","last_became_peered":"2023-08-17T17:34:23.544381+0000","last_unstale":"2023-08-17T17:34:23.557463+0000","last_undegraded":"2023-08-17T17:34:23.557463+0000","last_fullsized":"2023-08-17T17:34:23.557463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535353+0000","last_change":"2023-08-17T17:34:23.181210+0000","last_active":"2023-08-17T17:34:23.535353+0000","last_peered":"2023-08-17T17:34:23.535353+0000","last_clean":"2023-08-17T17:34:23.535353+0000","last_became_active":"2023-08-17T17:34:23.180969+0000","last_became_peered":"2023-08-17T17:34:23.180969+0000","last_unstale":"2023-08-17T17:34:23.535353+0000","last_undegraded":"2023-08-17T17:34:23.535353+0000","last_fullsized":"2023-08-17T17:34:23.535353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550540+0000","last_change":"2023-08-17T17:34:23.548247+0000","last_active":"2023-08-17T17:34:23.550540+0000","last_peered":"2023-08-17T17:34:23.550540+0000","last_clean":"2023-08-17T17:34:23.550540+0000","last_became_active":"2023-08-17T17:34:23.547379+0000","last_became_peered":"2023-08-17T17:34:23.547379+0000","last_unstale":"2023-08-17T17:34:23.550540+0000","last_undegraded":"2023-08-17T17:34:23.550540+0000","last_fullsized":"2023-08-17T17:34:23.550540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536842+0000","last_change":"2023-08-17T17:34:23.185419+0000","last_active":"2023-08-17T17:34:23.536842+0000","last_peered":"2023-08-17T17:34:23.536842+0000","last_clean":"2023-08-17T17:34:23.536842+0000","last_became_active":"2023-08-17T17:34:23.184865+0000","last_became_peered":"2023-08-17T17:34:23.184865+0000","last_unstale":"2023-08-17T17:34:23.536842+0000","last_undegraded":"2023-08-17T17:34:23.536842+0000","last_fullsized":"2023-08-17T17:34:23.536842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553350+0000","last_change":"2023-08-17T17:34:23.544643+0000","last_active":"2023-08-17T17:34:23.553350+0000","last_peered":"2023-08-17T17:34:23.553350+0000","last_clean":"2023-08-17T17:34:23.553350+0000","last_became_active":"2023-08-17T17:34:23.544406+0000","last_became_peered":"2023-08-17T17:34:23.544406+0000","last_unstale":"2023-08-17T17:34:23.553350+0000","last_undegraded":"2023-08-17T17:34:23.553350+0000","last_fullsized":"2023-08-17T17:34:23.553350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536734+0000","last_change":"2023-08-17T17:34:23.186776+0000","last_active":"2023-08-17T17:34:23.536734+0000","last_peered":"2023-08-17T17:34:23.536734+0000","last_clean":"2023-08-17T17:34:23.536734+0000","last_became_active":"2023-08-17T17:34:23.186521+0000","last_became_peered":"2023-08-17T17:34:23.186521+0000","last_unstale":"2023-08-17T17:34:23.536734+0000","last_undegraded":"2023-08-17T17:34:23.536734+0000","last_fullsized":"2023-08-17T17:34:23.536734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561721+0000","last_change":"2023-08-17T17:34:23.560630+0000","last_active":"2023-08-17T17:34:23.561721+0000","last_peered":"2023-08-17T17:34:23.561721+0000","last_clean":"2023-08-17T17:34:23.561721+0000","last_became_active":"2023-08-17T17:34:23.560282+0000","last_became_peered":"2023-08-17T17:34:23.560282+0000","last_unstale":"2023-08-17T17:34:23.561721+0000","last_undegraded":"2023-08-17T17:34:23.561721+0000","last_fullsized":"2023-08-17T17:34:23.561721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552036+0000","last_change":"2023-08-17T17:34:23.191397+0000","last_active":"2023-08-17T17:34:23.552036+0000","last_peered":"2023-08-17T17:34:23.552036+0000","last_clean":"2023-08-17T17:34:23.552036+0000","last_became_active":"2023-08-17T17:34:23.191058+0000","last_became_peered":"2023-08-17T17:34:23.191058+0000","last_unstale":"2023-08-17T17:34:23.552036+0000","last_undegraded":"2023-08-17T17:34:23.552036+0000","last_fullsized":"2023-08-17T17:34:23.552036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556066+0000","last_change":"2023-08-17T17:34:23.553590+0000","last_active":"2023-08-17T17:34:23.556066+0000","last_peered":"2023-08-17T17:34:23.556066+0000","last_clean":"2023-08-17T17:34:23.556066+0000","last_became_active":"2023-08-17T17:34:23.552092+0000","last_became_peered":"2023-08-17T17:34:23.552092+0000","last_unstale":"2023-08-17T17:34:23.556066+0000","last_undegraded":"2023-08-17T17:34:23.556066+0000","last_fullsized":"2023-08-17T17:34:23.556066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533621+0000","last_change":"2023-08-17T17:34:23.191260+0000","last_active":"2023-08-17T17:34:23.533621+0000","last_peered":"2023-08-17T17:34:23.533621+0000","last_clean":"2023-08-17T17:34:23.533621+0000","last_became_active":"2023-08-17T17:34:23.190994+0000","last_became_peered":"2023-08-17T17:34:23.190994+0000","last_unstale":"2023-08-17T17:34:23.533621+0000","last_undegraded":"2023-08-17T17:34:23.533621+0000","last_fullsized":"2023-08-17T17:34:23.533621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561214+0000","last_change":"2023-08-17T17:34:23.556967+0000","last_active":"2023-08-17T17:34:23.561214+0000","last_peered":"2023-08-17T17:34:23.561214+0000","last_clean":"2023-08-17T17:34:23.561214+0000","last_became_active":"2023-08-17T17:34:23.556712+0000","last_became_peered":"2023-08-17T17:34:23.556712+0000","last_unstale":"2023-08-17T17:34:23.561214+0000","last_undegraded":"2023-08-17T17:34:23.561214+0000","last_fullsized":"2023-08-17T17:34:23.561214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-17T17:34:26.318699+0000","last_change":"2023-08-17T17:34:23.189238+0000","last_active":"2023-08-17T17:34:26.318699+0000","last_peered":"2023-08-17T17:34:26.318699+0000","last_clean":"2023-08-17T17:34:26.318699+0000","last_became_active":"2023-08-17T17:34:23.188964+0000","last_became_peered":"2023-08-17T17:34:23.188964+0000","last_unstale":"2023-08-17T17:34:26.318699+0000","last_undegraded":"2023-08-17T17:34:26.318699+0000","last_fullsized":"2023-08-17T17:34:26.318699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556723+0000","last_change":"2023-08-17T17:34:23.549243+0000","last_active":"2023-08-17T17:34:23.556723+0000","last_peered":"2023-08-17T17:34:23.556723+0000","last_clean":"2023-08-17T17:34:23.556723+0000","last_became_active":"2023-08-17T17:34:23.548966+0000","last_became_peered":"2023-08-17T17:34:23.548966+0000","last_unstale":"2023-08-17T17:34:23.556723+0000","last_undegraded":"2023-08-17T17:34:23.556723+0000","last_fullsized":"2023-08-17T17:34:23.556723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553705+0000","last_change":"2023-08-17T17:34:23.189039+0000","last_active":"2023-08-17T17:34:23.553705+0000","last_peered":"2023-08-17T17:34:23.553705+0000","last_clean":"2023-08-17T17:34:23.553705+0000","last_became_active":"2023-08-17T17:34:23.188785+0000","last_became_peered":"2023-08-17T17:34:23.188785+0000","last_unstale":"2023-08-17T17:34:23.553705+0000","last_undegraded":"2023-08-17T17:34:23.553705+0000","last_fullsized":"2023-08-17T17:34:23.553705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556711+0000","last_change":"2023-08-17T17:34:23.555845+0000","last_active":"2023-08-17T17:34:23.556711+0000","last_peered":"2023-08-17T17:34:23.556711+0000","last_clean":"2023-08-17T17:34:23.556711+0000","last_became_active":"2023-08-17T17:34:23.555604+0000","last_became_peered":"2023-08-17T17:34:23.555604+0000","last_unstale":"2023-08-17T17:34:23.556711+0000","last_undegraded":"2023-08-17T17:34:23.556711+0000","last_fullsized":"2023-08-17T17:34:23.556711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538052+0000","last_change":"2023-08-17T17:34:23.187717+0000","last_active":"2023-08-17T17:34:23.538052+0000","last_peered":"2023-08-17T17:34:23.538052+0000","last_clean":"2023-08-17T17:34:23.538052+0000","last_became_active":"2023-08-17T17:34:23.184648+0000","last_became_peered":"2023-08-17T17:34:23.184648+0000","last_unstale":"2023-08-17T17:34:23.538052+0000","last_undegraded":"2023-08-17T17:34:23.538052+0000","last_fullsized":"2023-08-17T17:34:23.538052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555978+0000","last_change":"2023-08-17T17:34:23.552413+0000","last_active":"2023-08-17T17:34:23.555978+0000","last_peered":"2023-08-17T17:34:23.555978+0000","last_clean":"2023-08-17T17:34:23.555978+0000","last_became_active":"2023-08-17T17:34:23.552087+0000","last_became_peered":"2023-08-17T17:34:23.552087+0000","last_unstale":"2023-08-17T17:34:23.555978+0000","last_undegraded":"2023-08-17T17:34:23.555978+0000","last_fullsized":"2023-08-17T17:34:23.555978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554478+0000","last_change":"2023-08-17T17:34:23.189135+0000","last_active":"2023-08-17T17:34:23.554478+0000","last_peered":"2023-08-17T17:34:23.554478+0000","last_clean":"2023-08-17T17:34:23.554478+0000","last_became_active":"2023-08-17T17:34:23.188880+0000","last_became_peered":"2023-08-17T17:34:23.188880+0000","last_unstale":"2023-08-17T17:34:23.554478+0000","last_undegraded":"2023-08-17T17:34:23.554478+0000","last_fullsized":"2023-08-17T17:34:23.554478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551405+0000","last_change":"2023-08-17T17:34:23.549370+0000","last_active":"2023-08-17T17:34:23.551405+0000","last_peered":"2023-08-17T17:34:23.551405+0000","last_clean":"2023-08-17T17:34:23.551405+0000","last_became_active":"2023-08-17T17:34:23.549106+0000","last_became_peered":"2023-08-17T17:34:23.549106+0000","last_unstale":"2023-08-17T17:34:23.551405+0000","last_undegraded":"2023-08-17T17:34:23.551405+0000","last_fullsized":"2023-08-17T17:34:23.551405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537049+0000","last_change":"2023-08-17T17:34:23.188935+0000","last_active":"2023-08-17T17:34:23.537049+0000","last_peered":"2023-08-17T17:34:23.537049+0000","last_clean":"2023-08-17T17:34:23.537049+0000","last_became_active":"2023-08-17T17:34:23.188377+0000","last_became_peered":"2023-08-17T17:34:23.188377+0000","last_unstale":"2023-08-17T17:34:23.537049+0000","last_undegraded":"2023-08-17T17:34:23.537049+0000","last_fullsized":"2023-08-17T17:34:23.537049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556432+0000","last_change":"2023-08-17T17:34:23.555082+0000","last_active":"2023-08-17T17:34:23.556432+0000","last_peered":"2023-08-17T17:34:23.556432+0000","last_clean":"2023-08-17T17:34:23.556432+0000","last_became_active":"2023-08-17T17:34:23.554814+0000","last_became_peered":"2023-08-17T17:34:23.554814+0000","last_unstale":"2023-08-17T17:34:23.556432+0000","last_undegraded":"2023-08-17T17:34:23.556432+0000","last_fullsized":"2023-08-17T17:34:23.556432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552365+0000","last_change":"2023-08-17T17:34:23.190120+0000","last_active":"2023-08-17T17:34:23.552365+0000","last_peered":"2023-08-17T17:34:23.552365+0000","last_clean":"2023-08-17T17:34:23.552365+0000","last_became_active":"2023-08-17T17:34:23.189569+0000","last_became_peered":"2023-08-17T17:34:23.189569+0000","last_unstale":"2023-08-17T17:34:23.552365+0000","last_undegraded":"2023-08-17T17:34:23.552365+0000","last_fullsized":"2023-08-17T17:34:23.552365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.565228+0000","last_change":"2023-08-17T17:34:23.561106+0000","last_active":"2023-08-17T17:34:23.565228+0000","last_peered":"2023-08-17T17:34:23.565228+0000","last_clean":"2023-08-17T17:34:23.565228+0000","last_became_active":"2023-08-17T17:34:23.560898+0000","last_became_peered":"2023-08-17T17:34:23.560898+0000","last_unstale":"2023-08-17T17:34:23.565228+0000","last_undegraded":"2023-08-17T17:34:23.565228+0000","last_fullsized":"2023-08-17T17:34:23.565228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543062+0000","last_change":"2023-08-17T17:34:23.198065+0000","last_active":"2023-08-17T17:34:23.543062+0000","last_peered":"2023-08-17T17:34:23.543062+0000","last_clean":"2023-08-17T17:34:23.543062+0000","last_became_active":"2023-08-17T17:34:23.197731+0000","last_became_peered":"2023-08-17T17:34:23.197731+0000","last_unstale":"2023-08-17T17:34:23.543062+0000","last_undegraded":"2023-08-17T17:34:23.543062+0000","last_fullsized":"2023-08-17T17:34:23.543062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553514+0000","last_change":"2023-08-17T17:34:23.547875+0000","last_active":"2023-08-17T17:34:23.553514+0000","last_peered":"2023-08-17T17:34:23.553514+0000","last_clean":"2023-08-17T17:34:23.553514+0000","last_became_active":"2023-08-17T17:34:23.547593+0000","last_became_peered":"2023-08-17T17:34:23.547593+0000","last_unstale":"2023-08-17T17:34:23.553514+0000","last_undegraded":"2023-08-17T17:34:23.553514+0000","last_fullsized":"2023-08-17T17:34:23.553514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557302+0000","last_change":"2023-08-17T17:34:23.190210+0000","last_active":"2023-08-17T17:34:23.557302+0000","last_peered":"2023-08-17T17:34:23.557302+0000","last_clean":"2023-08-17T17:34:23.557302+0000","last_became_active":"2023-08-17T17:34:23.189745+0000","last_became_peered":"2023-08-17T17:34:23.189745+0000","last_unstale":"2023-08-17T17:34:23.557302+0000","last_undegraded":"2023-08-17T17:34:23.557302+0000","last_fullsized":"2023-08-17T17:34:23.557302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561762+0000","last_change":"2023-08-17T17:34:23.555242+0000","last_active":"2023-08-17T17:34:23.561762+0000","last_peered":"2023-08-17T17:34:23.561762+0000","last_clean":"2023-08-17T17:34:23.561762+0000","last_became_active":"2023-08-17T17:34:23.554975+0000","last_became_peered":"2023-08-17T17:34:23.554975+0000","last_unstale":"2023-08-17T17:34:23.561762+0000","last_undegraded":"2023-08-17T17:34:23.561762+0000","last_fullsized":"2023-08-17T17:34:23.561762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535659+0000","last_change":"2023-08-17T17:34:23.186514+0000","last_active":"2023-08-17T17:34:23.535659+0000","last_peered":"2023-08-17T17:34:23.535659+0000","last_clean":"2023-08-17T17:34:23.535659+0000","last_became_active":"2023-08-17T17:34:23.186237+0000","last_became_peered":"2023-08-17T17:34:23.186237+0000","last_unstale":"2023-08-17T17:34:23.535659+0000","last_undegraded":"2023-08-17T17:34:23.535659+0000","last_fullsized":"2023-08-17T17:34:23.535659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557448+0000","last_change":"2023-08-17T17:34:23.556160+0000","last_active":"2023-08-17T17:34:23.557448+0000","last_peered":"2023-08-17T17:34:23.557448+0000","last_clean":"2023-08-17T17:34:23.557448+0000","last_became_active":"2023-08-17T17:34:23.555906+0000","last_became_peered":"2023-08-17T17:34:23.555906+0000","last_unstale":"2023-08-17T17:34:23.557448+0000","last_undegraded":"2023-08-17T17:34:23.557448+0000","last_fullsized":"2023-08-17T17:34:23.557448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537668+0000","last_change":"2023-08-17T17:34:23.188736+0000","last_active":"2023-08-17T17:34:23.537668+0000","last_peered":"2023-08-17T17:34:23.537668+0000","last_clean":"2023-08-17T17:34:23.537668+0000","last_became_active":"2023-08-17T17:34:23.188463+0000","last_became_peered":"2023-08-17T17:34:23.188463+0000","last_unstale":"2023-08-17T17:34:23.537668+0000","last_undegraded":"2023-08-17T17:34:23.537668+0000","last_fullsized":"2023-08-17T17:34:23.537668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556730+0000","last_change":"2023-08-17T17:34:23.556037+0000","last_active":"2023-08-17T17:34:23.556730+0000","last_peered":"2023-08-17T17:34:23.556730+0000","last_clean":"2023-08-17T17:34:23.556730+0000","last_became_active":"2023-08-17T17:34:23.555773+0000","last_became_peered":"2023-08-17T17:34:23.555773+0000","last_unstale":"2023-08-17T17:34:23.556730+0000","last_undegraded":"2023-08-17T17:34:23.556730+0000","last_fullsized":"2023-08-17T17:34:23.556730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555701+0000","last_change":"2023-08-17T17:34:23.182339+0000","last_active":"2023-08-17T17:34:23.555701+0000","last_peered":"2023-08-17T17:34:23.555701+0000","last_clean":"2023-08-17T17:34:23.555701+0000","last_became_active":"2023-08-17T17:34:23.182072+0000","last_became_peered":"2023-08-17T17:34:23.182072+0000","last_unstale":"2023-08-17T17:34:23.555701+0000","last_undegraded":"2023-08-17T17:34:23.555701+0000","last_fullsized":"2023-08-17T17:34:23.555701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547106+0000","last_change":"2023-08-17T17:34:23.540248+0000","last_active":"2023-08-17T17:34:23.547106+0000","last_peered":"2023-08-17T17:34:23.547106+0000","last_clean":"2023-08-17T17:34:23.547106+0000","last_became_active":"2023-08-17T17:34:23.539612+0000","last_became_peered":"2023-08-17T17:34:23.539612+0000","last_unstale":"2023-08-17T17:34:23.547106+0000","last_undegraded":"2023-08-17T17:34:23.547106+0000","last_fullsized":"2023-08-17T17:34:23.547106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533235+0000","last_change":"2023-08-17T17:34:23.191957+0000","last_active":"2023-08-17T17:34:23.533235+0000","last_peered":"2023-08-17T17:34:23.533235+0000","last_clean":"2023-08-17T17:34:23.533235+0000","last_became_active":"2023-08-17T17:34:23.191666+0000","last_became_peered":"2023-08-17T17:34:23.191666+0000","last_unstale":"2023-08-17T17:34:23.533235+0000","last_undegraded":"2023-08-17T17:34:23.533235+0000","last_fullsized":"2023-08-17T17:34:23.533235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556313+0000","last_change":"2023-08-17T17:34:23.553646+0000","last_active":"2023-08-17T17:34:23.556313+0000","last_peered":"2023-08-17T17:34:23.556313+0000","last_clean":"2023-08-17T17:34:23.556313+0000","last_became_active":"2023-08-17T17:34:23.553378+0000","last_became_peered":"2023-08-17T17:34:23.553378+0000","last_unstale":"2023-08-17T17:34:23.556313+0000","last_undegraded":"2023-08-17T17:34:23.556313+0000","last_fullsized":"2023-08-17T17:34:23.556313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536649+0000","last_change":"2023-08-17T17:34:23.191017+0000","last_active":"2023-08-17T17:34:23.536649+0000","last_peered":"2023-08-17T17:34:23.536649+0000","last_clean":"2023-08-17T17:34:23.536649+0000","last_became_active":"2023-08-17T17:34:23.190761+0000","last_became_peered":"2023-08-17T17:34:23.190761+0000","last_unstale":"2023-08-17T17:34:23.536649+0000","last_undegraded":"2023-08-17T17:34:23.536649+0000","last_fullsized":"2023-08-17T17:34:23.536649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556028+0000","last_change":"2023-08-17T17:34:23.552814+0000","last_active":"2023-08-17T17:34:23.556028+0000","last_peered":"2023-08-17T17:34:23.556028+0000","last_clean":"2023-08-17T17:34:23.556028+0000","last_became_active":"2023-08-17T17:34:23.552549+0000","last_became_peered":"2023-08-17T17:34:23.552549+0000","last_unstale":"2023-08-17T17:34:23.556028+0000","last_undegraded":"2023-08-17T17:34:23.556028+0000","last_fullsized":"2023-08-17T17:34:23.556028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.560981+0000","last_change":"2023-08-17T17:34:23.184359+0000","last_active":"2023-08-17T17:34:23.560981+0000","last_peered":"2023-08-17T17:34:23.560981+0000","last_clean":"2023-08-17T17:34:23.560981+0000","last_became_active":"2023-08-17T17:34:23.183723+0000","last_became_peered":"2023-08-17T17:34:23.183723+0000","last_unstale":"2023-08-17T17:34:23.560981+0000","last_undegraded":"2023-08-17T17:34:23.560981+0000","last_fullsized":"2023-08-17T17:34:23.560981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555985+0000","last_change":"2023-08-17T17:34:23.551730+0000","last_active":"2023-08-17T17:34:23.555985+0000","last_peered":"2023-08-17T17:34:23.555985+0000","last_clean":"2023-08-17T17:34:23.555985+0000","last_became_active":"2023-08-17T17:34:23.551463+0000","last_became_peered":"2023-08-17T17:34:23.551463+0000","last_unstale":"2023-08-17T17:34:23.555985+0000","last_undegraded":"2023-08-17T17:34:23.555985+0000","last_fullsized":"2023-08-17T17:34:23.555985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.562820+0000","last_change":"2023-08-17T17:34:23.189962+0000","last_active":"2023-08-17T17:34:23.562820+0000","last_peered":"2023-08-17T17:34:23.562820+0000","last_clean":"2023-08-17T17:34:23.562820+0000","last_became_active":"2023-08-17T17:34:23.189247+0000","last_became_peered":"2023-08-17T17:34:23.189247+0000","last_unstale":"2023-08-17T17:34:23.562820+0000","last_undegraded":"2023-08-17T17:34:23.562820+0000","last_fullsized":"2023-08-17T17:34:23.562820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547521+0000","last_change":"2023-08-17T17:34:23.542831+0000","last_active":"2023-08-17T17:34:23.547521+0000","last_peered":"2023-08-17T17:34:23.547521+0000","last_clean":"2023-08-17T17:34:23.547521+0000","last_became_active":"2023-08-17T17:34:23.542564+0000","last_became_peered":"2023-08-17T17:34:23.542564+0000","last_unstale":"2023-08-17T17:34:23.547521+0000","last_undegraded":"2023-08-17T17:34:23.547521+0000","last_fullsized":"2023-08-17T17:34:23.547521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543908+0000","last_change":"2023-08-17T17:34:23.193784+0000","last_active":"2023-08-17T17:34:23.543908+0000","last_peered":"2023-08-17T17:34:23.543908+0000","last_clean":"2023-08-17T17:34:23.543908+0000","last_became_active":"2023-08-17T17:34:23.193515+0000","last_became_peered":"2023-08-17T17:34:23.193515+0000","last_unstale":"2023-08-17T17:34:23.543908+0000","last_undegraded":"2023-08-17T17:34:23.543908+0000","last_fullsized":"2023-08-17T17:34:23.543908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.562719+0000","last_change":"2023-08-17T17:34:23.559293+0000","last_active":"2023-08-17T17:34:23.562719+0000","last_peered":"2023-08-17T17:34:23.562719+0000","last_clean":"2023-08-17T17:34:23.562719+0000","last_became_active":"2023-08-17T17:34:23.559072+0000","last_became_peered":"2023-08-17T17:34:23.559072+0000","last_unstale":"2023-08-17T17:34:23.562719+0000","last_undegraded":"2023-08-17T17:34:23.562719+0000","last_fullsized":"2023-08-17T17:34:23.562719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543183+0000","last_change":"2023-08-17T17:34:23.191570+0000","last_active":"2023-08-17T17:34:23.543183+0000","last_peered":"2023-08-17T17:34:23.543183+0000","last_clean":"2023-08-17T17:34:23.543183+0000","last_became_active":"2023-08-17T17:34:23.191127+0000","last_became_peered":"2023-08-17T17:34:23.191127+0000","last_unstale":"2023-08-17T17:34:23.543183+0000","last_undegraded":"2023-08-17T17:34:23.543183+0000","last_fullsized":"2023-08-17T17:34:23.543183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554026+0000","last_change":"2023-08-17T17:34:23.548523+0000","last_active":"2023-08-17T17:34:23.554026+0000","last_peered":"2023-08-17T17:34:23.554026+0000","last_clean":"2023-08-17T17:34:23.554026+0000","last_became_active":"2023-08-17T17:34:23.548180+0000","last_became_peered":"2023-08-17T17:34:23.548180+0000","last_unstale":"2023-08-17T17:34:23.554026+0000","last_undegraded":"2023-08-17T17:34:23.554026+0000","last_fullsized":"2023-08-17T17:34:23.554026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541743+0000","last_change":"2023-08-17T17:34:23.193931+0000","last_active":"2023-08-17T17:34:23.541743+0000","last_peered":"2023-08-17T17:34:23.541743+0000","last_clean":"2023-08-17T17:34:23.541743+0000","last_became_active":"2023-08-17T17:34:23.193104+0000","last_became_peered":"2023-08-17T17:34:23.193104+0000","last_unstale":"2023-08-17T17:34:23.541743+0000","last_undegraded":"2023-08-17T17:34:23.541743+0000","last_fullsized":"2023-08-17T17:34:23.541743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555975+0000","last_change":"2023-08-17T17:34:23.551080+0000","last_active":"2023-08-17T17:34:23.555975+0000","last_peered":"2023-08-17T17:34:23.555975+0000","last_clean":"2023-08-17T17:34:23.555975+0000","last_became_active":"2023-08-17T17:34:23.550830+0000","last_became_peered":"2023-08-17T17:34:23.550830+0000","last_unstale":"2023-08-17T17:34:23.555975+0000","last_undegraded":"2023-08-17T17:34:23.555975+0000","last_fullsized":"2023-08-17T17:34:23.555975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553243+0000","last_change":"2023-08-17T17:34:23.182626+0000","last_active":"2023-08-17T17:34:23.553243+0000","last_peered":"2023-08-17T17:34:23.553243+0000","last_clean":"2023-08-17T17:34:23.553243+0000","last_became_active":"2023-08-17T17:34:23.182368+0000","last_became_peered":"2023-08-17T17:34:23.182368+0000","last_unstale":"2023-08-17T17:34:23.553243+0000","last_undegraded":"2023-08-17T17:34:23.553243+0000","last_fullsized":"2023-08-17T17:34:23.553243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547126+0000","last_change":"2023-08-17T17:34:23.540567+0000","last_active":"2023-08-17T17:34:23.547126+0000","last_peered":"2023-08-17T17:34:23.547126+0000","last_clean":"2023-08-17T17:34:23.547126+0000","last_became_active":"2023-08-17T17:34:23.539925+0000","last_became_peered":"2023-08-17T17:34:23.539925+0000","last_unstale":"2023-08-17T17:34:23.547126+0000","last_undegraded":"2023-08-17T17:34:23.547126+0000","last_fullsized":"2023-08-17T17:34:23.547126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.545585+0000","last_change":"2023-08-17T17:34:23.194479+0000","last_active":"2023-08-17T17:34:23.545585+0000","last_peered":"2023-08-17T17:34:23.545585+0000","last_clean":"2023-08-17T17:34:23.545585+0000","last_became_active":"2023-08-17T17:34:23.194196+0000","last_became_peered":"2023-08-17T17:34:23.194196+0000","last_unstale":"2023-08-17T17:34:23.545585+0000","last_undegraded":"2023-08-17T17:34:23.545585+0000","last_fullsized":"2023-08-17T17:34:23.545585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556322+0000","last_change":"2023-08-17T17:34:23.553805+0000","last_active":"2023-08-17T17:34:23.556322+0000","last_peered":"2023-08-17T17:34:23.556322+0000","last_clean":"2023-08-17T17:34:23.556322+0000","last_became_active":"2023-08-17T17:34:23.553524+0000","last_became_peered":"2023-08-17T17:34:23.553524+0000","last_unstale":"2023-08-17T17:34:23.556322+0000","last_undegraded":"2023-08-17T17:34:23.556322+0000","last_fullsized":"2023-08-17T17:34:23.556322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553107+0000","last_change":"2023-08-17T17:34:23.184707+0000","last_active":"2023-08-17T17:34:23.553107+0000","last_peered":"2023-08-17T17:34:23.553107+0000","last_clean":"2023-08-17T17:34:23.553107+0000","last_became_active":"2023-08-17T17:34:23.184244+0000","last_became_peered":"2023-08-17T17:34:23.184244+0000","last_unstale":"2023-08-17T17:34:23.553107+0000","last_undegraded":"2023-08-17T17:34:23.553107+0000","last_fullsized":"2023-08-17T17:34:23.553107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.562691+0000","last_change":"2023-08-17T17:34:23.558704+0000","last_active":"2023-08-17T17:34:23.562691+0000","last_peered":"2023-08-17T17:34:23.562691+0000","last_clean":"2023-08-17T17:34:23.562691+0000","last_became_active":"2023-08-17T17:34:23.558374+0000","last_became_peered":"2023-08-17T17:34:23.558374+0000","last_unstale":"2023-08-17T17:34:23.562691+0000","last_undegraded":"2023-08-17T17:34:23.562691+0000","last_fullsized":"2023-08-17T17:34:23.562691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557028+0000","last_change":"2023-08-17T17:34:23.190318+0000","last_active":"2023-08-17T17:34:23.557028+0000","last_peered":"2023-08-17T17:34:23.557028+0000","last_clean":"2023-08-17T17:34:23.557028+0000","last_became_active":"2023-08-17T17:34:23.190011+0000","last_became_peered":"2023-08-17T17:34:23.190011+0000","last_unstale":"2023-08-17T17:34:23.557028+0000","last_undegraded":"2023-08-17T17:34:23.557028+0000","last_fullsized":"2023-08-17T17:34:23.557028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553785+0000","last_change":"2023-08-17T17:34:23.552175+0000","last_active":"2023-08-17T17:34:23.553785+0000","last_peered":"2023-08-17T17:34:23.553785+0000","last_clean":"2023-08-17T17:34:23.553785+0000","last_became_active":"2023-08-17T17:34:23.551927+0000","last_became_peered":"2023-08-17T17:34:23.551927+0000","last_unstale":"2023-08-17T17:34:23.553785+0000","last_undegraded":"2023-08-17T17:34:23.553785+0000","last_fullsized":"2023-08-17T17:34:23.553785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561308+0000","last_change":"2023-08-17T17:34:23.184913+0000","last_active":"2023-08-17T17:34:23.561308+0000","last_peered":"2023-08-17T17:34:23.561308+0000","last_clean":"2023-08-17T17:34:23.561308+0000","last_became_active":"2023-08-17T17:34:23.184622+0000","last_became_peered":"2023-08-17T17:34:23.184622+0000","last_unstale":"2023-08-17T17:34:23.561308+0000","last_undegraded":"2023-08-17T17:34:23.561308+0000","last_fullsized":"2023-08-17T17:34:23.561308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556497+0000","last_change":"2023-08-17T17:34:23.555151+0000","last_active":"2023-08-17T17:34:23.556497+0000","last_peered":"2023-08-17T17:34:23.556497+0000","last_clean":"2023-08-17T17:34:23.556497+0000","last_became_active":"2023-08-17T17:34:23.554868+0000","last_became_peered":"2023-08-17T17:34:23.554868+0000","last_unstale":"2023-08-17T17:34:23.556497+0000","last_undegraded":"2023-08-17T17:34:23.556497+0000","last_fullsized":"2023-08-17T17:34:23.556497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537732+0000","last_change":"2023-08-17T17:34:23.189742+0000","last_active":"2023-08-17T17:34:23.537732+0000","last_peered":"2023-08-17T17:34:23.537732+0000","last_clean":"2023-08-17T17:34:23.537732+0000","last_became_active":"2023-08-17T17:34:23.189466+0000","last_became_peered":"2023-08-17T17:34:23.189466+0000","last_unstale":"2023-08-17T17:34:23.537732+0000","last_undegraded":"2023-08-17T17:34:23.537732+0000","last_fullsized":"2023-08-17T17:34:23.537732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557135+0000","last_change":"2023-08-17T17:34:23.553968+0000","last_active":"2023-08-17T17:34:23.557135+0000","last_peered":"2023-08-17T17:34:23.557135+0000","last_clean":"2023-08-17T17:34:23.557135+0000","last_became_active":"2023-08-17T17:34:23.552409+0000","last_became_peered":"2023-08-17T17:34:23.552409+0000","last_unstale":"2023-08-17T17:34:23.557135+0000","last_undegraded":"2023-08-17T17:34:23.557135+0000","last_fullsized":"2023-08-17T17:34:23.557135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533930+0000","last_change":"2023-08-17T17:34:23.189070+0000","last_active":"2023-08-17T17:34:23.533930+0000","last_peered":"2023-08-17T17:34:23.533930+0000","last_clean":"2023-08-17T17:34:23.533930+0000","last_became_active":"2023-08-17T17:34:23.188771+0000","last_became_peered":"2023-08-17T17:34:23.188771+0000","last_unstale":"2023-08-17T17:34:23.533930+0000","last_undegraded":"2023-08-17T17:34:23.533930+0000","last_fullsized":"2023-08-17T17:34:23.533930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554378+0000","last_change":"2023-08-17T17:34:23.549482+0000","last_active":"2023-08-17T17:34:23.554378+0000","last_peered":"2023-08-17T17:34:23.554378+0000","last_clean":"2023-08-17T17:34:23.554378+0000","last_became_active":"2023-08-17T17:34:23.549214+0000","last_became_peered":"2023-08-17T17:34:23.549214+0000","last_unstale":"2023-08-17T17:34:23.554378+0000","last_undegraded":"2023-08-17T17:34:23.554378+0000","last_fullsized":"2023-08-17T17:34:23.554378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557902+0000","last_change":"2023-08-17T17:34:23.191534+0000","last_active":"2023-08-17T17:34:23.557902+0000","last_peered":"2023-08-17T17:34:23.557902+0000","last_clean":"2023-08-17T17:34:23.557902+0000","last_became_active":"2023-08-17T17:34:23.191251+0000","last_became_peered":"2023-08-17T17:34:23.191251+0000","last_unstale":"2023-08-17T17:34:23.557902+0000","last_undegraded":"2023-08-17T17:34:23.557902+0000","last_fullsized":"2023-08-17T17:34:23.557902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:34:36.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:34:36.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.307+0000 7ff5e6069700 1 Processor -- start 2023-08-17T17:34:36.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.307+0000 7ff5e6069700 1 -- start start 2023-08-17T17:34:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.307+0000 7ff5e6069700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5e0151e40 0x7ff5e0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.307+0000 7ff5e6069700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e00a7c90 0x7ff5e00c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.307+0000 7ff5e6069700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff5e00be4d0 0x7ff5e00be960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.307+0000 7ff5e6069700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e00bf210 con 0x7ff5e0151e40 2023-08-17T17:34:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.307+0000 7ff5e6069700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e00c5a80 con 0x7ff5e00be4d0 2023-08-17T17:34:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.307+0000 7ff5e6069700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00bee50 con 0x7ff5e00a7c90 2023-08-17T17:34:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5df7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5e0151e40 0x7ff5e0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5df7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5e0151e40 0x7ff5e0152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47024/0 (socket says 172.21.15.78:47024) 2023-08-17T17:34:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5df7fe700 1 -- 172.21.15.78:0/2310755418 learned_addr learned my addr 172.21.15.78:0/2310755418 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5df7fe700 1 -- 172.21.15.78:0/2310755418 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e00a7c90 msgr2=0x7ff5e00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5df7fe700 1 --2- 172.21.15.78:0/2310755418 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e00a7c90 0x7ff5e00c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5df7fe700 1 -- 172.21.15.78:0/2310755418 >> v2:172.21.15.150:3300/0 conn(0x7ff5e00be4d0 msgr2=0x7ff5e00be960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5df7fe700 1 --2- 172.21.15.78:0/2310755418 >> v2:172.21.15.150:3300/0 conn(0x7ff5e00be4d0 0x7ff5e00be960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5df7fe700 1 -- 172.21.15.78:0/2310755418 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00c5450 con 0x7ff5e0151e40 2023-08-17T17:34:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5df7fe700 1 --2- 172.21.15.78:0/2310755418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e0151e40 0x7ff5e0152f00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7ff5e00c3a40 tx=0x7ff5d00090f0).ready entity=mon.0 client_cookie=ac37d929dc4801fc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5deffd700 1 -- 172.21.15.78:0/2310755418 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000b600 con 0x7ff5e0151e40 2023-08-17T17:34:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5deffd700 1 -- 172.21.15.78:0/2310755418 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d000b760 con 0x7ff5e0151e40 2023-08-17T17:34:36.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5deffd700 1 -- 172.21.15.78:0/2310755418 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000bae0 con 0x7ff5e0151e40 2023-08-17T17:34:36.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5e6069700 1 -- 172.21.15.78:0/2310755418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e0151e40 msgr2=0x7ff5e0152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5e6069700 1 --2- 172.21.15.78:0/2310755418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e0151e40 0x7ff5e0152f00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7ff5e00c3a40 tx=0x7ff5d00090f0).stop 2023-08-17T17:34:36.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.308+0000 7ff5e6069700 1 -- 172.21.15.78:0/2310755418 shutdown_connections 2023-08-17T17:34:36.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.309+0000 7ff5e6069700 1 --2- 172.21.15.78:0/2310755418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e0151e40 0x7ff5e0152f00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.309+0000 7ff5e6069700 1 --2- 172.21.15.78:0/2310755418 >> v2:172.21.15.150:3300/0 conn(0x7ff5e00be4d0 0x7ff5e00be960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:36.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.309+0000 7ff5e6069700 1 --2- 172.21.15.78:0/2310755418 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e00a7c90 0x7ff5e00c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:36.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.309+0000 7ff5e6069700 1 -- 172.21.15.78:0/2310755418 >> 172.21.15.78:0/2310755418 conn(0x7ff5e0092330 msgr2=0x7ff5e0062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:36.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.309+0000 7ff5e6069700 1 -- 172.21.15.78:0/2310755418 shutdown_connections 2023-08-17T17:34:36.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.309+0000 7ff5e6069700 1 -- 172.21.15.78:0/2310755418 wait complete. 2023-08-17T17:34:36.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.310+0000 7ff5e6069700 1 Processor -- start 2023-08-17T17:34:36.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.310+0000 7ff5e6069700 1 -- start start 2023-08-17T17:34:36.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5e6069700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e00a7c90 0x7ff5e00c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5e6069700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00be4d0 0x7ff5e00c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5e6069700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e0151e40 0x7ff5e00c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5e6069700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0144020 con 0x7ff5e00be4d0 2023-08-17T17:34:36.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5e6069700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00c1df0 con 0x7ff5e0151e40 2023-08-17T17:34:36.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5e6069700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00c7110 con 0x7ff5e00a7c90 2023-08-17T17:34:36.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00be4d0 0x7ff5e00c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00be4d0 0x7ff5e00c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47032/0 (socket says 172.21.15.78:47032) 2023-08-17T17:34:36.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d6ffd700 1 -- 172.21.15.78:0/1332724153 learned_addr learned my addr 172.21.15.78:0/1332724153 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:36.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d6ffd700 1 -- 172.21.15.78:0/1332724153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e00a7c90 msgr2=0x7ff5e00c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5df7fe700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e00a7c90 0x7ff5e00c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5dffff700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e0151e40 0x7ff5e00c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d6ffd700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e00a7c90 0x7ff5e00c0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d6ffd700 1 -- 172.21.15.78:0/1332724153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e0151e40 msgr2=0x7ff5e00c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d6ffd700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e0151e40 0x7ff5e00c2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d6ffd700 1 -- 172.21.15.78:0/1332724153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0009370 con 0x7ff5e00be4d0 2023-08-17T17:34:36.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d6ffd700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00be4d0 0x7ff5e00c68c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7ff5c800b560 tx=0x7ff5c80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:36.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d7fff700 1 -- 172.21.15.78:0/1332724153 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800d4a0 con 0x7ff5e00be4d0 2023-08-17T17:34:36.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d7fff700 1 -- 172.21.15.78:0/1332724153 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c800d620 con 0x7ff5e00be4d0 2023-08-17T17:34:36.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5d7fff700 1 -- 172.21.15.78:0/1332724153 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800d9e0 con 0x7ff5e00be4d0 2023-08-17T17:34:36.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5e6069700 1 -- 172.21.15.78:0/1332724153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e00c73f0 con 0x7ff5e00be4d0 2023-08-17T17:34:36.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.311+0000 7ff5e6069700 1 -- 172.21.15.78:0/1332724153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e00c6db0 con 0x7ff5e00be4d0 2023-08-17T17:34:36.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.312+0000 7ff5e6069700 1 -- 172.21.15.78:0/1332724153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e00c20d0 con 0x7ff5e00be4d0 2023-08-17T17:34:36.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.313+0000 7ff5d7fff700 1 -- 172.21.15.78:0/1332724153 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff5c800f030 con 0x7ff5e00be4d0 2023-08-17T17:34:36.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.313+0000 7ff5d7fff700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5c005ed90 0x7ff5c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.313+0000 7ff5d7fff700 1 -- 172.21.15.78:0/1332724153 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff5c8079850 con 0x7ff5e00be4d0 2023-08-17T17:34:36.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.313+0000 7ff5df7fe700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5c005ed90 0x7ff5c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.313+0000 7ff5df7fe700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5c005ed90 0x7ff5c0061250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff5d0009130 tx=0x7ff5d0017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:36.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.317+0000 7ff5d7fff700 1 -- 172.21.15.78:0/1332724153 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff5c804adf0 con 0x7ff5e00be4d0 2023-08-17T17:34:36.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.475+0000 7ff5e6069700 1 -- 172.21.15.78:0/1332724153 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5e01533f0 con 0x7ff5c005ed90 2023-08-17T17:34:36.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.483+0000 7ff5d7fff700 1 -- 172.21.15.78:0/1332724153 <== mgr.4104 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336282 (secure 0 0 0) 0x7ff5e01533f0 con 0x7ff5c005ed90 2023-08-17T17:34:36.488 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:36.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 -- 172.21.15.78:0/1332724153 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5c005ed90 msgr2=0x7ff5c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5c005ed90 0x7ff5c0061250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff5d0009130 tx=0x7ff5d0017000).stop 2023-08-17T17:34:36.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 -- 172.21.15.78:0/1332724153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00be4d0 msgr2=0x7ff5e00c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00be4d0 0x7ff5e00c68c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7ff5c800b560 tx=0x7ff5c80090f0).stop 2023-08-17T17:34:36.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 -- 172.21.15.78:0/1332724153 shutdown_connections 2023-08-17T17:34:36.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5c005ed90 0x7ff5c0061250 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e0151e40 0x7ff5e00c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e00a7c90 0x7ff5e00c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 --2- 172.21.15.78:0/1332724153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00be4d0 0x7ff5e00c68c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 -- 172.21.15.78:0/1332724153 >> 172.21.15.78:0/1332724153 conn(0x7ff5e0092330 msgr2=0x7ff5e00a5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:36.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 -- 172.21.15.78:0/1332724153 shutdown_connections 2023-08-17T17:34:36.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.487+0000 7ff5e6069700 1 -- 172.21.15.78:0/1332724153 wait complete. 2023-08-17T17:34:36.492 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:34:36.500 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-17T17:34:35.010650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378624,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596096,"statfs":{"total":773094113280,"available":770658402304,"internally_reserved":0,"allocated":1900544,"data_stored":687340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001606"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561594+0000","last_change":"2023-08-17T17:34:23.557678+0000","last_active":"2023-08-17T17:34:23.561594+0000","last_peered":"2023-08-17T17:34:23.561594+0000","last_clean":"2023-08-17T17:34:23.561594+0000","last_became_active":"2023-08-17T17:34:23.555333+0000","last_became_peered":"2023-08-17T17:34:23.555333+0000","last_unstale":"2023-08-17T17:34:23.561594+0000","last_undegraded":"2023-08-17T17:34:23.561594+0000","last_fullsized":"2023-08-17T17:34:23.561594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.539074+0000","last_change":"2023-08-17T17:34:23.190017+0000","last_active":"2023-08-17T17:34:23.539074+0000","last_peered":"2023-08-17T17:34:23.539074+0000","last_clean":"2023-08-17T17:34:23.539074+0000","last_became_active":"2023-08-17T17:34:23.189552+0000","last_became_peered":"2023-08-17T17:34:23.189552+0000","last_unstale":"2023-08-17T17:34:23.539074+0000","last_undegraded":"2023-08-17T17:34:23.539074+0000","last_fullsized":"2023-08-17T17:34:23.539074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553264+0000","last_change":"2023-08-17T17:34:23.547846+0000","last_active":"2023-08-17T17:34:23.553264+0000","last_peered":"2023-08-17T17:34:23.553264+0000","last_clean":"2023-08-17T17:34:23.553264+0000","last_became_active":"2023-08-17T17:34:23.547522+0000","last_became_peered":"2023-08-17T17:34:23.547522+0000","last_unstale":"2023-08-17T17:34:23.553264+0000","last_undegraded":"2023-08-17T17:34:23.553264+0000","last_fullsized":"2023-08-17T17:34:23.553264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533143+0000","last_change":"2023-08-17T17:34:23.196197+0000","last_active":"2023-08-17T17:34:23.533143+0000","last_peered":"2023-08-17T17:34:23.533143+0000","last_clean":"2023-08-17T17:34:23.533143+0000","last_became_active":"2023-08-17T17:34:23.195910+0000","last_became_peered":"2023-08-17T17:34:23.195910+0000","last_unstale":"2023-08-17T17:34:23.533143+0000","last_undegraded":"2023-08-17T17:34:23.533143+0000","last_fullsized":"2023-08-17T17:34:23.533143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556574+0000","last_change":"2023-08-17T17:34:23.550439+0000","last_active":"2023-08-17T17:34:23.556574+0000","last_peered":"2023-08-17T17:34:23.556574+0000","last_clean":"2023-08-17T17:34:23.556574+0000","last_became_active":"2023-08-17T17:34:23.550192+0000","last_became_peered":"2023-08-17T17:34:23.550192+0000","last_unstale":"2023-08-17T17:34:23.556574+0000","last_undegraded":"2023-08-17T17:34:23.556574+0000","last_fullsized":"2023-08-17T17:34:23.556574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553151+0000","last_change":"2023-08-17T17:34:23.186362+0000","last_active":"2023-08-17T17:34:23.553151+0000","last_peered":"2023-08-17T17:34:23.553151+0000","last_clean":"2023-08-17T17:34:23.553151+0000","last_became_active":"2023-08-17T17:34:23.186076+0000","last_became_peered":"2023-08-17T17:34:23.186076+0000","last_unstale":"2023-08-17T17:34:23.553151+0000","last_undegraded":"2023-08-17T17:34:23.553151+0000","last_fullsized":"2023-08-17T17:34:23.553151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561724+0000","last_change":"2023-08-17T17:34:23.558066+0000","last_active":"2023-08-17T17:34:23.561724+0000","last_peered":"2023-08-17T17:34:23.561724+0000","last_clean":"2023-08-17T17:34:23.561724+0000","last_became_active":"2023-08-17T17:34:23.557750+0000","last_became_peered":"2023-08-17T17:34:23.557750+0000","last_unstale":"2023-08-17T17:34:23.561724+0000","last_undegraded":"2023-08-17T17:34:23.561724+0000","last_fullsized":"2023-08-17T17:34:23.561724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538164+0000","last_change":"2023-08-17T17:34:23.185772+0000","last_active":"2023-08-17T17:34:23.538164+0000","last_peered":"2023-08-17T17:34:23.538164+0000","last_clean":"2023-08-17T17:34:23.538164+0000","last_became_active":"2023-08-17T17:34:23.185206+0000","last_became_peered":"2023-08-17T17:34:23.185206+0000","last_unstale":"2023-08-17T17:34:23.538164+0000","last_undegraded":"2023-08-17T17:34:23.538164+0000","last_fullsized":"2023-08-17T17:34:23.538164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561741+0000","last_change":"2023-08-17T17:34:23.558454+0000","last_active":"2023-08-17T17:34:23.561741+0000","last_peered":"2023-08-17T17:34:23.561741+0000","last_clean":"2023-08-17T17:34:23.561741+0000","last_became_active":"2023-08-17T17:34:23.558213+0000","last_became_peered":"2023-08-17T17:34:23.558213+0000","last_unstale":"2023-08-17T17:34:23.561741+0000","last_undegraded":"2023-08-17T17:34:23.561741+0000","last_fullsized":"2023-08-17T17:34:23.561741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538249+0000","last_change":"2023-08-17T17:34:23.188666+0000","last_active":"2023-08-17T17:34:23.538249+0000","last_peered":"2023-08-17T17:34:23.538249+0000","last_clean":"2023-08-17T17:34:23.538249+0000","last_became_active":"2023-08-17T17:34:23.188351+0000","last_became_peered":"2023-08-17T17:34:23.188351+0000","last_unstale":"2023-08-17T17:34:23.538249+0000","last_undegraded":"2023-08-17T17:34:23.538249+0000","last_fullsized":"2023-08-17T17:34:23.538249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553062+0000","last_change":"2023-08-17T17:34:23.550268+0000","last_active":"2023-08-17T17:34:23.553062+0000","last_peered":"2023-08-17T17:34:23.553062+0000","last_clean":"2023-08-17T17:34:23.553062+0000","last_became_active":"2023-08-17T17:34:23.549994+0000","last_became_peered":"2023-08-17T17:34:23.549994+0000","last_unstale":"2023-08-17T17:34:23.553062+0000","last_undegraded":"2023-08-17T17:34:23.553062+0000","last_fullsized":"2023-08-17T17:34:23.553062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561548+0000","last_change":"2023-08-17T17:34:23.187424+0000","last_active":"2023-08-17T17:34:23.561548+0000","last_peered":"2023-08-17T17:34:23.561548+0000","last_clean":"2023-08-17T17:34:23.561548+0000","last_became_active":"2023-08-17T17:34:23.187090+0000","last_became_peered":"2023-08-17T17:34:23.187090+0000","last_unstale":"2023-08-17T17:34:23.561548+0000","last_undegraded":"2023-08-17T17:34:23.561548+0000","last_fullsized":"2023-08-17T17:34:23.561548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555838+0000","last_change":"2023-08-17T17:34:23.550226+0000","last_active":"2023-08-17T17:34:23.555838+0000","last_peered":"2023-08-17T17:34:23.555838+0000","last_clean":"2023-08-17T17:34:23.555838+0000","last_became_active":"2023-08-17T17:34:23.549894+0000","last_became_peered":"2023-08-17T17:34:23.549894+0000","last_unstale":"2023-08-17T17:34:23.555838+0000","last_undegraded":"2023-08-17T17:34:23.555838+0000","last_fullsized":"2023-08-17T17:34:23.555838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557712+0000","last_change":"2023-08-17T17:34:23.191048+0000","last_active":"2023-08-17T17:34:23.557712+0000","last_peered":"2023-08-17T17:34:23.557712+0000","last_clean":"2023-08-17T17:34:23.557712+0000","last_became_active":"2023-08-17T17:34:23.189624+0000","last_became_peered":"2023-08-17T17:34:23.189624+0000","last_unstale":"2023-08-17T17:34:23.557712+0000","last_undegraded":"2023-08-17T17:34:23.557712+0000","last_fullsized":"2023-08-17T17:34:23.557712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561649+0000","last_change":"2023-08-17T17:34:23.560468+0000","last_active":"2023-08-17T17:34:23.561649+0000","last_peered":"2023-08-17T17:34:23.561649+0000","last_clean":"2023-08-17T17:34:23.561649+0000","last_became_active":"2023-08-17T17:34:23.560200+0000","last_became_peered":"2023-08-17T17:34:23.560200+0000","last_unstale":"2023-08-17T17:34:23.561649+0000","last_undegraded":"2023-08-17T17:34:23.561649+0000","last_fullsized":"2023-08-17T17:34:23.561649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557231+0000","last_change":"2023-08-17T17:34:23.192628+0000","last_active":"2023-08-17T17:34:23.557231+0000","last_peered":"2023-08-17T17:34:23.557231+0000","last_clean":"2023-08-17T17:34:23.557231+0000","last_became_active":"2023-08-17T17:34:23.192359+0000","last_became_peered":"2023-08-17T17:34:23.192359+0000","last_unstale":"2023-08-17T17:34:23.557231+0000","last_undegraded":"2023-08-17T17:34:23.557231+0000","last_fullsized":"2023-08-17T17:34:23.557231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554345+0000","last_change":"2023-08-17T17:34:23.549337+0000","last_active":"2023-08-17T17:34:23.554345+0000","last_peered":"2023-08-17T17:34:23.554345+0000","last_clean":"2023-08-17T17:34:23.554345+0000","last_became_active":"2023-08-17T17:34:23.547732+0000","last_became_peered":"2023-08-17T17:34:23.547732+0000","last_unstale":"2023-08-17T17:34:23.554345+0000","last_undegraded":"2023-08-17T17:34:23.554345+0000","last_fullsized":"2023-08-17T17:34:23.554345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536787+0000","last_change":"2023-08-17T17:34:23.189436+0000","last_active":"2023-08-17T17:34:23.536787+0000","last_peered":"2023-08-17T17:34:23.536787+0000","last_clean":"2023-08-17T17:34:23.536787+0000","last_became_active":"2023-08-17T17:34:23.189166+0000","last_became_peered":"2023-08-17T17:34:23.189166+0000","last_unstale":"2023-08-17T17:34:23.536787+0000","last_undegraded":"2023-08-17T17:34:23.536787+0000","last_fullsized":"2023-08-17T17:34:23.536787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553613+0000","last_change":"2023-08-17T17:34:23.551604+0000","last_active":"2023-08-17T17:34:23.553613+0000","last_peered":"2023-08-17T17:34:23.553613+0000","last_clean":"2023-08-17T17:34:23.553613+0000","last_became_active":"2023-08-17T17:34:23.551329+0000","last_became_peered":"2023-08-17T17:34:23.551329+0000","last_unstale":"2023-08-17T17:34:23.553613+0000","last_undegraded":"2023-08-17T17:34:23.553613+0000","last_fullsized":"2023-08-17T17:34:23.553613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541261+0000","last_change":"2023-08-17T17:34:23.190730+0000","last_active":"2023-08-17T17:34:23.541261+0000","last_peered":"2023-08-17T17:34:23.541261+0000","last_clean":"2023-08-17T17:34:23.541261+0000","last_became_active":"2023-08-17T17:34:23.190449+0000","last_became_peered":"2023-08-17T17:34:23.190449+0000","last_unstale":"2023-08-17T17:34:23.541261+0000","last_undegraded":"2023-08-17T17:34:23.541261+0000","last_fullsized":"2023-08-17T17:34:23.541261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561770+0000","last_change":"2023-08-17T17:34:23.558813+0000","last_active":"2023-08-17T17:34:23.561770+0000","last_peered":"2023-08-17T17:34:23.561770+0000","last_clean":"2023-08-17T17:34:23.561770+0000","last_became_active":"2023-08-17T17:34:23.558310+0000","last_became_peered":"2023-08-17T17:34:23.558310+0000","last_unstale":"2023-08-17T17:34:23.561770+0000","last_undegraded":"2023-08-17T17:34:23.561770+0000","last_fullsized":"2023-08-17T17:34:23.561770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555952+0000","last_change":"2023-08-17T17:34:23.185442+0000","last_active":"2023-08-17T17:34:23.555952+0000","last_peered":"2023-08-17T17:34:23.555952+0000","last_clean":"2023-08-17T17:34:23.555952+0000","last_became_active":"2023-08-17T17:34:23.185159+0000","last_became_peered":"2023-08-17T17:34:23.185159+0000","last_unstale":"2023-08-17T17:34:23.555952+0000","last_undegraded":"2023-08-17T17:34:23.555952+0000","last_fullsized":"2023-08-17T17:34:23.555952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550463+0000","last_change":"2023-08-17T17:34:23.547815+0000","last_active":"2023-08-17T17:34:23.550463+0000","last_peered":"2023-08-17T17:34:23.550463+0000","last_clean":"2023-08-17T17:34:23.550463+0000","last_became_active":"2023-08-17T17:34:23.547492+0000","last_became_peered":"2023-08-17T17:34:23.547492+0000","last_unstale":"2023-08-17T17:34:23.550463+0000","last_undegraded":"2023-08-17T17:34:23.550463+0000","last_fullsized":"2023-08-17T17:34:23.550463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557254+0000","last_change":"2023-08-17T17:34:23.192604+0000","last_active":"2023-08-17T17:34:23.557254+0000","last_peered":"2023-08-17T17:34:23.557254+0000","last_clean":"2023-08-17T17:34:23.557254+0000","last_became_active":"2023-08-17T17:34:23.192411+0000","last_became_peered":"2023-08-17T17:34:23.192411+0000","last_unstale":"2023-08-17T17:34:23.557254+0000","last_undegraded":"2023-08-17T17:34:23.557254+0000","last_fullsized":"2023-08-17T17:34:23.557254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554087+0000","last_change":"2023-08-17T17:34:23.548701+0000","last_active":"2023-08-17T17:34:23.554087+0000","last_peered":"2023-08-17T17:34:23.554087+0000","last_clean":"2023-08-17T17:34:23.554087+0000","last_became_active":"2023-08-17T17:34:23.548165+0000","last_became_peered":"2023-08-17T17:34:23.548165+0000","last_unstale":"2023-08-17T17:34:23.554087+0000","last_undegraded":"2023-08-17T17:34:23.554087+0000","last_fullsized":"2023-08-17T17:34:23.554087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557058+0000","last_change":"2023-08-17T17:34:23.193961+0000","last_active":"2023-08-17T17:34:23.557058+0000","last_peered":"2023-08-17T17:34:23.557058+0000","last_clean":"2023-08-17T17:34:23.557058+0000","last_became_active":"2023-08-17T17:34:23.193712+0000","last_became_peered":"2023-08-17T17:34:23.193712+0000","last_unstale":"2023-08-17T17:34:23.557058+0000","last_undegraded":"2023-08-17T17:34:23.557058+0000","last_fullsized":"2023-08-17T17:34:23.557058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.562714+0000","last_change":"2023-08-17T17:34:23.559424+0000","last_active":"2023-08-17T17:34:23.562714+0000","last_peered":"2023-08-17T17:34:23.562714+0000","last_clean":"2023-08-17T17:34:23.562714+0000","last_became_active":"2023-08-17T17:34:23.559157+0000","last_became_peered":"2023-08-17T17:34:23.559157+0000","last_unstale":"2023-08-17T17:34:23.562714+0000","last_undegraded":"2023-08-17T17:34:23.562714+0000","last_fullsized":"2023-08-17T17:34:23.562714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541905+0000","last_change":"2023-08-17T17:34:23.198227+0000","last_active":"2023-08-17T17:34:23.541905+0000","last_peered":"2023-08-17T17:34:23.541905+0000","last_clean":"2023-08-17T17:34:23.541905+0000","last_became_active":"2023-08-17T17:34:23.197944+0000","last_became_peered":"2023-08-17T17:34:23.197944+0000","last_unstale":"2023-08-17T17:34:23.541905+0000","last_undegraded":"2023-08-17T17:34:23.541905+0000","last_fullsized":"2023-08-17T17:34:23.541905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552923+0000","last_change":"2023-08-17T17:34:23.547115+0000","last_active":"2023-08-17T17:34:23.552923+0000","last_peered":"2023-08-17T17:34:23.552923+0000","last_clean":"2023-08-17T17:34:23.552923+0000","last_became_active":"2023-08-17T17:34:23.546829+0000","last_became_peered":"2023-08-17T17:34:23.546829+0000","last_unstale":"2023-08-17T17:34:23.552923+0000","last_undegraded":"2023-08-17T17:34:23.552923+0000","last_fullsized":"2023-08-17T17:34:23.552923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537300+0000","last_change":"2023-08-17T17:34:23.187589+0000","last_active":"2023-08-17T17:34:23.537300+0000","last_peered":"2023-08-17T17:34:23.537300+0000","last_clean":"2023-08-17T17:34:23.537300+0000","last_became_active":"2023-08-17T17:34:23.187290+0000","last_became_peered":"2023-08-17T17:34:23.187290+0000","last_unstale":"2023-08-17T17:34:23.537300+0000","last_undegraded":"2023-08-17T17:34:23.537300+0000","last_fullsized":"2023-08-17T17:34:23.537300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556397+0000","last_change":"2023-08-17T17:34:23.554129+0000","last_active":"2023-08-17T17:34:23.556397+0000","last_peered":"2023-08-17T17:34:23.556397+0000","last_clean":"2023-08-17T17:34:23.556397+0000","last_became_active":"2023-08-17T17:34:23.553850+0000","last_became_peered":"2023-08-17T17:34:23.553850+0000","last_unstale":"2023-08-17T17:34:23.556397+0000","last_undegraded":"2023-08-17T17:34:23.556397+0000","last_fullsized":"2023-08-17T17:34:23.556397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561125+0000","last_change":"2023-08-17T17:34:23.186710+0000","last_active":"2023-08-17T17:34:23.561125+0000","last_peered":"2023-08-17T17:34:23.561125+0000","last_clean":"2023-08-17T17:34:23.561125+0000","last_became_active":"2023-08-17T17:34:23.186445+0000","last_became_peered":"2023-08-17T17:34:23.186445+0000","last_unstale":"2023-08-17T17:34:23.561125+0000","last_undegraded":"2023-08-17T17:34:23.561125+0000","last_fullsized":"2023-08-17T17:34:23.561125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556303+0000","last_change":"2023-08-17T17:34:23.550750+0000","last_active":"2023-08-17T17:34:23.556303+0000","last_peered":"2023-08-17T17:34:23.556303+0000","last_clean":"2023-08-17T17:34:23.556303+0000","last_became_active":"2023-08-17T17:34:23.550414+0000","last_became_peered":"2023-08-17T17:34:23.550414+0000","last_unstale":"2023-08-17T17:34:23.556303+0000","last_undegraded":"2023-08-17T17:34:23.556303+0000","last_fullsized":"2023-08-17T17:34:23.556303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543904+0000","last_change":"2023-08-17T17:34:23.191770+0000","last_active":"2023-08-17T17:34:23.543904+0000","last_peered":"2023-08-17T17:34:23.543904+0000","last_clean":"2023-08-17T17:34:23.543904+0000","last_became_active":"2023-08-17T17:34:23.191496+0000","last_became_peered":"2023-08-17T17:34:23.191496+0000","last_unstale":"2023-08-17T17:34:23.543904+0000","last_undegraded":"2023-08-17T17:34:23.543904+0000","last_fullsized":"2023-08-17T17:34:23.543904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556458+0000","last_change":"2023-08-17T17:34:23.555082+0000","last_active":"2023-08-17T17:34:23.556458+0000","last_peered":"2023-08-17T17:34:23.556458+0000","last_clean":"2023-08-17T17:34:23.556458+0000","last_became_active":"2023-08-17T17:34:23.554787+0000","last_became_peered":"2023-08-17T17:34:23.554787+0000","last_unstale":"2023-08-17T17:34:23.556458+0000","last_undegraded":"2023-08-17T17:34:23.556458+0000","last_fullsized":"2023-08-17T17:34:23.556458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.539343+0000","last_change":"2023-08-17T17:34:23.186144+0000","last_active":"2023-08-17T17:34:23.539343+0000","last_peered":"2023-08-17T17:34:23.539343+0000","last_clean":"2023-08-17T17:34:23.539343+0000","last_became_active":"2023-08-17T17:34:23.185783+0000","last_became_peered":"2023-08-17T17:34:23.185783+0000","last_unstale":"2023-08-17T17:34:23.539343+0000","last_undegraded":"2023-08-17T17:34:23.539343+0000","last_fullsized":"2023-08-17T17:34:23.539343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.558748+0000","last_change":"2023-08-17T17:34:23.556916+0000","last_active":"2023-08-17T17:34:23.558748+0000","last_peered":"2023-08-17T17:34:23.558748+0000","last_clean":"2023-08-17T17:34:23.558748+0000","last_became_active":"2023-08-17T17:34:23.556648+0000","last_became_peered":"2023-08-17T17:34:23.556648+0000","last_unstale":"2023-08-17T17:34:23.558748+0000","last_undegraded":"2023-08-17T17:34:23.558748+0000","last_fullsized":"2023-08-17T17:34:23.558748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553011+0000","last_change":"2023-08-17T17:34:23.186198+0000","last_active":"2023-08-17T17:34:23.553011+0000","last_peered":"2023-08-17T17:34:23.553011+0000","last_clean":"2023-08-17T17:34:23.553011+0000","last_became_active":"2023-08-17T17:34:23.185926+0000","last_became_peered":"2023-08-17T17:34:23.185926+0000","last_unstale":"2023-08-17T17:34:23.553011+0000","last_undegraded":"2023-08-17T17:34:23.553011+0000","last_fullsized":"2023-08-17T17:34:23.553011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533588+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:34:23.533588+0000","last_peered":"2023-08-17T17:34:23.533588+0000","last_clean":"2023-08-17T17:34:23.533588+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:34:23.533588+0000","last_undegraded":"2023-08-17T17:34:23.533588+0000","last_fullsized":"2023-08-17T17:34:23.533588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537500+0000","last_change":"2023-08-17T17:34:23.184771+0000","last_active":"2023-08-17T17:34:23.537500+0000","last_peered":"2023-08-17T17:34:23.537500+0000","last_clean":"2023-08-17T17:34:23.537500+0000","last_became_active":"2023-08-17T17:34:23.184315+0000","last_became_peered":"2023-08-17T17:34:23.184315+0000","last_unstale":"2023-08-17T17:34:23.537500+0000","last_undegraded":"2023-08-17T17:34:23.537500+0000","last_fullsized":"2023-08-17T17:34:23.537500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552062+0000","last_change":"2023-08-17T17:34:23.542863+0000","last_active":"2023-08-17T17:34:23.552062+0000","last_peered":"2023-08-17T17:34:23.552062+0000","last_clean":"2023-08-17T17:34:23.552062+0000","last_became_active":"2023-08-17T17:34:23.542602+0000","last_became_peered":"2023-08-17T17:34:23.542602+0000","last_unstale":"2023-08-17T17:34:23.552062+0000","last_undegraded":"2023-08-17T17:34:23.552062+0000","last_fullsized":"2023-08-17T17:34:23.552062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536939+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:34:23.536939+0000","last_peered":"2023-08-17T17:34:23.536939+0000","last_clean":"2023-08-17T17:34:23.536939+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:34:23.536939+0000","last_undegraded":"2023-08-17T17:34:23.536939+0000","last_fullsized":"2023-08-17T17:34:23.536939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.545603+0000","last_change":"2023-08-17T17:34:23.187110+0000","last_active":"2023-08-17T17:34:23.545603+0000","last_peered":"2023-08-17T17:34:23.545603+0000","last_clean":"2023-08-17T17:34:23.545603+0000","last_became_active":"2023-08-17T17:34:23.186796+0000","last_became_peered":"2023-08-17T17:34:23.186796+0000","last_unstale":"2023-08-17T17:34:23.545603+0000","last_undegraded":"2023-08-17T17:34:23.545603+0000","last_fullsized":"2023-08-17T17:34:23.545603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552439+0000","last_change":"2023-08-17T17:34:23.542382+0000","last_active":"2023-08-17T17:34:23.552439+0000","last_peered":"2023-08-17T17:34:23.552439+0000","last_clean":"2023-08-17T17:34:23.552439+0000","last_became_active":"2023-08-17T17:34:23.542108+0000","last_became_peered":"2023-08-17T17:34:23.542108+0000","last_unstale":"2023-08-17T17:34:23.552439+0000","last_undegraded":"2023-08-17T17:34:23.552439+0000","last_fullsized":"2023-08-17T17:34:23.552439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552089+0000","last_change":"2023-08-17T17:34:23.543037+0000","last_active":"2023-08-17T17:34:23.552089+0000","last_peered":"2023-08-17T17:34:23.552089+0000","last_clean":"2023-08-17T17:34:23.552089+0000","last_became_active":"2023-08-17T17:34:23.542776+0000","last_became_peered":"2023-08-17T17:34:23.542776+0000","last_unstale":"2023-08-17T17:34:23.552089+0000","last_undegraded":"2023-08-17T17:34:23.552089+0000","last_fullsized":"2023-08-17T17:34:23.552089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535248+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:34:23.535248+0000","last_peered":"2023-08-17T17:34:23.535248+0000","last_clean":"2023-08-17T17:34:23.535248+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:34:23.535248+0000","last_undegraded":"2023-08-17T17:34:23.535248+0000","last_fullsized":"2023-08-17T17:34:23.535248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533154+0000","last_change":"2023-08-17T17:34:23.189586+0000","last_active":"2023-08-17T17:34:23.533154+0000","last_peered":"2023-08-17T17:34:23.533154+0000","last_clean":"2023-08-17T17:34:23.533154+0000","last_became_active":"2023-08-17T17:34:23.189430+0000","last_became_peered":"2023-08-17T17:34:23.189430+0000","last_unstale":"2023-08-17T17:34:23.533154+0000","last_undegraded":"2023-08-17T17:34:23.533154+0000","last_fullsized":"2023-08-17T17:34:23.533154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557368+0000","last_change":"2023-08-17T17:34:23.553467+0000","last_active":"2023-08-17T17:34:23.557368+0000","last_peered":"2023-08-17T17:34:23.557368+0000","last_clean":"2023-08-17T17:34:23.557368+0000","last_became_active":"2023-08-17T17:34:23.553182+0000","last_became_peered":"2023-08-17T17:34:23.553182+0000","last_unstale":"2023-08-17T17:34:23.557368+0000","last_undegraded":"2023-08-17T17:34:23.557368+0000","last_fullsized":"2023-08-17T17:34:23.557368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537185+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:34:23.537185+0000","last_peered":"2023-08-17T17:34:23.537185+0000","last_clean":"2023-08-17T17:34:23.537185+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:34:23.537185+0000","last_undegraded":"2023-08-17T17:34:23.537185+0000","last_fullsized":"2023-08-17T17:34:23.537185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.540641+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:34:23.540641+0000","last_peered":"2023-08-17T17:34:23.540641+0000","last_clean":"2023-08-17T17:34:23.540641+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:34:23.540641+0000","last_undegraded":"2023-08-17T17:34:23.540641+0000","last_fullsized":"2023-08-17T17:34:23.540641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551649+0000","last_change":"2023-08-17T17:34:23.182606+0000","last_active":"2023-08-17T17:34:23.551649+0000","last_peered":"2023-08-17T17:34:23.551649+0000","last_clean":"2023-08-17T17:34:23.551649+0000","last_became_active":"2023-08-17T17:34:23.182335+0000","last_became_peered":"2023-08-17T17:34:23.182335+0000","last_unstale":"2023-08-17T17:34:23.551649+0000","last_undegraded":"2023-08-17T17:34:23.551649+0000","last_fullsized":"2023-08-17T17:34:23.551649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553244+0000","last_change":"2023-08-17T17:34:23.547812+0000","last_active":"2023-08-17T17:34:23.553244+0000","last_peered":"2023-08-17T17:34:23.553244+0000","last_clean":"2023-08-17T17:34:23.553244+0000","last_became_active":"2023-08-17T17:34:23.547532+0000","last_became_peered":"2023-08-17T17:34:23.547532+0000","last_unstale":"2023-08-17T17:34:23.553244+0000","last_undegraded":"2023-08-17T17:34:23.553244+0000","last_fullsized":"2023-08-17T17:34:23.553244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541070+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:34:23.541070+0000","last_peered":"2023-08-17T17:34:23.541070+0000","last_clean":"2023-08-17T17:34:23.541070+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:34:23.541070+0000","last_undegraded":"2023-08-17T17:34:23.541070+0000","last_fullsized":"2023-08-17T17:34:23.541070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536221+0000","last_change":"2023-08-17T17:34:23.187849+0000","last_active":"2023-08-17T17:34:23.536221+0000","last_peered":"2023-08-17T17:34:23.536221+0000","last_clean":"2023-08-17T17:34:23.536221+0000","last_became_active":"2023-08-17T17:34:23.187578+0000","last_became_peered":"2023-08-17T17:34:23.187578+0000","last_unstale":"2023-08-17T17:34:23.536221+0000","last_undegraded":"2023-08-17T17:34:23.536221+0000","last_fullsized":"2023-08-17T17:34:23.536221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541946+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:34:23.541946+0000","last_peered":"2023-08-17T17:34:23.541946+0000","last_clean":"2023-08-17T17:34:23.541946+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:34:23.541946+0000","last_undegraded":"2023-08-17T17:34:23.541946+0000","last_fullsized":"2023-08-17T17:34:23.541946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533816+0000","last_change":"2023-08-17T17:34:23.191992+0000","last_active":"2023-08-17T17:34:23.533816+0000","last_peered":"2023-08-17T17:34:23.533816+0000","last_clean":"2023-08-17T17:34:23.533816+0000","last_became_active":"2023-08-17T17:34:23.191711+0000","last_became_peered":"2023-08-17T17:34:23.191711+0000","last_unstale":"2023-08-17T17:34:23.533816+0000","last_undegraded":"2023-08-17T17:34:23.533816+0000","last_fullsized":"2023-08-17T17:34:23.533816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550945+0000","last_change":"2023-08-17T17:34:23.541695+0000","last_active":"2023-08-17T17:34:23.550945+0000","last_peered":"2023-08-17T17:34:23.550945+0000","last_clean":"2023-08-17T17:34:23.550945+0000","last_became_active":"2023-08-17T17:34:23.541430+0000","last_became_peered":"2023-08-17T17:34:23.541430+0000","last_unstale":"2023-08-17T17:34:23.550945+0000","last_undegraded":"2023-08-17T17:34:23.550945+0000","last_fullsized":"2023-08-17T17:34:23.550945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561299+0000","last_change":"2023-08-17T17:34:23.188530+0000","last_active":"2023-08-17T17:34:23.561299+0000","last_peered":"2023-08-17T17:34:23.561299+0000","last_clean":"2023-08-17T17:34:23.561299+0000","last_became_active":"2023-08-17T17:34:23.188237+0000","last_became_peered":"2023-08-17T17:34:23.188237+0000","last_unstale":"2023-08-17T17:34:23.561299+0000","last_undegraded":"2023-08-17T17:34:23.561299+0000","last_fullsized":"2023-08-17T17:34:23.561299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533756+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:34:23.533756+0000","last_peered":"2023-08-17T17:34:23.533756+0000","last_clean":"2023-08-17T17:34:23.533756+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:34:23.533756+0000","last_undegraded":"2023-08-17T17:34:23.533756+0000","last_fullsized":"2023-08-17T17:34:23.533756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561250+0000","last_change":"2023-08-17T17:34:23.557366+0000","last_active":"2023-08-17T17:34:23.561250+0000","last_peered":"2023-08-17T17:34:23.561250+0000","last_clean":"2023-08-17T17:34:23.561250+0000","last_became_active":"2023-08-17T17:34:23.555195+0000","last_became_peered":"2023-08-17T17:34:23.555195+0000","last_unstale":"2023-08-17T17:34:23.561250+0000","last_undegraded":"2023-08-17T17:34:23.561250+0000","last_fullsized":"2023-08-17T17:34:23.561250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543361+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:34:23.543361+0000","last_peered":"2023-08-17T17:34:23.543361+0000","last_clean":"2023-08-17T17:34:23.543361+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:34:23.543361+0000","last_undegraded":"2023-08-17T17:34:23.543361+0000","last_fullsized":"2023-08-17T17:34:23.543361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537218+0000","last_change":"2023-08-17T17:34:23.191591+0000","last_active":"2023-08-17T17:34:23.537218+0000","last_peered":"2023-08-17T17:34:23.537218+0000","last_clean":"2023-08-17T17:34:23.537218+0000","last_became_active":"2023-08-17T17:34:23.190831+0000","last_became_peered":"2023-08-17T17:34:23.190831+0000","last_unstale":"2023-08-17T17:34:23.537218+0000","last_undegraded":"2023-08-17T17:34:23.537218+0000","last_fullsized":"2023-08-17T17:34:23.537218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551876+0000","last_change":"2023-08-17T17:34:23.542994+0000","last_active":"2023-08-17T17:34:23.551876+0000","last_peered":"2023-08-17T17:34:23.551876+0000","last_clean":"2023-08-17T17:34:23.551876+0000","last_became_active":"2023-08-17T17:34:23.542731+0000","last_became_peered":"2023-08-17T17:34:23.542731+0000","last_unstale":"2023-08-17T17:34:23.551876+0000","last_undegraded":"2023-08-17T17:34:23.551876+0000","last_fullsized":"2023-08-17T17:34:23.551876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550786+0000","last_change":"2023-08-17T17:34:23.547644+0000","last_active":"2023-08-17T17:34:23.550786+0000","last_peered":"2023-08-17T17:34:23.550786+0000","last_clean":"2023-08-17T17:34:23.550786+0000","last_became_active":"2023-08-17T17:34:23.547383+0000","last_became_peered":"2023-08-17T17:34:23.547383+0000","last_unstale":"2023-08-17T17:34:23.550786+0000","last_undegraded":"2023-08-17T17:34:23.550786+0000","last_fullsized":"2023-08-17T17:34:23.550786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537092+0000","last_change":"2023-08-17T17:34:23.190255+0000","last_active":"2023-08-17T17:34:23.537092+0000","last_peered":"2023-08-17T17:34:23.537092+0000","last_clean":"2023-08-17T17:34:23.537092+0000","last_became_active":"2023-08-17T17:34:23.189984+0000","last_became_peered":"2023-08-17T17:34:23.189984+0000","last_unstale":"2023-08-17T17:34:23.537092+0000","last_undegraded":"2023-08-17T17:34:23.537092+0000","last_fullsized":"2023-08-17T17:34:23.537092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555854+0000","last_change":"2023-08-17T17:34:23.552719+0000","last_active":"2023-08-17T17:34:23.555854+0000","last_peered":"2023-08-17T17:34:23.555854+0000","last_clean":"2023-08-17T17:34:23.555854+0000","last_became_active":"2023-08-17T17:34:23.552438+0000","last_became_peered":"2023-08-17T17:34:23.552438+0000","last_unstale":"2023-08-17T17:34:23.555854+0000","last_undegraded":"2023-08-17T17:34:23.555854+0000","last_fullsized":"2023-08-17T17:34:23.555854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537344+0000","last_change":"2023-08-17T17:34:23.190817+0000","last_active":"2023-08-17T17:34:23.537344+0000","last_peered":"2023-08-17T17:34:23.537344+0000","last_clean":"2023-08-17T17:34:23.537344+0000","last_became_active":"2023-08-17T17:34:23.190559+0000","last_became_peered":"2023-08-17T17:34:23.190559+0000","last_unstale":"2023-08-17T17:34:23.537344+0000","last_undegraded":"2023-08-17T17:34:23.537344+0000","last_fullsized":"2023-08-17T17:34:23.537344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556048+0000","last_change":"2023-08-17T17:34:23.553414+0000","last_active":"2023-08-17T17:34:23.556048+0000","last_peered":"2023-08-17T17:34:23.556048+0000","last_clean":"2023-08-17T17:34:23.556048+0000","last_became_active":"2023-08-17T17:34:23.552895+0000","last_became_peered":"2023-08-17T17:34:23.552895+0000","last_unstale":"2023-08-17T17:34:23.556048+0000","last_undegraded":"2023-08-17T17:34:23.556048+0000","last_fullsized":"2023-08-17T17:34:23.556048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553204+0000","last_change":"2023-08-17T17:34:23.190779+0000","last_active":"2023-08-17T17:34:23.553204+0000","last_peered":"2023-08-17T17:34:23.553204+0000","last_clean":"2023-08-17T17:34:23.553204+0000","last_became_active":"2023-08-17T17:34:23.190512+0000","last_became_peered":"2023-08-17T17:34:23.190512+0000","last_unstale":"2023-08-17T17:34:23.553204+0000","last_undegraded":"2023-08-17T17:34:23.553204+0000","last_fullsized":"2023-08-17T17:34:23.553204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551327+0000","last_change":"2023-08-17T17:34:23.549278+0000","last_active":"2023-08-17T17:34:23.551327+0000","last_peered":"2023-08-17T17:34:23.551327+0000","last_clean":"2023-08-17T17:34:23.551327+0000","last_became_active":"2023-08-17T17:34:23.548986+0000","last_became_peered":"2023-08-17T17:34:23.548986+0000","last_unstale":"2023-08-17T17:34:23.551327+0000","last_undegraded":"2023-08-17T17:34:23.551327+0000","last_fullsized":"2023-08-17T17:34:23.551327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.559755+0000","last_change":"2023-08-17T17:34:23.186530+0000","last_active":"2023-08-17T17:34:23.559755+0000","last_peered":"2023-08-17T17:34:23.559755+0000","last_clean":"2023-08-17T17:34:23.559755+0000","last_became_active":"2023-08-17T17:34:23.186269+0000","last_became_peered":"2023-08-17T17:34:23.186269+0000","last_unstale":"2023-08-17T17:34:23.559755+0000","last_undegraded":"2023-08-17T17:34:23.559755+0000","last_fullsized":"2023-08-17T17:34:23.559755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554062+0000","last_change":"2023-08-17T17:34:23.549760+0000","last_active":"2023-08-17T17:34:23.554062+0000","last_peered":"2023-08-17T17:34:23.554062+0000","last_clean":"2023-08-17T17:34:23.554062+0000","last_became_active":"2023-08-17T17:34:23.549485+0000","last_became_peered":"2023-08-17T17:34:23.549485+0000","last_unstale":"2023-08-17T17:34:23.554062+0000","last_undegraded":"2023-08-17T17:34:23.554062+0000","last_fullsized":"2023-08-17T17:34:23.554062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547751+0000","last_change":"2023-08-17T17:34:23.185767+0000","last_active":"2023-08-17T17:34:23.547751+0000","last_peered":"2023-08-17T17:34:23.547751+0000","last_clean":"2023-08-17T17:34:23.547751+0000","last_became_active":"2023-08-17T17:34:23.185523+0000","last_became_peered":"2023-08-17T17:34:23.185523+0000","last_unstale":"2023-08-17T17:34:23.547751+0000","last_undegraded":"2023-08-17T17:34:23.547751+0000","last_fullsized":"2023-08-17T17:34:23.547751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552869+0000","last_change":"2023-08-17T17:34:23.550201+0000","last_active":"2023-08-17T17:34:23.552869+0000","last_peered":"2023-08-17T17:34:23.552869+0000","last_clean":"2023-08-17T17:34:23.552869+0000","last_became_active":"2023-08-17T17:34:23.550017+0000","last_became_peered":"2023-08-17T17:34:23.550017+0000","last_unstale":"2023-08-17T17:34:23.552869+0000","last_undegraded":"2023-08-17T17:34:23.552869+0000","last_fullsized":"2023-08-17T17:34:23.552869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.544892+0000","last_change":"2023-08-17T17:34:23.184375+0000","last_active":"2023-08-17T17:34:23.544892+0000","last_peered":"2023-08-17T17:34:23.544892+0000","last_clean":"2023-08-17T17:34:23.544892+0000","last_became_active":"2023-08-17T17:34:23.184095+0000","last_became_peered":"2023-08-17T17:34:23.184095+0000","last_unstale":"2023-08-17T17:34:23.544892+0000","last_undegraded":"2023-08-17T17:34:23.544892+0000","last_fullsized":"2023-08-17T17:34:23.544892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557463+0000","last_change":"2023-08-17T17:34:23.544840+0000","last_active":"2023-08-17T17:34:23.557463+0000","last_peered":"2023-08-17T17:34:23.557463+0000","last_clean":"2023-08-17T17:34:23.557463+0000","last_became_active":"2023-08-17T17:34:23.544381+0000","last_became_peered":"2023-08-17T17:34:23.544381+0000","last_unstale":"2023-08-17T17:34:23.557463+0000","last_undegraded":"2023-08-17T17:34:23.557463+0000","last_fullsized":"2023-08-17T17:34:23.557463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535353+0000","last_change":"2023-08-17T17:34:23.181210+0000","last_active":"2023-08-17T17:34:23.535353+0000","last_peered":"2023-08-17T17:34:23.535353+0000","last_clean":"2023-08-17T17:34:23.535353+0000","last_became_active":"2023-08-17T17:34:23.180969+0000","last_became_peered":"2023-08-17T17:34:23.180969+0000","last_unstale":"2023-08-17T17:34:23.535353+0000","last_undegraded":"2023-08-17T17:34:23.535353+0000","last_fullsized":"2023-08-17T17:34:23.535353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.550540+0000","last_change":"2023-08-17T17:34:23.548247+0000","last_active":"2023-08-17T17:34:23.550540+0000","last_peered":"2023-08-17T17:34:23.550540+0000","last_clean":"2023-08-17T17:34:23.550540+0000","last_became_active":"2023-08-17T17:34:23.547379+0000","last_became_peered":"2023-08-17T17:34:23.547379+0000","last_unstale":"2023-08-17T17:34:23.550540+0000","last_undegraded":"2023-08-17T17:34:23.550540+0000","last_fullsized":"2023-08-17T17:34:23.550540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536842+0000","last_change":"2023-08-17T17:34:23.185419+0000","last_active":"2023-08-17T17:34:23.536842+0000","last_peered":"2023-08-17T17:34:23.536842+0000","last_clean":"2023-08-17T17:34:23.536842+0000","last_became_active":"2023-08-17T17:34:23.184865+0000","last_became_peered":"2023-08-17T17:34:23.184865+0000","last_unstale":"2023-08-17T17:34:23.536842+0000","last_undegraded":"2023-08-17T17:34:23.536842+0000","last_fullsized":"2023-08-17T17:34:23.536842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553350+0000","last_change":"2023-08-17T17:34:23.544643+0000","last_active":"2023-08-17T17:34:23.553350+0000","last_peered":"2023-08-17T17:34:23.553350+0000","last_clean":"2023-08-17T17:34:23.553350+0000","last_became_active":"2023-08-17T17:34:23.544406+0000","last_became_peered":"2023-08-17T17:34:23.544406+0000","last_unstale":"2023-08-17T17:34:23.553350+0000","last_undegraded":"2023-08-17T17:34:23.553350+0000","last_fullsized":"2023-08-17T17:34:23.553350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536734+0000","last_change":"2023-08-17T17:34:23.186776+0000","last_active":"2023-08-17T17:34:23.536734+0000","last_peered":"2023-08-17T17:34:23.536734+0000","last_clean":"2023-08-17T17:34:23.536734+0000","last_became_active":"2023-08-17T17:34:23.186521+0000","last_became_peered":"2023-08-17T17:34:23.186521+0000","last_unstale":"2023-08-17T17:34:23.536734+0000","last_undegraded":"2023-08-17T17:34:23.536734+0000","last_fullsized":"2023-08-17T17:34:23.536734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561721+0000","last_change":"2023-08-17T17:34:23.560630+0000","last_active":"2023-08-17T17:34:23.561721+0000","last_peered":"2023-08-17T17:34:23.561721+0000","last_clean":"2023-08-17T17:34:23.561721+0000","last_became_active":"2023-08-17T17:34:23.560282+0000","last_became_peered":"2023-08-17T17:34:23.560282+0000","last_unstale":"2023-08-17T17:34:23.561721+0000","last_undegraded":"2023-08-17T17:34:23.561721+0000","last_fullsized":"2023-08-17T17:34:23.561721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552036+0000","last_change":"2023-08-17T17:34:23.191397+0000","last_active":"2023-08-17T17:34:23.552036+0000","last_peered":"2023-08-17T17:34:23.552036+0000","last_clean":"2023-08-17T17:34:23.552036+0000","last_became_active":"2023-08-17T17:34:23.191058+0000","last_became_peered":"2023-08-17T17:34:23.191058+0000","last_unstale":"2023-08-17T17:34:23.552036+0000","last_undegraded":"2023-08-17T17:34:23.552036+0000","last_fullsized":"2023-08-17T17:34:23.552036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556066+0000","last_change":"2023-08-17T17:34:23.553590+0000","last_active":"2023-08-17T17:34:23.556066+0000","last_peered":"2023-08-17T17:34:23.556066+0000","last_clean":"2023-08-17T17:34:23.556066+0000","last_became_active":"2023-08-17T17:34:23.552092+0000","last_became_peered":"2023-08-17T17:34:23.552092+0000","last_unstale":"2023-08-17T17:34:23.556066+0000","last_undegraded":"2023-08-17T17:34:23.556066+0000","last_fullsized":"2023-08-17T17:34:23.556066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533621+0000","last_change":"2023-08-17T17:34:23.191260+0000","last_active":"2023-08-17T17:34:23.533621+0000","last_peered":"2023-08-17T17:34:23.533621+0000","last_clean":"2023-08-17T17:34:23.533621+0000","last_became_active":"2023-08-17T17:34:23.190994+0000","last_became_peered":"2023-08-17T17:34:23.190994+0000","last_unstale":"2023-08-17T17:34:23.533621+0000","last_undegraded":"2023-08-17T17:34:23.533621+0000","last_fullsized":"2023-08-17T17:34:23.533621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561214+0000","last_change":"2023-08-17T17:34:23.556967+0000","last_active":"2023-08-17T17:34:23.561214+0000","last_peered":"2023-08-17T17:34:23.561214+0000","last_clean":"2023-08-17T17:34:23.561214+0000","last_became_active":"2023-08-17T17:34:23.556712+0000","last_became_peered":"2023-08-17T17:34:23.556712+0000","last_unstale":"2023-08-17T17:34:23.561214+0000","last_undegraded":"2023-08-17T17:34:23.561214+0000","last_fullsized":"2023-08-17T17:34:23.561214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-17T17:34:26.318699+0000","last_change":"2023-08-17T17:34:23.189238+0000","last_active":"2023-08-17T17:34:26.318699+0000","last_peered":"2023-08-17T17:34:26.318699+0000","last_clean":"2023-08-17T17:34:26.318699+0000","last_became_active":"2023-08-17T17:34:23.188964+0000","last_became_peered":"2023-08-17T17:34:23.188964+0000","last_unstale":"2023-08-17T17:34:26.318699+0000","last_undegraded":"2023-08-17T17:34:26.318699+0000","last_fullsized":"2023-08-17T17:34:26.318699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556723+0000","last_change":"2023-08-17T17:34:23.549243+0000","last_active":"2023-08-17T17:34:23.556723+0000","last_peered":"2023-08-17T17:34:23.556723+0000","last_clean":"2023-08-17T17:34:23.556723+0000","last_became_active":"2023-08-17T17:34:23.548966+0000","last_became_peered":"2023-08-17T17:34:23.548966+0000","last_unstale":"2023-08-17T17:34:23.556723+0000","last_undegraded":"2023-08-17T17:34:23.556723+0000","last_fullsized":"2023-08-17T17:34:23.556723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553705+0000","last_change":"2023-08-17T17:34:23.189039+0000","last_active":"2023-08-17T17:34:23.553705+0000","last_peered":"2023-08-17T17:34:23.553705+0000","last_clean":"2023-08-17T17:34:23.553705+0000","last_became_active":"2023-08-17T17:34:23.188785+0000","last_became_peered":"2023-08-17T17:34:23.188785+0000","last_unstale":"2023-08-17T17:34:23.553705+0000","last_undegraded":"2023-08-17T17:34:23.553705+0000","last_fullsized":"2023-08-17T17:34:23.553705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556711+0000","last_change":"2023-08-17T17:34:23.555845+0000","last_active":"2023-08-17T17:34:23.556711+0000","last_peered":"2023-08-17T17:34:23.556711+0000","last_clean":"2023-08-17T17:34:23.556711+0000","last_became_active":"2023-08-17T17:34:23.555604+0000","last_became_peered":"2023-08-17T17:34:23.555604+0000","last_unstale":"2023-08-17T17:34:23.556711+0000","last_undegraded":"2023-08-17T17:34:23.556711+0000","last_fullsized":"2023-08-17T17:34:23.556711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.538052+0000","last_change":"2023-08-17T17:34:23.187717+0000","last_active":"2023-08-17T17:34:23.538052+0000","last_peered":"2023-08-17T17:34:23.538052+0000","last_clean":"2023-08-17T17:34:23.538052+0000","last_became_active":"2023-08-17T17:34:23.184648+0000","last_became_peered":"2023-08-17T17:34:23.184648+0000","last_unstale":"2023-08-17T17:34:23.538052+0000","last_undegraded":"2023-08-17T17:34:23.538052+0000","last_fullsized":"2023-08-17T17:34:23.538052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555978+0000","last_change":"2023-08-17T17:34:23.552413+0000","last_active":"2023-08-17T17:34:23.555978+0000","last_peered":"2023-08-17T17:34:23.555978+0000","last_clean":"2023-08-17T17:34:23.555978+0000","last_became_active":"2023-08-17T17:34:23.552087+0000","last_became_peered":"2023-08-17T17:34:23.552087+0000","last_unstale":"2023-08-17T17:34:23.555978+0000","last_undegraded":"2023-08-17T17:34:23.555978+0000","last_fullsized":"2023-08-17T17:34:23.555978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554478+0000","last_change":"2023-08-17T17:34:23.189135+0000","last_active":"2023-08-17T17:34:23.554478+0000","last_peered":"2023-08-17T17:34:23.554478+0000","last_clean":"2023-08-17T17:34:23.554478+0000","last_became_active":"2023-08-17T17:34:23.188880+0000","last_became_peered":"2023-08-17T17:34:23.188880+0000","last_unstale":"2023-08-17T17:34:23.554478+0000","last_undegraded":"2023-08-17T17:34:23.554478+0000","last_fullsized":"2023-08-17T17:34:23.554478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.551405+0000","last_change":"2023-08-17T17:34:23.549370+0000","last_active":"2023-08-17T17:34:23.551405+0000","last_peered":"2023-08-17T17:34:23.551405+0000","last_clean":"2023-08-17T17:34:23.551405+0000","last_became_active":"2023-08-17T17:34:23.549106+0000","last_became_peered":"2023-08-17T17:34:23.549106+0000","last_unstale":"2023-08-17T17:34:23.551405+0000","last_undegraded":"2023-08-17T17:34:23.551405+0000","last_fullsized":"2023-08-17T17:34:23.551405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537049+0000","last_change":"2023-08-17T17:34:23.188935+0000","last_active":"2023-08-17T17:34:23.537049+0000","last_peered":"2023-08-17T17:34:23.537049+0000","last_clean":"2023-08-17T17:34:23.537049+0000","last_became_active":"2023-08-17T17:34:23.188377+0000","last_became_peered":"2023-08-17T17:34:23.188377+0000","last_unstale":"2023-08-17T17:34:23.537049+0000","last_undegraded":"2023-08-17T17:34:23.537049+0000","last_fullsized":"2023-08-17T17:34:23.537049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556432+0000","last_change":"2023-08-17T17:34:23.555082+0000","last_active":"2023-08-17T17:34:23.556432+0000","last_peered":"2023-08-17T17:34:23.556432+0000","last_clean":"2023-08-17T17:34:23.556432+0000","last_became_active":"2023-08-17T17:34:23.554814+0000","last_became_peered":"2023-08-17T17:34:23.554814+0000","last_unstale":"2023-08-17T17:34:23.556432+0000","last_undegraded":"2023-08-17T17:34:23.556432+0000","last_fullsized":"2023-08-17T17:34:23.556432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.552365+0000","last_change":"2023-08-17T17:34:23.190120+0000","last_active":"2023-08-17T17:34:23.552365+0000","last_peered":"2023-08-17T17:34:23.552365+0000","last_clean":"2023-08-17T17:34:23.552365+0000","last_became_active":"2023-08-17T17:34:23.189569+0000","last_became_peered":"2023-08-17T17:34:23.189569+0000","last_unstale":"2023-08-17T17:34:23.552365+0000","last_undegraded":"2023-08-17T17:34:23.552365+0000","last_fullsized":"2023-08-17T17:34:23.552365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.565228+0000","last_change":"2023-08-17T17:34:23.561106+0000","last_active":"2023-08-17T17:34:23.565228+0000","last_peered":"2023-08-17T17:34:23.565228+0000","last_clean":"2023-08-17T17:34:23.565228+0000","last_became_active":"2023-08-17T17:34:23.560898+0000","last_became_peered":"2023-08-17T17:34:23.560898+0000","last_unstale":"2023-08-17T17:34:23.565228+0000","last_undegraded":"2023-08-17T17:34:23.565228+0000","last_fullsized":"2023-08-17T17:34:23.565228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543062+0000","last_change":"2023-08-17T17:34:23.198065+0000","last_active":"2023-08-17T17:34:23.543062+0000","last_peered":"2023-08-17T17:34:23.543062+0000","last_clean":"2023-08-17T17:34:23.543062+0000","last_became_active":"2023-08-17T17:34:23.197731+0000","last_became_peered":"2023-08-17T17:34:23.197731+0000","last_unstale":"2023-08-17T17:34:23.543062+0000","last_undegraded":"2023-08-17T17:34:23.543062+0000","last_fullsized":"2023-08-17T17:34:23.543062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553514+0000","last_change":"2023-08-17T17:34:23.547875+0000","last_active":"2023-08-17T17:34:23.553514+0000","last_peered":"2023-08-17T17:34:23.553514+0000","last_clean":"2023-08-17T17:34:23.553514+0000","last_became_active":"2023-08-17T17:34:23.547593+0000","last_became_peered":"2023-08-17T17:34:23.547593+0000","last_unstale":"2023-08-17T17:34:23.553514+0000","last_undegraded":"2023-08-17T17:34:23.553514+0000","last_fullsized":"2023-08-17T17:34:23.553514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557302+0000","last_change":"2023-08-17T17:34:23.190210+0000","last_active":"2023-08-17T17:34:23.557302+0000","last_peered":"2023-08-17T17:34:23.557302+0000","last_clean":"2023-08-17T17:34:23.557302+0000","last_became_active":"2023-08-17T17:34:23.189745+0000","last_became_peered":"2023-08-17T17:34:23.189745+0000","last_unstale":"2023-08-17T17:34:23.557302+0000","last_undegraded":"2023-08-17T17:34:23.557302+0000","last_fullsized":"2023-08-17T17:34:23.557302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561762+0000","last_change":"2023-08-17T17:34:23.555242+0000","last_active":"2023-08-17T17:34:23.561762+0000","last_peered":"2023-08-17T17:34:23.561762+0000","last_clean":"2023-08-17T17:34:23.561762+0000","last_became_active":"2023-08-17T17:34:23.554975+0000","last_became_peered":"2023-08-17T17:34:23.554975+0000","last_unstale":"2023-08-17T17:34:23.561762+0000","last_undegraded":"2023-08-17T17:34:23.561762+0000","last_fullsized":"2023-08-17T17:34:23.561762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.535659+0000","last_change":"2023-08-17T17:34:23.186514+0000","last_active":"2023-08-17T17:34:23.535659+0000","last_peered":"2023-08-17T17:34:23.535659+0000","last_clean":"2023-08-17T17:34:23.535659+0000","last_became_active":"2023-08-17T17:34:23.186237+0000","last_became_peered":"2023-08-17T17:34:23.186237+0000","last_unstale":"2023-08-17T17:34:23.535659+0000","last_undegraded":"2023-08-17T17:34:23.535659+0000","last_fullsized":"2023-08-17T17:34:23.535659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557448+0000","last_change":"2023-08-17T17:34:23.556160+0000","last_active":"2023-08-17T17:34:23.557448+0000","last_peered":"2023-08-17T17:34:23.557448+0000","last_clean":"2023-08-17T17:34:23.557448+0000","last_became_active":"2023-08-17T17:34:23.555906+0000","last_became_peered":"2023-08-17T17:34:23.555906+0000","last_unstale":"2023-08-17T17:34:23.557448+0000","last_undegraded":"2023-08-17T17:34:23.557448+0000","last_fullsized":"2023-08-17T17:34:23.557448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537668+0000","last_change":"2023-08-17T17:34:23.188736+0000","last_active":"2023-08-17T17:34:23.537668+0000","last_peered":"2023-08-17T17:34:23.537668+0000","last_clean":"2023-08-17T17:34:23.537668+0000","last_became_active":"2023-08-17T17:34:23.188463+0000","last_became_peered":"2023-08-17T17:34:23.188463+0000","last_unstale":"2023-08-17T17:34:23.537668+0000","last_undegraded":"2023-08-17T17:34:23.537668+0000","last_fullsized":"2023-08-17T17:34:23.537668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556730+0000","last_change":"2023-08-17T17:34:23.556037+0000","last_active":"2023-08-17T17:34:23.556730+0000","last_peered":"2023-08-17T17:34:23.556730+0000","last_clean":"2023-08-17T17:34:23.556730+0000","last_became_active":"2023-08-17T17:34:23.555773+0000","last_became_peered":"2023-08-17T17:34:23.555773+0000","last_unstale":"2023-08-17T17:34:23.556730+0000","last_undegraded":"2023-08-17T17:34:23.556730+0000","last_fullsized":"2023-08-17T17:34:23.556730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555701+0000","last_change":"2023-08-17T17:34:23.182339+0000","last_active":"2023-08-17T17:34:23.555701+0000","last_peered":"2023-08-17T17:34:23.555701+0000","last_clean":"2023-08-17T17:34:23.555701+0000","last_became_active":"2023-08-17T17:34:23.182072+0000","last_became_peered":"2023-08-17T17:34:23.182072+0000","last_unstale":"2023-08-17T17:34:23.555701+0000","last_undegraded":"2023-08-17T17:34:23.555701+0000","last_fullsized":"2023-08-17T17:34:23.555701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547106+0000","last_change":"2023-08-17T17:34:23.540248+0000","last_active":"2023-08-17T17:34:23.547106+0000","last_peered":"2023-08-17T17:34:23.547106+0000","last_clean":"2023-08-17T17:34:23.547106+0000","last_became_active":"2023-08-17T17:34:23.539612+0000","last_became_peered":"2023-08-17T17:34:23.539612+0000","last_unstale":"2023-08-17T17:34:23.547106+0000","last_undegraded":"2023-08-17T17:34:23.547106+0000","last_fullsized":"2023-08-17T17:34:23.547106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533235+0000","last_change":"2023-08-17T17:34:23.191957+0000","last_active":"2023-08-17T17:34:23.533235+0000","last_peered":"2023-08-17T17:34:23.533235+0000","last_clean":"2023-08-17T17:34:23.533235+0000","last_became_active":"2023-08-17T17:34:23.191666+0000","last_became_peered":"2023-08-17T17:34:23.191666+0000","last_unstale":"2023-08-17T17:34:23.533235+0000","last_undegraded":"2023-08-17T17:34:23.533235+0000","last_fullsized":"2023-08-17T17:34:23.533235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556313+0000","last_change":"2023-08-17T17:34:23.553646+0000","last_active":"2023-08-17T17:34:23.556313+0000","last_peered":"2023-08-17T17:34:23.556313+0000","last_clean":"2023-08-17T17:34:23.556313+0000","last_became_active":"2023-08-17T17:34:23.553378+0000","last_became_peered":"2023-08-17T17:34:23.553378+0000","last_unstale":"2023-08-17T17:34:23.556313+0000","last_undegraded":"2023-08-17T17:34:23.556313+0000","last_fullsized":"2023-08-17T17:34:23.556313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.536649+0000","last_change":"2023-08-17T17:34:23.191017+0000","last_active":"2023-08-17T17:34:23.536649+0000","last_peered":"2023-08-17T17:34:23.536649+0000","last_clean":"2023-08-17T17:34:23.536649+0000","last_became_active":"2023-08-17T17:34:23.190761+0000","last_became_peered":"2023-08-17T17:34:23.190761+0000","last_unstale":"2023-08-17T17:34:23.536649+0000","last_undegraded":"2023-08-17T17:34:23.536649+0000","last_fullsized":"2023-08-17T17:34:23.536649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556028+0000","last_change":"2023-08-17T17:34:23.552814+0000","last_active":"2023-08-17T17:34:23.556028+0000","last_peered":"2023-08-17T17:34:23.556028+0000","last_clean":"2023-08-17T17:34:23.556028+0000","last_became_active":"2023-08-17T17:34:23.552549+0000","last_became_peered":"2023-08-17T17:34:23.552549+0000","last_unstale":"2023-08-17T17:34:23.556028+0000","last_undegraded":"2023-08-17T17:34:23.556028+0000","last_fullsized":"2023-08-17T17:34:23.556028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.560981+0000","last_change":"2023-08-17T17:34:23.184359+0000","last_active":"2023-08-17T17:34:23.560981+0000","last_peered":"2023-08-17T17:34:23.560981+0000","last_clean":"2023-08-17T17:34:23.560981+0000","last_became_active":"2023-08-17T17:34:23.183723+0000","last_became_peered":"2023-08-17T17:34:23.183723+0000","last_unstale":"2023-08-17T17:34:23.560981+0000","last_undegraded":"2023-08-17T17:34:23.560981+0000","last_fullsized":"2023-08-17T17:34:23.560981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555985+0000","last_change":"2023-08-17T17:34:23.551730+0000","last_active":"2023-08-17T17:34:23.555985+0000","last_peered":"2023-08-17T17:34:23.555985+0000","last_clean":"2023-08-17T17:34:23.555985+0000","last_became_active":"2023-08-17T17:34:23.551463+0000","last_became_peered":"2023-08-17T17:34:23.551463+0000","last_unstale":"2023-08-17T17:34:23.555985+0000","last_undegraded":"2023-08-17T17:34:23.555985+0000","last_fullsized":"2023-08-17T17:34:23.555985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.562820+0000","last_change":"2023-08-17T17:34:23.189962+0000","last_active":"2023-08-17T17:34:23.562820+0000","last_peered":"2023-08-17T17:34:23.562820+0000","last_clean":"2023-08-17T17:34:23.562820+0000","last_became_active":"2023-08-17T17:34:23.189247+0000","last_became_peered":"2023-08-17T17:34:23.189247+0000","last_unstale":"2023-08-17T17:34:23.562820+0000","last_undegraded":"2023-08-17T17:34:23.562820+0000","last_fullsized":"2023-08-17T17:34:23.562820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547521+0000","last_change":"2023-08-17T17:34:23.542831+0000","last_active":"2023-08-17T17:34:23.547521+0000","last_peered":"2023-08-17T17:34:23.547521+0000","last_clean":"2023-08-17T17:34:23.547521+0000","last_became_active":"2023-08-17T17:34:23.542564+0000","last_became_peered":"2023-08-17T17:34:23.542564+0000","last_unstale":"2023-08-17T17:34:23.547521+0000","last_undegraded":"2023-08-17T17:34:23.547521+0000","last_fullsized":"2023-08-17T17:34:23.547521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543908+0000","last_change":"2023-08-17T17:34:23.193784+0000","last_active":"2023-08-17T17:34:23.543908+0000","last_peered":"2023-08-17T17:34:23.543908+0000","last_clean":"2023-08-17T17:34:23.543908+0000","last_became_active":"2023-08-17T17:34:23.193515+0000","last_became_peered":"2023-08-17T17:34:23.193515+0000","last_unstale":"2023-08-17T17:34:23.543908+0000","last_undegraded":"2023-08-17T17:34:23.543908+0000","last_fullsized":"2023-08-17T17:34:23.543908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.562719+0000","last_change":"2023-08-17T17:34:23.559293+0000","last_active":"2023-08-17T17:34:23.562719+0000","last_peered":"2023-08-17T17:34:23.562719+0000","last_clean":"2023-08-17T17:34:23.562719+0000","last_became_active":"2023-08-17T17:34:23.559072+0000","last_became_peered":"2023-08-17T17:34:23.559072+0000","last_unstale":"2023-08-17T17:34:23.562719+0000","last_undegraded":"2023-08-17T17:34:23.562719+0000","last_fullsized":"2023-08-17T17:34:23.562719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.543183+0000","last_change":"2023-08-17T17:34:23.191570+0000","last_active":"2023-08-17T17:34:23.543183+0000","last_peered":"2023-08-17T17:34:23.543183+0000","last_clean":"2023-08-17T17:34:23.543183+0000","last_became_active":"2023-08-17T17:34:23.191127+0000","last_became_peered":"2023-08-17T17:34:23.191127+0000","last_unstale":"2023-08-17T17:34:23.543183+0000","last_undegraded":"2023-08-17T17:34:23.543183+0000","last_fullsized":"2023-08-17T17:34:23.543183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554026+0000","last_change":"2023-08-17T17:34:23.548523+0000","last_active":"2023-08-17T17:34:23.554026+0000","last_peered":"2023-08-17T17:34:23.554026+0000","last_clean":"2023-08-17T17:34:23.554026+0000","last_became_active":"2023-08-17T17:34:23.548180+0000","last_became_peered":"2023-08-17T17:34:23.548180+0000","last_unstale":"2023-08-17T17:34:23.554026+0000","last_undegraded":"2023-08-17T17:34:23.554026+0000","last_fullsized":"2023-08-17T17:34:23.554026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.541743+0000","last_change":"2023-08-17T17:34:23.193931+0000","last_active":"2023-08-17T17:34:23.541743+0000","last_peered":"2023-08-17T17:34:23.541743+0000","last_clean":"2023-08-17T17:34:23.541743+0000","last_became_active":"2023-08-17T17:34:23.193104+0000","last_became_peered":"2023-08-17T17:34:23.193104+0000","last_unstale":"2023-08-17T17:34:23.541743+0000","last_undegraded":"2023-08-17T17:34:23.541743+0000","last_fullsized":"2023-08-17T17:34:23.541743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.555975+0000","last_change":"2023-08-17T17:34:23.551080+0000","last_active":"2023-08-17T17:34:23.555975+0000","last_peered":"2023-08-17T17:34:23.555975+0000","last_clean":"2023-08-17T17:34:23.555975+0000","last_became_active":"2023-08-17T17:34:23.550830+0000","last_became_peered":"2023-08-17T17:34:23.550830+0000","last_unstale":"2023-08-17T17:34:23.555975+0000","last_undegraded":"2023-08-17T17:34:23.555975+0000","last_fullsized":"2023-08-17T17:34:23.555975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553243+0000","last_change":"2023-08-17T17:34:23.182626+0000","last_active":"2023-08-17T17:34:23.553243+0000","last_peered":"2023-08-17T17:34:23.553243+0000","last_clean":"2023-08-17T17:34:23.553243+0000","last_became_active":"2023-08-17T17:34:23.182368+0000","last_became_peered":"2023-08-17T17:34:23.182368+0000","last_unstale":"2023-08-17T17:34:23.553243+0000","last_undegraded":"2023-08-17T17:34:23.553243+0000","last_fullsized":"2023-08-17T17:34:23.553243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.547126+0000","last_change":"2023-08-17T17:34:23.540567+0000","last_active":"2023-08-17T17:34:23.547126+0000","last_peered":"2023-08-17T17:34:23.547126+0000","last_clean":"2023-08-17T17:34:23.547126+0000","last_became_active":"2023-08-17T17:34:23.539925+0000","last_became_peered":"2023-08-17T17:34:23.539925+0000","last_unstale":"2023-08-17T17:34:23.547126+0000","last_undegraded":"2023-08-17T17:34:23.547126+0000","last_fullsized":"2023-08-17T17:34:23.547126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.545585+0000","last_change":"2023-08-17T17:34:23.194479+0000","last_active":"2023-08-17T17:34:23.545585+0000","last_peered":"2023-08-17T17:34:23.545585+0000","last_clean":"2023-08-17T17:34:23.545585+0000","last_became_active":"2023-08-17T17:34:23.194196+0000","last_became_peered":"2023-08-17T17:34:23.194196+0000","last_unstale":"2023-08-17T17:34:23.545585+0000","last_undegraded":"2023-08-17T17:34:23.545585+0000","last_fullsized":"2023-08-17T17:34:23.545585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556322+0000","last_change":"2023-08-17T17:34:23.553805+0000","last_active":"2023-08-17T17:34:23.556322+0000","last_peered":"2023-08-17T17:34:23.556322+0000","last_clean":"2023-08-17T17:34:23.556322+0000","last_became_active":"2023-08-17T17:34:23.553524+0000","last_became_peered":"2023-08-17T17:34:23.553524+0000","last_unstale":"2023-08-17T17:34:23.556322+0000","last_undegraded":"2023-08-17T17:34:23.556322+0000","last_fullsized":"2023-08-17T17:34:23.556322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553107+0000","last_change":"2023-08-17T17:34:23.184707+0000","last_active":"2023-08-17T17:34:23.553107+0000","last_peered":"2023-08-17T17:34:23.553107+0000","last_clean":"2023-08-17T17:34:23.553107+0000","last_became_active":"2023-08-17T17:34:23.184244+0000","last_became_peered":"2023-08-17T17:34:23.184244+0000","last_unstale":"2023-08-17T17:34:23.553107+0000","last_undegraded":"2023-08-17T17:34:23.553107+0000","last_fullsized":"2023-08-17T17:34:23.553107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.562691+0000","last_change":"2023-08-17T17:34:23.558704+0000","last_active":"2023-08-17T17:34:23.562691+0000","last_peered":"2023-08-17T17:34:23.562691+0000","last_clean":"2023-08-17T17:34:23.562691+0000","last_became_active":"2023-08-17T17:34:23.558374+0000","last_became_peered":"2023-08-17T17:34:23.558374+0000","last_unstale":"2023-08-17T17:34:23.562691+0000","last_undegraded":"2023-08-17T17:34:23.562691+0000","last_fullsized":"2023-08-17T17:34:23.562691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557028+0000","last_change":"2023-08-17T17:34:23.190318+0000","last_active":"2023-08-17T17:34:23.557028+0000","last_peered":"2023-08-17T17:34:23.557028+0000","last_clean":"2023-08-17T17:34:23.557028+0000","last_became_active":"2023-08-17T17:34:23.190011+0000","last_became_peered":"2023-08-17T17:34:23.190011+0000","last_unstale":"2023-08-17T17:34:23.557028+0000","last_undegraded":"2023-08-17T17:34:23.557028+0000","last_fullsized":"2023-08-17T17:34:23.557028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.553785+0000","last_change":"2023-08-17T17:34:23.552175+0000","last_active":"2023-08-17T17:34:23.553785+0000","last_peered":"2023-08-17T17:34:23.553785+0000","last_clean":"2023-08-17T17:34:23.553785+0000","last_became_active":"2023-08-17T17:34:23.551927+0000","last_became_peered":"2023-08-17T17:34:23.551927+0000","last_unstale":"2023-08-17T17:34:23.553785+0000","last_undegraded":"2023-08-17T17:34:23.553785+0000","last_fullsized":"2023-08-17T17:34:23.553785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.561308+0000","last_change":"2023-08-17T17:34:23.184913+0000","last_active":"2023-08-17T17:34:23.561308+0000","last_peered":"2023-08-17T17:34:23.561308+0000","last_clean":"2023-08-17T17:34:23.561308+0000","last_became_active":"2023-08-17T17:34:23.184622+0000","last_became_peered":"2023-08-17T17:34:23.184622+0000","last_unstale":"2023-08-17T17:34:23.561308+0000","last_undegraded":"2023-08-17T17:34:23.561308+0000","last_fullsized":"2023-08-17T17:34:23.561308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.556497+0000","last_change":"2023-08-17T17:34:23.555151+0000","last_active":"2023-08-17T17:34:23.556497+0000","last_peered":"2023-08-17T17:34:23.556497+0000","last_clean":"2023-08-17T17:34:23.556497+0000","last_became_active":"2023-08-17T17:34:23.554868+0000","last_became_peered":"2023-08-17T17:34:23.554868+0000","last_unstale":"2023-08-17T17:34:23.556497+0000","last_undegraded":"2023-08-17T17:34:23.556497+0000","last_fullsized":"2023-08-17T17:34:23.556497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.537732+0000","last_change":"2023-08-17T17:34:23.189742+0000","last_active":"2023-08-17T17:34:23.537732+0000","last_peered":"2023-08-17T17:34:23.537732+0000","last_clean":"2023-08-17T17:34:23.537732+0000","last_became_active":"2023-08-17T17:34:23.189466+0000","last_became_peered":"2023-08-17T17:34:23.189466+0000","last_unstale":"2023-08-17T17:34:23.537732+0000","last_undegraded":"2023-08-17T17:34:23.537732+0000","last_fullsized":"2023-08-17T17:34:23.537732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557135+0000","last_change":"2023-08-17T17:34:23.553968+0000","last_active":"2023-08-17T17:34:23.557135+0000","last_peered":"2023-08-17T17:34:23.557135+0000","last_clean":"2023-08-17T17:34:23.557135+0000","last_became_active":"2023-08-17T17:34:23.552409+0000","last_became_peered":"2023-08-17T17:34:23.552409+0000","last_unstale":"2023-08-17T17:34:23.557135+0000","last_undegraded":"2023-08-17T17:34:23.557135+0000","last_fullsized":"2023-08-17T17:34:23.557135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.533930+0000","last_change":"2023-08-17T17:34:23.189070+0000","last_active":"2023-08-17T17:34:23.533930+0000","last_peered":"2023-08-17T17:34:23.533930+0000","last_clean":"2023-08-17T17:34:23.533930+0000","last_became_active":"2023-08-17T17:34:23.188771+0000","last_became_peered":"2023-08-17T17:34:23.188771+0000","last_unstale":"2023-08-17T17:34:23.533930+0000","last_undegraded":"2023-08-17T17:34:23.533930+0000","last_fullsized":"2023-08-17T17:34:23.533930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.554378+0000","last_change":"2023-08-17T17:34:23.549482+0000","last_active":"2023-08-17T17:34:23.554378+0000","last_peered":"2023-08-17T17:34:23.554378+0000","last_clean":"2023-08-17T17:34:23.554378+0000","last_became_active":"2023-08-17T17:34:23.549214+0000","last_became_peered":"2023-08-17T17:34:23.549214+0000","last_unstale":"2023-08-17T17:34:23.554378+0000","last_undegraded":"2023-08-17T17:34:23.554378+0000","last_fullsized":"2023-08-17T17:34:23.554378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:23.163284+0000","last_clean_scrub_stamp":"2023-08-17T17:34:23.163284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T17:34:23.557902+0000","last_change":"2023-08-17T17:34:23.191534+0000","last_active":"2023-08-17T17:34:23.557902+0000","last_peered":"2023-08-17T17:34:23.557902+0000","last_clean":"2023-08-17T17:34:23.557902+0000","last_became_active":"2023-08-17T17:34:23.191251+0000","last_became_peered":"2023-08-17T17:34:23.191251+0000","last_unstale":"2023-08-17T17:34:23.557902+0000","last_undegraded":"2023-08-17T17:34:23.557902+0000","last_fullsized":"2023-08-17T17:34:23.557902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:22.161581+0000","last_clean_scrub_stamp":"2023-08-17T17:34:22.161581+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:34:36.508 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-17T17:34:36.508 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-17T17:34:36.508 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-17T17:34:36.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-17T17:34:36.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.650+0000 7fde577f4700 1 Processor -- start 2023-08-17T17:34:36.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.650+0000 7fde577f4700 1 -- start start 2023-08-17T17:34:36.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.651+0000 7fde577f4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde500bef00 0x7fde50064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.651+0000 7fde577f4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500c4040 con 0x7fde500a7fe0 2023-08-17T17:34:36.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.651+0000 7fde577f4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500c3430 con 0x7fde50065140 2023-08-17T17:34:36.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.651+0000 7fde577f4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde500c3710 con 0x7fde500bef00 2023-08-17T17:34:36.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.651+0000 7fde54d8f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde500bef00 0x7fde50064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.651+0000 7fde55590700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fde500a7fe0 0x7fde500be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38284/0 (socket says 172.21.15.78:38284) 2023-08-17T17:34:36.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.651+0000 7fde55590700 1 -- 172.21.15.78:0/2134376524 learned_addr learned my addr 172.21.15.78:0/2134376524 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:36.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde54d8f700 1 -- 172.21.15.78:0/2134376524 >> v1:172.21.15.150:6789/0 conn(0x7fde50065140 legacy=0x7fde500c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:36.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde54d8f700 1 -- 172.21.15.78:0/2134376524 >> v1:172.21.15.78:6789/0 conn(0x7fde500a7fe0 legacy=0x7fde500be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde54d8f700 1 -- 172.21.15.78:0/2134376524 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500c39f0 con 0x7fde500bef00 2023-08-17T17:34:36.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde54d8f700 1 --2- 172.21.15.78:0/2134376524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 0x7fde50064180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fde40009760 tx=0x7fde40009060).ready entity=mon.0 client_cookie=bf6d1f9facbcd5cc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:36.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde47fff700 1 -- 172.21.15.78:0/2134376524 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000f510 con 0x7fde500bef00 2023-08-17T17:34:36.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde47fff700 1 -- 172.21.15.78:0/2134376524 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4000f670 con 0x7fde500bef00 2023-08-17T17:34:36.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde47fff700 1 -- 172.21.15.78:0/2134376524 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000f9f0 con 0x7fde500bef00 2023-08-17T17:34:36.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde577f4700 1 -- 172.21.15.78:0/2134376524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 msgr2=0x7fde50064180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde577f4700 1 --2- 172.21.15.78:0/2134376524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 0x7fde50064180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fde40009760 tx=0x7fde40009060).stop 2023-08-17T17:34:36.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde577f4700 1 -- 172.21.15.78:0/2134376524 shutdown_connections 2023-08-17T17:34:36.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde577f4700 1 --2- 172.21.15.78:0/2134376524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 0x7fde50064180 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde577f4700 1 -- 172.21.15.78:0/2134376524 >> 172.21.15.78:0/2134376524 conn(0x7fde50092330 msgr2=0x7fde50062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:36.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde577f4700 1 -- 172.21.15.78:0/2134376524 shutdown_connections 2023-08-17T17:34:36.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.652+0000 7fde577f4700 1 -- 172.21.15.78:0/2134376524 wait complete. 2023-08-17T17:34:36.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.654+0000 7fde577f4700 1 Processor -- start 2023-08-17T17:34:36.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.654+0000 7fde577f4700 1 -- start start 2023-08-17T17:34:36.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.654+0000 7fde577f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50065140 0x7fde50147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.654+0000 7fde577f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde500a7fe0 0x7fde500ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.654+0000 7fde577f4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 0x7fde500adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.654+0000 7fde577f4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50156340 con 0x7fde500bef00 2023-08-17T17:34:36.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.654+0000 7fde577f4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500ae440 con 0x7fde50065140 2023-08-17T17:34:36.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.654+0000 7fde577f4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde501556c0 con 0x7fde500a7fe0 2023-08-17T17:34:36.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.654+0000 7fde55d91700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 0x7fde500adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde55d91700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 0x7fde500adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47050/0 (socket says 172.21.15.78:47050) 2023-08-17T17:34:36.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde55d91700 1 -- 172.21.15.78:0/3845878060 learned_addr learned my addr 172.21.15.78:0/3845878060 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde54d8f700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde500a7fe0 0x7fde500ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde55590700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50065140 0x7fde50147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde55d91700 1 -- 172.21.15.78:0/3845878060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde500a7fe0 msgr2=0x7fde500ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde55d91700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde500a7fe0 0x7fde500ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde55d91700 1 -- 172.21.15.78:0/3845878060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50065140 msgr2=0x7fde50147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde55d91700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50065140 0x7fde50147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde55d91700 1 -- 172.21.15.78:0/3845878060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde400092a0 con 0x7fde500bef00 2023-08-17T17:34:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde55d91700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 0x7fde500adf50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fde4800c490 tx=0x7fde48007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde457fa700 1 -- 172.21.15.78:0/3845878060 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48002ea0 con 0x7fde500bef00 2023-08-17T17:34:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde457fa700 1 -- 172.21.15.78:0/3845878060 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4800f470 con 0x7fde500bef00 2023-08-17T17:34:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde577f4700 1 -- 172.21.15.78:0/3845878060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde501559a0 con 0x7fde500bef00 2023-08-17T17:34:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde457fa700 1 -- 172.21.15.78:0/3845878060 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800f810 con 0x7fde500bef00 2023-08-17T17:34:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.655+0000 7fde577f4700 1 -- 172.21.15.78:0/3845878060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde50155f60 con 0x7fde500bef00 2023-08-17T17:34:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.656+0000 7fde577f4700 1 -- 172.21.15.78:0/3845878060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde50069f40 con 0x7fde500bef00 2023-08-17T17:34:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.656+0000 7fde457fa700 1 -- 172.21.15.78:0/3845878060 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fde48010070 con 0x7fde500bef00 2023-08-17T17:34:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.657+0000 7fde457fa700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ed90 0x7fde34061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.657+0000 7fde457fa700 1 -- 172.21.15.78:0/3845878060 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fde48078ec0 con 0x7fde500bef00 2023-08-17T17:34:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.657+0000 7fde55590700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ed90 0x7fde34061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.657+0000 7fde55590700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ed90 0x7fde34061250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fde4c005ad0 tx=0x7fde4c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:36.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.661+0000 7fde457fa700 1 -- 172.21.15.78:0/3845878060 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde480478f0 con 0x7fde500bef00 2023-08-17T17:34:36.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.861+0000 7fde577f4700 1 -- 172.21.15.78:0/3845878060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fde500c3cd0 con 0x7fde500bef00 2023-08-17T17:34:36.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.861+0000 7fde457fa700 1 -- 172.21.15.78:0/3845878060 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fde4804a460 con 0x7fde500bef00 2023-08-17T17:34:36.863 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:36.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.863+0000 7fde577f4700 1 -- 172.21.15.78:0/3845878060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ed90 msgr2=0x7fde34061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.863+0000 7fde577f4700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ed90 0x7fde34061250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fde4c005ad0 tx=0x7fde4c009040).stop 2023-08-17T17:34:36.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.863+0000 7fde577f4700 1 -- 172.21.15.78:0/3845878060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 msgr2=0x7fde500adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.863+0000 7fde577f4700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 0x7fde500adf50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fde4800c490 tx=0x7fde48007de0).stop 2023-08-17T17:34:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.864+0000 7fde577f4700 1 -- 172.21.15.78:0/3845878060 shutdown_connections 2023-08-17T17:34:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.864+0000 7fde577f4700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ed90 0x7fde34061250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.864+0000 7fde577f4700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde500bef00 0x7fde500adf50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.864+0000 7fde577f4700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50065140 0x7fde50147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.864+0000 7fde577f4700 1 --2- 172.21.15.78:0/3845878060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde500a7fe0 0x7fde500ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.864+0000 7fde577f4700 1 -- 172.21.15.78:0/3845878060 >> 172.21.15.78:0/3845878060 conn(0x7fde50092330 msgr2=0x7fde50064700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.864+0000 7fde577f4700 1 -- 172.21.15.78:0/3845878060 shutdown_connections 2023-08-17T17:34:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.864+0000 7fde577f4700 1 -- 172.21.15.78:0/3845878060 wait complete. 2023-08-17T17:34:36.876 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-17T17:34:36.877 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-17T17:34:36.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.988+0000 7f0fc3648700 1 Processor -- start 2023-08-17T17:34:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.989+0000 7f0fc3648700 1 -- start start 2023-08-17T17:34:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.989+0000 7f0fc3648700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 0x7f0fbc064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.989+0000 7f0fc3648700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0fbc0bef00 0x7f0fbc0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.989+0000 7f0fc3648700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc0c4040 con 0x7f0fbc065140 2023-08-17T17:34:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc3648700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c7080 con 0x7f0fbc0bef00 2023-08-17T17:34:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc3648700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c3430 con 0x7f0fbc0a7fe0 2023-08-17T17:34:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc1be5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0fbc0bef00 0x7f0fbc0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc0be3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0fbc065140 0x7f0fbc0be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38288/0 (socket says 172.21.15.78:38288) 2023-08-17T17:34:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc0be3700 1 -- 172.21.15.78:0/2322413768 learned_addr learned my addr 172.21.15.78:0/2322413768 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc13e4700 1 --2- 172.21.15.78:0/2322413768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 0x7f0fbc064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc1be5700 1 -- 172.21.15.78:0/2322413768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 msgr2=0x7f0fbc064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc1be5700 1 --2- 172.21.15.78:0/2322413768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 0x7f0fbc064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc1be5700 1 -- 172.21.15.78:0/2322413768 >> v1:172.21.15.78:6789/0 conn(0x7f0fbc065140 legacy=0x7f0fbc0be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc1be5700 1 -- 172.21.15.78:0/2322413768 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0c3710 con 0x7f0fbc0bef00 2023-08-17T17:34:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fb3fff700 1 -- 172.21.15.78:0/2322413768 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194572556 0 0) 0x7f0fbc0c4040 con 0x7f0fbc065140 2023-08-17T17:34:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc13e4700 1 --2- 172.21.15.78:0/2322413768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 0x7f0fbc064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fc1be5700 1 --2- 172.21.15.78:0/2322413768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc0bef00 0x7f0fbc0c6b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0fb4009e60 tx=0x7f0fb4009780).ready entity=mon.0 client_cookie=b9ac02e3b1364d8d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fb3fff700 1 -- 172.21.15.78:0/2322413768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400e070 con 0x7f0fbc0bef00 2023-08-17T17:34:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fb3fff700 1 -- 172.21.15.78:0/2322413768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb400bc30 con 0x7f0fbc0bef00 2023-08-17T17:34:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.990+0000 7f0fb3fff700 1 -- 172.21.15.78:0/2322413768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4012410 con 0x7f0fbc0bef00 2023-08-17T17:34:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.991+0000 7f0fc3648700 1 -- 172.21.15.78:0/2322413768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc0bef00 msgr2=0x7f0fbc0c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.991+0000 7f0fc3648700 1 --2- 172.21.15.78:0/2322413768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc0bef00 0x7f0fbc0c6b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0fb4009e60 tx=0x7f0fb4009780).stop 2023-08-17T17:34:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.991+0000 7f0fc3648700 1 -- 172.21.15.78:0/2322413768 shutdown_connections 2023-08-17T17:34:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.991+0000 7f0fc3648700 1 --2- 172.21.15.78:0/2322413768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc0bef00 0x7f0fbc0c6b90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.991+0000 7f0fc3648700 1 --2- 172.21.15.78:0/2322413768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 0x7f0fbc064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.991+0000 7f0fc3648700 1 -- 172.21.15.78:0/2322413768 >> 172.21.15.78:0/2322413768 conn(0x7f0fbc092330 msgr2=0x7f0fbc062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.991+0000 7f0fc3648700 1 -- 172.21.15.78:0/2322413768 shutdown_connections 2023-08-17T17:34:36.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.991+0000 7f0fc3648700 1 -- 172.21.15.78:0/2322413768 wait complete. 2023-08-17T17:34:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.992+0000 7f0fc3648700 1 Processor -- start 2023-08-17T17:34:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.992+0000 7f0fc3648700 1 -- start start 2023-08-17T17:34:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc3648700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc065140 0x7f0fbc0ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc3648700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 0x7f0fbc0c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc3648700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fbc0bef00 0x7f0fbc159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc3648700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc156230 con 0x7f0fbc065140 2023-08-17T17:34:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc3648700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc155620 con 0x7f0fbc0bef00 2023-08-17T17:34:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc3648700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc155900 con 0x7f0fbc0a7fe0 2023-08-17T17:34:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc13e4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc065140 0x7f0fbc0ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc13e4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc065140 0x7f0fbc0ac660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47068/0 (socket says 172.21.15.78:47068) 2023-08-17T17:34:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc13e4700 1 -- 172.21.15.78:0/3997211476 learned_addr learned my addr 172.21.15.78:0/3997211476 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc0be3700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 0x7f0fbc0c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc1be5700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fbc0bef00 0x7f0fbc159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:36.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc13e4700 1 -- 172.21.15.78:0/3997211476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 msgr2=0x7f0fbc0c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc13e4700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 0x7f0fbc0c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc13e4700 1 -- 172.21.15.78:0/3997211476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fbc0bef00 msgr2=0x7f0fbc159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc13e4700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fbc0bef00 0x7f0fbc159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc13e4700 1 -- 172.21.15.78:0/3997211476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4009a20 con 0x7f0fbc065140 2023-08-17T17:34:37.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc13e4700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc065140 0x7f0fbc0ac660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f0fb800c880 tx=0x7f0fb8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fb17fa700 1 -- 172.21.15.78:0/3997211476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8010580 con 0x7f0fbc065140 2023-08-17T17:34:37.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fb17fa700 1 -- 172.21.15.78:0/3997211476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb80106e0 con 0x7f0fbc065140 2023-08-17T17:34:37.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fc3648700 1 -- 172.21.15.78:0/3997211476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc155be0 con 0x7f0fbc065140 2023-08-17T17:34:37.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.993+0000 7f0fb17fa700 1 -- 172.21.15.78:0/3997211476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8010a60 con 0x7f0fbc065140 2023-08-17T17:34:37.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.994+0000 7f0fc3648700 1 -- 172.21.15.78:0/3997211476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc0bfd30 con 0x7f0fbc065140 2023-08-17T17:34:37.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.994+0000 7f0fc3648700 1 -- 172.21.15.78:0/3997211476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc0adaf0 con 0x7f0fbc065140 2023-08-17T17:34:37.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.995+0000 7f0fb17fa700 1 -- 172.21.15.78:0/3997211476 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0fb801b460 con 0x7f0fbc065140 2023-08-17T17:34:37.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.995+0000 7f0fb17fa700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fa005ed90 0x7f0fa0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.995+0000 7f0fb17fa700 1 -- 172.21.15.78:0/3997211476 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0fb8079c70 con 0x7f0fbc065140 2023-08-17T17:34:37.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.995+0000 7f0fc0be3700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fa005ed90 0x7f0fa0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.995+0000 7f0fc0be3700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fa005ed90 0x7f0fa0061250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0fbc154dd0 tx=0x7f0fac009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:36.999+0000 7f0fb17fa700 1 -- 172.21.15.78:0/3997211476 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fb804b1b0 con 0x7f0fbc065140 2023-08-17T17:34:37.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.163+0000 7f0fc3648700 1 -- 172.21.15.78:0/3997211476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fbc0c39f0 con 0x7f0fbc065140 2023-08-17T17:34:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.164+0000 7f0fb17fa700 1 -- 172.21.15.78:0/3997211476 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f0fb804e7d0 con 0x7f0fbc065140 2023-08-17T17:34:37.165 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:37.166 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.165+0000 7f0fc3648700 1 -- 172.21.15.78:0/3997211476 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fa005ed90 msgr2=0x7f0fa0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.165+0000 7f0fc3648700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fa005ed90 0x7f0fa0061250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0fbc154dd0 tx=0x7f0fac009040).stop 2023-08-17T17:34:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.165+0000 7f0fc3648700 1 -- 172.21.15.78:0/3997211476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc065140 msgr2=0x7f0fbc0ac660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.165+0000 7f0fc3648700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc065140 0x7f0fbc0ac660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f0fb800c880 tx=0x7f0fb8008040).stop 2023-08-17T17:34:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.166+0000 7f0fc3648700 1 -- 172.21.15.78:0/3997211476 shutdown_connections 2023-08-17T17:34:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.166+0000 7f0fc3648700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fa005ed90 0x7f0fa0061250 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.166+0000 7f0fc3648700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fbc0bef00 0x7f0fbc159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.166+0000 7f0fc3648700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fbc065140 0x7f0fbc0ac660 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.166+0000 7f0fc3648700 1 --2- 172.21.15.78:0/3997211476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fbc0a7fe0 0x7f0fbc0c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.166+0000 7f0fc3648700 1 -- 172.21.15.78:0/3997211476 >> 172.21.15.78:0/3997211476 conn(0x7f0fbc092330 msgr2=0x7f0fbc0be3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.166+0000 7f0fc3648700 1 -- 172.21.15.78:0/3997211476 shutdown_connections 2023-08-17T17:34:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.166+0000 7f0fc3648700 1 -- 172.21.15.78:0/3997211476 wait complete. 2023-08-17T17:34:37.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:34:21.874660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:34:22.501817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:34:37.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:34:37.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.296+0000 7fdbab009700 1 Processor -- start 2023-08-17T17:34:37.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.296+0000 7fdbab009700 1 -- start start 2023-08-17T17:34:37.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdbab009700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdba414f9d0 0x7fdba4152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdbab009700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba40bc610 con 0x7fdba4065100 2023-08-17T17:34:37.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdbab009700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba40bc310 con 0x7fdba406b280 2023-08-17T17:34:37.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdbab009700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba4066550 con 0x7fdba414f9d0 2023-08-17T17:34:37.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdba95a6700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdba4065100 0x7fdba40624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38296/0 (socket says 172.21.15.78:38296) 2023-08-17T17:34:37.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdba95a6700 1 -- 172.21.15.78:0/4123381270 learned_addr learned my addr 172.21.15.78:0/4123381270 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:37.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdba8da5700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdba414f9d0 0x7fdba4152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272785388 0 0) 0x7fdba40bc610 con 0x7fdba4065100 2023-08-17T17:34:37.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb8c0033f0 con 0x7fdba4065100 2023-08-17T17:34:37.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097685676 0 0) 0x7fdba40bc310 con 0x7fdba406b280 2023-08-17T17:34:37.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdba40bc610 con 0x7fdba406b280 2023-08-17T17:34:37.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2050793181 0 0) 0x7fdb8c0033f0 con 0x7fdba4065100 2023-08-17T17:34:37.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdba414f9d0 msgr2=0x7fdba4152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:37.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdb9b7fe700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdba414f9d0 0x7fdba4152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 >> v1:172.21.15.150:6789/0 conn(0x7fdba406b280 legacy=0x7fdba40649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.297+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba40be1c0 con 0x7fdba4065100 2023-08-17T17:34:37.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fdb9c001470 con 0x7fdba4065100 2023-08-17T17:34:37.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 >> v1:172.21.15.78:6789/0 conn(0x7fdba4065100 legacy=0x7fdba40624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb8c003aa0 0x7fdb8c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb8c004690 0x7fdb8c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdba414f9d0 0x7fdb8c005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba4066550 con 0x7fdb8c003aa0 2023-08-17T17:34:37.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c00b990 con 0x7fdb8c004690 2023-08-17T17:34:37.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c00bb20 con 0x7fdba414f9d0 2023-08-17T17:34:37.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdba8da5700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb8c003aa0 0x7fdb8c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9bfff700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb8c004690 0x7fdb8c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdba95a6700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdba414f9d0 0x7fdb8c005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdba8da5700 1 -- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdba414f9d0 msgr2=0x7fdb8c005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:37.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdba8da5700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdba414f9d0 0x7fdb8c005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdba8da5700 1 -- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb8c004690 msgr2=0x7fdb8c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:37.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdba8da5700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb8c004690 0x7fdb8c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdba8da5700 1 -- 172.21.15.78:0/4123381270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c0033f0 con 0x7fdb8c003aa0 2023-08-17T17:34:37.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdba8da5700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb8c003aa0 0x7fdb8c003ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fdba000e300 tx=0x7fdba000b040).ready entity=mon.0 client_cookie=e02f4df70295a67e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0009b10 con 0x7fdb8c003aa0 2023-08-17T17:34:37.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba000f040 con 0x7fdb8c003aa0 2023-08-17T17:34:37.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.298+0000 7fdb9b7fe700 1 -- 172.21.15.78:0/4123381270 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba000ed60 con 0x7fdb8c003aa0 2023-08-17T17:34:37.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.299+0000 7fdbab009700 1 -- 172.21.15.78:0/4123381270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb8c003aa0 msgr2=0x7fdb8c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.299+0000 7fdbab009700 1 --2- 172.21.15.78:0/4123381270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb8c003aa0 0x7fdb8c003ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fdba000e300 tx=0x7fdba000b040).stop 2023-08-17T17:34:37.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.299+0000 7fdba95a6700 1 -- 172.21.15.78:0/4123381270 reap_dead start 2023-08-17T17:34:37.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.299+0000 7fdbab009700 1 -- 172.21.15.78:0/4123381270 shutdown_connections 2023-08-17T17:34:37.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.299+0000 7fdbab009700 1 -- 172.21.15.78:0/4123381270 >> 172.21.15.78:0/4123381270 conn(0x7fdba40c3db0 msgr2=0x7fdba40c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:37.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.299+0000 7fdbab009700 1 -- 172.21.15.78:0/4123381270 shutdown_connections 2023-08-17T17:34:37.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.299+0000 7fdbab009700 1 -- 172.21.15.78:0/4123381270 wait complete. 2023-08-17T17:34:37.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.300+0000 7fdbab009700 1 Processor -- start 2023-08-17T17:34:37.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.300+0000 7fdbab009700 1 -- start start 2023-08-17T17:34:37.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdbab009700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb8c003aa0 0x7fdba40aa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdbab009700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdba40bf4a0 0x7fdba4150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdbab009700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdba40bf920 0x7fdba4151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdbab009700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba4151760 con 0x7fdba40bf920 2023-08-17T17:34:37.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdbab009700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba4165e80 con 0x7fdba40bf4a0 2023-08-17T17:34:37.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdbab009700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40aa7f0 con 0x7fdb8c003aa0 2023-08-17T17:34:37.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdba95a6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdba40bf920 0x7fdba4151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdba95a6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdba40bf920 0x7fdba4151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47084/0 (socket says 172.21.15.78:47084) 2023-08-17T17:34:37.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdba95a6700 1 -- 172.21.15.78:0/1540251442 learned_addr learned my addr 172.21.15.78:0/1540251442 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:37.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdba8da5700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb8c003aa0 0x7fdba40aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdb9bfff700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdba40bf4a0 0x7fdba4150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdba95a6700 1 -- 172.21.15.78:0/1540251442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb8c003aa0 msgr2=0x7fdba40aa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdba95a6700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb8c003aa0 0x7fdba40aa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdba95a6700 1 -- 172.21.15.78:0/1540251442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdba40bf4a0 msgr2=0x7fdba4150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdba95a6700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdba40bf4a0 0x7fdba4150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdba95a6700 1 -- 172.21.15.78:0/1540251442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba4162d70 con 0x7fdba40bf920 2023-08-17T17:34:37.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdb9bfff700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdba40bf4a0 0x7fdba4150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:37.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdba95a6700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdba40bf920 0x7fdba4151270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fdb9c000fd0 tx=0x7fdb9c0010d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdb98ff9700 1 -- 172.21.15.78:0/1540251442 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c010520 con 0x7fdba40bf920 2023-08-17T17:34:37.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdb98ff9700 1 -- 172.21.15.78:0/1540251442 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c010680 con 0x7fdba40bf920 2023-08-17T17:34:37.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdbab009700 1 -- 172.21.15.78:0/1540251442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba4163050 con 0x7fdba40bf920 2023-08-17T17:34:37.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdb98ff9700 1 -- 172.21.15.78:0/1540251442 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c010a20 con 0x7fdba40bf920 2023-08-17T17:34:37.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.301+0000 7fdbab009700 1 -- 172.21.15.78:0/1540251442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba4163610 con 0x7fdba40bf920 2023-08-17T17:34:37.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.302+0000 7fdbab009700 1 -- 172.21.15.78:0/1540251442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba4165ff0 con 0x7fdba40bf920 2023-08-17T17:34:37.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.303+0000 7fdb98ff9700 1 -- 172.21.15.78:0/1540251442 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdb9c01a020 con 0x7fdba40bf920 2023-08-17T17:34:37.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.303+0000 7fdb98ff9700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb9005ed60 0x7fdb90061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.303+0000 7fdb98ff9700 1 -- 172.21.15.78:0/1540251442 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb9c079280 con 0x7fdba40bf920 2023-08-17T17:34:37.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.303+0000 7fdba8da5700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb9005ed60 0x7fdb90061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.303+0000 7fdba8da5700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb9005ed60 0x7fdb90061220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fdba000bfd0 tx=0x7fdba001a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.307+0000 7fdb98ff9700 1 -- 172.21.15.78:0/1540251442 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdba4165ff0 con 0x7fdba40bf920 2023-08-17T17:34:37.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.467+0000 7fdbab009700 1 -- 172.21.15.78:0/1540251442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdba4165ff0 con 0x7fdba40bf920 2023-08-17T17:34:37.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.467+0000 7fdb98ff9700 1 -- 172.21.15.78:0/1540251442 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdba4165ff0 con 0x7fdba40bf920 2023-08-17T17:34:37.469 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:34:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 -- 172.21.15.78:0/1540251442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb9005ed60 msgr2=0x7fdb90061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb9005ed60 0x7fdb90061220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fdba000bfd0 tx=0x7fdba001a000).stop 2023-08-17T17:34:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 -- 172.21.15.78:0/1540251442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdba40bf920 msgr2=0x7fdba4151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdba40bf920 0x7fdba4151270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fdb9c000fd0 tx=0x7fdb9c0010d0).stop 2023-08-17T17:34:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 -- 172.21.15.78:0/1540251442 shutdown_connections 2023-08-17T17:34:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb9005ed60 0x7fdb90061220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdba40bf920 0x7fdba4151270 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb8c003aa0 0x7fdba40aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 --2- 172.21.15.78:0/1540251442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdba40bf4a0 0x7fdba4150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 -- 172.21.15.78:0/1540251442 >> 172.21.15.78:0/1540251442 conn(0x7fdba40c3db0 msgr2=0x7fdba4154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 -- 172.21.15.78:0/1540251442 shutdown_connections 2023-08-17T17:34:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.469+0000 7fdbab009700 1 -- 172.21.15.78:0/1540251442 wait complete. 2023-08-17T17:34:37.482 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:34:37.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.596+0000 7f74ed666700 1 Processor -- start 2023-08-17T17:34:37.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.596+0000 7f74ed666700 1 -- start start 2023-08-17T17:34:37.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.597+0000 7f74ed666700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74e80aa0f0 0x7f74e80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.597+0000 7f74ed666700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74e80c5810 0x7f74e80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.597+0000 7f74ed666700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e80649b0 con 0x7f74e80aa4d0 2023-08-17T17:34:37.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.597+0000 7f74ed666700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e80c6170 con 0x7f74e80aa0f0 2023-08-17T17:34:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.597+0000 7f74ed666700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8063420 con 0x7f74e80c5810 2023-08-17T17:34:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.597+0000 7f74e6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74e80aa0f0 0x7f74e80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.597+0000 7f74e6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74e80aa0f0 0x7f74e80644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47098/0 (socket says 172.21.15.78:47098) 2023-08-17T17:34:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.597+0000 7f74e6ffd700 1 -- 172.21.15.78:0/2707823434 learned_addr learned my addr 172.21.15.78:0/2707823434 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.597+0000 7f74e6ffd700 1 -- 172.21.15.78:0/2707823434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74e80c5810 msgr2=0x7f74e80c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.597+0000 7f74e77fe700 1 --2- 172.21.15.78:0/2707823434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74e80c5810 0x7f74e80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74e6ffd700 1 --2- 172.21.15.78:0/2707823434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74e80c5810 0x7f74e80c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74e6ffd700 1 -- 172.21.15.78:0/2707823434 >> v1:172.21.15.150:6789/0 conn(0x7f74e80aa4d0 legacy=0x7f74e80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74e6ffd700 1 -- 172.21.15.78:0/2707823434 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e8063700 con 0x7f74e80aa0f0 2023-08-17T17:34:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74e6ffd700 1 --2- 172.21.15.78:0/2707823434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80aa0f0 0x7f74e80644c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f74d8009f20 tx=0x7f74d8009840).ready entity=mon.0 client_cookie=8eb8e6a65f7c3d92 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74e5ffb700 1 -- 172.21.15.78:0/2707823434 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800e070 con 0x7f74e80aa0f0 2023-08-17T17:34:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74e5ffb700 1 -- 172.21.15.78:0/2707823434 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d800ba40 con 0x7f74e80aa0f0 2023-08-17T17:34:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74e5ffb700 1 -- 172.21.15.78:0/2707823434 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800bdc0 con 0x7f74e80aa0f0 2023-08-17T17:34:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74ed666700 1 -- 172.21.15.78:0/2707823434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80aa0f0 msgr2=0x7f74e80644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74ed666700 1 --2- 172.21.15.78:0/2707823434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80aa0f0 0x7f74e80644c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f74d8009f20 tx=0x7f74d8009840).stop 2023-08-17T17:34:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74ed666700 1 -- 172.21.15.78:0/2707823434 shutdown_connections 2023-08-17T17:34:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74ed666700 1 --2- 172.21.15.78:0/2707823434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74e80c5810 0x7f74e80c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74ed666700 1 --2- 172.21.15.78:0/2707823434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80aa0f0 0x7f74e80644c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74ed666700 1 -- 172.21.15.78:0/2707823434 >> 172.21.15.78:0/2707823434 conn(0x7f74e806a6a0 msgr2=0x7f74e80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74ed666700 1 -- 172.21.15.78:0/2707823434 shutdown_connections 2023-08-17T17:34:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.598+0000 7f74ed666700 1 -- 172.21.15.78:0/2707823434 wait complete. 2023-08-17T17:34:37.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74ed666700 1 Processor -- start 2023-08-17T17:34:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74ed666700 1 -- start start 2023-08-17T17:34:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74ed666700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80aa0f0 0x7f74e80c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74ed666700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74e80aa4d0 0x7f74e814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74ed666700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80c5810 0x7f74e8164200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74ed666700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80c1ed0 con 0x7f74e80c5810 2023-08-17T17:34:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74ed666700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8164ac0 con 0x7f74e80aa0f0 2023-08-17T17:34:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74ed666700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8164da0 con 0x7f74e80aa4d0 2023-08-17T17:34:37.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74e77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80c5810 0x7f74e8164200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74e77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80c5810 0x7f74e8164200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47106/0 (socket says 172.21.15.78:47106) 2023-08-17T17:34:37.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.600+0000 7f74e77fe700 1 -- 172.21.15.78:0/488697333 learned_addr learned my addr 172.21.15.78:0/488697333 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:37.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74e6ffd700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80aa0f0 0x7f74e80c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74e67fc700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74e80aa4d0 0x7f74e814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74e77fe700 1 -- 172.21.15.78:0/488697333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74e80aa4d0 msgr2=0x7f74e814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74e77fe700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74e80aa4d0 0x7f74e814fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74e77fe700 1 -- 172.21.15.78:0/488697333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80aa0f0 msgr2=0x7f74e80c3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74e77fe700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80aa0f0 0x7f74e80c3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74e77fe700 1 -- 172.21.15.78:0/488697333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8009ae0 con 0x7f74e80c5810 2023-08-17T17:34:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74e77fe700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80c5810 0x7f74e8164200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f74e000c650 tx=0x7f74e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74ceffd700 1 -- 172.21.15.78:0/488697333 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0010580 con 0x7f74e80c5810 2023-08-17T17:34:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74ceffd700 1 -- 172.21.15.78:0/488697333 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e00106e0 con 0x7f74e80c5810 2023-08-17T17:34:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74ed666700 1 -- 172.21.15.78:0/488697333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e8165080 con 0x7f74e80c5810 2023-08-17T17:34:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74ceffd700 1 -- 172.21.15.78:0/488697333 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0010a60 con 0x7f74e80c5810 2023-08-17T17:34:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.601+0000 7f74ed666700 1 -- 172.21.15.78:0/488697333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e8150030 con 0x7f74e80c5810 2023-08-17T17:34:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.602+0000 7f74ed666700 1 -- 172.21.15.78:0/488697333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e80c2080 con 0x7f74e80c5810 2023-08-17T17:34:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.602+0000 7f74ceffd700 1 -- 172.21.15.78:0/488697333 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f74e001b460 con 0x7f74e80c5810 2023-08-17T17:34:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.602+0000 7f74ceffd700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f74d405ed90 0x7f74d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.603+0000 7f74ceffd700 1 -- 172.21.15.78:0/488697333 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f74e00799e0 con 0x7f74e80c5810 2023-08-17T17:34:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.603+0000 7f74e6ffd700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f74d405ed90 0x7f74d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.603+0000 7f74e6ffd700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f74d405ed90 0x7f74d4061250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f74d800c010 tx=0x7f74d8009840).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.607+0000 7f74ceffd700 1 -- 172.21.15.78:0/488697333 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f74e80c2080 con 0x7f74e80c5810 2023-08-17T17:34:37.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.770+0000 7f74ed666700 1 -- 172.21.15.78:0/488697333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f74e80c2010 con 0x7f74e80c5810 2023-08-17T17:34:37.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.770+0000 7f74ceffd700 1 -- 172.21.15.78:0/488697333 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74e004af20 con 0x7f74e80c5810 2023-08-17T17:34:37.772 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:34:37.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 -- 172.21.15.78:0/488697333 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f74d405ed90 msgr2=0x7f74d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f74d405ed90 0x7f74d4061250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f74d800c010 tx=0x7f74d8009840).stop 2023-08-17T17:34:37.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 -- 172.21.15.78:0/488697333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80c5810 msgr2=0x7f74e8164200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80c5810 0x7f74e8164200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f74e000c650 tx=0x7f74e0008040).stop 2023-08-17T17:34:37.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 -- 172.21.15.78:0/488697333 shutdown_connections 2023-08-17T17:34:37.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f74d405ed90 0x7f74d4061250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80c5810 0x7f74e8164200 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74e80aa0f0 0x7f74e80c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 --2- 172.21.15.78:0/488697333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74e80aa4d0 0x7f74e814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 -- 172.21.15.78:0/488697333 >> 172.21.15.78:0/488697333 conn(0x7f74e806a6a0 msgr2=0x7f74e80b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:37.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 -- 172.21.15.78:0/488697333 shutdown_connections 2023-08-17T17:34:37.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.772+0000 7f74ed666700 1 -- 172.21.15.78:0/488697333 wait complete. 2023-08-17T17:34:37.785 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:34:37.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.899+0000 7f801b9ac700 1 Processor -- start 2023-08-17T17:34:37.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.899+0000 7f801b9ac700 1 -- start start 2023-08-17T17:34:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f801b9ac700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80140aa0f0 0x7f80140644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f801b9ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140aa4d0 0x7f80140c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f801b9ac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f80140c5810 0x7f80140c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f801b9ac700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80140649b0 con 0x7f80140aa0f0 2023-08-17T17:34:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f801b9ac700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80140c6120 con 0x7f80140c5810 2023-08-17T17:34:37.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f801b9ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8014063420 con 0x7f80140aa4d0 2023-08-17T17:34:37.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f8019748700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80140aa0f0 0x7f80140644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f8019748700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80140aa0f0 0x7f80140644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47114/0 (socket says 172.21.15.78:47114) 2023-08-17T17:34:37.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f8019748700 1 -- 172.21.15.78:0/2997137744 learned_addr learned my addr 172.21.15.78:0/2997137744 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:37.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f8018f47700 1 --2- 172.21.15.78:0/2997137744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140aa4d0 0x7f80140c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.900+0000 7f8019f49700 1 --2- 172.21.15.78:0/2997137744 >> v2:172.21.15.150:3300/0 conn(0x7f80140c5810 0x7f80140c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f8019748700 1 -- 172.21.15.78:0/2997137744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140aa4d0 msgr2=0x7f80140c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f8019748700 1 --2- 172.21.15.78:0/2997137744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140aa4d0 0x7f80140c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f8019748700 1 -- 172.21.15.78:0/2997137744 >> v2:172.21.15.150:3300/0 conn(0x7f80140c5810 msgr2=0x7f80140c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f8019748700 1 --2- 172.21.15.78:0/2997137744 >> v2:172.21.15.150:3300/0 conn(0x7f80140c5810 0x7f80140c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f8019748700 1 -- 172.21.15.78:0/2997137744 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8014063700 con 0x7f80140aa0f0 2023-08-17T17:34:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f8019f49700 1 --2- 172.21.15.78:0/2997137744 >> v2:172.21.15.150:3300/0 conn(0x7f80140c5810 0x7f80140c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f8019748700 1 --2- 172.21.15.78:0/2997137744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa0f0 0x7f80140644c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f8014159060 tx=0x7f8010009840).ready entity=mon.0 client_cookie=d5ddd736d744c6c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f800bfff700 1 -- 172.21.15.78:0/2997137744 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000e070 con 0x7f80140aa0f0 2023-08-17T17:34:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f800bfff700 1 -- 172.21.15.78:0/2997137744 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801000ba20 con 0x7f80140aa0f0 2023-08-17T17:34:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f800bfff700 1 -- 172.21.15.78:0/2997137744 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000bda0 con 0x7f80140aa0f0 2023-08-17T17:34:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f801b9ac700 1 -- 172.21.15.78:0/2997137744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa0f0 msgr2=0x7f80140644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f801b9ac700 1 --2- 172.21.15.78:0/2997137744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa0f0 0x7f80140644c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f8014159060 tx=0x7f8010009840).stop 2023-08-17T17:34:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f801b9ac700 1 -- 172.21.15.78:0/2997137744 shutdown_connections 2023-08-17T17:34:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f801b9ac700 1 --2- 172.21.15.78:0/2997137744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa0f0 0x7f80140644c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f801b9ac700 1 --2- 172.21.15.78:0/2997137744 >> v2:172.21.15.150:3300/0 conn(0x7f80140c5810 0x7f80140c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f801b9ac700 1 --2- 172.21.15.78:0/2997137744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140aa4d0 0x7f80140c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f801b9ac700 1 -- 172.21.15.78:0/2997137744 >> 172.21.15.78:0/2997137744 conn(0x7f801406a6a0 msgr2=0x7f80140caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.901+0000 7f801b9ac700 1 -- 172.21.15.78:0/2997137744 shutdown_connections 2023-08-17T17:34:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.902+0000 7f801b9ac700 1 -- 172.21.15.78:0/2997137744 wait complete. 2023-08-17T17:34:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.903+0000 7f801b9ac700 1 Processor -- start 2023-08-17T17:34:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.903+0000 7f801b9ac700 1 -- start start 2023-08-17T17:34:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.903+0000 7f801b9ac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80140aa0f0 0x7f80140ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.903+0000 7f801b9ac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa4d0 0x7f80140c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.903+0000 7f801b9ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140c5810 0x7f80140c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.903+0000 7f801b9ac700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80140c1fb0 con 0x7f80140aa4d0 2023-08-17T17:34:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.903+0000 7f801b9ac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80140c2dd0 con 0x7f80140aa0f0 2023-08-17T17:34:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.903+0000 7f801b9ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80140c21c0 con 0x7f80140c5810 2023-08-17T17:34:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8018f47700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa4d0 0x7f80140c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8018f47700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa4d0 0x7f80140c1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47126/0 (socket says 172.21.15.78:47126) 2023-08-17T17:34:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8018f47700 1 -- 172.21.15.78:0/347810310 learned_addr learned my addr 172.21.15.78:0/347810310 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8019748700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80140aa0f0 0x7f80140ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8019f49700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140c5810 0x7f80140c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8018f47700 1 -- 172.21.15.78:0/347810310 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140c5810 msgr2=0x7f80140c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8018f47700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140c5810 0x7f80140c3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8018f47700 1 -- 172.21.15.78:0/347810310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80140aa0f0 msgr2=0x7f80140ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8018f47700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80140aa0f0 0x7f80140ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8018f47700 1 -- 172.21.15.78:0/347810310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8010009ae0 con 0x7f80140aa4d0 2023-08-17T17:34:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8019748700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80140aa0f0 0x7f80140ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f8018f47700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa4d0 0x7f80140c1ac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f800400e950 tx=0x7f8004009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f80097fa700 1 -- 172.21.15.78:0/347810310 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400c8e0 con 0x7f80140aa4d0 2023-08-17T17:34:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f80097fa700 1 -- 172.21.15.78:0/347810310 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800400ca40 con 0x7f80140aa4d0 2023-08-17T17:34:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f80097fa700 1 -- 172.21.15.78:0/347810310 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400cdc0 con 0x7f80140aa4d0 2023-08-17T17:34:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f801b9ac700 1 -- 172.21.15.78:0/347810310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80140c24a0 con 0x7f80140aa4d0 2023-08-17T17:34:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.904+0000 7f801b9ac700 1 -- 172.21.15.78:0/347810310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80140c2a60 con 0x7f80140aa4d0 2023-08-17T17:34:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.905+0000 7f801b9ac700 1 -- 172.21.15.78:0/347810310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80140c2f80 con 0x7f80140aa4d0 2023-08-17T17:34:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.906+0000 7f80097fa700 1 -- 172.21.15.78:0/347810310 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8004022070 con 0x7f80140aa4d0 2023-08-17T17:34:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.906+0000 7f80097fa700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ff805ed90 0x7f7ff8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.906+0000 7f80097fa700 1 -- 172.21.15.78:0/347810310 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f800407a000 con 0x7f80140aa4d0 2023-08-17T17:34:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.906+0000 7f8019748700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ff805ed90 0x7f7ff8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.906+0000 7f8019748700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ff805ed90 0x7f7ff8061250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f801000c010 tx=0x7f8010009840).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:37.910+0000 7f80097fa700 1 -- 172.21.15.78:0/347810310 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f80140c2f80 con 0x7f80140aa4d0 2023-08-17T17:34:38.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.071+0000 7f801b9ac700 1 -- 172.21.15.78:0/347810310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80140c2f40 con 0x7f80140aa4d0 2023-08-17T17:34:38.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.072+0000 7f80097fa700 1 -- 172.21.15.78:0/347810310 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80040160a0 con 0x7f80140aa4d0 2023-08-17T17:34:38.074 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:38.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.073+0000 7f801b9ac700 1 -- 172.21.15.78:0/347810310 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ff805ed90 msgr2=0x7f7ff8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.073+0000 7f801b9ac700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ff805ed90 0x7f7ff8061250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f801000c010 tx=0x7f8010009840).stop 2023-08-17T17:34:38.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.074+0000 7f801b9ac700 1 -- 172.21.15.78:0/347810310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa4d0 msgr2=0x7f80140c1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.074+0000 7f801b9ac700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa4d0 0x7f80140c1ac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f800400e950 tx=0x7f8004009060).stop 2023-08-17T17:34:38.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.074+0000 7f801b9ac700 1 -- 172.21.15.78:0/347810310 shutdown_connections 2023-08-17T17:34:38.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.074+0000 7f801b9ac700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ff805ed90 0x7f7ff8061250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.074+0000 7f801b9ac700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140c5810 0x7f80140c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.074+0000 7f801b9ac700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80140aa0f0 0x7f80140ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.074+0000 7f801b9ac700 1 --2- 172.21.15.78:0/347810310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80140aa4d0 0x7f80140c1ac0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.074+0000 7f801b9ac700 1 -- 172.21.15.78:0/347810310 >> 172.21.15.78:0/347810310 conn(0x7f801406a6a0 msgr2=0x7f8014151840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:38.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.074+0000 7f801b9ac700 1 -- 172.21.15.78:0/347810310 shutdown_connections 2023-08-17T17:34:38.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.074+0000 7f801b9ac700 1 -- 172.21.15.78:0/347810310 wait complete. 2023-08-17T17:34:38.087 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:34:38.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.200+0000 7f5aa40b2700 1 Processor -- start 2023-08-17T17:34:38.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.201+0000 7f5aa40b2700 1 -- start start 2023-08-17T17:34:38.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.201+0000 7f5aa40b2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 0x7f5a9c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.201+0000 7f5aa40b2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5a9c0aa4d0 0x7f5a9c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.201+0000 7f5aa40b2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0649b0 con 0x7f5a9c0c5810 2023-08-17T17:34:38.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.201+0000 7f5aa40b2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c063420 con 0x7f5a9c0aa4d0 2023-08-17T17:34:38.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.201+0000 7f5aa40b2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c063700 con 0x7f5a9c0aa0f0 2023-08-17T17:34:38.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa1e4e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 0x7f5a9c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa164d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5a9c0aa4d0 0x7f5a9c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa1e4e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 0x7f5a9c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:39046/0 (socket says 172.21.15.78:39046) 2023-08-17T17:34:38.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa1e4e700 1 -- 172.21.15.78:0/1828000963 learned_addr learned my addr 172.21.15.78:0/1828000963 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:38.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa264f700 1 --1- 172.21.15.78:0/1828000963 >> v1:172.21.15.150:6789/0 conn(0x7f5a9c0c5810 0x7f5a9c0a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:57818/0 (socket says 172.21.15.78:57818) 2023-08-17T17:34:38.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa164d700 1 -- 172.21.15.78:0/1828000963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 msgr2=0x7f5a9c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:38.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa164d700 1 --2- 172.21.15.78:0/1828000963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 0x7f5a9c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa164d700 1 -- 172.21.15.78:0/1828000963 >> v1:172.21.15.150:6789/0 conn(0x7f5a9c0c5810 legacy=0x7f5a9c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa164d700 1 -- 172.21.15.78:0/1828000963 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c0639e0 con 0x7f5a9c0aa4d0 2023-08-17T17:34:38.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa0e4c700 1 -- 172.21.15.78:0/1828000963 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832592513 0 0) 0x7f5a9c0649b0 con 0x7f5a9c0c5810 2023-08-17T17:34:38.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa164d700 1 --2- 172.21.15.78:0/1828000963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a9c0aa4d0 0x7f5a9c0c0e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5a8c009760 tx=0x7f5a8c009060).ready entity=mon.1 client_cookie=cf3f2381376eab5c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:38.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa0e4c700 1 -- 172.21.15.78:0/1828000963 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c00f510 con 0x7f5a9c0aa4d0 2023-08-17T17:34:38.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa0e4c700 1 -- 172.21.15.78:0/1828000963 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c00f670 con 0x7f5a9c0aa4d0 2023-08-17T17:34:38.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.202+0000 7f5aa0e4c700 1 -- 172.21.15.78:0/1828000963 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c00f9f0 con 0x7f5a9c0aa4d0 2023-08-17T17:34:38.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.203+0000 7f5aa40b2700 1 -- 172.21.15.78:0/1828000963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a9c0aa4d0 msgr2=0x7f5a9c0c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.203+0000 7f5aa40b2700 1 --2- 172.21.15.78:0/1828000963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a9c0aa4d0 0x7f5a9c0c0e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5a8c009760 tx=0x7f5a8c009060).stop 2023-08-17T17:34:38.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.203+0000 7f5aa40b2700 1 -- 172.21.15.78:0/1828000963 shutdown_connections 2023-08-17T17:34:38.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.203+0000 7f5aa40b2700 1 --2- 172.21.15.78:0/1828000963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 0x7f5a9c0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.203+0000 7f5aa40b2700 1 --2- 172.21.15.78:0/1828000963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a9c0aa4d0 0x7f5a9c0c0e10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.203+0000 7f5aa40b2700 1 -- 172.21.15.78:0/1828000963 >> 172.21.15.78:0/1828000963 conn(0x7f5a9c06a6a0 msgr2=0x7f5a9c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:38.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.203+0000 7f5aa40b2700 1 -- 172.21.15.78:0/1828000963 shutdown_connections 2023-08-17T17:34:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.203+0000 7f5aa40b2700 1 -- 172.21.15.78:0/1828000963 wait complete. 2023-08-17T17:34:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.204+0000 7f5aa40b2700 1 Processor -- start 2023-08-17T17:34:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.204+0000 7f5aa40b2700 1 -- start start 2023-08-17T17:34:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa40b2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 0x7f5a9c151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa40b2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a9c0aa4d0 0x7f5a9c0a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa40b2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a9c0c5810 0x7f5a9c0a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa40b2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c164620 con 0x7f5a9c0c5810 2023-08-17T17:34:38.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa40b2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c1520e0 con 0x7f5a9c0aa4d0 2023-08-17T17:34:38.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa40b2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0a8ba0 con 0x7f5a9c0aa0f0 2023-08-17T17:34:38.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa264f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a9c0c5810 0x7f5a9c0a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa264f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a9c0c5810 0x7f5a9c0a86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47142/0 (socket says 172.21.15.78:47142) 2023-08-17T17:34:38.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa264f700 1 -- 172.21.15.78:0/2762450352 learned_addr learned my addr 172.21.15.78:0/2762450352 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:38.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa164d700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a9c0aa4d0 0x7f5a9c0a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa1e4e700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 0x7f5a9c151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa264f700 1 -- 172.21.15.78:0/2762450352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 msgr2=0x7f5a9c151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa264f700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 0x7f5a9c151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa264f700 1 -- 172.21.15.78:0/2762450352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a9c0aa4d0 msgr2=0x7f5a9c0a81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa264f700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a9c0aa4d0 0x7f5a9c0a81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa264f700 1 -- 172.21.15.78:0/2762450352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c0092a0 con 0x7f5a9c0c5810 2023-08-17T17:34:38.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5aa264f700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a9c0c5810 0x7f5a9c0a86b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f5a9400c460 tx=0x7f5a94007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:38.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.205+0000 7f5a91ffb700 1 -- 172.21.15.78:0/2762450352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940070d0 con 0x7f5a9c0c5810 2023-08-17T17:34:38.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.206+0000 7f5a91ffb700 1 -- 172.21.15.78:0/2762450352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a94007250 con 0x7f5a9c0c5810 2023-08-17T17:34:38.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.206+0000 7f5a91ffb700 1 -- 172.21.15.78:0/2762450352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940056e0 con 0x7f5a9c0c5810 2023-08-17T17:34:38.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.206+0000 7f5aa40b2700 1 -- 172.21.15.78:0/2762450352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c0c3530 con 0x7f5a9c0c5810 2023-08-17T17:34:38.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.206+0000 7f5aa40b2700 1 -- 172.21.15.78:0/2762450352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c0c40b0 con 0x7f5a9c0c5810 2023-08-17T17:34:38.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.207+0000 7f5aa40b2700 1 -- 172.21.15.78:0/2762450352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c083980 con 0x7f5a9c0c5810 2023-08-17T17:34:38.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.207+0000 7f5a91ffb700 1 -- 172.21.15.78:0/2762450352 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5a94010070 con 0x7f5a9c0c5810 2023-08-17T17:34:38.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.207+0000 7f5a91ffb700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a8005ed90 0x7f5a80061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.207+0000 7f5a91ffb700 1 -- 172.21.15.78:0/2762450352 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5a94078f70 con 0x7f5a9c0c5810 2023-08-17T17:34:38.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.207+0000 7f5aa1e4e700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a8005ed90 0x7f5a80061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.208+0000 7f5aa1e4e700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a8005ed90 0x7f5a80061250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5a9800f550 tx=0x7f5a9800b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:38.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.211+0000 7f5a91ffb700 1 -- 172.21.15.78:0/2762450352 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a9404a510 con 0x7f5a9c0c5810 2023-08-17T17:34:38.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.375+0000 7f5aa40b2700 1 -- 172.21.15.78:0/2762450352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a9c046af0 con 0x7f5a9c0c5810 2023-08-17T17:34:38.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.375+0000 7f5a91ffb700 1 -- 172.21.15.78:0/2762450352 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a9404db30 con 0x7f5a9c0c5810 2023-08-17T17:34:38.377 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:38.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 -- 172.21.15.78:0/2762450352 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a8005ed90 msgr2=0x7f5a80061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a8005ed90 0x7f5a80061250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5a9800f550 tx=0x7f5a9800b040).stop 2023-08-17T17:34:38.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 -- 172.21.15.78:0/2762450352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a9c0c5810 msgr2=0x7f5a9c0a86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a9c0c5810 0x7f5a9c0a86b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f5a9400c460 tx=0x7f5a94007e10).stop 2023-08-17T17:34:38.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 -- 172.21.15.78:0/2762450352 shutdown_connections 2023-08-17T17:34:38.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a8005ed90 0x7f5a80061250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a9c0c5810 0x7f5a9c0a86b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a9c0aa0f0 0x7f5a9c151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 --2- 172.21.15.78:0/2762450352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a9c0aa4d0 0x7f5a9c0a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 -- 172.21.15.78:0/2762450352 >> 172.21.15.78:0/2762450352 conn(0x7f5a9c06a6a0 msgr2=0x7f5a9c05e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:38.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 -- 172.21.15.78:0/2762450352 shutdown_connections 2023-08-17T17:34:38.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.377+0000 7f5aa40b2700 1 -- 172.21.15.78:0/2762450352 wait complete. 2023-08-17T17:34:38.390 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:34:38.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.501+0000 7f97c23a3700 1 Processor -- start 2023-08-17T17:34:38.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.501+0000 7f97c23a3700 1 -- start start 2023-08-17T17:34:38.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97c23a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc0c1010 0x7f97bc0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97c23a3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97bc0c7350 con 0x7f97bc0c6ee0 2023-08-17T17:34:38.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97c23a3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97bc0a8350 con 0x7f97bc154140 2023-08-17T17:34:38.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97c23a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc154520 con 0x7f97bc0c1010 2023-08-17T17:34:38.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97bb7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f97bc0c6ee0 0x7f97bc0c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38310/0 (socket says 172.21.15.78:38310) 2023-08-17T17:34:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97bb7fe700 1 -- 172.21.15.78:0/2311266225 learned_addr learned my addr 172.21.15.78:0/2311266225 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97c0940700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc0c1010 0x7f97bc0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813208721 0 0) 0x7f97bc0c7350 con 0x7f97bc0c6ee0 2023-08-17T17:34:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97a80033f0 con 0x7f97bc0c6ee0 2023-08-17T17:34:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653892087 0 0) 0x7f97bc0a8350 con 0x7f97bc154140 2023-08-17T17:34:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97bc0c7350 con 0x7f97bc154140 2023-08-17T17:34:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352378678 0 0) 0x7f97a80033f0 con 0x7f97bc0c6ee0 2023-08-17T17:34:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc0c1010 msgr2=0x7f97bc0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc0c1010 0x7f97bc0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 >> v1:172.21.15.150:6789/0 conn(0x7f97bc154140 legacy=0x7f97bc0a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc0c91e0 con 0x7f97bc0c6ee0 2023-08-17T17:34:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f97ac001470 con 0x7f97bc0c6ee0 2023-08-17T17:34:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 >> v1:172.21.15.78:6789/0 conn(0x7f97bc0c6ee0 legacy=0x7f97bc0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8003aa0 0x7f97a8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc0c1010 0x7f97a8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a8004b80 0x7f97a8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc154520 con 0x7f97a8004b80 2023-08-17T17:34:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a800b910 con 0x7f97a8003aa0 2023-08-17T17:34:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a800bad0 con 0x7f97bc0c1010 2023-08-17T17:34:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97c0940700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a8004b80 0x7f97a8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97bb7fe700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc0c1010 0x7f97a8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.502+0000 7f97bbfff700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8003aa0 0x7f97a8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c0940700 1 -- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc0c1010 msgr2=0x7f97a8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:38.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c0940700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc0c1010 0x7f97a8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c0940700 1 -- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8003aa0 msgr2=0x7f97a8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:38.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c0940700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8003aa0 0x7f97a8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c0940700 1 -- 172.21.15.78:0/2311266225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a80033f0 con 0x7f97a8004b80 2023-08-17T17:34:38.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c0940700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a8004b80 0x7f97a8005000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f97bc0c00f0 tx=0x7f97b400b040).ready entity=mon.0 client_cookie=4cee7f9b483e8950 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:38.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4009ac0 con 0x7f97a8004b80 2023-08-17T17:34:38.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b400f040 con 0x7f97a8004b80 2023-08-17T17:34:38.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97baffd700 1 -- 172.21.15.78:0/2311266225 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b400ec10 con 0x7f97a8004b80 2023-08-17T17:34:38.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c23a3700 1 -- 172.21.15.78:0/2311266225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a8004b80 msgr2=0x7f97a8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c23a3700 1 --2- 172.21.15.78:0/2311266225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a8004b80 0x7f97a8005000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f97bc0c00f0 tx=0x7f97b400b040).stop 2023-08-17T17:34:38.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c0940700 1 -- 172.21.15.78:0/2311266225 reap_dead start 2023-08-17T17:34:38.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c23a3700 1 -- 172.21.15.78:0/2311266225 shutdown_connections 2023-08-17T17:34:38.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c23a3700 1 -- 172.21.15.78:0/2311266225 >> 172.21.15.78:0/2311266225 conn(0x7f97bc094510 msgr2=0x7f97bc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:38.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c23a3700 1 -- 172.21.15.78:0/2311266225 shutdown_connections 2023-08-17T17:34:38.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.503+0000 7f97c23a3700 1 -- 172.21.15.78:0/2311266225 wait complete. 2023-08-17T17:34:38.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.504+0000 7f97c23a3700 1 Processor -- start 2023-08-17T17:34:38.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.505+0000 7f97c23a3700 1 -- start start 2023-08-17T17:34:38.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.505+0000 7f97c23a3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8004b80 0x7f97bc0638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.505+0000 7f97c23a3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc1515f0 0x7f97bc063dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.505+0000 7f97c23a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc164870 0x7f97bc164cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.505+0000 7f97c23a3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0642b0 con 0x7f97bc1515f0 2023-08-17T17:34:38.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.505+0000 7f97c23a3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc152690 con 0x7f97a8004b80 2023-08-17T17:34:38.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.505+0000 7f97c23a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc151a80 con 0x7f97bc164870 2023-08-17T17:34:38.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc1515f0 0x7f97bc063dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc1515f0 0x7f97bc063dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47164/0 (socket says 172.21.15.78:47164) 2023-08-17T17:34:38.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97bb7fe700 1 -- 172.21.15.78:0/3906186644 learned_addr learned my addr 172.21.15.78:0/3906186644 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:38.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97bbfff700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8004b80 0x7f97bc0638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97c0940700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc164870 0x7f97bc164cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97bb7fe700 1 -- 172.21.15.78:0/3906186644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc164870 msgr2=0x7f97bc164cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97bb7fe700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc164870 0x7f97bc164cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97bb7fe700 1 -- 172.21.15.78:0/3906186644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8004b80 msgr2=0x7f97bc0638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97bb7fe700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8004b80 0x7f97bc0638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97bb7fe700 1 -- 172.21.15.78:0/3906186644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc151d60 con 0x7f97bc1515f0 2023-08-17T17:34:38.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97bb7fe700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc1515f0 0x7f97bc063dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f97ac004760 tx=0x7f97ac001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:38.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97b3fff700 1 -- 172.21.15.78:0/3906186644 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac011590 con 0x7f97bc1515f0 2023-08-17T17:34:38.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97b3fff700 1 -- 172.21.15.78:0/3906186644 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac0116f0 con 0x7f97bc1515f0 2023-08-17T17:34:38.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97c23a3700 1 -- 172.21.15.78:0/3906186644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97bc152040 con 0x7f97bc1515f0 2023-08-17T17:34:38.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97b3fff700 1 -- 172.21.15.78:0/3906186644 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac011a70 con 0x7f97bc1515f0 2023-08-17T17:34:38.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.506+0000 7f97c23a3700 1 -- 172.21.15.78:0/3906186644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97bc14fff0 con 0x7f97bc1515f0 2023-08-17T17:34:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.507+0000 7f97c23a3700 1 -- 172.21.15.78:0/3906186644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97bc0aba40 con 0x7f97bc1515f0 2023-08-17T17:34:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.507+0000 7f97b3fff700 1 -- 172.21.15.78:0/3906186644 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f97ac01b030 con 0x7f97bc1515f0 2023-08-17T17:34:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.508+0000 7f97b3fff700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979c05ed90 0x7f979c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.508+0000 7f97b3fff700 1 -- 172.21.15.78:0/3906186644 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f97ac0795c0 con 0x7f97bc1515f0 2023-08-17T17:34:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.508+0000 7f97bbfff700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979c05ed90 0x7f979c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.508+0000 7f97bbfff700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979c05ed90 0x7f979c061250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f97a4007fd0 tx=0x7f97a4007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:38.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.512+0000 7f97b3fff700 1 -- 172.21.15.78:0/3906186644 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f97ac04ab60 con 0x7f97bc1515f0 2023-08-17T17:34:38.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.715+0000 7f97c23a3700 1 -- 172.21.15.78:0/3906186644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97bc047350 con 0x7f97bc1515f0 2023-08-17T17:34:38.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.715+0000 7f97b3fff700 1 -- 172.21.15.78:0/3906186644 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f97ac019020 con 0x7f97bc1515f0 2023-08-17T17:34:38.717 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:38.717 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4150014676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4150014676},{"type":"v1","addr":"172.21.15.150:6834","nonce":4150014676}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1895700227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1895700227},{"type":"v1","addr":"172.21.15.150:6835","nonce":1895700227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3007671664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3007671664},{"type":"v1","addr":"172.21.15.78:6835","nonce":3007671664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:34:23.529472+0000","modified":"2023-08-17T17:34:25.535687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/2283193122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2283193122},{"type":"v1","addr":"172.21.15.78:6837","nonce":2283193122}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T17:34:38.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 -- 172.21.15.78:0/3906186644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979c05ed90 msgr2=0x7f979c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979c05ed90 0x7f979c061250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f97a4007fd0 tx=0x7f97a4007bb0).stop 2023-08-17T17:34:38.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 -- 172.21.15.78:0/3906186644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc1515f0 msgr2=0x7f97bc063dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc1515f0 0x7f97bc063dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f97ac004760 tx=0x7f97ac001e10).stop 2023-08-17T17:34:38.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 -- 172.21.15.78:0/3906186644 shutdown_connections 2023-08-17T17:34:38.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979c05ed90 0x7f979c061250 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97bc164870 0x7f97bc164cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8004b80 0x7f97bc0638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 --2- 172.21.15.78:0/3906186644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc1515f0 0x7f97bc063dc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 -- 172.21.15.78:0/3906186644 >> 172.21.15.78:0/3906186644 conn(0x7f97bc094510 msgr2=0x7f97bc1506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:38.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 -- 172.21.15.78:0/3906186644 shutdown_connections 2023-08-17T17:34:38.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.717+0000 7f97c23a3700 1 -- 172.21.15.78:0/3906186644 wait complete. 2023-08-17T17:34:38.720 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2023-08-17T17:34:38.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:38.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.841+0000 7f87258b8700 1 Processor -- start 2023-08-17T17:34:38.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.841+0000 7f87258b8700 1 -- start start 2023-08-17T17:34:38.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f87258b8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8720154140 0x7f87200c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f87258b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f87200c1010 0x7f87200ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f87258b8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8720154520 con 0x7f87200a7c40 2023-08-17T17:34:38.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f87258b8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87200c91e0 con 0x7f8720154140 2023-08-17T17:34:38.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f87258b8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87200c94c0 con 0x7f87200c1010 2023-08-17T17:34:38.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f871effd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8720154140 0x7f87200c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f8717fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f87200a7c40 0x7f87200c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45662/0 (socket says 172.21.15.78:45662) 2023-08-17T17:34:38.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f8717fff700 1 -- 172.21.15.78:0/4245414130 learned_addr learned my addr 172.21.15.78:0/4245414130 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:38.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f871effd700 1 -- 172.21.15.78:0/4245414130 >> v2:172.21.15.150:3300/0 conn(0x7f87200c1010 msgr2=0x7f87200ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:38.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f871effd700 1 --2- 172.21.15.78:0/4245414130 >> v2:172.21.15.150:3300/0 conn(0x7f87200c1010 0x7f87200ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:38.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f871effd700 1 -- 172.21.15.78:0/4245414130 >> v1:172.21.15.78:6789/0 conn(0x7f87200a7c40 legacy=0x7f87200c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f871e7fc700 1 -- 172.21.15.78:0/4245414130 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167887937 0 0) 0x7f8720154520 con 0x7f87200a7c40 2023-08-17T17:34:38.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f871effd700 1 -- 172.21.15.78:0/4245414130 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87200c97a0 con 0x7f8720154140 2023-08-17T17:34:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f871effd700 1 --2- 172.21.15.78:0/4245414130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 0x7f87200c6ee0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f87200c00d0 tx=0x7f8710009060).ready entity=mon.0 client_cookie=ff8705acf4f30340 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f871e7fc700 1 -- 172.21.15.78:0/4245414130 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000b580 con 0x7f8720154140 2023-08-17T17:34:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f871e7fc700 1 -- 172.21.15.78:0/4245414130 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000b6e0 con 0x7f8720154140 2023-08-17T17:34:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.842+0000 7f871e7fc700 1 -- 172.21.15.78:0/4245414130 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000ba60 con 0x7f8720154140 2023-08-17T17:34:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.843+0000 7f87258b8700 1 -- 172.21.15.78:0/4245414130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 msgr2=0x7f87200c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.843+0000 7f87258b8700 1 --2- 172.21.15.78:0/4245414130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 0x7f87200c6ee0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f87200c00d0 tx=0x7f8710009060).stop 2023-08-17T17:34:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.843+0000 7f87258b8700 1 -- 172.21.15.78:0/4245414130 shutdown_connections 2023-08-17T17:34:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.843+0000 7f87258b8700 1 --2- 172.21.15.78:0/4245414130 >> v2:172.21.15.150:3300/0 conn(0x7f87200c1010 0x7f87200ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.843+0000 7f87258b8700 1 --2- 172.21.15.78:0/4245414130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 0x7f87200c6ee0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.843+0000 7f87258b8700 1 -- 172.21.15.78:0/4245414130 >> 172.21.15.78:0/4245414130 conn(0x7f8720094510 msgr2=0x7f872006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.843+0000 7f87258b8700 1 -- 172.21.15.78:0/4245414130 shutdown_connections 2023-08-17T17:34:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.843+0000 7f87258b8700 1 -- 172.21.15.78:0/4245414130 wait complete. 2023-08-17T17:34:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.844+0000 7f87258b8700 1 Processor -- start 2023-08-17T17:34:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.844+0000 7f87258b8700 1 -- start start 2023-08-17T17:34:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f87258b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87200a7c40 0x7f8720157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f87258b8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87200c1010 0x7f8720155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f87258b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 0x7f8720150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f87258b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87200b00d0 con 0x7f8720154140 2023-08-17T17:34:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f87258b8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8720155930 con 0x7f87200c1010 2023-08-17T17:34:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f87258b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87200afa80 con 0x7f87200a7c40 2023-08-17T17:34:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f871f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 0x7f8720150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f871f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 0x7f8720150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48626/0 (socket says 172.21.15.78:48626) 2023-08-17T17:34:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f871f7fe700 1 -- 172.21.15.78:0/559976602 learned_addr learned my addr 172.21.15.78:0/559976602 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f871f7fe700 1 -- 172.21.15.78:0/559976602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87200a7c40 msgr2=0x7f8720157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f871effd700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87200a7c40 0x7f8720157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f8717fff700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87200c1010 0x7f8720155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f871f7fe700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87200a7c40 0x7f8720157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f871f7fe700 1 -- 172.21.15.78:0/559976602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87200c1010 msgr2=0x7f8720155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f871f7fe700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87200c1010 0x7f8720155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f871f7fe700 1 -- 172.21.15.78:0/559976602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100092a0 con 0x7f8720154140 2023-08-17T17:34:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f871f7fe700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 0x7f8720150d70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f871800bc30 tx=0x7f8718009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:38.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f8716ffd700 1 -- 172.21.15.78:0/559976602 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871800c7a0 con 0x7f8720154140 2023-08-17T17:34:38.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f8716ffd700 1 -- 172.21.15.78:0/559976602 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8718010070 con 0x7f8720154140 2023-08-17T17:34:38.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f87258b8700 1 -- 172.21.15.78:0/559976602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87200afd60 con 0x7f8720154140 2023-08-17T17:34:38.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f8716ffd700 1 -- 172.21.15.78:0/559976602 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871800c960 con 0x7f8720154140 2023-08-17T17:34:38.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.845+0000 7f87258b8700 1 -- 172.21.15.78:0/559976602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8720151260 con 0x7f8720154140 2023-08-17T17:34:38.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.846+0000 7f87258b8700 1 -- 172.21.15.78:0/559976602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87200c72f0 con 0x7f8720154140 2023-08-17T17:34:38.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.847+0000 7f8716ffd700 1 -- 172.21.15.78:0/559976602 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f871801c070 con 0x7f8720154140 2023-08-17T17:34:38.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.847+0000 7f8716ffd700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870005ed90 0x7f8700061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:38.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.847+0000 7f8716ffd700 1 -- 172.21.15.78:0/559976602 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f87180792e0 con 0x7f8720154140 2023-08-17T17:34:38.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.847+0000 7f871effd700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870005ed90 0x7f8700061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:38.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.847+0000 7f871effd700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870005ed90 0x7f8700061250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f871000b340 tx=0x7f8710017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:38.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:38.851+0000 7f8716ffd700 1 -- 172.21.15.78:0/559976602 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f871804a880 con 0x7f8720154140 2023-08-17T17:34:39.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.015+0000 7f87258b8700 1 -- 172.21.15.78:0/559976602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8720047350 con 0x7f8720154140 2023-08-17T17:34:39.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.015+0000 7f8716ffd700 1 -- 172.21.15.78:0/559976602 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f871801a070 con 0x7f8720154140 2023-08-17T17:34:39.017 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:39.017 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:39.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.017+0000 7f87258b8700 1 -- 172.21.15.78:0/559976602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870005ed90 msgr2=0x7f8700061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.017+0000 7f87258b8700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870005ed90 0x7f8700061250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f871000b340 tx=0x7f8710017000).stop 2023-08-17T17:34:39.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.017+0000 7f87258b8700 1 -- 172.21.15.78:0/559976602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 msgr2=0x7f8720150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.017+0000 7f87258b8700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 0x7f8720150d70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f871800bc30 tx=0x7f8718009840).stop 2023-08-17T17:34:39.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.018+0000 7f87258b8700 1 -- 172.21.15.78:0/559976602 shutdown_connections 2023-08-17T17:34:39.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.018+0000 7f87258b8700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f870005ed90 0x7f8700061250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.018+0000 7f87258b8700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8720154140 0x7f8720150d70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.018+0000 7f87258b8700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87200a7c40 0x7f8720157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.018+0000 7f87258b8700 1 --2- 172.21.15.78:0/559976602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87200c1010 0x7f8720155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.018+0000 7f87258b8700 1 -- 172.21.15.78:0/559976602 >> 172.21.15.78:0/559976602 conn(0x7f8720094510 msgr2=0x7f8720064610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:39.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.018+0000 7f87258b8700 1 -- 172.21.15.78:0/559976602 shutdown_connections 2023-08-17T17:34:39.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.018+0000 7f87258b8700 1 -- 172.21.15.78:0/559976602 wait complete. 2023-08-17T17:34:39.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:34:21.874660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:34:22.501817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:34:39.032 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:34:39.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.145+0000 7fb241637700 1 Processor -- start 2023-08-17T17:34:39.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.145+0000 7fb241637700 1 -- start start 2023-08-17T17:34:39.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.146+0000 7fb241637700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb23c0aa0f0 0x7fb23c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.146+0000 7fb241637700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 0x7fb23c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.146+0000 7fb241637700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c0649b0 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.146+0000 7fb241637700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c0c6170 con 0x7fb23c0aa0f0 2023-08-17T17:34:39.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.146+0000 7fb241637700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c063420 con 0x7fb23c0c5810 2023-08-17T17:34:39.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.146+0000 7fb23b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 0x7fb23c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.146+0000 7fb23affd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb23c0aa0f0 0x7fb23c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.146+0000 7fb2327fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb23c0aa4d0 0x7fb23c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:55736/0 (socket says 172.21.15.78:55736) 2023-08-17T17:34:39.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.146+0000 7fb2327fc700 1 -- 172.21.15.78:0/3139969936 learned_addr learned my addr 172.21.15.78:0/3139969936 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:39.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb23affd700 1 -- 172.21.15.78:0/3139969936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 msgr2=0x7fb23c0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:39.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb23affd700 1 --2- 172.21.15.78:0/3139969936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 0x7fb23c0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb23affd700 1 -- 172.21.15.78:0/3139969936 >> v1:172.21.15.150:6789/0 conn(0x7fb23c0aa4d0 legacy=0x7fb23c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb23a7fc700 1 -- 172.21.15.78:0/3139969936 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500681183 0 0) 0x7fb23c0649b0 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb23affd700 1 -- 172.21.15.78:0/3139969936 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c063700 con 0x7fb23c0aa0f0 2023-08-17T17:34:39.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb23b7fe700 1 --2- 172.21.15.78:0/3139969936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 0x7fb23c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:39.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb23affd700 1 --2- 172.21.15.78:0/3139969936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb23c0aa0f0 0x7fb23c0644c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb22c009760 tx=0x7fb22c009060).ready entity=mon.1 client_cookie=b394545b500dfa58 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:39.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb23a7fc700 1 -- 172.21.15.78:0/3139969936 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00f510 con 0x7fb23c0aa0f0 2023-08-17T17:34:39.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb23a7fc700 1 -- 172.21.15.78:0/3139969936 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00f670 con 0x7fb23c0aa0f0 2023-08-17T17:34:39.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb23a7fc700 1 -- 172.21.15.78:0/3139969936 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00f9f0 con 0x7fb23c0aa0f0 2023-08-17T17:34:39.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.147+0000 7fb241637700 1 -- 172.21.15.78:0/3139969936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb23c0aa0f0 msgr2=0x7fb23c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.148+0000 7fb241637700 1 --2- 172.21.15.78:0/3139969936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb23c0aa0f0 0x7fb23c0644c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb22c009760 tx=0x7fb22c009060).stop 2023-08-17T17:34:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.148+0000 7fb241637700 1 -- 172.21.15.78:0/3139969936 shutdown_connections 2023-08-17T17:34:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.148+0000 7fb241637700 1 --2- 172.21.15.78:0/3139969936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 0x7fb23c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.148+0000 7fb241637700 1 --2- 172.21.15.78:0/3139969936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb23c0aa0f0 0x7fb23c0644c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.148+0000 7fb241637700 1 -- 172.21.15.78:0/3139969936 >> 172.21.15.78:0/3139969936 conn(0x7fb23c06a6a0 msgr2=0x7fb23c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.148+0000 7fb241637700 1 -- 172.21.15.78:0/3139969936 shutdown_connections 2023-08-17T17:34:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.148+0000 7fb241637700 1 -- 172.21.15.78:0/3139969936 wait complete. 2023-08-17T17:34:39.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.149+0000 7fb241637700 1 Processor -- start 2023-08-17T17:34:39.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.149+0000 7fb241637700 1 -- start start 2023-08-17T17:34:39.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb241637700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb23c0aa0f0 0x7fb23c0ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb241637700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb23c0aa4d0 0x7fb23c0c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb241637700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 0x7fb23c142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb241637700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0c3500 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb241637700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0ab1a0 con 0x7fb23c0aa0f0 2023-08-17T17:34:39.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb241637700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0c3220 con 0x7fb23c0c5810 2023-08-17T17:34:39.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2327fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb23c0aa4d0 0x7fb23c0c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2327fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb23c0aa4d0 0x7fb23c0c29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48638/0 (socket says 172.21.15.78:48638) 2023-08-17T17:34:39.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2327fc700 1 -- 172.21.15.78:0/1948158296 learned_addr learned my addr 172.21.15.78:0/1948158296 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:39.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb23b7fe700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 0x7fb23c142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb23affd700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb23c0aa0f0 0x7fb23c0ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2327fc700 1 -- 172.21.15.78:0/1948158296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 msgr2=0x7fb23c142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2327fc700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 0x7fb23c142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2327fc700 1 -- 172.21.15.78:0/1948158296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb23c0aa0f0 msgr2=0x7fb23c0ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2327fc700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb23c0aa0f0 0x7fb23c0ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2327fc700 1 -- 172.21.15.78:0/1948158296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb234009a20 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb23b7fe700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 0x7fb23c142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb23affd700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb23c0aa0f0 0x7fb23c0ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2327fc700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb23c0aa4d0 0x7fb23c0c29d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fb22400c4a0 tx=0x7fb224007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2337fe700 1 -- 172.21.15.78:0/1948158296 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240072e0 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2337fe700 1 -- 172.21.15.78:0/1948158296 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb224007440 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb2337fe700 1 -- 172.21.15.78:0/1948158296 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240057a0 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb241637700 1 -- 172.21.15.78:0/1948158296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c0092a0 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.150+0000 7fb241637700 1 -- 172.21.15.78:0/1948158296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c0aae30 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.151+0000 7fb241637700 1 -- 172.21.15.78:0/1948158296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c0aa9b0 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.152+0000 7fb2337fe700 1 -- 172.21.15.78:0/1948158296 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb224010070 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.152+0000 7fb2337fe700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb21c05ed90 0x7fb21c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.152+0000 7fb2337fe700 1 -- 172.21.15.78:0/1948158296 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb224079200 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.152+0000 7fb23affd700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb21c05ed90 0x7fb21c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.152+0000 7fb23affd700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb21c05ed90 0x7fb21c061250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb22c009760 tx=0x7fb22c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:39.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.156+0000 7fb2337fe700 1 -- 172.21.15.78:0/1948158296 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb23c0aa9b0 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.323+0000 7fb241637700 1 -- 172.21.15.78:0/1948158296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb23c0aa9b0 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.323+0000 7fb2337fe700 1 -- 172.21.15.78:0/1948158296 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb23c0aa9b0 con 0x7fb23c0aa4d0 2023-08-17T17:34:39.325 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:34:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 -- 172.21.15.78:0/1948158296 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb21c05ed90 msgr2=0x7fb21c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb21c05ed90 0x7fb21c061250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb22c009760 tx=0x7fb22c017000).stop 2023-08-17T17:34:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 -- 172.21.15.78:0/1948158296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb23c0aa4d0 msgr2=0x7fb23c0c29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb23c0aa4d0 0x7fb23c0c29d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fb22400c4a0 tx=0x7fb224007c30).stop 2023-08-17T17:34:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 -- 172.21.15.78:0/1948158296 shutdown_connections 2023-08-17T17:34:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb21c05ed90 0x7fb21c061250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb23c0c5810 0x7fb23c142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb23c0aa0f0 0x7fb23c0ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 --2- 172.21.15.78:0/1948158296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb23c0aa4d0 0x7fb23c0c29d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 -- 172.21.15.78:0/1948158296 >> 172.21.15.78:0/1948158296 conn(0x7fb23c06a6a0 msgr2=0x7fb23c1519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 -- 172.21.15.78:0/1948158296 shutdown_connections 2023-08-17T17:34:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.325+0000 7fb241637700 1 -- 172.21.15.78:0/1948158296 wait complete. 2023-08-17T17:34:39.339 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:34:39.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.453+0000 7f3110e32700 1 Processor -- start 2023-08-17T17:34:39.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.453+0000 7f3110e32700 1 -- start start 2023-08-17T17:34:39.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f3110e32700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f310c0aa0f0 0x7f310c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f3110e32700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0aa4d0 0x7f310c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f3110e32700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310c0649b0 con 0x7f310c0c5810 2023-08-17T17:34:39.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f3110e32700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310c063420 con 0x7f310c0aa0f0 2023-08-17T17:34:39.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f3110e32700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c063700 con 0x7f310c0aa4d0 2023-08-17T17:34:39.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310ad9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f310c0c5810 0x7f310c0c5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45666/0 (socket says 172.21.15.78:45666) 2023-08-17T17:34:39.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310ad9d700 1 -- 172.21.15.78:0/1655258605 learned_addr learned my addr 172.21.15.78:0/1655258605 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:39.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248226772 0 0) 0x7f310c0649b0 con 0x7f310c0c5810 2023-08-17T17:34:39.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f3109d9b700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0aa4d0 0x7f310c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310a59c700 1 --2- 172.21.15.78:0/1655258605 >> v2:172.21.15.150:3300/0 conn(0x7f310c0aa0f0 0x7f310c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30f40033f0 con 0x7f310c0c5810 2023-08-17T17:34:39.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2353596734 0 0) 0x7f30f40033f0 con 0x7f310c0c5810 2023-08-17T17:34:39.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0aa4d0 msgr2=0x7f310c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:39.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0aa4d0 0x7f310c0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 >> v2:172.21.15.150:3300/0 conn(0x7f310c0aa0f0 msgr2=0x7f310c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:39.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 --2- 172.21.15.78:0/1655258605 >> v2:172.21.15.150:3300/0 conn(0x7f310c0aa0f0 0x7f310c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c0639e0 con 0x7f310c0c5810 2023-08-17T17:34:39.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3104001470 con 0x7f310c0c5810 2023-08-17T17:34:39.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 >> v1:172.21.15.78:6789/0 conn(0x7f310c0c5810 legacy=0x7f310c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 0x7f30f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0aa4d0 0x7f30f4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30f4004b80 0x7f30f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c063420 con 0x7f30f40038e0 2023-08-17T17:34:39.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c063700 con 0x7f30f4004b80 2023-08-17T17:34:39.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.454+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f400b8e0 con 0x7f310c0aa4d0 2023-08-17T17:34:39.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310a59c700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 0x7f30f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f3109d9b700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0aa4d0 0x7f30f4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310ad9d700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30f4004b80 0x7f30f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310a59c700 1 -- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0aa4d0 msgr2=0x7f30f4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:39.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310a59c700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0aa4d0 0x7f30f4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310a59c700 1 -- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30f4004b80 msgr2=0x7f30f4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:39.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310a59c700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30f4004b80 0x7f30f4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310a59c700 1 -- 172.21.15.78:0/1655258605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f40033f0 con 0x7f30f40038e0 2023-08-17T17:34:39.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310a59c700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 0x7f30f4003d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f30fc00e210 tx=0x7f30fc00b040).ready entity=mon.0 client_cookie=40b836f3f95fc5de server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:39.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc009ac0 con 0x7f30f40038e0 2023-08-17T17:34:39.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc00f040 con 0x7f30f40038e0 2023-08-17T17:34:39.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f310959a700 1 -- 172.21.15.78:0/1655258605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc00ecd0 con 0x7f30f40038e0 2023-08-17T17:34:39.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f3110e32700 1 -- 172.21.15.78:0/1655258605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 msgr2=0x7f30f4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.455+0000 7f3110e32700 1 --2- 172.21.15.78:0/1655258605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 0x7f30f4003d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f30fc00e210 tx=0x7f30fc00b040).stop 2023-08-17T17:34:39.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.456+0000 7f310ad9d700 1 -- 172.21.15.78:0/1655258605 reap_dead start 2023-08-17T17:34:39.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.456+0000 7f3110e32700 1 -- 172.21.15.78:0/1655258605 shutdown_connections 2023-08-17T17:34:39.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.456+0000 7f3110e32700 1 -- 172.21.15.78:0/1655258605 >> 172.21.15.78:0/1655258605 conn(0x7f310c06a6a0 msgr2=0x7f310c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:39.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.456+0000 7f3110e32700 1 -- 172.21.15.78:0/1655258605 shutdown_connections 2023-08-17T17:34:39.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.456+0000 7f3110e32700 1 -- 172.21.15.78:0/1655258605 wait complete. 2023-08-17T17:34:39.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.457+0000 7f3110e32700 1 Processor -- start 2023-08-17T17:34:39.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.457+0000 7f3110e32700 1 -- start start 2023-08-17T17:34:39.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.457+0000 7f3110e32700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 0x7f310c1653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.457+0000 7f3110e32700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0ad170 0x7f310c149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.457+0000 7f3110e32700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f310c1509e0 0x7f310c0aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.457+0000 7f3110e32700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c0acc80 con 0x7f30f40038e0 2023-08-17T17:34:39.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.457+0000 7f3110e32700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c14a320 con 0x7f310c1509e0 2023-08-17T17:34:39.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.457+0000 7f3110e32700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c164f40 con 0x7f310c0ad170 2023-08-17T17:34:39.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f310a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 0x7f310c1653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f310a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 0x7f310c1653d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48654/0 (socket says 172.21.15.78:48654) 2023-08-17T17:34:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f310a59c700 1 -- 172.21.15.78:0/4227647397 learned_addr learned my addr 172.21.15.78:0/4227647397 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f3109d9b700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0ad170 0x7f310c149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f310ad9d700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f310c1509e0 0x7f310c0aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f310a59c700 1 -- 172.21.15.78:0/4227647397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0ad170 msgr2=0x7f310c149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f310a59c700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0ad170 0x7f310c149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f310a59c700 1 -- 172.21.15.78:0/4227647397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f310c1509e0 msgr2=0x7f310c0aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f310a59c700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f310c1509e0 0x7f310c0aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f310a59c700 1 -- 172.21.15.78:0/4227647397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c149d80 con 0x7f30f40038e0 2023-08-17T17:34:39.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f310a59c700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 0x7f310c1653d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f30f40044c0 tx=0x7f30fc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:39.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f30fa7fc700 1 -- 172.21.15.78:0/4227647397 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc013d70 con 0x7f30f40038e0 2023-08-17T17:34:39.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f30fa7fc700 1 -- 172.21.15.78:0/4227647397 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc027420 con 0x7f30f40038e0 2023-08-17T17:34:39.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f30fa7fc700 1 -- 172.21.15.78:0/4227647397 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc0275d0 con 0x7f30f40038e0 2023-08-17T17:34:39.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f3110e32700 1 -- 172.21.15.78:0/4227647397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310c0ad650 con 0x7f30f40038e0 2023-08-17T17:34:39.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.458+0000 7f3110e32700 1 -- 172.21.15.78:0/4227647397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310c1648f0 con 0x7f30f40038e0 2023-08-17T17:34:39.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.459+0000 7f3110e32700 1 -- 172.21.15.78:0/4227647397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310c083980 con 0x7f30f40038e0 2023-08-17T17:34:39.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.459+0000 7f30fa7fc700 1 -- 172.21.15.78:0/4227647397 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f30fc02e070 con 0x7f30f40038e0 2023-08-17T17:34:39.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.460+0000 7f30fa7fc700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30ec05ed90 0x7f30ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.460+0000 7f30fa7fc700 1 -- 172.21.15.78:0/4227647397 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f30fc07baf0 con 0x7f30f40038e0 2023-08-17T17:34:39.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.460+0000 7f3109d9b700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30ec05ed90 0x7f30ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.460+0000 7f3109d9b700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30ec05ed90 0x7f30ec061250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3100009270 tx=0x7f3100008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:39.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.464+0000 7f30fa7fc700 1 -- 172.21.15.78:0/4227647397 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f30fc04d0d0 con 0x7f30f40038e0 2023-08-17T17:34:39.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.630+0000 7f3110e32700 1 -- 172.21.15.78:0/4227647397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f310c046af0 con 0x7f30f40038e0 2023-08-17T17:34:39.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.630+0000 7f30fa7fc700 1 -- 172.21.15.78:0/4227647397 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f30fc02c030 con 0x7f30f40038e0 2023-08-17T17:34:39.632 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:34:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 -- 172.21.15.78:0/4227647397 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30ec05ed90 msgr2=0x7f30ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30ec05ed90 0x7f30ec061250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3100009270 tx=0x7f3100008040).stop 2023-08-17T17:34:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 -- 172.21.15.78:0/4227647397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 msgr2=0x7f310c1653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 0x7f310c1653d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f30f40044c0 tx=0x7f30fc01a000).stop 2023-08-17T17:34:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 -- 172.21.15.78:0/4227647397 shutdown_connections 2023-08-17T17:34:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30ec05ed90 0x7f30ec061250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f310c1509e0 0x7f310c0aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f40038e0 0x7f310c1653d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 --2- 172.21.15.78:0/4227647397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f310c0ad170 0x7f310c149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 -- 172.21.15.78:0/4227647397 >> 172.21.15.78:0/4227647397 conn(0x7f310c06a6a0 msgr2=0x7f310c153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 -- 172.21.15.78:0/4227647397 shutdown_connections 2023-08-17T17:34:39.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.632+0000 7f3110e32700 1 -- 172.21.15.78:0/4227647397 wait complete. 2023-08-17T17:34:39.645 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:34:39.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.759+0000 7fdec756a700 1 Processor -- start 2023-08-17T17:34:39.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.759+0000 7fdec756a700 1 -- start start 2023-08-17T17:34:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec756a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdec014ea60 0x7fdec0069310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec756a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdec0069800 0x7fdec00bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec756a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec00c5990 con 0x7fdec014e680 2023-08-17T17:34:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec756a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec00bcc10 con 0x7fdec0069800 2023-08-17T17:34:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec756a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec0069c90 con 0x7fdec014ea60 2023-08-17T17:34:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec5b07700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdec0069800 0x7fdec00bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec5b07700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdec0069800 0x7fdec00bd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48666/0 (socket says 172.21.15.78:48666) 2023-08-17T17:34:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec5b07700 1 -- 172.21.15.78:0/1818422755 learned_addr learned my addr 172.21.15.78:0/1818422755 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec4b05700 1 --2- 172.21.15.78:0/1818422755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdec014ea60 0x7fdec0069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec5b07700 1 -- 172.21.15.78:0/1818422755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdec014ea60 msgr2=0x7fdec0069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec5b07700 1 --2- 172.21.15.78:0/1818422755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdec014ea60 0x7fdec0069310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec5b07700 1 -- 172.21.15.78:0/1818422755 >> v1:172.21.15.150:6789/0 conn(0x7fdec014e680 legacy=0x7fdec00c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec5b07700 1 -- 172.21.15.78:0/1818422755 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00c4120 con 0x7fdec0069800 2023-08-17T17:34:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.760+0000 7fdec5b07700 1 --2- 172.21.15.78:0/1818422755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec0069800 0x7fdec00bd0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fdeb0006fd0 tx=0x7fdeb00090f0).ready entity=mon.0 client_cookie=5f69ad0ea81c1bce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdebffff700 1 -- 172.21.15.78:0/1818422755 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000b600 con 0x7fdec0069800 2023-08-17T17:34:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdebffff700 1 -- 172.21.15.78:0/1818422755 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb000b760 con 0x7fdec0069800 2023-08-17T17:34:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdebffff700 1 -- 172.21.15.78:0/1818422755 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000bae0 con 0x7fdec0069800 2023-08-17T17:34:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdec756a700 1 -- 172.21.15.78:0/1818422755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec0069800 msgr2=0x7fdec00bd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdec756a700 1 --2- 172.21.15.78:0/1818422755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec0069800 0x7fdec00bd0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fdeb0006fd0 tx=0x7fdeb00090f0).stop 2023-08-17T17:34:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdec756a700 1 -- 172.21.15.78:0/1818422755 shutdown_connections 2023-08-17T17:34:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdec756a700 1 --2- 172.21.15.78:0/1818422755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec0069800 0x7fdec00bd0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdec756a700 1 --2- 172.21.15.78:0/1818422755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdec014ea60 0x7fdec0069310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdec756a700 1 -- 172.21.15.78:0/1818422755 >> 172.21.15.78:0/1818422755 conn(0x7fdec00c7b80 msgr2=0x7fdec00c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdec756a700 1 -- 172.21.15.78:0/1818422755 shutdown_connections 2023-08-17T17:34:39.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.761+0000 7fdec756a700 1 -- 172.21.15.78:0/1818422755 wait complete. 2023-08-17T17:34:39.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.762+0000 7fdec756a700 1 Processor -- start 2023-08-17T17:34:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.762+0000 7fdec756a700 1 -- start start 2023-08-17T17:34:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec756a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdec0069800 0x7fdec00a90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec756a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec014e680 0x7fdec00a7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec756a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdec014ea60 0x7fdec015f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec756a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00a9780 con 0x7fdec014e680 2023-08-17T17:34:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec756a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00a9a60 con 0x7fdec014ea60 2023-08-17T17:34:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec756a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00a9d40 con 0x7fdec0069800 2023-08-17T17:34:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec4b05700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec014e680 0x7fdec00a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec4b05700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec014e680 0x7fdec00a7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48668/0 (socket says 172.21.15.78:48668) 2023-08-17T17:34:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec4b05700 1 -- 172.21.15.78:0/739754727 learned_addr learned my addr 172.21.15.78:0/739754727 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec5306700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdec0069800 0x7fdec00a90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.763+0000 7fdec5b07700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdec014ea60 0x7fdec015f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdec4b05700 1 -- 172.21.15.78:0/739754727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdec0069800 msgr2=0x7fdec00a90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdec4b05700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdec0069800 0x7fdec00a90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdec4b05700 1 -- 172.21.15.78:0/739754727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdec014ea60 msgr2=0x7fdec015f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdec4b05700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdec014ea60 0x7fdec015f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdec4b05700 1 -- 172.21.15.78:0/739754727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb0009370 con 0x7fdec014e680 2023-08-17T17:34:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdec4b05700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec014e680 0x7fdec00a7640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fdeb400c650 tx=0x7fdeb4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdebd7fa700 1 -- 172.21.15.78:0/739754727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4010580 con 0x7fdec014e680 2023-08-17T17:34:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdebd7fa700 1 -- 172.21.15.78:0/739754727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb40106e0 con 0x7fdec014e680 2023-08-17T17:34:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdebd7fa700 1 -- 172.21.15.78:0/739754727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4010a60 con 0x7fdec014e680 2023-08-17T17:34:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdec756a700 1 -- 172.21.15.78:0/739754727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec00aa020 con 0x7fdec014e680 2023-08-17T17:34:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.764+0000 7fdec756a700 1 -- 172.21.15.78:0/739754727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec00a7b30 con 0x7fdec014e680 2023-08-17T17:34:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.765+0000 7fdec756a700 1 -- 172.21.15.78:0/739754727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec0068270 con 0x7fdec014e680 2023-08-17T17:34:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.765+0000 7fdebd7fa700 1 -- 172.21.15.78:0/739754727 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdeb401b460 con 0x7fdec014e680 2023-08-17T17:34:39.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.765+0000 7fdebd7fa700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdeac05ed90 0x7fdeac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:39.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.765+0000 7fdebd7fa700 1 -- 172.21.15.78:0/739754727 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdeb4079b70 con 0x7fdec014e680 2023-08-17T17:34:39.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.765+0000 7fdec5306700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdeac05ed90 0x7fdeac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:39.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.766+0000 7fdec5306700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdeac05ed90 0x7fdeac061250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fdeb8003e80 tx=0x7fdeb8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:39.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.769+0000 7fdebd7fa700 1 -- 172.21.15.78:0/739754727 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdeb404b0b0 con 0x7fdec014e680 2023-08-17T17:34:39.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.932+0000 7fdec756a700 1 -- 172.21.15.78:0/739754727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdec00c3880 con 0x7fdec014e680 2023-08-17T17:34:39.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.932+0000 7fdebd7fa700 1 -- 172.21.15.78:0/739754727 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdeb404e6d0 con 0x7fdec014e680 2023-08-17T17:34:39.934 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:39.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 -- 172.21.15.78:0/739754727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdeac05ed90 msgr2=0x7fdeac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdeac05ed90 0x7fdeac061250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fdeb8003e80 tx=0x7fdeb8009040).stop 2023-08-17T17:34:39.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 -- 172.21.15.78:0/739754727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec014e680 msgr2=0x7fdec00a7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:39.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec014e680 0x7fdec00a7640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fdeb400c650 tx=0x7fdeb4008040).stop 2023-08-17T17:34:39.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 -- 172.21.15.78:0/739754727 shutdown_connections 2023-08-17T17:34:39.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdeac05ed90 0x7fdeac061250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdec014ea60 0x7fdec015f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdec0069800 0x7fdec00a90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 --2- 172.21.15.78:0/739754727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdec014e680 0x7fdec00a7640 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:39.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 -- 172.21.15.78:0/739754727 >> 172.21.15.78:0/739754727 conn(0x7fdec00c7b80 msgr2=0x7fdec0065880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:39.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 -- 172.21.15.78:0/739754727 shutdown_connections 2023-08-17T17:34:39.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:39.934+0000 7fdec756a700 1 -- 172.21.15.78:0/739754727 wait complete. 2023-08-17T17:34:39.947 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:34:40.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.062+0000 7f3167f3f700 1 Processor -- start 2023-08-17T17:34:40.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.062+0000 7f3167f3f700 1 -- start start 2023-08-17T17:34:40.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3167f3f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31600aa0f0 0x7f31600644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3167f3f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31600aa4d0 0x7f31600c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3167f3f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 0x7f31600c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3167f3f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31600649b0 con 0x7f31600aa0f0 2023-08-17T17:34:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3167f3f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31600c6140 con 0x7f31600aa4d0 2023-08-17T17:34:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3167f3f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3160063420 con 0x7f31600c5810 2023-08-17T17:34:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3165cdb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31600aa0f0 0x7f31600644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3165cdb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31600aa0f0 0x7f31600644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48674/0 (socket says 172.21.15.78:48674) 2023-08-17T17:34:40.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3165cdb700 1 -- 172.21.15.78:0/4237673306 learned_addr learned my addr 172.21.15.78:0/4237673306 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:40.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f31654da700 1 --2- 172.21.15.78:0/4237673306 >> v2:172.21.15.150:3300/0 conn(0x7f31600aa4d0 0x7f31600c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f31664dc700 1 --2- 172.21.15.78:0/4237673306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 0x7f31600c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3165cdb700 1 -- 172.21.15.78:0/4237673306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 msgr2=0x7f31600c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:40.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3165cdb700 1 --2- 172.21.15.78:0/4237673306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 0x7f31600c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3165cdb700 1 -- 172.21.15.78:0/4237673306 >> v2:172.21.15.150:3300/0 conn(0x7f31600aa4d0 msgr2=0x7f31600c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:40.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3165cdb700 1 --2- 172.21.15.78:0/4237673306 >> v2:172.21.15.150:3300/0 conn(0x7f31600aa4d0 0x7f31600c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3165cdb700 1 -- 172.21.15.78:0/4237673306 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160063700 con 0x7f31600aa0f0 2023-08-17T17:34:40.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f31664dc700 1 --2- 172.21.15.78:0/4237673306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 0x7f31600c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:40.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.063+0000 7f3165cdb700 1 --2- 172.21.15.78:0/4237673306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 0x7f31600644c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f3160159060 tx=0x7f315c009840).ready entity=mon.0 client_cookie=5e25b86384439e6e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:40.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3164cd9700 1 -- 172.21.15.78:0/4237673306 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00e070 con 0x7f31600aa0f0 2023-08-17T17:34:40.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3164cd9700 1 -- 172.21.15.78:0/4237673306 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c00ba50 con 0x7f31600aa0f0 2023-08-17T17:34:40.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3164cd9700 1 -- 172.21.15.78:0/4237673306 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00bdd0 con 0x7f31600aa0f0 2023-08-17T17:34:40.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3167f3f700 1 -- 172.21.15.78:0/4237673306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 msgr2=0x7f31600644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3167f3f700 1 --2- 172.21.15.78:0/4237673306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 0x7f31600644c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f3160159060 tx=0x7f315c009840).stop 2023-08-17T17:34:40.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3167f3f700 1 -- 172.21.15.78:0/4237673306 shutdown_connections 2023-08-17T17:34:40.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3167f3f700 1 --2- 172.21.15.78:0/4237673306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 0x7f31600644c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3167f3f700 1 --2- 172.21.15.78:0/4237673306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 0x7f31600c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3167f3f700 1 --2- 172.21.15.78:0/4237673306 >> v2:172.21.15.150:3300/0 conn(0x7f31600aa4d0 0x7f31600c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3167f3f700 1 -- 172.21.15.78:0/4237673306 >> 172.21.15.78:0/4237673306 conn(0x7f316006a6a0 msgr2=0x7f31600caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:40.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3167f3f700 1 -- 172.21.15.78:0/4237673306 shutdown_connections 2023-08-17T17:34:40.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.064+0000 7f3167f3f700 1 -- 172.21.15.78:0/4237673306 wait complete. 2023-08-17T17:34:40.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.065+0000 7f3167f3f700 1 Processor -- start 2023-08-17T17:34:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.065+0000 7f3167f3f700 1 -- start start 2023-08-17T17:34:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3167f3f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 0x7f3160142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3167f3f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31600aa4d0 0x7f31600acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3167f3f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 0x7f31600ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3167f3f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600ab310 con 0x7f31600aa0f0 2023-08-17T17:34:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3167f3f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600aaa50 con 0x7f31600aa4d0 2023-08-17T17:34:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3167f3f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31600aacc0 con 0x7f31600c5810 2023-08-17T17:34:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3165cdb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 0x7f3160142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3165cdb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 0x7f3160142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48686/0 (socket says 172.21.15.78:48686) 2023-08-17T17:34:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3165cdb700 1 -- 172.21.15.78:0/3634785846 learned_addr learned my addr 172.21.15.78:0/3634785846 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f31654da700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31600aa4d0 0x7f31600acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f31664dc700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 0x7f31600ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3165cdb700 1 -- 172.21.15.78:0/3634785846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 msgr2=0x7f31600ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3165cdb700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 0x7f31600ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3165cdb700 1 -- 172.21.15.78:0/3634785846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31600aa4d0 msgr2=0x7f31600acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3165cdb700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31600aa4d0 0x7f31600acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3165cdb700 1 -- 172.21.15.78:0/3634785846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c009ae0 con 0x7f31600aa0f0 2023-08-17T17:34:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.066+0000 7f3165cdb700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 0x7f3160142b40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f315c00ba00 tx=0x7f31600c6bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.067+0000 7f3155ffb700 1 -- 172.21.15.78:0/3634785846 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00bbc0 con 0x7f31600aa0f0 2023-08-17T17:34:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.067+0000 7f3155ffb700 1 -- 172.21.15.78:0/3634785846 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c00bd20 con 0x7f31600aa0f0 2023-08-17T17:34:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.067+0000 7f3167f3f700 1 -- 172.21.15.78:0/3634785846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31600aafa0 con 0x7f31600aa0f0 2023-08-17T17:34:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.067+0000 7f3155ffb700 1 -- 172.21.15.78:0/3634785846 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c01d670 con 0x7f31600aa0f0 2023-08-17T17:34:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.067+0000 7f3167f3f700 1 -- 172.21.15.78:0/3634785846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3160143030 con 0x7f31600aa0f0 2023-08-17T17:34:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.068+0000 7f3167f3f700 1 -- 172.21.15.78:0/3634785846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3160083980 con 0x7f31600aa0f0 2023-08-17T17:34:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.068+0000 7f3155ffb700 1 -- 172.21.15.78:0/3634785846 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f315c024030 con 0x7f31600aa0f0 2023-08-17T17:34:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.068+0000 7f3155ffb700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f314405ed90 0x7f3144061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.068+0000 7f3155ffb700 1 -- 172.21.15.78:0/3634785846 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f315c07aef0 con 0x7f31600aa0f0 2023-08-17T17:34:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.069+0000 7f31654da700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f314405ed90 0x7f3144061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.069+0000 7f31654da700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f314405ed90 0x7f3144061250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f31600b0cc0 tx=0x7f3150008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.072+0000 7f3155ffb700 1 -- 172.21.15.78:0/3634785846 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f315c04c540 con 0x7f31600aa0f0 2023-08-17T17:34:40.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.234+0000 7f3167f3f700 1 -- 172.21.15.78:0/3634785846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3160046af0 con 0x7f31600aa0f0 2023-08-17T17:34:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.234+0000 7f3155ffb700 1 -- 172.21.15.78:0/3634785846 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f315c022030 con 0x7f31600aa0f0 2023-08-17T17:34:40.236 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:40.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 -- 172.21.15.78:0/3634785846 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f314405ed90 msgr2=0x7f3144061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f314405ed90 0x7f3144061250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f31600b0cc0 tx=0x7f3150008040).stop 2023-08-17T17:34:40.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 -- 172.21.15.78:0/3634785846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 msgr2=0x7f3160142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 0x7f3160142b40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f315c00ba00 tx=0x7f31600c6bb0).stop 2023-08-17T17:34:40.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 -- 172.21.15.78:0/3634785846 shutdown_connections 2023-08-17T17:34:40.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f314405ed90 0x7f3144061250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31600c5810 0x7f31600ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31600aa0f0 0x7f3160142b40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 --2- 172.21.15.78:0/3634785846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31600aa4d0 0x7f31600acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 -- 172.21.15.78:0/3634785846 >> 172.21.15.78:0/3634785846 conn(0x7f316006a6a0 msgr2=0x7f31601517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 -- 172.21.15.78:0/3634785846 shutdown_connections 2023-08-17T17:34:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.236+0000 7f3167f3f700 1 -- 172.21.15.78:0/3634785846 wait complete. 2023-08-17T17:34:40.250 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:34:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.361+0000 7fa6fd4fc700 1 Processor -- start 2023-08-17T17:34:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.361+0000 7fa6fd4fc700 1 -- start start 2023-08-17T17:34:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.362+0000 7fa6fd4fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa6f80c6ee0 0x7fa6f80c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.362+0000 7fa6fd4fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c0df0 0x7fa6f80ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.362+0000 7fa6fd4fc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f80c7350 con 0x7fa6f8154140 2023-08-17T17:34:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.362+0000 7fa6fd4fc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f80a8350 con 0x7fa6f80c6ee0 2023-08-17T17:34:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.362+0000 7fa6fd4fc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80c1280 con 0x7fa6f80c0df0 2023-08-17T17:34:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.362+0000 7fa6f77fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c0df0 0x7fa6f80ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.362+0000 7fa6f6ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa6f8154140 0x7fa6f80a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:55758/0 (socket says 172.21.15.78:55758) 2023-08-17T17:34:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.362+0000 7fa6f6ffd700 1 -- 172.21.15.78:0/1902136797 learned_addr learned my addr 172.21.15.78:0/1902136797 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.362+0000 7fa6f67fc700 1 --2- 172.21.15.78:0/1902136797 >> v2:172.21.15.150:3300/0 conn(0x7fa6f80c6ee0 0x7fa6f80c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f5ffb700 1 -- 172.21.15.78:0/1902136797 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274100903 0 0) 0x7fa6f80c7350 con 0x7fa6f8154140 2023-08-17T17:34:40.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f5ffb700 1 -- 172.21.15.78:0/1902136797 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e00033f0 con 0x7fa6f8154140 2023-08-17T17:34:40.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f77fe700 1 -- 172.21.15.78:0/1902136797 >> v2:172.21.15.150:3300/0 conn(0x7fa6f80c6ee0 msgr2=0x7fa6f80c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:40.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f77fe700 1 --2- 172.21.15.78:0/1902136797 >> v2:172.21.15.150:3300/0 conn(0x7fa6f80c6ee0 0x7fa6f80c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f77fe700 1 -- 172.21.15.78:0/1902136797 >> v1:172.21.15.150:6789/0 conn(0x7fa6f8154140 legacy=0x7fa6f80a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f77fe700 1 -- 172.21.15.78:0/1902136797 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8154520 con 0x7fa6f80c0df0 2023-08-17T17:34:40.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f67fc700 1 --2- 172.21.15.78:0/1902136797 >> v2:172.21.15.150:3300/0 conn(0x7fa6f80c6ee0 0x7fa6f80c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:40.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f77fe700 1 --2- 172.21.15.78:0/1902136797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c0df0 0x7fa6f80ca280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa6f0009760 tx=0x7fa6f0009060).ready entity=mon.2 client_cookie=261555afed047f3d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:40.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f5ffb700 1 -- 172.21.15.78:0/1902136797 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f000d4a0 con 0x7fa6f80c0df0 2023-08-17T17:34:40.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f5ffb700 1 -- 172.21.15.78:0/1902136797 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f000d600 con 0x7fa6f80c0df0 2023-08-17T17:34:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6f5ffb700 1 -- 172.21.15.78:0/1902136797 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f000d980 con 0x7fa6f80c0df0 2023-08-17T17:34:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/1902136797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c0df0 msgr2=0x7fa6f80ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.363+0000 7fa6fd4fc700 1 --2- 172.21.15.78:0/1902136797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c0df0 0x7fa6f80ca280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa6f0009760 tx=0x7fa6f0009060).stop 2023-08-17T17:34:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.364+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/1902136797 shutdown_connections 2023-08-17T17:34:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.364+0000 7fa6fd4fc700 1 --2- 172.21.15.78:0/1902136797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c0df0 0x7fa6f80ca280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.364+0000 7fa6fd4fc700 1 --2- 172.21.15.78:0/1902136797 >> v2:172.21.15.150:3300/0 conn(0x7fa6f80c6ee0 0x7fa6f80c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.364+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/1902136797 >> 172.21.15.78:0/1902136797 conn(0x7fa6f8094510 msgr2=0x7fa6f806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.364+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/1902136797 shutdown_connections 2023-08-17T17:34:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.364+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/1902136797 wait complete. 2023-08-17T17:34:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.365+0000 7fa6fd4fc700 1 Processor -- start 2023-08-17T17:34:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.365+0000 7fa6fd4fc700 1 -- start start 2023-08-17T17:34:40.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6fd4fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c0df0 0x7fa6f80c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6fd4fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c6ee0 0x7fa6f80c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6fd4fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8154140 0x7fa6f8143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6fd4fc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f81574d0 con 0x7fa6f80c0df0 2023-08-17T17:34:40.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6fd4fc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8157640 con 0x7fa6f8154140 2023-08-17T17:34:40.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6fd4fc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80c30e0 con 0x7fa6f80c6ee0 2023-08-17T17:34:40.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c0df0 0x7fa6f80c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c0df0 0x7fa6f80c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48690/0 (socket says 172.21.15.78:48690) 2023-08-17T17:34:40.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f6ffd700 1 -- 172.21.15.78:0/95681079 learned_addr learned my addr 172.21.15.78:0/95681079 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:40.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f67fc700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c6ee0 0x7fa6f80c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f6ffd700 1 -- 172.21.15.78:0/95681079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c6ee0 msgr2=0x7fa6f80c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f77fe700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8154140 0x7fa6f8143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f6ffd700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c6ee0 0x7fa6f80c28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f6ffd700 1 -- 172.21.15.78:0/95681079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8154140 msgr2=0x7fa6f8143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f6ffd700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8154140 0x7fa6f8143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f6ffd700 1 -- 172.21.15.78:0/95681079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec0092a0 con 0x7fa6f80c0df0 2023-08-17T17:34:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6f6ffd700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c0df0 0x7fa6f80c49c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fa6e8002250 tx=0x7fa6e80015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6deffd700 1 -- 172.21.15.78:0/95681079 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8005d30 con 0x7fa6f80c0df0 2023-08-17T17:34:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6deffd700 1 -- 172.21.15.78:0/95681079 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8005e90 con 0x7fa6f80c0df0 2023-08-17T17:34:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/95681079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f00092a0 con 0x7fa6f80c0df0 2023-08-17T17:34:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6deffd700 1 -- 172.21.15.78:0/95681079 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8007320 con 0x7fa6f80c0df0 2023-08-17T17:34:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.366+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/95681079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f80c36a0 con 0x7fa6f80c0df0 2023-08-17T17:34:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.367+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/95681079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f8047350 con 0x7fa6f80c0df0 2023-08-17T17:34:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.367+0000 7fa6deffd700 1 -- 172.21.15.78:0/95681079 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa6e8010030 con 0x7fa6f80c0df0 2023-08-17T17:34:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.368+0000 7fa6deffd700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6e405ed90 0x7fa6e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.368+0000 7fa6deffd700 1 -- 172.21.15.78:0/95681079 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa6e8079b10 con 0x7fa6f80c0df0 2023-08-17T17:34:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.368+0000 7fa6f67fc700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6e405ed90 0x7fa6e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.368+0000 7fa6f67fc700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6e405ed90 0x7fa6e4061250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa6ec006d80 tx=0x7fa6ec008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:40.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.372+0000 7fa6deffd700 1 -- 172.21.15.78:0/95681079 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa6e804b0b0 con 0x7fa6f80c0df0 2023-08-17T17:34:40.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.575+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/95681079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6f80c91e0 con 0x7fa6f80c0df0 2023-08-17T17:34:40.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.576+0000 7fa6deffd700 1 -- 172.21.15.78:0/95681079 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7fa6e804e6d0 con 0x7fa6f80c0df0 2023-08-17T17:34:40.578 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:40.578 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4150014676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4150014676},{"type":"v1","addr":"172.21.15.150:6834","nonce":4150014676}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1895700227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1895700227},{"type":"v1","addr":"172.21.15.150:6835","nonce":1895700227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3007671664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3007671664},{"type":"v1","addr":"172.21.15.78:6835","nonce":3007671664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:34:23.529472+0000","modified":"2023-08-17T17:34:25.535687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/2283193122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2283193122},{"type":"v1","addr":"172.21.15.78:6837","nonce":2283193122}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T17:34:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/95681079 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6e405ed90 msgr2=0x7fa6e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6e405ed90 0x7fa6e4061250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa6ec006d80 tx=0x7fa6ec008040).stop 2023-08-17T17:34:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/95681079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c0df0 msgr2=0x7fa6f80c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c0df0 0x7fa6f80c49c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fa6e8002250 tx=0x7fa6e80015b0).stop 2023-08-17T17:34:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/95681079 shutdown_connections 2023-08-17T17:34:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6e405ed90 0x7fa6e4061250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8154140 0x7fa6f8143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c0df0 0x7fa6f80c49c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 --2- 172.21.15.78:0/95681079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f80c6ee0 0x7fa6f80c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/95681079 >> 172.21.15.78:0/95681079 conn(0x7fa6f8094510 msgr2=0x7fa6f80c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/95681079 shutdown_connections 2023-08-17T17:34:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.578+0000 7fa6fd4fc700 1 -- 172.21.15.78:0/95681079 wait complete. 2023-08-17T17:34:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2023-08-17T17:34:40.591 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.702+0000 7f80ec1c6700 1 Processor -- start 2023-08-17T17:34:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.702+0000 7f80ec1c6700 1 -- start start 2023-08-17T17:34:40.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.703+0000 7f80ec1c6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80e4154140 0x7f80e40c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.703+0000 7f80ec1c6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80e40a7c40 0x7f80e40c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.703+0000 7f80ec1c6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f80e40a8080 0x7f80e40c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.703+0000 7f80ec1c6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e40c12e0 con 0x7f80e40a7c40 2023-08-17T17:34:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.703+0000 7f80ec1c6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e4154520 con 0x7f80e40a8080 2023-08-17T17:34:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.703+0000 7f80ec1c6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40c91e0 con 0x7f80e4154140 2023-08-17T17:34:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.703+0000 7f80e9761700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80e40a7c40 0x7f80e40c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.703+0000 7f80e9761700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80e40a7c40 0x7f80e40c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48706/0 (socket says 172.21.15.78:48706) 2023-08-17T17:34:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.703+0000 7f80e9761700 1 -- 172.21.15.78:0/1635214177 learned_addr learned my addr 172.21.15.78:0/1635214177 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80e9f62700 1 --2- 172.21.15.78:0/1635214177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80e4154140 0x7f80e40c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80ea763700 1 --2- 172.21.15.78:0/1635214177 >> v2:172.21.15.150:3300/0 conn(0x7f80e40a8080 0x7f80e40c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80e9761700 1 -- 172.21.15.78:0/1635214177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80e4154140 msgr2=0x7f80e40c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80e9761700 1 --2- 172.21.15.78:0/1635214177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80e4154140 0x7f80e40c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80e9761700 1 -- 172.21.15.78:0/1635214177 >> v2:172.21.15.150:3300/0 conn(0x7f80e40a8080 msgr2=0x7f80e40c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80e9761700 1 --2- 172.21.15.78:0/1635214177 >> v2:172.21.15.150:3300/0 conn(0x7f80e40a8080 0x7f80e40c0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80e9761700 1 -- 172.21.15.78:0/1635214177 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40c94c0 con 0x7f80e40a7c40 2023-08-17T17:34:40.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80e9761700 1 --2- 172.21.15.78:0/1635214177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 0x7f80e40c0900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f80e406bd60 tx=0x7f80d40090f0).ready entity=mon.0 client_cookie=ce8c19e6e5c41621 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:40.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80e8f60700 1 -- 172.21.15.78:0/1635214177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400b600 con 0x7f80e40a7c40 2023-08-17T17:34:40.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80e8f60700 1 -- 172.21.15.78:0/1635214177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d400b760 con 0x7f80e40a7c40 2023-08-17T17:34:40.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80e8f60700 1 -- 172.21.15.78:0/1635214177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400bae0 con 0x7f80e40a7c40 2023-08-17T17:34:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80ec1c6700 1 -- 172.21.15.78:0/1635214177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 msgr2=0x7f80e40c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80ec1c6700 1 --2- 172.21.15.78:0/1635214177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 0x7f80e40c0900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f80e406bd60 tx=0x7f80d40090f0).stop 2023-08-17T17:34:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80ec1c6700 1 -- 172.21.15.78:0/1635214177 shutdown_connections 2023-08-17T17:34:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80ec1c6700 1 --2- 172.21.15.78:0/1635214177 >> v2:172.21.15.150:3300/0 conn(0x7f80e40a8080 0x7f80e40c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80ec1c6700 1 --2- 172.21.15.78:0/1635214177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80e4154140 0x7f80e40c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80ec1c6700 1 --2- 172.21.15.78:0/1635214177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 0x7f80e40c0900 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.704+0000 7f80ec1c6700 1 -- 172.21.15.78:0/1635214177 >> 172.21.15.78:0/1635214177 conn(0x7f80e4094510 msgr2=0x7f80e406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.705+0000 7f80ec1c6700 1 -- 172.21.15.78:0/1635214177 shutdown_connections 2023-08-17T17:34:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.705+0000 7f80ec1c6700 1 -- 172.21.15.78:0/1635214177 wait complete. 2023-08-17T17:34:40.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.706+0000 7f80ec1c6700 1 Processor -- start 2023-08-17T17:34:40.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.706+0000 7f80ec1c6700 1 -- start start 2023-08-17T17:34:40.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.706+0000 7f80ec1c6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 0x7f80e40b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.706+0000 7f80ec1c6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80e40a8080 0x7f80e40ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.706+0000 7f80ec1c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e4154140 0x7f80e40ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.706+0000 7f80ec1c6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40af3c0 con 0x7f80e40a7c40 2023-08-17T17:34:40.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.706+0000 7f80ec1c6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4164f10 con 0x7f80e4154140 2023-08-17T17:34:40.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.706+0000 7f80ec1c6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40aeb20 con 0x7f80e40a8080 2023-08-17T17:34:40.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80e9f62700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 0x7f80e40b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80e9f62700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 0x7f80e40b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48720/0 (socket says 172.21.15.78:48720) 2023-08-17T17:34:40.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80e9f62700 1 -- 172.21.15.78:0/3824096797 learned_addr learned my addr 172.21.15.78:0/3824096797 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:40.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80e9f62700 1 -- 172.21.15.78:0/3824096797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80e40a8080 msgr2=0x7f80e40ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80e9f62700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80e40a8080 0x7f80e40ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:40.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80e9f62700 1 -- 172.21.15.78:0/3824096797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e4154140 msgr2=0x7f80e40ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80e9f62700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e4154140 0x7f80e40ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80e9f62700 1 -- 172.21.15.78:0/3824096797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d4009370 con 0x7f80e40a7c40 2023-08-17T17:34:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80e9f62700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 0x7f80e40b08f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f80e000d890 tx=0x7f80e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80d9ffb700 1 -- 172.21.15.78:0/3824096797 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00125f0 con 0x7f80e40a7c40 2023-08-17T17:34:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80d9ffb700 1 -- 172.21.15.78:0/3824096797 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e0012750 con 0x7f80e40a7c40 2023-08-17T17:34:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80ec1c6700 1 -- 172.21.15.78:0/3824096797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e40aee00 con 0x7f80e40a7c40 2023-08-17T17:34:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80d9ffb700 1 -- 172.21.15.78:0/3824096797 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0012ad0 con 0x7f80e40a7c40 2023-08-17T17:34:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.707+0000 7f80ec1c6700 1 -- 172.21.15.78:0/3824096797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e40ad370 con 0x7f80e40a7c40 2023-08-17T17:34:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.708+0000 7f80d9ffb700 1 -- 172.21.15.78:0/3824096797 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f80e0013480 con 0x7f80e40a7c40 2023-08-17T17:34:40.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.708+0000 7f80ec1c6700 1 -- 172.21.15.78:0/3824096797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e4047350 con 0x7f80e40a7c40 2023-08-17T17:34:40.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.709+0000 7f80d9ffb700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f80c805ed90 0x7f80c8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:40.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.709+0000 7f80d9ffb700 1 -- 172.21.15.78:0/3824096797 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f80e0079ac0 con 0x7f80e40a7c40 2023-08-17T17:34:40.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.709+0000 7f80e9761700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f80c805ed90 0x7f80c8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:40.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.709+0000 7f80e9761700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f80c805ed90 0x7f80c8061250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f80e406bd60 tx=0x7f80d4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:40.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.713+0000 7f80d9ffb700 1 -- 172.21.15.78:0/3824096797 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f80e004b000 con 0x7f80e40a7c40 2023-08-17T17:34:40.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.876+0000 7f80ec1c6700 1 -- 172.21.15.78:0/3824096797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80e405ed40 con 0x7f80e40a7c40 2023-08-17T17:34:40.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.877+0000 7f80d9ffb700 1 -- 172.21.15.78:0/3824096797 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f80e004e620 con 0x7f80e40a7c40 2023-08-17T17:34:40.879 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:40.879 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:40.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 -- 172.21.15.78:0/3824096797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f80c805ed90 msgr2=0x7f80c8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f80c805ed90 0x7f80c8061250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f80e406bd60 tx=0x7f80d4017000).stop 2023-08-17T17:34:40.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 -- 172.21.15.78:0/3824096797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 msgr2=0x7f80e40b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:40.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 0x7f80e40b08f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f80e000d890 tx=0x7f80e0008040).stop 2023-08-17T17:34:40.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 -- 172.21.15.78:0/3824096797 shutdown_connections 2023-08-17T17:34:40.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f80c805ed90 0x7f80c8061250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80e4154140 0x7f80e40ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:40.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e40a7c40 0x7f80e40b08f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:40.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 --2- 172.21.15.78:0/3824096797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80e40a8080 0x7f80e40ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:40.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 -- 172.21.15.78:0/3824096797 >> 172.21.15.78:0/3824096797 conn(0x7f80e4094510 msgr2=0x7f80e40c04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:40.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 -- 172.21.15.78:0/3824096797 shutdown_connections 2023-08-17T17:34:40.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:40.879+0000 7f80ec1c6700 1 -- 172.21.15.78:0/3824096797 wait complete. 2023-08-17T17:34:40.893 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:34:41.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.003+0000 7f95ddb58700 1 Processor -- start 2023-08-17T17:34:41.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.003+0000 7f95ddb58700 1 -- start start 2023-08-17T17:34:41.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.004+0000 7f95ddb58700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95d80c6ee0 0x7f95d80c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.004+0000 7f95ddb58700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95d80c0df0 0x7f95d80ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.004+0000 7f95ddb58700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d80c7350 con 0x7f95d8154140 2023-08-17T17:34:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.004+0000 7f95ddb58700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d80a8350 con 0x7f95d80c6ee0 2023-08-17T17:34:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.004+0000 7f95ddb58700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80c1280 con 0x7f95d80c0df0 2023-08-17T17:34:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.004+0000 7f95d6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95d80c6ee0 0x7f95d80c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.004+0000 7f95d6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95d80c6ee0 0x7f95d80c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48730/0 (socket says 172.21.15.78:48730) 2023-08-17T17:34:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.004+0000 7f95d6ffd700 1 -- 172.21.15.78:0/3927208641 learned_addr learned my addr 172.21.15.78:0/3927208641 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.004+0000 7f95d7fff700 1 --2- 172.21.15.78:0/3927208641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95d80c0df0 0x7f95d80ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95d6ffd700 1 -- 172.21.15.78:0/3927208641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95d80c0df0 msgr2=0x7f95d80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95d6ffd700 1 --2- 172.21.15.78:0/3927208641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95d80c0df0 0x7f95d80ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95d6ffd700 1 -- 172.21.15.78:0/3927208641 >> v1:172.21.15.150:6789/0 conn(0x7f95d8154140 legacy=0x7f95d80a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95d6ffd700 1 -- 172.21.15.78:0/3927208641 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d8154520 con 0x7f95d80c6ee0 2023-08-17T17:34:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95d6ffd700 1 --2- 172.21.15.78:0/3927208641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 0x7f95d80c0900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f95cc006fd0 tx=0x7f95cc0090f0).ready entity=mon.0 client_cookie=a82c3931be0f9680 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95d67fc700 1 -- 172.21.15.78:0/3927208641 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00b580 con 0x7f95d80c6ee0 2023-08-17T17:34:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95d67fc700 1 -- 172.21.15.78:0/3927208641 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc00b6e0 con 0x7f95d80c6ee0 2023-08-17T17:34:41.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95d67fc700 1 -- 172.21.15.78:0/3927208641 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00ba60 con 0x7f95d80c6ee0 2023-08-17T17:34:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95ddb58700 1 -- 172.21.15.78:0/3927208641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 msgr2=0x7f95d80c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95ddb58700 1 --2- 172.21.15.78:0/3927208641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 0x7f95d80c0900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f95cc006fd0 tx=0x7f95cc0090f0).stop 2023-08-17T17:34:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95ddb58700 1 -- 172.21.15.78:0/3927208641 shutdown_connections 2023-08-17T17:34:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95ddb58700 1 --2- 172.21.15.78:0/3927208641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95d80c0df0 0x7f95d80ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95ddb58700 1 --2- 172.21.15.78:0/3927208641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 0x7f95d80c0900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95ddb58700 1 -- 172.21.15.78:0/3927208641 >> 172.21.15.78:0/3927208641 conn(0x7f95d8094510 msgr2=0x7f95d806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95ddb58700 1 -- 172.21.15.78:0/3927208641 shutdown_connections 2023-08-17T17:34:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.005+0000 7f95ddb58700 1 -- 172.21.15.78:0/3927208641 wait complete. 2023-08-17T17:34:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.007+0000 7f95ddb58700 1 Processor -- start 2023-08-17T17:34:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.007+0000 7f95ddb58700 1 -- start start 2023-08-17T17:34:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.007+0000 7f95ddb58700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95d80c0df0 0x7f95d80ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.007+0000 7f95ddb58700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 0x7f95d80c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.007+0000 7f95ddb58700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95d8154140 0x7f95d814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.007+0000 7f95ddb58700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80c3020 con 0x7f95d80c6ee0 2023-08-17T17:34:41.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.007+0000 7f95ddb58700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80c33a0 con 0x7f95d8154140 2023-08-17T17:34:41.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.007+0000 7f95ddb58700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80c2780 con 0x7f95d80c0df0 2023-08-17T17:34:41.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.007+0000 7f95d6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 0x7f95d80c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.007+0000 7f95d6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 0x7f95d80c1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48736/0 (socket says 172.21.15.78:48736) 2023-08-17T17:34:41.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95d6ffd700 1 -- 172.21.15.78:0/2096570355 learned_addr learned my addr 172.21.15.78:0/2096570355 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:41.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95d77fe700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95d80c0df0 0x7f95d80ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95d7fff700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95d8154140 0x7f95d814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95d6ffd700 1 -- 172.21.15.78:0/2096570355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95d80c0df0 msgr2=0x7f95d80ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95d6ffd700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95d80c0df0 0x7f95d80ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95d6ffd700 1 -- 172.21.15.78:0/2096570355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95d8154140 msgr2=0x7f95d814e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95d6ffd700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95d8154140 0x7f95d814e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95d6ffd700 1 -- 172.21.15.78:0/2096570355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc009370 con 0x7f95d80c6ee0 2023-08-17T17:34:41.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95d6ffd700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 0x7f95d80c1f30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f95cc009fd0 tx=0x7f95cc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:41.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95bf7fe700 1 -- 172.21.15.78:0/2096570355 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00b850 con 0x7f95d80c6ee0 2023-08-17T17:34:41.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95bf7fe700 1 -- 172.21.15.78:0/2096570355 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc00b9b0 con 0x7f95d80c6ee0 2023-08-17T17:34:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95ddb58700 1 -- 172.21.15.78:0/2096570355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d80c2a60 con 0x7f95d80c6ee0 2023-08-17T17:34:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95bf7fe700 1 -- 172.21.15.78:0/2096570355 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc01c670 con 0x7f95d80c6ee0 2023-08-17T17:34:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.008+0000 7f95ddb58700 1 -- 172.21.15.78:0/2096570355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d80c2420 con 0x7f95d80c6ee0 2023-08-17T17:34:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.009+0000 7f95ddb58700 1 -- 172.21.15.78:0/2096570355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d8047350 con 0x7f95d80c6ee0 2023-08-17T17:34:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.009+0000 7f95bf7fe700 1 -- 172.21.15.78:0/2096570355 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f95cc02c070 con 0x7f95d80c6ee0 2023-08-17T17:34:41.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.010+0000 7f95bf7fe700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95c405ed90 0x7f95c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.010+0000 7f95bf7fe700 1 -- 172.21.15.78:0/2096570355 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f95cc07b660 con 0x7f95d80c6ee0 2023-08-17T17:34:41.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.010+0000 7f95d77fe700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95c405ed90 0x7f95c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.010+0000 7f95d77fe700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95c405ed90 0x7f95c4061250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f95c8003dd0 tx=0x7f95c8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:41.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.014+0000 7f95bf7fe700 1 -- 172.21.15.78:0/2096570355 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f95cc04cc00 con 0x7f95d80c6ee0 2023-08-17T17:34:41.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.218+0000 7f95ddb58700 1 -- 172.21.15.78:0/2096570355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95d80c91e0 con 0x7f95d80c6ee0 2023-08-17T17:34:41.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.219+0000 7f95bf7fe700 1 -- 172.21.15.78:0/2096570355 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f95cc02a020 con 0x7f95d80c6ee0 2023-08-17T17:34:41.221 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:41.221 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4150014676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4150014676},{"type":"v1","addr":"172.21.15.150:6834","nonce":4150014676}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1895700227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1895700227},{"type":"v1","addr":"172.21.15.150:6835","nonce":1895700227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3007671664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3007671664},{"type":"v1","addr":"172.21.15.78:6835","nonce":3007671664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:34:23.529472+0000","modified":"2023-08-17T17:34:25.535687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/2283193122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2283193122},{"type":"v1","addr":"172.21.15.78:6837","nonce":2283193122}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T17:34:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 -- 172.21.15.78:0/2096570355 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95c405ed90 msgr2=0x7f95c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95c405ed90 0x7f95c4061250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f95c8003dd0 tx=0x7f95c8009040).stop 2023-08-17T17:34:41.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 -- 172.21.15.78:0/2096570355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 msgr2=0x7f95d80c1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 0x7f95d80c1f30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f95cc009fd0 tx=0x7f95cc017000).stop 2023-08-17T17:34:41.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 -- 172.21.15.78:0/2096570355 shutdown_connections 2023-08-17T17:34:41.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95c405ed90 0x7f95c4061250 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95d8154140 0x7f95d814e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95d80c0df0 0x7f95d80ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 --2- 172.21.15.78:0/2096570355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95d80c6ee0 0x7f95d80c1f30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 -- 172.21.15.78:0/2096570355 >> 172.21.15.78:0/2096570355 conn(0x7f95d8094510 msgr2=0x7f95d8064920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 -- 172.21.15.78:0/2096570355 shutdown_connections 2023-08-17T17:34:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.221+0000 7f95ddb58700 1 -- 172.21.15.78:0/2096570355 wait complete. 2023-08-17T17:34:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2023-08-17T17:34:41.636 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T17:34:23.529472+0000', 'modified': '2023-08-17T17:34:25.535687+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/2283193122', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 2283193122}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 2283193122}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T17:34:41.636 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T17:34:41.637 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-17T17:34:41.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.750+0000 7fcd0da7b700 1 Processor -- start 2023-08-17T17:34:41.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.750+0000 7fcd0da7b700 1 -- start start 2023-08-17T17:34:41.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd0da7b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd081541a0 0x7fcd080a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd0da7b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd08154580 0x7fcd080bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd0da7b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcd080c0340 0x7fcd080c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd0da7b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080a8190 con 0x7fcd08154580 2023-08-17T17:34:41.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd0da7b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080c8df0 con 0x7fcd080c0340 2023-08-17T17:34:41.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd0da7b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080c9970 con 0x7fcd081541a0 2023-08-17T17:34:41.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd06ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd08154580 0x7fcd080bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd06ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd08154580 0x7fcd080bfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48748/0 (socket says 172.21.15.78:48748) 2023-08-17T17:34:41.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd06ffd700 1 -- 172.21.15.78:0/310088067 learned_addr learned my addr 172.21.15.78:0/310088067 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:41.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd06ffd700 1 -- 172.21.15.78:0/310088067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd081541a0 msgr2=0x7fcd080a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd07fff700 1 --2- 172.21.15.78:0/310088067 >> v2:172.21.15.150:3300/0 conn(0x7fcd080c0340 0x7fcd080c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd077fe700 1 --2- 172.21.15.78:0/310088067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd081541a0 0x7fcd080a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/310088067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd081541a0 0x7fcd080a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd06ffd700 1 -- 172.21.15.78:0/310088067 >> v2:172.21.15.150:3300/0 conn(0x7fcd080c0340 msgr2=0x7fcd080c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/310088067 >> v2:172.21.15.150:3300/0 conn(0x7fcd080c0340 0x7fcd080c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd06ffd700 1 -- 172.21.15.78:0/310088067 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080c0770 con 0x7fcd08154580 2023-08-17T17:34:41.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd07fff700 1 --2- 172.21.15.78:0/310088067 >> v2:172.21.15.150:3300/0 conn(0x7fcd080c0340 0x7fcd080c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:41.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.751+0000 7fcd077fe700 1 --2- 172.21.15.78:0/310088067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd081541a0 0x7fcd080a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:41.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/310088067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd08154580 0x7fcd080bfe50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fcd08085a70 tx=0x7fccfc0090f0).ready entity=mon.0 client_cookie=2794279cc11934a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:41.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd067fc700 1 -- 172.21.15.78:0/310088067 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00b600 con 0x7fcd08154580 2023-08-17T17:34:41.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd067fc700 1 -- 172.21.15.78:0/310088067 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc00b760 con 0x7fcd08154580 2023-08-17T17:34:41.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd067fc700 1 -- 172.21.15.78:0/310088067 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00bb00 con 0x7fcd08154580 2023-08-17T17:34:41.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd0da7b700 1 -- 172.21.15.78:0/310088067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd08154580 msgr2=0x7fcd080bfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd0da7b700 1 --2- 172.21.15.78:0/310088067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd08154580 0x7fcd080bfe50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fcd08085a70 tx=0x7fccfc0090f0).stop 2023-08-17T17:34:41.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd0da7b700 1 -- 172.21.15.78:0/310088067 shutdown_connections 2023-08-17T17:34:41.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd0da7b700 1 --2- 172.21.15.78:0/310088067 >> v2:172.21.15.150:3300/0 conn(0x7fcd080c0340 0x7fcd080c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd0da7b700 1 --2- 172.21.15.78:0/310088067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd081541a0 0x7fcd080a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd0da7b700 1 --2- 172.21.15.78:0/310088067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd08154580 0x7fcd080bfe50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd0da7b700 1 -- 172.21.15.78:0/310088067 >> 172.21.15.78:0/310088067 conn(0x7fcd0806a400 msgr2=0x7fcd080caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:41.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd0da7b700 1 -- 172.21.15.78:0/310088067 shutdown_connections 2023-08-17T17:34:41.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.752+0000 7fcd0da7b700 1 -- 172.21.15.78:0/310088067 wait complete. 2023-08-17T17:34:41.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.753+0000 7fcd0da7b700 1 Processor -- start 2023-08-17T17:34:41.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd0da7b700 1 -- start start 2023-08-17T17:34:41.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd0da7b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080c0340 0x7fcd08159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd0da7b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd081541a0 0x7fcd080adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd0da7b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08154580 0x7fcd081511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd0da7b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080ae680 con 0x7fcd081541a0 2023-08-17T17:34:41.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd0da7b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080ae960 con 0x7fcd080c0340 2023-08-17T17:34:41.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd0da7b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080aec40 con 0x7fcd08154580 2023-08-17T17:34:41.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd06ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd081541a0 0x7fcd080adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd06ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd081541a0 0x7fcd080adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48752/0 (socket says 172.21.15.78:48752) 2023-08-17T17:34:41.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd06ffd700 1 -- 172.21.15.78:0/1035940233 learned_addr learned my addr 172.21.15.78:0/1035940233 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:41.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd077fe700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080c0340 0x7fcd08159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.754+0000 7fcd07fff700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08154580 0x7fcd081511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fcd06ffd700 1 -- 172.21.15.78:0/1035940233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08154580 msgr2=0x7fcd081511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08154580 0x7fcd081511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fcd06ffd700 1 -- 172.21.15.78:0/1035940233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080c0340 msgr2=0x7fcd08159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080c0340 0x7fcd08159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fcd06ffd700 1 -- 172.21.15.78:0/1035940233 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc009370 con 0x7fcd081541a0 2023-08-17T17:34:41.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd081541a0 0x7fcd080adea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fcd08083b60 tx=0x7fccfc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:41.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fccef7fe700 1 -- 172.21.15.78:0/1035940233 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc006d90 con 0x7fcd081541a0 2023-08-17T17:34:41.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fccef7fe700 1 -- 172.21.15.78:0/1035940233 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc00bec0 con 0x7fcd081541a0 2023-08-17T17:34:41.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fcd0da7b700 1 -- 172.21.15.78:0/1035940233 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd080aef20 con 0x7fcd081541a0 2023-08-17T17:34:41.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fccef7fe700 1 -- 172.21.15.78:0/1035940233 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc024470 con 0x7fcd081541a0 2023-08-17T17:34:41.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.755+0000 7fcd0da7b700 1 -- 172.21.15.78:0/1035940233 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd080ae390 con 0x7fcd081541a0 2023-08-17T17:34:41.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.756+0000 7fccef7fe700 1 -- 172.21.15.78:0/1035940233 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fccfc00f070 con 0x7fcd081541a0 2023-08-17T17:34:41.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.756+0000 7fccef7fe700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccf405ed90 0x7fccf4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.757+0000 7fccef7fe700 1 -- 172.21.15.78:0/1035940233 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fccfc07b680 con 0x7fcd081541a0 2023-08-17T17:34:41.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.757+0000 7fcd077fe700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccf405ed90 0x7fccf4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.757+0000 7fcd077fe700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccf405ed90 0x7fccf4061250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fccf800f600 tx=0x7fccf80077b0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:41.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.759+0000 7fcd1f410b80 1 Processor -- start 2023-08-17T17:34:41.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.759+0000 7fcd1f410b80 1 -- start start 2023-08-17T17:34:41.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82842000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8283cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e8283d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e82807d00 con 0x564e8288a8c0 2023-08-17T17:34:41.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e8277ecb0 con 0x564e82841c20 2023-08-17T17:34:41.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e82793c90 con 0x564e8283d3f0 2023-08-17T17:34:41.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd06ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8283cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd06ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8283cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48754/0 (socket says 172.21.15.78:48754) 2023-08-17T17:34:41.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd06ffd700 1 -- 172.21.15.78:0/231604438 learned_addr learned my addr 172.21.15.78:0/231604438 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:41.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd07fff700 1 --2- 172.21.15.78:0/231604438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e8283d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd077fe700 1 --2- 172.21.15.78:0/231604438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82842000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd06ffd700 1 -- 172.21.15.78:0/231604438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 msgr2=0x564e8283d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/231604438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e8283d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd06ffd700 1 -- 172.21.15.78:0/231604438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 msgr2=0x564e82842000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/231604438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82842000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd06ffd700 1 -- 172.21.15.78:0/231604438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e82636310 con 0x564e8288a8c0 2023-08-17T17:34:41.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd077fe700 1 --2- 172.21.15.78:0/231604438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82842000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:41.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/231604438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8283cf00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fccfc04cd70 tx=0x7fccfc07b040).ready entity=mon.0 client_cookie=ed6f852fb36793ea server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:41.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fccecff9700 1 -- 172.21.15.78:0/231604438 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc04ec80 con 0x564e8288a8c0 2023-08-17T17:34:41.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fccecff9700 1 -- 172.21.15.78:0/231604438 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc079900 con 0x564e8288a8c0 2023-08-17T17:34:41.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.760+0000 7fccecff9700 1 -- 172.21.15.78:0/231604438 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc079a70 con 0x564e8288a8c0 2023-08-17T17:34:41.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.761+0000 7fcd1f410b80 1 -- 172.21.15.78:0/231604438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 msgr2=0x564e8283cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.761+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/231604438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8283cf00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fccfc04cd70 tx=0x7fccfc07b040).stop 2023-08-17T17:34:41.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.761+0000 7fcd1f410b80 1 -- 172.21.15.78:0/231604438 shutdown_connections 2023-08-17T17:34:41.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.761+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/231604438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e8283d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.761+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/231604438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82842000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.761+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/231604438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8283cf00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.761+0000 7fcd1f410b80 1 -- 172.21.15.78:0/231604438 >> 172.21.15.78:0/231604438 conn(0x564e825fee40 msgr2=0x564e8288ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:41.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.761+0000 7fcd1f410b80 1 -- 172.21.15.78:0/231604438 shutdown_connections 2023-08-17T17:34:41.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.761+0000 7fcd1f410b80 1 -- 172.21.15.78:0/231604438 wait complete. 2023-08-17T17:34:41.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.761+0000 7fcd1f410b80 1 -- start start 2023-08-17T17:34:41.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd1f410b80 1 Processor -- start 2023-08-17T17:34:41.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e828709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82869740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8286f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e8275aef0 con 0x564e8288a8c0 2023-08-17T17:34:41.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e8275f8d0 con 0x564e82841c20 2023-08-17T17:34:41.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e82869c30 con 0x564e8283d3f0 2023-08-17T17:34:41.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd1f410b80 10 client.0 ll_register_callbacks cb 0x564e82801ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:34:41.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd07fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8286f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd07fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8286f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48762/0 (socket says 172.21.15.78:48762) 2023-08-17T17:34:41.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd07fff700 1 -- 172.21.15.78:0/3190256510 learned_addr learned my addr 172.21.15.78:0/3190256510 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:41.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82869740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.762+0000 7fcd077fe700 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e828709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd07fff700 1 -- 172.21.15.78:0/3190256510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 msgr2=0x564e828709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd07fff700 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e828709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd07fff700 1 -- 172.21.15.78:0/3190256510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 msgr2=0x564e82869740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd07fff700 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82869740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd07fff700 1 -- 172.21.15.78:0/3190256510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd080ae390 con 0x564e8288a8c0 2023-08-17T17:34:41.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd07fff700 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8286f6c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fcd00012600 tx=0x7fcd00008040).ready entity=mon.0 client_cookie=956b739e2d3bec21 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:41.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcce5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:34:41.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcce5ffb700 1 -- 172.21.15.78:0/3190256510 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000a4f0 con 0x564e8288a8c0 2023-08-17T17:34:41.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcce5ffb700 1 -- 172.21.15.78:0/3190256510 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcd00015450 con 0x564e8288a8c0 2023-08-17T17:34:41.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3190256510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e8283c0f0 con 0x564e8288a8c0 2023-08-17T17:34:41.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcce5ffb700 1 -- 172.21.15.78:0/3190256510 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd00015820 con 0x564e8288a8c0 2023-08-17T17:34:41.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd1f410b80 10 client.4656 fetch_fsmap learned FSMap version 6 2023-08-17T17:34:41.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3190256510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x564e8278ce70 con 0x564e8288a8c0 2023-08-17T17:34:41.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcce5ffb700 1 -- 172.21.15.78:0/3190256510 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e8283c0f0 con 0x564e8288a8c0 2023-08-17T17:34:41.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcce5ffb700 1 -- 172.21.15.78:0/3190256510 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcd00015980 con 0x564e8288a8c0 2023-08-17T17:34:41.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd1f410b80 10 client.4656 fetch_fsmap finished waiting for FSMap version 6 2023-08-17T17:34:41.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd1f410b80 10 client.4656 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T17:34:41.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd1f410b80 20 client.4656 populate_metadata read hostname 'smithi078' 2023-08-17T17:34:41.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.78:6836/2283193122,v1:172.21.15.78:6837/2283193122] conn(0x564e828700a0 0x564e8286c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd1f410b80 4 client.4656 mds_command: new command op to 4266 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T17:34:41.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3190256510 --> [v2:172.21.15.78:6836/2283193122,v1:172.21.15.78:6837/2283193122] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e8280bb50 con 0x564e828700a0 2023-08-17T17:34:41.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.763+0000 7fcd077fe700 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.78:6836/2283193122,v1:172.21.15.78:6837/2283193122] conn(0x564e828700a0 0x564e8286c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcce5ffb700 10 client.4656 ms_handle_connect on v2:172.21.15.78:6836/2283193122 2023-08-17T17:34:41.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd077fe700 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.78:6836/2283193122,v1:172.21.15.78:6837/2283193122] conn(0x564e828700a0 0x564e8286c230 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3eecbfd1d698ac8c server_cookie=4d53592f80bc6c25 in_seq=0 out_seq=0 2023-08-17T17:34:41.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcce5ffb700 1 -- 172.21.15.78:0/3190256510 <== mds.0 v2:172.21.15.78:6836/2283193122 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x564e8280bb50 con 0x564e828700a0 2023-08-17T17:34:41.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcce5ffb700 10 client.4656 handle_command_reply: tid=0 2023-08-17T17:34:41.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 client.4656 shutdown 2023-08-17T17:34:41.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3190256510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 msgr2=0x564e8286f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8286f6c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fcd00012600 tx=0x7fcd00008040).stop 2023-08-17T17:34:41.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3190256510 shutdown_connections 2023-08-17T17:34:41.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.78:6836/2283193122,v1:172.21.15.78:6837/2283193122] conn(0x564e828700a0 0x564e8286c230 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e8286f6c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e828709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcce5ffb700 0 client.4656 ms_handle_reset on v2:172.21.15.78:6836/2283193122 2023-08-17T17:34:41.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/3190256510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82869740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3190256510 >> 172.21.15.78:0/3190256510 conn(0x564e825fee40 msgr2=0x564e82842000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:41.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3190256510 shutdown_connections 2023-08-17T17:34:41.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.764+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3190256510 wait complete. 2023-08-17T17:34:41.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.765+0000 7fcd1f410b80 20 client.4656 trim_cache size 0 max 16384 2023-08-17T17:34:41.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.781+0000 7fcd1f410b80 1 Processor -- start 2023-08-17T17:34:41.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.781+0000 7fcd1f410b80 1 -- start start 2023-08-17T17:34:41.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.781+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e8283dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.781+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e82841c20 0x564e8283ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.781+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e8288a8c0 0x564e8288b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.781+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e82882840 con 0x564e82841c20 2023-08-17T17:34:41.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.781+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e8286d990 con 0x564e8288a8c0 2023-08-17T17:34:41.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.781+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e8283b4b0 con 0x564e8283d3f0 2023-08-17T17:34:41.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd06ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e82841c20 0x564e8283ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd06ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e82841c20 0x564e8283ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48768/0 (socket says 172.21.15.78:48768) 2023-08-17T17:34:41.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd06ffd700 1 -- 172.21.15.78:0/3986881309 learned_addr learned my addr 172.21.15.78:0/3986881309 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:41.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd077fe700 1 --2- 172.21.15.78:0/3986881309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e8283dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd07fff700 1 --2- 172.21.15.78:0/3986881309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e8288a8c0 0x564e8288b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd06ffd700 1 -- 172.21.15.78:0/3986881309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 msgr2=0x564e8283dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/3986881309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e8283dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd06ffd700 1 -- 172.21.15.78:0/3986881309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e8288a8c0 msgr2=0x564e8288b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/3986881309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e8288a8c0 0x564e8288b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd06ffd700 1 -- 172.21.15.78:0/3986881309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e82788480 con 0x564e82841c20 2023-08-17T17:34:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd07fff700 1 --2- 172.21.15.78:0/3986881309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e8288a8c0 0x564e8288b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/3986881309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e82841c20 0x564e8283ef70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fccfc009f50 tx=0x7fccfc034000).ready entity=mon.0 client_cookie=7e3d9ebe860d284d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcced7fa700 1 -- 172.21.15.78:0/3986881309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc000bc0 con 0x564e82841c20 2023-08-17T17:34:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcced7fa700 1 -- 172.21.15.78:0/3986881309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc04ffe0 con 0x564e82841c20 2023-08-17T17:34:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcced7fa700 1 -- 172.21.15.78:0/3986881309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc04cff0 con 0x564e82841c20 2023-08-17T17:34:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3986881309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e82841c20 msgr2=0x564e8283ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/3986881309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e82841c20 0x564e8283ef70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fccfc009f50 tx=0x7fccfc034000).stop 2023-08-17T17:34:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3986881309 shutdown_connections 2023-08-17T17:34:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/3986881309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e8288a8c0 0x564e8288b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/3986881309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e8283dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/3986881309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e82841c20 0x564e8283ef70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.782+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3986881309 >> 172.21.15.78:0/3986881309 conn(0x564e825fee40 msgr2=0x564e8288ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:41.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.783+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3986881309 shutdown_connections 2023-08-17T17:34:41.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.783+0000 7fcd1f410b80 1 -- 172.21.15.78:0/3986881309 wait complete. 2023-08-17T17:34:41.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.783+0000 7fcd1f410b80 1 -- start start 2023-08-17T17:34:41.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.783+0000 7fcd1f410b80 1 Processor -- start 2023-08-17T17:34:41.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e828eb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82883550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd1f410b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e82881a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e828ebe20 con 0x564e8288a8c0 2023-08-17T17:34:41.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e828ed500 con 0x564e82841c20 2023-08-17T17:34:41.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd1f410b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e8286dce0 con 0x564e8283d3f0 2023-08-17T17:34:41.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd1f410b80 10 client.0 ll_register_callbacks cb 0x564e82801ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:34:41.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd07fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e82881a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd07fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e82881a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48770/0 (socket says 172.21.15.78:48770) 2023-08-17T17:34:41.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd07fff700 1 -- 172.21.15.78:0/2041431610 learned_addr learned my addr 172.21.15.78:0/2041431610 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:41.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd077fe700 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e828eb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd06ffd700 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82883550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd07fff700 1 -- 172.21.15.78:0/2041431610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 msgr2=0x564e828eb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd07fff700 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e828eb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd07fff700 1 -- 172.21.15.78:0/2041431610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 msgr2=0x564e82883550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:41.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd07fff700 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82883550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd07fff700 1 -- 172.21.15.78:0/2041431610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e82636310 con 0x564e8288a8c0 2023-08-17T17:34:41.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd077fe700 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e828eb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:41.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd07fff700 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e82881a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fcd00012600 tx=0x7fcd00025000).ready entity=mon.0 client_cookie=caedcc42d846b503 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:41.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcce5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:34:41.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcce5ffb700 1 -- 172.21.15.78:0/2041431610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00015a30 con 0x564e8288a8c0 2023-08-17T17:34:41.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcce5ffb700 1 -- 172.21.15.78:0/2041431610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcd0001e3f0 con 0x564e8288a8c0 2023-08-17T17:34:41.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.784+0000 7fcd1f410b80 1 -- 172.21.15.78:0/2041431610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fccfc079900 con 0x564e8288a8c0 2023-08-17T17:34:41.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcce5ffb700 1 -- 172.21.15.78:0/2041431610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd0001e7c0 con 0x564e8288a8c0 2023-08-17T17:34:41.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 10 client.4662 fetch_fsmap learned FSMap version 6 2023-08-17T17:34:41.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 -- 172.21.15.78:0/2041431610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x564e827881d0 con 0x564e8288a8c0 2023-08-17T17:34:41.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcce5ffb700 1 -- 172.21.15.78:0/2041431610 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc079900 con 0x564e8288a8c0 2023-08-17T17:34:41.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcce5ffb700 1 -- 172.21.15.78:0/2041431610 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcd0001e920 con 0x564e8288a8c0 2023-08-17T17:34:41.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 10 client.4662 fetch_fsmap finished waiting for FSMap version 6 2023-08-17T17:34:41.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 10 client.4662 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T17:34:41.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 20 client.4662 populate_metadata read hostname 'smithi078' 2023-08-17T17:34:41.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.78:6836/2283193122,v1:172.21.15.78:6837/2283193122] conn(0x564e82885660 0x564e82885a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:41.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 4 client.4662 mds_command: new command op to 4266 tid=0[{"prefix": "status"}] 2023-08-17T17:34:41.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 -- 172.21.15.78:0/2041431610 --> [v2:172.21.15.78:6836/2283193122,v1:172.21.15.78:6837/2283193122] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564e825faca0 con 0x564e82885660 2023-08-17T17:34:41.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd077fe700 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.78:6836/2283193122,v1:172.21.15.78:6837/2283193122] conn(0x564e82885660 0x564e82885a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:41.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcce5ffb700 10 client.4662 ms_handle_connect on v2:172.21.15.78:6836/2283193122 2023-08-17T17:34:41.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd077fe700 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.78:6836/2283193122,v1:172.21.15.78:6837/2283193122] conn(0x564e82885660 0x564e82885a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6508b371a858a330 server_cookie=9863d56aa313d9ca in_seq=0 out_seq=0 2023-08-17T17:34:41.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcce5ffb700 1 -- 172.21.15.78:0/2041431610 <== mds.0 v2:172.21.15.78:6836/2283193122 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x564e825faca0 con 0x564e82885660 2023-08-17T17:34:41.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcce5ffb700 10 client.4662 handle_command_reply: tid=0 2023-08-17T17:34:41.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 client.4662 shutdown 2023-08-17T17:34:41.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 -- 172.21.15.78:0/2041431610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 msgr2=0x564e82881a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e82881a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fcd00012600 tx=0x7fcd00025000).stop 2023-08-17T17:34:41.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 -- 172.21.15.78:0/2041431610 shutdown_connections 2023-08-17T17:34:41.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.78:6836/2283193122,v1:172.21.15.78:6837/2283193122] conn(0x564e82885660 0x564e82885a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564e8288a8c0 0x564e82881a80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x564e8283d3f0 0x564e828eb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 --2- 172.21.15.78:0/2041431610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564e82841c20 0x564e82883550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcce5ffb700 0 client.4662 ms_handle_reset on v2:172.21.15.78:6836/2283193122 2023-08-17T17:34:41.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.785+0000 7fcd1f410b80 1 -- 172.21.15.78:0/2041431610 >> 172.21.15.78:0/2041431610 conn(0x564e825fee40 msgr2=0x564e8283d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:41.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd1f410b80 1 -- 172.21.15.78:0/2041431610 shutdown_connections 2023-08-17T17:34:41.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd1f410b80 1 -- 172.21.15.78:0/2041431610 wait complete. 2023-08-17T17:34:41.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd1f410b80 20 client.4662 trim_cache size 0 max 16384 2023-08-17T17:34:41.798 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:34:41.799 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T17:34:41.799 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T17:34:41.799 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4266, 2023-08-17T17:34:41.799 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T17:34:41.799 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T17:34:41.799 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T17:34:41.799 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 18.256019102, 2023-08-17T17:34:41.799 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 6, 2023-08-17T17:34:41.800 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 22, 2023-08-17T17:34:41.800 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 22, 2023-08-17T17:34:41.800 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 22.630967295000001 2023-08-17T17:34:41.800 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:34:41.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 -- 172.21.15.78:0/1035940233 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccf405ed90 msgr2=0x7fccf4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccf405ed90 0x7fccf4061250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fccf800f600 tx=0x7fccf80077b0).stop 2023-08-17T17:34:41.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 -- 172.21.15.78:0/1035940233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd081541a0 msgr2=0x7fcd080adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd081541a0 0x7fcd080adea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fcd08083b60 tx=0x7fccfc017000).stop 2023-08-17T17:34:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 -- 172.21.15.78:0/1035940233 shutdown_connections 2023-08-17T17:34:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccf405ed90 0x7fccf4061250 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08154580 0x7fcd081511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080c0340 0x7fcd08159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 --2- 172.21.15.78:0/1035940233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd081541a0 0x7fcd080adea0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 -- 172.21.15.78:0/1035940233 >> 172.21.15.78:0/1035940233 conn(0x7fcd0806a400 msgr2=0x7fcd08063db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 -- 172.21.15.78:0/1035940233 shutdown_connections 2023-08-17T17:34:41.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:41.786+0000 7fcd0da7b700 1 -- 172.21.15.78:0/1035940233 wait complete. 2023-08-17T17:34:41.803 INFO:teuthology.run_tasks:Running task kclient... 2023-08-17T17:34:41.823 INFO:tasks.kclient:Mounting kernel clients... 2023-08-17T17:34:41.824 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-17T17:34:41.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:41.825 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:34:41.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:41.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-08-17T17:34:41.905 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2023-08-17T17:34:41.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T17:34:41.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:41.907 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:34:41.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:41.961 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-08-17T17:34:42.025 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2023-08-17T17:34:42.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T17:34:42.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:42.026 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-08-17T17:34:42.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:42.045 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-08-17T17:34:42.115 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2023-08-17T17:34:42.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T17:34:42.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:42.117 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-08-17T17:34:42.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:42.175 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-08-17T17:34:42.242 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2023-08-17T17:34:42.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T17:34:42.244 INFO:tasks.kclient:client.0 config is {} 2023-08-17T17:34:42.244 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T17:34:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.343+0000 7f0d8a320700 1 Processor -- start 2023-08-17T17:34:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.343+0000 7f0d8a320700 1 -- start start 2023-08-17T17:34:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d8a320700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d841523f0 0x7f0d840ab010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d8a320700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0d840c3d20 0x7f0d840ab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d8a320700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d841528b0 con 0x7f0d84152010 2023-08-17T17:34:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d8a320700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d84152b90 con 0x7f0d840c3d20 2023-08-17T17:34:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d8a320700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84152e70 con 0x7f0d841523f0 2023-08-17T17:34:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d888bd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0d840c3d20 0x7f0d840ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d888bd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0d840c3d20 0x7f0d840ab500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48780/0 (socket says 172.21.15.78:48780) 2023-08-17T17:34:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d888bd700 1 -- 172.21.15.78:0/2956594479 learned_addr learned my addr 172.21.15.78:0/2956594479 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d837fe700 1 --2- 172.21.15.78:0/2956594479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d841523f0 0x7f0d840ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d888bd700 1 -- 172.21.15.78:0/2956594479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d841523f0 msgr2=0x7f0d840ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d888bd700 1 --2- 172.21.15.78:0/2956594479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d841523f0 0x7f0d840ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:42.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d888bd700 1 -- 172.21.15.78:0/2956594479 >> v1:172.21.15.150:6789/0 conn(0x7f0d84152010 legacy=0x7f0d840c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:42.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d888bd700 1 -- 172.21.15.78:0/2956594479 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84153150 con 0x7f0d840c3d20 2023-08-17T17:34:42.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.344+0000 7f0d837fe700 1 --2- 172.21.15.78:0/2956594479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d841523f0 0x7f0d840ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:42.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d888bd700 1 --2- 172.21.15.78:0/2956594479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 0x7f0d840ab500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f0d7c009f20 tx=0x7f0d7c009840).ready entity=mon.0 client_cookie=81f414e677420d53 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:42.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d82ffd700 1 -- 172.21.15.78:0/2956594479 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00e070 con 0x7f0d840c3d20 2023-08-17T17:34:42.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d82ffd700 1 -- 172.21.15.78:0/2956594479 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00ba40 con 0x7f0d840c3d20 2023-08-17T17:34:42.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d82ffd700 1 -- 172.21.15.78:0/2956594479 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00bdc0 con 0x7f0d840c3d20 2023-08-17T17:34:42.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d8a320700 1 -- 172.21.15.78:0/2956594479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 msgr2=0x7f0d840ab500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:42.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d8a320700 1 --2- 172.21.15.78:0/2956594479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 0x7f0d840ab500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f0d7c009f20 tx=0x7f0d7c009840).stop 2023-08-17T17:34:42.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d8a320700 1 -- 172.21.15.78:0/2956594479 shutdown_connections 2023-08-17T17:34:42.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d8a320700 1 --2- 172.21.15.78:0/2956594479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 0x7f0d840ab500 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:42.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d8a320700 1 --2- 172.21.15.78:0/2956594479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d841523f0 0x7f0d840ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:42.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d8a320700 1 -- 172.21.15.78:0/2956594479 >> 172.21.15.78:0/2956594479 conn(0x7f0d840624e0 msgr2=0x7f0d840628c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:42.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d8a320700 1 -- 172.21.15.78:0/2956594479 shutdown_connections 2023-08-17T17:34:42.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.345+0000 7f0d8a320700 1 -- 172.21.15.78:0/2956594479 wait complete. 2023-08-17T17:34:42.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.346+0000 7f0d8a320700 1 Processor -- start 2023-08-17T17:34:42.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d8a320700 1 -- start start 2023-08-17T17:34:42.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d8a320700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 0x7f0d840ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:42.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d8a320700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d84152010 0x7f0d840adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:42.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d8a320700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d841523f0 0x7f0d840be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:42.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d8a320700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8414cb10 con 0x7f0d840c3d20 2023-08-17T17:34:42.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d8a320700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840ac8b0 con 0x7f0d841523f0 2023-08-17T17:34:42.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d8a320700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840ae590 con 0x7f0d84152010 2023-08-17T17:34:42.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d83fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 0x7f0d840ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:42.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d83fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 0x7f0d840ac3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48794/0 (socket says 172.21.15.78:48794) 2023-08-17T17:34:42.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d83fff700 1 -- 172.21.15.78:0/3373206270 learned_addr learned my addr 172.21.15.78:0/3373206270 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:42.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d837fe700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d84152010 0x7f0d840adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.347+0000 7f0d888bd700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d841523f0 0x7f0d840be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d83fff700 1 -- 172.21.15.78:0/3373206270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d84152010 msgr2=0x7f0d840adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d83fff700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d84152010 0x7f0d840adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d83fff700 1 -- 172.21.15.78:0/3373206270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d841523f0 msgr2=0x7f0d840be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d83fff700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d841523f0 0x7f0d840be0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d83fff700 1 -- 172.21.15.78:0/3373206270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c009ae0 con 0x7f0d840c3d20 2023-08-17T17:34:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d83fff700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 0x7f0d840ac3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f0d7400c440 tx=0x7f0d74007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:42.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d6bfff700 1 -- 172.21.15.78:0/3373206270 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400cea0 con 0x7f0d840c3d20 2023-08-17T17:34:42.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d6bfff700 1 -- 172.21.15.78:0/3373206270 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7400f470 con 0x7f0d840c3d20 2023-08-17T17:34:42.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d8a320700 1 -- 172.21.15.78:0/3373206270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d840ae870 con 0x7f0d840c3d20 2023-08-17T17:34:42.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d6bfff700 1 -- 172.21.15.78:0/3373206270 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400f810 con 0x7f0d840c3d20 2023-08-17T17:34:42.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.348+0000 7f0d8a320700 1 -- 172.21.15.78:0/3373206270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d840aee30 con 0x7f0d840c3d20 2023-08-17T17:34:42.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.349+0000 7f0d8a320700 1 -- 172.21.15.78:0/3373206270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d84047350 con 0x7f0d840c3d20 2023-08-17T17:34:42.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.349+0000 7f0d6bfff700 1 -- 172.21.15.78:0/3373206270 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0d74019030 con 0x7f0d840c3d20 2023-08-17T17:34:42.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.350+0000 7f0d6bfff700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d7005ed90 0x7f0d70061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:42.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.350+0000 7f0d837fe700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d7005ed90 0x7f0d70061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:42.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.350+0000 7f0d6bfff700 1 -- 172.21.15.78:0/3373206270 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0d74078e60 con 0x7f0d840c3d20 2023-08-17T17:34:42.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.350+0000 7f0d837fe700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d7005ed90 0x7f0d70061250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0d840aa450 tx=0x7f0d78008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:42.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.354+0000 7f0d6bfff700 1 -- 172.21.15.78:0/3373206270 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d740488f0 con 0x7f0d840c3d20 2023-08-17T17:34:42.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.556+0000 7f0d8a320700 1 -- 172.21.15.78:0/3373206270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d840c9e10 con 0x7f0d840c3d20 2023-08-17T17:34:42.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.556+0000 7f0d6bfff700 1 -- 172.21.15.78:0/3373206270 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0d7404a4b0 con 0x7f0d840c3d20 2023-08-17T17:34:42.558 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:34:42.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 -- 172.21.15.78:0/3373206270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d7005ed90 msgr2=0x7f0d70061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:42.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d7005ed90 0x7f0d70061250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0d840aa450 tx=0x7f0d78008040).stop 2023-08-17T17:34:42.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 -- 172.21.15.78:0/3373206270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 msgr2=0x7f0d840ac3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:42.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 0x7f0d840ac3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f0d7400c440 tx=0x7f0d74007de0).stop 2023-08-17T17:34:42.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 -- 172.21.15.78:0/3373206270 shutdown_connections 2023-08-17T17:34:42.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d7005ed90 0x7f0d70061250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:42.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d841523f0 0x7f0d840be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:42.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d840c3d20 0x7f0d840ac3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:42.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 --2- 172.21.15.78:0/3373206270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d84152010 0x7f0d840adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:42.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 -- 172.21.15.78:0/3373206270 >> 172.21.15.78:0/3373206270 conn(0x7f0d840624e0 msgr2=0x7f0d84067060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:42.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 -- 172.21.15.78:0/3373206270 shutdown_connections 2023-08-17T17:34:42.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:42.558+0000 7f0d8a320700 1 -- 172.21.15.78:0/3373206270 wait complete. 2023-08-17T17:34:42.570 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-17T17:34:42.571 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:34:42.571 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T17:34:42.571 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T17:34:42.571 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T17:34:42.571 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-17T17:34:42.571 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-17T17:34:42.572 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:34:42.572 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:34:42.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:42.572 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T17:34:42.587 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:34:42.587 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:34:42.587 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:34:42.587 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:42.587 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:34:42.588 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:42.588 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:42.588 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:42.588 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T17:34:42.588 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:42.588 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:42.588 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T17:34:42.589 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:42.589 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:42.589 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:34:42.589 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:42.589 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:34:42.589 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42196sec preferred_lft 42196sec 2023-08-17T17:34:42.589 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T17:34:42.589 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:42.590 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-17T17:34:42.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:42.590 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:34:42.591 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:34:42.591 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2023-08-17T17:34:42.591 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2023-08-17T17:34:42.591 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2023-08-17T17:34:42.592 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-17T17:34:42.592 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:34:42.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:42.754 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:34:42.795 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T17:34:42.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:42.796 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T17:34:42.867 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T17:34:42.868 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:34:42.868 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:34:42.868 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:34:42.868 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:34:42.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:42.869 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:34:42.869 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:34:42.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:34:42.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:34:42.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:34:42.870 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:34:43.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:43.120 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:34:43.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:43.134 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-08-17T17:34:43.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:43.188 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:34:43.188 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:34:43.188 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T17:34:43.188 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-17T17:34:43.189 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:34:43.277 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-17T17:34:43.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:43.278 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:34:43.278 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:34:43.278 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-17T17:34:43.278 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-17T17:34:43.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-17T17:34:43.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-17T17:34:43.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-17T17:34:43.279 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:34:43.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:43.471 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:34:43.471 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:34:43.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T17:34:43.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2023-08-17T17:34:43.472 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:34:43.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:43.563 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T17:34:43.577 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:34:43.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:43.669 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:43.670 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:34:43.768 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:43.768 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:34:43.770 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:34:43.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:43.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T17:34:43.795 INFO:tasks.kclient:client.2 config is {} 2023-08-17T17:34:43.795 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T17:34:43.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.933+0000 7f99e2c42700 1 Processor -- start 2023-08-17T17:34:43.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.933+0000 7f99e2c42700 1 -- start start 2023-08-17T17:34:43.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.934+0000 7f99e2c42700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f99dc0a85b0 0x7f99dc066970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:43.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.934+0000 7f99e2c42700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc06a4b0 con 0x7f99dc066590 2023-08-17T17:34:43.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.934+0000 7f99e2c42700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc0c2490 con 0x7f99dc0679e0 2023-08-17T17:34:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.934+0000 7f99e2c42700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99dc06a790 con 0x7f99dc0a85b0 2023-08-17T17:34:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.934+0000 7f99e09de700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f99dc066590 0x7f99dc150c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45668/0 (socket says 172.21.15.78:45668) 2023-08-17T17:34:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.934+0000 7f99e09de700 1 -- 172.21.15.78:0/4122265936 learned_addr learned my addr 172.21.15.78:0/4122265936 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99e11df700 1 --2- 172.21.15.78:0/4122265936 >> v2:172.21.15.150:3300/0 conn(0x7f99dc0a85b0 0x7f99dc066970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914122093 0 0) 0x7f99dc06a4b0 con 0x7f99dc066590 2023-08-17T17:34:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99c80033f0 con 0x7f99dc066590 2023-08-17T17:34:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126814262 0 0) 0x7f99c80033f0 con 0x7f99dc066590 2023-08-17T17:34:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 >> v2:172.21.15.150:3300/0 conn(0x7f99dc0a85b0 msgr2=0x7f99dc066970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 --2- 172.21.15.78:0/4122265936 >> v2:172.21.15.150:3300/0 conn(0x7f99dc0a85b0 0x7f99dc066970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 >> v1:172.21.15.150:6789/0 conn(0x7f99dc0679e0 legacy=0x7f99dc154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc0c2770 con 0x7f99dc066590 2023-08-17T17:34:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f99cc0017f0 con 0x7f99dc066590 2023-08-17T17:34:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 >> v1:172.21.15.78:6789/0 conn(0x7f99dc066590 legacy=0x7f99dc150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99c80038e0 0x7f99c8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c8004690 0x7f99c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99c8005000 0x7f99c800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc06a790 con 0x7f99c8004690 2023-08-17T17:34:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c800bf60 con 0x7f99c80038e0 2023-08-17T17:34:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c800c0f0 con 0x7f99c8005000 2023-08-17T17:34:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99dbfff700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c8004690 0x7f99c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99e09de700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99c80038e0 0x7f99c8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99e11df700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99c8005000 0x7f99c800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99dbfff700 1 -- 172.21.15.78:0/4122265936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99c8005000 msgr2=0x7f99c800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99dbfff700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99c8005000 0x7f99c800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99dbfff700 1 -- 172.21.15.78:0/4122265936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99c80038e0 msgr2=0x7f99c8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99dbfff700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99c80038e0 0x7f99c8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99e11df700 1 -- 172.21.15.78:0/4122265936 reap_dead start 2023-08-17T17:34:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.935+0000 7f99dbfff700 1 -- 172.21.15.78:0/4122265936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c80033f0 con 0x7f99c8004690 2023-08-17T17:34:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99dbfff700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c8004690 0x7f99c8004b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f99c4001730 tx=0x7f99c4007bb0).ready entity=mon.0 client_cookie=878c3988effc132f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4007020 con 0x7f99c8004690 2023-08-17T17:34:43.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c4007180 con 0x7f99c8004690 2023-08-17T17:34:43.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99db7fe700 1 -- 172.21.15.78:0/4122265936 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4007520 con 0x7f99c8004690 2023-08-17T17:34:43.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99e2c42700 1 -- 172.21.15.78:0/4122265936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c8004690 msgr2=0x7f99c8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:43.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99e2c42700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c8004690 0x7f99c8004b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f99c4001730 tx=0x7f99c4007bb0).stop 2023-08-17T17:34:43.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99e2c42700 1 -- 172.21.15.78:0/4122265936 shutdown_connections 2023-08-17T17:34:43.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99e2c42700 1 --2- 172.21.15.78:0/4122265936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c8004690 0x7f99c8004b10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:43.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99e2c42700 1 -- 172.21.15.78:0/4122265936 >> 172.21.15.78:0/4122265936 conn(0x7f99dc0c8720 msgr2=0x7f99dc0c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:43.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99e2c42700 1 -- 172.21.15.78:0/4122265936 shutdown_connections 2023-08-17T17:34:43.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.936+0000 7f99e2c42700 1 -- 172.21.15.78:0/4122265936 wait complete. 2023-08-17T17:34:43.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.937+0000 7f99e2c42700 1 Processor -- start 2023-08-17T17:34:43.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e2c42700 1 -- start start 2023-08-17T17:34:43.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e2c42700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99c8004690 0x7f99dc0c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:43.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e2c42700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99dc0aa200 0x7f99dc14a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:43.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e2c42700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc14e490 0x7f99dc0bf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:43.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e2c42700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0abfe0 con 0x7f99dc14e490 2023-08-17T17:34:43.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e2c42700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0c1aa0 con 0x7f99c8004690 2023-08-17T17:34:43.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e2c42700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0ac280 con 0x7f99dc0aa200 2023-08-17T17:34:43.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e11df700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc14e490 0x7f99dc0bf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:43.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e11df700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc14e490 0x7f99dc0bf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48818/0 (socket says 172.21.15.78:48818) 2023-08-17T17:34:43.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e11df700 1 -- 172.21.15.78:0/3737846389 learned_addr learned my addr 172.21.15.78:0/3737846389 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:43.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.938+0000 7f99e09de700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99c8004690 0x7f99dc0c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99dbfff700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99dc0aa200 0x7f99dc14a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99e11df700 1 -- 172.21.15.78:0/3737846389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99dc0aa200 msgr2=0x7f99dc14a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99e11df700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99dc0aa200 0x7f99dc14a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99e11df700 1 -- 172.21.15.78:0/3737846389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99c8004690 msgr2=0x7f99dc0c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99e11df700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99c8004690 0x7f99dc0c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99e11df700 1 -- 172.21.15.78:0/3737846389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc0ac560 con 0x7f99dc14e490 2023-08-17T17:34:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99dbfff700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99dc0aa200 0x7f99dc14a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99e11df700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc14e490 0x7f99dc0bf290 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f99dc05e450 tx=0x7f99d4006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99d8ff9700 1 -- 172.21.15.78:0/3737846389 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4016070 con 0x7f99dc14e490 2023-08-17T17:34:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99d8ff9700 1 -- 172.21.15.78:0/3737846389 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d4009e00 con 0x7f99dc14e490 2023-08-17T17:34:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99e2c42700 1 -- 172.21.15.78:0/3737846389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc0ac840 con 0x7f99dc14e490 2023-08-17T17:34:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99d8ff9700 1 -- 172.21.15.78:0/3737846389 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4005ae0 con 0x7f99dc14e490 2023-08-17T17:34:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.939+0000 7f99e2c42700 1 -- 172.21.15.78:0/3737846389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc0ace00 con 0x7f99dc14e490 2023-08-17T17:34:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.940+0000 7f99e2c42700 1 -- 172.21.15.78:0/3737846389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc0acff0 con 0x7f99dc14e490 2023-08-17T17:34:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.940+0000 7f99d8ff9700 1 -- 172.21.15.78:0/3737846389 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f99d4023070 con 0x7f99dc14e490 2023-08-17T17:34:43.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.940+0000 7f99d8ff9700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99bc05ed90 0x7f99bc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:43.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.941+0000 7f99d8ff9700 1 -- 172.21.15.78:0/3737846389 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f99d407b470 con 0x7f99dc14e490 2023-08-17T17:34:43.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.941+0000 7f99e09de700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99bc05ed90 0x7f99bc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:43.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.941+0000 7f99e09de700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99bc05ed90 0x7f99bc061250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f99cc001920 tx=0x7f99cc007d70).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:43.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:43.945+0000 7f99d8ff9700 1 -- 172.21.15.78:0/3737846389 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99d404ca60 con 0x7f99dc14e490 2023-08-17T17:34:44.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.150+0000 7f99e2c42700 1 -- 172.21.15.78:0/3737846389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99dc0c54b0 con 0x7f99dc14e490 2023-08-17T17:34:44.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.151+0000 7f99d8ff9700 1 -- 172.21.15.78:0/3737846389 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f99d4021020 con 0x7f99dc14e490 2023-08-17T17:34:44.153 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:34:44.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 -- 172.21.15.78:0/3737846389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99bc05ed90 msgr2=0x7f99bc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:44.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99bc05ed90 0x7f99bc061250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f99cc001920 tx=0x7f99cc007d70).stop 2023-08-17T17:34:44.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 -- 172.21.15.78:0/3737846389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc14e490 msgr2=0x7f99dc0bf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:44.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc14e490 0x7f99dc0bf290 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f99dc05e450 tx=0x7f99d4006f90).stop 2023-08-17T17:34:44.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 -- 172.21.15.78:0/3737846389 shutdown_connections 2023-08-17T17:34:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99bc05ed90 0x7f99bc061250 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc14e490 0x7f99dc0bf290 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99c8004690 0x7f99dc0c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 --2- 172.21.15.78:0/3737846389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99dc0aa200 0x7f99dc14a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 -- 172.21.15.78:0/3737846389 >> 172.21.15.78:0/3737846389 conn(0x7f99dc0c8720 msgr2=0x7f99dc14c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 -- 172.21.15.78:0/3737846389 shutdown_connections 2023-08-17T17:34:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:44.152+0000 7f99e2c42700 1 -- 172.21.15.78:0/3737846389 wait complete. 2023-08-17T17:34:44.165 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-17T17:34:44.165 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:34:44.165 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T17:34:44.165 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-17T17:34:44.166 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-17T17:34:44.166 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-17T17:34:44.166 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-17T17:34:44.166 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:34:44.166 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-17T17:34:44.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.167 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T17:34:44.182 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:34:44.182 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:34:44.182 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:34:44.182 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.182 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:34:44.182 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.183 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:44.183 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:44.183 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T17:34:44.183 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:44.183 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:44.183 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T17:34:44.183 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:44.184 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:44.184 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:34:44.184 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:44.184 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:34:44.184 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42195sec preferred_lft 42195sec 2023-08-17T17:34:44.184 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T17:34:44.184 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.185 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:34:44.185 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:44.185 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T17:34:44.185 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.185 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T17:34:44.185 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.185 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:34:44.185 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T17:34:44.186 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link tentative 2023-08-17T17:34:44.186 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.186 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:34:44.245 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T17:34:44.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.247 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T17:34:44.302 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T17:34:44.302 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:34:44.303 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:34:44.303 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:34:44.303 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:34:44.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.303 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:34:44.304 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:34:44.304 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:34:44.304 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:34:44.304 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:34:44.305 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:34:44.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.402 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:34:44.416 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T17:34:44.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.417 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-08-17T17:34:44.470 INFO:teuthology.orchestra.run.smithi078.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-17T17:34:44.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.471 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:34:44.471 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:34:44.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T17:34:44.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-17T17:34:44.472 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:34:44.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.559 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-17T17:34:44.595 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:34:44.595 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:34:44.595 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:34:44.595 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.595 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:34:44.596 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.596 INFO:teuthology.orchestra.run.smithi078.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:34:44.596 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether a2:86:bc:94:ba:db brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-17T17:34:44.596 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-17T17:34:44.596 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.596 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::a086:bcff:fe94:badb/64 scope link tentative 2023-08-17T17:34:44.596 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-17T17:34:44.681 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:34:44.681 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:34:44.681 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:34:44.681 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.682 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:34:44.682 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.682 INFO:teuthology.orchestra.run.smithi078.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:34:44.682 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether a2:86:bc:94:ba:db brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-17T17:34:44.682 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-17T17:34:44.682 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.682 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::a086:bcff:fe94:badb/64 scope link tentative 2023-08-17T17:34:44.683 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:44.694 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-17T17:34:44.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.695 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:34:44.695 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:34:44.695 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-17T17:34:44.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-17T17:34:44.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-17T17:34:44.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-17T17:34:44.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-17T17:34:44.696 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:34:44.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:44.930 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:34:44.930 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:34:44.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.1 up 2023-08-17T17:34:44.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.1 master ceph-brx 2023-08-17T17:34:44.930 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:34:45.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:45.012 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.2 2023-08-17T17:34:45.026 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:34:45.026 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:45.104 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:45.105 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:34:45.130 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:45.130 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:34:45.131 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:34:45.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:45.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-17T17:34:45.196 INFO:tasks.kclient:client.1 config is {} 2023-08-17T17:34:45.197 DEBUG:teuthology.orchestra.run.smithi150:> ceph fs ls 2023-08-17T17:34:45.309 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.307+0000 7fd95afc4700 1 Processor -- start 2023-08-17T17:34:45.310 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.307+0000 7fd95afc4700 1 -- start start 2023-08-17T17:34:45.311 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.308+0000 7fd95afc4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9540a85b0 0x7fd954066970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:45.311 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.308+0000 7fd95afc4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95406a4b0 con 0x7fd9540679e0 2023-08-17T17:34:45.311 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.308+0000 7fd95afc4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9540c2490 con 0x7fd954066590 2023-08-17T17:34:45.311 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.308+0000 7fd95afc4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95406a790 con 0x7fd9540a85b0 2023-08-17T17:34:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.308+0000 7fd959561700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9540a85b0 0x7fd954066970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.308+0000 7fd958d60700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd954066590 0x7fd954150c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:56380/0 (socket says 172.21.15.150:56380) 2023-08-17T17:34:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.308+0000 7fd958d60700 1 -- 172.21.15.150:0/380935651 learned_addr learned my addr 172.21.15.150:0/380935651 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-08-17T17:34:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd959561700 1 -- 172.21.15.150:0/380935651 >> v1:172.21.15.150:6789/0 conn(0x7fd954066590 legacy=0x7fd954150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd959561700 1 -- 172.21.15.150:0/380935651 >> v1:172.21.15.78:6789/0 conn(0x7fd9540679e0 legacy=0x7fd954154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd9537fe700 1 -- 172.21.15.150:0/380935651 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903153917 0 0) 0x7fd9540c2490 con 0x7fd954066590 2023-08-17T17:34:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd959561700 1 -- 172.21.15.150:0/380935651 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9540c2770 con 0x7fd9540a85b0 2023-08-17T17:34:45.312 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd959561700 1 --2- 172.21.15.150:0/380935651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 0x7fd954066970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd94c009e60 tx=0x7fd94c009780).ready entity=mon.1 client_cookie=507d2643cec334d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:45.313 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd9537fe700 1 -- 172.21.15.150:0/380935651 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00e070 con 0x7fd9540a85b0 2023-08-17T17:34:45.313 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd9537fe700 1 -- 172.21.15.150:0/380935651 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c00bb30 con 0x7fd9540a85b0 2023-08-17T17:34:45.313 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd9537fe700 1 -- 172.21.15.150:0/380935651 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00beb0 con 0x7fd9540a85b0 2023-08-17T17:34:45.315 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd95afc4700 1 -- 172.21.15.150:0/380935651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 msgr2=0x7fd954066970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:45.315 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd95afc4700 1 --2- 172.21.15.150:0/380935651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 0x7fd954066970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd94c009e60 tx=0x7fd94c009780).stop 2023-08-17T17:34:45.315 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd95afc4700 1 -- 172.21.15.150:0/380935651 shutdown_connections 2023-08-17T17:34:45.315 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd95afc4700 1 --2- 172.21.15.150:0/380935651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 0x7fd954066970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:45.316 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd95afc4700 1 -- 172.21.15.150:0/380935651 >> 172.21.15.150:0/380935651 conn(0x7fd9540c8720 msgr2=0x7fd9540c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:45.316 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd95afc4700 1 -- 172.21.15.150:0/380935651 shutdown_connections 2023-08-17T17:34:45.316 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.309+0000 7fd95afc4700 1 -- 172.21.15.150:0/380935651 wait complete. 2023-08-17T17:34:45.316 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.311+0000 7fd95afc4700 1 Processor -- start 2023-08-17T17:34:45.316 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.311+0000 7fd95afc4700 1 -- start start 2023-08-17T17:34:45.316 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd95afc4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd954066590 0x7fd954149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:45.316 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd95afc4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9540679e0 0x7fd954154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:45.317 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd95afc4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 0x7fd9541552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:45.317 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd95afc4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd954156570 con 0x7fd954066590 2023-08-17T17:34:45.317 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd95afc4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9540c0d40 con 0x7fd9540a85b0 2023-08-17T17:34:45.317 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd95afc4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd954155960 con 0x7fd9540679e0 2023-08-17T17:34:45.317 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd959561700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 0x7fd9541552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:45.317 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd953fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9540679e0 0x7fd954154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:45.317 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd959561700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 0x7fd9541552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36926/0 (socket says 172.21.15.150:36926) 2023-08-17T17:34:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd959561700 1 -- 172.21.15.150:0/1141179526 learned_addr learned my addr 172.21.15.150:0/1141179526 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd958d60700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd954066590 0x7fd954149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd959561700 1 -- 172.21.15.150:0/1141179526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9540679e0 msgr2=0x7fd954154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd959561700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9540679e0 0x7fd954154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd959561700 1 -- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd954066590 msgr2=0x7fd954149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd959561700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd954066590 0x7fd954149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd959561700 1 -- 172.21.15.150:0/1141179526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c009a20 con 0x7fd9540a85b0 2023-08-17T17:34:45.318 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd958d60700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd954066590 0x7fd954149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:45.319 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd959561700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 0x7fd9541552e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fd94c00b6c0 tx=0x7fd94c009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:45.319 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd950ff9700 1 -- 172.21.15.150:0/1141179526 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c0070e0 con 0x7fd9540a85b0 2023-08-17T17:34:45.319 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd950ff9700 1 -- 172.21.15.150:0/1141179526 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c01c660 con 0x7fd9540a85b0 2023-08-17T17:34:45.319 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd95afc4700 1 -- 172.21.15.150:0/1141179526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd954155c40 con 0x7fd9540a85b0 2023-08-17T17:34:45.319 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd950ff9700 1 -- 172.21.15.150:0/1141179526 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c01ca20 con 0x7fd9540a85b0 2023-08-17T17:34:45.320 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.312+0000 7fd95afc4700 1 -- 172.21.15.150:0/1141179526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd954156200 con 0x7fd9540a85b0 2023-08-17T17:34:45.320 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.313+0000 7fd95afc4700 1 -- 172.21.15.150:0/1141179526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9541566e0 con 0x7fd9540a85b0 2023-08-17T17:34:45.320 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.314+0000 7fd950ff9700 1 -- 172.21.15.150:0/1141179526 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd94c01d420 con 0x7fd9540a85b0 2023-08-17T17:34:45.320 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.314+0000 7fd950ff9700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd93805ed90 0x7fd938061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:45.321 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.314+0000 7fd950ff9700 1 -- 172.21.15.150:0/1141179526 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd94c07c080 con 0x7fd9540a85b0 2023-08-17T17:34:45.321 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.314+0000 7fd958d60700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd93805ed90 0x7fd938061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:45.321 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.315+0000 7fd958d60700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd93805ed90 0x7fd938061250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fd948000c00 tx=0x7fd948009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:45.321 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.319+0000 7fd950ff9700 1 -- 172.21.15.150:0/1141179526 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd94c051050 con 0x7fd9540a85b0 2023-08-17T17:34:45.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.525+0000 7fd95afc4700 1 -- 172.21.15.150:0/1141179526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd9540c54b0 con 0x7fd9540a85b0 2023-08-17T17:34:45.528 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.526+0000 7fd950ff9700 1 -- 172.21.15.150:0/1141179526 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd94c050c40 con 0x7fd9540a85b0 2023-08-17T17:34:45.528 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:34:45.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.527+0000 7fd95afc4700 1 -- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd93805ed90 msgr2=0x7fd938061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:45.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.527+0000 7fd95afc4700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd93805ed90 0x7fd938061250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fd948000c00 tx=0x7fd948009040).stop 2023-08-17T17:34:45.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.527+0000 7fd95afc4700 1 -- 172.21.15.150:0/1141179526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 msgr2=0x7fd9541552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:45.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.527+0000 7fd95afc4700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 0x7fd9541552e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fd94c00b6c0 tx=0x7fd94c009780).stop 2023-08-17T17:34:45.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.527+0000 7fd95afc4700 1 -- 172.21.15.150:0/1141179526 shutdown_connections 2023-08-17T17:34:45.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.527+0000 7fd95afc4700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd93805ed90 0x7fd938061250 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:45.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.527+0000 7fd95afc4700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9540a85b0 0x7fd9541552e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:45.531 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.527+0000 7fd95afc4700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd954066590 0x7fd954149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:45.531 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.527+0000 7fd95afc4700 1 --2- 172.21.15.150:0/1141179526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9540679e0 0x7fd954154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:45.531 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.527+0000 7fd95afc4700 1 -- 172.21.15.150:0/1141179526 >> 172.21.15.150:0/1141179526 conn(0x7fd9540c8720 msgr2=0x7fd9540c5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:45.531 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.528+0000 7fd95afc4700 1 -- 172.21.15.150:0/1141179526 shutdown_connections 2023-08-17T17:34:45.531 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:45.528+0000 7fd95afc4700 1 -- 172.21.15.150:0/1141179526 wait complete. 2023-08-17T17:34:45.540 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-17T17:34:45.540 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:34:45.541 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2023-08-17T17:34:45.541 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-17T17:34:45.541 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-17T17:34:45.541 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-17T17:34:45.541 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-17T17:34:45.541 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:34:45.542 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-17T17:34:45.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:45.542 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2023-08-17T17:34:45.557 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:34:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:34:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:34:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-08-17T17:34:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:45.558 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2023-08-17T17:34:45.558 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2023-08-17T17:34:45.559 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:45.559 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:34:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:34:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42208sec preferred_lft 42208sec 2023-08-17T17:34:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2023-08-17T17:34:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:45.560 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-17T17:34:45.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:45.560 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-08-17T17:34:45.561 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-08-17T17:34:45.561 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2023-08-17T17:34:45.561 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2023-08-17T17:34:45.561 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2023-08-17T17:34:45.562 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-17T17:34:45.562 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-08-17T17:34:45.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:45.725 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:34:45.765 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-08-17T17:34:45.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:45.767 DEBUG:teuthology.orchestra.run.smithi150:> route 2023-08-17T17:34:45.854 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2023-08-17T17:34:45.854 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:34:45.854 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:34:45.854 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:34:45.854 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:34:45.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:45.855 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-08-17T17:34:45.855 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-08-17T17:34:45.855 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:34:45.856 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:34:45.856 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:34:45.856 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-08-17T17:34:46.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:46.067 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-08-17T17:34:46.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:46.082 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2023-08-17T17:34:46.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:46.136 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-08-17T17:34:46.136 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-08-17T17:34:46.137 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-17T17:34:46.137 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-17T17:34:46.137 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-08-17T17:34:46.224 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-17T17:34:46.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:46.225 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-08-17T17:34:46.225 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-08-17T17:34:46.225 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-17T17:34:46.225 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-17T17:34:46.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-17T17:34:46.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-17T17:34:46.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-17T17:34:46.226 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-08-17T17:34:46.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:46.431 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-08-17T17:34:46.431 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-08-17T17:34:46.431 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2023-08-17T17:34:46.431 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2023-08-17T17:34:46.432 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-08-17T17:34:46.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:46.524 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-08-17T17:34:46.538 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:34:46.538 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:46.631 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:46.631 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:34:46.723 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:46.724 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:34:46.726 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:34:46.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:46.726 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-17T17:34:46.750 INFO:tasks.kclient:client.3 config is {} 2023-08-17T17:34:46.751 DEBUG:teuthology.orchestra.run.smithi150:> ceph fs ls 2023-08-17T17:34:46.891 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.889+0000 7f318baa3700 1 Processor -- start 2023-08-17T17:34:46.891 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.889+0000 7f318baa3700 1 -- start start 2023-08-17T17:34:46.892 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318baa3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31840a7220 0x7f3184155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:46.893 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318baa3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3184154f90 con 0x7f31840624e0 2023-08-17T17:34:46.893 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318baa3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31841586f0 con 0x7f31840c42d0 2023-08-17T17:34:46.893 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318baa3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3184158f60 con 0x7f31840a7220 2023-08-17T17:34:46.893 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318903e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f31840c42d0 0x7f3184157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:56386/0 (socket says 172.21.15.150:56386) 2023-08-17T17:34:46.893 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318903e700 1 -- 172.21.15.150:0/2687244691 learned_addr learned my addr 172.21.15.150:0/2687244691 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-08-17T17:34:46.893 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318983f700 1 --2- 172.21.15.150:0/2687244691 >> v2:172.21.15.78:3300/0 conn(0x7f31840a7220 0x7f3184155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:46.893 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318883d700 1 -- 172.21.15.150:0/2687244691 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553067610 0 0) 0x7f31841586f0 con 0x7f31840c42d0 2023-08-17T17:34:46.894 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318883d700 1 -- 172.21.15.150:0/2687244691 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f316c0033f0 con 0x7f31840c42d0 2023-08-17T17:34:46.894 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318883d700 1 -- 172.21.15.150:0/2687244691 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4047303606 0 0) 0x7f316c0033f0 con 0x7f31840c42d0 2023-08-17T17:34:46.894 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318983f700 1 -- 172.21.15.150:0/2687244691 >> v1:172.21.15.150:6789/0 conn(0x7f31840c42d0 legacy=0x7f3184157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:46.894 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318983f700 1 -- 172.21.15.150:0/2687244691 >> v1:172.21.15.78:6789/0 conn(0x7f31840624e0 legacy=0x7f31840628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:46.894 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318983f700 1 -- 172.21.15.150:0/2687244691 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31841589a0 con 0x7f31840a7220 2023-08-17T17:34:46.894 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.890+0000 7f318983f700 1 --2- 172.21.15.150:0/2687244691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31840a7220 0x7f3184155420 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f3174009de0 tx=0x7f3174009780).ready entity=mon.0 client_cookie=ea878ad3273bdcb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:46.894 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.891+0000 7f318883d700 1 -- 172.21.15.150:0/2687244691 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317400e070 con 0x7f31840a7220 2023-08-17T17:34:46.895 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.891+0000 7f318883d700 1 -- 172.21.15.150:0/2687244691 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317400b8d0 con 0x7f31840a7220 2023-08-17T17:34:46.895 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.891+0000 7f318883d700 1 -- 172.21.15.150:0/2687244691 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3178001470 con 0x7f31840a7220 2023-08-17T17:34:46.896 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.891+0000 7f318baa3700 1 -- 172.21.15.150:0/2687244691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31840a7220 msgr2=0x7f3184155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:46.897 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.891+0000 7f318baa3700 1 --2- 172.21.15.150:0/2687244691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31840a7220 0x7f3184155420 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f3174009de0 tx=0x7f3174009780).stop 2023-08-17T17:34:46.897 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.891+0000 7f318baa3700 1 -- 172.21.15.150:0/2687244691 shutdown_connections 2023-08-17T17:34:46.897 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.891+0000 7f318baa3700 1 --2- 172.21.15.150:0/2687244691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31840a7220 0x7f3184155420 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:46.897 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.891+0000 7f318baa3700 1 -- 172.21.15.150:0/2687244691 >> 172.21.15.150:0/2687244691 conn(0x7f31840c8720 msgr2=0x7f31840c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:46.897 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.891+0000 7f318baa3700 1 -- 172.21.15.150:0/2687244691 shutdown_connections 2023-08-17T17:34:46.897 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.891+0000 7f318baa3700 1 -- 172.21.15.150:0/2687244691 wait complete. 2023-08-17T17:34:46.898 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.892+0000 7f318baa3700 1 Processor -- start 2023-08-17T17:34:46.898 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.892+0000 7f318baa3700 1 -- start start 2023-08-17T17:34:46.898 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318baa3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31840624e0 0x7f3184155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:46.898 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318baa3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31840a7220 0x7f31840a9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:46.898 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318baa3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31840c42d0 0x7f3184165150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:46.898 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318baa3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3184155910 con 0x7f31840624e0 2023-08-17T17:34:46.898 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318baa3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31841578f0 con 0x7f31840c42d0 2023-08-17T17:34:46.898 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318baa3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3184155b20 con 0x7f31840a7220 2023-08-17T17:34:46.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318a040700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31840c42d0 0x7f3184165150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:46.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318903e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31840a7220 0x7f31840a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:46.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318a040700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31840c42d0 0x7f3184165150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36944/0 (socket says 172.21.15.150:36944) 2023-08-17T17:34:46.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318a040700 1 -- 172.21.15.150:0/2680680149 learned_addr learned my addr 172.21.15.150:0/2680680149 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-08-17T17:34:46.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.893+0000 7f318983f700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31840624e0 0x7f3184155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:46.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f318a040700 1 -- 172.21.15.150:0/2680680149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31840a7220 msgr2=0x7f31840a9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:46.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f318a040700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31840a7220 0x7f31840a9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f318a040700 1 -- 172.21.15.150:0/2680680149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31840624e0 msgr2=0x7f3184155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f318a040700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31840624e0 0x7f3184155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f318a040700 1 -- 172.21.15.150:0/2680680149 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3174009a20 con 0x7f31840c42d0 2023-08-17T17:34:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f318903e700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31840a7220 0x7f31840a9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f318a040700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31840c42d0 0x7f3184165150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f317c00c440 tx=0x7f317c007d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f3181ffb700 1 -- 172.21.15.150:0/2680680149 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c012400 con 0x7f31840c42d0 2023-08-17T17:34:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f318baa3700 1 -- 172.21.15.150:0/2680680149 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3184155e00 con 0x7f31840c42d0 2023-08-17T17:34:46.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f3181ffb700 1 -- 172.21.15.150:0/2680680149 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c012770 con 0x7f31840c42d0 2023-08-17T17:34:46.901 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f3181ffb700 1 -- 172.21.15.150:0/2680680149 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c0128e0 con 0x7f31840c42d0 2023-08-17T17:34:46.901 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.894+0000 7f318baa3700 1 -- 172.21.15.150:0/2680680149 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3184164cb0 con 0x7f31840c42d0 2023-08-17T17:34:46.901 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.895+0000 7f3181ffb700 1 -- 172.21.15.150:0/2680680149 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f317c019030 con 0x7f31840c42d0 2023-08-17T17:34:46.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.895+0000 7f318baa3700 1 -- 172.21.15.150:0/2680680149 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3184164e40 con 0x7f31840c42d0 2023-08-17T17:34:46.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.895+0000 7f3181ffb700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f317005ed90 0x7f3170061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:46.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.895+0000 7f3181ffb700 1 -- 172.21.15.150:0/2680680149 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f317c078d40 con 0x7f31840c42d0 2023-08-17T17:34:46.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.896+0000 7f318983f700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f317005ed90 0x7f3170061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:46.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.896+0000 7f318983f700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f317005ed90 0x7f3170061250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f3174009d30 tx=0x7f3174009780).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:46.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:46.900+0000 7f3181ffb700 1 -- 172.21.15.150:0/2680680149 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f317c0488f0 con 0x7f31840c42d0 2023-08-17T17:34:47.105 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.103+0000 7f318baa3700 1 -- 172.21.15.150:0/2680680149 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3184047350 con 0x7f31840c42d0 2023-08-17T17:34:47.105 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.103+0000 7f3181ffb700 1 -- 172.21.15.150:0/2680680149 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f317c017030 con 0x7f31840c42d0 2023-08-17T17:34:47.106 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:34:47.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 -- 172.21.15.150:0/2680680149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f317005ed90 msgr2=0x7f3170061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:47.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f317005ed90 0x7f3170061250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f3174009d30 tx=0x7f3174009780).stop 2023-08-17T17:34:47.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 -- 172.21.15.150:0/2680680149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31840c42d0 msgr2=0x7f3184165150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:47.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31840c42d0 0x7f3184165150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f317c00c440 tx=0x7f317c007d60).stop 2023-08-17T17:34:47.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 -- 172.21.15.150:0/2680680149 shutdown_connections 2023-08-17T17:34:47.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f317005ed90 0x7f3170061250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:47.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31840c42d0 0x7f3184165150 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:47.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31840624e0 0x7f3184155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:47.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 --2- 172.21.15.150:0/2680680149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31840a7220 0x7f31840a9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:47.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 -- 172.21.15.150:0/2680680149 >> 172.21.15.150:0/2680680149 conn(0x7f31840c8720 msgr2=0x7f31840be470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:47.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 -- 172.21.15.150:0/2680680149 shutdown_connections 2023-08-17T17:34:47.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-08-17T17:34:47.105+0000 7f318baa3700 1 -- 172.21.15.150:0/2680680149 wait complete. 2023-08-17T17:34:47.117 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-17T17:34:47.118 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:34:47.118 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2023-08-17T17:34:47.118 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-17T17:34:47.118 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-17T17:34:47.118 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-17T17:34:47.119 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-17T17:34:47.119 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:34:47.119 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-17T17:34:47.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.119 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2023-08-17T17:34:47.135 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:34:47.135 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:34:47.135 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:34:47.135 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.135 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-08-17T17:34:47.135 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.135 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:47.136 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:47.136 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2023-08-17T17:34:47.136 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:47.136 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:47.136 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2023-08-17T17:34:47.136 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:34:47.136 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:47.137 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:34:47.137 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:47.137 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:34:47.137 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-08-17T17:34:47.137 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2023-08-17T17:34:47.137 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.137 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:34:47.137 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 56:a7:e8:0f:3e:0a brd ff:ff:ff:ff:ff:ff 2023-08-17T17:34:47.138 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T17:34:47.138 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.138 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::1c9d:4bff:fed3:c634/64 scope link 2023-08-17T17:34:47.138 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.138 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:34:47.138 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 56:a7:e8:0f:3e:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-17T17:34:47.138 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::54a7:e8ff:fe0f:3e0a/64 scope link tentative 2023-08-17T17:34:47.139 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.139 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:34:47.198 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-08-17T17:34:47.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.200 DEBUG:teuthology.orchestra.run.smithi150:> route 2023-08-17T17:34:47.255 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2023-08-17T17:34:47.255 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:34:47.255 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:34:47.256 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:34:47.256 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:34:47.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.256 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-08-17T17:34:47.257 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-08-17T17:34:47.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:34:47.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:34:47.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:34:47.258 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-08-17T17:34:47.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.356 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-08-17T17:34:47.369 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-17T17:34:47.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.370 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2023-08-17T17:34:47.424 INFO:teuthology.orchestra.run.smithi150.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-17T17:34:47.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.464 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-08-17T17:34:47.464 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-08-17T17:34:47.464 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-17T17:34:47.465 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-17T17:34:47.465 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-08-17T17:34:47.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.513 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-17T17:34:47.542 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:34:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:34:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:34:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-08-17T17:34:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.543 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:34:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether fe:27:6b:86:8f:be brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-17T17:34:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-17T17:34:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::fc27:6bff:fe86:8fbe/64 scope link tentative 2023-08-17T17:34:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.558 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-17T17:34:47.630 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:34:47.631 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:34:47.631 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:34:47.631 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.631 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-08-17T17:34:47.631 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.631 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:34:47.632 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether fe:27:6b:86:8f:be brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-17T17:34:47.632 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-17T17:34:47.632 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.632 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::fc27:6bff:fe86:8fbe/64 scope link tentative 2023-08-17T17:34:47.632 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:34:47.645 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-17T17:34:47.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.645 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-08-17T17:34:47.646 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-08-17T17:34:47.646 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-17T17:34:47.646 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-17T17:34:47.646 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-17T17:34:47.647 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-17T17:34:47.647 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-17T17:34:47.647 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-08-17T17:34:47.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.865 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-08-17T17:34:47.865 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-08-17T17:34:47.865 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.1 up 2023-08-17T17:34:47.866 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.1 master ceph-brx 2023-08-17T17:34:47.866 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-08-17T17:34:47.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:47.946 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p /home/ubuntu/cephtest/mnt.3 2023-08-17T17:34:47.959 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:34:47.960 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:48.038 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:48.039 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:34:48.063 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:34:48.064 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:34:48.066 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:34:48.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:48.066 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-17T17:34:48.129 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-17T17:34:48.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:48.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.269+0000 7f415c4d3700 1 Processor -- start 2023-08-17T17:34:48.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.269+0000 7f415c4d3700 1 -- start start 2023-08-17T17:34:48.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.270+0000 7f415c4d3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 0x7f415415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.270+0000 7f415c4d3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415406b580 con 0x7f4154063b10 2023-08-17T17:34:48.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.270+0000 7f415c4d3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41540bcb10 con 0x7f4154150e10 2023-08-17T17:34:48.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.270+0000 7f415c4d3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41540bc200 con 0x7f41540aa320 2023-08-17T17:34:48.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f4159a6e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4154063b10 0x7f41540bd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45680/0 (socket says 172.21.15.78:45680) 2023-08-17T17:34:48.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f4159a6e700 1 -- 172.21.15.78:0/3500383440 learned_addr learned my addr 172.21.15.78:0/3500383440 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:48.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415aa70700 1 --2- 172.21.15.78:0/3500383440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 0x7f415415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415926d700 1 -- 172.21.15.78:0/3500383440 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706312290 0 0) 0x7f415406b580 con 0x7f4154063b10 2023-08-17T17:34:48.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415926d700 1 -- 172.21.15.78:0/3500383440 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41400033f0 con 0x7f4154063b10 2023-08-17T17:34:48.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415926d700 1 -- 172.21.15.78:0/3500383440 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018284980 0 0) 0x7f41540bcb10 con 0x7f4154150e10 2023-08-17T17:34:48.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415926d700 1 -- 172.21.15.78:0/3500383440 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f415406b580 con 0x7f4154150e10 2023-08-17T17:34:48.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415aa70700 1 -- 172.21.15.78:0/3500383440 >> v1:172.21.15.150:6789/0 conn(0x7f4154150e10 legacy=0x7f41540bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415aa70700 1 -- 172.21.15.78:0/3500383440 >> v1:172.21.15.78:6789/0 conn(0x7f4154063b10 legacy=0x7f41540bd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415aa70700 1 -- 172.21.15.78:0/3500383440 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540c34e0 con 0x7f41540aa320 2023-08-17T17:34:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415aa70700 1 --2- 172.21.15.78:0/3500383440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 0x7f415415bac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f414c009e90 tx=0x7f414c009780).ready entity=mon.2 client_cookie=e212a8516589d471 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415926d700 1 -- 172.21.15.78:0/3500383440 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c00e070 con 0x7f41540aa320 2023-08-17T17:34:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415926d700 1 -- 172.21.15.78:0/3500383440 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c00bab0 con 0x7f41540aa320 2023-08-17T17:34:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.271+0000 7f415926d700 1 -- 172.21.15.78:0/3500383440 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c00be30 con 0x7f41540aa320 2023-08-17T17:34:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.272+0000 7f415c4d3700 1 -- 172.21.15.78:0/3500383440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 msgr2=0x7f415415bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.272+0000 7f415c4d3700 1 --2- 172.21.15.78:0/3500383440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 0x7f415415bac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f414c009e90 tx=0x7f414c009780).stop 2023-08-17T17:34:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.272+0000 7f415c4d3700 1 -- 172.21.15.78:0/3500383440 shutdown_connections 2023-08-17T17:34:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.272+0000 7f415c4d3700 1 --2- 172.21.15.78:0/3500383440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 0x7f415415bac0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.272+0000 7f415c4d3700 1 -- 172.21.15.78:0/3500383440 >> 172.21.15.78:0/3500383440 conn(0x7f41540c3d40 msgr2=0x7f41540c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.272+0000 7f415c4d3700 1 -- 172.21.15.78:0/3500383440 shutdown_connections 2023-08-17T17:34:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.272+0000 7f415c4d3700 1 -- 172.21.15.78:0/3500383440 wait complete. 2023-08-17T17:34:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.273+0000 7f415c4d3700 1 Processor -- start 2023-08-17T17:34:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.273+0000 7f415c4d3700 1 -- start start 2023-08-17T17:34:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415c4d3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4154063b10 0x7f415414aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415c4d3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 0x7f4154151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415c4d3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4154150e10 0x7f4154151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415c4d3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4154152430 con 0x7f4154063b10 2023-08-17T17:34:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415c4d3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41540bf4f0 con 0x7f4154150e10 2023-08-17T17:34:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415c4d3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41540bf060 con 0x7f41540aa320 2023-08-17T17:34:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415a26f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4154063b10 0x7f415414aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415a26f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4154063b10 0x7f415414aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48824/0 (socket says 172.21.15.78:48824) 2023-08-17T17:34:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415a26f700 1 -- 172.21.15.78:0/1402905815 learned_addr learned my addr 172.21.15.78:0/1402905815 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f4159a6e700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 0x7f4154151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415aa70700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4154150e10 0x7f4154151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415a26f700 1 -- 172.21.15.78:0/1402905815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 msgr2=0x7f4154151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415a26f700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 0x7f4154151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415a26f700 1 -- 172.21.15.78:0/1402905815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4154150e10 msgr2=0x7f4154151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415a26f700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4154150e10 0x7f4154151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415a26f700 1 -- 172.21.15.78:0/1402905815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c009a20 con 0x7f4154063b10 2023-08-17T17:34:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415aa70700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4154150e10 0x7f4154151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.274+0000 7f415a26f700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4154063b10 0x7f415414aee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f415000c470 tx=0x7f4150007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.275+0000 7f414a7fc700 1 -- 172.21.15.78:0/1402905815 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000ce90 con 0x7f4154063b10 2023-08-17T17:34:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.275+0000 7f414a7fc700 1 -- 172.21.15.78:0/1402905815 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000f470 con 0x7f4154063b10 2023-08-17T17:34:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.275+0000 7f415c4d3700 1 -- 172.21.15.78:0/1402905815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41540be450 con 0x7f4154063b10 2023-08-17T17:34:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.275+0000 7f414a7fc700 1 -- 172.21.15.78:0/1402905815 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000f830 con 0x7f4154063b10 2023-08-17T17:34:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.275+0000 7f415c4d3700 1 -- 172.21.15.78:0/1402905815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41540bea10 con 0x7f4154063b10 2023-08-17T17:34:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.276+0000 7f415c4d3700 1 -- 172.21.15.78:0/1402905815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41540bf340 con 0x7f4154063b10 2023-08-17T17:34:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.276+0000 7f414a7fc700 1 -- 172.21.15.78:0/1402905815 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4150019030 con 0x7f4154063b10 2023-08-17T17:34:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.276+0000 7f414a7fc700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f413805ed90 0x7f4138061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.276+0000 7f414a7fc700 1 -- 172.21.15.78:0/1402905815 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4150078f40 con 0x7f4154063b10 2023-08-17T17:34:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.277+0000 7f4159a6e700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f413805ed90 0x7f4138061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.277+0000 7f4159a6e700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f413805ed90 0x7f4138061250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f41540a9810 tx=0x7f4144009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.280+0000 7f414a7fc700 1 -- 172.21.15.78:0/1402905815 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f415004a4e0 con 0x7f4154063b10 2023-08-17T17:34:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.443+0000 7f415c4d3700 1 -- 172.21.15.78:0/1402905815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41540c3a80 con 0x7f4154063b10 2023-08-17T17:34:48.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.444+0000 7f414a7fc700 1 -- 172.21.15.78:0/1402905815 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f415004db00 con 0x7f4154063b10 2023-08-17T17:34:48.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:48.446 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 -- 172.21.15.78:0/1402905815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f413805ed90 msgr2=0x7f4138061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f413805ed90 0x7f4138061250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f41540a9810 tx=0x7f4144009040).stop 2023-08-17T17:34:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 -- 172.21.15.78:0/1402905815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4154063b10 msgr2=0x7f415414aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4154063b10 0x7f415414aee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f415000c470 tx=0x7f4150007c50).stop 2023-08-17T17:34:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 -- 172.21.15.78:0/1402905815 shutdown_connections 2023-08-17T17:34:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f413805ed90 0x7f4138061250 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4154150e10 0x7f4154151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4154063b10 0x7f415414aee0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 --2- 172.21.15.78:0/1402905815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41540aa320 0x7f4154151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 -- 172.21.15.78:0/1402905815 >> 172.21.15.78:0/1402905815 conn(0x7f41540c3d40 msgr2=0x7f4154064310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 -- 172.21.15.78:0/1402905815 shutdown_connections 2023-08-17T17:34:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.446+0000 7f415c4d3700 1 -- 172.21.15.78:0/1402905815 wait complete. 2023-08-17T17:34:48.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:34:21.874660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:34:22.501817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:34:48.460 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:34:48.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.574+0000 7f03c570b700 1 Processor -- start 2023-08-17T17:34:48.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.574+0000 7f03c570b700 1 -- start start 2023-08-17T17:34:48.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03c570b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c01502e0 0x7f03c00695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03c570b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03c00bc980 0x7f03c00c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03c570b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c00bd2d0 con 0x7f03c01506c0 2023-08-17T17:34:48.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03c570b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c0069130 con 0x7f03c00bc980 2023-08-17T17:34:48.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03c570b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00c1f40 con 0x7f03c01502e0 2023-08-17T17:34:48.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03bf7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03c00bc980 0x7f03c00c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03beffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c01502e0 0x7f03c00695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03beffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c01502e0 0x7f03c00695c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:51496/0 (socket says 172.21.15.78:51496) 2023-08-17T17:34:48.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03bf7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03c00bc980 0x7f03c00c1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:45108/0 (socket says 172.21.15.78:45108) 2023-08-17T17:34:48.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03beffd700 1 -- 172.21.15.78:0/1541637295 learned_addr learned my addr 172.21.15.78:0/1541637295 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:48.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.575+0000 7f03b67fc700 1 --1- 172.21.15.78:0/1541637295 >> v1:172.21.15.150:6789/0 conn(0x7f03c01506c0 0x7f03c00bc270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:50446/0 (socket says 172.21.15.78:50446) 2023-08-17T17:34:48.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03beffd700 1 -- 172.21.15.78:0/1541637295 >> v2:172.21.15.150:3300/0 conn(0x7f03c00bc980 msgr2=0x7f03c00c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:48.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03beffd700 1 --2- 172.21.15.78:0/1541637295 >> v2:172.21.15.150:3300/0 conn(0x7f03c00bc980 0x7f03c00c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03beffd700 1 -- 172.21.15.78:0/1541637295 >> v1:172.21.15.150:6789/0 conn(0x7f03c01506c0 legacy=0x7f03c00bc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03beffd700 1 -- 172.21.15.78:0/1541637295 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00bd520 con 0x7f03c01502e0 2023-08-17T17:34:48.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03beffd700 1 --2- 172.21.15.78:0/1541637295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c01502e0 0x7f03c00695c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f03b0006fd0 tx=0x7f03b00090f0).ready entity=mon.2 client_cookie=290abdd3dc3f08ae server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03be7fc700 1 -- 172.21.15.78:0/1541637295 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b000b580 con 0x7f03c01502e0 2023-08-17T17:34:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03be7fc700 1 -- 172.21.15.78:0/1541637295 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b000b6e0 con 0x7f03c01502e0 2023-08-17T17:34:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03be7fc700 1 -- 172.21.15.78:0/1541637295 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b000ba80 con 0x7f03c01502e0 2023-08-17T17:34:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03c570b700 1 -- 172.21.15.78:0/1541637295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c01502e0 msgr2=0x7f03c00695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03c570b700 1 --2- 172.21.15.78:0/1541637295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c01502e0 0x7f03c00695c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f03b0006fd0 tx=0x7f03b00090f0).stop 2023-08-17T17:34:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03c570b700 1 -- 172.21.15.78:0/1541637295 shutdown_connections 2023-08-17T17:34:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03c570b700 1 --2- 172.21.15.78:0/1541637295 >> v2:172.21.15.150:3300/0 conn(0x7f03c00bc980 0x7f03c00c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03c570b700 1 --2- 172.21.15.78:0/1541637295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c01502e0 0x7f03c00695c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.576+0000 7f03c570b700 1 -- 172.21.15.78:0/1541637295 >> 172.21.15.78:0/1541637295 conn(0x7f03c00c6a80 msgr2=0x7f03c00c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.577+0000 7f03c570b700 1 -- 172.21.15.78:0/1541637295 shutdown_connections 2023-08-17T17:34:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.577+0000 7f03c570b700 1 -- 172.21.15.78:0/1541637295 wait complete. 2023-08-17T17:34:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.578+0000 7f03c570b700 1 Processor -- start 2023-08-17T17:34:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.578+0000 7f03c570b700 1 -- start start 2023-08-17T17:34:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.578+0000 7f03c570b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00bc980 0x7f03c0136b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.578+0000 7f03c570b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c01502e0 0x7f03c0146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03c570b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03c01506c0 0x7f03c01473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03c570b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0137030 con 0x7f03c01502e0 2023-08-17T17:34:48.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03c570b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0137240 con 0x7f03c01506c0 2023-08-17T17:34:48.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03c570b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01485b0 con 0x7f03c00bc980 2023-08-17T17:34:48.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c01502e0 0x7f03c0146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c01502e0 0x7f03c0146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34034/0 (socket says 172.21.15.78:34034) 2023-08-17T17:34:48.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b67fc700 1 -- 172.21.15.78:0/993689123 learned_addr learned my addr 172.21.15.78:0/993689123 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:48.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03beffd700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00bc980 0x7f03c0136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03bf7fe700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03c01506c0 0x7f03c01473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b67fc700 1 -- 172.21.15.78:0/993689123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00bc980 msgr2=0x7f03c0136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b67fc700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00bc980 0x7f03c0136b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b67fc700 1 -- 172.21.15.78:0/993689123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03c01506c0 msgr2=0x7f03c01473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b67fc700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03c01506c0 0x7f03c01473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b67fc700 1 -- 172.21.15.78:0/993689123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b0009370 con 0x7f03c01502e0 2023-08-17T17:34:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b67fc700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c01502e0 0x7f03c0146ee0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f03a800efd0 tx=0x7f03a8007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b77fe700 1 -- 172.21.15.78:0/993689123 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8016070 con 0x7f03c01502e0 2023-08-17T17:34:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b77fe700 1 -- 172.21.15.78:0/993689123 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a80070d0 con 0x7f03c01502e0 2023-08-17T17:34:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03c570b700 1 -- 172.21.15.78:0/993689123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c01479a0 con 0x7f03c01502e0 2023-08-17T17:34:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03b77fe700 1 -- 172.21.15.78:0/993689123 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8007450 con 0x7f03c01502e0 2023-08-17T17:34:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.579+0000 7f03c570b700 1 -- 172.21.15.78:0/993689123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c0147f60 con 0x7f03c01502e0 2023-08-17T17:34:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.580+0000 7f03c570b700 1 -- 172.21.15.78:0/993689123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c0067440 con 0x7f03c01502e0 2023-08-17T17:34:48.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.581+0000 7f03b77fe700 1 -- 172.21.15.78:0/993689123 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f03a8005b00 con 0x7f03c01502e0 2023-08-17T17:34:48.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.581+0000 7f03b77fe700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f03a005ed60 0x7f03a0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.581+0000 7f03b77fe700 1 -- 172.21.15.78:0/993689123 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f03a807bc90 con 0x7f03c01502e0 2023-08-17T17:34:48.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.581+0000 7f03beffd700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f03a005ed60 0x7f03a0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.581+0000 7f03beffd700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f03a005ed60 0x7f03a0061220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f03b0009fd0 tx=0x7f03b0017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:48.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.585+0000 7f03b77fe700 1 -- 172.21.15.78:0/993689123 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f03a804d230 con 0x7f03c01502e0 2023-08-17T17:34:48.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.747+0000 7f03c570b700 1 -- 172.21.15.78:0/993689123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f03c00bd800 con 0x7f03c01502e0 2023-08-17T17:34:48.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.747+0000 7f03b77fe700 1 -- 172.21.15.78:0/993689123 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f03a8050850 con 0x7f03c01502e0 2023-08-17T17:34:48.749 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:34:48.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 -- 172.21.15.78:0/993689123 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f03a005ed60 msgr2=0x7f03a0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f03a005ed60 0x7f03a0061220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f03b0009fd0 tx=0x7f03b0017000).stop 2023-08-17T17:34:48.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 -- 172.21.15.78:0/993689123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c01502e0 msgr2=0x7f03c0146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c01502e0 0x7f03c0146ee0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f03a800efd0 tx=0x7f03a8007df0).stop 2023-08-17T17:34:48.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 -- 172.21.15.78:0/993689123 shutdown_connections 2023-08-17T17:34:48.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f03a005ed60 0x7f03a0061220 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03c01506c0 0x7f03c01473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00bc980 0x7f03c0136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 --2- 172.21.15.78:0/993689123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c01502e0 0x7f03c0146ee0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 -- 172.21.15.78:0/993689123 >> 172.21.15.78:0/993689123 conn(0x7f03c00c6a80 msgr2=0x7f03c00c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:48.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 -- 172.21.15.78:0/993689123 shutdown_connections 2023-08-17T17:34:48.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.749+0000 7f03c570b700 1 -- 172.21.15.78:0/993689123 wait complete. 2023-08-17T17:34:48.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:34:48.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.875+0000 7f2f4b59e700 1 Processor -- start 2023-08-17T17:34:48.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.875+0000 7f2f4b59e700 1 -- start start 2023-08-17T17:34:48.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.876+0000 7f2f4b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2f4c151a40 0x7f2f4c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.876+0000 7f2f4b59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f4c157be0 0x7f2f4c158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.876+0000 7f2f4b59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c158520 con 0x7f2f4c151e20 2023-08-17T17:34:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.876+0000 7f2f4b59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0c6620 con 0x7f2f4c157be0 2023-08-17T17:34:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.876+0000 7f2f4b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0c6900 con 0x7f2f4c151a40 2023-08-17T17:34:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4ad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f4c157be0 0x7f2f4c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f49d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2f4c151e20 0x7f2f4c0c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33024/0 (socket says 172.21.15.78:33024) 2023-08-17T17:34:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f49d9b700 1 -- 172.21.15.78:0/2256061770 learned_addr learned my addr 172.21.15.78:0/2256061770 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4a59c700 1 --2- 172.21.15.78:0/2256061770 >> v2:172.21.15.150:3300/0 conn(0x7f2f4c151a40 0x7f2f4c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4ad9d700 1 -- 172.21.15.78:0/2256061770 >> v2:172.21.15.150:3300/0 conn(0x7f2f4c151a40 msgr2=0x7f2f4c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4ad9d700 1 --2- 172.21.15.78:0/2256061770 >> v2:172.21.15.150:3300/0 conn(0x7f2f4c151a40 0x7f2f4c0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4ad9d700 1 -- 172.21.15.78:0/2256061770 >> v1:172.21.15.78:6789/0 conn(0x7f2f4c151e20 legacy=0x7f2f4c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4959a700 1 -- 172.21.15.78:0/2256061770 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016351597 0 0) 0x7f2f4c158520 con 0x7f2f4c151e20 2023-08-17T17:34:48.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4ad9d700 1 -- 172.21.15.78:0/2256061770 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c0c6be0 con 0x7f2f4c157be0 2023-08-17T17:34:48.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4ad9d700 1 --2- 172.21.15.78:0/2256061770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 0x7f2f4c158030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f2f4c083860 tx=0x7f2f44009060).ready entity=mon.0 client_cookie=59a5afc1b2d883e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:48.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4959a700 1 -- 172.21.15.78:0/2256061770 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4400f510 con 0x7f2f4c157be0 2023-08-17T17:34:48.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4959a700 1 -- 172.21.15.78:0/2256061770 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4400f670 con 0x7f2f4c157be0 2023-08-17T17:34:48.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.877+0000 7f2f4959a700 1 -- 172.21.15.78:0/2256061770 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4400f9f0 con 0x7f2f4c157be0 2023-08-17T17:34:48.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.878+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2256061770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 msgr2=0x7f2f4c158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.878+0000 7f2f4b59e700 1 --2- 172.21.15.78:0/2256061770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 0x7f2f4c158030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f2f4c083860 tx=0x7f2f44009060).stop 2023-08-17T17:34:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.878+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2256061770 shutdown_connections 2023-08-17T17:34:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.878+0000 7f2f4b59e700 1 --2- 172.21.15.78:0/2256061770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 0x7f2f4c158030 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.878+0000 7f2f4b59e700 1 --2- 172.21.15.78:0/2256061770 >> v2:172.21.15.150:3300/0 conn(0x7f2f4c151a40 0x7f2f4c0c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.878+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2256061770 >> 172.21.15.78:0/2256061770 conn(0x7f2f4c0943b0 msgr2=0x7f2f4c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.878+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2256061770 shutdown_connections 2023-08-17T17:34:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.878+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2256061770 wait complete. 2023-08-17T17:34:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.879+0000 7f2f4b59e700 1 Processor -- start 2023-08-17T17:34:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.879+0000 7f2f4b59e700 1 -- start start 2023-08-17T17:34:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f4c151a40 0x7f2f4c0ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f4c151e20 0x7f2f4c144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 0x7f2f4c0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4b59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c164420 con 0x7f2f4c157be0 2023-08-17T17:34:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0aae50 con 0x7f2f4c151a40 2023-08-17T17:34:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c167e00 con 0x7f2f4c151e20 2023-08-17T17:34:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 0x7f2f4c0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 0x7f2f4c0b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34056/0 (socket says 172.21.15.78:34056) 2023-08-17T17:34:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4ad9d700 1 -- 172.21.15.78:0/2794066081 learned_addr learned my addr 172.21.15.78:0/2794066081 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f49d9b700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f4c151e20 0x7f2f4c144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4a59c700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f4c151a40 0x7f2f4c0ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4ad9d700 1 -- 172.21.15.78:0/2794066081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f4c151e20 msgr2=0x7f2f4c144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4ad9d700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f4c151e20 0x7f2f4c144ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4ad9d700 1 -- 172.21.15.78:0/2794066081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f4c151a40 msgr2=0x7f2f4c0ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4ad9d700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f4c151a40 0x7f2f4c0ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4ad9d700 1 -- 172.21.15.78:0/2794066081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f440092a0 con 0x7f2f4c157be0 2023-08-17T17:34:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f49d9b700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f4c151e20 0x7f2f4c144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4ad9d700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 0x7f2f4c0b0400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f2f44009dd0 tx=0x7f2f44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f427fc700 1 -- 172.21.15.78:0/2794066081 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4400f9f0 con 0x7f2f4c157be0 2023-08-17T17:34:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f427fc700 1 -- 172.21.15.78:0/2794066081 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4401b440 con 0x7f2f4c157be0 2023-08-17T17:34:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2794066081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c1680e0 con 0x7f2f4c157be0 2023-08-17T17:34:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f427fc700 1 -- 172.21.15.78:0/2794066081 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4401b800 con 0x7f2f4c157be0 2023-08-17T17:34:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.880+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2794066081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c1686a0 con 0x7f2f4c157be0 2023-08-17T17:34:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.881+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2794066081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c1645c0 con 0x7f2f4c157be0 2023-08-17T17:34:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.882+0000 7f2f427fc700 1 -- 172.21.15.78:0/2794066081 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2f4400f070 con 0x7f2f4c157be0 2023-08-17T17:34:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.882+0000 7f2f427fc700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f2c05ed90 0x7f2f2c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.882+0000 7f2f427fc700 1 -- 172.21.15.78:0/2794066081 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2f4407b250 con 0x7f2f4c157be0 2023-08-17T17:34:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.882+0000 7f2f4a59c700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f2c05ed90 0x7f2f2c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:48.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.882+0000 7f2f4a59c700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f2c05ed90 0x7f2f2c061250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2f3c007700 tx=0x7f2f3c00b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:48.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:48.886+0000 7f2f427fc700 1 -- 172.21.15.78:0/2794066081 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f4c1645c0 con 0x7f2f4c157be0 2023-08-17T17:34:49.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.049+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2794066081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f4c1645c0 con 0x7f2f4c157be0 2023-08-17T17:34:49.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.050+0000 7f2f427fc700 1 -- 172.21.15.78:0/2794066081 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f4c1645c0 con 0x7f2f4c157be0 2023-08-17T17:34:49.051 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:34:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2794066081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f2c05ed90 msgr2=0x7f2f2c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f2c05ed90 0x7f2f2c061250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2f3c007700 tx=0x7f2f3c00b040).stop 2023-08-17T17:34:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2794066081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 msgr2=0x7f2f4c0b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 0x7f2f4c0b0400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f2f44009dd0 tx=0x7f2f44017000).stop 2023-08-17T17:34:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2794066081 shutdown_connections 2023-08-17T17:34:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f2c05ed90 0x7f2f2c061250 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f4c157be0 0x7f2f4c0b0400 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f4c151a40 0x7f2f4c0ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 --2- 172.21.15.78:0/2794066081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f4c151e20 0x7f2f4c144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2794066081 >> 172.21.15.78:0/2794066081 conn(0x7f2f4c0943b0 msgr2=0x7f2f4c0c1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2794066081 shutdown_connections 2023-08-17T17:34:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.051+0000 7f2f4b59e700 1 -- 172.21.15.78:0/2794066081 wait complete. 2023-08-17T17:34:49.064 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:34:49.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.178+0000 7fb2edad6700 1 Processor -- start 2023-08-17T17:34:49.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.178+0000 7fb2edad6700 1 -- start start 2023-08-17T17:34:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.179+0000 7fb2edad6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2e80aa0f0 0x7fb2e80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.179+0000 7fb2edad6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb2e80aa4d0 0x7fb2e80c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.179+0000 7fb2edad6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e80649b0 con 0x7fb2e80c5810 2023-08-17T17:34:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.179+0000 7fb2edad6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e8063420 con 0x7fb2e80aa0f0 2023-08-17T17:34:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.179+0000 7fb2edad6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e8063700 con 0x7fb2e80aa4d0 2023-08-17T17:34:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.179+0000 7fb2e77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2e80aa0f0 0x7fb2e80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.179+0000 7fb2e77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2e80aa0f0 0x7fb2e80644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34058/0 (socket says 172.21.15.78:34058) 2023-08-17T17:34:49.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.179+0000 7fb2e7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb2e80c5810 0x7fb2e80a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33030/0 (socket says 172.21.15.78:33030) 2023-08-17T17:34:49.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.179+0000 7fb2e77fe700 1 -- 172.21.15.78:0/2823311277 learned_addr learned my addr 172.21.15.78:0/2823311277 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:49.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e6ffd700 1 --2- 172.21.15.78:0/2823311277 >> v2:172.21.15.150:3300/0 conn(0x7fb2e80aa4d0 0x7fb2e80c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e77fe700 1 -- 172.21.15.78:0/2823311277 >> v2:172.21.15.150:3300/0 conn(0x7fb2e80aa4d0 msgr2=0x7fb2e80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:49.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e77fe700 1 --2- 172.21.15.78:0/2823311277 >> v2:172.21.15.150:3300/0 conn(0x7fb2e80aa4d0 0x7fb2e80c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e77fe700 1 -- 172.21.15.78:0/2823311277 >> v1:172.21.15.78:6789/0 conn(0x7fb2e80c5810 legacy=0x7fb2e80a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e67fc700 1 -- 172.21.15.78:0/2823311277 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347654135 0 0) 0x7fb2e80649b0 con 0x7fb2e80c5810 2023-08-17T17:34:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e77fe700 1 -- 172.21.15.78:0/2823311277 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80639e0 con 0x7fb2e80aa0f0 2023-08-17T17:34:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e6ffd700 1 --2- 172.21.15.78:0/2823311277 >> v2:172.21.15.150:3300/0 conn(0x7fb2e80aa4d0 0x7fb2e80c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e77fe700 1 --2- 172.21.15.78:0/2823311277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80aa0f0 0x7fb2e80644c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb2e8159060 tx=0x7fb2d80090f0).ready entity=mon.0 client_cookie=a0a20a615a2954ff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e67fc700 1 -- 172.21.15.78:0/2823311277 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800b600 con 0x7fb2e80aa0f0 2023-08-17T17:34:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e67fc700 1 -- 172.21.15.78:0/2823311277 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d800b760 con 0x7fb2e80aa0f0 2023-08-17T17:34:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2e67fc700 1 -- 172.21.15.78:0/2823311277 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800bae0 con 0x7fb2e80aa0f0 2023-08-17T17:34:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2edad6700 1 -- 172.21.15.78:0/2823311277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80aa0f0 msgr2=0x7fb2e80644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2edad6700 1 --2- 172.21.15.78:0/2823311277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80aa0f0 0x7fb2e80644c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb2e8159060 tx=0x7fb2d80090f0).stop 2023-08-17T17:34:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2edad6700 1 -- 172.21.15.78:0/2823311277 shutdown_connections 2023-08-17T17:34:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2edad6700 1 --2- 172.21.15.78:0/2823311277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80aa0f0 0x7fb2e80644c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2edad6700 1 --2- 172.21.15.78:0/2823311277 >> v2:172.21.15.150:3300/0 conn(0x7fb2e80aa4d0 0x7fb2e80c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2edad6700 1 -- 172.21.15.78:0/2823311277 >> 172.21.15.78:0/2823311277 conn(0x7fb2e806a6a0 msgr2=0x7fb2e80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2edad6700 1 -- 172.21.15.78:0/2823311277 shutdown_connections 2023-08-17T17:34:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.180+0000 7fb2edad6700 1 -- 172.21.15.78:0/2823311277 wait complete. 2023-08-17T17:34:49.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.182+0000 7fb2edad6700 1 Processor -- start 2023-08-17T17:34:49.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.182+0000 7fb2edad6700 1 -- start start 2023-08-17T17:34:49.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.182+0000 7fb2edad6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2e80aa0f0 0x7fb2e80c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.182+0000 7fb2edad6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2e80aa4d0 0x7fb2e8151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.182+0000 7fb2edad6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80c5810 0x7fb2e8151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.182+0000 7fb2edad6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80c2d40 con 0x7fb2e80c5810 2023-08-17T17:34:49.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.182+0000 7fb2edad6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e8152170 con 0x7fb2e80aa0f0 2023-08-17T17:34:49.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.182+0000 7fb2edad6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80c31d0 con 0x7fb2e80aa4d0 2023-08-17T17:34:49.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.182+0000 7fb2e7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80c5810 0x7fb2e8151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2e7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80c5810 0x7fb2e8151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34064/0 (socket says 172.21.15.78:34064) 2023-08-17T17:34:49.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2e7fff700 1 -- 172.21.15.78:0/1675844432 learned_addr learned my addr 172.21.15.78:0/1675844432 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:49.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2e77fe700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2e80aa0f0 0x7fb2e80c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2e6ffd700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2e80aa4d0 0x7fb2e8151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2e7fff700 1 -- 172.21.15.78:0/1675844432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2e80aa4d0 msgr2=0x7fb2e8151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2e7fff700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2e80aa4d0 0x7fb2e8151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2e7fff700 1 -- 172.21.15.78:0/1675844432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2e80aa0f0 msgr2=0x7fb2e80c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2e7fff700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2e80aa0f0 0x7fb2e80c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2e7fff700 1 -- 172.21.15.78:0/1675844432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8009370 con 0x7fb2e80c5810 2023-08-17T17:34:49.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2e7fff700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80c5810 0x7fb2e8151360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fb2e000c810 tx=0x7fb2e00014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:49.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2cf7fe700 1 -- 172.21.15.78:0/1675844432 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0005c70 con 0x7fb2e80c5810 2023-08-17T17:34:49.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2cf7fe700 1 -- 172.21.15.78:0/1675844432 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e0005dd0 con 0x7fb2e80c5810 2023-08-17T17:34:49.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2edad6700 1 -- 172.21.15.78:0/1675844432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e80c2130 con 0x7fb2e80c5810 2023-08-17T17:34:49.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2cf7fe700 1 -- 172.21.15.78:0/1675844432 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0007320 con 0x7fb2e80c5810 2023-08-17T17:34:49.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.183+0000 7fb2edad6700 1 -- 172.21.15.78:0/1675844432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e80c26f0 con 0x7fb2e80c5810 2023-08-17T17:34:49.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.184+0000 7fb2edad6700 1 -- 172.21.15.78:0/1675844432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e8083980 con 0x7fb2e80c5810 2023-08-17T17:34:49.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.184+0000 7fb2cf7fe700 1 -- 172.21.15.78:0/1675844432 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb2e001a060 con 0x7fb2e80c5810 2023-08-17T17:34:49.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.185+0000 7fb2cf7fe700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2d405ed90 0x7fb2d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.185+0000 7fb2cf7fe700 1 -- 172.21.15.78:0/1675844432 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb2e0079430 con 0x7fb2e80c5810 2023-08-17T17:34:49.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.185+0000 7fb2e77fe700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2d405ed90 0x7fb2d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.185+0000 7fb2e77fe700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2d405ed90 0x7fb2d4061250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb2d8009130 tx=0x7fb2d8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:49.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.189+0000 7fb2cf7fe700 1 -- 172.21.15.78:0/1675844432 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2e004a9d0 con 0x7fb2e80c5810 2023-08-17T17:34:49.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.354+0000 7fb2edad6700 1 -- 172.21.15.78:0/1675844432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2e80cbd40 con 0x7fb2e80c5810 2023-08-17T17:34:49.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.354+0000 7fb2cf7fe700 1 -- 172.21.15.78:0/1675844432 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2e00180a0 con 0x7fb2e80c5810 2023-08-17T17:34:49.356 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:49.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 -- 172.21.15.78:0/1675844432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2d405ed90 msgr2=0x7fb2d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2d405ed90 0x7fb2d4061250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb2d8009130 tx=0x7fb2d8017000).stop 2023-08-17T17:34:49.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 -- 172.21.15.78:0/1675844432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80c5810 msgr2=0x7fb2e8151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80c5810 0x7fb2e8151360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fb2e000c810 tx=0x7fb2e00014a0).stop 2023-08-17T17:34:49.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 -- 172.21.15.78:0/1675844432 shutdown_connections 2023-08-17T17:34:49.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2d405ed90 0x7fb2d4061250 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e80c5810 0x7fb2e8151360 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2e80aa0f0 0x7fb2e80c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 --2- 172.21.15.78:0/1675844432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2e80aa4d0 0x7fb2e8151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 -- 172.21.15.78:0/1675844432 >> 172.21.15.78:0/1675844432 conn(0x7fb2e806a6a0 msgr2=0x7fb2e8153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:49.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 -- 172.21.15.78:0/1675844432 shutdown_connections 2023-08-17T17:34:49.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.356+0000 7fb2edad6700 1 -- 172.21.15.78:0/1675844432 wait complete. 2023-08-17T17:34:49.369 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:34:49.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.483+0000 7f6017af3700 1 Processor -- start 2023-08-17T17:34:49.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.483+0000 7f6017af3700 1 -- start start 2023-08-17T17:34:49.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.484+0000 7f6017af3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6010062c00 0x7f60101590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.484+0000 7f6017af3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6010069310 con 0x7f601006a040 2023-08-17T17:34:49.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.484+0000 7f6017af3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6010069bb0 con 0x7f601013b490 2023-08-17T17:34:49.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.484+0000 7f6017af3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6010159780 con 0x7f6010062c00 2023-08-17T17:34:49.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.484+0000 7f601508e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f601006a040 0x7f60101589e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33040/0 (socket says 172.21.15.78:33040) 2023-08-17T17:34:49.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.484+0000 7f601508e700 1 -- 172.21.15.78:0/1255034290 learned_addr learned my addr 172.21.15.78:0/1255034290 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:49.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.484+0000 7f6016090700 1 --2- 172.21.15.78:0/1255034290 >> v2:172.21.15.150:3300/0 conn(0x7f6010062c00 0x7f60101590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.484+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342389986 0 0) 0x7f6010069310 con 0x7f601006a040 2023-08-17T17:34:49.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.484+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff80033f0 con 0x7f601006a040 2023-08-17T17:34:49.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.484+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145839538 0 0) 0x7f5ff80033f0 con 0x7f601006a040 2023-08-17T17:34:49.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 >> v2:172.21.15.150:3300/0 conn(0x7f6010062c00 msgr2=0x7f60101590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:49.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 --2- 172.21.15.78:0/1255034290 >> v2:172.21.15.150:3300/0 conn(0x7f6010062c00 0x7f60101590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 >> v1:172.21.15.150:6789/0 conn(0x7f601013b490 legacy=0x7f60100624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010069560 con 0x7f601006a040 2023-08-17T17:34:49.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f6004001470 con 0x7f601006a040 2023-08-17T17:34:49.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 >> v1:172.21.15.78:6789/0 conn(0x7f601006a040 legacy=0x7f60101589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff80038e0 0x7f5ff8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff8004690 0x7f5ff8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff8005000 0x7f5ff800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6010159780 con 0x7f5ff8004690 2023-08-17T17:34:49.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff800bf60 con 0x7f5ff80038e0 2023-08-17T17:34:49.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff800c0f0 con 0x7f5ff8005000 2023-08-17T17:34:49.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601508e700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff8004690 0x7f5ff8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601588f700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff80038e0 0x7f5ff8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f6016090700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff8005000 0x7f5ff800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601508e700 1 -- 172.21.15.78:0/1255034290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff8005000 msgr2=0x7f5ff800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:49.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601508e700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff8005000 0x7f5ff800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601508e700 1 -- 172.21.15.78:0/1255034290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff80038e0 msgr2=0x7f5ff8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:49.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601508e700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff80038e0 0x7f5ff8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601508e700 1 -- 172.21.15.78:0/1255034290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80033f0 con 0x7f5ff8004690 2023-08-17T17:34:49.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f6016090700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff8005000 0x7f5ff800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:49.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f6016090700 1 -- 172.21.15.78:0/1255034290 reap_dead start 2023-08-17T17:34:49.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601508e700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff8004690 0x7f5ff8004b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f600400c190 tx=0x7f6004001e50).ready entity=mon.0 client_cookie=8ca14db2b16528e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:49.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004007a20 con 0x7f5ff8004690 2023-08-17T17:34:49.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600400cac0 con 0x7f5ff8004690 2023-08-17T17:34:49.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.485+0000 7f601488d700 1 -- 172.21.15.78:0/1255034290 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600400ce40 con 0x7f5ff8004690 2023-08-17T17:34:49.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.486+0000 7f6017af3700 1 -- 172.21.15.78:0/1255034290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff8004690 msgr2=0x7f5ff8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.486+0000 7f6017af3700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff8004690 0x7f5ff8004b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f600400c190 tx=0x7f6004001e50).stop 2023-08-17T17:34:49.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.486+0000 7f6017af3700 1 -- 172.21.15.78:0/1255034290 shutdown_connections 2023-08-17T17:34:49.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.486+0000 7f6017af3700 1 --2- 172.21.15.78:0/1255034290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff8004690 0x7f5ff8004b10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.486+0000 7f6017af3700 1 -- 172.21.15.78:0/1255034290 >> 172.21.15.78:0/1255034290 conn(0x7f60100c7b80 msgr2=0x7f60100c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:49.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.486+0000 7f6017af3700 1 -- 172.21.15.78:0/1255034290 shutdown_connections 2023-08-17T17:34:49.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.486+0000 7f6017af3700 1 -- 172.21.15.78:0/1255034290 wait complete. 2023-08-17T17:34:49.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.487+0000 7f6017af3700 1 Processor -- start 2023-08-17T17:34:49.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.487+0000 7f6017af3700 1 -- start start 2023-08-17T17:34:49.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f6017af3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff8004690 0x7f6010151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f6017af3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6010151a40 0x7f6010155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f6017af3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6010155670 0x7f60100ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f6017af3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601013c200 con 0x7f6010151a40 2023-08-17T17:34:49.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f6017af3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6010155ab0 con 0x7f5ff8004690 2023-08-17T17:34:49.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f6017af3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60100ad6f0 con 0x7f6010155670 2023-08-17T17:34:49.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f601508e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6010151a40 0x7f6010155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f601508e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6010151a40 0x7f6010155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34078/0 (socket says 172.21.15.78:34078) 2023-08-17T17:34:49.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f601508e700 1 -- 172.21.15.78:0/2886733026 learned_addr learned my addr 172.21.15.78:0/2886733026 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:49.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f601588f700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff8004690 0x7f6010151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f6016090700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6010155670 0x7f60100ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f601508e700 1 -- 172.21.15.78:0/2886733026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6010155670 msgr2=0x7f60100ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f601508e700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6010155670 0x7f60100ac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f601508e700 1 -- 172.21.15.78:0/2886733026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff8004690 msgr2=0x7f6010151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f601508e700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff8004690 0x7f6010151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f601508e700 1 -- 172.21.15.78:0/2886733026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60100ad9d0 con 0x7f6010151a40 2023-08-17T17:34:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f601508e700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6010151a40 0x7f6010155180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f600400ca90 tx=0x7f6004015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f600dffb700 1 -- 172.21.15.78:0/2886733026 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040072e0 con 0x7f6010151a40 2023-08-17T17:34:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f600dffb700 1 -- 172.21.15.78:0/2886733026 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6004007440 con 0x7f6010151a40 2023-08-17T17:34:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f600dffb700 1 -- 172.21.15.78:0/2886733026 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040046b0 con 0x7f6010151a40 2023-08-17T17:34:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.488+0000 7f6017af3700 1 -- 172.21.15.78:0/2886733026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601013bbb0 con 0x7f6010151a40 2023-08-17T17:34:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.489+0000 7f6017af3700 1 -- 172.21.15.78:0/2886733026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60100ace70 con 0x7f6010151a40 2023-08-17T17:34:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.489+0000 7f6017af3700 1 -- 172.21.15.78:0/2886733026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601013c3b0 con 0x7f6010151a40 2023-08-17T17:34:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.490+0000 7f600dffb700 1 -- 172.21.15.78:0/2886733026 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6004010070 con 0x7f6010151a40 2023-08-17T17:34:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.490+0000 7f600dffb700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ffc05ed90 0x7f5ffc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.490+0000 7f600dffb700 1 -- 172.21.15.78:0/2886733026 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f600407a290 con 0x7f6010151a40 2023-08-17T17:34:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.490+0000 7f601588f700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ffc05ed90 0x7f5ffc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.490+0000 7f601588f700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ffc05ed90 0x7f5ffc061250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f6000004290 tx=0x7f6000007f30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.494+0000 7f600dffb700 1 -- 172.21.15.78:0/2886733026 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f601013c3b0 con 0x7f6010151a40 2023-08-17T17:34:49.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.655+0000 7f6017af3700 1 -- 172.21.15.78:0/2886733026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6010068270 con 0x7f6010151a40 2023-08-17T17:34:49.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.655+0000 7f600dffb700 1 -- 172.21.15.78:0/2886733026 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6004024070 con 0x7f6010151a40 2023-08-17T17:34:49.657 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:49.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.657+0000 7f6017af3700 1 -- 172.21.15.78:0/2886733026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ffc05ed90 msgr2=0x7f5ffc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.657+0000 7f6017af3700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ffc05ed90 0x7f5ffc061250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f6000004290 tx=0x7f6000007f30).stop 2023-08-17T17:34:49.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.657+0000 7f6017af3700 1 -- 172.21.15.78:0/2886733026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6010151a40 msgr2=0x7f6010155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.657+0000 7f6017af3700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6010151a40 0x7f6010155180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f600400ca90 tx=0x7f6004015000).stop 2023-08-17T17:34:49.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.657+0000 7f6017af3700 1 -- 172.21.15.78:0/2886733026 shutdown_connections 2023-08-17T17:34:49.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.657+0000 7f6017af3700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ffc05ed90 0x7f5ffc061250 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.657+0000 7f6017af3700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6010155670 0x7f60100ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.657+0000 7f6017af3700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff8004690 0x7f6010151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.657+0000 7f6017af3700 1 --2- 172.21.15.78:0/2886733026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6010151a40 0x7f6010155180 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.657+0000 7f6017af3700 1 -- 172.21.15.78:0/2886733026 >> 172.21.15.78:0/2886733026 conn(0x7f60100c7b80 msgr2=0x7f6010152850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:49.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.658+0000 7f6017af3700 1 -- 172.21.15.78:0/2886733026 shutdown_connections 2023-08-17T17:34:49.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.658+0000 7f6017af3700 1 -- 172.21.15.78:0/2886733026 wait complete. 2023-08-17T17:34:49.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.782+0000 7f3c34b6d700 1 Processor -- start 2023-08-17T17:34:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.782+0000 7f3c34b6d700 1 -- start start 2023-08-17T17:34:49.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.783+0000 7f3c34b6d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3c3013a640 0x7f3c30154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.783+0000 7f3c34b6d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c3006a2c0 0x7f3c30069050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.783+0000 7f3c34b6d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c300c2c10 con 0x7f3c3013aa20 2023-08-17T17:34:49.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.783+0000 7f3c34b6d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c30155010 con 0x7f3c3013a640 2023-08-17T17:34:49.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.783+0000 7f3c34b6d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c301552e0 con 0x7f3c3006a2c0 2023-08-17T17:34:49.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.783+0000 7f3c2ed9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3c3013aa20 0x7f3c30151590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33042/0 (socket says 172.21.15.78:33042) 2023-08-17T17:34:49.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.783+0000 7f3c2ed9d700 1 -- 172.21.15.78:0/2523486867 learned_addr learned my addr 172.21.15.78:0/2523486867 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:49.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2e59c700 1 --2- 172.21.15.78:0/2523486867 >> v2:172.21.15.150:3300/0 conn(0x7f3c3013a640 0x7f3c30154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2dd9b700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c3006a2c0 0x7f3c30069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648786031 0 0) 0x7f3c300c2c10 con 0x7f3c3013aa20 2023-08-17T17:34:49.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c1c0033f0 con 0x7f3c3013aa20 2023-08-17T17:34:49.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3860415059 0 0) 0x7f3c1c0033f0 con 0x7f3c3013aa20 2023-08-17T17:34:49.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c3006a2c0 msgr2=0x7f3c30069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:49.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c3006a2c0 0x7f3c30069050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 >> v2:172.21.15.150:3300/0 conn(0x7f3c3013a640 msgr2=0x7f3c30154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:49.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 --2- 172.21.15.78:0/2523486867 >> v2:172.21.15.150:3300/0 conn(0x7f3c3013a640 0x7f3c30154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c301555c0 con 0x7f3c3013aa20 2023-08-17T17:34:49.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3c28001470 con 0x7f3c3013aa20 2023-08-17T17:34:49.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 >> v1:172.21.15.78:6789/0 conn(0x7f3c3013aa20 legacy=0x7f3c30151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c1c0038e0 0x7f3c1c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c1c004690 0x7f3c1c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c1c005000 0x7f3c1c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c30155010 con 0x7f3c1c004690 2023-08-17T17:34:49.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c301552e0 con 0x7f3c1c0038e0 2023-08-17T17:34:49.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c00bdd0 con 0x7f3c1c005000 2023-08-17T17:34:49.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2dd9b700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c3006a2c0 0x7f3c30069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:49.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2e59c700 1 --2- 172.21.15.78:0/2523486867 >> v2:172.21.15.150:3300/0 conn(0x7f3c3013a640 0x7f3c30154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:49.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2dd9b700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c1c004690 0x7f3c1c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2dd9b700 1 -- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c1c005000 msgr2=0x7f3c1c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:49.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2dd9b700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c1c005000 0x7f3c1c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:49.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2dd9b700 1 -- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c1c0038e0 msgr2=0x7f3c1c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:49.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2e59c700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c1c0038e0 0x7f3c1c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2dd9b700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c1c0038e0 0x7f3c1c003d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.784+0000 7f3c2dd9b700 1 -- 172.21.15.78:0/2523486867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c0033f0 con 0x7f3c1c004690 2023-08-17T17:34:49.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c2dd9b700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c1c004690 0x7f3c1c004b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f3c18009ad0 tx=0x7f3c18009060).ready entity=mon.0 client_cookie=8f6c9058834161be server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:49.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180094d0 con 0x7f3c1c004690 2023-08-17T17:34:49.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800e640 con 0x7f3c1c004690 2023-08-17T17:34:49.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c2d59a700 1 -- 172.21.15.78:0/2523486867 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800ea00 con 0x7f3c1c004690 2023-08-17T17:34:49.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c34b6d700 1 -- 172.21.15.78:0/2523486867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c1c004690 msgr2=0x7f3c1c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c34b6d700 1 --2- 172.21.15.78:0/2523486867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c1c004690 0x7f3c1c004b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f3c18009ad0 tx=0x7f3c18009060).stop 2023-08-17T17:34:49.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c2ed9d700 1 -- 172.21.15.78:0/2523486867 reap_dead start 2023-08-17T17:34:49.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c34b6d700 1 -- 172.21.15.78:0/2523486867 shutdown_connections 2023-08-17T17:34:49.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c34b6d700 1 -- 172.21.15.78:0/2523486867 >> 172.21.15.78:0/2523486867 conn(0x7f3c300c7b00 msgr2=0x7f3c300c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:49.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c34b6d700 1 -- 172.21.15.78:0/2523486867 shutdown_connections 2023-08-17T17:34:49.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.785+0000 7f3c34b6d700 1 -- 172.21.15.78:0/2523486867 wait complete. 2023-08-17T17:34:49.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.786+0000 7f3c34b6d700 1 Processor -- start 2023-08-17T17:34:49.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.786+0000 7f3c34b6d700 1 -- start start 2023-08-17T17:34:49.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c34b6d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c1c004690 0x7f3c30150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c34b6d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c30136a30 0x7f3c30064d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c34b6d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c300aaab0 0x7f3c30065230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c34b6d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c30065720 con 0x7f3c30136a30 2023-08-17T17:34:49.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c34b6d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c30162110 con 0x7f3c300aaab0 2023-08-17T17:34:49.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c34b6d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c30161520 con 0x7f3c1c004690 2023-08-17T17:34:49.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c30136a30 0x7f3c30064d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c30136a30 0x7f3c30064d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34106/0 (socket says 172.21.15.78:34106) 2023-08-17T17:34:49.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2dd9b700 1 -- 172.21.15.78:0/1687861017 learned_addr learned my addr 172.21.15.78:0/1687861017 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:49.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2e59c700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c1c004690 0x7f3c30150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2ed9d700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c300aaab0 0x7f3c30065230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2dd9b700 1 -- 172.21.15.78:0/1687861017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c1c004690 msgr2=0x7f3c30150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2dd9b700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c1c004690 0x7f3c30150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2dd9b700 1 -- 172.21.15.78:0/1687861017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c300aaab0 msgr2=0x7f3c30065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2dd9b700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c300aaab0 0x7f3c30065230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2dd9b700 1 -- 172.21.15.78:0/1687861017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c301617e0 con 0x7f3c30136a30 2023-08-17T17:34:49.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.787+0000 7f3c2e59c700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c1c004690 0x7f3c30150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:49.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.788+0000 7f3c2dd9b700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c30136a30 0x7f3c30064d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f3c18009f50 tx=0x7f3c18019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:49.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.788+0000 7f3c267fc700 1 -- 172.21.15.78:0/1687861017 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800ed70 con 0x7f3c30136a30 2023-08-17T17:34:49.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.788+0000 7f3c267fc700 1 -- 172.21.15.78:0/1687861017 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800eed0 con 0x7f3c30136a30 2023-08-17T17:34:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.788+0000 7f3c267fc700 1 -- 172.21.15.78:0/1687861017 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1801c6b0 con 0x7f3c30136a30 2023-08-17T17:34:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.788+0000 7f3c34b6d700 1 -- 172.21.15.78:0/1687861017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c30161ac0 con 0x7f3c30136a30 2023-08-17T17:34:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.788+0000 7f3c34b6d700 1 -- 172.21.15.78:0/1687861017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c30150f60 con 0x7f3c30136a30 2023-08-17T17:34:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.789+0000 7f3c34b6d700 1 -- 172.21.15.78:0/1687861017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c30047350 con 0x7f3c30136a30 2023-08-17T17:34:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.789+0000 7f3c267fc700 1 -- 172.21.15.78:0/1687861017 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3c1801ca20 con 0x7f3c30136a30 2023-08-17T17:34:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.789+0000 7f3c267fc700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c1005ed90 0x7f3c10061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.789+0000 7f3c267fc700 1 -- 172.21.15.78:0/1687861017 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3c1807e3a0 con 0x7f3c30136a30 2023-08-17T17:34:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.789+0000 7f3c2e59c700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c1005ed90 0x7f3c10061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.790+0000 7f3c2e59c700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c1005ed90 0x7f3c10061250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f3c20007970 tx=0x7f3c2000b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.793+0000 7f3c267fc700 1 -- 172.21.15.78:0/1687861017 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c1804f980 con 0x7f3c30136a30 2023-08-17T17:34:49.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.956+0000 7f3c34b6d700 1 -- 172.21.15.78:0/1687861017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c300adae0 con 0x7f3c30136a30 2023-08-17T17:34:49.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.957+0000 7f3c267fc700 1 -- 172.21.15.78:0/1687861017 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f3c1801ccb0 con 0x7f3c30136a30 2023-08-17T17:34:49.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:49.959 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:49.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 -- 172.21.15.78:0/1687861017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c1005ed90 msgr2=0x7f3c10061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c1005ed90 0x7f3c10061250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f3c20007970 tx=0x7f3c2000b040).stop 2023-08-17T17:34:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 -- 172.21.15.78:0/1687861017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c30136a30 msgr2=0x7f3c30064d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c30136a30 0x7f3c30064d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f3c18009f50 tx=0x7f3c18019000).stop 2023-08-17T17:34:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 -- 172.21.15.78:0/1687861017 shutdown_connections 2023-08-17T17:34:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c1005ed90 0x7f3c10061250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c300aaab0 0x7f3c30065230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c1c004690 0x7f3c30150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 --2- 172.21.15.78:0/1687861017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c30136a30 0x7f3c30064d40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:49.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 -- 172.21.15.78:0/1687861017 >> 172.21.15.78:0/1687861017 conn(0x7f3c300c7b00 msgr2=0x7f3c301373b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:49.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 -- 172.21.15.78:0/1687861017 shutdown_connections 2023-08-17T17:34:49.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:49.959+0000 7f3c34b6d700 1 -- 172.21.15.78:0/1687861017 wait complete. 2023-08-17T17:34:49.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:34:21.874660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:34:22.501817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:34:49.973 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:34:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.086+0000 7f6e62c33700 1 Processor -- start 2023-08-17T17:34:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.086+0000 7f6e62c33700 1 -- start start 2023-08-17T17:34:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.087+0000 7f6e62c33700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6e5c0aa0f0 0x7f6e5c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.087+0000 7f6e62c33700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e5c0c5810 0x7f6e5c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.087+0000 7f6e62c33700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c0649b0 con 0x7f6e5c0aa4d0 2023-08-17T17:34:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.087+0000 7f6e62c33700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c0c6170 con 0x7f6e5c0c5810 2023-08-17T17:34:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.087+0000 7f6e62c33700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c063420 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.087+0000 7f6e611d0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e5c0c5810 0x7f6e5c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.087+0000 7f6e611d0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e5c0c5810 0x7f6e5c0c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34120/0 (socket says 172.21.15.78:34120) 2023-08-17T17:34:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.087+0000 7f6e611d0700 1 -- 172.21.15.78:0/3895355842 learned_addr learned my addr 172.21.15.78:0/3895355842 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e609cf700 1 --2- 172.21.15.78:0/3895355842 >> v2:172.21.15.150:3300/0 conn(0x7f6e5c0aa0f0 0x7f6e5c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e611d0700 1 -- 172.21.15.78:0/3895355842 >> v2:172.21.15.150:3300/0 conn(0x7f6e5c0aa0f0 msgr2=0x7f6e5c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e611d0700 1 --2- 172.21.15.78:0/3895355842 >> v2:172.21.15.150:3300/0 conn(0x7f6e5c0aa0f0 0x7f6e5c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e611d0700 1 -- 172.21.15.78:0/3895355842 >> v1:172.21.15.150:6789/0 conn(0x7f6e5c0aa4d0 legacy=0x7f6e5c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e611d0700 1 -- 172.21.15.78:0/3895355842 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c063700 con 0x7f6e5c0c5810 2023-08-17T17:34:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e611d0700 1 --2- 172.21.15.78:0/3895355842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c5810 0x7f6e5c0c5c80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f6e5c0cade0 tx=0x7f6e540090f0).ready entity=mon.0 client_cookie=7f1778bb3f92a34f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e5b7fe700 1 -- 172.21.15.78:0/3895355842 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400b5a0 con 0x7f6e5c0c5810 2023-08-17T17:34:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e5b7fe700 1 -- 172.21.15.78:0/3895355842 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5400b700 con 0x7f6e5c0c5810 2023-08-17T17:34:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e5b7fe700 1 -- 172.21.15.78:0/3895355842 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400ba80 con 0x7f6e5c0c5810 2023-08-17T17:34:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e62c33700 1 -- 172.21.15.78:0/3895355842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c5810 msgr2=0x7f6e5c0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.088+0000 7f6e62c33700 1 --2- 172.21.15.78:0/3895355842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c5810 0x7f6e5c0c5c80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f6e5c0cade0 tx=0x7f6e540090f0).stop 2023-08-17T17:34:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.089+0000 7f6e62c33700 1 -- 172.21.15.78:0/3895355842 shutdown_connections 2023-08-17T17:34:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.089+0000 7f6e62c33700 1 --2- 172.21.15.78:0/3895355842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c5810 0x7f6e5c0c5c80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.089+0000 7f6e62c33700 1 --2- 172.21.15.78:0/3895355842 >> v2:172.21.15.150:3300/0 conn(0x7f6e5c0aa0f0 0x7f6e5c0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.089+0000 7f6e62c33700 1 -- 172.21.15.78:0/3895355842 >> 172.21.15.78:0/3895355842 conn(0x7f6e5c06a6a0 msgr2=0x7f6e5c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.089+0000 7f6e62c33700 1 -- 172.21.15.78:0/3895355842 shutdown_connections 2023-08-17T17:34:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.089+0000 7f6e62c33700 1 -- 172.21.15.78:0/3895355842 wait complete. 2023-08-17T17:34:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.090+0000 7f6e62c33700 1 Processor -- start 2023-08-17T17:34:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.090+0000 7f6e62c33700 1 -- start start 2023-08-17T17:34:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e62c33700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0aa0f0 0x7f6e5c1687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e62c33700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e5c0aa4d0 0x7f6e5c0abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e62c33700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e5c0c5810 0x7f6e5c151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e62c33700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0acbe0 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e62c33700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0ac340 con 0x7f6e5c0c5810 2023-08-17T17:34:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e62c33700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0ac620 con 0x7f6e5c0aa4d0 2023-08-17T17:34:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e609cf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0aa0f0 0x7f6e5c1687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e609cf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0aa0f0 0x7f6e5c1687c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34122/0 (socket says 172.21.15.78:34122) 2023-08-17T17:34:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e609cf700 1 -- 172.21.15.78:0/1031308485 learned_addr learned my addr 172.21.15.78:0/1031308485 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e611d0700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e5c0c5810 0x7f6e5c151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e5bfff700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e5c0aa4d0 0x7f6e5c0abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e609cf700 1 -- 172.21.15.78:0/1031308485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e5c0aa4d0 msgr2=0x7f6e5c0abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e609cf700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e5c0aa4d0 0x7f6e5c0abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e609cf700 1 -- 172.21.15.78:0/1031308485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e5c0c5810 msgr2=0x7f6e5c151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e609cf700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e5c0c5810 0x7f6e5c151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e609cf700 1 -- 172.21.15.78:0/1031308485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54009370 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e609cf700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0aa0f0 0x7f6e5c1687c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f6e4c00e190 tx=0x7f6e4c009920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:50.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e58ff9700 1 -- 172.21.15.78:0/1031308485 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00ee30 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e58ff9700 1 -- 172.21.15.78:0/1031308485 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c014400 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e62c33700 1 -- 172.21.15.78:0/1031308485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c0ac900 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e58ff9700 1 -- 172.21.15.78:0/1031308485 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c014780 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.091+0000 7f6e62c33700 1 -- 172.21.15.78:0/1031308485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c0ac020 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.092+0000 7f6e62c33700 1 -- 172.21.15.78:0/1031308485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c0c3ba0 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.092+0000 7f6e58ff9700 1 -- 172.21.15.78:0/1031308485 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6e4c01b030 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.093+0000 7f6e58ff9700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e4805ed90 0x7f6e48061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.093+0000 7f6e58ff9700 1 -- 172.21.15.78:0/1031308485 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6e4c079f30 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.093+0000 7f6e5bfff700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e4805ed90 0x7f6e48061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.093+0000 7f6e5bfff700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e4805ed90 0x7f6e48061250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6e5c0c21a0 tx=0x7f6e50009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.097+0000 7f6e58ff9700 1 -- 172.21.15.78:0/1031308485 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6e4c04eea0 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.259+0000 7f6e62c33700 1 -- 172.21.15.78:0/1031308485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6e5c046af0 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.259+0000 7f6e58ff9700 1 -- 172.21.15.78:0/1031308485 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6e4c04ea90 con 0x7f6e5c0aa0f0 2023-08-17T17:34:50.261 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:34:50.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 -- 172.21.15.78:0/1031308485 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e4805ed90 msgr2=0x7f6e48061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e4805ed90 0x7f6e48061250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6e5c0c21a0 tx=0x7f6e50009040).stop 2023-08-17T17:34:50.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 -- 172.21.15.78:0/1031308485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0aa0f0 msgr2=0x7f6e5c1687c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0aa0f0 0x7f6e5c1687c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f6e4c00e190 tx=0x7f6e4c009920).stop 2023-08-17T17:34:50.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 -- 172.21.15.78:0/1031308485 shutdown_connections 2023-08-17T17:34:50.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e4805ed90 0x7f6e48061250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e5c0c5810 0x7f6e5c151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0aa0f0 0x7f6e5c1687c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 --2- 172.21.15.78:0/1031308485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e5c0aa4d0 0x7f6e5c0abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 -- 172.21.15.78:0/1031308485 >> 172.21.15.78:0/1031308485 conn(0x7f6e5c06a6a0 msgr2=0x7f6e5c0ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:50.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 -- 172.21.15.78:0/1031308485 shutdown_connections 2023-08-17T17:34:50.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.261+0000 7f6e62c33700 1 -- 172.21.15.78:0/1031308485 wait complete. 2023-08-17T17:34:50.275 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:34:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.389+0000 7f7b66dab700 1 Processor -- start 2023-08-17T17:34:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.389+0000 7f7b66dab700 1 -- start start 2023-08-17T17:34:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.390+0000 7f7b66dab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600aa0f0 0x7f7b600644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.390+0000 7f7b66dab700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7b600aa4d0 0x7f7b600c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.390+0000 7f7b66dab700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b600649b0 con 0x7f7b600c5810 2023-08-17T17:34:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.390+0000 7f7b66dab700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b60063420 con 0x7f7b600aa4d0 2023-08-17T17:34:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.390+0000 7f7b66dab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b60063700 con 0x7f7b600aa0f0 2023-08-17T17:34:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.390+0000 7f7b57fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7b600aa4d0 0x7f7b600c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.390+0000 7f7b64b47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600aa0f0 0x7f7b600644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b57fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7b600aa4d0 0x7f7b600c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:45248/0 (socket says 172.21.15.78:45248) 2023-08-17T17:34:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b57fff700 1 -- 172.21.15.78:0/2087582138 learned_addr learned my addr 172.21.15.78:0/2087582138 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b64b47700 1 -- 172.21.15.78:0/2087582138 >> v2:172.21.15.150:3300/0 conn(0x7f7b600aa4d0 msgr2=0x7f7b600c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b64b47700 1 --2- 172.21.15.78:0/2087582138 >> v2:172.21.15.150:3300/0 conn(0x7f7b600aa4d0 0x7f7b600c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b64b47700 1 -- 172.21.15.78:0/2087582138 >> v1:172.21.15.150:6789/0 conn(0x7f7b600c5810 legacy=0x7f7b600a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b64b47700 1 -- 172.21.15.78:0/2087582138 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600639e0 con 0x7f7b600aa0f0 2023-08-17T17:34:50.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b57fff700 1 --2- 172.21.15.78:0/2087582138 >> v2:172.21.15.150:3300/0 conn(0x7f7b600aa4d0 0x7f7b600c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:50.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b64b47700 1 --2- 172.21.15.78:0/2087582138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600aa0f0 0x7f7b600644c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7b5c009760 tx=0x7f7b5c009060).ready entity=mon.2 client_cookie=d34b00de7523850a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:50.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b577fe700 1 -- 172.21.15.78:0/2087582138 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00f510 con 0x7f7b600aa0f0 2023-08-17T17:34:50.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b577fe700 1 -- 172.21.15.78:0/2087582138 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c00f670 con 0x7f7b600aa0f0 2023-08-17T17:34:50.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.391+0000 7f7b577fe700 1 -- 172.21.15.78:0/2087582138 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00f9f0 con 0x7f7b600aa0f0 2023-08-17T17:34:50.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.392+0000 7f7b66dab700 1 -- 172.21.15.78:0/2087582138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600aa0f0 msgr2=0x7f7b600644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.392+0000 7f7b66dab700 1 --2- 172.21.15.78:0/2087582138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600aa0f0 0x7f7b600644c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7b5c009760 tx=0x7f7b5c009060).stop 2023-08-17T17:34:50.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.392+0000 7f7b66dab700 1 -- 172.21.15.78:0/2087582138 shutdown_connections 2023-08-17T17:34:50.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.392+0000 7f7b66dab700 1 --2- 172.21.15.78:0/2087582138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600aa0f0 0x7f7b600644c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.392+0000 7f7b66dab700 1 --2- 172.21.15.78:0/2087582138 >> v2:172.21.15.150:3300/0 conn(0x7f7b600aa4d0 0x7f7b600c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.392+0000 7f7b66dab700 1 -- 172.21.15.78:0/2087582138 >> 172.21.15.78:0/2087582138 conn(0x7f7b6006a6a0 msgr2=0x7f7b600caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:50.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.392+0000 7f7b66dab700 1 -- 172.21.15.78:0/2087582138 shutdown_connections 2023-08-17T17:34:50.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.392+0000 7f7b66dab700 1 -- 172.21.15.78:0/2087582138 wait complete. 2023-08-17T17:34:50.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.393+0000 7f7b66dab700 1 Processor -- start 2023-08-17T17:34:50.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.393+0000 7f7b66dab700 1 -- start start 2023-08-17T17:34:50.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b66dab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b600aa0f0 0x7f7b60151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b66dab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b600aa4d0 0x7f7b60164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b66dab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600c5810 0x7f7b600c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b66dab700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600c4a60 con 0x7f7b600aa4d0 2023-08-17T17:34:50.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b66dab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600ab430 con 0x7f7b600aa0f0 2023-08-17T17:34:50.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b66dab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600aab00 con 0x7f7b600c5810 2023-08-17T17:34:50.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b57fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b600aa4d0 0x7f7b60164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b57fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b600aa4d0 0x7f7b60164540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34136/0 (socket says 172.21.15.78:34136) 2023-08-17T17:34:50.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b57fff700 1 -- 172.21.15.78:0/3083857605 learned_addr learned my addr 172.21.15.78:0/3083857605 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:50.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b65348700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600c5810 0x7f7b600c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b64b47700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b600aa0f0 0x7f7b60151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b57fff700 1 -- 172.21.15.78:0/3083857605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600c5810 msgr2=0x7f7b600c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b57fff700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600c5810 0x7f7b600c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b57fff700 1 -- 172.21.15.78:0/3083857605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b600aa0f0 msgr2=0x7f7b60151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b57fff700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b600aa0f0 0x7f7b60151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b57fff700 1 -- 172.21.15.78:0/3083857605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b50009370 con 0x7f7b600aa4d0 2023-08-17T17:34:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b64b47700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b600aa0f0 0x7f7b60151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b57fff700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b600aa4d0 0x7f7b60164540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f7b5000ea20 tx=0x7f7b500090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b54ff9700 1 -- 172.21.15.78:0/3083857605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000c7f0 con 0x7f7b600aa4d0 2023-08-17T17:34:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b54ff9700 1 -- 172.21.15.78:0/3083857605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5000c950 con 0x7f7b600aa4d0 2023-08-17T17:34:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b66dab700 1 -- 172.21.15.78:0/3083857605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c0092a0 con 0x7f7b600aa4d0 2023-08-17T17:34:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b54ff9700 1 -- 172.21.15.78:0/3083857605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000ccd0 con 0x7f7b600aa4d0 2023-08-17T17:34:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.394+0000 7f7b66dab700 1 -- 172.21.15.78:0/3083857605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b600ab0c0 con 0x7f7b600aa4d0 2023-08-17T17:34:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.395+0000 7f7b66dab700 1 -- 172.21.15.78:0/3083857605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b600ab5a0 con 0x7f7b600aa4d0 2023-08-17T17:34:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.396+0000 7f7b54ff9700 1 -- 172.21.15.78:0/3083857605 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7b50022070 con 0x7f7b600aa4d0 2023-08-17T17:34:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.396+0000 7f7b54ff9700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7b4c05ed90 0x7f7b4c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.396+0000 7f7b54ff9700 1 -- 172.21.15.78:0/3083857605 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7b5007a010 con 0x7f7b600aa4d0 2023-08-17T17:34:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.396+0000 7f7b64b47700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7b4c05ed90 0x7f7b4c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.397+0000 7f7b64b47700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7b4c05ed90 0x7f7b4c061250 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7b5c009760 tx=0x7f7b5c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:50.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.400+0000 7f7b54ff9700 1 -- 172.21.15.78:0/3083857605 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b5004b5b0 con 0x7f7b600aa4d0 2023-08-17T17:34:50.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.562+0000 7f7b66dab700 1 -- 172.21.15.78:0/3083857605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7b60046af0 con 0x7f7b600aa4d0 2023-08-17T17:34:50.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.563+0000 7f7b54ff9700 1 -- 172.21.15.78:0/3083857605 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b5004ebd0 con 0x7f7b600aa4d0 2023-08-17T17:34:50.565 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:34:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 -- 172.21.15.78:0/3083857605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7b4c05ed90 msgr2=0x7f7b4c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7b4c05ed90 0x7f7b4c061250 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7b5c009760 tx=0x7f7b5c017000).stop 2023-08-17T17:34:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 -- 172.21.15.78:0/3083857605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b600aa4d0 msgr2=0x7f7b60164540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b600aa4d0 0x7f7b60164540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f7b5000ea20 tx=0x7f7b500090f0).stop 2023-08-17T17:34:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 -- 172.21.15.78:0/3083857605 shutdown_connections 2023-08-17T17:34:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7b4c05ed90 0x7f7b4c061250 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7b600c5810 0x7f7b600c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b600aa0f0 0x7f7b60151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 --2- 172.21.15.78:0/3083857605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b600aa4d0 0x7f7b60164540 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 -- 172.21.15.78:0/3083857605 >> 172.21.15.78:0/3083857605 conn(0x7f7b6006a6a0 msgr2=0x7f7b600a9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:50.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 -- 172.21.15.78:0/3083857605 shutdown_connections 2023-08-17T17:34:50.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.565+0000 7f7b66dab700 1 -- 172.21.15.78:0/3083857605 wait complete. 2023-08-17T17:34:50.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:34:50.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.691+0000 7ff8511b8700 1 Processor -- start 2023-08-17T17:34:50.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.691+0000 7ff8511b8700 1 -- start start 2023-08-17T17:34:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff8511b8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff84c0aa0f0 0x7ff84c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff8511b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff84c0aa4d0 0x7ff84c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff8511b8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c0649b0 con 0x7ff84c0c5810 2023-08-17T17:34:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff8511b8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c063420 con 0x7ff84c0aa0f0 2023-08-17T17:34:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff8511b8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c063700 con 0x7ff84c0aa4d0 2023-08-17T17:34:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff84ad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff84c0aa0f0 0x7ff84c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff84ad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff84c0aa0f0 0x7ff84c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34146/0 (socket says 172.21.15.78:34146) 2023-08-17T17:34:50.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff84ad9d700 1 -- 172.21.15.78:0/1439053924 learned_addr learned my addr 172.21.15.78:0/1439053924 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:50.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff84259c700 1 --2- 172.21.15.78:0/1439053924 >> v2:172.21.15.150:3300/0 conn(0x7ff84c0aa4d0 0x7ff84c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff84ad9d700 1 -- 172.21.15.78:0/1439053924 >> v2:172.21.15.150:3300/0 conn(0x7ff84c0aa4d0 msgr2=0x7ff84c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:50.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff84ad9d700 1 --2- 172.21.15.78:0/1439053924 >> v2:172.21.15.150:3300/0 conn(0x7ff84c0aa4d0 0x7ff84c0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff84ad9d700 1 -- 172.21.15.78:0/1439053924 >> v1:172.21.15.150:6789/0 conn(0x7ff84c0c5810 legacy=0x7ff84c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:50.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff84ad9d700 1 -- 172.21.15.78:0/1439053924 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0639e0 con 0x7ff84c0aa0f0 2023-08-17T17:34:50.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.692+0000 7ff84ad9d700 1 --2- 172.21.15.78:0/1439053924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0aa0f0 0x7ff84c0644c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7ff84c159060 tx=0x7ff83c0090f0).ready entity=mon.0 client_cookie=17ae8b4b29bc4045 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:50.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff84a59c700 1 -- 172.21.15.78:0/1439053924 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00b5a0 con 0x7ff84c0aa0f0 2023-08-17T17:34:50.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff84a59c700 1 -- 172.21.15.78:0/1439053924 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00b700 con 0x7ff84c0aa0f0 2023-08-17T17:34:50.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff84a59c700 1 -- 172.21.15.78:0/1439053924 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00ba80 con 0x7ff84c0aa0f0 2023-08-17T17:34:50.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff8511b8700 1 -- 172.21.15.78:0/1439053924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0aa0f0 msgr2=0x7ff84c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff8511b8700 1 --2- 172.21.15.78:0/1439053924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0aa0f0 0x7ff84c0644c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7ff84c159060 tx=0x7ff83c0090f0).stop 2023-08-17T17:34:50.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff8511b8700 1 -- 172.21.15.78:0/1439053924 shutdown_connections 2023-08-17T17:34:50.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff8511b8700 1 --2- 172.21.15.78:0/1439053924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0aa0f0 0x7ff84c0644c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff8511b8700 1 --2- 172.21.15.78:0/1439053924 >> v2:172.21.15.150:3300/0 conn(0x7ff84c0aa4d0 0x7ff84c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff8511b8700 1 -- 172.21.15.78:0/1439053924 >> 172.21.15.78:0/1439053924 conn(0x7ff84c06a6a0 msgr2=0x7ff84c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:50.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff8511b8700 1 -- 172.21.15.78:0/1439053924 shutdown_connections 2023-08-17T17:34:50.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.693+0000 7ff8511b8700 1 -- 172.21.15.78:0/1439053924 wait complete. 2023-08-17T17:34:50.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.694+0000 7ff8511b8700 1 Processor -- start 2023-08-17T17:34:50.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.694+0000 7ff8511b8700 1 -- start start 2023-08-17T17:34:50.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff8511b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff84c0aa0f0 0x7ff84c14c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff8511b8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff84c0aa4d0 0x7ff84c0aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff8511b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c5810 0x7ff84c0af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff8511b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0b05d0 con 0x7ff84c0c5810 2023-08-17T17:34:50.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff8511b8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c14b8d0 con 0x7ff84c0aa4d0 2023-08-17T17:34:50.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff8511b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c14c840 con 0x7ff84c0aa0f0 2023-08-17T17:34:50.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff84b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c5810 0x7ff84c0af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff84259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff84c0aa4d0 0x7ff84c0aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff84b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c5810 0x7ff84c0af340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34162/0 (socket says 172.21.15.78:34162) 2023-08-17T17:34:50.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff84ad9d700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff84c0aa0f0 0x7ff84c14c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.695+0000 7ff84b59e700 1 -- 172.21.15.78:0/1311703637 learned_addr learned my addr 172.21.15.78:0/1311703637 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:50.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff84b59e700 1 -- 172.21.15.78:0/1311703637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff84c0aa0f0 msgr2=0x7ff84c14c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff84b59e700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff84c0aa0f0 0x7ff84c14c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff84b59e700 1 -- 172.21.15.78:0/1311703637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff84c0aa4d0 msgr2=0x7ff84c0aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff84b59e700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff84c0aa4d0 0x7ff84c0aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff84b59e700 1 -- 172.21.15.78:0/1311703637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c009370 con 0x7ff84c0c5810 2023-08-17T17:34:50.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff84b59e700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c5810 0x7ff84c0af340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7ff84400b810 tx=0x7ff844009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:50.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff8437fe700 1 -- 172.21.15.78:0/1311703637 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400d4a0 con 0x7ff84c0c5810 2023-08-17T17:34:50.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff8437fe700 1 -- 172.21.15.78:0/1311703637 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84400d600 con 0x7ff84c0c5810 2023-08-17T17:34:50.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff8437fe700 1 -- 172.21.15.78:0/1311703637 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400d9c0 con 0x7ff84c0c5810 2023-08-17T17:34:50.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff8511b8700 1 -- 172.21.15.78:0/1311703637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c0af9c0 con 0x7ff84c0c5810 2023-08-17T17:34:50.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.696+0000 7ff8511b8700 1 -- 172.21.15.78:0/1311703637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c0aff80 con 0x7ff84c0c5810 2023-08-17T17:34:50.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.697+0000 7ff8511b8700 1 -- 172.21.15.78:0/1311703637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84c0b0740 con 0x7ff84c0c5810 2023-08-17T17:34:50.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.697+0000 7ff8437fe700 1 -- 172.21.15.78:0/1311703637 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff844018030 con 0x7ff84c0c5810 2023-08-17T17:34:50.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.698+0000 7ff8437fe700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff82c05ed90 0x7ff82c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:50.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.698+0000 7ff8437fe700 1 -- 172.21.15.78:0/1311703637 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff8440791c0 con 0x7ff84c0c5810 2023-08-17T17:34:50.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.698+0000 7ff84ad9d700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff82c05ed90 0x7ff82c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:50.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.698+0000 7ff84ad9d700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff82c05ed90 0x7ff82c061250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7ff83c006df0 tx=0x7ff83c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:50.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.702+0000 7ff8437fe700 1 -- 172.21.15.78:0/1311703637 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff8440478f0 con 0x7ff84c0c5810 2023-08-17T17:34:50.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.867+0000 7ff8511b8700 1 -- 172.21.15.78:0/1311703637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff84c158e40 con 0x7ff84c0c5810 2023-08-17T17:34:50.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.867+0000 7ff8437fe700 1 -- 172.21.15.78:0/1311703637 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff84404a810 con 0x7ff84c0c5810 2023-08-17T17:34:50.869 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:50.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.869+0000 7ff8511b8700 1 -- 172.21.15.78:0/1311703637 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff82c05ed90 msgr2=0x7ff82c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.869+0000 7ff8511b8700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff82c05ed90 0x7ff82c061250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7ff83c006df0 tx=0x7ff83c015000).stop 2023-08-17T17:34:50.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.869+0000 7ff8511b8700 1 -- 172.21.15.78:0/1311703637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c5810 msgr2=0x7ff84c0af340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.869+0000 7ff8511b8700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c5810 0x7ff84c0af340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7ff84400b810 tx=0x7ff844009290).stop 2023-08-17T17:34:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.869+0000 7ff8511b8700 1 -- 172.21.15.78:0/1311703637 shutdown_connections 2023-08-17T17:34:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.869+0000 7ff8511b8700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff82c05ed90 0x7ff82c061250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.869+0000 7ff8511b8700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c5810 0x7ff84c0af340 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.869+0000 7ff8511b8700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff84c0aa0f0 0x7ff84c14c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.869+0000 7ff8511b8700 1 --2- 172.21.15.78:0/1311703637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff84c0aa4d0 0x7ff84c0aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.869+0000 7ff8511b8700 1 -- 172.21.15.78:0/1311703637 >> 172.21.15.78:0/1311703637 conn(0x7ff84c06a6a0 msgr2=0x7ff84c153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:50.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.870+0000 7ff8511b8700 1 -- 172.21.15.78:0/1311703637 shutdown_connections 2023-08-17T17:34:50.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.870+0000 7ff8511b8700 1 -- 172.21.15.78:0/1311703637 wait complete. 2023-08-17T17:34:50.883 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:34:50.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.996+0000 7f4859347700 1 Processor -- start 2023-08-17T17:34:50.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.996+0000 7f4859347700 1 -- start start 2023-08-17T17:34:50.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f4859347700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540aa4d0 0x7f48540644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f4859347700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48540c5810 0x7f48540c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f4859347700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48540649b0 con 0x7f48540aa0f0 2023-08-17T17:34:51.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f4859347700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48540c6150 con 0x7f48540c5810 2023-08-17T17:34:51.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f4859347700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4854063420 con 0x7f48540aa4d0 2023-08-17T17:34:51.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f4852ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f48540aa0f0 0x7f48540c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33058/0 (socket says 172.21.15.78:33058) 2023-08-17T17:34:51.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f4852ffd700 1 -- 172.21.15.78:0/4016729954 learned_addr learned my addr 172.21.15.78:0/4016729954 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:51.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f484a7fc700 1 --2- 172.21.15.78:0/4016729954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540aa4d0 0x7f48540644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f48537fe700 1 --2- 172.21.15.78:0/4016729954 >> v2:172.21.15.150:3300/0 conn(0x7f48540c5810 0x7f48540c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f48527fc700 1 -- 172.21.15.78:0/4016729954 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325279703 0 0) 0x7f48540649b0 con 0x7f48540aa0f0 2023-08-17T17:34:51.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.997+0000 7f48527fc700 1 -- 172.21.15.78:0/4016729954 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48400033f0 con 0x7f48540aa0f0 2023-08-17T17:34:51.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f48527fc700 1 -- 172.21.15.78:0/4016729954 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2833362713 0 0) 0x7f48400033f0 con 0x7f48540aa0f0 2023-08-17T17:34:51.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f484a7fc700 1 -- 172.21.15.78:0/4016729954 >> v2:172.21.15.150:3300/0 conn(0x7f48540c5810 msgr2=0x7f48540c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:51.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f484a7fc700 1 --2- 172.21.15.78:0/4016729954 >> v2:172.21.15.150:3300/0 conn(0x7f48540c5810 0x7f48540c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f484a7fc700 1 -- 172.21.15.78:0/4016729954 >> v1:172.21.15.78:6789/0 conn(0x7f48540aa0f0 legacy=0x7f48540c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f484a7fc700 1 -- 172.21.15.78:0/4016729954 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854063700 con 0x7f48540aa4d0 2023-08-17T17:34:51.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f484a7fc700 1 --2- 172.21.15.78:0/4016729954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540aa4d0 0x7f48540644c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f483c009760 tx=0x7f483c009060).ready entity=mon.2 client_cookie=ccbc85ba26f03843 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f48527fc700 1 -- 172.21.15.78:0/4016729954 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844001470 con 0x7f48540aa4d0 2023-08-17T17:34:51.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f48527fc700 1 -- 172.21.15.78:0/4016729954 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c011400 con 0x7f48540aa4d0 2023-08-17T17:34:51.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f48527fc700 1 -- 172.21.15.78:0/4016729954 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c011780 con 0x7f48540aa4d0 2023-08-17T17:34:51.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f4859347700 1 -- 172.21.15.78:0/4016729954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540aa4d0 msgr2=0x7f48540644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f4859347700 1 --2- 172.21.15.78:0/4016729954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540aa4d0 0x7f48540644c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f483c009760 tx=0x7f483c009060).stop 2023-08-17T17:34:51.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f4859347700 1 -- 172.21.15.78:0/4016729954 shutdown_connections 2023-08-17T17:34:51.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f4859347700 1 --2- 172.21.15.78:0/4016729954 >> v2:172.21.15.150:3300/0 conn(0x7f48540c5810 0x7f48540c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f4859347700 1 --2- 172.21.15.78:0/4016729954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540aa4d0 0x7f48540644c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f4859347700 1 -- 172.21.15.78:0/4016729954 >> 172.21.15.78:0/4016729954 conn(0x7f485406a6a0 msgr2=0x7f48540caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f4859347700 1 -- 172.21.15.78:0/4016729954 shutdown_connections 2023-08-17T17:34:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:50.998+0000 7f4859347700 1 -- 172.21.15.78:0/4016729954 wait complete. 2023-08-17T17:34:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.000+0000 7f4859347700 1 Processor -- start 2023-08-17T17:34:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.000+0000 7f4859347700 1 -- start start 2023-08-17T17:34:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.000+0000 7f4859347700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48540aa0f0 0x7f48541504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.000+0000 7f4859347700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540aa4d0 0x7f48540a9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.000+0000 7f4859347700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540c5810 0x7f48540a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.000+0000 7f4859347700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4854150e70 con 0x7f48540aa0f0 2023-08-17T17:34:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.000+0000 7f4859347700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48540a9b00 con 0x7f48540aa4d0 2023-08-17T17:34:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.000+0000 7f4859347700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48540ae950 con 0x7f48540c5810 2023-08-17T17:34:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4852ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48540aa0f0 0x7f48541504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4852ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48540aa0f0 0x7f48541504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34168/0 (socket says 172.21.15.78:34168) 2023-08-17T17:34:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4852ffd700 1 -- 172.21.15.78:0/631186017 learned_addr learned my addr 172.21.15.78:0/631186017 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f48537fe700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540c5810 0x7f48540a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f484a7fc700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540aa4d0 0x7f48540a9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4852ffd700 1 -- 172.21.15.78:0/631186017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540c5810 msgr2=0x7f48540a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4852ffd700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540c5810 0x7f48540a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4852ffd700 1 -- 172.21.15.78:0/631186017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540aa4d0 msgr2=0x7f48540a9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4852ffd700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540aa4d0 0x7f48540a9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4852ffd700 1 -- 172.21.15.78:0/631186017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c0092a0 con 0x7f48540aa0f0 2023-08-17T17:34:51.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f48537fe700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540c5810 0x7f48540a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:51.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4852ffd700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48540aa0f0 0x7f48541504b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f484400c840 tx=0x7f4844001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f484b7fe700 1 -- 172.21.15.78:0/631186017 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844007170 con 0x7f48540aa0f0 2023-08-17T17:34:51.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f484b7fe700 1 -- 172.21.15.78:0/631186017 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48440072d0 con 0x7f48540aa0f0 2023-08-17T17:34:51.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4859347700 1 -- 172.21.15.78:0/631186017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48540ae020 con 0x7f48540aa0f0 2023-08-17T17:34:51.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f484b7fe700 1 -- 172.21.15.78:0/631186017 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440048c0 con 0x7f48540aa0f0 2023-08-17T17:34:51.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.001+0000 7f4859347700 1 -- 172.21.15.78:0/631186017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48540ae5e0 con 0x7f48540aa0f0 2023-08-17T17:34:51.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.002+0000 7f4859347700 1 -- 172.21.15.78:0/631186017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4854083980 con 0x7f48540aa0f0 2023-08-17T17:34:51.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.002+0000 7f484b7fe700 1 -- 172.21.15.78:0/631186017 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4844010070 con 0x7f48540aa0f0 2023-08-17T17:34:51.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.003+0000 7f484b7fe700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f483405ed90 0x7f4834061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.003+0000 7f484b7fe700 1 -- 172.21.15.78:0/631186017 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4844079600 con 0x7f48540aa0f0 2023-08-17T17:34:51.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.003+0000 7f484a7fc700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f483405ed90 0x7f4834061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.003+0000 7f484a7fc700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f483405ed90 0x7f4834061250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f48540c51f0 tx=0x7f483c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.007+0000 7f484b7fe700 1 -- 172.21.15.78:0/631186017 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f484404ab40 con 0x7f48540aa0f0 2023-08-17T17:34:51.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.171+0000 7f4859347700 1 -- 172.21.15.78:0/631186017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4854046af0 con 0x7f48540aa0f0 2023-08-17T17:34:51.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.171+0000 7f484b7fe700 1 -- 172.21.15.78:0/631186017 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f484404e160 con 0x7f48540aa0f0 2023-08-17T17:34:51.173 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.173+0000 7f4859347700 1 -- 172.21.15.78:0/631186017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f483405ed90 msgr2=0x7f4834061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.173+0000 7f4859347700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f483405ed90 0x7f4834061250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f48540c51f0 tx=0x7f483c016000).stop 2023-08-17T17:34:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.173+0000 7f4859347700 1 -- 172.21.15.78:0/631186017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48540aa0f0 msgr2=0x7f48541504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.173+0000 7f4859347700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48540aa0f0 0x7f48541504b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f484400c840 tx=0x7f4844001aa0).stop 2023-08-17T17:34:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.173+0000 7f4859347700 1 -- 172.21.15.78:0/631186017 shutdown_connections 2023-08-17T17:34:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.173+0000 7f4859347700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f483405ed90 0x7f4834061250 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.173+0000 7f4859347700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48540c5810 0x7f48540a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.173+0000 7f4859347700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48540aa0f0 0x7f48541504b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.173+0000 7f4859347700 1 --2- 172.21.15.78:0/631186017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48540aa4d0 0x7f48540a9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.173+0000 7f4859347700 1 -- 172.21.15.78:0/631186017 >> 172.21.15.78:0/631186017 conn(0x7f485406a6a0 msgr2=0x7f485405e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.174+0000 7f4859347700 1 -- 172.21.15.78:0/631186017 shutdown_connections 2023-08-17T17:34:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.174+0000 7f4859347700 1 -- 172.21.15.78:0/631186017 wait complete. 2023-08-17T17:34:51.187 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:51.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.299+0000 7fc15cad0700 1 Processor -- start 2023-08-17T17:34:51.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.299+0000 7fc15cad0700 1 -- start start 2023-08-17T17:34:51.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc15cad0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580a7fe0 0x7fc158064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc15cad0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc1580bef00 0x7fc1580c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc15cad0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1580c4040 con 0x7fc158065140 2023-08-17T17:34:51.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc15cad0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1580c7080 con 0x7fc1580bef00 2023-08-17T17:34:51.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc15cad0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580c3430 con 0x7fc1580a7fe0 2023-08-17T17:34:51.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc156d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc1580bef00 0x7fc1580c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc15659c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580a7fe0 0x7fc158064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc15659c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580a7fe0 0x7fc158064180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:51604/0 (socket says 172.21.15.78:51604) 2023-08-17T17:34:51.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc15659c700 1 -- 172.21.15.78:0/3680668734 learned_addr learned my addr 172.21.15.78:0/3680668734 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:51.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc156d9d700 1 --2- 172.21.15.78:0/3680668734 >> v2:172.21.15.150:3300/0 conn(0x7fc1580bef00 0x7fc1580c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:45310/0 (socket says 172.21.15.78:45310) 2023-08-17T17:34:51.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.300+0000 7fc14dd9b700 1 --1- 172.21.15.78:0/3680668734 >> v1:172.21.15.150:6789/0 conn(0x7fc158065140 0x7fc1580be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:50470/0 (socket says 172.21.15.78:50470) 2023-08-17T17:34:51.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.301+0000 7fc15659c700 1 -- 172.21.15.78:0/3680668734 >> v2:172.21.15.150:3300/0 conn(0x7fc1580bef00 msgr2=0x7fc1580c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:51.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.301+0000 7fc15659c700 1 --2- 172.21.15.78:0/3680668734 >> v2:172.21.15.150:3300/0 conn(0x7fc1580bef00 0x7fc1580c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.301+0000 7fc15659c700 1 -- 172.21.15.78:0/3680668734 >> v1:172.21.15.150:6789/0 conn(0x7fc158065140 legacy=0x7fc1580be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.301+0000 7fc15659c700 1 -- 172.21.15.78:0/3680668734 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1580c3710 con 0x7fc1580a7fe0 2023-08-17T17:34:51.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.301+0000 7fc156d9d700 1 --2- 172.21.15.78:0/3680668734 >> v2:172.21.15.150:3300/0 conn(0x7fc1580bef00 0x7fc1580c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:51.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.301+0000 7fc15659c700 1 --2- 172.21.15.78:0/3680668734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580a7fe0 0x7fc158064180 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc148006fd0 tx=0x7fc1480090f0).ready entity=mon.2 client_cookie=b39c9f6510d9879f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.301+0000 7fc155d9b700 1 -- 172.21.15.78:0/3680668734 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14800b580 con 0x7fc1580a7fe0 2023-08-17T17:34:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.301+0000 7fc155d9b700 1 -- 172.21.15.78:0/3680668734 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14800b6e0 con 0x7fc1580a7fe0 2023-08-17T17:34:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.301+0000 7fc155d9b700 1 -- 172.21.15.78:0/3680668734 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14800ba60 con 0x7fc1580a7fe0 2023-08-17T17:34:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.302+0000 7fc15cad0700 1 -- 172.21.15.78:0/3680668734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580a7fe0 msgr2=0x7fc158064180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.302+0000 7fc15cad0700 1 --2- 172.21.15.78:0/3680668734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580a7fe0 0x7fc158064180 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc148006fd0 tx=0x7fc1480090f0).stop 2023-08-17T17:34:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.302+0000 7fc15cad0700 1 -- 172.21.15.78:0/3680668734 shutdown_connections 2023-08-17T17:34:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.302+0000 7fc15cad0700 1 --2- 172.21.15.78:0/3680668734 >> v2:172.21.15.150:3300/0 conn(0x7fc1580bef00 0x7fc1580c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.302+0000 7fc15cad0700 1 --2- 172.21.15.78:0/3680668734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580a7fe0 0x7fc158064180 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.302+0000 7fc15cad0700 1 -- 172.21.15.78:0/3680668734 >> 172.21.15.78:0/3680668734 conn(0x7fc158092330 msgr2=0x7fc158062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:51.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.302+0000 7fc15cad0700 1 -- 172.21.15.78:0/3680668734 shutdown_connections 2023-08-17T17:34:51.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.302+0000 7fc15cad0700 1 -- 172.21.15.78:0/3680668734 wait complete. 2023-08-17T17:34:51.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.303+0000 7fc15cad0700 1 Processor -- start 2023-08-17T17:34:51.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.303+0000 7fc15cad0700 1 -- start start 2023-08-17T17:34:51.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc15cad0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc158065140 0x7fc158152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc15cad0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1580a7fe0 0x7fc1580aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc15cad0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580bef00 0x7fc1580aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc15cad0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580ad6c0 con 0x7fc1580a7fe0 2023-08-17T17:34:51.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc15cad0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158154a70 con 0x7fc158065140 2023-08-17T17:34:51.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc15cad0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580acb40 con 0x7fc1580bef00 2023-08-17T17:34:51.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1580a7fe0 0x7fc1580aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1580a7fe0 0x7fc1580aa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34170/0 (socket says 172.21.15.78:34170) 2023-08-17T17:34:51.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14dd9b700 1 -- 172.21.15.78:0/1293670933 learned_addr learned my addr 172.21.15.78:0/1293670933 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:51.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc15659c700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc158065140 0x7fc158152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc156d9d700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580bef00 0x7fc1580aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14dd9b700 1 -- 172.21.15.78:0/1293670933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580bef00 msgr2=0x7fc1580aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14dd9b700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580bef00 0x7fc1580aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14dd9b700 1 -- 172.21.15.78:0/1293670933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc158065140 msgr2=0x7fc158152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14dd9b700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc158065140 0x7fc158152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14dd9b700 1 -- 172.21.15.78:0/1293670933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc150009a20 con 0x7fc1580a7fe0 2023-08-17T17:34:51.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc156d9d700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580bef00 0x7fc1580aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:51.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14dd9b700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1580a7fe0 0x7fc1580aa4f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fc14000c440 tx=0x7fc140007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14effd700 1 -- 172.21.15.78:0/1293670933 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14000ce60 con 0x7fc1580a7fe0 2023-08-17T17:34:51.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14effd700 1 -- 172.21.15.78:0/1293670933 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1400072e0 con 0x7fc1580a7fe0 2023-08-17T17:34:51.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc15cad0700 1 -- 172.21.15.78:0/1293670933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc148009370 con 0x7fc1580a7fe0 2023-08-17T17:34:51.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.304+0000 7fc14effd700 1 -- 172.21.15.78:0/1293670933 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400056e0 con 0x7fc1580a7fe0 2023-08-17T17:34:51.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.305+0000 7fc15cad0700 1 -- 172.21.15.78:0/1293670933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1580ad100 con 0x7fc1580a7fe0 2023-08-17T17:34:51.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.305+0000 7fc15cad0700 1 -- 172.21.15.78:0/1293670933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc158154840 con 0x7fc1580a7fe0 2023-08-17T17:34:51.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.306+0000 7fc14effd700 1 -- 172.21.15.78:0/1293670933 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc14001a060 con 0x7fc1580a7fe0 2023-08-17T17:34:51.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.306+0000 7fc14effd700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc13805ed90 0x7fc138061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.306+0000 7fc14effd700 1 -- 172.21.15.78:0/1293670933 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc140079160 con 0x7fc1580a7fe0 2023-08-17T17:34:51.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.306+0000 7fc15659c700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc13805ed90 0x7fc138061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.306+0000 7fc15659c700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc13805ed90 0x7fc138061250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc148009130 tx=0x7fc148017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.310+0000 7fc14effd700 1 -- 172.21.15.78:0/1293670933 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc158154840 con 0x7fc1580a7fe0 2023-08-17T17:34:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.476+0000 7fc15cad0700 1 -- 172.21.15.78:0/1293670933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc158047350 con 0x7fc1580a7fe0 2023-08-17T17:34:51.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.477+0000 7fc14effd700 1 -- 172.21.15.78:0/1293670933 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fc140018070 con 0x7fc1580a7fe0 2023-08-17T17:34:51.479 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:51.479 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:51.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.478+0000 7fc15cad0700 1 -- 172.21.15.78:0/1293670933 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc13805ed90 msgr2=0x7fc138061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.478+0000 7fc15cad0700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc13805ed90 0x7fc138061250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc148009130 tx=0x7fc148017000).stop 2023-08-17T17:34:51.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.478+0000 7fc15cad0700 1 -- 172.21.15.78:0/1293670933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1580a7fe0 msgr2=0x7fc1580aa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.478+0000 7fc15cad0700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1580a7fe0 0x7fc1580aa4f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fc14000c440 tx=0x7fc140007d80).stop 2023-08-17T17:34:51.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.478+0000 7fc15cad0700 1 -- 172.21.15.78:0/1293670933 shutdown_connections 2023-08-17T17:34:51.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.478+0000 7fc15cad0700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc13805ed90 0x7fc138061250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.478+0000 7fc15cad0700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1580bef00 0x7fc1580aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.478+0000 7fc15cad0700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc158065140 0x7fc158152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.478+0000 7fc15cad0700 1 --2- 172.21.15.78:0/1293670933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1580a7fe0 0x7fc1580aa4f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.478+0000 7fc15cad0700 1 -- 172.21.15.78:0/1293670933 >> 172.21.15.78:0/1293670933 conn(0x7fc158092330 msgr2=0x7fc1580c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:51.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.479+0000 7fc15cad0700 1 -- 172.21.15.78:0/1293670933 shutdown_connections 2023-08-17T17:34:51.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.479+0000 7fc15cad0700 1 -- 172.21.15.78:0/1293670933 wait complete. 2023-08-17T17:34:51.492 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:34:21.874660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:34:22.501817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:34:51.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:34:51.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.606+0000 7febe89b3700 1 Processor -- start 2023-08-17T17:34:51.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.606+0000 7febe89b3700 1 -- start start 2023-08-17T17:34:51.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.607+0000 7febe89b3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413b890 0x7febe4155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.607+0000 7febe89b3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7febe41568d0 0x7febe40bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.607+0000 7febe89b3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40a5a20 con 0x7febe413bc70 2023-08-17T17:34:51.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.607+0000 7febe89b3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe40c32d0 con 0x7febe41568d0 2023-08-17T17:34:51.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.607+0000 7febe89b3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40c3570 con 0x7febe413b890 2023-08-17T17:34:51.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.608+0000 7febe259c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413b890 0x7febe4155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.608+0000 7febe259c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413b890 0x7febe4155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:51634/0 (socket says 172.21.15.78:51634) 2023-08-17T17:34:51.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.608+0000 7febe2d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7febe41568d0 0x7febe40bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.608+0000 7febe259c700 1 -- 172.21.15.78:0/323108981 learned_addr learned my addr 172.21.15.78:0/323108981 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.608+0000 7febe259c700 1 -- 172.21.15.78:0/323108981 >> v2:172.21.15.150:3300/0 conn(0x7febe41568d0 msgr2=0x7febe40bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.608+0000 7febe259c700 1 --2- 172.21.15.78:0/323108981 >> v2:172.21.15.150:3300/0 conn(0x7febe41568d0 0x7febe40bdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.608+0000 7febe259c700 1 -- 172.21.15.78:0/323108981 >> v1:172.21.15.150:6789/0 conn(0x7febe413bc70 legacy=0x7febe41561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.608+0000 7febe259c700 1 -- 172.21.15.78:0/323108981 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40bfad0 con 0x7febe413b890 2023-08-17T17:34:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.608+0000 7febe259c700 1 --2- 172.21.15.78:0/323108981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413b890 0x7febe4155cd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7febe40c3410 tx=0x7febd40090f0).ready entity=mon.2 client_cookie=fe0f92366855fdfe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.608+0000 7febe1d9b700 1 -- 172.21.15.78:0/323108981 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400b520 con 0x7febe413b890 2023-08-17T17:34:51.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.609+0000 7febe1d9b700 1 -- 172.21.15.78:0/323108981 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd400b680 con 0x7febe413b890 2023-08-17T17:34:51.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.609+0000 7febe1d9b700 1 -- 172.21.15.78:0/323108981 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400ba00 con 0x7febe413b890 2023-08-17T17:34:51.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.609+0000 7febe89b3700 1 -- 172.21.15.78:0/323108981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413b890 msgr2=0x7febe4155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.609+0000 7febe89b3700 1 --2- 172.21.15.78:0/323108981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413b890 0x7febe4155cd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7febe40c3410 tx=0x7febd40090f0).stop 2023-08-17T17:34:51.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.609+0000 7febe89b3700 1 -- 172.21.15.78:0/323108981 shutdown_connections 2023-08-17T17:34:51.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.609+0000 7febe89b3700 1 --2- 172.21.15.78:0/323108981 >> v2:172.21.15.150:3300/0 conn(0x7febe41568d0 0x7febe40bdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.609+0000 7febe89b3700 1 --2- 172.21.15.78:0/323108981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413b890 0x7febe4155cd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.609+0000 7febe89b3700 1 -- 172.21.15.78:0/323108981 >> 172.21.15.78:0/323108981 conn(0x7febe4062f80 msgr2=0x7febe40c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:51.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.609+0000 7febe89b3700 1 -- 172.21.15.78:0/323108981 shutdown_connections 2023-08-17T17:34:51.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.609+0000 7febe89b3700 1 -- 172.21.15.78:0/323108981 wait complete. 2023-08-17T17:34:51.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.610+0000 7febe89b3700 1 Processor -- start 2023-08-17T17:34:51.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.610+0000 7febe89b3700 1 -- start start 2023-08-17T17:34:51.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febe89b3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febe413b890 0x7febe40a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febe89b3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413bc70 0x7febe40ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febe89b3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe41568d0 0x7febe4064ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febe89b3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4168d30 con 0x7febe41568d0 2023-08-17T17:34:51.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febe89b3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe41681b0 con 0x7febe413b890 2023-08-17T17:34:51.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febe89b3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe4168490 con 0x7febe413bc70 2023-08-17T17:34:51.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febe2d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe41568d0 0x7febe4064ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febe2d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe41568d0 0x7febe4064ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34180/0 (socket says 172.21.15.78:34180) 2023-08-17T17:34:51.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febe2d9d700 1 -- 172.21.15.78:0/389560473 learned_addr learned my addr 172.21.15.78:0/389560473 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:51.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febd9d9b700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413bc70 0x7febe40ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.611+0000 7febe259c700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febe413b890 0x7febe40a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febe2d9d700 1 -- 172.21.15.78:0/389560473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413bc70 msgr2=0x7febe40ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febe2d9d700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413bc70 0x7febe40ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febe2d9d700 1 -- 172.21.15.78:0/389560473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febe413b890 msgr2=0x7febe40a9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febe2d9d700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febe413b890 0x7febe40a9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febe2d9d700 1 -- 172.21.15.78:0/389560473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009370 con 0x7febe41568d0 2023-08-17T17:34:51.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febe2d9d700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe41568d0 0x7febe4064ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7febdc009d10 tx=0x7febdc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febdaffd700 1 -- 172.21.15.78:0/389560473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc009e70 con 0x7febe41568d0 2023-08-17T17:34:51.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febdaffd700 1 -- 172.21.15.78:0/389560473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc00f040 con 0x7febe41568d0 2023-08-17T17:34:51.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febdaffd700 1 -- 172.21.15.78:0/389560473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc00ccb0 con 0x7febe41568d0 2023-08-17T17:34:51.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febe89b3700 1 -- 172.21.15.78:0/389560473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe4168770 con 0x7febe41568d0 2023-08-17T17:34:51.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.612+0000 7febe89b3700 1 -- 172.21.15.78:0/389560473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe40a9960 con 0x7febe41568d0 2023-08-17T17:34:51.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.613+0000 7febe89b3700 1 -- 172.21.15.78:0/389560473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe40695e0 con 0x7febe41568d0 2023-08-17T17:34:51.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.613+0000 7febdaffd700 1 -- 172.21.15.78:0/389560473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7febdc013610 con 0x7febe41568d0 2023-08-17T17:34:51.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.613+0000 7febdaffd700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7febc405ed90 0x7febc4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.613+0000 7febdaffd700 1 -- 172.21.15.78:0/389560473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7febdc07a300 con 0x7febe41568d0 2023-08-17T17:34:51.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.613+0000 7febe259c700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7febc405ed90 0x7febc4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.614+0000 7febe259c700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7febc405ed90 0x7febc4061250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7febd4009130 tx=0x7febd4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.617+0000 7febdaffd700 1 -- 172.21.15.78:0/389560473 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7febdc04b8a0 con 0x7febe41568d0 2023-08-17T17:34:51.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.778+0000 7febe89b3700 1 -- 172.21.15.78:0/389560473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7febe4065cd0 con 0x7febe41568d0 2023-08-17T17:34:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.779+0000 7febdaffd700 1 -- 172.21.15.78:0/389560473 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7febdc04eec0 con 0x7febe41568d0 2023-08-17T17:34:51.781 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:34:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 -- 172.21.15.78:0/389560473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7febc405ed90 msgr2=0x7febc4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7febc405ed90 0x7febc4061250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7febd4009130 tx=0x7febd4017000).stop 2023-08-17T17:34:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 -- 172.21.15.78:0/389560473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe41568d0 msgr2=0x7febe4064ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe41568d0 0x7febe4064ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7febdc009d10 tx=0x7febdc00b040).stop 2023-08-17T17:34:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 -- 172.21.15.78:0/389560473 shutdown_connections 2023-08-17T17:34:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7febc405ed90 0x7febc4061250 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe41568d0 0x7febe4064ce0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febe413b890 0x7febe40a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 --2- 172.21.15.78:0/389560473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febe413bc70 0x7febe40ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 -- 172.21.15.78:0/389560473 >> 172.21.15.78:0/389560473 conn(0x7febe4062f80 msgr2=0x7febe40a6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:51.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 -- 172.21.15.78:0/389560473 shutdown_connections 2023-08-17T17:34:51.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.781+0000 7febe89b3700 1 -- 172.21.15.78:0/389560473 wait complete. 2023-08-17T17:34:51.794 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:34:51.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.908+0000 7fb417fff700 1 Processor -- start 2023-08-17T17:34:51.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.908+0000 7fb417fff700 1 -- start start 2023-08-17T17:34:51.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb417fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb418151e20 0x7fb4180c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb417fff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180c6620 con 0x7fb418151a40 2023-08-17T17:34:51.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb417fff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180c6900 con 0x7fb418157be0 2023-08-17T17:34:51.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb417fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4180c6be0 con 0x7fb418151e20 2023-08-17T17:34:51.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb416ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb418151a40 0x7fb4180c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33070/0 (socket says 172.21.15.78:33070) 2023-08-17T17:34:51.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb416ffd700 1 -- 172.21.15.78:0/1038274334 learned_addr learned my addr 172.21.15.78:0/1038274334 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:51.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272560505 0 0) 0x7fb4180c6620 con 0x7fb418151a40 2023-08-17T17:34:51.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4040033f0 con 0x7fb418151a40 2023-08-17T17:34:51.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb40e7fc700 1 --2- 172.21.15.78:0/1038274334 >> v2:172.21.15.150:3300/0 conn(0x7fb418151e20 0x7fb4180c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 331684660 0 0) 0x7fb4040033f0 con 0x7fb418151a40 2023-08-17T17:34:51.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.909+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 >> v2:172.21.15.150:3300/0 conn(0x7fb418151e20 msgr2=0x7fb4180c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:51.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 --2- 172.21.15.78:0/1038274334 >> v2:172.21.15.150:3300/0 conn(0x7fb418151e20 0x7fb4180c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 >> v1:172.21.15.150:6789/0 conn(0x7fb418157be0 legacy=0x7fb4180c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180c6ec0 con 0x7fb418151a40 2023-08-17T17:34:51.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fb4080015f0 con 0x7fb418151a40 2023-08-17T17:34:51.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 >> v1:172.21.15.78:6789/0 conn(0x7fb418151a40 legacy=0x7fb4180c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4040038e0 0x7fb404003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb404004690 0x7fb404004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb404005000 0x7fb40400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180c6be0 con 0x7fb404005000 2023-08-17T17:34:51.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40400beb0 con 0x7fb404004690 2023-08-17T17:34:51.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40400c070 con 0x7fb4040038e0 2023-08-17T17:34:51.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4177fe700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb404005000 0x7fb40400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb416ffd700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4040038e0 0x7fb404003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb40e7fc700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb404004690 0x7fb404004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4177fe700 1 -- 172.21.15.78:0/1038274334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4040038e0 msgr2=0x7fb404003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:51.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4177fe700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4040038e0 0x7fb404003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4177fe700 1 -- 172.21.15.78:0/1038274334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb404004690 msgr2=0x7fb404004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:51.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4177fe700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb404004690 0x7fb404004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4177fe700 1 -- 172.21.15.78:0/1038274334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040033f0 con 0x7fb404005000 2023-08-17T17:34:51.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4177fe700 1 -- 172.21.15.78:0/1038274334 reap_dead start 2023-08-17T17:34:51.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4177fe700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb404005000 0x7fb40400b8e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fb410001e30 tx=0x7fb410007f30).ready entity=mon.0 client_cookie=dda83a53287d0a7e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410006a20 con 0x7fb404005000 2023-08-17T17:34:51.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb410006b80 con 0x7fb404005000 2023-08-17T17:34:51.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.910+0000 7fb4167fc700 1 -- 172.21.15.78:0/1038274334 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41000c5d0 con 0x7fb404005000 2023-08-17T17:34:51.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.911+0000 7fb417fff700 1 -- 172.21.15.78:0/1038274334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb404005000 msgr2=0x7fb40400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.911+0000 7fb417fff700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb404005000 0x7fb40400b8e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fb410001e30 tx=0x7fb410007f30).stop 2023-08-17T17:34:51.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.911+0000 7fb417fff700 1 -- 172.21.15.78:0/1038274334 shutdown_connections 2023-08-17T17:34:51.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.911+0000 7fb417fff700 1 --2- 172.21.15.78:0/1038274334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb404005000 0x7fb40400b8e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.911+0000 7fb417fff700 1 -- 172.21.15.78:0/1038274334 >> 172.21.15.78:0/1038274334 conn(0x7fb4180943b0 msgr2=0x7fb41806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:51.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.911+0000 7fb417fff700 1 -- 172.21.15.78:0/1038274334 shutdown_connections 2023-08-17T17:34:51.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.911+0000 7fb417fff700 1 -- 172.21.15.78:0/1038274334 wait complete. 2023-08-17T17:34:51.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.912+0000 7fb417fff700 1 Processor -- start 2023-08-17T17:34:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.912+0000 7fb417fff700 1 -- start start 2023-08-17T17:34:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb417fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb404005000 0x7fb41814a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb417fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb418157ff0 0x7fb418158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb417fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4180c3580 0x7fb4180c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb417fff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180adc90 con 0x7fb418157ff0 2023-08-17T17:34:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb417fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb418158960 con 0x7fb4180c3580 2023-08-17T17:34:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb417fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180c42b0 con 0x7fb404005000 2023-08-17T17:34:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb40e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb418157ff0 0x7fb418158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb40e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb418157ff0 0x7fb418158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34208/0 (socket says 172.21.15.78:34208) 2023-08-17T17:34:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb40e7fc700 1 -- 172.21.15.78:0/194194876 learned_addr learned my addr 172.21.15.78:0/194194876 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb4177fe700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4180c3580 0x7fb4180c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb416ffd700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb404005000 0x7fb41814a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb40e7fc700 1 -- 172.21.15.78:0/194194876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb404005000 msgr2=0x7fb41814a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb40e7fc700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb404005000 0x7fb41814a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb40e7fc700 1 -- 172.21.15.78:0/194194876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4180c3580 msgr2=0x7fb4180c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb40e7fc700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4180c3580 0x7fb4180c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb40e7fc700 1 -- 172.21.15.78:0/194194876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180c4590 con 0x7fb418157ff0 2023-08-17T17:34:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb4177fe700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4180c3580 0x7fb4180c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.913+0000 7fb40e7fc700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb418157ff0 0x7fb418158470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb4000119f0 tx=0x7fb400006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.914+0000 7fb40f7fe700 1 -- 172.21.15.78:0/194194876 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400005a90 con 0x7fb418157ff0 2023-08-17T17:34:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.914+0000 7fb40f7fe700 1 -- 172.21.15.78:0/194194876 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400005bf0 con 0x7fb418157ff0 2023-08-17T17:34:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.914+0000 7fb417fff700 1 -- 172.21.15.78:0/194194876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4180c4870 con 0x7fb418157ff0 2023-08-17T17:34:51.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.914+0000 7fb40f7fe700 1 -- 172.21.15.78:0/194194876 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40000f730 con 0x7fb418157ff0 2023-08-17T17:34:51.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.914+0000 7fb417fff700 1 -- 172.21.15.78:0/194194876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41814acb0 con 0x7fb418157ff0 2023-08-17T17:34:51.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.914+0000 7fb417fff700 1 -- 172.21.15.78:0/194194876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4180adf70 con 0x7fb418157ff0 2023-08-17T17:34:51.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.915+0000 7fb40f7fe700 1 -- 172.21.15.78:0/194194876 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb400024070 con 0x7fb418157ff0 2023-08-17T17:34:51.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.915+0000 7fb40f7fe700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3f805ed90 0x7fb3f8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:51.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.915+0000 7fb40f7fe700 1 -- 172.21.15.78:0/194194876 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb40007a570 con 0x7fb418157ff0 2023-08-17T17:34:51.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.915+0000 7fb416ffd700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3f805ed90 0x7fb3f8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.916+0000 7fb416ffd700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3f805ed90 0x7fb3f8061250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb408001720 tx=0x7fb408009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:51.919+0000 7fb40f7fe700 1 -- 172.21.15.78:0/194194876 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb40004ba00 con 0x7fb418157ff0 2023-08-17T17:34:52.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.081+0000 7fb417fff700 1 -- 172.21.15.78:0/194194876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb418082f90 con 0x7fb418157ff0 2023-08-17T17:34:52.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.081+0000 7fb40f7fe700 1 -- 172.21.15.78:0/194194876 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb400018020 con 0x7fb418157ff0 2023-08-17T17:34:52.083 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:34:52.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 -- 172.21.15.78:0/194194876 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3f805ed90 msgr2=0x7fb3f8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3f805ed90 0x7fb3f8061250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb408001720 tx=0x7fb408009040).stop 2023-08-17T17:34:52.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 -- 172.21.15.78:0/194194876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb418157ff0 msgr2=0x7fb418158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb418157ff0 0x7fb418158470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb4000119f0 tx=0x7fb400006f40).stop 2023-08-17T17:34:52.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 -- 172.21.15.78:0/194194876 shutdown_connections 2023-08-17T17:34:52.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3f805ed90 0x7fb3f8061250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4180c3580 0x7fb4180c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb404005000 0x7fb41814a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 --2- 172.21.15.78:0/194194876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb418157ff0 0x7fb418158470 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 -- 172.21.15.78:0/194194876 >> 172.21.15.78:0/194194876 conn(0x7fb4180943b0 msgr2=0x7fb4180c0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:52.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 -- 172.21.15.78:0/194194876 shutdown_connections 2023-08-17T17:34:52.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.083+0000 7fb417fff700 1 -- 172.21.15.78:0/194194876 wait complete. 2023-08-17T17:34:52.096 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:34:52.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.210+0000 7f346d2aa700 1 Processor -- start 2023-08-17T17:34:52.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.210+0000 7f346d2aa700 1 -- start start 2023-08-17T17:34:52.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.211+0000 7f346d2aa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f34681578f0 0x7f34680be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.211+0000 7f346d2aa700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34680c3e10 con 0x7f34680bf0e0 2023-08-17T17:34:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.211+0000 7f346d2aa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34680c34e0 con 0x7f3468096520 2023-08-17T17:34:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.211+0000 7f346d2aa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34680bf5c0 con 0x7f34681578f0 2023-08-17T17:34:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.211+0000 7f3466ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f34681578f0 0x7f34680be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.211+0000 7f3466ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f34681578f0 0x7f34680be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34218/0 (socket says 172.21.15.78:34218) 2023-08-17T17:34:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.211+0000 7f345e7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f34680bf0e0 0x7f3468095e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33074/0 (socket says 172.21.15.78:33074) 2023-08-17T17:34:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.211+0000 7f3466ffd700 1 -- 172.21.15.78:0/2458723057 learned_addr learned my addr 172.21.15.78:0/2458723057 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f3466ffd700 1 -- 172.21.15.78:0/2458723057 >> v1:172.21.15.150:6789/0 conn(0x7f3468096520 legacy=0x7f34680c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f3466ffd700 1 -- 172.21.15.78:0/2458723057 >> v1:172.21.15.78:6789/0 conn(0x7f34680bf0e0 legacy=0x7f3468095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f3466ffd700 1 -- 172.21.15.78:0/2458723057 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34680c37c0 con 0x7f34681578f0 2023-08-17T17:34:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f34667fc700 1 -- 172.21.15.78:0/2458723057 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982252660 0 0) 0x7f34680c3e10 con 0x7f34680bf0e0 2023-08-17T17:34:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f3466ffd700 1 --2- 172.21.15.78:0/2458723057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34681578f0 0x7f34680be210 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f3458006fd0 tx=0x7f34580090f0).ready entity=mon.0 client_cookie=9e7987a4ff8d12cb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f34667fc700 1 -- 172.21.15.78:0/2458723057 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345800b600 con 0x7f34681578f0 2023-08-17T17:34:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f34667fc700 1 -- 172.21.15.78:0/2458723057 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345800b760 con 0x7f34681578f0 2023-08-17T17:34:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f34667fc700 1 -- 172.21.15.78:0/2458723057 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345800bb00 con 0x7f34681578f0 2023-08-17T17:34:52.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f346d2aa700 1 -- 172.21.15.78:0/2458723057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34681578f0 msgr2=0x7f34680be210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f346d2aa700 1 --2- 172.21.15.78:0/2458723057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34681578f0 0x7f34680be210 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f3458006fd0 tx=0x7f34580090f0).stop 2023-08-17T17:34:52.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f346d2aa700 1 -- 172.21.15.78:0/2458723057 shutdown_connections 2023-08-17T17:34:52.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f346d2aa700 1 --2- 172.21.15.78:0/2458723057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34681578f0 0x7f34680be210 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.212+0000 7f346d2aa700 1 -- 172.21.15.78:0/2458723057 >> 172.21.15.78:0/2458723057 conn(0x7f3468062f80 msgr2=0x7f34680c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:52.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.213+0000 7f346d2aa700 1 -- 172.21.15.78:0/2458723057 shutdown_connections 2023-08-17T17:34:52.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.213+0000 7f346d2aa700 1 -- 172.21.15.78:0/2458723057 wait complete. 2023-08-17T17:34:52.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.214+0000 7f346d2aa700 1 Processor -- start 2023-08-17T17:34:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.214+0000 7f346d2aa700 1 -- start start 2023-08-17T17:34:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.214+0000 7f346d2aa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3468096520 0x7f34680aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.214+0000 7f346d2aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34680bf0e0 0x7f346814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.214+0000 7f346d2aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34681578f0 0x7f34680a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.214+0000 7f346d2aa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34680ad800 con 0x7f34680bf0e0 2023-08-17T17:34:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.214+0000 7f346d2aa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34680aae30 con 0x7f3468096520 2023-08-17T17:34:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f346d2aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34680ab110 con 0x7f34681578f0 2023-08-17T17:34:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34680bf0e0 0x7f346814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34680bf0e0 0x7f346814f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34234/0 (socket says 172.21.15.78:34234) 2023-08-17T17:34:52.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345e7fc700 1 -- 172.21.15.78:0/2874969972 learned_addr learned my addr 172.21.15.78:0/2874969972 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:52.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f3466ffd700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3468096520 0x7f34680aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f34677fe700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34681578f0 0x7f34680a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345e7fc700 1 -- 172.21.15.78:0/2874969972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34681578f0 msgr2=0x7f34680a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345e7fc700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34681578f0 0x7f34680a96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345e7fc700 1 -- 172.21.15.78:0/2874969972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3468096520 msgr2=0x7f34680aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345e7fc700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3468096520 0x7f34680aa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345e7fc700 1 -- 172.21.15.78:0/2874969972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458009370 con 0x7f34680bf0e0 2023-08-17T17:34:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f3466ffd700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3468096520 0x7f34680aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f34677fe700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34681578f0 0x7f34680a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345e7fc700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34680bf0e0 0x7f346814f0f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f345000c560 tx=0x7f3450007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345f7fe700 1 -- 172.21.15.78:0/2874969972 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500072e0 con 0x7f34680bf0e0 2023-08-17T17:34:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345f7fe700 1 -- 172.21.15.78:0/2874969972 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3450007440 con 0x7f34680bf0e0 2023-08-17T17:34:52.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f346d2aa700 1 -- 172.21.15.78:0/2874969972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34680ab3f0 con 0x7f34680bf0e0 2023-08-17T17:34:52.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f345f7fe700 1 -- 172.21.15.78:0/2874969972 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500058f0 con 0x7f34680bf0e0 2023-08-17T17:34:52.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.215+0000 7f346d2aa700 1 -- 172.21.15.78:0/2874969972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34680a9ba0 con 0x7f34680bf0e0 2023-08-17T17:34:52.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.216+0000 7f346d2aa700 1 -- 172.21.15.78:0/2874969972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34680695e0 con 0x7f34680bf0e0 2023-08-17T17:34:52.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.217+0000 7f345f7fe700 1 -- 172.21.15.78:0/2874969972 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3450010070 con 0x7f34680bf0e0 2023-08-17T17:34:52.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.217+0000 7f345f7fe700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f344805ed60 0x7f3448061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.217+0000 7f345f7fe700 1 -- 172.21.15.78:0/2874969972 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3450079210 con 0x7f34680bf0e0 2023-08-17T17:34:52.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.217+0000 7f3466ffd700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f344805ed60 0x7f3448061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.217+0000 7f3466ffd700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f344805ed60 0x7f3448061220 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f345800b3c0 tx=0x7f3458017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:52.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.221+0000 7f345f7fe700 1 -- 172.21.15.78:0/2874969972 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f345004a7b0 con 0x7f34680bf0e0 2023-08-17T17:34:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.384+0000 7f346d2aa700 1 -- 172.21.15.78:0/2874969972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3468046af0 con 0x7f34680bf0e0 2023-08-17T17:34:52.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.384+0000 7f345f7fe700 1 -- 172.21.15.78:0/2874969972 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f345004ddd0 con 0x7f34680bf0e0 2023-08-17T17:34:52.386 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 -- 172.21.15.78:0/2874969972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f344805ed60 msgr2=0x7f3448061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f344805ed60 0x7f3448061220 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f345800b3c0 tx=0x7f3458017000).stop 2023-08-17T17:34:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 -- 172.21.15.78:0/2874969972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34680bf0e0 msgr2=0x7f346814f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34680bf0e0 0x7f346814f0f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f345000c560 tx=0x7f3450007c90).stop 2023-08-17T17:34:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 -- 172.21.15.78:0/2874969972 shutdown_connections 2023-08-17T17:34:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f344805ed60 0x7f3448061220 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34681578f0 0x7f34680a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3468096520 0x7f34680aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 --2- 172.21.15.78:0/2874969972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34680bf0e0 0x7f346814f0f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 -- 172.21.15.78:0/2874969972 >> 172.21.15.78:0/2874969972 conn(0x7f3468062f80 msgr2=0x7f34681569f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:52.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 -- 172.21.15.78:0/2874969972 shutdown_connections 2023-08-17T17:34:52.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.386+0000 7f346d2aa700 1 -- 172.21.15.78:0/2874969972 wait complete. 2023-08-17T17:34:52.399 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:34:52.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.513+0000 7f1192778700 1 Processor -- start 2023-08-17T17:34:52.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.513+0000 7f1192778700 1 -- start start 2023-08-17T17:34:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.514+0000 7f1192778700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f118c151a40 0x7f118c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.514+0000 7f1192778700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c0c6620 con 0x7f118c157be0 2023-08-17T17:34:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.514+0000 7f1192778700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c0c6900 con 0x7f118c151e20 2023-08-17T17:34:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.514+0000 7f1192778700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0c6be0 con 0x7f118c151a40 2023-08-17T17:34:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.514+0000 7f1191f77700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f118c157be0 0x7f118c0c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33090/0 (socket says 172.21.15.78:33090) 2023-08-17T17:34:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.514+0000 7f1191f77700 1 -- 172.21.15.78:0/2767625782 learned_addr learned my addr 172.21.15.78:0/2767625782 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:52.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1191776700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f118c151a40 0x7f118c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064889119 0 0) 0x7f118c0c6620 con 0x7f118c157be0 2023-08-17T17:34:52.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11780033f0 con 0x7f118c157be0 2023-08-17T17:34:52.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2964233326 0 0) 0x7f11780033f0 con 0x7f118c157be0 2023-08-17T17:34:52.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f118c151a40 msgr2=0x7f118c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:52.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f118c151a40 0x7f118c0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 >> v1:172.21.15.150:6789/0 conn(0x7f118c151e20 legacy=0x7f118c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0c6ec0 con 0x7f118c157be0 2023-08-17T17:34:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f1184001470 con 0x7f118c157be0 2023-08-17T17:34:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 >> v1:172.21.15.78:6789/0 conn(0x7f118c157be0 legacy=0x7f118c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f118c151a40 0x7f1178003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1178003e40 0x7f1178004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1178004b80 0x7f1178005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0c6be0 con 0x7f1178003e40 2023-08-17T17:34:52.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117800b990 con 0x7f1178004b80 2023-08-17T17:34:52.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117800bb50 con 0x7f118c151a40 2023-08-17T17:34:52.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1190f75700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1178003e40 0x7f1178004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1191776700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f118c151a40 0x7f1178003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1191f77700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1178004b80 0x7f1178005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1190f75700 1 -- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f118c151a40 msgr2=0x7f1178003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:52.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1190f75700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f118c151a40 0x7f1178003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1190f75700 1 -- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1178004b80 msgr2=0x7f1178005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:52.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1190f75700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1178004b80 0x7f1178005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1190f75700 1 -- 172.21.15.78:0/2767625782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11780033f0 con 0x7f1178003e40 2023-08-17T17:34:52.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.515+0000 7f1190f75700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1178003e40 0x7f1178004690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f118c0853e0 tx=0x7f117c007c00).ready entity=mon.0 client_cookie=401a5273ffce79e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:52.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.516+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c007020 con 0x7f1178003e40 2023-08-17T17:34:52.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.516+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c007180 con 0x7f1178003e40 2023-08-17T17:34:52.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.516+0000 7f1183fff700 1 -- 172.21.15.78:0/2767625782 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c007520 con 0x7f1178003e40 2023-08-17T17:34:52.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.516+0000 7f1192778700 1 -- 172.21.15.78:0/2767625782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1178003e40 msgr2=0x7f1178004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.516+0000 7f1192778700 1 --2- 172.21.15.78:0/2767625782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1178003e40 0x7f1178004690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f118c0853e0 tx=0x7f117c007c00).stop 2023-08-17T17:34:52.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.516+0000 7f1191f77700 1 -- 172.21.15.78:0/2767625782 reap_dead start 2023-08-17T17:34:52.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.516+0000 7f1192778700 1 -- 172.21.15.78:0/2767625782 shutdown_connections 2023-08-17T17:34:52.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.516+0000 7f1192778700 1 -- 172.21.15.78:0/2767625782 >> 172.21.15.78:0/2767625782 conn(0x7f118c0943b0 msgr2=0x7f118c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:52.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.516+0000 7f1192778700 1 -- 172.21.15.78:0/2767625782 shutdown_connections 2023-08-17T17:34:52.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.516+0000 7f1192778700 1 -- 172.21.15.78:0/2767625782 wait complete. 2023-08-17T17:34:52.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.517+0000 7f1192778700 1 Processor -- start 2023-08-17T17:34:52.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.517+0000 7f1192778700 1 -- start start 2023-08-17T17:34:52.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1192778700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1178003e40 0x7f118c0c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1192778700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f118c0a9410 0x7f118c149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1192778700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f118c156940 0x7f118c156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1192778700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c157290 con 0x7f118c0a9410 2023-08-17T17:34:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1192778700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0af350 con 0x7f118c156940 2023-08-17T17:34:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1192778700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0c4240 con 0x7f1178003e40 2023-08-17T17:34:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1190f75700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f118c0a9410 0x7f118c149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1190f75700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f118c0a9410 0x7f118c149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34248/0 (socket says 172.21.15.78:34248) 2023-08-17T17:34:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1190f75700 1 -- 172.21.15.78:0/2309244869 learned_addr learned my addr 172.21.15.78:0/2309244869 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1191776700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1178003e40 0x7f118c0c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.518+0000 7f1191f77700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f118c156940 0x7f118c156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f1190f75700 1 -- 172.21.15.78:0/2309244869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1178003e40 msgr2=0x7f118c0c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f1190f75700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1178003e40 0x7f118c0c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f1190f75700 1 -- 172.21.15.78:0/2309244869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f118c156940 msgr2=0x7f118c156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f1190f75700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f118c156940 0x7f118c156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f1190f75700 1 -- 172.21.15.78:0/2309244869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0c4520 con 0x7f118c0a9410 2023-08-17T17:34:52.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f1191f77700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f118c156940 0x7f118c156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:52.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f1190f75700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f118c0a9410 0x7f118c149820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f118c094ae0 tx=0x7f117c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:52.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f11817fa700 1 -- 172.21.15.78:0/2309244869 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c006f90 con 0x7f118c0a9410 2023-08-17T17:34:52.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f11817fa700 1 -- 172.21.15.78:0/2309244869 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c013670 con 0x7f118c0a9410 2023-08-17T17:34:52.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f11817fa700 1 -- 172.21.15.78:0/2309244869 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c013a10 con 0x7f118c0a9410 2023-08-17T17:34:52.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f1192778700 1 -- 172.21.15.78:0/2309244869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c0c4800 con 0x7f118c0a9410 2023-08-17T17:34:52.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.519+0000 7f1192778700 1 -- 172.21.15.78:0/2309244869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c0a9890 con 0x7f118c0a9410 2023-08-17T17:34:52.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.520+0000 7f1192778700 1 -- 172.21.15.78:0/2309244869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c082f90 con 0x7f118c0a9410 2023-08-17T17:34:52.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.520+0000 7f11817fa700 1 -- 172.21.15.78:0/2309244869 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f117c01d070 con 0x7f118c0a9410 2023-08-17T17:34:52.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.520+0000 7f11817fa700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f117005ed90 0x7f1170061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.520+0000 7f11817fa700 1 -- 172.21.15.78:0/2309244869 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f117c07a530 con 0x7f118c0a9410 2023-08-17T17:34:52.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.521+0000 7f1191776700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f117005ed90 0x7f1170061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.521+0000 7f1191776700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f117005ed90 0x7f1170061250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f11880094d0 tx=0x7f118800b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:52.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.525+0000 7f11817fa700 1 -- 172.21.15.78:0/2309244869 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f117c04bad0 con 0x7f118c0a9410 2023-08-17T17:34:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.687+0000 7f1192778700 1 -- 172.21.15.78:0/2309244869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f118c05f910 con 0x7f118c0a9410 2023-08-17T17:34:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.687+0000 7f11817fa700 1 -- 172.21.15.78:0/2309244869 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f117c01a070 con 0x7f118c0a9410 2023-08-17T17:34:52.689 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:52.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.689+0000 7f1192778700 1 -- 172.21.15.78:0/2309244869 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f117005ed90 msgr2=0x7f1170061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.689+0000 7f1192778700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f117005ed90 0x7f1170061250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f11880094d0 tx=0x7f118800b040).stop 2023-08-17T17:34:52.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.689+0000 7f1192778700 1 -- 172.21.15.78:0/2309244869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f118c0a9410 msgr2=0x7f118c149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.689+0000 7f1192778700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f118c0a9410 0x7f118c149820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f118c094ae0 tx=0x7f117c015000).stop 2023-08-17T17:34:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.689+0000 7f1192778700 1 -- 172.21.15.78:0/2309244869 shutdown_connections 2023-08-17T17:34:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.689+0000 7f1192778700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f117005ed90 0x7f1170061250 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.690+0000 7f1192778700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f118c156940 0x7f118c156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.690+0000 7f1192778700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1178003e40 0x7f118c0c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.690+0000 7f1192778700 1 --2- 172.21.15.78:0/2309244869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f118c0a9410 0x7f118c149820 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.690+0000 7f1192778700 1 -- 172.21.15.78:0/2309244869 >> 172.21.15.78:0/2309244869 conn(0x7f118c0943b0 msgr2=0x7f118c0c06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:52.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.690+0000 7f1192778700 1 -- 172.21.15.78:0/2309244869 shutdown_connections 2023-08-17T17:34:52.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.690+0000 7f1192778700 1 -- 172.21.15.78:0/2309244869 wait complete. 2023-08-17T17:34:52.703 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:52.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.814+0000 7faa5cbaf700 1 Processor -- start 2023-08-17T17:34:52.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.814+0000 7faa5cbaf700 1 -- start start 2023-08-17T17:34:52.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa5cbaf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faa580c6ee0 0x7faa580c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa5cbaf700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa580c0df0 0x7faa580ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa5cbaf700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa580c7350 con 0x7faa58154140 2023-08-17T17:34:52.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa5cbaf700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa580a8350 con 0x7faa580c0df0 2023-08-17T17:34:52.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa5cbaf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa580c1240 con 0x7faa580c6ee0 2023-08-17T17:34:52.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa56d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa580c0df0 0x7faa580ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa5659c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7faa58154140 0x7faa580a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33100/0 (socket says 172.21.15.78:33100) 2023-08-17T17:34:52.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa5659c700 1 -- 172.21.15.78:0/3561369054 learned_addr learned my addr 172.21.15.78:0/3561369054 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:52.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa4dd9b700 1 --2- 172.21.15.78:0/3561369054 >> v2:172.21.15.150:3300/0 conn(0x7faa580c6ee0 0x7faa580c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa56d9d700 1 -- 172.21.15.78:0/3561369054 >> v2:172.21.15.150:3300/0 conn(0x7faa580c6ee0 msgr2=0x7faa580c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:52.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa56d9d700 1 --2- 172.21.15.78:0/3561369054 >> v2:172.21.15.150:3300/0 conn(0x7faa580c6ee0 0x7faa580c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa56d9d700 1 -- 172.21.15.78:0/3561369054 >> v1:172.21.15.78:6789/0 conn(0x7faa58154140 legacy=0x7faa580a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.815+0000 7faa55d9b700 1 -- 172.21.15.78:0/3561369054 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500916698 0 0) 0x7faa580c7350 con 0x7faa58154140 2023-08-17T17:34:52.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa56d9d700 1 -- 172.21.15.78:0/3561369054 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58154520 con 0x7faa580c0df0 2023-08-17T17:34:52.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa56d9d700 1 --2- 172.21.15.78:0/3561369054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa580c0df0 0x7faa580ca280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7faa580652a0 tx=0x7faa50009780).ready entity=mon.0 client_cookie=6abd631444739583 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:52.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa55d9b700 1 -- 172.21.15.78:0/3561369054 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5000e070 con 0x7faa580c0df0 2023-08-17T17:34:52.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa55d9b700 1 -- 172.21.15.78:0/3561369054 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5000bb60 con 0x7faa580c0df0 2023-08-17T17:34:52.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa55d9b700 1 -- 172.21.15.78:0/3561369054 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50012410 con 0x7faa580c0df0 2023-08-17T17:34:52.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa5cbaf700 1 -- 172.21.15.78:0/3561369054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa580c0df0 msgr2=0x7faa580ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa5cbaf700 1 --2- 172.21.15.78:0/3561369054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa580c0df0 0x7faa580ca280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7faa580652a0 tx=0x7faa50009780).stop 2023-08-17T17:34:52.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa5cbaf700 1 -- 172.21.15.78:0/3561369054 shutdown_connections 2023-08-17T17:34:52.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa5cbaf700 1 --2- 172.21.15.78:0/3561369054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa580c0df0 0x7faa580ca280 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa5cbaf700 1 --2- 172.21.15.78:0/3561369054 >> v2:172.21.15.150:3300/0 conn(0x7faa580c6ee0 0x7faa580c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa5cbaf700 1 -- 172.21.15.78:0/3561369054 >> 172.21.15.78:0/3561369054 conn(0x7faa58094510 msgr2=0x7faa5806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:52.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa5cbaf700 1 -- 172.21.15.78:0/3561369054 shutdown_connections 2023-08-17T17:34:52.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.816+0000 7faa5cbaf700 1 -- 172.21.15.78:0/3561369054 wait complete. 2023-08-17T17:34:52.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.817+0000 7faa5cbaf700 1 Processor -- start 2023-08-17T17:34:52.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.818+0000 7faa5cbaf700 1 -- start start 2023-08-17T17:34:52.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.818+0000 7faa5cbaf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa580c0df0 0x7faa580ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.818+0000 7faa5cbaf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa580c6ee0 0x7faa58151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.818+0000 7faa5cbaf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa58154140 0x7faa58164140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.818+0000 7faa5cbaf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa580ae8a0 con 0x7faa58154140 2023-08-17T17:34:52.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.818+0000 7faa5cbaf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa58151500 con 0x7faa580c0df0 2023-08-17T17:34:52.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.818+0000 7faa5cbaf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa580affa0 con 0x7faa580c6ee0 2023-08-17T17:34:52.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.818+0000 7faa56d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa58154140 0x7faa58164140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.818+0000 7faa56d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa58154140 0x7faa58164140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34260/0 (socket says 172.21.15.78:34260) 2023-08-17T17:34:52.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.818+0000 7faa56d9d700 1 -- 172.21.15.78:0/2510431701 learned_addr learned my addr 172.21.15.78:0/2510431701 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:52.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa4dd9b700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa580c6ee0 0x7faa58151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa5659c700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa580c0df0 0x7faa580ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa56d9d700 1 -- 172.21.15.78:0/2510431701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa580c6ee0 msgr2=0x7faa58151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa56d9d700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa580c6ee0 0x7faa58151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa56d9d700 1 -- 172.21.15.78:0/2510431701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa580c0df0 msgr2=0x7faa580ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa56d9d700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa580c0df0 0x7faa580ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa56d9d700 1 -- 172.21.15.78:0/2510431701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa50009a20 con 0x7faa58154140 2023-08-17T17:34:52.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa5659c700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa580c0df0 0x7faa580ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:52.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa56d9d700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa58154140 0x7faa58164140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7faa5000b6c0 tx=0x7faa580a8490).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:52.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa4effd700 1 -- 172.21.15.78:0/2510431701 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5001d630 con 0x7faa58154140 2023-08-17T17:34:52.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa4effd700 1 -- 172.21.15.78:0/2510431701 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5001d790 con 0x7faa58154140 2023-08-17T17:34:52.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa5cbaf700 1 -- 172.21.15.78:0/2510431701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa580afc90 con 0x7faa58154140 2023-08-17T17:34:52.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa4effd700 1 -- 172.21.15.78:0/2510431701 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5001db10 con 0x7faa58154140 2023-08-17T17:34:52.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.819+0000 7faa5cbaf700 1 -- 172.21.15.78:0/2510431701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa581648b0 con 0x7faa58154140 2023-08-17T17:34:52.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.820+0000 7faa5cbaf700 1 -- 172.21.15.78:0/2510431701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa580c6970 con 0x7faa58154140 2023-08-17T17:34:52.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.820+0000 7faa4effd700 1 -- 172.21.15.78:0/2510431701 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faa50027460 con 0x7faa58154140 2023-08-17T17:34:52.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.820+0000 7faa4effd700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa3805ed90 0x7faa38061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:52.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.821+0000 7faa4effd700 1 -- 172.21.15.78:0/2510431701 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa5007bb40 con 0x7faa58154140 2023-08-17T17:34:52.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.821+0000 7faa5659c700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa3805ed90 0x7faa38061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:52.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.821+0000 7faa5659c700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa3805ed90 0x7faa38061250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7faa580aa920 tx=0x7faa48009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:52.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.825+0000 7faa4effd700 1 -- 172.21.15.78:0/2510431701 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa5004d080 con 0x7faa58154140 2023-08-17T17:34:52.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.992+0000 7faa5cbaf700 1 -- 172.21.15.78:0/2510431701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa58047350 con 0x7faa58154140 2023-08-17T17:34:52.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.993+0000 7faa4effd700 1 -- 172.21.15.78:0/2510431701 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7faa500506a0 con 0x7faa58154140 2023-08-17T17:34:52.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:52.995 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:52.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.994+0000 7faa5cbaf700 1 -- 172.21.15.78:0/2510431701 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa3805ed90 msgr2=0x7faa38061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.994+0000 7faa5cbaf700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa3805ed90 0x7faa38061250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7faa580aa920 tx=0x7faa48009040).stop 2023-08-17T17:34:52.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.994+0000 7faa5cbaf700 1 -- 172.21.15.78:0/2510431701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa58154140 msgr2=0x7faa58164140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:52.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.994+0000 7faa5cbaf700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa58154140 0x7faa58164140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7faa5000b6c0 tx=0x7faa580a8490).stop 2023-08-17T17:34:52.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.994+0000 7faa5cbaf700 1 -- 172.21.15.78:0/2510431701 shutdown_connections 2023-08-17T17:34:52.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.994+0000 7faa5cbaf700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa3805ed90 0x7faa38061250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.994+0000 7faa5cbaf700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa58154140 0x7faa58164140 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.995+0000 7faa5cbaf700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa580c0df0 0x7faa580ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.995+0000 7faa5cbaf700 1 --2- 172.21.15.78:0/2510431701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa580c6ee0 0x7faa58151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:52.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.995+0000 7faa5cbaf700 1 -- 172.21.15.78:0/2510431701 >> 172.21.15.78:0/2510431701 conn(0x7faa58094510 msgr2=0x7faa580ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:52.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.995+0000 7faa5cbaf700 1 -- 172.21.15.78:0/2510431701 shutdown_connections 2023-08-17T17:34:52.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:52.995+0000 7faa5cbaf700 1 -- 172.21.15.78:0/2510431701 wait complete. 2023-08-17T17:34:53.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:34:21.874660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:34:22.501817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:34:53.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:34:53.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.123+0000 7f12442a2700 1 Processor -- start 2023-08-17T17:34:53.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.123+0000 7f12442a2700 1 -- start start 2023-08-17T17:34:53.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f12442a2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f123c0aa0f0 0x7f123c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f12442a2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f123c0aa4d0 0x7f123c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f12442a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0c5810 0x7f123c0c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f12442a2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0649b0 con 0x7f123c0aa0f0 2023-08-17T17:34:53.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f12442a2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0c6140 con 0x7f123c0aa4d0 2023-08-17T17:34:53.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f12442a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c063420 con 0x7f123c0c5810 2023-08-17T17:34:53.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124203e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f123c0aa0f0 0x7f123c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124203e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f123c0aa0f0 0x7f123c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34270/0 (socket says 172.21.15.78:34270) 2023-08-17T17:34:53.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124203e700 1 -- 172.21.15.78:0/1524025719 learned_addr learned my addr 172.21.15.78:0/1524025719 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:53.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124183d700 1 --2- 172.21.15.78:0/1524025719 >> v2:172.21.15.150:3300/0 conn(0x7f123c0aa4d0 0x7f123c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124283f700 1 --2- 172.21.15.78:0/1524025719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0c5810 0x7f123c0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124203e700 1 -- 172.21.15.78:0/1524025719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0c5810 msgr2=0x7f123c0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:53.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124203e700 1 --2- 172.21.15.78:0/1524025719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0c5810 0x7f123c0c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124203e700 1 -- 172.21.15.78:0/1524025719 >> v2:172.21.15.150:3300/0 conn(0x7f123c0aa4d0 msgr2=0x7f123c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124203e700 1 --2- 172.21.15.78:0/1524025719 >> v2:172.21.15.150:3300/0 conn(0x7f123c0aa4d0 0x7f123c0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124203e700 1 -- 172.21.15.78:0/1524025719 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c063700 con 0x7f123c0aa0f0 2023-08-17T17:34:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124283f700 1 --2- 172.21.15.78:0/1524025719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0c5810 0x7f123c0c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124183d700 1 --2- 172.21.15.78:0/1524025719 >> v2:172.21.15.150:3300/0 conn(0x7f123c0aa4d0 0x7f123c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124203e700 1 --2- 172.21.15.78:0/1524025719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa0f0 0x7f123c0644c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f123c159060 tx=0x7f12380090f0).ready entity=mon.0 client_cookie=9e2471135c6817e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124103c700 1 -- 172.21.15.78:0/1524025719 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123800b600 con 0x7f123c0aa0f0 2023-08-17T17:34:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124103c700 1 -- 172.21.15.78:0/1524025719 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123800b760 con 0x7f123c0aa0f0 2023-08-17T17:34:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.124+0000 7f124103c700 1 -- 172.21.15.78:0/1524025719 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123800bae0 con 0x7f123c0aa0f0 2023-08-17T17:34:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.125+0000 7f12442a2700 1 -- 172.21.15.78:0/1524025719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa0f0 msgr2=0x7f123c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.125+0000 7f12442a2700 1 --2- 172.21.15.78:0/1524025719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa0f0 0x7f123c0644c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f123c159060 tx=0x7f12380090f0).stop 2023-08-17T17:34:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.125+0000 7f12442a2700 1 -- 172.21.15.78:0/1524025719 shutdown_connections 2023-08-17T17:34:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.125+0000 7f12442a2700 1 --2- 172.21.15.78:0/1524025719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa0f0 0x7f123c0644c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.125+0000 7f12442a2700 1 --2- 172.21.15.78:0/1524025719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0c5810 0x7f123c0c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.125+0000 7f12442a2700 1 --2- 172.21.15.78:0/1524025719 >> v2:172.21.15.150:3300/0 conn(0x7f123c0aa4d0 0x7f123c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.125+0000 7f12442a2700 1 -- 172.21.15.78:0/1524025719 >> 172.21.15.78:0/1524025719 conn(0x7f123c06a6a0 msgr2=0x7f123c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:53.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.125+0000 7f12442a2700 1 -- 172.21.15.78:0/1524025719 shutdown_connections 2023-08-17T17:34:53.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.125+0000 7f12442a2700 1 -- 172.21.15.78:0/1524025719 wait complete. 2023-08-17T17:34:53.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.126+0000 7f12442a2700 1 Processor -- start 2023-08-17T17:34:53.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.126+0000 7f12442a2700 1 -- start start 2023-08-17T17:34:53.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f12442a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0aa0f0 0x7f123c0c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f12442a2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa4d0 0x7f123c150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f12442a2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f123c0c5810 0x7f123c1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f12442a2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0aa9b0 con 0x7f123c0aa4d0 2023-08-17T17:34:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f12442a2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c150ae0 con 0x7f123c0c5810 2023-08-17T17:34:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f12442a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0ab9c0 con 0x7f123c0aa0f0 2023-08-17T17:34:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124183d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa4d0 0x7f123c150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124183d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa4d0 0x7f123c150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34278/0 (socket says 172.21.15.78:34278) 2023-08-17T17:34:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124183d700 1 -- 172.21.15.78:0/1466531299 learned_addr learned my addr 172.21.15.78:0/1466531299 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124203e700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0aa0f0 0x7f123c0c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124183d700 1 -- 172.21.15.78:0/1466531299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0aa0f0 msgr2=0x7f123c0c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124283f700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f123c0c5810 0x7f123c1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124183d700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0aa0f0 0x7f123c0c05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124183d700 1 -- 172.21.15.78:0/1466531299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f123c0c5810 msgr2=0x7f123c1505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124183d700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f123c0c5810 0x7f123c1505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124183d700 1 -- 172.21.15.78:0/1466531299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1238009370 con 0x7f123c0aa4d0 2023-08-17T17:34:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124203e700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0aa0f0 0x7f123c0c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124283f700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f123c0c5810 0x7f123c1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.127+0000 7f124183d700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa4d0 0x7f123c150100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f122c00c880 tx=0x7f122c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.128+0000 7f12327fc700 1 -- 172.21.15.78:0/1466531299 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c010580 con 0x7f123c0aa4d0 2023-08-17T17:34:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.128+0000 7f12327fc700 1 -- 172.21.15.78:0/1466531299 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c0106e0 con 0x7f123c0aa4d0 2023-08-17T17:34:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.128+0000 7f12327fc700 1 -- 172.21.15.78:0/1466531299 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c010a60 con 0x7f123c0aa4d0 2023-08-17T17:34:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.128+0000 7f12442a2700 1 -- 172.21.15.78:0/1466531299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c0aac00 con 0x7f123c0aa4d0 2023-08-17T17:34:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.128+0000 7f12442a2700 1 -- 172.21.15.78:0/1466531299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c0ab1c0 con 0x7f123c0aa4d0 2023-08-17T17:34:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.129+0000 7f12442a2700 1 -- 172.21.15.78:0/1466531299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c083980 con 0x7f123c0aa4d0 2023-08-17T17:34:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.129+0000 7f12327fc700 1 -- 172.21.15.78:0/1466531299 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f122c01b460 con 0x7f123c0aa4d0 2023-08-17T17:34:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.129+0000 7f12327fc700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005ed90 0x7f1220061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.129+0000 7f12327fc700 1 -- 172.21.15.78:0/1466531299 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f122c079d20 con 0x7f123c0aa4d0 2023-08-17T17:34:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.129+0000 7f124203e700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005ed90 0x7f1220061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.130+0000 7f124203e700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005ed90 0x7f1220061250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f123800b3c0 tx=0x7f1238017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:53.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.133+0000 7f12327fc700 1 -- 172.21.15.78:0/1466531299 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f122c04b260 con 0x7f123c0aa4d0 2023-08-17T17:34:53.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.300+0000 7f12442a2700 1 -- 172.21.15.78:0/1466531299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f123c0629b0 con 0x7f123c0aa4d0 2023-08-17T17:34:53.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.300+0000 7f12327fc700 1 -- 172.21.15.78:0/1466531299 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f122c04e880 con 0x7f123c0aa4d0 2023-08-17T17:34:53.302 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:34:53.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 -- 172.21.15.78:0/1466531299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005ed90 msgr2=0x7f1220061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005ed90 0x7f1220061250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f123800b3c0 tx=0x7f1238017000).stop 2023-08-17T17:34:53.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 -- 172.21.15.78:0/1466531299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa4d0 msgr2=0x7f123c150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa4d0 0x7f123c150100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f122c00c880 tx=0x7f122c008040).stop 2023-08-17T17:34:53.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 -- 172.21.15.78:0/1466531299 shutdown_connections 2023-08-17T17:34:53.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005ed90 0x7f1220061250 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f123c0c5810 0x7f123c1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f123c0aa0f0 0x7f123c0c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 --2- 172.21.15.78:0/1466531299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f123c0aa4d0 0x7f123c150100 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 -- 172.21.15.78:0/1466531299 >> 172.21.15.78:0/1466531299 conn(0x7f123c06a6a0 msgr2=0x7f123c0a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 -- 172.21.15.78:0/1466531299 shutdown_connections 2023-08-17T17:34:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.302+0000 7f12442a2700 1 -- 172.21.15.78:0/1466531299 wait complete. 2023-08-17T17:34:53.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:34:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.429+0000 7f764209b700 1 Processor -- start 2023-08-17T17:34:53.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.429+0000 7f764209b700 1 -- start start 2023-08-17T17:34:53.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f764209b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f763c0aa4d0 0x7f763c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f764209b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0c5810 0x7f763c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f764209b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c0649b0 con 0x7f763c0aa0f0 2023-08-17T17:34:53.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f764209b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0c6170 con 0x7f763c0aa4d0 2023-08-17T17:34:53.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f764209b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c063420 con 0x7f763c0c5810 2023-08-17T17:34:53.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f763c0aa4d0 0x7f763c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f763c0aa0f0 0x7f763c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33104/0 (socket says 172.21.15.78:33104) 2023-08-17T17:34:53.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f763c0aa4d0 0x7f763c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34288/0 (socket says 172.21.15.78:34288) 2023-08-17T17:34:53.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763b7fe700 1 -- 172.21.15.78:0/606438164 learned_addr learned my addr 172.21.15.78:0/606438164 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:53.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763bfff700 1 --2- 172.21.15.78:0/606438164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0c5810 0x7f763c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763affd700 1 -- 172.21.15.78:0/606438164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0c5810 msgr2=0x7f763c0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:53.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763affd700 1 --2- 172.21.15.78:0/606438164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0c5810 0x7f763c0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763affd700 1 -- 172.21.15.78:0/606438164 >> v1:172.21.15.78:6789/0 conn(0x7f763c0aa0f0 legacy=0x7f763c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763affd700 1 -- 172.21.15.78:0/606438164 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c063700 con 0x7f763c0aa4d0 2023-08-17T17:34:53.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763a7fc700 1 -- 172.21.15.78:0/606438164 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478925651 0 0) 0x7f763c0649b0 con 0x7f763c0aa0f0 2023-08-17T17:34:53.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.430+0000 7f763bfff700 1 --2- 172.21.15.78:0/606438164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0c5810 0x7f763c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:53.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f763affd700 1 --2- 172.21.15.78:0/606438164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0aa4d0 0x7f763c0644c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f7630009760 tx=0x7f7630009060).ready entity=mon.0 client_cookie=22acb018640b6cf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:53.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f763a7fc700 1 -- 172.21.15.78:0/606438164 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763000b580 con 0x7f763c0aa4d0 2023-08-17T17:34:53.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f763a7fc700 1 -- 172.21.15.78:0/606438164 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763000b6e0 con 0x7f763c0aa4d0 2023-08-17T17:34:53.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f763a7fc700 1 -- 172.21.15.78:0/606438164 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763000ba60 con 0x7f763c0aa4d0 2023-08-17T17:34:53.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f764209b700 1 -- 172.21.15.78:0/606438164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0aa4d0 msgr2=0x7f763c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f764209b700 1 --2- 172.21.15.78:0/606438164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0aa4d0 0x7f763c0644c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f7630009760 tx=0x7f7630009060).stop 2023-08-17T17:34:53.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f764209b700 1 -- 172.21.15.78:0/606438164 shutdown_connections 2023-08-17T17:34:53.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f764209b700 1 --2- 172.21.15.78:0/606438164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0c5810 0x7f763c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f764209b700 1 --2- 172.21.15.78:0/606438164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0aa4d0 0x7f763c0644c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f764209b700 1 -- 172.21.15.78:0/606438164 >> 172.21.15.78:0/606438164 conn(0x7f763c06a6a0 msgr2=0x7f763c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:53.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f764209b700 1 -- 172.21.15.78:0/606438164 shutdown_connections 2023-08-17T17:34:53.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.431+0000 7f764209b700 1 -- 172.21.15.78:0/606438164 wait complete. 2023-08-17T17:34:53.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f764209b700 1 Processor -- start 2023-08-17T17:34:53.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f764209b700 1 -- start start 2023-08-17T17:34:53.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f764209b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f763c0aa0f0 0x7f763c0ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f764209b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0aa4d0 0x7f763c151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f764209b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0c5810 0x7f763c0c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f764209b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0c2e50 con 0x7f763c0c5810 2023-08-17T17:34:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f764209b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0c33d0 con 0x7f763c0aa0f0 2023-08-17T17:34:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f764209b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0c2510 con 0x7f763c0aa4d0 2023-08-17T17:34:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f763bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0c5810 0x7f763c0c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f763bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0c5810 0x7f763c0c1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34292/0 (socket says 172.21.15.78:34292) 2023-08-17T17:34:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.433+0000 7f763bfff700 1 -- 172.21.15.78:0/3842650886 learned_addr learned my addr 172.21.15.78:0/3842650886 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f763affd700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0aa4d0 0x7f763c151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f763b7fe700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f763c0aa0f0 0x7f763c0ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f763bfff700 1 -- 172.21.15.78:0/3842650886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0aa4d0 msgr2=0x7f763c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f763bfff700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0aa4d0 0x7f763c151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f763bfff700 1 -- 172.21.15.78:0/3842650886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f763c0aa0f0 msgr2=0x7f763c0ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f763bfff700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f763c0aa0f0 0x7f763c0ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f763bfff700 1 -- 172.21.15.78:0/3842650886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76300092a0 con 0x7f763c0c5810 2023-08-17T17:34:53.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f763b7fe700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f763c0aa0f0 0x7f763c0ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:53.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f763bfff700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0c5810 0x7f763c0c1ac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f763400c880 tx=0x7f7634008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:53.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f76237fe700 1 -- 172.21.15.78:0/3842650886 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634010580 con 0x7f763c0c5810 2023-08-17T17:34:53.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f76237fe700 1 -- 172.21.15.78:0/3842650886 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76340106e0 con 0x7f763c0c5810 2023-08-17T17:34:53.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f764209b700 1 -- 172.21.15.78:0/3842650886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c0c27f0 con 0x7f763c0c5810 2023-08-17T17:34:53.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f76237fe700 1 -- 172.21.15.78:0/3842650886 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634010a60 con 0x7f763c0c5810 2023-08-17T17:34:53.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.434+0000 7f764209b700 1 -- 172.21.15.78:0/3842650886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c151f30 con 0x7f763c0c5810 2023-08-17T17:34:53.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.435+0000 7f764209b700 1 -- 172.21.15.78:0/3842650886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763c0c3540 con 0x7f763c0c5810 2023-08-17T17:34:53.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.435+0000 7f76237fe700 1 -- 172.21.15.78:0/3842650886 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f763401b460 con 0x7f763c0c5810 2023-08-17T17:34:53.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.436+0000 7f76237fe700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f762805ed90 0x7f7628061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.436+0000 7f76237fe700 1 -- 172.21.15.78:0/3842650886 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7634079bf0 con 0x7f763c0c5810 2023-08-17T17:34:53.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.436+0000 7f763b7fe700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f762805ed90 0x7f7628061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.436+0000 7f763b7fe700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f762805ed90 0x7f7628061250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f762c001e10 tx=0x7f762c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:53.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.440+0000 7f76237fe700 1 -- 172.21.15.78:0/3842650886 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f763404b130 con 0x7f763c0c5810 2023-08-17T17:34:53.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.603+0000 7f764209b700 1 -- 172.21.15.78:0/3842650886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f763c064ed0 con 0x7f763c0c5810 2023-08-17T17:34:53.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.604+0000 7f76237fe700 1 -- 172.21.15.78:0/3842650886 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f763404e750 con 0x7f763c0c5810 2023-08-17T17:34:53.606 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:34:53.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.605+0000 7f764209b700 1 -- 172.21.15.78:0/3842650886 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f762805ed90 msgr2=0x7f7628061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.605+0000 7f764209b700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f762805ed90 0x7f7628061250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f762c001e10 tx=0x7f762c009040).stop 2023-08-17T17:34:53.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.605+0000 7f764209b700 1 -- 172.21.15.78:0/3842650886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0c5810 msgr2=0x7f763c0c1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.605+0000 7f764209b700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0c5810 0x7f763c0c1ac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f763400c880 tx=0x7f7634008040).stop 2023-08-17T17:34:53.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.605+0000 7f764209b700 1 -- 172.21.15.78:0/3842650886 shutdown_connections 2023-08-17T17:34:53.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.605+0000 7f764209b700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f762805ed90 0x7f7628061250 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.605+0000 7f764209b700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f763c0c5810 0x7f763c0c1ac0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.605+0000 7f764209b700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f763c0aa0f0 0x7f763c0ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.605+0000 7f764209b700 1 --2- 172.21.15.78:0/3842650886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f763c0aa4d0 0x7f763c151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.605+0000 7f764209b700 1 -- 172.21.15.78:0/3842650886 >> 172.21.15.78:0/3842650886 conn(0x7f763c06a6a0 msgr2=0x7f763c152dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:53.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.606+0000 7f764209b700 1 -- 172.21.15.78:0/3842650886 shutdown_connections 2023-08-17T17:34:53.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.606+0000 7f764209b700 1 -- 172.21.15.78:0/3842650886 wait complete. 2023-08-17T17:34:53.619 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:34:53.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.732+0000 7fdeb39f0700 1 Processor -- start 2023-08-17T17:34:53.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.732+0000 7fdeb39f0700 1 -- start start 2023-08-17T17:34:53.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdeb39f0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa4d0 0x7fdeac0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdeb39f0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdeac0c5810 0x7fdeac0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdeb39f0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac0649b0 con 0x7fdeac0aa0f0 2023-08-17T17:34:53.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdeb39f0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac0c6150 con 0x7fdeac0c5810 2023-08-17T17:34:53.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdeb39f0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac063420 con 0x7fdeac0aa4d0 2023-08-17T17:34:53.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdeb178c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdeac0aa0f0 0x7fdeac0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33108/0 (socket says 172.21.15.78:33108) 2023-08-17T17:34:53.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdeb178c700 1 -- 172.21.15.78:0/1297511515 learned_addr learned my addr 172.21.15.78:0/1297511515 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:53.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdeb0f8b700 1 --2- 172.21.15.78:0/1297511515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa4d0 0x7fdeac0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdeb1f8d700 1 --2- 172.21.15.78:0/1297511515 >> v2:172.21.15.150:3300/0 conn(0x7fdeac0c5810 0x7fdeac0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdea3fff700 1 -- 172.21.15.78:0/1297511515 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069600675 0 0) 0x7fdeac0649b0 con 0x7fdeac0aa0f0 2023-08-17T17:34:53.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.733+0000 7fdea3fff700 1 -- 172.21.15.78:0/1297511515 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde980033f0 con 0x7fdeac0aa0f0 2023-08-17T17:34:53.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdeb0f8b700 1 -- 172.21.15.78:0/1297511515 >> v2:172.21.15.150:3300/0 conn(0x7fdeac0c5810 msgr2=0x7fdeac0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:53.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdea3fff700 1 -- 172.21.15.78:0/1297511515 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737566071 0 0) 0x7fde980033f0 con 0x7fdeac0aa0f0 2023-08-17T17:34:53.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdeb0f8b700 1 --2- 172.21.15.78:0/1297511515 >> v2:172.21.15.150:3300/0 conn(0x7fdeac0c5810 0x7fdeac0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdeb0f8b700 1 -- 172.21.15.78:0/1297511515 >> v1:172.21.15.78:6789/0 conn(0x7fdeac0aa0f0 legacy=0x7fdeac0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdeb0f8b700 1 -- 172.21.15.78:0/1297511515 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac063700 con 0x7fdeac0aa4d0 2023-08-17T17:34:53.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdeb1f8d700 1 --2- 172.21.15.78:0/1297511515 >> v2:172.21.15.150:3300/0 conn(0x7fdeac0c5810 0x7fdeac0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:53.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdeb0f8b700 1 --2- 172.21.15.78:0/1297511515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa4d0 0x7fdeac0644c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fde9c009760 tx=0x7fde9c009060).ready entity=mon.2 client_cookie=777cd28269cf6408 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:53.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdea3fff700 1 -- 172.21.15.78:0/1297511515 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8001470 con 0x7fdeac0aa4d0 2023-08-17T17:34:53.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdea3fff700 1 -- 172.21.15.78:0/1297511515 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c011400 con 0x7fdeac0aa4d0 2023-08-17T17:34:53.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdea3fff700 1 -- 172.21.15.78:0/1297511515 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c011780 con 0x7fdeac0aa4d0 2023-08-17T17:34:53.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdeb39f0700 1 -- 172.21.15.78:0/1297511515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa4d0 msgr2=0x7fdeac0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.734+0000 7fdeb39f0700 1 --2- 172.21.15.78:0/1297511515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa4d0 0x7fdeac0644c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fde9c009760 tx=0x7fde9c009060).stop 2023-08-17T17:34:53.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.735+0000 7fdeb39f0700 1 -- 172.21.15.78:0/1297511515 shutdown_connections 2023-08-17T17:34:53.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.735+0000 7fdeb39f0700 1 --2- 172.21.15.78:0/1297511515 >> v2:172.21.15.150:3300/0 conn(0x7fdeac0c5810 0x7fdeac0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.735+0000 7fdeb39f0700 1 --2- 172.21.15.78:0/1297511515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa4d0 0x7fdeac0644c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.735+0000 7fdeb39f0700 1 -- 172.21.15.78:0/1297511515 >> 172.21.15.78:0/1297511515 conn(0x7fdeac06a6a0 msgr2=0x7fdeac0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:53.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.735+0000 7fdeb39f0700 1 -- 172.21.15.78:0/1297511515 shutdown_connections 2023-08-17T17:34:53.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.735+0000 7fdeb39f0700 1 -- 172.21.15.78:0/1297511515 wait complete. 2023-08-17T17:34:53.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.736+0000 7fdeb39f0700 1 Processor -- start 2023-08-17T17:34:53.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.736+0000 7fdeb39f0700 1 -- start start 2023-08-17T17:34:53.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb39f0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa0f0 0x7fdeac150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb39f0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac0aa4d0 0x7fdeac0c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb39f0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeac0c5810 0x7fdeac0c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb39f0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c24a0 con 0x7fdeac0c5810 2023-08-17T17:34:53.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb39f0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac158cd0 con 0x7fdeac0aa4d0 2023-08-17T17:34:53.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb39f0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c26a0 con 0x7fdeac0aa0f0 2023-08-17T17:34:53.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb1f8d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeac0c5810 0x7fdeac0c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb1f8d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeac0c5810 0x7fdeac0c1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34296/0 (socket says 172.21.15.78:34296) 2023-08-17T17:34:53.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb1f8d700 1 -- 172.21.15.78:0/3838170613 learned_addr learned my addr 172.21.15.78:0/3838170613 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:53.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb0f8b700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac0aa4d0 0x7fdeac0c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb178c700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa0f0 0x7fdeac150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb1f8d700 1 -- 172.21.15.78:0/3838170613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa0f0 msgr2=0x7fdeac150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb1f8d700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa0f0 0x7fdeac150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb1f8d700 1 -- 172.21.15.78:0/3838170613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac0aa4d0 msgr2=0x7fdeac0c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb1f8d700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac0aa4d0 0x7fdeac0c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb1f8d700 1 -- 172.21.15.78:0/3838170613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea4009a20 con 0x7fdeac0c5810 2023-08-17T17:34:53.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb1f8d700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeac0c5810 0x7fdeac0c1fb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fdea4009f20 tx=0x7fdea400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:53.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdea17fa700 1 -- 172.21.15.78:0/3838170613 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea400cc80 con 0x7fdeac0c5810 2023-08-17T17:34:53.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdea17fa700 1 -- 172.21.15.78:0/3838170613 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea400f040 con 0x7fdeac0c5810 2023-08-17T17:34:53.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb39f0700 1 -- 172.21.15.78:0/3838170613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c0092a0 con 0x7fdeac0c5810 2023-08-17T17:34:53.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdea17fa700 1 -- 172.21.15.78:0/3838170613 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea4013400 con 0x7fdeac0c5810 2023-08-17T17:34:53.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.737+0000 7fdeb39f0700 1 -- 172.21.15.78:0/3838170613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac0c2c60 con 0x7fdeac0c5810 2023-08-17T17:34:53.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.738+0000 7fdeb39f0700 1 -- 172.21.15.78:0/3838170613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac083980 con 0x7fdeac0c5810 2023-08-17T17:34:53.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.738+0000 7fdea17fa700 1 -- 172.21.15.78:0/3838170613 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdea40137f0 con 0x7fdeac0c5810 2023-08-17T17:34:53.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.739+0000 7fdea17fa700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde9005ed90 0x7fde90061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:53.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.739+0000 7fdea17fa700 1 -- 172.21.15.78:0/3838170613 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdea407a660 con 0x7fdeac0c5810 2023-08-17T17:34:53.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.739+0000 7fdeb178c700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde9005ed90 0x7fde90061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:53.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.739+0000 7fdeb178c700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde9005ed90 0x7fde90061250 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fdea80059e0 tx=0x7fdea8001470).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:53.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.743+0000 7fdea17fa700 1 -- 172.21.15.78:0/3838170613 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdea404bc00 con 0x7fdeac0c5810 2023-08-17T17:34:53.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.907+0000 7fdeb39f0700 1 -- 172.21.15.78:0/3838170613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdeac0cbd40 con 0x7fdeac0c5810 2023-08-17T17:34:53.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.907+0000 7fdea17fa700 1 -- 172.21.15.78:0/3838170613 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdea404f220 con 0x7fdeac0c5810 2023-08-17T17:34:53.909 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:53.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.909+0000 7fdeb39f0700 1 -- 172.21.15.78:0/3838170613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde9005ed90 msgr2=0x7fde90061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.909+0000 7fdeb39f0700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde9005ed90 0x7fde90061250 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fdea80059e0 tx=0x7fdea8001470).stop 2023-08-17T17:34:53.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.909+0000 7fdeb39f0700 1 -- 172.21.15.78:0/3838170613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeac0c5810 msgr2=0x7fdeac0c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:53.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.909+0000 7fdeb39f0700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeac0c5810 0x7fdeac0c1fb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fdea4009f20 tx=0x7fdea400b040).stop 2023-08-17T17:34:53.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.910+0000 7fdeb39f0700 1 -- 172.21.15.78:0/3838170613 shutdown_connections 2023-08-17T17:34:53.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.910+0000 7fdeb39f0700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde9005ed90 0x7fde90061250 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.910+0000 7fdeb39f0700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeac0c5810 0x7fdeac0c1fb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.910+0000 7fdeb39f0700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0aa0f0 0x7fdeac150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.910+0000 7fdeb39f0700 1 --2- 172.21.15.78:0/3838170613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac0aa4d0 0x7fdeac0c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:53.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.910+0000 7fdeb39f0700 1 -- 172.21.15.78:0/3838170613 >> 172.21.15.78:0/3838170613 conn(0x7fdeac06a6a0 msgr2=0x7fdeac1518b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:53.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.910+0000 7fdeb39f0700 1 -- 172.21.15.78:0/3838170613 shutdown_connections 2023-08-17T17:34:53.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:53.910+0000 7fdeb39f0700 1 -- 172.21.15.78:0/3838170613 wait complete. 2023-08-17T17:34:53.923 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:34:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.036+0000 7fe3db611700 1 Processor -- start 2023-08-17T17:34:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.036+0000 7fe3db611700 1 -- start start 2023-08-17T17:34:54.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3db611700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3d4062c00 0x7fe3d4069f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3db611700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3d41545e0 0x7fe3d4154a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3db611700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d4069b00 con 0x7fe3d413a740 2023-08-17T17:34:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3db611700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d4155640 con 0x7fe3d4062c00 2023-08-17T17:34:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3db611700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d413ab20 con 0x7fe3d41545e0 2023-08-17T17:34:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3d8bac700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3d4062c00 0x7fe3d4069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3d8bac700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3d4062c00 0x7fe3d4069f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34306/0 (socket says 172.21.15.78:34306) 2023-08-17T17:34:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3d8bac700 1 -- 172.21.15.78:0/2729463326 learned_addr learned my addr 172.21.15.78:0/2729463326 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3d9bae700 1 --2- 172.21.15.78:0/2729463326 >> v2:172.21.15.150:3300/0 conn(0x7fe3d41545e0 0x7fe3d4154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3d8bac700 1 -- 172.21.15.78:0/2729463326 >> v2:172.21.15.150:3300/0 conn(0x7fe3d41545e0 msgr2=0x7fe3d4154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3d8bac700 1 --2- 172.21.15.78:0/2729463326 >> v2:172.21.15.150:3300/0 conn(0x7fe3d41545e0 0x7fe3d4154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3d8bac700 1 -- 172.21.15.78:0/2729463326 >> v1:172.21.15.150:6789/0 conn(0x7fe3d413a740 legacy=0x7fe3d40624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.037+0000 7fe3d8bac700 1 -- 172.21.15.78:0/2729463326 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4155360 con 0x7fe3d4062c00 2023-08-17T17:34:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3d8bac700 1 --2- 172.21.15.78:0/2729463326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 0x7fe3d4069f90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fe3d4063130 tx=0x7fe3c80090f0).ready entity=mon.0 client_cookie=acf3c9983ea3cc88 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3d3fff700 1 -- 172.21.15.78:0/2729463326 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800b5a0 con 0x7fe3d4062c00 2023-08-17T17:34:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3d3fff700 1 -- 172.21.15.78:0/2729463326 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c800b700 con 0x7fe3d4062c00 2023-08-17T17:34:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3d3fff700 1 -- 172.21.15.78:0/2729463326 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800ba80 con 0x7fe3d4062c00 2023-08-17T17:34:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3db611700 1 -- 172.21.15.78:0/2729463326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 msgr2=0x7fe3d4069f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3db611700 1 --2- 172.21.15.78:0/2729463326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 0x7fe3d4069f90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fe3d4063130 tx=0x7fe3c80090f0).stop 2023-08-17T17:34:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3db611700 1 -- 172.21.15.78:0/2729463326 shutdown_connections 2023-08-17T17:34:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3db611700 1 --2- 172.21.15.78:0/2729463326 >> v2:172.21.15.150:3300/0 conn(0x7fe3d41545e0 0x7fe3d4154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3db611700 1 --2- 172.21.15.78:0/2729463326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 0x7fe3d4069f90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3db611700 1 -- 172.21.15.78:0/2729463326 >> 172.21.15.78:0/2729463326 conn(0x7fe3d40c7b80 msgr2=0x7fe3d40c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3db611700 1 -- 172.21.15.78:0/2729463326 shutdown_connections 2023-08-17T17:34:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.038+0000 7fe3db611700 1 -- 172.21.15.78:0/2729463326 wait complete. 2023-08-17T17:34:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.039+0000 7fe3db611700 1 Processor -- start 2023-08-17T17:34:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.039+0000 7fe3db611700 1 -- start start 2023-08-17T17:34:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.040+0000 7fe3db611700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 0x7fe3d41535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.040+0000 7fe3db611700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d413a740 0x7fe3d40ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.040+0000 7fe3db611700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d41545e0 0x7fe3d40a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.040+0000 7fe3db611700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40add20 con 0x7fe3d4062c00 2023-08-17T17:34:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.040+0000 7fe3db611700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40a71b0 con 0x7fe3d413a740 2023-08-17T17:34:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.040+0000 7fe3db611700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4153aa0 con 0x7fe3d41545e0 2023-08-17T17:34:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.040+0000 7fe3d93ad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 0x7fe3d41535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.040+0000 7fe3d93ad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 0x7fe3d41535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34316/0 (socket says 172.21.15.78:34316) 2023-08-17T17:34:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.040+0000 7fe3d93ad700 1 -- 172.21.15.78:0/3280661774 learned_addr learned my addr 172.21.15.78:0/3280661774 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d8bac700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d413a740 0x7fe3d40ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d9bae700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d41545e0 0x7fe3d40a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d93ad700 1 -- 172.21.15.78:0/3280661774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d41545e0 msgr2=0x7fe3d40a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d93ad700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d41545e0 0x7fe3d40a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d93ad700 1 -- 172.21.15.78:0/3280661774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d413a740 msgr2=0x7fe3d40ad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d93ad700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d413a740 0x7fe3d40ad5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d93ad700 1 -- 172.21.15.78:0/3280661774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009370 con 0x7fe3d4062c00 2023-08-17T17:34:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d9bae700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d41545e0 0x7fe3d40a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d8bac700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d413a740 0x7fe3d40ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d93ad700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 0x7fe3d41535b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fe3cc00c810 tx=0x7fe3cc0025e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d17fa700 1 -- 172.21.15.78:0/3280661774 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00a580 con 0x7fe3d4062c00 2023-08-17T17:34:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d17fa700 1 -- 172.21.15.78:0/3280661774 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00a700 con 0x7fe3d4062c00 2023-08-17T17:34:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3db611700 1 -- 172.21.15.78:0/3280661774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d41645c0 con 0x7fe3d4062c00 2023-08-17T17:34:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3d17fa700 1 -- 172.21.15.78:0/3280661774 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00aac0 con 0x7fe3d4062c00 2023-08-17T17:34:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.041+0000 7fe3db611700 1 -- 172.21.15.78:0/3280661774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d4165140 con 0x7fe3d4062c00 2023-08-17T17:34:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.042+0000 7fe3db611700 1 -- 172.21.15.78:0/3280661774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d4068270 con 0x7fe3d4062c00 2023-08-17T17:34:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.042+0000 7fe3d17fa700 1 -- 172.21.15.78:0/3280661774 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe3cc010070 con 0x7fe3d4062c00 2023-08-17T17:34:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.043+0000 7fe3d17fa700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3c005ed90 0x7fe3c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.043+0000 7fe3d17fa700 1 -- 172.21.15.78:0/3280661774 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe3cc079a20 con 0x7fe3d4062c00 2023-08-17T17:34:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.043+0000 7fe3d8bac700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3c005ed90 0x7fe3c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.043+0000 7fe3d8bac700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3c005ed90 0x7fe3c0061250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fe3d4063000 tx=0x7fe3c8015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.047+0000 7fe3d17fa700 1 -- 172.21.15.78:0/3280661774 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3cc04afc0 con 0x7fe3d4062c00 2023-08-17T17:34:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.207+0000 7fe3db611700 1 -- 172.21.15.78:0/3280661774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3d4165420 con 0x7fe3d4062c00 2023-08-17T17:34:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.207+0000 7fe3d17fa700 1 -- 172.21.15.78:0/3280661774 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3cc04e5e0 con 0x7fe3d4062c00 2023-08-17T17:34:54.209 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 -- 172.21.15.78:0/3280661774 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3c005ed90 msgr2=0x7fe3c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3c005ed90 0x7fe3c0061250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fe3d4063000 tx=0x7fe3c8015000).stop 2023-08-17T17:34:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 -- 172.21.15.78:0/3280661774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 msgr2=0x7fe3d41535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 0x7fe3d41535b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fe3cc00c810 tx=0x7fe3cc0025e0).stop 2023-08-17T17:34:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 -- 172.21.15.78:0/3280661774 shutdown_connections 2023-08-17T17:34:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3c005ed90 0x7fe3c0061250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d41545e0 0x7fe3d40a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3d4062c00 0x7fe3d41535b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 --2- 172.21.15.78:0/3280661774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d413a740 0x7fe3d40ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 -- 172.21.15.78:0/3280661774 >> 172.21.15.78:0/3280661774 conn(0x7fe3d40c7b80 msgr2=0x7fe3d4156a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 -- 172.21.15.78:0/3280661774 shutdown_connections 2023-08-17T17:34:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.209+0000 7fe3db611700 1 -- 172.21.15.78:0/3280661774 wait complete. 2023-08-17T17:34:54.232 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-08-17T17:34:54.233 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-17T17:34:54.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-08-17T17:34:54.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.345+0000 7fe3fda53700 1 Processor -- start 2023-08-17T17:34:54.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.345+0000 7fe3fda53700 1 -- start start 2023-08-17T17:34:54.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3fda53700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154140 0x7fe3f80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3fda53700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3f80c1010 0x7fe3f80ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3fda53700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f8154520 con 0x7fe3f80a7c40 2023-08-17T17:34:54.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3fda53700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f80c91e0 con 0x7fe3f80c1010 2023-08-17T17:34:54.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3fda53700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f80c94c0 con 0x7fe3f8154140 2023-08-17T17:34:54.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3f77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3f80c1010 0x7fe3f80ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3f77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3f80c1010 0x7fe3f80ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34326/0 (socket says 172.21.15.78:34326) 2023-08-17T17:34:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3f77fe700 1 -- 172.21.15.78:0/2367698774 learned_addr learned my addr 172.21.15.78:0/2367698774 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3effff700 1 --1- 172.21.15.78:0/2367698774 >> v1:172.21.15.78:6789/0 conn(0x7fe3f80a7c40 0x7fe3f80c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33120/0 (socket says 172.21.15.78:33120) 2023-08-17T17:34:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3f6ffd700 1 --2- 172.21.15.78:0/2367698774 >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154140 0x7fe3f80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3f77fe700 1 -- 172.21.15.78:0/2367698774 >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154140 msgr2=0x7fe3f80c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3f77fe700 1 --2- 172.21.15.78:0/2367698774 >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154140 0x7fe3f80c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3f77fe700 1 -- 172.21.15.78:0/2367698774 >> v1:172.21.15.78:6789/0 conn(0x7fe3f80a7c40 legacy=0x7fe3f80c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3f77fe700 1 -- 172.21.15.78:0/2367698774 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80c97a0 con 0x7fe3f80c1010 2023-08-17T17:34:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3f67fc700 1 -- 172.21.15.78:0/2367698774 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445201820 0 0) 0x7fe3f8154520 con 0x7fe3f80a7c40 2023-08-17T17:34:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.346+0000 7fe3f6ffd700 1 --2- 172.21.15.78:0/2367698774 >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154140 0x7fe3f80c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3f77fe700 1 --2- 172.21.15.78:0/2367698774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80c1010 0x7fe3f80ca280 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fe3f80625b0 tx=0x7fe3f0009840).ready entity=mon.0 client_cookie=56e80b045cb7dc8b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3f67fc700 1 -- 172.21.15.78:0/2367698774 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000e070 con 0x7fe3f80c1010 2023-08-17T17:34:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3f67fc700 1 -- 172.21.15.78:0/2367698774 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000ba50 con 0x7fe3f80c1010 2023-08-17T17:34:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3f67fc700 1 -- 172.21.15.78:0/2367698774 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000bdd0 con 0x7fe3f80c1010 2023-08-17T17:34:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3fda53700 1 -- 172.21.15.78:0/2367698774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80c1010 msgr2=0x7fe3f80ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3fda53700 1 --2- 172.21.15.78:0/2367698774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80c1010 0x7fe3f80ca280 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fe3f80625b0 tx=0x7fe3f0009840).stop 2023-08-17T17:34:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3fda53700 1 -- 172.21.15.78:0/2367698774 shutdown_connections 2023-08-17T17:34:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3fda53700 1 --2- 172.21.15.78:0/2367698774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80c1010 0x7fe3f80ca280 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3fda53700 1 --2- 172.21.15.78:0/2367698774 >> v2:172.21.15.150:3300/0 conn(0x7fe3f8154140 0x7fe3f80c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3fda53700 1 -- 172.21.15.78:0/2367698774 >> 172.21.15.78:0/2367698774 conn(0x7fe3f8094510 msgr2=0x7fe3f806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3fda53700 1 -- 172.21.15.78:0/2367698774 shutdown_connections 2023-08-17T17:34:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.347+0000 7fe3fda53700 1 -- 172.21.15.78:0/2367698774 wait complete. 2023-08-17T17:34:54.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.348+0000 7fe3fda53700 1 Processor -- start 2023-08-17T17:34:54.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.348+0000 7fe3fda53700 1 -- start start 2023-08-17T17:34:54.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3fda53700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80a7c40 0x7fe3f80c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3fda53700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3f80c1010 0x7fe3f814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3fda53700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3f8154140 0x7fe3f80ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3fda53700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80c49e0 con 0x7fe3f80a7c40 2023-08-17T17:34:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3fda53700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80c4550 con 0x7fe3f8154140 2023-08-17T17:34:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3fda53700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80c3940 con 0x7fe3f80c1010 2023-08-17T17:34:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3f6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80a7c40 0x7fe3f80c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3f6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80a7c40 0x7fe3f80c2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34334/0 (socket says 172.21.15.78:34334) 2023-08-17T17:34:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3f6ffd700 1 -- 172.21.15.78:0/1839644950 learned_addr learned my addr 172.21.15.78:0/1839644950 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3f77fe700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3f8154140 0x7fe3f80ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.349+0000 7fe3effff700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3f80c1010 0x7fe3f814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3f6ffd700 1 -- 172.21.15.78:0/1839644950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3f80c1010 msgr2=0x7fe3f814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:54.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3f6ffd700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3f80c1010 0x7fe3f814e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3f6ffd700 1 -- 172.21.15.78:0/1839644950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3f8154140 msgr2=0x7fe3f80ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:54.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3f6ffd700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3f8154140 0x7fe3f80ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:54.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3f6ffd700 1 -- 172.21.15.78:0/1839644950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f0009ae0 con 0x7fe3f80a7c40 2023-08-17T17:34:54.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3effff700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3f80c1010 0x7fe3f814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3f77fe700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3f8154140 0x7fe3f80ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3f6ffd700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80a7c40 0x7fe3f80c2f80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fe3e800c880 tx=0x7fe3e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3eeffd700 1 -- 172.21.15.78:0/1839644950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8010580 con 0x7fe3f80a7c40 2023-08-17T17:34:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3eeffd700 1 -- 172.21.15.78:0/1839644950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e80106e0 con 0x7fe3f80a7c40 2023-08-17T17:34:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3fda53700 1 -- 172.21.15.78:0/1839644950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f80c3c20 con 0x7fe3f80a7c40 2023-08-17T17:34:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3eeffd700 1 -- 172.21.15.78:0/1839644950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8010a60 con 0x7fe3f80a7c40 2023-08-17T17:34:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.350+0000 7fe3fda53700 1 -- 172.21.15.78:0/1839644950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f80c41e0 con 0x7fe3f80a7c40 2023-08-17T17:34:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.351+0000 7fe3fda53700 1 -- 172.21.15.78:0/1839644950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f80c4830 con 0x7fe3f80a7c40 2023-08-17T17:34:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.351+0000 7fe3eeffd700 1 -- 172.21.15.78:0/1839644950 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe3e801b460 con 0x7fe3f80a7c40 2023-08-17T17:34:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.351+0000 7fe3eeffd700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3d805ed90 0x7fe3d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.352+0000 7fe3eeffd700 1 -- 172.21.15.78:0/1839644950 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe3e8079cf0 con 0x7fe3f80a7c40 2023-08-17T17:34:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.352+0000 7fe3effff700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3d805ed90 0x7fe3d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.352+0000 7fe3effff700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3d805ed90 0x7fe3d8061250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe3f80b0fe0 tx=0x7fe3e0007cb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:54.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.356+0000 7fe3eeffd700 1 -- 172.21.15.78:0/1839644950 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3e804b230 con 0x7fe3f80a7c40 2023-08-17T17:34:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:54.583+0000 7fe3fda53700 1 -- 172.21.15.78:0/1839644950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fe3f8047350 con 0x7fe3f80a7c40 2023-08-17T17:34:55.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.288+0000 7fe3eeffd700 1 -- 172.21.15.78:0/1839644950 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe3e804e850 con 0x7fe3f80a7c40 2023-08-17T17:34:55.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 -- 172.21.15.78:0/1839644950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3d805ed90 msgr2=0x7fe3d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:55.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3d805ed90 0x7fe3d8061250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe3f80b0fe0 tx=0x7fe3e0007cb0).stop 2023-08-17T17:34:55.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 -- 172.21.15.78:0/1839644950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80a7c40 msgr2=0x7fe3f80c2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:55.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80a7c40 0x7fe3f80c2f80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fe3e800c880 tx=0x7fe3e8008040).stop 2023-08-17T17:34:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 -- 172.21.15.78:0/1839644950 shutdown_connections 2023-08-17T17:34:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe3d805ed90 0x7fe3d8061250 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3f8154140 0x7fe3f80ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f80a7c40 0x7fe3f80c2f80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 --2- 172.21.15.78:0/1839644950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3f80c1010 0x7fe3f814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 -- 172.21.15.78:0/1839644950 >> 172.21.15.78:0/1839644950 conn(0x7fe3f8094510 msgr2=0x7fe3f80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 -- 172.21.15.78:0/1839644950 shutdown_connections 2023-08-17T17:34:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.290+0000 7fe3fda53700 1 -- 172.21.15.78:0/1839644950 wait complete. 2023-08-17T17:34:55.304 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T17:34:55.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.420+0000 7fe52359e700 1 Processor -- start 2023-08-17T17:34:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.420+0000 7fe52359e700 1 -- start start 2023-08-17T17:34:55.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe524151a40 0x7fe5240c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:55.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52359e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5240c6620 con 0x7fe524157be0 2023-08-17T17:34:55.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5240c6900 con 0x7fe524151e20 2023-08-17T17:34:55.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240c6be0 con 0x7fe524151a40 2023-08-17T17:34:55.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe522d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe524157be0 0x7fe5240c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33128/0 (socket says 172.21.15.78:33128) 2023-08-17T17:34:55.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe522d9d700 1 -- 172.21.15.78:0/2536357806 learned_addr learned my addr 172.21.15.78:0/2536357806 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615184920 0 0) 0x7fe5240c6620 con 0x7fe524157be0 2023-08-17T17:34:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5100033f0 con 0x7fe524157be0 2023-08-17T17:34:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52259c700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe524151a40 0x7fe5240c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1582289454 0 0) 0x7fe5100033f0 con 0x7fe524157be0 2023-08-17T17:34:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe524151a40 msgr2=0x7fe5240c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52159a700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe524151a40 0x7fe5240c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.421+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 >> v1:172.21.15.150:6789/0 conn(0x7fe524151e20 legacy=0x7fe5240c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5240c6ec0 con 0x7fe524157be0 2023-08-17T17:34:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fe514001470 con 0x7fe524157be0 2023-08-17T17:34:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 >> v1:172.21.15.78:6789/0 conn(0x7fe524157be0 legacy=0x7fe5240c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe510003910 0x7fe510003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe524151a40 0x7fe510004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe510004b80 0x7fe510005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240c6be0 con 0x7fe510004b80 2023-08-17T17:34:55.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51000ba30 con 0x7fe510003910 2023-08-17T17:34:55.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51000bbf0 con 0x7fe524151a40 2023-08-17T17:34:55.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe522d9d700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe510004b80 0x7fe510005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:55.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52259c700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe510003910 0x7fe510003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:55.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe521d9b700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe524151a40 0x7fe510004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:55.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe522d9d700 1 -- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe524151a40 msgr2=0x7fe510004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:55.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe522d9d700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe524151a40 0x7fe510004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe522d9d700 1 -- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe510003910 msgr2=0x7fe510003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:55.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe522d9d700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe510003910 0x7fe510003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe522d9d700 1 -- 172.21.15.78:0/2536357806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100033f0 con 0x7fe510004b80 2023-08-17T17:34:55.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe522d9d700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe510004b80 0x7fe510005000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe51400c190 tx=0x7fe514001e50).ready entity=mon.0 client_cookie=3984306fc5000eac server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:55.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514007a20 con 0x7fe510004b80 2023-08-17T17:34:55.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51400cac0 con 0x7fe510004b80 2023-08-17T17:34:55.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.422+0000 7fe52159a700 1 -- 172.21.15.78:0/2536357806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51400ce40 con 0x7fe510004b80 2023-08-17T17:34:55.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.423+0000 7fe52359e700 1 -- 172.21.15.78:0/2536357806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe510004b80 msgr2=0x7fe510005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.423+0000 7fe52359e700 1 --2- 172.21.15.78:0/2536357806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe510004b80 0x7fe510005000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe51400c190 tx=0x7fe514001e50).stop 2023-08-17T17:34:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.423+0000 7fe522d9d700 1 -- 172.21.15.78:0/2536357806 reap_dead start 2023-08-17T17:34:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.423+0000 7fe52359e700 1 -- 172.21.15.78:0/2536357806 shutdown_connections 2023-08-17T17:34:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.423+0000 7fe52359e700 1 -- 172.21.15.78:0/2536357806 >> 172.21.15.78:0/2536357806 conn(0x7fe5240943b0 msgr2=0x7fe52406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.423+0000 7fe52359e700 1 -- 172.21.15.78:0/2536357806 shutdown_connections 2023-08-17T17:34:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.423+0000 7fe52359e700 1 -- 172.21.15.78:0/2536357806 wait complete. 2023-08-17T17:34:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.424+0000 7fe52359e700 1 Processor -- start 2023-08-17T17:34:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.424+0000 7fe52359e700 1 -- start start 2023-08-17T17:34:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe52359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe510004b80 0x7fe52413af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe52359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe52413b450 0x7fe5240acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe52359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240ad4b0 0x7fe5240ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe52359e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240acb30 con 0x7fe52413b450 2023-08-17T17:34:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe52359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240abf20 con 0x7fe510004b80 2023-08-17T17:34:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe52359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240ac200 con 0x7fe5240ad4b0 2023-08-17T17:34:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe521d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe52413b450 0x7fe5240acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe521d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe52413b450 0x7fe5240acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34350/0 (socket says 172.21.15.78:34350) 2023-08-17T17:34:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe521d9b700 1 -- 172.21.15.78:0/4161182532 learned_addr learned my addr 172.21.15.78:0/4161182532 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe522d9d700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240ad4b0 0x7fe5240ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe52259c700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe510004b80 0x7fe52413af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe521d9b700 1 -- 172.21.15.78:0/4161182532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240ad4b0 msgr2=0x7fe5240ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe521d9b700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240ad4b0 0x7fe5240ab3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe521d9b700 1 -- 172.21.15.78:0/4161182532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe510004b80 msgr2=0x7fe52413af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe521d9b700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe510004b80 0x7fe52413af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe521d9b700 1 -- 172.21.15.78:0/4161182532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5240ac4e0 con 0x7fe52413b450 2023-08-17T17:34:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe522d9d700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240ad4b0 0x7fe5240ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe521d9b700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe52413b450 0x7fe5240acfc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe52406bc50 tx=0x7fe50c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe51a7fc700 1 -- 172.21.15.78:0/4161182532 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c011590 con 0x7fe52413b450 2023-08-17T17:34:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe51a7fc700 1 -- 172.21.15.78:0/4161182532 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c0116f0 con 0x7fe52413b450 2023-08-17T17:34:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe51a7fc700 1 -- 172.21.15.78:0/4161182532 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c011ab0 con 0x7fe52413b450 2023-08-17T17:34:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe52359e700 1 -- 172.21.15.78:0/4161182532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5240ac7c0 con 0x7fe52413b450 2023-08-17T17:34:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.425+0000 7fe52359e700 1 -- 172.21.15.78:0/4161182532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5240ab8c0 con 0x7fe52413b450 2023-08-17T17:34:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.426+0000 7fe52359e700 1 -- 172.21.15.78:0/4161182532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5240acce0 con 0x7fe52413b450 2023-08-17T17:34:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.427+0000 7fe51a7fc700 1 -- 172.21.15.78:0/4161182532 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe50c01a030 con 0x7fe52413b450 2023-08-17T17:34:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.427+0000 7fe51a7fc700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe50405ed90 0x7fe504061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.427+0000 7fe51a7fc700 1 -- 172.21.15.78:0/4161182532 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe50c079500 con 0x7fe52413b450 2023-08-17T17:34:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.427+0000 7fe52259c700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe50405ed90 0x7fe504061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.427+0000 7fe52259c700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe50405ed90 0x7fe504061250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe51c009870 tx=0x7fe51c009740).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:55.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.431+0000 7fe51a7fc700 1 -- 172.21.15.78:0/4161182532 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe5240acce0 con 0x7fe52413b450 2023-08-17T17:34:55.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.598+0000 7fe52359e700 1 -- 172.21.15.78:0/4161182532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe524082f90 con 0x7fe52413b450 2023-08-17T17:34:55.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.601+0000 7fe51a7fc700 1 -- 172.21.15.78:0/4161182532 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe50c04aaa0 con 0x7fe52413b450 2023-08-17T17:34:55.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 -- 172.21.15.78:0/4161182532 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe50405ed90 msgr2=0x7fe504061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe50405ed90 0x7fe504061250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe51c009870 tx=0x7fe51c009740).stop 2023-08-17T17:34:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 -- 172.21.15.78:0/4161182532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe52413b450 msgr2=0x7fe5240acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe52413b450 0x7fe5240acfc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe52406bc50 tx=0x7fe50c007c00).stop 2023-08-17T17:34:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 -- 172.21.15.78:0/4161182532 shutdown_connections 2023-08-17T17:34:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe50405ed90 0x7fe504061250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240ad4b0 0x7fe5240ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe510004b80 0x7fe52413af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 --2- 172.21.15.78:0/4161182532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe52413b450 0x7fe5240acfc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 -- 172.21.15.78:0/4161182532 >> 172.21.15.78:0/4161182532 conn(0x7fe5240943b0 msgr2=0x7fe524157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 -- 172.21.15.78:0/4161182532 shutdown_connections 2023-08-17T17:34:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:55.603+0000 7fe52359e700 1 -- 172.21.15.78:0/4161182532 wait complete. 2023-08-17T17:34:55.616 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:34:55.617 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:34:55.655 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:34:55.700 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:34:55.701 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T17:34:55.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:34:55.701 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-17T17:34:55.733 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:34:55.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:55.734 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T17:34:55.789 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-17T17:34:55.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:34:55.789 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-08-17T17:34:55.827 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T17:34:55.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:55.828 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-17T17:34:55.884 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-08-17T17:34:55.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:34:55.885 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-08-17T17:34:55.920 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:34:55.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:55.920 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-17T17:34:55.975 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-08-17T17:34:55.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:34:55.975 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-08-17T17:34:56.013 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T17:34:56.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:34:56.014 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-17T17:34:56.069 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T17:34:56.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:34:56.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.180+0000 7f116da22700 1 Processor -- start 2023-08-17T17:34:56.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.180+0000 7f116da22700 1 -- start start 2023-08-17T17:34:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f116da22700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f11680a5f80 0x7f11681540e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f116da22700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680c18a0 0x7f11681545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f116da22700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1168068d40 con 0x7f11680a5ba0 2023-08-17T17:34:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f116da22700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11680693c0 con 0x7f11680a5f80 2023-08-17T17:34:56.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f116da22700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1168154fd0 con 0x7f11680c18a0 2023-08-17T17:34:56.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1166ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f11680a5ba0 0x7f1168069dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33130/0 (socket says 172.21.15.78:33130) 2023-08-17T17:34:56.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1166ffd700 1 -- 172.21.15.78:0/2621537181 learned_addr learned my addr 172.21.15.78:0/2621537181 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:56.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f11677fe700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680c18a0 0x7f11681545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f11667fc700 1 --2- 172.21.15.78:0/2621537181 >> v2:172.21.15.150:3300/0 conn(0x7f11680a5f80 0x7f11681540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165928704 0 0) 0x7f1168068d40 con 0x7f11680a5ba0 2023-08-17T17:34:56.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11500033f0 con 0x7f11680a5ba0 2023-08-17T17:34:56.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4255439333 0 0) 0x7f11500033f0 con 0x7f11680a5ba0 2023-08-17T17:34:56.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680c18a0 msgr2=0x7f11681545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:56.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680c18a0 0x7f11681545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 >> v2:172.21.15.150:3300/0 conn(0x7f11680a5f80 msgr2=0x7f11681540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:56.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 --2- 172.21.15.78:0/2621537181 >> v2:172.21.15.150:3300/0 conn(0x7f11680a5f80 0x7f11681540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680c1d60 con 0x7f11680a5ba0 2023-08-17T17:34:56.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f11600017f0 con 0x7f11680a5ba0 2023-08-17T17:34:56.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 >> v1:172.21.15.78:6789/0 conn(0x7f11680a5ba0 legacy=0x7f1168069dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 0x7f1150003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1150004690 0x7f1150004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680c18a0 0x7f1150005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680693c0 con 0x7f11500038e0 2023-08-17T17:34:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1168154fd0 con 0x7f1150004690 2023-08-17T17:34:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.181+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115000b8e0 con 0x7f11680c18a0 2023-08-17T17:34:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f1166ffd700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 0x7f1150003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f11667fc700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1150004690 0x7f1150004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f11677fe700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680c18a0 0x7f1150005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f1166ffd700 1 -- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680c18a0 msgr2=0x7f1150005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:56.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f1166ffd700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680c18a0 0x7f1150005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f1166ffd700 1 -- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1150004690 msgr2=0x7f1150004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:56.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f1166ffd700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1150004690 0x7f1150004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f1166ffd700 1 -- 172.21.15.78:0/2621537181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500033f0 con 0x7f11500038e0 2023-08-17T17:34:56.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f1166ffd700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 0x7f1150003d00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f116000c530 tx=0x7f1160002210).ready entity=mon.0 client_cookie=ceed30773062596 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:56.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160007de0 con 0x7f11500038e0 2023-08-17T17:34:56.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000ce60 con 0x7f11500038e0 2023-08-17T17:34:56.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.182+0000 7f1165ffb700 1 -- 172.21.15.78:0/2621537181 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160005d50 con 0x7f11500038e0 2023-08-17T17:34:56.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.183+0000 7f116da22700 1 -- 172.21.15.78:0/2621537181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 msgr2=0x7f1150003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.183+0000 7f116da22700 1 --2- 172.21.15.78:0/2621537181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 0x7f1150003d00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f116000c530 tx=0x7f1160002210).stop 2023-08-17T17:34:56.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.183+0000 7f11677fe700 1 -- 172.21.15.78:0/2621537181 reap_dead start 2023-08-17T17:34:56.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.183+0000 7f116da22700 1 -- 172.21.15.78:0/2621537181 shutdown_connections 2023-08-17T17:34:56.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.183+0000 7f116da22700 1 -- 172.21.15.78:0/2621537181 >> 172.21.15.78:0/2621537181 conn(0x7f1168062f70 msgr2=0x7f11680c6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:56.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.183+0000 7f116da22700 1 -- 172.21.15.78:0/2621537181 shutdown_connections 2023-08-17T17:34:56.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.183+0000 7f116da22700 1 -- 172.21.15.78:0/2621537181 wait complete. 2023-08-17T17:34:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.184+0000 7f116da22700 1 Processor -- start 2023-08-17T17:34:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.184+0000 7f116da22700 1 -- start start 2023-08-17T17:34:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f116da22700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 0x7f11680a7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f116da22700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680bf640 0x7f11680ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f116da22700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1168153e00 0x7f1168154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f116da22700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680c0780 con 0x7f11500038e0 2023-08-17T17:34:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f116da22700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1168154730 con 0x7f1168153e00 2023-08-17T17:34:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f116da22700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11680bfb00 con 0x7f11680bf640 2023-08-17T17:34:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 0x7f11680a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 0x7f11680a7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34374/0 (socket says 172.21.15.78:34374) 2023-08-17T17:34:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f1166ffd700 1 -- 172.21.15.78:0/1540367756 learned_addr learned my addr 172.21.15.78:0/1540367756 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f1166ffd700 1 -- 172.21.15.78:0/1540367756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680bf640 msgr2=0x7f11680ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f11667fc700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680bf640 0x7f11680ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f11677fe700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1168153e00 0x7f1168154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f1166ffd700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680bf640 0x7f11680ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f1166ffd700 1 -- 172.21.15.78:0/1540367756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1168153e00 msgr2=0x7f1168154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f1166ffd700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1168153e00 0x7f1168154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f1166ffd700 1 -- 172.21.15.78:0/1540367756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680bfde0 con 0x7f11500038e0 2023-08-17T17:34:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f11667fc700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680bf640 0x7f11680ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f11677fe700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1168153e00 0x7f1168154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f1166ffd700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 0x7f11680a7980 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f1160002250 tx=0x7f1160015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f114effd700 1 -- 172.21.15.78:0/1540367756 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600074f0 con 0x7f11500038e0 2023-08-17T17:34:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f114effd700 1 -- 172.21.15.78:0/1540367756 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1160007650 con 0x7f11500038e0 2023-08-17T17:34:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f116da22700 1 -- 172.21.15.78:0/1540367756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11680c00c0 con 0x7f11500038e0 2023-08-17T17:34:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f114effd700 1 -- 172.21.15.78:0/1540367756 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160007a10 con 0x7f11500038e0 2023-08-17T17:34:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.185+0000 7f116da22700 1 -- 172.21.15.78:0/1540367756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11680ac7c0 con 0x7f11500038e0 2023-08-17T17:34:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.186+0000 7f116da22700 1 -- 172.21.15.78:0/1540367756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11680673d0 con 0x7f11500038e0 2023-08-17T17:34:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.186+0000 7f114effd700 1 -- 172.21.15.78:0/1540367756 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1160010070 con 0x7f11500038e0 2023-08-17T17:34:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.187+0000 7f114effd700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f115405ed80 0x7f1154061240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.187+0000 7f114effd700 1 -- 172.21.15.78:0/1540367756 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1160019070 con 0x7f11500038e0 2023-08-17T17:34:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.187+0000 7f11667fc700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f115405ed80 0x7f1154061240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.187+0000 7f11667fc700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f115405ed80 0x7f1154061240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f115c006c40 tx=0x7f115c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.191+0000 7f114effd700 1 -- 172.21.15.78:0/1540367756 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f116004c390 con 0x7f11500038e0 2023-08-17T17:34:56.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.394+0000 7f116da22700 1 -- 172.21.15.78:0/1540367756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1168046af0 con 0x7f11500038e0 2023-08-17T17:34:56.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.395+0000 7f114effd700 1 -- 172.21.15.78:0/1540367756 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f1160026070 con 0x7f11500038e0 2023-08-17T17:34:56.396 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:56.397 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4150014676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4150014676},{"type":"v1","addr":"172.21.15.150:6834","nonce":4150014676}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1895700227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1895700227},{"type":"v1","addr":"172.21.15.150:6835","nonce":1895700227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3007671664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3007671664},{"type":"v1","addr":"172.21.15.78:6835","nonce":3007671664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:34:23.529472+0000","modified":"2023-08-17T17:34:25.535687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/2283193122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2283193122},{"type":"v1","addr":"172.21.15.78:6837","nonce":2283193122}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T17:34:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 -- 172.21.15.78:0/1540367756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f115405ed80 msgr2=0x7f1154061240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f115405ed80 0x7f1154061240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f115c006c40 tx=0x7f115c008040).stop 2023-08-17T17:34:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 -- 172.21.15.78:0/1540367756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 msgr2=0x7f11680a7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 0x7f11680a7980 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f1160002250 tx=0x7f1160015000).stop 2023-08-17T17:34:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 -- 172.21.15.78:0/1540367756 shutdown_connections 2023-08-17T17:34:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f115405ed80 0x7f1154061240 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1168153e00 0x7f1168154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11500038e0 0x7f11680a7980 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 --2- 172.21.15.78:0/1540367756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11680bf640 0x7f11680ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 -- 172.21.15.78:0/1540367756 >> 172.21.15.78:0/1540367756 conn(0x7f1168062f70 msgr2=0x7f11680c5150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.396+0000 7f116da22700 1 -- 172.21.15.78:0/1540367756 shutdown_connections 2023-08-17T17:34:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.397+0000 7f116da22700 1 -- 172.21.15.78:0/1540367756 wait complete. 2023-08-17T17:34:56.400 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2023-08-17T17:34:56.410 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:56.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.521+0000 7f6cebdde700 1 Processor -- start 2023-08-17T17:34:56.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.522+0000 7f6cebdde700 1 -- start start 2023-08-17T17:34:56.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.522+0000 7f6cebdde700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ce40a7fe0 0x7f6ce4064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6cebdde700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6ce4065140 0x7f6ce40c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6cebdde700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce40c4040 con 0x7f6ce40be7f0 2023-08-17T17:34:56.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6cebdde700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40c7080 con 0x7f6ce4065140 2023-08-17T17:34:56.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6cebdde700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40c3430 con 0x7f6ce40a7fe0 2023-08-17T17:34:56.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce9379700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6ce4065140 0x7f6ce40c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6cea37b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6ce40be7f0 0x7f6ce40c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33138/0 (socket says 172.21.15.78:33138) 2023-08-17T17:34:56.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6cea37b700 1 -- 172.21.15.78:0/1292605610 learned_addr learned my addr 172.21.15.78:0/1292605610 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:56.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce9b7a700 1 --2- 172.21.15.78:0/1292605610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ce40a7fe0 0x7f6ce4064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce9379700 1 -- 172.21.15.78:0/1292605610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ce40a7fe0 msgr2=0x7f6ce4064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:56.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce9379700 1 --2- 172.21.15.78:0/1292605610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ce40a7fe0 0x7f6ce4064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce9379700 1 -- 172.21.15.78:0/1292605610 >> v1:172.21.15.78:6789/0 conn(0x7f6ce40be7f0 legacy=0x7f6ce40c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce9379700 1 -- 172.21.15.78:0/1292605610 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40c3710 con 0x7f6ce4065140 2023-08-17T17:34:56.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce8b78700 1 -- 172.21.15.78:0/1292605610 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079725965 0 0) 0x7f6ce40c4040 con 0x7f6ce40be7f0 2023-08-17T17:34:56.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce9379700 1 --2- 172.21.15.78:0/1292605610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 0x7f6ce40c6b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f6cd4009760 tx=0x7f6cd4009060).ready entity=mon.0 client_cookie=2306696667ca50b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:56.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce8b78700 1 -- 172.21.15.78:0/1292605610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400b580 con 0x7f6ce4065140 2023-08-17T17:34:56.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce8b78700 1 -- 172.21.15.78:0/1292605610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd400b6e0 con 0x7f6ce4065140 2023-08-17T17:34:56.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.523+0000 7f6ce8b78700 1 -- 172.21.15.78:0/1292605610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400ba60 con 0x7f6ce4065140 2023-08-17T17:34:56.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.524+0000 7f6cebdde700 1 -- 172.21.15.78:0/1292605610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 msgr2=0x7f6ce40c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.524+0000 7f6cebdde700 1 --2- 172.21.15.78:0/1292605610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 0x7f6ce40c6b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f6cd4009760 tx=0x7f6cd4009060).stop 2023-08-17T17:34:56.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.524+0000 7f6cebdde700 1 -- 172.21.15.78:0/1292605610 shutdown_connections 2023-08-17T17:34:56.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.524+0000 7f6cebdde700 1 --2- 172.21.15.78:0/1292605610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ce40a7fe0 0x7f6ce4064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.524+0000 7f6cebdde700 1 --2- 172.21.15.78:0/1292605610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 0x7f6ce40c6b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.524+0000 7f6cebdde700 1 -- 172.21.15.78:0/1292605610 >> 172.21.15.78:0/1292605610 conn(0x7f6ce4092330 msgr2=0x7f6ce4062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:56.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.524+0000 7f6cebdde700 1 -- 172.21.15.78:0/1292605610 shutdown_connections 2023-08-17T17:34:56.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.524+0000 7f6cebdde700 1 -- 172.21.15.78:0/1292605610 wait complete. 2023-08-17T17:34:56.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.525+0000 7f6cebdde700 1 Processor -- start 2023-08-17T17:34:56.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.525+0000 7f6cebdde700 1 -- start start 2023-08-17T17:34:56.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cebdde700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 0x7f6ce41519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cebdde700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ce40a7fe0 0x7f6ce40a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cebdde700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ce40be7f0 0x7f6ce40a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cebdde700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40c07b0 con 0x7f6ce4065140 2023-08-17T17:34:56.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cebdde700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4151ed0 con 0x7f6ce40a7fe0 2023-08-17T17:34:56.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cebdde700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40a7580 con 0x7f6ce40be7f0 2023-08-17T17:34:56.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6ce9b7a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 0x7f6ce41519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6ce9b7a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 0x7f6ce41519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34406/0 (socket says 172.21.15.78:34406) 2023-08-17T17:34:56.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6ce9b7a700 1 -- 172.21.15.78:0/4040545323 learned_addr learned my addr 172.21.15.78:0/4040545323 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:56.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cea37b700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ce40be7f0 0x7f6ce40a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6ce9379700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ce40a7fe0 0x7f6ce40a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6ce9b7a700 1 -- 172.21.15.78:0/4040545323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ce40be7f0 msgr2=0x7f6ce40a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6ce9b7a700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ce40be7f0 0x7f6ce40a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6ce9b7a700 1 -- 172.21.15.78:0/4040545323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ce40a7fe0 msgr2=0x7f6ce40a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6ce9b7a700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ce40a7fe0 0x7f6ce40a7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6ce9b7a700 1 -- 172.21.15.78:0/4040545323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd40092a0 con 0x7f6ce4065140 2023-08-17T17:34:56.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6ce9b7a700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 0x7f6ce41519e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f6ce000d890 tx=0x7f6ce0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:56.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cd9ffb700 1 -- 172.21.15.78:0/4040545323 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00125f0 con 0x7f6ce4065140 2023-08-17T17:34:56.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cd9ffb700 1 -- 172.21.15.78:0/4040545323 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0012750 con 0x7f6ce4065140 2023-08-17T17:34:56.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cebdde700 1 -- 172.21.15.78:0/4040545323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce40ab180 con 0x7f6ce4065140 2023-08-17T17:34:56.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.526+0000 7f6cd9ffb700 1 -- 172.21.15.78:0/4040545323 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0012ad0 con 0x7f6ce4065140 2023-08-17T17:34:56.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.527+0000 7f6cebdde700 1 -- 172.21.15.78:0/4040545323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce40c0160 con 0x7f6ce4065140 2023-08-17T17:34:56.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.527+0000 7f6cebdde700 1 -- 172.21.15.78:0/4040545323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce4047350 con 0x7f6ce4065140 2023-08-17T17:34:56.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.528+0000 7f6cd9ffb700 1 -- 172.21.15.78:0/4040545323 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6ce0013480 con 0x7f6ce4065140 2023-08-17T17:34:56.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.528+0000 7f6cd9ffb700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6cc805ed60 0x7f6cc8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.528+0000 7f6cd9ffb700 1 -- 172.21.15.78:0/4040545323 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6ce0079a90 con 0x7f6ce4065140 2023-08-17T17:34:56.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.528+0000 7f6ce9379700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6cc805ed60 0x7f6cc8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.528+0000 7f6ce9379700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6cc805ed60 0x7f6cc8061220 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f6cd4009760 tx=0x7f6cd4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:56.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.532+0000 7f6cd9ffb700 1 -- 172.21.15.78:0/4040545323 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ce004afd0 con 0x7f6ce4065140 2023-08-17T17:34:56.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.695+0000 7f6cebdde700 1 -- 172.21.15.78:0/4040545323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ce40c0a90 con 0x7f6ce4065140 2023-08-17T17:34:56.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.696+0000 7f6cd9ffb700 1 -- 172.21.15.78:0/4040545323 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f6ce004e5f0 con 0x7f6ce4065140 2023-08-17T17:34:56.698 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:56.698 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:56.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 -- 172.21.15.78:0/4040545323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6cc805ed60 msgr2=0x7f6cc8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6cc805ed60 0x7f6cc8061220 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f6cd4009760 tx=0x7f6cd4017000).stop 2023-08-17T17:34:56.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 -- 172.21.15.78:0/4040545323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 msgr2=0x7f6ce41519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 0x7f6ce41519e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f6ce000d890 tx=0x7f6ce0008040).stop 2023-08-17T17:34:56.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 -- 172.21.15.78:0/4040545323 shutdown_connections 2023-08-17T17:34:56.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6cc805ed60 0x7f6cc8061220 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ce40be7f0 0x7f6ce40a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ce4065140 0x7f6ce41519e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 --2- 172.21.15.78:0/4040545323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ce40a7fe0 0x7f6ce40a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 -- 172.21.15.78:0/4040545323 >> 172.21.15.78:0/4040545323 conn(0x7f6ce4092330 msgr2=0x7f6ce4153780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:56.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 -- 172.21.15.78:0/4040545323 shutdown_connections 2023-08-17T17:34:56.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.698+0000 7f6cebdde700 1 -- 172.21.15.78:0/4040545323 wait complete. 2023-08-17T17:34:56.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:34:21.874660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:34:22.501817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:34:56.712 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:34:56.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.827+0000 7f8445e7a700 1 Processor -- start 2023-08-17T17:34:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.827+0000 7f8445e7a700 1 -- start start 2023-08-17T17:34:56.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8445e7a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8440151a40 0x7f84400c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8445e7a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440157be0 0x7f8440158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8445e7a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8440158560 con 0x7f8440151e20 2023-08-17T17:34:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8445e7a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84400c6620 con 0x7f8440151a40 2023-08-17T17:34:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8445e7a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84400c6900 con 0x7f8440157be0 2023-08-17T17:34:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f843ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8440151e20 0x7f84400c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33148/0 (socket says 172.21.15.78:33148) 2023-08-17T17:34:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f843ffff700 1 -- 172.21.15.78:0/685319962 learned_addr learned my addr 172.21.15.78:0/685319962 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8444e78700 1 --2- 172.21.15.78:0/685319962 >> v2:172.21.15.150:3300/0 conn(0x7f8440151a40 0x7f84400c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8445679700 1 --2- 172.21.15.78:0/685319962 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440157be0 0x7f8440158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f843f7fe700 1 -- 172.21.15.78:0/685319962 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673551175 0 0) 0x7f8440158560 con 0x7f8440151e20 2023-08-17T17:34:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f843f7fe700 1 -- 172.21.15.78:0/685319962 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84300033f0 con 0x7f8440151e20 2023-08-17T17:34:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8445679700 1 -- 172.21.15.78:0/685319962 >> v2:172.21.15.150:3300/0 conn(0x7f8440151a40 msgr2=0x7f84400c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8445679700 1 --2- 172.21.15.78:0/685319962 >> v2:172.21.15.150:3300/0 conn(0x7f8440151a40 0x7f84400c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8445679700 1 -- 172.21.15.78:0/685319962 >> v1:172.21.15.78:6789/0 conn(0x7f8440151e20 legacy=0x7f84400c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f843f7fe700 1 -- 172.21.15.78:0/685319962 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2381648284 0 0) 0x7f84300033f0 con 0x7f8440151e20 2023-08-17T17:34:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.828+0000 7f8445679700 1 -- 172.21.15.78:0/685319962 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400c6be0 con 0x7f8440157be0 2023-08-17T17:34:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f8445679700 1 --2- 172.21.15.78:0/685319962 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440157be0 0x7f8440158070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f8438009e60 tx=0x7f8438009780).ready entity=mon.2 client_cookie=d21f2992af4ba59 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f843f7fe700 1 -- 172.21.15.78:0/685319962 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800e070 con 0x7f8440157be0 2023-08-17T17:34:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f843f7fe700 1 -- 172.21.15.78:0/685319962 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843800b7a0 con 0x7f8440157be0 2023-08-17T17:34:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f843f7fe700 1 -- 172.21.15.78:0/685319962 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c0015f0 con 0x7f8440157be0 2023-08-17T17:34:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f8445e7a700 1 -- 172.21.15.78:0/685319962 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440157be0 msgr2=0x7f8440158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f8445e7a700 1 --2- 172.21.15.78:0/685319962 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440157be0 0x7f8440158070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f8438009e60 tx=0x7f8438009780).stop 2023-08-17T17:34:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f8445e7a700 1 -- 172.21.15.78:0/685319962 shutdown_connections 2023-08-17T17:34:56.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f8445e7a700 1 --2- 172.21.15.78:0/685319962 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440157be0 0x7f8440158070 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f8445e7a700 1 --2- 172.21.15.78:0/685319962 >> v2:172.21.15.150:3300/0 conn(0x7f8440151a40 0x7f84400c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f8445e7a700 1 -- 172.21.15.78:0/685319962 >> 172.21.15.78:0/685319962 conn(0x7f84400943b0 msgr2=0x7f844006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:56.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f8445e7a700 1 -- 172.21.15.78:0/685319962 shutdown_connections 2023-08-17T17:34:56.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.829+0000 7f8445e7a700 1 -- 172.21.15.78:0/685319962 wait complete. 2023-08-17T17:34:56.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.830+0000 7f8445e7a700 1 Processor -- start 2023-08-17T17:34:56.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.830+0000 7f8445e7a700 1 -- start start 2023-08-17T17:34:56.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f8445e7a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8440151a40 0x7f844014c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f8445e7a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440151e20 0x7f844014d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f8445e7a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8440157be0 0x7f84400a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f8445e7a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400c3cc0 con 0x7f8440157be0 2023-08-17T17:34:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f8445e7a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400abf20 con 0x7f8440151a40 2023-08-17T17:34:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f8445e7a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84400c3390 con 0x7f8440151e20 2023-08-17T17:34:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f8445679700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8440157be0 0x7f84400a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f8445679700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8440157be0 0x7f84400a8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34414/0 (socket says 172.21.15.78:34414) 2023-08-17T17:34:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f8445679700 1 -- 172.21.15.78:0/1870090487 learned_addr learned my addr 172.21.15.78:0/1870090487 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f8444e78700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8440151a40 0x7f844014c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.831+0000 7f843ffff700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440151e20 0x7f844014d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f8445679700 1 -- 172.21.15.78:0/1870090487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440151e20 msgr2=0x7f844014d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f8445679700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440151e20 0x7f844014d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f8445679700 1 -- 172.21.15.78:0/1870090487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8440151a40 msgr2=0x7f844014c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:56.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f8445679700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8440151a40 0x7f844014c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f8445679700 1 -- 172.21.15.78:0/1870090487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8438009a20 con 0x7f8440157be0 2023-08-17T17:34:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f8445679700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8440157be0 0x7f84400a8a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f843800b610 tx=0x7f8438009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f843cff9700 1 -- 172.21.15.78:0/1870090487 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843801d420 con 0x7f8440157be0 2023-08-17T17:34:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f843cff9700 1 -- 172.21.15.78:0/1870090487 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843801d580 con 0x7f8440157be0 2023-08-17T17:34:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f8445e7a700 1 -- 172.21.15.78:0/1870090487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84400c3670 con 0x7f8440157be0 2023-08-17T17:34:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f843cff9700 1 -- 172.21.15.78:0/1870090487 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843801d940 con 0x7f8440157be0 2023-08-17T17:34:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.832+0000 7f8445e7a700 1 -- 172.21.15.78:0/1870090487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844014ccc0 con 0x7f8440157be0 2023-08-17T17:34:56.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.833+0000 7f8445e7a700 1 -- 172.21.15.78:0/1870090487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8440082f90 con 0x7f8440157be0 2023-08-17T17:34:56.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.833+0000 7f843cff9700 1 -- 172.21.15.78:0/1870090487 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f843801dd30 con 0x7f8440157be0 2023-08-17T17:34:56.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.833+0000 7f843cff9700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f842405ed90 0x7f8424061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:56.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.833+0000 7f843cff9700 1 -- 172.21.15.78:0/1870090487 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f843807ba10 con 0x7f8440157be0 2023-08-17T17:34:56.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.834+0000 7f8444e78700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f842405ed90 0x7f8424061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:56.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.834+0000 7f8444e78700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f842405ed90 0x7f8424061250 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8434006fd0 tx=0x7f8434006f40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:56.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.838+0000 7f843cff9700 1 -- 172.21.15.78:0/1870090487 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f843804cfb0 con 0x7f8440157be0 2023-08-17T17:34:57.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.999+0000 7f8445e7a700 1 -- 172.21.15.78:0/1870090487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f844005f910 con 0x7f8440157be0 2023-08-17T17:34:57.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:56.999+0000 7f843cff9700 1 -- 172.21.15.78:0/1870090487 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8438009880 con 0x7f8440157be0 2023-08-17T17:34:57.001 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:34:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 -- 172.21.15.78:0/1870090487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f842405ed90 msgr2=0x7f8424061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f842405ed90 0x7f8424061250 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8434006fd0 tx=0x7f8434006f40).stop 2023-08-17T17:34:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 -- 172.21.15.78:0/1870090487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8440157be0 msgr2=0x7f84400a8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8440157be0 0x7f84400a8a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f843800b610 tx=0x7f8438009780).stop 2023-08-17T17:34:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 -- 172.21.15.78:0/1870090487 shutdown_connections 2023-08-17T17:34:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f842405ed90 0x7f8424061250 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8440157be0 0x7f84400a8a40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8440151a40 0x7f844014c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 --2- 172.21.15.78:0/1870090487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8440151e20 0x7f844014d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 -- 172.21.15.78:0/1870090487 >> 172.21.15.78:0/1870090487 conn(0x7f84400943b0 msgr2=0x7f8440063000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:57.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 -- 172.21.15.78:0/1870090487 shutdown_connections 2023-08-17T17:34:57.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.001+0000 7f8445e7a700 1 -- 172.21.15.78:0/1870090487 wait complete. 2023-08-17T17:34:57.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:34:57.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.128+0000 7fd3ac85e700 1 Processor -- start 2023-08-17T17:34:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.128+0000 7fd3ac85e700 1 -- start start 2023-08-17T17:34:57.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3ac85e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3a80aa4d0 0x7fd3a80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3ac85e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd3a80c5810 0x7fd3a80c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3ac85e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a80649b0 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3ac85e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a80c6150 con 0x7fd3a80c5810 2023-08-17T17:34:57.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3ac85e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a8063420 con 0x7fd3a80aa4d0 2023-08-17T17:34:57.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3a6d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd3a80c5810 0x7fd3a80c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3a6d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd3a80c5810 0x7fd3a80c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34428/0 (socket says 172.21.15.78:34428) 2023-08-17T17:34:57.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3a6d9d700 1 -- 172.21.15.78:0/256569453 learned_addr learned my addr 172.21.15.78:0/256569453 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:57.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3a5d9b700 1 --2- 172.21.15.78:0/256569453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3a80aa4d0 0x7fd3a80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3a6d9d700 1 -- 172.21.15.78:0/256569453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3a80aa4d0 msgr2=0x7fd3a80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:57.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3a6d9d700 1 --2- 172.21.15.78:0/256569453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3a80aa4d0 0x7fd3a80644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3a6d9d700 1 -- 172.21.15.78:0/256569453 >> v1:172.21.15.150:6789/0 conn(0x7fd3a80aa0f0 legacy=0x7fd3a80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:57.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3a6d9d700 1 -- 172.21.15.78:0/256569453 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8063700 con 0x7fd3a80c5810 2023-08-17T17:34:57.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3a6d9d700 1 --2- 172.21.15.78:0/256569453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80c5810 0x7fd3a80c5c60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fd398006fd0 tx=0x7fd3980090f0).ready entity=mon.0 client_cookie=edbf184a82aeeb0a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.129+0000 7fd3a559a700 1 -- 172.21.15.78:0/256569453 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39800b600 con 0x7fd3a80c5810 2023-08-17T17:34:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.130+0000 7fd3a559a700 1 -- 172.21.15.78:0/256569453 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39800b760 con 0x7fd3a80c5810 2023-08-17T17:34:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.130+0000 7fd3a559a700 1 -- 172.21.15.78:0/256569453 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39800bae0 con 0x7fd3a80c5810 2023-08-17T17:34:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.130+0000 7fd3ac85e700 1 -- 172.21.15.78:0/256569453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80c5810 msgr2=0x7fd3a80c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.130+0000 7fd3ac85e700 1 --2- 172.21.15.78:0/256569453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80c5810 0x7fd3a80c5c60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fd398006fd0 tx=0x7fd3980090f0).stop 2023-08-17T17:34:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.130+0000 7fd3ac85e700 1 -- 172.21.15.78:0/256569453 shutdown_connections 2023-08-17T17:34:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.130+0000 7fd3ac85e700 1 --2- 172.21.15.78:0/256569453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80c5810 0x7fd3a80c5c60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.130+0000 7fd3ac85e700 1 --2- 172.21.15.78:0/256569453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3a80aa4d0 0x7fd3a80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.130+0000 7fd3ac85e700 1 -- 172.21.15.78:0/256569453 >> 172.21.15.78:0/256569453 conn(0x7fd3a806a6a0 msgr2=0x7fd3a80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.130+0000 7fd3ac85e700 1 -- 172.21.15.78:0/256569453 shutdown_connections 2023-08-17T17:34:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.130+0000 7fd3ac85e700 1 -- 172.21.15.78:0/256569453 wait complete. 2023-08-17T17:34:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.131+0000 7fd3ac85e700 1 Processor -- start 2023-08-17T17:34:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.131+0000 7fd3ac85e700 1 -- start start 2023-08-17T17:34:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3ac85e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80aa0f0 0x7fd3a80c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3ac85e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a80aa4d0 0x7fd3a80c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3ac85e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3a80c5810 0x7fd3a8151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3ac85e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80c3540 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3ac85e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80ae390 con 0x7fd3a80aa4d0 2023-08-17T17:34:57.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3ac85e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80c2fc0 con 0x7fd3a80c5810 2023-08-17T17:34:57.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80aa0f0 0x7fd3a80c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80aa0f0 0x7fd3a80c2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34434/0 (socket says 172.21.15.78:34434) 2023-08-17T17:34:57.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a659c700 1 -- 172.21.15.78:0/856890080 learned_addr learned my addr 172.21.15.78:0/856890080 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:57.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a5d9b700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a80aa4d0 0x7fd3a80c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a6d9d700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3a80c5810 0x7fd3a8151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a659c700 1 -- 172.21.15.78:0/856890080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3a80c5810 msgr2=0x7fd3a8151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a659c700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3a80c5810 0x7fd3a8151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a659c700 1 -- 172.21.15.78:0/856890080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a80aa4d0 msgr2=0x7fd3a80c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a659c700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a80aa4d0 0x7fd3a80c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a659c700 1 -- 172.21.15.78:0/856890080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd398009370 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.132+0000 7fd3a659c700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80aa0f0 0x7fd3a80c2680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fd3a000b760 tx=0x7fd3a00092f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:57.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.133+0000 7fd39e7fc700 1 -- 172.21.15.78:0/856890080 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a000d4a0 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.133+0000 7fd39e7fc700 1 -- 172.21.15.78:0/856890080 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a000d640 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.133+0000 7fd3ac85e700 1 -- 172.21.15.78:0/856890080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a80c3260 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.133+0000 7fd39e7fc700 1 -- 172.21.15.78:0/856890080 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a000da00 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.133+0000 7fd3ac85e700 1 -- 172.21.15.78:0/856890080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a80c2b70 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.133+0000 7fd3ac85e700 1 -- 172.21.15.78:0/856890080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a80ae1e0 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.134+0000 7fd39e7fc700 1 -- 172.21.15.78:0/856890080 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd3a0018030 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.134+0000 7fd39e7fc700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd38805ed90 0x7fd388061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.134+0000 7fd39e7fc700 1 -- 172.21.15.78:0/856890080 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd3a0079250 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.134+0000 7fd3a5d9b700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd38805ed90 0x7fd388061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.134+0000 7fd3a5d9b700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd38805ed90 0x7fd388061250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd3a80a9da0 tx=0x7fd390008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:57.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.138+0000 7fd39e7fc700 1 -- 172.21.15.78:0/856890080 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd3a00478f0 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.302+0000 7fd3ac85e700 1 -- 172.21.15.78:0/856890080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd3a8046af0 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.302+0000 7fd39e7fc700 1 -- 172.21.15.78:0/856890080 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd3a004a8a0 con 0x7fd3a80aa0f0 2023-08-17T17:34:57.304 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:34:57.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 -- 172.21.15.78:0/856890080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd38805ed90 msgr2=0x7fd388061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd38805ed90 0x7fd388061250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd3a80a9da0 tx=0x7fd390008040).stop 2023-08-17T17:34:57.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 -- 172.21.15.78:0/856890080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80aa0f0 msgr2=0x7fd3a80c2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80aa0f0 0x7fd3a80c2680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fd3a000b760 tx=0x7fd3a00092f0).stop 2023-08-17T17:34:57.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 -- 172.21.15.78:0/856890080 shutdown_connections 2023-08-17T17:34:57.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd38805ed90 0x7fd388061250 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3a80c5810 0x7fd3a8151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3a80aa0f0 0x7fd3a80c2680 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 --2- 172.21.15.78:0/856890080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3a80aa4d0 0x7fd3a80c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 -- 172.21.15.78:0/856890080 >> 172.21.15.78:0/856890080 conn(0x7fd3a806a6a0 msgr2=0x7fd3a80a8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:57.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 -- 172.21.15.78:0/856890080 shutdown_connections 2023-08-17T17:34:57.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.304+0000 7fd3ac85e700 1 -- 172.21.15.78:0/856890080 wait complete. 2023-08-17T17:34:57.317 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:34:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.431+0000 7f81a042e700 1 Processor -- start 2023-08-17T17:34:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.431+0000 7f81a042e700 1 -- start start 2023-08-17T17:34:57.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f81a042e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f819813b890 0x7f8198155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f81a042e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 0x7f81981561c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f81a042e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81980a5a20 con 0x7f81981566b0 2023-08-17T17:34:57.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f81a042e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81980c32d0 con 0x7f819813b890 2023-08-17T17:34:57.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f81a042e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81980c3570 con 0x7f819813bc70 2023-08-17T17:34:57.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f819e1ca700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f819813b890 0x7f8198155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f819e1ca700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f819813b890 0x7f8198155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34440/0 (socket says 172.21.15.78:34440) 2023-08-17T17:34:57.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f819e1ca700 1 -- 172.21.15.78:0/2934411725 learned_addr learned my addr 172.21.15.78:0/2934411725 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:57.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f819d9c9700 1 --2- 172.21.15.78:0/2934411725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 0x7f81981561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f819e1ca700 1 -- 172.21.15.78:0/2934411725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 msgr2=0x7f81981561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:57.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f819e1ca700 1 --2- 172.21.15.78:0/2934411725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 0x7f81981561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f819e1ca700 1 -- 172.21.15.78:0/2934411725 >> v1:172.21.15.150:6789/0 conn(0x7f81981566b0 legacy=0x7f81980c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f819e1ca700 1 -- 172.21.15.78:0/2934411725 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8198156b60 con 0x7f819813b890 2023-08-17T17:34:57.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.432+0000 7f819d9c9700 1 --2- 172.21.15.78:0/2934411725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 0x7f81981561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:57.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f819e1ca700 1 --2- 172.21.15.78:0/2934411725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 0x7f8198155cd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f8190009f20 tx=0x7f8190009840).ready entity=mon.0 client_cookie=76ad046a57478843 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:57.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f819d1c8700 1 -- 172.21.15.78:0/2934411725 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000e070 con 0x7f819813b890 2023-08-17T17:34:57.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f819d1c8700 1 -- 172.21.15.78:0/2934411725 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819000ba80 con 0x7f819813b890 2023-08-17T17:34:57.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f819d1c8700 1 -- 172.21.15.78:0/2934411725 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000be00 con 0x7f819813b890 2023-08-17T17:34:57.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f81a042e700 1 -- 172.21.15.78:0/2934411725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 msgr2=0x7f8198155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f81a042e700 1 --2- 172.21.15.78:0/2934411725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 0x7f8198155cd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f8190009f20 tx=0x7f8190009840).stop 2023-08-17T17:34:57.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f81a042e700 1 -- 172.21.15.78:0/2934411725 shutdown_connections 2023-08-17T17:34:57.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f81a042e700 1 --2- 172.21.15.78:0/2934411725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 0x7f8198155cd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f81a042e700 1 --2- 172.21.15.78:0/2934411725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 0x7f81981561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f81a042e700 1 -- 172.21.15.78:0/2934411725 >> 172.21.15.78:0/2934411725 conn(0x7f8198062f80 msgr2=0x7f81980c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:57.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f81a042e700 1 -- 172.21.15.78:0/2934411725 shutdown_connections 2023-08-17T17:34:57.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.433+0000 7f81a042e700 1 -- 172.21.15.78:0/2934411725 wait complete. 2023-08-17T17:34:57.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.434+0000 7f81a042e700 1 Processor -- start 2023-08-17T17:34:57.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.434+0000 7f81a042e700 1 -- start start 2023-08-17T17:34:57.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f81a042e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 0x7f8198137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f81a042e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 0x7f81980a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f81a042e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81981566b0 0x7f8198095e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f81a042e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8198153d10 con 0x7f819813b890 2023-08-17T17:34:57.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f81a042e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81980a9e50 con 0x7f81981566b0 2023-08-17T17:34:57.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f81a042e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8198153fd0 con 0x7f819813bc70 2023-08-17T17:34:57.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f819e1ca700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 0x7f8198137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f819e1ca700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 0x7f8198137cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34448/0 (socket says 172.21.15.78:34448) 2023-08-17T17:34:57.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f819e1ca700 1 -- 172.21.15.78:0/1357791608 learned_addr learned my addr 172.21.15.78:0/1357791608 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:57.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f819d9c9700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 0x7f81980a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.435+0000 7f819e9cb700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81981566b0 0x7f8198095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f819e1ca700 1 -- 172.21.15.78:0/1357791608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 msgr2=0x7f81980a8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f819e1ca700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 0x7f81980a8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f819e1ca700 1 -- 172.21.15.78:0/1357791608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81981566b0 msgr2=0x7f8198095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f819e1ca700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81981566b0 0x7f8198095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f819e1ca700 1 -- 172.21.15.78:0/1357791608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190009ae0 con 0x7f819813b890 2023-08-17T17:34:57.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f819e9cb700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81981566b0 0x7f8198095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:57.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f819e1ca700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 0x7f8198137cf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f81900072d0 tx=0x7f8190009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:57.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f818e7fc700 1 -- 172.21.15.78:0/1357791608 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190013c20 con 0x7f819813b890 2023-08-17T17:34:57.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f818e7fc700 1 -- 172.21.15.78:0/1357791608 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8190013d80 con 0x7f819813b890 2023-08-17T17:34:57.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f81a042e700 1 -- 172.21.15.78:0/1357791608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81980a95b0 con 0x7f819813b890 2023-08-17T17:34:57.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f818e7fc700 1 -- 172.21.15.78:0/1357791608 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819001e6c0 con 0x7f819813b890 2023-08-17T17:34:57.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.436+0000 7f81a042e700 1 -- 172.21.15.78:0/1357791608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81980a9b70 con 0x7f819813b890 2023-08-17T17:34:57.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.437+0000 7f81a042e700 1 -- 172.21.15.78:0/1357791608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81980695e0 con 0x7f819813b890 2023-08-17T17:34:57.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.437+0000 7f818e7fc700 1 -- 172.21.15.78:0/1357791608 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8190025030 con 0x7f819813b890 2023-08-17T17:34:57.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.437+0000 7f818e7fc700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f817c05edc0 0x7f817c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.438+0000 7f818e7fc700 1 -- 172.21.15.78:0/1357791608 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f819007b120 con 0x7f819813b890 2023-08-17T17:34:57.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.438+0000 7f819d9c9700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f817c05edc0 0x7f817c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.438+0000 7f819d9c9700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f817c05edc0 0x7f817c061280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8198167af0 tx=0x7f8188008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:57.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.442+0000 7f818e7fc700 1 -- 172.21.15.78:0/1357791608 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f819004c6c0 con 0x7f819813b890 2023-08-17T17:34:57.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.604+0000 7f81a042e700 1 -- 172.21.15.78:0/1357791608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8198046af0 con 0x7f819813b890 2023-08-17T17:34:57.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.605+0000 7f818e7fc700 1 -- 172.21.15.78:0/1357791608 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8190023020 con 0x7f819813b890 2023-08-17T17:34:57.606 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:57.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 -- 172.21.15.78:0/1357791608 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f817c05edc0 msgr2=0x7f817c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f817c05edc0 0x7f817c061280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8198167af0 tx=0x7f8188008040).stop 2023-08-17T17:34:57.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 -- 172.21.15.78:0/1357791608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 msgr2=0x7f8198137cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 0x7f8198137cf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f81900072d0 tx=0x7f8190009840).stop 2023-08-17T17:34:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 -- 172.21.15.78:0/1357791608 shutdown_connections 2023-08-17T17:34:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f817c05edc0 0x7f817c061280 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81981566b0 0x7f8198095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f819813b890 0x7f8198137cf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 --2- 172.21.15.78:0/1357791608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819813bc70 0x7f81980a8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 -- 172.21.15.78:0/1357791608 >> 172.21.15.78:0/1357791608 conn(0x7f8198062f80 msgr2=0x7f81981391f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.606+0000 7f81a042e700 1 -- 172.21.15.78:0/1357791608 shutdown_connections 2023-08-17T17:34:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.607+0000 7f81a042e700 1 -- 172.21.15.78:0/1357791608 wait complete. 2023-08-17T17:34:57.619 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:34:57.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.734+0000 7f3f01ade700 1 Processor -- start 2023-08-17T17:34:57.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.734+0000 7f3f01ade700 1 -- start start 2023-08-17T17:34:57.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.734+0000 7f3f01ade700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3efc069a20 0x7f3efc15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.734+0000 7f3f01ade700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc0c5990 con 0x7f3efc14e680 2023-08-17T17:34:57.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.734+0000 7f3f01ade700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc0bcc10 con 0x7f3efc14ea60 2023-08-17T17:34:57.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.734+0000 7f3f01ade700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc0c4120 con 0x7f3efc069a20 2023-08-17T17:34:57.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efb7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3efc14e680 0x7f3efc0c2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33156/0 (socket says 172.21.15.78:33156) 2023-08-17T17:34:57.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efb7fe700 1 -- 172.21.15.78:0/1206347561 learned_addr learned my addr 172.21.15.78:0/1206347561 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:57.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efbfff700 1 --2- 172.21.15.78:0/1206347561 >> v2:172.21.15.150:3300/0 conn(0x7f3efc069a20 0x7f3efc15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617869793 0 0) 0x7f3efc0c5990 con 0x7f3efc14e680 2023-08-17T17:34:57.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee40033f0 con 0x7f3efc14e680 2023-08-17T17:34:57.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1456454175 0 0) 0x7f3ee40033f0 con 0x7f3efc14e680 2023-08-17T17:34:57.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 >> v2:172.21.15.150:3300/0 conn(0x7f3efc069a20 msgr2=0x7f3efc15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:57.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 --2- 172.21.15.78:0/1206347561 >> v2:172.21.15.150:3300/0 conn(0x7f3efc069a20 0x7f3efc15bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 >> v1:172.21.15.150:6789/0 conn(0x7f3efc14ea60 legacy=0x7f3efc069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0c3880 con 0x7f3efc14e680 2023-08-17T17:34:57.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3eec0017f0 con 0x7f3efc14e680 2023-08-17T17:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 >> v1:172.21.15.78:6789/0 conn(0x7f3efc14e680 legacy=0x7f3efc0c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee40038e0 0x7f3ee4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee4004690 0x7f3ee4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4005000 0x7f3ee400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0c4120 con 0x7f3ee40038e0 2023-08-17T17:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee400beb0 con 0x7f3ee4005000 2023-08-17T17:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee400c070 con 0x7f3ee4004690 2023-08-17T17:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efb7fe700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee40038e0 0x7f3ee4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efaffd700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee4004690 0x7f3ee4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efbfff700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4005000 0x7f3ee400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efb7fe700 1 -- 172.21.15.78:0/1206347561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee4004690 msgr2=0x7f3ee4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efb7fe700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee4004690 0x7f3ee4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efb7fe700 1 -- 172.21.15.78:0/1206347561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4005000 msgr2=0x7f3ee400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efb7fe700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4005000 0x7f3ee400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efb7fe700 1 -- 172.21.15.78:0/1206347561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40033f0 con 0x7f3ee40038e0 2023-08-17T17:34:57.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.735+0000 7f3efbfff700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4005000 0x7f3ee400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:57.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3efbfff700 1 -- 172.21.15.78:0/1206347561 reap_dead start 2023-08-17T17:34:57.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3efb7fe700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee40038e0 0x7f3ee4003d00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f3eec00c5f0 tx=0x7f3efc1512d0).ready entity=mon.0 client_cookie=2b1916fbcc0406b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:57.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec00cdf0 con 0x7f3ee40038e0 2023-08-17T17:34:57.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec005b20 con 0x7f3ee40038e0 2023-08-17T17:34:57.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3efa7fc700 1 -- 172.21.15.78:0/1206347561 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec005ea0 con 0x7f3ee40038e0 2023-08-17T17:34:57.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3f01ade700 1 -- 172.21.15.78:0/1206347561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee40038e0 msgr2=0x7f3ee4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3f01ade700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee40038e0 0x7f3ee4003d00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f3eec00c5f0 tx=0x7f3efc1512d0).stop 2023-08-17T17:34:57.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3f01ade700 1 -- 172.21.15.78:0/1206347561 shutdown_connections 2023-08-17T17:34:57.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3f01ade700 1 --2- 172.21.15.78:0/1206347561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee40038e0 0x7f3ee4003d00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3f01ade700 1 -- 172.21.15.78:0/1206347561 >> 172.21.15.78:0/1206347561 conn(0x7f3efc0c7b80 msgr2=0x7f3efc0c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:57.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3f01ade700 1 -- 172.21.15.78:0/1206347561 shutdown_connections 2023-08-17T17:34:57.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.736+0000 7f3f01ade700 1 -- 172.21.15.78:0/1206347561 wait complete. 2023-08-17T17:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.737+0000 7f3f01ade700 1 Processor -- start 2023-08-17T17:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3f01ade700 1 -- start start 2023-08-17T17:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3f01ade700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee40038e0 0x7f3efc0bf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3f01ade700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3efc0befe0 0x7f3efc160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3f01ade700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3efc160850 0x7f3efc14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3f01ade700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc150d10 con 0x7f3efc160850 2023-08-17T17:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3f01ade700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc141d00 con 0x7f3efc0befe0 2023-08-17T17:34:57.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3f01ade700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0bfc50 con 0x7f3ee40038e0 2023-08-17T17:34:57.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3efbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3efc160850 0x7f3efc14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3efbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3efc160850 0x7f3efc14eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34470/0 (socket says 172.21.15.78:34470) 2023-08-17T17:34:57.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3efbfff700 1 -- 172.21.15.78:0/4289355613 learned_addr learned my addr 172.21.15.78:0/4289355613 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:57.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3efb7fe700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee40038e0 0x7f3efc0bf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.738+0000 7f3efaffd700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3efc0befe0 0x7f3efc160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3efbfff700 1 -- 172.21.15.78:0/4289355613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee40038e0 msgr2=0x7f3efc0bf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3efbfff700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee40038e0 0x7f3efc0bf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3efbfff700 1 -- 172.21.15.78:0/4289355613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3efc0befe0 msgr2=0x7f3efc160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3efbfff700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3efc0befe0 0x7f3efc160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3efbfff700 1 -- 172.21.15.78:0/4289355613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0bf460 con 0x7f3efc160850 2023-08-17T17:34:57.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3efaffd700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3efc0befe0 0x7f3efc160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:57.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3efbfff700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3efc160850 0x7f3efc14eee0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f3efc06a790 tx=0x7f3ef4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:57.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3ee37fe700 1 -- 172.21.15.78:0/4289355613 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4015440 con 0x7f3efc160850 2023-08-17T17:34:57.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3ee37fe700 1 -- 172.21.15.78:0/4289355613 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef40155a0 con 0x7f3efc160850 2023-08-17T17:34:57.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3f01ade700 1 -- 172.21.15.78:0/4289355613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc1413d0 con 0x7f3efc160850 2023-08-17T17:34:57.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3ee37fe700 1 -- 172.21.15.78:0/4289355613 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4015920 con 0x7f3efc160850 2023-08-17T17:34:57.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.739+0000 7f3f01ade700 1 -- 172.21.15.78:0/4289355613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc141990 con 0x7f3efc160850 2023-08-17T17:34:57.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.740+0000 7f3f01ade700 1 -- 172.21.15.78:0/4289355613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc068270 con 0x7f3efc160850 2023-08-17T17:34:57.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.740+0000 7f3ee37fe700 1 -- 172.21.15.78:0/4289355613 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3ef401d030 con 0x7f3efc160850 2023-08-17T17:34:57.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.740+0000 7f3ee37fe700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ee805ed90 0x7f3ee8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:57.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.741+0000 7f3ee37fe700 1 -- 172.21.15.78:0/4289355613 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3ef40793e0 con 0x7f3efc160850 2023-08-17T17:34:57.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.741+0000 7f3efb7fe700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ee805ed90 0x7f3ee8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:57.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.741+0000 7f3efb7fe700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ee805ed90 0x7f3ee8061250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3eec001e10 tx=0x7f3eec015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:57.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.744+0000 7f3ee37fe700 1 -- 172.21.15.78:0/4289355613 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ef404aa30 con 0x7f3efc160850 2023-08-17T17:34:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.906+0000 7f3f01ade700 1 -- 172.21.15.78:0/4289355613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3efc046af0 con 0x7f3efc160850 2023-08-17T17:34:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.907+0000 7f3ee37fe700 1 -- 172.21.15.78:0/4289355613 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ef404e050 con 0x7f3efc160850 2023-08-17T17:34:57.909 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:34:57.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 -- 172.21.15.78:0/4289355613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ee805ed90 msgr2=0x7f3ee8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ee805ed90 0x7f3ee8061250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3eec001e10 tx=0x7f3eec015000).stop 2023-08-17T17:34:57.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 -- 172.21.15.78:0/4289355613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3efc160850 msgr2=0x7f3efc14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:57.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3efc160850 0x7f3efc14eee0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f3efc06a790 tx=0x7f3ef4008040).stop 2023-08-17T17:34:57.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 -- 172.21.15.78:0/4289355613 shutdown_connections 2023-08-17T17:34:57.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ee805ed90 0x7f3ee8061250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3efc160850 0x7f3efc14eee0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee40038e0 0x7f3efc0bf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 --2- 172.21.15.78:0/4289355613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3efc0befe0 0x7f3efc160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:57.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 -- 172.21.15.78:0/4289355613 >> 172.21.15.78:0/4289355613 conn(0x7f3efc0c7b80 msgr2=0x7f3efc065cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:57.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 -- 172.21.15.78:0/4289355613 shutdown_connections 2023-08-17T17:34:57.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:57.909+0000 7f3f01ade700 1 -- 172.21.15.78:0/4289355613 wait complete. 2023-08-17T17:34:57.922 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:34:58.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.034+0000 7f1032221700 1 Processor -- start 2023-08-17T17:34:58.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.034+0000 7f1032221700 1 -- start start 2023-08-17T17:34:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.035+0000 7f1032221700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c1553c0 0x7f102c069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.035+0000 7f1032221700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f102c0c1f10 0x7f102c067f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.035+0000 7f1032221700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f102c068430 0x7f102c0644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.035+0000 7f1032221700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102c069480 con 0x7f102c068430 2023-08-17T17:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.035+0000 7f1032221700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102c0a65a0 con 0x7f102c0c1f10 2023-08-17T17:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.035+0000 7f1032221700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0c2d20 con 0x7f102c1553c0 2023-08-17T17:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.035+0000 7f102bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f102c068430 0x7f102c0644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f102c068430 0x7f102c0644d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34486/0 (socket says 172.21.15.78:34486) 2023-08-17T17:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102bfff700 1 -- 172.21.15.78:0/2988393732 learned_addr learned my addr 172.21.15.78:0/2988393732 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102b7fe700 1 --2- 172.21.15.78:0/2988393732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c1553c0 0x7f102c069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102affd700 1 --2- 172.21.15.78:0/2988393732 >> v2:172.21.15.150:3300/0 conn(0x7f102c0c1f10 0x7f102c067f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102bfff700 1 -- 172.21.15.78:0/2988393732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c1553c0 msgr2=0x7f102c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102bfff700 1 --2- 172.21.15.78:0/2988393732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c1553c0 0x7f102c069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102bfff700 1 -- 172.21.15.78:0/2988393732 >> v2:172.21.15.150:3300/0 conn(0x7f102c0c1f10 msgr2=0x7f102c067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102bfff700 1 --2- 172.21.15.78:0/2988393732 >> v2:172.21.15.150:3300/0 conn(0x7f102c0c1f10 0x7f102c067f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102bfff700 1 -- 172.21.15.78:0/2988393732 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c064040 con 0x7f102c068430 2023-08-17T17:34:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102b7fe700 1 --2- 172.21.15.78:0/2988393732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c1553c0 0x7f102c069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102bfff700 1 --2- 172.21.15.78:0/2988393732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 0x7f102c0644d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f102c0c44a0 tx=0x7f1024009840).ready entity=mon.0 client_cookie=4359dd16741db7b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102a7fc700 1 -- 172.21.15.78:0/2988393732 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400e070 con 0x7f102c068430 2023-08-17T17:34:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102a7fc700 1 -- 172.21.15.78:0/2988393732 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102400ba50 con 0x7f102c068430 2023-08-17T17:34:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f102a7fc700 1 -- 172.21.15.78:0/2988393732 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400bdd0 con 0x7f102c068430 2023-08-17T17:34:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f1032221700 1 -- 172.21.15.78:0/2988393732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 msgr2=0x7f102c0644d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.036+0000 7f1032221700 1 --2- 172.21.15.78:0/2988393732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 0x7f102c0644d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f102c0c44a0 tx=0x7f1024009840).stop 2023-08-17T17:34:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.037+0000 7f1032221700 1 -- 172.21.15.78:0/2988393732 shutdown_connections 2023-08-17T17:34:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.037+0000 7f1032221700 1 --2- 172.21.15.78:0/2988393732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 0x7f102c0644d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.037+0000 7f1032221700 1 --2- 172.21.15.78:0/2988393732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c1553c0 0x7f102c069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.037+0000 7f1032221700 1 --2- 172.21.15.78:0/2988393732 >> v2:172.21.15.150:3300/0 conn(0x7f102c0c1f10 0x7f102c067f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.037+0000 7f1032221700 1 -- 172.21.15.78:0/2988393732 >> 172.21.15.78:0/2988393732 conn(0x7f102c062fc0 msgr2=0x7f102c0c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.037+0000 7f1032221700 1 -- 172.21.15.78:0/2988393732 shutdown_connections 2023-08-17T17:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.037+0000 7f1032221700 1 -- 172.21.15.78:0/2988393732 wait complete. 2023-08-17T17:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.038+0000 7f1032221700 1 Processor -- start 2023-08-17T17:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.038+0000 7f1032221700 1 -- start start 2023-08-17T17:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f1032221700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 0x7f102c1430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f1032221700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c0c1f10 0x7f102c161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f1032221700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f102c1553c0 0x7f102c0ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f1032221700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0bda90 con 0x7f102c068430 2023-08-17T17:34:58.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f1032221700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0be610 con 0x7f102c1553c0 2023-08-17T17:34:58.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f1032221700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0bdce0 con 0x7f102c0c1f10 2023-08-17T17:34:58.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 0x7f102c1430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 0x7f102c1430f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34490/0 (socket says 172.21.15.78:34490) 2023-08-17T17:34:58.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102b7fe700 1 -- 172.21.15.78:0/862900234 learned_addr learned my addr 172.21.15.78:0/862900234 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:58.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102affd700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c0c1f10 0x7f102c161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102b7fe700 1 -- 172.21.15.78:0/862900234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c0c1f10 msgr2=0x7f102c161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102b7fe700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c0c1f10 0x7f102c161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102b7fe700 1 -- 172.21.15.78:0/862900234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f102c1553c0 msgr2=0x7f102c0ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102bfff700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f102c1553c0 0x7f102c0ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102b7fe700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f102c1553c0 0x7f102c0ab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102b7fe700 1 -- 172.21.15.78:0/862900234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1024009ae0 con 0x7f102c068430 2023-08-17T17:34:58.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102affd700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c0c1f10 0x7f102c161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:58.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f102b7fe700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 0x7f102c1430f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f101c00c880 tx=0x7f101c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:58.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f10137fe700 1 -- 172.21.15.78:0/862900234 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c010580 con 0x7f102c068430 2023-08-17T17:34:58.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f10137fe700 1 -- 172.21.15.78:0/862900234 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c0106e0 con 0x7f102c068430 2023-08-17T17:34:58.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f1032221700 1 -- 172.21.15.78:0/862900234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102c0bdfc0 con 0x7f102c068430 2023-08-17T17:34:58.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f10137fe700 1 -- 172.21.15.78:0/862900234 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c010a60 con 0x7f102c068430 2023-08-17T17:34:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.039+0000 7f1032221700 1 -- 172.21.15.78:0/862900234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c1435e0 con 0x7f102c068430 2023-08-17T17:34:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.040+0000 7f1032221700 1 -- 172.21.15.78:0/862900234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102c047350 con 0x7f102c068430 2023-08-17T17:34:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.041+0000 7f10137fe700 1 -- 172.21.15.78:0/862900234 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f101c01b460 con 0x7f102c068430 2023-08-17T17:34:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.041+0000 7f10137fe700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f101805ed90 0x7f1018061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.041+0000 7f10137fe700 1 -- 172.21.15.78:0/862900234 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f101c079d00 con 0x7f102c068430 2023-08-17T17:34:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.041+0000 7f102affd700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f101805ed90 0x7f1018061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.041+0000 7f102affd700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f101805ed90 0x7f1018061250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f102c0bfe60 tx=0x7f1020008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:58.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.045+0000 7f10137fe700 1 -- 172.21.15.78:0/862900234 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f101c07d030 con 0x7f102c068430 2023-08-17T17:34:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.245+0000 7f1032221700 1 -- 172.21.15.78:0/862900234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f102c0be8f0 con 0x7f102c068430 2023-08-17T17:34:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.246+0000 7f10137fe700 1 -- 172.21.15.78:0/862900234 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f101c04b240 con 0x7f102c068430 2023-08-17T17:34:58.248 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:58.248 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4150014676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4150014676},{"type":"v1","addr":"172.21.15.150:6834","nonce":4150014676}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1895700227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1895700227},{"type":"v1","addr":"172.21.15.150:6835","nonce":1895700227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3007671664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3007671664},{"type":"v1","addr":"172.21.15.78:6835","nonce":3007671664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:34:23.529472+0000","modified":"2023-08-17T17:34:25.535687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/2283193122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2283193122},{"type":"v1","addr":"172.21.15.78:6837","nonce":2283193122}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T17:34:58.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 -- 172.21.15.78:0/862900234 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f101805ed90 msgr2=0x7f1018061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f101805ed90 0x7f1018061250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f102c0bfe60 tx=0x7f1020008040).stop 2023-08-17T17:34:58.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 -- 172.21.15.78:0/862900234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 msgr2=0x7f102c1430f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 0x7f102c1430f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f101c00c880 tx=0x7f101c008040).stop 2023-08-17T17:34:58.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 -- 172.21.15.78:0/862900234 shutdown_connections 2023-08-17T17:34:58.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f101805ed90 0x7f1018061250 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f102c1553c0 0x7f102c0ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f102c068430 0x7f102c1430f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 --2- 172.21.15.78:0/862900234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f102c0c1f10 0x7f102c161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 -- 172.21.15.78:0/862900234 >> 172.21.15.78:0/862900234 conn(0x7f102c062fc0 msgr2=0x7f102c1542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:58.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 -- 172.21.15.78:0/862900234 shutdown_connections 2023-08-17T17:34:58.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.248+0000 7f1032221700 1 -- 172.21.15.78:0/862900234 wait complete. 2023-08-17T17:34:58.251 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2023-08-17T17:34:58.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.374+0000 7f3c1ccc3700 1 Processor -- start 2023-08-17T17:34:58.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.374+0000 7f3c1ccc3700 1 -- start start 2023-08-17T17:34:58.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1ccc3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3c18154140 0x7f3c180c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1ccc3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3c180a7c40 0x7f3c180c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1ccc3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c18154520 con 0x7f3c180a80b0 2023-08-17T17:34:58.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1ccc3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c180c91e0 con 0x7f3c18154140 2023-08-17T17:34:58.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1ccc3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c180c94c0 con 0x7f3c180a7c40 2023-08-17T17:34:58.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3c18154140 0x7f3c180c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3c18154140 0x7f3c180c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34502/0 (socket says 172.21.15.78:34502) 2023-08-17T17:34:58.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1659c700 1 -- 172.21.15.78:0/3986420894 learned_addr learned my addr 172.21.15.78:0/3986420894 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:58.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c15d9b700 1 --2- 172.21.15.78:0/3986420894 >> v2:172.21.15.150:3300/0 conn(0x7f3c180a7c40 0x7f3c180c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1659c700 1 -- 172.21.15.78:0/3986420894 >> v2:172.21.15.150:3300/0 conn(0x7f3c180a7c40 msgr2=0x7f3c180c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:58.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1659c700 1 --2- 172.21.15.78:0/3986420894 >> v2:172.21.15.150:3300/0 conn(0x7f3c180a7c40 0x7f3c180c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1659c700 1 -- 172.21.15.78:0/3986420894 >> v1:172.21.15.150:6789/0 conn(0x7f3c180a80b0 legacy=0x7f3c180ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1659c700 1 -- 172.21.15.78:0/3986420894 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c180c97a0 con 0x7f3c18154140 2023-08-17T17:34:58.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c15d9b700 1 --2- 172.21.15.78:0/3986420894 >> v2:172.21.15.150:3300/0 conn(0x7f3c180a7c40 0x7f3c180c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:58.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.375+0000 7f3c1659c700 1 --2- 172.21.15.78:0/3986420894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c18154140 0x7f3c180c6ee0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f3c180652a0 tx=0x7f3c080090f0).ready entity=mon.0 client_cookie=c8bfead8bcaa0a7d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:58.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1559a700 1 -- 172.21.15.78:0/3986420894 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800b600 con 0x7f3c18154140 2023-08-17T17:34:58.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1559a700 1 -- 172.21.15.78:0/3986420894 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0800b760 con 0x7f3c18154140 2023-08-17T17:34:58.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1559a700 1 -- 172.21.15.78:0/3986420894 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800bae0 con 0x7f3c18154140 2023-08-17T17:34:58.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3986420894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c18154140 msgr2=0x7f3c180c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1ccc3700 1 --2- 172.21.15.78:0/3986420894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c18154140 0x7f3c180c6ee0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f3c180652a0 tx=0x7f3c080090f0).stop 2023-08-17T17:34:58.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3986420894 shutdown_connections 2023-08-17T17:34:58.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1ccc3700 1 --2- 172.21.15.78:0/3986420894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c18154140 0x7f3c180c6ee0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1ccc3700 1 --2- 172.21.15.78:0/3986420894 >> v2:172.21.15.150:3300/0 conn(0x7f3c180a7c40 0x7f3c180c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3986420894 >> 172.21.15.78:0/3986420894 conn(0x7f3c18094510 msgr2=0x7f3c1806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:58.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3986420894 shutdown_connections 2023-08-17T17:34:58.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.376+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3986420894 wait complete. 2023-08-17T17:34:58.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.377+0000 7f3c1ccc3700 1 Processor -- start 2023-08-17T17:34:58.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.377+0000 7f3c1ccc3700 1 -- start start 2023-08-17T17:34:58.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c1ccc3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c180a7c40 0x7f3c18159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c1ccc3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c180a80b0 0x7f3c180af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c1ccc3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c18154140 0x7f3c180c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c1ccc3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18158c00 con 0x7f3c180a80b0 2023-08-17T17:34:58.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c1ccc3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c180af770 con 0x7f3c180a7c40 2023-08-17T17:34:58.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c1ccc3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18165110 con 0x7f3c18154140 2023-08-17T17:34:58.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c15d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c180a80b0 0x7f3c180af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c15d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c180a80b0 0x7f3c180af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34504/0 (socket says 172.21.15.78:34504) 2023-08-17T17:34:58.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c15d9b700 1 -- 172.21.15.78:0/3963077278 learned_addr learned my addr 172.21.15.78:0/3963077278 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:58.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c1659c700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c180a7c40 0x7f3c18159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.378+0000 7f3c16d9d700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c18154140 0x7f3c180c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c15d9b700 1 -- 172.21.15.78:0/3963077278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c18154140 msgr2=0x7f3c180c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c15d9b700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c18154140 0x7f3c180c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c15d9b700 1 -- 172.21.15.78:0/3963077278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c180a7c40 msgr2=0x7f3c18159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c15d9b700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c180a7c40 0x7f3c18159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c15d9b700 1 -- 172.21.15.78:0/3963077278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08009370 con 0x7f3c180a80b0 2023-08-17T17:34:58.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c16d9d700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c18154140 0x7f3c180c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:58.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c15d9b700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c180a80b0 0x7f3c180af280 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f3c0c00d890 tx=0x7f3c0c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:58.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c067fc700 1 -- 172.21.15.78:0/3963077278 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c011590 con 0x7f3c180a80b0 2023-08-17T17:34:58.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c067fc700 1 -- 172.21.15.78:0/3963077278 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c0116f0 con 0x7f3c180a80b0 2023-08-17T17:34:58.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3963077278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c18157ff0 con 0x7f3c180a80b0 2023-08-17T17:34:58.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c067fc700 1 -- 172.21.15.78:0/3963077278 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c011a70 con 0x7f3c180a80b0 2023-08-17T17:34:58.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.379+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3963077278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c181585b0 con 0x7f3c180a80b0 2023-08-17T17:34:58.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.380+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3963077278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c18047350 con 0x7f3c180a80b0 2023-08-17T17:34:58.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.380+0000 7f3c067fc700 1 -- 172.21.15.78:0/3963077278 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3c0c01c460 con 0x7f3c180a80b0 2023-08-17T17:34:58.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.380+0000 7f3c067fc700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3bf805ed90 0x7f3bf8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.380+0000 7f3c067fc700 1 -- 172.21.15.78:0/3963077278 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3c0c0799a0 con 0x7f3c180a80b0 2023-08-17T17:34:58.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.380+0000 7f3c1659c700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3bf805ed90 0x7f3bf8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.381+0000 7f3c1659c700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3bf805ed90 0x7f3bf8061250 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f3c08009fd0 tx=0x7f3c08017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:58.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.384+0000 7f3c067fc700 1 -- 172.21.15.78:0/3963077278 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c0c04aee0 con 0x7f3c180a80b0 2023-08-17T17:34:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.549+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3963077278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c180c34c0 con 0x7f3c180a80b0 2023-08-17T17:34:58.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.550+0000 7f3c067fc700 1 -- 172.21.15.78:0/3963077278 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f3c0c04e500 con 0x7f3c180a80b0 2023-08-17T17:34:58.551 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:58.552 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:58.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3963077278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3bf805ed90 msgr2=0x7f3bf8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3bf805ed90 0x7f3bf8061250 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f3c08009fd0 tx=0x7f3c08017000).stop 2023-08-17T17:34:58.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3963077278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c180a80b0 msgr2=0x7f3c180af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c180a80b0 0x7f3c180af280 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f3c0c00d890 tx=0x7f3c0c008040).stop 2023-08-17T17:34:58.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3963077278 shutdown_connections 2023-08-17T17:34:58.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3bf805ed90 0x7f3bf8061250 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c18154140 0x7f3c180c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c180a7c40 0x7f3c18159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 --2- 172.21.15.78:0/3963077278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c180a80b0 0x7f3c180af280 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3963077278 >> 172.21.15.78:0/3963077278 conn(0x7f3c18094510 msgr2=0x7f3c18063b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:58.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3963077278 shutdown_connections 2023-08-17T17:34:58.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.551+0000 7f3c1ccc3700 1 -- 172.21.15.78:0/3963077278 wait complete. 2023-08-17T17:34:58.565 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T17:34:58.566 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:34:58.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.676+0000 7f8a10de2700 1 Processor -- start 2023-08-17T17:34:58.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.676+0000 7f8a10de2700 1 -- start start 2023-08-17T17:34:58.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a10de2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c154140 0x7f8a0c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a10de2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a0c0c1010 0x7f8a0c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a10de2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c154520 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a10de2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0c91e0 con 0x7f8a0c0c1010 2023-08-17T17:34:58.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a10de2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0c94c0 con 0x7f8a0c154140 2023-08-17T17:34:58.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a0ad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a0c0c1010 0x7f8a0c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a01d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8a0c0a7c40 0x7f8a0c0c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34554/0 (socket says 172.21.15.78:34554) 2023-08-17T17:34:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a01d9b700 1 -- 172.21.15.78:0/774463240 learned_addr learned my addr 172.21.15.78:0/774463240 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a0a59c700 1 --2- 172.21.15.78:0/774463240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c154140 0x7f8a0c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a0ad9d700 1 -- 172.21.15.78:0/774463240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c154140 msgr2=0x7f8a0c0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a0ad9d700 1 --2- 172.21.15.78:0/774463240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c154140 0x7f8a0c0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a0ad9d700 1 -- 172.21.15.78:0/774463240 >> v1:172.21.15.78:6789/0 conn(0x7f8a0c0a7c40 legacy=0x7f8a0c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a0ad9d700 1 -- 172.21.15.78:0/774463240 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c0c97a0 con 0x7f8a0c0c1010 2023-08-17T17:34:58.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.677+0000 7f8a09d9b700 1 -- 172.21.15.78:0/774463240 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646950436 0 0) 0x7f8a0c154520 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a0a59c700 1 --2- 172.21.15.78:0/774463240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c154140 0x7f8a0c0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:34:58.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a0ad9d700 1 --2- 172.21.15.78:0/774463240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0c1010 0x7f8a0c0ca280 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f8a04009e60 tx=0x7f8a04009780).ready entity=mon.0 client_cookie=b7c98901416170f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:58.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a09d9b700 1 -- 172.21.15.78:0/774463240 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400e070 con 0x7f8a0c0c1010 2023-08-17T17:34:58.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a09d9b700 1 -- 172.21.15.78:0/774463240 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0400bc30 con 0x7f8a0c0c1010 2023-08-17T17:34:58.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a09d9b700 1 -- 172.21.15.78:0/774463240 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04012410 con 0x7f8a0c0c1010 2023-08-17T17:34:58.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a10de2700 1 -- 172.21.15.78:0/774463240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0c1010 msgr2=0x7f8a0c0ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a10de2700 1 --2- 172.21.15.78:0/774463240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0c1010 0x7f8a0c0ca280 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f8a04009e60 tx=0x7f8a04009780).stop 2023-08-17T17:34:58.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a10de2700 1 -- 172.21.15.78:0/774463240 shutdown_connections 2023-08-17T17:34:58.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a10de2700 1 --2- 172.21.15.78:0/774463240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0c1010 0x7f8a0c0ca280 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a10de2700 1 --2- 172.21.15.78:0/774463240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c154140 0x7f8a0c0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a10de2700 1 -- 172.21.15.78:0/774463240 >> 172.21.15.78:0/774463240 conn(0x7f8a0c094510 msgr2=0x7f8a0c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:58.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a10de2700 1 -- 172.21.15.78:0/774463240 shutdown_connections 2023-08-17T17:34:58.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.678+0000 7f8a10de2700 1 -- 172.21.15.78:0/774463240 wait complete. 2023-08-17T17:34:58.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.679+0000 7f8a10de2700 1 Processor -- start 2023-08-17T17:34:58.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.680+0000 7f8a10de2700 1 -- start start 2023-08-17T17:34:58.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.680+0000 7f8a10de2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0a7c40 0x7f8a0c140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.680+0000 7f8a10de2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c0c1010 0x7f8a0c156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.680+0000 7f8a10de2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0c154140 0x7f8a0c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.680+0000 7f8a10de2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c159530 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.680+0000 7f8a10de2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c158680 con 0x7f8a0c154140 2023-08-17T17:34:58.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.680+0000 7f8a10de2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c158920 con 0x7f8a0c0c1010 2023-08-17T17:34:58.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.680+0000 7f8a0a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0a7c40 0x7f8a0c140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.680+0000 7f8a0a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0a7c40 0x7f8a0c140870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33200/0 (socket says 172.21.15.78:33200) 2023-08-17T17:34:58.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.680+0000 7f8a0a59c700 1 -- 172.21.15.78:0/2551729425 learned_addr learned my addr 172.21.15.78:0/2551729425 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:58.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a01d9b700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c0c1010 0x7f8a0c156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a0a59c700 1 -- 172.21.15.78:0/2551729425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c0c1010 msgr2=0x7f8a0c156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a0a59c700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c0c1010 0x7f8a0c156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a0a59c700 1 -- 172.21.15.78:0/2551729425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0c154140 msgr2=0x7f8a0c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a0a59c700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0c154140 0x7f8a0c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:58.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a0a59c700 1 -- 172.21.15.78:0/2551729425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a04009a20 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a0a59c700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0a7c40 0x7f8a0c140870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f89fc00c880 tx=0x7f89fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:58.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a02ffd700 1 -- 172.21.15.78:0/2551729425 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc010580 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a02ffd700 1 -- 172.21.15.78:0/2551729425 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc0106e0 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a10de2700 1 -- 172.21.15.78:0/2551729425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c158c00 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a02ffd700 1 -- 172.21.15.78:0/2551729425 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc010a60 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.681+0000 7f8a10de2700 1 -- 172.21.15.78:0/2551729425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c1591c0 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.682+0000 7f8a10de2700 1 -- 172.21.15.78:0/2551729425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c047350 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.682+0000 7f8a02ffd700 1 -- 172.21.15.78:0/2551729425 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f89fc01b460 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.682+0000 7f8a02ffd700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f89ec05ed90 0x7f89ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:58.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.682+0000 7f8a02ffd700 1 -- 172.21.15.78:0/2551729425 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f89fc079cd0 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.682+0000 7f8a01d9b700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f89ec05ed90 0x7f89ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:58.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.683+0000 7f8a01d9b700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f89ec05ed90 0x7f89ec061250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f8a0c155bb0 tx=0x7f89f4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:58.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.686+0000 7f8a02ffd700 1 -- 172.21.15.78:0/2551729425 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89fc04b210 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.888+0000 7f8a10de2700 1 -- 172.21.15.78:0/2551729425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a0c1538b0 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.889+0000 7f8a02ffd700 1 -- 172.21.15.78:0/2551729425 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f89fc04e830 con 0x7f8a0c0a7c40 2023-08-17T17:34:58.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:58.891 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4150014676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4150014676},{"type":"v1","addr":"172.21.15.150:6834","nonce":4150014676}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1895700227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1895700227},{"type":"v1","addr":"172.21.15.150:6835","nonce":1895700227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3007671664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3007671664},{"type":"v1","addr":"172.21.15.78:6835","nonce":3007671664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:34:23.529472+0000","modified":"2023-08-17T17:34:25.535687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/2283193122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2283193122},{"type":"v1","addr":"172.21.15.78:6837","nonce":2283193122}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T17:34:58.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 -- 172.21.15.78:0/2551729425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f89ec05ed90 msgr2=0x7f89ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f89ec05ed90 0x7f89ec061250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f8a0c155bb0 tx=0x7f89f4009040).stop 2023-08-17T17:34:58.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 -- 172.21.15.78:0/2551729425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0a7c40 msgr2=0x7f8a0c140870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:58.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0a7c40 0x7f8a0c140870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f89fc00c880 tx=0x7f89fc008040).stop 2023-08-17T17:34:58.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 -- 172.21.15.78:0/2551729425 shutdown_connections 2023-08-17T17:34:58.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f89ec05ed90 0x7f89ec061250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a0c154140 0x7f8a0c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:58.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a0c0a7c40 0x7f8a0c140870 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 --2- 172.21.15.78:0/2551729425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a0c0c1010 0x7f8a0c156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:58.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 -- 172.21.15.78:0/2551729425 >> 172.21.15.78:0/2551729425 conn(0x7f8a0c094510 msgr2=0x7f8a0c0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:58.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 -- 172.21.15.78:0/2551729425 shutdown_connections 2023-08-17T17:34:58.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:58.891+0000 7f8a10de2700 1 -- 172.21.15.78:0/2551729425 wait complete. 2023-08-17T17:34:58.894 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2023-08-17T17:34:58.904 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:34:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.015+0000 7fda02c11700 1 Processor -- start 2023-08-17T17:34:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.015+0000 7fda02c11700 1 -- start start 2023-08-17T17:34:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.016+0000 7fda02c11700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9fc0650a0 0x7fd9fc1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.016+0000 7fda02c11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9fc0c1a00 0x7fd9fc0c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.016+0000 7fda02c11700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd9fc154240 0x7fd9fc154680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.016+0000 7fda02c11700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc0699f0 con 0x7fd9fc154240 2023-08-17T17:34:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.016+0000 7fda02c11700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc0c2370 con 0x7fd9fc0650a0 2023-08-17T17:34:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.016+0000 7fda02c11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc151be0 con 0x7fd9fc0c1a00 2023-08-17T17:34:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.016+0000 7fda011ae700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd9fc154240 0x7fd9fc154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.016+0000 7fda011ae700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd9fc154240 0x7fd9fc154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33210/0 (socket says 172.21.15.78:33210) 2023-08-17T17:34:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda011ae700 1 -- 172.21.15.78:0/3847100184 learned_addr learned my addr 172.21.15.78:0/3847100184 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda009ad700 1 --2- 172.21.15.78:0/3847100184 >> v2:172.21.15.150:3300/0 conn(0x7fd9fc0650a0 0x7fd9fc1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fd9fbfff700 1 --2- 172.21.15.78:0/3847100184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9fc0c1a00 0x7fd9fc0c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda011ae700 1 -- 172.21.15.78:0/3847100184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9fc0c1a00 msgr2=0x7fd9fc0c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda011ae700 1 --2- 172.21.15.78:0/3847100184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9fc0c1a00 0x7fd9fc0c1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda011ae700 1 -- 172.21.15.78:0/3847100184 >> v2:172.21.15.150:3300/0 conn(0x7fd9fc0650a0 msgr2=0x7fd9fc1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda011ae700 1 --2- 172.21.15.78:0/3847100184 >> v2:172.21.15.150:3300/0 conn(0x7fd9fc0650a0 0x7fd9fc1516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda011ae700 1 -- 172.21.15.78:0/3847100184 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc068950 con 0x7fd9fc154240 2023-08-17T17:34:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda009ad700 1 --2- 172.21.15.78:0/3847100184 >> v2:172.21.15.150:3300/0 conn(0x7fd9fc0650a0 0x7fd9fc1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda011ae700 1 --2- 172.21.15.78:0/3847100184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc154240 0x7fd9fc154680 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fd9fc0c44a0 tx=0x7fd9ec0090f0).ready entity=mon.0 client_cookie=620f6a4abbda85dd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fd9fb7fe700 1 -- 172.21.15.78:0/3847100184 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec00b520 con 0x7fd9fc154240 2023-08-17T17:34:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fd9fb7fe700 1 -- 172.21.15.78:0/3847100184 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec00b680 con 0x7fd9fc154240 2023-08-17T17:34:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fd9fb7fe700 1 -- 172.21.15.78:0/3847100184 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec00ba00 con 0x7fd9fc154240 2023-08-17T17:34:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda02c11700 1 -- 172.21.15.78:0/3847100184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc154240 msgr2=0x7fd9fc154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.017+0000 7fda02c11700 1 --2- 172.21.15.78:0/3847100184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc154240 0x7fd9fc154680 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fd9fc0c44a0 tx=0x7fd9ec0090f0).stop 2023-08-17T17:34:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.018+0000 7fda02c11700 1 -- 172.21.15.78:0/3847100184 shutdown_connections 2023-08-17T17:34:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.018+0000 7fda02c11700 1 --2- 172.21.15.78:0/3847100184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc154240 0x7fd9fc154680 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.018+0000 7fda02c11700 1 --2- 172.21.15.78:0/3847100184 >> v2:172.21.15.150:3300/0 conn(0x7fd9fc0650a0 0x7fd9fc1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.018+0000 7fda02c11700 1 --2- 172.21.15.78:0/3847100184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9fc0c1a00 0x7fd9fc0c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.018+0000 7fda02c11700 1 -- 172.21.15.78:0/3847100184 >> 172.21.15.78:0/3847100184 conn(0x7fd9fc062fc0 msgr2=0x7fd9fc0c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:59.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.018+0000 7fda02c11700 1 -- 172.21.15.78:0/3847100184 shutdown_connections 2023-08-17T17:34:59.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.018+0000 7fda02c11700 1 -- 172.21.15.78:0/3847100184 wait complete. 2023-08-17T17:34:59.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.019+0000 7fda02c11700 1 Processor -- start 2023-08-17T17:34:59.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.019+0000 7fda02c11700 1 -- start start 2023-08-17T17:34:59.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda02c11700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc0650a0 0x7fd9fc150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda02c11700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0c1a00 0x7fd9fc14b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda02c11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9fc154240 0x7fd9fc0a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda02c11700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0bf230 con 0x7fd9fc0650a0 2023-08-17T17:34:59.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda02c11700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc150710 con 0x7fd9fc0c1a00 2023-08-17T17:34:59.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda02c11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0bebe0 con 0x7fd9fc154240 2023-08-17T17:34:59.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda009ad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc0650a0 0x7fd9fc150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda009ad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc0650a0 0x7fd9fc150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33224/0 (socket says 172.21.15.78:33224) 2023-08-17T17:34:59.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda009ad700 1 -- 172.21.15.78:0/2895145612 learned_addr learned my addr 172.21.15.78:0/2895145612 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:59.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fd9fbfff700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0c1a00 0x7fd9fc14b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda011ae700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9fc154240 0x7fd9fc0a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda009ad700 1 -- 172.21.15.78:0/2895145612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9fc154240 msgr2=0x7fd9fc0a8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda009ad700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9fc154240 0x7fd9fc0a8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda009ad700 1 -- 172.21.15.78:0/2895145612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0c1a00 msgr2=0x7fd9fc14b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda009ad700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0c1a00 0x7fd9fc14b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda009ad700 1 -- 172.21.15.78:0/2895145612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec009370 con 0x7fd9fc0650a0 2023-08-17T17:34:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda009ad700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc0650a0 0x7fd9fc150160 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fd9f400d180 tx=0x7fd9f40099f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fd9f8ff9700 1 -- 172.21.15.78:0/2895145612 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400de20 con 0x7fd9fc0650a0 2023-08-17T17:34:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fd9f8ff9700 1 -- 172.21.15.78:0/2895145612 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f400f040 con 0x7fd9fc0650a0 2023-08-17T17:34:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda02c11700 1 -- 172.21.15.78:0/2895145612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc0beec0 con 0x7fd9fc0650a0 2023-08-17T17:34:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fd9f8ff9700 1 -- 172.21.15.78:0/2895145612 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4013600 con 0x7fd9fc0650a0 2023-08-17T17:34:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.020+0000 7fda02c11700 1 -- 172.21.15.78:0/2895145612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc1496c0 con 0x7fd9fc0650a0 2023-08-17T17:34:59.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.021+0000 7fda02c11700 1 -- 172.21.15.78:0/2895145612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc047350 con 0x7fd9fc0650a0 2023-08-17T17:34:59.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.021+0000 7fd9f8ff9700 1 -- 172.21.15.78:0/2895145612 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd9f40139f0 con 0x7fd9fc0650a0 2023-08-17T17:34:59.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.022+0000 7fd9f8ff9700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd9dc05ed90 0x7fd9dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.022+0000 7fd9f8ff9700 1 -- 172.21.15.78:0/2895145612 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd9f407a390 con 0x7fd9fc0650a0 2023-08-17T17:34:59.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.022+0000 7fd9fbfff700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd9dc05ed90 0x7fd9dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.022+0000 7fd9fbfff700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd9dc05ed90 0x7fd9dc061250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fd9e4006d80 tx=0x7fd9e4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:59.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.026+0000 7fd9f8ff9700 1 -- 172.21.15.78:0/2895145612 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd9f404b930 con 0x7fd9fc0650a0 2023-08-17T17:34:59.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.230+0000 7fda02c11700 1 -- 172.21.15.78:0/2895145612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9fc149d60 con 0x7fd9fc0650a0 2023-08-17T17:34:59.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.230+0000 7fd9f8ff9700 1 -- 172.21.15.78:0/2895145612 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7fd9fc149d60 con 0x7fd9fc0650a0 2023-08-17T17:34:59.232 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:59.233 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4150014676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4150014676},{"type":"v1","addr":"172.21.15.150:6834","nonce":4150014676}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1895700227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1895700227},{"type":"v1","addr":"172.21.15.150:6835","nonce":1895700227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3007671664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3007671664},{"type":"v1","addr":"172.21.15.78:6835","nonce":3007671664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:34:23.529472+0000","modified":"2023-08-17T17:34:25.535687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/2283193122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2283193122},{"type":"v1","addr":"172.21.15.78:6837","nonce":2283193122}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T17:34:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.232+0000 7fda02c11700 1 -- 172.21.15.78:0/2895145612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd9dc05ed90 msgr2=0x7fd9dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.232+0000 7fda02c11700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd9dc05ed90 0x7fd9dc061250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fd9e4006d80 tx=0x7fd9e4008040).stop 2023-08-17T17:34:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.232+0000 7fda02c11700 1 -- 172.21.15.78:0/2895145612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc0650a0 msgr2=0x7fd9fc150160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.232+0000 7fda02c11700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc0650a0 0x7fd9fc150160 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fd9f400d180 tx=0x7fd9f40099f0).stop 2023-08-17T17:34:59.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.233+0000 7fda02c11700 1 -- 172.21.15.78:0/2895145612 shutdown_connections 2023-08-17T17:34:59.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.233+0000 7fda02c11700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd9dc05ed90 0x7fd9dc061250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.233+0000 7fda02c11700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9fc154240 0x7fd9fc0a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.233+0000 7fda02c11700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9fc0650a0 0x7fd9fc150160 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.233+0000 7fda02c11700 1 --2- 172.21.15.78:0/2895145612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9fc0c1a00 0x7fd9fc14b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.233+0000 7fda02c11700 1 -- 172.21.15.78:0/2895145612 >> 172.21.15.78:0/2895145612 conn(0x7fd9fc062fc0 msgr2=0x7fd9fc0abc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:59.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.233+0000 7fda02c11700 1 -- 172.21.15.78:0/2895145612 shutdown_connections 2023-08-17T17:34:59.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.233+0000 7fda02c11700 1 -- 172.21.15.78:0/2895145612 wait complete. 2023-08-17T17:34:59.236 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2023-08-17T17:34:59.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:34:59.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.359+0000 7f73e1dd3700 1 Processor -- start 2023-08-17T17:34:59.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.359+0000 7f73e1dd3700 1 -- start start 2023-08-17T17:34:59.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.360+0000 7f73e1dd3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc154140 0x7f73dc0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.360+0000 7f73e1dd3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f73dc0c1010 0x7f73dc0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.360+0000 7f73e1dd3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc154520 con 0x7f73dc0a7c40 2023-08-17T17:34:59.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.360+0000 7f73e1dd3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73dc0c91e0 con 0x7f73dc0c1010 2023-08-17T17:34:59.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.360+0000 7f73e1dd3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0c94c0 con 0x7f73dc154140 2023-08-17T17:34:59.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.360+0000 7f73daffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f73dc0a7c40 0x7f73dc0c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34556/0 (socket says 172.21.15.78:34556) 2023-08-17T17:34:59.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.360+0000 7f73daffd700 1 -- 172.21.15.78:0/309131274 learned_addr learned my addr 172.21.15.78:0/309131274 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:59.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73dbfff700 1 --2- 172.21.15.78:0/309131274 >> v2:172.21.15.150:3300/0 conn(0x7f73dc0c1010 0x7f73dc0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73db7fe700 1 --2- 172.21.15.78:0/309131274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc154140 0x7f73dc0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73da7fc700 1 -- 172.21.15.78:0/309131274 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377775569 0 0) 0x7f73dc154520 con 0x7f73dc0a7c40 2023-08-17T17:34:59.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73da7fc700 1 -- 172.21.15.78:0/309131274 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73c40033f0 con 0x7f73dc0a7c40 2023-08-17T17:34:59.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73db7fe700 1 -- 172.21.15.78:0/309131274 >> v2:172.21.15.150:3300/0 conn(0x7f73dc0c1010 msgr2=0x7f73dc0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:59.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73db7fe700 1 --2- 172.21.15.78:0/309131274 >> v2:172.21.15.150:3300/0 conn(0x7f73dc0c1010 0x7f73dc0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73db7fe700 1 -- 172.21.15.78:0/309131274 >> v1:172.21.15.78:6789/0 conn(0x7f73dc0a7c40 legacy=0x7f73dc0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73db7fe700 1 -- 172.21.15.78:0/309131274 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0c97a0 con 0x7f73dc154140 2023-08-17T17:34:59.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73dbfff700 1 --2- 172.21.15.78:0/309131274 >> v2:172.21.15.150:3300/0 conn(0x7f73dc0c1010 0x7f73dc0ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:34:59.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73db7fe700 1 --2- 172.21.15.78:0/309131274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc154140 0x7f73dc0c6ee0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f73cc009e60 tx=0x7f73cc009780).ready entity=mon.2 client_cookie=c1af54dd351ef60b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:59.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73da7fc700 1 -- 172.21.15.78:0/309131274 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00e070 con 0x7f73dc154140 2023-08-17T17:34:59.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73da7fc700 1 -- 172.21.15.78:0/309131274 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc00bab0 con 0x7f73dc154140 2023-08-17T17:34:59.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.361+0000 7f73da7fc700 1 -- 172.21.15.78:0/309131274 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00be30 con 0x7f73dc154140 2023-08-17T17:34:59.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.362+0000 7f73e1dd3700 1 -- 172.21.15.78:0/309131274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc154140 msgr2=0x7f73dc0c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.362+0000 7f73e1dd3700 1 --2- 172.21.15.78:0/309131274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc154140 0x7f73dc0c6ee0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f73cc009e60 tx=0x7f73cc009780).stop 2023-08-17T17:34:59.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.362+0000 7f73e1dd3700 1 -- 172.21.15.78:0/309131274 shutdown_connections 2023-08-17T17:34:59.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.362+0000 7f73e1dd3700 1 --2- 172.21.15.78:0/309131274 >> v2:172.21.15.150:3300/0 conn(0x7f73dc0c1010 0x7f73dc0ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.362+0000 7f73e1dd3700 1 --2- 172.21.15.78:0/309131274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc154140 0x7f73dc0c6ee0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.362+0000 7f73e1dd3700 1 -- 172.21.15.78:0/309131274 >> 172.21.15.78:0/309131274 conn(0x7f73dc094510 msgr2=0x7f73dc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:59.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.362+0000 7f73e1dd3700 1 -- 172.21.15.78:0/309131274 shutdown_connections 2023-08-17T17:34:59.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.362+0000 7f73e1dd3700 1 -- 172.21.15.78:0/309131274 wait complete. 2023-08-17T17:34:59.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.363+0000 7f73e1dd3700 1 Processor -- start 2023-08-17T17:34:59.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.363+0000 7f73e1dd3700 1 -- start start 2023-08-17T17:34:59.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73e1dd3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0a7c40 0x7f73dc0af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73e1dd3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc0c1010 0x7f73dc0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73e1dd3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154140 0x7f73dc158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73e1dd3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0b0db0 con 0x7f73dc154140 2023-08-17T17:34:59.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73e1dd3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0b0430 con 0x7f73dc0a7c40 2023-08-17T17:34:59.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73e1dd3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0af820 con 0x7f73dc0c1010 2023-08-17T17:34:59.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73dbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154140 0x7f73dc158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73dbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154140 0x7f73dc158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33234/0 (socket says 172.21.15.78:33234) 2023-08-17T17:34:59.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73dbfff700 1 -- 172.21.15.78:0/3488619690 learned_addr learned my addr 172.21.15.78:0/3488619690 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:59.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73db7fe700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0a7c40 0x7f73dc0af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73daffd700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc0c1010 0x7f73dc0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73dbfff700 1 -- 172.21.15.78:0/3488619690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc0c1010 msgr2=0x7f73dc0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73dbfff700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc0c1010 0x7f73dc0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73dbfff700 1 -- 172.21.15.78:0/3488619690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0a7c40 msgr2=0x7f73dc0af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73dbfff700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0a7c40 0x7f73dc0af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73dbfff700 1 -- 172.21.15.78:0/3488619690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d40092a0 con 0x7f73dc154140 2023-08-17T17:34:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.364+0000 7f73dbfff700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154140 0x7f73dc158c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f73d400e8e0 tx=0x7f73d4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.365+0000 7f73c37fe700 1 -- 172.21.15.78:0/3488619690 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400ee80 con 0x7f73dc154140 2023-08-17T17:34:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.365+0000 7f73c37fe700 1 -- 172.21.15.78:0/3488619690 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d400c850 con 0x7f73dc154140 2023-08-17T17:34:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.365+0000 7f73e1dd3700 1 -- 172.21.15.78:0/3488619690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc009a20 con 0x7f73dc154140 2023-08-17T17:34:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.365+0000 7f73c37fe700 1 -- 172.21.15.78:0/3488619690 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400cbd0 con 0x7f73dc154140 2023-08-17T17:34:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.365+0000 7f73e1dd3700 1 -- 172.21.15.78:0/3488619690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc0afde0 con 0x7f73dc154140 2023-08-17T17:34:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.366+0000 7f73e1dd3700 1 -- 172.21.15.78:0/3488619690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc0b05c0 con 0x7f73dc154140 2023-08-17T17:34:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.366+0000 7f73c37fe700 1 -- 172.21.15.78:0/3488619690 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f73d4022070 con 0x7f73dc154140 2023-08-17T17:34:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.366+0000 7f73c37fe700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73c805ed90 0x7f73c8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.366+0000 7f73c37fe700 1 -- 172.21.15.78:0/3488619690 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f73d4079f50 con 0x7f73dc154140 2023-08-17T17:34:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.366+0000 7f73db7fe700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73c805ed90 0x7f73c8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.367+0000 7f73db7fe700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73c805ed90 0x7f73c8061250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f73cc0099f0 tx=0x7f73cc009780).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.370+0000 7f73c37fe700 1 -- 172.21.15.78:0/3488619690 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73d40a88f0 con 0x7f73dc154140 2023-08-17T17:34:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.533+0000 7f73e1dd3700 1 -- 172.21.15.78:0/3488619690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73dc047350 con 0x7f73dc154140 2023-08-17T17:34:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.533+0000 7f73c37fe700 1 -- 172.21.15.78:0/3488619690 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f73d404b4f0 con 0x7f73dc154140 2023-08-17T17:34:59.535 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:34:59.536 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:34:24.531047+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:34:21.874660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T17:34:22.501817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 -- 172.21.15.78:0/3488619690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73c805ed90 msgr2=0x7f73c8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73c805ed90 0x7f73c8061250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f73cc0099f0 tx=0x7f73cc009780).stop 2023-08-17T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 -- 172.21.15.78:0/3488619690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154140 msgr2=0x7f73dc158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154140 0x7f73dc158c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f73d400e8e0 tx=0x7f73d4009060).stop 2023-08-17T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 -- 172.21.15.78:0/3488619690 shutdown_connections 2023-08-17T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73c805ed90 0x7f73c8061250 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154140 0x7f73dc158c40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73dc0a7c40 0x7f73dc0af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 --2- 172.21.15.78:0/3488619690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73dc0c1010 0x7f73dc0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 -- 172.21.15.78:0/3488619690 >> 172.21.15.78:0/3488619690 conn(0x7f73dc094510 msgr2=0x7f73dc0c6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 -- 172.21.15.78:0/3488619690 shutdown_connections 2023-08-17T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.535+0000 7f73e1dd3700 1 -- 172.21.15.78:0/3488619690 wait complete. 2023-08-17T17:34:59.549 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T17:34:59.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.661+0000 7fccdb04e700 1 Processor -- start 2023-08-17T17:34:59.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.661+0000 7fccdb04e700 1 -- start start 2023-08-17T17:34:59.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.662+0000 7fccdb04e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4064340 0x7fccd4064720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.662+0000 7fccdb04e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd40c7860 con 0x7fccd40bec60 2023-08-17T17:34:59.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.662+0000 7fccdb04e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd40c6c90 con 0x7fccd40c98b0 2023-08-17T17:34:59.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.662+0000 7fccdb04e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40638b0 con 0x7fccd4064340 2023-08-17T17:34:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fccd95eb700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fccd40bec60 0x7fccd40c32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34558/0 (socket says 172.21.15.78:34558) 2023-08-17T17:34:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fccd95eb700 1 -- 172.21.15.78:0/545498836 learned_addr learned my addr 172.21.15.78:0/545498836 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:34:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fccd8dea700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4064340 0x7fccd4064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163126910 0 0) 0x7fccd40c7860 con 0x7fccd40bec60 2023-08-17T17:34:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccbc0033f0 con 0x7fccd40bec60 2023-08-17T17:34:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1230569515 0 0) 0x7fccbc0033f0 con 0x7fccd40bec60 2023-08-17T17:34:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4064340 msgr2=0x7fccd4064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4064340 0x7fccd4064720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 >> v1:172.21.15.150:6789/0 conn(0x7fccd40c98b0 legacy=0x7fccd40c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40c6f30 con 0x7fccd40bec60 2023-08-17T17:34:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fcccc0017f0 con 0x7fccd40bec60 2023-08-17T17:34:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 >> v1:172.21.15.78:6789/0 conn(0x7fccd40bec60 legacy=0x7fccd40c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4064340 0x7fccbc003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccbc003e40 0x7fccbc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccbc004b80 0x7fccbc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40638b0 con 0x7fccbc004b80 2023-08-17T17:34:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc00b990 con 0x7fccbc003e40 2023-08-17T17:34:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc00bb50 con 0x7fccd4064340 2023-08-17T17:34:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fccd95eb700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccbc004b80 0x7fccbc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fccd8dea700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4064340 0x7fccbc003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.663+0000 7fcccbfff700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccbc003e40 0x7fccbc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccd95eb700 1 -- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4064340 msgr2=0x7fccbc003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccd95eb700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4064340 0x7fccbc003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccd95eb700 1 -- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccbc003e40 msgr2=0x7fccbc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:34:59.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccd95eb700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccbc003e40 0x7fccbc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:34:59.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccd95eb700 1 -- 172.21.15.78:0/545498836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc0033f0 con 0x7fccbc004b80 2023-08-17T17:34:59.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fcccbfff700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccbc003e40 0x7fccbc004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:34:59.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccd95eb700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccbc004b80 0x7fccbc005000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fcccc00c480 tx=0x7fcccc00c790).ready entity=mon.0 client_cookie=2d4d10c207dacfd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:59.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc002030 con 0x7fccbc004b80 2023-08-17T17:34:59.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc00ce20 con 0x7fccbc004b80 2023-08-17T17:34:59.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fcccb7fe700 1 -- 172.21.15.78:0/545498836 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc005d70 con 0x7fccbc004b80 2023-08-17T17:34:59.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccdb04e700 1 -- 172.21.15.78:0/545498836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccbc004b80 msgr2=0x7fccbc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccdb04e700 1 --2- 172.21.15.78:0/545498836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccbc004b80 0x7fccbc005000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fcccc00c480 tx=0x7fcccc00c790).stop 2023-08-17T17:34:59.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccd95eb700 1 -- 172.21.15.78:0/545498836 reap_dead start 2023-08-17T17:34:59.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccdb04e700 1 -- 172.21.15.78:0/545498836 shutdown_connections 2023-08-17T17:34:59.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccdb04e700 1 -- 172.21.15.78:0/545498836 >> 172.21.15.78:0/545498836 conn(0x7fccd4062cd0 msgr2=0x7fccd40c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:34:59.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.664+0000 7fccdb04e700 1 -- 172.21.15.78:0/545498836 shutdown_connections 2023-08-17T17:34:59.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.665+0000 7fccdb04e700 1 -- 172.21.15.78:0/545498836 wait complete. 2023-08-17T17:34:59.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.666+0000 7fccdb04e700 1 Processor -- start 2023-08-17T17:34:59.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.666+0000 7fccdb04e700 1 -- start start 2023-08-17T17:34:59.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.666+0000 7fccdb04e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd41563c0 0x7fccd40ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.666+0000 7fccdb04e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccd40ad8b0 0x7fccd40a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.666+0000 7fccdb04e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd40a9980 0x7fccd40675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.666+0000 7fccdb04e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd4150740 con 0x7fccd41563c0 2023-08-17T17:34:59.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.666+0000 7fccdb04e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40ae3e0 con 0x7fccd40ad8b0 2023-08-17T17:34:59.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.666+0000 7fccdb04e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd4154a60 con 0x7fccd40a9980 2023-08-17T17:34:59.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccd8dea700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd41563c0 0x7fccd40ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccd8dea700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd41563c0 0x7fccd40ab280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33252/0 (socket says 172.21.15.78:33252) 2023-08-17T17:34:59.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccd8dea700 1 -- 172.21.15.78:0/1954052071 learned_addr learned my addr 172.21.15.78:0/1954052071 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:34:59.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccd8dea700 1 -- 172.21.15.78:0/1954052071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd40a9980 msgr2=0x7fccd40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccd8dea700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd40a9980 0x7fccd40675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:59.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccd8dea700 1 -- 172.21.15.78:0/1954052071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccd40ad8b0 msgr2=0x7fccd40a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:34:59.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccd8dea700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccd40ad8b0 0x7fccd40a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:34:59.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccd8dea700 1 -- 172.21.15.78:0/1954052071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd41567a0 con 0x7fccd41563c0 2023-08-17T17:34:59.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccd8dea700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd41563c0 0x7fccd40ab280 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fccd00119c0 tx=0x7fccd0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:59.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccc8ff9700 1 -- 172.21.15.78:0/1954052071 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd000f8e0 con 0x7fccd41563c0 2023-08-17T17:34:59.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccc8ff9700 1 -- 172.21.15.78:0/1954052071 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd000fa40 con 0x7fccd41563c0 2023-08-17T17:34:59.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccdb04e700 1 -- 172.21.15.78:0/1954052071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd40ade20 con 0x7fccd41563c0 2023-08-17T17:34:59.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccc8ff9700 1 -- 172.21.15.78:0/1954052071 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd000fe00 con 0x7fccd41563c0 2023-08-17T17:34:59.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.667+0000 7fccdb04e700 1 -- 172.21.15.78:0/1954052071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd41546f0 con 0x7fccd41563c0 2023-08-17T17:34:59.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.668+0000 7fccdb04e700 1 -- 172.21.15.78:0/1954052071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd4047350 con 0x7fccd41563c0 2023-08-17T17:34:59.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.668+0000 7fccc8ff9700 1 -- 172.21.15.78:0/1954052071 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fccd0024070 con 0x7fccd41563c0 2023-08-17T17:34:59.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.669+0000 7fccc8ff9700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccc005edc0 0x7fccc0061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:34:59.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.669+0000 7fccc8ff9700 1 -- 172.21.15.78:0/1954052071 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fccd007a620 con 0x7fccd41563c0 2023-08-17T17:34:59.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.669+0000 7fcccbfff700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccc005edc0 0x7fccc0061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:34:59.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.669+0000 7fcccbfff700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccc005edc0 0x7fccc0061280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fccc4007900 tx=0x7fccc4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:34:59.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.673+0000 7fccc8ff9700 1 -- 172.21.15.78:0/1954052071 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fccd004bbc0 con 0x7fccd41563c0 2023-08-17T17:34:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:34:59.875+0000 7fccdb04e700 1 -- 172.21.15.78:0/1954052071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fccd40a7c40 con 0x7fccd41563c0 2023-08-17T17:35:00.305 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T17:35:00.304+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T17:35:00.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.306+0000 7fccc8ff9700 1 -- 172.21.15.78:0/1954052071 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fccd004f1e0 con 0x7fccd41563c0 2023-08-17T17:35:00.309 INFO:tasks.ceph.mds.c.smithi078.stderr: -1730> 2023-08-17T17:34:29.161+0000 7fbce32fb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:35:00.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 -- 172.21.15.78:0/1954052071 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccc005edc0 msgr2=0x7fccc0061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:00.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccc005edc0 0x7fccc0061280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fccc4007900 tx=0x7fccc4009040).stop 2023-08-17T17:35:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 -- 172.21.15.78:0/1954052071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd41563c0 msgr2=0x7fccd40ab280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd41563c0 0x7fccd40ab280 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fccd00119c0 tx=0x7fccd0009060).stop 2023-08-17T17:35:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 -- 172.21.15.78:0/1954052071 shutdown_connections 2023-08-17T17:35:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fccc005edc0 0x7fccc0061280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd40a9980 0x7fccd40675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd41563c0 0x7fccd40ab280 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 --2- 172.21.15.78:0/1954052071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccd40ad8b0 0x7fccd40a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 -- 172.21.15.78:0/1954052071 >> 172.21.15.78:0/1954052071 conn(0x7fccd4062cd0 msgr2=0x7fccd4156a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 -- 172.21.15.78:0/1954052071 shutdown_connections 2023-08-17T17:35:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.309+0000 7fccdb04e700 1 -- 172.21.15.78:0/1954052071 wait complete. 2023-08-17T17:35:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T17:35:00.324 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T17:35:00.331 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:35:00.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.438+0000 7fa92b4c9700 1 Processor -- start 2023-08-17T17:35:00.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.438+0000 7fa92b4c9700 1 -- start start 2023-08-17T17:35:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa92b4c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa924151500 0x7fa9240c1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa92b4c9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9240c22d0 con 0x7fa924069e10 2023-08-17T17:35:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa92b4c9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9240c16c0 con 0x7fa9241518e0 2023-08-17T17:35:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa92b4c9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240c19a0 con 0x7fa924151500 2023-08-17T17:35:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa929cc6700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa924069e10 0x7fa9240c2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34560/0 (socket says 172.21.15.78:34560) 2023-08-17T17:35:00.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa929cc6700 1 -- 172.21.15.78:0/1693331148 learned_addr learned my addr 172.21.15.78:0/1693331148 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:00.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257163257 0 0) 0x7fa9240c22d0 con 0x7fa924069e10 2023-08-17T17:35:00.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa90c0033f0 con 0x7fa924069e10 2023-08-17T17:35:00.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa92a4c7700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa924151500 0x7fa9240c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:00.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3540310355 0 0) 0x7fa90c0033f0 con 0x7fa924069e10 2023-08-17T17:35:00.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa924151500 msgr2=0x7fa9240c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:00.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa924151500 0x7fa9240c1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:00.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 >> v1:172.21.15.150:6789/0 conn(0x7fa9241518e0 legacy=0x7fa924151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:00.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9240c1c80 con 0x7fa924069e10 2023-08-17T17:35:00.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fa918001470 con 0x7fa924069e10 2023-08-17T17:35:00.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 >> v1:172.21.15.78:6789/0 conn(0x7fa924069e10 legacy=0x7fa9240c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:00.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa90c003910 0x7fa90c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:00.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa90c004690 0x7fa90c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:00.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa924151500 0x7fa90c0050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:00.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240c19a0 con 0x7fa90c004690 2023-08-17T17:35:00.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c00b9c0 con 0x7fa90c003910 2023-08-17T17:35:00.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c00bb80 con 0x7fa924151500 2023-08-17T17:35:00.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa929cc6700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa90c004690 0x7fa90c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:00.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.439+0000 7fa92a4c7700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa90c003910 0x7fa90c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:00.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa92acc8700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa924151500 0x7fa90c0050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:00.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa929cc6700 1 -- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa924151500 msgr2=0x7fa90c0050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:00.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa929cc6700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa924151500 0x7fa90c0050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:00.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa929cc6700 1 -- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa90c003910 msgr2=0x7fa90c003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:00.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa929cc6700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa90c003910 0x7fa90c003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:00.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa929cc6700 1 -- 172.21.15.78:0/1693331148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0033f0 con 0x7fa90c004690 2023-08-17T17:35:00.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa929cc6700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa90c004690 0x7fa90c004b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fa91800c160 tx=0x7fa918001e50).ready entity=mon.0 client_cookie=4c9adeb464bc12da server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:00.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918007a20 con 0x7fa90c004690 2023-08-17T17:35:00.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91800ca90 con 0x7fa90c004690 2023-08-17T17:35:00.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa9294c5700 1 -- 172.21.15.78:0/1693331148 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91800ce10 con 0x7fa90c004690 2023-08-17T17:35:00.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa92b4c9700 1 -- 172.21.15.78:0/1693331148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa90c004690 msgr2=0x7fa90c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:00.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa92b4c9700 1 --2- 172.21.15.78:0/1693331148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa90c004690 0x7fa90c004b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fa91800c160 tx=0x7fa918001e50).stop 2023-08-17T17:35:00.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa92acc8700 1 -- 172.21.15.78:0/1693331148 reap_dead start 2023-08-17T17:35:00.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa92b4c9700 1 -- 172.21.15.78:0/1693331148 shutdown_connections 2023-08-17T17:35:00.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.440+0000 7fa92b4c9700 1 -- 172.21.15.78:0/1693331148 >> 172.21.15.78:0/1693331148 conn(0x7fa9240c6b00 msgr2=0x7fa9240c6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:00.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.441+0000 7fa92b4c9700 1 -- 172.21.15.78:0/1693331148 shutdown_connections 2023-08-17T17:35:00.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.441+0000 7fa92b4c9700 1 -- 172.21.15.78:0/1693331148 wait complete. 2023-08-17T17:35:00.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa92b4c9700 1 Processor -- start 2023-08-17T17:35:00.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa92b4c9700 1 -- start start 2023-08-17T17:35:00.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa92b4c9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa90c004690 0x7fa924164f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:00.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa92b4c9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9240abf10 0x7fa9240ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:00.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa92b4c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9241557e0 0x7fa924155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:00.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa92b4c9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240ac880 con 0x7fa9240abf10 2023-08-17T17:35:00.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa92b4c9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9241621b0 con 0x7fa90c004690 2023-08-17T17:35:00.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa92b4c9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9241564a0 con 0x7fa9241557e0 2023-08-17T17:35:00.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa929cc6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9240abf10 0x7fa9240ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:00.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa929cc6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9240abf10 0x7fa9240ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33282/0 (socket says 172.21.15.78:33282) 2023-08-17T17:35:00.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.442+0000 7fa929cc6700 1 -- 172.21.15.78:0/3763311550 learned_addr learned my addr 172.21.15.78:0/3763311550 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:00.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa92a4c7700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa90c004690 0x7fa924164f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:00.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa92acc8700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9241557e0 0x7fa924155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:00.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa929cc6700 1 -- 172.21.15.78:0/3763311550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9241557e0 msgr2=0x7fa924155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:00.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa929cc6700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9241557e0 0x7fa924155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:00.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa929cc6700 1 -- 172.21.15.78:0/3763311550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa90c004690 msgr2=0x7fa924164f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:00.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa929cc6700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa90c004690 0x7fa924164f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:00.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa929cc6700 1 -- 172.21.15.78:0/3763311550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924156780 con 0x7fa9240abf10 2023-08-17T17:35:00.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa92a4c7700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa90c004690 0x7fa924164f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:00.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa929cc6700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9240abf10 0x7fa9240ac390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fa91800c750 tx=0x7fa918015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:00.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa9227fc700 1 -- 172.21.15.78:0/3763311550 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9180075c0 con 0x7fa9240abf10 2023-08-17T17:35:00.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa9227fc700 1 -- 172.21.15.78:0/3763311550 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9180046b0 con 0x7fa9240abf10 2023-08-17T17:35:00.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa92b4c9700 1 -- 172.21.15.78:0/3763311550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa924156a60 con 0x7fa9240abf10 2023-08-17T17:35:00.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa9227fc700 1 -- 172.21.15.78:0/3763311550 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918004a50 con 0x7fa9240abf10 2023-08-17T17:35:00.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.443+0000 7fa92b4c9700 1 -- 172.21.15.78:0/3763311550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa924165470 con 0x7fa9240abf10 2023-08-17T17:35:00.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.444+0000 7fa92b4c9700 1 -- 172.21.15.78:0/3763311550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa924162500 con 0x7fa9240abf10 2023-08-17T17:35:00.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.444+0000 7fa9227fc700 1 -- 172.21.15.78:0/3763311550 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa91801d070 con 0x7fa9240abf10 2023-08-17T17:35:00.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.445+0000 7fa9227fc700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa91005ed90 0x7fa910061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:00.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.445+0000 7fa9227fc700 1 -- 172.21.15.78:0/3763311550 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fa91807aaf0 con 0x7fa9240abf10 2023-08-17T17:35:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.445+0000 7fa92a4c7700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa91005ed90 0x7fa910061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.445+0000 7fa92a4c7700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa91005ed90 0x7fa910061250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa91c0099f0 tx=0x7fa91c00b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.449+0000 7fa9227fc700 1 -- 172.21.15.78:0/3763311550 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa91804bf30 con 0x7fa9240abf10 2023-08-17T17:35:00.505 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:35:00.507 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:35:00.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:00.656+0000 7fa92b4c9700 1 -- 172.21.15.78:0/3763311550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa92405f910 con 0x7fa9240abf10 2023-08-17T17:35:01.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.321+0000 7fa9227fc700 1 -- 172.21.15.78:0/3763311550 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa91801a070 con 0x7fa9240abf10 2023-08-17T17:35:01.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.323+0000 7fa92b4c9700 1 -- 172.21.15.78:0/3763311550 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa91005ed90 msgr2=0x7fa910061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:01.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.323+0000 7fa92b4c9700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa91005ed90 0x7fa910061250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa91c0099f0 tx=0x7fa91c00b040).stop 2023-08-17T17:35:01.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.323+0000 7fa92b4c9700 1 -- 172.21.15.78:0/3763311550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9240abf10 msgr2=0x7fa9240ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:01.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.323+0000 7fa92b4c9700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9240abf10 0x7fa9240ac390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fa91800c750 tx=0x7fa918015000).stop 2023-08-17T17:35:01.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.324+0000 7fa92b4c9700 1 -- 172.21.15.78:0/3763311550 shutdown_connections 2023-08-17T17:35:01.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.324+0000 7fa92b4c9700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa91005ed90 0x7fa910061250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.324+0000 7fa92b4c9700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9241557e0 0x7fa924155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.324+0000 7fa92b4c9700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa90c004690 0x7fa924164f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.324+0000 7fa92b4c9700 1 --2- 172.21.15.78:0/3763311550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9240abf10 0x7fa9240ac390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.324+0000 7fa92b4c9700 1 -- 172.21.15.78:0/3763311550 >> 172.21.15.78:0/3763311550 conn(0x7fa9240c6b00 msgr2=0x7fa9240bc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:01.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.324+0000 7fa92b4c9700 1 -- 172.21.15.78:0/3763311550 shutdown_connections 2023-08-17T17:35:01.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.324+0000 7fa92b4c9700 1 -- 172.21.15.78:0/3763311550 wait complete. 2023-08-17T17:35:01.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T17:35:01.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.452+0000 7fd16bc82700 1 Processor -- start 2023-08-17T17:35:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.452+0000 7fd16bc82700 1 -- start start 2023-08-17T17:35:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd16bc82700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1640aa0f0 0x7fd1640644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd16bc82700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640aa4d0 0x7fd1640c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd16bc82700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd1640c5810 0x7fd1640c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd16bc82700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1640649b0 con 0x7fd1640aa0f0 2023-08-17T17:35:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd16bc82700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1640c6120 con 0x7fd1640c5810 2023-08-17T17:35:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd16bc82700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd164063420 con 0x7fd1640aa4d0 2023-08-17T17:35:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd169a1e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1640aa0f0 0x7fd1640644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd169a1e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1640aa0f0 0x7fd1640644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33284/0 (socket says 172.21.15.78:33284) 2023-08-17T17:35:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd169a1e700 1 -- 172.21.15.78:0/163932826 learned_addr learned my addr 172.21.15.78:0/163932826 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd16921d700 1 --2- 172.21.15.78:0/163932826 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640aa4d0 0x7fd1640c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.453+0000 7fd16a21f700 1 --2- 172.21.15.78:0/163932826 >> v2:172.21.15.150:3300/0 conn(0x7fd1640c5810 0x7fd1640c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.454+0000 7fd16921d700 1 -- 172.21.15.78:0/163932826 >> v2:172.21.15.150:3300/0 conn(0x7fd1640c5810 msgr2=0x7fd1640c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.454+0000 7fd16921d700 1 --2- 172.21.15.78:0/163932826 >> v2:172.21.15.150:3300/0 conn(0x7fd1640c5810 0x7fd1640c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.454+0000 7fd16921d700 1 -- 172.21.15.78:0/163932826 >> v2:172.21.15.78:3300/0 conn(0x7fd1640aa0f0 msgr2=0x7fd1640644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.454+0000 7fd16921d700 1 --2- 172.21.15.78:0/163932826 >> v2:172.21.15.78:3300/0 conn(0x7fd1640aa0f0 0x7fd1640644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.454+0000 7fd16921d700 1 -- 172.21.15.78:0/163932826 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd164063700 con 0x7fd1640aa4d0 2023-08-17T17:35:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.454+0000 7fd16921d700 1 --2- 172.21.15.78:0/163932826 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640aa4d0 0x7fd1640c0e10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd164159060 tx=0x7fd154009060).ready entity=mon.2 client_cookie=269e270817b10b39 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:01.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.454+0000 7fd168a1c700 1 -- 172.21.15.78:0/163932826 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15400d4a0 con 0x7fd1640aa4d0 2023-08-17T17:35:01.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.454+0000 7fd168a1c700 1 -- 172.21.15.78:0/163932826 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15400d600 con 0x7fd1640aa4d0 2023-08-17T17:35:01.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.454+0000 7fd168a1c700 1 -- 172.21.15.78:0/163932826 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15400d980 con 0x7fd1640aa4d0 2023-08-17T17:35:01.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.455+0000 7fd16bc82700 1 -- 172.21.15.78:0/163932826 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640aa4d0 msgr2=0x7fd1640c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:01.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.455+0000 7fd16bc82700 1 --2- 172.21.15.78:0/163932826 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640aa4d0 0x7fd1640c0e10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd164159060 tx=0x7fd154009060).stop 2023-08-17T17:35:01.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.455+0000 7fd16bc82700 1 -- 172.21.15.78:0/163932826 shutdown_connections 2023-08-17T17:35:01.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.455+0000 7fd16bc82700 1 --2- 172.21.15.78:0/163932826 >> v2:172.21.15.78:3300/0 conn(0x7fd1640aa0f0 0x7fd1640644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.455+0000 7fd16bc82700 1 --2- 172.21.15.78:0/163932826 >> v2:172.21.15.150:3300/0 conn(0x7fd1640c5810 0x7fd1640c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.455+0000 7fd16bc82700 1 --2- 172.21.15.78:0/163932826 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640aa4d0 0x7fd1640c0e10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.455+0000 7fd16bc82700 1 -- 172.21.15.78:0/163932826 >> 172.21.15.78:0/163932826 conn(0x7fd16406a6a0 msgr2=0x7fd1640caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:01.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.455+0000 7fd16bc82700 1 -- 172.21.15.78:0/163932826 shutdown_connections 2023-08-17T17:35:01.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.455+0000 7fd16bc82700 1 -- 172.21.15.78:0/163932826 wait complete. 2023-08-17T17:35:01.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.456+0000 7fd16bc82700 1 Processor -- start 2023-08-17T17:35:01.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.456+0000 7fd16bc82700 1 -- start start 2023-08-17T17:35:01.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd16bc82700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640aa0f0 0x7fd164167f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:01.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd16bc82700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1640aa4d0 0x7fd1640984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd16bc82700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640c5810 0x7fd164142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd16bc82700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640ad950 con 0x7fd1640aa0f0 2023-08-17T17:35:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd16bc82700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd164168e30 con 0x7fd1640aa4d0 2023-08-17T17:35:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd16bc82700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd164168590 con 0x7fd1640c5810 2023-08-17T17:35:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd169a1e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640aa0f0 0x7fd164167f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd169a1e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640aa0f0 0x7fd164167f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33296/0 (socket says 172.21.15.78:33296) 2023-08-17T17:35:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd169a1e700 1 -- 172.21.15.78:0/112672026 learned_addr learned my addr 172.21.15.78:0/112672026 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd16921d700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1640aa4d0 0x7fd1640984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd16a21f700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640c5810 0x7fd164142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd169a1e700 1 -- 172.21.15.78:0/112672026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640c5810 msgr2=0x7fd164142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd169a1e700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640c5810 0x7fd164142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd169a1e700 1 -- 172.21.15.78:0/112672026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1640aa4d0 msgr2=0x7fd1640984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd169a1e700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1640aa4d0 0x7fd1640984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd169a1e700 1 -- 172.21.15.78:0/112672026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1540092a0 con 0x7fd1640aa0f0 2023-08-17T17:35:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd16921d700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1640aa4d0 0x7fd1640984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd169a1e700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640aa0f0 0x7fd164167f40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fd160009ed0 tx=0x7fd16000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd159ffb700 1 -- 172.21.15.78:0/112672026 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000ca70 con 0x7fd1640aa0f0 2023-08-17T17:35:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd159ffb700 1 -- 172.21.15.78:0/112672026 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16000f040 con 0x7fd1640aa0f0 2023-08-17T17:35:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd16bc82700 1 -- 172.21.15.78:0/112672026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd164168870 con 0x7fd1640aa0f0 2023-08-17T17:35:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.457+0000 7fd159ffb700 1 -- 172.21.15.78:0/112672026 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000cde0 con 0x7fd1640aa0f0 2023-08-17T17:35:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.458+0000 7fd16bc82700 1 -- 172.21.15.78:0/112672026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1640c2e50 con 0x7fd1640aa0f0 2023-08-17T17:35:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.458+0000 7fd16bc82700 1 -- 172.21.15.78:0/112672026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd164083980 con 0x7fd1640aa0f0 2023-08-17T17:35:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.458+0000 7fd159ffb700 1 -- 172.21.15.78:0/112672026 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd16001b030 con 0x7fd1640aa0f0 2023-08-17T17:35:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.459+0000 7fd159ffb700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd14805ed60 0x7fd148061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.459+0000 7fd159ffb700 1 -- 172.21.15.78:0/112672026 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd1600799b0 con 0x7fd1640aa0f0 2023-08-17T17:35:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.459+0000 7fd16921d700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd14805ed60 0x7fd148061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.459+0000 7fd16921d700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd14805ed60 0x7fd148061220 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fd154009fd0 tx=0x7fd154016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.463+0000 7fd159ffb700 1 -- 172.21.15.78:0/112672026 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd16004afb0 con 0x7fd1640aa0f0 2023-08-17T17:35:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:01.627+0000 7fd16bc82700 1 -- 172.21.15.78:0/112672026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd164046af0 con 0x7fd1640aa0f0 2023-08-17T17:35:02.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.322+0000 7fd159ffb700 1 -- 172.21.15.78:0/112672026 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd164046af0 con 0x7fd1640aa0f0 2023-08-17T17:35:02.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.325+0000 7fd16bc82700 1 -- 172.21.15.78:0/112672026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd14805ed60 msgr2=0x7fd148061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:02.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.325+0000 7fd16bc82700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd14805ed60 0x7fd148061220 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fd154009fd0 tx=0x7fd154016000).stop 2023-08-17T17:35:02.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.326+0000 7fd16bc82700 1 -- 172.21.15.78:0/112672026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640aa0f0 msgr2=0x7fd164167f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:02.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.326+0000 7fd16bc82700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640aa0f0 0x7fd164167f40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fd160009ed0 tx=0x7fd16000b040).stop 2023-08-17T17:35:02.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.326+0000 7fd16bc82700 1 -- 172.21.15.78:0/112672026 shutdown_connections 2023-08-17T17:35:02.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.326+0000 7fd16bc82700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd14805ed60 0x7fd148061220 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:02.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.326+0000 7fd16bc82700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1640c5810 0x7fd164142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:02.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.326+0000 7fd16bc82700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640aa0f0 0x7fd164167f40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:02.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.326+0000 7fd16bc82700 1 --2- 172.21.15.78:0/112672026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1640aa4d0 0x7fd1640984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:02.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.326+0000 7fd16bc82700 1 -- 172.21.15.78:0/112672026 >> 172.21.15.78:0/112672026 conn(0x7fd16406a6a0 msgr2=0x7fd164151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:02.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.326+0000 7fd16bc82700 1 -- 172.21.15.78:0/112672026 shutdown_connections 2023-08-17T17:35:02.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.326+0000 7fd16bc82700 1 -- 172.21.15.78:0/112672026 wait complete. 2023-08-17T17:35:02.329 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T17:35:02.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T17:35:02.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.462+0000 7f40fa710700 1 Processor -- start 2023-08-17T17:35:02.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.462+0000 7f40fa710700 1 -- start start 2023-08-17T17:35:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.463+0000 7f40fa710700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40f40aa0f0 0x7f40f40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.463+0000 7f40fa710700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f40f40aa4d0 0x7f40f40c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.463+0000 7f40fa710700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f40649b0 con 0x7f40f40c5810 2023-08-17T17:35:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.463+0000 7f40fa710700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f4063420 con 0x7f40f40aa0f0 2023-08-17T17:35:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.463+0000 7f40fa710700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f4063700 con 0x7f40f40aa4d0 2023-08-17T17:35:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.463+0000 7f40f3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40f40aa0f0 0x7f40f40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.463+0000 7f40f8cad700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f40f40c5810 0x7f40f40a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34566/0 (socket says 172.21.15.78:34566) 2023-08-17T17:35:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.463+0000 7f40f8cad700 1 -- 172.21.15.78:0/1501545725 learned_addr learned my addr 172.21.15.78:0/1501545725 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f37fe700 1 --2- 172.21.15.78:0/1501545725 >> v2:172.21.15.150:3300/0 conn(0x7f40f40aa4d0 0x7f40f40c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f3fff700 1 -- 172.21.15.78:0/1501545725 >> v2:172.21.15.150:3300/0 conn(0x7f40f40aa4d0 msgr2=0x7f40f40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f3fff700 1 --2- 172.21.15.78:0/1501545725 >> v2:172.21.15.150:3300/0 conn(0x7f40f40aa4d0 0x7f40f40c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f2ffd700 1 -- 172.21.15.78:0/1501545725 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858399991 0 0) 0x7f40f40649b0 con 0x7f40f40c5810 2023-08-17T17:35:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f3fff700 1 -- 172.21.15.78:0/1501545725 >> v1:172.21.15.78:6789/0 conn(0x7f40f40c5810 legacy=0x7f40f40a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f3fff700 1 -- 172.21.15.78:0/1501545725 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40639e0 con 0x7f40f40aa0f0 2023-08-17T17:35:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f37fe700 1 --2- 172.21.15.78:0/1501545725 >> v2:172.21.15.150:3300/0 conn(0x7f40f40aa4d0 0x7f40f40c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f3fff700 1 --2- 172.21.15.78:0/1501545725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa0f0 0x7f40f40644c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f40f4159060 tx=0x7f40e4009060).ready entity=mon.0 client_cookie=94e067c05df7e366 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f2ffd700 1 -- 172.21.15.78:0/1501545725 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400b580 con 0x7f40f40aa0f0 2023-08-17T17:35:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f2ffd700 1 -- 172.21.15.78:0/1501545725 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e400b6e0 con 0x7f40f40aa0f0 2023-08-17T17:35:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40f2ffd700 1 -- 172.21.15.78:0/1501545725 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400ba60 con 0x7f40f40aa0f0 2023-08-17T17:35:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40fa710700 1 -- 172.21.15.78:0/1501545725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa0f0 msgr2=0x7f40f40644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40fa710700 1 --2- 172.21.15.78:0/1501545725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa0f0 0x7f40f40644c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f40f4159060 tx=0x7f40e4009060).stop 2023-08-17T17:35:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40fa710700 1 -- 172.21.15.78:0/1501545725 shutdown_connections 2023-08-17T17:35:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40fa710700 1 --2- 172.21.15.78:0/1501545725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa0f0 0x7f40f40644c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40fa710700 1 --2- 172.21.15.78:0/1501545725 >> v2:172.21.15.150:3300/0 conn(0x7f40f40aa4d0 0x7f40f40c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40fa710700 1 -- 172.21.15.78:0/1501545725 >> 172.21.15.78:0/1501545725 conn(0x7f40f406a6a0 msgr2=0x7f40f40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40fa710700 1 -- 172.21.15.78:0/1501545725 shutdown_connections 2023-08-17T17:35:02.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.464+0000 7f40fa710700 1 -- 172.21.15.78:0/1501545725 wait complete. 2023-08-17T17:35:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.465+0000 7f40fa710700 1 Processor -- start 2023-08-17T17:35:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.466+0000 7f40fa710700 1 -- start start 2023-08-17T17:35:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.466+0000 7f40fa710700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40f40aa0f0 0x7f40f4150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.466+0000 7f40fa710700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa4d0 0x7f40f4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.466+0000 7f40fa710700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f40c5810 0x7f40f40c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.466+0000 7f40fa710700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40afd30 con 0x7f40f40aa4d0 2023-08-17T17:35:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.466+0000 7f40fa710700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40af120 con 0x7f40f40c5810 2023-08-17T17:35:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.466+0000 7f40fa710700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40af400 con 0x7f40f40aa0f0 2023-08-17T17:35:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40f37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa4d0 0x7f40f4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40f37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa4d0 0x7f40f4154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33328/0 (socket says 172.21.15.78:33328) 2023-08-17T17:35:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40f37fe700 1 -- 172.21.15.78:0/639008316 learned_addr learned my addr 172.21.15.78:0/639008316 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40f37fe700 1 -- 172.21.15.78:0/639008316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40f40aa0f0 msgr2=0x7f40f4150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40f37fe700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40f40aa0f0 0x7f40f4150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40f8cad700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f40c5810 0x7f40f40c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40f37fe700 1 -- 172.21.15.78:0/639008316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f40c5810 msgr2=0x7f40f40c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40f37fe700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f40c5810 0x7f40f40c03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40f37fe700 1 -- 172.21.15.78:0/639008316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40092a0 con 0x7f40f40aa4d0 2023-08-17T17:35:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40f37fe700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa4d0 0x7f40f4154ae0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f40e800c880 tx=0x7f40e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40dbfff700 1 -- 172.21.15.78:0/639008316 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8010580 con 0x7f40f40aa4d0 2023-08-17T17:35:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40dbfff700 1 -- 172.21.15.78:0/639008316 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e80106e0 con 0x7f40f40aa4d0 2023-08-17T17:35:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40fa710700 1 -- 172.21.15.78:0/639008316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f40af6e0 con 0x7f40f40aa4d0 2023-08-17T17:35:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40dbfff700 1 -- 172.21.15.78:0/639008316 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8010a60 con 0x7f40f40aa4d0 2023-08-17T17:35:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.467+0000 7f40fa710700 1 -- 172.21.15.78:0/639008316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f4150a70 con 0x7f40f40aa4d0 2023-08-17T17:35:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.468+0000 7f40fa710700 1 -- 172.21.15.78:0/639008316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f4083980 con 0x7f40f40aa4d0 2023-08-17T17:35:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.468+0000 7f40dbfff700 1 -- 172.21.15.78:0/639008316 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f40e801b460 con 0x7f40f40aa4d0 2023-08-17T17:35:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.469+0000 7f40dbfff700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40e005ed90 0x7f40e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.469+0000 7f40dbfff700 1 -- 172.21.15.78:0/639008316 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f40e8079bc0 con 0x7f40f40aa4d0 2023-08-17T17:35:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.469+0000 7f40f3fff700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40e005ed90 0x7f40e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.469+0000 7f40f3fff700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40e005ed90 0x7f40e0061250 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f40e400b340 tx=0x7f40e4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.473+0000 7f40dbfff700 1 -- 172.21.15.78:0/639008316 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f40e804b260 con 0x7f40f40aa4d0 2023-08-17T17:35:02.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:02.639+0000 7f40fa710700 1 -- 172.21.15.78:0/639008316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f40f40afe70 con 0x7f40f40aa4d0 2023-08-17T17:35:03.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.330+0000 7f40dbfff700 1 -- 172.21.15.78:0/639008316 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f40e804e880 con 0x7f40f40aa4d0 2023-08-17T17:35:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 -- 172.21.15.78:0/639008316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40e005ed90 msgr2=0x7f40e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40e005ed90 0x7f40e0061250 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f40e400b340 tx=0x7f40e4017000).stop 2023-08-17T17:35:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 -- 172.21.15.78:0/639008316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa4d0 msgr2=0x7f40f4154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa4d0 0x7f40f4154ae0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f40e800c880 tx=0x7f40e8008040).stop 2023-08-17T17:35:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 -- 172.21.15.78:0/639008316 shutdown_connections 2023-08-17T17:35:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40e005ed90 0x7f40e0061250 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f40c5810 0x7f40f40c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40f40aa0f0 0x7f40f4150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 --2- 172.21.15.78:0/639008316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40f40aa4d0 0x7f40f4154ae0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 -- 172.21.15.78:0/639008316 >> 172.21.15.78:0/639008316 conn(0x7f40f406a6a0 msgr2=0x7f40f40a8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 -- 172.21.15.78:0/639008316 shutdown_connections 2023-08-17T17:35:03.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.332+0000 7f40fa710700 1 -- 172.21.15.78:0/639008316 wait complete. 2023-08-17T17:35:03.336 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T17:35:03.346 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T17:35:03.347 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T17:35:03.347 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T17:35:03.347 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:35:03.347 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T17:35:03.347 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T17:35:03.348 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T17:35:03.348 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:35:03.348 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T17:35:03.348 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T17:35:03.349 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T17:35:03.349 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:35:03.349 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T17:35:03.349 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T17:35:03.350 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T17:35:03.350 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:35:03.355 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T17:35:03.356 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T17:35:03.356 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T17:35:03.357 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T17:35:03.360 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T17:35:03.361 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T17:35:03.361 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T17:35:03.361 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T17:35:03.397 INFO:tasks.ceph.mds.a:Started 2023-08-17T17:35:03.398 DEBUG:teuthology.parallel:result is None 2023-08-17T17:35:03.398 INFO:tasks.ceph.mds.c:Started 2023-08-17T17:35:03.399 DEBUG:teuthology.parallel:result is None 2023-08-17T17:35:03.403 INFO:tasks.ceph.mds.b:Started 2023-08-17T17:35:03.403 DEBUG:teuthology.parallel:result is None 2023-08-17T17:35:03.404 INFO:tasks.ceph.mds.d:Started 2023-08-17T17:35:03.404 DEBUG:teuthology.parallel:result is None 2023-08-17T17:35:03.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T17:35:03.469 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T17:35:03.470 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:35:03.480 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:35:03.480 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T17:35:03.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.533+0000 7fa6fc97d700 1 Processor -- start 2023-08-17T17:35:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.533+0000 7fa6fc97d700 1 -- start start 2023-08-17T17:35:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa6f8151fa0 0x7fa6f80c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f80c72e0 con 0x7fa6f8152380 2023-08-17T17:35:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f80c4bb0 con 0x7fa6f80c8780 2023-08-17T17:35:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f80c4e90 con 0x7fa6f8151fa0 2023-08-17T17:35:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6effff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa6f8152380 0x7fa6f80c4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34586/0 (socket says 172.21.15.78:34586) 2023-08-17T17:35:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6effff700 1 -- 172.21.15.78:0/2662847539 learned_addr learned my addr 172.21.15.78:0/2662847539 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f659c700 1 --2- 172.21.15.78:0/2662847539 >> v2:172.21.15.150:3300/0 conn(0x7fa6f8151fa0 0x7fa6f80c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f5d9b700 1 -- 172.21.15.78:0/2662847539 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559610599 0 0) 0x7fa6f80c72e0 con 0x7fa6f8152380 2023-08-17T17:35:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f5d9b700 1 -- 172.21.15.78:0/2662847539 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e40033f0 con 0x7fa6f8152380 2023-08-17T17:35:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f5d9b700 1 -- 172.21.15.78:0/2662847539 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67841873 0 0) 0x7fa6f80c4bb0 con 0x7fa6f80c8780 2023-08-17T17:35:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f5d9b700 1 -- 172.21.15.78:0/2662847539 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f80c72e0 con 0x7fa6f80c8780 2023-08-17T17:35:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f659c700 1 -- 172.21.15.78:0/2662847539 >> v1:172.21.15.150:6789/0 conn(0x7fa6f80c8780 legacy=0x7fa6f80bdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f5d9b700 1 -- 172.21.15.78:0/2662847539 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3769047207 0 0) 0x7fa6e40033f0 con 0x7fa6f8152380 2023-08-17T17:35:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f659c700 1 -- 172.21.15.78:0/2662847539 >> v1:172.21.15.78:6789/0 conn(0x7fa6f8152380 legacy=0x7fa6f80c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f659c700 1 -- 172.21.15.78:0/2662847539 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f80c6c90 con 0x7fa6f8151fa0 2023-08-17T17:35:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f659c700 1 --2- 172.21.15.78:0/2662847539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8151fa0 0x7fa6f80c3b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fa6e8009760 tx=0x7fa6e8009060).ready entity=mon.1 client_cookie=51ea44488eaa3114 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:03.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f5d9b700 1 -- 172.21.15.78:0/2662847539 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0001470 con 0x7fa6f8151fa0 2023-08-17T17:35:03.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f5d9b700 1 -- 172.21.15.78:0/2662847539 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8011400 con 0x7fa6f8151fa0 2023-08-17T17:35:03.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6f5d9b700 1 -- 172.21.15.78:0/2662847539 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8011780 con 0x7fa6f8151fa0 2023-08-17T17:35:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2662847539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8151fa0 msgr2=0x7fa6f80c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 --2- 172.21.15.78:0/2662847539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8151fa0 0x7fa6f80c3b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fa6e8009760 tx=0x7fa6e8009060).stop 2023-08-17T17:35:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2662847539 shutdown_connections 2023-08-17T17:35:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 --2- 172.21.15.78:0/2662847539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8151fa0 0x7fa6f80c3b90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2662847539 >> 172.21.15.78:0/2662847539 conn(0x7fa6f8062cd0 msgr2=0x7fa6f80c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2662847539 shutdown_connections 2023-08-17T17:35:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.535+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2662847539 wait complete. 2023-08-17T17:35:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.536+0000 7fa6fc97d700 1 Processor -- start 2023-08-17T17:35:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.536+0000 7fa6fc97d700 1 -- start start 2023-08-17T17:35:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.537+0000 7fa6fc97d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c8780 0x7fa6f80a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.537+0000 7fa6fc97d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8151fa0 0x7fa6f80c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.537+0000 7fa6fc97d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f8152380 0x7fa6f80a7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.537+0000 7fa6fc97d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80c2360 con 0x7fa6f80c8780 2023-08-17T17:35:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.537+0000 7fa6fc97d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80ac660 con 0x7fa6f8151fa0 2023-08-17T17:35:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.537+0000 7fa6fc97d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80c1a00 con 0x7fa6f8152380 2023-08-17T17:35:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.537+0000 7fa6f659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c8780 0x7fa6f80a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:03.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.537+0000 7fa6f659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c8780 0x7fa6f80a5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33364/0 (socket says 172.21.15.78:33364) 2023-08-17T17:35:03.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.537+0000 7fa6f659c700 1 -- 172.21.15.78:0/2900579885 learned_addr learned my addr 172.21.15.78:0/2900579885 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:03.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.537+0000 7fa6effff700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8151fa0 0x7fa6f80c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:03.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6f6d9d700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f8152380 0x7fa6f80a7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:03.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6f659c700 1 -- 172.21.15.78:0/2900579885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f8152380 msgr2=0x7fa6f80a7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:03.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6f659c700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f8152380 0x7fa6f80a7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:03.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6f659c700 1 -- 172.21.15.78:0/2900579885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8151fa0 msgr2=0x7fa6f80c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6f659c700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8151fa0 0x7fa6f80c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6f659c700 1 -- 172.21.15.78:0/2900579885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e80092a0 con 0x7fa6f80c8780 2023-08-17T17:35:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6f6d9d700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f8152380 0x7fa6f80a7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6f659c700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c8780 0x7fa6f80a5aa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fa6e8009d50 tx=0x7fa6e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6ee7fc700 1 -- 172.21.15.78:0/2900579885 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80108e0 con 0x7fa6f80c8780 2023-08-17T17:35:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6ee7fc700 1 -- 172.21.15.78:0/2900579885 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8010a40 con 0x7fa6f80c8780 2023-08-17T17:35:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2900579885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f80a6080 con 0x7fa6f80c8780 2023-08-17T17:35:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6ee7fc700 1 -- 172.21.15.78:0/2900579885 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8010de0 con 0x7fa6f80c8780 2023-08-17T17:35:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.538+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2900579885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f80a6640 con 0x7fa6f80c8780 2023-08-17T17:35:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.539+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2900579885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f8047350 con 0x7fa6f80c8780 2023-08-17T17:35:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.539+0000 7fa6ee7fc700 1 -- 172.21.15.78:0/2900579885 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa6e800f070 con 0x7fa6f80c8780 2023-08-17T17:35:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.539+0000 7fa6ee7fc700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6d805ed90 0x7fa6d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.539+0000 7fa6ee7fc700 1 -- 172.21.15.78:0/2900579885 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fa6e807acf0 con 0x7fa6f80c8780 2023-08-17T17:35:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.540+0000 7fa6effff700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6d805ed90 0x7fa6d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.540+0000 7fa6effff700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6d805ed90 0x7fa6d8061250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa6f80c16a0 tx=0x7fa6e00015c0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:03.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.544+0000 7fa6ee7fc700 1 -- 172.21.15.78:0/2900579885 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa6e804c5d0 con 0x7fa6f80c8780 2023-08-17T17:35:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:03.723+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2900579885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa6f80ac7d0 con 0x7fa6f80c8780 2023-08-17T17:35:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.515+0000 7fa6ee7fc700 1 -- 172.21.15.78:0/2900579885 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa6f80ac7d0 con 0x7fa6f80c8780 2023-08-17T17:35:04.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2900579885 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6d805ed90 msgr2=0x7fa6d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:04.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6d805ed90 0x7fa6d8061250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa6f80c16a0 tx=0x7fa6e00015c0).stop 2023-08-17T17:35:04.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2900579885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c8780 msgr2=0x7fa6f80a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:04.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c8780 0x7fa6f80a5aa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fa6e8009d50 tx=0x7fa6e8016000).stop 2023-08-17T17:35:04.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2900579885 shutdown_connections 2023-08-17T17:35:04.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa6d805ed90 0x7fa6d8061250 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6f8152380 0x7fa6f80a7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f80c8780 0x7fa6f80a5aa0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 --2- 172.21.15.78:0/2900579885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f8151fa0 0x7fa6f80c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2900579885 >> 172.21.15.78:0/2900579885 conn(0x7fa6f8062cd0 msgr2=0x7fa6f80679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:04.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2900579885 shutdown_connections 2023-08-17T17:35:04.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.517+0000 7fa6fc97d700 1 -- 172.21.15.78:0/2900579885 wait complete. 2023-08-17T17:35:04.520 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-08-17T17:35:04.531 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T17:35:04.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.645+0000 7f7f03b7b700 1 Processor -- start 2023-08-17T17:35:04.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.646+0000 7f7f03b7b700 1 -- start start 2023-08-17T17:35:04.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.646+0000 7f7f03b7b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7efc062fe0 0x7f7efc0c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:04.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.646+0000 7f7f03b7b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc0c3580 con 0x7f7efc0c2070 2023-08-17T17:35:04.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.646+0000 7f7f03b7b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc0c3a10 con 0x7f7efc0624f0 2023-08-17T17:35:04.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.646+0000 7f7f03b7b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc06b990 con 0x7f7efc062fe0 2023-08-17T17:35:04.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.646+0000 7f7f02118700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7efc0c2070 0x7f7efc06b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34592/0 (socket says 172.21.15.78:34592) 2023-08-17T17:35:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.646+0000 7f7f02118700 1 -- 172.21.15.78:0/4164024476 learned_addr learned my addr 172.21.15.78:0/4164024476 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f01116700 1 --2- 172.21.15.78:0/4164024476 >> v2:172.21.15.150:3300/0 conn(0x7f7efc062fe0 0x7f7efc0c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885565704 0 0) 0x7f7efc0c3580 con 0x7f7efc0c2070 2023-08-17T17:35:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee80033f0 con 0x7f7efc0c2070 2023-08-17T17:35:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1588209792 0 0) 0x7f7ee80033f0 con 0x7f7efc0c2070 2023-08-17T17:35:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 >> v2:172.21.15.150:3300/0 conn(0x7f7efc062fe0 msgr2=0x7f7efc0c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 --2- 172.21.15.78:0/4164024476 >> v2:172.21.15.150:3300/0 conn(0x7f7efc062fe0 0x7f7efc0c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 >> v1:172.21.15.150:6789/0 conn(0x7f7efc0624f0 legacy=0x7f7efc0628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0c2970 con 0x7f7efc0c2070 2023-08-17T17:35:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f7ef40017f0 con 0x7f7efc0c2070 2023-08-17T17:35:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 >> v1:172.21.15.78:6789/0 conn(0x7f7efc0c2070 legacy=0x7f7efc06b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ee80038e0 0x7f7ee8003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee8004690 0x7f7ee8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee8005000 0x7f7ee800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc06b990 con 0x7f7ee80038e0 2023-08-17T17:35:04.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee800bf30 con 0x7f7ee8005000 2023-08-17T17:35:04.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee800c0f0 con 0x7f7ee8004690 2023-08-17T17:35:04.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f01917700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ee80038e0 0x7f7ee8003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:04.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f02118700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee8005000 0x7f7ee800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:04.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f01116700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee8004690 0x7f7ee8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:04.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f01917700 1 -- 172.21.15.78:0/4164024476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee8004690 msgr2=0x7f7ee8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:04.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f01917700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee8004690 0x7f7ee8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f01917700 1 -- 172.21.15.78:0/4164024476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee8005000 msgr2=0x7f7ee800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f01917700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee8005000 0x7f7ee800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f01917700 1 -- 172.21.15.78:0/4164024476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80033f0 con 0x7f7ee80038e0 2023-08-17T17:35:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f02118700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee8005000 0x7f7ee800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.647+0000 7f7f02118700 1 -- 172.21.15.78:0/4164024476 reap_dead start 2023-08-17T17:35:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f01917700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ee80038e0 0x7f7ee8003cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f7ef8001820 tx=0x7f7ef8007b90).ready entity=mon.0 client_cookie=ba8149db922d7872 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8007ea0 con 0x7f7ee80038e0 2023-08-17T17:35:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8012400 con 0x7f7ee80038e0 2023-08-17T17:35:04.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f00915700 1 -- 172.21.15.78:0/4164024476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80127a0 con 0x7f7ee80038e0 2023-08-17T17:35:04.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f03b7b700 1 -- 172.21.15.78:0/4164024476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ee80038e0 msgr2=0x7f7ee8003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:04.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f03b7b700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ee80038e0 0x7f7ee8003cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f7ef8001820 tx=0x7f7ef8007b90).stop 2023-08-17T17:35:04.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f03b7b700 1 -- 172.21.15.78:0/4164024476 shutdown_connections 2023-08-17T17:35:04.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f03b7b700 1 --2- 172.21.15.78:0/4164024476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ee80038e0 0x7f7ee8003cc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f03b7b700 1 -- 172.21.15.78:0/4164024476 >> 172.21.15.78:0/4164024476 conn(0x7f7efc0c3d40 msgr2=0x7f7efc0c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:04.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f03b7b700 1 -- 172.21.15.78:0/4164024476 shutdown_connections 2023-08-17T17:35:04.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.648+0000 7f7f03b7b700 1 -- 172.21.15.78:0/4164024476 wait complete. 2023-08-17T17:35:04.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.649+0000 7f7f03b7b700 1 Processor -- start 2023-08-17T17:35:04.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.649+0000 7f7f03b7b700 1 -- start start 2023-08-17T17:35:04.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f03b7b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee80038e0 0x7f7efc0a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:04.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f03b7b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7efc0634c0 0x7f7efc063940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:04.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f03b7b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc163620 0x7f7efc163a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:04.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f03b7b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc14bf10 con 0x7f7efc163620 2023-08-17T17:35:04.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f03b7b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc1536d0 con 0x7f7ee80038e0 2023-08-17T17:35:04.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f03b7b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc063e30 con 0x7f7efc0634c0 2023-08-17T17:35:04.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f02118700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc163620 0x7f7efc163a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:04.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f02118700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc163620 0x7f7efc163a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33390/0 (socket says 172.21.15.78:33390) 2023-08-17T17:35:04.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f02118700 1 -- 172.21.15.78:0/3144144952 learned_addr learned my addr 172.21.15.78:0/3144144952 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:04.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f01917700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee80038e0 0x7f7efc0a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:04.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.650+0000 7f7f01116700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7efc0634c0 0x7f7efc063940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:04.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7f02118700 1 -- 172.21.15.78:0/3144144952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7efc0634c0 msgr2=0x7f7efc063940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:04.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7f02118700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7efc0634c0 0x7f7efc063940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7f02118700 1 -- 172.21.15.78:0/3144144952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee80038e0 msgr2=0x7f7efc0a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7f02118700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee80038e0 0x7f7efc0a8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7f02118700 1 -- 172.21.15.78:0/3144144952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc14b900 con 0x7f7efc163620 2023-08-17T17:35:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7f02118700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc163620 0x7f7efc163a60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f7efc069ea0 tx=0x7f7ef4007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7ef1ffb700 1 -- 172.21.15.78:0/3144144952 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4010520 con 0x7f7efc163620 2023-08-17T17:35:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7ef1ffb700 1 -- 172.21.15.78:0/3144144952 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4010680 con 0x7f7efc163620 2023-08-17T17:35:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7f03b7b700 1 -- 172.21.15.78:0/3144144952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc1642a0 con 0x7f7efc163620 2023-08-17T17:35:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7ef1ffb700 1 -- 172.21.15.78:0/3144144952 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4010a20 con 0x7f7efc163620 2023-08-17T17:35:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.651+0000 7f7f03b7b700 1 -- 172.21.15.78:0/3144144952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc164580 con 0x7f7efc163620 2023-08-17T17:35:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.652+0000 7f7f03b7b700 1 -- 172.21.15.78:0/3144144952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc047350 con 0x7f7efc163620 2023-08-17T17:35:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.653+0000 7f7ef1ffb700 1 -- 172.21.15.78:0/3144144952 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7ef4014430 con 0x7f7efc163620 2023-08-17T17:35:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.653+0000 7f7ef1ffb700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ee005ed90 0x7f7ee0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.653+0000 7f7ef1ffb700 1 -- 172.21.15.78:0/3144144952 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7ef4079580 con 0x7f7efc163620 2023-08-17T17:35:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.653+0000 7f7f01917700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ee005ed90 0x7f7ee0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.654+0000 7f7f01917700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ee005ed90 0x7f7ee0061250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7efc0c1590 tx=0x7f7ef8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:04.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.657+0000 7f7ef1ffb700 1 -- 172.21.15.78:0/3144144952 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ef404ae10 con 0x7f7efc163620 2023-08-17T17:35:04.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.887+0000 7f7f03b7b700 1 -- 172.21.15.78:0/3144144952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7efc0c2c50 con 0x7f7efc163620 2023-08-17T17:35:04.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.888+0000 7f7ef1ffb700 1 -- 172.21.15.78:0/3144144952 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f7ef404e430 con 0x7f7efc163620 2023-08-17T17:35:04.888 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:35:04.889 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:35:04.889 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-08-17T17:35:04.889 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.889 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-08-17T17:35:04.889 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA==", 2023-08-17T17:35:04.889 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.889 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:35:04.890 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:35:04.890 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:35:04.890 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.890 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.890 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.890 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.890 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-08-17T17:35:04.890 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g==", 2023-08-17T17:35:04.891 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.891 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:35:04.891 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:35:04.891 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:35:04.891 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.891 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.891 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.892 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.892 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-08-17T17:35:04.892 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw==", 2023-08-17T17:35:04.892 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.892 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:35:04.892 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:35:04.892 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:35:04.892 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.893 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.893 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.893 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.893 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-08-17T17:35:04.893 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg==", 2023-08-17T17:35:04.893 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.893 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:35:04.893 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:35:04.894 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:35:04.894 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.894 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.894 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.894 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.894 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-08-17T17:35:04.894 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg==", 2023-08-17T17:35:04.894 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.895 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:35:04.895 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:35:04.895 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.895 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.895 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.895 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.895 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-08-17T17:35:04.896 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw==", 2023-08-17T17:35:04.896 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.896 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:35:04.896 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:35:04.896 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.896 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.896 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.896 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.897 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-08-17T17:35:04.897 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA==", 2023-08-17T17:35:04.897 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.897 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:35:04.897 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:35:04.897 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.897 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.897 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.898 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.898 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-08-17T17:35:04.898 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ==", 2023-08-17T17:35:04.898 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.898 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:35:04.898 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:35:04.898 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.899 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.899 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.899 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.899 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-08-17T17:35:04.899 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA==", 2023-08-17T17:35:04.899 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.899 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:35:04.899 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:35:04.900 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.900 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.900 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.900 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.900 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-08-17T17:35:04.900 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q==", 2023-08-17T17:35:04.900 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.900 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:35:04.901 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:35:04.901 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.901 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.901 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.901 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.901 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-08-17T17:35:04.901 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw==", 2023-08-17T17:35:04.901 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.902 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:35:04.902 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:35:04.902 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.902 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.902 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.902 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.902 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-08-17T17:35:04.903 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg==", 2023-08-17T17:35:04.903 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.903 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:35:04.903 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:35:04.903 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.903 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.903 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.903 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.904 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-08-17T17:35:04.904 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA==", 2023-08-17T17:35:04.904 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.904 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:35:04.904 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:35:04.904 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:35:04.904 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:35:04.904 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.905 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.905 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.905 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-08-17T17:35:04.905 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ==", 2023-08-17T17:35:04.905 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.905 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:35:04.905 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:35:04.906 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:35:04.906 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:35:04.906 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.906 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.906 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.906 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-08-17T17:35:04.906 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ==", 2023-08-17T17:35:04.906 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.907 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:35:04.907 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:35:04.907 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:35:04.907 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:35:04.907 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.907 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.907 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.907 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-08-17T17:35:04.908 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw==", 2023-08-17T17:35:04.908 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.908 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:35:04.908 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:35:04.908 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:35:04.908 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:35:04.908 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.909 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.909 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.909 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-08-17T17:35:04.909 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k6n2yGhAAldYlBQaNGCgXL0HA2ePHVg==", 2023-08-17T17:35:04.909 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.909 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:35:04.909 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:35:04.909 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:35:04.910 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.910 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.910 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.910 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.910 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mds", 2023-08-17T17:35:04.910 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAOWt5kig36EhAAglX07n173imj0q5Z8ieaOg==", 2023-08-17T17:35:04.910 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.910 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mds" 2023-08-17T17:35:04.911 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.911 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.911 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.911 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mgr", 2023-08-17T17:35:04.911 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAOWt5kTRb6EhAA6VHMOKqtrm1ho2UO+WL43Q==", 2023-08-17T17:35:04.911 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.911 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-17T17:35:04.911 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.912 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.912 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.912 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-osd", 2023-08-17T17:35:04.912 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAOWt5kiR/6EhAArVSa/LXFdmUWw2hUyoPSJQ==", 2023-08-17T17:35:04.912 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.912 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-osd" 2023-08-17T17:35:04.912 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.913 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.913 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.913 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd", 2023-08-17T17:35:04.913 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAOWt5kNCf6EhAAffgMkNra+QCIUrzwd05YVw==", 2023-08-17T17:35:04.913 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.913 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-17T17:35:04.913 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.913 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.914 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.914 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-17T17:35:04.914 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAOWt5kvy76EhAAVMp2IdAtO3hE28l3AdWu1Q==", 2023-08-17T17:35:04.914 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.914 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-17T17:35:04.914 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.914 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.915 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.915 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rgw", 2023-08-17T17:35:04.915 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAOWt5kVTb6EhAAcdG6FKxNIvcn4jvFCctHyQ==", 2023-08-17T17:35:04.915 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.915 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-17T17:35:04.915 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.915 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.915 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.916 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-08-17T17:35:04.916 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg==", 2023-08-17T17:35:04.916 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.916 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:35:04.916 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:35:04.916 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.916 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.916 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:04.917 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:04.917 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-08-17T17:35:04.917 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA==", 2023-08-17T17:35:04.917 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:35:04.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:35:04.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:35:04.917 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:35:04.918 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.918 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:04.918 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-08-17T17:35:04.918 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:35:04.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 -- 172.21.15.78:0/3144144952 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ee005ed90 msgr2=0x7f7ee0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:04.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ee005ed90 0x7f7ee0061250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7efc0c1590 tx=0x7f7ef8016000).stop 2023-08-17T17:35:04.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 -- 172.21.15.78:0/3144144952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc163620 msgr2=0x7f7efc163a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:04.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc163620 0x7f7efc163a60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f7efc069ea0 tx=0x7f7ef4007ee0).stop 2023-08-17T17:35:04.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 -- 172.21.15.78:0/3144144952 shutdown_connections 2023-08-17T17:35:04.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ee005ed90 0x7f7ee0061250 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc163620 0x7f7efc163a60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ee80038e0 0x7f7efc0a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 --2- 172.21.15.78:0/3144144952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7efc0634c0 0x7f7efc063940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:04.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 -- 172.21.15.78:0/3144144952 >> 172.21.15.78:0/3144144952 conn(0x7f7efc0c3d40 msgr2=0x7f7efc0ac7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:04.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 -- 172.21.15.78:0/3144144952 shutdown_connections 2023-08-17T17:35:04.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:04.890+0000 7f7f03b7b700 1 -- 172.21.15.78:0/3144144952 wait complete. 2023-08-17T17:35:04.921 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-17T17:35:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.035+0000 7f9eba187700 1 Processor -- start 2023-08-17T17:35:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.035+0000 7f9eba187700 1 -- start start 2023-08-17T17:35:05.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eba187700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4153f80 0x7f9eb40a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eba187700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb40c9ca0 con 0x7f9eb40c0e30 2023-08-17T17:35:05.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eba187700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb40c96b0 con 0x7f9eb40cb890 2023-08-17T17:35:05.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eba187700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40c0080 con 0x7f9eb4153f80 2023-08-17T17:35:05.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eb9986700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9eb40c0e30 0x7f9eb40ca130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34602/0 (socket says 172.21.15.78:34602) 2023-08-17T17:35:05.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eb9986700 1 -- 172.21.15.78:0/490933989 learned_addr learned my addr 172.21.15.78:0/490933989 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:05.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102302850 0 0) 0x7f9eb40c9ca0 con 0x7f9eb40c0e30 2023-08-17T17:35:05.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eb9185700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4153f80 0x7f9eb40a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ea00033f0 con 0x7f9eb40c0e30 2023-08-17T17:35:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1675780291 0 0) 0x7f9ea00033f0 con 0x7f9eb40c0e30 2023-08-17T17:35:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4153f80 msgr2=0x7f9eb40a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eabfff700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4153f80 0x7f9eb40a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 >> v1:172.21.15.150:6789/0 conn(0x7f9eb40cb890 legacy=0x7f9eb40c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb40c0360 con 0x7f9eb40c0e30 2023-08-17T17:35:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f9eac0017f0 con 0x7f9eb40c0e30 2023-08-17T17:35:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.036+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 >> v1:172.21.15.78:6789/0 conn(0x7f9eb40c0e30 legacy=0x7f9eb40ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eabfff700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea0003910 0x7f9ea0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eabfff700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ea0004690 0x7f9ea0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eabfff700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4153f80 0x7f9ea0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40c0080 con 0x7f9ea0004690 2023-08-17T17:35:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea000b910 con 0x7f9ea0003910 2023-08-17T17:35:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea000bad0 con 0x7f9eb4153f80 2023-08-17T17:35:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eb8984700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ea0004690 0x7f9ea0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eb9185700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea0003910 0x7f9ea0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eb9986700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4153f80 0x7f9ea0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eb8984700 1 -- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4153f80 msgr2=0x7f9ea0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eb8984700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4153f80 0x7f9ea0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eb8984700 1 -- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea0003910 msgr2=0x7f9ea0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eb8984700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea0003910 0x7f9ea0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eb8984700 1 -- 172.21.15.78:0/490933989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00033f0 con 0x7f9ea0004690 2023-08-17T17:35:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eb9986700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4153f80 0x7f9ea0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eb8984700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ea0004690 0x7f9ea0004b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f9ea4001700 tx=0x7f9ea4007bb0).ready entity=mon.0 client_cookie=5b2cb4543b34c20c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4007020 con 0x7f9ea0004690 2023-08-17T17:35:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea4007180 con 0x7f9ea0004690 2023-08-17T17:35:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.037+0000 7f9eabfff700 1 -- 172.21.15.78:0/490933989 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4007500 con 0x7f9ea0004690 2023-08-17T17:35:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.038+0000 7f9eba187700 1 -- 172.21.15.78:0/490933989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ea0004690 msgr2=0x7f9ea0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.038+0000 7f9eba187700 1 --2- 172.21.15.78:0/490933989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ea0004690 0x7f9ea0004b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f9ea4001700 tx=0x7f9ea4007bb0).stop 2023-08-17T17:35:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.038+0000 7f9eb9986700 1 -- 172.21.15.78:0/490933989 reap_dead start 2023-08-17T17:35:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.038+0000 7f9eba187700 1 -- 172.21.15.78:0/490933989 shutdown_connections 2023-08-17T17:35:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.038+0000 7f9eba187700 1 -- 172.21.15.78:0/490933989 >> 172.21.15.78:0/490933989 conn(0x7f9eb406a400 msgr2=0x7f9eb40cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.038+0000 7f9eba187700 1 -- 172.21.15.78:0/490933989 shutdown_connections 2023-08-17T17:35:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.038+0000 7f9eba187700 1 -- 172.21.15.78:0/490933989 wait complete. 2023-08-17T17:35:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.039+0000 7f9eba187700 1 Processor -- start 2023-08-17T17:35:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.039+0000 7f9eba187700 1 -- start start 2023-08-17T17:35:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eba187700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ea0004690 0x7f9eb4159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eba187700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb4157cb0 0x7f9eb41418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eba187700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb4157330 0x7f9eb4154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eba187700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb4158da0 con 0x7f9eb4157cb0 2023-08-17T17:35:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eba187700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb4141da0 con 0x7f9eb4157330 2023-08-17T17:35:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eba187700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb4158190 con 0x7f9ea0004690 2023-08-17T17:35:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eb8984700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb4157cb0 0x7f9eb41418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eb8984700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb4157cb0 0x7f9eb41418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33408/0 (socket says 172.21.15.78:33408) 2023-08-17T17:35:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eb8984700 1 -- 172.21.15.78:0/909732613 learned_addr learned my addr 172.21.15.78:0/909732613 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eb9185700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ea0004690 0x7f9eb4159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eb8984700 1 -- 172.21.15.78:0/909732613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ea0004690 msgr2=0x7f9eb4159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eb8984700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ea0004690 0x7f9eb4159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eb8984700 1 -- 172.21.15.78:0/909732613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb4157330 msgr2=0x7f9eb4154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eb8984700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb4157330 0x7f9eb4154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eb8984700 1 -- 172.21.15.78:0/909732613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4158470 con 0x7f9eb4157cb0 2023-08-17T17:35:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eb8984700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb4157cb0 0x7f9eb41418b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f9ea4001cf0 tx=0x7f9ea4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9ea97fa700 1 -- 172.21.15.78:0/909732613 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea401e440 con 0x7f9eb4157cb0 2023-08-17T17:35:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9ea97fa700 1 -- 172.21.15.78:0/909732613 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea401e5c0 con 0x7f9eb4157cb0 2023-08-17T17:35:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9eba187700 1 -- 172.21.15.78:0/909732613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb4158750 con 0x7f9eb4157cb0 2023-08-17T17:35:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.040+0000 7f9ea97fa700 1 -- 172.21.15.78:0/909732613 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea401e980 con 0x7f9eb4157cb0 2023-08-17T17:35:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.041+0000 7f9eba187700 1 -- 172.21.15.78:0/909732613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb4157790 con 0x7f9eb4157cb0 2023-08-17T17:35:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.041+0000 7f9eba187700 1 -- 172.21.15.78:0/909732613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb4158f10 con 0x7f9eb4157cb0 2023-08-17T17:35:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.042+0000 7f9ea97fa700 1 -- 172.21.15.78:0/909732613 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9ea4025030 con 0x7f9eb4157cb0 2023-08-17T17:35:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.042+0000 7f9ea97fa700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805edc0 0x7f9e98061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.042+0000 7f9ea97fa700 1 -- 172.21.15.78:0/909732613 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9ea407a5f0 con 0x7f9eb4157cb0 2023-08-17T17:35:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.042+0000 7f9eb9185700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805edc0 0x7f9e98061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.042+0000 7f9eb9185700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805edc0 0x7f9e98061280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f9eb0009220 tx=0x7f9eb0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.046+0000 7f9ea97fa700 1 -- 172.21.15.78:0/909732613 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ea404bee0 con 0x7f9eb4157cb0 2023-08-17T17:35:05.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.270+0000 7f9eba187700 1 -- 172.21.15.78:0/909732613 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f9eb4065230 con 0x7f9eb4157cb0 2023-08-17T17:35:05.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.273+0000 7f9ea97fa700 1 -- 172.21.15.78:0/909732613 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9ea4023070 con 0x7f9eb4157cb0 2023-08-17T17:35:05.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 -- 172.21.15.78:0/909732613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805edc0 msgr2=0x7f9e98061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805edc0 0x7f9e98061280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f9eb0009220 tx=0x7f9eb0008040).stop 2023-08-17T17:35:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 -- 172.21.15.78:0/909732613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb4157cb0 msgr2=0x7f9eb41418b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb4157cb0 0x7f9eb41418b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f9ea4001cf0 tx=0x7f9ea4016000).stop 2023-08-17T17:35:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 -- 172.21.15.78:0/909732613 shutdown_connections 2023-08-17T17:35:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805edc0 0x7f9e98061280 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb4157330 0x7f9eb4154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ea0004690 0x7f9eb4159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 --2- 172.21.15.78:0/909732613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb4157cb0 0x7f9eb41418b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 -- 172.21.15.78:0/909732613 >> 172.21.15.78:0/909732613 conn(0x7f9eb406a400 msgr2=0x7f9eb4064500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 -- 172.21.15.78:0/909732613 shutdown_connections 2023-08-17T17:35:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.275+0000 7f9eba187700 1 -- 172.21.15.78:0/909732613 wait complete. 2023-08-17T17:35:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:updated 2023-08-17T17:35:05.287 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-17T17:35:05.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.401+0000 7fefb345b700 1 Processor -- start 2023-08-17T17:35:05.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.401+0000 7fefb345b700 1 -- start start 2023-08-17T17:35:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb345b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefac153f80 0x7fefac0a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb345b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fefac0cb890 0x7fefac0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb345b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fefac154360 0x7fefac0c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb345b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefac0c1100 con 0x7fefac154360 2023-08-17T17:35:05.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb345b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefac0c9ca0 con 0x7fefac0cb890 2023-08-17T17:35:05.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb345b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0c96b0 con 0x7fefac153f80 2023-08-17T17:35:05.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb2c5a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fefac154360 0x7fefac0c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb2c5a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fefac154360 0x7fefac0c0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33416/0 (socket says 172.21.15.78:33416) 2023-08-17T17:35:05.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb2c5a700 1 -- 172.21.15.78:0/152075842 learned_addr learned my addr 172.21.15.78:0/152075842 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:05.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb2459700 1 --2- 172.21.15.78:0/152075842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefac153f80 0x7fefac0a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb1c58700 1 --2- 172.21.15.78:0/152075842 >> v2:172.21.15.150:3300/0 conn(0x7fefac0cb890 0x7fefac0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb2c5a700 1 -- 172.21.15.78:0/152075842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefac153f80 msgr2=0x7fefac0a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb2c5a700 1 --2- 172.21.15.78:0/152075842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefac153f80 0x7fefac0a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb2c5a700 1 -- 172.21.15.78:0/152075842 >> v2:172.21.15.150:3300/0 conn(0x7fefac0cb890 msgr2=0x7fefac0c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb2c5a700 1 --2- 172.21.15.78:0/152075842 >> v2:172.21.15.150:3300/0 conn(0x7fefac0cb890 0x7fefac0c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb2c5a700 1 -- 172.21.15.78:0/152075842 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac0c0080 con 0x7fefac154360 2023-08-17T17:35:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb1c58700 1 --2- 172.21.15.78:0/152075842 >> v2:172.21.15.150:3300/0 conn(0x7fefac0cb890 0x7fefac0c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.402+0000 7fefb2c5a700 1 --2- 172.21.15.78:0/152075842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac154360 0x7fefac0c0c10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fefac062740 tx=0x7fef9c0090f0).ready entity=mon.0 client_cookie=89e5427d2d4d881f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:05.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb1457700 1 -- 172.21.15.78:0/152075842 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00b600 con 0x7fefac154360 2023-08-17T17:35:05.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb1457700 1 -- 172.21.15.78:0/152075842 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c00b760 con 0x7fefac154360 2023-08-17T17:35:05.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb1457700 1 -- 172.21.15.78:0/152075842 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00bae0 con 0x7fefac154360 2023-08-17T17:35:05.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb345b700 1 -- 172.21.15.78:0/152075842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac154360 msgr2=0x7fefac0c0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb345b700 1 --2- 172.21.15.78:0/152075842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac154360 0x7fefac0c0c10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fefac062740 tx=0x7fef9c0090f0).stop 2023-08-17T17:35:05.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb345b700 1 -- 172.21.15.78:0/152075842 shutdown_connections 2023-08-17T17:35:05.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb345b700 1 --2- 172.21.15.78:0/152075842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac154360 0x7fefac0c0c10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb345b700 1 --2- 172.21.15.78:0/152075842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefac153f80 0x7fefac0a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb345b700 1 --2- 172.21.15.78:0/152075842 >> v2:172.21.15.150:3300/0 conn(0x7fefac0cb890 0x7fefac0c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb345b700 1 -- 172.21.15.78:0/152075842 >> 172.21.15.78:0/152075842 conn(0x7fefac06a400 msgr2=0x7fefac0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:05.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb345b700 1 -- 172.21.15.78:0/152075842 shutdown_connections 2023-08-17T17:35:05.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.403+0000 7fefb345b700 1 -- 172.21.15.78:0/152075842 wait complete. 2023-08-17T17:35:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.404+0000 7fefb345b700 1 Processor -- start 2023-08-17T17:35:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.404+0000 7fefb345b700 1 -- start start 2023-08-17T17:35:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb345b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac0cb890 0x7fefac0c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb345b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefac153f80 0x7fefac156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb345b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefac154360 0x7fefac14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb345b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac1681c0 con 0x7fefac0cb890 2023-08-17T17:35:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb345b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac167ee0 con 0x7fefac154360 2023-08-17T17:35:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb345b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0c3620 con 0x7fefac153f80 2023-08-17T17:35:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb2459700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac0cb890 0x7fefac0c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb2459700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac0cb890 0x7fefac0c4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33418/0 (socket says 172.21.15.78:33418) 2023-08-17T17:35:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb2459700 1 -- 172.21.15.78:0/3059228754 learned_addr learned my addr 172.21.15.78:0/3059228754 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb1c58700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefac153f80 0x7fefac156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.405+0000 7fefb2c5a700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefac154360 0x7fefac14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefb2459700 1 -- 172.21.15.78:0/3059228754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefac153f80 msgr2=0x7fefac156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefb2459700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefac153f80 0x7fefac156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefb2459700 1 -- 172.21.15.78:0/3059228754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefac154360 msgr2=0x7fefac14f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefb2459700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefac154360 0x7fefac14f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefb2459700 1 -- 172.21.15.78:0/3059228754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c009370 con 0x7fefac0cb890 2023-08-17T17:35:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefb2459700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac0cb890 0x7fefac0c4100 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fefa400e190 tx=0x7fefa4009950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefaa7fc700 1 -- 172.21.15.78:0/3059228754 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa400ecd0 con 0x7fefac0cb890 2023-08-17T17:35:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefaa7fc700 1 -- 172.21.15.78:0/3059228754 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa400ee30 con 0x7fefac0cb890 2023-08-17T17:35:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefaa7fc700 1 -- 172.21.15.78:0/3059228754 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4014610 con 0x7fefac0cb890 2023-08-17T17:35:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefb345b700 1 -- 172.21.15.78:0/3059228754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac0c3900 con 0x7fefac0cb890 2023-08-17T17:35:05.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.406+0000 7fefb345b700 1 -- 172.21.15.78:0/3059228754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac0c45f0 con 0x7fefac0cb890 2023-08-17T17:35:05.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.407+0000 7fefb345b700 1 -- 172.21.15.78:0/3059228754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefac0c3480 con 0x7fefac0cb890 2023-08-17T17:35:05.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.407+0000 7fefaa7fc700 1 -- 172.21.15.78:0/3059228754 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fefa401b030 con 0x7fefac0cb890 2023-08-17T17:35:05.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.408+0000 7fefaa7fc700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef9805edc0 0x7fef98061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.408+0000 7fefaa7fc700 1 -- 172.21.15.78:0/3059228754 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fefa4079640 con 0x7fefac0cb890 2023-08-17T17:35:05.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.408+0000 7fefb1c58700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef9805edc0 0x7fef98061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.408+0000 7fefb1c58700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef9805edc0 0x7fef98061280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fefac062710 tx=0x7fefa0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:05.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.412+0000 7fefaa7fc700 1 -- 172.21.15.78:0/3059228754 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fefac0c3480 con 0x7fefac0cb890 2023-08-17T17:35:05.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.638+0000 7fefb345b700 1 -- 172.21.15.78:0/3059228754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fefac0c3480 con 0x7fefac0cb890 2023-08-17T17:35:05.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.641+0000 7fefaa7fc700 1 -- 172.21.15.78:0/3059228754 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7fefac0c3480 con 0x7fefac0cb890 2023-08-17T17:35:05.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 -- 172.21.15.78:0/3059228754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef9805edc0 msgr2=0x7fef98061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef9805edc0 0x7fef98061280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fefac062710 tx=0x7fefa0008040).stop 2023-08-17T17:35:05.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 -- 172.21.15.78:0/3059228754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac0cb890 msgr2=0x7fefac0c4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac0cb890 0x7fefac0c4100 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fefa400e190 tx=0x7fefa4009950).stop 2023-08-17T17:35:05.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 -- 172.21.15.78:0/3059228754 shutdown_connections 2023-08-17T17:35:05.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef9805edc0 0x7fef98061280 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefac154360 0x7fefac14f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefac0cb890 0x7fefac0c4100 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 --2- 172.21.15.78:0/3059228754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefac153f80 0x7fefac156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 -- 172.21.15.78:0/3059228754 >> 172.21.15.78:0/3059228754 conn(0x7fefac06a400 msgr2=0x7fefac0c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:05.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 -- 172.21.15.78:0/3059228754 shutdown_connections 2023-08-17T17:35:05.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.643+0000 7fefb345b700 1 -- 172.21.15.78:0/3059228754 wait complete. 2023-08-17T17:35:05.646 INFO:teuthology.orchestra.run.smithi078.stderr:updated 2023-08-17T17:35:05.655 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-17T17:35:05.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.768+0000 7f8183f4e700 1 Processor -- start 2023-08-17T17:35:05.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.768+0000 7f8183f4e700 1 -- start start 2023-08-17T17:35:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.769+0000 7f8183f4e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817c1541a0 0x7f817c0a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.769+0000 7f8183f4e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f817c0c0560 0x7f817c0c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.769+0000 7f8183f4e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c0c8df0 con 0x7f817c154580 2023-08-17T17:35:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.769+0000 7f8183f4e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c0a8190 con 0x7f817c0c0560 2023-08-17T17:35:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.769+0000 7f8183f4e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0c9970 con 0x7f817c1541a0 2023-08-17T17:35:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.769+0000 7f81824eb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f817c0c0560 0x7f817c0c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.769+0000 7f81814e9700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f817c154580 0x7f817c0bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34616/0 (socket says 172.21.15.78:34616) 2023-08-17T17:35:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.769+0000 7f81814e9700 1 -- 172.21.15.78:0/3695887669 learned_addr learned my addr 172.21.15.78:0/3695887669 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f8181cea700 1 --2- 172.21.15.78:0/3695887669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817c1541a0 0x7f817c0a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f81824eb700 1 -- 172.21.15.78:0/3695887669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817c1541a0 msgr2=0x7f817c0a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:05.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f81824eb700 1 --2- 172.21.15.78:0/3695887669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817c1541a0 0x7f817c0a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f81824eb700 1 -- 172.21.15.78:0/3695887669 >> v1:172.21.15.78:6789/0 conn(0x7f817c154580 legacy=0x7f817c0bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f8180ce8700 1 -- 172.21.15.78:0/3695887669 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522549952 0 0) 0x7f817c0c8df0 con 0x7f817c154580 2023-08-17T17:35:05.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f81824eb700 1 -- 172.21.15.78:0/3695887669 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0c9040 con 0x7f817c0c0560 2023-08-17T17:35:05.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f81824eb700 1 --2- 172.21.15.78:0/3695887669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c0c0560 0x7f817c0c6f80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f8174009e60 tx=0x7f8174009780).ready entity=mon.0 client_cookie=a1eb888754f53f4d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:05.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f8180ce8700 1 -- 172.21.15.78:0/3695887669 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817400e070 con 0x7f817c0c0560 2023-08-17T17:35:05.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f8180ce8700 1 -- 172.21.15.78:0/3695887669 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817400bc30 con 0x7f817c0c0560 2023-08-17T17:35:05.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f8180ce8700 1 -- 172.21.15.78:0/3695887669 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8174012410 con 0x7f817c0c0560 2023-08-17T17:35:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f8183f4e700 1 -- 172.21.15.78:0/3695887669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c0c0560 msgr2=0x7f817c0c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.770+0000 7f8183f4e700 1 --2- 172.21.15.78:0/3695887669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c0c0560 0x7f817c0c6f80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f8174009e60 tx=0x7f8174009780).stop 2023-08-17T17:35:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.771+0000 7f8183f4e700 1 -- 172.21.15.78:0/3695887669 shutdown_connections 2023-08-17T17:35:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.771+0000 7f8183f4e700 1 --2- 172.21.15.78:0/3695887669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c0c0560 0x7f817c0c6f80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.771+0000 7f8183f4e700 1 --2- 172.21.15.78:0/3695887669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817c1541a0 0x7f817c0a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.771+0000 7f8183f4e700 1 -- 172.21.15.78:0/3695887669 >> 172.21.15.78:0/3695887669 conn(0x7f817c06a400 msgr2=0x7f817c0caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.771+0000 7f8183f4e700 1 -- 172.21.15.78:0/3695887669 shutdown_connections 2023-08-17T17:35:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.771+0000 7f8183f4e700 1 -- 172.21.15.78:0/3695887669 wait complete. 2023-08-17T17:35:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.772+0000 7f8183f4e700 1 Processor -- start 2023-08-17T17:35:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.772+0000 7f8183f4e700 1 -- start start 2023-08-17T17:35:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.772+0000 7f8183f4e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817c0c0560 0x7f817c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.772+0000 7f8183f4e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c1541a0 0x7f817c156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.772+0000 7f8183f4e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817c154580 0x7f817c14f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.772+0000 7f8183f4e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c157a10 con 0x7f817c1541a0 2023-08-17T17:35:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.772+0000 7f8183f4e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0ae590 con 0x7f817c154580 2023-08-17T17:35:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.772+0000 7f8183f4e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c157730 con 0x7f817c0c0560 2023-08-17T17:35:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f81814e9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c1541a0 0x7f817c156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f81814e9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c1541a0 0x7f817c156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33446/0 (socket says 172.21.15.78:33446) 2023-08-17T17:35:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f81814e9700 1 -- 172.21.15.78:0/757891667 learned_addr learned my addr 172.21.15.78:0/757891667 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f8181cea700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817c0c0560 0x7f817c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f81814e9700 1 -- 172.21.15.78:0/757891667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817c0c0560 msgr2=0x7f817c155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f81814e9700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817c0c0560 0x7f817c155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f81824eb700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817c154580 0x7f817c14f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f81814e9700 1 -- 172.21.15.78:0/757891667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817c154580 msgr2=0x7f817c14f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:05.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f81814e9700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817c154580 0x7f817c14f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:05.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f81814e9700 1 -- 172.21.15.78:0/757891667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174009a20 con 0x7f817c1541a0 2023-08-17T17:35:05.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f81814e9700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c1541a0 0x7f817c156f00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f816c001eb0 tx=0x7f816c007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:05.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f8171ffb700 1 -- 172.21.15.78:0/757891667 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0072e0 con 0x7f817c1541a0 2023-08-17T17:35:05.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f8171ffb700 1 -- 172.21.15.78:0/757891667 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c007460 con 0x7f817c1541a0 2023-08-17T17:35:05.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f8183f4e700 1 -- 172.21.15.78:0/757891667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c0adf40 con 0x7f817c1541a0 2023-08-17T17:35:05.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f8171ffb700 1 -- 172.21.15.78:0/757891667 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0059f0 con 0x7f817c1541a0 2023-08-17T17:35:05.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.773+0000 7f8183f4e700 1 -- 172.21.15.78:0/757891667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c155a30 con 0x7f817c1541a0 2023-08-17T17:35:05.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.774+0000 7f8183f4e700 1 -- 172.21.15.78:0/757891667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c047350 con 0x7f817c1541a0 2023-08-17T17:35:05.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.774+0000 7f8171ffb700 1 -- 172.21.15.78:0/757891667 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f816c010070 con 0x7f817c1541a0 2023-08-17T17:35:05.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.775+0000 7f8171ffb700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f816005ed60 0x7f8160061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:05.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.775+0000 7f8171ffb700 1 -- 172.21.15.78:0/757891667 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f816c078f00 con 0x7f817c1541a0 2023-08-17T17:35:05.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.775+0000 7f8181cea700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f816005ed60 0x7f8160061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:05.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.775+0000 7f8181cea700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f816005ed60 0x7f8160061220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f8178006fd0 tx=0x7f8178008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:05.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:05.779+0000 7f8171ffb700 1 -- 172.21.15.78:0/757891667 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f816c04a6e0 con 0x7f817c1541a0 2023-08-17T17:35:06.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.006+0000 7f8183f4e700 1 -- 172.21.15.78:0/757891667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f817c0c9320 con 0x7f817c1541a0 2023-08-17T17:35:06.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.010+0000 7f8171ffb700 1 -- 172.21.15.78:0/757891667 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f816c04dd00 con 0x7f817c1541a0 2023-08-17T17:35:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 -- 172.21.15.78:0/757891667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f816005ed60 msgr2=0x7f8160061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f816005ed60 0x7f8160061220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f8178006fd0 tx=0x7f8178008040).stop 2023-08-17T17:35:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 -- 172.21.15.78:0/757891667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c1541a0 msgr2=0x7f817c156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c1541a0 0x7f817c156f00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f816c001eb0 tx=0x7f816c007b90).stop 2023-08-17T17:35:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 -- 172.21.15.78:0/757891667 shutdown_connections 2023-08-17T17:35:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f816005ed60 0x7f8160061220 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817c154580 0x7f817c14f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817c0c0560 0x7f817c155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 --2- 172.21.15.78:0/757891667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f817c1541a0 0x7f817c156f00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 -- 172.21.15.78:0/757891667 >> 172.21.15.78:0/757891667 conn(0x7f817c06a400 msgr2=0x7f817c0bfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 -- 172.21.15.78:0/757891667 shutdown_connections 2023-08-17T17:35:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.012+0000 7f8183f4e700 1 -- 172.21.15.78:0/757891667 wait complete. 2023-08-17T17:35:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:updated 2023-08-17T17:35:06.024 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-17T17:35:06.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.138+0000 7fa896c5e700 1 Processor -- start 2023-08-17T17:35:06.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.138+0000 7fa896c5e700 1 -- start start 2023-08-17T17:35:06.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.139+0000 7fa896c5e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa890154580 0x7fa8900a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.139+0000 7fa896c5e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8900c0560 0x7fa8900c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.139+0000 7fa896c5e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8900c8df0 con 0x7fa8901541a0 2023-08-17T17:35:06.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.139+0000 7fa896c5e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8900a8190 con 0x7fa8900c0560 2023-08-17T17:35:06.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.139+0000 7fa896c5e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900c9970 con 0x7fa890154580 2023-08-17T17:35:06.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa8951fb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8900c0560 0x7fa8900c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa887fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa890154580 0x7fa8900a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa8949fa700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa8901541a0 0x7fa8900bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:54450/0 (socket says 172.21.15.78:54450) 2023-08-17T17:35:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa8949fa700 1 -- 172.21.15.78:0/2332386428 learned_addr learned my addr 172.21.15.78:0/2332386428 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa887fff700 1 -- 172.21.15.78:0/2332386428 >> v2:172.21.15.150:3300/0 conn(0x7fa8900c0560 msgr2=0x7fa8900c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa887fff700 1 --2- 172.21.15.78:0/2332386428 >> v2:172.21.15.150:3300/0 conn(0x7fa8900c0560 0x7fa8900c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa8877fe700 1 -- 172.21.15.78:0/2332386428 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791028749 0 0) 0x7fa8900c8df0 con 0x7fa8901541a0 2023-08-17T17:35:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa887fff700 1 -- 172.21.15.78:0/2332386428 >> v1:172.21.15.150:6789/0 conn(0x7fa8901541a0 legacy=0x7fa8900bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa887fff700 1 -- 172.21.15.78:0/2332386428 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900c9040 con 0x7fa890154580 2023-08-17T17:35:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa887fff700 1 --2- 172.21.15.78:0/2332386428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa890154580 0x7fa8900a7ca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa880009760 tx=0x7fa880009060).ready entity=mon.2 client_cookie=7ca915018ea1e0b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa8877fe700 1 -- 172.21.15.78:0/2332386428 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800090d0 con 0x7fa890154580 2023-08-17T17:35:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa8877fe700 1 -- 172.21.15.78:0/2332386428 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000f510 con 0x7fa890154580 2023-08-17T17:35:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.140+0000 7fa8877fe700 1 -- 172.21.15.78:0/2332386428 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000f890 con 0x7fa890154580 2023-08-17T17:35:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.141+0000 7fa896c5e700 1 -- 172.21.15.78:0/2332386428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa890154580 msgr2=0x7fa8900a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.141+0000 7fa896c5e700 1 --2- 172.21.15.78:0/2332386428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa890154580 0x7fa8900a7ca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa880009760 tx=0x7fa880009060).stop 2023-08-17T17:35:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.141+0000 7fa896c5e700 1 -- 172.21.15.78:0/2332386428 shutdown_connections 2023-08-17T17:35:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.141+0000 7fa896c5e700 1 --2- 172.21.15.78:0/2332386428 >> v2:172.21.15.150:3300/0 conn(0x7fa8900c0560 0x7fa8900c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.141+0000 7fa896c5e700 1 --2- 172.21.15.78:0/2332386428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa890154580 0x7fa8900a7ca0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.141+0000 7fa896c5e700 1 -- 172.21.15.78:0/2332386428 >> 172.21.15.78:0/2332386428 conn(0x7fa89006a400 msgr2=0x7fa8900caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.141+0000 7fa896c5e700 1 -- 172.21.15.78:0/2332386428 shutdown_connections 2023-08-17T17:35:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.141+0000 7fa896c5e700 1 -- 172.21.15.78:0/2332386428 wait complete. 2023-08-17T17:35:06.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.142+0000 7fa896c5e700 1 Processor -- start 2023-08-17T17:35:06.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.142+0000 7fa896c5e700 1 -- start start 2023-08-17T17:35:06.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa896c5e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8900c0560 0x7fa89014d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa896c5e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8901541a0 0x7fa890151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa896c5e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa890154580 0x7fa890151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa896c5e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa890151fe0 con 0x7fa890154580 2023-08-17T17:35:06.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa896c5e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa890168060 con 0x7fa8900c0560 2023-08-17T17:35:06.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa896c5e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa890167450 con 0x7fa8901541a0 2023-08-17T17:35:06.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa8951fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa890154580 0x7fa890151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa8951fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa890154580 0x7fa890151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33450/0 (socket says 172.21.15.78:33450) 2023-08-17T17:35:06.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa8951fb700 1 -- 172.21.15.78:0/264195068 learned_addr learned my addr 172.21.15.78:0/264195068 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:06.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa8949fa700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8900c0560 0x7fa89014d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa887fff700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8901541a0 0x7fa890151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa8951fb700 1 -- 172.21.15.78:0/264195068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8901541a0 msgr2=0x7fa890151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa8951fb700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8901541a0 0x7fa890151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa8951fb700 1 -- 172.21.15.78:0/264195068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8900c0560 msgr2=0x7fa89014d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa8951fb700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8900c0560 0x7fa89014d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.143+0000 7fa8951fb700 1 -- 172.21.15.78:0/264195068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8800092a0 con 0x7fa890154580 2023-08-17T17:35:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.144+0000 7fa8951fb700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa890154580 0x7fa890151af0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fa88800e6f0 tx=0x7fa888009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.144+0000 7fa884ff9700 1 -- 172.21.15.78:0/264195068 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888009350 con 0x7fa890154580 2023-08-17T17:35:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.144+0000 7fa884ff9700 1 -- 172.21.15.78:0/264195068 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa888012600 con 0x7fa890154580 2023-08-17T17:35:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.144+0000 7fa896c5e700 1 -- 172.21.15.78:0/264195068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa890167730 con 0x7fa890154580 2023-08-17T17:35:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.144+0000 7fa884ff9700 1 -- 172.21.15.78:0/264195068 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888012980 con 0x7fa890154580 2023-08-17T17:35:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.144+0000 7fa896c5e700 1 -- 172.21.15.78:0/264195068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa890167cf0 con 0x7fa890154580 2023-08-17T17:35:06.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.145+0000 7fa896c5e700 1 -- 172.21.15.78:0/264195068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8901681f0 con 0x7fa890154580 2023-08-17T17:35:06.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.145+0000 7fa884ff9700 1 -- 172.21.15.78:0/264195068 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa888022070 con 0x7fa890154580 2023-08-17T17:35:06.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.145+0000 7fa884ff9700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa87c05ed90 0x7fa87c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.145+0000 7fa884ff9700 1 -- 172.21.15.78:0/264195068 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa888079a50 con 0x7fa890154580 2023-08-17T17:35:06.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.145+0000 7fa8949fa700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa87c05ed90 0x7fa87c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.146+0000 7fa8949fa700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa87c05ed90 0x7fa87c061250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fa88c007fd0 tx=0x7fa88c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:06.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.149+0000 7fa884ff9700 1 -- 172.21.15.78:0/264195068 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa88804b340 con 0x7fa890154580 2023-08-17T17:35:06.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.376+0000 7fa896c5e700 1 -- 172.21.15.78:0/264195068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa890047350 con 0x7fa890154580 2023-08-17T17:35:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.382+0000 7fa884ff9700 1 -- 172.21.15.78:0/264195068 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa88804e960 con 0x7fa890154580 2023-08-17T17:35:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 -- 172.21.15.78:0/264195068 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa87c05ed90 msgr2=0x7fa87c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa87c05ed90 0x7fa87c061250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fa88c007fd0 tx=0x7fa88c009040).stop 2023-08-17T17:35:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 -- 172.21.15.78:0/264195068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa890154580 msgr2=0x7fa890151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa890154580 0x7fa890151af0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fa88800e6f0 tx=0x7fa888009060).stop 2023-08-17T17:35:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 -- 172.21.15.78:0/264195068 shutdown_connections 2023-08-17T17:35:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa87c05ed90 0x7fa87c061250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa890154580 0x7fa890151af0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8900c0560 0x7fa89014d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 --2- 172.21.15.78:0/264195068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8901541a0 0x7fa890151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 -- 172.21.15.78:0/264195068 >> 172.21.15.78:0/264195068 conn(0x7fa89006a400 msgr2=0x7fa890063c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 -- 172.21.15.78:0/264195068 shutdown_connections 2023-08-17T17:35:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.384+0000 7fa896c5e700 1 -- 172.21.15.78:0/264195068 wait complete. 2023-08-17T17:35:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:updated 2023-08-17T17:35:06.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-17T17:35:06.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.510+0000 7f4773e7c700 1 Processor -- start 2023-08-17T17:35:06.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.510+0000 7f4773e7c700 1 -- start start 2023-08-17T17:35:06.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4773e7c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c0650c0 0x7f476c065700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4773e7c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476c158930 con 0x7f476c1543f0 2023-08-17T17:35:06.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4773e7c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476c158dc0 con 0x7f476c154010 2023-08-17T17:35:06.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4773e7c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c065ce0 con 0x7f476c0650c0 2023-08-17T17:35:06.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4772419700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f476c1543f0 0x7f476c0688b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34622/0 (socket says 172.21.15.78:34622) 2023-08-17T17:35:06.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4772419700 1 -- 172.21.15.78:0/2718694491 learned_addr learned my addr 172.21.15.78:0/2718694491 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:06.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4771417700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c0650c0 0x7f476c065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427444563 0 0) 0x7f476c158930 con 0x7f476c1543f0 2023-08-17T17:35:06.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47580033f0 con 0x7f476c1543f0 2023-08-17T17:35:06.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482041150 0 0) 0x7f476c158dc0 con 0x7f476c154010 2023-08-17T17:35:06.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f476c158930 con 0x7f476c154010 2023-08-17T17:35:06.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 493114544 0 0) 0x7f47580033f0 con 0x7f476c1543f0 2023-08-17T17:35:06.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c0650c0 msgr2=0x7f476c065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:06.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c0650c0 0x7f476c065700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 >> v1:172.21.15.150:6789/0 conn(0x7f476c154010 legacy=0x7f476c0649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c158040 con 0x7f476c1543f0 2023-08-17T17:35:06.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f47640017f0 con 0x7f476c1543f0 2023-08-17T17:35:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 >> v1:172.21.15.78:6789/0 conn(0x7f476c1543f0 legacy=0x7f476c0688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4758003aa0 0x7f4758003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c0650c0 0x7f4758004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4758004b80 0x7f4758005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c065ce0 con 0x7f4758004b80 2023-08-17T17:35:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475800b910 con 0x7f4758003aa0 2023-08-17T17:35:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475800bad0 con 0x7f476c0650c0 2023-08-17T17:35:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4772419700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4758004b80 0x7f4758005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.511+0000 7f4771c18700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4758003aa0 0x7f4758003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4771417700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c0650c0 0x7f4758004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4772419700 1 -- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c0650c0 msgr2=0x7f4758004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:06.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4772419700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c0650c0 0x7f4758004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4772419700 1 -- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4758003aa0 msgr2=0x7f4758003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:06.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4772419700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4758003aa0 0x7f4758003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4772419700 1 -- 172.21.15.78:0/2718694491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580033f0 con 0x7f4758004b80 2023-08-17T17:35:06.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4772419700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4758004b80 0x7f4758005000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f476400c5c0 tx=0x7f4764007f40).ready entity=mon.0 client_cookie=344b9c18cebca32b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476400cdc0 con 0x7f4758004b80 2023-08-17T17:35:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4764005b20 con 0x7f4758004b80 2023-08-17T17:35:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4770c16700 1 -- 172.21.15.78:0/2718694491 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764005ea0 con 0x7f4758004b80 2023-08-17T17:35:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4773e7c700 1 -- 172.21.15.78:0/2718694491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4758004b80 msgr2=0x7f4758005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4773e7c700 1 --2- 172.21.15.78:0/2718694491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4758004b80 0x7f4758005000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f476400c5c0 tx=0x7f4764007f40).stop 2023-08-17T17:35:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4772419700 1 -- 172.21.15.78:0/2718694491 reap_dead start 2023-08-17T17:35:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4773e7c700 1 -- 172.21.15.78:0/2718694491 shutdown_connections 2023-08-17T17:35:06.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.512+0000 7f4773e7c700 1 -- 172.21.15.78:0/2718694491 >> 172.21.15.78:0/2718694491 conn(0x7f476c0c7330 msgr2=0x7f476c0c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:06.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.513+0000 7f4773e7c700 1 -- 172.21.15.78:0/2718694491 shutdown_connections 2023-08-17T17:35:06.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.513+0000 7f4773e7c700 1 -- 172.21.15.78:0/2718694491 wait complete. 2023-08-17T17:35:06.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.514+0000 7f4773e7c700 1 Processor -- start 2023-08-17T17:35:06.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.514+0000 7f4773e7c700 1 -- start start 2023-08-17T17:35:06.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.514+0000 7f4773e7c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4758004b80 0x7f476c1504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.514+0000 7f4773e7c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c156c00 0x7f476c14ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.514+0000 7f4773e7c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f476c14ef60 0x7f476c0c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.514+0000 7f4773e7c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c164730 con 0x7f476c14ef60 2023-08-17T17:35:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.514+0000 7f4773e7c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c151590 con 0x7f4758004b80 2023-08-17T17:35:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.514+0000 7f4773e7c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c1649b0 con 0x7f476c156c00 2023-08-17T17:35:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.514+0000 7f4772419700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f476c14ef60 0x7f476c0c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4772419700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f476c14ef60 0x7f476c0c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33474/0 (socket says 172.21.15.78:33474) 2023-08-17T17:35:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4772419700 1 -- 172.21.15.78:0/2814720180 learned_addr learned my addr 172.21.15.78:0/2814720180 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4771417700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c156c00 0x7f476c14ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4771c18700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4758004b80 0x7f476c1504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4772419700 1 -- 172.21.15.78:0/2814720180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c156c00 msgr2=0x7f476c14ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4772419700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c156c00 0x7f476c14ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4772419700 1 -- 172.21.15.78:0/2814720180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4758004b80 msgr2=0x7f476c1504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4772419700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4758004b80 0x7f476c1504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4772419700 1 -- 172.21.15.78:0/2814720180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c150cf0 con 0x7f476c14ef60 2023-08-17T17:35:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4772419700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f476c14ef60 0x7f476c0c5cf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f4764000f80 tx=0x7f4764015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4761ffb700 1 -- 172.21.15.78:0/2814720180 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764001400 con 0x7f476c14ef60 2023-08-17T17:35:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4761ffb700 1 -- 172.21.15.78:0/2814720180 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476400cdc0 con 0x7f476c14ef60 2023-08-17T17:35:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4773e7c700 1 -- 172.21.15.78:0/2814720180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476c150fd0 con 0x7f476c14ef60 2023-08-17T17:35:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4761ffb700 1 -- 172.21.15.78:0/2814720180 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764013450 con 0x7f476c14ef60 2023-08-17T17:35:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.515+0000 7f4773e7c700 1 -- 172.21.15.78:0/2814720180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476c1509b0 con 0x7f476c14ef60 2023-08-17T17:35:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.516+0000 7f4773e7c700 1 -- 172.21.15.78:0/2814720180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476c164b40 con 0x7f476c14ef60 2023-08-17T17:35:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.516+0000 7f4761ffb700 1 -- 172.21.15.78:0/2814720180 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f476401d070 con 0x7f476c14ef60 2023-08-17T17:35:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.517+0000 7f4761ffb700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f475005ed90 0x7f4750061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.517+0000 7f4761ffb700 1 -- 172.21.15.78:0/2814720180 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f476407a670 con 0x7f476c14ef60 2023-08-17T17:35:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.517+0000 7f4771c18700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f475005ed90 0x7f4750061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.517+0000 7f4771c18700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f475005ed90 0x7f4750061250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4768007cc0 tx=0x7f4768009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.521+0000 7f4761ffb700 1 -- 172.21.15.78:0/2814720180 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f476404bfe0 con 0x7f476c14ef60 2023-08-17T17:35:06.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.746+0000 7f4773e7c700 1 -- 172.21.15.78:0/2814720180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f476c047350 con 0x7f476c14ef60 2023-08-17T17:35:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.752+0000 7f4761ffb700 1 -- 172.21.15.78:0/2814720180 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f476401a070 con 0x7f476c14ef60 2023-08-17T17:35:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 -- 172.21.15.78:0/2814720180 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f475005ed90 msgr2=0x7f4750061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f475005ed90 0x7f4750061250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4768007cc0 tx=0x7f4768009040).stop 2023-08-17T17:35:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 -- 172.21.15.78:0/2814720180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f476c14ef60 msgr2=0x7f476c0c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f476c14ef60 0x7f476c0c5cf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f4764000f80 tx=0x7f4764015000).stop 2023-08-17T17:35:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 -- 172.21.15.78:0/2814720180 shutdown_connections 2023-08-17T17:35:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f475005ed90 0x7f4750061250 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f476c14ef60 0x7f476c0c5cf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4758004b80 0x7f476c1504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 --2- 172.21.15.78:0/2814720180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f476c156c00 0x7f476c14ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 -- 172.21.15.78:0/2814720180 >> 172.21.15.78:0/2814720180 conn(0x7f476c0c7330 msgr2=0x7f476c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 -- 172.21.15.78:0/2814720180 shutdown_connections 2023-08-17T17:35:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.754+0000 7f4773e7c700 1 -- 172.21.15.78:0/2814720180 wait complete. 2023-08-17T17:35:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:updated 2023-08-17T17:35:06.766 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-17T17:35:06.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.879+0000 7f8c71316700 1 Processor -- start 2023-08-17T17:35:06.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.879+0000 7f8c71316700 1 -- start start 2023-08-17T17:35:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.880+0000 7f8c71316700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8c6c1541a0 0x7f8c6c0a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.880+0000 7f8c71316700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c154580 0x7f8c6c0bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.880+0000 7f8c71316700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0c8df0 con 0x7f8c6c0c0340 2023-08-17T17:35:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.880+0000 7f8c71316700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0a8190 con 0x7f8c6c1541a0 2023-08-17T17:35:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.880+0000 7f8c71316700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c9970 con 0x7f8c6c154580 2023-08-17T17:35:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.880+0000 7f8c627fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c154580 0x7f8c6c0bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.880+0000 7f8c6affd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8c6c1541a0 0x7f8c6c0a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.880+0000 7f8c627fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c154580 0x7f8c6c0bfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:32980/0 (socket says 172.21.15.78:32980) 2023-08-17T17:35:06.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.880+0000 7f8c627fc700 1 -- 172.21.15.78:0/2081747410 learned_addr learned my addr 172.21.15.78:0/2081747410 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:06.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.881+0000 7f8c627fc700 1 -- 172.21.15.78:0/2081747410 >> v2:172.21.15.150:3300/0 conn(0x7f8c6c1541a0 msgr2=0x7f8c6c0a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:06.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.881+0000 7f8c627fc700 1 --2- 172.21.15.78:0/2081747410 >> v2:172.21.15.150:3300/0 conn(0x7f8c6c1541a0 0x7f8c6c0a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.881+0000 7f8c627fc700 1 -- 172.21.15.78:0/2081747410 >> v1:172.21.15.150:6789/0 conn(0x7f8c6c0c0340 legacy=0x7f8c6c0c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.881+0000 7f8c627fc700 1 -- 172.21.15.78:0/2081747410 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c0c07b0 con 0x7f8c6c154580 2023-08-17T17:35:06.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.881+0000 7f8c627fc700 1 --2- 172.21.15.78:0/2081747410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c154580 0x7f8c6c0bfe50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8c54006fd0 tx=0x7f8c540090f0).ready entity=mon.2 client_cookie=4afc9f94f2b136f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:06.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.881+0000 7f8c6a7fc700 1 -- 172.21.15.78:0/2081747410 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400b580 con 0x7f8c6c154580 2023-08-17T17:35:06.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.881+0000 7f8c6a7fc700 1 -- 172.21.15.78:0/2081747410 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5400b6e0 con 0x7f8c6c154580 2023-08-17T17:35:06.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.881+0000 7f8c6a7fc700 1 -- 172.21.15.78:0/2081747410 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400ba80 con 0x7f8c6c154580 2023-08-17T17:35:06.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.882+0000 7f8c71316700 1 -- 172.21.15.78:0/2081747410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c154580 msgr2=0x7f8c6c0bfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.882+0000 7f8c71316700 1 --2- 172.21.15.78:0/2081747410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c154580 0x7f8c6c0bfe50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8c54006fd0 tx=0x7f8c540090f0).stop 2023-08-17T17:35:06.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.882+0000 7f8c71316700 1 -- 172.21.15.78:0/2081747410 shutdown_connections 2023-08-17T17:35:06.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.882+0000 7f8c71316700 1 --2- 172.21.15.78:0/2081747410 >> v2:172.21.15.150:3300/0 conn(0x7f8c6c1541a0 0x7f8c6c0a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.882+0000 7f8c71316700 1 --2- 172.21.15.78:0/2081747410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c154580 0x7f8c6c0bfe50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.882+0000 7f8c71316700 1 -- 172.21.15.78:0/2081747410 >> 172.21.15.78:0/2081747410 conn(0x7f8c6c06a400 msgr2=0x7f8c6c0caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:06.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.882+0000 7f8c71316700 1 -- 172.21.15.78:0/2081747410 shutdown_connections 2023-08-17T17:35:06.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.882+0000 7f8c71316700 1 -- 172.21.15.78:0/2081747410 wait complete. 2023-08-17T17:35:06.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.883+0000 7f8c71316700 1 Processor -- start 2023-08-17T17:35:06.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.883+0000 7f8c71316700 1 -- start start 2023-08-17T17:35:06.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c71316700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c0c0340 0x7f8c6c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c71316700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c6c1541a0 0x7f8c6c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c71316700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6c154580 0x7f8c6c154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c71316700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0ae850 con 0x7f8c6c154580 2023-08-17T17:35:06.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c71316700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0af640 con 0x7f8c6c1541a0 2023-08-17T17:35:06.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c71316700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0aea30 con 0x7f8c6c0c0340 2023-08-17T17:35:06.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c6b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6c154580 0x7f8c6c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c6b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6c154580 0x7f8c6c154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33488/0 (socket says 172.21.15.78:33488) 2023-08-17T17:35:06.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c6b7fe700 1 -- 172.21.15.78:0/4092401000 learned_addr learned my addr 172.21.15.78:0/4092401000 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:06.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c627fc700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c6c1541a0 0x7f8c6c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c6affd700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c0c0340 0x7f8c6c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c6b7fe700 1 -- 172.21.15.78:0/4092401000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c0c0340 msgr2=0x7f8c6c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c6b7fe700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c0c0340 0x7f8c6c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c6b7fe700 1 -- 172.21.15.78:0/4092401000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c6c1541a0 msgr2=0x7f8c6c0b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:06.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c6b7fe700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c6c1541a0 0x7f8c6c0b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:06.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c6b7fe700 1 -- 172.21.15.78:0/4092401000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c54009370 con 0x7f8c6c154580 2023-08-17T17:35:06.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c6b7fe700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6c154580 0x7f8c6c154960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f8c6400c7c0 tx=0x7f8c64001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c637fe700 1 -- 172.21.15.78:0/4092401000 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400e4a0 con 0x7f8c6c154580 2023-08-17T17:35:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.884+0000 7f8c637fe700 1 -- 172.21.15.78:0/4092401000 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6400e600 con 0x7f8c6c154580 2023-08-17T17:35:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.885+0000 7f8c71316700 1 -- 172.21.15.78:0/4092401000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c0aed10 con 0x7f8c6c154580 2023-08-17T17:35:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.885+0000 7f8c637fe700 1 -- 172.21.15.78:0/4092401000 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400e980 con 0x7f8c6c154580 2023-08-17T17:35:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.885+0000 7f8c71316700 1 -- 172.21.15.78:0/4092401000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c0af2d0 con 0x7f8c6c154580 2023-08-17T17:35:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.885+0000 7f8c71316700 1 -- 172.21.15.78:0/4092401000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c0af7b0 con 0x7f8c6c154580 2023-08-17T17:35:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.886+0000 7f8c637fe700 1 -- 172.21.15.78:0/4092401000 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8c64010070 con 0x7f8c6c154580 2023-08-17T17:35:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.886+0000 7f8c637fe700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c4c05ed90 0x7f8c4c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:06.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.886+0000 7f8c637fe700 1 -- 172.21.15.78:0/4092401000 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8c64078e70 con 0x7f8c6c154580 2023-08-17T17:35:06.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.886+0000 7f8c6affd700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c4c05ed90 0x7f8c4c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:06.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.887+0000 7f8c6affd700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c4c05ed90 0x7f8c4c061250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f8c5c009b90 tx=0x7f8c5c009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:06.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:06.890+0000 7f8c637fe700 1 -- 172.21.15.78:0/4092401000 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c640478f0 con 0x7f8c6c154580 2023-08-17T17:35:07.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.119+0000 7f8c71316700 1 -- 172.21.15.78:0/4092401000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f8c6c047350 con 0x7f8c6c154580 2023-08-17T17:35:07.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.125+0000 7f8c637fe700 1 -- 172.21.15.78:0/4092401000 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v14) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8c6404a760 con 0x7f8c6c154580 2023-08-17T17:35:07.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 -- 172.21.15.78:0/4092401000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c4c05ed90 msgr2=0x7f8c4c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c4c05ed90 0x7f8c4c061250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f8c5c009b90 tx=0x7f8c5c009060).stop 2023-08-17T17:35:07.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 -- 172.21.15.78:0/4092401000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6c154580 msgr2=0x7f8c6c154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6c154580 0x7f8c6c154960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f8c6400c7c0 tx=0x7f8c64001510).stop 2023-08-17T17:35:07.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 -- 172.21.15.78:0/4092401000 shutdown_connections 2023-08-17T17:35:07.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c4c05ed90 0x7f8c4c061250 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6c154580 0x7f8c6c154960 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c6c0c0340 0x7f8c6c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 --2- 172.21.15.78:0/4092401000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c6c1541a0 0x7f8c6c0b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 -- 172.21.15.78:0/4092401000 >> 172.21.15.78:0/4092401000 conn(0x7f8c6c06a400 msgr2=0x7f8c6c157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:07.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 -- 172.21.15.78:0/4092401000 shutdown_connections 2023-08-17T17:35:07.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.127+0000 7f8c71316700 1 -- 172.21.15.78:0/4092401000 wait complete. 2023-08-17T17:35:07.129 INFO:teuthology.orchestra.run.smithi078.stderr:updated 2023-08-17T17:35:07.139 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:35:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.251+0000 7ff5b5a50700 1 Processor -- start 2023-08-17T17:35:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.251+0000 7ff5b5a50700 1 -- start start 2023-08-17T17:35:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.252+0000 7ff5b5a50700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b00c6ee0 0x7ff5b00c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.252+0000 7ff5b5a50700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5b00c0df0 0x7ff5b00ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.252+0000 7ff5b5a50700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b00a8350 con 0x7ff5b0154140 2023-08-17T17:35:07.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.252+0000 7ff5b5a50700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b00c7320 con 0x7ff5b00c0df0 2023-08-17T17:35:07.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.252+0000 7ff5b5a50700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00c1280 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.252+0000 7ff5af7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5b00c0df0 0x7ff5b00ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.252+0000 7ff5af7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5b00c0df0 0x7ff5b00ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33500/0 (socket says 172.21.15.78:33500) 2023-08-17T17:35:07.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.252+0000 7ff5af7fe700 1 -- 172.21.15.78:0/231472786 learned_addr learned my addr 172.21.15.78:0/231472786 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:07.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5af7fe700 1 -- 172.21.15.78:0/231472786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b00c6ee0 msgr2=0x7ff5b00c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:07.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5af7fe700 1 --2- 172.21.15.78:0/231472786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b00c6ee0 0x7ff5b00c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:07.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5af7fe700 1 -- 172.21.15.78:0/231472786 >> v1:172.21.15.150:6789/0 conn(0x7ff5b0154140 legacy=0x7ff5b00a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:07.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5af7fe700 1 -- 172.21.15.78:0/231472786 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0154520 con 0x7ff5b00c0df0 2023-08-17T17:35:07.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5af7fe700 1 --2- 172.21.15.78:0/231472786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c0df0 0x7ff5b00ca280 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7ff5a8006fd0 tx=0x7ff5a80090f0).ready entity=mon.0 client_cookie=f56b73a1ed3f20b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:07.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5adffb700 1 -- 172.21.15.78:0/231472786 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800b600 con 0x7ff5b00c0df0 2023-08-17T17:35:07.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5adffb700 1 -- 172.21.15.78:0/231472786 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a800b760 con 0x7ff5b00c0df0 2023-08-17T17:35:07.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5adffb700 1 -- 172.21.15.78:0/231472786 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800bae0 con 0x7ff5b00c0df0 2023-08-17T17:35:07.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5b5a50700 1 -- 172.21.15.78:0/231472786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c0df0 msgr2=0x7ff5b00ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5b5a50700 1 --2- 172.21.15.78:0/231472786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c0df0 0x7ff5b00ca280 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7ff5a8006fd0 tx=0x7ff5a80090f0).stop 2023-08-17T17:35:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5b5a50700 1 -- 172.21.15.78:0/231472786 shutdown_connections 2023-08-17T17:35:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5b5a50700 1 --2- 172.21.15.78:0/231472786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c0df0 0x7ff5b00ca280 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5b5a50700 1 --2- 172.21.15.78:0/231472786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b00c6ee0 0x7ff5b00c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5b5a50700 1 -- 172.21.15.78:0/231472786 >> 172.21.15.78:0/231472786 conn(0x7ff5b0094510 msgr2=0x7ff5b006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5b5a50700 1 -- 172.21.15.78:0/231472786 shutdown_connections 2023-08-17T17:35:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.253+0000 7ff5b5a50700 1 -- 172.21.15.78:0/231472786 wait complete. 2023-08-17T17:35:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.255+0000 7ff5b5a50700 1 Processor -- start 2023-08-17T17:35:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.255+0000 7ff5b5a50700 1 -- start start 2023-08-17T17:35:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.255+0000 7ff5b5a50700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b00c0df0 0x7ff5b00ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.255+0000 7ff5b5a50700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c6ee0 0x7ff5b00ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.255+0000 7ff5b5a50700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b0154140 0x7ff5b014d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.255+0000 7ff5b5a50700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00afcf0 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5b5a50700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00af0e0 con 0x7ff5b00c0df0 2023-08-17T17:35:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5b5a50700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00af3c0 con 0x7ff5b0154140 2023-08-17T17:35:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5ae7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c6ee0 0x7ff5b00ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5ae7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c6ee0 0x7ff5b00ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33504/0 (socket says 172.21.15.78:33504) 2023-08-17T17:35:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5ae7fc700 1 -- 172.21.15.78:0/1670948471 learned_addr learned my addr 172.21.15.78:0/1670948471 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5af7fe700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b0154140 0x7ff5b014d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5aeffd700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b00c0df0 0x7ff5b00ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5ae7fc700 1 -- 172.21.15.78:0/1670948471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b0154140 msgr2=0x7ff5b014d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5ae7fc700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b0154140 0x7ff5b014d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5ae7fc700 1 -- 172.21.15.78:0/1670948471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b00c0df0 msgr2=0x7ff5b00ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5ae7fc700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b00c0df0 0x7ff5b00ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5ae7fc700 1 -- 172.21.15.78:0/1670948471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8009370 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5aeffd700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b00c0df0 0x7ff5b00ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:07.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5ae7fc700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c6ee0 0x7ff5b00ae8d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7ff59800b530 tx=0x7ff5980090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:07.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5a6ffd700 1 -- 172.21.15.78:0/1670948471 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598002320 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5a6ffd700 1 -- 172.21.15.78:0/1670948471 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5980024a0 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5b5a50700 1 -- 172.21.15.78:0/1670948471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b00af6a0 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5a6ffd700 1 -- 172.21.15.78:0/1670948471 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598002860 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.256+0000 7ff5b5a50700 1 -- 172.21.15.78:0/1670948471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b00aedc0 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.257+0000 7ff5b5a50700 1 -- 172.21.15.78:0/1670948471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b00afea0 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.257+0000 7ff5a6ffd700 1 -- 172.21.15.78:0/1670948471 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff59800f030 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.258+0000 7ff5a6ffd700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff59005ed90 0x7ff590061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.258+0000 7ff5a6ffd700 1 -- 172.21.15.78:0/1670948471 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff598079610 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.258+0000 7ff5aeffd700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff59005ed90 0x7ff590061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.258+0000 7ff5aeffd700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff59005ed90 0x7ff590061250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff5a0006fd0 tx=0x7ff5a00012e0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:07.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.262+0000 7ff5a6ffd700 1 -- 172.21.15.78:0/1670948471 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff5b00afea0 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.425+0000 7ff5b5a50700 1 -- 172.21.15.78:0/1670948471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5b0047350 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.426+0000 7ff5a6ffd700 1 -- 172.21.15.78:0/1670948471 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13760 (secure 0 0 0) 0x7ff59804adf0 con 0x7ff5b00c6ee0 2023-08-17T17:35:07.427 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:35:07.427 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":30,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:35:04.512170+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:35:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 -- 172.21.15.78:0/1670948471 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff59005ed90 msgr2=0x7ff590061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff59005ed90 0x7ff590061250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff5a0006fd0 tx=0x7ff5a00012e0).stop 2023-08-17T17:35:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 -- 172.21.15.78:0/1670948471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c6ee0 msgr2=0x7ff5b00ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c6ee0 0x7ff5b00ae8d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7ff59800b530 tx=0x7ff5980090f0).stop 2023-08-17T17:35:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 -- 172.21.15.78:0/1670948471 shutdown_connections 2023-08-17T17:35:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff59005ed90 0x7ff590061250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b0154140 0x7ff5b014d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b00c0df0 0x7ff5b00ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 --2- 172.21.15.78:0/1670948471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5b00c6ee0 0x7ff5b00ae8d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 -- 172.21.15.78:0/1670948471 >> 172.21.15.78:0/1670948471 conn(0x7ff5b0094510 msgr2=0x7ff5b0063050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 -- 172.21.15.78:0/1670948471 shutdown_connections 2023-08-17T17:35:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.428+0000 7ff5b5a50700 1 -- 172.21.15.78:0/1670948471 wait complete. 2023-08-17T17:35:07.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T17:35:07.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:35:07.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.556+0000 7f16ad299700 1 Processor -- start 2023-08-17T17:35:07.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.556+0000 7f16ad299700 1 -- start start 2023-08-17T17:35:07.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f16ad299700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16a80aa4d0 0x7f16a80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f16ad299700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a80649b0 con 0x7f16a80c5810 2023-08-17T17:35:07.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f16ad299700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a8063420 con 0x7f16a80aa0f0 2023-08-17T17:35:07.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f16ad299700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a8063700 con 0x7f16a80aa4d0 2023-08-17T17:35:07.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f169e7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16a80aa4d0 0x7f16a80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f16a77fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f16a80c5810 0x7f16a80a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34624/0 (socket says 172.21.15.78:34624) 2023-08-17T17:35:07.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f16a77fe700 1 -- 172.21.15.78:0/620886693 learned_addr learned my addr 172.21.15.78:0/620886693 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:07.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f169e7fc700 1 --2- 172.21.15.78:0/620886693 >> v2:172.21.15.78:3300/0 conn(0x7f16a80aa4d0 0x7f16a80644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33508/0 (socket says 172.21.15.78:33508) 2023-08-17T17:35:07.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f169e7fc700 1 -- 172.21.15.78:0/620886693 >> v1:172.21.15.150:6789/0 conn(0x7f16a80aa0f0 legacy=0x7f16a80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:07.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f169e7fc700 1 -- 172.21.15.78:0/620886693 >> v1:172.21.15.78:6789/0 conn(0x7f16a80c5810 legacy=0x7f16a80a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f169e7fc700 1 -- 172.21.15.78:0/620886693 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80639e0 con 0x7f16a80aa4d0 2023-08-17T17:35:07.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.557+0000 7f16a67fc700 1 -- 172.21.15.78:0/620886693 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082037138 0 0) 0x7f16a80649b0 con 0x7f16a80c5810 2023-08-17T17:35:07.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f169e7fc700 1 --2- 172.21.15.78:0/620886693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa4d0 0x7f16a80644c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f1690009760 tx=0x7f1690009060).ready entity=mon.0 client_cookie=55e6ee1c009a86ce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:07.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f16a67fc700 1 -- 172.21.15.78:0/620886693 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000b520 con 0x7f16a80aa4d0 2023-08-17T17:35:07.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f16a67fc700 1 -- 172.21.15.78:0/620886693 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169000b680 con 0x7f16a80aa4d0 2023-08-17T17:35:07.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f16a67fc700 1 -- 172.21.15.78:0/620886693 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000ba00 con 0x7f16a80aa4d0 2023-08-17T17:35:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f16ad299700 1 -- 172.21.15.78:0/620886693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa4d0 msgr2=0x7f16a80644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f16ad299700 1 --2- 172.21.15.78:0/620886693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa4d0 0x7f16a80644c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f1690009760 tx=0x7f1690009060).stop 2023-08-17T17:35:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f16ad299700 1 -- 172.21.15.78:0/620886693 shutdown_connections 2023-08-17T17:35:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f16ad299700 1 --2- 172.21.15.78:0/620886693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa4d0 0x7f16a80644c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f16ad299700 1 -- 172.21.15.78:0/620886693 >> 172.21.15.78:0/620886693 conn(0x7f16a806a6a0 msgr2=0x7f16a80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f16ad299700 1 -- 172.21.15.78:0/620886693 shutdown_connections 2023-08-17T17:35:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.558+0000 7f16ad299700 1 -- 172.21.15.78:0/620886693 wait complete. 2023-08-17T17:35:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.559+0000 7f16ad299700 1 Processor -- start 2023-08-17T17:35:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16ad299700 1 -- start start 2023-08-17T17:35:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16ad299700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa0f0 0x7f16a8152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16ad299700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80aa4d0 0x7f16a80afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16ad299700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a80c5810 0x7f16a80b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16ad299700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80b0870 con 0x7f16a80aa0f0 2023-08-17T17:35:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16ad299700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81560c0 con 0x7f16a80c5810 2023-08-17T17:35:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16ad299700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80c3190 con 0x7f16a80aa4d0 2023-08-17T17:35:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16a6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa0f0 0x7f16a8152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16a6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa0f0 0x7f16a8152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33524/0 (socket says 172.21.15.78:33524) 2023-08-17T17:35:07.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16a6ffd700 1 -- 172.21.15.78:0/2003273832 learned_addr learned my addr 172.21.15.78:0/2003273832 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:07.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f169e7fc700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80aa4d0 0x7f16a80afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.560+0000 7f16a77fe700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a80c5810 0x7f16a80b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f16a6ffd700 1 -- 172.21.15.78:0/2003273832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80aa4d0 msgr2=0x7f16a80afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f16a6ffd700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80aa4d0 0x7f16a80afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f16a6ffd700 1 -- 172.21.15.78:0/2003273832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a80c5810 msgr2=0x7f16a80b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f16a6ffd700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a80c5810 0x7f16a80b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f16a6ffd700 1 -- 172.21.15.78:0/2003273832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16900092a0 con 0x7f16a80aa0f0 2023-08-17T17:35:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f169e7fc700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80aa4d0 0x7f16a80afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f16a6ffd700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa0f0 0x7f16a8152160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f169800c440 tx=0x7f1698007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f169f7fe700 1 -- 172.21.15.78:0/2003273832 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800f470 con 0x7f16a80aa0f0 2023-08-17T17:35:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f169f7fe700 1 -- 172.21.15.78:0/2003273832 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169800f5f0 con 0x7f16a80aa0f0 2023-08-17T17:35:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f16ad299700 1 -- 172.21.15.78:0/2003273832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a80c3470 con 0x7f16a80aa0f0 2023-08-17T17:35:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f169f7fe700 1 -- 172.21.15.78:0/2003273832 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800f9b0 con 0x7f16a80aa0f0 2023-08-17T17:35:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.561+0000 7f16ad299700 1 -- 172.21.15.78:0/2003273832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a80c3a30 con 0x7f16a80aa0f0 2023-08-17T17:35:07.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.562+0000 7f16ad299700 1 -- 172.21.15.78:0/2003273832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a8155e90 con 0x7f16a80aa0f0 2023-08-17T17:35:07.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.562+0000 7f169f7fe700 1 -- 172.21.15.78:0/2003273832 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1698019030 con 0x7f16a80aa0f0 2023-08-17T17:35:07.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.562+0000 7f169f7fe700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f168805ed60 0x7f1688061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.562+0000 7f169f7fe700 1 -- 172.21.15.78:0/2003273832 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1698078bf0 con 0x7f16a80aa0f0 2023-08-17T17:35:07.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.563+0000 7f169e7fc700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f168805ed60 0x7f1688061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.563+0000 7f169e7fc700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f168805ed60 0x7f1688061220 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f1690009760 tx=0x7f1690017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:07.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.566+0000 7f169f7fe700 1 -- 172.21.15.78:0/2003273832 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f16980488f0 con 0x7f16a80aa0f0 2023-08-17T17:35:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.728+0000 7f16ad299700 1 -- 172.21.15.78:0/2003273832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f16a8046af0 con 0x7f16a80aa0f0 2023-08-17T17:35:07.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.729+0000 7f169f7fe700 1 -- 172.21.15.78:0/2003273832 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f16a8155e90 con 0x7f16a80aa0f0 2023-08-17T17:35:07.729 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:35:07.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.730+0000 7f16ad299700 1 -- 172.21.15.78:0/2003273832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f168805ed60 msgr2=0x7f1688061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.730+0000 7f16ad299700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f168805ed60 0x7f1688061220 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f1690009760 tx=0x7f1690017000).stop 2023-08-17T17:35:07.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.730+0000 7f16ad299700 1 -- 172.21.15.78:0/2003273832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa0f0 msgr2=0x7f16a8152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.730+0000 7f16ad299700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa0f0 0x7f16a8152160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f169800c440 tx=0x7f1698007de0).stop 2023-08-17T17:35:07.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.731+0000 7f16ad299700 1 -- 172.21.15.78:0/2003273832 shutdown_connections 2023-08-17T17:35:07.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.731+0000 7f16ad299700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f168805ed60 0x7f1688061220 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.731+0000 7f16ad299700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a80c5810 0x7f16a80b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.731+0000 7f16ad299700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a80aa0f0 0x7f16a8152160 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.731+0000 7f16ad299700 1 --2- 172.21.15.78:0/2003273832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80aa4d0 0x7f16a80afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.731+0000 7f16ad299700 1 -- 172.21.15.78:0/2003273832 >> 172.21.15.78:0/2003273832 conn(0x7f16a806a6a0 msgr2=0x7f16a80a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:07.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.731+0000 7f16ad299700 1 -- 172.21.15.78:0/2003273832 shutdown_connections 2023-08-17T17:35:07.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.731+0000 7f16ad299700 1 -- 172.21.15.78:0/2003273832 wait complete. 2023-08-17T17:35:07.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:35:07.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.858+0000 7fc6985b2700 1 Processor -- start 2023-08-17T17:35:07.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.858+0000 7fc6985b2700 1 -- start start 2023-08-17T17:35:07.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc6985b2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900aa0f0 0x7fc6900644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc6985b2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6900c5810 0x7fc6900c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc6985b2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900649b0 con 0x7fc6900aa4d0 2023-08-17T17:35:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc6985b2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900c6170 con 0x7fc6900c5810 2023-08-17T17:35:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc6985b2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc690063420 con 0x7fc6900aa0f0 2023-08-17T17:35:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc696b4f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6900c5810 0x7fc6900c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc695b4d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc6900aa4d0 0x7fc6900c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34632/0 (socket says 172.21.15.78:34632) 2023-08-17T17:35:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc696b4f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6900c5810 0x7fc6900c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33536/0 (socket says 172.21.15.78:33536) 2023-08-17T17:35:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc695b4d700 1 -- 172.21.15.78:0/1101612369 learned_addr learned my addr 172.21.15.78:0/1101612369 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc69634e700 1 --2- 172.21.15.78:0/1101612369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900aa0f0 0x7fc6900644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc696b4f700 1 -- 172.21.15.78:0/1101612369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900aa0f0 msgr2=0x7fc6900644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc696b4f700 1 --2- 172.21.15.78:0/1101612369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900aa0f0 0x7fc6900644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc696b4f700 1 -- 172.21.15.78:0/1101612369 >> v1:172.21.15.78:6789/0 conn(0x7fc6900aa4d0 legacy=0x7fc6900c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc69534c700 1 -- 172.21.15.78:0/1101612369 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026351873 0 0) 0x7fc6900649b0 con 0x7fc6900aa4d0 2023-08-17T17:35:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.859+0000 7fc696b4f700 1 -- 172.21.15.78:0/1101612369 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc690063700 con 0x7fc6900c5810 2023-08-17T17:35:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc696b4f700 1 --2- 172.21.15.78:0/1101612369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900c5810 0x7fc6900c5c80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fc688009e60 tx=0x7fc688009780).ready entity=mon.0 client_cookie=958fb59145765584 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc69534c700 1 -- 172.21.15.78:0/1101612369 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800e070 con 0x7fc6900c5810 2023-08-17T17:35:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc69534c700 1 -- 172.21.15.78:0/1101612369 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68800bc30 con 0x7fc6900c5810 2023-08-17T17:35:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc69534c700 1 -- 172.21.15.78:0/1101612369 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688012410 con 0x7fc6900c5810 2023-08-17T17:35:07.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc6985b2700 1 -- 172.21.15.78:0/1101612369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900c5810 msgr2=0x7fc6900c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc6985b2700 1 --2- 172.21.15.78:0/1101612369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900c5810 0x7fc6900c5c80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fc688009e60 tx=0x7fc688009780).stop 2023-08-17T17:35:07.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc6985b2700 1 -- 172.21.15.78:0/1101612369 shutdown_connections 2023-08-17T17:35:07.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc6985b2700 1 --2- 172.21.15.78:0/1101612369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900c5810 0x7fc6900c5c80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc6985b2700 1 --2- 172.21.15.78:0/1101612369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900aa0f0 0x7fc6900644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc6985b2700 1 -- 172.21.15.78:0/1101612369 >> 172.21.15.78:0/1101612369 conn(0x7fc69006a6a0 msgr2=0x7fc6900caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc6985b2700 1 -- 172.21.15.78:0/1101612369 shutdown_connections 2023-08-17T17:35:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.860+0000 7fc6985b2700 1 -- 172.21.15.78:0/1101612369 wait complete. 2023-08-17T17:35:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.861+0000 7fc6985b2700 1 Processor -- start 2023-08-17T17:35:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.861+0000 7fc6985b2700 1 -- start start 2023-08-17T17:35:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc6985b2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900aa0f0 0x7fc690145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc6985b2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6900aa4d0 0x7fc6900abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc6985b2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900c5810 0x7fc6900affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc6985b2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900ad860 con 0x7fc6900aa0f0 2023-08-17T17:35:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc6985b2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900ad3d0 con 0x7fc6900aa4d0 2023-08-17T17:35:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc6985b2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c4bc0 con 0x7fc6900c5810 2023-08-17T17:35:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc69634e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900aa0f0 0x7fc690145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc69634e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900aa0f0 0x7fc690145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33546/0 (socket says 172.21.15.78:33546) 2023-08-17T17:35:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc69634e700 1 -- 172.21.15.78:0/3175370052 learned_addr learned my addr 172.21.15.78:0/3175370052 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc69634e700 1 -- 172.21.15.78:0/3175370052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900c5810 msgr2=0x7fc6900affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc696b4f700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900c5810 0x7fc6900affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc695b4d700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6900aa4d0 0x7fc6900abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc69634e700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900c5810 0x7fc6900affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc69634e700 1 -- 172.21.15.78:0/3175370052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6900aa4d0 msgr2=0x7fc6900abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.862+0000 7fc69634e700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6900aa4d0 0x7fc6900abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.863+0000 7fc69634e700 1 -- 172.21.15.78:0/3175370052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc688009a20 con 0x7fc6900aa0f0 2023-08-17T17:35:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.863+0000 7fc696b4f700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900c5810 0x7fc6900affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.863+0000 7fc695b4d700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6900aa4d0 0x7fc6900abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.863+0000 7fc69634e700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900aa0f0 0x7fc690145a90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fc68c00d890 tx=0x7fc68c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.863+0000 7fc6867fc700 1 -- 172.21.15.78:0/3175370052 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0125f0 con 0x7fc6900aa0f0 2023-08-17T17:35:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.863+0000 7fc6867fc700 1 -- 172.21.15.78:0/3175370052 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c012750 con 0x7fc6900aa0f0 2023-08-17T17:35:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.863+0000 7fc6985b2700 1 -- 172.21.15.78:0/3175370052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900ac7c0 con 0x7fc6900aa0f0 2023-08-17T17:35:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.863+0000 7fc6867fc700 1 -- 172.21.15.78:0/3175370052 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c012ad0 con 0x7fc6900aa0f0 2023-08-17T17:35:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.863+0000 7fc6985b2700 1 -- 172.21.15.78:0/3175370052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900acd80 con 0x7fc6900aa0f0 2023-08-17T17:35:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.864+0000 7fc6985b2700 1 -- 172.21.15.78:0/3175370052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6900ad6b0 con 0x7fc6900aa0f0 2023-08-17T17:35:07.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.864+0000 7fc6867fc700 1 -- 172.21.15.78:0/3175370052 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc68c013480 con 0x7fc6900aa0f0 2023-08-17T17:35:07.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.864+0000 7fc6867fc700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc67405ed90 0x7fc674061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:07.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.864+0000 7fc695b4d700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc67405ed90 0x7fc674061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:07.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.864+0000 7fc6867fc700 1 -- 172.21.15.78:0/3175370052 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc68c079710 con 0x7fc6900aa0f0 2023-08-17T17:35:07.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.865+0000 7fc695b4d700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc67405ed90 0x7fc674061250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fc690159030 tx=0x7fc680009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:07.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:07.869+0000 7fc6867fc700 1 -- 172.21.15.78:0/3175370052 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc68c04afa0 con 0x7fc6900aa0f0 2023-08-17T17:35:08.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.030+0000 7fc6985b2700 1 -- 172.21.15.78:0/3175370052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc690046af0 con 0x7fc6900aa0f0 2023-08-17T17:35:08.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.031+0000 7fc6867fc700 1 -- 172.21.15.78:0/3175370052 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc68c04e5c0 con 0x7fc6900aa0f0 2023-08-17T17:35:08.032 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:35:08.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 -- 172.21.15.78:0/3175370052 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc67405ed90 msgr2=0x7fc674061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc67405ed90 0x7fc674061250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fc690159030 tx=0x7fc680009040).stop 2023-08-17T17:35:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 -- 172.21.15.78:0/3175370052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900aa0f0 msgr2=0x7fc690145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900aa0f0 0x7fc690145a90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fc68c00d890 tx=0x7fc68c008040).stop 2023-08-17T17:35:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 -- 172.21.15.78:0/3175370052 shutdown_connections 2023-08-17T17:35:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc67405ed90 0x7fc674061250 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900c5810 0x7fc6900affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6900aa0f0 0x7fc690145a90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 --2- 172.21.15.78:0/3175370052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6900aa4d0 0x7fc6900abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 -- 172.21.15.78:0/3175370052 >> 172.21.15.78:0/3175370052 conn(0x7fc69006a6a0 msgr2=0x7fc6900ca660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 -- 172.21.15.78:0/3175370052 shutdown_connections 2023-08-17T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.033+0000 7fc6985b2700 1 -- 172.21.15.78:0/3175370052 wait complete. 2023-08-17T17:35:08.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T17:35:08.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.157+0000 7f367f0e2700 1 Processor -- start 2023-08-17T17:35:08.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.157+0000 7f367f0e2700 1 -- start start 2023-08-17T17:35:08.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.158+0000 7f367f0e2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f36781375e0 0x7f3678065110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.158+0000 7f367f0e2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36780c0ff0 0x7f36780c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.158+0000 7f367f0e2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36780c14b0 con 0x7f3678137e30 2023-08-17T17:35:08.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.158+0000 7f367f0e2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36780c1790 con 0x7f36780c0ff0 2023-08-17T17:35:08.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.158+0000 7f367f0e2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36780c1a70 con 0x7f36781375e0 2023-08-17T17:35:08.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.158+0000 7f366ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36780c0ff0 0x7f36780c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:08.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.158+0000 7f367d67f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3678137e30 0x7f3678069310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34646/0 (socket says 172.21.15.78:34646) 2023-08-17T17:35:08.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.158+0000 7f366ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36780c0ff0 0x7f36780c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33554/0 (socket says 172.21.15.78:33554) 2023-08-17T17:35:08.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.158+0000 7f367d67f700 1 -- 172.21.15.78:0/2468285015 learned_addr learned my addr 172.21.15.78:0/2468285015 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:08.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f367ce7e700 1 --2- 172.21.15.78:0/2468285015 >> v2:172.21.15.150:3300/0 conn(0x7f36781375e0 0x7f3678065110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:08.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f366ffff700 1 -- 172.21.15.78:0/2468285015 >> v2:172.21.15.150:3300/0 conn(0x7f36781375e0 msgr2=0x7f3678065110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:08.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f366ffff700 1 --2- 172.21.15.78:0/2468285015 >> v2:172.21.15.150:3300/0 conn(0x7f36781375e0 0x7f3678065110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f366ffff700 1 -- 172.21.15.78:0/2468285015 >> v1:172.21.15.78:6789/0 conn(0x7f3678137e30 legacy=0x7f3678069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f366f7fe700 1 -- 172.21.15.78:0/2468285015 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084131443 0 0) 0x7f36780c14b0 con 0x7f3678137e30 2023-08-17T17:35:08.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f366ffff700 1 -- 172.21.15.78:0/2468285015 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780c1d50 con 0x7f36780c0ff0 2023-08-17T17:35:08.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f366ffff700 1 --2- 172.21.15.78:0/2468285015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36780c0ff0 0x7f36780c57d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f36780633d0 tx=0x7f3668009060).ready entity=mon.0 client_cookie=a25b60d1b0f7e4c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:08.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f366f7fe700 1 -- 172.21.15.78:0/2468285015 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800b580 con 0x7f36780c0ff0 2023-08-17T17:35:08.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f366f7fe700 1 -- 172.21.15.78:0/2468285015 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800b6e0 con 0x7f36780c0ff0 2023-08-17T17:35:08.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f366f7fe700 1 -- 172.21.15.78:0/2468285015 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800ba60 con 0x7f36780c0ff0 2023-08-17T17:35:08.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f367f0e2700 1 -- 172.21.15.78:0/2468285015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36780c0ff0 msgr2=0x7f36780c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f367f0e2700 1 --2- 172.21.15.78:0/2468285015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36780c0ff0 0x7f36780c57d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f36780633d0 tx=0x7f3668009060).stop 2023-08-17T17:35:08.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f367f0e2700 1 -- 172.21.15.78:0/2468285015 shutdown_connections 2023-08-17T17:35:08.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f367f0e2700 1 --2- 172.21.15.78:0/2468285015 >> v2:172.21.15.150:3300/0 conn(0x7f36781375e0 0x7f3678065110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f367f0e2700 1 --2- 172.21.15.78:0/2468285015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36780c0ff0 0x7f36780c57d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.159+0000 7f367f0e2700 1 -- 172.21.15.78:0/2468285015 >> 172.21.15.78:0/2468285015 conn(0x7f3678062fc0 msgr2=0x7f36780c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:08.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.160+0000 7f367f0e2700 1 -- 172.21.15.78:0/2468285015 shutdown_connections 2023-08-17T17:35:08.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.160+0000 7f367f0e2700 1 -- 172.21.15.78:0/2468285015 wait complete. 2023-08-17T17:35:08.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.161+0000 7f367f0e2700 1 Processor -- start 2023-08-17T17:35:08.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.161+0000 7f367f0e2700 1 -- start start 2023-08-17T17:35:08.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367f0e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36780c0ff0 0x7f3678135ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367f0e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36781375e0 0x7f3678155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367f0e2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3678137e30 0x7f3678151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367f0e2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36780aa970 con 0x7f3678137e30 2023-08-17T17:35:08.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367f0e2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3678136960 con 0x7f36781375e0 2023-08-17T17:35:08.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367f0e2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36781564b0 con 0x7f36780c0ff0 2023-08-17T17:35:08.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367d67f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3678137e30 0x7f3678151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:08.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367d67f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3678137e30 0x7f3678151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33570/0 (socket says 172.21.15.78:33570) 2023-08-17T17:35:08.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367d67f700 1 -- 172.21.15.78:0/3113363630 learned_addr learned my addr 172.21.15.78:0/3113363630 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:08.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367d67f700 1 -- 172.21.15.78:0/3113363630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36780c0ff0 msgr2=0x7f3678135ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367d67f700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36780c0ff0 0x7f3678135ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:08.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367d67f700 1 -- 172.21.15.78:0/3113363630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36781375e0 msgr2=0x7f3678155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367d67f700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36781375e0 0x7f3678155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:08.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367d67f700 1 -- 172.21.15.78:0/3113363630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36680092a0 con 0x7f3678137e30 2023-08-17T17:35:08.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367d67f700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3678137e30 0x7f3678151580 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f367000c810 tx=0x7f36700014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:08.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f366cff9700 1 -- 172.21.15.78:0/3113363630 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670005d30 con 0x7f3678137e30 2023-08-17T17:35:08.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f366cff9700 1 -- 172.21.15.78:0/3113363630 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3670005e90 con 0x7f3678137e30 2023-08-17T17:35:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367f0e2700 1 -- 172.21.15.78:0/3113363630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36781566e0 con 0x7f3678137e30 2023-08-17T17:35:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f366cff9700 1 -- 172.21.15.78:0/3113363630 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670007320 con 0x7f3678137e30 2023-08-17T17:35:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.162+0000 7f367f0e2700 1 -- 172.21.15.78:0/3113363630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3678156ca0 con 0x7f3678137e30 2023-08-17T17:35:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.163+0000 7f367f0e2700 1 -- 172.21.15.78:0/3113363630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36780bbb60 con 0x7f3678137e30 2023-08-17T17:35:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.164+0000 7f366cff9700 1 -- 172.21.15.78:0/3113363630 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3670010030 con 0x7f3678137e30 2023-08-17T17:35:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.164+0000 7f366cff9700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f366405ed60 0x7f3664061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.164+0000 7f366cff9700 1 -- 172.21.15.78:0/3113363630 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f36700796b0 con 0x7f3678137e30 2023-08-17T17:35:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.164+0000 7f367ce7e700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f366405ed60 0x7f3664061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.164+0000 7f367ce7e700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f366405ed60 0x7f3664061220 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f367400b8f0 tx=0x7f3674008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.168+0000 7f366cff9700 1 -- 172.21.15.78:0/3113363630 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f367004af40 con 0x7f3678137e30 2023-08-17T17:35:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.336+0000 7f367f0e2700 1 -- 172.21.15.78:0/3113363630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3678047350 con 0x7f3678137e30 2023-08-17T17:35:08.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.336+0000 7f366cff9700 1 -- 172.21.15.78:0/3113363630 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7f367004e560 con 0x7f3678137e30 2023-08-17T17:35:08.337 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:35:08.338 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:35:08.338 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:08.338 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T17:35:08.338 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T17:35:08.338 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:35:08.338 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:08.338 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T17:35:08.339 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T17:35:08.339 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:08.339 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:35:08.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.338+0000 7f367f0e2700 1 -- 172.21.15.78:0/3113363630 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f366405ed60 msgr2=0x7f3664061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.338+0000 7f367f0e2700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f366405ed60 0x7f3664061220 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f367400b8f0 tx=0x7f3674008040).stop 2023-08-17T17:35:08.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.338+0000 7f367f0e2700 1 -- 172.21.15.78:0/3113363630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3678137e30 msgr2=0x7f3678151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.338+0000 7f367f0e2700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3678137e30 0x7f3678151580 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f367000c810 tx=0x7f36700014d0).stop 2023-08-17T17:35:08.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.339+0000 7f367f0e2700 1 -- 172.21.15.78:0/3113363630 shutdown_connections 2023-08-17T17:35:08.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.339+0000 7f367f0e2700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f366405ed60 0x7f3664061220 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.339+0000 7f367f0e2700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3678137e30 0x7f3678151580 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.339+0000 7f367f0e2700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36780c0ff0 0x7f3678135ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:08.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.339+0000 7f367f0e2700 1 --2- 172.21.15.78:0/3113363630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36781375e0 0x7f3678155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:08.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.339+0000 7f367f0e2700 1 -- 172.21.15.78:0/3113363630 >> 172.21.15.78:0/3113363630 conn(0x7f3678062fc0 msgr2=0x7f36780c6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:08.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.339+0000 7f367f0e2700 1 -- 172.21.15.78:0/3113363630 shutdown_connections 2023-08-17T17:35:08.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.339+0000 7f367f0e2700 1 -- 172.21.15.78:0/3113363630 wait complete. 2023-08-17T17:35:08.351 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T17:35:08.352 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T17:35:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.469+0000 7fc1c94fd700 1 Processor -- start 2023-08-17T17:35:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.469+0000 7fc1c94fd700 1 -- start start 2023-08-17T17:35:08.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c94fd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc1c41520c0 0x7fc1c40c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c94fd700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c40c3a90 con 0x7fc1c40c6390 2023-08-17T17:35:08.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c94fd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c40c2e80 con 0x7fc1c40c6810 2023-08-17T17:35:08.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c94fd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c40c3160 con 0x7fc1c41520c0 2023-08-17T17:35:08.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1bbfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc1c40c6390 0x7fc1c40a9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34656/0 (socket says 172.21.15.78:34656) 2023-08-17T17:35:08.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1bbfff700 1 -- 172.21.15.78:0/3924400907 learned_addr learned my addr 172.21.15.78:0/3924400907 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:08.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c3fff700 1 --2- 172.21.15.78:0/3924400907 >> v2:172.21.15.150:3300/0 conn(0x7fc1c41520c0 0x7fc1c40c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:08.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496403945 0 0) 0x7fc1c40c3a90 con 0x7fc1c40c6390 2023-08-17T17:35:08.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b00033f0 con 0x7fc1c40c6390 2023-08-17T17:35:08.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3747640620 0 0) 0x7fc1b00033f0 con 0x7fc1c40c6390 2023-08-17T17:35:08.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 >> v2:172.21.15.150:3300/0 conn(0x7fc1c41520c0 msgr2=0x7fc1c40c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:08.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 --2- 172.21.15.78:0/3924400907 >> v2:172.21.15.150:3300/0 conn(0x7fc1c41520c0 0x7fc1c40c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 >> v1:172.21.15.150:6789/0 conn(0x7fc1c40c6810 legacy=0x7fc1c40625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40c3440 con 0x7fc1c40c6390 2023-08-17T17:35:08.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fc1ac001470 con 0x7fc1c40c6390 2023-08-17T17:35:08.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 >> v1:172.21.15.78:6789/0 conn(0x7fc1c40c6390 legacy=0x7fc1c40a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1b0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1b0004690 0x7fc1b0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1b0005000 0x7fc1b000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40c3160 con 0x7fc1b00038e0 2023-08-17T17:35:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000bf60 con 0x7fc1b0005000 2023-08-17T17:35:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000c0f0 con 0x7fc1b0004690 2023-08-17T17:35:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.470+0000 7fc1c3fff700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1b0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1bbfff700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1b0004690 0x7fc1b0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c3fff700 1 -- 172.21.15.78:0/3924400907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1b0004690 msgr2=0x7fc1b0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c3fff700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1b0004690 0x7fc1b0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c8cfc700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1b0005000 0x7fc1b000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c3fff700 1 -- 172.21.15.78:0/3924400907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1b0005000 msgr2=0x7fc1b000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c3fff700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1b0005000 0x7fc1b000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c3fff700 1 -- 172.21.15.78:0/3924400907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00033f0 con 0x7fc1b00038e0 2023-08-17T17:35:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c8cfc700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1b0005000 0x7fc1b000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c8cfc700 1 -- 172.21.15.78:0/3924400907 reap_dead start 2023-08-17T17:35:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c3fff700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1b0003d00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fc1b4009a60 tx=0x7fc1b4009060).ready entity=mon.0 client_cookie=127d0fd5d7416a7a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4009ea0 con 0x7fc1b00038e0 2023-08-17T17:35:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b4009430 con 0x7fc1b00038e0 2023-08-17T17:35:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c37fe700 1 -- 172.21.15.78:0/3924400907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400e870 con 0x7fc1b00038e0 2023-08-17T17:35:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3924400907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 msgr2=0x7fc1b0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.471+0000 7fc1c94fd700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1b0003d00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fc1b4009a60 tx=0x7fc1b4009060).stop 2023-08-17T17:35:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.472+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3924400907 shutdown_connections 2023-08-17T17:35:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.472+0000 7fc1c94fd700 1 --2- 172.21.15.78:0/3924400907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1b0003d00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.472+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3924400907 >> 172.21.15.78:0/3924400907 conn(0x7fc1c40c3e20 msgr2=0x7fc1c40c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.472+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3924400907 shutdown_connections 2023-08-17T17:35:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.472+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3924400907 wait complete. 2023-08-17T17:35:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.473+0000 7fc1c94fd700 1 Processor -- start 2023-08-17T17:35:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.473+0000 7fc1c94fd700 1 -- start start 2023-08-17T17:35:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.473+0000 7fc1c94fd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1c4145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.473+0000 7fc1c94fd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1c4169860 0x7fc1c4064e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.473+0000 7fc1c94fd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1c4065310 0x7fc1c4168690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.473+0000 7fc1c94fd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c41696a0 con 0x7fc1b00038e0 2023-08-17T17:35:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.473+0000 7fc1c94fd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4065790 con 0x7fc1c4065310 2023-08-17T17:35:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.473+0000 7fc1c94fd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c41693c0 con 0x7fc1c4169860 2023-08-17T17:35:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1c4145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1c4145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33596/0 (socket says 172.21.15.78:33596) 2023-08-17T17:35:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c3fff700 1 -- 172.21.15.78:0/3626996299 learned_addr learned my addr 172.21.15.78:0/3626996299 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c3fff700 1 -- 172.21.15.78:0/3626996299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1c4169860 msgr2=0x7fc1c4064e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c3fff700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1c4169860 0x7fc1c4064e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c3fff700 1 -- 172.21.15.78:0/3626996299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1c4065310 msgr2=0x7fc1c4168690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c3fff700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1c4065310 0x7fc1c4168690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c3fff700 1 -- 172.21.15.78:0/3626996299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40a71f0 con 0x7fc1b00038e0 2023-08-17T17:35:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c3fff700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1c4145f00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fc1b400e4b0 tx=0x7fc1b401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c0ff9700 1 -- 172.21.15.78:0/3626996299 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b401ba50 con 0x7fc1b00038e0 2023-08-17T17:35:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c0ff9700 1 -- 172.21.15.78:0/3626996299 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b401bbd0 con 0x7fc1b00038e0 2023-08-17T17:35:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3626996299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c40a74d0 con 0x7fc1b00038e0 2023-08-17T17:35:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c0ff9700 1 -- 172.21.15.78:0/3626996299 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4025440 con 0x7fc1b00038e0 2023-08-17T17:35:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.474+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3626996299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c41463f0 con 0x7fc1b00038e0 2023-08-17T17:35:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.475+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3626996299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c40a7b20 con 0x7fc1b00038e0 2023-08-17T17:35:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.475+0000 7fc1c0ff9700 1 -- 172.21.15.78:0/3626996299 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc1b402b020 con 0x7fc1b00038e0 2023-08-17T17:35:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.476+0000 7fc1c0ff9700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc1a405ed60 0x7fc1a4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.476+0000 7fc1c0ff9700 1 -- 172.21.15.78:0/3626996299 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc1b407afa0 con 0x7fc1b00038e0 2023-08-17T17:35:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.476+0000 7fc1bbfff700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc1a405ed60 0x7fc1a4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.476+0000 7fc1bbfff700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc1a405ed60 0x7fc1a4061220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fc1ac0010e0 tx=0x7fc1ac001560).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.480+0000 7fc1c0ff9700 1 -- 172.21.15.78:0/3626996299 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1b404c890 con 0x7fc1b00038e0 2023-08-17T17:35:08.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:08.641+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3626996299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fc1c40a7050 con 0x7fc1b00038e0 2023-08-17T17:35:09.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.351+0000 7fc1c0ff9700 1 -- 172.21.15.78:0/3626996299 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 152+0+0 (secure 0 0 0) 0x7fc1c40a7050 con 0x7fc1b00038e0 2023-08-17T17:35:09.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.353+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3626996299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc1a405ed60 msgr2=0x7fc1a4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:09.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.353+0000 7fc1c94fd700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc1a405ed60 0x7fc1a4061220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fc1ac0010e0 tx=0x7fc1ac001560).stop 2023-08-17T17:35:09.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.353+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3626996299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 msgr2=0x7fc1c4145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:09.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.353+0000 7fc1c94fd700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1c4145f00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fc1b400e4b0 tx=0x7fc1b401a000).stop 2023-08-17T17:35:09.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.354+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3626996299 shutdown_connections 2023-08-17T17:35:09.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.354+0000 7fc1c94fd700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc1a405ed60 0x7fc1a4061220 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:09.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.354+0000 7fc1c94fd700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1c4065310 0x7fc1c4168690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:09.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.354+0000 7fc1c94fd700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b00038e0 0x7fc1c4145f00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:09.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.354+0000 7fc1c94fd700 1 --2- 172.21.15.78:0/3626996299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1c4169860 0x7fc1c4064e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:09.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.354+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3626996299 >> 172.21.15.78:0/3626996299 conn(0x7fc1c40c3e20 msgr2=0x7fc1c4151290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:09.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.354+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3626996299 shutdown_connections 2023-08-17T17:35:09.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.354+0000 7fc1c94fd700 1 -- 172.21.15.78:0/3626996299 wait complete. 2023-08-17T17:35:09.362 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T17:35:09.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T17:35:09.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.492+0000 7f2195a0b700 1 Processor -- start 2023-08-17T17:35:09.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.492+0000 7f2195a0b700 1 -- start start 2023-08-17T17:35:09.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.492+0000 7f2195a0b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f21900c0f10 0x7f21900c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:09.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.492+0000 7f2195a0b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f21900c7e10 0x7f21900ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:09.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.492+0000 7f2195a0b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21900c6970 con 0x7f2190154110 2023-08-17T17:35:09.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.492+0000 7f2195a0b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21900cac90 con 0x7f21900c0f10 2023-08-17T17:35:09.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.492+0000 7f2195a0b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21900c6040 con 0x7f21900c7e10 2023-08-17T17:35:09.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f21867fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f21900c0f10 0x7f21900c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:09.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f21867fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f21900c0f10 0x7f21900c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53414/0 (socket says 172.21.15.78:53414) 2023-08-17T17:35:09.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f21867fc700 1 -- 172.21.15.78:0/2898727143 learned_addr learned my addr 172.21.15.78:0/2898727143 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:09.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f218f7fe700 1 --2- 172.21.15.78:0/2898727143 >> v2:172.21.15.150:3300/0 conn(0x7f21900c7e10 0x7f21900ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:09.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f21867fc700 1 -- 172.21.15.78:0/2898727143 >> v2:172.21.15.150:3300/0 conn(0x7f21900c7e10 msgr2=0x7f21900ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:09.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f21867fc700 1 --2- 172.21.15.78:0/2898727143 >> v2:172.21.15.150:3300/0 conn(0x7f21900c7e10 0x7f21900ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:09.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f21867fc700 1 -- 172.21.15.78:0/2898727143 >> v1:172.21.15.150:6789/0 conn(0x7f2190154110 legacy=0x7f21900c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:09.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f21867fc700 1 -- 172.21.15.78:0/2898727143 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21900c6320 con 0x7f21900c0f10 2023-08-17T17:35:09.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f21867fc700 1 --2- 172.21.15.78:0/2898727143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900c0f10 0x7f21900c9f40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f21900aa9f0 tx=0x7f21780090f0).ready entity=mon.0 client_cookie=288e62fa95cf78cf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:09.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f218e7fc700 1 -- 172.21.15.78:0/2898727143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800b520 con 0x7f21900c0f10 2023-08-17T17:35:09.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f218e7fc700 1 -- 172.21.15.78:0/2898727143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217800b680 con 0x7f21900c0f10 2023-08-17T17:35:09.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.493+0000 7f218e7fc700 1 -- 172.21.15.78:0/2898727143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800ba00 con 0x7f21900c0f10 2023-08-17T17:35:09.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.494+0000 7f2195a0b700 1 -- 172.21.15.78:0/2898727143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900c0f10 msgr2=0x7f21900c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:09.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.494+0000 7f2195a0b700 1 --2- 172.21.15.78:0/2898727143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900c0f10 0x7f21900c9f40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f21900aa9f0 tx=0x7f21780090f0).stop 2023-08-17T17:35:09.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.494+0000 7f2195a0b700 1 -- 172.21.15.78:0/2898727143 shutdown_connections 2023-08-17T17:35:09.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.494+0000 7f2195a0b700 1 --2- 172.21.15.78:0/2898727143 >> v2:172.21.15.150:3300/0 conn(0x7f21900c7e10 0x7f21900ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:09.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.494+0000 7f2195a0b700 1 --2- 172.21.15.78:0/2898727143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900c0f10 0x7f21900c9f40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:09.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.494+0000 7f2195a0b700 1 -- 172.21.15.78:0/2898727143 >> 172.21.15.78:0/2898727143 conn(0x7f2190094650 msgr2=0x7f219006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.494+0000 7f2195a0b700 1 -- 172.21.15.78:0/2898727143 shutdown_connections 2023-08-17T17:35:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.494+0000 7f2195a0b700 1 -- 172.21.15.78:0/2898727143 wait complete. 2023-08-17T17:35:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.495+0000 7f2195a0b700 1 Processor -- start 2023-08-17T17:35:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.495+0000 7f2195a0b700 1 -- start start 2023-08-17T17:35:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f2195a0b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21900c0f10 0x7f2190165090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f2195a0b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21900c7e10 0x7f21900c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f2195a0b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2190154110 0x7f2190167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f2195a0b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190164640 con 0x7f2190154110 2023-08-17T17:35:09.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f2195a0b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190164c00 con 0x7f21900c0f10 2023-08-17T17:35:09.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f2195a0b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2190165580 con 0x7f21900c7e10 2023-08-17T17:35:09.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2190154110 0x7f2190167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:09.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2190154110 0x7f2190167ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53424/0 (socket says 172.21.15.78:53424) 2023-08-17T17:35:09.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218f7fe700 1 -- 172.21.15.78:0/576966305 learned_addr learned my addr 172.21.15.78:0/576966305 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:09.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218effd700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21900c0f10 0x7f2190165090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:09.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f21867fc700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21900c7e10 0x7f21900c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:09.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218f7fe700 1 -- 172.21.15.78:0/576966305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21900c7e10 msgr2=0x7f21900c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:09.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218f7fe700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21900c7e10 0x7f21900c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:09.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218f7fe700 1 -- 172.21.15.78:0/576966305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21900c0f10 msgr2=0x7f2190165090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:09.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218f7fe700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21900c0f10 0x7f2190165090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:09.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218f7fe700 1 -- 172.21.15.78:0/576966305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2178009370 con 0x7f2190154110 2023-08-17T17:35:09.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218effd700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21900c0f10 0x7f2190165090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:09.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f218f7fe700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2190154110 0x7f2190167ba0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f2188009ef0 tx=0x7f218800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:09.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f21877fe700 1 -- 172.21.15.78:0/576966305 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800cc50 con 0x7f2190154110 2023-08-17T17:35:09.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f21877fe700 1 -- 172.21.15.78:0/576966305 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800f040 con 0x7f2190154110 2023-08-17T17:35:09.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f2195a0b700 1 -- 172.21.15.78:0/576966305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2190168660 con 0x7f2190154110 2023-08-17T17:35:09.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.496+0000 7f21877fe700 1 -- 172.21.15.78:0/576966305 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188013400 con 0x7f2190154110 2023-08-17T17:35:09.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.497+0000 7f2195a0b700 1 -- 172.21.15.78:0/576966305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2190164890 con 0x7f2190154110 2023-08-17T17:35:09.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.497+0000 7f2195a0b700 1 -- 172.21.15.78:0/576966305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2190164d90 con 0x7f2190154110 2023-08-17T17:35:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.498+0000 7f21877fe700 1 -- 172.21.15.78:0/576966305 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f21880137b0 con 0x7f2190154110 2023-08-17T17:35:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.498+0000 7f21877fe700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f217005ed90 0x7f2170061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.498+0000 7f218effd700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f217005ed90 0x7f2170061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.498+0000 7f21877fe700 1 -- 172.21.15.78:0/576966305 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f218807a2f0 con 0x7f2190154110 2023-08-17T17:35:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.499+0000 7f218effd700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f217005ed90 0x7f2170061250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f21900adb70 tx=0x7f2180009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:09.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.503+0000 7f21877fe700 1 -- 172.21.15.78:0/576966305 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f218804ba70 con 0x7f2190154110 2023-08-17T17:35:09.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:09.669+0000 7f2195a0b700 1 -- 172.21.15.78:0/576966305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2190047350 con 0x7f2190154110 2023-08-17T17:35:10.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.358+0000 7f21877fe700 1 -- 172.21.15.78:0/576966305 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f218804f090 con 0x7f2190154110 2023-08-17T17:35:10.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.363+0000 7f2195a0b700 1 -- 172.21.15.78:0/576966305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f217005ed90 msgr2=0x7f2170061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.363+0000 7f2195a0b700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f217005ed90 0x7f2170061250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f21900adb70 tx=0x7f2180009040).stop 2023-08-17T17:35:10.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.363+0000 7f2195a0b700 1 -- 172.21.15.78:0/576966305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2190154110 msgr2=0x7f2190167ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.363+0000 7f2195a0b700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2190154110 0x7f2190167ba0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f2188009ef0 tx=0x7f218800b040).stop 2023-08-17T17:35:10.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.364+0000 7f2195a0b700 1 -- 172.21.15.78:0/576966305 shutdown_connections 2023-08-17T17:35:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.364+0000 7f2195a0b700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f217005ed90 0x7f2170061250 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.364+0000 7f2195a0b700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2190154110 0x7f2190167ba0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.364+0000 7f2195a0b700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21900c0f10 0x7f2190165090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.364+0000 7f2195a0b700 1 --2- 172.21.15.78:0/576966305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21900c7e10 0x7f21900c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.364+0000 7f2195a0b700 1 -- 172.21.15.78:0/576966305 >> 172.21.15.78:0/576966305 conn(0x7f2190094650 msgr2=0x7f2190064850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:10.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.366+0000 7f2195a0b700 1 -- 172.21.15.78:0/576966305 shutdown_connections 2023-08-17T17:35:10.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.366+0000 7f2195a0b700 1 -- 172.21.15.78:0/576966305 wait complete. 2023-08-17T17:35:10.375 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T17:35:10.389 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T17:35:10.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.504+0000 7f10af69f700 1 Processor -- start 2023-08-17T17:35:10.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.504+0000 7f10af69f700 1 -- start start 2023-08-17T17:35:10.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10af69f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a80aa4d0 0x7f10a80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10af69f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f10a80c5810 0x7f10a80c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10af69f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a80649b0 con 0x7f10a80aa0f0 2023-08-17T17:35:10.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10af69f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a80c6150 con 0x7f10a80c5810 2023-08-17T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10af69f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8063420 con 0x7f10a80aa4d0 2023-08-17T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10adc3c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f10a80c5810 0x7f10a80c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10adc3c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f10a80c5810 0x7f10a80c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53432/0 (socket says 172.21.15.78:53432) 2023-08-17T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10adc3c700 1 -- 172.21.15.78:0/3435139648 learned_addr learned my addr 172.21.15.78:0/3435139648 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10acc3a700 1 --2- 172.21.15.78:0/3435139648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a80aa4d0 0x7f10a80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10adc3c700 1 -- 172.21.15.78:0/3435139648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a80aa4d0 msgr2=0x7f10a80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10adc3c700 1 --2- 172.21.15.78:0/3435139648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a80aa4d0 0x7f10a80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10adc3c700 1 -- 172.21.15.78:0/3435139648 >> v1:172.21.15.150:6789/0 conn(0x7f10a80aa0f0 legacy=0x7f10a80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:10.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10adc3c700 1 -- 172.21.15.78:0/3435139648 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a8063700 con 0x7f10a80c5810 2023-08-17T17:35:10.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.505+0000 7f10adc3c700 1 --2- 172.21.15.78:0/3435139648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80c5810 0x7f10a80c5c60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f10a0006fd0 tx=0x7f10a00090f0).ready entity=mon.0 client_cookie=bf234e6e515cdae server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:10.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f109ffff700 1 -- 172.21.15.78:0/3435139648 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a000b600 con 0x7f10a80c5810 2023-08-17T17:35:10.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f109ffff700 1 -- 172.21.15.78:0/3435139648 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a000b760 con 0x7f10a80c5810 2023-08-17T17:35:10.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f109ffff700 1 -- 172.21.15.78:0/3435139648 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a000bae0 con 0x7f10a80c5810 2023-08-17T17:35:10.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f10af69f700 1 -- 172.21.15.78:0/3435139648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80c5810 msgr2=0x7f10a80c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f10af69f700 1 --2- 172.21.15.78:0/3435139648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80c5810 0x7f10a80c5c60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f10a0006fd0 tx=0x7f10a00090f0).stop 2023-08-17T17:35:10.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f10af69f700 1 -- 172.21.15.78:0/3435139648 shutdown_connections 2023-08-17T17:35:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f10af69f700 1 --2- 172.21.15.78:0/3435139648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80c5810 0x7f10a80c5c60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f10af69f700 1 --2- 172.21.15.78:0/3435139648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a80aa4d0 0x7f10a80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f10af69f700 1 -- 172.21.15.78:0/3435139648 >> 172.21.15.78:0/3435139648 conn(0x7f10a806a6a0 msgr2=0x7f10a80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f10af69f700 1 -- 172.21.15.78:0/3435139648 shutdown_connections 2023-08-17T17:35:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.506+0000 7f10af69f700 1 -- 172.21.15.78:0/3435139648 wait complete. 2023-08-17T17:35:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.507+0000 7f10af69f700 1 Processor -- start 2023-08-17T17:35:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.507+0000 7f10af69f700 1 -- start start 2023-08-17T17:35:10.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.508+0000 7f10af69f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a80aa0f0 0x7f10a81589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.508+0000 7f10af69f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80aa4d0 0x7f10a8167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.508+0000 7f10af69f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80c5810 0x7f10a81519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.508+0000 7f10af69f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8158e90 con 0x7f10a80aa4d0 2023-08-17T17:35:10.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.508+0000 7f10af69f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a81647a0 con 0x7f10a80c5810 2023-08-17T17:35:10.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.508+0000 7f10af69f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8168260 con 0x7f10a80aa0f0 2023-08-17T17:35:10.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.508+0000 7f10acc3a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80aa4d0 0x7f10a8167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.508+0000 7f10acc3a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80aa4d0 0x7f10a8167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53442/0 (socket says 172.21.15.78:53442) 2023-08-17T17:35:10.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.508+0000 7f10acc3a700 1 -- 172.21.15.78:0/3150638660 learned_addr learned my addr 172.21.15.78:0/3150638660 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:10.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.508+0000 7f10ad43b700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a80aa0f0 0x7f10a81589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f10adc3c700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80c5810 0x7f10a81519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f10acc3a700 1 -- 172.21.15.78:0/3150638660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a80aa0f0 msgr2=0x7f10a81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f10acc3a700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a80aa0f0 0x7f10a81589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f10acc3a700 1 -- 172.21.15.78:0/3150638660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80c5810 msgr2=0x7f10a81519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f10acc3a700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80c5810 0x7f10a81519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f10acc3a700 1 -- 172.21.15.78:0/3150638660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0009370 con 0x7f10a80aa4d0 2023-08-17T17:35:10.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f10adc3c700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80c5810 0x7f10a81519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:10.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f10acc3a700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80aa4d0 0x7f10a8167d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f109800d890 tx=0x7f1098008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:10.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f109d7fa700 1 -- 172.21.15.78:0/3150638660 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098011590 con 0x7f10a80aa4d0 2023-08-17T17:35:10.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f109d7fa700 1 -- 172.21.15.78:0/3150638660 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10980116f0 con 0x7f10a80aa4d0 2023-08-17T17:35:10.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f10af69f700 1 -- 172.21.15.78:0/3150638660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a8168d10 con 0x7f10a80aa4d0 2023-08-17T17:35:10.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f109d7fa700 1 -- 172.21.15.78:0/3150638660 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098011a70 con 0x7f10a80aa4d0 2023-08-17T17:35:10.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.509+0000 7f10af69f700 1 -- 172.21.15.78:0/3150638660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a8164a40 con 0x7f10a80aa4d0 2023-08-17T17:35:10.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.510+0000 7f10af69f700 1 -- 172.21.15.78:0/3150638660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a8083980 con 0x7f10a80aa4d0 2023-08-17T17:35:10.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.510+0000 7f109d7fa700 1 -- 172.21.15.78:0/3150638660 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f109801c460 con 0x7f10a80aa4d0 2023-08-17T17:35:10.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.511+0000 7f109d7fa700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f108c05ed90 0x7f108c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.511+0000 7f109d7fa700 1 -- 172.21.15.78:0/3150638660 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f10980799b0 con 0x7f10a80aa4d0 2023-08-17T17:35:10.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.511+0000 7f10ad43b700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f108c05ed90 0x7f108c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.511+0000 7f10ad43b700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f108c05ed90 0x7f108c061250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f10a4006fd0 tx=0x7f10a4009250).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:10.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.515+0000 7f109d7fa700 1 -- 172.21.15.78:0/3150638660 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f109804ae40 con 0x7f10a80aa4d0 2023-08-17T17:35:10.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.720+0000 7f10af69f700 1 -- 172.21.15.78:0/3150638660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f10a80630f0 con 0x7f10a80aa4d0 2023-08-17T17:35:10.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.726+0000 7f109d7fa700 1 -- 172.21.15.78:0/3150638660 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v10) v1 ==== 172+0+0 (secure 0 0 0) 0x7f109804e460 con 0x7f10a80aa4d0 2023-08-17T17:35:10.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.732+0000 7f10af69f700 1 -- 172.21.15.78:0/3150638660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f108c05ed90 msgr2=0x7f108c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.732+0000 7f10af69f700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f108c05ed90 0x7f108c061250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f10a4006fd0 tx=0x7f10a4009250).stop 2023-08-17T17:35:10.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.732+0000 7f10af69f700 1 -- 172.21.15.78:0/3150638660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80aa4d0 msgr2=0x7f10a8167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.732+0000 7f10af69f700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80aa4d0 0x7f10a8167d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f109800d890 tx=0x7f1098008040).stop 2023-08-17T17:35:10.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.733+0000 7f10af69f700 1 -- 172.21.15.78:0/3150638660 shutdown_connections 2023-08-17T17:35:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.733+0000 7f10af69f700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f108c05ed90 0x7f108c061250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.733+0000 7f10af69f700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80c5810 0x7f10a81519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.733+0000 7f10af69f700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a80aa0f0 0x7f10a81589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.733+0000 7f10af69f700 1 --2- 172.21.15.78:0/3150638660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a80aa4d0 0x7f10a8167d70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.733+0000 7f10af69f700 1 -- 172.21.15.78:0/3150638660 >> 172.21.15.78:0/3150638660 conn(0x7f10a806a6a0 msgr2=0x7f10a8152e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.735+0000 7f10af69f700 1 -- 172.21.15.78:0/3150638660 shutdown_connections 2023-08-17T17:35:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.735+0000 7f10af69f700 1 -- 172.21.15.78:0/3150638660 wait complete. 2023-08-17T17:35:10.739 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 5 and data pool 6 2023-08-17T17:35:10.756 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:35:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.868+0000 7f7595211700 1 Processor -- start 2023-08-17T17:35:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.868+0000 7f7595211700 1 -- start start 2023-08-17T17:35:10.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.869+0000 7f7595211700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f759013a640 0x7f7590154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.869+0000 7f7595211700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7590069760 0x7f75900c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.869+0000 7f7595211700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75900c2c10 con 0x7f759006a2c0 2023-08-17T17:35:10.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.869+0000 7f7595211700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7590155010 con 0x7f759013a640 2023-08-17T17:35:10.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.869+0000 7f7595211700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75901552e0 con 0x7f7590069760 2023-08-17T17:35:10.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.869+0000 7f758ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f759013a640 0x7f7590154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.869+0000 7f758e59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f759006a2c0 0x7f7590069050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55304/0 (socket says 172.21.15.78:55304) 2023-08-17T17:35:10.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.869+0000 7f758e59c700 1 -- 172.21.15.78:0/3534489438 learned_addr learned my addr 172.21.15.78:0/3534489438 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:10.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f758f59e700 1 --2- 172.21.15.78:0/3534489438 >> v2:172.21.15.150:3300/0 conn(0x7f7590069760 0x7f75900c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f758ed9d700 1 -- 172.21.15.78:0/3534489438 >> v2:172.21.15.150:3300/0 conn(0x7f7590069760 msgr2=0x7f75900c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:10.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f758ed9d700 1 --2- 172.21.15.78:0/3534489438 >> v2:172.21.15.150:3300/0 conn(0x7f7590069760 0x7f75900c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f758ed9d700 1 -- 172.21.15.78:0/3534489438 >> v1:172.21.15.78:6789/0 conn(0x7f759006a2c0 legacy=0x7f7590069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f758dd9b700 1 -- 172.21.15.78:0/3534489438 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143673538 0 0) 0x7f75900c2c10 con 0x7f759006a2c0 2023-08-17T17:35:10.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f758ed9d700 1 -- 172.21.15.78:0/3534489438 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75901555c0 con 0x7f759013a640 2023-08-17T17:35:10.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f758ed9d700 1 --2- 172.21.15.78:0/3534489438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759013a640 0x7f7590154b20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f75901526d0 tx=0x7f7580009780).ready entity=mon.0 client_cookie=265efdbd334dba4a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:10.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f758dd9b700 1 -- 172.21.15.78:0/3534489438 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758000e070 con 0x7f759013a640 2023-08-17T17:35:10.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f758dd9b700 1 -- 172.21.15.78:0/3534489438 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758000bc30 con 0x7f759013a640 2023-08-17T17:35:10.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f758dd9b700 1 -- 172.21.15.78:0/3534489438 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580012410 con 0x7f759013a640 2023-08-17T17:35:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f7595211700 1 -- 172.21.15.78:0/3534489438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759013a640 msgr2=0x7f7590154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f7595211700 1 --2- 172.21.15.78:0/3534489438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759013a640 0x7f7590154b20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f75901526d0 tx=0x7f7580009780).stop 2023-08-17T17:35:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f7595211700 1 -- 172.21.15.78:0/3534489438 shutdown_connections 2023-08-17T17:35:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f7595211700 1 --2- 172.21.15.78:0/3534489438 >> v2:172.21.15.150:3300/0 conn(0x7f7590069760 0x7f75900c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f7595211700 1 --2- 172.21.15.78:0/3534489438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f759013a640 0x7f7590154b20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.870+0000 7f7595211700 1 -- 172.21.15.78:0/3534489438 >> 172.21.15.78:0/3534489438 conn(0x7f75900c7b00 msgr2=0x7f75900c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.871+0000 7f7595211700 1 -- 172.21.15.78:0/3534489438 shutdown_connections 2023-08-17T17:35:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.871+0000 7f7595211700 1 -- 172.21.15.78:0/3534489438 wait complete. 2023-08-17T17:35:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.872+0000 7f7595211700 1 Processor -- start 2023-08-17T17:35:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.872+0000 7f7595211700 1 -- start start 2023-08-17T17:35:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7595211700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7590069760 0x7f75900c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7595211700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f759006a2c0 0x7f75901502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7595211700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f759013a640 0x7f75900c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7595211700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75900bfc60 con 0x7f7590069760 2023-08-17T17:35:10.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7595211700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75900c07e0 con 0x7f759006a2c0 2023-08-17T17:35:10.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7595211700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7590136ee0 con 0x7f759013a640 2023-08-17T17:35:10.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f758ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7590069760 0x7f75900c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f758ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7590069760 0x7f75900c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53456/0 (socket says 172.21.15.78:53456) 2023-08-17T17:35:10.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f758ed9d700 1 -- 172.21.15.78:0/2852107292 learned_addr learned my addr 172.21.15.78:0/2852107292 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:10.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f758e59c700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f759006a2c0 0x7f75901502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f758ed9d700 1 -- 172.21.15.78:0/2852107292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f759013a640 msgr2=0x7f75900c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f758ed9d700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f759013a640 0x7f75900c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:10.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f758ed9d700 1 -- 172.21.15.78:0/2852107292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f759006a2c0 msgr2=0x7f75901502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:10.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f758ed9d700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f759006a2c0 0x7f75901502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:10.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f758ed9d700 1 -- 172.21.15.78:0/2852107292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7580009a20 con 0x7f7590069760 2023-08-17T17:35:10.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f758ed9d700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7590069760 0x7f75900c0c70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f758000b6c0 tx=0x7f7580009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:10.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7576ffd700 1 -- 172.21.15.78:0/2852107292 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758001f070 con 0x7f7590069760 2023-08-17T17:35:10.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7576ffd700 1 -- 172.21.15.78:0/2852107292 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580019630 con 0x7f7590069760 2023-08-17T17:35:10.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7595211700 1 -- 172.21.15.78:0/2852107292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75900bfeb0 con 0x7f7590069760 2023-08-17T17:35:10.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7576ffd700 1 -- 172.21.15.78:0/2852107292 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75800199d0 con 0x7f7590069760 2023-08-17T17:35:10.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.873+0000 7f7595211700 1 -- 172.21.15.78:0/2852107292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75900c0470 con 0x7f7590069760 2023-08-17T17:35:10.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.874+0000 7f7595211700 1 -- 172.21.15.78:0/2852107292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75900c0ac0 con 0x7f7590069760 2023-08-17T17:35:10.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.875+0000 7f7576ffd700 1 -- 172.21.15.78:0/2852107292 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f758002d3f0 con 0x7f7590069760 2023-08-17T17:35:10.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.875+0000 7f7576ffd700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f757c05ed90 0x7f757c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:10.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.875+0000 7f7576ffd700 1 -- 172.21.15.78:0/2852107292 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f758007d330 con 0x7f7590069760 2023-08-17T17:35:10.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.875+0000 7f758e59c700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f757c05ed90 0x7f757c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:10.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.875+0000 7f758e59c700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f757c05ed90 0x7f757c061250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f7590139220 tx=0x7f7584009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:10.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:10.879+0000 7f7576ffd700 1 -- 172.21.15.78:0/2852107292 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f758004e870 con 0x7f7590069760 2023-08-17T17:35:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.046+0000 7f7595211700 1 -- 172.21.15.78:0/2852107292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7590047350 con 0x7f7590069760 2023-08-17T17:35:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.047+0000 7f7576ffd700 1 -- 172.21.15.78:0/2852107292 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f7580017070 con 0x7f7590069760 2023-08-17T17:35:11.048 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:35:11.048 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":33,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:35:10.721056+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:35:08.663808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T17:35:09.691655+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:35:11.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 -- 172.21.15.78:0/2852107292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f757c05ed90 msgr2=0x7f757c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f757c05ed90 0x7f757c061250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f7590139220 tx=0x7f7584009040).stop 2023-08-17T17:35:11.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 -- 172.21.15.78:0/2852107292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7590069760 msgr2=0x7f75900c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7590069760 0x7f75900c0c70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f758000b6c0 tx=0x7f7580009780).stop 2023-08-17T17:35:11.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 -- 172.21.15.78:0/2852107292 shutdown_connections 2023-08-17T17:35:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f757c05ed90 0x7f757c061250 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f759013a640 0x7f75900c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7590069760 0x7f75900c0c70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 --2- 172.21.15.78:0/2852107292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f759006a2c0 0x7f75901502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 -- 172.21.15.78:0/2852107292 >> 172.21.15.78:0/2852107292 conn(0x7f75900c7b00 msgr2=0x7f7590152700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 -- 172.21.15.78:0/2852107292 shutdown_connections 2023-08-17T17:35:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.049+0000 7f7595211700 1 -- 172.21.15.78:0/2852107292 wait complete. 2023-08-17T17:35:11.062 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:35:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.174+0000 7fb46c3d0700 1 Processor -- start 2023-08-17T17:35:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.174+0000 7fb46c3d0700 1 -- start start 2023-08-17T17:35:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.175+0000 7fb46c3d0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4640c6ee0 0x7fb4640c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.175+0000 7fb46c3d0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 0x7fb4640ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.175+0000 7fb46c3d0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640c7350 con 0x7fb464154140 2023-08-17T17:35:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.175+0000 7fb46c3d0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4640a8350 con 0x7fb4640c6ee0 2023-08-17T17:35:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.175+0000 7fb46c3d0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640c1280 con 0x7fb4640c0df0 2023-08-17T17:35:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.175+0000 7fb46996b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4640c6ee0 0x7fb4640c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.175+0000 7fb46996b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4640c6ee0 0x7fb4640c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53468/0 (socket says 172.21.15.78:53468) 2023-08-17T17:35:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.175+0000 7fb46996b700 1 -- 172.21.15.78:0/3601968954 learned_addr learned my addr 172.21.15.78:0/3601968954 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.175+0000 7fb46a96d700 1 --2- 172.21.15.78:0/3601968954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 0x7fb4640ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46996b700 1 -- 172.21.15.78:0/3601968954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 msgr2=0x7fb4640ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46996b700 1 --2- 172.21.15.78:0/3601968954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 0x7fb4640ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46996b700 1 -- 172.21.15.78:0/3601968954 >> v1:172.21.15.150:6789/0 conn(0x7fb464154140 legacy=0x7fb4640a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46996b700 1 -- 172.21.15.78:0/3601968954 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464154520 con 0x7fb4640c6ee0 2023-08-17T17:35:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46a96d700 1 --2- 172.21.15.78:0/3601968954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 0x7fb4640ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:11.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46996b700 1 --2- 172.21.15.78:0/3601968954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 0x7fb4640c0900 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fb454006fd0 tx=0x7fb4540090f0).ready entity=mon.0 client_cookie=62c1c388b3130c80 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:11.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46916a700 1 -- 172.21.15.78:0/3601968954 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400b600 con 0x7fb4640c6ee0 2023-08-17T17:35:11.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46916a700 1 -- 172.21.15.78:0/3601968954 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400b760 con 0x7fb4640c6ee0 2023-08-17T17:35:11.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46916a700 1 -- 172.21.15.78:0/3601968954 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400bae0 con 0x7fb4640c6ee0 2023-08-17T17:35:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46c3d0700 1 -- 172.21.15.78:0/3601968954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 msgr2=0x7fb4640c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46c3d0700 1 --2- 172.21.15.78:0/3601968954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 0x7fb4640c0900 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fb454006fd0 tx=0x7fb4540090f0).stop 2023-08-17T17:35:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46c3d0700 1 -- 172.21.15.78:0/3601968954 shutdown_connections 2023-08-17T17:35:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46c3d0700 1 --2- 172.21.15.78:0/3601968954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 0x7fb4640ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46c3d0700 1 --2- 172.21.15.78:0/3601968954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 0x7fb4640c0900 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.176+0000 7fb46c3d0700 1 -- 172.21.15.78:0/3601968954 >> 172.21.15.78:0/3601968954 conn(0x7fb464094510 msgr2=0x7fb46406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:11.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.177+0000 7fb46c3d0700 1 -- 172.21.15.78:0/3601968954 shutdown_connections 2023-08-17T17:35:11.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.177+0000 7fb46c3d0700 1 -- 172.21.15.78:0/3601968954 wait complete. 2023-08-17T17:35:11.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46c3d0700 1 Processor -- start 2023-08-17T17:35:11.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46c3d0700 1 -- start start 2023-08-17T17:35:11.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46c3d0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 0x7fb464150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46c3d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 0x7fb4640ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46c3d0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb464154140 0x7fb4640ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46c3d0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb464157180 con 0x7fb4640c6ee0 2023-08-17T17:35:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46c3d0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640c4260 con 0x7fb464154140 2023-08-17T17:35:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46c3d0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640ae9b0 con 0x7fb4640c0df0 2023-08-17T17:35:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46996b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 0x7fb4640ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46996b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 0x7fb4640ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53472/0 (socket says 172.21.15.78:53472) 2023-08-17T17:35:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.178+0000 7fb46996b700 1 -- 172.21.15.78:0/1480898249 learned_addr learned my addr 172.21.15.78:0/1480898249 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46a16c700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 0x7fb464150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46a96d700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb464154140 0x7fb4640ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46996b700 1 -- 172.21.15.78:0/1480898249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 msgr2=0x7fb464150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46996b700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 0x7fb464150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46996b700 1 -- 172.21.15.78:0/1480898249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb464154140 msgr2=0x7fb4640ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46996b700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb464154140 0x7fb4640ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46996b700 1 -- 172.21.15.78:0/1480898249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454009370 con 0x7fb4640c6ee0 2023-08-17T17:35:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46a96d700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb464154140 0x7fb4640ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46996b700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 0x7fb4640ade40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fb46406c200 tx=0x7fb454017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb45a7fc700 1 -- 172.21.15.78:0/1480898249 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400b8d0 con 0x7fb4640c6ee0 2023-08-17T17:35:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb45a7fc700 1 -- 172.21.15.78:0/1480898249 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400ba30 con 0x7fb4640c6ee0 2023-08-17T17:35:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46c3d0700 1 -- 172.21.15.78:0/1480898249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4640aec90 con 0x7fb4640c6ee0 2023-08-17T17:35:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb45a7fc700 1 -- 172.21.15.78:0/1480898249 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45401b660 con 0x7fb4640c6ee0 2023-08-17T17:35:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.179+0000 7fb46c3d0700 1 -- 172.21.15.78:0/1480898249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb464150750 con 0x7fb4640c6ee0 2023-08-17T17:35:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.180+0000 7fb46c3d0700 1 -- 172.21.15.78:0/1480898249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4641572f0 con 0x7fb4640c6ee0 2023-08-17T17:35:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.180+0000 7fb45a7fc700 1 -- 172.21.15.78:0/1480898249 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb45402b070 con 0x7fb4640c6ee0 2023-08-17T17:35:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.181+0000 7fb45a7fc700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb44805ed90 0x7fb448061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.181+0000 7fb45a7fc700 1 -- 172.21.15.78:0/1480898249 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb45407b410 con 0x7fb4640c6ee0 2023-08-17T17:35:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.181+0000 7fb46a16c700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb44805ed90 0x7fb448061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.181+0000 7fb46a16c700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb44805ed90 0x7fb448061250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb460003860 tx=0x7fb460007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.185+0000 7fb45a7fc700 1 -- 172.21.15.78:0/1480898249 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb45404c9b0 con 0x7fb4640c6ee0 2023-08-17T17:35:11.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.348+0000 7fb46c3d0700 1 -- 172.21.15.78:0/1480898249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb464047350 con 0x7fb4640c6ee0 2023-08-17T17:35:11.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.349+0000 7fb45a7fc700 1 -- 172.21.15.78:0/1480898249 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16989 (secure 0 0 0) 0x7fb45401f020 con 0x7fb4640c6ee0 2023-08-17T17:35:11.350 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:35:11.350 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":33,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:35:10.721056+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:35:08.663808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T17:35:09.691655+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:35:11.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.351+0000 7fb46c3d0700 1 -- 172.21.15.78:0/1480898249 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb44805ed90 msgr2=0x7fb448061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.351+0000 7fb46c3d0700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb44805ed90 0x7fb448061250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb460003860 tx=0x7fb460007d40).stop 2023-08-17T17:35:11.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.351+0000 7fb46c3d0700 1 -- 172.21.15.78:0/1480898249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 msgr2=0x7fb4640ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.351+0000 7fb46c3d0700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 0x7fb4640ade40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fb46406c200 tx=0x7fb454017000).stop 2023-08-17T17:35:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.351+0000 7fb46c3d0700 1 -- 172.21.15.78:0/1480898249 shutdown_connections 2023-08-17T17:35:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.351+0000 7fb46c3d0700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb44805ed90 0x7fb448061250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.351+0000 7fb46c3d0700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb464154140 0x7fb4640ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.351+0000 7fb46c3d0700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4640c0df0 0x7fb464150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.351+0000 7fb46c3d0700 1 --2- 172.21.15.78:0/1480898249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4640c6ee0 0x7fb4640ade40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.351+0000 7fb46c3d0700 1 -- 172.21.15.78:0/1480898249 >> 172.21.15.78:0/1480898249 conn(0x7fb464094510 msgr2=0x7fb4640a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.352+0000 7fb46c3d0700 1 -- 172.21.15.78:0/1480898249 shutdown_connections 2023-08-17T17:35:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.352+0000 7fb46c3d0700 1 -- 172.21.15.78:0/1480898249 wait complete. 2023-08-17T17:35:11.364 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T17:35:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.479+0000 7f185e0a2700 1 Processor -- start 2023-08-17T17:35:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.479+0000 7f185e0a2700 1 -- start start 2023-08-17T17:35:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.480+0000 7f185e0a2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18580aa4d0 0x7f18580644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.480+0000 7f185e0a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580c5810 0x7f18580c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.480+0000 7f185e0a2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18580649b0 con 0x7f18580aa0f0 2023-08-17T17:35:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.480+0000 7f185e0a2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18580c6170 con 0x7f18580aa4d0 2023-08-17T17:35:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.480+0000 7f185e0a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1858063420 con 0x7f18580c5810 2023-08-17T17:35:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.480+0000 7f1856ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18580aa4d0 0x7f18580644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f1857fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580c5810 0x7f18580c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f18577fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f18580aa0f0 0x7f18580c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:35926/0 (socket says 172.21.15.78:35926) 2023-08-17T17:35:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f18577fe700 1 -- 172.21.15.78:0/151679591 learned_addr learned my addr 172.21.15.78:0/151679591 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f18567fc700 1 -- 172.21.15.78:0/151679591 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587651959 0 0) 0x7f18580649b0 con 0x7f18580aa0f0 2023-08-17T17:35:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f1857fff700 1 -- 172.21.15.78:0/151679591 >> v2:172.21.15.150:3300/0 conn(0x7f18580aa4d0 msgr2=0x7f18580644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f1857fff700 1 --2- 172.21.15.78:0/151679591 >> v2:172.21.15.150:3300/0 conn(0x7f18580aa4d0 0x7f18580644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f1857fff700 1 -- 172.21.15.78:0/151679591 >> v1:172.21.15.150:6789/0 conn(0x7f18580aa0f0 legacy=0x7f18580c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f1857fff700 1 -- 172.21.15.78:0/151679591 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858063700 con 0x7f18580c5810 2023-08-17T17:35:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f1857fff700 1 --2- 172.21.15.78:0/151679591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580c5810 0x7f18580c5c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1850009760 tx=0x7f1850009060).ready entity=mon.2 client_cookie=95d5d492bb9910bb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f18567fc700 1 -- 172.21.15.78:0/151679591 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185000f510 con 0x7f18580c5810 2023-08-17T17:35:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f18567fc700 1 -- 172.21.15.78:0/151679591 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185000f670 con 0x7f18580c5810 2023-08-17T17:35:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.481+0000 7f18567fc700 1 -- 172.21.15.78:0/151679591 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185000f9f0 con 0x7f18580c5810 2023-08-17T17:35:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.482+0000 7f185e0a2700 1 -- 172.21.15.78:0/151679591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580c5810 msgr2=0x7f18580c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.482+0000 7f185e0a2700 1 --2- 172.21.15.78:0/151679591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580c5810 0x7f18580c5c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1850009760 tx=0x7f1850009060).stop 2023-08-17T17:35:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.482+0000 7f185e0a2700 1 -- 172.21.15.78:0/151679591 shutdown_connections 2023-08-17T17:35:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.482+0000 7f185e0a2700 1 --2- 172.21.15.78:0/151679591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580c5810 0x7f18580c5c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.482+0000 7f185e0a2700 1 --2- 172.21.15.78:0/151679591 >> v2:172.21.15.150:3300/0 conn(0x7f18580aa4d0 0x7f18580644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.482+0000 7f185e0a2700 1 -- 172.21.15.78:0/151679591 >> 172.21.15.78:0/151679591 conn(0x7f185806a6a0 msgr2=0x7f18580caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.482+0000 7f185e0a2700 1 -- 172.21.15.78:0/151679591 shutdown_connections 2023-08-17T17:35:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.482+0000 7f185e0a2700 1 -- 172.21.15.78:0/151679591 wait complete. 2023-08-17T17:35:11.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.483+0000 7f185e0a2700 1 Processor -- start 2023-08-17T17:35:11.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.483+0000 7f185e0a2700 1 -- start start 2023-08-17T17:35:11.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f185e0a2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18580aa0f0 0x7f18580ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f185e0a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580aa4d0 0x7f18580ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f185e0a2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18580c5810 0x7f18580c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f185e0a2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18580ac010 con 0x7f18580aa0f0 2023-08-17T17:35:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f185e0a2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18580c22d0 con 0x7f18580c5810 2023-08-17T17:35:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f185e0a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18580c1ac0 con 0x7f18580aa4d0 2023-08-17T17:35:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f18577fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18580aa0f0 0x7f18580ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f18577fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18580aa0f0 0x7f18580ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53474/0 (socket says 172.21.15.78:53474) 2023-08-17T17:35:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f18577fe700 1 -- 172.21.15.78:0/1014386548 learned_addr learned my addr 172.21.15.78:0/1014386548 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f1857fff700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18580c5810 0x7f18580c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f1856ffd700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580aa4d0 0x7f18580ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f18577fe700 1 -- 172.21.15.78:0/1014386548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580aa4d0 msgr2=0x7f18580ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f18577fe700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580aa4d0 0x7f18580ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f18577fe700 1 -- 172.21.15.78:0/1014386548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18580c5810 msgr2=0x7f18580c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f18577fe700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18580c5810 0x7f18580c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f18577fe700 1 -- 172.21.15.78:0/1014386548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18500092a0 con 0x7f18580aa0f0 2023-08-17T17:35:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f1856ffd700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580aa4d0 0x7f18580ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f18577fe700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18580aa0f0 0x7f18580ad590 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f184800c840 tx=0x7f1848001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f183f7fe700 1 -- 172.21.15.78:0/1014386548 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848005d30 con 0x7f18580aa0f0 2023-08-17T17:35:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f183f7fe700 1 -- 172.21.15.78:0/1014386548 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1848005e90 con 0x7f18580aa0f0 2023-08-17T17:35:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f185e0a2700 1 -- 172.21.15.78:0/1014386548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18580c1d10 con 0x7f18580aa0f0 2023-08-17T17:35:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f183f7fe700 1 -- 172.21.15.78:0/1014386548 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848007320 con 0x7f18580aa0f0 2023-08-17T17:35:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.484+0000 7f185e0a2700 1 -- 172.21.15.78:0/1014386548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18580ac1f0 con 0x7f18580aa0f0 2023-08-17T17:35:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.485+0000 7f185e0a2700 1 -- 172.21.15.78:0/1014386548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1858083980 con 0x7f18580aa0f0 2023-08-17T17:35:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.486+0000 7f183f7fe700 1 -- 172.21.15.78:0/1014386548 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1848010030 con 0x7f18580aa0f0 2023-08-17T17:35:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.486+0000 7f183f7fe700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f184405ed90 0x7f1844061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.486+0000 7f183f7fe700 1 -- 172.21.15.78:0/1014386548 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1848079ab0 con 0x7f18580aa0f0 2023-08-17T17:35:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.486+0000 7f1856ffd700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f184405ed90 0x7f1844061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.486+0000 7f1856ffd700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f184405ed90 0x7f1844061250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f184c006d80 tx=0x7f184c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:11.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.490+0000 7f183f7fe700 1 -- 172.21.15.78:0/1014386548 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f184804b050 con 0x7f18580aa0f0 2023-08-17T17:35:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:11.695+0000 7f185e0a2700 1 -- 172.21.15.78:0/1014386548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f18580cbd40 con 0x7f18580aa0f0 2023-08-17T17:35:12.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.362+0000 7f183f7fe700 1 -- 172.21.15.78:0/1014386548 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f18480016b0 con 0x7f18580aa0f0 2023-08-17T17:35:12.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 -- 172.21.15.78:0/1014386548 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f184405ed90 msgr2=0x7f1844061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:12.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f184405ed90 0x7f1844061250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f184c006d80 tx=0x7f184c008040).stop 2023-08-17T17:35:12.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 -- 172.21.15.78:0/1014386548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18580aa0f0 msgr2=0x7f18580ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:12.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18580aa0f0 0x7f18580ad590 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f184800c840 tx=0x7f1848001570).stop 2023-08-17T17:35:12.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 -- 172.21.15.78:0/1014386548 shutdown_connections 2023-08-17T17:35:12.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f184405ed90 0x7f1844061250 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:12.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18580c5810 0x7f18580c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:12.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18580aa0f0 0x7f18580ad590 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:12.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 --2- 172.21.15.78:0/1014386548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18580aa4d0 0x7f18580ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:12.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 -- 172.21.15.78:0/1014386548 >> 172.21.15.78:0/1014386548 conn(0x7f185806a6a0 msgr2=0x7f18580a8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:12.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.364+0000 7f185e0a2700 1 -- 172.21.15.78:0/1014386548 shutdown_connections 2023-08-17T17:35:12.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.365+0000 7f185e0a2700 1 -- 172.21.15.78:0/1014386548 wait complete. 2023-08-17T17:35:12.377 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T17:35:12.378 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T17:35:12.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.495+0000 7f065fa1b700 1 Processor -- start 2023-08-17T17:35:12.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.495+0000 7f065fa1b700 1 -- start start 2023-08-17T17:35:12.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.496+0000 7f065fa1b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580aa4d0 0x7f06580644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:12.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.496+0000 7f065fa1b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06580649b0 con 0x7f06580c5810 2023-08-17T17:35:12.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.496+0000 7f065fa1b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0658063420 con 0x7f06580aa0f0 2023-08-17T17:35:12.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.496+0000 7f065fa1b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0658063700 con 0x7f06580aa4d0 2023-08-17T17:35:12.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.496+0000 7f065dfb8700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f06580c5810 0x7f06580a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55320/0 (socket says 172.21.15.78:55320) 2023-08-17T17:35:12.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.496+0000 7f065dfb8700 1 -- 172.21.15.78:0/3493511715 learned_addr learned my addr 172.21.15.78:0/3493511715 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:12.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.496+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619045090 0 0) 0x7f06580649b0 con 0x7f06580c5810 2023-08-17T17:35:12.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.496+0000 7f065cfb6700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580aa4d0 0x7f06580644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:12.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.496+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06440033f0 con 0x7f06580c5810 2023-08-17T17:35:12.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2642029486 0 0) 0x7f06440033f0 con 0x7f06580c5810 2023-08-17T17:35:12.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580aa4d0 msgr2=0x7f06580644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:12.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580aa4d0 0x7f06580644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:12.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 >> v1:172.21.15.150:6789/0 conn(0x7f06580aa0f0 legacy=0x7f06580c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:12.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580639e0 con 0x7f06580c5810 2023-08-17T17:35:12.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f06500017f0 con 0x7f06580c5810 2023-08-17T17:35:12.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 >> v1:172.21.15.78:6789/0 conn(0x7f06580c5810 legacy=0x7f06580a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:12.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580aa4d0 0x7f0644003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:12.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0644003e00 0x7f0644004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:12.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0644004b80 0x7f0644005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:12.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0658063700 con 0x7f0644004b80 2023-08-17T17:35:12.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064400b8e0 con 0x7f0644003e00 2023-08-17T17:35:12.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064400baa0 con 0x7f06580aa4d0 2023-08-17T17:35:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065dfb8700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0644004b80 0x7f0644005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065cfb6700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0644003e00 0x7f0644004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065d7b7700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580aa4d0 0x7f0644003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065dfb8700 1 -- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580aa4d0 msgr2=0x7f0644003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065dfb8700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580aa4d0 0x7f0644003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065dfb8700 1 -- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0644003e00 msgr2=0x7f0644004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065dfb8700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0644003e00 0x7f0644004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065dfb8700 1 -- 172.21.15.78:0/3493511715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06440033f0 con 0x7f0644004b80 2023-08-17T17:35:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065cfb6700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0644003e00 0x7f0644004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065d7b7700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06580aa4d0 0x7f0644003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f065dfb8700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0644004b80 0x7f0644005000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f065000c5f0 tx=0x7f0650001d90).ready entity=mon.0 client_cookie=4310ead58b106d9b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650001fc0 con 0x7f0644004b80 2023-08-17T17:35:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650005b20 con 0x7f0644004b80 2023-08-17T17:35:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.497+0000 7f064ffff700 1 -- 172.21.15.78:0/3493511715 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500070d0 con 0x7f0644004b80 2023-08-17T17:35:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.498+0000 7f065fa1b700 1 -- 172.21.15.78:0/3493511715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0644004b80 msgr2=0x7f0644005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.498+0000 7f065fa1b700 1 --2- 172.21.15.78:0/3493511715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0644004b80 0x7f0644005000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f065000c5f0 tx=0x7f0650001d90).stop 2023-08-17T17:35:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.498+0000 7f065dfb8700 1 -- 172.21.15.78:0/3493511715 reap_dead start 2023-08-17T17:35:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.498+0000 7f065fa1b700 1 -- 172.21.15.78:0/3493511715 shutdown_connections 2023-08-17T17:35:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.498+0000 7f065fa1b700 1 -- 172.21.15.78:0/3493511715 >> 172.21.15.78:0/3493511715 conn(0x7f065806a6a0 msgr2=0x7f06580caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.498+0000 7f065fa1b700 1 -- 172.21.15.78:0/3493511715 shutdown_connections 2023-08-17T17:35:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.498+0000 7f065fa1b700 1 -- 172.21.15.78:0/3493511715 wait complete. 2023-08-17T17:35:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.499+0000 7f065fa1b700 1 Processor -- start 2023-08-17T17:35:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.499+0000 7f065fa1b700 1 -- start start 2023-08-17T17:35:12.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065fa1b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0644004b80 0x7f0658164550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:12.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065fa1b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0658154ae0 0x7f06580c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:12.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065fa1b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580ad0f0 0x7f06580c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:12.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065fa1b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06580c8280 con 0x7f0658154ae0 2023-08-17T17:35:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065fa1b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06581534d0 con 0x7f06580ad0f0 2023-08-17T17:35:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065fa1b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0658164ff0 con 0x7f0644004b80 2023-08-17T17:35:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065cfb6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0658154ae0 0x7f06580c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065cfb6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0658154ae0 0x7f06580c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53490/0 (socket says 172.21.15.78:53490) 2023-08-17T17:35:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065cfb6700 1 -- 172.21.15.78:0/3683924105 learned_addr learned my addr 172.21.15.78:0/3683924105 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065d7b7700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0644004b80 0x7f0658164550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065dfb8700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580ad0f0 0x7f06580c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:12.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065cfb6700 1 -- 172.21.15.78:0/3683924105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0644004b80 msgr2=0x7f0658164550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:12.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065cfb6700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0644004b80 0x7f0658164550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:12.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065cfb6700 1 -- 172.21.15.78:0/3683924105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580ad0f0 msgr2=0x7f06580c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:12.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065cfb6700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580ad0f0 0x7f06580c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:12.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065cfb6700 1 -- 172.21.15.78:0/3683924105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0658164a40 con 0x7f0658154ae0 2023-08-17T17:35:12.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.500+0000 7f065dfb8700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580ad0f0 0x7f06580c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:12.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.501+0000 7f065cfb6700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0658154ae0 0x7f06580c78a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f0648011710 tx=0x7f0648008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:12.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.501+0000 7f064d7fa700 1 -- 172.21.15.78:0/3683924105 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648013620 con 0x7f0658154ae0 2023-08-17T17:35:12.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.501+0000 7f064d7fa700 1 -- 172.21.15.78:0/3683924105 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648013780 con 0x7f0658154ae0 2023-08-17T17:35:12.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.501+0000 7f065fa1b700 1 -- 172.21.15.78:0/3683924105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0658164d10 con 0x7f0658154ae0 2023-08-17T17:35:12.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.501+0000 7f064d7fa700 1 -- 172.21.15.78:0/3683924105 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648013b00 con 0x7f0658154ae0 2023-08-17T17:35:12.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.501+0000 7f065fa1b700 1 -- 172.21.15.78:0/3683924105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06581594d0 con 0x7f0658154ae0 2023-08-17T17:35:12.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.502+0000 7f065fa1b700 1 -- 172.21.15.78:0/3683924105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0658084270 con 0x7f0658154ae0 2023-08-17T17:35:12.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.502+0000 7f064d7fa700 1 -- 172.21.15.78:0/3683924105 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0648012040 con 0x7f0658154ae0 2023-08-17T17:35:12.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.502+0000 7f064d7fa700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f063c05edc0 0x7f063c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:12.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.502+0000 7f064d7fa700 1 -- 172.21.15.78:0/3683924105 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0648079d10 con 0x7f0658154ae0 2023-08-17T17:35:12.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.502+0000 7f065d7b7700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f063c05edc0 0x7f063c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:12.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.503+0000 7f065d7b7700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f063c05edc0 0x7f063c061280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f0654007fd0 tx=0x7f065400c040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:12.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.506+0000 7f064d7fa700 1 -- 172.21.15.78:0/3683924105 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f064804b2b0 con 0x7f0658154ae0 2023-08-17T17:35:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:12.716+0000 7f065fa1b700 1 -- 172.21.15.78:0/3683924105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0658046af0 con 0x7f0658154ae0 2023-08-17T17:35:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.369+0000 7f064d7fa700 1 -- 172.21.15.78:0/3683924105 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f064804e8d0 con 0x7f0658154ae0 2023-08-17T17:35:13.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 -- 172.21.15.78:0/3683924105 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f063c05edc0 msgr2=0x7f063c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f063c05edc0 0x7f063c061280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f0654007fd0 tx=0x7f065400c040).stop 2023-08-17T17:35:13.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 -- 172.21.15.78:0/3683924105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0658154ae0 msgr2=0x7f06580c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0658154ae0 0x7f06580c78a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f0648011710 tx=0x7f0648008040).stop 2023-08-17T17:35:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 -- 172.21.15.78:0/3683924105 shutdown_connections 2023-08-17T17:35:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f063c05edc0 0x7f063c061280 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06580ad0f0 0x7f06580c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0644004b80 0x7f0658164550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 --2- 172.21.15.78:0/3683924105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0658154ae0 0x7f06580c78a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 -- 172.21.15.78:0/3683924105 >> 172.21.15.78:0/3683924105 conn(0x7f065806a6a0 msgr2=0x7f0658153cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 -- 172.21.15.78:0/3683924105 shutdown_connections 2023-08-17T17:35:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.371+0000 7f065fa1b700 1 -- 172.21.15.78:0/3683924105 wait complete. 2023-08-17T17:35:13.384 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T17:35:13.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:35:13.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.497+0000 7efca6587700 1 Processor -- start 2023-08-17T17:35:13.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.497+0000 7efca6587700 1 -- start start 2023-08-17T17:35:13.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efca6587700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 0x7efca00c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efca6587700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efca00a9f60 0x7efca00c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efca6587700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca00c6860 con 0x7efca0154470 2023-08-17T17:35:13.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efca6587700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca00c8940 con 0x7efca00a9f60 2023-08-17T17:35:13.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efca6587700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca00aa3d0 con 0x7efca0154090 2023-08-17T17:35:13.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efc9f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efca0154470 0x7efca00a7d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55324/0 (socket says 172.21.15.78:55324) 2023-08-17T17:35:13.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efc9f7fe700 1 -- 172.21.15.78:0/3861755578 learned_addr learned my addr 172.21.15.78:0/3861755578 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:13.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efc9ffff700 1 --2- 172.21.15.78:0/3861755578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 0x7efca00c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efca4b24700 1 --2- 172.21.15.78:0/3861755578 >> v2:172.21.15.150:3300/0 conn(0x7efca00a9f60 0x7efca00c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efc9effd700 1 -- 172.21.15.78:0/3861755578 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898603430 0 0) 0x7efca00c6860 con 0x7efca0154470 2023-08-17T17:35:13.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.498+0000 7efc9effd700 1 -- 172.21.15.78:0/3861755578 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc880033f0 con 0x7efca0154470 2023-08-17T17:35:13.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efc9ffff700 1 -- 172.21.15.78:0/3861755578 >> v2:172.21.15.150:3300/0 conn(0x7efca00a9f60 msgr2=0x7efca00c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:13.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efc9ffff700 1 --2- 172.21.15.78:0/3861755578 >> v2:172.21.15.150:3300/0 conn(0x7efca00a9f60 0x7efca00c07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efc9ffff700 1 -- 172.21.15.78:0/3861755578 >> v1:172.21.15.78:6789/0 conn(0x7efca0154470 legacy=0x7efca00a7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efc9ffff700 1 -- 172.21.15.78:0/3861755578 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca00aa690 con 0x7efca0154090 2023-08-17T17:35:13.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efca4b24700 1 --2- 172.21.15.78:0/3861755578 >> v2:172.21.15.150:3300/0 conn(0x7efca00a9f60 0x7efca00c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:35:13.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efc9ffff700 1 --2- 172.21.15.78:0/3861755578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 0x7efca00c8450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7efc90009760 tx=0x7efc90009060).ready entity=mon.2 client_cookie=757bb755c495c19d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:13.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efc9effd700 1 -- 172.21.15.78:0/3861755578 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000d4a0 con 0x7efca0154090 2023-08-17T17:35:13.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efc9effd700 1 -- 172.21.15.78:0/3861755578 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000d600 con 0x7efca0154090 2023-08-17T17:35:13.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efc9effd700 1 -- 172.21.15.78:0/3861755578 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000d980 con 0x7efca0154090 2023-08-17T17:35:13.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efca6587700 1 -- 172.21.15.78:0/3861755578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 msgr2=0x7efca00c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.499+0000 7efca6587700 1 --2- 172.21.15.78:0/3861755578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 0x7efca00c8450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7efc90009760 tx=0x7efc90009060).stop 2023-08-17T17:35:13.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.500+0000 7efca6587700 1 -- 172.21.15.78:0/3861755578 shutdown_connections 2023-08-17T17:35:13.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.500+0000 7efca6587700 1 --2- 172.21.15.78:0/3861755578 >> v2:172.21.15.150:3300/0 conn(0x7efca00a9f60 0x7efca00c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.500+0000 7efca6587700 1 --2- 172.21.15.78:0/3861755578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 0x7efca00c8450 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.500+0000 7efca6587700 1 -- 172.21.15.78:0/3861755578 >> 172.21.15.78:0/3861755578 conn(0x7efca0094670 msgr2=0x7efca006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:13.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.500+0000 7efca6587700 1 -- 172.21.15.78:0/3861755578 shutdown_connections 2023-08-17T17:35:13.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.500+0000 7efca6587700 1 -- 172.21.15.78:0/3861755578 wait complete. 2023-08-17T17:35:13.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.501+0000 7efca6587700 1 Processor -- start 2023-08-17T17:35:13.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.501+0000 7efca6587700 1 -- start start 2023-08-17T17:35:13.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca6587700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca00a9f60 0x7efca0150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca6587700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 0x7efca0144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca6587700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca0154470 0x7efca00c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca6587700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca00aabe0 con 0x7efca0154470 2023-08-17T17:35:13.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca6587700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca00c41e0 con 0x7efca00a9f60 2023-08-17T17:35:13.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca6587700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca00c35d0 con 0x7efca0154090 2023-08-17T17:35:13.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca4b24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca0154470 0x7efca00c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca4b24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca0154470 0x7efca00c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53492/0 (socket says 172.21.15.78:53492) 2023-08-17T17:35:13.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca4b24700 1 -- 172.21.15.78:0/3620427442 learned_addr learned my addr 172.21.15.78:0/3620427442 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:13.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efc9ffff700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca00a9f60 0x7efca0150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efc9f7fe700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 0x7efca0144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca4b24700 1 -- 172.21.15.78:0/3620427442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 msgr2=0x7efca0144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca4b24700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 0x7efca0144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca4b24700 1 -- 172.21.15.78:0/3620427442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca00a9f60 msgr2=0x7efca0150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca4b24700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca00a9f60 0x7efca0150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca4b24700 1 -- 172.21.15.78:0/3620427442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98009a20 con 0x7efca0154470 2023-08-17T17:35:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efc9ffff700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca00a9f60 0x7efca0150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca4b24700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca0154470 0x7efca00c4670 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7efc98009fc0 tx=0x7efc9800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efc87fff700 1 -- 172.21.15.78:0/3620427442 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800cc80 con 0x7efca0154470 2023-08-17T17:35:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efc87fff700 1 -- 172.21.15.78:0/3620427442 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9800f040 con 0x7efca0154470 2023-08-17T17:35:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca6587700 1 -- 172.21.15.78:0/3620427442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc900092a0 con 0x7efca0154470 2023-08-17T17:35:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efc87fff700 1 -- 172.21.15.78:0/3620427442 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98013400 con 0x7efca0154470 2023-08-17T17:35:13.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.502+0000 7efca6587700 1 -- 172.21.15.78:0/3620427442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca00c3e70 con 0x7efca0154470 2023-08-17T17:35:13.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.503+0000 7efca6587700 1 -- 172.21.15.78:0/3620427442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca00c4350 con 0x7efca0154470 2023-08-17T17:35:13.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.504+0000 7efc87fff700 1 -- 172.21.15.78:0/3620427442 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efc980137b0 con 0x7efca0154470 2023-08-17T17:35:13.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.504+0000 7efc87fff700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efc8c05ed90 0x7efc8c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.504+0000 7efc87fff700 1 -- 172.21.15.78:0/3620427442 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efc9807a660 con 0x7efca0154470 2023-08-17T17:35:13.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.504+0000 7efc9ffff700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efc8c05ed90 0x7efc8c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.504+0000 7efc9ffff700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efc8c05ed90 0x7efc8c061250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7efca00c56a0 tx=0x7efc90016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:13.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.508+0000 7efc87fff700 1 -- 172.21.15.78:0/3620427442 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc9804bc00 con 0x7efca0154470 2023-08-17T17:35:13.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.712+0000 7efca6587700 1 -- 172.21.15.78:0/3620427442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efca0047350 con 0x7efca0154470 2023-08-17T17:35:13.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.713+0000 7efc87fff700 1 -- 172.21.15.78:0/3620427442 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4483 (secure 0 0 0) 0x7efc9804f220 con 0x7efca0154470 2023-08-17T17:35:13.714 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:35:13.714 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/175439344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":175439344},{"type":"v1","addr":"172.21.15.150:6834","nonce":175439344}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/893012651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":893012651},{"type":"v1","addr":"172.21.15.150:6835","nonce":893012651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4944,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/734042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":734042508},{"type":"v1","addr":"172.21.15.78:6836","nonce":734042508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:35:10.721386+0000","modified":"2023-08-17T17:35:13.361851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/3186726071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3186726071},{"type":"v1","addr":"172.21.15.78:6837","nonce":3186726071}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T17:35:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 -- 172.21.15.78:0/3620427442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efc8c05ed90 msgr2=0x7efc8c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efc8c05ed90 0x7efc8c061250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7efca00c56a0 tx=0x7efc90016000).stop 2023-08-17T17:35:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 -- 172.21.15.78:0/3620427442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca0154470 msgr2=0x7efca00c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca0154470 0x7efca00c4670 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7efc98009fc0 tx=0x7efc9800b040).stop 2023-08-17T17:35:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 -- 172.21.15.78:0/3620427442 shutdown_connections 2023-08-17T17:35:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efc8c05ed90 0x7efc8c061250 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca0154470 0x7efca00c4670 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca00a9f60 0x7efca0150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 --2- 172.21.15.78:0/3620427442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca0154090 0x7efca0144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 -- 172.21.15.78:0/3620427442 >> 172.21.15.78:0/3620427442 conn(0x7efca0094670 msgr2=0x7efca00caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:13.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 -- 172.21.15.78:0/3620427442 shutdown_connections 2023-08-17T17:35:13.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.715+0000 7efca6587700 1 -- 172.21.15.78:0/3620427442 wait complete. 2023-08-17T17:35:13.717 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 13 2023-08-17T17:35:13.727 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:35:13.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.839+0000 7f3fe2557700 1 Processor -- start 2023-08-17T17:35:13.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.839+0000 7f3fe2557700 1 -- start start 2023-08-17T17:35:13.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe2557700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fdc0c01b0 0x7f3fdc0c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe2557700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3fdc0a7bd0 0x7f3fdc063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe2557700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fdc063960 con 0x7f3fdc0a8050 2023-08-17T17:35:13.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe2557700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fdc0649f0 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe2557700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fdc063030 con 0x7f3fdc0c01b0 2023-08-17T17:35:13.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe0d54700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3fdc0a7bd0 0x7f3fdc063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe0d54700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3fdc0a7bd0 0x7f3fdc063df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53494/0 (socket says 172.21.15.78:53494) 2023-08-17T17:35:13.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe0d54700 1 -- 172.21.15.78:0/2123620464 learned_addr learned my addr 172.21.15.78:0/2123620464 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:13.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe1555700 1 --2- 172.21.15.78:0/2123620464 >> v2:172.21.15.150:3300/0 conn(0x7f3fdc0c01b0 0x7f3fdc0c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe0d54700 1 -- 172.21.15.78:0/2123620464 >> v2:172.21.15.150:3300/0 conn(0x7f3fdc0c01b0 msgr2=0x7f3fdc0c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:13.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe0d54700 1 --2- 172.21.15.78:0/2123620464 >> v2:172.21.15.150:3300/0 conn(0x7f3fdc0c01b0 0x7f3fdc0c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe0d54700 1 -- 172.21.15.78:0/2123620464 >> v1:172.21.15.150:6789/0 conn(0x7f3fdc0a8050 legacy=0x7f3fdc0642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:13.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe0d54700 1 -- 172.21.15.78:0/2123620464 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc063310 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe1555700 1 --2- 172.21.15.78:0/2123620464 >> v2:172.21.15.150:3300/0 conn(0x7f3fdc0c01b0 0x7f3fdc0c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:13.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.840+0000 7f3fe0d54700 1 --2- 172.21.15.78:0/2123620464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 0x7f3fdc063df0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f3fdc05e020 tx=0x7f3fd0009840).ready entity=mon.0 client_cookie=ccf1c0bb73850b69 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:13.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fdbfff700 1 -- 172.21.15.78:0/2123620464 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000e070 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fdbfff700 1 -- 172.21.15.78:0/2123620464 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000ba10 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fdbfff700 1 -- 172.21.15.78:0/2123620464 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000bd90 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fe2557700 1 -- 172.21.15.78:0/2123620464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 msgr2=0x7f3fdc063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fe2557700 1 --2- 172.21.15.78:0/2123620464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 0x7f3fdc063df0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f3fdc05e020 tx=0x7f3fd0009840).stop 2023-08-17T17:35:13.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fe2557700 1 -- 172.21.15.78:0/2123620464 shutdown_connections 2023-08-17T17:35:13.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fe2557700 1 --2- 172.21.15.78:0/2123620464 >> v2:172.21.15.150:3300/0 conn(0x7f3fdc0c01b0 0x7f3fdc0c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fe2557700 1 --2- 172.21.15.78:0/2123620464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 0x7f3fdc063df0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fe2557700 1 -- 172.21.15.78:0/2123620464 >> 172.21.15.78:0/2123620464 conn(0x7f3fdc06a6c0 msgr2=0x7f3fdc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:13.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fe2557700 1 -- 172.21.15.78:0/2123620464 shutdown_connections 2023-08-17T17:35:13.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.841+0000 7f3fe2557700 1 -- 172.21.15.78:0/2123620464 wait complete. 2023-08-17T17:35:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.842+0000 7f3fe2557700 1 Processor -- start 2023-08-17T17:35:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.842+0000 7f3fe2557700 1 -- start start 2023-08-17T17:35:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe2557700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 0x7f3fdc0c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe2557700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fdc0a8050 0x7f3fdc167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe2557700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fdc0c01b0 0x7f3fdc167f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe2557700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc1643f0 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe2557700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc1683f0 con 0x7f3fdc0a8050 2023-08-17T17:35:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe2557700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0b0360 con 0x7f3fdc0c01b0 2023-08-17T17:35:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe1555700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 0x7f3fdc0c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe1555700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 0x7f3fdc0c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53508/0 (socket says 172.21.15.78:53508) 2023-08-17T17:35:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe1555700 1 -- 172.21.15.78:0/2978675853 learned_addr learned my addr 172.21.15.78:0/2978675853 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe0d54700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fdc0a8050 0x7f3fdc167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.843+0000 7f3fe1d56700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fdc0c01b0 0x7f3fdc167f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fe1555700 1 -- 172.21.15.78:0/2978675853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fdc0c01b0 msgr2=0x7f3fdc167f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fe1555700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fdc0c01b0 0x7f3fdc167f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fe1555700 1 -- 172.21.15.78:0/2978675853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fdc0a8050 msgr2=0x7f3fdc167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fe1555700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fdc0a8050 0x7f3fdc167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fe1555700 1 -- 172.21.15.78:0/2978675853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0009ae0 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fe1d56700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fdc0c01b0 0x7f3fdc167f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fe1555700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 0x7f3fdc0c49b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f3fd400c880 tx=0x7f3fd4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2978675853 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4010580 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2978675853 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd40106e0 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fe2557700 1 -- 172.21.15.78:0/2978675853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fdc1688d0 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2978675853 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4010a60 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.844+0000 7f3fe2557700 1 -- 172.21.15.78:0/2978675853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc1685f0 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.845+0000 7f3fe2557700 1 -- 172.21.15.78:0/2978675853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fdc164f10 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.845+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2978675853 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3fd401b460 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.846+0000 7f3fd97fa700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 0x7f3fc8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:13.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.846+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2978675853 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3fd4079ba0 con 0x7f3fdc0a7bd0 2023-08-17T17:35:13.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.846+0000 7f3fe0d54700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 0x7f3fc8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:13.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.846+0000 7f3fe0d54700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 0x7f3fc8061250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3fd000b9e0 tx=0x7f3fd0009840).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:13.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:13.850+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2978675853 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fd404b0e0 con 0x7f3fdc0a7bd0 2023-08-17T17:35:14.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.011+0000 7f3fe2557700 1 -- 172.21.15.78:0/2978675853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fdc164d10 con 0x7f3fdc0a7bd0 2023-08-17T17:35:14.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.012+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2978675853 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f3fd404e700 con 0x7f3fdc0a7bd0 2023-08-17T17:35:14.013 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:35:14.013 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":34,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:35:11.723240+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:35:08.663808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T17:35:09.691655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:35:14.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.014+0000 7f3fe2557700 1 -- 172.21.15.78:0/2978675853 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 msgr2=0x7f3fc8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.014+0000 7f3fe2557700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 0x7f3fc8061250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3fd000b9e0 tx=0x7f3fd0009840).stop 2023-08-17T17:35:14.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.014+0000 7f3fe2557700 1 -- 172.21.15.78:0/2978675853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 msgr2=0x7f3fdc0c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.014+0000 7f3fe2557700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 0x7f3fdc0c49b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f3fd400c880 tx=0x7f3fd4008040).stop 2023-08-17T17:35:14.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.014+0000 7f3fe2557700 1 -- 172.21.15.78:0/2978675853 shutdown_connections 2023-08-17T17:35:14.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.014+0000 7f3fe2557700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 0x7f3fc8061250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.015+0000 7f3fe2557700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fdc0c01b0 0x7f3fdc167f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.015+0000 7f3fe2557700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fdc0a7bd0 0x7f3fdc0c49b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.015+0000 7f3fe2557700 1 --2- 172.21.15.78:0/2978675853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fdc0a8050 0x7f3fdc167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.015+0000 7f3fe2557700 1 -- 172.21.15.78:0/2978675853 >> 172.21.15.78:0/2978675853 conn(0x7f3fdc06a6c0 msgr2=0x7f3fdc0c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:14.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.015+0000 7f3fe2557700 1 -- 172.21.15.78:0/2978675853 shutdown_connections 2023-08-17T17:35:14.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.015+0000 7f3fe2557700 1 -- 172.21.15.78:0/2978675853 wait complete. 2023-08-17T17:35:14.027 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T17:35:14.027 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:35:14.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.139+0000 7fc7a5104700 1 Processor -- start 2023-08-17T17:35:14.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.139+0000 7fc7a5104700 1 -- start start 2023-08-17T17:35:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.140+0000 7fc7a5104700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a01553c0 0x7fc7a0069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.140+0000 7fc7a5104700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc7a00c1f10 0x7fc7a0067f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.140+0000 7fc7a5104700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a00a65a0 con 0x7fc7a0068430 2023-08-17T17:35:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.140+0000 7fc7a5104700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a0069480 con 0x7fc7a00c1f10 2023-08-17T17:35:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.140+0000 7fc7a5104700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00c2d20 con 0x7fc7a01553c0 2023-08-17T17:35:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79f59e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc7a0068430 0x7fc7a00644d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55338/0 (socket says 172.21.15.78:55338) 2023-08-17T17:35:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79f59e700 1 -- 172.21.15.78:0/4187693657 learned_addr learned my addr 172.21.15.78:0/4187693657 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79ed9d700 1 --2- 172.21.15.78:0/4187693657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a01553c0 0x7fc7a0069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79659c700 1 --2- 172.21.15.78:0/4187693657 >> v2:172.21.15.150:3300/0 conn(0x7fc7a00c1f10 0x7fc7a0067f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79e59c700 1 -- 172.21.15.78:0/4187693657 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645141161 0 0) 0x7fc7a00a65a0 con 0x7fc7a0068430 2023-08-17T17:35:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79e59c700 1 -- 172.21.15.78:0/4187693657 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc78c0033f0 con 0x7fc7a0068430 2023-08-17T17:35:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79ed9d700 1 -- 172.21.15.78:0/4187693657 >> v2:172.21.15.150:3300/0 conn(0x7fc7a00c1f10 msgr2=0x7fc7a0067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79ed9d700 1 --2- 172.21.15.78:0/4187693657 >> v2:172.21.15.150:3300/0 conn(0x7fc7a00c1f10 0x7fc7a0067f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79ed9d700 1 -- 172.21.15.78:0/4187693657 >> v1:172.21.15.78:6789/0 conn(0x7fc7a0068430 legacy=0x7fc7a00644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79ed9d700 1 -- 172.21.15.78:0/4187693657 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a0064040 con 0x7fc7a01553c0 2023-08-17T17:35:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79ed9d700 1 --2- 172.21.15.78:0/4187693657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a01553c0 0x7fc7a0069f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc790009760 tx=0x7fc790009060).ready entity=mon.2 client_cookie=3b4479642bea44a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79e59c700 1 -- 172.21.15.78:0/4187693657 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79000d4a0 con 0x7fc7a01553c0 2023-08-17T17:35:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79e59c700 1 -- 172.21.15.78:0/4187693657 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79000d600 con 0x7fc7a01553c0 2023-08-17T17:35:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.141+0000 7fc79e59c700 1 -- 172.21.15.78:0/4187693657 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79000d980 con 0x7fc7a01553c0 2023-08-17T17:35:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.142+0000 7fc7a5104700 1 -- 172.21.15.78:0/4187693657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a01553c0 msgr2=0x7fc7a0069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.142+0000 7fc7a5104700 1 --2- 172.21.15.78:0/4187693657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a01553c0 0x7fc7a0069f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc790009760 tx=0x7fc790009060).stop 2023-08-17T17:35:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.142+0000 7fc7a5104700 1 -- 172.21.15.78:0/4187693657 shutdown_connections 2023-08-17T17:35:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.142+0000 7fc7a5104700 1 --2- 172.21.15.78:0/4187693657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a01553c0 0x7fc7a0069f30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.142+0000 7fc7a5104700 1 --2- 172.21.15.78:0/4187693657 >> v2:172.21.15.150:3300/0 conn(0x7fc7a00c1f10 0x7fc7a0067f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.142+0000 7fc7a5104700 1 -- 172.21.15.78:0/4187693657 >> 172.21.15.78:0/4187693657 conn(0x7fc7a0062fc0 msgr2=0x7fc7a00c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.142+0000 7fc7a5104700 1 -- 172.21.15.78:0/4187693657 shutdown_connections 2023-08-17T17:35:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.142+0000 7fc7a5104700 1 -- 172.21.15.78:0/4187693657 wait complete. 2023-08-17T17:35:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.143+0000 7fc7a5104700 1 Processor -- start 2023-08-17T17:35:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.143+0000 7fc7a5104700 1 -- start start 2023-08-17T17:35:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc7a5104700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a0068430 0x7fc7a0164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc7a5104700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7a00c1f10 0x7fc7a01566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc7a5104700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7a01553c0 0x7fc7a0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc7a5104700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00a0b70 con 0x7fc7a01553c0 2023-08-17T17:35:14.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc7a5104700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00a1680 con 0x7fc7a00c1f10 2023-08-17T17:35:14.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc7a5104700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00a0d50 con 0x7fc7a0068430 2023-08-17T17:35:14.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7a01553c0 0x7fc7a0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7a01553c0 0x7fc7a0156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53522/0 (socket says 172.21.15.78:53522) 2023-08-17T17:35:14.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79f59e700 1 -- 172.21.15.78:0/2996875156 learned_addr learned my addr 172.21.15.78:0/2996875156 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:14.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79659c700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7a00c1f10 0x7fc7a01566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79ed9d700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a0068430 0x7fc7a0164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79f59e700 1 -- 172.21.15.78:0/2996875156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a0068430 msgr2=0x7fc7a0164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79f59e700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a0068430 0x7fc7a0164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79f59e700 1 -- 172.21.15.78:0/2996875156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7a00c1f10 msgr2=0x7fc7a01566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79f59e700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7a00c1f10 0x7fc7a01566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79f59e700 1 -- 172.21.15.78:0/2996875156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7900092a0 con 0x7fc7a01553c0 2023-08-17T17:35:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc79f59e700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7a01553c0 0x7fc7a0156bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fc798001460 tx=0x7fc798001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc7977fe700 1 -- 172.21.15.78:0/2996875156 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc798005d30 con 0x7fc7a01553c0 2023-08-17T17:35:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc7977fe700 1 -- 172.21.15.78:0/2996875156 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc798005e90 con 0x7fc7a01553c0 2023-08-17T17:35:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc7a5104700 1 -- 172.21.15.78:0/2996875156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a00a1030 con 0x7fc7a01553c0 2023-08-17T17:35:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.144+0000 7fc7977fe700 1 -- 172.21.15.78:0/2996875156 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc798007320 con 0x7fc7a01553c0 2023-08-17T17:35:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.145+0000 7fc7a5104700 1 -- 172.21.15.78:0/2996875156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a01559d0 con 0x7fc7a01553c0 2023-08-17T17:35:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.145+0000 7fc7a5104700 1 -- 172.21.15.78:0/2996875156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a00a1810 con 0x7fc7a01553c0 2023-08-17T17:35:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.146+0000 7fc7977fe700 1 -- 172.21.15.78:0/2996875156 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc798010030 con 0x7fc7a01553c0 2023-08-17T17:35:14.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.146+0000 7fc7977fe700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc78005ed90 0x7fc780061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.146+0000 7fc7977fe700 1 -- 172.21.15.78:0/2996875156 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc798079a60 con 0x7fc7a01553c0 2023-08-17T17:35:14.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.146+0000 7fc79ed9d700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc78005ed90 0x7fc780061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.147+0000 7fc79ed9d700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc78005ed90 0x7fc780061250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fc7a01575b0 tx=0x7fc790016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:14.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.150+0000 7fc7977fe700 1 -- 172.21.15.78:0/2996875156 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc79804afa0 con 0x7fc7a01553c0 2023-08-17T17:35:14.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.308+0000 7fc7a5104700 1 -- 172.21.15.78:0/2996875156 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7a0047350 con 0x7fc78005ed90 2023-08-17T17:35:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.317+0000 7fc7977fe700 1 -- 172.21.15.78:0/2996875156 <== mgr.4104 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336424 (secure 0 0 0) 0x7fc7a0047350 con 0x7fc78005ed90 2023-08-17T17:35:14.320 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:35:14.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 -- 172.21.15.78:0/2996875156 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc78005ed90 msgr2=0x7fc780061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc78005ed90 0x7fc780061250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fc7a01575b0 tx=0x7fc790016000).stop 2023-08-17T17:35:14.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 -- 172.21.15.78:0/2996875156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7a01553c0 msgr2=0x7fc7a0156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7a01553c0 0x7fc7a0156bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fc798001460 tx=0x7fc798001650).stop 2023-08-17T17:35:14.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 -- 172.21.15.78:0/2996875156 shutdown_connections 2023-08-17T17:35:14.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc78005ed90 0x7fc780061250 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7a01553c0 0x7fc7a0156bb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a0068430 0x7fc7a0164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 --2- 172.21.15.78:0/2996875156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7a00c1f10 0x7fc7a01566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 -- 172.21.15.78:0/2996875156 >> 172.21.15.78:0/2996875156 conn(0x7fc7a0062fc0 msgr2=0x7fc7a0065250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:14.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.320+0000 7fc7a5104700 1 -- 172.21.15.78:0/2996875156 shutdown_connections 2023-08-17T17:35:14.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.321+0000 7fc7a5104700 1 -- 172.21.15.78:0/2996875156 wait complete. 2023-08-17T17:35:14.324 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:35:14.333 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-08-17T17:35:13.018847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379624,"kb_used_data":2856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595096,"statfs":{"total":773094113280,"available":770657378304,"internally_reserved":0,"allocated":2924544,"data_stored":1169531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.598697"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.744713+0000","last_change":"2023-08-17T17:35:10.744713+0000","last_active":"2023-08-17T17:35:10.744713+0000","last_peered":"2023-08-17T17:35:10.744713+0000","last_clean":"2023-08-17T17:35:10.744713+0000","last_became_active":"2023-08-17T17:35:10.744458+0000","last_became_peered":"2023-08-17T17:35:10.744458+0000","last_unstale":"2023-08-17T17:35:10.744713+0000","last_undegraded":"2023-08-17T17:35:10.744713+0000","last_fullsized":"2023-08-17T17:35:10.744713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.752297+0000","last_change":"2023-08-17T17:35:10.379264+0000","last_active":"2023-08-17T17:35:10.752297+0000","last_peered":"2023-08-17T17:35:10.752297+0000","last_clean":"2023-08-17T17:35:10.752297+0000","last_became_active":"2023-08-17T17:35:10.378966+0000","last_became_peered":"2023-08-17T17:35:10.378966+0000","last_unstale":"2023-08-17T17:35:10.752297+0000","last_undegraded":"2023-08-17T17:35:10.752297+0000","last_fullsized":"2023-08-17T17:35:10.752297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.739049+0000","last_change":"2023-08-17T17:35:10.739049+0000","last_active":"2023-08-17T17:35:10.739049+0000","last_peered":"2023-08-17T17:35:10.739049+0000","last_clean":"2023-08-17T17:35:10.739049+0000","last_became_active":"2023-08-17T17:35:10.738788+0000","last_became_peered":"2023-08-17T17:35:10.738788+0000","last_unstale":"2023-08-17T17:35:10.739049+0000","last_undegraded":"2023-08-17T17:35:10.739049+0000","last_fullsized":"2023-08-17T17:35:10.739049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.384341+0000","last_change":"2023-08-17T17:35:10.382409+0000","last_active":"2023-08-17T17:35:10.384341+0000","last_peered":"2023-08-17T17:35:10.384341+0000","last_clean":"2023-08-17T17:35:10.384341+0000","last_became_active":"2023-08-17T17:35:10.378886+0000","last_became_peered":"2023-08-17T17:35:10.378886+0000","last_unstale":"2023-08-17T17:35:10.384341+0000","last_undegraded":"2023-08-17T17:35:10.384341+0000","last_fullsized":"2023-08-17T17:35:10.384341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.738388+0000","last_change":"2023-08-17T17:35:10.738388+0000","last_active":"2023-08-17T17:35:10.738388+0000","last_peered":"2023-08-17T17:35:10.738388+0000","last_clean":"2023-08-17T17:35:10.738388+0000","last_became_active":"2023-08-17T17:35:10.738094+0000","last_became_peered":"2023-08-17T17:35:10.738094+0000","last_unstale":"2023-08-17T17:35:10.738388+0000","last_undegraded":"2023-08-17T17:35:10.738388+0000","last_fullsized":"2023-08-17T17:35:10.738388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383630+0000","last_change":"2023-08-17T17:35:10.375780+0000","last_active":"2023-08-17T17:35:10.383630+0000","last_peered":"2023-08-17T17:35:10.383630+0000","last_clean":"2023-08-17T17:35:10.383630+0000","last_became_active":"2023-08-17T17:35:10.375317+0000","last_became_peered":"2023-08-17T17:35:10.375317+0000","last_unstale":"2023-08-17T17:35:10.383630+0000","last_undegraded":"2023-08-17T17:35:10.383630+0000","last_fullsized":"2023-08-17T17:35:10.383630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737643+0000","last_change":"2023-08-17T17:35:10.737643+0000","last_active":"2023-08-17T17:35:10.737643+0000","last_peered":"2023-08-17T17:35:10.737643+0000","last_clean":"2023-08-17T17:35:10.737643+0000","last_became_active":"2023-08-17T17:35:10.737365+0000","last_became_peered":"2023-08-17T17:35:10.737365+0000","last_unstale":"2023-08-17T17:35:10.737643+0000","last_undegraded":"2023-08-17T17:35:10.737643+0000","last_fullsized":"2023-08-17T17:35:10.737643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.746783+0000","last_change":"2023-08-17T17:35:10.372071+0000","last_active":"2023-08-17T17:35:10.746783+0000","last_peered":"2023-08-17T17:35:10.746783+0000","last_clean":"2023-08-17T17:35:10.746783+0000","last_became_active":"2023-08-17T17:35:10.371779+0000","last_became_peered":"2023-08-17T17:35:10.371779+0000","last_unstale":"2023-08-17T17:35:10.746783+0000","last_undegraded":"2023-08-17T17:35:10.746783+0000","last_fullsized":"2023-08-17T17:35:10.746783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.739979+0000","last_change":"2023-08-17T17:35:10.739979+0000","last_active":"2023-08-17T17:35:10.739979+0000","last_peered":"2023-08-17T17:35:10.739979+0000","last_clean":"2023-08-17T17:35:10.739979+0000","last_became_active":"2023-08-17T17:35:10.739711+0000","last_became_peered":"2023-08-17T17:35:10.739711+0000","last_unstale":"2023-08-17T17:35:10.739979+0000","last_undegraded":"2023-08-17T17:35:10.739979+0000","last_fullsized":"2023-08-17T17:35:10.739979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.731100+0000","last_change":"2023-08-17T17:35:10.380313+0000","last_active":"2023-08-17T17:35:10.731100+0000","last_peered":"2023-08-17T17:35:10.731100+0000","last_clean":"2023-08-17T17:35:10.731100+0000","last_became_active":"2023-08-17T17:35:10.379947+0000","last_became_peered":"2023-08-17T17:35:10.379947+0000","last_unstale":"2023-08-17T17:35:10.731100+0000","last_undegraded":"2023-08-17T17:35:10.731100+0000","last_fullsized":"2023-08-17T17:35:10.731100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747853+0000","last_change":"2023-08-17T17:35:10.747853+0000","last_active":"2023-08-17T17:35:10.747853+0000","last_peered":"2023-08-17T17:35:10.747853+0000","last_clean":"2023-08-17T17:35:10.747853+0000","last_became_active":"2023-08-17T17:35:10.744648+0000","last_became_peered":"2023-08-17T17:35:10.744648+0000","last_unstale":"2023-08-17T17:35:10.747853+0000","last_undegraded":"2023-08-17T17:35:10.747853+0000","last_fullsized":"2023-08-17T17:35:10.747853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.725838+0000","last_change":"2023-08-17T17:35:10.376635+0000","last_active":"2023-08-17T17:35:10.725838+0000","last_peered":"2023-08-17T17:35:10.725838+0000","last_clean":"2023-08-17T17:35:10.725838+0000","last_became_active":"2023-08-17T17:35:10.376362+0000","last_became_peered":"2023-08-17T17:35:10.376362+0000","last_unstale":"2023-08-17T17:35:10.725838+0000","last_undegraded":"2023-08-17T17:35:10.725838+0000","last_fullsized":"2023-08-17T17:35:10.725838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737720+0000","last_change":"2023-08-17T17:35:10.737720+0000","last_active":"2023-08-17T17:35:10.737720+0000","last_peered":"2023-08-17T17:35:10.737720+0000","last_clean":"2023-08-17T17:35:10.737720+0000","last_became_active":"2023-08-17T17:35:10.737307+0000","last_became_peered":"2023-08-17T17:35:10.737307+0000","last_unstale":"2023-08-17T17:35:10.737720+0000","last_undegraded":"2023-08-17T17:35:10.737720+0000","last_fullsized":"2023-08-17T17:35:10.737720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.389192+0000","last_change":"2023-08-17T17:35:10.384453+0000","last_active":"2023-08-17T17:35:10.389192+0000","last_peered":"2023-08-17T17:35:10.389192+0000","last_clean":"2023-08-17T17:35:10.389192+0000","last_became_active":"2023-08-17T17:35:10.384236+0000","last_became_peered":"2023-08-17T17:35:10.384236+0000","last_unstale":"2023-08-17T17:35:10.389192+0000","last_undegraded":"2023-08-17T17:35:10.389192+0000","last_fullsized":"2023-08-17T17:35:10.389192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.734965+0000","last_change":"2023-08-17T17:35:10.734965+0000","last_active":"2023-08-17T17:35:10.734965+0000","last_peered":"2023-08-17T17:35:10.734965+0000","last_clean":"2023-08-17T17:35:10.734965+0000","last_became_active":"2023-08-17T17:35:10.734707+0000","last_became_peered":"2023-08-17T17:35:10.734707+0000","last_unstale":"2023-08-17T17:35:10.734965+0000","last_undegraded":"2023-08-17T17:35:10.734965+0000","last_fullsized":"2023-08-17T17:35:10.734965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.386450+0000","last_change":"2023-08-17T17:35:10.380822+0000","last_active":"2023-08-17T17:35:10.386450+0000","last_peered":"2023-08-17T17:35:10.386450+0000","last_clean":"2023-08-17T17:35:10.386450+0000","last_became_active":"2023-08-17T17:35:10.380321+0000","last_became_peered":"2023-08-17T17:35:10.380321+0000","last_unstale":"2023-08-17T17:35:10.386450+0000","last_undegraded":"2023-08-17T17:35:10.386450+0000","last_fullsized":"2023-08-17T17:35:10.386450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743650+0000","last_change":"2023-08-17T17:35:10.743650+0000","last_active":"2023-08-17T17:35:10.743650+0000","last_peered":"2023-08-17T17:35:10.743650+0000","last_clean":"2023-08-17T17:35:10.743650+0000","last_became_active":"2023-08-17T17:35:10.743160+0000","last_became_peered":"2023-08-17T17:35:10.743160+0000","last_unstale":"2023-08-17T17:35:10.743650+0000","last_undegraded":"2023-08-17T17:35:10.743650+0000","last_fullsized":"2023-08-17T17:35:10.743650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383776+0000","last_change":"2023-08-17T17:35:10.375599+0000","last_active":"2023-08-17T17:35:10.383776+0000","last_peered":"2023-08-17T17:35:10.383776+0000","last_clean":"2023-08-17T17:35:10.383776+0000","last_became_active":"2023-08-17T17:35:10.375304+0000","last_became_peered":"2023-08-17T17:35:10.375304+0000","last_unstale":"2023-08-17T17:35:10.383776+0000","last_undegraded":"2023-08-17T17:35:10.383776+0000","last_fullsized":"2023-08-17T17:35:10.383776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737049+0000","last_change":"2023-08-17T17:35:10.737049+0000","last_active":"2023-08-17T17:35:10.737049+0000","last_peered":"2023-08-17T17:35:10.737049+0000","last_clean":"2023-08-17T17:35:10.737049+0000","last_became_active":"2023-08-17T17:35:10.736744+0000","last_became_peered":"2023-08-17T17:35:10.736744+0000","last_unstale":"2023-08-17T17:35:10.737049+0000","last_undegraded":"2023-08-17T17:35:10.737049+0000","last_fullsized":"2023-08-17T17:35:10.737049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.385355+0000","last_change":"2023-08-17T17:35:10.384082+0000","last_active":"2023-08-17T17:35:10.385355+0000","last_peered":"2023-08-17T17:35:10.385355+0000","last_clean":"2023-08-17T17:35:10.385355+0000","last_became_active":"2023-08-17T17:35:10.383615+0000","last_became_peered":"2023-08-17T17:35:10.383615+0000","last_unstale":"2023-08-17T17:35:10.385355+0000","last_undegraded":"2023-08-17T17:35:10.385355+0000","last_fullsized":"2023-08-17T17:35:10.385355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745702+0000","last_change":"2023-08-17T17:35:10.745702+0000","last_active":"2023-08-17T17:35:10.745702+0000","last_peered":"2023-08-17T17:35:10.745702+0000","last_clean":"2023-08-17T17:35:10.745702+0000","last_became_active":"2023-08-17T17:35:10.745418+0000","last_became_peered":"2023-08-17T17:35:10.745418+0000","last_unstale":"2023-08-17T17:35:10.745702+0000","last_undegraded":"2023-08-17T17:35:10.745702+0000","last_fullsized":"2023-08-17T17:35:10.745702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.378763+0000","last_change":"2023-08-17T17:35:10.377373+0000","last_active":"2023-08-17T17:35:10.378763+0000","last_peered":"2023-08-17T17:35:10.378763+0000","last_clean":"2023-08-17T17:35:10.378763+0000","last_became_active":"2023-08-17T17:35:10.377071+0000","last_became_peered":"2023-08-17T17:35:10.377071+0000","last_unstale":"2023-08-17T17:35:10.378763+0000","last_undegraded":"2023-08-17T17:35:10.378763+0000","last_fullsized":"2023-08-17T17:35:10.378763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.738284+0000","last_change":"2023-08-17T17:35:10.738284+0000","last_active":"2023-08-17T17:35:10.738284+0000","last_peered":"2023-08-17T17:35:10.738284+0000","last_clean":"2023-08-17T17:35:10.738284+0000","last_became_active":"2023-08-17T17:35:10.737914+0000","last_became_peered":"2023-08-17T17:35:10.737914+0000","last_unstale":"2023-08-17T17:35:10.738284+0000","last_undegraded":"2023-08-17T17:35:10.738284+0000","last_fullsized":"2023-08-17T17:35:10.738284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.751874+0000","last_change":"2023-08-17T17:35:10.380152+0000","last_active":"2023-08-17T17:35:10.751874+0000","last_peered":"2023-08-17T17:35:10.751874+0000","last_clean":"2023-08-17T17:35:10.751874+0000","last_became_active":"2023-08-17T17:35:10.379831+0000","last_became_peered":"2023-08-17T17:35:10.379831+0000","last_unstale":"2023-08-17T17:35:10.751874+0000","last_undegraded":"2023-08-17T17:35:10.751874+0000","last_fullsized":"2023-08-17T17:35:10.751874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749280+0000","last_change":"2023-08-17T17:35:10.749280+0000","last_active":"2023-08-17T17:35:10.749280+0000","last_peered":"2023-08-17T17:35:10.749280+0000","last_clean":"2023-08-17T17:35:10.749280+0000","last_became_active":"2023-08-17T17:35:10.748989+0000","last_became_peered":"2023-08-17T17:35:10.748989+0000","last_unstale":"2023-08-17T17:35:10.749280+0000","last_undegraded":"2023-08-17T17:35:10.749280+0000","last_fullsized":"2023-08-17T17:35:10.749280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.731215+0000","last_change":"2023-08-17T17:35:10.380231+0000","last_active":"2023-08-17T17:35:10.731215+0000","last_peered":"2023-08-17T17:35:10.731215+0000","last_clean":"2023-08-17T17:35:10.731215+0000","last_became_active":"2023-08-17T17:35:10.379640+0000","last_became_peered":"2023-08-17T17:35:10.379640+0000","last_unstale":"2023-08-17T17:35:10.731215+0000","last_undegraded":"2023-08-17T17:35:10.731215+0000","last_fullsized":"2023-08-17T17:35:10.731215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.741506+0000","last_change":"2023-08-17T17:35:10.741506+0000","last_active":"2023-08-17T17:35:10.741506+0000","last_peered":"2023-08-17T17:35:10.741506+0000","last_clean":"2023-08-17T17:35:10.741506+0000","last_became_active":"2023-08-17T17:35:10.741196+0000","last_became_peered":"2023-08-17T17:35:10.741196+0000","last_unstale":"2023-08-17T17:35:10.741506+0000","last_undegraded":"2023-08-17T17:35:10.741506+0000","last_fullsized":"2023-08-17T17:35:10.741506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.379182+0000","last_change":"2023-08-17T17:35:10.372914+0000","last_active":"2023-08-17T17:35:10.379182+0000","last_peered":"2023-08-17T17:35:10.379182+0000","last_clean":"2023-08-17T17:35:10.379182+0000","last_became_active":"2023-08-17T17:35:10.372662+0000","last_became_peered":"2023-08-17T17:35:10.372662+0000","last_unstale":"2023-08-17T17:35:10.379182+0000","last_undegraded":"2023-08-17T17:35:10.379182+0000","last_fullsized":"2023-08-17T17:35:10.379182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743686+0000","last_change":"2023-08-17T17:35:10.743686+0000","last_active":"2023-08-17T17:35:10.743686+0000","last_peered":"2023-08-17T17:35:10.743686+0000","last_clean":"2023-08-17T17:35:10.743686+0000","last_became_active":"2023-08-17T17:35:10.743405+0000","last_became_peered":"2023-08-17T17:35:10.743405+0000","last_unstale":"2023-08-17T17:35:10.743686+0000","last_undegraded":"2023-08-17T17:35:10.743686+0000","last_fullsized":"2023-08-17T17:35:10.743686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383619+0000","last_change":"2023-08-17T17:35:10.376359+0000","last_active":"2023-08-17T17:35:10.383619+0000","last_peered":"2023-08-17T17:35:10.383619+0000","last_clean":"2023-08-17T17:35:10.383619+0000","last_became_active":"2023-08-17T17:35:10.376074+0000","last_became_peered":"2023-08-17T17:35:10.376074+0000","last_unstale":"2023-08-17T17:35:10.383619+0000","last_undegraded":"2023-08-17T17:35:10.383619+0000","last_fullsized":"2023-08-17T17:35:10.383619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745765+0000","last_change":"2023-08-17T17:35:10.745765+0000","last_active":"2023-08-17T17:35:10.745765+0000","last_peered":"2023-08-17T17:35:10.745765+0000","last_clean":"2023-08-17T17:35:10.745765+0000","last_became_active":"2023-08-17T17:35:10.745465+0000","last_became_peered":"2023-08-17T17:35:10.745465+0000","last_unstale":"2023-08-17T17:35:10.745765+0000","last_undegraded":"2023-08-17T17:35:10.745765+0000","last_fullsized":"2023-08-17T17:35:10.745765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.751965+0000","last_change":"2023-08-17T17:35:10.380829+0000","last_active":"2023-08-17T17:35:10.751965+0000","last_peered":"2023-08-17T17:35:10.751965+0000","last_clean":"2023-08-17T17:35:10.751965+0000","last_became_active":"2023-08-17T17:35:10.380593+0000","last_became_peered":"2023-08-17T17:35:10.380593+0000","last_unstale":"2023-08-17T17:35:10.751965+0000","last_undegraded":"2023-08-17T17:35:10.751965+0000","last_fullsized":"2023-08-17T17:35:10.751965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743335+0000","last_change":"2023-08-17T17:35:10.743335+0000","last_active":"2023-08-17T17:35:10.743335+0000","last_peered":"2023-08-17T17:35:10.743335+0000","last_clean":"2023-08-17T17:35:10.743335+0000","last_became_active":"2023-08-17T17:35:10.743028+0000","last_became_peered":"2023-08-17T17:35:10.743028+0000","last_unstale":"2023-08-17T17:35:10.743335+0000","last_undegraded":"2023-08-17T17:35:10.743335+0000","last_fullsized":"2023-08-17T17:35:10.743335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.389216+0000","last_change":"2023-08-17T17:35:10.385061+0000","last_active":"2023-08-17T17:35:10.389216+0000","last_peered":"2023-08-17T17:35:10.389216+0000","last_clean":"2023-08-17T17:35:10.389216+0000","last_became_active":"2023-08-17T17:35:10.384772+0000","last_became_peered":"2023-08-17T17:35:10.384772+0000","last_unstale":"2023-08-17T17:35:10.389216+0000","last_undegraded":"2023-08-17T17:35:10.389216+0000","last_fullsized":"2023-08-17T17:35:10.389216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743287+0000","last_change":"2023-08-17T17:35:10.743287+0000","last_active":"2023-08-17T17:35:10.743287+0000","last_peered":"2023-08-17T17:35:10.743287+0000","last_clean":"2023-08-17T17:35:10.743287+0000","last_became_active":"2023-08-17T17:35:10.743032+0000","last_became_peered":"2023-08-17T17:35:10.743032+0000","last_unstale":"2023-08-17T17:35:10.743287+0000","last_undegraded":"2023-08-17T17:35:10.743287+0000","last_fullsized":"2023-08-17T17:35:10.743287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.384402+0000","last_change":"2023-08-17T17:35:10.383277+0000","last_active":"2023-08-17T17:35:10.384402+0000","last_peered":"2023-08-17T17:35:10.384402+0000","last_clean":"2023-08-17T17:35:10.384402+0000","last_became_active":"2023-08-17T17:35:10.383015+0000","last_became_peered":"2023-08-17T17:35:10.383015+0000","last_unstale":"2023-08-17T17:35:10.384402+0000","last_undegraded":"2023-08-17T17:35:10.384402+0000","last_fullsized":"2023-08-17T17:35:10.384402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.742412+0000","last_change":"2023-08-17T17:35:10.742412+0000","last_active":"2023-08-17T17:35:10.742412+0000","last_peered":"2023-08-17T17:35:10.742412+0000","last_clean":"2023-08-17T17:35:10.742412+0000","last_became_active":"2023-08-17T17:35:10.742132+0000","last_became_peered":"2023-08-17T17:35:10.742132+0000","last_unstale":"2023-08-17T17:35:10.742412+0000","last_undegraded":"2023-08-17T17:35:10.742412+0000","last_fullsized":"2023-08-17T17:35:10.742412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.726029+0000","last_change":"2023-08-17T17:35:10.379052+0000","last_active":"2023-08-17T17:35:10.726029+0000","last_peered":"2023-08-17T17:35:10.726029+0000","last_clean":"2023-08-17T17:35:10.726029+0000","last_became_active":"2023-08-17T17:35:10.378760+0000","last_became_peered":"2023-08-17T17:35:10.378760+0000","last_unstale":"2023-08-17T17:35:10.726029+0000","last_undegraded":"2023-08-17T17:35:10.726029+0000","last_fullsized":"2023-08-17T17:35:10.726029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.751290+0000","last_change":"2023-08-17T17:35:10.751290+0000","last_active":"2023-08-17T17:35:10.751290+0000","last_peered":"2023-08-17T17:35:10.751290+0000","last_clean":"2023-08-17T17:35:10.751290+0000","last_became_active":"2023-08-17T17:35:10.751014+0000","last_became_peered":"2023-08-17T17:35:10.751014+0000","last_unstale":"2023-08-17T17:35:10.751290+0000","last_undegraded":"2023-08-17T17:35:10.751290+0000","last_fullsized":"2023-08-17T17:35:10.751290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.374436+0000","last_change":"2023-08-17T17:35:10.369167+0000","last_active":"2023-08-17T17:35:10.374436+0000","last_peered":"2023-08-17T17:35:10.374436+0000","last_clean":"2023-08-17T17:35:10.374436+0000","last_became_active":"2023-08-17T17:35:10.368885+0000","last_became_peered":"2023-08-17T17:35:10.368885+0000","last_unstale":"2023-08-17T17:35:10.374436+0000","last_undegraded":"2023-08-17T17:35:10.374436+0000","last_fullsized":"2023-08-17T17:35:10.374436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.751236+0000","last_change":"2023-08-17T17:35:10.751236+0000","last_active":"2023-08-17T17:35:10.751236+0000","last_peered":"2023-08-17T17:35:10.751236+0000","last_clean":"2023-08-17T17:35:10.751236+0000","last_became_active":"2023-08-17T17:35:10.750811+0000","last_became_peered":"2023-08-17T17:35:10.750811+0000","last_unstale":"2023-08-17T17:35:10.751236+0000","last_undegraded":"2023-08-17T17:35:10.751236+0000","last_fullsized":"2023-08-17T17:35:10.751236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.728433+0000","last_change":"2023-08-17T17:35:10.367846+0000","last_active":"2023-08-17T17:35:10.728433+0000","last_peered":"2023-08-17T17:35:10.728433+0000","last_clean":"2023-08-17T17:35:10.728433+0000","last_became_active":"2023-08-17T17:35:10.367554+0000","last_became_peered":"2023-08-17T17:35:10.367554+0000","last_unstale":"2023-08-17T17:35:10.728433+0000","last_undegraded":"2023-08-17T17:35:10.728433+0000","last_fullsized":"2023-08-17T17:35:10.728433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747685+0000","last_change":"2023-08-17T17:35:10.747685+0000","last_active":"2023-08-17T17:35:10.747685+0000","last_peered":"2023-08-17T17:35:10.747685+0000","last_clean":"2023-08-17T17:35:10.747685+0000","last_became_active":"2023-08-17T17:35:10.747194+0000","last_became_peered":"2023-08-17T17:35:10.747194+0000","last_unstale":"2023-08-17T17:35:10.747685+0000","last_undegraded":"2023-08-17T17:35:10.747685+0000","last_fullsized":"2023-08-17T17:35:10.747685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.384074+0000","last_change":"2023-08-17T17:35:10.380688+0000","last_active":"2023-08-17T17:35:10.384074+0000","last_peered":"2023-08-17T17:35:10.384074+0000","last_clean":"2023-08-17T17:35:10.384074+0000","last_became_active":"2023-08-17T17:35:10.380198+0000","last_became_peered":"2023-08-17T17:35:10.380198+0000","last_unstale":"2023-08-17T17:35:10.384074+0000","last_undegraded":"2023-08-17T17:35:10.384074+0000","last_fullsized":"2023-08-17T17:35:10.384074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.735853+0000","last_change":"2023-08-17T17:35:10.735853+0000","last_active":"2023-08-17T17:35:10.735853+0000","last_peered":"2023-08-17T17:35:10.735853+0000","last_clean":"2023-08-17T17:35:10.735853+0000","last_became_active":"2023-08-17T17:35:10.734524+0000","last_became_peered":"2023-08-17T17:35:10.734524+0000","last_unstale":"2023-08-17T17:35:10.735853+0000","last_undegraded":"2023-08-17T17:35:10.735853+0000","last_fullsized":"2023-08-17T17:35:10.735853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.376747+0000","last_change":"2023-08-17T17:35:10.375184+0000","last_active":"2023-08-17T17:35:10.376747+0000","last_peered":"2023-08-17T17:35:10.376747+0000","last_clean":"2023-08-17T17:35:10.376747+0000","last_became_active":"2023-08-17T17:35:10.374665+0000","last_became_peered":"2023-08-17T17:35:10.374665+0000","last_unstale":"2023-08-17T17:35:10.376747+0000","last_undegraded":"2023-08-17T17:35:10.376747+0000","last_fullsized":"2023-08-17T17:35:10.376747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737512+0000","last_change":"2023-08-17T17:35:10.737512+0000","last_active":"2023-08-17T17:35:10.737512+0000","last_peered":"2023-08-17T17:35:10.737512+0000","last_clean":"2023-08-17T17:35:10.737512+0000","last_became_active":"2023-08-17T17:35:10.737209+0000","last_became_peered":"2023-08-17T17:35:10.737209+0000","last_unstale":"2023-08-17T17:35:10.737512+0000","last_undegraded":"2023-08-17T17:35:10.737512+0000","last_fullsized":"2023-08-17T17:35:10.737512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.375155+0000","last_change":"2023-08-17T17:35:10.368260+0000","last_active":"2023-08-17T17:35:10.375155+0000","last_peered":"2023-08-17T17:35:10.375155+0000","last_clean":"2023-08-17T17:35:10.375155+0000","last_became_active":"2023-08-17T17:35:10.367893+0000","last_became_peered":"2023-08-17T17:35:10.367893+0000","last_unstale":"2023-08-17T17:35:10.375155+0000","last_undegraded":"2023-08-17T17:35:10.375155+0000","last_fullsized":"2023-08-17T17:35:10.375155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.744583+0000","last_change":"2023-08-17T17:35:10.744583+0000","last_active":"2023-08-17T17:35:10.744583+0000","last_peered":"2023-08-17T17:35:10.744583+0000","last_clean":"2023-08-17T17:35:10.744583+0000","last_became_active":"2023-08-17T17:35:10.744283+0000","last_became_peered":"2023-08-17T17:35:10.744283+0000","last_unstale":"2023-08-17T17:35:10.744583+0000","last_undegraded":"2023-08-17T17:35:10.744583+0000","last_fullsized":"2023-08-17T17:35:10.744583+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.374195+0000","last_change":"2023-08-17T17:35:10.371220+0000","last_active":"2023-08-17T17:35:10.374195+0000","last_peered":"2023-08-17T17:35:10.374195+0000","last_clean":"2023-08-17T17:35:10.374195+0000","last_became_active":"2023-08-17T17:35:10.370934+0000","last_became_peered":"2023-08-17T17:35:10.370934+0000","last_unstale":"2023-08-17T17:35:10.374195+0000","last_undegraded":"2023-08-17T17:35:10.374195+0000","last_fullsized":"2023-08-17T17:35:10.374195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743686+0000","last_change":"2023-08-17T17:35:10.743686+0000","last_active":"2023-08-17T17:35:10.743686+0000","last_peered":"2023-08-17T17:35:10.743686+0000","last_clean":"2023-08-17T17:35:10.743686+0000","last_became_active":"2023-08-17T17:35:10.743419+0000","last_became_peered":"2023-08-17T17:35:10.743419+0000","last_unstale":"2023-08-17T17:35:10.743686+0000","last_undegraded":"2023-08-17T17:35:10.743686+0000","last_fullsized":"2023-08-17T17:35:10.743686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.384386+0000","last_change":"2023-08-17T17:35:10.383209+0000","last_active":"2023-08-17T17:35:10.384386+0000","last_peered":"2023-08-17T17:35:10.384386+0000","last_clean":"2023-08-17T17:35:10.384386+0000","last_became_active":"2023-08-17T17:35:10.382945+0000","last_became_peered":"2023-08-17T17:35:10.382945+0000","last_unstale":"2023-08-17T17:35:10.384386+0000","last_undegraded":"2023-08-17T17:35:10.384386+0000","last_fullsized":"2023-08-17T17:35:10.384386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745199+0000","last_change":"2023-08-17T17:35:10.745199+0000","last_active":"2023-08-17T17:35:10.745199+0000","last_peered":"2023-08-17T17:35:10.745199+0000","last_clean":"2023-08-17T17:35:10.745199+0000","last_became_active":"2023-08-17T17:35:10.744924+0000","last_became_peered":"2023-08-17T17:35:10.744924+0000","last_unstale":"2023-08-17T17:35:10.745199+0000","last_undegraded":"2023-08-17T17:35:10.745199+0000","last_fullsized":"2023-08-17T17:35:10.745199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.376494+0000","last_change":"2023-08-17T17:35:10.374278+0000","last_active":"2023-08-17T17:35:10.376494+0000","last_peered":"2023-08-17T17:35:10.376494+0000","last_clean":"2023-08-17T17:35:10.376494+0000","last_became_active":"2023-08-17T17:35:10.373536+0000","last_became_peered":"2023-08-17T17:35:10.373536+0000","last_unstale":"2023-08-17T17:35:10.376494+0000","last_undegraded":"2023-08-17T17:35:10.376494+0000","last_fullsized":"2023-08-17T17:35:10.376494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747777+0000","last_change":"2023-08-17T17:35:10.747777+0000","last_active":"2023-08-17T17:35:10.747777+0000","last_peered":"2023-08-17T17:35:10.747777+0000","last_clean":"2023-08-17T17:35:10.747777+0000","last_became_active":"2023-08-17T17:35:10.747299+0000","last_became_peered":"2023-08-17T17:35:10.747299+0000","last_unstale":"2023-08-17T17:35:10.747777+0000","last_undegraded":"2023-08-17T17:35:10.747777+0000","last_fullsized":"2023-08-17T17:35:10.747777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.378281+0000","last_change":"2023-08-17T17:35:10.374538+0000","last_active":"2023-08-17T17:35:10.378281+0000","last_peered":"2023-08-17T17:35:10.378281+0000","last_clean":"2023-08-17T17:35:10.378281+0000","last_became_active":"2023-08-17T17:35:10.374182+0000","last_became_peered":"2023-08-17T17:35:10.374182+0000","last_unstale":"2023-08-17T17:35:10.378281+0000","last_undegraded":"2023-08-17T17:35:10.378281+0000","last_fullsized":"2023-08-17T17:35:10.378281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745785+0000","last_change":"2023-08-17T17:35:10.745785+0000","last_active":"2023-08-17T17:35:10.745785+0000","last_peered":"2023-08-17T17:35:10.745785+0000","last_clean":"2023-08-17T17:35:10.745785+0000","last_became_active":"2023-08-17T17:35:10.745628+0000","last_became_peered":"2023-08-17T17:35:10.745628+0000","last_unstale":"2023-08-17T17:35:10.745785+0000","last_undegraded":"2023-08-17T17:35:10.745785+0000","last_fullsized":"2023-08-17T17:35:10.745785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383930+0000","last_change":"2023-08-17T17:35:10.379823+0000","last_active":"2023-08-17T17:35:10.383930+0000","last_peered":"2023-08-17T17:35:10.383930+0000","last_clean":"2023-08-17T17:35:10.383930+0000","last_became_active":"2023-08-17T17:35:10.379554+0000","last_became_peered":"2023-08-17T17:35:10.379554+0000","last_unstale":"2023-08-17T17:35:10.383930+0000","last_undegraded":"2023-08-17T17:35:10.383930+0000","last_fullsized":"2023-08-17T17:35:10.383930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747464+0000","last_change":"2023-08-17T17:35:10.747464+0000","last_active":"2023-08-17T17:35:10.747464+0000","last_peered":"2023-08-17T17:35:10.747464+0000","last_clean":"2023-08-17T17:35:10.747464+0000","last_became_active":"2023-08-17T17:35:10.746828+0000","last_became_peered":"2023-08-17T17:35:10.746828+0000","last_unstale":"2023-08-17T17:35:10.747464+0000","last_undegraded":"2023-08-17T17:35:10.747464+0000","last_fullsized":"2023-08-17T17:35:10.747464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.389212+0000","last_change":"2023-08-17T17:35:10.384999+0000","last_active":"2023-08-17T17:35:10.389212+0000","last_peered":"2023-08-17T17:35:10.389212+0000","last_clean":"2023-08-17T17:35:10.389212+0000","last_became_active":"2023-08-17T17:35:10.384714+0000","last_became_peered":"2023-08-17T17:35:10.384714+0000","last_unstale":"2023-08-17T17:35:10.389212+0000","last_undegraded":"2023-08-17T17:35:10.389212+0000","last_fullsized":"2023-08-17T17:35:10.389212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745123+0000","last_change":"2023-08-17T17:35:10.745123+0000","last_active":"2023-08-17T17:35:10.745123+0000","last_peered":"2023-08-17T17:35:10.745123+0000","last_clean":"2023-08-17T17:35:10.745123+0000","last_became_active":"2023-08-17T17:35:10.744713+0000","last_became_peered":"2023-08-17T17:35:10.744713+0000","last_unstale":"2023-08-17T17:35:10.745123+0000","last_undegraded":"2023-08-17T17:35:10.745123+0000","last_fullsized":"2023-08-17T17:35:10.745123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383848+0000","last_change":"2023-08-17T17:35:10.374166+0000","last_active":"2023-08-17T17:35:10.383848+0000","last_peered":"2023-08-17T17:35:10.383848+0000","last_clean":"2023-08-17T17:35:10.383848+0000","last_became_active":"2023-08-17T17:35:10.373493+0000","last_became_peered":"2023-08-17T17:35:10.373493+0000","last_unstale":"2023-08-17T17:35:10.383848+0000","last_undegraded":"2023-08-17T17:35:10.383848+0000","last_fullsized":"2023-08-17T17:35:10.383848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743182+0000","last_change":"2023-08-17T17:35:10.743182+0000","last_active":"2023-08-17T17:35:10.743182+0000","last_peered":"2023-08-17T17:35:10.743182+0000","last_clean":"2023-08-17T17:35:10.743182+0000","last_became_active":"2023-08-17T17:35:10.742892+0000","last_became_peered":"2023-08-17T17:35:10.742892+0000","last_unstale":"2023-08-17T17:35:10.743182+0000","last_undegraded":"2023-08-17T17:35:10.743182+0000","last_fullsized":"2023-08-17T17:35:10.743182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.378792+0000","last_change":"2023-08-17T17:35:10.376980+0000","last_active":"2023-08-17T17:35:10.378792+0000","last_peered":"2023-08-17T17:35:10.378792+0000","last_clean":"2023-08-17T17:35:10.378792+0000","last_became_active":"2023-08-17T17:35:10.376469+0000","last_became_peered":"2023-08-17T17:35:10.376469+0000","last_unstale":"2023-08-17T17:35:10.378792+0000","last_undegraded":"2023-08-17T17:35:10.378792+0000","last_fullsized":"2023-08-17T17:35:10.378792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749608+0000","last_change":"2023-08-17T17:35:10.749608+0000","last_active":"2023-08-17T17:35:10.749608+0000","last_peered":"2023-08-17T17:35:10.749608+0000","last_clean":"2023-08-17T17:35:10.749608+0000","last_became_active":"2023-08-17T17:35:10.749343+0000","last_became_peered":"2023-08-17T17:35:10.749343+0000","last_unstale":"2023-08-17T17:35:10.749608+0000","last_undegraded":"2023-08-17T17:35:10.749608+0000","last_fullsized":"2023-08-17T17:35:10.749608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.736856+0000","last_change":"2023-08-17T17:35:10.378692+0000","last_active":"2023-08-17T17:35:10.736856+0000","last_peered":"2023-08-17T17:35:10.736856+0000","last_clean":"2023-08-17T17:35:10.736856+0000","last_became_active":"2023-08-17T17:35:10.376508+0000","last_became_peered":"2023-08-17T17:35:10.376508+0000","last_unstale":"2023-08-17T17:35:10.736856+0000","last_undegraded":"2023-08-17T17:35:10.736856+0000","last_fullsized":"2023-08-17T17:35:10.736856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747990+0000","last_change":"2023-08-17T17:35:10.747990+0000","last_active":"2023-08-17T17:35:10.747990+0000","last_peered":"2023-08-17T17:35:10.747990+0000","last_clean":"2023-08-17T17:35:10.747990+0000","last_became_active":"2023-08-17T17:35:10.746294+0000","last_became_peered":"2023-08-17T17:35:10.746294+0000","last_unstale":"2023-08-17T17:35:10.747990+0000","last_undegraded":"2023-08-17T17:35:10.747990+0000","last_fullsized":"2023-08-17T17:35:10.747990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.728406+0000","last_change":"2023-08-17T17:35:10.371856+0000","last_active":"2023-08-17T17:35:10.728406+0000","last_peered":"2023-08-17T17:35:10.728406+0000","last_clean":"2023-08-17T17:35:10.728406+0000","last_became_active":"2023-08-17T17:35:10.371565+0000","last_became_peered":"2023-08-17T17:35:10.371565+0000","last_unstale":"2023-08-17T17:35:10.728406+0000","last_undegraded":"2023-08-17T17:35:10.728406+0000","last_fullsized":"2023-08-17T17:35:10.728406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.744619+0000","last_change":"2023-08-17T17:35:10.744619+0000","last_active":"2023-08-17T17:35:10.744619+0000","last_peered":"2023-08-17T17:35:10.744619+0000","last_clean":"2023-08-17T17:35:10.744619+0000","last_became_active":"2023-08-17T17:35:10.744357+0000","last_became_peered":"2023-08-17T17:35:10.744357+0000","last_unstale":"2023-08-17T17:35:10.744619+0000","last_undegraded":"2023-08-17T17:35:10.744619+0000","last_fullsized":"2023-08-17T17:35:10.744619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747571+0000","last_change":"2023-08-17T17:35:10.371553+0000","last_active":"2023-08-17T17:35:10.747571+0000","last_peered":"2023-08-17T17:35:10.747571+0000","last_clean":"2023-08-17T17:35:10.747571+0000","last_became_active":"2023-08-17T17:35:10.371382+0000","last_became_peered":"2023-08-17T17:35:10.371382+0000","last_unstale":"2023-08-17T17:35:10.747571+0000","last_undegraded":"2023-08-17T17:35:10.747571+0000","last_fullsized":"2023-08-17T17:35:10.747571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745369+0000","last_change":"2023-08-17T17:35:10.745369+0000","last_active":"2023-08-17T17:35:10.745369+0000","last_peered":"2023-08-17T17:35:10.745369+0000","last_clean":"2023-08-17T17:35:10.745369+0000","last_became_active":"2023-08-17T17:35:10.745081+0000","last_became_peered":"2023-08-17T17:35:10.745081+0000","last_unstale":"2023-08-17T17:35:10.745369+0000","last_undegraded":"2023-08-17T17:35:10.745369+0000","last_fullsized":"2023-08-17T17:35:10.745369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383967+0000","last_change":"2023-08-17T17:35:10.379916+0000","last_active":"2023-08-17T17:35:10.383967+0000","last_peered":"2023-08-17T17:35:10.383967+0000","last_clean":"2023-08-17T17:35:10.383967+0000","last_became_active":"2023-08-17T17:35:10.379627+0000","last_became_peered":"2023-08-17T17:35:10.379627+0000","last_unstale":"2023-08-17T17:35:10.383967+0000","last_undegraded":"2023-08-17T17:35:10.383967+0000","last_fullsized":"2023-08-17T17:35:10.383967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.741491+0000","last_change":"2023-08-17T17:35:10.741491+0000","last_active":"2023-08-17T17:35:10.741491+0000","last_peered":"2023-08-17T17:35:10.741491+0000","last_clean":"2023-08-17T17:35:10.741491+0000","last_became_active":"2023-08-17T17:35:10.741211+0000","last_became_peered":"2023-08-17T17:35:10.741211+0000","last_unstale":"2023-08-17T17:35:10.741491+0000","last_undegraded":"2023-08-17T17:35:10.741491+0000","last_fullsized":"2023-08-17T17:35:10.741491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.378365+0000","last_change":"2023-08-17T17:35:10.375359+0000","last_active":"2023-08-17T17:35:10.378365+0000","last_peered":"2023-08-17T17:35:10.378365+0000","last_clean":"2023-08-17T17:35:10.378365+0000","last_became_active":"2023-08-17T17:35:10.375066+0000","last_became_peered":"2023-08-17T17:35:10.375066+0000","last_unstale":"2023-08-17T17:35:10.378365+0000","last_undegraded":"2023-08-17T17:35:10.378365+0000","last_fullsized":"2023-08-17T17:35:10.378365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.736733+0000","last_change":"2023-08-17T17:35:10.736733+0000","last_active":"2023-08-17T17:35:10.736733+0000","last_peered":"2023-08-17T17:35:10.736733+0000","last_clean":"2023-08-17T17:35:10.736733+0000","last_became_active":"2023-08-17T17:35:10.736406+0000","last_became_peered":"2023-08-17T17:35:10.736406+0000","last_unstale":"2023-08-17T17:35:10.736733+0000","last_undegraded":"2023-08-17T17:35:10.736733+0000","last_fullsized":"2023-08-17T17:35:10.736733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.386551+0000","last_change":"2023-08-17T17:35:10.381786+0000","last_active":"2023-08-17T17:35:10.386551+0000","last_peered":"2023-08-17T17:35:10.386551+0000","last_clean":"2023-08-17T17:35:10.386551+0000","last_became_active":"2023-08-17T17:35:10.381454+0000","last_became_peered":"2023-08-17T17:35:10.381454+0000","last_unstale":"2023-08-17T17:35:10.386551+0000","last_undegraded":"2023-08-17T17:35:10.386551+0000","last_fullsized":"2023-08-17T17:35:10.386551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.739405+0000","last_change":"2023-08-17T17:35:10.739405+0000","last_active":"2023-08-17T17:35:10.739405+0000","last_peered":"2023-08-17T17:35:10.739405+0000","last_clean":"2023-08-17T17:35:10.739405+0000","last_became_active":"2023-08-17T17:35:10.739137+0000","last_became_peered":"2023-08-17T17:35:10.739137+0000","last_unstale":"2023-08-17T17:35:10.739405+0000","last_undegraded":"2023-08-17T17:35:10.739405+0000","last_fullsized":"2023-08-17T17:35:10.739405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.373698+0000","last_change":"2023-08-17T17:35:10.370127+0000","last_active":"2023-08-17T17:35:10.373698+0000","last_peered":"2023-08-17T17:35:10.373698+0000","last_clean":"2023-08-17T17:35:10.373698+0000","last_became_active":"2023-08-17T17:35:10.369844+0000","last_became_peered":"2023-08-17T17:35:10.369844+0000","last_unstale":"2023-08-17T17:35:10.373698+0000","last_undegraded":"2023-08-17T17:35:10.373698+0000","last_fullsized":"2023-08-17T17:35:10.373698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.744334+0000","last_change":"2023-08-17T17:35:10.744334+0000","last_active":"2023-08-17T17:35:10.744334+0000","last_peered":"2023-08-17T17:35:10.744334+0000","last_clean":"2023-08-17T17:35:10.744334+0000","last_became_active":"2023-08-17T17:35:10.744031+0000","last_became_peered":"2023-08-17T17:35:10.744031+0000","last_unstale":"2023-08-17T17:35:10.744334+0000","last_undegraded":"2023-08-17T17:35:10.744334+0000","last_fullsized":"2023-08-17T17:35:10.744334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.381012+0000","last_change":"2023-08-17T17:35:10.373943+0000","last_active":"2023-08-17T17:35:10.381012+0000","last_peered":"2023-08-17T17:35:10.381012+0000","last_clean":"2023-08-17T17:35:10.381012+0000","last_became_active":"2023-08-17T17:35:10.373598+0000","last_became_peered":"2023-08-17T17:35:10.373598+0000","last_unstale":"2023-08-17T17:35:10.381012+0000","last_undegraded":"2023-08-17T17:35:10.381012+0000","last_fullsized":"2023-08-17T17:35:10.381012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.736926+0000","last_change":"2023-08-17T17:35:10.736926+0000","last_active":"2023-08-17T17:35:10.736926+0000","last_peered":"2023-08-17T17:35:10.736926+0000","last_clean":"2023-08-17T17:35:10.736926+0000","last_became_active":"2023-08-17T17:35:10.736631+0000","last_became_peered":"2023-08-17T17:35:10.736631+0000","last_unstale":"2023-08-17T17:35:10.736926+0000","last_undegraded":"2023-08-17T17:35:10.736926+0000","last_fullsized":"2023-08-17T17:35:10.736926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.381068+0000","last_change":"2023-08-17T17:35:10.379316+0000","last_active":"2023-08-17T17:35:10.381068+0000","last_peered":"2023-08-17T17:35:10.381068+0000","last_clean":"2023-08-17T17:35:10.381068+0000","last_became_active":"2023-08-17T17:35:10.379099+0000","last_became_peered":"2023-08-17T17:35:10.379099+0000","last_unstale":"2023-08-17T17:35:10.381068+0000","last_undegraded":"2023-08-17T17:35:10.381068+0000","last_fullsized":"2023-08-17T17:35:10.381068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745762+0000","last_change":"2023-08-17T17:35:10.745762+0000","last_active":"2023-08-17T17:35:10.745762+0000","last_peered":"2023-08-17T17:35:10.745762+0000","last_clean":"2023-08-17T17:35:10.745762+0000","last_became_active":"2023-08-17T17:35:10.744888+0000","last_became_peered":"2023-08-17T17:35:10.744888+0000","last_unstale":"2023-08-17T17:35:10.745762+0000","last_undegraded":"2023-08-17T17:35:10.745762+0000","last_fullsized":"2023-08-17T17:35:10.745762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.386365+0000","last_change":"2023-08-17T17:35:10.379159+0000","last_active":"2023-08-17T17:35:10.386365+0000","last_peered":"2023-08-17T17:35:10.386365+0000","last_clean":"2023-08-17T17:35:10.386365+0000","last_became_active":"2023-08-17T17:35:10.378849+0000","last_became_peered":"2023-08-17T17:35:10.378849+0000","last_unstale":"2023-08-17T17:35:10.386365+0000","last_undegraded":"2023-08-17T17:35:10.386365+0000","last_fullsized":"2023-08-17T17:35:10.386365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.744140+0000","last_change":"2023-08-17T17:35:10.744140+0000","last_active":"2023-08-17T17:35:10.744140+0000","last_peered":"2023-08-17T17:35:10.744140+0000","last_clean":"2023-08-17T17:35:10.744140+0000","last_became_active":"2023-08-17T17:35:10.743751+0000","last_became_peered":"2023-08-17T17:35:10.743751+0000","last_unstale":"2023-08-17T17:35:10.744140+0000","last_undegraded":"2023-08-17T17:35:10.744140+0000","last_fullsized":"2023-08-17T17:35:10.744140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.750903+0000","last_change":"2023-08-17T17:35:10.375604+0000","last_active":"2023-08-17T17:35:10.750903+0000","last_peered":"2023-08-17T17:35:10.750903+0000","last_clean":"2023-08-17T17:35:10.750903+0000","last_became_active":"2023-08-17T17:35:10.374935+0000","last_became_peered":"2023-08-17T17:35:10.374935+0000","last_unstale":"2023-08-17T17:35:10.750903+0000","last_undegraded":"2023-08-17T17:35:10.750903+0000","last_fullsized":"2023-08-17T17:35:10.750903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.735553+0000","last_change":"2023-08-17T17:35:10.735553+0000","last_active":"2023-08-17T17:35:10.735553+0000","last_peered":"2023-08-17T17:35:10.735553+0000","last_clean":"2023-08-17T17:35:10.735553+0000","last_became_active":"2023-08-17T17:35:10.735191+0000","last_became_peered":"2023-08-17T17:35:10.735191+0000","last_unstale":"2023-08-17T17:35:10.735553+0000","last_undegraded":"2023-08-17T17:35:10.735553+0000","last_fullsized":"2023-08-17T17:35:10.735553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743988+0000","last_change":"2023-08-17T17:35:10.374920+0000","last_active":"2023-08-17T17:35:10.743988+0000","last_peered":"2023-08-17T17:35:10.743988+0000","last_clean":"2023-08-17T17:35:10.743988+0000","last_became_active":"2023-08-17T17:35:10.374692+0000","last_became_peered":"2023-08-17T17:35:10.374692+0000","last_unstale":"2023-08-17T17:35:10.743988+0000","last_undegraded":"2023-08-17T17:35:10.743988+0000","last_fullsized":"2023-08-17T17:35:10.743988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.742100+0000","last_change":"2023-08-17T17:35:10.742100+0000","last_active":"2023-08-17T17:35:10.742100+0000","last_peered":"2023-08-17T17:35:10.742100+0000","last_clean":"2023-08-17T17:35:10.742100+0000","last_became_active":"2023-08-17T17:35:10.741836+0000","last_became_peered":"2023-08-17T17:35:10.741836+0000","last_unstale":"2023-08-17T17:35:10.742100+0000","last_undegraded":"2023-08-17T17:35:10.742100+0000","last_fullsized":"2023-08-17T17:35:10.742100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.726945+0000","last_change":"2023-08-17T17:35:10.379669+0000","last_active":"2023-08-17T17:35:10.726945+0000","last_peered":"2023-08-17T17:35:10.726945+0000","last_clean":"2023-08-17T17:35:10.726945+0000","last_became_active":"2023-08-17T17:35:10.379405+0000","last_became_peered":"2023-08-17T17:35:10.379405+0000","last_unstale":"2023-08-17T17:35:10.726945+0000","last_undegraded":"2023-08-17T17:35:10.726945+0000","last_fullsized":"2023-08-17T17:35:10.726945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737579+0000","last_change":"2023-08-17T17:35:10.737579+0000","last_active":"2023-08-17T17:35:10.737579+0000","last_peered":"2023-08-17T17:35:10.737579+0000","last_clean":"2023-08-17T17:35:10.737579+0000","last_became_active":"2023-08-17T17:35:10.737293+0000","last_became_peered":"2023-08-17T17:35:10.737293+0000","last_unstale":"2023-08-17T17:35:10.737579+0000","last_undegraded":"2023-08-17T17:35:10.737579+0000","last_fullsized":"2023-08-17T17:35:10.737579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.373819+0000","last_change":"2023-08-17T17:35:10.370186+0000","last_active":"2023-08-17T17:35:10.373819+0000","last_peered":"2023-08-17T17:35:10.373819+0000","last_clean":"2023-08-17T17:35:10.373819+0000","last_became_active":"2023-08-17T17:35:10.369907+0000","last_became_peered":"2023-08-17T17:35:10.369907+0000","last_unstale":"2023-08-17T17:35:10.373819+0000","last_undegraded":"2023-08-17T17:35:10.373819+0000","last_fullsized":"2023-08-17T17:35:10.373819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.748178+0000","last_change":"2023-08-17T17:35:10.748178+0000","last_active":"2023-08-17T17:35:10.748178+0000","last_peered":"2023-08-17T17:35:10.748178+0000","last_clean":"2023-08-17T17:35:10.748178+0000","last_became_active":"2023-08-17T17:35:10.745566+0000","last_became_peered":"2023-08-17T17:35:10.745566+0000","last_unstale":"2023-08-17T17:35:10.748178+0000","last_undegraded":"2023-08-17T17:35:10.748178+0000","last_fullsized":"2023-08-17T17:35:10.748178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383867+0000","last_change":"2023-08-17T17:35:10.374354+0000","last_active":"2023-08-17T17:35:10.383867+0000","last_peered":"2023-08-17T17:35:10.383867+0000","last_clean":"2023-08-17T17:35:10.383867+0000","last_became_active":"2023-08-17T17:35:10.373895+0000","last_became_peered":"2023-08-17T17:35:10.373895+0000","last_unstale":"2023-08-17T17:35:10.383867+0000","last_undegraded":"2023-08-17T17:35:10.383867+0000","last_fullsized":"2023-08-17T17:35:10.383867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.738305+0000","last_change":"2023-08-17T17:35:10.738305+0000","last_active":"2023-08-17T17:35:10.738305+0000","last_peered":"2023-08-17T17:35:10.738305+0000","last_clean":"2023-08-17T17:35:10.738305+0000","last_became_active":"2023-08-17T17:35:10.738055+0000","last_became_peered":"2023-08-17T17:35:10.738055+0000","last_unstale":"2023-08-17T17:35:10.738305+0000","last_undegraded":"2023-08-17T17:35:10.738305+0000","last_fullsized":"2023-08-17T17:35:10.738305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.750396+0000","last_change":"2023-08-17T17:35:10.377167+0000","last_active":"2023-08-17T17:35:10.750396+0000","last_peered":"2023-08-17T17:35:10.750396+0000","last_clean":"2023-08-17T17:35:10.750396+0000","last_became_active":"2023-08-17T17:35:10.376853+0000","last_became_peered":"2023-08-17T17:35:10.376853+0000","last_unstale":"2023-08-17T17:35:10.750396+0000","last_undegraded":"2023-08-17T17:35:10.750396+0000","last_fullsized":"2023-08-17T17:35:10.750396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749255+0000","last_change":"2023-08-17T17:35:10.749255+0000","last_active":"2023-08-17T17:35:10.749255+0000","last_peered":"2023-08-17T17:35:10.749255+0000","last_clean":"2023-08-17T17:35:10.749255+0000","last_became_active":"2023-08-17T17:35:10.745106+0000","last_became_peered":"2023-08-17T17:35:10.745106+0000","last_unstale":"2023-08-17T17:35:10.749255+0000","last_undegraded":"2023-08-17T17:35:10.749255+0000","last_fullsized":"2023-08-17T17:35:10.749255+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.730191+0000","last_change":"2023-08-17T17:35:10.371645+0000","last_active":"2023-08-17T17:35:10.730191+0000","last_peered":"2023-08-17T17:35:10.730191+0000","last_clean":"2023-08-17T17:35:10.730191+0000","last_became_active":"2023-08-17T17:35:10.371323+0000","last_became_peered":"2023-08-17T17:35:10.371323+0000","last_unstale":"2023-08-17T17:35:10.730191+0000","last_undegraded":"2023-08-17T17:35:10.730191+0000","last_fullsized":"2023-08-17T17:35:10.730191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.741321+0000","last_change":"2023-08-17T17:35:10.741321+0000","last_active":"2023-08-17T17:35:10.741321+0000","last_peered":"2023-08-17T17:35:10.741321+0000","last_clean":"2023-08-17T17:35:10.741321+0000","last_became_active":"2023-08-17T17:35:10.741025+0000","last_became_peered":"2023-08-17T17:35:10.741025+0000","last_unstale":"2023-08-17T17:35:10.741321+0000","last_undegraded":"2023-08-17T17:35:10.741321+0000","last_fullsized":"2023-08-17T17:35:10.741321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749658+0000","last_change":"2023-08-17T17:35:10.373789+0000","last_active":"2023-08-17T17:35:10.749658+0000","last_peered":"2023-08-17T17:35:10.749658+0000","last_clean":"2023-08-17T17:35:10.749658+0000","last_became_active":"2023-08-17T17:35:10.373492+0000","last_became_peered":"2023-08-17T17:35:10.373492+0000","last_unstale":"2023-08-17T17:35:10.749658+0000","last_undegraded":"2023-08-17T17:35:10.749658+0000","last_fullsized":"2023-08-17T17:35:10.749658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.738008+0000","last_change":"2023-08-17T17:35:10.738008+0000","last_active":"2023-08-17T17:35:10.738008+0000","last_peered":"2023-08-17T17:35:10.738008+0000","last_clean":"2023-08-17T17:35:10.738008+0000","last_became_active":"2023-08-17T17:35:10.737729+0000","last_became_peered":"2023-08-17T17:35:10.737729+0000","last_unstale":"2023-08-17T17:35:10.738008+0000","last_undegraded":"2023-08-17T17:35:10.738008+0000","last_fullsized":"2023-08-17T17:35:10.738008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.375997+0000","last_change":"2023-08-17T17:35:10.373894+0000","last_active":"2023-08-17T17:35:10.375997+0000","last_peered":"2023-08-17T17:35:10.375997+0000","last_clean":"2023-08-17T17:35:10.375997+0000","last_became_active":"2023-08-17T17:35:10.373606+0000","last_became_peered":"2023-08-17T17:35:10.373606+0000","last_unstale":"2023-08-17T17:35:10.375997+0000","last_undegraded":"2023-08-17T17:35:10.375997+0000","last_fullsized":"2023-08-17T17:35:10.375997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.740965+0000","last_change":"2023-08-17T17:35:10.740965+0000","last_active":"2023-08-17T17:35:10.740965+0000","last_peered":"2023-08-17T17:35:10.740965+0000","last_clean":"2023-08-17T17:35:10.740965+0000","last_became_active":"2023-08-17T17:35:10.740510+0000","last_became_peered":"2023-08-17T17:35:10.740510+0000","last_unstale":"2023-08-17T17:35:10.740965+0000","last_undegraded":"2023-08-17T17:35:10.740965+0000","last_fullsized":"2023-08-17T17:35:10.740965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.374298+0000","last_change":"2023-08-17T17:35:10.372043+0000","last_active":"2023-08-17T17:35:10.374298+0000","last_peered":"2023-08-17T17:35:10.374298+0000","last_clean":"2023-08-17T17:35:10.374298+0000","last_became_active":"2023-08-17T17:35:10.371446+0000","last_became_peered":"2023-08-17T17:35:10.371446+0000","last_unstale":"2023-08-17T17:35:10.374298+0000","last_undegraded":"2023-08-17T17:35:10.374298+0000","last_fullsized":"2023-08-17T17:35:10.374298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.748287+0000","last_change":"2023-08-17T17:35:10.748287+0000","last_active":"2023-08-17T17:35:10.748287+0000","last_peered":"2023-08-17T17:35:10.748287+0000","last_clean":"2023-08-17T17:35:10.748287+0000","last_became_active":"2023-08-17T17:35:10.747975+0000","last_became_peered":"2023-08-17T17:35:10.747975+0000","last_unstale":"2023-08-17T17:35:10.748287+0000","last_undegraded":"2023-08-17T17:35:10.748287+0000","last_fullsized":"2023-08-17T17:35:10.748287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.731326+0000","last_change":"2023-08-17T17:35:10.380410+0000","last_active":"2023-08-17T17:35:10.731326+0000","last_peered":"2023-08-17T17:35:10.731326+0000","last_clean":"2023-08-17T17:35:10.731326+0000","last_became_active":"2023-08-17T17:35:10.380045+0000","last_became_peered":"2023-08-17T17:35:10.380045+0000","last_unstale":"2023-08-17T17:35:10.731326+0000","last_undegraded":"2023-08-17T17:35:10.731326+0000","last_fullsized":"2023-08-17T17:35:10.731326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.741673+0000","last_change":"2023-08-17T17:35:10.741673+0000","last_active":"2023-08-17T17:35:10.741673+0000","last_peered":"2023-08-17T17:35:10.741673+0000","last_clean":"2023-08-17T17:35:10.741673+0000","last_became_active":"2023-08-17T17:35:10.741417+0000","last_became_peered":"2023-08-17T17:35:10.741417+0000","last_unstale":"2023-08-17T17:35:10.741673+0000","last_undegraded":"2023-08-17T17:35:10.741673+0000","last_fullsized":"2023-08-17T17:35:10.741673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.376695+0000","last_change":"2023-08-17T17:35:10.375220+0000","last_active":"2023-08-17T17:35:10.376695+0000","last_peered":"2023-08-17T17:35:10.376695+0000","last_clean":"2023-08-17T17:35:10.376695+0000","last_became_active":"2023-08-17T17:35:10.374895+0000","last_became_peered":"2023-08-17T17:35:10.374895+0000","last_unstale":"2023-08-17T17:35:10.376695+0000","last_undegraded":"2023-08-17T17:35:10.376695+0000","last_fullsized":"2023-08-17T17:35:10.376695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.748793+0000","last_change":"2023-08-17T17:35:10.748793+0000","last_active":"2023-08-17T17:35:10.748793+0000","last_peered":"2023-08-17T17:35:10.748793+0000","last_clean":"2023-08-17T17:35:10.748793+0000","last_became_active":"2023-08-17T17:35:10.748500+0000","last_became_peered":"2023-08-17T17:35:10.748500+0000","last_unstale":"2023-08-17T17:35:10.748793+0000","last_undegraded":"2023-08-17T17:35:10.748793+0000","last_fullsized":"2023-08-17T17:35:10.748793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.389173+0000","last_change":"2023-08-17T17:35:10.384385+0000","last_active":"2023-08-17T17:35:10.389173+0000","last_peered":"2023-08-17T17:35:10.389173+0000","last_clean":"2023-08-17T17:35:10.389173+0000","last_became_active":"2023-08-17T17:35:10.384151+0000","last_became_peered":"2023-08-17T17:35:10.384151+0000","last_unstale":"2023-08-17T17:35:10.389173+0000","last_undegraded":"2023-08-17T17:35:10.389173+0000","last_fullsized":"2023-08-17T17:35:10.389173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749571+0000","last_change":"2023-08-17T17:35:10.749571+0000","last_active":"2023-08-17T17:35:10.749571+0000","last_peered":"2023-08-17T17:35:10.749571+0000","last_clean":"2023-08-17T17:35:10.749571+0000","last_became_active":"2023-08-17T17:35:10.749327+0000","last_became_peered":"2023-08-17T17:35:10.749327+0000","last_unstale":"2023-08-17T17:35:10.749571+0000","last_undegraded":"2023-08-17T17:35:10.749571+0000","last_fullsized":"2023-08-17T17:35:10.749571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.381583+0000","last_change":"2023-08-17T17:35:10.379993+0000","last_active":"2023-08-17T17:35:10.381583+0000","last_peered":"2023-08-17T17:35:10.381583+0000","last_clean":"2023-08-17T17:35:10.381583+0000","last_became_active":"2023-08-17T17:35:10.379702+0000","last_became_peered":"2023-08-17T17:35:10.379702+0000","last_unstale":"2023-08-17T17:35:10.381583+0000","last_undegraded":"2023-08-17T17:35:10.381583+0000","last_fullsized":"2023-08-17T17:35:10.381583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.742074+0000","last_change":"2023-08-17T17:35:10.742074+0000","last_active":"2023-08-17T17:35:10.742074+0000","last_peered":"2023-08-17T17:35:10.742074+0000","last_clean":"2023-08-17T17:35:10.742074+0000","last_became_active":"2023-08-17T17:35:10.741799+0000","last_became_peered":"2023-08-17T17:35:10.741799+0000","last_unstale":"2023-08-17T17:35:10.742074+0000","last_undegraded":"2023-08-17T17:35:10.742074+0000","last_fullsized":"2023-08-17T17:35:10.742074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.376859+0000","last_change":"2023-08-17T17:35:10.375952+0000","last_active":"2023-08-17T17:35:10.376859+0000","last_peered":"2023-08-17T17:35:10.376859+0000","last_clean":"2023-08-17T17:35:10.376859+0000","last_became_active":"2023-08-17T17:35:10.375677+0000","last_became_peered":"2023-08-17T17:35:10.375677+0000","last_unstale":"2023-08-17T17:35:10.376859+0000","last_undegraded":"2023-08-17T17:35:10.376859+0000","last_fullsized":"2023-08-17T17:35:10.376859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.358262+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:35:10.358262+0000","last_peered":"2023-08-17T17:35:10.358262+0000","last_clean":"2023-08-17T17:35:10.358262+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:35:10.358262+0000","last_undegraded":"2023-08-17T17:35:10.358262+0000","last_fullsized":"2023-08-17T17:35:10.358262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.741289+0000","last_change":"2023-08-17T17:35:10.741289+0000","last_active":"2023-08-17T17:35:10.741289+0000","last_peered":"2023-08-17T17:35:10.741289+0000","last_clean":"2023-08-17T17:35:10.741289+0000","last_became_active":"2023-08-17T17:35:10.740904+0000","last_became_peered":"2023-08-17T17:35:10.740904+0000","last_unstale":"2023-08-17T17:35:10.741289+0000","last_undegraded":"2023-08-17T17:35:10.741289+0000","last_fullsized":"2023-08-17T17:35:10.741289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.376908+0000","last_change":"2023-08-17T17:35:10.375897+0000","last_active":"2023-08-17T17:35:10.376908+0000","last_peered":"2023-08-17T17:35:10.376908+0000","last_clean":"2023-08-17T17:35:10.376908+0000","last_became_active":"2023-08-17T17:35:10.375639+0000","last_became_peered":"2023-08-17T17:35:10.375639+0000","last_unstale":"2023-08-17T17:35:10.376908+0000","last_undegraded":"2023-08-17T17:35:10.376908+0000","last_fullsized":"2023-08-17T17:35:10.376908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.362638+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:35:10.362638+0000","last_peered":"2023-08-17T17:35:10.362638+0000","last_clean":"2023-08-17T17:35:10.362638+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:35:10.362638+0000","last_undegraded":"2023-08-17T17:35:10.362638+0000","last_fullsized":"2023-08-17T17:35:10.362638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747219+0000","last_change":"2023-08-17T17:35:10.747219+0000","last_active":"2023-08-17T17:35:10.747219+0000","last_peered":"2023-08-17T17:35:10.747219+0000","last_clean":"2023-08-17T17:35:10.747219+0000","last_became_active":"2023-08-17T17:35:10.745290+0000","last_became_peered":"2023-08-17T17:35:10.745290+0000","last_unstale":"2023-08-17T17:35:10.747219+0000","last_undegraded":"2023-08-17T17:35:10.747219+0000","last_fullsized":"2023-08-17T17:35:10.747219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.370979+0000","last_change":"2023-08-17T17:35:10.368838+0000","last_active":"2023-08-17T17:35:10.370979+0000","last_peered":"2023-08-17T17:35:10.370979+0000","last_clean":"2023-08-17T17:35:10.370979+0000","last_became_active":"2023-08-17T17:35:10.368397+0000","last_became_peered":"2023-08-17T17:35:10.368397+0000","last_unstale":"2023-08-17T17:35:10.370979+0000","last_undegraded":"2023-08-17T17:35:10.370979+0000","last_fullsized":"2023-08-17T17:35:10.370979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.360158+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:35:10.360158+0000","last_peered":"2023-08-17T17:35:10.360158+0000","last_clean":"2023-08-17T17:35:10.360158+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:35:10.360158+0000","last_undegraded":"2023-08-17T17:35:10.360158+0000","last_fullsized":"2023-08-17T17:35:10.360158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.750011+0000","last_change":"2023-08-17T17:35:10.750011+0000","last_active":"2023-08-17T17:35:10.750011+0000","last_peered":"2023-08-17T17:35:10.750011+0000","last_clean":"2023-08-17T17:35:10.750011+0000","last_became_active":"2023-08-17T17:35:10.749665+0000","last_became_peered":"2023-08-17T17:35:10.749665+0000","last_unstale":"2023-08-17T17:35:10.750011+0000","last_undegraded":"2023-08-17T17:35:10.750011+0000","last_fullsized":"2023-08-17T17:35:10.750011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.386423+0000","last_change":"2023-08-17T17:35:10.379904+0000","last_active":"2023-08-17T17:35:10.386423+0000","last_peered":"2023-08-17T17:35:10.386423+0000","last_clean":"2023-08-17T17:35:10.386423+0000","last_became_active":"2023-08-17T17:35:10.379626+0000","last_became_peered":"2023-08-17T17:35:10.379626+0000","last_unstale":"2023-08-17T17:35:10.386423+0000","last_undegraded":"2023-08-17T17:35:10.386423+0000","last_fullsized":"2023-08-17T17:35:10.386423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.363667+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:35:10.363667+0000","last_peered":"2023-08-17T17:35:10.363667+0000","last_clean":"2023-08-17T17:35:10.363667+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:35:10.363667+0000","last_undegraded":"2023-08-17T17:35:10.363667+0000","last_fullsized":"2023-08-17T17:35:10.363667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.369230+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:35:10.369230+0000","last_peered":"2023-08-17T17:35:10.369230+0000","last_clean":"2023-08-17T17:35:10.369230+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:35:10.369230+0000","last_undegraded":"2023-08-17T17:35:10.369230+0000","last_fullsized":"2023-08-17T17:35:10.369230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.746942+0000","last_change":"2023-08-17T17:35:10.746942+0000","last_active":"2023-08-17T17:35:10.746942+0000","last_peered":"2023-08-17T17:35:10.746942+0000","last_clean":"2023-08-17T17:35:10.746942+0000","last_became_active":"2023-08-17T17:35:10.746718+0000","last_became_peered":"2023-08-17T17:35:10.746718+0000","last_unstale":"2023-08-17T17:35:10.746942+0000","last_undegraded":"2023-08-17T17:35:10.746942+0000","last_fullsized":"2023-08-17T17:35:10.746942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749366+0000","last_change":"2023-08-17T17:35:10.375762+0000","last_active":"2023-08-17T17:35:10.749366+0000","last_peered":"2023-08-17T17:35:10.749366+0000","last_clean":"2023-08-17T17:35:10.749366+0000","last_became_active":"2023-08-17T17:35:10.375420+0000","last_became_peered":"2023-08-17T17:35:10.375420+0000","last_unstale":"2023-08-17T17:35:10.749366+0000","last_undegraded":"2023-08-17T17:35:10.749366+0000","last_fullsized":"2023-08-17T17:35:10.749366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.369640+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:35:10.369640+0000","last_peered":"2023-08-17T17:35:10.369640+0000","last_clean":"2023-08-17T17:35:10.369640+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:35:10.369640+0000","last_undegraded":"2023-08-17T17:35:10.369640+0000","last_fullsized":"2023-08-17T17:35:10.369640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747448+0000","last_change":"2023-08-17T17:35:10.747448+0000","last_active":"2023-08-17T17:35:10.747448+0000","last_peered":"2023-08-17T17:35:10.747448+0000","last_clean":"2023-08-17T17:35:10.747448+0000","last_became_active":"2023-08-17T17:35:10.746221+0000","last_became_peered":"2023-08-17T17:35:10.746221+0000","last_unstale":"2023-08-17T17:35:10.747448+0000","last_undegraded":"2023-08-17T17:35:10.747448+0000","last_fullsized":"2023-08-17T17:35:10.747448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.384084+0000","last_change":"2023-08-17T17:35:10.378175+0000","last_active":"2023-08-17T17:35:10.384084+0000","last_peered":"2023-08-17T17:35:10.384084+0000","last_clean":"2023-08-17T17:35:10.384084+0000","last_became_active":"2023-08-17T17:35:10.377923+0000","last_became_peered":"2023-08-17T17:35:10.377923+0000","last_unstale":"2023-08-17T17:35:10.384084+0000","last_undegraded":"2023-08-17T17:35:10.384084+0000","last_fullsized":"2023-08-17T17:35:10.384084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.371699+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:35:10.371699+0000","last_peered":"2023-08-17T17:35:10.371699+0000","last_clean":"2023-08-17T17:35:10.371699+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:35:10.371699+0000","last_undegraded":"2023-08-17T17:35:10.371699+0000","last_fullsized":"2023-08-17T17:35:10.371699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737343+0000","last_change":"2023-08-17T17:35:10.737343+0000","last_active":"2023-08-17T17:35:10.737343+0000","last_peered":"2023-08-17T17:35:10.737343+0000","last_clean":"2023-08-17T17:35:10.737343+0000","last_became_active":"2023-08-17T17:35:10.737065+0000","last_became_peered":"2023-08-17T17:35:10.737065+0000","last_unstale":"2023-08-17T17:35:10.737343+0000","last_undegraded":"2023-08-17T17:35:10.737343+0000","last_fullsized":"2023-08-17T17:35:10.737343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383922+0000","last_change":"2023-08-17T17:35:10.379803+0000","last_active":"2023-08-17T17:35:10.383922+0000","last_peered":"2023-08-17T17:35:10.383922+0000","last_clean":"2023-08-17T17:35:10.383922+0000","last_became_active":"2023-08-17T17:35:10.379509+0000","last_became_peered":"2023-08-17T17:35:10.379509+0000","last_unstale":"2023-08-17T17:35:10.383922+0000","last_undegraded":"2023-08-17T17:35:10.383922+0000","last_fullsized":"2023-08-17T17:35:10.383922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.358111+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:35:10.358111+0000","last_peered":"2023-08-17T17:35:10.358111+0000","last_clean":"2023-08-17T17:35:10.358111+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:35:10.358111+0000","last_undegraded":"2023-08-17T17:35:10.358111+0000","last_fullsized":"2023-08-17T17:35:10.358111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.748093+0000","last_change":"2023-08-17T17:35:10.748093+0000","last_active":"2023-08-17T17:35:10.748093+0000","last_peered":"2023-08-17T17:35:10.748093+0000","last_clean":"2023-08-17T17:35:10.748093+0000","last_became_active":"2023-08-17T17:35:10.745484+0000","last_became_peered":"2023-08-17T17:35:10.745484+0000","last_unstale":"2023-08-17T17:35:10.748093+0000","last_undegraded":"2023-08-17T17:35:10.748093+0000","last_fullsized":"2023-08-17T17:35:10.748093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.381039+0000","last_change":"2023-08-17T17:35:10.379037+0000","last_active":"2023-08-17T17:35:10.381039+0000","last_peered":"2023-08-17T17:35:10.381039+0000","last_clean":"2023-08-17T17:35:10.381039+0000","last_became_active":"2023-08-17T17:35:10.378745+0000","last_became_peered":"2023-08-17T17:35:10.378745+0000","last_unstale":"2023-08-17T17:35:10.381039+0000","last_undegraded":"2023-08-17T17:35:10.381039+0000","last_fullsized":"2023-08-17T17:35:10.381039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.364672+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:35:10.364672+0000","last_peered":"2023-08-17T17:35:10.364672+0000","last_clean":"2023-08-17T17:35:10.364672+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:35:10.364672+0000","last_undegraded":"2023-08-17T17:35:10.364672+0000","last_fullsized":"2023-08-17T17:35:10.364672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":152644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":138142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":138142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":138142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":153640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":144821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:35:14.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:35:14.341 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:35:14.337+0000 7fecbabc5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:35:14.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.452+0000 7f8751568700 1 Processor -- start 2023-08-17T17:35:14.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.453+0000 7f8751568700 1 -- start start 2023-08-17T17:35:14.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.453+0000 7f8751568700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f874c154140 0x7f874c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.453+0000 7f8751568700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f874c0c1010 0x7f874c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.453+0000 7f8751568700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c154520 con 0x7f874c0a7c40 2023-08-17T17:35:14.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.453+0000 7f8751568700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874c0c91e0 con 0x7f874c154140 2023-08-17T17:35:14.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.453+0000 7f8751568700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0c94c0 con 0x7f874c0c1010 2023-08-17T17:35:14.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f874c154140 0x7f874c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f87427fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f874c0a7c40 0x7f874c0c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55340/0 (socket says 172.21.15.78:55340) 2023-08-17T17:35:14.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f87427fc700 1 -- 172.21.15.78:0/286174639 learned_addr learned my addr 172.21.15.78:0/286174639 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:14.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874b7fe700 1 --2- 172.21.15.78:0/286174639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f874c0c1010 0x7f874c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874affd700 1 -- 172.21.15.78:0/286174639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f874c0c1010 msgr2=0x7f874c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:14.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874affd700 1 --2- 172.21.15.78:0/286174639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f874c0c1010 0x7f874c0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874affd700 1 -- 172.21.15.78:0/286174639 >> v1:172.21.15.78:6789/0 conn(0x7f874c0a7c40 legacy=0x7f874c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874affd700 1 -- 172.21.15.78:0/286174639 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c0c97a0 con 0x7f874c154140 2023-08-17T17:35:14.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874a7fc700 1 -- 172.21.15.78:0/286174639 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651989024 0 0) 0x7f874c154520 con 0x7f874c0a7c40 2023-08-17T17:35:14.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874affd700 1 --2- 172.21.15.78:0/286174639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c154140 0x7f874c0c6ee0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f873c009760 tx=0x7f873c009060).ready entity=mon.0 client_cookie=a85efff648739901 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:14.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874a7fc700 1 -- 172.21.15.78:0/286174639 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00b580 con 0x7f874c154140 2023-08-17T17:35:14.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874a7fc700 1 -- 172.21.15.78:0/286174639 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00b6e0 con 0x7f874c154140 2023-08-17T17:35:14.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.454+0000 7f874a7fc700 1 -- 172.21.15.78:0/286174639 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00ba60 con 0x7f874c154140 2023-08-17T17:35:14.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.455+0000 7f8751568700 1 -- 172.21.15.78:0/286174639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c154140 msgr2=0x7f874c0c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.455+0000 7f8751568700 1 --2- 172.21.15.78:0/286174639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c154140 0x7f874c0c6ee0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f873c009760 tx=0x7f873c009060).stop 2023-08-17T17:35:14.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.455+0000 7f8751568700 1 -- 172.21.15.78:0/286174639 shutdown_connections 2023-08-17T17:35:14.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.455+0000 7f8751568700 1 --2- 172.21.15.78:0/286174639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f874c0c1010 0x7f874c0ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.455+0000 7f8751568700 1 --2- 172.21.15.78:0/286174639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c154140 0x7f874c0c6ee0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.455+0000 7f8751568700 1 -- 172.21.15.78:0/286174639 >> 172.21.15.78:0/286174639 conn(0x7f874c094510 msgr2=0x7f874c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:14.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.455+0000 7f8751568700 1 -- 172.21.15.78:0/286174639 shutdown_connections 2023-08-17T17:35:14.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.455+0000 7f8751568700 1 -- 172.21.15.78:0/286174639 wait complete. 2023-08-17T17:35:14.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.456+0000 7f8751568700 1 Processor -- start 2023-08-17T17:35:14.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.456+0000 7f8751568700 1 -- start start 2023-08-17T17:35:14.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f8751568700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c0a7c40 0x7f874c142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f8751568700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c1010 0x7f874c0c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f8751568700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f874c154140 0x7f874c097fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f8751568700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c096ba0 con 0x7f874c0a7c40 2023-08-17T17:35:14.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f8751568700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0c32b0 con 0x7f874c0c1010 2023-08-17T17:35:14.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f8751568700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0c2420 con 0x7f874c154140 2023-08-17T17:35:14.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f874affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c0a7c40 0x7f874c142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f874affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c0a7c40 0x7f874c142430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53546/0 (socket says 172.21.15.78:53546) 2023-08-17T17:35:14.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f874affd700 1 -- 172.21.15.78:0/1181195462 learned_addr learned my addr 172.21.15.78:0/1181195462 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:14.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f87427fc700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c1010 0x7f874c0c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f874b7fe700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f874c154140 0x7f874c097fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f874affd700 1 -- 172.21.15.78:0/1181195462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f874c154140 msgr2=0x7f874c097fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f874affd700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f874c154140 0x7f874c097fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f874affd700 1 -- 172.21.15.78:0/1181195462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c1010 msgr2=0x7f874c0c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f874affd700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c1010 0x7f874c0c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f874affd700 1 -- 172.21.15.78:0/1181195462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c0092a0 con 0x7f874c0a7c40 2023-08-17T17:35:14.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f87427fc700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c1010 0x7f874c0c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:14.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f874affd700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c0a7c40 0x7f874c142430 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f873c009eb0 tx=0x7f873c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:14.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f87437fe700 1 -- 172.21.15.78:0/1181195462 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00b850 con 0x7f874c0a7c40 2023-08-17T17:35:14.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f87437fe700 1 -- 172.21.15.78:0/1181195462 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00b9b0 con 0x7f874c0a7c40 2023-08-17T17:35:14.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f8751568700 1 -- 172.21.15.78:0/1181195462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874c0c26a0 con 0x7f874c0a7c40 2023-08-17T17:35:14.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f87437fe700 1 -- 172.21.15.78:0/1181195462 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c01c630 con 0x7f874c0a7c40 2023-08-17T17:35:14.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.457+0000 7f8751568700 1 -- 172.21.15.78:0/1181195462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c0c2c60 con 0x7f874c0a7c40 2023-08-17T17:35:14.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.458+0000 7f8751568700 1 -- 172.21.15.78:0/1181195462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874c047350 con 0x7f874c0a7c40 2023-08-17T17:35:14.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.459+0000 7f87437fe700 1 -- 172.21.15.78:0/1181195462 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f873c02c070 con 0x7f874c0a7c40 2023-08-17T17:35:14.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.459+0000 7f87437fe700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f872c05ed90 0x7f872c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.459+0000 7f87437fe700 1 -- 172.21.15.78:0/1181195462 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f873c07b960 con 0x7f874c0a7c40 2023-08-17T17:35:14.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.459+0000 7f87427fc700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f872c05ed90 0x7f872c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.460+0000 7f87427fc700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f872c05ed90 0x7f872c061250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f874c097dc0 tx=0x7f8734009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:14.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.463+0000 7f87437fe700 1 -- 172.21.15.78:0/1181195462 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f873c04cf00 con 0x7f874c0a7c40 2023-08-17T17:35:14.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.622+0000 7f8751568700 1 -- 172.21.15.78:0/1181195462 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f874c0c33f0 con 0x7f872c05ed90 2023-08-17T17:35:14.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.630+0000 7f87437fe700 1 -- 172.21.15.78:0/1181195462 <== mgr.4104 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336424 (secure 0 0 0) 0x7f87340012f0 con 0x7f872c05ed90 2023-08-17T17:35:14.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:35:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.633+0000 7f8751568700 1 -- 172.21.15.78:0/1181195462 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f872c05ed90 msgr2=0x7f872c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.633+0000 7f8751568700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f872c05ed90 0x7f872c061250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f874c097dc0 tx=0x7f8734009040).stop 2023-08-17T17:35:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.633+0000 7f8751568700 1 -- 172.21.15.78:0/1181195462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c0a7c40 msgr2=0x7f874c142430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.633+0000 7f8751568700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c0a7c40 0x7f874c142430 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f873c009eb0 tx=0x7f873c017000).stop 2023-08-17T17:35:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.634+0000 7f8751568700 1 -- 172.21.15.78:0/1181195462 shutdown_connections 2023-08-17T17:35:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.634+0000 7f8751568700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f872c05ed90 0x7f872c061250 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.634+0000 7f8751568700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f874c154140 0x7f874c097fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.634+0000 7f8751568700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874c0a7c40 0x7f874c142430 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.634+0000 7f8751568700 1 --2- 172.21.15.78:0/1181195462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f874c0c1010 0x7f874c0c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.634+0000 7f8751568700 1 -- 172.21.15.78:0/1181195462 >> 172.21.15.78:0/1181195462 conn(0x7f874c094510 msgr2=0x7f874c0c04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.634+0000 7f8751568700 1 -- 172.21.15.78:0/1181195462 shutdown_connections 2023-08-17T17:35:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.634+0000 7f8751568700 1 -- 172.21.15.78:0/1181195462 wait complete. 2023-08-17T17:35:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:35:14.646 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-08-17T17:35:13.018847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379624,"kb_used_data":2856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595096,"statfs":{"total":773094113280,"available":770657378304,"internally_reserved":0,"allocated":2924544,"data_stored":1169531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.598697"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.744713+0000","last_change":"2023-08-17T17:35:10.744713+0000","last_active":"2023-08-17T17:35:10.744713+0000","last_peered":"2023-08-17T17:35:10.744713+0000","last_clean":"2023-08-17T17:35:10.744713+0000","last_became_active":"2023-08-17T17:35:10.744458+0000","last_became_peered":"2023-08-17T17:35:10.744458+0000","last_unstale":"2023-08-17T17:35:10.744713+0000","last_undegraded":"2023-08-17T17:35:10.744713+0000","last_fullsized":"2023-08-17T17:35:10.744713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.752297+0000","last_change":"2023-08-17T17:35:10.379264+0000","last_active":"2023-08-17T17:35:10.752297+0000","last_peered":"2023-08-17T17:35:10.752297+0000","last_clean":"2023-08-17T17:35:10.752297+0000","last_became_active":"2023-08-17T17:35:10.378966+0000","last_became_peered":"2023-08-17T17:35:10.378966+0000","last_unstale":"2023-08-17T17:35:10.752297+0000","last_undegraded":"2023-08-17T17:35:10.752297+0000","last_fullsized":"2023-08-17T17:35:10.752297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.739049+0000","last_change":"2023-08-17T17:35:10.739049+0000","last_active":"2023-08-17T17:35:10.739049+0000","last_peered":"2023-08-17T17:35:10.739049+0000","last_clean":"2023-08-17T17:35:10.739049+0000","last_became_active":"2023-08-17T17:35:10.738788+0000","last_became_peered":"2023-08-17T17:35:10.738788+0000","last_unstale":"2023-08-17T17:35:10.739049+0000","last_undegraded":"2023-08-17T17:35:10.739049+0000","last_fullsized":"2023-08-17T17:35:10.739049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.384341+0000","last_change":"2023-08-17T17:35:10.382409+0000","last_active":"2023-08-17T17:35:10.384341+0000","last_peered":"2023-08-17T17:35:10.384341+0000","last_clean":"2023-08-17T17:35:10.384341+0000","last_became_active":"2023-08-17T17:35:10.378886+0000","last_became_peered":"2023-08-17T17:35:10.378886+0000","last_unstale":"2023-08-17T17:35:10.384341+0000","last_undegraded":"2023-08-17T17:35:10.384341+0000","last_fullsized":"2023-08-17T17:35:10.384341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.738388+0000","last_change":"2023-08-17T17:35:10.738388+0000","last_active":"2023-08-17T17:35:10.738388+0000","last_peered":"2023-08-17T17:35:10.738388+0000","last_clean":"2023-08-17T17:35:10.738388+0000","last_became_active":"2023-08-17T17:35:10.738094+0000","last_became_peered":"2023-08-17T17:35:10.738094+0000","last_unstale":"2023-08-17T17:35:10.738388+0000","last_undegraded":"2023-08-17T17:35:10.738388+0000","last_fullsized":"2023-08-17T17:35:10.738388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383630+0000","last_change":"2023-08-17T17:35:10.375780+0000","last_active":"2023-08-17T17:35:10.383630+0000","last_peered":"2023-08-17T17:35:10.383630+0000","last_clean":"2023-08-17T17:35:10.383630+0000","last_became_active":"2023-08-17T17:35:10.375317+0000","last_became_peered":"2023-08-17T17:35:10.375317+0000","last_unstale":"2023-08-17T17:35:10.383630+0000","last_undegraded":"2023-08-17T17:35:10.383630+0000","last_fullsized":"2023-08-17T17:35:10.383630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737643+0000","last_change":"2023-08-17T17:35:10.737643+0000","last_active":"2023-08-17T17:35:10.737643+0000","last_peered":"2023-08-17T17:35:10.737643+0000","last_clean":"2023-08-17T17:35:10.737643+0000","last_became_active":"2023-08-17T17:35:10.737365+0000","last_became_peered":"2023-08-17T17:35:10.737365+0000","last_unstale":"2023-08-17T17:35:10.737643+0000","last_undegraded":"2023-08-17T17:35:10.737643+0000","last_fullsized":"2023-08-17T17:35:10.737643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.746783+0000","last_change":"2023-08-17T17:35:10.372071+0000","last_active":"2023-08-17T17:35:10.746783+0000","last_peered":"2023-08-17T17:35:10.746783+0000","last_clean":"2023-08-17T17:35:10.746783+0000","last_became_active":"2023-08-17T17:35:10.371779+0000","last_became_peered":"2023-08-17T17:35:10.371779+0000","last_unstale":"2023-08-17T17:35:10.746783+0000","last_undegraded":"2023-08-17T17:35:10.746783+0000","last_fullsized":"2023-08-17T17:35:10.746783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.739979+0000","last_change":"2023-08-17T17:35:10.739979+0000","last_active":"2023-08-17T17:35:10.739979+0000","last_peered":"2023-08-17T17:35:10.739979+0000","last_clean":"2023-08-17T17:35:10.739979+0000","last_became_active":"2023-08-17T17:35:10.739711+0000","last_became_peered":"2023-08-17T17:35:10.739711+0000","last_unstale":"2023-08-17T17:35:10.739979+0000","last_undegraded":"2023-08-17T17:35:10.739979+0000","last_fullsized":"2023-08-17T17:35:10.739979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.731100+0000","last_change":"2023-08-17T17:35:10.380313+0000","last_active":"2023-08-17T17:35:10.731100+0000","last_peered":"2023-08-17T17:35:10.731100+0000","last_clean":"2023-08-17T17:35:10.731100+0000","last_became_active":"2023-08-17T17:35:10.379947+0000","last_became_peered":"2023-08-17T17:35:10.379947+0000","last_unstale":"2023-08-17T17:35:10.731100+0000","last_undegraded":"2023-08-17T17:35:10.731100+0000","last_fullsized":"2023-08-17T17:35:10.731100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747853+0000","last_change":"2023-08-17T17:35:10.747853+0000","last_active":"2023-08-17T17:35:10.747853+0000","last_peered":"2023-08-17T17:35:10.747853+0000","last_clean":"2023-08-17T17:35:10.747853+0000","last_became_active":"2023-08-17T17:35:10.744648+0000","last_became_peered":"2023-08-17T17:35:10.744648+0000","last_unstale":"2023-08-17T17:35:10.747853+0000","last_undegraded":"2023-08-17T17:35:10.747853+0000","last_fullsized":"2023-08-17T17:35:10.747853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.725838+0000","last_change":"2023-08-17T17:35:10.376635+0000","last_active":"2023-08-17T17:35:10.725838+0000","last_peered":"2023-08-17T17:35:10.725838+0000","last_clean":"2023-08-17T17:35:10.725838+0000","last_became_active":"2023-08-17T17:35:10.376362+0000","last_became_peered":"2023-08-17T17:35:10.376362+0000","last_unstale":"2023-08-17T17:35:10.725838+0000","last_undegraded":"2023-08-17T17:35:10.725838+0000","last_fullsized":"2023-08-17T17:35:10.725838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737720+0000","last_change":"2023-08-17T17:35:10.737720+0000","last_active":"2023-08-17T17:35:10.737720+0000","last_peered":"2023-08-17T17:35:10.737720+0000","last_clean":"2023-08-17T17:35:10.737720+0000","last_became_active":"2023-08-17T17:35:10.737307+0000","last_became_peered":"2023-08-17T17:35:10.737307+0000","last_unstale":"2023-08-17T17:35:10.737720+0000","last_undegraded":"2023-08-17T17:35:10.737720+0000","last_fullsized":"2023-08-17T17:35:10.737720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.389192+0000","last_change":"2023-08-17T17:35:10.384453+0000","last_active":"2023-08-17T17:35:10.389192+0000","last_peered":"2023-08-17T17:35:10.389192+0000","last_clean":"2023-08-17T17:35:10.389192+0000","last_became_active":"2023-08-17T17:35:10.384236+0000","last_became_peered":"2023-08-17T17:35:10.384236+0000","last_unstale":"2023-08-17T17:35:10.389192+0000","last_undegraded":"2023-08-17T17:35:10.389192+0000","last_fullsized":"2023-08-17T17:35:10.389192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.734965+0000","last_change":"2023-08-17T17:35:10.734965+0000","last_active":"2023-08-17T17:35:10.734965+0000","last_peered":"2023-08-17T17:35:10.734965+0000","last_clean":"2023-08-17T17:35:10.734965+0000","last_became_active":"2023-08-17T17:35:10.734707+0000","last_became_peered":"2023-08-17T17:35:10.734707+0000","last_unstale":"2023-08-17T17:35:10.734965+0000","last_undegraded":"2023-08-17T17:35:10.734965+0000","last_fullsized":"2023-08-17T17:35:10.734965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.386450+0000","last_change":"2023-08-17T17:35:10.380822+0000","last_active":"2023-08-17T17:35:10.386450+0000","last_peered":"2023-08-17T17:35:10.386450+0000","last_clean":"2023-08-17T17:35:10.386450+0000","last_became_active":"2023-08-17T17:35:10.380321+0000","last_became_peered":"2023-08-17T17:35:10.380321+0000","last_unstale":"2023-08-17T17:35:10.386450+0000","last_undegraded":"2023-08-17T17:35:10.386450+0000","last_fullsized":"2023-08-17T17:35:10.386450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743650+0000","last_change":"2023-08-17T17:35:10.743650+0000","last_active":"2023-08-17T17:35:10.743650+0000","last_peered":"2023-08-17T17:35:10.743650+0000","last_clean":"2023-08-17T17:35:10.743650+0000","last_became_active":"2023-08-17T17:35:10.743160+0000","last_became_peered":"2023-08-17T17:35:10.743160+0000","last_unstale":"2023-08-17T17:35:10.743650+0000","last_undegraded":"2023-08-17T17:35:10.743650+0000","last_fullsized":"2023-08-17T17:35:10.743650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383776+0000","last_change":"2023-08-17T17:35:10.375599+0000","last_active":"2023-08-17T17:35:10.383776+0000","last_peered":"2023-08-17T17:35:10.383776+0000","last_clean":"2023-08-17T17:35:10.383776+0000","last_became_active":"2023-08-17T17:35:10.375304+0000","last_became_peered":"2023-08-17T17:35:10.375304+0000","last_unstale":"2023-08-17T17:35:10.383776+0000","last_undegraded":"2023-08-17T17:35:10.383776+0000","last_fullsized":"2023-08-17T17:35:10.383776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737049+0000","last_change":"2023-08-17T17:35:10.737049+0000","last_active":"2023-08-17T17:35:10.737049+0000","last_peered":"2023-08-17T17:35:10.737049+0000","last_clean":"2023-08-17T17:35:10.737049+0000","last_became_active":"2023-08-17T17:35:10.736744+0000","last_became_peered":"2023-08-17T17:35:10.736744+0000","last_unstale":"2023-08-17T17:35:10.737049+0000","last_undegraded":"2023-08-17T17:35:10.737049+0000","last_fullsized":"2023-08-17T17:35:10.737049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.385355+0000","last_change":"2023-08-17T17:35:10.384082+0000","last_active":"2023-08-17T17:35:10.385355+0000","last_peered":"2023-08-17T17:35:10.385355+0000","last_clean":"2023-08-17T17:35:10.385355+0000","last_became_active":"2023-08-17T17:35:10.383615+0000","last_became_peered":"2023-08-17T17:35:10.383615+0000","last_unstale":"2023-08-17T17:35:10.385355+0000","last_undegraded":"2023-08-17T17:35:10.385355+0000","last_fullsized":"2023-08-17T17:35:10.385355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745702+0000","last_change":"2023-08-17T17:35:10.745702+0000","last_active":"2023-08-17T17:35:10.745702+0000","last_peered":"2023-08-17T17:35:10.745702+0000","last_clean":"2023-08-17T17:35:10.745702+0000","last_became_active":"2023-08-17T17:35:10.745418+0000","last_became_peered":"2023-08-17T17:35:10.745418+0000","last_unstale":"2023-08-17T17:35:10.745702+0000","last_undegraded":"2023-08-17T17:35:10.745702+0000","last_fullsized":"2023-08-17T17:35:10.745702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.378763+0000","last_change":"2023-08-17T17:35:10.377373+0000","last_active":"2023-08-17T17:35:10.378763+0000","last_peered":"2023-08-17T17:35:10.378763+0000","last_clean":"2023-08-17T17:35:10.378763+0000","last_became_active":"2023-08-17T17:35:10.377071+0000","last_became_peered":"2023-08-17T17:35:10.377071+0000","last_unstale":"2023-08-17T17:35:10.378763+0000","last_undegraded":"2023-08-17T17:35:10.378763+0000","last_fullsized":"2023-08-17T17:35:10.378763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.738284+0000","last_change":"2023-08-17T17:35:10.738284+0000","last_active":"2023-08-17T17:35:10.738284+0000","last_peered":"2023-08-17T17:35:10.738284+0000","last_clean":"2023-08-17T17:35:10.738284+0000","last_became_active":"2023-08-17T17:35:10.737914+0000","last_became_peered":"2023-08-17T17:35:10.737914+0000","last_unstale":"2023-08-17T17:35:10.738284+0000","last_undegraded":"2023-08-17T17:35:10.738284+0000","last_fullsized":"2023-08-17T17:35:10.738284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.751874+0000","last_change":"2023-08-17T17:35:10.380152+0000","last_active":"2023-08-17T17:35:10.751874+0000","last_peered":"2023-08-17T17:35:10.751874+0000","last_clean":"2023-08-17T17:35:10.751874+0000","last_became_active":"2023-08-17T17:35:10.379831+0000","last_became_peered":"2023-08-17T17:35:10.379831+0000","last_unstale":"2023-08-17T17:35:10.751874+0000","last_undegraded":"2023-08-17T17:35:10.751874+0000","last_fullsized":"2023-08-17T17:35:10.751874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749280+0000","last_change":"2023-08-17T17:35:10.749280+0000","last_active":"2023-08-17T17:35:10.749280+0000","last_peered":"2023-08-17T17:35:10.749280+0000","last_clean":"2023-08-17T17:35:10.749280+0000","last_became_active":"2023-08-17T17:35:10.748989+0000","last_became_peered":"2023-08-17T17:35:10.748989+0000","last_unstale":"2023-08-17T17:35:10.749280+0000","last_undegraded":"2023-08-17T17:35:10.749280+0000","last_fullsized":"2023-08-17T17:35:10.749280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.731215+0000","last_change":"2023-08-17T17:35:10.380231+0000","last_active":"2023-08-17T17:35:10.731215+0000","last_peered":"2023-08-17T17:35:10.731215+0000","last_clean":"2023-08-17T17:35:10.731215+0000","last_became_active":"2023-08-17T17:35:10.379640+0000","last_became_peered":"2023-08-17T17:35:10.379640+0000","last_unstale":"2023-08-17T17:35:10.731215+0000","last_undegraded":"2023-08-17T17:35:10.731215+0000","last_fullsized":"2023-08-17T17:35:10.731215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.741506+0000","last_change":"2023-08-17T17:35:10.741506+0000","last_active":"2023-08-17T17:35:10.741506+0000","last_peered":"2023-08-17T17:35:10.741506+0000","last_clean":"2023-08-17T17:35:10.741506+0000","last_became_active":"2023-08-17T17:35:10.741196+0000","last_became_peered":"2023-08-17T17:35:10.741196+0000","last_unstale":"2023-08-17T17:35:10.741506+0000","last_undegraded":"2023-08-17T17:35:10.741506+0000","last_fullsized":"2023-08-17T17:35:10.741506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.379182+0000","last_change":"2023-08-17T17:35:10.372914+0000","last_active":"2023-08-17T17:35:10.379182+0000","last_peered":"2023-08-17T17:35:10.379182+0000","last_clean":"2023-08-17T17:35:10.379182+0000","last_became_active":"2023-08-17T17:35:10.372662+0000","last_became_peered":"2023-08-17T17:35:10.372662+0000","last_unstale":"2023-08-17T17:35:10.379182+0000","last_undegraded":"2023-08-17T17:35:10.379182+0000","last_fullsized":"2023-08-17T17:35:10.379182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743686+0000","last_change":"2023-08-17T17:35:10.743686+0000","last_active":"2023-08-17T17:35:10.743686+0000","last_peered":"2023-08-17T17:35:10.743686+0000","last_clean":"2023-08-17T17:35:10.743686+0000","last_became_active":"2023-08-17T17:35:10.743405+0000","last_became_peered":"2023-08-17T17:35:10.743405+0000","last_unstale":"2023-08-17T17:35:10.743686+0000","last_undegraded":"2023-08-17T17:35:10.743686+0000","last_fullsized":"2023-08-17T17:35:10.743686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383619+0000","last_change":"2023-08-17T17:35:10.376359+0000","last_active":"2023-08-17T17:35:10.383619+0000","last_peered":"2023-08-17T17:35:10.383619+0000","last_clean":"2023-08-17T17:35:10.383619+0000","last_became_active":"2023-08-17T17:35:10.376074+0000","last_became_peered":"2023-08-17T17:35:10.376074+0000","last_unstale":"2023-08-17T17:35:10.383619+0000","last_undegraded":"2023-08-17T17:35:10.383619+0000","last_fullsized":"2023-08-17T17:35:10.383619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745765+0000","last_change":"2023-08-17T17:35:10.745765+0000","last_active":"2023-08-17T17:35:10.745765+0000","last_peered":"2023-08-17T17:35:10.745765+0000","last_clean":"2023-08-17T17:35:10.745765+0000","last_became_active":"2023-08-17T17:35:10.745465+0000","last_became_peered":"2023-08-17T17:35:10.745465+0000","last_unstale":"2023-08-17T17:35:10.745765+0000","last_undegraded":"2023-08-17T17:35:10.745765+0000","last_fullsized":"2023-08-17T17:35:10.745765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.751965+0000","last_change":"2023-08-17T17:35:10.380829+0000","last_active":"2023-08-17T17:35:10.751965+0000","last_peered":"2023-08-17T17:35:10.751965+0000","last_clean":"2023-08-17T17:35:10.751965+0000","last_became_active":"2023-08-17T17:35:10.380593+0000","last_became_peered":"2023-08-17T17:35:10.380593+0000","last_unstale":"2023-08-17T17:35:10.751965+0000","last_undegraded":"2023-08-17T17:35:10.751965+0000","last_fullsized":"2023-08-17T17:35:10.751965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743335+0000","last_change":"2023-08-17T17:35:10.743335+0000","last_active":"2023-08-17T17:35:10.743335+0000","last_peered":"2023-08-17T17:35:10.743335+0000","last_clean":"2023-08-17T17:35:10.743335+0000","last_became_active":"2023-08-17T17:35:10.743028+0000","last_became_peered":"2023-08-17T17:35:10.743028+0000","last_unstale":"2023-08-17T17:35:10.743335+0000","last_undegraded":"2023-08-17T17:35:10.743335+0000","last_fullsized":"2023-08-17T17:35:10.743335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.389216+0000","last_change":"2023-08-17T17:35:10.385061+0000","last_active":"2023-08-17T17:35:10.389216+0000","last_peered":"2023-08-17T17:35:10.389216+0000","last_clean":"2023-08-17T17:35:10.389216+0000","last_became_active":"2023-08-17T17:35:10.384772+0000","last_became_peered":"2023-08-17T17:35:10.384772+0000","last_unstale":"2023-08-17T17:35:10.389216+0000","last_undegraded":"2023-08-17T17:35:10.389216+0000","last_fullsized":"2023-08-17T17:35:10.389216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743287+0000","last_change":"2023-08-17T17:35:10.743287+0000","last_active":"2023-08-17T17:35:10.743287+0000","last_peered":"2023-08-17T17:35:10.743287+0000","last_clean":"2023-08-17T17:35:10.743287+0000","last_became_active":"2023-08-17T17:35:10.743032+0000","last_became_peered":"2023-08-17T17:35:10.743032+0000","last_unstale":"2023-08-17T17:35:10.743287+0000","last_undegraded":"2023-08-17T17:35:10.743287+0000","last_fullsized":"2023-08-17T17:35:10.743287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.384402+0000","last_change":"2023-08-17T17:35:10.383277+0000","last_active":"2023-08-17T17:35:10.384402+0000","last_peered":"2023-08-17T17:35:10.384402+0000","last_clean":"2023-08-17T17:35:10.384402+0000","last_became_active":"2023-08-17T17:35:10.383015+0000","last_became_peered":"2023-08-17T17:35:10.383015+0000","last_unstale":"2023-08-17T17:35:10.384402+0000","last_undegraded":"2023-08-17T17:35:10.384402+0000","last_fullsized":"2023-08-17T17:35:10.384402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.742412+0000","last_change":"2023-08-17T17:35:10.742412+0000","last_active":"2023-08-17T17:35:10.742412+0000","last_peered":"2023-08-17T17:35:10.742412+0000","last_clean":"2023-08-17T17:35:10.742412+0000","last_became_active":"2023-08-17T17:35:10.742132+0000","last_became_peered":"2023-08-17T17:35:10.742132+0000","last_unstale":"2023-08-17T17:35:10.742412+0000","last_undegraded":"2023-08-17T17:35:10.742412+0000","last_fullsized":"2023-08-17T17:35:10.742412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.726029+0000","last_change":"2023-08-17T17:35:10.379052+0000","last_active":"2023-08-17T17:35:10.726029+0000","last_peered":"2023-08-17T17:35:10.726029+0000","last_clean":"2023-08-17T17:35:10.726029+0000","last_became_active":"2023-08-17T17:35:10.378760+0000","last_became_peered":"2023-08-17T17:35:10.378760+0000","last_unstale":"2023-08-17T17:35:10.726029+0000","last_undegraded":"2023-08-17T17:35:10.726029+0000","last_fullsized":"2023-08-17T17:35:10.726029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.751290+0000","last_change":"2023-08-17T17:35:10.751290+0000","last_active":"2023-08-17T17:35:10.751290+0000","last_peered":"2023-08-17T17:35:10.751290+0000","last_clean":"2023-08-17T17:35:10.751290+0000","last_became_active":"2023-08-17T17:35:10.751014+0000","last_became_peered":"2023-08-17T17:35:10.751014+0000","last_unstale":"2023-08-17T17:35:10.751290+0000","last_undegraded":"2023-08-17T17:35:10.751290+0000","last_fullsized":"2023-08-17T17:35:10.751290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.374436+0000","last_change":"2023-08-17T17:35:10.369167+0000","last_active":"2023-08-17T17:35:10.374436+0000","last_peered":"2023-08-17T17:35:10.374436+0000","last_clean":"2023-08-17T17:35:10.374436+0000","last_became_active":"2023-08-17T17:35:10.368885+0000","last_became_peered":"2023-08-17T17:35:10.368885+0000","last_unstale":"2023-08-17T17:35:10.374436+0000","last_undegraded":"2023-08-17T17:35:10.374436+0000","last_fullsized":"2023-08-17T17:35:10.374436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.751236+0000","last_change":"2023-08-17T17:35:10.751236+0000","last_active":"2023-08-17T17:35:10.751236+0000","last_peered":"2023-08-17T17:35:10.751236+0000","last_clean":"2023-08-17T17:35:10.751236+0000","last_became_active":"2023-08-17T17:35:10.750811+0000","last_became_peered":"2023-08-17T17:35:10.750811+0000","last_unstale":"2023-08-17T17:35:10.751236+0000","last_undegraded":"2023-08-17T17:35:10.751236+0000","last_fullsized":"2023-08-17T17:35:10.751236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.728433+0000","last_change":"2023-08-17T17:35:10.367846+0000","last_active":"2023-08-17T17:35:10.728433+0000","last_peered":"2023-08-17T17:35:10.728433+0000","last_clean":"2023-08-17T17:35:10.728433+0000","last_became_active":"2023-08-17T17:35:10.367554+0000","last_became_peered":"2023-08-17T17:35:10.367554+0000","last_unstale":"2023-08-17T17:35:10.728433+0000","last_undegraded":"2023-08-17T17:35:10.728433+0000","last_fullsized":"2023-08-17T17:35:10.728433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747685+0000","last_change":"2023-08-17T17:35:10.747685+0000","last_active":"2023-08-17T17:35:10.747685+0000","last_peered":"2023-08-17T17:35:10.747685+0000","last_clean":"2023-08-17T17:35:10.747685+0000","last_became_active":"2023-08-17T17:35:10.747194+0000","last_became_peered":"2023-08-17T17:35:10.747194+0000","last_unstale":"2023-08-17T17:35:10.747685+0000","last_undegraded":"2023-08-17T17:35:10.747685+0000","last_fullsized":"2023-08-17T17:35:10.747685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.384074+0000","last_change":"2023-08-17T17:35:10.380688+0000","last_active":"2023-08-17T17:35:10.384074+0000","last_peered":"2023-08-17T17:35:10.384074+0000","last_clean":"2023-08-17T17:35:10.384074+0000","last_became_active":"2023-08-17T17:35:10.380198+0000","last_became_peered":"2023-08-17T17:35:10.380198+0000","last_unstale":"2023-08-17T17:35:10.384074+0000","last_undegraded":"2023-08-17T17:35:10.384074+0000","last_fullsized":"2023-08-17T17:35:10.384074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.735853+0000","last_change":"2023-08-17T17:35:10.735853+0000","last_active":"2023-08-17T17:35:10.735853+0000","last_peered":"2023-08-17T17:35:10.735853+0000","last_clean":"2023-08-17T17:35:10.735853+0000","last_became_active":"2023-08-17T17:35:10.734524+0000","last_became_peered":"2023-08-17T17:35:10.734524+0000","last_unstale":"2023-08-17T17:35:10.735853+0000","last_undegraded":"2023-08-17T17:35:10.735853+0000","last_fullsized":"2023-08-17T17:35:10.735853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.376747+0000","last_change":"2023-08-17T17:35:10.375184+0000","last_active":"2023-08-17T17:35:10.376747+0000","last_peered":"2023-08-17T17:35:10.376747+0000","last_clean":"2023-08-17T17:35:10.376747+0000","last_became_active":"2023-08-17T17:35:10.374665+0000","last_became_peered":"2023-08-17T17:35:10.374665+0000","last_unstale":"2023-08-17T17:35:10.376747+0000","last_undegraded":"2023-08-17T17:35:10.376747+0000","last_fullsized":"2023-08-17T17:35:10.376747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737512+0000","last_change":"2023-08-17T17:35:10.737512+0000","last_active":"2023-08-17T17:35:10.737512+0000","last_peered":"2023-08-17T17:35:10.737512+0000","last_clean":"2023-08-17T17:35:10.737512+0000","last_became_active":"2023-08-17T17:35:10.737209+0000","last_became_peered":"2023-08-17T17:35:10.737209+0000","last_unstale":"2023-08-17T17:35:10.737512+0000","last_undegraded":"2023-08-17T17:35:10.737512+0000","last_fullsized":"2023-08-17T17:35:10.737512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.375155+0000","last_change":"2023-08-17T17:35:10.368260+0000","last_active":"2023-08-17T17:35:10.375155+0000","last_peered":"2023-08-17T17:35:10.375155+0000","last_clean":"2023-08-17T17:35:10.375155+0000","last_became_active":"2023-08-17T17:35:10.367893+0000","last_became_peered":"2023-08-17T17:35:10.367893+0000","last_unstale":"2023-08-17T17:35:10.375155+0000","last_undegraded":"2023-08-17T17:35:10.375155+0000","last_fullsized":"2023-08-17T17:35:10.375155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.744583+0000","last_change":"2023-08-17T17:35:10.744583+0000","last_active":"2023-08-17T17:35:10.744583+0000","last_peered":"2023-08-17T17:35:10.744583+0000","last_clean":"2023-08-17T17:35:10.744583+0000","last_became_active":"2023-08-17T17:35:10.744283+0000","last_became_peered":"2023-08-17T17:35:10.744283+0000","last_unstale":"2023-08-17T17:35:10.744583+0000","last_undegraded":"2023-08-17T17:35:10.744583+0000","last_fullsized":"2023-08-17T17:35:10.744583+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.374195+0000","last_change":"2023-08-17T17:35:10.371220+0000","last_active":"2023-08-17T17:35:10.374195+0000","last_peered":"2023-08-17T17:35:10.374195+0000","last_clean":"2023-08-17T17:35:10.374195+0000","last_became_active":"2023-08-17T17:35:10.370934+0000","last_became_peered":"2023-08-17T17:35:10.370934+0000","last_unstale":"2023-08-17T17:35:10.374195+0000","last_undegraded":"2023-08-17T17:35:10.374195+0000","last_fullsized":"2023-08-17T17:35:10.374195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743686+0000","last_change":"2023-08-17T17:35:10.743686+0000","last_active":"2023-08-17T17:35:10.743686+0000","last_peered":"2023-08-17T17:35:10.743686+0000","last_clean":"2023-08-17T17:35:10.743686+0000","last_became_active":"2023-08-17T17:35:10.743419+0000","last_became_peered":"2023-08-17T17:35:10.743419+0000","last_unstale":"2023-08-17T17:35:10.743686+0000","last_undegraded":"2023-08-17T17:35:10.743686+0000","last_fullsized":"2023-08-17T17:35:10.743686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.384386+0000","last_change":"2023-08-17T17:35:10.383209+0000","last_active":"2023-08-17T17:35:10.384386+0000","last_peered":"2023-08-17T17:35:10.384386+0000","last_clean":"2023-08-17T17:35:10.384386+0000","last_became_active":"2023-08-17T17:35:10.382945+0000","last_became_peered":"2023-08-17T17:35:10.382945+0000","last_unstale":"2023-08-17T17:35:10.384386+0000","last_undegraded":"2023-08-17T17:35:10.384386+0000","last_fullsized":"2023-08-17T17:35:10.384386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745199+0000","last_change":"2023-08-17T17:35:10.745199+0000","last_active":"2023-08-17T17:35:10.745199+0000","last_peered":"2023-08-17T17:35:10.745199+0000","last_clean":"2023-08-17T17:35:10.745199+0000","last_became_active":"2023-08-17T17:35:10.744924+0000","last_became_peered":"2023-08-17T17:35:10.744924+0000","last_unstale":"2023-08-17T17:35:10.745199+0000","last_undegraded":"2023-08-17T17:35:10.745199+0000","last_fullsized":"2023-08-17T17:35:10.745199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.376494+0000","last_change":"2023-08-17T17:35:10.374278+0000","last_active":"2023-08-17T17:35:10.376494+0000","last_peered":"2023-08-17T17:35:10.376494+0000","last_clean":"2023-08-17T17:35:10.376494+0000","last_became_active":"2023-08-17T17:35:10.373536+0000","last_became_peered":"2023-08-17T17:35:10.373536+0000","last_unstale":"2023-08-17T17:35:10.376494+0000","last_undegraded":"2023-08-17T17:35:10.376494+0000","last_fullsized":"2023-08-17T17:35:10.376494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747777+0000","last_change":"2023-08-17T17:35:10.747777+0000","last_active":"2023-08-17T17:35:10.747777+0000","last_peered":"2023-08-17T17:35:10.747777+0000","last_clean":"2023-08-17T17:35:10.747777+0000","last_became_active":"2023-08-17T17:35:10.747299+0000","last_became_peered":"2023-08-17T17:35:10.747299+0000","last_unstale":"2023-08-17T17:35:10.747777+0000","last_undegraded":"2023-08-17T17:35:10.747777+0000","last_fullsized":"2023-08-17T17:35:10.747777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.378281+0000","last_change":"2023-08-17T17:35:10.374538+0000","last_active":"2023-08-17T17:35:10.378281+0000","last_peered":"2023-08-17T17:35:10.378281+0000","last_clean":"2023-08-17T17:35:10.378281+0000","last_became_active":"2023-08-17T17:35:10.374182+0000","last_became_peered":"2023-08-17T17:35:10.374182+0000","last_unstale":"2023-08-17T17:35:10.378281+0000","last_undegraded":"2023-08-17T17:35:10.378281+0000","last_fullsized":"2023-08-17T17:35:10.378281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745785+0000","last_change":"2023-08-17T17:35:10.745785+0000","last_active":"2023-08-17T17:35:10.745785+0000","last_peered":"2023-08-17T17:35:10.745785+0000","last_clean":"2023-08-17T17:35:10.745785+0000","last_became_active":"2023-08-17T17:35:10.745628+0000","last_became_peered":"2023-08-17T17:35:10.745628+0000","last_unstale":"2023-08-17T17:35:10.745785+0000","last_undegraded":"2023-08-17T17:35:10.745785+0000","last_fullsized":"2023-08-17T17:35:10.745785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383930+0000","last_change":"2023-08-17T17:35:10.379823+0000","last_active":"2023-08-17T17:35:10.383930+0000","last_peered":"2023-08-17T17:35:10.383930+0000","last_clean":"2023-08-17T17:35:10.383930+0000","last_became_active":"2023-08-17T17:35:10.379554+0000","last_became_peered":"2023-08-17T17:35:10.379554+0000","last_unstale":"2023-08-17T17:35:10.383930+0000","last_undegraded":"2023-08-17T17:35:10.383930+0000","last_fullsized":"2023-08-17T17:35:10.383930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747464+0000","last_change":"2023-08-17T17:35:10.747464+0000","last_active":"2023-08-17T17:35:10.747464+0000","last_peered":"2023-08-17T17:35:10.747464+0000","last_clean":"2023-08-17T17:35:10.747464+0000","last_became_active":"2023-08-17T17:35:10.746828+0000","last_became_peered":"2023-08-17T17:35:10.746828+0000","last_unstale":"2023-08-17T17:35:10.747464+0000","last_undegraded":"2023-08-17T17:35:10.747464+0000","last_fullsized":"2023-08-17T17:35:10.747464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.389212+0000","last_change":"2023-08-17T17:35:10.384999+0000","last_active":"2023-08-17T17:35:10.389212+0000","last_peered":"2023-08-17T17:35:10.389212+0000","last_clean":"2023-08-17T17:35:10.389212+0000","last_became_active":"2023-08-17T17:35:10.384714+0000","last_became_peered":"2023-08-17T17:35:10.384714+0000","last_unstale":"2023-08-17T17:35:10.389212+0000","last_undegraded":"2023-08-17T17:35:10.389212+0000","last_fullsized":"2023-08-17T17:35:10.389212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745123+0000","last_change":"2023-08-17T17:35:10.745123+0000","last_active":"2023-08-17T17:35:10.745123+0000","last_peered":"2023-08-17T17:35:10.745123+0000","last_clean":"2023-08-17T17:35:10.745123+0000","last_became_active":"2023-08-17T17:35:10.744713+0000","last_became_peered":"2023-08-17T17:35:10.744713+0000","last_unstale":"2023-08-17T17:35:10.745123+0000","last_undegraded":"2023-08-17T17:35:10.745123+0000","last_fullsized":"2023-08-17T17:35:10.745123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383848+0000","last_change":"2023-08-17T17:35:10.374166+0000","last_active":"2023-08-17T17:35:10.383848+0000","last_peered":"2023-08-17T17:35:10.383848+0000","last_clean":"2023-08-17T17:35:10.383848+0000","last_became_active":"2023-08-17T17:35:10.373493+0000","last_became_peered":"2023-08-17T17:35:10.373493+0000","last_unstale":"2023-08-17T17:35:10.383848+0000","last_undegraded":"2023-08-17T17:35:10.383848+0000","last_fullsized":"2023-08-17T17:35:10.383848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743182+0000","last_change":"2023-08-17T17:35:10.743182+0000","last_active":"2023-08-17T17:35:10.743182+0000","last_peered":"2023-08-17T17:35:10.743182+0000","last_clean":"2023-08-17T17:35:10.743182+0000","last_became_active":"2023-08-17T17:35:10.742892+0000","last_became_peered":"2023-08-17T17:35:10.742892+0000","last_unstale":"2023-08-17T17:35:10.743182+0000","last_undegraded":"2023-08-17T17:35:10.743182+0000","last_fullsized":"2023-08-17T17:35:10.743182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.378792+0000","last_change":"2023-08-17T17:35:10.376980+0000","last_active":"2023-08-17T17:35:10.378792+0000","last_peered":"2023-08-17T17:35:10.378792+0000","last_clean":"2023-08-17T17:35:10.378792+0000","last_became_active":"2023-08-17T17:35:10.376469+0000","last_became_peered":"2023-08-17T17:35:10.376469+0000","last_unstale":"2023-08-17T17:35:10.378792+0000","last_undegraded":"2023-08-17T17:35:10.378792+0000","last_fullsized":"2023-08-17T17:35:10.378792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749608+0000","last_change":"2023-08-17T17:35:10.749608+0000","last_active":"2023-08-17T17:35:10.749608+0000","last_peered":"2023-08-17T17:35:10.749608+0000","last_clean":"2023-08-17T17:35:10.749608+0000","last_became_active":"2023-08-17T17:35:10.749343+0000","last_became_peered":"2023-08-17T17:35:10.749343+0000","last_unstale":"2023-08-17T17:35:10.749608+0000","last_undegraded":"2023-08-17T17:35:10.749608+0000","last_fullsized":"2023-08-17T17:35:10.749608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.736856+0000","last_change":"2023-08-17T17:35:10.378692+0000","last_active":"2023-08-17T17:35:10.736856+0000","last_peered":"2023-08-17T17:35:10.736856+0000","last_clean":"2023-08-17T17:35:10.736856+0000","last_became_active":"2023-08-17T17:35:10.376508+0000","last_became_peered":"2023-08-17T17:35:10.376508+0000","last_unstale":"2023-08-17T17:35:10.736856+0000","last_undegraded":"2023-08-17T17:35:10.736856+0000","last_fullsized":"2023-08-17T17:35:10.736856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747990+0000","last_change":"2023-08-17T17:35:10.747990+0000","last_active":"2023-08-17T17:35:10.747990+0000","last_peered":"2023-08-17T17:35:10.747990+0000","last_clean":"2023-08-17T17:35:10.747990+0000","last_became_active":"2023-08-17T17:35:10.746294+0000","last_became_peered":"2023-08-17T17:35:10.746294+0000","last_unstale":"2023-08-17T17:35:10.747990+0000","last_undegraded":"2023-08-17T17:35:10.747990+0000","last_fullsized":"2023-08-17T17:35:10.747990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.728406+0000","last_change":"2023-08-17T17:35:10.371856+0000","last_active":"2023-08-17T17:35:10.728406+0000","last_peered":"2023-08-17T17:35:10.728406+0000","last_clean":"2023-08-17T17:35:10.728406+0000","last_became_active":"2023-08-17T17:35:10.371565+0000","last_became_peered":"2023-08-17T17:35:10.371565+0000","last_unstale":"2023-08-17T17:35:10.728406+0000","last_undegraded":"2023-08-17T17:35:10.728406+0000","last_fullsized":"2023-08-17T17:35:10.728406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.744619+0000","last_change":"2023-08-17T17:35:10.744619+0000","last_active":"2023-08-17T17:35:10.744619+0000","last_peered":"2023-08-17T17:35:10.744619+0000","last_clean":"2023-08-17T17:35:10.744619+0000","last_became_active":"2023-08-17T17:35:10.744357+0000","last_became_peered":"2023-08-17T17:35:10.744357+0000","last_unstale":"2023-08-17T17:35:10.744619+0000","last_undegraded":"2023-08-17T17:35:10.744619+0000","last_fullsized":"2023-08-17T17:35:10.744619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747571+0000","last_change":"2023-08-17T17:35:10.371553+0000","last_active":"2023-08-17T17:35:10.747571+0000","last_peered":"2023-08-17T17:35:10.747571+0000","last_clean":"2023-08-17T17:35:10.747571+0000","last_became_active":"2023-08-17T17:35:10.371382+0000","last_became_peered":"2023-08-17T17:35:10.371382+0000","last_unstale":"2023-08-17T17:35:10.747571+0000","last_undegraded":"2023-08-17T17:35:10.747571+0000","last_fullsized":"2023-08-17T17:35:10.747571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745369+0000","last_change":"2023-08-17T17:35:10.745369+0000","last_active":"2023-08-17T17:35:10.745369+0000","last_peered":"2023-08-17T17:35:10.745369+0000","last_clean":"2023-08-17T17:35:10.745369+0000","last_became_active":"2023-08-17T17:35:10.745081+0000","last_became_peered":"2023-08-17T17:35:10.745081+0000","last_unstale":"2023-08-17T17:35:10.745369+0000","last_undegraded":"2023-08-17T17:35:10.745369+0000","last_fullsized":"2023-08-17T17:35:10.745369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383967+0000","last_change":"2023-08-17T17:35:10.379916+0000","last_active":"2023-08-17T17:35:10.383967+0000","last_peered":"2023-08-17T17:35:10.383967+0000","last_clean":"2023-08-17T17:35:10.383967+0000","last_became_active":"2023-08-17T17:35:10.379627+0000","last_became_peered":"2023-08-17T17:35:10.379627+0000","last_unstale":"2023-08-17T17:35:10.383967+0000","last_undegraded":"2023-08-17T17:35:10.383967+0000","last_fullsized":"2023-08-17T17:35:10.383967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.741491+0000","last_change":"2023-08-17T17:35:10.741491+0000","last_active":"2023-08-17T17:35:10.741491+0000","last_peered":"2023-08-17T17:35:10.741491+0000","last_clean":"2023-08-17T17:35:10.741491+0000","last_became_active":"2023-08-17T17:35:10.741211+0000","last_became_peered":"2023-08-17T17:35:10.741211+0000","last_unstale":"2023-08-17T17:35:10.741491+0000","last_undegraded":"2023-08-17T17:35:10.741491+0000","last_fullsized":"2023-08-17T17:35:10.741491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.378365+0000","last_change":"2023-08-17T17:35:10.375359+0000","last_active":"2023-08-17T17:35:10.378365+0000","last_peered":"2023-08-17T17:35:10.378365+0000","last_clean":"2023-08-17T17:35:10.378365+0000","last_became_active":"2023-08-17T17:35:10.375066+0000","last_became_peered":"2023-08-17T17:35:10.375066+0000","last_unstale":"2023-08-17T17:35:10.378365+0000","last_undegraded":"2023-08-17T17:35:10.378365+0000","last_fullsized":"2023-08-17T17:35:10.378365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.736733+0000","last_change":"2023-08-17T17:35:10.736733+0000","last_active":"2023-08-17T17:35:10.736733+0000","last_peered":"2023-08-17T17:35:10.736733+0000","last_clean":"2023-08-17T17:35:10.736733+0000","last_became_active":"2023-08-17T17:35:10.736406+0000","last_became_peered":"2023-08-17T17:35:10.736406+0000","last_unstale":"2023-08-17T17:35:10.736733+0000","last_undegraded":"2023-08-17T17:35:10.736733+0000","last_fullsized":"2023-08-17T17:35:10.736733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.386551+0000","last_change":"2023-08-17T17:35:10.381786+0000","last_active":"2023-08-17T17:35:10.386551+0000","last_peered":"2023-08-17T17:35:10.386551+0000","last_clean":"2023-08-17T17:35:10.386551+0000","last_became_active":"2023-08-17T17:35:10.381454+0000","last_became_peered":"2023-08-17T17:35:10.381454+0000","last_unstale":"2023-08-17T17:35:10.386551+0000","last_undegraded":"2023-08-17T17:35:10.386551+0000","last_fullsized":"2023-08-17T17:35:10.386551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.739405+0000","last_change":"2023-08-17T17:35:10.739405+0000","last_active":"2023-08-17T17:35:10.739405+0000","last_peered":"2023-08-17T17:35:10.739405+0000","last_clean":"2023-08-17T17:35:10.739405+0000","last_became_active":"2023-08-17T17:35:10.739137+0000","last_became_peered":"2023-08-17T17:35:10.739137+0000","last_unstale":"2023-08-17T17:35:10.739405+0000","last_undegraded":"2023-08-17T17:35:10.739405+0000","last_fullsized":"2023-08-17T17:35:10.739405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.373698+0000","last_change":"2023-08-17T17:35:10.370127+0000","last_active":"2023-08-17T17:35:10.373698+0000","last_peered":"2023-08-17T17:35:10.373698+0000","last_clean":"2023-08-17T17:35:10.373698+0000","last_became_active":"2023-08-17T17:35:10.369844+0000","last_became_peered":"2023-08-17T17:35:10.369844+0000","last_unstale":"2023-08-17T17:35:10.373698+0000","last_undegraded":"2023-08-17T17:35:10.373698+0000","last_fullsized":"2023-08-17T17:35:10.373698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.744334+0000","last_change":"2023-08-17T17:35:10.744334+0000","last_active":"2023-08-17T17:35:10.744334+0000","last_peered":"2023-08-17T17:35:10.744334+0000","last_clean":"2023-08-17T17:35:10.744334+0000","last_became_active":"2023-08-17T17:35:10.744031+0000","last_became_peered":"2023-08-17T17:35:10.744031+0000","last_unstale":"2023-08-17T17:35:10.744334+0000","last_undegraded":"2023-08-17T17:35:10.744334+0000","last_fullsized":"2023-08-17T17:35:10.744334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.381012+0000","last_change":"2023-08-17T17:35:10.373943+0000","last_active":"2023-08-17T17:35:10.381012+0000","last_peered":"2023-08-17T17:35:10.381012+0000","last_clean":"2023-08-17T17:35:10.381012+0000","last_became_active":"2023-08-17T17:35:10.373598+0000","last_became_peered":"2023-08-17T17:35:10.373598+0000","last_unstale":"2023-08-17T17:35:10.381012+0000","last_undegraded":"2023-08-17T17:35:10.381012+0000","last_fullsized":"2023-08-17T17:35:10.381012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.736926+0000","last_change":"2023-08-17T17:35:10.736926+0000","last_active":"2023-08-17T17:35:10.736926+0000","last_peered":"2023-08-17T17:35:10.736926+0000","last_clean":"2023-08-17T17:35:10.736926+0000","last_became_active":"2023-08-17T17:35:10.736631+0000","last_became_peered":"2023-08-17T17:35:10.736631+0000","last_unstale":"2023-08-17T17:35:10.736926+0000","last_undegraded":"2023-08-17T17:35:10.736926+0000","last_fullsized":"2023-08-17T17:35:10.736926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.381068+0000","last_change":"2023-08-17T17:35:10.379316+0000","last_active":"2023-08-17T17:35:10.381068+0000","last_peered":"2023-08-17T17:35:10.381068+0000","last_clean":"2023-08-17T17:35:10.381068+0000","last_became_active":"2023-08-17T17:35:10.379099+0000","last_became_peered":"2023-08-17T17:35:10.379099+0000","last_unstale":"2023-08-17T17:35:10.381068+0000","last_undegraded":"2023-08-17T17:35:10.381068+0000","last_fullsized":"2023-08-17T17:35:10.381068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.745762+0000","last_change":"2023-08-17T17:35:10.745762+0000","last_active":"2023-08-17T17:35:10.745762+0000","last_peered":"2023-08-17T17:35:10.745762+0000","last_clean":"2023-08-17T17:35:10.745762+0000","last_became_active":"2023-08-17T17:35:10.744888+0000","last_became_peered":"2023-08-17T17:35:10.744888+0000","last_unstale":"2023-08-17T17:35:10.745762+0000","last_undegraded":"2023-08-17T17:35:10.745762+0000","last_fullsized":"2023-08-17T17:35:10.745762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.386365+0000","last_change":"2023-08-17T17:35:10.379159+0000","last_active":"2023-08-17T17:35:10.386365+0000","last_peered":"2023-08-17T17:35:10.386365+0000","last_clean":"2023-08-17T17:35:10.386365+0000","last_became_active":"2023-08-17T17:35:10.378849+0000","last_became_peered":"2023-08-17T17:35:10.378849+0000","last_unstale":"2023-08-17T17:35:10.386365+0000","last_undegraded":"2023-08-17T17:35:10.386365+0000","last_fullsized":"2023-08-17T17:35:10.386365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.744140+0000","last_change":"2023-08-17T17:35:10.744140+0000","last_active":"2023-08-17T17:35:10.744140+0000","last_peered":"2023-08-17T17:35:10.744140+0000","last_clean":"2023-08-17T17:35:10.744140+0000","last_became_active":"2023-08-17T17:35:10.743751+0000","last_became_peered":"2023-08-17T17:35:10.743751+0000","last_unstale":"2023-08-17T17:35:10.744140+0000","last_undegraded":"2023-08-17T17:35:10.744140+0000","last_fullsized":"2023-08-17T17:35:10.744140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.750903+0000","last_change":"2023-08-17T17:35:10.375604+0000","last_active":"2023-08-17T17:35:10.750903+0000","last_peered":"2023-08-17T17:35:10.750903+0000","last_clean":"2023-08-17T17:35:10.750903+0000","last_became_active":"2023-08-17T17:35:10.374935+0000","last_became_peered":"2023-08-17T17:35:10.374935+0000","last_unstale":"2023-08-17T17:35:10.750903+0000","last_undegraded":"2023-08-17T17:35:10.750903+0000","last_fullsized":"2023-08-17T17:35:10.750903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.735553+0000","last_change":"2023-08-17T17:35:10.735553+0000","last_active":"2023-08-17T17:35:10.735553+0000","last_peered":"2023-08-17T17:35:10.735553+0000","last_clean":"2023-08-17T17:35:10.735553+0000","last_became_active":"2023-08-17T17:35:10.735191+0000","last_became_peered":"2023-08-17T17:35:10.735191+0000","last_unstale":"2023-08-17T17:35:10.735553+0000","last_undegraded":"2023-08-17T17:35:10.735553+0000","last_fullsized":"2023-08-17T17:35:10.735553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.743988+0000","last_change":"2023-08-17T17:35:10.374920+0000","last_active":"2023-08-17T17:35:10.743988+0000","last_peered":"2023-08-17T17:35:10.743988+0000","last_clean":"2023-08-17T17:35:10.743988+0000","last_became_active":"2023-08-17T17:35:10.374692+0000","last_became_peered":"2023-08-17T17:35:10.374692+0000","last_unstale":"2023-08-17T17:35:10.743988+0000","last_undegraded":"2023-08-17T17:35:10.743988+0000","last_fullsized":"2023-08-17T17:35:10.743988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.742100+0000","last_change":"2023-08-17T17:35:10.742100+0000","last_active":"2023-08-17T17:35:10.742100+0000","last_peered":"2023-08-17T17:35:10.742100+0000","last_clean":"2023-08-17T17:35:10.742100+0000","last_became_active":"2023-08-17T17:35:10.741836+0000","last_became_peered":"2023-08-17T17:35:10.741836+0000","last_unstale":"2023-08-17T17:35:10.742100+0000","last_undegraded":"2023-08-17T17:35:10.742100+0000","last_fullsized":"2023-08-17T17:35:10.742100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.726945+0000","last_change":"2023-08-17T17:35:10.379669+0000","last_active":"2023-08-17T17:35:10.726945+0000","last_peered":"2023-08-17T17:35:10.726945+0000","last_clean":"2023-08-17T17:35:10.726945+0000","last_became_active":"2023-08-17T17:35:10.379405+0000","last_became_peered":"2023-08-17T17:35:10.379405+0000","last_unstale":"2023-08-17T17:35:10.726945+0000","last_undegraded":"2023-08-17T17:35:10.726945+0000","last_fullsized":"2023-08-17T17:35:10.726945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737579+0000","last_change":"2023-08-17T17:35:10.737579+0000","last_active":"2023-08-17T17:35:10.737579+0000","last_peered":"2023-08-17T17:35:10.737579+0000","last_clean":"2023-08-17T17:35:10.737579+0000","last_became_active":"2023-08-17T17:35:10.737293+0000","last_became_peered":"2023-08-17T17:35:10.737293+0000","last_unstale":"2023-08-17T17:35:10.737579+0000","last_undegraded":"2023-08-17T17:35:10.737579+0000","last_fullsized":"2023-08-17T17:35:10.737579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.373819+0000","last_change":"2023-08-17T17:35:10.370186+0000","last_active":"2023-08-17T17:35:10.373819+0000","last_peered":"2023-08-17T17:35:10.373819+0000","last_clean":"2023-08-17T17:35:10.373819+0000","last_became_active":"2023-08-17T17:35:10.369907+0000","last_became_peered":"2023-08-17T17:35:10.369907+0000","last_unstale":"2023-08-17T17:35:10.373819+0000","last_undegraded":"2023-08-17T17:35:10.373819+0000","last_fullsized":"2023-08-17T17:35:10.373819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.748178+0000","last_change":"2023-08-17T17:35:10.748178+0000","last_active":"2023-08-17T17:35:10.748178+0000","last_peered":"2023-08-17T17:35:10.748178+0000","last_clean":"2023-08-17T17:35:10.748178+0000","last_became_active":"2023-08-17T17:35:10.745566+0000","last_became_peered":"2023-08-17T17:35:10.745566+0000","last_unstale":"2023-08-17T17:35:10.748178+0000","last_undegraded":"2023-08-17T17:35:10.748178+0000","last_fullsized":"2023-08-17T17:35:10.748178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383867+0000","last_change":"2023-08-17T17:35:10.374354+0000","last_active":"2023-08-17T17:35:10.383867+0000","last_peered":"2023-08-17T17:35:10.383867+0000","last_clean":"2023-08-17T17:35:10.383867+0000","last_became_active":"2023-08-17T17:35:10.373895+0000","last_became_peered":"2023-08-17T17:35:10.373895+0000","last_unstale":"2023-08-17T17:35:10.383867+0000","last_undegraded":"2023-08-17T17:35:10.383867+0000","last_fullsized":"2023-08-17T17:35:10.383867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.738305+0000","last_change":"2023-08-17T17:35:10.738305+0000","last_active":"2023-08-17T17:35:10.738305+0000","last_peered":"2023-08-17T17:35:10.738305+0000","last_clean":"2023-08-17T17:35:10.738305+0000","last_became_active":"2023-08-17T17:35:10.738055+0000","last_became_peered":"2023-08-17T17:35:10.738055+0000","last_unstale":"2023-08-17T17:35:10.738305+0000","last_undegraded":"2023-08-17T17:35:10.738305+0000","last_fullsized":"2023-08-17T17:35:10.738305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.750396+0000","last_change":"2023-08-17T17:35:10.377167+0000","last_active":"2023-08-17T17:35:10.750396+0000","last_peered":"2023-08-17T17:35:10.750396+0000","last_clean":"2023-08-17T17:35:10.750396+0000","last_became_active":"2023-08-17T17:35:10.376853+0000","last_became_peered":"2023-08-17T17:35:10.376853+0000","last_unstale":"2023-08-17T17:35:10.750396+0000","last_undegraded":"2023-08-17T17:35:10.750396+0000","last_fullsized":"2023-08-17T17:35:10.750396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749255+0000","last_change":"2023-08-17T17:35:10.749255+0000","last_active":"2023-08-17T17:35:10.749255+0000","last_peered":"2023-08-17T17:35:10.749255+0000","last_clean":"2023-08-17T17:35:10.749255+0000","last_became_active":"2023-08-17T17:35:10.745106+0000","last_became_peered":"2023-08-17T17:35:10.745106+0000","last_unstale":"2023-08-17T17:35:10.749255+0000","last_undegraded":"2023-08-17T17:35:10.749255+0000","last_fullsized":"2023-08-17T17:35:10.749255+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.730191+0000","last_change":"2023-08-17T17:35:10.371645+0000","last_active":"2023-08-17T17:35:10.730191+0000","last_peered":"2023-08-17T17:35:10.730191+0000","last_clean":"2023-08-17T17:35:10.730191+0000","last_became_active":"2023-08-17T17:35:10.371323+0000","last_became_peered":"2023-08-17T17:35:10.371323+0000","last_unstale":"2023-08-17T17:35:10.730191+0000","last_undegraded":"2023-08-17T17:35:10.730191+0000","last_fullsized":"2023-08-17T17:35:10.730191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.741321+0000","last_change":"2023-08-17T17:35:10.741321+0000","last_active":"2023-08-17T17:35:10.741321+0000","last_peered":"2023-08-17T17:35:10.741321+0000","last_clean":"2023-08-17T17:35:10.741321+0000","last_became_active":"2023-08-17T17:35:10.741025+0000","last_became_peered":"2023-08-17T17:35:10.741025+0000","last_unstale":"2023-08-17T17:35:10.741321+0000","last_undegraded":"2023-08-17T17:35:10.741321+0000","last_fullsized":"2023-08-17T17:35:10.741321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749658+0000","last_change":"2023-08-17T17:35:10.373789+0000","last_active":"2023-08-17T17:35:10.749658+0000","last_peered":"2023-08-17T17:35:10.749658+0000","last_clean":"2023-08-17T17:35:10.749658+0000","last_became_active":"2023-08-17T17:35:10.373492+0000","last_became_peered":"2023-08-17T17:35:10.373492+0000","last_unstale":"2023-08-17T17:35:10.749658+0000","last_undegraded":"2023-08-17T17:35:10.749658+0000","last_fullsized":"2023-08-17T17:35:10.749658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.738008+0000","last_change":"2023-08-17T17:35:10.738008+0000","last_active":"2023-08-17T17:35:10.738008+0000","last_peered":"2023-08-17T17:35:10.738008+0000","last_clean":"2023-08-17T17:35:10.738008+0000","last_became_active":"2023-08-17T17:35:10.737729+0000","last_became_peered":"2023-08-17T17:35:10.737729+0000","last_unstale":"2023-08-17T17:35:10.738008+0000","last_undegraded":"2023-08-17T17:35:10.738008+0000","last_fullsized":"2023-08-17T17:35:10.738008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.375997+0000","last_change":"2023-08-17T17:35:10.373894+0000","last_active":"2023-08-17T17:35:10.375997+0000","last_peered":"2023-08-17T17:35:10.375997+0000","last_clean":"2023-08-17T17:35:10.375997+0000","last_became_active":"2023-08-17T17:35:10.373606+0000","last_became_peered":"2023-08-17T17:35:10.373606+0000","last_unstale":"2023-08-17T17:35:10.375997+0000","last_undegraded":"2023-08-17T17:35:10.375997+0000","last_fullsized":"2023-08-17T17:35:10.375997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.740965+0000","last_change":"2023-08-17T17:35:10.740965+0000","last_active":"2023-08-17T17:35:10.740965+0000","last_peered":"2023-08-17T17:35:10.740965+0000","last_clean":"2023-08-17T17:35:10.740965+0000","last_became_active":"2023-08-17T17:35:10.740510+0000","last_became_peered":"2023-08-17T17:35:10.740510+0000","last_unstale":"2023-08-17T17:35:10.740965+0000","last_undegraded":"2023-08-17T17:35:10.740965+0000","last_fullsized":"2023-08-17T17:35:10.740965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.374298+0000","last_change":"2023-08-17T17:35:10.372043+0000","last_active":"2023-08-17T17:35:10.374298+0000","last_peered":"2023-08-17T17:35:10.374298+0000","last_clean":"2023-08-17T17:35:10.374298+0000","last_became_active":"2023-08-17T17:35:10.371446+0000","last_became_peered":"2023-08-17T17:35:10.371446+0000","last_unstale":"2023-08-17T17:35:10.374298+0000","last_undegraded":"2023-08-17T17:35:10.374298+0000","last_fullsized":"2023-08-17T17:35:10.374298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.748287+0000","last_change":"2023-08-17T17:35:10.748287+0000","last_active":"2023-08-17T17:35:10.748287+0000","last_peered":"2023-08-17T17:35:10.748287+0000","last_clean":"2023-08-17T17:35:10.748287+0000","last_became_active":"2023-08-17T17:35:10.747975+0000","last_became_peered":"2023-08-17T17:35:10.747975+0000","last_unstale":"2023-08-17T17:35:10.748287+0000","last_undegraded":"2023-08-17T17:35:10.748287+0000","last_fullsized":"2023-08-17T17:35:10.748287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.731326+0000","last_change":"2023-08-17T17:35:10.380410+0000","last_active":"2023-08-17T17:35:10.731326+0000","last_peered":"2023-08-17T17:35:10.731326+0000","last_clean":"2023-08-17T17:35:10.731326+0000","last_became_active":"2023-08-17T17:35:10.380045+0000","last_became_peered":"2023-08-17T17:35:10.380045+0000","last_unstale":"2023-08-17T17:35:10.731326+0000","last_undegraded":"2023-08-17T17:35:10.731326+0000","last_fullsized":"2023-08-17T17:35:10.731326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.741673+0000","last_change":"2023-08-17T17:35:10.741673+0000","last_active":"2023-08-17T17:35:10.741673+0000","last_peered":"2023-08-17T17:35:10.741673+0000","last_clean":"2023-08-17T17:35:10.741673+0000","last_became_active":"2023-08-17T17:35:10.741417+0000","last_became_peered":"2023-08-17T17:35:10.741417+0000","last_unstale":"2023-08-17T17:35:10.741673+0000","last_undegraded":"2023-08-17T17:35:10.741673+0000","last_fullsized":"2023-08-17T17:35:10.741673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.376695+0000","last_change":"2023-08-17T17:35:10.375220+0000","last_active":"2023-08-17T17:35:10.376695+0000","last_peered":"2023-08-17T17:35:10.376695+0000","last_clean":"2023-08-17T17:35:10.376695+0000","last_became_active":"2023-08-17T17:35:10.374895+0000","last_became_peered":"2023-08-17T17:35:10.374895+0000","last_unstale":"2023-08-17T17:35:10.376695+0000","last_undegraded":"2023-08-17T17:35:10.376695+0000","last_fullsized":"2023-08-17T17:35:10.376695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.748793+0000","last_change":"2023-08-17T17:35:10.748793+0000","last_active":"2023-08-17T17:35:10.748793+0000","last_peered":"2023-08-17T17:35:10.748793+0000","last_clean":"2023-08-17T17:35:10.748793+0000","last_became_active":"2023-08-17T17:35:10.748500+0000","last_became_peered":"2023-08-17T17:35:10.748500+0000","last_unstale":"2023-08-17T17:35:10.748793+0000","last_undegraded":"2023-08-17T17:35:10.748793+0000","last_fullsized":"2023-08-17T17:35:10.748793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.389173+0000","last_change":"2023-08-17T17:35:10.384385+0000","last_active":"2023-08-17T17:35:10.389173+0000","last_peered":"2023-08-17T17:35:10.389173+0000","last_clean":"2023-08-17T17:35:10.389173+0000","last_became_active":"2023-08-17T17:35:10.384151+0000","last_became_peered":"2023-08-17T17:35:10.384151+0000","last_unstale":"2023-08-17T17:35:10.389173+0000","last_undegraded":"2023-08-17T17:35:10.389173+0000","last_fullsized":"2023-08-17T17:35:10.389173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749571+0000","last_change":"2023-08-17T17:35:10.749571+0000","last_active":"2023-08-17T17:35:10.749571+0000","last_peered":"2023-08-17T17:35:10.749571+0000","last_clean":"2023-08-17T17:35:10.749571+0000","last_became_active":"2023-08-17T17:35:10.749327+0000","last_became_peered":"2023-08-17T17:35:10.749327+0000","last_unstale":"2023-08-17T17:35:10.749571+0000","last_undegraded":"2023-08-17T17:35:10.749571+0000","last_fullsized":"2023-08-17T17:35:10.749571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.381583+0000","last_change":"2023-08-17T17:35:10.379993+0000","last_active":"2023-08-17T17:35:10.381583+0000","last_peered":"2023-08-17T17:35:10.381583+0000","last_clean":"2023-08-17T17:35:10.381583+0000","last_became_active":"2023-08-17T17:35:10.379702+0000","last_became_peered":"2023-08-17T17:35:10.379702+0000","last_unstale":"2023-08-17T17:35:10.381583+0000","last_undegraded":"2023-08-17T17:35:10.381583+0000","last_fullsized":"2023-08-17T17:35:10.381583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.742074+0000","last_change":"2023-08-17T17:35:10.742074+0000","last_active":"2023-08-17T17:35:10.742074+0000","last_peered":"2023-08-17T17:35:10.742074+0000","last_clean":"2023-08-17T17:35:10.742074+0000","last_became_active":"2023-08-17T17:35:10.741799+0000","last_became_peered":"2023-08-17T17:35:10.741799+0000","last_unstale":"2023-08-17T17:35:10.742074+0000","last_undegraded":"2023-08-17T17:35:10.742074+0000","last_fullsized":"2023-08-17T17:35:10.742074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.376859+0000","last_change":"2023-08-17T17:35:10.375952+0000","last_active":"2023-08-17T17:35:10.376859+0000","last_peered":"2023-08-17T17:35:10.376859+0000","last_clean":"2023-08-17T17:35:10.376859+0000","last_became_active":"2023-08-17T17:35:10.375677+0000","last_became_peered":"2023-08-17T17:35:10.375677+0000","last_unstale":"2023-08-17T17:35:10.376859+0000","last_undegraded":"2023-08-17T17:35:10.376859+0000","last_fullsized":"2023-08-17T17:35:10.376859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.358262+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:35:10.358262+0000","last_peered":"2023-08-17T17:35:10.358262+0000","last_clean":"2023-08-17T17:35:10.358262+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:35:10.358262+0000","last_undegraded":"2023-08-17T17:35:10.358262+0000","last_fullsized":"2023-08-17T17:35:10.358262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.741289+0000","last_change":"2023-08-17T17:35:10.741289+0000","last_active":"2023-08-17T17:35:10.741289+0000","last_peered":"2023-08-17T17:35:10.741289+0000","last_clean":"2023-08-17T17:35:10.741289+0000","last_became_active":"2023-08-17T17:35:10.740904+0000","last_became_peered":"2023-08-17T17:35:10.740904+0000","last_unstale":"2023-08-17T17:35:10.741289+0000","last_undegraded":"2023-08-17T17:35:10.741289+0000","last_fullsized":"2023-08-17T17:35:10.741289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.376908+0000","last_change":"2023-08-17T17:35:10.375897+0000","last_active":"2023-08-17T17:35:10.376908+0000","last_peered":"2023-08-17T17:35:10.376908+0000","last_clean":"2023-08-17T17:35:10.376908+0000","last_became_active":"2023-08-17T17:35:10.375639+0000","last_became_peered":"2023-08-17T17:35:10.375639+0000","last_unstale":"2023-08-17T17:35:10.376908+0000","last_undegraded":"2023-08-17T17:35:10.376908+0000","last_fullsized":"2023-08-17T17:35:10.376908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.362638+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:35:10.362638+0000","last_peered":"2023-08-17T17:35:10.362638+0000","last_clean":"2023-08-17T17:35:10.362638+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:35:10.362638+0000","last_undegraded":"2023-08-17T17:35:10.362638+0000","last_fullsized":"2023-08-17T17:35:10.362638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747219+0000","last_change":"2023-08-17T17:35:10.747219+0000","last_active":"2023-08-17T17:35:10.747219+0000","last_peered":"2023-08-17T17:35:10.747219+0000","last_clean":"2023-08-17T17:35:10.747219+0000","last_became_active":"2023-08-17T17:35:10.745290+0000","last_became_peered":"2023-08-17T17:35:10.745290+0000","last_unstale":"2023-08-17T17:35:10.747219+0000","last_undegraded":"2023-08-17T17:35:10.747219+0000","last_fullsized":"2023-08-17T17:35:10.747219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.370979+0000","last_change":"2023-08-17T17:35:10.368838+0000","last_active":"2023-08-17T17:35:10.370979+0000","last_peered":"2023-08-17T17:35:10.370979+0000","last_clean":"2023-08-17T17:35:10.370979+0000","last_became_active":"2023-08-17T17:35:10.368397+0000","last_became_peered":"2023-08-17T17:35:10.368397+0000","last_unstale":"2023-08-17T17:35:10.370979+0000","last_undegraded":"2023-08-17T17:35:10.370979+0000","last_fullsized":"2023-08-17T17:35:10.370979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.360158+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:35:10.360158+0000","last_peered":"2023-08-17T17:35:10.360158+0000","last_clean":"2023-08-17T17:35:10.360158+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:35:10.360158+0000","last_undegraded":"2023-08-17T17:35:10.360158+0000","last_fullsized":"2023-08-17T17:35:10.360158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.750011+0000","last_change":"2023-08-17T17:35:10.750011+0000","last_active":"2023-08-17T17:35:10.750011+0000","last_peered":"2023-08-17T17:35:10.750011+0000","last_clean":"2023-08-17T17:35:10.750011+0000","last_became_active":"2023-08-17T17:35:10.749665+0000","last_became_peered":"2023-08-17T17:35:10.749665+0000","last_unstale":"2023-08-17T17:35:10.750011+0000","last_undegraded":"2023-08-17T17:35:10.750011+0000","last_fullsized":"2023-08-17T17:35:10.750011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.386423+0000","last_change":"2023-08-17T17:35:10.379904+0000","last_active":"2023-08-17T17:35:10.386423+0000","last_peered":"2023-08-17T17:35:10.386423+0000","last_clean":"2023-08-17T17:35:10.386423+0000","last_became_active":"2023-08-17T17:35:10.379626+0000","last_became_peered":"2023-08-17T17:35:10.379626+0000","last_unstale":"2023-08-17T17:35:10.386423+0000","last_undegraded":"2023-08-17T17:35:10.386423+0000","last_fullsized":"2023-08-17T17:35:10.386423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.363667+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:35:10.363667+0000","last_peered":"2023-08-17T17:35:10.363667+0000","last_clean":"2023-08-17T17:35:10.363667+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:35:10.363667+0000","last_undegraded":"2023-08-17T17:35:10.363667+0000","last_fullsized":"2023-08-17T17:35:10.363667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.369230+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:35:10.369230+0000","last_peered":"2023-08-17T17:35:10.369230+0000","last_clean":"2023-08-17T17:35:10.369230+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:35:10.369230+0000","last_undegraded":"2023-08-17T17:35:10.369230+0000","last_fullsized":"2023-08-17T17:35:10.369230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.746942+0000","last_change":"2023-08-17T17:35:10.746942+0000","last_active":"2023-08-17T17:35:10.746942+0000","last_peered":"2023-08-17T17:35:10.746942+0000","last_clean":"2023-08-17T17:35:10.746942+0000","last_became_active":"2023-08-17T17:35:10.746718+0000","last_became_peered":"2023-08-17T17:35:10.746718+0000","last_unstale":"2023-08-17T17:35:10.746942+0000","last_undegraded":"2023-08-17T17:35:10.746942+0000","last_fullsized":"2023-08-17T17:35:10.746942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.749366+0000","last_change":"2023-08-17T17:35:10.375762+0000","last_active":"2023-08-17T17:35:10.749366+0000","last_peered":"2023-08-17T17:35:10.749366+0000","last_clean":"2023-08-17T17:35:10.749366+0000","last_became_active":"2023-08-17T17:35:10.375420+0000","last_became_peered":"2023-08-17T17:35:10.375420+0000","last_unstale":"2023-08-17T17:35:10.749366+0000","last_undegraded":"2023-08-17T17:35:10.749366+0000","last_fullsized":"2023-08-17T17:35:10.749366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.369640+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:35:10.369640+0000","last_peered":"2023-08-17T17:35:10.369640+0000","last_clean":"2023-08-17T17:35:10.369640+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:35:10.369640+0000","last_undegraded":"2023-08-17T17:35:10.369640+0000","last_fullsized":"2023-08-17T17:35:10.369640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.747448+0000","last_change":"2023-08-17T17:35:10.747448+0000","last_active":"2023-08-17T17:35:10.747448+0000","last_peered":"2023-08-17T17:35:10.747448+0000","last_clean":"2023-08-17T17:35:10.747448+0000","last_became_active":"2023-08-17T17:35:10.746221+0000","last_became_peered":"2023-08-17T17:35:10.746221+0000","last_unstale":"2023-08-17T17:35:10.747448+0000","last_undegraded":"2023-08-17T17:35:10.747448+0000","last_fullsized":"2023-08-17T17:35:10.747448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.384084+0000","last_change":"2023-08-17T17:35:10.378175+0000","last_active":"2023-08-17T17:35:10.384084+0000","last_peered":"2023-08-17T17:35:10.384084+0000","last_clean":"2023-08-17T17:35:10.384084+0000","last_became_active":"2023-08-17T17:35:10.377923+0000","last_became_peered":"2023-08-17T17:35:10.377923+0000","last_unstale":"2023-08-17T17:35:10.384084+0000","last_undegraded":"2023-08-17T17:35:10.384084+0000","last_fullsized":"2023-08-17T17:35:10.384084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.371699+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:35:10.371699+0000","last_peered":"2023-08-17T17:35:10.371699+0000","last_clean":"2023-08-17T17:35:10.371699+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:35:10.371699+0000","last_undegraded":"2023-08-17T17:35:10.371699+0000","last_fullsized":"2023-08-17T17:35:10.371699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.737343+0000","last_change":"2023-08-17T17:35:10.737343+0000","last_active":"2023-08-17T17:35:10.737343+0000","last_peered":"2023-08-17T17:35:10.737343+0000","last_clean":"2023-08-17T17:35:10.737343+0000","last_became_active":"2023-08-17T17:35:10.737065+0000","last_became_peered":"2023-08-17T17:35:10.737065+0000","last_unstale":"2023-08-17T17:35:10.737343+0000","last_undegraded":"2023-08-17T17:35:10.737343+0000","last_fullsized":"2023-08-17T17:35:10.737343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.383922+0000","last_change":"2023-08-17T17:35:10.379803+0000","last_active":"2023-08-17T17:35:10.383922+0000","last_peered":"2023-08-17T17:35:10.383922+0000","last_clean":"2023-08-17T17:35:10.383922+0000","last_became_active":"2023-08-17T17:35:10.379509+0000","last_became_peered":"2023-08-17T17:35:10.379509+0000","last_unstale":"2023-08-17T17:35:10.383922+0000","last_undegraded":"2023-08-17T17:35:10.383922+0000","last_fullsized":"2023-08-17T17:35:10.383922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.358111+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:35:10.358111+0000","last_peered":"2023-08-17T17:35:10.358111+0000","last_clean":"2023-08-17T17:35:10.358111+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:35:10.358111+0000","last_undegraded":"2023-08-17T17:35:10.358111+0000","last_fullsized":"2023-08-17T17:35:10.358111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.748093+0000","last_change":"2023-08-17T17:35:10.748093+0000","last_active":"2023-08-17T17:35:10.748093+0000","last_peered":"2023-08-17T17:35:10.748093+0000","last_clean":"2023-08-17T17:35:10.748093+0000","last_became_active":"2023-08-17T17:35:10.745484+0000","last_became_peered":"2023-08-17T17:35:10.745484+0000","last_unstale":"2023-08-17T17:35:10.748093+0000","last_undegraded":"2023-08-17T17:35:10.748093+0000","last_fullsized":"2023-08-17T17:35:10.748093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:10.349870+0000","last_clean_scrub_stamp":"2023-08-17T17:35:10.349870+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.381039+0000","last_change":"2023-08-17T17:35:10.379037+0000","last_active":"2023-08-17T17:35:10.381039+0000","last_peered":"2023-08-17T17:35:10.381039+0000","last_clean":"2023-08-17T17:35:10.381039+0000","last_became_active":"2023-08-17T17:35:10.378745+0000","last_became_peered":"2023-08-17T17:35:10.378745+0000","last_unstale":"2023-08-17T17:35:10.381039+0000","last_undegraded":"2023-08-17T17:35:10.381039+0000","last_fullsized":"2023-08-17T17:35:10.381039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:35:09.343398+0000","last_clean_scrub_stamp":"2023-08-17T17:35:09.343398+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-17T17:35:10.364672+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:35:10.364672+0000","last_peered":"2023-08-17T17:35:10.364672+0000","last_clean":"2023-08-17T17:35:10.364672+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:35:10.364672+0000","last_undegraded":"2023-08-17T17:35:10.364672+0000","last_fullsized":"2023-08-17T17:35:10.364672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":152644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":138142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":138142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":138142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":153640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":144821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:35:14.653 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T17:35:14.653 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T17:35:14.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.805+0000 7fece759e700 1 Processor -- start 2023-08-17T17:35:14.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.805+0000 7fece759e700 1 -- start start 2023-08-17T17:35:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.806+0000 7fece759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fece8153bc0 0x7fece8158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.806+0000 7fece759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece80a5a90 0x7fece8157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.806+0000 7fece759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece8063260 con 0x7fece8153fa0 2023-08-17T17:35:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.806+0000 7fece759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece8154420 con 0x7fece8153bc0 2023-08-17T17:35:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.806+0000 7fece759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece80a5f20 con 0x7fece80a5a90 2023-08-17T17:35:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fece8153bc0 0x7fece8158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fece8153bc0 0x7fece8158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53548/0 (socket says 172.21.15.78:53548) 2023-08-17T17:35:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece659c700 1 -- 172.21.15.78:0/310021892 learned_addr learned my addr 172.21.15.78:0/310021892 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece6d9d700 1 --2- 172.21.15.78:0/310021892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece80a5a90 0x7fece8157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece659c700 1 -- 172.21.15.78:0/310021892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece80a5a90 msgr2=0x7fece8157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece659c700 1 --2- 172.21.15.78:0/310021892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece80a5a90 0x7fece8157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece659c700 1 -- 172.21.15.78:0/310021892 >> v1:172.21.15.150:6789/0 conn(0x7fece8153fa0 legacy=0x7fece80636f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece659c700 1 -- 172.21.15.78:0/310021892 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8062690 con 0x7fece8153bc0 2023-08-17T17:35:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece6d9d700 1 --2- 172.21.15.78:0/310021892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece80a5a90 0x7fece8157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece659c700 1 --2- 172.21.15.78:0/310021892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece8153bc0 0x7fece8158680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fecd8009f20 tx=0x7fecd8009840).ready entity=mon.0 client_cookie=b9bbd134cc5b6407 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece559a700 1 -- 172.21.15.78:0/310021892 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd800e070 con 0x7fece8153bc0 2023-08-17T17:35:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece559a700 1 -- 172.21.15.78:0/310021892 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd800ba80 con 0x7fece8153bc0 2023-08-17T17:35:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.807+0000 7fece559a700 1 -- 172.21.15.78:0/310021892 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd800be00 con 0x7fece8153bc0 2023-08-17T17:35:14.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.808+0000 7fece759e700 1 -- 172.21.15.78:0/310021892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece8153bc0 msgr2=0x7fece8158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.808+0000 7fece759e700 1 --2- 172.21.15.78:0/310021892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece8153bc0 0x7fece8158680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fecd8009f20 tx=0x7fecd8009840).stop 2023-08-17T17:35:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.808+0000 7fece759e700 1 -- 172.21.15.78:0/310021892 shutdown_connections 2023-08-17T17:35:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.808+0000 7fece759e700 1 --2- 172.21.15.78:0/310021892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece80a5a90 0x7fece8157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.808+0000 7fece759e700 1 --2- 172.21.15.78:0/310021892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece8153bc0 0x7fece8158680 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.808+0000 7fece759e700 1 -- 172.21.15.78:0/310021892 >> 172.21.15.78:0/310021892 conn(0x7fece80647c0 msgr2=0x7fece8064bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.808+0000 7fece759e700 1 -- 172.21.15.78:0/310021892 shutdown_connections 2023-08-17T17:35:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.808+0000 7fece759e700 1 -- 172.21.15.78:0/310021892 wait complete. 2023-08-17T17:35:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.809+0000 7fece759e700 1 Processor -- start 2023-08-17T17:35:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.809+0000 7fece759e700 1 -- start start 2023-08-17T17:35:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece80a5a90 0x7fece81508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fece8153bc0 0x7fece81564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece8153fa0 0x7fece80a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece80a74c0 con 0x7fece80a5a90 2023-08-17T17:35:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece80a68b0 con 0x7fece8153bc0 2023-08-17T17:35:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece80a6b90 con 0x7fece8153fa0 2023-08-17T17:35:14.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece80a5a90 0x7fece81508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece80a5a90 0x7fece81508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53558/0 (socket says 172.21.15.78:53558) 2023-08-17T17:35:14.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece659c700 1 -- 172.21.15.78:0/77568343 learned_addr learned my addr 172.21.15.78:0/77568343 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:14.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece6d9d700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece8153fa0 0x7fece80a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece5d9b700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fece8153bc0 0x7fece81564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece659c700 1 -- 172.21.15.78:0/77568343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece8153fa0 msgr2=0x7fece80a7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece659c700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece8153fa0 0x7fece80a7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece659c700 1 -- 172.21.15.78:0/77568343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fece8153bc0 msgr2=0x7fece81564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece659c700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fece8153bc0 0x7fece81564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece659c700 1 -- 172.21.15.78:0/77568343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd8009ae0 con 0x7fece80a5a90 2023-08-17T17:35:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece5d9b700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fece8153bc0 0x7fece81564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece659c700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece80a5a90 0x7fece81508b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fecd800b6c0 tx=0x7fece80631d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fecde7fc700 1 -- 172.21.15.78:0/77568343 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8013cc0 con 0x7fece80a5a90 2023-08-17T17:35:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fecde7fc700 1 -- 172.21.15.78:0/77568343 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd8013e20 con 0x7fece80a5a90 2023-08-17T17:35:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece759e700 1 -- 172.21.15.78:0/77568343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece80a6e70 con 0x7fece80a5a90 2023-08-17T17:35:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fecde7fc700 1 -- 172.21.15.78:0/77568343 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd801e680 con 0x7fece80a5a90 2023-08-17T17:35:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.810+0000 7fece759e700 1 -- 172.21.15.78:0/77568343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece81569c0 con 0x7fece80a5a90 2023-08-17T17:35:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.811+0000 7fece759e700 1 -- 172.21.15.78:0/77568343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece806ab40 con 0x7fece80a5a90 2023-08-17T17:35:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.812+0000 7fecde7fc700 1 -- 172.21.15.78:0/77568343 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fecd8025030 con 0x7fece80a5a90 2023-08-17T17:35:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.812+0000 7fecde7fc700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecc805ed90 0x7fecc8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.812+0000 7fecde7fc700 1 -- 172.21.15.78:0/77568343 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fecd807b180 con 0x7fece80a5a90 2023-08-17T17:35:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.812+0000 7fece5d9b700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecc805ed90 0x7fecc8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.812+0000 7fece5d9b700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecc805ed90 0x7fecc8061250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fece80c1740 tx=0x7fecd0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:14.816+0000 7fecde7fc700 1 -- 172.21.15.78:0/77568343 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fecd804c7d0 con 0x7fece80a5a90 2023-08-17T17:35:15.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.040+0000 7fece759e700 1 -- 172.21.15.78:0/77568343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fece8062930 con 0x7fece80a5a90 2023-08-17T17:35:15.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.044+0000 7fecde7fc700 1 -- 172.21.15.78:0/77568343 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fecd8023070 con 0x7fece80a5a90 2023-08-17T17:35:15.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 -- 172.21.15.78:0/77568343 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecc805ed90 msgr2=0x7fecc8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecc805ed90 0x7fecc8061250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fece80c1740 tx=0x7fecd0009040).stop 2023-08-17T17:35:15.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 -- 172.21.15.78:0/77568343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece80a5a90 msgr2=0x7fece81508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece80a5a90 0x7fece81508b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fecd800b6c0 tx=0x7fece80631d0).stop 2023-08-17T17:35:15.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 -- 172.21.15.78:0/77568343 shutdown_connections 2023-08-17T17:35:15.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecc805ed90 0x7fecc8061250 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fece8153fa0 0x7fece80a7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fece80a5a90 0x7fece81508b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 --2- 172.21.15.78:0/77568343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fece8153bc0 0x7fece81564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 -- 172.21.15.78:0/77568343 >> 172.21.15.78:0/77568343 conn(0x7fece80647c0 msgr2=0x7fece8065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:15.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 -- 172.21.15.78:0/77568343 shutdown_connections 2023-08-17T17:35:15.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.046+0000 7fece759e700 1 -- 172.21.15.78:0/77568343 wait complete. 2023-08-17T17:35:15.048 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-08-17T17:35:15.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:35:15.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.169+0000 7fec6b87a700 1 Processor -- start 2023-08-17T17:35:15.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.169+0000 7fec6b87a700 1 -- start start 2023-08-17T17:35:15.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.170+0000 7fec6b87a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 0x7fec64154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.170+0000 7fec6b87a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fec6406a2c0 0x7fec64069050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.170+0000 7fec6b87a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec640c2c10 con 0x7fec6413aa20 2023-08-17T17:35:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.170+0000 7fec6b87a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec64155010 con 0x7fec6406a2c0 2023-08-17T17:35:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.170+0000 7fec6b87a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec641552e0 con 0x7fec6413a640 2023-08-17T17:35:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec69616700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 0x7fec64154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec68e15700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fec6406a2c0 0x7fec64069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec69616700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 0x7fec64154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:53996/0 (socket says 172.21.15.78:53996) 2023-08-17T17:35:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec68e15700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fec6406a2c0 0x7fec64069050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:37514/0 (socket says 172.21.15.78:37514) 2023-08-17T17:35:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec69616700 1 -- 172.21.15.78:0/1440831796 learned_addr learned my addr 172.21.15.78:0/1440831796 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec69e17700 1 --1- 172.21.15.78:0/1440831796 >> v1:172.21.15.150:6789/0 conn(0x7fec6413aa20 0x7fec64151590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:35958/0 (socket says 172.21.15.78:35958) 2023-08-17T17:35:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec68e15700 1 -- 172.21.15.78:0/1440831796 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 msgr2=0x7fec64154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec68e15700 1 --2- 172.21.15.78:0/1440831796 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 0x7fec64154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec68e15700 1 -- 172.21.15.78:0/1440831796 >> v1:172.21.15.150:6789/0 conn(0x7fec6413aa20 legacy=0x7fec64151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec68e15700 1 -- 172.21.15.78:0/1440831796 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec641555c0 con 0x7fec6406a2c0 2023-08-17T17:35:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec69616700 1 --2- 172.21.15.78:0/1440831796 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 0x7fec64154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:35:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec68e15700 1 --2- 172.21.15.78:0/1440831796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6406a2c0 0x7fec64069050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fec54009760 tx=0x7fec54009060).ready entity=mon.1 client_cookie=ba9b7f58831fe5af server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec5bfff700 1 -- 172.21.15.78:0/1440831796 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400f510 con 0x7fec6406a2c0 2023-08-17T17:35:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec5bfff700 1 -- 172.21.15.78:0/1440831796 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5400f670 con 0x7fec6406a2c0 2023-08-17T17:35:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.171+0000 7fec5bfff700 1 -- 172.21.15.78:0/1440831796 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400f9f0 con 0x7fec6406a2c0 2023-08-17T17:35:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.172+0000 7fec6b87a700 1 -- 172.21.15.78:0/1440831796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6406a2c0 msgr2=0x7fec64069050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.172+0000 7fec6b87a700 1 --2- 172.21.15.78:0/1440831796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6406a2c0 0x7fec64069050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fec54009760 tx=0x7fec54009060).stop 2023-08-17T17:35:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.172+0000 7fec6b87a700 1 -- 172.21.15.78:0/1440831796 shutdown_connections 2023-08-17T17:35:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.172+0000 7fec6b87a700 1 --2- 172.21.15.78:0/1440831796 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 0x7fec64154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.172+0000 7fec6b87a700 1 --2- 172.21.15.78:0/1440831796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6406a2c0 0x7fec64069050 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.172+0000 7fec6b87a700 1 -- 172.21.15.78:0/1440831796 >> 172.21.15.78:0/1440831796 conn(0x7fec640c7b00 msgr2=0x7fec640c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.172+0000 7fec6b87a700 1 -- 172.21.15.78:0/1440831796 shutdown_connections 2023-08-17T17:35:15.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.172+0000 7fec6b87a700 1 -- 172.21.15.78:0/1440831796 wait complete. 2023-08-17T17:35:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.173+0000 7fec6b87a700 1 Processor -- start 2023-08-17T17:35:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.173+0000 7fec6b87a700 1 -- start start 2023-08-17T17:35:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec6b87a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6406a2c0 0x7fec640a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec6b87a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 0x7fec64166520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec6b87a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6413aa20 0x7fec640bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec6b87a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec64166b60 con 0x7fec6406a2c0 2023-08-17T17:35:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec6b87a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640ac1d0 con 0x7fec6413aa20 2023-08-17T17:35:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec6b87a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec640ac470 con 0x7fec6413a640 2023-08-17T17:35:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec69616700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6406a2c0 0x7fec640a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec69616700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6406a2c0 0x7fec640a75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53560/0 (socket says 172.21.15.78:53560) 2023-08-17T17:35:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec69616700 1 -- 172.21.15.78:0/335417914 learned_addr learned my addr 172.21.15.78:0/335417914 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec68e15700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 0x7fec64166520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec69e17700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6413aa20 0x7fec640bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec69616700 1 -- 172.21.15.78:0/335417914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 msgr2=0x7fec64166520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec69616700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 0x7fec64166520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec69616700 1 -- 172.21.15.78:0/335417914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6413aa20 msgr2=0x7fec640bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec69616700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6413aa20 0x7fec640bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec69616700 1 -- 172.21.15.78:0/335417914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec60009370 con 0x7fec6406a2c0 2023-08-17T17:35:15.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.174+0000 7fec69e17700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6413aa20 0x7fec640bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:15.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.175+0000 7fec69616700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6406a2c0 0x7fec640a75e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fec6000ea20 tx=0x7fec600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:15.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.175+0000 7fec597fa700 1 -- 172.21.15.78:0/335417914 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6000c850 con 0x7fec6406a2c0 2023-08-17T17:35:15.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.175+0000 7fec597fa700 1 -- 172.21.15.78:0/335417914 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6000c9b0 con 0x7fec6406a2c0 2023-08-17T17:35:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.175+0000 7fec6b87a700 1 -- 172.21.15.78:0/335417914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec540092a0 con 0x7fec6406a2c0 2023-08-17T17:35:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.175+0000 7fec597fa700 1 -- 172.21.15.78:0/335417914 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6000cd30 con 0x7fec6406a2c0 2023-08-17T17:35:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.175+0000 7fec6b87a700 1 -- 172.21.15.78:0/335417914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6413bcd0 con 0x7fec6406a2c0 2023-08-17T17:35:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.176+0000 7fec6b87a700 1 -- 172.21.15.78:0/335417914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec640c42e0 con 0x7fec6406a2c0 2023-08-17T17:35:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.176+0000 7fec597fa700 1 -- 172.21.15.78:0/335417914 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fec60022070 con 0x7fec6406a2c0 2023-08-17T17:35:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.176+0000 7fec597fa700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4805ed90 0x7fec48061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.176+0000 7fec597fa700 1 -- 172.21.15.78:0/335417914 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fec60079ff0 con 0x7fec6406a2c0 2023-08-17T17:35:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.176+0000 7fec68e15700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4805ed90 0x7fec48061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.177+0000 7fec68e15700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4805ed90 0x7fec48061250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fec54009760 tx=0x7fec54017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:15.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.180+0000 7fec597fa700 1 -- 172.21.15.78:0/335417914 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec6004b590 con 0x7fec6406a2c0 2023-08-17T17:35:15.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.388+0000 7fec6b87a700 1 -- 172.21.15.78:0/335417914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec640aa360 con 0x7fec6406a2c0 2023-08-17T17:35:15.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.389+0000 7fec597fa700 1 -- 172.21.15.78:0/335417914 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4483 (secure 0 0 0) 0x7fec640aa360 con 0x7fec6406a2c0 2023-08-17T17:35:15.389 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:35:15.389 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/175439344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":175439344},{"type":"v1","addr":"172.21.15.150:6834","nonce":175439344}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/893012651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":893012651},{"type":"v1","addr":"172.21.15.150:6835","nonce":893012651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4944,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/734042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":734042508},{"type":"v1","addr":"172.21.15.78:6836","nonce":734042508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:35:10.721386+0000","modified":"2023-08-17T17:35:13.361851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/3186726071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3186726071},{"type":"v1","addr":"172.21.15.78:6837","nonce":3186726071}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T17:35:15.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 -- 172.21.15.78:0/335417914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4805ed90 msgr2=0x7fec48061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4805ed90 0x7fec48061250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fec54009760 tx=0x7fec54017000).stop 2023-08-17T17:35:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 -- 172.21.15.78:0/335417914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6406a2c0 msgr2=0x7fec640a75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6406a2c0 0x7fec640a75e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fec6000ea20 tx=0x7fec600090f0).stop 2023-08-17T17:35:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 -- 172.21.15.78:0/335417914 shutdown_connections 2023-08-17T17:35:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4805ed90 0x7fec48061250 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6413aa20 0x7fec640bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6406a2c0 0x7fec640a75e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 --2- 172.21.15.78:0/335417914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6413a640 0x7fec64166520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 -- 172.21.15.78:0/335417914 >> 172.21.15.78:0/335417914 conn(0x7fec640c7b00 msgr2=0x7fec640c53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 -- 172.21.15.78:0/335417914 shutdown_connections 2023-08-17T17:35:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.391+0000 7fec6b87a700 1 -- 172.21.15.78:0/335417914 wait complete. 2023-08-17T17:35:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 13 2023-08-17T17:35:15.804 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T17:35:10.721386+0000', 'modified': '2023-08-17T17:35:13.361851+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4947}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4947': {'gid': 4947, 'name': 'c', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/3186726071', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6835', 'nonce': 3186726071}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 3186726071}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T17:35:15.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T17:35:15.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-17T17:35:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.919+0000 7fd468f9a700 1 Processor -- start 2023-08-17T17:35:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.919+0000 7fd468f9a700 1 -- start start 2023-08-17T17:35:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.920+0000 7fd468f9a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 0x7fd4640a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.920+0000 7fd468f9a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640c7690 con 0x7fd464154580 2023-08-17T17:35:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.920+0000 7fd468f9a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640c8df0 con 0x7fd4640c0560 2023-08-17T17:35:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.920+0000 7fd468f9a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640a8190 con 0x7fd4641541a0 2023-08-17T17:35:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.920+0000 7fd459d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd464154580 0x7fd4640bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55348/0 (socket says 172.21.15.78:55348) 2023-08-17T17:35:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.920+0000 7fd459d9b700 1 -- 172.21.15.78:0/2758056819 learned_addr learned my addr 172.21.15.78:0/2758056819 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.920+0000 7fd46259c700 1 --2- 172.21.15.78:0/2758056819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 0x7fd4640a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.920+0000 7fd461d9b700 1 -- 172.21.15.78:0/2758056819 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308628530 0 0) 0x7fd44c001110 con 0x7fd464154580 2023-08-17T17:35:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.920+0000 7fd461d9b700 1 -- 172.21.15.78:0/2758056819 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4500033f0 con 0x7fd464154580 2023-08-17T17:35:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd461d9b700 1 -- 172.21.15.78:0/2758056819 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120622074 0 0) 0x7fd4640c8df0 con 0x7fd4640c0560 2023-08-17T17:35:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd461d9b700 1 -- 172.21.15.78:0/2758056819 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd44c001110 con 0x7fd4640c0560 2023-08-17T17:35:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd461d9b700 1 -- 172.21.15.78:0/2758056819 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 296755758 0 0) 0x7fd4500033f0 con 0x7fd464154580 2023-08-17T17:35:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd46259c700 1 -- 172.21.15.78:0/2758056819 >> v1:172.21.15.150:6789/0 conn(0x7fd4640c0560 legacy=0x7fd4640c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd46259c700 1 -- 172.21.15.78:0/2758056819 >> v1:172.21.15.78:6789/0 conn(0x7fd464154580 legacy=0x7fd4640bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd46259c700 1 -- 172.21.15.78:0/2758056819 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640c9970 con 0x7fd4641541a0 2023-08-17T17:35:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd46259c700 1 --2- 172.21.15.78:0/2758056819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 0x7fd4640a7ca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd454009790 tx=0x7fd454009060).ready entity=mon.2 client_cookie=95fc481b73d5d33 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd461d9b700 1 -- 172.21.15.78:0/2758056819 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c001600 con 0x7fd4641541a0 2023-08-17T17:35:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd461d9b700 1 -- 172.21.15.78:0/2758056819 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4540090d0 con 0x7fd4641541a0 2023-08-17T17:35:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd461d9b700 1 -- 172.21.15.78:0/2758056819 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454011610 con 0x7fd4641541a0 2023-08-17T17:35:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd468f9a700 1 -- 172.21.15.78:0/2758056819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 msgr2=0x7fd4640a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd468f9a700 1 --2- 172.21.15.78:0/2758056819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 0x7fd4640a7ca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd454009790 tx=0x7fd454009060).stop 2023-08-17T17:35:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd468f9a700 1 -- 172.21.15.78:0/2758056819 shutdown_connections 2023-08-17T17:35:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd468f9a700 1 --2- 172.21.15.78:0/2758056819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 0x7fd4640a7ca0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.921+0000 7fd468f9a700 1 -- 172.21.15.78:0/2758056819 >> 172.21.15.78:0/2758056819 conn(0x7fd46406a400 msgr2=0x7fd4640caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.922+0000 7fd468f9a700 1 -- 172.21.15.78:0/2758056819 shutdown_connections 2023-08-17T17:35:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.922+0000 7fd468f9a700 1 -- 172.21.15.78:0/2758056819 wait complete. 2023-08-17T17:35:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.923+0000 7fd468f9a700 1 Processor -- start 2023-08-17T17:35:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.923+0000 7fd468f9a700 1 -- start start 2023-08-17T17:35:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.923+0000 7fd468f9a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4640c0560 0x7fd4641496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.923+0000 7fd468f9a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 0x7fd46414aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd468f9a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd464154580 0x7fd464063a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd468f9a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46414b370 con 0x7fd464154580 2023-08-17T17:35:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd468f9a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd464164780 con 0x7fd4640c0560 2023-08-17T17:35:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd468f9a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd464164a60 con 0x7fd4641541a0 2023-08-17T17:35:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd462d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd464154580 0x7fd464063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd462d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd464154580 0x7fd464063a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53574/0 (socket says 172.21.15.78:53574) 2023-08-17T17:35:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd462d9d700 1 -- 172.21.15.78:0/3810127619 learned_addr learned my addr 172.21.15.78:0/3810127619 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd46259c700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4640c0560 0x7fd4641496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd459d9b700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 0x7fd46414aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd462d9d700 1 -- 172.21.15.78:0/3810127619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 msgr2=0x7fd46414aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd462d9d700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 0x7fd46414aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd462d9d700 1 -- 172.21.15.78:0/3810127619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4640c0560 msgr2=0x7fd4641496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd462d9d700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4640c0560 0x7fd4641496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd462d9d700 1 -- 172.21.15.78:0/3810127619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4540092a0 con 0x7fd464154580 2023-08-17T17:35:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd459d9b700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 0x7fd46414aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd46259c700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4640c0560 0x7fd4641496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd462d9d700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd464154580 0x7fd464063a90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fd45c00c710 tx=0x7fd45c00cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd45affd700 1 -- 172.21.15.78:0/3810127619 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c010510 con 0x7fd464154580 2023-08-17T17:35:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd45affd700 1 -- 172.21.15.78:0/3810127619 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c010670 con 0x7fd464154580 2023-08-17T17:35:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd45affd700 1 -- 172.21.15.78:0/3810127619 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0109f0 con 0x7fd464154580 2023-08-17T17:35:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd468f9a700 1 -- 172.21.15.78:0/3810127619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd464164d40 con 0x7fd464154580 2023-08-17T17:35:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.924+0000 7fd468f9a700 1 -- 172.21.15.78:0/3810127619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd464149b90 con 0x7fd464154580 2023-08-17T17:35:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.926+0000 7fd45affd700 1 -- 172.21.15.78:0/3810127619 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd45c010070 con 0x7fd464154580 2023-08-17T17:35:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.926+0000 7fd45affd700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd44405ed60 0x7fd444061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.926+0000 7fd45affd700 1 -- 172.21.15.78:0/3810127619 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd45c0798c0 con 0x7fd464154580 2023-08-17T17:35:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.926+0000 7fd46259c700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd44405ed60 0x7fd444061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.926+0000 7fd46259c700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd44405ed60 0x7fd444061220 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fd4640c66d0 tx=0x7fd454016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.928+0000 7fd47a92fb80 1 Processor -- start 2023-08-17T17:35:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.928+0000 7fd47a92fb80 1 -- start start 2023-08-17T17:35:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 0x56114613b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 0x561146135f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x561146136870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561146100d00 con 0x5611461363f0 2023-08-17T17:35:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561146077cb0 con 0x56114613ac20 2023-08-17T17:35:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x56114608cc90 con 0x5611461838c0 2023-08-17T17:35:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd462d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x561146136870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd462d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x561146136870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53582/0 (socket says 172.21.15.78:53582) 2023-08-17T17:35:15.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd462d9d700 1 -- 172.21.15.78:0/3234091217 learned_addr learned my addr 172.21.15.78:0/3234091217 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:15.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd46259c700 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 0x56114613b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd459d9b700 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 0x561146135f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd462d9d700 1 -- 172.21.15.78:0/3234091217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 msgr2=0x561146135f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:15.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd462d9d700 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 0x561146135f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd462d9d700 1 -- 172.21.15.78:0/3234091217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 msgr2=0x56114613b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:15.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd462d9d700 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 0x56114613b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd462d9d700 1 -- 172.21.15.78:0/3234091217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561145f2f310 con 0x5611461363f0 2023-08-17T17:35:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd459d9b700 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 0x561146135f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd46259c700 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 0x56114613b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.929+0000 7fd462d9d700 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x561146136870 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fd45c04e710 tx=0x7fd45c00f000).ready entity=mon.0 client_cookie=51b4c7e1a08b8617 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd4437fe700 1 -- 172.21.15.78:0/3234091217 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c053070 con 0x5611461363f0 2023-08-17T17:35:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd4437fe700 1 -- 172.21.15.78:0/3234091217 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c054270 con 0x5611461363f0 2023-08-17T17:35:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd4437fe700 1 -- 172.21.15.78:0/3234091217 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c077b40 con 0x5611461363f0 2023-08-17T17:35:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd47a92fb80 1 -- 172.21.15.78:0/3234091217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 msgr2=0x561146136870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x561146136870 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fd45c04e710 tx=0x7fd45c00f000).stop 2023-08-17T17:35:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd47a92fb80 1 -- 172.21.15.78:0/3234091217 shutdown_connections 2023-08-17T17:35:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x561146136870 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 0x56114613b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/3234091217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 0x561146135f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd47a92fb80 1 -- 172.21.15.78:0/3234091217 >> 172.21.15.78:0/3234091217 conn(0x561145ef7e40 msgr2=0x561146183d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd47a92fb80 1 -- 172.21.15.78:0/3234091217 shutdown_connections 2023-08-17T17:35:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.930+0000 7fd47a92fb80 1 -- 172.21.15.78:0/3234091217 wait complete. 2023-08-17T17:35:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.931+0000 7fd47a92fb80 1 -- start start 2023-08-17T17:35:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.931+0000 7fd47a92fb80 1 Processor -- start 2023-08-17T17:35:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461363f0 0x56114617d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x56114613ac20 0x561146180f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461838c0 0x561146182b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561146053ef0 con 0x5611461838c0 2023-08-17T17:35:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611460588d0 con 0x5611461363f0 2023-08-17T17:35:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x56114617d950 con 0x56114613ac20 2023-08-17T17:35:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd47a92fb80 10 client.0 ll_register_callbacks cb 0x5611460face0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:35:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd462d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461838c0 0x561146182b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd462d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461838c0 0x561146182b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53596/0 (socket says 172.21.15.78:53596) 2023-08-17T17:35:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd462d9d700 1 -- 172.21.15.78:0/1053726473 learned_addr learned my addr 172.21.15.78:0/1053726473 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd46259c700 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461363f0 0x56114617d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd459d9b700 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x56114613ac20 0x561146180f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd462d9d700 1 -- 172.21.15.78:0/1053726473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x56114613ac20 msgr2=0x561146180f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd462d9d700 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x56114613ac20 0x561146180f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd462d9d700 1 -- 172.21.15.78:0/1053726473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461363f0 msgr2=0x56114617d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd462d9d700 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461363f0 0x56114617d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd462d9d700 1 -- 172.21.15.78:0/1053726473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd464149b90 con 0x5611461838c0 2023-08-17T17:35:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd46259c700 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461363f0 0x56114617d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd462d9d700 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461838c0 0x561146182b10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fd45c010f30 tx=0x7fd45c059000).ready entity=mon.0 client_cookie=e3823538e4e30755 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd440ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:35:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd440ff9700 1 -- 172.21.15.78:0/1053726473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c04e220 con 0x5611461838c0 2023-08-17T17:35:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd440ff9700 1 -- 172.21.15.78:0/1053726473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd45c05fca0 con 0x5611461838c0 2023-08-17T17:35:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.932+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1053726473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561146104b50 con 0x5611461838c0 2023-08-17T17:35:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd440ff9700 1 -- 172.21.15.78:0/1053726473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd45c05fe60 con 0x5611461838c0 2023-08-17T17:35:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd47a92fb80 10 client.5127 fetch_fsmap learned FSMap version 13 2023-08-17T17:35:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1053726473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x561146085e70 con 0x5611461838c0 2023-08-17T17:35:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd440ff9700 1 -- 172.21.15.78:0/1053726473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561146104b50 con 0x5611461838c0 2023-08-17T17:35:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd440ff9700 1 -- 172.21.15.78:0/1053726473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 13) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd45c04a910 con 0x5611461838c0 2023-08-17T17:35:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd47a92fb80 10 client.5127 fetch_fsmap finished waiting for FSMap version 13 2023-08-17T17:35:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd47a92fb80 10 client.5127 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T17:35:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd47a92fb80 20 client.5127 populate_metadata read hostname 'smithi078' 2023-08-17T17:35:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.78:6835/3186726071,v1:172.21.15.78:6837/3186726071] conn(0x561146193010 0x5611461933f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd47a92fb80 4 client.5127 mds_command: new command op to 4947 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T17:35:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1053726473 --> [v2:172.21.15.78:6835/3186726071,v1:172.21.15.78:6837/3186726071] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561145ef3ca0 con 0x561146193010 2023-08-17T17:35:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd46259c700 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.78:6835/3186726071,v1:172.21.15.78:6837/3186726071] conn(0x561146193010 0x5611461933f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd440ff9700 10 client.5127 ms_handle_connect on v2:172.21.15.78:6835/3186726071 2023-08-17T17:35:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.933+0000 7fd46259c700 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.78:6835/3186726071,v1:172.21.15.78:6837/3186726071] conn(0x561146193010 0x5611461933f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ca383120b56534cf server_cookie=652dc4db2af8a855 in_seq=0 out_seq=0 2023-08-17T17:35:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd440ff9700 1 -- 172.21.15.78:0/1053726473 <== mds.0 v2:172.21.15.78:6835/3186726071 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x561145ef3ca0 con 0x561146193010 2023-08-17T17:35:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd440ff9700 10 client.5127 handle_command_reply: tid=0 2023-08-17T17:35:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 client.5127 shutdown 2023-08-17T17:35:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1053726473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461838c0 msgr2=0x561146182b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461838c0 0x561146182b10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fd45c010f30 tx=0x7fd45c059000).stop 2023-08-17T17:35:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1053726473 shutdown_connections 2023-08-17T17:35:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.78:6835/3186726071,v1:172.21.15.78:6837/3186726071] conn(0x561146193010 0x5611461933f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461838c0 0x561146182b10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd440ff9700 0 client.5127 ms_handle_reset on v2:172.21.15.78:6835/3186726071 2023-08-17T17:35:15.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461363f0 0x56114617d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1053726473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x56114613ac20 0x561146180f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1053726473 >> 172.21.15.78:0/1053726473 conn(0x561145ef7e40 msgr2=0x561146138c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:15.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1053726473 shutdown_connections 2023-08-17T17:35:15.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1053726473 wait complete. 2023-08-17T17:35:15.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.934+0000 7fd47a92fb80 20 client.5127 trim_cache size 0 max 16384 2023-08-17T17:35:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.951+0000 7fd47a92fb80 1 Processor -- start 2023-08-17T17:35:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.951+0000 7fd47a92fb80 1 -- start start 2023-08-17T17:35:15.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.951+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x56114613b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.951+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 0x561146199420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.951+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 0x561146199910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.951+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611461820b0 con 0x5611461363f0 2023-08-17T17:35:15.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.951+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561146181340 con 0x56114613ac20 2023-08-17T17:35:15.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.951+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561146199e00 con 0x5611461838c0 2023-08-17T17:35:15.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.951+0000 7fd46259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x56114613b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd46259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x56114613b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53604/0 (socket says 172.21.15.78:53604) 2023-08-17T17:35:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd46259c700 1 -- 172.21.15.78:0/3442349818 learned_addr learned my addr 172.21.15.78:0/3442349818 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd459d9b700 1 --2- 172.21.15.78:0/3442349818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 0x561146199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd462d9d700 1 --2- 172.21.15.78:0/3442349818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 0x561146199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd46259c700 1 -- 172.21.15.78:0/3442349818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 msgr2=0x561146199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd46259c700 1 --2- 172.21.15.78:0/3442349818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 0x561146199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd46259c700 1 -- 172.21.15.78:0/3442349818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 msgr2=0x561146199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd46259c700 1 --2- 172.21.15.78:0/3442349818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 0x561146199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd46259c700 1 -- 172.21.15.78:0/3442349818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56114617b1d0 con 0x5611461363f0 2023-08-17T17:35:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd459d9b700 1 --2- 172.21.15.78:0/3442349818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 0x561146199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd46259c700 1 --2- 172.21.15.78:0/3442349818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x56114613b1d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fd464083b60 tx=0x7fd454014000).ready entity=mon.0 client_cookie=82e8734e4a34905e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd443fff700 1 -- 172.21.15.78:0/3442349818 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45402a670 con 0x5611461363f0 2023-08-17T17:35:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd443fff700 1 -- 172.21.15.78:0/3442349818 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45402a7d0 con 0x5611461363f0 2023-08-17T17:35:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd443fff700 1 -- 172.21.15.78:0/3442349818 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45402a940 con 0x5611461363f0 2023-08-17T17:35:15.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd47a92fb80 1 -- 172.21.15.78:0/3442349818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 msgr2=0x56114613b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.952+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/3442349818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x56114613b1d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fd464083b60 tx=0x7fd454014000).stop 2023-08-17T17:35:15.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.953+0000 7fd47a92fb80 1 -- 172.21.15.78:0/3442349818 shutdown_connections 2023-08-17T17:35:15.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.953+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/3442349818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5611461838c0 0x561146199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.953+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/3442349818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x56114613b1d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.953+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/3442349818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56114613ac20 0x561146199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.953+0000 7fd47a92fb80 1 -- 172.21.15.78:0/3442349818 >> 172.21.15.78:0/3442349818 conn(0x561145ef7e40 msgr2=0x5611461828d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:15.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.953+0000 7fd47a92fb80 1 -- 172.21.15.78:0/3442349818 shutdown_connections 2023-08-17T17:35:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.953+0000 7fd47a92fb80 1 -- 172.21.15.78:0/3442349818 wait complete. 2023-08-17T17:35:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.953+0000 7fd47a92fb80 1 -- start start 2023-08-17T17:35:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.953+0000 7fd47a92fb80 1 Processor -- start 2023-08-17T17:35:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x5611461603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x56114613ac20 0x5611461608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd47a92fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461838c0 0x5611461615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611461376c0 con 0x5611461363f0 2023-08-17T17:35:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611461e4bc0 con 0x5611461838c0 2023-08-17T17:35:15.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd47a92fb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611461626f0 con 0x56114613ac20 2023-08-17T17:35:15.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd47a92fb80 10 client.0 ll_register_callbacks cb 0x5611460face0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:35:15.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd46259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x5611461603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd46259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x5611461603e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53610/0 (socket says 172.21.15.78:53610) 2023-08-17T17:35:15.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd46259c700 1 -- 172.21.15.78:0/1775310455 learned_addr learned my addr 172.21.15.78:0/1775310455 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:15.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd462d9d700 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461838c0 0x5611461615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd459d9b700 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x56114613ac20 0x5611461608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd46259c700 1 -- 172.21.15.78:0/1775310455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x56114613ac20 msgr2=0x5611461608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd46259c700 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x56114613ac20 0x5611461608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd46259c700 1 -- 172.21.15.78:0/1775310455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461838c0 msgr2=0x5611461615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd46259c700 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461838c0 0x5611461615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd46259c700 1 -- 172.21.15.78:0/1775310455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4640c9970 con 0x5611461363f0 2023-08-17T17:35:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.954+0000 7fd462d9d700 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461838c0 0x5611461615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd46259c700 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x5611461603e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fd45400a010 tx=0x7fd45402d000).ready entity=mon.0 client_cookie=707633eb7ebe402d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd440ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:35:15.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd440ff9700 1 -- 172.21.15.78:0/1775310455 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45402a670 con 0x5611461363f0 2023-08-17T17:35:15.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd440ff9700 1 -- 172.21.15.78:0/1775310455 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd45403c470 con 0x5611461363f0 2023-08-17T17:35:15.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1775310455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611461350f0 con 0x5611461363f0 2023-08-17T17:35:15.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd440ff9700 1 -- 172.21.15.78:0/1775310455 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4540115e0 con 0x5611461363f0 2023-08-17T17:35:15.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd47a92fb80 10 client.5133 fetch_fsmap learned FSMap version 13 2023-08-17T17:35:15.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1775310455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x561146081480 con 0x5611461363f0 2023-08-17T17:35:15.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd440ff9700 1 -- 172.21.15.78:0/1775310455 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611461350f0 con 0x5611461363f0 2023-08-17T17:35:15.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd440ff9700 1 -- 172.21.15.78:0/1775310455 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 13) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd45403ca50 con 0x5611461363f0 2023-08-17T17:35:15.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd47a92fb80 10 client.5133 fetch_fsmap finished waiting for FSMap version 13 2023-08-17T17:35:15.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd47a92fb80 10 client.5133 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T17:35:15.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd47a92fb80 20 client.5133 populate_metadata read hostname 'smithi078' 2023-08-17T17:35:15.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.78:6835/3186726071,v1:172.21.15.78:6837/3186726071] conn(0x561146199760 0x561146161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:15.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd47a92fb80 4 client.5133 mds_command: new command op to 4947 tid=0[{"prefix": "status"}] 2023-08-17T17:35:15.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1775310455 --> [v2:172.21.15.78:6835/3186726071,v1:172.21.15.78:6837/3186726071] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561145f2aca0 con 0x561146199760 2023-08-17T17:35:15.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd459d9b700 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.78:6835/3186726071,v1:172.21.15.78:6837/3186726071] conn(0x561146199760 0x561146161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd440ff9700 10 client.5133 ms_handle_connect on v2:172.21.15.78:6835/3186726071 2023-08-17T17:35:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.955+0000 7fd459d9b700 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.78:6835/3186726071,v1:172.21.15.78:6837/3186726071] conn(0x561146199760 0x561146161ad0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9affac4a23145792 server_cookie=5adab575ae1539e7 in_seq=0 out_seq=0 2023-08-17T17:35:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd440ff9700 1 -- 172.21.15.78:0/1775310455 <== mds.0 v2:172.21.15.78:6835/3186726071 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7fd44c00d150 con 0x561146199760 2023-08-17T17:35:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd440ff9700 10 client.5133 handle_command_reply: tid=0 2023-08-17T17:35:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 client.5133 shutdown 2023-08-17T17:35:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1775310455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 msgr2=0x5611461603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x5611461603e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fd45400a010 tx=0x7fd45402d000).stop 2023-08-17T17:35:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1775310455 shutdown_connections 2023-08-17T17:35:15.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.78:6835/3186726071,v1:172.21.15.78:6837/3186726071] conn(0x561146199760 0x561146161ad0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5611461838c0 0x5611461615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd440ff9700 0 client.5133 ms_handle_reset on v2:172.21.15.78:6835/3186726071 2023-08-17T17:35:15.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611461363f0 0x5611461603e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 --2- 172.21.15.78:0/1775310455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x56114613ac20 0x5611461608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1775310455 >> 172.21.15.78:0/1775310455 conn(0x561145ef7e40 msgr2=0x561146183ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:15.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1775310455 shutdown_connections 2023-08-17T17:35:15.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 1 -- 172.21.15.78:0/1775310455 wait complete. 2023-08-17T17:35:15.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd47a92fb80 20 client.5133 trim_cache size 0 max 16384 2023-08-17T17:35:15.967 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:35:15.967 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T17:35:15.967 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T17:35:15.967 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4947, 2023-08-17T17:35:15.968 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T17:35:15.968 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T17:35:15.968 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T17:35:15.968 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 5.2330164769999996, 2023-08-17T17:35:15.968 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 13, 2023-08-17T17:35:15.968 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 34, 2023-08-17T17:35:15.968 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 34, 2023-08-17T17:35:15.968 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 12.484664467 2023-08-17T17:35:15.969 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:35:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd468f9a700 1 -- 172.21.15.78:0/3810127619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd44405ed60 msgr2=0x7fd444061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd468f9a700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd44405ed60 0x7fd444061220 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fd4640c66d0 tx=0x7fd454016000).stop 2023-08-17T17:35:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd468f9a700 1 -- 172.21.15.78:0/3810127619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd464154580 msgr2=0x7fd464063a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd468f9a700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd464154580 0x7fd464063a90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fd45c00c710 tx=0x7fd45c00cad0).stop 2023-08-17T17:35:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd468f9a700 1 -- 172.21.15.78:0/3810127619 shutdown_connections 2023-08-17T17:35:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd468f9a700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd44405ed60 0x7fd444061220 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd468f9a700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd464154580 0x7fd464063a90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd468f9a700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4640c0560 0x7fd4641496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd468f9a700 1 --2- 172.21.15.78:0/3810127619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4641541a0 0x7fd46414aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:15.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.956+0000 7fd468f9a700 1 -- 172.21.15.78:0/3810127619 >> 172.21.15.78:0/3810127619 conn(0x7fd46406a400 msgr2=0x7fd464063050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:15.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.957+0000 7fd468f9a700 1 -- 172.21.15.78:0/3810127619 shutdown_connections 2023-08-17T17:35:15.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:15.957+0000 7fd468f9a700 1 -- 172.21.15.78:0/3810127619 wait complete. 2023-08-17T17:35:15.972 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T17:35:16.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.072+0000 7fce84eff700 1 Processor -- start 2023-08-17T17:35:16.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.072+0000 7fce84eff700 1 -- start start 2023-08-17T17:35:16.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.073+0000 7fce84eff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fce801508b0 0x7fce800a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:16.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.073+0000 7fce84eff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fce80068a80 0x7fce80066ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:16.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.073+0000 7fce84eff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80150c90 0x7fce80066fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:16.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.073+0000 7fce84eff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce800674c0 con 0x7fce80068a80 2023-08-17T17:35:16.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.073+0000 7fce84eff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce80068f60 con 0x7fce801508b0 2023-08-17T17:35:16.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.073+0000 7fce84eff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce80069240 con 0x7fce80150c90 2023-08-17T17:35:16.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fce80068a80 0x7fce80066ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:16.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fce80068a80 0x7fce80066ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53614/0 (socket says 172.21.15.78:53614) 2023-08-17T17:35:16.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7dd9b700 1 -- 172.21.15.78:0/4281542580 learned_addr learned my addr 172.21.15.78:0/4281542580 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:16.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7e59c700 1 --2- 172.21.15.78:0/4281542580 >> v2:172.21.15.150:3300/0 conn(0x7fce801508b0 0x7fce800a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:16.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7ed9d700 1 --2- 172.21.15.78:0/4281542580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80150c90 0x7fce80066fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:16.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7dd9b700 1 -- 172.21.15.78:0/4281542580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80150c90 msgr2=0x7fce80066fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:16.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7dd9b700 1 --2- 172.21.15.78:0/4281542580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80150c90 0x7fce80066fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7dd9b700 1 -- 172.21.15.78:0/4281542580 >> v2:172.21.15.150:3300/0 conn(0x7fce801508b0 msgr2=0x7fce800a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:16.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7dd9b700 1 --2- 172.21.15.78:0/4281542580 >> v2:172.21.15.150:3300/0 conn(0x7fce801508b0 0x7fce800a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7dd9b700 1 -- 172.21.15.78:0/4281542580 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce80069520 con 0x7fce80068a80 2023-08-17T17:35:16.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7ed9d700 1 --2- 172.21.15.78:0/4281542580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80150c90 0x7fce80066fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:16.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7dd9b700 1 --2- 172.21.15.78:0/4281542580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80068a80 0x7fce80066ae0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fce8006c2a0 tx=0x7fce74009060).ready entity=mon.0 client_cookie=b4287ab34a801860 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:16.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7d59a700 1 -- 172.21.15.78:0/4281542580 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74005880 con 0x7fce80068a80 2023-08-17T17:35:16.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7d59a700 1 -- 172.21.15.78:0/4281542580 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce740059e0 con 0x7fce80068a80 2023-08-17T17:35:16.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.074+0000 7fce7d59a700 1 -- 172.21.15.78:0/4281542580 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74005d60 con 0x7fce80068a80 2023-08-17T17:35:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.075+0000 7fce84eff700 1 -- 172.21.15.78:0/4281542580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80068a80 msgr2=0x7fce80066ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.075+0000 7fce84eff700 1 --2- 172.21.15.78:0/4281542580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80068a80 0x7fce80066ae0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fce8006c2a0 tx=0x7fce74009060).stop 2023-08-17T17:35:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.075+0000 7fce84eff700 1 -- 172.21.15.78:0/4281542580 shutdown_connections 2023-08-17T17:35:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.075+0000 7fce84eff700 1 --2- 172.21.15.78:0/4281542580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80150c90 0x7fce80066fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.075+0000 7fce84eff700 1 --2- 172.21.15.78:0/4281542580 >> v2:172.21.15.150:3300/0 conn(0x7fce801508b0 0x7fce800a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.075+0000 7fce84eff700 1 --2- 172.21.15.78:0/4281542580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80068a80 0x7fce80066ae0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.075+0000 7fce84eff700 1 -- 172.21.15.78:0/4281542580 >> 172.21.15.78:0/4281542580 conn(0x7fce800c4980 msgr2=0x7fce800663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.075+0000 7fce84eff700 1 -- 172.21.15.78:0/4281542580 shutdown_connections 2023-08-17T17:35:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.075+0000 7fce84eff700 1 -- 172.21.15.78:0/4281542580 wait complete. 2023-08-17T17:35:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.076+0000 7fce84eff700 1 Processor -- start 2023-08-17T17:35:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.076+0000 7fce84eff700 1 -- start start 2023-08-17T17:35:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce84eff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80068a80 0x7fce80152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce84eff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce801508b0 0x7fce8013a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce84eff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80150c90 0x7fce80151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce84eff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80151bb0 con 0x7fce80150c90 2023-08-17T17:35:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce84eff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80151e90 con 0x7fce801508b0 2023-08-17T17:35:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce84eff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce80152170 con 0x7fce80068a80 2023-08-17T17:35:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80150c90 0x7fce80151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80150c90 0x7fce80151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53618/0 (socket says 172.21.15.78:53618) 2023-08-17T17:35:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7ed9d700 1 -- 172.21.15.78:0/828580498 learned_addr learned my addr 172.21.15.78:0/828580498 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:16.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7ed9d700 1 -- 172.21.15.78:0/828580498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80068a80 msgr2=0x7fce80152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:16.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7dd9b700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce801508b0 0x7fce8013a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:16.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7e59c700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80068a80 0x7fce80152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:16.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7ed9d700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80068a80 0x7fce80152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7ed9d700 1 -- 172.21.15.78:0/828580498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce801508b0 msgr2=0x7fce8013a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:16.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7ed9d700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce801508b0 0x7fce8013a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7ed9d700 1 -- 172.21.15.78:0/828580498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74009300 con 0x7fce80150c90 2023-08-17T17:35:16.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce7ed9d700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80150c90 0x7fce80151110 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fce7800cef0 tx=0x7fce78007820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:16.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce6e7fc700 1 -- 172.21.15.78:0/828580498 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7800ae00 con 0x7fce80150c90 2023-08-17T17:35:16.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce6e7fc700 1 -- 172.21.15.78:0/828580498 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78016400 con 0x7fce80150c90 2023-08-17T17:35:16.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce6e7fc700 1 -- 172.21.15.78:0/828580498 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78016780 con 0x7fce80150c90 2023-08-17T17:35:16.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce84eff700 1 -- 172.21.15.78:0/828580498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce80152450 con 0x7fce80150c90 2023-08-17T17:35:16.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.077+0000 7fce84eff700 1 -- 172.21.15.78:0/828580498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8014c1d0 con 0x7fce80150c90 2023-08-17T17:35:16.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.078+0000 7fce84eff700 1 -- 172.21.15.78:0/828580498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce80152970 con 0x7fce80150c90 2023-08-17T17:35:16.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.079+0000 7fce6e7fc700 1 -- 172.21.15.78:0/828580498 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fce780203f0 con 0x7fce80150c90 2023-08-17T17:35:16.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.079+0000 7fce6e7fc700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fce6005ed60 0x7fce60061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:16.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.079+0000 7fce6e7fc700 1 -- 172.21.15.78:0/828580498 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fce7807a6a0 con 0x7fce80150c90 2023-08-17T17:35:16.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.079+0000 7fce7e59c700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fce6005ed60 0x7fce60061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:16.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.079+0000 7fce7e59c700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fce6005ed60 0x7fce60061220 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fce70006fd0 tx=0x7fce70008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:16.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.083+0000 7fce6e7fc700 1 -- 172.21.15.78:0/828580498 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fce80152970 con 0x7fce80150c90 2023-08-17T17:35:16.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.288+0000 7fce84eff700 1 -- 172.21.15.78:0/828580498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce80152970 con 0x7fce80150c90 2023-08-17T17:35:16.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.289+0000 7fce6e7fc700 1 -- 172.21.15.78:0/828580498 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7fce80152970 con 0x7fce80150c90 2023-08-17T17:35:16.289 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:35:16.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 -- 172.21.15.78:0/828580498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fce6005ed60 msgr2=0x7fce60061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:16.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fce6005ed60 0x7fce60061220 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fce70006fd0 tx=0x7fce70008040).stop 2023-08-17T17:35:16.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 -- 172.21.15.78:0/828580498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80150c90 msgr2=0x7fce80151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:16.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80150c90 0x7fce80151110 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fce7800cef0 tx=0x7fce78007820).stop 2023-08-17T17:35:16.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 -- 172.21.15.78:0/828580498 shutdown_connections 2023-08-17T17:35:16.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fce6005ed60 0x7fce60061220 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce80150c90 0x7fce80151110 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce80068a80 0x7fce80152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 --2- 172.21.15.78:0/828580498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce801508b0 0x7fce8013a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:16.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 -- 172.21.15.78:0/828580498 >> 172.21.15.78:0/828580498 conn(0x7fce800c4980 msgr2=0x7fce80065030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:16.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 -- 172.21.15.78:0/828580498 shutdown_connections 2023-08-17T17:35:16.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.290+0000 7fce84eff700 1 -- 172.21.15.78:0/828580498 wait complete. 2023-08-17T17:35:16.301 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T17:35:16.302 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:35:16.302 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T17:35:16.302 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T17:35:16.302 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T17:35:16.303 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T17:35:16.303 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T17:35:16.303 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:35:16.303 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:35:16.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:35:16.304 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T17:35:16.319 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:35:16.319 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:35:16.319 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:35:16.319 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:35:16.319 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:35:16.320 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:35:16.320 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:35:16.320 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:35:16.320 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T17:35:16.320 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:35:16.321 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:35:16.321 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T17:35:16.321 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:35:16.321 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:35:16.321 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:35:16.321 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:35:16.321 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:35:16.322 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42163sec preferred_lft 42163sec 2023-08-17T17:35:16.322 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T17:35:16.322 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:35:16.322 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:35:16.322 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:35:16.322 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T17:35:16.322 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:35:16.322 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T17:35:16.323 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:35:16.323 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:35:16.323 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T17:35:16.323 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link 2023-08-17T17:35:16.323 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:35:16.323 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:35:16.323 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T17:35:16.323 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::54:39ff:fe93:1c36/64 scope link 2023-08-17T17:35:16.324 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:35:16.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:35:16.324 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:35:16.382 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T17:35:16.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:35:16.383 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T17:35:16.439 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T17:35:16.439 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:35:16.440 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:35:16.440 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:35:16.440 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:35:16.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:35:16.441 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:35:16.441 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:35:16.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:35:16.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:35:16.443 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:35:16.443 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:35:16.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:35:16.539 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:35:16.554 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T17:35:16.554 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T17:35:16.554 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:35:16.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:35:16.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T17:35:16.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:35:16.618 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T17:35:16.671 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:35:16.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:35:16.750 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:35:16.750 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:35:16.774 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:35:16.774 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:35:16.776 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:35:16.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:35:16.777 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T17:35:16.842 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-17T17:35:16.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.995+0000 7fdcb4925700 1 Processor -- start 2023-08-17T17:35:16.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.995+0000 7fdcb4925700 1 -- start start 2023-08-17T17:35:16.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.996+0000 7fdcb4925700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdcb00c0560 0x7fdcb00a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:16.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.996+0000 7fdcb4925700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb00c7690 con 0x7fdcb01541a0 2023-08-17T17:35:16.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.996+0000 7fdcb4925700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb00c8df0 con 0x7fdcb0154580 2023-08-17T17:35:16.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.996+0000 7fdcb4925700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb00a8190 con 0x7fdcb00c0560 2023-08-17T17:35:16.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.996+0000 7fdcaed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdcb00c0560 0x7fdcb00a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:16.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.996+0000 7fdcae59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdcb01541a0 0x7fdcb00bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55352/0 (socket says 172.21.15.78:55352) 2023-08-17T17:35:16.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.996+0000 7fdcaed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdcb00c0560 0x7fdcb00a7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53626/0 (socket says 172.21.15.78:53626) 2023-08-17T17:35:16.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.996+0000 7fdcae59c700 1 -- 172.21.15.78:0/2804758118 learned_addr learned my addr 172.21.15.78:0/2804758118 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:16.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcaed9d700 1 -- 172.21.15.78:0/2804758118 >> v1:172.21.15.150:6789/0 conn(0x7fdcb0154580 legacy=0x7fdcb00c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:16.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcaed9d700 1 -- 172.21.15.78:0/2804758118 >> v1:172.21.15.78:6789/0 conn(0x7fdcb01541a0 legacy=0x7fdcb00bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:16.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcad59a700 1 -- 172.21.15.78:0/2804758118 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44480850 0 0) 0x7fdca0001110 con 0x7fdcb01541a0 2023-08-17T17:35:16.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcaed9d700 1 -- 172.21.15.78:0/2804758118 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb00c9970 con 0x7fdcb00c0560 2023-08-17T17:35:16.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcaed9d700 1 --2- 172.21.15.78:0/2804758118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb00c0560 0x7fdcb00a7ca0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fdca8009e60 tx=0x7fdca8009780).ready entity=mon.0 client_cookie=8057c5da03a00e35 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:17.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcad59a700 1 -- 172.21.15.78:0/2804758118 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800e070 con 0x7fdcb00c0560 2023-08-17T17:35:17.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcad59a700 1 -- 172.21.15.78:0/2804758118 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca800bc30 con 0x7fdcb00c0560 2023-08-17T17:35:17.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcad59a700 1 -- 172.21.15.78:0/2804758118 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8012410 con 0x7fdcb00c0560 2023-08-17T17:35:17.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcb4925700 1 -- 172.21.15.78:0/2804758118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb00c0560 msgr2=0x7fdcb00a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:17.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcb4925700 1 --2- 172.21.15.78:0/2804758118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb00c0560 0x7fdcb00a7ca0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fdca8009e60 tx=0x7fdca8009780).stop 2023-08-17T17:35:17.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcb4925700 1 -- 172.21.15.78:0/2804758118 shutdown_connections 2023-08-17T17:35:17.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcb4925700 1 --2- 172.21.15.78:0/2804758118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb00c0560 0x7fdcb00a7ca0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.997+0000 7fdcb4925700 1 -- 172.21.15.78:0/2804758118 >> 172.21.15.78:0/2804758118 conn(0x7fdcb006a400 msgr2=0x7fdcb00caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:17.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.998+0000 7fdcb4925700 1 -- 172.21.15.78:0/2804758118 shutdown_connections 2023-08-17T17:35:17.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.998+0000 7fdcb4925700 1 -- 172.21.15.78:0/2804758118 wait complete. 2023-08-17T17:35:17.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.999+0000 7fdcb4925700 1 Processor -- start 2023-08-17T17:35:17.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.999+0000 7fdcb4925700 1 -- start start 2023-08-17T17:35:17.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.999+0000 7fdcb4925700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c0560 0x7fdcb0164e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:17.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.999+0000 7fdcb4925700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb01541a0 0x7fdcb0097290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:17.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.999+0000 7fdcb4925700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcb0154580 0x7fdcb0097780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:17.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.999+0000 7fdcb4925700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0097e40 con 0x7fdcb01541a0 2023-08-17T17:35:17.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.999+0000 7fdcb4925700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00c3a30 con 0x7fdcb00c0560 2023-08-17T17:35:17.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.999+0000 7fdcb4925700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0094f90 con 0x7fdcb0154580 2023-08-17T17:35:17.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:16.999+0000 7fdcadd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb01541a0 0x7fdcb0097290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:17.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcadd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb01541a0 0x7fdcb0097290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53642/0 (socket says 172.21.15.78:53642) 2023-08-17T17:35:17.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcadd9b700 1 -- 172.21.15.78:0/4073546902 learned_addr learned my addr 172.21.15.78:0/4073546902 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:17.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcae59c700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c0560 0x7fdcb0164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:17.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcaed9d700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcb0154580 0x7fdcb0097780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:17.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcadd9b700 1 -- 172.21.15.78:0/4073546902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcb0154580 msgr2=0x7fdcb0097780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:17.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcadd9b700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcb0154580 0x7fdcb0097780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcadd9b700 1 -- 172.21.15.78:0/4073546902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c0560 msgr2=0x7fdcb0164e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:17.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcadd9b700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c0560 0x7fdcb0164e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcadd9b700 1 -- 172.21.15.78:0/4073546902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca8009a20 con 0x7fdcb01541a0 2023-08-17T17:35:17.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcae59c700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c0560 0x7fdcb0164e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:17.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcadd9b700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb01541a0 0x7fdcb0097290 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fdca400c4a0 tx=0x7fdca4007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:17.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdc9e7fc700 1 -- 172.21.15.78:0/4073546902 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4001ea0 con 0x7fdcb01541a0 2023-08-17T17:35:17.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdc9e7fc700 1 -- 172.21.15.78:0/4073546902 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca4007020 con 0x7fdcb01541a0 2023-08-17T17:35:17.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcb4925700 1 -- 172.21.15.78:0/4073546902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb0166fd0 con 0x7fdcb01541a0 2023-08-17T17:35:17.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdc9e7fc700 1 -- 172.21.15.78:0/4073546902 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40073c0 con 0x7fdcb01541a0 2023-08-17T17:35:17.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.000+0000 7fdcb4925700 1 -- 172.21.15.78:0/4073546902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb00c33e0 con 0x7fdcb01541a0 2023-08-17T17:35:17.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.001+0000 7fdcb4925700 1 -- 172.21.15.78:0/4073546902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb0047350 con 0x7fdcb01541a0 2023-08-17T17:35:17.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.001+0000 7fdc9e7fc700 1 -- 172.21.15.78:0/4073546902 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdca4010070 con 0x7fdcb01541a0 2023-08-17T17:35:17.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.002+0000 7fdc9e7fc700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc9005ed90 0x7fdc90061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:17.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.002+0000 7fdcae59c700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc9005ed90 0x7fdc90061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:17.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.002+0000 7fdc9e7fc700 1 -- 172.21.15.78:0/4073546902 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdca4079290 con 0x7fdcb01541a0 2023-08-17T17:35:17.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.002+0000 7fdcae59c700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc9005ed90 0x7fdc90061250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fdca0007fd0 tx=0x7fdca0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:17.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.006+0000 7fdc9e7fc700 1 -- 172.21.15.78:0/4073546902 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdca404a830 con 0x7fdcb01541a0 2023-08-17T17:35:17.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.194+0000 7fdcb4925700 1 -- 172.21.15.78:0/4073546902 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcb00c9040 con 0x7fdc9005ed90 2023-08-17T17:35:17.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.196+0000 7fdc9e7fc700 1 -- 172.21.15.78:0/4073546902 <== mgr.4104 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdcb00c9040 con 0x7fdc9005ed90 2023-08-17T17:35:17.196 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:35:17.196 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:35:17.196 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephfs" 2023-08-17T17:35:17.197 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:35:17.197 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:35:17.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 -- 172.21.15.78:0/4073546902 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc9005ed90 msgr2=0x7fdc90061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:17.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc9005ed90 0x7fdc90061250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fdca0007fd0 tx=0x7fdca0009040).stop 2023-08-17T17:35:17.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 -- 172.21.15.78:0/4073546902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb01541a0 msgr2=0x7fdcb0097290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:17.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb01541a0 0x7fdcb0097290 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fdca400c4a0 tx=0x7fdca4007da0).stop 2023-08-17T17:35:17.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 -- 172.21.15.78:0/4073546902 shutdown_connections 2023-08-17T17:35:17.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc9005ed90 0x7fdc90061250 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcb0154580 0x7fdcb0097780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcb00c0560 0x7fdcb0164e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 --2- 172.21.15.78:0/4073546902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcb01541a0 0x7fdcb0097290 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 -- 172.21.15.78:0/4073546902 >> 172.21.15.78:0/4073546902 conn(0x7fdcb006a400 msgr2=0x7fdcb00cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:17.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 -- 172.21.15.78:0/4073546902 shutdown_connections 2023-08-17T17:35:17.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.198+0000 7fdcb4925700 1 -- 172.21.15.78:0/4073546902 wait complete. 2023-08-17T17:35:17.210 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-17T17:35:17.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.324+0000 7f2e9b59e700 1 Processor -- start 2023-08-17T17:35:17.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.324+0000 7f2e9b59e700 1 -- start start 2023-08-17T17:35:17.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9b59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e9c151a40 0x7f2e9c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:17.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2e9c157be0 0x7f2e9c158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:17.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c158520 con 0x7f2e9c151e20 2023-08-17T17:35:17.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9b59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0c6620 con 0x7f2e9c151a40 2023-08-17T17:35:17.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0c6900 con 0x7f2e9c157be0 2023-08-17T17:35:17.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e9c151a40 0x7f2e9c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:17.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e9c151a40 0x7f2e9c0c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53650/0 (socket says 172.21.15.78:53650) 2023-08-17T17:35:17.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9a59c700 1 -- 172.21.15.78:0/1304226282 learned_addr learned my addr 172.21.15.78:0/1304226282 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:17.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9a59c700 1 -- 172.21.15.78:0/1304226282 >> v2:172.21.15.150:3300/0 conn(0x7f2e9c157be0 msgr2=0x7f2e9c158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:17.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9ad9d700 1 --2- 172.21.15.78:0/1304226282 >> v2:172.21.15.150:3300/0 conn(0x7f2e9c157be0 0x7f2e9c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:17.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9a59c700 1 --2- 172.21.15.78:0/1304226282 >> v2:172.21.15.150:3300/0 conn(0x7f2e9c157be0 0x7f2e9c158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9a59c700 1 -- 172.21.15.78:0/1304226282 >> v1:172.21.15.150:6789/0 conn(0x7f2e9c151e20 legacy=0x7f2e9c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:17.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9a59c700 1 -- 172.21.15.78:0/1304226282 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0c6be0 con 0x7f2e9c151a40 2023-08-17T17:35:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.325+0000 7f2e9a59c700 1 --2- 172.21.15.78:0/1304226282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151a40 0x7f2e9c0c8260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f2e9c155770 tx=0x7f2e8c009060).ready entity=mon.0 client_cookie=af5b51c66b40f7f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e99d9b700 1 -- 172.21.15.78:0/1304226282 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c005880 con 0x7f2e9c151a40 2023-08-17T17:35:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e99d9b700 1 -- 172.21.15.78:0/1304226282 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0059e0 con 0x7f2e9c151a40 2023-08-17T17:35:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e99d9b700 1 -- 172.21.15.78:0/1304226282 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c005d60 con 0x7f2e9c151a40 2023-08-17T17:35:17.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e9b59e700 1 -- 172.21.15.78:0/1304226282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151a40 msgr2=0x7f2e9c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:17.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e9b59e700 1 --2- 172.21.15.78:0/1304226282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151a40 0x7f2e9c0c8260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f2e9c155770 tx=0x7f2e8c009060).stop 2023-08-17T17:35:17.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e9b59e700 1 -- 172.21.15.78:0/1304226282 shutdown_connections 2023-08-17T17:35:17.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e9b59e700 1 --2- 172.21.15.78:0/1304226282 >> v2:172.21.15.150:3300/0 conn(0x7f2e9c157be0 0x7f2e9c158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e9b59e700 1 --2- 172.21.15.78:0/1304226282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151a40 0x7f2e9c0c8260 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e9b59e700 1 -- 172.21.15.78:0/1304226282 >> 172.21.15.78:0/1304226282 conn(0x7f2e9c0943b0 msgr2=0x7f2e9c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:17.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e9b59e700 1 -- 172.21.15.78:0/1304226282 shutdown_connections 2023-08-17T17:35:17.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.326+0000 7f2e9b59e700 1 -- 172.21.15.78:0/1304226282 wait complete. 2023-08-17T17:35:17.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.327+0000 7f2e9b59e700 1 Processor -- start 2023-08-17T17:35:17.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.327+0000 7f2e9b59e700 1 -- start start 2023-08-17T17:35:17.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e9b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e9c151a40 0x7f2e9c168440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:17.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e9b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151e20 0x7f2e9c14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:17.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e9b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c157be0 0x7f2e9c0aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:17.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e9b59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c167fb0 con 0x7f2e9c151e20 2023-08-17T17:35:17.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e9b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0acd90 con 0x7f2e9c157be0 2023-08-17T17:35:17.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e9b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0ad030 con 0x7f2e9c151a40 2023-08-17T17:35:17.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e91d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151e20 0x7f2e9c14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:17.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e91d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151e20 0x7f2e9c14b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53658/0 (socket says 172.21.15.78:53658) 2023-08-17T17:35:17.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e91d9b700 1 -- 172.21.15.78:0/3108194292 learned_addr learned my addr 172.21.15.78:0/3108194292 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:17.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e9ad9d700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c157be0 0x7f2e9c0aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:17.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.328+0000 7f2e9a59c700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e9c151a40 0x7f2e9c168440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:17.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e91d9b700 1 -- 172.21.15.78:0/3108194292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e9c151a40 msgr2=0x7f2e9c168440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:17.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e91d9b700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e9c151a40 0x7f2e9c168440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e91d9b700 1 -- 172.21.15.78:0/3108194292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c157be0 msgr2=0x7f2e9c0aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:17.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e91d9b700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c157be0 0x7f2e9c0aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:17.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e91d9b700 1 -- 172.21.15.78:0/3108194292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c009300 con 0x7f2e9c151e20 2023-08-17T17:35:17.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e9ad9d700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c157be0 0x7f2e9c0aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:17.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e9a59c700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e9c151a40 0x7f2e9c168440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:17.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e91d9b700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151e20 0x7f2e9c14b0e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f2e8400b470 tx=0x7f2e84006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:17.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e92ffd700 1 -- 172.21.15.78:0/3108194292 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84012410 con 0x7f2e9c151e20 2023-08-17T17:35:17.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e92ffd700 1 -- 172.21.15.78:0/3108194292 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840125b0 con 0x7f2e9c151e20 2023-08-17T17:35:17.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e9b59e700 1 -- 172.21.15.78:0/3108194292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c0ad310 con 0x7f2e9c151e20 2023-08-17T17:35:17.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e92ffd700 1 -- 172.21.15.78:0/3108194292 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84012970 con 0x7f2e9c151e20 2023-08-17T17:35:17.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.329+0000 7f2e9b59e700 1 -- 172.21.15.78:0/3108194292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c0c4940 con 0x7f2e9c151e20 2023-08-17T17:35:17.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.330+0000 7f2e9b59e700 1 -- 172.21.15.78:0/3108194292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c0c4b60 con 0x7f2e9c151e20 2023-08-17T17:35:17.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.330+0000 7f2e92ffd700 1 -- 172.21.15.78:0/3108194292 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2e8400f030 con 0x7f2e9c151e20 2023-08-17T17:35:17.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.330+0000 7f2e92ffd700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2e7c05ed90 0x7f2e7c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:17.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.331+0000 7f2e92ffd700 1 -- 172.21.15.78:0/3108194292 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2e84079680 con 0x7f2e9c151e20 2023-08-17T17:35:17.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.331+0000 7f2e9a59c700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2e7c05ed90 0x7f2e7c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:17.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.331+0000 7f2e9a59c700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2e7c05ed90 0x7f2e7c061250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f2e9c156e70 tx=0x7f2e8c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:17.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.335+0000 7f2e92ffd700 1 -- 172.21.15.78:0/3108194292 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e9c0c4b60 con 0x7f2e9c151e20 2023-08-17T17:35:17.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:17.543+0000 7f2e9b59e700 1 -- 172.21.15.78:0/3108194292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f2e9c0c4b60 con 0x7f2e9c151e20 2023-08-17T17:35:18.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.387+0000 7f2e92ffd700 1 -- 172.21.15.78:0/3108194292 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 5) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f2e84012d20 con 0x7f2e9c151e20 2023-08-17T17:35:18.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.388+0000 7f2e92ffd700 1 -- 172.21.15.78:0/3108194292 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v5) v1 ==== 92+0+0 (secure 0 0 0) 0x7f2e84072e60 con 0x7f2e9c151e20 2023-08-17T17:35:18.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 -- 172.21.15.78:0/3108194292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2e7c05ed90 msgr2=0x7f2e7c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2e7c05ed90 0x7f2e7c061250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f2e9c156e70 tx=0x7f2e8c016000).stop 2023-08-17T17:35:18.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 -- 172.21.15.78:0/3108194292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151e20 msgr2=0x7f2e9c14b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151e20 0x7f2e9c14b0e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f2e8400b470 tx=0x7f2e84006f90).stop 2023-08-17T17:35:18.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 -- 172.21.15.78:0/3108194292 shutdown_connections 2023-08-17T17:35:18.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2e7c05ed90 0x7f2e7c061250 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c157be0 0x7f2e9c0aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e9c151a40 0x7f2e9c168440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 --2- 172.21.15.78:0/3108194292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e9c151e20 0x7f2e9c14b0e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 -- 172.21.15.78:0/3108194292 >> 172.21.15.78:0/3108194292 conn(0x7f2e9c0943b0 msgr2=0x7f2e9c064670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:18.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.390+0000 7f2e9b59e700 1 -- 172.21.15.78:0/3108194292 shutdown_connections 2023-08-17T17:35:18.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.391+0000 7f2e9b59e700 1 -- 172.21.15.78:0/3108194292 wait complete. 2023-08-17T17:35:18.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-17T17:35:18.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.526+0000 7f59ef3e0700 1 Processor -- start 2023-08-17T17:35:18.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.526+0000 7f59ef3e0700 1 -- start start 2023-08-17T17:35:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ef3e0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f59e80c6f00 0x7f59e80c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ef3e0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f59e80bfea0 0x7f59e80c0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ef3e0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e80c7850 con 0x7f59e8154440 2023-08-17T17:35:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ef3e0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e80a8480 con 0x7f59e80bfea0 2023-08-17T17:35:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ef3e0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e80c9d80 con 0x7f59e80c6f00 2023-08-17T17:35:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ed97d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f59e80bfea0 0x7f59e80c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ed97d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f59e80bfea0 0x7f59e80c0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39510/0 (socket says 172.21.15.78:39510) 2023-08-17T17:35:18.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ed97d700 1 -- 172.21.15.78:0/2943426956 learned_addr learned my addr 172.21.15.78:0/2943426956 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:18.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ec97b700 1 --2- 172.21.15.78:0/2943426956 >> v2:172.21.15.150:3300/0 conn(0x7f59e80c6f00 0x7f59e80c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:18.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ed97d700 1 -- 172.21.15.78:0/2943426956 >> v2:172.21.15.150:3300/0 conn(0x7f59e80c6f00 msgr2=0x7f59e80c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:18.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ed97d700 1 --2- 172.21.15.78:0/2943426956 >> v2:172.21.15.150:3300/0 conn(0x7f59e80c6f00 0x7f59e80c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59dffff700 1 -- 172.21.15.78:0/2943426956 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159303488 0 0) 0x7f59e80c7850 con 0x7f59e8154440 2023-08-17T17:35:18.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ed97d700 1 -- 172.21.15.78:0/2943426956 >> v1:172.21.15.150:6789/0 conn(0x7f59e8154440 legacy=0x7f59e80a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ed97d700 1 -- 172.21.15.78:0/2943426956 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e80c0820 con 0x7f59e80bfea0 2023-08-17T17:35:18.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.527+0000 7f59ed97d700 1 --2- 172.21.15.78:0/2943426956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e80bfea0 0x7f59e80c0330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f59e80cc050 tx=0x7f59e0009840).ready entity=mon.0 client_cookie=d00dfc64cc360a19 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:18.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59dffff700 1 -- 172.21.15.78:0/2943426956 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e000e070 con 0x7f59e80bfea0 2023-08-17T17:35:18.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59dffff700 1 -- 172.21.15.78:0/2943426956 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e000ba20 con 0x7f59e80bfea0 2023-08-17T17:35:18.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59dffff700 1 -- 172.21.15.78:0/2943426956 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e000bda0 con 0x7f59e80bfea0 2023-08-17T17:35:18.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59ef3e0700 1 -- 172.21.15.78:0/2943426956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e80bfea0 msgr2=0x7f59e80c0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59ef3e0700 1 --2- 172.21.15.78:0/2943426956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e80bfea0 0x7f59e80c0330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f59e80cc050 tx=0x7f59e0009840).stop 2023-08-17T17:35:18.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59ef3e0700 1 -- 172.21.15.78:0/2943426956 shutdown_connections 2023-08-17T17:35:18.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59ef3e0700 1 --2- 172.21.15.78:0/2943426956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e80bfea0 0x7f59e80c0330 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59ef3e0700 1 --2- 172.21.15.78:0/2943426956 >> v2:172.21.15.150:3300/0 conn(0x7f59e80c6f00 0x7f59e80c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59ef3e0700 1 -- 172.21.15.78:0/2943426956 >> 172.21.15.78:0/2943426956 conn(0x7f59e806a400 msgr2=0x7f59e80caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:18.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59ef3e0700 1 -- 172.21.15.78:0/2943426956 shutdown_connections 2023-08-17T17:35:18.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.528+0000 7f59ef3e0700 1 -- 172.21.15.78:0/2943426956 wait complete. 2023-08-17T17:35:18.534 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:18.532+0000 7f46d08e4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:35:18.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.529+0000 7f59ef3e0700 1 Processor -- start 2023-08-17T17:35:18.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.529+0000 7f59ef3e0700 1 -- start start 2023-08-17T17:35:18.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.530+0000 7f59ef3e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80bfea0 0x7f59e81500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.530+0000 7f59ef3e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59e80c6f00 0x7f59e80c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.530+0000 7f59ef3e0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e8154440 0x7f59e815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.530+0000 7f59ef3e0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e80af130 con 0x7f59e8154440 2023-08-17T17:35:18.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.530+0000 7f59ef3e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e80c2790 con 0x7f59e80bfea0 2023-08-17T17:35:18.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.530+0000 7f59ef3e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e80aee50 con 0x7f59e80c6f00 2023-08-17T17:35:18.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.530+0000 7f59ed97d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e8154440 0x7f59e815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:18.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ed97d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e8154440 0x7f59e815a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39518/0 (socket says 172.21.15.78:39518) 2023-08-17T17:35:18.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ed97d700 1 -- 172.21.15.78:0/3458506681 learned_addr learned my addr 172.21.15.78:0/3458506681 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:18.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ed17c700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80bfea0 0x7f59e81500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:18.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ec97b700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59e80c6f00 0x7f59e80c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:18.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ed97d700 1 -- 172.21.15.78:0/3458506681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59e80c6f00 msgr2=0x7f59e80c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ed97d700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59e80c6f00 0x7f59e80c2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ed97d700 1 -- 172.21.15.78:0/3458506681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80bfea0 msgr2=0x7f59e81500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ed97d700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80bfea0 0x7f59e81500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ed97d700 1 -- 172.21.15.78:0/3458506681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0009ae0 con 0x7f59e8154440 2023-08-17T17:35:18.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ed17c700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80bfea0 0x7f59e81500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:35:18.538 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:18.531+0000 7fa958dcf680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:35:18.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ed97d700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e8154440 0x7f59e815a0e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f59e000b6c0 tx=0x7f59e0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:18.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59dd7fa700 1 -- 172.21.15.78:0/3458506681 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0013e60 con 0x7f59e8154440 2023-08-17T17:35:18.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59dd7fa700 1 -- 172.21.15.78:0/3458506681 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e00092e0 con 0x7f59e8154440 2023-08-17T17:35:18.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ef3e0700 1 -- 172.21.15.78:0/3458506681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e80c2140 con 0x7f59e8154440 2023-08-17T17:35:18.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59dd7fa700 1 -- 172.21.15.78:0/3458506681 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e001e6c0 con 0x7f59e8154440 2023-08-17T17:35:18.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.531+0000 7f59ef3e0700 1 -- 172.21.15.78:0/3458506681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e81505a0 con 0x7f59e8154440 2023-08-17T17:35:18.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.532+0000 7f59ef3e0700 1 -- 172.21.15.78:0/3458506681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e80c1fa0 con 0x7f59e8154440 2023-08-17T17:35:18.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.533+0000 7f59dd7fa700 1 -- 172.21.15.78:0/3458506681 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f59e0025030 con 0x7f59e8154440 2023-08-17T17:35:18.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.533+0000 7f59dd7fa700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f59cc05ede0 0x7f59cc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.533+0000 7f59ed17c700 1 -- 172.21.15.78:0/3458506681 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f59cc05ede0 msgr2=0x7f59cc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:35:18.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.534+0000 7f59dd7fa700 1 -- 172.21.15.78:0/3458506681 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f59e007b200 con 0x7f59e8154440 2023-08-17T17:35:18.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.534+0000 7f59ed17c700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f59cc05ede0 0x7f59cc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:35:18.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.538+0000 7f59dd7fa700 1 -- 172.21.15.78:0/3458506681 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59e80c1fa0 con 0x7f59e8154440 2023-08-17T17:35:18.597 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:18.596+0000 7f46d08e4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:35:18.597 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:18.596+0000 7fa958dcf680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:35:18.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.706+0000 7f59ef3e0700 1 -- 172.21.15.78:0/3458506681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f59e80c1fa0 con 0x7f59e8154440 2023-08-17T17:35:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.712+0000 7f59dd7fa700 1 -- 172.21.15.78:0/3458506681 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v3)=0 v3) v1 ==== 138+0+0 (secure 0 0 0) 0x7f59e80c1fa0 con 0x7f59e8154440 2023-08-17T17:35:18.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 -- 172.21.15.78:0/3458506681 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f59cc05ede0 msgr2=0x7f59cc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:35:18.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f59cc05ede0 0x7f59cc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:18.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 -- 172.21.15.78:0/3458506681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e8154440 msgr2=0x7f59e815a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e8154440 0x7f59e815a0e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f59e000b6c0 tx=0x7f59e0009840).stop 2023-08-17T17:35:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 -- 172.21.15.78:0/3458506681 shutdown_connections 2023-08-17T17:35:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f59cc05ede0 0x7f59cc0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59e8154440 0x7f59e815a0e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80bfea0 0x7f59e81500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 --2- 172.21.15.78:0/3458506681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59e80c6f00 0x7f59e80c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 -- 172.21.15.78:0/3458506681 >> 172.21.15.78:0/3458506681 conn(0x7f59e806a400 msgr2=0x7f59e80c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:18.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 -- 172.21.15.78:0/3458506681 shutdown_connections 2023-08-17T17:35:18.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.714+0000 7f59ef3e0700 1 -- 172.21.15.78:0/3458506681 wait complete. 2023-08-17T17:35:18.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:18.726 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-17T17:35:18.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:18.746 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-08-17T17:35:18.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-08-17T17:35:18.875 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:18.874+0000 7f46d08e4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:35:18.883 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:18.883+0000 7fa958dcf680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:35:18.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.963+0000 7fddd6f24700 1 Processor -- start 2023-08-17T17:35:18.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.963+0000 7fddd6f24700 1 -- start start 2023-08-17T17:35:18.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.963+0000 7fddd6f24700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fddd013b890 0x7fddd0155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.963+0000 7fddd6f24700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddd01568d0 0x7fddd00bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.963+0000 7fddd6f24700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd00a5a20 con 0x7fddd013bc70 2023-08-17T17:35:18.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.963+0000 7fddd6f24700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd00c32d0 con 0x7fddd01568d0 2023-08-17T17:35:18.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.963+0000 7fddd6f24700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd00c3570 con 0x7fddd013b890 2023-08-17T17:35:18.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddd54c1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddd01568d0 0x7fddd00bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:18.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddcffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fddd013bc70 0x7fddd01561c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43822/0 (socket says 172.21.15.78:43822) 2023-08-17T17:35:18.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddcffff700 1 -- 172.21.15.78:0/2529156051 learned_addr learned my addr 172.21.15.78:0/2529156051 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:18.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddd54c1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddd01568d0 0x7fddd00bdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39522/0 (socket says 172.21.15.78:39522) 2023-08-17T17:35:18.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddd4cc0700 1 --2- 172.21.15.78:0/2529156051 >> v2:172.21.15.150:3300/0 conn(0x7fddd013b890 0x7fddd0155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:18.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddd54c1700 1 -- 172.21.15.78:0/2529156051 >> v2:172.21.15.150:3300/0 conn(0x7fddd013b890 msgr2=0x7fddd0155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:18.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddd54c1700 1 --2- 172.21.15.78:0/2529156051 >> v2:172.21.15.150:3300/0 conn(0x7fddd013b890 0x7fddd0155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddd54c1700 1 -- 172.21.15.78:0/2529156051 >> v1:172.21.15.78:6789/0 conn(0x7fddd013bc70 legacy=0x7fddd01561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddcf7fe700 1 -- 172.21.15.78:0/2529156051 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927594898 0 0) 0x7fddd00a5a20 con 0x7fddd013bc70 2023-08-17T17:35:18.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddd54c1700 1 -- 172.21.15.78:0/2529156051 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00bfad0 con 0x7fddd01568d0 2023-08-17T17:35:18.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddd4cc0700 1 --2- 172.21.15.78:0/2529156051 >> v2:172.21.15.150:3300/0 conn(0x7fddd013b890 0x7fddd0155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:18.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddd54c1700 1 --2- 172.21.15.78:0/2529156051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd01568d0 0x7fddd00bdc30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fddd005feb0 tx=0x7fddc8009780).ready entity=mon.0 client_cookie=e96c666c71c2e26f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:18.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddcf7fe700 1 -- 172.21.15.78:0/2529156051 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800e070 con 0x7fddd01568d0 2023-08-17T17:35:18.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddcf7fe700 1 -- 172.21.15.78:0/2529156051 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc800bc30 con 0x7fddd01568d0 2023-08-17T17:35:18.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.964+0000 7fddcf7fe700 1 -- 172.21.15.78:0/2529156051 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8012410 con 0x7fddd01568d0 2023-08-17T17:35:18.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.965+0000 7fddd6f24700 1 -- 172.21.15.78:0/2529156051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd01568d0 msgr2=0x7fddd00bdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.965+0000 7fddd6f24700 1 --2- 172.21.15.78:0/2529156051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd01568d0 0x7fddd00bdc30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fddd005feb0 tx=0x7fddc8009780).stop 2023-08-17T17:35:18.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.965+0000 7fddd6f24700 1 -- 172.21.15.78:0/2529156051 shutdown_connections 2023-08-17T17:35:18.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.965+0000 7fddd6f24700 1 --2- 172.21.15.78:0/2529156051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd01568d0 0x7fddd00bdc30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.965+0000 7fddd6f24700 1 --2- 172.21.15.78:0/2529156051 >> v2:172.21.15.150:3300/0 conn(0x7fddd013b890 0x7fddd0155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.965+0000 7fddd6f24700 1 -- 172.21.15.78:0/2529156051 >> 172.21.15.78:0/2529156051 conn(0x7fddd0062f80 msgr2=0x7fddd00c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:18.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.965+0000 7fddd6f24700 1 -- 172.21.15.78:0/2529156051 shutdown_connections 2023-08-17T17:35:18.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.965+0000 7fddd6f24700 1 -- 172.21.15.78:0/2529156051 wait complete. 2023-08-17T17:35:18.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.966+0000 7fddd6f24700 1 Processor -- start 2023-08-17T17:35:18.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.966+0000 7fddd6f24700 1 -- start start 2023-08-17T17:35:18.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddd6f24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd013b890 0x7fddd01368e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddd6f24700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd013bc70 0x7fddd00ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddd6f24700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd01568d0 0x7fddd00ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddd6f24700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd01378d0 con 0x7fddd013b890 2023-08-17T17:35:18.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddd6f24700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd0136dd0 con 0x7fddd01568d0 2023-08-17T17:35:18.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddd6f24700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd0137030 con 0x7fddd013bc70 2023-08-17T17:35:18.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddd4cc0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd013b890 0x7fddd01368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:18.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddd4cc0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd013b890 0x7fddd01368e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39532/0 (socket says 172.21.15.78:39532) 2023-08-17T17:35:18.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddd4cc0700 1 -- 172.21.15.78:0/4183016807 learned_addr learned my addr 172.21.15.78:0/4183016807 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:18.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddd54c1700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd01568d0 0x7fddd00ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:18.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.967+0000 7fddcffff700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd013bc70 0x7fddd00ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:18.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddd4cc0700 1 -- 172.21.15.78:0/4183016807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd013bc70 msgr2=0x7fddd00ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddd4cc0700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd013bc70 0x7fddd00ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddd4cc0700 1 -- 172.21.15.78:0/4183016807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd01568d0 msgr2=0x7fddd00ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:18.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddd4cc0700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd01568d0 0x7fddd00ac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:18.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddd4cc0700 1 -- 172.21.15.78:0/4183016807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc8009a20 con 0x7fddd013b890 2023-08-17T17:35:18.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddd4cc0700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd013b890 0x7fddd01368e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fddc400d860 tx=0x7fddc4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:18.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400f520 con 0x7fddd013b890 2023-08-17T17:35:18.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc400f680 con 0x7fddd013b890 2023-08-17T17:35:18.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddd6f24700 1 -- 172.21.15.78:0/4183016807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd0137310 con 0x7fddd013b890 2023-08-17T17:35:18.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400fa00 con 0x7fddd013b890 2023-08-17T17:35:18.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.968+0000 7fddd6f24700 1 -- 172.21.15.78:0/4183016807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd00a9e70 con 0x7fddd013b890 2023-08-17T17:35:18.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.969+0000 7fddd6f24700 1 -- 172.21.15.78:0/4183016807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd00aa1e0 con 0x7fddd013b890 2023-08-17T17:35:18.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.969+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fddc401a030 con 0x7fddd013b890 2023-08-17T17:35:18.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.970+0000 7fddccff9700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb4061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:18.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.970+0000 7fddcffff700 1 -- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 msgr2=0x7fddb4061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:35:18.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.970+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fddc40796f0 con 0x7fddd013b890 2023-08-17T17:35:18.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.970+0000 7fddcffff700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:35:18.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:18.974+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fddc404ac90 con 0x7fddd013b890 2023-08-17T17:35:19.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:19.168+0000 7fddd6f24700 1 -- 172.21.15.78:0/4183016807 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fddd0138650 con 0x7fddb405edb0 2023-08-17T17:35:19.492 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:19.487+0000 7f46d08e4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:35:19.504 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:19.504+0000 7fa958dcf680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:35:19.560 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:19.559+0000 7f46d08e4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:35:19.576 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:19.576+0000 7fa958dcf680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:35:19.746 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:19.745+0000 7f46d08e4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:35:19.760 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:19.760+0000 7fa958dcf680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:35:20.166 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:20.165+0000 7f46d08e4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:35:20.175 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:20.175+0000 7fa958dcf680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:35:20.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:20.188+0000 7fddcffff700 1 -- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 msgr2=0x7fddb4061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:35:20.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:20.188+0000 7fddcffff700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:35:20.269 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:20.268+0000 7f46d08e4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:35:20.279 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:20.279+0000 7fa958dcf680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:35:20.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:20.421+0000 7f46d08e4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:35:20.429 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:20.429+0000 7fa958dcf680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:35:20.496 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:20.495+0000 7f46d08e4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:35:20.502 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:20.502+0000 7fa958dcf680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:35:20.563 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:20.562+0000 7f46d08e4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:35:20.569 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:20.569+0000 7fa958dcf680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:35:20.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:20.589+0000 7fddcffff700 1 -- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 msgr2=0x7fddb4061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:35:20.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:20.589+0000 7fddcffff700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T17:35:20.821 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:20.820+0000 7f46d08e4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:35:20.824 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:20.824+0000 7fa958dcf680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:35:21.004 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:21.003+0000 7f46d08e4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:35:21.006 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:21.006+0000 7fa958dcf680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:35:21.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:21.390+0000 7fddcffff700 1 -- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 msgr2=0x7fddb4061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:35:21.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:21.390+0000 7fddcffff700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T17:35:21.649 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:21.649+0000 7fa958dcf680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:35:21.659 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:21.658+0000 7f46d08e4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:35:21.716 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:21.715+0000 7fa958dcf680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:35:21.726 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:21.725+0000 7f46d08e4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:35:21.789 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:21.788+0000 7fa958dcf680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:35:21.801 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:21.800+0000 7f46d08e4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:35:21.932 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:21.931+0000 7fa958dcf680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:35:21.945 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:21.944+0000 7f46d08e4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:35:22.001 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.000+0000 7fa958dcf680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:35:22.014 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:22.013+0000 7f46d08e4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:35:22.114 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.114+0000 7fa958dcf680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:35:22.128 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:22.127+0000 7f46d08e4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:35:22.220 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.220+0000 7fa958dcf680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:35:22.234 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:22.234+0000 7f46d08e4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:35:22.507 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.506+0000 7fa958dcf680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:35:22.527 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:22.526+0000 7f46d08e4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:35:22.576 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.576+0000 7fa958dcf680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:35:22.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:22.594+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 6) v1 ==== 75109+0+0 (secure 0 0 0) 0x7fddc400fd70 con 0x7fddd013b890 2023-08-17T17:35:22.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:22.595+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 msgr2=0x7fddb4061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:35:22.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:22.595+0000 7fddccff9700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:22.600 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:35:22.599+0000 7f46d08e4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:35:22.663 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.663+0000 7fa8d75ad700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:35:22.664 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.663+0000 7fa8d75ad700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:35:22.664 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.663+0000 7fa8d75ad700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:35:22.664 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.663+0000 7fa8d75ad700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:35:22.664 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.663+0000 7fa8d75ad700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:35:22.664 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.663+0000 7fa8d3da6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:35:22.664 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.663+0000 7fa8d3da6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:35:22.664 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.663+0000 7fa8d3da6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:35:22.665 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.663+0000 7fa8d3da6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:35:22.665 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:35:22.663+0000 7fa8d3da6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:35:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.598+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fddc4077970 con 0x7fddd013b890 2023-08-17T17:35:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.598+0000 7fddccff9700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb402fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.598+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fddd0138650 con 0x7fddb405edb0 2023-08-17T17:35:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.599+0000 7fddcffff700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb402fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.601+0000 7fddcffff700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb402fd10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fddd0138ce0 tx=0x7fddbc007bd0).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.635+0000 7fddccff9700 1 -- 172.21.15.78:0/4183016807 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fddd0138650 con 0x7fddb405edb0 2023-08-17T17:35:23.636 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/dir0 2023-08-17T17:35:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 -- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 msgr2=0x7fddb402fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb402fd10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fddd0138ce0 tx=0x7fddbc007bd0).stop 2023-08-17T17:35:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 -- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd013b890 msgr2=0x7fddd01368e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd013b890 0x7fddd01368e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fddc400d860 tx=0x7fddc4008040).stop 2023-08-17T17:35:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 -- 172.21.15.78:0/4183016807 shutdown_connections 2023-08-17T17:35:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddb405edb0 0x7fddb402fd10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd01568d0 0x7fddd00ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd013b890 0x7fddd01368e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 --2- 172.21.15.78:0/4183016807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd013bc70 0x7fddd00ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 -- 172.21.15.78:0/4183016807 >> 172.21.15.78:0/4183016807 conn(0x7fddd0062f80 msgr2=0x7fddd00c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:23.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 -- 172.21.15.78:0/4183016807 shutdown_connections 2023-08-17T17:35:23.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.638+0000 7fddd6f24700 1 -- 172.21.15.78:0/4183016807 wait complete. 2023-08-17T17:35:23.652 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-08-17T17:35:23.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:23.653 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-08-17T17:35:23.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-08-17T17:35:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.868+0000 7f08da4da700 1 Processor -- start 2023-08-17T17:35:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.868+0000 7f08da4da700 1 -- start start 2023-08-17T17:35:23.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08da4da700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08d40aa0f0 0x7f08d40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:23.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08da4da700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f08d40aa4d0 0x7f08d40c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:23.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08da4da700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d40649b0 con 0x7f08d40c5810 2023-08-17T17:35:23.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08da4da700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d4063420 con 0x7f08d40aa0f0 2023-08-17T17:35:23.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08da4da700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d4063700 con 0x7f08d40aa4d0 2023-08-17T17:35:23.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08d3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08d40aa0f0 0x7f08d40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08d3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08d40aa0f0 0x7f08d40644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39662/0 (socket says 172.21.15.78:39662) 2023-08-17T17:35:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08d3fff700 1 -- 172.21.15.78:0/3166582903 learned_addr learned my addr 172.21.15.78:0/3166582903 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08d37fe700 1 --2- 172.21.15.78:0/3166582903 >> v2:172.21.15.150:3300/0 conn(0x7f08d40aa4d0 0x7f08d40c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08d3fff700 1 -- 172.21.15.78:0/3166582903 >> v2:172.21.15.150:3300/0 conn(0x7f08d40aa4d0 msgr2=0x7f08d40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08d3fff700 1 --2- 172.21.15.78:0/3166582903 >> v2:172.21.15.150:3300/0 conn(0x7f08d40aa4d0 0x7f08d40c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.869+0000 7f08d3fff700 1 -- 172.21.15.78:0/3166582903 >> v1:172.21.15.150:6789/0 conn(0x7f08d40c5810 legacy=0x7f08d40a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08d3fff700 1 -- 172.21.15.78:0/3166582903 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40639e0 con 0x7f08d40aa0f0 2023-08-17T17:35:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08d3fff700 1 --2- 172.21.15.78:0/3166582903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40aa0f0 0x7f08d40644c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f08d4159060 tx=0x7f08c40090f0).ready entity=mon.0 client_cookie=e5949bea68c18d44 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08d2ffd700 1 -- 172.21.15.78:0/3166582903 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400b5a0 con 0x7f08d40aa0f0 2023-08-17T17:35:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08d2ffd700 1 -- 172.21.15.78:0/3166582903 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c400b700 con 0x7f08d40aa0f0 2023-08-17T17:35:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08d2ffd700 1 -- 172.21.15.78:0/3166582903 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400ba80 con 0x7f08d40aa0f0 2023-08-17T17:35:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08da4da700 1 -- 172.21.15.78:0/3166582903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40aa0f0 msgr2=0x7f08d40644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08da4da700 1 --2- 172.21.15.78:0/3166582903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40aa0f0 0x7f08d40644c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f08d4159060 tx=0x7f08c40090f0).stop 2023-08-17T17:35:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08da4da700 1 -- 172.21.15.78:0/3166582903 shutdown_connections 2023-08-17T17:35:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08da4da700 1 --2- 172.21.15.78:0/3166582903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40aa0f0 0x7f08d40644c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08da4da700 1 --2- 172.21.15.78:0/3166582903 >> v2:172.21.15.150:3300/0 conn(0x7f08d40aa4d0 0x7f08d40c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08da4da700 1 -- 172.21.15.78:0/3166582903 >> 172.21.15.78:0/3166582903 conn(0x7f08d406a6a0 msgr2=0x7f08d40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08da4da700 1 -- 172.21.15.78:0/3166582903 shutdown_connections 2023-08-17T17:35:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.870+0000 7f08da4da700 1 -- 172.21.15.78:0/3166582903 wait complete. 2023-08-17T17:35:23.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.871+0000 7f08da4da700 1 Processor -- start 2023-08-17T17:35:23.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.872+0000 7f08da4da700 1 -- start start 2023-08-17T17:35:23.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.872+0000 7f08da4da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08d40aa0f0 0x7f08d41495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:23.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.872+0000 7f08da4da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08d40aa4d0 0x7f08d414b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:23.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.872+0000 7f08da4da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40c5810 0x7f08d414b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:23.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.872+0000 7f08da4da700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40ab7b0 con 0x7f08d40c5810 2023-08-17T17:35:23.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.872+0000 7f08da4da700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40abd70 con 0x7f08d40aa0f0 2023-08-17T17:35:23.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.872+0000 7f08da4da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40b0850 con 0x7f08d40aa4d0 2023-08-17T17:35:23.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.872+0000 7f08d8a77700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40c5810 0x7f08d414b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08d8a77700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40c5810 0x7f08d414b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39678/0 (socket says 172.21.15.78:39678) 2023-08-17T17:35:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08d3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08d40aa0f0 0x7f08d41495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08d8a77700 1 -- 172.21.15.78:0/2410647961 learned_addr learned my addr 172.21.15.78:0/2410647961 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08d37fe700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08d40aa4d0 0x7f08d414b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08d8a77700 1 -- 172.21.15.78:0/2410647961 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08d40aa4d0 msgr2=0x7f08d414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08d8a77700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08d40aa4d0 0x7f08d414b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08d8a77700 1 -- 172.21.15.78:0/2410647961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08d40aa0f0 msgr2=0x7f08d41495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08d8a77700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08d40aa0f0 0x7f08d41495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08d8a77700 1 -- 172.21.15.78:0/2410647961 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4009370 con 0x7f08d40c5810 2023-08-17T17:35:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08d8a77700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40c5810 0x7f08d414b690 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f08cc00b840 tx=0x7f08cc009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08bbfff700 1 -- 172.21.15.78:0/2410647961 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00d4a0 con 0x7f08d40c5810 2023-08-17T17:35:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08bbfff700 1 -- 172.21.15.78:0/2410647961 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc00d600 con 0x7f08d40c5810 2023-08-17T17:35:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08da4da700 1 -- 172.21.15.78:0/2410647961 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d40b0b30 con 0x7f08d40c5810 2023-08-17T17:35:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08bbfff700 1 -- 172.21.15.78:0/2410647961 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00d9c0 con 0x7f08d40c5810 2023-08-17T17:35:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.873+0000 7f08da4da700 1 -- 172.21.15.78:0/2410647961 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d414bb80 con 0x7f08d40c5810 2023-08-17T17:35:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.874+0000 7f08da4da700 1 -- 172.21.15.78:0/2410647961 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d4083980 con 0x7f08d40c5810 2023-08-17T17:35:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.874+0000 7f08bbfff700 1 -- 172.21.15.78:0/2410647961 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f08cc018030 con 0x7f08d40c5810 2023-08-17T17:35:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.875+0000 7f08bbfff700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08c005ed40 0x7f08c0061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.875+0000 7f08bbfff700 1 -- 172.21.15.78:0/2410647961 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f08cc0791d0 con 0x7f08d40c5810 2023-08-17T17:35:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.875+0000 7f08d3fff700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08c005ed40 0x7f08c0061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.875+0000 7f08d3fff700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08c005ed40 0x7f08c0061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f08c4009130 tx=0x7f08c4015000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:23.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:23.879+0000 7f08bbfff700 1 -- 172.21.15.78:0/2410647961 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f08cc0478f0 con 0x7f08d40c5810 2023-08-17T17:35:24.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.067+0000 7f08da4da700 1 -- 172.21.15.78:0/2410647961 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f08d40abeb0 con 0x7f08c005ed40 2023-08-17T17:35:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.070+0000 7f08bbfff700 1 -- 172.21.15.78:0/2410647961 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f08d40abeb0 con 0x7f08c005ed40 2023-08-17T17:35:24.072 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/dir1 2023-08-17T17:35:24.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.072+0000 7f08da4da700 1 -- 172.21.15.78:0/2410647961 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08c005ed40 msgr2=0x7f08c0061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.072+0000 7f08da4da700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08c005ed40 0x7f08c0061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f08c4009130 tx=0x7f08c4015000).stop 2023-08-17T17:35:24.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.072+0000 7f08da4da700 1 -- 172.21.15.78:0/2410647961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40c5810 msgr2=0x7f08d414b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.072+0000 7f08da4da700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40c5810 0x7f08d414b690 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f08cc00b840 tx=0x7f08cc009290).stop 2023-08-17T17:35:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.072+0000 7f08da4da700 1 -- 172.21.15.78:0/2410647961 shutdown_connections 2023-08-17T17:35:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.072+0000 7f08da4da700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08c005ed40 0x7f08c0061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.072+0000 7f08da4da700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d40c5810 0x7f08d414b690 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.072+0000 7f08da4da700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08d40aa0f0 0x7f08d41495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.073+0000 7f08da4da700 1 --2- 172.21.15.78:0/2410647961 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08d40aa4d0 0x7f08d414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.073+0000 7f08da4da700 1 -- 172.21.15.78:0/2410647961 >> 172.21.15.78:0/2410647961 conn(0x7f08d406a6a0 msgr2=0x7f08d40a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.073+0000 7f08da4da700 1 -- 172.21.15.78:0/2410647961 shutdown_connections 2023-08-17T17:35:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.073+0000 7f08da4da700 1 -- 172.21.15.78:0/2410647961 wait complete. 2023-08-17T17:35:24.086 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-08-17T17:35:24.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:24.087 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-08-17T17:35:24.102 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-08-17T17:35:24.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.258+0000 7f20294e4700 1 Processor -- start 2023-08-17T17:35:24.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.258+0000 7f20294e4700 1 -- start start 2023-08-17T17:35:24.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.258+0000 7f20294e4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2024151a40 0x7f20240c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.258+0000 7f20294e4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2024151e20 0x7f20240c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.258+0000 7f20294e4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20240c6620 con 0x7f2024157be0 2023-08-17T17:35:24.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.258+0000 7f20294e4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240c6900 con 0x7f2024151a40 2023-08-17T17:35:24.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.258+0000 7f20294e4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240c6be0 con 0x7f2024151e20 2023-08-17T17:35:24.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2023fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2024151a40 0x7f20240c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2023fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2024151a40 0x7f20240c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39686/0 (socket says 172.21.15.78:39686) 2023-08-17T17:35:24.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2023fff700 1 -- 172.21.15.78:0/3036977854 learned_addr learned my addr 172.21.15.78:0/3036977854 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:24.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f20237fe700 1 --2- 172.21.15.78:0/3036977854 >> v2:172.21.15.150:3300/0 conn(0x7f2024151e20 0x7f20240c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2023fff700 1 -- 172.21.15.78:0/3036977854 >> v2:172.21.15.150:3300/0 conn(0x7f2024151e20 msgr2=0x7f20240c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:24.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2023fff700 1 --2- 172.21.15.78:0/3036977854 >> v2:172.21.15.150:3300/0 conn(0x7f2024151e20 0x7f20240c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2023fff700 1 -- 172.21.15.78:0/3036977854 >> v1:172.21.15.150:6789/0 conn(0x7f2024157be0 legacy=0x7f2024154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:24.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2023fff700 1 -- 172.21.15.78:0/3036977854 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240c6ec0 con 0x7f2024151a40 2023-08-17T17:35:24.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2023fff700 1 --2- 172.21.15.78:0/3036977854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151a40 0x7f20240c8260 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f2024065360 tx=0x7f2014009060).ready entity=mon.0 client_cookie=741247f8e81ef848 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:24.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2022ffd700 1 -- 172.21.15.78:0/3036977854 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014005880 con 0x7f2024151a40 2023-08-17T17:35:24.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2022ffd700 1 -- 172.21.15.78:0/3036977854 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20140059e0 con 0x7f2024151a40 2023-08-17T17:35:24.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.259+0000 7f2022ffd700 1 -- 172.21.15.78:0/3036977854 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014005d60 con 0x7f2024151a40 2023-08-17T17:35:24.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.260+0000 7f20294e4700 1 -- 172.21.15.78:0/3036977854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151a40 msgr2=0x7f20240c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.260+0000 7f20294e4700 1 --2- 172.21.15.78:0/3036977854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151a40 0x7f20240c8260 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f2024065360 tx=0x7f2014009060).stop 2023-08-17T17:35:24.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.260+0000 7f20294e4700 1 -- 172.21.15.78:0/3036977854 shutdown_connections 2023-08-17T17:35:24.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.260+0000 7f20294e4700 1 --2- 172.21.15.78:0/3036977854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151a40 0x7f20240c8260 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.260+0000 7f20294e4700 1 --2- 172.21.15.78:0/3036977854 >> v2:172.21.15.150:3300/0 conn(0x7f2024151e20 0x7f20240c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.260+0000 7f20294e4700 1 -- 172.21.15.78:0/3036977854 >> 172.21.15.78:0/3036977854 conn(0x7f20240943b0 msgr2=0x7f202406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:24.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.260+0000 7f20294e4700 1 -- 172.21.15.78:0/3036977854 shutdown_connections 2023-08-17T17:35:24.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.260+0000 7f20294e4700 1 -- 172.21.15.78:0/3036977854 wait complete. 2023-08-17T17:35:24.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.261+0000 7f20294e4700 1 Processor -- start 2023-08-17T17:35:24.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.261+0000 7f20294e4700 1 -- start start 2023-08-17T17:35:24.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20294e4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2024151a40 0x7f2024156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20294e4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151e20 0x7f20241670a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20294e4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2024157be0 0x7f2024167900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20294e4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20240ab3a0 con 0x7f2024151e20 2023-08-17T17:35:24.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20294e4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20240ab680 con 0x7f2024151a40 2023-08-17T17:35:24.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20294e4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20240ab960 con 0x7f2024157be0 2023-08-17T17:35:24.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20237fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151e20 0x7f20241670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20237fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151e20 0x7f20241670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39698/0 (socket says 172.21.15.78:39698) 2023-08-17T17:35:24.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20237fe700 1 -- 172.21.15.78:0/2774513921 learned_addr learned my addr 172.21.15.78:0/2774513921 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:24.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f2023fff700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2024151a40 0x7f2024156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20237fe700 1 -- 172.21.15.78:0/2774513921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2024157be0 msgr2=0x7f2024167900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20237fe700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2024157be0 0x7f2024167900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:24.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20237fe700 1 -- 172.21.15.78:0/2774513921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2024151a40 msgr2=0x7f2024156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20237fe700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2024151a40 0x7f2024156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20237fe700 1 -- 172.21.15.78:0/2774513921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014009300 con 0x7f2024151e20 2023-08-17T17:35:24.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f20237fe700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151e20 0x7f20241670a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f201800c880 tx=0x7f2018008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:24.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f200bfff700 1 -- 172.21.15.78:0/2774513921 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018010580 con 0x7f2024151e20 2023-08-17T17:35:24.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.262+0000 7f200bfff700 1 -- 172.21.15.78:0/2774513921 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20180106e0 con 0x7f2024151e20 2023-08-17T17:35:24.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.263+0000 7f20294e4700 1 -- 172.21.15.78:0/2774513921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20240abc40 con 0x7f2024151e20 2023-08-17T17:35:24.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.263+0000 7f200bfff700 1 -- 172.21.15.78:0/2774513921 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018010a60 con 0x7f2024151e20 2023-08-17T17:35:24.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.263+0000 7f20294e4700 1 -- 172.21.15.78:0/2774513921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2024167590 con 0x7f2024151e20 2023-08-17T17:35:24.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.263+0000 7f20294e4700 1 -- 172.21.15.78:0/2774513921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2024165500 con 0x7f2024151e20 2023-08-17T17:35:24.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.264+0000 7f200bfff700 1 -- 172.21.15.78:0/2774513921 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f201801b460 con 0x7f2024151e20 2023-08-17T17:35:24.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.264+0000 7f200bfff700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f201005ed40 0x7f2010061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.264+0000 7f200bfff700 1 -- 172.21.15.78:0/2774513921 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2018079ca0 con 0x7f2024151e20 2023-08-17T17:35:24.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.264+0000 7f2023fff700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f201005ed40 0x7f2010061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.264+0000 7f2023fff700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f201005ed40 0x7f2010061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f201400b360 tx=0x7f2014016000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:24.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.268+0000 7f200bfff700 1 -- 172.21.15.78:0/2774513921 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2024165500 con 0x7f2024151e20 2023-08-17T17:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.454+0000 7f20294e4700 1 -- 172.21.15.78:0/2774513921 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2024165500 con 0x7f201005ed40 2023-08-17T17:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.458+0000 7f200bfff700 1 -- 172.21.15.78:0/2774513921 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2024165500 con 0x7f201005ed40 2023-08-17T17:35:24.459 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/dir2 2023-08-17T17:35:24.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.459+0000 7f20294e4700 1 -- 172.21.15.78:0/2774513921 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f201005ed40 msgr2=0x7f2010061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.459+0000 7f20294e4700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f201005ed40 0x7f2010061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f201400b360 tx=0x7f2014016000).stop 2023-08-17T17:35:24.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.459+0000 7f20294e4700 1 -- 172.21.15.78:0/2774513921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151e20 msgr2=0x7f20241670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.459+0000 7f20294e4700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151e20 0x7f20241670a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f201800c880 tx=0x7f2018008040).stop 2023-08-17T17:35:24.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.459+0000 7f20294e4700 1 -- 172.21.15.78:0/2774513921 shutdown_connections 2023-08-17T17:35:24.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.459+0000 7f20294e4700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f201005ed40 0x7f2010061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.459+0000 7f20294e4700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2024157be0 0x7f2024167900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:24.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.459+0000 7f20294e4700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2024151a40 0x7f2024156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.459+0000 7f20294e4700 1 --2- 172.21.15.78:0/2774513921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2024151e20 0x7f20241670a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.459+0000 7f20294e4700 1 -- 172.21.15.78:0/2774513921 >> 172.21.15.78:0/2774513921 conn(0x7f20240943b0 msgr2=0x7f20240c0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:24.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.460+0000 7f20294e4700 1 -- 172.21.15.78:0/2774513921 shutdown_connections 2023-08-17T17:35:24.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.460+0000 7f20294e4700 1 -- 172.21.15.78:0/2774513921 wait complete. 2023-08-17T17:35:24.473 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-08-17T17:35:24.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:24.473 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-08-17T17:35:24.489 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-08-17T17:35:24.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.647+0000 7f96199aa700 1 Processor -- start 2023-08-17T17:35:24.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.647+0000 7f96199aa700 1 -- start start 2023-08-17T17:35:24.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f96199aa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9614151a40 0x7f96140c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f96199aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151e20 0x7f96140c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f96199aa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96140c6620 con 0x7f9614157be0 2023-08-17T17:35:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f96199aa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96140c6900 con 0x7f9614151a40 2023-08-17T17:35:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f96199aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96140c6be0 con 0x7f9614151e20 2023-08-17T17:35:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f9613fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151e20 0x7f96140c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f96189a8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9614151a40 0x7f96140c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f96191a9700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9614157be0 0x7f9614154610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:57204/0 (socket says 172.21.15.78:57204) 2023-08-17T17:35:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f96191a9700 1 -- 172.21.15.78:0/1972679207 learned_addr learned my addr 172.21.15.78:0/1972679207 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f9613fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151e20 0x7f96140c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:59836/0 (socket says 172.21.15.78:59836) 2023-08-17T17:35:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.648+0000 7f96189a8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9614151a40 0x7f96140c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:36074/0 (socket says 172.21.15.78:36074) 2023-08-17T17:35:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96189a8700 1 -- 172.21.15.78:0/1972679207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151e20 msgr2=0x7f96140c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96189a8700 1 --2- 172.21.15.78:0/1972679207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151e20 0x7f96140c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96189a8700 1 -- 172.21.15.78:0/1972679207 >> v1:172.21.15.150:6789/0 conn(0x7f9614157be0 legacy=0x7f9614154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96189a8700 1 -- 172.21.15.78:0/1972679207 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140c6ec0 con 0x7f9614151a40 2023-08-17T17:35:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96137fe700 1 -- 172.21.15.78:0/1972679207 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808579181 0 0) 0x7f96140c6620 con 0x7f9614157be0 2023-08-17T17:35:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f9613fff700 1 --2- 172.21.15.78:0/1972679207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151e20 0x7f96140c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:35:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96189a8700 1 --2- 172.21.15.78:0/1972679207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9614151a40 0x7f96140c8260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f9608006fd0 tx=0x7f9608006f40).ready entity=mon.1 client_cookie=c1ccbbf7c9615352 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96137fe700 1 -- 172.21.15.78:0/1972679207 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608005880 con 0x7f9614151a40 2023-08-17T17:35:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96137fe700 1 -- 172.21.15.78:0/1972679207 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96080059e0 con 0x7f9614151a40 2023-08-17T17:35:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96137fe700 1 -- 172.21.15.78:0/1972679207 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608005d60 con 0x7f9614151a40 2023-08-17T17:35:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96199aa700 1 -- 172.21.15.78:0/1972679207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9614151a40 msgr2=0x7f96140c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96199aa700 1 --2- 172.21.15.78:0/1972679207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9614151a40 0x7f96140c8260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f9608006fd0 tx=0x7f9608006f40).stop 2023-08-17T17:35:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96199aa700 1 -- 172.21.15.78:0/1972679207 shutdown_connections 2023-08-17T17:35:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96199aa700 1 --2- 172.21.15.78:0/1972679207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9614151a40 0x7f96140c8260 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96199aa700 1 --2- 172.21.15.78:0/1972679207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151e20 0x7f96140c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96199aa700 1 -- 172.21.15.78:0/1972679207 >> 172.21.15.78:0/1972679207 conn(0x7f96140943b0 msgr2=0x7f961406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96199aa700 1 -- 172.21.15.78:0/1972679207 shutdown_connections 2023-08-17T17:35:24.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.649+0000 7f96199aa700 1 -- 172.21.15.78:0/1972679207 wait complete. 2023-08-17T17:35:24.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.650+0000 7f96199aa700 1 Processor -- start 2023-08-17T17:35:24.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.651+0000 7f96199aa700 1 -- start start 2023-08-17T17:35:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.651+0000 7f96199aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151a40 0x7f9614168270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.651+0000 7f96199aa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9614151e20 0x7f96140c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.651+0000 7f96199aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9614157be0 0x7f961414c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.651+0000 7f96199aa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9614168760 con 0x7f9614157be0 2023-08-17T17:35:24.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.651+0000 7f96199aa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96140aaa40 con 0x7f9614151e20 2023-08-17T17:35:24.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.651+0000 7f96199aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96140aad20 con 0x7f9614151a40 2023-08-17T17:35:24.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96191a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9614157be0 0x7f961414c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96191a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9614157be0 0x7f961414c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39710/0 (socket says 172.21.15.78:39710) 2023-08-17T17:35:24.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96191a9700 1 -- 172.21.15.78:0/1047638357 learned_addr learned my addr 172.21.15.78:0/1047638357 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:24.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96189a8700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151a40 0x7f9614168270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f9613fff700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9614151e20 0x7f96140c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96191a9700 1 -- 172.21.15.78:0/1047638357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151a40 msgr2=0x7f9614168270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96191a9700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151a40 0x7f9614168270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96191a9700 1 -- 172.21.15.78:0/1047638357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9614151e20 msgr2=0x7f96140c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96191a9700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9614151e20 0x7f96140c12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96191a9700 1 -- 172.21.15.78:0/1047638357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600009250 con 0x7f9614157be0 2023-08-17T17:35:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96191a9700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9614157be0 0x7f961414c370 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f960c00c730 tx=0x7f960c001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f9610ff9700 1 -- 172.21.15.78:0/1047638357 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c005d30 con 0x7f9614157be0 2023-08-17T17:35:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f9610ff9700 1 -- 172.21.15.78:0/1047638357 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c005e90 con 0x7f9614157be0 2023-08-17T17:35:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f9610ff9700 1 -- 172.21.15.78:0/1047638357 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c007340 con 0x7f9614157be0 2023-08-17T17:35:24.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96199aa700 1 -- 172.21.15.78:0/1047638357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9608009250 con 0x7f9614157be0 2023-08-17T17:35:24.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.652+0000 7f96199aa700 1 -- 172.21.15.78:0/1047638357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96140ab2e0 con 0x7f9614157be0 2023-08-17T17:35:24.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.653+0000 7f96199aa700 1 -- 172.21.15.78:0/1047638357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9614082f90 con 0x7f9614157be0 2023-08-17T17:35:24.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.653+0000 7f9610ff9700 1 -- 172.21.15.78:0/1047638357 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f960c010030 con 0x7f9614157be0 2023-08-17T17:35:24.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.654+0000 7f9610ff9700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95f805ed40 0x7f95f8061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:24.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.654+0000 7f9610ff9700 1 -- 172.21.15.78:0/1047638357 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f960c0799c0 con 0x7f9614157be0 2023-08-17T17:35:24.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.654+0000 7f96189a8700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95f805ed40 0x7f95f8061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:24.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.654+0000 7f96189a8700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95f805ed40 0x7f95f8061200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9608006fa0 tx=0x7f9608016000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:24.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.658+0000 7f9610ff9700 1 -- 172.21.15.78:0/1047638357 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f960c04af50 con 0x7f9614157be0 2023-08-17T17:35:24.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.844+0000 7f96199aa700 1 -- 172.21.15.78:0/1047638357 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f961405f910 con 0x7f95f805ed40 2023-08-17T17:35:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.848+0000 7f9610ff9700 1 -- 172.21.15.78:0/1047638357 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f961405f910 con 0x7f95f805ed40 2023-08-17T17:35:24.849 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/dir3 2023-08-17T17:35:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.849+0000 7f96199aa700 1 -- 172.21.15.78:0/1047638357 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95f805ed40 msgr2=0x7f95f8061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.849+0000 7f96199aa700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95f805ed40 0x7f95f8061200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9608006fa0 tx=0x7f9608016000).stop 2023-08-17T17:35:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.849+0000 7f96199aa700 1 -- 172.21.15.78:0/1047638357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9614157be0 msgr2=0x7f961414c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.849+0000 7f96199aa700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9614157be0 0x7f961414c370 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f960c00c730 tx=0x7f960c001520).stop 2023-08-17T17:35:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.849+0000 7f96199aa700 1 -- 172.21.15.78:0/1047638357 shutdown_connections 2023-08-17T17:35:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.849+0000 7f96199aa700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f95f805ed40 0x7f95f8061200 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.849+0000 7f96199aa700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9614157be0 0x7f961414c370 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.849+0000 7f96199aa700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9614151a40 0x7f9614168270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.849+0000 7f96199aa700 1 --2- 172.21.15.78:0/1047638357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9614151e20 0x7f96140c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.849+0000 7f96199aa700 1 -- 172.21.15.78:0/1047638357 >> 172.21.15.78:0/1047638357 conn(0x7f96140943b0 msgr2=0x7f96140c04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.850+0000 7f96199aa700 1 -- 172.21.15.78:0/1047638357 shutdown_connections 2023-08-17T17:35:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:24.850+0000 7f96199aa700 1 -- 172.21.15.78:0/1047638357 wait complete. 2023-08-17T17:35:24.863 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-08-17T17:35:24.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:24.863 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-08-17T17:35:24.879 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-08-17T17:35:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.034+0000 7f15f5685700 1 Processor -- start 2023-08-17T17:35:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.034+0000 7f15f5685700 1 -- start start 2023-08-17T17:35:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15f5685700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00aa4d0 0x7f15f00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15f5685700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15f00c5810 0x7f15f00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15f5685700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00649b0 con 0x7f15f00aa0f0 2023-08-17T17:35:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15f5685700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f00c6150 con 0x7f15f00c5810 2023-08-17T17:35:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15f5685700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0063420 con 0x7f15f00aa4d0 2023-08-17T17:35:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15ef7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15f00c5810 0x7f15f00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15ef7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15f00c5810 0x7f15f00c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39714/0 (socket says 172.21.15.78:39714) 2023-08-17T17:35:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15ef7fe700 1 -- 172.21.15.78:0/1795682311 learned_addr learned my addr 172.21.15.78:0/1795682311 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15e67fc700 1 --2- 172.21.15.78:0/1795682311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00aa4d0 0x7f15f00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15ef7fe700 1 -- 172.21.15.78:0/1795682311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00aa4d0 msgr2=0x7f15f00644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.035+0000 7f15ef7fe700 1 --2- 172.21.15.78:0/1795682311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00aa4d0 0x7f15f00644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15ef7fe700 1 -- 172.21.15.78:0/1795682311 >> v1:172.21.15.150:6789/0 conn(0x7f15f00aa0f0 legacy=0x7f15f00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15ef7fe700 1 -- 172.21.15.78:0/1795682311 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f0063700 con 0x7f15f00c5810 2023-08-17T17:35:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15e67fc700 1 --2- 172.21.15.78:0/1795682311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00aa4d0 0x7f15f00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15ef7fe700 1 --2- 172.21.15.78:0/1795682311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00c5810 0x7f15f00c5c60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f15e8009f20 tx=0x7f15e8009840).ready entity=mon.0 client_cookie=5efc199d75fc680e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15ee7fc700 1 -- 172.21.15.78:0/1795682311 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800e070 con 0x7f15f00c5810 2023-08-17T17:35:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15ee7fc700 1 -- 172.21.15.78:0/1795682311 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e800ba80 con 0x7f15f00c5810 2023-08-17T17:35:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15ee7fc700 1 -- 172.21.15.78:0/1795682311 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800be00 con 0x7f15f00c5810 2023-08-17T17:35:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15f5685700 1 -- 172.21.15.78:0/1795682311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00c5810 msgr2=0x7f15f00c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15f5685700 1 --2- 172.21.15.78:0/1795682311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00c5810 0x7f15f00c5c60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f15e8009f20 tx=0x7f15e8009840).stop 2023-08-17T17:35:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15f5685700 1 -- 172.21.15.78:0/1795682311 shutdown_connections 2023-08-17T17:35:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15f5685700 1 --2- 172.21.15.78:0/1795682311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00c5810 0x7f15f00c5c60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15f5685700 1 --2- 172.21.15.78:0/1795682311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00aa4d0 0x7f15f00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15f5685700 1 -- 172.21.15.78:0/1795682311 >> 172.21.15.78:0/1795682311 conn(0x7f15f006a6a0 msgr2=0x7f15f00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15f5685700 1 -- 172.21.15.78:0/1795682311 shutdown_connections 2023-08-17T17:35:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.036+0000 7f15f5685700 1 -- 172.21.15.78:0/1795682311 wait complete. 2023-08-17T17:35:25.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.038+0000 7f15f5685700 1 Processor -- start 2023-08-17T17:35:25.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.038+0000 7f15f5685700 1 -- start start 2023-08-17T17:35:25.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.038+0000 7f15f5685700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15f00aa0f0 0x7f15f00abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.038+0000 7f15f5685700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00aa4d0 0x7f15f00c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.038+0000 7f15f5685700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00c5810 0x7f15f0145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.038+0000 7f15f5685700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00acba0 con 0x7f15f00aa4d0 2023-08-17T17:35:25.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.038+0000 7f15f5685700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00c3080 con 0x7f15f00aa0f0 2023-08-17T17:35:25.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.038+0000 7f15f5685700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00ac550 con 0x7f15f00c5810 2023-08-17T17:35:25.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.038+0000 7f15e67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00aa4d0 0x7f15f00c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00aa4d0 0x7f15f00c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39718/0 (socket says 172.21.15.78:39718) 2023-08-17T17:35:25.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e67fc700 1 -- 172.21.15.78:0/1661502339 learned_addr learned my addr 172.21.15.78:0/1661502339 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:25.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15ef7fe700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00c5810 0x7f15f0145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15eeffd700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15f00aa0f0 0x7f15f00abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e67fc700 1 -- 172.21.15.78:0/1661502339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00c5810 msgr2=0x7f15f0145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e67fc700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00c5810 0x7f15f0145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e67fc700 1 -- 172.21.15.78:0/1661502339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15f00aa0f0 msgr2=0x7f15f00abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e67fc700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15f00aa0f0 0x7f15f00abf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e67fc700 1 -- 172.21.15.78:0/1661502339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8009ae0 con 0x7f15f00aa4d0 2023-08-17T17:35:25.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e67fc700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00aa4d0 0x7f15f00c2870 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f15d800d860 tx=0x7f15d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:25.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e77fe700 1 -- 172.21.15.78:0/1661502339 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011590 con 0x7f15f00aa4d0 2023-08-17T17:35:25.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e77fe700 1 -- 172.21.15.78:0/1661502339 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d80116f0 con 0x7f15f00aa4d0 2023-08-17T17:35:25.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15f5685700 1 -- 172.21.15.78:0/1661502339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f00ac830 con 0x7f15f00aa4d0 2023-08-17T17:35:25.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15e77fe700 1 -- 172.21.15.78:0/1661502339 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011a70 con 0x7f15f00aa4d0 2023-08-17T17:35:25.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.039+0000 7f15f5685700 1 -- 172.21.15.78:0/1661502339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f00c3360 con 0x7f15f00aa4d0 2023-08-17T17:35:25.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.040+0000 7f15f5685700 1 -- 172.21.15.78:0/1661502339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f0083980 con 0x7f15f00aa4d0 2023-08-17T17:35:25.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.040+0000 7f15e77fe700 1 -- 172.21.15.78:0/1661502339 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f15d8012420 con 0x7f15f00aa4d0 2023-08-17T17:35:25.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.041+0000 7f15e77fe700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f15d005ed40 0x7f15d0061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.041+0000 7f15e77fe700 1 -- 172.21.15.78:0/1661502339 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f15d80797f0 con 0x7f15f00aa4d0 2023-08-17T17:35:25.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.041+0000 7f15eeffd700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f15d005ed40 0x7f15d0061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.041+0000 7f15eeffd700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f15d005ed40 0x7f15d0061200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f15e0001680 tx=0x7f15e0009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:25.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.045+0000 7f15e77fe700 1 -- 172.21.15.78:0/1661502339 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f15d804ad20 con 0x7f15f00aa4d0 2023-08-17T17:35:25.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.230+0000 7f15f5685700 1 -- 172.21.15.78:0/1661502339 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f15f00629b0 con 0x7f15d005ed40 2023-08-17T17:35:25.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.234+0000 7f15e77fe700 1 -- 172.21.15.78:0/1661502339 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f15f00629b0 con 0x7f15d005ed40 2023-08-17T17:35:25.235 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/dir4 2023-08-17T17:35:25.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.235+0000 7f15f5685700 1 -- 172.21.15.78:0/1661502339 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f15d005ed40 msgr2=0x7f15d0061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.235+0000 7f15f5685700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f15d005ed40 0x7f15d0061200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f15e0001680 tx=0x7f15e0009040).stop 2023-08-17T17:35:25.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.235+0000 7f15f5685700 1 -- 172.21.15.78:0/1661502339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00aa4d0 msgr2=0x7f15f00c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.235+0000 7f15f5685700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00aa4d0 0x7f15f00c2870 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f15d800d860 tx=0x7f15d8008040).stop 2023-08-17T17:35:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.235+0000 7f15f5685700 1 -- 172.21.15.78:0/1661502339 shutdown_connections 2023-08-17T17:35:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.235+0000 7f15f5685700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f15d005ed40 0x7f15d0061200 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.235+0000 7f15f5685700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15f00c5810 0x7f15f0145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.235+0000 7f15f5685700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15f00aa0f0 0x7f15f00abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.235+0000 7f15f5685700 1 --2- 172.21.15.78:0/1661502339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f00aa4d0 0x7f15f00c2870 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.236+0000 7f15f5685700 1 -- 172.21.15.78:0/1661502339 >> 172.21.15.78:0/1661502339 conn(0x7f15f006a6a0 msgr2=0x7f15f01517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:25.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.236+0000 7f15f5685700 1 -- 172.21.15.78:0/1661502339 shutdown_connections 2023-08-17T17:35:25.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.236+0000 7f15f5685700 1 -- 172.21.15.78:0/1661502339 wait complete. 2023-08-17T17:35:25.249 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-08-17T17:35:25.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:25.249 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-08-17T17:35:25.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-08-17T17:35:25.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.420+0000 7f47c6d70700 1 Processor -- start 2023-08-17T17:35:25.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.420+0000 7f47c6d70700 1 -- start start 2023-08-17T17:35:25.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.421+0000 7f47c6d70700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47c00c5f20 0x7f47c00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.421+0000 7f47c6d70700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c00649b0 con 0x7f47c00aa4d0 2023-08-17T17:35:25.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.421+0000 7f47c6d70700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c0063420 con 0x7f47c00aa0f0 2023-08-17T17:35:25.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.421+0000 7f47c6d70700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c0063700 con 0x7f47c00c5f20 2023-08-17T17:35:25.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.421+0000 7f47c530d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47c00c5f20 0x7f47c00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.421+0000 7f47c530d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47c00c5f20 0x7f47c00644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39732/0 (socket says 172.21.15.78:39732) 2023-08-17T17:35:25.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.421+0000 7f47c530d700 1 -- 172.21.15.78:0/4280913896 learned_addr learned my addr 172.21.15.78:0/4280913896 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:25.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.421+0000 7f47c530d700 1 -- 172.21.15.78:0/4280913896 >> v1:172.21.15.150:6789/0 conn(0x7f47c00aa0f0 legacy=0x7f47c00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:25.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.421+0000 7f47c530d700 1 -- 172.21.15.78:0/4280913896 >> v1:172.21.15.78:6789/0 conn(0x7f47c00aa4d0 legacy=0x7f47c00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.421+0000 7f47c530d700 1 -- 172.21.15.78:0/4280913896 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c00639e0 con 0x7f47c00c5f20 2023-08-17T17:35:25.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47c530d700 1 --2- 172.21.15.78:0/4280913896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 0x7f47c00644c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f47b8009f20 tx=0x7f47b8009840).ready entity=mon.0 client_cookie=932c2c3e256ae66d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:25.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47b77fe700 1 -- 172.21.15.78:0/4280913896 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b800e070 con 0x7f47c00c5f20 2023-08-17T17:35:25.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47b77fe700 1 -- 172.21.15.78:0/4280913896 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b800ba40 con 0x7f47c00c5f20 2023-08-17T17:35:25.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47b77fe700 1 -- 172.21.15.78:0/4280913896 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b800bdc0 con 0x7f47c00c5f20 2023-08-17T17:35:25.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47c6d70700 1 -- 172.21.15.78:0/4280913896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 msgr2=0x7f47c00644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47c6d70700 1 --2- 172.21.15.78:0/4280913896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 0x7f47c00644c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f47b8009f20 tx=0x7f47b8009840).stop 2023-08-17T17:35:25.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47c6d70700 1 -- 172.21.15.78:0/4280913896 shutdown_connections 2023-08-17T17:35:25.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47c6d70700 1 --2- 172.21.15.78:0/4280913896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 0x7f47c00644c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47c6d70700 1 -- 172.21.15.78:0/4280913896 >> 172.21.15.78:0/4280913896 conn(0x7f47c006a6a0 msgr2=0x7f47c00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:25.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47c6d70700 1 -- 172.21.15.78:0/4280913896 shutdown_connections 2023-08-17T17:35:25.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.422+0000 7f47c6d70700 1 -- 172.21.15.78:0/4280913896 wait complete. 2023-08-17T17:35:25.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.423+0000 7f47c6d70700 1 Processor -- start 2023-08-17T17:35:25.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.424+0000 7f47c6d70700 1 -- start start 2023-08-17T17:35:25.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.424+0000 7f47c6d70700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47c00aa0f0 0x7f47c01469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.424+0000 7f47c6d70700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47c00aa4d0 0x7f47c00c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.424+0000 7f47c6d70700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 0x7f47c00ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.424+0000 7f47c6d70700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c00ca6b0 con 0x7f47c00c5f20 2023-08-17T17:35:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.424+0000 7f47c6d70700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c00ab8a0 con 0x7f47c00aa0f0 2023-08-17T17:35:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.424+0000 7f47c6d70700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c0157060 con 0x7f47c00aa4d0 2023-08-17T17:35:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.424+0000 7f47c530d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 0x7f47c00ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.424+0000 7f47c530d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 0x7f47c00ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39738/0 (socket says 172.21.15.78:39738) 2023-08-17T17:35:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.424+0000 7f47c530d700 1 -- 172.21.15.78:0/3455325037 learned_addr learned my addr 172.21.15.78:0/3455325037 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47c4b0c700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47c00aa0f0 0x7f47c01469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47b7fff700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47c00aa4d0 0x7f47c00c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47c530d700 1 -- 172.21.15.78:0/3455325037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47c00aa4d0 msgr2=0x7f47c00c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47c530d700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47c00aa4d0 0x7f47c00c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47c530d700 1 -- 172.21.15.78:0/3455325037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47c00aa0f0 msgr2=0x7f47c01469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47c530d700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47c00aa0f0 0x7f47c01469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47c530d700 1 -- 172.21.15.78:0/3455325037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b8009ae0 con 0x7f47c00c5f20 2023-08-17T17:35:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47b7fff700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47c00aa4d0 0x7f47c00c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47c530d700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 0x7f47c00ca1c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f47c005e180 tx=0x7f47b8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47b4ff9700 1 -- 172.21.15.78:0/3455325037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b800bd80 con 0x7f47c00c5f20 2023-08-17T17:35:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47b4ff9700 1 -- 172.21.15.78:0/3455325037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b8007610 con 0x7f47c00c5f20 2023-08-17T17:35:25.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47b4ff9700 1 -- 172.21.15.78:0/3455325037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80079b0 con 0x7f47c00c5f20 2023-08-17T17:35:25.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47c6d70700 1 -- 172.21.15.78:0/3455325037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c0157340 con 0x7f47c00c5f20 2023-08-17T17:35:25.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.425+0000 7f47c6d70700 1 -- 172.21.15.78:0/3455325037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c0146eb0 con 0x7f47c00c5f20 2023-08-17T17:35:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.426+0000 7f47c6d70700 1 -- 172.21.15.78:0/3455325037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c0156ec0 con 0x7f47c00c5f20 2023-08-17T17:35:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.426+0000 7f47b4ff9700 1 -- 172.21.15.78:0/3455325037 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f47b8026460 con 0x7f47c00c5f20 2023-08-17T17:35:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.427+0000 7f47b4ff9700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f47ac05ed40 0x7f47ac061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.427+0000 7f47b4ff9700 1 -- 172.21.15.78:0/3455325037 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f47b807b960 con 0x7f47c00c5f20 2023-08-17T17:35:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.427+0000 7f47c4b0c700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f47ac05ed40 0x7f47ac061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.427+0000 7f47c4b0c700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f47ac05ed40 0x7f47ac061200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f47bc0036e0 tx=0x7f47bc009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.431+0000 7f47b4ff9700 1 -- 172.21.15.78:0/3455325037 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f47c0156ec0 con 0x7f47c00c5f20 2023-08-17T17:35:25.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.602+0000 7f47b4ff9700 1 -- 172.21.15.78:0/3455325037 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f47b807dd70 con 0x7f47c00c5f20 2023-08-17T17:35:25.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.619+0000 7f47c6d70700 1 -- 172.21.15.78:0/3455325037 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f47c0156ec0 con 0x7f47ac05ed40 2023-08-17T17:35:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.623+0000 7f47b4ff9700 1 -- 172.21.15.78:0/3455325037 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f47c0156ec0 con 0x7f47ac05ed40 2023-08-17T17:35:25.624 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/dir5 2023-08-17T17:35:25.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.624+0000 7f47c6d70700 1 -- 172.21.15.78:0/3455325037 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f47ac05ed40 msgr2=0x7f47ac061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.624+0000 7f47c6d70700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f47ac05ed40 0x7f47ac061200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f47bc0036e0 tx=0x7f47bc009040).stop 2023-08-17T17:35:25.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.624+0000 7f47c6d70700 1 -- 172.21.15.78:0/3455325037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 msgr2=0x7f47c00ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.624+0000 7f47c6d70700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 0x7f47c00ca1c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f47c005e180 tx=0x7f47b8009840).stop 2023-08-17T17:35:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.624+0000 7f47c6d70700 1 -- 172.21.15.78:0/3455325037 shutdown_connections 2023-08-17T17:35:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.624+0000 7f47c6d70700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f47ac05ed40 0x7f47ac061200 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.624+0000 7f47c6d70700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47c00c5f20 0x7f47c00ca1c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.624+0000 7f47c6d70700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47c00aa0f0 0x7f47c01469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.625+0000 7f47c6d70700 1 --2- 172.21.15.78:0/3455325037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47c00aa4d0 0x7f47c00c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.625+0000 7f47c6d70700 1 -- 172.21.15.78:0/3455325037 >> 172.21.15.78:0/3455325037 conn(0x7f47c006a6a0 msgr2=0x7f47c00a8440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.625+0000 7f47c6d70700 1 -- 172.21.15.78:0/3455325037 shutdown_connections 2023-08-17T17:35:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.625+0000 7f47c6d70700 1 -- 172.21.15.78:0/3455325037 wait complete. 2023-08-17T17:35:25.638 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-08-17T17:35:25.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:25.638 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-08-17T17:35:25.654 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-08-17T17:35:25.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.811+0000 7fa251aee700 1 Processor -- start 2023-08-17T17:35:25.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.811+0000 7fa251aee700 1 -- start start 2023-08-17T17:35:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa251aee700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa24c151e20 0x7fa24c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa251aee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa24c157be0 0x7fa24c158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa251aee700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c158520 con 0x7fa24c151a40 2023-08-17T17:35:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa251aee700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c0c6620 con 0x7fa24c151e20 2023-08-17T17:35:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa251aee700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c0c6900 con 0x7fa24c157be0 2023-08-17T17:35:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa243fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa24c151e20 0x7fa24c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa243fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa24c151e20 0x7fa24c0c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39748/0 (socket says 172.21.15.78:39748) 2023-08-17T17:35:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa243fff700 1 -- 172.21.15.78:0/1657211750 learned_addr learned my addr 172.21.15.78:0/1657211750 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa243fff700 1 -- 172.21.15.78:0/1657211750 >> v2:172.21.15.150:3300/0 conn(0x7fa24c157be0 msgr2=0x7fa24c158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa243fff700 1 --2- 172.21.15.78:0/1657211750 >> v2:172.21.15.150:3300/0 conn(0x7fa24c157be0 0x7fa24c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa243fff700 1 -- 172.21.15.78:0/1657211750 >> v1:172.21.15.150:6789/0 conn(0x7fa24c151a40 legacy=0x7fa24c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa243fff700 1 -- 172.21.15.78:0/1657211750 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c0c6be0 con 0x7fa24c151e20 2023-08-17T17:35:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa243fff700 1 --2- 172.21.15.78:0/1657211750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 0x7fa24c0c8260 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fa24c155770 tx=0x7fa23c009060).ready entity=mon.0 client_cookie=a98b06e626ba6b95 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa2437fe700 1 -- 172.21.15.78:0/1657211750 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c005880 con 0x7fa24c151e20 2023-08-17T17:35:25.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa2437fe700 1 -- 172.21.15.78:0/1657211750 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c0059e0 con 0x7fa24c151e20 2023-08-17T17:35:25.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.812+0000 7fa2437fe700 1 -- 172.21.15.78:0/1657211750 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c005d60 con 0x7fa24c151e20 2023-08-17T17:35:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.813+0000 7fa251aee700 1 -- 172.21.15.78:0/1657211750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 msgr2=0x7fa24c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.813+0000 7fa251aee700 1 --2- 172.21.15.78:0/1657211750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 0x7fa24c0c8260 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fa24c155770 tx=0x7fa23c009060).stop 2023-08-17T17:35:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.813+0000 7fa251aee700 1 -- 172.21.15.78:0/1657211750 shutdown_connections 2023-08-17T17:35:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.813+0000 7fa251aee700 1 --2- 172.21.15.78:0/1657211750 >> v2:172.21.15.150:3300/0 conn(0x7fa24c157be0 0x7fa24c158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.813+0000 7fa251aee700 1 --2- 172.21.15.78:0/1657211750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 0x7fa24c0c8260 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.813+0000 7fa251aee700 1 -- 172.21.15.78:0/1657211750 >> 172.21.15.78:0/1657211750 conn(0x7fa24c0943b0 msgr2=0x7fa24c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.813+0000 7fa251aee700 1 -- 172.21.15.78:0/1657211750 shutdown_connections 2023-08-17T17:35:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.813+0000 7fa251aee700 1 -- 172.21.15.78:0/1657211750 wait complete. 2023-08-17T17:35:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.814+0000 7fa251aee700 1 Processor -- start 2023-08-17T17:35:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.814+0000 7fa251aee700 1 -- start start 2023-08-17T17:35:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa251aee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa24c151a40 0x7fa24c1415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa251aee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 0x7fa24c0a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa251aee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa24c157be0 0x7fa24c0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa251aee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0a9420 con 0x7fa24c151e20 2023-08-17T17:35:25.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa251aee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c1685f0 con 0x7fa24c157be0 2023-08-17T17:35:25.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa251aee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c1679e0 con 0x7fa24c151a40 2023-08-17T17:35:25.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa243fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 0x7fa24c0a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa243fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 0x7fa24c0a8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39758/0 (socket says 172.21.15.78:39758) 2023-08-17T17:35:25.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa243fff700 1 -- 172.21.15.78:0/2083198783 learned_addr learned my addr 172.21.15.78:0/2083198783 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:25.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa243fff700 1 -- 172.21.15.78:0/2083198783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa24c151a40 msgr2=0x7fa24c1415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa243fff700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa24c151a40 0x7fa24c1415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:25.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa243fff700 1 -- 172.21.15.78:0/2083198783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa24c157be0 msgr2=0x7fa24c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:25.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa243fff700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa24c157be0 0x7fa24c0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:25.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa243fff700 1 -- 172.21.15.78:0/2083198783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c009300 con 0x7fa24c151e20 2023-08-17T17:35:25.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa243fff700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 0x7fa24c0a8a40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fa23c009f30 tx=0x7fa23c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:25.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa240ff9700 1 -- 172.21.15.78:0/2083198783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00b7b0 con 0x7fa24c151e20 2023-08-17T17:35:25.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa240ff9700 1 -- 172.21.15.78:0/2083198783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c00b910 con 0x7fa24c151e20 2023-08-17T17:35:25.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa251aee700 1 -- 172.21.15.78:0/2083198783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c167cc0 con 0x7fa24c151e20 2023-08-17T17:35:25.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa240ff9700 1 -- 172.21.15.78:0/2083198783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00bcd0 con 0x7fa24c151e20 2023-08-17T17:35:25.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.815+0000 7fa251aee700 1 -- 172.21.15.78:0/2083198783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c168280 con 0x7fa24c151e20 2023-08-17T17:35:25.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.816+0000 7fa251aee700 1 -- 172.21.15.78:0/2083198783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c082f90 con 0x7fa24c151e20 2023-08-17T17:35:25.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.817+0000 7fa240ff9700 1 -- 172.21.15.78:0/2083198783 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fa23c02a070 con 0x7fa24c151e20 2023-08-17T17:35:25.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.817+0000 7fa240ff9700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa23805ee60 0x7fa238061320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:25.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.817+0000 7fa240ff9700 1 -- 172.21.15.78:0/2083198783 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa23c07af80 con 0x7fa24c151e20 2023-08-17T17:35:25.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.817+0000 7fa250aec700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa23805ee60 0x7fa238061320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:25.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.818+0000 7fa250aec700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa23805ee60 0x7fa238061320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa248009630 tx=0x7fa248006b50).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:25.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:25.821+0000 7fa240ff9700 1 -- 172.21.15.78:0/2083198783 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa23c04c3a0 con 0x7fa24c151e20 2023-08-17T17:35:26.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.009+0000 7fa251aee700 1 -- 172.21.15.78:0/2083198783 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa24c05f910 con 0x7fa23805ee60 2023-08-17T17:35:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.012+0000 7fa240ff9700 1 -- 172.21.15.78:0/2083198783 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa24c05f910 con 0x7fa23805ee60 2023-08-17T17:35:26.014 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/dir6 2023-08-17T17:35:26.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 -- 172.21.15.78:0/2083198783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa23805ee60 msgr2=0x7fa238061320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa23805ee60 0x7fa238061320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa248009630 tx=0x7fa248006b50).stop 2023-08-17T17:35:26.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 -- 172.21.15.78:0/2083198783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 msgr2=0x7fa24c0a8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 0x7fa24c0a8a40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fa23c009f30 tx=0x7fa23c016000).stop 2023-08-17T17:35:26.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 -- 172.21.15.78:0/2083198783 shutdown_connections 2023-08-17T17:35:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa23805ee60 0x7fa238061320 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa24c157be0 0x7fa24c0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa24c151a40 0x7fa24c1415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 --2- 172.21.15.78:0/2083198783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa24c151e20 0x7fa24c0a8a40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 -- 172.21.15.78:0/2083198783 >> 172.21.15.78:0/2083198783 conn(0x7fa24c0943b0 msgr2=0x7fa24c155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 -- 172.21.15.78:0/2083198783 shutdown_connections 2023-08-17T17:35:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.014+0000 7fa251aee700 1 -- 172.21.15.78:0/2083198783 wait complete. 2023-08-17T17:35:26.027 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-08-17T17:35:26.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:26.028 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-08-17T17:35:26.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-08-17T17:35:26.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.200+0000 7fd2c2bf0700 1 Processor -- start 2023-08-17T17:35:26.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.200+0000 7fd2c2bf0700 1 -- start start 2023-08-17T17:35:26.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c2bf0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd2bc154100 0x7fd2bc06a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c2bf0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc0bc980 0x7fd2bc0be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c2bf0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0bd140 con 0x7fd2bc0624f0 2023-08-17T17:35:26.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c2bf0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0bd420 con 0x7fd2bc154100 2023-08-17T17:35:26.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c2bf0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0bd700 con 0x7fd2bc0bc980 2023-08-17T17:35:26.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c1bee700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd2bc154100 0x7fd2bc06a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c1bee700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd2bc154100 0x7fd2bc06a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39762/0 (socket says 172.21.15.78:39762) 2023-08-17T17:35:26.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c1bee700 1 -- 172.21.15.78:0/3611007352 learned_addr learned my addr 172.21.15.78:0/3611007352 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:26.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c1bee700 1 -- 172.21.15.78:0/3611007352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc0bc980 msgr2=0x7fd2bc0be1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:26.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c13ed700 1 --2- 172.21.15.78:0/3611007352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc0bc980 0x7fd2bc0be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c1bee700 1 --2- 172.21.15.78:0/3611007352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc0bc980 0x7fd2bc0be1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c1bee700 1 -- 172.21.15.78:0/3611007352 >> v1:172.21.15.78:6789/0 conn(0x7fd2bc0624f0 legacy=0x7fd2bc0652a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c1bee700 1 -- 172.21.15.78:0/3611007352 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0bd9e0 con 0x7fd2bc154100 2023-08-17T17:35:26.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c13ed700 1 --2- 172.21.15.78:0/3611007352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc0bc980 0x7fd2bc0be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:26.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c1bee700 1 --2- 172.21.15.78:0/3611007352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc154100 0x7fd2bc06a2b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fd2b8006fd0 tx=0x7fd2b80090f0).ready entity=mon.0 client_cookie=1e14d915dd1d62de server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:26.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.201+0000 7fd2c0bec700 1 -- 172.21.15.78:0/3611007352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b800b600 con 0x7fd2bc154100 2023-08-17T17:35:26.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.202+0000 7fd2c0bec700 1 -- 172.21.15.78:0/3611007352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b800b760 con 0x7fd2bc154100 2023-08-17T17:35:26.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.202+0000 7fd2c0bec700 1 -- 172.21.15.78:0/3611007352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b800bae0 con 0x7fd2bc154100 2023-08-17T17:35:26.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.202+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/3611007352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc154100 msgr2=0x7fd2bc06a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.202+0000 7fd2c2bf0700 1 --2- 172.21.15.78:0/3611007352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc154100 0x7fd2bc06a2b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fd2b8006fd0 tx=0x7fd2b80090f0).stop 2023-08-17T17:35:26.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.202+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/3611007352 shutdown_connections 2023-08-17T17:35:26.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.202+0000 7fd2c2bf0700 1 --2- 172.21.15.78:0/3611007352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc154100 0x7fd2bc06a2b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.202+0000 7fd2c2bf0700 1 --2- 172.21.15.78:0/3611007352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc0bc980 0x7fd2bc0be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.202+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/3611007352 >> 172.21.15.78:0/3611007352 conn(0x7fd2bc0c84a0 msgr2=0x7fd2bc0c44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:26.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.202+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/3611007352 shutdown_connections 2023-08-17T17:35:26.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.202+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/3611007352 wait complete. 2023-08-17T17:35:26.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.203+0000 7fd2c2bf0700 1 Processor -- start 2023-08-17T17:35:26.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.203+0000 7fd2c2bf0700 1 -- start start 2023-08-17T17:35:26.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c2bf0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2bc0624f0 0x7fd2bc167dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c2bf0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc0bc980 0x7fd2bc0a8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c2bf0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc154100 0x7fd2bc155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c2bf0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc1548f0 con 0x7fd2bc0bc980 2023-08-17T17:35:26.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c2bf0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc168610 con 0x7fd2bc0624f0 2023-08-17T17:35:26.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c2bf0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc1688f0 con 0x7fd2bc154100 2023-08-17T17:35:26.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c13ed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc0bc980 0x7fd2bc0a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c13ed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc0bc980 0x7fd2bc0a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39768/0 (socket says 172.21.15.78:39768) 2023-08-17T17:35:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c13ed700 1 -- 172.21.15.78:0/1217426963 learned_addr learned my addr 172.21.15.78:0/1217426963 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c1bee700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2bc0624f0 0x7fd2bc167dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c23ef700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc154100 0x7fd2bc155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c13ed700 1 -- 172.21.15.78:0/1217426963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc154100 msgr2=0x7fd2bc155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c13ed700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc154100 0x7fd2bc155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c13ed700 1 -- 172.21.15.78:0/1217426963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2bc0624f0 msgr2=0x7fd2bc167dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c13ed700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2bc0624f0 0x7fd2bc167dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c13ed700 1 -- 172.21.15.78:0/1217426963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8009370 con 0x7fd2bc0bc980 2023-08-17T17:35:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c1bee700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2bc0624f0 0x7fd2bc167dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.204+0000 7fd2c23ef700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc154100 0x7fd2bc155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.205+0000 7fd2c13ed700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc0bc980 0x7fd2bc0a8180 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fd2ac00c880 tx=0x7fd2ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.205+0000 7fd2b1ffb700 1 -- 172.21.15.78:0/1217426963 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac010580 con 0x7fd2bc0bc980 2023-08-17T17:35:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.205+0000 7fd2b1ffb700 1 -- 172.21.15.78:0/1217426963 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac0106e0 con 0x7fd2bc0bc980 2023-08-17T17:35:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.205+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/1217426963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc168bd0 con 0x7fd2bc0bc980 2023-08-17T17:35:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.205+0000 7fd2b1ffb700 1 -- 172.21.15.78:0/1217426963 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac010a60 con 0x7fd2bc0bc980 2023-08-17T17:35:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.205+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/1217426963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc1682b0 con 0x7fd2bc0bc980 2023-08-17T17:35:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.206+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/1217426963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc05f910 con 0x7fd2bc0bc980 2023-08-17T17:35:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.206+0000 7fd2b1ffb700 1 -- 172.21.15.78:0/1217426963 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fd2ac01b460 con 0x7fd2bc0bc980 2023-08-17T17:35:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.206+0000 7fd2b1ffb700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd2a005ee30 0x7fd2a00612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.207+0000 7fd2b1ffb700 1 -- 172.21.15.78:0/1217426963 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd2ac079f60 con 0x7fd2bc0bc980 2023-08-17T17:35:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.207+0000 7fd2c1bee700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd2a005ee30 0x7fd2a00612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.207+0000 7fd2c1bee700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd2a005ee30 0x7fd2a00612f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd2b8009340 tx=0x7fd2b8017000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.211+0000 7fd2b1ffb700 1 -- 172.21.15.78:0/1217426963 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd2ac04b320 con 0x7fd2bc0bc980 2023-08-17T17:35:26.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.401+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/1217426963 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2bc0bdcc0 con 0x7fd2a005ee30 2023-08-17T17:35:26.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.404+0000 7fd2b1ffb700 1 -- 172.21.15.78:0/1217426963 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd2bc0bdcc0 con 0x7fd2a005ee30 2023-08-17T17:35:26.406 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/dir7 2023-08-17T17:35:26.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.406+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/1217426963 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd2a005ee30 msgr2=0x7fd2a00612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.406+0000 7fd2c2bf0700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd2a005ee30 0x7fd2a00612f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd2b8009340 tx=0x7fd2b8017000).stop 2023-08-17T17:35:26.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.406+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/1217426963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc0bc980 msgr2=0x7fd2bc0a8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.406+0000 7fd2c2bf0700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc0bc980 0x7fd2bc0a8180 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fd2ac00c880 tx=0x7fd2ac008040).stop 2023-08-17T17:35:26.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.406+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/1217426963 shutdown_connections 2023-08-17T17:35:26.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.406+0000 7fd2c2bf0700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd2a005ee30 0x7fd2a00612f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.406+0000 7fd2c2bf0700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2bc154100 0x7fd2bc155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.406+0000 7fd2c2bf0700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2bc0624f0 0x7fd2bc167dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.406+0000 7fd2c2bf0700 1 --2- 172.21.15.78:0/1217426963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2bc0bc980 0x7fd2bc0a8180 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.406+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/1217426963 >> 172.21.15.78:0/1217426963 conn(0x7fd2bc0c84a0 msgr2=0x7fd2bc151670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:26.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.407+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/1217426963 shutdown_connections 2023-08-17T17:35:26.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.407+0000 7fd2c2bf0700 1 -- 172.21.15.78:0/1217426963 wait complete. 2023-08-17T17:35:26.419 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-08-17T17:35:26.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:26.420 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-08-17T17:35:26.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-08-17T17:35:26.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.591+0000 7fca1efef700 1 Processor -- start 2023-08-17T17:35:26.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.592+0000 7fca1efef700 1 -- start start 2023-08-17T17:35:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1efef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fca180c4790 0x7fca18064a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1efef700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fca180c5a10 0x7fca180c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1efef700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca18155400 con 0x7fca18062cd0 2023-08-17T17:35:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1efef700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca180c30d0 con 0x7fca180c5a10 2023-08-17T17:35:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1efef700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca181547f0 con 0x7fca180c4790 2023-08-17T17:35:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1e7ee700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fca180c5a10 0x7fca180c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1e7ee700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fca180c5a10 0x7fca180c4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39772/0 (socket says 172.21.15.78:39772) 2023-08-17T17:35:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1e7ee700 1 -- 172.21.15.78:0/2567280850 learned_addr learned my addr 172.21.15.78:0/2567280850 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1e7ee700 1 -- 172.21.15.78:0/2567280850 >> v2:172.21.15.150:3300/0 conn(0x7fca180c4790 msgr2=0x7fca18064a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1e7ee700 1 --2- 172.21.15.78:0/2567280850 >> v2:172.21.15.150:3300/0 conn(0x7fca180c4790 0x7fca18064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1e7ee700 1 -- 172.21.15.78:0/2567280850 >> v1:172.21.15.150:6789/0 conn(0x7fca18062cd0 legacy=0x7fca180c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1e7ee700 1 -- 172.21.15.78:0/2567280850 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18154ad0 con 0x7fca180c5a10 2023-08-17T17:35:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1e7ee700 1 --2- 172.21.15.78:0/2567280850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c5a10 0x7fca180c4b70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fca18065a20 tx=0x7fca10009840).ready entity=mon.0 client_cookie=dc98a46ce046c146 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1cfeb700 1 -- 172.21.15.78:0/2567280850 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000e070 con 0x7fca180c5a10 2023-08-17T17:35:26.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1cfeb700 1 -- 172.21.15.78:0/2567280850 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1000ba10 con 0x7fca180c5a10 2023-08-17T17:35:26.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.593+0000 7fca1cfeb700 1 -- 172.21.15.78:0/2567280850 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000bd90 con 0x7fca180c5a10 2023-08-17T17:35:26.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.594+0000 7fca1efef700 1 -- 172.21.15.78:0/2567280850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c5a10 msgr2=0x7fca180c4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.594+0000 7fca1efef700 1 --2- 172.21.15.78:0/2567280850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c5a10 0x7fca180c4b70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fca18065a20 tx=0x7fca10009840).stop 2023-08-17T17:35:26.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.594+0000 7fca1efef700 1 -- 172.21.15.78:0/2567280850 shutdown_connections 2023-08-17T17:35:26.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.594+0000 7fca1efef700 1 --2- 172.21.15.78:0/2567280850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c5a10 0x7fca180c4b70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.594+0000 7fca1efef700 1 --2- 172.21.15.78:0/2567280850 >> v2:172.21.15.150:3300/0 conn(0x7fca180c4790 0x7fca18064a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:35:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.594+0000 7fca1efef700 1 -- 172.21.15.78:0/2567280850 >> 172.21.15.78:0/2567280850 conn(0x7fca1806a660 msgr2=0x7fca180921a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.594+0000 7fca1efef700 1 -- 172.21.15.78:0/2567280850 shutdown_connections 2023-08-17T17:35:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.594+0000 7fca1efef700 1 -- 172.21.15.78:0/2567280850 wait complete. 2023-08-17T17:35:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.595+0000 7fca1efef700 1 Processor -- start 2023-08-17T17:35:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.595+0000 7fca1efef700 1 -- start start 2023-08-17T17:35:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1efef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca18062cd0 0x7fca18165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1efef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c4790 0x7fca181536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1efef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180c5a10 0x7fca180c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1efef700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180c0480 con 0x7fca180c4790 2023-08-17T17:35:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1efef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180bfb70 con 0x7fca180c5a10 2023-08-17T17:35:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1efef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca18165730 con 0x7fca18062cd0 2023-08-17T17:35:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1d7ec700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c4790 0x7fca181536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1d7ec700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c4790 0x7fca181536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39780/0 (socket says 172.21.15.78:39780) 2023-08-17T17:35:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1d7ec700 1 -- 172.21.15.78:0/2782616618 learned_addr learned my addr 172.21.15.78:0/2782616618 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1e7ee700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180c5a10 0x7fca180c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1d7ec700 1 -- 172.21.15.78:0/2782616618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca18062cd0 msgr2=0x7fca18165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1dfed700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca18062cd0 0x7fca18165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1d7ec700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca18062cd0 0x7fca18165240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1d7ec700 1 -- 172.21.15.78:0/2782616618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180c5a10 msgr2=0x7fca180c1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1d7ec700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180c5a10 0x7fca180c1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1d7ec700 1 -- 172.21.15.78:0/2782616618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca10009ae0 con 0x7fca180c4790 2023-08-17T17:35:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1e7ee700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180c5a10 0x7fca180c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.596+0000 7fca1d7ec700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c4790 0x7fca181536a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fca0800c440 tx=0x7fca08007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:26.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.597+0000 7fca0dffb700 1 -- 172.21.15.78:0/2782616618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800f470 con 0x7fca180c4790 2023-08-17T17:35:26.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.597+0000 7fca0dffb700 1 -- 172.21.15.78:0/2782616618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0800f5f0 con 0x7fca180c4790 2023-08-17T17:35:26.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.597+0000 7fca1efef700 1 -- 172.21.15.78:0/2782616618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca18164ec0 con 0x7fca180c4790 2023-08-17T17:35:26.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.597+0000 7fca0dffb700 1 -- 172.21.15.78:0/2782616618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800f9b0 con 0x7fca180c4790 2023-08-17T17:35:26.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.597+0000 7fca1efef700 1 -- 172.21.15.78:0/2782616618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca180c00a0 con 0x7fca180c4790 2023-08-17T17:35:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.598+0000 7fca1efef700 1 -- 172.21.15.78:0/2782616618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca180c05c0 con 0x7fca180c4790 2023-08-17T17:35:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.598+0000 7fca0dffb700 1 -- 172.21.15.78:0/2782616618 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fca08019030 con 0x7fca180c4790 2023-08-17T17:35:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.598+0000 7fca0dffb700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9fc05ee30 0x7fc9fc0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.598+0000 7fca0dffb700 1 -- 172.21.15.78:0/2782616618 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fca080791e0 con 0x7fca180c4790 2023-08-17T17:35:26.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.598+0000 7fca1dfed700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9fc05ee30 0x7fc9fc0612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.599+0000 7fca1dfed700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9fc05ee30 0x7fc9fc0612f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fca180bea50 tx=0x7fca14008040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:26.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.602+0000 7fca0dffb700 1 -- 172.21.15.78:0/2782616618 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca080488f0 con 0x7fca180c4790 2023-08-17T17:35:26.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.794+0000 7fca1efef700 1 -- 172.21.15.78:0/2782616618 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fca1805f910 con 0x7fc9fc05ee30 2023-08-17T17:35:26.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.798+0000 7fca0dffb700 1 -- 172.21.15.78:0/2782616618 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fca1805f910 con 0x7fc9fc05ee30 2023-08-17T17:35:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/dir8 2023-08-17T17:35:26.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 -- 172.21.15.78:0/2782616618 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9fc05ee30 msgr2=0x7fc9fc0612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9fc05ee30 0x7fc9fc0612f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fca180bea50 tx=0x7fca14008040).stop 2023-08-17T17:35:26.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 -- 172.21.15.78:0/2782616618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c4790 msgr2=0x7fca181536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c4790 0x7fca181536a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fca0800c440 tx=0x7fca08007de0).stop 2023-08-17T17:35:26.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 -- 172.21.15.78:0/2782616618 shutdown_connections 2023-08-17T17:35:26.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9fc05ee30 0x7fc9fc0612f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180c5a10 0x7fca180c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca18062cd0 0x7fca18165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 --2- 172.21.15.78:0/2782616618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca180c4790 0x7fca181536a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 -- 172.21.15.78:0/2782616618 >> 172.21.15.78:0/2782616618 conn(0x7fca1806a660 msgr2=0x7fca18063c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:26.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 -- 172.21.15.78:0/2782616618 shutdown_connections 2023-08-17T17:35:26.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.800+0000 7fca1efef700 1 -- 172.21.15.78:0/2782616618 wait complete. 2023-08-17T17:35:26.813 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-08-17T17:35:26.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:35:26.814 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-08-17T17:35:26.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-08-17T17:35:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.985+0000 7f3e54c58700 1 Processor -- start 2023-08-17T17:35:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.985+0000 7f3e54c58700 1 -- start start 2023-08-17T17:35:26.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.986+0000 7f3e54c58700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e500c5f20 0x7f3e500644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.986+0000 7f3e54c58700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e500649b0 con 0x7f3e500aa4d0 2023-08-17T17:35:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.986+0000 7f3e54c58700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e50063420 con 0x7f3e500aa0f0 2023-08-17T17:35:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.986+0000 7f3e54c58700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50063700 con 0x7f3e500c5f20 2023-08-17T17:35:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.986+0000 7f3e45d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3e500aa4d0 0x7f3e500c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43858/0 (socket says 172.21.15.78:43858) 2023-08-17T17:35:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.986+0000 7f3e45d9b700 1 -- 172.21.15.78:0/1857748697 learned_addr learned my addr 172.21.15.78:0/1857748697 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.986+0000 7f3e4ed9d700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e500c5f20 0x7f3e500644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.986+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204147701 0 0) 0x7f3e500649b0 con 0x7f3e500aa4d0 2023-08-17T17:35:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.986+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e3c0033f0 con 0x7f3e500aa4d0 2023-08-17T17:35:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031778997 0 0) 0x7f3e50063420 con 0x7f3e500aa0f0 2023-08-17T17:35:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e500649b0 con 0x7f3e500aa0f0 2023-08-17T17:35:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3637245260 0 0) 0x7f3e3c0033f0 con 0x7f3e500aa4d0 2023-08-17T17:35:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e500c5f20 msgr2=0x7f3e500644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e500c5f20 0x7f3e500644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 >> v1:172.21.15.150:6789/0 conn(0x7f3e500aa0f0 legacy=0x7f3e500c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500639e0 con 0x7f3e500aa4d0 2023-08-17T17:35:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3e38001470 con 0x7f3e500aa4d0 2023-08-17T17:35:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 >> v1:172.21.15.78:6789/0 conn(0x7f3e500aa4d0 legacy=0x7f3e500c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c003aa0 0x7f3e3c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e500c5f20 0x7f3e3c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3c004b80 0x7f3e3c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50063700 con 0x7f3e3c003aa0 2023-08-17T17:35:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c00b990 con 0x7f3e3c004b80 2023-08-17T17:35:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c00bb00 con 0x7f3e500c5f20 2023-08-17T17:35:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4e59c700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c003aa0 0x7f3e3c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e45d9b700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e500c5f20 0x7f3e3c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4ed9d700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3c004b80 0x7f3e3c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4e59c700 1 -- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e500c5f20 msgr2=0x7f3e3c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4e59c700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e500c5f20 0x7f3e3c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4e59c700 1 -- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3c004b80 msgr2=0x7f3e3c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4e59c700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3c004b80 0x7f3e3c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4e59c700 1 -- 172.21.15.78:0/1857748697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0033f0 con 0x7f3e3c003aa0 2023-08-17T17:35:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e45d9b700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e500c5f20 0x7f3e3c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4e59c700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c003aa0 0x7f3e3c003ea0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f3e40001890 tx=0x7f3e40007bb0).ready entity=mon.0 client_cookie=1e857c81a14ce48a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40007020 con 0x7f3e3c003aa0 2023-08-17T17:35:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e40007180 con 0x7f3e3c003aa0 2023-08-17T17:35:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.987+0000 7f3e4dd9b700 1 -- 172.21.15.78:0/1857748697 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40007500 con 0x7f3e3c003aa0 2023-08-17T17:35:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.988+0000 7f3e54c58700 1 -- 172.21.15.78:0/1857748697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c003aa0 msgr2=0x7f3e3c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.988+0000 7f3e54c58700 1 --2- 172.21.15.78:0/1857748697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e3c003aa0 0x7f3e3c003ea0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f3e40001890 tx=0x7f3e40007bb0).stop 2023-08-17T17:35:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.988+0000 7f3e4ed9d700 1 -- 172.21.15.78:0/1857748697 reap_dead start 2023-08-17T17:35:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.988+0000 7f3e54c58700 1 -- 172.21.15.78:0/1857748697 shutdown_connections 2023-08-17T17:35:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.988+0000 7f3e54c58700 1 -- 172.21.15.78:0/1857748697 >> 172.21.15.78:0/1857748697 conn(0x7f3e5006a6a0 msgr2=0x7f3e500caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.988+0000 7f3e54c58700 1 -- 172.21.15.78:0/1857748697 shutdown_connections 2023-08-17T17:35:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.988+0000 7f3e54c58700 1 -- 172.21.15.78:0/1857748697 wait complete. 2023-08-17T17:35:26.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.989+0000 7f3e54c58700 1 Processor -- start 2023-08-17T17:35:26.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.989+0000 7f3e54c58700 1 -- start start 2023-08-17T17:35:26.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e54c58700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c003aa0 0x7f3e500c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e54c58700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e50164790 0x7f3e501469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e54c58700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e50146eb0 0x7f3e500c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e54c58700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500ab980 con 0x7f3e50164790 2023-08-17T17:35:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e54c58700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500abf40 con 0x7f3e50146eb0 2023-08-17T17:35:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e54c58700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500c3050 con 0x7f3e3c003aa0 2023-08-17T17:35:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e45d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e50164790 0x7f3e501469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e45d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e50164790 0x7f3e501469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39800/0 (socket says 172.21.15.78:39800) 2023-08-17T17:35:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e45d9b700 1 -- 172.21.15.78:0/2957893210 learned_addr learned my addr 172.21.15.78:0/2957893210 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e4e59c700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c003aa0 0x7f3e500c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e4ed9d700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e50146eb0 0x7f3e500c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e45d9b700 1 -- 172.21.15.78:0/2957893210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c003aa0 msgr2=0x7f3e500c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e45d9b700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c003aa0 0x7f3e500c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e45d9b700 1 -- 172.21.15.78:0/2957893210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e50146eb0 msgr2=0x7f3e500c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e45d9b700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e50146eb0 0x7f3e500c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e45d9b700 1 -- 172.21.15.78:0/2957893210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500c3330 con 0x7f3e50164790 2023-08-17T17:35:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e45d9b700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e50164790 0x7f3e501469c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f3e38001bb0 tx=0x7f3e380011a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.990+0000 7f3e46ffd700 1 -- 172.21.15.78:0/2957893210 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e38010450 con 0x7f3e50164790 2023-08-17T17:35:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.991+0000 7f3e46ffd700 1 -- 172.21.15.78:0/2957893210 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e380105b0 con 0x7f3e50164790 2023-08-17T17:35:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.991+0000 7f3e54c58700 1 -- 172.21.15.78:0/2957893210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e500abbd0 con 0x7f3e50164790 2023-08-17T17:35:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.991+0000 7f3e46ffd700 1 -- 172.21.15.78:0/2957893210 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e38010950 con 0x7f3e50164790 2023-08-17T17:35:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.991+0000 7f3e54c58700 1 -- 172.21.15.78:0/2957893210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e500ca5f0 con 0x7f3e50164790 2023-08-17T17:35:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.992+0000 7f3e54c58700 1 -- 172.21.15.78:0/2957893210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e500ac0b0 con 0x7f3e50164790 2023-08-17T17:35:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.992+0000 7f3e46ffd700 1 -- 172.21.15.78:0/2957893210 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f3e38010cc0 con 0x7f3e50164790 2023-08-17T17:35:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.992+0000 7f3e46ffd700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e3005ee30 0x7f3e300612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.992+0000 7f3e46ffd700 1 -- 172.21.15.78:0/2957893210 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f3e38079d50 con 0x7f3e50164790 2023-08-17T17:35:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.992+0000 7f3e4e59c700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e3005ee30 0x7f3e300612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.993+0000 7f3e4e59c700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e3005ee30 0x7f3e300612f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3e40000c00 tx=0x7f3e40016000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:26.996+0000 7f3e46ffd700 1 -- 172.21.15.78:0/2957893210 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e3804b170 con 0x7f3e50164790 2023-08-17T17:35:27.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.183+0000 7f3e54c58700 1 -- 172.21.15.78:0/2957893210 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e50046af0 con 0x7f3e3005ee30 2023-08-17T17:35:27.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.187+0000 7f3e46ffd700 1 -- 172.21.15.78:0/2957893210 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3e50046af0 con 0x7f3e3005ee30 2023-08-17T17:35:27.188 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/dir9 2023-08-17T17:35:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 -- 172.21.15.78:0/2957893210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e3005ee30 msgr2=0x7f3e300612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e3005ee30 0x7f3e300612f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3e40000c00 tx=0x7f3e40016000).stop 2023-08-17T17:35:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 -- 172.21.15.78:0/2957893210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e50164790 msgr2=0x7f3e501469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e50164790 0x7f3e501469c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f3e38001bb0 tx=0x7f3e380011a0).stop 2023-08-17T17:35:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 -- 172.21.15.78:0/2957893210 shutdown_connections 2023-08-17T17:35:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e3005ee30 0x7f3e300612f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e50146eb0 0x7f3e500c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c003aa0 0x7f3e500c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 --2- 172.21.15.78:0/2957893210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e50164790 0x7f3e501469c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 -- 172.21.15.78:0/2957893210 >> 172.21.15.78:0/2957893210 conn(0x7f3e5006a6a0 msgr2=0x7f3e500b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:27.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 -- 172.21.15.78:0/2957893210 shutdown_connections 2023-08-17T17:35:27.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.189+0000 7f3e54c58700 1 -- 172.21.15.78:0/2957893210 wait complete. 2023-08-17T17:35:27.202 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-08-17T17:35:27.203 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-08-17T17:35:27.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.319+0000 7fedba0e5700 1 Processor -- start 2023-08-17T17:35:27.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.319+0000 7fedba0e5700 1 -- start start 2023-08-17T17:35:27.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedba0e5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fedb40aa0f0 0x7fedb40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedba0e5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fedb40c5810 0x7fedb40c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedba0e5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb40649b0 con 0x7fedb40aa4d0 2023-08-17T17:35:27.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedba0e5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb40c6170 con 0x7fedb40c5810 2023-08-17T17:35:27.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedba0e5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb4063420 con 0x7fedb40aa0f0 2023-08-17T17:35:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fedb40c5810 0x7fedb40c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fedb40c5810 0x7fedb40c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39816/0 (socket says 172.21.15.78:39816) 2023-08-17T17:35:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb3fff700 1 -- 172.21.15.78:0/2759539524 learned_addr learned my addr 172.21.15.78:0/2759539524 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb37fe700 1 --2- 172.21.15.78:0/2759539524 >> v2:172.21.15.150:3300/0 conn(0x7fedb40aa0f0 0x7fedb40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb3fff700 1 -- 172.21.15.78:0/2759539524 >> v2:172.21.15.150:3300/0 conn(0x7fedb40aa0f0 msgr2=0x7fedb40644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb3fff700 1 --2- 172.21.15.78:0/2759539524 >> v2:172.21.15.150:3300/0 conn(0x7fedb40aa0f0 0x7fedb40644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb3fff700 1 -- 172.21.15.78:0/2759539524 >> v1:172.21.15.150:6789/0 conn(0x7fedb40aa4d0 legacy=0x7fedb40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb3fff700 1 -- 172.21.15.78:0/2759539524 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4063700 con 0x7fedb40c5810 2023-08-17T17:35:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb3fff700 1 --2- 172.21.15.78:0/2759539524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40c5810 0x7fedb40c5c80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fedb40cade0 tx=0x7fedac0090f0).ready entity=mon.0 client_cookie=fe51feef792c16bc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb27fc700 1 -- 172.21.15.78:0/2759539524 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00b600 con 0x7fedb40c5810 2023-08-17T17:35:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb27fc700 1 -- 172.21.15.78:0/2759539524 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac00b760 con 0x7fedb40c5810 2023-08-17T17:35:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.320+0000 7fedb27fc700 1 -- 172.21.15.78:0/2759539524 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00bae0 con 0x7fedb40c5810 2023-08-17T17:35:27.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.321+0000 7fedba0e5700 1 -- 172.21.15.78:0/2759539524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40c5810 msgr2=0x7fedb40c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.321+0000 7fedba0e5700 1 --2- 172.21.15.78:0/2759539524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40c5810 0x7fedb40c5c80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fedb40cade0 tx=0x7fedac0090f0).stop 2023-08-17T17:35:27.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.321+0000 7fedba0e5700 1 -- 172.21.15.78:0/2759539524 shutdown_connections 2023-08-17T17:35:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.321+0000 7fedba0e5700 1 --2- 172.21.15.78:0/2759539524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40c5810 0x7fedb40c5c80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.321+0000 7fedba0e5700 1 --2- 172.21.15.78:0/2759539524 >> v2:172.21.15.150:3300/0 conn(0x7fedb40aa0f0 0x7fedb40644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.321+0000 7fedba0e5700 1 -- 172.21.15.78:0/2759539524 >> 172.21.15.78:0/2759539524 conn(0x7fedb406a6a0 msgr2=0x7fedb40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.321+0000 7fedba0e5700 1 -- 172.21.15.78:0/2759539524 shutdown_connections 2023-08-17T17:35:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.321+0000 7fedba0e5700 1 -- 172.21.15.78:0/2759539524 wait complete. 2023-08-17T17:35:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.322+0000 7fedba0e5700 1 Processor -- start 2023-08-17T17:35:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.322+0000 7fedba0e5700 1 -- start start 2023-08-17T17:35:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedba0e5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb40aa0f0 0x7fedb4151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedba0e5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40aa4d0 0x7fedb40c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedba0e5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedb40c5810 0x7fedb40c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedba0e5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb4151fd0 con 0x7fedb40aa4d0 2023-08-17T17:35:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedba0e5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40ab980 con 0x7fedb40aa0f0 2023-08-17T17:35:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedba0e5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40abf40 con 0x7fedb40c5810 2023-08-17T17:35:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40aa4d0 0x7fedb40c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40aa4d0 0x7fedb40c2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39832/0 (socket says 172.21.15.78:39832) 2023-08-17T17:35:27.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb2ffd700 1 -- 172.21.15.78:0/1734885026 learned_addr learned my addr 172.21.15.78:0/1734885026 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:27.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb37fe700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb40aa0f0 0x7fedb4151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb3fff700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedb40c5810 0x7fedb40c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb2ffd700 1 -- 172.21.15.78:0/1734885026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedb40c5810 msgr2=0x7fedb40c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb2ffd700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedb40c5810 0x7fedb40c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb2ffd700 1 -- 172.21.15.78:0/1734885026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb40aa0f0 msgr2=0x7fedb4151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb2ffd700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb40aa0f0 0x7fedb4151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb2ffd700 1 -- 172.21.15.78:0/1734885026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac009370 con 0x7fedb40aa4d0 2023-08-17T17:35:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb3fff700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedb40c5810 0x7fedb40c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.323+0000 7fedb2ffd700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40aa4d0 0x7fedb40c2490 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fed9c00c440 tx=0x7fed9c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.324+0000 7fedab7fe700 1 -- 172.21.15.78:0/1734885026 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c00ce60 con 0x7fedb40aa4d0 2023-08-17T17:35:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.324+0000 7fedab7fe700 1 -- 172.21.15.78:0/1734885026 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c00f470 con 0x7fedb40aa4d0 2023-08-17T17:35:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.324+0000 7fedba0e5700 1 -- 172.21.15.78:0/1734885026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb40ca490 con 0x7fedb40aa4d0 2023-08-17T17:35:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.324+0000 7fedab7fe700 1 -- 172.21.15.78:0/1734885026 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c00f810 con 0x7fedb40aa4d0 2023-08-17T17:35:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.324+0000 7fedba0e5700 1 -- 172.21.15.78:0/1734885026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb40caa50 con 0x7fedb40aa4d0 2023-08-17T17:35:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.324+0000 7fedba0e5700 1 -- 172.21.15.78:0/1734885026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb4083980 con 0x7fedb40aa4d0 2023-08-17T17:35:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.325+0000 7fedab7fe700 1 -- 172.21.15.78:0/1734885026 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fed9c019030 con 0x7fedb40aa4d0 2023-08-17T17:35:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.325+0000 7fedab7fe700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed9405ee30 0x7fed940612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.325+0000 7fedab7fe700 1 -- 172.21.15.78:0/1734885026 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fed9c0791a0 con 0x7fedb40aa4d0 2023-08-17T17:35:27.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.325+0000 7fedb37fe700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed9405ee30 0x7fed940612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.326+0000 7fedb37fe700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed9405ee30 0x7fed940612f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7feda4009fd0 tx=0x7feda4009880).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:27.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.329+0000 7fedab7fe700 1 -- 172.21.15.78:0/1734885026 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed9c04a5c0 con 0x7fedb40aa4d0 2023-08-17T17:35:27.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.517+0000 7fedba0e5700 1 -- 172.21.15.78:0/1734885026 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fedb4046af0 con 0x7fed9405ee30 2023-08-17T17:35:27.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.521+0000 7fedab7fe700 1 -- 172.21.15.78:0/1734885026 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fedb4046af0 con 0x7fed9405ee30 2023-08-17T17:35:27.523 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-08-17T17:35:27.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 -- 172.21.15.78:0/1734885026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed9405ee30 msgr2=0x7fed940612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed9405ee30 0x7fed940612f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7feda4009fd0 tx=0x7feda4009880).stop 2023-08-17T17:35:27.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 -- 172.21.15.78:0/1734885026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40aa4d0 msgr2=0x7fedb40c2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40aa4d0 0x7fedb40c2490 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fed9c00c440 tx=0x7fed9c007d90).stop 2023-08-17T17:35:27.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 -- 172.21.15.78:0/1734885026 shutdown_connections 2023-08-17T17:35:27.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed9405ee30 0x7fed940612f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedb40c5810 0x7fedb40c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb40aa0f0 0x7fedb4151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 --2- 172.21.15.78:0/1734885026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb40aa4d0 0x7fedb40c2490 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 -- 172.21.15.78:0/1734885026 >> 172.21.15.78:0/1734885026 conn(0x7fedb406a6a0 msgr2=0x7fedb40a9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:27.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 -- 172.21.15.78:0/1734885026 shutdown_connections 2023-08-17T17:35:27.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.523+0000 7fedba0e5700 1 -- 172.21.15.78:0/1734885026 wait complete. 2023-08-17T17:35:27.536 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-08-17T17:35:27.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-08-17T17:35:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.653+0000 7f6e9cebb700 1 Processor -- start 2023-08-17T17:35:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.653+0000 7f6e9cebb700 1 -- start start 2023-08-17T17:35:27.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e9cebb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e98151a40 0x7f6e980c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e9cebb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e98157be0 0x7f6e98158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e9cebb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e98158560 con 0x7f6e98151e20 2023-08-17T17:35:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e9cebb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e980c6620 con 0x7f6e98151a40 2023-08-17T17:35:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e9cebb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980c6900 con 0x7f6e98157be0 2023-08-17T17:35:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e977fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e98151a40 0x7f6e980c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e977fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e98151a40 0x7f6e980c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39846/0 (socket says 172.21.15.78:39846) 2023-08-17T17:35:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e977fe700 1 -- 172.21.15.78:0/2880087248 learned_addr learned my addr 172.21.15.78:0/2880087248 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e97fff700 1 --2- 172.21.15.78:0/2880087248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e98157be0 0x7f6e98158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e977fe700 1 -- 172.21.15.78:0/2880087248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e98157be0 msgr2=0x7f6e98158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e977fe700 1 --2- 172.21.15.78:0/2880087248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e98157be0 0x7f6e98158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e977fe700 1 -- 172.21.15.78:0/2880087248 >> v1:172.21.15.78:6789/0 conn(0x7f6e98151e20 legacy=0x7f6e980c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e96ffd700 1 -- 172.21.15.78:0/2880087248 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658034230 0 0) 0x7f6e98158560 con 0x7f6e98151e20 2023-08-17T17:35:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e977fe700 1 -- 172.21.15.78:0/2880087248 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980c6be0 con 0x7f6e98151a40 2023-08-17T17:35:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e977fe700 1 --2- 172.21.15.78:0/2880087248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 0x7f6e980c8260 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f6e88009810 tx=0x7f6e88009060).ready entity=mon.0 client_cookie=652a8545007e84f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e96ffd700 1 -- 172.21.15.78:0/2880087248 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88005880 con 0x7f6e98151a40 2023-08-17T17:35:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e96ffd700 1 -- 172.21.15.78:0/2880087248 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e880059e0 con 0x7f6e98151a40 2023-08-17T17:35:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.654+0000 7f6e96ffd700 1 -- 172.21.15.78:0/2880087248 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88005d60 con 0x7f6e98151a40 2023-08-17T17:35:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.655+0000 7f6e9cebb700 1 -- 172.21.15.78:0/2880087248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 msgr2=0x7f6e980c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.655+0000 7f6e9cebb700 1 --2- 172.21.15.78:0/2880087248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 0x7f6e980c8260 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f6e88009810 tx=0x7f6e88009060).stop 2023-08-17T17:35:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.655+0000 7f6e9cebb700 1 -- 172.21.15.78:0/2880087248 shutdown_connections 2023-08-17T17:35:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.655+0000 7f6e9cebb700 1 --2- 172.21.15.78:0/2880087248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e98157be0 0x7f6e98158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.655+0000 7f6e9cebb700 1 --2- 172.21.15.78:0/2880087248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 0x7f6e980c8260 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.655+0000 7f6e9cebb700 1 -- 172.21.15.78:0/2880087248 >> 172.21.15.78:0/2880087248 conn(0x7f6e980943b0 msgr2=0x7f6e9806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.655+0000 7f6e9cebb700 1 -- 172.21.15.78:0/2880087248 shutdown_connections 2023-08-17T17:35:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.655+0000 7f6e9cebb700 1 -- 172.21.15.78:0/2880087248 wait complete. 2023-08-17T17:35:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.656+0000 7f6e9cebb700 1 Processor -- start 2023-08-17T17:35:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.656+0000 7f6e9cebb700 1 -- start start 2023-08-17T17:35:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e9cebb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 0x7f6e9814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e9cebb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e98151e20 0x7f6e980641e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e9cebb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e98157be0 0x7f6e980646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e9cebb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98064bc0 con 0x7f6e98151a40 2023-08-17T17:35:27.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e9cebb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980c1d80 con 0x7f6e98151e20 2023-08-17T17:35:27.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e9cebb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980c2900 con 0x7f6e98157be0 2023-08-17T17:35:27.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e977fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 0x7f6e9814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e977fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 0x7f6e9814c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39848/0 (socket says 172.21.15.78:39848) 2023-08-17T17:35:27.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e977fe700 1 -- 172.21.15.78:0/3785020433 learned_addr learned my addr 172.21.15.78:0/3785020433 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:27.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e977fe700 1 -- 172.21.15.78:0/3785020433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e98157be0 msgr2=0x7f6e980646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e97fff700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e98157be0 0x7f6e980646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e8ffff700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e98151e20 0x7f6e980641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e977fe700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e98157be0 0x7f6e980646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e977fe700 1 -- 172.21.15.78:0/3785020433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e98151e20 msgr2=0x7f6e980641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e977fe700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e98151e20 0x7f6e980641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e977fe700 1 -- 172.21.15.78:0/3785020433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88009300 con 0x7f6e98151a40 2023-08-17T17:35:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e8ffff700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e98151e20 0x7f6e980641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.657+0000 7f6e977fe700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 0x7f6e9814c7e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f6e88009f60 tx=0x7f6e88016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.658+0000 7f6e8f7fe700 1 -- 172.21.15.78:0/3785020433 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88005880 con 0x7f6e98151a40 2023-08-17T17:35:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.658+0000 7f6e8f7fe700 1 -- 172.21.15.78:0/3785020433 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8800b850 con 0x7f6e98151a40 2023-08-17T17:35:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.658+0000 7f6e9cebb700 1 -- 172.21.15.78:0/3785020433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e980c1fd0 con 0x7f6e98151a40 2023-08-17T17:35:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.658+0000 7f6e8f7fe700 1 -- 172.21.15.78:0/3785020433 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800bc10 con 0x7f6e98151a40 2023-08-17T17:35:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.658+0000 7f6e9cebb700 1 -- 172.21.15.78:0/3785020433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e980c2590 con 0x7f6e98151a40 2023-08-17T17:35:27.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.658+0000 7f6e9cebb700 1 -- 172.21.15.78:0/3785020433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e98082f90 con 0x7f6e98151a40 2023-08-17T17:35:27.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.659+0000 7f6e8f7fe700 1 -- 172.21.15.78:0/3785020433 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f6e8800f070 con 0x7f6e98151a40 2023-08-17T17:35:27.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.659+0000 7f6e8f7fe700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e7805ee00 0x7f6e780612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.659+0000 7f6e8f7fe700 1 -- 172.21.15.78:0/3785020433 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f6e8807b040 con 0x7f6e98151a40 2023-08-17T17:35:27.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.659+0000 7f6e8ffff700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e7805ee00 0x7f6e780612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.660+0000 7f6e8ffff700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e7805ee00 0x7f6e780612c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6e98167750 tx=0x7f6e80009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:27.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.663+0000 7f6e8f7fe700 1 -- 172.21.15.78:0/3785020433 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6e8804c460 con 0x7f6e98151a40 2023-08-17T17:35:27.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.852+0000 7f6e9cebb700 1 -- 172.21.15.78:0/3785020433 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e980c2a40 con 0x7f6e7805ee00 2023-08-17T17:35:27.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.855+0000 7f6e8f7fe700 1 -- 172.21.15.78:0/3785020433 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6e800013a0 con 0x7f6e7805ee00 2023-08-17T17:35:27.857 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-08-17T17:35:27.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 -- 172.21.15.78:0/3785020433 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e7805ee00 msgr2=0x7f6e780612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e7805ee00 0x7f6e780612c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6e98167750 tx=0x7f6e80009040).stop 2023-08-17T17:35:27.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 -- 172.21.15.78:0/3785020433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 msgr2=0x7f6e9814c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 0x7f6e9814c7e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f6e88009f60 tx=0x7f6e88016000).stop 2023-08-17T17:35:27.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 -- 172.21.15.78:0/3785020433 shutdown_connections 2023-08-17T17:35:27.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6e7805ee00 0x7f6e780612c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e98157be0 0x7f6e980646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e98151a40 0x7f6e9814c7e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 --2- 172.21.15.78:0/3785020433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e98151e20 0x7f6e980641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 -- 172.21.15.78:0/3785020433 >> 172.21.15.78:0/3785020433 conn(0x7f6e980943b0 msgr2=0x7f6e98062ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:27.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 -- 172.21.15.78:0/3785020433 shutdown_connections 2023-08-17T17:35:27.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.857+0000 7f6e9cebb700 1 -- 172.21.15.78:0/3785020433 wait complete. 2023-08-17T17:35:27.870 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-08-17T17:35:27.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-08-17T17:35:27.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.987+0000 7f4eca78b700 1 Processor -- start 2023-08-17T17:35:27.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.987+0000 7f4eca78b700 1 -- start start 2023-08-17T17:35:27.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4eca78b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4ec40aa0f0 0x7f4ec40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4eca78b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4ec40c5810 0x7f4ec40c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4eca78b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec40649b0 con 0x7f4ec40aa4d0 2023-08-17T17:35:27.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4eca78b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec40c6170 con 0x7f4ec40c5810 2023-08-17T17:35:27.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4eca78b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec4063420 con 0x7f4ec40aa0f0 2023-08-17T17:35:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4ec8d28700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4ec40c5810 0x7f4ec40c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4ec8d28700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4ec40c5810 0x7f4ec40c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39850/0 (socket says 172.21.15.78:39850) 2023-08-17T17:35:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4ec8d28700 1 -- 172.21.15.78:0/3608353569 learned_addr learned my addr 172.21.15.78:0/3608353569 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4ec3fff700 1 --2- 172.21.15.78:0/3608353569 >> v2:172.21.15.150:3300/0 conn(0x7f4ec40aa0f0 0x7f4ec40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4ec8d28700 1 -- 172.21.15.78:0/3608353569 >> v2:172.21.15.150:3300/0 conn(0x7f4ec40aa0f0 msgr2=0x7f4ec40644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.988+0000 7f4ec8d28700 1 --2- 172.21.15.78:0/3608353569 >> v2:172.21.15.150:3300/0 conn(0x7f4ec40aa0f0 0x7f4ec40644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4ec8d28700 1 -- 172.21.15.78:0/3608353569 >> v1:172.21.15.150:6789/0 conn(0x7f4ec40aa4d0 legacy=0x7f4ec40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4ec8d28700 1 -- 172.21.15.78:0/3608353569 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4063700 con 0x7f4ec40c5810 2023-08-17T17:35:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4ec8d28700 1 --2- 172.21.15.78:0/3608353569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 0x7f4ec40c5c80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f4ec40cade0 tx=0x7f4ebc009840).ready entity=mon.0 client_cookie=4217cc6ec87eedd5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4ec2ffd700 1 -- 172.21.15.78:0/3608353569 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc00e070 con 0x7f4ec40c5810 2023-08-17T17:35:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4ec2ffd700 1 -- 172.21.15.78:0/3608353569 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc00ba50 con 0x7f4ec40c5810 2023-08-17T17:35:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4ec2ffd700 1 -- 172.21.15.78:0/3608353569 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc00bdd0 con 0x7f4ec40c5810 2023-08-17T17:35:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4eca78b700 1 -- 172.21.15.78:0/3608353569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 msgr2=0x7f4ec40c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4eca78b700 1 --2- 172.21.15.78:0/3608353569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 0x7f4ec40c5c80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f4ec40cade0 tx=0x7f4ebc009840).stop 2023-08-17T17:35:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4eca78b700 1 -- 172.21.15.78:0/3608353569 shutdown_connections 2023-08-17T17:35:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4eca78b700 1 --2- 172.21.15.78:0/3608353569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 0x7f4ec40c5c80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4eca78b700 1 --2- 172.21.15.78:0/3608353569 >> v2:172.21.15.150:3300/0 conn(0x7f4ec40aa0f0 0x7f4ec40644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4eca78b700 1 -- 172.21.15.78:0/3608353569 >> 172.21.15.78:0/3608353569 conn(0x7f4ec406a6a0 msgr2=0x7f4ec40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4eca78b700 1 -- 172.21.15.78:0/3608353569 shutdown_connections 2023-08-17T17:35:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.989+0000 7f4eca78b700 1 -- 172.21.15.78:0/3608353569 wait complete. 2023-08-17T17:35:27.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.990+0000 7f4eca78b700 1 Processor -- start 2023-08-17T17:35:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.991+0000 7f4eca78b700 1 -- start start 2023-08-17T17:35:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.991+0000 7f4eca78b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ec40aa0f0 0x7f4ec4152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.991+0000 7f4eca78b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ec40aa4d0 0x7f4ec40af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.991+0000 7f4eca78b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 0x7f4ec40c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.991+0000 7f4eca78b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40aec30 con 0x7f4ec40c5810 2023-08-17T17:35:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.991+0000 7f4eca78b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40ae020 con 0x7f4ec40aa0f0 2023-08-17T17:35:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.991+0000 7f4eca78b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40ae300 con 0x7f4ec40aa4d0 2023-08-17T17:35:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.991+0000 7f4ec8d28700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 0x7f4ec40c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.991+0000 7f4ec8d28700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 0x7f4ec40c27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39862/0 (socket says 172.21.15.78:39862) 2023-08-17T17:35:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.991+0000 7f4ec8d28700 1 -- 172.21.15.78:0/2261301325 learned_addr learned my addr 172.21.15.78:0/2261301325 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4ec3fff700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ec40aa0f0 0x7f4ec4152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4ec37fe700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ec40aa4d0 0x7f4ec40af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4ec8d28700 1 -- 172.21.15.78:0/2261301325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ec40aa4d0 msgr2=0x7f4ec40af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4ec8d28700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ec40aa4d0 0x7f4ec40af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4ec8d28700 1 -- 172.21.15.78:0/2261301325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ec40aa0f0 msgr2=0x7f4ec4152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4ec8d28700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ec40aa0f0 0x7f4ec4152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4ec8d28700 1 -- 172.21.15.78:0/2261301325 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc009ae0 con 0x7f4ec40c5810 2023-08-17T17:35:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4ec37fe700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ec40aa4d0 0x7f4ec40af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4ec8d28700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 0x7f4ec40c27e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f4ebc009fd0 tx=0x7f4ebc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4eabfff700 1 -- 172.21.15.78:0/2261301325 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc00bdd0 con 0x7f4ec40c5810 2023-08-17T17:35:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4eabfff700 1 -- 172.21.15.78:0/2261301325 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc0092e0 con 0x7f4ec40c5810 2023-08-17T17:35:28.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4eca78b700 1 -- 172.21.15.78:0/2261301325 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec40ae5e0 con 0x7f4ec40c5810 2023-08-17T17:35:28.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4eabfff700 1 -- 172.21.15.78:0/2261301325 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc01c610 con 0x7f4ec40c5810 2023-08-17T17:35:28.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.992+0000 7f4eca78b700 1 -- 172.21.15.78:0/2261301325 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec41525f0 con 0x7f4ec40c5810 2023-08-17T17:35:28.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.993+0000 7f4eca78b700 1 -- 172.21.15.78:0/2261301325 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec4083980 con 0x7f4ec40c5810 2023-08-17T17:35:28.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.993+0000 7f4eabfff700 1 -- 172.21.15.78:0/2261301325 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f4ebc01c9c0 con 0x7f4ec40c5810 2023-08-17T17:35:28.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.994+0000 7f4eabfff700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4eb005ee30 0x7f4eb00612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.994+0000 7f4eabfff700 1 -- 172.21.15.78:0/2261301325 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f4ebc07b8e0 con 0x7f4ec40c5810 2023-08-17T17:35:28.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.994+0000 7f4ec3fff700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4eb005ee30 0x7f4eb00612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.994+0000 7f4ec3fff700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4eb005ee30 0x7f4eb00612f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4eb400bbc0 tx=0x7f4eb4008040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:28.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:27.998+0000 7f4eabfff700 1 -- 172.21.15.78:0/2261301325 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ebc04cd00 con 0x7f4ec40c5810 2023-08-17T17:35:28.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.188+0000 7f4eca78b700 1 -- 172.21.15.78:0/2261301325 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ec40629b0 con 0x7f4eb005ee30 2023-08-17T17:35:28.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.192+0000 7f4eabfff700 1 -- 172.21.15.78:0/2261301325 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4ec40629b0 con 0x7f4eb005ee30 2023-08-17T17:35:28.193 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-08-17T17:35:28.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 -- 172.21.15.78:0/2261301325 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4eb005ee30 msgr2=0x7f4eb00612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4eb005ee30 0x7f4eb00612f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4eb400bbc0 tx=0x7f4eb4008040).stop 2023-08-17T17:35:28.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 -- 172.21.15.78:0/2261301325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 msgr2=0x7f4ec40c27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 0x7f4ec40c27e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f4ebc009fd0 tx=0x7f4ebc009840).stop 2023-08-17T17:35:28.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 -- 172.21.15.78:0/2261301325 shutdown_connections 2023-08-17T17:35:28.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4eb005ee30 0x7f4eb00612f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ec40c5810 0x7f4ec40c27e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ec40aa0f0 0x7f4ec4152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 --2- 172.21.15.78:0/2261301325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ec40aa4d0 0x7f4ec40af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 -- 172.21.15.78:0/2261301325 >> 172.21.15.78:0/2261301325 conn(0x7f4ec406a6a0 msgr2=0x7f4ec40a7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:28.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 -- 172.21.15.78:0/2261301325 shutdown_connections 2023-08-17T17:35:28.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.194+0000 7f4eca78b700 1 -- 172.21.15.78:0/2261301325 wait complete. 2023-08-17T17:35:28.207 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-08-17T17:35:28.207 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-08-17T17:35:28.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.323+0000 7fe78694e700 1 Processor -- start 2023-08-17T17:35:28.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.323+0000 7fe78694e700 1 -- start start 2023-08-17T17:35:28.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.324+0000 7fe78694e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe7800aa4d0 0x7fe7800644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.324+0000 7fe78694e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7800c5810 0x7fe7800c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.324+0000 7fe78694e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7800649b0 con 0x7fe7800aa0f0 2023-08-17T17:35:28.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.324+0000 7fe78694e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7800c6170 con 0x7fe7800aa4d0 2023-08-17T17:35:28.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.324+0000 7fe78694e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe780063420 con 0x7fe7800c5810 2023-08-17T17:35:28.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.324+0000 7fe77f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe7800aa4d0 0x7fe7800644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.324+0000 7fe77f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe7800aa4d0 0x7fe7800644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39866/0 (socket says 172.21.15.78:39866) 2023-08-17T17:35:28.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.324+0000 7fe77f7fe700 1 -- 172.21.15.78:0/2321570013 learned_addr learned my addr 172.21.15.78:0/2321570013 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:28.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.324+0000 7fe784eeb700 1 --2- 172.21.15.78:0/2321570013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7800c5810 0x7fe7800c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe77f7fe700 1 -- 172.21.15.78:0/2321570013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7800c5810 msgr2=0x7fe7800c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:28.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe77f7fe700 1 --2- 172.21.15.78:0/2321570013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7800c5810 0x7fe7800c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe77f7fe700 1 -- 172.21.15.78:0/2321570013 >> v1:172.21.15.150:6789/0 conn(0x7fe7800aa0f0 legacy=0x7fe7800c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe77f7fe700 1 -- 172.21.15.78:0/2321570013 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe780063700 con 0x7fe7800aa4d0 2023-08-17T17:35:28.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe77f7fe700 1 --2- 172.21.15.78:0/2321570013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 0x7fe7800644c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fe774006fd0 tx=0x7fe7740090f0).ready entity=mon.0 client_cookie=a48ed721a9630a2b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:28.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe77effd700 1 -- 172.21.15.78:0/2321570013 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400b600 con 0x7fe7800aa4d0 2023-08-17T17:35:28.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe77effd700 1 -- 172.21.15.78:0/2321570013 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77400b760 con 0x7fe7800aa4d0 2023-08-17T17:35:28.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe77effd700 1 -- 172.21.15.78:0/2321570013 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400bae0 con 0x7fe7800aa4d0 2023-08-17T17:35:28.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe78694e700 1 -- 172.21.15.78:0/2321570013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 msgr2=0x7fe7800644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe78694e700 1 --2- 172.21.15.78:0/2321570013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 0x7fe7800644c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fe774006fd0 tx=0x7fe7740090f0).stop 2023-08-17T17:35:28.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe78694e700 1 -- 172.21.15.78:0/2321570013 shutdown_connections 2023-08-17T17:35:28.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe78694e700 1 --2- 172.21.15.78:0/2321570013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7800c5810 0x7fe7800c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe78694e700 1 --2- 172.21.15.78:0/2321570013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 0x7fe7800644c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe78694e700 1 -- 172.21.15.78:0/2321570013 >> 172.21.15.78:0/2321570013 conn(0x7fe78006a6a0 msgr2=0x7fe7800caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:28.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe78694e700 1 -- 172.21.15.78:0/2321570013 shutdown_connections 2023-08-17T17:35:28.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.325+0000 7fe78694e700 1 -- 172.21.15.78:0/2321570013 wait complete. 2023-08-17T17:35:28.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.326+0000 7fe78694e700 1 Processor -- start 2023-08-17T17:35:28.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.327+0000 7fe78694e700 1 -- start start 2023-08-17T17:35:28.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.327+0000 7fe78694e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7800aa0f0 0x7fe7800c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.327+0000 7fe78694e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 0x7fe7800c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.327+0000 7fe78694e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7800c5810 0x7fe7800c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.327+0000 7fe78694e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800c2a20 con 0x7fe7800aa4d0 2023-08-17T17:35:28.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.327+0000 7fe78694e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800c2d00 con 0x7fe7800c5810 2023-08-17T17:35:28.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.327+0000 7fe78694e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800c2fe0 con 0x7fe7800aa0f0 2023-08-17T17:35:28.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.327+0000 7fe77f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 0x7fe7800c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.327+0000 7fe77f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 0x7fe7800c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39882/0 (socket says 172.21.15.78:39882) 2023-08-17T17:35:28.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.327+0000 7fe77f7fe700 1 -- 172.21.15.78:0/247259675 learned_addr learned my addr 172.21.15.78:0/247259675 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe77f7fe700 1 -- 172.21.15.78:0/247259675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7800aa0f0 msgr2=0x7fe7800c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe77ffff700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7800aa0f0 0x7fe7800c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe784eeb700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7800c5810 0x7fe7800c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe77f7fe700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7800aa0f0 0x7fe7800c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe77f7fe700 1 -- 172.21.15.78:0/247259675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7800c5810 msgr2=0x7fe7800c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe77f7fe700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7800c5810 0x7fe7800c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe77f7fe700 1 -- 172.21.15.78:0/247259675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe774009370 con 0x7fe7800aa4d0 2023-08-17T17:35:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe77f7fe700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 0x7fe7800c21f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fe774011000 tx=0x7fe774017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe767fff700 1 -- 172.21.15.78:0/247259675 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400b8d0 con 0x7fe7800aa4d0 2023-08-17T17:35:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe767fff700 1 -- 172.21.15.78:0/247259675 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77400ba30 con 0x7fe7800aa4d0 2023-08-17T17:35:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe767fff700 1 -- 172.21.15.78:0/247259675 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77401c670 con 0x7fe7800aa4d0 2023-08-17T17:35:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe78694e700 1 -- 172.21.15.78:0/247259675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7800c32c0 con 0x7fe7800aa4d0 2023-08-17T17:35:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.328+0000 7fe78694e700 1 -- 172.21.15.78:0/247259675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7800c26e0 con 0x7fe7800aa4d0 2023-08-17T17:35:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.329+0000 7fe78694e700 1 -- 172.21.15.78:0/247259675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7800c37e0 con 0x7fe7800aa4d0 2023-08-17T17:35:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.329+0000 7fe767fff700 1 -- 172.21.15.78:0/247259675 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fe77402c070 con 0x7fe7800aa4d0 2023-08-17T17:35:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.330+0000 7fe767fff700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe76c05ee30 0x7fe76c0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.330+0000 7fe767fff700 1 -- 172.21.15.78:0/247259675 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fe77407b9d0 con 0x7fe7800aa4d0 2023-08-17T17:35:28.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.330+0000 7fe77ffff700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe76c05ee30 0x7fe76c0612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.330+0000 7fe77ffff700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe76c05ee30 0x7fe76c0612f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe7700015e0 tx=0x7fe770009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:28.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.334+0000 7fe767fff700 1 -- 172.21.15.78:0/247259675 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe7800c37e0 con 0x7fe7800aa4d0 2023-08-17T17:35:28.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.522+0000 7fe78694e700 1 -- 172.21.15.78:0/247259675 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7800c37e0 con 0x7fe76c05ee30 2023-08-17T17:35:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.526+0000 7fe767fff700 1 -- 172.21.15.78:0/247259675 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fe7800c37e0 con 0x7fe76c05ee30 2023-08-17T17:35:28.528 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-08-17T17:35:28.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.528+0000 7fe78694e700 1 -- 172.21.15.78:0/247259675 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe76c05ee30 msgr2=0x7fe76c0612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.528+0000 7fe78694e700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe76c05ee30 0x7fe76c0612f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe7700015e0 tx=0x7fe770009040).stop 2023-08-17T17:35:28.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.528+0000 7fe78694e700 1 -- 172.21.15.78:0/247259675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 msgr2=0x7fe7800c21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.528+0000 7fe78694e700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 0x7fe7800c21f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fe774011000 tx=0x7fe774017000).stop 2023-08-17T17:35:28.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.528+0000 7fe78694e700 1 -- 172.21.15.78:0/247259675 shutdown_connections 2023-08-17T17:35:28.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.528+0000 7fe78694e700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe76c05ee30 0x7fe76c0612f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.529+0000 7fe78694e700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7800c5810 0x7fe7800c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.529+0000 7fe78694e700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7800aa0f0 0x7fe7800c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.529+0000 7fe78694e700 1 --2- 172.21.15.78:0/247259675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7800aa4d0 0x7fe7800c21f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.529+0000 7fe78694e700 1 -- 172.21.15.78:0/247259675 >> 172.21.15.78:0/247259675 conn(0x7fe78006a6a0 msgr2=0x7fe7800afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:28.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.529+0000 7fe78694e700 1 -- 172.21.15.78:0/247259675 shutdown_connections 2023-08-17T17:35:28.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.529+0000 7fe78694e700 1 -- 172.21.15.78:0/247259675 wait complete. 2023-08-17T17:35:28.542 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-08-17T17:35:28.542 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-08-17T17:35:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.660+0000 7f5ea759e700 1 Processor -- start 2023-08-17T17:35:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.660+0000 7f5ea759e700 1 -- start start 2023-08-17T17:35:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.661+0000 7f5ea759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5ea80a6f10 0x7f5ea8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.661+0000 7f5ea759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea8062c00 0x7f5ea8154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.661+0000 7f5ea759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea8069690 con 0x7f5ea81547e0 2023-08-17T17:35:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.661+0000 7f5ea759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea81557f0 con 0x7f5ea80a6f10 2023-08-17T17:35:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.661+0000 7f5ea759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8155230 con 0x7f5ea8062c00 2023-08-17T17:35:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.661+0000 7f5ea659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5ea80a6f10 0x7f5ea8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.661+0000 7f5ea659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5ea80a6f10 0x7f5ea8069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48482/0 (socket says 172.21.15.78:48482) 2023-08-17T17:35:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.661+0000 7f5ea659c700 1 -- 172.21.15.78:0/1024724035 learned_addr learned my addr 172.21.15.78:0/1024724035 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea6d9d700 1 --2- 172.21.15.78:0/1024724035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea8062c00 0x7f5ea8154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea659c700 1 -- 172.21.15.78:0/1024724035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea8062c00 msgr2=0x7f5ea8154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea659c700 1 --2- 172.21.15.78:0/1024724035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea8062c00 0x7f5ea8154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea659c700 1 -- 172.21.15.78:0/1024724035 >> v1:172.21.15.150:6789/0 conn(0x7f5ea81547e0 legacy=0x7f5ea80624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea659c700 1 -- 172.21.15.78:0/1024724035 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea8155510 con 0x7f5ea80a6f10 2023-08-17T17:35:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea659c700 1 --2- 172.21.15.78:0/1024724035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea80a6f10 0x7f5ea8069b20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f5e98006fd0 tx=0x7f5e980090f0).ready entity=mon.0 client_cookie=5383575cd9ad3425 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea5d9b700 1 -- 172.21.15.78:0/1024724035 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800b600 con 0x7f5ea80a6f10 2023-08-17T17:35:28.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea5d9b700 1 -- 172.21.15.78:0/1024724035 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9800b760 con 0x7f5ea80a6f10 2023-08-17T17:35:28.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea5d9b700 1 -- 172.21.15.78:0/1024724035 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800bae0 con 0x7f5ea80a6f10 2023-08-17T17:35:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea759e700 1 -- 172.21.15.78:0/1024724035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea80a6f10 msgr2=0x7f5ea8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.662+0000 7f5ea759e700 1 --2- 172.21.15.78:0/1024724035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea80a6f10 0x7f5ea8069b20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f5e98006fd0 tx=0x7f5e980090f0).stop 2023-08-17T17:35:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.663+0000 7f5ea759e700 1 -- 172.21.15.78:0/1024724035 shutdown_connections 2023-08-17T17:35:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.663+0000 7f5ea759e700 1 --2- 172.21.15.78:0/1024724035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea8062c00 0x7f5ea8154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.663+0000 7f5ea759e700 1 --2- 172.21.15.78:0/1024724035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea80a6f10 0x7f5ea8069b20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.663+0000 7f5ea759e700 1 -- 172.21.15.78:0/1024724035 >> 172.21.15.78:0/1024724035 conn(0x7f5ea80c7c10 msgr2=0x7f5ea80c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.663+0000 7f5ea759e700 1 -- 172.21.15.78:0/1024724035 shutdown_connections 2023-08-17T17:35:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.663+0000 7f5ea759e700 1 -- 172.21.15.78:0/1024724035 wait complete. 2023-08-17T17:35:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.664+0000 7f5ea759e700 1 Processor -- start 2023-08-17T17:35:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.664+0000 7f5ea759e700 1 -- start start 2023-08-17T17:35:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea8062c00 0x7f5ea8167810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea80a6f10 0x7f5ea80a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea81547e0 0x7f5ea8165c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80a9840 con 0x7f5ea8062c00 2023-08-17T17:35:28.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80a8990 con 0x7f5ea80a6f10 2023-08-17T17:35:28.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80a8ea0 con 0x7f5ea81547e0 2023-08-17T17:35:28.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea8062c00 0x7f5ea8167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea8062c00 0x7f5ea8167810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48498/0 (socket says 172.21.15.78:48498) 2023-08-17T17:35:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea659c700 1 -- 172.21.15.78:0/2300204717 learned_addr learned my addr 172.21.15.78:0/2300204717 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5e9dd9b700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea80a6f10 0x7f5ea80a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea6d9d700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea81547e0 0x7f5ea8165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea659c700 1 -- 172.21.15.78:0/2300204717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea81547e0 msgr2=0x7f5ea8165c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea659c700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea81547e0 0x7f5ea8165c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea659c700 1 -- 172.21.15.78:0/2300204717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea80a6f10 msgr2=0x7f5ea80a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea659c700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea80a6f10 0x7f5ea80a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea659c700 1 -- 172.21.15.78:0/2300204717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98009370 con 0x7f5ea8062c00 2023-08-17T17:35:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5e9dd9b700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea80a6f10 0x7f5ea80a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea659c700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea8062c00 0x7f5ea8167810 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f5ea8068920 tx=0x7f5e98017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5e9effd700 1 -- 172.21.15.78:0/2300204717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800b8d0 con 0x7f5ea8062c00 2023-08-17T17:35:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5e9effd700 1 -- 172.21.15.78:0/2300204717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9800ba30 con 0x7f5ea8062c00 2023-08-17T17:35:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5e9effd700 1 -- 172.21.15.78:0/2300204717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9801c670 con 0x7f5ea8062c00 2023-08-17T17:35:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea759e700 1 -- 172.21.15.78:0/2300204717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea80a9180 con 0x7f5ea8062c00 2023-08-17T17:35:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.665+0000 7f5ea759e700 1 -- 172.21.15.78:0/2300204717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea8167d00 con 0x7f5ea8062c00 2023-08-17T17:35:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.666+0000 7f5ea759e700 1 -- 172.21.15.78:0/2300204717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea805f910 con 0x7f5ea8062c00 2023-08-17T17:35:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.667+0000 7f5e9effd700 1 -- 172.21.15.78:0/2300204717 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f5e9802c070 con 0x7f5ea8062c00 2023-08-17T17:35:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.667+0000 7f5e9effd700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5e8805ee30 0x7f5e880612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.667+0000 7f5e9effd700 1 -- 172.21.15.78:0/2300204717 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5e9807bb20 con 0x7f5ea8062c00 2023-08-17T17:35:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.667+0000 7f5e9dd9b700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5e8805ee30 0x7f5e880612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.668+0000 7f5e9dd9b700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5e8805ee30 0x7f5e880612f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5ea815f130 tx=0x7f5e90009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.671+0000 7f5e9effd700 1 -- 172.21.15.78:0/2300204717 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5e9804cff0 con 0x7f5ea8062c00 2023-08-17T17:35:28.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.857+0000 7f5ea759e700 1 -- 172.21.15.78:0/2300204717 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ea8046af0 con 0x7f5e8805ee30 2023-08-17T17:35:28.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.861+0000 7f5e9effd700 1 -- 172.21.15.78:0/2300204717 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5ea8046af0 con 0x7f5e8805ee30 2023-08-17T17:35:28.862 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-08-17T17:35:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 -- 172.21.15.78:0/2300204717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5e8805ee30 msgr2=0x7f5e880612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5e8805ee30 0x7f5e880612f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5ea815f130 tx=0x7f5e90009040).stop 2023-08-17T17:35:28.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 -- 172.21.15.78:0/2300204717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea8062c00 msgr2=0x7f5ea8167810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea8062c00 0x7f5ea8167810 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f5ea8068920 tx=0x7f5e98017000).stop 2023-08-17T17:35:28.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 -- 172.21.15.78:0/2300204717 shutdown_connections 2023-08-17T17:35:28.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5e8805ee30 0x7f5e880612f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ea81547e0 0x7f5ea8165c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea8062c00 0x7f5ea8167810 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 --2- 172.21.15.78:0/2300204717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ea80a6f10 0x7f5ea80a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 -- 172.21.15.78:0/2300204717 >> 172.21.15.78:0/2300204717 conn(0x7f5ea80c7c10 msgr2=0x7f5ea813d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:28.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 -- 172.21.15.78:0/2300204717 shutdown_connections 2023-08-17T17:35:28.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.863+0000 7f5ea759e700 1 -- 172.21.15.78:0/2300204717 wait complete. 2023-08-17T17:35:28.876 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-08-17T17:35:28.876 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-08-17T17:35:28.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.991+0000 7fde592bf700 1 Processor -- start 2023-08-17T17:35:28.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.991+0000 7fde592bf700 1 -- start start 2023-08-17T17:35:28.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.992+0000 7fde592bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 0x7fde540644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.992+0000 7fde592bf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fde540aa4d0 0x7fde540c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.992+0000 7fde592bf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde540649b0 con 0x7fde540c5810 2023-08-17T17:35:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.992+0000 7fde592bf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde54063420 con 0x7fde540aa4d0 2023-08-17T17:35:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.992+0000 7fde592bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde54063700 con 0x7fde540aa0f0 2023-08-17T17:35:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.992+0000 7fde52ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 0x7fde540644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.992+0000 7fde4a7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fde540aa4d0 0x7fde540c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.992+0000 7fde537fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fde540c5810 0x7fde540a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:36534/0 (socket says 172.21.15.78:36534) 2023-08-17T17:35:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.992+0000 7fde537fe700 1 -- 172.21.15.78:0/3444921838 learned_addr learned my addr 172.21.15.78:0/3444921838 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.992+0000 7fde52ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 0x7fde540644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:53968/0 (socket says 172.21.15.78:53968) 2023-08-17T17:35:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde4a7fc700 1 -- 172.21.15.78:0/3444921838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 msgr2=0x7fde540644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde4a7fc700 1 --2- 172.21.15.78:0/3444921838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 0x7fde540644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde4a7fc700 1 -- 172.21.15.78:0/3444921838 >> v1:172.21.15.150:6789/0 conn(0x7fde540c5810 legacy=0x7fde540a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde527fc700 1 -- 172.21.15.78:0/3444921838 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938816921 0 0) 0x7fde540649b0 con 0x7fde540c5810 2023-08-17T17:35:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde4a7fc700 1 -- 172.21.15.78:0/3444921838 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540639e0 con 0x7fde540aa4d0 2023-08-17T17:35:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde4a7fc700 1 --2- 172.21.15.78:0/3444921838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde540aa4d0 0x7fde540c0e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fde3c009760 tx=0x7fde3c009060).ready entity=mon.1 client_cookie=469884ebf41c7f3b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde527fc700 1 -- 172.21.15.78:0/3444921838 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c00f510 con 0x7fde540aa4d0 2023-08-17T17:35:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde527fc700 1 -- 172.21.15.78:0/3444921838 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c00f670 con 0x7fde540aa4d0 2023-08-17T17:35:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde527fc700 1 -- 172.21.15.78:0/3444921838 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c00f9f0 con 0x7fde540aa4d0 2023-08-17T17:35:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde592bf700 1 -- 172.21.15.78:0/3444921838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde540aa4d0 msgr2=0x7fde540c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde592bf700 1 --2- 172.21.15.78:0/3444921838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde540aa4d0 0x7fde540c0e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fde3c009760 tx=0x7fde3c009060).stop 2023-08-17T17:35:28.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde592bf700 1 -- 172.21.15.78:0/3444921838 shutdown_connections 2023-08-17T17:35:28.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde592bf700 1 --2- 172.21.15.78:0/3444921838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 0x7fde540644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde592bf700 1 --2- 172.21.15.78:0/3444921838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde540aa4d0 0x7fde540c0e10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:28.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.993+0000 7fde592bf700 1 -- 172.21.15.78:0/3444921838 >> 172.21.15.78:0/3444921838 conn(0x7fde5406a6a0 msgr2=0x7fde540caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:28.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.994+0000 7fde592bf700 1 -- 172.21.15.78:0/3444921838 shutdown_connections 2023-08-17T17:35:28.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.994+0000 7fde592bf700 1 -- 172.21.15.78:0/3444921838 wait complete. 2023-08-17T17:35:28.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.995+0000 7fde592bf700 1 Processor -- start 2023-08-17T17:35:28.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.995+0000 7fde592bf700 1 -- start start 2023-08-17T17:35:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde592bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 0x7fde540c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde592bf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde540aa4d0 0x7fde540c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde592bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde540c5810 0x7fde54155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde592bf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540abb30 con 0x7fde540aa4d0 2023-08-17T17:35:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde592bf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540ac3d0 con 0x7fde540c5810 2023-08-17T17:35:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde592bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde540c4490 con 0x7fde540aa0f0 2023-08-17T17:35:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde540aa4d0 0x7fde540c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde540aa4d0 0x7fde540c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48504/0 (socket says 172.21.15.78:48504) 2023-08-17T17:35:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4a7fc700 1 -- 172.21.15.78:0/58062624 learned_addr learned my addr 172.21.15.78:0/58062624 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde537fe700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde540c5810 0x7fde54155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde52ffd700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 0x7fde540c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4a7fc700 1 -- 172.21.15.78:0/58062624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 msgr2=0x7fde540c1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4a7fc700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 0x7fde540c1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4a7fc700 1 -- 172.21.15.78:0/58062624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde540c5810 msgr2=0x7fde54155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4a7fc700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde540c5810 0x7fde54155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4a7fc700 1 -- 172.21.15.78:0/58062624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c0092a0 con 0x7fde540aa4d0 2023-08-17T17:35:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde52ffd700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 0x7fde540c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4a7fc700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde540aa4d0 0x7fde540c3fa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fde3c009e00 tx=0x7fde3c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4b7fe700 1 -- 172.21.15.78:0/58062624 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c00f7e0 con 0x7fde540aa4d0 2023-08-17T17:35:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4b7fe700 1 -- 172.21.15.78:0/58062624 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c00f940 con 0x7fde540aa4d0 2023-08-17T17:35:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde592bf700 1 -- 172.21.15.78:0/58062624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde54156250 con 0x7fde540aa4d0 2023-08-17T17:35:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde4b7fe700 1 -- 172.21.15.78:0/58062624 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c01b660 con 0x7fde540aa4d0 2023-08-17T17:35:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.996+0000 7fde592bf700 1 -- 172.21.15.78:0/58062624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde540abd80 con 0x7fde540aa4d0 2023-08-17T17:35:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.997+0000 7fde592bf700 1 -- 172.21.15.78:0/58062624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde540cbb40 con 0x7fde540aa4d0 2023-08-17T17:35:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.998+0000 7fde4b7fe700 1 -- 172.21.15.78:0/58062624 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fde3c02c070 con 0x7fde540aa4d0 2023-08-17T17:35:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.998+0000 7fde4b7fe700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ee30 0x7fde340612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.998+0000 7fde4b7fe700 1 -- 172.21.15.78:0/58062624 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fde3c07b700 con 0x7fde540aa4d0 2023-08-17T17:35:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.998+0000 7fde52ffd700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ee30 0x7fde340612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:28.998+0000 7fde52ffd700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ee30 0x7fde340612f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fde44009b60 tx=0x7fde44008040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.002+0000 7fde4b7fe700 1 -- 172.21.15.78:0/58062624 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde3c04cb20 con 0x7fde540aa4d0 2023-08-17T17:35:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.190+0000 7fde592bf700 1 -- 172.21.15.78:0/58062624 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fde54046af0 con 0x7fde3405ee30 2023-08-17T17:35:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.193+0000 7fde4b7fe700 1 -- 172.21.15.78:0/58062624 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fde54046af0 con 0x7fde3405ee30 2023-08-17T17:35:29.195 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-08-17T17:35:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 -- 172.21.15.78:0/58062624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ee30 msgr2=0x7fde340612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ee30 0x7fde340612f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fde44009b60 tx=0x7fde44008040).stop 2023-08-17T17:35:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 -- 172.21.15.78:0/58062624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde540aa4d0 msgr2=0x7fde540c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde540aa4d0 0x7fde540c3fa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fde3c009e00 tx=0x7fde3c017000).stop 2023-08-17T17:35:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 -- 172.21.15.78:0/58062624 shutdown_connections 2023-08-17T17:35:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde3405ee30 0x7fde340612f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde540c5810 0x7fde54155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde540aa0f0 0x7fde540c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 --2- 172.21.15.78:0/58062624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde540aa4d0 0x7fde540c3fa0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 -- 172.21.15.78:0/58062624 >> 172.21.15.78:0/58062624 conn(0x7fde5406a6a0 msgr2=0x7fde54153080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 -- 172.21.15.78:0/58062624 shutdown_connections 2023-08-17T17:35:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.195+0000 7fde592bf700 1 -- 172.21.15.78:0/58062624 wait complete. 2023-08-17T17:35:29.208 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-08-17T17:35:29.209 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-08-17T17:35:29.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.325+0000 7f19814df700 1 Processor -- start 2023-08-17T17:35:29.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.325+0000 7f19814df700 1 -- start start 2023-08-17T17:35:29.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f19814df700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c0aa4d0 0x7f197c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f19814df700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c0649b0 con 0x7f197c0c5810 2023-08-17T17:35:29.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f19814df700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c063420 con 0x7f197c0aa0f0 2023-08-17T17:35:29.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f19814df700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c063700 con 0x7f197c0aa4d0 2023-08-17T17:35:29.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f197c0c5810 0x7f197c0a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40692/0 (socket says 172.21.15.78:40692) 2023-08-17T17:35:29.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197b7fe700 1 -- 172.21.15.78:0/145069587 learned_addr learned my addr 172.21.15.78:0/145069587 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:29.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f19727fc700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c0aa4d0 0x7f197c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331082797 0 0) 0x7f197c0649b0 con 0x7f197c0c5810 2023-08-17T17:35:29.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19680033f0 con 0x7f197c0c5810 2023-08-17T17:35:29.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056448949 0 0) 0x7f197c063420 con 0x7f197c0aa0f0 2023-08-17T17:35:29.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f197c0649b0 con 0x7f197c0aa0f0 2023-08-17T17:35:29.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 946536679 0 0) 0x7f19680033f0 con 0x7f197c0c5810 2023-08-17T17:35:29.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c0aa4d0 msgr2=0x7f197c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:29.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c0aa4d0 0x7f197c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 >> v1:172.21.15.150:6789/0 conn(0x7f197c0aa0f0 legacy=0x7f197c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c0639e0 con 0x7f197c0c5810 2023-08-17T17:35:29.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f19740017f0 con 0x7f197c0c5810 2023-08-17T17:35:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 >> v1:172.21.15.78:6789/0 conn(0x7f197c0c5810 legacy=0x7f197c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.326+0000 7f197a7fc700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1968003aa0 0x7f1968003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197a7fc700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c0aa4d0 0x7f1968004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197a7fc700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1968004b80 0x7f1968005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c063700 con 0x7f1968004b80 2023-08-17T17:35:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196800b990 con 0x7f1968003aa0 2023-08-17T17:35:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196800bb50 con 0x7f197c0aa4d0 2023-08-17T17:35:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197b7fe700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1968004b80 0x7f1968005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f19727fc700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c0aa4d0 0x7f1968004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197affd700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1968003aa0 0x7f1968003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197b7fe700 1 -- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c0aa4d0 msgr2=0x7f1968004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197b7fe700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c0aa4d0 0x7f1968004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197b7fe700 1 -- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1968003aa0 msgr2=0x7f1968003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197b7fe700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1968003aa0 0x7f1968003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197b7fe700 1 -- 172.21.15.78:0/145069587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19680033f0 con 0x7f1968004b80 2023-08-17T17:35:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197b7fe700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1968004b80 0x7f1968005000 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f197400c410 tx=0x7f1974007f40).ready entity=mon.0 client_cookie=9a694ef305d9952c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:29.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197400cce0 con 0x7f1968004b80 2023-08-17T17:35:29.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197400ce40 con 0x7f1968004b80 2023-08-17T17:35:29.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.327+0000 7f197a7fc700 1 -- 172.21.15.78:0/145069587 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974005d30 con 0x7f1968004b80 2023-08-17T17:35:29.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.328+0000 7f19814df700 1 -- 172.21.15.78:0/145069587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1968004b80 msgr2=0x7f1968005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.328+0000 7f19814df700 1 --2- 172.21.15.78:0/145069587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1968004b80 0x7f1968005000 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f197400c410 tx=0x7f1974007f40).stop 2023-08-17T17:35:29.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.328+0000 7f197b7fe700 1 -- 172.21.15.78:0/145069587 reap_dead start 2023-08-17T17:35:29.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.328+0000 7f19814df700 1 -- 172.21.15.78:0/145069587 shutdown_connections 2023-08-17T17:35:29.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.328+0000 7f19814df700 1 -- 172.21.15.78:0/145069587 >> 172.21.15.78:0/145069587 conn(0x7f197c06a6a0 msgr2=0x7f197c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:29.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.328+0000 7f19814df700 1 -- 172.21.15.78:0/145069587 shutdown_connections 2023-08-17T17:35:29.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.328+0000 7f19814df700 1 -- 172.21.15.78:0/145069587 wait complete. 2023-08-17T17:35:29.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.329+0000 7f19814df700 1 Processor -- start 2023-08-17T17:35:29.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.329+0000 7f19814df700 1 -- start start 2023-08-17T17:35:29.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19814df700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1968004b80 0x7f197c0c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19814df700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c1459b0 0x7f197c0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19814df700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f197c145e30 0x7f197c0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19814df700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0c8280 con 0x7f197c145e30 2023-08-17T17:35:29.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19814df700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0ac3c0 con 0x7f1968004b80 2023-08-17T17:35:29.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19814df700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0ac6a0 con 0x7f197c1459b0 2023-08-17T17:35:29.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f197c145e30 0x7f197c0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f197c145e30 0x7f197c0c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48522/0 (socket says 172.21.15.78:48522) 2023-08-17T17:35:29.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197b7fe700 1 -- 172.21.15.78:0/1105148265 learned_addr learned my addr 172.21.15.78:0/1105148265 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:29.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19727fc700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c1459b0 0x7f197c0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197affd700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1968004b80 0x7f197c0c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197b7fe700 1 -- 172.21.15.78:0/1105148265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c1459b0 msgr2=0x7f197c0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197b7fe700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c1459b0 0x7f197c0c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197b7fe700 1 -- 172.21.15.78:0/1105148265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1968004b80 msgr2=0x7f197c0c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197b7fe700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1968004b80 0x7f197c0c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197b7fe700 1 -- 172.21.15.78:0/1105148265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c0ac980 con 0x7f197c145e30 2023-08-17T17:35:29.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19727fc700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c1459b0 0x7f197c0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:29.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197affd700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1968004b80 0x7f197c0c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:35:29.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f197b7fe700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f197c145e30 0x7f197c0c7d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f1974000f80 tx=0x7f1974013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:29.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19737fe700 1 -- 172.21.15.78:0/1105148265 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740072e0 con 0x7f197c145e30 2023-08-17T17:35:29.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19737fe700 1 -- 172.21.15.78:0/1105148265 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1974007440 con 0x7f197c145e30 2023-08-17T17:35:29.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19814df700 1 -- 172.21.15.78:0/1105148265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c0acc60 con 0x7f197c145e30 2023-08-17T17:35:29.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19737fe700 1 -- 172.21.15.78:0/1105148265 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974007800 con 0x7f197c145e30 2023-08-17T17:35:29.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.330+0000 7f19814df700 1 -- 172.21.15.78:0/1105148265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c0ad220 con 0x7f197c145e30 2023-08-17T17:35:29.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.331+0000 7f19814df700 1 -- 172.21.15.78:0/1105148265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c083980 con 0x7f197c145e30 2023-08-17T17:35:29.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.332+0000 7f19737fe700 1 -- 172.21.15.78:0/1105148265 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f197401d020 con 0x7f197c145e30 2023-08-17T17:35:29.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.332+0000 7f19737fe700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f195c05ee30 0x7f195c0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.332+0000 7f19737fe700 1 -- 172.21.15.78:0/1105148265 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f197407aa00 con 0x7f197c145e30 2023-08-17T17:35:29.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.332+0000 7f197affd700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f195c05ee30 0x7f195c0612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.332+0000 7f197affd700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f195c05ee30 0x7f195c0612f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f196c007a40 tx=0x7f196c009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:29.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.336+0000 7f19737fe700 1 -- 172.21.15.78:0/1105148265 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f197404be00 con 0x7f197c145e30 2023-08-17T17:35:29.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.524+0000 7f19814df700 1 -- 172.21.15.78:0/1105148265 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f197c046af0 con 0x7f195c05ee30 2023-08-17T17:35:29.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.528+0000 7f19737fe700 1 -- 172.21.15.78:0/1105148265 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f197c046af0 con 0x7f195c05ee30 2023-08-17T17:35:29.529 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-08-17T17:35:29.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 -- 172.21.15.78:0/1105148265 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f195c05ee30 msgr2=0x7f195c0612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f195c05ee30 0x7f195c0612f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f196c007a40 tx=0x7f196c009040).stop 2023-08-17T17:35:29.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 -- 172.21.15.78:0/1105148265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f197c145e30 msgr2=0x7f197c0c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f197c145e30 0x7f197c0c7d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f1974000f80 tx=0x7f1974013000).stop 2023-08-17T17:35:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 -- 172.21.15.78:0/1105148265 shutdown_connections 2023-08-17T17:35:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f195c05ee30 0x7f195c0612f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f197c145e30 0x7f197c0c7d90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1968004b80 0x7f197c0c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 --2- 172.21.15.78:0/1105148265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f197c1459b0 0x7f197c0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 -- 172.21.15.78:0/1105148265 >> 172.21.15.78:0/1105148265 conn(0x7f197c06a6a0 msgr2=0x7f197c0a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:29.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 -- 172.21.15.78:0/1105148265 shutdown_connections 2023-08-17T17:35:29.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.530+0000 7f19814df700 1 -- 172.21.15.78:0/1105148265 wait complete. 2023-08-17T17:35:29.543 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-08-17T17:35:29.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-08-17T17:35:29.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.658+0000 7f7d4f59e700 1 Processor -- start 2023-08-17T17:35:29.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.658+0000 7f7d4f59e700 1 -- start start 2023-08-17T17:35:29.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.659+0000 7f7d4f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d500a5860 0x7f7d500a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.659+0000 7f7d4f59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d500a6a10 con 0x7f7d50151c80 2023-08-17T17:35:29.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.659+0000 7f7d4f59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d500a5e00 con 0x7f7d500a7390 2023-08-17T17:35:29.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.659+0000 7f7d4f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500a60e0 con 0x7f7d500a5860 2023-08-17T17:35:29.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.659+0000 7f7d4e59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7d50151c80 0x7f7d50062db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40704/0 (socket says 172.21.15.78:40704) 2023-08-17T17:35:29.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.659+0000 7f7d4e59c700 1 -- 172.21.15.78:0/1750907399 learned_addr learned my addr 172.21.15.78:0/1750907399 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:29.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474983013 0 0) 0x7f7d500a6a10 con 0x7f7d50151c80 2023-08-17T17:35:29.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d3c0033f0 con 0x7f7d50151c80 2023-08-17T17:35:29.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d45d9b700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d500a5860 0x7f7d500a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 375625930 0 0) 0x7f7d3c0033f0 con 0x7f7d50151c80 2023-08-17T17:35:29.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d500a5860 msgr2=0x7f7d500a6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:29.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d500a5860 0x7f7d500a6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 >> v1:172.21.15.150:6789/0 conn(0x7f7d500a7390 legacy=0x7f7d500bda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500a63c0 con 0x7f7d50151c80 2023-08-17T17:35:29.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f7d400015f0 con 0x7f7d50151c80 2023-08-17T17:35:29.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 >> v1:172.21.15.78:6789/0 conn(0x7f7d50151c80 legacy=0x7f7d50062db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3c003910 0x7f7d3c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3c004690 0x7f7d3c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d500a5860 0x7f7d3c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500a60e0 con 0x7f7d3c003910 2023-08-17T17:35:29.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c00b8e0 con 0x7f7d3c004690 2023-08-17T17:35:29.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c00ba50 con 0x7f7d500a5860 2023-08-17T17:35:29.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4e59c700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3c003910 0x7f7d3c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d45d9b700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3c004690 0x7f7d3c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4ed9d700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d500a5860 0x7f7d3c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4e59c700 1 -- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d500a5860 msgr2=0x7f7d3c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:29.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4e59c700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d500a5860 0x7f7d3c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4e59c700 1 -- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3c004690 msgr2=0x7f7d3c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:29.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4e59c700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3c004690 0x7f7d3c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d4e59c700 1 -- 172.21.15.78:0/1750907399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0033f0 con 0x7f7d3c003910 2023-08-17T17:35:29.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.660+0000 7f7d45d9b700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3c004690 0x7f7d3c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:29.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4e59c700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3c003910 0x7f7d3c003cf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f7d4000c190 tx=0x7f7d400077a0).ready entity=mon.0 client_cookie=767caedc0d86e160 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:29.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d400079b0 con 0x7f7d3c003910 2023-08-17T17:35:29.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4000ca60 con 0x7f7d3c003910 2023-08-17T17:35:29.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4dd9b700 1 -- 172.21.15.78:0/1750907399 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000cde0 con 0x7f7d3c003910 2023-08-17T17:35:29.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4f59e700 1 -- 172.21.15.78:0/1750907399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3c003910 msgr2=0x7f7d3c003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4f59e700 1 --2- 172.21.15.78:0/1750907399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3c003910 0x7f7d3c003cf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f7d4000c190 tx=0x7f7d400077a0).stop 2023-08-17T17:35:29.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4ed9d700 1 -- 172.21.15.78:0/1750907399 reap_dead start 2023-08-17T17:35:29.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4f59e700 1 -- 172.21.15.78:0/1750907399 shutdown_connections 2023-08-17T17:35:29.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4f59e700 1 -- 172.21.15.78:0/1750907399 >> 172.21.15.78:0/1750907399 conn(0x7f7d5006a660 msgr2=0x7f7d500921a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:29.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4f59e700 1 -- 172.21.15.78:0/1750907399 shutdown_connections 2023-08-17T17:35:29.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.661+0000 7f7d4f59e700 1 -- 172.21.15.78:0/1750907399 wait complete. 2023-08-17T17:35:29.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.662+0000 7f7d4f59e700 1 Processor -- start 2023-08-17T17:35:29.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.663+0000 7f7d4f59e700 1 -- start start 2023-08-17T17:35:29.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.663+0000 7f7d4f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3c003910 0x7f7d501424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.663+0000 7f7d4f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d500c2220 0x7f7d500c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.663+0000 7f7d4f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d501546d0 0x7f7d50154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.663+0000 7f7d4f59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500abe40 con 0x7f7d501546d0 2023-08-17T17:35:29.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.663+0000 7f7d4f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500ac120 con 0x7f7d500c2220 2023-08-17T17:35:29.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.663+0000 7f7d4f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500ac400 con 0x7f7d3c003910 2023-08-17T17:35:29.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.663+0000 7f7d4ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d501546d0 0x7f7d50154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.663+0000 7f7d4ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d501546d0 0x7f7d50154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48544/0 (socket says 172.21.15.78:48544) 2023-08-17T17:35:29.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.663+0000 7f7d4ed9d700 1 -- 172.21.15.78:0/3338509646 learned_addr learned my addr 172.21.15.78:0/3338509646 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:29.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d4e59c700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3c003910 0x7f7d501424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d45d9b700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d500c2220 0x7f7d500c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d4ed9d700 1 -- 172.21.15.78:0/3338509646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3c003910 msgr2=0x7f7d501424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d4ed9d700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3c003910 0x7f7d501424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d4ed9d700 1 -- 172.21.15.78:0/3338509646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d500c2220 msgr2=0x7f7d500c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d4ed9d700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d500c2220 0x7f7d500c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d4ed9d700 1 -- 172.21.15.78:0/3338509646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500ac6e0 con 0x7f7d501546d0 2023-08-17T17:35:29.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d4ed9d700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d501546d0 0x7f7d50154b50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f7d500c3080 tx=0x7f7d48009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:29.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d46ffd700 1 -- 172.21.15.78:0/3338509646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48003030 con 0x7f7d501546d0 2023-08-17T17:35:29.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d46ffd700 1 -- 172.21.15.78:0/3338509646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d48003190 con 0x7f7d501546d0 2023-08-17T17:35:29.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d4f59e700 1 -- 172.21.15.78:0/3338509646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d500ac9c0 con 0x7f7d501546d0 2023-08-17T17:35:29.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d46ffd700 1 -- 172.21.15.78:0/3338509646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48001850 con 0x7f7d501546d0 2023-08-17T17:35:29.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.664+0000 7f7d4f59e700 1 -- 172.21.15.78:0/3338509646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d500aba80 con 0x7f7d501546d0 2023-08-17T17:35:29.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.665+0000 7f7d4f59e700 1 -- 172.21.15.78:0/3338509646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d500acbb0 con 0x7f7d501546d0 2023-08-17T17:35:29.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.665+0000 7f7d46ffd700 1 -- 172.21.15.78:0/3338509646 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f7d4801c060 con 0x7f7d501546d0 2023-08-17T17:35:29.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.666+0000 7f7d46ffd700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7d3005ee30 0x7f7d300612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.666+0000 7f7d4e59c700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7d3005ee30 0x7f7d300612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.666+0000 7f7d46ffd700 1 -- 172.21.15.78:0/3338509646 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f7d48079670 con 0x7f7d501546d0 2023-08-17T17:35:29.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.666+0000 7f7d4e59c700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7d3005ee30 0x7f7d300612f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7d50157310 tx=0x7f7d40015000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:29.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.670+0000 7f7d46ffd700 1 -- 172.21.15.78:0/3338509646 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7d4804aa90 con 0x7f7d501546d0 2023-08-17T17:35:29.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.857+0000 7f7d4f59e700 1 -- 172.21.15.78:0/3338509646 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d500ac290 con 0x7f7d3005ee30 2023-08-17T17:35:29.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.861+0000 7f7d46ffd700 1 -- 172.21.15.78:0/3338509646 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f7d500ac290 con 0x7f7d3005ee30 2023-08-17T17:35:29.862 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-08-17T17:35:29.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 -- 172.21.15.78:0/3338509646 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7d3005ee30 msgr2=0x7f7d300612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7d3005ee30 0x7f7d300612f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7d50157310 tx=0x7f7d40015000).stop 2023-08-17T17:35:29.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 -- 172.21.15.78:0/3338509646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d501546d0 msgr2=0x7f7d50154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d501546d0 0x7f7d50154b50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f7d500c3080 tx=0x7f7d48009040).stop 2023-08-17T17:35:29.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 -- 172.21.15.78:0/3338509646 shutdown_connections 2023-08-17T17:35:29.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7d3005ee30 0x7f7d300612f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d501546d0 0x7f7d50154b50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3c003910 0x7f7d501424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 --2- 172.21.15.78:0/3338509646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d500c2220 0x7f7d500c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 -- 172.21.15.78:0/3338509646 >> 172.21.15.78:0/3338509646 conn(0x7f7d5006a660 msgr2=0x7f7d500c39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:29.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 -- 172.21.15.78:0/3338509646 shutdown_connections 2023-08-17T17:35:29.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.863+0000 7f7d4f59e700 1 -- 172.21.15.78:0/3338509646 wait complete. 2023-08-17T17:35:29.876 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-08-17T17:35:29.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-08-17T17:35:29.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.992+0000 7fd9b31cf700 1 Processor -- start 2023-08-17T17:35:29.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.992+0000 7fd9b31cf700 1 -- start start 2023-08-17T17:35:29.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9b31cf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9ac0aa4d0 0x7fd9ac0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9b31cf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0c5810 0x7fd9ac0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:29.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9b31cf700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ac0649b0 con 0x7fd9ac0aa0f0 2023-08-17T17:35:29.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9b31cf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac0c6170 con 0x7fd9ac0aa4d0 2023-08-17T17:35:29.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9b31cf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac063420 con 0x7fd9ac0c5810 2023-08-17T17:35:29.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9b0f6b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd9ac0aa0f0 0x7fd9ac0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40718/0 (socket says 172.21.15.78:40718) 2023-08-17T17:35:29.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9b0f6b700 1 -- 172.21.15.78:0/1453317042 learned_addr learned my addr 172.21.15.78:0/1453317042 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:29.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9b176c700 1 --2- 172.21.15.78:0/1453317042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0c5810 0x7fd9ac0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9a3fff700 1 --2- 172.21.15.78:0/1453317042 >> v2:172.21.15.150:3300/0 conn(0x7fd9ac0aa4d0 0x7fd9ac0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:29.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9a37fe700 1 -- 172.21.15.78:0/1453317042 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568195140 0 0) 0x7fd9ac0649b0 con 0x7fd9ac0aa0f0 2023-08-17T17:35:29.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.993+0000 7fd9a37fe700 1 -- 172.21.15.78:0/1453317042 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9940033f0 con 0x7fd9ac0aa0f0 2023-08-17T17:35:29.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9a3fff700 1 -- 172.21.15.78:0/1453317042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0c5810 msgr2=0x7fd9ac0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:29.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9a3fff700 1 --2- 172.21.15.78:0/1453317042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0c5810 0x7fd9ac0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:29.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9a3fff700 1 -- 172.21.15.78:0/1453317042 >> v1:172.21.15.78:6789/0 conn(0x7fd9ac0aa0f0 legacy=0x7fd9ac0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:29.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9a3fff700 1 -- 172.21.15.78:0/1453317042 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac063700 con 0x7fd9ac0aa4d0 2023-08-17T17:35:29.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9a3fff700 1 --2- 172.21.15.78:0/1453317042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ac0aa4d0 0x7fd9ac0644c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fd99c009760 tx=0x7fd99c009060).ready entity=mon.1 client_cookie=1a9c2c4c1bd05090 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:29.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9a37fe700 1 -- 172.21.15.78:0/1453317042 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00d4a0 con 0x7fd9ac0aa4d0 2023-08-17T17:35:29.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9a37fe700 1 -- 172.21.15.78:0/1453317042 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c00d600 con 0x7fd9ac0aa4d0 2023-08-17T17:35:30.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9a37fe700 1 -- 172.21.15.78:0/1453317042 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00d980 con 0x7fd9ac0aa4d0 2023-08-17T17:35:30.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9b31cf700 1 -- 172.21.15.78:0/1453317042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ac0aa4d0 msgr2=0x7fd9ac0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9b31cf700 1 --2- 172.21.15.78:0/1453317042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ac0aa4d0 0x7fd9ac0644c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fd99c009760 tx=0x7fd99c009060).stop 2023-08-17T17:35:30.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9b31cf700 1 -- 172.21.15.78:0/1453317042 shutdown_connections 2023-08-17T17:35:30.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9b31cf700 1 --2- 172.21.15.78:0/1453317042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0c5810 0x7fd9ac0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9b31cf700 1 --2- 172.21.15.78:0/1453317042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ac0aa4d0 0x7fd9ac0644c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9b31cf700 1 -- 172.21.15.78:0/1453317042 >> 172.21.15.78:0/1453317042 conn(0x7fd9ac06a6a0 msgr2=0x7fd9ac0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:30.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9b31cf700 1 -- 172.21.15.78:0/1453317042 shutdown_connections 2023-08-17T17:35:30.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.994+0000 7fd9b31cf700 1 -- 172.21.15.78:0/1453317042 wait complete. 2023-08-17T17:35:30.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.996+0000 7fd9b31cf700 1 Processor -- start 2023-08-17T17:35:30.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.996+0000 7fd9b31cf700 1 -- start start 2023-08-17T17:35:30.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.996+0000 7fd9b31cf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0aa0f0 0x7fd9ac0ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.996+0000 7fd9b31cf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ac0aa4d0 0x7fd9ac146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.996+0000 7fd9b31cf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9ac0c5810 0x7fd9ac0aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.996+0000 7fd9b31cf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0ad590 con 0x7fd9ac0c5810 2023-08-17T17:35:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.996+0000 7fd9b31cf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0ac720 con 0x7fd9ac0aa4d0 2023-08-17T17:35:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.996+0000 7fd9b31cf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac1470e0 con 0x7fd9ac0aa0f0 2023-08-17T17:35:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b176c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9ac0c5810 0x7fd9ac0aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b176c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9ac0c5810 0x7fd9ac0aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48560/0 (socket says 172.21.15.78:48560) 2023-08-17T17:35:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b176c700 1 -- 172.21.15.78:0/559917704 learned_addr learned my addr 172.21.15.78:0/559917704 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9a3fff700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ac0aa4d0 0x7fd9ac146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b0f6b700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0aa0f0 0x7fd9ac0ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b176c700 1 -- 172.21.15.78:0/559917704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0aa0f0 msgr2=0x7fd9ac0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b176c700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0aa0f0 0x7fd9ac0ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b176c700 1 -- 172.21.15.78:0/559917704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ac0aa4d0 msgr2=0x7fd9ac146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b176c700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ac0aa4d0 0x7fd9ac146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b176c700 1 -- 172.21.15.78:0/559917704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c0092a0 con 0x7fd9ac0c5810 2023-08-17T17:35:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b0f6b700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0aa0f0 0x7fd9ac0ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b176c700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9ac0c5810 0x7fd9ac0aef00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fd9a4009e90 tx=0x7fd9a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9a0ff9700 1 -- 172.21.15.78:0/559917704 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a400cb50 con 0x7fd9ac0c5810 2023-08-17T17:35:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9a0ff9700 1 -- 172.21.15.78:0/559917704 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a400f040 con 0x7fd9ac0c5810 2023-08-17T17:35:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b31cf700 1 -- 172.21.15.78:0/559917704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac0ac980 con 0x7fd9ac0c5810 2023-08-17T17:35:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9a0ff9700 1 -- 172.21.15.78:0/559917704 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a400cec0 con 0x7fd9ac0c5810 2023-08-17T17:35:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.997+0000 7fd9b31cf700 1 -- 172.21.15.78:0/559917704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac0acf40 con 0x7fd9ac0c5810 2023-08-17T17:35:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.998+0000 7fd9b31cf700 1 -- 172.21.15.78:0/559917704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac0ad700 con 0x7fd9ac0c5810 2023-08-17T17:35:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.998+0000 7fd9a0ff9700 1 -- 172.21.15.78:0/559917704 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fd9a4013610 con 0x7fd9ac0c5810 2023-08-17T17:35:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.999+0000 7fd9a0ff9700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd99805ee30 0x7fd9980612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.999+0000 7fd9a0ff9700 1 -- 172.21.15.78:0/559917704 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd9a407a7e0 con 0x7fd9ac0c5810 2023-08-17T17:35:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.999+0000 7fd9b0f6b700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd99805ee30 0x7fd9980612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:29.999+0000 7fd9b0f6b700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd99805ee30 0x7fd9980612f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd9a8005750 tx=0x7fd9a8009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.003+0000 7fd9a0ff9700 1 -- 172.21.15.78:0/559917704 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd9a404bc00 con 0x7fd9ac0c5810 2023-08-17T17:35:30.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.190+0000 7fd9b31cf700 1 -- 172.21.15.78:0/559917704 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9ac046af0 con 0x7fd99805ee30 2023-08-17T17:35:30.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.193+0000 7fd9a0ff9700 1 -- 172.21.15.78:0/559917704 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd9ac046af0 con 0x7fd99805ee30 2023-08-17T17:35:30.195 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-08-17T17:35:30.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 -- 172.21.15.78:0/559917704 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd99805ee30 msgr2=0x7fd9980612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd99805ee30 0x7fd9980612f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd9a8005750 tx=0x7fd9a8009040).stop 2023-08-17T17:35:30.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 -- 172.21.15.78:0/559917704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9ac0c5810 msgr2=0x7fd9ac0aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9ac0c5810 0x7fd9ac0aef00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fd9a4009e90 tx=0x7fd9a400b040).stop 2023-08-17T17:35:30.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 -- 172.21.15.78:0/559917704 shutdown_connections 2023-08-17T17:35:30.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd99805ee30 0x7fd9980612f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9ac0c5810 0x7fd9ac0aef00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9ac0aa0f0 0x7fd9ac0ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 --2- 172.21.15.78:0/559917704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9ac0aa4d0 0x7fd9ac146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 -- 172.21.15.78:0/559917704 >> 172.21.15.78:0/559917704 conn(0x7fd9ac06a6a0 msgr2=0x7fd9ac0ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:30.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 -- 172.21.15.78:0/559917704 shutdown_connections 2023-08-17T17:35:30.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.195+0000 7fd9b31cf700 1 -- 172.21.15.78:0/559917704 wait complete. 2023-08-17T17:35:30.208 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-08-17T17:35:30.209 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-08-17T17:35:30.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.325+0000 7fa5921af700 1 Processor -- start 2023-08-17T17:35:30.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.325+0000 7fa5921af700 1 -- start start 2023-08-17T17:35:30.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa5921af700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa58c0aa4d0 0x7fa58c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa5921af700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0c5810 0x7fa58c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa5921af700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c0649b0 con 0x7fa58c0aa0f0 2023-08-17T17:35:30.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa5921af700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58c0c6170 con 0x7fa58c0aa4d0 2023-08-17T17:35:30.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa5921af700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c063420 con 0x7fa58c0c5810 2023-08-17T17:35:30.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa58c0aa0f0 0x7fa58c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40720/0 (socket says 172.21.15.78:40720) 2023-08-17T17:35:30.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58b7fe700 1 -- 172.21.15.78:0/2734441417 learned_addr learned my addr 172.21.15.78:0/2734441417 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:35:30.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58affd700 1 --2- 172.21.15.78:0/2734441417 >> v2:172.21.15.150:3300/0 conn(0x7fa58c0aa4d0 0x7fa58c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58bfff700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0c5810 0x7fa58c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631107608 0 0) 0x7fa58c0649b0 con 0x7fa58c0aa0f0 2023-08-17T17:35:30.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5740033f0 con 0x7fa58c0aa0f0 2023-08-17T17:35:30.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2748730902 0 0) 0x7fa5740033f0 con 0x7fa58c0aa0f0 2023-08-17T17:35:30.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0c5810 msgr2=0x7fa58c0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:30.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58a7fc700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0c5810 0x7fa58c0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 >> v2:172.21.15.150:3300/0 conn(0x7fa58c0aa4d0 msgr2=0x7fa58c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:30.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.326+0000 7fa58a7fc700 1 --2- 172.21.15.78:0/2734441417 >> v2:172.21.15.150:3300/0 conn(0x7fa58c0aa4d0 0x7fa58c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c063700 con 0x7fa58c0aa0f0 2023-08-17T17:35:30.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fa57c0017f0 con 0x7fa58c0aa0f0 2023-08-17T17:35:30.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58affd700 1 --2- 172.21.15.78:0/2734441417 >> v2:172.21.15.150:3300/0 conn(0x7fa58c0aa4d0 0x7fa58c0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:35:30.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 >> v1:172.21.15.78:6789/0 conn(0x7fa58c0aa0f0 legacy=0x7fa58c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5740038e0 0x7fa574003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 0x7fa574004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0c5810 0x7fa574005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0c6170 con 0x7fa574004690 2023-08-17T17:35:30.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c063420 con 0x7fa5740038e0 2023-08-17T17:35:30.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57400b8e0 con 0x7fa58c0c5810 2023-08-17T17:35:30.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58affd700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 0x7fa574004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58b7fe700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5740038e0 0x7fa574003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58bfff700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0c5810 0x7fa574005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58affd700 1 -- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0c5810 msgr2=0x7fa574005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:30.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58affd700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0c5810 0x7fa574005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58affd700 1 -- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5740038e0 msgr2=0x7fa574003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:35:30.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58affd700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5740038e0 0x7fa574003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58affd700 1 -- 172.21.15.78:0/2734441417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740033f0 con 0x7fa574004690 2023-08-17T17:35:30.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58b7fe700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5740038e0 0x7fa574003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:35:30.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58affd700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 0x7fa574004b10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fa58c0aa980 tx=0x7fa580009060).ready entity=mon.0 client_cookie=9b42e1801abc5b73 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:30.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800095c0 con 0x7fa574004690 2023-08-17T17:35:30.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000e710 con 0x7fa574004690 2023-08-17T17:35:30.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.327+0000 7fa58a7fc700 1 -- 172.21.15.78:0/2734441417 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000ea90 con 0x7fa574004690 2023-08-17T17:35:30.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.328+0000 7fa5921af700 1 -- 172.21.15.78:0/2734441417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 msgr2=0x7fa574004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.328+0000 7fa5921af700 1 --2- 172.21.15.78:0/2734441417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 0x7fa574004b10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fa58c0aa980 tx=0x7fa580009060).stop 2023-08-17T17:35:30.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.328+0000 7fa58bfff700 1 -- 172.21.15.78:0/2734441417 reap_dead start 2023-08-17T17:35:30.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.328+0000 7fa5921af700 1 -- 172.21.15.78:0/2734441417 shutdown_connections 2023-08-17T17:35:30.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.328+0000 7fa5921af700 1 -- 172.21.15.78:0/2734441417 >> 172.21.15.78:0/2734441417 conn(0x7fa58c06a6a0 msgr2=0x7fa58c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:30.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.328+0000 7fa5921af700 1 -- 172.21.15.78:0/2734441417 shutdown_connections 2023-08-17T17:35:30.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.328+0000 7fa5921af700 1 -- 172.21.15.78:0/2734441417 wait complete. 2023-08-17T17:35:30.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.329+0000 7fa5921af700 1 Processor -- start 2023-08-17T17:35:30.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.329+0000 7fa5921af700 1 -- start start 2023-08-17T17:35:30.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5921af700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 0x7fa58c151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5921af700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0abbf0 0x7fa58c0c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5921af700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0ac070 0x7fa58c0c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5921af700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0ad4e0 con 0x7fa574004690 2023-08-17T17:35:30.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5921af700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0aab50 con 0x7fa58c0abbf0 2023-08-17T17:35:30.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5921af700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0aae30 con 0x7fa58c0ac070 2023-08-17T17:35:30.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 0x7fa58c151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 0x7fa58c151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48586/0 (socket says 172.21.15.78:48586) 2023-08-17T17:35:30.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58b7fe700 1 -- 172.21.15.78:0/1297229740 learned_addr learned my addr 172.21.15.78:0/1297229740 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:35:30.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58bfff700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0ac070 0x7fa58c0c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58affd700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0abbf0 0x7fa58c0c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58b7fe700 1 -- 172.21.15.78:0/1297229740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0ac070 msgr2=0x7fa58c0c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58b7fe700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0ac070 0x7fa58c0c2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58b7fe700 1 -- 172.21.15.78:0/1297229740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0abbf0 msgr2=0x7fa58c0c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58b7fe700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0abbf0 0x7fa58c0c2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58b7fe700 1 -- 172.21.15.78:0/1297229740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0ab110 con 0x7fa574004690 2023-08-17T17:35:30.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa58b7fe700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 0x7fa58c151bd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fa57c002250 tx=0x7fa57c001120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:30.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5737fe700 1 -- 172.21.15.78:0/1297229740 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00c8b0 con 0x7fa574004690 2023-08-17T17:35:30.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5737fe700 1 -- 172.21.15.78:0/1297229740 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c00ca10 con 0x7fa574004690 2023-08-17T17:35:30.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5921af700 1 -- 172.21.15.78:0/1297229740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58c0ab3f0 con 0x7fa574004690 2023-08-17T17:35:30.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5737fe700 1 -- 172.21.15.78:0/1297229740 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00cdb0 con 0x7fa574004690 2023-08-17T17:35:30.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.330+0000 7fa5921af700 1 -- 172.21.15.78:0/1297229740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c1520c0 con 0x7fa574004690 2023-08-17T17:35:30.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.331+0000 7fa5921af700 1 -- 172.21.15.78:0/1297229740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58c083980 con 0x7fa574004690 2023-08-17T17:35:30.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.332+0000 7fa5737fe700 1 -- 172.21.15.78:0/1297229740 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fa57c014640 con 0x7fa574004690 2023-08-17T17:35:30.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.332+0000 7fa5737fe700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa57805ee30 0x7fa5780612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:35:30.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.332+0000 7fa5737fe700 1 -- 172.21.15.78:0/1297229740 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa57c079e20 con 0x7fa574004690 2023-08-17T17:35:30.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.332+0000 7fa58affd700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa57805ee30 0x7fa5780612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:35:30.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.333+0000 7fa58affd700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa57805ee30 0x7fa5780612f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa58c167830 tx=0x7fa580019000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:35:30.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.336+0000 7fa5737fe700 1 -- 172.21.15.78:0/1297229740 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa57c0498f0 con 0x7fa574004690 2023-08-17T17:35:30.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.525+0000 7fa5921af700 1 -- 172.21.15.78:0/1297229740 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa58c0cbd40 con 0x7fa57805ee30 2023-08-17T17:35:30.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.529+0000 7fa5737fe700 1 -- 172.21.15.78:0/1297229740 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa58c0cbd40 con 0x7fa57805ee30 2023-08-17T17:35:30.530 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-08-17T17:35:30.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 -- 172.21.15.78:0/1297229740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa57805ee30 msgr2=0x7fa5780612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa57805ee30 0x7fa5780612f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa58c167830 tx=0x7fa580019000).stop 2023-08-17T17:35:30.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 -- 172.21.15.78:0/1297229740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 msgr2=0x7fa58c151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:35:30.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 0x7fa58c151bd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fa57c002250 tx=0x7fa57c001120).stop 2023-08-17T17:35:30.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 -- 172.21.15.78:0/1297229740 shutdown_connections 2023-08-17T17:35:30.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa57805ee30 0x7fa5780612f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa58c0ac070 0x7fa58c0c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa574004690 0x7fa58c151bd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 --2- 172.21.15.78:0/1297229740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa58c0abbf0 0x7fa58c0c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:35:30.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 -- 172.21.15.78:0/1297229740 >> 172.21.15.78:0/1297229740 conn(0x7fa58c06a6a0 msgr2=0x7fa58c1539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:35:30.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 -- 172.21.15.78:0/1297229740 shutdown_connections 2023-08-17T17:35:30.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:35:30.530+0000 7fa5921af700 1 -- 172.21.15.78:0/1297229740 wait complete. 2023-08-17T17:35:30.543 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-08-17T17:35:30.576 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:35:30.578 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:36:00.197 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:36:00.196+0000 7fa8c6d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:36:00.198 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:36:00.196+0000 7fa8c6d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:36:00.198 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:36:00.196+0000 7fa8c6d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:36:00.198 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:36:00.196+0000 7fa8c6d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:36:00.198 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:36:00.196+0000 7fa8c6d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:36:00.632 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:36:00.635 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:36:30.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:36:30.698 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:37:00.761 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:37:00.765 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:37:30.833 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:37:30.835 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:38:00.893 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:38:00.896 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:38:30.961 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:38:30.963 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:39:01.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:39:01.046 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:39:31.123 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:39:31.125 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:40:01.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:40:01.181 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:40:31.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:40:31.249 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:41:01.306 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:41:01.309 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:41:31.370 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:41:31.373 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:42:01.434 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:42:01.437 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:42:31.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:42:31.510 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:43:01.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:43:01.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:43:31.681 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:43:31.685 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:44:01.783 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:44:01.786 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:44:31.859 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:44:31.861 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:45:01.929 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:45:01.931 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:45:32.026 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:45:32.029 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:46:02.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:46:02.093 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:46:18.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-08-17T17:46:18.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.674+0000 7f6c248e0700 1 Processor -- start 2023-08-17T17:46:18.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.674+0000 7f6c248e0700 1 -- start start 2023-08-17T17:46:18.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.675+0000 7f6c248e0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c201578f0 0x7f6c200be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:18.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.675+0000 7f6c248e0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6c20096520 0x7f6c200c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:18.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.675+0000 7f6c248e0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c200c3e10 con 0x7f6c200bf0e0 2023-08-17T17:46:18.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.675+0000 7f6c248e0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c200bf5c0 con 0x7f6c201578f0 2023-08-17T17:46:18.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.675+0000 7f6c248e0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c200c32d0 con 0x7f6c20096520 2023-08-17T17:46:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.675+0000 7f6c1e59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c201578f0 0x7f6c200be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.675+0000 7f6c1e59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c201578f0 0x7f6c200be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54834/0 (socket says 172.21.15.78:54834) 2023-08-17T17:46:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.675+0000 7f6c1e59c700 1 -- 172.21.15.78:0/1306627405 learned_addr learned my addr 172.21.15.78:0/1306627405 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c1ed9d700 1 --2- 172.21.15.78:0/1306627405 >> v2:172.21.15.150:3300/0 conn(0x7f6c20096520 0x7f6c200c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c1e59c700 1 -- 172.21.15.78:0/1306627405 >> v2:172.21.15.150:3300/0 conn(0x7f6c20096520 msgr2=0x7f6c200c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c1e59c700 1 --2- 172.21.15.78:0/1306627405 >> v2:172.21.15.150:3300/0 conn(0x7f6c20096520 0x7f6c200c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c1e59c700 1 -- 172.21.15.78:0/1306627405 >> v1:172.21.15.150:6789/0 conn(0x7f6c200bf0e0 legacy=0x7f6c20095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:18.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c1e59c700 1 -- 172.21.15.78:0/1306627405 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200c34e0 con 0x7f6c201578f0 2023-08-17T17:46:18.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c1e59c700 1 --2- 172.21.15.78:0/1306627405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c201578f0 0x7f6c200be210 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f6c200bdf10 tx=0x7f6c100090f0).ready entity=mon.0 client_cookie=9e07e819ba10d329 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:18.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c1dd9b700 1 -- 172.21.15.78:0/1306627405 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000b5a0 con 0x7f6c201578f0 2023-08-17T17:46:18.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c1dd9b700 1 -- 172.21.15.78:0/1306627405 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000b700 con 0x7f6c201578f0 2023-08-17T17:46:18.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c1dd9b700 1 -- 172.21.15.78:0/1306627405 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000baa0 con 0x7f6c201578f0 2023-08-17T17:46:18.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c248e0700 1 -- 172.21.15.78:0/1306627405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c201578f0 msgr2=0x7f6c200be210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:18.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c248e0700 1 --2- 172.21.15.78:0/1306627405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c201578f0 0x7f6c200be210 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f6c200bdf10 tx=0x7f6c100090f0).stop 2023-08-17T17:46:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c248e0700 1 -- 172.21.15.78:0/1306627405 shutdown_connections 2023-08-17T17:46:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c248e0700 1 --2- 172.21.15.78:0/1306627405 >> v2:172.21.15.150:3300/0 conn(0x7f6c20096520 0x7f6c200c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c248e0700 1 --2- 172.21.15.78:0/1306627405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c201578f0 0x7f6c200be210 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c248e0700 1 -- 172.21.15.78:0/1306627405 >> 172.21.15.78:0/1306627405 conn(0x7f6c20062f80 msgr2=0x7f6c200c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c248e0700 1 -- 172.21.15.78:0/1306627405 shutdown_connections 2023-08-17T17:46:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.676+0000 7f6c248e0700 1 -- 172.21.15.78:0/1306627405 wait complete. 2023-08-17T17:46:18.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.678+0000 7f6c248e0700 1 Processor -- start 2023-08-17T17:46:18.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.678+0000 7f6c248e0700 1 -- start start 2023-08-17T17:46:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.678+0000 7f6c248e0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c20096520 0x7f6c200c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.678+0000 7f6c248e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c200bf0e0 0x7f6c200aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.678+0000 7f6c248e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c201578f0 0x7f6c200ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.678+0000 7f6c248e0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200ab600 con 0x7f6c20096520 2023-08-17T17:46:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.678+0000 7f6c248e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200c0810 con 0x7f6c200bf0e0 2023-08-17T17:46:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.678+0000 7f6c248e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200c2e50 con 0x7f6c201578f0 2023-08-17T17:46:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c1e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c20096520 0x7f6c200c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c1e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c20096520 0x7f6c200c2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54844/0 (socket says 172.21.15.78:54844) 2023-08-17T17:46:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c1e59c700 1 -- 172.21.15.78:0/3839339875 learned_addr learned my addr 172.21.15.78:0/3839339875 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c1e59c700 1 -- 172.21.15.78:0/3839339875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c201578f0 msgr2=0x7f6c200ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c1e59c700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c201578f0 0x7f6c200ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c1e59c700 1 -- 172.21.15.78:0/3839339875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c200bf0e0 msgr2=0x7f6c200aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c15d9b700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c200bf0e0 0x7f6c200aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c1e59c700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c200bf0e0 0x7f6c200aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c1e59c700 1 -- 172.21.15.78:0/3839339875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c10009370 con 0x7f6c20096520 2023-08-17T17:46:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c1e59c700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c20096520 0x7f6c200c2960 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f6c2006a090 tx=0x7f6c10015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c16ffd700 1 -- 172.21.15.78:0/3839339875 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10006930 con 0x7f6c20096520 2023-08-17T17:46:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c16ffd700 1 -- 172.21.15.78:0/3839339875 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000b870 con 0x7f6c20096520 2023-08-17T17:46:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c248e0700 1 -- 172.21.15.78:0/3839339875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c200a9600 con 0x7f6c20096520 2023-08-17T17:46:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c16ffd700 1 -- 172.21.15.78:0/3839339875 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10024470 con 0x7f6c20096520 2023-08-17T17:46:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.679+0000 7f6c248e0700 1 -- 172.21.15.78:0/3839339875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c200a9bc0 con 0x7f6c20096520 2023-08-17T17:46:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.680+0000 7f6c248e0700 1 -- 172.21.15.78:0/3839339875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c201574e0 con 0x7f6c20096520 2023-08-17T17:46:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.680+0000 7f6c16ffd700 1 -- 172.21.15.78:0/3839339875 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f6c1000f070 con 0x7f6c20096520 2023-08-17T17:46:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.681+0000 7f6c16ffd700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c0005ee70 0x7f6c00061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.681+0000 7f6c16ffd700 1 -- 172.21.15.78:0/3839339875 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f6c1007b9a0 con 0x7f6c20096520 2023-08-17T17:46:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.681+0000 7f6c15d9b700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c0005ee70 0x7f6c00061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.681+0000 7f6c15d9b700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c0005ee70 0x7f6c00061330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6c08007fd0 tx=0x7f6c08009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.685+0000 7f6c16ffd700 1 -- 172.21.15.78:0/3839339875 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c1004ce50 con 0x7f6c20096520 2023-08-17T17:46:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.873+0000 7f6c248e0700 1 -- 172.21.15.78:0/3839339875 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c200c37c0 con 0x7f6c0005ee70 2023-08-17T17:46:18.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.876+0000 7f6c16ffd700 1 -- 172.21.15.78:0/3839339875 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f6c200c37c0 con 0x7f6c0005ee70 2023-08-17T17:46:18.877 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-08-17T17:46:18.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 -- 172.21.15.78:0/3839339875 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c0005ee70 msgr2=0x7f6c00061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c0005ee70 0x7f6c00061330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6c08007fd0 tx=0x7f6c08009040).stop 2023-08-17T17:46:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 -- 172.21.15.78:0/3839339875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c20096520 msgr2=0x7f6c200c2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c20096520 0x7f6c200c2960 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f6c2006a090 tx=0x7f6c10015000).stop 2023-08-17T17:46:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 -- 172.21.15.78:0/3839339875 shutdown_connections 2023-08-17T17:46:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6c0005ee70 0x7f6c00061330 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c201578f0 0x7f6c200ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c20096520 0x7f6c200c2960 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 --2- 172.21.15.78:0/3839339875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c200bf0e0 0x7f6c200aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 -- 172.21.15.78:0/3839339875 >> 172.21.15.78:0/3839339875 conn(0x7f6c20062f80 msgr2=0x7f6c20156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 -- 172.21.15.78:0/3839339875 shutdown_connections 2023-08-17T17:46:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:18.878+0000 7f6c248e0700 1 -- 172.21.15.78:0/3839339875 wait complete. 2023-08-17T17:46:18.890 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-08-17T17:46:18.890 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-08-17T17:46:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.008+0000 7f7c20460700 1 Processor -- start 2023-08-17T17:46:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.008+0000 7f7c20460700 1 -- start start 2023-08-17T17:46:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.009+0000 7f7c20460700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c180aa4d0 0x7f7c180644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.009+0000 7f7c20460700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c180c5810 0x7f7c180c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.009+0000 7f7c20460700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c180649b0 con 0x7f7c180aa0f0 2023-08-17T17:46:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.009+0000 7f7c20460700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c180c6170 con 0x7f7c180aa4d0 2023-08-17T17:46:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.009+0000 7f7c20460700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18063420 con 0x7f7c180c5810 2023-08-17T17:46:19.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.009+0000 7f7c1d9fb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c180aa4d0 0x7f7c180644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.009+0000 7f7c1d9fb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c180aa4d0 0x7f7c180644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54850/0 (socket says 172.21.15.78:54850) 2023-08-17T17:46:19.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.009+0000 7f7c1d9fb700 1 -- 172.21.15.78:0/3285733180 learned_addr learned my addr 172.21.15.78:0/3285733180 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:19.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.009+0000 7f7c1e9fd700 1 --2- 172.21.15.78:0/3285733180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c180c5810 0x7f7c180c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c1d9fb700 1 -- 172.21.15.78:0/3285733180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c180c5810 msgr2=0x7f7c180c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:19.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c1d9fb700 1 --2- 172.21.15.78:0/3285733180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c180c5810 0x7f7c180c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c1d9fb700 1 -- 172.21.15.78:0/3285733180 >> v1:172.21.15.150:6789/0 conn(0x7f7c180aa0f0 legacy=0x7f7c180c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c1d9fb700 1 -- 172.21.15.78:0/3285733180 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18063700 con 0x7f7c180aa4d0 2023-08-17T17:46:19.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c1d9fb700 1 --2- 172.21.15.78:0/3285733180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 0x7f7c180644c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f7c08006fd0 tx=0x7f7c080090f0).ready entity=mon.0 client_cookie=205762ae90c2766a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:19.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c1d1fa700 1 -- 172.21.15.78:0/3285733180 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800b580 con 0x7f7c180aa4d0 2023-08-17T17:46:19.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c1d1fa700 1 -- 172.21.15.78:0/3285733180 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800b6e0 con 0x7f7c180aa4d0 2023-08-17T17:46:19.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c1d1fa700 1 -- 172.21.15.78:0/3285733180 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800ba60 con 0x7f7c180aa4d0 2023-08-17T17:46:19.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c20460700 1 -- 172.21.15.78:0/3285733180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 msgr2=0x7f7c180644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c20460700 1 --2- 172.21.15.78:0/3285733180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 0x7f7c180644c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f7c08006fd0 tx=0x7f7c080090f0).stop 2023-08-17T17:46:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c20460700 1 -- 172.21.15.78:0/3285733180 shutdown_connections 2023-08-17T17:46:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c20460700 1 --2- 172.21.15.78:0/3285733180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c180c5810 0x7f7c180c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c20460700 1 --2- 172.21.15.78:0/3285733180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 0x7f7c180644c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c20460700 1 -- 172.21.15.78:0/3285733180 >> 172.21.15.78:0/3285733180 conn(0x7f7c1806a6a0 msgr2=0x7f7c180caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.010+0000 7f7c20460700 1 -- 172.21.15.78:0/3285733180 shutdown_connections 2023-08-17T17:46:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.011+0000 7f7c20460700 1 -- 172.21.15.78:0/3285733180 wait complete. 2023-08-17T17:46:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c20460700 1 Processor -- start 2023-08-17T17:46:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c20460700 1 -- start start 2023-08-17T17:46:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c20460700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c180aa0f0 0x7f7c180c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c20460700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 0x7f7c180c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c20460700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c180c5810 0x7f7c180c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c20460700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180c2a20 con 0x7f7c180aa4d0 2023-08-17T17:46:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c20460700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180c2d00 con 0x7f7c180c5810 2023-08-17T17:46:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c20460700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180c2fe0 con 0x7f7c180aa0f0 2023-08-17T17:46:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c1d9fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 0x7f7c180c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c1d9fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 0x7f7c180c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54854/0 (socket says 172.21.15.78:54854) 2023-08-17T17:46:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.012+0000 7f7c1d9fb700 1 -- 172.21.15.78:0/3360291983 learned_addr learned my addr 172.21.15.78:0/3360291983 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c1e9fd700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c180c5810 0x7f7c180c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c1e1fc700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c180aa0f0 0x7f7c180c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c1d9fb700 1 -- 172.21.15.78:0/3360291983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c180aa0f0 msgr2=0x7f7c180c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c1d9fb700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c180aa0f0 0x7f7c180c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c1d9fb700 1 -- 172.21.15.78:0/3360291983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c180c5810 msgr2=0x7f7c180c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c1d9fb700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c180c5810 0x7f7c180c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c1d9fb700 1 -- 172.21.15.78:0/3360291983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08009370 con 0x7f7c180aa4d0 2023-08-17T17:46:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c1d9fb700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 0x7f7c180c21f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f7c08009130 tx=0x7f7c08017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c0e7fc700 1 -- 172.21.15.78:0/3360291983 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800b850 con 0x7f7c180aa4d0 2023-08-17T17:46:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c0e7fc700 1 -- 172.21.15.78:0/3360291983 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800b9b0 con 0x7f7c180aa4d0 2023-08-17T17:46:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c20460700 1 -- 172.21.15.78:0/3360291983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c180c32c0 con 0x7f7c180aa4d0 2023-08-17T17:46:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c0e7fc700 1 -- 172.21.15.78:0/3360291983 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801c670 con 0x7f7c180aa4d0 2023-08-17T17:46:19.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.013+0000 7f7c20460700 1 -- 172.21.15.78:0/3360291983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c180c26e0 con 0x7f7c180aa4d0 2023-08-17T17:46:19.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.014+0000 7f7c20460700 1 -- 172.21.15.78:0/3360291983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c180c37e0 con 0x7f7c180aa4d0 2023-08-17T17:46:19.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.014+0000 7f7c0e7fc700 1 -- 172.21.15.78:0/3360291983 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f7c0802c070 con 0x7f7c180aa4d0 2023-08-17T17:46:19.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.015+0000 7f7c0e7fc700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7bfc05ee70 0x7f7bfc061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.015+0000 7f7c1e1fc700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7bfc05ee70 0x7f7bfc061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.015+0000 7f7c0e7fc700 1 -- 172.21.15.78:0/3360291983 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f7c0807b800 con 0x7f7c180aa4d0 2023-08-17T17:46:19.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.015+0000 7f7c1e1fc700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7bfc05ee70 0x7f7bfc061330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7c140036b0 tx=0x7f7c14009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:19.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.019+0000 7f7c0e7fc700 1 -- 172.21.15.78:0/3360291983 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7c180c37e0 con 0x7f7c180aa4d0 2023-08-17T17:46:19.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.207+0000 7f7c20460700 1 -- 172.21.15.78:0/3360291983 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c180c37e0 con 0x7f7bfc05ee70 2023-08-17T17:46:19.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.211+0000 7f7c0e7fc700 1 -- 172.21.15.78:0/3360291983 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7c180c37e0 con 0x7f7bfc05ee70 2023-08-17T17:46:19.211 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-08-17T17:46:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 -- 172.21.15.78:0/3360291983 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7bfc05ee70 msgr2=0x7f7bfc061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7bfc05ee70 0x7f7bfc061330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7c140036b0 tx=0x7f7c14009040).stop 2023-08-17T17:46:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 -- 172.21.15.78:0/3360291983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 msgr2=0x7f7c180c21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 0x7f7c180c21f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f7c08009130 tx=0x7f7c08017000).stop 2023-08-17T17:46:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 -- 172.21.15.78:0/3360291983 shutdown_connections 2023-08-17T17:46:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7bfc05ee70 0x7f7bfc061330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c180c5810 0x7f7c180c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c180aa0f0 0x7f7c180c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 --2- 172.21.15.78:0/3360291983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c180aa4d0 0x7f7c180c21f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 -- 172.21.15.78:0/3360291983 >> 172.21.15.78:0/3360291983 conn(0x7f7c1806a6a0 msgr2=0x7f7c180afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:19.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 -- 172.21.15.78:0/3360291983 shutdown_connections 2023-08-17T17:46:19.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.213+0000 7f7c20460700 1 -- 172.21.15.78:0/3360291983 wait complete. 2023-08-17T17:46:19.224 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-08-17T17:46:19.225 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-08-17T17:46:19.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.341+0000 7fefa29fd700 1 Processor -- start 2023-08-17T17:46:19.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.342+0000 7fefa29fd700 1 -- start start 2023-08-17T17:46:19.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.342+0000 7fefa29fd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9c151a40 0x7fef9c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa29fd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef9c157be0 0x7fef9c158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa29fd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c158540 con 0x7fef9c151e20 2023-08-17T17:46:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa29fd700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c0c6620 con 0x7fef9c157be0 2023-08-17T17:46:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa29fd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0c6900 con 0x7fef9c151a40 2023-08-17T17:46:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa21fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef9c157be0 0x7fef9c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa21fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef9c157be0 0x7fef9c158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54870/0 (socket says 172.21.15.78:54870) 2023-08-17T17:46:19.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa21fc700 1 -- 172.21.15.78:0/64704384 learned_addr learned my addr 172.21.15.78:0/64704384 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:19.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa19fb700 1 --2- 172.21.15.78:0/64704384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9c151a40 0x7fef9c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa21fc700 1 -- 172.21.15.78:0/64704384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9c151a40 msgr2=0x7fef9c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:19.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa21fc700 1 --2- 172.21.15.78:0/64704384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9c151a40 0x7fef9c0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa21fc700 1 -- 172.21.15.78:0/64704384 >> v1:172.21.15.150:6789/0 conn(0x7fef9c151e20 legacy=0x7fef9c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa21fc700 1 -- 172.21.15.78:0/64704384 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c0c6be0 con 0x7fef9c157be0 2023-08-17T17:46:19.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa21fc700 1 --2- 172.21.15.78:0/64704384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c157be0 0x7fef9c158050 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fef94009f20 tx=0x7fef94009840).ready entity=mon.0 client_cookie=c494d671fcc5ad16 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:19.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa09f9700 1 -- 172.21.15.78:0/64704384 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9400e070 con 0x7fef9c157be0 2023-08-17T17:46:19.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa09f9700 1 -- 172.21.15.78:0/64704384 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9400b9d0 con 0x7fef9c157be0 2023-08-17T17:46:19.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.343+0000 7fefa09f9700 1 -- 172.21.15.78:0/64704384 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9400bd50 con 0x7fef9c157be0 2023-08-17T17:46:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.344+0000 7fefa29fd700 1 -- 172.21.15.78:0/64704384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c157be0 msgr2=0x7fef9c158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.344+0000 7fefa29fd700 1 --2- 172.21.15.78:0/64704384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c157be0 0x7fef9c158050 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fef94009f20 tx=0x7fef94009840).stop 2023-08-17T17:46:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.344+0000 7fefa29fd700 1 -- 172.21.15.78:0/64704384 shutdown_connections 2023-08-17T17:46:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.344+0000 7fefa29fd700 1 --2- 172.21.15.78:0/64704384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c157be0 0x7fef9c158050 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.344+0000 7fefa29fd700 1 --2- 172.21.15.78:0/64704384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9c151a40 0x7fef9c0c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.344+0000 7fefa29fd700 1 -- 172.21.15.78:0/64704384 >> 172.21.15.78:0/64704384 conn(0x7fef9c0943b0 msgr2=0x7fef9c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.344+0000 7fefa29fd700 1 -- 172.21.15.78:0/64704384 shutdown_connections 2023-08-17T17:46:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.344+0000 7fefa29fd700 1 -- 172.21.15.78:0/64704384 wait complete. 2023-08-17T17:46:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.345+0000 7fefa29fd700 1 Processor -- start 2023-08-17T17:46:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.345+0000 7fefa29fd700 1 -- start start 2023-08-17T17:46:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa29fd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef9c151a40 0x7fef9c14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa29fd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c151e20 0x7fef9c0ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa29fd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9c157be0 0x7fef9c0abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa29fd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0ac6f0 con 0x7fef9c151e20 2023-08-17T17:46:19.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa29fd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0aa510 con 0x7fef9c151a40 2023-08-17T17:46:19.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa29fd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0aadb0 con 0x7fef9c157be0 2023-08-17T17:46:19.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa11fa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c151e20 0x7fef9c0ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa11fa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c151e20 0x7fef9c0ab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54882/0 (socket says 172.21.15.78:54882) 2023-08-17T17:46:19.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa11fa700 1 -- 172.21.15.78:0/3965546945 learned_addr learned my addr 172.21.15.78:0/3965546945 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:19.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa21fc700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9c157be0 0x7fef9c0abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa19fb700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef9c151a40 0x7fef9c14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa11fa700 1 -- 172.21.15.78:0/3965546945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9c157be0 msgr2=0x7fef9c0abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa11fa700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9c157be0 0x7fef9c0abaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa11fa700 1 -- 172.21.15.78:0/3965546945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef9c151a40 msgr2=0x7fef9c14c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa11fa700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef9c151a40 0x7fef9c14c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa11fa700 1 -- 172.21.15.78:0/3965546945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94009ae0 con 0x7fef9c151e20 2023-08-17T17:46:19.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa11fa700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c151e20 0x7fef9c0ab240 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fef8c00c440 tx=0x7fef8c007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:19.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fef91ffb700 1 -- 172.21.15.78:0/3965546945 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c007020 con 0x7fef9c151e20 2023-08-17T17:46:19.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fef91ffb700 1 -- 172.21.15.78:0/3965546945 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c007180 con 0x7fef9c151e20 2023-08-17T17:46:19.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fef91ffb700 1 -- 172.21.15.78:0/3965546945 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c007500 con 0x7fef9c151e20 2023-08-17T17:46:19.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.346+0000 7fefa29fd700 1 -- 172.21.15.78:0/3965546945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c14cde0 con 0x7fef9c151e20 2023-08-17T17:46:19.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.347+0000 7fefa29fd700 1 -- 172.21.15.78:0/3965546945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c0aa760 con 0x7fef9c151e20 2023-08-17T17:46:19.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.348+0000 7fefa29fd700 1 -- 172.21.15.78:0/3965546945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c082f90 con 0x7fef9c151e20 2023-08-17T17:46:19.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.348+0000 7fef91ffb700 1 -- 172.21.15.78:0/3965546945 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fef8c010070 con 0x7fef9c151e20 2023-08-17T17:46:19.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.348+0000 7fef91ffb700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef8005ee70 0x7fef80061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.348+0000 7fef91ffb700 1 -- 172.21.15.78:0/3965546945 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fef8c078d70 con 0x7fef9c151e20 2023-08-17T17:46:19.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.348+0000 7fefa19fb700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef8005ee70 0x7fef80061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.348+0000 7fefa19fb700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef8005ee70 0x7fef80061330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fef98006fd0 tx=0x7fef98006f40).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:19.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.352+0000 7fef91ffb700 1 -- 172.21.15.78:0/3965546945 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef8c0478f0 con 0x7fef9c151e20 2023-08-17T17:46:19.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.540+0000 7fefa29fd700 1 -- 172.21.15.78:0/3965546945 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fef9c05f910 con 0x7fef8005ee70 2023-08-17T17:46:19.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.544+0000 7fef91ffb700 1 -- 172.21.15.78:0/3965546945 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fef9c05f910 con 0x7fef8005ee70 2023-08-17T17:46:19.544 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-08-17T17:46:19.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.545+0000 7fefa29fd700 1 -- 172.21.15.78:0/3965546945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef8005ee70 msgr2=0x7fef80061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.545+0000 7fefa29fd700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef8005ee70 0x7fef80061330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fef98006fd0 tx=0x7fef98006f40).stop 2023-08-17T17:46:19.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.545+0000 7fefa29fd700 1 -- 172.21.15.78:0/3965546945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c151e20 msgr2=0x7fef9c0ab240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.545+0000 7fefa29fd700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c151e20 0x7fef9c0ab240 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fef8c00c440 tx=0x7fef8c007d30).stop 2023-08-17T17:46:19.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.545+0000 7fefa29fd700 1 -- 172.21.15.78:0/3965546945 shutdown_connections 2023-08-17T17:46:19.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.545+0000 7fefa29fd700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef8005ee70 0x7fef80061330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.545+0000 7fefa29fd700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9c157be0 0x7fef9c0abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.545+0000 7fefa29fd700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef9c151a40 0x7fef9c14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.545+0000 7fefa29fd700 1 --2- 172.21.15.78:0/3965546945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9c151e20 0x7fef9c0ab240 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.545+0000 7fefa29fd700 1 -- 172.21.15.78:0/3965546945 >> 172.21.15.78:0/3965546945 conn(0x7fef9c0943b0 msgr2=0x7fef9c063840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:19.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.546+0000 7fefa29fd700 1 -- 172.21.15.78:0/3965546945 shutdown_connections 2023-08-17T17:46:19.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.546+0000 7fefa29fd700 1 -- 172.21.15.78:0/3965546945 wait complete. 2023-08-17T17:46:19.557 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-08-17T17:46:19.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-08-17T17:46:19.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.675+0000 7f89280f4700 1 Processor -- start 2023-08-17T17:46:19.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.675+0000 7f89280f4700 1 -- start start 2023-08-17T17:46:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f89280f4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f89200aa0f0 0x7f89200644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f89280f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c5810 0x7f89200c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f89280f4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89200649b0 con 0x7f89200aa4d0 2023-08-17T17:46:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f89280f4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89200c6170 con 0x7f89200aa0f0 2023-08-17T17:46:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f89280f4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8920063420 con 0x7f89200c5810 2023-08-17T17:46:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f892568f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f89200aa4d0 0x7f89200c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37690/0 (socket says 172.21.15.78:37690) 2023-08-17T17:46:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f892568f700 1 -- 172.21.15.78:0/238235495 learned_addr learned my addr 172.21.15.78:0/238235495 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746983876 0 0) 0x7f89200649b0 con 0x7f89200aa4d0 2023-08-17T17:46:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8926691700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c5810 0x7f89200c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8925e90700 1 --2- 172.21.15.78:0/238235495 >> v2:172.21.15.150:3300/0 conn(0x7f89200aa0f0 0x7f89200644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f890c0033f0 con 0x7f89200aa4d0 2023-08-17T17:46:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2892432103 0 0) 0x7f890c0033f0 con 0x7f89200aa4d0 2023-08-17T17:46:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c5810 msgr2=0x7f89200c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:19.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c5810 0x7f89200c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 >> v2:172.21.15.150:3300/0 conn(0x7f89200aa0f0 msgr2=0x7f89200644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:19.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 --2- 172.21.15.78:0/238235495 >> v2:172.21.15.150:3300/0 conn(0x7f89200aa0f0 0x7f89200644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8920063700 con 0x7f89200aa4d0 2023-08-17T17:46:19.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f8910001470 con 0x7f89200aa4d0 2023-08-17T17:46:19.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 >> v1:172.21.15.78:6789/0 conn(0x7f89200aa4d0 legacy=0x7f89200c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.676+0000 7f8924e8e700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f890c0038e0 0x7f890c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8924e8e700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c5810 0x7f890c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8924e8e700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f890c004b80 0x7f890c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200c6170 con 0x7f890c004b80 2023-08-17T17:46:19.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8920063420 con 0x7f890c0038e0 2023-08-17T17:46:19.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890c00b8e0 con 0x7f89200c5810 2023-08-17T17:46:19.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8926691700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f890c004b80 0x7f890c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8925e90700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f890c0038e0 0x7f890c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f892568f700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c5810 0x7f890c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8926691700 1 -- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c5810 msgr2=0x7f890c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:19.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8926691700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c5810 0x7f890c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8926691700 1 -- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f890c0038e0 msgr2=0x7f890c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:19.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8926691700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f890c0038e0 0x7f890c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8926691700 1 -- 172.21.15.78:0/238235495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c0033f0 con 0x7f890c004b80 2023-08-17T17:46:19.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f892568f700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c5810 0x7f890c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:19.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8926691700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f890c004b80 0x7f890c005000 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f8918009a80 tx=0x7f8918009060).ready entity=mon.0 client_cookie=67fb3a811d909f31 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918009430 con 0x7f890c004b80 2023-08-17T17:46:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891800e640 con 0x7f890c004b80 2023-08-17T17:46:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.677+0000 7f8924e8e700 1 -- 172.21.15.78:0/238235495 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891800e9c0 con 0x7f890c004b80 2023-08-17T17:46:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.678+0000 7f89280f4700 1 -- 172.21.15.78:0/238235495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f890c004b80 msgr2=0x7f890c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.678+0000 7f89280f4700 1 --2- 172.21.15.78:0/238235495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f890c004b80 0x7f890c005000 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f8918009a80 tx=0x7f8918009060).stop 2023-08-17T17:46:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.678+0000 7f8926691700 1 -- 172.21.15.78:0/238235495 reap_dead start 2023-08-17T17:46:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.678+0000 7f89280f4700 1 -- 172.21.15.78:0/238235495 shutdown_connections 2023-08-17T17:46:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.678+0000 7f89280f4700 1 -- 172.21.15.78:0/238235495 >> 172.21.15.78:0/238235495 conn(0x7f892006a6a0 msgr2=0x7f89200caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:19.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.678+0000 7f89280f4700 1 -- 172.21.15.78:0/238235495 shutdown_connections 2023-08-17T17:46:19.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.678+0000 7f89280f4700 1 -- 172.21.15.78:0/238235495 wait complete. 2023-08-17T17:46:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.679+0000 7f89280f4700 1 Processor -- start 2023-08-17T17:46:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.679+0000 7f89280f4700 1 -- start start 2023-08-17T17:46:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f89280f4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8920158540 0x7f89200c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f89280f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8920158920 0x7f89200c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f89280f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c45f0 0x7f89200a7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f89280f4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200c3600 con 0x7f8920158540 2023-08-17T17:46:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f89280f4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200c52a0 con 0x7f8920158920 2023-08-17T17:46:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f89280f4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8920158da0 con 0x7f89200c45f0 2023-08-17T17:46:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8925e90700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8920158540 0x7f89200c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8925e90700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8920158540 0x7f89200c25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54892/0 (socket says 172.21.15.78:54892) 2023-08-17T17:46:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8925e90700 1 -- 172.21.15.78:0/985987437 learned_addr learned my addr 172.21.15.78:0/985987437 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f892568f700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8920158920 0x7f89200c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8926691700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c45f0 0x7f89200a7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8925e90700 1 -- 172.21.15.78:0/985987437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c45f0 msgr2=0x7f89200a7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8925e90700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c45f0 0x7f89200a7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8925e90700 1 -- 172.21.15.78:0/985987437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8920158920 msgr2=0x7f89200c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8925e90700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8920158920 0x7f89200c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8925e90700 1 -- 172.21.15.78:0/985987437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89200c3850 con 0x7f8920158540 2023-08-17T17:46:19.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f892568f700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8920158920 0x7f89200c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:19.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8925e90700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8920158540 0x7f89200c25c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f891c009fd0 tx=0x7f891c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8915ffb700 1 -- 172.21.15.78:0/985987437 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c00e040 con 0x7f8920158540 2023-08-17T17:46:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8915ffb700 1 -- 172.21.15.78:0/985987437 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c00f040 con 0x7f8920158540 2023-08-17T17:46:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f89280f4700 1 -- 172.21.15.78:0/985987437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89200c3b30 con 0x7f8920158540 2023-08-17T17:46:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.680+0000 7f8915ffb700 1 -- 172.21.15.78:0/985987437 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c015450 con 0x7f8920158540 2023-08-17T17:46:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.681+0000 7f89280f4700 1 -- 172.21.15.78:0/985987437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89200c40f0 con 0x7f8920158540 2023-08-17T17:46:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.681+0000 7f89280f4700 1 -- 172.21.15.78:0/985987437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8920083980 con 0x7f8920158540 2023-08-17T17:46:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.682+0000 7f8915ffb700 1 -- 172.21.15.78:0/985987437 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f891c015880 con 0x7f8920158540 2023-08-17T17:46:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.682+0000 7f8915ffb700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f890405ee70 0x7f8904061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.682+0000 7f8915ffb700 1 -- 172.21.15.78:0/985987437 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f891c07ae70 con 0x7f8920158540 2023-08-17T17:46:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.682+0000 7f892568f700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f890405ee70 0x7f8904061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.682+0000 7f892568f700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f890405ee70 0x7f8904061330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f89100016a0 tx=0x7f8910009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.686+0000 7f8915ffb700 1 -- 172.21.15.78:0/985987437 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f891c04c320 con 0x7f8920158540 2023-08-17T17:46:19.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.875+0000 7f89280f4700 1 -- 172.21.15.78:0/985987437 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f89200cbd40 con 0x7f890405ee70 2023-08-17T17:46:19.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.879+0000 7f8915ffb700 1 -- 172.21.15.78:0/985987437 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f89200cbd40 con 0x7f890405ee70 2023-08-17T17:46:19.879 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-08-17T17:46:19.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 -- 172.21.15.78:0/985987437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f890405ee70 msgr2=0x7f8904061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f890405ee70 0x7f8904061330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f89100016a0 tx=0x7f8910009040).stop 2023-08-17T17:46:19.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 -- 172.21.15.78:0/985987437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8920158540 msgr2=0x7f89200c25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:19.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8920158540 0x7f89200c25c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f891c009fd0 tx=0x7f891c00b040).stop 2023-08-17T17:46:19.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 -- 172.21.15.78:0/985987437 shutdown_connections 2023-08-17T17:46:19.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f890405ee70 0x7f8904061330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89200c45f0 0x7f89200a7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8920158540 0x7f89200c25c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 --2- 172.21.15.78:0/985987437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8920158920 0x7f89200c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:19.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 -- 172.21.15.78:0/985987437 >> 172.21.15.78:0/985987437 conn(0x7f892006a6a0 msgr2=0x7f89200afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:19.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 -- 172.21.15.78:0/985987437 shutdown_connections 2023-08-17T17:46:19.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:19.881+0000 7f89280f4700 1 -- 172.21.15.78:0/985987437 wait complete. 2023-08-17T17:46:19.893 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-08-17T17:46:19.893 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-08-17T17:46:20.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.010+0000 7ff9e870e700 1 Processor -- start 2023-08-17T17:46:20.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.010+0000 7ff9e870e700 1 -- start start 2023-08-17T17:46:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e870e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff9e00aa4d0 0x7ff9e00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e870e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e00649b0 con 0x7ff9e00c5810 2023-08-17T17:46:20.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e870e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e0063420 con 0x7ff9e00aa0f0 2023-08-17T17:46:20.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e870e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e0063700 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e5ca9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff9e00aa4d0 0x7ff9e00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e6cab700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff9e00c5810 0x7ff9e00a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37702/0 (socket says 172.21.15.78:37702) 2023-08-17T17:46:20.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e6cab700 1 -- 172.21.15.78:0/4268920071 learned_addr learned my addr 172.21.15.78:0/4268920071 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:20.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e5ca9700 1 -- 172.21.15.78:0/4268920071 >> v1:172.21.15.150:6789/0 conn(0x7ff9e00aa0f0 legacy=0x7ff9e00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e5ca9700 1 -- 172.21.15.78:0/4268920071 >> v1:172.21.15.78:6789/0 conn(0x7ff9e00c5810 legacy=0x7ff9e00a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e5ca9700 1 -- 172.21.15.78:0/4268920071 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e00639e0 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e54a8700 1 -- 172.21.15.78:0/4268920071 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036685253 0 0) 0x7ff9e00649b0 con 0x7ff9e00c5810 2023-08-17T17:46:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e5ca9700 1 --2- 172.21.15.78:0/4268920071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 0x7ff9e00644c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7ff9d0009760 tx=0x7ff9d0009060).ready entity=mon.0 client_cookie=50b75b1ea8a24bb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e54a8700 1 -- 172.21.15.78:0/4268920071 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000b580 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e54a8700 1 -- 172.21.15.78:0/4268920071 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000b6e0 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.011+0000 7ff9e54a8700 1 -- 172.21.15.78:0/4268920071 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000ba60 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.012+0000 7ff9e870e700 1 -- 172.21.15.78:0/4268920071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 msgr2=0x7ff9e00644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.012+0000 7ff9e870e700 1 --2- 172.21.15.78:0/4268920071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 0x7ff9e00644c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7ff9d0009760 tx=0x7ff9d0009060).stop 2023-08-17T17:46:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.012+0000 7ff9e870e700 1 -- 172.21.15.78:0/4268920071 shutdown_connections 2023-08-17T17:46:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.012+0000 7ff9e870e700 1 --2- 172.21.15.78:0/4268920071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 0x7ff9e00644c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.012+0000 7ff9e870e700 1 -- 172.21.15.78:0/4268920071 >> 172.21.15.78:0/4268920071 conn(0x7ff9e006a6a0 msgr2=0x7ff9e00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.012+0000 7ff9e870e700 1 -- 172.21.15.78:0/4268920071 shutdown_connections 2023-08-17T17:46:20.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.012+0000 7ff9e870e700 1 -- 172.21.15.78:0/4268920071 wait complete. 2023-08-17T17:46:20.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.013+0000 7ff9e870e700 1 Processor -- start 2023-08-17T17:46:20.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.013+0000 7ff9e870e700 1 -- start start 2023-08-17T17:46:20.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e870e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9e00aa0f0 0x7ff9e00af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e870e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 0x7ff9e0152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e870e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9e00c5810 0x7ff9e00aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e870e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00ac4a0 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e870e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00ac780 con 0x7ff9e00c5810 2023-08-17T17:46:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e870e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00aca60 con 0x7ff9e00aa0f0 2023-08-17T17:46:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e5ca9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 0x7ff9e0152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e5ca9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 0x7ff9e0152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54910/0 (socket says 172.21.15.78:54910) 2023-08-17T17:46:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e5ca9700 1 -- 172.21.15.78:0/213871493 learned_addr learned my addr 172.21.15.78:0/213871493 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e64aa700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9e00aa0f0 0x7ff9e00af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e6cab700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9e00c5810 0x7ff9e00aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e5ca9700 1 -- 172.21.15.78:0/213871493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9e00aa0f0 msgr2=0x7ff9e00af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e5ca9700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9e00aa0f0 0x7ff9e00af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e5ca9700 1 -- 172.21.15.78:0/213871493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9e00c5810 msgr2=0x7ff9e00aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e5ca9700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9e00c5810 0x7ff9e00aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e5ca9700 1 -- 172.21.15.78:0/213871493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00092a0 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e64aa700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9e00aa0f0 0x7ff9e00af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e6cab700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9e00c5810 0x7ff9e00aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9e5ca9700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 0x7ff9e0152820 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7ff9e005e180 tx=0x7ff9d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.014+0000 7ff9d67fc700 1 -- 172.21.15.78:0/213871493 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000ba60 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.015+0000 7ff9d67fc700 1 -- 172.21.15.78:0/213871493 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d0000c90 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.015+0000 7ff9e870e700 1 -- 172.21.15.78:0/213871493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e00acd40 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.015+0000 7ff9d67fc700 1 -- 172.21.15.78:0/213871493 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d001b640 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.015+0000 7ff9e870e700 1 -- 172.21.15.78:0/213871493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e00afec0 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.015+0000 7ff9e870e700 1 -- 172.21.15.78:0/213871493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e0083980 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.016+0000 7ff9d67fc700 1 -- 172.21.15.78:0/213871493 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7ff9d000f070 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.016+0000 7ff9d67fc700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9c405ee40 0x7ff9c4061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.016+0000 7ff9d67fc700 1 -- 172.21.15.78:0/213871493 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7ff9d007b940 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.016+0000 7ff9e64aa700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9c405ee40 0x7ff9c4061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.017+0000 7ff9e64aa700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9c405ee40 0x7ff9c4061300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff9dc001730 tx=0x7ff9dc009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:20.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.020+0000 7ff9d67fc700 1 -- 172.21.15.78:0/213871493 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9d004cce0 con 0x7ff9e00aa4d0 2023-08-17T17:46:20.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.207+0000 7ff9e870e700 1 -- 172.21.15.78:0/213871493 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9e0046af0 con 0x7ff9c405ee40 2023-08-17T17:46:20.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.211+0000 7ff9d67fc700 1 -- 172.21.15.78:0/213871493 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ff9e0046af0 con 0x7ff9c405ee40 2023-08-17T17:46:20.211 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-08-17T17:46:20.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 -- 172.21.15.78:0/213871493 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9c405ee40 msgr2=0x7ff9c4061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9c405ee40 0x7ff9c4061300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff9dc001730 tx=0x7ff9dc009040).stop 2023-08-17T17:46:20.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 -- 172.21.15.78:0/213871493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 msgr2=0x7ff9e0152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 0x7ff9e0152820 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7ff9e005e180 tx=0x7ff9d0017000).stop 2023-08-17T17:46:20.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 -- 172.21.15.78:0/213871493 shutdown_connections 2023-08-17T17:46:20.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9c405ee40 0x7ff9c4061300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9e00c5810 0x7ff9e00aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9e00aa0f0 0x7ff9e00af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 --2- 172.21.15.78:0/213871493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e00aa4d0 0x7ff9e0152820 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 -- 172.21.15.78:0/213871493 >> 172.21.15.78:0/213871493 conn(0x7ff9e006a6a0 msgr2=0x7ff9e00ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 -- 172.21.15.78:0/213871493 shutdown_connections 2023-08-17T17:46:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.212+0000 7ff9e870e700 1 -- 172.21.15.78:0/213871493 wait complete. 2023-08-17T17:46:20.224 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-08-17T17:46:20.224 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-08-17T17:46:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.340+0000 7fb28d0ce700 1 Processor -- start 2023-08-17T17:46:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.340+0000 7fb28d0ce700 1 -- start start 2023-08-17T17:46:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28d0ce700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb2880aa4d0 0x7fb2880644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28d0ce700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2880c5810 0x7fb2880c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28d0ce700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2880649b0 con 0x7fb2880aa0f0 2023-08-17T17:46:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28d0ce700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880c6170 con 0x7fb2880c5810 2023-08-17T17:46:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28d0ce700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb288063420 con 0x7fb2880aa4d0 2023-08-17T17:46:20.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2880c5810 0x7fb2880c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb286d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb2880aa0f0 0x7fb2880c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37716/0 (socket says 172.21.15.78:37716) 2023-08-17T17:46:20.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb286d9d700 1 -- 172.21.15.78:0/3577934242 learned_addr learned my addr 172.21.15.78:0/3577934242 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:20.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28759e700 1 -- 172.21.15.78:0/3577934242 >> v2:172.21.15.150:3300/0 conn(0x7fb2880aa4d0 msgr2=0x7fb2880644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:20.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28659c700 1 --2- 172.21.15.78:0/3577934242 >> v2:172.21.15.150:3300/0 conn(0x7fb2880aa4d0 0x7fb2880644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb285d9b700 1 -- 172.21.15.78:0/3577934242 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175597148 0 0) 0x7fb2880649b0 con 0x7fb2880aa0f0 2023-08-17T17:46:20.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28759e700 1 --2- 172.21.15.78:0/3577934242 >> v2:172.21.15.150:3300/0 conn(0x7fb2880aa4d0 0x7fb2880644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28759e700 1 -- 172.21.15.78:0/3577934242 >> v1:172.21.15.78:6789/0 conn(0x7fb2880aa0f0 legacy=0x7fb2880c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28759e700 1 -- 172.21.15.78:0/3577934242 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb288063700 con 0x7fb2880c5810 2023-08-17T17:46:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28659c700 1 --2- 172.21.15.78:0/3577934242 >> v2:172.21.15.150:3300/0 conn(0x7fb2880aa4d0 0x7fb2880644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb28759e700 1 --2- 172.21.15.78:0/3577934242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880c5810 0x7fb2880c5c80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fb2880c17a0 tx=0x7fb280009780).ready entity=mon.0 client_cookie=faef27e56a8fcc5f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb285d9b700 1 -- 172.21.15.78:0/3577934242 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28000e070 con 0x7fb2880c5810 2023-08-17T17:46:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb285d9b700 1 -- 172.21.15.78:0/3577934242 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28000bc30 con 0x7fb2880c5810 2023-08-17T17:46:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.341+0000 7fb285d9b700 1 -- 172.21.15.78:0/3577934242 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280012410 con 0x7fb2880c5810 2023-08-17T17:46:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.342+0000 7fb28d0ce700 1 -- 172.21.15.78:0/3577934242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880c5810 msgr2=0x7fb2880c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.342+0000 7fb28d0ce700 1 --2- 172.21.15.78:0/3577934242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880c5810 0x7fb2880c5c80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fb2880c17a0 tx=0x7fb280009780).stop 2023-08-17T17:46:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.342+0000 7fb28d0ce700 1 -- 172.21.15.78:0/3577934242 shutdown_connections 2023-08-17T17:46:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.342+0000 7fb28d0ce700 1 --2- 172.21.15.78:0/3577934242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880c5810 0x7fb2880c5c80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.342+0000 7fb28d0ce700 1 --2- 172.21.15.78:0/3577934242 >> v2:172.21.15.150:3300/0 conn(0x7fb2880aa4d0 0x7fb2880644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.342+0000 7fb28d0ce700 1 -- 172.21.15.78:0/3577934242 >> 172.21.15.78:0/3577934242 conn(0x7fb28806a6a0 msgr2=0x7fb2880caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.342+0000 7fb28d0ce700 1 -- 172.21.15.78:0/3577934242 shutdown_connections 2023-08-17T17:46:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.342+0000 7fb28d0ce700 1 -- 172.21.15.78:0/3577934242 wait complete. 2023-08-17T17:46:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.343+0000 7fb28d0ce700 1 Processor -- start 2023-08-17T17:46:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.343+0000 7fb28d0ce700 1 -- start start 2023-08-17T17:46:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb28d0ce700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880aa0f0 0x7fb2880c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb28d0ce700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2880aa4d0 0x7fb288146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb28d0ce700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2880c5810 0x7fb2880b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb28d0ce700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880c33a0 con 0x7fb2880aa0f0 2023-08-17T17:46:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb28d0ce700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880c1e10 con 0x7fb2880c5810 2023-08-17T17:46:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb28d0ce700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880c20f0 con 0x7fb2880aa4d0 2023-08-17T17:46:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb286d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880aa0f0 0x7fb2880c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb286d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880aa0f0 0x7fb2880c2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54916/0 (socket says 172.21.15.78:54916) 2023-08-17T17:46:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb286d9d700 1 -- 172.21.15.78:0/2449371491 learned_addr learned my addr 172.21.15.78:0/2449371491 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb28659c700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2880aa4d0 0x7fb288146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb28759e700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2880c5810 0x7fb2880b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb286d9d700 1 -- 172.21.15.78:0/2449371491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2880aa4d0 msgr2=0x7fb288146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb286d9d700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2880aa4d0 0x7fb288146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb286d9d700 1 -- 172.21.15.78:0/2449371491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2880c5810 msgr2=0x7fb2880b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb286d9d700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2880c5810 0x7fb2880b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb286d9d700 1 -- 172.21.15.78:0/2449371491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280009a20 con 0x7fb2880aa0f0 2023-08-17T17:46:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb286d9d700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880aa0f0 0x7fb2880c2eb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fb27800c4e0 tx=0x7fb278007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb27effd700 1 -- 172.21.15.78:0/2449371491 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2780072e0 con 0x7fb2880aa0f0 2023-08-17T17:46:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.344+0000 7fb27effd700 1 -- 172.21.15.78:0/2449371491 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb278007440 con 0x7fb2880aa0f0 2023-08-17T17:46:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.345+0000 7fb28d0ce700 1 -- 172.21.15.78:0/2449371491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2880c23d0 con 0x7fb2880aa0f0 2023-08-17T17:46:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.345+0000 7fb27effd700 1 -- 172.21.15.78:0/2449371491 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2780057a0 con 0x7fb2880aa0f0 2023-08-17T17:46:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.345+0000 7fb28d0ce700 1 -- 172.21.15.78:0/2449371491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2880c2990 con 0x7fb2880aa0f0 2023-08-17T17:46:20.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.345+0000 7fb28d0ce700 1 -- 172.21.15.78:0/2449371491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb288083980 con 0x7fb2880aa0f0 2023-08-17T17:46:20.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.346+0000 7fb27effd700 1 -- 172.21.15.78:0/2449371491 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fb27801a060 con 0x7fb2880aa0f0 2023-08-17T17:46:20.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.346+0000 7fb27effd700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb26805ee70 0x7fb268061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.346+0000 7fb27effd700 1 -- 172.21.15.78:0/2449371491 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fb2780795d0 con 0x7fb2880aa0f0 2023-08-17T17:46:20.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.346+0000 7fb28659c700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb26805ee70 0x7fb268061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.347+0000 7fb28659c700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb26805ee70 0x7fb268061330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb2880c73c0 tx=0x7fb270008040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:20.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.350+0000 7fb27effd700 1 -- 172.21.15.78:0/2449371491 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb27804aa80 con 0x7fb2880aa0f0 2023-08-17T17:46:20.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.537+0000 7fb28d0ce700 1 -- 172.21.15.78:0/2449371491 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2880cbd40 con 0x7fb26805ee70 2023-08-17T17:46:20.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.541+0000 7fb27effd700 1 -- 172.21.15.78:0/2449371491 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb2880cbd40 con 0x7fb26805ee70 2023-08-17T17:46:20.541 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-08-17T17:46:20.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 -- 172.21.15.78:0/2449371491 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb26805ee70 msgr2=0x7fb268061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb26805ee70 0x7fb268061330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb2880c73c0 tx=0x7fb270008040).stop 2023-08-17T17:46:20.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 -- 172.21.15.78:0/2449371491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880aa0f0 msgr2=0x7fb2880c2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880aa0f0 0x7fb2880c2eb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fb27800c4e0 tx=0x7fb278007c70).stop 2023-08-17T17:46:20.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 -- 172.21.15.78:0/2449371491 shutdown_connections 2023-08-17T17:46:20.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb26805ee70 0x7fb268061330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2880c5810 0x7fb2880b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2880aa0f0 0x7fb2880c2eb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 --2- 172.21.15.78:0/2449371491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2880aa4d0 0x7fb288146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 -- 172.21.15.78:0/2449371491 >> 172.21.15.78:0/2449371491 conn(0x7fb28806a6a0 msgr2=0x7fb2880a95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:20.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 -- 172.21.15.78:0/2449371491 shutdown_connections 2023-08-17T17:46:20.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.543+0000 7fb28d0ce700 1 -- 172.21.15.78:0/2449371491 wait complete. 2023-08-17T17:46:20.554 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-08-17T17:46:20.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-08-17T17:46:20.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.671+0000 7f5bee63d700 1 Processor -- start 2023-08-17T17:46:20.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.671+0000 7f5bee63d700 1 -- start start 2023-08-17T17:46:20.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.672+0000 7f5bee63d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5be80aa0f0 0x7f5be80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.672+0000 7f5bee63d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5be80aa4d0 0x7f5be80c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.672+0000 7f5bee63d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80c5810 0x7f5be80c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.672+0000 7f5bee63d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be80649b0 con 0x7f5be80aa4d0 2023-08-17T17:46:20.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.672+0000 7f5bee63d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be80c6140 con 0x7f5be80aa0f0 2023-08-17T17:46:20.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.672+0000 7f5bee63d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8063420 con 0x7f5be80c5810 2023-08-17T17:46:20.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.672+0000 7f5be77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5be80aa4d0 0x7f5be80c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.672+0000 7f5be77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5be80aa4d0 0x7f5be80c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54926/0 (socket says 172.21.15.78:54926) 2023-08-17T17:46:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.672+0000 7f5be77fe700 1 -- 172.21.15.78:0/4028743705 learned_addr learned my addr 172.21.15.78:0/4028743705 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5be7fff700 1 --2- 172.21.15.78:0/4028743705 >> v2:172.21.15.150:3300/0 conn(0x7f5be80aa0f0 0x7f5be80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5becbda700 1 --2- 172.21.15.78:0/4028743705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80c5810 0x7f5be80c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5be77fe700 1 -- 172.21.15.78:0/4028743705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80c5810 msgr2=0x7f5be80c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:20.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5be77fe700 1 --2- 172.21.15.78:0/4028743705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80c5810 0x7f5be80c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5be77fe700 1 -- 172.21.15.78:0/4028743705 >> v2:172.21.15.150:3300/0 conn(0x7f5be80aa0f0 msgr2=0x7f5be80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:20.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5be77fe700 1 --2- 172.21.15.78:0/4028743705 >> v2:172.21.15.150:3300/0 conn(0x7f5be80aa0f0 0x7f5be80644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5be77fe700 1 -- 172.21.15.78:0/4028743705 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be8063700 con 0x7f5be80aa4d0 2023-08-17T17:46:20.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5be77fe700 1 --2- 172.21.15.78:0/4028743705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa4d0 0x7f5be80c0e10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f5be80cade0 tx=0x7f5bdc0090f0).ready entity=mon.0 client_cookie=49a9cd3f2f1de35e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:20.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5be6ffd700 1 -- 172.21.15.78:0/4028743705 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00b600 con 0x7f5be80aa4d0 2023-08-17T17:46:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5be6ffd700 1 -- 172.21.15.78:0/4028743705 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00b760 con 0x7f5be80aa4d0 2023-08-17T17:46:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5be6ffd700 1 -- 172.21.15.78:0/4028743705 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00bae0 con 0x7f5be80aa4d0 2023-08-17T17:46:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5bee63d700 1 -- 172.21.15.78:0/4028743705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa4d0 msgr2=0x7f5be80c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5bee63d700 1 --2- 172.21.15.78:0/4028743705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa4d0 0x7f5be80c0e10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f5be80cade0 tx=0x7f5bdc0090f0).stop 2023-08-17T17:46:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5bee63d700 1 -- 172.21.15.78:0/4028743705 shutdown_connections 2023-08-17T17:46:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5bee63d700 1 --2- 172.21.15.78:0/4028743705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80c5810 0x7f5be80c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5bee63d700 1 --2- 172.21.15.78:0/4028743705 >> v2:172.21.15.150:3300/0 conn(0x7f5be80aa0f0 0x7f5be80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5bee63d700 1 --2- 172.21.15.78:0/4028743705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa4d0 0x7f5be80c0e10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5bee63d700 1 -- 172.21.15.78:0/4028743705 >> 172.21.15.78:0/4028743705 conn(0x7f5be806a6a0 msgr2=0x7f5be80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.673+0000 7f5bee63d700 1 -- 172.21.15.78:0/4028743705 shutdown_connections 2023-08-17T17:46:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.674+0000 7f5bee63d700 1 -- 172.21.15.78:0/4028743705 wait complete. 2023-08-17T17:46:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.675+0000 7f5bee63d700 1 Processor -- start 2023-08-17T17:46:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.675+0000 7f5bee63d700 1 -- start start 2023-08-17T17:46:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.675+0000 7f5bee63d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa0f0 0x7f5be813e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.675+0000 7f5bee63d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80aa4d0 0x7f5be80c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5bee63d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be80c5810 0x7f5be80c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5bee63d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80ab980 con 0x7f5be80aa0f0 2023-08-17T17:46:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5bee63d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80aad70 con 0x7f5be80c5810 2023-08-17T17:46:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5bee63d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80ab050 con 0x7f5be80aa4d0 2023-08-17T17:46:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa0f0 0x7f5be813e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa0f0 0x7f5be813e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54928/0 (socket says 172.21.15.78:54928) 2023-08-17T17:46:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be7fff700 1 -- 172.21.15.78:0/2663037455 learned_addr learned my addr 172.21.15.78:0/2663037455 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be77fe700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80aa4d0 0x7f5be80c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5becbda700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be80c5810 0x7f5be80c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be7fff700 1 -- 172.21.15.78:0/2663037455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80aa4d0 msgr2=0x7f5be80c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be7fff700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80aa4d0 0x7f5be80c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be7fff700 1 -- 172.21.15.78:0/2663037455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be80c5810 msgr2=0x7f5be80c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be7fff700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be80c5810 0x7f5be80c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be7fff700 1 -- 172.21.15.78:0/2663037455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc009370 con 0x7f5be80aa0f0 2023-08-17T17:46:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be77fe700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80aa4d0 0x7f5be80c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5becbda700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be80c5810 0x7f5be80c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:20.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5be7fff700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa0f0 0x7f5be813e640 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f5bd800c650 tx=0x7f5bd8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:20.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5bcffff700 1 -- 172.21.15.78:0/2663037455 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8010580 con 0x7f5be80aa0f0 2023-08-17T17:46:20.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5bcffff700 1 -- 172.21.15.78:0/2663037455 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd80106e0 con 0x7f5be80aa0f0 2023-08-17T17:46:20.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5bee63d700 1 -- 172.21.15.78:0/2663037455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be80ab330 con 0x7f5be80aa0f0 2023-08-17T17:46:20.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5bcffff700 1 -- 172.21.15.78:0/2663037455 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8010a60 con 0x7f5be80aa0f0 2023-08-17T17:46:20.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.676+0000 7f5bee63d700 1 -- 172.21.15.78:0/2663037455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be813eb30 con 0x7f5be80aa0f0 2023-08-17T17:46:20.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.677+0000 7f5bee63d700 1 -- 172.21.15.78:0/2663037455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be8083980 con 0x7f5be80aa0f0 2023-08-17T17:46:20.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.677+0000 7f5bcffff700 1 -- 172.21.15.78:0/2663037455 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f5bd801b460 con 0x7f5be80aa0f0 2023-08-17T17:46:20.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.678+0000 7f5bcffff700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5bd405ee70 0x7f5bd4061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:20.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.678+0000 7f5bcffff700 1 -- 172.21.15.78:0/2663037455 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f5bd8079d90 con 0x7f5be80aa0f0 2023-08-17T17:46:20.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.678+0000 7f5be77fe700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5bd405ee70 0x7f5bd4061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:20.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.678+0000 7f5be77fe700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5bd405ee70 0x7f5bd4061330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5be80cade0 tx=0x7f5bdc017000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:20.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.682+0000 7f5bcffff700 1 -- 172.21.15.78:0/2663037455 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5bd804b1e0 con 0x7f5be80aa0f0 2023-08-17T17:46:20.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.873+0000 7f5bee63d700 1 -- 172.21.15.78:0/2663037455 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5be80abac0 con 0x7f5bd405ee70 2023-08-17T17:46:20.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.876+0000 7f5bcffff700 1 -- 172.21.15.78:0/2663037455 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f5bdc006b70 con 0x7f5bd405ee70 2023-08-17T17:46:20.877 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-08-17T17:46:20.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 -- 172.21.15.78:0/2663037455 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5bd405ee70 msgr2=0x7f5bd4061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5bd405ee70 0x7f5bd4061330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5be80cade0 tx=0x7f5bdc017000).stop 2023-08-17T17:46:20.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 -- 172.21.15.78:0/2663037455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa0f0 msgr2=0x7f5be813e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:20.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa0f0 0x7f5be813e640 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f5bd800c650 tx=0x7f5bd8008040).stop 2023-08-17T17:46:20.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 -- 172.21.15.78:0/2663037455 shutdown_connections 2023-08-17T17:46:20.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5bd405ee70 0x7f5bd4061330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be80c5810 0x7f5be80c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be80aa0f0 0x7f5be813e640 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 --2- 172.21.15.78:0/2663037455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be80aa4d0 0x7f5be80c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:20.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 -- 172.21.15.78:0/2663037455 >> 172.21.15.78:0/2663037455 conn(0x7f5be806a6a0 msgr2=0x7f5be81530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:20.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 -- 172.21.15.78:0/2663037455 shutdown_connections 2023-08-17T17:46:20.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:20.878+0000 7f5bee63d700 1 -- 172.21.15.78:0/2663037455 wait complete. 2023-08-17T17:46:20.890 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-08-17T17:46:20.891 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-08-17T17:46:21.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.008+0000 7fa4d31d3700 1 Processor -- start 2023-08-17T17:46:21.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.008+0000 7fa4d31d3700 1 -- start start 2023-08-17T17:46:21.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.009+0000 7fa4d31d3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa4cc0aa4d0 0x7fa4cc0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.009+0000 7fa4d31d3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc0649b0 con 0x7fa4cc0aa0f0 2023-08-17T17:46:21.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.009+0000 7fa4d31d3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc063420 con 0x7fa4cc0c5810 2023-08-17T17:46:21.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.009+0000 7fa4d31d3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4cc063700 con 0x7fa4cc0aa4d0 2023-08-17T17:46:21.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.009+0000 7fa4d0f6f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa4cc0aa0f0 0x7fa4cc0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37728/0 (socket says 172.21.15.78:37728) 2023-08-17T17:46:21.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.009+0000 7fa4d0f6f700 1 -- 172.21.15.78:0/3144177953 learned_addr learned my addr 172.21.15.78:0/3144177953 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:21.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.009+0000 7fa4cbfff700 1 --2- 172.21.15.78:0/3144177953 >> v2:172.21.15.150:3300/0 conn(0x7fa4cc0aa4d0 0x7fa4cc0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.009+0000 7fa4cb7fe700 1 -- 172.21.15.78:0/3144177953 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758697728 0 0) 0x7fa4cc0649b0 con 0x7fa4cc0aa0f0 2023-08-17T17:46:21.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.009+0000 7fa4cb7fe700 1 -- 172.21.15.78:0/3144177953 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4bc0033f0 con 0x7fa4cc0aa0f0 2023-08-17T17:46:21.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.009+0000 7fa4cb7fe700 1 -- 172.21.15.78:0/3144177953 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511341587 0 0) 0x7fa4cc063420 con 0x7fa4cc0c5810 2023-08-17T17:46:21.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4cb7fe700 1 -- 172.21.15.78:0/3144177953 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4cc0649b0 con 0x7fa4cc0c5810 2023-08-17T17:46:21.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4cb7fe700 1 -- 172.21.15.78:0/3144177953 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 374567550 0 0) 0x7fa4bc0033f0 con 0x7fa4cc0aa0f0 2023-08-17T17:46:21.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4cbfff700 1 -- 172.21.15.78:0/3144177953 >> v1:172.21.15.150:6789/0 conn(0x7fa4cc0c5810 legacy=0x7fa4cc0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4cbfff700 1 -- 172.21.15.78:0/3144177953 >> v1:172.21.15.78:6789/0 conn(0x7fa4cc0aa0f0 legacy=0x7fa4cc0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4cbfff700 1 -- 172.21.15.78:0/3144177953 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc0639e0 con 0x7fa4cc0aa4d0 2023-08-17T17:46:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4cbfff700 1 --2- 172.21.15.78:0/3144177953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4cc0aa4d0 0x7fa4cc0644c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fa4b8009760 tx=0x7fa4b8009060).ready entity=mon.1 client_cookie=7a7ab85c33d2661e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4cb7fe700 1 -- 172.21.15.78:0/3144177953 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0001470 con 0x7fa4cc0aa4d0 2023-08-17T17:46:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4cb7fe700 1 -- 172.21.15.78:0/3144177953 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8011400 con 0x7fa4cc0aa4d0 2023-08-17T17:46:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4cb7fe700 1 -- 172.21.15.78:0/3144177953 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8011780 con 0x7fa4cc0aa4d0 2023-08-17T17:46:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4d31d3700 1 -- 172.21.15.78:0/3144177953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4cc0aa4d0 msgr2=0x7fa4cc0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4d31d3700 1 --2- 172.21.15.78:0/3144177953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4cc0aa4d0 0x7fa4cc0644c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fa4b8009760 tx=0x7fa4b8009060).stop 2023-08-17T17:46:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4d31d3700 1 -- 172.21.15.78:0/3144177953 shutdown_connections 2023-08-17T17:46:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4d31d3700 1 --2- 172.21.15.78:0/3144177953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4cc0aa4d0 0x7fa4cc0644c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.010+0000 7fa4d31d3700 1 -- 172.21.15.78:0/3144177953 >> 172.21.15.78:0/3144177953 conn(0x7fa4cc06a6a0 msgr2=0x7fa4cc0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:21.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.011+0000 7fa4d31d3700 1 -- 172.21.15.78:0/3144177953 shutdown_connections 2023-08-17T17:46:21.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.011+0000 7fa4d31d3700 1 -- 172.21.15.78:0/3144177953 wait complete. 2023-08-17T17:46:21.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.012+0000 7fa4d31d3700 1 Processor -- start 2023-08-17T17:46:21.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.012+0000 7fa4d31d3700 1 -- start start 2023-08-17T17:46:21.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d31d3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4cc0aa0f0 0x7fa4cc153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d31d3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4cc0aa4d0 0x7fa4cc0c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d31d3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4cc0c5810 0x7fa4cc0c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d31d3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c21b0 con 0x7fa4cc0c5810 2023-08-17T17:46:21.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d31d3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c4890 con 0x7fa4cc0aa4d0 2023-08-17T17:46:21.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d31d3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c1b60 con 0x7fa4cc0aa0f0 2023-08-17T17:46:21.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d1770700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4cc0c5810 0x7fa4cc0c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d1770700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4cc0c5810 0x7fa4cc0c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54936/0 (socket says 172.21.15.78:54936) 2023-08-17T17:46:21.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d1770700 1 -- 172.21.15.78:0/4087577286 learned_addr learned my addr 172.21.15.78:0/4087577286 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:21.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4cbfff700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4cc0aa4d0 0x7fa4cc0c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d0f6f700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4cc0aa0f0 0x7fa4cc153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d1770700 1 -- 172.21.15.78:0/4087577286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4cc0aa0f0 msgr2=0x7fa4cc153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d1770700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4cc0aa0f0 0x7fa4cc153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d1770700 1 -- 172.21.15.78:0/4087577286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4cc0aa4d0 msgr2=0x7fa4cc0c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d1770700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4cc0aa4d0 0x7fa4cc0c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d1770700 1 -- 172.21.15.78:0/4087577286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80092a0 con 0x7fa4cc0c5810 2023-08-17T17:46:21.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4cbfff700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4cc0aa4d0 0x7fa4cc0c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:21.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d0f6f700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4cc0aa0f0 0x7fa4cc153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:21.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d1770700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4cc0c5810 0x7fa4cc0c2b30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fa4c400c7c0 tx=0x7fa4c400cb80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:21.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4c8ff9700 1 -- 172.21.15.78:0/4087577286 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4002020 con 0x7fa4cc0c5810 2023-08-17T17:46:21.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4c8ff9700 1 -- 172.21.15.78:0/4087577286 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c4002180 con 0x7fa4cc0c5810 2023-08-17T17:46:21.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d31d3700 1 -- 172.21.15.78:0/4087577286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc0c1e40 con 0x7fa4cc0c5810 2023-08-17T17:46:21.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4c8ff9700 1 -- 172.21.15.78:0/4087577286 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4001590 con 0x7fa4cc0c5810 2023-08-17T17:46:21.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.013+0000 7fa4d31d3700 1 -- 172.21.15.78:0/4087577286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc153f10 con 0x7fa4cc0c5810 2023-08-17T17:46:21.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.014+0000 7fa4d31d3700 1 -- 172.21.15.78:0/4087577286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4cc0c2320 con 0x7fa4cc0c5810 2023-08-17T17:46:21.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.015+0000 7fa4c8ff9700 1 -- 172.21.15.78:0/4087577286 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fa4c4018020 con 0x7fa4cc0c5810 2023-08-17T17:46:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.015+0000 7fa4c8ff9700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4b005ee70 0x7fa4b0061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.015+0000 7fa4c8ff9700 1 -- 172.21.15.78:0/4087577286 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa4c4079350 con 0x7fa4cc0c5810 2023-08-17T17:46:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.015+0000 7fa4d0f6f700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4b005ee70 0x7fa4b0061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.015+0000 7fa4d0f6f700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4b005ee70 0x7fa4b0061330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa4c0000c00 tx=0x7fa4c0009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.019+0000 7fa4c8ff9700 1 -- 172.21.15.78:0/4087577286 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa4c40488f0 con 0x7fa4cc0c5810 2023-08-17T17:46:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.210+0000 7fa4d31d3700 1 -- 172.21.15.78:0/4087577286 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4cc046af0 con 0x7fa4b005ee70 2023-08-17T17:46:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.213+0000 7fa4c8ff9700 1 -- 172.21.15.78:0/4087577286 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa4cc046af0 con 0x7fa4b005ee70 2023-08-17T17:46:21.214 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-08-17T17:46:21.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 -- 172.21.15.78:0/4087577286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4b005ee70 msgr2=0x7fa4b0061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4b005ee70 0x7fa4b0061330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa4c0000c00 tx=0x7fa4c0009040).stop 2023-08-17T17:46:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 -- 172.21.15.78:0/4087577286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4cc0c5810 msgr2=0x7fa4cc0c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4cc0c5810 0x7fa4cc0c2b30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fa4c400c7c0 tx=0x7fa4c400cb80).stop 2023-08-17T17:46:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 -- 172.21.15.78:0/4087577286 shutdown_connections 2023-08-17T17:46:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4b005ee70 0x7fa4b0061330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4cc0c5810 0x7fa4cc0c2b30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4cc0aa0f0 0x7fa4cc153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 --2- 172.21.15.78:0/4087577286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4cc0aa4d0 0x7fa4cc0c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 -- 172.21.15.78:0/4087577286 >> 172.21.15.78:0/4087577286 conn(0x7fa4cc06a6a0 msgr2=0x7fa4cc152df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 -- 172.21.15.78:0/4087577286 shutdown_connections 2023-08-17T17:46:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.215+0000 7fa4d31d3700 1 -- 172.21.15.78:0/4087577286 wait complete. 2023-08-17T17:46:21.227 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-08-17T17:46:21.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-08-17T17:46:21.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.345+0000 7f57c2338700 1 Processor -- start 2023-08-17T17:46:21.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.345+0000 7f57c2338700 1 -- start start 2023-08-17T17:46:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57c2338700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc151a40 0x7f57bc0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57c2338700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f57bc151e20 0x7f57bc0c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57c2338700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57bc0c6620 con 0x7f57bc157be0 2023-08-17T17:46:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57c2338700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57bc0c6900 con 0x7f57bc151e20 2023-08-17T17:46:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57c2338700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0c6be0 con 0x7f57bc151a40 2023-08-17T17:46:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57c1b37700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f57bc157be0 0x7f57bc154610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37730/0 (socket says 172.21.15.78:37730) 2023-08-17T17:46:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57c1b37700 1 -- 172.21.15.78:0/3860342429 learned_addr learned my addr 172.21.15.78:0/3860342429 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57c1336700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc151a40 0x7f57bc0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57c0b35700 1 --2- 172.21.15.78:0/3860342429 >> v2:172.21.15.150:3300/0 conn(0x7f57bc151e20 0x7f57bc0c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220392053 0 0) 0x7f57bc0c6620 con 0x7f57bc157be0 2023-08-17T17:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a80033f0 con 0x7f57bc157be0 2023-08-17T17:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737582286 0 0) 0x7f57a80033f0 con 0x7f57bc157be0 2023-08-17T17:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc151a40 msgr2=0x7f57bc0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc151a40 0x7f57bc0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 >> v2:172.21.15.150:3300/0 conn(0x7f57bc151e20 msgr2=0x7f57bc0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 --2- 172.21.15.78:0/3860342429 >> v2:172.21.15.150:3300/0 conn(0x7f57bc151e20 0x7f57bc0c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc0c6ec0 con 0x7f57bc157be0 2023-08-17T17:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f57b4001470 con 0x7f57bc157be0 2023-08-17T17:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 >> v1:172.21.15.78:6789/0 conn(0x7f57bc157be0 legacy=0x7f57bc154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 0x7f57a8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc151a40 0x7f57a8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57a8004b80 0x7f57a8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0c6900 con 0x7f57a80038e0 2023-08-17T17:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0c6be0 con 0x7f57a8004b80 2023-08-17T17:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a800b8e0 con 0x7f57bc151a40 2023-08-17T17:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.346+0000 7f57c1336700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 0x7f57a8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c0b35700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc151a40 0x7f57a8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c1b37700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57a8004b80 0x7f57a8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c1336700 1 -- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc151a40 msgr2=0x7f57a8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c1336700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc151a40 0x7f57a8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c1336700 1 -- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57a8004b80 msgr2=0x7f57a8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c1336700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57a8004b80 0x7f57a8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c1336700 1 -- 172.21.15.78:0/3860342429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80033f0 con 0x7f57a80038e0 2023-08-17T17:46:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c0b35700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc151a40 0x7f57a8004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c1336700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 0x7f57a8003d00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f57b800e210 tx=0x7f57b800b040).ready entity=mon.0 client_cookie=b5c301c25447d15b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8009b10 con 0x7f57a80038e0 2023-08-17T17:46:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b800f040 con 0x7f57a80038e0 2023-08-17T17:46:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57b3fff700 1 -- 172.21.15.78:0/3860342429 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800ece0 con 0x7f57a80038e0 2023-08-17T17:46:21.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c2338700 1 -- 172.21.15.78:0/3860342429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 msgr2=0x7f57a8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c2338700 1 --2- 172.21.15.78:0/3860342429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 0x7f57a8003d00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f57b800e210 tx=0x7f57b800b040).stop 2023-08-17T17:46:21.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.347+0000 7f57c1b37700 1 -- 172.21.15.78:0/3860342429 reap_dead start 2023-08-17T17:46:21.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.348+0000 7f57c2338700 1 -- 172.21.15.78:0/3860342429 shutdown_connections 2023-08-17T17:46:21.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.348+0000 7f57c2338700 1 -- 172.21.15.78:0/3860342429 >> 172.21.15.78:0/3860342429 conn(0x7f57bc0943b0 msgr2=0x7f57bc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:21.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.348+0000 7f57c2338700 1 -- 172.21.15.78:0/3860342429 shutdown_connections 2023-08-17T17:46:21.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.348+0000 7f57c2338700 1 -- 172.21.15.78:0/3860342429 wait complete. 2023-08-17T17:46:21.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.349+0000 7f57c2338700 1 Processor -- start 2023-08-17T17:46:21.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.349+0000 7f57c2338700 1 -- start start 2023-08-17T17:46:21.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c2338700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 0x7f57bc14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c2338700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57bc0ac350 0x7f57bc0ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c2338700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc159e00 0x7f57bc15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c2338700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0ae940 con 0x7f57a80038e0 2023-08-17T17:46:21.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c2338700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc152870 con 0x7f57bc0ac350 2023-08-17T17:46:21.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c2338700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0add30 con 0x7f57bc159e00 2023-08-17T17:46:21.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c1336700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 0x7f57bc14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c1336700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 0x7f57bc14c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54958/0 (socket says 172.21.15.78:54958) 2023-08-17T17:46:21.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c1336700 1 -- 172.21.15.78:0/1151144949 learned_addr learned my addr 172.21.15.78:0/1151144949 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:21.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c1336700 1 -- 172.21.15.78:0/1151144949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc159e00 msgr2=0x7f57bc15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c1336700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc159e00 0x7f57bc15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:21.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c1336700 1 -- 172.21.15.78:0/1151144949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57bc0ac350 msgr2=0x7f57bc0ac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c1336700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57bc0ac350 0x7f57bc0ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:21.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c1336700 1 -- 172.21.15.78:0/1151144949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc0ae010 con 0x7f57a80038e0 2023-08-17T17:46:21.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c1336700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 0x7f57bc14c7c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f57b800e800 tx=0x7f57b801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:21.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57b17fa700 1 -- 172.21.15.78:0/1151144949 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8013ba0 con 0x7f57a80038e0 2023-08-17T17:46:21.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57b17fa700 1 -- 172.21.15.78:0/1151144949 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8013d00 con 0x7f57a80038e0 2023-08-17T17:46:21.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c2338700 1 -- 172.21.15.78:0/1151144949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57bc0ae2f0 con 0x7f57a80038e0 2023-08-17T17:46:21.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57b17fa700 1 -- 172.21.15.78:0/1151144949 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8013e90 con 0x7f57a80038e0 2023-08-17T17:46:21.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.350+0000 7f57c2338700 1 -- 172.21.15.78:0/1151144949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc0accc0 con 0x7f57a80038e0 2023-08-17T17:46:21.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.351+0000 7f57c2338700 1 -- 172.21.15.78:0/1151144949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57bc082f90 con 0x7f57a80038e0 2023-08-17T17:46:21.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.352+0000 7f57b17fa700 1 -- 172.21.15.78:0/1151144949 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f57b802d070 con 0x7f57a80038e0 2023-08-17T17:46:21.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.352+0000 7f57b17fa700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57a005ee70 0x7f57a0061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.352+0000 7f57b17fa700 1 -- 172.21.15.78:0/1151144949 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f57b807b9c0 con 0x7f57a80038e0 2023-08-17T17:46:21.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.352+0000 7f57c0b35700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57a005ee70 0x7f57a0061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.352+0000 7f57c0b35700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57a005ee70 0x7f57a0061330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f57bc065360 tx=0x7f57ac008040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:21.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.356+0000 7f57b17fa700 1 -- 172.21.15.78:0/1151144949 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57b804ce70 con 0x7f57a80038e0 2023-08-17T17:46:21.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.548+0000 7f57c2338700 1 -- 172.21.15.78:0/1151144949 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f57bc0aea80 con 0x7f57a005ee70 2023-08-17T17:46:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.551+0000 7f57b17fa700 1 -- 172.21.15.78:0/1151144949 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f57ac00de90 con 0x7f57a005ee70 2023-08-17T17:46:21.551 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-08-17T17:46:21.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 -- 172.21.15.78:0/1151144949 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57a005ee70 msgr2=0x7f57a0061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57a005ee70 0x7f57a0061330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f57bc065360 tx=0x7f57ac008040).stop 2023-08-17T17:46:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 -- 172.21.15.78:0/1151144949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 msgr2=0x7f57bc14c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 0x7f57bc14c7c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f57b800e800 tx=0x7f57b801a000).stop 2023-08-17T17:46:21.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 -- 172.21.15.78:0/1151144949 shutdown_connections 2023-08-17T17:46:21.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57a005ee70 0x7f57a0061330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57bc159e00 0x7f57bc15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:21.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57a80038e0 0x7f57bc14c7c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 --2- 172.21.15.78:0/1151144949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57bc0ac350 0x7f57bc0ac7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 -- 172.21.15.78:0/1151144949 >> 172.21.15.78:0/1151144949 conn(0x7f57bc0943b0 msgr2=0x7f57bc158050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 -- 172.21.15.78:0/1151144949 shutdown_connections 2023-08-17T17:46:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.553+0000 7f57c2338700 1 -- 172.21.15.78:0/1151144949 wait complete. 2023-08-17T17:46:21.564 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-08-17T17:46:21.565 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-08-17T17:46:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.683+0000 7f0a03ff7700 1 Processor -- start 2023-08-17T17:46:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.683+0000 7f0a03ff7700 1 -- start start 2023-08-17T17:46:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a03ff7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09fc0c5f20 0x7f09fc0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a03ff7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc0649b0 con 0x7f09fc0aa4d0 2023-08-17T17:46:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a03ff7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc063420 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a03ff7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc063700 con 0x7f09fc0c5f20 2023-08-17T17:46:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a02594700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09fc0c5f20 0x7f09fc0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a01592700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f09fc0aa4d0 0x7f09fc0c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37736/0 (socket says 172.21.15.78:37736) 2023-08-17T17:46:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a01592700 1 -- 172.21.15.78:0/1939951554 learned_addr learned my addr 172.21.15.78:0/1939951554 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a02594700 1 -- 172.21.15.78:0/1939951554 >> v1:172.21.15.150:6789/0 conn(0x7f09fc0aa0f0 legacy=0x7f09fc0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a02594700 1 -- 172.21.15.78:0/1939951554 >> v1:172.21.15.78:6789/0 conn(0x7f09fc0aa4d0 legacy=0x7f09fc0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a02594700 1 -- 172.21.15.78:0/1939951554 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc0639e0 con 0x7f09fc0c5f20 2023-08-17T17:46:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.684+0000 7f0a02594700 1 --2- 172.21.15.78:0/1939951554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0c5f20 0x7f09fc0644c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f09ec009760 tx=0x7f09ec009060).ready entity=mon.0 client_cookie=105e1a1de291391d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.685+0000 7f0a00d91700 1 -- 172.21.15.78:0/1939951554 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00f510 con 0x7f09fc0c5f20 2023-08-17T17:46:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.685+0000 7f0a00d91700 1 -- 172.21.15.78:0/1939951554 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec00f670 con 0x7f09fc0c5f20 2023-08-17T17:46:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.685+0000 7f0a00d91700 1 -- 172.21.15.78:0/1939951554 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00f9f0 con 0x7f09fc0c5f20 2023-08-17T17:46:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.685+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1939951554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0c5f20 msgr2=0x7f09fc0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.685+0000 7f0a03ff7700 1 --2- 172.21.15.78:0/1939951554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0c5f20 0x7f09fc0644c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f09ec009760 tx=0x7f09ec009060).stop 2023-08-17T17:46:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.685+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1939951554 shutdown_connections 2023-08-17T17:46:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.685+0000 7f0a03ff7700 1 --2- 172.21.15.78:0/1939951554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0c5f20 0x7f09fc0644c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.685+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1939951554 >> 172.21.15.78:0/1939951554 conn(0x7f09fc06a6a0 msgr2=0x7f09fc0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.685+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1939951554 shutdown_connections 2023-08-17T17:46:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.685+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1939951554 wait complete. 2023-08-17T17:46:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.686+0000 7f0a03ff7700 1 Processor -- start 2023-08-17T17:46:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.686+0000 7f0a03ff7700 1 -- start start 2023-08-17T17:46:21.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a03ff7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0aa0f0 0x7f09fc13f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a03ff7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09fc0aa4d0 0x7f09fc0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a03ff7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0c5f20 0x7f09fc0af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a03ff7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0af9e0 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a03ff7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0ad860 con 0x7f09fc0c5f20 2023-08-17T17:46:21.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a03ff7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0c4a90 con 0x7f09fc0aa4d0 2023-08-17T17:46:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a01d93700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0aa0f0 0x7f09fc13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a01d93700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0aa0f0 0x7f09fc13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54972/0 (socket says 172.21.15.78:54972) 2023-08-17T17:46:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a01d93700 1 -- 172.21.15.78:0/1055949399 learned_addr learned my addr 172.21.15.78:0/1055949399 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a02594700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0c5f20 0x7f09fc0af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.687+0000 7f0a01592700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09fc0aa4d0 0x7f09fc0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f0a01d93700 1 -- 172.21.15.78:0/1055949399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09fc0aa4d0 msgr2=0x7f09fc0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f0a01d93700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09fc0aa4d0 0x7f09fc0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f0a01d93700 1 -- 172.21.15.78:0/1055949399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0c5f20 msgr2=0x7f09fc0af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f0a01d93700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0c5f20 0x7f09fc0af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f0a01d93700 1 -- 172.21.15.78:0/1055949399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec0092a0 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f0a01d93700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0aa0f0 0x7f09fc13f420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f09f400c4c0 tx=0x7f09f4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:21.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f09f9ffb700 1 -- 172.21.15.78:0/1055949399 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f400ce10 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f09f9ffb700 1 -- 172.21.15.78:0/1055949399 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f4001e90 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f09f9ffb700 1 -- 172.21.15.78:0/1055949399 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4007250 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1055949399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc0c3e80 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.688+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1055949399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc0c4440 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.689+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1055949399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc083980 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.689+0000 7f09f9ffb700 1 -- 172.21.15.78:0/1055949399 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f09f4010070 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.689+0000 7f09f9ffb700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09e805ee70 0x7f09e8061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:21.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.690+0000 7f09f9ffb700 1 -- 172.21.15.78:0/1055949399 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f09f40793a0 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.690+0000 7f0a01592700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09e805ee70 0x7f09e8061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:21.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.690+0000 7f0a01592700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09e805ee70 0x7f09e8061330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f09fc0b0d80 tx=0x7f09f0009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:21.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.694+0000 7f09f9ffb700 1 -- 172.21.15.78:0/1055949399 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09f404a850 con 0x7f09fc0aa0f0 2023-08-17T17:46:21.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.883+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1055949399 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f09fc046af0 con 0x7f09e805ee70 2023-08-17T17:46:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.886+0000 7f09f9ffb700 1 -- 172.21.15.78:0/1055949399 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f09fc046af0 con 0x7f09e805ee70 2023-08-17T17:46:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-08-17T17:46:21.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1055949399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09e805ee70 msgr2=0x7f09e8061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09e805ee70 0x7f09e8061330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f09fc0b0d80 tx=0x7f09f0009040).stop 2023-08-17T17:46:21.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1055949399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0aa0f0 msgr2=0x7f09fc13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:21.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0aa0f0 0x7f09fc13f420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f09f400c4c0 tx=0x7f09f4007e00).stop 2023-08-17T17:46:21.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1055949399 shutdown_connections 2023-08-17T17:46:21.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09e805ee70 0x7f09e8061330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0c5f20 0x7f09fc0af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09fc0aa0f0 0x7f09fc13f420 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 --2- 172.21.15.78:0/1055949399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09fc0aa4d0 0x7f09fc0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:21.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1055949399 >> 172.21.15.78:0/1055949399 conn(0x7f09fc06a6a0 msgr2=0x7f09fc0ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:21.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1055949399 shutdown_connections 2023-08-17T17:46:21.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:21.888+0000 7f0a03ff7700 1 -- 172.21.15.78:0/1055949399 wait complete. 2023-08-17T17:46:21.900 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-08-17T17:46:21.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:21.901 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-08-17T17:46:21.918 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:21.921 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:21.921 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_36_00_UTC', 'scheduled-2023-08-17-17_37_00_UTC', 'scheduled-2023-08-17-17_38_00_UTC', 'scheduled-2023-08-17-17_39_00_UTC', 'scheduled-2023-08-17-17_40_00_UTC', 'scheduled-2023-08-17-17_41_00_UTC', 'scheduled-2023-08-17-17_42_00_UTC', 'scheduled-2023-08-17-17_43_00_UTC', 'scheduled-2023-08-17-17_44_00_UTC', 'scheduled-2023-08-17-17_45_00_UTC', 'scheduled-2023-08-17-17_46_00_UTC'] 2023-08-17T17:46:21.922 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-08-17T17:46:22.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.074+0000 7f5822cd5700 1 Processor -- start 2023-08-17T17:46:22.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.074+0000 7f5822cd5700 1 -- start start 2023-08-17T17:46:22.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5822cd5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f581c0aa0f0 0x7f581c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5822cd5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0aa4d0 0x7f581c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5822cd5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581c0649b0 con 0x7f581c0c5810 2023-08-17T17:46:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5822cd5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581c063420 con 0x7f581c0aa0f0 2023-08-17T17:46:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5822cd5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c063700 con 0x7f581c0aa4d0 2023-08-17T17:46:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5820a71700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f581c0aa0f0 0x7f581c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5820a71700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f581c0aa0f0 0x7f581c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54988/0 (socket says 172.21.15.78:54988) 2023-08-17T17:46:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5820a71700 1 -- 172.21.15.78:0/3421463217 learned_addr learned my addr 172.21.15.78:0/3421463217 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f581bfff700 1 --2- 172.21.15.78:0/3421463217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0aa4d0 0x7f581c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5820a71700 1 -- 172.21.15.78:0/3421463217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0aa4d0 msgr2=0x7f581c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5820a71700 1 --2- 172.21.15.78:0/3421463217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0aa4d0 0x7f581c0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5820a71700 1 -- 172.21.15.78:0/3421463217 >> v1:172.21.15.150:6789/0 conn(0x7f581c0c5810 legacy=0x7f581c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f5820a71700 1 -- 172.21.15.78:0/3421463217 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c0639e0 con 0x7f581c0aa0f0 2023-08-17T17:46:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.075+0000 7f581bfff700 1 --2- 172.21.15.78:0/3421463217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0aa4d0 0x7f581c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:22.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f5820a71700 1 --2- 172.21.15.78:0/3421463217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa0f0 0x7f581c0644c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f580c006fd0 tx=0x7f580c0090f0).ready entity=mon.0 client_cookie=fe019edc40c9abc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:22.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f581b7fe700 1 -- 172.21.15.78:0/3421463217 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c00b600 con 0x7f581c0aa0f0 2023-08-17T17:46:22.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f581b7fe700 1 -- 172.21.15.78:0/3421463217 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c00b760 con 0x7f581c0aa0f0 2023-08-17T17:46:22.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f581b7fe700 1 -- 172.21.15.78:0/3421463217 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c00bae0 con 0x7f581c0aa0f0 2023-08-17T17:46:22.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f5822cd5700 1 -- 172.21.15.78:0/3421463217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa0f0 msgr2=0x7f581c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f5822cd5700 1 --2- 172.21.15.78:0/3421463217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa0f0 0x7f581c0644c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f580c006fd0 tx=0x7f580c0090f0).stop 2023-08-17T17:46:22.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f5822cd5700 1 -- 172.21.15.78:0/3421463217 shutdown_connections 2023-08-17T17:46:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f5822cd5700 1 --2- 172.21.15.78:0/3421463217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa0f0 0x7f581c0644c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f5822cd5700 1 --2- 172.21.15.78:0/3421463217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0aa4d0 0x7f581c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f5822cd5700 1 -- 172.21.15.78:0/3421463217 >> 172.21.15.78:0/3421463217 conn(0x7f581c06a6a0 msgr2=0x7f581c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f5822cd5700 1 -- 172.21.15.78:0/3421463217 shutdown_connections 2023-08-17T17:46:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.076+0000 7f5822cd5700 1 -- 172.21.15.78:0/3421463217 wait complete. 2023-08-17T17:46:22.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.077+0000 7f5822cd5700 1 Processor -- start 2023-08-17T17:46:22.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.077+0000 7f5822cd5700 1 -- start start 2023-08-17T17:46:22.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.078+0000 7f5822cd5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f581c0aa0f0 0x7f581c142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.078+0000 7f5822cd5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa4d0 0x7f581c0acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.078+0000 7f5822cd5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0c5810 0x7f581c164730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.078+0000 7f5822cd5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c165720 con 0x7f581c0aa4d0 2023-08-17T17:46:22.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.078+0000 7f5822cd5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c0ac730 con 0x7f581c0aa0f0 2023-08-17T17:46:22.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.078+0000 7f5822cd5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c165160 con 0x7f581c0c5810 2023-08-17T17:46:22.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.078+0000 7f581bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa4d0 0x7f581c0acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.078+0000 7f581bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa4d0 0x7f581c0acbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54992/0 (socket says 172.21.15.78:54992) 2023-08-17T17:46:22.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.078+0000 7f581bfff700 1 -- 172.21.15.78:0/2417336560 learned_addr learned my addr 172.21.15.78:0/2417336560 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:22.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f5820a71700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f581c0aa0f0 0x7f581c142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f5821272700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0c5810 0x7f581c164730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f581bfff700 1 -- 172.21.15.78:0/2417336560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0c5810 msgr2=0x7f581c164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f581bfff700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0c5810 0x7f581c164730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f581bfff700 1 -- 172.21.15.78:0/2417336560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f581c0aa0f0 msgr2=0x7f581c142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f581bfff700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f581c0aa0f0 0x7f581c142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f581bfff700 1 -- 172.21.15.78:0/2417336560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c009370 con 0x7f581c0aa4d0 2023-08-17T17:46:22.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f5820a71700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f581c0aa0f0 0x7f581c142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:22.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f581bfff700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa4d0 0x7f581c0acbc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f581000c880 tx=0x7f5810008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:22.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f5818ff9700 1 -- 172.21.15.78:0/2417336560 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810010580 con 0x7f581c0aa4d0 2023-08-17T17:46:22.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f5818ff9700 1 -- 172.21.15.78:0/2417336560 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58100106e0 con 0x7f581c0aa4d0 2023-08-17T17:46:22.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f5822cd5700 1 -- 172.21.15.78:0/2417336560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c165440 con 0x7f581c0aa4d0 2023-08-17T17:46:22.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f5818ff9700 1 -- 172.21.15.78:0/2417336560 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810010a60 con 0x7f581c0aa4d0 2023-08-17T17:46:22.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.079+0000 7f5822cd5700 1 -- 172.21.15.78:0/2417336560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c168a00 con 0x7f581c0aa4d0 2023-08-17T17:46:22.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.080+0000 7f5822cd5700 1 -- 172.21.15.78:0/2417336560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c168c20 con 0x7f581c0aa4d0 2023-08-17T17:46:22.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.080+0000 7f5818ff9700 1 -- 172.21.15.78:0/2417336560 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f581001b460 con 0x7f581c0aa4d0 2023-08-17T17:46:22.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.081+0000 7f5818ff9700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f580805eea0 0x7f5808061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.081+0000 7f5818ff9700 1 -- 172.21.15.78:0/2417336560 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f5810079f90 con 0x7f581c0aa4d0 2023-08-17T17:46:22.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.081+0000 7f5820a71700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f580805eea0 0x7f5808061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.081+0000 7f5820a71700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f580805eea0 0x7f5808061360 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f580c00b3c0 tx=0x7f580c017000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:22.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.085+0000 7f5818ff9700 1 -- 172.21.15.78:0/2417336560 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f581c168c20 con 0x7f581c0aa4d0 2023-08-17T17:46:22.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.272+0000 7f5822cd5700 1 -- 172.21.15.78:0/2417336560 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f581c168c20 con 0x7f580805eea0 2023-08-17T17:46:22.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.273+0000 7f5818ff9700 1 -- 172.21.15.78:0/2417336560 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f581c168c20 con 0x7f580805eea0 2023-08-17T17:46:22.274 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:22.274 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:23", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:22.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 -- 172.21.15.78:0/2417336560 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f580805eea0 msgr2=0x7f5808061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f580805eea0 0x7f5808061360 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f580c00b3c0 tx=0x7f580c017000).stop 2023-08-17T17:46:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 -- 172.21.15.78:0/2417336560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa4d0 msgr2=0x7f581c0acbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa4d0 0x7f581c0acbc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f581000c880 tx=0x7f5810008040).stop 2023-08-17T17:46:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 -- 172.21.15.78:0/2417336560 shutdown_connections 2023-08-17T17:46:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f580805eea0 0x7f5808061360 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f581c0c5810 0x7f581c164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f581c0aa0f0 0x7f581c142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 --2- 172.21.15.78:0/2417336560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f581c0aa4d0 0x7f581c0acbc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 -- 172.21.15.78:0/2417336560 >> 172.21.15.78:0/2417336560 conn(0x7f581c06a6a0 msgr2=0x7f581c0a8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:22.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 -- 172.21.15.78:0/2417336560 shutdown_connections 2023-08-17T17:46:22.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.275+0000 7f5822cd5700 1 -- 172.21.15.78:0/2417336560 wait complete. 2023-08-17T17:46:22.287 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:23", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:22.287 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:35:23', 'first': '2023-08-17T17:36:00', 'last': '2023-08-17T17:46:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-17T17:46:22.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:22.288 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-08-17T17:46:22.303 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:22.303 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:22.304 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:22.304 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:22.304 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:22.304 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:22.304 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:22.304 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:22.304 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:22.305 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:22.305 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:22.305 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_36_00_UTC', 'scheduled-2023-08-17-17_37_00_UTC', 'scheduled-2023-08-17-17_38_00_UTC', 'scheduled-2023-08-17-17_39_00_UTC', 'scheduled-2023-08-17-17_40_00_UTC', 'scheduled-2023-08-17-17_41_00_UTC', 'scheduled-2023-08-17-17_42_00_UTC', 'scheduled-2023-08-17-17_43_00_UTC', 'scheduled-2023-08-17-17_44_00_UTC', 'scheduled-2023-08-17-17_45_00_UTC', 'scheduled-2023-08-17-17_46_00_UTC'] 2023-08-17T17:46:22.306 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-08-17T17:46:22.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.464+0000 7fdc0565e700 1 Processor -- start 2023-08-17T17:46:22.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.464+0000 7fdc0565e700 1 -- start start 2023-08-17T17:46:22.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdc0565e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc000c7d90 0x7fdc000c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdc0565e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc000c9d70 0x7fdc000c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdc0565e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc000c71f0 con 0x7fdc000aa250 2023-08-17T17:46:22.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdc0565e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc000c10b0 con 0x7fdc000c9d70 2023-08-17T17:46:22.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdc0565e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000c8770 con 0x7fdc000c7d90 2023-08-17T17:46:22.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbff7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc000c9d70 0x7fdc000c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbff7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc000c9d70 0x7fdc000c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55004/0 (socket says 172.21.15.78:55004) 2023-08-17T17:46:22.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbff7fe700 1 -- 172.21.15.78:0/3255957416 learned_addr learned my addr 172.21.15.78:0/3255957416 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbf7fff700 1 --2- 172.21.15.78:0/3255957416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc000c7d90 0x7fdc000c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbff7fe700 1 -- 172.21.15.78:0/3255957416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc000c7d90 msgr2=0x7fdc000c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbff7fe700 1 --2- 172.21.15.78:0/3255957416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc000c7d90 0x7fdc000c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbff7fe700 1 -- 172.21.15.78:0/3255957416 >> v1:172.21.15.150:6789/0 conn(0x7fdc000aa250 legacy=0x7fdc000c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbff7fe700 1 -- 172.21.15.78:0/3255957416 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00154400 con 0x7fdc000c9d70 2023-08-17T17:46:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbff7fe700 1 --2- 172.21.15.78:0/3255957416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc000c9d70 0x7fdc000c0bc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fdbf8009f20 tx=0x7fdbf8009840).ready entity=mon.0 client_cookie=38ff348311a4f4a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbfe7fc700 1 -- 172.21.15.78:0/3255957416 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800e070 con 0x7fdc000c9d70 2023-08-17T17:46:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbfe7fc700 1 -- 172.21.15.78:0/3255957416 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf800ba40 con 0x7fdc000c9d70 2023-08-17T17:46:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.465+0000 7fdbfe7fc700 1 -- 172.21.15.78:0/3255957416 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800bdc0 con 0x7fdc000c9d70 2023-08-17T17:46:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.466+0000 7fdc0565e700 1 -- 172.21.15.78:0/3255957416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc000c9d70 msgr2=0x7fdc000c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.466+0000 7fdc0565e700 1 --2- 172.21.15.78:0/3255957416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc000c9d70 0x7fdc000c0bc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fdbf8009f20 tx=0x7fdbf8009840).stop 2023-08-17T17:46:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.466+0000 7fdc0565e700 1 -- 172.21.15.78:0/3255957416 shutdown_connections 2023-08-17T17:46:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.466+0000 7fdc0565e700 1 --2- 172.21.15.78:0/3255957416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc000c9d70 0x7fdc000c0bc0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.466+0000 7fdc0565e700 1 --2- 172.21.15.78:0/3255957416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc000c7d90 0x7fdc000c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.466+0000 7fdc0565e700 1 -- 172.21.15.78:0/3255957416 >> 172.21.15.78:0/3255957416 conn(0x7fdc000944f0 msgr2=0x7fdc0006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.466+0000 7fdc0565e700 1 -- 172.21.15.78:0/3255957416 shutdown_connections 2023-08-17T17:46:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.466+0000 7fdc0565e700 1 -- 172.21.15.78:0/3255957416 wait complete. 2023-08-17T17:46:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.467+0000 7fdc0565e700 1 Processor -- start 2023-08-17T17:46:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.467+0000 7fdc0565e700 1 -- start start 2023-08-17T17:46:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdc0565e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc000aa250 0x7fdc0015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdc0565e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc000c9d70 0x7fdc0015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdc0565e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00154990 0x7fdc00154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdc0565e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0015ad90 con 0x7fdc00154990 2023-08-17T17:46:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdc0565e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000af120 con 0x7fdc000c9d70 2023-08-17T17:46:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdc0565e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000aec90 con 0x7fdc000aa250 2023-08-17T17:46:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbff7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00154990 0x7fdc00154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbff7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00154990 0x7fdc00154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55010/0 (socket says 172.21.15.78:55010) 2023-08-17T17:46:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbff7fe700 1 -- 172.21.15.78:0/3847245569 learned_addr learned my addr 172.21.15.78:0/3847245569 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbfeffd700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc000aa250 0x7fdc0015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbf7fff700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc000c9d70 0x7fdc0015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbff7fe700 1 -- 172.21.15.78:0/3847245569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc000aa250 msgr2=0x7fdc0015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbff7fe700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc000aa250 0x7fdc0015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbff7fe700 1 -- 172.21.15.78:0/3847245569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc000c9d70 msgr2=0x7fdc0015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbff7fe700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc000c9d70 0x7fdc0015a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbff7fe700 1 -- 172.21.15.78:0/3847245569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8009ae0 con 0x7fdc00154990 2023-08-17T17:46:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbff7fe700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00154990 0x7fdc00154e10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fdbf800b6c0 tx=0x7fdbf8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbf6ffd700 1 -- 172.21.15.78:0/3847245569 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800bdc0 con 0x7fdc00154990 2023-08-17T17:46:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbf6ffd700 1 -- 172.21.15.78:0/3847245569 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf80092e0 con 0x7fdc00154990 2023-08-17T17:46:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdc0565e700 1 -- 172.21.15.78:0/3847245569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc000ae080 con 0x7fdc00154990 2023-08-17T17:46:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdbf6ffd700 1 -- 172.21.15.78:0/3847245569 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf801d6b0 con 0x7fdc00154990 2023-08-17T17:46:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.468+0000 7fdc0565e700 1 -- 172.21.15.78:0/3847245569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc000ae640 con 0x7fdc00154990 2023-08-17T17:46:22.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.469+0000 7fdc0565e700 1 -- 172.21.15.78:0/3847245569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0005f910 con 0x7fdc00154990 2023-08-17T17:46:22.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.470+0000 7fdbf6ffd700 1 -- 172.21.15.78:0/3847245569 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fdbf8024030 con 0x7fdc00154990 2023-08-17T17:46:22.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.470+0000 7fdbf6ffd700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdbe005ee40 0x7fdbe0061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.470+0000 7fdbf6ffd700 1 -- 172.21.15.78:0/3847245569 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fdbf807b2a0 con 0x7fdc00154990 2023-08-17T17:46:22.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.470+0000 7fdbfeffd700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdbe005ee40 0x7fdbe0061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.471+0000 7fdbfeffd700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdbe005ee40 0x7fdbe0061300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fdbf0007fd0 tx=0x7fdbf0007d70).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:22.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.474+0000 7fdbf6ffd700 1 -- 172.21.15.78:0/3847245569 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdbf804c750 con 0x7fdc00154990 2023-08-17T17:46:22.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.662+0000 7fdc0565e700 1 -- 172.21.15.78:0/3847245569 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc00155720 con 0x7fdbe005ee40 2023-08-17T17:46:22.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.663+0000 7fdbf6ffd700 1 -- 172.21.15.78:0/3847245569 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fdbf0002550 con 0x7fdbe005ee40 2023-08-17T17:46:22.663 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:22.663 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:24", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 -- 172.21.15.78:0/3847245569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdbe005ee40 msgr2=0x7fdbe0061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdbe005ee40 0x7fdbe0061300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fdbf0007fd0 tx=0x7fdbf0007d70).stop 2023-08-17T17:46:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 -- 172.21.15.78:0/3847245569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00154990 msgr2=0x7fdc00154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00154990 0x7fdc00154e10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fdbf800b6c0 tx=0x7fdbf8009840).stop 2023-08-17T17:46:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 -- 172.21.15.78:0/3847245569 shutdown_connections 2023-08-17T17:46:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdbe005ee40 0x7fdbe0061300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00154990 0x7fdc00154e10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc000aa250 0x7fdc0015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 --2- 172.21.15.78:0/3847245569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc000c9d70 0x7fdc0015a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 -- 172.21.15.78:0/3847245569 >> 172.21.15.78:0/3847245569 conn(0x7fdc000944f0 msgr2=0x7fdc000a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 -- 172.21.15.78:0/3847245569 shutdown_connections 2023-08-17T17:46:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.665+0000 7fdc0565e700 1 -- 172.21.15.78:0/3847245569 wait complete. 2023-08-17T17:46:22.677 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:24", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:22.677 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:35:24', 'first': '2023-08-17T17:36:00', 'last': '2023-08-17T17:46:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-17T17:46:22.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:22.678 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-08-17T17:46:22.693 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:22.693 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:22.694 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:22.694 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:22.694 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:22.694 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:22.694 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:22.694 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:22.694 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:22.694 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:22.695 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:22.695 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_36_00_UTC', 'scheduled-2023-08-17-17_37_00_UTC', 'scheduled-2023-08-17-17_38_00_UTC', 'scheduled-2023-08-17-17_39_00_UTC', 'scheduled-2023-08-17-17_40_00_UTC', 'scheduled-2023-08-17-17_41_00_UTC', 'scheduled-2023-08-17-17_42_00_UTC', 'scheduled-2023-08-17-17_43_00_UTC', 'scheduled-2023-08-17-17_44_00_UTC', 'scheduled-2023-08-17-17_45_00_UTC', 'scheduled-2023-08-17-17_46_00_UTC'] 2023-08-17T17:46:22.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-08-17T17:46:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.854+0000 7f496b26e700 1 Processor -- start 2023-08-17T17:46:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.854+0000 7f496b26e700 1 -- start start 2023-08-17T17:46:22.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496b26e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49640aa0f0 0x7f49640644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496b26e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 0x7f49640c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496b26e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f49640c5810 0x7f49640c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496b26e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49640649b0 con 0x7f49640aa0f0 2023-08-17T17:46:22.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496b26e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49640c6120 con 0x7f49640c5810 2023-08-17T17:46:22.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496b26e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4964063420 con 0x7f49640aa4d0 2023-08-17T17:46:22.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496900a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49640aa0f0 0x7f49640644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496900a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49640aa0f0 0x7f49640644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55024/0 (socket says 172.21.15.78:55024) 2023-08-17T17:46:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496900a700 1 -- 172.21.15.78:0/2461627581 learned_addr learned my addr 172.21.15.78:0/2461627581 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496980b700 1 --2- 172.21.15.78:0/2461627581 >> v2:172.21.15.150:3300/0 conn(0x7f49640c5810 0x7f49640c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f4968809700 1 --2- 172.21.15.78:0/2461627581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 0x7f49640c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496900a700 1 -- 172.21.15.78:0/2461627581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 msgr2=0x7f49640c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496900a700 1 --2- 172.21.15.78:0/2461627581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 0x7f49640c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496900a700 1 -- 172.21.15.78:0/2461627581 >> v2:172.21.15.150:3300/0 conn(0x7f49640c5810 msgr2=0x7f49640c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496900a700 1 --2- 172.21.15.78:0/2461627581 >> v2:172.21.15.150:3300/0 conn(0x7f49640c5810 0x7f49640c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496900a700 1 -- 172.21.15.78:0/2461627581 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4964063700 con 0x7f49640aa0f0 2023-08-17T17:46:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496980b700 1 --2- 172.21.15.78:0/2461627581 >> v2:172.21.15.150:3300/0 conn(0x7f49640c5810 0x7f49640c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f4968809700 1 --2- 172.21.15.78:0/2461627581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 0x7f49640c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f496900a700 1 --2- 172.21.15.78:0/2461627581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640aa0f0 0x7f49640644c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f4964159060 tx=0x7f49600090f0).ready entity=mon.0 client_cookie=fa51f9a44e7529f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f495bfff700 1 -- 172.21.15.78:0/2461627581 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496000b600 con 0x7f49640aa0f0 2023-08-17T17:46:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f495bfff700 1 -- 172.21.15.78:0/2461627581 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496000b760 con 0x7f49640aa0f0 2023-08-17T17:46:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.855+0000 7f495bfff700 1 -- 172.21.15.78:0/2461627581 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496000bae0 con 0x7f49640aa0f0 2023-08-17T17:46:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.856+0000 7f496b26e700 1 -- 172.21.15.78:0/2461627581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640aa0f0 msgr2=0x7f49640644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.856+0000 7f496b26e700 1 --2- 172.21.15.78:0/2461627581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640aa0f0 0x7f49640644c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f4964159060 tx=0x7f49600090f0).stop 2023-08-17T17:46:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.856+0000 7f496b26e700 1 -- 172.21.15.78:0/2461627581 shutdown_connections 2023-08-17T17:46:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.856+0000 7f496b26e700 1 --2- 172.21.15.78:0/2461627581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640aa0f0 0x7f49640644c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.856+0000 7f496b26e700 1 --2- 172.21.15.78:0/2461627581 >> v2:172.21.15.150:3300/0 conn(0x7f49640c5810 0x7f49640c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.856+0000 7f496b26e700 1 --2- 172.21.15.78:0/2461627581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 0x7f49640c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.856+0000 7f496b26e700 1 -- 172.21.15.78:0/2461627581 >> 172.21.15.78:0/2461627581 conn(0x7f496406a6a0 msgr2=0x7f49640caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:22.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.856+0000 7f496b26e700 1 -- 172.21.15.78:0/2461627581 shutdown_connections 2023-08-17T17:46:22.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.856+0000 7f496b26e700 1 -- 172.21.15.78:0/2461627581 wait complete. 2023-08-17T17:46:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.857+0000 7f496b26e700 1 Processor -- start 2023-08-17T17:46:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.857+0000 7f496b26e700 1 -- start start 2023-08-17T17:46:22.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496b26e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49640aa0f0 0x7f496413f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496b26e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 0x7f49640c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496b26e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640c5810 0x7f49640ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496b26e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640ca6e0 con 0x7f49640c5810 2023-08-17T17:46:22.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496b26e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640ade80 con 0x7f49640aa0f0 2023-08-17T17:46:22.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496b26e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640c28a0 con 0x7f49640aa4d0 2023-08-17T17:46:22.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496980b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640c5810 0x7f49640ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496980b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640c5810 0x7f49640ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55036/0 (socket says 172.21.15.78:55036) 2023-08-17T17:46:22.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496980b700 1 -- 172.21.15.78:0/903752778 learned_addr learned my addr 172.21.15.78:0/903752778 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:22.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496900a700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49640aa0f0 0x7f496413f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f4968809700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 0x7f49640c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496980b700 1 -- 172.21.15.78:0/903752778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 msgr2=0x7f49640c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496980b700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 0x7f49640c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496980b700 1 -- 172.21.15.78:0/903752778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49640aa0f0 msgr2=0x7f496413f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:22.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496980b700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49640aa0f0 0x7f496413f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:22.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.858+0000 7f496980b700 1 -- 172.21.15.78:0/903752778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960009370 con 0x7f49640c5810 2023-08-17T17:46:22.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.859+0000 7f496980b700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640c5810 0x7f49640ca1f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f495c00cef0 tx=0x7f495c007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:22.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.859+0000 7f49597fa700 1 -- 172.21.15.78:0/903752778 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00ad20 con 0x7f49640c5810 2023-08-17T17:46:22.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.859+0000 7f49597fa700 1 -- 172.21.15.78:0/903752778 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00ae80 con 0x7f49640c5810 2023-08-17T17:46:22.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.859+0000 7f496b26e700 1 -- 172.21.15.78:0/903752778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49640ae0d0 con 0x7f49640c5810 2023-08-17T17:46:22.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.859+0000 7f49597fa700 1 -- 172.21.15.78:0/903752778 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c016630 con 0x7f49640c5810 2023-08-17T17:46:22.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.859+0000 7f496b26e700 1 -- 172.21.15.78:0/903752778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49640ae690 con 0x7f49640c5810 2023-08-17T17:46:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.860+0000 7f496b26e700 1 -- 172.21.15.78:0/903752778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4964083980 con 0x7f49640c5810 2023-08-17T17:46:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.860+0000 7f49597fa700 1 -- 172.21.15.78:0/903752778 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f495c01d060 con 0x7f49640c5810 2023-08-17T17:46:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.860+0000 7f49597fa700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f494805ee70 0x7f4948061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.860+0000 7f49597fa700 1 -- 172.21.15.78:0/903752778 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f495c07a500 con 0x7f49640c5810 2023-08-17T17:46:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.860+0000 7f496900a700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f494805ee70 0x7f4948061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.861+0000 7f496900a700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f494805ee70 0x7f4948061330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4960009130 tx=0x7f4960017000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:22.864+0000 7f49597fa700 1 -- 172.21.15.78:0/903752778 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f495c04b9b0 con 0x7f49640c5810 2023-08-17T17:46:23.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.052+0000 7f496b26e700 1 -- 172.21.15.78:0/903752778 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49640cbd40 con 0x7f494805ee70 2023-08-17T17:46:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.053+0000 7f49597fa700 1 -- 172.21.15.78:0/903752778 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f49640cbd40 con 0x7f494805ee70 2023-08-17T17:46:23.054 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:23.054 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:24", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:23.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 -- 172.21.15.78:0/903752778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f494805ee70 msgr2=0x7f4948061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f494805ee70 0x7f4948061330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4960009130 tx=0x7f4960017000).stop 2023-08-17T17:46:23.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 -- 172.21.15.78:0/903752778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640c5810 msgr2=0x7f49640ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640c5810 0x7f49640ca1f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f495c00cef0 tx=0x7f495c007860).stop 2023-08-17T17:46:23.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 -- 172.21.15.78:0/903752778 shutdown_connections 2023-08-17T17:46:23.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f494805ee70 0x7f4948061330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640c5810 0x7f49640ca1f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49640aa0f0 0x7f496413f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 --2- 172.21.15.78:0/903752778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49640aa4d0 0x7f49640c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 -- 172.21.15.78:0/903752778 >> 172.21.15.78:0/903752778 conn(0x7f496406a6a0 msgr2=0x7f49640a8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:23.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 -- 172.21.15.78:0/903752778 shutdown_connections 2023-08-17T17:46:23.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.055+0000 7f496b26e700 1 -- 172.21.15.78:0/903752778 wait complete. 2023-08-17T17:46:23.067 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:24", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:23.067 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:35:24', 'first': '2023-08-17T17:36:00', 'last': '2023-08-17T17:46:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-17T17:46:23.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:23.068 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-08-17T17:46:23.083 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:23.083 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:23.083 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:23.083 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:23.083 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:23.083 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:23.084 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:23.084 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:23.084 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:23.084 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:23.084 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:23.085 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_36_00_UTC', 'scheduled-2023-08-17-17_37_00_UTC', 'scheduled-2023-08-17-17_38_00_UTC', 'scheduled-2023-08-17-17_39_00_UTC', 'scheduled-2023-08-17-17_40_00_UTC', 'scheduled-2023-08-17-17_41_00_UTC', 'scheduled-2023-08-17-17_42_00_UTC', 'scheduled-2023-08-17-17_43_00_UTC', 'scheduled-2023-08-17-17_44_00_UTC', 'scheduled-2023-08-17-17_45_00_UTC', 'scheduled-2023-08-17-17_46_00_UTC'] 2023-08-17T17:46:23.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-08-17T17:46:23.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.240+0000 7f5810e96700 1 Processor -- start 2023-08-17T17:46:23.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.240+0000 7f5810e96700 1 -- start start 2023-08-17T17:46:23.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5810e96700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f580c0aa4d0 0x7f580c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5810e96700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f580c0c5810 0x7f580c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5810e96700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580c0649b0 con 0x7f580c0aa0f0 2023-08-17T17:46:23.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5810e96700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580c0c6170 con 0x7f580c0aa4d0 2023-08-17T17:46:23.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5810e96700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580c063420 con 0x7f580c0c5810 2023-08-17T17:46:23.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5801d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f580c0aa4d0 0x7f580c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f580a59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f580c0aa0f0 0x7f580c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37746/0 (socket says 172.21.15.78:37746) 2023-08-17T17:46:23.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f580a59c700 1 -- 172.21.15.78:0/2207306348 learned_addr learned my addr 172.21.15.78:0/2207306348 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:23.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f580ad9d700 1 --2- 172.21.15.78:0/2207306348 >> v2:172.21.15.150:3300/0 conn(0x7f580c0c5810 0x7f580c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5801d9b700 1 -- 172.21.15.78:0/2207306348 >> v2:172.21.15.150:3300/0 conn(0x7f580c0c5810 msgr2=0x7f580c0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:23.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5801d9b700 1 --2- 172.21.15.78:0/2207306348 >> v2:172.21.15.150:3300/0 conn(0x7f580c0c5810 0x7f580c0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5801d9b700 1 -- 172.21.15.78:0/2207306348 >> v1:172.21.15.78:6789/0 conn(0x7f580c0aa0f0 legacy=0x7f580c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5809d9b700 1 -- 172.21.15.78:0/2207306348 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503804096 0 0) 0x7f580c0649b0 con 0x7f580c0aa0f0 2023-08-17T17:46:23.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5801d9b700 1 -- 172.21.15.78:0/2207306348 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c063700 con 0x7f580c0aa4d0 2023-08-17T17:46:23.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f580ad9d700 1 --2- 172.21.15.78:0/2207306348 >> v2:172.21.15.150:3300/0 conn(0x7f580c0c5810 0x7f580c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:23.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5801d9b700 1 --2- 172.21.15.78:0/2207306348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0aa4d0 0x7f580c0644c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f580c159090 tx=0x7f57f4009060).ready entity=mon.0 client_cookie=e138b3391e1db2a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:23.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5809d9b700 1 -- 172.21.15.78:0/2207306348 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f400b580 con 0x7f580c0aa4d0 2023-08-17T17:46:23.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5809d9b700 1 -- 172.21.15.78:0/2207306348 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f400b6e0 con 0x7f580c0aa4d0 2023-08-17T17:46:23.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.241+0000 7f5809d9b700 1 -- 172.21.15.78:0/2207306348 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f400ba60 con 0x7f580c0aa4d0 2023-08-17T17:46:23.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.242+0000 7f5810e96700 1 -- 172.21.15.78:0/2207306348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0aa4d0 msgr2=0x7f580c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.242+0000 7f5810e96700 1 --2- 172.21.15.78:0/2207306348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0aa4d0 0x7f580c0644c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f580c159090 tx=0x7f57f4009060).stop 2023-08-17T17:46:23.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.242+0000 7f5810e96700 1 -- 172.21.15.78:0/2207306348 shutdown_connections 2023-08-17T17:46:23.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.242+0000 7f5810e96700 1 --2- 172.21.15.78:0/2207306348 >> v2:172.21.15.150:3300/0 conn(0x7f580c0c5810 0x7f580c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.242+0000 7f5810e96700 1 --2- 172.21.15.78:0/2207306348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0aa4d0 0x7f580c0644c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.242+0000 7f5810e96700 1 -- 172.21.15.78:0/2207306348 >> 172.21.15.78:0/2207306348 conn(0x7f580c06a6a0 msgr2=0x7f580c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:23.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.242+0000 7f5810e96700 1 -- 172.21.15.78:0/2207306348 shutdown_connections 2023-08-17T17:46:23.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.242+0000 7f5810e96700 1 -- 172.21.15.78:0/2207306348 wait complete. 2023-08-17T17:46:23.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.243+0000 7f5810e96700 1 Processor -- start 2023-08-17T17:46:23.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.243+0000 7f5810e96700 1 -- start start 2023-08-17T17:46:23.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f5810e96700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f580c0aa0f0 0x7f580c151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f5810e96700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f580c0aa4d0 0x7f580c0c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f5810e96700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0c5810 0x7f580c0c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f5810e96700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0c4230 con 0x7f580c0c5810 2023-08-17T17:46:23.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f5810e96700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0ac410 con 0x7f580c0aa0f0 2023-08-17T17:46:23.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f5810e96700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0ab800 con 0x7f580c0aa4d0 2023-08-17T17:46:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f580ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0c5810 0x7f580c0c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f580ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0c5810 0x7f580c0c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55060/0 (socket says 172.21.15.78:55060) 2023-08-17T17:46:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f580ad9d700 1 -- 172.21.15.78:0/895357985 learned_addr learned my addr 172.21.15.78:0/895357985 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f5801d9b700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f580c0aa4d0 0x7f580c0c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f580a59c700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f580c0aa0f0 0x7f580c151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f580ad9d700 1 -- 172.21.15.78:0/895357985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f580c0aa4d0 msgr2=0x7f580c0c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f580ad9d700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f580c0aa4d0 0x7f580c0c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f580ad9d700 1 -- 172.21.15.78:0/895357985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f580c0aa0f0 msgr2=0x7f580c151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f580ad9d700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f580c0aa0f0 0x7f580c151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f580ad9d700 1 -- 172.21.15.78:0/895357985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f40092a0 con 0x7f580c0c5810 2023-08-17T17:46:23.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f5801d9b700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f580c0aa4d0 0x7f580c0c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.244+0000 7f580a59c700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f580c0aa0f0 0x7f580c151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.245+0000 7f580ad9d700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0c5810 0x7f580c0c3d40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f580400cf20 tx=0x7f5804007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.245+0000 7f5802ffd700 1 -- 172.21.15.78:0/895357985 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400adf0 con 0x7f580c0c5810 2023-08-17T17:46:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.245+0000 7f5802ffd700 1 -- 172.21.15.78:0/895357985 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5804016400 con 0x7f580c0c5810 2023-08-17T17:46:23.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.245+0000 7f5810e96700 1 -- 172.21.15.78:0/895357985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580c0abae0 con 0x7f580c0c5810 2023-08-17T17:46:23.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.245+0000 7f5802ffd700 1 -- 172.21.15.78:0/895357985 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804016780 con 0x7f580c0c5810 2023-08-17T17:46:23.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.245+0000 7f5810e96700 1 -- 172.21.15.78:0/895357985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c0ac0a0 con 0x7f580c0c5810 2023-08-17T17:46:23.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.246+0000 7f5810e96700 1 -- 172.21.15.78:0/895357985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c083980 con 0x7f580c0c5810 2023-08-17T17:46:23.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.246+0000 7f5802ffd700 1 -- 172.21.15.78:0/895357985 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f580401d060 con 0x7f580c0c5810 2023-08-17T17:46:23.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.246+0000 7f5802ffd700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57ec05ee70 0x7f57ec061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.246+0000 7f5802ffd700 1 -- 172.21.15.78:0/895357985 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f580407a2d0 con 0x7f580c0c5810 2023-08-17T17:46:23.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.246+0000 7f580a59c700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57ec05ee70 0x7f57ec061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.247+0000 7f580a59c700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57ec05ee70 0x7f57ec061330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f57fc001750 tx=0x7f57fc009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.250+0000 7f5802ffd700 1 -- 172.21.15.78:0/895357985 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f580404b780 con 0x7f580c0c5810 2023-08-17T17:46:23.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.436+0000 7f5810e96700 1 -- 172.21.15.78:0/895357985 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f580c0cbd40 con 0x7f57ec05ee70 2023-08-17T17:46:23.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.437+0000 7f5802ffd700 1 -- 172.21.15.78:0/895357985 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f580c0cbd40 con 0x7f57ec05ee70 2023-08-17T17:46:23.438 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:23.438 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:24", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 -- 172.21.15.78:0/895357985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57ec05ee70 msgr2=0x7f57ec061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57ec05ee70 0x7f57ec061330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f57fc001750 tx=0x7f57fc009040).stop 2023-08-17T17:46:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 -- 172.21.15.78:0/895357985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0c5810 msgr2=0x7f580c0c3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0c5810 0x7f580c0c3d40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f580400cf20 tx=0x7f5804007860).stop 2023-08-17T17:46:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 -- 172.21.15.78:0/895357985 shutdown_connections 2023-08-17T17:46:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57ec05ee70 0x7f57ec061330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580c0c5810 0x7f580c0c3d40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f580c0aa0f0 0x7f580c151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 --2- 172.21.15.78:0/895357985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f580c0aa4d0 0x7f580c0c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 -- 172.21.15.78:0/895357985 >> 172.21.15.78:0/895357985 conn(0x7f580c06a6a0 msgr2=0x7f580c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 -- 172.21.15.78:0/895357985 shutdown_connections 2023-08-17T17:46:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.439+0000 7f5810e96700 1 -- 172.21.15.78:0/895357985 wait complete. 2023-08-17T17:46:23.451 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:24", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:23.452 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:35:24', 'first': '2023-08-17T17:36:00', 'last': '2023-08-17T17:46:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-17T17:46:23.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:23.452 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-08-17T17:46:23.467 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:23.467 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:23.468 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:23.468 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:23.468 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:23.468 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:23.468 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:23.468 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:23.469 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:23.469 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:23.469 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:23.470 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_36_00_UTC', 'scheduled-2023-08-17-17_37_00_UTC', 'scheduled-2023-08-17-17_38_00_UTC', 'scheduled-2023-08-17-17_39_00_UTC', 'scheduled-2023-08-17-17_40_00_UTC', 'scheduled-2023-08-17-17_41_00_UTC', 'scheduled-2023-08-17-17_42_00_UTC', 'scheduled-2023-08-17-17_43_00_UTC', 'scheduled-2023-08-17-17_44_00_UTC', 'scheduled-2023-08-17-17_45_00_UTC', 'scheduled-2023-08-17-17_46_00_UTC'] 2023-08-17T17:46:23.470 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-08-17T17:46:23.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.626+0000 7fa01bfff700 1 Processor -- start 2023-08-17T17:46:23.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.626+0000 7fa01bfff700 1 -- start start 2023-08-17T17:46:23.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa01c151e20 0x7fa01c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa01c157be0 0x7fa01c158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01bfff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01c158520 con 0x7fa01c151a40 2023-08-17T17:46:23.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01bfff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c0c6620 con 0x7fa01c157be0 2023-08-17T17:46:23.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01bfff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c0c6900 con 0x7fa01c151e20 2023-08-17T17:46:23.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa01c157be0 0x7fa01c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01affd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa01c151a40 0x7fa01c0c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37754/0 (socket says 172.21.15.78:37754) 2023-08-17T17:46:23.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01affd700 1 -- 172.21.15.78:0/3733638180 learned_addr learned my addr 172.21.15.78:0/3733638180 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:23.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01a7fc700 1 --2- 172.21.15.78:0/3733638180 >> v2:172.21.15.150:3300/0 conn(0x7fa01c151e20 0x7fa01c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01b7fe700 1 -- 172.21.15.78:0/3733638180 >> v2:172.21.15.150:3300/0 conn(0x7fa01c151e20 msgr2=0x7fa01c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01b7fe700 1 --2- 172.21.15.78:0/3733638180 >> v2:172.21.15.150:3300/0 conn(0x7fa01c151e20 0x7fa01c0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01b7fe700 1 -- 172.21.15.78:0/3733638180 >> v1:172.21.15.78:6789/0 conn(0x7fa01c151a40 legacy=0x7fa01c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa019ffb700 1 -- 172.21.15.78:0/3733638180 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009702899 0 0) 0x7fa01c158520 con 0x7fa01c151a40 2023-08-17T17:46:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01b7fe700 1 -- 172.21.15.78:0/3733638180 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c0c6be0 con 0x7fa01c157be0 2023-08-17T17:46:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01a7fc700 1 --2- 172.21.15.78:0/3733638180 >> v2:172.21.15.150:3300/0 conn(0x7fa01c151e20 0x7fa01c0c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:23.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa01b7fe700 1 --2- 172.21.15.78:0/3733638180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 0x7fa01c158030 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fa01c065360 tx=0x7fa014009060).ready entity=mon.0 client_cookie=90366834870f5c25 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:23.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa019ffb700 1 -- 172.21.15.78:0/3733638180 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400b580 con 0x7fa01c157be0 2023-08-17T17:46:23.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa019ffb700 1 -- 172.21.15.78:0/3733638180 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01400b6e0 con 0x7fa01c157be0 2023-08-17T17:46:23.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.627+0000 7fa019ffb700 1 -- 172.21.15.78:0/3733638180 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400ba60 con 0x7fa01c157be0 2023-08-17T17:46:23.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.628+0000 7fa01bfff700 1 -- 172.21.15.78:0/3733638180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 msgr2=0x7fa01c158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.628+0000 7fa01bfff700 1 --2- 172.21.15.78:0/3733638180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 0x7fa01c158030 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fa01c065360 tx=0x7fa014009060).stop 2023-08-17T17:46:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.628+0000 7fa01bfff700 1 -- 172.21.15.78:0/3733638180 shutdown_connections 2023-08-17T17:46:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.628+0000 7fa01bfff700 1 --2- 172.21.15.78:0/3733638180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 0x7fa01c158030 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.628+0000 7fa01bfff700 1 --2- 172.21.15.78:0/3733638180 >> v2:172.21.15.150:3300/0 conn(0x7fa01c151e20 0x7fa01c0c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.628+0000 7fa01bfff700 1 -- 172.21.15.78:0/3733638180 >> 172.21.15.78:0/3733638180 conn(0x7fa01c0943b0 msgr2=0x7fa01c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.628+0000 7fa01bfff700 1 -- 172.21.15.78:0/3733638180 shutdown_connections 2023-08-17T17:46:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.628+0000 7fa01bfff700 1 -- 172.21.15.78:0/3733638180 wait complete. 2023-08-17T17:46:23.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.629+0000 7fa01bfff700 1 Processor -- start 2023-08-17T17:46:23.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.629+0000 7fa01bfff700 1 -- start start 2023-08-17T17:46:23.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa01c151a40 0x7fa01c1429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01c151e20 0x7fa01c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 0x7fa01c14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01bfff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c143ba0 con 0x7fa01c157be0 2023-08-17T17:46:23.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01bfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c142f90 con 0x7fa01c151e20 2023-08-17T17:46:23.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c143270 con 0x7fa01c151a40 2023-08-17T17:46:23.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 0x7fa01c14cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 0x7fa01c14cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55076/0 (socket says 172.21.15.78:55076) 2023-08-17T17:46:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01b7fe700 1 -- 172.21.15.78:0/3572748870 learned_addr learned my addr 172.21.15.78:0/3572748870 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01a7fc700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01c151e20 0x7fa01c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01affd700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa01c151a40 0x7fa01c1429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01b7fe700 1 -- 172.21.15.78:0/3572748870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa01c151a40 msgr2=0x7fa01c1429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01b7fe700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa01c151a40 0x7fa01c1429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01b7fe700 1 -- 172.21.15.78:0/3572748870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01c151e20 msgr2=0x7fa01c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01b7fe700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01c151e20 0x7fa01c1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01b7fe700 1 -- 172.21.15.78:0/3572748870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0140092a0 con 0x7fa01c157be0 2023-08-17T17:46:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01b7fe700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 0x7fa01c14cf90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fa014009fd0 tx=0x7fa014017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa012ffd700 1 -- 172.21.15.78:0/3572748870 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400b850 con 0x7fa01c157be0 2023-08-17T17:46:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa012ffd700 1 -- 172.21.15.78:0/3572748870 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01400b9b0 con 0x7fa01c157be0 2023-08-17T17:46:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa01bfff700 1 -- 172.21.15.78:0/3572748870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c143550 con 0x7fa01c157be0 2023-08-17T17:46:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.630+0000 7fa012ffd700 1 -- 172.21.15.78:0/3572748870 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01401b690 con 0x7fa01c157be0 2023-08-17T17:46:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.631+0000 7fa01bfff700 1 -- 172.21.15.78:0/3572748870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c1507b0 con 0x7fa01c157be0 2023-08-17T17:46:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.631+0000 7fa01bfff700 1 -- 172.21.15.78:0/3572748870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01c082f90 con 0x7fa01c157be0 2023-08-17T17:46:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.632+0000 7fa012ffd700 1 -- 172.21.15.78:0/3572748870 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fa01400f070 con 0x7fa01c157be0 2023-08-17T17:46:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.632+0000 7fa012ffd700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9ffc05ee40 0x7f9ffc061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.632+0000 7fa012ffd700 1 -- 172.21.15.78:0/3572748870 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa01407b490 con 0x7fa01c157be0 2023-08-17T17:46:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.632+0000 7fa01affd700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9ffc05ee40 0x7f9ffc061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.632+0000 7fa01affd700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9ffc05ee40 0x7f9ffc061300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa00c0016e0 tx=0x7fa00c009040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.636+0000 7fa012ffd700 1 -- 172.21.15.78:0/3572748870 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa01404c8e0 con 0x7fa01c157be0 2023-08-17T17:46:23.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.824+0000 7fa01bfff700 1 -- 172.21.15.78:0/3572748870 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa01c05f910 con 0x7f9ffc05ee40 2023-08-17T17:46:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.825+0000 7fa012ffd700 1 -- 172.21.15.78:0/3572748870 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fa01c05f910 con 0x7f9ffc05ee40 2023-08-17T17:46:23.826 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:23.826 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:25", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:23.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.827+0000 7fa01bfff700 1 -- 172.21.15.78:0/3572748870 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9ffc05ee40 msgr2=0x7f9ffc061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.827+0000 7fa01bfff700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9ffc05ee40 0x7f9ffc061300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa00c0016e0 tx=0x7fa00c009040).stop 2023-08-17T17:46:23.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.827+0000 7fa01bfff700 1 -- 172.21.15.78:0/3572748870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 msgr2=0x7fa01c14cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:23.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.827+0000 7fa01bfff700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 0x7fa01c14cf90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fa014009fd0 tx=0x7fa014017000).stop 2023-08-17T17:46:23.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.827+0000 7fa01bfff700 1 -- 172.21.15.78:0/3572748870 shutdown_connections 2023-08-17T17:46:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.827+0000 7fa01bfff700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9ffc05ee40 0x7f9ffc061300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.827+0000 7fa01bfff700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c157be0 0x7fa01c14cf90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.827+0000 7fa01bfff700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa01c151a40 0x7fa01c1429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.827+0000 7fa01bfff700 1 --2- 172.21.15.78:0/3572748870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa01c151e20 0x7fa01c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.827+0000 7fa01bfff700 1 -- 172.21.15.78:0/3572748870 >> 172.21.15.78:0/3572748870 conn(0x7fa01c0943b0 msgr2=0x7fa01c0c0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.828+0000 7fa01bfff700 1 -- 172.21.15.78:0/3572748870 shutdown_connections 2023-08-17T17:46:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:23.828+0000 7fa01bfff700 1 -- 172.21.15.78:0/3572748870 wait complete. 2023-08-17T17:46:23.839 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:25", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:23.839 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:35:25', 'first': '2023-08-17T17:36:00', 'last': '2023-08-17T17:46:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-17T17:46:23.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:23.840 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-08-17T17:46:23.855 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:23.855 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:23.855 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:23.855 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:23.856 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:23.856 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:23.856 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:23.856 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:23.856 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:23.856 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:23.856 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:23.857 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_36_00_UTC', 'scheduled-2023-08-17-17_37_00_UTC', 'scheduled-2023-08-17-17_38_00_UTC', 'scheduled-2023-08-17-17_39_00_UTC', 'scheduled-2023-08-17-17_40_00_UTC', 'scheduled-2023-08-17-17_41_00_UTC', 'scheduled-2023-08-17-17_42_00_UTC', 'scheduled-2023-08-17-17_43_00_UTC', 'scheduled-2023-08-17-17_44_00_UTC', 'scheduled-2023-08-17-17_45_00_UTC', 'scheduled-2023-08-17-17_46_00_UTC'] 2023-08-17T17:46:23.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-08-17T17:46:24.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.013+0000 7fb255707700 1 Processor -- start 2023-08-17T17:46:24.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.013+0000 7fb255707700 1 -- start start 2023-08-17T17:46:24.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.014+0000 7fb255707700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2500aa4d0 0x7fb2500644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.014+0000 7fb255707700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb2500c5810 0x7fb2500c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.014+0000 7fb255707700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2500649b0 con 0x7fb2500aa0f0 2023-08-17T17:46:24.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.014+0000 7fb255707700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2500c6150 con 0x7fb2500c5810 2023-08-17T17:46:24.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.014+0000 7fb255707700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb250063420 con 0x7fb2500aa4d0 2023-08-17T17:46:24.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.014+0000 7fb24effd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb2500aa0f0 0x7fb2500c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37756/0 (socket says 172.21.15.78:37756) 2023-08-17T17:46:24.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.014+0000 7fb24effd700 1 -- 172.21.15.78:0/87218543 learned_addr learned my addr 172.21.15.78:0/87218543 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:24.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24f7fe700 1 --2- 172.21.15.78:0/87218543 >> v2:172.21.15.150:3300/0 conn(0x7fb2500c5810 0x7fb2500c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb2467fc700 1 --2- 172.21.15.78:0/87218543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2500aa4d0 0x7fb2500644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24e7fc700 1 -- 172.21.15.78:0/87218543 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739762995 0 0) 0x7fb2500649b0 con 0x7fb2500aa0f0 2023-08-17T17:46:24.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24e7fc700 1 -- 172.21.15.78:0/87218543 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb23c0033f0 con 0x7fb2500aa0f0 2023-08-17T17:46:24.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24f7fe700 1 -- 172.21.15.78:0/87218543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2500aa4d0 msgr2=0x7fb2500644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:24.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24f7fe700 1 --2- 172.21.15.78:0/87218543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2500aa4d0 0x7fb2500644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24f7fe700 1 -- 172.21.15.78:0/87218543 >> v1:172.21.15.78:6789/0 conn(0x7fb2500aa0f0 legacy=0x7fb2500c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24e7fc700 1 -- 172.21.15.78:0/87218543 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1834510856 0 0) 0x7fb23c0033f0 con 0x7fb2500aa0f0 2023-08-17T17:46:24.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24f7fe700 1 -- 172.21.15.78:0/87218543 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250063700 con 0x7fb2500c5810 2023-08-17T17:46:24.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24f7fe700 1 --2- 172.21.15.78:0/87218543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2500c5810 0x7fb2500c5c60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb248009e60 tx=0x7fb248009780).ready entity=mon.1 client_cookie=dddf88b1859490e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:24.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24e7fc700 1 -- 172.21.15.78:0/87218543 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24800e070 con 0x7fb2500c5810 2023-08-17T17:46:24.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24e7fc700 1 -- 172.21.15.78:0/87218543 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24800b7a0 con 0x7fb2500c5810 2023-08-17T17:46:24.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.015+0000 7fb24e7fc700 1 -- 172.21.15.78:0/87218543 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240001470 con 0x7fb2500c5810 2023-08-17T17:46:24.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.016+0000 7fb255707700 1 -- 172.21.15.78:0/87218543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2500c5810 msgr2=0x7fb2500c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.016+0000 7fb255707700 1 --2- 172.21.15.78:0/87218543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2500c5810 0x7fb2500c5c60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb248009e60 tx=0x7fb248009780).stop 2023-08-17T17:46:24.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.016+0000 7fb255707700 1 -- 172.21.15.78:0/87218543 shutdown_connections 2023-08-17T17:46:24.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.016+0000 7fb255707700 1 --2- 172.21.15.78:0/87218543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2500c5810 0x7fb2500c5c60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.016+0000 7fb255707700 1 --2- 172.21.15.78:0/87218543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2500aa4d0 0x7fb2500644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.016+0000 7fb255707700 1 -- 172.21.15.78:0/87218543 >> 172.21.15.78:0/87218543 conn(0x7fb25006a6a0 msgr2=0x7fb2500caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.016+0000 7fb255707700 1 -- 172.21.15.78:0/87218543 shutdown_connections 2023-08-17T17:46:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.016+0000 7fb255707700 1 -- 172.21.15.78:0/87218543 wait complete. 2023-08-17T17:46:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.017+0000 7fb255707700 1 Processor -- start 2023-08-17T17:46:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.017+0000 7fb255707700 1 -- start start 2023-08-17T17:46:24.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb255707700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2500aa0f0 0x7fb2500ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb255707700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2500aa4d0 0x7fb250147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb255707700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2500c5810 0x7fb2500b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb255707700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500ac870 con 0x7fb2500c5810 2023-08-17T17:46:24.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb255707700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb250153d20 con 0x7fb2500aa0f0 2023-08-17T17:46:24.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb255707700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500abcf0 con 0x7fb2500aa4d0 2023-08-17T17:46:24.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb24f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2500c5810 0x7fb2500b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb24f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2500c5810 0x7fb2500b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55082/0 (socket says 172.21.15.78:55082) 2023-08-17T17:46:24.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb24f7fe700 1 -- 172.21.15.78:0/992195797 learned_addr learned my addr 172.21.15.78:0/992195797 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:24.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb24effd700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2500aa0f0 0x7fb2500ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb2467fc700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2500aa4d0 0x7fb250147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb24f7fe700 1 -- 172.21.15.78:0/992195797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2500aa4d0 msgr2=0x7fb250147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb24f7fe700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2500aa4d0 0x7fb250147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb24f7fe700 1 -- 172.21.15.78:0/992195797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2500aa0f0 msgr2=0x7fb2500ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb24f7fe700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2500aa0f0 0x7fb2500ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb24f7fe700 1 -- 172.21.15.78:0/992195797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb248009a20 con 0x7fb2500c5810 2023-08-17T17:46:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.018+0000 7fb24f7fe700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2500c5810 0x7fb2500b01a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fb24800b610 tx=0x7fb248009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.019+0000 7fb2477fe700 1 -- 172.21.15.78:0/992195797 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248009420 con 0x7fb2500c5810 2023-08-17T17:46:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.019+0000 7fb2477fe700 1 -- 172.21.15.78:0/992195797 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24801e430 con 0x7fb2500c5810 2023-08-17T17:46:24.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.019+0000 7fb255707700 1 -- 172.21.15.78:0/992195797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2500abfd0 con 0x7fb2500c5810 2023-08-17T17:46:24.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.019+0000 7fb2477fe700 1 -- 172.21.15.78:0/992195797 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24801e7d0 con 0x7fb2500c5810 2023-08-17T17:46:24.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.019+0000 7fb255707700 1 -- 172.21.15.78:0/992195797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2500ac590 con 0x7fb2500c5810 2023-08-17T17:46:24.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.019+0000 7fb255707700 1 -- 172.21.15.78:0/992195797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb250083980 con 0x7fb2500c5810 2023-08-17T17:46:24.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.020+0000 7fb2477fe700 1 -- 172.21.15.78:0/992195797 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fb24801ebc0 con 0x7fb2500c5810 2023-08-17T17:46:24.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.020+0000 7fb2477fe700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb23005ee70 0x7fb230061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.020+0000 7fb2477fe700 1 -- 172.21.15.78:0/992195797 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fb24807bf60 con 0x7fb2500c5810 2023-08-17T17:46:24.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.020+0000 7fb24effd700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb23005ee70 0x7fb230061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.021+0000 7fb24effd700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb23005ee70 0x7fb230061330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb240004bc0 tx=0x7fb240001680).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:24.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.024+0000 7fb2477fe700 1 -- 172.21.15.78:0/992195797 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2480aa8f0 con 0x7fb2500c5810 2023-08-17T17:46:24.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.210+0000 7fb255707700 1 -- 172.21.15.78:0/992195797 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2500629b0 con 0x7fb23005ee70 2023-08-17T17:46:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.211+0000 7fb2477fe700 1 -- 172.21.15.78:0/992195797 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fb2500629b0 con 0x7fb23005ee70 2023-08-17T17:46:24.211 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:24.212 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:25", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:24.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 -- 172.21.15.78:0/992195797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb23005ee70 msgr2=0x7fb230061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb23005ee70 0x7fb230061330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb240004bc0 tx=0x7fb240001680).stop 2023-08-17T17:46:24.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 -- 172.21.15.78:0/992195797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2500c5810 msgr2=0x7fb2500b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2500c5810 0x7fb2500b01a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fb24800b610 tx=0x7fb248009780).stop 2023-08-17T17:46:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 -- 172.21.15.78:0/992195797 shutdown_connections 2023-08-17T17:46:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb23005ee70 0x7fb230061330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2500c5810 0x7fb2500b01a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2500aa0f0 0x7fb2500ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 --2- 172.21.15.78:0/992195797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2500aa4d0 0x7fb250147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 -- 172.21.15.78:0/992195797 >> 172.21.15.78:0/992195797 conn(0x7fb25006a6a0 msgr2=0x7fb2500a8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 -- 172.21.15.78:0/992195797 shutdown_connections 2023-08-17T17:46:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.213+0000 7fb255707700 1 -- 172.21.15.78:0/992195797 wait complete. 2023-08-17T17:46:24.224 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:25", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:24.225 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:35:25', 'first': '2023-08-17T17:36:00', 'last': '2023-08-17T17:46:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-17T17:46:24.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:24.225 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-08-17T17:46:24.240 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:24.243 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_36_00_UTC', 'scheduled-2023-08-17-17_37_00_UTC', 'scheduled-2023-08-17-17_38_00_UTC', 'scheduled-2023-08-17-17_39_00_UTC', 'scheduled-2023-08-17-17_40_00_UTC', 'scheduled-2023-08-17-17_41_00_UTC', 'scheduled-2023-08-17-17_42_00_UTC', 'scheduled-2023-08-17-17_43_00_UTC', 'scheduled-2023-08-17-17_44_00_UTC', 'scheduled-2023-08-17-17_45_00_UTC', 'scheduled-2023-08-17-17_46_00_UTC'] 2023-08-17T17:46:24.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-08-17T17:46:24.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.399+0000 7f846d2a3700 1 Processor -- start 2023-08-17T17:46:24.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.399+0000 7f846d2a3700 1 -- start start 2023-08-17T17:46:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.399+0000 7f846d2a3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f84680aa0f0 0x7f84680644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.399+0000 7f846d2a3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84680649b0 con 0x7f84680c5810 2023-08-17T17:46:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.399+0000 7f846d2a3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8468063420 con 0x7f84680aa4d0 2023-08-17T17:46:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.399+0000 7f846d2a3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8468063700 con 0x7f84680aa0f0 2023-08-17T17:46:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f84677fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f84680c5810 0x7f84680a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37766/0 (socket says 172.21.15.78:37766) 2023-08-17T17:46:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f84677fe700 1 -- 172.21.15.78:0/3910799227 learned_addr learned my addr 172.21.15.78:0/3910799227 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8466ffd700 1 --2- 172.21.15.78:0/3910799227 >> v2:172.21.15.150:3300/0 conn(0x7f84680aa0f0 0x7f84680644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742030082 0 0) 0x7f84680649b0 con 0x7f84680c5810 2023-08-17T17:46:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84540033f0 con 0x7f84680c5810 2023-08-17T17:46:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4065470831 0 0) 0x7f84540033f0 con 0x7f84680c5810 2023-08-17T17:46:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 >> v2:172.21.15.150:3300/0 conn(0x7f84680aa0f0 msgr2=0x7f84680644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 --2- 172.21.15.78:0/3910799227 >> v2:172.21.15.150:3300/0 conn(0x7f84680aa0f0 0x7f84680644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 >> v1:172.21.15.150:6789/0 conn(0x7f84680aa4d0 legacy=0x7f84680c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680639e0 con 0x7f84680c5810 2023-08-17T17:46:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f8458001470 con 0x7f84680c5810 2023-08-17T17:46:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 >> v1:172.21.15.78:6789/0 conn(0x7f84680c5810 legacy=0x7f84680a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84540038e0 0x7f8454003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f8454004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8454005000 0x7f845400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8468063700 con 0x7f8454004690 2023-08-17T17:46:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845400beb0 con 0x7f8454005000 2023-08-17T17:46:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845400c070 con 0x7f84540038e0 2023-08-17T17:46:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f84667fc700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f8454004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f84677fe700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8454005000 0x7f845400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.400+0000 7f8466ffd700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84540038e0 0x7f8454003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f84667fc700 1 -- 172.21.15.78:0/3910799227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84540038e0 msgr2=0x7f8454003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f84667fc700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84540038e0 0x7f8454003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f84667fc700 1 -- 172.21.15.78:0/3910799227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8454005000 msgr2=0x7f845400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f84667fc700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8454005000 0x7f845400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f84667fc700 1 -- 172.21.15.78:0/3910799227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540033f0 con 0x7f8454004690 2023-08-17T17:46:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f84677fe700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8454005000 0x7f845400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f84677fe700 1 -- 172.21.15.78:0/3910799227 reap_dead start 2023-08-17T17:46:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f84667fc700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f8454004b10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f8450001700 tx=0x7f8450007bb0).ready entity=mon.0 client_cookie=40d6e665b605d2f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450007020 con 0x7f8454004690 2023-08-17T17:46:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8450007180 con 0x7f8454004690 2023-08-17T17:46:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f8465ffb700 1 -- 172.21.15.78:0/3910799227 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450007520 con 0x7f8454004690 2023-08-17T17:46:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f846d2a3700 1 -- 172.21.15.78:0/3910799227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 msgr2=0x7f8454004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f846d2a3700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f8454004b10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f8450001700 tx=0x7f8450007bb0).stop 2023-08-17T17:46:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f846d2a3700 1 -- 172.21.15.78:0/3910799227 shutdown_connections 2023-08-17T17:46:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f846d2a3700 1 --2- 172.21.15.78:0/3910799227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f8454004b10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f846d2a3700 1 -- 172.21.15.78:0/3910799227 >> 172.21.15.78:0/3910799227 conn(0x7f846806a6a0 msgr2=0x7f84680caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f846d2a3700 1 -- 172.21.15.78:0/3910799227 shutdown_connections 2023-08-17T17:46:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.401+0000 7f846d2a3700 1 -- 172.21.15.78:0/3910799227 wait complete. 2023-08-17T17:46:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.403+0000 7f846d2a3700 1 Processor -- start 2023-08-17T17:46:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.403+0000 7f846d2a3700 1 -- start start 2023-08-17T17:46:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.403+0000 7f846d2a3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f84680acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.403+0000 7f846d2a3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8468153ce0 0x7f84680afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.403+0000 7f846d2a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84680b0380 0x7f8468158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.403+0000 7f846d2a3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680ac960 con 0x7f8454004690 2023-08-17T17:46:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.403+0000 7f846d2a3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680b0800 con 0x7f8468153ce0 2023-08-17T17:46:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.403+0000 7f846d2a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680abd50 con 0x7f84680b0380 2023-08-17T17:46:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.403+0000 7f8466ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f84680acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.403+0000 7f8466ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f84680acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55094/0 (socket says 172.21.15.78:55094) 2023-08-17T17:46:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f8466ffd700 1 -- 172.21.15.78:0/2007898511 learned_addr learned my addr 172.21.15.78:0/2007898511 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f84667fc700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8468153ce0 0x7f84680afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f84677fe700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84680b0380 0x7f8468158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f8466ffd700 1 -- 172.21.15.78:0/2007898511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84680b0380 msgr2=0x7f8468158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f8466ffd700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84680b0380 0x7f8468158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f8466ffd700 1 -- 172.21.15.78:0/2007898511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8468153ce0 msgr2=0x7f84680afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f8466ffd700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8468153ce0 0x7f84680afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f8466ffd700 1 -- 172.21.15.78:0/2007898511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680ac030 con 0x7f8454004690 2023-08-17T17:46:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f84667fc700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8468153ce0 0x7f84680afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f8466ffd700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f84680acdf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f84600115b0 tx=0x7f846000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f845effd700 1 -- 172.21.15.78:0/2007898511 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000e030 con 0x7f8454004690 2023-08-17T17:46:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f845effd700 1 -- 172.21.15.78:0/2007898511 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84600153f0 con 0x7f8454004690 2023-08-17T17:46:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f846d2a3700 1 -- 172.21.15.78:0/2007898511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84680ac310 con 0x7f8454004690 2023-08-17T17:46:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f845effd700 1 -- 172.21.15.78:0/2007898511 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460015770 con 0x7f8454004690 2023-08-17T17:46:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.404+0000 7f846d2a3700 1 -- 172.21.15.78:0/2007898511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8468154160 con 0x7f8454004690 2023-08-17T17:46:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.405+0000 7f846d2a3700 1 -- 172.21.15.78:0/2007898511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84680ac7b0 con 0x7f8454004690 2023-08-17T17:46:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.405+0000 7f845effd700 1 -- 172.21.15.78:0/2007898511 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f8460015b60 con 0x7f8454004690 2023-08-17T17:46:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.406+0000 7f845effd700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f844805eea0 0x7f8448061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.406+0000 7f845effd700 1 -- 172.21.15.78:0/2007898511 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f846000f070 con 0x7f8454004690 2023-08-17T17:46:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.406+0000 7f84667fc700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f844805eea0 0x7f8448061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.406+0000 7f84667fc700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f844805eea0 0x7f8448061360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f846815b400 tx=0x7f8450016000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.410+0000 7f845effd700 1 -- 172.21.15.78:0/2007898511 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f846004bf10 con 0x7f8454004690 2023-08-17T17:46:24.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.599+0000 7f846d2a3700 1 -- 172.21.15.78:0/2007898511 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84680acaa0 con 0x7f844805eea0 2023-08-17T17:46:24.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.600+0000 7f845effd700 1 -- 172.21.15.78:0/2007898511 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f8450000ce0 con 0x7f844805eea0 2023-08-17T17:46:24.600 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:24.601 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:26", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:24.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 -- 172.21.15.78:0/2007898511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f844805eea0 msgr2=0x7f8448061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f844805eea0 0x7f8448061360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f846815b400 tx=0x7f8450016000).stop 2023-08-17T17:46:24.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 -- 172.21.15.78:0/2007898511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 msgr2=0x7f84680acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f84680acdf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f84600115b0 tx=0x7f846000b040).stop 2023-08-17T17:46:24.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 -- 172.21.15.78:0/2007898511 shutdown_connections 2023-08-17T17:46:24.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f844805eea0 0x7f8448061360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84680b0380 0x7f8468158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8454004690 0x7f84680acdf0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 --2- 172.21.15.78:0/2007898511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8468153ce0 0x7f84680afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 -- 172.21.15.78:0/2007898511 >> 172.21.15.78:0/2007898511 conn(0x7f846806a6a0 msgr2=0x7f84680a9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:24.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 -- 172.21.15.78:0/2007898511 shutdown_connections 2023-08-17T17:46:24.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.602+0000 7f846d2a3700 1 -- 172.21.15.78:0/2007898511 wait complete. 2023-08-17T17:46:24.614 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:26", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:24.614 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:35:26', 'first': '2023-08-17T17:36:00', 'last': '2023-08-17T17:46:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-17T17:46:24.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:24.615 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-08-17T17:46:24.630 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:24.630 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:24.630 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:24.632 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_36_00_UTC', 'scheduled-2023-08-17-17_37_00_UTC', 'scheduled-2023-08-17-17_38_00_UTC', 'scheduled-2023-08-17-17_39_00_UTC', 'scheduled-2023-08-17-17_40_00_UTC', 'scheduled-2023-08-17-17_41_00_UTC', 'scheduled-2023-08-17-17_42_00_UTC', 'scheduled-2023-08-17-17_43_00_UTC', 'scheduled-2023-08-17-17_44_00_UTC', 'scheduled-2023-08-17-17_45_00_UTC', 'scheduled-2023-08-17-17_46_00_UTC'] 2023-08-17T17:46:24.632 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-08-17T17:46:24.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.785+0000 7f2090a10700 1 Processor -- start 2023-08-17T17:46:24.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.785+0000 7f2090a10700 1 -- start start 2023-08-17T17:46:24.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.786+0000 7f2090a10700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f208c151e20 0x7f208c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.786+0000 7f2090a10700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c157be0 0x7f208c158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.786+0000 7f2090a10700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208c158560 con 0x7f208c151a40 2023-08-17T17:46:24.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.786+0000 7f2090a10700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208c0c6620 con 0x7f208c151e20 2023-08-17T17:46:24.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.786+0000 7f2090a10700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0c6900 con 0x7f208c157be0 2023-08-17T17:46:24.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.786+0000 7f2083fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f208c151e20 0x7f208c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.786+0000 7f208ad9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f208c151a40 0x7f208c0c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37770/0 (socket says 172.21.15.78:37770) 2023-08-17T17:46:24.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.786+0000 7f208ad9d700 1 -- 172.21.15.78:0/1243005500 learned_addr learned my addr 172.21.15.78:0/1243005500 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:24.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f2083fff700 1 -- 172.21.15.78:0/1243005500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c157be0 msgr2=0x7f208c158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:24.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f208b59e700 1 --2- 172.21.15.78:0/1243005500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c157be0 0x7f208c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f2083fff700 1 --2- 172.21.15.78:0/1243005500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c157be0 0x7f208c158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f2083fff700 1 -- 172.21.15.78:0/1243005500 >> v1:172.21.15.78:6789/0 conn(0x7f208c151a40 legacy=0x7f208c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f208a59c700 1 -- 172.21.15.78:0/1243005500 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249050444 0 0) 0x7f208c158560 con 0x7f208c151a40 2023-08-17T17:46:24.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f2083fff700 1 -- 172.21.15.78:0/1243005500 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c0c6be0 con 0x7f208c151e20 2023-08-17T17:46:24.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f208b59e700 1 --2- 172.21.15.78:0/1243005500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c157be0 0x7f208c158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:24.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f2083fff700 1 --2- 172.21.15.78:0/1243005500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151e20 0x7f208c0c8260 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f2074006fd0 tx=0x7f2074006f40).ready entity=mon.0 client_cookie=67accc62648b2e90 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:24.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f208a59c700 1 -- 172.21.15.78:0/1243005500 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074005880 con 0x7f208c151e20 2023-08-17T17:46:24.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f208a59c700 1 -- 172.21.15.78:0/1243005500 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20740059e0 con 0x7f208c151e20 2023-08-17T17:46:24.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f208a59c700 1 -- 172.21.15.78:0/1243005500 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074005d60 con 0x7f208c151e20 2023-08-17T17:46:24.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f2090a10700 1 -- 172.21.15.78:0/1243005500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151e20 msgr2=0x7f208c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f2090a10700 1 --2- 172.21.15.78:0/1243005500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151e20 0x7f208c0c8260 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f2074006fd0 tx=0x7f2074006f40).stop 2023-08-17T17:46:24.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f2090a10700 1 -- 172.21.15.78:0/1243005500 shutdown_connections 2023-08-17T17:46:24.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f2090a10700 1 --2- 172.21.15.78:0/1243005500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c157be0 0x7f208c158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.787+0000 7f2090a10700 1 --2- 172.21.15.78:0/1243005500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151e20 0x7f208c0c8260 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.788+0000 7f2090a10700 1 -- 172.21.15.78:0/1243005500 >> 172.21.15.78:0/1243005500 conn(0x7f208c0943b0 msgr2=0x7f208c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:24.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.788+0000 7f2090a10700 1 -- 172.21.15.78:0/1243005500 shutdown_connections 2023-08-17T17:46:24.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.788+0000 7f2090a10700 1 -- 172.21.15.78:0/1243005500 wait complete. 2023-08-17T17:46:24.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.789+0000 7f2090a10700 1 Processor -- start 2023-08-17T17:46:24.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.789+0000 7f2090a10700 1 -- start start 2023-08-17T17:46:24.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.789+0000 7f2090a10700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151a40 0x7f208c152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.789+0000 7f2090a10700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c151e20 0x7f208c14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.789+0000 7f2090a10700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c157be0 0x7f208c150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.789+0000 7f2090a10700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0af670 con 0x7f208c151a40 2023-08-17T17:46:24.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.789+0000 7f2090a10700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0a9be0 con 0x7f208c157be0 2023-08-17T17:46:24.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.789+0000 7f2090a10700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0aed40 con 0x7f208c151e20 2023-08-17T17:46:24.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f208ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151a40 0x7f208c152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f208ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151a40 0x7f208c152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55104/0 (socket says 172.21.15.78:55104) 2023-08-17T17:46:24.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f208ad9d700 1 -- 172.21.15.78:0/3306419944 learned_addr learned my addr 172.21.15.78:0/3306419944 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:24.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f2083fff700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c151e20 0x7f208c14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f208ad9d700 1 -- 172.21.15.78:0/3306419944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c151e20 msgr2=0x7f208c14fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f208ad9d700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c151e20 0x7f208c14fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f208b59e700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c157be0 0x7f208c150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f208ad9d700 1 -- 172.21.15.78:0/3306419944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c157be0 msgr2=0x7f208c150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f208ad9d700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c157be0 0x7f208c150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f208ad9d700 1 -- 172.21.15.78:0/3306419944 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2074009250 con 0x7f208c151a40 2023-08-17T17:46:24.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f208ad9d700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151a40 0x7f208c152220 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f207c00c490 tx=0x7f207c007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:24.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f2082ffd700 1 -- 172.21.15.78:0/3306419944 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c0072e0 con 0x7f208c151a40 2023-08-17T17:46:24.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f2082ffd700 1 -- 172.21.15.78:0/3306419944 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c007440 con 0x7f208c151a40 2023-08-17T17:46:24.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f2090a10700 1 -- 172.21.15.78:0/3306419944 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208c0af020 con 0x7f208c151a40 2023-08-17T17:46:24.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f2082ffd700 1 -- 172.21.15.78:0/3306419944 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c005880 con 0x7f208c151a40 2023-08-17T17:46:24.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.790+0000 7f2090a10700 1 -- 172.21.15.78:0/3306419944 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c152710 con 0x7f208c151a40 2023-08-17T17:46:24.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.791+0000 7f2090a10700 1 -- 172.21.15.78:0/3306419944 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208c082f90 con 0x7f208c151a40 2023-08-17T17:46:24.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.791+0000 7f2082ffd700 1 -- 172.21.15.78:0/3306419944 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f207c010070 con 0x7f208c151a40 2023-08-17T17:46:24.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.792+0000 7f2082ffd700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f206c05ee70 0x7f206c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:24.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.792+0000 7f2082ffd700 1 -- 172.21.15.78:0/3306419944 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f207c079200 con 0x7f208c151a40 2023-08-17T17:46:24.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.792+0000 7f2083fff700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f206c05ee70 0x7f206c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:24.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.792+0000 7f2083fff700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f206c05ee70 0x7f206c061330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2074009fd0 tx=0x7f2074016000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:24.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.796+0000 7f2082ffd700 1 -- 172.21.15.78:0/3306419944 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f207c04a650 con 0x7f208c151a40 2023-08-17T17:46:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.981+0000 7f2090a10700 1 -- 172.21.15.78:0/3306419944 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f208c0af7b0 con 0x7f206c05ee70 2023-08-17T17:46:24.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.982+0000 7f2082ffd700 1 -- 172.21.15.78:0/3306419944 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f2074005cf0 con 0x7f206c05ee70 2023-08-17T17:46:24.982 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:24.983 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:26", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 -- 172.21.15.78:0/3306419944 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f206c05ee70 msgr2=0x7f206c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f206c05ee70 0x7f206c061330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2074009fd0 tx=0x7f2074016000).stop 2023-08-17T17:46:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 -- 172.21.15.78:0/3306419944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151a40 msgr2=0x7f208c152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151a40 0x7f208c152220 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f207c00c490 tx=0x7f207c007d00).stop 2023-08-17T17:46:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 -- 172.21.15.78:0/3306419944 shutdown_connections 2023-08-17T17:46:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f206c05ee70 0x7f206c061330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c157be0 0x7f208c150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f208c151a40 0x7f208c152220 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 --2- 172.21.15.78:0/3306419944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f208c151e20 0x7f208c14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:24.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 -- 172.21.15.78:0/3306419944 >> 172.21.15.78:0/3306419944 conn(0x7f208c0943b0 msgr2=0x7f208c150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:24.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 -- 172.21.15.78:0/3306419944 shutdown_connections 2023-08-17T17:46:24.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:24.984+0000 7f2090a10700 1 -- 172.21.15.78:0/3306419944 wait complete. 2023-08-17T17:46:24.996 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:26", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:24.996 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:35:26', 'first': '2023-08-17T17:36:00', 'last': '2023-08-17T17:46:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-17T17:46:24.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:24.997 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-08-17T17:46:25.013 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:25.013 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:25.013 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:25.013 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:25.014 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:25.014 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:25.014 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:25.014 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:25.014 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:25.014 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:25.014 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:25.015 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_36_00_UTC', 'scheduled-2023-08-17-17_37_00_UTC', 'scheduled-2023-08-17-17_38_00_UTC', 'scheduled-2023-08-17-17_39_00_UTC', 'scheduled-2023-08-17-17_40_00_UTC', 'scheduled-2023-08-17-17_41_00_UTC', 'scheduled-2023-08-17-17_42_00_UTC', 'scheduled-2023-08-17-17_43_00_UTC', 'scheduled-2023-08-17-17_44_00_UTC', 'scheduled-2023-08-17-17_45_00_UTC', 'scheduled-2023-08-17-17_46_00_UTC'] 2023-08-17T17:46:25.015 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-08-17T17:46:25.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.168+0000 7f2a2b8d7700 1 Processor -- start 2023-08-17T17:46:25.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.169+0000 7f2a2b8d7700 1 -- start start 2023-08-17T17:46:25.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.169+0000 7f2a2b8d7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2a2414e680 0x7f2a240c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.169+0000 7f2a2b8d7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a2414ea60 0x7f2a240c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.169+0000 7f2a2b8d7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a24069310 0x7f2a240697a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.169+0000 7f2a2b8d7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a240c5990 con 0x7f2a2414ea60 2023-08-17T17:46:25.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.169+0000 7f2a2b8d7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a240bcc10 con 0x7f2a2414e680 2023-08-17T17:46:25.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.169+0000 7f2a2b8d7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24069c90 con 0x7f2a24069310 2023-08-17T17:46:25.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a28e72700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a2414ea60 0x7f2a240c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a28e72700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a2414ea60 0x7f2a240c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55110/0 (socket says 172.21.15.78:55110) 2023-08-17T17:46:25.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a28e72700 1 -- 172.21.15.78:0/3826295181 learned_addr learned my addr 172.21.15.78:0/3826295181 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:25.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a29673700 1 --2- 172.21.15.78:0/3826295181 >> v2:172.21.15.150:3300/0 conn(0x7f2a2414e680 0x7f2a240c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a29e74700 1 --2- 172.21.15.78:0/3826295181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a24069310 0x7f2a240697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a28e72700 1 -- 172.21.15.78:0/3826295181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a24069310 msgr2=0x7f2a240697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:25.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a28e72700 1 --2- 172.21.15.78:0/3826295181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a24069310 0x7f2a240697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a28e72700 1 -- 172.21.15.78:0/3826295181 >> v2:172.21.15.150:3300/0 conn(0x7f2a2414e680 msgr2=0x7f2a240c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:25.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a28e72700 1 --2- 172.21.15.78:0/3826295181 >> v2:172.21.15.150:3300/0 conn(0x7f2a2414e680 0x7f2a240c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a28e72700 1 -- 172.21.15.78:0/3826295181 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a240c4120 con 0x7f2a2414ea60 2023-08-17T17:46:25.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a28e72700 1 --2- 172.21.15.78:0/3826295181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2414ea60 0x7f2a240c3290 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f2a24067380 tx=0x7f2a180090f0).ready entity=mon.0 client_cookie=a265f64b1e844673 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:25.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a23fff700 1 -- 172.21.15.78:0/3826295181 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1800b600 con 0x7f2a2414ea60 2023-08-17T17:46:25.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a23fff700 1 -- 172.21.15.78:0/3826295181 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1800b760 con 0x7f2a2414ea60 2023-08-17T17:46:25.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.170+0000 7f2a23fff700 1 -- 172.21.15.78:0/3826295181 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1800bae0 con 0x7f2a2414ea60 2023-08-17T17:46:25.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.171+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3826295181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2414ea60 msgr2=0x7f2a240c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.171+0000 7f2a2b8d7700 1 --2- 172.21.15.78:0/3826295181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2414ea60 0x7f2a240c3290 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f2a24067380 tx=0x7f2a180090f0).stop 2023-08-17T17:46:25.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.171+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3826295181 shutdown_connections 2023-08-17T17:46:25.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.171+0000 7f2a2b8d7700 1 --2- 172.21.15.78:0/3826295181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a24069310 0x7f2a240697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.171+0000 7f2a2b8d7700 1 --2- 172.21.15.78:0/3826295181 >> v2:172.21.15.150:3300/0 conn(0x7f2a2414e680 0x7f2a240c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.171+0000 7f2a2b8d7700 1 --2- 172.21.15.78:0/3826295181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2414ea60 0x7f2a240c3290 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.171+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3826295181 >> 172.21.15.78:0/3826295181 conn(0x7f2a240c7b80 msgr2=0x7f2a240c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:25.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.171+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3826295181 shutdown_connections 2023-08-17T17:46:25.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.171+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3826295181 wait complete. 2023-08-17T17:46:25.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.172+0000 7f2a2b8d7700 1 Processor -- start 2023-08-17T17:46:25.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.172+0000 7f2a2b8d7700 1 -- start start 2023-08-17T17:46:25.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a2b8d7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a24069310 0x7f2a24161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a2b8d7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a2414e680 0x7f2a2414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a2b8d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a2414ea60 0x7f2a240bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a2b8d7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240abb20 con 0x7f2a24069310 2023-08-17T17:46:25.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a2b8d7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24161900 con 0x7f2a2414ea60 2023-08-17T17:46:25.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a2b8d7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240aaf10 con 0x7f2a2414e680 2023-08-17T17:46:25.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a29673700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a24069310 0x7f2a24161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a29673700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a24069310 0x7f2a24161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55116/0 (socket says 172.21.15.78:55116) 2023-08-17T17:46:25.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a29673700 1 -- 172.21.15.78:0/3739089945 learned_addr learned my addr 172.21.15.78:0/3739089945 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:25.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a28e72700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a2414e680 0x7f2a2414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a29e74700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a2414ea60 0x7f2a240bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a29673700 1 -- 172.21.15.78:0/3739089945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a2414e680 msgr2=0x7f2a2414c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a29673700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a2414e680 0x7f2a2414c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a29673700 1 -- 172.21.15.78:0/3739089945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a2414ea60 msgr2=0x7f2a240bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a29673700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a2414ea60 0x7f2a240bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a29673700 1 -- 172.21.15.78:0/3739089945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a18009370 con 0x7f2a24069310 2023-08-17T17:46:25.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.173+0000 7f2a29673700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a24069310 0x7f2a24161410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f2a1400e190 tx=0x7f2a14009920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:25.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.174+0000 7f2a217fa700 1 -- 172.21.15.78:0/3739089945 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400ecd0 con 0x7f2a24069310 2023-08-17T17:46:25.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.174+0000 7f2a217fa700 1 -- 172.21.15.78:0/3739089945 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1400ee30 con 0x7f2a24069310 2023-08-17T17:46:25.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.174+0000 7f2a217fa700 1 -- 172.21.15.78:0/3739089945 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14014610 con 0x7f2a24069310 2023-08-17T17:46:25.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.174+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3739089945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a240ab1f0 con 0x7f2a24069310 2023-08-17T17:46:25.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.174+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3739089945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a240ab7b0 con 0x7f2a24069310 2023-08-17T17:46:25.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.175+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3739089945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a24068270 con 0x7f2a24069310 2023-08-17T17:46:25.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.175+0000 7f2a217fa700 1 -- 172.21.15.78:0/3739089945 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f2a1401b030 con 0x7f2a24069310 2023-08-17T17:46:25.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.175+0000 7f2a217fa700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1005ee70 0x7f2a10061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.176+0000 7f2a217fa700 1 -- 172.21.15.78:0/3739089945 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f2a14079ef0 con 0x7f2a24069310 2023-08-17T17:46:25.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.176+0000 7f2a28e72700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1005ee70 0x7f2a10061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.176+0000 7f2a28e72700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1005ee70 0x7f2a10061330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2a18009130 tx=0x7f2a18017000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:25.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.180+0000 7f2a217fa700 1 -- 172.21.15.78:0/3739089945 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a1404b3a0 con 0x7f2a24069310 2023-08-17T17:46:25.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.364+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3739089945 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a240c6cb0 con 0x7f2a1005ee70 2023-08-17T17:46:25.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.366+0000 7f2a217fa700 1 -- 172.21.15.78:0/3739089945 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f2a18000c50 con 0x7f2a1005ee70 2023-08-17T17:46:25.366 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:25.366 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:26", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:25.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3739089945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1005ee70 msgr2=0x7f2a10061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1005ee70 0x7f2a10061330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2a18009130 tx=0x7f2a18017000).stop 2023-08-17T17:46:25.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3739089945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a24069310 msgr2=0x7f2a24161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a24069310 0x7f2a24161410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f2a1400e190 tx=0x7f2a14009920).stop 2023-08-17T17:46:25.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3739089945 shutdown_connections 2023-08-17T17:46:25.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1005ee70 0x7f2a10061330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a2414ea60 0x7f2a240bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a24069310 0x7f2a24161410 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 --2- 172.21.15.78:0/3739089945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a2414e680 0x7f2a2414c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3739089945 >> 172.21.15.78:0/3739089945 conn(0x7f2a240c7b80 msgr2=0x7f2a240c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:25.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3739089945 shutdown_connections 2023-08-17T17:46:25.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.368+0000 7f2a2b8d7700 1 -- 172.21.15.78:0/3739089945 wait complete. 2023-08-17T17:46:25.380 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:26", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:25.380 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:35:26', 'first': '2023-08-17T17:36:00', 'last': '2023-08-17T17:46:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-17T17:46:25.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:25.381 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-08-17T17:46:25.396 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:25.396 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:25.396 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:25.396 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:25.397 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:25.397 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:25.397 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:25.397 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:25.397 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:25.397 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:25.397 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:25.398 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_36_00_UTC', 'scheduled-2023-08-17-17_37_00_UTC', 'scheduled-2023-08-17-17_38_00_UTC', 'scheduled-2023-08-17-17_39_00_UTC', 'scheduled-2023-08-17-17_40_00_UTC', 'scheduled-2023-08-17-17_41_00_UTC', 'scheduled-2023-08-17-17_42_00_UTC', 'scheduled-2023-08-17-17_43_00_UTC', 'scheduled-2023-08-17-17_44_00_UTC', 'scheduled-2023-08-17-17_45_00_UTC', 'scheduled-2023-08-17-17_46_00_UTC'] 2023-08-17T17:46:25.398 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-08-17T17:46:25.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.553+0000 7fde785c2700 1 Processor -- start 2023-08-17T17:46:25.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.553+0000 7fde785c2700 1 -- start start 2023-08-17T17:46:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde785c2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde700aa0f0 0x7fde700644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde785c2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fde700aa4d0 0x7fde700c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde785c2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde700c5810 0x7fde700c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde785c2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde700649b0 con 0x7fde700aa0f0 2023-08-17T17:46:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde785c2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde700c6140 con 0x7fde700aa4d0 2023-08-17T17:46:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde785c2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde70063420 con 0x7fde700c5810 2023-08-17T17:46:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde7635e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde700aa0f0 0x7fde700644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde7635e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde700aa0f0 0x7fde700644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55130/0 (socket says 172.21.15.78:55130) 2023-08-17T17:46:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde7635e700 1 -- 172.21.15.78:0/3760813892 learned_addr learned my addr 172.21.15.78:0/3760813892 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde76b5f700 1 --2- 172.21.15.78:0/3760813892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde700c5810 0x7fde700c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde75b5d700 1 --2- 172.21.15.78:0/3760813892 >> v2:172.21.15.150:3300/0 conn(0x7fde700aa4d0 0x7fde700c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde7635e700 1 -- 172.21.15.78:0/3760813892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde700c5810 msgr2=0x7fde700c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde7635e700 1 --2- 172.21.15.78:0/3760813892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde700c5810 0x7fde700c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde7635e700 1 -- 172.21.15.78:0/3760813892 >> v2:172.21.15.150:3300/0 conn(0x7fde700aa4d0 msgr2=0x7fde700c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde7635e700 1 --2- 172.21.15.78:0/3760813892 >> v2:172.21.15.150:3300/0 conn(0x7fde700aa4d0 0x7fde700c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde7635e700 1 -- 172.21.15.78:0/3760813892 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70063700 con 0x7fde700aa0f0 2023-08-17T17:46:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde75b5d700 1 --2- 172.21.15.78:0/3760813892 >> v2:172.21.15.150:3300/0 conn(0x7fde700aa4d0 0x7fde700c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.554+0000 7fde7635e700 1 --2- 172.21.15.78:0/3760813892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700aa0f0 0x7fde700644c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fde70159060 tx=0x7fde6c0090f0).ready entity=mon.0 client_cookie=9d78a36e40833683 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde7535c700 1 -- 172.21.15.78:0/3760813892 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00b600 con 0x7fde700aa0f0 2023-08-17T17:46:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde7535c700 1 -- 172.21.15.78:0/3760813892 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c00b760 con 0x7fde700aa0f0 2023-08-17T17:46:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde7535c700 1 -- 172.21.15.78:0/3760813892 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00bae0 con 0x7fde700aa0f0 2023-08-17T17:46:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde785c2700 1 -- 172.21.15.78:0/3760813892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700aa0f0 msgr2=0x7fde700644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde785c2700 1 --2- 172.21.15.78:0/3760813892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700aa0f0 0x7fde700644c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fde70159060 tx=0x7fde6c0090f0).stop 2023-08-17T17:46:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde785c2700 1 -- 172.21.15.78:0/3760813892 shutdown_connections 2023-08-17T17:46:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde785c2700 1 --2- 172.21.15.78:0/3760813892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700aa0f0 0x7fde700644c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde785c2700 1 --2- 172.21.15.78:0/3760813892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde700c5810 0x7fde700c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde785c2700 1 --2- 172.21.15.78:0/3760813892 >> v2:172.21.15.150:3300/0 conn(0x7fde700aa4d0 0x7fde700c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde785c2700 1 -- 172.21.15.78:0/3760813892 >> 172.21.15.78:0/3760813892 conn(0x7fde7006a6a0 msgr2=0x7fde700caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde785c2700 1 -- 172.21.15.78:0/3760813892 shutdown_connections 2023-08-17T17:46:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.555+0000 7fde785c2700 1 -- 172.21.15.78:0/3760813892 wait complete. 2023-08-17T17:46:25.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.556+0000 7fde785c2700 1 Processor -- start 2023-08-17T17:46:25.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.556+0000 7fde785c2700 1 -- start start 2023-08-17T17:46:25.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde785c2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde700aa0f0 0x7fde70145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde785c2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde700aa4d0 0x7fde700affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde785c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700c5810 0x7fde700b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde785c2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700b09b0 con 0x7fde700c5810 2023-08-17T17:46:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde785c2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700c2220 con 0x7fde700aa4d0 2023-08-17T17:46:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde785c2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde700ad280 con 0x7fde700aa0f0 2023-08-17T17:46:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde76b5f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700c5810 0x7fde700b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde76b5f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700c5810 0x7fde700b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55134/0 (socket says 172.21.15.78:55134) 2023-08-17T17:46:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde76b5f700 1 -- 172.21.15.78:0/2199374741 learned_addr learned my addr 172.21.15.78:0/2199374741 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde75b5d700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde700aa4d0 0x7fde700affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde7635e700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde700aa0f0 0x7fde70145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde76b5f700 1 -- 172.21.15.78:0/2199374741 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde700aa0f0 msgr2=0x7fde70145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde76b5f700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde700aa0f0 0x7fde70145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde76b5f700 1 -- 172.21.15.78:0/2199374741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde700aa4d0 msgr2=0x7fde700affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde76b5f700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde700aa4d0 0x7fde700affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde76b5f700 1 -- 172.21.15.78:0/2199374741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c009370 con 0x7fde700c5810 2023-08-17T17:46:25.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.557+0000 7fde76b5f700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700c5810 0x7fde700b04c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fde6800e0e0 tx=0x7fde68009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.558+0000 7fde667fc700 1 -- 172.21.15.78:0/2199374741 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6800ec20 con 0x7fde700c5810 2023-08-17T17:46:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.558+0000 7fde667fc700 1 -- 172.21.15.78:0/2199374741 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6800ed80 con 0x7fde700c5810 2023-08-17T17:46:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.558+0000 7fde785c2700 1 -- 172.21.15.78:0/2199374741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde700acfa0 con 0x7fde700c5810 2023-08-17T17:46:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.558+0000 7fde667fc700 1 -- 172.21.15.78:0/2199374741 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde68014610 con 0x7fde700c5810 2023-08-17T17:46:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.558+0000 7fde785c2700 1 -- 172.21.15.78:0/2199374741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde700c1eb0 con 0x7fde700c5810 2023-08-17T17:46:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.559+0000 7fde785c2700 1 -- 172.21.15.78:0/2199374741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde700c23b0 con 0x7fde700c5810 2023-08-17T17:46:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.559+0000 7fde667fc700 1 -- 172.21.15.78:0/2199374741 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fde6801b030 con 0x7fde700c5810 2023-08-17T17:46:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.559+0000 7fde667fc700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde5405ee40 0x7fde54061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.559+0000 7fde667fc700 1 -- 172.21.15.78:0/2199374741 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fde68079f70 con 0x7fde700c5810 2023-08-17T17:46:25.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.559+0000 7fde7635e700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde5405ee40 0x7fde54061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.560+0000 7fde7635e700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde5405ee40 0x7fde54061300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fde6c009130 tx=0x7fde6c017000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:25.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.563+0000 7fde667fc700 1 -- 172.21.15.78:0/2199374741 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde6804b420 con 0x7fde700c5810 2023-08-17T17:46:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.747+0000 7fde785c2700 1 -- 172.21.15.78:0/2199374741 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde70046af0 con 0x7fde5405ee40 2023-08-17T17:46:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.749+0000 7fde667fc700 1 -- 172.21.15.78:0/2199374741 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fde70046af0 con 0x7fde5405ee40 2023-08-17T17:46:25.749 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:25.749 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:27", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:25.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 -- 172.21.15.78:0/2199374741 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde5405ee40 msgr2=0x7fde54061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde5405ee40 0x7fde54061300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fde6c009130 tx=0x7fde6c017000).stop 2023-08-17T17:46:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 -- 172.21.15.78:0/2199374741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700c5810 msgr2=0x7fde700b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700c5810 0x7fde700b04c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fde6800e0e0 tx=0x7fde68009900).stop 2023-08-17T17:46:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 -- 172.21.15.78:0/2199374741 shutdown_connections 2023-08-17T17:46:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fde5405ee40 0x7fde54061300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde700c5810 0x7fde700b04c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde700aa0f0 0x7fde70145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 --2- 172.21.15.78:0/2199374741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde700aa4d0 0x7fde700affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 -- 172.21.15.78:0/2199374741 >> 172.21.15.78:0/2199374741 conn(0x7fde7006a6a0 msgr2=0x7fde701517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:25.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 -- 172.21.15.78:0/2199374741 shutdown_connections 2023-08-17T17:46:25.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.751+0000 7fde785c2700 1 -- 172.21.15.78:0/2199374741 wait complete. 2023-08-17T17:46:25.763 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:35:27", "first": "2023-08-17T17:36:00", "last": "2023-08-17T17:46:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-17T17:46:25.763 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:35:27', 'first': '2023-08-17T17:36:00', 'last': '2023-08-17T17:46:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-17T17:46:25.763 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-08-17T17:46:25.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.881+0000 7ff415fc8700 1 Processor -- start 2023-08-17T17:46:25.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.881+0000 7ff415fc8700 1 -- start start 2023-08-17T17:46:25.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff415fc8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff410151a40 0x7ff4100c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff415fc8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff410151e20 0x7ff4100c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff415fc8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4100c6620 con 0x7ff410157be0 2023-08-17T17:46:25.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff415fc8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4100c6900 con 0x7ff410151a40 2023-08-17T17:46:25.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff415fc8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4100c6be0 con 0x7ff410151e20 2023-08-17T17:46:25.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff414fc6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff410151a40 0x7ff4100c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff414fc6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff410151a40 0x7ff4100c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55148/0 (socket says 172.21.15.78:55148) 2023-08-17T17:46:25.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff414fc6700 1 -- 172.21.15.78:0/267428224 learned_addr learned my addr 172.21.15.78:0/267428224 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:25.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff407fff700 1 --2- 172.21.15.78:0/267428224 >> v2:172.21.15.150:3300/0 conn(0x7ff410151e20 0x7ff4100c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff414fc6700 1 -- 172.21.15.78:0/267428224 >> v2:172.21.15.150:3300/0 conn(0x7ff410151e20 msgr2=0x7ff4100c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff414fc6700 1 --2- 172.21.15.78:0/267428224 >> v2:172.21.15.150:3300/0 conn(0x7ff410151e20 0x7ff4100c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff414fc6700 1 -- 172.21.15.78:0/267428224 >> v1:172.21.15.150:6789/0 conn(0x7ff410157be0 legacy=0x7ff410154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff414fc6700 1 -- 172.21.15.78:0/267428224 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100c6ec0 con 0x7ff410151a40 2023-08-17T17:46:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff414fc6700 1 --2- 172.21.15.78:0/267428224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151a40 0x7ff4100c8260 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7ff410065360 tx=0x7ff40c009840).ready entity=mon.0 client_cookie=795e25a2427acd36 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff4077fe700 1 -- 172.21.15.78:0/267428224 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c00e070 con 0x7ff410151a40 2023-08-17T17:46:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff4077fe700 1 -- 172.21.15.78:0/267428224 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c00ba20 con 0x7ff410151a40 2023-08-17T17:46:25.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.882+0000 7ff4077fe700 1 -- 172.21.15.78:0/267428224 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c00bda0 con 0x7ff410151a40 2023-08-17T17:46:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.883+0000 7ff415fc8700 1 -- 172.21.15.78:0/267428224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151a40 msgr2=0x7ff4100c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.883+0000 7ff415fc8700 1 --2- 172.21.15.78:0/267428224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151a40 0x7ff4100c8260 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7ff410065360 tx=0x7ff40c009840).stop 2023-08-17T17:46:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.883+0000 7ff415fc8700 1 -- 172.21.15.78:0/267428224 shutdown_connections 2023-08-17T17:46:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.883+0000 7ff415fc8700 1 --2- 172.21.15.78:0/267428224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151a40 0x7ff4100c8260 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.883+0000 7ff415fc8700 1 --2- 172.21.15.78:0/267428224 >> v2:172.21.15.150:3300/0 conn(0x7ff410151e20 0x7ff4100c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.883+0000 7ff415fc8700 1 -- 172.21.15.78:0/267428224 >> 172.21.15.78:0/267428224 conn(0x7ff4100943b0 msgr2=0x7ff41006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.883+0000 7ff415fc8700 1 -- 172.21.15.78:0/267428224 shutdown_connections 2023-08-17T17:46:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.883+0000 7ff415fc8700 1 -- 172.21.15.78:0/267428224 wait complete. 2023-08-17T17:46:25.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.884+0000 7ff415fc8700 1 Processor -- start 2023-08-17T17:46:25.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.884+0000 7ff415fc8700 1 -- start start 2023-08-17T17:46:25.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff415fc8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff410151a40 0x7ff41014b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff415fc8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151e20 0x7ff4100adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff415fc8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff410157be0 0x7ff4100a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff415fc8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff410165900 con 0x7ff410151e20 2023-08-17T17:46:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff415fc8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100c30a0 con 0x7ff410157be0 2023-08-17T17:46:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff415fc8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100ae8f0 con 0x7ff410151a40 2023-08-17T17:46:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff407fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151e20 0x7ff4100adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff407fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151e20 0x7ff4100adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55162/0 (socket says 172.21.15.78:55162) 2023-08-17T17:46:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff407fff700 1 -- 172.21.15.78:0/1821828228 learned_addr learned my addr 172.21.15.78:0/1821828228 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff4157c7700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff410157be0 0x7ff4100a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff414fc6700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff410151a40 0x7ff41014b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff407fff700 1 -- 172.21.15.78:0/1821828228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff410151a40 msgr2=0x7ff41014b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff407fff700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff410151a40 0x7ff41014b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff407fff700 1 -- 172.21.15.78:0/1821828228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff410157be0 msgr2=0x7ff4100a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff407fff700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff410157be0 0x7ff4100a8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.885+0000 7ff407fff700 1 -- 172.21.15.78:0/1821828228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c009ae0 con 0x7ff410151e20 2023-08-17T17:46:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.886+0000 7ff407fff700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151e20 0x7ff4100adea0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7ff40000e900 tx=0x7ff400006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.886+0000 7ff404ff9700 1 -- 172.21.15.78:0/1821828228 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400012600 con 0x7ff410151e20 2023-08-17T17:46:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.886+0000 7ff404ff9700 1 -- 172.21.15.78:0/1821828228 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff400012760 con 0x7ff410151e20 2023-08-17T17:46:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.886+0000 7ff415fc8700 1 -- 172.21.15.78:0/1821828228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4100aebd0 con 0x7ff410151e20 2023-08-17T17:46:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.886+0000 7ff404ff9700 1 -- 172.21.15.78:0/1821828228 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400012ae0 con 0x7ff410151e20 2023-08-17T17:46:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.886+0000 7ff415fc8700 1 -- 172.21.15.78:0/1821828228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4100af190 con 0x7ff410151e20 2023-08-17T17:46:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.887+0000 7ff415fc8700 1 -- 172.21.15.78:0/1821828228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff410082f90 con 0x7ff410151e20 2023-08-17T17:46:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.887+0000 7ff404ff9700 1 -- 172.21.15.78:0/1821828228 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7ff400022070 con 0x7ff410151e20 2023-08-17T17:46:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.887+0000 7ff404ff9700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3fc05ee40 0x7ff3fc061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.888+0000 7ff404ff9700 1 -- 172.21.15.78:0/1821828228 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7ff400079e70 con 0x7ff410151e20 2023-08-17T17:46:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.888+0000 7ff414fc6700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3fc05ee40 0x7ff3fc061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.888+0000 7ff414fc6700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3fc05ee40 0x7ff3fc061300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff40c00c010 tx=0x7ff40c009840).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:25.892+0000 7ff404ff9700 1 -- 172.21.15.78:0/1821828228 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff40004b320 con 0x7ff410151e20 2023-08-17T17:46:26.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.078+0000 7ff415fc8700 1 -- 172.21.15.78:0/1821828228 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff41005f910 con 0x7ff3fc05ee40 2023-08-17T17:46:26.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.081+0000 7ff404ff9700 1 -- 172.21.15.78:0/1821828228 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7ff41005f910 con 0x7ff3fc05ee40 2023-08-17T17:46:26.082 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-08-17T17:46:26.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 -- 172.21.15.78:0/1821828228 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3fc05ee40 msgr2=0x7ff3fc061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:26.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3fc05ee40 0x7ff3fc061300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff40c00c010 tx=0x7ff40c009840).stop 2023-08-17T17:46:26.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 -- 172.21.15.78:0/1821828228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151e20 msgr2=0x7ff4100adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:26.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151e20 0x7ff4100adea0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7ff40000e900 tx=0x7ff400006f40).stop 2023-08-17T17:46:26.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 -- 172.21.15.78:0/1821828228 shutdown_connections 2023-08-17T17:46:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3fc05ee40 0x7ff3fc061300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff410157be0 0x7ff4100a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff410151a40 0x7ff41014b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 --2- 172.21.15.78:0/1821828228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff410151e20 0x7ff4100adea0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:26.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 -- 172.21.15.78:0/1821828228 >> 172.21.15.78:0/1821828228 conn(0x7ff4100943b0 msgr2=0x7ff41006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:26.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 -- 172.21.15.78:0/1821828228 shutdown_connections 2023-08-17T17:46:26.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.083+0000 7ff415fc8700 1 -- 172.21.15.78:0/1821828228 wait complete. 2023-08-17T17:46:26.095 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-08-17T17:46:26.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.095 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-08-17T17:46:26.110 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:26.111 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:26.111 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:26.111 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:26.111 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:26.111 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:26.111 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:26.111 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:26.112 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:26.112 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:26.112 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:26.113 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:26.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.113 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_36_00_UTC) 2023-08-17T17:46:26.173 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:26.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.174 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_37_00_UTC) 2023-08-17T17:46:26.233 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:26.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.234 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_38_00_UTC) 2023-08-17T17:46:26.295 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:26.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.295 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_39_00_UTC) 2023-08-17T17:46:26.359 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:26.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.360 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_40_00_UTC) 2023-08-17T17:46:26.420 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:26.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.421 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_41_00_UTC) 2023-08-17T17:46:26.483 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:26.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.484 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_42_00_UTC) 2023-08-17T17:46:26.544 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:26.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.545 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_43_00_UTC) 2023-08-17T17:46:26.604 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:26.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.605 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_44_00_UTC) 2023-08-17T17:46:26.663 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:26.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.663 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_45_00_UTC) 2023-08-17T17:46:26.722 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:26.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.723 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-17-17_46_00_UTC) 2023-08-17T17:46:26.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:26.782 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-08-17T17:46:26.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-08-17T17:46:26.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.997+0000 7f687ea65700 1 Processor -- start 2023-08-17T17:46:26.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.997+0000 7f687ea65700 1 -- start start 2023-08-17T17:46:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687ea65700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 0x7f68781514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687ea65700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6878063600 0x7f6878063a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687ea65700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68780bd260 con 0x7f687814ea30 2023-08-17T17:46:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687ea65700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6878063f50 con 0x7f6878063600 2023-08-17T17:46:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687ea65700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6878151d70 con 0x7f687806b280 2023-08-17T17:46:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687d262700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 0x7f68781514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687e264700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6878063600 0x7f6878063a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687d262700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 0x7f68781514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:58408/0 (socket says 172.21.15.78:58408) 2023-08-17T17:46:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687d262700 1 -- 172.21.15.78:0/2775337285 learned_addr learned my addr 172.21.15.78:0/2775337285 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687d262700 1 -- 172.21.15.78:0/2775337285 >> v2:172.21.15.150:3300/0 conn(0x7f6878063600 msgr2=0x7f6878063a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.998+0000 7f687d262700 1 --2- 172.21.15.78:0/2775337285 >> v2:172.21.15.150:3300/0 conn(0x7f6878063600 0x7f6878063a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687d262700 1 -- 172.21.15.78:0/2775337285 >> v1:172.21.15.150:6789/0 conn(0x7f687814ea30 legacy=0x7f68780c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687d262700 1 -- 172.21.15.78:0/2775337285 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6878152050 con 0x7f687806b280 2023-08-17T17:46:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687e264700 1 --2- 172.21.15.78:0/2775337285 >> v2:172.21.15.150:3300/0 conn(0x7f6878063600 0x7f6878063a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687d262700 1 --2- 172.21.15.78:0/2775337285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 0x7f68781514b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6868006fd0 tx=0x7f68680090f0).ready entity=mon.2 client_cookie=dd43197dcb744bdf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687ca61700 1 -- 172.21.15.78:0/2775337285 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686800b580 con 0x7f687806b280 2023-08-17T17:46:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687ca61700 1 -- 172.21.15.78:0/2775337285 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686800b6e0 con 0x7f687806b280 2023-08-17T17:46:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687ca61700 1 -- 172.21.15.78:0/2775337285 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686800ba60 con 0x7f687806b280 2023-08-17T17:46:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687ea65700 1 -- 172.21.15.78:0/2775337285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 msgr2=0x7f68781514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687ea65700 1 --2- 172.21.15.78:0/2775337285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 0x7f68781514b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6868006fd0 tx=0x7f68680090f0).stop 2023-08-17T17:46:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687ea65700 1 -- 172.21.15.78:0/2775337285 shutdown_connections 2023-08-17T17:46:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687ea65700 1 --2- 172.21.15.78:0/2775337285 >> v2:172.21.15.150:3300/0 conn(0x7f6878063600 0x7f6878063a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687ea65700 1 --2- 172.21.15.78:0/2775337285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 0x7f68781514b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687ea65700 1 -- 172.21.15.78:0/2775337285 >> 172.21.15.78:0/2775337285 conn(0x7f68780c3e20 msgr2=0x7f68780c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:26.999+0000 7f687ea65700 1 -- 172.21.15.78:0/2775337285 shutdown_connections 2023-08-17T17:46:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.000+0000 7f687ea65700 1 -- 172.21.15.78:0/2775337285 wait complete. 2023-08-17T17:46:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687ea65700 1 Processor -- start 2023-08-17T17:46:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687ea65700 1 -- start start 2023-08-17T17:46:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687ea65700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878063600 0x7f68780a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687ea65700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 0x7f6878144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687ea65700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f687814ea30 0x7f68781450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687ea65700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c0c70 con 0x7f6878063600 2023-08-17T17:46:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687ea65700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c0060 con 0x7f687814ea30 2023-08-17T17:46:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687ea65700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c0340 con 0x7f687806b280 2023-08-17T17:46:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687da63700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878063600 0x7f68780a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687da63700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878063600 0x7f68780a5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55178/0 (socket says 172.21.15.78:55178) 2023-08-17T17:46:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.001+0000 7f687da63700 1 -- 172.21.15.78:0/2454738106 learned_addr learned my addr 172.21.15.78:0/2454738106 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f687e264700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f687814ea30 0x7f68781450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f687d262700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 0x7f6878144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f687da63700 1 -- 172.21.15.78:0/2454738106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 msgr2=0x7f6878144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f687da63700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 0x7f6878144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f687da63700 1 -- 172.21.15.78:0/2454738106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f687814ea30 msgr2=0x7f68781450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f687da63700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f687814ea30 0x7f68781450f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f687da63700 1 -- 172.21.15.78:0/2454738106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6870009a20 con 0x7f6878063600 2023-08-17T17:46:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f687da63700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878063600 0x7f68780a5c00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f687400c440 tx=0x7f6874007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f686dffb700 1 -- 172.21.15.78:0/2454738106 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687400ce40 con 0x7f6878063600 2023-08-17T17:46:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f686dffb700 1 -- 172.21.15.78:0/2454738106 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874007020 con 0x7f6878063600 2023-08-17T17:46:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f687ea65700 1 -- 172.21.15.78:0/2454738106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6868009370 con 0x7f6878063600 2023-08-17T17:46:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f686dffb700 1 -- 172.21.15.78:0/2454738106 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740073c0 con 0x7f6878063600 2023-08-17T17:46:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.002+0000 7f687ea65700 1 -- 172.21.15.78:0/2454738106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68780c0900 con 0x7f6878063600 2023-08-17T17:46:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.003+0000 7f686dffb700 1 -- 172.21.15.78:0/2454738106 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f6874010070 con 0x7f6878063600 2023-08-17T17:46:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.003+0000 7f687ea65700 1 -- 172.21.15.78:0/2454738106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687805f910 con 0x7f6878063600 2023-08-17T17:46:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.004+0000 7f686dffb700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f685c05ee70 0x7f685c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.004+0000 7f686dffb700 1 -- 172.21.15.78:0/2454738106 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f6874078ea0 con 0x7f6878063600 2023-08-17T17:46:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.004+0000 7f687d262700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f685c05ee70 0x7f685c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.004+0000 7f687d262700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f685c05ee70 0x7f685c061330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6868009130 tx=0x7f6868017000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.008+0000 7f686dffb700 1 -- 172.21.15.78:0/2454738106 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f68740478f0 con 0x7f6878063600 2023-08-17T17:46:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.196+0000 7f687ea65700 1 -- 172.21.15.78:0/2454738106 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f68780a0ee0 con 0x7f685c05ee70 2023-08-17T17:46:27.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.199+0000 7f686dffb700 1 -- 172.21.15.78:0/2454738106 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f68780a0ee0 con 0x7f685c05ee70 2023-08-17T17:46:27.200 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-08-17T17:46:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 -- 172.21.15.78:0/2454738106 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f685c05ee70 msgr2=0x7f685c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f685c05ee70 0x7f685c061330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6868009130 tx=0x7f6868017000).stop 2023-08-17T17:46:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 -- 172.21.15.78:0/2454738106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878063600 msgr2=0x7f68780a5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878063600 0x7f68780a5c00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f687400c440 tx=0x7f6874007e00).stop 2023-08-17T17:46:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 -- 172.21.15.78:0/2454738106 shutdown_connections 2023-08-17T17:46:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f685c05ee70 0x7f685c061330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f687814ea30 0x7f68781450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878063600 0x7f68780a5c00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 --2- 172.21.15.78:0/2454738106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f687806b280 0x7f6878144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 -- 172.21.15.78:0/2454738106 >> 172.21.15.78:0/2454738106 conn(0x7f68780c3e20 msgr2=0x7f68780c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 -- 172.21.15.78:0/2454738106 shutdown_connections 2023-08-17T17:46:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:27.202+0000 7f687ea65700 1 -- 172.21.15.78:0/2454738106 wait complete. 2023-08-17T17:46:27.213 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-08-17T17:46:27.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.214 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-08-17T17:46:27.228 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:27.229 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:27.229 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:27.229 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:27.229 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:27.229 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:27.229 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:27.229 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:27.229 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:27.230 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:27.230 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:27.230 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:27.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.231 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_36_00_UTC) 2023-08-17T17:46:27.291 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:27.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.292 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_37_00_UTC) 2023-08-17T17:46:27.351 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:27.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.352 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_38_00_UTC) 2023-08-17T17:46:27.410 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:27.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.411 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_39_00_UTC) 2023-08-17T17:46:27.470 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:27.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.471 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_40_00_UTC) 2023-08-17T17:46:27.530 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:27.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.531 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_41_00_UTC) 2023-08-17T17:46:27.589 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:27.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.590 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_42_00_UTC) 2023-08-17T17:46:27.649 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:27.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.650 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_43_00_UTC) 2023-08-17T17:46:27.708 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:27.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.709 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_44_00_UTC) 2023-08-17T17:46:27.767 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:27.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.768 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_45_00_UTC) 2023-08-17T17:46:27.826 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:27.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.827 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-17-17_46_00_UTC) 2023-08-17T17:46:27.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:27.890 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-08-17T17:46:27.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-08-17T17:46:28.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.105+0000 7f663f59e700 1 Processor -- start 2023-08-17T17:46:28.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.106+0000 7f663f59e700 1 -- start start 2023-08-17T17:46:28.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.106+0000 7f663f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6640151a40 0x7f66400c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:28.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.106+0000 7f663f59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6640151e20 0x7f66400c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:28.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.106+0000 7f663f59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66400c6620 con 0x7f6640157be0 2023-08-17T17:46:28.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.106+0000 7f663f59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66400c6900 con 0x7f6640151e20 2023-08-17T17:46:28.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.106+0000 7f663f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66400c6be0 con 0x7f6640151a40 2023-08-17T17:46:28.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663ed9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6640157be0 0x7f6640154610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37772/0 (socket says 172.21.15.78:37772) 2023-08-17T17:46:28.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663ed9d700 1 -- 172.21.15.78:0/3318055471 learned_addr learned my addr 172.21.15.78:0/3318055471 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:28.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f6635d9b700 1 --2- 172.21.15.78:0/3318055471 >> v2:172.21.15.150:3300/0 conn(0x7f6640151e20 0x7f66400c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:28.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397612687 0 0) 0x7f66400c6620 con 0x7f6640157be0 2023-08-17T17:46:28.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663e59c700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6640151a40 0x7f66400c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:28.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f662c0033f0 con 0x7f6640157be0 2023-08-17T17:46:28.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 619462445 0 0) 0x7f662c0033f0 con 0x7f6640157be0 2023-08-17T17:46:28.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6640151a40 msgr2=0x7f66400c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:28.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6640151a40 0x7f66400c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:28.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 >> v2:172.21.15.150:3300/0 conn(0x7f6640151e20 msgr2=0x7f66400c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:28.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 --2- 172.21.15.78:0/3318055471 >> v2:172.21.15.150:3300/0 conn(0x7f6640151e20 0x7f66400c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:28.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66400c6ec0 con 0x7f6640157be0 2023-08-17T17:46:28.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f66380017f0 con 0x7f6640157be0 2023-08-17T17:46:28.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 >> v1:172.21.15.78:6789/0 conn(0x7f6640157be0 legacy=0x7f6640154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:28.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f662c0038e0 0x7f662c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:28.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6640151a40 0x7f662c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:28.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f662c004b80 0x7f662c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:28.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66400c6900 con 0x7f662c004b80 2023-08-17T17:46:28.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66400c6be0 con 0x7f662c0038e0 2023-08-17T17:46:28.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c00b8e0 con 0x7f6640151a40 2023-08-17T17:46:28.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663ed9d700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f662c004b80 0x7f662c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:28.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f6635d9b700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6640151a40 0x7f662c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:28.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.107+0000 7f663e59c700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f662c0038e0 0x7f662c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:28.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663ed9d700 1 -- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6640151a40 msgr2=0x7f662c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:28.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663ed9d700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6640151a40 0x7f662c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:28.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663ed9d700 1 -- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f662c0038e0 msgr2=0x7f662c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:28.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663ed9d700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f662c0038e0 0x7f662c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:28.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663ed9d700 1 -- 172.21.15.78:0/3318055471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c0033f0 con 0x7f662c004b80 2023-08-17T17:46:28.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663e59c700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f662c0038e0 0x7f662c003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:28.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663ed9d700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f662c004b80 0x7f662c005000 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f663800c530 tx=0x7f6638001d90).ready entity=mon.0 client_cookie=b09c838fa4933854 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:28.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800ce60 con 0x7f662c004b80 2023-08-17T17:46:28.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638005b20 con 0x7f662c004b80 2023-08-17T17:46:28.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663dd9b700 1 -- 172.21.15.78:0/3318055471 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380070d0 con 0x7f662c004b80 2023-08-17T17:46:28.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663f59e700 1 -- 172.21.15.78:0/3318055471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f662c004b80 msgr2=0x7f662c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663f59e700 1 --2- 172.21.15.78:0/3318055471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f662c004b80 0x7f662c005000 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f663800c530 tx=0x7f6638001d90).stop 2023-08-17T17:46:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663ed9d700 1 -- 172.21.15.78:0/3318055471 reap_dead start 2023-08-17T17:46:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663f59e700 1 -- 172.21.15.78:0/3318055471 shutdown_connections 2023-08-17T17:46:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663f59e700 1 -- 172.21.15.78:0/3318055471 >> 172.21.15.78:0/3318055471 conn(0x7f66400943b0 msgr2=0x7f664006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663f59e700 1 -- 172.21.15.78:0/3318055471 shutdown_connections 2023-08-17T17:46:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.108+0000 7f663f59e700 1 -- 172.21.15.78:0/3318055471 wait complete. 2023-08-17T17:46:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663f59e700 1 Processor -- start 2023-08-17T17:46:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663f59e700 1 -- start start 2023-08-17T17:46:28.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f662c004b80 0x7f664014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:28.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6640153110 0x7f6640153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:28.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400a7a70 0x7f66400a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:28.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663f59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664014aed0 con 0x7f66400a7a70 2023-08-17T17:46:28.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66400c3850 con 0x7f6640153110 2023-08-17T17:46:28.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66400a83e0 con 0x7f662c004b80 2023-08-17T17:46:28.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400a7a70 0x7f66400a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:28.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400a7a70 0x7f66400a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55202/0 (socket says 172.21.15.78:55202) 2023-08-17T17:46:28.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.110+0000 7f663ed9d700 1 -- 172.21.15.78:0/388920364 learned_addr learned my addr 172.21.15.78:0/388920364 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:28.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f6635d9b700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6640153110 0x7f6640153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:28.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f663ed9d700 1 -- 172.21.15.78:0/388920364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f662c004b80 msgr2=0x7f664014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:28.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f663ed9d700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f662c004b80 0x7f664014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:28.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f663ed9d700 1 -- 172.21.15.78:0/388920364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6640153110 msgr2=0x7f6640153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:28.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f663ed9d700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6640153110 0x7f6640153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:28.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f663ed9d700 1 -- 172.21.15.78:0/388920364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66400a8650 con 0x7f66400a7a70 2023-08-17T17:46:28.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f6635d9b700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6640153110 0x7f6640153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:28.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f663ed9d700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400a7a70 0x7f66400a7ef0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f663800a000 tx=0x7f6638015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:28.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f6636ffd700 1 -- 172.21.15.78:0/388920364 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380017b0 con 0x7f66400a7a70 2023-08-17T17:46:28.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f6636ffd700 1 -- 172.21.15.78:0/388920364 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638005c90 con 0x7f66400a7a70 2023-08-17T17:46:28.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f663f59e700 1 -- 172.21.15.78:0/388920364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66400a8930 con 0x7f66400a7a70 2023-08-17T17:46:28.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f6636ffd700 1 -- 172.21.15.78:0/388920364 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380136a0 con 0x7f66400a7a70 2023-08-17T17:46:28.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.111+0000 7f663f59e700 1 -- 172.21.15.78:0/388920364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66400c34e0 con 0x7f66400a7a70 2023-08-17T17:46:28.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.112+0000 7f663f59e700 1 -- 172.21.15.78:0/388920364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6640082f90 con 0x7f66400a7a70 2023-08-17T17:46:28.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.112+0000 7f6636ffd700 1 -- 172.21.15.78:0/388920364 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f6638010070 con 0x7f66400a7a70 2023-08-17T17:46:28.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.113+0000 7f6636ffd700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f662005ee70 0x7f6620061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:28.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.113+0000 7f6636ffd700 1 -- 172.21.15.78:0/388920364 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f6638019070 con 0x7f66400a7a70 2023-08-17T17:46:28.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.113+0000 7f663e59c700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f662005ee70 0x7f6620061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:28.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.113+0000 7f663e59c700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f662005ee70 0x7f6620061330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6630006cd0 tx=0x7f6630006f40).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:28.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.117+0000 7f6636ffd700 1 -- 172.21.15.78:0/388920364 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f663804c160 con 0x7f66400a7a70 2023-08-17T17:46:28.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.303+0000 7f663f59e700 1 -- 172.21.15.78:0/388920364 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f664005f910 con 0x7f662005ee70 2023-08-17T17:46:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.306+0000 7f6636ffd700 1 -- 172.21.15.78:0/388920364 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f664005f910 con 0x7f662005ee70 2023-08-17T17:46:28.307 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-08-17T17:46:28.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 -- 172.21.15.78:0/388920364 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f662005ee70 msgr2=0x7f6620061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f662005ee70 0x7f6620061330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6630006cd0 tx=0x7f6630006f40).stop 2023-08-17T17:46:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 -- 172.21.15.78:0/388920364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400a7a70 msgr2=0x7f66400a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400a7a70 0x7f66400a7ef0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f663800a000 tx=0x7f6638015000).stop 2023-08-17T17:46:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 -- 172.21.15.78:0/388920364 shutdown_connections 2023-08-17T17:46:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f662005ee70 0x7f6620061330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400a7a70 0x7f66400a7ef0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f662c004b80 0x7f664014a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 --2- 172.21.15.78:0/388920364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6640153110 0x7f6640153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:28.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 -- 172.21.15.78:0/388920364 >> 172.21.15.78:0/388920364 conn(0x7f66400943b0 msgr2=0x7f66400c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:28.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 -- 172.21.15.78:0/388920364 shutdown_connections 2023-08-17T17:46:28.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:28.308+0000 7f663f59e700 1 -- 172.21.15.78:0/388920364 wait complete. 2023-08-17T17:46:28.320 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-08-17T17:46:28.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.320 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-08-17T17:46:28.336 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:28.336 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:28.336 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:28.336 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:28.336 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:28.336 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:28.337 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:28.337 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:28.337 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:28.337 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:28.337 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:28.338 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:28.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.338 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_36_00_UTC) 2023-08-17T17:46:28.402 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:28.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.402 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_37_00_UTC) 2023-08-17T17:46:28.462 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:28.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.463 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_38_00_UTC) 2023-08-17T17:46:28.522 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:28.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.523 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_39_00_UTC) 2023-08-17T17:46:28.582 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:28.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.583 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_40_00_UTC) 2023-08-17T17:46:28.642 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:28.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.642 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_41_00_UTC) 2023-08-17T17:46:28.701 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:28.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.702 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_42_00_UTC) 2023-08-17T17:46:28.764 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:28.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.765 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_43_00_UTC) 2023-08-17T17:46:28.823 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:28.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.824 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_44_00_UTC) 2023-08-17T17:46:28.884 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:28.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.884 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_45_00_UTC) 2023-08-17T17:46:28.943 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:28.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:28.944 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-17-17_46_00_UTC) 2023-08-17T17:46:29.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.004 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-08-17T17:46:29.061 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-08-17T17:46:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.218+0000 7fb302555700 1 Processor -- start 2023-08-17T17:46:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.218+0000 7fb302555700 1 -- start start 2023-08-17T17:46:29.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb302555700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0aa0f0 0x7fb2fc0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:29.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb302555700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb2fc0aa4d0 0x7fb2fc0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:29.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb302555700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc0649b0 con 0x7fb2fc0c5810 2023-08-17T17:46:29.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb302555700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc063420 con 0x7fb2fc0aa4d0 2023-08-17T17:46:29.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb302555700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc063700 con 0x7fb2fc0aa0f0 2023-08-17T17:46:29.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb300af2700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb2fc0c5810 0x7fb2fc0a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45052/0 (socket says 172.21.15.78:45052) 2023-08-17T17:46:29.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb300af2700 1 -- 172.21.15.78:0/2123833969 learned_addr learned my addr 172.21.15.78:0/2123833969 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:29.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469669606 0 0) 0x7fb2fc0649b0 con 0x7fb2fc0c5810 2023-08-17T17:46:29.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2fb7fe700 1 --2- 172.21.15.78:0/2123833969 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc0aa4d0 0x7fb2fc0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e40033f0 con 0x7fb2fc0c5810 2023-08-17T17:46:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2fbfff700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0aa0f0 0x7fb2fc0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3697891964 0 0) 0x7fb2e40033f0 con 0x7fb2fc0c5810 2023-08-17T17:46:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0aa0f0 msgr2=0x7fb2fc0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2faffd700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0aa0f0 0x7fb2fc0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc0aa4d0 msgr2=0x7fb2fc0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2faffd700 1 --2- 172.21.15.78:0/2123833969 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc0aa4d0 0x7fb2fc0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc0639e0 con 0x7fb2fc0c5810 2023-08-17T17:46:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fb2f40017f0 con 0x7fb2fc0c5810 2023-08-17T17:46:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.219+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 >> v1:172.21.15.78:6789/0 conn(0x7fb2fc0c5810 legacy=0x7fb2fc0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2faffd700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 0x7fb2e4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2faffd700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0aa0f0 0x7fb2e4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2faffd700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2e4004b80 0x7fb2e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc063420 con 0x7fb2e40038e0 2023-08-17T17:46:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc063700 con 0x7fb2e4004b80 2023-08-17T17:46:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e400b8e0 con 0x7fb2fc0aa0f0 2023-08-17T17:46:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2fbfff700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 0x7fb2e4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2fb7fe700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0aa0f0 0x7fb2e4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb300af2700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2e4004b80 0x7fb2e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2fbfff700 1 -- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0aa0f0 msgr2=0x7fb2e4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2fbfff700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0aa0f0 0x7fb2e4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2fbfff700 1 -- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2e4004b80 msgr2=0x7fb2e4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2fbfff700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2e4004b80 0x7fb2e4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2fbfff700 1 -- 172.21.15.78:0/2123833969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e40033f0 con 0x7fb2e40038e0 2023-08-17T17:46:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2fbfff700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 0x7fb2e4003d00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fb2ec00ba00 tx=0x7fb2ec008040).ready entity=mon.0 client_cookie=41e77df2025e8827 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec00b340 con 0x7fb2e40038e0 2023-08-17T17:46:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec013480 con 0x7fb2e40038e0 2023-08-17T17:46:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.220+0000 7fb2faffd700 1 -- 172.21.15.78:0/2123833969 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec013800 con 0x7fb2e40038e0 2023-08-17T17:46:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.221+0000 7fb302555700 1 -- 172.21.15.78:0/2123833969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 msgr2=0x7fb2e4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:29.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.221+0000 7fb302555700 1 --2- 172.21.15.78:0/2123833969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 0x7fb2e4003d00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fb2ec00ba00 tx=0x7fb2ec008040).stop 2023-08-17T17:46:29.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.221+0000 7fb300af2700 1 -- 172.21.15.78:0/2123833969 reap_dead start 2023-08-17T17:46:29.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.221+0000 7fb302555700 1 -- 172.21.15.78:0/2123833969 shutdown_connections 2023-08-17T17:46:29.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.221+0000 7fb302555700 1 -- 172.21.15.78:0/2123833969 >> 172.21.15.78:0/2123833969 conn(0x7fb2fc06a6a0 msgr2=0x7fb2fc0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:29.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.221+0000 7fb302555700 1 -- 172.21.15.78:0/2123833969 shutdown_connections 2023-08-17T17:46:29.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.221+0000 7fb302555700 1 -- 172.21.15.78:0/2123833969 wait complete. 2023-08-17T17:46:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.222+0000 7fb302555700 1 Processor -- start 2023-08-17T17:46:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.222+0000 7fb302555700 1 -- start start 2023-08-17T17:46:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb302555700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 0x7fb2fc144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb302555700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2fc0ad2e0 0x7fb2fc0982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb302555700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0ad760 0x7fb2fc098790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:29.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb302555700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0acc70 con 0x7fb2e40038e0 2023-08-17T17:46:29.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb302555700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc098c80 con 0x7fb2fc0ad2e0 2023-08-17T17:46:29.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb302555700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0c4960 con 0x7fb2fc0ad760 2023-08-17T17:46:29.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 0x7fb2fc144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:29.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 0x7fb2fc144b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41972/0 (socket says 172.21.15.78:41972) 2023-08-17T17:46:29.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2fbfff700 1 -- 172.21.15.78:0/2364210667 learned_addr learned my addr 172.21.15.78:0/2364210667 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:29.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2fb7fe700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2fc0ad2e0 0x7fb2fc0982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:29.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb300af2700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0ad760 0x7fb2fc098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:29.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2fbfff700 1 -- 172.21.15.78:0/2364210667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0ad760 msgr2=0x7fb2fc098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:29.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2fbfff700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0ad760 0x7fb2fc098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:29.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2fbfff700 1 -- 172.21.15.78:0/2364210667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2fc0ad2e0 msgr2=0x7fb2fc0982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:29.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2fbfff700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2fc0ad2e0 0x7fb2fc0982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:29.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2fbfff700 1 -- 172.21.15.78:0/2364210667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc0abbd0 con 0x7fb2e40038e0 2023-08-17T17:46:29.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2fbfff700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 0x7fb2fc144b00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fb2ec008010 tx=0x7fb2ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:29.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2e3fff700 1 -- 172.21.15.78:0/2364210667 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec012b20 con 0x7fb2e40038e0 2023-08-17T17:46:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2e3fff700 1 -- 172.21.15.78:0/2364210667 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec012c80 con 0x7fb2e40038e0 2023-08-17T17:46:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb302555700 1 -- 172.21.15.78:0/2364210667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc0abeb0 con 0x7fb2e40038e0 2023-08-17T17:46:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.223+0000 7fb2e3fff700 1 -- 172.21.15.78:0/2364210667 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec01d410 con 0x7fb2e40038e0 2023-08-17T17:46:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.224+0000 7fb302555700 1 -- 172.21.15.78:0/2364210667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc0ac470 con 0x7fb2e40038e0 2023-08-17T17:46:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.224+0000 7fb302555700 1 -- 172.21.15.78:0/2364210667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc0acac0 con 0x7fb2e40038e0 2023-08-17T17:46:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.225+0000 7fb2e3fff700 1 -- 172.21.15.78:0/2364210667 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fb2ec02c070 con 0x7fb2e40038e0 2023-08-17T17:46:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.225+0000 7fb2e3fff700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2e805ee70 0x7fb2e8061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.225+0000 7fb2e3fff700 1 -- 172.21.15.78:0/2364210667 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fb2ec07b360 con 0x7fb2e40038e0 2023-08-17T17:46:29.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.225+0000 7fb2fb7fe700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2e805ee70 0x7fb2e8061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:29.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.225+0000 7fb2fb7fe700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2e805ee70 0x7fb2e8061330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb2fc167b40 tx=0x7fb2f0009060).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:29.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.229+0000 7fb2e3fff700 1 -- 172.21.15.78:0/2364210667 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2ec04c810 con 0x7fb2e40038e0 2023-08-17T17:46:29.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.415+0000 7fb302555700 1 -- 172.21.15.78:0/2364210667 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2fc0acc70 con 0x7fb2e805ee70 2023-08-17T17:46:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.418+0000 7fb2e3fff700 1 -- 172.21.15.78:0/2364210667 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fb2f0019070 con 0x7fb2e805ee70 2023-08-17T17:46:29.419 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-08-17T17:46:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.420+0000 7fb302555700 1 -- 172.21.15.78:0/2364210667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2e805ee70 msgr2=0x7fb2e8061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.420+0000 7fb302555700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2e805ee70 0x7fb2e8061330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb2fc167b40 tx=0x7fb2f0009060).stop 2023-08-17T17:46:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.420+0000 7fb302555700 1 -- 172.21.15.78:0/2364210667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 msgr2=0x7fb2fc144b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.420+0000 7fb302555700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 0x7fb2fc144b00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fb2ec008010 tx=0x7fb2ec008040).stop 2023-08-17T17:46:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.420+0000 7fb302555700 1 -- 172.21.15.78:0/2364210667 shutdown_connections 2023-08-17T17:46:29.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.420+0000 7fb302555700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb2e805ee70 0x7fb2e8061330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:29.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.420+0000 7fb302555700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2fc0ad760 0x7fb2fc098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:29.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.420+0000 7fb302555700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e40038e0 0x7fb2fc144b00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:29.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.420+0000 7fb302555700 1 --2- 172.21.15.78:0/2364210667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2fc0ad2e0 0x7fb2fc0982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:29.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.421+0000 7fb302555700 1 -- 172.21.15.78:0/2364210667 >> 172.21.15.78:0/2364210667 conn(0x7fb2fc06a6a0 msgr2=0x7fb2fc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:29.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.421+0000 7fb302555700 1 -- 172.21.15.78:0/2364210667 shutdown_connections 2023-08-17T17:46:29.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:29.421+0000 7fb302555700 1 -- 172.21.15.78:0/2364210667 wait complete. 2023-08-17T17:46:29.433 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-08-17T17:46:29.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.434 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-08-17T17:46:29.449 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:29.449 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:29.449 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:29.449 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:29.449 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:29.450 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:29.450 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:29.450 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:29.450 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:29.450 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:29.450 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:29.451 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:29.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.452 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_36_00_UTC) 2023-08-17T17:46:29.521 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:29.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.522 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_37_00_UTC) 2023-08-17T17:46:29.582 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:29.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.583 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_38_00_UTC) 2023-08-17T17:46:29.650 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:29.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.651 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_39_00_UTC) 2023-08-17T17:46:29.719 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:29.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.719 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_40_00_UTC) 2023-08-17T17:46:29.797 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:29.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.798 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_41_00_UTC) 2023-08-17T17:46:29.860 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:29.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.861 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_42_00_UTC) 2023-08-17T17:46:29.921 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:29.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.921 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_43_00_UTC) 2023-08-17T17:46:29.980 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:29.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:29.981 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_44_00_UTC) 2023-08-17T17:46:30.041 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:30.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:30.041 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_45_00_UTC) 2023-08-17T17:46:30.100 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:30.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:30.101 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-17-17_46_00_UTC) 2023-08-17T17:46:30.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:30.162 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-08-17T17:46:30.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-08-17T17:46:30.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.379+0000 7f8c3b403700 1 Processor -- start 2023-08-17T17:46:30.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.379+0000 7f8c3b403700 1 -- start start 2023-08-17T17:46:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.380+0000 7f8c3b403700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c340bde20 0x7f8c340c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.380+0000 7f8c3b403700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c340c3650 con 0x7f8c3413a240 2023-08-17T17:46:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.380+0000 7f8c3b403700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c340c3930 con 0x7f8c340bda40 2023-08-17T17:46:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.380+0000 7f8c3b403700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c340c3460 con 0x7f8c340bde20 2023-08-17T17:46:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.380+0000 7f8c39c00700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c340bde20 0x7f8c340c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.380+0000 7f8c39c00700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c340bde20 0x7f8c340c2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41976/0 (socket says 172.21.15.78:41976) 2023-08-17T17:46:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.380+0000 7f8c39c00700 1 -- 172.21.15.78:0/2796800025 learned_addr learned my addr 172.21.15.78:0/2796800025 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.380+0000 7f8c39c00700 1 -- 172.21.15.78:0/2796800025 >> v1:172.21.15.150:6789/0 conn(0x7f8c340bda40 legacy=0x7f8c34069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.380+0000 7f8c39c00700 1 -- 172.21.15.78:0/2796800025 >> v1:172.21.15.78:6789/0 conn(0x7f8c3413a240 legacy=0x7f8c3413a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.380+0000 7f8c39c00700 1 -- 172.21.15.78:0/2796800025 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c340c3c10 con 0x7f8c340bde20 2023-08-17T17:46:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.381+0000 7f8c39c00700 1 --2- 172.21.15.78:0/2796800025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c340bde20 0x7f8c340c2f70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f8c24006fd0 tx=0x7f8c240090f0).ready entity=mon.0 client_cookie=5639a3dceb84d3ed server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:30.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.381+0000 7f8c393ff700 1 -- 172.21.15.78:0/2796800025 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400b600 con 0x7f8c340bde20 2023-08-17T17:46:30.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.381+0000 7f8c393ff700 1 -- 172.21.15.78:0/2796800025 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2400b760 con 0x7f8c340bde20 2023-08-17T17:46:30.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.381+0000 7f8c393ff700 1 -- 172.21.15.78:0/2796800025 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400bae0 con 0x7f8c340bde20 2023-08-17T17:46:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.381+0000 7f8c3b403700 1 -- 172.21.15.78:0/2796800025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c340bde20 msgr2=0x7f8c340c2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.381+0000 7f8c3b403700 1 --2- 172.21.15.78:0/2796800025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c340bde20 0x7f8c340c2f70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f8c24006fd0 tx=0x7f8c240090f0).stop 2023-08-17T17:46:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.381+0000 7f8c3b403700 1 -- 172.21.15.78:0/2796800025 shutdown_connections 2023-08-17T17:46:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.381+0000 7f8c3b403700 1 --2- 172.21.15.78:0/2796800025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c340bde20 0x7f8c340c2f70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.381+0000 7f8c3b403700 1 -- 172.21.15.78:0/2796800025 >> 172.21.15.78:0/2796800025 conn(0x7f8c340c7c10 msgr2=0x7f8c340c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.382+0000 7f8c3b403700 1 -- 172.21.15.78:0/2796800025 shutdown_connections 2023-08-17T17:46:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.382+0000 7f8c3b403700 1 -- 172.21.15.78:0/2796800025 wait complete. 2023-08-17T17:46:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.383+0000 7f8c3b403700 1 Processor -- start 2023-08-17T17:46:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.383+0000 7f8c3b403700 1 -- start start 2023-08-17T17:46:30.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.383+0000 7f8c3b403700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c340bda40 0x7f8c34150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.383+0000 7f8c3b403700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c340bde20 0x7f8c340c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.383+0000 7f8c3b403700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c3413a240 0x7f8c340c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.383+0000 7f8c3b403700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340c7970 con 0x7f8c3413a240 2023-08-17T17:46:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.383+0000 7f8c3b403700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340ab810 con 0x7f8c340bde20 2023-08-17T17:46:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.383+0000 7f8c3b403700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340aac40 con 0x7f8c340bda40 2023-08-17T17:46:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3ac02700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c3413a240 0x7f8c340c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3ac02700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c3413a240 0x7f8c340c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41982/0 (socket says 172.21.15.78:41982) 2023-08-17T17:46:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3ac02700 1 -- 172.21.15.78:0/1966057422 learned_addr learned my addr 172.21.15.78:0/1966057422 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c39c00700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c340bde20 0x7f8c340c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3a401700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c340bda40 0x7f8c34150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3ac02700 1 -- 172.21.15.78:0/1966057422 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c340bda40 msgr2=0x7f8c34150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3ac02700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c340bda40 0x7f8c34150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3ac02700 1 -- 172.21.15.78:0/1966057422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c340bde20 msgr2=0x7f8c340c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3ac02700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c340bde20 0x7f8c340c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3ac02700 1 -- 172.21.15.78:0/1966057422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24009370 con 0x7f8c3413a240 2023-08-17T17:46:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3ac02700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c3413a240 0x7f8c340c7480 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f8c2c00c7c0 tx=0x7f8c2c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c2a7fc700 1 -- 172.21.15.78:0/1966057422 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c00e4a0 con 0x7f8c3413a240 2023-08-17T17:46:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c2a7fc700 1 -- 172.21.15.78:0/1966057422 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c00e600 con 0x7f8c3413a240 2023-08-17T17:46:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c2a7fc700 1 -- 172.21.15.78:0/1966057422 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c00e980 con 0x7f8c3413a240 2023-08-17T17:46:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3b403700 1 -- 172.21.15.78:0/1966057422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c340aaee0 con 0x7f8c3413a240 2023-08-17T17:46:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.384+0000 7f8c3b403700 1 -- 172.21.15.78:0/1966057422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c340ab4a0 con 0x7f8c3413a240 2023-08-17T17:46:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.385+0000 7f8c3b403700 1 -- 172.21.15.78:0/1966057422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3405f910 con 0x7f8c3413a240 2023-08-17T17:46:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.385+0000 7f8c2a7fc700 1 -- 172.21.15.78:0/1966057422 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f8c2c010070 con 0x7f8c3413a240 2023-08-17T17:46:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.386+0000 7f8c2a7fc700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c1805ee40 0x7f8c18061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.386+0000 7f8c2a7fc700 1 -- 172.21.15.78:0/1966057422 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7114+0+0 (secure 0 0 0) 0x7f8c2c0796c0 con 0x7f8c3413a240 2023-08-17T17:46:30.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.386+0000 7f8c3a401700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c1805ee40 0x7f8c18061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:30.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.386+0000 7f8c3a401700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c1805ee40 0x7f8c18061300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8c300038e0 tx=0x7f8c30007d40).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:30.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.390+0000 7f8c2a7fc700 1 -- 172.21.15.78:0/1966057422 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c2c0478f0 con 0x7f8c3413a240 2023-08-17T17:46:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.591+0000 7f8c3b403700 1 -- 172.21.15.78:0/1966057422 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c340c3ef0 con 0x7f8c1805ee40 2023-08-17T17:46:30.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.595+0000 7f8c2a7fc700 1 -- 172.21.15.78:0/1966057422 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f8c340c3ef0 con 0x7f8c1805ee40 2023-08-17T17:46:30.598 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-08-17T17:46:30.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.599+0000 7f8c3b403700 1 -- 172.21.15.78:0/1966057422 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c1805ee40 msgr2=0x7f8c18061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:30.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.599+0000 7f8c3b403700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c1805ee40 0x7f8c18061300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8c300038e0 tx=0x7f8c30007d40).stop 2023-08-17T17:46:30.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.599+0000 7f8c3b403700 1 -- 172.21.15.78:0/1966057422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c3413a240 msgr2=0x7f8c340c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:30.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.599+0000 7f8c3b403700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c3413a240 0x7f8c340c7480 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f8c2c00c7c0 tx=0x7f8c2c001510).stop 2023-08-17T17:46:30.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.599+0000 7f8c3b403700 1 -- 172.21.15.78:0/1966057422 shutdown_connections 2023-08-17T17:46:30.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.599+0000 7f8c3b403700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c1805ee40 0x7f8c18061300 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0x7f8c300038e0 tx=0x7f8c30007d40).stop 2023-08-17T17:46:30.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.599+0000 7f8c3b403700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c3413a240 0x7f8c340c7480 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:30.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.599+0000 7f8c3b403700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c340bda40 0x7f8c34150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:30.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.599+0000 7f8c3b403700 1 --2- 172.21.15.78:0/1966057422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c340bde20 0x7f8c340c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:30.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.599+0000 7f8c3b403700 1 -- 172.21.15.78:0/1966057422 >> 172.21.15.78:0/1966057422 conn(0x7f8c340c7c10 msgr2=0x7f8c34065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:30.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.600+0000 7f8c3b403700 1 -- 172.21.15.78:0/1966057422 shutdown_connections 2023-08-17T17:46:30.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:30.600+0000 7f8c3b403700 1 -- 172.21.15.78:0/1966057422 wait complete. 2023-08-17T17:46:30.615 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-08-17T17:46:30.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:30.616 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-08-17T17:46:30.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:30.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:30.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:30.631 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:30.632 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:30.632 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:30.632 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:30.632 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:30.632 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:30.632 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:30.632 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:30.633 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:30.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:30.634 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_36_00_UTC) 2023-08-17T17:46:30.705 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:30.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:30.706 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_37_00_UTC) 2023-08-17T17:46:30.766 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:30.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:30.766 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_38_00_UTC) 2023-08-17T17:46:30.826 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:30.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:30.827 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_39_00_UTC) 2023-08-17T17:46:30.885 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:30.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:30.886 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_40_00_UTC) 2023-08-17T17:46:30.945 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:30.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:30.945 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_41_00_UTC) 2023-08-17T17:46:31.005 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:31.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.006 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_42_00_UTC) 2023-08-17T17:46:31.065 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:31.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.065 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_43_00_UTC) 2023-08-17T17:46:31.125 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:31.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.125 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_44_00_UTC) 2023-08-17T17:46:31.185 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:31.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.185 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_45_00_UTC) 2023-08-17T17:46:31.245 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:31.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.246 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-17-17_46_00_UTC) 2023-08-17T17:46:31.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.306 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-08-17T17:46:31.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-08-17T17:46:31.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.531+0000 7ff26a57c700 1 Processor -- start 2023-08-17T17:46:31.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.532+0000 7ff26a57c700 1 -- start start 2023-08-17T17:46:31.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.532+0000 7ff26a57c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff2640bc980 0x7ff2640695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.532+0000 7ff26a57c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2640bd2d0 con 0x7ff2641506c0 2023-08-17T17:46:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.532+0000 7ff26a57c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff264069130 con 0x7ff2641502e0 2023-08-17T17:46:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.532+0000 7ff26a57c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2640c1f40 con 0x7ff2640bc980 2023-08-17T17:46:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff268b19700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff2641506c0 0x7ff2640c4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45068/0 (socket says 172.21.15.78:45068) 2023-08-17T17:46:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff268b19700 1 -- 172.21.15.78:0/3654230403 learned_addr learned my addr 172.21.15.78:0/3654230403 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706518799 0 0) 0x7ff2640bd2d0 con 0x7ff2641506c0 2023-08-17T17:46:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff24c0033f0 con 0x7ff2641506c0 2023-08-17T17:46:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff2637fe700 1 --2- 172.21.15.78:0/3654230403 >> v2:172.21.15.150:3300/0 conn(0x7ff2640bc980 0x7ff2640695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 552645749 0 0) 0x7ff24c0033f0 con 0x7ff2641506c0 2023-08-17T17:46:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 >> v2:172.21.15.150:3300/0 conn(0x7ff2640bc980 msgr2=0x7ff2640695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 --2- 172.21.15.78:0/3654230403 >> v2:172.21.15.150:3300/0 conn(0x7ff2640bc980 0x7ff2640695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 >> v1:172.21.15.150:6789/0 conn(0x7ff2641502e0 legacy=0x7ff2640bc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2640bd520 con 0x7ff2641506c0 2023-08-17T17:46:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7ff25c0017f0 con 0x7ff2641506c0 2023-08-17T17:46:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 >> v1:172.21.15.78:6789/0 conn(0x7ff2641506c0 legacy=0x7ff2640c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c0038e0 0x7ff24c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff24c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff24c005050 0x7ff24c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2640c1f40 con 0x7ff24c004690 2023-08-17T17:46:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c00bfe0 con 0x7ff24c005050 2023-08-17T17:46:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c00c1a0 con 0x7ff24c0038e0 2023-08-17T17:46:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff2637fe700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff24c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff263fff700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c0038e0 0x7ff24c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff268b19700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff24c005050 0x7ff24c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff2637fe700 1 -- 172.21.15.78:0/3654230403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c0038e0 msgr2=0x7ff24c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff2637fe700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c0038e0 0x7ff24c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff2637fe700 1 -- 172.21.15.78:0/3654230403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff24c005050 msgr2=0x7ff24c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.533+0000 7ff2637fe700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff24c005050 0x7ff24c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff268b19700 1 -- 172.21.15.78:0/3654230403 reap_dead start 2023-08-17T17:46:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff2637fe700 1 -- 172.21.15.78:0/3654230403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c0033f0 con 0x7ff24c004690 2023-08-17T17:46:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff2637fe700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff24c004b10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7ff258006d80 tx=0x7ff258009060).ready entity=mon.0 client_cookie=ac8830c79056ee55 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258009e70 con 0x7ff24c004690 2023-08-17T17:46:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25800e610 con 0x7ff24c004690 2023-08-17T17:46:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff262ffd700 1 -- 172.21.15.78:0/3654230403 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25800e9d0 con 0x7ff24c004690 2023-08-17T17:46:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff26a57c700 1 -- 172.21.15.78:0/3654230403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 msgr2=0x7ff24c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:31.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff26a57c700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff24c004b10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7ff258006d80 tx=0x7ff258009060).stop 2023-08-17T17:46:31.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff26a57c700 1 -- 172.21.15.78:0/3654230403 shutdown_connections 2023-08-17T17:46:31.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff26a57c700 1 --2- 172.21.15.78:0/3654230403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff24c004b10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:31.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff26a57c700 1 -- 172.21.15.78:0/3654230403 >> 172.21.15.78:0/3654230403 conn(0x7ff2640c6a80 msgr2=0x7ff2640c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:31.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff26a57c700 1 -- 172.21.15.78:0/3654230403 shutdown_connections 2023-08-17T17:46:31.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.534+0000 7ff26a57c700 1 -- 172.21.15.78:0/3654230403 wait complete. 2023-08-17T17:46:31.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.535+0000 7ff26a57c700 1 Processor -- start 2023-08-17T17:46:31.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.536+0000 7ff26a57c700 1 -- start start 2023-08-17T17:46:31.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff26a57c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff26414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:31.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff26a57c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff26414db40 0x7ff2640c0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:31.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff26a57c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2640c0880 0x7ff264147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:31.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff26a57c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26414f770 con 0x7ff24c004690 2023-08-17T17:46:31.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff26a57c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff264147060 con 0x7ff26414db40 2023-08-17T17:46:31.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff26a57c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff264147340 con 0x7ff2640c0880 2023-08-17T17:46:31.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff263fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff26414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:31.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff263fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff26414eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41998/0 (socket says 172.21.15.78:41998) 2023-08-17T17:46:31.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff263fff700 1 -- 172.21.15.78:0/3894307403 learned_addr learned my addr 172.21.15.78:0/3894307403 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:31.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff268b19700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2640c0880 0x7ff264147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:31.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff2637fe700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff26414db40 0x7ff2640c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:31.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff268b19700 1 -- 172.21.15.78:0/3894307403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff26414db40 msgr2=0x7ff2640c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:31.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff268b19700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff26414db40 0x7ff2640c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:31.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff268b19700 1 -- 172.21.15.78:0/3894307403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 msgr2=0x7ff26414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:31.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff268b19700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff26414eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:31.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff268b19700 1 -- 172.21.15.78:0/3894307403 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff264147620 con 0x7ff2640c0880 2023-08-17T17:46:31.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.537+0000 7ff263fff700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff26414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:31.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.540+0000 7ff268b19700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2640c0880 0x7ff264147b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff2640c7800 tx=0x7ff25c007d50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.541+0000 7ff24bfff700 1 -- 172.21.15.78:0/3894307403 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00f840 con 0x7ff2640c0880 2023-08-17T17:46:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.541+0000 7ff24bfff700 1 -- 172.21.15.78:0/3894307403 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c00f9a0 con 0x7ff2640c0880 2023-08-17T17:46:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.542+0000 7ff24bfff700 1 -- 172.21.15.78:0/3894307403 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00fd60 con 0x7ff2640c0880 2023-08-17T17:46:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.542+0000 7ff26a57c700 1 -- 172.21.15.78:0/3894307403 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26414f3d0 con 0x7ff2640c0880 2023-08-17T17:46:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.544+0000 7ff26a57c700 1 -- 172.21.15.78:0/3894307403 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2641481f0 con 0x7ff2640c0880 2023-08-17T17:46:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.545+0000 7ff24bfff700 1 -- 172.21.15.78:0/3894307403 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7ff25c012560 con 0x7ff2640c0880 2023-08-17T17:46:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.546+0000 7ff24bfff700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff25005eec0 0x7ff250061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.546+0000 7ff24bfff700 1 -- 172.21.15.78:0/3894307403 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 7082+0+0 (secure 0 0 0) 0x7ff25c077590 con 0x7ff2640c0880 2023-08-17T17:46:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.546+0000 7ff263fff700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff25005eec0 0x7ff250061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.546+0000 7ff263fff700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff25005eec0 0x7ff250061380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff254007fd0 tx=0x7ff254007bb0).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:31.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.547+0000 7ff26a57c700 1 -- 172.21.15.78:0/3894307403 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff264147990 con 0x7ff2640c0880 2023-08-17T17:46:31.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.558+0000 7ff24bfff700 1 -- 172.21.15.78:0/3894307403 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff25c019030 con 0x7ff2640c0880 2023-08-17T17:46:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.777+0000 7ff26a57c700 1 -- 172.21.15.78:0/3894307403 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff264148440 con 0x7ff25005eec0 2023-08-17T17:46:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.781+0000 7ff24bfff700 1 -- 172.21.15.78:0/3894307403 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7ff264148440 con 0x7ff25005eec0 2023-08-17T17:46:31.781 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-08-17T17:46:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 -- 172.21.15.78:0/3894307403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff25005eec0 msgr2=0x7ff250061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff25005eec0 0x7ff250061380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff254007fd0 tx=0x7ff254007bb0).stop 2023-08-17T17:46:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 -- 172.21.15.78:0/3894307403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2640c0880 msgr2=0x7ff264147b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2640c0880 0x7ff264147b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff2640c7800 tx=0x7ff25c007d50).stop 2023-08-17T17:46:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 -- 172.21.15.78:0/3894307403 shutdown_connections 2023-08-17T17:46:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff25005eec0 0x7ff250061380 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2640c0880 0x7ff264147b40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff24c004690 0x7ff26414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 --2- 172.21.15.78:0/3894307403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff26414db40 0x7ff2640c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:31.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 -- 172.21.15.78:0/3894307403 >> 172.21.15.78:0/3894307403 conn(0x7ff2640c6a80 msgr2=0x7ff2640c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:31.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 -- 172.21.15.78:0/3894307403 shutdown_connections 2023-08-17T17:46:31.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:31.783+0000 7ff26a57c700 1 -- 172.21.15.78:0/3894307403 wait complete. 2023-08-17T17:46:31.795 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-08-17T17:46:31.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.795 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-08-17T17:46:31.811 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:31.811 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:31.812 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:31.812 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:31.812 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:31.812 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:31.812 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:31.812 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:31.812 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:31.813 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:31.813 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:31.813 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:31.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.814 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_36_00_UTC) 2023-08-17T17:46:31.874 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:31.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.875 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_37_00_UTC) 2023-08-17T17:46:31.935 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:31.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.936 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_38_00_UTC) 2023-08-17T17:46:31.996 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:31.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:31.997 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_39_00_UTC) 2023-08-17T17:46:32.057 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:32.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:32.057 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_40_00_UTC) 2023-08-17T17:46:32.118 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:32.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:32.119 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_41_00_UTC) 2023-08-17T17:46:32.173 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:46:32.179 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:32.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:32.180 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_42_00_UTC) 2023-08-17T17:46:32.221 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:46:32.241 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:32.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:32.241 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_43_00_UTC) 2023-08-17T17:46:32.325 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:32.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:32.326 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_44_00_UTC) 2023-08-17T17:46:32.387 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:32.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:32.388 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_45_00_UTC) 2023-08-17T17:46:32.450 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:32.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:32.450 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-17-17_46_00_UTC) 2023-08-17T17:46:32.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:32.516 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-08-17T17:46:32.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-08-17T17:46:32.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.745+0000 7fe10c6ef700 1 Processor -- start 2023-08-17T17:46:32.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.745+0000 7fe10c6ef700 1 -- start start 2023-08-17T17:46:32.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe10c6ef700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1040c5f20 0x7fe1040644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:32.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe10c6ef700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1040649b0 con 0x7fe1040aa4d0 2023-08-17T17:46:32.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe10c6ef700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe104063420 con 0x7fe1040aa0f0 2023-08-17T17:46:32.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe10c6ef700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe104063700 con 0x7fe1040c5f20 2023-08-17T17:46:32.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe10ac8c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1040c5f20 0x7fe1040644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:32.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe109c8a700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe1040aa4d0 0x7fe1040c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45080/0 (socket says 172.21.15.78:45080) 2023-08-17T17:46:32.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe109c8a700 1 -- 172.21.15.78:0/2967332359 learned_addr learned my addr 172.21.15.78:0/2967332359 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:32.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe109489700 1 -- 172.21.15.78:0/2967332359 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927643642 0 0) 0x7fe1040649b0 con 0x7fe1040aa4d0 2023-08-17T17:46:32.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe109489700 1 -- 172.21.15.78:0/2967332359 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0ec0033f0 con 0x7fe1040aa4d0 2023-08-17T17:46:32.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe10ac8c700 1 -- 172.21.15.78:0/2967332359 >> v1:172.21.15.150:6789/0 conn(0x7fe1040aa0f0 legacy=0x7fe1040c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:32.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe10ac8c700 1 -- 172.21.15.78:0/2967332359 >> v1:172.21.15.78:6789/0 conn(0x7fe1040aa4d0 legacy=0x7fe1040c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:32.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe10ac8c700 1 -- 172.21.15.78:0/2967332359 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1040639e0 con 0x7fe1040c5f20 2023-08-17T17:46:32.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe10ac8c700 1 --2- 172.21.15.78:0/2967332359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040c5f20 0x7fe1040644c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fe0f4009760 tx=0x7fe0f4009060).ready entity=mon.0 client_cookie=47709849c47af19f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:32.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.746+0000 7fe109489700 1 -- 172.21.15.78:0/2967332359 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400f510 con 0x7fe1040c5f20 2023-08-17T17:46:32.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.747+0000 7fe109489700 1 -- 172.21.15.78:0/2967332359 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f400f670 con 0x7fe1040c5f20 2023-08-17T17:46:32.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.747+0000 7fe109489700 1 -- 172.21.15.78:0/2967332359 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400f9f0 con 0x7fe1040c5f20 2023-08-17T17:46:32.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.747+0000 7fe10c6ef700 1 -- 172.21.15.78:0/2967332359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040c5f20 msgr2=0x7fe1040644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:32.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.747+0000 7fe10c6ef700 1 --2- 172.21.15.78:0/2967332359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040c5f20 0x7fe1040644c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fe0f4009760 tx=0x7fe0f4009060).stop 2023-08-17T17:46:32.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.747+0000 7fe10c6ef700 1 -- 172.21.15.78:0/2967332359 shutdown_connections 2023-08-17T17:46:32.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.747+0000 7fe10c6ef700 1 --2- 172.21.15.78:0/2967332359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040c5f20 0x7fe1040644c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:32.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.747+0000 7fe10c6ef700 1 -- 172.21.15.78:0/2967332359 >> 172.21.15.78:0/2967332359 conn(0x7fe10406a6a0 msgr2=0x7fe1040caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:32.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.747+0000 7fe10c6ef700 1 -- 172.21.15.78:0/2967332359 shutdown_connections 2023-08-17T17:46:32.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.747+0000 7fe10c6ef700 1 -- 172.21.15.78:0/2967332359 wait complete. 2023-08-17T17:46:32.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.748+0000 7fe10c6ef700 1 Processor -- start 2023-08-17T17:46:32.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.748+0000 7fe10c6ef700 1 -- start start 2023-08-17T17:46:32.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe10c6ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1040aa0f0 0x7fe1040afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:32.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe10c6ef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040aa4d0 0x7fe1040c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:32.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe10c6ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1040c5f20 0x7fe104140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:32.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe10c6ef700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040c4070 con 0x7fe1040aa4d0 2023-08-17T17:46:32.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe10c6ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040af830 con 0x7fe1040aa0f0 2023-08-17T17:46:32.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe10c6ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040aec20 con 0x7fe1040c5f20 2023-08-17T17:46:32.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe109c8a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040aa4d0 0x7fe1040c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:32.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe109c8a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040aa4d0 0x7fe1040c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42014/0 (socket says 172.21.15.78:42014) 2023-08-17T17:46:32.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe109c8a700 1 -- 172.21.15.78:0/3491571726 learned_addr learned my addr 172.21.15.78:0/3491571726 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:32.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe10a48b700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1040aa0f0 0x7fe1040afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:32.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe10ac8c700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1040c5f20 0x7fe104140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:32.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe109c8a700 1 -- 172.21.15.78:0/3491571726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1040c5f20 msgr2=0x7fe104140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:32.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe109c8a700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1040c5f20 0x7fe104140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:32.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe109c8a700 1 -- 172.21.15.78:0/3491571726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1040aa0f0 msgr2=0x7fe1040afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:32.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe109c8a700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1040aa0f0 0x7fe1040afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:32.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.749+0000 7fe109c8a700 1 -- 172.21.15.78:0/3491571726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40092a0 con 0x7fe1040aa4d0 2023-08-17T17:46:32.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.750+0000 7fe109c8a700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040aa4d0 0x7fe1040c30f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fe0f800c4c0 tx=0x7fe0f8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:32.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.750+0000 7fe1027fc700 1 -- 172.21.15.78:0/3491571726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f800ce70 con 0x7fe1040aa4d0 2023-08-17T17:46:32.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.750+0000 7fe1027fc700 1 -- 172.21.15.78:0/3491571726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f80072e0 con 0x7fe1040aa4d0 2023-08-17T17:46:32.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.750+0000 7fe10c6ef700 1 -- 172.21.15.78:0/3491571726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1040aef00 con 0x7fe1040aa4d0 2023-08-17T17:46:32.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.750+0000 7fe1027fc700 1 -- 172.21.15.78:0/3491571726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80057a0 con 0x7fe1040aa4d0 2023-08-17T17:46:32.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.750+0000 7fe10c6ef700 1 -- 172.21.15.78:0/3491571726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1040af4c0 con 0x7fe1040aa4d0 2023-08-17T17:46:32.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.751+0000 7fe10c6ef700 1 -- 172.21.15.78:0/3491571726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1040af9e0 con 0x7fe1040aa4d0 2023-08-17T17:46:32.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.751+0000 7fe1027fc700 1 -- 172.21.15.78:0/3491571726 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fe0f801a060 con 0x7fe1040aa4d0 2023-08-17T17:46:32.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.751+0000 7fe1027fc700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe0f005ee70 0x7fe0f0061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:32.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.751+0000 7fe1027fc700 1 -- 172.21.15.78:0/3491571726 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fe0f8079620 con 0x7fe1040aa4d0 2023-08-17T17:46:32.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.752+0000 7fe10a48b700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe0f005ee70 0x7fe0f0061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:32.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.752+0000 7fe10a48b700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe0f005ee70 0x7fe0f0061330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe0fc004290 tx=0x7fe0fc001560).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:32.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.756+0000 7fe1027fc700 1 -- 172.21.15.78:0/3491571726 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1040af9e0 con 0x7fe1040aa4d0 2023-08-17T17:46:32.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.945+0000 7fe10c6ef700 1 -- 172.21.15.78:0/3491571726 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1040af9a0 con 0x7fe0f005ee70 2023-08-17T17:46:32.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.948+0000 7fe1027fc700 1 -- 172.21.15.78:0/3491571726 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fe1040af9a0 con 0x7fe0f005ee70 2023-08-17T17:46:32.948 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-08-17T17:46:32.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 -- 172.21.15.78:0/3491571726 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe0f005ee70 msgr2=0x7fe0f0061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:32.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe0f005ee70 0x7fe0f0061330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe0fc004290 tx=0x7fe0fc001560).stop 2023-08-17T17:46:32.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 -- 172.21.15.78:0/3491571726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040aa4d0 msgr2=0x7fe1040c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:32.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040aa4d0 0x7fe1040c30f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fe0f800c4c0 tx=0x7fe0f8007c50).stop 2023-08-17T17:46:32.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 -- 172.21.15.78:0/3491571726 shutdown_connections 2023-08-17T17:46:32.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe0f005ee70 0x7fe0f0061330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:32.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1040c5f20 0x7fe104140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:32.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1040aa0f0 0x7fe1040afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:32.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 --2- 172.21.15.78:0/3491571726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1040aa4d0 0x7fe1040c30f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:32.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 -- 172.21.15.78:0/3491571726 >> 172.21.15.78:0/3491571726 conn(0x7fe10406a6a0 msgr2=0x7fe104153b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:32.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 -- 172.21.15.78:0/3491571726 shutdown_connections 2023-08-17T17:46:32.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:32.950+0000 7fe10c6ef700 1 -- 172.21.15.78:0/3491571726 wait complete. 2023-08-17T17:46:32.961 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-08-17T17:46:32.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:32.962 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-08-17T17:46:32.977 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:32.977 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:32.977 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:32.978 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:32.978 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:32.978 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:32.978 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:32.978 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:32.978 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:32.978 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:32.979 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:32.979 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:32.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:32.980 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_36_00_UTC) 2023-08-17T17:46:33.042 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:33.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.043 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_37_00_UTC) 2023-08-17T17:46:33.103 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:33.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.103 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_38_00_UTC) 2023-08-17T17:46:33.163 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:33.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.164 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_39_00_UTC) 2023-08-17T17:46:33.225 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:33.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.225 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_40_00_UTC) 2023-08-17T17:46:33.285 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:33.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.286 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_41_00_UTC) 2023-08-17T17:46:33.346 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:33.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.347 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_42_00_UTC) 2023-08-17T17:46:33.407 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:33.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.408 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_43_00_UTC) 2023-08-17T17:46:33.469 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:33.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.469 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_44_00_UTC) 2023-08-17T17:46:33.543 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:33.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.543 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_45_00_UTC) 2023-08-17T17:46:33.604 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:33.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.605 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-17-17_46_00_UTC) 2023-08-17T17:46:33.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:33.666 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-08-17T17:46:33.723 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-08-17T17:46:33.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.888+0000 7f7529b2b700 1 Processor -- start 2023-08-17T17:46:33.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.888+0000 7f7529b2b700 1 -- start start 2023-08-17T17:46:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.888+0000 7f7529b2b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7524151a40 0x7f75240c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.888+0000 7f7529b2b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524157be0 0x7f7524158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.888+0000 7f7529b2b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7524158560 con 0x7f7524151e20 2023-08-17T17:46:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.888+0000 7f7529b2b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75240c6620 con 0x7f7524151a40 2023-08-17T17:46:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.888+0000 7f7529b2b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75240c6900 con 0x7f7524157be0 2023-08-17T17:46:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f7528b29700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7524151a40 0x7f75240c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f751bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7524151e20 0x7f75240c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45092/0 (socket says 172.21.15.78:45092) 2023-08-17T17:46:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f751bfff700 1 -- 172.21.15.78:0/1498925981 learned_addr learned my addr 172.21.15.78:0/1498925981 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f7528b29700 1 -- 172.21.15.78:0/1498925981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524157be0 msgr2=0x7f7524158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f752932a700 1 --2- 172.21.15.78:0/1498925981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524157be0 0x7f7524158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f751b7fe700 1 -- 172.21.15.78:0/1498925981 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628946921 0 0) 0x7f7524158560 con 0x7f7524151e20 2023-08-17T17:46:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f7528b29700 1 --2- 172.21.15.78:0/1498925981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524157be0 0x7f7524158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f7528b29700 1 -- 172.21.15.78:0/1498925981 >> v1:172.21.15.78:6789/0 conn(0x7f7524151e20 legacy=0x7f75240c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f7528b29700 1 -- 172.21.15.78:0/1498925981 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75240c6be0 con 0x7f7524151a40 2023-08-17T17:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f752932a700 1 --2- 172.21.15.78:0/1498925981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524157be0 0x7f7524158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f7528b29700 1 --2- 172.21.15.78:0/1498925981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524151a40 0x7f75240c8260 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f7520006fd0 tx=0x7f7520006f40).ready entity=mon.0 client_cookie=23260b19a0ade939 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f751b7fe700 1 -- 172.21.15.78:0/1498925981 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520005880 con 0x7f7524151a40 2023-08-17T17:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f751b7fe700 1 -- 172.21.15.78:0/1498925981 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75200059e0 con 0x7f7524151a40 2023-08-17T17:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.889+0000 7f751b7fe700 1 -- 172.21.15.78:0/1498925981 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520005d60 con 0x7f7524151a40 2023-08-17T17:46:33.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.890+0000 7f7529b2b700 1 -- 172.21.15.78:0/1498925981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524151a40 msgr2=0x7f75240c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:33.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.890+0000 7f7529b2b700 1 --2- 172.21.15.78:0/1498925981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524151a40 0x7f75240c8260 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f7520006fd0 tx=0x7f7520006f40).stop 2023-08-17T17:46:33.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.890+0000 7f7529b2b700 1 -- 172.21.15.78:0/1498925981 shutdown_connections 2023-08-17T17:46:33.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.890+0000 7f7529b2b700 1 --2- 172.21.15.78:0/1498925981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524157be0 0x7f7524158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:33.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.890+0000 7f7529b2b700 1 --2- 172.21.15.78:0/1498925981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524151a40 0x7f75240c8260 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:33.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.890+0000 7f7529b2b700 1 -- 172.21.15.78:0/1498925981 >> 172.21.15.78:0/1498925981 conn(0x7f75240943b0 msgr2=0x7f752406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:33.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.890+0000 7f7529b2b700 1 -- 172.21.15.78:0/1498925981 shutdown_connections 2023-08-17T17:46:33.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.890+0000 7f7529b2b700 1 -- 172.21.15.78:0/1498925981 wait complete. 2023-08-17T17:46:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.891+0000 7f7529b2b700 1 Processor -- start 2023-08-17T17:46:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.891+0000 7f7529b2b700 1 -- start start 2023-08-17T17:46:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f7529b2b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524151a40 0x7f75240af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f7529b2b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7524151e20 0x7f7524063460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f7529b2b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524157be0 0x7f7524063950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f7529b2b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7524063e40 con 0x7f7524157be0 2023-08-17T17:46:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f7529b2b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75240b0520 con 0x7f7524151e20 2023-08-17T17:46:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f7529b2b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752414ded0 con 0x7f7524151a40 2023-08-17T17:46:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f752932a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524157be0 0x7f7524063950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f752932a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524157be0 0x7f7524063950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42032/0 (socket says 172.21.15.78:42032) 2023-08-17T17:46:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f752932a700 1 -- 172.21.15.78:0/3683909359 learned_addr learned my addr 172.21.15.78:0/3683909359 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f7528b29700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524151a40 0x7f75240af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f751bfff700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7524151e20 0x7f7524063460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f752932a700 1 -- 172.21.15.78:0/3683909359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524151a40 msgr2=0x7f75240af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f752932a700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524151a40 0x7f75240af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f752932a700 1 -- 172.21.15.78:0/3683909359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7524151e20 msgr2=0x7f7524063460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f752932a700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7524151e20 0x7f7524063460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f752932a700 1 -- 172.21.15.78:0/3683909359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009250 con 0x7f7524157be0 2023-08-17T17:46:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f751bfff700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7524151e20 0x7f7524063460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f752932a700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524157be0 0x7f7524063950 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f751c00a380 tx=0x7f751c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.892+0000 7f7518ff9700 1 -- 172.21.15.78:0/3683909359 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00ae10 con 0x7f7524157be0 2023-08-17T17:46:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.893+0000 7f7518ff9700 1 -- 172.21.15.78:0/3683909359 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c00d650 con 0x7f7524157be0 2023-08-17T17:46:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.893+0000 7f7529b2b700 1 -- 172.21.15.78:0/3683909359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75240af9a0 con 0x7f7524157be0 2023-08-17T17:46:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.893+0000 7f7518ff9700 1 -- 172.21.15.78:0/3683909359 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00d9d0 con 0x7f7524157be0 2023-08-17T17:46:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.893+0000 7f7529b2b700 1 -- 172.21.15.78:0/3683909359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75240aff60 con 0x7f7524157be0 2023-08-17T17:46:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.894+0000 7f7529b2b700 1 -- 172.21.15.78:0/3683909359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7524082f90 con 0x7f7524157be0 2023-08-17T17:46:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.894+0000 7f7518ff9700 1 -- 172.21.15.78:0/3683909359 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f751c0203f0 con 0x7f7524157be0 2023-08-17T17:46:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.894+0000 7f7518ff9700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f751005ee40 0x7f7510061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.894+0000 7f7518ff9700 1 -- 172.21.15.78:0/3683909359 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f751c07aed0 con 0x7f7524157be0 2023-08-17T17:46:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.894+0000 7f7528b29700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f751005ee40 0x7f7510061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.895+0000 7f7528b29700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f751005ee40 0x7f7510061300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f7520006f80 tx=0x7f7520016000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:33.898+0000 7f7518ff9700 1 -- 172.21.15.78:0/3683909359 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f751c04c040 con 0x7f7524157be0 2023-08-17T17:46:34.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.100+0000 7f7529b2b700 1 -- 172.21.15.78:0/3683909359 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f752405f910 con 0x7f751005ee40 2023-08-17T17:46:34.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.103+0000 7f7518ff9700 1 -- 172.21.15.78:0/3683909359 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f752405f910 con 0x7f751005ee40 2023-08-17T17:46:34.104 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-08-17T17:46:34.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.105+0000 7f7529b2b700 1 -- 172.21.15.78:0/3683909359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f751005ee40 msgr2=0x7f7510061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:34.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.105+0000 7f7529b2b700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f751005ee40 0x7f7510061300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f7520006f80 tx=0x7f7520016000).stop 2023-08-17T17:46:34.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.105+0000 7f7529b2b700 1 -- 172.21.15.78:0/3683909359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524157be0 msgr2=0x7f7524063950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:34.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.105+0000 7f7529b2b700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524157be0 0x7f7524063950 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f751c00a380 tx=0x7f751c007900).stop 2023-08-17T17:46:34.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.105+0000 7f7529b2b700 1 -- 172.21.15.78:0/3683909359 shutdown_connections 2023-08-17T17:46:34.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.105+0000 7f7529b2b700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f751005ee40 0x7f7510061300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:34.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.105+0000 7f7529b2b700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7524157be0 0x7f7524063950 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:34.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.105+0000 7f7529b2b700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7524151a40 0x7f75240af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:34.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.105+0000 7f7529b2b700 1 --2- 172.21.15.78:0/3683909359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7524151e20 0x7f7524063460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:34.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.105+0000 7f7529b2b700 1 -- 172.21.15.78:0/3683909359 >> 172.21.15.78:0/3683909359 conn(0x7f75240943b0 msgr2=0x7f7524150c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:34.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.106+0000 7f7529b2b700 1 -- 172.21.15.78:0/3683909359 shutdown_connections 2023-08-17T17:46:34.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:34.106+0000 7f7529b2b700 1 -- 172.21.15.78:0/3683909359 wait complete. 2023-08-17T17:46:34.117 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-08-17T17:46:34.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.118 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-08-17T17:46:34.133 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:34.134 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:34.134 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:34.134 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:34.134 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:34.134 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:34.134 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:34.134 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:34.135 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:34.135 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:34.135 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:34.135 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:34.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.136 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_36_00_UTC) 2023-08-17T17:46:34.198 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:34.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.198 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_37_00_UTC) 2023-08-17T17:46:34.259 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:34.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.260 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_38_00_UTC) 2023-08-17T17:46:34.319 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:34.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.320 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_39_00_UTC) 2023-08-17T17:46:34.381 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:34.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.382 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_40_00_UTC) 2023-08-17T17:46:34.444 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:34.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.445 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_41_00_UTC) 2023-08-17T17:46:34.518 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:34.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.519 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_42_00_UTC) 2023-08-17T17:46:34.580 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:34.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.581 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_43_00_UTC) 2023-08-17T17:46:34.640 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:34.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.644 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_44_00_UTC) 2023-08-17T17:46:34.700 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:34.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.701 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_45_00_UTC) 2023-08-17T17:46:34.763 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:34.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.764 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-17-17_46_00_UTC) 2023-08-17T17:46:34.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:34.827 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-08-17T17:46:34.888 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-08-17T17:46:35.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.051+0000 7f3513f69700 1 Processor -- start 2023-08-17T17:46:35.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.052+0000 7f3513f69700 1 -- start start 2023-08-17T17:46:35.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.053+0000 7f3513f69700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa0f0 0x7f350c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:35.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.053+0000 7f3513f69700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f350c0c5810 0x7f350c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.053+0000 7f3513f69700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c0649b0 con 0x7f350c0aa4d0 2023-08-17T17:46:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.053+0000 7f3513f69700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c0c6170 con 0x7f350c0c5810 2023-08-17T17:46:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.053+0000 7f3513f69700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c063420 con 0x7f350c0aa0f0 2023-08-17T17:46:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.053+0000 7f3512506700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f350c0c5810 0x7f350c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.053+0000 7f3511504700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f350c0aa4d0 0x7f350c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45096/0 (socket says 172.21.15.78:45096) 2023-08-17T17:46:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.053+0000 7f3511504700 1 -- 172.21.15.78:0/441673006 learned_addr learned my addr 172.21.15.78:0/441673006 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.053+0000 7f3511d05700 1 --2- 172.21.15.78:0/441673006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa0f0 0x7f350c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.054+0000 7f3510d03700 1 -- 172.21.15.78:0/441673006 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885510582 0 0) 0x7f350c0649b0 con 0x7f350c0aa4d0 2023-08-17T17:46:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.054+0000 7f3510d03700 1 -- 172.21.15.78:0/441673006 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34f80033f0 con 0x7f350c0aa4d0 2023-08-17T17:46:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.054+0000 7f3512506700 1 -- 172.21.15.78:0/441673006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa0f0 msgr2=0x7f350c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.054+0000 7f3512506700 1 --2- 172.21.15.78:0/441673006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa0f0 0x7f350c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.054+0000 7f3512506700 1 -- 172.21.15.78:0/441673006 >> v1:172.21.15.78:6789/0 conn(0x7f350c0aa4d0 legacy=0x7f350c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.054+0000 7f3512506700 1 -- 172.21.15.78:0/441673006 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c063700 con 0x7f350c0c5810 2023-08-17T17:46:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.054+0000 7f3512506700 1 --2- 172.21.15.78:0/441673006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c0c5810 0x7f350c0c5c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3508009760 tx=0x7f3508009060).ready entity=mon.1 client_cookie=34642863659f504d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.054+0000 7f3510d03700 1 -- 172.21.15.78:0/441673006 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350800d4a0 con 0x7f350c0c5810 2023-08-17T17:46:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.054+0000 7f3510d03700 1 -- 172.21.15.78:0/441673006 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350800d600 con 0x7f350c0c5810 2023-08-17T17:46:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.054+0000 7f3510d03700 1 -- 172.21.15.78:0/441673006 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350800d980 con 0x7f350c0c5810 2023-08-17T17:46:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.055+0000 7f3513f69700 1 -- 172.21.15.78:0/441673006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c0c5810 msgr2=0x7f350c0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.055+0000 7f3513f69700 1 --2- 172.21.15.78:0/441673006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c0c5810 0x7f350c0c5c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3508009760 tx=0x7f3508009060).stop 2023-08-17T17:46:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.055+0000 7f3513f69700 1 -- 172.21.15.78:0/441673006 shutdown_connections 2023-08-17T17:46:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.055+0000 7f3513f69700 1 --2- 172.21.15.78:0/441673006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c0c5810 0x7f350c0c5c80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.055+0000 7f3513f69700 1 --2- 172.21.15.78:0/441673006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa0f0 0x7f350c0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.055+0000 7f3513f69700 1 -- 172.21.15.78:0/441673006 >> 172.21.15.78:0/441673006 conn(0x7f350c06a6a0 msgr2=0x7f350c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.056+0000 7f3513f69700 1 -- 172.21.15.78:0/441673006 shutdown_connections 2023-08-17T17:46:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.056+0000 7f3513f69700 1 -- 172.21.15.78:0/441673006 wait complete. 2023-08-17T17:46:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.057+0000 7f3513f69700 1 Processor -- start 2023-08-17T17:46:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.057+0000 7f3513f69700 1 -- start start 2023-08-17T17:46:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3513f69700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f350c0aa0f0 0x7f350c152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3513f69700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa4d0 0x7f350c153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3513f69700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c0c5810 0x7f350c153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3513f69700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c154170 con 0x7f350c0aa0f0 2023-08-17T17:46:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3513f69700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0ac2f0 con 0x7f350c0c5810 2023-08-17T17:46:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3513f69700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0abd10 con 0x7f350c0aa4d0 2023-08-17T17:46:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511504700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa4d0 0x7f350c153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511504700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa4d0 0x7f350c153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:56664/0 (socket says 172.21.15.78:56664) 2023-08-17T17:46:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511504700 1 -- 172.21.15.78:0/2679787988 learned_addr learned my addr 172.21.15.78:0/2679787988 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3512506700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c0c5810 0x7f350c153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511d05700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f350c0aa0f0 0x7f350c152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511504700 1 -- 172.21.15.78:0/2679787988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c0c5810 msgr2=0x7f350c153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511504700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c0c5810 0x7f350c153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511504700 1 -- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f350c0aa0f0 msgr2=0x7f350c152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511504700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f350c0aa0f0 0x7f350c152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511504700 1 -- 172.21.15.78:0/2679787988 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080092a0 con 0x7f350c0aa4d0 2023-08-17T17:46:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511d05700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f350c0aa0f0 0x7f350c152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.059+0000 7f3511504700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa4d0 0x7f350c153790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f34fc00c4f0 tx=0x7f34fc007c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.060+0000 7f3501ffb700 1 -- 172.21.15.78:0/2679787988 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0072e0 con 0x7f350c0aa4d0 2023-08-17T17:46:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.060+0000 7f3501ffb700 1 -- 172.21.15.78:0/2679787988 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc007440 con 0x7f350c0aa4d0 2023-08-17T17:46:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.060+0000 7f3501ffb700 1 -- 172.21.15.78:0/2679787988 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0057a0 con 0x7f350c0aa4d0 2023-08-17T17:46:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.060+0000 7f3513f69700 1 -- 172.21.15.78:0/2679787988 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c156be0 con 0x7f350c0aa4d0 2023-08-17T17:46:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.060+0000 7f3513f69700 1 -- 172.21.15.78:0/2679787988 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c0abf80 con 0x7f350c0aa4d0 2023-08-17T17:46:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.061+0000 7f3513f69700 1 -- 172.21.15.78:0/2679787988 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c062fc0 con 0x7f350c0aa4d0 2023-08-17T17:46:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.062+0000 7f3501ffb700 1 -- 172.21.15.78:0/2679787988 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f34fc010070 con 0x7f350c0aa4d0 2023-08-17T17:46:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.063+0000 7f3501ffb700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f34f005ee70 0x7f34f0061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.063+0000 7f3501ffb700 1 -- 172.21.15.78:0/2679787988 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f34fc079900 con 0x7f350c0aa4d0 2023-08-17T17:46:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.063+0000 7f3511d05700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f34f005ee70 0x7f34f0061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.064+0000 7f3511d05700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f34f005ee70 0x7f34f0061330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f35040076c0 tx=0x7f350400b040).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:35.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.067+0000 7f3501ffb700 1 -- 172.21.15.78:0/2679787988 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f34fc04aa50 con 0x7f350c0aa4d0 2023-08-17T17:46:35.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.253+0000 7f3513f69700 1 -- 172.21.15.78:0/2679787988 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f350c046af0 con 0x7f34f005ee70 2023-08-17T17:46:35.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.256+0000 7f3501ffb700 1 -- 172.21.15.78:0/2679787988 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f350c046af0 con 0x7f34f005ee70 2023-08-17T17:46:35.256 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-08-17T17:46:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 -- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f34f005ee70 msgr2=0x7f34f0061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f34f005ee70 0x7f34f0061330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f35040076c0 tx=0x7f350400b040).stop 2023-08-17T17:46:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 -- 172.21.15.78:0/2679787988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa4d0 msgr2=0x7f350c153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa4d0 0x7f350c153790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f34fc00c4f0 tx=0x7f34fc007c50).stop 2023-08-17T17:46:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 -- 172.21.15.78:0/2679787988 shutdown_connections 2023-08-17T17:46:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f34f005ee70 0x7f34f0061330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c0c5810 0x7f350c153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f350c0aa0f0 0x7f350c152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 --2- 172.21.15.78:0/2679787988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350c0aa4d0 0x7f350c153790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 -- 172.21.15.78:0/2679787988 >> 172.21.15.78:0/2679787988 conn(0x7f350c06a6a0 msgr2=0x7f350c0985c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:35.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 -- 172.21.15.78:0/2679787988 shutdown_connections 2023-08-17T17:46:35.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:35.258+0000 7f3513f69700 1 -- 172.21.15.78:0/2679787988 wait complete. 2023-08-17T17:46:35.269 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-08-17T17:46:35.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.270 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-08-17T17:46:35.285 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:35.285 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:35.285 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:35.286 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:35.286 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:35.286 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:35.286 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:35.286 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:35.286 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:35.286 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:35.286 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:35.287 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:35.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.288 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_36_00_UTC) 2023-08-17T17:46:35.349 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:35.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.350 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_37_00_UTC) 2023-08-17T17:46:35.411 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:35.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.412 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_38_00_UTC) 2023-08-17T17:46:35.480 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:35.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.481 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_39_00_UTC) 2023-08-17T17:46:35.544 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:35.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.545 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_40_00_UTC) 2023-08-17T17:46:35.605 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:35.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.605 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_41_00_UTC) 2023-08-17T17:46:35.672 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:35.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.673 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_42_00_UTC) 2023-08-17T17:46:35.735 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:35.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.736 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_43_00_UTC) 2023-08-17T17:46:35.795 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:35.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.796 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_44_00_UTC) 2023-08-17T17:46:35.855 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:35.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.856 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_45_00_UTC) 2023-08-17T17:46:35.915 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:35.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.916 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-17-17_46_00_UTC) 2023-08-17T17:46:35.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:35.975 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-08-17T17:46:36.032 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-08-17T17:46:36.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.188+0000 7f5b7e19d700 1 Processor -- start 2023-08-17T17:46:36.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.188+0000 7f5b7e19d700 1 -- start start 2023-08-17T17:46:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b7e19d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b780aa0f0 0x7f5b780644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b7e19d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780649b0 con 0x7f5b780aa4d0 2023-08-17T17:46:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b7e19d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b78063420 con 0x7f5b780c5810 2023-08-17T17:46:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b7e19d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b78063700 con 0x7f5b780aa0f0 2023-08-17T17:46:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b777fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b780aa0f0 0x7f5b780644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b777fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b780aa0f0 0x7f5b780644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42048/0 (socket says 172.21.15.78:42048) 2023-08-17T17:46:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b777fe700 1 -- 172.21.15.78:0/2654652139 learned_addr learned my addr 172.21.15.78:0/2654652139 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b6ffff700 1 --1- 172.21.15.78:0/2654652139 >> v1:172.21.15.78:6789/0 conn(0x7f5b780aa4d0 0x7f5b780c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45110/0 (socket says 172.21.15.78:45110) 2023-08-17T17:46:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b777fe700 1 -- 172.21.15.78:0/2654652139 >> v1:172.21.15.150:6789/0 conn(0x7f5b780c5810 legacy=0x7f5b780a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b777fe700 1 -- 172.21.15.78:0/2654652139 >> v1:172.21.15.78:6789/0 conn(0x7f5b780aa4d0 legacy=0x7f5b780c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.189+0000 7f5b76ffd700 1 -- 172.21.15.78:0/2654652139 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099403714 0 0) 0x7f5b780649b0 con 0x7f5b780aa4d0 2023-08-17T17:46:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b777fe700 1 -- 172.21.15.78:0/2654652139 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780639e0 con 0x7f5b780aa0f0 2023-08-17T17:46:36.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b777fe700 1 --2- 172.21.15.78:0/2654652139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780aa0f0 0x7f5b780644c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f5b68006fd0 tx=0x7f5b680090f0).ready entity=mon.0 client_cookie=e1a534c0c3c37abc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:36.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b76ffd700 1 -- 172.21.15.78:0/2654652139 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6800b600 con 0x7f5b780aa0f0 2023-08-17T17:46:36.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b76ffd700 1 -- 172.21.15.78:0/2654652139 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6800b760 con 0x7f5b780aa0f0 2023-08-17T17:46:36.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b76ffd700 1 -- 172.21.15.78:0/2654652139 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6800bae0 con 0x7f5b780aa0f0 2023-08-17T17:46:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b7e19d700 1 -- 172.21.15.78:0/2654652139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780aa0f0 msgr2=0x7f5b780644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b7e19d700 1 --2- 172.21.15.78:0/2654652139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780aa0f0 0x7f5b780644c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f5b68006fd0 tx=0x7f5b680090f0).stop 2023-08-17T17:46:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b7e19d700 1 -- 172.21.15.78:0/2654652139 shutdown_connections 2023-08-17T17:46:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b7e19d700 1 --2- 172.21.15.78:0/2654652139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780aa0f0 0x7f5b780644c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b7e19d700 1 -- 172.21.15.78:0/2654652139 >> 172.21.15.78:0/2654652139 conn(0x7f5b7806a6a0 msgr2=0x7f5b780caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b7e19d700 1 -- 172.21.15.78:0/2654652139 shutdown_connections 2023-08-17T17:46:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.190+0000 7f5b7e19d700 1 -- 172.21.15.78:0/2654652139 wait complete. 2023-08-17T17:46:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.191+0000 7f5b7e19d700 1 Processor -- start 2023-08-17T17:46:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.191+0000 7f5b7e19d700 1 -- start start 2023-08-17T17:46:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.192+0000 7f5b7e19d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b780aa0f0 0x7f5b78158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.192+0000 7f5b7e19d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b780aa4d0 0x7f5b780ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.192+0000 7f5b7e19d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780c5810 0x7f5b780c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.192+0000 7f5b7e19d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780c1ac0 con 0x7f5b780c5810 2023-08-17T17:46:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.192+0000 7f5b7e19d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780ad040 con 0x7f5b780aa4d0 2023-08-17T17:46:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.192+0000 7f5b7e19d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780ad290 con 0x7f5b780aa0f0 2023-08-17T17:46:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.192+0000 7f5b77fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780c5810 0x7f5b780c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.193+0000 7f5b77fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780c5810 0x7f5b780c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42050/0 (socket says 172.21.15.78:42050) 2023-08-17T17:46:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.193+0000 7f5b77fff700 1 -- 172.21.15.78:0/1155374479 learned_addr learned my addr 172.21.15.78:0/1155374479 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.193+0000 7f5b6ffff700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b780aa4d0 0x7f5b780ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.193+0000 7f5b777fe700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b780aa0f0 0x7f5b78158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.193+0000 7f5b77fff700 1 -- 172.21.15.78:0/1155374479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b780aa0f0 msgr2=0x7f5b78158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.193+0000 7f5b77fff700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b780aa0f0 0x7f5b78158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.193+0000 7f5b77fff700 1 -- 172.21.15.78:0/1155374479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b780aa4d0 msgr2=0x7f5b780ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.193+0000 7f5b77fff700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b780aa4d0 0x7f5b780ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.193+0000 7f5b77fff700 1 -- 172.21.15.78:0/1155374479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b68009370 con 0x7f5b780c5810 2023-08-17T17:46:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.193+0000 7f5b77fff700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780c5810 0x7f5b780c9c40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f5b7000c7c0 tx=0x7f5b70001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.194+0000 7f5b6f7fe700 1 -- 172.21.15.78:0/1155374479 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000e4a0 con 0x7f5b780c5810 2023-08-17T17:46:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.194+0000 7f5b6f7fe700 1 -- 172.21.15.78:0/1155374479 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7000e600 con 0x7f5b780c5810 2023-08-17T17:46:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.194+0000 7f5b7e19d700 1 -- 172.21.15.78:0/1155374479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b780ad570 con 0x7f5b780c5810 2023-08-17T17:46:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.194+0000 7f5b6f7fe700 1 -- 172.21.15.78:0/1155374479 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000e980 con 0x7f5b780c5810 2023-08-17T17:46:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.194+0000 7f5b7e19d700 1 -- 172.21.15.78:0/1155374479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b780ab870 con 0x7f5b780c5810 2023-08-17T17:46:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.195+0000 7f5b7e19d700 1 -- 172.21.15.78:0/1155374479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b781549d0 con 0x7f5b780c5810 2023-08-17T17:46:36.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.195+0000 7f5b6f7fe700 1 -- 172.21.15.78:0/1155374479 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f5b70010070 con 0x7f5b780c5810 2023-08-17T17:46:36.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.195+0000 7f5b6f7fe700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b5805ee70 0x7f5b58061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:36.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.195+0000 7f5b777fe700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b5805ee70 0x7f5b58061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:36.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.196+0000 7f5b777fe700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b5805ee70 0x7f5b58061330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5b68009130 tx=0x7f5b68017000).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:36.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.199+0000 7f5b6f7fe700 1 -- 172.21.15.78:0/1155374479 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7590+0+0 (secure 0 0 0) 0x7f5b7004e430 con 0x7f5b780c5810 2023-08-17T17:46:36.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.207+0000 7f5b6f7fe700 1 -- 172.21.15.78:0/1155374479 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b700478f0 con 0x7f5b780c5810 2023-08-17T17:46:36.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.403+0000 7f5b7e19d700 1 -- 172.21.15.78:0/1155374479 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b78098d40 con 0x7f5b5805ee70 2023-08-17T17:46:36.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.406+0000 7f5b6f7fe700 1 -- 172.21.15.78:0/1155374479 <== mgr.5163 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5b78098d40 con 0x7f5b5805ee70 2023-08-17T17:46:36.408 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-08-17T17:46:36.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 -- 172.21.15.78:0/1155374479 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b5805ee70 msgr2=0x7f5b58061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:36.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b5805ee70 0x7f5b58061330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5b68009130 tx=0x7f5b68017000).stop 2023-08-17T17:46:36.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 -- 172.21.15.78:0/1155374479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780c5810 msgr2=0x7f5b780c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:36.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780c5810 0x7f5b780c9c40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f5b7000c7c0 tx=0x7f5b70001510).stop 2023-08-17T17:46:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 -- 172.21.15.78:0/1155374479 shutdown_connections 2023-08-17T17:46:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b5805ee70 0x7f5b58061330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b780c5810 0x7f5b780c9c40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b780aa0f0 0x7f5b78158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 --2- 172.21.15.78:0/1155374479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b780aa4d0 0x7f5b780ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:36.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 -- 172.21.15.78:0/1155374479 >> 172.21.15.78:0/1155374479 conn(0x7f5b7806a6a0 msgr2=0x7f5b780a8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:36.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 -- 172.21.15.78:0/1155374479 shutdown_connections 2023-08-17T17:46:36.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:36.411+0000 7f5b7e19d700 1 -- 172.21.15.78:0/1155374479 wait complete. 2023-08-17T17:46:36.427 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-08-17T17:46:36.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:36.428 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-08-17T17:46:36.443 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:36.444 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:36.444 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:36.444 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:36.444 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:36.444 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:36.444 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:36.445 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:36.445 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:36.445 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:36.445 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:36.446 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_36_00_UTC 2023-08-17T17:46:36.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:36.446 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_36_00_UTC) 2023-08-17T17:46:36.521 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_37_00_UTC 2023-08-17T17:46:36.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:36.521 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_37_00_UTC) 2023-08-17T17:46:36.581 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_38_00_UTC 2023-08-17T17:46:36.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:36.581 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_38_00_UTC) 2023-08-17T17:46:36.641 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_39_00_UTC 2023-08-17T17:46:36.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:36.642 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_39_00_UTC) 2023-08-17T17:46:36.702 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_40_00_UTC 2023-08-17T17:46:36.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:36.703 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_40_00_UTC) 2023-08-17T17:46:36.768 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_41_00_UTC 2023-08-17T17:46:36.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:36.769 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_41_00_UTC) 2023-08-17T17:46:36.829 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_42_00_UTC 2023-08-17T17:46:36.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:36.830 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_42_00_UTC) 2023-08-17T17:46:36.888 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_43_00_UTC 2023-08-17T17:46:36.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:36.889 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_43_00_UTC) 2023-08-17T17:46:36.952 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_44_00_UTC 2023-08-17T17:46:36.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:36.953 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_44_00_UTC) 2023-08-17T17:46:37.012 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_45_00_UTC 2023-08-17T17:46:37.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:37.013 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_45_00_UTC) 2023-08-17T17:46:37.074 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_46_00_UTC 2023-08-17T17:46:37.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:37.075 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-17-17_46_00_UTC) 2023-08-17T17:46:37.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:37.134 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-08-17T17:46:37.191 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-17T17:46:37.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.344+0000 7f8c4519f700 1 Processor -- start 2023-08-17T17:46:37.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.344+0000 7f8c4519f700 1 -- start start 2023-08-17T17:46:37.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.345+0000 7f8c4519f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c400a5860 0x7f8c400a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:37.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.345+0000 7f8c4519f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c400a7390 0x7f8c400bda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:37.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.345+0000 7f8c4519f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c400a6a10 con 0x7f8c40151c80 2023-08-17T17:46:37.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.345+0000 7f8c4519f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c400a5e00 con 0x7f8c400a7390 2023-08-17T17:46:37.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.345+0000 7f8c4519f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400a60e0 con 0x7f8c400a5860 2023-08-17T17:46:37.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.345+0000 7f8c4499e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c400a7390 0x7f8c400bda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:37.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.345+0000 7f8c4499e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c400a7390 0x7f8c400bda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42056/0 (socket says 172.21.15.78:42056) 2023-08-17T17:46:37.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.345+0000 7f8c4499e700 1 -- 172.21.15.78:0/1260550861 learned_addr learned my addr 172.21.15.78:0/1260550861 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:37.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.345+0000 7f8c3f7fe700 1 --2- 172.21.15.78:0/1260550861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c400a5860 0x7f8c400a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:37.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4499e700 1 -- 172.21.15.78:0/1260550861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c400a5860 msgr2=0x7f8c400a6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:37.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4499e700 1 --2- 172.21.15.78:0/1260550861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c400a5860 0x7f8c400a6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:37.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4499e700 1 -- 172.21.15.78:0/1260550861 >> v1:172.21.15.150:6789/0 conn(0x7f8c40151c80 legacy=0x7f8c40062db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:37.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4499e700 1 -- 172.21.15.78:0/1260550861 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c400a63c0 con 0x7f8c400a7390 2023-08-17T17:46:37.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4499e700 1 --2- 172.21.15.78:0/1260550861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c400a7390 0x7f8c400bda30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f8c38009f20 tx=0x7f8c38009840).ready entity=mon.0 client_cookie=9fe6f88ce9f66f52 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:37.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c3effd700 1 -- 172.21.15.78:0/1260550861 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800e070 con 0x7f8c400a7390 2023-08-17T17:46:37.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c3effd700 1 -- 172.21.15.78:0/1260550861 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3800b9d0 con 0x7f8c400a7390 2023-08-17T17:46:37.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c3effd700 1 -- 172.21.15.78:0/1260550861 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800bd50 con 0x7f8c400a7390 2023-08-17T17:46:37.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4519f700 1 -- 172.21.15.78:0/1260550861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c400a7390 msgr2=0x7f8c400bda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:37.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4519f700 1 --2- 172.21.15.78:0/1260550861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c400a7390 0x7f8c400bda30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f8c38009f20 tx=0x7f8c38009840).stop 2023-08-17T17:46:37.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4519f700 1 -- 172.21.15.78:0/1260550861 shutdown_connections 2023-08-17T17:46:37.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4519f700 1 --2- 172.21.15.78:0/1260550861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c400a7390 0x7f8c400bda30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:37.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4519f700 1 --2- 172.21.15.78:0/1260550861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c400a5860 0x7f8c400a6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:37.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4519f700 1 -- 172.21.15.78:0/1260550861 >> 172.21.15.78:0/1260550861 conn(0x7f8c4006a660 msgr2=0x7f8c400921a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:37.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4519f700 1 -- 172.21.15.78:0/1260550861 shutdown_connections 2023-08-17T17:46:37.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.346+0000 7f8c4519f700 1 -- 172.21.15.78:0/1260550861 wait complete. 2023-08-17T17:46:37.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.348+0000 7f8c4519f700 1 Processor -- start 2023-08-17T17:46:37.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.348+0000 7f8c4519f700 1 -- start start 2023-08-17T17:46:37.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.348+0000 7f8c4519f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c400a5860 0x7f8c400aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:37.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.348+0000 7f8c4519f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c400a7390 0x7f8c4014c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:37.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.348+0000 7f8c4519f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c40151c80 0x7f8c400ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:37.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.348+0000 7f8c4519f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40152060 con 0x7f8c40151c80 2023-08-17T17:46:37.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.348+0000 7f8c4519f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400abf70 con 0x7f8c400a5860 2023-08-17T17:46:37.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4519f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4014cb70 con 0x7f8c400a7390 2023-08-17T17:46:37.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4499e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c40151c80 0x7f8c400ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:37.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4499e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c40151c80 0x7f8c400ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42072/0 (socket says 172.21.15.78:42072) 2023-08-17T17:46:37.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4499e700 1 -- 172.21.15.78:0/386320058 learned_addr learned my addr 172.21.15.78:0/386320058 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:37.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c3f7fe700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c400a7390 0x7f8c4014c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:37.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c3ffff700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c400a5860 0x7f8c400aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:37.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4499e700 1 -- 172.21.15.78:0/386320058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c400a7390 msgr2=0x7f8c4014c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:37.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4499e700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c400a7390 0x7f8c4014c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:37.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4499e700 1 -- 172.21.15.78:0/386320058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c400a5860 msgr2=0x7f8c400aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:37.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4499e700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c400a5860 0x7f8c400aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:37.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4499e700 1 -- 172.21.15.78:0/386320058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38009ae0 con 0x7f8c40151c80 2023-08-17T17:46:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4499e700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c40151c80 0x7f8c400ace50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f8c3800b610 tx=0x7f8c38009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c27fff700 1 -- 172.21.15.78:0/386320058 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c380092e0 con 0x7f8c40151c80 2023-08-17T17:46:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c27fff700 1 -- 172.21.15.78:0/386320058 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3801e470 con 0x7f8c40151c80 2023-08-17T17:46:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4519f700 1 -- 172.21.15.78:0/386320058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c400ac1f0 con 0x7f8c40151c80 2023-08-17T17:46:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c27fff700 1 -- 172.21.15.78:0/386320058 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3801e830 con 0x7f8c40151c80 2023-08-17T17:46:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.349+0000 7f8c4519f700 1 -- 172.21.15.78:0/386320058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c400ac7b0 con 0x7f8c40151c80 2023-08-17T17:46:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.350+0000 7f8c4519f700 1 -- 172.21.15.78:0/386320058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c40152210 con 0x7f8c40151c80 2023-08-17T17:46:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.350+0000 7f8c27fff700 1 -- 172.21.15.78:0/386320058 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f8c38025030 con 0x7f8c40151c80 2023-08-17T17:46:37.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.351+0000 7f8c27fff700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c2c05ee70 0x7f8c2c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:37.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.351+0000 7f8c27fff700 1 -- 172.21.15.78:0/386320058 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f8c3807b400 con 0x7f8c40151c80 2023-08-17T17:46:37.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.351+0000 7f8c3ffff700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c2c05ee70 0x7f8c2c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:37.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.351+0000 7f8c3ffff700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c2c05ee70 0x7f8c2c061330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8c30007fd0 tx=0x7f8c30007d90).ready entity=mgr.5163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:37.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.355+0000 7f8c27fff700 1 -- 172.21.15.78:0/386320058 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c40152210 con 0x7f8c40151c80 2023-08-17T17:46:37.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:37.578+0000 7f8c4519f700 1 -- 172.21.15.78:0/386320058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f8c4005f910 con 0x7f8c40151c80 2023-08-17T17:46:38.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.529+0000 7f8c27fff700 1 -- 172.21.15.78:0/386320058 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f8c3801b040 con 0x7f8c40151c80 2023-08-17T17:46:38.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.529+0000 7f8c27fff700 1 -- 172.21.15.78:0/386320058 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v11) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8c38074ee0 con 0x7f8c40151c80 2023-08-17T17:46:38.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.532+0000 7f8c4519f700 1 -- 172.21.15.78:0/386320058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c2c05ee70 msgr2=0x7f8c2c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:38.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.532+0000 7f8c4519f700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c2c05ee70 0x7f8c2c061330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8c30007fd0 tx=0x7f8c30007d90).stop 2023-08-17T17:46:38.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.532+0000 7f8c4519f700 1 -- 172.21.15.78:0/386320058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c40151c80 msgr2=0x7f8c400ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:38.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.532+0000 7f8c4519f700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c40151c80 0x7f8c400ace50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f8c3800b610 tx=0x7f8c38009840).stop 2023-08-17T17:46:38.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.533+0000 7f8c4519f700 1 -- 172.21.15.78:0/386320058 shutdown_connections 2023-08-17T17:46:38.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.533+0000 7f8c4519f700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8c2c05ee70 0x7f8c2c061330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:38.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.533+0000 7f8c4519f700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c40151c80 0x7f8c400ace50 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:38.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.533+0000 7f8c4519f700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c400a5860 0x7f8c400aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:38.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.533+0000 7f8c4519f700 1 --2- 172.21.15.78:0/386320058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c400a7390 0x7f8c4014c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:38.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.533+0000 7f8c4519f700 1 -- 172.21.15.78:0/386320058 >> 172.21.15.78:0/386320058 conn(0x7f8c4006a660 msgr2=0x7f8c400c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:38.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.534+0000 7f8c4519f700 1 -- 172.21.15.78:0/386320058 shutdown_connections 2023-08-17T17:46:38.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.534+0000 7f8c4519f700 1 -- 172.21.15.78:0/386320058 wait complete. 2023-08-17T17:46:38.554 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:46:38.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:46:38.607 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:46:38.647 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:46:38.647 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T17:46:38.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:46:38.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T17:46:38.677 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:38.675+0000 7f621a60b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:46:38.690 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:46:38.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:46:38.691 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T17:46:38.692 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:38.689+0000 7f3a3990e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:46:38.741 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:38.739+0000 7f621a60b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:46:38.745 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:46:38.755 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:38.754+0000 7f3a3990e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:46:38.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.870+0000 7fc11c618700 1 Processor -- start 2023-08-17T17:46:38.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.870+0000 7fc11c618700 1 -- start start 2023-08-17T17:46:38.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.871+0000 7fc11c618700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1140c0ff0 0x7fc1140c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:38.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.871+0000 7fc11c618700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc114137e30 0x7fc1140c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:38.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.871+0000 7fc11c618700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc114065820 con 0x7fc1141375e0 2023-08-17T17:46:38.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.871+0000 7fc11c618700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1140c61b0 con 0x7fc114137e30 2023-08-17T17:46:38.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.871+0000 7fc11c618700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1140c14b0 con 0x7fc1140c0ff0 2023-08-17T17:46:38.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc119bb3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1140c0ff0 0x7fc1140c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:38.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc11abb5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc114137e30 0x7fc1140c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:38.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc11a3b4700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc1141375e0 0x7fc114065110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:56038/0 (socket says 172.21.15.78:56038) 2023-08-17T17:46:38.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc11a3b4700 1 -- 172.21.15.78:0/3492311695 learned_addr learned my addr 172.21.15.78:0/3492311695 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:38.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc119bb3700 1 -- 172.21.15.78:0/3492311695 >> v2:172.21.15.150:3300/0 conn(0x7fc114137e30 msgr2=0x7fc1140c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:38.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc119bb3700 1 --2- 172.21.15.78:0/3492311695 >> v2:172.21.15.150:3300/0 conn(0x7fc114137e30 0x7fc1140c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:38.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc119bb3700 1 -- 172.21.15.78:0/3492311695 >> v1:172.21.15.150:6789/0 conn(0x7fc1141375e0 legacy=0x7fc114065110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:38.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc119bb3700 1 -- 172.21.15.78:0/3492311695 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1140c1790 con 0x7fc1140c0ff0 2023-08-17T17:46:38.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc11abb5700 1 --2- 172.21.15.78:0/3492311695 >> v2:172.21.15.150:3300/0 conn(0x7fc114137e30 0x7fc1140c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:38.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc119bb3700 1 --2- 172.21.15.78:0/3492311695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1140c0ff0 0x7fc1140c57d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc110009760 tx=0x7fc110009060).ready entity=mon.2 client_cookie=e4a84b44372c857 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:38.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc1193b2700 1 -- 172.21.15.78:0/3492311695 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11000f510 con 0x7fc1140c0ff0 2023-08-17T17:46:38.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc1193b2700 1 -- 172.21.15.78:0/3492311695 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11000f670 con 0x7fc1140c0ff0 2023-08-17T17:46:38.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.872+0000 7fc1193b2700 1 -- 172.21.15.78:0/3492311695 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11000f9f0 con 0x7fc1140c0ff0 2023-08-17T17:46:38.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.873+0000 7fc11c618700 1 -- 172.21.15.78:0/3492311695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1140c0ff0 msgr2=0x7fc1140c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:38.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.873+0000 7fc11c618700 1 --2- 172.21.15.78:0/3492311695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1140c0ff0 0x7fc1140c57d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc110009760 tx=0x7fc110009060).stop 2023-08-17T17:46:38.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.873+0000 7fc11c618700 1 -- 172.21.15.78:0/3492311695 shutdown_connections 2023-08-17T17:46:38.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.873+0000 7fc11c618700 1 --2- 172.21.15.78:0/3492311695 >> v2:172.21.15.150:3300/0 conn(0x7fc114137e30 0x7fc1140c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:38.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.873+0000 7fc11c618700 1 --2- 172.21.15.78:0/3492311695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1140c0ff0 0x7fc1140c57d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:38.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.873+0000 7fc11c618700 1 -- 172.21.15.78:0/3492311695 >> 172.21.15.78:0/3492311695 conn(0x7fc114062fc0 msgr2=0x7fc1140c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:38.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.873+0000 7fc11c618700 1 -- 172.21.15.78:0/3492311695 shutdown_connections 2023-08-17T17:46:38.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.873+0000 7fc11c618700 1 -- 172.21.15.78:0/3492311695 wait complete. 2023-08-17T17:46:38.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.874+0000 7fc11c618700 1 Processor -- start 2023-08-17T17:46:38.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.874+0000 7fc11c618700 1 -- start start 2023-08-17T17:46:38.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11c618700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1140c0ff0 0x7fc114165fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:38.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11c618700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1141375e0 0x7fc114153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:38.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11c618700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc114137e30 0x7fc1141629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:38.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11c618700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1140bf820 con 0x7fc1140c0ff0 2023-08-17T17:46:38.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11c618700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc114166e90 con 0x7fc114137e30 2023-08-17T17:46:38.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11c618700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1141668d0 con 0x7fc1141375e0 2023-08-17T17:46:38.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11a3b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1140c0ff0 0x7fc114165fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:38.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11a3b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1140c0ff0 0x7fc114165fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58164/0 (socket says 172.21.15.78:58164) 2023-08-17T17:46:38.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11a3b4700 1 -- 172.21.15.78:0/465403432 learned_addr learned my addr 172.21.15.78:0/465403432 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11abb5700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc114137e30 0x7fc1141629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc119bb3700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1141375e0 0x7fc114153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11a3b4700 1 -- 172.21.15.78:0/465403432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1141375e0 msgr2=0x7fc114153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11a3b4700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1141375e0 0x7fc114153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11a3b4700 1 -- 172.21.15.78:0/465403432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc114137e30 msgr2=0x7fc1141629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11a3b4700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc114137e30 0x7fc1141629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11a3b4700 1 -- 172.21.15.78:0/465403432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c009a20 con 0x7fc1140c0ff0 2023-08-17T17:46:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc11abb5700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc114137e30 0x7fc1141629d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.875+0000 7fc119bb3700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1141375e0 0x7fc114153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.876+0000 7fc11a3b4700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1140c0ff0 0x7fc114165fd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fc10400c4c0 tx=0x7fc104007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.876+0000 7fc10a7fc700 1 -- 172.21.15.78:0/465403432 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040072e0 con 0x7fc1140c0ff0 2023-08-17T17:46:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.876+0000 7fc10a7fc700 1 -- 172.21.15.78:0/465403432 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc104007440 con 0x7fc1140c0ff0 2023-08-17T17:46:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.876+0000 7fc11c618700 1 -- 172.21.15.78:0/465403432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1100092a0 con 0x7fc1140c0ff0 2023-08-17T17:46:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.876+0000 7fc10a7fc700 1 -- 172.21.15.78:0/465403432 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040057a0 con 0x7fc1140c0ff0 2023-08-17T17:46:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.876+0000 7fc11c618700 1 -- 172.21.15.78:0/465403432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc114166c60 con 0x7fc1140c0ff0 2023-08-17T17:46:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.877+0000 7fc11c618700 1 -- 172.21.15.78:0/465403432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc114047350 con 0x7fc1140c0ff0 2023-08-17T17:46:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.877+0000 7fc10a7fc700 1 -- 172.21.15.78:0/465403432 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fc104010070 con 0x7fc1140c0ff0 2023-08-17T17:46:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.877+0000 7fc10a7fc700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc0f805ee20 0x7fc0f80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.877+0000 7fc119bb3700 1 -- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc0f805ee20 msgr2=0x7fc0f80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.877+0000 7fc10a7fc700 1 -- 172.21.15.78:0/465403432 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fc1040794f0 con 0x7fc1140c0ff0 2023-08-17T17:46:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.877+0000 7fc119bb3700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc0f805ee20 0x7fc0f80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:38.881+0000 7fc10a7fc700 1 -- 172.21.15.78:0/465403432 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc10404a6b0 con 0x7fc1140c0ff0 2023-08-17T17:46:39.016 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:39.014+0000 7f621a60b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:46:39.043 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:39.042+0000 7f3a3990e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:46:39.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.078+0000 7fc119bb3700 1 -- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc0f805ee20 msgr2=0x7fc0f80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:39.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.078+0000 7fc119bb3700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc0f805ee20 0x7fc0f80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:46:39.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.091+0000 7fc11c618700 1 -- 172.21.15.78:0/465403432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1140c1a70 con 0x7fc1140c0ff0 2023-08-17T17:46:39.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.091+0000 7fc10a7fc700 1 -- 172.21.15.78:0/465403432 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4483 (secure 0 0 0) 0x7fc10404dcd0 con 0x7fc1140c0ff0 2023-08-17T17:46:39.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:39.093 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/175439344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":175439344},{"type":"v1","addr":"172.21.15.150:6834","nonce":175439344}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/893012651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":893012651},{"type":"v1","addr":"172.21.15.150:6835","nonce":893012651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4944,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/734042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":734042508},{"type":"v1","addr":"172.21.15.78:6836","nonce":734042508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:35:10.721386+0000","modified":"2023-08-17T17:35:13.361851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/3186726071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3186726071},{"type":"v1","addr":"172.21.15.78:6837","nonce":3186726071}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T17:46:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.093+0000 7fc11c618700 1 -- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc0f805ee20 msgr2=0x7fc0f80612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.093+0000 7fc11c618700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc0f805ee20 0x7fc0f80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.093+0000 7fc11c618700 1 -- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1140c0ff0 msgr2=0x7fc114165fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.093+0000 7fc11c618700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1140c0ff0 0x7fc114165fd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fc10400c4c0 tx=0x7fc104007db0).stop 2023-08-17T17:46:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.093+0000 7fc11c618700 1 -- 172.21.15.78:0/465403432 shutdown_connections 2023-08-17T17:46:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.093+0000 7fc11c618700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc0f805ee20 0x7fc0f80612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.093+0000 7fc11c618700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc114137e30 0x7fc1141629d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.093+0000 7fc11c618700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1140c0ff0 0x7fc114165fd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.093+0000 7fc11c618700 1 --2- 172.21.15.78:0/465403432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1141375e0 0x7fc114153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.093+0000 7fc11c618700 1 -- 172.21.15.78:0/465403432 >> 172.21.15.78:0/465403432 conn(0x7fc114062fc0 msgr2=0x7fc11414f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.094+0000 7fc11c618700 1 -- 172.21.15.78:0/465403432 shutdown_connections 2023-08-17T17:46:39.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.094+0000 7fc11c618700 1 -- 172.21.15.78:0/465403432 wait complete. 2023-08-17T17:46:39.097 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 13 2023-08-17T17:46:39.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:46:39.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.224+0000 7ff6d284e700 1 Processor -- start 2023-08-17T17:46:39.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.224+0000 7ff6d284e700 1 -- start start 2023-08-17T17:46:39.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6d284e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6cc150e10 0x7ff6cc0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6d284e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6cc063b10 0x7ff6cc0bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6d284e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff6cc0bd490 0x7ff6cc0bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6d284e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6cc06b580 con 0x7ff6cc150e10 2023-08-17T17:46:39.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6d284e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6cc0bcb10 con 0x7ff6cc0bd490 2023-08-17T17:46:39.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6d284e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0bc200 con 0x7ff6cc063b10 2023-08-17T17:46:39.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6cbfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6cc150e10 0x7ff6cc0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6cbfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6cc150e10 0x7ff6cc0aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58172/0 (socket says 172.21.15.78:58172) 2023-08-17T17:46:39.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6cbfff700 1 -- 172.21.15.78:0/742663523 learned_addr learned my addr 172.21.15.78:0/742663523 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:39.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6d0deb700 1 --2- 172.21.15.78:0/742663523 >> v2:172.21.15.150:3300/0 conn(0x7ff6cc0bd490 0x7ff6cc0bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6cb7fe700 1 --2- 172.21.15.78:0/742663523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6cc063b10 0x7ff6cc0bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6cbfff700 1 -- 172.21.15.78:0/742663523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6cc063b10 msgr2=0x7ff6cc0bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:39.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6cbfff700 1 --2- 172.21.15.78:0/742663523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6cc063b10 0x7ff6cc0bcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6cbfff700 1 -- 172.21.15.78:0/742663523 >> v2:172.21.15.150:3300/0 conn(0x7ff6cc0bd490 msgr2=0x7ff6cc0bd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:39.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6cbfff700 1 --2- 172.21.15.78:0/742663523 >> v2:172.21.15.150:3300/0 conn(0x7ff6cc0bd490 0x7ff6cc0bd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6cbfff700 1 -- 172.21.15.78:0/742663523 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0c37a0 con 0x7ff6cc150e10 2023-08-17T17:46:39.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6cbfff700 1 --2- 172.21.15.78:0/742663523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 0x7ff6cc0aa320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ff6cc069ea0 tx=0x7ff6bc0090f0).ready entity=mon.0 client_cookie=c8501abc64d98df3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:39.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6caffd700 1 -- 172.21.15.78:0/742663523 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc00b600 con 0x7ff6cc150e10 2023-08-17T17:46:39.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6caffd700 1 -- 172.21.15.78:0/742663523 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc00b760 con 0x7ff6cc150e10 2023-08-17T17:46:39.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.225+0000 7ff6caffd700 1 -- 172.21.15.78:0/742663523 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc00bae0 con 0x7ff6cc150e10 2023-08-17T17:46:39.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.226+0000 7ff6d284e700 1 -- 172.21.15.78:0/742663523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 msgr2=0x7ff6cc0aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.226+0000 7ff6d284e700 1 --2- 172.21.15.78:0/742663523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 0x7ff6cc0aa320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ff6cc069ea0 tx=0x7ff6bc0090f0).stop 2023-08-17T17:46:39.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.226+0000 7ff6d284e700 1 -- 172.21.15.78:0/742663523 shutdown_connections 2023-08-17T17:46:39.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.226+0000 7ff6d284e700 1 --2- 172.21.15.78:0/742663523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 0x7ff6cc0aa320 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.226+0000 7ff6d284e700 1 --2- 172.21.15.78:0/742663523 >> v2:172.21.15.150:3300/0 conn(0x7ff6cc0bd490 0x7ff6cc0bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.226+0000 7ff6d284e700 1 --2- 172.21.15.78:0/742663523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6cc063b10 0x7ff6cc0bcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.226+0000 7ff6d284e700 1 -- 172.21.15.78:0/742663523 >> 172.21.15.78:0/742663523 conn(0x7ff6cc0c3d40 msgr2=0x7ff6cc0c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:39.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.226+0000 7ff6d284e700 1 -- 172.21.15.78:0/742663523 shutdown_connections 2023-08-17T17:46:39.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.226+0000 7ff6d284e700 1 -- 172.21.15.78:0/742663523 wait complete. 2023-08-17T17:46:39.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.227+0000 7ff6d284e700 1 Processor -- start 2023-08-17T17:46:39.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.227+0000 7ff6d284e700 1 -- start start 2023-08-17T17:46:39.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d284e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6cc063b10 0x7ff6cc1535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d284e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6cc0bd490 0x7ff6cc14d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d284e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 0x7ff6cc1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d284e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0a7100 con 0x7ff6cc150e10 2023-08-17T17:46:39.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d284e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0ab9e0 con 0x7ff6cc0bd490 2023-08-17T17:46:39.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d284e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0abcc0 con 0x7ff6cc063b10 2023-08-17T17:46:39.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d0deb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 0x7ff6cc1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d0deb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 0x7ff6cc1550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58182/0 (socket says 172.21.15.78:58182) 2023-08-17T17:46:39.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d0deb700 1 -- 172.21.15.78:0/1768040790 learned_addr learned my addr 172.21.15.78:0/1768040790 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:39.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6cbfff700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6cc063b10 0x7ff6cc1535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6cb7fe700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6cc0bd490 0x7ff6cc14d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d0deb700 1 -- 172.21.15.78:0/1768040790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6cc063b10 msgr2=0x7ff6cc1535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d0deb700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6cc063b10 0x7ff6cc1535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d0deb700 1 -- 172.21.15.78:0/1768040790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6cc0bd490 msgr2=0x7ff6cc14d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d0deb700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6cc0bd490 0x7ff6cc14d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.228+0000 7ff6d0deb700 1 -- 172.21.15.78:0/1768040790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc009370 con 0x7ff6cc150e10 2023-08-17T17:46:39.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.229+0000 7ff6d0deb700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 0x7ff6cc1550c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7ff6c4009fd0 tx=0x7ff6c4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:39.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.229+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1768040790 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c400ebf0 con 0x7ff6cc150e10 2023-08-17T17:46:39.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.229+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1768040790 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c400ed50 con 0x7ff6cc150e10 2023-08-17T17:46:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.229+0000 7ff6d284e700 1 -- 172.21.15.78:0/1768040790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc0abfa0 con 0x7ff6cc150e10 2023-08-17T17:46:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.229+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1768040790 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4014610 con 0x7ff6cc150e10 2023-08-17T17:46:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.229+0000 7ff6d284e700 1 -- 172.21.15.78:0/1768040790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc153b40 con 0x7ff6cc150e10 2023-08-17T17:46:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.230+0000 7ff6d284e700 1 -- 172.21.15.78:0/1768040790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc0a72b0 con 0x7ff6cc150e10 2023-08-17T17:46:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.230+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1768040790 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff6c401b030 con 0x7ff6cc150e10 2023-08-17T17:46:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.230+0000 7ff6b3fff700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6b805ee20 0x7ff6b80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.230+0000 7ff6cbfff700 1 -- 172.21.15.78:0/1768040790 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6b805ee20 msgr2=0x7ff6b80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.230+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1768040790 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7ff6c407a2a0 con 0x7ff6cc150e10 2023-08-17T17:46:39.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.230+0000 7ff6cbfff700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6b805ee20 0x7ff6b80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:39.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.234+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1768040790 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff6cc0a72b0 con 0x7ff6cc150e10 2023-08-17T17:46:39.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.406+0000 7ff6d284e700 1 -- 172.21.15.78:0/1768040790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6cc0a72b0 con 0x7ff6cc150e10 2023-08-17T17:46:39.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.407+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1768040790 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18443 (secure 0 0 0) 0x7ff6cc0a72b0 con 0x7ff6cc150e10 2023-08-17T17:46:39.408 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:39.409 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":47,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:46:38.196344+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:35:08.663808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T17:35:09.691655+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6833/119464":"2023-08-18T17:35:22.589074+0000","172.21.15.78:6832/119464":"2023-08-18T17:35:22.589074+0000","172.21.15.78:0/3252365413":"2023-08-18T17:35:22.589074+0000","172.21.15.78:0/3495218499":"2023-08-18T17:35:22.589074+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":2},{"begin":7,"length":2},{"begin":11,"length":1},{"begin":13,"length":2},{"begin":17,"length":2},{"begin":21,"length":1},{"begin":23,"length":2},{"begin":27,"length":2},{"begin":31,"length":1},{"begin":33,"length":2},{"begin":37,"length":2},{"begin":41,"length":1},{"begin":43,"length":2},{"begin":47,"length":2},{"begin":51,"length":1},{"begin":53,"length":2},{"begin":57,"length":2},{"begin":61,"length":1},{"begin":63,"length":2},{"begin":67,"length":2},{"begin":71,"length":1},{"begin":73,"length":2},{"begin":77,"length":2},{"begin":81,"length":1},{"begin":83,"length":2},{"begin":87,"length":2},{"begin":91,"length":1},{"begin":93,"length":2},{"begin":97,"length":2},{"begin":101,"length":1},{"begin":103,"length":2},{"begin":107,"length":1},{"begin":110,"length":2},{"begin":166,"length":55}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":8,"length":1},{"begin":18,"length":1},{"begin":28,"length":1},{"begin":38,"length":1},{"begin":48,"length":1},{"begin":58,"length":1},{"begin":68,"length":1},{"begin":78,"length":1},{"begin":88,"length":1},{"begin":98,"length":1},{"begin":103,"length":1},{"begin":210,"length":11}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:46:39.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 -- 172.21.15.78:0/1768040790 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6b805ee20 msgr2=0x7ff6b80612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:39.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6b805ee20 0x7ff6b80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:39.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 -- 172.21.15.78:0/1768040790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 msgr2=0x7ff6cc1550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 0x7ff6cc1550c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7ff6c4009fd0 tx=0x7ff6c4009900).stop 2023-08-17T17:46:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 -- 172.21.15.78:0/1768040790 shutdown_connections 2023-08-17T17:46:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6b805ee20 0x7ff6b80612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6cc150e10 0x7ff6cc1550c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6cc063b10 0x7ff6cc1535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 --2- 172.21.15.78:0/1768040790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6cc0bd490 0x7ff6cc14d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 -- 172.21.15.78:0/1768040790 >> 172.21.15.78:0/1768040790 conn(0x7ff6cc0c3d40 msgr2=0x7ff6cc064fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 -- 172.21.15.78:0/1768040790 shutdown_connections 2023-08-17T17:46:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.409+0000 7ff6d284e700 1 -- 172.21.15.78:0/1768040790 wait complete. 2023-08-17T17:46:39.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:35:08.663808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:35:09.691655+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 47, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:46:39.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:46:39.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.543+0000 7f741d333700 1 Processor -- start 2023-08-17T17:46:39.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.543+0000 7f741d333700 1 -- start start 2023-08-17T17:46:39.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f741d333700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74180aa0f0 0x7f74180644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f741d333700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74180aa4d0 0x7f74180c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f741d333700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74180c5810 0x7f74180c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f741d333700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74180649b0 con 0x7f74180aa4d0 2023-08-17T17:46:39.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f741d333700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74180c6140 con 0x7f74180c5810 2023-08-17T17:46:39.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f741d333700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7418063420 con 0x7f74180aa0f0 2023-08-17T17:46:39.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f74167fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74180aa4d0 0x7f74180c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f74167fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74180aa4d0 0x7f74180c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58194/0 (socket says 172.21.15.78:58194) 2023-08-17T17:46:39.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f74167fc700 1 -- 172.21.15.78:0/595440553 learned_addr learned my addr 172.21.15.78:0/595440553 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:39.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f7416ffd700 1 --2- 172.21.15.78:0/595440553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74180aa0f0 0x7f74180644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f74177fe700 1 --2- 172.21.15.78:0/595440553 >> v2:172.21.15.150:3300/0 conn(0x7f74180c5810 0x7f74180c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f74167fc700 1 -- 172.21.15.78:0/595440553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74180aa0f0 msgr2=0x7f74180644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:39.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f74167fc700 1 --2- 172.21.15.78:0/595440553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74180aa0f0 0x7f74180644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f74167fc700 1 -- 172.21.15.78:0/595440553 >> v2:172.21.15.150:3300/0 conn(0x7f74180c5810 msgr2=0x7f74180c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:39.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f74167fc700 1 --2- 172.21.15.78:0/595440553 >> v2:172.21.15.150:3300/0 conn(0x7f74180c5810 0x7f74180c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f74167fc700 1 -- 172.21.15.78:0/595440553 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7418063700 con 0x7f74180aa4d0 2023-08-17T17:46:39.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.544+0000 7f74167fc700 1 --2- 172.21.15.78:0/595440553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 0x7f74180c0e10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f7418159060 tx=0x7f74080090f0).ready entity=mon.0 client_cookie=34749258d09691d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:39.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f7415ffb700 1 -- 172.21.15.78:0/595440553 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800f510 con 0x7f74180aa4d0 2023-08-17T17:46:39.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f7415ffb700 1 -- 172.21.15.78:0/595440553 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740800f670 con 0x7f74180aa4d0 2023-08-17T17:46:39.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f7415ffb700 1 -- 172.21.15.78:0/595440553 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800f9f0 con 0x7f74180aa4d0 2023-08-17T17:46:39.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f741d333700 1 -- 172.21.15.78:0/595440553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 msgr2=0x7f74180c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f741d333700 1 --2- 172.21.15.78:0/595440553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 0x7f74180c0e10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f7418159060 tx=0x7f74080090f0).stop 2023-08-17T17:46:39.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f741d333700 1 -- 172.21.15.78:0/595440553 shutdown_connections 2023-08-17T17:46:39.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f741d333700 1 --2- 172.21.15.78:0/595440553 >> v2:172.21.15.150:3300/0 conn(0x7f74180c5810 0x7f74180c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f741d333700 1 --2- 172.21.15.78:0/595440553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74180aa0f0 0x7f74180644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f741d333700 1 --2- 172.21.15.78:0/595440553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 0x7f74180c0e10 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f741d333700 1 -- 172.21.15.78:0/595440553 >> 172.21.15.78:0/595440553 conn(0x7f741806a6a0 msgr2=0x7f74180caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:39.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f741d333700 1 -- 172.21.15.78:0/595440553 shutdown_connections 2023-08-17T17:46:39.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.545+0000 7f741d333700 1 -- 172.21.15.78:0/595440553 wait complete. 2023-08-17T17:46:39.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.546+0000 7f741d333700 1 Processor -- start 2023-08-17T17:46:39.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f741d333700 1 -- start start 2023-08-17T17:46:39.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f741d333700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74180aa0f0 0x7f74180c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f741d333700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 0x7f74180b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f741d333700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74180c5810 0x7f74180ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f741d333700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180c4b40 con 0x7f74180aa4d0 2023-08-17T17:46:39.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f741d333700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180aabe0 con 0x7f74180c5810 2023-08-17T17:46:39.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f741d333700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180c4040 con 0x7f74180aa0f0 2023-08-17T17:46:39.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f74167fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 0x7f74180b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f74167fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 0x7f74180b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58208/0 (socket says 172.21.15.78:58208) 2023-08-17T17:46:39.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f74167fc700 1 -- 172.21.15.78:0/3501982755 learned_addr learned my addr 172.21.15.78:0/3501982755 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:39.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.547+0000 7f7416ffd700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74180aa0f0 0x7f74180c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f74177fe700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74180c5810 0x7f74180ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f74167fc700 1 -- 172.21.15.78:0/3501982755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74180aa0f0 msgr2=0x7f74180c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f74167fc700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74180aa0f0 0x7f74180c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f74167fc700 1 -- 172.21.15.78:0/3501982755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74180c5810 msgr2=0x7f74180ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f74167fc700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74180c5810 0x7f74180ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f74167fc700 1 -- 172.21.15.78:0/3501982755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408009370 con 0x7f74180aa4d0 2023-08-17T17:46:39.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f74167fc700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 0x7f74180b0190 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f741805e180 tx=0x7f7408017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:39.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f73feffd700 1 -- 172.21.15.78:0/3501982755 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800fe80 con 0x7f74180aa4d0 2023-08-17T17:46:39.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f73feffd700 1 -- 172.21.15.78:0/3501982755 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740800f7e0 con 0x7f74180aa4d0 2023-08-17T17:46:39.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f741d333700 1 -- 172.21.15.78:0/3501982755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74180c42c0 con 0x7f74180aa4d0 2023-08-17T17:46:39.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f73feffd700 1 -- 172.21.15.78:0/3501982755 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740801c630 con 0x7f74180aa4d0 2023-08-17T17:46:39.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.548+0000 7f741d333700 1 -- 172.21.15.78:0/3501982755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74180c4860 con 0x7f74180aa4d0 2023-08-17T17:46:39.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.549+0000 7f741d333700 1 -- 172.21.15.78:0/3501982755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74180aa9b0 con 0x7f74180aa4d0 2023-08-17T17:46:39.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.549+0000 7f73feffd700 1 -- 172.21.15.78:0/3501982755 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f740802c070 con 0x7f74180aa4d0 2023-08-17T17:46:39.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.550+0000 7f73feffd700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f740405ee20 0x7f74040612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.550+0000 7f7416ffd700 1 -- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f740405ee20 msgr2=0x7f74040612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:39.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.550+0000 7f73feffd700 1 -- 172.21.15.78:0/3501982755 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f740807b8d0 con 0x7f74180aa4d0 2023-08-17T17:46:39.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.550+0000 7f7416ffd700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f740405ee20 0x7f74040612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:39.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.554+0000 7f73feffd700 1 -- 172.21.15.78:0/3501982755 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f74180aa9b0 con 0x7f74180aa4d0 2023-08-17T17:46:39.630 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:39.628+0000 7f621a60b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:46:39.685 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:39.684+0000 7f3a3990e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:46:39.701 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:39.700+0000 7f621a60b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:46:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.751+0000 7f7416ffd700 1 -- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f740405ee20 msgr2=0x7f74040612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.751+0000 7f7416ffd700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f740405ee20 0x7f74040612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:46:39.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.754+0000 7f741d333700 1 -- 172.21.15.78:0/3501982755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f74180aa9b0 con 0x7f74180aa4d0 2023-08-17T17:46:39.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.755+0000 7f73feffd700 1 -- 172.21.15.78:0/3501982755 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v47) v1 ==== 110+0+10 (secure 0 0 0) 0x7f74180aa9b0 con 0x7f74180aa4d0 2023-08-17T17:46:39.756 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:46:39.757 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:39.756+0000 7f3a3990e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:46:39.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 -- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f740405ee20 msgr2=0x7f74040612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:39.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f740405ee20 0x7f74040612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:39.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 -- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 msgr2=0x7f74180b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 0x7f74180b0190 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f741805e180 tx=0x7f7408017000).stop 2023-08-17T17:46:39.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 -- 172.21.15.78:0/3501982755 shutdown_connections 2023-08-17T17:46:39.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f740405ee20 0x7f74040612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:39.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74180c5810 0x7f74180ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74180aa0f0 0x7f74180c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 --2- 172.21.15.78:0/3501982755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74180aa4d0 0x7f74180b0190 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 -- 172.21.15.78:0/3501982755 >> 172.21.15.78:0/3501982755 conn(0x7f741806a6a0 msgr2=0x7f7418152f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:39.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 -- 172.21.15.78:0/3501982755 shutdown_connections 2023-08-17T17:46:39.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.757+0000 7f741d333700 1 -- 172.21.15.78:0/3501982755 wait complete. 2023-08-17T17:46:39.770 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:46:39.887 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:39.885+0000 7f621a60b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:46:39.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.890+0000 7fafe5481700 1 Processor -- start 2023-08-17T17:46:39.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.890+0000 7fafe5481700 1 -- start start 2023-08-17T17:46:39.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafe5481700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fafe0096520 0x7fafe00be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafe5481700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe00c3e10 con 0x7fafe01578f0 2023-08-17T17:46:39.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafe5481700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe00c34e0 con 0x7fafe00bf0e0 2023-08-17T17:46:39.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafe5481700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe00bf5c0 con 0x7fafe0096520 2023-08-17T17:46:39.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafdeffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fafe01578f0 0x7fafe0095e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56044/0 (socket says 172.21.15.78:56044) 2023-08-17T17:46:39.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafdeffd700 1 -- 172.21.15.78:0/3109327545 learned_addr learned my addr 172.21.15.78:0/3109327545 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:39.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafde7fc700 1 --2- 172.21.15.78:0/3109327545 >> v2:172.21.15.150:3300/0 conn(0x7fafe0096520 0x7fafe00be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905016518 0 0) 0x7fafe00c3e10 con 0x7fafe01578f0 2023-08-17T17:46:39.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc80033f0 con 0x7fafe01578f0 2023-08-17T17:46:39.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949722145 0 0) 0x7fafe00c34e0 con 0x7fafe00bf0e0 2023-08-17T17:46:39.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe00c3e10 con 0x7fafe00bf0e0 2023-08-17T17:46:39.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.891+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3623146196 0 0) 0x7fafc80033f0 con 0x7fafe01578f0 2023-08-17T17:46:39.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 >> v2:172.21.15.150:3300/0 conn(0x7fafe0096520 msgr2=0x7fafe00be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:39.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 --2- 172.21.15.78:0/3109327545 >> v2:172.21.15.150:3300/0 conn(0x7fafe0096520 0x7fafe00be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 >> v1:172.21.15.150:6789/0 conn(0x7fafe00bf0e0 legacy=0x7fafe00c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe00c37c0 con 0x7fafe01578f0 2023-08-17T17:46:39.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fafd4001470 con 0x7fafe01578f0 2023-08-17T17:46:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafde7fc700 1 --2- 172.21.15.78:0/3109327545 >> v2:172.21.15.150:3300/0 conn(0x7fafe0096520 0x7fafe00be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 >> v1:172.21.15.78:6789/0 conn(0x7fafe01578f0 legacy=0x7fafe0095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc8003a70 0x7fafc8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc8004690 0x7fafc8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc8005050 0x7fafc800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00bf5c0 con 0x7fafc8004690 2023-08-17T17:46:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc800bfc0 con 0x7fafc8003a70 2023-08-17T17:46:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc800c180 con 0x7fafc8005050 2023-08-17T17:46:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafde7fc700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc8004690 0x7fafc8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafdeffd700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc8003a70 0x7fafc8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafdf7fe700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc8005050 0x7fafc800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafde7fc700 1 -- 172.21.15.78:0/3109327545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc8005050 msgr2=0x7fafc800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafde7fc700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc8005050 0x7fafc800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafde7fc700 1 -- 172.21.15.78:0/3109327545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc8003a70 msgr2=0x7fafc8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafde7fc700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc8003a70 0x7fafc8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafde7fc700 1 -- 172.21.15.78:0/3109327545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc80033f0 con 0x7fafc8004690 2023-08-17T17:46:39.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafdf7fe700 1 -- 172.21.15.78:0/3109327545 reap_dead start 2023-08-17T17:46:39.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafdeffd700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc8003a70 0x7fafc8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:39.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafde7fc700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc8004690 0x7fafc8004b10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fafe0096920 tx=0x7fafd0009060).ready entity=mon.0 client_cookie=f4c762acc924da3a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:39.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd00095c0 con 0x7fafc8004690 2023-08-17T17:46:39.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd000e710 con 0x7fafc8004690 2023-08-17T17:46:39.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.892+0000 7fafddffb700 1 -- 172.21.15.78:0/3109327545 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd000ea90 con 0x7fafc8004690 2023-08-17T17:46:39.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.893+0000 7fafe5481700 1 -- 172.21.15.78:0/3109327545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc8004690 msgr2=0x7fafc8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.893+0000 7fafe5481700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc8004690 0x7fafc8004b10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fafe0096920 tx=0x7fafd0009060).stop 2023-08-17T17:46:39.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.893+0000 7fafe5481700 1 -- 172.21.15.78:0/3109327545 shutdown_connections 2023-08-17T17:46:39.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.893+0000 7fafe5481700 1 --2- 172.21.15.78:0/3109327545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc8004690 0x7fafc8004b10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.893+0000 7fafe5481700 1 -- 172.21.15.78:0/3109327545 >> 172.21.15.78:0/3109327545 conn(0x7fafe0062f80 msgr2=0x7fafe00c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:39.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.893+0000 7fafe5481700 1 -- 172.21.15.78:0/3109327545 shutdown_connections 2023-08-17T17:46:39.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.893+0000 7fafe5481700 1 -- 172.21.15.78:0/3109327545 wait complete. 2023-08-17T17:46:39.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.894+0000 7fafe5481700 1 Processor -- start 2023-08-17T17:46:39.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.894+0000 7fafe5481700 1 -- start start 2023-08-17T17:46:39.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafe5481700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc8004690 0x7fafe00aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafe5481700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafe0168550 0x7fafe00ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafe5481700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe0167930 0x7fafe0167db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafe5481700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01682a0 con 0x7fafe0167930 2023-08-17T17:46:39.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafe5481700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00a9020 con 0x7fafc8004690 2023-08-17T17:46:39.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafe5481700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00a9300 con 0x7fafe0168550 2023-08-17T17:46:39.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafdf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe0167930 0x7fafe0167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafdeffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc8004690 0x7fafe00aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafdf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe0167930 0x7fafe0167db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58222/0 (socket says 172.21.15.78:58222) 2023-08-17T17:46:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafdf7fe700 1 -- 172.21.15.78:0/1824046391 learned_addr learned my addr 172.21.15.78:0/1824046391 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.895+0000 7fafde7fc700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafe0168550 0x7fafe00ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafdf7fe700 1 -- 172.21.15.78:0/1824046391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafe0168550 msgr2=0x7fafe00ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafdf7fe700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafe0168550 0x7fafe00ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafdf7fe700 1 -- 172.21.15.78:0/1824046391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc8004690 msgr2=0x7fafe00aa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafdf7fe700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc8004690 0x7fafe00aa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafdf7fe700 1 -- 172.21.15.78:0/1824046391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe00a95e0 con 0x7fafe0167930 2023-08-17T17:46:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafdf7fe700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe0167930 0x7fafe0167db0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fafe00c3260 tx=0x7fafd8007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafc6ffd700 1 -- 172.21.15.78:0/1824046391 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8002ea0 con 0x7fafe0167930 2023-08-17T17:46:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafc6ffd700 1 -- 172.21.15.78:0/1824046391 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8006a20 con 0x7fafe0167930 2023-08-17T17:46:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafe5481700 1 -- 172.21.15.78:0/1824046391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe00a98c0 con 0x7fafe0167930 2023-08-17T17:46:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafc6ffd700 1 -- 172.21.15.78:0/1824046391 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8006de0 con 0x7fafe0167930 2023-08-17T17:46:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.896+0000 7fafe5481700 1 -- 172.21.15.78:0/1824046391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe00aa0c0 con 0x7fafe0167930 2023-08-17T17:46:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.897+0000 7fafe5481700 1 -- 172.21.15.78:0/1824046391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe00a9d60 con 0x7fafe0167930 2023-08-17T17:46:39.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.897+0000 7fafc6ffd700 1 -- 172.21.15.78:0/1824046391 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fafd8007240 con 0x7fafe0167930 2023-08-17T17:46:39.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.898+0000 7fafc6ffd700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fafcc05ee20 0x7fafcc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:39.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.898+0000 7fafdeffd700 1 -- 172.21.15.78:0/1824046391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fafcc05ee20 msgr2=0x7fafcc0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:39.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.898+0000 7fafc6ffd700 1 -- 172.21.15.78:0/1824046391 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fafd80798b0 con 0x7fafe0167930 2023-08-17T17:46:39.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.898+0000 7fafdeffd700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fafcc05ee20 0x7fafcc0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:39.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:39.902+0000 7fafc6ffd700 1 -- 172.21.15.78:0/1824046391 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fafd80498f0 con 0x7fafe0167930 2023-08-17T17:46:39.953 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:39.952+0000 7f3a3990e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:46:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.071+0000 7fafe5481700 1 -- 172.21.15.78:0/1824046391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fafe0046af0 con 0x7fafe0167930 2023-08-17T17:46:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.072+0000 7fafc6ffd700 1 -- 172.21.15.78:0/1824046391 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7fafd804aa70 con 0x7fafe0167930 2023-08-17T17:46:40.073 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:46:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 -- 172.21.15.78:0/1824046391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fafcc05ee20 msgr2=0x7fafcc0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fafcc05ee20 0x7fafcc0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 -- 172.21.15.78:0/1824046391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe0167930 msgr2=0x7fafe0167db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe0167930 0x7fafe0167db0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fafe00c3260 tx=0x7fafd8007f30).stop 2023-08-17T17:46:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 -- 172.21.15.78:0/1824046391 shutdown_connections 2023-08-17T17:46:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fafcc05ee20 0x7fafcc0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe0167930 0x7fafe0167db0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc8004690 0x7fafe00aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 --2- 172.21.15.78:0/1824046391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafe0168550 0x7fafe00ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 -- 172.21.15.78:0/1824046391 >> 172.21.15.78:0/1824046391 conn(0x7fafe0062f80 msgr2=0x7fafe00642c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 -- 172.21.15.78:0/1824046391 shutdown_connections 2023-08-17T17:46:40.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.074+0000 7fafe5481700 1 -- 172.21.15.78:0/1824046391 wait complete. 2023-08-17T17:46:40.087 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:46:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.208+0000 7f9d29464700 1 Processor -- start 2023-08-17T17:46:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.208+0000 7f9d29464700 1 -- start start 2023-08-17T17:46:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d29464700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d240c4790 0x7f9d24064a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d29464700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 0x7f9d240c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d29464700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9d240c5300 0x7f9d240c5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d29464700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d24155400 con 0x7f9d240c4790 2023-08-17T17:46:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d29464700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d240c5c80 con 0x7f9d240c5300 2023-08-17T17:46:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d29464700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240c30d0 con 0x7f9d24062cd0 2023-08-17T17:46:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d23fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d240c4790 0x7f9d24064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d23fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d240c4790 0x7f9d24064a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58234/0 (socket says 172.21.15.78:58234) 2023-08-17T17:46:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d23fff700 1 -- 172.21.15.78:0/491898882 learned_addr learned my addr 172.21.15.78:0/491898882 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d28c63700 1 --2- 172.21.15.78:0/491898882 >> v2:172.21.15.150:3300/0 conn(0x7f9d240c5300 0x7f9d240c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d237fe700 1 --2- 172.21.15.78:0/491898882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 0x7f9d240c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d23fff700 1 -- 172.21.15.78:0/491898882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 msgr2=0x7f9d240c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d23fff700 1 --2- 172.21.15.78:0/491898882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 0x7f9d240c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d23fff700 1 -- 172.21.15.78:0/491898882 >> v2:172.21.15.150:3300/0 conn(0x7f9d240c5300 msgr2=0x7f9d240c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d23fff700 1 --2- 172.21.15.78:0/491898882 >> v2:172.21.15.150:3300/0 conn(0x7f9d240c5300 0x7f9d240c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d23fff700 1 -- 172.21.15.78:0/491898882 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d241547f0 con 0x7f9d240c4790 2023-08-17T17:46:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d237fe700 1 --2- 172.21.15.78:0/491898882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 0x7f9d240c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d23fff700 1 --2- 172.21.15.78:0/491898882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 0x7f9d24064a90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f9d24069ef0 tx=0x7f9d14009060).ready entity=mon.0 client_cookie=28d610cc5879ec27 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d22ffd700 1 -- 172.21.15.78:0/491898882 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14005880 con 0x7f9d240c4790 2023-08-17T17:46:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d22ffd700 1 -- 172.21.15.78:0/491898882 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d140059e0 con 0x7f9d240c4790 2023-08-17T17:46:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.209+0000 7f9d22ffd700 1 -- 172.21.15.78:0/491898882 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14005d60 con 0x7f9d240c4790 2023-08-17T17:46:40.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.210+0000 7f9d29464700 1 -- 172.21.15.78:0/491898882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 msgr2=0x7f9d24064a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.210+0000 7f9d29464700 1 --2- 172.21.15.78:0/491898882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 0x7f9d24064a90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f9d24069ef0 tx=0x7f9d14009060).stop 2023-08-17T17:46:40.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.210+0000 7f9d29464700 1 -- 172.21.15.78:0/491898882 shutdown_connections 2023-08-17T17:46:40.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.210+0000 7f9d29464700 1 --2- 172.21.15.78:0/491898882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 0x7f9d24064a90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.210+0000 7f9d29464700 1 --2- 172.21.15.78:0/491898882 >> v2:172.21.15.150:3300/0 conn(0x7f9d240c5300 0x7f9d240c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.210+0000 7f9d29464700 1 --2- 172.21.15.78:0/491898882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 0x7f9d240c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.210+0000 7f9d29464700 1 -- 172.21.15.78:0/491898882 >> 172.21.15.78:0/491898882 conn(0x7f9d2406a660 msgr2=0x7f9d240921a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.210+0000 7f9d29464700 1 -- 172.21.15.78:0/491898882 shutdown_connections 2023-08-17T17:46:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.210+0000 7f9d29464700 1 -- 172.21.15.78:0/491898882 wait complete. 2023-08-17T17:46:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.211+0000 7f9d29464700 1 Processor -- start 2023-08-17T17:46:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.211+0000 7f9d29464700 1 -- start start 2023-08-17T17:46:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d29464700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 0x7f9d240a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d29464700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 0x7f9d24153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d29464700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d240c5300 0x7f9d241644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d29464700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240adcd0 con 0x7f9d240c4790 2023-08-17T17:46:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d29464700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240abf20 con 0x7f9d240c5300 2023-08-17T17:46:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d29464700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d241653d0 con 0x7f9d24062cd0 2023-08-17T17:46:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d237fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 0x7f9d24153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d237fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 0x7f9d24153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58240/0 (socket says 172.21.15.78:58240) 2023-08-17T17:46:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d237fe700 1 -- 172.21.15.78:0/3693465624 learned_addr learned my addr 172.21.15.78:0/3693465624 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d23fff700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 0x7f9d240a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d28c63700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d240c5300 0x7f9d241644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d237fe700 1 -- 172.21.15.78:0/3693465624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 msgr2=0x7f9d240a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d237fe700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 0x7f9d240a85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d237fe700 1 -- 172.21.15.78:0/3693465624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d240c5300 msgr2=0x7f9d241644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d237fe700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d240c5300 0x7f9d241644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.212+0000 7f9d237fe700 1 -- 172.21.15.78:0/3693465624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14009300 con 0x7f9d240c4790 2023-08-17T17:46:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.213+0000 7f9d237fe700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 0x7f9d24153570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f9d1800d8c0 tx=0x7f9d18008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.213+0000 7f9d0bfff700 1 -- 172.21.15.78:0/3693465624 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18011590 con 0x7f9d240c4790 2023-08-17T17:46:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.213+0000 7f9d0bfff700 1 -- 172.21.15.78:0/3693465624 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d180116f0 con 0x7f9d240c4790 2023-08-17T17:46:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.213+0000 7f9d0bfff700 1 -- 172.21.15.78:0/3693465624 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18011a70 con 0x7f9d240c4790 2023-08-17T17:46:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.213+0000 7f9d29464700 1 -- 172.21.15.78:0/3693465624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d24164e10 con 0x7f9d240c4790 2023-08-17T17:46:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.213+0000 7f9d29464700 1 -- 172.21.15.78:0/3693465624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d240abbb0 con 0x7f9d240c4790 2023-08-17T17:46:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.214+0000 7f9d29464700 1 -- 172.21.15.78:0/3693465624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d240ac0b0 con 0x7f9d240c4790 2023-08-17T17:46:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.214+0000 7f9d0bfff700 1 -- 172.21.15.78:0/3693465624 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f9d1801c460 con 0x7f9d240c4790 2023-08-17T17:46:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.214+0000 7f9d0bfff700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9d1005edf0 0x7f9d100612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.214+0000 7f9d23fff700 1 -- 172.21.15.78:0/3693465624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9d1005edf0 msgr2=0x7f9d100612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.214+0000 7f9d0bfff700 1 -- 172.21.15.78:0/3693465624 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f9d18079d60 con 0x7f9d240c4790 2023-08-17T17:46:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.214+0000 7f9d23fff700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9d1005edf0 0x7f9d100612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.218+0000 7f9d0bfff700 1 -- 172.21.15.78:0/3693465624 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9d1804aec0 con 0x7f9d240c4790 2023-08-17T17:46:40.308 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:40.307+0000 7f621a60b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:46:40.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.387+0000 7f9d29464700 1 -- 172.21.15.78:0/3693465624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d2405f910 con 0x7f9d240c4790 2023-08-17T17:46:40.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.388+0000 7f9d0bfff700 1 -- 172.21.15.78:0/3693465624 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d1804e4e0 con 0x7f9d240c4790 2023-08-17T17:46:40.389 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:46:40.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 -- 172.21.15.78:0/3693465624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9d1005edf0 msgr2=0x7f9d100612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:40.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9d1005edf0 0x7f9d100612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:40.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 -- 172.21.15.78:0/3693465624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 msgr2=0x7f9d24153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 0x7f9d24153570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f9d1800d8c0 tx=0x7f9d18008040).stop 2023-08-17T17:46:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 -- 172.21.15.78:0/3693465624 shutdown_connections 2023-08-17T17:46:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9d1005edf0 0x7f9d100612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d240c5300 0x7f9d241644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d24062cd0 0x7f9d240a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 --2- 172.21.15.78:0/3693465624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d240c4790 0x7f9d24153570 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 -- 172.21.15.78:0/3693465624 >> 172.21.15.78:0/3693465624 conn(0x7f9d2406a660 msgr2=0x7f9d240668b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 -- 172.21.15.78:0/3693465624 shutdown_connections 2023-08-17T17:46:40.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f9d29464700 1 -- 172.21.15.78:0/3693465624 wait complete. 2023-08-17T17:46:40.393 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:40.390+0000 7f3a3990e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:46:40.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:46:40.410 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:40.409+0000 7f621a60b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:46:40.503 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:40.502+0000 7f3a3990e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:46:40.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.522+0000 7f17c14ef700 1 Processor -- start 2023-08-17T17:46:40.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.522+0000 7f17c14ef700 1 -- start start 2023-08-17T17:46:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.523+0000 7f17c14ef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f17bc062c00 0x7f17bc15f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.523+0000 7f17c14ef700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17bc0bcf10 con 0x7f17bc13a870 2023-08-17T17:46:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.523+0000 7f17c14ef700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17bc0bd1f0 con 0x7f17bc13a490 2023-08-17T17:46:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.523+0000 7f17c14ef700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17bc0c29d0 con 0x7f17bc062c00 2023-08-17T17:46:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.523+0000 7f17ba7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f17bc13a870 0x7f17bc0624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56052/0 (socket says 172.21.15.78:56052) 2023-08-17T17:46:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.523+0000 7f17ba7fc700 1 -- 172.21.15.78:0/454625353 learned_addr learned my addr 172.21.15.78:0/454625353 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17bb7fe700 1 --2- 172.21.15.78:0/454625353 >> v2:172.21.15.150:3300/0 conn(0x7f17bc062c00 0x7f17bc15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17b9ffb700 1 -- 172.21.15.78:0/454625353 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369871701 0 0) 0x7f17bc0bcf10 con 0x7f17bc13a870 2023-08-17T17:46:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17b9ffb700 1 -- 172.21.15.78:0/454625353 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a40033f0 con 0x7f17bc13a870 2023-08-17T17:46:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17b9ffb700 1 -- 172.21.15.78:0/454625353 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812286453 0 0) 0x7f17bc0bd1f0 con 0x7f17bc13a490 2023-08-17T17:46:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17b9ffb700 1 -- 172.21.15.78:0/454625353 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17bc0bcf10 con 0x7f17bc13a490 2023-08-17T17:46:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17bb7fe700 1 -- 172.21.15.78:0/454625353 >> v1:172.21.15.150:6789/0 conn(0x7f17bc13a490 legacy=0x7f17bc069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17bb7fe700 1 -- 172.21.15.78:0/454625353 >> v1:172.21.15.78:6789/0 conn(0x7f17bc13a870 legacy=0x7f17bc0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17bb7fe700 1 -- 172.21.15.78:0/454625353 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc0c2310 con 0x7f17bc062c00 2023-08-17T17:46:40.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17bb7fe700 1 --2- 172.21.15.78:0/454625353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17bc062c00 0x7f17bc15f030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f17b4009e60 tx=0x7f17b4009780).ready entity=mon.1 client_cookie=1e53df912fa67552 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:40.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17b9ffb700 1 -- 172.21.15.78:0/454625353 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400e070 con 0x7f17bc062c00 2023-08-17T17:46:40.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17b9ffb700 1 -- 172.21.15.78:0/454625353 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b400bab0 con 0x7f17bc062c00 2023-08-17T17:46:40.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.524+0000 7f17b9ffb700 1 -- 172.21.15.78:0/454625353 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400be30 con 0x7f17bc062c00 2023-08-17T17:46:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.525+0000 7f17c14ef700 1 -- 172.21.15.78:0/454625353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17bc062c00 msgr2=0x7f17bc15f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.525+0000 7f17c14ef700 1 --2- 172.21.15.78:0/454625353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17bc062c00 0x7f17bc15f030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f17b4009e60 tx=0x7f17b4009780).stop 2023-08-17T17:46:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.525+0000 7f17c14ef700 1 -- 172.21.15.78:0/454625353 shutdown_connections 2023-08-17T17:46:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.525+0000 7f17c14ef700 1 --2- 172.21.15.78:0/454625353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17bc062c00 0x7f17bc15f030 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.525+0000 7f17c14ef700 1 -- 172.21.15.78:0/454625353 >> 172.21.15.78:0/454625353 conn(0x7f17bc0c7bd0 msgr2=0x7f17bc0c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.525+0000 7f17c14ef700 1 -- 172.21.15.78:0/454625353 shutdown_connections 2023-08-17T17:46:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.525+0000 7f17c14ef700 1 -- 172.21.15.78:0/454625353 wait complete. 2023-08-17T17:46:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.526+0000 7f17c14ef700 1 Processor -- start 2023-08-17T17:46:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.526+0000 7f17c14ef700 1 -- start start 2023-08-17T17:46:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17c14ef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc062c00 0x7f17bc165700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17c14ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17bc13a490 0x7f17bc164570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17c14ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17bc13a870 0x7f17bc157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17c14ef700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc0a7910 con 0x7f17bc062c00 2023-08-17T17:46:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17c14ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc164ee0 con 0x7f17bc13a870 2023-08-17T17:46:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17c14ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc1651c0 con 0x7f17bc13a490 2023-08-17T17:46:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17baffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc062c00 0x7f17bc165700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17baffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc062c00 0x7f17bc165700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58248/0 (socket says 172.21.15.78:58248) 2023-08-17T17:46:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17baffd700 1 -- 172.21.15.78:0/383838694 learned_addr learned my addr 172.21.15.78:0/383838694 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17bb7fe700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17bc13a870 0x7f17bc157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17ba7fc700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17bc13a490 0x7f17bc164570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17baffd700 1 -- 172.21.15.78:0/383838694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17bc13a490 msgr2=0x7f17bc164570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17baffd700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17bc13a490 0x7f17bc164570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17baffd700 1 -- 172.21.15.78:0/383838694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17bc13a870 msgr2=0x7f17bc157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17baffd700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17bc13a870 0x7f17bc157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17baffd700 1 -- 172.21.15.78:0/383838694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4009a20 con 0x7f17bc062c00 2023-08-17T17:46:40.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.527+0000 7f17baffd700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc062c00 0x7f17bc165700 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f17b000c490 tx=0x7f17b0007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:40.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.528+0000 7f17a2ffd700 1 -- 172.21.15.78:0/383838694 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b000ce40 con 0x7f17bc062c00 2023-08-17T17:46:40.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.528+0000 7f17a2ffd700 1 -- 172.21.15.78:0/383838694 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b000f470 con 0x7f17bc062c00 2023-08-17T17:46:40.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.528+0000 7f17c14ef700 1 -- 172.21.15.78:0/383838694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17bc1654a0 con 0x7f17bc062c00 2023-08-17T17:46:40.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.528+0000 7f17a2ffd700 1 -- 172.21.15.78:0/383838694 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b000f810 con 0x7f17bc062c00 2023-08-17T17:46:40.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.528+0000 7f17c14ef700 1 -- 172.21.15.78:0/383838694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17bc165bf0 con 0x7f17bc062c00 2023-08-17T17:46:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.528+0000 7f17c14ef700 1 -- 172.21.15.78:0/383838694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17bc0c57d0 con 0x7f17bc062c00 2023-08-17T17:46:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.529+0000 7f17a2ffd700 1 -- 172.21.15.78:0/383838694 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f17b0019030 con 0x7f17bc062c00 2023-08-17T17:46:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.529+0000 7f17a2ffd700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f17a805ee20 0x7f17a80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.529+0000 7f17ba7fc700 1 -- 172.21.15.78:0/383838694 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f17a805ee20 msgr2=0x7f17a80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.529+0000 7f17a2ffd700 1 -- 172.21.15.78:0/383838694 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f17b0079350 con 0x7f17bc062c00 2023-08-17T17:46:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.529+0000 7f17ba7fc700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f17a805ee20 0x7f17a80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:40.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.537+0000 7f17a2ffd700 1 -- 172.21.15.78:0/383838694 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17b004a510 con 0x7f17bc062c00 2023-08-17T17:46:40.565 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:40.563+0000 7f621a60b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:46:40.639 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:40.637+0000 7f621a60b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:46:40.663 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:40.662+0000 7f3a3990e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:46:40.706 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:40.704+0000 7f621a60b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:46:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.705+0000 7f17c14ef700 1 -- 172.21.15.78:0/383838694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17bc0a7760 con 0x7f17bc062c00 2023-08-17T17:46:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.706+0000 7f17a2ffd700 1 -- 172.21.15.78:0/383838694 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17b004db30 con 0x7f17bc062c00 2023-08-17T17:46:40.707 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:46:40.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 -- 172.21.15.78:0/383838694 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f17a805ee20 msgr2=0x7f17a80612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f17a805ee20 0x7f17a80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 -- 172.21.15.78:0/383838694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc062c00 msgr2=0x7f17bc165700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc062c00 0x7f17bc165700 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f17b000c490 tx=0x7f17b0007c90).stop 2023-08-17T17:46:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 -- 172.21.15.78:0/383838694 shutdown_connections 2023-08-17T17:46:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f17a805ee20 0x7f17a80612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17bc13a870 0x7f17bc157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc062c00 0x7f17bc165700 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 --2- 172.21.15.78:0/383838694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17bc13a490 0x7f17bc164570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 -- 172.21.15.78:0/383838694 >> 172.21.15.78:0/383838694 conn(0x7f17bc0c7bd0 msgr2=0x7f17bc0a6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 -- 172.21.15.78:0/383838694 shutdown_connections 2023-08-17T17:46:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.708+0000 7f17c14ef700 1 -- 172.21.15.78:0/383838694 wait complete. 2023-08-17T17:46:40.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:46:40.740 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:40.739+0000 7f3a3990e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:46:40.811 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:40.810+0000 7f3a3990e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:46:40.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.837+0000 7fddda9cc700 1 Processor -- start 2023-08-17T17:46:40.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.837+0000 7fddda9cc700 1 -- start start 2023-08-17T17:46:40.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddda9cc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 0x7fddd40c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddda9cc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fddd40c5b50 0x7fddd40624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddda9cc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd40c6040 con 0x7fddd4066a40 2023-08-17T17:46:40.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddda9cc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd4069b00 con 0x7fddd40c5b50 2023-08-17T17:46:40.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddda9cc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4069f90 con 0x7fddd4066660 2023-08-17T17:46:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd3fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 0x7fddd40c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd8f69700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fddd4066a40 0x7fddd4151570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:56062/0 (socket says 172.21.15.78:56062) 2023-08-17T17:46:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd37fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fddd40c5b50 0x7fddd40624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd8f69700 1 -- 172.21.15.78:0/888285175 learned_addr learned my addr 172.21.15.78:0/888285175 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd2ffd700 1 -- 172.21.15.78:0/888285175 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741296399 0 0) 0x7fddcc001490 con 0x7fddd4066a40 2023-08-17T17:46:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd2ffd700 1 -- 172.21.15.78:0/888285175 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddbc0033f0 con 0x7fddd4066a40 2023-08-17T17:46:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd3fff700 1 -- 172.21.15.78:0/888285175 >> v2:172.21.15.150:3300/0 conn(0x7fddd40c5b50 msgr2=0x7fddd40624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd3fff700 1 --2- 172.21.15.78:0/888285175 >> v2:172.21.15.150:3300/0 conn(0x7fddd40c5b50 0x7fddd40624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd3fff700 1 -- 172.21.15.78:0/888285175 >> v1:172.21.15.150:6789/0 conn(0x7fddd4066a40 legacy=0x7fddd4151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd3fff700 1 -- 172.21.15.78:0/888285175 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40691d0 con 0x7fddd4066660 2023-08-17T17:46:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd37fe700 1 --2- 172.21.15.78:0/888285175 >> v2:172.21.15.150:3300/0 conn(0x7fddd40c5b50 0x7fddd40624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.838+0000 7fddd3fff700 1 --2- 172.21.15.78:0/888285175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 0x7fddd40c5660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fddc4009760 tx=0x7fddc4009060).ready entity=mon.2 client_cookie=4f8c01ff237f68e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddd2ffd700 1 -- 172.21.15.78:0/888285175 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400d4a0 con 0x7fddd4066660 2023-08-17T17:46:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddd2ffd700 1 -- 172.21.15.78:0/888285175 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc400d600 con 0x7fddd4066660 2023-08-17T17:46:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddd2ffd700 1 -- 172.21.15.78:0/888285175 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400d980 con 0x7fddd4066660 2023-08-17T17:46:40.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddda9cc700 1 -- 172.21.15.78:0/888285175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 msgr2=0x7fddd40c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddda9cc700 1 --2- 172.21.15.78:0/888285175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 0x7fddd40c5660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fddc4009760 tx=0x7fddc4009060).stop 2023-08-17T17:46:40.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddda9cc700 1 -- 172.21.15.78:0/888285175 shutdown_connections 2023-08-17T17:46:40.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddda9cc700 1 --2- 172.21.15.78:0/888285175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 0x7fddd40c5660 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddda9cc700 1 --2- 172.21.15.78:0/888285175 >> v2:172.21.15.150:3300/0 conn(0x7fddd40c5b50 0x7fddd40624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddda9cc700 1 -- 172.21.15.78:0/888285175 >> 172.21.15.78:0/888285175 conn(0x7fddd40c7b00 msgr2=0x7fddd40c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:40.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddda9cc700 1 -- 172.21.15.78:0/888285175 shutdown_connections 2023-08-17T17:46:40.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.839+0000 7fddda9cc700 1 -- 172.21.15.78:0/888285175 wait complete. 2023-08-17T17:46:40.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.840+0000 7fddda9cc700 1 Processor -- start 2023-08-17T17:46:40.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.841+0000 7fddda9cc700 1 -- start start 2023-08-17T17:46:40.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.841+0000 7fddda9cc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 0x7fddd4148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.841+0000 7fddda9cc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd4066a40 0x7fddd40bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.841+0000 7fddda9cc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd40c5b50 0x7fddd40be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.841+0000 7fddda9cc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40aa6e0 con 0x7fddd40c5b50 2023-08-17T17:46:40.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.841+0000 7fddda9cc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40be5c0 con 0x7fddd4066a40 2023-08-17T17:46:40.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.841+0000 7fddda9cc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4168cb0 con 0x7fddd4066660 2023-08-17T17:46:40.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.841+0000 7fddd8f69700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd40c5b50 0x7fddd40be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddd8f69700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd40c5b50 0x7fddd40be0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58264/0 (socket says 172.21.15.78:58264) 2023-08-17T17:46:40.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddd8f69700 1 -- 172.21.15.78:0/3366629922 learned_addr learned my addr 172.21.15.78:0/3366629922 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:40.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddd37fe700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd4066a40 0x7fddd40bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddd3fff700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 0x7fddd4148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:40.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddd8f69700 1 -- 172.21.15.78:0/3366629922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 msgr2=0x7fddd4148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddd8f69700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 0x7fddd4148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddd8f69700 1 -- 172.21.15.78:0/3366629922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd4066a40 msgr2=0x7fddd40bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:40.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddd8f69700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd4066a40 0x7fddd40bdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:40.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddd8f69700 1 -- 172.21.15.78:0/3366629922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc80092a0 con 0x7fddd40c5b50 2023-08-17T17:46:40.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddd8f69700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd40c5b50 0x7fddd40be0d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fddcc00c810 tx=0x7fddcc007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:40.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddbbfff700 1 -- 172.21.15.78:0/3366629922 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc005d30 con 0x7fddd40c5b50 2023-08-17T17:46:40.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddbbfff700 1 -- 172.21.15.78:0/3366629922 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc005e90 con 0x7fddd40c5b50 2023-08-17T17:46:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddda9cc700 1 -- 172.21.15.78:0/3366629922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc40092a0 con 0x7fddd40c5b50 2023-08-17T17:46:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddbbfff700 1 -- 172.21.15.78:0/3366629922 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc007320 con 0x7fddd40c5b50 2023-08-17T17:46:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.842+0000 7fddda9cc700 1 -- 172.21.15.78:0/3366629922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd41681d0 con 0x7fddd40c5b50 2023-08-17T17:46:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.843+0000 7fddda9cc700 1 -- 172.21.15.78:0/3366629922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd4047350 con 0x7fddd40c5b50 2023-08-17T17:46:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.843+0000 7fddbbfff700 1 -- 172.21.15.78:0/3366629922 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fddcc010030 con 0x7fddd40c5b50 2023-08-17T17:46:40.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.844+0000 7fddbbfff700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddc005ee20 0x7fddc00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:40.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.844+0000 7fddd3fff700 1 -- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddc005ee20 msgr2=0x7fddc00612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:40.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.844+0000 7fddbbfff700 1 -- 172.21.15.78:0/3366629922 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fddcc079be0 con 0x7fddd40c5b50 2023-08-17T17:46:40.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.844+0000 7fddd3fff700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddc005ee20 0x7fddc00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:40.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:40.848+0000 7fddbbfff700 1 -- 172.21.15.78:0/3366629922 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fddcc04ada0 con 0x7fddd40c5b50 2023-08-17T17:46:40.965 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:40.964+0000 7f621a60b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:46:41.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.045+0000 7fddd3fff700 1 -- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddc005ee20 msgr2=0x7fddc00612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:41.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.045+0000 7fddd3fff700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddc005ee20 0x7fddc00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:46:41.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.060+0000 7fddda9cc700 1 -- 172.21.15.78:0/3366629922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddd40c6040 con 0x7fddd40c5b50 2023-08-17T17:46:41.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.060+0000 7fddbbfff700 1 -- 172.21.15.78:0/3366629922 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4483 (secure 0 0 0) 0x7fddd40c6040 con 0x7fddd40c5b50 2023-08-17T17:46:41.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:41.061 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/175439344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":175439344},{"type":"v1","addr":"172.21.15.150:6834","nonce":175439344}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/893012651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":893012651},{"type":"v1","addr":"172.21.15.150:6835","nonce":893012651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4944,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/734042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":734042508},{"type":"v1","addr":"172.21.15.78:6836","nonce":734042508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:35:10.721386+0000","modified":"2023-08-17T17:35:13.361851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/3186726071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3186726071},{"type":"v1","addr":"172.21.15.78:6837","nonce":3186726071}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T17:46:41.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 -- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddc005ee20 msgr2=0x7fddc00612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:41.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddc005ee20 0x7fddc00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:41.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 -- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd40c5b50 msgr2=0x7fddd40be0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd40c5b50 0x7fddd40be0d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fddcc00c810 tx=0x7fddcc007e30).stop 2023-08-17T17:46:41.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 -- 172.21.15.78:0/3366629922 shutdown_connections 2023-08-17T17:46:41.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fddc005ee20 0x7fddc00612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:41.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd40c5b50 0x7fddd40be0d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd4066660 0x7fddd4148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 --2- 172.21.15.78:0/3366629922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd4066a40 0x7fddd40bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 -- 172.21.15.78:0/3366629922 >> 172.21.15.78:0/3366629922 conn(0x7fddd40c7b00 msgr2=0x7fddd4155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:41.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 -- 172.21.15.78:0/3366629922 shutdown_connections 2023-08-17T17:46:41.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.062+0000 7fddda9cc700 1 -- 172.21.15.78:0/3366629922 wait complete. 2023-08-17T17:46:41.065 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 13 2023-08-17T17:46:41.076 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:46:41.080 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:41.079+0000 7f3a3990e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:46:41.147 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:41.146+0000 7f621a60b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:46:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.198+0000 7f6ef1aca700 1 Processor -- start 2023-08-17T17:46:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.198+0000 7f6ef1aca700 1 -- start start 2023-08-17T17:46:41.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6ef1aca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 0x7f6eec1353d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6ef1aca700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec1536b0 con 0x7f6eec152b50 2023-08-17T17:46:41.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6ef1aca700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec069050 con 0x7f6eec134ff0 2023-08-17T17:46:41.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6ef1aca700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec066d50 con 0x7f6eec062c00 2023-08-17T17:46:41.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6eebfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6eec152b50 0x7f6eec152fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56054/0 (socket says 172.21.15.78:56054) 2023-08-17T17:46:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6eebfff700 1 -- 172.21.15.78:0/3992180735 learned_addr learned my addr 172.21.15.78:0/3992180735 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6ee3fff700 1 --2- 172.21.15.78:0/3992180735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 0x7f6eec1353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6eeaffd700 1 -- 172.21.15.78:0/3992180735 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365768423 0 0) 0x7f6ee4001490 con 0x7f6eec152b50 2023-08-17T17:46:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6eeaffd700 1 -- 172.21.15.78:0/3992180735 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ed80033f0 con 0x7f6eec152b50 2023-08-17T17:46:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6eeaffd700 1 -- 172.21.15.78:0/3992180735 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765928366 0 0) 0x7f6eec069050 con 0x7f6eec134ff0 2023-08-17T17:46:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6eeaffd700 1 -- 172.21.15.78:0/3992180735 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee4001490 con 0x7f6eec134ff0 2023-08-17T17:46:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6ee3fff700 1 -- 172.21.15.78:0/3992180735 >> v1:172.21.15.150:6789/0 conn(0x7f6eec134ff0 legacy=0x7f6eec0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6ee3fff700 1 -- 172.21.15.78:0/3992180735 >> v1:172.21.15.78:6789/0 conn(0x7f6eec152b50 legacy=0x7f6eec152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.199+0000 7f6ee3fff700 1 -- 172.21.15.78:0/3992180735 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0692a0 con 0x7f6eec062c00 2023-08-17T17:46:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.200+0000 7f6ee3fff700 1 --2- 172.21.15.78:0/3992180735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 0x7f6eec1353d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6ed4009790 tx=0x7f6ed4009060).ready entity=mon.2 client_cookie=fa8bb22be891d7da server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.200+0000 7f6eeaffd700 1 -- 172.21.15.78:0/3992180735 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400f510 con 0x7f6eec062c00 2023-08-17T17:46:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.200+0000 7f6eeaffd700 1 -- 172.21.15.78:0/3992180735 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400f670 con 0x7f6eec062c00 2023-08-17T17:46:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.200+0000 7f6eeaffd700 1 -- 172.21.15.78:0/3992180735 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400f9f0 con 0x7f6eec062c00 2023-08-17T17:46:41.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.200+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3992180735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 msgr2=0x7f6eec1353d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.200+0000 7f6ef1aca700 1 --2- 172.21.15.78:0/3992180735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 0x7f6eec1353d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6ed4009790 tx=0x7f6ed4009060).stop 2023-08-17T17:46:41.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.200+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3992180735 shutdown_connections 2023-08-17T17:46:41.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.200+0000 7f6ef1aca700 1 --2- 172.21.15.78:0/3992180735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 0x7f6eec1353d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.200+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3992180735 >> 172.21.15.78:0/3992180735 conn(0x7f6eec0c7b00 msgr2=0x7f6eec0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:41.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.201+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3992180735 shutdown_connections 2023-08-17T17:46:41.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.201+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3992180735 wait complete. 2023-08-17T17:46:41.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.202+0000 7f6ef1aca700 1 Processor -- start 2023-08-17T17:46:41.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.202+0000 7f6ef1aca700 1 -- start start 2023-08-17T17:46:41.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.202+0000 7f6ef1aca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 0x7f6eec1645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.202+0000 7f6ef1aca700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec134ff0 0x7f6eec135940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.202+0000 7f6ef1aca700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eec152b50 0x7f6eec133f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.202+0000 7f6ef1aca700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec167cd0 con 0x7f6eec134ff0 2023-08-17T17:46:41.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.202+0000 7f6ef1aca700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec134b10 con 0x7f6eec152b50 2023-08-17T17:46:41.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.202+0000 7f6ef1aca700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec164be0 con 0x7f6eec062c00 2023-08-17T17:46:41.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec134ff0 0x7f6eec135940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec134ff0 0x7f6eec135940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58276/0 (socket says 172.21.15.78:58276) 2023-08-17T17:46:41.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee3fff700 1 -- 172.21.15.78:0/3238530489 learned_addr learned my addr 172.21.15.78:0/3238530489 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:41.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6eebfff700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eec152b50 0x7f6eec133f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6eeb7fe700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 0x7f6eec1645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee3fff700 1 -- 172.21.15.78:0/3238530489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 msgr2=0x7f6eec1645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee3fff700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 0x7f6eec1645d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee3fff700 1 -- 172.21.15.78:0/3238530489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eec152b50 msgr2=0x7f6eec133f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee3fff700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eec152b50 0x7f6eec133f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee3fff700 1 -- 172.21.15.78:0/3238530489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed40092a0 con 0x7f6eec134ff0 2023-08-17T17:46:41.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee3fff700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec134ff0 0x7f6eec135940 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f6ed4011000 tx=0x7f6ed4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:41.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee37fe700 1 -- 172.21.15.78:0/3238530489 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400fe80 con 0x7f6eec134ff0 2023-08-17T17:46:41.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee37fe700 1 -- 172.21.15.78:0/3238530489 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400f7e0 con 0x7f6eec134ff0 2023-08-17T17:46:41.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ee37fe700 1 -- 172.21.15.78:0/3238530489 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed401b640 con 0x7f6eec134ff0 2023-08-17T17:46:41.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3238530489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec164ec0 con 0x7f6eec134ff0 2023-08-17T17:46:41.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.203+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3238530489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec135e30 con 0x7f6eec134ff0 2023-08-17T17:46:41.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.204+0000 7f6ee37fe700 1 -- 172.21.15.78:0/3238530489 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f6ed400f070 con 0x7f6eec134ff0 2023-08-17T17:46:41.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.204+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3238530489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eec167e40 con 0x7f6eec134ff0 2023-08-17T17:46:41.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.205+0000 7f6ee37fe700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6ecc05ee20 0x7f6ecc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.205+0000 7f6eeb7fe700 1 -- 172.21.15.78:0/3238530489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6ecc05ee20 msgr2=0x7f6ecc0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:41.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.205+0000 7f6ee37fe700 1 -- 172.21.15.78:0/3238530489 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f6ed407b7b0 con 0x7f6eec134ff0 2023-08-17T17:46:41.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.205+0000 7f6eeb7fe700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6ecc05ee20 0x7f6ecc0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:41.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.209+0000 7f6ee37fe700 1 -- 172.21.15.78:0/3238530489 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6eec167e40 con 0x7f6eec134ff0 2023-08-17T17:46:41.272 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:41.271+0000 7f3a3990e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:46:41.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.383+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3238530489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6eec167e10 con 0x7f6eec134ff0 2023-08-17T17:46:41.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.384+0000 7f6ee37fe700 1 -- 172.21.15.78:0/3238530489 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18443 (secure 0 0 0) 0x7f6ed4028020 con 0x7f6eec134ff0 2023-08-17T17:46:41.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:41.385 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":47,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:46:38.196344+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:35:08.663808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T17:35:09.691655+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6833/119464":"2023-08-18T17:35:22.589074+0000","172.21.15.78:6832/119464":"2023-08-18T17:35:22.589074+0000","172.21.15.78:0/3252365413":"2023-08-18T17:35:22.589074+0000","172.21.15.78:0/3495218499":"2023-08-18T17:35:22.589074+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":2},{"begin":7,"length":2},{"begin":11,"length":1},{"begin":13,"length":2},{"begin":17,"length":2},{"begin":21,"length":1},{"begin":23,"length":2},{"begin":27,"length":2},{"begin":31,"length":1},{"begin":33,"length":2},{"begin":37,"length":2},{"begin":41,"length":1},{"begin":43,"length":2},{"begin":47,"length":2},{"begin":51,"length":1},{"begin":53,"length":2},{"begin":57,"length":2},{"begin":61,"length":1},{"begin":63,"length":2},{"begin":67,"length":2},{"begin":71,"length":1},{"begin":73,"length":2},{"begin":77,"length":2},{"begin":81,"length":1},{"begin":83,"length":2},{"begin":87,"length":2},{"begin":91,"length":1},{"begin":93,"length":2},{"begin":97,"length":2},{"begin":101,"length":1},{"begin":103,"length":2},{"begin":107,"length":1},{"begin":110,"length":2},{"begin":166,"length":55}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":8,"length":1},{"begin":18,"length":1},{"begin":28,"length":1},{"begin":38,"length":1},{"begin":48,"length":1},{"begin":58,"length":1},{"begin":68,"length":1},{"begin":78,"length":1},{"begin":88,"length":1},{"begin":98,"length":1},{"begin":103,"length":1},{"begin":210,"length":11}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:46:41.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3238530489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6ecc05ee20 msgr2=0x7f6ecc0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:41.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6ecc05ee20 0x7f6ecc0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:41.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3238530489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec134ff0 msgr2=0x7f6eec135940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec134ff0 0x7f6eec135940 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f6ed4011000 tx=0x7f6ed4017000).stop 2023-08-17T17:46:41.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3238530489 shutdown_connections 2023-08-17T17:46:41.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6ecc05ee20 0x7f6ecc0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:41.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eec152b50 0x7f6eec133f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec062c00 0x7f6eec1645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 --2- 172.21.15.78:0/3238530489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec134ff0 0x7f6eec135940 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3238530489 >> 172.21.15.78:0/3238530489 conn(0x7f6eec0c7b00 msgr2=0x7f6eec0be030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:41.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3238530489 shutdown_connections 2023-08-17T17:46:41.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.386+0000 7f6ef1aca700 1 -- 172.21.15.78:0/3238530489 wait complete. 2023-08-17T17:46:41.400 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T17:46:41.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:46:41.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.515+0000 7f40d7c5d700 1 Processor -- start 2023-08-17T17:46:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.515+0000 7f40d7c5d700 1 -- start start 2023-08-17T17:46:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.516+0000 7f40d7c5d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40d0154140 0x7f40d00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.516+0000 7f40d7c5d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f40d00a7c40 0x7f40d00c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.516+0000 7f40d7c5d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d0154520 con 0x7f40d00a80b0 2023-08-17T17:46:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.516+0000 7f40d7c5d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d00c91e0 con 0x7f40d0154140 2023-08-17T17:46:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.516+0000 7f40d7c5d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d00c94c0 con 0x7f40d00a7c40 2023-08-17T17:46:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.516+0000 7f40d59f9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40d0154140 0x7f40d00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.516+0000 7f40d61fa700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f40d00a80b0 0x7f40d00ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56060/0 (socket says 172.21.15.78:56060) 2023-08-17T17:46:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.516+0000 7f40d61fa700 1 -- 172.21.15.78:0/692858730 learned_addr learned my addr 172.21.15.78:0/692858730 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.517+0000 7f40d51f8700 1 --2- 172.21.15.78:0/692858730 >> v2:172.21.15.150:3300/0 conn(0x7f40d00a7c40 0x7f40d00c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.517+0000 7f40d59f9700 1 -- 172.21.15.78:0/692858730 >> v2:172.21.15.150:3300/0 conn(0x7f40d00a7c40 msgr2=0x7f40d00c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.517+0000 7f40d59f9700 1 --2- 172.21.15.78:0/692858730 >> v2:172.21.15.150:3300/0 conn(0x7f40d00a7c40 0x7f40d00c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.517+0000 7f40d59f9700 1 -- 172.21.15.78:0/692858730 >> v1:172.21.15.78:6789/0 conn(0x7f40d00a80b0 legacy=0x7f40d00ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.517+0000 7f40d59f9700 1 -- 172.21.15.78:0/692858730 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00c97a0 con 0x7f40d0154140 2023-08-17T17:46:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.517+0000 7f40d49f7700 1 -- 172.21.15.78:0/692858730 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812764497 0 0) 0x7f40d0154520 con 0x7f40d00a80b0 2023-08-17T17:46:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.517+0000 7f40d59f9700 1 --2- 172.21.15.78:0/692858730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d0154140 0x7f40d00c6ee0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f40d00652a0 tx=0x7f40c8009780).ready entity=mon.0 client_cookie=a94129b4452fe4d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.517+0000 7f40d49f7700 1 -- 172.21.15.78:0/692858730 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800e070 con 0x7f40d0154140 2023-08-17T17:46:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.517+0000 7f40d49f7700 1 -- 172.21.15.78:0/692858730 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800bb60 con 0x7f40d0154140 2023-08-17T17:46:41.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.517+0000 7f40d49f7700 1 -- 172.21.15.78:0/692858730 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8012410 con 0x7f40d0154140 2023-08-17T17:46:41.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.518+0000 7f40d7c5d700 1 -- 172.21.15.78:0/692858730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d0154140 msgr2=0x7f40d00c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.518+0000 7f40d7c5d700 1 --2- 172.21.15.78:0/692858730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d0154140 0x7f40d00c6ee0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f40d00652a0 tx=0x7f40c8009780).stop 2023-08-17T17:46:41.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.518+0000 7f40d7c5d700 1 -- 172.21.15.78:0/692858730 shutdown_connections 2023-08-17T17:46:41.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.518+0000 7f40d7c5d700 1 --2- 172.21.15.78:0/692858730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d0154140 0x7f40d00c6ee0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.518+0000 7f40d7c5d700 1 --2- 172.21.15.78:0/692858730 >> v2:172.21.15.150:3300/0 conn(0x7f40d00a7c40 0x7f40d00c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.518+0000 7f40d7c5d700 1 -- 172.21.15.78:0/692858730 >> 172.21.15.78:0/692858730 conn(0x7f40d0094510 msgr2=0x7f40d006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:41.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.518+0000 7f40d7c5d700 1 -- 172.21.15.78:0/692858730 shutdown_connections 2023-08-17T17:46:41.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.518+0000 7f40d7c5d700 1 -- 172.21.15.78:0/692858730 wait complete. 2023-08-17T17:46:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.519+0000 7f40d7c5d700 1 Processor -- start 2023-08-17T17:46:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.519+0000 7f40d7c5d700 1 -- start start 2023-08-17T17:46:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d7c5d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d00a7c40 0x7f40d01591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d7c5d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d00a80b0 0x7f40d00aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d7c5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d0154140 0x7f40d01527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d7c5d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00a9500 con 0x7f40d00a80b0 2023-08-17T17:46:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d7c5d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d01596c0 con 0x7f40d00a7c40 2023-08-17T17:46:41.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d7c5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00a8fb0 con 0x7f40d0154140 2023-08-17T17:46:41.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d51f8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d00a80b0 0x7f40d00aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d51f8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d00a80b0 0x7f40d00aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58298/0 (socket says 172.21.15.78:58298) 2023-08-17T17:46:41.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d51f8700 1 -- 172.21.15.78:0/347218499 learned_addr learned my addr 172.21.15.78:0/347218499 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:41.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d59f9700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d00a7c40 0x7f40d01591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d61fa700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d0154140 0x7f40d01527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d51f8700 1 -- 172.21.15.78:0/347218499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d0154140 msgr2=0x7f40d01527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d51f8700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d0154140 0x7f40d01527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d51f8700 1 -- 172.21.15.78:0/347218499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d00a7c40 msgr2=0x7f40d01591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d51f8700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d00a7c40 0x7f40d01591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d51f8700 1 -- 172.21.15.78:0/347218499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8009a20 con 0x7f40d00a80b0 2023-08-17T17:46:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.520+0000 7f40d51f8700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d00a80b0 0x7f40d00aa200 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f40c400e930 tx=0x7f40c4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.521+0000 7f40cdffb700 1 -- 172.21.15.78:0/347218499 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4012600 con 0x7f40d00a80b0 2023-08-17T17:46:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.521+0000 7f40d7c5d700 1 -- 172.21.15.78:0/347218499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d00a9220 con 0x7f40d00a80b0 2023-08-17T17:46:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.521+0000 7f40cdffb700 1 -- 172.21.15.78:0/347218499 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4012760 con 0x7f40d00a80b0 2023-08-17T17:46:41.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.521+0000 7f40cdffb700 1 -- 172.21.15.78:0/347218499 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4012ae0 con 0x7f40d00a80b0 2023-08-17T17:46:41.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.521+0000 7f40d7c5d700 1 -- 172.21.15.78:0/347218499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d00a9ba0 con 0x7f40d00a80b0 2023-08-17T17:46:41.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.522+0000 7f40d7c5d700 1 -- 172.21.15.78:0/347218499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d00aa7b0 con 0x7f40d00a80b0 2023-08-17T17:46:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.523+0000 7f40cdffb700 1 -- 172.21.15.78:0/347218499 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f40c4022070 con 0x7f40d00a80b0 2023-08-17T17:46:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.523+0000 7f40cdffb700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40bc05edf0 0x7f40bc0612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.523+0000 7f40d59f9700 1 -- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40bc05edf0 msgr2=0x7f40bc0612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.523+0000 7f40cdffb700 1 -- 172.21.15.78:0/347218499 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f40c407a130 con 0x7f40d00a80b0 2023-08-17T17:46:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.523+0000 7f40d59f9700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40bc05edf0 0x7f40bc0612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:41.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.527+0000 7f40cdffb700 1 -- 172.21.15.78:0/347218499 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f40c404b2f0 con 0x7f40d00a80b0 2023-08-17T17:46:41.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.724+0000 7f40d59f9700 1 -- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40bc05edf0 msgr2=0x7f40bc0612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:41.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.724+0000 7f40d59f9700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40bc05edf0 0x7f40bc0612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:46:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.737+0000 7f40d7c5d700 1 -- 172.21.15.78:0/347218499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40d005f6b0 con 0x7f40d00a80b0 2023-08-17T17:46:41.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.738+0000 7f40cdffb700 1 -- 172.21.15.78:0/347218499 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4483 (secure 0 0 0) 0x7f40c404e910 con 0x7f40d00a80b0 2023-08-17T17:46:41.739 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:41.739 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/175439344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":175439344},{"type":"v1","addr":"172.21.15.150:6834","nonce":175439344}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/893012651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":893012651},{"type":"v1","addr":"172.21.15.150:6835","nonce":893012651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4944,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/734042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":734042508},{"type":"v1","addr":"172.21.15.78:6836","nonce":734042508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:35:10.721386+0000","modified":"2023-08-17T17:35:13.361851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/3186726071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3186726071},{"type":"v1","addr":"172.21.15.78:6837","nonce":3186726071}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T17:46:41.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.739+0000 7f40d7c5d700 1 -- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40bc05edf0 msgr2=0x7f40bc0612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:41.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.739+0000 7f40d7c5d700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40bc05edf0 0x7f40bc0612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:41.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.739+0000 7f40d7c5d700 1 -- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d00a80b0 msgr2=0x7f40d00aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.739+0000 7f40d7c5d700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d00a80b0 0x7f40d00aa200 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f40c400e930 tx=0x7f40c4009060).stop 2023-08-17T17:46:41.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.740+0000 7f40d7c5d700 1 -- 172.21.15.78:0/347218499 shutdown_connections 2023-08-17T17:46:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.740+0000 7f40d7c5d700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40bc05edf0 0x7f40bc0612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.740+0000 7f40d7c5d700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d0154140 0x7f40d01527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.740+0000 7f40d7c5d700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d00a7c40 0x7f40d01591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.740+0000 7f40d7c5d700 1 --2- 172.21.15.78:0/347218499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d00a80b0 0x7f40d00aa200 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.740+0000 7f40d7c5d700 1 -- 172.21.15.78:0/347218499 >> 172.21.15.78:0/347218499 conn(0x7f40d0094510 msgr2=0x7f40d00c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.740+0000 7f40d7c5d700 1 -- 172.21.15.78:0/347218499 shutdown_connections 2023-08-17T17:46:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.740+0000 7f40d7c5d700 1 -- 172.21.15.78:0/347218499 wait complete. 2023-08-17T17:46:41.743 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 13 2023-08-17T17:46:41.753 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:46:41.800 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:41.799+0000 7f621a60b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:46:41.868 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:41.866+0000 7f621a60b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:46:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.872+0000 7ff8de33a700 1 Processor -- start 2023-08-17T17:46:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.872+0000 7ff8de33a700 1 -- start start 2023-08-17T17:46:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8de33a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80661a0 0x7ff8d80bc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8de33a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8d8151980 0x7ff8d8151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8de33a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d806b8e0 con 0x7ff8d80bc3c0 2023-08-17T17:46:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8de33a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d8064af0 con 0x7ff8d8151980 2023-08-17T17:46:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8de33a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d806b320 con 0x7ff8d80661a0 2023-08-17T17:46:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8d7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff8d80bc3c0 0x7ff8d80643e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56068/0 (socket says 172.21.15.78:56068) 2023-08-17T17:46:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8d7fff700 1 -- 172.21.15.78:0/1335005465 learned_addr learned my addr 172.21.15.78:0/1335005465 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8d77fe700 1 --2- 172.21.15.78:0/1335005465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80661a0 0x7ff8d80bc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8dc8d7700 1 --2- 172.21.15.78:0/1335005465 >> v2:172.21.15.150:3300/0 conn(0x7ff8d8151980 0x7ff8d8151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/1335005465 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155847781 0 0) 0x7ff8d806b8e0 con 0x7ff8d80bc3c0 2023-08-17T17:46:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/1335005465 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c00033f0 con 0x7ff8d80bc3c0 2023-08-17T17:46:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8d77fe700 1 -- 172.21.15.78:0/1335005465 >> v2:172.21.15.150:3300/0 conn(0x7ff8d8151980 msgr2=0x7ff8d8151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8d77fe700 1 --2- 172.21.15.78:0/1335005465 >> v2:172.21.15.150:3300/0 conn(0x7ff8d8151980 0x7ff8d8151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8d77fe700 1 -- 172.21.15.78:0/1335005465 >> v1:172.21.15.78:6789/0 conn(0x7ff8d80bc3c0 legacy=0x7ff8d80643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8d77fe700 1 -- 172.21.15.78:0/1335005465 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d806b600 con 0x7ff8d80661a0 2023-08-17T17:46:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8dc8d7700 1 --2- 172.21.15.78:0/1335005465 >> v2:172.21.15.150:3300/0 conn(0x7ff8d8151980 0x7ff8d8151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.873+0000 7ff8d77fe700 1 --2- 172.21.15.78:0/1335005465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80661a0 0x7ff8d80bc7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff8cc009760 tx=0x7ff8cc009060).ready entity=mon.2 client_cookie=6384b901af0aed42 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/1335005465 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00d4a0 con 0x7ff8d80661a0 2023-08-17T17:46:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/1335005465 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc00d600 con 0x7ff8d80661a0 2023-08-17T17:46:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/1335005465 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00d980 con 0x7ff8d80661a0 2023-08-17T17:46:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8de33a700 1 -- 172.21.15.78:0/1335005465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80661a0 msgr2=0x7ff8d80bc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8de33a700 1 --2- 172.21.15.78:0/1335005465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80661a0 0x7ff8d80bc7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff8cc009760 tx=0x7ff8cc009060).stop 2023-08-17T17:46:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8de33a700 1 -- 172.21.15.78:0/1335005465 shutdown_connections 2023-08-17T17:46:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8de33a700 1 --2- 172.21.15.78:0/1335005465 >> v2:172.21.15.150:3300/0 conn(0x7ff8d8151980 0x7ff8d8151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8de33a700 1 --2- 172.21.15.78:0/1335005465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80661a0 0x7ff8d80bc7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8de33a700 1 -- 172.21.15.78:0/1335005465 >> 172.21.15.78:0/1335005465 conn(0x7ff8d80c3d40 msgr2=0x7ff8d80c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8de33a700 1 -- 172.21.15.78:0/1335005465 shutdown_connections 2023-08-17T17:46:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.874+0000 7ff8de33a700 1 -- 172.21.15.78:0/1335005465 wait complete. 2023-08-17T17:46:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.875+0000 7ff8de33a700 1 Processor -- start 2023-08-17T17:46:41.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.876+0000 7ff8de33a700 1 -- start start 2023-08-17T17:46:41.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.876+0000 7ff8de33a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d80661a0 0x7ff8d80aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.876+0000 7ff8de33a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80bc3c0 0x7ff8d80abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.876+0000 7ff8de33a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d8151980 0x7ff8d80be800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.876+0000 7ff8de33a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80ab840 con 0x7ff8d8151980 2023-08-17T17:46:41.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.876+0000 7ff8de33a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80aac30 con 0x7ff8d80661a0 2023-08-17T17:46:41.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.876+0000 7ff8de33a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80aaf10 con 0x7ff8d80bc3c0 2023-08-17T17:46:41.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.876+0000 7ff8dc8d7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d8151980 0x7ff8d80be800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8dc8d7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d8151980 0x7ff8d80be800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58300/0 (socket says 172.21.15.78:58300) 2023-08-17T17:46:41.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8dc8d7700 1 -- 172.21.15.78:0/3678655080 learned_addr learned my addr 172.21.15.78:0/3678655080 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:41.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8d77fe700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80bc3c0 0x7ff8d80abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8d7fff700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d80661a0 0x7ff8d80aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:41.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8dc8d7700 1 -- 172.21.15.78:0/3678655080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80bc3c0 msgr2=0x7ff8d80abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8dc8d7700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80bc3c0 0x7ff8d80abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8dc8d7700 1 -- 172.21.15.78:0/3678655080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d80661a0 msgr2=0x7ff8d80aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:41.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8dc8d7700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d80661a0 0x7ff8d80aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:41.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8dc8d7700 1 -- 172.21.15.78:0/3678655080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0009a20 con 0x7ff8d8151980 2023-08-17T17:46:41.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8d7fff700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d80661a0 0x7ff8d80aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:41.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8d77fe700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80bc3c0 0x7ff8d80abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:41.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8dc8d7700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d8151980 0x7ff8d80be800 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7ff8d0009f20 tx=0x7ff8d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:41.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8bffff700 1 -- 172.21.15.78:0/3678655080 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000cb70 con 0x7ff8d8151980 2023-08-17T17:46:41.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8bffff700 1 -- 172.21.15.78:0/3678655080 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d000f040 con 0x7ff8d8151980 2023-08-17T17:46:41.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8bffff700 1 -- 172.21.15.78:0/3678655080 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0013400 con 0x7ff8d8151980 2023-08-17T17:46:41.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8de33a700 1 -- 172.21.15.78:0/3678655080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc0092a0 con 0x7ff8d8151980 2023-08-17T17:46:41.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.877+0000 7ff8de33a700 1 -- 172.21.15.78:0/3678655080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d80ab4d0 con 0x7ff8d8151980 2023-08-17T17:46:41.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.878+0000 7ff8de33a700 1 -- 172.21.15.78:0/3678655080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d80ab9b0 con 0x7ff8d8151980 2023-08-17T17:46:41.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.879+0000 7ff8bffff700 1 -- 172.21.15.78:0/3678655080 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff8d00137f0 con 0x7ff8d8151980 2023-08-17T17:46:41.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.879+0000 7ff8bffff700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8c405ee20 0x7ff8c40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:41.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.879+0000 7ff8d7fff700 1 -- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8c405ee20 msgr2=0x7ff8c40612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:41.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.879+0000 7ff8bffff700 1 -- 172.21.15.78:0/3678655080 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7ff8d007a930 con 0x7ff8d8151980 2023-08-17T17:46:41.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.879+0000 7ff8d7fff700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8c405ee20 0x7ff8c40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:41.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:41.883+0000 7ff8bffff700 1 -- 172.21.15.78:0/3678655080 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff8d004baf0 con 0x7ff8d8151980 2023-08-17T17:46:41.944 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:41.942+0000 7f621a60b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:46:41.947 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:41.946+0000 7f3a3990e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:46:42.017 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:42.016+0000 7f3a3990e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:46:42.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.080+0000 7ff8d7fff700 1 -- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8c405ee20 msgr2=0x7ff8c40612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:42.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.080+0000 7ff8d7fff700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8c405ee20 0x7ff8c40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:46:42.089 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:42.087+0000 7f621a60b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:46:42.093 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:42.092+0000 7f3a3990e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:46:42.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.093+0000 7ff8de33a700 1 -- 172.21.15.78:0/3678655080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8d8047350 con 0x7ff8d8151980 2023-08-17T17:46:42.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.093+0000 7ff8bffff700 1 -- 172.21.15.78:0/3678655080 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4483 (secure 0 0 0) 0x7ff8d004f110 con 0x7ff8d8151980 2023-08-17T17:46:42.095 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:42.095 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/175439344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":175439344},{"type":"v1","addr":"172.21.15.150:6834","nonce":175439344}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/893012651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":893012651},{"type":"v1","addr":"172.21.15.150:6835","nonce":893012651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4944,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/734042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":734042508},{"type":"v1","addr":"172.21.15.78:6836","nonce":734042508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:35:10.721386+0000","modified":"2023-08-17T17:35:13.361851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/3186726071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3186726071},{"type":"v1","addr":"172.21.15.78:6837","nonce":3186726071}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T17:46:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.095+0000 7ff8de33a700 1 -- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8c405ee20 msgr2=0x7ff8c40612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.095+0000 7ff8de33a700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8c405ee20 0x7ff8c40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.095+0000 7ff8de33a700 1 -- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d8151980 msgr2=0x7ff8d80be800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.095+0000 7ff8de33a700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d8151980 0x7ff8d80be800 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7ff8d0009f20 tx=0x7ff8d000b040).stop 2023-08-17T17:46:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.095+0000 7ff8de33a700 1 -- 172.21.15.78:0/3678655080 shutdown_connections 2023-08-17T17:46:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.095+0000 7ff8de33a700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff8c405ee20 0x7ff8c40612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.095+0000 7ff8de33a700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d8151980 0x7ff8d80be800 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.095+0000 7ff8de33a700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d80661a0 0x7ff8d80aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.095+0000 7ff8de33a700 1 --2- 172.21.15.78:0/3678655080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d80bc3c0 0x7ff8d80abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.096+0000 7ff8de33a700 1 -- 172.21.15.78:0/3678655080 >> 172.21.15.78:0/3678655080 conn(0x7ff8d80c3d40 msgr2=0x7ff8d80a7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.096+0000 7ff8de33a700 1 -- 172.21.15.78:0/3678655080 shutdown_connections 2023-08-17T17:46:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.096+0000 7ff8de33a700 1 -- 172.21.15.78:0/3678655080 wait complete. 2023-08-17T17:46:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 13 2023-08-17T17:46:42.109 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:46:42.158 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:42.157+0000 7f621a60b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:46:42.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.224+0000 7fb064da0700 1 Processor -- start 2023-08-17T17:46:42.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.224+0000 7fb064da0700 1 -- start start 2023-08-17T17:46:42.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.225+0000 7fb064da0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb060154140 0x7fb0600c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.225+0000 7fb064da0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb0600a7c40 0x7fb0600c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.225+0000 7fb064da0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb060154520 con 0x7fb0600a8080 2023-08-17T17:46:42.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.225+0000 7fb064da0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0600c91e0 con 0x7fb0600a7c40 2023-08-17T17:46:42.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.225+0000 7fb064da0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600c94c0 con 0x7fb060154140 2023-08-17T17:46:42.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.225+0000 7fb05dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb0600a7c40 0x7fb0600c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:42.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.225+0000 7fb05dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb0600a7c40 0x7fb0600c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58312/0 (socket says 172.21.15.78:58312) 2023-08-17T17:46:42.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.225+0000 7fb05dd9b700 1 -- 172.21.15.78:0/582759800 learned_addr learned my addr 172.21.15.78:0/582759800 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:42.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.225+0000 7fb05e59c700 1 --2- 172.21.15.78:0/582759800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb060154140 0x7fb0600c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:42.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.226+0000 7fb05dd9b700 1 -- 172.21.15.78:0/582759800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb060154140 msgr2=0x7fb0600c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:42.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.226+0000 7fb05dd9b700 1 --2- 172.21.15.78:0/582759800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb060154140 0x7fb0600c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.226+0000 7fb05dd9b700 1 -- 172.21.15.78:0/582759800 >> v1:172.21.15.150:6789/0 conn(0x7fb0600a8080 legacy=0x7fb0600ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:42.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.226+0000 7fb05dd9b700 1 -- 172.21.15.78:0/582759800 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0600c97a0 con 0x7fb0600a7c40 2023-08-17T17:46:42.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.226+0000 7fb05dd9b700 1 --2- 172.21.15.78:0/582759800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a7c40 0x7fb0600c0900 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fb054006fd0 tx=0x7fb0540090f0).ready entity=mon.0 client_cookie=8d346570210ffec2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:42.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.226+0000 7fb05d59a700 1 -- 172.21.15.78:0/582759800 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05400b580 con 0x7fb0600a7c40 2023-08-17T17:46:42.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.226+0000 7fb05d59a700 1 -- 172.21.15.78:0/582759800 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05400b6e0 con 0x7fb0600a7c40 2023-08-17T17:46:42.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.226+0000 7fb05d59a700 1 -- 172.21.15.78:0/582759800 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05400ba60 con 0x7fb0600a7c40 2023-08-17T17:46:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.226+0000 7fb064da0700 1 -- 172.21.15.78:0/582759800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a7c40 msgr2=0x7fb0600c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.226+0000 7fb064da0700 1 --2- 172.21.15.78:0/582759800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a7c40 0x7fb0600c0900 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fb054006fd0 tx=0x7fb0540090f0).stop 2023-08-17T17:46:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.227+0000 7fb064da0700 1 -- 172.21.15.78:0/582759800 shutdown_connections 2023-08-17T17:46:42.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.227+0000 7fb064da0700 1 --2- 172.21.15.78:0/582759800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb060154140 0x7fb0600c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.227+0000 7fb064da0700 1 --2- 172.21.15.78:0/582759800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a7c40 0x7fb0600c0900 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.227+0000 7fb064da0700 1 -- 172.21.15.78:0/582759800 >> 172.21.15.78:0/582759800 conn(0x7fb060094510 msgr2=0x7fb06006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:42.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.227+0000 7fb064da0700 1 -- 172.21.15.78:0/582759800 shutdown_connections 2023-08-17T17:46:42.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.227+0000 7fb064da0700 1 -- 172.21.15.78:0/582759800 wait complete. 2023-08-17T17:46:42.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.228+0000 7fb064da0700 1 Processor -- start 2023-08-17T17:46:42.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.228+0000 7fb064da0700 1 -- start start 2023-08-17T17:46:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.228+0000 7fb064da0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0600a7c40 0x7fb06014ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.228+0000 7fb064da0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a8080 0x7fb0600ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.228+0000 7fb064da0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb060154140 0x7fb0601506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.228+0000 7fb064da0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600ab720 con 0x7fb0600a8080 2023-08-17T17:46:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.228+0000 7fb064da0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600aab10 con 0x7fb0600a7c40 2023-08-17T17:46:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.228+0000 7fb064da0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600aadf0 con 0x7fb060154140 2023-08-17T17:46:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a8080 0x7fb0600ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a8080 0x7fb0600ac500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58314/0 (socket says 172.21.15.78:58314) 2023-08-17T17:46:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05dd9b700 1 -- 172.21.15.78:0/3554802229 learned_addr learned my addr 172.21.15.78:0/3554802229 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05e59c700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0600a7c40 0x7fb06014ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05ed9d700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb060154140 0x7fb0601506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05dd9b700 1 -- 172.21.15.78:0/3554802229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb060154140 msgr2=0x7fb0601506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05dd9b700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb060154140 0x7fb0601506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05dd9b700 1 -- 172.21.15.78:0/3554802229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0600a7c40 msgr2=0x7fb06014ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05dd9b700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0600a7c40 0x7fb06014ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05dd9b700 1 -- 172.21.15.78:0/3554802229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb054009370 con 0x7fb0600a8080 2023-08-17T17:46:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb05dd9b700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a8080 0x7fb0600ac500 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fb054009130 tx=0x7fb054017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb04e7fc700 1 -- 172.21.15.78:0/3554802229 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb054000bc0 con 0x7fb0600a8080 2023-08-17T17:46:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb04e7fc700 1 -- 172.21.15.78:0/3554802229 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05400b850 con 0x7fb0600a8080 2023-08-17T17:46:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb064da0700 1 -- 172.21.15.78:0/3554802229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0600ab0d0 con 0x7fb0600a8080 2023-08-17T17:46:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb04e7fc700 1 -- 172.21.15.78:0/3554802229 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb054000d20 con 0x7fb0600a8080 2023-08-17T17:46:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.229+0000 7fb064da0700 1 -- 172.21.15.78:0/3554802229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06014ef40 con 0x7fb0600a8080 2023-08-17T17:46:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.230+0000 7fb064da0700 1 -- 172.21.15.78:0/3554802229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0600ab890 con 0x7fb0600a8080 2023-08-17T17:46:42.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.230+0000 7fb04e7fc700 1 -- 172.21.15.78:0/3554802229 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fb05402c070 con 0x7fb0600a8080 2023-08-17T17:46:42.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.231+0000 7fb04e7fc700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb04005ee20 0x7fb0400612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.231+0000 7fb05e59c700 1 -- 172.21.15.78:0/3554802229 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb04005ee20 msgr2=0x7fb0400612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:42.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.231+0000 7fb04e7fc700 1 -- 172.21.15.78:0/3554802229 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fb05407bb60 con 0x7fb0600a8080 2023-08-17T17:46:42.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.231+0000 7fb05e59c700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb04005ee20 0x7fb0400612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:42.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.235+0000 7fb04e7fc700 1 -- 172.21.15.78:0/3554802229 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb05404cd20 con 0x7fb0600a8080 2023-08-17T17:46:42.249 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:42.248+0000 7f3a3990e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:46:42.273 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:42.272+0000 7f621a60b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:46:42.320 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:42.319+0000 7f3a3990e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:46:42.379 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:42.378+0000 7f621a60b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:46:42.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.402+0000 7fb064da0700 1 -- 172.21.15.78:0/3554802229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb060047350 con 0x7fb0600a8080 2023-08-17T17:46:42.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.403+0000 7fb04e7fc700 1 -- 172.21.15.78:0/3554802229 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18443 (secure 0 0 0) 0x7fb05402a020 con 0x7fb0600a8080 2023-08-17T17:46:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:42.405 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":47,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:46:38.196344+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:35:08.663808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T17:35:09.691655+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6833/119464":"2023-08-18T17:35:22.589074+0000","172.21.15.78:6832/119464":"2023-08-18T17:35:22.589074+0000","172.21.15.78:0/3252365413":"2023-08-18T17:35:22.589074+0000","172.21.15.78:0/3495218499":"2023-08-18T17:35:22.589074+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":2},{"begin":7,"length":2},{"begin":11,"length":1},{"begin":13,"length":2},{"begin":17,"length":2},{"begin":21,"length":1},{"begin":23,"length":2},{"begin":27,"length":2},{"begin":31,"length":1},{"begin":33,"length":2},{"begin":37,"length":2},{"begin":41,"length":1},{"begin":43,"length":2},{"begin":47,"length":2},{"begin":51,"length":1},{"begin":53,"length":2},{"begin":57,"length":2},{"begin":61,"length":1},{"begin":63,"length":2},{"begin":67,"length":2},{"begin":71,"length":1},{"begin":73,"length":2},{"begin":77,"length":2},{"begin":81,"length":1},{"begin":83,"length":2},{"begin":87,"length":2},{"begin":91,"length":1},{"begin":93,"length":2},{"begin":97,"length":2},{"begin":101,"length":1},{"begin":103,"length":2},{"begin":107,"length":1},{"begin":110,"length":2},{"begin":166,"length":55}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":8,"length":1},{"begin":18,"length":1},{"begin":28,"length":1},{"begin":38,"length":1},{"begin":48,"length":1},{"begin":58,"length":1},{"begin":68,"length":1},{"begin":78,"length":1},{"begin":88,"length":1},{"begin":98,"length":1},{"begin":103,"length":1},{"begin":210,"length":11}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:46:42.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 -- 172.21.15.78:0/3554802229 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb04005ee20 msgr2=0x7fb0400612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:42.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb04005ee20 0x7fb0400612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:42.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 -- 172.21.15.78:0/3554802229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a8080 msgr2=0x7fb0600ac500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:42.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a8080 0x7fb0600ac500 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fb054009130 tx=0x7fb054017000).stop 2023-08-17T17:46:42.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 -- 172.21.15.78:0/3554802229 shutdown_connections 2023-08-17T17:46:42.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb04005ee20 0x7fb0400612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:42.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb060154140 0x7fb0601506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0600a7c40 0x7fb06014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 --2- 172.21.15.78:0/3554802229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0600a8080 0x7fb0600ac500 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 -- 172.21.15.78:0/3554802229 >> 172.21.15.78:0/3554802229 conn(0x7fb060094510 msgr2=0x7fb0601530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:42.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 -- 172.21.15.78:0/3554802229 shutdown_connections 2023-08-17T17:46:42.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.405+0000 7fb064da0700 1 -- 172.21.15.78:0/3554802229 wait complete. 2023-08-17T17:46:42.419 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T17:46:42.439 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:42.438+0000 7f3a3990e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:46:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.535+0000 7f790aeff700 1 Processor -- start 2023-08-17T17:46:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.535+0000 7f790aeff700 1 -- start start 2023-08-17T17:46:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f790aeff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904153f80 0x7f79040a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f790aeff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f79040cb890 0x7f79040c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f790aeff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79040c9ca0 con 0x7f7904154360 2023-08-17T17:46:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f790aeff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79040c96b0 con 0x7f79040cb890 2023-08-17T17:46:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f790aeff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79040c0080 con 0x7f7904153f80 2023-08-17T17:46:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f79096fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f79040cb890 0x7f79040c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f790a6fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7904154360 0x7f79040ca130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56084/0 (socket says 172.21.15.78:56084) 2023-08-17T17:46:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f790a6fe700 1 -- 172.21.15.78:0/1328534286 learned_addr learned my addr 172.21.15.78:0/1328534286 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:42.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f7909efd700 1 --2- 172.21.15.78:0/1328534286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904153f80 0x7f79040a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:42.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f79096fc700 1 -- 172.21.15.78:0/1328534286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904153f80 msgr2=0x7f79040a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:42.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f79096fc700 1 --2- 172.21.15.78:0/1328534286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904153f80 0x7f79040a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f79096fc700 1 -- 172.21.15.78:0/1328534286 >> v1:172.21.15.78:6789/0 conn(0x7f7904154360 legacy=0x7f79040ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:42.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f7908efb700 1 -- 172.21.15.78:0/1328534286 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695307089 0 0) 0x7f79040c9ca0 con 0x7f7904154360 2023-08-17T17:46:42.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f79096fc700 1 -- 172.21.15.78:0/1328534286 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040c0360 con 0x7f79040cb890 2023-08-17T17:46:42.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f79096fc700 1 --2- 172.21.15.78:0/1328534286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79040cb890 0x7f79040c0720 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f78f4009760 tx=0x7f78f4009060).ready entity=mon.0 client_cookie=849e1a98bd520d28 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:42.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f7908efb700 1 -- 172.21.15.78:0/1328534286 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400b580 con 0x7f79040cb890 2023-08-17T17:46:42.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f7908efb700 1 -- 172.21.15.78:0/1328534286 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f400b6e0 con 0x7f79040cb890 2023-08-17T17:46:42.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.536+0000 7f7908efb700 1 -- 172.21.15.78:0/1328534286 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400ba60 con 0x7f79040cb890 2023-08-17T17:46:42.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.537+0000 7f790aeff700 1 -- 172.21.15.78:0/1328534286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79040cb890 msgr2=0x7f79040c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:42.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.537+0000 7f790aeff700 1 --2- 172.21.15.78:0/1328534286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79040cb890 0x7f79040c0720 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f78f4009760 tx=0x7f78f4009060).stop 2023-08-17T17:46:42.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.537+0000 7f790aeff700 1 -- 172.21.15.78:0/1328534286 shutdown_connections 2023-08-17T17:46:42.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.537+0000 7f790aeff700 1 --2- 172.21.15.78:0/1328534286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904153f80 0x7f79040a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.537+0000 7f790aeff700 1 --2- 172.21.15.78:0/1328534286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79040cb890 0x7f79040c0720 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.537+0000 7f790aeff700 1 -- 172.21.15.78:0/1328534286 >> 172.21.15.78:0/1328534286 conn(0x7f790406a400 msgr2=0x7f79040cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.537+0000 7f790aeff700 1 -- 172.21.15.78:0/1328534286 shutdown_connections 2023-08-17T17:46:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.537+0000 7f790aeff700 1 -- 172.21.15.78:0/1328534286 wait complete. 2023-08-17T17:46:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.538+0000 7f790aeff700 1 Processor -- start 2023-08-17T17:46:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.538+0000 7f790aeff700 1 -- start start 2023-08-17T17:46:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f790aeff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79040cb890 0x7f79040b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f790aeff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7904153f80 0x7f7904155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f790aeff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904154360 0x7f790414f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f790aeff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7904156260 con 0x7f7904153f80 2023-08-17T17:46:42.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f790aeff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7904155740 con 0x7f79040cb890 2023-08-17T17:46:42.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f790aeff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79040c28f0 con 0x7f7904154360 2023-08-17T17:46:42.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f79096fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7904153f80 0x7f7904155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:42.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f79096fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7904153f80 0x7f7904155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58328/0 (socket says 172.21.15.78:58328) 2023-08-17T17:46:42.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f79096fc700 1 -- 172.21.15.78:0/2778917398 learned_addr learned my addr 172.21.15.78:0/2778917398 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f790a6fe700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904154360 0x7f790414f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f7909efd700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79040cb890 0x7f79040b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f79096fc700 1 -- 172.21.15.78:0/2778917398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904154360 msgr2=0x7f790414f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f79096fc700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904154360 0x7f790414f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f79096fc700 1 -- 172.21.15.78:0/2778917398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79040cb890 msgr2=0x7f79040b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f79096fc700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79040cb890 0x7f79040b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f79096fc700 1 -- 172.21.15.78:0/2778917398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f40092a0 con 0x7f7904153f80 2023-08-17T17:46:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f790a6fe700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904154360 0x7f790414f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.539+0000 7f7909efd700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79040cb890 0x7f79040b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.540+0000 7f79096fc700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7904153f80 0x7f7904155250 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f78f4011000 tx=0x7f78f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.540+0000 7f78f9ffb700 1 -- 172.21.15.78:0/2778917398 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400b850 con 0x7f7904153f80 2023-08-17T17:46:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.540+0000 7f78f9ffb700 1 -- 172.21.15.78:0/2778917398 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f400b9b0 con 0x7f7904153f80 2023-08-17T17:46:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.540+0000 7f790aeff700 1 -- 172.21.15.78:0/2778917398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79041559c0 con 0x7f7904153f80 2023-08-17T17:46:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.540+0000 7f78f9ffb700 1 -- 172.21.15.78:0/2778917398 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f401b660 con 0x7f7904153f80 2023-08-17T17:46:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.540+0000 7f790aeff700 1 -- 172.21.15.78:0/2778917398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7904156000 con 0x7f7904153f80 2023-08-17T17:46:42.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.541+0000 7f790aeff700 1 -- 172.21.15.78:0/2778917398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7904065230 con 0x7f7904153f80 2023-08-17T17:46:42.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.541+0000 7f78f9ffb700 1 -- 172.21.15.78:0/2778917398 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f78f402b070 con 0x7f7904153f80 2023-08-17T17:46:42.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.542+0000 7f78f9ffb700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ee20 0x7f78e80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.542+0000 7f7909efd700 1 -- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ee20 msgr2=0x7f78e80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.542+0000 7f78f9ffb700 1 -- 172.21.15.78:0/2778917398 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f78f407b8c0 con 0x7f7904153f80 2023-08-17T17:46:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.542+0000 7f7909efd700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ee20 0x7f78e80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:46:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.546+0000 7f78f9ffb700 1 -- 172.21.15.78:0/2778917398 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78f404ca80 con 0x7f7904153f80 2023-08-17T17:46:42.553 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:42.552+0000 7f3a3990e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:46:42.671 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:42.669+0000 7f621a60b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:46:42.740 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:46:42.739+0000 7f621a60b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:46:42.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.743+0000 7f7909efd700 1 -- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ee20 msgr2=0x7f78e80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:46:42.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.743+0000 7f7909efd700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ee20 0x7f78e80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:46:42.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.761+0000 7f790aeff700 1 -- 172.21.15.78:0/2778917398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f79040c9930 con 0x7f7904153f80 2023-08-17T17:46:42.849 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:42.848+0000 7f3a3990e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:46:42.919 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:42.918+0000 7f3a3990e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:46:42.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.940+0000 7f78f9ffb700 1 -- 172.21.15.78:0/2778917398 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 12) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f78f4021030 con 0x7f7904153f80 2023-08-17T17:46:42.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.940+0000 7f78f9ffb700 1 -- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ee20 msgr2=0x7f78e80612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:46:42.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:42.940+0000 7f78f9ffb700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ee20 0x7f78e80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:42.945 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:46:42.944+0000 7fecb73be700 -1 mds.0.journaler.mdlog(rw) _finish_write_head got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:46:42.945 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:46:42.944+0000 7fecb73be700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:46:42.946 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:46:42.944+0000 7fecb73be700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:46:42.960 INFO:tasks.ceph.mds.c.smithi078.stderr: -4> 2023-08-17T17:46:42.944+0000 7fecb73be700 -1 mds.0.journaler.mdlog(rw) _finish_write_head got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:46:42.961 INFO:tasks.ceph.mds.c.smithi078.stderr: -3> 2023-08-17T17:46:42.944+0000 7fecb73be700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:46:42.961 INFO:tasks.ceph.mds.c.smithi078.stderr: -1> 2023-08-17T17:46:42.944+0000 7fecb73be700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:46:42.981 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:46:43.007 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:43.006+0000 7f39b98ef700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:46:43.008 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:43.006+0000 7f39b98ef700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:46:43.008 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:43.006+0000 7f39b98ef700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:46:43.008 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:43.006+0000 7f39b98ef700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:46:43.008 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:43.006+0000 7f39b98ef700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:46:43.008 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:43.006+0000 7f39bc8f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:46:43.008 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:43.006+0000 7f39bc8f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:46:43.009 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:43.006+0000 7f39bc8f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:46:43.009 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:43.006+0000 7f39bc8f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:46:43.009 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:46:43.006+0000 7f39bc8f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:46:43.522 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T17:46:43.521+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T17:46:43.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.529+0000 7f78f9ffb700 1 -- 172.21.15.78:0/2778917398 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f78f40554e0 con 0x7f7904153f80 2023-08-17T17:46:43.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.531+0000 7f790aeff700 1 -- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7904153f80 msgr2=0x7f7904155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:43.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.531+0000 7f790aeff700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7904153f80 0x7f7904155250 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f78f4011000 tx=0x7f78f4017000).stop 2023-08-17T17:46:43.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.531+0000 7f790aeff700 1 -- 172.21.15.78:0/2778917398 shutdown_connections 2023-08-17T17:46:43.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.531+0000 7f790aeff700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ee20 0x7f78e80612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:43.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.531+0000 7f790aeff700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7904154360 0x7f790414f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:43.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.531+0000 7f790aeff700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79040cb890 0x7f79040b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:43.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.531+0000 7f790aeff700 1 --2- 172.21.15.78:0/2778917398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7904153f80 0x7f7904155250 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:43.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.531+0000 7f790aeff700 1 -- 172.21.15.78:0/2778917398 >> 172.21.15.78:0/2778917398 conn(0x7f790406a400 msgr2=0x7f7904152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:43.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.532+0000 7f790aeff700 1 -- 172.21.15.78:0/2778917398 shutdown_connections 2023-08-17T17:46:43.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.532+0000 7f790aeff700 1 -- 172.21.15.78:0/2778917398 wait complete. 2023-08-17T17:46:43.534 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T17:46:43.545 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T17:46:43.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.700+0000 7fd44917e700 1 Processor -- start 2023-08-17T17:46:43.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.700+0000 7fd44917e700 1 -- start start 2023-08-17T17:46:43.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.701+0000 7fd44917e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4441578f0 0x7fd4440be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:43.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.701+0000 7fd44917e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4440bf0e0 0x7fd444095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.701+0000 7fd44917e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd444096300 0x7fd444064330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.701+0000 7fd44917e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4440bf5c0 con 0x7fd4441578f0 2023-08-17T17:46:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.701+0000 7fd44917e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4440c32d0 con 0x7fd444096300 2023-08-17T17:46:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.701+0000 7fd44917e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440967b0 con 0x7fd4440bf0e0 2023-08-17T17:46:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.701+0000 7fd442d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4441578f0 0x7fd4440be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.701+0000 7fd442d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4441578f0 0x7fd4440be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58438/0 (socket says 172.21.15.78:58438) 2023-08-17T17:46:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.701+0000 7fd442d9d700 1 -- 172.21.15.78:0/376618091 learned_addr learned my addr 172.21.15.78:0/376618091 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:43.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd44359e700 1 --2- 172.21.15.78:0/376618091 >> v2:172.21.15.150:3300/0 conn(0x7fd444096300 0x7fd444064330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:43.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd43bfff700 1 --2- 172.21.15.78:0/376618091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4440bf0e0 0x7fd444095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:43.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd442d9d700 1 -- 172.21.15.78:0/376618091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4440bf0e0 msgr2=0x7fd444095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:43.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd442d9d700 1 --2- 172.21.15.78:0/376618091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4440bf0e0 0x7fd444095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:43.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd442d9d700 1 -- 172.21.15.78:0/376618091 >> v2:172.21.15.150:3300/0 conn(0x7fd444096300 msgr2=0x7fd444064330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:43.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd442d9d700 1 --2- 172.21.15.78:0/376618091 >> v2:172.21.15.150:3300/0 conn(0x7fd444096300 0x7fd444064330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:43.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd442d9d700 1 -- 172.21.15.78:0/376618091 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4440c3e10 con 0x7fd4441578f0 2023-08-17T17:46:43.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd442d9d700 1 --2- 172.21.15.78:0/376618091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4441578f0 0x7fd4440be210 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd4440659e0 tx=0x7fd4340090f0).ready entity=mon.0 client_cookie=d7aa511efec1bdab server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:43.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd44259c700 1 -- 172.21.15.78:0/376618091 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400f510 con 0x7fd4441578f0 2023-08-17T17:46:43.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd44259c700 1 -- 172.21.15.78:0/376618091 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400f670 con 0x7fd4441578f0 2023-08-17T17:46:43.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.702+0000 7fd44259c700 1 -- 172.21.15.78:0/376618091 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400fa10 con 0x7fd4441578f0 2023-08-17T17:46:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.703+0000 7fd44917e700 1 -- 172.21.15.78:0/376618091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4441578f0 msgr2=0x7fd4440be210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.703+0000 7fd44917e700 1 --2- 172.21.15.78:0/376618091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4441578f0 0x7fd4440be210 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd4440659e0 tx=0x7fd4340090f0).stop 2023-08-17T17:46:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.703+0000 7fd44917e700 1 -- 172.21.15.78:0/376618091 shutdown_connections 2023-08-17T17:46:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.703+0000 7fd44917e700 1 --2- 172.21.15.78:0/376618091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4441578f0 0x7fd4440be210 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.703+0000 7fd44917e700 1 --2- 172.21.15.78:0/376618091 >> v2:172.21.15.150:3300/0 conn(0x7fd444096300 0x7fd444064330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.703+0000 7fd44917e700 1 --2- 172.21.15.78:0/376618091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4440bf0e0 0x7fd444095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.703+0000 7fd44917e700 1 -- 172.21.15.78:0/376618091 >> 172.21.15.78:0/376618091 conn(0x7fd444062f80 msgr2=0x7fd4440c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.703+0000 7fd44917e700 1 -- 172.21.15.78:0/376618091 shutdown_connections 2023-08-17T17:46:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.703+0000 7fd44917e700 1 -- 172.21.15.78:0/376618091 wait complete. 2023-08-17T17:46:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.704+0000 7fd44917e700 1 Processor -- start 2023-08-17T17:46:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.704+0000 7fd44917e700 1 -- start start 2023-08-17T17:46:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.704+0000 7fd44917e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd444096300 0x7fd4440aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.704+0000 7fd44917e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4440bf0e0 0x7fd444156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.704+0000 7fd44917e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4441578f0 0x7fd44415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.704+0000 7fd44917e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440a9de0 con 0x7fd4440bf0e0 2023-08-17T17:46:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.704+0000 7fd44917e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd444159120 con 0x7fd444096300 2023-08-17T17:46:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd44917e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441588c0 con 0x7fd4441578f0 2023-08-17T17:46:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4440bf0e0 0x7fd444156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4440bf0e0 0x7fd444156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58444/0 (socket says 172.21.15.78:58444) 2023-08-17T17:46:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43bfff700 1 -- 172.21.15.78:0/368645967 learned_addr learned my addr 172.21.15.78:0/368645967 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd442d9d700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd444096300 0x7fd4440aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd44359e700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4441578f0 0x7fd44415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43bfff700 1 -- 172.21.15.78:0/368645967 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4441578f0 msgr2=0x7fd44415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43bfff700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4441578f0 0x7fd44415a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:43.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43bfff700 1 -- 172.21.15.78:0/368645967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd444096300 msgr2=0x7fd4440aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:43.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43bfff700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd444096300 0x7fd4440aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:43.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43bfff700 1 -- 172.21.15.78:0/368645967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434009370 con 0x7fd4440bf0e0 2023-08-17T17:46:43.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd442d9d700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd444096300 0x7fd4440aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:43.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43bfff700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4440bf0e0 0x7fd444156860 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd42c00e980 tx=0x7fd42c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:43.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43affd700 1 -- 172.21.15.78:0/368645967 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c00c850 con 0x7fd4440bf0e0 2023-08-17T17:46:43.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43affd700 1 -- 172.21.15.78:0/368645967 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c00c9b0 con 0x7fd4440bf0e0 2023-08-17T17:46:43.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd43affd700 1 -- 172.21.15.78:0/368645967 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c00cd30 con 0x7fd4440bf0e0 2023-08-17T17:46:43.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd44917e700 1 -- 172.21.15.78:0/368645967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4440bfd70 con 0x7fd4440bf0e0 2023-08-17T17:46:43.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.705+0000 7fd44917e700 1 -- 172.21.15.78:0/368645967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd444158e40 con 0x7fd4440bf0e0 2023-08-17T17:46:43.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.706+0000 7fd44917e700 1 -- 172.21.15.78:0/368645967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4440a9f90 con 0x7fd4440bf0e0 2023-08-17T17:46:43.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.706+0000 7fd43affd700 1 -- 172.21.15.78:0/368645967 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 12) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fd42c022070 con 0x7fd4440bf0e0 2023-08-17T17:46:43.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.707+0000 7fd43affd700 1 -- 172.21.15.78:0/368645967 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7180+0+0 (secure 0 0 0) 0x7fd42c07a2f0 con 0x7fd4440bf0e0 2023-08-17T17:46:43.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.711+0000 7fd43affd700 1 -- 172.21.15.78:0/368645967 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4440a9f90 con 0x7fd4440bf0e0 2023-08-17T17:46:43.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.916+0000 7fd44917e700 1 -- 172.21.15.78:0/368645967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd4440a9f90 con 0x7fd4440bf0e0 2023-08-17T17:46:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.939+0000 7fd43affd700 1 -- 172.21.15.78:0/368645967 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 13) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fd42c077e70 con 0x7fd4440bf0e0 2023-08-17T17:46:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.939+0000 7fd43affd700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4240301b0 0x7fd424067d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.940+0000 7fd442d9d700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4240301b0 0x7fd424067d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:43.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:43.941+0000 7fd442d9d700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4240301b0 0x7fd424067d20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fd4440659e0 tx=0x7fd434017000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.530+0000 7fd43affd700 1 -- 172.21.15.78:0/368645967 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd42c06d5e0 con 0x7fd4440bf0e0 2023-08-17T17:46:44.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 -- 172.21.15.78:0/368645967 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4240301b0 msgr2=0x7fd424067d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:44.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4240301b0 0x7fd424067d20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fd4440659e0 tx=0x7fd434017000).stop 2023-08-17T17:46:44.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 -- 172.21.15.78:0/368645967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4440bf0e0 msgr2=0x7fd444156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:44.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4440bf0e0 0x7fd444156860 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd42c00e980 tx=0x7fd42c009060).stop 2023-08-17T17:46:44.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 -- 172.21.15.78:0/368645967 shutdown_connections 2023-08-17T17:46:44.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4240301b0 0x7fd424067d20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:44.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4441578f0 0x7fd44415a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:44.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd444096300 0x7fd4440aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:44.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 --2- 172.21.15.78:0/368645967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4440bf0e0 0x7fd444156860 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:44.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 -- 172.21.15.78:0/368645967 >> 172.21.15.78:0/368645967 conn(0x7fd444062f80 msgr2=0x7fd4440c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:44.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 -- 172.21.15.78:0/368645967 shutdown_connections 2023-08-17T17:46:44.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.532+0000 7fd44917e700 1 -- 172.21.15.78:0/368645967 wait complete. 2023-08-17T17:46:44.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T17:46:44.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.661+0000 7f09ed8dc700 1 Processor -- start 2023-08-17T17:46:44.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.661+0000 7f09ed8dc700 1 -- start start 2023-08-17T17:46:44.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.662+0000 7f09ed8dc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09e8154440 0x7f09e80a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:44.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.662+0000 7f09ed8dc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f09e80bfea0 0x7f09e80c0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:44.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.662+0000 7f09ed8dc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e80c9d80 con 0x7f09e80ca210 2023-08-17T17:46:44.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.662+0000 7f09ed8dc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e80c07f0 con 0x7f09e8154440 2023-08-17T17:46:44.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.662+0000 7f09ed8dc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e80c9170 con 0x7f09e80bfea0 2023-08-17T17:46:44.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.662+0000 7f09e6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09e8154440 0x7f09e80a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:44.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.662+0000 7f09e6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09e8154440 0x7f09e80a7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58454/0 (socket says 172.21.15.78:58454) 2023-08-17T17:46:44.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.662+0000 7f09e6ffd700 1 -- 172.21.15.78:0/2555968648 learned_addr learned my addr 172.21.15.78:0/2555968648 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:44.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.663+0000 7f09e6ffd700 1 -- 172.21.15.78:0/2555968648 >> v2:172.21.15.150:3300/0 conn(0x7f09e80bfea0 msgr2=0x7f09e80c0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:44.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.663+0000 7f09e6ffd700 1 --2- 172.21.15.78:0/2555968648 >> v2:172.21.15.150:3300/0 conn(0x7f09e80bfea0 0x7f09e80c0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:44.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.663+0000 7f09e6ffd700 1 -- 172.21.15.78:0/2555968648 >> v1:172.21.15.150:6789/0 conn(0x7f09e80ca210 legacy=0x7f09e80ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:44.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.663+0000 7f09e6ffd700 1 -- 172.21.15.78:0/2555968648 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e80c9450 con 0x7f09e8154440 2023-08-17T17:46:44.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.663+0000 7f09e6ffd700 1 --2- 172.21.15.78:0/2555968648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 0x7f09e80a7d70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f09e80cc050 tx=0x7f09d80090f0).ready entity=mon.0 client_cookie=878ec584be5a3c64 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:44.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.663+0000 7f09e5ffb700 1 -- 172.21.15.78:0/2555968648 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d800b5a0 con 0x7f09e8154440 2023-08-17T17:46:44.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.663+0000 7f09e5ffb700 1 -- 172.21.15.78:0/2555968648 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d800b700 con 0x7f09e8154440 2023-08-17T17:46:44.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.663+0000 7f09e5ffb700 1 -- 172.21.15.78:0/2555968648 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d800ba80 con 0x7f09e8154440 2023-08-17T17:46:44.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.663+0000 7f09ed8dc700 1 -- 172.21.15.78:0/2555968648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 msgr2=0x7f09e80a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:44.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.663+0000 7f09ed8dc700 1 --2- 172.21.15.78:0/2555968648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 0x7f09e80a7d70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f09e80cc050 tx=0x7f09d80090f0).stop 2023-08-17T17:46:44.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.664+0000 7f09ed8dc700 1 -- 172.21.15.78:0/2555968648 shutdown_connections 2023-08-17T17:46:44.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.664+0000 7f09ed8dc700 1 --2- 172.21.15.78:0/2555968648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 0x7f09e80a7d70 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:44.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.664+0000 7f09ed8dc700 1 --2- 172.21.15.78:0/2555968648 >> v2:172.21.15.150:3300/0 conn(0x7f09e80bfea0 0x7f09e80c0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:44.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.664+0000 7f09ed8dc700 1 -- 172.21.15.78:0/2555968648 >> 172.21.15.78:0/2555968648 conn(0x7f09e806a400 msgr2=0x7f09e80caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:44.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.664+0000 7f09ed8dc700 1 -- 172.21.15.78:0/2555968648 shutdown_connections 2023-08-17T17:46:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.664+0000 7f09ed8dc700 1 -- 172.21.15.78:0/2555968648 wait complete. 2023-08-17T17:46:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.665+0000 7f09ed8dc700 1 Processor -- start 2023-08-17T17:46:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.665+0000 7f09ed8dc700 1 -- start start 2023-08-17T17:46:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ed8dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09e80bfea0 0x7f09e80c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ed8dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09e80ca210 0x7f09e8143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ed8dc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 0x7f09e80c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ed8dc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80af040 con 0x7f09e8154440 2023-08-17T17:46:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ed8dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80c27f0 con 0x7f09e80ca210 2023-08-17T17:46:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ed8dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80c2510 con 0x7f09e80bfea0 2023-08-17T17:46:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 0x7f09e80c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 0x7f09e80c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58468/0 (socket says 172.21.15.78:58468) 2023-08-17T17:46:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e77fe700 1 -- 172.21.15.78:0/1032477768 learned_addr learned my addr 172.21.15.78:0/1032477768 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e67fc700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09e80ca210 0x7f09e8143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e77fe700 1 -- 172.21.15.78:0/1032477768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09e80bfea0 msgr2=0x7f09e80c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e77fe700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09e80bfea0 0x7f09e80c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e77fe700 1 -- 172.21.15.78:0/1032477768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09e80ca210 msgr2=0x7f09e8143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e77fe700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09e80ca210 0x7f09e8143760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e77fe700 1 -- 172.21.15.78:0/1032477768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8009370 con 0x7f09e8154440 2023-08-17T17:46:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e67fc700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09e80ca210 0x7f09e8143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09e77fe700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 0x7f09e80c3c50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f09e000b7e0 tx=0x7f09e0009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ceffd700 1 -- 172.21.15.78:0/1032477768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000d620 con 0x7f09e8154440 2023-08-17T17:46:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ceffd700 1 -- 172.21.15.78:0/1032477768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e000d7c0 con 0x7f09e8154440 2023-08-17T17:46:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ed8dc700 1 -- 172.21.15.78:0/1032477768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e80ae9f0 con 0x7f09e8154440 2023-08-17T17:46:44.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ceffd700 1 -- 172.21.15.78:0/1032477768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000db80 con 0x7f09e8154440 2023-08-17T17:46:44.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.666+0000 7f09ed8dc700 1 -- 172.21.15.78:0/1032477768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e80c4e60 con 0x7f09e8154440 2023-08-17T17:46:44.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.667+0000 7f09ed8dc700 1 -- 172.21.15.78:0/1032477768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e80ae850 con 0x7f09e8154440 2023-08-17T17:46:44.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.668+0000 7f09ceffd700 1 -- 172.21.15.78:0/1032477768 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f09e000f480 con 0x7f09e8154440 2023-08-17T17:46:44.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.668+0000 7f09ceffd700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09d405ecf0 0x7f09d40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:44.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.668+0000 7f09ceffd700 1 -- 172.21.15.78:0/1032477768 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7180+0+0 (secure 0 0 0) 0x7f09e007a1c0 con 0x7f09e8154440 2023-08-17T17:46:44.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.668+0000 7f09e6ffd700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09d405ecf0 0x7f09d40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:44.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.668+0000 7f09e6ffd700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09d405ecf0 0x7f09d40611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f09d8006df0 tx=0x7f09d8015000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:44.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.672+0000 7f09ceffd700 1 -- 172.21.15.78:0/1032477768 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09e80ae850 con 0x7f09e8154440 2023-08-17T17:46:44.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:44.833+0000 7f09ed8dc700 1 -- 172.21.15.78:0/1032477768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f09e80ae850 con 0x7f09e8154440 2023-08-17T17:46:45.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.531+0000 7f09ceffd700 1 -- 172.21.15.78:0/1032477768 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) v1 ==== 181+0+0 (secure 0 0 0) 0x7f09e80ae850 con 0x7f09e8154440 2023-08-17T17:46:45.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.534+0000 7f09ed8dc700 1 -- 172.21.15.78:0/1032477768 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09d405ecf0 msgr2=0x7f09d40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:45.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.534+0000 7f09ed8dc700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09d405ecf0 0x7f09d40611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f09d8006df0 tx=0x7f09d8015000).stop 2023-08-17T17:46:45.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.534+0000 7f09ed8dc700 1 -- 172.21.15.78:0/1032477768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 msgr2=0x7f09e80c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:45.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.534+0000 7f09ed8dc700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 0x7f09e80c3c50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f09e000b7e0 tx=0x7f09e0009310).stop 2023-08-17T17:46:45.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.534+0000 7f09ed8dc700 1 -- 172.21.15.78:0/1032477768 shutdown_connections 2023-08-17T17:46:45.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.534+0000 7f09ed8dc700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09d405ecf0 0x7f09d40611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:45.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.534+0000 7f09ed8dc700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09e8154440 0x7f09e80c3c50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:45.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.534+0000 7f09ed8dc700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09e80bfea0 0x7f09e80c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:45.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.534+0000 7f09ed8dc700 1 --2- 172.21.15.78:0/1032477768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09e80ca210 0x7f09e8143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:45.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.534+0000 7f09ed8dc700 1 -- 172.21.15.78:0/1032477768 >> 172.21.15.78:0/1032477768 conn(0x7f09e806a400 msgr2=0x7f09e81536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:45.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.535+0000 7f09ed8dc700 1 -- 172.21.15.78:0/1032477768 shutdown_connections 2023-08-17T17:46:45.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.535+0000 7f09ed8dc700 1 -- 172.21.15.78:0/1032477768 wait complete. 2023-08-17T17:46:45.538 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T17:46:45.551 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T17:46:45.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.676+0000 7f3d4f357700 1 Processor -- start 2023-08-17T17:46:45.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.677+0000 7f3d4f357700 1 -- start start 2023-08-17T17:46:45.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.677+0000 7f3d4f357700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa0f0 0x7f3d480644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:45.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.677+0000 7f3d4f357700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d480c5810 0x7f3d480c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:45.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.677+0000 7f3d4f357700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d480649b0 con 0x7f3d480aa4d0 2023-08-17T17:46:45.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.677+0000 7f3d4f357700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d480c6170 con 0x7f3d480c5810 2023-08-17T17:46:45.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.677+0000 7f3d4f357700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48063420 con 0x7f3d480aa0f0 2023-08-17T17:46:45.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4d0f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa0f0 0x7f3d480644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:45.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4d0f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa0f0 0x7f3d480644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:40094/0 (socket says 172.21.15.78:40094) 2023-08-17T17:46:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4d0f3700 1 -- 172.21.15.78:0/3781813257 learned_addr learned my addr 172.21.15.78:0/3781813257 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4d8f4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d480c5810 0x7f3d480c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4c8f2700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3d480aa4d0 0x7f3d480c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:56090/0 (socket says 172.21.15.78:56090) 2023-08-17T17:46:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4d0f3700 1 -- 172.21.15.78:0/3781813257 >> v2:172.21.15.150:3300/0 conn(0x7f3d480c5810 msgr2=0x7f3d480c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4d0f3700 1 --2- 172.21.15.78:0/3781813257 >> v2:172.21.15.150:3300/0 conn(0x7f3d480c5810 0x7f3d480c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4d0f3700 1 -- 172.21.15.78:0/3781813257 >> v1:172.21.15.150:6789/0 conn(0x7f3d480aa4d0 legacy=0x7f3d480c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4d0f3700 1 -- 172.21.15.78:0/3781813257 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d48063700 con 0x7f3d480aa0f0 2023-08-17T17:46:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4d8f4700 1 --2- 172.21.15.78:0/3781813257 >> v2:172.21.15.150:3300/0 conn(0x7f3d480c5810 0x7f3d480c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.678+0000 7f3d4d0f3700 1 --2- 172.21.15.78:0/3781813257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa0f0 0x7f3d480644c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3d44006fd0 tx=0x7f3d440090f0).ready entity=mon.2 client_cookie=4726253516122fe6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d3ffff700 1 -- 172.21.15.78:0/3781813257 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400b580 con 0x7f3d480aa0f0 2023-08-17T17:46:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d3ffff700 1 -- 172.21.15.78:0/3781813257 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4400b6e0 con 0x7f3d480aa0f0 2023-08-17T17:46:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d3ffff700 1 -- 172.21.15.78:0/3781813257 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400ba60 con 0x7f3d480aa0f0 2023-08-17T17:46:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d4f357700 1 -- 172.21.15.78:0/3781813257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa0f0 msgr2=0x7f3d480644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d4f357700 1 --2- 172.21.15.78:0/3781813257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa0f0 0x7f3d480644c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3d44006fd0 tx=0x7f3d440090f0).stop 2023-08-17T17:46:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d4f357700 1 -- 172.21.15.78:0/3781813257 shutdown_connections 2023-08-17T17:46:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d4f357700 1 --2- 172.21.15.78:0/3781813257 >> v2:172.21.15.150:3300/0 conn(0x7f3d480c5810 0x7f3d480c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d4f357700 1 --2- 172.21.15.78:0/3781813257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa0f0 0x7f3d480644c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d4f357700 1 -- 172.21.15.78:0/3781813257 >> 172.21.15.78:0/3781813257 conn(0x7f3d4806a6a0 msgr2=0x7f3d480caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d4f357700 1 -- 172.21.15.78:0/3781813257 shutdown_connections 2023-08-17T17:46:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.679+0000 7f3d4f357700 1 -- 172.21.15.78:0/3781813257 wait complete. 2023-08-17T17:46:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.680+0000 7f3d4f357700 1 Processor -- start 2023-08-17T17:46:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.680+0000 7f3d4f357700 1 -- start start 2023-08-17T17:46:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4f357700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480aa0f0 0x7f3d480c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4f357700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa4d0 0x7f3d481645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4f357700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d480c5810 0x7f3d48151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4f357700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480c3480 con 0x7f3d480aa0f0 2023-08-17T17:46:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4f357700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480aab50 con 0x7f3d480c5810 2023-08-17T17:46:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4f357700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480aae30 con 0x7f3d480aa4d0 2023-08-17T17:46:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4d0f3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480aa0f0 0x7f3d480c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4d0f3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480aa0f0 0x7f3d480c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58484/0 (socket says 172.21.15.78:58484) 2023-08-17T17:46:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4d0f3700 1 -- 172.21.15.78:0/1056756132 learned_addr learned my addr 172.21.15.78:0/1056756132 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4c8f2700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa4d0 0x7f3d481645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.681+0000 7f3d4d8f4700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d480c5810 0x7f3d48151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d4d0f3700 1 -- 172.21.15.78:0/1056756132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa4d0 msgr2=0x7f3d481645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d4d0f3700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa4d0 0x7f3d481645b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d4d0f3700 1 -- 172.21.15.78:0/1056756132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d480c5810 msgr2=0x7f3d48151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d4d0f3700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d480c5810 0x7f3d48151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d4d0f3700 1 -- 172.21.15.78:0/1056756132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40009a20 con 0x7f3d480aa0f0 2023-08-17T17:46:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d4d0f3700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480aa0f0 0x7f3d480c3f30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f3d44009fd0 tx=0x7f3d44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d3d7fa700 1 -- 172.21.15.78:0/1056756132 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400b850 con 0x7f3d480aa0f0 2023-08-17T17:46:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d3d7fa700 1 -- 172.21.15.78:0/1056756132 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4400b9b0 con 0x7f3d480aa0f0 2023-08-17T17:46:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d4f357700 1 -- 172.21.15.78:0/1056756132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d44009370 con 0x7f3d480aa0f0 2023-08-17T17:46:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d3d7fa700 1 -- 172.21.15.78:0/1056756132 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4401c670 con 0x7f3d480aa0f0 2023-08-17T17:46:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.682+0000 7f3d4f357700 1 -- 172.21.15.78:0/1056756132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d480ab3f0 con 0x7f3d480aa0f0 2023-08-17T17:46:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.683+0000 7f3d4f357700 1 -- 172.21.15.78:0/1056756132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d480ab760 con 0x7f3d480aa0f0 2023-08-17T17:46:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.683+0000 7f3d3d7fa700 1 -- 172.21.15.78:0/1056756132 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f3d4402c070 con 0x7f3d480aa0f0 2023-08-17T17:46:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.683+0000 7f3d3d7fa700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2c05ecf0 0x7f3d2c0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.683+0000 7f3d3d7fa700 1 -- 172.21.15.78:0/1056756132 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f3d4407b870 con 0x7f3d480aa0f0 2023-08-17T17:46:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.684+0000 7f3d4c8f2700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2c05ecf0 0x7f3d2c0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.684+0000 7f3d4c8f2700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2c05ecf0 0x7f3d2c0611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3d48084430 tx=0x7f3d38007bf0).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.688+0000 7f3d3d7fa700 1 -- 172.21.15.78:0/1056756132 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d4404cc70 con 0x7f3d480aa0f0 2023-08-17T17:46:45.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.859+0000 7f3d4f357700 1 -- 172.21.15.78:0/1056756132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d48046af0 con 0x7f3d480aa0f0 2023-08-17T17:46:45.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:45.943+0000 7f3d3d7fa700 1 -- 172.21.15.78:0/1056756132 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3d44022030 con 0x7f3d480aa0f0 2023-08-17T17:46:46.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.199+0000 7f3d3d7fa700 1 -- 172.21.15.78:0/1056756132 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3d44042a10 con 0x7f3d480aa0f0 2023-08-17T17:46:46.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 -- 172.21.15.78:0/1056756132 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2c05ecf0 msgr2=0x7f3d2c0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2c05ecf0 0x7f3d2c0611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3d48084430 tx=0x7f3d38007bf0).stop 2023-08-17T17:46:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 -- 172.21.15.78:0/1056756132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480aa0f0 msgr2=0x7f3d480c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480aa0f0 0x7f3d480c3f30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f3d44009fd0 tx=0x7f3d44017000).stop 2023-08-17T17:46:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 -- 172.21.15.78:0/1056756132 shutdown_connections 2023-08-17T17:46:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2c05ecf0 0x7f3d2c0611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d480c5810 0x7f3d48151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480aa0f0 0x7f3d480c3f30 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 --2- 172.21.15.78:0/1056756132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d480aa4d0 0x7f3d481645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 -- 172.21.15.78:0/1056756132 >> 172.21.15.78:0/1056756132 conn(0x7f3d4806a6a0 msgr2=0x7f3d480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:46.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 -- 172.21.15.78:0/1056756132 shutdown_connections 2023-08-17T17:46:46.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.202+0000 7f3d4f357700 1 -- 172.21.15.78:0/1056756132 wait complete. 2023-08-17T17:46:46.206 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T17:46:46.217 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T17:46:46.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.332+0000 7fcc1d619700 1 Processor -- start 2023-08-17T17:46:46.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.332+0000 7fcc1d619700 1 -- start start 2023-08-17T17:46:46.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1d619700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc18151a40 0x7fcc180c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1d619700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc18157be0 0x7fcc18158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1d619700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc18158520 con 0x7fcc18151e20 2023-08-17T17:46:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1d619700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc180c6620 con 0x7fcc18157be0 2023-08-17T17:46:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1d619700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc180c6900 con 0x7fcc18151a40 2023-08-17T17:46:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1ce18700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc18157be0 0x7fcc18158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1ce18700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc18157be0 0x7fcc18158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58496/0 (socket says 172.21.15.78:58496) 2023-08-17T17:46:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc177fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcc18151e20 0x7fcc180c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56096/0 (socket says 172.21.15.78:56096) 2023-08-17T17:46:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1ce18700 1 -- 172.21.15.78:0/3718021405 learned_addr learned my addr 172.21.15.78:0/3718021405 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc17fff700 1 --2- 172.21.15.78:0/3718021405 >> v2:172.21.15.150:3300/0 conn(0x7fcc18151a40 0x7fcc180c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1ce18700 1 -- 172.21.15.78:0/3718021405 >> v2:172.21.15.150:3300/0 conn(0x7fcc18151a40 msgr2=0x7fcc180c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1ce18700 1 --2- 172.21.15.78:0/3718021405 >> v2:172.21.15.150:3300/0 conn(0x7fcc18151a40 0x7fcc180c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1ce18700 1 -- 172.21.15.78:0/3718021405 >> v1:172.21.15.78:6789/0 conn(0x7fcc18151e20 legacy=0x7fcc180c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc16ffd700 1 -- 172.21.15.78:0/3718021405 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050615392 0 0) 0x7fcc18158520 con 0x7fcc18151e20 2023-08-17T17:46:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1ce18700 1 -- 172.21.15.78:0/3718021405 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180c6be0 con 0x7fcc18157be0 2023-08-17T17:46:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc1ce18700 1 --2- 172.21.15.78:0/3718021405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18157be0 0x7fcc18158030 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fcc18083860 tx=0x7fcc10009840).ready entity=mon.0 client_cookie=11e1c0f130fd6ca8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:46.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc16ffd700 1 -- 172.21.15.78:0/3718021405 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1000e070 con 0x7fcc18157be0 2023-08-17T17:46:46.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc16ffd700 1 -- 172.21.15.78:0/3718021405 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1000ba50 con 0x7fcc18157be0 2023-08-17T17:46:46.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.333+0000 7fcc16ffd700 1 -- 172.21.15.78:0/3718021405 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1000bdd0 con 0x7fcc18157be0 2023-08-17T17:46:46.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.334+0000 7fcc1d619700 1 -- 172.21.15.78:0/3718021405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18157be0 msgr2=0x7fcc18158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.334+0000 7fcc1d619700 1 --2- 172.21.15.78:0/3718021405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18157be0 0x7fcc18158030 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fcc18083860 tx=0x7fcc10009840).stop 2023-08-17T17:46:46.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.334+0000 7fcc1d619700 1 -- 172.21.15.78:0/3718021405 shutdown_connections 2023-08-17T17:46:46.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.334+0000 7fcc1d619700 1 --2- 172.21.15.78:0/3718021405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18157be0 0x7fcc18158030 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.334+0000 7fcc1d619700 1 --2- 172.21.15.78:0/3718021405 >> v2:172.21.15.150:3300/0 conn(0x7fcc18151a40 0x7fcc180c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.334+0000 7fcc1d619700 1 -- 172.21.15.78:0/3718021405 >> 172.21.15.78:0/3718021405 conn(0x7fcc180943b0 msgr2=0x7fcc1806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:46.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.334+0000 7fcc1d619700 1 -- 172.21.15.78:0/3718021405 shutdown_connections 2023-08-17T17:46:46.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.334+0000 7fcc1d619700 1 -- 172.21.15.78:0/3718021405 wait complete. 2023-08-17T17:46:46.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.335+0000 7fcc1d619700 1 Processor -- start 2023-08-17T17:46:46.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.335+0000 7fcc1d619700 1 -- start start 2023-08-17T17:46:46.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc1d619700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc18151a40 0x7fcc18168730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc1d619700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18151e20 0x7fcc1814a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc1d619700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc18157be0 0x7fcc180c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc1d619700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc181682a0 con 0x7fcc18151e20 2023-08-17T17:46:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc1d619700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180c2760 con 0x7fcc18151a40 2023-08-17T17:46:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc1d619700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc18167c50 con 0x7fcc18157be0 2023-08-17T17:46:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc177fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18151e20 0x7fcc1814a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc177fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18151e20 0x7fcc1814a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58510/0 (socket says 172.21.15.78:58510) 2023-08-17T17:46:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc177fe700 1 -- 172.21.15.78:0/1354275849 learned_addr learned my addr 172.21.15.78:0/1354275849 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc17fff700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc18151a40 0x7fcc18168730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc1ce18700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc18157be0 0x7fcc180c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc177fe700 1 -- 172.21.15.78:0/1354275849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc18157be0 msgr2=0x7fcc180c1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc177fe700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc18157be0 0x7fcc180c1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc177fe700 1 -- 172.21.15.78:0/1354275849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc18151a40 msgr2=0x7fcc18168730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc177fe700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc18151a40 0x7fcc18168730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc177fe700 1 -- 172.21.15.78:0/1354275849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10009ae0 con 0x7fcc18151e20 2023-08-17T17:46:46.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.336+0000 7fcc177fe700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18151e20 0x7fcc1814a6f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fcc0800c810 tx=0x7fcc08007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:46.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.337+0000 7fcbfffff700 1 -- 172.21.15.78:0/1354275849 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080072e0 con 0x7fcc18151e20 2023-08-17T17:46:46.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.337+0000 7fcbfffff700 1 -- 172.21.15.78:0/1354275849 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc08007440 con 0x7fcc18151e20 2023-08-17T17:46:46.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.337+0000 7fcc1d619700 1 -- 172.21.15.78:0/1354275849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc18167f30 con 0x7fcc18151e20 2023-08-17T17:46:46.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.337+0000 7fcbfffff700 1 -- 172.21.15.78:0/1354275849 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080058a0 con 0x7fcc18151e20 2023-08-17T17:46:46.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.337+0000 7fcc1d619700 1 -- 172.21.15.78:0/1354275849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc181505d0 con 0x7fcc18151e20 2023-08-17T17:46:46.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.338+0000 7fcc1d619700 1 -- 172.21.15.78:0/1354275849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc18082f90 con 0x7fcc18151e20 2023-08-17T17:46:46.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.338+0000 7fcbfffff700 1 -- 172.21.15.78:0/1354275849 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcc08005c50 con 0x7fcc18151e20 2023-08-17T17:46:46.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.338+0000 7fcbfffff700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc0405ed90 0x7fcc04061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.338+0000 7fcbfffff700 1 -- 172.21.15.78:0/1354275849 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6255+0+0 (secure 0 0 0) 0x7fcc08079500 con 0x7fcc18151e20 2023-08-17T17:46:46.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.338+0000 7fcc17fff700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc0405ed90 0x7fcc04061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.339+0000 7fcc17fff700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc0405ed90 0x7fcc04061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcc0c00a9d0 tx=0x7fcc0c008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:46.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.342+0000 7fcbfffff700 1 -- 172.21.15.78:0/1354275849 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc0804aa20 con 0x7fcc18151e20 2023-08-17T17:46:46.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.513+0000 7fcc1d619700 1 -- 172.21.15.78:0/1354275849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcc1805f910 con 0x7fcc18151e20 2023-08-17T17:46:46.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.517+0000 7fcbfffff700 1 -- 172.21.15.78:0/1354275849 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v4) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcc0804e040 con 0x7fcc18151e20 2023-08-17T17:46:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 -- 172.21.15.78:0/1354275849 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc0405ed90 msgr2=0x7fcc04061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc0405ed90 0x7fcc04061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcc0c00a9d0 tx=0x7fcc0c008040).stop 2023-08-17T17:46:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 -- 172.21.15.78:0/1354275849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18151e20 msgr2=0x7fcc1814a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18151e20 0x7fcc1814a6f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fcc0800c810 tx=0x7fcc08007ba0).stop 2023-08-17T17:46:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 -- 172.21.15.78:0/1354275849 shutdown_connections 2023-08-17T17:46:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc0405ed90 0x7fcc04061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc18157be0 0x7fcc180c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc18151a40 0x7fcc18168730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 --2- 172.21.15.78:0/1354275849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc18151e20 0x7fcc1814a6f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 -- 172.21.15.78:0/1354275849 >> 172.21.15.78:0/1354275849 conn(0x7fcc180943b0 msgr2=0x7fcc180bfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:46.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 -- 172.21.15.78:0/1354275849 shutdown_connections 2023-08-17T17:46:46.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.519+0000 7fcc1d619700 1 -- 172.21.15.78:0/1354275849 wait complete. 2023-08-17T17:46:46.532 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-17T17:46:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.645+0000 7f30653c4700 1 Processor -- start 2023-08-17T17:46:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.645+0000 7f30653c4700 1 -- start start 2023-08-17T17:46:46.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.646+0000 7f30653c4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f30600aa4d0 0x7f30600644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.646+0000 7f30653c4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30600649b0 con 0x7f30600c5810 2023-08-17T17:46:46.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.646+0000 7f30653c4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3060063420 con 0x7f30600aa0f0 2023-08-17T17:46:46.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.646+0000 7f30653c4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3060063700 con 0x7f30600aa4d0 2023-08-17T17:46:46.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.646+0000 7f305e7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f30600aa4d0 0x7f30600644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.646+0000 7f305f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f30600c5810 0x7f30600a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56108/0 (socket says 172.21.15.78:56108) 2023-08-17T17:46:46.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.646+0000 7f305f7fe700 1 -- 172.21.15.78:0/2674893528 learned_addr learned my addr 172.21.15.78:0/2674893528 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:46.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f305e7fc700 1 -- 172.21.15.78:0/2674893528 >> v1:172.21.15.150:6789/0 conn(0x7f30600aa0f0 legacy=0x7f30600c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:46.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f305e7fc700 1 -- 172.21.15.78:0/2674893528 >> v1:172.21.15.78:6789/0 conn(0x7f30600c5810 legacy=0x7f30600a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f305e7fc700 1 -- 172.21.15.78:0/2674893528 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30600639e0 con 0x7f30600aa4d0 2023-08-17T17:46:46.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f305dffb700 1 -- 172.21.15.78:0/2674893528 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984534698 0 0) 0x7f30600649b0 con 0x7f30600c5810 2023-08-17T17:46:46.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f305e7fc700 1 --2- 172.21.15.78:0/2674893528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600aa4d0 0x7f30600644c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f3054009760 tx=0x7f3054009060).ready entity=mon.0 client_cookie=a40f09579e232f44 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:46.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f305dffb700 1 -- 172.21.15.78:0/2674893528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305400b520 con 0x7f30600aa4d0 2023-08-17T17:46:46.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f305dffb700 1 -- 172.21.15.78:0/2674893528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305400b680 con 0x7f30600aa4d0 2023-08-17T17:46:46.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f305dffb700 1 -- 172.21.15.78:0/2674893528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305400ba00 con 0x7f30600aa4d0 2023-08-17T17:46:46.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f30653c4700 1 -- 172.21.15.78:0/2674893528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600aa4d0 msgr2=0x7f30600644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f30653c4700 1 --2- 172.21.15.78:0/2674893528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600aa4d0 0x7f30600644c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f3054009760 tx=0x7f3054009060).stop 2023-08-17T17:46:46.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f30653c4700 1 -- 172.21.15.78:0/2674893528 shutdown_connections 2023-08-17T17:46:46.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f30653c4700 1 --2- 172.21.15.78:0/2674893528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600aa4d0 0x7f30600644c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f30653c4700 1 -- 172.21.15.78:0/2674893528 >> 172.21.15.78:0/2674893528 conn(0x7f306006a6a0 msgr2=0x7f30600caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:46.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f30653c4700 1 -- 172.21.15.78:0/2674893528 shutdown_connections 2023-08-17T17:46:46.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.647+0000 7f30653c4700 1 -- 172.21.15.78:0/2674893528 wait complete. 2023-08-17T17:46:46.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f30653c4700 1 Processor -- start 2023-08-17T17:46:46.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f30653c4700 1 -- start start 2023-08-17T17:46:46.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f30653c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30600aa0f0 0x7f30600c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f30653c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30600aa4d0 0x7f30601524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f30653c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600c5810 0x7f3060151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f30653c4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30600c2a70 con 0x7f30600c5810 2023-08-17T17:46:46.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f30653c4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3060164470 con 0x7f30600aa0f0 2023-08-17T17:46:46.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f30653c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3060151e10 con 0x7f30600aa4d0 2023-08-17T17:46:46.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f305f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600c5810 0x7f3060151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f305f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600c5810 0x7f3060151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58528/0 (socket says 172.21.15.78:58528) 2023-08-17T17:46:46.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.649+0000 7f305f7fe700 1 -- 172.21.15.78:0/628659423 learned_addr learned my addr 172.21.15.78:0/628659423 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:46.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f305effd700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30600aa0f0 0x7f30600c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f305e7fc700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30600aa4d0 0x7f30601524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f305f7fe700 1 -- 172.21.15.78:0/628659423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30600aa4d0 msgr2=0x7f30601524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f305f7fe700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30600aa4d0 0x7f30601524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f305f7fe700 1 -- 172.21.15.78:0/628659423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30600aa0f0 msgr2=0x7f30600c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f305f7fe700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30600aa0f0 0x7f30600c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f305f7fe700 1 -- 172.21.15.78:0/628659423 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540092a0 con 0x7f30600c5810 2023-08-17T17:46:46.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f305f7fe700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600c5810 0x7f3060151920 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f305800c730 tx=0x7f3058001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:46.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f3046ffd700 1 -- 172.21.15.78:0/628659423 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058005d30 con 0x7f30600c5810 2023-08-17T17:46:46.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f3046ffd700 1 -- 172.21.15.78:0/628659423 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3058005e90 con 0x7f30600c5810 2023-08-17T17:46:46.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f3046ffd700 1 -- 172.21.15.78:0/628659423 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058007340 con 0x7f30600c5810 2023-08-17T17:46:46.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f30653c4700 1 -- 172.21.15.78:0/628659423 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30600c2ca0 con 0x7f30600c5810 2023-08-17T17:46:46.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.650+0000 7f30653c4700 1 -- 172.21.15.78:0/628659423 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3060164990 con 0x7f30600c5810 2023-08-17T17:46:46.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.651+0000 7f30653c4700 1 -- 172.21.15.78:0/628659423 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3060083980 con 0x7f30600c5810 2023-08-17T17:46:46.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.651+0000 7f3046ffd700 1 -- 172.21.15.78:0/628659423 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3058010030 con 0x7f30600c5810 2023-08-17T17:46:46.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.652+0000 7f3046ffd700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f304c05ed90 0x7f304c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.652+0000 7f3046ffd700 1 -- 172.21.15.78:0/628659423 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6255+0+0 (secure 0 0 0) 0x7f3058079a80 con 0x7f30600c5810 2023-08-17T17:46:46.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.652+0000 7f305effd700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f304c05ed90 0x7f304c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.652+0000 7f305effd700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f304c05ed90 0x7f304c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f30500036e0 tx=0x7f3050009040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:46.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.656+0000 7f3046ffd700 1 -- 172.21.15.78:0/628659423 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f305804afa0 con 0x7f30600c5810 2023-08-17T17:46:46.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.822+0000 7f30653c4700 1 -- 172.21.15.78:0/628659423 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f3060046af0 con 0x7f30600c5810 2023-08-17T17:46:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.825+0000 7f3046ffd700 1 -- 172.21.15.78:0/628659423 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v5) v1 ==== 120+0+0 (secure 0 0 0) 0x7f305804e5c0 con 0x7f30600c5810 2023-08-17T17:46:46.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 -- 172.21.15.78:0/628659423 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f304c05ed90 msgr2=0x7f304c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f304c05ed90 0x7f304c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f30500036e0 tx=0x7f3050009040).stop 2023-08-17T17:46:46.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 -- 172.21.15.78:0/628659423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600c5810 msgr2=0x7f3060151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600c5810 0x7f3060151920 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f305800c730 tx=0x7f3058001520).stop 2023-08-17T17:46:46.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 -- 172.21.15.78:0/628659423 shutdown_connections 2023-08-17T17:46:46.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f304c05ed90 0x7f304c061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30600c5810 0x7f3060151920 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30600aa0f0 0x7f30600c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 --2- 172.21.15.78:0/628659423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30600aa4d0 0x7f30601524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 -- 172.21.15.78:0/628659423 >> 172.21.15.78:0/628659423 conn(0x7f306006a6a0 msgr2=0x7f30600a83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:46.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 -- 172.21.15.78:0/628659423 shutdown_connections 2023-08-17T17:46:46.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.827+0000 7f30653c4700 1 -- 172.21.15.78:0/628659423 wait complete. 2023-08-17T17:46:46.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-08-17T17:46:46.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.956+0000 7f4f68d61700 1 Processor -- start 2023-08-17T17:46:46.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.956+0000 7f4f68d61700 1 -- start start 2023-08-17T17:46:46.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.957+0000 7f4f68d61700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4f640a7fe0 0x7f4f64064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.957+0000 7f4f68d61700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4f640bef00 0x7f4f640c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.957+0000 7f4f68d61700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f640c4040 con 0x7f4f64065140 2023-08-17T17:46:46.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.957+0000 7f4f68d61700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f640c7080 con 0x7f4f640a7fe0 2023-08-17T17:46:46.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.957+0000 7f4f68d61700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f640c3430 con 0x7f4f640bef00 2023-08-17T17:46:46.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.957+0000 7f4f6259c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4f640a7fe0 0x7f4f64064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.957+0000 7f4f59d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4f64065140 0x7f4f640be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56122/0 (socket says 172.21.15.78:56122) 2023-08-17T17:46:46.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.957+0000 7f4f59d9b700 1 -- 172.21.15.78:0/3957747200 learned_addr learned my addr 172.21.15.78:0/3957747200 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:46.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f62d9d700 1 --2- 172.21.15.78:0/3957747200 >> v2:172.21.15.150:3300/0 conn(0x7f4f640bef00 0x7f4f640c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f6259c700 1 -- 172.21.15.78:0/3957747200 >> v2:172.21.15.150:3300/0 conn(0x7f4f640bef00 msgr2=0x7f4f640c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:46.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f6259c700 1 --2- 172.21.15.78:0/3957747200 >> v2:172.21.15.150:3300/0 conn(0x7f4f640bef00 0x7f4f640c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f6259c700 1 -- 172.21.15.78:0/3957747200 >> v1:172.21.15.78:6789/0 conn(0x7f4f64065140 legacy=0x7f4f640be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f6259c700 1 -- 172.21.15.78:0/3957747200 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640c3710 con 0x7f4f640a7fe0 2023-08-17T17:46:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f61d9b700 1 -- 172.21.15.78:0/3957747200 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282211291 0 0) 0x7f4f640c4040 con 0x7f4f64065140 2023-08-17T17:46:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f62d9d700 1 --2- 172.21.15.78:0/3957747200 >> v2:172.21.15.150:3300/0 conn(0x7f4f640bef00 0x7f4f640c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f6259c700 1 --2- 172.21.15.78:0/3957747200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640a7fe0 0x7f4f64064180 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f4f64096d00 tx=0x7f4f54009060).ready entity=mon.0 client_cookie=5a19cf30c07d5a2f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f61d9b700 1 -- 172.21.15.78:0/3957747200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5400b580 con 0x7f4f640a7fe0 2023-08-17T17:46:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f61d9b700 1 -- 172.21.15.78:0/3957747200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5400b6e0 con 0x7f4f640a7fe0 2023-08-17T17:46:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f61d9b700 1 -- 172.21.15.78:0/3957747200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5400ba60 con 0x7f4f640a7fe0 2023-08-17T17:46:46.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f68d61700 1 -- 172.21.15.78:0/3957747200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640a7fe0 msgr2=0x7f4f64064180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f68d61700 1 --2- 172.21.15.78:0/3957747200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640a7fe0 0x7f4f64064180 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f4f64096d00 tx=0x7f4f54009060).stop 2023-08-17T17:46:46.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f68d61700 1 -- 172.21.15.78:0/3957747200 shutdown_connections 2023-08-17T17:46:46.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f68d61700 1 --2- 172.21.15.78:0/3957747200 >> v2:172.21.15.150:3300/0 conn(0x7f4f640bef00 0x7f4f640c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f68d61700 1 --2- 172.21.15.78:0/3957747200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640a7fe0 0x7f4f64064180 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.958+0000 7f4f68d61700 1 -- 172.21.15.78:0/3957747200 >> 172.21.15.78:0/3957747200 conn(0x7f4f64092330 msgr2=0x7f4f64062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:46.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.959+0000 7f4f68d61700 1 -- 172.21.15.78:0/3957747200 shutdown_connections 2023-08-17T17:46:46.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.959+0000 7f4f68d61700 1 -- 172.21.15.78:0/3957747200 wait complete. 2023-08-17T17:46:46.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.960+0000 7f4f68d61700 1 Processor -- start 2023-08-17T17:46:46.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.960+0000 7f4f68d61700 1 -- start start 2023-08-17T17:46:46.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.960+0000 7f4f68d61700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f64065140 0x7f4f64151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f68d61700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f640a7fe0 0x7f4f640ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f68d61700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640bef00 0x7f4f640ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f68d61700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640ae840 con 0x7f4f640bef00 2023-08-17T17:46:46.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f68d61700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640acdc0 con 0x7f4f640a7fe0 2023-08-17T17:46:46.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f68d61700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640ac1b0 con 0x7f4f64065140 2023-08-17T17:46:46.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f62d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640bef00 0x7f4f640ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f62d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640bef00 0x7f4f640ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58546/0 (socket says 172.21.15.78:58546) 2023-08-17T17:46:46.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f62d9d700 1 -- 172.21.15.78:0/4103480615 learned_addr learned my addr 172.21.15.78:0/4103480615 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:46.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f59d9b700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f640a7fe0 0x7f4f640ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f62d9d700 1 -- 172.21.15.78:0/4103480615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f64065140 msgr2=0x7f4f64151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f62d9d700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f64065140 0x7f4f64151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:46.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f62d9d700 1 -- 172.21.15.78:0/4103480615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f640a7fe0 msgr2=0x7f4f640ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:46.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f62d9d700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f640a7fe0 0x7f4f640ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:46.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f62d9d700 1 -- 172.21.15.78:0/4103480615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f540092a0 con 0x7f4f640bef00 2023-08-17T17:46:46.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f59d9b700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f640a7fe0 0x7f4f640ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:46.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f62d9d700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640bef00 0x7f4f640ae350 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f4f5c00cef0 tx=0x7f4f5c007820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:46.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f5affd700 1 -- 172.21.15.78:0/4103480615 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00ae00 con 0x7f4f640bef00 2023-08-17T17:46:46.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f5affd700 1 -- 172.21.15.78:0/4103480615 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c016400 con 0x7f4f640bef00 2023-08-17T17:46:46.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f68d61700 1 -- 172.21.15.78:0/4103480615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f640ac490 con 0x7f4f640bef00 2023-08-17T17:46:46.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f5affd700 1 -- 172.21.15.78:0/4103480615 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c016780 con 0x7f4f640bef00 2023-08-17T17:46:46.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.961+0000 7f4f68d61700 1 -- 172.21.15.78:0/4103480615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f640aca50 con 0x7f4f640bef00 2023-08-17T17:46:46.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.962+0000 7f4f68d61700 1 -- 172.21.15.78:0/4103480615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f64047350 con 0x7f4f640bef00 2023-08-17T17:46:46.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.963+0000 7f4f5affd700 1 -- 172.21.15.78:0/4103480615 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4f5c01d060 con 0x7f4f640bef00 2023-08-17T17:46:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.963+0000 7f4f5affd700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4405ed90 0x7f4f44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.963+0000 7f4f5affd700 1 -- 172.21.15.78:0/4103480615 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6255+0+0 (secure 0 0 0) 0x7f4f5c07a550 con 0x7f4f640bef00 2023-08-17T17:46:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.963+0000 7f4f6259c700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4405ed90 0x7f4f44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.963+0000 7f4f6259c700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4405ed90 0x7f4f44061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4f5400b340 tx=0x7f4f54017000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:46.967+0000 7f4f5affd700 1 -- 172.21.15.78:0/4103480615 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f5c04ba70 con 0x7f4f640bef00 2023-08-17T17:46:47.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.194+0000 7f4f68d61700 1 -- 172.21.15.78:0/4103480615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f4f640acf50 con 0x7f4f640bef00 2023-08-17T17:46:47.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.536+0000 7f4f5affd700 1 -- 172.21.15.78:0/4103480615 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v434) v1 ==== 158+0+0 (secure 0 0 0) 0x7f4f5c04f090 con 0x7f4f640bef00 2023-08-17T17:46:47.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 -- 172.21.15.78:0/4103480615 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4405ed90 msgr2=0x7f4f44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:47.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4405ed90 0x7f4f44061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4f5400b340 tx=0x7f4f54017000).stop 2023-08-17T17:46:47.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 -- 172.21.15.78:0/4103480615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640bef00 msgr2=0x7f4f640ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:47.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640bef00 0x7f4f640ae350 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f4f5c00cef0 tx=0x7f4f5c007820).stop 2023-08-17T17:46:47.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 -- 172.21.15.78:0/4103480615 shutdown_connections 2023-08-17T17:46:47.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f4405ed90 0x7f4f44061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:47.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f640bef00 0x7f4f640ae350 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:47.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f64065140 0x7f4f64151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:47.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 --2- 172.21.15.78:0/4103480615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f640a7fe0 0x7f4f640ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:47.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 -- 172.21.15.78:0/4103480615 >> 172.21.15.78:0/4103480615 conn(0x7f4f64092330 msgr2=0x7f4f640c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:47.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 -- 172.21.15.78:0/4103480615 shutdown_connections 2023-08-17T17:46:47.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.538+0000 7f4f68d61700 1 -- 172.21.15.78:0/4103480615 wait complete. 2023-08-17T17:46:47.551 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-08-17T17:46:47.552 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-08-17T17:46:47.552 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-17T17:46:47.553 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-08-17T17:46:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.665+0000 7f5f5e4f1700 1 Processor -- start 2023-08-17T17:46:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.665+0000 7f5f5e4f1700 1 -- start start 2023-08-17T17:46:47.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.665+0000 7f5f5e4f1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f580c2110 0x7f5f581516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:47.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.665+0000 7f5f5e4f1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f58151be0 con 0x7f5f580650a0 2023-08-17T17:46:47.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.665+0000 7f5f5e4f1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f58068950 con 0x7f5f580c4ee0 2023-08-17T17:46:47.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.665+0000 7f5f5e4f1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f580699f0 con 0x7f5f580c2110 2023-08-17T17:46:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f577fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f580c2110 0x7f5f581516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f577fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f580c2110 0x7f5f581516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58556/0 (socket says 172.21.15.78:58556) 2023-08-17T17:46:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f57fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5f580650a0 0x7f5f580c1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56136/0 (socket says 172.21.15.78:56136) 2023-08-17T17:46:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f577fe700 1 -- 172.21.15.78:0/1266587289 learned_addr learned my addr 172.21.15.78:0/1266587289 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f577fe700 1 -- 172.21.15.78:0/1266587289 >> v1:172.21.15.150:6789/0 conn(0x7f5f580c4ee0 legacy=0x7f5f580c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f577fe700 1 -- 172.21.15.78:0/1266587289 >> v1:172.21.15.78:6789/0 conn(0x7f5f580650a0 legacy=0x7f5f580c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f56ffd700 1 -- 172.21.15.78:0/1266587289 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415605129 0 0) 0x7f5f58151be0 con 0x7f5f580650a0 2023-08-17T17:46:47.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f577fe700 1 -- 172.21.15.78:0/1266587289 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58068c30 con 0x7f5f580c2110 2023-08-17T17:46:47.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f577fe700 1 --2- 172.21.15.78:0/1266587289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 0x7f5f581516f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f5f4c006fd0 tx=0x7f5f4c00a2b0).ready entity=mon.0 client_cookie=d3312521323807a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f56ffd700 1 -- 172.21.15.78:0/1266587289 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00c930 con 0x7f5f580c2110 2023-08-17T17:46:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f56ffd700 1 -- 172.21.15.78:0/1266587289 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c00ca90 con 0x7f5f580c2110 2023-08-17T17:46:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.666+0000 7f5f56ffd700 1 -- 172.21.15.78:0/1266587289 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00ce10 con 0x7f5f580c2110 2023-08-17T17:46:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.667+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/1266587289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 msgr2=0x7f5f581516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.667+0000 7f5f5e4f1700 1 --2- 172.21.15.78:0/1266587289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 0x7f5f581516f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f5f4c006fd0 tx=0x7f5f4c00a2b0).stop 2023-08-17T17:46:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.667+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/1266587289 shutdown_connections 2023-08-17T17:46:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.667+0000 7f5f5e4f1700 1 --2- 172.21.15.78:0/1266587289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 0x7f5f581516f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.667+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/1266587289 >> 172.21.15.78:0/1266587289 conn(0x7f5f58062fc0 msgr2=0x7f5f580c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.667+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/1266587289 shutdown_connections 2023-08-17T17:46:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.667+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/1266587289 wait complete. 2023-08-17T17:46:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.668+0000 7f5f5e4f1700 1 Processor -- start 2023-08-17T17:46:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.668+0000 7f5f5e4f1700 1 -- start start 2023-08-17T17:46:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f5e4f1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f580650a0 0x7f5f5813e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f5e4f1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 0x7f5f5813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f5e4f1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f580c4ee0 0x7f5f580abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f5e4f1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5813d930 con 0x7f5f580c2110 2023-08-17T17:46:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f5e4f1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5813dc10 con 0x7f5f580c4ee0 2023-08-17T17:46:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f5e4f1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5813def0 con 0x7f5f580650a0 2023-08-17T17:46:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f577fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 0x7f5f5813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f577fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 0x7f5f5813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58562/0 (socket says 172.21.15.78:58562) 2023-08-17T17:46:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f577fe700 1 -- 172.21.15.78:0/31147443 learned_addr learned my addr 172.21.15.78:0/31147443 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f577fe700 1 -- 172.21.15.78:0/31147443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f580650a0 msgr2=0x7f5f5813e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f577fe700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f580650a0 0x7f5f5813e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f577fe700 1 -- 172.21.15.78:0/31147443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f580c4ee0 msgr2=0x7f5f580abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f577fe700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f580c4ee0 0x7f5f580abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f577fe700 1 -- 172.21.15.78:0/31147443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c00a510 con 0x7f5f580c2110 2023-08-17T17:46:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f577fe700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 0x7f5f5813b5e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f5f58150cb0 tx=0x7f5f4c00a2b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f3ffff700 1 -- 172.21.15.78:0/31147443 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00ce10 con 0x7f5f580c2110 2023-08-17T17:46:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f3ffff700 1 -- 172.21.15.78:0/31147443 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c023430 con 0x7f5f580c2110 2023-08-17T17:46:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/31147443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5813e1d0 con 0x7f5f580c2110 2023-08-17T17:46:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f3ffff700 1 -- 172.21.15.78:0/31147443 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c0237f0 con 0x7f5f580c2110 2023-08-17T17:46:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.669+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/31147443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5813bad0 con 0x7f5f580c2110 2023-08-17T17:46:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.670+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/31147443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f58047350 con 0x7f5f580c2110 2023-08-17T17:46:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.671+0000 7f5f3ffff700 1 -- 172.21.15.78:0/31147443 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5f4c02a070 con 0x7f5f580c2110 2023-08-17T17:46:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.671+0000 7f5f3ffff700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f4405ed90 0x7f5f44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.671+0000 7f5f3ffff700 1 -- 172.21.15.78:0/31147443 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6255+0+0 (secure 0 0 0) 0x7f5f4c07b050 con 0x7f5f580c2110 2023-08-17T17:46:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.671+0000 7f5f57fff700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f4405ed90 0x7f5f44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:47.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.671+0000 7f5f57fff700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f4405ed90 0x7f5f44061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5f480014c0 tx=0x7f5f48007960).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:47.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.675+0000 7f5f3ffff700 1 -- 172.21.15.78:0/31147443 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f4c04c570 con 0x7f5f580c2110 2023-08-17T17:46:47.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:47.903+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/31147443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f5f580c2990 con 0x7f5f580c2110 2023-08-17T17:46:48.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.537+0000 7f5f3ffff700 1 -- 172.21.15.78:0/31147443 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v435) v1 ==== 157+0+0 (secure 0 0 0) 0x7f5f4c028020 con 0x7f5f580c2110 2023-08-17T17:46:48.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/31147443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f4405ed90 msgr2=0x7f5f44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:48.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f4405ed90 0x7f5f44061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5f480014c0 tx=0x7f5f48007960).stop 2023-08-17T17:46:48.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/31147443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 msgr2=0x7f5f5813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 0x7f5f5813b5e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f5f58150cb0 tx=0x7f5f4c00a2b0).stop 2023-08-17T17:46:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/31147443 shutdown_connections 2023-08-17T17:46:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f4405ed90 0x7f5f44061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f580c4ee0 0x7f5f580abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f580650a0 0x7f5f5813e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 --2- 172.21.15.78:0/31147443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f580c2110 0x7f5f5813b5e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/31147443 >> 172.21.15.78:0/31147443 conn(0x7f5f58062fc0 msgr2=0x7f5f58152e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/31147443 shutdown_connections 2023-08-17T17:46:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.540+0000 7f5f5e4f1700 1 -- 172.21.15.78:0/31147443 wait complete. 2023-08-17T17:46:48.554 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T17:46:48.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.671+0000 7fb631f12700 1 Processor -- start 2023-08-17T17:46:48.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.671+0000 7fb631f12700 1 -- start start 2023-08-17T17:46:48.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb631f12700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb62c0aa0f0 0x7fb62c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:48.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb631f12700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb62c0c5810 0x7fb62c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:48.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb631f12700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c0649b0 con 0x7fb62c0aa4d0 2023-08-17T17:46:48.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb631f12700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0c6170 con 0x7fb62c0c5810 2023-08-17T17:46:48.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb631f12700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c063420 con 0x7fb62c0aa0f0 2023-08-17T17:46:48.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb62c0c5810 0x7fb62c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:48.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62affd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb62c0aa4d0 0x7fb62c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49884/0 (socket says 172.21.15.78:49884) 2023-08-17T17:46:48.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62affd700 1 -- 172.21.15.78:0/1836785405 learned_addr learned my addr 172.21.15.78:0/1836785405 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:48.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62bfff700 1 -- 172.21.15.78:0/1836785405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb62c0aa0f0 msgr2=0x7fb62c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:48.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62bfff700 1 --2- 172.21.15.78:0/1836785405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb62c0aa0f0 0x7fb62c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:48.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62bfff700 1 -- 172.21.15.78:0/1836785405 >> v1:172.21.15.78:6789/0 conn(0x7fb62c0aa4d0 legacy=0x7fb62c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:48.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62bfff700 1 -- 172.21.15.78:0/1836785405 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c063700 con 0x7fb62c0c5810 2023-08-17T17:46:48.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62a7fc700 1 -- 172.21.15.78:0/1836785405 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325959156 0 0) 0x7fb62c0649b0 con 0x7fb62c0aa4d0 2023-08-17T17:46:48.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62bfff700 1 --2- 172.21.15.78:0/1836785405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 0x7fb62c0c5c80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fb624009e60 tx=0x7fb624009780).ready entity=mon.0 client_cookie=8533a92ef08448c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:48.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62a7fc700 1 -- 172.21.15.78:0/1836785405 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400e070 con 0x7fb62c0c5810 2023-08-17T17:46:48.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62a7fc700 1 -- 172.21.15.78:0/1836785405 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62400bc30 con 0x7fb62c0c5810 2023-08-17T17:46:48.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.672+0000 7fb62a7fc700 1 -- 172.21.15.78:0/1836785405 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624012410 con 0x7fb62c0c5810 2023-08-17T17:46:48.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.673+0000 7fb631f12700 1 -- 172.21.15.78:0/1836785405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 msgr2=0x7fb62c0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:48.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.673+0000 7fb631f12700 1 --2- 172.21.15.78:0/1836785405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 0x7fb62c0c5c80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fb624009e60 tx=0x7fb624009780).stop 2023-08-17T17:46:48.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.673+0000 7fb631f12700 1 -- 172.21.15.78:0/1836785405 shutdown_connections 2023-08-17T17:46:48.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.673+0000 7fb631f12700 1 --2- 172.21.15.78:0/1836785405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 0x7fb62c0c5c80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:48.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.673+0000 7fb631f12700 1 --2- 172.21.15.78:0/1836785405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb62c0aa0f0 0x7fb62c0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:48.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.673+0000 7fb631f12700 1 -- 172.21.15.78:0/1836785405 >> 172.21.15.78:0/1836785405 conn(0x7fb62c06a6a0 msgr2=0x7fb62c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:48.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.673+0000 7fb631f12700 1 -- 172.21.15.78:0/1836785405 shutdown_connections 2023-08-17T17:46:48.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.673+0000 7fb631f12700 1 -- 172.21.15.78:0/1836785405 wait complete. 2023-08-17T17:46:48.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.674+0000 7fb631f12700 1 Processor -- start 2023-08-17T17:46:48.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.674+0000 7fb631f12700 1 -- start start 2023-08-17T17:46:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb631f12700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62c0aa0f0 0x7fb62c0ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb631f12700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb62c0aa4d0 0x7fb62c152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb631f12700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 0x7fb62c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb631f12700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0aee50 con 0x7fb62c0c5810 2023-08-17T17:46:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb631f12700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0af410 con 0x7fb62c0aa0f0 2023-08-17T17:46:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb631f12700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0abcd0 con 0x7fb62c0aa4d0 2023-08-17T17:46:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb62bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 0x7fb62c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:48.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb62bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 0x7fb62c0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36702/0 (socket says 172.21.15.78:36702) 2023-08-17T17:46:48.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb62bfff700 1 -- 172.21.15.78:0/460694656 learned_addr learned my addr 172.21.15.78:0/460694656 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:48.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb62b7fe700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62c0aa0f0 0x7fb62c0ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:48.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb62affd700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb62c0aa4d0 0x7fb62c152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:48.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb62bfff700 1 -- 172.21.15.78:0/460694656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb62c0aa4d0 msgr2=0x7fb62c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:48.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb62bfff700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb62c0aa4d0 0x7fb62c152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:48.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb62bfff700 1 -- 172.21.15.78:0/460694656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62c0aa0f0 msgr2=0x7fb62c0ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.675+0000 7fb62bfff700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62c0aa0f0 0x7fb62c0ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.676+0000 7fb62bfff700 1 -- 172.21.15.78:0/460694656 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624009a20 con 0x7fb62c0c5810 2023-08-17T17:46:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.676+0000 7fb62bfff700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 0x7fb62c0c4330 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fb624012f80 tx=0x7fb624009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.676+0000 7fb6137fe700 1 -- 172.21.15.78:0/460694656 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62401d630 con 0x7fb62c0c5810 2023-08-17T17:46:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.676+0000 7fb6137fe700 1 -- 172.21.15.78:0/460694656 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62401d790 con 0x7fb62c0c5810 2023-08-17T17:46:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.676+0000 7fb6137fe700 1 -- 172.21.15.78:0/460694656 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62401db50 con 0x7fb62c0c5810 2023-08-17T17:46:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.676+0000 7fb631f12700 1 -- 172.21.15.78:0/460694656 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c0c1bf0 con 0x7fb62c0c5810 2023-08-17T17:46:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.676+0000 7fb631f12700 1 -- 172.21.15.78:0/460694656 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c0af0a0 con 0x7fb62c0c5810 2023-08-17T17:46:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.677+0000 7fb631f12700 1 -- 172.21.15.78:0/460694656 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c0af5a0 con 0x7fb62c0c5810 2023-08-17T17:46:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.677+0000 7fb6137fe700 1 -- 172.21.15.78:0/460694656 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb624026410 con 0x7fb62c0c5810 2023-08-17T17:46:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.677+0000 7fb6137fe700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61805ed90 0x7fb618061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.677+0000 7fb6137fe700 1 -- 172.21.15.78:0/460694656 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6255+0+0 (secure 0 0 0) 0x7fb62407bb90 con 0x7fb62c0c5810 2023-08-17T17:46:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.677+0000 7fb62b7fe700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61805ed90 0x7fb618061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.678+0000 7fb62b7fe700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61805ed90 0x7fb618061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb61c006fd0 tx=0x7fb61c009060).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:48.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.681+0000 7fb6137fe700 1 -- 172.21.15.78:0/460694656 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb62404d050 con 0x7fb62c0c5810 2023-08-17T17:46:48.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.845+0000 7fb631f12700 1 -- 172.21.15.78:0/460694656 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb62c046af0 con 0x7fb62c0c5810 2023-08-17T17:46:48.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.851+0000 7fb6137fe700 1 -- 172.21.15.78:0/460694656 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb624050670 con 0x7fb62c0c5810 2023-08-17T17:46:48.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 -- 172.21.15.78:0/460694656 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61805ed90 msgr2=0x7fb618061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:48.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61805ed90 0x7fb618061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb61c006fd0 tx=0x7fb61c009060).stop 2023-08-17T17:46:48.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 -- 172.21.15.78:0/460694656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 msgr2=0x7fb62c0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:48.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 0x7fb62c0c4330 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fb624012f80 tx=0x7fb624009780).stop 2023-08-17T17:46:48.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 -- 172.21.15.78:0/460694656 shutdown_connections 2023-08-17T17:46:48.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61805ed90 0x7fb618061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:48.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb62c0c5810 0x7fb62c0c4330 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:48.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb62c0aa0f0 0x7fb62c0ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 --2- 172.21.15.78:0/460694656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb62c0aa4d0 0x7fb62c152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 -- 172.21.15.78:0/460694656 >> 172.21.15.78:0/460694656 conn(0x7fb62c06a6a0 msgr2=0x7fb62c0a7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 -- 172.21.15.78:0/460694656 shutdown_connections 2023-08-17T17:46:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:48.853+0000 7fb631f12700 1 -- 172.21.15.78:0/460694656 wait complete. 2023-08-17T17:46:48.866 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:46:48.866 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:46:48.901 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:46:48.945 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:46:48.945 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T17:46:48.946 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:46:49.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.058+0000 7f5c5491f700 1 Processor -- start 2023-08-17T17:46:49.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.058+0000 7f5c5491f700 1 -- start start 2023-08-17T17:46:49.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c5491f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5c50154140 0x7f5c500c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c5491f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5c500a7c40 0x7f5c500c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c5491f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c50154520 con 0x7f5c500a80b0 2023-08-17T17:46:49.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c5491f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c500c91e0 con 0x7f5c500a7c40 2023-08-17T17:46:49.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c5491f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c500c94c0 con 0x7f5c50154140 2023-08-17T17:46:49.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5c500a7c40 0x7f5c500c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5c500a7c40 0x7f5c500c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36716/0 (socket says 172.21.15.78:36716) 2023-08-17T17:46:49.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4dd9b700 1 -- 172.21.15.78:0/536706632 learned_addr learned my addr 172.21.15.78:0/536706632 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:49.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4e59c700 1 --2- 172.21.15.78:0/536706632 >> v2:172.21.15.150:3300/0 conn(0x7f5c50154140 0x7f5c500c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4dd9b700 1 -- 172.21.15.78:0/536706632 >> v2:172.21.15.150:3300/0 conn(0x7f5c50154140 msgr2=0x7f5c500c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:49.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4dd9b700 1 --2- 172.21.15.78:0/536706632 >> v2:172.21.15.150:3300/0 conn(0x7f5c50154140 0x7f5c500c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4dd9b700 1 -- 172.21.15.78:0/536706632 >> v1:172.21.15.150:6789/0 conn(0x7f5c500a80b0 legacy=0x7f5c500ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4dd9b700 1 -- 172.21.15.78:0/536706632 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c500c97a0 con 0x7f5c500a7c40 2023-08-17T17:46:49.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4dd9b700 1 --2- 172.21.15.78:0/536706632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 0x7f5c500c0900 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f5c500625b0 tx=0x7f5c380090f0).ready entity=mon.0 client_cookie=c37b6a2328fff01f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:49.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4d59a700 1 -- 172.21.15.78:0/536706632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800b600 con 0x7f5c500a7c40 2023-08-17T17:46:49.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4d59a700 1 -- 172.21.15.78:0/536706632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3800b760 con 0x7f5c500a7c40 2023-08-17T17:46:49.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.059+0000 7f5c4d59a700 1 -- 172.21.15.78:0/536706632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800bae0 con 0x7f5c500a7c40 2023-08-17T17:46:49.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.060+0000 7f5c5491f700 1 -- 172.21.15.78:0/536706632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 msgr2=0x7f5c500c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.060+0000 7f5c5491f700 1 --2- 172.21.15.78:0/536706632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 0x7f5c500c0900 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f5c500625b0 tx=0x7f5c380090f0).stop 2023-08-17T17:46:49.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.060+0000 7f5c5491f700 1 -- 172.21.15.78:0/536706632 shutdown_connections 2023-08-17T17:46:49.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.060+0000 7f5c5491f700 1 --2- 172.21.15.78:0/536706632 >> v2:172.21.15.150:3300/0 conn(0x7f5c50154140 0x7f5c500c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.060+0000 7f5c5491f700 1 --2- 172.21.15.78:0/536706632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 0x7f5c500c0900 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.060+0000 7f5c5491f700 1 -- 172.21.15.78:0/536706632 >> 172.21.15.78:0/536706632 conn(0x7f5c50094510 msgr2=0x7f5c5006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.060+0000 7f5c5491f700 1 -- 172.21.15.78:0/536706632 shutdown_connections 2023-08-17T17:46:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.060+0000 7f5c5491f700 1 -- 172.21.15.78:0/536706632 wait complete. 2023-08-17T17:46:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.061+0000 7f5c5491f700 1 Processor -- start 2023-08-17T17:46:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.061+0000 7f5c5491f700 1 -- start start 2023-08-17T17:46:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c5491f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 0x7f5c50165c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c5491f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c500a80b0 0x7f5c50167660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c5491f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50154140 0x7f5c50164a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c5491f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c50150730 con 0x7f5c500a7c40 2023-08-17T17:46:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c5491f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c50150980 con 0x7f5c500a80b0 2023-08-17T17:46:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c5491f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c50150c60 con 0x7f5c50154140 2023-08-17T17:46:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 0x7f5c50165c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 0x7f5c50165c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36730/0 (socket says 172.21.15.78:36730) 2023-08-17T17:46:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4e59c700 1 -- 172.21.15.78:0/87011556 learned_addr learned my addr 172.21.15.78:0/87011556 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4dd9b700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c500a80b0 0x7f5c50167660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4ed9d700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50154140 0x7f5c50164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4e59c700 1 -- 172.21.15.78:0/87011556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50154140 msgr2=0x7f5c50164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4e59c700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50154140 0x7f5c50164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4e59c700 1 -- 172.21.15.78:0/87011556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c500a80b0 msgr2=0x7f5c50167660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4e59c700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c500a80b0 0x7f5c50167660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4e59c700 1 -- 172.21.15.78:0/87011556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009370 con 0x7f5c500a7c40 2023-08-17T17:46:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c4e59c700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 0x7f5c50165c00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f5c4800d890 tx=0x7f5c48008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.062+0000 7f5c467fc700 1 -- 172.21.15.78:0/87011556 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c480125f0 con 0x7f5c500a7c40 2023-08-17T17:46:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.063+0000 7f5c467fc700 1 -- 172.21.15.78:0/87011556 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c48012750 con 0x7f5c500a7c40 2023-08-17T17:46:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.063+0000 7f5c5491f700 1 -- 172.21.15.78:0/87011556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c50150f40 con 0x7f5c500a7c40 2023-08-17T17:46:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.063+0000 7f5c467fc700 1 -- 172.21.15.78:0/87011556 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48012ad0 con 0x7f5c500a7c40 2023-08-17T17:46:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.063+0000 7f5c5491f700 1 -- 172.21.15.78:0/87011556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c501660f0 con 0x7f5c500a7c40 2023-08-17T17:46:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.063+0000 7f5c5491f700 1 -- 172.21.15.78:0/87011556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c50151590 con 0x7f5c500a7c40 2023-08-17T17:46:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.064+0000 7f5c467fc700 1 -- 172.21.15.78:0/87011556 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5c48013480 con 0x7f5c500a7c40 2023-08-17T17:46:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.064+0000 7f5c467fc700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3005ed90 0x7f5c30061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.064+0000 7f5c467fc700 1 -- 172.21.15.78:0/87011556 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6255+0+0 (secure 0 0 0) 0x7f5c480799d0 con 0x7f5c500a7c40 2023-08-17T17:46:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.064+0000 7f5c4dd9b700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3005ed90 0x7f5c30061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.064+0000 7f5c4dd9b700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3005ed90 0x7f5c30061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5c38009130 tx=0x7f5c38017000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.068+0000 7f5c467fc700 1 -- 172.21.15.78:0/87011556 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c4804ae90 con 0x7f5c500a7c40 2023-08-17T17:46:49.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.268+0000 7f5c5491f700 1 -- 172.21.15.78:0/87011556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c5006b6e0 con 0x7f5c500a7c40 2023-08-17T17:46:49.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.269+0000 7f5c467fc700 1 -- 172.21.15.78:0/87011556 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f5c4804e4b0 con 0x7f5c500a7c40 2023-08-17T17:46:49.270 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:49.270 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/175439344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":175439344},{"type":"v1","addr":"172.21.15.150:6834","nonce":175439344}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/893012651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":893012651},{"type":"v1","addr":"172.21.15.150:6835","nonce":893012651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4944,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/734042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":734042508},{"type":"v1","addr":"172.21.15.78:6836","nonce":734042508}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/725223841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":725223841},{"type":"v1","addr":"172.21.15.78:6837","nonce":725223841}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[]} 2023-08-17T17:46:49.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 -- 172.21.15.78:0/87011556 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3005ed90 msgr2=0x7f5c30061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3005ed90 0x7f5c30061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5c38009130 tx=0x7f5c38017000).stop 2023-08-17T17:46:49.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 -- 172.21.15.78:0/87011556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 msgr2=0x7f5c50165c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 0x7f5c50165c00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f5c4800d890 tx=0x7f5c48008040).stop 2023-08-17T17:46:49.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 -- 172.21.15.78:0/87011556 shutdown_connections 2023-08-17T17:46:49.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3005ed90 0x7f5c30061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50154140 0x7f5c50164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c500a7c40 0x7f5c50165c00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 --2- 172.21.15.78:0/87011556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c500a80b0 0x7f5c50167660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 -- 172.21.15.78:0/87011556 >> 172.21.15.78:0/87011556 conn(0x7f5c50094510 msgr2=0x7f5c500cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 -- 172.21.15.78:0/87011556 shutdown_connections 2023-08-17T17:46:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.270+0000 7f5c5491f700 1 -- 172.21.15.78:0/87011556 wait complete. 2023-08-17T17:46:49.274 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 15 2023-08-17T17:46:49.283 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T17:46:49.284 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T17:46:49.284 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T17:46:49.284 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:46:49.284 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T17:46:49.285 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T17:46:49.285 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T17:46:49.285 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:46:49.285 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T17:46:49.285 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T17:46:49.286 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T17:46:49.286 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:46:49.286 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T17:46:49.286 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T17:46:49.287 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T17:46:49.287 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:46:49.292 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T17:46:49.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T17:46:49.293 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T17:46:49.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T17:46:49.297 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T17:46:49.297 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T17:46:49.298 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T17:46:49.298 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T17:46:49.335 INFO:tasks.ceph.mds.a:Started 2023-08-17T17:46:49.335 DEBUG:teuthology.parallel:result is None 2023-08-17T17:46:49.336 INFO:tasks.ceph.mds.c:Started 2023-08-17T17:46:49.336 DEBUG:teuthology.parallel:result is None 2023-08-17T17:46:49.340 INFO:tasks.ceph.mds.b:Started 2023-08-17T17:46:49.340 DEBUG:teuthology.parallel:result is None 2023-08-17T17:46:49.341 INFO:tasks.ceph.mds.d:Started 2023-08-17T17:46:49.341 DEBUG:teuthology.parallel:result is None 2023-08-17T17:46:49.342 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T17:46:49.407 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:46:49.407 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T17:46:49.418 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:46:49.418 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T17:46:49.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.462+0000 7f4cfb59e700 1 Processor -- start 2023-08-17T17:46:49.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.462+0000 7f4cfb59e700 1 -- start start 2023-08-17T17:46:49.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cfb59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4cfc14fc20 0x7f4cfc152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cfb59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc0bcfe0 con 0x7f4cfc062c00 2023-08-17T17:46:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cfb59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc067840 con 0x7f4cfc14f840 2023-08-17T17:46:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cfb59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc0bca20 con 0x7f4cfc14fc20 2023-08-17T17:46:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cf9d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4cfc062c00 0x7f4cfc0c2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49906/0 (socket says 172.21.15.78:49906) 2023-08-17T17:46:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cf9d9b700 1 -- 172.21.15.78:0/1791001822 learned_addr learned my addr 172.21.15.78:0/1791001822 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cfad9d700 1 --2- 172.21.15.78:0/1791001822 >> v2:172.21.15.150:3300/0 conn(0x7f4cfc14fc20 0x7f4cfc152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cf959a700 1 -- 172.21.15.78:0/1791001822 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528030477 0 0) 0x7f4cfc0bcfe0 con 0x7f4cfc062c00 2023-08-17T17:46:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cf959a700 1 -- 172.21.15.78:0/1791001822 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce40033f0 con 0x7f4cfc062c00 2023-08-17T17:46:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cfad9d700 1 -- 172.21.15.78:0/1791001822 >> v1:172.21.15.150:6789/0 conn(0x7f4cfc14f840 legacy=0x7f4cfc0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cf959a700 1 -- 172.21.15.78:0/1791001822 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1408294249 0 0) 0x7f4ce40033f0 con 0x7f4cfc062c00 2023-08-17T17:46:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.463+0000 7f4cfad9d700 1 -- 172.21.15.78:0/1791001822 >> v1:172.21.15.78:6789/0 conn(0x7f4cfc062c00 legacy=0x7f4cfc0c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cfad9d700 1 -- 172.21.15.78:0/1791001822 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0bcd00 con 0x7f4cfc14fc20 2023-08-17T17:46:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cfad9d700 1 --2- 172.21.15.78:0/1791001822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cfc14fc20 0x7f4cfc152fe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f4cf4009e60 tx=0x7f4cf4009780).ready entity=mon.1 client_cookie=f628981b6d95d915 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cf959a700 1 -- 172.21.15.78:0/1791001822 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf400e070 con 0x7f4cfc14fc20 2023-08-17T17:46:49.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cf959a700 1 -- 172.21.15.78:0/1791001822 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf400b850 con 0x7f4cfc14fc20 2023-08-17T17:46:49.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cf959a700 1 -- 172.21.15.78:0/1791001822 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0001470 con 0x7f4cfc14fc20 2023-08-17T17:46:49.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cfb59e700 1 -- 172.21.15.78:0/1791001822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cfc14fc20 msgr2=0x7f4cfc152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cfb59e700 1 --2- 172.21.15.78:0/1791001822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cfc14fc20 0x7f4cfc152fe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f4cf4009e60 tx=0x7f4cf4009780).stop 2023-08-17T17:46:49.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cfb59e700 1 -- 172.21.15.78:0/1791001822 shutdown_connections 2023-08-17T17:46:49.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cfb59e700 1 --2- 172.21.15.78:0/1791001822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cfc14fc20 0x7f4cfc152fe0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cfb59e700 1 -- 172.21.15.78:0/1791001822 >> 172.21.15.78:0/1791001822 conn(0x7f4cfc0c8550 msgr2=0x7f4cfc0c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:49.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cfb59e700 1 -- 172.21.15.78:0/1791001822 shutdown_connections 2023-08-17T17:46:49.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.464+0000 7f4cfb59e700 1 -- 172.21.15.78:0/1791001822 wait complete. 2023-08-17T17:46:49.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.465+0000 7f4cfb59e700 1 Processor -- start 2023-08-17T17:46:49.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.465+0000 7f4cfb59e700 1 -- start start 2023-08-17T17:46:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cfb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4cfc062c00 0x7f4cfc167580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cfb59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cfc14f840 0x7f4cfc065190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cfb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cfc14fc20 0x7f4cfc065680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cfb59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0aaea0 con 0x7f4cfc14f840 2023-08-17T17:46:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cfb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc065c50 con 0x7f4cfc14fc20 2023-08-17T17:46:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cfb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc065f30 con 0x7f4cfc062c00 2023-08-17T17:46:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cf9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cfc14f840 0x7f4cfc065190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cf9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cfc14f840 0x7f4cfc065190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36776/0 (socket says 172.21.15.78:36776) 2023-08-17T17:46:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cf9d9b700 1 -- 172.21.15.78:0/446995130 learned_addr learned my addr 172.21.15.78:0/446995130 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cfad9d700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cfc14fc20 0x7f4cfc065680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cfa59c700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4cfc062c00 0x7f4cfc167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.466+0000 7f4cf9d9b700 1 -- 172.21.15.78:0/446995130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4cfc062c00 msgr2=0x7f4cfc167580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cf9d9b700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4cfc062c00 0x7f4cfc167580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cf9d9b700 1 -- 172.21.15.78:0/446995130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cfc14fc20 msgr2=0x7f4cfc065680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cf9d9b700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cfc14fc20 0x7f4cfc065680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cf9d9b700 1 -- 172.21.15.78:0/446995130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4009a20 con 0x7f4cfc14f840 2023-08-17T17:46:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cfa59c700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4cfc062c00 0x7f4cfc167580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cf9d9b700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cfc14f840 0x7f4cfc065190 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f4cf000c760 tx=0x7f4cf0001ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cea7fc700 1 -- 172.21.15.78:0/446995130 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0007170 con 0x7f4cfc14f840 2023-08-17T17:46:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cea7fc700 1 -- 172.21.15.78:0/446995130 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf00072d0 con 0x7f4cfc14f840 2023-08-17T17:46:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cfb59e700 1 -- 172.21.15.78:0/446995130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc066210 con 0x7f4cfc14f840 2023-08-17T17:46:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cea7fc700 1 -- 172.21.15.78:0/446995130 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00048c0 con 0x7f4cfc14f840 2023-08-17T17:46:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.467+0000 7f4cfb59e700 1 -- 172.21.15.78:0/446995130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc066b50 con 0x7f4cfc14f840 2023-08-17T17:46:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.468+0000 7f4cfb59e700 1 -- 172.21.15.78:0/446995130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cfc0ab050 con 0x7f4cfc14f840 2023-08-17T17:46:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.468+0000 7f4cea7fc700 1 -- 172.21.15.78:0/446995130 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4cf0010070 con 0x7f4cfc14f840 2023-08-17T17:46:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.468+0000 7f4cea7fc700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4cdc05ed90 0x7f4cdc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.468+0000 7f4cea7fc700 1 -- 172.21.15.78:0/446995130 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f4cf00793c0 con 0x7f4cfc14f840 2023-08-17T17:46:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.468+0000 7f4cfa59c700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4cdc05ed90 0x7f4cdc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:49.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.469+0000 7f4cfa59c700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4cdc05ed90 0x7f4cdc061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4cfc0bd830 tx=0x7f4cec009040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:49.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.472+0000 7f4cea7fc700 1 -- 172.21.15.78:0/446995130 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4cfc0ab050 con 0x7f4cfc14f840 2023-08-17T17:46:49.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:49.648+0000 7f4cfb59e700 1 -- 172.21.15.78:0/446995130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4cfc0c56c0 con 0x7f4cfc14f840 2023-08-17T17:46:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.540+0000 7f4cea7fc700 1 -- 172.21.15.78:0/446995130 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4cf004ab20 con 0x7f4cfc14f840 2023-08-17T17:46:50.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.542+0000 7f4cfb59e700 1 -- 172.21.15.78:0/446995130 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4cdc05ed90 msgr2=0x7f4cdc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:50.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.542+0000 7f4cfb59e700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4cdc05ed90 0x7f4cdc061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4cfc0bd830 tx=0x7f4cec009040).stop 2023-08-17T17:46:50.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.542+0000 7f4cfb59e700 1 -- 172.21.15.78:0/446995130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cfc14f840 msgr2=0x7f4cfc065190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:50.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.542+0000 7f4cfb59e700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cfc14f840 0x7f4cfc065190 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f4cf000c760 tx=0x7f4cf0001ad0).stop 2023-08-17T17:46:50.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.542+0000 7f4cfb59e700 1 -- 172.21.15.78:0/446995130 shutdown_connections 2023-08-17T17:46:50.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.542+0000 7f4cfb59e700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4cdc05ed90 0x7f4cdc061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.542+0000 7f4cfb59e700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4cfc14fc20 0x7f4cfc065680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.542+0000 7f4cfb59e700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4cfc062c00 0x7f4cfc167580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.542+0000 7f4cfb59e700 1 --2- 172.21.15.78:0/446995130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cfc14f840 0x7f4cfc065190 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.542+0000 7f4cfb59e700 1 -- 172.21.15.78:0/446995130 >> 172.21.15.78:0/446995130 conn(0x7f4cfc0c8550 msgr2=0x7f4cfc151950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:50.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.543+0000 7f4cfb59e700 1 -- 172.21.15.78:0/446995130 shutdown_connections 2023-08-17T17:46:50.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.543+0000 7f4cfb59e700 1 -- 172.21.15.78:0/446995130 wait complete. 2023-08-17T17:46:50.546 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-08-17T17:46:50.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T17:46:50.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.672+0000 7f7e07f37700 1 Processor -- start 2023-08-17T17:46:50.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.673+0000 7f7e07f37700 1 -- start start 2023-08-17T17:46:50.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.673+0000 7f7e07f37700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7e00154140 0x7f7e000c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:50.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.673+0000 7f7e07f37700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a7c40 0x7f7e000c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:50.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.673+0000 7f7e07f37700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e00154520 con 0x7f7e000a8080 2023-08-17T17:46:50.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.673+0000 7f7e07f37700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e000c91e0 con 0x7f7e00154140 2023-08-17T17:46:50.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.673+0000 7f7e07f37700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000c94c0 con 0x7f7e000a7c40 2023-08-17T17:46:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e05cd3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7e00154140 0x7f7e000c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e054d2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a7c40 0x7f7e000c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e05cd3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7e00154140 0x7f7e000c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:56224/0 (socket says 172.21.15.78:56224) 2023-08-17T17:46:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e05cd3700 1 -- 172.21.15.78:0/2494499833 learned_addr learned my addr 172.21.15.78:0/2494499833 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e064d4700 1 --1- 172.21.15.78:0/2494499833 >> v1:172.21.15.150:6789/0 conn(0x7f7e000a8080 0x7f7e000ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:51210/0 (socket says 172.21.15.78:51210) 2023-08-17T17:46:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e054d2700 1 -- 172.21.15.78:0/2494499833 >> v2:172.21.15.150:3300/0 conn(0x7f7e00154140 msgr2=0x7f7e000c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e054d2700 1 --2- 172.21.15.78:0/2494499833 >> v2:172.21.15.150:3300/0 conn(0x7f7e00154140 0x7f7e000c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e054d2700 1 -- 172.21.15.78:0/2494499833 >> v1:172.21.15.150:6789/0 conn(0x7f7e000a8080 legacy=0x7f7e000ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e04cd1700 1 -- 172.21.15.78:0/2494499833 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197925278 0 0) 0x7f7e00154520 con 0x7f7e000a8080 2023-08-17T17:46:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e054d2700 1 -- 172.21.15.78:0/2494499833 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e000c97a0 con 0x7f7e000a7c40 2023-08-17T17:46:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e05cd3700 1 --2- 172.21.15.78:0/2494499833 >> v2:172.21.15.150:3300/0 conn(0x7f7e00154140 0x7f7e000c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.674+0000 7f7e054d2700 1 --2- 172.21.15.78:0/2494499833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a7c40 0x7f7e000c0900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7df4009760 tx=0x7f7df4009060).ready entity=mon.2 client_cookie=d6589675ca9d4c77 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e04cd1700 1 -- 172.21.15.78:0/2494499833 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400f510 con 0x7f7e000a7c40 2023-08-17T17:46:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e04cd1700 1 -- 172.21.15.78:0/2494499833 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df400f670 con 0x7f7e000a7c40 2023-08-17T17:46:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e04cd1700 1 -- 172.21.15.78:0/2494499833 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400f9f0 con 0x7f7e000a7c40 2023-08-17T17:46:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e07f37700 1 -- 172.21.15.78:0/2494499833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a7c40 msgr2=0x7f7e000c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e07f37700 1 --2- 172.21.15.78:0/2494499833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a7c40 0x7f7e000c0900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7df4009760 tx=0x7f7df4009060).stop 2023-08-17T17:46:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e07f37700 1 -- 172.21.15.78:0/2494499833 shutdown_connections 2023-08-17T17:46:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e07f37700 1 --2- 172.21.15.78:0/2494499833 >> v2:172.21.15.150:3300/0 conn(0x7f7e00154140 0x7f7e000c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e07f37700 1 --2- 172.21.15.78:0/2494499833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a7c40 0x7f7e000c0900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e07f37700 1 -- 172.21.15.78:0/2494499833 >> 172.21.15.78:0/2494499833 conn(0x7f7e00094510 msgr2=0x7f7e0006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e07f37700 1 -- 172.21.15.78:0/2494499833 shutdown_connections 2023-08-17T17:46:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.675+0000 7f7e07f37700 1 -- 172.21.15.78:0/2494499833 wait complete. 2023-08-17T17:46:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.676+0000 7f7e07f37700 1 Processor -- start 2023-08-17T17:46:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.676+0000 7f7e07f37700 1 -- start start 2023-08-17T17:46:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e07f37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e000a7c40 0x7f7e001569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e07f37700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a8080 0x7f7e00146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e07f37700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e00154140 0x7f7e001556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e07f37700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00150b90 con 0x7f7e000a7c40 2023-08-17T17:46:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e07f37700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00156f70 con 0x7f7e00154140 2023-08-17T17:46:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e07f37700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00157250 con 0x7f7e000a8080 2023-08-17T17:46:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e05cd3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e000a7c40 0x7f7e001569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e05cd3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e000a7c40 0x7f7e001569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36784/0 (socket says 172.21.15.78:36784) 2023-08-17T17:46:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e05cd3700 1 -- 172.21.15.78:0/3260333157 learned_addr learned my addr 172.21.15.78:0/3260333157 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e064d4700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e00154140 0x7f7e001556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.677+0000 7f7e054d2700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a8080 0x7f7e00146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7e05cd3700 1 -- 172.21.15.78:0/3260333157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a8080 msgr2=0x7f7e00146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7e05cd3700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a8080 0x7f7e00146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7e05cd3700 1 -- 172.21.15.78:0/3260333157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e00154140 msgr2=0x7f7e001556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7e05cd3700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e00154140 0x7f7e001556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7e05cd3700 1 -- 172.21.15.78:0/3260333157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8009370 con 0x7f7e000a7c40 2023-08-17T17:46:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7e05cd3700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e000a7c40 0x7f7e001569b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f7df800ea20 tx=0x7f7df80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7dfdffb700 1 -- 172.21.15.78:0/3260333157 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800ee60 con 0x7f7e000a7c40 2023-08-17T17:46:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7dfdffb700 1 -- 172.21.15.78:0/3260333157 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df800c850 con 0x7f7e000a7c40 2023-08-17T17:46:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7e07f37700 1 -- 172.21.15.78:0/3260333157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df40092a0 con 0x7f7e000a7c40 2023-08-17T17:46:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7dfdffb700 1 -- 172.21.15.78:0/3260333157 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800cbd0 con 0x7f7e000a7c40 2023-08-17T17:46:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.678+0000 7f7e07f37700 1 -- 172.21.15.78:0/3260333157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e00150de0 con 0x7f7e000a7c40 2023-08-17T17:46:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.679+0000 7f7e07f37700 1 -- 172.21.15.78:0/3260333157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e00151150 con 0x7f7e000a7c40 2023-08-17T17:46:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.679+0000 7f7dfdffb700 1 -- 172.21.15.78:0/3260333157 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7df8022070 con 0x7f7e000a7c40 2023-08-17T17:46:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.680+0000 7f7dfdffb700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7dec05ed90 0x7f7dec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.680+0000 7f7dfdffb700 1 -- 172.21.15.78:0/3260333157 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7df8079ba0 con 0x7f7e000a7c40 2023-08-17T17:46:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.680+0000 7f7e054d2700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7dec05ed90 0x7f7dec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.680+0000 7f7e054d2700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7dec05ed90 0x7f7dec061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7e00167660 tx=0x7f7df4017000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.684+0000 7f7dfdffb700 1 -- 172.21.15.78:0/3260333157 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7df804b490 con 0x7f7e000a7c40 2023-08-17T17:46:50.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.909+0000 7f7e07f37700 1 -- 172.21.15.78:0/3260333157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7e00047350 con 0x7f7e000a7c40 2023-08-17T17:46:50.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.910+0000 7f7dfdffb700 1 -- 172.21.15.78:0/3260333157 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7df8016020 con 0x7f7e000a7c40 2023-08-17T17:46:50.911 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:50.911 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:46:50.912 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-08-17T17:46:50.912 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.912 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-08-17T17:46:50.912 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA==", 2023-08-17T17:46:50.912 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.912 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:46:50.912 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:46:50.913 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:46:50.913 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.913 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.913 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.913 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.913 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-08-17T17:46:50.913 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g==", 2023-08-17T17:46:50.914 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.914 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:46:50.914 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:46:50.914 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:46:50.914 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.914 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.914 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.915 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.915 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-08-17T17:46:50.915 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw==", 2023-08-17T17:46:50.915 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.915 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:46:50.915 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:46:50.915 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:46:50.916 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.916 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.916 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.916 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.916 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-08-17T17:46:50.916 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg==", 2023-08-17T17:46:50.916 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:46:50.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:46:50.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:46:50.917 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.917 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.917 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.917 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.918 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-08-17T17:46:50.918 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg==", 2023-08-17T17:46:50.918 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.918 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:46:50.918 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:46:50.919 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.919 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.919 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.919 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.919 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-08-17T17:46:50.919 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw==", 2023-08-17T17:46:50.919 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.920 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:46:50.920 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:46:50.920 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.920 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.920 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.920 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.920 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-08-17T17:46:50.921 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA==", 2023-08-17T17:46:50.921 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.921 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:46:50.921 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:46:50.921 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.921 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.921 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.922 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.922 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-08-17T17:46:50.922 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ==", 2023-08-17T17:46:50.922 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.922 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:46:50.922 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:46:50.922 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.923 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.923 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.923 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.923 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-08-17T17:46:50.923 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA==", 2023-08-17T17:46:50.923 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.923 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:46:50.923 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:46:50.924 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.924 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.924 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.924 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.924 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-08-17T17:46:50.924 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q==", 2023-08-17T17:46:50.924 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.925 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:46:50.925 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:46:50.925 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.925 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.925 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.925 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.925 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-08-17T17:46:50.926 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw==", 2023-08-17T17:46:50.926 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.926 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:46:50.926 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:46:50.926 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.926 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.926 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.927 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.927 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-08-17T17:46:50.927 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg==", 2023-08-17T17:46:50.927 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.927 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:46:50.927 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:46:50.927 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.928 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.928 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.928 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.928 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-08-17T17:46:50.928 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA==", 2023-08-17T17:46:50.928 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.928 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:46:50.929 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-08-17T17:46:50.929 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T17:46:50.929 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.929 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.929 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.929 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-08-17T17:46:50.929 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ==", 2023-08-17T17:46:50.930 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.930 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:46:50.930 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:46:50.930 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:46:50.930 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:46:50.930 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.930 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.931 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.931 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-08-17T17:46:50.931 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ==", 2023-08-17T17:46:50.931 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.931 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:46:50.931 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:46:50.931 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:46:50.932 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:46:50.932 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.932 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.932 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.932 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-08-17T17:46:50.932 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw==", 2023-08-17T17:46:50.932 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.933 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:46:50.933 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:46:50.933 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:46:50.933 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:46:50.933 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.933 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.933 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.933 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-08-17T17:46:50.934 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k6n2yGhAAldYlBQaNGCgXL0HA2ePHVg==", 2023-08-17T17:46:50.934 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.934 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:46:50.934 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:46:50.934 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:46:50.934 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.934 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.935 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.935 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.935 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-08-17T17:46:50.935 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg==", 2023-08-17T17:46:50.935 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.935 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:46:50.935 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:46:50.936 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.936 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.936 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:50.936 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:50.936 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-08-17T17:46:50.936 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA==", 2023-08-17T17:46:50.936 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:46:50.937 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:46:50.937 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:46:50.937 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:46:50.937 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.937 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:50.937 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-08-17T17:46:50.937 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:46:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.911+0000 7f7e07f37700 1 -- 172.21.15.78:0/3260333157 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7dec05ed90 msgr2=0x7f7dec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.911+0000 7f7e07f37700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7dec05ed90 0x7f7dec061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7e00167660 tx=0x7f7df4017000).stop 2023-08-17T17:46:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.911+0000 7f7e07f37700 1 -- 172.21.15.78:0/3260333157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e000a7c40 msgr2=0x7f7e001569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.911+0000 7f7e07f37700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e000a7c40 0x7f7e001569b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f7df800ea20 tx=0x7f7df80090f0).stop 2023-08-17T17:46:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.912+0000 7f7e07f37700 1 -- 172.21.15.78:0/3260333157 shutdown_connections 2023-08-17T17:46:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.912+0000 7f7e07f37700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7dec05ed90 0x7f7dec061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.912+0000 7f7e07f37700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e00154140 0x7f7e001556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.912+0000 7f7e07f37700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e000a7c40 0x7f7e001569b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.912+0000 7f7e07f37700 1 --2- 172.21.15.78:0/3260333157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e000a8080 0x7f7e00146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.912+0000 7f7e07f37700 1 -- 172.21.15.78:0/3260333157 >> 172.21.15.78:0/3260333157 conn(0x7f7e00094510 msgr2=0x7f7e000cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.912+0000 7f7e07f37700 1 -- 172.21.15.78:0/3260333157 shutdown_connections 2023-08-17T17:46:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:50.912+0000 7f7e07f37700 1 -- 172.21.15.78:0/3260333157 wait complete. 2023-08-17T17:46:50.941 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:46:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.052+0000 7f08ee40d700 1 Processor -- start 2023-08-17T17:46:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.052+0000 7f08ee40d700 1 -- start start 2023-08-17T17:46:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.053+0000 7f08ee40d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08e8154140 0x7f08e80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.053+0000 7f08ee40d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08e80a7c40 0x7f08e80c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.053+0000 7f08ee40d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e8154520 con 0x7f08e80a8080 2023-08-17T17:46:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.053+0000 7f08ee40d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e80c91e0 con 0x7f08e8154140 2023-08-17T17:46:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.053+0000 7f08ee40d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80c94c0 con 0x7f08e80a7c40 2023-08-17T17:46:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.053+0000 7f08e7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08e8154140 0x7f08e80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.053+0000 7f08ec9aa700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f08e80a8080 0x7f08e80ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49922/0 (socket says 172.21.15.78:49922) 2023-08-17T17:46:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.053+0000 7f08ec9aa700 1 -- 172.21.15.78:0/3593909038 learned_addr learned my addr 172.21.15.78:0/3593909038 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e77fe700 1 --2- 172.21.15.78:0/3593909038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08e80a7c40 0x7f08e80c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e7fff700 1 -- 172.21.15.78:0/3593909038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08e80a7c40 msgr2=0x7f08e80c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e7fff700 1 --2- 172.21.15.78:0/3593909038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08e80a7c40 0x7f08e80c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e7fff700 1 -- 172.21.15.78:0/3593909038 >> v1:172.21.15.78:6789/0 conn(0x7f08e80a8080 legacy=0x7f08e80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e6ffd700 1 -- 172.21.15.78:0/3593909038 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165609311 0 0) 0x7f08e8154520 con 0x7f08e80a8080 2023-08-17T17:46:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e7fff700 1 -- 172.21.15.78:0/3593909038 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e80c97a0 con 0x7f08e8154140 2023-08-17T17:46:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e77fe700 1 --2- 172.21.15.78:0/3593909038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08e80a7c40 0x7f08e80c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e7fff700 1 --2- 172.21.15.78:0/3593909038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 0x7f08e80c6ee0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f08d8009760 tx=0x7f08d8009060).ready entity=mon.0 client_cookie=f35f53bd216bb768 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e6ffd700 1 -- 172.21.15.78:0/3593909038 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800b580 con 0x7f08e8154140 2023-08-17T17:46:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e6ffd700 1 -- 172.21.15.78:0/3593909038 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d800b6e0 con 0x7f08e8154140 2023-08-17T17:46:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.054+0000 7f08e6ffd700 1 -- 172.21.15.78:0/3593909038 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800ba60 con 0x7f08e8154140 2023-08-17T17:46:51.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.055+0000 7f08ee40d700 1 -- 172.21.15.78:0/3593909038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 msgr2=0x7f08e80c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.055+0000 7f08ee40d700 1 --2- 172.21.15.78:0/3593909038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 0x7f08e80c6ee0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f08d8009760 tx=0x7f08d8009060).stop 2023-08-17T17:46:51.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.055+0000 7f08ee40d700 1 -- 172.21.15.78:0/3593909038 shutdown_connections 2023-08-17T17:46:51.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.055+0000 7f08ee40d700 1 --2- 172.21.15.78:0/3593909038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 0x7f08e80c6ee0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.055+0000 7f08ee40d700 1 --2- 172.21.15.78:0/3593909038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08e80a7c40 0x7f08e80c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.055+0000 7f08ee40d700 1 -- 172.21.15.78:0/3593909038 >> 172.21.15.78:0/3593909038 conn(0x7f08e8094510 msgr2=0x7f08e806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:51.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.055+0000 7f08ee40d700 1 -- 172.21.15.78:0/3593909038 shutdown_connections 2023-08-17T17:46:51.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.055+0000 7f08ee40d700 1 -- 172.21.15.78:0/3593909038 wait complete. 2023-08-17T17:46:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.056+0000 7f08ee40d700 1 Processor -- start 2023-08-17T17:46:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.056+0000 7f08ee40d700 1 -- start start 2023-08-17T17:46:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ee40d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08e80a7c40 0x7f08e80aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ee40d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08e80a8080 0x7f08e80b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ee40d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 0x7f08e80ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ee40d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80abc10 con 0x7f08e8154140 2023-08-17T17:46:51.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ee40d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80ab000 con 0x7f08e80a7c40 2023-08-17T17:46:51.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ee40d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80ab2e0 con 0x7f08e80a8080 2023-08-17T17:46:51.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ec9aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 0x7f08e80ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ec9aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 0x7f08e80ac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36800/0 (socket says 172.21.15.78:36800) 2023-08-17T17:46:51.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ec9aa700 1 -- 172.21.15.78:0/3057477263 learned_addr learned my addr 172.21.15.78:0/3057477263 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:51.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ec9aa700 1 -- 172.21.15.78:0/3057477263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08e80a8080 msgr2=0x7f08e80b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ec9aa700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08e80a8080 0x7f08e80b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:51.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ec9aa700 1 -- 172.21.15.78:0/3057477263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08e80a7c40 msgr2=0x7f08e80aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08e7fff700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08e80a7c40 0x7f08e80aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ec9aa700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08e80a7c40 0x7f08e80aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ec9aa700 1 -- 172.21.15.78:0/3057477263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80092a0 con 0x7f08e8154140 2023-08-17T17:46:51.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ec9aa700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 0x7f08e80ac0a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f08e000c7e0 tx=0x7f08e00014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08cffff700 1 -- 172.21.15.78:0/3057477263 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0005d30 con 0x7f08e8154140 2023-08-17T17:46:51.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08cffff700 1 -- 172.21.15.78:0/3057477263 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e0005e90 con 0x7f08e8154140 2023-08-17T17:46:51.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ee40d700 1 -- 172.21.15.78:0/3057477263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e80ab5c0 con 0x7f08e8154140 2023-08-17T17:46:51.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08cffff700 1 -- 172.21.15.78:0/3057477263 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0007320 con 0x7f08e8154140 2023-08-17T17:46:51.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.057+0000 7f08ee40d700 1 -- 172.21.15.78:0/3057477263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e80ac590 con 0x7f08e8154140 2023-08-17T17:46:51.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.058+0000 7f08ee40d700 1 -- 172.21.15.78:0/3057477263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e8047350 con 0x7f08e8154140 2023-08-17T17:46:51.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.059+0000 7f08cffff700 1 -- 172.21.15.78:0/3057477263 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f08e0010030 con 0x7f08e8154140 2023-08-17T17:46:51.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.059+0000 7f08cffff700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08d405ed90 0x7f08d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.059+0000 7f08cffff700 1 -- 172.21.15.78:0/3057477263 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f08e0079610 con 0x7f08e8154140 2023-08-17T17:46:51.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.059+0000 7f08e7fff700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08d405ed90 0x7f08d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.059+0000 7f08e7fff700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08d405ed90 0x7f08d4061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f08d800b340 tx=0x7f08d8017000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.063+0000 7f08cffff700 1 -- 172.21.15.78:0/3057477263 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f08e004af00 con 0x7f08e8154140 2023-08-17T17:46:51.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.228+0000 7f08ee40d700 1 -- 172.21.15.78:0/3057477263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e80abd50 con 0x7f08e8154140 2023-08-17T17:46:51.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.229+0000 7f08cffff700 1 -- 172.21.15.78:0/3057477263 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+13760 (secure 0 0 0) 0x7f08e004e520 con 0x7f08e8154140 2023-08-17T17:46:51.230 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:51.231 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":56,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:46:50.538402+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:46:51.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 -- 172.21.15.78:0/3057477263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08d405ed90 msgr2=0x7f08d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08d405ed90 0x7f08d4061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f08d800b340 tx=0x7f08d8017000).stop 2023-08-17T17:46:51.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 -- 172.21.15.78:0/3057477263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 msgr2=0x7f08e80ac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 0x7f08e80ac0a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f08e000c7e0 tx=0x7f08e00014a0).stop 2023-08-17T17:46:51.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 -- 172.21.15.78:0/3057477263 shutdown_connections 2023-08-17T17:46:51.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f08d405ed90 0x7f08d4061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08e8154140 0x7f08e80ac0a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08e80a7c40 0x7f08e80aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 --2- 172.21.15.78:0/3057477263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08e80a8080 0x7f08e80b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:51.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 -- 172.21.15.78:0/3057477263 >> 172.21.15.78:0/3057477263 conn(0x7f08e8094510 msgr2=0x7f08e80c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:51.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 -- 172.21.15.78:0/3057477263 shutdown_connections 2023-08-17T17:46:51.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.231+0000 7f08ee40d700 1 -- 172.21.15.78:0/3057477263 wait complete. 2023-08-17T17:46:51.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T17:46:51.245 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:46:51.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.359+0000 7f8681165700 1 Processor -- start 2023-08-17T17:46:51.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.359+0000 7f8681165700 1 -- start start 2023-08-17T17:46:51.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.360+0000 7f8681165700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f867c1578f0 0x7f867c0be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.360+0000 7f8681165700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0bf0e0 0x7f867c095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.360+0000 7f8681165700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c0967b0 con 0x7f867c096300 2023-08-17T17:46:51.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.360+0000 7f8681165700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c0bf5c0 con 0x7f867c1578f0 2023-08-17T17:46:51.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.360+0000 7f8681165700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c32d0 con 0x7f867c0bf0e0 2023-08-17T17:46:51.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.360+0000 7f867b59e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f867c096300 0x7f867c064330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49930/0 (socket says 172.21.15.78:49930) 2023-08-17T17:46:51.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867b59e700 1 -- 172.21.15.78:0/88902546 learned_addr learned my addr 172.21.15.78:0/88902546 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:51.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905407161 0 0) 0x7f8674001490 con 0x7f867c096300 2023-08-17T17:46:51.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867ad9d700 1 --2- 172.21.15.78:0/88902546 >> v2:172.21.15.150:3300/0 conn(0x7f867c1578f0 0x7f867c0be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867259c700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0bf0e0 0x7f867c095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86680033f0 con 0x7f867c096300 2023-08-17T17:46:51.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 596881045 0 0) 0x7f86680033f0 con 0x7f867c096300 2023-08-17T17:46:51.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0bf0e0 msgr2=0x7f867c095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:51.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0bf0e0 0x7f867c095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 >> v2:172.21.15.150:3300/0 conn(0x7f867c1578f0 msgr2=0x7f867c0be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 --2- 172.21.15.78:0/88902546 >> v2:172.21.15.150:3300/0 conn(0x7f867c1578f0 0x7f867c0be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c0c3e10 con 0x7f867c096300 2023-08-17T17:46:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f8674001980 con 0x7f867c096300 2023-08-17T17:46:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 >> v1:172.21.15.78:6789/0 conn(0x7f867c096300 legacy=0x7f867c064330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86680038e0 0x7f8668003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0bf0e0 0x7f8668004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 0x7f8668005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0bf5c0 con 0x7f8668004b80 2023-08-17T17:46:51.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c32d0 con 0x7f86680038e0 2023-08-17T17:46:51.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866800b8e0 con 0x7f867c0bf0e0 2023-08-17T17:46:51.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867b59e700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 0x7f8668005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867ad9d700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86680038e0 0x7f8668003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867259c700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0bf0e0 0x7f8668004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867b59e700 1 -- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0bf0e0 msgr2=0x7f8668004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:51.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867b59e700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0bf0e0 0x7f8668004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867b59e700 1 -- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86680038e0 msgr2=0x7f8668003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:51.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867b59e700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86680038e0 0x7f8668003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.361+0000 7f867b59e700 1 -- 172.21.15.78:0/88902546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86680033f0 con 0x7f8668004b80 2023-08-17T17:46:51.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f867ad9d700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86680038e0 0x7f8668003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:51.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f867b59e700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 0x7f8668005000 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f867400c6d0 tx=0x7f8674007c80).ready entity=mon.0 client_cookie=412e368efd483bcb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674005b20 con 0x7f8668004b80 2023-08-17T17:46:51.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674005c80 con 0x7f8668004b80 2023-08-17T17:46:51.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f867a59c700 1 -- 172.21.15.78:0/88902546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674007110 con 0x7f8668004b80 2023-08-17T17:46:51.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f8681165700 1 -- 172.21.15.78:0/88902546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 msgr2=0x7f8668005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f8681165700 1 --2- 172.21.15.78:0/88902546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 0x7f8668005000 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f867400c6d0 tx=0x7f8674007c80).stop 2023-08-17T17:46:51.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f867b59e700 1 -- 172.21.15.78:0/88902546 reap_dead start 2023-08-17T17:46:51.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f8681165700 1 -- 172.21.15.78:0/88902546 shutdown_connections 2023-08-17T17:46:51.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f8681165700 1 -- 172.21.15.78:0/88902546 >> 172.21.15.78:0/88902546 conn(0x7f867c062f80 msgr2=0x7f867c0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:51.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f8681165700 1 -- 172.21.15.78:0/88902546 shutdown_connections 2023-08-17T17:46:51.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.362+0000 7f8681165700 1 -- 172.21.15.78:0/88902546 wait complete. 2023-08-17T17:46:51.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.363+0000 7f8681165700 1 Processor -- start 2023-08-17T17:46:51.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.364+0000 7f8681165700 1 -- start start 2023-08-17T17:46:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.364+0000 7f8681165700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 0x7f867c14f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.364+0000 7f8681165700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f867c0ade60 0x7f867c1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.364+0000 7f8681165700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0ae2e0 0x7f867c158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.364+0000 7f8681165700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c158b80 con 0x7f8668004b80 2023-08-17T17:46:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.364+0000 7f8681165700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0bfd70 con 0x7f867c0ade60 2023-08-17T17:46:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.364+0000 7f8681165700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0a9390 con 0x7f867c0ae2e0 2023-08-17T17:46:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.364+0000 7f867ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 0x7f867c14f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.364+0000 7f867ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 0x7f867c14f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36818/0 (socket says 172.21.15.78:36818) 2023-08-17T17:46:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.364+0000 7f867ad9d700 1 -- 172.21.15.78:0/2488253750 learned_addr learned my addr 172.21.15.78:0/2488253750 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f867259c700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f867c0ade60 0x7f867c1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f867b59e700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0ae2e0 0x7f867c158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f867ad9d700 1 -- 172.21.15.78:0/2488253750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0ae2e0 msgr2=0x7f867c158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f867ad9d700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0ae2e0 0x7f867c158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f867ad9d700 1 -- 172.21.15.78:0/2488253750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f867c0ade60 msgr2=0x7f867c1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f867ad9d700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f867c0ade60 0x7f867c1581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f867ad9d700 1 -- 172.21.15.78:0/2488253750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c0a9670 con 0x7f8668004b80 2023-08-17T17:46:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f867ad9d700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 0x7f867c14f9d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f866c011690 tx=0x7f866c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f86737fe700 1 -- 172.21.15.78:0/2488253750 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c013620 con 0x7f8668004b80 2023-08-17T17:46:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f86737fe700 1 -- 172.21.15.78:0/2488253750 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c013780 con 0x7f8668004b80 2023-08-17T17:46:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f86737fe700 1 -- 172.21.15.78:0/2488253750 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c013b00 con 0x7f8668004b80 2023-08-17T17:46:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f8681165700 1 -- 172.21.15.78:0/2488253750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c0a9950 con 0x7f8668004b80 2023-08-17T17:46:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.365+0000 7f8681165700 1 -- 172.21.15.78:0/2488253750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c0a9f10 con 0x7f8668004b80 2023-08-17T17:46:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.366+0000 7f8681165700 1 -- 172.21.15.78:0/2488253750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c0695e0 con 0x7f8668004b80 2023-08-17T17:46:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.366+0000 7f86737fe700 1 -- 172.21.15.78:0/2488253750 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f866c012040 con 0x7f8668004b80 2023-08-17T17:46:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.367+0000 7f86737fe700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f865c05ed90 0x7f865c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.367+0000 7f86737fe700 1 -- 172.21.15.78:0/2488253750 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f866c079d80 con 0x7f8668004b80 2023-08-17T17:46:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.367+0000 7f867259c700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f865c05ed90 0x7f865c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.367+0000 7f867259c700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f865c05ed90 0x7f865c061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8664006d50 tx=0x7f8664008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.371+0000 7f86737fe700 1 -- 172.21.15.78:0/2488253750 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f866c04b670 con 0x7f8668004b80 2023-08-17T17:46:51.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.535+0000 7f8681165700 1 -- 172.21.15.78:0/2488253750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f867c046af0 con 0x7f8668004b80 2023-08-17T17:46:51.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.535+0000 7f86737fe700 1 -- 172.21.15.78:0/2488253750 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v56) v1 ==== 110+0+10 (secure 0 0 0) 0x7f867c046af0 con 0x7f8668004b80 2023-08-17T17:46:51.537 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:46:51.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 -- 172.21.15.78:0/2488253750 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f865c05ed90 msgr2=0x7f865c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f865c05ed90 0x7f865c061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8664006d50 tx=0x7f8664008040).stop 2023-08-17T17:46:51.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 -- 172.21.15.78:0/2488253750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 msgr2=0x7f867c14f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 0x7f867c14f9d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f866c011690 tx=0x7f866c008040).stop 2023-08-17T17:46:51.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 -- 172.21.15.78:0/2488253750 shutdown_connections 2023-08-17T17:46:51.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f865c05ed90 0x7f865c061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f867c0ae2e0 0x7f867c158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668004b80 0x7f867c14f9d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 --2- 172.21.15.78:0/2488253750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f867c0ade60 0x7f867c1581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 -- 172.21.15.78:0/2488253750 >> 172.21.15.78:0/2488253750 conn(0x7f867c062f80 msgr2=0x7f867c0a7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:51.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 -- 172.21.15.78:0/2488253750 shutdown_connections 2023-08-17T17:46:51.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.537+0000 7f8681165700 1 -- 172.21.15.78:0/2488253750 wait complete. 2023-08-17T17:46:51.551 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:46:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.665+0000 7fe696d5a700 1 Processor -- start 2023-08-17T17:46:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.665+0000 7fe696d5a700 1 -- start start 2023-08-17T17:46:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe696d5a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe6901542a0 0x7fe6900c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe696d5a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe6900c7f60 0x7fe69015dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe696d5a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6900c6310 con 0x7fe690153ec0 2023-08-17T17:46:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe696d5a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6900c5d90 con 0x7fe6901542a0 2023-08-17T17:46:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe696d5a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6900c9a20 con 0x7fe6900c7f60 2023-08-17T17:46:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe687fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe6901542a0 0x7fe6900c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe694af6700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe690153ec0 0x7fe6900c7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49942/0 (socket says 172.21.15.78:49942) 2023-08-17T17:46:51.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe694af6700 1 -- 172.21.15.78:0/3753536509 learned_addr learned my addr 172.21.15.78:0/3753536509 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:51.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe6952f7700 1 --2- 172.21.15.78:0/3753536509 >> v2:172.21.15.150:3300/0 conn(0x7fe6900c7f60 0x7fe69015dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe687fff700 1 -- 172.21.15.78:0/3753536509 >> v2:172.21.15.150:3300/0 conn(0x7fe6900c7f60 msgr2=0x7fe69015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:51.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe687fff700 1 --2- 172.21.15.78:0/3753536509 >> v2:172.21.15.150:3300/0 conn(0x7fe6900c7f60 0x7fe69015dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe687fff700 1 -- 172.21.15.78:0/3753536509 >> v1:172.21.15.78:6789/0 conn(0x7fe690153ec0 legacy=0x7fe6900c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe687fff700 1 -- 172.21.15.78:0/3753536509 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900c9c40 con 0x7fe6901542a0 2023-08-17T17:46:51.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.666+0000 7fe6877fe700 1 -- 172.21.15.78:0/3753536509 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104312178 0 0) 0x7fe6900c6310 con 0x7fe690153ec0 2023-08-17T17:46:51.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe687fff700 1 --2- 172.21.15.78:0/3753536509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 0x7fe6900c9530 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fe6900c53d0 tx=0x7fe680009060).ready entity=mon.0 client_cookie=f108098dc93a366c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe6877fe700 1 -- 172.21.15.78:0/3753536509 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68000b580 con 0x7fe6901542a0 2023-08-17T17:46:51.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe6877fe700 1 -- 172.21.15.78:0/3753536509 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68000b6e0 con 0x7fe6901542a0 2023-08-17T17:46:51.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe6877fe700 1 -- 172.21.15.78:0/3753536509 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68000ba60 con 0x7fe6901542a0 2023-08-17T17:46:51.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe696d5a700 1 -- 172.21.15.78:0/3753536509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 msgr2=0x7fe6900c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe696d5a700 1 --2- 172.21.15.78:0/3753536509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 0x7fe6900c9530 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fe6900c53d0 tx=0x7fe680009060).stop 2023-08-17T17:46:51.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe696d5a700 1 -- 172.21.15.78:0/3753536509 shutdown_connections 2023-08-17T17:46:51.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe696d5a700 1 --2- 172.21.15.78:0/3753536509 >> v2:172.21.15.150:3300/0 conn(0x7fe6900c7f60 0x7fe69015dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe696d5a700 1 --2- 172.21.15.78:0/3753536509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 0x7fe6900c9530 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe696d5a700 1 -- 172.21.15.78:0/3753536509 >> 172.21.15.78:0/3753536509 conn(0x7fe690084bb0 msgr2=0x7fe6900944d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:51.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe696d5a700 1 -- 172.21.15.78:0/3753536509 shutdown_connections 2023-08-17T17:46:51.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.667+0000 7fe696d5a700 1 -- 172.21.15.78:0/3753536509 wait complete. 2023-08-17T17:46:51.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.668+0000 7fe696d5a700 1 Processor -- start 2023-08-17T17:46:51.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe696d5a700 1 -- start start 2023-08-17T17:46:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe696d5a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6900c7f60 0x7fe69014f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe696d5a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe690153ec0 0x7fe6900af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe696d5a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 0x7fe6900af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe696d5a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900afaf0 con 0x7fe6901542a0 2023-08-17T17:46:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe696d5a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900afcd0 con 0x7fe6900c7f60 2023-08-17T17:46:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe696d5a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900affb0 con 0x7fe690153ec0 2023-08-17T17:46:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe6952f7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 0x7fe6900af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe6952f7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 0x7fe6900af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36844/0 (socket says 172.21.15.78:36844) 2023-08-17T17:46:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe6952f7700 1 -- 172.21.15.78:0/2023158727 learned_addr learned my addr 172.21.15.78:0/2023158727 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe694af6700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6900c7f60 0x7fe69014f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.669+0000 7fe687fff700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe690153ec0 0x7fe6900af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe6952f7700 1 -- 172.21.15.78:0/2023158727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe690153ec0 msgr2=0x7fe6900af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe6952f7700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe690153ec0 0x7fe6900af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe6952f7700 1 -- 172.21.15.78:0/2023158727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6900c7f60 msgr2=0x7fe69014f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe6952f7700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6900c7f60 0x7fe69014f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe6952f7700 1 -- 172.21.15.78:0/2023158727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6800092a0 con 0x7fe6901542a0 2023-08-17T17:46:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe694af6700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6900c7f60 0x7fe69014f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe687fff700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe690153ec0 0x7fe6900af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe6952f7700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 0x7fe6900af600 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fe688006980 tx=0x7fe688008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe684ff9700 1 -- 172.21.15.78:0/2023158727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688011590 con 0x7fe6901542a0 2023-08-17T17:46:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe684ff9700 1 -- 172.21.15.78:0/2023158727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6880116f0 con 0x7fe6901542a0 2023-08-17T17:46:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe684ff9700 1 -- 172.21.15.78:0/2023158727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688011a70 con 0x7fe6901542a0 2023-08-17T17:46:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe696d5a700 1 -- 172.21.15.78:0/2023158727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6900b0290 con 0x7fe6901542a0 2023-08-17T17:46:51.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.670+0000 7fe696d5a700 1 -- 172.21.15.78:0/2023158727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6900b08d0 con 0x7fe6901542a0 2023-08-17T17:46:51.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.671+0000 7fe696d5a700 1 -- 172.21.15.78:0/2023158727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe690065310 con 0x7fe6901542a0 2023-08-17T17:46:51.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.671+0000 7fe684ff9700 1 -- 172.21.15.78:0/2023158727 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe68801c460 con 0x7fe6901542a0 2023-08-17T17:46:51.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.671+0000 7fe684ff9700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe67c05ed90 0x7fe67c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.672+0000 7fe684ff9700 1 -- 172.21.15.78:0/2023158727 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe688079720 con 0x7fe6901542a0 2023-08-17T17:46:51.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.672+0000 7fe694af6700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe67c05ed90 0x7fe67c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.672+0000 7fe694af6700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe67c05ed90 0x7fe67c061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe68c0016e0 tx=0x7fe68c009040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.676+0000 7fe684ff9700 1 -- 172.21.15.78:0/2023158727 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe68804afb0 con 0x7fe6901542a0 2023-08-17T17:46:51.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.835+0000 7fe696d5a700 1 -- 172.21.15.78:0/2023158727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe6900a9960 con 0x7fe6901542a0 2023-08-17T17:46:51.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.836+0000 7fe684ff9700 1 -- 172.21.15.78:0/2023158727 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe68804e5d0 con 0x7fe6901542a0 2023-08-17T17:46:51.837 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:46:51.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 -- 172.21.15.78:0/2023158727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe67c05ed90 msgr2=0x7fe67c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe67c05ed90 0x7fe67c061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe68c0016e0 tx=0x7fe68c009040).stop 2023-08-17T17:46:51.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 -- 172.21.15.78:0/2023158727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 msgr2=0x7fe6900af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 0x7fe6900af600 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fe688006980 tx=0x7fe688008040).stop 2023-08-17T17:46:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 -- 172.21.15.78:0/2023158727 shutdown_connections 2023-08-17T17:46:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe67c05ed90 0x7fe67c061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6901542a0 0x7fe6900af600 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6900c7f60 0x7fe69014f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 --2- 172.21.15.78:0/2023158727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe690153ec0 0x7fe6900af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 -- 172.21.15.78:0/2023158727 >> 172.21.15.78:0/2023158727 conn(0x7fe690084bb0 msgr2=0x7fe690064860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 -- 172.21.15.78:0/2023158727 shutdown_connections 2023-08-17T17:46:51.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.838+0000 7fe696d5a700 1 -- 172.21.15.78:0/2023158727 wait complete. 2023-08-17T17:46:51.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T17:46:51.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.962+0000 7f4f7cdf6700 1 Processor -- start 2023-08-17T17:46:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.962+0000 7f4f7cdf6700 1 -- start start 2023-08-17T17:46:51.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.963+0000 7f4f7cdf6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4f780c6ee0 0x7f4f780c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.963+0000 7f4f7cdf6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f780c7350 con 0x7f4f780c0df0 2023-08-17T17:46:51.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.963+0000 7f4f7cdf6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f780a8350 con 0x7f4f78154140 2023-08-17T17:46:51.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.963+0000 7f4f7cdf6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f780c1240 con 0x7f4f780c6ee0 2023-08-17T17:46:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.963+0000 7f4f6dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4f780c6ee0 0x7f4f780c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.963+0000 7f4f76d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4f780c0df0 0x7f4f780ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49952/0 (socket says 172.21.15.78:49952) 2023-08-17T17:46:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.963+0000 7f4f76d9d700 1 -- 172.21.15.78:0/1014134115 learned_addr learned my addr 172.21.15.78:0/1014134115 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f6dd9b700 1 -- 172.21.15.78:0/1014134115 >> v1:172.21.15.150:6789/0 conn(0x7f4f78154140 legacy=0x7f4f780a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f6dd9b700 1 -- 172.21.15.78:0/1014134115 >> v1:172.21.15.78:6789/0 conn(0x7f4f780c0df0 legacy=0x7f4f780ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f75d9b700 1 -- 172.21.15.78:0/1014134115 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826976753 0 0) 0x7f4f780c7350 con 0x7f4f780c0df0 2023-08-17T17:46:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f6dd9b700 1 -- 172.21.15.78:0/1014134115 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78154520 con 0x7f4f780c6ee0 2023-08-17T17:46:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f6dd9b700 1 --2- 172.21.15.78:0/1014134115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c6ee0 0x7f4f780c0900 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f4f60009760 tx=0x7f4f60009060).ready entity=mon.0 client_cookie=8e483dc0187fc5e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f75d9b700 1 -- 172.21.15.78:0/1014134115 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6000b520 con 0x7f4f780c6ee0 2023-08-17T17:46:51.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f75d9b700 1 -- 172.21.15.78:0/1014134115 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6000b680 con 0x7f4f780c6ee0 2023-08-17T17:46:51.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f75d9b700 1 -- 172.21.15.78:0/1014134115 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6000ba00 con 0x7f4f780c6ee0 2023-08-17T17:46:51.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/1014134115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c6ee0 msgr2=0x7f4f780c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f7cdf6700 1 --2- 172.21.15.78:0/1014134115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c6ee0 0x7f4f780c0900 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f4f60009760 tx=0x7f4f60009060).stop 2023-08-17T17:46:51.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/1014134115 shutdown_connections 2023-08-17T17:46:51.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f7cdf6700 1 --2- 172.21.15.78:0/1014134115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c6ee0 0x7f4f780c0900 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/1014134115 >> 172.21.15.78:0/1014134115 conn(0x7f4f78094510 msgr2=0x7f4f7806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/1014134115 shutdown_connections 2023-08-17T17:46:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.964+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/1014134115 wait complete. 2023-08-17T17:46:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7cdf6700 1 Processor -- start 2023-08-17T17:46:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7cdf6700 1 -- start start 2023-08-17T17:46:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7cdf6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c0df0 0x7f4f7814df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7cdf6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f780c6ee0 0x7f4f78155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7cdf6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f78154140 0x7f4f781550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7cdf6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78155cf0 con 0x7f4f780c0df0 2023-08-17T17:46:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7cdf6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780ade40 con 0x7f4f780c6ee0 2023-08-17T17:46:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7cdf6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f781555d0 con 0x7f4f78154140 2023-08-17T17:46:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c0df0 0x7f4f7814df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c0df0 0x7f4f7814df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36860/0 (socket says 172.21.15.78:36860) 2023-08-17T17:46:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.966+0000 7f4f7659c700 1 -- 172.21.15.78:0/2437555802 learned_addr learned my addr 172.21.15.78:0/2437555802 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f6dd9b700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f780c6ee0 0x7f4f78155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f76d9d700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f78154140 0x7f4f781550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f7659c700 1 -- 172.21.15.78:0/2437555802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f78154140 msgr2=0x7f4f781550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f7659c700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f78154140 0x7f4f781550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f7659c700 1 -- 172.21.15.78:0/2437555802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f780c6ee0 msgr2=0x7f4f78155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f7659c700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f780c6ee0 0x7f4f78155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f7659c700 1 -- 172.21.15.78:0/2437555802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f600092a0 con 0x7f4f780c0df0 2023-08-17T17:46:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f6dd9b700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f780c6ee0 0x7f4f78155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f7659c700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c0df0 0x7f4f7814df60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f4f6800b490 tx=0x7f4f68006f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f6effd700 1 -- 172.21.15.78:0/2437555802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68002320 con 0x7f4f780c0df0 2023-08-17T17:46:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f6effd700 1 -- 172.21.15.78:0/2437555802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f680024c0 con 0x7f4f780c0df0 2023-08-17T17:46:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f6effd700 1 -- 172.21.15.78:0/2437555802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68002880 con 0x7f4f780c0df0 2023-08-17T17:46:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/2437555802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f78155ee0 con 0x7f4f780c0df0 2023-08-17T17:46:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.967+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/2437555802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f781564a0 con 0x7f4f780c0df0 2023-08-17T17:46:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.968+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/2437555802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f78047350 con 0x7f4f780c0df0 2023-08-17T17:46:51.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.968+0000 7f4f6effd700 1 -- 172.21.15.78:0/2437555802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4f6800f030 con 0x7f4f780c0df0 2023-08-17T17:46:51.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.969+0000 7f4f6effd700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f5805ed90 0x7f4f58061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:51.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.969+0000 7f4f6effd700 1 -- 172.21.15.78:0/2437555802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4f680794f0 con 0x7f4f780c0df0 2023-08-17T17:46:51.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.969+0000 7f4f6dd9b700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f5805ed90 0x7f4f58061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:51.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.969+0000 7f4f6dd9b700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f5805ed90 0x7f4f58061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4f78153b80 tx=0x7f4f60017000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:51.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:51.973+0000 7f4f6effd700 1 -- 172.21.15.78:0/2437555802 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f6804ade0 con 0x7f4f780c0df0 2023-08-17T17:46:52.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.138+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/2437555802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4f780c91e0 con 0x7f4f780c0df0 2023-08-17T17:46:52.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.139+0000 7f4f6effd700 1 -- 172.21.15.78:0/2437555802 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) v1 ==== 84+0+143 (secure 0 0 0) 0x7f4f6804e400 con 0x7f4f780c0df0 2023-08-17T17:46:52.140 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:52.140 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:46:52.140 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:52.140 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T17:46:52.141 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T17:46:52.141 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:46:52.141 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:46:52.141 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T17:46:52.141 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T17:46:52.141 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:46:52.141 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:46:52.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.140+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/2437555802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f5805ed90 msgr2=0x7f4f58061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f5805ed90 0x7f4f58061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4f78153b80 tx=0x7f4f60017000).stop 2023-08-17T17:46:52.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/2437555802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c0df0 msgr2=0x7f4f7814df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c0df0 0x7f4f7814df60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f4f6800b490 tx=0x7f4f68006f00).stop 2023-08-17T17:46:52.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/2437555802 shutdown_connections 2023-08-17T17:46:52.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4f5805ed90 0x7f4f58061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f78154140 0x7f4f781550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f780c0df0 0x7f4f7814df60 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 --2- 172.21.15.78:0/2437555802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f780c6ee0 0x7f4f78155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/2437555802 >> 172.21.15.78:0/2437555802 conn(0x7f4f78094510 msgr2=0x7f4f780a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:52.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/2437555802 shutdown_connections 2023-08-17T17:46:52.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.141+0000 7f4f7cdf6700 1 -- 172.21.15.78:0/2437555802 wait complete. 2023-08-17T17:46:52.153 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T17:46:52.154 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T17:46:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.270+0000 7ff565847700 1 Processor -- start 2023-08-17T17:46:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.270+0000 7ff565847700 1 -- start start 2023-08-17T17:46:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff565847700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff560153ec0 0x7ff5600c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff565847700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5601542a0 0x7ff5600c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff565847700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5600c6310 con 0x7ff5600a7b90 2023-08-17T17:46:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff565847700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5600c5d90 con 0x7ff5601542a0 2023-08-17T17:46:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff565847700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600c9a20 con 0x7ff560153ec0 2023-08-17T17:46:52.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff5567fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5601542a0 0x7ff5600c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff55f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff5600a7b90 0x7ff5600c67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49962/0 (socket says 172.21.15.78:49962) 2023-08-17T17:46:52.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff55f7fe700 1 -- 172.21.15.78:0/1504634496 learned_addr learned my addr 172.21.15.78:0/1504634496 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:52.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff55effd700 1 --2- 172.21.15.78:0/1504634496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff560153ec0 0x7ff5600c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff55e7fc700 1 -- 172.21.15.78:0/1504634496 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388133496 0 0) 0x7ff5600c6310 con 0x7ff5600a7b90 2023-08-17T17:46:52.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff55e7fc700 1 -- 172.21.15.78:0/1504634496 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff54c0033f0 con 0x7ff5600a7b90 2023-08-17T17:46:52.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff5567fc700 1 -- 172.21.15.78:0/1504634496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff560153ec0 msgr2=0x7ff5600c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:52.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.271+0000 7ff5567fc700 1 --2- 172.21.15.78:0/1504634496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff560153ec0 0x7ff5600c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff5567fc700 1 -- 172.21.15.78:0/1504634496 >> v1:172.21.15.78:6789/0 conn(0x7ff5600a7b90 legacy=0x7ff5600c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff5567fc700 1 -- 172.21.15.78:0/1504634496 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5600c9c40 con 0x7ff5601542a0 2023-08-17T17:46:52.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff5567fc700 1 --2- 172.21.15.78:0/1504634496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 0x7ff5600c7850 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7ff548009760 tx=0x7ff548009060).ready entity=mon.0 client_cookie=b53e539cc8d0497c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:52.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff55e7fc700 1 -- 172.21.15.78:0/1504634496 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54800d4a0 con 0x7ff5601542a0 2023-08-17T17:46:52.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff55e7fc700 1 -- 172.21.15.78:0/1504634496 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54800d600 con 0x7ff5601542a0 2023-08-17T17:46:52.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff55e7fc700 1 -- 172.21.15.78:0/1504634496 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54800d980 con 0x7ff5601542a0 2023-08-17T17:46:52.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff565847700 1 -- 172.21.15.78:0/1504634496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 msgr2=0x7ff5600c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff565847700 1 --2- 172.21.15.78:0/1504634496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 0x7ff5600c7850 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7ff548009760 tx=0x7ff548009060).stop 2023-08-17T17:46:52.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff565847700 1 -- 172.21.15.78:0/1504634496 shutdown_connections 2023-08-17T17:46:52.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff565847700 1 --2- 172.21.15.78:0/1504634496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff560153ec0 0x7ff5600c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff565847700 1 --2- 172.21.15.78:0/1504634496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 0x7ff5600c7850 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff565847700 1 -- 172.21.15.78:0/1504634496 >> 172.21.15.78:0/1504634496 conn(0x7ff560084bb0 msgr2=0x7ff5600944d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:52.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff565847700 1 -- 172.21.15.78:0/1504634496 shutdown_connections 2023-08-17T17:46:52.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.272+0000 7ff565847700 1 -- 172.21.15.78:0/1504634496 wait complete. 2023-08-17T17:46:52.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.274+0000 7ff565847700 1 Processor -- start 2023-08-17T17:46:52.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.274+0000 7ff565847700 1 -- start start 2023-08-17T17:46:52.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.274+0000 7ff565847700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600a7b90 0x7ff56014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.274+0000 7ff565847700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff560153ec0 0x7ff5600b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.274+0000 7ff565847700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 0x7ff5600b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.274+0000 7ff565847700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600c25f0 con 0x7ff5601542a0 2023-08-17T17:46:52.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.274+0000 7ff565847700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600aec80 con 0x7ff5600a7b90 2023-08-17T17:46:52.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.274+0000 7ff565847700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5601574f0 con 0x7ff560153ec0 2023-08-17T17:46:52.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.274+0000 7ff55f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 0x7ff5600b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.274+0000 7ff55f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 0x7ff5600b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36880/0 (socket says 172.21.15.78:36880) 2023-08-17T17:46:52.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff55f7fe700 1 -- 172.21.15.78:0/2964034489 learned_addr learned my addr 172.21.15.78:0/2964034489 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:52.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff55effd700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600a7b90 0x7ff56014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff55f7fe700 1 -- 172.21.15.78:0/2964034489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff560153ec0 msgr2=0x7ff5600b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff5567fc700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff560153ec0 0x7ff5600b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff55f7fe700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff560153ec0 0x7ff5600b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff55f7fe700 1 -- 172.21.15.78:0/2964034489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600a7b90 msgr2=0x7ff56014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff55f7fe700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600a7b90 0x7ff56014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff55f7fe700 1 -- 172.21.15.78:0/2964034489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480092a0 con 0x7ff5601542a0 2023-08-17T17:46:52.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff55effd700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600a7b90 0x7ff56014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:52.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff55f7fe700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 0x7ff5600b07c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7ff55800c790 tx=0x7ff558007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:52.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff5577fe700 1 -- 172.21.15.78:0/2964034489 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558005d30 con 0x7ff5601542a0 2023-08-17T17:46:52.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff5577fe700 1 -- 172.21.15.78:0/2964034489 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558005e90 con 0x7ff5601542a0 2023-08-17T17:46:52.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff5577fe700 1 -- 172.21.15.78:0/2964034489 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558007320 con 0x7ff5601542a0 2023-08-17T17:46:52.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff565847700 1 -- 172.21.15.78:0/2964034489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5601577d0 con 0x7ff5601542a0 2023-08-17T17:46:52.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.275+0000 7ff565847700 1 -- 172.21.15.78:0/2964034489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5600b0cb0 con 0x7ff5601542a0 2023-08-17T17:46:52.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.276+0000 7ff565847700 1 -- 172.21.15.78:0/2964034489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5600c2760 con 0x7ff5601542a0 2023-08-17T17:46:52.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.276+0000 7ff5577fe700 1 -- 172.21.15.78:0/2964034489 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff558010030 con 0x7ff5601542a0 2023-08-17T17:46:52.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.277+0000 7ff5577fe700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff54005ed90 0x7ff540061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.277+0000 7ff5577fe700 1 -- 172.21.15.78:0/2964034489 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff558079720 con 0x7ff5601542a0 2023-08-17T17:46:52.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.277+0000 7ff55effd700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff54005ed90 0x7ff540061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.277+0000 7ff55effd700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff54005ed90 0x7ff540061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff550006d20 tx=0x7ff550008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:52.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.281+0000 7ff5577fe700 1 -- 172.21.15.78:0/2964034489 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff55804b010 con 0x7ff5601542a0 2023-08-17T17:46:52.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.443+0000 7ff565847700 1 -- 172.21.15.78:0/2964034489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7ff560046af0 con 0x7ff5601542a0 2023-08-17T17:46:52.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.558+0000 7ff5577fe700 1 -- 172.21.15.78:0/2964034489 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) v1 ==== 152+0+0 (secure 0 0 0) 0x7ff55804e630 con 0x7ff5601542a0 2023-08-17T17:46:52.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.561+0000 7ff565847700 1 -- 172.21.15.78:0/2964034489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff54005ed90 msgr2=0x7ff540061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.561+0000 7ff565847700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff54005ed90 0x7ff540061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff550006d20 tx=0x7ff550008040).stop 2023-08-17T17:46:52.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.561+0000 7ff565847700 1 -- 172.21.15.78:0/2964034489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 msgr2=0x7ff5600b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.561+0000 7ff565847700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 0x7ff5600b07c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7ff55800c790 tx=0x7ff558007f90).stop 2023-08-17T17:46:52.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.561+0000 7ff565847700 1 -- 172.21.15.78:0/2964034489 shutdown_connections 2023-08-17T17:46:52.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.561+0000 7ff565847700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff54005ed90 0x7ff540061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.561+0000 7ff565847700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5601542a0 0x7ff5600b07c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.561+0000 7ff565847700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5600a7b90 0x7ff56014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.561+0000 7ff565847700 1 --2- 172.21.15.78:0/2964034489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff560153ec0 0x7ff5600b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.561+0000 7ff565847700 1 -- 172.21.15.78:0/2964034489 >> 172.21.15.78:0/2964034489 conn(0x7ff560084bb0 msgr2=0x7ff56014f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:52.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.562+0000 7ff565847700 1 -- 172.21.15.78:0/2964034489 shutdown_connections 2023-08-17T17:46:52.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.562+0000 7ff565847700 1 -- 172.21.15.78:0/2964034489 wait complete. 2023-08-17T17:46:52.565 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T17:46:52.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T17:46:52.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.697+0000 7fb9096e5700 1 Processor -- start 2023-08-17T17:46:52.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.697+0000 7fb9096e5700 1 -- start start 2023-08-17T17:46:52.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.698+0000 7fb9096e5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb904154110 0x7fb9040c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.698+0000 7fb9096e5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9040c6970 con 0x7fb9040c7e10 2023-08-17T17:46:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.698+0000 7fb9096e5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9040c1150 con 0x7fb9040c0cf0 2023-08-17T17:46:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.698+0000 7fb9096e5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9040cac90 con 0x7fb904154110 2023-08-17T17:46:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.698+0000 7fb9037fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb9040c7e10 0x7fb90415ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49968/0 (socket says 172.21.15.78:49968) 2023-08-17T17:46:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.698+0000 7fb9037fe700 1 -- 172.21.15.78:0/3925982071 learned_addr learned my addr 172.21.15.78:0/3925982071 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.698+0000 7fb902ffd700 1 --2- 172.21.15.78:0/3925982071 >> v2:172.21.15.150:3300/0 conn(0x7fb904154110 0x7fb9040c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.698+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866327559 0 0) 0x7fb9040c6970 con 0x7fb9040c7e10 2023-08-17T17:46:52.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.698+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f00033f0 con 0x7fb9040c7e10 2023-08-17T17:46:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2986349759 0 0) 0x7fb8f00033f0 con 0x7fb9040c7e10 2023-08-17T17:46:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 >> v2:172.21.15.150:3300/0 conn(0x7fb904154110 msgr2=0x7fb9040c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 --2- 172.21.15.78:0/3925982071 >> v2:172.21.15.150:3300/0 conn(0x7fb904154110 0x7fb9040c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 >> v1:172.21.15.150:6789/0 conn(0x7fb9040c0cf0 legacy=0x7fb9040c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9040c6040 con 0x7fb9040c7e10 2023-08-17T17:46:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fb8fc0017f0 con 0x7fb9040c7e10 2023-08-17T17:46:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 >> v1:172.21.15.78:6789/0 conn(0x7fb9040c7e10 legacy=0x7fb90415ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8f00038e0 0x7fb8f0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8f0004690 0x7fb8f0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8f0005000 0x7fb8f000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9040cac90 con 0x7fb8f0004690 2023-08-17T17:46:52.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f000bf60 con 0x7fb8f00038e0 2023-08-17T17:46:52.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f000c0f0 con 0x7fb8f0005000 2023-08-17T17:46:52.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb8fbfff700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8f0004690 0x7fb8f0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb902ffd700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8f00038e0 0x7fb8f0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9037fe700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8f0005000 0x7fb8f000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb8fbfff700 1 -- 172.21.15.78:0/3925982071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8f0005000 msgr2=0x7fb8f000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:52.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb8fbfff700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8f0005000 0x7fb8f000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb8fbfff700 1 -- 172.21.15.78:0/3925982071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8f00038e0 msgr2=0x7fb8f0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:52.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb8fbfff700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8f00038e0 0x7fb8f0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb8fbfff700 1 -- 172.21.15.78:0/3925982071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f00033f0 con 0x7fb8f0004690 2023-08-17T17:46:52.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9037fe700 1 -- 172.21.15.78:0/3925982071 reap_dead start 2023-08-17T17:46:52.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb8fbfff700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8f0004690 0x7fb8f0004b10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fb8ec001730 tx=0x7fb8ec007bb0).ready entity=mon.0 client_cookie=358fcbcc90db48da server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:52.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec007020 con 0x7fb8f0004690 2023-08-17T17:46:52.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec007180 con 0x7fb8f0004690 2023-08-17T17:46:52.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.699+0000 7fb9027fc700 1 -- 172.21.15.78:0/3925982071 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec007520 con 0x7fb8f0004690 2023-08-17T17:46:52.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.700+0000 7fb9096e5700 1 -- 172.21.15.78:0/3925982071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8f0004690 msgr2=0x7fb8f0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.700+0000 7fb9096e5700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8f0004690 0x7fb8f0004b10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fb8ec001730 tx=0x7fb8ec007bb0).stop 2023-08-17T17:46:52.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.700+0000 7fb9096e5700 1 -- 172.21.15.78:0/3925982071 shutdown_connections 2023-08-17T17:46:52.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.700+0000 7fb9096e5700 1 --2- 172.21.15.78:0/3925982071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8f0004690 0x7fb8f0004b10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.700+0000 7fb9096e5700 1 -- 172.21.15.78:0/3925982071 >> 172.21.15.78:0/3925982071 conn(0x7fb904094650 msgr2=0x7fb90406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:52.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.700+0000 7fb9096e5700 1 -- 172.21.15.78:0/3925982071 shutdown_connections 2023-08-17T17:46:52.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.700+0000 7fb9096e5700 1 -- 172.21.15.78:0/3925982071 wait complete. 2023-08-17T17:46:52.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.701+0000 7fb9096e5700 1 Processor -- start 2023-08-17T17:46:52.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.701+0000 7fb9096e5700 1 -- start start 2023-08-17T17:46:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb9096e5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8f0004690 0x7fb904142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb9096e5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9040c44d0 0x7fb9040c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb9096e5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb90415a380 0x7fb90415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb9096e5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb904151230 con 0x7fb9040c44d0 2023-08-17T17:46:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb9096e5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90415acf0 con 0x7fb8f0004690 2023-08-17T17:46:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb9096e5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb904150620 con 0x7fb90415a380 2023-08-17T17:46:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9040c44d0 0x7fb9040c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9040c44d0 0x7fb9040c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36896/0 (socket says 172.21.15.78:36896) 2023-08-17T17:46:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8fbfff700 1 -- 172.21.15.78:0/764072506 learned_addr learned my addr 172.21.15.78:0/764072506 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb902ffd700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8f0004690 0x7fb904142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb9037fe700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb90415a380 0x7fb90415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8fbfff700 1 -- 172.21.15.78:0/764072506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb90415a380 msgr2=0x7fb90415a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8fbfff700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb90415a380 0x7fb90415a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8fbfff700 1 -- 172.21.15.78:0/764072506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8f0004690 msgr2=0x7fb904142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8fbfff700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8f0004690 0x7fb904142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8fbfff700 1 -- 172.21.15.78:0/764072506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb904150900 con 0x7fb9040c44d0 2023-08-17T17:46:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb9037fe700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb90415a380 0x7fb90415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8fbfff700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9040c44d0 0x7fb9040c4950 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fb8ec001d20 tx=0x7fb8ec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8faffd700 1 -- 172.21.15.78:0/764072506 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec013460 con 0x7fb9040c44d0 2023-08-17T17:46:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb8faffd700 1 -- 172.21.15.78:0/764072506 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec0135c0 con 0x7fb9040c44d0 2023-08-17T17:46:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.702+0000 7fb9096e5700 1 -- 172.21.15.78:0/764072506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb904150be0 con 0x7fb9040c44d0 2023-08-17T17:46:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.703+0000 7fb8faffd700 1 -- 172.21.15.78:0/764072506 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec013980 con 0x7fb9040c44d0 2023-08-17T17:46:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.703+0000 7fb9096e5700 1 -- 172.21.15.78:0/764072506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb904142e50 con 0x7fb9040c44d0 2023-08-17T17:46:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.703+0000 7fb9096e5700 1 -- 172.21.15.78:0/764072506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9040b0fc0 con 0x7fb9040c44d0 2023-08-17T17:46:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.704+0000 7fb8faffd700 1 -- 172.21.15.78:0/764072506 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb8ec010030 con 0x7fb9040c44d0 2023-08-17T17:46:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.704+0000 7fb8faffd700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb8e405ed90 0x7fb8e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.704+0000 7fb8faffd700 1 -- 172.21.15.78:0/764072506 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fb8ec07a2d0 con 0x7fb9040c44d0 2023-08-17T17:46:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.704+0000 7fb902ffd700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb8e405ed90 0x7fb8e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.705+0000 7fb902ffd700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb8e405ed90 0x7fb8e4061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb8f4006d80 tx=0x7fb8f4009060).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.709+0000 7fb8faffd700 1 -- 172.21.15.78:0/764072506 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8ec04ba50 con 0x7fb9040c44d0 2023-08-17T17:46:52.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:52.871+0000 7fb9096e5700 1 -- 172.21.15.78:0/764072506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb904047350 con 0x7fb9040c44d0 2023-08-17T17:46:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.564+0000 7fb8faffd700 1 -- 172.21.15.78:0/764072506 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb8ec04f070 con 0x7fb9040c44d0 2023-08-17T17:46:53.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.568+0000 7fb9096e5700 1 -- 172.21.15.78:0/764072506 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb8e405ed90 msgr2=0x7fb8e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:53.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.568+0000 7fb9096e5700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb8e405ed90 0x7fb8e4061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb8f4006d80 tx=0x7fb8f4009060).stop 2023-08-17T17:46:53.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.568+0000 7fb9096e5700 1 -- 172.21.15.78:0/764072506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9040c44d0 msgr2=0x7fb9040c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:53.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.568+0000 7fb9096e5700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9040c44d0 0x7fb9040c4950 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fb8ec001d20 tx=0x7fb8ec015000).stop 2023-08-17T17:46:53.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.571+0000 7fb9096e5700 1 -- 172.21.15.78:0/764072506 shutdown_connections 2023-08-17T17:46:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.571+0000 7fb9096e5700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb8e405ed90 0x7fb8e4061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.571+0000 7fb9096e5700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb90415a380 0x7fb90415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.571+0000 7fb9096e5700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8f0004690 0x7fb904142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.571+0000 7fb9096e5700 1 --2- 172.21.15.78:0/764072506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9040c44d0 0x7fb9040c4950 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.571+0000 7fb9096e5700 1 -- 172.21.15.78:0/764072506 >> 172.21.15.78:0/764072506 conn(0x7fb904094650 msgr2=0x7fb9040c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.575+0000 7fb9096e5700 1 -- 172.21.15.78:0/764072506 shutdown_connections 2023-08-17T17:46:53.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.575+0000 7fb9096e5700 1 -- 172.21.15.78:0/764072506 wait complete. 2023-08-17T17:46:53.590 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T17:46:53.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T17:46:53.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.712+0000 7f2cf1976700 1 Processor -- start 2023-08-17T17:46:53.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.712+0000 7f2cf1976700 1 -- start start 2023-08-17T17:46:53.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.713+0000 7f2cf1976700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cec0aa0f0 0x7f2cec0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:53.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.713+0000 7f2cf1976700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cec0c5810 0x7f2cec0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:53.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.713+0000 7f2cf1976700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec0649b0 con 0x7f2cec0aa4d0 2023-08-17T17:46:53.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.713+0000 7f2cf1976700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec0c6170 con 0x7f2cec0c5810 2023-08-17T17:46:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.713+0000 7f2cf1976700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec063420 con 0x7f2cec0aa0f0 2023-08-17T17:46:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.713+0000 7f2ceb7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cec0c5810 0x7f2cec0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.713+0000 7f2ce27fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2cec0aa4d0 0x7f2cec0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49982/0 (socket says 172.21.15.78:49982) 2023-08-17T17:46:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.713+0000 7f2ce27fc700 1 -- 172.21.15.78:0/72985953 learned_addr learned my addr 172.21.15.78:0/72985953 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.713+0000 7f2ceaffd700 1 --2- 172.21.15.78:0/72985953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cec0aa0f0 0x7f2cec0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2ceb7fe700 1 -- 172.21.15.78:0/72985953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cec0aa0f0 msgr2=0x7f2cec0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2ceb7fe700 1 --2- 172.21.15.78:0/72985953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cec0aa0f0 0x7f2cec0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2ceb7fe700 1 -- 172.21.15.78:0/72985953 >> v1:172.21.15.78:6789/0 conn(0x7f2cec0aa4d0 legacy=0x7f2cec0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cea7fc700 1 -- 172.21.15.78:0/72985953 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311912579 0 0) 0x7f2cec0649b0 con 0x7f2cec0aa4d0 2023-08-17T17:46:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2ceb7fe700 1 -- 172.21.15.78:0/72985953 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec063700 con 0x7f2cec0c5810 2023-08-17T17:46:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2ceb7fe700 1 --2- 172.21.15.78:0/72985953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 0x7f2cec0c5c80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f2ce4009e60 tx=0x7f2ce4009780).ready entity=mon.0 client_cookie=36bb2041939992df server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cea7fc700 1 -- 172.21.15.78:0/72985953 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce400e070 con 0x7f2cec0c5810 2023-08-17T17:46:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cea7fc700 1 -- 172.21.15.78:0/72985953 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce400bc30 con 0x7f2cec0c5810 2023-08-17T17:46:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cea7fc700 1 -- 172.21.15.78:0/72985953 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4012410 con 0x7f2cec0c5810 2023-08-17T17:46:53.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cf1976700 1 -- 172.21.15.78:0/72985953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 msgr2=0x7f2cec0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cf1976700 1 --2- 172.21.15.78:0/72985953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 0x7f2cec0c5c80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f2ce4009e60 tx=0x7f2ce4009780).stop 2023-08-17T17:46:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cf1976700 1 -- 172.21.15.78:0/72985953 shutdown_connections 2023-08-17T17:46:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cf1976700 1 --2- 172.21.15.78:0/72985953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 0x7f2cec0c5c80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cf1976700 1 --2- 172.21.15.78:0/72985953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cec0aa0f0 0x7f2cec0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cf1976700 1 -- 172.21.15.78:0/72985953 >> 172.21.15.78:0/72985953 conn(0x7f2cec06a6a0 msgr2=0x7f2cec0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cf1976700 1 -- 172.21.15.78:0/72985953 shutdown_connections 2023-08-17T17:46:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.714+0000 7f2cf1976700 1 -- 172.21.15.78:0/72985953 wait complete. 2023-08-17T17:46:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.716+0000 7f2cf1976700 1 Processor -- start 2023-08-17T17:46:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.716+0000 7f2cf1976700 1 -- start start 2023-08-17T17:46:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.716+0000 7f2cf1976700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cec0aa0f0 0x7f2cec0c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.716+0000 7f2cf1976700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cec0aa4d0 0x7f2cec152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.716+0000 7f2cf1976700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 0x7f2cec0ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.716+0000 7f2cf1976700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0c34c0 con 0x7f2cec0c5810 2023-08-17T17:46:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.716+0000 7f2cf1976700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0c2f00 con 0x7f2cec0aa4d0 2023-08-17T17:46:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.716+0000 7f2cf1976700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0c31e0 con 0x7f2cec0aa0f0 2023-08-17T17:46:53.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ceb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 0x7f2cec0ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:53.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ceb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 0x7f2cec0ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36912/0 (socket says 172.21.15.78:36912) 2023-08-17T17:46:53.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ceb7fe700 1 -- 172.21.15.78:0/2192722342 learned_addr learned my addr 172.21.15.78:0/2192722342 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:53.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ce27fc700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cec0aa4d0 0x7f2cec152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:53.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ceaffd700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cec0aa0f0 0x7f2cec0c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:53.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ceb7fe700 1 -- 172.21.15.78:0/2192722342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cec0aa0f0 msgr2=0x7f2cec0c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:53.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ceb7fe700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cec0aa0f0 0x7f2cec0c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ceb7fe700 1 -- 172.21.15.78:0/2192722342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cec0aa4d0 msgr2=0x7f2cec152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:53.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ceb7fe700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cec0aa4d0 0x7f2cec152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ceb7fe700 1 -- 172.21.15.78:0/2192722342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4009a20 con 0x7f2cec0c5810 2023-08-17T17:46:53.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ce27fc700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cec0aa4d0 0x7f2cec152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:53.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ceb7fe700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 0x7f2cec0ad050 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f2ce400b6c0 tx=0x7f2ce4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:53.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ce37fe700 1 -- 172.21.15.78:0/2192722342 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40116d0 con 0x7f2cec0c5810 2023-08-17T17:46:53.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ce37fe700 1 -- 172.21.15.78:0/2192722342 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce4011830 con 0x7f2cec0c5810 2023-08-17T17:46:53.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2cf1976700 1 -- 172.21.15.78:0/2192722342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec0ac850 con 0x7f2cec0c5810 2023-08-17T17:46:53.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2ce37fe700 1 -- 172.21.15.78:0/2192722342 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4011bf0 con 0x7f2cec0c5810 2023-08-17T17:46:53.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.717+0000 7f2cf1976700 1 -- 172.21.15.78:0/2192722342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec0c1cc0 con 0x7f2cec0c5810 2023-08-17T17:46:53.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.718+0000 7f2cf1976700 1 -- 172.21.15.78:0/2192722342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec0acd70 con 0x7f2cec0c5810 2023-08-17T17:46:53.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.718+0000 7f2ce37fe700 1 -- 172.21.15.78:0/2192722342 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2ce4011d50 con 0x7f2cec0c5810 2023-08-17T17:46:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.719+0000 7f2ce37fe700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ccc05ed90 0x7f2ccc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.719+0000 7f2ce37fe700 1 -- 172.21.15.78:0/2192722342 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f2ce407be50 con 0x7f2cec0c5810 2023-08-17T17:46:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.719+0000 7f2ceaffd700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ccc05ed90 0x7f2ccc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.719+0000 7f2ceaffd700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ccc05ed90 0x7f2ccc061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2cdc00bb20 tx=0x7f2cdc008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.723+0000 7f2ce37fe700 1 -- 172.21.15.78:0/2192722342 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ce404d450 con 0x7f2cec0c5810 2023-08-17T17:46:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.928+0000 7f2cf1976700 1 -- 172.21.15.78:0/2192722342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2cec046af0 con 0x7f2cec0c5810 2023-08-17T17:46:53.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.937+0000 7f2ce37fe700 1 -- 172.21.15.78:0/2192722342 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v17) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2ce4050a70 con 0x7f2cec0c5810 2023-08-17T17:46:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.947+0000 7f2cf1976700 1 -- 172.21.15.78:0/2192722342 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ccc05ed90 msgr2=0x7f2ccc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.947+0000 7f2cf1976700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ccc05ed90 0x7f2ccc061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2cdc00bb20 tx=0x7f2cdc008040).stop 2023-08-17T17:46:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.947+0000 7f2cf1976700 1 -- 172.21.15.78:0/2192722342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 msgr2=0x7f2cec0ad050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.947+0000 7f2cf1976700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 0x7f2cec0ad050 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f2ce400b6c0 tx=0x7f2ce4009780).stop 2023-08-17T17:46:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.947+0000 7f2cf1976700 1 -- 172.21.15.78:0/2192722342 shutdown_connections 2023-08-17T17:46:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.947+0000 7f2cf1976700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2ccc05ed90 0x7f2ccc061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.947+0000 7f2cf1976700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cec0c5810 0x7f2cec0ad050 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.947+0000 7f2cf1976700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cec0aa0f0 0x7f2cec0c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.947+0000 7f2cf1976700 1 --2- 172.21.15.78:0/2192722342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cec0aa4d0 0x7f2cec152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.947+0000 7f2cf1976700 1 -- 172.21.15.78:0/2192722342 >> 172.21.15.78:0/2192722342 conn(0x7f2cec06a6a0 msgr2=0x7f2cec0a9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.948+0000 7f2cf1976700 1 -- 172.21.15.78:0/2192722342 shutdown_connections 2023-08-17T17:46:53.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:53.948+0000 7f2cf1976700 1 -- 172.21.15.78:0/2192722342 wait complete. 2023-08-17T17:46:53.959 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 7 and data pool 8 2023-08-17T17:46:53.970 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:46:54.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.081+0000 7eff224af700 1 Processor -- start 2023-08-17T17:46:54.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.081+0000 7eff224af700 1 -- start start 2023-08-17T17:46:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.082+0000 7eff224af700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff1c154140 0x7eff1c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.082+0000 7eff224af700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c154520 con 0x7eff1c0a7c40 2023-08-17T17:46:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.082+0000 7eff224af700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c0c91e0 con 0x7eff1c0c1010 2023-08-17T17:46:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.082+0000 7eff224af700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0c94c0 con 0x7eff1c154140 2023-08-17T17:46:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.082+0000 7eff1bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff1c154140 0x7eff1c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.082+0000 7eff1b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7eff1c0a7c40 0x7eff1c0c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49990/0 (socket says 172.21.15.78:49990) 2023-08-17T17:46:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.082+0000 7eff1b7fe700 1 -- 172.21.15.78:0/2417073447 learned_addr learned my addr 172.21.15.78:0/2417073447 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.082+0000 7eff1bfff700 1 -- 172.21.15.78:0/2417073447 >> v1:172.21.15.150:6789/0 conn(0x7eff1c0c1010 legacy=0x7eff1c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.082+0000 7eff1bfff700 1 -- 172.21.15.78:0/2417073447 >> v1:172.21.15.78:6789/0 conn(0x7eff1c0a7c40 legacy=0x7eff1c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff1bfff700 1 -- 172.21.15.78:0/2417073447 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0c97a0 con 0x7eff1c154140 2023-08-17T17:46:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff1affd700 1 -- 172.21.15.78:0/2417073447 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964418274 0 0) 0x7eff1c154520 con 0x7eff1c0a7c40 2023-08-17T17:46:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff1bfff700 1 --2- 172.21.15.78:0/2417073447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c154140 0x7eff1c0c6ee0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7eff0c009760 tx=0x7eff0c009060).ready entity=mon.0 client_cookie=e113914a9304d80b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff1affd700 1 -- 172.21.15.78:0/2417073447 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00b520 con 0x7eff1c154140 2023-08-17T17:46:54.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff1affd700 1 -- 172.21.15.78:0/2417073447 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c00b680 con 0x7eff1c154140 2023-08-17T17:46:54.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff1affd700 1 -- 172.21.15.78:0/2417073447 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00ba00 con 0x7eff1c154140 2023-08-17T17:46:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff224af700 1 -- 172.21.15.78:0/2417073447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c154140 msgr2=0x7eff1c0c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff224af700 1 --2- 172.21.15.78:0/2417073447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c154140 0x7eff1c0c6ee0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7eff0c009760 tx=0x7eff0c009060).stop 2023-08-17T17:46:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff224af700 1 -- 172.21.15.78:0/2417073447 shutdown_connections 2023-08-17T17:46:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff224af700 1 --2- 172.21.15.78:0/2417073447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c154140 0x7eff1c0c6ee0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff224af700 1 -- 172.21.15.78:0/2417073447 >> 172.21.15.78:0/2417073447 conn(0x7eff1c094510 msgr2=0x7eff1c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff224af700 1 -- 172.21.15.78:0/2417073447 shutdown_connections 2023-08-17T17:46:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.083+0000 7eff224af700 1 -- 172.21.15.78:0/2417073447 wait complete. 2023-08-17T17:46:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.084+0000 7eff224af700 1 Processor -- start 2023-08-17T17:46:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.085+0000 7eff224af700 1 -- start start 2023-08-17T17:46:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.085+0000 7eff224af700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0a7c40 0x7eff1c0c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.085+0000 7eff224af700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff1c0c1010 0x7eff1c0c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.085+0000 7eff224af700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff1c154140 0x7eff1c150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.085+0000 7eff224af700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c163f90 con 0x7eff1c0a7c40 2023-08-17T17:46:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.085+0000 7eff224af700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c4d50 con 0x7eff1c0c1010 2023-08-17T17:46:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.085+0000 7eff224af700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c2e00 con 0x7eff1c154140 2023-08-17T17:46:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.085+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0a7c40 0x7eff1c0c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.085+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0a7c40 0x7eff1c0c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36934/0 (socket says 172.21.15.78:36934) 2023-08-17T17:46:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.085+0000 7eff1bfff700 1 -- 172.21.15.78:0/2910730990 learned_addr learned my addr 172.21.15.78:0/2910730990 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff1bfff700 1 -- 172.21.15.78:0/2910730990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff1c154140 msgr2=0x7eff1c150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff1bfff700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff1c154140 0x7eff1c150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff1bfff700 1 -- 172.21.15.78:0/2910730990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff1c0c1010 msgr2=0x7eff1c0c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff1bfff700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff1c0c1010 0x7eff1c0c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff1bfff700 1 -- 172.21.15.78:0/2910730990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0092a0 con 0x7eff1c0a7c40 2023-08-17T17:46:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff1bfff700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0a7c40 0x7eff1c0c4860 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7eff0c006dd0 tx=0x7eff0c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff03fff700 1 -- 172.21.15.78:0/2910730990 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00b7f0 con 0x7eff1c0a7c40 2023-08-17T17:46:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff03fff700 1 -- 172.21.15.78:0/2910730990 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c00b950 con 0x7eff1c0a7c40 2023-08-17T17:46:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff224af700 1 -- 172.21.15.78:0/2910730990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c0c3070 con 0x7eff1c0a7c40 2023-08-17T17:46:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff03fff700 1 -- 172.21.15.78:0/2910730990 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c01b660 con 0x7eff1c0a7c40 2023-08-17T17:46:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.086+0000 7eff224af700 1 -- 172.21.15.78:0/2910730990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c0c3630 con 0x7eff1c0a7c40 2023-08-17T17:46:54.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.087+0000 7eff224af700 1 -- 172.21.15.78:0/2910730990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c1640e0 con 0x7eff1c0a7c40 2023-08-17T17:46:54.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.087+0000 7eff03fff700 1 -- 172.21.15.78:0/2910730990 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7eff0c00f070 con 0x7eff1c0a7c40 2023-08-17T17:46:54.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.088+0000 7eff03fff700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7eff0805ed90 0x7eff08061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.088+0000 7eff03fff700 1 -- 172.21.15.78:0/2910730990 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6121+0+0 (secure 0 0 0) 0x7eff0c07b640 con 0x7eff1c0a7c40 2023-08-17T17:46:54.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.088+0000 7eff1b7fe700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7eff0805ed90 0x7eff08061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.088+0000 7eff1b7fe700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7eff0805ed90 0x7eff08061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7eff1c095f50 tx=0x7eff10007a50).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:54.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.092+0000 7eff03fff700 1 -- 172.21.15.78:0/2910730990 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff1c1640e0 con 0x7eff1c0a7c40 2023-08-17T17:46:54.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.256+0000 7eff224af700 1 -- 172.21.15.78:0/2910730990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff1c1640e0 con 0x7eff1c0a7c40 2023-08-17T17:46:54.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.257+0000 7eff03fff700 1 -- 172.21.15.78:0/2910730990 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16989 (secure 0 0 0) 0x7eff1c1640e0 con 0x7eff1c0a7c40 2023-08-17T17:46:54.258 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:54.258 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":59,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:46:53.930080+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:46:52.467922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T17:46:52.895738+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:46:54.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.258+0000 7eff224af700 1 -- 172.21.15.78:0/2910730990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7eff0805ed90 msgr2=0x7eff08061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.258+0000 7eff224af700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7eff0805ed90 0x7eff08061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7eff1c095f50 tx=0x7eff10007a50).stop 2023-08-17T17:46:54.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.258+0000 7eff224af700 1 -- 172.21.15.78:0/2910730990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0a7c40 msgr2=0x7eff1c0c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.258+0000 7eff224af700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0a7c40 0x7eff1c0c4860 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7eff0c006dd0 tx=0x7eff0c017000).stop 2023-08-17T17:46:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.258+0000 7eff224af700 1 -- 172.21.15.78:0/2910730990 shutdown_connections 2023-08-17T17:46:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.258+0000 7eff224af700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7eff0805ed90 0x7eff08061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.258+0000 7eff224af700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff1c154140 0x7eff1c150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.258+0000 7eff224af700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0a7c40 0x7eff1c0c4860 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.258+0000 7eff224af700 1 --2- 172.21.15.78:0/2910730990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff1c0c1010 0x7eff1c0c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.258+0000 7eff224af700 1 -- 172.21.15.78:0/2910730990 >> 172.21.15.78:0/2910730990 conn(0x7eff1c094510 msgr2=0x7eff1c0644a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.259+0000 7eff224af700 1 -- 172.21.15.78:0/2910730990 shutdown_connections 2023-08-17T17:46:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.259+0000 7eff224af700 1 -- 172.21.15.78:0/2910730990 wait complete. 2023-08-17T17:46:54.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:46:54.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.383+0000 7faabdc1d700 1 Processor -- start 2023-08-17T17:46:54.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.383+0000 7faabdc1d700 1 -- start start 2023-08-17T17:46:54.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.384+0000 7faabdc1d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faab80c6ee0 0x7faab80c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.384+0000 7faabdc1d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab80c7350 con 0x7faab8154140 2023-08-17T17:46:54.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.384+0000 7faabdc1d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab80a8350 con 0x7faab80c0df0 2023-08-17T17:46:54.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.384+0000 7faabdc1d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab80c1240 con 0x7faab80c6ee0 2023-08-17T17:46:54.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.384+0000 7faab77fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7faab8154140 0x7faab80a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50004/0 (socket says 172.21.15.78:50004) 2023-08-17T17:46:54.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.384+0000 7faab77fe700 1 -- 172.21.15.78:0/1670747916 learned_addr learned my addr 172.21.15.78:0/1670747916 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:54.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.384+0000 7faab6ffd700 1 --2- 172.21.15.78:0/1670747916 >> v2:172.21.15.150:3300/0 conn(0x7faab80c6ee0 0x7faab80c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab67fc700 1 -- 172.21.15.78:0/1670747916 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807436115 0 0) 0x7faab80c7350 con 0x7faab8154140 2023-08-17T17:46:54.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab67fc700 1 -- 172.21.15.78:0/1670747916 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa00033f0 con 0x7faab8154140 2023-08-17T17:46:54.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab67fc700 1 -- 172.21.15.78:0/1670747916 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925752056 0 0) 0x7faab80a8350 con 0x7faab80c0df0 2023-08-17T17:46:54.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab67fc700 1 -- 172.21.15.78:0/1670747916 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab80c7350 con 0x7faab80c0df0 2023-08-17T17:46:54.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab67fc700 1 -- 172.21.15.78:0/1670747916 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 572219716 0 0) 0x7faaa00033f0 con 0x7faab8154140 2023-08-17T17:46:54.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab6ffd700 1 -- 172.21.15.78:0/1670747916 >> v1:172.21.15.150:6789/0 conn(0x7faab80c0df0 legacy=0x7faab80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab6ffd700 1 -- 172.21.15.78:0/1670747916 >> v1:172.21.15.78:6789/0 conn(0x7faab8154140 legacy=0x7faab80a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab6ffd700 1 -- 172.21.15.78:0/1670747916 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab8154520 con 0x7faab80c6ee0 2023-08-17T17:46:54.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab6ffd700 1 --2- 172.21.15.78:0/1670747916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab80c6ee0 0x7faab80c0900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7faaac009760 tx=0x7faaac009060).ready entity=mon.1 client_cookie=81f454a5982019 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:54.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab67fc700 1 -- 172.21.15.78:0/1670747916 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa80017f0 con 0x7faab80c6ee0 2023-08-17T17:46:54.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab67fc700 1 -- 172.21.15.78:0/1670747916 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac011400 con 0x7faab80c6ee0 2023-08-17T17:46:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.385+0000 7faab67fc700 1 -- 172.21.15.78:0/1670747916 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac011780 con 0x7faab80c6ee0 2023-08-17T17:46:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.386+0000 7faabdc1d700 1 -- 172.21.15.78:0/1670747916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab80c6ee0 msgr2=0x7faab80c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.386+0000 7faabdc1d700 1 --2- 172.21.15.78:0/1670747916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab80c6ee0 0x7faab80c0900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7faaac009760 tx=0x7faaac009060).stop 2023-08-17T17:46:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.386+0000 7faabdc1d700 1 -- 172.21.15.78:0/1670747916 shutdown_connections 2023-08-17T17:46:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.386+0000 7faabdc1d700 1 --2- 172.21.15.78:0/1670747916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab80c6ee0 0x7faab80c0900 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.386+0000 7faabdc1d700 1 -- 172.21.15.78:0/1670747916 >> 172.21.15.78:0/1670747916 conn(0x7faab8094510 msgr2=0x7faab806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.386+0000 7faabdc1d700 1 -- 172.21.15.78:0/1670747916 shutdown_connections 2023-08-17T17:46:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.386+0000 7faabdc1d700 1 -- 172.21.15.78:0/1670747916 wait complete. 2023-08-17T17:46:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.387+0000 7faabdc1d700 1 Processor -- start 2023-08-17T17:46:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.387+0000 7faabdc1d700 1 -- start start 2023-08-17T17:46:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faabdc1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faab80c0df0 0x7faab814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faabdc1d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab80c6ee0 0x7faab8167800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faabdc1d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab8154140 0x7faab80643d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faabdc1d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab80c3170 con 0x7faab80c0df0 2023-08-17T17:46:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faabdc1d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab8168250 con 0x7faab8154140 2023-08-17T17:46:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faabdc1d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab8168530 con 0x7faab80c6ee0 2023-08-17T17:46:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faab77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faab80c0df0 0x7faab814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faab77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faab80c0df0 0x7faab814e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36950/0 (socket says 172.21.15.78:36950) 2023-08-17T17:46:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faab77fe700 1 -- 172.21.15.78:0/3055559001 learned_addr learned my addr 172.21.15.78:0/3055559001 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faab77fe700 1 -- 172.21.15.78:0/3055559001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab80c6ee0 msgr2=0x7faab8167800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faab77fe700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab80c6ee0 0x7faab8167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faab77fe700 1 -- 172.21.15.78:0/3055559001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab8154140 msgr2=0x7faab80643d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faab7fff700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab8154140 0x7faab80643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faab77fe700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab8154140 0x7faab80643d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faab77fe700 1 -- 172.21.15.78:0/3055559001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0092a0 con 0x7faab80c0df0 2023-08-17T17:46:54.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faab77fe700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faab80c0df0 0x7faab814e100 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7faaa800cb90 tx=0x7faaa8007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:54.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faa9f7fe700 1 -- 172.21.15.78:0/3055559001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa8004c40 con 0x7faab80c0df0 2023-08-17T17:46:54.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faa9f7fe700 1 -- 172.21.15.78:0/3055559001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa8004dc0 con 0x7faab80c0df0 2023-08-17T17:46:54.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faabdc1d700 1 -- 172.21.15.78:0/3055559001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab80c2e00 con 0x7faab80c0df0 2023-08-17T17:46:54.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.388+0000 7faa9f7fe700 1 -- 172.21.15.78:0/3055559001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa80073c0 con 0x7faab80c0df0 2023-08-17T17:46:54.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.389+0000 7faabdc1d700 1 -- 172.21.15.78:0/3055559001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab814e5f0 con 0x7faab80c0df0 2023-08-17T17:46:54.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.389+0000 7faabdc1d700 1 -- 172.21.15.78:0/3055559001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab80c2c60 con 0x7faab80c0df0 2023-08-17T17:46:54.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.390+0000 7faa9f7fe700 1 -- 172.21.15.78:0/3055559001 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faaa8010070 con 0x7faab80c0df0 2023-08-17T17:46:54.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.390+0000 7faa9f7fe700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faaa405ed90 0x7faaa4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.390+0000 7faa9f7fe700 1 -- 172.21.15.78:0/3055559001 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faaa8079b10 con 0x7faab80c0df0 2023-08-17T17:46:54.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.390+0000 7faab6ffd700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faaa405ed90 0x7faaa4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.390+0000 7faab6ffd700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faaa405ed90 0x7faaa4061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faab80c2780 tx=0x7faaac016000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:54.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.394+0000 7faa9f7fe700 1 -- 172.21.15.78:0/3055559001 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faab80c2c60 con 0x7faab80c0df0 2023-08-17T17:46:54.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.557+0000 7faabdc1d700 1 -- 172.21.15.78:0/3055559001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faab80c2c60 con 0x7faab80c0df0 2023-08-17T17:46:54.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.558+0000 7faa9f7fe700 1 -- 172.21.15.78:0/3055559001 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16989 (secure 0 0 0) 0x7faab80c2c60 con 0x7faab80c0df0 2023-08-17T17:46:54.560 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:54.560 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":59,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:46:53.930080+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:46:52.467922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T17:46:52.895738+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:46:54.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 -- 172.21.15.78:0/3055559001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faaa405ed90 msgr2=0x7faaa4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faaa405ed90 0x7faaa4061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faab80c2780 tx=0x7faaac016000).stop 2023-08-17T17:46:54.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 -- 172.21.15.78:0/3055559001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faab80c0df0 msgr2=0x7faab814e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faab80c0df0 0x7faab814e100 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7faaa800cb90 tx=0x7faaa8007c20).stop 2023-08-17T17:46:54.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 -- 172.21.15.78:0/3055559001 shutdown_connections 2023-08-17T17:46:54.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faaa405ed90 0x7faaa4061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab8154140 0x7faab80643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faab80c0df0 0x7faab814e100 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 --2- 172.21.15.78:0/3055559001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab80c6ee0 0x7faab8167800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:54.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 -- 172.21.15.78:0/3055559001 >> 172.21.15.78:0/3055559001 conn(0x7faab8094510 msgr2=0x7faab80cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:54.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 -- 172.21.15.78:0/3055559001 shutdown_connections 2023-08-17T17:46:54.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.560+0000 7faabdc1d700 1 -- 172.21.15.78:0/3055559001 wait complete. 2023-08-17T17:46:54.574 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T17:46:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.688+0000 7f565d05e700 1 Processor -- start 2023-08-17T17:46:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.688+0000 7f565d05e700 1 -- start start 2023-08-17T17:46:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f565d05e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f56581582f0 0x7f56580c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f565d05e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56580c6620 con 0x7f5658151e20 2023-08-17T17:46:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f565d05e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56580c6900 con 0x7f5658151a40 2023-08-17T17:46:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f565d05e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56580c6be0 con 0x7f56581582f0 2023-08-17T17:46:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f565c85d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f56581582f0 0x7f56580c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f56577fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5658151e20 0x7f5658157be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50020/0 (socket says 172.21.15.78:50020) 2023-08-17T17:46:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f56577fe700 1 -- 172.21.15.78:0/4151242689 learned_addr learned my addr 172.21.15.78:0/4151242689 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f565c85d700 1 -- 172.21.15.78:0/4151242689 >> v1:172.21.15.150:6789/0 conn(0x7f5658151a40 legacy=0x7f56580c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f565c85d700 1 -- 172.21.15.78:0/4151242689 >> v1:172.21.15.78:6789/0 conn(0x7f5658151e20 legacy=0x7f5658157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f565c85d700 1 -- 172.21.15.78:0/4151242689 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580c6ec0 con 0x7f56581582f0 2023-08-17T17:46:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f5656ffd700 1 -- 172.21.15.78:0/4151242689 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817615723 0 0) 0x7f56580c6620 con 0x7f5658151e20 2023-08-17T17:46:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f565c85d700 1 --2- 172.21.15.78:0/4151242689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56581582f0 0x7f56580c8260 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f5650009e60 tx=0x7f5650009780).ready entity=mon.0 client_cookie=b65186fd6ba785fb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f5656ffd700 1 -- 172.21.15.78:0/4151242689 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000e070 con 0x7f56581582f0 2023-08-17T17:46:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f5656ffd700 1 -- 172.21.15.78:0/4151242689 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565000bbf0 con 0x7f56581582f0 2023-08-17T17:46:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.689+0000 7f5656ffd700 1 -- 172.21.15.78:0/4151242689 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650012410 con 0x7f56581582f0 2023-08-17T17:46:54.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.690+0000 7f565d05e700 1 -- 172.21.15.78:0/4151242689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56581582f0 msgr2=0x7f56580c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.690+0000 7f565d05e700 1 --2- 172.21.15.78:0/4151242689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56581582f0 0x7f56580c8260 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f5650009e60 tx=0x7f5650009780).stop 2023-08-17T17:46:54.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.690+0000 7f565d05e700 1 -- 172.21.15.78:0/4151242689 shutdown_connections 2023-08-17T17:46:54.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.690+0000 7f565d05e700 1 --2- 172.21.15.78:0/4151242689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56581582f0 0x7f56580c8260 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.690+0000 7f565d05e700 1 -- 172.21.15.78:0/4151242689 >> 172.21.15.78:0/4151242689 conn(0x7f56580943b0 msgr2=0x7f565806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:54.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.690+0000 7f565d05e700 1 -- 172.21.15.78:0/4151242689 shutdown_connections 2023-08-17T17:46:54.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.690+0000 7f565d05e700 1 -- 172.21.15.78:0/4151242689 wait complete. 2023-08-17T17:46:54.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.691+0000 7f565d05e700 1 Processor -- start 2023-08-17T17:46:54.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.691+0000 7f565d05e700 1 -- start start 2023-08-17T17:46:54.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f565d05e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5658151a40 0x7f5658163550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f565d05e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5658151e20 0x7f56580c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f565d05e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56581582f0 0x7f56580c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f565d05e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56580c2760 con 0x7f5658151e20 2023-08-17T17:46:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f565d05e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56580ae9d0 con 0x7f5658151a40 2023-08-17T17:46:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f565d05e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56580addc0 con 0x7f56581582f0 2023-08-17T17:46:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f56577fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5658151e20 0x7f56580c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f56577fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5658151e20 0x7f56580c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36962/0 (socket says 172.21.15.78:36962) 2023-08-17T17:46:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f56577fe700 1 -- 172.21.15.78:0/2716148390 learned_addr learned my addr 172.21.15.78:0/2716148390 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f5657fff700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5658151a40 0x7f5658163550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f565c85d700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56581582f0 0x7f56580c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f56577fe700 1 -- 172.21.15.78:0/2716148390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56581582f0 msgr2=0x7f56580c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f56577fe700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56581582f0 0x7f56580c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f56577fe700 1 -- 172.21.15.78:0/2716148390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5658151a40 msgr2=0x7f5658163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f56577fe700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5658151a40 0x7f5658163550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f56577fe700 1 -- 172.21.15.78:0/2716148390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650009a20 con 0x7f5658151e20 2023-08-17T17:46:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.692+0000 7f5657fff700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5658151a40 0x7f5658163550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.693+0000 7f56577fe700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5658151e20 0x7f56580c1d80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f5648001360 tx=0x7f5648007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.693+0000 7f563ffff700 1 -- 172.21.15.78:0/2716148390 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480072e0 con 0x7f5658151e20 2023-08-17T17:46:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.693+0000 7f563ffff700 1 -- 172.21.15.78:0/2716148390 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648007460 con 0x7f5658151e20 2023-08-17T17:46:54.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.693+0000 7f565d05e700 1 -- 172.21.15.78:0/2716148390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56580ae0a0 con 0x7f5658151e20 2023-08-17T17:46:54.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.693+0000 7f563ffff700 1 -- 172.21.15.78:0/2716148390 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480058c0 con 0x7f5658151e20 2023-08-17T17:46:54.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.693+0000 7f565d05e700 1 -- 172.21.15.78:0/2716148390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56580ae660 con 0x7f5658151e20 2023-08-17T17:46:54.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.694+0000 7f565d05e700 1 -- 172.21.15.78:0/2716148390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5658082f90 con 0x7f5658151e20 2023-08-17T17:46:54.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.694+0000 7f563ffff700 1 -- 172.21.15.78:0/2716148390 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5648010070 con 0x7f5658151e20 2023-08-17T17:46:54.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.694+0000 7f563ffff700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f564405ed90 0x7f5644061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:54.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.694+0000 7f563ffff700 1 -- 172.21.15.78:0/2716148390 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f56480791b0 con 0x7f5658151e20 2023-08-17T17:46:54.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.694+0000 7f5657fff700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f564405ed90 0x7f5644061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:54.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.695+0000 7f5657fff700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f564405ed90 0x7f5644061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f564c00b910 tx=0x7f564c008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:54.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.698+0000 7f563ffff700 1 -- 172.21.15.78:0/2716148390 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f564804a750 con 0x7f5658151e20 2023-08-17T17:46:54.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.905+0000 7f565d05e700 1 -- 172.21.15.78:0/2716148390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f56580aeb60 con 0x7f5658151e20 2023-08-17T17:46:54.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.936+0000 7f563ffff700 1 -- 172.21.15.78:0/2716148390 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f564804dd70 con 0x7f5658151e20 2023-08-17T17:46:54.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 -- 172.21.15.78:0/2716148390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f564405ed90 msgr2=0x7f5644061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f564405ed90 0x7f5644061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f564c00b910 tx=0x7f564c008040).stop 2023-08-17T17:46:54.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 -- 172.21.15.78:0/2716148390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5658151e20 msgr2=0x7f56580c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:54.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5658151e20 0x7f56580c1d80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f5648001360 tx=0x7f5648007b00).stop 2023-08-17T17:46:54.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 -- 172.21.15.78:0/2716148390 shutdown_connections 2023-08-17T17:46:54.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f564405ed90 0x7f5644061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56581582f0 0x7f56580c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5658151a40 0x7f5658163550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 --2- 172.21.15.78:0/2716148390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5658151e20 0x7f56580c1d80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:54.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 -- 172.21.15.78:0/2716148390 >> 172.21.15.78:0/2716148390 conn(0x7f56580943b0 msgr2=0x7f5658062ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:54.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 -- 172.21.15.78:0/2716148390 shutdown_connections 2023-08-17T17:46:54.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:54.938+0000 7f565d05e700 1 -- 172.21.15.78:0/2716148390 wait complete. 2023-08-17T17:46:54.952 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T17:46:54.952 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T17:46:55.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.066+0000 7fd0f5441700 1 Processor -- start 2023-08-17T17:46:55.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.066+0000 7fd0f5441700 1 -- start start 2023-08-17T17:46:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.067+0000 7fd0f5441700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0f0096520 0x7fd0f00be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.067+0000 7fd0f5441700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f00c3e10 con 0x7fd0f01578f0 2023-08-17T17:46:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.067+0000 7fd0f5441700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f00c34e0 con 0x7fd0f00bf0e0 2023-08-17T17:46:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.067+0000 7fd0f5441700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f00bf5c0 con 0x7fd0f0096520 2023-08-17T17:46:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.067+0000 7fd0e67fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0f0096520 0x7fd0f00be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:55.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.067+0000 7fd0eeffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd0f01578f0 0x7fd0f0095e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50024/0 (socket says 172.21.15.78:50024) 2023-08-17T17:46:55.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.067+0000 7fd0eeffd700 1 -- 172.21.15.78:0/1554700793 learned_addr learned my addr 172.21.15.78:0/1554700793 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:55.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0e67fc700 1 -- 172.21.15.78:0/1554700793 >> v1:172.21.15.150:6789/0 conn(0x7fd0f00bf0e0 legacy=0x7fd0f00c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:55.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0e67fc700 1 -- 172.21.15.78:0/1554700793 >> v1:172.21.15.78:6789/0 conn(0x7fd0f01578f0 legacy=0x7fd0f0095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:55.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0e67fc700 1 -- 172.21.15.78:0/1554700793 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f00c37c0 con 0x7fd0f0096520 2023-08-17T17:46:55.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0ee7fc700 1 -- 172.21.15.78:0/1554700793 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077643467 0 0) 0x7fd0f00c3e10 con 0x7fd0f01578f0 2023-08-17T17:46:55.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0e67fc700 1 --2- 172.21.15.78:0/1554700793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 0x7fd0f00be210 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fd0d8009760 tx=0x7fd0d8009060).ready entity=mon.0 client_cookie=645598474dac08af server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:55.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0ee7fc700 1 -- 172.21.15.78:0/1554700793 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80090d0 con 0x7fd0f0096520 2023-08-17T17:46:55.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0ee7fc700 1 -- 172.21.15.78:0/1554700793 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d800b520 con 0x7fd0f0096520 2023-08-17T17:46:55.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0ee7fc700 1 -- 172.21.15.78:0/1554700793 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d800b8a0 con 0x7fd0f0096520 2023-08-17T17:46:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0f5441700 1 -- 172.21.15.78:0/1554700793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 msgr2=0x7fd0f00be210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0f5441700 1 --2- 172.21.15.78:0/1554700793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 0x7fd0f00be210 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fd0d8009760 tx=0x7fd0d8009060).stop 2023-08-17T17:46:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0f5441700 1 -- 172.21.15.78:0/1554700793 shutdown_connections 2023-08-17T17:46:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0f5441700 1 --2- 172.21.15.78:0/1554700793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 0x7fd0f00be210 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0f5441700 1 -- 172.21.15.78:0/1554700793 >> 172.21.15.78:0/1554700793 conn(0x7fd0f0062f80 msgr2=0x7fd0f00c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0f5441700 1 -- 172.21.15.78:0/1554700793 shutdown_connections 2023-08-17T17:46:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.068+0000 7fd0f5441700 1 -- 172.21.15.78:0/1554700793 wait complete. 2023-08-17T17:46:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.070+0000 7fd0f5441700 1 Processor -- start 2023-08-17T17:46:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.070+0000 7fd0f5441700 1 -- start start 2023-08-17T17:46:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.070+0000 7fd0f5441700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 0x7fd0f0153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.070+0000 7fd0f5441700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0f00bf0e0 0x7fd0f014e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.070+0000 7fd0f5441700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0f01578f0 0x7fd0f0157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.070+0000 7fd0f5441700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f0154560 con 0x7fd0f0096520 2023-08-17T17:46:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.070+0000 7fd0f5441700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f00aa390 con 0x7fd0f00bf0e0 2023-08-17T17:46:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.070+0000 7fd0f5441700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f00a9ac0 con 0x7fd0f01578f0 2023-08-17T17:46:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.070+0000 7fd0eeffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 0x7fd0f0153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.070+0000 7fd0eeffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 0x7fd0f0153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36980/0 (socket says 172.21.15.78:36980) 2023-08-17T17:46:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0eeffd700 1 -- 172.21.15.78:0/2315052057 learned_addr learned my addr 172.21.15.78:0/2315052057 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0eeffd700 1 -- 172.21.15.78:0/2315052057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0f01578f0 msgr2=0x7fd0f0157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0eeffd700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0f01578f0 0x7fd0f0157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0eeffd700 1 -- 172.21.15.78:0/2315052057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0f00bf0e0 msgr2=0x7fd0f014e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0eeffd700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0f00bf0e0 0x7fd0f014e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0eeffd700 1 -- 172.21.15.78:0/2315052057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d80092a0 con 0x7fd0f0096520 2023-08-17T17:46:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0eeffd700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 0x7fd0f0153500 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fd0e000c460 tx=0x7fd0e0007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0e77fe700 1 -- 172.21.15.78:0/2315052057 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00072e0 con 0x7fd0f0096520 2023-08-17T17:46:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0e77fe700 1 -- 172.21.15.78:0/2315052057 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e0007440 con 0x7fd0f0096520 2023-08-17T17:46:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0f5441700 1 -- 172.21.15.78:0/2315052057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f0154280 con 0x7fd0f0096520 2023-08-17T17:46:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0e77fe700 1 -- 172.21.15.78:0/2315052057 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00057a0 con 0x7fd0f0096520 2023-08-17T17:46:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.071+0000 7fd0f5441700 1 -- 172.21.15.78:0/2315052057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f00aa020 con 0x7fd0f0096520 2023-08-17T17:46:55.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.072+0000 7fd0f5441700 1 -- 172.21.15.78:0/2315052057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f00a9c00 con 0x7fd0f0096520 2023-08-17T17:46:55.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.072+0000 7fd0e77fe700 1 -- 172.21.15.78:0/2315052057 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd0e001a060 con 0x7fd0f0096520 2023-08-17T17:46:55.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.073+0000 7fd0e77fe700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd0d005ed90 0x7fd0d0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:55.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.073+0000 7fd0e77fe700 1 -- 172.21.15.78:0/2315052057 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd0e0079300 con 0x7fd0f0096520 2023-08-17T17:46:55.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.073+0000 7fd0e67fc700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd0d005ed90 0x7fd0d0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:55.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.073+0000 7fd0e67fc700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd0d005ed90 0x7fd0d0061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd0f0096920 tx=0x7fd0d8017000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:55.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.077+0000 7fd0e77fe700 1 -- 172.21.15.78:0/2315052057 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd0f00a9c00 con 0x7fd0f0096520 2023-08-17T17:46:55.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.282+0000 7fd0f5441700 1 -- 172.21.15.78:0/2315052057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd0f00a9c00 con 0x7fd0f0096520 2023-08-17T17:46:55.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.947+0000 7fd0e77fe700 1 -- 172.21.15.78:0/2315052057 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd0f00a9c00 con 0x7fd0f0096520 2023-08-17T17:46:55.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 -- 172.21.15.78:0/2315052057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd0d005ed90 msgr2=0x7fd0d0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:55.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd0d005ed90 0x7fd0d0061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd0f0096920 tx=0x7fd0d8017000).stop 2023-08-17T17:46:55.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 -- 172.21.15.78:0/2315052057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 msgr2=0x7fd0f0153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:55.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 0x7fd0f0153500 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fd0e000c460 tx=0x7fd0e0007e90).stop 2023-08-17T17:46:55.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 -- 172.21.15.78:0/2315052057 shutdown_connections 2023-08-17T17:46:55.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd0d005ed90 0x7fd0d0061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:55.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0f01578f0 0x7fd0f0157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:55.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0f0096520 0x7fd0f0153500 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:55.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 --2- 172.21.15.78:0/2315052057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0f00bf0e0 0x7fd0f014e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:55.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 -- 172.21.15.78:0/2315052057 >> 172.21.15.78:0/2315052057 conn(0x7fd0f0062f80 msgr2=0x7fd0f00a5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:55.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 -- 172.21.15.78:0/2315052057 shutdown_connections 2023-08-17T17:46:55.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:55.949+0000 7fd0f5441700 1 -- 172.21.15.78:0/2315052057 wait complete. 2023-08-17T17:46:55.962 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T17:46:55.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:46:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.074+0000 7f40dcdc7700 1 Processor -- start 2023-08-17T17:46:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.074+0000 7f40dcdc7700 1 -- start start 2023-08-17T17:46:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.075+0000 7f40dcdc7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f40d8154140 0x7f40d80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.075+0000 7f40dcdc7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 0x7f40d80c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.075+0000 7f40dcdc7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40d80a8080 0x7f40d80c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.075+0000 7f40dcdc7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d80c12e0 con 0x7f40d80a8080 2023-08-17T17:46:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.075+0000 7f40dcdc7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d8154520 con 0x7f40d8154140 2023-08-17T17:46:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.075+0000 7f40dcdc7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80c91e0 con 0x7f40d80a7c40 2023-08-17T17:46:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.075+0000 7f40d6d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40d80a8080 0x7f40d80c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.075+0000 7f40d6d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40d80a8080 0x7f40d80c0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36992/0 (socket says 172.21.15.78:36992) 2023-08-17T17:46:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.075+0000 7f40d6d9d700 1 -- 172.21.15.78:0/2765390037 learned_addr learned my addr 172.21.15.78:0/2765390037 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40d659c700 1 --2- 172.21.15.78:0/2765390037 >> v2:172.21.15.150:3300/0 conn(0x7f40d8154140 0x7f40d80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40cffff700 1 --2- 172.21.15.78:0/2765390037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 0x7f40d80c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40d6d9d700 1 -- 172.21.15.78:0/2765390037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 msgr2=0x7f40d80c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40d6d9d700 1 --2- 172.21.15.78:0/2765390037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 0x7f40d80c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40d6d9d700 1 -- 172.21.15.78:0/2765390037 >> v2:172.21.15.150:3300/0 conn(0x7f40d8154140 msgr2=0x7f40d80c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40d6d9d700 1 --2- 172.21.15.78:0/2765390037 >> v2:172.21.15.150:3300/0 conn(0x7f40d8154140 0x7f40d80c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40d6d9d700 1 -- 172.21.15.78:0/2765390037 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d80c94c0 con 0x7f40d80a8080 2023-08-17T17:46:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40cffff700 1 --2- 172.21.15.78:0/2765390037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 0x7f40d80c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40d6d9d700 1 --2- 172.21.15.78:0/2765390037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 0x7f40d80c0df0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f40d80625b0 tx=0x7f40d0009840).ready entity=mon.0 client_cookie=761b8876bacc18cb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40d5d9b700 1 -- 172.21.15.78:0/2765390037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000e070 con 0x7f40d80a8080 2023-08-17T17:46:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40d5d9b700 1 -- 172.21.15.78:0/2765390037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d000ba50 con 0x7f40d80a8080 2023-08-17T17:46:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40d5d9b700 1 -- 172.21.15.78:0/2765390037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000bdd0 con 0x7f40d80a8080 2023-08-17T17:46:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40dcdc7700 1 -- 172.21.15.78:0/2765390037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 msgr2=0x7f40d80c0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40dcdc7700 1 --2- 172.21.15.78:0/2765390037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 0x7f40d80c0df0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f40d80625b0 tx=0x7f40d0009840).stop 2023-08-17T17:46:56.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40dcdc7700 1 -- 172.21.15.78:0/2765390037 shutdown_connections 2023-08-17T17:46:56.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40dcdc7700 1 --2- 172.21.15.78:0/2765390037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 0x7f40d80c0df0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40dcdc7700 1 --2- 172.21.15.78:0/2765390037 >> v2:172.21.15.150:3300/0 conn(0x7f40d8154140 0x7f40d80c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40dcdc7700 1 --2- 172.21.15.78:0/2765390037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 0x7f40d80c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40dcdc7700 1 -- 172.21.15.78:0/2765390037 >> 172.21.15.78:0/2765390037 conn(0x7f40d8094510 msgr2=0x7f40d806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:56.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.076+0000 7f40dcdc7700 1 -- 172.21.15.78:0/2765390037 shutdown_connections 2023-08-17T17:46:56.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.077+0000 7f40dcdc7700 1 -- 172.21.15.78:0/2765390037 wait complete. 2023-08-17T17:46:56.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.078+0000 7f40dcdc7700 1 Processor -- start 2023-08-17T17:46:56.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.078+0000 7f40dcdc7700 1 -- start start 2023-08-17T17:46:56.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.078+0000 7f40dcdc7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 0x7f40d8142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.078+0000 7f40dcdc7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 0x7f40d80ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.078+0000 7f40dcdc7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d8154140 0x7f40d80caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.078+0000 7f40dcdc7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80caf40 con 0x7f40d80a8080 2023-08-17T17:46:56.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.078+0000 7f40dcdc7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80b0bd0 con 0x7f40d8154140 2023-08-17T17:46:56.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.078+0000 7f40dcdc7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80cb140 con 0x7f40d80a7c40 2023-08-17T17:46:56.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40cffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 0x7f40d80ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40cffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 0x7f40d80ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37008/0 (socket says 172.21.15.78:37008) 2023-08-17T17:46:56.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40cffff700 1 -- 172.21.15.78:0/791751302 learned_addr learned my addr 172.21.15.78:0/791751302 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:56.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40d6d9d700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d8154140 0x7f40d80caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40d659c700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 0x7f40d8142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40cffff700 1 -- 172.21.15.78:0/791751302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 msgr2=0x7f40d8142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40cffff700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 0x7f40d8142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40cffff700 1 -- 172.21.15.78:0/791751302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d8154140 msgr2=0x7f40d80caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40cffff700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d8154140 0x7f40d80caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40cffff700 1 -- 172.21.15.78:0/791751302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0009ae0 con 0x7f40d80a8080 2023-08-17T17:46:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40d6d9d700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d8154140 0x7f40d80caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40cffff700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 0x7f40d80ca560 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f40c000c880 tx=0x7f40c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40ce7fc700 1 -- 172.21.15.78:0/791751302 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0010580 con 0x7f40d80a8080 2023-08-17T17:46:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40ce7fc700 1 -- 172.21.15.78:0/791751302 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c00106e0 con 0x7f40d80a8080 2023-08-17T17:46:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40ce7fc700 1 -- 172.21.15.78:0/791751302 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0010a60 con 0x7f40d80a8080 2023-08-17T17:46:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40dcdc7700 1 -- 172.21.15.78:0/791751302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d80c2fa0 con 0x7f40d80a8080 2023-08-17T17:46:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.079+0000 7f40dcdc7700 1 -- 172.21.15.78:0/791751302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d80c3560 con 0x7f40d80a8080 2023-08-17T17:46:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.080+0000 7f40dcdc7700 1 -- 172.21.15.78:0/791751302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d8047350 con 0x7f40d80a8080 2023-08-17T17:46:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.080+0000 7f40ce7fc700 1 -- 172.21.15.78:0/791751302 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f40c001b460 con 0x7f40d80a8080 2023-08-17T17:46:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.081+0000 7f40ce7fc700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40b805ed90 0x7f40b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.081+0000 7f40ce7fc700 1 -- 172.21.15.78:0/791751302 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f40c0079d30 con 0x7f40d80a8080 2023-08-17T17:46:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.081+0000 7f40d659c700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40b805ed90 0x7f40b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.081+0000 7f40d659c700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40b805ed90 0x7f40b8061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f40c8006fd0 tx=0x7f40c8008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:56.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.085+0000 7f40ce7fc700 1 -- 172.21.15.78:0/791751302 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f40c004b270 con 0x7f40d80a8080 2023-08-17T17:46:56.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.292+0000 7f40dcdc7700 1 -- 172.21.15.78:0/791751302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40d80c6e10 con 0x7f40d80a8080 2023-08-17T17:46:56.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.293+0000 7f40ce7fc700 1 -- 172.21.15.78:0/791751302 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f40c004e890 con 0x7f40d80a8080 2023-08-17T17:46:56.295 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:56.295 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5090,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2346190042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2346190042},{"type":"v1","addr":"172.21.15.150:6834","nonce":2346190042}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2674101879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2674101879},{"type":"v1","addr":"172.21.15.78:6837","nonce":2674101879}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5745,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1609000139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1609000139},{"type":"v1","addr":"172.21.15.78:6836","nonce":1609000139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:46:53.930414+0000","modified":"2023-08-17T17:46:55.941460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/412084175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":412084175},{"type":"v1","addr":"172.21.15.150:6835","nonce":412084175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T17:46:56.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 -- 172.21.15.78:0/791751302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40b805ed90 msgr2=0x7f40b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40b805ed90 0x7f40b8061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f40c8006fd0 tx=0x7f40c8008040).stop 2023-08-17T17:46:56.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 -- 172.21.15.78:0/791751302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 msgr2=0x7f40d80ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 0x7f40d80ca560 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f40c000c880 tx=0x7f40c0008040).stop 2023-08-17T17:46:56.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 -- 172.21.15.78:0/791751302 shutdown_connections 2023-08-17T17:46:56.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f40b805ed90 0x7f40b8061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40d8154140 0x7f40d80caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40d80a7c40 0x7f40d8142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 --2- 172.21.15.78:0/791751302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d80a8080 0x7f40d80ca560 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 -- 172.21.15.78:0/791751302 >> 172.21.15.78:0/791751302 conn(0x7f40d8094510 msgr2=0x7f40d80a9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:56.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 -- 172.21.15.78:0/791751302 shutdown_connections 2023-08-17T17:46:56.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.295+0000 7f40dcdc7700 1 -- 172.21.15.78:0/791751302 wait complete. 2023-08-17T17:46:56.298 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 19 2023-08-17T17:46:56.308 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:46:56.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.419+0000 7fc12d34a700 1 Processor -- start 2023-08-17T17:46:56.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.419+0000 7fc12d34a700 1 -- start start 2023-08-17T17:46:56.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc12d34a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1280c01b0 0x7fc1280c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc12d34a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc1280a7bd0 0x7fc128063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc12d34a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280a8050 0x7fc1280642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc12d34a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc128063960 con 0x7fc1280c01b0 2023-08-17T17:46:56.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc12d34a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc128063030 con 0x7fc1280a7bd0 2023-08-17T17:46:56.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc12d34a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc128063310 con 0x7fc1280a8050 2023-08-17T17:46:56.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc127fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1280c01b0 0x7fc1280c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc127fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1280c01b0 0x7fc1280c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37024/0 (socket says 172.21.15.78:37024) 2023-08-17T17:46:56.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc127fff700 1 -- 172.21.15.78:0/3762060988 learned_addr learned my addr 172.21.15.78:0/3762060988 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc1277fe700 1 --2- 172.21.15.78:0/3762060988 >> v2:172.21.15.150:3300/0 conn(0x7fc1280a7bd0 0x7fc128063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc127fff700 1 -- 172.21.15.78:0/3762060988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280a8050 msgr2=0x7fc1280642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc12cb49700 1 --2- 172.21.15.78:0/3762060988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280a8050 0x7fc1280642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc127fff700 1 --2- 172.21.15.78:0/3762060988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280a8050 0x7fc1280642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc127fff700 1 -- 172.21.15.78:0/3762060988 >> v2:172.21.15.150:3300/0 conn(0x7fc1280a7bd0 msgr2=0x7fc128063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc127fff700 1 --2- 172.21.15.78:0/3762060988 >> v2:172.21.15.150:3300/0 conn(0x7fc1280a7bd0 0x7fc128063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc127fff700 1 -- 172.21.15.78:0/3762060988 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280635f0 con 0x7fc1280c01b0 2023-08-17T17:46:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc1277fe700 1 --2- 172.21.15.78:0/3762060988 >> v2:172.21.15.150:3300/0 conn(0x7fc1280a7bd0 0x7fc128063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.420+0000 7fc127fff700 1 --2- 172.21.15.78:0/3762060988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280c01b0 0x7fc1280c5b90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fc128098d60 tx=0x7fc1180090f0).ready entity=mon.0 client_cookie=47330a5d330fe583 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc126ffd700 1 -- 172.21.15.78:0/3762060988 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11800b600 con 0x7fc1280c01b0 2023-08-17T17:46:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc126ffd700 1 -- 172.21.15.78:0/3762060988 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11800b760 con 0x7fc1280c01b0 2023-08-17T17:46:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc126ffd700 1 -- 172.21.15.78:0/3762060988 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11800bae0 con 0x7fc1280c01b0 2023-08-17T17:46:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc12d34a700 1 -- 172.21.15.78:0/3762060988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280c01b0 msgr2=0x7fc1280c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc12d34a700 1 --2- 172.21.15.78:0/3762060988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280c01b0 0x7fc1280c5b90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fc128098d60 tx=0x7fc1180090f0).stop 2023-08-17T17:46:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc12d34a700 1 -- 172.21.15.78:0/3762060988 shutdown_connections 2023-08-17T17:46:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc12d34a700 1 --2- 172.21.15.78:0/3762060988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280c01b0 0x7fc1280c5b90 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc12d34a700 1 --2- 172.21.15.78:0/3762060988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280a8050 0x7fc1280642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc12d34a700 1 --2- 172.21.15.78:0/3762060988 >> v2:172.21.15.150:3300/0 conn(0x7fc1280a7bd0 0x7fc128063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc12d34a700 1 -- 172.21.15.78:0/3762060988 >> 172.21.15.78:0/3762060988 conn(0x7fc12806a6c0 msgr2=0x7fc1280cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc12d34a700 1 -- 172.21.15.78:0/3762060988 shutdown_connections 2023-08-17T17:46:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.421+0000 7fc12d34a700 1 -- 172.21.15.78:0/3762060988 wait complete. 2023-08-17T17:46:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.422+0000 7fc12d34a700 1 Processor -- start 2023-08-17T17:46:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.422+0000 7fc12d34a700 1 -- start start 2023-08-17T17:46:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.423+0000 7fc12d34a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280a7bd0 0x7fc12814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.423+0000 7fc12d34a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1280a8050 0x7fc1280c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.423+0000 7fc12d34a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280c01b0 0x7fc1280b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.423+0000 7fc12d34a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280c5120 con 0x7fc1280a7bd0 2023-08-17T17:46:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.423+0000 7fc12d34a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1281570c0 con 0x7fc1280a8050 2023-08-17T17:46:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.423+0000 7fc12d34a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280c22d0 con 0x7fc1280c01b0 2023-08-17T17:46:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.423+0000 7fc127fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280a7bd0 0x7fc12814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.423+0000 7fc127fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280a7bd0 0x7fc12814ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37028/0 (socket says 172.21.15.78:37028) 2023-08-17T17:46:56.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.423+0000 7fc127fff700 1 -- 172.21.15.78:0/1381790820 learned_addr learned my addr 172.21.15.78:0/1381790820 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:56.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.423+0000 7fc1277fe700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1280a8050 0x7fc1280c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc12cb49700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280c01b0 0x7fc1280b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc127fff700 1 -- 172.21.15.78:0/1381790820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280c01b0 msgr2=0x7fc1280b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc127fff700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280c01b0 0x7fc1280b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc127fff700 1 -- 172.21.15.78:0/1381790820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1280a8050 msgr2=0x7fc1280c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc127fff700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1280a8050 0x7fc1280c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc127fff700 1 -- 172.21.15.78:0/1381790820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118009370 con 0x7fc1280a7bd0 2023-08-17T17:46:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc12cb49700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280c01b0 0x7fc1280b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc127fff700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280a7bd0 0x7fc12814ebd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fc118009130 tx=0x7fc118017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc10ffff700 1 -- 172.21.15.78:0/1381790820 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11800bae0 con 0x7fc1280a7bd0 2023-08-17T17:46:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc10ffff700 1 -- 172.21.15.78:0/1381790820 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc118000c90 con 0x7fc1280a7bd0 2023-08-17T17:46:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc12d34a700 1 -- 172.21.15.78:0/1381790820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1280c47f0 con 0x7fc1280a7bd0 2023-08-17T17:46:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc10ffff700 1 -- 172.21.15.78:0/1381790820 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11801c650 con 0x7fc1280a7bd0 2023-08-17T17:46:56.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.424+0000 7fc12d34a700 1 -- 172.21.15.78:0/1381790820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1280c4db0 con 0x7fc1280a7bd0 2023-08-17T17:46:56.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.425+0000 7fc12d34a700 1 -- 172.21.15.78:0/1381790820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1280ae7b0 con 0x7fc1280a7bd0 2023-08-17T17:46:56.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.425+0000 7fc10ffff700 1 -- 172.21.15.78:0/1381790820 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc11800f070 con 0x7fc1280a7bd0 2023-08-17T17:46:56.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.425+0000 7fc10ffff700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc11405ed90 0x7fc114061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.426+0000 7fc10ffff700 1 -- 172.21.15.78:0/1381790820 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc11807b340 con 0x7fc1280a7bd0 2023-08-17T17:46:56.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.426+0000 7fc1277fe700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc11405ed90 0x7fc114061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.426+0000 7fc1277fe700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc11405ed90 0x7fc114061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc128098970 tx=0x7fc11c008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:56.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.430+0000 7fc10ffff700 1 -- 172.21.15.78:0/1381790820 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc118050310 con 0x7fc1280a7bd0 2023-08-17T17:46:56.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.592+0000 7fc12d34a700 1 -- 172.21.15.78:0/1381790820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1280c63e0 con 0x7fc1280a7bd0 2023-08-17T17:46:56.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.593+0000 7fc10ffff700 1 -- 172.21.15.78:0/1381790820 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fc118020020 con 0x7fc1280a7bd0 2023-08-17T17:46:56.595 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:56.595 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":60,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:46:54.933044+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:46:52.467922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T17:46:52.895738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:46:56.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.595+0000 7fc12d34a700 1 -- 172.21.15.78:0/1381790820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc11405ed90 msgr2=0x7fc114061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.595+0000 7fc12d34a700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc11405ed90 0x7fc114061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc128098970 tx=0x7fc11c008040).stop 2023-08-17T17:46:56.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.595+0000 7fc12d34a700 1 -- 172.21.15.78:0/1381790820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280a7bd0 msgr2=0x7fc12814ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.595+0000 7fc12d34a700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280a7bd0 0x7fc12814ebd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fc118009130 tx=0x7fc118017000).stop 2023-08-17T17:46:56.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.595+0000 7fc12d34a700 1 -- 172.21.15.78:0/1381790820 shutdown_connections 2023-08-17T17:46:56.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.595+0000 7fc12d34a700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc11405ed90 0x7fc114061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.595+0000 7fc12d34a700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1280c01b0 0x7fc1280b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.595+0000 7fc12d34a700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1280a7bd0 0x7fc12814ebd0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.595+0000 7fc12d34a700 1 --2- 172.21.15.78:0/1381790820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1280a8050 0x7fc1280c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.595+0000 7fc12d34a700 1 -- 172.21.15.78:0/1381790820 >> 172.21.15.78:0/1381790820 conn(0x7fc12806a6c0 msgr2=0x7fc1280c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:56.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.596+0000 7fc12d34a700 1 -- 172.21.15.78:0/1381790820 shutdown_connections 2023-08-17T17:46:56.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.596+0000 7fc12d34a700 1 -- 172.21.15.78:0/1381790820 wait complete. 2023-08-17T17:46:56.609 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T17:46:56.609 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:46:56.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.721+0000 7f8f7d9ae700 1 Processor -- start 2023-08-17T17:46:56.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.721+0000 7f8f7d9ae700 1 -- start start 2023-08-17T17:46:56.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.721+0000 7f8f7d9ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f78154140 0x7f8f780c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.721+0000 7f8f7d9ae700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f780a7c40 0x7f8f780c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.721+0000 7f8f7d9ae700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f78154520 con 0x7f8f780a8080 2023-08-17T17:46:56.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.721+0000 7f8f7d9ae700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f780c91e0 con 0x7f8f780a7c40 2023-08-17T17:46:56.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.721+0000 7f8f7d9ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780c94c0 con 0x7f8f78154140 2023-08-17T17:46:56.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f767fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f780a7c40 0x7f8f780c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f777fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8f780a8080 0x7f8f780ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50028/0 (socket says 172.21.15.78:50028) 2023-08-17T17:46:56.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f777fe700 1 -- 172.21.15.78:0/871391563 learned_addr learned my addr 172.21.15.78:0/871391563 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:56.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f76ffd700 1 --2- 172.21.15.78:0/871391563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f78154140 0x7f8f780c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f767fc700 1 -- 172.21.15.78:0/871391563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f78154140 msgr2=0x7f8f780c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f767fc700 1 --2- 172.21.15.78:0/871391563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f78154140 0x7f8f780c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f767fc700 1 -- 172.21.15.78:0/871391563 >> v1:172.21.15.78:6789/0 conn(0x7f8f780a8080 legacy=0x7f8f780ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f767fc700 1 -- 172.21.15.78:0/871391563 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780c97a0 con 0x7f8f780a7c40 2023-08-17T17:46:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f767fc700 1 --2- 172.21.15.78:0/871391563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a7c40 0x7f8f780c0900 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f8f60009760 tx=0x7f8f60009060).ready entity=mon.0 client_cookie=87306ca55b9a2ce8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f75ffb700 1 -- 172.21.15.78:0/871391563 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000b580 con 0x7f8f780a7c40 2023-08-17T17:46:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f75ffb700 1 -- 172.21.15.78:0/871391563 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6000b6e0 con 0x7f8f780a7c40 2023-08-17T17:46:56.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.722+0000 7f8f75ffb700 1 -- 172.21.15.78:0/871391563 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000ba60 con 0x7f8f780a7c40 2023-08-17T17:46:56.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.723+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/871391563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a7c40 msgr2=0x7f8f780c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.723+0000 7f8f7d9ae700 1 --2- 172.21.15.78:0/871391563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a7c40 0x7f8f780c0900 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f8f60009760 tx=0x7f8f60009060).stop 2023-08-17T17:46:56.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.723+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/871391563 shutdown_connections 2023-08-17T17:46:56.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.723+0000 7f8f7d9ae700 1 --2- 172.21.15.78:0/871391563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f78154140 0x7f8f780c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.723+0000 7f8f7d9ae700 1 --2- 172.21.15.78:0/871391563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a7c40 0x7f8f780c0900 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.723+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/871391563 >> 172.21.15.78:0/871391563 conn(0x7f8f78094510 msgr2=0x7f8f7806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:56.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.723+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/871391563 shutdown_connections 2023-08-17T17:46:56.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.723+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/871391563 wait complete. 2023-08-17T17:46:56.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.724+0000 7f8f7d9ae700 1 Processor -- start 2023-08-17T17:46:56.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.724+0000 7f8f7d9ae700 1 -- start start 2023-08-17T17:46:56.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f7d9ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f780a7c40 0x7f8f7814dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f7d9ae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a8080 0x7f8f7814f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f7d9ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f78154140 0x7f8f78152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f7d9ae700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780b0a30 con 0x7f8f780a8080 2023-08-17T17:46:56.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f7d9ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780aec70 con 0x7f8f78154140 2023-08-17T17:46:56.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f7d9ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780af230 con 0x7f8f780a7c40 2023-08-17T17:46:56.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f767fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a8080 0x7f8f7814f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f767fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a8080 0x7f8f7814f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37058/0 (socket says 172.21.15.78:37058) 2023-08-17T17:46:56.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f767fc700 1 -- 172.21.15.78:0/397320256 learned_addr learned my addr 172.21.15.78:0/397320256 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:56.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f767fc700 1 -- 172.21.15.78:0/397320256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f780a7c40 msgr2=0x7f8f7814dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f767fc700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f780a7c40 0x7f8f7814dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:56.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f767fc700 1 -- 172.21.15.78:0/397320256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f78154140 msgr2=0x7f8f78152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f767fc700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f78154140 0x7f8f78152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:56.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f767fc700 1 -- 172.21.15.78:0/397320256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f600092a0 con 0x7f8f780a8080 2023-08-17T17:46:56.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f767fc700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a8080 0x7f8f7814f2b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f8f7806c200 tx=0x7f8f60017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:56.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f6effd700 1 -- 172.21.15.78:0/397320256 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000b850 con 0x7f8f780a8080 2023-08-17T17:46:56.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f6effd700 1 -- 172.21.15.78:0/397320256 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6000b9b0 con 0x7f8f780a8080 2023-08-17T17:46:56.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/397320256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7814e4d0 con 0x7f8f780a8080 2023-08-17T17:46:56.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f6effd700 1 -- 172.21.15.78:0/397320256 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6001b660 con 0x7f8f780a8080 2023-08-17T17:46:56.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.725+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/397320256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f78150250 con 0x7f8f780a8080 2023-08-17T17:46:56.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.726+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/397320256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f78150440 con 0x7f8f780a8080 2023-08-17T17:46:56.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.727+0000 7f8f6effd700 1 -- 172.21.15.78:0/397320256 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8f6002b070 con 0x7f8f780a8080 2023-08-17T17:46:56.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.727+0000 7f8f6effd700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f5805ed90 0x7f8f58061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:56.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.727+0000 7f8f6effd700 1 -- 172.21.15.78:0/397320256 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8f6007b510 con 0x7f8f780a8080 2023-08-17T17:46:56.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.727+0000 7f8f76ffd700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f5805ed90 0x7f8f58061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:56.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.727+0000 7f8f76ffd700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f5805ed90 0x7f8f58061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8f7805fd20 tx=0x7f8f70009970).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:56.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.731+0000 7f8f6effd700 1 -- 172.21.15.78:0/397320256 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8f6004cab0 con 0x7f8f780a8080 2023-08-17T17:46:56.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.891+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/397320256 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f7814e660 con 0x7f8f5805ed90 2023-08-17T17:46:56.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.901+0000 7f8f6effd700 1 -- 172.21.15.78:0/397320256 <== mgr.5568 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359287 (secure 0 0 0) 0x7f8f7814e660 con 0x7f8f5805ed90 2023-08-17T17:46:56.906 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:56.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/397320256 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f5805ed90 msgr2=0x7f8f58061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f5805ed90 0x7f8f58061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8f7805fd20 tx=0x7f8f70009970).stop 2023-08-17T17:46:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/397320256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a8080 msgr2=0x7f8f7814f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a8080 0x7f8f7814f2b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f8f7806c200 tx=0x7f8f60017000).stop 2023-08-17T17:46:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/397320256 shutdown_connections 2023-08-17T17:46:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f5805ed90 0x7f8f58061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f78154140 0x7f8f78152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f780a7c40 0x7f8f7814dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 --2- 172.21.15.78:0/397320256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f780a8080 0x7f8f7814f2b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/397320256 >> 172.21.15.78:0/397320256 conn(0x7f8f78094510 msgr2=0x7f8f780cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:56.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/397320256 shutdown_connections 2023-08-17T17:46:56.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:56.905+0000 7f8f7d9ae700 1 -- 172.21.15.78:0/397320256 wait complete. 2023-08-17T17:46:56.910 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:46:56.918 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-17T17:46:54.951025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2394384,"kb_used_data":5328,"kb_used_omap":0,"kb_used_meta":2388992,"kb_avail":752580336,"statfs":{"total":773094113280,"available":770642264064,"internally_reserved":0,"allocated":5455872,"data_stored":2621940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2446327808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14991300,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-715,"num_write_kb":-15540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.584838"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940561+0000","last_change":"2023-08-17T17:46:53.940679+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940561+0000","last_undegraded":"2023-08-17T17:46:53.940561+0000","last_fullsized":"2023-08-17T17:46:53.940561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590226+0000","last_change":"2023-08-17T17:46:53.588790+0000","last_active":"2023-08-17T17:46:53.590226+0000","last_peered":"2023-08-17T17:46:53.590226+0000","last_clean":"2023-08-17T17:46:53.590226+0000","last_became_active":"2023-08-17T17:46:53.588320+0000","last_became_peered":"2023-08-17T17:46:53.588320+0000","last_unstale":"2023-08-17T17:46:53.590226+0000","last_undegraded":"2023-08-17T17:46:53.590226+0000","last_fullsized":"2023-08-17T17:46:53.590226+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944374+0000","last_change":"2023-08-17T17:46:53.944501+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944374+0000","last_undegraded":"2023-08-17T17:46:53.944374+0000","last_fullsized":"2023-08-17T17:46:53.944374+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593232+0000","last_change":"2023-08-17T17:46:53.591003+0000","last_active":"2023-08-17T17:46:53.593232+0000","last_peered":"2023-08-17T17:46:53.593232+0000","last_clean":"2023-08-17T17:46:53.593232+0000","last_became_active":"2023-08-17T17:46:53.590718+0000","last_became_peered":"2023-08-17T17:46:53.590718+0000","last_unstale":"2023-08-17T17:46:53.593232+0000","last_undegraded":"2023-08-17T17:46:53.593232+0000","last_fullsized":"2023-08-17T17:46:53.593232+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942803+0000","last_change":"2023-08-17T17:46:53.942946+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942803+0000","last_undegraded":"2023-08-17T17:46:53.942803+0000","last_fullsized":"2023-08-17T17:46:53.942803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586289+0000","last_change":"2023-08-17T17:46:53.582491+0000","last_active":"2023-08-17T17:46:53.586289+0000","last_peered":"2023-08-17T17:46:53.586289+0000","last_clean":"2023-08-17T17:46:53.586289+0000","last_became_active":"2023-08-17T17:46:53.582209+0000","last_became_peered":"2023-08-17T17:46:53.582209+0000","last_unstale":"2023-08-17T17:46:53.586289+0000","last_undegraded":"2023-08-17T17:46:53.586289+0000","last_fullsized":"2023-08-17T17:46:53.586289+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943450+0000","last_change":"2023-08-17T17:46:53.943567+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943450+0000","last_undegraded":"2023-08-17T17:46:53.943450+0000","last_fullsized":"2023-08-17T17:46:53.943450+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590908+0000","last_change":"2023-08-17T17:46:53.582713+0000","last_active":"2023-08-17T17:46:53.590908+0000","last_peered":"2023-08-17T17:46:53.590908+0000","last_clean":"2023-08-17T17:46:53.590908+0000","last_became_active":"2023-08-17T17:46:53.582461+0000","last_became_peered":"2023-08-17T17:46:53.582461+0000","last_unstale":"2023-08-17T17:46:53.590908+0000","last_undegraded":"2023-08-17T17:46:53.590908+0000","last_fullsized":"2023-08-17T17:46:53.590908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940203+0000","last_change":"2023-08-17T17:46:53.940323+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940203+0000","last_undegraded":"2023-08-17T17:46:53.940203+0000","last_fullsized":"2023-08-17T17:46:53.940203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593671+0000","last_change":"2023-08-17T17:46:53.592771+0000","last_active":"2023-08-17T17:46:53.593671+0000","last_peered":"2023-08-17T17:46:53.593671+0000","last_clean":"2023-08-17T17:46:53.593671+0000","last_became_active":"2023-08-17T17:46:53.592489+0000","last_became_peered":"2023-08-17T17:46:53.592489+0000","last_unstale":"2023-08-17T17:46:53.593671+0000","last_undegraded":"2023-08-17T17:46:53.593671+0000","last_fullsized":"2023-08-17T17:46:53.593671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939101+0000","last_change":"2023-08-17T17:46:53.939239+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939101+0000","last_undegraded":"2023-08-17T17:46:53.939101+0000","last_fullsized":"2023-08-17T17:46:53.939101+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.588813+0000","last_change":"2023-08-17T17:46:53.587114+0000","last_active":"2023-08-17T17:46:53.588813+0000","last_peered":"2023-08-17T17:46:53.588813+0000","last_clean":"2023-08-17T17:46:53.588813+0000","last_became_active":"2023-08-17T17:46:53.586795+0000","last_became_peered":"2023-08-17T17:46:53.586795+0000","last_unstale":"2023-08-17T17:46:53.588813+0000","last_undegraded":"2023-08-17T17:46:53.588813+0000","last_fullsized":"2023-08-17T17:46:53.588813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940224+0000","last_change":"2023-08-17T17:46:53.940345+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940224+0000","last_undegraded":"2023-08-17T17:46:53.940224+0000","last_fullsized":"2023-08-17T17:46:53.940224+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595075+0000","last_change":"2023-08-17T17:46:53.594476+0000","last_active":"2023-08-17T17:46:53.595075+0000","last_peered":"2023-08-17T17:46:53.595075+0000","last_clean":"2023-08-17T17:46:53.595075+0000","last_became_active":"2023-08-17T17:46:53.594195+0000","last_became_peered":"2023-08-17T17:46:53.594195+0000","last_unstale":"2023-08-17T17:46:53.595075+0000","last_undegraded":"2023-08-17T17:46:53.595075+0000","last_fullsized":"2023-08-17T17:46:53.595075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940236+0000","last_change":"2023-08-17T17:46:53.940343+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940236+0000","last_undegraded":"2023-08-17T17:46:53.940236+0000","last_fullsized":"2023-08-17T17:46:53.940236+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592124+0000","last_change":"2023-08-17T17:46:53.584269+0000","last_active":"2023-08-17T17:46:53.592124+0000","last_peered":"2023-08-17T17:46:53.592124+0000","last_clean":"2023-08-17T17:46:53.592124+0000","last_became_active":"2023-08-17T17:46:53.583408+0000","last_became_peered":"2023-08-17T17:46:53.583408+0000","last_unstale":"2023-08-17T17:46:53.592124+0000","last_undegraded":"2023-08-17T17:46:53.592124+0000","last_fullsized":"2023-08-17T17:46:53.592124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940328+0000","last_change":"2023-08-17T17:46:53.940447+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940328+0000","last_undegraded":"2023-08-17T17:46:53.940328+0000","last_fullsized":"2023-08-17T17:46:53.940328+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591631+0000","last_change":"2023-08-17T17:46:53.585244+0000","last_active":"2023-08-17T17:46:53.591631+0000","last_peered":"2023-08-17T17:46:53.591631+0000","last_clean":"2023-08-17T17:46:53.591631+0000","last_became_active":"2023-08-17T17:46:53.584478+0000","last_became_peered":"2023-08-17T17:46:53.584478+0000","last_unstale":"2023-08-17T17:46:53.591631+0000","last_undegraded":"2023-08-17T17:46:53.591631+0000","last_fullsized":"2023-08-17T17:46:53.591631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944635+0000","last_change":"2023-08-17T17:46:53.944753+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944635+0000","last_undegraded":"2023-08-17T17:46:53.944635+0000","last_fullsized":"2023-08-17T17:46:53.944635+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592109+0000","last_change":"2023-08-17T17:46:53.585467+0000","last_active":"2023-08-17T17:46:53.592109+0000","last_peered":"2023-08-17T17:46:53.592109+0000","last_clean":"2023-08-17T17:46:53.592109+0000","last_became_active":"2023-08-17T17:46:53.585163+0000","last_became_peered":"2023-08-17T17:46:53.585163+0000","last_unstale":"2023-08-17T17:46:53.592109+0000","last_undegraded":"2023-08-17T17:46:53.592109+0000","last_fullsized":"2023-08-17T17:46:53.592109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940255+0000","last_change":"2023-08-17T17:46:53.940392+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940255+0000","last_undegraded":"2023-08-17T17:46:53.940255+0000","last_fullsized":"2023-08-17T17:46:53.940255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593121+0000","last_change":"2023-08-17T17:46:53.582814+0000","last_active":"2023-08-17T17:46:53.593121+0000","last_peered":"2023-08-17T17:46:53.593121+0000","last_clean":"2023-08-17T17:46:53.593121+0000","last_became_active":"2023-08-17T17:46:53.582554+0000","last_became_peered":"2023-08-17T17:46:53.582554+0000","last_unstale":"2023-08-17T17:46:53.593121+0000","last_undegraded":"2023-08-17T17:46:53.593121+0000","last_fullsized":"2023-08-17T17:46:53.593121+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938396+0000","last_change":"2023-08-17T17:46:53.938647+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938396+0000","last_undegraded":"2023-08-17T17:46:53.938396+0000","last_fullsized":"2023-08-17T17:46:53.938396+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587294+0000","last_change":"2023-08-17T17:46:53.582218+0000","last_active":"2023-08-17T17:46:53.587294+0000","last_peered":"2023-08-17T17:46:53.587294+0000","last_clean":"2023-08-17T17:46:53.587294+0000","last_became_active":"2023-08-17T17:46:53.581840+0000","last_became_peered":"2023-08-17T17:46:53.581840+0000","last_unstale":"2023-08-17T17:46:53.587294+0000","last_undegraded":"2023-08-17T17:46:53.587294+0000","last_fullsized":"2023-08-17T17:46:53.587294+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945327+0000","last_change":"2023-08-17T17:46:53.945464+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945327+0000","last_undegraded":"2023-08-17T17:46:53.945327+0000","last_fullsized":"2023-08-17T17:46:53.945327+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594346+0000","last_change":"2023-08-17T17:46:53.591437+0000","last_active":"2023-08-17T17:46:53.594346+0000","last_peered":"2023-08-17T17:46:53.594346+0000","last_clean":"2023-08-17T17:46:53.594346+0000","last_became_active":"2023-08-17T17:46:53.591145+0000","last_became_peered":"2023-08-17T17:46:53.591145+0000","last_unstale":"2023-08-17T17:46:53.594346+0000","last_undegraded":"2023-08-17T17:46:53.594346+0000","last_fullsized":"2023-08-17T17:46:53.594346+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942957+0000","last_change":"2023-08-17T17:46:53.943086+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942957+0000","last_undegraded":"2023-08-17T17:46:53.942957+0000","last_fullsized":"2023-08-17T17:46:53.942957+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591703+0000","last_change":"2023-08-17T17:46:53.586078+0000","last_active":"2023-08-17T17:46:53.591703+0000","last_peered":"2023-08-17T17:46:53.591703+0000","last_clean":"2023-08-17T17:46:53.591703+0000","last_became_active":"2023-08-17T17:46:53.585831+0000","last_became_peered":"2023-08-17T17:46:53.585831+0000","last_unstale":"2023-08-17T17:46:53.591703+0000","last_undegraded":"2023-08-17T17:46:53.591703+0000","last_fullsized":"2023-08-17T17:46:53.591703+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944495+0000","last_change":"2023-08-17T17:46:53.944657+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944495+0000","last_undegraded":"2023-08-17T17:46:53.944495+0000","last_fullsized":"2023-08-17T17:46:53.944495+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587539+0000","last_change":"2023-08-17T17:46:53.575072+0000","last_active":"2023-08-17T17:46:53.587539+0000","last_peered":"2023-08-17T17:46:53.587539+0000","last_clean":"2023-08-17T17:46:53.587539+0000","last_became_active":"2023-08-17T17:46:53.574793+0000","last_became_peered":"2023-08-17T17:46:53.574793+0000","last_unstale":"2023-08-17T17:46:53.587539+0000","last_undegraded":"2023-08-17T17:46:53.587539+0000","last_fullsized":"2023-08-17T17:46:53.587539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941728+0000","last_change":"2023-08-17T17:46:53.941848+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941728+0000","last_undegraded":"2023-08-17T17:46:53.941728+0000","last_fullsized":"2023-08-17T17:46:53.941728+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593840+0000","last_change":"2023-08-17T17:46:53.592156+0000","last_active":"2023-08-17T17:46:53.593840+0000","last_peered":"2023-08-17T17:46:53.593840+0000","last_clean":"2023-08-17T17:46:53.593840+0000","last_became_active":"2023-08-17T17:46:53.591901+0000","last_became_peered":"2023-08-17T17:46:53.591901+0000","last_unstale":"2023-08-17T17:46:53.593840+0000","last_undegraded":"2023-08-17T17:46:53.593840+0000","last_fullsized":"2023-08-17T17:46:53.593840+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.943747+0000","last_change":"2023-08-17T17:46:53.943829+0000","last_active":"2023-08-17T17:46:53.943747+0000","last_peered":"2023-08-17T17:46:53.943747+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.943505+0000","last_became_peered":"2023-08-17T17:46:53.943505+0000","last_unstale":"2023-08-17T17:46:53.943747+0000","last_undegraded":"2023-08-17T17:46:53.943747+0000","last_fullsized":"2023-08-17T17:46:53.943747+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586303+0000","last_change":"2023-08-17T17:46:53.580728+0000","last_active":"2023-08-17T17:46:53.586303+0000","last_peered":"2023-08-17T17:46:53.586303+0000","last_clean":"2023-08-17T17:46:53.586303+0000","last_became_active":"2023-08-17T17:46:53.580452+0000","last_became_peered":"2023-08-17T17:46:53.580452+0000","last_unstale":"2023-08-17T17:46:53.586303+0000","last_undegraded":"2023-08-17T17:46:53.586303+0000","last_fullsized":"2023-08-17T17:46:53.586303+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.947036+0000","last_change":"2023-08-17T17:46:53.947661+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.947036+0000","last_undegraded":"2023-08-17T17:46:53.947036+0000","last_fullsized":"2023-08-17T17:46:53.947036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593827+0000","last_change":"2023-08-17T17:46:53.592847+0000","last_active":"2023-08-17T17:46:53.593827+0000","last_peered":"2023-08-17T17:46:53.593827+0000","last_clean":"2023-08-17T17:46:53.593827+0000","last_became_active":"2023-08-17T17:46:53.592477+0000","last_became_peered":"2023-08-17T17:46:53.592477+0000","last_unstale":"2023-08-17T17:46:53.593827+0000","last_undegraded":"2023-08-17T17:46:53.593827+0000","last_fullsized":"2023-08-17T17:46:53.593827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943978+0000","last_change":"2023-08-17T17:46:53.944133+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943978+0000","last_undegraded":"2023-08-17T17:46:53.943978+0000","last_fullsized":"2023-08-17T17:46:53.943978+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592092+0000","last_change":"2023-08-17T17:46:53.590998+0000","last_active":"2023-08-17T17:46:53.592092+0000","last_peered":"2023-08-17T17:46:53.592092+0000","last_clean":"2023-08-17T17:46:53.592092+0000","last_became_active":"2023-08-17T17:46:53.590681+0000","last_became_peered":"2023-08-17T17:46:53.590681+0000","last_unstale":"2023-08-17T17:46:53.592092+0000","last_undegraded":"2023-08-17T17:46:53.592092+0000","last_fullsized":"2023-08-17T17:46:53.592092+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943168+0000","last_change":"2023-08-17T17:46:53.943291+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943168+0000","last_undegraded":"2023-08-17T17:46:53.943168+0000","last_fullsized":"2023-08-17T17:46:53.943168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.597850+0000","last_change":"2023-08-17T17:46:53.593024+0000","last_active":"2023-08-17T17:46:53.597850+0000","last_peered":"2023-08-17T17:46:53.597850+0000","last_clean":"2023-08-17T17:46:53.597850+0000","last_became_active":"2023-08-17T17:46:53.592759+0000","last_became_peered":"2023-08-17T17:46:53.592759+0000","last_unstale":"2023-08-17T17:46:53.597850+0000","last_undegraded":"2023-08-17T17:46:53.597850+0000","last_fullsized":"2023-08-17T17:46:53.597850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941047+0000","last_change":"2023-08-17T17:46:53.941852+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941047+0000","last_undegraded":"2023-08-17T17:46:53.941047+0000","last_fullsized":"2023-08-17T17:46:53.941047+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587734+0000","last_change":"2023-08-17T17:46:53.577716+0000","last_active":"2023-08-17T17:46:53.587734+0000","last_peered":"2023-08-17T17:46:53.587734+0000","last_clean":"2023-08-17T17:46:53.587734+0000","last_became_active":"2023-08-17T17:46:53.576999+0000","last_became_peered":"2023-08-17T17:46:53.576999+0000","last_unstale":"2023-08-17T17:46:53.587734+0000","last_undegraded":"2023-08-17T17:46:53.587734+0000","last_fullsized":"2023-08-17T17:46:53.587734+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943877+0000","last_change":"2023-08-17T17:46:53.943984+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943877+0000","last_undegraded":"2023-08-17T17:46:53.943877+0000","last_fullsized":"2023-08-17T17:46:53.943877+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590702+0000","last_change":"2023-08-17T17:46:53.583067+0000","last_active":"2023-08-17T17:46:53.590702+0000","last_peered":"2023-08-17T17:46:53.590702+0000","last_clean":"2023-08-17T17:46:53.590702+0000","last_became_active":"2023-08-17T17:46:53.582373+0000","last_became_peered":"2023-08-17T17:46:53.582373+0000","last_unstale":"2023-08-17T17:46:53.590702+0000","last_undegraded":"2023-08-17T17:46:53.590702+0000","last_fullsized":"2023-08-17T17:46:53.590702+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941545+0000","last_change":"2023-08-17T17:46:53.941639+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941545+0000","last_undegraded":"2023-08-17T17:46:53.941545+0000","last_fullsized":"2023-08-17T17:46:53.941545+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589458+0000","last_change":"2023-08-17T17:46:53.587208+0000","last_active":"2023-08-17T17:46:53.589458+0000","last_peered":"2023-08-17T17:46:53.589458+0000","last_clean":"2023-08-17T17:46:53.589458+0000","last_became_active":"2023-08-17T17:46:53.586922+0000","last_became_peered":"2023-08-17T17:46:53.586922+0000","last_unstale":"2023-08-17T17:46:53.589458+0000","last_undegraded":"2023-08-17T17:46:53.589458+0000","last_fullsized":"2023-08-17T17:46:53.589458+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952595+0000","last_change":"2023-08-17T17:46:53.952664+0000","last_active":"2023-08-17T17:46:53.952595+0000","last_peered":"2023-08-17T17:46:53.952595+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.952430+0000","last_became_peered":"2023-08-17T17:46:53.952430+0000","last_unstale":"2023-08-17T17:46:53.952595+0000","last_undegraded":"2023-08-17T17:46:53.952595+0000","last_fullsized":"2023-08-17T17:46:53.952595+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587376+0000","last_change":"2023-08-17T17:46:53.583496+0000","last_active":"2023-08-17T17:46:53.587376+0000","last_peered":"2023-08-17T17:46:53.587376+0000","last_clean":"2023-08-17T17:46:53.587376+0000","last_became_active":"2023-08-17T17:46:53.583200+0000","last_became_peered":"2023-08-17T17:46:53.583200+0000","last_unstale":"2023-08-17T17:46:53.587376+0000","last_undegraded":"2023-08-17T17:46:53.587376+0000","last_fullsized":"2023-08-17T17:46:53.587376+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944577+0000","last_change":"2023-08-17T17:46:53.944699+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944577+0000","last_undegraded":"2023-08-17T17:46:53.944577+0000","last_fullsized":"2023-08-17T17:46:53.944577+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593065+0000","last_change":"2023-08-17T17:46:53.591647+0000","last_active":"2023-08-17T17:46:53.593065+0000","last_peered":"2023-08-17T17:46:53.593065+0000","last_clean":"2023-08-17T17:46:53.593065+0000","last_became_active":"2023-08-17T17:46:53.591369+0000","last_became_peered":"2023-08-17T17:46:53.591369+0000","last_unstale":"2023-08-17T17:46:53.593065+0000","last_undegraded":"2023-08-17T17:46:53.593065+0000","last_fullsized":"2023-08-17T17:46:53.593065+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939609+0000","last_change":"2023-08-17T17:46:53.939758+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939609+0000","last_undegraded":"2023-08-17T17:46:53.939609+0000","last_fullsized":"2023-08-17T17:46:53.939609+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594295+0000","last_change":"2023-08-17T17:46:53.591137+0000","last_active":"2023-08-17T17:46:53.594295+0000","last_peered":"2023-08-17T17:46:53.594295+0000","last_clean":"2023-08-17T17:46:53.594295+0000","last_became_active":"2023-08-17T17:46:53.590561+0000","last_became_peered":"2023-08-17T17:46:53.590561+0000","last_unstale":"2023-08-17T17:46:53.594295+0000","last_undegraded":"2023-08-17T17:46:53.594295+0000","last_fullsized":"2023-08-17T17:46:53.594295+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939500+0000","last_change":"2023-08-17T17:46:53.939664+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939500+0000","last_undegraded":"2023-08-17T17:46:53.939500+0000","last_fullsized":"2023-08-17T17:46:53.939500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583400+0000","last_change":"2023-08-17T17:46:53.578788+0000","last_active":"2023-08-17T17:46:53.583400+0000","last_peered":"2023-08-17T17:46:53.583400+0000","last_clean":"2023-08-17T17:46:53.583400+0000","last_became_active":"2023-08-17T17:46:53.578283+0000","last_became_peered":"2023-08-17T17:46:53.578283+0000","last_unstale":"2023-08-17T17:46:53.583400+0000","last_undegraded":"2023-08-17T17:46:53.583400+0000","last_fullsized":"2023-08-17T17:46:53.583400+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952045+0000","last_change":"2023-08-17T17:46:53.952105+0000","last_active":"2023-08-17T17:46:53.952045+0000","last_peered":"2023-08-17T17:46:53.952045+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.951761+0000","last_became_peered":"2023-08-17T17:46:53.951761+0000","last_unstale":"2023-08-17T17:46:53.952045+0000","last_undegraded":"2023-08-17T17:46:53.952045+0000","last_fullsized":"2023-08-17T17:46:53.952045+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587277+0000","last_change":"2023-08-17T17:46:53.582134+0000","last_active":"2023-08-17T17:46:53.587277+0000","last_peered":"2023-08-17T17:46:53.587277+0000","last_clean":"2023-08-17T17:46:53.587277+0000","last_became_active":"2023-08-17T17:46:53.581821+0000","last_became_peered":"2023-08-17T17:46:53.581821+0000","last_unstale":"2023-08-17T17:46:53.587277+0000","last_undegraded":"2023-08-17T17:46:53.587277+0000","last_fullsized":"2023-08-17T17:46:53.587277+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942082+0000","last_change":"2023-08-17T17:46:53.942203+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942082+0000","last_undegraded":"2023-08-17T17:46:53.942082+0000","last_fullsized":"2023-08-17T17:46:53.942082+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586364+0000","last_change":"2023-08-17T17:46:53.581919+0000","last_active":"2023-08-17T17:46:53.586364+0000","last_peered":"2023-08-17T17:46:53.586364+0000","last_clean":"2023-08-17T17:46:53.586364+0000","last_became_active":"2023-08-17T17:46:53.581615+0000","last_became_peered":"2023-08-17T17:46:53.581615+0000","last_unstale":"2023-08-17T17:46:53.586364+0000","last_undegraded":"2023-08-17T17:46:53.586364+0000","last_fullsized":"2023-08-17T17:46:53.586364+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943285+0000","last_change":"2023-08-17T17:46:53.943426+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943285+0000","last_undegraded":"2023-08-17T17:46:53.943285+0000","last_fullsized":"2023-08-17T17:46:53.943285+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589673+0000","last_change":"2023-08-17T17:46:53.587221+0000","last_active":"2023-08-17T17:46:53.589673+0000","last_peered":"2023-08-17T17:46:53.589673+0000","last_clean":"2023-08-17T17:46:53.589673+0000","last_became_active":"2023-08-17T17:46:53.586901+0000","last_became_peered":"2023-08-17T17:46:53.586901+0000","last_unstale":"2023-08-17T17:46:53.589673+0000","last_undegraded":"2023-08-17T17:46:53.589673+0000","last_fullsized":"2023-08-17T17:46:53.589673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944893+0000","last_change":"2023-08-17T17:46:53.945173+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944893+0000","last_undegraded":"2023-08-17T17:46:53.944893+0000","last_fullsized":"2023-08-17T17:46:53.944893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587692+0000","last_change":"2023-08-17T17:46:53.579836+0000","last_active":"2023-08-17T17:46:53.587692+0000","last_peered":"2023-08-17T17:46:53.587692+0000","last_clean":"2023-08-17T17:46:53.587692+0000","last_became_active":"2023-08-17T17:46:53.579544+0000","last_became_peered":"2023-08-17T17:46:53.579544+0000","last_unstale":"2023-08-17T17:46:53.587692+0000","last_undegraded":"2023-08-17T17:46:53.587692+0000","last_fullsized":"2023-08-17T17:46:53.587692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945016+0000","last_change":"2023-08-17T17:46:53.945126+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945016+0000","last_undegraded":"2023-08-17T17:46:53.945016+0000","last_fullsized":"2023-08-17T17:46:53.945016+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.585758+0000","last_change":"2023-08-17T17:46:53.583210+0000","last_active":"2023-08-17T17:46:53.585758+0000","last_peered":"2023-08-17T17:46:53.585758+0000","last_clean":"2023-08-17T17:46:53.585758+0000","last_became_active":"2023-08-17T17:46:53.583036+0000","last_became_peered":"2023-08-17T17:46:53.583036+0000","last_unstale":"2023-08-17T17:46:53.585758+0000","last_undegraded":"2023-08-17T17:46:53.585758+0000","last_fullsized":"2023-08-17T17:46:53.585758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943461+0000","last_change":"2023-08-17T17:46:53.943591+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943461+0000","last_undegraded":"2023-08-17T17:46:53.943461+0000","last_fullsized":"2023-08-17T17:46:53.943461+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.575333+0000","last_change":"2023-08-17T17:46:53.574238+0000","last_active":"2023-08-17T17:46:53.575333+0000","last_peered":"2023-08-17T17:46:53.575333+0000","last_clean":"2023-08-17T17:46:53.575333+0000","last_became_active":"2023-08-17T17:46:53.573880+0000","last_became_peered":"2023-08-17T17:46:53.573880+0000","last_unstale":"2023-08-17T17:46:53.575333+0000","last_undegraded":"2023-08-17T17:46:53.575333+0000","last_fullsized":"2023-08-17T17:46:53.575333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937057+0000","last_change":"2023-08-17T17:46:53.937240+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937057+0000","last_undegraded":"2023-08-17T17:46:53.937057+0000","last_fullsized":"2023-08-17T17:46:53.937057+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593638+0000","last_change":"2023-08-17T17:46:53.588046+0000","last_active":"2023-08-17T17:46:53.593638+0000","last_peered":"2023-08-17T17:46:53.593638+0000","last_clean":"2023-08-17T17:46:53.593638+0000","last_became_active":"2023-08-17T17:46:53.587776+0000","last_became_peered":"2023-08-17T17:46:53.587776+0000","last_unstale":"2023-08-17T17:46:53.593638+0000","last_undegraded":"2023-08-17T17:46:53.593638+0000","last_fullsized":"2023-08-17T17:46:53.593638+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941251+0000","last_change":"2023-08-17T17:46:53.941251+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941251+0000","last_undegraded":"2023-08-17T17:46:53.941251+0000","last_fullsized":"2023-08-17T17:46:53.941251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583978+0000","last_change":"2023-08-17T17:46:53.580782+0000","last_active":"2023-08-17T17:46:53.583978+0000","last_peered":"2023-08-17T17:46:53.583978+0000","last_clean":"2023-08-17T17:46:53.583978+0000","last_became_active":"2023-08-17T17:46:53.580298+0000","last_became_peered":"2023-08-17T17:46:53.580298+0000","last_unstale":"2023-08-17T17:46:53.583978+0000","last_undegraded":"2023-08-17T17:46:53.583978+0000","last_fullsized":"2023-08-17T17:46:53.583978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940775+0000","last_change":"2023-08-17T17:46:53.940903+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940775+0000","last_undegraded":"2023-08-17T17:46:53.940775+0000","last_fullsized":"2023-08-17T17:46:53.940775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589471+0000","last_change":"2023-08-17T17:46:53.587937+0000","last_active":"2023-08-17T17:46:53.589471+0000","last_peered":"2023-08-17T17:46:53.589471+0000","last_clean":"2023-08-17T17:46:53.589471+0000","last_became_active":"2023-08-17T17:46:53.587645+0000","last_became_peered":"2023-08-17T17:46:53.587645+0000","last_unstale":"2023-08-17T17:46:53.589471+0000","last_undegraded":"2023-08-17T17:46:53.589471+0000","last_fullsized":"2023-08-17T17:46:53.589471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938302+0000","last_change":"2023-08-17T17:46:53.938456+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938302+0000","last_undegraded":"2023-08-17T17:46:53.938302+0000","last_fullsized":"2023-08-17T17:46:53.938302+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595334+0000","last_change":"2023-08-17T17:46:53.591820+0000","last_active":"2023-08-17T17:46:53.595334+0000","last_peered":"2023-08-17T17:46:53.595334+0000","last_clean":"2023-08-17T17:46:53.595334+0000","last_became_active":"2023-08-17T17:46:53.591544+0000","last_became_peered":"2023-08-17T17:46:53.591544+0000","last_unstale":"2023-08-17T17:46:53.595334+0000","last_undegraded":"2023-08-17T17:46:53.595334+0000","last_fullsized":"2023-08-17T17:46:53.595334+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945011+0000","last_change":"2023-08-17T17:46:53.945183+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945011+0000","last_undegraded":"2023-08-17T17:46:53.945011+0000","last_fullsized":"2023-08-17T17:46:53.945011+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.581056+0000","last_change":"2023-08-17T17:46:53.576364+0000","last_active":"2023-08-17T17:46:53.581056+0000","last_peered":"2023-08-17T17:46:53.581056+0000","last_clean":"2023-08-17T17:46:53.581056+0000","last_became_active":"2023-08-17T17:46:53.576052+0000","last_became_peered":"2023-08-17T17:46:53.576052+0000","last_unstale":"2023-08-17T17:46:53.581056+0000","last_undegraded":"2023-08-17T17:46:53.581056+0000","last_fullsized":"2023-08-17T17:46:53.581056+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941183+0000","last_change":"2023-08-17T17:46:53.941315+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941183+0000","last_undegraded":"2023-08-17T17:46:53.941183+0000","last_fullsized":"2023-08-17T17:46:53.941183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.588720+0000","last_change":"2023-08-17T17:46:53.583930+0000","last_active":"2023-08-17T17:46:53.588720+0000","last_peered":"2023-08-17T17:46:53.588720+0000","last_clean":"2023-08-17T17:46:53.588720+0000","last_became_active":"2023-08-17T17:46:53.583633+0000","last_became_peered":"2023-08-17T17:46:53.583633+0000","last_unstale":"2023-08-17T17:46:53.588720+0000","last_undegraded":"2023-08-17T17:46:53.588720+0000","last_fullsized":"2023-08-17T17:46:53.588720+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945636+0000","last_change":"2023-08-17T17:46:53.946154+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945636+0000","last_undegraded":"2023-08-17T17:46:53.945636+0000","last_fullsized":"2023-08-17T17:46:53.945636+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583312+0000","last_change":"2023-08-17T17:46:53.576838+0000","last_active":"2023-08-17T17:46:53.583312+0000","last_peered":"2023-08-17T17:46:53.583312+0000","last_clean":"2023-08-17T17:46:53.583312+0000","last_became_active":"2023-08-17T17:46:53.576666+0000","last_became_peered":"2023-08-17T17:46:53.576666+0000","last_unstale":"2023-08-17T17:46:53.583312+0000","last_undegraded":"2023-08-17T17:46:53.583312+0000","last_fullsized":"2023-08-17T17:46:53.583312+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937664+0000","last_change":"2023-08-17T17:46:53.937822+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937664+0000","last_undegraded":"2023-08-17T17:46:53.937664+0000","last_fullsized":"2023-08-17T17:46:53.937664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590205+0000","last_change":"2023-08-17T17:46:53.588579+0000","last_active":"2023-08-17T17:46:53.590205+0000","last_peered":"2023-08-17T17:46:53.590205+0000","last_clean":"2023-08-17T17:46:53.590205+0000","last_became_active":"2023-08-17T17:46:53.588025+0000","last_became_peered":"2023-08-17T17:46:53.588025+0000","last_unstale":"2023-08-17T17:46:53.590205+0000","last_undegraded":"2023-08-17T17:46:53.590205+0000","last_fullsized":"2023-08-17T17:46:53.590205+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.946622+0000","last_change":"2023-08-17T17:46:53.946710+0000","last_active":"2023-08-17T17:46:53.946622+0000","last_peered":"2023-08-17T17:46:53.946622+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.946424+0000","last_became_peered":"2023-08-17T17:46:53.946424+0000","last_unstale":"2023-08-17T17:46:53.946622+0000","last_undegraded":"2023-08-17T17:46:53.946622+0000","last_fullsized":"2023-08-17T17:46:53.946622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593808+0000","last_change":"2023-08-17T17:46:53.592735+0000","last_active":"2023-08-17T17:46:53.593808+0000","last_peered":"2023-08-17T17:46:53.593808+0000","last_clean":"2023-08-17T17:46:53.593808+0000","last_became_active":"2023-08-17T17:46:53.592421+0000","last_became_peered":"2023-08-17T17:46:53.592421+0000","last_unstale":"2023-08-17T17:46:53.593808+0000","last_undegraded":"2023-08-17T17:46:53.593808+0000","last_fullsized":"2023-08-17T17:46:53.593808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.948487+0000","last_change":"2023-08-17T17:46:53.948603+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.948487+0000","last_undegraded":"2023-08-17T17:46:53.948487+0000","last_fullsized":"2023-08-17T17:46:53.948487+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595091+0000","last_change":"2023-08-17T17:46:53.594526+0000","last_active":"2023-08-17T17:46:53.595091+0000","last_peered":"2023-08-17T17:46:53.595091+0000","last_clean":"2023-08-17T17:46:53.595091+0000","last_became_active":"2023-08-17T17:46:53.594206+0000","last_became_peered":"2023-08-17T17:46:53.594206+0000","last_unstale":"2023-08-17T17:46:53.595091+0000","last_undegraded":"2023-08-17T17:46:53.595091+0000","last_fullsized":"2023-08-17T17:46:53.595091+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938853+0000","last_change":"2023-08-17T17:46:53.938963+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938853+0000","last_undegraded":"2023-08-17T17:46:53.938853+0000","last_fullsized":"2023-08-17T17:46:53.938853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587827+0000","last_change":"2023-08-17T17:46:53.581153+0000","last_active":"2023-08-17T17:46:53.587827+0000","last_peered":"2023-08-17T17:46:53.587827+0000","last_clean":"2023-08-17T17:46:53.587827+0000","last_became_active":"2023-08-17T17:46:53.580902+0000","last_became_peered":"2023-08-17T17:46:53.580902+0000","last_unstale":"2023-08-17T17:46:53.587827+0000","last_undegraded":"2023-08-17T17:46:53.587827+0000","last_fullsized":"2023-08-17T17:46:53.587827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937121+0000","last_change":"2023-08-17T17:46:53.937261+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937121+0000","last_undegraded":"2023-08-17T17:46:53.937121+0000","last_fullsized":"2023-08-17T17:46:53.937121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595272+0000","last_change":"2023-08-17T17:46:53.591102+0000","last_active":"2023-08-17T17:46:53.595272+0000","last_peered":"2023-08-17T17:46:53.595272+0000","last_clean":"2023-08-17T17:46:53.595272+0000","last_became_active":"2023-08-17T17:46:53.590811+0000","last_became_peered":"2023-08-17T17:46:53.590811+0000","last_unstale":"2023-08-17T17:46:53.595272+0000","last_undegraded":"2023-08-17T17:46:53.595272+0000","last_fullsized":"2023-08-17T17:46:53.595272+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943621+0000","last_change":"2023-08-17T17:46:53.945412+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943621+0000","last_undegraded":"2023-08-17T17:46:53.943621+0000","last_fullsized":"2023-08-17T17:46:53.943621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592959+0000","last_change":"2023-08-17T17:46:53.591056+0000","last_active":"2023-08-17T17:46:53.592959+0000","last_peered":"2023-08-17T17:46:53.592959+0000","last_clean":"2023-08-17T17:46:53.592959+0000","last_became_active":"2023-08-17T17:46:53.590762+0000","last_became_peered":"2023-08-17T17:46:53.590762+0000","last_unstale":"2023-08-17T17:46:53.592959+0000","last_undegraded":"2023-08-17T17:46:53.592959+0000","last_fullsized":"2023-08-17T17:46:53.592959+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941519+0000","last_change":"2023-08-17T17:46:53.941637+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941519+0000","last_undegraded":"2023-08-17T17:46:53.941519+0000","last_fullsized":"2023-08-17T17:46:53.941519+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590423+0000","last_change":"2023-08-17T17:46:53.589394+0000","last_active":"2023-08-17T17:46:53.590423+0000","last_peered":"2023-08-17T17:46:53.590423+0000","last_clean":"2023-08-17T17:46:53.590423+0000","last_became_active":"2023-08-17T17:46:53.589087+0000","last_became_peered":"2023-08-17T17:46:53.589087+0000","last_unstale":"2023-08-17T17:46:53.590423+0000","last_undegraded":"2023-08-17T17:46:53.590423+0000","last_fullsized":"2023-08-17T17:46:53.590423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944884+0000","last_change":"2023-08-17T17:46:53.945023+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944884+0000","last_undegraded":"2023-08-17T17:46:53.944884+0000","last_fullsized":"2023-08-17T17:46:53.944884+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587961+0000","last_change":"2023-08-17T17:46:53.584361+0000","last_active":"2023-08-17T17:46:53.587961+0000","last_peered":"2023-08-17T17:46:53.587961+0000","last_clean":"2023-08-17T17:46:53.587961+0000","last_became_active":"2023-08-17T17:46:53.584085+0000","last_became_peered":"2023-08-17T17:46:53.584085+0000","last_unstale":"2023-08-17T17:46:53.587961+0000","last_undegraded":"2023-08-17T17:46:53.587961+0000","last_fullsized":"2023-08-17T17:46:53.587961+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939992+0000","last_change":"2023-08-17T17:46:53.940120+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939992+0000","last_undegraded":"2023-08-17T17:46:53.939992+0000","last_fullsized":"2023-08-17T17:46:53.939992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594348+0000","last_change":"2023-08-17T17:46:53.588048+0000","last_active":"2023-08-17T17:46:53.594348+0000","last_peered":"2023-08-17T17:46:53.594348+0000","last_clean":"2023-08-17T17:46:53.594348+0000","last_became_active":"2023-08-17T17:46:53.587765+0000","last_became_peered":"2023-08-17T17:46:53.587765+0000","last_unstale":"2023-08-17T17:46:53.594348+0000","last_undegraded":"2023-08-17T17:46:53.594348+0000","last_fullsized":"2023-08-17T17:46:53.594348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939716+0000","last_change":"2023-08-17T17:46:53.939858+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939716+0000","last_undegraded":"2023-08-17T17:46:53.939716+0000","last_fullsized":"2023-08-17T17:46:53.939716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591534+0000","last_change":"2023-08-17T17:46:53.580274+0000","last_active":"2023-08-17T17:46:53.591534+0000","last_peered":"2023-08-17T17:46:53.591534+0000","last_clean":"2023-08-17T17:46:53.591534+0000","last_became_active":"2023-08-17T17:46:53.580000+0000","last_became_peered":"2023-08-17T17:46:53.580000+0000","last_unstale":"2023-08-17T17:46:53.591534+0000","last_undegraded":"2023-08-17T17:46:53.591534+0000","last_fullsized":"2023-08-17T17:46:53.591534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937716+0000","last_change":"2023-08-17T17:46:53.937873+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937716+0000","last_undegraded":"2023-08-17T17:46:53.937716+0000","last_fullsized":"2023-08-17T17:46:53.937716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.582774+0000","last_change":"2023-08-17T17:46:53.581711+0000","last_active":"2023-08-17T17:46:53.582774+0000","last_peered":"2023-08-17T17:46:53.582774+0000","last_clean":"2023-08-17T17:46:53.582774+0000","last_became_active":"2023-08-17T17:46:53.581422+0000","last_became_peered":"2023-08-17T17:46:53.581422+0000","last_unstale":"2023-08-17T17:46:53.582774+0000","last_undegraded":"2023-08-17T17:46:53.582774+0000","last_fullsized":"2023-08-17T17:46:53.582774+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940892+0000","last_change":"2023-08-17T17:46:53.941005+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940892+0000","last_undegraded":"2023-08-17T17:46:53.940892+0000","last_fullsized":"2023-08-17T17:46:53.940892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590044+0000","last_change":"2023-08-17T17:46:53.588355+0000","last_active":"2023-08-17T17:46:53.590044+0000","last_peered":"2023-08-17T17:46:53.590044+0000","last_clean":"2023-08-17T17:46:53.590044+0000","last_became_active":"2023-08-17T17:46:53.587993+0000","last_became_peered":"2023-08-17T17:46:53.587993+0000","last_unstale":"2023-08-17T17:46:53.590044+0000","last_undegraded":"2023-08-17T17:46:53.590044+0000","last_fullsized":"2023-08-17T17:46:53.590044+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937494+0000","last_change":"2023-08-17T17:46:53.937635+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937494+0000","last_undegraded":"2023-08-17T17:46:53.937494+0000","last_fullsized":"2023-08-17T17:46:53.937494+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583805+0000","last_change":"2023-08-17T17:46:53.581332+0000","last_active":"2023-08-17T17:46:53.583805+0000","last_peered":"2023-08-17T17:46:53.583805+0000","last_clean":"2023-08-17T17:46:53.583805+0000","last_became_active":"2023-08-17T17:46:53.581009+0000","last_became_peered":"2023-08-17T17:46:53.581009+0000","last_unstale":"2023-08-17T17:46:53.583805+0000","last_undegraded":"2023-08-17T17:46:53.583805+0000","last_fullsized":"2023-08-17T17:46:53.583805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941448+0000","last_change":"2023-08-17T17:46:53.941575+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941448+0000","last_undegraded":"2023-08-17T17:46:53.941448+0000","last_fullsized":"2023-08-17T17:46:53.941448+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587786+0000","last_change":"2023-08-17T17:46:53.581061+0000","last_active":"2023-08-17T17:46:53.587786+0000","last_peered":"2023-08-17T17:46:53.587786+0000","last_clean":"2023-08-17T17:46:53.587786+0000","last_became_active":"2023-08-17T17:46:53.580750+0000","last_became_peered":"2023-08-17T17:46:53.580750+0000","last_unstale":"2023-08-17T17:46:53.587786+0000","last_undegraded":"2023-08-17T17:46:53.587786+0000","last_fullsized":"2023-08-17T17:46:53.587786+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944411+0000","last_change":"2023-08-17T17:46:53.944546+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944411+0000","last_undegraded":"2023-08-17T17:46:53.944411+0000","last_fullsized":"2023-08-17T17:46:53.944411+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591641+0000","last_change":"2023-08-17T17:46:53.584779+0000","last_active":"2023-08-17T17:46:53.591641+0000","last_peered":"2023-08-17T17:46:53.591641+0000","last_clean":"2023-08-17T17:46:53.591641+0000","last_became_active":"2023-08-17T17:46:53.584502+0000","last_became_peered":"2023-08-17T17:46:53.584502+0000","last_unstale":"2023-08-17T17:46:53.591641+0000","last_undegraded":"2023-08-17T17:46:53.591641+0000","last_fullsized":"2023-08-17T17:46:53.591641+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":5,"reported_epoch":59,"state":"active","last_fresh":"2023-08-17T17:46:53.947664+0000","last_change":"2023-08-17T17:46:53.947664+0000","last_active":"2023-08-17T17:46:53.947664+0000","last_peered":"2023-08-17T17:46:53.947664+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.947664+0000","last_became_peered":"2023-08-17T17:46:53.947664+0000","last_unstale":"2023-08-17T17:46:53.947664+0000","last_undegraded":"2023-08-17T17:46:53.947664+0000","last_fullsized":"2023-08-17T17:46:53.947664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.585170+0000","last_change":"2023-08-17T17:46:53.582200+0000","last_active":"2023-08-17T17:46:53.585170+0000","last_peered":"2023-08-17T17:46:53.585170+0000","last_clean":"2023-08-17T17:46:53.585170+0000","last_became_active":"2023-08-17T17:46:53.581952+0000","last_became_peered":"2023-08-17T17:46:53.581952+0000","last_unstale":"2023-08-17T17:46:53.585170+0000","last_undegraded":"2023-08-17T17:46:53.585170+0000","last_fullsized":"2023-08-17T17:46:53.585170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944068+0000","last_change":"2023-08-17T17:46:53.944185+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944068+0000","last_undegraded":"2023-08-17T17:46:53.944068+0000","last_fullsized":"2023-08-17T17:46:53.944068+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589729+0000","last_change":"2023-08-17T17:46:53.588244+0000","last_active":"2023-08-17T17:46:53.589729+0000","last_peered":"2023-08-17T17:46:53.589729+0000","last_clean":"2023-08-17T17:46:53.589729+0000","last_became_active":"2023-08-17T17:46:53.587974+0000","last_became_peered":"2023-08-17T17:46:53.587974+0000","last_unstale":"2023-08-17T17:46:53.589729+0000","last_undegraded":"2023-08-17T17:46:53.589729+0000","last_fullsized":"2023-08-17T17:46:53.589729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.567702+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:46:53.567702+0000","last_peered":"2023-08-17T17:46:53.567702+0000","last_clean":"2023-08-17T17:46:53.567702+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:46:53.567702+0000","last_undegraded":"2023-08-17T17:46:53.567702+0000","last_fullsized":"2023-08-17T17:46:53.567702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.936412+0000","last_change":"2023-08-17T17:46:53.936577+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.936412+0000","last_undegraded":"2023-08-17T17:46:53.936412+0000","last_fullsized":"2023-08-17T17:46:53.936412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593048+0000","last_change":"2023-08-17T17:46:53.591586+0000","last_active":"2023-08-17T17:46:53.593048+0000","last_peered":"2023-08-17T17:46:53.593048+0000","last_clean":"2023-08-17T17:46:53.593048+0000","last_became_active":"2023-08-17T17:46:53.591021+0000","last_became_peered":"2023-08-17T17:46:53.591021+0000","last_unstale":"2023-08-17T17:46:53.593048+0000","last_undegraded":"2023-08-17T17:46:53.593048+0000","last_fullsized":"2023-08-17T17:46:53.593048+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.570406+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:46:53.570406+0000","last_peered":"2023-08-17T17:46:53.570406+0000","last_clean":"2023-08-17T17:46:53.570406+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:46:53.570406+0000","last_undegraded":"2023-08-17T17:46:53.570406+0000","last_fullsized":"2023-08-17T17:46:53.570406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941113+0000","last_change":"2023-08-17T17:46:53.941363+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941113+0000","last_undegraded":"2023-08-17T17:46:53.941113+0000","last_fullsized":"2023-08-17T17:46:53.941113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591304+0000","last_change":"2023-08-17T17:46:53.584242+0000","last_active":"2023-08-17T17:46:53.591304+0000","last_peered":"2023-08-17T17:46:53.591304+0000","last_clean":"2023-08-17T17:46:53.591304+0000","last_became_active":"2023-08-17T17:46:53.583975+0000","last_became_peered":"2023-08-17T17:46:53.583975+0000","last_unstale":"2023-08-17T17:46:53.591304+0000","last_undegraded":"2023-08-17T17:46:53.591304+0000","last_fullsized":"2023-08-17T17:46:53.591304+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.574503+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:46:53.574503+0000","last_peered":"2023-08-17T17:46:53.574503+0000","last_clean":"2023-08-17T17:46:53.574503+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:46:53.574503+0000","last_undegraded":"2023-08-17T17:46:53.574503+0000","last_fullsized":"2023-08-17T17:46:53.574503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941461+0000","last_change":"2023-08-17T17:46:53.941622+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941461+0000","last_undegraded":"2023-08-17T17:46:53.941461+0000","last_fullsized":"2023-08-17T17:46:53.941461+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595361+0000","last_change":"2023-08-17T17:46:53.591978+0000","last_active":"2023-08-17T17:46:53.595361+0000","last_peered":"2023-08-17T17:46:53.595361+0000","last_clean":"2023-08-17T17:46:53.595361+0000","last_became_active":"2023-08-17T17:46:53.591812+0000","last_became_peered":"2023-08-17T17:46:53.591812+0000","last_unstale":"2023-08-17T17:46:53.595361+0000","last_undegraded":"2023-08-17T17:46:53.595361+0000","last_fullsized":"2023-08-17T17:46:53.595361+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.577814+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:46:53.577814+0000","last_peered":"2023-08-17T17:46:53.577814+0000","last_clean":"2023-08-17T17:46:53.577814+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:46:53.577814+0000","last_undegraded":"2023-08-17T17:46:53.577814+0000","last_fullsized":"2023-08-17T17:46:53.577814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.580993+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:46:53.580993+0000","last_peered":"2023-08-17T17:46:53.580993+0000","last_clean":"2023-08-17T17:46:53.580993+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:46:53.580993+0000","last_undegraded":"2023-08-17T17:46:53.580993+0000","last_fullsized":"2023-08-17T17:46:53.580993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938984+0000","last_change":"2023-08-17T17:46:53.939138+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938984+0000","last_undegraded":"2023-08-17T17:46:53.938984+0000","last_fullsized":"2023-08-17T17:46:53.938984+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589500+0000","last_change":"2023-08-17T17:46:53.586983+0000","last_active":"2023-08-17T17:46:53.589500+0000","last_peered":"2023-08-17T17:46:53.589500+0000","last_clean":"2023-08-17T17:46:53.589500+0000","last_became_active":"2023-08-17T17:46:53.586729+0000","last_became_peered":"2023-08-17T17:46:53.586729+0000","last_unstale":"2023-08-17T17:46:53.589500+0000","last_undegraded":"2023-08-17T17:46:53.589500+0000","last_fullsized":"2023-08-17T17:46:53.589500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.581035+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:46:53.581035+0000","last_peered":"2023-08-17T17:46:53.581035+0000","last_clean":"2023-08-17T17:46:53.581035+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:46:53.581035+0000","last_undegraded":"2023-08-17T17:46:53.581035+0000","last_fullsized":"2023-08-17T17:46:53.581035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939926+0000","last_change":"2023-08-17T17:46:53.940046+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939926+0000","last_undegraded":"2023-08-17T17:46:53.939926+0000","last_fullsized":"2023-08-17T17:46:53.939926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593263+0000","last_change":"2023-08-17T17:46:53.591593+0000","last_active":"2023-08-17T17:46:53.593263+0000","last_peered":"2023-08-17T17:46:53.593263+0000","last_clean":"2023-08-17T17:46:53.593263+0000","last_became_active":"2023-08-17T17:46:53.591368+0000","last_became_peered":"2023-08-17T17:46:53.591368+0000","last_unstale":"2023-08-17T17:46:53.593263+0000","last_undegraded":"2023-08-17T17:46:53.593263+0000","last_fullsized":"2023-08-17T17:46:53.593263+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.582295+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:46:53.582295+0000","last_peered":"2023-08-17T17:46:53.582295+0000","last_clean":"2023-08-17T17:46:53.582295+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:46:53.582295+0000","last_undegraded":"2023-08-17T17:46:53.582295+0000","last_fullsized":"2023-08-17T17:46:53.582295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952125+0000","last_change":"2023-08-17T17:46:53.952198+0000","last_active":"2023-08-17T17:46:53.952125+0000","last_peered":"2023-08-17T17:46:53.952125+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.951935+0000","last_became_peered":"2023-08-17T17:46:53.951935+0000","last_unstale":"2023-08-17T17:46:53.952125+0000","last_undegraded":"2023-08-17T17:46:53.952125+0000","last_fullsized":"2023-08-17T17:46:53.952125+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587803+0000","last_change":"2023-08-17T17:46:53.581838+0000","last_active":"2023-08-17T17:46:53.587803+0000","last_peered":"2023-08-17T17:46:53.587803+0000","last_clean":"2023-08-17T17:46:53.587803+0000","last_became_active":"2023-08-17T17:46:53.581523+0000","last_became_peered":"2023-08-17T17:46:53.581523+0000","last_unstale":"2023-08-17T17:46:53.587803+0000","last_undegraded":"2023-08-17T17:46:53.587803+0000","last_fullsized":"2023-08-17T17:46:53.587803+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.568013+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:46:53.568013+0000","last_peered":"2023-08-17T17:46:53.568013+0000","last_clean":"2023-08-17T17:46:53.568013+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:46:53.568013+0000","last_undegraded":"2023-08-17T17:46:53.568013+0000","last_fullsized":"2023-08-17T17:46:53.568013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.936458+0000","last_change":"2023-08-17T17:46:53.936611+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.936458+0000","last_undegraded":"2023-08-17T17:46:53.936458+0000","last_fullsized":"2023-08-17T17:46:53.936458+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587511+0000","last_change":"2023-08-17T17:46:53.574800+0000","last_active":"2023-08-17T17:46:53.587511+0000","last_peered":"2023-08-17T17:46:53.587511+0000","last_clean":"2023-08-17T17:46:53.587511+0000","last_became_active":"2023-08-17T17:46:53.574519+0000","last_became_peered":"2023-08-17T17:46:53.574519+0000","last_unstale":"2023-08-17T17:46:53.587511+0000","last_undegraded":"2023-08-17T17:46:53.587511+0000","last_fullsized":"2023-08-17T17:46:53.587511+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.569249+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:46:53.569249+0000","last_peered":"2023-08-17T17:46:53.569249+0000","last_clean":"2023-08-17T17:46:53.569249+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:46:53.569249+0000","last_undegraded":"2023-08-17T17:46:53.569249+0000","last_fullsized":"2023-08-17T17:46:53.569249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.72099999999999997,"5min":0.76400000000000001,"15min":0.80200000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.68899999999999995,"5min":0.82399999999999995,"15min":0.82899999999999996},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"min":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.28999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.81200000000000006},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.80000000000000004},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.56100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70499999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.503}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.751,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.435}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.46200000000000002},"min":{"1min":0.34000000000000002,"5min":0.32300000000000001,"15min":0.28599999999999998},"max":{"1min":0.63,"5min":0.80100000000000005,"15min":0.85499999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.26300000000000001},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.72999999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.437,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.70699999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.375},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72899999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67900000000000005,"5min":0.79900000000000004,"15min":1.0980000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52600000000000002,"15min":0.50700000000000001},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71299999999999997,"5min":0.79000000000000004,"15min":1.0609999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.377},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.30599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.751,"15min":0.751},"last":0.498},{"interface":"front","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.48499999999999999},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.026},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.42699999999999999,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.0740000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.34200000000000003},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52800000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.38200000000000001,"15min":0.36299999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54400000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.27300000000000002,"5min":0.25,"15min":0.22800000000000001},"max":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.72999999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.40300000000000002},"min":{"1min":0.29999999999999999,"5min":0.28399999999999997,"15min":0.219},"max":{"1min":0.61599999999999999,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.435,"15min":0.41899999999999998},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29799999999999999},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.66600000000000004},"last":0.318},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.80800000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.39000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":1.0129999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63400000000000001,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":1.331,"15min":1.331},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64200000000000002,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":0.89000000000000001,"5min":1.319,"15min":1.319},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63800000000000001,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":1.2929999999999999,"15min":1.345},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.39800000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.94499999999999995},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67000000000000004,"15min":0.64200000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.436,"15min":0.41199999999999998},"max":{"1min":0.88900000000000001,"5min":1.359,"15min":1.377},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36599999999999999,"15min":0.34799999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.28799999999999998,"5min":0.248,"15min":0.217},"max":{"1min":0.48399999999999999,"5min":0.58799999999999997,"15min":0.66200000000000003},"last":0.313}]},{"osd":2,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38300000000000001,"15min":0.36199999999999999},"min":{"1min":0.26900000000000002,"5min":0.23599999999999999,"15min":0.20300000000000001},"max":{"1min":0.51400000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.65200000000000002},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.58999999999999997,"15min":0.66200000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.40500000000000003},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.49299999999999999,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.998,"5min":0.998,"15min":1.337},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":0.90700000000000003,"15min":1.3300000000000001},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.96299999999999997,"15min":0.97199999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.462},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.391},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84199999999999997,"5min":0.93300000000000005,"15min":0.97299999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.997,"15min":1.544},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.246,"5min":0.219,"15min":0.20599999999999999},"max":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.81100000000000005},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.28599999999999998,"5min":0.247,"15min":0.221},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40100000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.70199999999999996},"last":0.378},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42399999999999999,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":0.54900000000000004,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41099999999999998},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40799999999999997,"15min":0.39400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.222},"max":{"1min":0.61699999999999999,"5min":0.629,"15min":0.629},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.65600000000000003,"15min":0.60899999999999999},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39000000000000001},"max":{"1min":0.82899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.67300000000000004,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.625,"15min":0.59999999999999998},"min":{"1min":0.47599999999999998,"5min":0.43099999999999999,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.495}]},{"osd":7,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.64100000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.63400000000000001},"min":{"1min":0.51600000000000001,"5min":0.46100000000000002,"15min":0.441},"max":{"1min":0.85399999999999998,"5min":0.874,"15min":1.0109999999999999},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32800000000000001,"15min":0.33300000000000002},"min":{"1min":0.248,"5min":0.221,"15min":0.191},"max":{"1min":0.40400000000000003,"5min":0.48699999999999999,"15min":0.69999999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.36699999999999999,"15min":0.37},"min":{"1min":0.251,"5min":0.224,"15min":0.224},"max":{"1min":0.496,"5min":0.60599999999999998,"15min":0.71799999999999997},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.215},"max":{"1min":0.48499999999999999,"5min":0.61099999999999999,"15min":0.73799999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.49099999999999999,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.26900000000000002,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.82299999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40699999999999997,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.59399999999999997,"5min":0.61699999999999999,"15min":0.71099999999999997},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":0.89000000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":2.1309999999999998},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38100000000000001},"max":{"1min":0.80200000000000005,"5min":0.86099999999999999,"15min":0.90100000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77100000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":0.91700000000000004,"15min":0.95299999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.83999999999999997,"5min":1.016,"15min":2.1669999999999998},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71899999999999997,"5min":0.83999999999999997,"15min":0.89100000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55500000000000005,"15min":0.53300000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.83199999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.78200000000000003,"15min":0.80900000000000005},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59199999999999997,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77200000000000002,"5min":0.82199999999999995,"15min":0.84799999999999998},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55300000000000005,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.80100000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.55700000000000005},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.47199999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.86399999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47599999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.53200000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.94899999999999995},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.375,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.82199999999999995,"15min":0.91900000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.877,"15min":1.056},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.32200000000000001,"15min":0.27700000000000002},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":1.2609999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.35599999999999998,"15min":0.31},"max":{"1min":0.71799999999999997,"5min":0.77900000000000003,"15min":1.1499999999999999},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.747,"15min":1.242},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":0.81100000000000005,"15min":1.1399999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.252},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.81100000000000005,"15min":1.274},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":1.179},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":0.78000000000000003,"15min":1.3080000000000001},"last":0.499}]},{"osd":4,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.75,"15min":1.0620000000000001},"last":0.44},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.51400000000000001},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.83899999999999997,"15min":1.0740000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.503,"15min":0.52500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":1.01},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.56100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.30099999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.1020000000000001},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.56999999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":1.038},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.755,"5min":0.79100000000000004,"15min":1.1279999999999999},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:46:56.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:46:57.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.069+0000 7f045bf12700 1 Processor -- start 2023-08-17T17:46:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.069+0000 7f045bf12700 1 -- start start 2023-08-17T17:46:57.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.070+0000 7f045bf12700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04540c1010 0x7f04540ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.070+0000 7f045bf12700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04540c7350 con 0x7f04540c6ee0 2023-08-17T17:46:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.070+0000 7f045bf12700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04540a8350 con 0x7f0454154140 2023-08-17T17:46:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.070+0000 7f045bf12700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0454154520 con 0x7f04540c1010 2023-08-17T17:46:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.070+0000 7f04594ad700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f04540c6ee0 0x7f04540c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50030/0 (socket says 172.21.15.78:50030) 2023-08-17T17:46:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.070+0000 7f04594ad700 1 -- 172.21.15.78:0/802207160 learned_addr learned my addr 172.21.15.78:0/802207160 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.070+0000 7f045a4af700 1 --2- 172.21.15.78:0/802207160 >> v2:172.21.15.150:3300/0 conn(0x7f04540c1010 0x7f04540ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.070+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863206320 0 0) 0x7f04540c7350 con 0x7f04540c6ee0 2023-08-17T17:46:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.070+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04400033f0 con 0x7f04540c6ee0 2023-08-17T17:46:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341949727 0 0) 0x7f04540a8350 con 0x7f0454154140 2023-08-17T17:46:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04540c7350 con 0x7f0454154140 2023-08-17T17:46:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 799560217 0 0) 0x7f04400033f0 con 0x7f04540c6ee0 2023-08-17T17:46:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 >> v2:172.21.15.150:3300/0 conn(0x7f04540c1010 msgr2=0x7f04540ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 --2- 172.21.15.78:0/802207160 >> v2:172.21.15.150:3300/0 conn(0x7f04540c1010 0x7f04540ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 >> v1:172.21.15.150:6789/0 conn(0x7f0454154140 legacy=0x7f04540a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540c91e0 con 0x7f04540c6ee0 2023-08-17T17:46:57.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f0444001470 con 0x7f04540c6ee0 2023-08-17T17:46:57.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 >> v1:172.21.15.78:6789/0 conn(0x7f04540c6ee0 legacy=0x7f04540c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0440003a70 0x7f0440003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0440004690 0x7f0440004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f044000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454154520 con 0x7f0440005000 2023-08-17T17:46:57.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044000bf60 con 0x7f0440004690 2023-08-17T17:46:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044000c0d0 con 0x7f0440003a70 2023-08-17T17:46:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f045a4af700 1 --2- 172.21.15.78:0/802207160 >> v2:172.21.15.150:3300/0 conn(0x7f04540c1010 0x7f04540ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:46:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f045a4af700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f044000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0459cae700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0440003a70 0x7f0440003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f04594ad700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0440004690 0x7f0440004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f045a4af700 1 -- 172.21.15.78:0/802207160 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0440003a70 msgr2=0x7f0440003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f045a4af700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0440003a70 0x7f0440003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f045a4af700 1 -- 172.21.15.78:0/802207160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0440004690 msgr2=0x7f0440004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f045a4af700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0440004690 0x7f0440004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f045a4af700 1 -- 172.21.15.78:0/802207160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04400033f0 con 0x7f0440005000 2023-08-17T17:46:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f04594ad700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0440004690 0x7f0440004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f045a4af700 1 -- 172.21.15.78:0/802207160 reap_dead start 2023-08-17T17:46:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f045a4af700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f044000b8e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f044c009c30 tx=0x7f044c009060).ready entity=mon.0 client_cookie=8de80dac441554d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0095c0 con 0x7f0440005000 2023-08-17T17:46:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c00e710 con 0x7f0440005000 2023-08-17T17:46:57.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.071+0000 7f0458cac700 1 -- 172.21.15.78:0/802207160 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00eab0 con 0x7f0440005000 2023-08-17T17:46:57.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.072+0000 7f045bf12700 1 -- 172.21.15.78:0/802207160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 msgr2=0x7f044000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.072+0000 7f045bf12700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f044000b8e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f044c009c30 tx=0x7f044c009060).stop 2023-08-17T17:46:57.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.072+0000 7f045bf12700 1 -- 172.21.15.78:0/802207160 shutdown_connections 2023-08-17T17:46:57.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.072+0000 7f045bf12700 1 --2- 172.21.15.78:0/802207160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f044000b8e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.072+0000 7f045bf12700 1 -- 172.21.15.78:0/802207160 >> 172.21.15.78:0/802207160 conn(0x7f0454094510 msgr2=0x7f045406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:57.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.072+0000 7f045bf12700 1 -- 172.21.15.78:0/802207160 shutdown_connections 2023-08-17T17:46:57.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.072+0000 7f045bf12700 1 -- 172.21.15.78:0/802207160 wait complete. 2023-08-17T17:46:57.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.073+0000 7f045bf12700 1 Processor -- start 2023-08-17T17:46:57.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.073+0000 7f045bf12700 1 -- start start 2023-08-17T17:46:57.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f045bf12700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f0454150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f045bf12700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04540af6b0 0x7f04540c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f045bf12700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04540c36c0 0x7f04540638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f045bf12700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04540c4db0 con 0x7f0440005000 2023-08-17T17:46:57.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f045bf12700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04540afb30 con 0x7f04540af6b0 2023-08-17T17:46:57.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f045bf12700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04540af220 con 0x7f04540c36c0 2023-08-17T17:46:57.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f0459cae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f0454150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f0459cae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f0454150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37082/0 (socket says 172.21.15.78:37082) 2023-08-17T17:46:57.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f0459cae700 1 -- 172.21.15.78:0/2191481425 learned_addr learned my addr 172.21.15.78:0/2191481425 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:57.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f0459cae700 1 -- 172.21.15.78:0/2191481425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04540c36c0 msgr2=0x7f04540638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f0459cae700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04540c36c0 0x7f04540638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:57.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f0459cae700 1 -- 172.21.15.78:0/2191481425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04540af6b0 msgr2=0x7f04540c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f0459cae700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04540af6b0 0x7f04540c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:57.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f0459cae700 1 -- 172.21.15.78:0/2191481425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540c3b40 con 0x7f0440005000 2023-08-17T17:46:57.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f0459cae700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f0454150850 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f045000eb90 tx=0x7f0450007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:57.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.074+0000 7f0449ffb700 1 -- 172.21.15.78:0/2191481425 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0450004140 con 0x7f0440005000 2023-08-17T17:46:57.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.075+0000 7f0449ffb700 1 -- 172.21.15.78:0/2191481425 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0450001910 con 0x7f0440005000 2023-08-17T17:46:57.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.075+0000 7f045bf12700 1 -- 172.21.15.78:0/2191481425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04540ae8f0 con 0x7f0440005000 2023-08-17T17:46:57.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.075+0000 7f0449ffb700 1 -- 172.21.15.78:0/2191481425 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0450001c90 con 0x7f0440005000 2023-08-17T17:46:57.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.075+0000 7f045bf12700 1 -- 172.21.15.78:0/2191481425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04540aeeb0 con 0x7f0440005000 2023-08-17T17:46:57.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.076+0000 7f045bf12700 1 -- 172.21.15.78:0/2191481425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0454047350 con 0x7f0440005000 2023-08-17T17:46:57.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.076+0000 7f0449ffb700 1 -- 172.21.15.78:0/2191481425 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f045000c990 con 0x7f0440005000 2023-08-17T17:46:57.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.076+0000 7f0449ffb700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f043805ed90 0x7f0438061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.076+0000 7f0449ffb700 1 -- 172.21.15.78:0/2191481425 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0450079c80 con 0x7f0440005000 2023-08-17T17:46:57.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.076+0000 7f04594ad700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f043805ed90 0x7f0438061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.077+0000 7f04594ad700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f043805ed90 0x7f0438061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0444000c00 tx=0x7f0444001d90).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:57.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.080+0000 7f0449ffb700 1 -- 172.21.15.78:0/2191481425 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f045004ec50 con 0x7f0440005000 2023-08-17T17:46:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.238+0000 7f045bf12700 1 -- 172.21.15.78:0/2191481425 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04540af360 con 0x7f043805ed90 2023-08-17T17:46:57.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.247+0000 7f0449ffb700 1 -- 172.21.15.78:0/2191481425 <== mgr.5568 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359287 (secure 0 0 0) 0x7f0444010040 con 0x7f043805ed90 2023-08-17T17:46:57.251 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:57.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 -- 172.21.15.78:0/2191481425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f043805ed90 msgr2=0x7f0438061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f043805ed90 0x7f0438061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0444000c00 tx=0x7f0444001d90).stop 2023-08-17T17:46:57.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 -- 172.21.15.78:0/2191481425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 msgr2=0x7f0454150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f0454150850 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f045000eb90 tx=0x7f0450007f10).stop 2023-08-17T17:46:57.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 -- 172.21.15.78:0/2191481425 shutdown_connections 2023-08-17T17:46:57.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f043805ed90 0x7f0438061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04540c36c0 0x7f04540638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:57.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0440005000 0x7f0454150850 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 --2- 172.21.15.78:0/2191481425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04540af6b0 0x7f04540c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:57.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 -- 172.21.15.78:0/2191481425 >> 172.21.15.78:0/2191481425 conn(0x7f0454094510 msgr2=0x7f0454152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:57.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 -- 172.21.15.78:0/2191481425 shutdown_connections 2023-08-17T17:46:57.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.251+0000 7f045bf12700 1 -- 172.21.15.78:0/2191481425 wait complete. 2023-08-17T17:46:57.255 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:46:57.264 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:46:56.951438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2394384,"kb_used_data":5328,"kb_used_omap":0,"kb_used_meta":2388992,"kb_avail":752580336,"statfs":{"total":773094113280,"available":770642264064,"internally_reserved":0,"allocated":5455872,"data_stored":2621940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2446327808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14991300,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-715,"num_write_kb":-15540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.584838"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940561+0000","last_change":"2023-08-17T17:46:53.940679+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940561+0000","last_undegraded":"2023-08-17T17:46:53.940561+0000","last_fullsized":"2023-08-17T17:46:53.940561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590226+0000","last_change":"2023-08-17T17:46:53.588790+0000","last_active":"2023-08-17T17:46:53.590226+0000","last_peered":"2023-08-17T17:46:53.590226+0000","last_clean":"2023-08-17T17:46:53.590226+0000","last_became_active":"2023-08-17T17:46:53.588320+0000","last_became_peered":"2023-08-17T17:46:53.588320+0000","last_unstale":"2023-08-17T17:46:53.590226+0000","last_undegraded":"2023-08-17T17:46:53.590226+0000","last_fullsized":"2023-08-17T17:46:53.590226+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944374+0000","last_change":"2023-08-17T17:46:53.944501+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944374+0000","last_undegraded":"2023-08-17T17:46:53.944374+0000","last_fullsized":"2023-08-17T17:46:53.944374+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593232+0000","last_change":"2023-08-17T17:46:53.591003+0000","last_active":"2023-08-17T17:46:53.593232+0000","last_peered":"2023-08-17T17:46:53.593232+0000","last_clean":"2023-08-17T17:46:53.593232+0000","last_became_active":"2023-08-17T17:46:53.590718+0000","last_became_peered":"2023-08-17T17:46:53.590718+0000","last_unstale":"2023-08-17T17:46:53.593232+0000","last_undegraded":"2023-08-17T17:46:53.593232+0000","last_fullsized":"2023-08-17T17:46:53.593232+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942803+0000","last_change":"2023-08-17T17:46:53.942946+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942803+0000","last_undegraded":"2023-08-17T17:46:53.942803+0000","last_fullsized":"2023-08-17T17:46:53.942803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586289+0000","last_change":"2023-08-17T17:46:53.582491+0000","last_active":"2023-08-17T17:46:53.586289+0000","last_peered":"2023-08-17T17:46:53.586289+0000","last_clean":"2023-08-17T17:46:53.586289+0000","last_became_active":"2023-08-17T17:46:53.582209+0000","last_became_peered":"2023-08-17T17:46:53.582209+0000","last_unstale":"2023-08-17T17:46:53.586289+0000","last_undegraded":"2023-08-17T17:46:53.586289+0000","last_fullsized":"2023-08-17T17:46:53.586289+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943450+0000","last_change":"2023-08-17T17:46:53.943567+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943450+0000","last_undegraded":"2023-08-17T17:46:53.943450+0000","last_fullsized":"2023-08-17T17:46:53.943450+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590908+0000","last_change":"2023-08-17T17:46:53.582713+0000","last_active":"2023-08-17T17:46:53.590908+0000","last_peered":"2023-08-17T17:46:53.590908+0000","last_clean":"2023-08-17T17:46:53.590908+0000","last_became_active":"2023-08-17T17:46:53.582461+0000","last_became_peered":"2023-08-17T17:46:53.582461+0000","last_unstale":"2023-08-17T17:46:53.590908+0000","last_undegraded":"2023-08-17T17:46:53.590908+0000","last_fullsized":"2023-08-17T17:46:53.590908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940203+0000","last_change":"2023-08-17T17:46:53.940323+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940203+0000","last_undegraded":"2023-08-17T17:46:53.940203+0000","last_fullsized":"2023-08-17T17:46:53.940203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593671+0000","last_change":"2023-08-17T17:46:53.592771+0000","last_active":"2023-08-17T17:46:53.593671+0000","last_peered":"2023-08-17T17:46:53.593671+0000","last_clean":"2023-08-17T17:46:53.593671+0000","last_became_active":"2023-08-17T17:46:53.592489+0000","last_became_peered":"2023-08-17T17:46:53.592489+0000","last_unstale":"2023-08-17T17:46:53.593671+0000","last_undegraded":"2023-08-17T17:46:53.593671+0000","last_fullsized":"2023-08-17T17:46:53.593671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939101+0000","last_change":"2023-08-17T17:46:53.939239+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939101+0000","last_undegraded":"2023-08-17T17:46:53.939101+0000","last_fullsized":"2023-08-17T17:46:53.939101+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.588813+0000","last_change":"2023-08-17T17:46:53.587114+0000","last_active":"2023-08-17T17:46:53.588813+0000","last_peered":"2023-08-17T17:46:53.588813+0000","last_clean":"2023-08-17T17:46:53.588813+0000","last_became_active":"2023-08-17T17:46:53.586795+0000","last_became_peered":"2023-08-17T17:46:53.586795+0000","last_unstale":"2023-08-17T17:46:53.588813+0000","last_undegraded":"2023-08-17T17:46:53.588813+0000","last_fullsized":"2023-08-17T17:46:53.588813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940224+0000","last_change":"2023-08-17T17:46:53.940345+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940224+0000","last_undegraded":"2023-08-17T17:46:53.940224+0000","last_fullsized":"2023-08-17T17:46:53.940224+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595075+0000","last_change":"2023-08-17T17:46:53.594476+0000","last_active":"2023-08-17T17:46:53.595075+0000","last_peered":"2023-08-17T17:46:53.595075+0000","last_clean":"2023-08-17T17:46:53.595075+0000","last_became_active":"2023-08-17T17:46:53.594195+0000","last_became_peered":"2023-08-17T17:46:53.594195+0000","last_unstale":"2023-08-17T17:46:53.595075+0000","last_undegraded":"2023-08-17T17:46:53.595075+0000","last_fullsized":"2023-08-17T17:46:53.595075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940236+0000","last_change":"2023-08-17T17:46:53.940343+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940236+0000","last_undegraded":"2023-08-17T17:46:53.940236+0000","last_fullsized":"2023-08-17T17:46:53.940236+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592124+0000","last_change":"2023-08-17T17:46:53.584269+0000","last_active":"2023-08-17T17:46:53.592124+0000","last_peered":"2023-08-17T17:46:53.592124+0000","last_clean":"2023-08-17T17:46:53.592124+0000","last_became_active":"2023-08-17T17:46:53.583408+0000","last_became_peered":"2023-08-17T17:46:53.583408+0000","last_unstale":"2023-08-17T17:46:53.592124+0000","last_undegraded":"2023-08-17T17:46:53.592124+0000","last_fullsized":"2023-08-17T17:46:53.592124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940328+0000","last_change":"2023-08-17T17:46:53.940447+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940328+0000","last_undegraded":"2023-08-17T17:46:53.940328+0000","last_fullsized":"2023-08-17T17:46:53.940328+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591631+0000","last_change":"2023-08-17T17:46:53.585244+0000","last_active":"2023-08-17T17:46:53.591631+0000","last_peered":"2023-08-17T17:46:53.591631+0000","last_clean":"2023-08-17T17:46:53.591631+0000","last_became_active":"2023-08-17T17:46:53.584478+0000","last_became_peered":"2023-08-17T17:46:53.584478+0000","last_unstale":"2023-08-17T17:46:53.591631+0000","last_undegraded":"2023-08-17T17:46:53.591631+0000","last_fullsized":"2023-08-17T17:46:53.591631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944635+0000","last_change":"2023-08-17T17:46:53.944753+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944635+0000","last_undegraded":"2023-08-17T17:46:53.944635+0000","last_fullsized":"2023-08-17T17:46:53.944635+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592109+0000","last_change":"2023-08-17T17:46:53.585467+0000","last_active":"2023-08-17T17:46:53.592109+0000","last_peered":"2023-08-17T17:46:53.592109+0000","last_clean":"2023-08-17T17:46:53.592109+0000","last_became_active":"2023-08-17T17:46:53.585163+0000","last_became_peered":"2023-08-17T17:46:53.585163+0000","last_unstale":"2023-08-17T17:46:53.592109+0000","last_undegraded":"2023-08-17T17:46:53.592109+0000","last_fullsized":"2023-08-17T17:46:53.592109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940255+0000","last_change":"2023-08-17T17:46:53.940392+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940255+0000","last_undegraded":"2023-08-17T17:46:53.940255+0000","last_fullsized":"2023-08-17T17:46:53.940255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593121+0000","last_change":"2023-08-17T17:46:53.582814+0000","last_active":"2023-08-17T17:46:53.593121+0000","last_peered":"2023-08-17T17:46:53.593121+0000","last_clean":"2023-08-17T17:46:53.593121+0000","last_became_active":"2023-08-17T17:46:53.582554+0000","last_became_peered":"2023-08-17T17:46:53.582554+0000","last_unstale":"2023-08-17T17:46:53.593121+0000","last_undegraded":"2023-08-17T17:46:53.593121+0000","last_fullsized":"2023-08-17T17:46:53.593121+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938396+0000","last_change":"2023-08-17T17:46:53.938647+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938396+0000","last_undegraded":"2023-08-17T17:46:53.938396+0000","last_fullsized":"2023-08-17T17:46:53.938396+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587294+0000","last_change":"2023-08-17T17:46:53.582218+0000","last_active":"2023-08-17T17:46:53.587294+0000","last_peered":"2023-08-17T17:46:53.587294+0000","last_clean":"2023-08-17T17:46:53.587294+0000","last_became_active":"2023-08-17T17:46:53.581840+0000","last_became_peered":"2023-08-17T17:46:53.581840+0000","last_unstale":"2023-08-17T17:46:53.587294+0000","last_undegraded":"2023-08-17T17:46:53.587294+0000","last_fullsized":"2023-08-17T17:46:53.587294+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945327+0000","last_change":"2023-08-17T17:46:53.945464+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945327+0000","last_undegraded":"2023-08-17T17:46:53.945327+0000","last_fullsized":"2023-08-17T17:46:53.945327+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594346+0000","last_change":"2023-08-17T17:46:53.591437+0000","last_active":"2023-08-17T17:46:53.594346+0000","last_peered":"2023-08-17T17:46:53.594346+0000","last_clean":"2023-08-17T17:46:53.594346+0000","last_became_active":"2023-08-17T17:46:53.591145+0000","last_became_peered":"2023-08-17T17:46:53.591145+0000","last_unstale":"2023-08-17T17:46:53.594346+0000","last_undegraded":"2023-08-17T17:46:53.594346+0000","last_fullsized":"2023-08-17T17:46:53.594346+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942957+0000","last_change":"2023-08-17T17:46:53.943086+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942957+0000","last_undegraded":"2023-08-17T17:46:53.942957+0000","last_fullsized":"2023-08-17T17:46:53.942957+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591703+0000","last_change":"2023-08-17T17:46:53.586078+0000","last_active":"2023-08-17T17:46:53.591703+0000","last_peered":"2023-08-17T17:46:53.591703+0000","last_clean":"2023-08-17T17:46:53.591703+0000","last_became_active":"2023-08-17T17:46:53.585831+0000","last_became_peered":"2023-08-17T17:46:53.585831+0000","last_unstale":"2023-08-17T17:46:53.591703+0000","last_undegraded":"2023-08-17T17:46:53.591703+0000","last_fullsized":"2023-08-17T17:46:53.591703+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944495+0000","last_change":"2023-08-17T17:46:53.944657+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944495+0000","last_undegraded":"2023-08-17T17:46:53.944495+0000","last_fullsized":"2023-08-17T17:46:53.944495+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587539+0000","last_change":"2023-08-17T17:46:53.575072+0000","last_active":"2023-08-17T17:46:53.587539+0000","last_peered":"2023-08-17T17:46:53.587539+0000","last_clean":"2023-08-17T17:46:53.587539+0000","last_became_active":"2023-08-17T17:46:53.574793+0000","last_became_peered":"2023-08-17T17:46:53.574793+0000","last_unstale":"2023-08-17T17:46:53.587539+0000","last_undegraded":"2023-08-17T17:46:53.587539+0000","last_fullsized":"2023-08-17T17:46:53.587539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941728+0000","last_change":"2023-08-17T17:46:53.941848+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941728+0000","last_undegraded":"2023-08-17T17:46:53.941728+0000","last_fullsized":"2023-08-17T17:46:53.941728+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593840+0000","last_change":"2023-08-17T17:46:53.592156+0000","last_active":"2023-08-17T17:46:53.593840+0000","last_peered":"2023-08-17T17:46:53.593840+0000","last_clean":"2023-08-17T17:46:53.593840+0000","last_became_active":"2023-08-17T17:46:53.591901+0000","last_became_peered":"2023-08-17T17:46:53.591901+0000","last_unstale":"2023-08-17T17:46:53.593840+0000","last_undegraded":"2023-08-17T17:46:53.593840+0000","last_fullsized":"2023-08-17T17:46:53.593840+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.943747+0000","last_change":"2023-08-17T17:46:53.943829+0000","last_active":"2023-08-17T17:46:53.943747+0000","last_peered":"2023-08-17T17:46:53.943747+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.943505+0000","last_became_peered":"2023-08-17T17:46:53.943505+0000","last_unstale":"2023-08-17T17:46:53.943747+0000","last_undegraded":"2023-08-17T17:46:53.943747+0000","last_fullsized":"2023-08-17T17:46:53.943747+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586303+0000","last_change":"2023-08-17T17:46:53.580728+0000","last_active":"2023-08-17T17:46:53.586303+0000","last_peered":"2023-08-17T17:46:53.586303+0000","last_clean":"2023-08-17T17:46:53.586303+0000","last_became_active":"2023-08-17T17:46:53.580452+0000","last_became_peered":"2023-08-17T17:46:53.580452+0000","last_unstale":"2023-08-17T17:46:53.586303+0000","last_undegraded":"2023-08-17T17:46:53.586303+0000","last_fullsized":"2023-08-17T17:46:53.586303+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.947036+0000","last_change":"2023-08-17T17:46:53.947661+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.947036+0000","last_undegraded":"2023-08-17T17:46:53.947036+0000","last_fullsized":"2023-08-17T17:46:53.947036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593827+0000","last_change":"2023-08-17T17:46:53.592847+0000","last_active":"2023-08-17T17:46:53.593827+0000","last_peered":"2023-08-17T17:46:53.593827+0000","last_clean":"2023-08-17T17:46:53.593827+0000","last_became_active":"2023-08-17T17:46:53.592477+0000","last_became_peered":"2023-08-17T17:46:53.592477+0000","last_unstale":"2023-08-17T17:46:53.593827+0000","last_undegraded":"2023-08-17T17:46:53.593827+0000","last_fullsized":"2023-08-17T17:46:53.593827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943978+0000","last_change":"2023-08-17T17:46:53.944133+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943978+0000","last_undegraded":"2023-08-17T17:46:53.943978+0000","last_fullsized":"2023-08-17T17:46:53.943978+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592092+0000","last_change":"2023-08-17T17:46:53.590998+0000","last_active":"2023-08-17T17:46:53.592092+0000","last_peered":"2023-08-17T17:46:53.592092+0000","last_clean":"2023-08-17T17:46:53.592092+0000","last_became_active":"2023-08-17T17:46:53.590681+0000","last_became_peered":"2023-08-17T17:46:53.590681+0000","last_unstale":"2023-08-17T17:46:53.592092+0000","last_undegraded":"2023-08-17T17:46:53.592092+0000","last_fullsized":"2023-08-17T17:46:53.592092+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943168+0000","last_change":"2023-08-17T17:46:53.943291+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943168+0000","last_undegraded":"2023-08-17T17:46:53.943168+0000","last_fullsized":"2023-08-17T17:46:53.943168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.597850+0000","last_change":"2023-08-17T17:46:53.593024+0000","last_active":"2023-08-17T17:46:53.597850+0000","last_peered":"2023-08-17T17:46:53.597850+0000","last_clean":"2023-08-17T17:46:53.597850+0000","last_became_active":"2023-08-17T17:46:53.592759+0000","last_became_peered":"2023-08-17T17:46:53.592759+0000","last_unstale":"2023-08-17T17:46:53.597850+0000","last_undegraded":"2023-08-17T17:46:53.597850+0000","last_fullsized":"2023-08-17T17:46:53.597850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941047+0000","last_change":"2023-08-17T17:46:53.941852+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941047+0000","last_undegraded":"2023-08-17T17:46:53.941047+0000","last_fullsized":"2023-08-17T17:46:53.941047+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587734+0000","last_change":"2023-08-17T17:46:53.577716+0000","last_active":"2023-08-17T17:46:53.587734+0000","last_peered":"2023-08-17T17:46:53.587734+0000","last_clean":"2023-08-17T17:46:53.587734+0000","last_became_active":"2023-08-17T17:46:53.576999+0000","last_became_peered":"2023-08-17T17:46:53.576999+0000","last_unstale":"2023-08-17T17:46:53.587734+0000","last_undegraded":"2023-08-17T17:46:53.587734+0000","last_fullsized":"2023-08-17T17:46:53.587734+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943877+0000","last_change":"2023-08-17T17:46:53.943984+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943877+0000","last_undegraded":"2023-08-17T17:46:53.943877+0000","last_fullsized":"2023-08-17T17:46:53.943877+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590702+0000","last_change":"2023-08-17T17:46:53.583067+0000","last_active":"2023-08-17T17:46:53.590702+0000","last_peered":"2023-08-17T17:46:53.590702+0000","last_clean":"2023-08-17T17:46:53.590702+0000","last_became_active":"2023-08-17T17:46:53.582373+0000","last_became_peered":"2023-08-17T17:46:53.582373+0000","last_unstale":"2023-08-17T17:46:53.590702+0000","last_undegraded":"2023-08-17T17:46:53.590702+0000","last_fullsized":"2023-08-17T17:46:53.590702+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941545+0000","last_change":"2023-08-17T17:46:53.941639+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941545+0000","last_undegraded":"2023-08-17T17:46:53.941545+0000","last_fullsized":"2023-08-17T17:46:53.941545+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589458+0000","last_change":"2023-08-17T17:46:53.587208+0000","last_active":"2023-08-17T17:46:53.589458+0000","last_peered":"2023-08-17T17:46:53.589458+0000","last_clean":"2023-08-17T17:46:53.589458+0000","last_became_active":"2023-08-17T17:46:53.586922+0000","last_became_peered":"2023-08-17T17:46:53.586922+0000","last_unstale":"2023-08-17T17:46:53.589458+0000","last_undegraded":"2023-08-17T17:46:53.589458+0000","last_fullsized":"2023-08-17T17:46:53.589458+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952595+0000","last_change":"2023-08-17T17:46:53.952664+0000","last_active":"2023-08-17T17:46:53.952595+0000","last_peered":"2023-08-17T17:46:53.952595+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.952430+0000","last_became_peered":"2023-08-17T17:46:53.952430+0000","last_unstale":"2023-08-17T17:46:53.952595+0000","last_undegraded":"2023-08-17T17:46:53.952595+0000","last_fullsized":"2023-08-17T17:46:53.952595+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587376+0000","last_change":"2023-08-17T17:46:53.583496+0000","last_active":"2023-08-17T17:46:53.587376+0000","last_peered":"2023-08-17T17:46:53.587376+0000","last_clean":"2023-08-17T17:46:53.587376+0000","last_became_active":"2023-08-17T17:46:53.583200+0000","last_became_peered":"2023-08-17T17:46:53.583200+0000","last_unstale":"2023-08-17T17:46:53.587376+0000","last_undegraded":"2023-08-17T17:46:53.587376+0000","last_fullsized":"2023-08-17T17:46:53.587376+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944577+0000","last_change":"2023-08-17T17:46:53.944699+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944577+0000","last_undegraded":"2023-08-17T17:46:53.944577+0000","last_fullsized":"2023-08-17T17:46:53.944577+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593065+0000","last_change":"2023-08-17T17:46:53.591647+0000","last_active":"2023-08-17T17:46:53.593065+0000","last_peered":"2023-08-17T17:46:53.593065+0000","last_clean":"2023-08-17T17:46:53.593065+0000","last_became_active":"2023-08-17T17:46:53.591369+0000","last_became_peered":"2023-08-17T17:46:53.591369+0000","last_unstale":"2023-08-17T17:46:53.593065+0000","last_undegraded":"2023-08-17T17:46:53.593065+0000","last_fullsized":"2023-08-17T17:46:53.593065+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939609+0000","last_change":"2023-08-17T17:46:53.939758+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939609+0000","last_undegraded":"2023-08-17T17:46:53.939609+0000","last_fullsized":"2023-08-17T17:46:53.939609+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594295+0000","last_change":"2023-08-17T17:46:53.591137+0000","last_active":"2023-08-17T17:46:53.594295+0000","last_peered":"2023-08-17T17:46:53.594295+0000","last_clean":"2023-08-17T17:46:53.594295+0000","last_became_active":"2023-08-17T17:46:53.590561+0000","last_became_peered":"2023-08-17T17:46:53.590561+0000","last_unstale":"2023-08-17T17:46:53.594295+0000","last_undegraded":"2023-08-17T17:46:53.594295+0000","last_fullsized":"2023-08-17T17:46:53.594295+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939500+0000","last_change":"2023-08-17T17:46:53.939664+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939500+0000","last_undegraded":"2023-08-17T17:46:53.939500+0000","last_fullsized":"2023-08-17T17:46:53.939500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583400+0000","last_change":"2023-08-17T17:46:53.578788+0000","last_active":"2023-08-17T17:46:53.583400+0000","last_peered":"2023-08-17T17:46:53.583400+0000","last_clean":"2023-08-17T17:46:53.583400+0000","last_became_active":"2023-08-17T17:46:53.578283+0000","last_became_peered":"2023-08-17T17:46:53.578283+0000","last_unstale":"2023-08-17T17:46:53.583400+0000","last_undegraded":"2023-08-17T17:46:53.583400+0000","last_fullsized":"2023-08-17T17:46:53.583400+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952045+0000","last_change":"2023-08-17T17:46:53.952105+0000","last_active":"2023-08-17T17:46:53.952045+0000","last_peered":"2023-08-17T17:46:53.952045+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.951761+0000","last_became_peered":"2023-08-17T17:46:53.951761+0000","last_unstale":"2023-08-17T17:46:53.952045+0000","last_undegraded":"2023-08-17T17:46:53.952045+0000","last_fullsized":"2023-08-17T17:46:53.952045+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587277+0000","last_change":"2023-08-17T17:46:53.582134+0000","last_active":"2023-08-17T17:46:53.587277+0000","last_peered":"2023-08-17T17:46:53.587277+0000","last_clean":"2023-08-17T17:46:53.587277+0000","last_became_active":"2023-08-17T17:46:53.581821+0000","last_became_peered":"2023-08-17T17:46:53.581821+0000","last_unstale":"2023-08-17T17:46:53.587277+0000","last_undegraded":"2023-08-17T17:46:53.587277+0000","last_fullsized":"2023-08-17T17:46:53.587277+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942082+0000","last_change":"2023-08-17T17:46:53.942203+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942082+0000","last_undegraded":"2023-08-17T17:46:53.942082+0000","last_fullsized":"2023-08-17T17:46:53.942082+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586364+0000","last_change":"2023-08-17T17:46:53.581919+0000","last_active":"2023-08-17T17:46:53.586364+0000","last_peered":"2023-08-17T17:46:53.586364+0000","last_clean":"2023-08-17T17:46:53.586364+0000","last_became_active":"2023-08-17T17:46:53.581615+0000","last_became_peered":"2023-08-17T17:46:53.581615+0000","last_unstale":"2023-08-17T17:46:53.586364+0000","last_undegraded":"2023-08-17T17:46:53.586364+0000","last_fullsized":"2023-08-17T17:46:53.586364+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943285+0000","last_change":"2023-08-17T17:46:53.943426+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943285+0000","last_undegraded":"2023-08-17T17:46:53.943285+0000","last_fullsized":"2023-08-17T17:46:53.943285+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589673+0000","last_change":"2023-08-17T17:46:53.587221+0000","last_active":"2023-08-17T17:46:53.589673+0000","last_peered":"2023-08-17T17:46:53.589673+0000","last_clean":"2023-08-17T17:46:53.589673+0000","last_became_active":"2023-08-17T17:46:53.586901+0000","last_became_peered":"2023-08-17T17:46:53.586901+0000","last_unstale":"2023-08-17T17:46:53.589673+0000","last_undegraded":"2023-08-17T17:46:53.589673+0000","last_fullsized":"2023-08-17T17:46:53.589673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944893+0000","last_change":"2023-08-17T17:46:53.945173+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944893+0000","last_undegraded":"2023-08-17T17:46:53.944893+0000","last_fullsized":"2023-08-17T17:46:53.944893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587692+0000","last_change":"2023-08-17T17:46:53.579836+0000","last_active":"2023-08-17T17:46:53.587692+0000","last_peered":"2023-08-17T17:46:53.587692+0000","last_clean":"2023-08-17T17:46:53.587692+0000","last_became_active":"2023-08-17T17:46:53.579544+0000","last_became_peered":"2023-08-17T17:46:53.579544+0000","last_unstale":"2023-08-17T17:46:53.587692+0000","last_undegraded":"2023-08-17T17:46:53.587692+0000","last_fullsized":"2023-08-17T17:46:53.587692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945016+0000","last_change":"2023-08-17T17:46:53.945126+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945016+0000","last_undegraded":"2023-08-17T17:46:53.945016+0000","last_fullsized":"2023-08-17T17:46:53.945016+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.585758+0000","last_change":"2023-08-17T17:46:53.583210+0000","last_active":"2023-08-17T17:46:53.585758+0000","last_peered":"2023-08-17T17:46:53.585758+0000","last_clean":"2023-08-17T17:46:53.585758+0000","last_became_active":"2023-08-17T17:46:53.583036+0000","last_became_peered":"2023-08-17T17:46:53.583036+0000","last_unstale":"2023-08-17T17:46:53.585758+0000","last_undegraded":"2023-08-17T17:46:53.585758+0000","last_fullsized":"2023-08-17T17:46:53.585758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943461+0000","last_change":"2023-08-17T17:46:53.943591+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943461+0000","last_undegraded":"2023-08-17T17:46:53.943461+0000","last_fullsized":"2023-08-17T17:46:53.943461+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.575333+0000","last_change":"2023-08-17T17:46:53.574238+0000","last_active":"2023-08-17T17:46:53.575333+0000","last_peered":"2023-08-17T17:46:53.575333+0000","last_clean":"2023-08-17T17:46:53.575333+0000","last_became_active":"2023-08-17T17:46:53.573880+0000","last_became_peered":"2023-08-17T17:46:53.573880+0000","last_unstale":"2023-08-17T17:46:53.575333+0000","last_undegraded":"2023-08-17T17:46:53.575333+0000","last_fullsized":"2023-08-17T17:46:53.575333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937057+0000","last_change":"2023-08-17T17:46:53.937240+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937057+0000","last_undegraded":"2023-08-17T17:46:53.937057+0000","last_fullsized":"2023-08-17T17:46:53.937057+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593638+0000","last_change":"2023-08-17T17:46:53.588046+0000","last_active":"2023-08-17T17:46:53.593638+0000","last_peered":"2023-08-17T17:46:53.593638+0000","last_clean":"2023-08-17T17:46:53.593638+0000","last_became_active":"2023-08-17T17:46:53.587776+0000","last_became_peered":"2023-08-17T17:46:53.587776+0000","last_unstale":"2023-08-17T17:46:53.593638+0000","last_undegraded":"2023-08-17T17:46:53.593638+0000","last_fullsized":"2023-08-17T17:46:53.593638+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941251+0000","last_change":"2023-08-17T17:46:53.941251+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941251+0000","last_undegraded":"2023-08-17T17:46:53.941251+0000","last_fullsized":"2023-08-17T17:46:53.941251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583978+0000","last_change":"2023-08-17T17:46:53.580782+0000","last_active":"2023-08-17T17:46:53.583978+0000","last_peered":"2023-08-17T17:46:53.583978+0000","last_clean":"2023-08-17T17:46:53.583978+0000","last_became_active":"2023-08-17T17:46:53.580298+0000","last_became_peered":"2023-08-17T17:46:53.580298+0000","last_unstale":"2023-08-17T17:46:53.583978+0000","last_undegraded":"2023-08-17T17:46:53.583978+0000","last_fullsized":"2023-08-17T17:46:53.583978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940775+0000","last_change":"2023-08-17T17:46:53.940903+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940775+0000","last_undegraded":"2023-08-17T17:46:53.940775+0000","last_fullsized":"2023-08-17T17:46:53.940775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589471+0000","last_change":"2023-08-17T17:46:53.587937+0000","last_active":"2023-08-17T17:46:53.589471+0000","last_peered":"2023-08-17T17:46:53.589471+0000","last_clean":"2023-08-17T17:46:53.589471+0000","last_became_active":"2023-08-17T17:46:53.587645+0000","last_became_peered":"2023-08-17T17:46:53.587645+0000","last_unstale":"2023-08-17T17:46:53.589471+0000","last_undegraded":"2023-08-17T17:46:53.589471+0000","last_fullsized":"2023-08-17T17:46:53.589471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938302+0000","last_change":"2023-08-17T17:46:53.938456+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938302+0000","last_undegraded":"2023-08-17T17:46:53.938302+0000","last_fullsized":"2023-08-17T17:46:53.938302+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595334+0000","last_change":"2023-08-17T17:46:53.591820+0000","last_active":"2023-08-17T17:46:53.595334+0000","last_peered":"2023-08-17T17:46:53.595334+0000","last_clean":"2023-08-17T17:46:53.595334+0000","last_became_active":"2023-08-17T17:46:53.591544+0000","last_became_peered":"2023-08-17T17:46:53.591544+0000","last_unstale":"2023-08-17T17:46:53.595334+0000","last_undegraded":"2023-08-17T17:46:53.595334+0000","last_fullsized":"2023-08-17T17:46:53.595334+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945011+0000","last_change":"2023-08-17T17:46:53.945183+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945011+0000","last_undegraded":"2023-08-17T17:46:53.945011+0000","last_fullsized":"2023-08-17T17:46:53.945011+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.581056+0000","last_change":"2023-08-17T17:46:53.576364+0000","last_active":"2023-08-17T17:46:53.581056+0000","last_peered":"2023-08-17T17:46:53.581056+0000","last_clean":"2023-08-17T17:46:53.581056+0000","last_became_active":"2023-08-17T17:46:53.576052+0000","last_became_peered":"2023-08-17T17:46:53.576052+0000","last_unstale":"2023-08-17T17:46:53.581056+0000","last_undegraded":"2023-08-17T17:46:53.581056+0000","last_fullsized":"2023-08-17T17:46:53.581056+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941183+0000","last_change":"2023-08-17T17:46:53.941315+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941183+0000","last_undegraded":"2023-08-17T17:46:53.941183+0000","last_fullsized":"2023-08-17T17:46:53.941183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.588720+0000","last_change":"2023-08-17T17:46:53.583930+0000","last_active":"2023-08-17T17:46:53.588720+0000","last_peered":"2023-08-17T17:46:53.588720+0000","last_clean":"2023-08-17T17:46:53.588720+0000","last_became_active":"2023-08-17T17:46:53.583633+0000","last_became_peered":"2023-08-17T17:46:53.583633+0000","last_unstale":"2023-08-17T17:46:53.588720+0000","last_undegraded":"2023-08-17T17:46:53.588720+0000","last_fullsized":"2023-08-17T17:46:53.588720+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945636+0000","last_change":"2023-08-17T17:46:53.946154+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945636+0000","last_undegraded":"2023-08-17T17:46:53.945636+0000","last_fullsized":"2023-08-17T17:46:53.945636+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583312+0000","last_change":"2023-08-17T17:46:53.576838+0000","last_active":"2023-08-17T17:46:53.583312+0000","last_peered":"2023-08-17T17:46:53.583312+0000","last_clean":"2023-08-17T17:46:53.583312+0000","last_became_active":"2023-08-17T17:46:53.576666+0000","last_became_peered":"2023-08-17T17:46:53.576666+0000","last_unstale":"2023-08-17T17:46:53.583312+0000","last_undegraded":"2023-08-17T17:46:53.583312+0000","last_fullsized":"2023-08-17T17:46:53.583312+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937664+0000","last_change":"2023-08-17T17:46:53.937822+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937664+0000","last_undegraded":"2023-08-17T17:46:53.937664+0000","last_fullsized":"2023-08-17T17:46:53.937664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590205+0000","last_change":"2023-08-17T17:46:53.588579+0000","last_active":"2023-08-17T17:46:53.590205+0000","last_peered":"2023-08-17T17:46:53.590205+0000","last_clean":"2023-08-17T17:46:53.590205+0000","last_became_active":"2023-08-17T17:46:53.588025+0000","last_became_peered":"2023-08-17T17:46:53.588025+0000","last_unstale":"2023-08-17T17:46:53.590205+0000","last_undegraded":"2023-08-17T17:46:53.590205+0000","last_fullsized":"2023-08-17T17:46:53.590205+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.946622+0000","last_change":"2023-08-17T17:46:53.946710+0000","last_active":"2023-08-17T17:46:53.946622+0000","last_peered":"2023-08-17T17:46:53.946622+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.946424+0000","last_became_peered":"2023-08-17T17:46:53.946424+0000","last_unstale":"2023-08-17T17:46:53.946622+0000","last_undegraded":"2023-08-17T17:46:53.946622+0000","last_fullsized":"2023-08-17T17:46:53.946622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593808+0000","last_change":"2023-08-17T17:46:53.592735+0000","last_active":"2023-08-17T17:46:53.593808+0000","last_peered":"2023-08-17T17:46:53.593808+0000","last_clean":"2023-08-17T17:46:53.593808+0000","last_became_active":"2023-08-17T17:46:53.592421+0000","last_became_peered":"2023-08-17T17:46:53.592421+0000","last_unstale":"2023-08-17T17:46:53.593808+0000","last_undegraded":"2023-08-17T17:46:53.593808+0000","last_fullsized":"2023-08-17T17:46:53.593808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.948487+0000","last_change":"2023-08-17T17:46:53.948603+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.948487+0000","last_undegraded":"2023-08-17T17:46:53.948487+0000","last_fullsized":"2023-08-17T17:46:53.948487+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595091+0000","last_change":"2023-08-17T17:46:53.594526+0000","last_active":"2023-08-17T17:46:53.595091+0000","last_peered":"2023-08-17T17:46:53.595091+0000","last_clean":"2023-08-17T17:46:53.595091+0000","last_became_active":"2023-08-17T17:46:53.594206+0000","last_became_peered":"2023-08-17T17:46:53.594206+0000","last_unstale":"2023-08-17T17:46:53.595091+0000","last_undegraded":"2023-08-17T17:46:53.595091+0000","last_fullsized":"2023-08-17T17:46:53.595091+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938853+0000","last_change":"2023-08-17T17:46:53.938963+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938853+0000","last_undegraded":"2023-08-17T17:46:53.938853+0000","last_fullsized":"2023-08-17T17:46:53.938853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587827+0000","last_change":"2023-08-17T17:46:53.581153+0000","last_active":"2023-08-17T17:46:53.587827+0000","last_peered":"2023-08-17T17:46:53.587827+0000","last_clean":"2023-08-17T17:46:53.587827+0000","last_became_active":"2023-08-17T17:46:53.580902+0000","last_became_peered":"2023-08-17T17:46:53.580902+0000","last_unstale":"2023-08-17T17:46:53.587827+0000","last_undegraded":"2023-08-17T17:46:53.587827+0000","last_fullsized":"2023-08-17T17:46:53.587827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937121+0000","last_change":"2023-08-17T17:46:53.937261+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937121+0000","last_undegraded":"2023-08-17T17:46:53.937121+0000","last_fullsized":"2023-08-17T17:46:53.937121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595272+0000","last_change":"2023-08-17T17:46:53.591102+0000","last_active":"2023-08-17T17:46:53.595272+0000","last_peered":"2023-08-17T17:46:53.595272+0000","last_clean":"2023-08-17T17:46:53.595272+0000","last_became_active":"2023-08-17T17:46:53.590811+0000","last_became_peered":"2023-08-17T17:46:53.590811+0000","last_unstale":"2023-08-17T17:46:53.595272+0000","last_undegraded":"2023-08-17T17:46:53.595272+0000","last_fullsized":"2023-08-17T17:46:53.595272+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943621+0000","last_change":"2023-08-17T17:46:53.945412+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943621+0000","last_undegraded":"2023-08-17T17:46:53.943621+0000","last_fullsized":"2023-08-17T17:46:53.943621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592959+0000","last_change":"2023-08-17T17:46:53.591056+0000","last_active":"2023-08-17T17:46:53.592959+0000","last_peered":"2023-08-17T17:46:53.592959+0000","last_clean":"2023-08-17T17:46:53.592959+0000","last_became_active":"2023-08-17T17:46:53.590762+0000","last_became_peered":"2023-08-17T17:46:53.590762+0000","last_unstale":"2023-08-17T17:46:53.592959+0000","last_undegraded":"2023-08-17T17:46:53.592959+0000","last_fullsized":"2023-08-17T17:46:53.592959+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941519+0000","last_change":"2023-08-17T17:46:53.941637+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941519+0000","last_undegraded":"2023-08-17T17:46:53.941519+0000","last_fullsized":"2023-08-17T17:46:53.941519+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590423+0000","last_change":"2023-08-17T17:46:53.589394+0000","last_active":"2023-08-17T17:46:53.590423+0000","last_peered":"2023-08-17T17:46:53.590423+0000","last_clean":"2023-08-17T17:46:53.590423+0000","last_became_active":"2023-08-17T17:46:53.589087+0000","last_became_peered":"2023-08-17T17:46:53.589087+0000","last_unstale":"2023-08-17T17:46:53.590423+0000","last_undegraded":"2023-08-17T17:46:53.590423+0000","last_fullsized":"2023-08-17T17:46:53.590423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944884+0000","last_change":"2023-08-17T17:46:53.945023+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944884+0000","last_undegraded":"2023-08-17T17:46:53.944884+0000","last_fullsized":"2023-08-17T17:46:53.944884+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587961+0000","last_change":"2023-08-17T17:46:53.584361+0000","last_active":"2023-08-17T17:46:53.587961+0000","last_peered":"2023-08-17T17:46:53.587961+0000","last_clean":"2023-08-17T17:46:53.587961+0000","last_became_active":"2023-08-17T17:46:53.584085+0000","last_became_peered":"2023-08-17T17:46:53.584085+0000","last_unstale":"2023-08-17T17:46:53.587961+0000","last_undegraded":"2023-08-17T17:46:53.587961+0000","last_fullsized":"2023-08-17T17:46:53.587961+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939992+0000","last_change":"2023-08-17T17:46:53.940120+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939992+0000","last_undegraded":"2023-08-17T17:46:53.939992+0000","last_fullsized":"2023-08-17T17:46:53.939992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594348+0000","last_change":"2023-08-17T17:46:53.588048+0000","last_active":"2023-08-17T17:46:53.594348+0000","last_peered":"2023-08-17T17:46:53.594348+0000","last_clean":"2023-08-17T17:46:53.594348+0000","last_became_active":"2023-08-17T17:46:53.587765+0000","last_became_peered":"2023-08-17T17:46:53.587765+0000","last_unstale":"2023-08-17T17:46:53.594348+0000","last_undegraded":"2023-08-17T17:46:53.594348+0000","last_fullsized":"2023-08-17T17:46:53.594348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939716+0000","last_change":"2023-08-17T17:46:53.939858+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939716+0000","last_undegraded":"2023-08-17T17:46:53.939716+0000","last_fullsized":"2023-08-17T17:46:53.939716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591534+0000","last_change":"2023-08-17T17:46:53.580274+0000","last_active":"2023-08-17T17:46:53.591534+0000","last_peered":"2023-08-17T17:46:53.591534+0000","last_clean":"2023-08-17T17:46:53.591534+0000","last_became_active":"2023-08-17T17:46:53.580000+0000","last_became_peered":"2023-08-17T17:46:53.580000+0000","last_unstale":"2023-08-17T17:46:53.591534+0000","last_undegraded":"2023-08-17T17:46:53.591534+0000","last_fullsized":"2023-08-17T17:46:53.591534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937716+0000","last_change":"2023-08-17T17:46:53.937873+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937716+0000","last_undegraded":"2023-08-17T17:46:53.937716+0000","last_fullsized":"2023-08-17T17:46:53.937716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.582774+0000","last_change":"2023-08-17T17:46:53.581711+0000","last_active":"2023-08-17T17:46:53.582774+0000","last_peered":"2023-08-17T17:46:53.582774+0000","last_clean":"2023-08-17T17:46:53.582774+0000","last_became_active":"2023-08-17T17:46:53.581422+0000","last_became_peered":"2023-08-17T17:46:53.581422+0000","last_unstale":"2023-08-17T17:46:53.582774+0000","last_undegraded":"2023-08-17T17:46:53.582774+0000","last_fullsized":"2023-08-17T17:46:53.582774+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940892+0000","last_change":"2023-08-17T17:46:53.941005+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940892+0000","last_undegraded":"2023-08-17T17:46:53.940892+0000","last_fullsized":"2023-08-17T17:46:53.940892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590044+0000","last_change":"2023-08-17T17:46:53.588355+0000","last_active":"2023-08-17T17:46:53.590044+0000","last_peered":"2023-08-17T17:46:53.590044+0000","last_clean":"2023-08-17T17:46:53.590044+0000","last_became_active":"2023-08-17T17:46:53.587993+0000","last_became_peered":"2023-08-17T17:46:53.587993+0000","last_unstale":"2023-08-17T17:46:53.590044+0000","last_undegraded":"2023-08-17T17:46:53.590044+0000","last_fullsized":"2023-08-17T17:46:53.590044+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937494+0000","last_change":"2023-08-17T17:46:53.937635+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937494+0000","last_undegraded":"2023-08-17T17:46:53.937494+0000","last_fullsized":"2023-08-17T17:46:53.937494+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583805+0000","last_change":"2023-08-17T17:46:53.581332+0000","last_active":"2023-08-17T17:46:53.583805+0000","last_peered":"2023-08-17T17:46:53.583805+0000","last_clean":"2023-08-17T17:46:53.583805+0000","last_became_active":"2023-08-17T17:46:53.581009+0000","last_became_peered":"2023-08-17T17:46:53.581009+0000","last_unstale":"2023-08-17T17:46:53.583805+0000","last_undegraded":"2023-08-17T17:46:53.583805+0000","last_fullsized":"2023-08-17T17:46:53.583805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941448+0000","last_change":"2023-08-17T17:46:53.941575+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941448+0000","last_undegraded":"2023-08-17T17:46:53.941448+0000","last_fullsized":"2023-08-17T17:46:53.941448+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587786+0000","last_change":"2023-08-17T17:46:53.581061+0000","last_active":"2023-08-17T17:46:53.587786+0000","last_peered":"2023-08-17T17:46:53.587786+0000","last_clean":"2023-08-17T17:46:53.587786+0000","last_became_active":"2023-08-17T17:46:53.580750+0000","last_became_peered":"2023-08-17T17:46:53.580750+0000","last_unstale":"2023-08-17T17:46:53.587786+0000","last_undegraded":"2023-08-17T17:46:53.587786+0000","last_fullsized":"2023-08-17T17:46:53.587786+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944411+0000","last_change":"2023-08-17T17:46:53.944546+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944411+0000","last_undegraded":"2023-08-17T17:46:53.944411+0000","last_fullsized":"2023-08-17T17:46:53.944411+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591641+0000","last_change":"2023-08-17T17:46:53.584779+0000","last_active":"2023-08-17T17:46:53.591641+0000","last_peered":"2023-08-17T17:46:53.591641+0000","last_clean":"2023-08-17T17:46:53.591641+0000","last_became_active":"2023-08-17T17:46:53.584502+0000","last_became_peered":"2023-08-17T17:46:53.584502+0000","last_unstale":"2023-08-17T17:46:53.591641+0000","last_undegraded":"2023-08-17T17:46:53.591641+0000","last_fullsized":"2023-08-17T17:46:53.591641+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":5,"reported_epoch":59,"state":"active","last_fresh":"2023-08-17T17:46:53.947664+0000","last_change":"2023-08-17T17:46:53.947664+0000","last_active":"2023-08-17T17:46:53.947664+0000","last_peered":"2023-08-17T17:46:53.947664+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.947664+0000","last_became_peered":"2023-08-17T17:46:53.947664+0000","last_unstale":"2023-08-17T17:46:53.947664+0000","last_undegraded":"2023-08-17T17:46:53.947664+0000","last_fullsized":"2023-08-17T17:46:53.947664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.585170+0000","last_change":"2023-08-17T17:46:53.582200+0000","last_active":"2023-08-17T17:46:53.585170+0000","last_peered":"2023-08-17T17:46:53.585170+0000","last_clean":"2023-08-17T17:46:53.585170+0000","last_became_active":"2023-08-17T17:46:53.581952+0000","last_became_peered":"2023-08-17T17:46:53.581952+0000","last_unstale":"2023-08-17T17:46:53.585170+0000","last_undegraded":"2023-08-17T17:46:53.585170+0000","last_fullsized":"2023-08-17T17:46:53.585170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944068+0000","last_change":"2023-08-17T17:46:53.944185+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944068+0000","last_undegraded":"2023-08-17T17:46:53.944068+0000","last_fullsized":"2023-08-17T17:46:53.944068+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589729+0000","last_change":"2023-08-17T17:46:53.588244+0000","last_active":"2023-08-17T17:46:53.589729+0000","last_peered":"2023-08-17T17:46:53.589729+0000","last_clean":"2023-08-17T17:46:53.589729+0000","last_became_active":"2023-08-17T17:46:53.587974+0000","last_became_peered":"2023-08-17T17:46:53.587974+0000","last_unstale":"2023-08-17T17:46:53.589729+0000","last_undegraded":"2023-08-17T17:46:53.589729+0000","last_fullsized":"2023-08-17T17:46:53.589729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.567702+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:46:53.567702+0000","last_peered":"2023-08-17T17:46:53.567702+0000","last_clean":"2023-08-17T17:46:53.567702+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:46:53.567702+0000","last_undegraded":"2023-08-17T17:46:53.567702+0000","last_fullsized":"2023-08-17T17:46:53.567702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.936412+0000","last_change":"2023-08-17T17:46:53.936577+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.936412+0000","last_undegraded":"2023-08-17T17:46:53.936412+0000","last_fullsized":"2023-08-17T17:46:53.936412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593048+0000","last_change":"2023-08-17T17:46:53.591586+0000","last_active":"2023-08-17T17:46:53.593048+0000","last_peered":"2023-08-17T17:46:53.593048+0000","last_clean":"2023-08-17T17:46:53.593048+0000","last_became_active":"2023-08-17T17:46:53.591021+0000","last_became_peered":"2023-08-17T17:46:53.591021+0000","last_unstale":"2023-08-17T17:46:53.593048+0000","last_undegraded":"2023-08-17T17:46:53.593048+0000","last_fullsized":"2023-08-17T17:46:53.593048+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.570406+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:46:53.570406+0000","last_peered":"2023-08-17T17:46:53.570406+0000","last_clean":"2023-08-17T17:46:53.570406+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:46:53.570406+0000","last_undegraded":"2023-08-17T17:46:53.570406+0000","last_fullsized":"2023-08-17T17:46:53.570406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941113+0000","last_change":"2023-08-17T17:46:53.941363+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941113+0000","last_undegraded":"2023-08-17T17:46:53.941113+0000","last_fullsized":"2023-08-17T17:46:53.941113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591304+0000","last_change":"2023-08-17T17:46:53.584242+0000","last_active":"2023-08-17T17:46:53.591304+0000","last_peered":"2023-08-17T17:46:53.591304+0000","last_clean":"2023-08-17T17:46:53.591304+0000","last_became_active":"2023-08-17T17:46:53.583975+0000","last_became_peered":"2023-08-17T17:46:53.583975+0000","last_unstale":"2023-08-17T17:46:53.591304+0000","last_undegraded":"2023-08-17T17:46:53.591304+0000","last_fullsized":"2023-08-17T17:46:53.591304+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.574503+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:46:53.574503+0000","last_peered":"2023-08-17T17:46:53.574503+0000","last_clean":"2023-08-17T17:46:53.574503+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:46:53.574503+0000","last_undegraded":"2023-08-17T17:46:53.574503+0000","last_fullsized":"2023-08-17T17:46:53.574503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941461+0000","last_change":"2023-08-17T17:46:53.941622+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941461+0000","last_undegraded":"2023-08-17T17:46:53.941461+0000","last_fullsized":"2023-08-17T17:46:53.941461+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595361+0000","last_change":"2023-08-17T17:46:53.591978+0000","last_active":"2023-08-17T17:46:53.595361+0000","last_peered":"2023-08-17T17:46:53.595361+0000","last_clean":"2023-08-17T17:46:53.595361+0000","last_became_active":"2023-08-17T17:46:53.591812+0000","last_became_peered":"2023-08-17T17:46:53.591812+0000","last_unstale":"2023-08-17T17:46:53.595361+0000","last_undegraded":"2023-08-17T17:46:53.595361+0000","last_fullsized":"2023-08-17T17:46:53.595361+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.577814+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:46:53.577814+0000","last_peered":"2023-08-17T17:46:53.577814+0000","last_clean":"2023-08-17T17:46:53.577814+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:46:53.577814+0000","last_undegraded":"2023-08-17T17:46:53.577814+0000","last_fullsized":"2023-08-17T17:46:53.577814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.580993+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:46:53.580993+0000","last_peered":"2023-08-17T17:46:53.580993+0000","last_clean":"2023-08-17T17:46:53.580993+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:46:53.580993+0000","last_undegraded":"2023-08-17T17:46:53.580993+0000","last_fullsized":"2023-08-17T17:46:53.580993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938984+0000","last_change":"2023-08-17T17:46:53.939138+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938984+0000","last_undegraded":"2023-08-17T17:46:53.938984+0000","last_fullsized":"2023-08-17T17:46:53.938984+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589500+0000","last_change":"2023-08-17T17:46:53.586983+0000","last_active":"2023-08-17T17:46:53.589500+0000","last_peered":"2023-08-17T17:46:53.589500+0000","last_clean":"2023-08-17T17:46:53.589500+0000","last_became_active":"2023-08-17T17:46:53.586729+0000","last_became_peered":"2023-08-17T17:46:53.586729+0000","last_unstale":"2023-08-17T17:46:53.589500+0000","last_undegraded":"2023-08-17T17:46:53.589500+0000","last_fullsized":"2023-08-17T17:46:53.589500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.581035+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:46:53.581035+0000","last_peered":"2023-08-17T17:46:53.581035+0000","last_clean":"2023-08-17T17:46:53.581035+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:46:53.581035+0000","last_undegraded":"2023-08-17T17:46:53.581035+0000","last_fullsized":"2023-08-17T17:46:53.581035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939926+0000","last_change":"2023-08-17T17:46:53.940046+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939926+0000","last_undegraded":"2023-08-17T17:46:53.939926+0000","last_fullsized":"2023-08-17T17:46:53.939926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593263+0000","last_change":"2023-08-17T17:46:53.591593+0000","last_active":"2023-08-17T17:46:53.593263+0000","last_peered":"2023-08-17T17:46:53.593263+0000","last_clean":"2023-08-17T17:46:53.593263+0000","last_became_active":"2023-08-17T17:46:53.591368+0000","last_became_peered":"2023-08-17T17:46:53.591368+0000","last_unstale":"2023-08-17T17:46:53.593263+0000","last_undegraded":"2023-08-17T17:46:53.593263+0000","last_fullsized":"2023-08-17T17:46:53.593263+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.582295+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:46:53.582295+0000","last_peered":"2023-08-17T17:46:53.582295+0000","last_clean":"2023-08-17T17:46:53.582295+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:46:53.582295+0000","last_undegraded":"2023-08-17T17:46:53.582295+0000","last_fullsized":"2023-08-17T17:46:53.582295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952125+0000","last_change":"2023-08-17T17:46:53.952198+0000","last_active":"2023-08-17T17:46:53.952125+0000","last_peered":"2023-08-17T17:46:53.952125+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.951935+0000","last_became_peered":"2023-08-17T17:46:53.951935+0000","last_unstale":"2023-08-17T17:46:53.952125+0000","last_undegraded":"2023-08-17T17:46:53.952125+0000","last_fullsized":"2023-08-17T17:46:53.952125+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587803+0000","last_change":"2023-08-17T17:46:53.581838+0000","last_active":"2023-08-17T17:46:53.587803+0000","last_peered":"2023-08-17T17:46:53.587803+0000","last_clean":"2023-08-17T17:46:53.587803+0000","last_became_active":"2023-08-17T17:46:53.581523+0000","last_became_peered":"2023-08-17T17:46:53.581523+0000","last_unstale":"2023-08-17T17:46:53.587803+0000","last_undegraded":"2023-08-17T17:46:53.587803+0000","last_fullsized":"2023-08-17T17:46:53.587803+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.568013+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:46:53.568013+0000","last_peered":"2023-08-17T17:46:53.568013+0000","last_clean":"2023-08-17T17:46:53.568013+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:46:53.568013+0000","last_undegraded":"2023-08-17T17:46:53.568013+0000","last_fullsized":"2023-08-17T17:46:53.568013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.936458+0000","last_change":"2023-08-17T17:46:53.936611+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.936458+0000","last_undegraded":"2023-08-17T17:46:53.936458+0000","last_fullsized":"2023-08-17T17:46:53.936458+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587511+0000","last_change":"2023-08-17T17:46:53.574800+0000","last_active":"2023-08-17T17:46:53.587511+0000","last_peered":"2023-08-17T17:46:53.587511+0000","last_clean":"2023-08-17T17:46:53.587511+0000","last_became_active":"2023-08-17T17:46:53.574519+0000","last_became_peered":"2023-08-17T17:46:53.574519+0000","last_unstale":"2023-08-17T17:46:53.587511+0000","last_undegraded":"2023-08-17T17:46:53.587511+0000","last_fullsized":"2023-08-17T17:46:53.587511+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.569249+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:46:53.569249+0000","last_peered":"2023-08-17T17:46:53.569249+0000","last_clean":"2023-08-17T17:46:53.569249+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:46:53.569249+0000","last_undegraded":"2023-08-17T17:46:53.569249+0000","last_fullsized":"2023-08-17T17:46:53.569249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.72099999999999997,"5min":0.76400000000000001,"15min":0.80200000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.68899999999999995,"5min":0.82399999999999995,"15min":0.82899999999999996},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"min":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.28999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.81200000000000006},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.80000000000000004},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.56100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70499999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.503}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.751,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.435}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.46200000000000002},"min":{"1min":0.34000000000000002,"5min":0.32300000000000001,"15min":0.28599999999999998},"max":{"1min":0.63,"5min":0.80100000000000005,"15min":0.85499999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.26300000000000001},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.72999999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.437,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.70699999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.375},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72899999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67900000000000005,"5min":0.79900000000000004,"15min":1.0980000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52600000000000002,"15min":0.50700000000000001},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71299999999999997,"5min":0.79000000000000004,"15min":1.0609999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.377},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.30599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.751,"15min":0.751},"last":0.498},{"interface":"front","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.48499999999999999},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.026},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.42699999999999999,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.0740000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.34200000000000003},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52800000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.38200000000000001,"15min":0.36299999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54400000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.27300000000000002,"5min":0.25,"15min":0.22800000000000001},"max":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.72999999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.40300000000000002},"min":{"1min":0.29999999999999999,"5min":0.28399999999999997,"15min":0.219},"max":{"1min":0.61599999999999999,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.435,"15min":0.41899999999999998},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29799999999999999},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.66600000000000004},"last":0.318},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.80800000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.39000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":1.0129999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63400000000000001,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":1.331,"15min":1.331},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64200000000000002,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":0.89000000000000001,"5min":1.319,"15min":1.319},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63800000000000001,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":1.2929999999999999,"15min":1.345},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.39800000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.94499999999999995},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67000000000000004,"15min":0.64200000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.436,"15min":0.41199999999999998},"max":{"1min":0.88900000000000001,"5min":1.359,"15min":1.377},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36599999999999999,"15min":0.34799999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.28799999999999998,"5min":0.248,"15min":0.217},"max":{"1min":0.48399999999999999,"5min":0.58799999999999997,"15min":0.66200000000000003},"last":0.313}]},{"osd":2,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38300000000000001,"15min":0.36199999999999999},"min":{"1min":0.26900000000000002,"5min":0.23599999999999999,"15min":0.20300000000000001},"max":{"1min":0.51400000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.65200000000000002},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.58999999999999997,"15min":0.66200000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.40500000000000003},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.49299999999999999,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.998,"5min":0.998,"15min":1.337},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":0.90700000000000003,"15min":1.3300000000000001},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.96299999999999997,"15min":0.97199999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.462},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.391},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84199999999999997,"5min":0.93300000000000005,"15min":0.97299999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.997,"15min":1.544},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.246,"5min":0.219,"15min":0.20599999999999999},"max":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.81100000000000005},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.28599999999999998,"5min":0.247,"15min":0.221},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40100000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.70199999999999996},"last":0.378},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42399999999999999,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":0.54900000000000004,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41099999999999998},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40799999999999997,"15min":0.39400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.222},"max":{"1min":0.61699999999999999,"5min":0.629,"15min":0.629},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.65600000000000003,"15min":0.60899999999999999},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39000000000000001},"max":{"1min":0.82899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.67300000000000004,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.625,"15min":0.59999999999999998},"min":{"1min":0.47599999999999998,"5min":0.43099999999999999,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.495}]},{"osd":7,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.64100000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.63400000000000001},"min":{"1min":0.51600000000000001,"5min":0.46100000000000002,"15min":0.441},"max":{"1min":0.85399999999999998,"5min":0.874,"15min":1.0109999999999999},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32800000000000001,"15min":0.33300000000000002},"min":{"1min":0.248,"5min":0.221,"15min":0.191},"max":{"1min":0.40400000000000003,"5min":0.48699999999999999,"15min":0.69999999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.36699999999999999,"15min":0.37},"min":{"1min":0.251,"5min":0.224,"15min":0.224},"max":{"1min":0.496,"5min":0.60599999999999998,"15min":0.71799999999999997},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.215},"max":{"1min":0.48499999999999999,"5min":0.61099999999999999,"15min":0.73799999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.49099999999999999,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.26900000000000002,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.82299999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40699999999999997,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.59399999999999997,"5min":0.61699999999999999,"15min":0.71099999999999997},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":0.89000000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":2.1309999999999998},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38100000000000001},"max":{"1min":0.80200000000000005,"5min":0.86099999999999999,"15min":0.90100000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77100000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":0.91700000000000004,"15min":0.95299999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.83999999999999997,"5min":1.016,"15min":2.1669999999999998},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71899999999999997,"5min":0.83999999999999997,"15min":0.89100000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55500000000000005,"15min":0.53300000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.83199999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.78200000000000003,"15min":0.80900000000000005},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59199999999999997,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77200000000000002,"5min":0.82199999999999995,"15min":0.84799999999999998},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55300000000000005,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.80100000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.55700000000000005},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.47199999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.86399999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47599999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.53200000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.94899999999999995},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.375,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.82199999999999995,"15min":0.91900000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.877,"15min":1.056},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.32200000000000001,"15min":0.27700000000000002},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":1.2609999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.35599999999999998,"15min":0.31},"max":{"1min":0.71799999999999997,"5min":0.77900000000000003,"15min":1.1499999999999999},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.747,"15min":1.242},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":0.81100000000000005,"15min":1.1399999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.252},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.81100000000000005,"15min":1.274},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":1.179},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":0.78000000000000003,"15min":1.3080000000000001},"last":0.499}]},{"osd":4,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.75,"15min":1.0620000000000001},"last":0.44},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.51400000000000001},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.83899999999999997,"15min":1.0740000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.503,"15min":0.52500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":1.01},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.56100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.30099999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.1020000000000001},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.56999999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":1.038},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.755,"5min":0.79100000000000004,"15min":1.1279999999999999},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:46:57.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:46:57.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.415+0000 7f0144e4c700 1 Processor -- start 2023-08-17T17:46:57.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.415+0000 7f0144e4c700 1 -- start start 2023-08-17T17:46:57.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0144e4c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0140154140 0x7f01400c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0144e4c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01400a7c40 0x7f01400c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0144e4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01400a80b0 0x7f01400c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0144e4c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400c12e0 con 0x7f01400a7c40 2023-08-17T17:46:57.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0144e4c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0140154520 con 0x7f0140154140 2023-08-17T17:46:57.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0144e4c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01400c91e0 con 0x7f01400a80b0 2023-08-17T17:46:57.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0135d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01400a7c40 0x7f01400c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0135d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01400a7c40 0x7f01400c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37096/0 (socket says 172.21.15.78:37096) 2023-08-17T17:46:57.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0135d9b700 1 -- 172.21.15.78:0/1499263714 learned_addr learned my addr 172.21.15.78:0/1499263714 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:57.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f013ed9d700 1 --2- 172.21.15.78:0/1499263714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01400a80b0 0x7f01400c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f013e59c700 1 --2- 172.21.15.78:0/1499263714 >> v2:172.21.15.150:3300/0 conn(0x7f0140154140 0x7f01400c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0135d9b700 1 -- 172.21.15.78:0/1499263714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01400a80b0 msgr2=0x7f01400c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:57.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0135d9b700 1 --2- 172.21.15.78:0/1499263714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01400a80b0 0x7f01400c0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0135d9b700 1 -- 172.21.15.78:0/1499263714 >> v2:172.21.15.150:3300/0 conn(0x7f0140154140 msgr2=0x7f01400c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:57.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0135d9b700 1 --2- 172.21.15.78:0/1499263714 >> v2:172.21.15.150:3300/0 conn(0x7f0140154140 0x7f01400c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.416+0000 7f0135d9b700 1 -- 172.21.15.78:0/1499263714 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400c94c0 con 0x7f01400a7c40 2023-08-17T17:46:57.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f0135d9b700 1 --2- 172.21.15.78:0/1499263714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01400a7c40 0x7f01400c0900 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f01400625b0 tx=0x7f01280090f0).ready entity=mon.0 client_cookie=5502ce3f025b3902 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:57.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f013dd9b700 1 -- 172.21.15.78:0/1499263714 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012800b600 con 0x7f01400a7c40 2023-08-17T17:46:57.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f013dd9b700 1 -- 172.21.15.78:0/1499263714 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012800b760 con 0x7f01400a7c40 2023-08-17T17:46:57.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f013dd9b700 1 -- 172.21.15.78:0/1499263714 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012800bae0 con 0x7f01400a7c40 2023-08-17T17:46:57.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f0144e4c700 1 -- 172.21.15.78:0/1499263714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01400a7c40 msgr2=0x7f01400c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f0144e4c700 1 --2- 172.21.15.78:0/1499263714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01400a7c40 0x7f01400c0900 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f01400625b0 tx=0x7f01280090f0).stop 2023-08-17T17:46:57.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f0144e4c700 1 -- 172.21.15.78:0/1499263714 shutdown_connections 2023-08-17T17:46:57.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f0144e4c700 1 --2- 172.21.15.78:0/1499263714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01400a80b0 0x7f01400c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f0144e4c700 1 --2- 172.21.15.78:0/1499263714 >> v2:172.21.15.150:3300/0 conn(0x7f0140154140 0x7f01400c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f0144e4c700 1 --2- 172.21.15.78:0/1499263714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01400a7c40 0x7f01400c0900 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f0144e4c700 1 -- 172.21.15.78:0/1499263714 >> 172.21.15.78:0/1499263714 conn(0x7f0140094510 msgr2=0x7f014006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:57.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f0144e4c700 1 -- 172.21.15.78:0/1499263714 shutdown_connections 2023-08-17T17:46:57.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.417+0000 7f0144e4c700 1 -- 172.21.15.78:0/1499263714 wait complete. 2023-08-17T17:46:57.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.418+0000 7f0144e4c700 1 Processor -- start 2023-08-17T17:46:57.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.418+0000 7f0144e4c700 1 -- start start 2023-08-17T17:46:57.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f0144e4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01400a7c40 0x7f014014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f0144e4c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01400a80b0 0x7f0140150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f0144e4c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0140154140 0x7f0140150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f0144e4c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140150c60 con 0x7f0140154140 2023-08-17T17:46:57.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f0144e4c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01400c4600 con 0x7f01400a80b0 2023-08-17T17:46:57.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f0144e4c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01400c39f0 con 0x7f01400a7c40 2023-08-17T17:46:57.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f013ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0140154140 0x7f0140150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f013ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0140154140 0x7f0140150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37112/0 (socket says 172.21.15.78:37112) 2023-08-17T17:46:57.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f013ed9d700 1 -- 172.21.15.78:0/726305430 learned_addr learned my addr 172.21.15.78:0/726305430 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:57.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f0135d9b700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01400a80b0 0x7f0140150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.419+0000 7f013e59c700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01400a7c40 0x7f014014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f013ed9d700 1 -- 172.21.15.78:0/726305430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01400a7c40 msgr2=0x7f014014eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f013ed9d700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01400a7c40 0x7f014014eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f013ed9d700 1 -- 172.21.15.78:0/726305430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01400a80b0 msgr2=0x7f0140150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f013ed9d700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01400a80b0 0x7f0140150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f013ed9d700 1 -- 172.21.15.78:0/726305430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0128009370 con 0x7f0140154140 2023-08-17T17:46:57.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f013ed9d700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0140154140 0x7f0140150770 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f013800ce80 tx=0x7f0138007840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f0136ffd700 1 -- 172.21.15.78:0/726305430 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800acc0 con 0x7f0140154140 2023-08-17T17:46:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f0136ffd700 1 -- 172.21.15.78:0/726305430 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013800ae20 con 0x7f0140154140 2023-08-17T17:46:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f0144e4c700 1 -- 172.21.15.78:0/726305430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01400c3cd0 con 0x7f0140154140 2023-08-17T17:46:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f0136ffd700 1 -- 172.21.15.78:0/726305430 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138016610 con 0x7f0140154140 2023-08-17T17:46:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.420+0000 7f0144e4c700 1 -- 172.21.15.78:0/726305430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01400c4290 con 0x7f0140154140 2023-08-17T17:46:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.421+0000 7f0144e4c700 1 -- 172.21.15.78:0/726305430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140047350 con 0x7f0140154140 2023-08-17T17:46:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.421+0000 7f0136ffd700 1 -- 172.21.15.78:0/726305430 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f013801d060 con 0x7f0140154140 2023-08-17T17:46:57.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.422+0000 7f0136ffd700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f012005ed60 0x7f0120061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.422+0000 7f0136ffd700 1 -- 172.21.15.78:0/726305430 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f013807a2e0 con 0x7f0140154140 2023-08-17T17:46:57.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.422+0000 7f013e59c700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f012005ed60 0x7f0120061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.422+0000 7f013e59c700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f012005ed60 0x7f0120061220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f013000ab00 tx=0x7f0130006f90).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:57.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.426+0000 7f0136ffd700 1 -- 172.21.15.78:0/726305430 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f013804b880 con 0x7f0140154140 2023-08-17T17:46:57.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.585+0000 7f0144e4c700 1 -- 172.21.15.78:0/726305430 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01400c4770 con 0x7f012005ed60 2023-08-17T17:46:57.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.594+0000 7f0136ffd700 1 -- 172.21.15.78:0/726305430 <== mgr.5568 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359287 (secure 0 0 0) 0x7f01400c4770 con 0x7f012005ed60 2023-08-17T17:46:57.599 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:57.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 -- 172.21.15.78:0/726305430 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f012005ed60 msgr2=0x7f0120061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f012005ed60 0x7f0120061220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f013000ab00 tx=0x7f0130006f90).stop 2023-08-17T17:46:57.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 -- 172.21.15.78:0/726305430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0140154140 msgr2=0x7f0140150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0140154140 0x7f0140150770 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f013800ce80 tx=0x7f0138007840).stop 2023-08-17T17:46:57.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 -- 172.21.15.78:0/726305430 shutdown_connections 2023-08-17T17:46:57.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f012005ed60 0x7f0120061220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0140154140 0x7f0140150770 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01400a7c40 0x7f014014eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 --2- 172.21.15.78:0/726305430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01400a80b0 0x7f0140150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 -- 172.21.15.78:0/726305430 >> 172.21.15.78:0/726305430 conn(0x7f0140094510 msgr2=0x7f0140064980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:57.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 -- 172.21.15.78:0/726305430 shutdown_connections 2023-08-17T17:46:57.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.598+0000 7f0144e4c700 1 -- 172.21.15.78:0/726305430 wait complete. 2023-08-17T17:46:57.603 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:46:57.611 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:46:56.951438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2394384,"kb_used_data":5328,"kb_used_omap":0,"kb_used_meta":2388992,"kb_avail":752580336,"statfs":{"total":773094113280,"available":770642264064,"internally_reserved":0,"allocated":5455872,"data_stored":2621940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2446327808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14991300,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-715,"num_write_kb":-15540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.584838"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940561+0000","last_change":"2023-08-17T17:46:53.940679+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940561+0000","last_undegraded":"2023-08-17T17:46:53.940561+0000","last_fullsized":"2023-08-17T17:46:53.940561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590226+0000","last_change":"2023-08-17T17:46:53.588790+0000","last_active":"2023-08-17T17:46:53.590226+0000","last_peered":"2023-08-17T17:46:53.590226+0000","last_clean":"2023-08-17T17:46:53.590226+0000","last_became_active":"2023-08-17T17:46:53.588320+0000","last_became_peered":"2023-08-17T17:46:53.588320+0000","last_unstale":"2023-08-17T17:46:53.590226+0000","last_undegraded":"2023-08-17T17:46:53.590226+0000","last_fullsized":"2023-08-17T17:46:53.590226+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944374+0000","last_change":"2023-08-17T17:46:53.944501+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944374+0000","last_undegraded":"2023-08-17T17:46:53.944374+0000","last_fullsized":"2023-08-17T17:46:53.944374+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593232+0000","last_change":"2023-08-17T17:46:53.591003+0000","last_active":"2023-08-17T17:46:53.593232+0000","last_peered":"2023-08-17T17:46:53.593232+0000","last_clean":"2023-08-17T17:46:53.593232+0000","last_became_active":"2023-08-17T17:46:53.590718+0000","last_became_peered":"2023-08-17T17:46:53.590718+0000","last_unstale":"2023-08-17T17:46:53.593232+0000","last_undegraded":"2023-08-17T17:46:53.593232+0000","last_fullsized":"2023-08-17T17:46:53.593232+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942803+0000","last_change":"2023-08-17T17:46:53.942946+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942803+0000","last_undegraded":"2023-08-17T17:46:53.942803+0000","last_fullsized":"2023-08-17T17:46:53.942803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586289+0000","last_change":"2023-08-17T17:46:53.582491+0000","last_active":"2023-08-17T17:46:53.586289+0000","last_peered":"2023-08-17T17:46:53.586289+0000","last_clean":"2023-08-17T17:46:53.586289+0000","last_became_active":"2023-08-17T17:46:53.582209+0000","last_became_peered":"2023-08-17T17:46:53.582209+0000","last_unstale":"2023-08-17T17:46:53.586289+0000","last_undegraded":"2023-08-17T17:46:53.586289+0000","last_fullsized":"2023-08-17T17:46:53.586289+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943450+0000","last_change":"2023-08-17T17:46:53.943567+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943450+0000","last_undegraded":"2023-08-17T17:46:53.943450+0000","last_fullsized":"2023-08-17T17:46:53.943450+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590908+0000","last_change":"2023-08-17T17:46:53.582713+0000","last_active":"2023-08-17T17:46:53.590908+0000","last_peered":"2023-08-17T17:46:53.590908+0000","last_clean":"2023-08-17T17:46:53.590908+0000","last_became_active":"2023-08-17T17:46:53.582461+0000","last_became_peered":"2023-08-17T17:46:53.582461+0000","last_unstale":"2023-08-17T17:46:53.590908+0000","last_undegraded":"2023-08-17T17:46:53.590908+0000","last_fullsized":"2023-08-17T17:46:53.590908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940203+0000","last_change":"2023-08-17T17:46:53.940323+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940203+0000","last_undegraded":"2023-08-17T17:46:53.940203+0000","last_fullsized":"2023-08-17T17:46:53.940203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593671+0000","last_change":"2023-08-17T17:46:53.592771+0000","last_active":"2023-08-17T17:46:53.593671+0000","last_peered":"2023-08-17T17:46:53.593671+0000","last_clean":"2023-08-17T17:46:53.593671+0000","last_became_active":"2023-08-17T17:46:53.592489+0000","last_became_peered":"2023-08-17T17:46:53.592489+0000","last_unstale":"2023-08-17T17:46:53.593671+0000","last_undegraded":"2023-08-17T17:46:53.593671+0000","last_fullsized":"2023-08-17T17:46:53.593671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939101+0000","last_change":"2023-08-17T17:46:53.939239+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939101+0000","last_undegraded":"2023-08-17T17:46:53.939101+0000","last_fullsized":"2023-08-17T17:46:53.939101+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.588813+0000","last_change":"2023-08-17T17:46:53.587114+0000","last_active":"2023-08-17T17:46:53.588813+0000","last_peered":"2023-08-17T17:46:53.588813+0000","last_clean":"2023-08-17T17:46:53.588813+0000","last_became_active":"2023-08-17T17:46:53.586795+0000","last_became_peered":"2023-08-17T17:46:53.586795+0000","last_unstale":"2023-08-17T17:46:53.588813+0000","last_undegraded":"2023-08-17T17:46:53.588813+0000","last_fullsized":"2023-08-17T17:46:53.588813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940224+0000","last_change":"2023-08-17T17:46:53.940345+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940224+0000","last_undegraded":"2023-08-17T17:46:53.940224+0000","last_fullsized":"2023-08-17T17:46:53.940224+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595075+0000","last_change":"2023-08-17T17:46:53.594476+0000","last_active":"2023-08-17T17:46:53.595075+0000","last_peered":"2023-08-17T17:46:53.595075+0000","last_clean":"2023-08-17T17:46:53.595075+0000","last_became_active":"2023-08-17T17:46:53.594195+0000","last_became_peered":"2023-08-17T17:46:53.594195+0000","last_unstale":"2023-08-17T17:46:53.595075+0000","last_undegraded":"2023-08-17T17:46:53.595075+0000","last_fullsized":"2023-08-17T17:46:53.595075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940236+0000","last_change":"2023-08-17T17:46:53.940343+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940236+0000","last_undegraded":"2023-08-17T17:46:53.940236+0000","last_fullsized":"2023-08-17T17:46:53.940236+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592124+0000","last_change":"2023-08-17T17:46:53.584269+0000","last_active":"2023-08-17T17:46:53.592124+0000","last_peered":"2023-08-17T17:46:53.592124+0000","last_clean":"2023-08-17T17:46:53.592124+0000","last_became_active":"2023-08-17T17:46:53.583408+0000","last_became_peered":"2023-08-17T17:46:53.583408+0000","last_unstale":"2023-08-17T17:46:53.592124+0000","last_undegraded":"2023-08-17T17:46:53.592124+0000","last_fullsized":"2023-08-17T17:46:53.592124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940328+0000","last_change":"2023-08-17T17:46:53.940447+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940328+0000","last_undegraded":"2023-08-17T17:46:53.940328+0000","last_fullsized":"2023-08-17T17:46:53.940328+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591631+0000","last_change":"2023-08-17T17:46:53.585244+0000","last_active":"2023-08-17T17:46:53.591631+0000","last_peered":"2023-08-17T17:46:53.591631+0000","last_clean":"2023-08-17T17:46:53.591631+0000","last_became_active":"2023-08-17T17:46:53.584478+0000","last_became_peered":"2023-08-17T17:46:53.584478+0000","last_unstale":"2023-08-17T17:46:53.591631+0000","last_undegraded":"2023-08-17T17:46:53.591631+0000","last_fullsized":"2023-08-17T17:46:53.591631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944635+0000","last_change":"2023-08-17T17:46:53.944753+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944635+0000","last_undegraded":"2023-08-17T17:46:53.944635+0000","last_fullsized":"2023-08-17T17:46:53.944635+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592109+0000","last_change":"2023-08-17T17:46:53.585467+0000","last_active":"2023-08-17T17:46:53.592109+0000","last_peered":"2023-08-17T17:46:53.592109+0000","last_clean":"2023-08-17T17:46:53.592109+0000","last_became_active":"2023-08-17T17:46:53.585163+0000","last_became_peered":"2023-08-17T17:46:53.585163+0000","last_unstale":"2023-08-17T17:46:53.592109+0000","last_undegraded":"2023-08-17T17:46:53.592109+0000","last_fullsized":"2023-08-17T17:46:53.592109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940255+0000","last_change":"2023-08-17T17:46:53.940392+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940255+0000","last_undegraded":"2023-08-17T17:46:53.940255+0000","last_fullsized":"2023-08-17T17:46:53.940255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593121+0000","last_change":"2023-08-17T17:46:53.582814+0000","last_active":"2023-08-17T17:46:53.593121+0000","last_peered":"2023-08-17T17:46:53.593121+0000","last_clean":"2023-08-17T17:46:53.593121+0000","last_became_active":"2023-08-17T17:46:53.582554+0000","last_became_peered":"2023-08-17T17:46:53.582554+0000","last_unstale":"2023-08-17T17:46:53.593121+0000","last_undegraded":"2023-08-17T17:46:53.593121+0000","last_fullsized":"2023-08-17T17:46:53.593121+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938396+0000","last_change":"2023-08-17T17:46:53.938647+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938396+0000","last_undegraded":"2023-08-17T17:46:53.938396+0000","last_fullsized":"2023-08-17T17:46:53.938396+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587294+0000","last_change":"2023-08-17T17:46:53.582218+0000","last_active":"2023-08-17T17:46:53.587294+0000","last_peered":"2023-08-17T17:46:53.587294+0000","last_clean":"2023-08-17T17:46:53.587294+0000","last_became_active":"2023-08-17T17:46:53.581840+0000","last_became_peered":"2023-08-17T17:46:53.581840+0000","last_unstale":"2023-08-17T17:46:53.587294+0000","last_undegraded":"2023-08-17T17:46:53.587294+0000","last_fullsized":"2023-08-17T17:46:53.587294+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945327+0000","last_change":"2023-08-17T17:46:53.945464+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945327+0000","last_undegraded":"2023-08-17T17:46:53.945327+0000","last_fullsized":"2023-08-17T17:46:53.945327+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594346+0000","last_change":"2023-08-17T17:46:53.591437+0000","last_active":"2023-08-17T17:46:53.594346+0000","last_peered":"2023-08-17T17:46:53.594346+0000","last_clean":"2023-08-17T17:46:53.594346+0000","last_became_active":"2023-08-17T17:46:53.591145+0000","last_became_peered":"2023-08-17T17:46:53.591145+0000","last_unstale":"2023-08-17T17:46:53.594346+0000","last_undegraded":"2023-08-17T17:46:53.594346+0000","last_fullsized":"2023-08-17T17:46:53.594346+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942957+0000","last_change":"2023-08-17T17:46:53.943086+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942957+0000","last_undegraded":"2023-08-17T17:46:53.942957+0000","last_fullsized":"2023-08-17T17:46:53.942957+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591703+0000","last_change":"2023-08-17T17:46:53.586078+0000","last_active":"2023-08-17T17:46:53.591703+0000","last_peered":"2023-08-17T17:46:53.591703+0000","last_clean":"2023-08-17T17:46:53.591703+0000","last_became_active":"2023-08-17T17:46:53.585831+0000","last_became_peered":"2023-08-17T17:46:53.585831+0000","last_unstale":"2023-08-17T17:46:53.591703+0000","last_undegraded":"2023-08-17T17:46:53.591703+0000","last_fullsized":"2023-08-17T17:46:53.591703+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944495+0000","last_change":"2023-08-17T17:46:53.944657+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944495+0000","last_undegraded":"2023-08-17T17:46:53.944495+0000","last_fullsized":"2023-08-17T17:46:53.944495+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587539+0000","last_change":"2023-08-17T17:46:53.575072+0000","last_active":"2023-08-17T17:46:53.587539+0000","last_peered":"2023-08-17T17:46:53.587539+0000","last_clean":"2023-08-17T17:46:53.587539+0000","last_became_active":"2023-08-17T17:46:53.574793+0000","last_became_peered":"2023-08-17T17:46:53.574793+0000","last_unstale":"2023-08-17T17:46:53.587539+0000","last_undegraded":"2023-08-17T17:46:53.587539+0000","last_fullsized":"2023-08-17T17:46:53.587539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941728+0000","last_change":"2023-08-17T17:46:53.941848+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941728+0000","last_undegraded":"2023-08-17T17:46:53.941728+0000","last_fullsized":"2023-08-17T17:46:53.941728+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593840+0000","last_change":"2023-08-17T17:46:53.592156+0000","last_active":"2023-08-17T17:46:53.593840+0000","last_peered":"2023-08-17T17:46:53.593840+0000","last_clean":"2023-08-17T17:46:53.593840+0000","last_became_active":"2023-08-17T17:46:53.591901+0000","last_became_peered":"2023-08-17T17:46:53.591901+0000","last_unstale":"2023-08-17T17:46:53.593840+0000","last_undegraded":"2023-08-17T17:46:53.593840+0000","last_fullsized":"2023-08-17T17:46:53.593840+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.943747+0000","last_change":"2023-08-17T17:46:53.943829+0000","last_active":"2023-08-17T17:46:53.943747+0000","last_peered":"2023-08-17T17:46:53.943747+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.943505+0000","last_became_peered":"2023-08-17T17:46:53.943505+0000","last_unstale":"2023-08-17T17:46:53.943747+0000","last_undegraded":"2023-08-17T17:46:53.943747+0000","last_fullsized":"2023-08-17T17:46:53.943747+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586303+0000","last_change":"2023-08-17T17:46:53.580728+0000","last_active":"2023-08-17T17:46:53.586303+0000","last_peered":"2023-08-17T17:46:53.586303+0000","last_clean":"2023-08-17T17:46:53.586303+0000","last_became_active":"2023-08-17T17:46:53.580452+0000","last_became_peered":"2023-08-17T17:46:53.580452+0000","last_unstale":"2023-08-17T17:46:53.586303+0000","last_undegraded":"2023-08-17T17:46:53.586303+0000","last_fullsized":"2023-08-17T17:46:53.586303+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.947036+0000","last_change":"2023-08-17T17:46:53.947661+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.947036+0000","last_undegraded":"2023-08-17T17:46:53.947036+0000","last_fullsized":"2023-08-17T17:46:53.947036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593827+0000","last_change":"2023-08-17T17:46:53.592847+0000","last_active":"2023-08-17T17:46:53.593827+0000","last_peered":"2023-08-17T17:46:53.593827+0000","last_clean":"2023-08-17T17:46:53.593827+0000","last_became_active":"2023-08-17T17:46:53.592477+0000","last_became_peered":"2023-08-17T17:46:53.592477+0000","last_unstale":"2023-08-17T17:46:53.593827+0000","last_undegraded":"2023-08-17T17:46:53.593827+0000","last_fullsized":"2023-08-17T17:46:53.593827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943978+0000","last_change":"2023-08-17T17:46:53.944133+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943978+0000","last_undegraded":"2023-08-17T17:46:53.943978+0000","last_fullsized":"2023-08-17T17:46:53.943978+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592092+0000","last_change":"2023-08-17T17:46:53.590998+0000","last_active":"2023-08-17T17:46:53.592092+0000","last_peered":"2023-08-17T17:46:53.592092+0000","last_clean":"2023-08-17T17:46:53.592092+0000","last_became_active":"2023-08-17T17:46:53.590681+0000","last_became_peered":"2023-08-17T17:46:53.590681+0000","last_unstale":"2023-08-17T17:46:53.592092+0000","last_undegraded":"2023-08-17T17:46:53.592092+0000","last_fullsized":"2023-08-17T17:46:53.592092+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943168+0000","last_change":"2023-08-17T17:46:53.943291+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943168+0000","last_undegraded":"2023-08-17T17:46:53.943168+0000","last_fullsized":"2023-08-17T17:46:53.943168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.597850+0000","last_change":"2023-08-17T17:46:53.593024+0000","last_active":"2023-08-17T17:46:53.597850+0000","last_peered":"2023-08-17T17:46:53.597850+0000","last_clean":"2023-08-17T17:46:53.597850+0000","last_became_active":"2023-08-17T17:46:53.592759+0000","last_became_peered":"2023-08-17T17:46:53.592759+0000","last_unstale":"2023-08-17T17:46:53.597850+0000","last_undegraded":"2023-08-17T17:46:53.597850+0000","last_fullsized":"2023-08-17T17:46:53.597850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941047+0000","last_change":"2023-08-17T17:46:53.941852+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941047+0000","last_undegraded":"2023-08-17T17:46:53.941047+0000","last_fullsized":"2023-08-17T17:46:53.941047+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587734+0000","last_change":"2023-08-17T17:46:53.577716+0000","last_active":"2023-08-17T17:46:53.587734+0000","last_peered":"2023-08-17T17:46:53.587734+0000","last_clean":"2023-08-17T17:46:53.587734+0000","last_became_active":"2023-08-17T17:46:53.576999+0000","last_became_peered":"2023-08-17T17:46:53.576999+0000","last_unstale":"2023-08-17T17:46:53.587734+0000","last_undegraded":"2023-08-17T17:46:53.587734+0000","last_fullsized":"2023-08-17T17:46:53.587734+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943877+0000","last_change":"2023-08-17T17:46:53.943984+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943877+0000","last_undegraded":"2023-08-17T17:46:53.943877+0000","last_fullsized":"2023-08-17T17:46:53.943877+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590702+0000","last_change":"2023-08-17T17:46:53.583067+0000","last_active":"2023-08-17T17:46:53.590702+0000","last_peered":"2023-08-17T17:46:53.590702+0000","last_clean":"2023-08-17T17:46:53.590702+0000","last_became_active":"2023-08-17T17:46:53.582373+0000","last_became_peered":"2023-08-17T17:46:53.582373+0000","last_unstale":"2023-08-17T17:46:53.590702+0000","last_undegraded":"2023-08-17T17:46:53.590702+0000","last_fullsized":"2023-08-17T17:46:53.590702+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941545+0000","last_change":"2023-08-17T17:46:53.941639+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941545+0000","last_undegraded":"2023-08-17T17:46:53.941545+0000","last_fullsized":"2023-08-17T17:46:53.941545+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589458+0000","last_change":"2023-08-17T17:46:53.587208+0000","last_active":"2023-08-17T17:46:53.589458+0000","last_peered":"2023-08-17T17:46:53.589458+0000","last_clean":"2023-08-17T17:46:53.589458+0000","last_became_active":"2023-08-17T17:46:53.586922+0000","last_became_peered":"2023-08-17T17:46:53.586922+0000","last_unstale":"2023-08-17T17:46:53.589458+0000","last_undegraded":"2023-08-17T17:46:53.589458+0000","last_fullsized":"2023-08-17T17:46:53.589458+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952595+0000","last_change":"2023-08-17T17:46:53.952664+0000","last_active":"2023-08-17T17:46:53.952595+0000","last_peered":"2023-08-17T17:46:53.952595+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.952430+0000","last_became_peered":"2023-08-17T17:46:53.952430+0000","last_unstale":"2023-08-17T17:46:53.952595+0000","last_undegraded":"2023-08-17T17:46:53.952595+0000","last_fullsized":"2023-08-17T17:46:53.952595+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587376+0000","last_change":"2023-08-17T17:46:53.583496+0000","last_active":"2023-08-17T17:46:53.587376+0000","last_peered":"2023-08-17T17:46:53.587376+0000","last_clean":"2023-08-17T17:46:53.587376+0000","last_became_active":"2023-08-17T17:46:53.583200+0000","last_became_peered":"2023-08-17T17:46:53.583200+0000","last_unstale":"2023-08-17T17:46:53.587376+0000","last_undegraded":"2023-08-17T17:46:53.587376+0000","last_fullsized":"2023-08-17T17:46:53.587376+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944577+0000","last_change":"2023-08-17T17:46:53.944699+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944577+0000","last_undegraded":"2023-08-17T17:46:53.944577+0000","last_fullsized":"2023-08-17T17:46:53.944577+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593065+0000","last_change":"2023-08-17T17:46:53.591647+0000","last_active":"2023-08-17T17:46:53.593065+0000","last_peered":"2023-08-17T17:46:53.593065+0000","last_clean":"2023-08-17T17:46:53.593065+0000","last_became_active":"2023-08-17T17:46:53.591369+0000","last_became_peered":"2023-08-17T17:46:53.591369+0000","last_unstale":"2023-08-17T17:46:53.593065+0000","last_undegraded":"2023-08-17T17:46:53.593065+0000","last_fullsized":"2023-08-17T17:46:53.593065+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939609+0000","last_change":"2023-08-17T17:46:53.939758+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939609+0000","last_undegraded":"2023-08-17T17:46:53.939609+0000","last_fullsized":"2023-08-17T17:46:53.939609+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594295+0000","last_change":"2023-08-17T17:46:53.591137+0000","last_active":"2023-08-17T17:46:53.594295+0000","last_peered":"2023-08-17T17:46:53.594295+0000","last_clean":"2023-08-17T17:46:53.594295+0000","last_became_active":"2023-08-17T17:46:53.590561+0000","last_became_peered":"2023-08-17T17:46:53.590561+0000","last_unstale":"2023-08-17T17:46:53.594295+0000","last_undegraded":"2023-08-17T17:46:53.594295+0000","last_fullsized":"2023-08-17T17:46:53.594295+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939500+0000","last_change":"2023-08-17T17:46:53.939664+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939500+0000","last_undegraded":"2023-08-17T17:46:53.939500+0000","last_fullsized":"2023-08-17T17:46:53.939500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583400+0000","last_change":"2023-08-17T17:46:53.578788+0000","last_active":"2023-08-17T17:46:53.583400+0000","last_peered":"2023-08-17T17:46:53.583400+0000","last_clean":"2023-08-17T17:46:53.583400+0000","last_became_active":"2023-08-17T17:46:53.578283+0000","last_became_peered":"2023-08-17T17:46:53.578283+0000","last_unstale":"2023-08-17T17:46:53.583400+0000","last_undegraded":"2023-08-17T17:46:53.583400+0000","last_fullsized":"2023-08-17T17:46:53.583400+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952045+0000","last_change":"2023-08-17T17:46:53.952105+0000","last_active":"2023-08-17T17:46:53.952045+0000","last_peered":"2023-08-17T17:46:53.952045+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.951761+0000","last_became_peered":"2023-08-17T17:46:53.951761+0000","last_unstale":"2023-08-17T17:46:53.952045+0000","last_undegraded":"2023-08-17T17:46:53.952045+0000","last_fullsized":"2023-08-17T17:46:53.952045+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587277+0000","last_change":"2023-08-17T17:46:53.582134+0000","last_active":"2023-08-17T17:46:53.587277+0000","last_peered":"2023-08-17T17:46:53.587277+0000","last_clean":"2023-08-17T17:46:53.587277+0000","last_became_active":"2023-08-17T17:46:53.581821+0000","last_became_peered":"2023-08-17T17:46:53.581821+0000","last_unstale":"2023-08-17T17:46:53.587277+0000","last_undegraded":"2023-08-17T17:46:53.587277+0000","last_fullsized":"2023-08-17T17:46:53.587277+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942082+0000","last_change":"2023-08-17T17:46:53.942203+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942082+0000","last_undegraded":"2023-08-17T17:46:53.942082+0000","last_fullsized":"2023-08-17T17:46:53.942082+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586364+0000","last_change":"2023-08-17T17:46:53.581919+0000","last_active":"2023-08-17T17:46:53.586364+0000","last_peered":"2023-08-17T17:46:53.586364+0000","last_clean":"2023-08-17T17:46:53.586364+0000","last_became_active":"2023-08-17T17:46:53.581615+0000","last_became_peered":"2023-08-17T17:46:53.581615+0000","last_unstale":"2023-08-17T17:46:53.586364+0000","last_undegraded":"2023-08-17T17:46:53.586364+0000","last_fullsized":"2023-08-17T17:46:53.586364+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943285+0000","last_change":"2023-08-17T17:46:53.943426+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943285+0000","last_undegraded":"2023-08-17T17:46:53.943285+0000","last_fullsized":"2023-08-17T17:46:53.943285+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589673+0000","last_change":"2023-08-17T17:46:53.587221+0000","last_active":"2023-08-17T17:46:53.589673+0000","last_peered":"2023-08-17T17:46:53.589673+0000","last_clean":"2023-08-17T17:46:53.589673+0000","last_became_active":"2023-08-17T17:46:53.586901+0000","last_became_peered":"2023-08-17T17:46:53.586901+0000","last_unstale":"2023-08-17T17:46:53.589673+0000","last_undegraded":"2023-08-17T17:46:53.589673+0000","last_fullsized":"2023-08-17T17:46:53.589673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944893+0000","last_change":"2023-08-17T17:46:53.945173+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944893+0000","last_undegraded":"2023-08-17T17:46:53.944893+0000","last_fullsized":"2023-08-17T17:46:53.944893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587692+0000","last_change":"2023-08-17T17:46:53.579836+0000","last_active":"2023-08-17T17:46:53.587692+0000","last_peered":"2023-08-17T17:46:53.587692+0000","last_clean":"2023-08-17T17:46:53.587692+0000","last_became_active":"2023-08-17T17:46:53.579544+0000","last_became_peered":"2023-08-17T17:46:53.579544+0000","last_unstale":"2023-08-17T17:46:53.587692+0000","last_undegraded":"2023-08-17T17:46:53.587692+0000","last_fullsized":"2023-08-17T17:46:53.587692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945016+0000","last_change":"2023-08-17T17:46:53.945126+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945016+0000","last_undegraded":"2023-08-17T17:46:53.945016+0000","last_fullsized":"2023-08-17T17:46:53.945016+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.585758+0000","last_change":"2023-08-17T17:46:53.583210+0000","last_active":"2023-08-17T17:46:53.585758+0000","last_peered":"2023-08-17T17:46:53.585758+0000","last_clean":"2023-08-17T17:46:53.585758+0000","last_became_active":"2023-08-17T17:46:53.583036+0000","last_became_peered":"2023-08-17T17:46:53.583036+0000","last_unstale":"2023-08-17T17:46:53.585758+0000","last_undegraded":"2023-08-17T17:46:53.585758+0000","last_fullsized":"2023-08-17T17:46:53.585758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943461+0000","last_change":"2023-08-17T17:46:53.943591+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943461+0000","last_undegraded":"2023-08-17T17:46:53.943461+0000","last_fullsized":"2023-08-17T17:46:53.943461+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.575333+0000","last_change":"2023-08-17T17:46:53.574238+0000","last_active":"2023-08-17T17:46:53.575333+0000","last_peered":"2023-08-17T17:46:53.575333+0000","last_clean":"2023-08-17T17:46:53.575333+0000","last_became_active":"2023-08-17T17:46:53.573880+0000","last_became_peered":"2023-08-17T17:46:53.573880+0000","last_unstale":"2023-08-17T17:46:53.575333+0000","last_undegraded":"2023-08-17T17:46:53.575333+0000","last_fullsized":"2023-08-17T17:46:53.575333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937057+0000","last_change":"2023-08-17T17:46:53.937240+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937057+0000","last_undegraded":"2023-08-17T17:46:53.937057+0000","last_fullsized":"2023-08-17T17:46:53.937057+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593638+0000","last_change":"2023-08-17T17:46:53.588046+0000","last_active":"2023-08-17T17:46:53.593638+0000","last_peered":"2023-08-17T17:46:53.593638+0000","last_clean":"2023-08-17T17:46:53.593638+0000","last_became_active":"2023-08-17T17:46:53.587776+0000","last_became_peered":"2023-08-17T17:46:53.587776+0000","last_unstale":"2023-08-17T17:46:53.593638+0000","last_undegraded":"2023-08-17T17:46:53.593638+0000","last_fullsized":"2023-08-17T17:46:53.593638+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941251+0000","last_change":"2023-08-17T17:46:53.941251+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941251+0000","last_undegraded":"2023-08-17T17:46:53.941251+0000","last_fullsized":"2023-08-17T17:46:53.941251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583978+0000","last_change":"2023-08-17T17:46:53.580782+0000","last_active":"2023-08-17T17:46:53.583978+0000","last_peered":"2023-08-17T17:46:53.583978+0000","last_clean":"2023-08-17T17:46:53.583978+0000","last_became_active":"2023-08-17T17:46:53.580298+0000","last_became_peered":"2023-08-17T17:46:53.580298+0000","last_unstale":"2023-08-17T17:46:53.583978+0000","last_undegraded":"2023-08-17T17:46:53.583978+0000","last_fullsized":"2023-08-17T17:46:53.583978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940775+0000","last_change":"2023-08-17T17:46:53.940903+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940775+0000","last_undegraded":"2023-08-17T17:46:53.940775+0000","last_fullsized":"2023-08-17T17:46:53.940775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589471+0000","last_change":"2023-08-17T17:46:53.587937+0000","last_active":"2023-08-17T17:46:53.589471+0000","last_peered":"2023-08-17T17:46:53.589471+0000","last_clean":"2023-08-17T17:46:53.589471+0000","last_became_active":"2023-08-17T17:46:53.587645+0000","last_became_peered":"2023-08-17T17:46:53.587645+0000","last_unstale":"2023-08-17T17:46:53.589471+0000","last_undegraded":"2023-08-17T17:46:53.589471+0000","last_fullsized":"2023-08-17T17:46:53.589471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938302+0000","last_change":"2023-08-17T17:46:53.938456+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938302+0000","last_undegraded":"2023-08-17T17:46:53.938302+0000","last_fullsized":"2023-08-17T17:46:53.938302+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595334+0000","last_change":"2023-08-17T17:46:53.591820+0000","last_active":"2023-08-17T17:46:53.595334+0000","last_peered":"2023-08-17T17:46:53.595334+0000","last_clean":"2023-08-17T17:46:53.595334+0000","last_became_active":"2023-08-17T17:46:53.591544+0000","last_became_peered":"2023-08-17T17:46:53.591544+0000","last_unstale":"2023-08-17T17:46:53.595334+0000","last_undegraded":"2023-08-17T17:46:53.595334+0000","last_fullsized":"2023-08-17T17:46:53.595334+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945011+0000","last_change":"2023-08-17T17:46:53.945183+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945011+0000","last_undegraded":"2023-08-17T17:46:53.945011+0000","last_fullsized":"2023-08-17T17:46:53.945011+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.581056+0000","last_change":"2023-08-17T17:46:53.576364+0000","last_active":"2023-08-17T17:46:53.581056+0000","last_peered":"2023-08-17T17:46:53.581056+0000","last_clean":"2023-08-17T17:46:53.581056+0000","last_became_active":"2023-08-17T17:46:53.576052+0000","last_became_peered":"2023-08-17T17:46:53.576052+0000","last_unstale":"2023-08-17T17:46:53.581056+0000","last_undegraded":"2023-08-17T17:46:53.581056+0000","last_fullsized":"2023-08-17T17:46:53.581056+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941183+0000","last_change":"2023-08-17T17:46:53.941315+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941183+0000","last_undegraded":"2023-08-17T17:46:53.941183+0000","last_fullsized":"2023-08-17T17:46:53.941183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.588720+0000","last_change":"2023-08-17T17:46:53.583930+0000","last_active":"2023-08-17T17:46:53.588720+0000","last_peered":"2023-08-17T17:46:53.588720+0000","last_clean":"2023-08-17T17:46:53.588720+0000","last_became_active":"2023-08-17T17:46:53.583633+0000","last_became_peered":"2023-08-17T17:46:53.583633+0000","last_unstale":"2023-08-17T17:46:53.588720+0000","last_undegraded":"2023-08-17T17:46:53.588720+0000","last_fullsized":"2023-08-17T17:46:53.588720+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945636+0000","last_change":"2023-08-17T17:46:53.946154+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945636+0000","last_undegraded":"2023-08-17T17:46:53.945636+0000","last_fullsized":"2023-08-17T17:46:53.945636+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583312+0000","last_change":"2023-08-17T17:46:53.576838+0000","last_active":"2023-08-17T17:46:53.583312+0000","last_peered":"2023-08-17T17:46:53.583312+0000","last_clean":"2023-08-17T17:46:53.583312+0000","last_became_active":"2023-08-17T17:46:53.576666+0000","last_became_peered":"2023-08-17T17:46:53.576666+0000","last_unstale":"2023-08-17T17:46:53.583312+0000","last_undegraded":"2023-08-17T17:46:53.583312+0000","last_fullsized":"2023-08-17T17:46:53.583312+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937664+0000","last_change":"2023-08-17T17:46:53.937822+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937664+0000","last_undegraded":"2023-08-17T17:46:53.937664+0000","last_fullsized":"2023-08-17T17:46:53.937664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590205+0000","last_change":"2023-08-17T17:46:53.588579+0000","last_active":"2023-08-17T17:46:53.590205+0000","last_peered":"2023-08-17T17:46:53.590205+0000","last_clean":"2023-08-17T17:46:53.590205+0000","last_became_active":"2023-08-17T17:46:53.588025+0000","last_became_peered":"2023-08-17T17:46:53.588025+0000","last_unstale":"2023-08-17T17:46:53.590205+0000","last_undegraded":"2023-08-17T17:46:53.590205+0000","last_fullsized":"2023-08-17T17:46:53.590205+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.946622+0000","last_change":"2023-08-17T17:46:53.946710+0000","last_active":"2023-08-17T17:46:53.946622+0000","last_peered":"2023-08-17T17:46:53.946622+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.946424+0000","last_became_peered":"2023-08-17T17:46:53.946424+0000","last_unstale":"2023-08-17T17:46:53.946622+0000","last_undegraded":"2023-08-17T17:46:53.946622+0000","last_fullsized":"2023-08-17T17:46:53.946622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593808+0000","last_change":"2023-08-17T17:46:53.592735+0000","last_active":"2023-08-17T17:46:53.593808+0000","last_peered":"2023-08-17T17:46:53.593808+0000","last_clean":"2023-08-17T17:46:53.593808+0000","last_became_active":"2023-08-17T17:46:53.592421+0000","last_became_peered":"2023-08-17T17:46:53.592421+0000","last_unstale":"2023-08-17T17:46:53.593808+0000","last_undegraded":"2023-08-17T17:46:53.593808+0000","last_fullsized":"2023-08-17T17:46:53.593808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.948487+0000","last_change":"2023-08-17T17:46:53.948603+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.948487+0000","last_undegraded":"2023-08-17T17:46:53.948487+0000","last_fullsized":"2023-08-17T17:46:53.948487+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595091+0000","last_change":"2023-08-17T17:46:53.594526+0000","last_active":"2023-08-17T17:46:53.595091+0000","last_peered":"2023-08-17T17:46:53.595091+0000","last_clean":"2023-08-17T17:46:53.595091+0000","last_became_active":"2023-08-17T17:46:53.594206+0000","last_became_peered":"2023-08-17T17:46:53.594206+0000","last_unstale":"2023-08-17T17:46:53.595091+0000","last_undegraded":"2023-08-17T17:46:53.595091+0000","last_fullsized":"2023-08-17T17:46:53.595091+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938853+0000","last_change":"2023-08-17T17:46:53.938963+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938853+0000","last_undegraded":"2023-08-17T17:46:53.938853+0000","last_fullsized":"2023-08-17T17:46:53.938853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587827+0000","last_change":"2023-08-17T17:46:53.581153+0000","last_active":"2023-08-17T17:46:53.587827+0000","last_peered":"2023-08-17T17:46:53.587827+0000","last_clean":"2023-08-17T17:46:53.587827+0000","last_became_active":"2023-08-17T17:46:53.580902+0000","last_became_peered":"2023-08-17T17:46:53.580902+0000","last_unstale":"2023-08-17T17:46:53.587827+0000","last_undegraded":"2023-08-17T17:46:53.587827+0000","last_fullsized":"2023-08-17T17:46:53.587827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937121+0000","last_change":"2023-08-17T17:46:53.937261+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937121+0000","last_undegraded":"2023-08-17T17:46:53.937121+0000","last_fullsized":"2023-08-17T17:46:53.937121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595272+0000","last_change":"2023-08-17T17:46:53.591102+0000","last_active":"2023-08-17T17:46:53.595272+0000","last_peered":"2023-08-17T17:46:53.595272+0000","last_clean":"2023-08-17T17:46:53.595272+0000","last_became_active":"2023-08-17T17:46:53.590811+0000","last_became_peered":"2023-08-17T17:46:53.590811+0000","last_unstale":"2023-08-17T17:46:53.595272+0000","last_undegraded":"2023-08-17T17:46:53.595272+0000","last_fullsized":"2023-08-17T17:46:53.595272+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943621+0000","last_change":"2023-08-17T17:46:53.945412+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943621+0000","last_undegraded":"2023-08-17T17:46:53.943621+0000","last_fullsized":"2023-08-17T17:46:53.943621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592959+0000","last_change":"2023-08-17T17:46:53.591056+0000","last_active":"2023-08-17T17:46:53.592959+0000","last_peered":"2023-08-17T17:46:53.592959+0000","last_clean":"2023-08-17T17:46:53.592959+0000","last_became_active":"2023-08-17T17:46:53.590762+0000","last_became_peered":"2023-08-17T17:46:53.590762+0000","last_unstale":"2023-08-17T17:46:53.592959+0000","last_undegraded":"2023-08-17T17:46:53.592959+0000","last_fullsized":"2023-08-17T17:46:53.592959+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941519+0000","last_change":"2023-08-17T17:46:53.941637+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941519+0000","last_undegraded":"2023-08-17T17:46:53.941519+0000","last_fullsized":"2023-08-17T17:46:53.941519+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590423+0000","last_change":"2023-08-17T17:46:53.589394+0000","last_active":"2023-08-17T17:46:53.590423+0000","last_peered":"2023-08-17T17:46:53.590423+0000","last_clean":"2023-08-17T17:46:53.590423+0000","last_became_active":"2023-08-17T17:46:53.589087+0000","last_became_peered":"2023-08-17T17:46:53.589087+0000","last_unstale":"2023-08-17T17:46:53.590423+0000","last_undegraded":"2023-08-17T17:46:53.590423+0000","last_fullsized":"2023-08-17T17:46:53.590423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944884+0000","last_change":"2023-08-17T17:46:53.945023+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944884+0000","last_undegraded":"2023-08-17T17:46:53.944884+0000","last_fullsized":"2023-08-17T17:46:53.944884+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587961+0000","last_change":"2023-08-17T17:46:53.584361+0000","last_active":"2023-08-17T17:46:53.587961+0000","last_peered":"2023-08-17T17:46:53.587961+0000","last_clean":"2023-08-17T17:46:53.587961+0000","last_became_active":"2023-08-17T17:46:53.584085+0000","last_became_peered":"2023-08-17T17:46:53.584085+0000","last_unstale":"2023-08-17T17:46:53.587961+0000","last_undegraded":"2023-08-17T17:46:53.587961+0000","last_fullsized":"2023-08-17T17:46:53.587961+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939992+0000","last_change":"2023-08-17T17:46:53.940120+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939992+0000","last_undegraded":"2023-08-17T17:46:53.939992+0000","last_fullsized":"2023-08-17T17:46:53.939992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594348+0000","last_change":"2023-08-17T17:46:53.588048+0000","last_active":"2023-08-17T17:46:53.594348+0000","last_peered":"2023-08-17T17:46:53.594348+0000","last_clean":"2023-08-17T17:46:53.594348+0000","last_became_active":"2023-08-17T17:46:53.587765+0000","last_became_peered":"2023-08-17T17:46:53.587765+0000","last_unstale":"2023-08-17T17:46:53.594348+0000","last_undegraded":"2023-08-17T17:46:53.594348+0000","last_fullsized":"2023-08-17T17:46:53.594348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939716+0000","last_change":"2023-08-17T17:46:53.939858+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939716+0000","last_undegraded":"2023-08-17T17:46:53.939716+0000","last_fullsized":"2023-08-17T17:46:53.939716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591534+0000","last_change":"2023-08-17T17:46:53.580274+0000","last_active":"2023-08-17T17:46:53.591534+0000","last_peered":"2023-08-17T17:46:53.591534+0000","last_clean":"2023-08-17T17:46:53.591534+0000","last_became_active":"2023-08-17T17:46:53.580000+0000","last_became_peered":"2023-08-17T17:46:53.580000+0000","last_unstale":"2023-08-17T17:46:53.591534+0000","last_undegraded":"2023-08-17T17:46:53.591534+0000","last_fullsized":"2023-08-17T17:46:53.591534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937716+0000","last_change":"2023-08-17T17:46:53.937873+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937716+0000","last_undegraded":"2023-08-17T17:46:53.937716+0000","last_fullsized":"2023-08-17T17:46:53.937716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.582774+0000","last_change":"2023-08-17T17:46:53.581711+0000","last_active":"2023-08-17T17:46:53.582774+0000","last_peered":"2023-08-17T17:46:53.582774+0000","last_clean":"2023-08-17T17:46:53.582774+0000","last_became_active":"2023-08-17T17:46:53.581422+0000","last_became_peered":"2023-08-17T17:46:53.581422+0000","last_unstale":"2023-08-17T17:46:53.582774+0000","last_undegraded":"2023-08-17T17:46:53.582774+0000","last_fullsized":"2023-08-17T17:46:53.582774+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940892+0000","last_change":"2023-08-17T17:46:53.941005+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940892+0000","last_undegraded":"2023-08-17T17:46:53.940892+0000","last_fullsized":"2023-08-17T17:46:53.940892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590044+0000","last_change":"2023-08-17T17:46:53.588355+0000","last_active":"2023-08-17T17:46:53.590044+0000","last_peered":"2023-08-17T17:46:53.590044+0000","last_clean":"2023-08-17T17:46:53.590044+0000","last_became_active":"2023-08-17T17:46:53.587993+0000","last_became_peered":"2023-08-17T17:46:53.587993+0000","last_unstale":"2023-08-17T17:46:53.590044+0000","last_undegraded":"2023-08-17T17:46:53.590044+0000","last_fullsized":"2023-08-17T17:46:53.590044+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937494+0000","last_change":"2023-08-17T17:46:53.937635+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937494+0000","last_undegraded":"2023-08-17T17:46:53.937494+0000","last_fullsized":"2023-08-17T17:46:53.937494+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583805+0000","last_change":"2023-08-17T17:46:53.581332+0000","last_active":"2023-08-17T17:46:53.583805+0000","last_peered":"2023-08-17T17:46:53.583805+0000","last_clean":"2023-08-17T17:46:53.583805+0000","last_became_active":"2023-08-17T17:46:53.581009+0000","last_became_peered":"2023-08-17T17:46:53.581009+0000","last_unstale":"2023-08-17T17:46:53.583805+0000","last_undegraded":"2023-08-17T17:46:53.583805+0000","last_fullsized":"2023-08-17T17:46:53.583805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941448+0000","last_change":"2023-08-17T17:46:53.941575+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941448+0000","last_undegraded":"2023-08-17T17:46:53.941448+0000","last_fullsized":"2023-08-17T17:46:53.941448+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587786+0000","last_change":"2023-08-17T17:46:53.581061+0000","last_active":"2023-08-17T17:46:53.587786+0000","last_peered":"2023-08-17T17:46:53.587786+0000","last_clean":"2023-08-17T17:46:53.587786+0000","last_became_active":"2023-08-17T17:46:53.580750+0000","last_became_peered":"2023-08-17T17:46:53.580750+0000","last_unstale":"2023-08-17T17:46:53.587786+0000","last_undegraded":"2023-08-17T17:46:53.587786+0000","last_fullsized":"2023-08-17T17:46:53.587786+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944411+0000","last_change":"2023-08-17T17:46:53.944546+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944411+0000","last_undegraded":"2023-08-17T17:46:53.944411+0000","last_fullsized":"2023-08-17T17:46:53.944411+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591641+0000","last_change":"2023-08-17T17:46:53.584779+0000","last_active":"2023-08-17T17:46:53.591641+0000","last_peered":"2023-08-17T17:46:53.591641+0000","last_clean":"2023-08-17T17:46:53.591641+0000","last_became_active":"2023-08-17T17:46:53.584502+0000","last_became_peered":"2023-08-17T17:46:53.584502+0000","last_unstale":"2023-08-17T17:46:53.591641+0000","last_undegraded":"2023-08-17T17:46:53.591641+0000","last_fullsized":"2023-08-17T17:46:53.591641+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":5,"reported_epoch":59,"state":"active","last_fresh":"2023-08-17T17:46:53.947664+0000","last_change":"2023-08-17T17:46:53.947664+0000","last_active":"2023-08-17T17:46:53.947664+0000","last_peered":"2023-08-17T17:46:53.947664+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.947664+0000","last_became_peered":"2023-08-17T17:46:53.947664+0000","last_unstale":"2023-08-17T17:46:53.947664+0000","last_undegraded":"2023-08-17T17:46:53.947664+0000","last_fullsized":"2023-08-17T17:46:53.947664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.585170+0000","last_change":"2023-08-17T17:46:53.582200+0000","last_active":"2023-08-17T17:46:53.585170+0000","last_peered":"2023-08-17T17:46:53.585170+0000","last_clean":"2023-08-17T17:46:53.585170+0000","last_became_active":"2023-08-17T17:46:53.581952+0000","last_became_peered":"2023-08-17T17:46:53.581952+0000","last_unstale":"2023-08-17T17:46:53.585170+0000","last_undegraded":"2023-08-17T17:46:53.585170+0000","last_fullsized":"2023-08-17T17:46:53.585170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944068+0000","last_change":"2023-08-17T17:46:53.944185+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944068+0000","last_undegraded":"2023-08-17T17:46:53.944068+0000","last_fullsized":"2023-08-17T17:46:53.944068+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589729+0000","last_change":"2023-08-17T17:46:53.588244+0000","last_active":"2023-08-17T17:46:53.589729+0000","last_peered":"2023-08-17T17:46:53.589729+0000","last_clean":"2023-08-17T17:46:53.589729+0000","last_became_active":"2023-08-17T17:46:53.587974+0000","last_became_peered":"2023-08-17T17:46:53.587974+0000","last_unstale":"2023-08-17T17:46:53.589729+0000","last_undegraded":"2023-08-17T17:46:53.589729+0000","last_fullsized":"2023-08-17T17:46:53.589729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.567702+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:46:53.567702+0000","last_peered":"2023-08-17T17:46:53.567702+0000","last_clean":"2023-08-17T17:46:53.567702+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:46:53.567702+0000","last_undegraded":"2023-08-17T17:46:53.567702+0000","last_fullsized":"2023-08-17T17:46:53.567702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.936412+0000","last_change":"2023-08-17T17:46:53.936577+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.936412+0000","last_undegraded":"2023-08-17T17:46:53.936412+0000","last_fullsized":"2023-08-17T17:46:53.936412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593048+0000","last_change":"2023-08-17T17:46:53.591586+0000","last_active":"2023-08-17T17:46:53.593048+0000","last_peered":"2023-08-17T17:46:53.593048+0000","last_clean":"2023-08-17T17:46:53.593048+0000","last_became_active":"2023-08-17T17:46:53.591021+0000","last_became_peered":"2023-08-17T17:46:53.591021+0000","last_unstale":"2023-08-17T17:46:53.593048+0000","last_undegraded":"2023-08-17T17:46:53.593048+0000","last_fullsized":"2023-08-17T17:46:53.593048+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.570406+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:46:53.570406+0000","last_peered":"2023-08-17T17:46:53.570406+0000","last_clean":"2023-08-17T17:46:53.570406+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:46:53.570406+0000","last_undegraded":"2023-08-17T17:46:53.570406+0000","last_fullsized":"2023-08-17T17:46:53.570406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941113+0000","last_change":"2023-08-17T17:46:53.941363+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941113+0000","last_undegraded":"2023-08-17T17:46:53.941113+0000","last_fullsized":"2023-08-17T17:46:53.941113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591304+0000","last_change":"2023-08-17T17:46:53.584242+0000","last_active":"2023-08-17T17:46:53.591304+0000","last_peered":"2023-08-17T17:46:53.591304+0000","last_clean":"2023-08-17T17:46:53.591304+0000","last_became_active":"2023-08-17T17:46:53.583975+0000","last_became_peered":"2023-08-17T17:46:53.583975+0000","last_unstale":"2023-08-17T17:46:53.591304+0000","last_undegraded":"2023-08-17T17:46:53.591304+0000","last_fullsized":"2023-08-17T17:46:53.591304+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.574503+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:46:53.574503+0000","last_peered":"2023-08-17T17:46:53.574503+0000","last_clean":"2023-08-17T17:46:53.574503+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:46:53.574503+0000","last_undegraded":"2023-08-17T17:46:53.574503+0000","last_fullsized":"2023-08-17T17:46:53.574503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941461+0000","last_change":"2023-08-17T17:46:53.941622+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941461+0000","last_undegraded":"2023-08-17T17:46:53.941461+0000","last_fullsized":"2023-08-17T17:46:53.941461+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595361+0000","last_change":"2023-08-17T17:46:53.591978+0000","last_active":"2023-08-17T17:46:53.595361+0000","last_peered":"2023-08-17T17:46:53.595361+0000","last_clean":"2023-08-17T17:46:53.595361+0000","last_became_active":"2023-08-17T17:46:53.591812+0000","last_became_peered":"2023-08-17T17:46:53.591812+0000","last_unstale":"2023-08-17T17:46:53.595361+0000","last_undegraded":"2023-08-17T17:46:53.595361+0000","last_fullsized":"2023-08-17T17:46:53.595361+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.577814+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:46:53.577814+0000","last_peered":"2023-08-17T17:46:53.577814+0000","last_clean":"2023-08-17T17:46:53.577814+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:46:53.577814+0000","last_undegraded":"2023-08-17T17:46:53.577814+0000","last_fullsized":"2023-08-17T17:46:53.577814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.580993+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:46:53.580993+0000","last_peered":"2023-08-17T17:46:53.580993+0000","last_clean":"2023-08-17T17:46:53.580993+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:46:53.580993+0000","last_undegraded":"2023-08-17T17:46:53.580993+0000","last_fullsized":"2023-08-17T17:46:53.580993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938984+0000","last_change":"2023-08-17T17:46:53.939138+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938984+0000","last_undegraded":"2023-08-17T17:46:53.938984+0000","last_fullsized":"2023-08-17T17:46:53.938984+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589500+0000","last_change":"2023-08-17T17:46:53.586983+0000","last_active":"2023-08-17T17:46:53.589500+0000","last_peered":"2023-08-17T17:46:53.589500+0000","last_clean":"2023-08-17T17:46:53.589500+0000","last_became_active":"2023-08-17T17:46:53.586729+0000","last_became_peered":"2023-08-17T17:46:53.586729+0000","last_unstale":"2023-08-17T17:46:53.589500+0000","last_undegraded":"2023-08-17T17:46:53.589500+0000","last_fullsized":"2023-08-17T17:46:53.589500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.581035+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:46:53.581035+0000","last_peered":"2023-08-17T17:46:53.581035+0000","last_clean":"2023-08-17T17:46:53.581035+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:46:53.581035+0000","last_undegraded":"2023-08-17T17:46:53.581035+0000","last_fullsized":"2023-08-17T17:46:53.581035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939926+0000","last_change":"2023-08-17T17:46:53.940046+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939926+0000","last_undegraded":"2023-08-17T17:46:53.939926+0000","last_fullsized":"2023-08-17T17:46:53.939926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593263+0000","last_change":"2023-08-17T17:46:53.591593+0000","last_active":"2023-08-17T17:46:53.593263+0000","last_peered":"2023-08-17T17:46:53.593263+0000","last_clean":"2023-08-17T17:46:53.593263+0000","last_became_active":"2023-08-17T17:46:53.591368+0000","last_became_peered":"2023-08-17T17:46:53.591368+0000","last_unstale":"2023-08-17T17:46:53.593263+0000","last_undegraded":"2023-08-17T17:46:53.593263+0000","last_fullsized":"2023-08-17T17:46:53.593263+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.582295+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:46:53.582295+0000","last_peered":"2023-08-17T17:46:53.582295+0000","last_clean":"2023-08-17T17:46:53.582295+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:46:53.582295+0000","last_undegraded":"2023-08-17T17:46:53.582295+0000","last_fullsized":"2023-08-17T17:46:53.582295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952125+0000","last_change":"2023-08-17T17:46:53.952198+0000","last_active":"2023-08-17T17:46:53.952125+0000","last_peered":"2023-08-17T17:46:53.952125+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.951935+0000","last_became_peered":"2023-08-17T17:46:53.951935+0000","last_unstale":"2023-08-17T17:46:53.952125+0000","last_undegraded":"2023-08-17T17:46:53.952125+0000","last_fullsized":"2023-08-17T17:46:53.952125+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587803+0000","last_change":"2023-08-17T17:46:53.581838+0000","last_active":"2023-08-17T17:46:53.587803+0000","last_peered":"2023-08-17T17:46:53.587803+0000","last_clean":"2023-08-17T17:46:53.587803+0000","last_became_active":"2023-08-17T17:46:53.581523+0000","last_became_peered":"2023-08-17T17:46:53.581523+0000","last_unstale":"2023-08-17T17:46:53.587803+0000","last_undegraded":"2023-08-17T17:46:53.587803+0000","last_fullsized":"2023-08-17T17:46:53.587803+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.568013+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:46:53.568013+0000","last_peered":"2023-08-17T17:46:53.568013+0000","last_clean":"2023-08-17T17:46:53.568013+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:46:53.568013+0000","last_undegraded":"2023-08-17T17:46:53.568013+0000","last_fullsized":"2023-08-17T17:46:53.568013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.936458+0000","last_change":"2023-08-17T17:46:53.936611+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.936458+0000","last_undegraded":"2023-08-17T17:46:53.936458+0000","last_fullsized":"2023-08-17T17:46:53.936458+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587511+0000","last_change":"2023-08-17T17:46:53.574800+0000","last_active":"2023-08-17T17:46:53.587511+0000","last_peered":"2023-08-17T17:46:53.587511+0000","last_clean":"2023-08-17T17:46:53.587511+0000","last_became_active":"2023-08-17T17:46:53.574519+0000","last_became_peered":"2023-08-17T17:46:53.574519+0000","last_unstale":"2023-08-17T17:46:53.587511+0000","last_undegraded":"2023-08-17T17:46:53.587511+0000","last_fullsized":"2023-08-17T17:46:53.587511+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.569249+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:46:53.569249+0000","last_peered":"2023-08-17T17:46:53.569249+0000","last_clean":"2023-08-17T17:46:53.569249+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:46:53.569249+0000","last_undegraded":"2023-08-17T17:46:53.569249+0000","last_fullsized":"2023-08-17T17:46:53.569249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.72099999999999997,"5min":0.76400000000000001,"15min":0.80200000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.68899999999999995,"5min":0.82399999999999995,"15min":0.82899999999999996},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"min":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.28999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.81200000000000006},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.80000000000000004},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.56100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70499999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.503}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.751,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.435}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.46200000000000002},"min":{"1min":0.34000000000000002,"5min":0.32300000000000001,"15min":0.28599999999999998},"max":{"1min":0.63,"5min":0.80100000000000005,"15min":0.85499999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.26300000000000001},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.72999999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.437,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.70699999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.375},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72899999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67900000000000005,"5min":0.79900000000000004,"15min":1.0980000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52600000000000002,"15min":0.50700000000000001},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71299999999999997,"5min":0.79000000000000004,"15min":1.0609999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.377},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.30599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.751,"15min":0.751},"last":0.498},{"interface":"front","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.48499999999999999},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.026},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.42699999999999999,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.0740000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.34200000000000003},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52800000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.38200000000000001,"15min":0.36299999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54400000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.27300000000000002,"5min":0.25,"15min":0.22800000000000001},"max":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.72999999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.40300000000000002},"min":{"1min":0.29999999999999999,"5min":0.28399999999999997,"15min":0.219},"max":{"1min":0.61599999999999999,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.435,"15min":0.41899999999999998},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29799999999999999},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.66600000000000004},"last":0.318},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.80800000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.39000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":1.0129999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63400000000000001,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":1.331,"15min":1.331},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64200000000000002,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":0.89000000000000001,"5min":1.319,"15min":1.319},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63800000000000001,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":1.2929999999999999,"15min":1.345},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.39800000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.94499999999999995},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67000000000000004,"15min":0.64200000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.436,"15min":0.41199999999999998},"max":{"1min":0.88900000000000001,"5min":1.359,"15min":1.377},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36599999999999999,"15min":0.34799999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.28799999999999998,"5min":0.248,"15min":0.217},"max":{"1min":0.48399999999999999,"5min":0.58799999999999997,"15min":0.66200000000000003},"last":0.313}]},{"osd":2,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38300000000000001,"15min":0.36199999999999999},"min":{"1min":0.26900000000000002,"5min":0.23599999999999999,"15min":0.20300000000000001},"max":{"1min":0.51400000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.65200000000000002},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.58999999999999997,"15min":0.66200000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.40500000000000003},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.49299999999999999,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.998,"5min":0.998,"15min":1.337},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":0.90700000000000003,"15min":1.3300000000000001},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.96299999999999997,"15min":0.97199999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.462},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.391},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84199999999999997,"5min":0.93300000000000005,"15min":0.97299999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.997,"15min":1.544},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.246,"5min":0.219,"15min":0.20599999999999999},"max":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.81100000000000005},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.28599999999999998,"5min":0.247,"15min":0.221},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40100000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.70199999999999996},"last":0.378},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42399999999999999,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":0.54900000000000004,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41099999999999998},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40799999999999997,"15min":0.39400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.222},"max":{"1min":0.61699999999999999,"5min":0.629,"15min":0.629},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.65600000000000003,"15min":0.60899999999999999},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39000000000000001},"max":{"1min":0.82899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.67300000000000004,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.625,"15min":0.59999999999999998},"min":{"1min":0.47599999999999998,"5min":0.43099999999999999,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.495}]},{"osd":7,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.64100000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.63400000000000001},"min":{"1min":0.51600000000000001,"5min":0.46100000000000002,"15min":0.441},"max":{"1min":0.85399999999999998,"5min":0.874,"15min":1.0109999999999999},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32800000000000001,"15min":0.33300000000000002},"min":{"1min":0.248,"5min":0.221,"15min":0.191},"max":{"1min":0.40400000000000003,"5min":0.48699999999999999,"15min":0.69999999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.36699999999999999,"15min":0.37},"min":{"1min":0.251,"5min":0.224,"15min":0.224},"max":{"1min":0.496,"5min":0.60599999999999998,"15min":0.71799999999999997},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.215},"max":{"1min":0.48499999999999999,"5min":0.61099999999999999,"15min":0.73799999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.49099999999999999,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.26900000000000002,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.82299999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40699999999999997,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.59399999999999997,"5min":0.61699999999999999,"15min":0.71099999999999997},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":0.89000000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":2.1309999999999998},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38100000000000001},"max":{"1min":0.80200000000000005,"5min":0.86099999999999999,"15min":0.90100000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77100000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":0.91700000000000004,"15min":0.95299999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.83999999999999997,"5min":1.016,"15min":2.1669999999999998},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71899999999999997,"5min":0.83999999999999997,"15min":0.89100000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55500000000000005,"15min":0.53300000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.83199999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.78200000000000003,"15min":0.80900000000000005},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59199999999999997,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77200000000000002,"5min":0.82199999999999995,"15min":0.84799999999999998},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55300000000000005,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.80100000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.55700000000000005},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.47199999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.86399999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47599999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.53200000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.94899999999999995},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.375,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.82199999999999995,"15min":0.91900000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.877,"15min":1.056},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.32200000000000001,"15min":0.27700000000000002},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":1.2609999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.35599999999999998,"15min":0.31},"max":{"1min":0.71799999999999997,"5min":0.77900000000000003,"15min":1.1499999999999999},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.747,"15min":1.242},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":0.81100000000000005,"15min":1.1399999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.252},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.81100000000000005,"15min":1.274},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":1.179},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":0.78000000000000003,"15min":1.3080000000000001},"last":0.499}]},{"osd":4,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.75,"15min":1.0620000000000001},"last":0.44},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.51400000000000001},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.83899999999999997,"15min":1.0740000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.503,"15min":0.52500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":1.01},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.56100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.30099999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.1020000000000001},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.56999999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":1.038},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.755,"5min":0.79100000000000004,"15min":1.1279999999999999},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:46:57.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-08-17T17:46:57.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.940561+0000', 'last_change': '2023-08-17T17:46:53.940679+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.940561+0000', 'last_undegraded': '2023-08-17T17:46:53.940561+0000', 'last_fullsized': '2023-08-17T17:46:53.940561+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:46:57.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-08-17T17:46:57.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.944374+0000', 'last_change': '2023-08-17T17:46:53.944501+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.944374+0000', 'last_undegraded': '2023-08-17T17:46:53.944374+0000', 'last_fullsized': '2023-08-17T17:46:53.944374+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:46:57.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-08-17T17:46:57.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.942803+0000', 'last_change': '2023-08-17T17:46:53.942946+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.942803+0000', 'last_undegraded': '2023-08-17T17:46:53.942803+0000', 'last_fullsized': '2023-08-17T17:46:53.942803+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-08-17T17:46:57.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.943450+0000', 'last_change': '2023-08-17T17:46:53.943567+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.943450+0000', 'last_undegraded': '2023-08-17T17:46:53.943450+0000', 'last_fullsized': '2023-08-17T17:46:53.943450+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:46:57.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-08-17T17:46:57.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.940203+0000', 'last_change': '2023-08-17T17:46:53.940323+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.940203+0000', 'last_undegraded': '2023-08-17T17:46:53.940203+0000', 'last_fullsized': '2023-08-17T17:46:53.940203+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-08-17T17:46:57.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.939101+0000', 'last_change': '2023-08-17T17:46:53.939239+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.939101+0000', 'last_undegraded': '2023-08-17T17:46:53.939101+0000', 'last_fullsized': '2023-08-17T17:46:53.939101+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:46:57.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-08-17T17:46:57.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.940224+0000', 'last_change': '2023-08-17T17:46:53.940345+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.940224+0000', 'last_undegraded': '2023-08-17T17:46:53.940224+0000', 'last_fullsized': '2023-08-17T17:46:53.940224+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:46:57.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-08-17T17:46:57.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.940236+0000', 'last_change': '2023-08-17T17:46:53.940343+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.940236+0000', 'last_undegraded': '2023-08-17T17:46:53.940236+0000', 'last_fullsized': '2023-08-17T17:46:53.940236+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-08-17T17:46:57.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.940328+0000', 'last_change': '2023-08-17T17:46:53.940447+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.940328+0000', 'last_undegraded': '2023-08-17T17:46:53.940328+0000', 'last_fullsized': '2023-08-17T17:46:53.940328+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-08-17T17:46:57.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.944635+0000', 'last_change': '2023-08-17T17:46:53.944753+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.944635+0000', 'last_undegraded': '2023-08-17T17:46:53.944635+0000', 'last_fullsized': '2023-08-17T17:46:53.944635+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-08-17T17:46:57.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.940255+0000', 'last_change': '2023-08-17T17:46:53.940392+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.940255+0000', 'last_undegraded': '2023-08-17T17:46:53.940255+0000', 'last_fullsized': '2023-08-17T17:46:53.940255+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:46:57.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-08-17T17:46:57.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.938396+0000', 'last_change': '2023-08-17T17:46:53.938647+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.938396+0000', 'last_undegraded': '2023-08-17T17:46:53.938396+0000', 'last_fullsized': '2023-08-17T17:46:53.938396+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': ['4', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:46:57.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-08-17T17:46:57.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.945327+0000', 'last_change': '2023-08-17T17:46:53.945464+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.945327+0000', 'last_undegraded': '2023-08-17T17:46:53.945327+0000', 'last_fullsized': '2023-08-17T17:46:53.945327+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:46:57.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-08-17T17:46:57.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.942957+0000', 'last_change': '2023-08-17T17:46:53.943086+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.942957+0000', 'last_undegraded': '2023-08-17T17:46:53.942957+0000', 'last_fullsized': '2023-08-17T17:46:53.942957+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-08-17T17:46:57.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.944495+0000', 'last_change': '2023-08-17T17:46:53.944657+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.944495+0000', 'last_undegraded': '2023-08-17T17:46:53.944495+0000', 'last_fullsized': '2023-08-17T17:46:53.944495+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:46:57.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-08-17T17:46:57.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.941728+0000', 'last_change': '2023-08-17T17:46:53.941848+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.941728+0000', 'last_undegraded': '2023-08-17T17:46:53.941728+0000', 'last_fullsized': '2023-08-17T17:46:53.941728+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:46:57.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-08-17T17:46:57.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.947036+0000', 'last_change': '2023-08-17T17:46:53.947661+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.947036+0000', 'last_undegraded': '2023-08-17T17:46:53.947036+0000', 'last_fullsized': '2023-08-17T17:46:53.947036+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-08-17T17:46:57.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.943978+0000', 'last_change': '2023-08-17T17:46:53.944133+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.943978+0000', 'last_undegraded': '2023-08-17T17:46:53.943978+0000', 'last_fullsized': '2023-08-17T17:46:53.943978+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:46:57.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-08-17T17:46:57.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.943168+0000', 'last_change': '2023-08-17T17:46:53.943291+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.943168+0000', 'last_undegraded': '2023-08-17T17:46:53.943168+0000', 'last_fullsized': '2023-08-17T17:46:53.943168+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-08-17T17:46:57.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.941047+0000', 'last_change': '2023-08-17T17:46:53.941852+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.941047+0000', 'last_undegraded': '2023-08-17T17:46:53.941047+0000', 'last_fullsized': '2023-08-17T17:46:53.941047+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': ['6', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:46:57.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-08-17T17:46:57.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.943877+0000', 'last_change': '2023-08-17T17:46:53.943984+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.943877+0000', 'last_undegraded': '2023-08-17T17:46:53.943877+0000', 'last_fullsized': '2023-08-17T17:46:53.943877+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:46:57.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-08-17T17:46:57.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.941545+0000', 'last_change': '2023-08-17T17:46:53.941639+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.941545+0000', 'last_undegraded': '2023-08-17T17:46:53.941545+0000', 'last_fullsized': '2023-08-17T17:46:53.941545+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-08-17T17:46:57.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.944577+0000', 'last_change': '2023-08-17T17:46:53.944699+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.944577+0000', 'last_undegraded': '2023-08-17T17:46:53.944577+0000', 'last_fullsized': '2023-08-17T17:46:53.944577+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-08-17T17:46:57.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.939609+0000', 'last_change': '2023-08-17T17:46:53.939758+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.939609+0000', 'last_undegraded': '2023-08-17T17:46:53.939609+0000', 'last_fullsized': '2023-08-17T17:46:53.939609+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:46:57.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-08-17T17:46:57.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.939500+0000', 'last_change': '2023-08-17T17:46:53.939664+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.939500+0000', 'last_undegraded': '2023-08-17T17:46:53.939500+0000', 'last_fullsized': '2023-08-17T17:46:53.939500+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-08-17T17:46:57.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.942082+0000', 'last_change': '2023-08-17T17:46:53.942203+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.942082+0000', 'last_undegraded': '2023-08-17T17:46:53.942082+0000', 'last_fullsized': '2023-08-17T17:46:53.942082+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': ['6', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:46:57.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-08-17T17:46:57.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.943285+0000', 'last_change': '2023-08-17T17:46:53.943426+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.943285+0000', 'last_undegraded': '2023-08-17T17:46:53.943285+0000', 'last_fullsized': '2023-08-17T17:46:53.943285+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-08-17T17:46:57.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.944893+0000', 'last_change': '2023-08-17T17:46:53.945173+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.944893+0000', 'last_undegraded': '2023-08-17T17:46:53.944893+0000', 'last_fullsized': '2023-08-17T17:46:53.944893+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:46:57.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-08-17T17:46:57.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.945016+0000', 'last_change': '2023-08-17T17:46:53.945126+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.945016+0000', 'last_undegraded': '2023-08-17T17:46:53.945016+0000', 'last_fullsized': '2023-08-17T17:46:53.945016+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-08-17T17:46:57.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.943461+0000', 'last_change': '2023-08-17T17:46:53.943591+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.943461+0000', 'last_undegraded': '2023-08-17T17:46:53.943461+0000', 'last_fullsized': '2023-08-17T17:46:53.943461+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:46:57.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-08-17T17:46:57.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.937057+0000', 'last_change': '2023-08-17T17:46:53.937240+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.937057+0000', 'last_undegraded': '2023-08-17T17:46:53.937057+0000', 'last_fullsized': '2023-08-17T17:46:53.937057+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:46:57.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-08-17T17:46:57.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.941251+0000', 'last_change': '2023-08-17T17:46:53.941251+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.941251+0000', 'last_undegraded': '2023-08-17T17:46:53.941251+0000', 'last_fullsized': '2023-08-17T17:46:53.941251+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': ['6', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:46:57.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-08-17T17:46:57.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.940775+0000', 'last_change': '2023-08-17T17:46:53.940903+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.940775+0000', 'last_undegraded': '2023-08-17T17:46:53.940775+0000', 'last_fullsized': '2023-08-17T17:46:53.940775+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-08-17T17:46:57.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.938302+0000', 'last_change': '2023-08-17T17:46:53.938456+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.938302+0000', 'last_undegraded': '2023-08-17T17:46:53.938302+0000', 'last_fullsized': '2023-08-17T17:46:53.938302+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:46:57.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-08-17T17:46:57.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.945011+0000', 'last_change': '2023-08-17T17:46:53.945183+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.945011+0000', 'last_undegraded': '2023-08-17T17:46:53.945011+0000', 'last_fullsized': '2023-08-17T17:46:53.945011+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:46:57.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-08-17T17:46:57.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.941183+0000', 'last_change': '2023-08-17T17:46:53.941315+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.941183+0000', 'last_undegraded': '2023-08-17T17:46:53.941183+0000', 'last_fullsized': '2023-08-17T17:46:53.941183+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-08-17T17:46:57.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.945636+0000', 'last_change': '2023-08-17T17:46:53.946154+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.945636+0000', 'last_undegraded': '2023-08-17T17:46:53.945636+0000', 'last_fullsized': '2023-08-17T17:46:53.945636+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': ['7', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:46:57.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-08-17T17:46:57.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.937664+0000', 'last_change': '2023-08-17T17:46:53.937822+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.937664+0000', 'last_undegraded': '2023-08-17T17:46:53.937664+0000', 'last_fullsized': '2023-08-17T17:46:53.937664+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:46:57.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-08-17T17:46:57.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.948487+0000', 'last_change': '2023-08-17T17:46:53.948603+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.948487+0000', 'last_undegraded': '2023-08-17T17:46:53.948487+0000', 'last_fullsized': '2023-08-17T17:46:53.948487+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-08-17T17:46:57.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.938853+0000', 'last_change': '2023-08-17T17:46:53.938963+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.938853+0000', 'last_undegraded': '2023-08-17T17:46:53.938853+0000', 'last_fullsized': '2023-08-17T17:46:53.938853+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': ['4', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:46:57.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-08-17T17:46:57.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.937121+0000', 'last_change': '2023-08-17T17:46:53.937261+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.937121+0000', 'last_undegraded': '2023-08-17T17:46:53.937121+0000', 'last_fullsized': '2023-08-17T17:46:53.937121+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:46:57.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-08-17T17:46:57.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.943621+0000', 'last_change': '2023-08-17T17:46:53.945412+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.943621+0000', 'last_undegraded': '2023-08-17T17:46:53.943621+0000', 'last_fullsized': '2023-08-17T17:46:53.943621+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-08-17T17:46:57.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.941519+0000', 'last_change': '2023-08-17T17:46:53.941637+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.941519+0000', 'last_undegraded': '2023-08-17T17:46:53.941519+0000', 'last_fullsized': '2023-08-17T17:46:53.941519+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-08-17T17:46:57.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.944884+0000', 'last_change': '2023-08-17T17:46:53.945023+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.944884+0000', 'last_undegraded': '2023-08-17T17:46:53.944884+0000', 'last_fullsized': '2023-08-17T17:46:53.944884+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-08-17T17:46:57.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.939992+0000', 'last_change': '2023-08-17T17:46:53.940120+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.939992+0000', 'last_undegraded': '2023-08-17T17:46:53.939992+0000', 'last_fullsized': '2023-08-17T17:46:53.939992+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': ['3', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-08-17T17:46:57.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.939716+0000', 'last_change': '2023-08-17T17:46:53.939858+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.939716+0000', 'last_undegraded': '2023-08-17T17:46:53.939716+0000', 'last_fullsized': '2023-08-17T17:46:53.939716+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:46:57.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-08-17T17:46:57.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.937716+0000', 'last_change': '2023-08-17T17:46:53.937873+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.937716+0000', 'last_undegraded': '2023-08-17T17:46:53.937716+0000', 'last_fullsized': '2023-08-17T17:46:53.937716+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:46:57.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-08-17T17:46:57.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.940892+0000', 'last_change': '2023-08-17T17:46:53.941005+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.940892+0000', 'last_undegraded': '2023-08-17T17:46:53.940892+0000', 'last_fullsized': '2023-08-17T17:46:53.940892+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:46:57.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-08-17T17:46:57.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.937494+0000', 'last_change': '2023-08-17T17:46:53.937635+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.937494+0000', 'last_undegraded': '2023-08-17T17:46:53.937494+0000', 'last_fullsized': '2023-08-17T17:46:53.937494+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': ['5', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:46:57.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-08-17T17:46:57.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.941448+0000', 'last_change': '2023-08-17T17:46:53.941575+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.941448+0000', 'last_undegraded': '2023-08-17T17:46:53.941448+0000', 'last_fullsized': '2023-08-17T17:46:53.941448+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': ['6', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:46:57.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-08-17T17:46:57.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.944411+0000', 'last_change': '2023-08-17T17:46:53.944546+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.944411+0000', 'last_undegraded': '2023-08-17T17:46:53.944411+0000', 'last_fullsized': '2023-08-17T17:46:53.944411+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-08-17T17:46:57.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 5, 'reported_epoch': 59, 'state': 'active', 'last_fresh': '2023-08-17T17:46:53.947664+0000', 'last_change': '2023-08-17T17:46:53.947664+0000', 'last_active': '2023-08-17T17:46:53.947664+0000', 'last_peered': '2023-08-17T17:46:53.947664+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '2023-08-17T17:46:53.947664+0000', 'last_became_peered': '2023-08-17T17:46:53.947664+0000', 'last_unstale': '2023-08-17T17:46:53.947664+0000', 'last_undegraded': '2023-08-17T17:46:53.947664+0000', 'last_fullsized': '2023-08-17T17:46:53.947664+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:46:57.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-08-17T17:46:57.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.944068+0000', 'last_change': '2023-08-17T17:46:53.944185+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.944068+0000', 'last_undegraded': '2023-08-17T17:46:53.944068+0000', 'last_fullsized': '2023-08-17T17:46:53.944068+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:46:57.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-08-17T17:46:57.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.936412+0000', 'last_change': '2023-08-17T17:46:53.936577+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.936412+0000', 'last_undegraded': '2023-08-17T17:46:53.936412+0000', 'last_fullsized': '2023-08-17T17:46:53.936412+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:46:57.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-08-17T17:46:57.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.941113+0000', 'last_change': '2023-08-17T17:46:53.941363+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.941113+0000', 'last_undegraded': '2023-08-17T17:46:53.941113+0000', 'last_fullsized': '2023-08-17T17:46:53.941113+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-08-17T17:46:57.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.941461+0000', 'last_change': '2023-08-17T17:46:53.941622+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.941461+0000', 'last_undegraded': '2023-08-17T17:46:53.941461+0000', 'last_fullsized': '2023-08-17T17:46:53.941461+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': ['6', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:46:57.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-08-17T17:46:57.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.938984+0000', 'last_change': '2023-08-17T17:46:53.939138+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.938984+0000', 'last_undegraded': '2023-08-17T17:46:53.938984+0000', 'last_fullsized': '2023-08-17T17:46:53.938984+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:46:57.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-08-17T17:46:57.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.939926+0000', 'last_change': '2023-08-17T17:46:53.940046+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.939926+0000', 'last_undegraded': '2023-08-17T17:46:53.939926+0000', 'last_fullsized': '2023-08-17T17:46:53.939926+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:46:57.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-08-17T17:46:57.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:46:53.936458+0000', 'last_change': '2023-08-17T17:46:53.936611+0000', 'last_active': '2023-08-17T17:46:53.558461+0000', 'last_peered': '2023-08-17T17:46:53.558461+0000', 'last_clean': '2023-08-17T17:46:53.558461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:46:53.936458+0000', 'last_undegraded': '2023-08-17T17:46:53.936458+0000', 'last_fullsized': '2023-08-17T17:46:53.936458+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'last_clean_scrub_stamp': '2023-08-17T17:46:53.558461+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:46:57.658 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T17:46:57.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.768+0000 7fb8020c2700 1 Processor -- start 2023-08-17T17:46:57.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.768+0000 7fb8020c2700 1 -- start start 2023-08-17T17:46:57.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.769+0000 7fb8020c2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7fc0c1010 0x7fb7fc0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.769+0000 7fb8020c2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc0c7350 con 0x7fb7fc0c6ee0 2023-08-17T17:46:57.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.769+0000 7fb8020c2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc0a8350 con 0x7fb7fc154140 2023-08-17T17:46:57.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.769+0000 7fb8020c2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc154520 con 0x7fb7fc0c1010 2023-08-17T17:46:57.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.769+0000 7fb7faffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb7fc0c6ee0 0x7fb7fc0c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50038/0 (socket says 172.21.15.78:50038) 2023-08-17T17:46:57.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.769+0000 7fb7faffd700 1 -- 172.21.15.78:0/3408620143 learned_addr learned my addr 172.21.15.78:0/3408620143 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:57.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.769+0000 7fb7fbfff700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7fc0c1010 0x7fb7fc0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.769+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893363120 0 0) 0x7fb7fc0c7350 con 0x7fb7fc0c6ee0 2023-08-17T17:46:57.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.769+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e40033f0 con 0x7fb7fc0c6ee0 2023-08-17T17:46:57.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2700632654 0 0) 0x7fb7e40033f0 con 0x7fb7fc0c6ee0 2023-08-17T17:46:57.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7fc0c1010 msgr2=0x7fb7fc0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:57.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7fc0c1010 0x7fb7fc0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 >> v1:172.21.15.150:6789/0 conn(0x7fb7fc154140 legacy=0x7fb7fc0a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0c91e0 con 0x7fb7fc0c6ee0 2023-08-17T17:46:57.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fb7f0001470 con 0x7fb7fc0c6ee0 2023-08-17T17:46:57.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 >> v1:172.21.15.78:6789/0 conn(0x7fb7fc0c6ee0 legacy=0x7fb7fc0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7e4003910 0x7fb7e4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7e4004690 0x7fb7e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7fc0c1010 0x7fb7e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc154520 con 0x7fb7e4003910 2023-08-17T17:46:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e400b910 con 0x7fb7e4004690 2023-08-17T17:46:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e400bad0 con 0x7fb7fc0c1010 2023-08-17T17:46:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fb7fe700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7e4003910 0x7fb7e4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7faffd700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7e4004690 0x7fb7e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fbfff700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7fc0c1010 0x7fb7e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fb7fe700 1 -- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7fc0c1010 msgr2=0x7fb7e4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fb7fe700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7fc0c1010 0x7fb7e4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fb7fe700 1 -- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7e4004690 msgr2=0x7fb7e4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fb7fe700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7e4004690 0x7fb7e4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fb7fe700 1 -- 172.21.15.78:0/3408620143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e40033f0 con 0x7fb7e4003910 2023-08-17T17:46:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fbfff700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7fc0c1010 0x7fb7e4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fb7fe700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7e4003910 0x7fb7e4003d30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fb7ec001730 tx=0x7fb7ec007bb0).ready entity=mon.0 client_cookie=b820f28715a3fa15 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec007020 con 0x7fb7e4003910 2023-08-17T17:46:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec007180 con 0x7fb7e4003910 2023-08-17T17:46:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.770+0000 7fb7fa7fc700 1 -- 172.21.15.78:0/3408620143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec007500 con 0x7fb7e4003910 2023-08-17T17:46:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.771+0000 7fb8020c2700 1 -- 172.21.15.78:0/3408620143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7e4003910 msgr2=0x7fb7e4003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.771+0000 7fb8020c2700 1 --2- 172.21.15.78:0/3408620143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7e4003910 0x7fb7e4003d30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fb7ec001730 tx=0x7fb7ec007bb0).stop 2023-08-17T17:46:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.771+0000 7fb7fbfff700 1 -- 172.21.15.78:0/3408620143 reap_dead start 2023-08-17T17:46:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.771+0000 7fb8020c2700 1 -- 172.21.15.78:0/3408620143 shutdown_connections 2023-08-17T17:46:57.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.771+0000 7fb8020c2700 1 -- 172.21.15.78:0/3408620143 >> 172.21.15.78:0/3408620143 conn(0x7fb7fc094510 msgr2=0x7fb7fc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:57.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.771+0000 7fb8020c2700 1 -- 172.21.15.78:0/3408620143 shutdown_connections 2023-08-17T17:46:57.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.771+0000 7fb8020c2700 1 -- 172.21.15.78:0/3408620143 wait complete. 2023-08-17T17:46:57.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.772+0000 7fb8020c2700 1 Processor -- start 2023-08-17T17:46:57.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.772+0000 7fb8020c2700 1 -- start start 2023-08-17T17:46:57.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb8020c2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4003910 0x7fb7fc0a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb8020c2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7fc167f00 0x7fb7fc0aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb8020c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7fc0ca3d0 0x7fb7fc0ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb8020c2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc159900 con 0x7fb7fc0ca3d0 2023-08-17T17:46:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb8020c2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0a9e50 con 0x7fb7fc167f00 2023-08-17T17:46:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb8020c2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0aa720 con 0x7fb7e4003910 2023-08-17T17:46:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7fc0ca3d0 0x7fb7fc0ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7fc0ca3d0 0x7fb7fc0ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37136/0 (socket says 172.21.15.78:37136) 2023-08-17T17:46:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fbfff700 1 -- 172.21.15.78:0/2271856023 learned_addr learned my addr 172.21.15.78:0/2271856023 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:57.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7faffd700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7fc167f00 0x7fb7fc0aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fb7fe700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4003910 0x7fb7fc0a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fbfff700 1 -- 172.21.15.78:0/2271856023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4003910 msgr2=0x7fb7fc0a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fbfff700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4003910 0x7fb7fc0a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fbfff700 1 -- 172.21.15.78:0/2271856023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7fc167f00 msgr2=0x7fb7fc0aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:57.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fbfff700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7fc167f00 0x7fb7fc0aa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:57.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fbfff700 1 -- 172.21.15.78:0/2271856023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc158fd0 con 0x7fb7fc0ca3d0 2023-08-17T17:46:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7faffd700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7fc167f00 0x7fb7fc0aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fb7fe700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4003910 0x7fb7fc0a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:46:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.773+0000 7fb7fbfff700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7fc0ca3d0 0x7fb7fc0ca850 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fb7fc0c00f0 tx=0x7fb7f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.774+0000 7fb7e37fe700 1 -- 172.21.15.78:0/2271856023 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4009bf0 con 0x7fb7fc0ca3d0 2023-08-17T17:46:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.774+0000 7fb7e37fe700 1 -- 172.21.15.78:0/2271856023 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f400fc80 con 0x7fb7fc0ca3d0 2023-08-17T17:46:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.774+0000 7fb7e37fe700 1 -- 172.21.15.78:0/2271856023 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4014410 con 0x7fb7fc0ca3d0 2023-08-17T17:46:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.774+0000 7fb8020c2700 1 -- 172.21.15.78:0/2271856023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc1592b0 con 0x7fb7fc0ca3d0 2023-08-17T17:46:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.774+0000 7fb8020c2700 1 -- 172.21.15.78:0/2271856023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc14d0f0 con 0x7fb7fc0ca3d0 2023-08-17T17:46:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.774+0000 7fb8020c2700 1 -- 172.21.15.78:0/2271856023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc0a9fc0 con 0x7fb7fc0ca3d0 2023-08-17T17:46:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.775+0000 7fb7e37fe700 1 -- 172.21.15.78:0/2271856023 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb7f4014800 con 0x7fb7fc0ca3d0 2023-08-17T17:46:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.775+0000 7fb7e37fe700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb7e805ed90 0x7fb7e8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.775+0000 7fb7fb7fe700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb7e805ed90 0x7fb7e8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.775+0000 7fb7e37fe700 1 -- 172.21.15.78:0/2271856023 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb7f407a470 con 0x7fb7fc0ca3d0 2023-08-17T17:46:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.776+0000 7fb7fb7fe700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb7e805ed90 0x7fb7e8061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb7ec001010 tx=0x7fb7ec015000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:57.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:57.779+0000 7fb7e37fe700 1 -- 172.21.15.78:0/2271856023 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb7f404ba10 con 0x7fb7fc0ca3d0 2023-08-17T17:46:58.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.007+0000 7fb8020c2700 1 -- 172.21.15.78:0/2271856023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb7fc0c0120 con 0x7fb7fc0ca3d0 2023-08-17T17:46:58.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.007+0000 7fb7e37fe700 1 -- 172.21.15.78:0/2271856023 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1070 (secure 0 0 0) 0x7fb7f404f030 con 0x7fb7fc0ca3d0 2023-08-17T17:46:58.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:58.009 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":771,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":60,"num_osds":8,"num_up_osds":8,"osd_up_since":1692293655,"num_in_osds":8,"osd_in_since":1692293648,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":78},{"state_name":"creating+activating","count":58},{"state_name":"active","count":1}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2451849216,"bytes_avail":770642264064,"bytes_total":773094113280,"inactive_pgs_ratio":0.42335766553878784},"fsmap":{"epoch":19,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5757}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-08-17T17:36:24.616427+0000","services":{}},"progress_events":{}} 2023-08-17T17:46:58.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 -- 172.21.15.78:0/2271856023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb7e805ed90 msgr2=0x7fb7e8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:58.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb7e805ed90 0x7fb7e8061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb7ec001010 tx=0x7fb7ec015000).stop 2023-08-17T17:46:58.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 -- 172.21.15.78:0/2271856023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7fc0ca3d0 msgr2=0x7fb7fc0ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:58.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7fc0ca3d0 0x7fb7fc0ca850 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fb7fc0c00f0 tx=0x7fb7f400b040).stop 2023-08-17T17:46:58.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 -- 172.21.15.78:0/2271856023 shutdown_connections 2023-08-17T17:46:58.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb7e805ed90 0x7fb7e8061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7fc0ca3d0 0x7fb7fc0ca850 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4003910 0x7fb7fc0a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 --2- 172.21.15.78:0/2271856023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7fc167f00 0x7fb7fc0aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 -- 172.21.15.78:0/2271856023 >> 172.21.15.78:0/2271856023 conn(0x7fb7fc094510 msgr2=0x7fb7fc0c04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:58.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 -- 172.21.15.78:0/2271856023 shutdown_connections 2023-08-17T17:46:58.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.009+0000 7fb8020c2700 1 -- 172.21.15.78:0/2271856023 wait complete. 2023-08-17T17:46:58.022 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-17T17:46:58.023 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:46:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.134+0000 7f1c75b1b700 1 Processor -- start 2023-08-17T17:46:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.134+0000 7f1c75b1b700 1 -- start start 2023-08-17T17:46:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.135+0000 7f1c75b1b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c70154140 0x7f1c700c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.135+0000 7f1c75b1b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c700a7c40 0x7f1c700c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.135+0000 7f1c75b1b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c70154520 con 0x7f1c700a8080 2023-08-17T17:46:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.135+0000 7f1c75b1b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c700c91e0 con 0x7f1c70154140 2023-08-17T17:46:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.135+0000 7f1c75b1b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700c94c0 con 0x7f1c700a7c40 2023-08-17T17:46:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.135+0000 7f1c6f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c70154140 0x7f1c700c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.135+0000 7f1c6ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1c700a8080 0x7f1c700ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50054/0 (socket says 172.21.15.78:50054) 2023-08-17T17:46:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.135+0000 7f1c6ffff700 1 -- 172.21.15.78:0/864065051 learned_addr learned my addr 172.21.15.78:0/864065051 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:46:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.135+0000 7f1c6effd700 1 --2- 172.21.15.78:0/864065051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c700a7c40 0x7f1c700c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c6f7fe700 1 -- 172.21.15.78:0/864065051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c700a7c40 msgr2=0x7f1c700c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:46:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c6f7fe700 1 --2- 172.21.15.78:0/864065051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c700a7c40 0x7f1c700c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c6f7fe700 1 -- 172.21.15.78:0/864065051 >> v1:172.21.15.78:6789/0 conn(0x7f1c700a8080 legacy=0x7f1c700ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c6e7fc700 1 -- 172.21.15.78:0/864065051 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997357866 0 0) 0x7f1c70154520 con 0x7f1c700a8080 2023-08-17T17:46:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c6f7fe700 1 -- 172.21.15.78:0/864065051 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c700c97a0 con 0x7f1c70154140 2023-08-17T17:46:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c6f7fe700 1 --2- 172.21.15.78:0/864065051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c70154140 0x7f1c700c6ee0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f1c60009e60 tx=0x7f1c60009780).ready entity=mon.0 client_cookie=fc25a413a5db7e8f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c6e7fc700 1 -- 172.21.15.78:0/864065051 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000e070 con 0x7f1c70154140 2023-08-17T17:46:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c6e7fc700 1 -- 172.21.15.78:0/864065051 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6000bc30 con 0x7f1c70154140 2023-08-17T17:46:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c6e7fc700 1 -- 172.21.15.78:0/864065051 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60012410 con 0x7f1c70154140 2023-08-17T17:46:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c75b1b700 1 -- 172.21.15.78:0/864065051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c70154140 msgr2=0x7f1c700c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c75b1b700 1 --2- 172.21.15.78:0/864065051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c70154140 0x7f1c700c6ee0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f1c60009e60 tx=0x7f1c60009780).stop 2023-08-17T17:46:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c75b1b700 1 -- 172.21.15.78:0/864065051 shutdown_connections 2023-08-17T17:46:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c75b1b700 1 --2- 172.21.15.78:0/864065051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c70154140 0x7f1c700c6ee0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c75b1b700 1 --2- 172.21.15.78:0/864065051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c700a7c40 0x7f1c700c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c75b1b700 1 -- 172.21.15.78:0/864065051 >> 172.21.15.78:0/864065051 conn(0x7f1c70094510 msgr2=0x7f1c7006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c75b1b700 1 -- 172.21.15.78:0/864065051 shutdown_connections 2023-08-17T17:46:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.136+0000 7f1c75b1b700 1 -- 172.21.15.78:0/864065051 wait complete. 2023-08-17T17:46:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.138+0000 7f1c75b1b700 1 Processor -- start 2023-08-17T17:46:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.138+0000 7f1c75b1b700 1 -- start start 2023-08-17T17:46:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.138+0000 7f1c75b1b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c700a7c40 0x7f1c70151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.138+0000 7f1c75b1b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c700a8080 0x7f1c70155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.138+0000 7f1c75b1b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c70154140 0x7f1c70155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.138+0000 7f1c75b1b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c70155fe0 con 0x7f1c700a7c40 2023-08-17T17:46:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.138+0000 7f1c75b1b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700ade40 con 0x7f1c700a8080 2023-08-17T17:46:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.138+0000 7f1c75b1b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700ae9c0 con 0x7f1c70154140 2023-08-17T17:46:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.138+0000 7f1c6f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c700a7c40 0x7f1c70151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.138+0000 7f1c6f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c700a7c40 0x7f1c70151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37154/0 (socket says 172.21.15.78:37154) 2023-08-17T17:46:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c6f7fe700 1 -- 172.21.15.78:0/983278900 learned_addr learned my addr 172.21.15.78:0/983278900 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:46:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c6effd700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c700a8080 0x7f1c70155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c6f7fe700 1 -- 172.21.15.78:0/983278900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c70154140 msgr2=0x7f1c70155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c6f7fe700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c70154140 0x7f1c70155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c6f7fe700 1 -- 172.21.15.78:0/983278900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c700a8080 msgr2=0x7f1c70155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c6f7fe700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c700a8080 0x7f1c70155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c6f7fe700 1 -- 172.21.15.78:0/983278900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c60009a20 con 0x7f1c700a7c40 2023-08-17T17:46:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c6effd700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c700a8080 0x7f1c70155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:46:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c6f7fe700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c700a7c40 0x7f1c70151010 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f1c6000b6c0 tx=0x7f1c60009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c577fe700 1 -- 172.21.15.78:0/983278900 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6001d630 con 0x7f1c700a7c40 2023-08-17T17:46:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c577fe700 1 -- 172.21.15.78:0/983278900 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6001d790 con 0x7f1c700a7c40 2023-08-17T17:46:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c75b1b700 1 -- 172.21.15.78:0/983278900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c700aee50 con 0x7f1c700a7c40 2023-08-17T17:46:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c577fe700 1 -- 172.21.15.78:0/983278900 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6001db50 con 0x7f1c700a7c40 2023-08-17T17:46:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.139+0000 7f1c75b1b700 1 -- 172.21.15.78:0/983278900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c700ae370 con 0x7f1c700a7c40 2023-08-17T17:46:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.140+0000 7f1c75b1b700 1 -- 172.21.15.78:0/983278900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c700aeca0 con 0x7f1c700a7c40 2023-08-17T17:46:58.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.140+0000 7f1c577fe700 1 -- 172.21.15.78:0/983278900 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1c60026410 con 0x7f1c700a7c40 2023-08-17T17:46:58.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.141+0000 7f1c577fe700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c5c05ed90 0x7f1c5c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:46:58.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.141+0000 7f1c577fe700 1 -- 172.21.15.78:0/983278900 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1c6007bca0 con 0x7f1c700a7c40 2023-08-17T17:46:58.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.141+0000 7f1c6effd700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c5c05ed90 0x7f1c5c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:46:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.141+0000 7f1c6effd700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c5c05ed90 0x7f1c5c061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1c701677c0 tx=0x7f1c64008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:46:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.145+0000 7f1c577fe700 1 -- 172.21.15.78:0/983278900 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1c60080070 con 0x7f1c700a7c40 2023-08-17T17:46:58.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.304+0000 7f1c75b1b700 1 -- 172.21.15.78:0/983278900 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c70047350 con 0x7f1c5c05ed90 2023-08-17T17:46:58.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.314+0000 7f1c577fe700 1 -- 172.21.15.78:0/983278900 <== mgr.5568 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359287 (secure 0 0 0) 0x7f1c70047350 con 0x7f1c5c05ed90 2023-08-17T17:46:58.318 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:46:58.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 -- 172.21.15.78:0/983278900 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c5c05ed90 msgr2=0x7f1c5c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:58.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c5c05ed90 0x7f1c5c061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1c701677c0 tx=0x7f1c64008040).stop 2023-08-17T17:46:58.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 -- 172.21.15.78:0/983278900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c700a7c40 msgr2=0x7f1c70151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:46:58.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c700a7c40 0x7f1c70151010 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f1c6000b6c0 tx=0x7f1c60009780).stop 2023-08-17T17:46:58.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 -- 172.21.15.78:0/983278900 shutdown_connections 2023-08-17T17:46:58.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c5c05ed90 0x7f1c5c061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c70154140 0x7f1c70155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:46:58.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c700a7c40 0x7f1c70151010 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 --2- 172.21.15.78:0/983278900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c700a8080 0x7f1c70155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:46:58.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 -- 172.21.15.78:0/983278900 >> 172.21.15.78:0/983278900 conn(0x7f1c70094510 msgr2=0x7f1c700639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:46:58.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 -- 172.21.15.78:0/983278900 shutdown_connections 2023-08-17T17:46:58.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:46:58.317+0000 7f1c75b1b700 1 -- 172.21.15.78:0/983278900 wait complete. 2023-08-17T17:46:58.322 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:46:58.330 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:46:56.951438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2394384,"kb_used_data":5328,"kb_used_omap":0,"kb_used_meta":2388992,"kb_avail":752580336,"statfs":{"total":773094113280,"available":770642264064,"internally_reserved":0,"allocated":5455872,"data_stored":2621940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2446327808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14991300,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-715,"num_write_kb":-15540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.584838"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940561+0000","last_change":"2023-08-17T17:46:53.940679+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940561+0000","last_undegraded":"2023-08-17T17:46:53.940561+0000","last_fullsized":"2023-08-17T17:46:53.940561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590226+0000","last_change":"2023-08-17T17:46:53.588790+0000","last_active":"2023-08-17T17:46:53.590226+0000","last_peered":"2023-08-17T17:46:53.590226+0000","last_clean":"2023-08-17T17:46:53.590226+0000","last_became_active":"2023-08-17T17:46:53.588320+0000","last_became_peered":"2023-08-17T17:46:53.588320+0000","last_unstale":"2023-08-17T17:46:53.590226+0000","last_undegraded":"2023-08-17T17:46:53.590226+0000","last_fullsized":"2023-08-17T17:46:53.590226+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944374+0000","last_change":"2023-08-17T17:46:53.944501+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944374+0000","last_undegraded":"2023-08-17T17:46:53.944374+0000","last_fullsized":"2023-08-17T17:46:53.944374+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593232+0000","last_change":"2023-08-17T17:46:53.591003+0000","last_active":"2023-08-17T17:46:53.593232+0000","last_peered":"2023-08-17T17:46:53.593232+0000","last_clean":"2023-08-17T17:46:53.593232+0000","last_became_active":"2023-08-17T17:46:53.590718+0000","last_became_peered":"2023-08-17T17:46:53.590718+0000","last_unstale":"2023-08-17T17:46:53.593232+0000","last_undegraded":"2023-08-17T17:46:53.593232+0000","last_fullsized":"2023-08-17T17:46:53.593232+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942803+0000","last_change":"2023-08-17T17:46:53.942946+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942803+0000","last_undegraded":"2023-08-17T17:46:53.942803+0000","last_fullsized":"2023-08-17T17:46:53.942803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586289+0000","last_change":"2023-08-17T17:46:53.582491+0000","last_active":"2023-08-17T17:46:53.586289+0000","last_peered":"2023-08-17T17:46:53.586289+0000","last_clean":"2023-08-17T17:46:53.586289+0000","last_became_active":"2023-08-17T17:46:53.582209+0000","last_became_peered":"2023-08-17T17:46:53.582209+0000","last_unstale":"2023-08-17T17:46:53.586289+0000","last_undegraded":"2023-08-17T17:46:53.586289+0000","last_fullsized":"2023-08-17T17:46:53.586289+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943450+0000","last_change":"2023-08-17T17:46:53.943567+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943450+0000","last_undegraded":"2023-08-17T17:46:53.943450+0000","last_fullsized":"2023-08-17T17:46:53.943450+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590908+0000","last_change":"2023-08-17T17:46:53.582713+0000","last_active":"2023-08-17T17:46:53.590908+0000","last_peered":"2023-08-17T17:46:53.590908+0000","last_clean":"2023-08-17T17:46:53.590908+0000","last_became_active":"2023-08-17T17:46:53.582461+0000","last_became_peered":"2023-08-17T17:46:53.582461+0000","last_unstale":"2023-08-17T17:46:53.590908+0000","last_undegraded":"2023-08-17T17:46:53.590908+0000","last_fullsized":"2023-08-17T17:46:53.590908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940203+0000","last_change":"2023-08-17T17:46:53.940323+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940203+0000","last_undegraded":"2023-08-17T17:46:53.940203+0000","last_fullsized":"2023-08-17T17:46:53.940203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593671+0000","last_change":"2023-08-17T17:46:53.592771+0000","last_active":"2023-08-17T17:46:53.593671+0000","last_peered":"2023-08-17T17:46:53.593671+0000","last_clean":"2023-08-17T17:46:53.593671+0000","last_became_active":"2023-08-17T17:46:53.592489+0000","last_became_peered":"2023-08-17T17:46:53.592489+0000","last_unstale":"2023-08-17T17:46:53.593671+0000","last_undegraded":"2023-08-17T17:46:53.593671+0000","last_fullsized":"2023-08-17T17:46:53.593671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939101+0000","last_change":"2023-08-17T17:46:53.939239+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939101+0000","last_undegraded":"2023-08-17T17:46:53.939101+0000","last_fullsized":"2023-08-17T17:46:53.939101+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.588813+0000","last_change":"2023-08-17T17:46:53.587114+0000","last_active":"2023-08-17T17:46:53.588813+0000","last_peered":"2023-08-17T17:46:53.588813+0000","last_clean":"2023-08-17T17:46:53.588813+0000","last_became_active":"2023-08-17T17:46:53.586795+0000","last_became_peered":"2023-08-17T17:46:53.586795+0000","last_unstale":"2023-08-17T17:46:53.588813+0000","last_undegraded":"2023-08-17T17:46:53.588813+0000","last_fullsized":"2023-08-17T17:46:53.588813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940224+0000","last_change":"2023-08-17T17:46:53.940345+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940224+0000","last_undegraded":"2023-08-17T17:46:53.940224+0000","last_fullsized":"2023-08-17T17:46:53.940224+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595075+0000","last_change":"2023-08-17T17:46:53.594476+0000","last_active":"2023-08-17T17:46:53.595075+0000","last_peered":"2023-08-17T17:46:53.595075+0000","last_clean":"2023-08-17T17:46:53.595075+0000","last_became_active":"2023-08-17T17:46:53.594195+0000","last_became_peered":"2023-08-17T17:46:53.594195+0000","last_unstale":"2023-08-17T17:46:53.595075+0000","last_undegraded":"2023-08-17T17:46:53.595075+0000","last_fullsized":"2023-08-17T17:46:53.595075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940236+0000","last_change":"2023-08-17T17:46:53.940343+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940236+0000","last_undegraded":"2023-08-17T17:46:53.940236+0000","last_fullsized":"2023-08-17T17:46:53.940236+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592124+0000","last_change":"2023-08-17T17:46:53.584269+0000","last_active":"2023-08-17T17:46:53.592124+0000","last_peered":"2023-08-17T17:46:53.592124+0000","last_clean":"2023-08-17T17:46:53.592124+0000","last_became_active":"2023-08-17T17:46:53.583408+0000","last_became_peered":"2023-08-17T17:46:53.583408+0000","last_unstale":"2023-08-17T17:46:53.592124+0000","last_undegraded":"2023-08-17T17:46:53.592124+0000","last_fullsized":"2023-08-17T17:46:53.592124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940328+0000","last_change":"2023-08-17T17:46:53.940447+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940328+0000","last_undegraded":"2023-08-17T17:46:53.940328+0000","last_fullsized":"2023-08-17T17:46:53.940328+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591631+0000","last_change":"2023-08-17T17:46:53.585244+0000","last_active":"2023-08-17T17:46:53.591631+0000","last_peered":"2023-08-17T17:46:53.591631+0000","last_clean":"2023-08-17T17:46:53.591631+0000","last_became_active":"2023-08-17T17:46:53.584478+0000","last_became_peered":"2023-08-17T17:46:53.584478+0000","last_unstale":"2023-08-17T17:46:53.591631+0000","last_undegraded":"2023-08-17T17:46:53.591631+0000","last_fullsized":"2023-08-17T17:46:53.591631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944635+0000","last_change":"2023-08-17T17:46:53.944753+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944635+0000","last_undegraded":"2023-08-17T17:46:53.944635+0000","last_fullsized":"2023-08-17T17:46:53.944635+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592109+0000","last_change":"2023-08-17T17:46:53.585467+0000","last_active":"2023-08-17T17:46:53.592109+0000","last_peered":"2023-08-17T17:46:53.592109+0000","last_clean":"2023-08-17T17:46:53.592109+0000","last_became_active":"2023-08-17T17:46:53.585163+0000","last_became_peered":"2023-08-17T17:46:53.585163+0000","last_unstale":"2023-08-17T17:46:53.592109+0000","last_undegraded":"2023-08-17T17:46:53.592109+0000","last_fullsized":"2023-08-17T17:46:53.592109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940255+0000","last_change":"2023-08-17T17:46:53.940392+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940255+0000","last_undegraded":"2023-08-17T17:46:53.940255+0000","last_fullsized":"2023-08-17T17:46:53.940255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593121+0000","last_change":"2023-08-17T17:46:53.582814+0000","last_active":"2023-08-17T17:46:53.593121+0000","last_peered":"2023-08-17T17:46:53.593121+0000","last_clean":"2023-08-17T17:46:53.593121+0000","last_became_active":"2023-08-17T17:46:53.582554+0000","last_became_peered":"2023-08-17T17:46:53.582554+0000","last_unstale":"2023-08-17T17:46:53.593121+0000","last_undegraded":"2023-08-17T17:46:53.593121+0000","last_fullsized":"2023-08-17T17:46:53.593121+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938396+0000","last_change":"2023-08-17T17:46:53.938647+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938396+0000","last_undegraded":"2023-08-17T17:46:53.938396+0000","last_fullsized":"2023-08-17T17:46:53.938396+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587294+0000","last_change":"2023-08-17T17:46:53.582218+0000","last_active":"2023-08-17T17:46:53.587294+0000","last_peered":"2023-08-17T17:46:53.587294+0000","last_clean":"2023-08-17T17:46:53.587294+0000","last_became_active":"2023-08-17T17:46:53.581840+0000","last_became_peered":"2023-08-17T17:46:53.581840+0000","last_unstale":"2023-08-17T17:46:53.587294+0000","last_undegraded":"2023-08-17T17:46:53.587294+0000","last_fullsized":"2023-08-17T17:46:53.587294+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945327+0000","last_change":"2023-08-17T17:46:53.945464+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945327+0000","last_undegraded":"2023-08-17T17:46:53.945327+0000","last_fullsized":"2023-08-17T17:46:53.945327+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594346+0000","last_change":"2023-08-17T17:46:53.591437+0000","last_active":"2023-08-17T17:46:53.594346+0000","last_peered":"2023-08-17T17:46:53.594346+0000","last_clean":"2023-08-17T17:46:53.594346+0000","last_became_active":"2023-08-17T17:46:53.591145+0000","last_became_peered":"2023-08-17T17:46:53.591145+0000","last_unstale":"2023-08-17T17:46:53.594346+0000","last_undegraded":"2023-08-17T17:46:53.594346+0000","last_fullsized":"2023-08-17T17:46:53.594346+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942957+0000","last_change":"2023-08-17T17:46:53.943086+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942957+0000","last_undegraded":"2023-08-17T17:46:53.942957+0000","last_fullsized":"2023-08-17T17:46:53.942957+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591703+0000","last_change":"2023-08-17T17:46:53.586078+0000","last_active":"2023-08-17T17:46:53.591703+0000","last_peered":"2023-08-17T17:46:53.591703+0000","last_clean":"2023-08-17T17:46:53.591703+0000","last_became_active":"2023-08-17T17:46:53.585831+0000","last_became_peered":"2023-08-17T17:46:53.585831+0000","last_unstale":"2023-08-17T17:46:53.591703+0000","last_undegraded":"2023-08-17T17:46:53.591703+0000","last_fullsized":"2023-08-17T17:46:53.591703+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944495+0000","last_change":"2023-08-17T17:46:53.944657+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944495+0000","last_undegraded":"2023-08-17T17:46:53.944495+0000","last_fullsized":"2023-08-17T17:46:53.944495+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587539+0000","last_change":"2023-08-17T17:46:53.575072+0000","last_active":"2023-08-17T17:46:53.587539+0000","last_peered":"2023-08-17T17:46:53.587539+0000","last_clean":"2023-08-17T17:46:53.587539+0000","last_became_active":"2023-08-17T17:46:53.574793+0000","last_became_peered":"2023-08-17T17:46:53.574793+0000","last_unstale":"2023-08-17T17:46:53.587539+0000","last_undegraded":"2023-08-17T17:46:53.587539+0000","last_fullsized":"2023-08-17T17:46:53.587539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941728+0000","last_change":"2023-08-17T17:46:53.941848+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941728+0000","last_undegraded":"2023-08-17T17:46:53.941728+0000","last_fullsized":"2023-08-17T17:46:53.941728+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593840+0000","last_change":"2023-08-17T17:46:53.592156+0000","last_active":"2023-08-17T17:46:53.593840+0000","last_peered":"2023-08-17T17:46:53.593840+0000","last_clean":"2023-08-17T17:46:53.593840+0000","last_became_active":"2023-08-17T17:46:53.591901+0000","last_became_peered":"2023-08-17T17:46:53.591901+0000","last_unstale":"2023-08-17T17:46:53.593840+0000","last_undegraded":"2023-08-17T17:46:53.593840+0000","last_fullsized":"2023-08-17T17:46:53.593840+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.943747+0000","last_change":"2023-08-17T17:46:53.943829+0000","last_active":"2023-08-17T17:46:53.943747+0000","last_peered":"2023-08-17T17:46:53.943747+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.943505+0000","last_became_peered":"2023-08-17T17:46:53.943505+0000","last_unstale":"2023-08-17T17:46:53.943747+0000","last_undegraded":"2023-08-17T17:46:53.943747+0000","last_fullsized":"2023-08-17T17:46:53.943747+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586303+0000","last_change":"2023-08-17T17:46:53.580728+0000","last_active":"2023-08-17T17:46:53.586303+0000","last_peered":"2023-08-17T17:46:53.586303+0000","last_clean":"2023-08-17T17:46:53.586303+0000","last_became_active":"2023-08-17T17:46:53.580452+0000","last_became_peered":"2023-08-17T17:46:53.580452+0000","last_unstale":"2023-08-17T17:46:53.586303+0000","last_undegraded":"2023-08-17T17:46:53.586303+0000","last_fullsized":"2023-08-17T17:46:53.586303+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.947036+0000","last_change":"2023-08-17T17:46:53.947661+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.947036+0000","last_undegraded":"2023-08-17T17:46:53.947036+0000","last_fullsized":"2023-08-17T17:46:53.947036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593827+0000","last_change":"2023-08-17T17:46:53.592847+0000","last_active":"2023-08-17T17:46:53.593827+0000","last_peered":"2023-08-17T17:46:53.593827+0000","last_clean":"2023-08-17T17:46:53.593827+0000","last_became_active":"2023-08-17T17:46:53.592477+0000","last_became_peered":"2023-08-17T17:46:53.592477+0000","last_unstale":"2023-08-17T17:46:53.593827+0000","last_undegraded":"2023-08-17T17:46:53.593827+0000","last_fullsized":"2023-08-17T17:46:53.593827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943978+0000","last_change":"2023-08-17T17:46:53.944133+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943978+0000","last_undegraded":"2023-08-17T17:46:53.943978+0000","last_fullsized":"2023-08-17T17:46:53.943978+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592092+0000","last_change":"2023-08-17T17:46:53.590998+0000","last_active":"2023-08-17T17:46:53.592092+0000","last_peered":"2023-08-17T17:46:53.592092+0000","last_clean":"2023-08-17T17:46:53.592092+0000","last_became_active":"2023-08-17T17:46:53.590681+0000","last_became_peered":"2023-08-17T17:46:53.590681+0000","last_unstale":"2023-08-17T17:46:53.592092+0000","last_undegraded":"2023-08-17T17:46:53.592092+0000","last_fullsized":"2023-08-17T17:46:53.592092+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943168+0000","last_change":"2023-08-17T17:46:53.943291+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943168+0000","last_undegraded":"2023-08-17T17:46:53.943168+0000","last_fullsized":"2023-08-17T17:46:53.943168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.597850+0000","last_change":"2023-08-17T17:46:53.593024+0000","last_active":"2023-08-17T17:46:53.597850+0000","last_peered":"2023-08-17T17:46:53.597850+0000","last_clean":"2023-08-17T17:46:53.597850+0000","last_became_active":"2023-08-17T17:46:53.592759+0000","last_became_peered":"2023-08-17T17:46:53.592759+0000","last_unstale":"2023-08-17T17:46:53.597850+0000","last_undegraded":"2023-08-17T17:46:53.597850+0000","last_fullsized":"2023-08-17T17:46:53.597850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941047+0000","last_change":"2023-08-17T17:46:53.941852+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941047+0000","last_undegraded":"2023-08-17T17:46:53.941047+0000","last_fullsized":"2023-08-17T17:46:53.941047+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587734+0000","last_change":"2023-08-17T17:46:53.577716+0000","last_active":"2023-08-17T17:46:53.587734+0000","last_peered":"2023-08-17T17:46:53.587734+0000","last_clean":"2023-08-17T17:46:53.587734+0000","last_became_active":"2023-08-17T17:46:53.576999+0000","last_became_peered":"2023-08-17T17:46:53.576999+0000","last_unstale":"2023-08-17T17:46:53.587734+0000","last_undegraded":"2023-08-17T17:46:53.587734+0000","last_fullsized":"2023-08-17T17:46:53.587734+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943877+0000","last_change":"2023-08-17T17:46:53.943984+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943877+0000","last_undegraded":"2023-08-17T17:46:53.943877+0000","last_fullsized":"2023-08-17T17:46:53.943877+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590702+0000","last_change":"2023-08-17T17:46:53.583067+0000","last_active":"2023-08-17T17:46:53.590702+0000","last_peered":"2023-08-17T17:46:53.590702+0000","last_clean":"2023-08-17T17:46:53.590702+0000","last_became_active":"2023-08-17T17:46:53.582373+0000","last_became_peered":"2023-08-17T17:46:53.582373+0000","last_unstale":"2023-08-17T17:46:53.590702+0000","last_undegraded":"2023-08-17T17:46:53.590702+0000","last_fullsized":"2023-08-17T17:46:53.590702+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941545+0000","last_change":"2023-08-17T17:46:53.941639+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941545+0000","last_undegraded":"2023-08-17T17:46:53.941545+0000","last_fullsized":"2023-08-17T17:46:53.941545+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589458+0000","last_change":"2023-08-17T17:46:53.587208+0000","last_active":"2023-08-17T17:46:53.589458+0000","last_peered":"2023-08-17T17:46:53.589458+0000","last_clean":"2023-08-17T17:46:53.589458+0000","last_became_active":"2023-08-17T17:46:53.586922+0000","last_became_peered":"2023-08-17T17:46:53.586922+0000","last_unstale":"2023-08-17T17:46:53.589458+0000","last_undegraded":"2023-08-17T17:46:53.589458+0000","last_fullsized":"2023-08-17T17:46:53.589458+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952595+0000","last_change":"2023-08-17T17:46:53.952664+0000","last_active":"2023-08-17T17:46:53.952595+0000","last_peered":"2023-08-17T17:46:53.952595+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.952430+0000","last_became_peered":"2023-08-17T17:46:53.952430+0000","last_unstale":"2023-08-17T17:46:53.952595+0000","last_undegraded":"2023-08-17T17:46:53.952595+0000","last_fullsized":"2023-08-17T17:46:53.952595+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587376+0000","last_change":"2023-08-17T17:46:53.583496+0000","last_active":"2023-08-17T17:46:53.587376+0000","last_peered":"2023-08-17T17:46:53.587376+0000","last_clean":"2023-08-17T17:46:53.587376+0000","last_became_active":"2023-08-17T17:46:53.583200+0000","last_became_peered":"2023-08-17T17:46:53.583200+0000","last_unstale":"2023-08-17T17:46:53.587376+0000","last_undegraded":"2023-08-17T17:46:53.587376+0000","last_fullsized":"2023-08-17T17:46:53.587376+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944577+0000","last_change":"2023-08-17T17:46:53.944699+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944577+0000","last_undegraded":"2023-08-17T17:46:53.944577+0000","last_fullsized":"2023-08-17T17:46:53.944577+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593065+0000","last_change":"2023-08-17T17:46:53.591647+0000","last_active":"2023-08-17T17:46:53.593065+0000","last_peered":"2023-08-17T17:46:53.593065+0000","last_clean":"2023-08-17T17:46:53.593065+0000","last_became_active":"2023-08-17T17:46:53.591369+0000","last_became_peered":"2023-08-17T17:46:53.591369+0000","last_unstale":"2023-08-17T17:46:53.593065+0000","last_undegraded":"2023-08-17T17:46:53.593065+0000","last_fullsized":"2023-08-17T17:46:53.593065+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939609+0000","last_change":"2023-08-17T17:46:53.939758+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939609+0000","last_undegraded":"2023-08-17T17:46:53.939609+0000","last_fullsized":"2023-08-17T17:46:53.939609+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594295+0000","last_change":"2023-08-17T17:46:53.591137+0000","last_active":"2023-08-17T17:46:53.594295+0000","last_peered":"2023-08-17T17:46:53.594295+0000","last_clean":"2023-08-17T17:46:53.594295+0000","last_became_active":"2023-08-17T17:46:53.590561+0000","last_became_peered":"2023-08-17T17:46:53.590561+0000","last_unstale":"2023-08-17T17:46:53.594295+0000","last_undegraded":"2023-08-17T17:46:53.594295+0000","last_fullsized":"2023-08-17T17:46:53.594295+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939500+0000","last_change":"2023-08-17T17:46:53.939664+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939500+0000","last_undegraded":"2023-08-17T17:46:53.939500+0000","last_fullsized":"2023-08-17T17:46:53.939500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583400+0000","last_change":"2023-08-17T17:46:53.578788+0000","last_active":"2023-08-17T17:46:53.583400+0000","last_peered":"2023-08-17T17:46:53.583400+0000","last_clean":"2023-08-17T17:46:53.583400+0000","last_became_active":"2023-08-17T17:46:53.578283+0000","last_became_peered":"2023-08-17T17:46:53.578283+0000","last_unstale":"2023-08-17T17:46:53.583400+0000","last_undegraded":"2023-08-17T17:46:53.583400+0000","last_fullsized":"2023-08-17T17:46:53.583400+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952045+0000","last_change":"2023-08-17T17:46:53.952105+0000","last_active":"2023-08-17T17:46:53.952045+0000","last_peered":"2023-08-17T17:46:53.952045+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.951761+0000","last_became_peered":"2023-08-17T17:46:53.951761+0000","last_unstale":"2023-08-17T17:46:53.952045+0000","last_undegraded":"2023-08-17T17:46:53.952045+0000","last_fullsized":"2023-08-17T17:46:53.952045+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587277+0000","last_change":"2023-08-17T17:46:53.582134+0000","last_active":"2023-08-17T17:46:53.587277+0000","last_peered":"2023-08-17T17:46:53.587277+0000","last_clean":"2023-08-17T17:46:53.587277+0000","last_became_active":"2023-08-17T17:46:53.581821+0000","last_became_peered":"2023-08-17T17:46:53.581821+0000","last_unstale":"2023-08-17T17:46:53.587277+0000","last_undegraded":"2023-08-17T17:46:53.587277+0000","last_fullsized":"2023-08-17T17:46:53.587277+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.942082+0000","last_change":"2023-08-17T17:46:53.942203+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.942082+0000","last_undegraded":"2023-08-17T17:46:53.942082+0000","last_fullsized":"2023-08-17T17:46:53.942082+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.586364+0000","last_change":"2023-08-17T17:46:53.581919+0000","last_active":"2023-08-17T17:46:53.586364+0000","last_peered":"2023-08-17T17:46:53.586364+0000","last_clean":"2023-08-17T17:46:53.586364+0000","last_became_active":"2023-08-17T17:46:53.581615+0000","last_became_peered":"2023-08-17T17:46:53.581615+0000","last_unstale":"2023-08-17T17:46:53.586364+0000","last_undegraded":"2023-08-17T17:46:53.586364+0000","last_fullsized":"2023-08-17T17:46:53.586364+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943285+0000","last_change":"2023-08-17T17:46:53.943426+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943285+0000","last_undegraded":"2023-08-17T17:46:53.943285+0000","last_fullsized":"2023-08-17T17:46:53.943285+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589673+0000","last_change":"2023-08-17T17:46:53.587221+0000","last_active":"2023-08-17T17:46:53.589673+0000","last_peered":"2023-08-17T17:46:53.589673+0000","last_clean":"2023-08-17T17:46:53.589673+0000","last_became_active":"2023-08-17T17:46:53.586901+0000","last_became_peered":"2023-08-17T17:46:53.586901+0000","last_unstale":"2023-08-17T17:46:53.589673+0000","last_undegraded":"2023-08-17T17:46:53.589673+0000","last_fullsized":"2023-08-17T17:46:53.589673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944893+0000","last_change":"2023-08-17T17:46:53.945173+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944893+0000","last_undegraded":"2023-08-17T17:46:53.944893+0000","last_fullsized":"2023-08-17T17:46:53.944893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587692+0000","last_change":"2023-08-17T17:46:53.579836+0000","last_active":"2023-08-17T17:46:53.587692+0000","last_peered":"2023-08-17T17:46:53.587692+0000","last_clean":"2023-08-17T17:46:53.587692+0000","last_became_active":"2023-08-17T17:46:53.579544+0000","last_became_peered":"2023-08-17T17:46:53.579544+0000","last_unstale":"2023-08-17T17:46:53.587692+0000","last_undegraded":"2023-08-17T17:46:53.587692+0000","last_fullsized":"2023-08-17T17:46:53.587692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945016+0000","last_change":"2023-08-17T17:46:53.945126+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945016+0000","last_undegraded":"2023-08-17T17:46:53.945016+0000","last_fullsized":"2023-08-17T17:46:53.945016+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.585758+0000","last_change":"2023-08-17T17:46:53.583210+0000","last_active":"2023-08-17T17:46:53.585758+0000","last_peered":"2023-08-17T17:46:53.585758+0000","last_clean":"2023-08-17T17:46:53.585758+0000","last_became_active":"2023-08-17T17:46:53.583036+0000","last_became_peered":"2023-08-17T17:46:53.583036+0000","last_unstale":"2023-08-17T17:46:53.585758+0000","last_undegraded":"2023-08-17T17:46:53.585758+0000","last_fullsized":"2023-08-17T17:46:53.585758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943461+0000","last_change":"2023-08-17T17:46:53.943591+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943461+0000","last_undegraded":"2023-08-17T17:46:53.943461+0000","last_fullsized":"2023-08-17T17:46:53.943461+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.575333+0000","last_change":"2023-08-17T17:46:53.574238+0000","last_active":"2023-08-17T17:46:53.575333+0000","last_peered":"2023-08-17T17:46:53.575333+0000","last_clean":"2023-08-17T17:46:53.575333+0000","last_became_active":"2023-08-17T17:46:53.573880+0000","last_became_peered":"2023-08-17T17:46:53.573880+0000","last_unstale":"2023-08-17T17:46:53.575333+0000","last_undegraded":"2023-08-17T17:46:53.575333+0000","last_fullsized":"2023-08-17T17:46:53.575333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937057+0000","last_change":"2023-08-17T17:46:53.937240+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937057+0000","last_undegraded":"2023-08-17T17:46:53.937057+0000","last_fullsized":"2023-08-17T17:46:53.937057+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593638+0000","last_change":"2023-08-17T17:46:53.588046+0000","last_active":"2023-08-17T17:46:53.593638+0000","last_peered":"2023-08-17T17:46:53.593638+0000","last_clean":"2023-08-17T17:46:53.593638+0000","last_became_active":"2023-08-17T17:46:53.587776+0000","last_became_peered":"2023-08-17T17:46:53.587776+0000","last_unstale":"2023-08-17T17:46:53.593638+0000","last_undegraded":"2023-08-17T17:46:53.593638+0000","last_fullsized":"2023-08-17T17:46:53.593638+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941251+0000","last_change":"2023-08-17T17:46:53.941251+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941251+0000","last_undegraded":"2023-08-17T17:46:53.941251+0000","last_fullsized":"2023-08-17T17:46:53.941251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583978+0000","last_change":"2023-08-17T17:46:53.580782+0000","last_active":"2023-08-17T17:46:53.583978+0000","last_peered":"2023-08-17T17:46:53.583978+0000","last_clean":"2023-08-17T17:46:53.583978+0000","last_became_active":"2023-08-17T17:46:53.580298+0000","last_became_peered":"2023-08-17T17:46:53.580298+0000","last_unstale":"2023-08-17T17:46:53.583978+0000","last_undegraded":"2023-08-17T17:46:53.583978+0000","last_fullsized":"2023-08-17T17:46:53.583978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940775+0000","last_change":"2023-08-17T17:46:53.940903+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940775+0000","last_undegraded":"2023-08-17T17:46:53.940775+0000","last_fullsized":"2023-08-17T17:46:53.940775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589471+0000","last_change":"2023-08-17T17:46:53.587937+0000","last_active":"2023-08-17T17:46:53.589471+0000","last_peered":"2023-08-17T17:46:53.589471+0000","last_clean":"2023-08-17T17:46:53.589471+0000","last_became_active":"2023-08-17T17:46:53.587645+0000","last_became_peered":"2023-08-17T17:46:53.587645+0000","last_unstale":"2023-08-17T17:46:53.589471+0000","last_undegraded":"2023-08-17T17:46:53.589471+0000","last_fullsized":"2023-08-17T17:46:53.589471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938302+0000","last_change":"2023-08-17T17:46:53.938456+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938302+0000","last_undegraded":"2023-08-17T17:46:53.938302+0000","last_fullsized":"2023-08-17T17:46:53.938302+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595334+0000","last_change":"2023-08-17T17:46:53.591820+0000","last_active":"2023-08-17T17:46:53.595334+0000","last_peered":"2023-08-17T17:46:53.595334+0000","last_clean":"2023-08-17T17:46:53.595334+0000","last_became_active":"2023-08-17T17:46:53.591544+0000","last_became_peered":"2023-08-17T17:46:53.591544+0000","last_unstale":"2023-08-17T17:46:53.595334+0000","last_undegraded":"2023-08-17T17:46:53.595334+0000","last_fullsized":"2023-08-17T17:46:53.595334+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945011+0000","last_change":"2023-08-17T17:46:53.945183+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945011+0000","last_undegraded":"2023-08-17T17:46:53.945011+0000","last_fullsized":"2023-08-17T17:46:53.945011+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.581056+0000","last_change":"2023-08-17T17:46:53.576364+0000","last_active":"2023-08-17T17:46:53.581056+0000","last_peered":"2023-08-17T17:46:53.581056+0000","last_clean":"2023-08-17T17:46:53.581056+0000","last_became_active":"2023-08-17T17:46:53.576052+0000","last_became_peered":"2023-08-17T17:46:53.576052+0000","last_unstale":"2023-08-17T17:46:53.581056+0000","last_undegraded":"2023-08-17T17:46:53.581056+0000","last_fullsized":"2023-08-17T17:46:53.581056+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941183+0000","last_change":"2023-08-17T17:46:53.941315+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941183+0000","last_undegraded":"2023-08-17T17:46:53.941183+0000","last_fullsized":"2023-08-17T17:46:53.941183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.588720+0000","last_change":"2023-08-17T17:46:53.583930+0000","last_active":"2023-08-17T17:46:53.588720+0000","last_peered":"2023-08-17T17:46:53.588720+0000","last_clean":"2023-08-17T17:46:53.588720+0000","last_became_active":"2023-08-17T17:46:53.583633+0000","last_became_peered":"2023-08-17T17:46:53.583633+0000","last_unstale":"2023-08-17T17:46:53.588720+0000","last_undegraded":"2023-08-17T17:46:53.588720+0000","last_fullsized":"2023-08-17T17:46:53.588720+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.945636+0000","last_change":"2023-08-17T17:46:53.946154+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.945636+0000","last_undegraded":"2023-08-17T17:46:53.945636+0000","last_fullsized":"2023-08-17T17:46:53.945636+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583312+0000","last_change":"2023-08-17T17:46:53.576838+0000","last_active":"2023-08-17T17:46:53.583312+0000","last_peered":"2023-08-17T17:46:53.583312+0000","last_clean":"2023-08-17T17:46:53.583312+0000","last_became_active":"2023-08-17T17:46:53.576666+0000","last_became_peered":"2023-08-17T17:46:53.576666+0000","last_unstale":"2023-08-17T17:46:53.583312+0000","last_undegraded":"2023-08-17T17:46:53.583312+0000","last_fullsized":"2023-08-17T17:46:53.583312+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937664+0000","last_change":"2023-08-17T17:46:53.937822+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937664+0000","last_undegraded":"2023-08-17T17:46:53.937664+0000","last_fullsized":"2023-08-17T17:46:53.937664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590205+0000","last_change":"2023-08-17T17:46:53.588579+0000","last_active":"2023-08-17T17:46:53.590205+0000","last_peered":"2023-08-17T17:46:53.590205+0000","last_clean":"2023-08-17T17:46:53.590205+0000","last_became_active":"2023-08-17T17:46:53.588025+0000","last_became_peered":"2023-08-17T17:46:53.588025+0000","last_unstale":"2023-08-17T17:46:53.590205+0000","last_undegraded":"2023-08-17T17:46:53.590205+0000","last_fullsized":"2023-08-17T17:46:53.590205+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.946622+0000","last_change":"2023-08-17T17:46:53.946710+0000","last_active":"2023-08-17T17:46:53.946622+0000","last_peered":"2023-08-17T17:46:53.946622+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.946424+0000","last_became_peered":"2023-08-17T17:46:53.946424+0000","last_unstale":"2023-08-17T17:46:53.946622+0000","last_undegraded":"2023-08-17T17:46:53.946622+0000","last_fullsized":"2023-08-17T17:46:53.946622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593808+0000","last_change":"2023-08-17T17:46:53.592735+0000","last_active":"2023-08-17T17:46:53.593808+0000","last_peered":"2023-08-17T17:46:53.593808+0000","last_clean":"2023-08-17T17:46:53.593808+0000","last_became_active":"2023-08-17T17:46:53.592421+0000","last_became_peered":"2023-08-17T17:46:53.592421+0000","last_unstale":"2023-08-17T17:46:53.593808+0000","last_undegraded":"2023-08-17T17:46:53.593808+0000","last_fullsized":"2023-08-17T17:46:53.593808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.948487+0000","last_change":"2023-08-17T17:46:53.948603+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.948487+0000","last_undegraded":"2023-08-17T17:46:53.948487+0000","last_fullsized":"2023-08-17T17:46:53.948487+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595091+0000","last_change":"2023-08-17T17:46:53.594526+0000","last_active":"2023-08-17T17:46:53.595091+0000","last_peered":"2023-08-17T17:46:53.595091+0000","last_clean":"2023-08-17T17:46:53.595091+0000","last_became_active":"2023-08-17T17:46:53.594206+0000","last_became_peered":"2023-08-17T17:46:53.594206+0000","last_unstale":"2023-08-17T17:46:53.595091+0000","last_undegraded":"2023-08-17T17:46:53.595091+0000","last_fullsized":"2023-08-17T17:46:53.595091+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938853+0000","last_change":"2023-08-17T17:46:53.938963+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938853+0000","last_undegraded":"2023-08-17T17:46:53.938853+0000","last_fullsized":"2023-08-17T17:46:53.938853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587827+0000","last_change":"2023-08-17T17:46:53.581153+0000","last_active":"2023-08-17T17:46:53.587827+0000","last_peered":"2023-08-17T17:46:53.587827+0000","last_clean":"2023-08-17T17:46:53.587827+0000","last_became_active":"2023-08-17T17:46:53.580902+0000","last_became_peered":"2023-08-17T17:46:53.580902+0000","last_unstale":"2023-08-17T17:46:53.587827+0000","last_undegraded":"2023-08-17T17:46:53.587827+0000","last_fullsized":"2023-08-17T17:46:53.587827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937121+0000","last_change":"2023-08-17T17:46:53.937261+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937121+0000","last_undegraded":"2023-08-17T17:46:53.937121+0000","last_fullsized":"2023-08-17T17:46:53.937121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595272+0000","last_change":"2023-08-17T17:46:53.591102+0000","last_active":"2023-08-17T17:46:53.595272+0000","last_peered":"2023-08-17T17:46:53.595272+0000","last_clean":"2023-08-17T17:46:53.595272+0000","last_became_active":"2023-08-17T17:46:53.590811+0000","last_became_peered":"2023-08-17T17:46:53.590811+0000","last_unstale":"2023-08-17T17:46:53.595272+0000","last_undegraded":"2023-08-17T17:46:53.595272+0000","last_fullsized":"2023-08-17T17:46:53.595272+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.943621+0000","last_change":"2023-08-17T17:46:53.945412+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.943621+0000","last_undegraded":"2023-08-17T17:46:53.943621+0000","last_fullsized":"2023-08-17T17:46:53.943621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.592959+0000","last_change":"2023-08-17T17:46:53.591056+0000","last_active":"2023-08-17T17:46:53.592959+0000","last_peered":"2023-08-17T17:46:53.592959+0000","last_clean":"2023-08-17T17:46:53.592959+0000","last_became_active":"2023-08-17T17:46:53.590762+0000","last_became_peered":"2023-08-17T17:46:53.590762+0000","last_unstale":"2023-08-17T17:46:53.592959+0000","last_undegraded":"2023-08-17T17:46:53.592959+0000","last_fullsized":"2023-08-17T17:46:53.592959+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941519+0000","last_change":"2023-08-17T17:46:53.941637+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941519+0000","last_undegraded":"2023-08-17T17:46:53.941519+0000","last_fullsized":"2023-08-17T17:46:53.941519+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590423+0000","last_change":"2023-08-17T17:46:53.589394+0000","last_active":"2023-08-17T17:46:53.590423+0000","last_peered":"2023-08-17T17:46:53.590423+0000","last_clean":"2023-08-17T17:46:53.590423+0000","last_became_active":"2023-08-17T17:46:53.589087+0000","last_became_peered":"2023-08-17T17:46:53.589087+0000","last_unstale":"2023-08-17T17:46:53.590423+0000","last_undegraded":"2023-08-17T17:46:53.590423+0000","last_fullsized":"2023-08-17T17:46:53.590423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944884+0000","last_change":"2023-08-17T17:46:53.945023+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944884+0000","last_undegraded":"2023-08-17T17:46:53.944884+0000","last_fullsized":"2023-08-17T17:46:53.944884+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587961+0000","last_change":"2023-08-17T17:46:53.584361+0000","last_active":"2023-08-17T17:46:53.587961+0000","last_peered":"2023-08-17T17:46:53.587961+0000","last_clean":"2023-08-17T17:46:53.587961+0000","last_became_active":"2023-08-17T17:46:53.584085+0000","last_became_peered":"2023-08-17T17:46:53.584085+0000","last_unstale":"2023-08-17T17:46:53.587961+0000","last_undegraded":"2023-08-17T17:46:53.587961+0000","last_fullsized":"2023-08-17T17:46:53.587961+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939992+0000","last_change":"2023-08-17T17:46:53.940120+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939992+0000","last_undegraded":"2023-08-17T17:46:53.939992+0000","last_fullsized":"2023-08-17T17:46:53.939992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.594348+0000","last_change":"2023-08-17T17:46:53.588048+0000","last_active":"2023-08-17T17:46:53.594348+0000","last_peered":"2023-08-17T17:46:53.594348+0000","last_clean":"2023-08-17T17:46:53.594348+0000","last_became_active":"2023-08-17T17:46:53.587765+0000","last_became_peered":"2023-08-17T17:46:53.587765+0000","last_unstale":"2023-08-17T17:46:53.594348+0000","last_undegraded":"2023-08-17T17:46:53.594348+0000","last_fullsized":"2023-08-17T17:46:53.594348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939716+0000","last_change":"2023-08-17T17:46:53.939858+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939716+0000","last_undegraded":"2023-08-17T17:46:53.939716+0000","last_fullsized":"2023-08-17T17:46:53.939716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591534+0000","last_change":"2023-08-17T17:46:53.580274+0000","last_active":"2023-08-17T17:46:53.591534+0000","last_peered":"2023-08-17T17:46:53.591534+0000","last_clean":"2023-08-17T17:46:53.591534+0000","last_became_active":"2023-08-17T17:46:53.580000+0000","last_became_peered":"2023-08-17T17:46:53.580000+0000","last_unstale":"2023-08-17T17:46:53.591534+0000","last_undegraded":"2023-08-17T17:46:53.591534+0000","last_fullsized":"2023-08-17T17:46:53.591534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937716+0000","last_change":"2023-08-17T17:46:53.937873+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937716+0000","last_undegraded":"2023-08-17T17:46:53.937716+0000","last_fullsized":"2023-08-17T17:46:53.937716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.582774+0000","last_change":"2023-08-17T17:46:53.581711+0000","last_active":"2023-08-17T17:46:53.582774+0000","last_peered":"2023-08-17T17:46:53.582774+0000","last_clean":"2023-08-17T17:46:53.582774+0000","last_became_active":"2023-08-17T17:46:53.581422+0000","last_became_peered":"2023-08-17T17:46:53.581422+0000","last_unstale":"2023-08-17T17:46:53.582774+0000","last_undegraded":"2023-08-17T17:46:53.582774+0000","last_fullsized":"2023-08-17T17:46:53.582774+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.940892+0000","last_change":"2023-08-17T17:46:53.941005+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.940892+0000","last_undegraded":"2023-08-17T17:46:53.940892+0000","last_fullsized":"2023-08-17T17:46:53.940892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.590044+0000","last_change":"2023-08-17T17:46:53.588355+0000","last_active":"2023-08-17T17:46:53.590044+0000","last_peered":"2023-08-17T17:46:53.590044+0000","last_clean":"2023-08-17T17:46:53.590044+0000","last_became_active":"2023-08-17T17:46:53.587993+0000","last_became_peered":"2023-08-17T17:46:53.587993+0000","last_unstale":"2023-08-17T17:46:53.590044+0000","last_undegraded":"2023-08-17T17:46:53.590044+0000","last_fullsized":"2023-08-17T17:46:53.590044+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.937494+0000","last_change":"2023-08-17T17:46:53.937635+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.937494+0000","last_undegraded":"2023-08-17T17:46:53.937494+0000","last_fullsized":"2023-08-17T17:46:53.937494+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.583805+0000","last_change":"2023-08-17T17:46:53.581332+0000","last_active":"2023-08-17T17:46:53.583805+0000","last_peered":"2023-08-17T17:46:53.583805+0000","last_clean":"2023-08-17T17:46:53.583805+0000","last_became_active":"2023-08-17T17:46:53.581009+0000","last_became_peered":"2023-08-17T17:46:53.581009+0000","last_unstale":"2023-08-17T17:46:53.583805+0000","last_undegraded":"2023-08-17T17:46:53.583805+0000","last_fullsized":"2023-08-17T17:46:53.583805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941448+0000","last_change":"2023-08-17T17:46:53.941575+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941448+0000","last_undegraded":"2023-08-17T17:46:53.941448+0000","last_fullsized":"2023-08-17T17:46:53.941448+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587786+0000","last_change":"2023-08-17T17:46:53.581061+0000","last_active":"2023-08-17T17:46:53.587786+0000","last_peered":"2023-08-17T17:46:53.587786+0000","last_clean":"2023-08-17T17:46:53.587786+0000","last_became_active":"2023-08-17T17:46:53.580750+0000","last_became_peered":"2023-08-17T17:46:53.580750+0000","last_unstale":"2023-08-17T17:46:53.587786+0000","last_undegraded":"2023-08-17T17:46:53.587786+0000","last_fullsized":"2023-08-17T17:46:53.587786+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944411+0000","last_change":"2023-08-17T17:46:53.944546+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944411+0000","last_undegraded":"2023-08-17T17:46:53.944411+0000","last_fullsized":"2023-08-17T17:46:53.944411+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591641+0000","last_change":"2023-08-17T17:46:53.584779+0000","last_active":"2023-08-17T17:46:53.591641+0000","last_peered":"2023-08-17T17:46:53.591641+0000","last_clean":"2023-08-17T17:46:53.591641+0000","last_became_active":"2023-08-17T17:46:53.584502+0000","last_became_peered":"2023-08-17T17:46:53.584502+0000","last_unstale":"2023-08-17T17:46:53.591641+0000","last_undegraded":"2023-08-17T17:46:53.591641+0000","last_fullsized":"2023-08-17T17:46:53.591641+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":5,"reported_epoch":59,"state":"active","last_fresh":"2023-08-17T17:46:53.947664+0000","last_change":"2023-08-17T17:46:53.947664+0000","last_active":"2023-08-17T17:46:53.947664+0000","last_peered":"2023-08-17T17:46:53.947664+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.947664+0000","last_became_peered":"2023-08-17T17:46:53.947664+0000","last_unstale":"2023-08-17T17:46:53.947664+0000","last_undegraded":"2023-08-17T17:46:53.947664+0000","last_fullsized":"2023-08-17T17:46:53.947664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.585170+0000","last_change":"2023-08-17T17:46:53.582200+0000","last_active":"2023-08-17T17:46:53.585170+0000","last_peered":"2023-08-17T17:46:53.585170+0000","last_clean":"2023-08-17T17:46:53.585170+0000","last_became_active":"2023-08-17T17:46:53.581952+0000","last_became_peered":"2023-08-17T17:46:53.581952+0000","last_unstale":"2023-08-17T17:46:53.585170+0000","last_undegraded":"2023-08-17T17:46:53.585170+0000","last_fullsized":"2023-08-17T17:46:53.585170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.944068+0000","last_change":"2023-08-17T17:46:53.944185+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.944068+0000","last_undegraded":"2023-08-17T17:46:53.944068+0000","last_fullsized":"2023-08-17T17:46:53.944068+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589729+0000","last_change":"2023-08-17T17:46:53.588244+0000","last_active":"2023-08-17T17:46:53.589729+0000","last_peered":"2023-08-17T17:46:53.589729+0000","last_clean":"2023-08-17T17:46:53.589729+0000","last_became_active":"2023-08-17T17:46:53.587974+0000","last_became_peered":"2023-08-17T17:46:53.587974+0000","last_unstale":"2023-08-17T17:46:53.589729+0000","last_undegraded":"2023-08-17T17:46:53.589729+0000","last_fullsized":"2023-08-17T17:46:53.589729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.567702+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:46:53.567702+0000","last_peered":"2023-08-17T17:46:53.567702+0000","last_clean":"2023-08-17T17:46:53.567702+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:46:53.567702+0000","last_undegraded":"2023-08-17T17:46:53.567702+0000","last_fullsized":"2023-08-17T17:46:53.567702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.936412+0000","last_change":"2023-08-17T17:46:53.936577+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.936412+0000","last_undegraded":"2023-08-17T17:46:53.936412+0000","last_fullsized":"2023-08-17T17:46:53.936412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593048+0000","last_change":"2023-08-17T17:46:53.591586+0000","last_active":"2023-08-17T17:46:53.593048+0000","last_peered":"2023-08-17T17:46:53.593048+0000","last_clean":"2023-08-17T17:46:53.593048+0000","last_became_active":"2023-08-17T17:46:53.591021+0000","last_became_peered":"2023-08-17T17:46:53.591021+0000","last_unstale":"2023-08-17T17:46:53.593048+0000","last_undegraded":"2023-08-17T17:46:53.593048+0000","last_fullsized":"2023-08-17T17:46:53.593048+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.570406+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:46:53.570406+0000","last_peered":"2023-08-17T17:46:53.570406+0000","last_clean":"2023-08-17T17:46:53.570406+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:46:53.570406+0000","last_undegraded":"2023-08-17T17:46:53.570406+0000","last_fullsized":"2023-08-17T17:46:53.570406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941113+0000","last_change":"2023-08-17T17:46:53.941363+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941113+0000","last_undegraded":"2023-08-17T17:46:53.941113+0000","last_fullsized":"2023-08-17T17:46:53.941113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.591304+0000","last_change":"2023-08-17T17:46:53.584242+0000","last_active":"2023-08-17T17:46:53.591304+0000","last_peered":"2023-08-17T17:46:53.591304+0000","last_clean":"2023-08-17T17:46:53.591304+0000","last_became_active":"2023-08-17T17:46:53.583975+0000","last_became_peered":"2023-08-17T17:46:53.583975+0000","last_unstale":"2023-08-17T17:46:53.591304+0000","last_undegraded":"2023-08-17T17:46:53.591304+0000","last_fullsized":"2023-08-17T17:46:53.591304+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.574503+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:46:53.574503+0000","last_peered":"2023-08-17T17:46:53.574503+0000","last_clean":"2023-08-17T17:46:53.574503+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:46:53.574503+0000","last_undegraded":"2023-08-17T17:46:53.574503+0000","last_fullsized":"2023-08-17T17:46:53.574503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.941461+0000","last_change":"2023-08-17T17:46:53.941622+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.941461+0000","last_undegraded":"2023-08-17T17:46:53.941461+0000","last_fullsized":"2023-08-17T17:46:53.941461+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.595361+0000","last_change":"2023-08-17T17:46:53.591978+0000","last_active":"2023-08-17T17:46:53.595361+0000","last_peered":"2023-08-17T17:46:53.595361+0000","last_clean":"2023-08-17T17:46:53.595361+0000","last_became_active":"2023-08-17T17:46:53.591812+0000","last_became_peered":"2023-08-17T17:46:53.591812+0000","last_unstale":"2023-08-17T17:46:53.595361+0000","last_undegraded":"2023-08-17T17:46:53.595361+0000","last_fullsized":"2023-08-17T17:46:53.595361+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.577814+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:46:53.577814+0000","last_peered":"2023-08-17T17:46:53.577814+0000","last_clean":"2023-08-17T17:46:53.577814+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:46:53.577814+0000","last_undegraded":"2023-08-17T17:46:53.577814+0000","last_fullsized":"2023-08-17T17:46:53.577814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.580993+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:46:53.580993+0000","last_peered":"2023-08-17T17:46:53.580993+0000","last_clean":"2023-08-17T17:46:53.580993+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:46:53.580993+0000","last_undegraded":"2023-08-17T17:46:53.580993+0000","last_fullsized":"2023-08-17T17:46:53.580993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.938984+0000","last_change":"2023-08-17T17:46:53.939138+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.938984+0000","last_undegraded":"2023-08-17T17:46:53.938984+0000","last_fullsized":"2023-08-17T17:46:53.938984+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.589500+0000","last_change":"2023-08-17T17:46:53.586983+0000","last_active":"2023-08-17T17:46:53.589500+0000","last_peered":"2023-08-17T17:46:53.589500+0000","last_clean":"2023-08-17T17:46:53.589500+0000","last_became_active":"2023-08-17T17:46:53.586729+0000","last_became_peered":"2023-08-17T17:46:53.586729+0000","last_unstale":"2023-08-17T17:46:53.589500+0000","last_undegraded":"2023-08-17T17:46:53.589500+0000","last_fullsized":"2023-08-17T17:46:53.589500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.581035+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:46:53.581035+0000","last_peered":"2023-08-17T17:46:53.581035+0000","last_clean":"2023-08-17T17:46:53.581035+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:46:53.581035+0000","last_undegraded":"2023-08-17T17:46:53.581035+0000","last_fullsized":"2023-08-17T17:46:53.581035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.939926+0000","last_change":"2023-08-17T17:46:53.940046+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.939926+0000","last_undegraded":"2023-08-17T17:46:53.939926+0000","last_fullsized":"2023-08-17T17:46:53.939926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.593263+0000","last_change":"2023-08-17T17:46:53.591593+0000","last_active":"2023-08-17T17:46:53.593263+0000","last_peered":"2023-08-17T17:46:53.593263+0000","last_clean":"2023-08-17T17:46:53.593263+0000","last_became_active":"2023-08-17T17:46:53.591368+0000","last_became_peered":"2023-08-17T17:46:53.591368+0000","last_unstale":"2023-08-17T17:46:53.593263+0000","last_undegraded":"2023-08-17T17:46:53.593263+0000","last_fullsized":"2023-08-17T17:46:53.593263+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.582295+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:46:53.582295+0000","last_peered":"2023-08-17T17:46:53.582295+0000","last_clean":"2023-08-17T17:46:53.582295+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:46:53.582295+0000","last_undegraded":"2023-08-17T17:46:53.582295+0000","last_fullsized":"2023-08-17T17:46:53.582295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":7,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.952125+0000","last_change":"2023-08-17T17:46:53.952198+0000","last_active":"2023-08-17T17:46:53.952125+0000","last_peered":"2023-08-17T17:46:53.952125+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"2023-08-17T17:46:53.951935+0000","last_became_peered":"2023-08-17T17:46:53.951935+0000","last_unstale":"2023-08-17T17:46:53.952125+0000","last_undegraded":"2023-08-17T17:46:53.952125+0000","last_fullsized":"2023-08-17T17:46:53.952125+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587803+0000","last_change":"2023-08-17T17:46:53.581838+0000","last_active":"2023-08-17T17:46:53.587803+0000","last_peered":"2023-08-17T17:46:53.587803+0000","last_clean":"2023-08-17T17:46:53.587803+0000","last_became_active":"2023-08-17T17:46:53.581523+0000","last_became_peered":"2023-08-17T17:46:53.581523+0000","last_unstale":"2023-08-17T17:46:53.587803+0000","last_undegraded":"2023-08-17T17:46:53.587803+0000","last_fullsized":"2023-08-17T17:46:53.587803+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.568013+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:46:53.568013+0000","last_peered":"2023-08-17T17:46:53.568013+0000","last_clean":"2023-08-17T17:46:53.568013+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:46:53.568013+0000","last_undegraded":"2023-08-17T17:46:53.568013+0000","last_fullsized":"2023-08-17T17:46:53.568013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":2,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-08-17T17:46:53.936458+0000","last_change":"2023-08-17T17:46:53.936611+0000","last_active":"2023-08-17T17:46:53.558461+0000","last_peered":"2023-08-17T17:46:53.558461+0000","last_clean":"2023-08-17T17:46:53.558461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:46:53.936458+0000","last_undegraded":"2023-08-17T17:46:53.936458+0000","last_fullsized":"2023-08-17T17:46:53.936458+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.587511+0000","last_change":"2023-08-17T17:46:53.574800+0000","last_active":"2023-08-17T17:46:53.587511+0000","last_peered":"2023-08-17T17:46:53.587511+0000","last_clean":"2023-08-17T17:46:53.587511+0000","last_became_active":"2023-08-17T17:46:53.574519+0000","last_became_peered":"2023-08-17T17:46:53.574519+0000","last_unstale":"2023-08-17T17:46:53.587511+0000","last_undegraded":"2023-08-17T17:46:53.587511+0000","last_fullsized":"2023-08-17T17:46:53.587511+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.569249+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:46:53.569249+0000","last_peered":"2023-08-17T17:46:53.569249+0000","last_clean":"2023-08-17T17:46:53.569249+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:46:53.569249+0000","last_undegraded":"2023-08-17T17:46:53.569249+0000","last_fullsized":"2023-08-17T17:46:53.569249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.72099999999999997,"5min":0.76400000000000001,"15min":0.80200000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.68899999999999995,"5min":0.82399999999999995,"15min":0.82899999999999996},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"min":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.28999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.81200000000000006},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.80000000000000004},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.56100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70499999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.503}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.751,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.435}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.46200000000000002},"min":{"1min":0.34000000000000002,"5min":0.32300000000000001,"15min":0.28599999999999998},"max":{"1min":0.63,"5min":0.80100000000000005,"15min":0.85499999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.26300000000000001},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.72999999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.437,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.70699999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.375},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72899999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67900000000000005,"5min":0.79900000000000004,"15min":1.0980000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52600000000000002,"15min":0.50700000000000001},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71299999999999997,"5min":0.79000000000000004,"15min":1.0609999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.377},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.30599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.751,"15min":0.751},"last":0.498},{"interface":"front","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.48499999999999999},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.026},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.42699999999999999,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.0740000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.34200000000000003},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52800000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.38200000000000001,"15min":0.36299999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54400000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.27300000000000002,"5min":0.25,"15min":0.22800000000000001},"max":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.72999999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.40300000000000002},"min":{"1min":0.29999999999999999,"5min":0.28399999999999997,"15min":0.219},"max":{"1min":0.61599999999999999,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.435,"15min":0.41899999999999998},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29799999999999999},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.66600000000000004},"last":0.318},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.80800000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.39000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":1.0129999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63400000000000001,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":1.331,"15min":1.331},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64200000000000002,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":0.89000000000000001,"5min":1.319,"15min":1.319},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63800000000000001,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":1.2929999999999999,"15min":1.345},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.39800000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.94499999999999995},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67000000000000004,"15min":0.64200000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.436,"15min":0.41199999999999998},"max":{"1min":0.88900000000000001,"5min":1.359,"15min":1.377},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36599999999999999,"15min":0.34799999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.28799999999999998,"5min":0.248,"15min":0.217},"max":{"1min":0.48399999999999999,"5min":0.58799999999999997,"15min":0.66200000000000003},"last":0.313}]},{"osd":2,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38300000000000001,"15min":0.36199999999999999},"min":{"1min":0.26900000000000002,"5min":0.23599999999999999,"15min":0.20300000000000001},"max":{"1min":0.51400000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.65200000000000002},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.58999999999999997,"15min":0.66200000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.40500000000000003},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.49299999999999999,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.998,"5min":0.998,"15min":1.337},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":0.90700000000000003,"15min":1.3300000000000001},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.96299999999999997,"15min":0.97199999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.462},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.391},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84199999999999997,"5min":0.93300000000000005,"15min":0.97299999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.997,"15min":1.544},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.246,"5min":0.219,"15min":0.20599999999999999},"max":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.81100000000000005},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.28599999999999998,"5min":0.247,"15min":0.221},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40100000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.70199999999999996},"last":0.378},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42399999999999999,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":0.54900000000000004,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41099999999999998},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40799999999999997,"15min":0.39400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.222},"max":{"1min":0.61699999999999999,"5min":0.629,"15min":0.629},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.65600000000000003,"15min":0.60899999999999999},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39000000000000001},"max":{"1min":0.82899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.67300000000000004,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.625,"15min":0.59999999999999998},"min":{"1min":0.47599999999999998,"5min":0.43099999999999999,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.495}]},{"osd":7,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.64100000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.63400000000000001},"min":{"1min":0.51600000000000001,"5min":0.46100000000000002,"15min":0.441},"max":{"1min":0.85399999999999998,"5min":0.874,"15min":1.0109999999999999},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32800000000000001,"15min":0.33300000000000002},"min":{"1min":0.248,"5min":0.221,"15min":0.191},"max":{"1min":0.40400000000000003,"5min":0.48699999999999999,"15min":0.69999999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.36699999999999999,"15min":0.37},"min":{"1min":0.251,"5min":0.224,"15min":0.224},"max":{"1min":0.496,"5min":0.60599999999999998,"15min":0.71799999999999997},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.215},"max":{"1min":0.48499999999999999,"5min":0.61099999999999999,"15min":0.73799999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.49099999999999999,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.26900000000000002,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.82299999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40699999999999997,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.59399999999999997,"5min":0.61699999999999999,"15min":0.71099999999999997},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":0.89000000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":2.1309999999999998},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38100000000000001},"max":{"1min":0.80200000000000005,"5min":0.86099999999999999,"15min":0.90100000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77100000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":0.91700000000000004,"15min":0.95299999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.83999999999999997,"5min":1.016,"15min":2.1669999999999998},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71899999999999997,"5min":0.83999999999999997,"15min":0.89100000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55500000000000005,"15min":0.53300000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.83199999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.78200000000000003,"15min":0.80900000000000005},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59199999999999997,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77200000000000002,"5min":0.82199999999999995,"15min":0.84799999999999998},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55300000000000005,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.80100000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.55700000000000005},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.47199999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.86399999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47599999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.53200000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.94899999999999995},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.375,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.82199999999999995,"15min":0.91900000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.877,"15min":1.056},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":331082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.32200000000000001,"15min":0.27700000000000002},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":1.2609999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.35599999999999998,"15min":0.31},"max":{"1min":0.71799999999999997,"5min":0.77900000000000003,"15min":1.1499999999999999},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.747,"15min":1.242},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":0.81100000000000005,"15min":1.1399999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.252},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.81100000000000005,"15min":1.274},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":1.179},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":0.78000000000000003,"15min":1.3080000000000001},"last":0.499}]},{"osd":4,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.75,"15min":1.0620000000000001},"last":0.44},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.51400000000000001},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.83899999999999997,"15min":1.0740000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.503,"15min":0.52500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":1.01},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.56100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.30099999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.1020000000000001},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.56999999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":1.038},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.755,"5min":0.79100000000000004,"15min":1.1279999999999999},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:46:59.860 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:46:59.859+0000 7f7835fd8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:47:01.338 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:47:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.462+0000 7f75c4d26700 1 Processor -- start 2023-08-17T17:47:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.462+0000 7f75c4d26700 1 -- start start 2023-08-17T17:47:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75c4d26700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f75c0154140 0x7f75c00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75c4d26700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c00a7c40 0x7f75c00c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75c4d26700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c0154520 con 0x7f75c00a8080 2023-08-17T17:47:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75c4d26700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c00c91e0 con 0x7f75c0154140 2023-08-17T17:47:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75c4d26700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00c94c0 con 0x7f75c00a7c40 2023-08-17T17:47:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bed9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f75c00a8080 0x7f75c00ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51588/0 (socket says 172.21.15.78:51588) 2023-08-17T17:47:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bed9d700 1 -- 172.21.15.78:0/1949739185 learned_addr learned my addr 172.21.15.78:0/1949739185 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:47:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102177663 0 0) 0x7f75c0154520 con 0x7f75c00a8080 2023-08-17T17:47:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a80033f0 con 0x7f75c00a8080 2023-08-17T17:47:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75be59c700 1 --2- 172.21.15.78:0/1949739185 >> v2:172.21.15.150:3300/0 conn(0x7f75c0154140 0x7f75c00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bdd9b700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c00a7c40 0x7f75c00c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3328911351 0 0) 0x7f75a80033f0 con 0x7f75c00a8080 2023-08-17T17:47:01.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c00a7c40 msgr2=0x7f75c00c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c00a7c40 0x7f75c00c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 >> v2:172.21.15.150:3300/0 conn(0x7f75c0154140 msgr2=0x7f75c00c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 --2- 172.21.15.78:0/1949739185 >> v2:172.21.15.150:3300/0 conn(0x7f75c0154140 0x7f75c00c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c00c97a0 con 0x7f75c00a8080 2023-08-17T17:47:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f75b80017f0 con 0x7f75c00a8080 2023-08-17T17:47:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 >> v1:172.21.15.78:6789/0 conn(0x7f75c00a8080 legacy=0x7f75c00ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75a80038e0 0x7f75a8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c00a7c40 0x7f75a8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8004b80 0x7f75a8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00c91e0 con 0x7f75a8004b80 2023-08-17T17:47:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00c94c0 con 0x7f75a80038e0 2023-08-17T17:47:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.463+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a800b8e0 con 0x7f75c00a7c40 2023-08-17T17:47:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bed9d700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8004b80 0x7f75a8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75be59c700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75a80038e0 0x7f75a8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bdd9b700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c00a7c40 0x7f75a8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bed9d700 1 -- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c00a7c40 msgr2=0x7f75a8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bed9d700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c00a7c40 0x7f75a8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bed9d700 1 -- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75a80038e0 msgr2=0x7f75a8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bed9d700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75a80038e0 0x7f75a8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bed9d700 1 -- 172.21.15.78:0/1949739185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a80033f0 con 0x7f75a8004b80 2023-08-17T17:47:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bed9d700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8004b80 0x7f75a8005000 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f75c00852c0 tx=0x7f75b8002210).ready entity=mon.0 client_cookie=aa258cc6e5e7423e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b8007de0 con 0x7f75a8004b80 2023-08-17T17:47:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b800ce00 con 0x7f75a8004b80 2023-08-17T17:47:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.464+0000 7f75bd59a700 1 -- 172.21.15.78:0/1949739185 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b8005d30 con 0x7f75a8004b80 2023-08-17T17:47:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.465+0000 7f75c4d26700 1 -- 172.21.15.78:0/1949739185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8004b80 msgr2=0x7f75a8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.465+0000 7f75c4d26700 1 --2- 172.21.15.78:0/1949739185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8004b80 0x7f75a8005000 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f75c00852c0 tx=0x7f75b8002210).stop 2023-08-17T17:47:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.465+0000 7f75bed9d700 1 -- 172.21.15.78:0/1949739185 reap_dead start 2023-08-17T17:47:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.465+0000 7f75c4d26700 1 -- 172.21.15.78:0/1949739185 shutdown_connections 2023-08-17T17:47:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.465+0000 7f75c4d26700 1 -- 172.21.15.78:0/1949739185 >> 172.21.15.78:0/1949739185 conn(0x7f75c0094510 msgr2=0x7f75c006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.465+0000 7f75c4d26700 1 -- 172.21.15.78:0/1949739185 shutdown_connections 2023-08-17T17:47:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.465+0000 7f75c4d26700 1 -- 172.21.15.78:0/1949739185 wait complete. 2023-08-17T17:47:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.466+0000 7f75c4d26700 1 Processor -- start 2023-08-17T17:47:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.466+0000 7f75c4d26700 1 -- start start 2023-08-17T17:47:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75c4d26700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75a8004b80 0x7f75c0063b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75c4d26700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c0150600 0x7f75c0147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75c4d26700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c0064000 0x7f75c0147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75c4d26700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c0148270 con 0x7f75c0150600 2023-08-17T17:47:01.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75c4d26700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c014f560 con 0x7f75a8004b80 2023-08-17T17:47:01.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75c4d26700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c014f840 con 0x7f75c0064000 2023-08-17T17:47:01.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bdd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c0150600 0x7f75c0147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bdd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c0150600 0x7f75c0147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46812/0 (socket says 172.21.15.78:46812) 2023-08-17T17:47:01.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bdd9b700 1 -- 172.21.15.78:0/1121315619 learned_addr learned my addr 172.21.15.78:0/1121315619 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:01.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75be59c700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75a8004b80 0x7f75c0063b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bed9d700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c0064000 0x7f75c0147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bdd9b700 1 -- 172.21.15.78:0/1121315619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c0064000 msgr2=0x7f75c0147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bdd9b700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c0064000 0x7f75c0147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bdd9b700 1 -- 172.21.15.78:0/1121315619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75a8004b80 msgr2=0x7f75c0063b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bdd9b700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75a8004b80 0x7f75c0063b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bdd9b700 1 -- 172.21.15.78:0/1121315619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c014fb20 con 0x7f75c0150600 2023-08-17T17:47:01.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bed9d700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c0064000 0x7f75c0147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:47:01.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75bdd9b700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c0150600 0x7f75c0147890 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f75b40119c0 tx=0x7f75b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:01.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75ae7fc700 1 -- 172.21.15.78:0/1121315619 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b400f8e0 con 0x7f75c0150600 2023-08-17T17:47:01.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75ae7fc700 1 -- 172.21.15.78:0/1121315619 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b400fa40 con 0x7f75c0150600 2023-08-17T17:47:01.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75c4d26700 1 -- 172.21.15.78:0/1121315619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c014fe00 con 0x7f75c0150600 2023-08-17T17:47:01.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75ae7fc700 1 -- 172.21.15.78:0/1121315619 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b400fe00 con 0x7f75c0150600 2023-08-17T17:47:01.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.467+0000 7f75c4d26700 1 -- 172.21.15.78:0/1121315619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c014e7f0 con 0x7f75c0150600 2023-08-17T17:47:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.468+0000 7f75c4d26700 1 -- 172.21.15.78:0/1121315619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c0047350 con 0x7f75c0150600 2023-08-17T17:47:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.469+0000 7f75ae7fc700 1 -- 172.21.15.78:0/1121315619 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f75b4024070 con 0x7f75c0150600 2023-08-17T17:47:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.469+0000 7f75ae7fc700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75a005ed90 0x7f75a0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.469+0000 7f75ae7fc700 1 -- 172.21.15.78:0/1121315619 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f75b407a660 con 0x7f75c0150600 2023-08-17T17:47:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.469+0000 7f75be59c700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75a005ed90 0x7f75a0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.469+0000 7f75be59c700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75a005ed90 0x7f75a0061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f75b0006d50 tx=0x7f75b0008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.473+0000 7f75ae7fc700 1 -- 172.21.15.78:0/1121315619 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75b404bc00 con 0x7f75c0150600 2023-08-17T17:47:01.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.636+0000 7f75c4d26700 1 -- 172.21.15.78:0/1121315619 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75c00ca320 con 0x7f75a005ed90 2023-08-17T17:47:01.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.645+0000 7f75ae7fc700 1 -- 172.21.15.78:0/1121315619 <== mgr.5568 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361268 (secure 0 0 0) 0x7f75c00ca320 con 0x7f75a005ed90 2023-08-17T17:47:01.650 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:47:01.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 -- 172.21.15.78:0/1121315619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75a005ed90 msgr2=0x7f75a0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75a005ed90 0x7f75a0061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f75b0006d50 tx=0x7f75b0008040).stop 2023-08-17T17:47:01.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 -- 172.21.15.78:0/1121315619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c0150600 msgr2=0x7f75c0147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c0150600 0x7f75c0147890 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f75b40119c0 tx=0x7f75b4009060).stop 2023-08-17T17:47:01.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 -- 172.21.15.78:0/1121315619 shutdown_connections 2023-08-17T17:47:01.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f75a005ed90 0x7f75a0061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c0064000 0x7f75c0147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75a8004b80 0x7f75c0063b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 --2- 172.21.15.78:0/1121315619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c0150600 0x7f75c0147890 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 -- 172.21.15.78:0/1121315619 >> 172.21.15.78:0/1121315619 conn(0x7f75c0094510 msgr2=0x7f75c00c76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:01.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 -- 172.21.15.78:0/1121315619 shutdown_connections 2023-08-17T17:47:01.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.649+0000 7f75c4d26700 1 -- 172.21.15.78:0/1121315619 wait complete. 2023-08-17T17:47:01.653 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:47:01.662 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-17T17:47:00.952359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2394688,"kb_used_data":5632,"kb_used_omap":0,"kb_used_meta":2388992,"kb_avail":752580032,"statfs":{"total":773094113280,"available":770641952768,"internally_reserved":0,"allocated":5767168,"data_stored":2764332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2446327808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14991174,"num_objects":-19,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-700,"num_write_kb":-15537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.585368"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.957037+0000","last_change":"2023-08-17T17:46:53.951698+0000","last_active":"2023-08-17T17:46:53.957037+0000","last_peered":"2023-08-17T17:46:53.957037+0000","last_clean":"2023-08-17T17:46:53.957037+0000","last_became_active":"2023-08-17T17:46:53.951444+0000","last_became_peered":"2023-08-17T17:46:53.951444+0000","last_unstale":"2023-08-17T17:46:53.957037+0000","last_undegraded":"2023-08-17T17:46:53.957037+0000","last_fullsized":"2023-08-17T17:46:53.957037+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"59'3","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.959014+0000","last_change":"2023-08-17T17:46:53.588790+0000","last_active":"2023-08-17T17:46:53.959014+0000","last_peered":"2023-08-17T17:46:53.959014+0000","last_clean":"2023-08-17T17:46:53.959014+0000","last_became_active":"2023-08-17T17:46:53.588320+0000","last_became_peered":"2023-08-17T17:46:53.588320+0000","last_unstale":"2023-08-17T17:46:53.959014+0000","last_undegraded":"2023-08-17T17:46:53.959014+0000","last_fullsized":"2023-08-17T17:46:53.959014+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.956672+0000","last_change":"2023-08-17T17:46:53.955666+0000","last_active":"2023-08-17T17:46:53.956672+0000","last_peered":"2023-08-17T17:46:53.956672+0000","last_clean":"2023-08-17T17:46:53.956672+0000","last_became_active":"2023-08-17T17:46:53.955387+0000","last_became_peered":"2023-08-17T17:46:53.955387+0000","last_unstale":"2023-08-17T17:46:53.956672+0000","last_undegraded":"2023-08-17T17:46:53.956672+0000","last_fullsized":"2023-08-17T17:46:53.956672+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.937347+0000","last_change":"2023-08-17T17:46:53.591003+0000","last_active":"2023-08-17T17:46:53.937347+0000","last_peered":"2023-08-17T17:46:53.937347+0000","last_clean":"2023-08-17T17:46:53.937347+0000","last_became_active":"2023-08-17T17:46:53.590718+0000","last_became_peered":"2023-08-17T17:46:53.590718+0000","last_unstale":"2023-08-17T17:46:53.937347+0000","last_undegraded":"2023-08-17T17:46:53.937347+0000","last_fullsized":"2023-08-17T17:46:53.937347+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961937+0000","last_change":"2023-08-17T17:46:53.956432+0000","last_active":"2023-08-17T17:46:53.961937+0000","last_peered":"2023-08-17T17:46:53.961937+0000","last_clean":"2023-08-17T17:46:53.961937+0000","last_became_active":"2023-08-17T17:46:53.956114+0000","last_became_peered":"2023-08-17T17:46:53.956114+0000","last_unstale":"2023-08-17T17:46:53.961937+0000","last_undegraded":"2023-08-17T17:46:53.961937+0000","last_fullsized":"2023-08-17T17:46:53.961937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.938241+0000","last_change":"2023-08-17T17:46:53.582491+0000","last_active":"2023-08-17T17:46:53.938241+0000","last_peered":"2023-08-17T17:46:53.938241+0000","last_clean":"2023-08-17T17:46:53.938241+0000","last_became_active":"2023-08-17T17:46:53.582209+0000","last_became_peered":"2023-08-17T17:46:53.582209+0000","last_unstale":"2023-08-17T17:46:53.938241+0000","last_undegraded":"2023-08-17T17:46:53.938241+0000","last_fullsized":"2023-08-17T17:46:53.938241+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961810+0000","last_change":"2023-08-17T17:46:53.958263+0000","last_active":"2023-08-17T17:46:53.961810+0000","last_peered":"2023-08-17T17:46:53.961810+0000","last_clean":"2023-08-17T17:46:53.961810+0000","last_became_active":"2023-08-17T17:46:53.958001+0000","last_became_peered":"2023-08-17T17:46:53.958001+0000","last_unstale":"2023-08-17T17:46:53.961810+0000","last_undegraded":"2023-08-17T17:46:53.961810+0000","last_fullsized":"2023-08-17T17:46:53.961810+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960467+0000","last_change":"2023-08-17T17:46:53.582713+0000","last_active":"2023-08-17T17:46:53.960467+0000","last_peered":"2023-08-17T17:46:53.960467+0000","last_clean":"2023-08-17T17:46:53.960467+0000","last_became_active":"2023-08-17T17:46:53.582461+0000","last_became_peered":"2023-08-17T17:46:53.582461+0000","last_unstale":"2023-08-17T17:46:53.960467+0000","last_undegraded":"2023-08-17T17:46:53.960467+0000","last_fullsized":"2023-08-17T17:46:53.960467+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960798+0000","last_change":"2023-08-17T17:46:53.950845+0000","last_active":"2023-08-17T17:46:53.960798+0000","last_peered":"2023-08-17T17:46:53.960798+0000","last_clean":"2023-08-17T17:46:53.960798+0000","last_became_active":"2023-08-17T17:46:53.950610+0000","last_became_peered":"2023-08-17T17:46:53.950610+0000","last_unstale":"2023-08-17T17:46:53.960798+0000","last_undegraded":"2023-08-17T17:46:53.960798+0000","last_fullsized":"2023-08-17T17:46:53.960798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.959777+0000","last_change":"2023-08-17T17:46:53.592771+0000","last_active":"2023-08-17T17:46:53.959777+0000","last_peered":"2023-08-17T17:46:53.959777+0000","last_clean":"2023-08-17T17:46:53.959777+0000","last_became_active":"2023-08-17T17:46:53.592489+0000","last_became_peered":"2023-08-17T17:46:53.592489+0000","last_unstale":"2023-08-17T17:46:53.959777+0000","last_undegraded":"2023-08-17T17:46:53.959777+0000","last_fullsized":"2023-08-17T17:46:53.959777+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.957445+0000","last_change":"2023-08-17T17:46:53.952251+0000","last_active":"2023-08-17T17:46:53.957445+0000","last_peered":"2023-08-17T17:46:53.957445+0000","last_clean":"2023-08-17T17:46:53.957445+0000","last_became_active":"2023-08-17T17:46:53.951984+0000","last_became_peered":"2023-08-17T17:46:53.951984+0000","last_unstale":"2023-08-17T17:46:53.957445+0000","last_undegraded":"2023-08-17T17:46:53.957445+0000","last_fullsized":"2023-08-17T17:46:53.957445+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.957886+0000","last_change":"2023-08-17T17:46:53.587114+0000","last_active":"2023-08-17T17:46:53.957886+0000","last_peered":"2023-08-17T17:46:53.957886+0000","last_clean":"2023-08-17T17:46:53.957886+0000","last_became_active":"2023-08-17T17:46:53.586795+0000","last_became_peered":"2023-08-17T17:46:53.586795+0000","last_unstale":"2023-08-17T17:46:53.957886+0000","last_undegraded":"2023-08-17T17:46:53.957886+0000","last_fullsized":"2023-08-17T17:46:53.957886+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.957101+0000","last_change":"2023-08-17T17:46:53.951051+0000","last_active":"2023-08-17T17:46:53.957101+0000","last_peered":"2023-08-17T17:46:53.957101+0000","last_clean":"2023-08-17T17:46:53.957101+0000","last_became_active":"2023-08-17T17:46:53.950780+0000","last_became_peered":"2023-08-17T17:46:53.950780+0000","last_unstale":"2023-08-17T17:46:53.957101+0000","last_undegraded":"2023-08-17T17:46:53.957101+0000","last_fullsized":"2023-08-17T17:46:53.957101+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.944889+0000","last_change":"2023-08-17T17:46:53.594476+0000","last_active":"2023-08-17T17:46:53.944889+0000","last_peered":"2023-08-17T17:46:53.944889+0000","last_clean":"2023-08-17T17:46:53.944889+0000","last_became_active":"2023-08-17T17:46:53.594195+0000","last_became_peered":"2023-08-17T17:46:53.594195+0000","last_unstale":"2023-08-17T17:46:53.944889+0000","last_undegraded":"2023-08-17T17:46:53.944889+0000","last_fullsized":"2023-08-17T17:46:53.944889+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961241+0000","last_change":"2023-08-17T17:46:53.957188+0000","last_active":"2023-08-17T17:46:53.961241+0000","last_peered":"2023-08-17T17:46:53.961241+0000","last_clean":"2023-08-17T17:46:53.961241+0000","last_became_active":"2023-08-17T17:46:53.955290+0000","last_became_peered":"2023-08-17T17:46:53.955290+0000","last_unstale":"2023-08-17T17:46:53.961241+0000","last_undegraded":"2023-08-17T17:46:53.961241+0000","last_fullsized":"2023-08-17T17:46:53.961241+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.947781+0000","last_change":"2023-08-17T17:46:53.584269+0000","last_active":"2023-08-17T17:46:53.947781+0000","last_peered":"2023-08-17T17:46:53.947781+0000","last_clean":"2023-08-17T17:46:53.947781+0000","last_became_active":"2023-08-17T17:46:53.583408+0000","last_became_peered":"2023-08-17T17:46:53.583408+0000","last_unstale":"2023-08-17T17:46:53.947781+0000","last_undegraded":"2023-08-17T17:46:53.947781+0000","last_fullsized":"2023-08-17T17:46:53.947781+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961449+0000","last_change":"2023-08-17T17:46:53.957105+0000","last_active":"2023-08-17T17:46:53.961449+0000","last_peered":"2023-08-17T17:46:53.961449+0000","last_clean":"2023-08-17T17:46:53.961449+0000","last_became_active":"2023-08-17T17:46:53.956639+0000","last_became_peered":"2023-08-17T17:46:53.956639+0000","last_unstale":"2023-08-17T17:46:53.961449+0000","last_undegraded":"2023-08-17T17:46:53.961449+0000","last_fullsized":"2023-08-17T17:46:53.961449+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.949377+0000","last_change":"2023-08-17T17:46:53.585244+0000","last_active":"2023-08-17T17:46:53.949377+0000","last_peered":"2023-08-17T17:46:53.949377+0000","last_clean":"2023-08-17T17:46:53.949377+0000","last_became_active":"2023-08-17T17:46:53.584478+0000","last_became_peered":"2023-08-17T17:46:53.584478+0000","last_unstale":"2023-08-17T17:46:53.949377+0000","last_undegraded":"2023-08-17T17:46:53.949377+0000","last_fullsized":"2023-08-17T17:46:53.949377+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.963230+0000","last_change":"2023-08-17T17:46:53.960343+0000","last_active":"2023-08-17T17:46:53.963230+0000","last_peered":"2023-08-17T17:46:53.963230+0000","last_clean":"2023-08-17T17:46:53.963230+0000","last_became_active":"2023-08-17T17:46:53.960058+0000","last_became_peered":"2023-08-17T17:46:53.960058+0000","last_unstale":"2023-08-17T17:46:53.963230+0000","last_undegraded":"2023-08-17T17:46:53.963230+0000","last_fullsized":"2023-08-17T17:46:53.963230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.949117+0000","last_change":"2023-08-17T17:46:53.585467+0000","last_active":"2023-08-17T17:46:53.949117+0000","last_peered":"2023-08-17T17:46:53.949117+0000","last_clean":"2023-08-17T17:46:53.949117+0000","last_became_active":"2023-08-17T17:46:53.585163+0000","last_became_peered":"2023-08-17T17:46:53.585163+0000","last_unstale":"2023-08-17T17:46:53.949117+0000","last_undegraded":"2023-08-17T17:46:53.949117+0000","last_fullsized":"2023-08-17T17:46:53.949117+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.957257+0000","last_change":"2023-08-17T17:46:53.949903+0000","last_active":"2023-08-17T17:46:53.957257+0000","last_peered":"2023-08-17T17:46:53.957257+0000","last_clean":"2023-08-17T17:46:53.957257+0000","last_became_active":"2023-08-17T17:46:53.949624+0000","last_became_peered":"2023-08-17T17:46:53.949624+0000","last_unstale":"2023-08-17T17:46:53.957257+0000","last_undegraded":"2023-08-17T17:46:53.957257+0000","last_fullsized":"2023-08-17T17:46:53.957257+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.947813+0000","last_change":"2023-08-17T17:46:53.582814+0000","last_active":"2023-08-17T17:46:53.947813+0000","last_peered":"2023-08-17T17:46:53.947813+0000","last_clean":"2023-08-17T17:46:53.947813+0000","last_became_active":"2023-08-17T17:46:53.582554+0000","last_became_peered":"2023-08-17T17:46:53.582554+0000","last_unstale":"2023-08-17T17:46:53.947813+0000","last_undegraded":"2023-08-17T17:46:53.947813+0000","last_fullsized":"2023-08-17T17:46:53.947813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.957502+0000","last_change":"2023-08-17T17:46:53.950167+0000","last_active":"2023-08-17T17:46:53.957502+0000","last_peered":"2023-08-17T17:46:53.957502+0000","last_clean":"2023-08-17T17:46:53.957502+0000","last_became_active":"2023-08-17T17:46:53.949875+0000","last_became_peered":"2023-08-17T17:46:53.949875+0000","last_unstale":"2023-08-17T17:46:53.957502+0000","last_undegraded":"2023-08-17T17:46:53.957502+0000","last_fullsized":"2023-08-17T17:46:53.957502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"59'4","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.963185+0000","last_change":"2023-08-17T17:46:53.582218+0000","last_active":"2023-08-17T17:46:53.963185+0000","last_peered":"2023-08-17T17:46:53.963185+0000","last_clean":"2023-08-17T17:46:53.963185+0000","last_became_active":"2023-08-17T17:46:53.581840+0000","last_became_peered":"2023-08-17T17:46:53.581840+0000","last_unstale":"2023-08-17T17:46:53.963185+0000","last_undegraded":"2023-08-17T17:46:53.963185+0000","last_fullsized":"2023-08-17T17:46:53.963185+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.962570+0000","last_change":"2023-08-17T17:46:53.961323+0000","last_active":"2023-08-17T17:46:53.962570+0000","last_peered":"2023-08-17T17:46:53.962570+0000","last_clean":"2023-08-17T17:46:53.962570+0000","last_became_active":"2023-08-17T17:46:53.961038+0000","last_became_peered":"2023-08-17T17:46:53.961038+0000","last_unstale":"2023-08-17T17:46:53.962570+0000","last_undegraded":"2023-08-17T17:46:53.962570+0000","last_fullsized":"2023-08-17T17:46:53.962570+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.958618+0000","last_change":"2023-08-17T17:46:53.591437+0000","last_active":"2023-08-17T17:46:53.958618+0000","last_peered":"2023-08-17T17:46:53.958618+0000","last_clean":"2023-08-17T17:46:53.958618+0000","last_became_active":"2023-08-17T17:46:53.591145+0000","last_became_peered":"2023-08-17T17:46:53.591145+0000","last_unstale":"2023-08-17T17:46:53.958618+0000","last_undegraded":"2023-08-17T17:46:53.958618+0000","last_fullsized":"2023-08-17T17:46:53.958618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.963213+0000","last_change":"2023-08-17T17:46:53.961264+0000","last_active":"2023-08-17T17:46:53.963213+0000","last_peered":"2023-08-17T17:46:53.963213+0000","last_clean":"2023-08-17T17:46:53.963213+0000","last_became_active":"2023-08-17T17:46:53.960125+0000","last_became_peered":"2023-08-17T17:46:53.960125+0000","last_unstale":"2023-08-17T17:46:53.963213+0000","last_undegraded":"2023-08-17T17:46:53.963213+0000","last_fullsized":"2023-08-17T17:46:53.963213+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.948863+0000","last_change":"2023-08-17T17:46:53.586078+0000","last_active":"2023-08-17T17:46:53.948863+0000","last_peered":"2023-08-17T17:46:53.948863+0000","last_clean":"2023-08-17T17:46:53.948863+0000","last_became_active":"2023-08-17T17:46:53.585831+0000","last_became_peered":"2023-08-17T17:46:53.585831+0000","last_unstale":"2023-08-17T17:46:53.948863+0000","last_undegraded":"2023-08-17T17:46:53.948863+0000","last_fullsized":"2023-08-17T17:46:53.948863+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.956646+0000","last_change":"2023-08-17T17:46:53.955863+0000","last_active":"2023-08-17T17:46:53.956646+0000","last_peered":"2023-08-17T17:46:53.956646+0000","last_clean":"2023-08-17T17:46:53.956646+0000","last_became_active":"2023-08-17T17:46:53.955552+0000","last_became_peered":"2023-08-17T17:46:53.955552+0000","last_unstale":"2023-08-17T17:46:53.956646+0000","last_undegraded":"2023-08-17T17:46:53.956646+0000","last_fullsized":"2023-08-17T17:46:53.956646+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.939627+0000","last_change":"2023-08-17T17:46:53.575072+0000","last_active":"2023-08-17T17:46:53.939627+0000","last_peered":"2023-08-17T17:46:53.939627+0000","last_clean":"2023-08-17T17:46:53.939627+0000","last_became_active":"2023-08-17T17:46:53.574793+0000","last_became_peered":"2023-08-17T17:46:53.574793+0000","last_unstale":"2023-08-17T17:46:53.939627+0000","last_undegraded":"2023-08-17T17:46:53.939627+0000","last_fullsized":"2023-08-17T17:46:53.939627+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.958876+0000","last_change":"2023-08-17T17:46:53.954451+0000","last_active":"2023-08-17T17:46:53.958876+0000","last_peered":"2023-08-17T17:46:53.958876+0000","last_clean":"2023-08-17T17:46:53.958876+0000","last_became_active":"2023-08-17T17:46:53.954173+0000","last_became_peered":"2023-08-17T17:46:53.954173+0000","last_unstale":"2023-08-17T17:46:53.958876+0000","last_undegraded":"2023-08-17T17:46:53.958876+0000","last_fullsized":"2023-08-17T17:46:53.958876+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"59'4","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960704+0000","last_change":"2023-08-17T17:46:53.592156+0000","last_active":"2023-08-17T17:46:53.960704+0000","last_peered":"2023-08-17T17:46:53.960704+0000","last_clean":"2023-08-17T17:46:53.960704+0000","last_became_active":"2023-08-17T17:46:53.591901+0000","last_became_peered":"2023-08-17T17:46:53.591901+0000","last_unstale":"2023-08-17T17:46:53.960704+0000","last_undegraded":"2023-08-17T17:46:53.960704+0000","last_fullsized":"2023-08-17T17:46:53.960704+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.953814+0000","last_change":"2023-08-17T17:46:53.943829+0000","last_active":"2023-08-17T17:46:53.953814+0000","last_peered":"2023-08-17T17:46:53.953814+0000","last_clean":"2023-08-17T17:46:53.953814+0000","last_became_active":"2023-08-17T17:46:53.943505+0000","last_became_peered":"2023-08-17T17:46:53.943505+0000","last_unstale":"2023-08-17T17:46:53.953814+0000","last_undegraded":"2023-08-17T17:46:53.953814+0000","last_fullsized":"2023-08-17T17:46:53.953814+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.939803+0000","last_change":"2023-08-17T17:46:53.580728+0000","last_active":"2023-08-17T17:46:53.939803+0000","last_peered":"2023-08-17T17:46:53.939803+0000","last_clean":"2023-08-17T17:46:53.939803+0000","last_became_active":"2023-08-17T17:46:53.580452+0000","last_became_peered":"2023-08-17T17:46:53.580452+0000","last_unstale":"2023-08-17T17:46:53.939803+0000","last_undegraded":"2023-08-17T17:46:53.939803+0000","last_fullsized":"2023-08-17T17:46:53.939803+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.963263+0000","last_change":"2023-08-17T17:46:53.960482+0000","last_active":"2023-08-17T17:46:53.963263+0000","last_peered":"2023-08-17T17:46:53.963263+0000","last_clean":"2023-08-17T17:46:53.963263+0000","last_became_active":"2023-08-17T17:46:53.960213+0000","last_became_peered":"2023-08-17T17:46:53.960213+0000","last_unstale":"2023-08-17T17:46:53.963263+0000","last_undegraded":"2023-08-17T17:46:53.963263+0000","last_fullsized":"2023-08-17T17:46:53.963263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.938316+0000","last_change":"2023-08-17T17:46:53.592847+0000","last_active":"2023-08-17T17:46:53.938316+0000","last_peered":"2023-08-17T17:46:53.938316+0000","last_clean":"2023-08-17T17:46:53.938316+0000","last_became_active":"2023-08-17T17:46:53.592477+0000","last_became_peered":"2023-08-17T17:46:53.592477+0000","last_unstale":"2023-08-17T17:46:53.938316+0000","last_undegraded":"2023-08-17T17:46:53.938316+0000","last_fullsized":"2023-08-17T17:46:53.938316+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.956666+0000","last_change":"2023-08-17T17:46:53.954736+0000","last_active":"2023-08-17T17:46:53.956666+0000","last_peered":"2023-08-17T17:46:53.956666+0000","last_clean":"2023-08-17T17:46:53.956666+0000","last_became_active":"2023-08-17T17:46:53.954424+0000","last_became_peered":"2023-08-17T17:46:53.954424+0000","last_unstale":"2023-08-17T17:46:53.956666+0000","last_undegraded":"2023-08-17T17:46:53.956666+0000","last_fullsized":"2023-08-17T17:46:53.956666+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961929+0000","last_change":"2023-08-17T17:46:53.590998+0000","last_active":"2023-08-17T17:46:53.961929+0000","last_peered":"2023-08-17T17:46:53.961929+0000","last_clean":"2023-08-17T17:46:53.961929+0000","last_became_active":"2023-08-17T17:46:53.590681+0000","last_became_peered":"2023-08-17T17:46:53.590681+0000","last_unstale":"2023-08-17T17:46:53.961929+0000","last_undegraded":"2023-08-17T17:46:53.961929+0000","last_fullsized":"2023-08-17T17:46:53.961929+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.957211+0000","last_change":"2023-08-17T17:46:53.953409+0000","last_active":"2023-08-17T17:46:53.957211+0000","last_peered":"2023-08-17T17:46:53.957211+0000","last_clean":"2023-08-17T17:46:53.957211+0000","last_became_active":"2023-08-17T17:46:53.953188+0000","last_became_peered":"2023-08-17T17:46:53.953188+0000","last_unstale":"2023-08-17T17:46:53.957211+0000","last_undegraded":"2023-08-17T17:46:53.957211+0000","last_fullsized":"2023-08-17T17:46:53.957211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.939812+0000","last_change":"2023-08-17T17:46:53.593024+0000","last_active":"2023-08-17T17:46:53.939812+0000","last_peered":"2023-08-17T17:46:53.939812+0000","last_clean":"2023-08-17T17:46:53.939812+0000","last_became_active":"2023-08-17T17:46:53.592759+0000","last_became_peered":"2023-08-17T17:46:53.592759+0000","last_unstale":"2023-08-17T17:46:53.939812+0000","last_undegraded":"2023-08-17T17:46:53.939812+0000","last_fullsized":"2023-08-17T17:46:53.939812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.956112+0000","last_change":"2023-08-17T17:46:53.954348+0000","last_active":"2023-08-17T17:46:53.956112+0000","last_peered":"2023-08-17T17:46:53.956112+0000","last_clean":"2023-08-17T17:46:53.956112+0000","last_became_active":"2023-08-17T17:46:53.954063+0000","last_became_peered":"2023-08-17T17:46:53.954063+0000","last_unstale":"2023-08-17T17:46:53.956112+0000","last_undegraded":"2023-08-17T17:46:53.956112+0000","last_fullsized":"2023-08-17T17:46:53.956112+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960655+0000","last_change":"2023-08-17T17:46:53.577716+0000","last_active":"2023-08-17T17:46:53.960655+0000","last_peered":"2023-08-17T17:46:53.960655+0000","last_clean":"2023-08-17T17:46:53.960655+0000","last_became_active":"2023-08-17T17:46:53.576999+0000","last_became_peered":"2023-08-17T17:46:53.576999+0000","last_unstale":"2023-08-17T17:46:53.960655+0000","last_undegraded":"2023-08-17T17:46:53.960655+0000","last_fullsized":"2023-08-17T17:46:53.960655+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.962793+0000","last_change":"2023-08-17T17:46:53.956050+0000","last_active":"2023-08-17T17:46:53.962793+0000","last_peered":"2023-08-17T17:46:53.962793+0000","last_clean":"2023-08-17T17:46:53.962793+0000","last_became_active":"2023-08-17T17:46:53.955689+0000","last_became_peered":"2023-08-17T17:46:53.955689+0000","last_unstale":"2023-08-17T17:46:53.962793+0000","last_undegraded":"2023-08-17T17:46:53.962793+0000","last_fullsized":"2023-08-17T17:46:53.962793+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.948799+0000","last_change":"2023-08-17T17:46:53.583067+0000","last_active":"2023-08-17T17:46:53.948799+0000","last_peered":"2023-08-17T17:46:53.948799+0000","last_clean":"2023-08-17T17:46:53.948799+0000","last_became_active":"2023-08-17T17:46:53.582373+0000","last_became_peered":"2023-08-17T17:46:53.582373+0000","last_unstale":"2023-08-17T17:46:53.948799+0000","last_undegraded":"2023-08-17T17:46:53.948799+0000","last_fullsized":"2023-08-17T17:46:53.948799+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961059+0000","last_change":"2023-08-17T17:46:53.955867+0000","last_active":"2023-08-17T17:46:53.961059+0000","last_peered":"2023-08-17T17:46:53.961059+0000","last_clean":"2023-08-17T17:46:53.961059+0000","last_became_active":"2023-08-17T17:46:53.955610+0000","last_became_peered":"2023-08-17T17:46:53.955610+0000","last_unstale":"2023-08-17T17:46:53.961059+0000","last_undegraded":"2023-08-17T17:46:53.961059+0000","last_fullsized":"2023-08-17T17:46:53.961059+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.941961+0000","last_change":"2023-08-17T17:46:53.587208+0000","last_active":"2023-08-17T17:46:53.941961+0000","last_peered":"2023-08-17T17:46:53.941961+0000","last_clean":"2023-08-17T17:46:53.941961+0000","last_became_active":"2023-08-17T17:46:53.586922+0000","last_became_peered":"2023-08-17T17:46:53.586922+0000","last_unstale":"2023-08-17T17:46:53.941961+0000","last_undegraded":"2023-08-17T17:46:53.941961+0000","last_fullsized":"2023-08-17T17:46:53.941961+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.956656+0000","last_change":"2023-08-17T17:46:53.952664+0000","last_active":"2023-08-17T17:46:53.956656+0000","last_peered":"2023-08-17T17:46:53.956656+0000","last_clean":"2023-08-17T17:46:53.956656+0000","last_became_active":"2023-08-17T17:46:53.952430+0000","last_became_peered":"2023-08-17T17:46:53.952430+0000","last_unstale":"2023-08-17T17:46:53.956656+0000","last_undegraded":"2023-08-17T17:46:53.956656+0000","last_fullsized":"2023-08-17T17:46:53.956656+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.943030+0000","last_change":"2023-08-17T17:46:53.583496+0000","last_active":"2023-08-17T17:46:53.943030+0000","last_peered":"2023-08-17T17:46:53.943030+0000","last_clean":"2023-08-17T17:46:53.943030+0000","last_became_active":"2023-08-17T17:46:53.583200+0000","last_became_peered":"2023-08-17T17:46:53.583200+0000","last_unstale":"2023-08-17T17:46:53.943030+0000","last_undegraded":"2023-08-17T17:46:53.943030+0000","last_fullsized":"2023-08-17T17:46:53.943030+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.962886+0000","last_change":"2023-08-17T17:46:53.960302+0000","last_active":"2023-08-17T17:46:53.962886+0000","last_peered":"2023-08-17T17:46:53.962886+0000","last_clean":"2023-08-17T17:46:53.962886+0000","last_became_active":"2023-08-17T17:46:53.959375+0000","last_became_peered":"2023-08-17T17:46:53.959375+0000","last_unstale":"2023-08-17T17:46:53.962886+0000","last_undegraded":"2023-08-17T17:46:53.962886+0000","last_fullsized":"2023-08-17T17:46:53.962886+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.946196+0000","last_change":"2023-08-17T17:46:53.591647+0000","last_active":"2023-08-17T17:46:53.946196+0000","last_peered":"2023-08-17T17:46:53.946196+0000","last_clean":"2023-08-17T17:46:53.946196+0000","last_became_active":"2023-08-17T17:46:53.591369+0000","last_became_peered":"2023-08-17T17:46:53.591369+0000","last_unstale":"2023-08-17T17:46:53.946196+0000","last_undegraded":"2023-08-17T17:46:53.946196+0000","last_fullsized":"2023-08-17T17:46:53.946196+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.957782+0000","last_change":"2023-08-17T17:46:53.953424+0000","last_active":"2023-08-17T17:46:53.957782+0000","last_peered":"2023-08-17T17:46:53.957782+0000","last_clean":"2023-08-17T17:46:53.957782+0000","last_became_active":"2023-08-17T17:46:53.952809+0000","last_became_peered":"2023-08-17T17:46:53.952809+0000","last_unstale":"2023-08-17T17:46:53.957782+0000","last_undegraded":"2023-08-17T17:46:53.957782+0000","last_fullsized":"2023-08-17T17:46:53.957782+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.939803+0000","last_change":"2023-08-17T17:46:53.591137+0000","last_active":"2023-08-17T17:46:53.939803+0000","last_peered":"2023-08-17T17:46:53.939803+0000","last_clean":"2023-08-17T17:46:53.939803+0000","last_became_active":"2023-08-17T17:46:53.590561+0000","last_became_peered":"2023-08-17T17:46:53.590561+0000","last_unstale":"2023-08-17T17:46:53.939803+0000","last_undegraded":"2023-08-17T17:46:53.939803+0000","last_fullsized":"2023-08-17T17:46:53.939803+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960793+0000","last_change":"2023-08-17T17:46:53.955485+0000","last_active":"2023-08-17T17:46:53.960793+0000","last_peered":"2023-08-17T17:46:53.960793+0000","last_clean":"2023-08-17T17:46:53.960793+0000","last_became_active":"2023-08-17T17:46:53.955212+0000","last_became_peered":"2023-08-17T17:46:53.955212+0000","last_unstale":"2023-08-17T17:46:53.960793+0000","last_undegraded":"2023-08-17T17:46:53.960793+0000","last_fullsized":"2023-08-17T17:46:53.960793+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.938897+0000","last_change":"2023-08-17T17:46:53.578788+0000","last_active":"2023-08-17T17:46:53.938897+0000","last_peered":"2023-08-17T17:46:53.938897+0000","last_clean":"2023-08-17T17:46:53.938897+0000","last_became_active":"2023-08-17T17:46:53.578283+0000","last_became_peered":"2023-08-17T17:46:53.578283+0000","last_unstale":"2023-08-17T17:46:53.938897+0000","last_undegraded":"2023-08-17T17:46:53.938897+0000","last_fullsized":"2023-08-17T17:46:53.938897+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.954453+0000","last_change":"2023-08-17T17:46:53.952105+0000","last_active":"2023-08-17T17:46:53.954453+0000","last_peered":"2023-08-17T17:46:53.954453+0000","last_clean":"2023-08-17T17:46:53.954453+0000","last_became_active":"2023-08-17T17:46:53.951761+0000","last_became_peered":"2023-08-17T17:46:53.951761+0000","last_unstale":"2023-08-17T17:46:53.954453+0000","last_undegraded":"2023-08-17T17:46:53.954453+0000","last_fullsized":"2023-08-17T17:46:53.954453+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.937979+0000","last_change":"2023-08-17T17:46:53.582134+0000","last_active":"2023-08-17T17:46:53.937979+0000","last_peered":"2023-08-17T17:46:53.937979+0000","last_clean":"2023-08-17T17:46:53.937979+0000","last_became_active":"2023-08-17T17:46:53.581821+0000","last_became_peered":"2023-08-17T17:46:53.581821+0000","last_unstale":"2023-08-17T17:46:53.937979+0000","last_undegraded":"2023-08-17T17:46:53.937979+0000","last_fullsized":"2023-08-17T17:46:53.937979+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960009+0000","last_change":"2023-08-17T17:46:53.957891+0000","last_active":"2023-08-17T17:46:53.960009+0000","last_peered":"2023-08-17T17:46:53.960009+0000","last_clean":"2023-08-17T17:46:53.960009+0000","last_became_active":"2023-08-17T17:46:53.957442+0000","last_became_peered":"2023-08-17T17:46:53.957442+0000","last_unstale":"2023-08-17T17:46:53.960009+0000","last_undegraded":"2023-08-17T17:46:53.960009+0000","last_fullsized":"2023-08-17T17:46:53.960009+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.944219+0000","last_change":"2023-08-17T17:46:53.581919+0000","last_active":"2023-08-17T17:46:53.944219+0000","last_peered":"2023-08-17T17:46:53.944219+0000","last_clean":"2023-08-17T17:46:53.944219+0000","last_became_active":"2023-08-17T17:46:53.581615+0000","last_became_peered":"2023-08-17T17:46:53.581615+0000","last_unstale":"2023-08-17T17:46:53.944219+0000","last_undegraded":"2023-08-17T17:46:53.944219+0000","last_fullsized":"2023-08-17T17:46:53.944219+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961113+0000","last_change":"2023-08-17T17:46:53.953799+0000","last_active":"2023-08-17T17:46:53.961113+0000","last_peered":"2023-08-17T17:46:53.961113+0000","last_clean":"2023-08-17T17:46:53.961113+0000","last_became_active":"2023-08-17T17:46:53.953549+0000","last_became_peered":"2023-08-17T17:46:53.953549+0000","last_unstale":"2023-08-17T17:46:53.961113+0000","last_undegraded":"2023-08-17T17:46:53.961113+0000","last_fullsized":"2023-08-17T17:46:53.961113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.938374+0000","last_change":"2023-08-17T17:46:53.587221+0000","last_active":"2023-08-17T17:46:53.938374+0000","last_peered":"2023-08-17T17:46:53.938374+0000","last_clean":"2023-08-17T17:46:53.938374+0000","last_became_active":"2023-08-17T17:46:53.586901+0000","last_became_peered":"2023-08-17T17:46:53.586901+0000","last_unstale":"2023-08-17T17:46:53.938374+0000","last_undegraded":"2023-08-17T17:46:53.938374+0000","last_fullsized":"2023-08-17T17:46:53.938374+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.958511+0000","last_change":"2023-08-17T17:46:53.955949+0000","last_active":"2023-08-17T17:46:53.958511+0000","last_peered":"2023-08-17T17:46:53.958511+0000","last_clean":"2023-08-17T17:46:53.958511+0000","last_became_active":"2023-08-17T17:46:53.955657+0000","last_became_peered":"2023-08-17T17:46:53.955657+0000","last_unstale":"2023-08-17T17:46:53.958511+0000","last_undegraded":"2023-08-17T17:46:53.958511+0000","last_fullsized":"2023-08-17T17:46:53.958511+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.939520+0000","last_change":"2023-08-17T17:46:53.579836+0000","last_active":"2023-08-17T17:46:53.939520+0000","last_peered":"2023-08-17T17:46:53.939520+0000","last_clean":"2023-08-17T17:46:53.939520+0000","last_became_active":"2023-08-17T17:46:53.579544+0000","last_became_peered":"2023-08-17T17:46:53.579544+0000","last_unstale":"2023-08-17T17:46:53.939520+0000","last_undegraded":"2023-08-17T17:46:53.939520+0000","last_fullsized":"2023-08-17T17:46:53.939520+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.963266+0000","last_change":"2023-08-17T17:46:53.962313+0000","last_active":"2023-08-17T17:46:53.963266+0000","last_peered":"2023-08-17T17:46:53.963266+0000","last_clean":"2023-08-17T17:46:53.963266+0000","last_became_active":"2023-08-17T17:46:53.962069+0000","last_became_peered":"2023-08-17T17:46:53.962069+0000","last_unstale":"2023-08-17T17:46:53.963266+0000","last_undegraded":"2023-08-17T17:46:53.963266+0000","last_fullsized":"2023-08-17T17:46:53.963266+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.939302+0000","last_change":"2023-08-17T17:46:53.583210+0000","last_active":"2023-08-17T17:46:53.939302+0000","last_peered":"2023-08-17T17:46:53.939302+0000","last_clean":"2023-08-17T17:46:53.939302+0000","last_became_active":"2023-08-17T17:46:53.583036+0000","last_became_peered":"2023-08-17T17:46:53.583036+0000","last_unstale":"2023-08-17T17:46:53.939302+0000","last_undegraded":"2023-08-17T17:46:53.939302+0000","last_fullsized":"2023-08-17T17:46:53.939302+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.963396+0000","last_change":"2023-08-17T17:46:53.962113+0000","last_active":"2023-08-17T17:46:53.963396+0000","last_peered":"2023-08-17T17:46:53.963396+0000","last_clean":"2023-08-17T17:46:53.963396+0000","last_became_active":"2023-08-17T17:46:53.961818+0000","last_became_peered":"2023-08-17T17:46:53.961818+0000","last_unstale":"2023-08-17T17:46:53.963396+0000","last_undegraded":"2023-08-17T17:46:53.963396+0000","last_fullsized":"2023-08-17T17:46:53.963396+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.958508+0000","last_change":"2023-08-17T17:46:53.574238+0000","last_active":"2023-08-17T17:46:53.958508+0000","last_peered":"2023-08-17T17:46:53.958508+0000","last_clean":"2023-08-17T17:46:53.958508+0000","last_became_active":"2023-08-17T17:46:53.573880+0000","last_became_peered":"2023-08-17T17:46:53.573880+0000","last_unstale":"2023-08-17T17:46:53.958508+0000","last_undegraded":"2023-08-17T17:46:53.958508+0000","last_fullsized":"2023-08-17T17:46:53.958508+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960436+0000","last_change":"2023-08-17T17:46:53.952476+0000","last_active":"2023-08-17T17:46:53.960436+0000","last_peered":"2023-08-17T17:46:53.960436+0000","last_clean":"2023-08-17T17:46:53.960436+0000","last_became_active":"2023-08-17T17:46:53.950640+0000","last_became_peered":"2023-08-17T17:46:53.950640+0000","last_unstale":"2023-08-17T17:46:53.960436+0000","last_undegraded":"2023-08-17T17:46:53.960436+0000","last_fullsized":"2023-08-17T17:46:53.960436+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.958618+0000","last_change":"2023-08-17T17:46:53.588046+0000","last_active":"2023-08-17T17:46:53.958618+0000","last_peered":"2023-08-17T17:46:53.958618+0000","last_clean":"2023-08-17T17:46:53.958618+0000","last_became_active":"2023-08-17T17:46:53.587776+0000","last_became_peered":"2023-08-17T17:46:53.587776+0000","last_unstale":"2023-08-17T17:46:53.958618+0000","last_undegraded":"2023-08-17T17:46:53.958618+0000","last_fullsized":"2023-08-17T17:46:53.958618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.956056+0000","last_change":"2023-08-17T17:46:53.953330+0000","last_active":"2023-08-17T17:46:53.956056+0000","last_peered":"2023-08-17T17:46:53.956056+0000","last_clean":"2023-08-17T17:46:53.956056+0000","last_became_active":"2023-08-17T17:46:53.953081+0000","last_became_peered":"2023-08-17T17:46:53.953081+0000","last_unstale":"2023-08-17T17:46:53.956056+0000","last_undegraded":"2023-08-17T17:46:53.956056+0000","last_fullsized":"2023-08-17T17:46:53.956056+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.956884+0000","last_change":"2023-08-17T17:46:53.580782+0000","last_active":"2023-08-17T17:46:53.956884+0000","last_peered":"2023-08-17T17:46:53.956884+0000","last_clean":"2023-08-17T17:46:53.956884+0000","last_became_active":"2023-08-17T17:46:53.580298+0000","last_became_peered":"2023-08-17T17:46:53.580298+0000","last_unstale":"2023-08-17T17:46:53.956884+0000","last_undegraded":"2023-08-17T17:46:53.956884+0000","last_fullsized":"2023-08-17T17:46:53.956884+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960856+0000","last_change":"2023-08-17T17:46:53.955663+0000","last_active":"2023-08-17T17:46:53.960856+0000","last_peered":"2023-08-17T17:46:53.960856+0000","last_clean":"2023-08-17T17:46:53.960856+0000","last_became_active":"2023-08-17T17:46:53.955389+0000","last_became_peered":"2023-08-17T17:46:53.955389+0000","last_unstale":"2023-08-17T17:46:53.960856+0000","last_undegraded":"2023-08-17T17:46:53.960856+0000","last_fullsized":"2023-08-17T17:46:53.960856+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.938094+0000","last_change":"2023-08-17T17:46:53.587937+0000","last_active":"2023-08-17T17:46:53.938094+0000","last_peered":"2023-08-17T17:46:53.938094+0000","last_clean":"2023-08-17T17:46:53.938094+0000","last_became_active":"2023-08-17T17:46:53.587645+0000","last_became_peered":"2023-08-17T17:46:53.587645+0000","last_unstale":"2023-08-17T17:46:53.938094+0000","last_undegraded":"2023-08-17T17:46:53.938094+0000","last_fullsized":"2023-08-17T17:46:53.938094+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.959768+0000","last_change":"2023-08-17T17:46:53.957341+0000","last_active":"2023-08-17T17:46:53.959768+0000","last_peered":"2023-08-17T17:46:53.959768+0000","last_clean":"2023-08-17T17:46:53.959768+0000","last_became_active":"2023-08-17T17:46:53.957039+0000","last_became_peered":"2023-08-17T17:46:53.957039+0000","last_unstale":"2023-08-17T17:46:53.959768+0000","last_undegraded":"2023-08-17T17:46:53.959768+0000","last_fullsized":"2023-08-17T17:46:53.959768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.949687+0000","last_change":"2023-08-17T17:46:53.591820+0000","last_active":"2023-08-17T17:46:53.949687+0000","last_peered":"2023-08-17T17:46:53.949687+0000","last_clean":"2023-08-17T17:46:53.949687+0000","last_became_active":"2023-08-17T17:46:53.591544+0000","last_became_peered":"2023-08-17T17:46:53.591544+0000","last_unstale":"2023-08-17T17:46:53.949687+0000","last_undegraded":"2023-08-17T17:46:53.949687+0000","last_fullsized":"2023-08-17T17:46:53.949687+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960155+0000","last_change":"2023-08-17T17:46:53.959259+0000","last_active":"2023-08-17T17:46:53.960155+0000","last_peered":"2023-08-17T17:46:53.960155+0000","last_clean":"2023-08-17T17:46:53.960155+0000","last_became_active":"2023-08-17T17:46:53.958995+0000","last_became_peered":"2023-08-17T17:46:53.958995+0000","last_unstale":"2023-08-17T17:46:53.960155+0000","last_undegraded":"2023-08-17T17:46:53.960155+0000","last_fullsized":"2023-08-17T17:46:53.960155+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.938768+0000","last_change":"2023-08-17T17:46:53.576364+0000","last_active":"2023-08-17T17:46:53.938768+0000","last_peered":"2023-08-17T17:46:53.938768+0000","last_clean":"2023-08-17T17:46:53.938768+0000","last_became_active":"2023-08-17T17:46:53.576052+0000","last_became_peered":"2023-08-17T17:46:53.576052+0000","last_unstale":"2023-08-17T17:46:53.938768+0000","last_undegraded":"2023-08-17T17:46:53.938768+0000","last_fullsized":"2023-08-17T17:46:53.938768+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961076+0000","last_change":"2023-08-17T17:46:53.955471+0000","last_active":"2023-08-17T17:46:53.961076+0000","last_peered":"2023-08-17T17:46:53.961076+0000","last_clean":"2023-08-17T17:46:53.961076+0000","last_became_active":"2023-08-17T17:46:53.955164+0000","last_became_peered":"2023-08-17T17:46:53.955164+0000","last_unstale":"2023-08-17T17:46:53.961076+0000","last_undegraded":"2023-08-17T17:46:53.961076+0000","last_fullsized":"2023-08-17T17:46:53.961076+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.942062+0000","last_change":"2023-08-17T17:46:53.583930+0000","last_active":"2023-08-17T17:46:53.942062+0000","last_peered":"2023-08-17T17:46:53.942062+0000","last_clean":"2023-08-17T17:46:53.942062+0000","last_became_active":"2023-08-17T17:46:53.583633+0000","last_became_peered":"2023-08-17T17:46:53.583633+0000","last_unstale":"2023-08-17T17:46:53.942062+0000","last_undegraded":"2023-08-17T17:46:53.942062+0000","last_fullsized":"2023-08-17T17:46:53.942062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.959753+0000","last_change":"2023-08-17T17:46:53.958150+0000","last_active":"2023-08-17T17:46:53.959753+0000","last_peered":"2023-08-17T17:46:53.959753+0000","last_clean":"2023-08-17T17:46:53.959753+0000","last_became_active":"2023-08-17T17:46:53.957227+0000","last_became_peered":"2023-08-17T17:46:53.957227+0000","last_unstale":"2023-08-17T17:46:53.959753+0000","last_undegraded":"2023-08-17T17:46:53.959753+0000","last_fullsized":"2023-08-17T17:46:53.959753+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.947879+0000","last_change":"2023-08-17T17:46:53.576838+0000","last_active":"2023-08-17T17:46:53.947879+0000","last_peered":"2023-08-17T17:46:53.947879+0000","last_clean":"2023-08-17T17:46:53.947879+0000","last_became_active":"2023-08-17T17:46:53.576666+0000","last_became_peered":"2023-08-17T17:46:53.576666+0000","last_unstale":"2023-08-17T17:46:53.947879+0000","last_undegraded":"2023-08-17T17:46:53.947879+0000","last_fullsized":"2023-08-17T17:46:53.947879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.956977+0000","last_change":"2023-08-17T17:46:53.948154+0000","last_active":"2023-08-17T17:46:53.956977+0000","last_peered":"2023-08-17T17:46:53.956977+0000","last_clean":"2023-08-17T17:46:53.956977+0000","last_became_active":"2023-08-17T17:46:53.947786+0000","last_became_peered":"2023-08-17T17:46:53.947786+0000","last_unstale":"2023-08-17T17:46:53.956977+0000","last_undegraded":"2023-08-17T17:46:53.956977+0000","last_fullsized":"2023-08-17T17:46:53.956977+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.947653+0000","last_change":"2023-08-17T17:46:53.588579+0000","last_active":"2023-08-17T17:46:53.947653+0000","last_peered":"2023-08-17T17:46:53.947653+0000","last_clean":"2023-08-17T17:46:53.947653+0000","last_became_active":"2023-08-17T17:46:53.588025+0000","last_became_peered":"2023-08-17T17:46:53.588025+0000","last_unstale":"2023-08-17T17:46:53.947653+0000","last_undegraded":"2023-08-17T17:46:53.947653+0000","last_fullsized":"2023-08-17T17:46:53.947653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.954002+0000","last_change":"2023-08-17T17:46:53.946710+0000","last_active":"2023-08-17T17:46:53.954002+0000","last_peered":"2023-08-17T17:46:53.954002+0000","last_clean":"2023-08-17T17:46:53.954002+0000","last_became_active":"2023-08-17T17:46:53.946424+0000","last_became_peered":"2023-08-17T17:46:53.946424+0000","last_unstale":"2023-08-17T17:46:53.954002+0000","last_undegraded":"2023-08-17T17:46:53.954002+0000","last_fullsized":"2023-08-17T17:46:53.954002+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.938461+0000","last_change":"2023-08-17T17:46:53.592735+0000","last_active":"2023-08-17T17:46:53.938461+0000","last_peered":"2023-08-17T17:46:53.938461+0000","last_clean":"2023-08-17T17:46:53.938461+0000","last_became_active":"2023-08-17T17:46:53.592421+0000","last_became_peered":"2023-08-17T17:46:53.592421+0000","last_unstale":"2023-08-17T17:46:53.938461+0000","last_undegraded":"2023-08-17T17:46:53.938461+0000","last_fullsized":"2023-08-17T17:46:53.938461+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961917+0000","last_change":"2023-08-17T17:46:53.956335+0000","last_active":"2023-08-17T17:46:53.961917+0000","last_peered":"2023-08-17T17:46:53.961917+0000","last_clean":"2023-08-17T17:46:53.961917+0000","last_became_active":"2023-08-17T17:46:53.956058+0000","last_became_peered":"2023-08-17T17:46:53.956058+0000","last_unstale":"2023-08-17T17:46:53.961917+0000","last_undegraded":"2023-08-17T17:46:53.961917+0000","last_fullsized":"2023-08-17T17:46:53.961917+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"59'3","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.959853+0000","last_change":"2023-08-17T17:46:53.594526+0000","last_active":"2023-08-17T17:46:53.959853+0000","last_peered":"2023-08-17T17:46:53.959853+0000","last_clean":"2023-08-17T17:46:53.959853+0000","last_became_active":"2023-08-17T17:46:53.594206+0000","last_became_peered":"2023-08-17T17:46:53.594206+0000","last_unstale":"2023-08-17T17:46:53.959853+0000","last_undegraded":"2023-08-17T17:46:53.959853+0000","last_fullsized":"2023-08-17T17:46:53.959853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960242+0000","last_change":"2023-08-17T17:46:53.957595+0000","last_active":"2023-08-17T17:46:53.960242+0000","last_peered":"2023-08-17T17:46:53.960242+0000","last_clean":"2023-08-17T17:46:53.960242+0000","last_became_active":"2023-08-17T17:46:53.957307+0000","last_became_peered":"2023-08-17T17:46:53.957307+0000","last_unstale":"2023-08-17T17:46:53.960242+0000","last_undegraded":"2023-08-17T17:46:53.960242+0000","last_fullsized":"2023-08-17T17:46:53.960242+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960957+0000","last_change":"2023-08-17T17:46:53.581153+0000","last_active":"2023-08-17T17:46:53.960957+0000","last_peered":"2023-08-17T17:46:53.960957+0000","last_clean":"2023-08-17T17:46:53.960957+0000","last_became_active":"2023-08-17T17:46:53.580902+0000","last_became_peered":"2023-08-17T17:46:53.580902+0000","last_unstale":"2023-08-17T17:46:53.960957+0000","last_undegraded":"2023-08-17T17:46:53.960957+0000","last_fullsized":"2023-08-17T17:46:53.960957+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961214+0000","last_change":"2023-08-17T17:46:53.958732+0000","last_active":"2023-08-17T17:46:53.961214+0000","last_peered":"2023-08-17T17:46:53.961214+0000","last_clean":"2023-08-17T17:46:53.961214+0000","last_became_active":"2023-08-17T17:46:53.958382+0000","last_became_peered":"2023-08-17T17:46:53.958382+0000","last_unstale":"2023-08-17T17:46:53.961214+0000","last_undegraded":"2023-08-17T17:46:53.961214+0000","last_fullsized":"2023-08-17T17:46:53.961214+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.959296+0000","last_change":"2023-08-17T17:46:53.591102+0000","last_active":"2023-08-17T17:46:53.959296+0000","last_peered":"2023-08-17T17:46:53.959296+0000","last_clean":"2023-08-17T17:46:53.959296+0000","last_became_active":"2023-08-17T17:46:53.590811+0000","last_became_peered":"2023-08-17T17:46:53.590811+0000","last_unstale":"2023-08-17T17:46:53.959296+0000","last_undegraded":"2023-08-17T17:46:53.959296+0000","last_fullsized":"2023-08-17T17:46:53.959296+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961161+0000","last_change":"2023-08-17T17:46:53.955398+0000","last_active":"2023-08-17T17:46:53.961161+0000","last_peered":"2023-08-17T17:46:53.961161+0000","last_clean":"2023-08-17T17:46:53.961161+0000","last_became_active":"2023-08-17T17:46:53.955128+0000","last_became_peered":"2023-08-17T17:46:53.955128+0000","last_unstale":"2023-08-17T17:46:53.961161+0000","last_undegraded":"2023-08-17T17:46:53.961161+0000","last_fullsized":"2023-08-17T17:46:53.961161+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.943239+0000","last_change":"2023-08-17T17:46:53.591056+0000","last_active":"2023-08-17T17:46:53.943239+0000","last_peered":"2023-08-17T17:46:53.943239+0000","last_clean":"2023-08-17T17:46:53.943239+0000","last_became_active":"2023-08-17T17:46:53.590762+0000","last_became_peered":"2023-08-17T17:46:53.590762+0000","last_unstale":"2023-08-17T17:46:53.943239+0000","last_undegraded":"2023-08-17T17:46:53.943239+0000","last_fullsized":"2023-08-17T17:46:53.943239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961040+0000","last_change":"2023-08-17T17:46:53.952809+0000","last_active":"2023-08-17T17:46:53.961040+0000","last_peered":"2023-08-17T17:46:53.961040+0000","last_clean":"2023-08-17T17:46:53.961040+0000","last_became_active":"2023-08-17T17:46:53.952541+0000","last_became_peered":"2023-08-17T17:46:53.952541+0000","last_unstale":"2023-08-17T17:46:53.961040+0000","last_undegraded":"2023-08-17T17:46:53.961040+0000","last_fullsized":"2023-08-17T17:46:53.961040+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.945031+0000","last_change":"2023-08-17T17:46:53.589394+0000","last_active":"2023-08-17T17:46:53.945031+0000","last_peered":"2023-08-17T17:46:53.945031+0000","last_clean":"2023-08-17T17:46:53.945031+0000","last_became_active":"2023-08-17T17:46:53.589087+0000","last_became_peered":"2023-08-17T17:46:53.589087+0000","last_unstale":"2023-08-17T17:46:53.945031+0000","last_undegraded":"2023-08-17T17:46:53.945031+0000","last_fullsized":"2023-08-17T17:46:53.945031+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961964+0000","last_change":"2023-08-17T17:46:53.956410+0000","last_active":"2023-08-17T17:46:53.961964+0000","last_peered":"2023-08-17T17:46:53.961964+0000","last_clean":"2023-08-17T17:46:53.961964+0000","last_became_active":"2023-08-17T17:46:53.956128+0000","last_became_peered":"2023-08-17T17:46:53.956128+0000","last_unstale":"2023-08-17T17:46:53.961964+0000","last_undegraded":"2023-08-17T17:46:53.961964+0000","last_fullsized":"2023-08-17T17:46:53.961964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"59'4","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.958412+0000","last_change":"2023-08-17T17:46:53.584361+0000","last_active":"2023-08-17T17:46:53.958412+0000","last_peered":"2023-08-17T17:46:53.958412+0000","last_clean":"2023-08-17T17:46:53.958412+0000","last_became_active":"2023-08-17T17:46:53.584085+0000","last_became_peered":"2023-08-17T17:46:53.584085+0000","last_unstale":"2023-08-17T17:46:53.958412+0000","last_undegraded":"2023-08-17T17:46:53.958412+0000","last_fullsized":"2023-08-17T17:46:53.958412+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961467+0000","last_change":"2023-08-17T17:46:53.957228+0000","last_active":"2023-08-17T17:46:53.961467+0000","last_peered":"2023-08-17T17:46:53.961467+0000","last_clean":"2023-08-17T17:46:53.961467+0000","last_became_active":"2023-08-17T17:46:53.956930+0000","last_became_peered":"2023-08-17T17:46:53.956930+0000","last_unstale":"2023-08-17T17:46:53.961467+0000","last_undegraded":"2023-08-17T17:46:53.961467+0000","last_fullsized":"2023-08-17T17:46:53.961467+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961516+0000","last_change":"2023-08-17T17:46:53.588048+0000","last_active":"2023-08-17T17:46:53.961516+0000","last_peered":"2023-08-17T17:46:53.961516+0000","last_clean":"2023-08-17T17:46:53.961516+0000","last_became_active":"2023-08-17T17:46:53.587765+0000","last_became_peered":"2023-08-17T17:46:53.587765+0000","last_unstale":"2023-08-17T17:46:53.961516+0000","last_undegraded":"2023-08-17T17:46:53.961516+0000","last_fullsized":"2023-08-17T17:46:53.961516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960667+0000","last_change":"2023-08-17T17:46:53.956044+0000","last_active":"2023-08-17T17:46:53.960667+0000","last_peered":"2023-08-17T17:46:53.960667+0000","last_clean":"2023-08-17T17:46:53.960667+0000","last_became_active":"2023-08-17T17:46:53.955771+0000","last_became_peered":"2023-08-17T17:46:53.955771+0000","last_unstale":"2023-08-17T17:46:53.960667+0000","last_undegraded":"2023-08-17T17:46:53.960667+0000","last_fullsized":"2023-08-17T17:46:53.960667+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961125+0000","last_change":"2023-08-17T17:46:53.580274+0000","last_active":"2023-08-17T17:46:53.961125+0000","last_peered":"2023-08-17T17:46:53.961125+0000","last_clean":"2023-08-17T17:46:53.961125+0000","last_became_active":"2023-08-17T17:46:53.580000+0000","last_became_peered":"2023-08-17T17:46:53.580000+0000","last_unstale":"2023-08-17T17:46:53.961125+0000","last_undegraded":"2023-08-17T17:46:53.961125+0000","last_fullsized":"2023-08-17T17:46:53.961125+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.959713+0000","last_change":"2023-08-17T17:46:53.957212+0000","last_active":"2023-08-17T17:46:53.959713+0000","last_peered":"2023-08-17T17:46:53.959713+0000","last_clean":"2023-08-17T17:46:53.959713+0000","last_became_active":"2023-08-17T17:46:53.956883+0000","last_became_peered":"2023-08-17T17:46:53.956883+0000","last_unstale":"2023-08-17T17:46:53.959713+0000","last_undegraded":"2023-08-17T17:46:53.959713+0000","last_fullsized":"2023-08-17T17:46:53.959713+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.946158+0000","last_change":"2023-08-17T17:46:53.581711+0000","last_active":"2023-08-17T17:46:53.946158+0000","last_peered":"2023-08-17T17:46:53.946158+0000","last_clean":"2023-08-17T17:46:53.946158+0000","last_became_active":"2023-08-17T17:46:53.581422+0000","last_became_peered":"2023-08-17T17:46:53.581422+0000","last_unstale":"2023-08-17T17:46:53.946158+0000","last_undegraded":"2023-08-17T17:46:53.946158+0000","last_fullsized":"2023-08-17T17:46:53.946158+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.958825+0000","last_change":"2023-08-17T17:46:53.953719+0000","last_active":"2023-08-17T17:46:53.958825+0000","last_peered":"2023-08-17T17:46:53.958825+0000","last_clean":"2023-08-17T17:46:53.958825+0000","last_became_active":"2023-08-17T17:46:53.953451+0000","last_became_peered":"2023-08-17T17:46:53.953451+0000","last_unstale":"2023-08-17T17:46:53.958825+0000","last_undegraded":"2023-08-17T17:46:53.958825+0000","last_fullsized":"2023-08-17T17:46:53.958825+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.947920+0000","last_change":"2023-08-17T17:46:53.588355+0000","last_active":"2023-08-17T17:46:53.947920+0000","last_peered":"2023-08-17T17:46:53.947920+0000","last_clean":"2023-08-17T17:46:53.947920+0000","last_became_active":"2023-08-17T17:46:53.587993+0000","last_became_peered":"2023-08-17T17:46:53.587993+0000","last_unstale":"2023-08-17T17:46:53.947920+0000","last_undegraded":"2023-08-17T17:46:53.947920+0000","last_fullsized":"2023-08-17T17:46:53.947920+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961177+0000","last_change":"2023-08-17T17:46:53.955856+0000","last_active":"2023-08-17T17:46:53.961177+0000","last_peered":"2023-08-17T17:46:53.961177+0000","last_clean":"2023-08-17T17:46:53.961177+0000","last_became_active":"2023-08-17T17:46:53.949257+0000","last_became_peered":"2023-08-17T17:46:53.949257+0000","last_unstale":"2023-08-17T17:46:53.961177+0000","last_undegraded":"2023-08-17T17:46:53.961177+0000","last_fullsized":"2023-08-17T17:46:53.961177+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.954108+0000","last_change":"2023-08-17T17:46:53.581332+0000","last_active":"2023-08-17T17:46:53.954108+0000","last_peered":"2023-08-17T17:46:53.954108+0000","last_clean":"2023-08-17T17:46:53.954108+0000","last_became_active":"2023-08-17T17:46:53.581009+0000","last_became_peered":"2023-08-17T17:46:53.581009+0000","last_unstale":"2023-08-17T17:46:53.954108+0000","last_undegraded":"2023-08-17T17:46:53.954108+0000","last_fullsized":"2023-08-17T17:46:53.954108+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.959925+0000","last_change":"2023-08-17T17:46:53.957758+0000","last_active":"2023-08-17T17:46:53.959925+0000","last_peered":"2023-08-17T17:46:53.959925+0000","last_clean":"2023-08-17T17:46:53.959925+0000","last_became_active":"2023-08-17T17:46:53.957485+0000","last_became_peered":"2023-08-17T17:46:53.957485+0000","last_unstale":"2023-08-17T17:46:53.959925+0000","last_undegraded":"2023-08-17T17:46:53.959925+0000","last_fullsized":"2023-08-17T17:46:53.959925+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.939907+0000","last_change":"2023-08-17T17:46:53.581061+0000","last_active":"2023-08-17T17:46:53.939907+0000","last_peered":"2023-08-17T17:46:53.939907+0000","last_clean":"2023-08-17T17:46:53.939907+0000","last_became_active":"2023-08-17T17:46:53.580750+0000","last_became_peered":"2023-08-17T17:46:53.580750+0000","last_unstale":"2023-08-17T17:46:53.939907+0000","last_undegraded":"2023-08-17T17:46:53.939907+0000","last_fullsized":"2023-08-17T17:46:53.939907+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960372+0000","last_change":"2023-08-17T17:46:53.954981+0000","last_active":"2023-08-17T17:46:53.960372+0000","last_peered":"2023-08-17T17:46:53.960372+0000","last_clean":"2023-08-17T17:46:53.960372+0000","last_became_active":"2023-08-17T17:46:53.954735+0000","last_became_peered":"2023-08-17T17:46:53.954735+0000","last_unstale":"2023-08-17T17:46:53.960372+0000","last_undegraded":"2023-08-17T17:46:53.960372+0000","last_fullsized":"2023-08-17T17:46:53.960372+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.947869+0000","last_change":"2023-08-17T17:46:53.584779+0000","last_active":"2023-08-17T17:46:53.947869+0000","last_peered":"2023-08-17T17:46:53.947869+0000","last_clean":"2023-08-17T17:46:53.947869+0000","last_became_active":"2023-08-17T17:46:53.584502+0000","last_became_peered":"2023-08-17T17:46:53.584502+0000","last_unstale":"2023-08-17T17:46:53.947869+0000","last_undegraded":"2023-08-17T17:46:53.947869+0000","last_fullsized":"2023-08-17T17:46:53.947869+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.956336+0000","last_change":"2023-08-17T17:46:53.948137+0000","last_active":"2023-08-17T17:46:53.956336+0000","last_peered":"2023-08-17T17:46:53.956336+0000","last_clean":"2023-08-17T17:46:53.956336+0000","last_became_active":"2023-08-17T17:46:53.947664+0000","last_became_peered":"2023-08-17T17:46:53.947664+0000","last_unstale":"2023-08-17T17:46:53.956336+0000","last_undegraded":"2023-08-17T17:46:53.956336+0000","last_fullsized":"2023-08-17T17:46:53.956336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.939326+0000","last_change":"2023-08-17T17:46:53.582200+0000","last_active":"2023-08-17T17:46:53.939326+0000","last_peered":"2023-08-17T17:46:53.939326+0000","last_clean":"2023-08-17T17:46:53.939326+0000","last_became_active":"2023-08-17T17:46:53.581952+0000","last_became_peered":"2023-08-17T17:46:53.581952+0000","last_unstale":"2023-08-17T17:46:53.939326+0000","last_undegraded":"2023-08-17T17:46:53.939326+0000","last_fullsized":"2023-08-17T17:46:53.939326+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.963007+0000","last_change":"2023-08-17T17:46:53.960280+0000","last_active":"2023-08-17T17:46:53.963007+0000","last_peered":"2023-08-17T17:46:53.963007+0000","last_clean":"2023-08-17T17:46:53.963007+0000","last_became_active":"2023-08-17T17:46:53.959994+0000","last_became_peered":"2023-08-17T17:46:53.959994+0000","last_unstale":"2023-08-17T17:46:53.963007+0000","last_undegraded":"2023-08-17T17:46:53.963007+0000","last_fullsized":"2023-08-17T17:46:53.963007+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.938815+0000","last_change":"2023-08-17T17:46:53.588244+0000","last_active":"2023-08-17T17:46:53.938815+0000","last_peered":"2023-08-17T17:46:53.938815+0000","last_clean":"2023-08-17T17:46:53.938815+0000","last_became_active":"2023-08-17T17:46:53.587974+0000","last_became_peered":"2023-08-17T17:46:53.587974+0000","last_unstale":"2023-08-17T17:46:53.938815+0000","last_undegraded":"2023-08-17T17:46:53.938815+0000","last_fullsized":"2023-08-17T17:46:53.938815+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.939169+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:46:53.939169+0000","last_peered":"2023-08-17T17:46:53.939169+0000","last_clean":"2023-08-17T17:46:53.939169+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:46:53.939169+0000","last_undegraded":"2023-08-17T17:46:53.939169+0000","last_fullsized":"2023-08-17T17:46:53.939169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961087+0000","last_change":"2023-08-17T17:46:53.954300+0000","last_active":"2023-08-17T17:46:53.961087+0000","last_peered":"2023-08-17T17:46:53.961087+0000","last_clean":"2023-08-17T17:46:53.961087+0000","last_became_active":"2023-08-17T17:46:53.954014+0000","last_became_peered":"2023-08-17T17:46:53.954014+0000","last_unstale":"2023-08-17T17:46:53.961087+0000","last_undegraded":"2023-08-17T17:46:53.961087+0000","last_fullsized":"2023-08-17T17:46:53.961087+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.958283+0000","last_change":"2023-08-17T17:46:53.591586+0000","last_active":"2023-08-17T17:46:53.958283+0000","last_peered":"2023-08-17T17:46:53.958283+0000","last_clean":"2023-08-17T17:46:53.958283+0000","last_became_active":"2023-08-17T17:46:53.591021+0000","last_became_peered":"2023-08-17T17:46:53.591021+0000","last_unstale":"2023-08-17T17:46:53.958283+0000","last_undegraded":"2023-08-17T17:46:53.958283+0000","last_fullsized":"2023-08-17T17:46:53.958283+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.936515+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:46:53.936515+0000","last_peered":"2023-08-17T17:46:53.936515+0000","last_clean":"2023-08-17T17:46:53.936515+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:46:53.936515+0000","last_undegraded":"2023-08-17T17:46:53.936515+0000","last_fullsized":"2023-08-17T17:46:53.936515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960734+0000","last_change":"2023-08-17T17:46:53.951035+0000","last_active":"2023-08-17T17:46:53.960734+0000","last_peered":"2023-08-17T17:46:53.960734+0000","last_clean":"2023-08-17T17:46:53.960734+0000","last_became_active":"2023-08-17T17:46:53.950768+0000","last_became_peered":"2023-08-17T17:46:53.950768+0000","last_unstale":"2023-08-17T17:46:53.960734+0000","last_undegraded":"2023-08-17T17:46:53.960734+0000","last_fullsized":"2023-08-17T17:46:53.960734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.949767+0000","last_change":"2023-08-17T17:46:53.584242+0000","last_active":"2023-08-17T17:46:53.949767+0000","last_peered":"2023-08-17T17:46:53.949767+0000","last_clean":"2023-08-17T17:46:53.949767+0000","last_became_active":"2023-08-17T17:46:53.583975+0000","last_became_peered":"2023-08-17T17:46:53.583975+0000","last_unstale":"2023-08-17T17:46:53.949767+0000","last_undegraded":"2023-08-17T17:46:53.949767+0000","last_fullsized":"2023-08-17T17:46:53.949767+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.939964+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:46:53.939964+0000","last_peered":"2023-08-17T17:46:53.939964+0000","last_clean":"2023-08-17T17:46:53.939964+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:46:53.939964+0000","last_undegraded":"2023-08-17T17:46:53.939964+0000","last_fullsized":"2023-08-17T17:46:53.939964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.957774+0000","last_change":"2023-08-17T17:46:53.955507+0000","last_active":"2023-08-17T17:46:53.957774+0000","last_peered":"2023-08-17T17:46:53.957774+0000","last_clean":"2023-08-17T17:46:53.957774+0000","last_became_active":"2023-08-17T17:46:53.955083+0000","last_became_peered":"2023-08-17T17:46:53.955083+0000","last_unstale":"2023-08-17T17:46:53.957774+0000","last_undegraded":"2023-08-17T17:46:53.957774+0000","last_fullsized":"2023-08-17T17:46:53.957774+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.948853+0000","last_change":"2023-08-17T17:46:53.591978+0000","last_active":"2023-08-17T17:46:53.948853+0000","last_peered":"2023-08-17T17:46:53.948853+0000","last_clean":"2023-08-17T17:46:53.948853+0000","last_became_active":"2023-08-17T17:46:53.591812+0000","last_became_peered":"2023-08-17T17:46:53.591812+0000","last_unstale":"2023-08-17T17:46:53.948853+0000","last_undegraded":"2023-08-17T17:46:53.948853+0000","last_fullsized":"2023-08-17T17:46:53.948853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.937510+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:46:53.937510+0000","last_peered":"2023-08-17T17:46:53.937510+0000","last_clean":"2023-08-17T17:46:53.937510+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:46:53.937510+0000","last_undegraded":"2023-08-17T17:46:53.937510+0000","last_fullsized":"2023-08-17T17:46:53.937510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.944053+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:46:53.944053+0000","last_peered":"2023-08-17T17:46:53.944053+0000","last_clean":"2023-08-17T17:46:53.944053+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:46:53.944053+0000","last_undegraded":"2023-08-17T17:46:53.944053+0000","last_fullsized":"2023-08-17T17:46:53.944053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961765+0000","last_change":"2023-08-17T17:46:53.957454+0000","last_active":"2023-08-17T17:46:53.961765+0000","last_peered":"2023-08-17T17:46:53.961765+0000","last_clean":"2023-08-17T17:46:53.961765+0000","last_became_active":"2023-08-17T17:46:53.957029+0000","last_became_peered":"2023-08-17T17:46:53.957029+0000","last_unstale":"2023-08-17T17:46:53.961765+0000","last_undegraded":"2023-08-17T17:46:53.961765+0000","last_fullsized":"2023-08-17T17:46:53.961765+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.945561+0000","last_change":"2023-08-17T17:46:53.586983+0000","last_active":"2023-08-17T17:46:53.945561+0000","last_peered":"2023-08-17T17:46:53.945561+0000","last_clean":"2023-08-17T17:46:53.945561+0000","last_became_active":"2023-08-17T17:46:53.586729+0000","last_became_peered":"2023-08-17T17:46:53.586729+0000","last_unstale":"2023-08-17T17:46:53.945561+0000","last_undegraded":"2023-08-17T17:46:53.945561+0000","last_fullsized":"2023-08-17T17:46:53.945561+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.944146+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:46:53.944146+0000","last_peered":"2023-08-17T17:46:53.944146+0000","last_clean":"2023-08-17T17:46:53.944146+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:46:53.944146+0000","last_undegraded":"2023-08-17T17:46:53.944146+0000","last_fullsized":"2023-08-17T17:46:53.944146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.961220+0000","last_change":"2023-08-17T17:46:53.956816+0000","last_active":"2023-08-17T17:46:53.961220+0000","last_peered":"2023-08-17T17:46:53.961220+0000","last_clean":"2023-08-17T17:46:53.961220+0000","last_became_active":"2023-08-17T17:46:53.955538+0000","last_became_peered":"2023-08-17T17:46:53.955538+0000","last_unstale":"2023-08-17T17:46:53.961220+0000","last_undegraded":"2023-08-17T17:46:53.961220+0000","last_fullsized":"2023-08-17T17:46:53.961220+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.937271+0000","last_change":"2023-08-17T17:46:53.591593+0000","last_active":"2023-08-17T17:46:53.937271+0000","last_peered":"2023-08-17T17:46:53.937271+0000","last_clean":"2023-08-17T17:46:53.937271+0000","last_became_active":"2023-08-17T17:46:53.591368+0000","last_became_peered":"2023-08-17T17:46:53.591368+0000","last_unstale":"2023-08-17T17:46:53.937271+0000","last_undegraded":"2023-08-17T17:46:53.937271+0000","last_fullsized":"2023-08-17T17:46:53.937271+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.945643+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:46:53.945643+0000","last_peered":"2023-08-17T17:46:53.945643+0000","last_clean":"2023-08-17T17:46:53.945643+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:46:53.945643+0000","last_undegraded":"2023-08-17T17:46:53.945643+0000","last_fullsized":"2023-08-17T17:46:53.945643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.956593+0000","last_change":"2023-08-17T17:46:53.952198+0000","last_active":"2023-08-17T17:46:53.956593+0000","last_peered":"2023-08-17T17:46:53.956593+0000","last_clean":"2023-08-17T17:46:53.956593+0000","last_became_active":"2023-08-17T17:46:53.951935+0000","last_became_peered":"2023-08-17T17:46:53.951935+0000","last_unstale":"2023-08-17T17:46:53.956593+0000","last_undegraded":"2023-08-17T17:46:53.956593+0000","last_fullsized":"2023-08-17T17:46:53.956593+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.941644+0000","last_change":"2023-08-17T17:46:53.581838+0000","last_active":"2023-08-17T17:46:53.941644+0000","last_peered":"2023-08-17T17:46:53.941644+0000","last_clean":"2023-08-17T17:46:53.941644+0000","last_became_active":"2023-08-17T17:46:53.581523+0000","last_became_peered":"2023-08-17T17:46:53.581523+0000","last_unstale":"2023-08-17T17:46:53.941644+0000","last_undegraded":"2023-08-17T17:46:53.941644+0000","last_fullsized":"2023-08-17T17:46:53.941644+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.940636+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:46:53.940636+0000","last_peered":"2023-08-17T17:46:53.940636+0000","last_clean":"2023-08-17T17:46:53.940636+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:46:53.940636+0000","last_undegraded":"2023-08-17T17:46:53.940636+0000","last_fullsized":"2023-08-17T17:46:53.940636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.960661+0000","last_change":"2023-08-17T17:46:53.953081+0000","last_active":"2023-08-17T17:46:53.960661+0000","last_peered":"2023-08-17T17:46:53.960661+0000","last_clean":"2023-08-17T17:46:53.960661+0000","last_became_active":"2023-08-17T17:46:53.952775+0000","last_became_peered":"2023-08-17T17:46:53.952775+0000","last_unstale":"2023-08-17T17:46:53.960661+0000","last_undegraded":"2023-08-17T17:46:53.960661+0000","last_fullsized":"2023-08-17T17:46:53.960661+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:53.558461+0000","last_clean_scrub_stamp":"2023-08-17T17:46:53.558461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.940102+0000","last_change":"2023-08-17T17:46:53.574800+0000","last_active":"2023-08-17T17:46:53.940102+0000","last_peered":"2023-08-17T17:46:53.940102+0000","last_clean":"2023-08-17T17:46:53.940102+0000","last_became_active":"2023-08-17T17:46:53.574519+0000","last_became_peered":"2023-08-17T17:46:53.574519+0000","last_unstale":"2023-08-17T17:46:53.940102+0000","last_undegraded":"2023-08-17T17:46:53.940102+0000","last_fullsized":"2023-08-17T17:46:53.940102+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:46:52.553429+0000","last_clean_scrub_stamp":"2023-08-17T17:46:52.553429+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T17:46:53.946530+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:46:53.946530+0000","last_peered":"2023-08-17T17:46:53.946530+0000","last_clean":"2023-08-17T17:46:53.946530+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:46:53.946530+0000","last_undegraded":"2023-08-17T17:46:53.946530+0000","last_fullsized":"2023-08-17T17:46:53.946530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575002,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":724992,"data_stored":345643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.72099999999999997,"5min":0.76400000000000001,"15min":0.80200000000000005},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.68899999999999995,"5min":0.82399999999999995,"15min":0.82899999999999996},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53000000000000003},"min":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.28999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.81200000000000006},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.80000000000000004},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.56100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70499999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.751,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.46200000000000002},"min":{"1min":0.34000000000000002,"5min":0.32300000000000001,"15min":0.28599999999999998},"max":{"1min":0.63,"5min":0.80100000000000005,"15min":0.85499999999999998},"last":0.504},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.26300000000000001},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.72999999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.437,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.70699999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72899999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":716800,"data_stored":345035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67900000000000005,"5min":0.79900000000000004,"15min":1.0980000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52600000000000002,"15min":0.50700000000000001},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.438}]},{"osd":2,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71299999999999997,"5min":0.79000000000000004,"15min":1.0609999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.503}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.377},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.30599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.751,"15min":0.751},"last":0.371},{"interface":"front","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.48499999999999999},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.026},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.42699999999999999,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.0740000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.49299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":716800,"data_stored":345055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.34200000000000003},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52800000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.443},{"interface":"front","average":{"1min":0.372,"5min":0.38200000000000001,"15min":0.36299999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54400000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.433}]},{"osd":2,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.27300000000000002,"5min":0.25,"15min":0.22800000000000001},"max":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.72999999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.40300000000000002},"min":{"1min":0.29999999999999999,"5min":0.28399999999999997,"15min":0.219},"max":{"1min":0.61599999999999999,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.435,"15min":0.41899999999999998},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29799999999999999},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.66600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.80800000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.39000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":1.0129999999999999},"last":0.752}]},{"osd":5,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63400000000000001,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":1.331,"15min":1.331},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64200000000000002,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":0.89000000000000001,"5min":1.319,"15min":1.319},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63800000000000001,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":1.2929999999999999,"15min":1.345},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.39800000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.94499999999999995},"last":0.745}]},{"osd":7,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67000000000000004,"15min":0.64200000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.436,"15min":0.41199999999999998},"max":{"1min":0.88900000000000001,"5min":1.359,"15min":1.377},"last":0.68500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575002,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":724992,"data_stored":345091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36599999999999999,"15min":0.34799999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.28799999999999998,"5min":0.248,"15min":0.217},"max":{"1min":0.48399999999999999,"5min":0.58799999999999997,"15min":0.66200000000000003},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38300000000000001,"15min":0.36199999999999999},"min":{"1min":0.26900000000000002,"5min":0.23599999999999999,"15min":0.20300000000000001},"max":{"1min":0.51400000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.65200000000000002},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.58999999999999997,"15min":0.66200000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.40500000000000003},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.49299999999999999,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.998,"5min":0.998,"15min":1.337},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":0.90700000000000003,"15min":1.3300000000000001},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.96299999999999997,"15min":0.97199999999999998},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.462},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.391},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84199999999999997,"5min":0.93300000000000005,"15min":0.97299999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.997,"15min":1.544},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":724992,"data_stored":346501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.246,"5min":0.219,"15min":0.20599999999999999},"max":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.81100000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.28599999999999998,"5min":0.247,"15min":0.221},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40100000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.70199999999999996},"last":0.371},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42399999999999999,"15min":0.40799999999999997},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":0.54900000000000004,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41099999999999998},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40799999999999997,"15min":0.39400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.222},"max":{"1min":0.61699999999999999,"5min":0.629,"15min":0.629},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.65600000000000003,"15min":0.60899999999999999},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39000000000000001},"max":{"1min":0.82899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.67300000000000004,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.625,"15min":0.59999999999999998},"min":{"1min":0.47599999999999998,"5min":0.43099999999999999,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Aug 17 17:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.64100000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":0.75},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.63400000000000001},"min":{"1min":0.51600000000000001,"5min":0.46100000000000002,"15min":0.441},"max":{"1min":0.85399999999999998,"5min":0.874,"15min":1.0109999999999999},"last":0.84799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575002,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":724992,"data_stored":345631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32800000000000001,"15min":0.33300000000000002},"min":{"1min":0.248,"5min":0.221,"15min":0.191},"max":{"1min":0.40400000000000003,"5min":0.48699999999999999,"15min":0.69999999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.36699999999999999,"15min":0.37},"min":{"1min":0.251,"5min":0.224,"15min":0.224},"max":{"1min":0.496,"5min":0.60599999999999998,"15min":0.71799999999999997},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.215},"max":{"1min":0.48499999999999999,"5min":0.61099999999999999,"15min":0.73799999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.49099999999999999,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.499}]},{"osd":2,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.26900000000000002,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.82299999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40699999999999997,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.59399999999999997,"5min":0.61699999999999999,"15min":0.71099999999999997},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":0.89000000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":2.1309999999999998},"last":0.62}]},{"osd":5,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38100000000000001},"max":{"1min":0.80200000000000005,"5min":0.86099999999999999,"15min":0.90100000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77100000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":0.91700000000000004,"15min":0.95299999999999996},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.83999999999999997,"5min":1.016,"15min":2.1669999999999998},"last":0.91400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":716800,"data_stored":345519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71899999999999997,"5min":0.83999999999999997,"15min":0.89100000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55500000000000005,"15min":0.53300000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.83199999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.78200000000000003,"15min":0.80900000000000005},"last":0.497}]},{"osd":2,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59199999999999997,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77200000000000002,"5min":0.82199999999999995,"15min":0.84799999999999998},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55300000000000005,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.80100000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.55700000000000005},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.47199999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.86399999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47599999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.53200000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.94899999999999995},"last":0.627}]},{"osd":7,"last update":"Thu Aug 17 17:46:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.375,"5min":0.34399999999999997,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.82199999999999995,"15min":0.91900000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.877,"15min":1.056},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575001,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":716800,"data_stored":345857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.32200000000000001,"15min":0.27700000000000002},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":1.2609999999999999},"last":0.495},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.35599999999999998,"15min":0.31},"max":{"1min":0.71799999999999997,"5min":0.77900000000000003,"15min":1.1499999999999999},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.747,"15min":1.242},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":0.81100000000000005,"15min":1.1399999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.252},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.81100000000000005,"15min":1.274},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":1.179},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":0.78000000000000003,"15min":1.3080000000000001},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.75,"15min":1.0620000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.51400000000000001},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.83899999999999997,"15min":1.0740000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.503,"15min":0.52500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":1.01},"last":0.627},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.56100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.30099999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.1020000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.56999999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":1.038},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.755,"5min":0.79100000000000004,"15min":1.1279999999999999},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:47:01.669 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T17:47:01.670 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T17:47:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.819+0000 7f74138de700 1 Processor -- start 2023-08-17T17:47:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.819+0000 7f74138de700 1 -- start start 2023-08-17T17:47:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f74138de700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c155500 0x7f740c0645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f74138de700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740c137b00 con 0x7f740c062c00 2023-08-17T17:47:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f74138de700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740c063dc0 con 0x7f740c064ab0 2023-08-17T17:47:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f74138de700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0631b0 con 0x7f740c155500 2023-08-17T17:47:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7411e7b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f740c062c00 0x7f740c0bc570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51594/0 (socket says 172.21.15.78:51594) 2023-08-17T17:47:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7411e7b700 1 -- 172.21.15.78:0/2467547078 learned_addr learned my addr 172.21.15.78:0/2467547078 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:47:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799831434 0 0) 0x7f7404001490 con 0x7f740c062c00 2023-08-17T17:47:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f741167a700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c155500 0x7f740c0645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73f80033f0 con 0x7f740c062c00 2023-08-17T17:47:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2047025369 0 0) 0x7f73f80033f0 con 0x7f740c062c00 2023-08-17T17:47:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c155500 msgr2=0x7f740c0645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7403fff700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c155500 0x7f740c0645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 >> v1:172.21.15.150:6789/0 conn(0x7f740c064ab0 legacy=0x7f740c0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c063490 con 0x7f740c062c00 2023-08-17T17:47:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f7404001980 con 0x7f740c062c00 2023-08-17T17:47:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.820+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 >> v1:172.21.15.78:6789/0 conn(0x7f740c062c00 legacy=0x7f740c0bc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7403fff700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c155500 0x7f73f8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7403fff700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f8003e40 0x7f73f8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7403fff700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73f8004b80 0x7f73f8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0631b0 con 0x7f73f8003e40 2023-08-17T17:47:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f800b990 con 0x7f73f8004b80 2023-08-17T17:47:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f800bb50 con 0x7f740c155500 2023-08-17T17:47:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7410e79700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f8003e40 0x7f73f8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f741167a700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c155500 0x7f73f8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7411e7b700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73f8004b80 0x7f73f8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7410e79700 1 -- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c155500 msgr2=0x7f73f8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:01.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7410e79700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c155500 0x7f73f8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7410e79700 1 -- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73f8004b80 msgr2=0x7f73f8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:01.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7410e79700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73f8004b80 0x7f73f8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7410e79700 1 -- 172.21.15.78:0/2467547078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80033f0 con 0x7f73f8003e40 2023-08-17T17:47:01.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7411e7b700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73f8004b80 0x7f73f8005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:47:01.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7410e79700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f8003e40 0x7f73f8004690 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f73fc001700 tx=0x7f73fc007bb0).ready entity=mon.0 client_cookie=7d3f56bb9dd4a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc007020 con 0x7f73f8003e40 2023-08-17T17:47:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc007180 con 0x7f73f8003e40 2023-08-17T17:47:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.821+0000 7f7403fff700 1 -- 172.21.15.78:0/2467547078 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc007500 con 0x7f73f8003e40 2023-08-17T17:47:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.822+0000 7f74138de700 1 -- 172.21.15.78:0/2467547078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f8003e40 msgr2=0x7f73f8004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.822+0000 7f74138de700 1 --2- 172.21.15.78:0/2467547078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f8003e40 0x7f73f8004690 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f73fc001700 tx=0x7f73fc007bb0).stop 2023-08-17T17:47:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.822+0000 7f7411e7b700 1 -- 172.21.15.78:0/2467547078 reap_dead start 2023-08-17T17:47:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.822+0000 7f74138de700 1 -- 172.21.15.78:0/2467547078 shutdown_connections 2023-08-17T17:47:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.822+0000 7f74138de700 1 -- 172.21.15.78:0/2467547078 >> 172.21.15.78:0/2467547078 conn(0x7f740c0c3e70 msgr2=0x7f740c0c4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.822+0000 7f74138de700 1 -- 172.21.15.78:0/2467547078 shutdown_connections 2023-08-17T17:47:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.822+0000 7f74138de700 1 -- 172.21.15.78:0/2467547078 wait complete. 2023-08-17T17:47:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.823+0000 7f74138de700 1 Processor -- start 2023-08-17T17:47:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.823+0000 7f74138de700 1 -- start start 2023-08-17T17:47:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f74138de700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f740c136e70 0x7f740c137250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f74138de700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c0a97d0 0x7f740c1678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f74138de700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f740c167dd0 0x7f740c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f74138de700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c138ef0 con 0x7f740c167dd0 2023-08-17T17:47:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f74138de700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c168770 con 0x7f740c136e70 2023-08-17T17:47:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f74138de700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c168250 con 0x7f740c0a97d0 2023-08-17T17:47:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f7411e7b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f740c167dd0 0x7f740c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f7411e7b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f740c167dd0 0x7f740c0a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46822/0 (socket says 172.21.15.78:46822) 2023-08-17T17:47:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f7411e7b700 1 -- 172.21.15.78:0/1223041231 learned_addr learned my addr 172.21.15.78:0/1223041231 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f741167a700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f740c136e70 0x7f740c137250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f7410e79700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c0a97d0 0x7f740c1678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f7411e7b700 1 -- 172.21.15.78:0/1223041231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c0a97d0 msgr2=0x7f740c1678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f7411e7b700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c0a97d0 0x7f740c1678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f7411e7b700 1 -- 172.21.15.78:0/1223041231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f740c136e70 msgr2=0x7f740c137250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:01.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f7411e7b700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f740c136e70 0x7f740c137250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:01.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f7411e7b700 1 -- 172.21.15.78:0/1223041231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c152990 con 0x7f740c167dd0 2023-08-17T17:47:01.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.824+0000 7f7411e7b700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f740c167dd0 0x7f740c0a70c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f740c046ce0 tx=0x7f7404002210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:01.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.825+0000 7f74017fa700 1 -- 172.21.15.78:0/1223041231 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400e830 con 0x7f740c167dd0 2023-08-17T17:47:01.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.825+0000 7f74017fa700 1 -- 172.21.15.78:0/1223041231 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400e990 con 0x7f740c167dd0 2023-08-17T17:47:01.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.825+0000 7f74138de700 1 -- 172.21.15.78:0/1223041231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c138830 con 0x7f740c167dd0 2023-08-17T17:47:01.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.825+0000 7f74017fa700 1 -- 172.21.15.78:0/1223041231 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400ed50 con 0x7f740c167dd0 2023-08-17T17:47:01.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.825+0000 7f74138de700 1 -- 172.21.15.78:0/1223041231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c152520 con 0x7f740c167dd0 2023-08-17T17:47:01.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.826+0000 7f74138de700 1 -- 172.21.15.78:0/1223041231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c138cd0 con 0x7f740c167dd0 2023-08-17T17:47:01.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.826+0000 7f74017fa700 1 -- 172.21.15.78:0/1223041231 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7404014640 con 0x7f740c167dd0 2023-08-17T17:47:01.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.826+0000 7f74017fa700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73f005ed90 0x7f73f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:01.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.826+0000 7f74017fa700 1 -- 172.21.15.78:0/1223041231 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7404079d20 con 0x7f740c167dd0 2023-08-17T17:47:01.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.826+0000 7f741167a700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73f005ed90 0x7f73f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.827+0000 7f741167a700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73f005ed90 0x7f73f0061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7408006d80 tx=0x7f7408008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:01.830+0000 7f74017fa700 1 -- 172.21.15.78:0/1223041231 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f740404b2c0 con 0x7f740c167dd0 2023-08-17T17:47:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.059+0000 7f74138de700 1 -- 172.21.15.78:0/1223041231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f740c139030 con 0x7f740c167dd0 2023-08-17T17:47:02.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.063+0000 7f74017fa700 1 -- 172.21.15.78:0/1223041231 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f740c139030 con 0x7f740c167dd0 2023-08-17T17:47:02.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 -- 172.21.15.78:0/1223041231 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73f005ed90 msgr2=0x7f73f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73f005ed90 0x7f73f0061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7408006d80 tx=0x7f7408008040).stop 2023-08-17T17:47:02.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 -- 172.21.15.78:0/1223041231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f740c167dd0 msgr2=0x7f740c0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f740c167dd0 0x7f740c0a70c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f740c046ce0 tx=0x7f7404002210).stop 2023-08-17T17:47:02.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 -- 172.21.15.78:0/1223041231 shutdown_connections 2023-08-17T17:47:02.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73f005ed90 0x7f73f0061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f740c167dd0 0x7f740c0a70c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f740c136e70 0x7f740c137250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 --2- 172.21.15.78:0/1223041231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f740c0a97d0 0x7f740c1678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 -- 172.21.15.78:0/1223041231 >> 172.21.15.78:0/1223041231 conn(0x7f740c0c3e70 msgr2=0x7f740c0c4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:02.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 -- 172.21.15.78:0/1223041231 shutdown_connections 2023-08-17T17:47:02.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.065+0000 7f74138de700 1 -- 172.21.15.78:0/1223041231 wait complete. 2023-08-17T17:47:02.068 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-08-17T17:47:02.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:47:02.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.189+0000 7fe478222700 1 Processor -- start 2023-08-17T17:47:02.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.189+0000 7fe478222700 1 -- start start 2023-08-17T17:47:02.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe478222700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe470154140 0x7fe4700c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe478222700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a7c40 0x7fe4700c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe478222700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe470154520 con 0x7fe4700a8080 2023-08-17T17:47:02.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe478222700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4700c91e0 con 0x7fe470154140 2023-08-17T17:47:02.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe478222700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c94c0 con 0x7fe4700a7c40 2023-08-17T17:47:02.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe475fbe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe470154140 0x7fe4700c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe4757bd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a7c40 0x7fe4700c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe4757bd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a7c40 0x7fe4700c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:34980/0 (socket says 172.21.15.78:34980) 2023-08-17T17:47:02.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe475fbe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe470154140 0x7fe4700c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:57140/0 (socket says 172.21.15.78:57140) 2023-08-17T17:47:02.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe4757bd700 1 -- 172.21.15.78:0/668955546 learned_addr learned my addr 172.21.15.78:0/668955546 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:02.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.190+0000 7fe4767bf700 1 --1- 172.21.15.78:0/668955546 >> v1:172.21.15.150:6789/0 conn(0x7fe4700a8080 0x7fe4700ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:36212/0 (socket says 172.21.15.78:36212) 2023-08-17T17:47:02.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe4757bd700 1 -- 172.21.15.78:0/668955546 >> v2:172.21.15.150:3300/0 conn(0x7fe470154140 msgr2=0x7fe4700c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe4757bd700 1 --2- 172.21.15.78:0/668955546 >> v2:172.21.15.150:3300/0 conn(0x7fe470154140 0x7fe4700c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe4757bd700 1 -- 172.21.15.78:0/668955546 >> v1:172.21.15.150:6789/0 conn(0x7fe4700a8080 legacy=0x7fe4700ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe4757bd700 1 -- 172.21.15.78:0/668955546 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700c97a0 con 0x7fe4700a7c40 2023-08-17T17:47:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe475fbe700 1 --2- 172.21.15.78:0/668955546 >> v2:172.21.15.150:3300/0 conn(0x7fe470154140 0x7fe4700c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:47:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe4757bd700 1 --2- 172.21.15.78:0/668955546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a7c40 0x7fe4700c0900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe460006fd0 tx=0x7fe4600090f0).ready entity=mon.2 client_cookie=20d393ccc1cb0395 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe474fbc700 1 -- 172.21.15.78:0/668955546 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000b580 con 0x7fe4700a7c40 2023-08-17T17:47:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe474fbc700 1 -- 172.21.15.78:0/668955546 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46000b6e0 con 0x7fe4700a7c40 2023-08-17T17:47:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe474fbc700 1 -- 172.21.15.78:0/668955546 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000ba60 con 0x7fe4700a7c40 2023-08-17T17:47:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe478222700 1 -- 172.21.15.78:0/668955546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a7c40 msgr2=0x7fe4700c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.191+0000 7fe478222700 1 --2- 172.21.15.78:0/668955546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a7c40 0x7fe4700c0900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe460006fd0 tx=0x7fe4600090f0).stop 2023-08-17T17:47:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.192+0000 7fe478222700 1 -- 172.21.15.78:0/668955546 shutdown_connections 2023-08-17T17:47:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.192+0000 7fe478222700 1 --2- 172.21.15.78:0/668955546 >> v2:172.21.15.150:3300/0 conn(0x7fe470154140 0x7fe4700c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.192+0000 7fe478222700 1 --2- 172.21.15.78:0/668955546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a7c40 0x7fe4700c0900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.192+0000 7fe478222700 1 -- 172.21.15.78:0/668955546 >> 172.21.15.78:0/668955546 conn(0x7fe470094510 msgr2=0x7fe47006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.192+0000 7fe478222700 1 -- 172.21.15.78:0/668955546 shutdown_connections 2023-08-17T17:47:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.192+0000 7fe478222700 1 -- 172.21.15.78:0/668955546 wait complete. 2023-08-17T17:47:02.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.193+0000 7fe478222700 1 Processor -- start 2023-08-17T17:47:02.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.193+0000 7fe478222700 1 -- start start 2023-08-17T17:47:02.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.193+0000 7fe478222700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4700a7c40 0x7fe4700ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.193+0000 7fe478222700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a8080 0x7fe4700b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.193+0000 7fe478222700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe470154140 0x7fe47014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.193+0000 7fe478222700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700b0bd0 con 0x7fe470154140 2023-08-17T17:47:02.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.193+0000 7fe478222700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700ab670 con 0x7fe4700a7c40 2023-08-17T17:47:02.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.193+0000 7fe478222700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700af0a0 con 0x7fe4700a8080 2023-08-17T17:47:02.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe4767bf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe470154140 0x7fe47014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe4767bf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe470154140 0x7fe47014dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46836/0 (socket says 172.21.15.78:46836) 2023-08-17T17:47:02.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe4767bf700 1 -- 172.21.15.78:0/148254698 learned_addr learned my addr 172.21.15.78:0/148254698 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:02.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe475fbe700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4700a7c40 0x7fe4700ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe4757bd700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a8080 0x7fe4700b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe4767bf700 1 -- 172.21.15.78:0/148254698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a8080 msgr2=0x7fe4700b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe4767bf700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a8080 0x7fe4700b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe4767bf700 1 -- 172.21.15.78:0/148254698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4700a7c40 msgr2=0x7fe4700ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe4767bf700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4700a7c40 0x7fe4700ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe4767bf700 1 -- 172.21.15.78:0/148254698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c009a20 con 0x7fe470154140 2023-08-17T17:47:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe4767bf700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe470154140 0x7fe47014dd10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fe46800c440 tx=0x7fe468007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe465ffb700 1 -- 172.21.15.78:0/148254698 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4680070d0 con 0x7fe470154140 2023-08-17T17:47:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe465ffb700 1 -- 172.21.15.78:0/148254698 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe468007230 con 0x7fe470154140 2023-08-17T17:47:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe465ffb700 1 -- 172.21.15.78:0/148254698 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4680075b0 con 0x7fe470154140 2023-08-17T17:47:02.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe478222700 1 -- 172.21.15.78:0/148254698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe460009370 con 0x7fe470154140 2023-08-17T17:47:02.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.194+0000 7fe478222700 1 -- 172.21.15.78:0/148254698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4700af660 con 0x7fe470154140 2023-08-17T17:47:02.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.195+0000 7fe478222700 1 -- 172.21.15.78:0/148254698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe470047350 con 0x7fe470154140 2023-08-17T17:47:02.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.196+0000 7fe465ffb700 1 -- 172.21.15.78:0/148254698 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe468010070 con 0x7fe470154140 2023-08-17T17:47:02.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.196+0000 7fe465ffb700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe45405ed90 0x7fe454061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.196+0000 7fe465ffb700 1 -- 172.21.15.78:0/148254698 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe468078ed0 con 0x7fe470154140 2023-08-17T17:47:02.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.196+0000 7fe475fbe700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe45405ed90 0x7fe454061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.196+0000 7fe475fbe700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe45405ed90 0x7fe454061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe46c009fd0 tx=0x7fe46c00b040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:02.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.200+0000 7fe465ffb700 1 -- 172.21.15.78:0/148254698 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe46804a470 con 0x7fe470154140 2023-08-17T17:47:02.284 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:47:02.286 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:47:02.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.407+0000 7fe478222700 1 -- 172.21.15.78:0/148254698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4700c5000 con 0x7fe470154140 2023-08-17T17:47:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.408+0000 7fe465ffb700 1 -- 172.21.15.78:0/148254698 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fe46804da90 con 0x7fe470154140 2023-08-17T17:47:02.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:47:02.409 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5090,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2346190042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2346190042},{"type":"v1","addr":"172.21.15.150:6834","nonce":2346190042}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2674101879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2674101879},{"type":"v1","addr":"172.21.15.78:6837","nonce":2674101879}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5745,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1609000139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1609000139},{"type":"v1","addr":"172.21.15.78:6836","nonce":1609000139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:46:53.930414+0000","modified":"2023-08-17T17:46:55.941460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/412084175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":412084175},{"type":"v1","addr":"172.21.15.150:6835","nonce":412084175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T17:47:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 -- 172.21.15.78:0/148254698 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe45405ed90 msgr2=0x7fe454061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe45405ed90 0x7fe454061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe46c009fd0 tx=0x7fe46c00b040).stop 2023-08-17T17:47:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 -- 172.21.15.78:0/148254698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe470154140 msgr2=0x7fe47014dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe470154140 0x7fe47014dd10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fe46800c440 tx=0x7fe468007d70).stop 2023-08-17T17:47:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 -- 172.21.15.78:0/148254698 shutdown_connections 2023-08-17T17:47:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe45405ed90 0x7fe454061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe470154140 0x7fe47014dd10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4700a7c40 0x7fe4700ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 --2- 172.21.15.78:0/148254698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4700a8080 0x7fe4700b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 -- 172.21.15.78:0/148254698 >> 172.21.15.78:0/148254698 conn(0x7fe470094510 msgr2=0x7fe4700ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 -- 172.21.15.78:0/148254698 shutdown_connections 2023-08-17T17:47:02.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.410+0000 7fe478222700 1 -- 172.21.15.78:0/148254698 wait complete. 2023-08-17T17:47:02.413 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 19 2023-08-17T17:47:02.825 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T17:46:53.930414+0000', 'modified': '2023-08-17T17:46:55.941460+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5757}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5757': {'gid': 5757, 'name': 'd', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/412084175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 412084175}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 412084175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T17:47:02.825 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T17:47:02.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-17T17:47:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.940+0000 7fae5bf13700 1 Processor -- start 2023-08-17T17:47:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.940+0000 7fae5bf13700 1 -- start start 2023-08-17T17:47:02.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.941+0000 7fae5bf13700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae540c98b0 0x7fae54064720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.941+0000 7fae5bf13700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fae540bec60 0x7fae540c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.941+0000 7fae5bf13700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae540c7860 con 0x7fae54064340 2023-08-17T17:47:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.941+0000 7fae5bf13700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae540638b0 con 0x7fae540c98b0 2023-08-17T17:47:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.941+0000 7fae5bf13700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae540a8680 con 0x7fae540bec60 2023-08-17T17:47:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.941+0000 7fae594ae700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae540c98b0 0x7fae54064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.941+0000 7fae594ae700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae540c98b0 0x7fae54064720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46846/0 (socket says 172.21.15.78:46846) 2023-08-17T17:47:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.941+0000 7fae594ae700 1 -- 172.21.15.78:0/901181689 learned_addr learned my addr 172.21.15.78:0/901181689 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/901181689 >> v2:172.21.15.150:3300/0 conn(0x7fae540bec60 0x7fae540c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae594ae700 1 -- 172.21.15.78:0/901181689 >> v2:172.21.15.150:3300/0 conn(0x7fae540bec60 msgr2=0x7fae540c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae594ae700 1 --2- 172.21.15.78:0/901181689 >> v2:172.21.15.150:3300/0 conn(0x7fae540bec60 0x7fae540c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae594ae700 1 -- 172.21.15.78:0/901181689 >> v1:172.21.15.150:6789/0 conn(0x7fae54064340 legacy=0x7fae540c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae594ae700 1 -- 172.21.15.78:0/901181689 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae540c6c90 con 0x7fae540c98b0 2023-08-17T17:47:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/901181689 >> v2:172.21.15.150:3300/0 conn(0x7fae540bec60 0x7fae540c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:47:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae594ae700 1 --2- 172.21.15.78:0/901181689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae540c98b0 0x7fae54064720 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fae54063e50 tx=0x7fae440090f0).ready entity=mon.0 client_cookie=5437ae15d62ef158 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae58cad700 1 -- 172.21.15.78:0/901181689 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4400b5a0 con 0x7fae540c98b0 2023-08-17T17:47:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae58cad700 1 -- 172.21.15.78:0/901181689 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4400b700 con 0x7fae540c98b0 2023-08-17T17:47:02.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae58cad700 1 -- 172.21.15.78:0/901181689 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4400ba80 con 0x7fae540c98b0 2023-08-17T17:47:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae5bf13700 1 -- 172.21.15.78:0/901181689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae540c98b0 msgr2=0x7fae54064720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.942+0000 7fae5bf13700 1 --2- 172.21.15.78:0/901181689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae540c98b0 0x7fae54064720 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fae54063e50 tx=0x7fae440090f0).stop 2023-08-17T17:47:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.943+0000 7fae5bf13700 1 -- 172.21.15.78:0/901181689 shutdown_connections 2023-08-17T17:47:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.943+0000 7fae5bf13700 1 --2- 172.21.15.78:0/901181689 >> v2:172.21.15.150:3300/0 conn(0x7fae540bec60 0x7fae540c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.943+0000 7fae5bf13700 1 --2- 172.21.15.78:0/901181689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae540c98b0 0x7fae54064720 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.943+0000 7fae5bf13700 1 -- 172.21.15.78:0/901181689 >> 172.21.15.78:0/901181689 conn(0x7fae54062cd0 msgr2=0x7fae540c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.943+0000 7fae5bf13700 1 -- 172.21.15.78:0/901181689 shutdown_connections 2023-08-17T17:47:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.943+0000 7fae5bf13700 1 -- 172.21.15.78:0/901181689 wait complete. 2023-08-17T17:47:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.944+0000 7fae5bf13700 1 Processor -- start 2023-08-17T17:47:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.944+0000 7fae5bf13700 1 -- start start 2023-08-17T17:47:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.944+0000 7fae5bf13700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae54064340 0x7fae541524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.944+0000 7fae5bf13700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae540bec60 0x7fae54152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.944+0000 7fae5bf13700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae540c98b0 0x7fae54155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae5bf13700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae541677e0 con 0x7fae54064340 2023-08-17T17:47:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae5bf13700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae54168360 con 0x7fae540bec60 2023-08-17T17:47:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae5bf13700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae54167a30 con 0x7fae540c98b0 2023-08-17T17:47:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae59caf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae54064340 0x7fae541524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae59caf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae54064340 0x7fae541524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46852/0 (socket says 172.21.15.78:46852) 2023-08-17T17:47:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae59caf700 1 -- 172.21.15.78:0/2017512136 learned_addr learned my addr 172.21.15.78:0/2017512136 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae540c98b0 0x7fae54155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae594ae700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae540bec60 0x7fae54152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae59caf700 1 -- 172.21.15.78:0/2017512136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae540c98b0 msgr2=0x7fae54155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae59caf700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae540c98b0 0x7fae54155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae59caf700 1 -- 172.21.15.78:0/2017512136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae540bec60 msgr2=0x7fae54152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae59caf700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae540bec60 0x7fae54152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae59caf700 1 -- 172.21.15.78:0/2017512136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae44009370 con 0x7fae54064340 2023-08-17T17:47:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae540c98b0 0x7fae54155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:47:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae594ae700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae540bec60 0x7fae54152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:47:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae59caf700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae54064340 0x7fae541524d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fae5000c470 tx=0x7fae50007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae49ffb700 1 -- 172.21.15.78:0/2017512136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5000f470 con 0x7fae54064340 2023-08-17T17:47:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae49ffb700 1 -- 172.21.15.78:0/2017512136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5000f5f0 con 0x7fae54064340 2023-08-17T17:47:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae5bf13700 1 -- 172.21.15.78:0/2017512136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae54167d10 con 0x7fae54064340 2023-08-17T17:47:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae49ffb700 1 -- 172.21.15.78:0/2017512136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5000f9b0 con 0x7fae54064340 2023-08-17T17:47:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.945+0000 7fae5bf13700 1 -- 172.21.15.78:0/2017512136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae54157450 con 0x7fae54064340 2023-08-17T17:47:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.947+0000 7fae49ffb700 1 -- 172.21.15.78:0/2017512136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fae50019030 con 0x7fae54064340 2023-08-17T17:47:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.947+0000 7fae49ffb700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae3805ed90 0x7fae38061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.947+0000 7fae49ffb700 1 -- 172.21.15.78:0/2017512136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fae50078f10 con 0x7fae54064340 2023-08-17T17:47:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.947+0000 7fae594ae700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae3805ed90 0x7fae38061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.948+0000 7fae594ae700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae3805ed90 0x7fae38061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fae540c9cf0 tx=0x7fae44015000).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.949+0000 7fae6d8a8b80 1 Processor -- start 2023-08-17T17:47:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.949+0000 7fae6d8a8b80 1 -- start start 2023-08-17T17:47:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f2cc20 0x55c784f2d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f758c0 0x55c784f27f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f28870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c784ef2d00 con 0x55c784f283f0 2023-08-17T17:47:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c784e69cb0 con 0x55c784f758c0 2023-08-17T17:47:02.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c784e7ec90 con 0x55c784f2cc20 2023-08-17T17:47:02.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae5a4b0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f28870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae5a4b0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f28870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46860/0 (socket says 172.21.15.78:46860) 2023-08-17T17:47:02.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae5a4b0700 1 -- 172.21.15.78:0/1240426989 learned_addr learned my addr 172.21.15.78:0/1240426989 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:02.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae594ae700 1 --2- 172.21.15.78:0/1240426989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f758c0 0x55c784f27f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae59caf700 1 --2- 172.21.15.78:0/1240426989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f2cc20 0x55c784f2d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae5a4b0700 1 -- 172.21.15.78:0/1240426989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f2cc20 msgr2=0x55c784f2d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/1240426989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f2cc20 0x55c784f2d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae5a4b0700 1 -- 172.21.15.78:0/1240426989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f758c0 msgr2=0x55c784f27f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/1240426989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f758c0 0x55c784f27f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.950+0000 7fae5a4b0700 1 -- 172.21.15.78:0/1240426989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c784d21310 con 0x55c784f283f0 2023-08-17T17:47:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae594ae700 1 --2- 172.21.15.78:0/1240426989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f758c0 0x55c784f27f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:47:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/1240426989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f28870 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fae4c00e670 tx=0x7fae4c007b60).ready entity=mon.0 client_cookie=551db100cc2a0b32 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae3effd700 1 -- 172.21.15.78:0/1240426989 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00c710 con 0x55c784f283f0 2023-08-17T17:47:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae3effd700 1 -- 172.21.15.78:0/1240426989 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c00c870 con 0x55c784f283f0 2023-08-17T17:47:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae3effd700 1 -- 172.21.15.78:0/1240426989 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00cbf0 con 0x55c784f283f0 2023-08-17T17:47:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/1240426989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 msgr2=0x55c784f28870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/1240426989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f28870 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fae4c00e670 tx=0x7fae4c007b60).stop 2023-08-17T17:47:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/1240426989 shutdown_connections 2023-08-17T17:47:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/1240426989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f28870 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/1240426989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f2cc20 0x55c784f2d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/1240426989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f758c0 0x55c784f27f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/1240426989 >> 172.21.15.78:0/1240426989 conn(0x55c784ce9e40 msgr2=0x55c784f75d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:02.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.951+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/1240426989 shutdown_connections 2023-08-17T17:47:02.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.952+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/1240426989 wait complete. 2023-08-17T17:47:02.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.952+0000 7fae6d8a8b80 1 -- start start 2023-08-17T17:47:02.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.952+0000 7fae6d8a8b80 1 Processor -- start 2023-08-17T17:47:02.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f283f0 0x55c784f56920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f2cc20 0x55c784f82510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f758c0 0x55c784f55830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c784e45ef0 con 0x55c784f758c0 2023-08-17T17:47:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c784e4a8d0 con 0x55c784f2cc20 2023-08-17T17:47:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c784f56320 con 0x55c784f283f0 2023-08-17T17:47:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae6d8a8b80 10 client.0 ll_register_callbacks cb 0x55c784eecce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:47:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae5a4b0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f758c0 0x55c784f55830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae5a4b0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f758c0 0x55c784f55830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46870/0 (socket says 172.21.15.78:46870) 2023-08-17T17:47:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae5a4b0700 1 -- 172.21.15.78:0/2467733610 learned_addr learned my addr 172.21.15.78:0/2467733610 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae59caf700 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f283f0 0x55c784f56920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.953+0000 7fae594ae700 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f2cc20 0x55c784f82510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae5a4b0700 1 -- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f283f0 msgr2=0x55c784f56920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f283f0 0x55c784f56920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae5a4b0700 1 -- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f2cc20 msgr2=0x55c784f82510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f2cc20 0x55c784f82510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae5a4b0700 1 -- 172.21.15.78:0/2467733610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c007e20 con 0x55c784f758c0 2023-08-17T17:47:02.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f758c0 0x55c784f55830 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fae4c014000 tx=0x7fae4c01a000).ready entity=mon.0 client_cookie=54a3e5edd60a9e37 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:02.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae33fff700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:47:02.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae33fff700 1 -- 172.21.15.78:0/2467733610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c017440 con 0x55c784f758c0 2023-08-17T17:47:02.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae33fff700 1 -- 172.21.15.78:0/2467733610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fae4c0175a0 con 0x55c784f758c0 2023-08-17T17:47:02.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2467733610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c784f270f0 con 0x55c784f758c0 2023-08-17T17:47:02.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae33fff700 1 -- 172.21.15.78:0/2467733610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae4c017970 con 0x55c784f758c0 2023-08-17T17:47:02.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae6d8a8b80 10 client.5934 fetch_fsmap learned FSMap version 19 2023-08-17T17:47:02.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2467733610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55c784e77e70 con 0x55c784f758c0 2023-08-17T17:47:02.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae33fff700 1 -- 172.21.15.78:0/2467733610 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c784f270f0 con 0x55c784f758c0 2023-08-17T17:47:02.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae33fff700 1 -- 172.21.15.78:0/2467733610 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 19) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fae4c017ad0 con 0x55c784f758c0 2023-08-17T17:47:02.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae6d8a8b80 10 client.5934 fetch_fsmap finished waiting for FSMap version 19 2023-08-17T17:47:02.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae6d8a8b80 10 client.5934 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-17T17:47:02.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae6d8a8b80 20 client.5934 populate_metadata read hostname 'smithi078' 2023-08-17T17:47:02.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:6833/412084175,v1:172.21.15.150:6835/412084175] conn(0x55c784f70330 0x55c784f70710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae6d8a8b80 4 client.5934 mds_command: new command op to 5757 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T17:47:02.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2467733610 --> [v2:172.21.15.150:6833/412084175,v1:172.21.15.150:6835/412084175] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c784ef6b50 con 0x55c784f70330 2023-08-17T17:47:02.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.954+0000 7fae59caf700 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:6833/412084175,v1:172.21.15.150:6835/412084175] conn(0x55c784f70330 0x55c784f70710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.955+0000 7fae33fff700 10 client.5934 ms_handle_connect on v2:172.21.15.150:6833/412084175 2023-08-17T17:47:02.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.955+0000 7fae59caf700 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:6833/412084175,v1:172.21.15.150:6835/412084175] conn(0x55c784f70330 0x55c784f70710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=463fd53978915dc7 server_cookie=728a920704c988c2 in_seq=0 out_seq=0 2023-08-17T17:47:02.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.955+0000 7fae33fff700 1 -- 172.21.15.78:0/2467733610 <== mds.0 v2:172.21.15.150:6833/412084175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55c784ef6b50 con 0x55c784f70330 2023-08-17T17:47:02.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.955+0000 7fae33fff700 10 client.5934 handle_command_reply: tid=0 2023-08-17T17:47:02.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.955+0000 7fae6d8a8b80 1 client.5934 shutdown 2023-08-17T17:47:02.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2467733610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f758c0 msgr2=0x55c784f55830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f758c0 0x55c784f55830 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fae4c014000 tx=0x7fae4c01a000).stop 2023-08-17T17:47:02.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2467733610 shutdown_connections 2023-08-17T17:47:02.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:6833/412084175,v1:172.21.15.150:6835/412084175] conn(0x55c784f70330 0x55c784f70710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f758c0 0x55c784f55830 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae33fff700 0 client.5934 ms_handle_reset on v2:172.21.15.150:6833/412084175 2023-08-17T17:47:02.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f283f0 0x55c784f56920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2467733610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f2cc20 0x55c784f82510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2467733610 >> 172.21.15.78:0/2467733610 conn(0x55c784ce9e40 msgr2=0x55c784f2d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:02.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2467733610 shutdown_connections 2023-08-17T17:47:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2467733610 wait complete. 2023-08-17T17:47:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.956+0000 7fae6d8a8b80 20 client.5934 trim_cache size 0 max 16384 2023-08-17T17:47:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.972+0000 7fae6d8a8b80 1 Processor -- start 2023-08-17T17:47:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.972+0000 7fae6d8a8b80 1 -- start start 2023-08-17T17:47:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f283f0 0x55c784f58130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f2cc20 0x55c784f57b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f758c0 0x55c784f5a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c784f2e180 con 0x55c784f2cc20 2023-08-17T17:47:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c784f264b0 con 0x55c784f758c0 2023-08-17T17:47:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c784f76af0 con 0x55c784f283f0 2023-08-17T17:47:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae594ae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f2cc20 0x55c784f57b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae594ae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f2cc20 0x55c784f57b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46874/0 (socket says 172.21.15.78:46874) 2023-08-17T17:47:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae594ae700 1 -- 172.21.15.78:0/1926481736 learned_addr learned my addr 172.21.15.78:0/1926481736 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae594ae700 1 -- 172.21.15.78:0/1926481736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f283f0 msgr2=0x55c784f58130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae594ae700 1 --2- 172.21.15.78:0/1926481736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f283f0 0x55c784f58130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae594ae700 1 -- 172.21.15.78:0/1926481736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f758c0 msgr2=0x55c784f5a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae594ae700 1 --2- 172.21.15.78:0/1926481736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f758c0 0x55c784f5a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae594ae700 1 -- 172.21.15.78:0/1926481736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c784e73480 con 0x55c784f2cc20 2023-08-17T17:47:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.973+0000 7fae594ae700 1 --2- 172.21.15.78:0/1926481736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f2cc20 0x55c784f57b90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fae44006fd0 tx=0x7fae4401f070).ready entity=mon.0 client_cookie=fec9ccd5ea2a8f58 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:02.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae3f7fe700 1 -- 172.21.15.78:0/1926481736 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4401d890 con 0x55c784f2cc20 2023-08-17T17:47:02.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae3f7fe700 1 -- 172.21.15.78:0/1926481736 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4401d9f0 con 0x55c784f2cc20 2023-08-17T17:47:02.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae3f7fe700 1 -- 172.21.15.78:0/1926481736 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4401dd70 con 0x55c784f2cc20 2023-08-17T17:47:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/1926481736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f2cc20 msgr2=0x55c784f57b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/1926481736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f2cc20 0x55c784f57b90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fae44006fd0 tx=0x7fae4401f070).stop 2023-08-17T17:47:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/1926481736 shutdown_connections 2023-08-17T17:47:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/1926481736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f758c0 0x55c784f5a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/1926481736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f283f0 0x55c784f58130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/1926481736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f2cc20 0x55c784f57b90 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/1926481736 >> 172.21.15.78:0/1926481736 conn(0x55c784ce9e40 msgr2=0x55c784f29f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/1926481736 shutdown_connections 2023-08-17T17:47:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.974+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/1926481736 wait complete. 2023-08-17T17:47:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.975+0000 7fae6d8a8b80 1 -- start start 2023-08-17T17:47:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.975+0000 7fae6d8a8b80 1 Processor -- start 2023-08-17T17:47:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f744d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f2cc20 0x55c784fd8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae6d8a8b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f758c0 0x55c784f6e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c784f75350 con 0x55c784f283f0 2023-08-17T17:47:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c784f6ee70 con 0x55c784f2cc20 2023-08-17T17:47:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae6d8a8b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c784f74b40 con 0x55c784f758c0 2023-08-17T17:47:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae6d8a8b80 10 client.0 ll_register_callbacks cb 0x55c784eecce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:47:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae59caf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae59caf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f744d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46882/0 (socket says 172.21.15.78:46882) 2023-08-17T17:47:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae59caf700 1 -- 172.21.15.78:0/2694345593 learned_addr learned my addr 172.21.15.78:0/2694345593 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae594ae700 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f2cc20 0x55c784fd8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae5a4b0700 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f758c0 0x55c784f6e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae59caf700 1 -- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f758c0 msgr2=0x55c784f6e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae59caf700 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f758c0 0x55c784f6e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae59caf700 1 -- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f2cc20 msgr2=0x55c784fd8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae59caf700 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f2cc20 0x55c784fd8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae59caf700 1 -- 172.21.15.78:0/2694345593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae540c6c90 con 0x55c784f283f0 2023-08-17T17:47:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae59caf700 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f744d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fae5004e150 tx=0x7fae50055040).ready entity=mon.0 client_cookie=4e39fb2ec84cff6d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae33fff700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:47:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae33fff700 1 -- 172.21.15.78:0/2694345593 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5004d710 con 0x55c784f283f0 2023-08-17T17:47:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae33fff700 1 -- 172.21.15.78:0/2694345593 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fae5004d870 con 0x55c784f283f0 2023-08-17T17:47:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2694345593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae4c00c870 con 0x55c784f283f0 2023-08-17T17:47:02.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae33fff700 1 -- 172.21.15.78:0/2694345593 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae5005de80 con 0x55c784f283f0 2023-08-17T17:47:02.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae6d8a8b80 10 client.5940 fetch_fsmap learned FSMap version 19 2023-08-17T17:47:02.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2694345593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55c784e731d0 con 0x55c784f283f0 2023-08-17T17:47:02.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.976+0000 7fae33fff700 1 -- 172.21.15.78:0/2694345593 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c00c870 con 0x55c784f283f0 2023-08-17T17:47:02.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae33fff700 1 -- 172.21.15.78:0/2694345593 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 19) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fae5004a010 con 0x55c784f283f0 2023-08-17T17:47:02.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 10 client.5940 fetch_fsmap finished waiting for FSMap version 19 2023-08-17T17:47:02.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 10 client.5940 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-17T17:47:02.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 20 client.5940 populate_metadata read hostname 'smithi078' 2023-08-17T17:47:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:6833/412084175,v1:172.21.15.150:6835/412084175] conn(0x55c784f57ac0 0x55c784f57ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 4 client.5940 mds_command: new command op to 5757 tid=0[{"prefix": "status"}] 2023-08-17T17:47:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2694345593 --> [v2:172.21.15.150:6833/412084175,v1:172.21.15.150:6835/412084175] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c784ce5ca0 con 0x55c784f57ac0 2023-08-17T17:47:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae594ae700 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:6833/412084175,v1:172.21.15.150:6835/412084175] conn(0x55c784f57ac0 0x55c784f57ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae594ae700 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:6833/412084175,v1:172.21.15.150:6835/412084175] conn(0x55c784f57ac0 0x55c784f57ea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d01f9640d30817c3 server_cookie=af9a8e25596d08a8 in_seq=0 out_seq=0 2023-08-17T17:47:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae33fff700 10 client.5940 ms_handle_connect on v2:172.21.15.150:6833/412084175 2023-08-17T17:47:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae33fff700 1 -- 172.21.15.78:0/2694345593 <== mds.0 v2:172.21.15.150:6833/412084175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55c784ce5ca0 con 0x55c784f57ac0 2023-08-17T17:47:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae33fff700 10 client.5940 handle_command_reply: tid=0 2023-08-17T17:47:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 1 client.5940 shutdown 2023-08-17T17:47:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2694345593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 msgr2=0x55c784f744d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f744d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fae5004e150 tx=0x7fae50055040).stop 2023-08-17T17:47:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2694345593 shutdown_connections 2023-08-17T17:47:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.977+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:6833/412084175,v1:172.21.15.150:6835/412084175] conn(0x55c784f57ac0 0x55c784f57ea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55c784f758c0 0x55c784f6e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae33fff700 0 client.5940 ms_handle_reset on v2:172.21.15.150:6833/412084175 2023-08-17T17:47:02.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c784f283f0 0x55c784f744d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae6d8a8b80 1 --2- 172.21.15.78:0/2694345593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c784f2cc20 0x55c784fd8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2694345593 >> 172.21.15.78:0/2694345593 conn(0x55c784ce9e40 msgr2=0x55c784f2ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:02.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2694345593 shutdown_connections 2023-08-17T17:47:02.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae6d8a8b80 1 -- 172.21.15.78:0/2694345593 wait complete. 2023-08-17T17:47:02.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae6d8a8b80 20 client.5940 trim_cache size 0 max 16384 2023-08-17T17:47:02.989 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:47:02.989 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T17:47:02.989 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T17:47:02.989 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5757, 2023-08-17T17:47:02.989 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T17:47:02.989 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T17:47:02.989 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T17:47:02.990 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 9.045836692, 2023-08-17T17:47:02.990 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 19, 2023-08-17T17:47:02.990 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 60, 2023-08-17T17:47:02.990 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 60, 2023-08-17T17:47:02.990 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 13.559258061 2023-08-17T17:47:02.990 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:47:02.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 -- 172.21.15.78:0/2017512136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae3805ed90 msgr2=0x7fae38061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae3805ed90 0x7fae38061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fae540c9cf0 tx=0x7fae44015000).stop 2023-08-17T17:47:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 -- 172.21.15.78:0/2017512136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae54064340 msgr2=0x7fae541524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae54064340 0x7fae541524d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fae5000c470 tx=0x7fae50007de0).stop 2023-08-17T17:47:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 -- 172.21.15.78:0/2017512136 shutdown_connections 2023-08-17T17:47:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae3805ed90 0x7fae38061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae540c98b0 0x7fae54155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae54064340 0x7fae541524d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 --2- 172.21.15.78:0/2017512136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae540bec60 0x7fae54152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 -- 172.21.15.78:0/2017512136 >> 172.21.15.78:0/2017512136 conn(0x7fae54062cd0 msgr2=0x7fae540a7820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 -- 172.21.15.78:0/2017512136 shutdown_connections 2023-08-17T17:47:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:02.978+0000 7fae5bf13700 1 -- 172.21.15.78:0/2017512136 wait complete. 2023-08-17T17:47:02.993 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T17:47:03.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.093+0000 7fc489fe5700 1 Processor -- start 2023-08-17T17:47:03.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.093+0000 7fc489fe5700 1 -- start start 2023-08-17T17:47:03.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc489fe5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4840c1100 0x7fc4840c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:03.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc489fe5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc4841546b0 0x7fc484154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:03.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc489fe5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4840c8670 con 0x7fc4840c8290 2023-08-17T17:47:03.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc489fe5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4840c5f50 con 0x7fc4841546b0 2023-08-17T17:47:03.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc489fe5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4841552f0 con 0x7fc4840c1100 2023-08-17T17:47:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc483fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc4841546b0 0x7fc484154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc4837fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc4840c8290 0x7fc4840c09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51600/0 (socket says 172.21.15.78:51600) 2023-08-17T17:47:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc4837fe700 1 -- 172.21.15.78:0/96665095 learned_addr learned my addr 172.21.15.78:0/96665095 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:47:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc482ffd700 1 --2- 172.21.15.78:0/96665095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4840c1100 0x7fc4840c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc4827fc700 1 -- 172.21.15.78:0/96665095 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707077379 0 0) 0x7fc4840c8670 con 0x7fc4840c8290 2023-08-17T17:47:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc4827fc700 1 -- 172.21.15.78:0/96665095 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc46c0033f0 con 0x7fc4840c8290 2023-08-17T17:47:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc483fff700 1 -- 172.21.15.78:0/96665095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4840c1100 msgr2=0x7fc4840c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc483fff700 1 --2- 172.21.15.78:0/96665095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4840c1100 0x7fc4840c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc483fff700 1 -- 172.21.15.78:0/96665095 >> v1:172.21.15.78:6789/0 conn(0x7fc4840c8290 legacy=0x7fc4840c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.094+0000 7fc483fff700 1 -- 172.21.15.78:0/96665095 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4841555d0 con 0x7fc4841546b0 2023-08-17T17:47:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc483fff700 1 --2- 172.21.15.78:0/96665095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4841546b0 0x7fc484154b10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fc47c009e60 tx=0x7fc47c009780).ready entity=mon.0 client_cookie=d6c649a58d3042 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc4827fc700 1 -- 172.21.15.78:0/96665095 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00e070 con 0x7fc4841546b0 2023-08-17T17:47:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc4827fc700 1 -- 172.21.15.78:0/96665095 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c00bb60 con 0x7fc4841546b0 2023-08-17T17:47:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc4827fc700 1 -- 172.21.15.78:0/96665095 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c012410 con 0x7fc4841546b0 2023-08-17T17:47:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc489fe5700 1 -- 172.21.15.78:0/96665095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4841546b0 msgr2=0x7fc484154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc489fe5700 1 --2- 172.21.15.78:0/96665095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4841546b0 0x7fc484154b10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fc47c009e60 tx=0x7fc47c009780).stop 2023-08-17T17:47:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc489fe5700 1 -- 172.21.15.78:0/96665095 shutdown_connections 2023-08-17T17:47:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc489fe5700 1 --2- 172.21.15.78:0/96665095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4841546b0 0x7fc484154b10 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc489fe5700 1 --2- 172.21.15.78:0/96665095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4840c1100 0x7fc4840c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc489fe5700 1 -- 172.21.15.78:0/96665095 >> 172.21.15.78:0/96665095 conn(0x7fc484084df0 msgr2=0x7fc484094710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc489fe5700 1 -- 172.21.15.78:0/96665095 shutdown_connections 2023-08-17T17:47:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.095+0000 7fc489fe5700 1 -- 172.21.15.78:0/96665095 wait complete. 2023-08-17T17:47:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.096+0000 7fc489fe5700 1 Processor -- start 2023-08-17T17:47:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.097+0000 7fc489fe5700 1 -- start start 2023-08-17T17:47:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.097+0000 7fc489fe5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4840c1100 0x7fc4840b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.097+0000 7fc489fe5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4840c8290 0x7fc484168550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.097+0000 7fc489fe5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4841546b0 0x7fc4841645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.097+0000 7fc489fe5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840b1140 con 0x7fc4840c1100 2023-08-17T17:47:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.097+0000 7fc489fe5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4841655f0 con 0x7fc4840c8290 2023-08-17T17:47:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.097+0000 7fc489fe5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4841680c0 con 0x7fc4841546b0 2023-08-17T17:47:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.097+0000 7fc4837fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4840c1100 0x7fc4840b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.097+0000 7fc4837fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4840c1100 0x7fc4840b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46898/0 (socket says 172.21.15.78:46898) 2023-08-17T17:47:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.097+0000 7fc4837fe700 1 -- 172.21.15.78:0/3166382793 learned_addr learned my addr 172.21.15.78:0/3166382793 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc4837fe700 1 -- 172.21.15.78:0/3166382793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4841546b0 msgr2=0x7fc4841645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc4837fe700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4841546b0 0x7fc4841645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc4837fe700 1 -- 172.21.15.78:0/3166382793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4840c8290 msgr2=0x7fc484168550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc4837fe700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4840c8290 0x7fc484168550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc4837fe700 1 -- 172.21.15.78:0/3166382793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c009a20 con 0x7fc4840c1100 2023-08-17T17:47:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc4837fe700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4840c1100 0x7fc4840b0c50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fc47400c590 tx=0x7fc474007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc46b7fe700 1 -- 172.21.15.78:0/3166382793 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474007e40 con 0x7fc4840c1100 2023-08-17T17:47:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc46b7fe700 1 -- 172.21.15.78:0/3166382793 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740072e0 con 0x7fc4840c1100 2023-08-17T17:47:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc489fe5700 1 -- 172.21.15.78:0/3166382793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc484165030 con 0x7fc4840c1100 2023-08-17T17:47:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc46b7fe700 1 -- 172.21.15.78:0/3166382793 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740057a0 con 0x7fc4840c1100 2023-08-17T17:47:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.098+0000 7fc489fe5700 1 -- 172.21.15.78:0/3166382793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc484167d50 con 0x7fc4840c1100 2023-08-17T17:47:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.099+0000 7fc489fe5700 1 -- 172.21.15.78:0/3166382793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc484167bb0 con 0x7fc4840c1100 2023-08-17T17:47:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.099+0000 7fc46b7fe700 1 -- 172.21.15.78:0/3166382793 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc47401a060 con 0x7fc4840c1100 2023-08-17T17:47:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.100+0000 7fc46b7fe700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47005ed90 0x7fc470061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.100+0000 7fc46b7fe700 1 -- 172.21.15.78:0/3166382793 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc474078f40 con 0x7fc4840c1100 2023-08-17T17:47:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.100+0000 7fc482ffd700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47005ed90 0x7fc470061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.100+0000 7fc482ffd700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47005ed90 0x7fc470061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc4840af080 tx=0x7fc478008040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:03.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.104+0000 7fc46b7fe700 1 -- 172.21.15.78:0/3166382793 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc484167bb0 con 0x7fc4840c1100 2023-08-17T17:47:03.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.311+0000 7fc489fe5700 1 -- 172.21.15.78:0/3166382793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc484167bb0 con 0x7fc4840c1100 2023-08-17T17:47:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.312+0000 7fc46b7fe700 1 -- 172.21.15.78:0/3166382793 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc484167bb0 con 0x7fc4840c1100 2023-08-17T17:47:03.313 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:47:03.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 -- 172.21.15.78:0/3166382793 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47005ed90 msgr2=0x7fc470061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:03.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47005ed90 0x7fc470061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc4840af080 tx=0x7fc478008040).stop 2023-08-17T17:47:03.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 -- 172.21.15.78:0/3166382793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4840c1100 msgr2=0x7fc4840b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:03.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4840c1100 0x7fc4840b0c50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fc47400c590 tx=0x7fc474007c80).stop 2023-08-17T17:47:03.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 -- 172.21.15.78:0/3166382793 shutdown_connections 2023-08-17T17:47:03.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47005ed90 0x7fc470061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:03.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4841546b0 0x7fc4841645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:03.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4840c1100 0x7fc4840b0c50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:03.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 --2- 172.21.15.78:0/3166382793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4840c8290 0x7fc484168550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:03.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 -- 172.21.15.78:0/3166382793 >> 172.21.15.78:0/3166382793 conn(0x7fc484084df0 msgr2=0x7fc484063c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:03.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 -- 172.21.15.78:0/3166382793 shutdown_connections 2023-08-17T17:47:03.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:03.314+0000 7fc489fe5700 1 -- 172.21.15.78:0/3166382793 wait complete. 2023-08-17T17:47:03.325 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T17:47:03.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:47:03.326 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T17:47:03.326 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T17:47:03.326 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T17:47:03.327 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T17:47:03.327 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T17:47:03.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:47:03.327 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:47:03.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:47:03.328 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T17:47:03.343 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:47:03.344 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:47:03.344 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:47:03.344 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:47:03.344 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:47:03.344 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:47:03.345 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:47:03.345 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:47:03.345 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T17:47:03.345 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:47:03.345 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:47:03.345 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T17:47:03.345 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:47:03.345 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:47:03.346 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:47:03.346 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:47:03.346 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:47:03.346 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 41456sec preferred_lft 41456sec 2023-08-17T17:47:03.346 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T17:47:03.346 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:47:03.346 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:47:03.346 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:47:03.347 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T17:47:03.347 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:47:03.347 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T17:47:03.347 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:47:03.347 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:47:03.347 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T17:47:03.347 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link 2023-08-17T17:47:03.348 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:47:03.348 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:47:03.348 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T17:47:03.348 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::54:39ff:fe93:1c36/64 scope link 2023-08-17T17:47:03.348 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:47:03.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:47:03.349 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:47:03.407 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T17:47:03.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:47:03.409 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T17:47:03.464 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T17:47:03.464 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:47:03.464 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:47:03.465 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:47:03.465 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:47:03.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:47:03.466 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:47:03.466 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:47:03.466 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:47:03.466 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:47:03.467 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:47:03.467 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:47:03.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:47:03.563 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:47:03.578 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T17:47:03.578 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T17:47:03.578 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:47:03.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:47:03.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T17:47:03.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:47:03.642 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T17:47:03.696 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:47:03.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:47:03.774 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:47:03.775 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:47:03.801 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:47:03.801 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:47:03.803 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:47:03.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:47:03.804 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T17:47:03.867 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-17T17:47:04.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.020+0000 7fc9ccf5f700 1 Processor -- start 2023-08-17T17:47:04.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.020+0000 7fc9ccf5f700 1 -- start start 2023-08-17T17:47:04.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.021+0000 7fc9ccf5f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9c81541a0 0x7fc9c80a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.021+0000 7fc9ccf5f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c80c0560 0x7fc9c80c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.021+0000 7fc9ccf5f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80c8df0 con 0x7fc9c8154580 2023-08-17T17:47:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.021+0000 7fc9ccf5f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80a8190 con 0x7fc9c81541a0 2023-08-17T17:47:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.021+0000 7fc9ccf5f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c9970 con 0x7fc9c80c0560 2023-08-17T17:47:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.021+0000 7fc9bdd9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc9c8154580 0x7fc9c80bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51604/0 (socket says 172.21.15.78:51604) 2023-08-17T17:47:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.021+0000 7fc9bdd9b700 1 -- 172.21.15.78:0/535192213 learned_addr learned my addr 172.21.15.78:0/535192213 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:47:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c659c700 1 --2- 172.21.15.78:0/535192213 >> v2:172.21.15.150:3300/0 conn(0x7fc9c81541a0 0x7fc9c80a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c6d9d700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c80c0560 0x7fc9c80c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882861324 0 0) 0x7fc9c80c8df0 con 0x7fc9c8154580 2023-08-17T17:47:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9b40033f0 con 0x7fc9c8154580 2023-08-17T17:47:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3060611615 0 0) 0x7fc9b40033f0 con 0x7fc9c8154580 2023-08-17T17:47:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c80c0560 msgr2=0x7fc9c80c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c80c0560 0x7fc9c80c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 >> v2:172.21.15.150:3300/0 conn(0x7fc9c81541a0 msgr2=0x7fc9c80a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 --2- 172.21.15.78:0/535192213 >> v2:172.21.15.150:3300/0 conn(0x7fc9c81541a0 0x7fc9c80a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80c9040 con 0x7fc9c8154580 2023-08-17T17:47:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fc9b0001470 con 0x7fc9c8154580 2023-08-17T17:47:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 >> v1:172.21.15.78:6789/0 conn(0x7fc9c8154580 legacy=0x7fc9c80bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 0x7fc9b4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c80c0560 0x7fc9b4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9b4004b80 0x7fc9b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80a8190 con 0x7fc9b40038e0 2023-08-17T17:47:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c9970 con 0x7fc9b4004b80 2023-08-17T17:47:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b400b8e0 con 0x7fc9c80c0560 2023-08-17T17:47:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c659c700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 0x7fc9b4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9bdd9b700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c80c0560 0x7fc9b4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c6d9d700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9b4004b80 0x7fc9b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c659c700 1 -- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c80c0560 msgr2=0x7fc9b4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c659c700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c80c0560 0x7fc9b4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c659c700 1 -- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9b4004b80 msgr2=0x7fc9b4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c659c700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9b4004b80 0x7fc9b4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9c659c700 1 -- 172.21.15.78:0/535192213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b40033f0 con 0x7fc9b40038e0 2023-08-17T17:47:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.022+0000 7fc9bdd9b700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c80c0560 0x7fc9b4004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:47:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9c659c700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 0x7fc9b4003d00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fc9b8009a80 tx=0x7fc9b8009060).ready entity=mon.0 client_cookie=bfc8bcd8a8ac73a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8009430 con 0x7fc9b40038e0 2023-08-17T17:47:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b800e640 con 0x7fc9b40038e0 2023-08-17T17:47:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9c5d9b700 1 -- 172.21.15.78:0/535192213 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800e9c0 con 0x7fc9b40038e0 2023-08-17T17:47:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/535192213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 msgr2=0x7fc9b4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9ccf5f700 1 --2- 172.21.15.78:0/535192213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 0x7fc9b4003d00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fc9b8009a80 tx=0x7fc9b8009060).stop 2023-08-17T17:47:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9c6d9d700 1 -- 172.21.15.78:0/535192213 reap_dead start 2023-08-17T17:47:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/535192213 shutdown_connections 2023-08-17T17:47:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/535192213 >> 172.21.15.78:0/535192213 conn(0x7fc9c806a400 msgr2=0x7fc9c80caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/535192213 shutdown_connections 2023-08-17T17:47:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.023+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/535192213 wait complete. 2023-08-17T17:47:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.024+0000 7fc9ccf5f700 1 Processor -- start 2023-08-17T17:47:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.025+0000 7fc9ccf5f700 1 -- start start 2023-08-17T17:47:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.025+0000 7fc9ccf5f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 0x7fc9c80c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.025+0000 7fc9ccf5f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c8149960 0x7fc9c80c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.025+0000 7fc9ccf5f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c80c3450 0x7fc9c8063aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.025+0000 7fc9ccf5f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c45f0 con 0x7fc9b40038e0 2023-08-17T17:47:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.025+0000 7fc9ccf5f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c39e0 con 0x7fc9c80c3450 2023-08-17T17:47:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.025+0000 7fc9ccf5f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c3cc0 con 0x7fc9c8149960 2023-08-17T17:47:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.025+0000 7fc9c659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 0x7fc9c80c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.025+0000 7fc9c659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 0x7fc9c80c4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46916/0 (socket says 172.21.15.78:46916) 2023-08-17T17:47:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.025+0000 7fc9c659c700 1 -- 172.21.15.78:0/1636621438 learned_addr learned my addr 172.21.15.78:0/1636621438 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9c6d9d700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c80c3450 0x7fc9c8063aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9bdd9b700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c8149960 0x7fc9c80c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9c659c700 1 -- 172.21.15.78:0/1636621438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c8149960 msgr2=0x7fc9c80c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9c659c700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c8149960 0x7fc9c80c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9c659c700 1 -- 172.21.15.78:0/1636621438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c80c3450 msgr2=0x7fc9c8063aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9c659c700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c80c3450 0x7fc9c8063aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9c659c700 1 -- 172.21.15.78:0/1636621438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80c3fa0 con 0x7fc9b40038e0 2023-08-17T17:47:04.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9c659c700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 0x7fc9c80c4a80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fc9b800e4b0 tx=0x7fc9b801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:04.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9beffd700 1 -- 172.21.15.78:0/1636621438 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8000cb0 con 0x7fc9b40038e0 2023-08-17T17:47:04.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9beffd700 1 -- 172.21.15.78:0/1636621438 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b800e7b0 con 0x7fc9b40038e0 2023-08-17T17:47:04.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/1636621438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c80c4280 con 0x7fc9b40038e0 2023-08-17T17:47:04.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9beffd700 1 -- 172.21.15.78:0/1636621438 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b801b6a0 con 0x7fc9b40038e0 2023-08-17T17:47:04.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.026+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/1636621438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c8149de0 con 0x7fc9b40038e0 2023-08-17T17:47:04.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.027+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/1636621438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c8047350 con 0x7fc9b40038e0 2023-08-17T17:47:04.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.027+0000 7fc9beffd700 1 -- 172.21.15.78:0/1636621438 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc9b801ba50 con 0x7fc9b40038e0 2023-08-17T17:47:04.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.028+0000 7fc9beffd700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9a805ed90 0x7fc9a8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.028+0000 7fc9beffd700 1 -- 172.21.15.78:0/1636621438 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc9b807b750 con 0x7fc9b40038e0 2023-08-17T17:47:04.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.028+0000 7fc9bdd9b700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9a805ed90 0x7fc9a8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.028+0000 7fc9bdd9b700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9a805ed90 0x7fc9a8061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc9c81675c0 tx=0x7fc9b0009040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:04.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.032+0000 7fc9beffd700 1 -- 172.21.15.78:0/1636621438 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc9b804cd50 con 0x7fc9b40038e0 2023-08-17T17:47:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.223+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/1636621438 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9c80c4730 con 0x7fc9a805ed90 2023-08-17T17:47:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.224+0000 7fc9beffd700 1 -- 172.21.15.78:0/1636621438 <== mgr.5568 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc9b0010960 con 0x7fc9a805ed90 2023-08-17T17:47:04.225 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:47:04.225 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:47:04.226 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephfs" 2023-08-17T17:47:04.226 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:47:04.226 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:47:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/1636621438 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9a805ed90 msgr2=0x7fc9a8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9a805ed90 0x7fc9a8061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc9c81675c0 tx=0x7fc9b0009040).stop 2023-08-17T17:47:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/1636621438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 msgr2=0x7fc9c80c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 0x7fc9c80c4a80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fc9b800e4b0 tx=0x7fc9b801a000).stop 2023-08-17T17:47:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/1636621438 shutdown_connections 2023-08-17T17:47:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc9a805ed90 0x7fc9a8061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c80c3450 0x7fc9c8063aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9b40038e0 0x7fc9c80c4a80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 --2- 172.21.15.78:0/1636621438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9c8149960 0x7fc9c80c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/1636621438 >> 172.21.15.78:0/1636621438 conn(0x7fc9c806a400 msgr2=0x7fc9c80c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/1636621438 shutdown_connections 2023-08-17T17:47:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.226+0000 7fc9ccf5f700 1 -- 172.21.15.78:0/1636621438 wait complete. 2023-08-17T17:47:04.239 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-17T17:47:04.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.352+0000 7ff21f534700 1 Processor -- start 2023-08-17T17:47:04.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.352+0000 7ff21f534700 1 -- start start 2023-08-17T17:47:04.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.353+0000 7ff21f534700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff21813a740 0x7ff218069f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.353+0000 7ff21f534700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff218069b00 con 0x7ff218154cf0 2023-08-17T17:47:04.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.353+0000 7ff21f534700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21813ab20 con 0x7ff2180624f0 2023-08-17T17:47:04.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.353+0000 7ff21f534700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff218155640 con 0x7ff21813a740 2023-08-17T17:47:04.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.353+0000 7ff21dad1700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff218154cf0 0x7ff2180c2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51620/0 (socket says 172.21.15.78:51620) 2023-08-17T17:47:04.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.353+0000 7ff21dad1700 1 -- 172.21.15.78:0/729944272 learned_addr learned my addr 172.21.15.78:0/729944272 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:47:04.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643747235 0 0) 0x7ff218069b00 con 0x7ff218154cf0 2023-08-17T17:47:04.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21d2d0700 1 --2- 172.21.15.78:0/729944272 >> v2:172.21.15.150:3300/0 conn(0x7ff21813a740 0x7ff218069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2040033f0 con 0x7ff218154cf0 2023-08-17T17:47:04.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2905490393 0 0) 0x7ff2040033f0 con 0x7ff218154cf0 2023-08-17T17:47:04.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 >> v2:172.21.15.150:3300/0 conn(0x7ff21813a740 msgr2=0x7ff218069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:04.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 --2- 172.21.15.78:0/729944272 >> v2:172.21.15.150:3300/0 conn(0x7ff21813a740 0x7ff218069f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 >> v1:172.21.15.150:6789/0 conn(0x7ff2180624f0 legacy=0x7ff2181545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218155360 con 0x7ff218154cf0 2023-08-17T17:47:04.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7ff2100017f0 con 0x7ff218154cf0 2023-08-17T17:47:04.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 >> v1:172.21.15.78:6789/0 conn(0x7ff218154cf0 legacy=0x7ff2180c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2040038e0 0x7ff204003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff204004690 0x7ff204004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff20400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20400be80 con 0x7ff204005000 2023-08-17T17:47:04.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20400bff0 con 0x7ff204004690 2023-08-17T17:47:04.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20400c1b0 con 0x7ff2040038e0 2023-08-17T17:47:04.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21dad1700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff20400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21cacf700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff204004690 0x7ff204004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21d2d0700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2040038e0 0x7ff204003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21dad1700 1 -- 172.21.15.78:0/729944272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2040038e0 msgr2=0x7ff204003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21dad1700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2040038e0 0x7ff204003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21dad1700 1 -- 172.21.15.78:0/729944272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff204004690 msgr2=0x7ff204004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21dad1700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff204004690 0x7ff204004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21dad1700 1 -- 172.21.15.78:0/729944272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2040033f0 con 0x7ff204005000 2023-08-17T17:47:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21d2d0700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2040038e0 0x7ff204003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:47:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.354+0000 7ff21dad1700 1 -- 172.21.15.78:0/729944272 reap_dead start 2023-08-17T17:47:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff21dad1700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff20400b8e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7ff21000c480 tx=0x7ff21000c790).ready entity=mon.0 client_cookie=1c41090b726dde75 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210002030 con 0x7ff204005000 2023-08-17T17:47:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21000ce20 con 0x7ff204005000 2023-08-17T17:47:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff20ffff700 1 -- 172.21.15.78:0/729944272 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210005d30 con 0x7ff204005000 2023-08-17T17:47:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff21f534700 1 -- 172.21.15.78:0/729944272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 msgr2=0x7ff20400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff21f534700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff20400b8e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7ff21000c480 tx=0x7ff21000c790).stop 2023-08-17T17:47:04.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff21f534700 1 -- 172.21.15.78:0/729944272 shutdown_connections 2023-08-17T17:47:04.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff21f534700 1 --2- 172.21.15.78:0/729944272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff20400b8e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff21f534700 1 -- 172.21.15.78:0/729944272 >> 172.21.15.78:0/729944272 conn(0x7ff2180c7b80 msgr2=0x7ff2180c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:04.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff21f534700 1 -- 172.21.15.78:0/729944272 shutdown_connections 2023-08-17T17:47:04.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.355+0000 7ff21f534700 1 -- 172.21.15.78:0/729944272 wait complete. 2023-08-17T17:47:04.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.356+0000 7ff21f534700 1 Processor -- start 2023-08-17T17:47:04.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.356+0000 7ff21f534700 1 -- start start 2023-08-17T17:47:04.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.357+0000 7ff21f534700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff2180a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.357+0000 7ff21f534700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff218153660 0x7ff2180ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.357+0000 7ff21f534700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff218153ae0 0x7ff2180ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.357+0000 7ff21f534700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180ada30 con 0x7ff204005000 2023-08-17T17:47:04.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.357+0000 7ff21f534700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180a7030 con 0x7ff218153660 2023-08-17T17:47:04.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.357+0000 7ff21f534700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180a7e90 con 0x7ff218153ae0 2023-08-17T17:47:04.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.357+0000 7ff21d2d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff2180a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.357+0000 7ff21d2d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff2180a9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46928/0 (socket says 172.21.15.78:46928) 2023-08-17T17:47:04.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.357+0000 7ff21d2d0700 1 -- 172.21.15.78:0/132443060 learned_addr learned my addr 172.21.15.78:0/132443060 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:04.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21dad1700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff218153ae0 0x7ff2180ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21cacf700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff218153660 0x7ff2180ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21d2d0700 1 -- 172.21.15.78:0/132443060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff218153ae0 msgr2=0x7ff2180ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21d2d0700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff218153ae0 0x7ff2180ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21d2d0700 1 -- 172.21.15.78:0/132443060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff218153660 msgr2=0x7ff2180ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:04.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21d2d0700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff218153660 0x7ff2180ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:04.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21d2d0700 1 -- 172.21.15.78:0/132443060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2180a7280 con 0x7ff204005000 2023-08-17T17:47:04.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21cacf700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff218153660 0x7ff2180ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:47:04.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21d2d0700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff2180a9160 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7ff214011610 tx=0x7ff214008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:04.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff20d7fa700 1 -- 172.21.15.78:0/132443060 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214013620 con 0x7ff204005000 2023-08-17T17:47:04.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff20d7fa700 1 -- 172.21.15.78:0/132443060 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214013780 con 0x7ff204005000 2023-08-17T17:47:04.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21f534700 1 -- 172.21.15.78:0/132443060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2180a7560 con 0x7ff204005000 2023-08-17T17:47:04.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff20d7fa700 1 -- 172.21.15.78:0/132443060 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214013b00 con 0x7ff204005000 2023-08-17T17:47:04.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.358+0000 7ff21f534700 1 -- 172.21.15.78:0/132443060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2180a7b20 con 0x7ff204005000 2023-08-17T17:47:04.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.359+0000 7ff21f534700 1 -- 172.21.15.78:0/132443060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff218068270 con 0x7ff204005000 2023-08-17T17:47:04.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.359+0000 7ff20d7fa700 1 -- 172.21.15.78:0/132443060 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff214012040 con 0x7ff204005000 2023-08-17T17:47:04.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.359+0000 7ff20d7fa700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1fc05ed90 0x7ff1fc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:04.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.360+0000 7ff20d7fa700 1 -- 172.21.15.78:0/132443060 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff21407a110 con 0x7ff204005000 2023-08-17T17:47:04.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.360+0000 7ff21cacf700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1fc05ed90 0x7ff1fc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:04.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.360+0000 7ff21cacf700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1fc05ed90 0x7ff1fc061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff208007cc0 tx=0x7ff208009040).ready entity=mgr.5568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:04.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.364+0000 7ff20d7fa700 1 -- 172.21.15.78:0/132443060 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff21404b6b0 con 0x7ff204005000 2023-08-17T17:47:04.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:04.568+0000 7ff21f534700 1 -- 172.21.15.78:0/132443060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff218046af0 con 0x7ff204005000 2023-08-17T17:47:05.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.217+0000 7ff20d7fa700 1 -- 172.21.15.78:0/132443060 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 15) v1 ==== 75259+0+0 (secure 0 0 0) 0x7ff214078010 con 0x7ff204005000 2023-08-17T17:47:05.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.219+0000 7ff20d7fa700 1 -- 172.21.15.78:0/132443060 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v15) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff21406eeb0 con 0x7ff204005000 2023-08-17T17:47:05.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 -- 172.21.15.78:0/132443060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1fc05ed90 msgr2=0x7ff1fc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:05.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1fc05ed90 0x7ff1fc061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff208007cc0 tx=0x7ff208009040).stop 2023-08-17T17:47:05.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 -- 172.21.15.78:0/132443060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 msgr2=0x7ff2180a9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:05.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff2180a9160 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7ff214011610 tx=0x7ff214008040).stop 2023-08-17T17:47:05.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 -- 172.21.15.78:0/132443060 shutdown_connections 2023-08-17T17:47:05.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1fc05ed90 0x7ff1fc061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff218153ae0 0x7ff2180ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204005000 0x7ff2180a9160 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 --2- 172.21.15.78:0/132443060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff218153660 0x7ff2180ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 -- 172.21.15.78:0/132443060 >> 172.21.15.78:0/132443060 conn(0x7ff2180c7b80 msgr2=0x7ff2181395e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:05.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 -- 172.21.15.78:0/132443060 shutdown_connections 2023-08-17T17:47:05.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.221+0000 7ff21f534700 1 -- 172.21.15.78:0/132443060 wait complete. 2023-08-17T17:47:05.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-17T17:47:05.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.355+0000 7f60d51f3700 1 Processor -- start 2023-08-17T17:47:05.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.356+0000 7f60d51f3700 1 -- start start 2023-08-17T17:47:05.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.356+0000 7f60d51f3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f60d0062a90 0x7f60d014e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.356+0000 7f60d51f3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f60d0062f40 0x7f60d014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.356+0000 7f60d51f3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d00bcb40 con 0x7f60d00626b0 2023-08-17T17:47:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.356+0000 7f60d51f3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d00649f0 con 0x7f60d0062a90 2023-08-17T17:47:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.356+0000 7f60d51f3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d0063450 con 0x7f60d0062f40 2023-08-17T17:47:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60ce59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f60d0062a90 0x7f60d014e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60ced9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f60d00626b0 0x7f60d00bc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51640/0 (socket says 172.21.15.78:51640) 2023-08-17T17:47:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60ced9d700 1 -- 172.21.15.78:0/1086092996 learned_addr learned my addr 172.21.15.78:0/1086092996 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:47:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60cf59e700 1 --2- 172.21.15.78:0/1086092996 >> v2:172.21.15.150:3300/0 conn(0x7f60d0062f40 0x7f60d014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60ce59c700 1 -- 172.21.15.78:0/1086092996 >> v2:172.21.15.150:3300/0 conn(0x7f60d0062f40 msgr2=0x7f60d014e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60ce59c700 1 --2- 172.21.15.78:0/1086092996 >> v2:172.21.15.150:3300/0 conn(0x7f60d0062f40 0x7f60d014e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60ce59c700 1 -- 172.21.15.78:0/1086092996 >> v1:172.21.15.78:6789/0 conn(0x7f60d00626b0 legacy=0x7f60d00bc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60cdd9b700 1 -- 172.21.15.78:0/1086092996 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525494398 0 0) 0x7f60d00bcb40 con 0x7f60d00626b0 2023-08-17T17:47:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60ce59c700 1 -- 172.21.15.78:0/1086092996 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d0063730 con 0x7f60d0062a90 2023-08-17T17:47:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60ce59c700 1 --2- 172.21.15.78:0/1086092996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062a90 0x7f60d014e300 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f60d0155710 tx=0x7f60c0009060).ready entity=mon.0 client_cookie=48fd2039a0aa0e96 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:05.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60cdd9b700 1 -- 172.21.15.78:0/1086092996 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c000f510 con 0x7f60d0062a90 2023-08-17T17:47:05.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60cdd9b700 1 -- 172.21.15.78:0/1086092996 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c000f670 con 0x7f60d0062a90 2023-08-17T17:47:05.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.357+0000 7f60cdd9b700 1 -- 172.21.15.78:0/1086092996 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c000f9f0 con 0x7f60d0062a90 2023-08-17T17:47:05.361 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:05.358+0000 7f439b11d680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:47:05.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.358+0000 7f60d51f3700 1 -- 172.21.15.78:0/1086092996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062a90 msgr2=0x7f60d014e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:05.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.358+0000 7f60d51f3700 1 --2- 172.21.15.78:0/1086092996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062a90 0x7f60d014e300 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f60d0155710 tx=0x7f60c0009060).stop 2023-08-17T17:47:05.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.358+0000 7f60d51f3700 1 -- 172.21.15.78:0/1086092996 shutdown_connections 2023-08-17T17:47:05.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.358+0000 7f60d51f3700 1 --2- 172.21.15.78:0/1086092996 >> v2:172.21.15.150:3300/0 conn(0x7f60d0062f40 0x7f60d014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.358+0000 7f60d51f3700 1 --2- 172.21.15.78:0/1086092996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062a90 0x7f60d014e300 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.358+0000 7f60d51f3700 1 -- 172.21.15.78:0/1086092996 >> 172.21.15.78:0/1086092996 conn(0x7f60d00c3db0 msgr2=0x7f60d00c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:05.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.358+0000 7f60d51f3700 1 -- 172.21.15.78:0/1086092996 shutdown_connections 2023-08-17T17:47:05.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.358+0000 7f60d51f3700 1 -- 172.21.15.78:0/1086092996 wait complete. 2023-08-17T17:47:05.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.359+0000 7f60d51f3700 1 Processor -- start 2023-08-17T17:47:05.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.359+0000 7f60d51f3700 1 -- start start 2023-08-17T17:47:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60d51f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60d00626b0 0x7f60d00ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60d51f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60d0062a90 0x7f60d00a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60d51f3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062f40 0x7f60d00a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60d51f3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d0167e10 con 0x7f60d0062f40 2023-08-17T17:47:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60d51f3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00a97b0 con 0x7f60d0062a90 2023-08-17T17:47:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60d51f3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00a9a90 con 0x7f60d00626b0 2023-08-17T17:47:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60cf59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062f40 0x7f60d00a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60cf59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062f40 0x7f60d00a8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46952/0 (socket says 172.21.15.78:46952) 2023-08-17T17:47:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60cf59e700 1 -- 172.21.15.78:0/1283925552 learned_addr learned my addr 172.21.15.78:0/1283925552 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60ce59c700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60d0062a90 0x7f60d00a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60ced9d700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60d00626b0 0x7f60d00ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60cf59e700 1 -- 172.21.15.78:0/1283925552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60d00626b0 msgr2=0x7f60d00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60cf59e700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60d00626b0 0x7f60d00ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60cf59e700 1 -- 172.21.15.78:0/1283925552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60d0062a90 msgr2=0x7f60d00a73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60cf59e700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60d0062a90 0x7f60d00a73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.360+0000 7f60cf59e700 1 -- 172.21.15.78:0/1283925552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c00092a0 con 0x7f60d0062f40 2023-08-17T17:47:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.361+0000 7f60cf59e700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062f40 0x7f60d00a8e60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f60c8009e90 tx=0x7f60c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.361+0000 7f60b6ffd700 1 -- 172.21.15.78:0/1283925552 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800caa0 con 0x7f60d0062f40 2023-08-17T17:47:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.361+0000 7f60b6ffd700 1 -- 172.21.15.78:0/1283925552 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c800f040 con 0x7f60d0062f40 2023-08-17T17:47:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.361+0000 7f60b6ffd700 1 -- 172.21.15.78:0/1283925552 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800ce10 con 0x7f60d0062f40 2023-08-17T17:47:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.361+0000 7f60d51f3700 1 -- 172.21.15.78:0/1283925552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d00a9d70 con 0x7f60d0062f40 2023-08-17T17:47:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.361+0000 7f60d51f3700 1 -- 172.21.15.78:0/1283925552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d00a78a0 con 0x7f60d0062f40 2023-08-17T17:47:05.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.362+0000 7f60d51f3700 1 -- 172.21.15.78:0/1283925552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d00676a0 con 0x7f60d0062f40 2023-08-17T17:47:05.368 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:05.362+0000 7f6b57ef7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:47:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.362+0000 7f60b6ffd700 1 -- 172.21.15.78:0/1283925552 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 15) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f60c8013610 con 0x7f60d0062f40 2023-08-17T17:47:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.363+0000 7f60b6ffd700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f60bc05ede0 0x7f60bc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.363+0000 7f60ced9d700 1 -- 172.21.15.78:0/1283925552 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f60bc05ede0 msgr2=0x7f60bc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:47:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.363+0000 7f60b6ffd700 1 -- 172.21.15.78:0/1283925552 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f60c807a5d0 con 0x7f60d0062f40 2023-08-17T17:47:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.363+0000 7f60ced9d700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f60bc05ede0 0x7f60bc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:47:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.366+0000 7f60b6ffd700 1 -- 172.21.15.78:0/1283925552 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f60c804baf0 con 0x7f60d0062f40 2023-08-17T17:47:05.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:05.422+0000 7f439b11d680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:47:05.428 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:05.427+0000 7f6b57ef7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:47:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.537+0000 7f60d51f3700 1 -- 172.21.15.78:0/1283925552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f60d0046af0 con 0x7f60d0062f40 2023-08-17T17:47:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.541+0000 7f60b6ffd700 1 -- 172.21.15.78:0/1283925552 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v7)=0 v7) v1 ==== 138+0+0 (secure 0 0 0) 0x7f60c804f110 con 0x7f60d0062f40 2023-08-17T17:47:05.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 -- 172.21.15.78:0/1283925552 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f60bc05ede0 msgr2=0x7f60bc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:47:05.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f60bc05ede0 0x7f60bc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:05.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 -- 172.21.15.78:0/1283925552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062f40 msgr2=0x7f60d00a8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:05.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062f40 0x7f60d00a8e60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f60c8009e90 tx=0x7f60c800b040).stop 2023-08-17T17:47:05.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 -- 172.21.15.78:0/1283925552 shutdown_connections 2023-08-17T17:47:05.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f60bc05ede0 0x7f60bc0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60d0062f40 0x7f60d00a8e60 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60d00626b0 0x7f60d00ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 --2- 172.21.15.78:0/1283925552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60d0062a90 0x7f60d00a73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 -- 172.21.15.78:0/1283925552 >> 172.21.15.78:0/1283925552 conn(0x7f60d00c3db0 msgr2=0x7f60d00c4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 -- 172.21.15.78:0/1283925552 shutdown_connections 2023-08-17T17:47:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.543+0000 7f60d51f3700 1 -- 172.21.15.78:0/1283925552 wait complete. 2023-08-17T17:47:05.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:05.557 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-17T17:47:05.575 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-17T17:47:05.696 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:05.696+0000 7f439b11d680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:47:05.714 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:05.713+0000 7f6b57ef7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:47:05.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.735+0000 7f1ef1483700 1 Processor -- start 2023-08-17T17:47:05.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.735+0000 7f1ef1483700 1 -- start start 2023-08-17T17:47:05.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1ef1483700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1eec0bc640 0x7f1eec0624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1ef1483700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1eec0c27e0 0x7f1eec0bca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1ef1483700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1eec0bcf10 0x7f1eec068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1ef1483700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eec063a00 con 0x7f1eec0bc640 2023-08-17T17:47:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1ef1483700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eec063e90 con 0x7f1eec0c27e0 2023-08-17T17:47:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1ef1483700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec062df0 con 0x7f1eec0bcf10 2023-08-17T17:47:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eeaffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1eec0bc640 0x7f1eec0624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eeaffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1eec0bc640 0x7f1eec0624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46954/0 (socket says 172.21.15.78:46954) 2023-08-17T17:47:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eeaffd700 1 -- 172.21.15.78:0/3343284491 learned_addr learned my addr 172.21.15.78:0/3343284491 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eea7fc700 1 --2- 172.21.15.78:0/3343284491 >> v2:172.21.15.150:3300/0 conn(0x7f1eec0c27e0 0x7f1eec0bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eeb7fe700 1 --2- 172.21.15.78:0/3343284491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1eec0bcf10 0x7f1eec068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eeaffd700 1 -- 172.21.15.78:0/3343284491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1eec0bcf10 msgr2=0x7f1eec068bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/3343284491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1eec0bcf10 0x7f1eec068bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eeaffd700 1 -- 172.21.15.78:0/3343284491 >> v2:172.21.15.150:3300/0 conn(0x7f1eec0c27e0 msgr2=0x7f1eec0bca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/3343284491 >> v2:172.21.15.150:3300/0 conn(0x7f1eec0c27e0 0x7f1eec0bca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eeaffd700 1 -- 172.21.15.78:0/3343284491 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0630d0 con 0x7f1eec0bc640 2023-08-17T17:47:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/3343284491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bc640 0x7f1eec0624f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f1eec0c4b00 tx=0x7f1edc0090f0).ready entity=mon.0 client_cookie=83dc05e2349eac20 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1ee9ffb700 1 -- 172.21.15.78:0/3343284491 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00b600 con 0x7f1eec0bc640 2023-08-17T17:47:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1ee9ffb700 1 -- 172.21.15.78:0/3343284491 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1edc00b760 con 0x7f1eec0bc640 2023-08-17T17:47:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.736+0000 7f1ee9ffb700 1 -- 172.21.15.78:0/3343284491 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00bae0 con 0x7f1eec0bc640 2023-08-17T17:47:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.737+0000 7f1ef1483700 1 -- 172.21.15.78:0/3343284491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bc640 msgr2=0x7f1eec0624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.737+0000 7f1ef1483700 1 --2- 172.21.15.78:0/3343284491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bc640 0x7f1eec0624f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f1eec0c4b00 tx=0x7f1edc0090f0).stop 2023-08-17T17:47:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.737+0000 7f1ef1483700 1 -- 172.21.15.78:0/3343284491 shutdown_connections 2023-08-17T17:47:05.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.737+0000 7f1ef1483700 1 --2- 172.21.15.78:0/3343284491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bc640 0x7f1eec0624f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.737+0000 7f1ef1483700 1 --2- 172.21.15.78:0/3343284491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1eec0bcf10 0x7f1eec068bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.737+0000 7f1ef1483700 1 --2- 172.21.15.78:0/3343284491 >> v2:172.21.15.150:3300/0 conn(0x7f1eec0c27e0 0x7f1eec0bca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.737+0000 7f1ef1483700 1 -- 172.21.15.78:0/3343284491 >> 172.21.15.78:0/3343284491 conn(0x7f1eec0c3c10 msgr2=0x7f1eec0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:05.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.737+0000 7f1ef1483700 1 -- 172.21.15.78:0/3343284491 shutdown_connections 2023-08-17T17:47:05.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.737+0000 7f1ef1483700 1 -- 172.21.15.78:0/3343284491 wait complete. 2023-08-17T17:47:05.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.738+0000 7f1ef1483700 1 Processor -- start 2023-08-17T17:47:05.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.738+0000 7f1ef1483700 1 -- start start 2023-08-17T17:47:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1ef1483700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1eec0bc640 0x7f1eec14b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1ef1483700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bcf10 0x7f1eec14bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1ef1483700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec0c27e0 0x7f1eec150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1ef1483700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec150d30 con 0x7f1eec0bcf10 2023-08-17T17:47:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1ef1483700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec150fb0 con 0x7f1eec0c27e0 2023-08-17T17:47:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1ef1483700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec151290 con 0x7f1eec0bc640 2023-08-17T17:47:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1eea7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bcf10 0x7f1eec14bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1eea7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bcf10 0x7f1eec14bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46968/0 (socket says 172.21.15.78:46968) 2023-08-17T17:47:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1eea7fc700 1 -- 172.21.15.78:0/1551504131 learned_addr learned my addr 172.21.15.78:0/1551504131 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1eec0bc640 0x7f1eec14b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1eeb7fe700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec0c27e0 0x7f1eec150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1eea7fc700 1 -- 172.21.15.78:0/1551504131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1eec0bc640 msgr2=0x7f1eec14b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1eea7fc700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1eec0bc640 0x7f1eec14b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1eea7fc700 1 -- 172.21.15.78:0/1551504131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec0c27e0 msgr2=0x7f1eec150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1eea7fc700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec0c27e0 0x7f1eec150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.739+0000 7f1eea7fc700 1 -- 172.21.15.78:0/1551504131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc009370 con 0x7f1eec0bcf10 2023-08-17T17:47:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.740+0000 7f1eea7fc700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bcf10 0x7f1eec14bf30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f1ee0006980 tx=0x7f1ee0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.740+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0011590 con 0x7f1eec0bcf10 2023-08-17T17:47:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.740+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee00116f0 con 0x7f1eec0bcf10 2023-08-17T17:47:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.740+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0011a90 con 0x7f1eec0bcf10 2023-08-17T17:47:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.740+0000 7f1ef1483700 1 -- 172.21.15.78:0/1551504131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec151570 con 0x7f1eec0bcf10 2023-08-17T17:47:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.740+0000 7f1ef1483700 1 -- 172.21.15.78:0/1551504131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec151fe0 con 0x7f1eec0bcf10 2023-08-17T17:47:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.741+0000 7f1ef1483700 1 -- 172.21.15.78:0/1551504131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eec05f910 con 0x7f1eec0bcf10 2023-08-17T17:47:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.741+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 15) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f1ee001c460 con 0x7f1eec0bcf10 2023-08-17T17:47:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.742+0000 7f1ed2ffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.742+0000 7f1eeaffd700 1 -- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 msgr2=0x7f1ed80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:47:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.742+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ee0079870 con 0x7f1eec0bcf10 2023-08-17T17:47:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.742+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:47:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.746+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ee004adb0 con 0x7f1eec0bcf10 2023-08-17T17:47:05.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.936+0000 7f1ef1483700 1 -- 172.21.15.78:0/1551504131 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1eec0633b0 con 0x7f1ed805ede0 2023-08-17T17:47:05.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.943+0000 7f1eeaffd700 1 -- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 msgr2=0x7f1ed80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:47:05.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:05.943+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:47:06.305 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:06.304+0000 7f439b11d680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:47:06.331 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:06.330+0000 7f6b57ef7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:47:06.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:06.344+0000 7f1eeaffd700 1 -- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 msgr2=0x7f1ed80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:47:06.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:06.344+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T17:47:06.376 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:06.375+0000 7f439b11d680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:47:06.403 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:06.402+0000 7f6b57ef7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:47:06.562 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:06.562+0000 7f439b11d680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:47:06.589 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:06.588+0000 7f6b57ef7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:47:06.981 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:06.980+0000 7f439b11d680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:47:07.006 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:07.005+0000 7f6b57ef7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:47:07.083 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:07.083+0000 7f439b11d680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:47:07.109 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:07.108+0000 7f6b57ef7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:47:07.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:07.145+0000 7f1eeaffd700 1 -- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 msgr2=0x7f1ed80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:47:07.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:07.145+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T17:47:07.236 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:07.236+0000 7f439b11d680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:47:07.261 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:07.260+0000 7f6b57ef7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:47:07.310 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:07.310+0000 7f439b11d680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:47:07.335 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:07.334+0000 7f6b57ef7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:47:07.379 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:07.379+0000 7f439b11d680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:47:07.402 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:07.401+0000 7f6b57ef7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:47:07.634 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:07.634+0000 7f439b11d680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:47:07.659 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:07.658+0000 7f6b57ef7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:47:07.817 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:07.817+0000 7f439b11d680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:47:07.840 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:07.839+0000 7f6b57ef7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:47:08.464 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:08.463+0000 7f439b11d680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:47:08.488 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:08.487+0000 7f6b57ef7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:47:08.532 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:08.531+0000 7f439b11d680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:47:08.555 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:08.554+0000 7f6b57ef7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:47:08.606 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:08.605+0000 7f439b11d680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:47:08.630 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:08.629+0000 7f6b57ef7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:47:08.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:08.746+0000 7f1eeaffd700 1 -- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 msgr2=0x7f1ed80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:47:08.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:08.746+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-17T17:47:08.751 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:08.750+0000 7f439b11d680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:47:08.777 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:08.776+0000 7f6b57ef7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:47:08.821 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:08.820+0000 7f439b11d680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:47:08.847 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:08.846+0000 7f6b57ef7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:47:08.934 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:08.934+0000 7f439b11d680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:47:08.962 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:08.961+0000 7f6b57ef7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:47:09.041 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:09.041+0000 7f439b11d680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:47:09.068 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.067+0000 7f6b57ef7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:47:09.333 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:09.332+0000 7f439b11d680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:47:09.353 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.352+0000 7f6b57ef7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:47:09.402 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:47:09.402+0000 7f439b11d680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:47:09.424 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.423+0000 7f6b57ef7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:47:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:09.445+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 16) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f1ee0077770 con 0x7f1eec0bcf10 2023-08-17T17:47:09.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:09.445+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 msgr2=0x7f1ed80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:47:09.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:09.445+0000 7f1ed2ffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:47:09.504 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.503+0000 7f6ad36cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:47:09.504 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.503+0000 7f6ad36cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:47:09.504 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.503+0000 7f6ad36cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:47:09.504 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.503+0000 7f6ad36cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:47:09.505 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.503+0000 7f6ad36cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:47:09.505 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.503+0000 7f6ad66d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:47:09.505 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.503+0000 7f6ad66d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:47:09.505 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.503+0000 7f6ad66d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:47:09.505 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.503+0000 7f6ad66d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:47:09.506 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:47:09.503+0000 7f6ad66d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:47:10.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.446+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mgrmap(e 17) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f1ee0077af0 con 0x7f1eec0bcf10 2023-08-17T17:47:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.446+0000 7f1ed2ffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed802fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.446+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1eec0633b0 con 0x7f1ed805ede0 2023-08-17T17:47:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.446+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed802fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.448+0000 7f1eeaffd700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed802fd40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1edc009130 tx=0x7f1edc017000).ready entity=mgr.5973 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:10.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.463+0000 7f1ed2ffd700 1 -- 172.21.15.78:0/1551504131 <== mgr.5973 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1eec0633b0 con 0x7f1ed805ede0 2023-08-17T17:47:10.464 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path snap_test_dir1 2023-08-17T17:47:10.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.465+0000 7f1ef1483700 1 -- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 msgr2=0x7f1ed802fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.465+0000 7f1ef1483700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed802fd40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1edc009130 tx=0x7f1edc017000).stop 2023-08-17T17:47:10.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.465+0000 7f1ef1483700 1 -- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bcf10 msgr2=0x7f1eec14bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.465+0000 7f1ef1483700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bcf10 0x7f1eec14bf30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f1ee0006980 tx=0x7f1ee0008040).stop 2023-08-17T17:47:10.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.466+0000 7f1ef1483700 1 -- 172.21.15.78:0/1551504131 shutdown_connections 2023-08-17T17:47:10.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.466+0000 7f1ef1483700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ed805ede0 0x7f1ed802fd40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.466+0000 7f1ef1483700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eec0c27e0 0x7f1eec150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.466+0000 7f1ef1483700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1eec0bc640 0x7f1eec14b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.466+0000 7f1ef1483700 1 --2- 172.21.15.78:0/1551504131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1eec0bcf10 0x7f1eec14bf30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.466+0000 7f1ef1483700 1 -- 172.21.15.78:0/1551504131 >> 172.21.15.78:0/1551504131 conn(0x7f1eec0c3c10 msgr2=0x7f1eec0bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:10.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.466+0000 7f1ef1483700 1 -- 172.21.15.78:0/1551504131 shutdown_connections 2023-08-17T17:47:10.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.466+0000 7f1ef1483700 1 -- 172.21.15.78:0/1551504131 wait complete. 2023-08-17T17:47:10.481 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-17T17:47:10.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-08-17T17:47:10.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.602+0000 7f808a0eb700 1 Processor -- start 2023-08-17T17:47:10.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.602+0000 7f808a0eb700 1 -- start start 2023-08-17T17:47:10.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f808a0eb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8084155510 0x7f8084154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f808a0eb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80840c2b00 con 0x7f8084154ab0 2023-08-17T17:47:10.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f808a0eb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808406a4c0 con 0x7f80840c5970 2023-08-17T17:47:10.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f808a0eb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80840c1da0 con 0x7f8084155510 2023-08-17T17:47:10.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f8082ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8084155510 0x7f8084154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f80837fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8084154ab0 0x7f80841507c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54576/0 (socket says 172.21.15.78:54576) 2023-08-17T17:47:10.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f80837fe700 1 -- 172.21.15.78:0/2509534888 learned_addr learned my addr 172.21.15.78:0/2509534888 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:47:10.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f8082ffd700 1 -- 172.21.15.78:0/2509534888 >> v1:172.21.15.150:6789/0 conn(0x7f80840c5970 legacy=0x7f8084068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:10.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f80827fc700 1 -- 172.21.15.78:0/2509534888 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630519557 0 0) 0x7f80840c2b00 con 0x7f8084154ab0 2023-08-17T17:47:10.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f8082ffd700 1 -- 172.21.15.78:0/2509534888 >> v1:172.21.15.78:6789/0 conn(0x7f8084154ab0 legacy=0x7f80841507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f8082ffd700 1 -- 172.21.15.78:0/2509534888 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80840c1f80 con 0x7f8084155510 2023-08-17T17:47:10.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.603+0000 7f8082ffd700 1 --2- 172.21.15.78:0/2509534888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 0x7f8084154e90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f8078009760 tx=0x7f8078009060).ready entity=mon.0 client_cookie=fd17d99a5d42cbe8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:10.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.604+0000 7f80827fc700 1 -- 172.21.15.78:0/2509534888 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807800b520 con 0x7f8084155510 2023-08-17T17:47:10.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.604+0000 7f80827fc700 1 -- 172.21.15.78:0/2509534888 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807800b680 con 0x7f8084155510 2023-08-17T17:47:10.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.604+0000 7f80827fc700 1 -- 172.21.15.78:0/2509534888 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807800ba00 con 0x7f8084155510 2023-08-17T17:47:10.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.604+0000 7f808a0eb700 1 -- 172.21.15.78:0/2509534888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 msgr2=0x7f8084154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.604+0000 7f808a0eb700 1 --2- 172.21.15.78:0/2509534888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 0x7f8084154e90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f8078009760 tx=0x7f8078009060).stop 2023-08-17T17:47:10.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.604+0000 7f808a0eb700 1 -- 172.21.15.78:0/2509534888 shutdown_connections 2023-08-17T17:47:10.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.604+0000 7f808a0eb700 1 --2- 172.21.15.78:0/2509534888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 0x7f8084154e90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.604+0000 7f808a0eb700 1 -- 172.21.15.78:0/2509534888 >> 172.21.15.78:0/2509534888 conn(0x7f80840c6a80 msgr2=0x7f80840c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:10.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.604+0000 7f808a0eb700 1 -- 172.21.15.78:0/2509534888 shutdown_connections 2023-08-17T17:47:10.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.604+0000 7f808a0eb700 1 -- 172.21.15.78:0/2509534888 wait complete. 2023-08-17T17:47:10.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.605+0000 7f808a0eb700 1 Processor -- start 2023-08-17T17:47:10.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.605+0000 7f808a0eb700 1 -- start start 2023-08-17T17:47:10.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f808a0eb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80840c5970 0x7f80841685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f808a0eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8084154ab0 0x7f80841405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f808a0eb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 0x7f8084146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f808a0eb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80841467a0 con 0x7f8084155510 2023-08-17T17:47:10.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f808a0eb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8084145b90 con 0x7f80840c5970 2023-08-17T17:47:10.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f808a0eb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8084145e70 con 0x7f8084154ab0 2023-08-17T17:47:10.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f8083fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 0x7f8084146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f8083fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 0x7f8084146c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56212/0 (socket says 172.21.15.78:56212) 2023-08-17T17:47:10.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f8083fff700 1 -- 172.21.15.78:0/3258229783 learned_addr learned my addr 172.21.15.78:0/3258229783 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:10.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f8082ffd700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8084154ab0 0x7f80841405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.606+0000 7f80837fe700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80840c5970 0x7f80841685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f8083fff700 1 -- 172.21.15.78:0/3258229783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8084154ab0 msgr2=0x7f80841405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f8083fff700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8084154ab0 0x7f80841405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f8083fff700 1 -- 172.21.15.78:0/3258229783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80840c5970 msgr2=0x7f80841685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f8083fff700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80840c5970 0x7f80841685b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f8083fff700 1 -- 172.21.15.78:0/3258229783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80780092a0 con 0x7f8084155510 2023-08-17T17:47:10.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f80837fe700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80840c5970 0x7f80841685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:47:10.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f8083fff700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 0x7f8084146c30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f807c00b460 tx=0x7f807c006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:10.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f806b7fe700 1 -- 172.21.15.78:0/3258229783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c00be60 con 0x7f8084155510 2023-08-17T17:47:10.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f806b7fe700 1 -- 172.21.15.78:0/3258229783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c012410 con 0x7f8084155510 2023-08-17T17:47:10.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f808a0eb700 1 -- 172.21.15.78:0/3258229783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8084146150 con 0x7f8084155510 2023-08-17T17:47:10.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f806b7fe700 1 -- 172.21.15.78:0/3258229783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0127d0 con 0x7f8084155510 2023-08-17T17:47:10.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.607+0000 7f808a0eb700 1 -- 172.21.15.78:0/3258229783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8084168aa0 con 0x7f8084155510 2023-08-17T17:47:10.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.608+0000 7f808a0eb700 1 -- 172.21.15.78:0/3258229783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8084067440 con 0x7f8084155510 2023-08-17T17:47:10.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.608+0000 7f806b7fe700 1 -- 172.21.15.78:0/3258229783 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 17) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f807c00f030 con 0x7f8084155510 2023-08-17T17:47:10.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.608+0000 7f806b7fe700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807005ed40 0x7f8070061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.608+0000 7f806b7fe700 1 -- 172.21.15.78:0/3258229783 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f807c079500 con 0x7f8084155510 2023-08-17T17:47:10.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.608+0000 7f80837fe700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807005ed40 0x7f8070061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.609+0000 7f80837fe700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807005ed40 0x7f8070061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8074001560 tx=0x7f8074009040).ready entity=mgr.5973 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:10.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.613+0000 7f806b7fe700 1 -- 172.21.15.78:0/3258229783 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f807c04aa90 con 0x7f8084155510 2023-08-17T17:47:10.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.800+0000 7f808a0eb700 1 -- 172.21.15.78:0/3258229783 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f80840c2260 con 0x7f807005ed40 2023-08-17T17:47:10.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.804+0000 7f806b7fe700 1 -- 172.21.15.78:0/3258229783 <== mgr.5973 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f80840c2260 con 0x7f807005ed40 2023-08-17T17:47:10.806 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path snap_test_dir1 2023-08-17T17:47:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.806+0000 7f808a0eb700 1 -- 172.21.15.78:0/3258229783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807005ed40 msgr2=0x7f8070061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.806+0000 7f808a0eb700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807005ed40 0x7f8070061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8074001560 tx=0x7f8074009040).stop 2023-08-17T17:47:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.806+0000 7f808a0eb700 1 -- 172.21.15.78:0/3258229783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 msgr2=0x7f8084146c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.806+0000 7f808a0eb700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 0x7f8084146c30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f807c00b460 tx=0x7f807c006f20).stop 2023-08-17T17:47:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.807+0000 7f808a0eb700 1 -- 172.21.15.78:0/3258229783 shutdown_connections 2023-08-17T17:47:10.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.807+0000 7f808a0eb700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807005ed40 0x7f8070061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.807+0000 7f808a0eb700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8084155510 0x7f8084146c30 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.807+0000 7f808a0eb700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80840c5970 0x7f80841685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.807+0000 7f808a0eb700 1 --2- 172.21.15.78:0/3258229783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8084154ab0 0x7f80841405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.807+0000 7f808a0eb700 1 -- 172.21.15.78:0/3258229783 >> 172.21.15.78:0/3258229783 conn(0x7f80840c6a80 msgr2=0x7f80840651b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:10.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.807+0000 7f808a0eb700 1 -- 172.21.15.78:0/3258229783 shutdown_connections 2023-08-17T17:47:10.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.807+0000 7f808a0eb700 1 -- 172.21.15.78:0/3258229783 wait complete. 2023-08-17T17:47:10.819 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-17T17:47:10.820 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-17-17_48_00 in ~50s... 2023-08-17T17:47:10.820 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-17-17_49_00 in ~110s... 2023-08-17T17:47:10.820 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-08-17T17:47:10.821 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-17T17:47:10.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.935+0000 7f2a5a30e700 1 Processor -- start 2023-08-17T17:47:10.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.935+0000 7f2a5a30e700 1 -- start start 2023-08-17T17:47:10.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.936+0000 7f2a5a30e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2a541578f0 0x7f2a540be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.936+0000 7f2a5a30e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 0x7f2a540c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.936+0000 7f2a5a30e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a540c3e10 con 0x7f2a540bf0e0 2023-08-17T17:47:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.936+0000 7f2a5a30e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540bf5c0 con 0x7f2a541578f0 2023-08-17T17:47:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.936+0000 7f2a5a30e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540c32d0 con 0x7f2a54096520 2023-08-17T17:47:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.936+0000 7f2a588ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 0x7f2a540c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.936+0000 7f2a53fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2a541578f0 0x7f2a540be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.936+0000 7f2a588ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 0x7f2a540c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:57214/0 (socket says 172.21.15.78:57214) 2023-08-17T17:47:10.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.936+0000 7f2a588ab700 1 -- 172.21.15.78:0/2510669724 learned_addr learned my addr 172.21.15.78:0/2510669724 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:10.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a588ab700 1 -- 172.21.15.78:0/2510669724 >> v2:172.21.15.150:3300/0 conn(0x7f2a541578f0 msgr2=0x7f2a540be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:47:10.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a588ab700 1 --2- 172.21.15.78:0/2510669724 >> v2:172.21.15.150:3300/0 conn(0x7f2a541578f0 0x7f2a540be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a588ab700 1 -- 172.21.15.78:0/2510669724 >> v1:172.21.15.150:6789/0 conn(0x7f2a540bf0e0 legacy=0x7f2a54095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a588ab700 1 -- 172.21.15.78:0/2510669724 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540c34e0 con 0x7f2a54096520 2023-08-17T17:47:10.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a53fff700 1 --2- 172.21.15.78:0/2510669724 >> v2:172.21.15.150:3300/0 conn(0x7f2a541578f0 0x7f2a540be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:47:10.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a588ab700 1 --2- 172.21.15.78:0/2510669724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 0x7f2a540c42a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2a4c009f20 tx=0x7f2a4c009840).ready entity=mon.2 client_cookie=2a4875624d03c2ff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:10.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a52ffd700 1 -- 172.21.15.78:0/2510669724 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00e070 con 0x7f2a54096520 2023-08-17T17:47:10.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a52ffd700 1 -- 172.21.15.78:0/2510669724 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00b9d0 con 0x7f2a54096520 2023-08-17T17:47:10.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a52ffd700 1 -- 172.21.15.78:0/2510669724 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00bd50 con 0x7f2a54096520 2023-08-17T17:47:10.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2510669724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 msgr2=0x7f2a540c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.937+0000 7f2a5a30e700 1 --2- 172.21.15.78:0/2510669724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 0x7f2a540c42a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2a4c009f20 tx=0x7f2a4c009840).stop 2023-08-17T17:47:10.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.938+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2510669724 shutdown_connections 2023-08-17T17:47:10.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.938+0000 7f2a5a30e700 1 --2- 172.21.15.78:0/2510669724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 0x7f2a540c42a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.938+0000 7f2a5a30e700 1 --2- 172.21.15.78:0/2510669724 >> v2:172.21.15.150:3300/0 conn(0x7f2a541578f0 0x7f2a540be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.938+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2510669724 >> 172.21.15.78:0/2510669724 conn(0x7f2a54062f80 msgr2=0x7f2a540c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:10.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.938+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2510669724 shutdown_connections 2023-08-17T17:47:10.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.938+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2510669724 wait complete. 2023-08-17T17:47:10.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.939+0000 7f2a5a30e700 1 Processor -- start 2023-08-17T17:47:10.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.939+0000 7f2a5a30e700 1 -- start start 2023-08-17T17:47:10.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a5a30e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 0x7f2a54155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a5a30e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a540bf0e0 0x7f2a540aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a5a30e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a541578f0 0x7f2a54156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a5a30e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540ab910 con 0x7f2a541578f0 2023-08-17T17:47:10.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a5a30e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540bfd70 con 0x7f2a540bf0e0 2023-08-17T17:47:10.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a5a30e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a541563c0 con 0x7f2a54096520 2023-08-17T17:47:10.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a588ab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a541578f0 0x7f2a54156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a588ab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a541578f0 0x7f2a54156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56216/0 (socket says 172.21.15.78:56216) 2023-08-17T17:47:10.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a588ab700 1 -- 172.21.15.78:0/2994140492 learned_addr learned my addr 172.21.15.78:0/2994140492 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:47:10.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a53fff700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 0x7f2a54155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a537fe700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a540bf0e0 0x7f2a540aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a588ab700 1 -- 172.21.15.78:0/2994140492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 msgr2=0x7f2a54155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a588ab700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 0x7f2a54155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a588ab700 1 -- 172.21.15.78:0/2994140492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a540bf0e0 msgr2=0x7f2a540aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a588ab700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a540bf0e0 0x7f2a540aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a588ab700 1 -- 172.21.15.78:0/2994140492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440092a0 con 0x7f2a541578f0 2023-08-17T17:47:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a588ab700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a541578f0 0x7f2a54156690 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f2a4c010000 tx=0x7f2a4c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a3bfff700 1 -- 172.21.15.78:0/2994140492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c007080 con 0x7f2a541578f0 2023-08-17T17:47:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a3bfff700 1 -- 172.21.15.78:0/2994140492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00bd50 con 0x7f2a541578f0 2023-08-17T17:47:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2994140492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c009ae0 con 0x7f2a541578f0 2023-08-17T17:47:10.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.940+0000 7f2a3bfff700 1 -- 172.21.15.78:0/2994140492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c01d670 con 0x7f2a541578f0 2023-08-17T17:47:10.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.941+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2994140492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a540ad0b0 con 0x7f2a541578f0 2023-08-17T17:47:10.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.941+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2994140492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a54066490 con 0x7f2a541578f0 2023-08-17T17:47:10.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.942+0000 7f2a3bfff700 1 -- 172.21.15.78:0/2994140492 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 17) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f2a4c024030 con 0x7f2a541578f0 2023-08-17T17:47:10.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.942+0000 7f2a3bfff700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a4005ed40 0x7f2a40061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:47:10.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.942+0000 7f2a3bfff700 1 -- 172.21.15.78:0/2994140492 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2a4c07afe0 con 0x7f2a541578f0 2023-08-17T17:47:10.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.942+0000 7f2a53fff700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a4005ed40 0x7f2a40061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:47:10.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.943+0000 7f2a53fff700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a4005ed40 0x7f2a40061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2a44009dc0 tx=0x7f2a44009060).ready entity=mgr.5973 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:47:10.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:10.946+0000 7f2a3bfff700 1 -- 172.21.15.78:0/2994140492 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a4c04c510 con 0x7f2a541578f0 2023-08-17T17:47:11.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.131+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2994140492 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a540c37c0 con 0x7f2a4005ed40 2023-08-17T17:47:11.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.133+0000 7f2a3bfff700 1 -- 172.21.15.78:0/2994140492 <== mgr.5973 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f2a540c37c0 con 0x7f2a4005ed40 2023-08-17T17:47:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:47:11.135 INFO:teuthology.orchestra.run.smithi078.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-08-17T17:47:11.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2994140492 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a4005ed40 msgr2=0x7f2a40061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:11.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a4005ed40 0x7f2a40061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2a44009dc0 tx=0x7f2a44009060).stop 2023-08-17T17:47:11.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2994140492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a541578f0 msgr2=0x7f2a54156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:47:11.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a541578f0 0x7f2a54156690 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f2a4c010000 tx=0x7f2a4c009840).stop 2023-08-17T17:47:11.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2994140492 shutdown_connections 2023-08-17T17:47:11.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a4005ed40 0x7f2a40061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:11.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a541578f0 0x7f2a54156690 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:11.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a54096520 0x7f2a54155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:11.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 --2- 172.21.15.78:0/2994140492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a540bf0e0 0x7f2a540aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:47:11.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2994140492 >> 172.21.15.78:0/2994140492 conn(0x7f2a54062f80 msgr2=0x7f2a540a7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:47:11.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2994140492 shutdown_connections 2023-08-17T17:47:11.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:47:11.135+0000 7f2a5a30e700 1 -- 172.21.15.78:0/2994140492 wait complete. 2023-08-17T17:47:11.148 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-08-17T17:47:11.149 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-08-17T17:47:11.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:11.150 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:12.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:12.166 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:13.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:13.186 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:14.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:14.206 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:15.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:15.225 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:16.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:16.245 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:17.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:17.264 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:18.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:18.282 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:19.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:19.303 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:20.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:20.323 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:21.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:21.342 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:22.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:22.362 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:23.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:23.382 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:24.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:24.403 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:25.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:25.422 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:26.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:26.441 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:27.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:27.461 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:28.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:28.481 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:29.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:29.502 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:30.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:30.522 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:31.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:31.542 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:32.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:47:32.354 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:47:32.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:32.563 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:33.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:33.582 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:34.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:34.601 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:35.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:35.622 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:36.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:36.642 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:37.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:37.662 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:38.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:38.683 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:39.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:39.702 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:40.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:40.723 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:41.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:41.743 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:42.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:42.763 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:43.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:43.782 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:44.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:44.803 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:45.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:45.822 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:46.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:46.842 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:47.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:47.862 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:48.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:48.882 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:49.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:49.901 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:50.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:50.920 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:51.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:51.942 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:52.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:52.962 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:53.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:53.983 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:55.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:55.002 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:56.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:56.023 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:57.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:57.043 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:58.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:58.063 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:47:59.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:47:59.082 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:00.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:00.102 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:00.810 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:48:00.809+0000 7f6ac5eb4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:48:00.810 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:48:00.809+0000 7f6ac5eb4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:48:00.810 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:48:00.809+0000 7f6ac5eb4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:48:00.810 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:48:00.809+0000 7f6ac5eb4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:48:00.810 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:48:00.809+0000 7f6ac5eb4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:48:01.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:01.121 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:01.139 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:01.140 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-17-17_48_00_UTC'] 2023-08-17T17:48:01.141 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692294430.8202832, now = 1692294481.1410604, timo = 50 2023-08-17T17:48:02.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:02.142 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:02.160 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:02.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:48:02.417 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:48:03.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:03.161 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:03.178 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:04.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:04.181 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:04.198 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:05.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:05.200 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:05.219 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:06.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:06.221 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:06.238 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:07.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:07.240 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:07.259 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:08.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:08.261 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:08.279 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:09.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:09.281 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:09.298 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:10.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:10.301 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:10.319 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:11.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:11.321 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:11.338 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:12.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:12.340 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:13.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:13.360 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:13.377 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:14.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:14.380 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:14.398 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:15.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:15.400 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:15.418 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:16.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:16.420 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:16.439 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:17.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:17.441 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:17.459 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:18.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:18.461 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:18.479 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:19.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:19.482 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:19.500 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:20.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:20.502 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:20.520 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:21.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:21.523 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:21.540 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:22.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:22.542 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:22.561 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:23.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:23.563 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:23.580 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:24.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:24.582 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:24.600 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:25.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:25.602 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:25.620 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:26.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:26.622 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:26.640 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:27.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:27.643 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:27.660 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:28.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:28.662 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:28.680 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:29.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:29.682 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:29.700 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:30.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:30.702 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:30.720 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:31.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:31.722 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:31.740 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:32.482 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:48:32.485 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:48:32.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:32.742 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:32.760 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:33.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:33.762 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:33.781 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:34.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:34.783 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:34.801 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:35.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:35.803 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:35.822 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:36.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:36.824 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:36.842 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:37.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:37.844 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:37.862 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:38.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:38.864 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:38.881 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:39.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:39.883 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:39.901 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:40.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:40.903 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:40.921 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:41.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:41.923 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:41.942 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:42.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:42.944 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:42.962 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:43.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:43.964 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:43.981 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:44.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:44.983 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:45.001 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:46.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:46.002 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:46.019 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:47.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:47.022 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:47.039 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:48.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:48.041 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:48.059 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:49.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:49.062 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:49.080 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:50.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:50.082 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:50.100 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:51.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:51.102 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:51.120 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:52.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:52.122 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:52.139 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:53.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:53.141 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:53.160 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:54.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:54.161 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:54.179 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:55.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:55.182 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:55.200 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:56.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:56.202 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:56.220 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:57.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:57.222 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:57.240 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:58.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:58.242 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:58.261 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:48:59.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:48:59.263 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:48:59.281 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:49:00.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:49:00.284 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:49:00.302 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:49:01.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:49:01.304 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:49:01.322 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:49:01.322 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_49_00_UTC 2023-08-17T17:49:01.323 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-17-17_49_00_UTC'] 2023-08-17T17:49:01.323 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692294430.8202832, now = 1692294541.3234005, timo = 110 2023-08-17T17:49:02.324 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-17T17:49:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.460+0000 7ff32b316700 1 Processor -- start 2023-08-17T17:49:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.460+0000 7ff32b316700 1 -- start start 2023-08-17T17:49:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.461+0000 7ff32b316700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa4d0 0x7ff3240644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.461+0000 7ff32b316700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3240649b0 con 0x7ff3240c5810 2023-08-17T17:49:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.461+0000 7ff32b316700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff324063420 con 0x7ff3240aa0f0 2023-08-17T17:49:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.461+0000 7ff32b316700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff324063700 con 0x7ff3240aa4d0 2023-08-17T17:49:02.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.461+0000 7ff3298b3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff3240c5810 0x7ff3240a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40286/0 (socket says 172.21.15.78:40286) 2023-08-17T17:49:02.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.461+0000 7ff3298b3700 1 -- 172.21.15.78:0/4165767989 learned_addr learned my addr 172.21.15.78:0/4165767989 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:02.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.461+0000 7ff3288b1700 1 --2- 172.21.15.78:0/4165767989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa4d0 0x7ff3240644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:02.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.461+0000 7ff31bfff700 1 -- 172.21.15.78:0/4165767989 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270043396 0 0) 0x7ff3240649b0 con 0x7ff3240c5810 2023-08-17T17:49:02.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.461+0000 7ff31bfff700 1 -- 172.21.15.78:0/4165767989 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3100033f0 con 0x7ff3240c5810 2023-08-17T17:49:02.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff31bfff700 1 -- 172.21.15.78:0/4165767989 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231824668 0 0) 0x7ff324063420 con 0x7ff3240aa0f0 2023-08-17T17:49:02.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff3288b1700 1 -- 172.21.15.78:0/4165767989 >> v1:172.21.15.150:6789/0 conn(0x7ff3240aa0f0 legacy=0x7ff3240c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:02.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff3288b1700 1 -- 172.21.15.78:0/4165767989 >> v1:172.21.15.78:6789/0 conn(0x7ff3240c5810 legacy=0x7ff3240a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:02.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff3288b1700 1 -- 172.21.15.78:0/4165767989 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3240639e0 con 0x7ff3240aa4d0 2023-08-17T17:49:02.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff3288b1700 1 --2- 172.21.15.78:0/4165767989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa4d0 0x7ff3240644c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7ff314009790 tx=0x7ff314009060).ready entity=mon.2 client_cookie=e1d516bcd23ec1c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:02.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff31bfff700 1 -- 172.21.15.78:0/4165767989 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0017f0 con 0x7ff3240aa4d0 2023-08-17T17:49:02.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff31bfff700 1 -- 172.21.15.78:0/4165767989 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314012410 con 0x7ff3240aa4d0 2023-08-17T17:49:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff31bfff700 1 -- 172.21.15.78:0/4165767989 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314012790 con 0x7ff3240aa4d0 2023-08-17T17:49:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff32b316700 1 -- 172.21.15.78:0/4165767989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa4d0 msgr2=0x7ff3240644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff32b316700 1 --2- 172.21.15.78:0/4165767989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa4d0 0x7ff3240644c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7ff314009790 tx=0x7ff314009060).stop 2023-08-17T17:49:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff32b316700 1 -- 172.21.15.78:0/4165767989 shutdown_connections 2023-08-17T17:49:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff32b316700 1 --2- 172.21.15.78:0/4165767989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa4d0 0x7ff3240644c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.462+0000 7ff32b316700 1 -- 172.21.15.78:0/4165767989 >> 172.21.15.78:0/4165767989 conn(0x7ff32406a6a0 msgr2=0x7ff3240caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.463+0000 7ff32b316700 1 -- 172.21.15.78:0/4165767989 shutdown_connections 2023-08-17T17:49:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.463+0000 7ff32b316700 1 -- 172.21.15.78:0/4165767989 wait complete. 2023-08-17T17:49:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.464+0000 7ff32b316700 1 Processor -- start 2023-08-17T17:49:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.464+0000 7ff32b316700 1 -- start start 2023-08-17T17:49:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff32b316700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa0f0 0x7ff3241521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff32b316700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3240aa4d0 0x7ff3240c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff32b316700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3240c5810 0x7ff324155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff32b316700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240ac570 con 0x7ff3240aa4d0 2023-08-17T17:49:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff32b316700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240ab960 con 0x7ff3240c5810 2023-08-17T17:49:02.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff32b316700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240abc40 con 0x7ff3240aa0f0 2023-08-17T17:49:02.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3288b1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3240aa4d0 0x7ff3240c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:02.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3288b1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3240aa4d0 0x7ff3240c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41362/0 (socket says 172.21.15.78:41362) 2023-08-17T17:49:02.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3288b1700 1 -- 172.21.15.78:0/2875777239 learned_addr learned my addr 172.21.15.78:0/2875777239 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:02.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3290b2700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa0f0 0x7ff3241521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:02.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3298b3700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3240c5810 0x7ff324155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3288b1700 1 -- 172.21.15.78:0/2875777239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa0f0 msgr2=0x7ff3241521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3288b1700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa0f0 0x7ff3241521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3288b1700 1 -- 172.21.15.78:0/2875777239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3240c5810 msgr2=0x7ff324155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3288b1700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3240c5810 0x7ff324155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3288b1700 1 -- 172.21.15.78:0/2875777239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140092a0 con 0x7ff3240aa4d0 2023-08-17T17:49:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.465+0000 7ff3288b1700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3240aa4d0 0x7ff3240c2f10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7ff314009e30 tx=0x7ff314009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.466+0000 7ff3197fa700 1 -- 172.21.15.78:0/2875777239 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3140118d0 con 0x7ff3240aa4d0 2023-08-17T17:49:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.466+0000 7ff32b316700 1 -- 172.21.15.78:0/2875777239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3240abf20 con 0x7ff3240aa4d0 2023-08-17T17:49:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.466+0000 7ff32b316700 1 -- 172.21.15.78:0/2875777239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3241526c0 con 0x7ff3240aa4d0 2023-08-17T17:49:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.466+0000 7ff3197fa700 1 -- 172.21.15.78:0/2875777239 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314011c40 con 0x7ff3240aa4d0 2023-08-17T17:49:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.466+0000 7ff3197fa700 1 -- 172.21.15.78:0/2875777239 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314011db0 con 0x7ff3240aa4d0 2023-08-17T17:49:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.467+0000 7ff32b316700 1 -- 172.21.15.78:0/2875777239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff324083980 con 0x7ff3240aa4d0 2023-08-17T17:49:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.467+0000 7ff3197fa700 1 -- 172.21.15.78:0/2875777239 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) v1 ==== 75339+0+0 (secure 0 0 0) 0x7ff314024030 con 0x7ff3240aa4d0 2023-08-17T17:49:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.468+0000 7ff3197fa700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff30805ee70 0x7ff308061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.468+0000 7ff3197fa700 1 -- 172.21.15.78:0/2875777239 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6409+0+0 (secure 0 0 0) 0x7ff31407adf0 con 0x7ff3240aa4d0 2023-08-17T17:49:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.468+0000 7ff3290b2700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff30805ee70 0x7ff308061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.468+0000 7ff3290b2700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff30805ee70 0x7ff308061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff320003830 tx=0x7ff320007d40).ready entity=mgr.5973 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.472+0000 7ff3197fa700 1 -- 172.21.15.78:0/2875777239 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff31404c1f0 con 0x7ff3240aa4d0 2023-08-17T17:49:02.552 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:49:02.554 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:49:02.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.664+0000 7ff32b316700 1 -- 172.21.15.78:0/2875777239 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff324046af0 con 0x7ff30805ee70 2023-08-17T17:49:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.668+0000 7ff3197fa700 1 -- 172.21.15.78:0/2875777239 <== mgr.5973 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff324046af0 con 0x7ff30805ee70 2023-08-17T17:49:02.669 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path snap_test_dir1 2023-08-17T17:49:02.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 -- 172.21.15.78:0/2875777239 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff30805ee70 msgr2=0x7ff308061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:02.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff30805ee70 0x7ff308061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff320003830 tx=0x7ff320007d40).stop 2023-08-17T17:49:02.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 -- 172.21.15.78:0/2875777239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3240aa4d0 msgr2=0x7ff3240c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3240aa4d0 0x7ff3240c2f10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7ff314009e30 tx=0x7ff314009060).stop 2023-08-17T17:49:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 -- 172.21.15.78:0/2875777239 shutdown_connections 2023-08-17T17:49:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff30805ee70 0x7ff308061330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3240c5810 0x7ff324155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3240aa0f0 0x7ff3241521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 --2- 172.21.15.78:0/2875777239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3240aa4d0 0x7ff3240c2f10 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 -- 172.21.15.78:0/2875777239 >> 172.21.15.78:0/2875777239 conn(0x7ff32406a6a0 msgr2=0x7ff324153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 -- 172.21.15.78:0/2875777239 shutdown_connections 2023-08-17T17:49:02.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:02.670+0000 7ff32b316700 1 -- 172.21.15.78:0/2875777239 wait complete. 2023-08-17T17:49:02.682 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-17T17:49:02.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:49:02.683 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:49:02.697 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:49:02.698 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_49_00_UTC 2023-08-17T17:49:02.698 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-17-17_48_00_UTC 2023-08-17T17:49:02.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:49:02.699 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-17-17_48_00_UTC) 2023-08-17T17:49:02.758 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-17-17_49_00_UTC 2023-08-17T17:49:02.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:49:02.759 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-17-17_49_00_UTC) 2023-08-17T17:49:02.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:49:02.819 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-17T17:49:02.876 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-17T17:49:03.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.028+0000 7fc077009700 1 Processor -- start 2023-08-17T17:49:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.028+0000 7fc077009700 1 -- start start 2023-08-17T17:49:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc077009700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc0700aa0f0 0x7fc0700644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc077009700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0700c5810 0x7fc0700c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc077009700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0700649b0 con 0x7fc0700aa4d0 2023-08-17T17:49:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc077009700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0700c6170 con 0x7fc0700c5810 2023-08-17T17:49:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc077009700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc070063420 con 0x7fc0700aa0f0 2023-08-17T17:49:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc0755a6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0700c5810 0x7fc0700c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc0755a6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0700c5810 0x7fc0700c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41370/0 (socket says 172.21.15.78:41370) 2023-08-17T17:49:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc0755a6700 1 -- 172.21.15.78:0/1150161670 learned_addr learned my addr 172.21.15.78:0/1150161670 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc0755a6700 1 -- 172.21.15.78:0/1150161670 >> v2:172.21.15.150:3300/0 conn(0x7fc0700aa0f0 msgr2=0x7fc0700644c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-17T17:49:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc0755a6700 1 --2- 172.21.15.78:0/1150161670 >> v2:172.21.15.150:3300/0 conn(0x7fc0700aa0f0 0x7fc0700644c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc0755a6700 1 -- 172.21.15.78:0/1150161670 >> v1:172.21.15.150:6789/0 conn(0x7fc0700aa4d0 legacy=0x7fc0700c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.029+0000 7fc0755a6700 1 -- 172.21.15.78:0/1150161670 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070063700 con 0x7fc0700c5810 2023-08-17T17:49:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc0755a6700 1 --2- 172.21.15.78:0/1150161670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700c5810 0x7fc0700c5c80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fc0700cade0 tx=0x7fc068009840).ready entity=mon.0 client_cookie=9641ddf2239f639f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:03.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc0677fe700 1 -- 172.21.15.78:0/1150161670 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06800e070 con 0x7fc0700c5810 2023-08-17T17:49:03.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc0677fe700 1 -- 172.21.15.78:0/1150161670 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06800ba10 con 0x7fc0700c5810 2023-08-17T17:49:03.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc0677fe700 1 -- 172.21.15.78:0/1150161670 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06800bd90 con 0x7fc0700c5810 2023-08-17T17:49:03.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc077009700 1 -- 172.21.15.78:0/1150161670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700c5810 msgr2=0x7fc0700c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:03.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc077009700 1 --2- 172.21.15.78:0/1150161670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700c5810 0x7fc0700c5c80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fc0700cade0 tx=0x7fc068009840).stop 2023-08-17T17:49:03.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc077009700 1 -- 172.21.15.78:0/1150161670 shutdown_connections 2023-08-17T17:49:03.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc077009700 1 --2- 172.21.15.78:0/1150161670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700c5810 0x7fc0700c5c80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:03.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc077009700 1 --2- 172.21.15.78:0/1150161670 >> v2:172.21.15.150:3300/0 conn(0x7fc0700aa0f0 0x7fc0700644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc077009700 1 -- 172.21.15.78:0/1150161670 >> 172.21.15.78:0/1150161670 conn(0x7fc07006a6a0 msgr2=0x7fc0700caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc077009700 1 -- 172.21.15.78:0/1150161670 shutdown_connections 2023-08-17T17:49:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.030+0000 7fc077009700 1 -- 172.21.15.78:0/1150161670 wait complete. 2023-08-17T17:49:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.031+0000 7fc077009700 1 Processor -- start 2023-08-17T17:49:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc077009700 1 -- start start 2023-08-17T17:49:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc077009700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700aa0f0 0x7fc070146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc077009700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0700aa4d0 0x7fc070153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc077009700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0700c5810 0x7fc070153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:03.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc077009700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070154170 con 0x7fc0700aa0f0 2023-08-17T17:49:03.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc077009700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700c1ac0 con 0x7fc0700aa4d0 2023-08-17T17:49:03.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc077009700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700c2360 con 0x7fc0700c5810 2023-08-17T17:49:03.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc074da5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700aa0f0 0x7fc070146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:03.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc074da5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700aa0f0 0x7fc070146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41382/0 (socket says 172.21.15.78:41382) 2023-08-17T17:49:03.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc074da5700 1 -- 172.21.15.78:0/549054048 learned_addr learned my addr 172.21.15.78:0/549054048 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:03.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc067fff700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0700aa4d0 0x7fc070153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.032+0000 7fc0755a6700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0700c5810 0x7fc070153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc074da5700 1 -- 172.21.15.78:0/549054048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0700c5810 msgr2=0x7fc070153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc074da5700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0700c5810 0x7fc070153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc074da5700 1 -- 172.21.15.78:0/549054048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0700aa4d0 msgr2=0x7fc070153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc074da5700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0700aa4d0 0x7fc070153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc074da5700 1 -- 172.21.15.78:0/549054048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068009ae0 con 0x7fc0700aa0f0 2023-08-17T17:49:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc067fff700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0700aa4d0 0x7fc070153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc0755a6700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0700c5810 0x7fc070153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc074da5700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700aa0f0 0x7fc070146f20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fc06c00b490 tx=0x7fc06c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc064ff9700 1 -- 172.21.15.78:0/549054048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c012410 con 0x7fc0700aa0f0 2023-08-17T17:49:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc064ff9700 1 -- 172.21.15.78:0/549054048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c0125b0 con 0x7fc0700aa0f0 2023-08-17T17:49:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc077009700 1 -- 172.21.15.78:0/549054048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc070147410 con 0x7fc0700aa0f0 2023-08-17T17:49:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc064ff9700 1 -- 172.21.15.78:0/549054048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c012970 con 0x7fc0700aa0f0 2023-08-17T17:49:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.033+0000 7fc077009700 1 -- 172.21.15.78:0/549054048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0700c1d10 con 0x7fc0700aa0f0 2023-08-17T17:49:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.034+0000 7fc077009700 1 -- 172.21.15.78:0/549054048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0700c2640 con 0x7fc0700aa0f0 2023-08-17T17:49:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.034+0000 7fc064ff9700 1 -- 172.21.15.78:0/549054048 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fc06c00f030 con 0x7fc0700aa0f0 2023-08-17T17:49:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.035+0000 7fc064ff9700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc05c05ee70 0x7fc05c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.035+0000 7fc064ff9700 1 -- 172.21.15.78:0/549054048 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6409+0+0 (secure 0 0 0) 0x7fc06c079a80 con 0x7fc0700aa0f0 2023-08-17T17:49:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.035+0000 7fc067fff700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc05c05ee70 0x7fc05c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.035+0000 7fc067fff700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc05c05ee70 0x7fc05c061330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fc060006fd0 tx=0x7fc060008040).ready entity=mgr.5973 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.039+0000 7fc064ff9700 1 -- 172.21.15.78:0/549054048 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc06c04add0 con 0x7fc0700aa0f0 2023-08-17T17:49:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:03.247+0000 7fc077009700 1 -- 172.21.15.78:0/549054048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fc070046af0 con 0x7fc0700aa0f0 2023-08-17T17:49:04.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.257+0000 7fc064ff9700 1 -- 172.21.15.78:0/549054048 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fc06c012d20 con 0x7fc0700aa0f0 2023-08-17T17:49:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.259+0000 7fc064ff9700 1 -- 172.21.15.78:0/549054048 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v21) v1 ==== 93+0+0 (secure 0 0 0) 0x7fc06c073020 con 0x7fc0700aa0f0 2023-08-17T17:49:04.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 -- 172.21.15.78:0/549054048 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc05c05ee70 msgr2=0x7fc05c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:04.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc05c05ee70 0x7fc05c061330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fc060006fd0 tx=0x7fc060008040).stop 2023-08-17T17:49:04.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 -- 172.21.15.78:0/549054048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700aa0f0 msgr2=0x7fc070146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:04.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700aa0f0 0x7fc070146f20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fc06c00b490 tx=0x7fc06c009060).stop 2023-08-17T17:49:04.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 -- 172.21.15.78:0/549054048 shutdown_connections 2023-08-17T17:49:04.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc05c05ee70 0x7fc05c061330 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0700c5810 0x7fc070153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0700aa0f0 0x7fc070146f20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 --2- 172.21.15.78:0/549054048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0700aa4d0 0x7fc070153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 -- 172.21.15.78:0/549054048 >> 172.21.15.78:0/549054048 conn(0x7fc07006a6a0 msgr2=0x7fc070152df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:04.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 -- 172.21.15.78:0/549054048 shutdown_connections 2023-08-17T17:49:04.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.261+0000 7fc077009700 1 -- 172.21.15.78:0/549054048 wait complete. 2023-08-17T17:49:04.276 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:49:04.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:49:04.315 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:49:04.358 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:49:04.358 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T17:49:04.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:49:04.359 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T17:49:04.402 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:49:04.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:49:04.402 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T17:49:04.403 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:04.400+0000 7fc05343b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:49:04.403 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:04.400+0000 7f3967a7a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:49:04.457 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:04.465 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:04.464+0000 7f3967a7a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:49:04.467 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:04.466+0000 7fc05343b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:49:04.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.581+0000 7fd2915b4700 1 Processor -- start 2023-08-17T17:49:04.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.581+0000 7fd2915b4700 1 -- start start 2023-08-17T17:49:04.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.582+0000 7fd2915b4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd28c066660 0x7fd28c0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.582+0000 7fd2915b4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c066a40 0x7fd28c151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.582+0000 7fd2915b4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28c0c6040 con 0x7fd28c0c5b50 2023-08-17T17:49:04.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.582+0000 7fd2915b4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28c069b00 con 0x7fd28c066660 2023-08-17T17:49:04.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.582+0000 7fd2915b4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c069f90 con 0x7fd28c066a40 2023-08-17T17:49:04.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c066a40 0x7fd28c151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:04.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28affd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd28c066660 0x7fd28c0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:04.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28affd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd28c066660 0x7fd28c0c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:47124/0 (socket says 172.21.15.78:47124) 2023-08-17T17:49:04.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c066a40 0x7fd28c151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:54644/0 (socket says 172.21.15.78:54644) 2023-08-17T17:49:04.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28a7fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd28c0c5b50 0x7fd28c0624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:55072/0 (socket says 172.21.15.78:55072) 2023-08-17T17:49:04.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28affd700 1 -- 172.21.15.78:0/3758172190 learned_addr learned my addr 172.21.15.78:0/3758172190 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:04.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28affd700 1 -- 172.21.15.78:0/3758172190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c066a40 msgr2=0x7fd28c151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:04.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28affd700 1 --2- 172.21.15.78:0/3758172190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c066a40 0x7fd28c151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28affd700 1 -- 172.21.15.78:0/3758172190 >> v1:172.21.15.150:6789/0 conn(0x7fd28c0c5b50 legacy=0x7fd28c0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:04.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28affd700 1 -- 172.21.15.78:0/3758172190 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0691d0 con 0x7fd28c066660 2023-08-17T17:49:04.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28b7fe700 1 --2- 172.21.15.78:0/3758172190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c066a40 0x7fd28c151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:04.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd28affd700 1 --2- 172.21.15.78:0/3758172190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd28c066660 0x7fd28c0c5660 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fd280006fd0 tx=0x7fd2800090f0).ready entity=mon.1 client_cookie=15a229653c0f3faf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.583+0000 7fd289ffb700 1 -- 172.21.15.78:0/3758172190 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000b580 con 0x7fd28c066660 2023-08-17T17:49:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.584+0000 7fd289ffb700 1 -- 172.21.15.78:0/3758172190 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28000b6e0 con 0x7fd28c066660 2023-08-17T17:49:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.584+0000 7fd289ffb700 1 -- 172.21.15.78:0/3758172190 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000ba60 con 0x7fd28c066660 2023-08-17T17:49:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.584+0000 7fd2915b4700 1 -- 172.21.15.78:0/3758172190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd28c066660 msgr2=0x7fd28c0c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.584+0000 7fd2915b4700 1 --2- 172.21.15.78:0/3758172190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd28c066660 0x7fd28c0c5660 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fd280006fd0 tx=0x7fd2800090f0).stop 2023-08-17T17:49:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.584+0000 7fd2915b4700 1 -- 172.21.15.78:0/3758172190 shutdown_connections 2023-08-17T17:49:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.584+0000 7fd2915b4700 1 --2- 172.21.15.78:0/3758172190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c066a40 0x7fd28c151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.584+0000 7fd2915b4700 1 --2- 172.21.15.78:0/3758172190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd28c066660 0x7fd28c0c5660 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.584+0000 7fd2915b4700 1 -- 172.21.15.78:0/3758172190 >> 172.21.15.78:0/3758172190 conn(0x7fd28c0c7b00 msgr2=0x7fd28c0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:04.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.584+0000 7fd2915b4700 1 -- 172.21.15.78:0/3758172190 shutdown_connections 2023-08-17T17:49:04.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.584+0000 7fd2915b4700 1 -- 172.21.15.78:0/3758172190 wait complete. 2023-08-17T17:49:04.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.585+0000 7fd2915b4700 1 Processor -- start 2023-08-17T17:49:04.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.585+0000 7fd2915b4700 1 -- start start 2023-08-17T17:49:04.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd2915b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd28c066660 0x7fd28c147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd2915b4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd28c066a40 0x7fd28c0ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd2915b4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c0c5b50 0x7fd28c0ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd2915b4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c43c0 con 0x7fd28c066660 2023-08-17T17:49:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd2915b4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0ad480 con 0x7fd28c066a40 2023-08-17T17:49:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd2915b4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c4910 con 0x7fd28c0c5b50 2023-08-17T17:49:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd28affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd28c066660 0x7fd28c147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd28affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd28c066660 0x7fd28c147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41408/0 (socket says 172.21.15.78:41408) 2023-08-17T17:49:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd28affd700 1 -- 172.21.15.78:0/3005786640 learned_addr learned my addr 172.21.15.78:0/3005786640 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd28a7fc700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd28c066a40 0x7fd28c0ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.586+0000 7fd28b7fe700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c0c5b50 0x7fd28c0ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd28affd700 1 -- 172.21.15.78:0/3005786640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c0c5b50 msgr2=0x7fd28c0ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd28affd700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c0c5b50 0x7fd28c0ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd28affd700 1 -- 172.21.15.78:0/3005786640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd28c066a40 msgr2=0x7fd28c0ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd28affd700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd28c066a40 0x7fd28c0ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd28affd700 1 -- 172.21.15.78:0/3005786640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284009a20 con 0x7fd28c066660 2023-08-17T17:49:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd28b7fe700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c0c5b50 0x7fd28c0ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd28a7fc700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd28c066a40 0x7fd28c0ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd28affd700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd28c066660 0x7fd28c147f60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fd280009130 tx=0x7fd280017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd272ffd700 1 -- 172.21.15.78:0/3005786640 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000b850 con 0x7fd28c066660 2023-08-17T17:49:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd272ffd700 1 -- 172.21.15.78:0/3005786640 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28000b9b0 con 0x7fd28c066660 2023-08-17T17:49:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd272ffd700 1 -- 172.21.15.78:0/3005786640 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28001c670 con 0x7fd28c066660 2023-08-17T17:49:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd2915b4700 1 -- 172.21.15.78:0/3005786640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd280009370 con 0x7fd28c066660 2023-08-17T17:49:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.587+0000 7fd2915b4700 1 -- 172.21.15.78:0/3005786640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c0ad1a0 con 0x7fd28c066660 2023-08-17T17:49:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.588+0000 7fd2915b4700 1 -- 172.21.15.78:0/3005786640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c047350 con 0x7fd28c066660 2023-08-17T17:49:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.589+0000 7fd272ffd700 1 -- 172.21.15.78:0/3005786640 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fd28002c070 con 0x7fd28c066660 2023-08-17T17:49:04.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.589+0000 7fd272ffd700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd27805edf0 0x7fd2780612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.589+0000 7fd28a7fc700 1 -- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd27805edf0 msgr2=0x7fd2780612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:04.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.589+0000 7fd272ffd700 1 -- 172.21.15.78:0/3005786640 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6409+0+0 (secure 0 0 0) 0x7fd28007b870 con 0x7fd28c066660 2023-08-17T17:49:04.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.589+0000 7fd28a7fc700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd27805edf0 0x7fd2780612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:04.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.593+0000 7fd272ffd700 1 -- 172.21.15.78:0/3005786640 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd28004ccd0 con 0x7fd28c066660 2023-08-17T17:49:04.742 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:04.739+0000 7f3967a7a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:49:04.753 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:04.752+0000 7fc05343b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:49:04.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.790+0000 7fd28a7fc700 1 -- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd27805edf0 msgr2=0x7fd2780612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:04.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.790+0000 7fd28a7fc700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd27805edf0 0x7fd2780612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:04.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.807+0000 7fd2915b4700 1 -- 172.21.15.78:0/3005786640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd28c0c5010 con 0x7fd28c066660 2023-08-17T17:49:04.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.808+0000 7fd272ffd700 1 -- 172.21.15.78:0/3005786640 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fd28002a020 con 0x7fd28c066660 2023-08-17T17:49:04.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:04.809 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5090,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2346190042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2346190042},{"type":"v1","addr":"172.21.15.150:6834","nonce":2346190042}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2674101879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2674101879},{"type":"v1","addr":"172.21.15.78:6837","nonce":2674101879}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5745,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1609000139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1609000139},{"type":"v1","addr":"172.21.15.78:6836","nonce":1609000139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:46:53.930414+0000","modified":"2023-08-17T17:46:55.941460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/412084175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":412084175},{"type":"v1","addr":"172.21.15.150:6835","nonce":412084175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T17:49:04.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 -- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd27805edf0 msgr2=0x7fd2780612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:04.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd27805edf0 0x7fd2780612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:04.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 -- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd28c066660 msgr2=0x7fd28c147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:04.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd28c066660 0x7fd28c147f60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fd280009130 tx=0x7fd280017000).stop 2023-08-17T17:49:04.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 -- 172.21.15.78:0/3005786640 shutdown_connections 2023-08-17T17:49:04.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd27805edf0 0x7fd2780612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:04.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd28c0c5b50 0x7fd28c0ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd28c066660 0x7fd28c147f60 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 --2- 172.21.15.78:0/3005786640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd28c066a40 0x7fd28c0ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 -- 172.21.15.78:0/3005786640 >> 172.21.15.78:0/3005786640 conn(0x7fd28c0c7b00 msgr2=0x7fd28c153800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 -- 172.21.15.78:0/3005786640 shutdown_connections 2023-08-17T17:49:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.810+0000 7fd2915b4700 1 -- 172.21.15.78:0/3005786640 wait complete. 2023-08-17T17:49:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 19 2023-08-17T17:49:04.824 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:04.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.940+0000 7f4090a3e700 1 Processor -- start 2023-08-17T17:49:04.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.940+0000 7f4090a3e700 1 -- start start 2023-08-17T17:49:04.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.941+0000 7f4090a3e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f408c0bd8e0 0x7f408c1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.941+0000 7f4090a3e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f408c153ad0 0x7f408c0bc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.941+0000 7f4090a3e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c068110 con 0x7f408c0c62f0 2023-08-17T17:49:04.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.941+0000 7f4090a3e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c0bdd40 con 0x7f408c0bd8e0 2023-08-17T17:49:04.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.941+0000 7f4090a3e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0638d0 con 0x7f408c153ad0 2023-08-17T17:49:04.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.941+0000 7f4082ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f408c0bd8e0 0x7f408c1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:04.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.941+0000 7f408bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f408c153ad0 0x7f408c0bc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:04.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.941+0000 7f408b7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f408c0c62f0 0x7f408c0c66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:55074/0 (socket says 172.21.15.78:55074) 2023-08-17T17:49:04.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.941+0000 7f4082ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f408c0bd8e0 0x7f408c1535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:47130/0 (socket says 172.21.15.78:47130) 2023-08-17T17:49:04.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.941+0000 7f408b7fe700 1 -- 172.21.15.78:0/1314850139 learned_addr learned my addr 172.21.15.78:0/1314850139 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:04.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f408bfff700 1 -- 172.21.15.78:0/1314850139 >> v2:172.21.15.150:3300/0 conn(0x7f408c0bd8e0 msgr2=0x7f408c1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:04.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f408bfff700 1 --2- 172.21.15.78:0/1314850139 >> v2:172.21.15.150:3300/0 conn(0x7f408c0bd8e0 0x7f408c1535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f408bfff700 1 -- 172.21.15.78:0/1314850139 >> v1:172.21.15.150:6789/0 conn(0x7f408c0c62f0 legacy=0x7f408c0c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:04.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f408affd700 1 -- 172.21.15.78:0/1314850139 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291340773 0 0) 0x7f408c068110 con 0x7f408c0c62f0 2023-08-17T17:49:04.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f408bfff700 1 -- 172.21.15.78:0/1314850139 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0bdf80 con 0x7f408c153ad0 2023-08-17T17:49:04.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f4082ffd700 1 --2- 172.21.15.78:0/1314850139 >> v2:172.21.15.150:3300/0 conn(0x7f408c0bd8e0 0x7f408c1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:04.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f408bfff700 1 --2- 172.21.15.78:0/1314850139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f408c153ad0 0x7f408c0bc130 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4084009e60 tx=0x7f4084009780).ready entity=mon.2 client_cookie=f5587f5e34c5fa9e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:04.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f408affd700 1 -- 172.21.15.78:0/1314850139 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400e070 con 0x7f408c153ad0 2023-08-17T17:49:04.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f408affd700 1 -- 172.21.15.78:0/1314850139 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408400bb60 con 0x7f408c153ad0 2023-08-17T17:49:04.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f408affd700 1 -- 172.21.15.78:0/1314850139 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084012410 con 0x7f408c153ad0 2023-08-17T17:49:04.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f4090a3e700 1 -- 172.21.15.78:0/1314850139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f408c153ad0 msgr2=0x7f408c0bc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:04.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f4090a3e700 1 --2- 172.21.15.78:0/1314850139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f408c153ad0 0x7f408c0bc130 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4084009e60 tx=0x7f4084009780).stop 2023-08-17T17:49:04.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f4090a3e700 1 -- 172.21.15.78:0/1314850139 shutdown_connections 2023-08-17T17:49:04.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.942+0000 7f4090a3e700 1 --2- 172.21.15.78:0/1314850139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f408c153ad0 0x7f408c0bc130 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.943+0000 7f4090a3e700 1 --2- 172.21.15.78:0/1314850139 >> v2:172.21.15.150:3300/0 conn(0x7f408c0bd8e0 0x7f408c1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.943+0000 7f4090a3e700 1 -- 172.21.15.78:0/1314850139 >> 172.21.15.78:0/1314850139 conn(0x7f408c0aabf0 msgr2=0x7f408c0ac270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:04.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.943+0000 7f4090a3e700 1 -- 172.21.15.78:0/1314850139 shutdown_connections 2023-08-17T17:49:04.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.943+0000 7f4090a3e700 1 -- 172.21.15.78:0/1314850139 wait complete. 2023-08-17T17:49:04.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.944+0000 7f4090a3e700 1 Processor -- start 2023-08-17T17:49:04.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.944+0000 7f4090a3e700 1 -- start start 2023-08-17T17:49:04.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f4090a3e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f408c0bd8e0 0x7f408c14fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f4090a3e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f408c0c62f0 0x7f408c0c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f4090a3e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c153ad0 0x7f408c0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f4090a3e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0a8ec0 con 0x7f408c153ad0 2023-08-17T17:49:04.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f4090a3e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0c7b40 con 0x7f408c0bd8e0 2023-08-17T17:49:04.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f4090a3e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0c1e30 con 0x7f408c0c62f0 2023-08-17T17:49:04.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c153ad0 0x7f408c0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:04.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f408c0bd8e0 0x7f408c14fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:04.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c153ad0 0x7f408c0c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41412/0 (socket says 172.21.15.78:41412) 2023-08-17T17:49:04.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f408c0bd8e0 0x7f408c14fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:47136/0 (socket says 172.21.15.78:47136) 2023-08-17T17:49:04.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408bfff700 1 -- 172.21.15.78:0/872025644 learned_addr learned my addr 172.21.15.78:0/872025644 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:04.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408bfff700 1 -- 172.21.15.78:0/872025644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f408c0c62f0 msgr2=0x7f408c0c7160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-17T17:49:04.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408bfff700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f408c0c62f0 0x7f408c0c7160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:04.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408bfff700 1 -- 172.21.15.78:0/872025644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f408c0bd8e0 msgr2=0x7f408c14fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:04.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408bfff700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f408c0bd8e0 0x7f408c14fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:04.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408bfff700 1 -- 172.21.15.78:0/872025644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40740092a0 con 0x7f408c153ad0 2023-08-17T17:49:04.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408b7fe700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f408c0bd8e0 0x7f408c14fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:04.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f408bfff700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c153ad0 0x7f408c0c7650 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f408400b6c0 tx=0x7f4084009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:04.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f4083fff700 1 -- 172.21.15.78:0/872025644 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408401d630 con 0x7f408c153ad0 2023-08-17T17:49:04.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f4083fff700 1 -- 172.21.15.78:0/872025644 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408401d790 con 0x7f408c153ad0 2023-08-17T17:49:04.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f4090a3e700 1 -- 172.21.15.78:0/872025644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4084009a20 con 0x7f408c153ad0 2023-08-17T17:49:04.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.945+0000 7f4083fff700 1 -- 172.21.15.78:0/872025644 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408401db50 con 0x7f408c153ad0 2023-08-17T17:49:04.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.946+0000 7f4090a3e700 1 -- 172.21.15.78:0/872025644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c0a8620 con 0x7f408c153ad0 2023-08-17T17:49:04.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.947+0000 7f4090a3e700 1 -- 172.21.15.78:0/872025644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c0c4d60 con 0x7f408c153ad0 2023-08-17T17:49:04.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.947+0000 7f4083fff700 1 -- 172.21.15.78:0/872025644 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f4084026410 con 0x7f408c153ad0 2023-08-17T17:49:04.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.947+0000 7f4083fff700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f406c05ee20 0x7f406c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:04.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.947+0000 7f408b7fe700 1 -- 172.21.15.78:0/872025644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f406c05ee20 msgr2=0x7f406c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:04.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.948+0000 7f4083fff700 1 -- 172.21.15.78:0/872025644 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6409+0+0 (secure 0 0 0) 0x7f408407c0b0 con 0x7f408c153ad0 2023-08-17T17:49:04.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.948+0000 7f408b7fe700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f406c05ee20 0x7f406c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:04.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:04.952+0000 7f4083fff700 1 -- 172.21.15.78:0/872025644 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f408404d490 con 0x7f408c153ad0 2023-08-17T17:49:05.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.124+0000 7f4090a3e700 1 -- 172.21.15.78:0/872025644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f408c062fa0 con 0x7f408c153ad0 2023-08-17T17:49:05.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.124+0000 7f4083fff700 1 -- 172.21.15.78:0/872025644 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+17411 (secure 0 0 0) 0x7f4084050ab0 con 0x7f408c153ad0 2023-08-17T17:49:05.126 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:05.126 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":63,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:48:11.254981+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:46:52.467922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T17:46:52.895738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"8.21","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1630605532":"2023-08-18T17:47:09.437078+0000","172.21.15.78:6833/119464":"2023-08-18T17:47:09.437078+0000","172.21.15.78:6832/119464":"2023-08-18T17:47:09.437078+0000","172.21.15.78:0/4202278981":"2023-08-18T17:47:09.437078+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:05.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 -- 172.21.15.78:0/872025644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f406c05ee20 msgr2=0x7f406c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:05.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f406c05ee20 0x7f406c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 -- 172.21.15.78:0/872025644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c153ad0 msgr2=0x7f408c0c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c153ad0 0x7f408c0c7650 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f408400b6c0 tx=0x7f4084009780).stop 2023-08-17T17:49:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 -- 172.21.15.78:0/872025644 shutdown_connections 2023-08-17T17:49:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f406c05ee20 0x7f406c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c153ad0 0x7f408c0c7650 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f408c0bd8e0 0x7f408c14fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 --2- 172.21.15.78:0/872025644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f408c0c62f0 0x7f408c0c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 -- 172.21.15.78:0/872025644 >> 172.21.15.78:0/872025644 conn(0x7f408c0aabf0 msgr2=0x7f408c064980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 -- 172.21.15.78:0/872025644 shutdown_connections 2023-08-17T17:49:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.127+0000 7f4090a3e700 1 -- 172.21.15.78:0/872025644 wait complete. 2023-08-17T17:49:05.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:46:52.467922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:46:52.895738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:49:05.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:49:05.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.264+0000 7f0c45b67700 1 Processor -- start 2023-08-17T17:49:05.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.264+0000 7f0c45b67700 1 -- start start 2023-08-17T17:49:05.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.265+0000 7f0c45b67700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0c40153ee0 0x7f0c400c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.265+0000 7f0c45b67700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c400bc2e0 0x7f0c400bc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.265+0000 7f0c45b67700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4006b420 con 0x7f0c401542c0 2023-08-17T17:49:05.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.265+0000 7f0c45b67700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c400c7170 con 0x7f0c40153ee0 2023-08-17T17:49:05.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.265+0000 7f0c45b67700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c40062ec0 con 0x7f0c400bc2e0 2023-08-17T17:49:05.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.265+0000 7f0c44b65700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0c40153ee0 0x7f0c400c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.265+0000 7f0c3ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0c401542c0 0x7f0c400c1d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40302/0 (socket says 172.21.15.78:40302) 2023-08-17T17:49:05.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.265+0000 7f0c3ffff700 1 -- 172.21.15.78:0/1156886889 learned_addr learned my addr 172.21.15.78:0/1156886889 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:05.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.265+0000 7f0c45366700 1 --2- 172.21.15.78:0/1156886889 >> v2:172.21.15.150:3300/0 conn(0x7f0c400bc2e0 0x7f0c400bc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.266+0000 7f0c44b65700 1 -- 172.21.15.78:0/1156886889 >> v2:172.21.15.150:3300/0 conn(0x7f0c400bc2e0 msgr2=0x7f0c400bc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:05.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.266+0000 7f0c44b65700 1 --2- 172.21.15.78:0/1156886889 >> v2:172.21.15.150:3300/0 conn(0x7f0c400bc2e0 0x7f0c400bc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.266+0000 7f0c44b65700 1 -- 172.21.15.78:0/1156886889 >> v1:172.21.15.78:6789/0 conn(0x7f0c401542c0 legacy=0x7f0c400c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.266+0000 7f0c3f7fe700 1 -- 172.21.15.78:0/1156886889 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202133065 0 0) 0x7f0c4006b420 con 0x7f0c401542c0 2023-08-17T17:49:05.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.266+0000 7f0c44b65700 1 -- 172.21.15.78:0/1156886889 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4006b700 con 0x7f0c40153ee0 2023-08-17T17:49:05.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.266+0000 7f0c44b65700 1 --2- 172.21.15.78:0/1156886889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c40153ee0 0x7f0c400c6bd0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f0c40064670 tx=0x7f0c34009060).ready entity=mon.0 client_cookie=db3bcbbc788dcb5b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:05.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.266+0000 7f0c3f7fe700 1 -- 172.21.15.78:0/1156886889 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400f510 con 0x7f0c40153ee0 2023-08-17T17:49:05.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.266+0000 7f0c3f7fe700 1 -- 172.21.15.78:0/1156886889 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3400f670 con 0x7f0c40153ee0 2023-08-17T17:49:05.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.266+0000 7f0c3f7fe700 1 -- 172.21.15.78:0/1156886889 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400f9f0 con 0x7f0c40153ee0 2023-08-17T17:49:05.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.267+0000 7f0c45b67700 1 -- 172.21.15.78:0/1156886889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c40153ee0 msgr2=0x7f0c400c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.267+0000 7f0c45b67700 1 --2- 172.21.15.78:0/1156886889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c40153ee0 0x7f0c400c6bd0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f0c40064670 tx=0x7f0c34009060).stop 2023-08-17T17:49:05.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.267+0000 7f0c45b67700 1 -- 172.21.15.78:0/1156886889 shutdown_connections 2023-08-17T17:49:05.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.267+0000 7f0c45b67700 1 --2- 172.21.15.78:0/1156886889 >> v2:172.21.15.150:3300/0 conn(0x7f0c400bc2e0 0x7f0c400bc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.267+0000 7f0c45b67700 1 --2- 172.21.15.78:0/1156886889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c40153ee0 0x7f0c400c6bd0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.267+0000 7f0c45b67700 1 -- 172.21.15.78:0/1156886889 >> 172.21.15.78:0/1156886889 conn(0x7f0c400c3e20 msgr2=0x7f0c400c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:05.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.267+0000 7f0c45b67700 1 -- 172.21.15.78:0/1156886889 shutdown_connections 2023-08-17T17:49:05.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.267+0000 7f0c45b67700 1 -- 172.21.15.78:0/1156886889 wait complete. 2023-08-17T17:49:05.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.268+0000 7f0c45b67700 1 Processor -- start 2023-08-17T17:49:05.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.268+0000 7f0c45b67700 1 -- start start 2023-08-17T17:49:05.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c45b67700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400bc2e0 0x7f0c401501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c45b67700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c40153ee0 0x7f0c400abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c45b67700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c401542c0 0x7f0c400650a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c45b67700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400a8e20 con 0x7f0c400bc2e0 2023-08-17T17:49:05.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c45b67700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400a8210 con 0x7f0c40153ee0 2023-08-17T17:49:05.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c45b67700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400a84f0 con 0x7f0c401542c0 2023-08-17T17:49:05.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c44b65700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400bc2e0 0x7f0c401501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c44b65700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400bc2e0 0x7f0c401501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41434/0 (socket says 172.21.15.78:41434) 2023-08-17T17:49:05.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c44b65700 1 -- 172.21.15.78:0/2136411225 learned_addr learned my addr 172.21.15.78:0/2136411225 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:05.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c3ffff700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c40153ee0 0x7f0c400abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c45366700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c401542c0 0x7f0c400650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c44b65700 1 -- 172.21.15.78:0/2136411225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c401542c0 msgr2=0x7f0c400650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c44b65700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c401542c0 0x7f0c400650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c44b65700 1 -- 172.21.15.78:0/2136411225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c40153ee0 msgr2=0x7f0c400abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c44b65700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c40153ee0 0x7f0c400abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c44b65700 1 -- 172.21.15.78:0/2136411225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340092a0 con 0x7f0c400bc2e0 2023-08-17T17:49:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c44b65700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400bc2e0 0x7f0c401501a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f0c34009dd0 tx=0x7f0c34017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c3cff9700 1 -- 172.21.15.78:0/2136411225 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400f7e0 con 0x7f0c400bc2e0 2023-08-17T17:49:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c3cff9700 1 -- 172.21.15.78:0/2136411225 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3400f940 con 0x7f0c400bc2e0 2023-08-17T17:49:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.269+0000 7f0c45b67700 1 -- 172.21.15.78:0/2136411225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c400a87d0 con 0x7f0c400bc2e0 2023-08-17T17:49:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.270+0000 7f0c3cff9700 1 -- 172.21.15.78:0/2136411225 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3401b660 con 0x7f0c400bc2e0 2023-08-17T17:49:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.270+0000 7f0c45b67700 1 -- 172.21.15.78:0/2136411225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c400a7e30 con 0x7f0c400bc2e0 2023-08-17T17:49:05.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.270+0000 7f0c45b67700 1 -- 172.21.15.78:0/2136411225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4005f910 con 0x7f0c400bc2e0 2023-08-17T17:49:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.271+0000 7f0c3cff9700 1 -- 172.21.15.78:0/2136411225 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f0c3400f070 con 0x7f0c400bc2e0 2023-08-17T17:49:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.271+0000 7f0c3cff9700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0c2405ee20 0x7f0c240612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.271+0000 7f0c3ffff700 1 -- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0c2405ee20 msgr2=0x7f0c240612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:05.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.271+0000 7f0c3cff9700 1 -- 172.21.15.78:0/2136411225 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f0c3407b5a0 con 0x7f0c400bc2e0 2023-08-17T17:49:05.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.271+0000 7f0c3ffff700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0c2405ee20 0x7f0c240612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:05.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.275+0000 7f0c3cff9700 1 -- 172.21.15.78:0/2136411225 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0c3404c9c0 con 0x7f0c400bc2e0 2023-08-17T17:49:05.358 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:05.357+0000 7f3967a7a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:49:05.399 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:05.398+0000 7fc05343b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:49:05.432 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:05.431+0000 7f3967a7a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:49:05.472 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:05.471+0000 7fc05343b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:49:05.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.472+0000 7f0c3ffff700 1 -- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0c2405ee20 msgr2=0x7f0c240612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:05.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.472+0000 7f0c3ffff700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0c2405ee20 0x7f0c240612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:05.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.480+0000 7f0c45b67700 1 -- 172.21.15.78:0/2136411225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0c40046af0 con 0x7f0c400bc2e0 2023-08-17T17:49:05.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.481+0000 7f0c3cff9700 1 -- 172.21.15.78:0/2136411225 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v64) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0c3404ffe0 con 0x7f0c400bc2e0 2023-08-17T17:49:05.482 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:49:05.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 -- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0c2405ee20 msgr2=0x7f0c240612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:05.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0c2405ee20 0x7f0c240612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 -- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400bc2e0 msgr2=0x7f0c401501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400bc2e0 0x7f0c401501a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f0c34009dd0 tx=0x7f0c34017000).stop 2023-08-17T17:49:05.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 -- 172.21.15.78:0/2136411225 shutdown_connections 2023-08-17T17:49:05.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0c2405ee20 0x7f0c240612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c401542c0 0x7f0c400650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400bc2e0 0x7f0c401501a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 --2- 172.21.15.78:0/2136411225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c40153ee0 0x7f0c400abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 -- 172.21.15.78:0/2136411225 >> 172.21.15.78:0/2136411225 conn(0x7f0c400c3e20 msgr2=0x7f0c40151050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:05.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 -- 172.21.15.78:0/2136411225 shutdown_connections 2023-08-17T17:49:05.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.483+0000 7f0c45b67700 1 -- 172.21.15.78:0/2136411225 wait complete. 2023-08-17T17:49:05.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:49:05.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.617+0000 7f2582b1a700 1 Processor -- start 2023-08-17T17:49:05.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.617+0000 7f2582b1a700 1 -- start start 2023-08-17T17:49:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f2582b1a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f257c13a740 0x7f257c069f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f2582b1a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f257c0624f0 0x7f257c062970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f2582b1a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257c1545e0 0x7f257c154a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f2582b1a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c155640 con 0x7f257c0624f0 2023-08-17T17:49:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f2582b1a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c069b00 con 0x7f257c13a740 2023-08-17T17:49:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f2582b1a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c062e60 con 0x7f257c1545e0 2023-08-17T17:49:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f257bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f257c0624f0 0x7f257c062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f257bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f257c0624f0 0x7f257c062970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41442/0 (socket says 172.21.15.78:41442) 2023-08-17T17:49:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f257bfff700 1 -- 172.21.15.78:0/4128156392 learned_addr learned my addr 172.21.15.78:0/4128156392 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f25808b6700 1 --2- 172.21.15.78:0/4128156392 >> v2:172.21.15.150:3300/0 conn(0x7f257c13a740 0x7f257c069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f25810b7700 1 --2- 172.21.15.78:0/4128156392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257c1545e0 0x7f257c154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f257bfff700 1 -- 172.21.15.78:0/4128156392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257c1545e0 msgr2=0x7f257c154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f257bfff700 1 --2- 172.21.15.78:0/4128156392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257c1545e0 0x7f257c154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f257bfff700 1 -- 172.21.15.78:0/4128156392 >> v2:172.21.15.150:3300/0 conn(0x7f257c13a740 msgr2=0x7f257c069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:05.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f257bfff700 1 --2- 172.21.15.78:0/4128156392 >> v2:172.21.15.150:3300/0 conn(0x7f257c13a740 0x7f257c069f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f257bfff700 1 -- 172.21.15.78:0/4128156392 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c13ab20 con 0x7f257c0624f0 2023-08-17T17:49:05.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.618+0000 7f257bfff700 1 --2- 172.21.15.78:0/4128156392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c0624f0 0x7f257c062970 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f257c069110 tx=0x7f25680090f0).ready entity=mon.0 client_cookie=218bdd5a44b3afb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:05.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f257b7fe700 1 -- 172.21.15.78:0/4128156392 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256800f510 con 0x7f257c0624f0 2023-08-17T17:49:05.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f257b7fe700 1 -- 172.21.15.78:0/4128156392 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256800f670 con 0x7f257c0624f0 2023-08-17T17:49:05.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f257b7fe700 1 -- 172.21.15.78:0/4128156392 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256800f9f0 con 0x7f257c0624f0 2023-08-17T17:49:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f2582b1a700 1 -- 172.21.15.78:0/4128156392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c0624f0 msgr2=0x7f257c062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f2582b1a700 1 --2- 172.21.15.78:0/4128156392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c0624f0 0x7f257c062970 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f257c069110 tx=0x7f25680090f0).stop 2023-08-17T17:49:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f2582b1a700 1 -- 172.21.15.78:0/4128156392 shutdown_connections 2023-08-17T17:49:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f2582b1a700 1 --2- 172.21.15.78:0/4128156392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257c1545e0 0x7f257c154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f2582b1a700 1 --2- 172.21.15.78:0/4128156392 >> v2:172.21.15.150:3300/0 conn(0x7f257c13a740 0x7f257c069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f2582b1a700 1 --2- 172.21.15.78:0/4128156392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c0624f0 0x7f257c062970 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f2582b1a700 1 -- 172.21.15.78:0/4128156392 >> 172.21.15.78:0/4128156392 conn(0x7f257c0c7b80 msgr2=0x7f257c0c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f2582b1a700 1 -- 172.21.15.78:0/4128156392 shutdown_connections 2023-08-17T17:49:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.619+0000 7f2582b1a700 1 -- 172.21.15.78:0/4128156392 wait complete. 2023-08-17T17:49:05.625 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:05.618+0000 7f3967a7a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:49:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.620+0000 7f2582b1a700 1 Processor -- start 2023-08-17T17:49:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.621+0000 7f2582b1a700 1 -- start start 2023-08-17T17:49:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.621+0000 7f2582b1a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f257c0624f0 0x7f257c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.621+0000 7f2582b1a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c13a740 0x7f257c0aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.621+0000 7f2582b1a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257c1545e0 0x7f257c066460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.621+0000 7f2582b1a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0bf940 con 0x7f257c13a740 2023-08-17T17:49:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.621+0000 7f2582b1a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0ad110 con 0x7f257c0624f0 2023-08-17T17:49:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.621+0000 7f2582b1a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0adc10 con 0x7f257c1545e0 2023-08-17T17:49:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.621+0000 7f257bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c13a740 0x7f257c0aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.621+0000 7f257bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c13a740 0x7f257c0aab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41456/0 (socket says 172.21.15.78:41456) 2023-08-17T17:49:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.621+0000 7f257bfff700 1 -- 172.21.15.78:0/2529780972 learned_addr learned my addr 172.21.15.78:0/2529780972 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f257bfff700 1 -- 172.21.15.78:0/2529780972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257c1545e0 msgr2=0x7f257c066460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f257bfff700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257c1545e0 0x7f257c066460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f25808b6700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f257c0624f0 0x7f257c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f257bfff700 1 -- 172.21.15.78:0/2529780972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f257c0624f0 msgr2=0x7f257c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f257bfff700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f257c0624f0 0x7f257c0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f257bfff700 1 -- 172.21.15.78:0/2529780972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568009370 con 0x7f257c13a740 2023-08-17T17:49:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f25808b6700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f257c0624f0 0x7f257c0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f257bfff700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c13a740 0x7f257c0aab30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f257c068d20 tx=0x7f2568017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f2578ff9700 1 -- 172.21.15.78:0/2529780972 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256800f7e0 con 0x7f257c13a740 2023-08-17T17:49:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f2578ff9700 1 -- 172.21.15.78:0/2529780972 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256800f940 con 0x7f257c13a740 2023-08-17T17:49:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f2582b1a700 1 -- 172.21.15.78:0/2529780972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c0ad370 con 0x7f257c13a740 2023-08-17T17:49:05.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f2578ff9700 1 -- 172.21.15.78:0/2529780972 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256801c670 con 0x7f257c13a740 2023-08-17T17:49:05.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.622+0000 7f2582b1a700 1 -- 172.21.15.78:0/2529780972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c0ad930 con 0x7f257c13a740 2023-08-17T17:49:05.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.623+0000 7f2582b1a700 1 -- 172.21.15.78:0/2529780972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c068270 con 0x7f257c13a740 2023-08-17T17:49:05.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.624+0000 7f2578ff9700 1 -- 172.21.15.78:0/2529780972 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f256802c070 con 0x7f257c13a740 2023-08-17T17:49:05.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.624+0000 7f2578ff9700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f256005ee20 0x7f25600612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.624+0000 7f25808b6700 1 -- 172.21.15.78:0/2529780972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f256005ee20 msgr2=0x7f25600612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:05.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.624+0000 7f2578ff9700 1 -- 172.21.15.78:0/2529780972 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f256807b9e0 con 0x7f257c13a740 2023-08-17T17:49:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.624+0000 7f25808b6700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f256005ee20 0x7f25600612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.628+0000 7f2578ff9700 1 -- 172.21.15.78:0/2529780972 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f256804ceb0 con 0x7f257c13a740 2023-08-17T17:49:05.672 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:05.671+0000 7fc05343b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:49:05.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.798+0000 7f2582b1a700 1 -- 172.21.15.78:0/2529780972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f257c155360 con 0x7f257c13a740 2023-08-17T17:49:05.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.798+0000 7f2578ff9700 1 -- 172.21.15.78:0/2529780972 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2568020020 con 0x7f257c13a740 2023-08-17T17:49:05.799 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:49:05.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 -- 172.21.15.78:0/2529780972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f256005ee20 msgr2=0x7f25600612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:05.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f256005ee20 0x7f25600612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 -- 172.21.15.78:0/2529780972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c13a740 msgr2=0x7f257c0aab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c13a740 0x7f257c0aab30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f257c068d20 tx=0x7f2568017000).stop 2023-08-17T17:49:05.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 -- 172.21.15.78:0/2529780972 shutdown_connections 2023-08-17T17:49:05.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f256005ee20 0x7f25600612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f257c1545e0 0x7f257c066460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f257c0624f0 0x7f257c0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 --2- 172.21.15.78:0/2529780972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c13a740 0x7f257c0aab30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 -- 172.21.15.78:0/2529780972 >> 172.21.15.78:0/2529780972 conn(0x7f257c0c7b80 msgr2=0x7f257c0c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:05.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 -- 172.21.15.78:0/2529780972 shutdown_connections 2023-08-17T17:49:05.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.800+0000 7f2582b1a700 1 -- 172.21.15.78:0/2529780972 wait complete. 2023-08-17T17:49:05.813 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:49:05.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.939+0000 7f71a2344700 1 Processor -- start 2023-08-17T17:49:05.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.939+0000 7f71a2344700 1 -- start start 2023-08-17T17:49:05.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.940+0000 7f71a2344700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0bf0e0 0x7f719c0be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.940+0000 7f71a2344700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0c3e10 con 0x7f719c1578f0 2023-08-17T17:49:05.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.940+0000 7f71a2344700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0c34e0 con 0x7f719c096520 2023-08-17T17:49:05.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.940+0000 7f71a2344700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0bf5c0 con 0x7f719c0bf0e0 2023-08-17T17:49:05.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.940+0000 7f719bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f719c1578f0 0x7f719c095e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40312/0 (socket says 172.21.15.78:40312) 2023-08-17T17:49:05.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.940+0000 7f719bfff700 1 -- 172.21.15.78:0/2116977671 learned_addr learned my addr 172.21.15.78:0/2116977671 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:05.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f71a08e1700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0bf0e0 0x7f719c0be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581296585 0 0) 0x7f719c0c3e10 con 0x7f719c1578f0 2023-08-17T17:49:05.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71840033f0 con 0x7f719c1578f0 2023-08-17T17:49:05.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439533973 0 0) 0x7f719c0c34e0 con 0x7f719c096520 2023-08-17T17:49:05.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f719c0c3e10 con 0x7f719c096520 2023-08-17T17:49:05.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3404971929 0 0) 0x7f71840033f0 con 0x7f719c1578f0 2023-08-17T17:49:05.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0bf0e0 msgr2=0x7f719c0be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:05.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0bf0e0 0x7f719c0be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 >> v1:172.21.15.150:6789/0 conn(0x7f719c096520 legacy=0x7f719c0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0c37c0 con 0x7f719c1578f0 2023-08-17T17:49:05.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f718c001470 con 0x7f719c1578f0 2023-08-17T17:49:05.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 >> v1:172.21.15.78:6789/0 conn(0x7f719c1578f0 legacy=0x7f719c095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 0x7f7184003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7184004690 0x7f7184004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7184005000 0x7f718400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0bf5c0 con 0x7f7184003aa0 2023-08-17T17:49:05.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718400bf00 con 0x7f7184004690 2023-08-17T17:49:05.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718400c0c0 con 0x7f7184005000 2023-08-17T17:49:05.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f71a08e1700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0bf0e0 0x7f719c0be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:05.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719bfff700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 0x7f7184003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719b7fe700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7184004690 0x7f7184004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719bfff700 1 -- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7184005000 msgr2=0x7f718400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:05.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719bfff700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7184005000 0x7f718400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719bfff700 1 -- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7184004690 msgr2=0x7f7184004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:05.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719bfff700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7184004690 0x7f7184004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:05.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.941+0000 7f719bfff700 1 -- 172.21.15.78:0/2116977671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71840033f0 con 0x7f7184003aa0 2023-08-17T17:49:05.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f719bfff700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 0x7f7184003ea0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f718c00c110 tx=0x7f718c001e10).ready entity=mon.0 client_cookie=729cd28d61150336 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:05.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00ca40 con 0x7f7184003aa0 2023-08-17T17:49:05.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c00cba0 con 0x7f7184003aa0 2023-08-17T17:49:05.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f719affd700 1 -- 172.21.15.78:0/2116977671 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0070d0 con 0x7f7184003aa0 2023-08-17T17:49:05.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f71a2344700 1 -- 172.21.15.78:0/2116977671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 msgr2=0x7f7184003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:05.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f71a2344700 1 --2- 172.21.15.78:0/2116977671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 0x7f7184003ea0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f718c00c110 tx=0x7f718c001e10).stop 2023-08-17T17:49:05.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f71a08e1700 1 -- 172.21.15.78:0/2116977671 reap_dead start 2023-08-17T17:49:05.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f71a2344700 1 -- 172.21.15.78:0/2116977671 shutdown_connections 2023-08-17T17:49:05.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f71a2344700 1 -- 172.21.15.78:0/2116977671 >> 172.21.15.78:0/2116977671 conn(0x7f719c062f80 msgr2=0x7f719c0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:05.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f71a2344700 1 -- 172.21.15.78:0/2116977671 shutdown_connections 2023-08-17T17:49:05.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.942+0000 7f71a2344700 1 -- 172.21.15.78:0/2116977671 wait complete. 2023-08-17T17:49:05.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.943+0000 7f71a2344700 1 Processor -- start 2023-08-17T17:49:05.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.944+0000 7f71a2344700 1 -- start start 2023-08-17T17:49:05.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.944+0000 7f71a2344700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 0x7f719c164f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.944+0000 7f71a2344700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0c26e0 0x7f719c154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.944+0000 7f71a2344700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f719c168740 0x7f719c0c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.944+0000 7f71a2344700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c1682b0 con 0x7f7184003aa0 2023-08-17T17:49:05.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.944+0000 7f71a2344700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c165480 con 0x7f719c168740 2023-08-17T17:49:05.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.944+0000 7f71a2344700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c2be0 con 0x7f719c0c26e0 2023-08-17T17:49:05.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.944+0000 7f719bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 0x7f719c164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:05.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.944+0000 7f719bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 0x7f719c164f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41462/0 (socket says 172.21.15.78:41462) 2023-08-17T17:49:05.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.944+0000 7f719bfff700 1 -- 172.21.15.78:0/1855399045 learned_addr learned my addr 172.21.15.78:0/1855399045 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:05.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f719bfff700 1 -- 172.21.15.78:0/1855399045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0c26e0 msgr2=0x7f719c154830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-17T17:49:05.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f719bfff700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0c26e0 0x7f719c154830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f719bfff700 1 -- 172.21.15.78:0/1855399045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f719c168740 msgr2=0x7f719c0c5120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-17T17:49:05.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f719bfff700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f719c168740 0x7f719c0c5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:05.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f719bfff700 1 -- 172.21.15.78:0/1855399045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c167c60 con 0x7f7184003aa0 2023-08-17T17:49:05.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f719bfff700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 0x7f719c164f90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f718c001ed0 tx=0x7f718c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:05.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f7183fff700 1 -- 172.21.15.78:0/1855399045 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c001760 con 0x7f7184003aa0 2023-08-17T17:49:05.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f7183fff700 1 -- 172.21.15.78:0/1855399045 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c0046b0 con 0x7f7184003aa0 2023-08-17T17:49:05.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f7183fff700 1 -- 172.21.15.78:0/1855399045 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c004a30 con 0x7f7184003aa0 2023-08-17T17:49:05.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f71a2344700 1 -- 172.21.15.78:0/1855399045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c167f40 con 0x7f7184003aa0 2023-08-17T17:49:05.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.945+0000 7f71a2344700 1 -- 172.21.15.78:0/1855399045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c0c5610 con 0x7f7184003aa0 2023-08-17T17:49:05.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.946+0000 7f71a2344700 1 -- 172.21.15.78:0/1855399045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c167ac0 con 0x7f7184003aa0 2023-08-17T17:49:05.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.946+0000 7f7183fff700 1 -- 172.21.15.78:0/1855399045 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f718c010070 con 0x7f7184003aa0 2023-08-17T17:49:05.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.947+0000 7f7183fff700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f718805ee20 0x7f71880612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:05.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.947+0000 7f719b7fe700 1 -- 172.21.15.78:0/1855399045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f718805ee20 msgr2=0x7f71880612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:05.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.947+0000 7f7183fff700 1 -- 172.21.15.78:0/1855399045 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f718c01c040 con 0x7f7184003aa0 2023-08-17T17:49:05.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.947+0000 7f719b7fe700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f718805ee20 0x7f71880612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:05.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:05.954+0000 7f7183fff700 1 -- 172.21.15.78:0/1855399045 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f719c167ac0 con 0x7f7184003aa0 2023-08-17T17:49:06.053 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:06.051+0000 7f3967a7a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:49:06.117 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:06.116+0000 7fc05343b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:49:06.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.124+0000 7f71a2344700 1 -- 172.21.15.78:0/1855399045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f719c167ac0 con 0x7f7184003aa0 2023-08-17T17:49:06.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.125+0000 7f7183fff700 1 -- 172.21.15.78:0/1855399045 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f719c167ac0 con 0x7f7184003aa0 2023-08-17T17:49:06.126 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:49:06.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 -- 172.21.15.78:0/1855399045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f718805ee20 msgr2=0x7f71880612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:06.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f718805ee20 0x7f71880612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:06.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 -- 172.21.15.78:0/1855399045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 msgr2=0x7f719c164f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 0x7f719c164f90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f718c001ed0 tx=0x7f718c015000).stop 2023-08-17T17:49:06.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 -- 172.21.15.78:0/1855399045 shutdown_connections 2023-08-17T17:49:06.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f718805ee20 0x7f71880612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:06.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f719c168740 0x7f719c0c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:06.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184003aa0 0x7f719c164f90 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 --2- 172.21.15.78:0/1855399045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0c26e0 0x7f719c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 -- 172.21.15.78:0/1855399045 >> 172.21.15.78:0/1855399045 conn(0x7f719c062f80 msgr2=0x7f719c156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 -- 172.21.15.78:0/1855399045 shutdown_connections 2023-08-17T17:49:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.127+0000 7f71a2344700 1 -- 172.21.15.78:0/1855399045 wait complete. 2023-08-17T17:49:06.140 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:49:06.156 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:06.155+0000 7f3967a7a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:06.228 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:06.227+0000 7fc05343b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:06.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.259+0000 7f2a2d15c700 1 Processor -- start 2023-08-17T17:49:06.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.259+0000 7f2a2d15c700 1 -- start start 2023-08-17T17:49:06.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2d15c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2a2806b280 0x7f2a281514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2d15c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a28063600 0x7f2a28063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2d15c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a280bd260 con 0x7f2a2814ea30 2023-08-17T17:49:06.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2d15c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a28063f80 con 0x7f2a28063600 2023-08-17T17:49:06.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2d15c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a28151d70 con 0x7f2a2806b280 2023-08-17T17:49:06.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2c95b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a28063600 0x7f2a28063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2c95b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a28063600 0x7f2a28063a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41476/0 (socket says 172.21.15.78:41476) 2023-08-17T17:49:06.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2c95b700 1 -- 172.21.15.78:0/641078706 learned_addr learned my addr 172.21.15.78:0/641078706 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:06.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a277fe700 1 --2- 172.21.15.78:0/641078706 >> v2:172.21.15.150:3300/0 conn(0x7f2a2806b280 0x7f2a281514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2c95b700 1 -- 172.21.15.78:0/641078706 >> v2:172.21.15.150:3300/0 conn(0x7f2a2806b280 msgr2=0x7f2a281514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:06.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2c95b700 1 --2- 172.21.15.78:0/641078706 >> v2:172.21.15.150:3300/0 conn(0x7f2a2806b280 0x7f2a281514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2c95b700 1 -- 172.21.15.78:0/641078706 >> v1:172.21.15.150:6789/0 conn(0x7f2a2814ea30 legacy=0x7f2a280c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:06.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.260+0000 7f2a2c95b700 1 -- 172.21.15.78:0/641078706 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a28152050 con 0x7f2a28063600 2023-08-17T17:49:06.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a2c95b700 1 --2- 172.21.15.78:0/641078706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a28063600 0x7f2a28063a90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f2a28155a60 tx=0x7f2a2000ba50).ready entity=mon.0 client_cookie=194549a9c2b9a4b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:06.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a26ffd700 1 -- 172.21.15.78:0/641078706 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20010070 con 0x7f2a28063600 2023-08-17T17:49:06.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a26ffd700 1 -- 172.21.15.78:0/641078706 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2000de90 con 0x7f2a28063600 2023-08-17T17:49:06.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a26ffd700 1 -- 172.21.15.78:0/641078706 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000b2e0 con 0x7f2a28063600 2023-08-17T17:49:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a2d15c700 1 -- 172.21.15.78:0/641078706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a28063600 msgr2=0x7f2a28063a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a2d15c700 1 --2- 172.21.15.78:0/641078706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a28063600 0x7f2a28063a90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f2a28155a60 tx=0x7f2a2000ba50).stop 2023-08-17T17:49:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a2d15c700 1 -- 172.21.15.78:0/641078706 shutdown_connections 2023-08-17T17:49:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a2d15c700 1 --2- 172.21.15.78:0/641078706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a28063600 0x7f2a28063a90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a2d15c700 1 --2- 172.21.15.78:0/641078706 >> v2:172.21.15.150:3300/0 conn(0x7f2a2806b280 0x7f2a281514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a2d15c700 1 -- 172.21.15.78:0/641078706 >> 172.21.15.78:0/641078706 conn(0x7f2a280c3e20 msgr2=0x7f2a280c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a2d15c700 1 -- 172.21.15.78:0/641078706 shutdown_connections 2023-08-17T17:49:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.261+0000 7f2a2d15c700 1 -- 172.21.15.78:0/641078706 wait complete. 2023-08-17T17:49:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.262+0000 7f2a2d15c700 1 Processor -- start 2023-08-17T17:49:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.263+0000 7f2a2d15c700 1 -- start start 2023-08-17T17:49:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.263+0000 7f2a2d15c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a28063600 0x7f2a280ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.263+0000 7f2a2d15c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2806b280 0x7f2a28164050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.263+0000 7f2a2d15c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a2814ea30 0x7f2a2814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.263+0000 7f2a2d15c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a28163600 con 0x7f2a2806b280 2023-08-17T17:49:06.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.263+0000 7f2a2d15c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2814ce20 con 0x7f2a2814ea30 2023-08-17T17:49:06.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.263+0000 7f2a2d15c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a280abda0 con 0x7f2a28063600 2023-08-17T17:49:06.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.263+0000 7f2a277fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2806b280 0x7f2a28164050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.263+0000 7f2a277fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2806b280 0x7f2a28164050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41482/0 (socket says 172.21.15.78:41482) 2023-08-17T17:49:06.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.263+0000 7f2a277fe700 1 -- 172.21.15.78:0/1333652786 learned_addr learned my addr 172.21.15.78:0/1333652786 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:06.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a2c95b700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a2814ea30 0x7f2a2814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a27fff700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a28063600 0x7f2a280ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a277fe700 1 -- 172.21.15.78:0/1333652786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a28063600 msgr2=0x7f2a280ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a277fe700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a28063600 0x7f2a280ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a277fe700 1 -- 172.21.15.78:0/1333652786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a2814ea30 msgr2=0x7f2a2814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a277fe700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a2814ea30 0x7f2a2814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a277fe700 1 -- 172.21.15.78:0/1333652786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2000bcf0 con 0x7f2a2806b280 2023-08-17T17:49:06.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a277fe700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2806b280 0x7f2a28164050 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f2a1800d890 tx=0x7f2a18008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a0ffff700 1 -- 172.21.15.78:0/1333652786 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18011590 con 0x7f2a2806b280 2023-08-17T17:49:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a0ffff700 1 -- 172.21.15.78:0/1333652786 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a180116f0 con 0x7f2a2806b280 2023-08-17T17:49:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a2d15c700 1 -- 172.21.15.78:0/1333652786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a280ac080 con 0x7f2a2806b280 2023-08-17T17:49:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a0ffff700 1 -- 172.21.15.78:0/1333652786 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18011a70 con 0x7f2a2806b280 2023-08-17T17:49:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.264+0000 7f2a2d15c700 1 -- 172.21.15.78:0/1333652786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a28163b30 con 0x7f2a2806b280 2023-08-17T17:49:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.265+0000 7f2a2d15c700 1 -- 172.21.15.78:0/1333652786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2805f910 con 0x7f2a2806b280 2023-08-17T17:49:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.266+0000 7f2a0ffff700 1 -- 172.21.15.78:0/1333652786 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2a18012420 con 0x7f2a2806b280 2023-08-17T17:49:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.266+0000 7f2a0ffff700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1405ee20 0x7f2a140612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.266+0000 7f2a27fff700 1 -- 172.21.15.78:0/1333652786 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1405ee20 msgr2=0x7f2a140612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:06.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.266+0000 7f2a27fff700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1405ee20 0x7f2a140612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:06.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.267+0000 7f2a0ffff700 1 -- 172.21.15.78:0/1333652786 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f2a18011e20 con 0x7f2a2806b280 2023-08-17T17:49:06.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.275+0000 7f2a0ffff700 1 -- 172.21.15.78:0/1333652786 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a1804ac50 con 0x7f2a2806b280 2023-08-17T17:49:06.311 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:06.309+0000 7f3967a7a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:06.386 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:06.384+0000 7f3967a7a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:49:06.391 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:06.390+0000 7fc05343b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:06.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.445+0000 7f2a2d15c700 1 -- 172.21.15.78:0/1333652786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a28152330 con 0x7f2a2806b280 2023-08-17T17:49:06.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.445+0000 7f2a0ffff700 1 -- 172.21.15.78:0/1333652786 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a1804e270 con 0x7f2a2806b280 2023-08-17T17:49:06.446 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:49:06.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 -- 172.21.15.78:0/1333652786 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1405ee20 msgr2=0x7f2a140612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:06.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1405ee20 0x7f2a140612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 -- 172.21.15.78:0/1333652786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2806b280 msgr2=0x7f2a28164050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2806b280 0x7f2a28164050 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f2a1800d890 tx=0x7f2a18008040).stop 2023-08-17T17:49:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 -- 172.21.15.78:0/1333652786 shutdown_connections 2023-08-17T17:49:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2a1405ee20 0x7f2a140612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a2814ea30 0x7f2a2814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a28063600 0x7f2a280ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 --2- 172.21.15.78:0/1333652786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a2806b280 0x7f2a28164050 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 -- 172.21.15.78:0/1333652786 >> 172.21.15.78:0/1333652786 conn(0x7f2a280c3e20 msgr2=0x7f2a2814df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 -- 172.21.15.78:0/1333652786 shutdown_connections 2023-08-17T17:49:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.447+0000 7f2a2d15c700 1 -- 172.21.15.78:0/1333652786 wait complete. 2023-08-17T17:49:06.453 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:06.452+0000 7f3967a7a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:49:06.460 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:06.469 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:06.468+0000 7fc05343b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:49:06.541 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:06.540+0000 7fc05343b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:49:06.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.575+0000 7f9baef20700 1 Processor -- start 2023-08-17T17:49:06.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.575+0000 7f9baef20700 1 -- start start 2023-08-17T17:49:06.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.576+0000 7f9baef20700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ba80bc3c0 0x7f9ba80bc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.576+0000 7f9baef20700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ba8151980 0x7f9ba8151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.576+0000 7f9baef20700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba806b8e0 con 0x7f9ba80661a0 2023-08-17T17:49:06.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.576+0000 7f9baef20700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba8064af0 con 0x7f9ba80bc3c0 2023-08-17T17:49:06.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.576+0000 7f9baef20700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba806b320 con 0x7f9ba8151980 2023-08-17T17:49:06.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.576+0000 7f9baccbc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ba80bc3c0 0x7f9ba80bc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.576+0000 7f9baccbc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ba80bc3c0 0x7f9ba80bc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41494/0 (socket says 172.21.15.78:41494) 2023-08-17T17:49:06.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.576+0000 7f9baccbc700 1 -- 172.21.15.78:0/2752200388 learned_addr learned my addr 172.21.15.78:0/2752200388 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:06.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.577+0000 7f9bad4bd700 1 --2- 172.21.15.78:0/2752200388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ba8151980 0x7f9ba8151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.577+0000 7f9baccbc700 1 -- 172.21.15.78:0/2752200388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ba8151980 msgr2=0x7f9ba8151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:06.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.577+0000 7f9baccbc700 1 --2- 172.21.15.78:0/2752200388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ba8151980 0x7f9ba8151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.577+0000 7f9baccbc700 1 -- 172.21.15.78:0/2752200388 >> v1:172.21.15.150:6789/0 conn(0x7f9ba80661a0 legacy=0x7f9ba80643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.577+0000 7f9baccbc700 1 -- 172.21.15.78:0/2752200388 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba806b600 con 0x7f9ba80bc3c0 2023-08-17T17:49:06.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.577+0000 7f9baccbc700 1 --2- 172.21.15.78:0/2752200388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80bc3c0 0x7f9ba80bc7a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f9ba0006fd0 tx=0x7f9ba00090f0).ready entity=mon.0 client_cookie=8a46ff18cd119ff6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:06.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.577+0000 7f9ba77fe700 1 -- 172.21.15.78:0/2752200388 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000b580 con 0x7f9ba80bc3c0 2023-08-17T17:49:06.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.577+0000 7f9ba77fe700 1 -- 172.21.15.78:0/2752200388 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba000b6e0 con 0x7f9ba80bc3c0 2023-08-17T17:49:06.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.577+0000 7f9ba77fe700 1 -- 172.21.15.78:0/2752200388 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000ba60 con 0x7f9ba80bc3c0 2023-08-17T17:49:06.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.578+0000 7f9baef20700 1 -- 172.21.15.78:0/2752200388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80bc3c0 msgr2=0x7f9ba80bc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.578+0000 7f9baef20700 1 --2- 172.21.15.78:0/2752200388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80bc3c0 0x7f9ba80bc7a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f9ba0006fd0 tx=0x7f9ba00090f0).stop 2023-08-17T17:49:06.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.578+0000 7f9baef20700 1 -- 172.21.15.78:0/2752200388 shutdown_connections 2023-08-17T17:49:06.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.578+0000 7f9baef20700 1 --2- 172.21.15.78:0/2752200388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ba8151980 0x7f9ba8151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.578+0000 7f9baef20700 1 --2- 172.21.15.78:0/2752200388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80bc3c0 0x7f9ba80bc7a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.578+0000 7f9baef20700 1 -- 172.21.15.78:0/2752200388 >> 172.21.15.78:0/2752200388 conn(0x7f9ba80c3d40 msgr2=0x7f9ba80c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:06.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.578+0000 7f9baef20700 1 -- 172.21.15.78:0/2752200388 shutdown_connections 2023-08-17T17:49:06.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.578+0000 7f9baef20700 1 -- 172.21.15.78:0/2752200388 wait complete. 2023-08-17T17:49:06.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.579+0000 7f9baef20700 1 Processor -- start 2023-08-17T17:49:06.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.579+0000 7f9baef20700 1 -- start start 2023-08-17T17:49:06.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baef20700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80661a0 0x7f9ba81589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baef20700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ba80bc3c0 0x7f9ba8150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baef20700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ba8151980 0x7f9ba8150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baef20700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba8151340 con 0x7f9ba80661a0 2023-08-17T17:49:06.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baef20700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80c03e0 con 0x7f9ba80bc3c0 2023-08-17T17:49:06.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baef20700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba8158520 con 0x7f9ba8151980 2023-08-17T17:49:06.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baccbc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80661a0 0x7f9ba81589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baccbc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80661a0 0x7f9ba81589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41500/0 (socket says 172.21.15.78:41500) 2023-08-17T17:49:06.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baccbc700 1 -- 172.21.15.78:0/4075095403 learned_addr learned my addr 172.21.15.78:0/4075095403 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:06.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9bad4bd700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ba8151980 0x7f9ba8150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baccbc700 1 -- 172.21.15.78:0/4075095403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ba8151980 msgr2=0x7f9ba8150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baccbc700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ba8151980 0x7f9ba8150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baccbc700 1 -- 172.21.15.78:0/4075095403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ba80bc3c0 msgr2=0x7f9ba8150960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-17T17:49:06.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baccbc700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ba80bc3c0 0x7f9ba8150960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:06.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baccbc700 1 -- 172.21.15.78:0/4075095403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba0009370 con 0x7f9ba80661a0 2023-08-17T17:49:06.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baccbc700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80661a0 0x7f9ba81589b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f9ba0009fd0 tx=0x7f9ba0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:06.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9ba4ff9700 1 -- 172.21.15.78:0/4075095403 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0000bc0 con 0x7f9ba80661a0 2023-08-17T17:49:06.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9ba4ff9700 1 -- 172.21.15.78:0/4075095403 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba000b850 con 0x7f9ba80661a0 2023-08-17T17:49:06.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baef20700 1 -- 172.21.15.78:0/4075095403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba8162a30 con 0x7f9ba80661a0 2023-08-17T17:49:06.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9ba4ff9700 1 -- 172.21.15.78:0/4075095403 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0000d20 con 0x7f9ba80661a0 2023-08-17T17:49:06.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.580+0000 7f9baef20700 1 -- 172.21.15.78:0/4075095403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba81581b0 con 0x7f9ba80661a0 2023-08-17T17:49:06.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.581+0000 7f9baef20700 1 -- 172.21.15.78:0/4075095403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba8158800 con 0x7f9ba80661a0 2023-08-17T17:49:06.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.582+0000 7f9ba4ff9700 1 -- 172.21.15.78:0/4075095403 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f9ba002c070 con 0x7f9ba80661a0 2023-08-17T17:49:06.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.582+0000 7f9ba4ff9700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b8805ee20 0x7f9b880612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.582+0000 7f9ba7fff700 1 -- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b8805ee20 msgr2=0x7f9b880612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:06.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.582+0000 7f9ba4ff9700 1 -- 172.21.15.78:0/4075095403 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f9ba007b7e0 con 0x7f9ba80661a0 2023-08-17T17:49:06.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.582+0000 7f9ba7fff700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b8805ee20 0x7f9b880612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:06.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.586+0000 7f9ba4ff9700 1 -- 172.21.15.78:0/4075095403 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ba007de60 con 0x7f9ba80661a0 2023-08-17T17:49:06.712 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:06.710+0000 7f3967a7a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:49:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.783+0000 7f9ba7fff700 1 -- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b8805ee20 msgr2=0x7f9b880612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.783+0000 7f9ba7fff700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b8805ee20 0x7f9b880612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:06.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.799+0000 7f9baef20700 1 -- 172.21.15.78:0/4075095403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ba8047350 con 0x7f9ba80661a0 2023-08-17T17:49:06.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.799+0000 7f9ba4ff9700 1 -- 172.21.15.78:0/4075095403 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f9ba002a020 con 0x7f9ba80661a0 2023-08-17T17:49:06.801 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:06.801 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5090,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2346190042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2346190042},{"type":"v1","addr":"172.21.15.150:6834","nonce":2346190042}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2674101879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2674101879},{"type":"v1","addr":"172.21.15.78:6837","nonce":2674101879}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5745,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1609000139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1609000139},{"type":"v1","addr":"172.21.15.78:6836","nonce":1609000139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:46:53.930414+0000","modified":"2023-08-17T17:46:55.941460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/412084175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":412084175},{"type":"v1","addr":"172.21.15.150:6835","nonce":412084175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T17:49:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.801+0000 7f9baef20700 1 -- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b8805ee20 msgr2=0x7f9b880612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b8805ee20 0x7f9b880612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 -- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80661a0 msgr2=0x7f9ba81589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80661a0 0x7f9ba81589b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f9ba0009fd0 tx=0x7f9ba0017000).stop 2023-08-17T17:49:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 -- 172.21.15.78:0/4075095403 shutdown_connections 2023-08-17T17:49:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b8805ee20 0x7f9b880612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ba8151980 0x7f9ba8150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ba80661a0 0x7f9ba81589b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 --2- 172.21.15.78:0/4075095403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ba80bc3c0 0x7f9ba8150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 -- 172.21.15.78:0/4075095403 >> 172.21.15.78:0/4075095403 conn(0x7f9ba80c3d40 msgr2=0x7f9ba80a7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 -- 172.21.15.78:0/4075095403 shutdown_connections 2023-08-17T17:49:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.802+0000 7f9baef20700 1 -- 172.21.15.78:0/4075095403 wait complete. 2023-08-17T17:49:06.805 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 19 2023-08-17T17:49:06.810 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:06.809+0000 7fc05343b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:49:06.815 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:06.898 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:06.896+0000 7f3967a7a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:06.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.973+0000 7f80a0058700 1 Processor -- start 2023-08-17T17:49:06.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.973+0000 7f80a0058700 1 -- start start 2023-08-17T17:49:06.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f80a0058700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8098154140 0x7f80980c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f80a0058700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f80980c1010 0x7f80980ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f80a0058700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8098154520 con 0x7f80980a7c40 2023-08-17T17:49:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f80a0058700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80980c91e0 con 0x7f8098154140 2023-08-17T17:49:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f80a0058700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80980c94c0 con 0x7f80980c1010 2023-08-17T17:49:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f809ddf4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8098154140 0x7f80980c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f809ddf4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8098154140 0x7f80980c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41504/0 (socket says 172.21.15.78:41504) 2023-08-17T17:49:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f809ddf4700 1 -- 172.21.15.78:0/3575579727 learned_addr learned my addr 172.21.15.78:0/3575579727 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f809e5f5700 1 --2- 172.21.15.78:0/3575579727 >> v2:172.21.15.150:3300/0 conn(0x7f80980c1010 0x7f80980ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f809ddf4700 1 -- 172.21.15.78:0/3575579727 >> v2:172.21.15.150:3300/0 conn(0x7f80980c1010 msgr2=0x7f80980ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f809ddf4700 1 --2- 172.21.15.78:0/3575579727 >> v2:172.21.15.150:3300/0 conn(0x7f80980c1010 0x7f80980ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f809ddf4700 1 -- 172.21.15.78:0/3575579727 >> v1:172.21.15.150:6789/0 conn(0x7f80980a7c40 legacy=0x7f80980c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.974+0000 7f809ddf4700 1 -- 172.21.15.78:0/3575579727 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80980c97a0 con 0x7f8098154140 2023-08-17T17:49:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.975+0000 7f809ddf4700 1 --2- 172.21.15.78:0/3575579727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 0x7f80980c6ee0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f80980c00d0 tx=0x7f80880090f0).ready entity=mon.0 client_cookie=33242de84bf3f677 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:06.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.975+0000 7f809cdf2700 1 -- 172.21.15.78:0/3575579727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808800b520 con 0x7f8098154140 2023-08-17T17:49:06.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.975+0000 7f809cdf2700 1 -- 172.21.15.78:0/3575579727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808800b680 con 0x7f8098154140 2023-08-17T17:49:06.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.975+0000 7f809cdf2700 1 -- 172.21.15.78:0/3575579727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808800ba00 con 0x7f8098154140 2023-08-17T17:49:06.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.975+0000 7f80a0058700 1 -- 172.21.15.78:0/3575579727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 msgr2=0x7f80980c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.975+0000 7f80a0058700 1 --2- 172.21.15.78:0/3575579727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 0x7f80980c6ee0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f80980c00d0 tx=0x7f80880090f0).stop 2023-08-17T17:49:06.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.975+0000 7f80a0058700 1 -- 172.21.15.78:0/3575579727 shutdown_connections 2023-08-17T17:49:06.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.975+0000 7f80a0058700 1 --2- 172.21.15.78:0/3575579727 >> v2:172.21.15.150:3300/0 conn(0x7f80980c1010 0x7f80980ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.975+0000 7f80a0058700 1 --2- 172.21.15.78:0/3575579727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 0x7f80980c6ee0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.975+0000 7f80a0058700 1 -- 172.21.15.78:0/3575579727 >> 172.21.15.78:0/3575579727 conn(0x7f8098094510 msgr2=0x7f809806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:06.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.976+0000 7f80a0058700 1 -- 172.21.15.78:0/3575579727 shutdown_connections 2023-08-17T17:49:06.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.976+0000 7f80a0058700 1 -- 172.21.15.78:0/3575579727 wait complete. 2023-08-17T17:49:06.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f80a0058700 1 Processor -- start 2023-08-17T17:49:06.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f80a0058700 1 -- start start 2023-08-17T17:49:06.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f80a0058700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80980a7c40 0x7f80980ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f80a0058700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80980c1010 0x7f80980aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f80a0058700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 0x7f80980aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f80a0058700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80980aae00 con 0x7f8098154140 2023-08-17T17:49:06.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f80a0058700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80980b0790 con 0x7f80980a7c40 2023-08-17T17:49:06.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f80a0058700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80980afb80 con 0x7f80980c1010 2023-08-17T17:49:06.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f809e5f5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 0x7f80980aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f809e5f5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 0x7f80980aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41506/0 (socket says 172.21.15.78:41506) 2023-08-17T17:49:06.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.977+0000 7f809e5f5700 1 -- 172.21.15.78:0/2834214810 learned_addr learned my addr 172.21.15.78:0/2834214810 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:06.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f809ddf4700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80980a7c40 0x7f80980ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f809d5f3700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80980c1010 0x7f80980aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:06.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f809e5f5700 1 -- 172.21.15.78:0/2834214810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80980c1010 msgr2=0x7f80980aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f809e5f5700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80980c1010 0x7f80980aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f809e5f5700 1 -- 172.21.15.78:0/2834214810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80980a7c40 msgr2=0x7f80980ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:06.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f809e5f5700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80980a7c40 0x7f80980ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:06.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f809e5f5700 1 -- 172.21.15.78:0/2834214810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8088009370 con 0x7f8098154140 2023-08-17T17:49:06.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f809e5f5700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 0x7f80980aa910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f8090009e90 tx=0x7f809000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:06.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f808dffb700 1 -- 172.21.15.78:0/2834214810 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809000caa0 con 0x7f8098154140 2023-08-17T17:49:06.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f808dffb700 1 -- 172.21.15.78:0/2834214810 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809000f040 con 0x7f8098154140 2023-08-17T17:49:06.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f808dffb700 1 -- 172.21.15.78:0/2834214810 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809000ce10 con 0x7f8098154140 2023-08-17T17:49:06.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f80a0058700 1 -- 172.21.15.78:0/2834214810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80980afe60 con 0x7f8098154140 2023-08-17T17:49:06.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.978+0000 7f80a0058700 1 -- 172.21.15.78:0/2834214810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80980b0420 con 0x7f8098154140 2023-08-17T17:49:06.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.979+0000 7f80a0058700 1 -- 172.21.15.78:0/2834214810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8098047350 con 0x7f8098154140 2023-08-17T17:49:06.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.980+0000 7f808dffb700 1 -- 172.21.15.78:0/2834214810 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f8090013610 con 0x7f8098154140 2023-08-17T17:49:06.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.980+0000 7f808dffb700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807c05ee20 0x7f807c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:06.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.980+0000 7f809ddf4700 1 -- 172.21.15.78:0/2834214810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807c05ee20 msgr2=0x7f807c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:06.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.980+0000 7f808dffb700 1 -- 172.21.15.78:0/2834214810 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f809007a6c0 con 0x7f8098154140 2023-08-17T17:49:06.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.980+0000 7f809ddf4700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807c05ee20 0x7f807c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:06.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:06.984+0000 7f808dffb700 1 -- 172.21.15.78:0/2834214810 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f809004bae0 con 0x7f8098154140 2023-08-17T17:49:07.001 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:07.000+0000 7fc05343b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:07.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.153+0000 7f80a0058700 1 -- 172.21.15.78:0/2834214810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f809806b6c0 con 0x7f8098154140 2023-08-17T17:49:07.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.154+0000 7f808dffb700 1 -- 172.21.15.78:0/2834214810 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+17519 (secure 0 0 0) 0x7f809004f100 con 0x7f8098154140 2023-08-17T17:49:07.156 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:07.156 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":64,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:05.253258+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:46:52.467922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T17:46:52.895738+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":64,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"8.21","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1630605532":"2023-08-18T17:47:09.437078+0000","172.21.15.78:6833/119464":"2023-08-18T17:47:09.437078+0000","172.21.15.78:6832/119464":"2023-08-18T17:47:09.437078+0000","172.21.15.78:0/4202278981":"2023-08-18T17:47:09.437078+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:07.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.156+0000 7f80a0058700 1 -- 172.21.15.78:0/2834214810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807c05ee20 msgr2=0x7f807c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:07.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807c05ee20 0x7f807c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:07.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 -- 172.21.15.78:0/2834214810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 msgr2=0x7f80980aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 0x7f80980aa910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f8090009e90 tx=0x7f809000b040).stop 2023-08-17T17:49:07.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 -- 172.21.15.78:0/2834214810 shutdown_connections 2023-08-17T17:49:07.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f807c05ee20 0x7f807c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:07.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8098154140 0x7f80980aa910 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80980a7c40 0x7f80980ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 --2- 172.21.15.78:0/2834214810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80980c1010 0x7f80980aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 -- 172.21.15.78:0/2834214810 >> 172.21.15.78:0/2834214810 conn(0x7f8098094510 msgr2=0x7f80980645f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:07.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 -- 172.21.15.78:0/2834214810 shutdown_connections 2023-08-17T17:49:07.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.157+0000 7f80a0058700 1 -- 172.21.15.78:0/2834214810 wait complete. 2023-08-17T17:49:07.170 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T17:49:07.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:07.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.287+0000 7f9946db8700 1 Processor -- start 2023-08-17T17:49:07.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.287+0000 7f9946db8700 1 -- start start 2023-08-17T17:49:07.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.287+0000 7f9946db8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9940066a40 0x7f99400624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.287+0000 7f9946db8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400c6040 con 0x7f9940066660 2023-08-17T17:49:07.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.287+0000 7f9946db8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9940069b00 con 0x7f99400629e0 2023-08-17T17:49:07.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.287+0000 7f9946db8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9940062e50 con 0x7f9940066a40 2023-08-17T17:49:07.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f993ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9940066a40 0x7f99400624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:07.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f9944b54700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9940066660 0x7f99400c5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40324/0 (socket says 172.21.15.78:40324) 2023-08-17T17:49:07.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f9944b54700 1 -- 172.21.15.78:0/44263768 learned_addr learned my addr 172.21.15.78:0/44263768 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:07.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f993ffff700 1 -- 172.21.15.78:0/44263768 >> v1:172.21.15.150:6789/0 conn(0x7f99400629e0 legacy=0x7f9940151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f993ffff700 1 -- 172.21.15.78:0/44263768 >> v1:172.21.15.78:6789/0 conn(0x7f9940066660 legacy=0x7f99400c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f993f7fe700 1 -- 172.21.15.78:0/44263768 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793923232 0 0) 0x7f9934001110 con 0x7f9940066660 2023-08-17T17:49:07.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f993ffff700 1 -- 172.21.15.78:0/44263768 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940069f90 con 0x7f9940066a40 2023-08-17T17:49:07.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f993ffff700 1 --2- 172.21.15.78:0/44263768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066a40 0x7f99400624f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f992c009760 tx=0x7f992c009060).ready entity=mon.0 client_cookie=66b9cbd8c50667b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:07.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f993f7fe700 1 -- 172.21.15.78:0/44263768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00b580 con 0x7f9940066a40 2023-08-17T17:49:07.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f993f7fe700 1 -- 172.21.15.78:0/44263768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00b6e0 con 0x7f9940066a40 2023-08-17T17:49:07.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.288+0000 7f993f7fe700 1 -- 172.21.15.78:0/44263768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00ba60 con 0x7f9940066a40 2023-08-17T17:49:07.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.289+0000 7f9946db8700 1 -- 172.21.15.78:0/44263768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066a40 msgr2=0x7f99400624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.289+0000 7f9946db8700 1 --2- 172.21.15.78:0/44263768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066a40 0x7f99400624f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f992c009760 tx=0x7f992c009060).stop 2023-08-17T17:49:07.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.289+0000 7f9946db8700 1 -- 172.21.15.78:0/44263768 shutdown_connections 2023-08-17T17:49:07.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.289+0000 7f9946db8700 1 --2- 172.21.15.78:0/44263768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066a40 0x7f99400624f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.289+0000 7f9946db8700 1 -- 172.21.15.78:0/44263768 >> 172.21.15.78:0/44263768 conn(0x7f99400c7b00 msgr2=0x7f99400c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:07.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.289+0000 7f9946db8700 1 -- 172.21.15.78:0/44263768 shutdown_connections 2023-08-17T17:49:07.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.289+0000 7f9946db8700 1 -- 172.21.15.78:0/44263768 wait complete. 2023-08-17T17:49:07.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.290+0000 7f9946db8700 1 Processor -- start 2023-08-17T17:49:07.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.290+0000 7f9946db8700 1 -- start start 2023-08-17T17:49:07.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f9946db8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99400629e0 0x7f99400aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f9946db8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066660 0x7f99401527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f9946db8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9940066a40 0x7f9940164980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f9946db8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99400c5aa0 con 0x7f9940066660 2023-08-17T17:49:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f9946db8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99400a7c00 con 0x7f9940066a40 2023-08-17T17:49:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f9946db8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9940165560 con 0x7f99400629e0 2023-08-17T17:49:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f993ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066660 0x7f99401527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f993ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066660 0x7f99401527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41514/0 (socket says 172.21.15.78:41514) 2023-08-17T17:49:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f993ffff700 1 -- 172.21.15.78:0/2464396982 learned_addr learned my addr 172.21.15.78:0/2464396982 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f9944b54700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99400629e0 0x7f99400aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:07.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.291+0000 7f9945355700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9940066a40 0x7f9940164980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:07.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f993ffff700 1 -- 172.21.15.78:0/2464396982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99400629e0 msgr2=0x7f99400aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f993ffff700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99400629e0 0x7f99400aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f993ffff700 1 -- 172.21.15.78:0/2464396982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9940066a40 msgr2=0x7f9940164980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f993ffff700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9940066a40 0x7f9940164980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f993ffff700 1 -- 172.21.15.78:0/2464396982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c0092a0 con 0x7f9940066660 2023-08-17T17:49:07.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f9945355700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9940066a40 0x7f9940164980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f993ffff700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066660 0x7f99401527c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f994005f3a0 tx=0x7f992c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f993cff9700 1 -- 172.21.15.78:0/2464396982 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00b850 con 0x7f9940066660 2023-08-17T17:49:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f993cff9700 1 -- 172.21.15.78:0/2464396982 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00b9b0 con 0x7f9940066660 2023-08-17T17:49:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f993cff9700 1 -- 172.21.15.78:0/2464396982 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c01b620 con 0x7f9940066660 2023-08-17T17:49:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f9946db8700 1 -- 172.21.15.78:0/2464396982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9940165840 con 0x7f9940066660 2023-08-17T17:49:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.292+0000 7f9946db8700 1 -- 172.21.15.78:0/2464396982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99400a7890 con 0x7f9940066660 2023-08-17T17:49:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.293+0000 7f9946db8700 1 -- 172.21.15.78:0/2464396982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9940047350 con 0x7f9940066660 2023-08-17T17:49:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.294+0000 7f993cff9700 1 -- 172.21.15.78:0/2464396982 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f992c02b070 con 0x7f9940066660 2023-08-17T17:49:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.294+0000 7f993cff9700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f992405ee20 0x7f99240612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.294+0000 7f9944b54700 1 -- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f992405ee20 msgr2=0x7f99240612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:07.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.294+0000 7f993cff9700 1 -- 172.21.15.78:0/2464396982 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f992c07b630 con 0x7f9940066660 2023-08-17T17:49:07.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.294+0000 7f9944b54700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f992405ee20 0x7f99240612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:07.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.298+0000 7f993cff9700 1 -- 172.21.15.78:0/2464396982 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f992c04c9d0 con 0x7f9940066660 2023-08-17T17:49:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.495+0000 7f9944b54700 1 -- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f992405ee20 msgr2=0x7f99240612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.495+0000 7f9944b54700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f992405ee20 0x7f99240612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.514+0000 7f9946db8700 1 -- 172.21.15.78:0/2464396982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9940064b20 con 0x7f9940066660 2023-08-17T17:49:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.515+0000 7f993cff9700 1 -- 172.21.15.78:0/2464396982 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f992c01f090 con 0x7f9940066660 2023-08-17T17:49:07.516 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:07.516 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5090,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2346190042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2346190042},{"type":"v1","addr":"172.21.15.150:6834","nonce":2346190042}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2674101879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2674101879},{"type":"v1","addr":"172.21.15.78:6837","nonce":2674101879}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5745,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1609000139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1609000139},{"type":"v1","addr":"172.21.15.78:6836","nonce":1609000139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:46:53.930414+0000","modified":"2023-08-17T17:46:55.941460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/412084175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":412084175},{"type":"v1","addr":"172.21.15.150:6835","nonce":412084175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T17:49:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 -- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f992405ee20 msgr2=0x7f99240612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f992405ee20 0x7f99240612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 -- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066660 msgr2=0x7f99401527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066660 0x7f99401527c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f994005f3a0 tx=0x7f992c017000).stop 2023-08-17T17:49:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 -- 172.21.15.78:0/2464396982 shutdown_connections 2023-08-17T17:49:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f992405ee20 0x7f99240612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9940066a40 0x7f9940164980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99400629e0 0x7f99400aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 --2- 172.21.15.78:0/2464396982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940066660 0x7f99401527c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 -- 172.21.15.78:0/2464396982 >> 172.21.15.78:0/2464396982 conn(0x7f99400c7b00 msgr2=0x7f99400a66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 -- 172.21.15.78:0/2464396982 shutdown_connections 2023-08-17T17:49:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.517+0000 7f9946db8700 1 -- 172.21.15.78:0/2464396982 wait complete. 2023-08-17T17:49:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 19 2023-08-17T17:49:07.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:07.558 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:07.557+0000 7f3967a7a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:49:07.627 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:07.625+0000 7f3967a7a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:49:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.648+0000 7f62dff5d700 1 Processor -- start 2023-08-17T17:49:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.649+0000 7f62dff5d700 1 -- start start 2023-08-17T17:49:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.649+0000 7f62dff5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d8152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.649+0000 7f62dff5d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f62d80be4d0 0x7f62d80be960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.649+0000 7f62dff5d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d80bf210 con 0x7f62d80a7c90 2023-08-17T17:49:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.649+0000 7f62dff5d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d80c5a80 con 0x7f62d80be4d0 2023-08-17T17:49:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.649+0000 7f62dff5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80bee50 con 0x7f62d8151e40 2023-08-17T17:49:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62de4fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f62d80be4d0 0x7f62d80be960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62ddcf9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d8152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62dd4f8700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f62d80a7c90 0x7f62d80c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:55114/0 (socket says 172.21.15.78:55114) 2023-08-17T17:49:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62de4fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f62d80be4d0 0x7f62d80be960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:47276/0 (socket says 172.21.15.78:47276) 2023-08-17T17:49:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62ddcf9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d8152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:54762/0 (socket says 172.21.15.78:54762) 2023-08-17T17:49:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62dd4f8700 1 -- 172.21.15.78:0/1129806757 learned_addr learned my addr 172.21.15.78:0/1129806757 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62dccf7700 1 -- 172.21.15.78:0/1129806757 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340095850 0 0) 0x7f62d80bf210 con 0x7f62d80a7c90 2023-08-17T17:49:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62dccf7700 1 -- 172.21.15.78:0/1129806757 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c40033f0 con 0x7f62d80a7c90 2023-08-17T17:49:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62de4fa700 1 -- 172.21.15.78:0/1129806757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 msgr2=0x7f62d8152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62de4fa700 1 --2- 172.21.15.78:0/1129806757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d8152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62de4fa700 1 -- 172.21.15.78:0/1129806757 >> v1:172.21.15.150:6789/0 conn(0x7f62d80a7c90 legacy=0x7f62d80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62de4fa700 1 -- 172.21.15.78:0/1129806757 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80c5450 con 0x7f62d80be4d0 2023-08-17T17:49:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62ddcf9700 1 --2- 172.21.15.78:0/1129806757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d8152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62de4fa700 1 --2- 172.21.15.78:0/1129806757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62d80be4d0 0x7f62d80be960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f62d0009e60 tx=0x7f62d0009780).ready entity=mon.1 client_cookie=1db0f614a314412e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62dccf7700 1 -- 172.21.15.78:0/1129806757 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d000e070 con 0x7f62d80be4d0 2023-08-17T17:49:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62dccf7700 1 -- 172.21.15.78:0/1129806757 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d000bab0 con 0x7f62d80be4d0 2023-08-17T17:49:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.650+0000 7f62dccf7700 1 -- 172.21.15.78:0/1129806757 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d000be30 con 0x7f62d80be4d0 2023-08-17T17:49:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.651+0000 7f62dff5d700 1 -- 172.21.15.78:0/1129806757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62d80be4d0 msgr2=0x7f62d80be960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.651+0000 7f62dff5d700 1 --2- 172.21.15.78:0/1129806757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62d80be4d0 0x7f62d80be960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f62d0009e60 tx=0x7f62d0009780).stop 2023-08-17T17:49:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.651+0000 7f62dff5d700 1 -- 172.21.15.78:0/1129806757 shutdown_connections 2023-08-17T17:49:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.651+0000 7f62dff5d700 1 --2- 172.21.15.78:0/1129806757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62d80be4d0 0x7f62d80be960 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.651+0000 7f62dff5d700 1 --2- 172.21.15.78:0/1129806757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d8152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.651+0000 7f62dff5d700 1 -- 172.21.15.78:0/1129806757 >> 172.21.15.78:0/1129806757 conn(0x7f62d8092330 msgr2=0x7f62d8062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.651+0000 7f62dff5d700 1 -- 172.21.15.78:0/1129806757 shutdown_connections 2023-08-17T17:49:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.651+0000 7f62dff5d700 1 -- 172.21.15.78:0/1129806757 wait complete. 2023-08-17T17:49:07.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.652+0000 7f62dff5d700 1 Processor -- start 2023-08-17T17:49:07.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.652+0000 7f62dff5d700 1 -- start start 2023-08-17T17:49:07.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62dff5d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62d80a7c90 0x7f62d80add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62dff5d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d80be4d0 0x7f62d80ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62dff5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d80a9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62dff5d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80ae720 con 0x7f62d80be4d0 2023-08-17T17:49:07.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62dff5d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d814e330 con 0x7f62d80a7c90 2023-08-17T17:49:07.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62dff5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d814e8f0 con 0x7f62d8151e40 2023-08-17T17:49:07.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62dd4f8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d80be4d0 0x7f62d80ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:07.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62dd4f8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d80be4d0 0x7f62d80ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41518/0 (socket says 172.21.15.78:41518) 2023-08-17T17:49:07.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62de4fa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d80a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:07.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62ddcf9700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62d80a7c90 0x7f62d80add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:07.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62dd4f8700 1 -- 172.21.15.78:0/134510004 learned_addr learned my addr 172.21.15.78:0/134510004 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:07.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62de4fa700 1 -- 172.21.15.78:0/134510004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62d80a7c90 msgr2=0x7f62d80add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62de4fa700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62d80a7c90 0x7f62d80add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62de4fa700 1 -- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d80be4d0 msgr2=0x7f62d80ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62de4fa700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d80be4d0 0x7f62d80ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.653+0000 7f62de4fa700 1 -- 172.21.15.78:0/134510004 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d40092a0 con 0x7f62d8151e40 2023-08-17T17:49:07.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.654+0000 7f62de4fa700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d80a9210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f62d8069290 tx=0x7f62d0009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:07.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.654+0000 7f62cdffb700 1 -- 172.21.15.78:0/134510004 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0013e40 con 0x7f62d8151e40 2023-08-17T17:49:07.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.654+0000 7f62cdffb700 1 -- 172.21.15.78:0/134510004 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d001d630 con 0x7f62d8151e40 2023-08-17T17:49:07.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.654+0000 7f62dff5d700 1 -- 172.21.15.78:0/134510004 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d0009a20 con 0x7f62d8151e40 2023-08-17T17:49:07.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.654+0000 7f62cdffb700 1 -- 172.21.15.78:0/134510004 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d001d9f0 con 0x7f62d8151e40 2023-08-17T17:49:07.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.654+0000 7f62dff5d700 1 -- 172.21.15.78:0/134510004 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d80aa270 con 0x7f62d8151e40 2023-08-17T17:49:07.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.655+0000 7f62dff5d700 1 -- 172.21.15.78:0/134510004 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d8047350 con 0x7f62d8151e40 2023-08-17T17:49:07.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.655+0000 7f62cdffb700 1 -- 172.21.15.78:0/134510004 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f62d0026410 con 0x7f62d8151e40 2023-08-17T17:49:07.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.656+0000 7f62cdffb700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f62bc05ee20 0x7f62bc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:07.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.656+0000 7f62ddcf9700 1 -- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f62bc05ee20 msgr2=0x7f62bc0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:07.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.656+0000 7f62cdffb700 1 -- 172.21.15.78:0/134510004 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f62d007bd30 con 0x7f62d8151e40 2023-08-17T17:49:07.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.656+0000 7f62ddcf9700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f62bc05ee20 0x7f62bc0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:07.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.660+0000 7f62cdffb700 1 -- 172.21.15.78:0/134510004 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f62d004d0f0 con 0x7f62d8151e40 2023-08-17T17:49:07.688 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:07.687+0000 7fc05343b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:49:07.704 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:07.703+0000 7f3967a7a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:49:07.759 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:07.758+0000 7fc05343b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:49:07.836 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:07.835+0000 7fc05343b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:49:07.851 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:07.849+0000 7f3967a7a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:49:07.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.857+0000 7f62ddcf9700 1 -- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f62bc05ee20 msgr2=0x7f62bc0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:07.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.857+0000 7f62ddcf9700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f62bc05ee20 0x7f62bc0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:07.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.873+0000 7f62dff5d700 1 -- 172.21.15.78:0/134510004 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62d81533f0 con 0x7f62d8151e40 2023-08-17T17:49:07.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.873+0000 7f62cdffb700 1 -- 172.21.15.78:0/134510004 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f62d0050710 con 0x7f62d8151e40 2023-08-17T17:49:07.875 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:07.875 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5090,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2346190042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2346190042},{"type":"v1","addr":"172.21.15.150:6834","nonce":2346190042}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2674101879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2674101879},{"type":"v1","addr":"172.21.15.78:6837","nonce":2674101879}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5745,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1609000139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1609000139},{"type":"v1","addr":"172.21.15.78:6836","nonce":1609000139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:46:53.930414+0000","modified":"2023-08-17T17:46:55.941460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/412084175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":412084175},{"type":"v1","addr":"172.21.15.150:6835","nonce":412084175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T17:49:07.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 -- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f62bc05ee20 msgr2=0x7f62bc0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:07.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f62bc05ee20 0x7f62bc0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:07.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 -- 172.21.15.78:0/134510004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 msgr2=0x7f62d80a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:07.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d80a9210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f62d8069290 tx=0x7f62d0009780).stop 2023-08-17T17:49:07.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 -- 172.21.15.78:0/134510004 shutdown_connections 2023-08-17T17:49:07.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f62bc05ee20 0x7f62bc0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:07.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62d8151e40 0x7f62d80a9210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62d80a7c90 0x7f62d80add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 --2- 172.21.15.78:0/134510004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d80be4d0 0x7f62d80ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:07.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 -- 172.21.15.78:0/134510004 >> 172.21.15.78:0/134510004 conn(0x7f62d8092330 msgr2=0x7f62d80c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:07.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 -- 172.21.15.78:0/134510004 shutdown_connections 2023-08-17T17:49:07.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:07.875+0000 7f62dff5d700 1 -- 172.21.15.78:0/134510004 wait complete. 2023-08-17T17:49:07.879 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 19 2023-08-17T17:49:07.889 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:07.922 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:07.920+0000 7f3967a7a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:49:07.992 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:07.991+0000 7fc05343b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:49:08.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.003+0000 7f5b9c752700 1 Processor -- start 2023-08-17T17:49:08.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.003+0000 7f5b9c752700 1 -- start start 2023-08-17T17:49:08.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9c752700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5b9413a640 0x7f5b94154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9c752700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9406a2c0 0x7f5b94069050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9c752700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b940c2c10 con 0x7f5b9413aa20 2023-08-17T17:49:08.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9c752700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b94155010 con 0x7f5b9413a640 2023-08-17T17:49:08.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9c752700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b941552e0 con 0x7f5b9406a2c0 2023-08-17T17:49:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9a4ee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5b9413a640 0x7f5b94154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b99ced700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9406a2c0 0x7f5b94069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9acef700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5b9413aa20 0x7f5b94151590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:55120/0 (socket says 172.21.15.78:55120) 2023-08-17T17:49:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9acef700 1 -- 172.21.15.78:0/1783148155 learned_addr learned my addr 172.21.15.78:0/1783148155 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b99ced700 1 --2- 172.21.15.78:0/1783148155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9406a2c0 0x7f5b94069050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:54774/0 (socket says 172.21.15.78:54774) 2023-08-17T17:49:08.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9a4ee700 1 -- 172.21.15.78:0/1783148155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9406a2c0 msgr2=0x7f5b94069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:08.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9a4ee700 1 --2- 172.21.15.78:0/1783148155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9406a2c0 0x7f5b94069050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9a4ee700 1 -- 172.21.15.78:0/1783148155 >> v1:172.21.15.150:6789/0 conn(0x7f5b9413aa20 legacy=0x7f5b94151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:08.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b9a4ee700 1 -- 172.21.15.78:0/1783148155 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b941555c0 con 0x7f5b9413a640 2023-08-17T17:49:08.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b994ec700 1 -- 172.21.15.78:0/1783148155 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381939484 0 0) 0x7f5b940c2c10 con 0x7f5b9413aa20 2023-08-17T17:49:08.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.005+0000 7f5b99ced700 1 --2- 172.21.15.78:0/1783148155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9406a2c0 0x7f5b94069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:08.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b9a4ee700 1 --2- 172.21.15.78:0/1783148155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9413a640 0x7f5b94154b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5b8400ba00 tx=0x7f5b8400b300).ready entity=mon.1 client_cookie=4c07d08179f5de85 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b994ec700 1 -- 172.21.15.78:0/1783148155 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8400da70 con 0x7f5b9413a640 2023-08-17T17:49:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b994ec700 1 -- 172.21.15.78:0/1783148155 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8400dbd0 con 0x7f5b9413a640 2023-08-17T17:49:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b994ec700 1 -- 172.21.15.78:0/1783148155 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b84010470 con 0x7f5b9413a640 2023-08-17T17:49:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b9c752700 1 -- 172.21.15.78:0/1783148155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9413a640 msgr2=0x7f5b94154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b9c752700 1 --2- 172.21.15.78:0/1783148155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9413a640 0x7f5b94154b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5b8400ba00 tx=0x7f5b8400b300).stop 2023-08-17T17:49:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b9c752700 1 -- 172.21.15.78:0/1783148155 shutdown_connections 2023-08-17T17:49:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b9c752700 1 --2- 172.21.15.78:0/1783148155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9413a640 0x7f5b94154b20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b9c752700 1 --2- 172.21.15.78:0/1783148155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9406a2c0 0x7f5b94069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b9c752700 1 -- 172.21.15.78:0/1783148155 >> 172.21.15.78:0/1783148155 conn(0x7f5b940c7b00 msgr2=0x7f5b940c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b9c752700 1 -- 172.21.15.78:0/1783148155 shutdown_connections 2023-08-17T17:49:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.006+0000 7f5b9c752700 1 -- 172.21.15.78:0/1783148155 wait complete. 2023-08-17T17:49:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.007+0000 7f5b9c752700 1 Processor -- start 2023-08-17T17:49:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.007+0000 7f5b9c752700 1 -- start start 2023-08-17T17:49:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b9c752700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b9406a2c0 0x7f5b94065f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b9c752700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9413a640 0x7f5b940c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b9c752700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9413aa20 0x7f5b94167fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b9c752700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940bf810 con 0x7f5b9406a2c0 2023-08-17T17:49:08.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b9c752700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940bec40 con 0x7f5b9413a640 2023-08-17T17:49:08.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b9c752700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940beee0 con 0x7f5b9413aa20 2023-08-17T17:49:08.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b9a4ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b9406a2c0 0x7f5b94065f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:08.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b9a4ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b9406a2c0 0x7f5b94065f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41526/0 (socket says 172.21.15.78:41526) 2023-08-17T17:49:08.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b9a4ee700 1 -- 172.21.15.78:0/4109077004 learned_addr learned my addr 172.21.15.78:0/4109077004 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b9acef700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9413aa20 0x7f5b94167fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.008+0000 7f5b99ced700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9413a640 0x7f5b940c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b9a4ee700 1 -- 172.21.15.78:0/4109077004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9413aa20 msgr2=0x7f5b94167fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b9a4ee700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9413aa20 0x7f5b94167fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b9a4ee700 1 -- 172.21.15.78:0/4109077004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9413a640 msgr2=0x7f5b940c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b9a4ee700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9413a640 0x7f5b940c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b9a4ee700 1 -- 172.21.15.78:0/4109077004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b900092a0 con 0x7f5b9406a2c0 2023-08-17T17:49:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b9a4ee700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b9406a2c0 0x7f5b94065f40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f5b8400d5d0 tx=0x7f5b8400b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:08.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b8a7fc700 1 -- 172.21.15.78:0/4109077004 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8400de90 con 0x7f5b9406a2c0 2023-08-17T17:49:08.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b8a7fc700 1 -- 172.21.15.78:0/4109077004 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b84019660 con 0x7f5b9406a2c0 2023-08-17T17:49:08.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b9c752700 1 -- 172.21.15.78:0/4109077004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8400b540 con 0x7f5b9406a2c0 2023-08-17T17:49:08.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b8a7fc700 1 -- 172.21.15.78:0/4109077004 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b84019a20 con 0x7f5b9406a2c0 2023-08-17T17:49:08.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.009+0000 7f5b9c752700 1 -- 172.21.15.78:0/4109077004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b940bf4a0 con 0x7f5b9406a2c0 2023-08-17T17:49:08.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.010+0000 7f5b9c752700 1 -- 172.21.15.78:0/4109077004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b94069eb0 con 0x7f5b9406a2c0 2023-08-17T17:49:08.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.011+0000 7f5b8a7fc700 1 -- 172.21.15.78:0/4109077004 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f5b84016030 con 0x7f5b9406a2c0 2023-08-17T17:49:08.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.011+0000 7f5b8a7fc700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b7805ee20 0x7f5b780612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.011+0000 7f5b99ced700 1 -- 172.21.15.78:0/4109077004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b7805ee20 msgr2=0x7f5b780612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:08.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.011+0000 7f5b8a7fc700 1 -- 172.21.15.78:0/4109077004 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f5b8407ba40 con 0x7f5b9406a2c0 2023-08-17T17:49:08.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.011+0000 7f5b99ced700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b7805ee20 0x7f5b780612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:08.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.015+0000 7f5b8a7fc700 1 -- 172.21.15.78:0/4109077004 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b8404cee0 con 0x7f5b9406a2c0 2023-08-17T17:49:08.038 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:08.037+0000 7f3967a7a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:49:08.066 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.066+0000 7fc05343b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:49:08.146 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:08.145+0000 7f3967a7a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:08.184 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.183+0000 7fc05343b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:49:08.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.185+0000 7f5b9c752700 1 -- 172.21.15.78:0/4109077004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b94047350 con 0x7f5b9406a2c0 2023-08-17T17:49:08.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.186+0000 7f5b8a7fc700 1 -- 172.21.15.78:0/4109077004 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+17519 (secure 0 0 0) 0x7f5b84028070 con 0x7f5b9406a2c0 2023-08-17T17:49:08.188 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:08.188 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":64,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:05.253258+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:46:52.467922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T17:46:52.895738+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":64,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"8.21","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1630605532":"2023-08-18T17:47:09.437078+0000","172.21.15.78:6833/119464":"2023-08-18T17:47:09.437078+0000","172.21.15.78:6832/119464":"2023-08-18T17:47:09.437078+0000","172.21.15.78:0/4202278981":"2023-08-18T17:47:09.437078+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:08.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 -- 172.21.15.78:0/4109077004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b7805ee20 msgr2=0x7f5b780612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:08.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b7805ee20 0x7f5b780612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:08.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 -- 172.21.15.78:0/4109077004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b9406a2c0 msgr2=0x7f5b94065f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:08.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b9406a2c0 0x7f5b94065f40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f5b8400d5d0 tx=0x7f5b8400b300).stop 2023-08-17T17:49:08.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 -- 172.21.15.78:0/4109077004 shutdown_connections 2023-08-17T17:49:08.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5b7805ee20 0x7f5b780612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:08.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b9413aa20 0x7f5b94167fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b9406a2c0 0x7f5b94065f40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 --2- 172.21.15.78:0/4109077004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b9413a640 0x7f5b940c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 -- 172.21.15.78:0/4109077004 >> 172.21.15.78:0/4109077004 conn(0x7f5b940c7b00 msgr2=0x7f5b941394e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:08.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 -- 172.21.15.78:0/4109077004 shutdown_connections 2023-08-17T17:49:08.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.188+0000 7f5b9c752700 1 -- 172.21.15.78:0/4109077004 wait complete. 2023-08-17T17:49:08.202 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T17:49:08.299 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.298+0000 7fc05343b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:08.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.319+0000 7f31ed184700 1 Processor -- start 2023-08-17T17:49:08.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.319+0000 7f31ed184700 1 -- start start 2023-08-17T17:49:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.319+0000 7f31ed184700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31e8069310 0x7f31e80696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31ed184700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e8065ff0 con 0x7f31e80c5ae0 2023-08-17T17:49:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31ed184700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e80653e0 con 0x7f31e8066480 2023-08-17T17:49:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31ed184700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80656c0 con 0x7f31e8069310 2023-08-17T17:49:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e6d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31e8069310 0x7f31e80696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e759e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f31e80c5ae0 0x7f31e80c5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40332/0 (socket says 172.21.15.78:40332) 2023-08-17T17:49:08.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e759e700 1 -- 172.21.15.78:0/3921660595 learned_addr learned my addr 172.21.15.78:0/3921660595 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e6d9d700 1 -- 172.21.15.78:0/3921660595 >> v1:172.21.15.150:6789/0 conn(0x7f31e8066480 legacy=0x7f31e80c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e6d9d700 1 -- 172.21.15.78:0/3921660595 >> v1:172.21.15.78:6789/0 conn(0x7f31e80c5ae0 legacy=0x7f31e80c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e5d9b700 1 -- 172.21.15.78:0/3921660595 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411193745 0 0) 0x7f31e8065ff0 con 0x7f31e80c5ae0 2023-08-17T17:49:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e6d9d700 1 -- 172.21.15.78:0/3921660595 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80659a0 con 0x7f31e8069310 2023-08-17T17:49:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e6d9d700 1 --2- 172.21.15.78:0/3921660595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e8069310 0x7f31e80696f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f31d8009760 tx=0x7f31d8009060).ready entity=mon.0 client_cookie=2a1609a7f1507108 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e5d9b700 1 -- 172.21.15.78:0/3921660595 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d800b520 con 0x7f31e8069310 2023-08-17T17:49:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e5d9b700 1 -- 172.21.15.78:0/3921660595 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800b680 con 0x7f31e8069310 2023-08-17T17:49:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.320+0000 7f31e5d9b700 1 -- 172.21.15.78:0/3921660595 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d800ba00 con 0x7f31e8069310 2023-08-17T17:49:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.321+0000 7f31ed184700 1 -- 172.21.15.78:0/3921660595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e8069310 msgr2=0x7f31e80696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.321+0000 7f31ed184700 1 --2- 172.21.15.78:0/3921660595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e8069310 0x7f31e80696f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f31d8009760 tx=0x7f31d8009060).stop 2023-08-17T17:49:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.321+0000 7f31ed184700 1 -- 172.21.15.78:0/3921660595 shutdown_connections 2023-08-17T17:49:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.321+0000 7f31ed184700 1 --2- 172.21.15.78:0/3921660595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e8069310 0x7f31e80696f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.321+0000 7f31ed184700 1 -- 172.21.15.78:0/3921660595 >> 172.21.15.78:0/3921660595 conn(0x7f31e80c8680 msgr2=0x7f31e80c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:08.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.321+0000 7f31ed184700 1 -- 172.21.15.78:0/3921660595 shutdown_connections 2023-08-17T17:49:08.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.321+0000 7f31ed184700 1 -- 172.21.15.78:0/3921660595 wait complete. 2023-08-17T17:49:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.322+0000 7f31ed184700 1 Processor -- start 2023-08-17T17:49:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.322+0000 7f31ed184700 1 -- start start 2023-08-17T17:49:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31ed184700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e8066480 0x7f31e80a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31ed184700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31e8069310 0x7f31e8145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31ed184700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e80c5ae0 0x7f31e80624f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31ed184700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80a8be0 con 0x7f31e80c5ae0 2023-08-17T17:49:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31ed184700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80a7fd0 con 0x7f31e8069310 2023-08-17T17:49:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31ed184700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80a82b0 con 0x7f31e8066480 2023-08-17T17:49:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31e759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e80c5ae0 0x7f31e80624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31e759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e80c5ae0 0x7f31e80624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41552/0 (socket says 172.21.15.78:41552) 2023-08-17T17:49:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31e759e700 1 -- 172.21.15.78:0/2914729842 learned_addr learned my addr 172.21.15.78:0/2914729842 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31e659c700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31e8069310 0x7f31e8145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31e6d9d700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e8066480 0x7f31e80a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31e759e700 1 -- 172.21.15.78:0/2914729842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e8066480 msgr2=0x7f31e80a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31e759e700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e8066480 0x7f31e80a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31e759e700 1 -- 172.21.15.78:0/2914729842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31e8069310 msgr2=0x7f31e8145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31e759e700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31e8069310 0x7f31e8145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.323+0000 7f31e759e700 1 -- 172.21.15.78:0/2914729842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d80092a0 con 0x7f31e80c5ae0 2023-08-17T17:49:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.324+0000 7f31e759e700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e80c5ae0 0x7f31e80624f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f31e000c7e0 tx=0x7f31e0007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.324+0000 7f31ceffd700 1 -- 172.21.15.78:0/2914729842 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0005d30 con 0x7f31e80c5ae0 2023-08-17T17:49:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.324+0000 7f31ceffd700 1 -- 172.21.15.78:0/2914729842 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0005e90 con 0x7f31e80c5ae0 2023-08-17T17:49:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.324+0000 7f31ed184700 1 -- 172.21.15.78:0/2914729842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e80a8590 con 0x7f31e80c5ae0 2023-08-17T17:49:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.324+0000 7f31ceffd700 1 -- 172.21.15.78:0/2914729842 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0007320 con 0x7f31e80c5ae0 2023-08-17T17:49:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.324+0000 7f31ed184700 1 -- 172.21.15.78:0/2914729842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e80a7be0 con 0x7f31e80c5ae0 2023-08-17T17:49:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.325+0000 7f31ed184700 1 -- 172.21.15.78:0/2914729842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e8047350 con 0x7f31e80c5ae0 2023-08-17T17:49:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.326+0000 7f31ceffd700 1 -- 172.21.15.78:0/2914729842 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f31e0010030 con 0x7f31e80c5ae0 2023-08-17T17:49:08.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.326+0000 7f31ceffd700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f31d405ee20 0x7f31d40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:08.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.326+0000 7f31e6d9d700 1 -- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f31d405ee20 msgr2=0x7f31d40612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:08.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.326+0000 7f31ceffd700 1 -- 172.21.15.78:0/2914729842 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f31e007a100 con 0x7f31e80c5ae0 2023-08-17T17:49:08.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.326+0000 7f31e6d9d700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f31d405ee20 0x7f31d40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:08.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.330+0000 7f31ceffd700 1 -- 172.21.15.78:0/2914729842 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31e004b540 con 0x7f31e80c5ae0 2023-08-17T17:49:08.440 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:08.439+0000 7f3967a7a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:49:08.510 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:08.509+0000 7f3967a7a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:49:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.527+0000 7f31e6d9d700 1 -- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f31d405ee20 msgr2=0x7f31d40612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.527+0000 7f31e6d9d700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f31d405ee20 0x7f31d40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:08.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.542+0000 7f31ed184700 1 -- 172.21.15.78:0/2914729842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f31e80a74d0 con 0x7f31e80c5ae0 2023-08-17T17:49:08.599 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.598+0000 7fc05343b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:49:08.670 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.669+0000 7fc05343b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:49:08.689 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:49:08.688+0000 7f78327d1700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:08.690 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:49:08.688+0000 7f78327d1700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:08.690 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:49:08.688+0000 7f78327d1700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:49:08.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.690+0000 7f31ceffd700 1 -- 172.21.15.78:0/2914729842 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 22) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f31e0077f00 con 0x7f31e80c5ae0 2023-08-17T17:49:08.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.690+0000 7f31ceffd700 1 -- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f31d405ee20 msgr2=0x7f31d40612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:08.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:08.690+0000 7f31ceffd700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f31d405ee20 0x7f31d40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:08.704 INFO:tasks.ceph.mds.d.smithi150.stderr: -4> 2023-08-17T17:49:08.688+0000 7f78327d1700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:08.704 INFO:tasks.ceph.mds.d.smithi150.stderr: -3> 2023-08-17T17:49:08.688+0000 7f78327d1700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:08.704 INFO:tasks.ceph.mds.d.smithi150.stderr: -1> 2023-08-17T17:49:08.688+0000 7f78327d1700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:49:08.722 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:49:08.752 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.751+0000 7fbfd2c1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:08.752 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.751+0000 7fbfd2c1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:08.753 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.751+0000 7fbfd2c1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:08.753 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.751+0000 7fbfd2c1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:08.753 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.751+0000 7fbfd2c1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:08.753 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.751+0000 7fbfd6422700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:08.753 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.751+0000 7fbfd6422700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:08.753 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.751+0000 7fbfd6422700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:08.753 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.751+0000 7fbfd6422700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:08.754 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:08.751+0000 7fbfd6422700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:09.274 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T17:49:09.273+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T17:49:09.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.280+0000 7f31ceffd700 1 -- 172.21.15.78:0/2914729842 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f31e00778e0 con 0x7f31e80c5ae0 2023-08-17T17:49:09.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.282+0000 7f31ed184700 1 -- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e80c5ae0 msgr2=0x7f31e80624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.282+0000 7f31ed184700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e80c5ae0 0x7f31e80624f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f31e000c7e0 tx=0x7f31e0007f90).stop 2023-08-17T17:49:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.282+0000 7f31ed184700 1 -- 172.21.15.78:0/2914729842 shutdown_connections 2023-08-17T17:49:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.282+0000 7f31ed184700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f31d405ee20 0x7f31d40612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.282+0000 7f31ed184700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e80c5ae0 0x7f31e80624f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.282+0000 7f31ed184700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e8066480 0x7f31e80a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.282+0000 7f31ed184700 1 --2- 172.21.15.78:0/2914729842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31e8069310 0x7f31e8145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.282+0000 7f31ed184700 1 -- 172.21.15.78:0/2914729842 >> 172.21.15.78:0/2914729842 conn(0x7f31e80c8680 msgr2=0x7f31e8153030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:09.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.282+0000 7f31ed184700 1 -- 172.21.15.78:0/2914729842 shutdown_connections 2023-08-17T17:49:09.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.282+0000 7f31ed184700 1 -- 172.21.15.78:0/2914729842 wait complete. 2023-08-17T17:49:09.285 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T17:49:09.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T17:49:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.410+0000 7fe1f9e41700 1 Processor -- start 2023-08-17T17:49:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.410+0000 7fe1f9e41700 1 -- start start 2023-08-17T17:49:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.411+0000 7fe1f9e41700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f414e680 0x7fe1f40c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.411+0000 7fe1f9e41700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1f4069a20 0x7fe1f40c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.411+0000 7fe1f9e41700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f40c5990 con 0x7fe1f414ea60 2023-08-17T17:49:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.411+0000 7fe1f9e41700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f40bcc10 con 0x7fe1f4069a20 2023-08-17T17:49:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.411+0000 7fe1f9e41700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f40c4120 con 0x7fe1f414e680 2023-08-17T17:49:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f3fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1f4069a20 0x7fe1f40c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:09.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f37fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f414e680 0x7fe1f40c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:09.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1eaffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe1f414ea60 0x7fe1f4069310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:35990/0 (socket says 172.21.15.78:35990) 2023-08-17T17:49:09.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1eaffd700 1 -- 172.21.15.78:0/2989255598 learned_addr learned my addr 172.21.15.78:0/2989255598 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:09.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f3fff700 1 -- 172.21.15.78:0/2989255598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f414e680 msgr2=0x7fe1f40c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:09.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f3fff700 1 --2- 172.21.15.78:0/2989255598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f414e680 0x7fe1f40c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:09.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f3fff700 1 -- 172.21.15.78:0/2989255598 >> v1:172.21.15.150:6789/0 conn(0x7fe1f414ea60 legacy=0x7fe1f4069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:09.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f2ffd700 1 -- 172.21.15.78:0/2989255598 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102725325 0 0) 0x7fe1f40c5990 con 0x7fe1f414ea60 2023-08-17T17:49:09.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f3fff700 1 -- 172.21.15.78:0/2989255598 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f40c3880 con 0x7fe1f4069a20 2023-08-17T17:49:09.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f3fff700 1 --2- 172.21.15.78:0/2989255598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f4069a20 0x7fe1f40c3290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fe1ec009e60 tx=0x7fe1ec009780).ready entity=mon.1 client_cookie=d00e5d4d7de906ce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:09.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f2ffd700 1 -- 172.21.15.78:0/2989255598 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec00e070 con 0x7fe1f4069a20 2023-08-17T17:49:09.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f2ffd700 1 -- 172.21.15.78:0/2989255598 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec00bb60 con 0x7fe1f4069a20 2023-08-17T17:49:09.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.412+0000 7fe1f2ffd700 1 -- 172.21.15.78:0/2989255598 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec012410 con 0x7fe1f4069a20 2023-08-17T17:49:09.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.413+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2989255598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f4069a20 msgr2=0x7fe1f40c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:09.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.413+0000 7fe1f9e41700 1 --2- 172.21.15.78:0/2989255598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f4069a20 0x7fe1f40c3290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fe1ec009e60 tx=0x7fe1ec009780).stop 2023-08-17T17:49:09.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.413+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2989255598 shutdown_connections 2023-08-17T17:49:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.413+0000 7fe1f9e41700 1 --2- 172.21.15.78:0/2989255598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f4069a20 0x7fe1f40c3290 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.413+0000 7fe1f9e41700 1 --2- 172.21.15.78:0/2989255598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f414e680 0x7fe1f40c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.413+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2989255598 >> 172.21.15.78:0/2989255598 conn(0x7fe1f40c7b80 msgr2=0x7fe1f40c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.413+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2989255598 shutdown_connections 2023-08-17T17:49:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.413+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2989255598 wait complete. 2023-08-17T17:49:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.414+0000 7fe1f9e41700 1 Processor -- start 2023-08-17T17:49:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.414+0000 7fe1f9e41700 1 -- start start 2023-08-17T17:49:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1f9e41700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f4069a20 0x7fe1f414a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1f9e41700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f414e680 0x7fe1f40624f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1f9e41700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f414ea60 0x7fe1f40c1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1f9e41700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f4063390 con 0x7fe1f414e680 2023-08-17T17:49:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1f9e41700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f414ab00 con 0x7fe1f4069a20 2023-08-17T17:49:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1f9e41700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f4062af0 con 0x7fe1f414ea60 2023-08-17T17:49:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1eaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f414e680 0x7fe1f40624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1eaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f414e680 0x7fe1f40624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42330/0 (socket says 172.21.15.78:42330) 2023-08-17T17:49:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1eaffd700 1 -- 172.21.15.78:0/2540114230 learned_addr learned my addr 172.21.15.78:0/2540114230 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1f3fff700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f414ea60 0x7fe1f40c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1f37fe700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f4069a20 0x7fe1f414a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1eaffd700 1 -- 172.21.15.78:0/2540114230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f414ea60 msgr2=0x7fe1f40c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1eaffd700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f414ea60 0x7fe1f40c1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1eaffd700 1 -- 172.21.15.78:0/2540114230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f4069a20 msgr2=0x7fe1f414a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1eaffd700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f4069a20 0x7fe1f414a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.415+0000 7fe1eaffd700 1 -- 172.21.15.78:0/2540114230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec009a20 con 0x7fe1f414e680 2023-08-17T17:49:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.416+0000 7fe1f37fe700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f4069a20 0x7fe1f414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:09.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.416+0000 7fe1eaffd700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f414e680 0x7fe1f40624f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fe1dc00c490 tx=0x7fe1dc007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:09.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.416+0000 7fe1ebfff700 1 -- 172.21.15.78:0/2540114230 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0070d0 con 0x7fe1f414e680 2023-08-17T17:49:09.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.416+0000 7fe1ebfff700 1 -- 172.21.15.78:0/2540114230 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc007230 con 0x7fe1f414e680 2023-08-17T17:49:09.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.416+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2540114230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f4062dd0 con 0x7fe1f414e680 2023-08-17T17:49:09.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.416+0000 7fe1ebfff700 1 -- 172.21.15.78:0/2540114230 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0075d0 con 0x7fe1f414e680 2023-08-17T17:49:09.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.416+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2540114230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f40c1a50 con 0x7fe1f414e680 2023-08-17T17:49:09.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.417+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2540114230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f414a8d0 con 0x7fe1f414e680 2023-08-17T17:49:09.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.417+0000 7fe1ebfff700 1 -- 172.21.15.78:0/2540114230 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fe1dc01a060 con 0x7fe1f414e680 2023-08-17T17:49:09.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.417+0000 7fe1ebfff700 1 -- 172.21.15.78:0/2540114230 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6695+0+0 (secure 0 0 0) 0x7fe1dc079410 con 0x7fe1f414e680 2023-08-17T17:49:09.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.421+0000 7fe1ebfff700 1 -- 172.21.15.78:0/2540114230 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1f414a8d0 con 0x7fe1f414e680 2023-08-17T17:49:09.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.628+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2540114230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe1f414a8d0 con 0x7fe1f414e680 2023-08-17T17:49:09.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.692+0000 7fe1ebfff700 1 -- 172.21.15.78:0/2540114230 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 23) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fe1dc010070 con 0x7fe1f414e680 2023-08-17T17:49:09.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.692+0000 7fe1ebfff700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1d40301b0 0x7fe1d4067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:09.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.693+0000 7fe1f37fe700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1d40301b0 0x7fe1d4067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:09.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:09.694+0000 7fe1f37fe700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1d40301b0 0x7fe1d4067990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe1e4011310 tx=0x7fe1e4009060).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:10.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.281+0000 7fe1ebfff700 1 -- 172.21.15.78:0/2540114230 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe1dc072820 con 0x7fe1f414e680 2023-08-17T17:49:10.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.283+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2540114230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1d40301b0 msgr2=0x7fe1d4067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:10.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.283+0000 7fe1f9e41700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1d40301b0 0x7fe1d4067990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe1e4011310 tx=0x7fe1e4009060).stop 2023-08-17T17:49:10.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.283+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2540114230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f414e680 msgr2=0x7fe1f40624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:10.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.283+0000 7fe1f9e41700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f414e680 0x7fe1f40624f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fe1dc00c490 tx=0x7fe1dc007e60).stop 2023-08-17T17:49:10.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.284+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2540114230 shutdown_connections 2023-08-17T17:49:10.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.284+0000 7fe1f9e41700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1d40301b0 0x7fe1d4067990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:10.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.284+0000 7fe1f9e41700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f414ea60 0x7fe1f40c1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:10.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.284+0000 7fe1f9e41700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f4069a20 0x7fe1f414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:10.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.284+0000 7fe1f9e41700 1 --2- 172.21.15.78:0/2540114230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f414e680 0x7fe1f40624f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:10.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.284+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2540114230 >> 172.21.15.78:0/2540114230 conn(0x7fe1f40c7b80 msgr2=0x7fe1f40c2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:10.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.284+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2540114230 shutdown_connections 2023-08-17T17:49:10.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.284+0000 7fe1f9e41700 1 -- 172.21.15.78:0/2540114230 wait complete. 2023-08-17T17:49:10.297 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T17:49:10.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.414+0000 7f5fb7d0e700 1 Processor -- start 2023-08-17T17:49:10.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.414+0000 7f5fb7d0e700 1 -- start start 2023-08-17T17:49:10.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb7d0e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5fb00aa0f0 0x7f5fb00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:10.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb7d0e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5fb00c5810 0x7f5fb00c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:10.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb7d0e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00649b0 con 0x7f5fb00aa4d0 2023-08-17T17:49:10.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb7d0e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00c6170 con 0x7f5fb00c5810 2023-08-17T17:49:10.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb7d0e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb0063420 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb62ab700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5fb00c5810 0x7f5fb00c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:10.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb62ab700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5fb00c5810 0x7f5fb00c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42346/0 (socket says 172.21.15.78:42346) 2023-08-17T17:49:10.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb62ab700 1 -- 172.21.15.78:0/2468969193 learned_addr learned my addr 172.21.15.78:0/2468969193 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:10.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb5aaa700 1 --2- 172.21.15.78:0/2468969193 >> v2:172.21.15.150:3300/0 conn(0x7f5fb00aa0f0 0x7f5fb00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:10.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb62ab700 1 -- 172.21.15.78:0/2468969193 >> v2:172.21.15.150:3300/0 conn(0x7f5fb00aa0f0 msgr2=0x7f5fb00644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:10.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb62ab700 1 --2- 172.21.15.78:0/2468969193 >> v2:172.21.15.150:3300/0 conn(0x7f5fb00aa0f0 0x7f5fb00644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:10.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb62ab700 1 -- 172.21.15.78:0/2468969193 >> v1:172.21.15.150:6789/0 conn(0x7f5fb00aa4d0 legacy=0x7f5fb00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:10.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.415+0000 7f5fb62ab700 1 -- 172.21.15.78:0/2468969193 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0063700 con 0x7f5fb00c5810 2023-08-17T17:49:10.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb62ab700 1 --2- 172.21.15.78:0/2468969193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00c5810 0x7f5fb00c5c80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f5fb00cade0 tx=0x7f5fa8009840).ready entity=mon.0 client_cookie=79774e6f29a17f92 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:10.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb4aa8700 1 -- 172.21.15.78:0/2468969193 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800e070 con 0x7f5fb00c5810 2023-08-17T17:49:10.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb4aa8700 1 -- 172.21.15.78:0/2468969193 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa800ba50 con 0x7f5fb00c5810 2023-08-17T17:49:10.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb4aa8700 1 -- 172.21.15.78:0/2468969193 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800bdd0 con 0x7f5fb00c5810 2023-08-17T17:49:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/2468969193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00c5810 msgr2=0x7f5fb00c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb7d0e700 1 --2- 172.21.15.78:0/2468969193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00c5810 0x7f5fb00c5c80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f5fb00cade0 tx=0x7f5fa8009840).stop 2023-08-17T17:49:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/2468969193 shutdown_connections 2023-08-17T17:49:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb7d0e700 1 --2- 172.21.15.78:0/2468969193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00c5810 0x7f5fb00c5c80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:10.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb7d0e700 1 --2- 172.21.15.78:0/2468969193 >> v2:172.21.15.150:3300/0 conn(0x7f5fb00aa0f0 0x7f5fb00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:10.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/2468969193 >> 172.21.15.78:0/2468969193 conn(0x7f5fb006a6a0 msgr2=0x7f5fb00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:10.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/2468969193 shutdown_connections 2023-08-17T17:49:10.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.416+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/2468969193 wait complete. 2023-08-17T17:49:10.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.417+0000 7f5fb7d0e700 1 Processor -- start 2023-08-17T17:49:10.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.417+0000 7f5fb7d0e700 1 -- start start 2023-08-17T17:49:10.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.418+0000 7f5fb7d0e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00aa0f0 0x7f5fb00ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:10.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.418+0000 7f5fb7d0e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb00aa4d0 0x7f5fb00c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:10.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.418+0000 7f5fb7d0e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb00c5810 0x7f5fb0146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:10.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.418+0000 7f5fb7d0e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c1fb0 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.418+0000 7f5fb7d0e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c21c0 con 0x7f5fb00aa4d0 2023-08-17T17:49:10.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.418+0000 7f5fb7d0e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c24a0 con 0x7f5fb00c5810 2023-08-17T17:49:10.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.418+0000 7f5fb5aaa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00aa0f0 0x7f5fb00ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:10.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.418+0000 7f5fb5aaa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00aa0f0 0x7f5fb00ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42352/0 (socket says 172.21.15.78:42352) 2023-08-17T17:49:10.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.418+0000 7f5fb5aaa700 1 -- 172.21.15.78:0/595151309 learned_addr learned my addr 172.21.15.78:0/595151309 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:10.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.418+0000 7f5fb52a9700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb00aa4d0 0x7f5fb00c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:10.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fb62ab700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb00c5810 0x7f5fb0146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:10.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fb5aaa700 1 -- 172.21.15.78:0/595151309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb00c5810 msgr2=0x7f5fb0146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:10.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fb5aaa700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb00c5810 0x7f5fb0146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:10.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fb5aaa700 1 -- 172.21.15.78:0/595151309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb00aa4d0 msgr2=0x7f5fb00c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:10.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fb5aaa700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb00aa4d0 0x7f5fb00c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:10.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fb5aaa700 1 -- 172.21.15.78:0/595151309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa8009ae0 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fb52a9700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb00aa4d0 0x7f5fb00c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:10.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fb5aaa700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00aa0f0 0x7f5fb00ad630 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f5fac00d890 tx=0x7f5fac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:10.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fa5ffb700 1 -- 172.21.15.78:0/595151309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac0125f0 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fa5ffb700 1 -- 172.21.15.78:0/595151309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac012750 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/595151309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb00c2780 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fa5ffb700 1 -- 172.21.15.78:0/595151309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac012ad0 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.419+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/595151309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb00c2d40 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.420+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/595151309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb0083980 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.420+0000 7f5fa5ffb700 1 -- 172.21.15.78:0/595151309 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f5fac013480 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.421+0000 7f5fa5ffb700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f9405ecc0 0x7f5f94061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:10.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.421+0000 7f5fa5ffb700 1 -- 172.21.15.78:0/595151309 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6695+0+0 (secure 0 0 0) 0x7f5fac079bd0 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.421+0000 7f5fb52a9700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f9405ecc0 0x7f5f94061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:10.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.421+0000 7f5fb52a9700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f9405ecc0 0x7f5f94061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f5fb0167a30 tx=0x7f5fa0009040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:10.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.425+0000 7f5fa5ffb700 1 -- 172.21.15.78:0/595151309 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fac04af70 con 0x7f5fb00aa0f0 2023-08-17T17:49:10.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:10.588+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/595151309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5fb00cbd40 con 0x7f5fb00aa0f0 2023-08-17T17:49:11.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.229+0000 7f5fa5ffb700 1 -- 172.21.15.78:0/595151309 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5fac04e590 con 0x7f5fb00aa0f0 2023-08-17T17:49:11.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.235+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/595151309 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f9405ecc0 msgr2=0x7f5f94061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:11.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.235+0000 7f5fb7d0e700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f9405ecc0 0x7f5f94061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f5fb0167a30 tx=0x7f5fa0009040).stop 2023-08-17T17:49:11.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.235+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/595151309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00aa0f0 msgr2=0x7f5fb00ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:11.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.235+0000 7f5fb7d0e700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00aa0f0 0x7f5fb00ad630 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f5fac00d890 tx=0x7f5fac008040).stop 2023-08-17T17:49:11.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.236+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/595151309 shutdown_connections 2023-08-17T17:49:11.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.236+0000 7f5fb7d0e700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5f9405ecc0 0x7f5f94061180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:11.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.236+0000 7f5fb7d0e700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fb00c5810 0x7f5fb0146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:11.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.236+0000 7f5fb7d0e700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00aa0f0 0x7f5fb00ad630 secure :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0x7f5fac00d890 tx=0x7f5fac008040).stop 2023-08-17T17:49:11.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.236+0000 7f5fb7d0e700 1 --2- 172.21.15.78:0/595151309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fb00aa4d0 0x7f5fb00c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:11.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.236+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/595151309 >> 172.21.15.78:0/595151309 conn(0x7f5fb006a6a0 msgr2=0x7f5fb00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:11.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.240+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/595151309 shutdown_connections 2023-08-17T17:49:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.243+0000 7f5fb7d0e700 1 -- 172.21.15.78:0/595151309 wait complete. 2023-08-17T17:49:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T17:49:11.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T17:49:11.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.377+0000 7f3c4f507700 1 Processor -- start 2023-08-17T17:49:11.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.377+0000 7f3c4f507700 1 -- start start 2023-08-17T17:49:11.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.378+0000 7f3c4f507700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3c480aa0f0 0x7f3c480644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:11.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.378+0000 7f3c4f507700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3c480c5810 0x7f3c480c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:11.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.378+0000 7f3c4f507700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c480649b0 con 0x7f3c480aa4d0 2023-08-17T17:49:11.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.378+0000 7f3c4f507700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c480c6170 con 0x7f3c480aa0f0 2023-08-17T17:49:11.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.378+0000 7f3c4f507700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c48063420 con 0x7f3c480c5810 2023-08-17T17:49:11.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.378+0000 7f3c4d2a3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3c480aa0f0 0x7f3c480644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:11.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.378+0000 7f3c4d2a3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3c480aa0f0 0x7f3c480644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42354/0 (socket says 172.21.15.78:42354) 2023-08-17T17:49:11.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.378+0000 7f3c4d2a3700 1 -- 172.21.15.78:0/3303055642 learned_addr learned my addr 172.21.15.78:0/3303055642 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:11.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4daa4700 1 --2- 172.21.15.78:0/3303055642 >> v2:172.21.15.150:3300/0 conn(0x7f3c480c5810 0x7f3c480c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:11.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4d2a3700 1 -- 172.21.15.78:0/3303055642 >> v2:172.21.15.150:3300/0 conn(0x7f3c480c5810 msgr2=0x7f3c480c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:11.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4d2a3700 1 --2- 172.21.15.78:0/3303055642 >> v2:172.21.15.150:3300/0 conn(0x7f3c480c5810 0x7f3c480c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:11.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4d2a3700 1 -- 172.21.15.78:0/3303055642 >> v1:172.21.15.78:6789/0 conn(0x7f3c480aa4d0 legacy=0x7f3c480c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:11.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4d2a3700 1 -- 172.21.15.78:0/3303055642 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48063700 con 0x7f3c480aa0f0 2023-08-17T17:49:11.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4daa4700 1 --2- 172.21.15.78:0/3303055642 >> v2:172.21.15.150:3300/0 conn(0x7f3c480c5810 0x7f3c480c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:11.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4d2a3700 1 --2- 172.21.15.78:0/3303055642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa0f0 0x7f3c480644c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f3c48159090 tx=0x7f3c44009840).ready entity=mon.0 client_cookie=ff2cc421ab51efb6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:11.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c3ffff700 1 -- 172.21.15.78:0/3303055642 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400e070 con 0x7f3c480aa0f0 2023-08-17T17:49:11.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c3ffff700 1 -- 172.21.15.78:0/3303055642 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4400ba50 con 0x7f3c480aa0f0 2023-08-17T17:49:11.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c3ffff700 1 -- 172.21.15.78:0/3303055642 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400bdd0 con 0x7f3c480aa0f0 2023-08-17T17:49:11.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4f507700 1 -- 172.21.15.78:0/3303055642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa0f0 msgr2=0x7f3c480644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:11.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4f507700 1 --2- 172.21.15.78:0/3303055642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa0f0 0x7f3c480644c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f3c48159090 tx=0x7f3c44009840).stop 2023-08-17T17:49:11.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4f507700 1 -- 172.21.15.78:0/3303055642 shutdown_connections 2023-08-17T17:49:11.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4f507700 1 --2- 172.21.15.78:0/3303055642 >> v2:172.21.15.150:3300/0 conn(0x7f3c480c5810 0x7f3c480c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:11.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4f507700 1 --2- 172.21.15.78:0/3303055642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa0f0 0x7f3c480644c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:11.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.379+0000 7f3c4f507700 1 -- 172.21.15.78:0/3303055642 >> 172.21.15.78:0/3303055642 conn(0x7f3c4806a6a0 msgr2=0x7f3c480caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:11.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.380+0000 7f3c4f507700 1 -- 172.21.15.78:0/3303055642 shutdown_connections 2023-08-17T17:49:11.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.380+0000 7f3c4f507700 1 -- 172.21.15.78:0/3303055642 wait complete. 2023-08-17T17:49:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.381+0000 7f3c4f507700 1 Processor -- start 2023-08-17T17:49:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.381+0000 7f3c4f507700 1 -- start start 2023-08-17T17:49:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.381+0000 7f3c4f507700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c480aa0f0 0x7f3c4814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.381+0000 7f3c4f507700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa4d0 0x7f3c4814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.381+0000 7f3c4f507700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c480c5810 0x7f3c48152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.381+0000 7f3c4f507700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480b09c0 con 0x7f3c480aa4d0 2023-08-17T17:49:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4f507700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480b0ca0 con 0x7f3c480aa0f0 2023-08-17T17:49:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4f507700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480ab460 con 0x7f3c480c5810 2023-08-17T17:49:11.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4caa2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa4d0 0x7f3c4814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:11.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4caa2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa4d0 0x7f3c4814b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42362/0 (socket says 172.21.15.78:42362) 2023-08-17T17:49:11.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4caa2700 1 -- 172.21.15.78:0/2341447991 learned_addr learned my addr 172.21.15.78:0/2341447991 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:11.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4d2a3700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c480aa0f0 0x7f3c4814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:11.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4caa2700 1 -- 172.21.15.78:0/2341447991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c480c5810 msgr2=0x7f3c48152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:11.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4caa2700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c480c5810 0x7f3c48152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:11.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4caa2700 1 -- 172.21.15.78:0/2341447991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c480aa0f0 msgr2=0x7f3c4814bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4caa2700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c480aa0f0 0x7f3c4814bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4caa2700 1 -- 172.21.15.78:0/2341447991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44009ae0 con 0x7f3c480aa4d0 2023-08-17T17:49:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4d2a3700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c480aa0f0 0x7f3c4814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4caa2700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa4d0 0x7f3c4814b4e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f3c3800c4c0 tx=0x7f3c38007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c3d7fa700 1 -- 172.21.15.78:0/2341447991 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38007020 con 0x7f3c480aa4d0 2023-08-17T17:49:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c3d7fa700 1 -- 172.21.15.78:0/2341447991 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c38007180 con 0x7f3c480aa4d0 2023-08-17T17:49:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4f507700 1 -- 172.21.15.78:0/2341447991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c480ab740 con 0x7f3c480aa4d0 2023-08-17T17:49:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c3d7fa700 1 -- 172.21.15.78:0/2341447991 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38007520 con 0x7f3c480aa4d0 2023-08-17T17:49:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.382+0000 7f3c4f507700 1 -- 172.21.15.78:0/2341447991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c480b0690 con 0x7f3c480aa4d0 2023-08-17T17:49:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.383+0000 7f3c4f507700 1 -- 172.21.15.78:0/2341447991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c48064380 con 0x7f3c480aa4d0 2023-08-17T17:49:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.383+0000 7f3c3d7fa700 1 -- 172.21.15.78:0/2341447991 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f3c38010070 con 0x7f3c480aa4d0 2023-08-17T17:49:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.384+0000 7f3c3d7fa700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c2c05ecc0 0x7f3c2c061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.384+0000 7f3c3d7fa700 1 -- 172.21.15.78:0/2341447991 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6199+0+0 (secure 0 0 0) 0x7f3c38078d00 con 0x7f3c480aa4d0 2023-08-17T17:49:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.384+0000 7f3c4d2a3700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c2c05ecc0 0x7f3c2c061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.384+0000 7f3c4d2a3700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c2c05ecc0 0x7f3c2c061180 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3c480c5150 tx=0x7f3c44009840).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.388+0000 7f3c3d7fa700 1 -- 172.21.15.78:0/2341447991 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c380478f0 con 0x7f3c480aa4d0 2023-08-17T17:49:11.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.552+0000 7f3c4f507700 1 -- 172.21.15.78:0/2341447991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c48046af0 con 0x7f3c480aa4d0 2023-08-17T17:49:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:11.703+0000 7f3c3d7fa700 1 -- 172.21.15.78:0/2341447991 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3c38076c50 con 0x7f3c480aa4d0 2023-08-17T17:49:12.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.236+0000 7f3c3d7fa700 1 -- 172.21.15.78:0/2341447991 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3c38073bb0 con 0x7f3c480aa4d0 2023-08-17T17:49:12.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.239+0000 7f3c4f507700 1 -- 172.21.15.78:0/2341447991 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c2c05ecc0 msgr2=0x7f3c2c061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.239+0000 7f3c4f507700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c2c05ecc0 0x7f3c2c061180 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3c480c5150 tx=0x7f3c44009840).stop 2023-08-17T17:49:12.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.239+0000 7f3c4f507700 1 -- 172.21.15.78:0/2341447991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa4d0 msgr2=0x7f3c4814b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.239+0000 7f3c4f507700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa4d0 0x7f3c4814b4e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f3c3800c4c0 tx=0x7f3c38007dd0).stop 2023-08-17T17:49:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.240+0000 7f3c4f507700 1 -- 172.21.15.78:0/2341447991 shutdown_connections 2023-08-17T17:49:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.240+0000 7f3c4f507700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3c2c05ecc0 0x7f3c2c061180 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.240+0000 7f3c4f507700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c480c5810 0x7f3c48152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.240+0000 7f3c4f507700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c480aa0f0 0x7f3c4814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.240+0000 7f3c4f507700 1 --2- 172.21.15.78:0/2341447991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c480aa4d0 0x7f3c4814b4e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.240+0000 7f3c4f507700 1 -- 172.21.15.78:0/2341447991 >> 172.21.15.78:0/2341447991 conn(0x7f3c4806a6a0 msgr2=0x7f3c48153ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.240+0000 7f3c4f507700 1 -- 172.21.15.78:0/2341447991 shutdown_connections 2023-08-17T17:49:12.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.240+0000 7f3c4f507700 1 -- 172.21.15.78:0/2341447991 wait complete. 2023-08-17T17:49:12.243 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T17:49:12.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T17:49:12.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.372+0000 7f65b3b88700 1 Processor -- start 2023-08-17T17:49:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.372+0000 7f65b3b88700 1 -- start start 2023-08-17T17:49:12.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.373+0000 7f65b3b88700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65ac0aa0f0 0x7f65ac0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.373+0000 7f65b3b88700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0aa4d0 0x7f65ac0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.373+0000 7f65b3b88700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f65ac0c5810 0x7f65ac0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.373+0000 7f65b3b88700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac0649b0 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.373+0000 7f65b3b88700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac0c6120 con 0x7f65ac0c5810 2023-08-17T17:49:12.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.373+0000 7f65b3b88700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac063420 con 0x7f65ac0aa4d0 2023-08-17T17:49:12.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.373+0000 7f65b1924700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65ac0aa0f0 0x7f65ac0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.373+0000 7f65b1924700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65ac0aa0f0 0x7f65ac0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42372/0 (socket says 172.21.15.78:42372) 2023-08-17T17:49:12.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.373+0000 7f65b1924700 1 -- 172.21.15.78:0/1283375819 learned_addr learned my addr 172.21.15.78:0/1283375819 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:12.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b1924700 1 -- 172.21.15.78:0/1283375819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0aa4d0 msgr2=0x7f65ac0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:12.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b1924700 1 --2- 172.21.15.78:0/1283375819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0aa4d0 0x7f65ac0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b1924700 1 -- 172.21.15.78:0/1283375819 >> v2:172.21.15.150:3300/0 conn(0x7f65ac0c5810 msgr2=0x7f65ac0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:12.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b1924700 1 --2- 172.21.15.78:0/1283375819 >> v2:172.21.15.150:3300/0 conn(0x7f65ac0c5810 0x7f65ac0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b1924700 1 -- 172.21.15.78:0/1283375819 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac063700 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b1924700 1 --2- 172.21.15.78:0/1283375819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 0x7f65ac0644c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f65ac159060 tx=0x7f65a8009840).ready entity=mon.0 client_cookie=bd162e728230d3be server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:12.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b0922700 1 -- 172.21.15.78:0/1283375819 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800e070 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b0922700 1 -- 172.21.15.78:0/1283375819 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a800ba50 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b0922700 1 -- 172.21.15.78:0/1283375819 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800bdd0 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b3b88700 1 -- 172.21.15.78:0/1283375819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 msgr2=0x7f65ac0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.374+0000 7f65b3b88700 1 --2- 172.21.15.78:0/1283375819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 0x7f65ac0644c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f65ac159060 tx=0x7f65a8009840).stop 2023-08-17T17:49:12.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.375+0000 7f65b3b88700 1 -- 172.21.15.78:0/1283375819 shutdown_connections 2023-08-17T17:49:12.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.375+0000 7f65b3b88700 1 --2- 172.21.15.78:0/1283375819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 0x7f65ac0644c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.375+0000 7f65b3b88700 1 --2- 172.21.15.78:0/1283375819 >> v2:172.21.15.150:3300/0 conn(0x7f65ac0c5810 0x7f65ac0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.375+0000 7f65b3b88700 1 --2- 172.21.15.78:0/1283375819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0aa4d0 0x7f65ac0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.375+0000 7f65b3b88700 1 -- 172.21.15.78:0/1283375819 >> 172.21.15.78:0/1283375819 conn(0x7f65ac06a6a0 msgr2=0x7f65ac0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:12.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.375+0000 7f65b3b88700 1 -- 172.21.15.78:0/1283375819 shutdown_connections 2023-08-17T17:49:12.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.375+0000 7f65b3b88700 1 -- 172.21.15.78:0/1283375819 wait complete. 2023-08-17T17:49:12.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.376+0000 7f65b3b88700 1 Processor -- start 2023-08-17T17:49:12.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.376+0000 7f65b3b88700 1 -- start start 2023-08-17T17:49:12.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.376+0000 7f65b3b88700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 0x7f65ac14f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.376+0000 7f65b3b88700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65ac0aa4d0 0x7f65ac14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b3b88700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0c5810 0x7f65ac0ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b3b88700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac14ec20 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b3b88700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac14e010 con 0x7f65ac0aa4d0 2023-08-17T17:49:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b3b88700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac14e2f0 con 0x7f65ac0c5810 2023-08-17T17:49:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b1924700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 0x7f65ac14f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b1924700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 0x7f65ac14f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42376/0 (socket says 172.21.15.78:42376) 2023-08-17T17:49:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b1924700 1 -- 172.21.15.78:0/4178989611 learned_addr learned my addr 172.21.15.78:0/4178989611 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b1924700 1 -- 172.21.15.78:0/4178989611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0c5810 msgr2=0x7f65ac0ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b1924700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0c5810 0x7f65ac0ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b1924700 1 -- 172.21.15.78:0/4178989611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65ac0aa4d0 msgr2=0x7f65ac14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b1924700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65ac0aa4d0 0x7f65ac14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b1924700 1 -- 172.21.15.78:0/4178989611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a8009ae0 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b1924700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 0x7f65ac14f0b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f65a8009fd0 tx=0x7f65a8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65a1ffb700 1 -- 172.21.15.78:0/4178989611 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800bbc0 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65a1ffb700 1 -- 172.21.15.78:0/4178989611 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a800bd20 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b3b88700 1 -- 172.21.15.78:0/4178989611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac14e5d0 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65a1ffb700 1 -- 172.21.15.78:0/4178989611 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a801d660 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.377+0000 7f65b3b88700 1 -- 172.21.15.78:0/4178989611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac14f5a0 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.378+0000 7f65b3b88700 1 -- 172.21.15.78:0/4178989611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac14ef00 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.379+0000 7f65a1ffb700 1 -- 172.21.15.78:0/4178989611 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f65a801b040 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.379+0000 7f65a1ffb700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f659005ed60 0x7f6590061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.379+0000 7f65a1ffb700 1 -- 172.21.15.78:0/4178989611 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f65a807b470 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.379+0000 7f65b1123700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f659005ed60 0x7f6590061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.379+0000 7f65b1123700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f659005ed60 0x7f6590061220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f65ac0b0600 tx=0x7f659c006c30).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.384+0000 7f65a1ffb700 1 -- 172.21.15.78:0/4178989611 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f65a804cbb0 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.552+0000 7f65b3b88700 1 -- 172.21.15.78:0/4178989611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f65ac158e40 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.556+0000 7f65a1ffb700 1 -- 172.21.15.78:0/4178989611 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f65a80501d0 con 0x7f65ac0aa0f0 2023-08-17T17:49:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.557+0000 7f65b3b88700 1 -- 172.21.15.78:0/4178989611 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f659005ed60 msgr2=0x7f6590061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.557+0000 7f65b3b88700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f659005ed60 0x7f6590061220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f65ac0b0600 tx=0x7f659c006c30).stop 2023-08-17T17:49:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.557+0000 7f65b3b88700 1 -- 172.21.15.78:0/4178989611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 msgr2=0x7f65ac14f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.557+0000 7f65b3b88700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 0x7f65ac14f0b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f65a8009fd0 tx=0x7f65a8009840).stop 2023-08-17T17:49:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.557+0000 7f65b3b88700 1 -- 172.21.15.78:0/4178989611 shutdown_connections 2023-08-17T17:49:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.557+0000 7f65b3b88700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f659005ed60 0x7f6590061220 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.557+0000 7f65b3b88700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0c5810 0x7f65ac0ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.558+0000 7f65b3b88700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65ac0aa0f0 0x7f65ac14f0b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.558+0000 7f65b3b88700 1 --2- 172.21.15.78:0/4178989611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65ac0aa4d0 0x7f65ac14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.558+0000 7f65b3b88700 1 -- 172.21.15.78:0/4178989611 >> 172.21.15.78:0/4178989611 conn(0x7f65ac06a6a0 msgr2=0x7f65ac153900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.558+0000 7f65b3b88700 1 -- 172.21.15.78:0/4178989611 shutdown_connections 2023-08-17T17:49:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.558+0000 7f65b3b88700 1 -- 172.21.15.78:0/4178989611 wait complete. 2023-08-17T17:49:12.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-17T17:49:12.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e37d29700 1 Processor -- start 2023-08-17T17:49:12.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e37d29700 1 -- start start 2023-08-17T17:49:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e37d29700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3e300c5f20 0x7f3e300644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e37d29700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e300649b0 con 0x7f3e300aa0f0 2023-08-17T17:49:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e37d29700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e30063420 con 0x7f3e300aa4d0 2023-08-17T17:49:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e37d29700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e30063700 con 0x7f3e300c5f20 2023-08-17T17:49:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e362c6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3e300c5f20 0x7f3e300644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e362c6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3e300c5f20 0x7f3e300644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42384/0 (socket says 172.21.15.78:42384) 2023-08-17T17:49:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e362c6700 1 -- 172.21.15.78:0/4143891595 learned_addr learned my addr 172.21.15.78:0/4143891595 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e35ac5700 1 --1- 172.21.15.78:0/4143891595 >> v1:172.21.15.78:6789/0 conn(0x7f3e300aa0f0 0x7f3e300c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58770/0 (socket says 172.21.15.78:58770) 2023-08-17T17:49:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e362c6700 1 -- 172.21.15.78:0/4143891595 >> v1:172.21.15.150:6789/0 conn(0x7f3e300aa4d0 legacy=0x7f3e300c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e362c6700 1 -- 172.21.15.78:0/4143891595 >> v1:172.21.15.78:6789/0 conn(0x7f3e300aa0f0 legacy=0x7f3e300c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e362c6700 1 -- 172.21.15.78:0/4143891595 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300639e0 con 0x7f3e300c5f20 2023-08-17T17:49:12.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e362c6700 1 --2- 172.21.15.78:0/4143891595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300c5f20 0x7f3e300644c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f3e28009f20 tx=0x7f3e28009840).ready entity=mon.0 client_cookie=b3d0b2e245e0629c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:12.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e34ac3700 1 -- 172.21.15.78:0/4143891595 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800e070 con 0x7f3e300c5f20 2023-08-17T17:49:12.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e34ac3700 1 -- 172.21.15.78:0/4143891595 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2800ba40 con 0x7f3e300c5f20 2023-08-17T17:49:12.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.685+0000 7f3e34ac3700 1 -- 172.21.15.78:0/4143891595 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800bdc0 con 0x7f3e300c5f20 2023-08-17T17:49:12.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.686+0000 7f3e37d29700 1 -- 172.21.15.78:0/4143891595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300c5f20 msgr2=0x7f3e300644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.686+0000 7f3e37d29700 1 --2- 172.21.15.78:0/4143891595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300c5f20 0x7f3e300644c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f3e28009f20 tx=0x7f3e28009840).stop 2023-08-17T17:49:12.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.686+0000 7f3e37d29700 1 -- 172.21.15.78:0/4143891595 shutdown_connections 2023-08-17T17:49:12.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.686+0000 7f3e37d29700 1 --2- 172.21.15.78:0/4143891595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300c5f20 0x7f3e300644c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.686+0000 7f3e37d29700 1 -- 172.21.15.78:0/4143891595 >> 172.21.15.78:0/4143891595 conn(0x7f3e3006a6a0 msgr2=0x7f3e300caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:12.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.686+0000 7f3e37d29700 1 -- 172.21.15.78:0/4143891595 shutdown_connections 2023-08-17T17:49:12.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.686+0000 7f3e37d29700 1 -- 172.21.15.78:0/4143891595 wait complete. 2023-08-17T17:49:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.687+0000 7f3e37d29700 1 Processor -- start 2023-08-17T17:49:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.687+0000 7f3e37d29700 1 -- start start 2023-08-17T17:49:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e37d29700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e300aa0f0 0x7f3e300aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e37d29700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300aa4d0 0x7f3e30152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e37d29700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e300c5f20 0x7f3e30164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e37d29700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30165c00 con 0x7f3e300aa4d0 2023-08-17T17:49:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e37d29700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300aaea0 con 0x7f3e300c5f20 2023-08-17T17:49:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e37d29700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e301573d0 con 0x7f3e300aa0f0 2023-08-17T17:49:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e352c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300aa4d0 0x7f3e30152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e352c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300aa4d0 0x7f3e30152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42388/0 (socket says 172.21.15.78:42388) 2023-08-17T17:49:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e352c4700 1 -- 172.21.15.78:0/455586567 learned_addr learned my addr 172.21.15.78:0/455586567 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e352c4700 1 -- 172.21.15.78:0/455586567 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e300aa0f0 msgr2=0x7f3e300aa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e352c4700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e300aa0f0 0x7f3e300aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e352c4700 1 -- 172.21.15.78:0/455586567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e300c5f20 msgr2=0x7f3e30164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e362c6700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e300c5f20 0x7f3e30164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e352c4700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e300c5f20 0x7f3e30164bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e352c4700 1 -- 172.21.15.78:0/455586567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e28009ae0 con 0x7f3e300aa4d0 2023-08-17T17:49:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e362c6700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e300c5f20 0x7f3e30164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.688+0000 7f3e352c4700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300aa4d0 0x7f3e30152f20 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f3e2000c490 tx=0x7f3e20007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.689+0000 7f3e25ffb700 1 -- 172.21.15.78:0/455586567 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000f470 con 0x7f3e300aa4d0 2023-08-17T17:49:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.689+0000 7f3e25ffb700 1 -- 172.21.15.78:0/455586567 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2000f5d0 con 0x7f3e300aa4d0 2023-08-17T17:49:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.689+0000 7f3e37d29700 1 -- 172.21.15.78:0/455586567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e30165640 con 0x7f3e300aa4d0 2023-08-17T17:49:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.689+0000 7f3e25ffb700 1 -- 172.21.15.78:0/455586567 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000f990 con 0x7f3e300aa4d0 2023-08-17T17:49:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.689+0000 7f3e37d29700 1 -- 172.21.15.78:0/455586567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e30157060 con 0x7f3e300aa4d0 2023-08-17T17:49:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.690+0000 7f3e37d29700 1 -- 172.21.15.78:0/455586567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e30156ec0 con 0x7f3e300aa4d0 2023-08-17T17:49:12.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.690+0000 7f3e25ffb700 1 -- 172.21.15.78:0/455586567 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3e20019030 con 0x7f3e300aa4d0 2023-08-17T17:49:12.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.690+0000 7f3e25ffb700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e1405ed90 0x7f3e14061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.690+0000 7f3e25ffb700 1 -- 172.21.15.78:0/455586567 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f3e20078d70 con 0x7f3e300aa4d0 2023-08-17T17:49:12.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.690+0000 7f3e35ac5700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e1405ed90 0x7f3e14061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.691+0000 7f3e35ac5700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e1405ed90 0x7f3e14061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3e300c54c0 tx=0x7f3e2c0079b0).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:12.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.695+0000 7f3e25ffb700 1 -- 172.21.15.78:0/455586567 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e200488f0 con 0x7f3e300aa4d0 2023-08-17T17:49:12.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.859+0000 7f3e37d29700 1 -- 172.21.15.78:0/455586567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f3e30157510 con 0x7f3e300aa4d0 2023-08-17T17:49:12.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.862+0000 7f3e25ffb700 1 -- 172.21.15.78:0/455586567 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v9) v1 ==== 120+0+0 (secure 0 0 0) 0x7f3e20017070 con 0x7f3e300aa4d0 2023-08-17T17:49:12.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 -- 172.21.15.78:0/455586567 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e1405ed90 msgr2=0x7f3e14061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e1405ed90 0x7f3e14061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3e300c54c0 tx=0x7f3e2c0079b0).stop 2023-08-17T17:49:12.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 -- 172.21.15.78:0/455586567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300aa4d0 msgr2=0x7f3e30152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300aa4d0 0x7f3e30152f20 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f3e2000c490 tx=0x7f3e20007db0).stop 2023-08-17T17:49:12.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 -- 172.21.15.78:0/455586567 shutdown_connections 2023-08-17T17:49:12.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3e1405ed90 0x7f3e14061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e300c5f20 0x7f3e30164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e300aa0f0 0x7f3e300aa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 --2- 172.21.15.78:0/455586567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e300aa4d0 0x7f3e30152f20 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 -- 172.21.15.78:0/455586567 >> 172.21.15.78:0/455586567 conn(0x7f3e3006a6a0 msgr2=0x7f3e301538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:12.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 -- 172.21.15.78:0/455586567 shutdown_connections 2023-08-17T17:49:12.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.865+0000 7f3e37d29700 1 -- 172.21.15.78:0/455586567 wait complete. 2023-08-17T17:49:12.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-08-17T17:49:12.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27dbff9700 1 Processor -- start 2023-08-17T17:49:12.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27dbff9700 1 -- start start 2023-08-17T17:49:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27dbff9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27d4154140 0x7f27d40c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27dbff9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27d40c1010 0x7f27d40ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27dbff9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d4154520 con 0x7f27d40a7c40 2023-08-17T17:49:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27dbff9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d40c91e0 con 0x7f27d4154140 2023-08-17T17:49:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27dbff9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d40c94c0 con 0x7f27d40c1010 2023-08-17T17:49:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27d9d95700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27d4154140 0x7f27d40c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27d9d95700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27d4154140 0x7f27d40c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42392/0 (socket says 172.21.15.78:42392) 2023-08-17T17:49:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27d9d95700 1 -- 172.21.15.78:0/2532780190 learned_addr learned my addr 172.21.15.78:0/2532780190 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27d9d95700 1 -- 172.21.15.78:0/2532780190 >> v2:172.21.15.150:3300/0 conn(0x7f27d40c1010 msgr2=0x7f27d40ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27d9d95700 1 --2- 172.21.15.78:0/2532780190 >> v2:172.21.15.150:3300/0 conn(0x7f27d40c1010 0x7f27d40ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27d9d95700 1 -- 172.21.15.78:0/2532780190 >> v1:172.21.15.150:6789/0 conn(0x7f27d40a7c40 legacy=0x7f27d40c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.990+0000 7f27d9d95700 1 -- 172.21.15.78:0/2532780190 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40c97a0 con 0x7f27d4154140 2023-08-17T17:49:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27d9d95700 1 --2- 172.21.15.78:0/2532780190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d4154140 0x7f27d40c6ee0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f27d40c00d0 tx=0x7f27d0009840).ready entity=mon.0 client_cookie=821b97dfbab3961b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:12.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27d8d93700 1 -- 172.21.15.78:0/2532780190 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d000e070 con 0x7f27d4154140 2023-08-17T17:49:12.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27d8d93700 1 -- 172.21.15.78:0/2532780190 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d000ba10 con 0x7f27d4154140 2023-08-17T17:49:12.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27d8d93700 1 -- 172.21.15.78:0/2532780190 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d000bd90 con 0x7f27d4154140 2023-08-17T17:49:12.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27dbff9700 1 -- 172.21.15.78:0/2532780190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d4154140 msgr2=0x7f27d40c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27dbff9700 1 --2- 172.21.15.78:0/2532780190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d4154140 0x7f27d40c6ee0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f27d40c00d0 tx=0x7f27d0009840).stop 2023-08-17T17:49:12.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27dbff9700 1 -- 172.21.15.78:0/2532780190 shutdown_connections 2023-08-17T17:49:12.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27dbff9700 1 --2- 172.21.15.78:0/2532780190 >> v2:172.21.15.150:3300/0 conn(0x7f27d40c1010 0x7f27d40ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:12.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27dbff9700 1 --2- 172.21.15.78:0/2532780190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d4154140 0x7f27d40c6ee0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27dbff9700 1 -- 172.21.15.78:0/2532780190 >> 172.21.15.78:0/2532780190 conn(0x7f27d4094510 msgr2=0x7f27d406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:12.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27dbff9700 1 -- 172.21.15.78:0/2532780190 shutdown_connections 2023-08-17T17:49:12.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.992+0000 7f27dbff9700 1 -- 172.21.15.78:0/2532780190 wait complete. 2023-08-17T17:49:12.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.993+0000 7f27dbff9700 1 Processor -- start 2023-08-17T17:49:12.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.993+0000 7f27dbff9700 1 -- start start 2023-08-17T17:49:12.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27dbff9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d40a7c40 0x7f27d41650f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27dbff9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d40c1010 0x7f27d4097250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27dbff9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27d4154140 0x7f27d4097740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:12.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27dbff9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4097c30 con 0x7f27d40c1010 2023-08-17T17:49:12.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27dbff9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40c37e0 con 0x7f27d40a7c40 2023-08-17T17:49:12.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27dbff9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d41655e0 con 0x7f27d4154140 2023-08-17T17:49:12.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27d9594700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d40c1010 0x7f27d4097250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27d9594700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d40c1010 0x7f27d4097250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42404/0 (socket says 172.21.15.78:42404) 2023-08-17T17:49:12.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27d9594700 1 -- 172.21.15.78:0/2105641097 learned_addr learned my addr 172.21.15.78:0/2105641097 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:12.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27d9d95700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d40a7c40 0x7f27d41650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27da596700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27d4154140 0x7f27d4097740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:12.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27d9594700 1 -- 172.21.15.78:0/2105641097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27d4154140 msgr2=0x7f27d4097740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27d9594700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27d4154140 0x7f27d4097740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27d9594700 1 -- 172.21.15.78:0/2105641097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d40a7c40 msgr2=0x7f27d41650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:12.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27d9594700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d40a7c40 0x7f27d41650f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:12.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27d9594700 1 -- 172.21.15.78:0/2105641097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d0009ae0 con 0x7f27d40c1010 2023-08-17T17:49:13.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.994+0000 7f27d9d95700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d40a7c40 0x7f27d41650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:13.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.995+0000 7f27d9594700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d40c1010 0x7f27d4097250 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f27c400b490 tx=0x7f27c4006f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:13.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.995+0000 7f27c9ffb700 1 -- 172.21.15.78:0/2105641097 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4002320 con 0x7f27d40c1010 2023-08-17T17:49:13.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.995+0000 7f27c9ffb700 1 -- 172.21.15.78:0/2105641097 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c40024c0 con 0x7f27d40c1010 2023-08-17T17:49:13.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.995+0000 7f27dbff9700 1 -- 172.21.15.78:0/2105641097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d40c2bd0 con 0x7f27d40c1010 2023-08-17T17:49:13.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.995+0000 7f27c9ffb700 1 -- 172.21.15.78:0/2105641097 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4002880 con 0x7f27d40c1010 2023-08-17T17:49:13.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.995+0000 7f27dbff9700 1 -- 172.21.15.78:0/2105641097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d40c3190 con 0x7f27d40c1010 2023-08-17T17:49:13.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.996+0000 7f27dbff9700 1 -- 172.21.15.78:0/2105641097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d4047350 con 0x7f27d40c1010 2023-08-17T17:49:13.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.996+0000 7f27c9ffb700 1 -- 172.21.15.78:0/2105641097 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f27c400f030 con 0x7f27d40c1010 2023-08-17T17:49:13.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.996+0000 7f27c9ffb700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f27b805ed90 0x7f27b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:13.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.996+0000 7f27c9ffb700 1 -- 172.21.15.78:0/2105641097 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f27c40796a0 con 0x7f27d40c1010 2023-08-17T17:49:13.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.997+0000 7f27d9d95700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f27b805ed90 0x7f27b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:13.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:12.997+0000 7f27d9d95700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f27b805ed90 0x7f27b8061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f27d40c3eb0 tx=0x7f27d0009840).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:13.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.000+0000 7f27c9ffb700 1 -- 172.21.15.78:0/2105641097 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27c404ade0 con 0x7f27d40c1010 2023-08-17T17:49:13.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.227+0000 7f27dbff9700 1 -- 172.21.15.78:0/2105641097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f27d40b0e60 con 0x7f27d40c1010 2023-08-17T17:49:13.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.282+0000 7f27c9ffb700 1 -- 172.21.15.78:0/2105641097 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v524) v1 ==== 154+0+0 (secure 0 0 0) 0x7f27c404e400 con 0x7f27d40c1010 2023-08-17T17:49:13.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 -- 172.21.15.78:0/2105641097 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f27b805ed90 msgr2=0x7f27b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:13.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f27b805ed90 0x7f27b8061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f27d40c3eb0 tx=0x7f27d0009840).stop 2023-08-17T17:49:13.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 -- 172.21.15.78:0/2105641097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d40c1010 msgr2=0x7f27d4097250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:13.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d40c1010 0x7f27d4097250 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f27c400b490 tx=0x7f27c4006f00).stop 2023-08-17T17:49:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 -- 172.21.15.78:0/2105641097 shutdown_connections 2023-08-17T17:49:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f27b805ed90 0x7f27b8061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27d4154140 0x7f27d4097740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d40a7c40 0x7f27d41650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 --2- 172.21.15.78:0/2105641097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d40c1010 0x7f27d4097250 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 -- 172.21.15.78:0/2105641097 >> 172.21.15.78:0/2105641097 conn(0x7f27d4094510 msgr2=0x7f27d40c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 -- 172.21.15.78:0/2105641097 shutdown_connections 2023-08-17T17:49:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.285+0000 7f27dbff9700 1 -- 172.21.15.78:0/2105641097 wait complete. 2023-08-17T17:49:13.296 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-08-17T17:49:13.297 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-08-17T17:49:13.297 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-17T17:49:13.297 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-08-17T17:49:13.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.409+0000 7fe84dafe700 1 Processor -- start 2023-08-17T17:49:13.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.409+0000 7fe84dafe700 1 -- start start 2023-08-17T17:49:13.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.409+0000 7fe84dafe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe84814e290 0x7fe84814e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe84dafe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe8480643e0 0x7fe848157c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe84dafe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe848064890 0x7fe848158150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe84dafe700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe848158640 con 0x7fe8480643e0 2023-08-17T17:49:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe84dafe700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe848063bb0 con 0x7fe84814e290 2023-08-17T17:49:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe84dafe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe848062fa0 con 0x7fe848064890 2023-08-17T17:49:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe83ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe8480643e0 0x7fe848157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe83ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe8480643e0 0x7fe848157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42418/0 (socket says 172.21.15.78:42418) 2023-08-17T17:49:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe83ffff700 1 -- 172.21.15.78:0/646708182 learned_addr learned my addr 172.21.15.78:0/646708182 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe8477fe700 1 --2- 172.21.15.78:0/646708182 >> v2:172.21.15.150:3300/0 conn(0x7fe84814e290 0x7fe84814e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe847fff700 1 --2- 172.21.15.78:0/646708182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe848064890 0x7fe848158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe83ffff700 1 -- 172.21.15.78:0/646708182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe848064890 msgr2=0x7fe848158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe83ffff700 1 --2- 172.21.15.78:0/646708182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe848064890 0x7fe848158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe83ffff700 1 -- 172.21.15.78:0/646708182 >> v2:172.21.15.150:3300/0 conn(0x7fe84814e290 msgr2=0x7fe84814e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe83ffff700 1 --2- 172.21.15.78:0/646708182 >> v2:172.21.15.150:3300/0 conn(0x7fe84814e290 0x7fe84814e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe83ffff700 1 -- 172.21.15.78:0/646708182 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848063280 con 0x7fe8480643e0 2023-08-17T17:49:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe83ffff700 1 --2- 172.21.15.78:0/646708182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8480643e0 0x7fe848157c60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fe848067b70 tx=0x7fe8300090f0).ready entity=mon.0 client_cookie=8a2d7922b62404c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe846ffd700 1 -- 172.21.15.78:0/646708182 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83000f510 con 0x7fe8480643e0 2023-08-17T17:49:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe846ffd700 1 -- 172.21.15.78:0/646708182 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83000f670 con 0x7fe8480643e0 2023-08-17T17:49:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.410+0000 7fe846ffd700 1 -- 172.21.15.78:0/646708182 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83000f9f0 con 0x7fe8480643e0 2023-08-17T17:49:13.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.411+0000 7fe84dafe700 1 -- 172.21.15.78:0/646708182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8480643e0 msgr2=0x7fe848157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:13.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.411+0000 7fe84dafe700 1 --2- 172.21.15.78:0/646708182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8480643e0 0x7fe848157c60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fe848067b70 tx=0x7fe8300090f0).stop 2023-08-17T17:49:13.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.411+0000 7fe84dafe700 1 -- 172.21.15.78:0/646708182 shutdown_connections 2023-08-17T17:49:13.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.411+0000 7fe84dafe700 1 --2- 172.21.15.78:0/646708182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe848064890 0x7fe848158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.411+0000 7fe84dafe700 1 --2- 172.21.15.78:0/646708182 >> v2:172.21.15.150:3300/0 conn(0x7fe84814e290 0x7fe84814e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.411+0000 7fe84dafe700 1 --2- 172.21.15.78:0/646708182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8480643e0 0x7fe848157c60 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.411+0000 7fe84dafe700 1 -- 172.21.15.78:0/646708182 >> 172.21.15.78:0/646708182 conn(0x7fe8480c3d40 msgr2=0x7fe8480c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:13.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.411+0000 7fe84dafe700 1 -- 172.21.15.78:0/646708182 shutdown_connections 2023-08-17T17:49:13.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.411+0000 7fe84dafe700 1 -- 172.21.15.78:0/646708182 wait complete. 2023-08-17T17:49:13.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.412+0000 7fe84dafe700 1 Processor -- start 2023-08-17T17:49:13.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.412+0000 7fe84dafe700 1 -- start start 2023-08-17T17:49:13.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe84dafe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8480643e0 0x7fe848135f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:13.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe84dafe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe848064890 0x7fe848154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:13.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe84dafe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84814e290 0x7fe84813c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe84dafe700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe848155ba0 con 0x7fe84814e290 2023-08-17T17:49:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe84dafe700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe848154f90 con 0x7fe8480643e0 2023-08-17T17:49:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe84dafe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe848155270 con 0x7fe848064890 2023-08-17T17:49:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe847fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84814e290 0x7fe84813c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe847fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84814e290 0x7fe84813c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42432/0 (socket says 172.21.15.78:42432) 2023-08-17T17:49:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe847fff700 1 -- 172.21.15.78:0/1010287696 learned_addr learned my addr 172.21.15.78:0/1010287696 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe8477fe700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8480643e0 0x7fe848135f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe83ffff700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe848064890 0x7fe848154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe847fff700 1 -- 172.21.15.78:0/1010287696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe848064890 msgr2=0x7fe848154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe847fff700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe848064890 0x7fe848154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe847fff700 1 -- 172.21.15.78:0/1010287696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8480643e0 msgr2=0x7fe848135f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe847fff700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8480643e0 0x7fe848135f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe847fff700 1 -- 172.21.15.78:0/1010287696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830009370 con 0x7fe84814e290 2023-08-17T17:49:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe847fff700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84814e290 0x7fe84813c360 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fe840009df0 tx=0x7fe84000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe83f7fe700 1 -- 172.21.15.78:0/1010287696 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84000caa0 con 0x7fe84814e290 2023-08-17T17:49:13.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe83f7fe700 1 -- 172.21.15.78:0/1010287696 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84000f040 con 0x7fe84814e290 2023-08-17T17:49:13.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe84dafe700 1 -- 172.21.15.78:0/1010287696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe848155550 con 0x7fe84814e290 2023-08-17T17:49:13.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe83f7fe700 1 -- 172.21.15.78:0/1010287696 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84000ce10 con 0x7fe84814e290 2023-08-17T17:49:13.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.413+0000 7fe84dafe700 1 -- 172.21.15.78:0/1010287696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe848136410 con 0x7fe84814e290 2023-08-17T17:49:13.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.414+0000 7fe84dafe700 1 -- 172.21.15.78:0/1010287696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe848047350 con 0x7fe84814e290 2023-08-17T17:49:13.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.415+0000 7fe83f7fe700 1 -- 172.21.15.78:0/1010287696 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe840013610 con 0x7fe84814e290 2023-08-17T17:49:13.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.415+0000 7fe83f7fe700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe82805ed90 0x7fe828061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:13.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.415+0000 7fe83f7fe700 1 -- 172.21.15.78:0/1010287696 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5699+0+0 (secure 0 0 0) 0x7fe84007a1d0 con 0x7fe84814e290 2023-08-17T17:49:13.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.415+0000 7fe8477fe700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe82805ed90 0x7fe828061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:13.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.415+0000 7fe8477fe700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe82805ed90 0x7fe828061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe838009b90 tx=0x7fe838009060).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:13.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.419+0000 7fe83f7fe700 1 -- 172.21.15.78:0/1010287696 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe84004b910 con 0x7fe84814e290 2023-08-17T17:49:13.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:13.644+0000 7fe84dafe700 1 -- 172.21.15.78:0/1010287696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fe84813cc70 con 0x7fe84814e290 2023-08-17T17:49:14.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.284+0000 7fe83f7fe700 1 -- 172.21.15.78:0/1010287696 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v525) v1 ==== 159+0+0 (secure 0 0 0) 0x7fe84004ef30 con 0x7fe84814e290 2023-08-17T17:49:14.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 -- 172.21.15.78:0/1010287696 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe82805ed90 msgr2=0x7fe828061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe82805ed90 0x7fe828061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe838009b90 tx=0x7fe838009060).stop 2023-08-17T17:49:14.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 -- 172.21.15.78:0/1010287696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84814e290 msgr2=0x7fe84813c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84814e290 0x7fe84813c360 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fe840009df0 tx=0x7fe84000b040).stop 2023-08-17T17:49:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 -- 172.21.15.78:0/1010287696 shutdown_connections 2023-08-17T17:49:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe82805ed90 0x7fe828061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84814e290 0x7fe84813c360 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8480643e0 0x7fe848135f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 --2- 172.21.15.78:0/1010287696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe848064890 0x7fe848154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 -- 172.21.15.78:0/1010287696 >> 172.21.15.78:0/1010287696 conn(0x7fe8480c3d40 msgr2=0x7fe8480c6390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 -- 172.21.15.78:0/1010287696 shutdown_connections 2023-08-17T17:49:14.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.286+0000 7fe84dafe700 1 -- 172.21.15.78:0/1010287696 wait complete. 2023-08-17T17:49:14.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T17:49:14.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.413+0000 7f7efc166700 1 Processor -- start 2023-08-17T17:49:14.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.413+0000 7f7efc166700 1 -- start start 2023-08-17T17:49:14.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7efc166700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7ef40aa0f0 0x7f7ef40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7efc166700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7ef40aa4d0 0x7f7ef40c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7efc166700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40c5810 0x7f7ef40c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7efc166700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef40649b0 con 0x7f7ef40aa0f0 2023-08-17T17:49:14.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7efc166700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef40c6140 con 0x7f7ef40aa4d0 2023-08-17T17:49:14.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7efc166700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4063420 con 0x7f7ef40c5810 2023-08-17T17:49:14.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7ef9f02700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7ef40aa0f0 0x7f7ef40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7ef9f02700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7ef40aa0f0 0x7f7ef40644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42442/0 (socket says 172.21.15.78:42442) 2023-08-17T17:49:14.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7ef9f02700 1 -- 172.21.15.78:0/1227510266 learned_addr learned my addr 172.21.15.78:0/1227510266 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:14.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7ef9701700 1 --2- 172.21.15.78:0/1227510266 >> v2:172.21.15.150:3300/0 conn(0x7f7ef40aa4d0 0x7f7ef40c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7ef9f02700 1 -- 172.21.15.78:0/1227510266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40c5810 msgr2=0x7f7ef40c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:14.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7ef9f02700 1 --2- 172.21.15.78:0/1227510266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40c5810 0x7f7ef40c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:14.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7ef9f02700 1 -- 172.21.15.78:0/1227510266 >> v2:172.21.15.150:3300/0 conn(0x7f7ef40aa4d0 msgr2=0x7f7ef40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:14.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7ef9f02700 1 --2- 172.21.15.78:0/1227510266 >> v2:172.21.15.150:3300/0 conn(0x7f7ef40aa4d0 0x7f7ef40c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.414+0000 7f7ef9f02700 1 -- 172.21.15.78:0/1227510266 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4063700 con 0x7f7ef40aa0f0 2023-08-17T17:49:14.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7ef9f02700 1 --2- 172.21.15.78:0/1227510266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40aa0f0 0x7f7ef40644c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f7ef4159060 tx=0x7f7ef0009840).ready entity=mon.0 client_cookie=267069cfa2a46f35 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:14.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7ef8f00700 1 -- 172.21.15.78:0/1227510266 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000e070 con 0x7f7ef40aa0f0 2023-08-17T17:49:14.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7ef8f00700 1 -- 172.21.15.78:0/1227510266 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef000ba50 con 0x7f7ef40aa0f0 2023-08-17T17:49:14.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7ef8f00700 1 -- 172.21.15.78:0/1227510266 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000bdd0 con 0x7f7ef40aa0f0 2023-08-17T17:49:14.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7efc166700 1 -- 172.21.15.78:0/1227510266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40aa0f0 msgr2=0x7f7ef40644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7efc166700 1 --2- 172.21.15.78:0/1227510266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40aa0f0 0x7f7ef40644c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f7ef4159060 tx=0x7f7ef0009840).stop 2023-08-17T17:49:14.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7efc166700 1 -- 172.21.15.78:0/1227510266 shutdown_connections 2023-08-17T17:49:14.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7efc166700 1 --2- 172.21.15.78:0/1227510266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40aa0f0 0x7f7ef40644c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7efc166700 1 --2- 172.21.15.78:0/1227510266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40c5810 0x7f7ef40c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:14.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7efc166700 1 --2- 172.21.15.78:0/1227510266 >> v2:172.21.15.150:3300/0 conn(0x7f7ef40aa4d0 0x7f7ef40c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7efc166700 1 -- 172.21.15.78:0/1227510266 >> 172.21.15.78:0/1227510266 conn(0x7f7ef406a6a0 msgr2=0x7f7ef40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:14.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7efc166700 1 -- 172.21.15.78:0/1227510266 shutdown_connections 2023-08-17T17:49:14.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.415+0000 7f7efc166700 1 -- 172.21.15.78:0/1227510266 wait complete. 2023-08-17T17:49:14.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.416+0000 7f7efc166700 1 Processor -- start 2023-08-17T17:49:14.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.416+0000 7f7efc166700 1 -- start start 2023-08-17T17:49:14.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7efc166700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef40aa0f0 0x7f7ef40b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7efc166700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40aa4d0 0x7f7ef40c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7efc166700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40c5810 0x7f7ef413f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7efc166700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40c1fb0 con 0x7f7ef40c5810 2023-08-17T17:49:14.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7efc166700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef413fc70 con 0x7f7ef40aa0f0 2023-08-17T17:49:14.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7efc166700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40c2dd0 con 0x7f7ef40aa4d0 2023-08-17T17:49:14.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7efa703700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40c5810 0x7f7ef413f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7efa703700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40c5810 0x7f7ef413f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42456/0 (socket says 172.21.15.78:42456) 2023-08-17T17:49:14.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7efa703700 1 -- 172.21.15.78:0/3280131586 learned_addr learned my addr 172.21.15.78:0/3280131586 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:14.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7ef9f02700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef40aa0f0 0x7f7ef40b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.417+0000 7f7ef9701700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40aa4d0 0x7f7ef40c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7efa703700 1 -- 172.21.15.78:0/3280131586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40aa4d0 msgr2=0x7f7ef40c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7efa703700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40aa4d0 0x7f7ef40c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7efa703700 1 -- 172.21.15.78:0/3280131586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef40aa0f0 msgr2=0x7f7ef40b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7efa703700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef40aa0f0 0x7f7ef40b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7efa703700 1 -- 172.21.15.78:0/3280131586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef0009ae0 con 0x7f7ef40c5810 2023-08-17T17:49:14.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7efa703700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40c5810 0x7f7ef413f780 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f7eec00b5e0 tx=0x7f7eec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:14.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7ee9ffb700 1 -- 172.21.15.78:0/3280131586 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec002320 con 0x7f7ef40c5810 2023-08-17T17:49:14.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7ee9ffb700 1 -- 172.21.15.78:0/3280131586 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec0024a0 con 0x7f7ef40c5810 2023-08-17T17:49:14.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7efc166700 1 -- 172.21.15.78:0/3280131586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef40c21c0 con 0x7f7ef40c5810 2023-08-17T17:49:14.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7ee9ffb700 1 -- 172.21.15.78:0/3280131586 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec002860 con 0x7f7ef40c5810 2023-08-17T17:49:14.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.418+0000 7f7efc166700 1 -- 172.21.15.78:0/3280131586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef40c2780 con 0x7f7ef40c5810 2023-08-17T17:49:14.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.419+0000 7f7efc166700 1 -- 172.21.15.78:0/3280131586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef40c2f40 con 0x7f7ef40c5810 2023-08-17T17:49:14.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.419+0000 7f7ee9ffb700 1 -- 172.21.15.78:0/3280131586 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7eec00f030 con 0x7f7ef40c5810 2023-08-17T17:49:14.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.420+0000 7f7ee9ffb700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ed805ed90 0x7f7ed8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.420+0000 7f7ee9ffb700 1 -- 172.21.15.78:0/3280131586 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f7eec079610 con 0x7f7ef40c5810 2023-08-17T17:49:14.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.420+0000 7f7ef9f02700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ed805ed90 0x7f7ed8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.420+0000 7f7ef9f02700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ed805ed90 0x7f7ed8061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7ef0009880 tx=0x7f7ef40c6bb0).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:14.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.424+0000 7f7ee9ffb700 1 -- 172.21.15.78:0/3280131586 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7eec04ad50 con 0x7f7ef40c5810 2023-08-17T17:49:14.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.588+0000 7f7efc166700 1 -- 172.21.15.78:0/3280131586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7ef4046af0 con 0x7f7ef40c5810 2023-08-17T17:49:14.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.591+0000 7f7ee9ffb700 1 -- 172.21.15.78:0/3280131586 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7eec009160 con 0x7f7ef40c5810 2023-08-17T17:49:14.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 -- 172.21.15.78:0/3280131586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ed805ed90 msgr2=0x7f7ed8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ed805ed90 0x7f7ed8061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7ef0009880 tx=0x7f7ef40c6bb0).stop 2023-08-17T17:49:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 -- 172.21.15.78:0/3280131586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40c5810 msgr2=0x7f7ef413f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40c5810 0x7f7ef413f780 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f7eec00b5e0 tx=0x7f7eec009060).stop 2023-08-17T17:49:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 -- 172.21.15.78:0/3280131586 shutdown_connections 2023-08-17T17:49:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ed805ed90 0x7f7ed8061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef40c5810 0x7f7ef413f780 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef40aa0f0 0x7f7ef40b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 --2- 172.21.15.78:0/3280131586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40aa4d0 0x7f7ef40c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 -- 172.21.15.78:0/3280131586 >> 172.21.15.78:0/3280131586 conn(0x7f7ef406a6a0 msgr2=0x7f7ef4151820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:14.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 -- 172.21.15.78:0/3280131586 shutdown_connections 2023-08-17T17:49:14.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.593+0000 7f7efc166700 1 -- 172.21.15.78:0/3280131586 wait complete. 2023-08-17T17:49:14.605 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:49:14.605 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:49:14.642 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:49:14.691 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:49:14.691 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T17:49:14.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:14.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.805+0000 7fda37fff700 1 Processor -- start 2023-08-17T17:49:14.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.805+0000 7fda37fff700 1 -- start start 2023-08-17T17:49:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.806+0000 7fda37fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fda380be5e0 0x7fda380699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.806+0000 7fda37fff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3806a030 con 0x7fda380be200 2023-08-17T17:49:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.806+0000 7fda37fff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda380c20d0 con 0x7fda38155a70 2023-08-17T17:49:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.806+0000 7fda37fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda380a68b0 con 0x7fda380be5e0 2023-08-17T17:49:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.806+0000 7fda36ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fda380be200 0x7fda380c3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58784/0 (socket says 172.21.15.78:58784) 2023-08-17T17:49:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.806+0000 7fda36ffd700 1 -- 172.21.15.78:0/3678307003 learned_addr learned my addr 172.21.15.78:0/3678307003 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda2ffff700 1 --2- 172.21.15.78:0/3678307003 >> v2:172.21.15.150:3300/0 conn(0x7fda380be5e0 0x7fda380699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743157735 0 0) 0x7fda3806a030 con 0x7fda380be200 2023-08-17T17:49:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda240033f0 con 0x7fda380be200 2023-08-17T17:49:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1374570311 0 0) 0x7fda240033f0 con 0x7fda380be200 2023-08-17T17:49:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 >> v2:172.21.15.150:3300/0 conn(0x7fda380be5e0 msgr2=0x7fda380699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 --2- 172.21.15.78:0/3678307003 >> v2:172.21.15.150:3300/0 conn(0x7fda380be5e0 0x7fda380699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 >> v1:172.21.15.150:6789/0 conn(0x7fda38155a70 legacy=0x7fda38155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda380a6b90 con 0x7fda380be200 2023-08-17T17:49:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fda28001470 con 0x7fda380be200 2023-08-17T17:49:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 >> v1:172.21.15.78:6789/0 conn(0x7fda380be200 legacy=0x7fda380c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda240038e0 0x7fda24003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda24004690 0x7fda24004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda24005000 0x7fda2400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda380a68b0 con 0x7fda24005000 2023-08-17T17:49:14.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2400beb0 con 0x7fda240038e0 2023-08-17T17:49:14.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2400c070 con 0x7fda24004690 2023-08-17T17:49:14.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda377fe700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda24005000 0x7fda2400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda36ffd700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda240038e0 0x7fda24003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda2ffff700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda24004690 0x7fda24004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda377fe700 1 -- 172.21.15.78:0/3678307003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda24004690 msgr2=0x7fda24004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:14.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda377fe700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda24004690 0x7fda24004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda377fe700 1 -- 172.21.15.78:0/3678307003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda240038e0 msgr2=0x7fda24003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:14.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda377fe700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda240038e0 0x7fda24003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.807+0000 7fda377fe700 1 -- 172.21.15.78:0/3678307003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240033f0 con 0x7fda24005000 2023-08-17T17:49:14.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda377fe700 1 -- 172.21.15.78:0/3678307003 reap_dead start 2023-08-17T17:49:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda377fe700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda24005000 0x7fda2400b8e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fda38156580 tx=0x7fda30007f30).ready entity=mon.0 client_cookie=722de88dff47a069 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000c870 con 0x7fda24005000 2023-08-17T17:49:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000c9d0 con 0x7fda24005000 2023-08-17T17:49:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda367fc700 1 -- 172.21.15.78:0/3678307003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000cd70 con 0x7fda24005000 2023-08-17T17:49:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda37fff700 1 -- 172.21.15.78:0/3678307003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda24005000 msgr2=0x7fda2400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda37fff700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda24005000 0x7fda2400b8e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fda38156580 tx=0x7fda30007f30).stop 2023-08-17T17:49:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda37fff700 1 -- 172.21.15.78:0/3678307003 shutdown_connections 2023-08-17T17:49:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda37fff700 1 --2- 172.21.15.78:0/3678307003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda24005000 0x7fda2400b8e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda37fff700 1 -- 172.21.15.78:0/3678307003 >> 172.21.15.78:0/3678307003 conn(0x7fda380c4440 msgr2=0x7fda380c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda37fff700 1 -- 172.21.15.78:0/3678307003 shutdown_connections 2023-08-17T17:49:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.808+0000 7fda37fff700 1 -- 172.21.15.78:0/3678307003 wait complete. 2023-08-17T17:49:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.809+0000 7fda37fff700 1 Processor -- start 2023-08-17T17:49:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.809+0000 7fda37fff700 1 -- start start 2023-08-17T17:49:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda37fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24005000 0x7fda380c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda37fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda38146680 0x7fda380a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda37fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda3814f630 0x7fda3814fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda37fff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda380c75a0 con 0x7fda38146680 2023-08-17T17:49:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda37fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38146b00 con 0x7fda24005000 2023-08-17T17:49:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda37fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda380c6d00 con 0x7fda3814f630 2023-08-17T17:49:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda2ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda38146680 0x7fda380a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda2ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda38146680 0x7fda380a57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42476/0 (socket says 172.21.15.78:42476) 2023-08-17T17:49:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda2ffff700 1 -- 172.21.15.78:0/2339081015 learned_addr learned my addr 172.21.15.78:0/2339081015 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda36ffd700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24005000 0x7fda380c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda377fe700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda3814f630 0x7fda3814fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda2ffff700 1 -- 172.21.15.78:0/2339081015 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda3814f630 msgr2=0x7fda3814fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda2ffff700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda3814f630 0x7fda3814fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda2ffff700 1 -- 172.21.15.78:0/2339081015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24005000 msgr2=0x7fda380c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda2ffff700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24005000 0x7fda380c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.810+0000 7fda2ffff700 1 -- 172.21.15.78:0/2339081015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda380c6fe0 con 0x7fda38146680 2023-08-17T17:49:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.811+0000 7fda2ffff700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda38146680 0x7fda380a57d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fda20011a20 tx=0x7fda20009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.811+0000 7fda2effd700 1 -- 172.21.15.78:0/2339081015 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000f730 con 0x7fda38146680 2023-08-17T17:49:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.811+0000 7fda2effd700 1 -- 172.21.15.78:0/2339081015 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2000f890 con 0x7fda38146680 2023-08-17T17:49:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.811+0000 7fda37fff700 1 -- 172.21.15.78:0/2339081015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda380c72c0 con 0x7fda38146680 2023-08-17T17:49:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.811+0000 7fda2effd700 1 -- 172.21.15.78:0/2339081015 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000fc10 con 0x7fda38146680 2023-08-17T17:49:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.811+0000 7fda37fff700 1 -- 172.21.15.78:0/2339081015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda380a5cc0 con 0x7fda38146680 2023-08-17T17:49:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.812+0000 7fda37fff700 1 -- 172.21.15.78:0/2339081015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3814ef70 con 0x7fda38146680 2023-08-17T17:49:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.812+0000 7fda2effd700 1 -- 172.21.15.78:0/2339081015 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fda20024070 con 0x7fda38146680 2023-08-17T17:49:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.812+0000 7fda2effd700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 0x7fda18061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.812+0000 7fda2effd700 1 -- 172.21.15.78:0/2339081015 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5699+0+0 (secure 0 0 0) 0x7fda2007a310 con 0x7fda38146680 2023-08-17T17:49:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.812+0000 7fda36ffd700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 0x7fda18061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.813+0000 7fda36ffd700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 0x7fda18061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fda28001ed0 tx=0x7fda380c2040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:14.816+0000 7fda2effd700 1 -- 172.21.15.78:0/2339081015 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda3814ef70 con 0x7fda38146680 2023-08-17T17:49:15.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.017+0000 7fda37fff700 1 -- 172.21.15.78:0/2339081015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda3814ef70 con 0x7fda38146680 2023-08-17T17:49:15.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.018+0000 7fda2effd700 1 -- 172.21.15.78:0/2339081015 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fda3814ef70 con 0x7fda38146680 2023-08-17T17:49:15.018 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:15.019 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5090,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2346190042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2346190042},{"type":"v1","addr":"172.21.15.150:6834","nonce":2346190042}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3492833016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3492833016},{"type":"v1","addr":"172.21.15.150:6835","nonce":3492833016}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5440,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2674101879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2674101879},{"type":"v1","addr":"172.21.15.78:6837","nonce":2674101879}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5745,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1609000139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1609000139},{"type":"v1","addr":"172.21.15.78:6836","nonce":1609000139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2023-08-17T17:49:15.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.019+0000 7fda37fff700 1 -- 172.21.15.78:0/2339081015 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 msgr2=0x7fda18061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:15.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.019+0000 7fda37fff700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 0x7fda18061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fda28001ed0 tx=0x7fda380c2040).stop 2023-08-17T17:49:15.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.019+0000 7fda37fff700 1 -- 172.21.15.78:0/2339081015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda38146680 msgr2=0x7fda380a57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:15.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.019+0000 7fda37fff700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda38146680 0x7fda380a57d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fda20011a20 tx=0x7fda20009060).stop 2023-08-17T17:49:15.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.020+0000 7fda37fff700 1 -- 172.21.15.78:0/2339081015 shutdown_connections 2023-08-17T17:49:15.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.020+0000 7fda37fff700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 0x7fda18061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:15.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.020+0000 7fda37fff700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda3814f630 0x7fda3814fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:15.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.020+0000 7fda37fff700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24005000 0x7fda380c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:15.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.020+0000 7fda37fff700 1 --2- 172.21.15.78:0/2339081015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda38146680 0x7fda380a57d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:15.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.020+0000 7fda37fff700 1 -- 172.21.15.78:0/2339081015 >> 172.21.15.78:0/2339081015 conn(0x7fda380c4440 msgr2=0x7fda380635b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:15.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.020+0000 7fda37fff700 1 -- 172.21.15.78:0/2339081015 shutdown_connections 2023-08-17T17:49:15.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.020+0000 7fda37fff700 1 -- 172.21.15.78:0/2339081015 wait complete. 2023-08-17T17:49:15.022 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 21 2023-08-17T17:49:15.032 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T17:49:15.032 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T17:49:15.032 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T17:49:15.033 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:49:15.033 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T17:49:15.033 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T17:49:15.033 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T17:49:15.034 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:49:15.034 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T17:49:15.034 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T17:49:15.034 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T17:49:15.035 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:49:15.035 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T17:49:15.035 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T17:49:15.035 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T17:49:15.036 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:49:15.041 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T17:49:15.041 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T17:49:15.042 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T17:49:15.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T17:49:15.047 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T17:49:15.047 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T17:49:15.048 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T17:49:15.049 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T17:49:15.083 INFO:tasks.ceph.mds.a:Started 2023-08-17T17:49:15.083 DEBUG:teuthology.parallel:result is None 2023-08-17T17:49:15.084 INFO:tasks.ceph.mds.c:Started 2023-08-17T17:49:15.084 DEBUG:teuthology.parallel:result is None 2023-08-17T17:49:15.090 INFO:tasks.ceph.mds.b:Started 2023-08-17T17:49:15.090 DEBUG:teuthology.parallel:result is None 2023-08-17T17:49:15.092 INFO:tasks.ceph.mds.d:Started 2023-08-17T17:49:15.092 DEBUG:teuthology.parallel:result is None 2023-08-17T17:49:15.092 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T17:49:15.155 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:49:15.155 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T17:49:15.172 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T17:49:15.172 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:49:15.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.218+0000 7f3098775700 1 Processor -- start 2023-08-17T17:49:15.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.218+0000 7f3098775700 1 -- start start 2023-08-17T17:49:15.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.219+0000 7f3098775700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30900c0560 0x7f30900a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:15.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.219+0000 7f3098775700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30900c7690 con 0x7f3090154580 2023-08-17T17:49:15.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.219+0000 7f3098775700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30900c8df0 con 0x7f30901541a0 2023-08-17T17:49:15.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.219+0000 7f3098775700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30900a8190 con 0x7f30900c0560 2023-08-17T17:49:15.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.219+0000 7f3095d10700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3090154580 0x7f30900c6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58802/0 (socket says 172.21.15.78:58802) 2023-08-17T17:49:15.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.219+0000 7f3095d10700 1 -- 172.21.15.78:0/2549186794 learned_addr learned my addr 172.21.15.78:0/2549186794 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:15.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3096d12700 1 --2- 172.21.15.78:0/2549186794 >> v2:172.21.15.150:3300/0 conn(0x7f30900c0560 0x7f30900a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:15.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576957761 0 0) 0x7f3080001110 con 0x7f3090154580 2023-08-17T17:49:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f307c0033f0 con 0x7f3090154580 2023-08-17T17:49:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450448091 0 0) 0x7f307c0033f0 con 0x7f3090154580 2023-08-17T17:49:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 >> v2:172.21.15.150:3300/0 conn(0x7f30900c0560 msgr2=0x7f30900a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 --2- 172.21.15.78:0/2549186794 >> v2:172.21.15.150:3300/0 conn(0x7f30900c0560 0x7f30900a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 >> v1:172.21.15.150:6789/0 conn(0x7f30901541a0 legacy=0x7f30900bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30900c9970 con 0x7f3090154580 2023-08-17T17:49:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3080001600 con 0x7f3090154580 2023-08-17T17:49:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 >> v1:172.21.15.78:6789/0 conn(0x7f3090154580 legacy=0x7f30900c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:15.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307c0038e0 0x7f307c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:15.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f307c004690 0x7f307c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:15.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f307c005050 0x7f307c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:15.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30900a8190 con 0x7f307c0038e0 2023-08-17T17:49:15.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c00bfe0 con 0x7f307c004690 2023-08-17T17:49:15.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307c00c1a0 con 0x7f307c005050 2023-08-17T17:49:15.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3096511700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307c0038e0 0x7f307c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3095d10700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f307c004690 0x7f307c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3096d12700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f307c005050 0x7f307c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3096511700 1 -- 172.21.15.78:0/2549186794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f307c005050 msgr2=0x7f307c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3096511700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f307c005050 0x7f307c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3096511700 1 -- 172.21.15.78:0/2549186794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f307c004690 msgr2=0x7f307c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3096511700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f307c004690 0x7f307c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3096d12700 1 -- 172.21.15.78:0/2549186794 reap_dead start 2023-08-17T17:49:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3096511700 1 -- 172.21.15.78:0/2549186794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c0033f0 con 0x7f307c0038e0 2023-08-17T17:49:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.220+0000 7f3096511700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307c0038e0 0x7f307c003d00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f308c001730 tx=0x7f308c007bb0).ready entity=mon.0 client_cookie=8236584972e53135 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.221+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c007020 con 0x7f307c0038e0 2023-08-17T17:49:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.221+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c007180 con 0x7f307c0038e0 2023-08-17T17:49:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.221+0000 7f309550f700 1 -- 172.21.15.78:0/2549186794 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c007520 con 0x7f307c0038e0 2023-08-17T17:49:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.221+0000 7f3098775700 1 -- 172.21.15.78:0/2549186794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307c0038e0 msgr2=0x7f307c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.221+0000 7f3098775700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307c0038e0 0x7f307c003d00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f308c001730 tx=0x7f308c007bb0).stop 2023-08-17T17:49:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.221+0000 7f3098775700 1 -- 172.21.15.78:0/2549186794 shutdown_connections 2023-08-17T17:49:15.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.221+0000 7f3098775700 1 --2- 172.21.15.78:0/2549186794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307c0038e0 0x7f307c003d00 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:15.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.221+0000 7f3098775700 1 -- 172.21.15.78:0/2549186794 >> 172.21.15.78:0/2549186794 conn(0x7f309006a400 msgr2=0x7f30900caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:15.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.221+0000 7f3098775700 1 -- 172.21.15.78:0/2549186794 shutdown_connections 2023-08-17T17:49:15.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.221+0000 7f3098775700 1 -- 172.21.15.78:0/2549186794 wait complete. 2023-08-17T17:49:15.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.222+0000 7f3098775700 1 Processor -- start 2023-08-17T17:49:15.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.222+0000 7f3098775700 1 -- start start 2023-08-17T17:49:15.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3098775700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f307c0038e0 0x7f309014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:15.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3098775700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3090163f60 0x7f3090151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:15.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3098775700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3090151af0 0x7f309014db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:15.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3098775700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309014edd0 con 0x7f3090151af0 2023-08-17T17:49:15.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3098775700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30900afc90 con 0x7f3090163f60 2023-08-17T17:49:15.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3098775700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3090151f70 con 0x7f307c0038e0 2023-08-17T17:49:15.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3096d12700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3090151af0 0x7f309014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:15.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3095d10700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3090163f60 0x7f3090151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:15.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3096d12700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3090151af0 0x7f309014db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42510/0 (socket says 172.21.15.78:42510) 2023-08-17T17:49:15.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3095d10700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3090163f60 0x7f3090151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:40638/0 (socket says 172.21.15.78:40638) 2023-08-17T17:49:15.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3096d12700 1 -- 172.21.15.78:0/1130556815 learned_addr learned my addr 172.21.15.78:0/1130556815 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:15.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3096511700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f307c0038e0 0x7f309014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:15.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3096d12700 1 -- 172.21.15.78:0/1130556815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f307c0038e0 msgr2=0x7f309014d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:15.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3096d12700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f307c0038e0 0x7f309014d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:15.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3096d12700 1 -- 172.21.15.78:0/1130556815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3090163f60 msgr2=0x7f3090151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:15.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3096d12700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3090163f60 0x7f3090151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:15.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.223+0000 7f3096d12700 1 -- 172.21.15.78:0/1130556815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309014e810 con 0x7f3090151af0 2023-08-17T17:49:15.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.224+0000 7f3096d12700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3090151af0 0x7f309014db70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f30880094d0 tx=0x7f308800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:15.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.224+0000 7f30867fc700 1 -- 172.21.15.78:0/1130556815 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308800e040 con 0x7f3090151af0 2023-08-17T17:49:15.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.224+0000 7f30867fc700 1 -- 172.21.15.78:0/1130556815 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308800f040 con 0x7f3090151af0 2023-08-17T17:49:15.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.224+0000 7f30867fc700 1 -- 172.21.15.78:0/1130556815 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308800fd40 con 0x7f3090151af0 2023-08-17T17:49:15.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.224+0000 7f3098775700 1 -- 172.21.15.78:0/1130556815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309014eaf0 con 0x7f3090151af0 2023-08-17T17:49:15.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.224+0000 7f3098775700 1 -- 172.21.15.78:0/1130556815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309014d870 con 0x7f3090151af0 2023-08-17T17:49:15.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.225+0000 7f3098775700 1 -- 172.21.15.78:0/1130556815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30900af780 con 0x7f3090151af0 2023-08-17T17:49:15.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.225+0000 7f30867fc700 1 -- 172.21.15.78:0/1130556815 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3088015660 con 0x7f3090151af0 2023-08-17T17:49:15.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.225+0000 7f30867fc700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f307405edc0 0x7f3074061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:15.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.225+0000 7f3096511700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f307405edc0 0x7f3074061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:15.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.225+0000 7f30867fc700 1 -- 172.21.15.78:0/1130556815 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f308807a5a0 con 0x7f3090151af0 2023-08-17T17:49:15.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.226+0000 7f3096511700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f307405edc0 0x7f3074061280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f308c001050 tx=0x7f308c015000).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:15.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.229+0000 7f30867fc700 1 -- 172.21.15.78:0/1130556815 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f30900af780 con 0x7f3090151af0 2023-08-17T17:49:15.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:15.408+0000 7f3098775700 1 -- 172.21.15.78:0/1130556815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f30900af780 con 0x7f3090151af0 2023-08-17T17:49:16.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.292+0000 7f30867fc700 1 -- 172.21.15.78:0/1130556815 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v73) v1 ==== 97+0+0 (secure 0 0 0) 0x7f30900af780 con 0x7f3090151af0 2023-08-17T17:49:16.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 -- 172.21.15.78:0/1130556815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f307405edc0 msgr2=0x7f3074061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f307405edc0 0x7f3074061280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f308c001050 tx=0x7f308c015000).stop 2023-08-17T17:49:16.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 -- 172.21.15.78:0/1130556815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3090151af0 msgr2=0x7f309014db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3090151af0 0x7f309014db70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f30880094d0 tx=0x7f308800b040).stop 2023-08-17T17:49:16.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 -- 172.21.15.78:0/1130556815 shutdown_connections 2023-08-17T17:49:16.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f307405edc0 0x7f3074061280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3090151af0 0x7f309014db70 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f307c0038e0 0x7f309014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 --2- 172.21.15.78:0/1130556815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3090163f60 0x7f3090151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 -- 172.21.15.78:0/1130556815 >> 172.21.15.78:0/1130556815 conn(0x7f309006a400 msgr2=0x7f30900636b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 -- 172.21.15.78:0/1130556815 shutdown_connections 2023-08-17T17:49:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.294+0000 7f3098775700 1 -- 172.21.15.78:0/1130556815 wait complete. 2023-08-17T17:49:16.296 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-08-17T17:49:16.307 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T17:49:16.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.420+0000 7faab7793700 1 Processor -- start 2023-08-17T17:49:16.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.420+0000 7faab7793700 1 -- start start 2023-08-17T17:49:16.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.421+0000 7faab7793700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab0154140 0x7faab00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.421+0000 7faab7793700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faab00c1010 0x7faab00ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.421+0000 7faab7793700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab0154520 con 0x7faab00a7c40 2023-08-17T17:49:16.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.421+0000 7faab7793700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab00c91e0 con 0x7faab00c1010 2023-08-17T17:49:16.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.421+0000 7faab7793700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab00c94c0 con 0x7faab0154140 2023-08-17T17:49:16.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.421+0000 7faab4d2e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7faab00a7c40 0x7faab00c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58816/0 (socket says 172.21.15.78:58816) 2023-08-17T17:49:16.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.421+0000 7faab4d2e700 1 -- 172.21.15.78:0/200096374 learned_addr learned my addr 172.21.15.78:0/200096374 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:16.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879127563 0 0) 0x7faab0154520 con 0x7faab00a7c40 2023-08-17T17:49:16.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faab5d30700 1 --2- 172.21.15.78:0/200096374 >> v2:172.21.15.150:3300/0 conn(0x7faab00c1010 0x7faab00ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faab552f700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab0154140 0x7faab00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa980033f0 con 0x7faab00a7c40 2023-08-17T17:49:16.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3119747288 0 0) 0x7faa980033f0 con 0x7faab00a7c40 2023-08-17T17:49:16.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab0154140 msgr2=0x7faab00c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:16.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab0154140 0x7faab00c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 >> v2:172.21.15.150:3300/0 conn(0x7faab00c1010 msgr2=0x7faab00ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 --2- 172.21.15.78:0/200096374 >> v2:172.21.15.150:3300/0 conn(0x7faab00c1010 0x7faab00ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab00c97a0 con 0x7faab00a7c40 2023-08-17T17:49:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7faaa4001470 con 0x7faab00a7c40 2023-08-17T17:49:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 >> v1:172.21.15.78:6789/0 conn(0x7faab00a7c40 legacy=0x7faab00c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab0154140 0x7faa980038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 0x7faa98004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa98004b80 0x7faa98005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab00c91e0 con 0x7faa98003e10 2023-08-17T17:49:16.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab00c94c0 con 0x7faa98004b80 2023-08-17T17:49:16.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9800b8e0 con 0x7faab0154140 2023-08-17T17:49:16.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faab4d2e700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 0x7faa98004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faab552f700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab0154140 0x7faa980038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faab5d30700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa98004b80 0x7faa98005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faab4d2e700 1 -- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab0154140 msgr2=0x7faa980038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faab4d2e700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab0154140 0x7faa980038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faab4d2e700 1 -- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa98004b80 msgr2=0x7faa98005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faab4d2e700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa98004b80 0x7faa98005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.422+0000 7faab4d2e700 1 -- 172.21.15.78:0/200096374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa980033f0 con 0x7faa98003e10 2023-08-17T17:49:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faab4d2e700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 0x7faa98004690 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7faaa400c210 tx=0x7faaa4001e90).ready entity=mon.0 client_cookie=b0019fb7b535d345 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4007a60 con 0x7faa98003e10 2023-08-17T17:49:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa400caa0 con 0x7faa98003e10 2023-08-17T17:49:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faaaffff700 1 -- 172.21.15.78:0/200096374 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa400ce20 con 0x7faa98003e10 2023-08-17T17:49:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faab7793700 1 -- 172.21.15.78:0/200096374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 msgr2=0x7faa98004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faab7793700 1 --2- 172.21.15.78:0/200096374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 0x7faa98004690 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7faaa400c210 tx=0x7faaa4001e90).stop 2023-08-17T17:49:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faab5d30700 1 -- 172.21.15.78:0/200096374 reap_dead start 2023-08-17T17:49:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faab7793700 1 -- 172.21.15.78:0/200096374 shutdown_connections 2023-08-17T17:49:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faab7793700 1 -- 172.21.15.78:0/200096374 >> 172.21.15.78:0/200096374 conn(0x7faab0094510 msgr2=0x7faab006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faab7793700 1 -- 172.21.15.78:0/200096374 shutdown_connections 2023-08-17T17:49:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.423+0000 7faab7793700 1 -- 172.21.15.78:0/200096374 wait complete. 2023-08-17T17:49:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.424+0000 7faab7793700 1 Processor -- start 2023-08-17T17:49:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.424+0000 7faab7793700 1 -- start start 2023-08-17T17:49:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.425+0000 7faab7793700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 0x7faab00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.425+0000 7faab7793700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab00ade40 0x7faab00c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.425+0000 7faab7793700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab00c5040 0x7faab00ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.425+0000 7faab7793700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab01640a0 con 0x7faa98003e10 2023-08-17T17:49:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.425+0000 7faab7793700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab00ae2c0 con 0x7faab00ade40 2023-08-17T17:49:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.425+0000 7faab7793700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab0164360 con 0x7faab00c5040 2023-08-17T17:49:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.425+0000 7faab552f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 0x7faab00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.425+0000 7faab552f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 0x7faab00b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42528/0 (socket says 172.21.15.78:42528) 2023-08-17T17:49:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.425+0000 7faab552f700 1 -- 172.21.15.78:0/2938404588 learned_addr learned my addr 172.21.15.78:0/2938404588 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faab552f700 1 -- 172.21.15.78:0/2938404588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab00c5040 msgr2=0x7faab00ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faab552f700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab00c5040 0x7faab00ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faab552f700 1 -- 172.21.15.78:0/2938404588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab00ade40 msgr2=0x7faab00c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faab552f700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab00ade40 0x7faab00c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faab552f700 1 -- 172.21.15.78:0/2938404588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0164640 con 0x7faa98003e10 2023-08-17T17:49:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faab552f700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 0x7faab00b0070 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7faaa0011f80 tx=0x7faaa000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faaad7fa700 1 -- 172.21.15.78:0/2938404588 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa000e040 con 0x7faa98003e10 2023-08-17T17:49:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faaad7fa700 1 -- 172.21.15.78:0/2938404588 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa000f040 con 0x7faa98003e10 2023-08-17T17:49:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faab7793700 1 -- 172.21.15.78:0/2938404588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab0164920 con 0x7faa98003e10 2023-08-17T17:49:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faaad7fa700 1 -- 172.21.15.78:0/2938404588 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0015450 con 0x7faa98003e10 2023-08-17T17:49:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.426+0000 7faab7793700 1 -- 172.21.15.78:0/2938404588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab00aeb60 con 0x7faa98003e10 2023-08-17T17:49:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.427+0000 7faab7793700 1 -- 172.21.15.78:0/2938404588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab0047350 con 0x7faa98003e10 2023-08-17T17:49:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.427+0000 7faaad7fa700 1 -- 172.21.15.78:0/2938404588 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faaa0015880 con 0x7faa98003e10 2023-08-17T17:49:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.428+0000 7faaad7fa700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9c05ed90 0x7faa9c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.428+0000 7faab4d2e700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9c05ed90 0x7faa9c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.428+0000 7faaad7fa700 1 -- 172.21.15.78:0/2938404588 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5269+0+0 (secure 0 0 0) 0x7faaa007aaf0 con 0x7faa98003e10 2023-08-17T17:49:16.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.428+0000 7faab4d2e700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9c05ed90 0x7faa9c061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faaa4001ed0 tx=0x7faaa4015000).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:16.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.432+0000 7faaad7fa700 1 -- 172.21.15.78:0/2938404588 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faaa004c2d0 con 0x7faa98003e10 2023-08-17T17:49:16.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.657+0000 7faab7793700 1 -- 172.21.15.78:0/2938404588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7faab00c9a80 con 0x7faa98003e10 2023-08-17T17:49:16.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.658+0000 7faaad7fa700 1 -- 172.21.15.78:0/2938404588 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7faaa004f8f0 con 0x7faa98003e10 2023-08-17T17:49:16.658 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:16.658 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:49:16.659 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-08-17T17:49:16.659 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.659 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-08-17T17:49:16.659 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA==", 2023-08-17T17:49:16.659 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.659 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:16.659 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:49:16.660 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:49:16.660 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.660 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.660 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.660 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.660 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-08-17T17:49:16.660 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g==", 2023-08-17T17:49:16.661 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.661 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:16.661 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:49:16.661 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:49:16.661 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.661 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.661 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.661 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.662 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-08-17T17:49:16.662 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw==", 2023-08-17T17:49:16.662 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.662 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:16.662 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:49:16.662 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:49:16.662 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.662 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.663 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.663 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.663 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-08-17T17:49:16.663 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg==", 2023-08-17T17:49:16.663 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.663 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:16.663 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:49:16.663 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:49:16.664 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.664 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.664 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.664 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.664 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-08-17T17:49:16.664 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg==", 2023-08-17T17:49:16.664 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-08-17T17:49:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw==", 2023-08-17T17:49:16.666 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.666 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:16.666 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:16.666 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.666 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.666 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.666 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.666 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-08-17T17:49:16.667 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA==", 2023-08-17T17:49:16.667 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.667 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:16.667 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:16.667 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.667 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.667 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.667 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.668 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-08-17T17:49:16.668 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ==", 2023-08-17T17:49:16.668 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.668 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:16.668 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:16.669 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.669 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.669 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.669 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.669 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-08-17T17:49:16.669 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA==", 2023-08-17T17:49:16.669 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.670 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:16.670 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:16.670 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.670 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.670 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.670 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.670 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-08-17T17:49:16.671 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q==", 2023-08-17T17:49:16.671 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.671 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:16.671 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:16.671 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.671 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.671 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.672 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.672 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-08-17T17:49:16.672 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw==", 2023-08-17T17:49:16.672 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.672 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:16.672 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:16.672 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.673 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.673 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.673 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.673 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-08-17T17:49:16.673 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg==", 2023-08-17T17:49:16.673 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.673 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:16.674 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:16.674 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.674 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.674 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.674 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.674 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-08-17T17:49:16.674 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA==", 2023-08-17T17:49:16.674 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.675 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:16.675 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-08-17T17:49:16.675 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T17:49:16.675 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.675 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.675 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.675 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-08-17T17:49:16.676 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ==", 2023-08-17T17:49:16.676 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.676 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:16.676 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:49:16.676 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:49:16.676 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:49:16.677 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.677 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.677 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.677 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-08-17T17:49:16.677 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ==", 2023-08-17T17:49:16.677 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.677 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:16.677 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:49:16.678 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:49:16.678 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:49:16.678 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.678 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.678 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.678 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-08-17T17:49:16.678 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw==", 2023-08-17T17:49:16.679 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.679 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:16.679 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:49:16.679 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:49:16.679 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:49:16.679 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.679 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.680 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.680 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-08-17T17:49:16.680 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k6n2yGhAAldYlBQaNGCgXL0HA2ePHVg==", 2023-08-17T17:49:16.680 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.680 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:49:16.680 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:49:16.680 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:49:16.681 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.681 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.681 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.681 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.681 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-08-17T17:49:16.681 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg==", 2023-08-17T17:49:16.681 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.682 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:49:16.682 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:49:16.682 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.682 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.682 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:16.682 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:16.682 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-08-17T17:49:16.683 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA==", 2023-08-17T17:49:16.683 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:16.683 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:49:16.683 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:49:16.683 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:16.683 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.683 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:16.684 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-08-17T17:49:16.684 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:49:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 -- 172.21.15.78:0/2938404588 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9c05ed90 msgr2=0x7faa9c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9c05ed90 0x7faa9c061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faaa4001ed0 tx=0x7faaa4015000).stop 2023-08-17T17:49:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 -- 172.21.15.78:0/2938404588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 msgr2=0x7faab00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 0x7faab00b0070 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7faaa0011f80 tx=0x7faaa000b040).stop 2023-08-17T17:49:16.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 -- 172.21.15.78:0/2938404588 shutdown_connections 2023-08-17T17:49:16.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faa9c05ed90 0x7faa9c061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab00c5040 0x7faab00ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:16.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa98003e10 0x7faab00b0070 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 --2- 172.21.15.78:0/2938404588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab00ade40 0x7faab00c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:16.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 -- 172.21.15.78:0/2938404588 >> 172.21.15.78:0/2938404588 conn(0x7faab0094510 msgr2=0x7faab00aa070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:16.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 -- 172.21.15.78:0/2938404588 shutdown_connections 2023-08-17T17:49:16.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.660+0000 7faab7793700 1 -- 172.21.15.78:0/2938404588 wait complete. 2023-08-17T17:49:16.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.800+0000 7fd6d0a79700 1 Processor -- start 2023-08-17T17:49:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.800+0000 7fd6d0a79700 1 -- start start 2023-08-17T17:49:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6d0a79700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6cc0c6ee0 0x7fd6cc0c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6d0a79700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc0c7350 con 0x7fd6cc0c0df0 2023-08-17T17:49:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6d0a79700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc0a8350 con 0x7fd6cc154140 2023-08-17T17:49:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6d0a79700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc0c1240 con 0x7fd6cc0c6ee0 2023-08-17T17:49:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6c1d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6cc0c6ee0 0x7fd6cc0c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6cad9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd6cc0c0df0 0x7fd6cc0ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58820/0 (socket says 172.21.15.78:58820) 2023-08-17T17:49:16.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6cad9d700 1 -- 172.21.15.78:0/1469910749 learned_addr learned my addr 172.21.15.78:0/1469910749 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:16.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6c1d9b700 1 -- 172.21.15.78:0/1469910749 >> v1:172.21.15.150:6789/0 conn(0x7fd6cc154140 legacy=0x7fd6cc0a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6c1d9b700 1 -- 172.21.15.78:0/1469910749 >> v1:172.21.15.78:6789/0 conn(0x7fd6cc0c0df0 legacy=0x7fd6cc0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6c9d9b700 1 -- 172.21.15.78:0/1469910749 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155742580 0 0) 0x7fd6cc0c7350 con 0x7fd6cc0c0df0 2023-08-17T17:49:16.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6c1d9b700 1 -- 172.21.15.78:0/1469910749 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc154520 con 0x7fd6cc0c6ee0 2023-08-17T17:49:16.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.801+0000 7fd6c1d9b700 1 --2- 172.21.15.78:0/1469910749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc0c6ee0 0x7fd6cc0c0900 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7fd6b4009760 tx=0x7fd6b4009060).ready entity=mon.0 client_cookie=824963b5b73f0426 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:16.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.802+0000 7fd6c9d9b700 1 -- 172.21.15.78:0/1469910749 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400b580 con 0x7fd6cc0c6ee0 2023-08-17T17:49:16.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.802+0000 7fd6c9d9b700 1 -- 172.21.15.78:0/1469910749 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b400b6e0 con 0x7fd6cc0c6ee0 2023-08-17T17:49:16.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.802+0000 7fd6c9d9b700 1 -- 172.21.15.78:0/1469910749 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400ba60 con 0x7fd6cc0c6ee0 2023-08-17T17:49:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.802+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1469910749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc0c6ee0 msgr2=0x7fd6cc0c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.802+0000 7fd6d0a79700 1 --2- 172.21.15.78:0/1469910749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc0c6ee0 0x7fd6cc0c0900 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7fd6b4009760 tx=0x7fd6b4009060).stop 2023-08-17T17:49:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.802+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1469910749 shutdown_connections 2023-08-17T17:49:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.802+0000 7fd6d0a79700 1 --2- 172.21.15.78:0/1469910749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc0c6ee0 0x7fd6cc0c0900 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.802+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1469910749 >> 172.21.15.78:0/1469910749 conn(0x7fd6cc094510 msgr2=0x7fd6cc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.802+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1469910749 shutdown_connections 2023-08-17T17:49:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.802+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1469910749 wait complete. 2023-08-17T17:49:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.803+0000 7fd6d0a79700 1 Processor -- start 2023-08-17T17:49:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.803+0000 7fd6d0a79700 1 -- start start 2023-08-17T17:49:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6d0a79700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0c0df0 0x7fd6cc14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6d0a79700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6cc0c6ee0 0x7fd6cc150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6d0a79700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc154140 0x7fd6cc14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6d0a79700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc150830 con 0x7fd6cc154140 2023-08-17T17:49:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6d0a79700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc14fc20 con 0x7fd6cc0c0df0 2023-08-17T17:49:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6d0a79700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc14ff00 con 0x7fd6cc0c6ee0 2023-08-17T17:49:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6cad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc154140 0x7fd6cc14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6cad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc154140 0x7fd6cc14f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42554/0 (socket says 172.21.15.78:42554) 2023-08-17T17:49:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6cad9d700 1 -- 172.21.15.78:0/1732697959 learned_addr learned my addr 172.21.15.78:0/1732697959 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6ca59c700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0c0df0 0x7fd6cc14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.804+0000 7fd6c1d9b700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6cc0c6ee0 0x7fd6cc150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6cad9d700 1 -- 172.21.15.78:0/1732697959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6cc0c6ee0 msgr2=0x7fd6cc150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6cad9d700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6cc0c6ee0 0x7fd6cc150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6cad9d700 1 -- 172.21.15.78:0/1732697959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0c0df0 msgr2=0x7fd6cc14cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6cad9d700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0c0df0 0x7fd6cc14cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6cad9d700 1 -- 172.21.15.78:0/1732697959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40092a0 con 0x7fd6cc154140 2023-08-17T17:49:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6cad9d700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc154140 0x7fd6cc14f2b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fd6c400c7e0 tx=0x7fd6c4007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6c2ffd700 1 -- 172.21.15.78:0/1732697959 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4005d30 con 0x7fd6cc154140 2023-08-17T17:49:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6c2ffd700 1 -- 172.21.15.78:0/1732697959 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4005e90 con 0x7fd6cc154140 2023-08-17T17:49:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6c2ffd700 1 -- 172.21.15.78:0/1732697959 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4007320 con 0x7fd6cc154140 2023-08-17T17:49:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1732697959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc1501e0 con 0x7fd6cc154140 2023-08-17T17:49:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.805+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1732697959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc14d160 con 0x7fd6cc154140 2023-08-17T17:49:16.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.806+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1732697959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc1509a0 con 0x7fd6cc154140 2023-08-17T17:49:16.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.806+0000 7fd6c2ffd700 1 -- 172.21.15.78:0/1732697959 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd6c4010030 con 0x7fd6cc154140 2023-08-17T17:49:16.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.807+0000 7fd6c2ffd700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd6ac05ed90 0x7fd6ac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:16.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.807+0000 7fd6c2ffd700 1 -- 172.21.15.78:0/1732697959 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd6c40795b0 con 0x7fd6cc154140 2023-08-17T17:49:16.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.807+0000 7fd6ca59c700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd6ac05ed90 0x7fd6ac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:16.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.807+0000 7fd6ca59c700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd6ac05ed90 0x7fd6ac061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd6bc003860 tx=0x7fd6bc007d40).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:16.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.811+0000 7fd6c2ffd700 1 -- 172.21.15.78:0/1732697959 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd6c404aef0 con 0x7fd6cc154140 2023-08-17T17:49:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.976+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1732697959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6cc047350 con 0x7fd6cc154140 2023-08-17T17:49:16.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.977+0000 7fd6c2ffd700 1 -- 172.21.15.78:0/1732697959 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+13760 (secure 0 0 0) 0x7fd6c404e510 con 0x7fd6cc154140 2023-08-17T17:49:16.977 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:16.977 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":73,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:16.284605+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1732697959 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd6ac05ed90 msgr2=0x7fd6ac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd6ac05ed90 0x7fd6ac061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd6bc003860 tx=0x7fd6bc007d40).stop 2023-08-17T17:49:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1732697959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc154140 msgr2=0x7fd6cc14f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc154140 0x7fd6cc14f2b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fd6c400c7e0 tx=0x7fd6c4007f90).stop 2023-08-17T17:49:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1732697959 shutdown_connections 2023-08-17T17:49:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd6ac05ed90 0x7fd6ac061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6cc154140 0x7fd6cc14f2b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6cc0c0df0 0x7fd6cc14cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 --2- 172.21.15.78:0/1732697959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6cc0c6ee0 0x7fd6cc150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1732697959 >> 172.21.15.78:0/1732697959 conn(0x7fd6cc094510 msgr2=0x7fd6cc0a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1732697959 shutdown_connections 2023-08-17T17:49:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:16.979+0000 7fd6d0a79700 1 -- 172.21.15.78:0/1732697959 wait complete. 2023-08-17T17:49:16.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T17:49:16.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:49:17.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.107+0000 7f501c302700 1 Processor -- start 2023-08-17T17:49:17.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.107+0000 7f501c302700 1 -- start start 2023-08-17T17:49:17.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.108+0000 7f501c302700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50140aa0f0 0x7f50140644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.108+0000 7f501c302700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50140aa4d0 0x7f50140c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.108+0000 7f501c302700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50140649b0 con 0x7f50140c5810 2023-08-17T17:49:17.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.108+0000 7f501c302700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5014063420 con 0x7f50140aa0f0 2023-08-17T17:49:17.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.108+0000 7f501c302700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5014063700 con 0x7f50140aa4d0 2023-08-17T17:49:17.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.108+0000 7f501a09e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50140aa0f0 0x7f50140644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.108+0000 7f501a89f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f50140c5810 0x7f50140c5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58832/0 (socket says 172.21.15.78:58832) 2023-08-17T17:49:17.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.108+0000 7f501a89f700 1 -- 172.21.15.78:0/2632845788 learned_addr learned my addr 172.21.15.78:0/2632845788 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:17.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.108+0000 7f501989d700 1 --2- 172.21.15.78:0/2632845788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50140aa4d0 0x7f50140c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.108+0000 7f501a09e700 1 -- 172.21.15.78:0/2632845788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50140aa4d0 msgr2=0x7f50140c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:17.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501a09e700 1 --2- 172.21.15.78:0/2632845788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50140aa4d0 0x7f50140c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501a09e700 1 -- 172.21.15.78:0/2632845788 >> v1:172.21.15.78:6789/0 conn(0x7f50140c5810 legacy=0x7f50140c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501909c700 1 -- 172.21.15.78:0/2632845788 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471629174 0 0) 0x7f50140649b0 con 0x7f50140c5810 2023-08-17T17:49:17.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501a09e700 1 -- 172.21.15.78:0/2632845788 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50140639e0 con 0x7f50140aa0f0 2023-08-17T17:49:17.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501a09e700 1 --2- 172.21.15.78:0/2632845788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa0f0 0x7f50140644c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f5010009760 tx=0x7f5010009060).ready entity=mon.0 client_cookie=64f9a02ded21871e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:17.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501909c700 1 -- 172.21.15.78:0/2632845788 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501000b580 con 0x7f50140aa0f0 2023-08-17T17:49:17.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501909c700 1 -- 172.21.15.78:0/2632845788 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501000b6e0 con 0x7f50140aa0f0 2023-08-17T17:49:17.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501909c700 1 -- 172.21.15.78:0/2632845788 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501000ba60 con 0x7f50140aa0f0 2023-08-17T17:49:17.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501c302700 1 -- 172.21.15.78:0/2632845788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa0f0 msgr2=0x7f50140644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501c302700 1 --2- 172.21.15.78:0/2632845788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa0f0 0x7f50140644c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f5010009760 tx=0x7f5010009060).stop 2023-08-17T17:49:17.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501c302700 1 -- 172.21.15.78:0/2632845788 shutdown_connections 2023-08-17T17:49:17.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501c302700 1 --2- 172.21.15.78:0/2632845788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa0f0 0x7f50140644c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501c302700 1 --2- 172.21.15.78:0/2632845788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50140aa4d0 0x7f50140c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501c302700 1 -- 172.21.15.78:0/2632845788 >> 172.21.15.78:0/2632845788 conn(0x7f501406a6a0 msgr2=0x7f50140caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:17.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501c302700 1 -- 172.21.15.78:0/2632845788 shutdown_connections 2023-08-17T17:49:17.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.109+0000 7f501c302700 1 -- 172.21.15.78:0/2632845788 wait complete. 2023-08-17T17:49:17.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501c302700 1 Processor -- start 2023-08-17T17:49:17.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501c302700 1 -- start start 2023-08-17T17:49:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501c302700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50140aa0f0 0x7f50140ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501c302700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa4d0 0x7f5014145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501c302700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50140c5810 0x7f50140acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501c302700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50140ab440 con 0x7f50140aa4d0 2023-08-17T17:49:17.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501c302700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50141460d0 con 0x7f50140c5810 2023-08-17T17:49:17.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501c302700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50140ad100 con 0x7f50140aa0f0 2023-08-17T17:49:17.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501989d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa4d0 0x7f5014145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501989d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa4d0 0x7f5014145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42578/0 (socket says 172.21.15.78:42578) 2023-08-17T17:49:17.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.111+0000 7f501989d700 1 -- 172.21.15.78:0/854578702 learned_addr learned my addr 172.21.15.78:0/854578702 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:17.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f501989d700 1 -- 172.21.15.78:0/854578702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50140aa0f0 msgr2=0x7f50140ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f501989d700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50140aa0f0 0x7f50140ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:17.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f501989d700 1 -- 172.21.15.78:0/854578702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50140c5810 msgr2=0x7f50140acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f501a89f700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50140c5810 0x7f50140acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f501989d700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50140c5810 0x7f50140acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f501989d700 1 -- 172.21.15.78:0/854578702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50100092a0 con 0x7f50140aa4d0 2023-08-17T17:49:17.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f501989d700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa4d0 0x7f5014145be0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f500400c850 tx=0x7f5004008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:17.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f500a7fc700 1 -- 172.21.15.78:0/854578702 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004010580 con 0x7f50140aa4d0 2023-08-17T17:49:17.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f500a7fc700 1 -- 172.21.15.78:0/854578702 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50040106e0 con 0x7f50140aa4d0 2023-08-17T17:49:17.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f501c302700 1 -- 172.21.15.78:0/854578702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50140aab30 con 0x7f50140aa4d0 2023-08-17T17:49:17.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f500a7fc700 1 -- 172.21.15.78:0/854578702 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004010a60 con 0x7f50140aa4d0 2023-08-17T17:49:17.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.112+0000 7f501c302700 1 -- 172.21.15.78:0/854578702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50140ab0d0 con 0x7f50140aa4d0 2023-08-17T17:49:17.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.113+0000 7f501c302700 1 -- 172.21.15.78:0/854578702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5014083980 con 0x7f50140aa4d0 2023-08-17T17:49:17.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.113+0000 7f500a7fc700 1 -- 172.21.15.78:0/854578702 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f500401b460 con 0x7f50140aa4d0 2023-08-17T17:49:17.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.114+0000 7f500a7fc700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ff805ed90 0x7f4ff8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.114+0000 7f500a7fc700 1 -- 172.21.15.78:0/854578702 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5004079880 con 0x7f50140aa4d0 2023-08-17T17:49:17.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.114+0000 7f501a09e700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ff805ed90 0x7f4ff8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.114+0000 7f501a09e700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ff805ed90 0x7f4ff8061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f501000b340 tx=0x7f5010017000).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:17.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.118+0000 7f500a7fc700 1 -- 172.21.15.78:0/854578702 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f500404b0f0 con 0x7f50140aa4d0 2023-08-17T17:49:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.279+0000 7f501c302700 1 -- 172.21.15.78:0/854578702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f50140ab580 con 0x7f50140aa4d0 2023-08-17T17:49:17.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.279+0000 7f500a7fc700 1 -- 172.21.15.78:0/854578702 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v73) v1 ==== 110+0+10 (secure 0 0 0) 0x7f500404e710 con 0x7f50140aa4d0 2023-08-17T17:49:17.280 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:49:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 -- 172.21.15.78:0/854578702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ff805ed90 msgr2=0x7f4ff8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ff805ed90 0x7f4ff8061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f501000b340 tx=0x7f5010017000).stop 2023-08-17T17:49:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 -- 172.21.15.78:0/854578702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa4d0 msgr2=0x7f5014145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa4d0 0x7f5014145be0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f500400c850 tx=0x7f5004008040).stop 2023-08-17T17:49:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 -- 172.21.15.78:0/854578702 shutdown_connections 2023-08-17T17:49:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ff805ed90 0x7f4ff8061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50140c5810 0x7f50140acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50140aa0f0 0x7f50140ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 --2- 172.21.15.78:0/854578702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50140aa4d0 0x7f5014145be0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 -- 172.21.15.78:0/854578702 >> 172.21.15.78:0/854578702 conn(0x7f501406a6a0 msgr2=0x7f5014151a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 -- 172.21.15.78:0/854578702 shutdown_connections 2023-08-17T17:49:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.281+0000 7f501c302700 1 -- 172.21.15.78:0/854578702 wait complete. 2023-08-17T17:49:17.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:49:17.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.409+0000 7f9575376700 1 Processor -- start 2023-08-17T17:49:17.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.409+0000 7f9575376700 1 -- start start 2023-08-17T17:49:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f9575376700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9570153ed0 0x7f95701542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f9575376700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957006a820 con 0x7f9570063d10 2023-08-17T17:49:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f9575376700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9570069c10 con 0x7f95700bc0d0 2023-08-17T17:49:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f9575376700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9570069ef0 con 0x7f9570153ed0 2023-08-17T17:49:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9570063d10 0x7f95700c18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58848/0 (socket says 172.21.15.78:58848) 2023-08-17T17:49:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956f7fe700 1 -- 172.21.15.78:0/1237394706 learned_addr learned my addr 172.21.15.78:0/1237394706 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956effd700 1 --2- 172.21.15.78:0/1237394706 >> v2:172.21.15.150:3300/0 conn(0x7f9570153ed0 0x7f95701542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833412136 0 0) 0x7f957006a820 con 0x7f9570063d10 2023-08-17T17:49:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95580033f0 con 0x7f9570063d10 2023-08-17T17:49:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1629877376 0 0) 0x7f95580033f0 con 0x7f9570063d10 2023-08-17T17:49:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 >> v2:172.21.15.150:3300/0 conn(0x7f9570153ed0 msgr2=0x7f95701542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 --2- 172.21.15.78:0/1237394706 >> v2:172.21.15.150:3300/0 conn(0x7f9570153ed0 0x7f95701542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 >> v1:172.21.15.150:6789/0 conn(0x7f95700bc0d0 legacy=0x7f9570063600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957006a1d0 con 0x7f9570063d10 2023-08-17T17:49:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f95680017f0 con 0x7f9570063d10 2023-08-17T17:49:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 >> v1:172.21.15.78:6789/0 conn(0x7f9570063d10 legacy=0x7f95700c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95580038e0 0x7f9558003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9558004690 0x7f9558004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9558005000 0x7f955800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570069ef0 con 0x7f95580038e0 2023-08-17T17:49:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955800beb0 con 0x7f9558004690 2023-08-17T17:49:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955800c070 con 0x7f9558005000 2023-08-17T17:49:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.410+0000 7f956effd700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95580038e0 0x7f9558003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956e7fc700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9558004690 0x7f9558004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956f7fe700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9558005000 0x7f955800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956effd700 1 -- 172.21.15.78:0/1237394706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9558005000 msgr2=0x7f955800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956effd700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9558005000 0x7f955800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956effd700 1 -- 172.21.15.78:0/1237394706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9558004690 msgr2=0x7f9558004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956effd700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9558004690 0x7f9558004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956effd700 1 -- 172.21.15.78:0/1237394706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95580033f0 con 0x7f95580038e0 2023-08-17T17:49:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956f7fe700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9558005000 0x7f955800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956e7fc700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9558004690 0x7f9558004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956f7fe700 1 -- 172.21.15.78:0/1237394706 reap_dead start 2023-08-17T17:49:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956effd700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95580038e0 0x7f9558003d00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f9560009a60 tx=0x7f9560009060).ready entity=mon.0 client_cookie=58a693715d9b14d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560009ea0 con 0x7f95580038e0 2023-08-17T17:49:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560009430 con 0x7f95580038e0 2023-08-17T17:49:17.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f956dffb700 1 -- 172.21.15.78:0/1237394706 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956000e870 con 0x7f95580038e0 2023-08-17T17:49:17.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f9575376700 1 -- 172.21.15.78:0/1237394706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95580038e0 msgr2=0x7f9558003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f9575376700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95580038e0 0x7f9558003d00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f9560009a60 tx=0x7f9560009060).stop 2023-08-17T17:49:17.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f9575376700 1 -- 172.21.15.78:0/1237394706 shutdown_connections 2023-08-17T17:49:17.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f9575376700 1 --2- 172.21.15.78:0/1237394706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95580038e0 0x7f9558003d00 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.411+0000 7f9575376700 1 -- 172.21.15.78:0/1237394706 >> 172.21.15.78:0/1237394706 conn(0x7f95700c3c10 msgr2=0x7f95700c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:17.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.412+0000 7f9575376700 1 -- 172.21.15.78:0/1237394706 shutdown_connections 2023-08-17T17:49:17.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.412+0000 7f9575376700 1 -- 172.21.15.78:0/1237394706 wait complete. 2023-08-17T17:49:17.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.413+0000 7f9575376700 1 Processor -- start 2023-08-17T17:49:17.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.413+0000 7f9575376700 1 -- start start 2023-08-17T17:49:17.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.413+0000 7f9575376700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95580038e0 0x7f957014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.413+0000 7f9575376700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9570136940 0x7f9570062770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.413+0000 7f9575376700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9570136dc0 0x7f9570062c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f9575376700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570136710 con 0x7f9570136940 2023-08-17T17:49:17.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f9575376700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570063150 con 0x7f9570136dc0 2023-08-17T17:49:17.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f9575376700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95700bf3b0 con 0x7f95580038e0 2023-08-17T17:49:17.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9570136940 0x7f9570062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9570136940 0x7f9570062770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42600/0 (socket says 172.21.15.78:42600) 2023-08-17T17:49:17.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956e7fc700 1 -- 172.21.15.78:0/2524321038 learned_addr learned my addr 172.21.15.78:0/2524321038 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:17.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956effd700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95580038e0 0x7f957014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956f7fe700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9570136dc0 0x7f9570062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956e7fc700 1 -- 172.21.15.78:0/2524321038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95580038e0 msgr2=0x7f957014fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956e7fc700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95580038e0 0x7f957014fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956e7fc700 1 -- 172.21.15.78:0/2524321038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9570136dc0 msgr2=0x7f9570062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956e7fc700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9570136dc0 0x7f9570062c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956e7fc700 1 -- 172.21.15.78:0/2524321038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95700c0660 con 0x7f9570136940 2023-08-17T17:49:17.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956effd700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95580038e0 0x7f957014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:17.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f956e7fc700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9570136940 0x7f9570062770 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f956400e510 tx=0x7f9564009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:17.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f9556ffd700 1 -- 172.21.15.78:0/2524321038 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564010450 con 0x7f9570136940 2023-08-17T17:49:17.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f9556ffd700 1 -- 172.21.15.78:0/2524321038 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95640105b0 con 0x7f9570136940 2023-08-17T17:49:17.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f9575376700 1 -- 172.21.15.78:0/2524321038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95700c0050 con 0x7f9570136940 2023-08-17T17:49:17.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f9556ffd700 1 -- 172.21.15.78:0/2524321038 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564010930 con 0x7f9570136940 2023-08-17T17:49:17.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.414+0000 7f9575376700 1 -- 172.21.15.78:0/2524321038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95700c02f0 con 0x7f9570136940 2023-08-17T17:49:17.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.415+0000 7f9575376700 1 -- 172.21.15.78:0/2524321038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95700c07f0 con 0x7f9570136940 2023-08-17T17:49:17.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.415+0000 7f9556ffd700 1 -- 172.21.15.78:0/2524321038 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9564010d20 con 0x7f9570136940 2023-08-17T17:49:17.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.416+0000 7f9556ffd700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f955c05ed60 0x7f955c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.416+0000 7f9556ffd700 1 -- 172.21.15.78:0/2524321038 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9564079970 con 0x7f9570136940 2023-08-17T17:49:17.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.416+0000 7f956effd700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f955c05ed60 0x7f955c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.416+0000 7f956effd700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f955c05ed60 0x7f955c061220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9560006d50 tx=0x7f956001a000).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:17.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.420+0000 7f9556ffd700 1 -- 172.21.15.78:0/2524321038 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f956404b260 con 0x7f9570136940 2023-08-17T17:49:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.586+0000 7f9575376700 1 -- 172.21.15.78:0/2524321038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f957005f910 con 0x7f9570136940 2023-08-17T17:49:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.586+0000 7f9556ffd700 1 -- 172.21.15.78:0/2524321038 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7f956404e880 con 0x7f9570136940 2023-08-17T17:49:17.586 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:49:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 -- 172.21.15.78:0/2524321038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f955c05ed60 msgr2=0x7f955c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f955c05ed60 0x7f955c061220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9560006d50 tx=0x7f956001a000).stop 2023-08-17T17:49:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 -- 172.21.15.78:0/2524321038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9570136940 msgr2=0x7f9570062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9570136940 0x7f9570062770 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f956400e510 tx=0x7f9564009040).stop 2023-08-17T17:49:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 -- 172.21.15.78:0/2524321038 shutdown_connections 2023-08-17T17:49:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f955c05ed60 0x7f955c061220 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9570136dc0 0x7f9570062c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95580038e0 0x7f957014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 --2- 172.21.15.78:0/2524321038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9570136940 0x7f9570062770 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 -- 172.21.15.78:0/2524321038 >> 172.21.15.78:0/2524321038 conn(0x7f95700c3c10 msgr2=0x7f9570151990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 -- 172.21.15.78:0/2524321038 shutdown_connections 2023-08-17T17:49:17.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.588+0000 7f9575376700 1 -- 172.21.15.78:0/2524321038 wait complete. 2023-08-17T17:49:17.600 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T17:49:17.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.712+0000 7f3feb865700 1 Processor -- start 2023-08-17T17:49:17.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.713+0000 7f3feb865700 1 -- start start 2023-08-17T17:49:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3feb865700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fe4151e40 0x7f3fe4152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3feb865700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3fe40a7c90 0x7f3fe40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3feb865700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40bf210 con 0x7f3fe40be4d0 2023-08-17T17:49:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3feb865700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe40c5a80 con 0x7f3fe40a7c90 2023-08-17T17:49:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3feb865700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe40c5450 con 0x7f3fe4151e40 2023-08-17T17:49:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fe8e00700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3fe40a7c90 0x7f3fe40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fe8e00700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3fe40a7c90 0x7f3fe40c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42614/0 (socket says 172.21.15.78:42614) 2023-08-17T17:49:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fe8e00700 1 -- 172.21.15.78:0/16845355 learned_addr learned my addr 172.21.15.78:0/16845355 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fe9601700 1 --2- 172.21.15.78:0/16845355 >> v2:172.21.15.150:3300/0 conn(0x7f3fe4151e40 0x7f3fe4152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fe8e00700 1 -- 172.21.15.78:0/16845355 >> v2:172.21.15.150:3300/0 conn(0x7f3fe4151e40 msgr2=0x7f3fe4152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fe8e00700 1 --2- 172.21.15.78:0/16845355 >> v2:172.21.15.150:3300/0 conn(0x7f3fe4151e40 0x7f3fe4152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fe8e00700 1 -- 172.21.15.78:0/16845355 >> v1:172.21.15.150:6789/0 conn(0x7f3fe40be4d0 legacy=0x7f3fe40be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fe8e00700 1 -- 172.21.15.78:0/16845355 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe41533f0 con 0x7f3fe40a7c90 2023-08-17T17:49:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fe9601700 1 --2- 172.21.15.78:0/16845355 >> v2:172.21.15.150:3300/0 conn(0x7f3fe4151e40 0x7f3fe4152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fe8e00700 1 --2- 172.21.15.78:0/16845355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe40a7c90 0x7f3fe40c5f10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f3fe40685c0 tx=0x7f3fd40090f0).ready entity=mon.0 client_cookie=c66f5cd458b42a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fdbfff700 1 -- 172.21.15.78:0/16845355 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400b5a0 con 0x7f3fe40a7c90 2023-08-17T17:49:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fdbfff700 1 -- 172.21.15.78:0/16845355 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd400b700 con 0x7f3fe40a7c90 2023-08-17T17:49:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.714+0000 7f3fdbfff700 1 -- 172.21.15.78:0/16845355 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400ba80 con 0x7f3fe40a7c90 2023-08-17T17:49:17.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.715+0000 7f3feb865700 1 -- 172.21.15.78:0/16845355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe40a7c90 msgr2=0x7f3fe40c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.715+0000 7f3feb865700 1 --2- 172.21.15.78:0/16845355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe40a7c90 0x7f3fe40c5f10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f3fe40685c0 tx=0x7f3fd40090f0).stop 2023-08-17T17:49:17.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.715+0000 7f3feb865700 1 -- 172.21.15.78:0/16845355 shutdown_connections 2023-08-17T17:49:17.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.715+0000 7f3feb865700 1 --2- 172.21.15.78:0/16845355 >> v2:172.21.15.150:3300/0 conn(0x7f3fe4151e40 0x7f3fe4152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.715+0000 7f3feb865700 1 --2- 172.21.15.78:0/16845355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe40a7c90 0x7f3fe40c5f10 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.715+0000 7f3feb865700 1 -- 172.21.15.78:0/16845355 >> 172.21.15.78:0/16845355 conn(0x7f3fe4092330 msgr2=0x7f3fe4062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:17.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.715+0000 7f3feb865700 1 -- 172.21.15.78:0/16845355 shutdown_connections 2023-08-17T17:49:17.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.715+0000 7f3feb865700 1 -- 172.21.15.78:0/16845355 wait complete. 2023-08-17T17:49:17.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.716+0000 7f3feb865700 1 Processor -- start 2023-08-17T17:49:17.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.716+0000 7f3feb865700 1 -- start start 2023-08-17T17:49:17.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.717+0000 7f3feb865700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe40a7c90 0x7f3fe414dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.717+0000 7f3feb865700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fe40be4d0 0x7f3fe4141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.717+0000 7f3feb865700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe4151e40 0x7f3fe40a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.717+0000 7f3feb865700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c2830 con 0x7f3fe4151e40 2023-08-17T17:49:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.717+0000 7f3feb865700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c1c20 con 0x7f3fe40a7c90 2023-08-17T17:49:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.717+0000 7f3feb865700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c1f00 con 0x7f3fe40be4d0 2023-08-17T17:49:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.717+0000 7f3fe9e02700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe4151e40 0x7f3fe40a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.717+0000 7f3fe9e02700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe4151e40 0x7f3fe40a5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42628/0 (socket says 172.21.15.78:42628) 2023-08-17T17:49:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.717+0000 7f3fe9e02700 1 -- 172.21.15.78:0/2440957467 learned_addr learned my addr 172.21.15.78:0/2440957467 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fe9601700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe40a7c90 0x7f3fe414dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fe8e00700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fe40be4d0 0x7f3fe4141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fe9e02700 1 -- 172.21.15.78:0/2440957467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fe40be4d0 msgr2=0x7f3fe4141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fe9e02700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fe40be4d0 0x7f3fe4141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fe9e02700 1 -- 172.21.15.78:0/2440957467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe40a7c90 msgr2=0x7f3fe414dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fe9e02700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe40a7c90 0x7f3fe414dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fe9e02700 1 -- 172.21.15.78:0/2440957467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd4009370 con 0x7f3fe4151e40 2023-08-17T17:49:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fe9601700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe40a7c90 0x7f3fe414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fe9e02700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe4151e40 0x7f3fe40a5a60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f3fdc00c490 tx=0x7f3fdc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2440957467 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc002ea0 con 0x7f3fe4151e40 2023-08-17T17:49:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2440957467 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc00f470 con 0x7f3fe4151e40 2023-08-17T17:49:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3feb865700 1 -- 172.21.15.78:0/2440957467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe40c21e0 con 0x7f3fe4151e40 2023-08-17T17:49:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2440957467 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc00f810 con 0x7f3fe4151e40 2023-08-17T17:49:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.718+0000 7f3feb865700 1 -- 172.21.15.78:0/2440957467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe414e1e0 con 0x7f3fe4151e40 2023-08-17T17:49:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.719+0000 7f3feb865700 1 -- 172.21.15.78:0/2440957467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe40c2bc0 con 0x7f3fe4151e40 2023-08-17T17:49:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.719+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2440957467 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3fdc010070 con 0x7f3fe4151e40 2023-08-17T17:49:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.719+0000 7f3fd97fa700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 0x7f3fc8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.719+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2440957467 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3fdc078b70 con 0x7f3fe4151e40 2023-08-17T17:49:17.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.720+0000 7f3fe9601700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 0x7f3fc8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:17.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.720+0000 7f3fe9601700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 0x7f3fc8061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3fe000d4a0 tx=0x7f3fe00075d0).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:17.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.723+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2440957467 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fdc0478f0 con 0x7f3fe4151e40 2023-08-17T17:49:17.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.887+0000 7f3feb865700 1 -- 172.21.15.78:0/2440957467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3fe40a8190 con 0x7f3fe4151e40 2023-08-17T17:49:17.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.887+0000 7f3fd97fa700 1 -- 172.21.15.78:0/2440957467 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3fe40c2bc0 con 0x7f3fe4151e40 2023-08-17T17:49:17.888 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:17.888 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:49:17.888 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:17.889 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T17:49:17.889 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T17:49:17.889 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:17.889 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:17.889 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T17:49:17.889 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T17:49:17.889 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:17.889 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:49:17.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 -- 172.21.15.78:0/2440957467 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 msgr2=0x7f3fc8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 0x7f3fc8061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3fe000d4a0 tx=0x7f3fe00075d0).stop 2023-08-17T17:49:17.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 -- 172.21.15.78:0/2440957467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe4151e40 msgr2=0x7f3fe40a5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:17.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe4151e40 0x7f3fe40a5a60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f3fdc00c490 tx=0x7f3fdc007de0).stop 2023-08-17T17:49:17.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 -- 172.21.15.78:0/2440957467 shutdown_connections 2023-08-17T17:49:17.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3fc805ed90 0x7f3fc8061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe4151e40 0x7f3fe40a5a60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fe40a7c90 0x7f3fe414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 --2- 172.21.15.78:0/2440957467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fe40be4d0 0x7f3fe4141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:17.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 -- 172.21.15.78:0/2440957467 >> 172.21.15.78:0/2440957467 conn(0x7f3fe4092330 msgr2=0x7f3fe4150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:17.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 -- 172.21.15.78:0/2440957467 shutdown_connections 2023-08-17T17:49:17.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:17.890+0000 7f3feb865700 1 -- 172.21.15.78:0/2440957467 wait complete. 2023-08-17T17:49:17.902 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T17:49:17.902 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T17:49:18.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.021+0000 7fd092217700 1 Processor -- start 2023-08-17T17:49:18.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.021+0000 7fd092217700 1 -- start start 2023-08-17T17:49:18.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd092217700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd08c0aa0f0 0x7fd08c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:18.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd092217700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0649b0 con 0x7fd08c0c5810 2023-08-17T17:49:18.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd092217700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c063420 con 0x7fd08c0aa4d0 2023-08-17T17:49:18.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd092217700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c063700 con 0x7fd08c0aa0f0 2023-08-17T17:49:18.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd08b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd08c0aa0f0 0x7fd08c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:18.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd08bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd08c0c5810 0x7fd08c0a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58860/0 (socket says 172.21.15.78:58860) 2023-08-17T17:49:18.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd08bfff700 1 -- 172.21.15.78:0/2840075586 learned_addr learned my addr 172.21.15.78:0/2840075586 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:18.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd08b7fe700 1 -- 172.21.15.78:0/2840075586 >> v1:172.21.15.150:6789/0 conn(0x7fd08c0aa4d0 legacy=0x7fd08c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:18.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd08b7fe700 1 -- 172.21.15.78:0/2840075586 >> v1:172.21.15.78:6789/0 conn(0x7fd08c0c5810 legacy=0x7fd08c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd08a7fc700 1 -- 172.21.15.78:0/2840075586 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490373421 0 0) 0x7fd08c0649b0 con 0x7fd08c0c5810 2023-08-17T17:49:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.022+0000 7fd08b7fe700 1 -- 172.21.15.78:0/2840075586 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0639e0 con 0x7fd08c0aa0f0 2023-08-17T17:49:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd08b7fe700 1 --2- 172.21.15.78:0/2840075586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0aa0f0 0x7fd08c0644c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fd07c009e60 tx=0x7fd07c009780).ready entity=mon.0 client_cookie=57c9d895aa2ebe1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd08a7fc700 1 -- 172.21.15.78:0/2840075586 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c00e070 con 0x7fd08c0aa0f0 2023-08-17T17:49:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd08a7fc700 1 -- 172.21.15.78:0/2840075586 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c00bbf0 con 0x7fd08c0aa0f0 2023-08-17T17:49:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd08a7fc700 1 -- 172.21.15.78:0/2840075586 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c012410 con 0x7fd08c0aa0f0 2023-08-17T17:49:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd092217700 1 -- 172.21.15.78:0/2840075586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0aa0f0 msgr2=0x7fd08c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd092217700 1 --2- 172.21.15.78:0/2840075586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0aa0f0 0x7fd08c0644c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fd07c009e60 tx=0x7fd07c009780).stop 2023-08-17T17:49:18.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd092217700 1 -- 172.21.15.78:0/2840075586 shutdown_connections 2023-08-17T17:49:18.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd092217700 1 --2- 172.21.15.78:0/2840075586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0aa0f0 0x7fd08c0644c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:18.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd092217700 1 -- 172.21.15.78:0/2840075586 >> 172.21.15.78:0/2840075586 conn(0x7fd08c06a6a0 msgr2=0x7fd08c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:18.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd092217700 1 -- 172.21.15.78:0/2840075586 shutdown_connections 2023-08-17T17:49:18.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.023+0000 7fd092217700 1 -- 172.21.15.78:0/2840075586 wait complete. 2023-08-17T17:49:18.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.024+0000 7fd092217700 1 Processor -- start 2023-08-17T17:49:18.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.024+0000 7fd092217700 1 -- start start 2023-08-17T17:49:18.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd092217700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08c0aa0f0 0x7fd08c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:18.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd092217700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08c0aa4d0 0x7fd08c0c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd092217700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0c5810 0x7fd08c0ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd092217700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0acff0 con 0x7fd08c0c5810 2023-08-17T17:49:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd092217700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0c1bd0 con 0x7fd08c0aa4d0 2023-08-17T17:49:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd092217700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0c1eb0 con 0x7fd08c0aa0f0 2023-08-17T17:49:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd08bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0c5810 0x7fd08c0ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd08bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0c5810 0x7fd08c0ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42646/0 (socket says 172.21.15.78:42646) 2023-08-17T17:49:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd08bfff700 1 -- 172.21.15.78:0/323226223 learned_addr learned my addr 172.21.15.78:0/323226223 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd08b7fe700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08c0aa0f0 0x7fd08c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.025+0000 7fd08affd700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08c0aa4d0 0x7fd08c0c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd08bfff700 1 -- 172.21.15.78:0/323226223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08c0aa0f0 msgr2=0x7fd08c145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd08bfff700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08c0aa0f0 0x7fd08c145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd08bfff700 1 -- 172.21.15.78:0/323226223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08c0aa4d0 msgr2=0x7fd08c0c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd08bfff700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08c0aa4d0 0x7fd08c0c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd08bfff700 1 -- 172.21.15.78:0/323226223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c009a20 con 0x7fd08c0c5810 2023-08-17T17:49:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd08affd700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08c0aa4d0 0x7fd08c0c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd08bfff700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0c5810 0x7fd08c0ac4f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fd08400c460 tx=0x7fd084007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd0737fe700 1 -- 172.21.15.78:0/323226223 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0840072e0 con 0x7fd08c0c5810 2023-08-17T17:49:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd0737fe700 1 -- 172.21.15.78:0/323226223 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd084007440 con 0x7fd08c0c5810 2023-08-17T17:49:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd092217700 1 -- 172.21.15.78:0/323226223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c0c2190 con 0x7fd08c0c5810 2023-08-17T17:49:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd0737fe700 1 -- 172.21.15.78:0/323226223 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0840057a0 con 0x7fd08c0c5810 2023-08-17T17:49:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.026+0000 7fd092217700 1 -- 172.21.15.78:0/323226223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c151150 con 0x7fd08c0c5810 2023-08-17T17:49:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.027+0000 7fd092217700 1 -- 172.21.15.78:0/323226223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c0c26b0 con 0x7fd08c0c5810 2023-08-17T17:49:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.027+0000 7fd0737fe700 1 -- 172.21.15.78:0/323226223 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd08401a060 con 0x7fd08c0c5810 2023-08-17T17:49:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.027+0000 7fd0737fe700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd07805ed90 0x7fd078061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.027+0000 7fd0737fe700 1 -- 172.21.15.78:0/323226223 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd084078f30 con 0x7fd08c0c5810 2023-08-17T17:49:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.028+0000 7fd08b7fe700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd07805ed90 0x7fd078061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.028+0000 7fd08b7fe700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd07805ed90 0x7fd078061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd07c00b9b0 tx=0x7fd07c009780).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.031+0000 7fd0737fe700 1 -- 172.21.15.78:0/323226223 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd08c0c26b0 con 0x7fd08c0c5810 2023-08-17T17:49:18.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.196+0000 7fd092217700 1 -- 172.21.15.78:0/323226223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fd08c0c26b0 con 0x7fd08c0c5810 2023-08-17T17:49:18.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.301+0000 7fd0737fe700 1 -- 172.21.15.78:0/323226223 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd08c0c26b0 con 0x7fd08c0c5810 2023-08-17T17:49:18.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.303+0000 7fd092217700 1 -- 172.21.15.78:0/323226223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd07805ed90 msgr2=0x7fd078061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.303+0000 7fd092217700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd07805ed90 0x7fd078061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd07c00b9b0 tx=0x7fd07c009780).stop 2023-08-17T17:49:18.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.303+0000 7fd092217700 1 -- 172.21.15.78:0/323226223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0c5810 msgr2=0x7fd08c0ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.303+0000 7fd092217700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0c5810 0x7fd08c0ac4f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fd08400c460 tx=0x7fd084007e10).stop 2023-08-17T17:49:18.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.303+0000 7fd092217700 1 -- 172.21.15.78:0/323226223 shutdown_connections 2023-08-17T17:49:18.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.303+0000 7fd092217700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd07805ed90 0x7fd078061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:18.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.303+0000 7fd092217700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd08c0c5810 0x7fd08c0ac4f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:18.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.303+0000 7fd092217700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08c0aa0f0 0x7fd08c145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:18.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.303+0000 7fd092217700 1 --2- 172.21.15.78:0/323226223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08c0aa4d0 0x7fd08c0c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:18.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.303+0000 7fd092217700 1 -- 172.21.15.78:0/323226223 >> 172.21.15.78:0/323226223 conn(0x7fd08c06a6a0 msgr2=0x7fd08c0a87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:18.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.304+0000 7fd092217700 1 -- 172.21.15.78:0/323226223 shutdown_connections 2023-08-17T17:49:18.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.304+0000 7fd092217700 1 -- 172.21.15.78:0/323226223 wait complete. 2023-08-17T17:49:18.306 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T17:49:18.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T17:49:18.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.439+0000 7f0b9f3a5700 1 Processor -- start 2023-08-17T17:49:18.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.439+0000 7f0b9f3a5700 1 -- start start 2023-08-17T17:49:18.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9f3a5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0b980c7e10 0x7f0b980ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:18.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9f3a5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b980c6970 con 0x7f0b980c0f10 2023-08-17T17:49:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9f3a5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b980cac90 con 0x7f0b98154110 2023-08-17T17:49:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9f3a5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b980c6040 con 0x7f0b980c7e10 2023-08-17T17:49:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9d942700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0b980c7e10 0x7f0b980ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9c940700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0b980c0f10 0x7f0b980c9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58868/0 (socket says 172.21.15.78:58868) 2023-08-17T17:49:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9c940700 1 -- 172.21.15.78:0/3199860504 learned_addr learned my addr 172.21.15.78:0/3199860504 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9d942700 1 -- 172.21.15.78:0/3199860504 >> v1:172.21.15.150:6789/0 conn(0x7f0b98154110 legacy=0x7f0b980c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9d942700 1 -- 172.21.15.78:0/3199860504 >> v1:172.21.15.78:6789/0 conn(0x7f0b980c0f10 legacy=0x7f0b980c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b8ffff700 1 -- 172.21.15.78:0/3199860504 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150688381 0 0) 0x7f0b980c6970 con 0x7f0b980c0f10 2023-08-17T17:49:18.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9d942700 1 -- 172.21.15.78:0/3199860504 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b980c6320 con 0x7f0b980c7e10 2023-08-17T17:49:18.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.440+0000 7f0b9d942700 1 --2- 172.21.15.78:0/3199860504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 0x7f0b980ca650 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f0b90009e60 tx=0x7f0b90009780).ready entity=mon.0 client_cookie=c5fa739ce391dc4d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:18.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.441+0000 7f0b8ffff700 1 -- 172.21.15.78:0/3199860504 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9000e070 con 0x7f0b980c7e10 2023-08-17T17:49:18.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.441+0000 7f0b8ffff700 1 -- 172.21.15.78:0/3199860504 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9000bc30 con 0x7f0b980c7e10 2023-08-17T17:49:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.441+0000 7f0b8ffff700 1 -- 172.21.15.78:0/3199860504 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90012410 con 0x7f0b980c7e10 2023-08-17T17:49:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.441+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/3199860504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 msgr2=0x7f0b980ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.441+0000 7f0b9f3a5700 1 --2- 172.21.15.78:0/3199860504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 0x7f0b980ca650 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f0b90009e60 tx=0x7f0b90009780).stop 2023-08-17T17:49:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.441+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/3199860504 shutdown_connections 2023-08-17T17:49:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.441+0000 7f0b9f3a5700 1 --2- 172.21.15.78:0/3199860504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 0x7f0b980ca650 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.441+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/3199860504 >> 172.21.15.78:0/3199860504 conn(0x7f0b98094650 msgr2=0x7f0b9806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.441+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/3199860504 shutdown_connections 2023-08-17T17:49:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.441+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/3199860504 wait complete. 2023-08-17T17:49:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.442+0000 7f0b9f3a5700 1 Processor -- start 2023-08-17T17:49:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.442+0000 7f0b9f3a5700 1 -- start start 2023-08-17T17:49:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9f3a5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b980c0f10 0x7f0b98148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9f3a5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 0x7f0b98095350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9f3a5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b98154110 0x7f0b980c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9f3a5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b98148640 con 0x7f0b980c7e10 2023-08-17T17:49:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9f3a5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b981422b0 con 0x7f0b98154110 2023-08-17T17:49:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9f3a5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b98150830 con 0x7f0b980c0f10 2023-08-17T17:49:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9c940700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 0x7f0b98095350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9c940700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 0x7f0b98095350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42662/0 (socket says 172.21.15.78:42662) 2023-08-17T17:49:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9c940700 1 -- 172.21.15.78:0/1128732232 learned_addr learned my addr 172.21.15.78:0/1128732232 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9d942700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b98154110 0x7f0b980c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.443+0000 7f0b9d141700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b980c0f10 0x7f0b98148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b9c940700 1 -- 172.21.15.78:0/1128732232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b980c0f10 msgr2=0x7f0b98148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b9c940700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b980c0f10 0x7f0b98148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b9c940700 1 -- 172.21.15.78:0/1128732232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b98154110 msgr2=0x7f0b980c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b9c940700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b98154110 0x7f0b980c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b9c940700 1 -- 172.21.15.78:0/1128732232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90009a20 con 0x7f0b980c7e10 2023-08-17T17:49:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b9d942700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b98154110 0x7f0b980c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b9c940700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 0x7f0b98095350 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f0b8800c4a0 tx=0x7f0b88007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b8d7fa700 1 -- 172.21.15.78:0/1128732232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880072e0 con 0x7f0b980c7e10 2023-08-17T17:49:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b8d7fa700 1 -- 172.21.15.78:0/1128732232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88007440 con 0x7f0b980c7e10 2023-08-17T17:49:18.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/1128732232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9814fc20 con 0x7f0b980c7e10 2023-08-17T17:49:18.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b8d7fa700 1 -- 172.21.15.78:0/1128732232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880057a0 con 0x7f0b980c7e10 2023-08-17T17:49:18.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.444+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/1128732232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b981501e0 con 0x7f0b980c7e10 2023-08-17T17:49:18.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.445+0000 7f0b8d7fa700 1 -- 172.21.15.78:0/1128732232 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0b8801a060 con 0x7f0b980c7e10 2023-08-17T17:49:18.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.445+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/1128732232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b98096e30 con 0x7f0b980c7e10 2023-08-17T17:49:18.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.446+0000 7f0b8d7fa700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b7c05ed90 0x7f0b7c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:18.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.446+0000 7f0b8d7fa700 1 -- 172.21.15.78:0/1128732232 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f0b88079000 con 0x7f0b980c7e10 2023-08-17T17:49:18.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.446+0000 7f0b9d141700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b7c05ed90 0x7f0b7c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:18.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.446+0000 7f0b9d141700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b7c05ed90 0x7f0b7c061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0b94003860 tx=0x7f0b94007d40).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:18.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.450+0000 7f0b8d7fa700 1 -- 172.21.15.78:0/1128732232 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b98096e30 con 0x7f0b980c7e10 2023-08-17T17:49:18.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:18.614+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/1128732232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0b98096e30 con 0x7f0b980c7e10 2023-08-17T17:49:19.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.308+0000 7f0b8d7fa700 1 -- 172.21.15.78:0/1128732232 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0b98096e30 con 0x7f0b980c7e10 2023-08-17T17:49:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.316+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/1128732232 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b7c05ed90 msgr2=0x7f0b7c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.316+0000 7f0b9f3a5700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b7c05ed90 0x7f0b7c061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0b94003860 tx=0x7f0b94007d40).stop 2023-08-17T17:49:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.316+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/1128732232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 msgr2=0x7f0b98095350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.316+0000 7f0b9f3a5700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 0x7f0b98095350 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f0b8800c4a0 tx=0x7f0b88007c30).stop 2023-08-17T17:49:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.317+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/1128732232 shutdown_connections 2023-08-17T17:49:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.317+0000 7f0b9f3a5700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b7c05ed90 0x7f0b7c061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.317+0000 7f0b9f3a5700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b98154110 0x7f0b980c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.317+0000 7f0b9f3a5700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b980c0f10 0x7f0b98148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.317+0000 7f0b9f3a5700 1 --2- 172.21.15.78:0/1128732232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b980c7e10 0x7f0b98095350 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.318+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/1128732232 >> 172.21.15.78:0/1128732232 conn(0x7f0b98094650 msgr2=0x7f0b98063190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.318+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/1128732232 shutdown_connections 2023-08-17T17:49:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.318+0000 7f0b9f3a5700 1 -- 172.21.15.78:0/1128732232 wait complete. 2023-08-17T17:49:19.323 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T17:49:19.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T17:49:19.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.457+0000 7f789684f700 1 Processor -- start 2023-08-17T17:49:19.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.457+0000 7f789684f700 1 -- start start 2023-08-17T17:49:19.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f789684f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f78900644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f789684f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78900649b0 con 0x7f78900c5810 2023-08-17T17:49:19.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f789684f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7890063420 con 0x7f78900aa4d0 2023-08-17T17:49:19.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f789684f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7890063700 con 0x7f78900aa0f0 2023-08-17T17:49:19.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f7894dec700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f78900c5810 0x7f78900a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34994/0 (socket says 172.21.15.78:34994) 2023-08-17T17:49:19.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f7894dec700 1 -- 172.21.15.78:0/1628675715 learned_addr learned my addr 172.21.15.78:0/1628675715 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:19.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788ffff700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f78900644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009055343 0 0) 0x7f78900649b0 con 0x7f78900c5810 2023-08-17T17:49:19.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78780033f0 con 0x7f78900c5810 2023-08-17T17:49:19.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4251434744 0 0) 0x7f78780033f0 con 0x7f78900c5810 2023-08-17T17:49:19.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 msgr2=0x7f78900644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:19.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f78900644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 >> v1:172.21.15.150:6789/0 conn(0x7f78900aa4d0 legacy=0x7f78900c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900639e0 con 0x7f78900c5810 2023-08-17T17:49:19.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f78880017f0 con 0x7f78900c5810 2023-08-17T17:49:19.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788ffff700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f78900644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:19.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 >> v1:172.21.15.78:6789/0 conn(0x7f78900c5810 legacy=0x7f78900a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7878003910 0x7f7878003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7878004690 0x7f7878004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f7878005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890063700 con 0x7f7878003910 2023-08-17T17:49:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787800b8e0 con 0x7f7878004690 2023-08-17T17:49:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787800baa0 con 0x7f78900aa0f0 2023-08-17T17:49:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.458+0000 7f788ffff700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7878003910 0x7f7878003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788f7fe700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7878004690 0x7f7878004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f7894dec700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f7878005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788ffff700 1 -- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 msgr2=0x7f7878005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788ffff700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f7878005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788ffff700 1 -- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7878004690 msgr2=0x7f7878004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788ffff700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7878004690 0x7f7878004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788ffff700 1 -- 172.21.15.78:0/1628675715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78840092a0 con 0x7f7878003910 2023-08-17T17:49:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788f7fe700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7878004690 0x7f7878004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788ffff700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7878003910 0x7f7878003d30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f7884009c70 tx=0x7f7884009060).ready entity=mon.0 client_cookie=90212729a0a1ede1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:19.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840095c0 con 0x7f7878003910 2023-08-17T17:49:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788400e690 con 0x7f7878003910 2023-08-17T17:49:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f788effd700 1 -- 172.21.15.78:0/1628675715 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400ea10 con 0x7f7878003910 2023-08-17T17:49:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f789684f700 1 -- 172.21.15.78:0/1628675715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7878003910 msgr2=0x7f7878003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f789684f700 1 --2- 172.21.15.78:0/1628675715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7878003910 0x7f7878003d30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f7884009c70 tx=0x7f7884009060).stop 2023-08-17T17:49:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.459+0000 7f7894dec700 1 -- 172.21.15.78:0/1628675715 reap_dead start 2023-08-17T17:49:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.460+0000 7f789684f700 1 -- 172.21.15.78:0/1628675715 shutdown_connections 2023-08-17T17:49:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.460+0000 7f789684f700 1 -- 172.21.15.78:0/1628675715 >> 172.21.15.78:0/1628675715 conn(0x7f789006a6a0 msgr2=0x7f78900caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:19.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.460+0000 7f789684f700 1 -- 172.21.15.78:0/1628675715 shutdown_connections 2023-08-17T17:49:19.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.460+0000 7f789684f700 1 -- 172.21.15.78:0/1628675715 wait complete. 2023-08-17T17:49:19.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.461+0000 7f789684f700 1 Processor -- start 2023-08-17T17:49:19.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.461+0000 7f789684f700 1 -- start start 2023-08-17T17:49:19.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.461+0000 7f789684f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7878003910 0x7f7890153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.461+0000 7f789684f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7890158c40 0x7f7890156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f789684f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78901572d0 0x7f78900982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f789684f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890153870 con 0x7f7890158c40 2023-08-17T17:49:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f789684f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900aba30 con 0x7f78901572d0 2023-08-17T17:49:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f789684f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7890157810 con 0x7f7878003910 2023-08-17T17:49:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7890158c40 0x7f7890156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7890158c40 0x7f7890156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56464/0 (socket says 172.21.15.78:56464) 2023-08-17T17:49:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788f7fe700 1 -- 172.21.15.78:0/1300890837 learned_addr learned my addr 172.21.15.78:0/1300890837 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f7894dec700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78901572d0 0x7f78900982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788ffff700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7878003910 0x7f7890153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788f7fe700 1 -- 172.21.15.78:0/1300890837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7878003910 msgr2=0x7f7890153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788f7fe700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7878003910 0x7f7890153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788f7fe700 1 -- 172.21.15.78:0/1300890837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78901572d0 msgr2=0x7f78900982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788f7fe700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78901572d0 0x7f78900982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788f7fe700 1 -- 172.21.15.78:0/1300890837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7890157af0 con 0x7f7890158c40 2023-08-17T17:49:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788ffff700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7878003910 0x7f7890153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f788f7fe700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7890158c40 0x7f7890156de0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f7880007900 tx=0x7f7880009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f7877fff700 1 -- 172.21.15.78:0/1300890837 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880010450 con 0x7f7890158c40 2023-08-17T17:49:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f7877fff700 1 -- 172.21.15.78:0/1300890837 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78800105b0 con 0x7f7890158c40 2023-08-17T17:49:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f7877fff700 1 -- 172.21.15.78:0/1300890837 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880010930 con 0x7f7890158c40 2023-08-17T17:49:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f789684f700 1 -- 172.21.15.78:0/1300890837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7890157dd0 con 0x7f7890158c40 2023-08-17T17:49:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.462+0000 7f789684f700 1 -- 172.21.15.78:0/1300890837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7890098790 con 0x7f7890158c40 2023-08-17T17:49:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.463+0000 7f789684f700 1 -- 172.21.15.78:0/1300890837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78900abc50 con 0x7f7890158c40 2023-08-17T17:49:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.463+0000 7f7877fff700 1 -- 172.21.15.78:0/1300890837 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7880010d60 con 0x7f7890158c40 2023-08-17T17:49:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.464+0000 7f7877fff700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787c05ed90 0x7f787c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.464+0000 7f7877fff700 1 -- 172.21.15.78:0/1300890837 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f7880079c00 con 0x7f7890158c40 2023-08-17T17:49:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.464+0000 7f788ffff700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787c05ed90 0x7f787c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.464+0000 7f788ffff700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787c05ed90 0x7f787c061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7884006d50 tx=0x7f788401a000).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.468+0000 7f7877fff700 1 -- 172.21.15.78:0/1300890837 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78900abc50 con 0x7f7890158c40 2023-08-17T17:49:19.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.672+0000 7f789684f700 1 -- 172.21.15.78:0/1300890837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7890083980 con 0x7f7890158c40 2023-08-17T17:49:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.678+0000 7f7877fff700 1 -- 172.21.15.78:0/1300890837 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v23) v1 ==== 173+0+0 (secure 0 0 0) 0x7f788007f020 con 0x7f7890158c40 2023-08-17T17:49:19.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.684+0000 7f789684f700 1 -- 172.21.15.78:0/1300890837 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787c05ed90 msgr2=0x7f787c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.684+0000 7f789684f700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787c05ed90 0x7f787c061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7884006d50 tx=0x7f788401a000).stop 2023-08-17T17:49:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.684+0000 7f789684f700 1 -- 172.21.15.78:0/1300890837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7890158c40 msgr2=0x7f7890156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.684+0000 7f789684f700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7890158c40 0x7f7890156de0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f7880007900 tx=0x7f7880009040).stop 2023-08-17T17:49:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.684+0000 7f789684f700 1 -- 172.21.15.78:0/1300890837 shutdown_connections 2023-08-17T17:49:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.684+0000 7f789684f700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787c05ed90 0x7f787c061250 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0x7f7884006d50 tx=0x7f788401a000).stop 2023-08-17T17:49:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.684+0000 7f789684f700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78901572d0 0x7f78900982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.684+0000 7f789684f700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7878003910 0x7f7890153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.684+0000 7f789684f700 1 --2- 172.21.15.78:0/1300890837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7890158c40 0x7f7890156de0 secure :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0x7f7880007900 tx=0x7f7880009040).stop 2023-08-17T17:49:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.684+0000 7f789684f700 1 -- 172.21.15.78:0/1300890837 >> 172.21.15.78:0/1300890837 conn(0x7f789006a6a0 msgr2=0x7f78900c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.687+0000 7f789684f700 1 -- 172.21.15.78:0/1300890837 shutdown_connections 2023-08-17T17:49:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.688+0000 7f789684f700 1 -- 172.21.15.78:0/1300890837 wait complete. 2023-08-17T17:49:19.691 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 9 and data pool 10 2023-08-17T17:49:19.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.821+0000 7fcbe9faa700 1 Processor -- start 2023-08-17T17:49:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.821+0000 7fcbe9faa700 1 -- start start 2023-08-17T17:49:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.821+0000 7fcbe9faa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcbe40c6ee0 0x7fcbe40c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.821+0000 7fcbe9faa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c0df0 0x7fcbe40ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.821+0000 7fcbe9faa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe40c7350 con 0x7fcbe4154140 2023-08-17T17:49:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.821+0000 7fcbe9faa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe40a8350 con 0x7fcbe40c6ee0 2023-08-17T17:49:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.821+0000 7fcbe9faa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40c1280 con 0x7fcbe40c0df0 2023-08-17T17:49:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbdaffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcbe40c6ee0 0x7fcbe40c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbdaffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcbe40c6ee0 0x7fcbe40c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56468/0 (socket says 172.21.15.78:56468) 2023-08-17T17:49:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbdaffd700 1 -- 172.21.15.78:0/23719722 learned_addr learned my addr 172.21.15.78:0/23719722 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbdaffd700 1 -- 172.21.15.78:0/23719722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c0df0 msgr2=0x7fcbe40ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbe3fff700 1 --2- 172.21.15.78:0/23719722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c0df0 0x7fcbe40ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbdaffd700 1 --2- 172.21.15.78:0/23719722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c0df0 0x7fcbe40ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbdaffd700 1 -- 172.21.15.78:0/23719722 >> v1:172.21.15.150:6789/0 conn(0x7fcbe4154140 legacy=0x7fcbe40a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbdaffd700 1 -- 172.21.15.78:0/23719722 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe4154520 con 0x7fcbe40c6ee0 2023-08-17T17:49:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbe3fff700 1 --2- 172.21.15.78:0/23719722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c0df0 0x7fcbe40ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbdaffd700 1 --2- 172.21.15.78:0/23719722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe40c6ee0 0x7fcbe40c0900 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fcbcc006fd0 tx=0x7fcbcc0090f0).ready entity=mon.0 client_cookie=c582afb8f7b5d190 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbe2ffd700 1 -- 172.21.15.78:0/23719722 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc00b600 con 0x7fcbe40c6ee0 2023-08-17T17:49:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbe2ffd700 1 -- 172.21.15.78:0/23719722 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc00b760 con 0x7fcbe40c6ee0 2023-08-17T17:49:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.822+0000 7fcbe2ffd700 1 -- 172.21.15.78:0/23719722 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc00bae0 con 0x7fcbe40c6ee0 2023-08-17T17:49:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.823+0000 7fcbe9faa700 1 -- 172.21.15.78:0/23719722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe40c6ee0 msgr2=0x7fcbe40c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.823+0000 7fcbe9faa700 1 --2- 172.21.15.78:0/23719722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe40c6ee0 0x7fcbe40c0900 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fcbcc006fd0 tx=0x7fcbcc0090f0).stop 2023-08-17T17:49:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.823+0000 7fcbe9faa700 1 -- 172.21.15.78:0/23719722 shutdown_connections 2023-08-17T17:49:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.823+0000 7fcbe9faa700 1 --2- 172.21.15.78:0/23719722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c0df0 0x7fcbe40ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.823+0000 7fcbe9faa700 1 --2- 172.21.15.78:0/23719722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe40c6ee0 0x7fcbe40c0900 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.823+0000 7fcbe9faa700 1 -- 172.21.15.78:0/23719722 >> 172.21.15.78:0/23719722 conn(0x7fcbe4094510 msgr2=0x7fcbe406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.823+0000 7fcbe9faa700 1 -- 172.21.15.78:0/23719722 shutdown_connections 2023-08-17T17:49:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.823+0000 7fcbe9faa700 1 -- 172.21.15.78:0/23719722 wait complete. 2023-08-17T17:49:19.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.824+0000 7fcbe9faa700 1 Processor -- start 2023-08-17T17:49:19.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.824+0000 7fcbe9faa700 1 -- start start 2023-08-17T17:49:19.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe9faa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbe40c0df0 0x7fcbe40c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe9faa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c6ee0 0x7fcbe414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe9faa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe4154140 0x7fcbe40aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe9faa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40642b0 con 0x7fcbe4154140 2023-08-17T17:49:19.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe9faa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40aede0 con 0x7fcbe40c0df0 2023-08-17T17:49:19.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe9faa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40c30c0 con 0x7fcbe40c6ee0 2023-08-17T17:49:19.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe4154140 0x7fcbe40aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe4154140 0x7fcbe40aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56482/0 (socket says 172.21.15.78:56482) 2023-08-17T17:49:19.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe3fff700 1 -- 172.21.15.78:0/1397055561 learned_addr learned my addr 172.21.15.78:0/1397055561 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:19.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe37fe700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbe40c0df0 0x7fcbe40c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbdaffd700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c6ee0 0x7fcbe414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe3fff700 1 -- 172.21.15.78:0/1397055561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c6ee0 msgr2=0x7fcbe414dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe3fff700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c6ee0 0x7fcbe414dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe3fff700 1 -- 172.21.15.78:0/1397055561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbe40c0df0 msgr2=0x7fcbe40c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe3fff700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbe40c0df0 0x7fcbe40c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe3fff700 1 -- 172.21.15.78:0/1397055561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc009370 con 0x7fcbe4154140 2023-08-17T17:49:19.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe3fff700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe4154140 0x7fcbe40aa970 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fcbdc00a380 tx=0x7fcbdc007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:19.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbdbfff700 1 -- 172.21.15.78:0/1397055561 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00ae60 con 0x7fcbe4154140 2023-08-17T17:49:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbdbfff700 1 -- 172.21.15.78:0/1397055561 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc016470 con 0x7fcbe4154140 2023-08-17T17:49:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe9faa700 1 -- 172.21.15.78:0/1397055561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe40aeb00 con 0x7fcbe4154140 2023-08-17T17:49:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbdbfff700 1 -- 172.21.15.78:0/1397055561 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0167f0 con 0x7fcbe4154140 2023-08-17T17:49:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.825+0000 7fcbe9faa700 1 -- 172.21.15.78:0/1397055561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe40c3660 con 0x7fcbe4154140 2023-08-17T17:49:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.826+0000 7fcbe9faa700 1 -- 172.21.15.78:0/1397055561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe4047350 con 0x7fcbe4154140 2023-08-17T17:49:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.827+0000 7fcbdbfff700 1 -- 172.21.15.78:0/1397055561 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcbdc00d440 con 0x7fcbe4154140 2023-08-17T17:49:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.827+0000 7fcbdbfff700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcbc405edc0 0x7fcbc4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.827+0000 7fcbdbfff700 1 -- 172.21.15.78:0/1397055561 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcbdc07a8d0 con 0x7fcbe4154140 2023-08-17T17:49:19.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.827+0000 7fcbe37fe700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcbc405edc0 0x7fcbc4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:19.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.828+0000 7fcbe37fe700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcbc405edc0 0x7fcbc4061280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fcbd400b9b0 tx=0x7fcbd4008040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:19.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.831+0000 7fcbdbfff700 1 -- 172.21.15.78:0/1397055561 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcbdc04bf20 con 0x7fcbe4154140 2023-08-17T17:49:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.993+0000 7fcbe9faa700 1 -- 172.21.15.78:0/1397055561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbe40c91e0 con 0x7fcbe4154140 2023-08-17T17:49:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.994+0000 7fcbdbfff700 1 -- 172.21.15.78:0/1397055561 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16991 (secure 0 0 0) 0x7fcbdc04f540 con 0x7fcbe4154140 2023-08-17T17:49:19.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:19.995 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":76,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:19.673442+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:18.219880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:18.637834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 -- 172.21.15.78:0/1397055561 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcbc405edc0 msgr2=0x7fcbc4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcbc405edc0 0x7fcbc4061280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fcbd400b9b0 tx=0x7fcbd4008040).stop 2023-08-17T17:49:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 -- 172.21.15.78:0/1397055561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe4154140 msgr2=0x7fcbe40aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe4154140 0x7fcbe40aa970 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fcbdc00a380 tx=0x7fcbdc007900).stop 2023-08-17T17:49:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 -- 172.21.15.78:0/1397055561 shutdown_connections 2023-08-17T17:49:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcbc405edc0 0x7fcbc4061280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe4154140 0x7fcbe40aa970 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbe40c0df0 0x7fcbe40c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 --2- 172.21.15.78:0/1397055561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbe40c6ee0 0x7fcbe414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 -- 172.21.15.78:0/1397055561 >> 172.21.15.78:0/1397055561 conn(0x7fcbe4094510 msgr2=0x7fcbe40a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 -- 172.21.15.78:0/1397055561 shutdown_connections 2023-08-17T17:49:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:19.996+0000 7fcbe9faa700 1 -- 172.21.15.78:0/1397055561 wait complete. 2023-08-17T17:49:20.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.123+0000 7ff2199d1700 1 Processor -- start 2023-08-17T17:49:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.123+0000 7ff2199d1700 1 -- start start 2023-08-17T17:49:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.123+0000 7ff2199d1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff214154140 0x7ff2140c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.123+0000 7ff2199d1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2140a7c40 0x7ff2140c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.123+0000 7ff2199d1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff2140a8080 0x7ff2140c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.123+0000 7ff2199d1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2140c12e0 con 0x7ff214154140 2023-08-17T17:49:20.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.123+0000 7ff2199d1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff214154520 con 0x7ff2140a8080 2023-08-17T17:49:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.123+0000 7ff2199d1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c91e0 con 0x7ff2140a7c40 2023-08-17T17:49:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff212ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff214154140 0x7ff2140c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff212ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff214154140 0x7ff2140c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56486/0 (socket says 172.21.15.78:56486) 2023-08-17T17:49:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff212ffd700 1 -- 172.21.15.78:0/439792889 learned_addr learned my addr 172.21.15.78:0/439792889 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff2137fe700 1 --2- 172.21.15.78:0/439792889 >> v2:172.21.15.150:3300/0 conn(0x7ff2140a8080 0x7ff2140c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff20a7fc700 1 --2- 172.21.15.78:0/439792889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2140a7c40 0x7ff2140c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff212ffd700 1 -- 172.21.15.78:0/439792889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2140a7c40 msgr2=0x7ff2140c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:20.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff212ffd700 1 --2- 172.21.15.78:0/439792889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2140a7c40 0x7ff2140c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff212ffd700 1 -- 172.21.15.78:0/439792889 >> v2:172.21.15.150:3300/0 conn(0x7ff2140a8080 msgr2=0x7ff2140c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:20.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff212ffd700 1 --2- 172.21.15.78:0/439792889 >> v2:172.21.15.150:3300/0 conn(0x7ff2140a8080 0x7ff2140c0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff212ffd700 1 -- 172.21.15.78:0/439792889 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140c94c0 con 0x7ff214154140 2023-08-17T17:49:20.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff2137fe700 1 --2- 172.21.15.78:0/439792889 >> v2:172.21.15.150:3300/0 conn(0x7ff2140a8080 0x7ff2140c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:20.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff212ffd700 1 --2- 172.21.15.78:0/439792889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 0x7ff2140c6ee0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7ff21406bd60 tx=0x7ff2040090f0).ready entity=mon.0 client_cookie=d88f7b61859ffd4f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:20.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff2127fc700 1 -- 172.21.15.78:0/439792889 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400b600 con 0x7ff214154140 2023-08-17T17:49:20.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff2127fc700 1 -- 172.21.15.78:0/439792889 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20400b760 con 0x7ff214154140 2023-08-17T17:49:20.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.124+0000 7ff2127fc700 1 -- 172.21.15.78:0/439792889 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400bae0 con 0x7ff214154140 2023-08-17T17:49:20.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.125+0000 7ff2199d1700 1 -- 172.21.15.78:0/439792889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 msgr2=0x7ff2140c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.125+0000 7ff2199d1700 1 --2- 172.21.15.78:0/439792889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 0x7ff2140c6ee0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7ff21406bd60 tx=0x7ff2040090f0).stop 2023-08-17T17:49:20.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.125+0000 7ff2199d1700 1 -- 172.21.15.78:0/439792889 shutdown_connections 2023-08-17T17:49:20.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.125+0000 7ff2199d1700 1 --2- 172.21.15.78:0/439792889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 0x7ff2140c6ee0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.125+0000 7ff2199d1700 1 --2- 172.21.15.78:0/439792889 >> v2:172.21.15.150:3300/0 conn(0x7ff2140a8080 0x7ff2140c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.125+0000 7ff2199d1700 1 --2- 172.21.15.78:0/439792889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2140a7c40 0x7ff2140c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.125+0000 7ff2199d1700 1 -- 172.21.15.78:0/439792889 >> 172.21.15.78:0/439792889 conn(0x7ff214094510 msgr2=0x7ff21406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.125+0000 7ff2199d1700 1 -- 172.21.15.78:0/439792889 shutdown_connections 2023-08-17T17:49:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.125+0000 7ff2199d1700 1 -- 172.21.15.78:0/439792889 wait complete. 2023-08-17T17:49:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.126+0000 7ff2199d1700 1 Processor -- start 2023-08-17T17:49:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.126+0000 7ff2199d1700 1 -- start start 2023-08-17T17:49:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2199d1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2140a7c40 0x7ff21414eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2199d1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2140a8080 0x7ff2140c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2199d1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 0x7ff2141553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2199d1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c4890 con 0x7ff214154140 2023-08-17T17:49:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2199d1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c4d20 con 0x7ff2140a8080 2023-08-17T17:49:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2199d1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c3f60 con 0x7ff2140a7c40 2023-08-17T17:49:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2137fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 0x7ff2141553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2137fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 0x7ff2141553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56494/0 (socket says 172.21.15.78:56494) 2023-08-17T17:49:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2137fe700 1 -- 172.21.15.78:0/2845659616 learned_addr learned my addr 172.21.15.78:0/2845659616 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2137fe700 1 -- 172.21.15.78:0/2845659616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2140a7c40 msgr2=0x7ff21414eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2137fe700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2140a7c40 0x7ff21414eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2137fe700 1 -- 172.21.15.78:0/2845659616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2140a8080 msgr2=0x7ff2140c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2137fe700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2140a8080 0x7ff2140c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2137fe700 1 -- 172.21.15.78:0/2845659616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204009370 con 0x7ff214154140 2023-08-17T17:49:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2137fe700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 0x7ff2141553d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7ff20c00cfb0 tx=0x7ff20c0078c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff20b7fe700 1 -- 172.21.15.78:0/2845659616 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c016470 con 0x7ff214154140 2023-08-17T17:49:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff20b7fe700 1 -- 172.21.15.78:0/2845659616 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c0165d0 con 0x7ff214154140 2023-08-17T17:49:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2199d1700 1 -- 172.21.15.78:0/2845659616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140c4240 con 0x7ff214154140 2023-08-17T17:49:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff20b7fe700 1 -- 172.21.15.78:0/2845659616 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c016950 con 0x7ff214154140 2023-08-17T17:49:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.127+0000 7ff2199d1700 1 -- 172.21.15.78:0/2845659616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21414f040 con 0x7ff214154140 2023-08-17T17:49:20.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.128+0000 7ff2199d1700 1 -- 172.21.15.78:0/2845659616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214047350 con 0x7ff214154140 2023-08-17T17:49:20.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.129+0000 7ff20b7fe700 1 -- 172.21.15.78:0/2845659616 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff20c01d060 con 0x7ff214154140 2023-08-17T17:49:20.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.129+0000 7ff20b7fe700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1f405ed90 0x7ff1f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.129+0000 7ff20b7fe700 1 -- 172.21.15.78:0/2845659616 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff20c07a7a0 con 0x7ff214154140 2023-08-17T17:49:20.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.129+0000 7ff212ffd700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1f405ed90 0x7ff1f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.129+0000 7ff212ffd700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1f405ed90 0x7ff1f4061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff204009fd0 tx=0x7ff204017000).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:20.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.133+0000 7ff20b7fe700 1 -- 172.21.15.78:0/2845659616 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff20c04bd40 con 0x7ff214154140 2023-08-17T17:49:20.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.298+0000 7ff2199d1700 1 -- 172.21.15.78:0/2845659616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2140c49d0 con 0x7ff214154140 2023-08-17T17:49:20.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.299+0000 7ff20b7fe700 1 -- 172.21.15.78:0/2845659616 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16991 (secure 0 0 0) 0x7ff20c0079e0 con 0x7ff214154140 2023-08-17T17:49:20.300 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:20.300 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":76,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:19.673442+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:18.219880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:18.637834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 -- 172.21.15.78:0/2845659616 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1f405ed90 msgr2=0x7ff1f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1f405ed90 0x7ff1f4061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff204009fd0 tx=0x7ff204017000).stop 2023-08-17T17:49:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 -- 172.21.15.78:0/2845659616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 msgr2=0x7ff2141553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 0x7ff2141553d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7ff20c00cfb0 tx=0x7ff20c0078c0).stop 2023-08-17T17:49:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 -- 172.21.15.78:0/2845659616 shutdown_connections 2023-08-17T17:49:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1f405ed90 0x7ff1f4061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff214154140 0x7ff2141553d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2140a7c40 0x7ff21414eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:20.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 --2- 172.21.15.78:0/2845659616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2140a8080 0x7ff2140c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:20.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 -- 172.21.15.78:0/2845659616 >> 172.21.15.78:0/2845659616 conn(0x7ff214094510 msgr2=0x7ff214063de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:20.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 -- 172.21.15.78:0/2845659616 shutdown_connections 2023-08-17T17:49:20.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.301+0000 7ff2199d1700 1 -- 172.21.15.78:0/2845659616 wait complete. 2023-08-17T17:49:20.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T17:49:20.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.429+0000 7f29bdf74700 1 Processor -- start 2023-08-17T17:49:20.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.429+0000 7f29bdf74700 1 -- start start 2023-08-17T17:49:20.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.430+0000 7f29bdf74700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80aa0f0 0x7f29b80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.430+0000 7f29bdf74700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29b80aa4d0 0x7f29b80c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.430+0000 7f29bdf74700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b80649b0 con 0x7f29b80c5810 2023-08-17T17:49:20.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.430+0000 7f29bdf74700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b8063420 con 0x7f29b80aa4d0 2023-08-17T17:49:20.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.430+0000 7f29bdf74700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b8063700 con 0x7f29b80aa0f0 2023-08-17T17:49:20.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.430+0000 7f29b7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f29b80c5810 0x7f29b80a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35004/0 (socket says 172.21.15.78:35004) 2023-08-17T17:49:20.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.430+0000 7f29b7fff700 1 -- 172.21.15.78:0/3075306657 learned_addr learned my addr 172.21.15.78:0/3075306657 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:20.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.430+0000 7f29affff700 1 --2- 172.21.15.78:0/3075306657 >> v2:172.21.15.150:3300/0 conn(0x7f29b80aa4d0 0x7f29b80c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.430+0000 7f29b77fe700 1 --2- 172.21.15.78:0/3075306657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80aa0f0 0x7f29b80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29b6ffd700 1 -- 172.21.15.78:0/3075306657 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148435933 0 0) 0x7f29b80649b0 con 0x7f29b80c5810 2023-08-17T17:49:20.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29b6ffd700 1 -- 172.21.15.78:0/3075306657 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a40033f0 con 0x7f29b80c5810 2023-08-17T17:49:20.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29affff700 1 -- 172.21.15.78:0/3075306657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80aa0f0 msgr2=0x7f29b80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:20.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29affff700 1 --2- 172.21.15.78:0/3075306657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80aa0f0 0x7f29b80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29affff700 1 -- 172.21.15.78:0/3075306657 >> v1:172.21.15.78:6789/0 conn(0x7f29b80c5810 legacy=0x7f29b80a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29affff700 1 -- 172.21.15.78:0/3075306657 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b80639e0 con 0x7f29b80aa4d0 2023-08-17T17:49:20.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29b77fe700 1 --2- 172.21.15.78:0/3075306657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80aa0f0 0x7f29b80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:20.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29affff700 1 --2- 172.21.15.78:0/3075306657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80aa4d0 0x7f29b80c0e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f29a0009760 tx=0x7f29a0009060).ready entity=mon.1 client_cookie=5107c9c4e8817ba9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:20.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29b6ffd700 1 -- 172.21.15.78:0/3075306657 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000d4a0 con 0x7f29b80aa4d0 2023-08-17T17:49:20.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29b6ffd700 1 -- 172.21.15.78:0/3075306657 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a000d600 con 0x7f29b80aa4d0 2023-08-17T17:49:20.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.431+0000 7f29b6ffd700 1 -- 172.21.15.78:0/3075306657 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000d980 con 0x7f29b80aa4d0 2023-08-17T17:49:20.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.432+0000 7f29bdf74700 1 -- 172.21.15.78:0/3075306657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80aa4d0 msgr2=0x7f29b80c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.432+0000 7f29bdf74700 1 --2- 172.21.15.78:0/3075306657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80aa4d0 0x7f29b80c0e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f29a0009760 tx=0x7f29a0009060).stop 2023-08-17T17:49:20.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.432+0000 7f29bdf74700 1 -- 172.21.15.78:0/3075306657 shutdown_connections 2023-08-17T17:49:20.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.432+0000 7f29bdf74700 1 --2- 172.21.15.78:0/3075306657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80aa0f0 0x7f29b80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.432+0000 7f29bdf74700 1 --2- 172.21.15.78:0/3075306657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80aa4d0 0x7f29b80c0e10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.432+0000 7f29bdf74700 1 -- 172.21.15.78:0/3075306657 >> 172.21.15.78:0/3075306657 conn(0x7f29b806a6a0 msgr2=0x7f29b80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:20.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.432+0000 7f29bdf74700 1 -- 172.21.15.78:0/3075306657 shutdown_connections 2023-08-17T17:49:20.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.432+0000 7f29bdf74700 1 -- 172.21.15.78:0/3075306657 wait complete. 2023-08-17T17:49:20.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.433+0000 7f29bdf74700 1 Processor -- start 2023-08-17T17:49:20.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.433+0000 7f29bdf74700 1 -- start start 2023-08-17T17:49:20.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29bdf74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b80aa0f0 0x7f29b80c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29bdf74700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80aa4d0 0x7f29b8146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29bdf74700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80c5810 0x7f29b80c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29bdf74700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80c3630 con 0x7f29b80aa0f0 2023-08-17T17:49:20.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29bdf74700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80c2a20 con 0x7f29b80aa4d0 2023-08-17T17:49:20.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29bdf74700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80c2d00 con 0x7f29b80c5810 2023-08-17T17:49:20.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29b77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b80aa0f0 0x7f29b80c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29b77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b80aa0f0 0x7f29b80c2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56506/0 (socket says 172.21.15.78:56506) 2023-08-17T17:49:20.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29b77fe700 1 -- 172.21.15.78:0/2360851164 learned_addr learned my addr 172.21.15.78:0/2360851164 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:20.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29b7fff700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80c5810 0x7f29b80c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29b77fe700 1 -- 172.21.15.78:0/2360851164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80c5810 msgr2=0x7f29b80c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29affff700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80aa4d0 0x7f29b8146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29b77fe700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80c5810 0x7f29b80c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29b77fe700 1 -- 172.21.15.78:0/2360851164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80aa4d0 msgr2=0x7f29b8146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29b77fe700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80aa4d0 0x7f29b8146d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29b77fe700 1 -- 172.21.15.78:0/2360851164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a80092a0 con 0x7f29b80aa0f0 2023-08-17T17:49:20.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29b77fe700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b80aa0f0 0x7f29b80c2480 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f29a800ea20 tx=0x7f29a8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:20.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29af7fe700 1 -- 172.21.15.78:0/2360851164 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a800c850 con 0x7f29b80aa0f0 2023-08-17T17:49:20.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29af7fe700 1 -- 172.21.15.78:0/2360851164 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a800c9b0 con 0x7f29b80aa0f0 2023-08-17T17:49:20.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29bdf74700 1 -- 172.21.15.78:0/2360851164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a00092a0 con 0x7f29b80aa0f0 2023-08-17T17:49:20.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29af7fe700 1 -- 172.21.15.78:0/2360851164 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a800cd30 con 0x7f29b80aa0f0 2023-08-17T17:49:20.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.434+0000 7f29bdf74700 1 -- 172.21.15.78:0/2360851164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b80c32c0 con 0x7f29b80aa0f0 2023-08-17T17:49:20.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.435+0000 7f29bdf74700 1 -- 172.21.15.78:0/2360851164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b8147330 con 0x7f29b80aa0f0 2023-08-17T17:49:20.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.436+0000 7f29af7fe700 1 -- 172.21.15.78:0/2360851164 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f29a8022070 con 0x7f29b80aa0f0 2023-08-17T17:49:20.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.436+0000 7f29af7fe700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f299805ed90 0x7f2998061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.436+0000 7f29af7fe700 1 -- 172.21.15.78:0/2360851164 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f29a807a0d0 con 0x7f29b80aa0f0 2023-08-17T17:49:20.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.436+0000 7f29affff700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f299805ed90 0x7f2998061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.436+0000 7f29affff700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f299805ed90 0x7f2998061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f29a0009760 tx=0x7f29a0016000).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.440+0000 7f29af7fe700 1 -- 172.21.15.78:0/2360851164 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29a804b670 con 0x7f29b80aa0f0 2023-08-17T17:49:20.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.646+0000 7f29bdf74700 1 -- 172.21.15.78:0/2360851164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f29b80b0d50 con 0x7f29b80aa0f0 2023-08-17T17:49:20.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.680+0000 7f29af7fe700 1 -- 172.21.15.78:0/2360851164 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f29a804ec90 con 0x7f29b80aa0f0 2023-08-17T17:49:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 -- 172.21.15.78:0/2360851164 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f299805ed90 msgr2=0x7f2998061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f299805ed90 0x7f2998061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f29a0009760 tx=0x7f29a0016000).stop 2023-08-17T17:49:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 -- 172.21.15.78:0/2360851164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b80aa0f0 msgr2=0x7f29b80c2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b80aa0f0 0x7f29b80c2480 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f29a800ea20 tx=0x7f29a8009060).stop 2023-08-17T17:49:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 -- 172.21.15.78:0/2360851164 shutdown_connections 2023-08-17T17:49:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f299805ed90 0x7f2998061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b80c5810 0x7f29b80c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b80aa0f0 0x7f29b80c2480 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 --2- 172.21.15.78:0/2360851164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80aa4d0 0x7f29b8146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 -- 172.21.15.78:0/2360851164 >> 172.21.15.78:0/2360851164 conn(0x7f29b806a6a0 msgr2=0x7f29b8152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 -- 172.21.15.78:0/2360851164 shutdown_connections 2023-08-17T17:49:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.682+0000 7f29bdf74700 1 -- 172.21.15.78:0/2360851164 wait complete. 2023-08-17T17:49:20.695 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T17:49:20.695 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T17:49:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.812+0000 7fd69bfff700 1 Processor -- start 2023-08-17T17:49:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.812+0000 7fd69bfff700 1 -- start start 2023-08-17T17:49:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd69c151e20 0x7fd69c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69bfff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69c0c6620 con 0x7fd69c151a40 2023-08-17T17:49:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69bfff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69c0c6900 con 0x7fd69c157be0 2023-08-17T17:49:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69bfff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69c0c6be0 con 0x7fd69c151e20 2023-08-17T17:49:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd69c151e20 0x7fd69c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69affd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd69c151a40 0x7fd69c0c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35010/0 (socket says 172.21.15.78:35010) 2023-08-17T17:49:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69affd700 1 -- 172.21.15.78:0/3708618538 learned_addr learned my addr 172.21.15.78:0/3708618538 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69a7fc700 1 -- 172.21.15.78:0/3708618538 >> v1:172.21.15.150:6789/0 conn(0x7fd69c157be0 legacy=0x7fd69c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69a7fc700 1 -- 172.21.15.78:0/3708618538 >> v1:172.21.15.78:6789/0 conn(0x7fd69c151a40 legacy=0x7fd69c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69a7fc700 1 -- 172.21.15.78:0/3708618538 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c0c6ec0 con 0x7fd69c151e20 2023-08-17T17:49:20.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd69a7fc700 1 --2- 172.21.15.78:0/3708618538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c151e20 0x7fd69c0c8260 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fd684006fd0 tx=0x7fd684006f40).ready entity=mon.0 client_cookie=a6956c6f9db11ecb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:20.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd699ffb700 1 -- 172.21.15.78:0/3708618538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684005880 con 0x7fd69c151e20 2023-08-17T17:49:20.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd699ffb700 1 -- 172.21.15.78:0/3708618538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6840059e0 con 0x7fd69c151e20 2023-08-17T17:49:20.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.813+0000 7fd699ffb700 1 -- 172.21.15.78:0/3708618538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684005d60 con 0x7fd69c151e20 2023-08-17T17:49:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.814+0000 7fd69bfff700 1 -- 172.21.15.78:0/3708618538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c151e20 msgr2=0x7fd69c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.814+0000 7fd69bfff700 1 --2- 172.21.15.78:0/3708618538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c151e20 0x7fd69c0c8260 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fd684006fd0 tx=0x7fd684006f40).stop 2023-08-17T17:49:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.814+0000 7fd69bfff700 1 -- 172.21.15.78:0/3708618538 shutdown_connections 2023-08-17T17:49:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.814+0000 7fd69bfff700 1 --2- 172.21.15.78:0/3708618538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c151e20 0x7fd69c0c8260 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.814+0000 7fd69bfff700 1 -- 172.21.15.78:0/3708618538 >> 172.21.15.78:0/3708618538 conn(0x7fd69c0943b0 msgr2=0x7fd69c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.814+0000 7fd69bfff700 1 -- 172.21.15.78:0/3708618538 shutdown_connections 2023-08-17T17:49:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.814+0000 7fd69bfff700 1 -- 172.21.15.78:0/3708618538 wait complete. 2023-08-17T17:49:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.815+0000 7fd69bfff700 1 Processor -- start 2023-08-17T17:49:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.815+0000 7fd69bfff700 1 -- start start 2023-08-17T17:49:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd69c151a40 0x7fd69c1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd69c151e20 0x7fd69c14b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c157be0 0x7fd69c156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69bfff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c152f30 con 0x7fd69c157be0 2023-08-17T17:49:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69bfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c1538b0 con 0x7fd69c151e20 2023-08-17T17:49:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c152600 con 0x7fd69c151a40 2023-08-17T17:49:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c157be0 0x7fd69c156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c157be0 0x7fd69c156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56522/0 (socket says 172.21.15.78:56522) 2023-08-17T17:49:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69b7fe700 1 -- 172.21.15.78:0/79772820 learned_addr learned my addr 172.21.15.78:0/79772820 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69a7fc700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd69c151e20 0x7fd69c14b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69affd700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd69c151a40 0x7fd69c1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69b7fe700 1 -- 172.21.15.78:0/79772820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd69c151a40 msgr2=0x7fd69c1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69b7fe700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd69c151a40 0x7fd69c1533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69b7fe700 1 -- 172.21.15.78:0/79772820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd69c151e20 msgr2=0x7fd69c14b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69b7fe700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd69c151e20 0x7fd69c14b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69b7fe700 1 -- 172.21.15.78:0/79772820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd684009250 con 0x7fd69c157be0 2023-08-17T17:49:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.816+0000 7fd69affd700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd69c151a40 0x7fd69c1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.817+0000 7fd69b7fe700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c157be0 0x7fd69c156790 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fd68c00c7c0 tx=0x7fd68c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.817+0000 7fd692ffd700 1 -- 172.21.15.78:0/79772820 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00e4a0 con 0x7fd69c157be0 2023-08-17T17:49:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.817+0000 7fd692ffd700 1 -- 172.21.15.78:0/79772820 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00e600 con 0x7fd69c157be0 2023-08-17T17:49:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.817+0000 7fd69bfff700 1 -- 172.21.15.78:0/79772820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c1528e0 con 0x7fd69c157be0 2023-08-17T17:49:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.817+0000 7fd692ffd700 1 -- 172.21.15.78:0/79772820 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00e980 con 0x7fd69c157be0 2023-08-17T17:49:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.817+0000 7fd69bfff700 1 -- 172.21.15.78:0/79772820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69c14bd30 con 0x7fd69c157be0 2023-08-17T17:49:20.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.818+0000 7fd69bfff700 1 -- 172.21.15.78:0/79772820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69c082f90 con 0x7fd69c157be0 2023-08-17T17:49:20.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.818+0000 7fd692ffd700 1 -- 172.21.15.78:0/79772820 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd68c019030 con 0x7fd69c157be0 2023-08-17T17:49:20.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.818+0000 7fd692ffd700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd67c05ed90 0x7fd67c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:20.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.818+0000 7fd692ffd700 1 -- 172.21.15.78:0/79772820 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd68c079040 con 0x7fd69c157be0 2023-08-17T17:49:20.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.818+0000 7fd69affd700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd67c05ed90 0x7fd67c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:20.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.819+0000 7fd69affd700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd67c05ed90 0x7fd67c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd6940010e0 tx=0x7fd694009040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:20.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:20.822+0000 7fd692ffd700 1 -- 172.21.15.78:0/79772820 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd68c0488f0 con 0x7fd69c157be0 2023-08-17T17:49:21.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.026+0000 7fd69bfff700 1 -- 172.21.15.78:0/79772820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd69c05f910 con 0x7fd69c157be0 2023-08-17T17:49:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.688+0000 7fd692ffd700 1 -- 172.21.15.78:0/79772820 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd68c017030 con 0x7fd69c157be0 2023-08-17T17:49:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 -- 172.21.15.78:0/79772820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd67c05ed90 msgr2=0x7fd67c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd67c05ed90 0x7fd67c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd6940010e0 tx=0x7fd694009040).stop 2023-08-17T17:49:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 -- 172.21.15.78:0/79772820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c157be0 msgr2=0x7fd69c156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c157be0 0x7fd69c156790 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fd68c00c7c0 tx=0x7fd68c001510).stop 2023-08-17T17:49:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 -- 172.21.15.78:0/79772820 shutdown_connections 2023-08-17T17:49:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd67c05ed90 0x7fd67c061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd69c157be0 0x7fd69c156790 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd69c151a40 0x7fd69c1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 --2- 172.21.15.78:0/79772820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd69c151e20 0x7fd69c14b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 -- 172.21.15.78:0/79772820 >> 172.21.15.78:0/79772820 conn(0x7fd69c0943b0 msgr2=0x7fd69c14c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 -- 172.21.15.78:0/79772820 shutdown_connections 2023-08-17T17:49:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.690+0000 7fd69bfff700 1 -- 172.21.15.78:0/79772820 wait complete. 2023-08-17T17:49:21.703 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T17:49:21.703 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:21.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.815+0000 7fadde76c700 1 Processor -- start 2023-08-17T17:49:21.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.815+0000 7fadde76c700 1 -- start start 2023-08-17T17:49:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.816+0000 7fadde76c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd8154140 0x7fadd80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.816+0000 7fadde76c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd8154520 con 0x7fadd80a7c40 2023-08-17T17:49:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.816+0000 7fadde76c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80c91e0 con 0x7fadd80c1010 2023-08-17T17:49:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.816+0000 7fadde76c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80c94c0 con 0x7fadd8154140 2023-08-17T17:49:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.816+0000 7fadd77fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fadd80a7c40 0x7fadd80c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35024/0 (socket says 172.21.15.78:35024) 2023-08-17T17:49:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.816+0000 7fadd77fe700 1 -- 172.21.15.78:0/2279198398 learned_addr learned my addr 172.21.15.78:0/2279198398 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.816+0000 7fadd7fff700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd8154140 0x7fadd80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.816+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923944469 0 0) 0x7fadd8154520 con 0x7fadd80a7c40 2023-08-17T17:49:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc00033f0 con 0x7fadd80a7c40 2023-08-17T17:49:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931054936 0 0) 0x7fadd80c91e0 con 0x7fadd80c1010 2023-08-17T17:49:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd8154520 con 0x7fadd80c1010 2023-08-17T17:49:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3613764678 0 0) 0x7fadc00033f0 con 0x7fadd80a7c40 2023-08-17T17:49:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd8154140 msgr2=0x7fadd80c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd8154140 0x7fadd80c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 >> v1:172.21.15.150:6789/0 conn(0x7fadd80c1010 legacy=0x7fadd80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80c97a0 con 0x7fadd80a7c40 2023-08-17T17:49:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fadcc001470 con 0x7fadd80a7c40 2023-08-17T17:49:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 >> v1:172.21.15.78:6789/0 conn(0x7fadd80a7c40 legacy=0x7fadd80c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 0x7fadc0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd8154140 0x7fadc0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:21.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0004b80 0x7fadc0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:21.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80c94c0 con 0x7fadc0003aa0 2023-08-17T17:49:21.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc000b910 con 0x7fadc0004b80 2023-08-17T17:49:21.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc000bad0 con 0x7fadd8154140 2023-08-17T17:49:21.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd7fff700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 0x7fadc0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:21.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd77fe700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd8154140 0x7fadc0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:21.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7faddcd09700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0004b80 0x7fadc0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd7fff700 1 -- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd8154140 msgr2=0x7fadc0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd7fff700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd8154140 0x7fadc0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd7fff700 1 -- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0004b80 msgr2=0x7fadc0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd7fff700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0004b80 0x7fadc0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd7fff700 1 -- 172.21.15.78:0/2279198398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00033f0 con 0x7fadc0003aa0 2023-08-17T17:49:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.817+0000 7fadd7fff700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 0x7fadc0003ea0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7fadc8009a80 tx=0x7fadc8009060).ready entity=mon.0 client_cookie=4d2e5d090903d55e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.818+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8009430 con 0x7fadc0003aa0 2023-08-17T17:49:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.818+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800e640 con 0x7fadc0003aa0 2023-08-17T17:49:21.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.818+0000 7fadd6ffd700 1 -- 172.21.15.78:0/2279198398 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800e9c0 con 0x7fadc0003aa0 2023-08-17T17:49:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.818+0000 7fadde76c700 1 -- 172.21.15.78:0/2279198398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 msgr2=0x7fadc0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.818+0000 7fadde76c700 1 --2- 172.21.15.78:0/2279198398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 0x7fadc0003ea0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7fadc8009a80 tx=0x7fadc8009060).stop 2023-08-17T17:49:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.818+0000 7faddcd09700 1 -- 172.21.15.78:0/2279198398 reap_dead start 2023-08-17T17:49:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.818+0000 7fadde76c700 1 -- 172.21.15.78:0/2279198398 shutdown_connections 2023-08-17T17:49:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.818+0000 7fadde76c700 1 -- 172.21.15.78:0/2279198398 >> 172.21.15.78:0/2279198398 conn(0x7fadd8094510 msgr2=0x7fadd806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.818+0000 7fadde76c700 1 -- 172.21.15.78:0/2279198398 shutdown_connections 2023-08-17T17:49:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.818+0000 7fadde76c700 1 -- 172.21.15.78:0/2279198398 wait complete. 2023-08-17T17:49:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.819+0000 7fadde76c700 1 Processor -- start 2023-08-17T17:49:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadde76c700 1 -- start start 2023-08-17T17:49:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadde76c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 0x7fadd8142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadde76c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd80af560 0x7fadd80a9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:21.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadde76c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd80af9e0 0x7fadd80a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:21.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadde76c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80b0d80 con 0x7fadc0003aa0 2023-08-17T17:49:21.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadde76c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80a9b10 con 0x7fadd80af9e0 2023-08-17T17:49:21.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadde76c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80afef0 con 0x7fadd80af560 2023-08-17T17:49:21.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadd7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 0x7fadd8142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:21.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadd7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 0x7fadd8142960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56542/0 (socket says 172.21.15.78:56542) 2023-08-17T17:49:21.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadd7fff700 1 -- 172.21.15.78:0/617038831 learned_addr learned my addr 172.21.15.78:0/617038831 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:21.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7fadd77fe700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd80af560 0x7fadd80a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:21.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.820+0000 7faddcd09700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd80af9e0 0x7fadd80a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:21.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadd7fff700 1 -- 172.21.15.78:0/617038831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd80af560 msgr2=0x7fadd80a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:21.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadd7fff700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd80af560 0x7fadd80a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:21.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadd7fff700 1 -- 172.21.15.78:0/617038831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd80af9e0 msgr2=0x7fadd80a9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:21.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadd7fff700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd80af9e0 0x7fadd80a9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:21.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadd7fff700 1 -- 172.21.15.78:0/617038831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8142e50 con 0x7fadc0003aa0 2023-08-17T17:49:21.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7faddcd09700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd80af9e0 0x7fadd80a9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:21.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadd7fff700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 0x7fadd8142960 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fadc800e4b0 tx=0x7fadc801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:21.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadbffff700 1 -- 172.21.15.78:0/617038831 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800ed30 con 0x7fadc0003aa0 2023-08-17T17:49:21.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadbffff700 1 -- 172.21.15.78:0/617038831 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800ee90 con 0x7fadc0003aa0 2023-08-17T17:49:21.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadde76c700 1 -- 172.21.15.78:0/617038831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd80b0100 con 0x7fadc0003aa0 2023-08-17T17:49:21.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadbffff700 1 -- 172.21.15.78:0/617038831 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8026440 con 0x7fadc0003aa0 2023-08-17T17:49:21.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.821+0000 7fadde76c700 1 -- 172.21.15.78:0/617038831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd80b06c0 con 0x7fadc0003aa0 2023-08-17T17:49:21.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.822+0000 7fadde76c700 1 -- 172.21.15.78:0/617038831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd8047350 con 0x7fadc0003aa0 2023-08-17T17:49:21.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.822+0000 7fadbffff700 1 -- 172.21.15.78:0/617038831 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fadc802c020 con 0x7fadc0003aa0 2023-08-17T17:49:21.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.823+0000 7fadbffff700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fadc405ed90 0x7fadc4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:21.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.823+0000 7fadbffff700 1 -- 172.21.15.78:0/617038831 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fadc807b6f0 con 0x7fadc0003aa0 2023-08-17T17:49:21.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.823+0000 7fadd77fe700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fadc405ed90 0x7fadc4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:21.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.823+0000 7fadd77fe700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fadc405ed90 0x7fadc4061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fadcc001ca0 tx=0x7fadcc001e10).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:21.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:21.827+0000 7fadbffff700 1 -- 172.21.15.78:0/617038831 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fadc804cc90 con 0x7fadc0003aa0 2023-08-17T17:49:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.030+0000 7fadde76c700 1 -- 172.21.15.78:0/617038831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadd80c9a80 con 0x7fadc0003aa0 2023-08-17T17:49:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.031+0000 7fadbffff700 1 -- 172.21.15.78:0/617038831 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fadc8016090 con 0x7fadc0003aa0 2023-08-17T17:49:22.031 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:22.032 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2895715400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2895715400},{"type":"v1","addr":"172.21.15.150:6834","nonce":2895715400}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1604940701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1604940701},{"type":"v1","addr":"172.21.15.78:6836","nonce":1604940701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6234,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1676496794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1676496794},{"type":"v1","addr":"172.21.15.78:6837","nonce":1676496794}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:19.673872+0000","modified":"2023-08-17T17:49:21.684217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6246":{"gid":6246,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3219133912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3219133912},{"type":"v1","addr":"172.21.15.150:6835","nonce":3219133912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T17:49:22.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 -- 172.21.15.78:0/617038831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fadc405ed90 msgr2=0x7fadc4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fadc405ed90 0x7fadc4061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fadcc001ca0 tx=0x7fadcc001e10).stop 2023-08-17T17:49:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 -- 172.21.15.78:0/617038831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 msgr2=0x7fadd8142960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 0x7fadd8142960 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fadc800e4b0 tx=0x7fadc801a000).stop 2023-08-17T17:49:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 -- 172.21.15.78:0/617038831 shutdown_connections 2023-08-17T17:49:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fadc405ed90 0x7fadc4061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd80af9e0 0x7fadd80a9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadc0003aa0 0x7fadd8142960 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 --2- 172.21.15.78:0/617038831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fadd80af560 0x7fadd80a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 -- 172.21.15.78:0/617038831 >> 172.21.15.78:0/617038831 conn(0x7fadd8094510 msgr2=0x7fadd8064470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 -- 172.21.15.78:0/617038831 shutdown_connections 2023-08-17T17:49:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.033+0000 7fadde76c700 1 -- 172.21.15.78:0/617038831 wait complete. 2023-08-17T17:49:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 25 2023-08-17T17:49:22.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:22.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.158+0000 7f97e970d700 1 Processor -- start 2023-08-17T17:49:22.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.158+0000 7f97e970d700 1 -- start start 2023-08-17T17:49:22.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e970d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97e4154140 0x7f97e40c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e970d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e40a7c40 0x7f97e40c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e970d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f97e40a8080 0x7f97e40c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e970d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e40c12e0 con 0x7f97e4154140 2023-08-17T17:49:22.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e970d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e4154520 con 0x7f97e40a8080 2023-08-17T17:49:22.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e970d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40c91e0 con 0x7f97e40a7c40 2023-08-17T17:49:22.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e2ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97e4154140 0x7f97e40c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e2ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97e4154140 0x7f97e40c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56550/0 (socket says 172.21.15.78:56550) 2023-08-17T17:49:22.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e2ffd700 1 -- 172.21.15.78:0/4119913221 learned_addr learned my addr 172.21.15.78:0/4119913221 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:22.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e27fc700 1 --2- 172.21.15.78:0/4119913221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e40a7c40 0x7f97e40c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e37fe700 1 --2- 172.21.15.78:0/4119913221 >> v2:172.21.15.150:3300/0 conn(0x7f97e40a8080 0x7f97e40c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e2ffd700 1 -- 172.21.15.78:0/4119913221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e40a7c40 msgr2=0x7f97e40c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:22.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e2ffd700 1 --2- 172.21.15.78:0/4119913221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e40a7c40 0x7f97e40c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e2ffd700 1 -- 172.21.15.78:0/4119913221 >> v2:172.21.15.150:3300/0 conn(0x7f97e40a8080 msgr2=0x7f97e40c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:22.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e2ffd700 1 --2- 172.21.15.78:0/4119913221 >> v2:172.21.15.150:3300/0 conn(0x7f97e40a8080 0x7f97e40c0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e2ffd700 1 -- 172.21.15.78:0/4119913221 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e40c94c0 con 0x7f97e4154140 2023-08-17T17:49:22.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e2ffd700 1 --2- 172.21.15.78:0/4119913221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 0x7f97e40c6ee0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f97e406bd60 tx=0x7f97dc009840).ready entity=mon.0 client_cookie=df5ce6df1b0290b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:22.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e1ffb700 1 -- 172.21.15.78:0/4119913221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00e070 con 0x7f97e4154140 2023-08-17T17:49:22.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e1ffb700 1 -- 172.21.15.78:0/4119913221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc00ba50 con 0x7f97e4154140 2023-08-17T17:49:22.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.159+0000 7f97e1ffb700 1 -- 172.21.15.78:0/4119913221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00bdd0 con 0x7f97e4154140 2023-08-17T17:49:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.160+0000 7f97e970d700 1 -- 172.21.15.78:0/4119913221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 msgr2=0x7f97e40c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.160+0000 7f97e970d700 1 --2- 172.21.15.78:0/4119913221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 0x7f97e40c6ee0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f97e406bd60 tx=0x7f97dc009840).stop 2023-08-17T17:49:22.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.160+0000 7f97e970d700 1 -- 172.21.15.78:0/4119913221 shutdown_connections 2023-08-17T17:49:22.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.160+0000 7f97e970d700 1 --2- 172.21.15.78:0/4119913221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 0x7f97e40c6ee0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.160+0000 7f97e970d700 1 --2- 172.21.15.78:0/4119913221 >> v2:172.21.15.150:3300/0 conn(0x7f97e40a8080 0x7f97e40c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.160+0000 7f97e970d700 1 --2- 172.21.15.78:0/4119913221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e40a7c40 0x7f97e40c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.160+0000 7f97e970d700 1 -- 172.21.15.78:0/4119913221 >> 172.21.15.78:0/4119913221 conn(0x7f97e4094510 msgr2=0x7f97e406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:22.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.160+0000 7f97e970d700 1 -- 172.21.15.78:0/4119913221 shutdown_connections 2023-08-17T17:49:22.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.160+0000 7f97e970d700 1 -- 172.21.15.78:0/4119913221 wait complete. 2023-08-17T17:49:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.161+0000 7f97e970d700 1 Processor -- start 2023-08-17T17:49:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.161+0000 7f97e970d700 1 -- start start 2023-08-17T17:49:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e970d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97e40a7c40 0x7f97e40aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e970d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e40a8080 0x7f97e40abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e970d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 0x7f97e414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e970d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40ad200 con 0x7f97e4154140 2023-08-17T17:49:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e970d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40ac580 con 0x7f97e40a7c40 2023-08-17T17:49:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e970d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40ac860 con 0x7f97e40a8080 2023-08-17T17:49:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 0x7f97e414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 0x7f97e414e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56564/0 (socket says 172.21.15.78:56564) 2023-08-17T17:49:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e37fe700 1 -- 172.21.15.78:0/1603871464 learned_addr learned my addr 172.21.15.78:0/1603871464 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e2ffd700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97e40a7c40 0x7f97e40aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e27fc700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e40a8080 0x7f97e40abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e37fe700 1 -- 172.21.15.78:0/1603871464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e40a8080 msgr2=0x7f97e40abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e37fe700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e40a8080 0x7f97e40abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e37fe700 1 -- 172.21.15.78:0/1603871464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97e40a7c40 msgr2=0x7f97e40aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e37fe700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97e40a7c40 0x7f97e40aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e37fe700 1 -- 172.21.15.78:0/1603871464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc009ae0 con 0x7f97e4154140 2023-08-17T17:49:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.162+0000 7f97e37fe700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 0x7f97e414e9a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f97d400d640 tx=0x7f97d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.163+0000 7f97daffd700 1 -- 172.21.15.78:0/1603871464 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4011590 con 0x7f97e4154140 2023-08-17T17:49:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.163+0000 7f97daffd700 1 -- 172.21.15.78:0/1603871464 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d40116f0 con 0x7f97e4154140 2023-08-17T17:49:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.163+0000 7f97e970d700 1 -- 172.21.15.78:0/1603871464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e40acb40 con 0x7f97e4154140 2023-08-17T17:49:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.163+0000 7f97daffd700 1 -- 172.21.15.78:0/1603871464 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4011a70 con 0x7f97e4154140 2023-08-17T17:49:22.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.163+0000 7f97e970d700 1 -- 172.21.15.78:0/1603871464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e40ac140 con 0x7f97e4154140 2023-08-17T17:49:22.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.164+0000 7f97e970d700 1 -- 172.21.15.78:0/1603871464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e40ac330 con 0x7f97e4154140 2023-08-17T17:49:22.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.164+0000 7f97daffd700 1 -- 172.21.15.78:0/1603871464 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f97d4012420 con 0x7f97e4154140 2023-08-17T17:49:22.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.164+0000 7f97daffd700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f97c405ed90 0x7f97c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.164+0000 7f97daffd700 1 -- 172.21.15.78:0/1603871464 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f97d40795d0 con 0x7f97e4154140 2023-08-17T17:49:22.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.164+0000 7f97e2ffd700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f97c405ed90 0x7f97c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.165+0000 7f97e2ffd700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f97c405ed90 0x7f97c4061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f97e406bd60 tx=0x7f97dc009840).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:22.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.168+0000 7f97daffd700 1 -- 172.21.15.78:0/1603871464 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f97d404ab10 con 0x7f97e4154140 2023-08-17T17:49:22.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.330+0000 7f97e970d700 1 -- 172.21.15.78:0/1603871464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97e41567c0 con 0x7f97e4154140 2023-08-17T17:49:22.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.331+0000 7f97daffd700 1 -- 172.21.15.78:0/1603871464 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16978 (secure 0 0 0) 0x7f97d4011e60 con 0x7f97e4154140 2023-08-17T17:49:22.331 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:22.331 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":77,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:20.675587+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:18.219880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:18.637834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:22.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 -- 172.21.15.78:0/1603871464 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f97c405ed90 msgr2=0x7f97c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f97c405ed90 0x7f97c4061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f97e406bd60 tx=0x7f97dc009840).stop 2023-08-17T17:49:22.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 -- 172.21.15.78:0/1603871464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 msgr2=0x7f97e414e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 0x7f97e414e9a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f97d400d640 tx=0x7f97d4008040).stop 2023-08-17T17:49:22.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 -- 172.21.15.78:0/1603871464 shutdown_connections 2023-08-17T17:49:22.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f97c405ed90 0x7f97c4061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97e4154140 0x7f97e414e9a0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97e40a7c40 0x7f97e40aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 --2- 172.21.15.78:0/1603871464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e40a8080 0x7f97e40abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 -- 172.21.15.78:0/1603871464 >> 172.21.15.78:0/1603871464 conn(0x7f97e4094510 msgr2=0x7f97e40cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:22.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 -- 172.21.15.78:0/1603871464 shutdown_connections 2023-08-17T17:49:22.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.333+0000 7f97e970d700 1 -- 172.21.15.78:0/1603871464 wait complete. 2023-08-17T17:49:22.345 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T17:49:22.345 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:49:22.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.458+0000 7f87d6ad1700 1 Processor -- start 2023-08-17T17:49:22.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.458+0000 7f87d6ad1700 1 -- start start 2023-08-17T17:49:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.459+0000 7f87d6ad1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f87d0154140 0x7f87d00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.459+0000 7f87d6ad1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87d00c1010 0x7f87d00ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.459+0000 7f87d6ad1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d0154520 con 0x7f87d00a7c40 2023-08-17T17:49:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.459+0000 7f87d6ad1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d00c91e0 con 0x7f87d0154140 2023-08-17T17:49:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.459+0000 7f87d6ad1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d00c94c0 con 0x7f87d00c1010 2023-08-17T17:49:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.459+0000 7f87c7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f87d00a7c40 0x7f87d00c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35038/0 (socket says 172.21.15.78:35038) 2023-08-17T17:49:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.459+0000 7f87c7fff700 1 -- 172.21.15.78:0/1169975795 learned_addr learned my addr 172.21.15.78:0/1169975795 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.459+0000 7f87d486d700 1 --2- 172.21.15.78:0/1169975795 >> v2:172.21.15.150:3300/0 conn(0x7f87d0154140 0x7f87d00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.459+0000 7f87d506e700 1 --2- 172.21.15.78:0/1169975795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87d00c1010 0x7f87d00ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.459+0000 7f87c77fe700 1 -- 172.21.15.78:0/1169975795 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144488990 0 0) 0x7f87d0154520 con 0x7f87d00a7c40 2023-08-17T17:49:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87c77fe700 1 -- 172.21.15.78:0/1169975795 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87b80033f0 con 0x7f87d00a7c40 2023-08-17T17:49:22.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87d506e700 1 -- 172.21.15.78:0/1169975795 >> v2:172.21.15.150:3300/0 conn(0x7f87d0154140 msgr2=0x7f87d00c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:22.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87d506e700 1 --2- 172.21.15.78:0/1169975795 >> v2:172.21.15.150:3300/0 conn(0x7f87d0154140 0x7f87d00c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87d506e700 1 -- 172.21.15.78:0/1169975795 >> v1:172.21.15.78:6789/0 conn(0x7f87d00a7c40 legacy=0x7f87d00c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87d506e700 1 -- 172.21.15.78:0/1169975795 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d00c97a0 con 0x7f87d00c1010 2023-08-17T17:49:22.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87d486d700 1 --2- 172.21.15.78:0/1169975795 >> v2:172.21.15.150:3300/0 conn(0x7f87d0154140 0x7f87d00c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:22.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87d506e700 1 --2- 172.21.15.78:0/1169975795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87d00c1010 0x7f87d00ca280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f87c8009e60 tx=0x7f87c8009780).ready entity=mon.2 client_cookie=354454395cdd514 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:22.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87c77fe700 1 -- 172.21.15.78:0/1169975795 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c800e070 con 0x7f87d00c1010 2023-08-17T17:49:22.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87c77fe700 1 -- 172.21.15.78:0/1169975795 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c800bab0 con 0x7f87d00c1010 2023-08-17T17:49:22.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87c77fe700 1 -- 172.21.15.78:0/1169975795 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c800be30 con 0x7f87d00c1010 2023-08-17T17:49:22.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87d6ad1700 1 -- 172.21.15.78:0/1169975795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87d00c1010 msgr2=0x7f87d00ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.460+0000 7f87d6ad1700 1 --2- 172.21.15.78:0/1169975795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87d00c1010 0x7f87d00ca280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f87c8009e60 tx=0x7f87c8009780).stop 2023-08-17T17:49:22.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.461+0000 7f87d6ad1700 1 -- 172.21.15.78:0/1169975795 shutdown_connections 2023-08-17T17:49:22.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.461+0000 7f87d6ad1700 1 --2- 172.21.15.78:0/1169975795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87d00c1010 0x7f87d00ca280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.461+0000 7f87d6ad1700 1 --2- 172.21.15.78:0/1169975795 >> v2:172.21.15.150:3300/0 conn(0x7f87d0154140 0x7f87d00c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.461+0000 7f87d6ad1700 1 -- 172.21.15.78:0/1169975795 >> 172.21.15.78:0/1169975795 conn(0x7f87d0094510 msgr2=0x7f87d006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:22.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.461+0000 7f87d6ad1700 1 -- 172.21.15.78:0/1169975795 shutdown_connections 2023-08-17T17:49:22.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.461+0000 7f87d6ad1700 1 -- 172.21.15.78:0/1169975795 wait complete. 2023-08-17T17:49:22.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.462+0000 7f87d6ad1700 1 Processor -- start 2023-08-17T17:49:22.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.462+0000 7f87d6ad1700 1 -- start start 2023-08-17T17:49:22.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d6ad1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87d00a7c40 0x7f87d014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d6ad1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87d00c1010 0x7f87d00c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d6ad1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d0154140 0x7f87d00c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d6ad1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d00c2840 con 0x7f87d00a7c40 2023-08-17T17:49:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d6ad1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d00c1f30 con 0x7f87d0154140 2023-08-17T17:49:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d6ad1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d00c4cb0 con 0x7f87d00c1010 2023-08-17T17:49:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d486d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87d00a7c40 0x7f87d014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d486d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87d00a7c40 0x7f87d014ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56566/0 (socket says 172.21.15.78:56566) 2023-08-17T17:49:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d486d700 1 -- 172.21.15.78:0/3690441975 learned_addr learned my addr 172.21.15.78:0/3690441975 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d486d700 1 -- 172.21.15.78:0/3690441975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87d00c1010 msgr2=0x7f87d00c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d486d700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87d00c1010 0x7f87d00c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d486d700 1 -- 172.21.15.78:0/3690441975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d0154140 msgr2=0x7f87d00c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d486d700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d0154140 0x7f87d00c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d486d700 1 -- 172.21.15.78:0/3690441975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc0092a0 con 0x7f87d00a7c40 2023-08-17T17:49:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d486d700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87d00a7c40 0x7f87d014ea20 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f87cc00ea20 tx=0x7f87cc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87c4ff9700 1 -- 172.21.15.78:0/3690441975 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc00c850 con 0x7f87d00a7c40 2023-08-17T17:49:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87c4ff9700 1 -- 172.21.15.78:0/3690441975 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc00c9b0 con 0x7f87d00a7c40 2023-08-17T17:49:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d6ad1700 1 -- 172.21.15.78:0/3690441975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c8009a20 con 0x7f87d00a7c40 2023-08-17T17:49:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87c4ff9700 1 -- 172.21.15.78:0/3690441975 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc00cd30 con 0x7f87d00a7c40 2023-08-17T17:49:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.463+0000 7f87d6ad1700 1 -- 172.21.15.78:0/3690441975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d00c24d0 con 0x7f87d00a7c40 2023-08-17T17:49:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.464+0000 7f87d6ad1700 1 -- 172.21.15.78:0/3690441975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d0047350 con 0x7f87d00a7c40 2023-08-17T17:49:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.465+0000 7f87c4ff9700 1 -- 172.21.15.78:0/3690441975 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f87cc022070 con 0x7f87d00a7c40 2023-08-17T17:49:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.465+0000 7f87c4ff9700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87bc05ed90 0x7f87bc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.465+0000 7f87c7fff700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87bc05ed90 0x7f87bc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.465+0000 7f87c4ff9700 1 -- 172.21.15.78:0/3690441975 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f87cc07a010 con 0x7f87d00a7c40 2023-08-17T17:49:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.465+0000 7f87c7fff700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87bc05ed90 0x7f87bc061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f87c0005750 tx=0x7f87c0007850).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.469+0000 7f87c4ff9700 1 -- 172.21.15.78:0/3690441975 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87cc04b5b0 con 0x7f87d00a7c40 2023-08-17T17:49:22.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.628+0000 7f87d6ad1700 1 -- 172.21.15.78:0/3690441975 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87d005f3f0 con 0x7f87bc05ed90 2023-08-17T17:49:22.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.638+0000 7f87c4ff9700 1 -- 172.21.15.78:0/3690441975 <== mgr.6066 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360361 (secure 0 0 0) 0x7f87d005f3f0 con 0x7f87bc05ed90 2023-08-17T17:49:22.641 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:22.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.641+0000 7f87d6ad1700 1 -- 172.21.15.78:0/3690441975 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87bc05ed90 msgr2=0x7f87bc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.641+0000 7f87d6ad1700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87bc05ed90 0x7f87bc061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f87c0005750 tx=0x7f87c0007850).stop 2023-08-17T17:49:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.641+0000 7f87d6ad1700 1 -- 172.21.15.78:0/3690441975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87d00a7c40 msgr2=0x7f87d014ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.641+0000 7f87d6ad1700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87d00a7c40 0x7f87d014ea20 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f87cc00ea20 tx=0x7f87cc009060).stop 2023-08-17T17:49:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.641+0000 7f87d6ad1700 1 -- 172.21.15.78:0/3690441975 shutdown_connections 2023-08-17T17:49:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.641+0000 7f87d6ad1700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87bc05ed90 0x7f87bc061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.641+0000 7f87d6ad1700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87d0154140 0x7f87d00c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.641+0000 7f87d6ad1700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87d00a7c40 0x7f87d014ea20 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.641+0000 7f87d6ad1700 1 --2- 172.21.15.78:0/3690441975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87d00c1010 0x7f87d00c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:22.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.641+0000 7f87d6ad1700 1 -- 172.21.15.78:0/3690441975 >> 172.21.15.78:0/3690441975 conn(0x7f87d0094510 msgr2=0x7f87d00c04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:22.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.642+0000 7f87d6ad1700 1 -- 172.21.15.78:0/3690441975 shutdown_connections 2023-08-17T17:49:22.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.642+0000 7f87d6ad1700 1 -- 172.21.15.78:0/3690441975 wait complete. 2023-08-17T17:49:22.645 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:49:22.653 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-17T17:49:20.697698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404224,"kb_used_data":6976,"kb_used_omap":0,"kb_used_meta":2397184,"kb_avail":752570496,"statfs":{"total":773094113280,"available":770632187904,"internally_reserved":0,"allocated":7143424,"data_stored":3484816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2454716416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27605,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.541558"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690957+0000","last_change":"2023-08-17T17:49:19.690957+0000","last_active":"2023-08-17T17:49:19.690957+0000","last_peered":"2023-08-17T17:49:19.690957+0000","last_clean":"2023-08-17T17:49:19.690957+0000","last_became_active":"2023-08-17T17:49:19.690636+0000","last_became_peered":"2023-08-17T17:49:19.690636+0000","last_unstale":"2023-08-17T17:49:19.690957+0000","last_undegraded":"2023-08-17T17:49:19.690957+0000","last_fullsized":"2023-08-17T17:49:19.690957+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"76'3","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681840+0000","last_change":"2023-08-17T17:49:19.322111+0000","last_active":"2023-08-17T17:49:19.681840+0000","last_peered":"2023-08-17T17:49:19.681840+0000","last_clean":"2023-08-17T17:49:19.681840+0000","last_became_active":"2023-08-17T17:49:19.321778+0000","last_became_peered":"2023-08-17T17:49:19.321778+0000","last_unstale":"2023-08-17T17:49:19.681840+0000","last_undegraded":"2023-08-17T17:49:19.681840+0000","last_fullsized":"2023-08-17T17:49:19.681840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699590+0000","last_change":"2023-08-17T17:49:19.699664+0000","last_active":"2023-08-17T17:49:19.699590+0000","last_peered":"2023-08-17T17:49:19.699590+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699416+0000","last_became_peered":"2023-08-17T17:49:19.699416+0000","last_unstale":"2023-08-17T17:49:19.699590+0000","last_undegraded":"2023-08-17T17:49:19.699590+0000","last_fullsized":"2023-08-17T17:49:19.699590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.333353+0000","last_change":"2023-08-17T17:49:19.322333+0000","last_active":"2023-08-17T17:49:19.333353+0000","last_peered":"2023-08-17T17:49:19.333353+0000","last_clean":"2023-08-17T17:49:19.333353+0000","last_became_active":"2023-08-17T17:49:19.322077+0000","last_became_peered":"2023-08-17T17:49:19.322077+0000","last_unstale":"2023-08-17T17:49:19.333353+0000","last_undegraded":"2023-08-17T17:49:19.333353+0000","last_fullsized":"2023-08-17T17:49:19.333353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691445+0000","last_change":"2023-08-17T17:49:19.691522+0000","last_active":"2023-08-17T17:49:19.691445+0000","last_peered":"2023-08-17T17:49:19.691445+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691238+0000","last_became_peered":"2023-08-17T17:49:19.691238+0000","last_unstale":"2023-08-17T17:49:19.691445+0000","last_undegraded":"2023-08-17T17:49:19.691445+0000","last_fullsized":"2023-08-17T17:49:19.691445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337355+0000","last_change":"2023-08-17T17:49:19.333619+0000","last_active":"2023-08-17T17:49:19.337355+0000","last_peered":"2023-08-17T17:49:19.337355+0000","last_clean":"2023-08-17T17:49:19.337355+0000","last_became_active":"2023-08-17T17:49:19.333272+0000","last_became_peered":"2023-08-17T17:49:19.333272+0000","last_unstale":"2023-08-17T17:49:19.337355+0000","last_undegraded":"2023-08-17T17:49:19.337355+0000","last_fullsized":"2023-08-17T17:49:19.337355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694661+0000","last_change":"2023-08-17T17:49:19.694730+0000","last_active":"2023-08-17T17:49:19.694661+0000","last_peered":"2023-08-17T17:49:19.694661+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694310+0000","last_became_peered":"2023-08-17T17:49:19.694310+0000","last_unstale":"2023-08-17T17:49:19.694661+0000","last_undegraded":"2023-08-17T17:49:19.694661+0000","last_fullsized":"2023-08-17T17:49:19.694661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.331394+0000","last_change":"2023-08-17T17:49:19.325701+0000","last_active":"2023-08-17T17:49:19.331394+0000","last_peered":"2023-08-17T17:49:19.331394+0000","last_clean":"2023-08-17T17:49:19.331394+0000","last_became_active":"2023-08-17T17:49:19.325396+0000","last_became_peered":"2023-08-17T17:49:19.325396+0000","last_unstale":"2023-08-17T17:49:19.331394+0000","last_undegraded":"2023-08-17T17:49:19.331394+0000","last_fullsized":"2023-08-17T17:49:19.331394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.679803+0000","last_change":"2023-08-17T17:49:19.679944+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.679803+0000","last_undegraded":"2023-08-17T17:49:19.679803+0000","last_fullsized":"2023-08-17T17:49:19.679803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334625+0000","last_change":"2023-08-17T17:49:19.327117+0000","last_active":"2023-08-17T17:49:19.334625+0000","last_peered":"2023-08-17T17:49:19.334625+0000","last_clean":"2023-08-17T17:49:19.334625+0000","last_became_active":"2023-08-17T17:49:19.326840+0000","last_became_peered":"2023-08-17T17:49:19.326840+0000","last_unstale":"2023-08-17T17:49:19.334625+0000","last_undegraded":"2023-08-17T17:49:19.334625+0000","last_fullsized":"2023-08-17T17:49:19.334625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681781+0000","last_change":"2023-08-17T17:49:19.681912+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681781+0000","last_undegraded":"2023-08-17T17:49:19.681781+0000","last_fullsized":"2023-08-17T17:49:19.681781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324960+0000","last_change":"2023-08-17T17:49:19.319123+0000","last_active":"2023-08-17T17:49:19.324960+0000","last_peered":"2023-08-17T17:49:19.324960+0000","last_clean":"2023-08-17T17:49:19.324960+0000","last_became_active":"2023-08-17T17:49:19.318595+0000","last_became_peered":"2023-08-17T17:49:19.318595+0000","last_unstale":"2023-08-17T17:49:19.324960+0000","last_undegraded":"2023-08-17T17:49:19.324960+0000","last_fullsized":"2023-08-17T17:49:19.324960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687049+0000","last_change":"2023-08-17T17:49:19.687171+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687049+0000","last_undegraded":"2023-08-17T17:49:19.687049+0000","last_fullsized":"2023-08-17T17:49:19.687049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332903+0000","last_change":"2023-08-17T17:49:19.329857+0000","last_active":"2023-08-17T17:49:19.332903+0000","last_peered":"2023-08-17T17:49:19.332903+0000","last_clean":"2023-08-17T17:49:19.332903+0000","last_became_active":"2023-08-17T17:49:19.329112+0000","last_became_peered":"2023-08-17T17:49:19.329112+0000","last_unstale":"2023-08-17T17:49:19.332903+0000","last_undegraded":"2023-08-17T17:49:19.332903+0000","last_fullsized":"2023-08-17T17:49:19.332903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.688432+0000","last_change":"2023-08-17T17:49:19.688432+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.688432+0000","last_undegraded":"2023-08-17T17:49:19.688432+0000","last_fullsized":"2023-08-17T17:49:19.688432+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332256+0000","last_change":"2023-08-17T17:49:19.324543+0000","last_active":"2023-08-17T17:49:19.332256+0000","last_peered":"2023-08-17T17:49:19.332256+0000","last_clean":"2023-08-17T17:49:19.332256+0000","last_became_active":"2023-08-17T17:49:19.324266+0000","last_became_peered":"2023-08-17T17:49:19.324266+0000","last_unstale":"2023-08-17T17:49:19.332256+0000","last_undegraded":"2023-08-17T17:49:19.332256+0000","last_fullsized":"2023-08-17T17:49:19.332256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.679097+0000","last_change":"2023-08-17T17:49:19.679235+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.679097+0000","last_undegraded":"2023-08-17T17:49:19.679097+0000","last_fullsized":"2023-08-17T17:49:19.679097+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327444+0000","last_change":"2023-08-17T17:49:19.325582+0000","last_active":"2023-08-17T17:49:19.327444+0000","last_peered":"2023-08-17T17:49:19.327444+0000","last_clean":"2023-08-17T17:49:19.327444+0000","last_became_active":"2023-08-17T17:49:19.325292+0000","last_became_peered":"2023-08-17T17:49:19.325292+0000","last_unstale":"2023-08-17T17:49:19.327444+0000","last_undegraded":"2023-08-17T17:49:19.327444+0000","last_fullsized":"2023-08-17T17:49:19.327444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697554+0000","last_change":"2023-08-17T17:49:19.697630+0000","last_active":"2023-08-17T17:49:19.697554+0000","last_peered":"2023-08-17T17:49:19.697554+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.697302+0000","last_became_peered":"2023-08-17T17:49:19.697302+0000","last_unstale":"2023-08-17T17:49:19.697554+0000","last_undegraded":"2023-08-17T17:49:19.697554+0000","last_fullsized":"2023-08-17T17:49:19.697554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335268+0000","last_change":"2023-08-17T17:49:19.327360+0000","last_active":"2023-08-17T17:49:19.335268+0000","last_peered":"2023-08-17T17:49:19.335268+0000","last_clean":"2023-08-17T17:49:19.335268+0000","last_became_active":"2023-08-17T17:49:19.327081+0000","last_became_peered":"2023-08-17T17:49:19.327081+0000","last_unstale":"2023-08-17T17:49:19.335268+0000","last_undegraded":"2023-08-17T17:49:19.335268+0000","last_fullsized":"2023-08-17T17:49:19.335268+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700423+0000","last_change":"2023-08-17T17:49:19.700495+0000","last_active":"2023-08-17T17:49:19.700423+0000","last_peered":"2023-08-17T17:49:19.700423+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700216+0000","last_became_peered":"2023-08-17T17:49:19.700216+0000","last_unstale":"2023-08-17T17:49:19.700423+0000","last_undegraded":"2023-08-17T17:49:19.700423+0000","last_fullsized":"2023-08-17T17:49:19.700423+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332221+0000","last_change":"2023-08-17T17:49:19.323045+0000","last_active":"2023-08-17T17:49:19.332221+0000","last_peered":"2023-08-17T17:49:19.332221+0000","last_clean":"2023-08-17T17:49:19.332221+0000","last_became_active":"2023-08-17T17:49:19.322755+0000","last_became_peered":"2023-08-17T17:49:19.322755+0000","last_unstale":"2023-08-17T17:49:19.332221+0000","last_undegraded":"2023-08-17T17:49:19.332221+0000","last_fullsized":"2023-08-17T17:49:19.332221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.690552+0000","last_change":"2023-08-17T17:49:19.692027+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.690552+0000","last_undegraded":"2023-08-17T17:49:19.690552+0000","last_fullsized":"2023-08-17T17:49:19.690552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334796+0000","last_change":"2023-08-17T17:49:19.330926+0000","last_active":"2023-08-17T17:49:19.334796+0000","last_peered":"2023-08-17T17:49:19.334796+0000","last_clean":"2023-08-17T17:49:19.334796+0000","last_became_active":"2023-08-17T17:49:19.330379+0000","last_became_peered":"2023-08-17T17:49:19.330379+0000","last_unstale":"2023-08-17T17:49:19.334796+0000","last_undegraded":"2023-08-17T17:49:19.334796+0000","last_fullsized":"2023-08-17T17:49:19.334796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681409+0000","last_change":"2023-08-17T17:49:19.681509+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681409+0000","last_undegraded":"2023-08-17T17:49:19.681409+0000","last_fullsized":"2023-08-17T17:49:19.681409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.336938+0000","last_change":"2023-08-17T17:49:19.331576+0000","last_active":"2023-08-17T17:49:19.336938+0000","last_peered":"2023-08-17T17:49:19.336938+0000","last_clean":"2023-08-17T17:49:19.336938+0000","last_became_active":"2023-08-17T17:49:19.331285+0000","last_became_peered":"2023-08-17T17:49:19.331285+0000","last_unstale":"2023-08-17T17:49:19.336938+0000","last_undegraded":"2023-08-17T17:49:19.336938+0000","last_fullsized":"2023-08-17T17:49:19.336938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.701110+0000","last_change":"2023-08-17T17:49:19.701187+0000","last_active":"2023-08-17T17:49:19.701110+0000","last_peered":"2023-08-17T17:49:19.701110+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700922+0000","last_became_peered":"2023-08-17T17:49:19.700922+0000","last_unstale":"2023-08-17T17:49:19.701110+0000","last_undegraded":"2023-08-17T17:49:19.701110+0000","last_fullsized":"2023-08-17T17:49:19.701110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325494+0000","last_change":"2023-08-17T17:49:19.323917+0000","last_active":"2023-08-17T17:49:19.325494+0000","last_peered":"2023-08-17T17:49:19.325494+0000","last_clean":"2023-08-17T17:49:19.325494+0000","last_became_active":"2023-08-17T17:49:19.323538+0000","last_became_peered":"2023-08-17T17:49:19.323538+0000","last_unstale":"2023-08-17T17:49:19.325494+0000","last_undegraded":"2023-08-17T17:49:19.325494+0000","last_fullsized":"2023-08-17T17:49:19.325494+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696884+0000","last_change":"2023-08-17T17:49:19.696962+0000","last_active":"2023-08-17T17:49:19.696884+0000","last_peered":"2023-08-17T17:49:19.696884+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696322+0000","last_became_peered":"2023-08-17T17:49:19.696322+0000","last_unstale":"2023-08-17T17:49:19.696884+0000","last_undegraded":"2023-08-17T17:49:19.696884+0000","last_fullsized":"2023-08-17T17:49:19.696884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332883+0000","last_change":"2023-08-17T17:49:19.329416+0000","last_active":"2023-08-17T17:49:19.332883+0000","last_peered":"2023-08-17T17:49:19.332883+0000","last_clean":"2023-08-17T17:49:19.332883+0000","last_became_active":"2023-08-17T17:49:19.328707+0000","last_became_peered":"2023-08-17T17:49:19.328707+0000","last_unstale":"2023-08-17T17:49:19.332883+0000","last_undegraded":"2023-08-17T17:49:19.332883+0000","last_fullsized":"2023-08-17T17:49:19.332883+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694435+0000","last_change":"2023-08-17T17:49:19.694511+0000","last_active":"2023-08-17T17:49:19.694435+0000","last_peered":"2023-08-17T17:49:19.694435+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694182+0000","last_became_peered":"2023-08-17T17:49:19.694182+0000","last_unstale":"2023-08-17T17:49:19.694435+0000","last_undegraded":"2023-08-17T17:49:19.694435+0000","last_fullsized":"2023-08-17T17:49:19.694435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334887+0000","last_change":"2023-08-17T17:49:19.327993+0000","last_active":"2023-08-17T17:49:19.334887+0000","last_peered":"2023-08-17T17:49:19.334887+0000","last_clean":"2023-08-17T17:49:19.334887+0000","last_became_active":"2023-08-17T17:49:19.327700+0000","last_became_peered":"2023-08-17T17:49:19.327700+0000","last_unstale":"2023-08-17T17:49:19.334887+0000","last_undegraded":"2023-08-17T17:49:19.334887+0000","last_fullsized":"2023-08-17T17:49:19.334887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.682674+0000","last_change":"2023-08-17T17:49:19.682807+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.682674+0000","last_undegraded":"2023-08-17T17:49:19.682674+0000","last_fullsized":"2023-08-17T17:49:19.682674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335255+0000","last_change":"2023-08-17T17:49:19.328079+0000","last_active":"2023-08-17T17:49:19.335255+0000","last_peered":"2023-08-17T17:49:19.335255+0000","last_clean":"2023-08-17T17:49:19.335255+0000","last_became_active":"2023-08-17T17:49:19.327794+0000","last_became_peered":"2023-08-17T17:49:19.327794+0000","last_unstale":"2023-08-17T17:49:19.335255+0000","last_undegraded":"2023-08-17T17:49:19.335255+0000","last_fullsized":"2023-08-17T17:49:19.335255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694699+0000","last_change":"2023-08-17T17:49:19.694776+0000","last_active":"2023-08-17T17:49:19.694699+0000","last_peered":"2023-08-17T17:49:19.694699+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694363+0000","last_became_peered":"2023-08-17T17:49:19.694363+0000","last_unstale":"2023-08-17T17:49:19.694699+0000","last_undegraded":"2023-08-17T17:49:19.694699+0000","last_fullsized":"2023-08-17T17:49:19.694699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337851+0000","last_change":"2023-08-17T17:49:19.335785+0000","last_active":"2023-08-17T17:49:19.337851+0000","last_peered":"2023-08-17T17:49:19.337851+0000","last_clean":"2023-08-17T17:49:19.337851+0000","last_became_active":"2023-08-17T17:49:19.335488+0000","last_became_peered":"2023-08-17T17:49:19.335488+0000","last_unstale":"2023-08-17T17:49:19.337851+0000","last_undegraded":"2023-08-17T17:49:19.337851+0000","last_fullsized":"2023-08-17T17:49:19.337851+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693865+0000","last_change":"2023-08-17T17:49:19.693865+0000","last_active":"2023-08-17T17:49:19.693865+0000","last_peered":"2023-08-17T17:49:19.693865+0000","last_clean":"2023-08-17T17:49:19.693865+0000","last_became_active":"2023-08-17T17:49:19.692912+0000","last_became_peered":"2023-08-17T17:49:19.692912+0000","last_unstale":"2023-08-17T17:49:19.693865+0000","last_undegraded":"2023-08-17T17:49:19.693865+0000","last_fullsized":"2023-08-17T17:49:19.693865+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327087+0000","last_change":"2023-08-17T17:49:19.322192+0000","last_active":"2023-08-17T17:49:19.327087+0000","last_peered":"2023-08-17T17:49:19.327087+0000","last_clean":"2023-08-17T17:49:19.327087+0000","last_became_active":"2023-08-17T17:49:19.321913+0000","last_became_peered":"2023-08-17T17:49:19.321913+0000","last_unstale":"2023-08-17T17:49:19.327087+0000","last_undegraded":"2023-08-17T17:49:19.327087+0000","last_fullsized":"2023-08-17T17:49:19.327087+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694493+0000","last_change":"2023-08-17T17:49:19.694568+0000","last_active":"2023-08-17T17:49:19.694493+0000","last_peered":"2023-08-17T17:49:19.694493+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693972+0000","last_became_peered":"2023-08-17T17:49:19.693972+0000","last_unstale":"2023-08-17T17:49:19.694493+0000","last_undegraded":"2023-08-17T17:49:19.694493+0000","last_fullsized":"2023-08-17T17:49:19.694493+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335091+0000","last_change":"2023-08-17T17:49:19.326035+0000","last_active":"2023-08-17T17:49:19.335091+0000","last_peered":"2023-08-17T17:49:19.335091+0000","last_clean":"2023-08-17T17:49:19.335091+0000","last_became_active":"2023-08-17T17:49:19.325780+0000","last_became_peered":"2023-08-17T17:49:19.325780+0000","last_unstale":"2023-08-17T17:49:19.335091+0000","last_undegraded":"2023-08-17T17:49:19.335091+0000","last_fullsized":"2023-08-17T17:49:19.335091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696688+0000","last_change":"2023-08-17T17:49:19.696765+0000","last_active":"2023-08-17T17:49:19.696688+0000","last_peered":"2023-08-17T17:49:19.696688+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696474+0000","last_became_peered":"2023-08-17T17:49:19.696474+0000","last_unstale":"2023-08-17T17:49:19.696688+0000","last_undegraded":"2023-08-17T17:49:19.696688+0000","last_fullsized":"2023-08-17T17:49:19.696688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337370+0000","last_change":"2023-08-17T17:49:19.333623+0000","last_active":"2023-08-17T17:49:19.337370+0000","last_peered":"2023-08-17T17:49:19.337370+0000","last_clean":"2023-08-17T17:49:19.337370+0000","last_became_active":"2023-08-17T17:49:19.333170+0000","last_became_peered":"2023-08-17T17:49:19.333170+0000","last_unstale":"2023-08-17T17:49:19.337370+0000","last_undegraded":"2023-08-17T17:49:19.337370+0000","last_fullsized":"2023-08-17T17:49:19.337370+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.682255+0000","last_change":"2023-08-17T17:49:19.682401+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.682255+0000","last_undegraded":"2023-08-17T17:49:19.682255+0000","last_fullsized":"2023-08-17T17:49:19.682255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332291+0000","last_change":"2023-08-17T17:49:19.321366+0000","last_active":"2023-08-17T17:49:19.332291+0000","last_peered":"2023-08-17T17:49:19.332291+0000","last_clean":"2023-08-17T17:49:19.332291+0000","last_became_active":"2023-08-17T17:49:19.321072+0000","last_became_peered":"2023-08-17T17:49:19.321072+0000","last_unstale":"2023-08-17T17:49:19.332291+0000","last_undegraded":"2023-08-17T17:49:19.332291+0000","last_fullsized":"2023-08-17T17:49:19.332291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.683524+0000","last_change":"2023-08-17T17:49:19.683665+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.683524+0000","last_undegraded":"2023-08-17T17:49:19.683524+0000","last_fullsized":"2023-08-17T17:49:19.683524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337954+0000","last_change":"2023-08-17T17:49:19.336558+0000","last_active":"2023-08-17T17:49:19.337954+0000","last_peered":"2023-08-17T17:49:19.337954+0000","last_clean":"2023-08-17T17:49:19.337954+0000","last_became_active":"2023-08-17T17:49:19.336291+0000","last_became_peered":"2023-08-17T17:49:19.336291+0000","last_unstale":"2023-08-17T17:49:19.337954+0000","last_undegraded":"2023-08-17T17:49:19.337954+0000","last_fullsized":"2023-08-17T17:49:19.337954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.687375+0000","last_change":"2023-08-17T17:49:19.687375+0000","last_active":"2023-08-17T17:49:19.687375+0000","last_peered":"2023-08-17T17:49:19.687375+0000","last_clean":"2023-08-17T17:49:19.687375+0000","last_became_active":"2023-08-17T17:49:19.687084+0000","last_became_peered":"2023-08-17T17:49:19.687084+0000","last_unstale":"2023-08-17T17:49:19.687375+0000","last_undegraded":"2023-08-17T17:49:19.687375+0000","last_fullsized":"2023-08-17T17:49:19.687375+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337102+0000","last_change":"2023-08-17T17:49:19.335235+0000","last_active":"2023-08-17T17:49:19.337102+0000","last_peered":"2023-08-17T17:49:19.337102+0000","last_clean":"2023-08-17T17:49:19.337102+0000","last_became_active":"2023-08-17T17:49:19.334926+0000","last_became_peered":"2023-08-17T17:49:19.334926+0000","last_unstale":"2023-08-17T17:49:19.337102+0000","last_undegraded":"2023-08-17T17:49:19.337102+0000","last_fullsized":"2023-08-17T17:49:19.337102+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.677752+0000","last_change":"2023-08-17T17:49:19.677862+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.677752+0000","last_undegraded":"2023-08-17T17:49:19.677752+0000","last_fullsized":"2023-08-17T17:49:19.677752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324850+0000","last_change":"2023-08-17T17:49:19.320286+0000","last_active":"2023-08-17T17:49:19.324850+0000","last_peered":"2023-08-17T17:49:19.324850+0000","last_clean":"2023-08-17T17:49:19.324850+0000","last_became_active":"2023-08-17T17:49:19.320004+0000","last_became_peered":"2023-08-17T17:49:19.320004+0000","last_unstale":"2023-08-17T17:49:19.324850+0000","last_undegraded":"2023-08-17T17:49:19.324850+0000","last_fullsized":"2023-08-17T17:49:19.324850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696689+0000","last_change":"2023-08-17T17:49:19.696763+0000","last_active":"2023-08-17T17:49:19.696689+0000","last_peered":"2023-08-17T17:49:19.696689+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693241+0000","last_became_peered":"2023-08-17T17:49:19.693241+0000","last_unstale":"2023-08-17T17:49:19.696689+0000","last_undegraded":"2023-08-17T17:49:19.696689+0000","last_fullsized":"2023-08-17T17:49:19.696689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329975+0000","last_change":"2023-08-17T17:49:19.325997+0000","last_active":"2023-08-17T17:49:19.329975+0000","last_peered":"2023-08-17T17:49:19.329975+0000","last_clean":"2023-08-17T17:49:19.329975+0000","last_became_active":"2023-08-17T17:49:19.325180+0000","last_became_peered":"2023-08-17T17:49:19.325180+0000","last_unstale":"2023-08-17T17:49:19.329975+0000","last_undegraded":"2023-08-17T17:49:19.329975+0000","last_fullsized":"2023-08-17T17:49:19.329975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693028+0000","last_change":"2023-08-17T17:49:19.693095+0000","last_active":"2023-08-17T17:49:19.693028+0000","last_peered":"2023-08-17T17:49:19.693028+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692720+0000","last_became_peered":"2023-08-17T17:49:19.692720+0000","last_unstale":"2023-08-17T17:49:19.693028+0000","last_undegraded":"2023-08-17T17:49:19.693028+0000","last_fullsized":"2023-08-17T17:49:19.693028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334824+0000","last_change":"2023-08-17T17:49:19.327881+0000","last_active":"2023-08-17T17:49:19.334824+0000","last_peered":"2023-08-17T17:49:19.334824+0000","last_clean":"2023-08-17T17:49:19.334824+0000","last_became_active":"2023-08-17T17:49:19.327652+0000","last_became_peered":"2023-08-17T17:49:19.327652+0000","last_unstale":"2023-08-17T17:49:19.334824+0000","last_undegraded":"2023-08-17T17:49:19.334824+0000","last_fullsized":"2023-08-17T17:49:19.334824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693000+0000","last_change":"2023-08-17T17:49:19.693081+0000","last_active":"2023-08-17T17:49:19.693000+0000","last_peered":"2023-08-17T17:49:19.693000+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692808+0000","last_became_peered":"2023-08-17T17:49:19.692808+0000","last_unstale":"2023-08-17T17:49:19.693000+0000","last_undegraded":"2023-08-17T17:49:19.693000+0000","last_fullsized":"2023-08-17T17:49:19.693000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334588+0000","last_change":"2023-08-17T17:49:19.326742+0000","last_active":"2023-08-17T17:49:19.334588+0000","last_peered":"2023-08-17T17:49:19.334588+0000","last_clean":"2023-08-17T17:49:19.334588+0000","last_became_active":"2023-08-17T17:49:19.326380+0000","last_became_peered":"2023-08-17T17:49:19.326380+0000","last_unstale":"2023-08-17T17:49:19.334588+0000","last_undegraded":"2023-08-17T17:49:19.334588+0000","last_fullsized":"2023-08-17T17:49:19.334588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692196+0000","last_change":"2023-08-17T17:49:19.692243+0000","last_active":"2023-08-17T17:49:19.692196+0000","last_peered":"2023-08-17T17:49:19.692196+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692016+0000","last_became_peered":"2023-08-17T17:49:19.692016+0000","last_unstale":"2023-08-17T17:49:19.692196+0000","last_undegraded":"2023-08-17T17:49:19.692196+0000","last_fullsized":"2023-08-17T17:49:19.692196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335381+0000","last_change":"2023-08-17T17:49:19.329807+0000","last_active":"2023-08-17T17:49:19.335381+0000","last_peered":"2023-08-17T17:49:19.335381+0000","last_clean":"2023-08-17T17:49:19.335381+0000","last_became_active":"2023-08-17T17:49:19.329559+0000","last_became_peered":"2023-08-17T17:49:19.329559+0000","last_unstale":"2023-08-17T17:49:19.335381+0000","last_undegraded":"2023-08-17T17:49:19.335381+0000","last_fullsized":"2023-08-17T17:49:19.335381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690145+0000","last_change":"2023-08-17T17:49:19.690145+0000","last_active":"2023-08-17T17:49:19.690145+0000","last_peered":"2023-08-17T17:49:19.690145+0000","last_clean":"2023-08-17T17:49:19.690145+0000","last_became_active":"2023-08-17T17:49:19.689032+0000","last_became_peered":"2023-08-17T17:49:19.689032+0000","last_unstale":"2023-08-17T17:49:19.690145+0000","last_undegraded":"2023-08-17T17:49:19.690145+0000","last_fullsized":"2023-08-17T17:49:19.690145+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337392+0000","last_change":"2023-08-17T17:49:19.333863+0000","last_active":"2023-08-17T17:49:19.337392+0000","last_peered":"2023-08-17T17:49:19.337392+0000","last_clean":"2023-08-17T17:49:19.337392+0000","last_became_active":"2023-08-17T17:49:19.333293+0000","last_became_peered":"2023-08-17T17:49:19.333293+0000","last_unstale":"2023-08-17T17:49:19.337392+0000","last_undegraded":"2023-08-17T17:49:19.337392+0000","last_fullsized":"2023-08-17T17:49:19.337392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694365+0000","last_change":"2023-08-17T17:49:19.694448+0000","last_active":"2023-08-17T17:49:19.694365+0000","last_peered":"2023-08-17T17:49:19.694365+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694151+0000","last_became_peered":"2023-08-17T17:49:19.694151+0000","last_unstale":"2023-08-17T17:49:19.694365+0000","last_undegraded":"2023-08-17T17:49:19.694365+0000","last_fullsized":"2023-08-17T17:49:19.694365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324872+0000","last_change":"2023-08-17T17:49:19.320718+0000","last_active":"2023-08-17T17:49:19.324872+0000","last_peered":"2023-08-17T17:49:19.324872+0000","last_clean":"2023-08-17T17:49:19.324872+0000","last_became_active":"2023-08-17T17:49:19.320287+0000","last_became_peered":"2023-08-17T17:49:19.320287+0000","last_unstale":"2023-08-17T17:49:19.324872+0000","last_undegraded":"2023-08-17T17:49:19.324872+0000","last_fullsized":"2023-08-17T17:49:19.324872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.692331+0000","last_change":"2023-08-17T17:49:19.692457+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.692331+0000","last_undegraded":"2023-08-17T17:49:19.692331+0000","last_fullsized":"2023-08-17T17:49:19.692331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325398+0000","last_change":"2023-08-17T17:49:19.319827+0000","last_active":"2023-08-17T17:49:19.325398+0000","last_peered":"2023-08-17T17:49:19.325398+0000","last_clean":"2023-08-17T17:49:19.325398+0000","last_became_active":"2023-08-17T17:49:19.319566+0000","last_became_peered":"2023-08-17T17:49:19.319566+0000","last_unstale":"2023-08-17T17:49:19.325398+0000","last_undegraded":"2023-08-17T17:49:19.325398+0000","last_fullsized":"2023-08-17T17:49:19.325398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.686254+0000","last_change":"2023-08-17T17:49:19.686415+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.686254+0000","last_undegraded":"2023-08-17T17:49:19.686254+0000","last_fullsized":"2023-08-17T17:49:19.686254+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"76'1","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.677637+0000","last_change":"2023-08-17T17:49:19.323093+0000","last_active":"2023-08-17T17:49:19.677637+0000","last_peered":"2023-08-17T17:49:19.677637+0000","last_clean":"2023-08-17T17:49:19.677637+0000","last_became_active":"2023-08-17T17:49:19.322816+0000","last_became_peered":"2023-08-17T17:49:19.322816+0000","last_unstale":"2023-08-17T17:49:19.677637+0000","last_undegraded":"2023-08-17T17:49:19.677637+0000","last_fullsized":"2023-08-17T17:49:19.677637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696502+0000","last_change":"2023-08-17T17:49:19.696576+0000","last_active":"2023-08-17T17:49:19.696502+0000","last_peered":"2023-08-17T17:49:19.696502+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696279+0000","last_became_peered":"2023-08-17T17:49:19.696279+0000","last_unstale":"2023-08-17T17:49:19.696502+0000","last_undegraded":"2023-08-17T17:49:19.696502+0000","last_fullsized":"2023-08-17T17:49:19.696502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335223+0000","last_change":"2023-08-17T17:49:19.330805+0000","last_active":"2023-08-17T17:49:19.335223+0000","last_peered":"2023-08-17T17:49:19.335223+0000","last_clean":"2023-08-17T17:49:19.335223+0000","last_became_active":"2023-08-17T17:49:19.330398+0000","last_became_peered":"2023-08-17T17:49:19.330398+0000","last_unstale":"2023-08-17T17:49:19.335223+0000","last_undegraded":"2023-08-17T17:49:19.335223+0000","last_fullsized":"2023-08-17T17:49:19.335223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691533+0000","last_change":"2023-08-17T17:49:19.691581+0000","last_active":"2023-08-17T17:49:19.691533+0000","last_peered":"2023-08-17T17:49:19.691533+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691339+0000","last_became_peered":"2023-08-17T17:49:19.691339+0000","last_unstale":"2023-08-17T17:49:19.691533+0000","last_undegraded":"2023-08-17T17:49:19.691533+0000","last_fullsized":"2023-08-17T17:49:19.691533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334894+0000","last_change":"2023-08-17T17:49:19.329057+0000","last_active":"2023-08-17T17:49:19.334894+0000","last_peered":"2023-08-17T17:49:19.334894+0000","last_clean":"2023-08-17T17:49:19.334894+0000","last_became_active":"2023-08-17T17:49:19.328426+0000","last_became_peered":"2023-08-17T17:49:19.328426+0000","last_unstale":"2023-08-17T17:49:19.334894+0000","last_undegraded":"2023-08-17T17:49:19.334894+0000","last_fullsized":"2023-08-17T17:49:19.334894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699148+0000","last_change":"2023-08-17T17:49:19.699229+0000","last_active":"2023-08-17T17:49:19.699148+0000","last_peered":"2023-08-17T17:49:19.699148+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.698921+0000","last_became_peered":"2023-08-17T17:49:19.698921+0000","last_unstale":"2023-08-17T17:49:19.699148+0000","last_undegraded":"2023-08-17T17:49:19.699148+0000","last_fullsized":"2023-08-17T17:49:19.699148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329603+0000","last_change":"2023-08-17T17:49:19.322832+0000","last_active":"2023-08-17T17:49:19.329603+0000","last_peered":"2023-08-17T17:49:19.329603+0000","last_clean":"2023-08-17T17:49:19.329603+0000","last_became_active":"2023-08-17T17:49:19.322554+0000","last_became_peered":"2023-08-17T17:49:19.322554+0000","last_unstale":"2023-08-17T17:49:19.329603+0000","last_undegraded":"2023-08-17T17:49:19.329603+0000","last_fullsized":"2023-08-17T17:49:19.329603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684718+0000","last_change":"2023-08-17T17:49:19.684718+0000","last_active":"2023-08-17T17:49:19.684718+0000","last_peered":"2023-08-17T17:49:19.684718+0000","last_clean":"2023-08-17T17:49:19.684718+0000","last_became_active":"2023-08-17T17:49:19.684444+0000","last_became_peered":"2023-08-17T17:49:19.684444+0000","last_unstale":"2023-08-17T17:49:19.684718+0000","last_undegraded":"2023-08-17T17:49:19.684718+0000","last_fullsized":"2023-08-17T17:49:19.684718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335286+0000","last_change":"2023-08-17T17:49:19.326042+0000","last_active":"2023-08-17T17:49:19.335286+0000","last_peered":"2023-08-17T17:49:19.335286+0000","last_clean":"2023-08-17T17:49:19.335286+0000","last_became_active":"2023-08-17T17:49:19.325675+0000","last_became_peered":"2023-08-17T17:49:19.325675+0000","last_unstale":"2023-08-17T17:49:19.335286+0000","last_undegraded":"2023-08-17T17:49:19.335286+0000","last_fullsized":"2023-08-17T17:49:19.335286+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691069+0000","last_change":"2023-08-17T17:49:19.691116+0000","last_active":"2023-08-17T17:49:19.691069+0000","last_peered":"2023-08-17T17:49:19.691069+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.690769+0000","last_became_peered":"2023-08-17T17:49:19.690769+0000","last_unstale":"2023-08-17T17:49:19.691069+0000","last_undegraded":"2023-08-17T17:49:19.691069+0000","last_fullsized":"2023-08-17T17:49:19.691069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325499+0000","last_change":"2023-08-17T17:49:19.319420+0000","last_active":"2023-08-17T17:49:19.325499+0000","last_peered":"2023-08-17T17:49:19.325499+0000","last_clean":"2023-08-17T17:49:19.325499+0000","last_became_active":"2023-08-17T17:49:19.319142+0000","last_became_peered":"2023-08-17T17:49:19.319142+0000","last_unstale":"2023-08-17T17:49:19.325499+0000","last_undegraded":"2023-08-17T17:49:19.325499+0000","last_fullsized":"2023-08-17T17:49:19.325499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687002+0000","last_change":"2023-08-17T17:49:19.687002+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687002+0000","last_undegraded":"2023-08-17T17:49:19.687002+0000","last_fullsized":"2023-08-17T17:49:19.687002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335208+0000","last_change":"2023-08-17T17:49:19.326823+0000","last_active":"2023-08-17T17:49:19.335208+0000","last_peered":"2023-08-17T17:49:19.335208+0000","last_clean":"2023-08-17T17:49:19.335208+0000","last_became_active":"2023-08-17T17:49:19.326542+0000","last_became_peered":"2023-08-17T17:49:19.326542+0000","last_unstale":"2023-08-17T17:49:19.335208+0000","last_undegraded":"2023-08-17T17:49:19.335208+0000","last_fullsized":"2023-08-17T17:49:19.335208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694743+0000","last_change":"2023-08-17T17:49:19.694817+0000","last_active":"2023-08-17T17:49:19.694743+0000","last_peered":"2023-08-17T17:49:19.694743+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694557+0000","last_became_peered":"2023-08-17T17:49:19.694557+0000","last_unstale":"2023-08-17T17:49:19.694743+0000","last_undegraded":"2023-08-17T17:49:19.694743+0000","last_fullsized":"2023-08-17T17:49:19.694743+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337082+0000","last_change":"2023-08-17T17:49:19.334413+0000","last_active":"2023-08-17T17:49:19.337082+0000","last_peered":"2023-08-17T17:49:19.337082+0000","last_clean":"2023-08-17T17:49:19.337082+0000","last_became_active":"2023-08-17T17:49:19.334147+0000","last_became_peered":"2023-08-17T17:49:19.334147+0000","last_unstale":"2023-08-17T17:49:19.337082+0000","last_undegraded":"2023-08-17T17:49:19.337082+0000","last_fullsized":"2023-08-17T17:49:19.337082+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.686438+0000","last_change":"2023-08-17T17:49:19.686510+0000","last_active":"2023-08-17T17:49:19.686438+0000","last_peered":"2023-08-17T17:49:19.686438+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.686240+0000","last_became_peered":"2023-08-17T17:49:19.686240+0000","last_unstale":"2023-08-17T17:49:19.686438+0000","last_undegraded":"2023-08-17T17:49:19.686438+0000","last_fullsized":"2023-08-17T17:49:19.686438+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.340012+0000","last_change":"2023-08-17T17:49:19.338168+0000","last_active":"2023-08-17T17:49:19.340012+0000","last_peered":"2023-08-17T17:49:19.340012+0000","last_clean":"2023-08-17T17:49:19.340012+0000","last_became_active":"2023-08-17T17:49:19.337884+0000","last_became_peered":"2023-08-17T17:49:19.337884+0000","last_unstale":"2023-08-17T17:49:19.340012+0000","last_undegraded":"2023-08-17T17:49:19.340012+0000","last_fullsized":"2023-08-17T17:49:19.340012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693666+0000","last_change":"2023-08-17T17:49:19.693724+0000","last_active":"2023-08-17T17:49:19.693666+0000","last_peered":"2023-08-17T17:49:19.693666+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693492+0000","last_became_peered":"2023-08-17T17:49:19.693492+0000","last_unstale":"2023-08-17T17:49:19.693666+0000","last_undegraded":"2023-08-17T17:49:19.693666+0000","last_fullsized":"2023-08-17T17:49:19.693666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332828+0000","last_change":"2023-08-17T17:49:19.329035+0000","last_active":"2023-08-17T17:49:19.332828+0000","last_peered":"2023-08-17T17:49:19.332828+0000","last_clean":"2023-08-17T17:49:19.332828+0000","last_became_active":"2023-08-17T17:49:19.328686+0000","last_became_peered":"2023-08-17T17:49:19.328686+0000","last_unstale":"2023-08-17T17:49:19.332828+0000","last_undegraded":"2023-08-17T17:49:19.332828+0000","last_fullsized":"2023-08-17T17:49:19.332828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700291+0000","last_change":"2023-08-17T17:49:19.700364+0000","last_active":"2023-08-17T17:49:19.700291+0000","last_peered":"2023-08-17T17:49:19.700291+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699817+0000","last_became_peered":"2023-08-17T17:49:19.699817+0000","last_unstale":"2023-08-17T17:49:19.700291+0000","last_undegraded":"2023-08-17T17:49:19.700291+0000","last_fullsized":"2023-08-17T17:49:19.700291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337936+0000","last_change":"2023-08-17T17:49:19.336413+0000","last_active":"2023-08-17T17:49:19.337936+0000","last_peered":"2023-08-17T17:49:19.337936+0000","last_clean":"2023-08-17T17:49:19.337936+0000","last_became_active":"2023-08-17T17:49:19.335592+0000","last_became_peered":"2023-08-17T17:49:19.335592+0000","last_unstale":"2023-08-17T17:49:19.337936+0000","last_undegraded":"2023-08-17T17:49:19.337936+0000","last_fullsized":"2023-08-17T17:49:19.337936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693521+0000","last_change":"2023-08-17T17:49:19.693521+0000","last_active":"2023-08-17T17:49:19.693521+0000","last_peered":"2023-08-17T17:49:19.693521+0000","last_clean":"2023-08-17T17:49:19.693521+0000","last_became_active":"2023-08-17T17:49:19.692996+0000","last_became_peered":"2023-08-17T17:49:19.692996+0000","last_unstale":"2023-08-17T17:49:19.693521+0000","last_undegraded":"2023-08-17T17:49:19.693521+0000","last_fullsized":"2023-08-17T17:49:19.693521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332394+0000","last_change":"2023-08-17T17:49:19.324642+0000","last_active":"2023-08-17T17:49:19.332394+0000","last_peered":"2023-08-17T17:49:19.332394+0000","last_clean":"2023-08-17T17:49:19.332394+0000","last_became_active":"2023-08-17T17:49:19.324327+0000","last_became_peered":"2023-08-17T17:49:19.324327+0000","last_unstale":"2023-08-17T17:49:19.332394+0000","last_undegraded":"2023-08-17T17:49:19.332394+0000","last_fullsized":"2023-08-17T17:49:19.332394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681553+0000","last_change":"2023-08-17T17:49:19.681690+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681553+0000","last_undegraded":"2023-08-17T17:49:19.681553+0000","last_fullsized":"2023-08-17T17:49:19.681553+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335183+0000","last_change":"2023-08-17T17:49:19.332436+0000","last_active":"2023-08-17T17:49:19.335183+0000","last_peered":"2023-08-17T17:49:19.335183+0000","last_clean":"2023-08-17T17:49:19.335183+0000","last_became_active":"2023-08-17T17:49:19.332146+0000","last_became_peered":"2023-08-17T17:49:19.332146+0000","last_unstale":"2023-08-17T17:49:19.335183+0000","last_undegraded":"2023-08-17T17:49:19.335183+0000","last_fullsized":"2023-08-17T17:49:19.335183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691921+0000","last_change":"2023-08-17T17:49:19.691991+0000","last_active":"2023-08-17T17:49:19.691921+0000","last_peered":"2023-08-17T17:49:19.691921+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691732+0000","last_became_peered":"2023-08-17T17:49:19.691732+0000","last_unstale":"2023-08-17T17:49:19.691921+0000","last_undegraded":"2023-08-17T17:49:19.691921+0000","last_fullsized":"2023-08-17T17:49:19.691921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329922+0000","last_change":"2023-08-17T17:49:19.325834+0000","last_active":"2023-08-17T17:49:19.329922+0000","last_peered":"2023-08-17T17:49:19.329922+0000","last_clean":"2023-08-17T17:49:19.329922+0000","last_became_active":"2023-08-17T17:49:19.325261+0000","last_became_peered":"2023-08-17T17:49:19.325261+0000","last_unstale":"2023-08-17T17:49:19.329922+0000","last_undegraded":"2023-08-17T17:49:19.329922+0000","last_fullsized":"2023-08-17T17:49:19.329922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700066+0000","last_change":"2023-08-17T17:49:19.700149+0000","last_active":"2023-08-17T17:49:19.700066+0000","last_peered":"2023-08-17T17:49:19.700066+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699838+0000","last_became_peered":"2023-08-17T17:49:19.699838+0000","last_unstale":"2023-08-17T17:49:19.700066+0000","last_undegraded":"2023-08-17T17:49:19.700066+0000","last_fullsized":"2023-08-17T17:49:19.700066+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337932+0000","last_change":"2023-08-17T17:49:19.336190+0000","last_active":"2023-08-17T17:49:19.337932+0000","last_peered":"2023-08-17T17:49:19.337932+0000","last_clean":"2023-08-17T17:49:19.337932+0000","last_became_active":"2023-08-17T17:49:19.335782+0000","last_became_peered":"2023-08-17T17:49:19.335782+0000","last_unstale":"2023-08-17T17:49:19.337932+0000","last_undegraded":"2023-08-17T17:49:19.337932+0000","last_fullsized":"2023-08-17T17:49:19.337932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.677312+0000","last_change":"2023-08-17T17:49:19.677442+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.677312+0000","last_undegraded":"2023-08-17T17:49:19.677312+0000","last_fullsized":"2023-08-17T17:49:19.677312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332836+0000","last_change":"2023-08-17T17:49:19.329884+0000","last_active":"2023-08-17T17:49:19.332836+0000","last_peered":"2023-08-17T17:49:19.332836+0000","last_clean":"2023-08-17T17:49:19.332836+0000","last_became_active":"2023-08-17T17:49:19.329498+0000","last_became_peered":"2023-08-17T17:49:19.329498+0000","last_unstale":"2023-08-17T17:49:19.332836+0000","last_undegraded":"2023-08-17T17:49:19.332836+0000","last_fullsized":"2023-08-17T17:49:19.332836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.685087+0000","last_change":"2023-08-17T17:49:19.685259+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.685087+0000","last_undegraded":"2023-08-17T17:49:19.685087+0000","last_fullsized":"2023-08-17T17:49:19.685087+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335932+0000","last_change":"2023-08-17T17:49:19.334434+0000","last_active":"2023-08-17T17:49:19.335932+0000","last_peered":"2023-08-17T17:49:19.335932+0000","last_clean":"2023-08-17T17:49:19.335932+0000","last_became_active":"2023-08-17T17:49:19.334142+0000","last_became_peered":"2023-08-17T17:49:19.334142+0000","last_unstale":"2023-08-17T17:49:19.335932+0000","last_undegraded":"2023-08-17T17:49:19.335932+0000","last_fullsized":"2023-08-17T17:49:19.335932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690960+0000","last_change":"2023-08-17T17:49:19.691035+0000","last_active":"2023-08-17T17:49:19.690960+0000","last_peered":"2023-08-17T17:49:19.690960+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.690605+0000","last_became_peered":"2023-08-17T17:49:19.690605+0000","last_unstale":"2023-08-17T17:49:19.690960+0000","last_undegraded":"2023-08-17T17:49:19.690960+0000","last_fullsized":"2023-08-17T17:49:19.690960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329994+0000","last_change":"2023-08-17T17:49:19.326698+0000","last_active":"2023-08-17T17:49:19.329994+0000","last_peered":"2023-08-17T17:49:19.329994+0000","last_clean":"2023-08-17T17:49:19.329994+0000","last_became_active":"2023-08-17T17:49:19.326167+0000","last_became_peered":"2023-08-17T17:49:19.326167+0000","last_unstale":"2023-08-17T17:49:19.329994+0000","last_undegraded":"2023-08-17T17:49:19.329994+0000","last_fullsized":"2023-08-17T17:49:19.329994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692619+0000","last_change":"2023-08-17T17:49:19.692710+0000","last_active":"2023-08-17T17:49:19.692619+0000","last_peered":"2023-08-17T17:49:19.692619+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692379+0000","last_became_peered":"2023-08-17T17:49:19.692379+0000","last_unstale":"2023-08-17T17:49:19.692619+0000","last_undegraded":"2023-08-17T17:49:19.692619+0000","last_fullsized":"2023-08-17T17:49:19.692619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334913+0000","last_change":"2023-08-17T17:49:19.329215+0000","last_active":"2023-08-17T17:49:19.334913+0000","last_peered":"2023-08-17T17:49:19.334913+0000","last_clean":"2023-08-17T17:49:19.334913+0000","last_became_active":"2023-08-17T17:49:19.328771+0000","last_became_peered":"2023-08-17T17:49:19.328771+0000","last_unstale":"2023-08-17T17:49:19.334913+0000","last_undegraded":"2023-08-17T17:49:19.334913+0000","last_fullsized":"2023-08-17T17:49:19.334913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694500+0000","last_change":"2023-08-17T17:49:19.694579+0000","last_active":"2023-08-17T17:49:19.694500+0000","last_peered":"2023-08-17T17:49:19.694500+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694271+0000","last_became_peered":"2023-08-17T17:49:19.694271+0000","last_unstale":"2023-08-17T17:49:19.694500+0000","last_undegraded":"2023-08-17T17:49:19.694500+0000","last_fullsized":"2023-08-17T17:49:19.694500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332377+0000","last_change":"2023-08-17T17:49:19.324396+0000","last_active":"2023-08-17T17:49:19.332377+0000","last_peered":"2023-08-17T17:49:19.332377+0000","last_clean":"2023-08-17T17:49:19.332377+0000","last_became_active":"2023-08-17T17:49:19.324119+0000","last_became_peered":"2023-08-17T17:49:19.324119+0000","last_unstale":"2023-08-17T17:49:19.332377+0000","last_undegraded":"2023-08-17T17:49:19.332377+0000","last_fullsized":"2023-08-17T17:49:19.332377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695846+0000","last_change":"2023-08-17T17:49:19.695903+0000","last_active":"2023-08-17T17:49:19.695846+0000","last_peered":"2023-08-17T17:49:19.695846+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.695703+0000","last_became_peered":"2023-08-17T17:49:19.695703+0000","last_unstale":"2023-08-17T17:49:19.695846+0000","last_undegraded":"2023-08-17T17:49:19.695846+0000","last_fullsized":"2023-08-17T17:49:19.695846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337988+0000","last_change":"2023-08-17T17:49:19.336789+0000","last_active":"2023-08-17T17:49:19.337988+0000","last_peered":"2023-08-17T17:49:19.337988+0000","last_clean":"2023-08-17T17:49:19.337988+0000","last_became_active":"2023-08-17T17:49:19.335638+0000","last_became_peered":"2023-08-17T17:49:19.335638+0000","last_unstale":"2023-08-17T17:49:19.337988+0000","last_undegraded":"2023-08-17T17:49:19.337988+0000","last_fullsized":"2023-08-17T17:49:19.337988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.680809+0000","last_change":"2023-08-17T17:49:19.680952+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.680809+0000","last_undegraded":"2023-08-17T17:49:19.680809+0000","last_fullsized":"2023-08-17T17:49:19.680809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332309+0000","last_change":"2023-08-17T17:49:19.323231+0000","last_active":"2023-08-17T17:49:19.332309+0000","last_peered":"2023-08-17T17:49:19.332309+0000","last_clean":"2023-08-17T17:49:19.332309+0000","last_became_active":"2023-08-17T17:49:19.322950+0000","last_became_peered":"2023-08-17T17:49:19.322950+0000","last_unstale":"2023-08-17T17:49:19.332309+0000","last_undegraded":"2023-08-17T17:49:19.332309+0000","last_fullsized":"2023-08-17T17:49:19.332309+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693927+0000","last_change":"2023-08-17T17:49:19.693994+0000","last_active":"2023-08-17T17:49:19.693927+0000","last_peered":"2023-08-17T17:49:19.693927+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693700+0000","last_became_peered":"2023-08-17T17:49:19.693700+0000","last_unstale":"2023-08-17T17:49:19.693927+0000","last_undegraded":"2023-08-17T17:49:19.693927+0000","last_fullsized":"2023-08-17T17:49:19.693927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335184+0000","last_change":"2023-08-17T17:49:19.326736+0000","last_active":"2023-08-17T17:49:19.335184+0000","last_peered":"2023-08-17T17:49:19.335184+0000","last_clean":"2023-08-17T17:49:19.335184+0000","last_became_active":"2023-08-17T17:49:19.326484+0000","last_became_peered":"2023-08-17T17:49:19.326484+0000","last_unstale":"2023-08-17T17:49:19.335184+0000","last_undegraded":"2023-08-17T17:49:19.335184+0000","last_fullsized":"2023-08-17T17:49:19.335184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681143+0000","last_change":"2023-08-17T17:49:19.681274+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681143+0000","last_undegraded":"2023-08-17T17:49:19.681143+0000","last_fullsized":"2023-08-17T17:49:19.681143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335181+0000","last_change":"2023-08-17T17:49:19.327542+0000","last_active":"2023-08-17T17:49:19.335181+0000","last_peered":"2023-08-17T17:49:19.335181+0000","last_clean":"2023-08-17T17:49:19.335181+0000","last_became_active":"2023-08-17T17:49:19.327106+0000","last_became_peered":"2023-08-17T17:49:19.327106+0000","last_unstale":"2023-08-17T17:49:19.335181+0000","last_undegraded":"2023-08-17T17:49:19.335181+0000","last_fullsized":"2023-08-17T17:49:19.335181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687462+0000","last_change":"2023-08-17T17:49:19.687617+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687462+0000","last_undegraded":"2023-08-17T17:49:19.687462+0000","last_fullsized":"2023-08-17T17:49:19.687462+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329966+0000","last_change":"2023-08-17T17:49:19.326553+0000","last_active":"2023-08-17T17:49:19.329966+0000","last_peered":"2023-08-17T17:49:19.329966+0000","last_clean":"2023-08-17T17:49:19.329966+0000","last_became_active":"2023-08-17T17:49:19.326246+0000","last_became_peered":"2023-08-17T17:49:19.326246+0000","last_unstale":"2023-08-17T17:49:19.329966+0000","last_undegraded":"2023-08-17T17:49:19.329966+0000","last_fullsized":"2023-08-17T17:49:19.329966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.315081+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:49:19.315081+0000","last_peered":"2023-08-17T17:49:19.315081+0000","last_clean":"2023-08-17T17:49:19.315081+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:49:19.315081+0000","last_undegraded":"2023-08-17T17:49:19.315081+0000","last_fullsized":"2023-08-17T17:49:19.315081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691572+0000","last_change":"2023-08-17T17:49:19.691614+0000","last_active":"2023-08-17T17:49:19.691572+0000","last_peered":"2023-08-17T17:49:19.691572+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691423+0000","last_became_peered":"2023-08-17T17:49:19.691423+0000","last_unstale":"2023-08-17T17:49:19.691572+0000","last_undegraded":"2023-08-17T17:49:19.691572+0000","last_fullsized":"2023-08-17T17:49:19.691572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335200+0000","last_change":"2023-08-17T17:49:19.330639+0000","last_active":"2023-08-17T17:49:19.335200+0000","last_peered":"2023-08-17T17:49:19.335200+0000","last_clean":"2023-08-17T17:49:19.335200+0000","last_became_active":"2023-08-17T17:49:19.330350+0000","last_became_peered":"2023-08-17T17:49:19.330350+0000","last_unstale":"2023-08-17T17:49:19.335200+0000","last_undegraded":"2023-08-17T17:49:19.335200+0000","last_fullsized":"2023-08-17T17:49:19.335200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.312380+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:49:19.312380+0000","last_peered":"2023-08-17T17:49:19.312380+0000","last_clean":"2023-08-17T17:49:19.312380+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:49:19.312380+0000","last_undegraded":"2023-08-17T17:49:19.312380+0000","last_fullsized":"2023-08-17T17:49:19.312380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.686082+0000","last_change":"2023-08-17T17:49:19.686082+0000","last_active":"2023-08-17T17:49:19.686082+0000","last_peered":"2023-08-17T17:49:19.686082+0000","last_clean":"2023-08-17T17:49:19.686082+0000","last_became_active":"2023-08-17T17:49:19.685741+0000","last_became_peered":"2023-08-17T17:49:19.685741+0000","last_unstale":"2023-08-17T17:49:19.686082+0000","last_undegraded":"2023-08-17T17:49:19.686082+0000","last_fullsized":"2023-08-17T17:49:19.686082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329945+0000","last_change":"2023-08-17T17:49:19.326004+0000","last_active":"2023-08-17T17:49:19.329945+0000","last_peered":"2023-08-17T17:49:19.329945+0000","last_clean":"2023-08-17T17:49:19.329945+0000","last_became_active":"2023-08-17T17:49:19.325565+0000","last_became_peered":"2023-08-17T17:49:19.325565+0000","last_unstale":"2023-08-17T17:49:19.329945+0000","last_undegraded":"2023-08-17T17:49:19.329945+0000","last_fullsized":"2023-08-17T17:49:19.329945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.307336+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:49:19.307336+0000","last_peered":"2023-08-17T17:49:19.307336+0000","last_clean":"2023-08-17T17:49:19.307336+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:49:19.307336+0000","last_undegraded":"2023-08-17T17:49:19.307336+0000","last_fullsized":"2023-08-17T17:49:19.307336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.686198+0000","last_change":"2023-08-17T17:49:19.686198+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.686198+0000","last_undegraded":"2023-08-17T17:49:19.686198+0000","last_fullsized":"2023-08-17T17:49:19.686198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.331967+0000","last_change":"2023-08-17T17:49:19.323676+0000","last_active":"2023-08-17T17:49:19.331967+0000","last_peered":"2023-08-17T17:49:19.331967+0000","last_clean":"2023-08-17T17:49:19.331967+0000","last_became_active":"2023-08-17T17:49:19.323413+0000","last_became_peered":"2023-08-17T17:49:19.323413+0000","last_unstale":"2023-08-17T17:49:19.331967+0000","last_undegraded":"2023-08-17T17:49:19.331967+0000","last_fullsized":"2023-08-17T17:49:19.331967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.312588+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:49:19.312588+0000","last_peered":"2023-08-17T17:49:19.312588+0000","last_clean":"2023-08-17T17:49:19.312588+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:49:19.312588+0000","last_undegraded":"2023-08-17T17:49:19.312588+0000","last_fullsized":"2023-08-17T17:49:19.312588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327470+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:49:19.327470+0000","last_peered":"2023-08-17T17:49:19.327470+0000","last_clean":"2023-08-17T17:49:19.327470+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:49:19.327470+0000","last_undegraded":"2023-08-17T17:49:19.327470+0000","last_fullsized":"2023-08-17T17:49:19.327470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692415+0000","last_change":"2023-08-17T17:49:19.692902+0000","last_active":"2023-08-17T17:49:19.692415+0000","last_peered":"2023-08-17T17:49:19.692415+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691771+0000","last_became_peered":"2023-08-17T17:49:19.691771+0000","last_unstale":"2023-08-17T17:49:19.692415+0000","last_undegraded":"2023-08-17T17:49:19.692415+0000","last_fullsized":"2023-08-17T17:49:19.692415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334858+0000","last_change":"2023-08-17T17:49:19.327899+0000","last_active":"2023-08-17T17:49:19.334858+0000","last_peered":"2023-08-17T17:49:19.334858+0000","last_clean":"2023-08-17T17:49:19.334858+0000","last_became_active":"2023-08-17T17:49:19.327616+0000","last_became_peered":"2023-08-17T17:49:19.327616+0000","last_unstale":"2023-08-17T17:49:19.334858+0000","last_undegraded":"2023-08-17T17:49:19.334858+0000","last_fullsized":"2023-08-17T17:49:19.334858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327562+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:49:19.327562+0000","last_peered":"2023-08-17T17:49:19.327562+0000","last_clean":"2023-08-17T17:49:19.327562+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:49:19.327562+0000","last_undegraded":"2023-08-17T17:49:19.327562+0000","last_fullsized":"2023-08-17T17:49:19.327562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":5,"reported_epoch":76,"state":"active","last_fresh":"2023-08-17T17:49:19.700158+0000","last_change":"2023-08-17T17:49:19.700158+0000","last_active":"2023-08-17T17:49:19.700158+0000","last_peered":"2023-08-17T17:49:19.700158+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700158+0000","last_became_peered":"2023-08-17T17:49:19.700158+0000","last_unstale":"2023-08-17T17:49:19.700158+0000","last_undegraded":"2023-08-17T17:49:19.700158+0000","last_fullsized":"2023-08-17T17:49:19.700158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337871+0000","last_change":"2023-08-17T17:49:19.335888+0000","last_active":"2023-08-17T17:49:19.337871+0000","last_peered":"2023-08-17T17:49:19.337871+0000","last_clean":"2023-08-17T17:49:19.337871+0000","last_became_active":"2023-08-17T17:49:19.335473+0000","last_became_peered":"2023-08-17T17:49:19.335473+0000","last_unstale":"2023-08-17T17:49:19.337871+0000","last_undegraded":"2023-08-17T17:49:19.337871+0000","last_fullsized":"2023-08-17T17:49:19.337871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.326902+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:49:19.326902+0000","last_peered":"2023-08-17T17:49:19.326902+0000","last_clean":"2023-08-17T17:49:19.326902+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:49:19.326902+0000","last_undegraded":"2023-08-17T17:49:19.326902+0000","last_fullsized":"2023-08-17T17:49:19.326902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693028+0000","last_change":"2023-08-17T17:49:19.693028+0000","last_active":"2023-08-17T17:49:19.693028+0000","last_peered":"2023-08-17T17:49:19.693028+0000","last_clean":"2023-08-17T17:49:19.693028+0000","last_became_active":"2023-08-17T17:49:19.692600+0000","last_became_peered":"2023-08-17T17:49:19.692600+0000","last_unstale":"2023-08-17T17:49:19.693028+0000","last_undegraded":"2023-08-17T17:49:19.693028+0000","last_fullsized":"2023-08-17T17:49:19.693028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337964+0000","last_change":"2023-08-17T17:49:19.336579+0000","last_active":"2023-08-17T17:49:19.337964+0000","last_peered":"2023-08-17T17:49:19.337964+0000","last_clean":"2023-08-17T17:49:19.337964+0000","last_became_active":"2023-08-17T17:49:19.336142+0000","last_became_peered":"2023-08-17T17:49:19.336142+0000","last_unstale":"2023-08-17T17:49:19.337964+0000","last_undegraded":"2023-08-17T17:49:19.337964+0000","last_fullsized":"2023-08-17T17:49:19.337964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.315094+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:49:19.315094+0000","last_peered":"2023-08-17T17:49:19.315094+0000","last_clean":"2023-08-17T17:49:19.315094+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:49:19.315094+0000","last_undegraded":"2023-08-17T17:49:19.315094+0000","last_fullsized":"2023-08-17T17:49:19.315094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692584+0000","last_change":"2023-08-17T17:49:19.692672+0000","last_active":"2023-08-17T17:49:19.692584+0000","last_peered":"2023-08-17T17:49:19.692584+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692387+0000","last_became_peered":"2023-08-17T17:49:19.692387+0000","last_unstale":"2023-08-17T17:49:19.692584+0000","last_undegraded":"2023-08-17T17:49:19.692584+0000","last_fullsized":"2023-08-17T17:49:19.692584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335059+0000","last_change":"2023-08-17T17:49:19.325361+0000","last_active":"2023-08-17T17:49:19.335059+0000","last_peered":"2023-08-17T17:49:19.335059+0000","last_clean":"2023-08-17T17:49:19.335059+0000","last_became_active":"2023-08-17T17:49:19.325094+0000","last_became_peered":"2023-08-17T17:49:19.325094+0000","last_unstale":"2023-08-17T17:49:19.335059+0000","last_undegraded":"2023-08-17T17:49:19.335059+0000","last_fullsized":"2023-08-17T17:49:19.335059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.322602+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:49:19.322602+0000","last_peered":"2023-08-17T17:49:19.322602+0000","last_clean":"2023-08-17T17:49:19.322602+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:49:19.322602+0000","last_undegraded":"2023-08-17T17:49:19.322602+0000","last_fullsized":"2023-08-17T17:49:19.322602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.439}]},{"osd":1,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.28999999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.745,"5min":0.78100000000000003,"15min":0.80000000000000004},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.32600000000000001,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.48199999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":0.80100000000000005,"15min":0.85499999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.34499999999999997,"5min":0.34000000000000002,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.372,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.72799999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.626}]},{"osd":6,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.67700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.436,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.46100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.374}]},{"osd":1,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.33000000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.436},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.745,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84599999999999997,"5min":0.879,"15min":1.0609999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.377},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.498,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.32700000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68200000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.34200000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.77300000000000002,"15min":1.026},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.58799999999999997,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.496},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":1.51,"15min":1.51},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.74399999999999999,"5min":0.872,"15min":1.0740000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.79900000000000004},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.34699999999999998},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.309},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.371},"min":{"1min":0.28899999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53800000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.36199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.22800000000000001},"max":{"1min":0.47599999999999998,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41199999999999998,"15min":0.40699999999999997},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.56899999999999995,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.61399999999999999,"5min":0.625,"15min":0.66600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.35499999999999998,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.46600000000000003,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.624,"15min":0.61699999999999999},"min":{"1min":0.51000000000000001,"5min":0.39500000000000002,"15min":0.39000000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63900000000000001,"15min":0.623},"min":{"1min":0.497,"5min":0.39700000000000002,"15min":0.34399999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.331},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.66100000000000003,"15min":0.63200000000000001},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.54800000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.345},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.39800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.68700000000000006,"15min":0.65700000000000003},"min":{"1min":0.59799999999999998,"5min":0.42399999999999999,"15min":0.40899999999999997},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.68700000000000006,"15min":0.65800000000000003},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.41199999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.66700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.23400000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.54000000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.255},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.23899999999999999,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.66200000000000003},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36099999999999999,"15min":0.36399999999999999},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46300000000000002,"5min":0.54100000000000004,"15min":0.60099999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40300000000000002},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51500000000000001,"5min":0.58199999999999996,"15min":0.65200000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.32500000000000001,"5min":0.26600000000000001,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.55400000000000005,"15min":0.66200000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40899999999999997,"15min":0.40999999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.52700000000000002,"5min":0.56999999999999995,"15min":0.65700000000000003},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.90000000000000002,"15min":1.3300000000000001},"last":0.499}]},{"osd":5,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.63400000000000001,"15min":0.61499999999999999},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.439},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.391},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.71799999999999997,"15min":0.67400000000000004},"min":{"1min":0.53200000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.6109999999999998,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":0.997,"15min":1.544},"last":0.51100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.372},"min":{"1min":0.28899999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54100000000000004,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.60799999999999998,"5min":1.268,"15min":1.268},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40300000000000002,"15min":0.40000000000000002},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.222},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31}]},{"osd":4,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.46999999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.51,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.49399999999999999,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.63300000000000001},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.5509999999999999,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.627,"15min":0.60699999999999998},"min":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.39700000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.53200000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70199999999999996,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3859999999999999,"5min":2.984,"15min":2.984},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.48899999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.191},"max":{"1min":0.48399999999999999,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38,"15min":0.376},"min":{"1min":0.255,"5min":0.25,"15min":0.224},"max":{"1min":0.53200000000000003,"5min":0.60599999999999998,"15min":0.71799999999999997},"last":0.245}]},{"osd":1,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38100000000000001,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.215},"max":{"1min":0.57599999999999996,"5min":0.61099999999999999,"15min":0.73799999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39600000000000002,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"min":{"1min":0.30599999999999999,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41299999999999998},"min":{"1min":0.35999999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.71099999999999997},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.45400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.89000000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.272,"5min":1.272,"15min":2.1309999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.38100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.443,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.65400000000000003,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.65700000000000003,"15min":0.63600000000000001},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.66600000000000004,"15min":0.65000000000000002},"min":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.623},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.55100000000000005,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":1.014,"5min":1.016,"15min":2.1669999999999998},"last":0.58399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.752,"5min":0.76900000000000002,"15min":0.89100000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.629},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.51200000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.84799999999999998},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.44800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76200000000000001,"5min":0.77900000000000003,"15min":0.80100000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.85699999999999998},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.34100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.39100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68000000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68899999999999995,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.82199999999999995,"15min":0.91900000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77900000000000003,"5min":0.877,"15min":1.056},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.434,"5min":0.32900000000000001,"15min":0.27700000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.2609999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.317,"15min":0.31},"max":{"1min":1.022,"5min":1.022,"15min":1.1499999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.242},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.29799999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.438}]},{"osd":2,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.622,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.252},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.49299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.274},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.179},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.3080000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.35499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.75,"15min":1.0620000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":1.0740000000000001},"last":0.38100000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.42199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":1.01},"last":0.316},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.44700000000000001,"5min":0.33300000000000002,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.77000000000000002,"15min":1.1020000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.79700000000000004,"5min":0.82299999999999995,"15min":1.038},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.498,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":1.1279999999999999},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:49:22.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:49:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.807+0000 7f279f9d1700 1 Processor -- start 2023-08-17T17:49:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.807+0000 7f279f9d1700 1 -- start start 2023-08-17T17:49:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279f9d1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 0x7f27980c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279f9d1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27980c0df0 0x7f27980ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279f9d1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27980a8350 con 0x7f2798154140 2023-08-17T17:49:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279f9d1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27980c7320 con 0x7f27980c0df0 2023-08-17T17:49:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279f9d1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c1280 con 0x7f27980c6ee0 2023-08-17T17:49:22.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279df6e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27980c0df0 0x7f27980ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279d76d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2798154140 0x7f27980a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35046/0 (socket says 172.21.15.78:35046) 2023-08-17T17:49:22.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279d76d700 1 -- 172.21.15.78:0/321198420 learned_addr learned my addr 172.21.15.78:0/321198420 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:22.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279cf6c700 1 --2- 172.21.15.78:0/321198420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 0x7f27980c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279df6e700 1 -- 172.21.15.78:0/321198420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 msgr2=0x7f27980c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:22.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279df6e700 1 --2- 172.21.15.78:0/321198420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 0x7f27980c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279df6e700 1 -- 172.21.15.78:0/321198420 >> v1:172.21.15.78:6789/0 conn(0x7f2798154140 legacy=0x7f27980a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f278ffff700 1 -- 172.21.15.78:0/321198420 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686084534 0 0) 0x7f27980a8350 con 0x7f2798154140 2023-08-17T17:49:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279df6e700 1 -- 172.21.15.78:0/321198420 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798154520 con 0x7f27980c0df0 2023-08-17T17:49:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.808+0000 7f279cf6c700 1 --2- 172.21.15.78:0/321198420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 0x7f27980c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f279df6e700 1 --2- 172.21.15.78:0/321198420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27980c0df0 0x7f27980ca280 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f2790009e60 tx=0x7f2790009780).ready entity=mon.0 client_cookie=ec0e3e0285dcf87e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f278ffff700 1 -- 172.21.15.78:0/321198420 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279000e070 con 0x7f27980c0df0 2023-08-17T17:49:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f278ffff700 1 -- 172.21.15.78:0/321198420 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279000bc30 con 0x7f27980c0df0 2023-08-17T17:49:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f278ffff700 1 -- 172.21.15.78:0/321198420 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790012410 con 0x7f27980c0df0 2023-08-17T17:49:22.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f279f9d1700 1 -- 172.21.15.78:0/321198420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27980c0df0 msgr2=0x7f27980ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f279f9d1700 1 --2- 172.21.15.78:0/321198420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27980c0df0 0x7f27980ca280 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f2790009e60 tx=0x7f2790009780).stop 2023-08-17T17:49:22.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f279f9d1700 1 -- 172.21.15.78:0/321198420 shutdown_connections 2023-08-17T17:49:22.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f279f9d1700 1 --2- 172.21.15.78:0/321198420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27980c0df0 0x7f27980ca280 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f279f9d1700 1 --2- 172.21.15.78:0/321198420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 0x7f27980c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f279f9d1700 1 -- 172.21.15.78:0/321198420 >> 172.21.15.78:0/321198420 conn(0x7f2798094510 msgr2=0x7f279806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f279f9d1700 1 -- 172.21.15.78:0/321198420 shutdown_connections 2023-08-17T17:49:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.809+0000 7f279f9d1700 1 -- 172.21.15.78:0/321198420 wait complete. 2023-08-17T17:49:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.810+0000 7f279f9d1700 1 Processor -- start 2023-08-17T17:49:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.810+0000 7f279f9d1700 1 -- start start 2023-08-17T17:49:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.811+0000 7f279f9d1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27980c0df0 0x7f27980ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.811+0000 7f279f9d1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 0x7f279814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.811+0000 7f279f9d1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2798154140 0x7f27981643d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.811+0000 7f279f9d1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c35d0 con 0x7f2798154140 2023-08-17T17:49:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.811+0000 7f279f9d1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279814ce20 con 0x7f27980c0df0 2023-08-17T17:49:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.811+0000 7f279f9d1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2798164c90 con 0x7f27980c6ee0 2023-08-17T17:49:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.811+0000 7f279df6e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2798154140 0x7f27981643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.811+0000 7f279df6e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2798154140 0x7f27981643d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56578/0 (socket says 172.21.15.78:56578) 2023-08-17T17:49:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.811+0000 7f279df6e700 1 -- 172.21.15.78:0/2360092416 learned_addr learned my addr 172.21.15.78:0/2360092416 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f279df6e700 1 -- 172.21.15.78:0/2360092416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 msgr2=0x7f279814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f279cf6c700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 0x7f279814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f279d76d700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27980c0df0 0x7f27980ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f279df6e700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 0x7f279814c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f279df6e700 1 -- 172.21.15.78:0/2360092416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27980c0df0 msgr2=0x7f27980ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f279df6e700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27980c0df0 0x7f27980ab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f279df6e700 1 -- 172.21.15.78:0/2360092416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2790009a20 con 0x7f2798154140 2023-08-17T17:49:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f279df6e700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2798154140 0x7f27981643d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f279806c200 tx=0x7f2790009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f278d7fa700 1 -- 172.21.15.78:0/2360092416 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279001c660 con 0x7f2798154140 2023-08-17T17:49:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f278d7fa700 1 -- 172.21.15.78:0/2360092416 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279001c7c0 con 0x7f2798154140 2023-08-17T17:49:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f279f9d1700 1 -- 172.21.15.78:0/2360092416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2798164f70 con 0x7f2798154140 2023-08-17T17:49:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f278d7fa700 1 -- 172.21.15.78:0/2360092416 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279001cb80 con 0x7f2798154140 2023-08-17T17:49:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.812+0000 7f279f9d1700 1 -- 172.21.15.78:0/2360092416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27980c3260 con 0x7f2798154140 2023-08-17T17:49:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.813+0000 7f279f9d1700 1 -- 172.21.15.78:0/2360092416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27980c3740 con 0x7f2798154140 2023-08-17T17:49:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.813+0000 7f278d7fa700 1 -- 172.21.15.78:0/2360092416 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f279001d420 con 0x7f2798154140 2023-08-17T17:49:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.814+0000 7f278d7fa700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f277c05ed60 0x7f277c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.814+0000 7f278d7fa700 1 -- 172.21.15.78:0/2360092416 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f279007be90 con 0x7f2798154140 2023-08-17T17:49:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.814+0000 7f279d76d700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f277c05ed60 0x7f277c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.814+0000 7f279d76d700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f277c05ed60 0x7f277c061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f27980ab600 tx=0x7f2794009040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.818+0000 7f278d7fa700 1 -- 172.21.15.78:0/2360092416 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f279004d3d0 con 0x7f2798154140 2023-08-17T17:49:22.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.975+0000 7f279f9d1700 1 -- 172.21.15.78:0/2360092416 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27981513a0 con 0x7f277c05ed60 2023-08-17T17:49:22.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.984+0000 7f278d7fa700 1 -- 172.21.15.78:0/2360092416 <== mgr.6066 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360361 (secure 0 0 0) 0x7f2794001220 con 0x7f277c05ed60 2023-08-17T17:49:22.988 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 -- 172.21.15.78:0/2360092416 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f277c05ed60 msgr2=0x7f277c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f277c05ed60 0x7f277c061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f27980ab600 tx=0x7f2794009040).stop 2023-08-17T17:49:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 -- 172.21.15.78:0/2360092416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2798154140 msgr2=0x7f27981643d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2798154140 0x7f27981643d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f279806c200 tx=0x7f2790009780).stop 2023-08-17T17:49:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 -- 172.21.15.78:0/2360092416 shutdown_connections 2023-08-17T17:49:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f277c05ed60 0x7f277c061220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2798154140 0x7f27981643d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27980c0df0 0x7f27980ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 --2- 172.21.15.78:0/2360092416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27980c6ee0 0x7f279814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 -- 172.21.15.78:0/2360092416 >> 172.21.15.78:0/2360092416 conn(0x7f2798094510 msgr2=0x7f27980c04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 -- 172.21.15.78:0/2360092416 shutdown_connections 2023-08-17T17:49:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:22.988+0000 7f279f9d1700 1 -- 172.21.15.78:0/2360092416 wait complete. 2023-08-17T17:49:22.992 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:49:23.000 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:49:22.698025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404224,"kb_used_data":6976,"kb_used_omap":0,"kb_used_meta":2397184,"kb_avail":752570496,"statfs":{"total":773094113280,"available":770632187904,"internally_reserved":0,"allocated":7143424,"data_stored":3484816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2454716416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27605,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.541885"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690957+0000","last_change":"2023-08-17T17:49:19.690957+0000","last_active":"2023-08-17T17:49:19.690957+0000","last_peered":"2023-08-17T17:49:19.690957+0000","last_clean":"2023-08-17T17:49:19.690957+0000","last_became_active":"2023-08-17T17:49:19.690636+0000","last_became_peered":"2023-08-17T17:49:19.690636+0000","last_unstale":"2023-08-17T17:49:19.690957+0000","last_undegraded":"2023-08-17T17:49:19.690957+0000","last_fullsized":"2023-08-17T17:49:19.690957+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"76'3","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681840+0000","last_change":"2023-08-17T17:49:19.322111+0000","last_active":"2023-08-17T17:49:19.681840+0000","last_peered":"2023-08-17T17:49:19.681840+0000","last_clean":"2023-08-17T17:49:19.681840+0000","last_became_active":"2023-08-17T17:49:19.321778+0000","last_became_peered":"2023-08-17T17:49:19.321778+0000","last_unstale":"2023-08-17T17:49:19.681840+0000","last_undegraded":"2023-08-17T17:49:19.681840+0000","last_fullsized":"2023-08-17T17:49:19.681840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699590+0000","last_change":"2023-08-17T17:49:19.699664+0000","last_active":"2023-08-17T17:49:19.699590+0000","last_peered":"2023-08-17T17:49:19.699590+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699416+0000","last_became_peered":"2023-08-17T17:49:19.699416+0000","last_unstale":"2023-08-17T17:49:19.699590+0000","last_undegraded":"2023-08-17T17:49:19.699590+0000","last_fullsized":"2023-08-17T17:49:19.699590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.333353+0000","last_change":"2023-08-17T17:49:19.322333+0000","last_active":"2023-08-17T17:49:19.333353+0000","last_peered":"2023-08-17T17:49:19.333353+0000","last_clean":"2023-08-17T17:49:19.333353+0000","last_became_active":"2023-08-17T17:49:19.322077+0000","last_became_peered":"2023-08-17T17:49:19.322077+0000","last_unstale":"2023-08-17T17:49:19.333353+0000","last_undegraded":"2023-08-17T17:49:19.333353+0000","last_fullsized":"2023-08-17T17:49:19.333353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691445+0000","last_change":"2023-08-17T17:49:19.691522+0000","last_active":"2023-08-17T17:49:19.691445+0000","last_peered":"2023-08-17T17:49:19.691445+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691238+0000","last_became_peered":"2023-08-17T17:49:19.691238+0000","last_unstale":"2023-08-17T17:49:19.691445+0000","last_undegraded":"2023-08-17T17:49:19.691445+0000","last_fullsized":"2023-08-17T17:49:19.691445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337355+0000","last_change":"2023-08-17T17:49:19.333619+0000","last_active":"2023-08-17T17:49:19.337355+0000","last_peered":"2023-08-17T17:49:19.337355+0000","last_clean":"2023-08-17T17:49:19.337355+0000","last_became_active":"2023-08-17T17:49:19.333272+0000","last_became_peered":"2023-08-17T17:49:19.333272+0000","last_unstale":"2023-08-17T17:49:19.337355+0000","last_undegraded":"2023-08-17T17:49:19.337355+0000","last_fullsized":"2023-08-17T17:49:19.337355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694661+0000","last_change":"2023-08-17T17:49:19.694730+0000","last_active":"2023-08-17T17:49:19.694661+0000","last_peered":"2023-08-17T17:49:19.694661+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694310+0000","last_became_peered":"2023-08-17T17:49:19.694310+0000","last_unstale":"2023-08-17T17:49:19.694661+0000","last_undegraded":"2023-08-17T17:49:19.694661+0000","last_fullsized":"2023-08-17T17:49:19.694661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.331394+0000","last_change":"2023-08-17T17:49:19.325701+0000","last_active":"2023-08-17T17:49:19.331394+0000","last_peered":"2023-08-17T17:49:19.331394+0000","last_clean":"2023-08-17T17:49:19.331394+0000","last_became_active":"2023-08-17T17:49:19.325396+0000","last_became_peered":"2023-08-17T17:49:19.325396+0000","last_unstale":"2023-08-17T17:49:19.331394+0000","last_undegraded":"2023-08-17T17:49:19.331394+0000","last_fullsized":"2023-08-17T17:49:19.331394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.679803+0000","last_change":"2023-08-17T17:49:19.679944+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.679803+0000","last_undegraded":"2023-08-17T17:49:19.679803+0000","last_fullsized":"2023-08-17T17:49:19.679803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334625+0000","last_change":"2023-08-17T17:49:19.327117+0000","last_active":"2023-08-17T17:49:19.334625+0000","last_peered":"2023-08-17T17:49:19.334625+0000","last_clean":"2023-08-17T17:49:19.334625+0000","last_became_active":"2023-08-17T17:49:19.326840+0000","last_became_peered":"2023-08-17T17:49:19.326840+0000","last_unstale":"2023-08-17T17:49:19.334625+0000","last_undegraded":"2023-08-17T17:49:19.334625+0000","last_fullsized":"2023-08-17T17:49:19.334625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681781+0000","last_change":"2023-08-17T17:49:19.681912+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681781+0000","last_undegraded":"2023-08-17T17:49:19.681781+0000","last_fullsized":"2023-08-17T17:49:19.681781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324960+0000","last_change":"2023-08-17T17:49:19.319123+0000","last_active":"2023-08-17T17:49:19.324960+0000","last_peered":"2023-08-17T17:49:19.324960+0000","last_clean":"2023-08-17T17:49:19.324960+0000","last_became_active":"2023-08-17T17:49:19.318595+0000","last_became_peered":"2023-08-17T17:49:19.318595+0000","last_unstale":"2023-08-17T17:49:19.324960+0000","last_undegraded":"2023-08-17T17:49:19.324960+0000","last_fullsized":"2023-08-17T17:49:19.324960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687049+0000","last_change":"2023-08-17T17:49:19.687171+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687049+0000","last_undegraded":"2023-08-17T17:49:19.687049+0000","last_fullsized":"2023-08-17T17:49:19.687049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332903+0000","last_change":"2023-08-17T17:49:19.329857+0000","last_active":"2023-08-17T17:49:19.332903+0000","last_peered":"2023-08-17T17:49:19.332903+0000","last_clean":"2023-08-17T17:49:19.332903+0000","last_became_active":"2023-08-17T17:49:19.329112+0000","last_became_peered":"2023-08-17T17:49:19.329112+0000","last_unstale":"2023-08-17T17:49:19.332903+0000","last_undegraded":"2023-08-17T17:49:19.332903+0000","last_fullsized":"2023-08-17T17:49:19.332903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.688432+0000","last_change":"2023-08-17T17:49:19.688432+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.688432+0000","last_undegraded":"2023-08-17T17:49:19.688432+0000","last_fullsized":"2023-08-17T17:49:19.688432+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332256+0000","last_change":"2023-08-17T17:49:19.324543+0000","last_active":"2023-08-17T17:49:19.332256+0000","last_peered":"2023-08-17T17:49:19.332256+0000","last_clean":"2023-08-17T17:49:19.332256+0000","last_became_active":"2023-08-17T17:49:19.324266+0000","last_became_peered":"2023-08-17T17:49:19.324266+0000","last_unstale":"2023-08-17T17:49:19.332256+0000","last_undegraded":"2023-08-17T17:49:19.332256+0000","last_fullsized":"2023-08-17T17:49:19.332256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.679097+0000","last_change":"2023-08-17T17:49:19.679235+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.679097+0000","last_undegraded":"2023-08-17T17:49:19.679097+0000","last_fullsized":"2023-08-17T17:49:19.679097+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327444+0000","last_change":"2023-08-17T17:49:19.325582+0000","last_active":"2023-08-17T17:49:19.327444+0000","last_peered":"2023-08-17T17:49:19.327444+0000","last_clean":"2023-08-17T17:49:19.327444+0000","last_became_active":"2023-08-17T17:49:19.325292+0000","last_became_peered":"2023-08-17T17:49:19.325292+0000","last_unstale":"2023-08-17T17:49:19.327444+0000","last_undegraded":"2023-08-17T17:49:19.327444+0000","last_fullsized":"2023-08-17T17:49:19.327444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697554+0000","last_change":"2023-08-17T17:49:19.697630+0000","last_active":"2023-08-17T17:49:19.697554+0000","last_peered":"2023-08-17T17:49:19.697554+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.697302+0000","last_became_peered":"2023-08-17T17:49:19.697302+0000","last_unstale":"2023-08-17T17:49:19.697554+0000","last_undegraded":"2023-08-17T17:49:19.697554+0000","last_fullsized":"2023-08-17T17:49:19.697554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335268+0000","last_change":"2023-08-17T17:49:19.327360+0000","last_active":"2023-08-17T17:49:19.335268+0000","last_peered":"2023-08-17T17:49:19.335268+0000","last_clean":"2023-08-17T17:49:19.335268+0000","last_became_active":"2023-08-17T17:49:19.327081+0000","last_became_peered":"2023-08-17T17:49:19.327081+0000","last_unstale":"2023-08-17T17:49:19.335268+0000","last_undegraded":"2023-08-17T17:49:19.335268+0000","last_fullsized":"2023-08-17T17:49:19.335268+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700423+0000","last_change":"2023-08-17T17:49:19.700495+0000","last_active":"2023-08-17T17:49:19.700423+0000","last_peered":"2023-08-17T17:49:19.700423+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700216+0000","last_became_peered":"2023-08-17T17:49:19.700216+0000","last_unstale":"2023-08-17T17:49:19.700423+0000","last_undegraded":"2023-08-17T17:49:19.700423+0000","last_fullsized":"2023-08-17T17:49:19.700423+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332221+0000","last_change":"2023-08-17T17:49:19.323045+0000","last_active":"2023-08-17T17:49:19.332221+0000","last_peered":"2023-08-17T17:49:19.332221+0000","last_clean":"2023-08-17T17:49:19.332221+0000","last_became_active":"2023-08-17T17:49:19.322755+0000","last_became_peered":"2023-08-17T17:49:19.322755+0000","last_unstale":"2023-08-17T17:49:19.332221+0000","last_undegraded":"2023-08-17T17:49:19.332221+0000","last_fullsized":"2023-08-17T17:49:19.332221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.690552+0000","last_change":"2023-08-17T17:49:19.692027+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.690552+0000","last_undegraded":"2023-08-17T17:49:19.690552+0000","last_fullsized":"2023-08-17T17:49:19.690552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334796+0000","last_change":"2023-08-17T17:49:19.330926+0000","last_active":"2023-08-17T17:49:19.334796+0000","last_peered":"2023-08-17T17:49:19.334796+0000","last_clean":"2023-08-17T17:49:19.334796+0000","last_became_active":"2023-08-17T17:49:19.330379+0000","last_became_peered":"2023-08-17T17:49:19.330379+0000","last_unstale":"2023-08-17T17:49:19.334796+0000","last_undegraded":"2023-08-17T17:49:19.334796+0000","last_fullsized":"2023-08-17T17:49:19.334796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681409+0000","last_change":"2023-08-17T17:49:19.681509+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681409+0000","last_undegraded":"2023-08-17T17:49:19.681409+0000","last_fullsized":"2023-08-17T17:49:19.681409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.336938+0000","last_change":"2023-08-17T17:49:19.331576+0000","last_active":"2023-08-17T17:49:19.336938+0000","last_peered":"2023-08-17T17:49:19.336938+0000","last_clean":"2023-08-17T17:49:19.336938+0000","last_became_active":"2023-08-17T17:49:19.331285+0000","last_became_peered":"2023-08-17T17:49:19.331285+0000","last_unstale":"2023-08-17T17:49:19.336938+0000","last_undegraded":"2023-08-17T17:49:19.336938+0000","last_fullsized":"2023-08-17T17:49:19.336938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.701110+0000","last_change":"2023-08-17T17:49:19.701187+0000","last_active":"2023-08-17T17:49:19.701110+0000","last_peered":"2023-08-17T17:49:19.701110+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700922+0000","last_became_peered":"2023-08-17T17:49:19.700922+0000","last_unstale":"2023-08-17T17:49:19.701110+0000","last_undegraded":"2023-08-17T17:49:19.701110+0000","last_fullsized":"2023-08-17T17:49:19.701110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325494+0000","last_change":"2023-08-17T17:49:19.323917+0000","last_active":"2023-08-17T17:49:19.325494+0000","last_peered":"2023-08-17T17:49:19.325494+0000","last_clean":"2023-08-17T17:49:19.325494+0000","last_became_active":"2023-08-17T17:49:19.323538+0000","last_became_peered":"2023-08-17T17:49:19.323538+0000","last_unstale":"2023-08-17T17:49:19.325494+0000","last_undegraded":"2023-08-17T17:49:19.325494+0000","last_fullsized":"2023-08-17T17:49:19.325494+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696884+0000","last_change":"2023-08-17T17:49:19.696962+0000","last_active":"2023-08-17T17:49:19.696884+0000","last_peered":"2023-08-17T17:49:19.696884+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696322+0000","last_became_peered":"2023-08-17T17:49:19.696322+0000","last_unstale":"2023-08-17T17:49:19.696884+0000","last_undegraded":"2023-08-17T17:49:19.696884+0000","last_fullsized":"2023-08-17T17:49:19.696884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332883+0000","last_change":"2023-08-17T17:49:19.329416+0000","last_active":"2023-08-17T17:49:19.332883+0000","last_peered":"2023-08-17T17:49:19.332883+0000","last_clean":"2023-08-17T17:49:19.332883+0000","last_became_active":"2023-08-17T17:49:19.328707+0000","last_became_peered":"2023-08-17T17:49:19.328707+0000","last_unstale":"2023-08-17T17:49:19.332883+0000","last_undegraded":"2023-08-17T17:49:19.332883+0000","last_fullsized":"2023-08-17T17:49:19.332883+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694435+0000","last_change":"2023-08-17T17:49:19.694511+0000","last_active":"2023-08-17T17:49:19.694435+0000","last_peered":"2023-08-17T17:49:19.694435+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694182+0000","last_became_peered":"2023-08-17T17:49:19.694182+0000","last_unstale":"2023-08-17T17:49:19.694435+0000","last_undegraded":"2023-08-17T17:49:19.694435+0000","last_fullsized":"2023-08-17T17:49:19.694435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334887+0000","last_change":"2023-08-17T17:49:19.327993+0000","last_active":"2023-08-17T17:49:19.334887+0000","last_peered":"2023-08-17T17:49:19.334887+0000","last_clean":"2023-08-17T17:49:19.334887+0000","last_became_active":"2023-08-17T17:49:19.327700+0000","last_became_peered":"2023-08-17T17:49:19.327700+0000","last_unstale":"2023-08-17T17:49:19.334887+0000","last_undegraded":"2023-08-17T17:49:19.334887+0000","last_fullsized":"2023-08-17T17:49:19.334887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.682674+0000","last_change":"2023-08-17T17:49:19.682807+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.682674+0000","last_undegraded":"2023-08-17T17:49:19.682674+0000","last_fullsized":"2023-08-17T17:49:19.682674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335255+0000","last_change":"2023-08-17T17:49:19.328079+0000","last_active":"2023-08-17T17:49:19.335255+0000","last_peered":"2023-08-17T17:49:19.335255+0000","last_clean":"2023-08-17T17:49:19.335255+0000","last_became_active":"2023-08-17T17:49:19.327794+0000","last_became_peered":"2023-08-17T17:49:19.327794+0000","last_unstale":"2023-08-17T17:49:19.335255+0000","last_undegraded":"2023-08-17T17:49:19.335255+0000","last_fullsized":"2023-08-17T17:49:19.335255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694699+0000","last_change":"2023-08-17T17:49:19.694776+0000","last_active":"2023-08-17T17:49:19.694699+0000","last_peered":"2023-08-17T17:49:19.694699+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694363+0000","last_became_peered":"2023-08-17T17:49:19.694363+0000","last_unstale":"2023-08-17T17:49:19.694699+0000","last_undegraded":"2023-08-17T17:49:19.694699+0000","last_fullsized":"2023-08-17T17:49:19.694699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337851+0000","last_change":"2023-08-17T17:49:19.335785+0000","last_active":"2023-08-17T17:49:19.337851+0000","last_peered":"2023-08-17T17:49:19.337851+0000","last_clean":"2023-08-17T17:49:19.337851+0000","last_became_active":"2023-08-17T17:49:19.335488+0000","last_became_peered":"2023-08-17T17:49:19.335488+0000","last_unstale":"2023-08-17T17:49:19.337851+0000","last_undegraded":"2023-08-17T17:49:19.337851+0000","last_fullsized":"2023-08-17T17:49:19.337851+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693865+0000","last_change":"2023-08-17T17:49:19.693865+0000","last_active":"2023-08-17T17:49:19.693865+0000","last_peered":"2023-08-17T17:49:19.693865+0000","last_clean":"2023-08-17T17:49:19.693865+0000","last_became_active":"2023-08-17T17:49:19.692912+0000","last_became_peered":"2023-08-17T17:49:19.692912+0000","last_unstale":"2023-08-17T17:49:19.693865+0000","last_undegraded":"2023-08-17T17:49:19.693865+0000","last_fullsized":"2023-08-17T17:49:19.693865+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327087+0000","last_change":"2023-08-17T17:49:19.322192+0000","last_active":"2023-08-17T17:49:19.327087+0000","last_peered":"2023-08-17T17:49:19.327087+0000","last_clean":"2023-08-17T17:49:19.327087+0000","last_became_active":"2023-08-17T17:49:19.321913+0000","last_became_peered":"2023-08-17T17:49:19.321913+0000","last_unstale":"2023-08-17T17:49:19.327087+0000","last_undegraded":"2023-08-17T17:49:19.327087+0000","last_fullsized":"2023-08-17T17:49:19.327087+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694493+0000","last_change":"2023-08-17T17:49:19.694568+0000","last_active":"2023-08-17T17:49:19.694493+0000","last_peered":"2023-08-17T17:49:19.694493+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693972+0000","last_became_peered":"2023-08-17T17:49:19.693972+0000","last_unstale":"2023-08-17T17:49:19.694493+0000","last_undegraded":"2023-08-17T17:49:19.694493+0000","last_fullsized":"2023-08-17T17:49:19.694493+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335091+0000","last_change":"2023-08-17T17:49:19.326035+0000","last_active":"2023-08-17T17:49:19.335091+0000","last_peered":"2023-08-17T17:49:19.335091+0000","last_clean":"2023-08-17T17:49:19.335091+0000","last_became_active":"2023-08-17T17:49:19.325780+0000","last_became_peered":"2023-08-17T17:49:19.325780+0000","last_unstale":"2023-08-17T17:49:19.335091+0000","last_undegraded":"2023-08-17T17:49:19.335091+0000","last_fullsized":"2023-08-17T17:49:19.335091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696688+0000","last_change":"2023-08-17T17:49:19.696765+0000","last_active":"2023-08-17T17:49:19.696688+0000","last_peered":"2023-08-17T17:49:19.696688+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696474+0000","last_became_peered":"2023-08-17T17:49:19.696474+0000","last_unstale":"2023-08-17T17:49:19.696688+0000","last_undegraded":"2023-08-17T17:49:19.696688+0000","last_fullsized":"2023-08-17T17:49:19.696688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337370+0000","last_change":"2023-08-17T17:49:19.333623+0000","last_active":"2023-08-17T17:49:19.337370+0000","last_peered":"2023-08-17T17:49:19.337370+0000","last_clean":"2023-08-17T17:49:19.337370+0000","last_became_active":"2023-08-17T17:49:19.333170+0000","last_became_peered":"2023-08-17T17:49:19.333170+0000","last_unstale":"2023-08-17T17:49:19.337370+0000","last_undegraded":"2023-08-17T17:49:19.337370+0000","last_fullsized":"2023-08-17T17:49:19.337370+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.682255+0000","last_change":"2023-08-17T17:49:19.682401+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.682255+0000","last_undegraded":"2023-08-17T17:49:19.682255+0000","last_fullsized":"2023-08-17T17:49:19.682255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332291+0000","last_change":"2023-08-17T17:49:19.321366+0000","last_active":"2023-08-17T17:49:19.332291+0000","last_peered":"2023-08-17T17:49:19.332291+0000","last_clean":"2023-08-17T17:49:19.332291+0000","last_became_active":"2023-08-17T17:49:19.321072+0000","last_became_peered":"2023-08-17T17:49:19.321072+0000","last_unstale":"2023-08-17T17:49:19.332291+0000","last_undegraded":"2023-08-17T17:49:19.332291+0000","last_fullsized":"2023-08-17T17:49:19.332291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.683524+0000","last_change":"2023-08-17T17:49:19.683665+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.683524+0000","last_undegraded":"2023-08-17T17:49:19.683524+0000","last_fullsized":"2023-08-17T17:49:19.683524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337954+0000","last_change":"2023-08-17T17:49:19.336558+0000","last_active":"2023-08-17T17:49:19.337954+0000","last_peered":"2023-08-17T17:49:19.337954+0000","last_clean":"2023-08-17T17:49:19.337954+0000","last_became_active":"2023-08-17T17:49:19.336291+0000","last_became_peered":"2023-08-17T17:49:19.336291+0000","last_unstale":"2023-08-17T17:49:19.337954+0000","last_undegraded":"2023-08-17T17:49:19.337954+0000","last_fullsized":"2023-08-17T17:49:19.337954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.687375+0000","last_change":"2023-08-17T17:49:19.687375+0000","last_active":"2023-08-17T17:49:19.687375+0000","last_peered":"2023-08-17T17:49:19.687375+0000","last_clean":"2023-08-17T17:49:19.687375+0000","last_became_active":"2023-08-17T17:49:19.687084+0000","last_became_peered":"2023-08-17T17:49:19.687084+0000","last_unstale":"2023-08-17T17:49:19.687375+0000","last_undegraded":"2023-08-17T17:49:19.687375+0000","last_fullsized":"2023-08-17T17:49:19.687375+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337102+0000","last_change":"2023-08-17T17:49:19.335235+0000","last_active":"2023-08-17T17:49:19.337102+0000","last_peered":"2023-08-17T17:49:19.337102+0000","last_clean":"2023-08-17T17:49:19.337102+0000","last_became_active":"2023-08-17T17:49:19.334926+0000","last_became_peered":"2023-08-17T17:49:19.334926+0000","last_unstale":"2023-08-17T17:49:19.337102+0000","last_undegraded":"2023-08-17T17:49:19.337102+0000","last_fullsized":"2023-08-17T17:49:19.337102+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.677752+0000","last_change":"2023-08-17T17:49:19.677862+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.677752+0000","last_undegraded":"2023-08-17T17:49:19.677752+0000","last_fullsized":"2023-08-17T17:49:19.677752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324850+0000","last_change":"2023-08-17T17:49:19.320286+0000","last_active":"2023-08-17T17:49:19.324850+0000","last_peered":"2023-08-17T17:49:19.324850+0000","last_clean":"2023-08-17T17:49:19.324850+0000","last_became_active":"2023-08-17T17:49:19.320004+0000","last_became_peered":"2023-08-17T17:49:19.320004+0000","last_unstale":"2023-08-17T17:49:19.324850+0000","last_undegraded":"2023-08-17T17:49:19.324850+0000","last_fullsized":"2023-08-17T17:49:19.324850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696689+0000","last_change":"2023-08-17T17:49:19.696763+0000","last_active":"2023-08-17T17:49:19.696689+0000","last_peered":"2023-08-17T17:49:19.696689+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693241+0000","last_became_peered":"2023-08-17T17:49:19.693241+0000","last_unstale":"2023-08-17T17:49:19.696689+0000","last_undegraded":"2023-08-17T17:49:19.696689+0000","last_fullsized":"2023-08-17T17:49:19.696689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329975+0000","last_change":"2023-08-17T17:49:19.325997+0000","last_active":"2023-08-17T17:49:19.329975+0000","last_peered":"2023-08-17T17:49:19.329975+0000","last_clean":"2023-08-17T17:49:19.329975+0000","last_became_active":"2023-08-17T17:49:19.325180+0000","last_became_peered":"2023-08-17T17:49:19.325180+0000","last_unstale":"2023-08-17T17:49:19.329975+0000","last_undegraded":"2023-08-17T17:49:19.329975+0000","last_fullsized":"2023-08-17T17:49:19.329975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693028+0000","last_change":"2023-08-17T17:49:19.693095+0000","last_active":"2023-08-17T17:49:19.693028+0000","last_peered":"2023-08-17T17:49:19.693028+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692720+0000","last_became_peered":"2023-08-17T17:49:19.692720+0000","last_unstale":"2023-08-17T17:49:19.693028+0000","last_undegraded":"2023-08-17T17:49:19.693028+0000","last_fullsized":"2023-08-17T17:49:19.693028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334824+0000","last_change":"2023-08-17T17:49:19.327881+0000","last_active":"2023-08-17T17:49:19.334824+0000","last_peered":"2023-08-17T17:49:19.334824+0000","last_clean":"2023-08-17T17:49:19.334824+0000","last_became_active":"2023-08-17T17:49:19.327652+0000","last_became_peered":"2023-08-17T17:49:19.327652+0000","last_unstale":"2023-08-17T17:49:19.334824+0000","last_undegraded":"2023-08-17T17:49:19.334824+0000","last_fullsized":"2023-08-17T17:49:19.334824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693000+0000","last_change":"2023-08-17T17:49:19.693081+0000","last_active":"2023-08-17T17:49:19.693000+0000","last_peered":"2023-08-17T17:49:19.693000+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692808+0000","last_became_peered":"2023-08-17T17:49:19.692808+0000","last_unstale":"2023-08-17T17:49:19.693000+0000","last_undegraded":"2023-08-17T17:49:19.693000+0000","last_fullsized":"2023-08-17T17:49:19.693000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334588+0000","last_change":"2023-08-17T17:49:19.326742+0000","last_active":"2023-08-17T17:49:19.334588+0000","last_peered":"2023-08-17T17:49:19.334588+0000","last_clean":"2023-08-17T17:49:19.334588+0000","last_became_active":"2023-08-17T17:49:19.326380+0000","last_became_peered":"2023-08-17T17:49:19.326380+0000","last_unstale":"2023-08-17T17:49:19.334588+0000","last_undegraded":"2023-08-17T17:49:19.334588+0000","last_fullsized":"2023-08-17T17:49:19.334588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692196+0000","last_change":"2023-08-17T17:49:19.692243+0000","last_active":"2023-08-17T17:49:19.692196+0000","last_peered":"2023-08-17T17:49:19.692196+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692016+0000","last_became_peered":"2023-08-17T17:49:19.692016+0000","last_unstale":"2023-08-17T17:49:19.692196+0000","last_undegraded":"2023-08-17T17:49:19.692196+0000","last_fullsized":"2023-08-17T17:49:19.692196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335381+0000","last_change":"2023-08-17T17:49:19.329807+0000","last_active":"2023-08-17T17:49:19.335381+0000","last_peered":"2023-08-17T17:49:19.335381+0000","last_clean":"2023-08-17T17:49:19.335381+0000","last_became_active":"2023-08-17T17:49:19.329559+0000","last_became_peered":"2023-08-17T17:49:19.329559+0000","last_unstale":"2023-08-17T17:49:19.335381+0000","last_undegraded":"2023-08-17T17:49:19.335381+0000","last_fullsized":"2023-08-17T17:49:19.335381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690145+0000","last_change":"2023-08-17T17:49:19.690145+0000","last_active":"2023-08-17T17:49:19.690145+0000","last_peered":"2023-08-17T17:49:19.690145+0000","last_clean":"2023-08-17T17:49:19.690145+0000","last_became_active":"2023-08-17T17:49:19.689032+0000","last_became_peered":"2023-08-17T17:49:19.689032+0000","last_unstale":"2023-08-17T17:49:19.690145+0000","last_undegraded":"2023-08-17T17:49:19.690145+0000","last_fullsized":"2023-08-17T17:49:19.690145+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337392+0000","last_change":"2023-08-17T17:49:19.333863+0000","last_active":"2023-08-17T17:49:19.337392+0000","last_peered":"2023-08-17T17:49:19.337392+0000","last_clean":"2023-08-17T17:49:19.337392+0000","last_became_active":"2023-08-17T17:49:19.333293+0000","last_became_peered":"2023-08-17T17:49:19.333293+0000","last_unstale":"2023-08-17T17:49:19.337392+0000","last_undegraded":"2023-08-17T17:49:19.337392+0000","last_fullsized":"2023-08-17T17:49:19.337392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694365+0000","last_change":"2023-08-17T17:49:19.694448+0000","last_active":"2023-08-17T17:49:19.694365+0000","last_peered":"2023-08-17T17:49:19.694365+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694151+0000","last_became_peered":"2023-08-17T17:49:19.694151+0000","last_unstale":"2023-08-17T17:49:19.694365+0000","last_undegraded":"2023-08-17T17:49:19.694365+0000","last_fullsized":"2023-08-17T17:49:19.694365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324872+0000","last_change":"2023-08-17T17:49:19.320718+0000","last_active":"2023-08-17T17:49:19.324872+0000","last_peered":"2023-08-17T17:49:19.324872+0000","last_clean":"2023-08-17T17:49:19.324872+0000","last_became_active":"2023-08-17T17:49:19.320287+0000","last_became_peered":"2023-08-17T17:49:19.320287+0000","last_unstale":"2023-08-17T17:49:19.324872+0000","last_undegraded":"2023-08-17T17:49:19.324872+0000","last_fullsized":"2023-08-17T17:49:19.324872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.692331+0000","last_change":"2023-08-17T17:49:19.692457+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.692331+0000","last_undegraded":"2023-08-17T17:49:19.692331+0000","last_fullsized":"2023-08-17T17:49:19.692331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325398+0000","last_change":"2023-08-17T17:49:19.319827+0000","last_active":"2023-08-17T17:49:19.325398+0000","last_peered":"2023-08-17T17:49:19.325398+0000","last_clean":"2023-08-17T17:49:19.325398+0000","last_became_active":"2023-08-17T17:49:19.319566+0000","last_became_peered":"2023-08-17T17:49:19.319566+0000","last_unstale":"2023-08-17T17:49:19.325398+0000","last_undegraded":"2023-08-17T17:49:19.325398+0000","last_fullsized":"2023-08-17T17:49:19.325398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.686254+0000","last_change":"2023-08-17T17:49:19.686415+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.686254+0000","last_undegraded":"2023-08-17T17:49:19.686254+0000","last_fullsized":"2023-08-17T17:49:19.686254+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"76'1","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.677637+0000","last_change":"2023-08-17T17:49:19.323093+0000","last_active":"2023-08-17T17:49:19.677637+0000","last_peered":"2023-08-17T17:49:19.677637+0000","last_clean":"2023-08-17T17:49:19.677637+0000","last_became_active":"2023-08-17T17:49:19.322816+0000","last_became_peered":"2023-08-17T17:49:19.322816+0000","last_unstale":"2023-08-17T17:49:19.677637+0000","last_undegraded":"2023-08-17T17:49:19.677637+0000","last_fullsized":"2023-08-17T17:49:19.677637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696502+0000","last_change":"2023-08-17T17:49:19.696576+0000","last_active":"2023-08-17T17:49:19.696502+0000","last_peered":"2023-08-17T17:49:19.696502+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696279+0000","last_became_peered":"2023-08-17T17:49:19.696279+0000","last_unstale":"2023-08-17T17:49:19.696502+0000","last_undegraded":"2023-08-17T17:49:19.696502+0000","last_fullsized":"2023-08-17T17:49:19.696502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335223+0000","last_change":"2023-08-17T17:49:19.330805+0000","last_active":"2023-08-17T17:49:19.335223+0000","last_peered":"2023-08-17T17:49:19.335223+0000","last_clean":"2023-08-17T17:49:19.335223+0000","last_became_active":"2023-08-17T17:49:19.330398+0000","last_became_peered":"2023-08-17T17:49:19.330398+0000","last_unstale":"2023-08-17T17:49:19.335223+0000","last_undegraded":"2023-08-17T17:49:19.335223+0000","last_fullsized":"2023-08-17T17:49:19.335223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691533+0000","last_change":"2023-08-17T17:49:19.691581+0000","last_active":"2023-08-17T17:49:19.691533+0000","last_peered":"2023-08-17T17:49:19.691533+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691339+0000","last_became_peered":"2023-08-17T17:49:19.691339+0000","last_unstale":"2023-08-17T17:49:19.691533+0000","last_undegraded":"2023-08-17T17:49:19.691533+0000","last_fullsized":"2023-08-17T17:49:19.691533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334894+0000","last_change":"2023-08-17T17:49:19.329057+0000","last_active":"2023-08-17T17:49:19.334894+0000","last_peered":"2023-08-17T17:49:19.334894+0000","last_clean":"2023-08-17T17:49:19.334894+0000","last_became_active":"2023-08-17T17:49:19.328426+0000","last_became_peered":"2023-08-17T17:49:19.328426+0000","last_unstale":"2023-08-17T17:49:19.334894+0000","last_undegraded":"2023-08-17T17:49:19.334894+0000","last_fullsized":"2023-08-17T17:49:19.334894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699148+0000","last_change":"2023-08-17T17:49:19.699229+0000","last_active":"2023-08-17T17:49:19.699148+0000","last_peered":"2023-08-17T17:49:19.699148+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.698921+0000","last_became_peered":"2023-08-17T17:49:19.698921+0000","last_unstale":"2023-08-17T17:49:19.699148+0000","last_undegraded":"2023-08-17T17:49:19.699148+0000","last_fullsized":"2023-08-17T17:49:19.699148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329603+0000","last_change":"2023-08-17T17:49:19.322832+0000","last_active":"2023-08-17T17:49:19.329603+0000","last_peered":"2023-08-17T17:49:19.329603+0000","last_clean":"2023-08-17T17:49:19.329603+0000","last_became_active":"2023-08-17T17:49:19.322554+0000","last_became_peered":"2023-08-17T17:49:19.322554+0000","last_unstale":"2023-08-17T17:49:19.329603+0000","last_undegraded":"2023-08-17T17:49:19.329603+0000","last_fullsized":"2023-08-17T17:49:19.329603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684718+0000","last_change":"2023-08-17T17:49:19.684718+0000","last_active":"2023-08-17T17:49:19.684718+0000","last_peered":"2023-08-17T17:49:19.684718+0000","last_clean":"2023-08-17T17:49:19.684718+0000","last_became_active":"2023-08-17T17:49:19.684444+0000","last_became_peered":"2023-08-17T17:49:19.684444+0000","last_unstale":"2023-08-17T17:49:19.684718+0000","last_undegraded":"2023-08-17T17:49:19.684718+0000","last_fullsized":"2023-08-17T17:49:19.684718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335286+0000","last_change":"2023-08-17T17:49:19.326042+0000","last_active":"2023-08-17T17:49:19.335286+0000","last_peered":"2023-08-17T17:49:19.335286+0000","last_clean":"2023-08-17T17:49:19.335286+0000","last_became_active":"2023-08-17T17:49:19.325675+0000","last_became_peered":"2023-08-17T17:49:19.325675+0000","last_unstale":"2023-08-17T17:49:19.335286+0000","last_undegraded":"2023-08-17T17:49:19.335286+0000","last_fullsized":"2023-08-17T17:49:19.335286+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691069+0000","last_change":"2023-08-17T17:49:19.691116+0000","last_active":"2023-08-17T17:49:19.691069+0000","last_peered":"2023-08-17T17:49:19.691069+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.690769+0000","last_became_peered":"2023-08-17T17:49:19.690769+0000","last_unstale":"2023-08-17T17:49:19.691069+0000","last_undegraded":"2023-08-17T17:49:19.691069+0000","last_fullsized":"2023-08-17T17:49:19.691069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325499+0000","last_change":"2023-08-17T17:49:19.319420+0000","last_active":"2023-08-17T17:49:19.325499+0000","last_peered":"2023-08-17T17:49:19.325499+0000","last_clean":"2023-08-17T17:49:19.325499+0000","last_became_active":"2023-08-17T17:49:19.319142+0000","last_became_peered":"2023-08-17T17:49:19.319142+0000","last_unstale":"2023-08-17T17:49:19.325499+0000","last_undegraded":"2023-08-17T17:49:19.325499+0000","last_fullsized":"2023-08-17T17:49:19.325499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687002+0000","last_change":"2023-08-17T17:49:19.687002+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687002+0000","last_undegraded":"2023-08-17T17:49:19.687002+0000","last_fullsized":"2023-08-17T17:49:19.687002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335208+0000","last_change":"2023-08-17T17:49:19.326823+0000","last_active":"2023-08-17T17:49:19.335208+0000","last_peered":"2023-08-17T17:49:19.335208+0000","last_clean":"2023-08-17T17:49:19.335208+0000","last_became_active":"2023-08-17T17:49:19.326542+0000","last_became_peered":"2023-08-17T17:49:19.326542+0000","last_unstale":"2023-08-17T17:49:19.335208+0000","last_undegraded":"2023-08-17T17:49:19.335208+0000","last_fullsized":"2023-08-17T17:49:19.335208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694743+0000","last_change":"2023-08-17T17:49:19.694817+0000","last_active":"2023-08-17T17:49:19.694743+0000","last_peered":"2023-08-17T17:49:19.694743+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694557+0000","last_became_peered":"2023-08-17T17:49:19.694557+0000","last_unstale":"2023-08-17T17:49:19.694743+0000","last_undegraded":"2023-08-17T17:49:19.694743+0000","last_fullsized":"2023-08-17T17:49:19.694743+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337082+0000","last_change":"2023-08-17T17:49:19.334413+0000","last_active":"2023-08-17T17:49:19.337082+0000","last_peered":"2023-08-17T17:49:19.337082+0000","last_clean":"2023-08-17T17:49:19.337082+0000","last_became_active":"2023-08-17T17:49:19.334147+0000","last_became_peered":"2023-08-17T17:49:19.334147+0000","last_unstale":"2023-08-17T17:49:19.337082+0000","last_undegraded":"2023-08-17T17:49:19.337082+0000","last_fullsized":"2023-08-17T17:49:19.337082+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.686438+0000","last_change":"2023-08-17T17:49:19.686510+0000","last_active":"2023-08-17T17:49:19.686438+0000","last_peered":"2023-08-17T17:49:19.686438+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.686240+0000","last_became_peered":"2023-08-17T17:49:19.686240+0000","last_unstale":"2023-08-17T17:49:19.686438+0000","last_undegraded":"2023-08-17T17:49:19.686438+0000","last_fullsized":"2023-08-17T17:49:19.686438+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.340012+0000","last_change":"2023-08-17T17:49:19.338168+0000","last_active":"2023-08-17T17:49:19.340012+0000","last_peered":"2023-08-17T17:49:19.340012+0000","last_clean":"2023-08-17T17:49:19.340012+0000","last_became_active":"2023-08-17T17:49:19.337884+0000","last_became_peered":"2023-08-17T17:49:19.337884+0000","last_unstale":"2023-08-17T17:49:19.340012+0000","last_undegraded":"2023-08-17T17:49:19.340012+0000","last_fullsized":"2023-08-17T17:49:19.340012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693666+0000","last_change":"2023-08-17T17:49:19.693724+0000","last_active":"2023-08-17T17:49:19.693666+0000","last_peered":"2023-08-17T17:49:19.693666+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693492+0000","last_became_peered":"2023-08-17T17:49:19.693492+0000","last_unstale":"2023-08-17T17:49:19.693666+0000","last_undegraded":"2023-08-17T17:49:19.693666+0000","last_fullsized":"2023-08-17T17:49:19.693666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332828+0000","last_change":"2023-08-17T17:49:19.329035+0000","last_active":"2023-08-17T17:49:19.332828+0000","last_peered":"2023-08-17T17:49:19.332828+0000","last_clean":"2023-08-17T17:49:19.332828+0000","last_became_active":"2023-08-17T17:49:19.328686+0000","last_became_peered":"2023-08-17T17:49:19.328686+0000","last_unstale":"2023-08-17T17:49:19.332828+0000","last_undegraded":"2023-08-17T17:49:19.332828+0000","last_fullsized":"2023-08-17T17:49:19.332828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700291+0000","last_change":"2023-08-17T17:49:19.700364+0000","last_active":"2023-08-17T17:49:19.700291+0000","last_peered":"2023-08-17T17:49:19.700291+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699817+0000","last_became_peered":"2023-08-17T17:49:19.699817+0000","last_unstale":"2023-08-17T17:49:19.700291+0000","last_undegraded":"2023-08-17T17:49:19.700291+0000","last_fullsized":"2023-08-17T17:49:19.700291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337936+0000","last_change":"2023-08-17T17:49:19.336413+0000","last_active":"2023-08-17T17:49:19.337936+0000","last_peered":"2023-08-17T17:49:19.337936+0000","last_clean":"2023-08-17T17:49:19.337936+0000","last_became_active":"2023-08-17T17:49:19.335592+0000","last_became_peered":"2023-08-17T17:49:19.335592+0000","last_unstale":"2023-08-17T17:49:19.337936+0000","last_undegraded":"2023-08-17T17:49:19.337936+0000","last_fullsized":"2023-08-17T17:49:19.337936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693521+0000","last_change":"2023-08-17T17:49:19.693521+0000","last_active":"2023-08-17T17:49:19.693521+0000","last_peered":"2023-08-17T17:49:19.693521+0000","last_clean":"2023-08-17T17:49:19.693521+0000","last_became_active":"2023-08-17T17:49:19.692996+0000","last_became_peered":"2023-08-17T17:49:19.692996+0000","last_unstale":"2023-08-17T17:49:19.693521+0000","last_undegraded":"2023-08-17T17:49:19.693521+0000","last_fullsized":"2023-08-17T17:49:19.693521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332394+0000","last_change":"2023-08-17T17:49:19.324642+0000","last_active":"2023-08-17T17:49:19.332394+0000","last_peered":"2023-08-17T17:49:19.332394+0000","last_clean":"2023-08-17T17:49:19.332394+0000","last_became_active":"2023-08-17T17:49:19.324327+0000","last_became_peered":"2023-08-17T17:49:19.324327+0000","last_unstale":"2023-08-17T17:49:19.332394+0000","last_undegraded":"2023-08-17T17:49:19.332394+0000","last_fullsized":"2023-08-17T17:49:19.332394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681553+0000","last_change":"2023-08-17T17:49:19.681690+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681553+0000","last_undegraded":"2023-08-17T17:49:19.681553+0000","last_fullsized":"2023-08-17T17:49:19.681553+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335183+0000","last_change":"2023-08-17T17:49:19.332436+0000","last_active":"2023-08-17T17:49:19.335183+0000","last_peered":"2023-08-17T17:49:19.335183+0000","last_clean":"2023-08-17T17:49:19.335183+0000","last_became_active":"2023-08-17T17:49:19.332146+0000","last_became_peered":"2023-08-17T17:49:19.332146+0000","last_unstale":"2023-08-17T17:49:19.335183+0000","last_undegraded":"2023-08-17T17:49:19.335183+0000","last_fullsized":"2023-08-17T17:49:19.335183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691921+0000","last_change":"2023-08-17T17:49:19.691991+0000","last_active":"2023-08-17T17:49:19.691921+0000","last_peered":"2023-08-17T17:49:19.691921+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691732+0000","last_became_peered":"2023-08-17T17:49:19.691732+0000","last_unstale":"2023-08-17T17:49:19.691921+0000","last_undegraded":"2023-08-17T17:49:19.691921+0000","last_fullsized":"2023-08-17T17:49:19.691921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329922+0000","last_change":"2023-08-17T17:49:19.325834+0000","last_active":"2023-08-17T17:49:19.329922+0000","last_peered":"2023-08-17T17:49:19.329922+0000","last_clean":"2023-08-17T17:49:19.329922+0000","last_became_active":"2023-08-17T17:49:19.325261+0000","last_became_peered":"2023-08-17T17:49:19.325261+0000","last_unstale":"2023-08-17T17:49:19.329922+0000","last_undegraded":"2023-08-17T17:49:19.329922+0000","last_fullsized":"2023-08-17T17:49:19.329922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700066+0000","last_change":"2023-08-17T17:49:19.700149+0000","last_active":"2023-08-17T17:49:19.700066+0000","last_peered":"2023-08-17T17:49:19.700066+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699838+0000","last_became_peered":"2023-08-17T17:49:19.699838+0000","last_unstale":"2023-08-17T17:49:19.700066+0000","last_undegraded":"2023-08-17T17:49:19.700066+0000","last_fullsized":"2023-08-17T17:49:19.700066+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337932+0000","last_change":"2023-08-17T17:49:19.336190+0000","last_active":"2023-08-17T17:49:19.337932+0000","last_peered":"2023-08-17T17:49:19.337932+0000","last_clean":"2023-08-17T17:49:19.337932+0000","last_became_active":"2023-08-17T17:49:19.335782+0000","last_became_peered":"2023-08-17T17:49:19.335782+0000","last_unstale":"2023-08-17T17:49:19.337932+0000","last_undegraded":"2023-08-17T17:49:19.337932+0000","last_fullsized":"2023-08-17T17:49:19.337932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.677312+0000","last_change":"2023-08-17T17:49:19.677442+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.677312+0000","last_undegraded":"2023-08-17T17:49:19.677312+0000","last_fullsized":"2023-08-17T17:49:19.677312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332836+0000","last_change":"2023-08-17T17:49:19.329884+0000","last_active":"2023-08-17T17:49:19.332836+0000","last_peered":"2023-08-17T17:49:19.332836+0000","last_clean":"2023-08-17T17:49:19.332836+0000","last_became_active":"2023-08-17T17:49:19.329498+0000","last_became_peered":"2023-08-17T17:49:19.329498+0000","last_unstale":"2023-08-17T17:49:19.332836+0000","last_undegraded":"2023-08-17T17:49:19.332836+0000","last_fullsized":"2023-08-17T17:49:19.332836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.685087+0000","last_change":"2023-08-17T17:49:19.685259+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.685087+0000","last_undegraded":"2023-08-17T17:49:19.685087+0000","last_fullsized":"2023-08-17T17:49:19.685087+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335932+0000","last_change":"2023-08-17T17:49:19.334434+0000","last_active":"2023-08-17T17:49:19.335932+0000","last_peered":"2023-08-17T17:49:19.335932+0000","last_clean":"2023-08-17T17:49:19.335932+0000","last_became_active":"2023-08-17T17:49:19.334142+0000","last_became_peered":"2023-08-17T17:49:19.334142+0000","last_unstale":"2023-08-17T17:49:19.335932+0000","last_undegraded":"2023-08-17T17:49:19.335932+0000","last_fullsized":"2023-08-17T17:49:19.335932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690960+0000","last_change":"2023-08-17T17:49:19.691035+0000","last_active":"2023-08-17T17:49:19.690960+0000","last_peered":"2023-08-17T17:49:19.690960+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.690605+0000","last_became_peered":"2023-08-17T17:49:19.690605+0000","last_unstale":"2023-08-17T17:49:19.690960+0000","last_undegraded":"2023-08-17T17:49:19.690960+0000","last_fullsized":"2023-08-17T17:49:19.690960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329994+0000","last_change":"2023-08-17T17:49:19.326698+0000","last_active":"2023-08-17T17:49:19.329994+0000","last_peered":"2023-08-17T17:49:19.329994+0000","last_clean":"2023-08-17T17:49:19.329994+0000","last_became_active":"2023-08-17T17:49:19.326167+0000","last_became_peered":"2023-08-17T17:49:19.326167+0000","last_unstale":"2023-08-17T17:49:19.329994+0000","last_undegraded":"2023-08-17T17:49:19.329994+0000","last_fullsized":"2023-08-17T17:49:19.329994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692619+0000","last_change":"2023-08-17T17:49:19.692710+0000","last_active":"2023-08-17T17:49:19.692619+0000","last_peered":"2023-08-17T17:49:19.692619+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692379+0000","last_became_peered":"2023-08-17T17:49:19.692379+0000","last_unstale":"2023-08-17T17:49:19.692619+0000","last_undegraded":"2023-08-17T17:49:19.692619+0000","last_fullsized":"2023-08-17T17:49:19.692619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334913+0000","last_change":"2023-08-17T17:49:19.329215+0000","last_active":"2023-08-17T17:49:19.334913+0000","last_peered":"2023-08-17T17:49:19.334913+0000","last_clean":"2023-08-17T17:49:19.334913+0000","last_became_active":"2023-08-17T17:49:19.328771+0000","last_became_peered":"2023-08-17T17:49:19.328771+0000","last_unstale":"2023-08-17T17:49:19.334913+0000","last_undegraded":"2023-08-17T17:49:19.334913+0000","last_fullsized":"2023-08-17T17:49:19.334913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694500+0000","last_change":"2023-08-17T17:49:19.694579+0000","last_active":"2023-08-17T17:49:19.694500+0000","last_peered":"2023-08-17T17:49:19.694500+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694271+0000","last_became_peered":"2023-08-17T17:49:19.694271+0000","last_unstale":"2023-08-17T17:49:19.694500+0000","last_undegraded":"2023-08-17T17:49:19.694500+0000","last_fullsized":"2023-08-17T17:49:19.694500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332377+0000","last_change":"2023-08-17T17:49:19.324396+0000","last_active":"2023-08-17T17:49:19.332377+0000","last_peered":"2023-08-17T17:49:19.332377+0000","last_clean":"2023-08-17T17:49:19.332377+0000","last_became_active":"2023-08-17T17:49:19.324119+0000","last_became_peered":"2023-08-17T17:49:19.324119+0000","last_unstale":"2023-08-17T17:49:19.332377+0000","last_undegraded":"2023-08-17T17:49:19.332377+0000","last_fullsized":"2023-08-17T17:49:19.332377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695846+0000","last_change":"2023-08-17T17:49:19.695903+0000","last_active":"2023-08-17T17:49:19.695846+0000","last_peered":"2023-08-17T17:49:19.695846+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.695703+0000","last_became_peered":"2023-08-17T17:49:19.695703+0000","last_unstale":"2023-08-17T17:49:19.695846+0000","last_undegraded":"2023-08-17T17:49:19.695846+0000","last_fullsized":"2023-08-17T17:49:19.695846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337988+0000","last_change":"2023-08-17T17:49:19.336789+0000","last_active":"2023-08-17T17:49:19.337988+0000","last_peered":"2023-08-17T17:49:19.337988+0000","last_clean":"2023-08-17T17:49:19.337988+0000","last_became_active":"2023-08-17T17:49:19.335638+0000","last_became_peered":"2023-08-17T17:49:19.335638+0000","last_unstale":"2023-08-17T17:49:19.337988+0000","last_undegraded":"2023-08-17T17:49:19.337988+0000","last_fullsized":"2023-08-17T17:49:19.337988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.680809+0000","last_change":"2023-08-17T17:49:19.680952+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.680809+0000","last_undegraded":"2023-08-17T17:49:19.680809+0000","last_fullsized":"2023-08-17T17:49:19.680809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332309+0000","last_change":"2023-08-17T17:49:19.323231+0000","last_active":"2023-08-17T17:49:19.332309+0000","last_peered":"2023-08-17T17:49:19.332309+0000","last_clean":"2023-08-17T17:49:19.332309+0000","last_became_active":"2023-08-17T17:49:19.322950+0000","last_became_peered":"2023-08-17T17:49:19.322950+0000","last_unstale":"2023-08-17T17:49:19.332309+0000","last_undegraded":"2023-08-17T17:49:19.332309+0000","last_fullsized":"2023-08-17T17:49:19.332309+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693927+0000","last_change":"2023-08-17T17:49:19.693994+0000","last_active":"2023-08-17T17:49:19.693927+0000","last_peered":"2023-08-17T17:49:19.693927+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693700+0000","last_became_peered":"2023-08-17T17:49:19.693700+0000","last_unstale":"2023-08-17T17:49:19.693927+0000","last_undegraded":"2023-08-17T17:49:19.693927+0000","last_fullsized":"2023-08-17T17:49:19.693927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335184+0000","last_change":"2023-08-17T17:49:19.326736+0000","last_active":"2023-08-17T17:49:19.335184+0000","last_peered":"2023-08-17T17:49:19.335184+0000","last_clean":"2023-08-17T17:49:19.335184+0000","last_became_active":"2023-08-17T17:49:19.326484+0000","last_became_peered":"2023-08-17T17:49:19.326484+0000","last_unstale":"2023-08-17T17:49:19.335184+0000","last_undegraded":"2023-08-17T17:49:19.335184+0000","last_fullsized":"2023-08-17T17:49:19.335184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681143+0000","last_change":"2023-08-17T17:49:19.681274+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681143+0000","last_undegraded":"2023-08-17T17:49:19.681143+0000","last_fullsized":"2023-08-17T17:49:19.681143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335181+0000","last_change":"2023-08-17T17:49:19.327542+0000","last_active":"2023-08-17T17:49:19.335181+0000","last_peered":"2023-08-17T17:49:19.335181+0000","last_clean":"2023-08-17T17:49:19.335181+0000","last_became_active":"2023-08-17T17:49:19.327106+0000","last_became_peered":"2023-08-17T17:49:19.327106+0000","last_unstale":"2023-08-17T17:49:19.335181+0000","last_undegraded":"2023-08-17T17:49:19.335181+0000","last_fullsized":"2023-08-17T17:49:19.335181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687462+0000","last_change":"2023-08-17T17:49:19.687617+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687462+0000","last_undegraded":"2023-08-17T17:49:19.687462+0000","last_fullsized":"2023-08-17T17:49:19.687462+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329966+0000","last_change":"2023-08-17T17:49:19.326553+0000","last_active":"2023-08-17T17:49:19.329966+0000","last_peered":"2023-08-17T17:49:19.329966+0000","last_clean":"2023-08-17T17:49:19.329966+0000","last_became_active":"2023-08-17T17:49:19.326246+0000","last_became_peered":"2023-08-17T17:49:19.326246+0000","last_unstale":"2023-08-17T17:49:19.329966+0000","last_undegraded":"2023-08-17T17:49:19.329966+0000","last_fullsized":"2023-08-17T17:49:19.329966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.315081+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:49:19.315081+0000","last_peered":"2023-08-17T17:49:19.315081+0000","last_clean":"2023-08-17T17:49:19.315081+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:49:19.315081+0000","last_undegraded":"2023-08-17T17:49:19.315081+0000","last_fullsized":"2023-08-17T17:49:19.315081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691572+0000","last_change":"2023-08-17T17:49:19.691614+0000","last_active":"2023-08-17T17:49:19.691572+0000","last_peered":"2023-08-17T17:49:19.691572+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691423+0000","last_became_peered":"2023-08-17T17:49:19.691423+0000","last_unstale":"2023-08-17T17:49:19.691572+0000","last_undegraded":"2023-08-17T17:49:19.691572+0000","last_fullsized":"2023-08-17T17:49:19.691572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335200+0000","last_change":"2023-08-17T17:49:19.330639+0000","last_active":"2023-08-17T17:49:19.335200+0000","last_peered":"2023-08-17T17:49:19.335200+0000","last_clean":"2023-08-17T17:49:19.335200+0000","last_became_active":"2023-08-17T17:49:19.330350+0000","last_became_peered":"2023-08-17T17:49:19.330350+0000","last_unstale":"2023-08-17T17:49:19.335200+0000","last_undegraded":"2023-08-17T17:49:19.335200+0000","last_fullsized":"2023-08-17T17:49:19.335200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.312380+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:49:19.312380+0000","last_peered":"2023-08-17T17:49:19.312380+0000","last_clean":"2023-08-17T17:49:19.312380+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:49:19.312380+0000","last_undegraded":"2023-08-17T17:49:19.312380+0000","last_fullsized":"2023-08-17T17:49:19.312380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.686082+0000","last_change":"2023-08-17T17:49:19.686082+0000","last_active":"2023-08-17T17:49:19.686082+0000","last_peered":"2023-08-17T17:49:19.686082+0000","last_clean":"2023-08-17T17:49:19.686082+0000","last_became_active":"2023-08-17T17:49:19.685741+0000","last_became_peered":"2023-08-17T17:49:19.685741+0000","last_unstale":"2023-08-17T17:49:19.686082+0000","last_undegraded":"2023-08-17T17:49:19.686082+0000","last_fullsized":"2023-08-17T17:49:19.686082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329945+0000","last_change":"2023-08-17T17:49:19.326004+0000","last_active":"2023-08-17T17:49:19.329945+0000","last_peered":"2023-08-17T17:49:19.329945+0000","last_clean":"2023-08-17T17:49:19.329945+0000","last_became_active":"2023-08-17T17:49:19.325565+0000","last_became_peered":"2023-08-17T17:49:19.325565+0000","last_unstale":"2023-08-17T17:49:19.329945+0000","last_undegraded":"2023-08-17T17:49:19.329945+0000","last_fullsized":"2023-08-17T17:49:19.329945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.307336+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:49:19.307336+0000","last_peered":"2023-08-17T17:49:19.307336+0000","last_clean":"2023-08-17T17:49:19.307336+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:49:19.307336+0000","last_undegraded":"2023-08-17T17:49:19.307336+0000","last_fullsized":"2023-08-17T17:49:19.307336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.686198+0000","last_change":"2023-08-17T17:49:19.686198+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.686198+0000","last_undegraded":"2023-08-17T17:49:19.686198+0000","last_fullsized":"2023-08-17T17:49:19.686198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.331967+0000","last_change":"2023-08-17T17:49:19.323676+0000","last_active":"2023-08-17T17:49:19.331967+0000","last_peered":"2023-08-17T17:49:19.331967+0000","last_clean":"2023-08-17T17:49:19.331967+0000","last_became_active":"2023-08-17T17:49:19.323413+0000","last_became_peered":"2023-08-17T17:49:19.323413+0000","last_unstale":"2023-08-17T17:49:19.331967+0000","last_undegraded":"2023-08-17T17:49:19.331967+0000","last_fullsized":"2023-08-17T17:49:19.331967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.312588+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:49:19.312588+0000","last_peered":"2023-08-17T17:49:19.312588+0000","last_clean":"2023-08-17T17:49:19.312588+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:49:19.312588+0000","last_undegraded":"2023-08-17T17:49:19.312588+0000","last_fullsized":"2023-08-17T17:49:19.312588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327470+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:49:19.327470+0000","last_peered":"2023-08-17T17:49:19.327470+0000","last_clean":"2023-08-17T17:49:19.327470+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:49:19.327470+0000","last_undegraded":"2023-08-17T17:49:19.327470+0000","last_fullsized":"2023-08-17T17:49:19.327470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692415+0000","last_change":"2023-08-17T17:49:19.692902+0000","last_active":"2023-08-17T17:49:19.692415+0000","last_peered":"2023-08-17T17:49:19.692415+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691771+0000","last_became_peered":"2023-08-17T17:49:19.691771+0000","last_unstale":"2023-08-17T17:49:19.692415+0000","last_undegraded":"2023-08-17T17:49:19.692415+0000","last_fullsized":"2023-08-17T17:49:19.692415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334858+0000","last_change":"2023-08-17T17:49:19.327899+0000","last_active":"2023-08-17T17:49:19.334858+0000","last_peered":"2023-08-17T17:49:19.334858+0000","last_clean":"2023-08-17T17:49:19.334858+0000","last_became_active":"2023-08-17T17:49:19.327616+0000","last_became_peered":"2023-08-17T17:49:19.327616+0000","last_unstale":"2023-08-17T17:49:19.334858+0000","last_undegraded":"2023-08-17T17:49:19.334858+0000","last_fullsized":"2023-08-17T17:49:19.334858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327562+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:49:19.327562+0000","last_peered":"2023-08-17T17:49:19.327562+0000","last_clean":"2023-08-17T17:49:19.327562+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:49:19.327562+0000","last_undegraded":"2023-08-17T17:49:19.327562+0000","last_fullsized":"2023-08-17T17:49:19.327562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":5,"reported_epoch":76,"state":"active","last_fresh":"2023-08-17T17:49:19.700158+0000","last_change":"2023-08-17T17:49:19.700158+0000","last_active":"2023-08-17T17:49:19.700158+0000","last_peered":"2023-08-17T17:49:19.700158+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700158+0000","last_became_peered":"2023-08-17T17:49:19.700158+0000","last_unstale":"2023-08-17T17:49:19.700158+0000","last_undegraded":"2023-08-17T17:49:19.700158+0000","last_fullsized":"2023-08-17T17:49:19.700158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337871+0000","last_change":"2023-08-17T17:49:19.335888+0000","last_active":"2023-08-17T17:49:19.337871+0000","last_peered":"2023-08-17T17:49:19.337871+0000","last_clean":"2023-08-17T17:49:19.337871+0000","last_became_active":"2023-08-17T17:49:19.335473+0000","last_became_peered":"2023-08-17T17:49:19.335473+0000","last_unstale":"2023-08-17T17:49:19.337871+0000","last_undegraded":"2023-08-17T17:49:19.337871+0000","last_fullsized":"2023-08-17T17:49:19.337871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.326902+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:49:19.326902+0000","last_peered":"2023-08-17T17:49:19.326902+0000","last_clean":"2023-08-17T17:49:19.326902+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:49:19.326902+0000","last_undegraded":"2023-08-17T17:49:19.326902+0000","last_fullsized":"2023-08-17T17:49:19.326902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693028+0000","last_change":"2023-08-17T17:49:19.693028+0000","last_active":"2023-08-17T17:49:19.693028+0000","last_peered":"2023-08-17T17:49:19.693028+0000","last_clean":"2023-08-17T17:49:19.693028+0000","last_became_active":"2023-08-17T17:49:19.692600+0000","last_became_peered":"2023-08-17T17:49:19.692600+0000","last_unstale":"2023-08-17T17:49:19.693028+0000","last_undegraded":"2023-08-17T17:49:19.693028+0000","last_fullsized":"2023-08-17T17:49:19.693028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337964+0000","last_change":"2023-08-17T17:49:19.336579+0000","last_active":"2023-08-17T17:49:19.337964+0000","last_peered":"2023-08-17T17:49:19.337964+0000","last_clean":"2023-08-17T17:49:19.337964+0000","last_became_active":"2023-08-17T17:49:19.336142+0000","last_became_peered":"2023-08-17T17:49:19.336142+0000","last_unstale":"2023-08-17T17:49:19.337964+0000","last_undegraded":"2023-08-17T17:49:19.337964+0000","last_fullsized":"2023-08-17T17:49:19.337964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.315094+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:49:19.315094+0000","last_peered":"2023-08-17T17:49:19.315094+0000","last_clean":"2023-08-17T17:49:19.315094+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:49:19.315094+0000","last_undegraded":"2023-08-17T17:49:19.315094+0000","last_fullsized":"2023-08-17T17:49:19.315094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692584+0000","last_change":"2023-08-17T17:49:19.692672+0000","last_active":"2023-08-17T17:49:19.692584+0000","last_peered":"2023-08-17T17:49:19.692584+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692387+0000","last_became_peered":"2023-08-17T17:49:19.692387+0000","last_unstale":"2023-08-17T17:49:19.692584+0000","last_undegraded":"2023-08-17T17:49:19.692584+0000","last_fullsized":"2023-08-17T17:49:19.692584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335059+0000","last_change":"2023-08-17T17:49:19.325361+0000","last_active":"2023-08-17T17:49:19.335059+0000","last_peered":"2023-08-17T17:49:19.335059+0000","last_clean":"2023-08-17T17:49:19.335059+0000","last_became_active":"2023-08-17T17:49:19.325094+0000","last_became_peered":"2023-08-17T17:49:19.325094+0000","last_unstale":"2023-08-17T17:49:19.335059+0000","last_undegraded":"2023-08-17T17:49:19.335059+0000","last_fullsized":"2023-08-17T17:49:19.335059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.322602+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:49:19.322602+0000","last_peered":"2023-08-17T17:49:19.322602+0000","last_clean":"2023-08-17T17:49:19.322602+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:49:19.322602+0000","last_undegraded":"2023-08-17T17:49:19.322602+0000","last_fullsized":"2023-08-17T17:49:19.322602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.439}]},{"osd":1,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.28999999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.745,"5min":0.78100000000000003,"15min":0.80000000000000004},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.32600000000000001,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.48199999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":0.80100000000000005,"15min":0.85499999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.34499999999999997,"5min":0.34000000000000002,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.372,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.72799999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.626}]},{"osd":6,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.67700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.436,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.46100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.374}]},{"osd":1,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.33000000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.436},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.745,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84599999999999997,"5min":0.879,"15min":1.0609999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.377},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.498,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.32700000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68200000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.34200000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.77300000000000002,"15min":1.026},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.58799999999999997,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.496},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":1.51,"15min":1.51},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.74399999999999999,"5min":0.872,"15min":1.0740000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.79900000000000004},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.34699999999999998},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.309},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.371},"min":{"1min":0.28899999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53800000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.36199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.22800000000000001},"max":{"1min":0.47599999999999998,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41199999999999998,"15min":0.40699999999999997},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.56899999999999995,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.61399999999999999,"5min":0.625,"15min":0.66600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.35499999999999998,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.46600000000000003,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.624,"15min":0.61699999999999999},"min":{"1min":0.51000000000000001,"5min":0.39500000000000002,"15min":0.39000000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63900000000000001,"15min":0.623},"min":{"1min":0.497,"5min":0.39700000000000002,"15min":0.34399999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.331},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.66100000000000003,"15min":0.63200000000000001},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.54800000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.345},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.39800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.68700000000000006,"15min":0.65700000000000003},"min":{"1min":0.59799999999999998,"5min":0.42399999999999999,"15min":0.40899999999999997},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.68700000000000006,"15min":0.65800000000000003},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.41199999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.66700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.23400000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.54000000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.255},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.23899999999999999,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.66200000000000003},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36099999999999999,"15min":0.36399999999999999},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46300000000000002,"5min":0.54100000000000004,"15min":0.60099999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40300000000000002},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51500000000000001,"5min":0.58199999999999996,"15min":0.65200000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.32500000000000001,"5min":0.26600000000000001,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.55400000000000005,"15min":0.66200000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40899999999999997,"15min":0.40999999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.52700000000000002,"5min":0.56999999999999995,"15min":0.65700000000000003},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.90000000000000002,"15min":1.3300000000000001},"last":0.499}]},{"osd":5,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.63400000000000001,"15min":0.61499999999999999},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.439},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.391},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.71799999999999997,"15min":0.67400000000000004},"min":{"1min":0.53200000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.6109999999999998,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":0.997,"15min":1.544},"last":0.51100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.372},"min":{"1min":0.28899999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54100000000000004,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.60799999999999998,"5min":1.268,"15min":1.268},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40300000000000002,"15min":0.40000000000000002},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.222},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31}]},{"osd":4,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.46999999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.51,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.49399999999999999,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.63300000000000001},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.5509999999999999,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.627,"15min":0.60699999999999998},"min":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.39700000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.53200000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70199999999999996,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3859999999999999,"5min":2.984,"15min":2.984},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.48899999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.191},"max":{"1min":0.48399999999999999,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38,"15min":0.376},"min":{"1min":0.255,"5min":0.25,"15min":0.224},"max":{"1min":0.53200000000000003,"5min":0.60599999999999998,"15min":0.71799999999999997},"last":0.245}]},{"osd":1,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38100000000000001,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.215},"max":{"1min":0.57599999999999996,"5min":0.61099999999999999,"15min":0.73799999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39600000000000002,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"min":{"1min":0.30599999999999999,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41299999999999998},"min":{"1min":0.35999999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.71099999999999997},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.45400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.89000000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.272,"5min":1.272,"15min":2.1309999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.38100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.443,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.65400000000000003,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.65700000000000003,"15min":0.63600000000000001},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.66600000000000004,"15min":0.65000000000000002},"min":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.623},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.55100000000000005,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":1.014,"5min":1.016,"15min":2.1669999999999998},"last":0.58399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.752,"5min":0.76900000000000002,"15min":0.89100000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.629},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.51200000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.84799999999999998},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.44800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76200000000000001,"5min":0.77900000000000003,"15min":0.80100000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.85699999999999998},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.34100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.39100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68000000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68899999999999995,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.82199999999999995,"15min":0.91900000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77900000000000003,"5min":0.877,"15min":1.056},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.434,"5min":0.32900000000000001,"15min":0.27700000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.2609999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.317,"15min":0.31},"max":{"1min":1.022,"5min":1.022,"15min":1.1499999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.242},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.29799999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.438}]},{"osd":2,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.622,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.252},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.49299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.274},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.179},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.3080000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.35499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.75,"15min":1.0620000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":1.0740000000000001},"last":0.38100000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.42199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":1.01},"last":0.316},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.44700000000000001,"5min":0.33300000000000002,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.77000000000000002,"15min":1.1020000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.79700000000000004,"5min":0.82299999999999995,"15min":1.038},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.498,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":1.1279999999999999},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:49:23.008 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:49:23.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.152+0000 7f06e4a4e700 1 Processor -- start 2023-08-17T17:49:23.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.152+0000 7f06e4a4e700 1 -- start start 2023-08-17T17:49:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06e4a4e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f06e00a7bd0 0x7f06e0063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06e4a4e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06e00a8050 0x7f06e00642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06e4a4e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e0063960 con 0x7f06e00c01b0 2023-08-17T17:49:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06e4a4e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e0063030 con 0x7f06e00a7bd0 2023-08-17T17:49:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06e4a4e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e0063310 con 0x7f06e00a8050 2023-08-17T17:49:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06de59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f06e00a7bd0 0x7f06e0063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06ded9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f06e00c01b0 0x7f06e00c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35056/0 (socket says 172.21.15.78:35056) 2023-08-17T17:49:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06ded9d700 1 -- 172.21.15.78:0/1664756904 learned_addr learned my addr 172.21.15.78:0/1664756904 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06de59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f06e00a7bd0 0x7f06e0063df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56584/0 (socket says 172.21.15.78:56584) 2023-08-17T17:49:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06df59e700 1 --2- 172.21.15.78:0/1664756904 >> v2:172.21.15.150:3300/0 conn(0x7f06e00a8050 0x7f06e00642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06de59c700 1 -- 172.21.15.78:0/1664756904 >> v2:172.21.15.150:3300/0 conn(0x7f06e00a8050 msgr2=0x7f06e00642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06de59c700 1 --2- 172.21.15.78:0/1664756904 >> v2:172.21.15.150:3300/0 conn(0x7f06e00a8050 0x7f06e00642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06de59c700 1 -- 172.21.15.78:0/1664756904 >> v1:172.21.15.78:6789/0 conn(0x7f06e00c01b0 legacy=0x7f06e00c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06de59c700 1 -- 172.21.15.78:0/1664756904 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00635f0 con 0x7f06e00a7bd0 2023-08-17T17:49:23.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06ddd9b700 1 -- 172.21.15.78:0/1664756904 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602381910 0 0) 0x7f06e0063960 con 0x7f06e00c01b0 2023-08-17T17:49:23.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06de59c700 1 --2- 172.21.15.78:0/1664756904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 0x7f06e0063df0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f06e00cb970 tx=0x7f06d4009060).ready entity=mon.0 client_cookie=4f24dc72bd77a860 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:23.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06ddd9b700 1 -- 172.21.15.78:0/1664756904 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400b580 con 0x7f06e00a7bd0 2023-08-17T17:49:23.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06ddd9b700 1 -- 172.21.15.78:0/1664756904 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d400b6e0 con 0x7f06e00a7bd0 2023-08-17T17:49:23.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.153+0000 7f06ddd9b700 1 -- 172.21.15.78:0/1664756904 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400ba60 con 0x7f06e00a7bd0 2023-08-17T17:49:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.154+0000 7f06e4a4e700 1 -- 172.21.15.78:0/1664756904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 msgr2=0x7f06e0063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.154+0000 7f06e4a4e700 1 --2- 172.21.15.78:0/1664756904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 0x7f06e0063df0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f06e00cb970 tx=0x7f06d4009060).stop 2023-08-17T17:49:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.154+0000 7f06e4a4e700 1 -- 172.21.15.78:0/1664756904 shutdown_connections 2023-08-17T17:49:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.154+0000 7f06e4a4e700 1 --2- 172.21.15.78:0/1664756904 >> v2:172.21.15.150:3300/0 conn(0x7f06e00a8050 0x7f06e00642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.154+0000 7f06e4a4e700 1 --2- 172.21.15.78:0/1664756904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 0x7f06e0063df0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.154+0000 7f06e4a4e700 1 -- 172.21.15.78:0/1664756904 >> 172.21.15.78:0/1664756904 conn(0x7f06e006a6c0 msgr2=0x7f06e00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.154+0000 7f06e4a4e700 1 -- 172.21.15.78:0/1664756904 shutdown_connections 2023-08-17T17:49:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.154+0000 7f06e4a4e700 1 -- 172.21.15.78:0/1664756904 wait complete. 2023-08-17T17:49:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.155+0000 7f06e4a4e700 1 Processor -- start 2023-08-17T17:49:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.155+0000 7f06e4a4e700 1 -- start start 2023-08-17T17:49:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06e4a4e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 0x7f06e0156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06e4a4e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06e00a8050 0x7f06e00c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06e4a4e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e00c01b0 0x7f06e00c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06e4a4e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01652e0 con 0x7f06e00a7bd0 2023-08-17T17:49:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06e4a4e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00c9db0 con 0x7f06e00c01b0 2023-08-17T17:49:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06e4a4e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0168850 con 0x7f06e00a8050 2023-08-17T17:49:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06ded9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 0x7f06e0156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06ded9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 0x7f06e0156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56592/0 (socket says 172.21.15.78:56592) 2023-08-17T17:49:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06ded9d700 1 -- 172.21.15.78:0/573963932 learned_addr learned my addr 172.21.15.78:0/573963932 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06df59e700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e00c01b0 0x7f06e00c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06de59c700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06e00a8050 0x7f06e00c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06ded9d700 1 -- 172.21.15.78:0/573963932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06e00a8050 msgr2=0x7f06e00c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06ded9d700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06e00a8050 0x7f06e00c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06ded9d700 1 -- 172.21.15.78:0/573963932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e00c01b0 msgr2=0x7f06e00c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06ded9d700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e00c01b0 0x7f06e00c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06ded9d700 1 -- 172.21.15.78:0/573963932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40092a0 con 0x7f06e00a7bd0 2023-08-17T17:49:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06df59e700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e00c01b0 0x7f06e00c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.156+0000 7f06ded9d700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 0x7f06e0156de0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f06d800c840 tx=0x7f06d8001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.157+0000 7f06c6ffd700 1 -- 172.21.15.78:0/573963932 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8005d30 con 0x7f06e00a7bd0 2023-08-17T17:49:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.157+0000 7f06c6ffd700 1 -- 172.21.15.78:0/573963932 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d8005e90 con 0x7f06e00a7bd0 2023-08-17T17:49:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.157+0000 7f06e4a4e700 1 -- 172.21.15.78:0/573963932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e01683c0 con 0x7f06e00a7bd0 2023-08-17T17:49:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.157+0000 7f06c6ffd700 1 -- 172.21.15.78:0/573963932 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8007320 con 0x7f06e00a7bd0 2023-08-17T17:49:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.157+0000 7f06e4a4e700 1 -- 172.21.15.78:0/573963932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e0167d70 con 0x7f06e00a7bd0 2023-08-17T17:49:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.157+0000 7f06e4a4e700 1 -- 172.21.15.78:0/573963932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e00c1800 con 0x7f06e00a7bd0 2023-08-17T17:49:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.158+0000 7f06c6ffd700 1 -- 172.21.15.78:0/573963932 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f06d8010030 con 0x7f06e00a7bd0 2023-08-17T17:49:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.158+0000 7f06c6ffd700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06cc05ed90 0x7f06cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.158+0000 7f06c6ffd700 1 -- 172.21.15.78:0/573963932 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f06d8079a10 con 0x7f06e00a7bd0 2023-08-17T17:49:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.158+0000 7f06de59c700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06cc05ed90 0x7f06cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.159+0000 7f06de59c700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06cc05ed90 0x7f06cc061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f06d4009fd0 tx=0x7f06d4017000).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.162+0000 7f06c6ffd700 1 -- 172.21.15.78:0/573963932 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f06d804afb0 con 0x7f06e00a7bd0 2023-08-17T17:49:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.322+0000 7f06e4a4e700 1 -- 172.21.15.78:0/573963932 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06e01686a0 con 0x7f06cc05ed90 2023-08-17T17:49:23.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.331+0000 7f06c6ffd700 1 -- 172.21.15.78:0/573963932 <== mgr.6066 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360361 (secure 0 0 0) 0x7f06e01686a0 con 0x7f06cc05ed90 2023-08-17T17:49:23.334 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 -- 172.21.15.78:0/573963932 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06cc05ed90 msgr2=0x7f06cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06cc05ed90 0x7f06cc061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f06d4009fd0 tx=0x7f06d4017000).stop 2023-08-17T17:49:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 -- 172.21.15.78:0/573963932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 msgr2=0x7f06e0156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 0x7f06e0156de0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f06d800c840 tx=0x7f06d8001570).stop 2023-08-17T17:49:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 -- 172.21.15.78:0/573963932 shutdown_connections 2023-08-17T17:49:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06cc05ed90 0x7f06cc061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06e00c01b0 0x7f06e00c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00a7bd0 0x7f06e0156de0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 --2- 172.21.15.78:0/573963932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06e00a8050 0x7f06e00c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 -- 172.21.15.78:0/573963932 >> 172.21.15.78:0/573963932 conn(0x7f06e006a6c0 msgr2=0x7f06e00a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 -- 172.21.15.78:0/573963932 shutdown_connections 2023-08-17T17:49:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.335+0000 7f06e4a4e700 1 -- 172.21.15.78:0/573963932 wait complete. 2023-08-17T17:49:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:49:23.346 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:49:22.698025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404224,"kb_used_data":6976,"kb_used_omap":0,"kb_used_meta":2397184,"kb_avail":752570496,"statfs":{"total":773094113280,"available":770632187904,"internally_reserved":0,"allocated":7143424,"data_stored":3484816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2454716416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27605,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.541885"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690957+0000","last_change":"2023-08-17T17:49:19.690957+0000","last_active":"2023-08-17T17:49:19.690957+0000","last_peered":"2023-08-17T17:49:19.690957+0000","last_clean":"2023-08-17T17:49:19.690957+0000","last_became_active":"2023-08-17T17:49:19.690636+0000","last_became_peered":"2023-08-17T17:49:19.690636+0000","last_unstale":"2023-08-17T17:49:19.690957+0000","last_undegraded":"2023-08-17T17:49:19.690957+0000","last_fullsized":"2023-08-17T17:49:19.690957+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"76'3","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681840+0000","last_change":"2023-08-17T17:49:19.322111+0000","last_active":"2023-08-17T17:49:19.681840+0000","last_peered":"2023-08-17T17:49:19.681840+0000","last_clean":"2023-08-17T17:49:19.681840+0000","last_became_active":"2023-08-17T17:49:19.321778+0000","last_became_peered":"2023-08-17T17:49:19.321778+0000","last_unstale":"2023-08-17T17:49:19.681840+0000","last_undegraded":"2023-08-17T17:49:19.681840+0000","last_fullsized":"2023-08-17T17:49:19.681840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699590+0000","last_change":"2023-08-17T17:49:19.699664+0000","last_active":"2023-08-17T17:49:19.699590+0000","last_peered":"2023-08-17T17:49:19.699590+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699416+0000","last_became_peered":"2023-08-17T17:49:19.699416+0000","last_unstale":"2023-08-17T17:49:19.699590+0000","last_undegraded":"2023-08-17T17:49:19.699590+0000","last_fullsized":"2023-08-17T17:49:19.699590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.333353+0000","last_change":"2023-08-17T17:49:19.322333+0000","last_active":"2023-08-17T17:49:19.333353+0000","last_peered":"2023-08-17T17:49:19.333353+0000","last_clean":"2023-08-17T17:49:19.333353+0000","last_became_active":"2023-08-17T17:49:19.322077+0000","last_became_peered":"2023-08-17T17:49:19.322077+0000","last_unstale":"2023-08-17T17:49:19.333353+0000","last_undegraded":"2023-08-17T17:49:19.333353+0000","last_fullsized":"2023-08-17T17:49:19.333353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691445+0000","last_change":"2023-08-17T17:49:19.691522+0000","last_active":"2023-08-17T17:49:19.691445+0000","last_peered":"2023-08-17T17:49:19.691445+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691238+0000","last_became_peered":"2023-08-17T17:49:19.691238+0000","last_unstale":"2023-08-17T17:49:19.691445+0000","last_undegraded":"2023-08-17T17:49:19.691445+0000","last_fullsized":"2023-08-17T17:49:19.691445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337355+0000","last_change":"2023-08-17T17:49:19.333619+0000","last_active":"2023-08-17T17:49:19.337355+0000","last_peered":"2023-08-17T17:49:19.337355+0000","last_clean":"2023-08-17T17:49:19.337355+0000","last_became_active":"2023-08-17T17:49:19.333272+0000","last_became_peered":"2023-08-17T17:49:19.333272+0000","last_unstale":"2023-08-17T17:49:19.337355+0000","last_undegraded":"2023-08-17T17:49:19.337355+0000","last_fullsized":"2023-08-17T17:49:19.337355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694661+0000","last_change":"2023-08-17T17:49:19.694730+0000","last_active":"2023-08-17T17:49:19.694661+0000","last_peered":"2023-08-17T17:49:19.694661+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694310+0000","last_became_peered":"2023-08-17T17:49:19.694310+0000","last_unstale":"2023-08-17T17:49:19.694661+0000","last_undegraded":"2023-08-17T17:49:19.694661+0000","last_fullsized":"2023-08-17T17:49:19.694661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.331394+0000","last_change":"2023-08-17T17:49:19.325701+0000","last_active":"2023-08-17T17:49:19.331394+0000","last_peered":"2023-08-17T17:49:19.331394+0000","last_clean":"2023-08-17T17:49:19.331394+0000","last_became_active":"2023-08-17T17:49:19.325396+0000","last_became_peered":"2023-08-17T17:49:19.325396+0000","last_unstale":"2023-08-17T17:49:19.331394+0000","last_undegraded":"2023-08-17T17:49:19.331394+0000","last_fullsized":"2023-08-17T17:49:19.331394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.679803+0000","last_change":"2023-08-17T17:49:19.679944+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.679803+0000","last_undegraded":"2023-08-17T17:49:19.679803+0000","last_fullsized":"2023-08-17T17:49:19.679803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334625+0000","last_change":"2023-08-17T17:49:19.327117+0000","last_active":"2023-08-17T17:49:19.334625+0000","last_peered":"2023-08-17T17:49:19.334625+0000","last_clean":"2023-08-17T17:49:19.334625+0000","last_became_active":"2023-08-17T17:49:19.326840+0000","last_became_peered":"2023-08-17T17:49:19.326840+0000","last_unstale":"2023-08-17T17:49:19.334625+0000","last_undegraded":"2023-08-17T17:49:19.334625+0000","last_fullsized":"2023-08-17T17:49:19.334625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681781+0000","last_change":"2023-08-17T17:49:19.681912+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681781+0000","last_undegraded":"2023-08-17T17:49:19.681781+0000","last_fullsized":"2023-08-17T17:49:19.681781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324960+0000","last_change":"2023-08-17T17:49:19.319123+0000","last_active":"2023-08-17T17:49:19.324960+0000","last_peered":"2023-08-17T17:49:19.324960+0000","last_clean":"2023-08-17T17:49:19.324960+0000","last_became_active":"2023-08-17T17:49:19.318595+0000","last_became_peered":"2023-08-17T17:49:19.318595+0000","last_unstale":"2023-08-17T17:49:19.324960+0000","last_undegraded":"2023-08-17T17:49:19.324960+0000","last_fullsized":"2023-08-17T17:49:19.324960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687049+0000","last_change":"2023-08-17T17:49:19.687171+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687049+0000","last_undegraded":"2023-08-17T17:49:19.687049+0000","last_fullsized":"2023-08-17T17:49:19.687049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332903+0000","last_change":"2023-08-17T17:49:19.329857+0000","last_active":"2023-08-17T17:49:19.332903+0000","last_peered":"2023-08-17T17:49:19.332903+0000","last_clean":"2023-08-17T17:49:19.332903+0000","last_became_active":"2023-08-17T17:49:19.329112+0000","last_became_peered":"2023-08-17T17:49:19.329112+0000","last_unstale":"2023-08-17T17:49:19.332903+0000","last_undegraded":"2023-08-17T17:49:19.332903+0000","last_fullsized":"2023-08-17T17:49:19.332903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.688432+0000","last_change":"2023-08-17T17:49:19.688432+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.688432+0000","last_undegraded":"2023-08-17T17:49:19.688432+0000","last_fullsized":"2023-08-17T17:49:19.688432+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332256+0000","last_change":"2023-08-17T17:49:19.324543+0000","last_active":"2023-08-17T17:49:19.332256+0000","last_peered":"2023-08-17T17:49:19.332256+0000","last_clean":"2023-08-17T17:49:19.332256+0000","last_became_active":"2023-08-17T17:49:19.324266+0000","last_became_peered":"2023-08-17T17:49:19.324266+0000","last_unstale":"2023-08-17T17:49:19.332256+0000","last_undegraded":"2023-08-17T17:49:19.332256+0000","last_fullsized":"2023-08-17T17:49:19.332256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.679097+0000","last_change":"2023-08-17T17:49:19.679235+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.679097+0000","last_undegraded":"2023-08-17T17:49:19.679097+0000","last_fullsized":"2023-08-17T17:49:19.679097+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327444+0000","last_change":"2023-08-17T17:49:19.325582+0000","last_active":"2023-08-17T17:49:19.327444+0000","last_peered":"2023-08-17T17:49:19.327444+0000","last_clean":"2023-08-17T17:49:19.327444+0000","last_became_active":"2023-08-17T17:49:19.325292+0000","last_became_peered":"2023-08-17T17:49:19.325292+0000","last_unstale":"2023-08-17T17:49:19.327444+0000","last_undegraded":"2023-08-17T17:49:19.327444+0000","last_fullsized":"2023-08-17T17:49:19.327444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697554+0000","last_change":"2023-08-17T17:49:19.697630+0000","last_active":"2023-08-17T17:49:19.697554+0000","last_peered":"2023-08-17T17:49:19.697554+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.697302+0000","last_became_peered":"2023-08-17T17:49:19.697302+0000","last_unstale":"2023-08-17T17:49:19.697554+0000","last_undegraded":"2023-08-17T17:49:19.697554+0000","last_fullsized":"2023-08-17T17:49:19.697554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335268+0000","last_change":"2023-08-17T17:49:19.327360+0000","last_active":"2023-08-17T17:49:19.335268+0000","last_peered":"2023-08-17T17:49:19.335268+0000","last_clean":"2023-08-17T17:49:19.335268+0000","last_became_active":"2023-08-17T17:49:19.327081+0000","last_became_peered":"2023-08-17T17:49:19.327081+0000","last_unstale":"2023-08-17T17:49:19.335268+0000","last_undegraded":"2023-08-17T17:49:19.335268+0000","last_fullsized":"2023-08-17T17:49:19.335268+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700423+0000","last_change":"2023-08-17T17:49:19.700495+0000","last_active":"2023-08-17T17:49:19.700423+0000","last_peered":"2023-08-17T17:49:19.700423+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700216+0000","last_became_peered":"2023-08-17T17:49:19.700216+0000","last_unstale":"2023-08-17T17:49:19.700423+0000","last_undegraded":"2023-08-17T17:49:19.700423+0000","last_fullsized":"2023-08-17T17:49:19.700423+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332221+0000","last_change":"2023-08-17T17:49:19.323045+0000","last_active":"2023-08-17T17:49:19.332221+0000","last_peered":"2023-08-17T17:49:19.332221+0000","last_clean":"2023-08-17T17:49:19.332221+0000","last_became_active":"2023-08-17T17:49:19.322755+0000","last_became_peered":"2023-08-17T17:49:19.322755+0000","last_unstale":"2023-08-17T17:49:19.332221+0000","last_undegraded":"2023-08-17T17:49:19.332221+0000","last_fullsized":"2023-08-17T17:49:19.332221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.690552+0000","last_change":"2023-08-17T17:49:19.692027+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.690552+0000","last_undegraded":"2023-08-17T17:49:19.690552+0000","last_fullsized":"2023-08-17T17:49:19.690552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334796+0000","last_change":"2023-08-17T17:49:19.330926+0000","last_active":"2023-08-17T17:49:19.334796+0000","last_peered":"2023-08-17T17:49:19.334796+0000","last_clean":"2023-08-17T17:49:19.334796+0000","last_became_active":"2023-08-17T17:49:19.330379+0000","last_became_peered":"2023-08-17T17:49:19.330379+0000","last_unstale":"2023-08-17T17:49:19.334796+0000","last_undegraded":"2023-08-17T17:49:19.334796+0000","last_fullsized":"2023-08-17T17:49:19.334796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681409+0000","last_change":"2023-08-17T17:49:19.681509+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681409+0000","last_undegraded":"2023-08-17T17:49:19.681409+0000","last_fullsized":"2023-08-17T17:49:19.681409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.336938+0000","last_change":"2023-08-17T17:49:19.331576+0000","last_active":"2023-08-17T17:49:19.336938+0000","last_peered":"2023-08-17T17:49:19.336938+0000","last_clean":"2023-08-17T17:49:19.336938+0000","last_became_active":"2023-08-17T17:49:19.331285+0000","last_became_peered":"2023-08-17T17:49:19.331285+0000","last_unstale":"2023-08-17T17:49:19.336938+0000","last_undegraded":"2023-08-17T17:49:19.336938+0000","last_fullsized":"2023-08-17T17:49:19.336938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.701110+0000","last_change":"2023-08-17T17:49:19.701187+0000","last_active":"2023-08-17T17:49:19.701110+0000","last_peered":"2023-08-17T17:49:19.701110+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700922+0000","last_became_peered":"2023-08-17T17:49:19.700922+0000","last_unstale":"2023-08-17T17:49:19.701110+0000","last_undegraded":"2023-08-17T17:49:19.701110+0000","last_fullsized":"2023-08-17T17:49:19.701110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325494+0000","last_change":"2023-08-17T17:49:19.323917+0000","last_active":"2023-08-17T17:49:19.325494+0000","last_peered":"2023-08-17T17:49:19.325494+0000","last_clean":"2023-08-17T17:49:19.325494+0000","last_became_active":"2023-08-17T17:49:19.323538+0000","last_became_peered":"2023-08-17T17:49:19.323538+0000","last_unstale":"2023-08-17T17:49:19.325494+0000","last_undegraded":"2023-08-17T17:49:19.325494+0000","last_fullsized":"2023-08-17T17:49:19.325494+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696884+0000","last_change":"2023-08-17T17:49:19.696962+0000","last_active":"2023-08-17T17:49:19.696884+0000","last_peered":"2023-08-17T17:49:19.696884+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696322+0000","last_became_peered":"2023-08-17T17:49:19.696322+0000","last_unstale":"2023-08-17T17:49:19.696884+0000","last_undegraded":"2023-08-17T17:49:19.696884+0000","last_fullsized":"2023-08-17T17:49:19.696884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332883+0000","last_change":"2023-08-17T17:49:19.329416+0000","last_active":"2023-08-17T17:49:19.332883+0000","last_peered":"2023-08-17T17:49:19.332883+0000","last_clean":"2023-08-17T17:49:19.332883+0000","last_became_active":"2023-08-17T17:49:19.328707+0000","last_became_peered":"2023-08-17T17:49:19.328707+0000","last_unstale":"2023-08-17T17:49:19.332883+0000","last_undegraded":"2023-08-17T17:49:19.332883+0000","last_fullsized":"2023-08-17T17:49:19.332883+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694435+0000","last_change":"2023-08-17T17:49:19.694511+0000","last_active":"2023-08-17T17:49:19.694435+0000","last_peered":"2023-08-17T17:49:19.694435+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694182+0000","last_became_peered":"2023-08-17T17:49:19.694182+0000","last_unstale":"2023-08-17T17:49:19.694435+0000","last_undegraded":"2023-08-17T17:49:19.694435+0000","last_fullsized":"2023-08-17T17:49:19.694435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334887+0000","last_change":"2023-08-17T17:49:19.327993+0000","last_active":"2023-08-17T17:49:19.334887+0000","last_peered":"2023-08-17T17:49:19.334887+0000","last_clean":"2023-08-17T17:49:19.334887+0000","last_became_active":"2023-08-17T17:49:19.327700+0000","last_became_peered":"2023-08-17T17:49:19.327700+0000","last_unstale":"2023-08-17T17:49:19.334887+0000","last_undegraded":"2023-08-17T17:49:19.334887+0000","last_fullsized":"2023-08-17T17:49:19.334887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.682674+0000","last_change":"2023-08-17T17:49:19.682807+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.682674+0000","last_undegraded":"2023-08-17T17:49:19.682674+0000","last_fullsized":"2023-08-17T17:49:19.682674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335255+0000","last_change":"2023-08-17T17:49:19.328079+0000","last_active":"2023-08-17T17:49:19.335255+0000","last_peered":"2023-08-17T17:49:19.335255+0000","last_clean":"2023-08-17T17:49:19.335255+0000","last_became_active":"2023-08-17T17:49:19.327794+0000","last_became_peered":"2023-08-17T17:49:19.327794+0000","last_unstale":"2023-08-17T17:49:19.335255+0000","last_undegraded":"2023-08-17T17:49:19.335255+0000","last_fullsized":"2023-08-17T17:49:19.335255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694699+0000","last_change":"2023-08-17T17:49:19.694776+0000","last_active":"2023-08-17T17:49:19.694699+0000","last_peered":"2023-08-17T17:49:19.694699+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694363+0000","last_became_peered":"2023-08-17T17:49:19.694363+0000","last_unstale":"2023-08-17T17:49:19.694699+0000","last_undegraded":"2023-08-17T17:49:19.694699+0000","last_fullsized":"2023-08-17T17:49:19.694699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337851+0000","last_change":"2023-08-17T17:49:19.335785+0000","last_active":"2023-08-17T17:49:19.337851+0000","last_peered":"2023-08-17T17:49:19.337851+0000","last_clean":"2023-08-17T17:49:19.337851+0000","last_became_active":"2023-08-17T17:49:19.335488+0000","last_became_peered":"2023-08-17T17:49:19.335488+0000","last_unstale":"2023-08-17T17:49:19.337851+0000","last_undegraded":"2023-08-17T17:49:19.337851+0000","last_fullsized":"2023-08-17T17:49:19.337851+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693865+0000","last_change":"2023-08-17T17:49:19.693865+0000","last_active":"2023-08-17T17:49:19.693865+0000","last_peered":"2023-08-17T17:49:19.693865+0000","last_clean":"2023-08-17T17:49:19.693865+0000","last_became_active":"2023-08-17T17:49:19.692912+0000","last_became_peered":"2023-08-17T17:49:19.692912+0000","last_unstale":"2023-08-17T17:49:19.693865+0000","last_undegraded":"2023-08-17T17:49:19.693865+0000","last_fullsized":"2023-08-17T17:49:19.693865+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327087+0000","last_change":"2023-08-17T17:49:19.322192+0000","last_active":"2023-08-17T17:49:19.327087+0000","last_peered":"2023-08-17T17:49:19.327087+0000","last_clean":"2023-08-17T17:49:19.327087+0000","last_became_active":"2023-08-17T17:49:19.321913+0000","last_became_peered":"2023-08-17T17:49:19.321913+0000","last_unstale":"2023-08-17T17:49:19.327087+0000","last_undegraded":"2023-08-17T17:49:19.327087+0000","last_fullsized":"2023-08-17T17:49:19.327087+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694493+0000","last_change":"2023-08-17T17:49:19.694568+0000","last_active":"2023-08-17T17:49:19.694493+0000","last_peered":"2023-08-17T17:49:19.694493+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693972+0000","last_became_peered":"2023-08-17T17:49:19.693972+0000","last_unstale":"2023-08-17T17:49:19.694493+0000","last_undegraded":"2023-08-17T17:49:19.694493+0000","last_fullsized":"2023-08-17T17:49:19.694493+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335091+0000","last_change":"2023-08-17T17:49:19.326035+0000","last_active":"2023-08-17T17:49:19.335091+0000","last_peered":"2023-08-17T17:49:19.335091+0000","last_clean":"2023-08-17T17:49:19.335091+0000","last_became_active":"2023-08-17T17:49:19.325780+0000","last_became_peered":"2023-08-17T17:49:19.325780+0000","last_unstale":"2023-08-17T17:49:19.335091+0000","last_undegraded":"2023-08-17T17:49:19.335091+0000","last_fullsized":"2023-08-17T17:49:19.335091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696688+0000","last_change":"2023-08-17T17:49:19.696765+0000","last_active":"2023-08-17T17:49:19.696688+0000","last_peered":"2023-08-17T17:49:19.696688+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696474+0000","last_became_peered":"2023-08-17T17:49:19.696474+0000","last_unstale":"2023-08-17T17:49:19.696688+0000","last_undegraded":"2023-08-17T17:49:19.696688+0000","last_fullsized":"2023-08-17T17:49:19.696688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337370+0000","last_change":"2023-08-17T17:49:19.333623+0000","last_active":"2023-08-17T17:49:19.337370+0000","last_peered":"2023-08-17T17:49:19.337370+0000","last_clean":"2023-08-17T17:49:19.337370+0000","last_became_active":"2023-08-17T17:49:19.333170+0000","last_became_peered":"2023-08-17T17:49:19.333170+0000","last_unstale":"2023-08-17T17:49:19.337370+0000","last_undegraded":"2023-08-17T17:49:19.337370+0000","last_fullsized":"2023-08-17T17:49:19.337370+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.682255+0000","last_change":"2023-08-17T17:49:19.682401+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.682255+0000","last_undegraded":"2023-08-17T17:49:19.682255+0000","last_fullsized":"2023-08-17T17:49:19.682255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332291+0000","last_change":"2023-08-17T17:49:19.321366+0000","last_active":"2023-08-17T17:49:19.332291+0000","last_peered":"2023-08-17T17:49:19.332291+0000","last_clean":"2023-08-17T17:49:19.332291+0000","last_became_active":"2023-08-17T17:49:19.321072+0000","last_became_peered":"2023-08-17T17:49:19.321072+0000","last_unstale":"2023-08-17T17:49:19.332291+0000","last_undegraded":"2023-08-17T17:49:19.332291+0000","last_fullsized":"2023-08-17T17:49:19.332291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.683524+0000","last_change":"2023-08-17T17:49:19.683665+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.683524+0000","last_undegraded":"2023-08-17T17:49:19.683524+0000","last_fullsized":"2023-08-17T17:49:19.683524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337954+0000","last_change":"2023-08-17T17:49:19.336558+0000","last_active":"2023-08-17T17:49:19.337954+0000","last_peered":"2023-08-17T17:49:19.337954+0000","last_clean":"2023-08-17T17:49:19.337954+0000","last_became_active":"2023-08-17T17:49:19.336291+0000","last_became_peered":"2023-08-17T17:49:19.336291+0000","last_unstale":"2023-08-17T17:49:19.337954+0000","last_undegraded":"2023-08-17T17:49:19.337954+0000","last_fullsized":"2023-08-17T17:49:19.337954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.687375+0000","last_change":"2023-08-17T17:49:19.687375+0000","last_active":"2023-08-17T17:49:19.687375+0000","last_peered":"2023-08-17T17:49:19.687375+0000","last_clean":"2023-08-17T17:49:19.687375+0000","last_became_active":"2023-08-17T17:49:19.687084+0000","last_became_peered":"2023-08-17T17:49:19.687084+0000","last_unstale":"2023-08-17T17:49:19.687375+0000","last_undegraded":"2023-08-17T17:49:19.687375+0000","last_fullsized":"2023-08-17T17:49:19.687375+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337102+0000","last_change":"2023-08-17T17:49:19.335235+0000","last_active":"2023-08-17T17:49:19.337102+0000","last_peered":"2023-08-17T17:49:19.337102+0000","last_clean":"2023-08-17T17:49:19.337102+0000","last_became_active":"2023-08-17T17:49:19.334926+0000","last_became_peered":"2023-08-17T17:49:19.334926+0000","last_unstale":"2023-08-17T17:49:19.337102+0000","last_undegraded":"2023-08-17T17:49:19.337102+0000","last_fullsized":"2023-08-17T17:49:19.337102+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.677752+0000","last_change":"2023-08-17T17:49:19.677862+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.677752+0000","last_undegraded":"2023-08-17T17:49:19.677752+0000","last_fullsized":"2023-08-17T17:49:19.677752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324850+0000","last_change":"2023-08-17T17:49:19.320286+0000","last_active":"2023-08-17T17:49:19.324850+0000","last_peered":"2023-08-17T17:49:19.324850+0000","last_clean":"2023-08-17T17:49:19.324850+0000","last_became_active":"2023-08-17T17:49:19.320004+0000","last_became_peered":"2023-08-17T17:49:19.320004+0000","last_unstale":"2023-08-17T17:49:19.324850+0000","last_undegraded":"2023-08-17T17:49:19.324850+0000","last_fullsized":"2023-08-17T17:49:19.324850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696689+0000","last_change":"2023-08-17T17:49:19.696763+0000","last_active":"2023-08-17T17:49:19.696689+0000","last_peered":"2023-08-17T17:49:19.696689+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693241+0000","last_became_peered":"2023-08-17T17:49:19.693241+0000","last_unstale":"2023-08-17T17:49:19.696689+0000","last_undegraded":"2023-08-17T17:49:19.696689+0000","last_fullsized":"2023-08-17T17:49:19.696689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329975+0000","last_change":"2023-08-17T17:49:19.325997+0000","last_active":"2023-08-17T17:49:19.329975+0000","last_peered":"2023-08-17T17:49:19.329975+0000","last_clean":"2023-08-17T17:49:19.329975+0000","last_became_active":"2023-08-17T17:49:19.325180+0000","last_became_peered":"2023-08-17T17:49:19.325180+0000","last_unstale":"2023-08-17T17:49:19.329975+0000","last_undegraded":"2023-08-17T17:49:19.329975+0000","last_fullsized":"2023-08-17T17:49:19.329975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693028+0000","last_change":"2023-08-17T17:49:19.693095+0000","last_active":"2023-08-17T17:49:19.693028+0000","last_peered":"2023-08-17T17:49:19.693028+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692720+0000","last_became_peered":"2023-08-17T17:49:19.692720+0000","last_unstale":"2023-08-17T17:49:19.693028+0000","last_undegraded":"2023-08-17T17:49:19.693028+0000","last_fullsized":"2023-08-17T17:49:19.693028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334824+0000","last_change":"2023-08-17T17:49:19.327881+0000","last_active":"2023-08-17T17:49:19.334824+0000","last_peered":"2023-08-17T17:49:19.334824+0000","last_clean":"2023-08-17T17:49:19.334824+0000","last_became_active":"2023-08-17T17:49:19.327652+0000","last_became_peered":"2023-08-17T17:49:19.327652+0000","last_unstale":"2023-08-17T17:49:19.334824+0000","last_undegraded":"2023-08-17T17:49:19.334824+0000","last_fullsized":"2023-08-17T17:49:19.334824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693000+0000","last_change":"2023-08-17T17:49:19.693081+0000","last_active":"2023-08-17T17:49:19.693000+0000","last_peered":"2023-08-17T17:49:19.693000+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692808+0000","last_became_peered":"2023-08-17T17:49:19.692808+0000","last_unstale":"2023-08-17T17:49:19.693000+0000","last_undegraded":"2023-08-17T17:49:19.693000+0000","last_fullsized":"2023-08-17T17:49:19.693000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334588+0000","last_change":"2023-08-17T17:49:19.326742+0000","last_active":"2023-08-17T17:49:19.334588+0000","last_peered":"2023-08-17T17:49:19.334588+0000","last_clean":"2023-08-17T17:49:19.334588+0000","last_became_active":"2023-08-17T17:49:19.326380+0000","last_became_peered":"2023-08-17T17:49:19.326380+0000","last_unstale":"2023-08-17T17:49:19.334588+0000","last_undegraded":"2023-08-17T17:49:19.334588+0000","last_fullsized":"2023-08-17T17:49:19.334588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692196+0000","last_change":"2023-08-17T17:49:19.692243+0000","last_active":"2023-08-17T17:49:19.692196+0000","last_peered":"2023-08-17T17:49:19.692196+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692016+0000","last_became_peered":"2023-08-17T17:49:19.692016+0000","last_unstale":"2023-08-17T17:49:19.692196+0000","last_undegraded":"2023-08-17T17:49:19.692196+0000","last_fullsized":"2023-08-17T17:49:19.692196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335381+0000","last_change":"2023-08-17T17:49:19.329807+0000","last_active":"2023-08-17T17:49:19.335381+0000","last_peered":"2023-08-17T17:49:19.335381+0000","last_clean":"2023-08-17T17:49:19.335381+0000","last_became_active":"2023-08-17T17:49:19.329559+0000","last_became_peered":"2023-08-17T17:49:19.329559+0000","last_unstale":"2023-08-17T17:49:19.335381+0000","last_undegraded":"2023-08-17T17:49:19.335381+0000","last_fullsized":"2023-08-17T17:49:19.335381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690145+0000","last_change":"2023-08-17T17:49:19.690145+0000","last_active":"2023-08-17T17:49:19.690145+0000","last_peered":"2023-08-17T17:49:19.690145+0000","last_clean":"2023-08-17T17:49:19.690145+0000","last_became_active":"2023-08-17T17:49:19.689032+0000","last_became_peered":"2023-08-17T17:49:19.689032+0000","last_unstale":"2023-08-17T17:49:19.690145+0000","last_undegraded":"2023-08-17T17:49:19.690145+0000","last_fullsized":"2023-08-17T17:49:19.690145+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337392+0000","last_change":"2023-08-17T17:49:19.333863+0000","last_active":"2023-08-17T17:49:19.337392+0000","last_peered":"2023-08-17T17:49:19.337392+0000","last_clean":"2023-08-17T17:49:19.337392+0000","last_became_active":"2023-08-17T17:49:19.333293+0000","last_became_peered":"2023-08-17T17:49:19.333293+0000","last_unstale":"2023-08-17T17:49:19.337392+0000","last_undegraded":"2023-08-17T17:49:19.337392+0000","last_fullsized":"2023-08-17T17:49:19.337392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694365+0000","last_change":"2023-08-17T17:49:19.694448+0000","last_active":"2023-08-17T17:49:19.694365+0000","last_peered":"2023-08-17T17:49:19.694365+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694151+0000","last_became_peered":"2023-08-17T17:49:19.694151+0000","last_unstale":"2023-08-17T17:49:19.694365+0000","last_undegraded":"2023-08-17T17:49:19.694365+0000","last_fullsized":"2023-08-17T17:49:19.694365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324872+0000","last_change":"2023-08-17T17:49:19.320718+0000","last_active":"2023-08-17T17:49:19.324872+0000","last_peered":"2023-08-17T17:49:19.324872+0000","last_clean":"2023-08-17T17:49:19.324872+0000","last_became_active":"2023-08-17T17:49:19.320287+0000","last_became_peered":"2023-08-17T17:49:19.320287+0000","last_unstale":"2023-08-17T17:49:19.324872+0000","last_undegraded":"2023-08-17T17:49:19.324872+0000","last_fullsized":"2023-08-17T17:49:19.324872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.692331+0000","last_change":"2023-08-17T17:49:19.692457+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.692331+0000","last_undegraded":"2023-08-17T17:49:19.692331+0000","last_fullsized":"2023-08-17T17:49:19.692331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325398+0000","last_change":"2023-08-17T17:49:19.319827+0000","last_active":"2023-08-17T17:49:19.325398+0000","last_peered":"2023-08-17T17:49:19.325398+0000","last_clean":"2023-08-17T17:49:19.325398+0000","last_became_active":"2023-08-17T17:49:19.319566+0000","last_became_peered":"2023-08-17T17:49:19.319566+0000","last_unstale":"2023-08-17T17:49:19.325398+0000","last_undegraded":"2023-08-17T17:49:19.325398+0000","last_fullsized":"2023-08-17T17:49:19.325398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.686254+0000","last_change":"2023-08-17T17:49:19.686415+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.686254+0000","last_undegraded":"2023-08-17T17:49:19.686254+0000","last_fullsized":"2023-08-17T17:49:19.686254+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"76'1","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.677637+0000","last_change":"2023-08-17T17:49:19.323093+0000","last_active":"2023-08-17T17:49:19.677637+0000","last_peered":"2023-08-17T17:49:19.677637+0000","last_clean":"2023-08-17T17:49:19.677637+0000","last_became_active":"2023-08-17T17:49:19.322816+0000","last_became_peered":"2023-08-17T17:49:19.322816+0000","last_unstale":"2023-08-17T17:49:19.677637+0000","last_undegraded":"2023-08-17T17:49:19.677637+0000","last_fullsized":"2023-08-17T17:49:19.677637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696502+0000","last_change":"2023-08-17T17:49:19.696576+0000","last_active":"2023-08-17T17:49:19.696502+0000","last_peered":"2023-08-17T17:49:19.696502+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696279+0000","last_became_peered":"2023-08-17T17:49:19.696279+0000","last_unstale":"2023-08-17T17:49:19.696502+0000","last_undegraded":"2023-08-17T17:49:19.696502+0000","last_fullsized":"2023-08-17T17:49:19.696502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335223+0000","last_change":"2023-08-17T17:49:19.330805+0000","last_active":"2023-08-17T17:49:19.335223+0000","last_peered":"2023-08-17T17:49:19.335223+0000","last_clean":"2023-08-17T17:49:19.335223+0000","last_became_active":"2023-08-17T17:49:19.330398+0000","last_became_peered":"2023-08-17T17:49:19.330398+0000","last_unstale":"2023-08-17T17:49:19.335223+0000","last_undegraded":"2023-08-17T17:49:19.335223+0000","last_fullsized":"2023-08-17T17:49:19.335223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691533+0000","last_change":"2023-08-17T17:49:19.691581+0000","last_active":"2023-08-17T17:49:19.691533+0000","last_peered":"2023-08-17T17:49:19.691533+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691339+0000","last_became_peered":"2023-08-17T17:49:19.691339+0000","last_unstale":"2023-08-17T17:49:19.691533+0000","last_undegraded":"2023-08-17T17:49:19.691533+0000","last_fullsized":"2023-08-17T17:49:19.691533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334894+0000","last_change":"2023-08-17T17:49:19.329057+0000","last_active":"2023-08-17T17:49:19.334894+0000","last_peered":"2023-08-17T17:49:19.334894+0000","last_clean":"2023-08-17T17:49:19.334894+0000","last_became_active":"2023-08-17T17:49:19.328426+0000","last_became_peered":"2023-08-17T17:49:19.328426+0000","last_unstale":"2023-08-17T17:49:19.334894+0000","last_undegraded":"2023-08-17T17:49:19.334894+0000","last_fullsized":"2023-08-17T17:49:19.334894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699148+0000","last_change":"2023-08-17T17:49:19.699229+0000","last_active":"2023-08-17T17:49:19.699148+0000","last_peered":"2023-08-17T17:49:19.699148+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.698921+0000","last_became_peered":"2023-08-17T17:49:19.698921+0000","last_unstale":"2023-08-17T17:49:19.699148+0000","last_undegraded":"2023-08-17T17:49:19.699148+0000","last_fullsized":"2023-08-17T17:49:19.699148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329603+0000","last_change":"2023-08-17T17:49:19.322832+0000","last_active":"2023-08-17T17:49:19.329603+0000","last_peered":"2023-08-17T17:49:19.329603+0000","last_clean":"2023-08-17T17:49:19.329603+0000","last_became_active":"2023-08-17T17:49:19.322554+0000","last_became_peered":"2023-08-17T17:49:19.322554+0000","last_unstale":"2023-08-17T17:49:19.329603+0000","last_undegraded":"2023-08-17T17:49:19.329603+0000","last_fullsized":"2023-08-17T17:49:19.329603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684718+0000","last_change":"2023-08-17T17:49:19.684718+0000","last_active":"2023-08-17T17:49:19.684718+0000","last_peered":"2023-08-17T17:49:19.684718+0000","last_clean":"2023-08-17T17:49:19.684718+0000","last_became_active":"2023-08-17T17:49:19.684444+0000","last_became_peered":"2023-08-17T17:49:19.684444+0000","last_unstale":"2023-08-17T17:49:19.684718+0000","last_undegraded":"2023-08-17T17:49:19.684718+0000","last_fullsized":"2023-08-17T17:49:19.684718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335286+0000","last_change":"2023-08-17T17:49:19.326042+0000","last_active":"2023-08-17T17:49:19.335286+0000","last_peered":"2023-08-17T17:49:19.335286+0000","last_clean":"2023-08-17T17:49:19.335286+0000","last_became_active":"2023-08-17T17:49:19.325675+0000","last_became_peered":"2023-08-17T17:49:19.325675+0000","last_unstale":"2023-08-17T17:49:19.335286+0000","last_undegraded":"2023-08-17T17:49:19.335286+0000","last_fullsized":"2023-08-17T17:49:19.335286+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691069+0000","last_change":"2023-08-17T17:49:19.691116+0000","last_active":"2023-08-17T17:49:19.691069+0000","last_peered":"2023-08-17T17:49:19.691069+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.690769+0000","last_became_peered":"2023-08-17T17:49:19.690769+0000","last_unstale":"2023-08-17T17:49:19.691069+0000","last_undegraded":"2023-08-17T17:49:19.691069+0000","last_fullsized":"2023-08-17T17:49:19.691069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325499+0000","last_change":"2023-08-17T17:49:19.319420+0000","last_active":"2023-08-17T17:49:19.325499+0000","last_peered":"2023-08-17T17:49:19.325499+0000","last_clean":"2023-08-17T17:49:19.325499+0000","last_became_active":"2023-08-17T17:49:19.319142+0000","last_became_peered":"2023-08-17T17:49:19.319142+0000","last_unstale":"2023-08-17T17:49:19.325499+0000","last_undegraded":"2023-08-17T17:49:19.325499+0000","last_fullsized":"2023-08-17T17:49:19.325499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687002+0000","last_change":"2023-08-17T17:49:19.687002+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687002+0000","last_undegraded":"2023-08-17T17:49:19.687002+0000","last_fullsized":"2023-08-17T17:49:19.687002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335208+0000","last_change":"2023-08-17T17:49:19.326823+0000","last_active":"2023-08-17T17:49:19.335208+0000","last_peered":"2023-08-17T17:49:19.335208+0000","last_clean":"2023-08-17T17:49:19.335208+0000","last_became_active":"2023-08-17T17:49:19.326542+0000","last_became_peered":"2023-08-17T17:49:19.326542+0000","last_unstale":"2023-08-17T17:49:19.335208+0000","last_undegraded":"2023-08-17T17:49:19.335208+0000","last_fullsized":"2023-08-17T17:49:19.335208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694743+0000","last_change":"2023-08-17T17:49:19.694817+0000","last_active":"2023-08-17T17:49:19.694743+0000","last_peered":"2023-08-17T17:49:19.694743+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694557+0000","last_became_peered":"2023-08-17T17:49:19.694557+0000","last_unstale":"2023-08-17T17:49:19.694743+0000","last_undegraded":"2023-08-17T17:49:19.694743+0000","last_fullsized":"2023-08-17T17:49:19.694743+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337082+0000","last_change":"2023-08-17T17:49:19.334413+0000","last_active":"2023-08-17T17:49:19.337082+0000","last_peered":"2023-08-17T17:49:19.337082+0000","last_clean":"2023-08-17T17:49:19.337082+0000","last_became_active":"2023-08-17T17:49:19.334147+0000","last_became_peered":"2023-08-17T17:49:19.334147+0000","last_unstale":"2023-08-17T17:49:19.337082+0000","last_undegraded":"2023-08-17T17:49:19.337082+0000","last_fullsized":"2023-08-17T17:49:19.337082+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.686438+0000","last_change":"2023-08-17T17:49:19.686510+0000","last_active":"2023-08-17T17:49:19.686438+0000","last_peered":"2023-08-17T17:49:19.686438+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.686240+0000","last_became_peered":"2023-08-17T17:49:19.686240+0000","last_unstale":"2023-08-17T17:49:19.686438+0000","last_undegraded":"2023-08-17T17:49:19.686438+0000","last_fullsized":"2023-08-17T17:49:19.686438+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.340012+0000","last_change":"2023-08-17T17:49:19.338168+0000","last_active":"2023-08-17T17:49:19.340012+0000","last_peered":"2023-08-17T17:49:19.340012+0000","last_clean":"2023-08-17T17:49:19.340012+0000","last_became_active":"2023-08-17T17:49:19.337884+0000","last_became_peered":"2023-08-17T17:49:19.337884+0000","last_unstale":"2023-08-17T17:49:19.340012+0000","last_undegraded":"2023-08-17T17:49:19.340012+0000","last_fullsized":"2023-08-17T17:49:19.340012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693666+0000","last_change":"2023-08-17T17:49:19.693724+0000","last_active":"2023-08-17T17:49:19.693666+0000","last_peered":"2023-08-17T17:49:19.693666+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693492+0000","last_became_peered":"2023-08-17T17:49:19.693492+0000","last_unstale":"2023-08-17T17:49:19.693666+0000","last_undegraded":"2023-08-17T17:49:19.693666+0000","last_fullsized":"2023-08-17T17:49:19.693666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332828+0000","last_change":"2023-08-17T17:49:19.329035+0000","last_active":"2023-08-17T17:49:19.332828+0000","last_peered":"2023-08-17T17:49:19.332828+0000","last_clean":"2023-08-17T17:49:19.332828+0000","last_became_active":"2023-08-17T17:49:19.328686+0000","last_became_peered":"2023-08-17T17:49:19.328686+0000","last_unstale":"2023-08-17T17:49:19.332828+0000","last_undegraded":"2023-08-17T17:49:19.332828+0000","last_fullsized":"2023-08-17T17:49:19.332828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700291+0000","last_change":"2023-08-17T17:49:19.700364+0000","last_active":"2023-08-17T17:49:19.700291+0000","last_peered":"2023-08-17T17:49:19.700291+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699817+0000","last_became_peered":"2023-08-17T17:49:19.699817+0000","last_unstale":"2023-08-17T17:49:19.700291+0000","last_undegraded":"2023-08-17T17:49:19.700291+0000","last_fullsized":"2023-08-17T17:49:19.700291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337936+0000","last_change":"2023-08-17T17:49:19.336413+0000","last_active":"2023-08-17T17:49:19.337936+0000","last_peered":"2023-08-17T17:49:19.337936+0000","last_clean":"2023-08-17T17:49:19.337936+0000","last_became_active":"2023-08-17T17:49:19.335592+0000","last_became_peered":"2023-08-17T17:49:19.335592+0000","last_unstale":"2023-08-17T17:49:19.337936+0000","last_undegraded":"2023-08-17T17:49:19.337936+0000","last_fullsized":"2023-08-17T17:49:19.337936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693521+0000","last_change":"2023-08-17T17:49:19.693521+0000","last_active":"2023-08-17T17:49:19.693521+0000","last_peered":"2023-08-17T17:49:19.693521+0000","last_clean":"2023-08-17T17:49:19.693521+0000","last_became_active":"2023-08-17T17:49:19.692996+0000","last_became_peered":"2023-08-17T17:49:19.692996+0000","last_unstale":"2023-08-17T17:49:19.693521+0000","last_undegraded":"2023-08-17T17:49:19.693521+0000","last_fullsized":"2023-08-17T17:49:19.693521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332394+0000","last_change":"2023-08-17T17:49:19.324642+0000","last_active":"2023-08-17T17:49:19.332394+0000","last_peered":"2023-08-17T17:49:19.332394+0000","last_clean":"2023-08-17T17:49:19.332394+0000","last_became_active":"2023-08-17T17:49:19.324327+0000","last_became_peered":"2023-08-17T17:49:19.324327+0000","last_unstale":"2023-08-17T17:49:19.332394+0000","last_undegraded":"2023-08-17T17:49:19.332394+0000","last_fullsized":"2023-08-17T17:49:19.332394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681553+0000","last_change":"2023-08-17T17:49:19.681690+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681553+0000","last_undegraded":"2023-08-17T17:49:19.681553+0000","last_fullsized":"2023-08-17T17:49:19.681553+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335183+0000","last_change":"2023-08-17T17:49:19.332436+0000","last_active":"2023-08-17T17:49:19.335183+0000","last_peered":"2023-08-17T17:49:19.335183+0000","last_clean":"2023-08-17T17:49:19.335183+0000","last_became_active":"2023-08-17T17:49:19.332146+0000","last_became_peered":"2023-08-17T17:49:19.332146+0000","last_unstale":"2023-08-17T17:49:19.335183+0000","last_undegraded":"2023-08-17T17:49:19.335183+0000","last_fullsized":"2023-08-17T17:49:19.335183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691921+0000","last_change":"2023-08-17T17:49:19.691991+0000","last_active":"2023-08-17T17:49:19.691921+0000","last_peered":"2023-08-17T17:49:19.691921+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691732+0000","last_became_peered":"2023-08-17T17:49:19.691732+0000","last_unstale":"2023-08-17T17:49:19.691921+0000","last_undegraded":"2023-08-17T17:49:19.691921+0000","last_fullsized":"2023-08-17T17:49:19.691921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329922+0000","last_change":"2023-08-17T17:49:19.325834+0000","last_active":"2023-08-17T17:49:19.329922+0000","last_peered":"2023-08-17T17:49:19.329922+0000","last_clean":"2023-08-17T17:49:19.329922+0000","last_became_active":"2023-08-17T17:49:19.325261+0000","last_became_peered":"2023-08-17T17:49:19.325261+0000","last_unstale":"2023-08-17T17:49:19.329922+0000","last_undegraded":"2023-08-17T17:49:19.329922+0000","last_fullsized":"2023-08-17T17:49:19.329922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700066+0000","last_change":"2023-08-17T17:49:19.700149+0000","last_active":"2023-08-17T17:49:19.700066+0000","last_peered":"2023-08-17T17:49:19.700066+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699838+0000","last_became_peered":"2023-08-17T17:49:19.699838+0000","last_unstale":"2023-08-17T17:49:19.700066+0000","last_undegraded":"2023-08-17T17:49:19.700066+0000","last_fullsized":"2023-08-17T17:49:19.700066+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337932+0000","last_change":"2023-08-17T17:49:19.336190+0000","last_active":"2023-08-17T17:49:19.337932+0000","last_peered":"2023-08-17T17:49:19.337932+0000","last_clean":"2023-08-17T17:49:19.337932+0000","last_became_active":"2023-08-17T17:49:19.335782+0000","last_became_peered":"2023-08-17T17:49:19.335782+0000","last_unstale":"2023-08-17T17:49:19.337932+0000","last_undegraded":"2023-08-17T17:49:19.337932+0000","last_fullsized":"2023-08-17T17:49:19.337932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.677312+0000","last_change":"2023-08-17T17:49:19.677442+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.677312+0000","last_undegraded":"2023-08-17T17:49:19.677312+0000","last_fullsized":"2023-08-17T17:49:19.677312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332836+0000","last_change":"2023-08-17T17:49:19.329884+0000","last_active":"2023-08-17T17:49:19.332836+0000","last_peered":"2023-08-17T17:49:19.332836+0000","last_clean":"2023-08-17T17:49:19.332836+0000","last_became_active":"2023-08-17T17:49:19.329498+0000","last_became_peered":"2023-08-17T17:49:19.329498+0000","last_unstale":"2023-08-17T17:49:19.332836+0000","last_undegraded":"2023-08-17T17:49:19.332836+0000","last_fullsized":"2023-08-17T17:49:19.332836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.685087+0000","last_change":"2023-08-17T17:49:19.685259+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.685087+0000","last_undegraded":"2023-08-17T17:49:19.685087+0000","last_fullsized":"2023-08-17T17:49:19.685087+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335932+0000","last_change":"2023-08-17T17:49:19.334434+0000","last_active":"2023-08-17T17:49:19.335932+0000","last_peered":"2023-08-17T17:49:19.335932+0000","last_clean":"2023-08-17T17:49:19.335932+0000","last_became_active":"2023-08-17T17:49:19.334142+0000","last_became_peered":"2023-08-17T17:49:19.334142+0000","last_unstale":"2023-08-17T17:49:19.335932+0000","last_undegraded":"2023-08-17T17:49:19.335932+0000","last_fullsized":"2023-08-17T17:49:19.335932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690960+0000","last_change":"2023-08-17T17:49:19.691035+0000","last_active":"2023-08-17T17:49:19.690960+0000","last_peered":"2023-08-17T17:49:19.690960+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.690605+0000","last_became_peered":"2023-08-17T17:49:19.690605+0000","last_unstale":"2023-08-17T17:49:19.690960+0000","last_undegraded":"2023-08-17T17:49:19.690960+0000","last_fullsized":"2023-08-17T17:49:19.690960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329994+0000","last_change":"2023-08-17T17:49:19.326698+0000","last_active":"2023-08-17T17:49:19.329994+0000","last_peered":"2023-08-17T17:49:19.329994+0000","last_clean":"2023-08-17T17:49:19.329994+0000","last_became_active":"2023-08-17T17:49:19.326167+0000","last_became_peered":"2023-08-17T17:49:19.326167+0000","last_unstale":"2023-08-17T17:49:19.329994+0000","last_undegraded":"2023-08-17T17:49:19.329994+0000","last_fullsized":"2023-08-17T17:49:19.329994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692619+0000","last_change":"2023-08-17T17:49:19.692710+0000","last_active":"2023-08-17T17:49:19.692619+0000","last_peered":"2023-08-17T17:49:19.692619+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692379+0000","last_became_peered":"2023-08-17T17:49:19.692379+0000","last_unstale":"2023-08-17T17:49:19.692619+0000","last_undegraded":"2023-08-17T17:49:19.692619+0000","last_fullsized":"2023-08-17T17:49:19.692619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334913+0000","last_change":"2023-08-17T17:49:19.329215+0000","last_active":"2023-08-17T17:49:19.334913+0000","last_peered":"2023-08-17T17:49:19.334913+0000","last_clean":"2023-08-17T17:49:19.334913+0000","last_became_active":"2023-08-17T17:49:19.328771+0000","last_became_peered":"2023-08-17T17:49:19.328771+0000","last_unstale":"2023-08-17T17:49:19.334913+0000","last_undegraded":"2023-08-17T17:49:19.334913+0000","last_fullsized":"2023-08-17T17:49:19.334913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694500+0000","last_change":"2023-08-17T17:49:19.694579+0000","last_active":"2023-08-17T17:49:19.694500+0000","last_peered":"2023-08-17T17:49:19.694500+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694271+0000","last_became_peered":"2023-08-17T17:49:19.694271+0000","last_unstale":"2023-08-17T17:49:19.694500+0000","last_undegraded":"2023-08-17T17:49:19.694500+0000","last_fullsized":"2023-08-17T17:49:19.694500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332377+0000","last_change":"2023-08-17T17:49:19.324396+0000","last_active":"2023-08-17T17:49:19.332377+0000","last_peered":"2023-08-17T17:49:19.332377+0000","last_clean":"2023-08-17T17:49:19.332377+0000","last_became_active":"2023-08-17T17:49:19.324119+0000","last_became_peered":"2023-08-17T17:49:19.324119+0000","last_unstale":"2023-08-17T17:49:19.332377+0000","last_undegraded":"2023-08-17T17:49:19.332377+0000","last_fullsized":"2023-08-17T17:49:19.332377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695846+0000","last_change":"2023-08-17T17:49:19.695903+0000","last_active":"2023-08-17T17:49:19.695846+0000","last_peered":"2023-08-17T17:49:19.695846+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.695703+0000","last_became_peered":"2023-08-17T17:49:19.695703+0000","last_unstale":"2023-08-17T17:49:19.695846+0000","last_undegraded":"2023-08-17T17:49:19.695846+0000","last_fullsized":"2023-08-17T17:49:19.695846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337988+0000","last_change":"2023-08-17T17:49:19.336789+0000","last_active":"2023-08-17T17:49:19.337988+0000","last_peered":"2023-08-17T17:49:19.337988+0000","last_clean":"2023-08-17T17:49:19.337988+0000","last_became_active":"2023-08-17T17:49:19.335638+0000","last_became_peered":"2023-08-17T17:49:19.335638+0000","last_unstale":"2023-08-17T17:49:19.337988+0000","last_undegraded":"2023-08-17T17:49:19.337988+0000","last_fullsized":"2023-08-17T17:49:19.337988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.680809+0000","last_change":"2023-08-17T17:49:19.680952+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.680809+0000","last_undegraded":"2023-08-17T17:49:19.680809+0000","last_fullsized":"2023-08-17T17:49:19.680809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332309+0000","last_change":"2023-08-17T17:49:19.323231+0000","last_active":"2023-08-17T17:49:19.332309+0000","last_peered":"2023-08-17T17:49:19.332309+0000","last_clean":"2023-08-17T17:49:19.332309+0000","last_became_active":"2023-08-17T17:49:19.322950+0000","last_became_peered":"2023-08-17T17:49:19.322950+0000","last_unstale":"2023-08-17T17:49:19.332309+0000","last_undegraded":"2023-08-17T17:49:19.332309+0000","last_fullsized":"2023-08-17T17:49:19.332309+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693927+0000","last_change":"2023-08-17T17:49:19.693994+0000","last_active":"2023-08-17T17:49:19.693927+0000","last_peered":"2023-08-17T17:49:19.693927+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693700+0000","last_became_peered":"2023-08-17T17:49:19.693700+0000","last_unstale":"2023-08-17T17:49:19.693927+0000","last_undegraded":"2023-08-17T17:49:19.693927+0000","last_fullsized":"2023-08-17T17:49:19.693927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335184+0000","last_change":"2023-08-17T17:49:19.326736+0000","last_active":"2023-08-17T17:49:19.335184+0000","last_peered":"2023-08-17T17:49:19.335184+0000","last_clean":"2023-08-17T17:49:19.335184+0000","last_became_active":"2023-08-17T17:49:19.326484+0000","last_became_peered":"2023-08-17T17:49:19.326484+0000","last_unstale":"2023-08-17T17:49:19.335184+0000","last_undegraded":"2023-08-17T17:49:19.335184+0000","last_fullsized":"2023-08-17T17:49:19.335184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681143+0000","last_change":"2023-08-17T17:49:19.681274+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681143+0000","last_undegraded":"2023-08-17T17:49:19.681143+0000","last_fullsized":"2023-08-17T17:49:19.681143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335181+0000","last_change":"2023-08-17T17:49:19.327542+0000","last_active":"2023-08-17T17:49:19.335181+0000","last_peered":"2023-08-17T17:49:19.335181+0000","last_clean":"2023-08-17T17:49:19.335181+0000","last_became_active":"2023-08-17T17:49:19.327106+0000","last_became_peered":"2023-08-17T17:49:19.327106+0000","last_unstale":"2023-08-17T17:49:19.335181+0000","last_undegraded":"2023-08-17T17:49:19.335181+0000","last_fullsized":"2023-08-17T17:49:19.335181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687462+0000","last_change":"2023-08-17T17:49:19.687617+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687462+0000","last_undegraded":"2023-08-17T17:49:19.687462+0000","last_fullsized":"2023-08-17T17:49:19.687462+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329966+0000","last_change":"2023-08-17T17:49:19.326553+0000","last_active":"2023-08-17T17:49:19.329966+0000","last_peered":"2023-08-17T17:49:19.329966+0000","last_clean":"2023-08-17T17:49:19.329966+0000","last_became_active":"2023-08-17T17:49:19.326246+0000","last_became_peered":"2023-08-17T17:49:19.326246+0000","last_unstale":"2023-08-17T17:49:19.329966+0000","last_undegraded":"2023-08-17T17:49:19.329966+0000","last_fullsized":"2023-08-17T17:49:19.329966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.315081+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:49:19.315081+0000","last_peered":"2023-08-17T17:49:19.315081+0000","last_clean":"2023-08-17T17:49:19.315081+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:49:19.315081+0000","last_undegraded":"2023-08-17T17:49:19.315081+0000","last_fullsized":"2023-08-17T17:49:19.315081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691572+0000","last_change":"2023-08-17T17:49:19.691614+0000","last_active":"2023-08-17T17:49:19.691572+0000","last_peered":"2023-08-17T17:49:19.691572+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691423+0000","last_became_peered":"2023-08-17T17:49:19.691423+0000","last_unstale":"2023-08-17T17:49:19.691572+0000","last_undegraded":"2023-08-17T17:49:19.691572+0000","last_fullsized":"2023-08-17T17:49:19.691572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335200+0000","last_change":"2023-08-17T17:49:19.330639+0000","last_active":"2023-08-17T17:49:19.335200+0000","last_peered":"2023-08-17T17:49:19.335200+0000","last_clean":"2023-08-17T17:49:19.335200+0000","last_became_active":"2023-08-17T17:49:19.330350+0000","last_became_peered":"2023-08-17T17:49:19.330350+0000","last_unstale":"2023-08-17T17:49:19.335200+0000","last_undegraded":"2023-08-17T17:49:19.335200+0000","last_fullsized":"2023-08-17T17:49:19.335200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.312380+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:49:19.312380+0000","last_peered":"2023-08-17T17:49:19.312380+0000","last_clean":"2023-08-17T17:49:19.312380+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:49:19.312380+0000","last_undegraded":"2023-08-17T17:49:19.312380+0000","last_fullsized":"2023-08-17T17:49:19.312380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.686082+0000","last_change":"2023-08-17T17:49:19.686082+0000","last_active":"2023-08-17T17:49:19.686082+0000","last_peered":"2023-08-17T17:49:19.686082+0000","last_clean":"2023-08-17T17:49:19.686082+0000","last_became_active":"2023-08-17T17:49:19.685741+0000","last_became_peered":"2023-08-17T17:49:19.685741+0000","last_unstale":"2023-08-17T17:49:19.686082+0000","last_undegraded":"2023-08-17T17:49:19.686082+0000","last_fullsized":"2023-08-17T17:49:19.686082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329945+0000","last_change":"2023-08-17T17:49:19.326004+0000","last_active":"2023-08-17T17:49:19.329945+0000","last_peered":"2023-08-17T17:49:19.329945+0000","last_clean":"2023-08-17T17:49:19.329945+0000","last_became_active":"2023-08-17T17:49:19.325565+0000","last_became_peered":"2023-08-17T17:49:19.325565+0000","last_unstale":"2023-08-17T17:49:19.329945+0000","last_undegraded":"2023-08-17T17:49:19.329945+0000","last_fullsized":"2023-08-17T17:49:19.329945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.307336+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:49:19.307336+0000","last_peered":"2023-08-17T17:49:19.307336+0000","last_clean":"2023-08-17T17:49:19.307336+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:49:19.307336+0000","last_undegraded":"2023-08-17T17:49:19.307336+0000","last_fullsized":"2023-08-17T17:49:19.307336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.686198+0000","last_change":"2023-08-17T17:49:19.686198+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.686198+0000","last_undegraded":"2023-08-17T17:49:19.686198+0000","last_fullsized":"2023-08-17T17:49:19.686198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.331967+0000","last_change":"2023-08-17T17:49:19.323676+0000","last_active":"2023-08-17T17:49:19.331967+0000","last_peered":"2023-08-17T17:49:19.331967+0000","last_clean":"2023-08-17T17:49:19.331967+0000","last_became_active":"2023-08-17T17:49:19.323413+0000","last_became_peered":"2023-08-17T17:49:19.323413+0000","last_unstale":"2023-08-17T17:49:19.331967+0000","last_undegraded":"2023-08-17T17:49:19.331967+0000","last_fullsized":"2023-08-17T17:49:19.331967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.312588+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:49:19.312588+0000","last_peered":"2023-08-17T17:49:19.312588+0000","last_clean":"2023-08-17T17:49:19.312588+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:49:19.312588+0000","last_undegraded":"2023-08-17T17:49:19.312588+0000","last_fullsized":"2023-08-17T17:49:19.312588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327470+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:49:19.327470+0000","last_peered":"2023-08-17T17:49:19.327470+0000","last_clean":"2023-08-17T17:49:19.327470+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:49:19.327470+0000","last_undegraded":"2023-08-17T17:49:19.327470+0000","last_fullsized":"2023-08-17T17:49:19.327470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692415+0000","last_change":"2023-08-17T17:49:19.692902+0000","last_active":"2023-08-17T17:49:19.692415+0000","last_peered":"2023-08-17T17:49:19.692415+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691771+0000","last_became_peered":"2023-08-17T17:49:19.691771+0000","last_unstale":"2023-08-17T17:49:19.692415+0000","last_undegraded":"2023-08-17T17:49:19.692415+0000","last_fullsized":"2023-08-17T17:49:19.692415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334858+0000","last_change":"2023-08-17T17:49:19.327899+0000","last_active":"2023-08-17T17:49:19.334858+0000","last_peered":"2023-08-17T17:49:19.334858+0000","last_clean":"2023-08-17T17:49:19.334858+0000","last_became_active":"2023-08-17T17:49:19.327616+0000","last_became_peered":"2023-08-17T17:49:19.327616+0000","last_unstale":"2023-08-17T17:49:19.334858+0000","last_undegraded":"2023-08-17T17:49:19.334858+0000","last_fullsized":"2023-08-17T17:49:19.334858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327562+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:49:19.327562+0000","last_peered":"2023-08-17T17:49:19.327562+0000","last_clean":"2023-08-17T17:49:19.327562+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:49:19.327562+0000","last_undegraded":"2023-08-17T17:49:19.327562+0000","last_fullsized":"2023-08-17T17:49:19.327562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":5,"reported_epoch":76,"state":"active","last_fresh":"2023-08-17T17:49:19.700158+0000","last_change":"2023-08-17T17:49:19.700158+0000","last_active":"2023-08-17T17:49:19.700158+0000","last_peered":"2023-08-17T17:49:19.700158+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700158+0000","last_became_peered":"2023-08-17T17:49:19.700158+0000","last_unstale":"2023-08-17T17:49:19.700158+0000","last_undegraded":"2023-08-17T17:49:19.700158+0000","last_fullsized":"2023-08-17T17:49:19.700158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337871+0000","last_change":"2023-08-17T17:49:19.335888+0000","last_active":"2023-08-17T17:49:19.337871+0000","last_peered":"2023-08-17T17:49:19.337871+0000","last_clean":"2023-08-17T17:49:19.337871+0000","last_became_active":"2023-08-17T17:49:19.335473+0000","last_became_peered":"2023-08-17T17:49:19.335473+0000","last_unstale":"2023-08-17T17:49:19.337871+0000","last_undegraded":"2023-08-17T17:49:19.337871+0000","last_fullsized":"2023-08-17T17:49:19.337871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.326902+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:49:19.326902+0000","last_peered":"2023-08-17T17:49:19.326902+0000","last_clean":"2023-08-17T17:49:19.326902+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:49:19.326902+0000","last_undegraded":"2023-08-17T17:49:19.326902+0000","last_fullsized":"2023-08-17T17:49:19.326902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693028+0000","last_change":"2023-08-17T17:49:19.693028+0000","last_active":"2023-08-17T17:49:19.693028+0000","last_peered":"2023-08-17T17:49:19.693028+0000","last_clean":"2023-08-17T17:49:19.693028+0000","last_became_active":"2023-08-17T17:49:19.692600+0000","last_became_peered":"2023-08-17T17:49:19.692600+0000","last_unstale":"2023-08-17T17:49:19.693028+0000","last_undegraded":"2023-08-17T17:49:19.693028+0000","last_fullsized":"2023-08-17T17:49:19.693028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337964+0000","last_change":"2023-08-17T17:49:19.336579+0000","last_active":"2023-08-17T17:49:19.337964+0000","last_peered":"2023-08-17T17:49:19.337964+0000","last_clean":"2023-08-17T17:49:19.337964+0000","last_became_active":"2023-08-17T17:49:19.336142+0000","last_became_peered":"2023-08-17T17:49:19.336142+0000","last_unstale":"2023-08-17T17:49:19.337964+0000","last_undegraded":"2023-08-17T17:49:19.337964+0000","last_fullsized":"2023-08-17T17:49:19.337964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.315094+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:49:19.315094+0000","last_peered":"2023-08-17T17:49:19.315094+0000","last_clean":"2023-08-17T17:49:19.315094+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:49:19.315094+0000","last_undegraded":"2023-08-17T17:49:19.315094+0000","last_fullsized":"2023-08-17T17:49:19.315094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692584+0000","last_change":"2023-08-17T17:49:19.692672+0000","last_active":"2023-08-17T17:49:19.692584+0000","last_peered":"2023-08-17T17:49:19.692584+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692387+0000","last_became_peered":"2023-08-17T17:49:19.692387+0000","last_unstale":"2023-08-17T17:49:19.692584+0000","last_undegraded":"2023-08-17T17:49:19.692584+0000","last_fullsized":"2023-08-17T17:49:19.692584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335059+0000","last_change":"2023-08-17T17:49:19.325361+0000","last_active":"2023-08-17T17:49:19.335059+0000","last_peered":"2023-08-17T17:49:19.335059+0000","last_clean":"2023-08-17T17:49:19.335059+0000","last_became_active":"2023-08-17T17:49:19.325094+0000","last_became_peered":"2023-08-17T17:49:19.325094+0000","last_unstale":"2023-08-17T17:49:19.335059+0000","last_undegraded":"2023-08-17T17:49:19.335059+0000","last_fullsized":"2023-08-17T17:49:19.335059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.322602+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:49:19.322602+0000","last_peered":"2023-08-17T17:49:19.322602+0000","last_clean":"2023-08-17T17:49:19.322602+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:49:19.322602+0000","last_undegraded":"2023-08-17T17:49:19.322602+0000","last_fullsized":"2023-08-17T17:49:19.322602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.439}]},{"osd":1,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.28999999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.745,"5min":0.78100000000000003,"15min":0.80000000000000004},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.32600000000000001,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.48199999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":0.80100000000000005,"15min":0.85499999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.34499999999999997,"5min":0.34000000000000002,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.372,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.72799999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.626}]},{"osd":6,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.67700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.436,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.46100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.374}]},{"osd":1,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.33000000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.436},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.745,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84599999999999997,"5min":0.879,"15min":1.0609999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.377},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.498,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.32700000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68200000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.34200000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.77300000000000002,"15min":1.026},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.58799999999999997,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.496},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":1.51,"15min":1.51},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.74399999999999999,"5min":0.872,"15min":1.0740000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.79900000000000004},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.34699999999999998},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.309},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.371},"min":{"1min":0.28899999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53800000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.36199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.22800000000000001},"max":{"1min":0.47599999999999998,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41199999999999998,"15min":0.40699999999999997},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.56899999999999995,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.61399999999999999,"5min":0.625,"15min":0.66600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.35499999999999998,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.46600000000000003,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.624,"15min":0.61699999999999999},"min":{"1min":0.51000000000000001,"5min":0.39500000000000002,"15min":0.39000000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63900000000000001,"15min":0.623},"min":{"1min":0.497,"5min":0.39700000000000002,"15min":0.34399999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.331},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.66100000000000003,"15min":0.63200000000000001},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.54800000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.345},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.39800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.68700000000000006,"15min":0.65700000000000003},"min":{"1min":0.59799999999999998,"5min":0.42399999999999999,"15min":0.40899999999999997},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.68700000000000006,"15min":0.65800000000000003},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.41199999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.66700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.23400000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.54000000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.255},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.23899999999999999,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.66200000000000003},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36099999999999999,"15min":0.36399999999999999},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46300000000000002,"5min":0.54100000000000004,"15min":0.60099999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40300000000000002},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51500000000000001,"5min":0.58199999999999996,"15min":0.65200000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.32500000000000001,"5min":0.26600000000000001,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.55400000000000005,"15min":0.66200000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40899999999999997,"15min":0.40999999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.52700000000000002,"5min":0.56999999999999995,"15min":0.65700000000000003},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.90000000000000002,"15min":1.3300000000000001},"last":0.499}]},{"osd":5,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.63400000000000001,"15min":0.61499999999999999},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.439},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.391},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.71799999999999997,"15min":0.67400000000000004},"min":{"1min":0.53200000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.6109999999999998,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":0.997,"15min":1.544},"last":0.51100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.372},"min":{"1min":0.28899999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54100000000000004,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.60799999999999998,"5min":1.268,"15min":1.268},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40300000000000002,"15min":0.40000000000000002},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.222},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31}]},{"osd":4,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.46999999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.51,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.49399999999999999,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.63300000000000001},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.5509999999999999,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.627,"15min":0.60699999999999998},"min":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.39700000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.53200000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70199999999999996,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3859999999999999,"5min":2.984,"15min":2.984},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.48899999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.191},"max":{"1min":0.48399999999999999,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38,"15min":0.376},"min":{"1min":0.255,"5min":0.25,"15min":0.224},"max":{"1min":0.53200000000000003,"5min":0.60599999999999998,"15min":0.71799999999999997},"last":0.245}]},{"osd":1,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38100000000000001,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.215},"max":{"1min":0.57599999999999996,"5min":0.61099999999999999,"15min":0.73799999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39600000000000002,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"min":{"1min":0.30599999999999999,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41299999999999998},"min":{"1min":0.35999999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.71099999999999997},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.45400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.89000000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.272,"5min":1.272,"15min":2.1309999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.38100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.443,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.65400000000000003,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.65700000000000003,"15min":0.63600000000000001},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.66600000000000004,"15min":0.65000000000000002},"min":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.623},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.55100000000000005,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":1.014,"5min":1.016,"15min":2.1669999999999998},"last":0.58399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.752,"5min":0.76900000000000002,"15min":0.89100000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.629},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.51200000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.84799999999999998},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.44800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76200000000000001,"5min":0.77900000000000003,"15min":0.80100000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.85699999999999998},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.34100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.39100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68000000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68899999999999995,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.82199999999999995,"15min":0.91900000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77900000000000003,"5min":0.877,"15min":1.056},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.434,"5min":0.32900000000000001,"15min":0.27700000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.2609999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.317,"15min":0.31},"max":{"1min":1.022,"5min":1.022,"15min":1.1499999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.242},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.29799999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.438}]},{"osd":2,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.622,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.252},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.49299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.274},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.179},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.3080000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.35499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.75,"15min":1.0620000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":1.0740000000000001},"last":0.38100000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.42199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":1.01},"last":0.316},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.44700000000000001,"5min":0.33300000000000002,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.77000000000000002,"15min":1.1020000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.79700000000000004,"5min":0.82299999999999995,"15min":1.038},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.498,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":1.1279999999999999},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:49:23.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-08-17T17:49:23.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.679803+0000', 'last_change': '2023-08-17T17:49:19.679944+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.679803+0000', 'last_undegraded': '2023-08-17T17:49:19.679803+0000', 'last_fullsized': '2023-08-17T17:49:19.679803+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:49:23.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-08-17T17:49:23.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.681781+0000', 'last_change': '2023-08-17T17:49:19.681912+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.681781+0000', 'last_undegraded': '2023-08-17T17:49:19.681781+0000', 'last_fullsized': '2023-08-17T17:49:19.681781+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:23.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-08-17T17:49:23.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.687049+0000', 'last_change': '2023-08-17T17:49:19.687171+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.687049+0000', 'last_undegraded': '2023-08-17T17:49:19.687049+0000', 'last_fullsized': '2023-08-17T17:49:19.687049+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:49:23.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-08-17T17:49:23.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.688432+0000', 'last_change': '2023-08-17T17:49:19.688432+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.688432+0000', 'last_undegraded': '2023-08-17T17:49:19.688432+0000', 'last_fullsized': '2023-08-17T17:49:19.688432+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': ['6', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:23.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-08-17T17:49:23.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.679097+0000', 'last_change': '2023-08-17T17:49:19.679235+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.679097+0000', 'last_undegraded': '2023-08-17T17:49:19.679097+0000', 'last_fullsized': '2023-08-17T17:49:19.679097+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:49:23.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-08-17T17:49:23.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.690552+0000', 'last_change': '2023-08-17T17:49:19.692027+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.690552+0000', 'last_undegraded': '2023-08-17T17:49:19.690552+0000', 'last_fullsized': '2023-08-17T17:49:19.690552+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:23.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-08-17T17:49:23.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.681409+0000', 'last_change': '2023-08-17T17:49:19.681509+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.681409+0000', 'last_undegraded': '2023-08-17T17:49:19.681409+0000', 'last_fullsized': '2023-08-17T17:49:19.681409+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:23.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-08-17T17:49:23.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.682674+0000', 'last_change': '2023-08-17T17:49:19.682807+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.682674+0000', 'last_undegraded': '2023-08-17T17:49:19.682674+0000', 'last_fullsized': '2023-08-17T17:49:19.682674+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:49:23.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-08-17T17:49:23.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.682255+0000', 'last_change': '2023-08-17T17:49:19.682401+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.682255+0000', 'last_undegraded': '2023-08-17T17:49:19.682255+0000', 'last_fullsized': '2023-08-17T17:49:19.682255+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:49:23.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-08-17T17:49:23.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.683524+0000', 'last_change': '2023-08-17T17:49:19.683665+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.683524+0000', 'last_undegraded': '2023-08-17T17:49:19.683524+0000', 'last_fullsized': '2023-08-17T17:49:19.683524+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:49:23.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-08-17T17:49:23.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.677752+0000', 'last_change': '2023-08-17T17:49:19.677862+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.677752+0000', 'last_undegraded': '2023-08-17T17:49:19.677752+0000', 'last_fullsized': '2023-08-17T17:49:19.677752+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:49:23.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-08-17T17:49:23.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.692331+0000', 'last_change': '2023-08-17T17:49:19.692457+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.692331+0000', 'last_undegraded': '2023-08-17T17:49:19.692331+0000', 'last_fullsized': '2023-08-17T17:49:19.692331+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:23.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-08-17T17:49:23.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.686254+0000', 'last_change': '2023-08-17T17:49:19.686415+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.686254+0000', 'last_undegraded': '2023-08-17T17:49:19.686254+0000', 'last_fullsized': '2023-08-17T17:49:19.686254+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:23.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-08-17T17:49:23.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.687002+0000', 'last_change': '2023-08-17T17:49:19.687002+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.687002+0000', 'last_undegraded': '2023-08-17T17:49:19.687002+0000', 'last_fullsized': '2023-08-17T17:49:19.687002+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': ['6', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:23.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-08-17T17:49:23.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.681553+0000', 'last_change': '2023-08-17T17:49:19.681690+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.681553+0000', 'last_undegraded': '2023-08-17T17:49:19.681553+0000', 'last_fullsized': '2023-08-17T17:49:19.681553+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': ['4', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:49:23.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-08-17T17:49:23.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.677312+0000', 'last_change': '2023-08-17T17:49:19.677442+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.677312+0000', 'last_undegraded': '2023-08-17T17:49:19.677312+0000', 'last_fullsized': '2023-08-17T17:49:19.677312+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:49:23.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-08-17T17:49:23.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.685087+0000', 'last_change': '2023-08-17T17:49:19.685259+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.685087+0000', 'last_undegraded': '2023-08-17T17:49:19.685087+0000', 'last_fullsized': '2023-08-17T17:49:19.685087+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:49:23.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-08-17T17:49:23.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.680809+0000', 'last_change': '2023-08-17T17:49:19.680952+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.680809+0000', 'last_undegraded': '2023-08-17T17:49:19.680809+0000', 'last_fullsized': '2023-08-17T17:49:19.680809+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': ['4', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:49:23.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-08-17T17:49:23.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.681143+0000', 'last_change': '2023-08-17T17:49:19.681274+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.681143+0000', 'last_undegraded': '2023-08-17T17:49:19.681143+0000', 'last_fullsized': '2023-08-17T17:49:19.681143+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:23.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-08-17T17:49:23.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.687462+0000', 'last_change': '2023-08-17T17:49:19.687617+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.687462+0000', 'last_undegraded': '2023-08-17T17:49:19.687462+0000', 'last_fullsized': '2023-08-17T17:49:19.687462+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:23.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-08-17T17:49:23.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 76, 'state': 'creating+activating', 'last_fresh': '2023-08-17T17:49:19.686198+0000', 'last_change': '2023-08-17T17:49:19.686198+0000', 'last_active': '2023-08-17T17:49:19.301191+0000', 'last_peered': '2023-08-17T17:49:19.301191+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:19.686198+0000', 'last_undegraded': '2023-08-17T17:49:19.686198+0000', 'last_fullsized': '2023-08-17T17:49:19.686198+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:23.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-08-17T17:49:23.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 5, 'reported_epoch': 76, 'state': 'active', 'last_fresh': '2023-08-17T17:49:19.700158+0000', 'last_change': '2023-08-17T17:49:19.700158+0000', 'last_active': '2023-08-17T17:49:19.700158+0000', 'last_peered': '2023-08-17T17:49:19.700158+0000', 'last_clean': '2023-08-17T17:49:19.301191+0000', 'last_became_active': '2023-08-17T17:49:19.700158+0000', 'last_became_peered': '2023-08-17T17:49:19.700158+0000', 'last_unstale': '2023-08-17T17:49:19.700158+0000', 'last_undegraded': '2023-08-17T17:49:19.700158+0000', 'last_fullsized': '2023-08-17T17:49:19.700158+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:19.301191+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': ['6', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:23.370 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T17:49:23.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.498+0000 7f966359e700 1 Processor -- start 2023-08-17T17:49:23.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.498+0000 7f966359e700 1 -- start start 2023-08-17T17:49:23.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f966359e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96640a7bd0 0x7f9664063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f966359e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96640a8050 0x7f96640642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f966359e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9664063960 con 0x7f96640c01b0 2023-08-17T17:49:23.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f966359e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9664063030 con 0x7f96640a8050 2023-08-17T17:49:23.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f966359e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9664063310 con 0x7f96640a7bd0 2023-08-17T17:49:23.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f9662d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96640a8050 0x7f96640642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f966259c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f96640c01b0 0x7f96640c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35068/0 (socket says 172.21.15.78:35068) 2023-08-17T17:49:23.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f966259c700 1 -- 172.21.15.78:0/2094219162 learned_addr learned my addr 172.21.15.78:0/2094219162 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:23.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f9659d9b700 1 --2- 172.21.15.78:0/2094219162 >> v2:172.21.15.150:3300/0 conn(0x7f96640a7bd0 0x7f9664063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f9662d9d700 1 -- 172.21.15.78:0/2094219162 >> v2:172.21.15.150:3300/0 conn(0x7f96640a7bd0 msgr2=0x7f9664063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:23.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f9662d9d700 1 --2- 172.21.15.78:0/2094219162 >> v2:172.21.15.150:3300/0 conn(0x7f96640a7bd0 0x7f9664063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f9662d9d700 1 -- 172.21.15.78:0/2094219162 >> v1:172.21.15.78:6789/0 conn(0x7f96640c01b0 legacy=0x7f96640c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f9661d9b700 1 -- 172.21.15.78:0/2094219162 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794655193 0 0) 0x7f9664063960 con 0x7f96640c01b0 2023-08-17T17:49:23.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.499+0000 7f9662d9d700 1 -- 172.21.15.78:0/2094219162 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96640635f0 con 0x7f96640a8050 2023-08-17T17:49:23.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f9662d9d700 1 --2- 172.21.15.78:0/2094219162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640a8050 0x7f96640642e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f9664098d60 tx=0x7f965c009780).ready entity=mon.0 client_cookie=5e6160001c47690e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:23.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f9661d9b700 1 -- 172.21.15.78:0/2094219162 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c00e070 con 0x7f96640a8050 2023-08-17T17:49:23.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f9661d9b700 1 -- 172.21.15.78:0/2094219162 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c00bc30 con 0x7f96640a8050 2023-08-17T17:49:23.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f9661d9b700 1 -- 172.21.15.78:0/2094219162 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c012410 con 0x7f96640a8050 2023-08-17T17:49:23.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f966359e700 1 -- 172.21.15.78:0/2094219162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640a8050 msgr2=0x7f96640642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f966359e700 1 --2- 172.21.15.78:0/2094219162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640a8050 0x7f96640642e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f9664098d60 tx=0x7f965c009780).stop 2023-08-17T17:49:23.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f966359e700 1 -- 172.21.15.78:0/2094219162 shutdown_connections 2023-08-17T17:49:23.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f966359e700 1 --2- 172.21.15.78:0/2094219162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640a8050 0x7f96640642e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f966359e700 1 --2- 172.21.15.78:0/2094219162 >> v2:172.21.15.150:3300/0 conn(0x7f96640a7bd0 0x7f9664063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f966359e700 1 -- 172.21.15.78:0/2094219162 >> 172.21.15.78:0/2094219162 conn(0x7f966406a6c0 msgr2=0x7f96640cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:23.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f966359e700 1 -- 172.21.15.78:0/2094219162 shutdown_connections 2023-08-17T17:49:23.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.500+0000 7f966359e700 1 -- 172.21.15.78:0/2094219162 wait complete. 2023-08-17T17:49:23.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.501+0000 7f966359e700 1 Processor -- start 2023-08-17T17:49:23.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.501+0000 7f966359e700 1 -- start start 2023-08-17T17:49:23.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f966359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96640a7bd0 0x7f96640b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f966359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96640a8050 0x7f9664098280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f966359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640c01b0 0x7f96640c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f966359e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9664156380 con 0x7f96640c01b0 2023-08-17T17:49:23.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f966359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9664098770 con 0x7f96640a8050 2023-08-17T17:49:23.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f966359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9664098a20 con 0x7f96640a7bd0 2023-08-17T17:49:23.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f9662d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640c01b0 0x7f96640c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f9662d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640c01b0 0x7f96640c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56618/0 (socket says 172.21.15.78:56618) 2023-08-17T17:49:23.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f9662d9d700 1 -- 172.21.15.78:0/774780387 learned_addr learned my addr 172.21.15.78:0/774780387 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:23.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f9659d9b700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96640a8050 0x7f9664098280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.502+0000 7f966259c700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96640a7bd0 0x7f96640b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f9662d9d700 1 -- 172.21.15.78:0/774780387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96640a7bd0 msgr2=0x7f96640b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f9662d9d700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96640a7bd0 0x7f96640b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f9662d9d700 1 -- 172.21.15.78:0/774780387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96640a8050 msgr2=0x7f9664098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f9662d9d700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96640a8050 0x7f9664098280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f9662d9d700 1 -- 172.21.15.78:0/774780387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c009a20 con 0x7f96640c01b0 2023-08-17T17:49:23.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f966259c700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96640a7bd0 0x7f96640b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:23.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f9662d9d700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640c01b0 0x7f96640c1de0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f965c009fd0 tx=0x7f965c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:23.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f965affd700 1 -- 172.21.15.78:0/774780387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c012410 con 0x7f96640c01b0 2023-08-17T17:49:23.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f965affd700 1 -- 172.21.15.78:0/774780387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c00b6f0 con 0x7f96640c01b0 2023-08-17T17:49:23.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f966359e700 1 -- 172.21.15.78:0/774780387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9664155a50 con 0x7f96640c01b0 2023-08-17T17:49:23.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f965affd700 1 -- 172.21.15.78:0/774780387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c011d10 con 0x7f96640c01b0 2023-08-17T17:49:23.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.503+0000 7f966359e700 1 -- 172.21.15.78:0/774780387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9664156010 con 0x7f96640c01b0 2023-08-17T17:49:23.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.504+0000 7f966359e700 1 -- 172.21.15.78:0/774780387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96641564f0 con 0x7f96640c01b0 2023-08-17T17:49:23.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.504+0000 7f965affd700 1 -- 172.21.15.78:0/774780387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f965c01d630 con 0x7f96640c01b0 2023-08-17T17:49:23.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.505+0000 7f965affd700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f964405ed90 0x7f9644061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.505+0000 7f965affd700 1 -- 172.21.15.78:0/774780387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f965c07bf90 con 0x7f96640c01b0 2023-08-17T17:49:23.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.505+0000 7f966259c700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f964405ed90 0x7f9644061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.505+0000 7f966259c700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f964405ed90 0x7f9644061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9654001710 tx=0x7f9654009040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:23.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.509+0000 7f965affd700 1 -- 172.21.15.78:0/774780387 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f965c04d510 con 0x7f96640c01b0 2023-08-17T17:49:23.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.736+0000 7f966359e700 1 -- 172.21.15.78:0/774780387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f96640c63e0 con 0x7f96640c01b0 2023-08-17T17:49:23.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.737+0000 7f965affd700 1 -- 172.21.15.78:0/774780387 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1073 (secure 0 0 0) 0x7f965c050b30 con 0x7f96640c01b0 2023-08-17T17:49:23.737 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:23.738 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":917,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":77,"num_osds":8,"num_up_osds":8,"osd_up_since":1692293655,"num_in_osds":8,"osd_in_since":1692293648,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":115},{"state_name":"creating+activating","count":21},{"state_name":"active","count":1}],"num_pgs":137,"num_pools":4,"num_objects":2,"data_bytes":554,"bytes_used":2461925376,"bytes_avail":770632187904,"bytes_total":773094113280,"inactive_pgs_ratio":0.15328466892242432},"fsmap":{"epoch":25,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6246}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-17T17:48:11.469437+0000","services":{}},"progress_events":{}} 2023-08-17T17:49:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.738+0000 7f966359e700 1 -- 172.21.15.78:0/774780387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f964405ed90 msgr2=0x7f9644061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.738+0000 7f966359e700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f964405ed90 0x7f9644061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9654001710 tx=0x7f9654009040).stop 2023-08-17T17:49:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.738+0000 7f966359e700 1 -- 172.21.15.78:0/774780387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640c01b0 msgr2=0x7f96640c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.738+0000 7f966359e700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640c01b0 0x7f96640c1de0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f965c009fd0 tx=0x7f965c009780).stop 2023-08-17T17:49:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.739+0000 7f966359e700 1 -- 172.21.15.78:0/774780387 shutdown_connections 2023-08-17T17:49:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.739+0000 7f966359e700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f964405ed90 0x7f9644061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.739+0000 7f966359e700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96640c01b0 0x7f96640c1de0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.739+0000 7f966359e700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96640a7bd0 0x7f96640b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.739+0000 7f966359e700 1 --2- 172.21.15.78:0/774780387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96640a8050 0x7f9664098280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.739+0000 7f966359e700 1 -- 172.21.15.78:0/774780387 >> 172.21.15.78:0/774780387 conn(0x7f966406a6c0 msgr2=0x7f96640cacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.739+0000 7f966359e700 1 -- 172.21.15.78:0/774780387 shutdown_connections 2023-08-17T17:49:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.739+0000 7f966359e700 1 -- 172.21.15.78:0/774780387 wait complete. 2023-08-17T17:49:23.751 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-17T17:49:23.751 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:49:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.864+0000 7f65e03c1700 1 Processor -- start 2023-08-17T17:49:23.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.864+0000 7f65e03c1700 1 -- start start 2023-08-17T17:49:23.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.865+0000 7f65e03c1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65d8151e40 0x7f65d8152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.865+0000 7f65e03c1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d80bf210 con 0x7f65d80a7c90 2023-08-17T17:49:23.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.865+0000 7f65e03c1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d80c5a80 con 0x7f65d80be4d0 2023-08-17T17:49:23.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.865+0000 7f65e03c1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d80c5450 con 0x7f65d8151e40 2023-08-17T17:49:23.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.865+0000 7f65de15d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65d8151e40 0x7f65d8152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.865+0000 7f65dd95c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f65d80a7c90 0x7f65d80c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35078/0 (socket says 172.21.15.78:35078) 2023-08-17T17:49:23.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.865+0000 7f65dd95c700 1 -- 172.21.15.78:0/305108985 learned_addr learned my addr 172.21.15.78:0/305108985 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:23.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.866+0000 7f65de15d700 1 -- 172.21.15.78:0/305108985 >> v1:172.21.15.150:6789/0 conn(0x7f65d80be4d0 legacy=0x7f65d80be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:23.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.866+0000 7f65de15d700 1 -- 172.21.15.78:0/305108985 >> v1:172.21.15.78:6789/0 conn(0x7f65d80a7c90 legacy=0x7f65d80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.866+0000 7f65de15d700 1 -- 172.21.15.78:0/305108985 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d81533f0 con 0x7f65d8151e40 2023-08-17T17:49:23.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.866+0000 7f65dd15b700 1 -- 172.21.15.78:0/305108985 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601804795 0 0) 0x7f65d80bf210 con 0x7f65d80a7c90 2023-08-17T17:49:23.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.866+0000 7f65de15d700 1 --2- 172.21.15.78:0/305108985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d8151e40 0x7f65d8152f00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f65d4009e60 tx=0x7f65d4009780).ready entity=mon.0 client_cookie=c4b4b66455953f2a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:23.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.866+0000 7f65dd15b700 1 -- 172.21.15.78:0/305108985 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d400e070 con 0x7f65d8151e40 2023-08-17T17:49:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.866+0000 7f65dd15b700 1 -- 172.21.15.78:0/305108985 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d400bbf0 con 0x7f65d8151e40 2023-08-17T17:49:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.866+0000 7f65dd15b700 1 -- 172.21.15.78:0/305108985 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4012410 con 0x7f65d8151e40 2023-08-17T17:49:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.866+0000 7f65e03c1700 1 -- 172.21.15.78:0/305108985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d8151e40 msgr2=0x7f65d8152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.866+0000 7f65e03c1700 1 --2- 172.21.15.78:0/305108985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d8151e40 0x7f65d8152f00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f65d4009e60 tx=0x7f65d4009780).stop 2023-08-17T17:49:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.867+0000 7f65e03c1700 1 -- 172.21.15.78:0/305108985 shutdown_connections 2023-08-17T17:49:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.867+0000 7f65e03c1700 1 --2- 172.21.15.78:0/305108985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d8151e40 0x7f65d8152f00 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.867+0000 7f65e03c1700 1 -- 172.21.15.78:0/305108985 >> 172.21.15.78:0/305108985 conn(0x7f65d8092330 msgr2=0x7f65d8062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:23.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.867+0000 7f65e03c1700 1 -- 172.21.15.78:0/305108985 shutdown_connections 2023-08-17T17:49:23.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.867+0000 7f65e03c1700 1 -- 172.21.15.78:0/305108985 wait complete. 2023-08-17T17:49:23.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.868+0000 7f65e03c1700 1 Processor -- start 2023-08-17T17:49:23.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.868+0000 7f65e03c1700 1 -- start start 2023-08-17T17:49:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.868+0000 7f65e03c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d80a7c90 0x7f65d814bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.868+0000 7f65e03c1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65d80be4d0 0x7f65d80c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.868+0000 7f65e03c1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65d8151e40 0x7f65d80c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.868+0000 7f65e03c1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80c4610 con 0x7f65d80a7c90 2023-08-17T17:49:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.868+0000 7f65e03c1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d8154420 con 0x7f65d80be4d0 2023-08-17T17:49:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.868+0000 7f65e03c1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80ad440 con 0x7f65d8151e40 2023-08-17T17:49:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de15d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d80a7c90 0x7f65d814bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de15d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d80a7c90 0x7f65d814bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56636/0 (socket says 172.21.15.78:56636) 2023-08-17T17:49:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de15d700 1 -- 172.21.15.78:0/3694549354 learned_addr learned my addr 172.21.15.78:0/3694549354 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65dd95c700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65d80be4d0 0x7f65d80c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de95e700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65d8151e40 0x7f65d80c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de15d700 1 -- 172.21.15.78:0/3694549354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65d8151e40 msgr2=0x7f65d80c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de15d700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65d8151e40 0x7f65d80c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de15d700 1 -- 172.21.15.78:0/3694549354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65d80be4d0 msgr2=0x7f65d80c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de15d700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65d80be4d0 0x7f65d80c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de15d700 1 -- 172.21.15.78:0/3694549354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d4009a20 con 0x7f65d80a7c90 2023-08-17T17:49:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65dd95c700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65d80be4d0 0x7f65d80c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de95e700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65d8151e40 0x7f65d80c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65de15d700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d80a7c90 0x7f65d814bb10 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f65d400b6c0 tx=0x7f65d4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65ce7fc700 1 -- 172.21.15.78:0/3694549354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d401c660 con 0x7f65d80a7c90 2023-08-17T17:49:23.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65ce7fc700 1 -- 172.21.15.78:0/3694549354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d401c7c0 con 0x7f65d80a7c90 2023-08-17T17:49:23.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65e03c1700 1 -- 172.21.15.78:0/3694549354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d80ad8d0 con 0x7f65d80a7c90 2023-08-17T17:49:23.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65ce7fc700 1 -- 172.21.15.78:0/3694549354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d401cb80 con 0x7f65d80a7c90 2023-08-17T17:49:23.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.869+0000 7f65e03c1700 1 -- 172.21.15.78:0/3694549354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d80ac830 con 0x7f65d80a7c90 2023-08-17T17:49:23.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.870+0000 7f65e03c1700 1 -- 172.21.15.78:0/3694549354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d80ad720 con 0x7f65d80a7c90 2023-08-17T17:49:23.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.870+0000 7f65ce7fc700 1 -- 172.21.15.78:0/3694549354 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f65d401d420 con 0x7f65d80a7c90 2023-08-17T17:49:23.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.871+0000 7f65ce7fc700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f65bc05ed90 0x7f65bc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:23.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.871+0000 7f65ce7fc700 1 -- 172.21.15.78:0/3694549354 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f65d407bc20 con 0x7f65d80a7c90 2023-08-17T17:49:23.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.871+0000 7f65dd95c700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f65bc05ed90 0x7f65bc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:23.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.871+0000 7f65dd95c700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f65bc05ed90 0x7f65bc061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f65c80011e0 tx=0x7f65c8009040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:23.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:23.875+0000 7f65ce7fc700 1 -- 172.21.15.78:0/3694549354 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f65d404d160 con 0x7f65d80a7c90 2023-08-17T17:49:24.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.033+0000 7f65e03c1700 1 -- 172.21.15.78:0/3694549354 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65d8155850 con 0x7f65bc05ed90 2023-08-17T17:49:24.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.043+0000 7f65ce7fc700 1 -- 172.21.15.78:0/3694549354 <== mgr.6066 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360361 (secure 0 0 0) 0x7f65d8155850 con 0x7f65bc05ed90 2023-08-17T17:49:24.046 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 -- 172.21.15.78:0/3694549354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f65bc05ed90 msgr2=0x7f65bc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f65bc05ed90 0x7f65bc061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f65c80011e0 tx=0x7f65c8009040).stop 2023-08-17T17:49:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 -- 172.21.15.78:0/3694549354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d80a7c90 msgr2=0x7f65d814bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d80a7c90 0x7f65d814bb10 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f65d400b6c0 tx=0x7f65d4009780).stop 2023-08-17T17:49:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 -- 172.21.15.78:0/3694549354 shutdown_connections 2023-08-17T17:49:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f65bc05ed90 0x7f65bc061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65d8151e40 0x7f65d80c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d80a7c90 0x7f65d814bb10 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 --2- 172.21.15.78:0/3694549354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65d80be4d0 0x7f65d80c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 -- 172.21.15.78:0/3694549354 >> 172.21.15.78:0/3694549354 conn(0x7f65d8092330 msgr2=0x7f65d8067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 -- 172.21.15.78:0/3694549354 shutdown_connections 2023-08-17T17:49:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:24.046+0000 7f65e03c1700 1 -- 172.21.15.78:0/3694549354 wait complete. 2023-08-17T17:49:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:49:24.058 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:49:22.698025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404224,"kb_used_data":6976,"kb_used_omap":0,"kb_used_meta":2397184,"kb_avail":752570496,"statfs":{"total":773094113280,"available":770632187904,"internally_reserved":0,"allocated":7143424,"data_stored":3484816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2454716416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27605,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.541885"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690957+0000","last_change":"2023-08-17T17:49:19.690957+0000","last_active":"2023-08-17T17:49:19.690957+0000","last_peered":"2023-08-17T17:49:19.690957+0000","last_clean":"2023-08-17T17:49:19.690957+0000","last_became_active":"2023-08-17T17:49:19.690636+0000","last_became_peered":"2023-08-17T17:49:19.690636+0000","last_unstale":"2023-08-17T17:49:19.690957+0000","last_undegraded":"2023-08-17T17:49:19.690957+0000","last_fullsized":"2023-08-17T17:49:19.690957+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"76'3","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681840+0000","last_change":"2023-08-17T17:49:19.322111+0000","last_active":"2023-08-17T17:49:19.681840+0000","last_peered":"2023-08-17T17:49:19.681840+0000","last_clean":"2023-08-17T17:49:19.681840+0000","last_became_active":"2023-08-17T17:49:19.321778+0000","last_became_peered":"2023-08-17T17:49:19.321778+0000","last_unstale":"2023-08-17T17:49:19.681840+0000","last_undegraded":"2023-08-17T17:49:19.681840+0000","last_fullsized":"2023-08-17T17:49:19.681840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699590+0000","last_change":"2023-08-17T17:49:19.699664+0000","last_active":"2023-08-17T17:49:19.699590+0000","last_peered":"2023-08-17T17:49:19.699590+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699416+0000","last_became_peered":"2023-08-17T17:49:19.699416+0000","last_unstale":"2023-08-17T17:49:19.699590+0000","last_undegraded":"2023-08-17T17:49:19.699590+0000","last_fullsized":"2023-08-17T17:49:19.699590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.333353+0000","last_change":"2023-08-17T17:49:19.322333+0000","last_active":"2023-08-17T17:49:19.333353+0000","last_peered":"2023-08-17T17:49:19.333353+0000","last_clean":"2023-08-17T17:49:19.333353+0000","last_became_active":"2023-08-17T17:49:19.322077+0000","last_became_peered":"2023-08-17T17:49:19.322077+0000","last_unstale":"2023-08-17T17:49:19.333353+0000","last_undegraded":"2023-08-17T17:49:19.333353+0000","last_fullsized":"2023-08-17T17:49:19.333353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691445+0000","last_change":"2023-08-17T17:49:19.691522+0000","last_active":"2023-08-17T17:49:19.691445+0000","last_peered":"2023-08-17T17:49:19.691445+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691238+0000","last_became_peered":"2023-08-17T17:49:19.691238+0000","last_unstale":"2023-08-17T17:49:19.691445+0000","last_undegraded":"2023-08-17T17:49:19.691445+0000","last_fullsized":"2023-08-17T17:49:19.691445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337355+0000","last_change":"2023-08-17T17:49:19.333619+0000","last_active":"2023-08-17T17:49:19.337355+0000","last_peered":"2023-08-17T17:49:19.337355+0000","last_clean":"2023-08-17T17:49:19.337355+0000","last_became_active":"2023-08-17T17:49:19.333272+0000","last_became_peered":"2023-08-17T17:49:19.333272+0000","last_unstale":"2023-08-17T17:49:19.337355+0000","last_undegraded":"2023-08-17T17:49:19.337355+0000","last_fullsized":"2023-08-17T17:49:19.337355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694661+0000","last_change":"2023-08-17T17:49:19.694730+0000","last_active":"2023-08-17T17:49:19.694661+0000","last_peered":"2023-08-17T17:49:19.694661+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694310+0000","last_became_peered":"2023-08-17T17:49:19.694310+0000","last_unstale":"2023-08-17T17:49:19.694661+0000","last_undegraded":"2023-08-17T17:49:19.694661+0000","last_fullsized":"2023-08-17T17:49:19.694661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.331394+0000","last_change":"2023-08-17T17:49:19.325701+0000","last_active":"2023-08-17T17:49:19.331394+0000","last_peered":"2023-08-17T17:49:19.331394+0000","last_clean":"2023-08-17T17:49:19.331394+0000","last_became_active":"2023-08-17T17:49:19.325396+0000","last_became_peered":"2023-08-17T17:49:19.325396+0000","last_unstale":"2023-08-17T17:49:19.331394+0000","last_undegraded":"2023-08-17T17:49:19.331394+0000","last_fullsized":"2023-08-17T17:49:19.331394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.679803+0000","last_change":"2023-08-17T17:49:19.679944+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.679803+0000","last_undegraded":"2023-08-17T17:49:19.679803+0000","last_fullsized":"2023-08-17T17:49:19.679803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334625+0000","last_change":"2023-08-17T17:49:19.327117+0000","last_active":"2023-08-17T17:49:19.334625+0000","last_peered":"2023-08-17T17:49:19.334625+0000","last_clean":"2023-08-17T17:49:19.334625+0000","last_became_active":"2023-08-17T17:49:19.326840+0000","last_became_peered":"2023-08-17T17:49:19.326840+0000","last_unstale":"2023-08-17T17:49:19.334625+0000","last_undegraded":"2023-08-17T17:49:19.334625+0000","last_fullsized":"2023-08-17T17:49:19.334625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681781+0000","last_change":"2023-08-17T17:49:19.681912+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681781+0000","last_undegraded":"2023-08-17T17:49:19.681781+0000","last_fullsized":"2023-08-17T17:49:19.681781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324960+0000","last_change":"2023-08-17T17:49:19.319123+0000","last_active":"2023-08-17T17:49:19.324960+0000","last_peered":"2023-08-17T17:49:19.324960+0000","last_clean":"2023-08-17T17:49:19.324960+0000","last_became_active":"2023-08-17T17:49:19.318595+0000","last_became_peered":"2023-08-17T17:49:19.318595+0000","last_unstale":"2023-08-17T17:49:19.324960+0000","last_undegraded":"2023-08-17T17:49:19.324960+0000","last_fullsized":"2023-08-17T17:49:19.324960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687049+0000","last_change":"2023-08-17T17:49:19.687171+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687049+0000","last_undegraded":"2023-08-17T17:49:19.687049+0000","last_fullsized":"2023-08-17T17:49:19.687049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332903+0000","last_change":"2023-08-17T17:49:19.329857+0000","last_active":"2023-08-17T17:49:19.332903+0000","last_peered":"2023-08-17T17:49:19.332903+0000","last_clean":"2023-08-17T17:49:19.332903+0000","last_became_active":"2023-08-17T17:49:19.329112+0000","last_became_peered":"2023-08-17T17:49:19.329112+0000","last_unstale":"2023-08-17T17:49:19.332903+0000","last_undegraded":"2023-08-17T17:49:19.332903+0000","last_fullsized":"2023-08-17T17:49:19.332903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.688432+0000","last_change":"2023-08-17T17:49:19.688432+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.688432+0000","last_undegraded":"2023-08-17T17:49:19.688432+0000","last_fullsized":"2023-08-17T17:49:19.688432+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332256+0000","last_change":"2023-08-17T17:49:19.324543+0000","last_active":"2023-08-17T17:49:19.332256+0000","last_peered":"2023-08-17T17:49:19.332256+0000","last_clean":"2023-08-17T17:49:19.332256+0000","last_became_active":"2023-08-17T17:49:19.324266+0000","last_became_peered":"2023-08-17T17:49:19.324266+0000","last_unstale":"2023-08-17T17:49:19.332256+0000","last_undegraded":"2023-08-17T17:49:19.332256+0000","last_fullsized":"2023-08-17T17:49:19.332256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.679097+0000","last_change":"2023-08-17T17:49:19.679235+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.679097+0000","last_undegraded":"2023-08-17T17:49:19.679097+0000","last_fullsized":"2023-08-17T17:49:19.679097+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327444+0000","last_change":"2023-08-17T17:49:19.325582+0000","last_active":"2023-08-17T17:49:19.327444+0000","last_peered":"2023-08-17T17:49:19.327444+0000","last_clean":"2023-08-17T17:49:19.327444+0000","last_became_active":"2023-08-17T17:49:19.325292+0000","last_became_peered":"2023-08-17T17:49:19.325292+0000","last_unstale":"2023-08-17T17:49:19.327444+0000","last_undegraded":"2023-08-17T17:49:19.327444+0000","last_fullsized":"2023-08-17T17:49:19.327444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697554+0000","last_change":"2023-08-17T17:49:19.697630+0000","last_active":"2023-08-17T17:49:19.697554+0000","last_peered":"2023-08-17T17:49:19.697554+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.697302+0000","last_became_peered":"2023-08-17T17:49:19.697302+0000","last_unstale":"2023-08-17T17:49:19.697554+0000","last_undegraded":"2023-08-17T17:49:19.697554+0000","last_fullsized":"2023-08-17T17:49:19.697554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335268+0000","last_change":"2023-08-17T17:49:19.327360+0000","last_active":"2023-08-17T17:49:19.335268+0000","last_peered":"2023-08-17T17:49:19.335268+0000","last_clean":"2023-08-17T17:49:19.335268+0000","last_became_active":"2023-08-17T17:49:19.327081+0000","last_became_peered":"2023-08-17T17:49:19.327081+0000","last_unstale":"2023-08-17T17:49:19.335268+0000","last_undegraded":"2023-08-17T17:49:19.335268+0000","last_fullsized":"2023-08-17T17:49:19.335268+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700423+0000","last_change":"2023-08-17T17:49:19.700495+0000","last_active":"2023-08-17T17:49:19.700423+0000","last_peered":"2023-08-17T17:49:19.700423+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700216+0000","last_became_peered":"2023-08-17T17:49:19.700216+0000","last_unstale":"2023-08-17T17:49:19.700423+0000","last_undegraded":"2023-08-17T17:49:19.700423+0000","last_fullsized":"2023-08-17T17:49:19.700423+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332221+0000","last_change":"2023-08-17T17:49:19.323045+0000","last_active":"2023-08-17T17:49:19.332221+0000","last_peered":"2023-08-17T17:49:19.332221+0000","last_clean":"2023-08-17T17:49:19.332221+0000","last_became_active":"2023-08-17T17:49:19.322755+0000","last_became_peered":"2023-08-17T17:49:19.322755+0000","last_unstale":"2023-08-17T17:49:19.332221+0000","last_undegraded":"2023-08-17T17:49:19.332221+0000","last_fullsized":"2023-08-17T17:49:19.332221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.690552+0000","last_change":"2023-08-17T17:49:19.692027+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.690552+0000","last_undegraded":"2023-08-17T17:49:19.690552+0000","last_fullsized":"2023-08-17T17:49:19.690552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334796+0000","last_change":"2023-08-17T17:49:19.330926+0000","last_active":"2023-08-17T17:49:19.334796+0000","last_peered":"2023-08-17T17:49:19.334796+0000","last_clean":"2023-08-17T17:49:19.334796+0000","last_became_active":"2023-08-17T17:49:19.330379+0000","last_became_peered":"2023-08-17T17:49:19.330379+0000","last_unstale":"2023-08-17T17:49:19.334796+0000","last_undegraded":"2023-08-17T17:49:19.334796+0000","last_fullsized":"2023-08-17T17:49:19.334796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681409+0000","last_change":"2023-08-17T17:49:19.681509+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681409+0000","last_undegraded":"2023-08-17T17:49:19.681409+0000","last_fullsized":"2023-08-17T17:49:19.681409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.336938+0000","last_change":"2023-08-17T17:49:19.331576+0000","last_active":"2023-08-17T17:49:19.336938+0000","last_peered":"2023-08-17T17:49:19.336938+0000","last_clean":"2023-08-17T17:49:19.336938+0000","last_became_active":"2023-08-17T17:49:19.331285+0000","last_became_peered":"2023-08-17T17:49:19.331285+0000","last_unstale":"2023-08-17T17:49:19.336938+0000","last_undegraded":"2023-08-17T17:49:19.336938+0000","last_fullsized":"2023-08-17T17:49:19.336938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.701110+0000","last_change":"2023-08-17T17:49:19.701187+0000","last_active":"2023-08-17T17:49:19.701110+0000","last_peered":"2023-08-17T17:49:19.701110+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700922+0000","last_became_peered":"2023-08-17T17:49:19.700922+0000","last_unstale":"2023-08-17T17:49:19.701110+0000","last_undegraded":"2023-08-17T17:49:19.701110+0000","last_fullsized":"2023-08-17T17:49:19.701110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325494+0000","last_change":"2023-08-17T17:49:19.323917+0000","last_active":"2023-08-17T17:49:19.325494+0000","last_peered":"2023-08-17T17:49:19.325494+0000","last_clean":"2023-08-17T17:49:19.325494+0000","last_became_active":"2023-08-17T17:49:19.323538+0000","last_became_peered":"2023-08-17T17:49:19.323538+0000","last_unstale":"2023-08-17T17:49:19.325494+0000","last_undegraded":"2023-08-17T17:49:19.325494+0000","last_fullsized":"2023-08-17T17:49:19.325494+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696884+0000","last_change":"2023-08-17T17:49:19.696962+0000","last_active":"2023-08-17T17:49:19.696884+0000","last_peered":"2023-08-17T17:49:19.696884+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696322+0000","last_became_peered":"2023-08-17T17:49:19.696322+0000","last_unstale":"2023-08-17T17:49:19.696884+0000","last_undegraded":"2023-08-17T17:49:19.696884+0000","last_fullsized":"2023-08-17T17:49:19.696884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332883+0000","last_change":"2023-08-17T17:49:19.329416+0000","last_active":"2023-08-17T17:49:19.332883+0000","last_peered":"2023-08-17T17:49:19.332883+0000","last_clean":"2023-08-17T17:49:19.332883+0000","last_became_active":"2023-08-17T17:49:19.328707+0000","last_became_peered":"2023-08-17T17:49:19.328707+0000","last_unstale":"2023-08-17T17:49:19.332883+0000","last_undegraded":"2023-08-17T17:49:19.332883+0000","last_fullsized":"2023-08-17T17:49:19.332883+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694435+0000","last_change":"2023-08-17T17:49:19.694511+0000","last_active":"2023-08-17T17:49:19.694435+0000","last_peered":"2023-08-17T17:49:19.694435+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694182+0000","last_became_peered":"2023-08-17T17:49:19.694182+0000","last_unstale":"2023-08-17T17:49:19.694435+0000","last_undegraded":"2023-08-17T17:49:19.694435+0000","last_fullsized":"2023-08-17T17:49:19.694435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334887+0000","last_change":"2023-08-17T17:49:19.327993+0000","last_active":"2023-08-17T17:49:19.334887+0000","last_peered":"2023-08-17T17:49:19.334887+0000","last_clean":"2023-08-17T17:49:19.334887+0000","last_became_active":"2023-08-17T17:49:19.327700+0000","last_became_peered":"2023-08-17T17:49:19.327700+0000","last_unstale":"2023-08-17T17:49:19.334887+0000","last_undegraded":"2023-08-17T17:49:19.334887+0000","last_fullsized":"2023-08-17T17:49:19.334887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.682674+0000","last_change":"2023-08-17T17:49:19.682807+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.682674+0000","last_undegraded":"2023-08-17T17:49:19.682674+0000","last_fullsized":"2023-08-17T17:49:19.682674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335255+0000","last_change":"2023-08-17T17:49:19.328079+0000","last_active":"2023-08-17T17:49:19.335255+0000","last_peered":"2023-08-17T17:49:19.335255+0000","last_clean":"2023-08-17T17:49:19.335255+0000","last_became_active":"2023-08-17T17:49:19.327794+0000","last_became_peered":"2023-08-17T17:49:19.327794+0000","last_unstale":"2023-08-17T17:49:19.335255+0000","last_undegraded":"2023-08-17T17:49:19.335255+0000","last_fullsized":"2023-08-17T17:49:19.335255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694699+0000","last_change":"2023-08-17T17:49:19.694776+0000","last_active":"2023-08-17T17:49:19.694699+0000","last_peered":"2023-08-17T17:49:19.694699+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694363+0000","last_became_peered":"2023-08-17T17:49:19.694363+0000","last_unstale":"2023-08-17T17:49:19.694699+0000","last_undegraded":"2023-08-17T17:49:19.694699+0000","last_fullsized":"2023-08-17T17:49:19.694699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337851+0000","last_change":"2023-08-17T17:49:19.335785+0000","last_active":"2023-08-17T17:49:19.337851+0000","last_peered":"2023-08-17T17:49:19.337851+0000","last_clean":"2023-08-17T17:49:19.337851+0000","last_became_active":"2023-08-17T17:49:19.335488+0000","last_became_peered":"2023-08-17T17:49:19.335488+0000","last_unstale":"2023-08-17T17:49:19.337851+0000","last_undegraded":"2023-08-17T17:49:19.337851+0000","last_fullsized":"2023-08-17T17:49:19.337851+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693865+0000","last_change":"2023-08-17T17:49:19.693865+0000","last_active":"2023-08-17T17:49:19.693865+0000","last_peered":"2023-08-17T17:49:19.693865+0000","last_clean":"2023-08-17T17:49:19.693865+0000","last_became_active":"2023-08-17T17:49:19.692912+0000","last_became_peered":"2023-08-17T17:49:19.692912+0000","last_unstale":"2023-08-17T17:49:19.693865+0000","last_undegraded":"2023-08-17T17:49:19.693865+0000","last_fullsized":"2023-08-17T17:49:19.693865+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327087+0000","last_change":"2023-08-17T17:49:19.322192+0000","last_active":"2023-08-17T17:49:19.327087+0000","last_peered":"2023-08-17T17:49:19.327087+0000","last_clean":"2023-08-17T17:49:19.327087+0000","last_became_active":"2023-08-17T17:49:19.321913+0000","last_became_peered":"2023-08-17T17:49:19.321913+0000","last_unstale":"2023-08-17T17:49:19.327087+0000","last_undegraded":"2023-08-17T17:49:19.327087+0000","last_fullsized":"2023-08-17T17:49:19.327087+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694493+0000","last_change":"2023-08-17T17:49:19.694568+0000","last_active":"2023-08-17T17:49:19.694493+0000","last_peered":"2023-08-17T17:49:19.694493+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693972+0000","last_became_peered":"2023-08-17T17:49:19.693972+0000","last_unstale":"2023-08-17T17:49:19.694493+0000","last_undegraded":"2023-08-17T17:49:19.694493+0000","last_fullsized":"2023-08-17T17:49:19.694493+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335091+0000","last_change":"2023-08-17T17:49:19.326035+0000","last_active":"2023-08-17T17:49:19.335091+0000","last_peered":"2023-08-17T17:49:19.335091+0000","last_clean":"2023-08-17T17:49:19.335091+0000","last_became_active":"2023-08-17T17:49:19.325780+0000","last_became_peered":"2023-08-17T17:49:19.325780+0000","last_unstale":"2023-08-17T17:49:19.335091+0000","last_undegraded":"2023-08-17T17:49:19.335091+0000","last_fullsized":"2023-08-17T17:49:19.335091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696688+0000","last_change":"2023-08-17T17:49:19.696765+0000","last_active":"2023-08-17T17:49:19.696688+0000","last_peered":"2023-08-17T17:49:19.696688+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696474+0000","last_became_peered":"2023-08-17T17:49:19.696474+0000","last_unstale":"2023-08-17T17:49:19.696688+0000","last_undegraded":"2023-08-17T17:49:19.696688+0000","last_fullsized":"2023-08-17T17:49:19.696688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337370+0000","last_change":"2023-08-17T17:49:19.333623+0000","last_active":"2023-08-17T17:49:19.337370+0000","last_peered":"2023-08-17T17:49:19.337370+0000","last_clean":"2023-08-17T17:49:19.337370+0000","last_became_active":"2023-08-17T17:49:19.333170+0000","last_became_peered":"2023-08-17T17:49:19.333170+0000","last_unstale":"2023-08-17T17:49:19.337370+0000","last_undegraded":"2023-08-17T17:49:19.337370+0000","last_fullsized":"2023-08-17T17:49:19.337370+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.682255+0000","last_change":"2023-08-17T17:49:19.682401+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.682255+0000","last_undegraded":"2023-08-17T17:49:19.682255+0000","last_fullsized":"2023-08-17T17:49:19.682255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332291+0000","last_change":"2023-08-17T17:49:19.321366+0000","last_active":"2023-08-17T17:49:19.332291+0000","last_peered":"2023-08-17T17:49:19.332291+0000","last_clean":"2023-08-17T17:49:19.332291+0000","last_became_active":"2023-08-17T17:49:19.321072+0000","last_became_peered":"2023-08-17T17:49:19.321072+0000","last_unstale":"2023-08-17T17:49:19.332291+0000","last_undegraded":"2023-08-17T17:49:19.332291+0000","last_fullsized":"2023-08-17T17:49:19.332291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.683524+0000","last_change":"2023-08-17T17:49:19.683665+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.683524+0000","last_undegraded":"2023-08-17T17:49:19.683524+0000","last_fullsized":"2023-08-17T17:49:19.683524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337954+0000","last_change":"2023-08-17T17:49:19.336558+0000","last_active":"2023-08-17T17:49:19.337954+0000","last_peered":"2023-08-17T17:49:19.337954+0000","last_clean":"2023-08-17T17:49:19.337954+0000","last_became_active":"2023-08-17T17:49:19.336291+0000","last_became_peered":"2023-08-17T17:49:19.336291+0000","last_unstale":"2023-08-17T17:49:19.337954+0000","last_undegraded":"2023-08-17T17:49:19.337954+0000","last_fullsized":"2023-08-17T17:49:19.337954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.687375+0000","last_change":"2023-08-17T17:49:19.687375+0000","last_active":"2023-08-17T17:49:19.687375+0000","last_peered":"2023-08-17T17:49:19.687375+0000","last_clean":"2023-08-17T17:49:19.687375+0000","last_became_active":"2023-08-17T17:49:19.687084+0000","last_became_peered":"2023-08-17T17:49:19.687084+0000","last_unstale":"2023-08-17T17:49:19.687375+0000","last_undegraded":"2023-08-17T17:49:19.687375+0000","last_fullsized":"2023-08-17T17:49:19.687375+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337102+0000","last_change":"2023-08-17T17:49:19.335235+0000","last_active":"2023-08-17T17:49:19.337102+0000","last_peered":"2023-08-17T17:49:19.337102+0000","last_clean":"2023-08-17T17:49:19.337102+0000","last_became_active":"2023-08-17T17:49:19.334926+0000","last_became_peered":"2023-08-17T17:49:19.334926+0000","last_unstale":"2023-08-17T17:49:19.337102+0000","last_undegraded":"2023-08-17T17:49:19.337102+0000","last_fullsized":"2023-08-17T17:49:19.337102+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.677752+0000","last_change":"2023-08-17T17:49:19.677862+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.677752+0000","last_undegraded":"2023-08-17T17:49:19.677752+0000","last_fullsized":"2023-08-17T17:49:19.677752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324850+0000","last_change":"2023-08-17T17:49:19.320286+0000","last_active":"2023-08-17T17:49:19.324850+0000","last_peered":"2023-08-17T17:49:19.324850+0000","last_clean":"2023-08-17T17:49:19.324850+0000","last_became_active":"2023-08-17T17:49:19.320004+0000","last_became_peered":"2023-08-17T17:49:19.320004+0000","last_unstale":"2023-08-17T17:49:19.324850+0000","last_undegraded":"2023-08-17T17:49:19.324850+0000","last_fullsized":"2023-08-17T17:49:19.324850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696689+0000","last_change":"2023-08-17T17:49:19.696763+0000","last_active":"2023-08-17T17:49:19.696689+0000","last_peered":"2023-08-17T17:49:19.696689+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693241+0000","last_became_peered":"2023-08-17T17:49:19.693241+0000","last_unstale":"2023-08-17T17:49:19.696689+0000","last_undegraded":"2023-08-17T17:49:19.696689+0000","last_fullsized":"2023-08-17T17:49:19.696689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329975+0000","last_change":"2023-08-17T17:49:19.325997+0000","last_active":"2023-08-17T17:49:19.329975+0000","last_peered":"2023-08-17T17:49:19.329975+0000","last_clean":"2023-08-17T17:49:19.329975+0000","last_became_active":"2023-08-17T17:49:19.325180+0000","last_became_peered":"2023-08-17T17:49:19.325180+0000","last_unstale":"2023-08-17T17:49:19.329975+0000","last_undegraded":"2023-08-17T17:49:19.329975+0000","last_fullsized":"2023-08-17T17:49:19.329975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693028+0000","last_change":"2023-08-17T17:49:19.693095+0000","last_active":"2023-08-17T17:49:19.693028+0000","last_peered":"2023-08-17T17:49:19.693028+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692720+0000","last_became_peered":"2023-08-17T17:49:19.692720+0000","last_unstale":"2023-08-17T17:49:19.693028+0000","last_undegraded":"2023-08-17T17:49:19.693028+0000","last_fullsized":"2023-08-17T17:49:19.693028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334824+0000","last_change":"2023-08-17T17:49:19.327881+0000","last_active":"2023-08-17T17:49:19.334824+0000","last_peered":"2023-08-17T17:49:19.334824+0000","last_clean":"2023-08-17T17:49:19.334824+0000","last_became_active":"2023-08-17T17:49:19.327652+0000","last_became_peered":"2023-08-17T17:49:19.327652+0000","last_unstale":"2023-08-17T17:49:19.334824+0000","last_undegraded":"2023-08-17T17:49:19.334824+0000","last_fullsized":"2023-08-17T17:49:19.334824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693000+0000","last_change":"2023-08-17T17:49:19.693081+0000","last_active":"2023-08-17T17:49:19.693000+0000","last_peered":"2023-08-17T17:49:19.693000+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692808+0000","last_became_peered":"2023-08-17T17:49:19.692808+0000","last_unstale":"2023-08-17T17:49:19.693000+0000","last_undegraded":"2023-08-17T17:49:19.693000+0000","last_fullsized":"2023-08-17T17:49:19.693000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334588+0000","last_change":"2023-08-17T17:49:19.326742+0000","last_active":"2023-08-17T17:49:19.334588+0000","last_peered":"2023-08-17T17:49:19.334588+0000","last_clean":"2023-08-17T17:49:19.334588+0000","last_became_active":"2023-08-17T17:49:19.326380+0000","last_became_peered":"2023-08-17T17:49:19.326380+0000","last_unstale":"2023-08-17T17:49:19.334588+0000","last_undegraded":"2023-08-17T17:49:19.334588+0000","last_fullsized":"2023-08-17T17:49:19.334588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692196+0000","last_change":"2023-08-17T17:49:19.692243+0000","last_active":"2023-08-17T17:49:19.692196+0000","last_peered":"2023-08-17T17:49:19.692196+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692016+0000","last_became_peered":"2023-08-17T17:49:19.692016+0000","last_unstale":"2023-08-17T17:49:19.692196+0000","last_undegraded":"2023-08-17T17:49:19.692196+0000","last_fullsized":"2023-08-17T17:49:19.692196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335381+0000","last_change":"2023-08-17T17:49:19.329807+0000","last_active":"2023-08-17T17:49:19.335381+0000","last_peered":"2023-08-17T17:49:19.335381+0000","last_clean":"2023-08-17T17:49:19.335381+0000","last_became_active":"2023-08-17T17:49:19.329559+0000","last_became_peered":"2023-08-17T17:49:19.329559+0000","last_unstale":"2023-08-17T17:49:19.335381+0000","last_undegraded":"2023-08-17T17:49:19.335381+0000","last_fullsized":"2023-08-17T17:49:19.335381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690145+0000","last_change":"2023-08-17T17:49:19.690145+0000","last_active":"2023-08-17T17:49:19.690145+0000","last_peered":"2023-08-17T17:49:19.690145+0000","last_clean":"2023-08-17T17:49:19.690145+0000","last_became_active":"2023-08-17T17:49:19.689032+0000","last_became_peered":"2023-08-17T17:49:19.689032+0000","last_unstale":"2023-08-17T17:49:19.690145+0000","last_undegraded":"2023-08-17T17:49:19.690145+0000","last_fullsized":"2023-08-17T17:49:19.690145+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337392+0000","last_change":"2023-08-17T17:49:19.333863+0000","last_active":"2023-08-17T17:49:19.337392+0000","last_peered":"2023-08-17T17:49:19.337392+0000","last_clean":"2023-08-17T17:49:19.337392+0000","last_became_active":"2023-08-17T17:49:19.333293+0000","last_became_peered":"2023-08-17T17:49:19.333293+0000","last_unstale":"2023-08-17T17:49:19.337392+0000","last_undegraded":"2023-08-17T17:49:19.337392+0000","last_fullsized":"2023-08-17T17:49:19.337392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694365+0000","last_change":"2023-08-17T17:49:19.694448+0000","last_active":"2023-08-17T17:49:19.694365+0000","last_peered":"2023-08-17T17:49:19.694365+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694151+0000","last_became_peered":"2023-08-17T17:49:19.694151+0000","last_unstale":"2023-08-17T17:49:19.694365+0000","last_undegraded":"2023-08-17T17:49:19.694365+0000","last_fullsized":"2023-08-17T17:49:19.694365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.324872+0000","last_change":"2023-08-17T17:49:19.320718+0000","last_active":"2023-08-17T17:49:19.324872+0000","last_peered":"2023-08-17T17:49:19.324872+0000","last_clean":"2023-08-17T17:49:19.324872+0000","last_became_active":"2023-08-17T17:49:19.320287+0000","last_became_peered":"2023-08-17T17:49:19.320287+0000","last_unstale":"2023-08-17T17:49:19.324872+0000","last_undegraded":"2023-08-17T17:49:19.324872+0000","last_fullsized":"2023-08-17T17:49:19.324872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.692331+0000","last_change":"2023-08-17T17:49:19.692457+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.692331+0000","last_undegraded":"2023-08-17T17:49:19.692331+0000","last_fullsized":"2023-08-17T17:49:19.692331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325398+0000","last_change":"2023-08-17T17:49:19.319827+0000","last_active":"2023-08-17T17:49:19.325398+0000","last_peered":"2023-08-17T17:49:19.325398+0000","last_clean":"2023-08-17T17:49:19.325398+0000","last_became_active":"2023-08-17T17:49:19.319566+0000","last_became_peered":"2023-08-17T17:49:19.319566+0000","last_unstale":"2023-08-17T17:49:19.325398+0000","last_undegraded":"2023-08-17T17:49:19.325398+0000","last_fullsized":"2023-08-17T17:49:19.325398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.686254+0000","last_change":"2023-08-17T17:49:19.686415+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.686254+0000","last_undegraded":"2023-08-17T17:49:19.686254+0000","last_fullsized":"2023-08-17T17:49:19.686254+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"76'1","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.677637+0000","last_change":"2023-08-17T17:49:19.323093+0000","last_active":"2023-08-17T17:49:19.677637+0000","last_peered":"2023-08-17T17:49:19.677637+0000","last_clean":"2023-08-17T17:49:19.677637+0000","last_became_active":"2023-08-17T17:49:19.322816+0000","last_became_peered":"2023-08-17T17:49:19.322816+0000","last_unstale":"2023-08-17T17:49:19.677637+0000","last_undegraded":"2023-08-17T17:49:19.677637+0000","last_fullsized":"2023-08-17T17:49:19.677637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696502+0000","last_change":"2023-08-17T17:49:19.696576+0000","last_active":"2023-08-17T17:49:19.696502+0000","last_peered":"2023-08-17T17:49:19.696502+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.696279+0000","last_became_peered":"2023-08-17T17:49:19.696279+0000","last_unstale":"2023-08-17T17:49:19.696502+0000","last_undegraded":"2023-08-17T17:49:19.696502+0000","last_fullsized":"2023-08-17T17:49:19.696502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335223+0000","last_change":"2023-08-17T17:49:19.330805+0000","last_active":"2023-08-17T17:49:19.335223+0000","last_peered":"2023-08-17T17:49:19.335223+0000","last_clean":"2023-08-17T17:49:19.335223+0000","last_became_active":"2023-08-17T17:49:19.330398+0000","last_became_peered":"2023-08-17T17:49:19.330398+0000","last_unstale":"2023-08-17T17:49:19.335223+0000","last_undegraded":"2023-08-17T17:49:19.335223+0000","last_fullsized":"2023-08-17T17:49:19.335223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691533+0000","last_change":"2023-08-17T17:49:19.691581+0000","last_active":"2023-08-17T17:49:19.691533+0000","last_peered":"2023-08-17T17:49:19.691533+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691339+0000","last_became_peered":"2023-08-17T17:49:19.691339+0000","last_unstale":"2023-08-17T17:49:19.691533+0000","last_undegraded":"2023-08-17T17:49:19.691533+0000","last_fullsized":"2023-08-17T17:49:19.691533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334894+0000","last_change":"2023-08-17T17:49:19.329057+0000","last_active":"2023-08-17T17:49:19.334894+0000","last_peered":"2023-08-17T17:49:19.334894+0000","last_clean":"2023-08-17T17:49:19.334894+0000","last_became_active":"2023-08-17T17:49:19.328426+0000","last_became_peered":"2023-08-17T17:49:19.328426+0000","last_unstale":"2023-08-17T17:49:19.334894+0000","last_undegraded":"2023-08-17T17:49:19.334894+0000","last_fullsized":"2023-08-17T17:49:19.334894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699148+0000","last_change":"2023-08-17T17:49:19.699229+0000","last_active":"2023-08-17T17:49:19.699148+0000","last_peered":"2023-08-17T17:49:19.699148+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.698921+0000","last_became_peered":"2023-08-17T17:49:19.698921+0000","last_unstale":"2023-08-17T17:49:19.699148+0000","last_undegraded":"2023-08-17T17:49:19.699148+0000","last_fullsized":"2023-08-17T17:49:19.699148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329603+0000","last_change":"2023-08-17T17:49:19.322832+0000","last_active":"2023-08-17T17:49:19.329603+0000","last_peered":"2023-08-17T17:49:19.329603+0000","last_clean":"2023-08-17T17:49:19.329603+0000","last_became_active":"2023-08-17T17:49:19.322554+0000","last_became_peered":"2023-08-17T17:49:19.322554+0000","last_unstale":"2023-08-17T17:49:19.329603+0000","last_undegraded":"2023-08-17T17:49:19.329603+0000","last_fullsized":"2023-08-17T17:49:19.329603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684718+0000","last_change":"2023-08-17T17:49:19.684718+0000","last_active":"2023-08-17T17:49:19.684718+0000","last_peered":"2023-08-17T17:49:19.684718+0000","last_clean":"2023-08-17T17:49:19.684718+0000","last_became_active":"2023-08-17T17:49:19.684444+0000","last_became_peered":"2023-08-17T17:49:19.684444+0000","last_unstale":"2023-08-17T17:49:19.684718+0000","last_undegraded":"2023-08-17T17:49:19.684718+0000","last_fullsized":"2023-08-17T17:49:19.684718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335286+0000","last_change":"2023-08-17T17:49:19.326042+0000","last_active":"2023-08-17T17:49:19.335286+0000","last_peered":"2023-08-17T17:49:19.335286+0000","last_clean":"2023-08-17T17:49:19.335286+0000","last_became_active":"2023-08-17T17:49:19.325675+0000","last_became_peered":"2023-08-17T17:49:19.325675+0000","last_unstale":"2023-08-17T17:49:19.335286+0000","last_undegraded":"2023-08-17T17:49:19.335286+0000","last_fullsized":"2023-08-17T17:49:19.335286+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691069+0000","last_change":"2023-08-17T17:49:19.691116+0000","last_active":"2023-08-17T17:49:19.691069+0000","last_peered":"2023-08-17T17:49:19.691069+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.690769+0000","last_became_peered":"2023-08-17T17:49:19.690769+0000","last_unstale":"2023-08-17T17:49:19.691069+0000","last_undegraded":"2023-08-17T17:49:19.691069+0000","last_fullsized":"2023-08-17T17:49:19.691069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.325499+0000","last_change":"2023-08-17T17:49:19.319420+0000","last_active":"2023-08-17T17:49:19.325499+0000","last_peered":"2023-08-17T17:49:19.325499+0000","last_clean":"2023-08-17T17:49:19.325499+0000","last_became_active":"2023-08-17T17:49:19.319142+0000","last_became_peered":"2023-08-17T17:49:19.319142+0000","last_unstale":"2023-08-17T17:49:19.325499+0000","last_undegraded":"2023-08-17T17:49:19.325499+0000","last_fullsized":"2023-08-17T17:49:19.325499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687002+0000","last_change":"2023-08-17T17:49:19.687002+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687002+0000","last_undegraded":"2023-08-17T17:49:19.687002+0000","last_fullsized":"2023-08-17T17:49:19.687002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335208+0000","last_change":"2023-08-17T17:49:19.326823+0000","last_active":"2023-08-17T17:49:19.335208+0000","last_peered":"2023-08-17T17:49:19.335208+0000","last_clean":"2023-08-17T17:49:19.335208+0000","last_became_active":"2023-08-17T17:49:19.326542+0000","last_became_peered":"2023-08-17T17:49:19.326542+0000","last_unstale":"2023-08-17T17:49:19.335208+0000","last_undegraded":"2023-08-17T17:49:19.335208+0000","last_fullsized":"2023-08-17T17:49:19.335208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694743+0000","last_change":"2023-08-17T17:49:19.694817+0000","last_active":"2023-08-17T17:49:19.694743+0000","last_peered":"2023-08-17T17:49:19.694743+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694557+0000","last_became_peered":"2023-08-17T17:49:19.694557+0000","last_unstale":"2023-08-17T17:49:19.694743+0000","last_undegraded":"2023-08-17T17:49:19.694743+0000","last_fullsized":"2023-08-17T17:49:19.694743+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337082+0000","last_change":"2023-08-17T17:49:19.334413+0000","last_active":"2023-08-17T17:49:19.337082+0000","last_peered":"2023-08-17T17:49:19.337082+0000","last_clean":"2023-08-17T17:49:19.337082+0000","last_became_active":"2023-08-17T17:49:19.334147+0000","last_became_peered":"2023-08-17T17:49:19.334147+0000","last_unstale":"2023-08-17T17:49:19.337082+0000","last_undegraded":"2023-08-17T17:49:19.337082+0000","last_fullsized":"2023-08-17T17:49:19.337082+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.686438+0000","last_change":"2023-08-17T17:49:19.686510+0000","last_active":"2023-08-17T17:49:19.686438+0000","last_peered":"2023-08-17T17:49:19.686438+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.686240+0000","last_became_peered":"2023-08-17T17:49:19.686240+0000","last_unstale":"2023-08-17T17:49:19.686438+0000","last_undegraded":"2023-08-17T17:49:19.686438+0000","last_fullsized":"2023-08-17T17:49:19.686438+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.340012+0000","last_change":"2023-08-17T17:49:19.338168+0000","last_active":"2023-08-17T17:49:19.340012+0000","last_peered":"2023-08-17T17:49:19.340012+0000","last_clean":"2023-08-17T17:49:19.340012+0000","last_became_active":"2023-08-17T17:49:19.337884+0000","last_became_peered":"2023-08-17T17:49:19.337884+0000","last_unstale":"2023-08-17T17:49:19.340012+0000","last_undegraded":"2023-08-17T17:49:19.340012+0000","last_fullsized":"2023-08-17T17:49:19.340012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693666+0000","last_change":"2023-08-17T17:49:19.693724+0000","last_active":"2023-08-17T17:49:19.693666+0000","last_peered":"2023-08-17T17:49:19.693666+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693492+0000","last_became_peered":"2023-08-17T17:49:19.693492+0000","last_unstale":"2023-08-17T17:49:19.693666+0000","last_undegraded":"2023-08-17T17:49:19.693666+0000","last_fullsized":"2023-08-17T17:49:19.693666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332828+0000","last_change":"2023-08-17T17:49:19.329035+0000","last_active":"2023-08-17T17:49:19.332828+0000","last_peered":"2023-08-17T17:49:19.332828+0000","last_clean":"2023-08-17T17:49:19.332828+0000","last_became_active":"2023-08-17T17:49:19.328686+0000","last_became_peered":"2023-08-17T17:49:19.328686+0000","last_unstale":"2023-08-17T17:49:19.332828+0000","last_undegraded":"2023-08-17T17:49:19.332828+0000","last_fullsized":"2023-08-17T17:49:19.332828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700291+0000","last_change":"2023-08-17T17:49:19.700364+0000","last_active":"2023-08-17T17:49:19.700291+0000","last_peered":"2023-08-17T17:49:19.700291+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699817+0000","last_became_peered":"2023-08-17T17:49:19.699817+0000","last_unstale":"2023-08-17T17:49:19.700291+0000","last_undegraded":"2023-08-17T17:49:19.700291+0000","last_fullsized":"2023-08-17T17:49:19.700291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337936+0000","last_change":"2023-08-17T17:49:19.336413+0000","last_active":"2023-08-17T17:49:19.337936+0000","last_peered":"2023-08-17T17:49:19.337936+0000","last_clean":"2023-08-17T17:49:19.337936+0000","last_became_active":"2023-08-17T17:49:19.335592+0000","last_became_peered":"2023-08-17T17:49:19.335592+0000","last_unstale":"2023-08-17T17:49:19.337936+0000","last_undegraded":"2023-08-17T17:49:19.337936+0000","last_fullsized":"2023-08-17T17:49:19.337936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693521+0000","last_change":"2023-08-17T17:49:19.693521+0000","last_active":"2023-08-17T17:49:19.693521+0000","last_peered":"2023-08-17T17:49:19.693521+0000","last_clean":"2023-08-17T17:49:19.693521+0000","last_became_active":"2023-08-17T17:49:19.692996+0000","last_became_peered":"2023-08-17T17:49:19.692996+0000","last_unstale":"2023-08-17T17:49:19.693521+0000","last_undegraded":"2023-08-17T17:49:19.693521+0000","last_fullsized":"2023-08-17T17:49:19.693521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332394+0000","last_change":"2023-08-17T17:49:19.324642+0000","last_active":"2023-08-17T17:49:19.332394+0000","last_peered":"2023-08-17T17:49:19.332394+0000","last_clean":"2023-08-17T17:49:19.332394+0000","last_became_active":"2023-08-17T17:49:19.324327+0000","last_became_peered":"2023-08-17T17:49:19.324327+0000","last_unstale":"2023-08-17T17:49:19.332394+0000","last_undegraded":"2023-08-17T17:49:19.332394+0000","last_fullsized":"2023-08-17T17:49:19.332394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681553+0000","last_change":"2023-08-17T17:49:19.681690+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681553+0000","last_undegraded":"2023-08-17T17:49:19.681553+0000","last_fullsized":"2023-08-17T17:49:19.681553+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335183+0000","last_change":"2023-08-17T17:49:19.332436+0000","last_active":"2023-08-17T17:49:19.335183+0000","last_peered":"2023-08-17T17:49:19.335183+0000","last_clean":"2023-08-17T17:49:19.335183+0000","last_became_active":"2023-08-17T17:49:19.332146+0000","last_became_peered":"2023-08-17T17:49:19.332146+0000","last_unstale":"2023-08-17T17:49:19.335183+0000","last_undegraded":"2023-08-17T17:49:19.335183+0000","last_fullsized":"2023-08-17T17:49:19.335183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691921+0000","last_change":"2023-08-17T17:49:19.691991+0000","last_active":"2023-08-17T17:49:19.691921+0000","last_peered":"2023-08-17T17:49:19.691921+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691732+0000","last_became_peered":"2023-08-17T17:49:19.691732+0000","last_unstale":"2023-08-17T17:49:19.691921+0000","last_undegraded":"2023-08-17T17:49:19.691921+0000","last_fullsized":"2023-08-17T17:49:19.691921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329922+0000","last_change":"2023-08-17T17:49:19.325834+0000","last_active":"2023-08-17T17:49:19.329922+0000","last_peered":"2023-08-17T17:49:19.329922+0000","last_clean":"2023-08-17T17:49:19.329922+0000","last_became_active":"2023-08-17T17:49:19.325261+0000","last_became_peered":"2023-08-17T17:49:19.325261+0000","last_unstale":"2023-08-17T17:49:19.329922+0000","last_undegraded":"2023-08-17T17:49:19.329922+0000","last_fullsized":"2023-08-17T17:49:19.329922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700066+0000","last_change":"2023-08-17T17:49:19.700149+0000","last_active":"2023-08-17T17:49:19.700066+0000","last_peered":"2023-08-17T17:49:19.700066+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.699838+0000","last_became_peered":"2023-08-17T17:49:19.699838+0000","last_unstale":"2023-08-17T17:49:19.700066+0000","last_undegraded":"2023-08-17T17:49:19.700066+0000","last_fullsized":"2023-08-17T17:49:19.700066+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337932+0000","last_change":"2023-08-17T17:49:19.336190+0000","last_active":"2023-08-17T17:49:19.337932+0000","last_peered":"2023-08-17T17:49:19.337932+0000","last_clean":"2023-08-17T17:49:19.337932+0000","last_became_active":"2023-08-17T17:49:19.335782+0000","last_became_peered":"2023-08-17T17:49:19.335782+0000","last_unstale":"2023-08-17T17:49:19.337932+0000","last_undegraded":"2023-08-17T17:49:19.337932+0000","last_fullsized":"2023-08-17T17:49:19.337932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.677312+0000","last_change":"2023-08-17T17:49:19.677442+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.677312+0000","last_undegraded":"2023-08-17T17:49:19.677312+0000","last_fullsized":"2023-08-17T17:49:19.677312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332836+0000","last_change":"2023-08-17T17:49:19.329884+0000","last_active":"2023-08-17T17:49:19.332836+0000","last_peered":"2023-08-17T17:49:19.332836+0000","last_clean":"2023-08-17T17:49:19.332836+0000","last_became_active":"2023-08-17T17:49:19.329498+0000","last_became_peered":"2023-08-17T17:49:19.329498+0000","last_unstale":"2023-08-17T17:49:19.332836+0000","last_undegraded":"2023-08-17T17:49:19.332836+0000","last_fullsized":"2023-08-17T17:49:19.332836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.685087+0000","last_change":"2023-08-17T17:49:19.685259+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.685087+0000","last_undegraded":"2023-08-17T17:49:19.685087+0000","last_fullsized":"2023-08-17T17:49:19.685087+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335932+0000","last_change":"2023-08-17T17:49:19.334434+0000","last_active":"2023-08-17T17:49:19.335932+0000","last_peered":"2023-08-17T17:49:19.335932+0000","last_clean":"2023-08-17T17:49:19.335932+0000","last_became_active":"2023-08-17T17:49:19.334142+0000","last_became_peered":"2023-08-17T17:49:19.334142+0000","last_unstale":"2023-08-17T17:49:19.335932+0000","last_undegraded":"2023-08-17T17:49:19.335932+0000","last_fullsized":"2023-08-17T17:49:19.335932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.690960+0000","last_change":"2023-08-17T17:49:19.691035+0000","last_active":"2023-08-17T17:49:19.690960+0000","last_peered":"2023-08-17T17:49:19.690960+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.690605+0000","last_became_peered":"2023-08-17T17:49:19.690605+0000","last_unstale":"2023-08-17T17:49:19.690960+0000","last_undegraded":"2023-08-17T17:49:19.690960+0000","last_fullsized":"2023-08-17T17:49:19.690960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329994+0000","last_change":"2023-08-17T17:49:19.326698+0000","last_active":"2023-08-17T17:49:19.329994+0000","last_peered":"2023-08-17T17:49:19.329994+0000","last_clean":"2023-08-17T17:49:19.329994+0000","last_became_active":"2023-08-17T17:49:19.326167+0000","last_became_peered":"2023-08-17T17:49:19.326167+0000","last_unstale":"2023-08-17T17:49:19.329994+0000","last_undegraded":"2023-08-17T17:49:19.329994+0000","last_fullsized":"2023-08-17T17:49:19.329994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692619+0000","last_change":"2023-08-17T17:49:19.692710+0000","last_active":"2023-08-17T17:49:19.692619+0000","last_peered":"2023-08-17T17:49:19.692619+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692379+0000","last_became_peered":"2023-08-17T17:49:19.692379+0000","last_unstale":"2023-08-17T17:49:19.692619+0000","last_undegraded":"2023-08-17T17:49:19.692619+0000","last_fullsized":"2023-08-17T17:49:19.692619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334913+0000","last_change":"2023-08-17T17:49:19.329215+0000","last_active":"2023-08-17T17:49:19.334913+0000","last_peered":"2023-08-17T17:49:19.334913+0000","last_clean":"2023-08-17T17:49:19.334913+0000","last_became_active":"2023-08-17T17:49:19.328771+0000","last_became_peered":"2023-08-17T17:49:19.328771+0000","last_unstale":"2023-08-17T17:49:19.334913+0000","last_undegraded":"2023-08-17T17:49:19.334913+0000","last_fullsized":"2023-08-17T17:49:19.334913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694500+0000","last_change":"2023-08-17T17:49:19.694579+0000","last_active":"2023-08-17T17:49:19.694500+0000","last_peered":"2023-08-17T17:49:19.694500+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.694271+0000","last_became_peered":"2023-08-17T17:49:19.694271+0000","last_unstale":"2023-08-17T17:49:19.694500+0000","last_undegraded":"2023-08-17T17:49:19.694500+0000","last_fullsized":"2023-08-17T17:49:19.694500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332377+0000","last_change":"2023-08-17T17:49:19.324396+0000","last_active":"2023-08-17T17:49:19.332377+0000","last_peered":"2023-08-17T17:49:19.332377+0000","last_clean":"2023-08-17T17:49:19.332377+0000","last_became_active":"2023-08-17T17:49:19.324119+0000","last_became_peered":"2023-08-17T17:49:19.324119+0000","last_unstale":"2023-08-17T17:49:19.332377+0000","last_undegraded":"2023-08-17T17:49:19.332377+0000","last_fullsized":"2023-08-17T17:49:19.332377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695846+0000","last_change":"2023-08-17T17:49:19.695903+0000","last_active":"2023-08-17T17:49:19.695846+0000","last_peered":"2023-08-17T17:49:19.695846+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.695703+0000","last_became_peered":"2023-08-17T17:49:19.695703+0000","last_unstale":"2023-08-17T17:49:19.695846+0000","last_undegraded":"2023-08-17T17:49:19.695846+0000","last_fullsized":"2023-08-17T17:49:19.695846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337988+0000","last_change":"2023-08-17T17:49:19.336789+0000","last_active":"2023-08-17T17:49:19.337988+0000","last_peered":"2023-08-17T17:49:19.337988+0000","last_clean":"2023-08-17T17:49:19.337988+0000","last_became_active":"2023-08-17T17:49:19.335638+0000","last_became_peered":"2023-08-17T17:49:19.335638+0000","last_unstale":"2023-08-17T17:49:19.337988+0000","last_undegraded":"2023-08-17T17:49:19.337988+0000","last_fullsized":"2023-08-17T17:49:19.337988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.680809+0000","last_change":"2023-08-17T17:49:19.680952+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.680809+0000","last_undegraded":"2023-08-17T17:49:19.680809+0000","last_fullsized":"2023-08-17T17:49:19.680809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.332309+0000","last_change":"2023-08-17T17:49:19.323231+0000","last_active":"2023-08-17T17:49:19.332309+0000","last_peered":"2023-08-17T17:49:19.332309+0000","last_clean":"2023-08-17T17:49:19.332309+0000","last_became_active":"2023-08-17T17:49:19.322950+0000","last_became_peered":"2023-08-17T17:49:19.322950+0000","last_unstale":"2023-08-17T17:49:19.332309+0000","last_undegraded":"2023-08-17T17:49:19.332309+0000","last_fullsized":"2023-08-17T17:49:19.332309+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693927+0000","last_change":"2023-08-17T17:49:19.693994+0000","last_active":"2023-08-17T17:49:19.693927+0000","last_peered":"2023-08-17T17:49:19.693927+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.693700+0000","last_became_peered":"2023-08-17T17:49:19.693700+0000","last_unstale":"2023-08-17T17:49:19.693927+0000","last_undegraded":"2023-08-17T17:49:19.693927+0000","last_fullsized":"2023-08-17T17:49:19.693927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335184+0000","last_change":"2023-08-17T17:49:19.326736+0000","last_active":"2023-08-17T17:49:19.335184+0000","last_peered":"2023-08-17T17:49:19.335184+0000","last_clean":"2023-08-17T17:49:19.335184+0000","last_became_active":"2023-08-17T17:49:19.326484+0000","last_became_peered":"2023-08-17T17:49:19.326484+0000","last_unstale":"2023-08-17T17:49:19.335184+0000","last_undegraded":"2023-08-17T17:49:19.335184+0000","last_fullsized":"2023-08-17T17:49:19.335184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.681143+0000","last_change":"2023-08-17T17:49:19.681274+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.681143+0000","last_undegraded":"2023-08-17T17:49:19.681143+0000","last_fullsized":"2023-08-17T17:49:19.681143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335181+0000","last_change":"2023-08-17T17:49:19.327542+0000","last_active":"2023-08-17T17:49:19.335181+0000","last_peered":"2023-08-17T17:49:19.335181+0000","last_clean":"2023-08-17T17:49:19.335181+0000","last_became_active":"2023-08-17T17:49:19.327106+0000","last_became_peered":"2023-08-17T17:49:19.327106+0000","last_unstale":"2023-08-17T17:49:19.335181+0000","last_undegraded":"2023-08-17T17:49:19.335181+0000","last_fullsized":"2023-08-17T17:49:19.335181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.687462+0000","last_change":"2023-08-17T17:49:19.687617+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.687462+0000","last_undegraded":"2023-08-17T17:49:19.687462+0000","last_fullsized":"2023-08-17T17:49:19.687462+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329966+0000","last_change":"2023-08-17T17:49:19.326553+0000","last_active":"2023-08-17T17:49:19.329966+0000","last_peered":"2023-08-17T17:49:19.329966+0000","last_clean":"2023-08-17T17:49:19.329966+0000","last_became_active":"2023-08-17T17:49:19.326246+0000","last_became_peered":"2023-08-17T17:49:19.326246+0000","last_unstale":"2023-08-17T17:49:19.329966+0000","last_undegraded":"2023-08-17T17:49:19.329966+0000","last_fullsized":"2023-08-17T17:49:19.329966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.315081+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:49:19.315081+0000","last_peered":"2023-08-17T17:49:19.315081+0000","last_clean":"2023-08-17T17:49:19.315081+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:49:19.315081+0000","last_undegraded":"2023-08-17T17:49:19.315081+0000","last_fullsized":"2023-08-17T17:49:19.315081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691572+0000","last_change":"2023-08-17T17:49:19.691614+0000","last_active":"2023-08-17T17:49:19.691572+0000","last_peered":"2023-08-17T17:49:19.691572+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691423+0000","last_became_peered":"2023-08-17T17:49:19.691423+0000","last_unstale":"2023-08-17T17:49:19.691572+0000","last_undegraded":"2023-08-17T17:49:19.691572+0000","last_fullsized":"2023-08-17T17:49:19.691572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335200+0000","last_change":"2023-08-17T17:49:19.330639+0000","last_active":"2023-08-17T17:49:19.335200+0000","last_peered":"2023-08-17T17:49:19.335200+0000","last_clean":"2023-08-17T17:49:19.335200+0000","last_became_active":"2023-08-17T17:49:19.330350+0000","last_became_peered":"2023-08-17T17:49:19.330350+0000","last_unstale":"2023-08-17T17:49:19.335200+0000","last_undegraded":"2023-08-17T17:49:19.335200+0000","last_fullsized":"2023-08-17T17:49:19.335200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.312380+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:49:19.312380+0000","last_peered":"2023-08-17T17:49:19.312380+0000","last_clean":"2023-08-17T17:49:19.312380+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:49:19.312380+0000","last_undegraded":"2023-08-17T17:49:19.312380+0000","last_fullsized":"2023-08-17T17:49:19.312380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.686082+0000","last_change":"2023-08-17T17:49:19.686082+0000","last_active":"2023-08-17T17:49:19.686082+0000","last_peered":"2023-08-17T17:49:19.686082+0000","last_clean":"2023-08-17T17:49:19.686082+0000","last_became_active":"2023-08-17T17:49:19.685741+0000","last_became_peered":"2023-08-17T17:49:19.685741+0000","last_unstale":"2023-08-17T17:49:19.686082+0000","last_undegraded":"2023-08-17T17:49:19.686082+0000","last_fullsized":"2023-08-17T17:49:19.686082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.329945+0000","last_change":"2023-08-17T17:49:19.326004+0000","last_active":"2023-08-17T17:49:19.329945+0000","last_peered":"2023-08-17T17:49:19.329945+0000","last_clean":"2023-08-17T17:49:19.329945+0000","last_became_active":"2023-08-17T17:49:19.325565+0000","last_became_peered":"2023-08-17T17:49:19.325565+0000","last_unstale":"2023-08-17T17:49:19.329945+0000","last_undegraded":"2023-08-17T17:49:19.329945+0000","last_fullsized":"2023-08-17T17:49:19.329945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.307336+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:49:19.307336+0000","last_peered":"2023-08-17T17:49:19.307336+0000","last_clean":"2023-08-17T17:49:19.307336+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:49:19.307336+0000","last_undegraded":"2023-08-17T17:49:19.307336+0000","last_fullsized":"2023-08-17T17:49:19.307336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":3,"reported_epoch":76,"state":"creating+activating","last_fresh":"2023-08-17T17:49:19.686198+0000","last_change":"2023-08-17T17:49:19.686198+0000","last_active":"2023-08-17T17:49:19.301191+0000","last_peered":"2023-08-17T17:49:19.301191+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:19.686198+0000","last_undegraded":"2023-08-17T17:49:19.686198+0000","last_fullsized":"2023-08-17T17:49:19.686198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.331967+0000","last_change":"2023-08-17T17:49:19.323676+0000","last_active":"2023-08-17T17:49:19.331967+0000","last_peered":"2023-08-17T17:49:19.331967+0000","last_clean":"2023-08-17T17:49:19.331967+0000","last_became_active":"2023-08-17T17:49:19.323413+0000","last_became_peered":"2023-08-17T17:49:19.323413+0000","last_unstale":"2023-08-17T17:49:19.331967+0000","last_undegraded":"2023-08-17T17:49:19.331967+0000","last_fullsized":"2023-08-17T17:49:19.331967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.312588+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:49:19.312588+0000","last_peered":"2023-08-17T17:49:19.312588+0000","last_clean":"2023-08-17T17:49:19.312588+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:49:19.312588+0000","last_undegraded":"2023-08-17T17:49:19.312588+0000","last_fullsized":"2023-08-17T17:49:19.312588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327470+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:49:19.327470+0000","last_peered":"2023-08-17T17:49:19.327470+0000","last_clean":"2023-08-17T17:49:19.327470+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:49:19.327470+0000","last_undegraded":"2023-08-17T17:49:19.327470+0000","last_fullsized":"2023-08-17T17:49:19.327470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692415+0000","last_change":"2023-08-17T17:49:19.692902+0000","last_active":"2023-08-17T17:49:19.692415+0000","last_peered":"2023-08-17T17:49:19.692415+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.691771+0000","last_became_peered":"2023-08-17T17:49:19.691771+0000","last_unstale":"2023-08-17T17:49:19.692415+0000","last_undegraded":"2023-08-17T17:49:19.692415+0000","last_fullsized":"2023-08-17T17:49:19.692415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.334858+0000","last_change":"2023-08-17T17:49:19.327899+0000","last_active":"2023-08-17T17:49:19.334858+0000","last_peered":"2023-08-17T17:49:19.334858+0000","last_clean":"2023-08-17T17:49:19.334858+0000","last_became_active":"2023-08-17T17:49:19.327616+0000","last_became_peered":"2023-08-17T17:49:19.327616+0000","last_unstale":"2023-08-17T17:49:19.334858+0000","last_undegraded":"2023-08-17T17:49:19.334858+0000","last_fullsized":"2023-08-17T17:49:19.334858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.327562+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:49:19.327562+0000","last_peered":"2023-08-17T17:49:19.327562+0000","last_clean":"2023-08-17T17:49:19.327562+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:49:19.327562+0000","last_undegraded":"2023-08-17T17:49:19.327562+0000","last_fullsized":"2023-08-17T17:49:19.327562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":5,"reported_epoch":76,"state":"active","last_fresh":"2023-08-17T17:49:19.700158+0000","last_change":"2023-08-17T17:49:19.700158+0000","last_active":"2023-08-17T17:49:19.700158+0000","last_peered":"2023-08-17T17:49:19.700158+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.700158+0000","last_became_peered":"2023-08-17T17:49:19.700158+0000","last_unstale":"2023-08-17T17:49:19.700158+0000","last_undegraded":"2023-08-17T17:49:19.700158+0000","last_fullsized":"2023-08-17T17:49:19.700158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337871+0000","last_change":"2023-08-17T17:49:19.335888+0000","last_active":"2023-08-17T17:49:19.337871+0000","last_peered":"2023-08-17T17:49:19.337871+0000","last_clean":"2023-08-17T17:49:19.337871+0000","last_became_active":"2023-08-17T17:49:19.335473+0000","last_became_peered":"2023-08-17T17:49:19.335473+0000","last_unstale":"2023-08-17T17:49:19.337871+0000","last_undegraded":"2023-08-17T17:49:19.337871+0000","last_fullsized":"2023-08-17T17:49:19.337871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.326902+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:49:19.326902+0000","last_peered":"2023-08-17T17:49:19.326902+0000","last_clean":"2023-08-17T17:49:19.326902+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:49:19.326902+0000","last_undegraded":"2023-08-17T17:49:19.326902+0000","last_fullsized":"2023-08-17T17:49:19.326902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693028+0000","last_change":"2023-08-17T17:49:19.693028+0000","last_active":"2023-08-17T17:49:19.693028+0000","last_peered":"2023-08-17T17:49:19.693028+0000","last_clean":"2023-08-17T17:49:19.693028+0000","last_became_active":"2023-08-17T17:49:19.692600+0000","last_became_peered":"2023-08-17T17:49:19.692600+0000","last_unstale":"2023-08-17T17:49:19.693028+0000","last_undegraded":"2023-08-17T17:49:19.693028+0000","last_fullsized":"2023-08-17T17:49:19.693028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.337964+0000","last_change":"2023-08-17T17:49:19.336579+0000","last_active":"2023-08-17T17:49:19.337964+0000","last_peered":"2023-08-17T17:49:19.337964+0000","last_clean":"2023-08-17T17:49:19.337964+0000","last_became_active":"2023-08-17T17:49:19.336142+0000","last_became_peered":"2023-08-17T17:49:19.336142+0000","last_unstale":"2023-08-17T17:49:19.337964+0000","last_undegraded":"2023-08-17T17:49:19.337964+0000","last_fullsized":"2023-08-17T17:49:19.337964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.315094+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:49:19.315094+0000","last_peered":"2023-08-17T17:49:19.315094+0000","last_clean":"2023-08-17T17:49:19.315094+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:49:19.315094+0000","last_undegraded":"2023-08-17T17:49:19.315094+0000","last_fullsized":"2023-08-17T17:49:19.315094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":7,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692584+0000","last_change":"2023-08-17T17:49:19.692672+0000","last_active":"2023-08-17T17:49:19.692584+0000","last_peered":"2023-08-17T17:49:19.692584+0000","last_clean":"2023-08-17T17:49:19.301191+0000","last_became_active":"2023-08-17T17:49:19.692387+0000","last_became_peered":"2023-08-17T17:49:19.692387+0000","last_unstale":"2023-08-17T17:49:19.692584+0000","last_undegraded":"2023-08-17T17:49:19.692584+0000","last_fullsized":"2023-08-17T17:49:19.692584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.335059+0000","last_change":"2023-08-17T17:49:19.325361+0000","last_active":"2023-08-17T17:49:19.335059+0000","last_peered":"2023-08-17T17:49:19.335059+0000","last_clean":"2023-08-17T17:49:19.335059+0000","last_became_active":"2023-08-17T17:49:19.325094+0000","last_became_peered":"2023-08-17T17:49:19.325094+0000","last_unstale":"2023-08-17T17:49:19.335059+0000","last_undegraded":"2023-08-17T17:49:19.335059+0000","last_fullsized":"2023-08-17T17:49:19.335059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.322602+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:49:19.322602+0000","last_peered":"2023-08-17T17:49:19.322602+0000","last_clean":"2023-08-17T17:49:19.322602+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:49:19.322602+0000","last_undegraded":"2023-08-17T17:49:19.322602+0000","last_fullsized":"2023-08-17T17:49:19.322602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.439}]},{"osd":1,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.28999999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.745,"5min":0.78100000000000003,"15min":0.80000000000000004},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.32600000000000001,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.48199999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":0.80100000000000005,"15min":0.85499999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.34499999999999997,"5min":0.34000000000000002,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.372,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.72799999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.626}]},{"osd":6,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.67700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.436,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.46100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.374}]},{"osd":1,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.33000000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.436},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.745,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84599999999999997,"5min":0.879,"15min":1.0609999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.377},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.498,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.32700000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68200000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.34200000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.77300000000000002,"15min":1.026},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.58799999999999997,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.496},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":1.51,"15min":1.51},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.74399999999999999,"5min":0.872,"15min":1.0740000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.79900000000000004},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.34699999999999998},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.309},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.371},"min":{"1min":0.28899999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53800000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.36199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.22800000000000001},"max":{"1min":0.47599999999999998,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41199999999999998,"15min":0.40699999999999997},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.56899999999999995,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.61399999999999999,"5min":0.625,"15min":0.66600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.35499999999999998,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.46600000000000003,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.624,"15min":0.61699999999999999},"min":{"1min":0.51000000000000001,"5min":0.39500000000000002,"15min":0.39000000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63900000000000001,"15min":0.623},"min":{"1min":0.497,"5min":0.39700000000000002,"15min":0.34399999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.331},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.66100000000000003,"15min":0.63200000000000001},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.54800000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.345},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.39800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.68700000000000006,"15min":0.65700000000000003},"min":{"1min":0.59799999999999998,"5min":0.42399999999999999,"15min":0.40899999999999997},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.68700000000000006,"15min":0.65800000000000003},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.41199999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.66700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.23400000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.54000000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.255},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.23899999999999999,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.66200000000000003},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36099999999999999,"15min":0.36399999999999999},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46300000000000002,"5min":0.54100000000000004,"15min":0.60099999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40300000000000002},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51500000000000001,"5min":0.58199999999999996,"15min":0.65200000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.32500000000000001,"5min":0.26600000000000001,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.55400000000000005,"15min":0.66200000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40899999999999997,"15min":0.40999999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.52700000000000002,"5min":0.56999999999999995,"15min":0.65700000000000003},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.90000000000000002,"15min":1.3300000000000001},"last":0.499}]},{"osd":5,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.63400000000000001,"15min":0.61499999999999999},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.439},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.391},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.71799999999999997,"15min":0.67400000000000004},"min":{"1min":0.53200000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.6109999999999998,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":0.997,"15min":1.544},"last":0.51100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.372},"min":{"1min":0.28899999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54100000000000004,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.60799999999999998,"5min":1.268,"15min":1.268},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40300000000000002,"15min":0.40000000000000002},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.222},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31}]},{"osd":4,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.46999999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.51,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.49399999999999999,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.63300000000000001},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.5509999999999999,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.627,"15min":0.60699999999999998},"min":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.39700000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.53200000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70199999999999996,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3859999999999999,"5min":2.984,"15min":2.984},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.48899999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.191},"max":{"1min":0.48399999999999999,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38,"15min":0.376},"min":{"1min":0.255,"5min":0.25,"15min":0.224},"max":{"1min":0.53200000000000003,"5min":0.60599999999999998,"15min":0.71799999999999997},"last":0.245}]},{"osd":1,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38100000000000001,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.215},"max":{"1min":0.57599999999999996,"5min":0.61099999999999999,"15min":0.73799999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39600000000000002,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"min":{"1min":0.30599999999999999,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41299999999999998},"min":{"1min":0.35999999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.71099999999999997},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.45400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.89000000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.272,"5min":1.272,"15min":2.1309999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.38100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.443,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.65400000000000003,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.65700000000000003,"15min":0.63600000000000001},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.66600000000000004,"15min":0.65000000000000002},"min":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.623},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.55100000000000005,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":1.014,"5min":1.016,"15min":2.1669999999999998},"last":0.58399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.752,"5min":0.76900000000000002,"15min":0.89100000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.629},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.51200000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.84799999999999998},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.44800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76200000000000001,"5min":0.77900000000000003,"15min":0.80100000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.85699999999999998},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.34100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.39100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68000000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68899999999999995,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.82199999999999995,"15min":0.91900000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77900000000000003,"5min":0.877,"15min":1.056},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":892928,"data_stored":435602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.434,"5min":0.32900000000000001,"15min":0.27700000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.2609999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.317,"15min":0.31},"max":{"1min":1.022,"5min":1.022,"15min":1.1499999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.242},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.29799999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.438}]},{"osd":2,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.622,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.252},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.49299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.274},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.179},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.3080000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.35499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.75,"15min":1.0620000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":1.0740000000000001},"last":0.38100000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.42199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":1.01},"last":0.316},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.44700000000000001,"5min":0.33300000000000002,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.77000000000000002,"15min":1.1020000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.79700000000000004,"5min":0.82299999999999995,"15min":1.038},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.498,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":1.1279999999999999},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:49:25.599 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:49:25.599+0000 7fab2d465700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:49:27.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:49:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.190+0000 7f580ed1d700 1 Processor -- start 2023-08-17T17:49:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.190+0000 7f580ed1d700 1 -- start start 2023-08-17T17:49:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.191+0000 7f580ed1d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080bef00 0x7f5808064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.191+0000 7f580ed1d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5808065140 0x7f58080c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.191+0000 7f580ed1d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58080c4040 con 0x7f58080a7fe0 2023-08-17T17:49:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.191+0000 7f580ed1d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58080c7080 con 0x7f5808065140 2023-08-17T17:49:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.191+0000 7f580ed1d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080655f0 con 0x7f58080bef00 2023-08-17T17:49:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.191+0000 7f580cab9700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f58080a7fe0 0x7f58080be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35092/0 (socket says 172.21.15.78:35092) 2023-08-17T17:49:27.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.191+0000 7f580cab9700 1 -- 172.21.15.78:0/860799546 learned_addr learned my addr 172.21.15.78:0/860799546 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f580d2ba700 1 --2- 172.21.15.78:0/860799546 >> v2:172.21.15.150:3300/0 conn(0x7f5808065140 0x7f58080c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57fffff700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080bef00 0x7f5808064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997526798 0 0) 0x7f58080c4040 con 0x7f58080a7fe0 2023-08-17T17:49:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f00033f0 con 0x7f58080a7fe0 2023-08-17T17:49:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3228368793 0 0) 0x7f57f00033f0 con 0x7f58080a7fe0 2023-08-17T17:49:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080bef00 msgr2=0x7f5808064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080bef00 0x7f5808064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 >> v2:172.21.15.150:3300/0 conn(0x7f5808065140 msgr2=0x7f58080c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 --2- 172.21.15.78:0/860799546 >> v2:172.21.15.150:3300/0 conn(0x7f5808065140 0x7f58080c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080c3430 con 0x7f58080a7fe0 2023-08-17T17:49:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f58040017f0 con 0x7f58080a7fe0 2023-08-17T17:49:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 >> v1:172.21.15.78:6789/0 conn(0x7f58080a7fe0 legacy=0x7f58080be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 0x7f57f0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f0004690 0x7f57f0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080bef00 0x7f57f0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080c7080 con 0x7f57f00038e0 2023-08-17T17:49:27.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080655f0 con 0x7f57f0004690 2023-08-17T17:49:27.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f000b8e0 con 0x7f58080bef00 2023-08-17T17:49:27.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f580d2ba700 1 --2- 172.21.15.78:0/860799546 >> v2:172.21.15.150:3300/0 conn(0x7f5808065140 0x7f58080c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:27.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f580cab9700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 0x7f57f0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f57fffff700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f0004690 0x7f57f0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f580d2ba700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080bef00 0x7f57f0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f580cab9700 1 -- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080bef00 msgr2=0x7f57f0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:27.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f580cab9700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58080bef00 0x7f57f0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f580cab9700 1 -- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f0004690 msgr2=0x7f57f0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:27.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.192+0000 7f580cab9700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f0004690 0x7f57f0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f580cab9700 1 -- 172.21.15.78:0/860799546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f00033f0 con 0x7f57f00038e0 2023-08-17T17:49:27.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f580cab9700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 0x7f57f0003d00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f580400c530 tx=0x7f5804002210).ready entity=mon.0 client_cookie=ca241304642c2ca3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:27.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804007de0 con 0x7f57f00038e0 2023-08-17T17:49:27.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580400ce60 con 0x7f57f00038e0 2023-08-17T17:49:27.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f57ff7fe700 1 -- 172.21.15.78:0/860799546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804005d70 con 0x7f57f00038e0 2023-08-17T17:49:27.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f580ed1d700 1 -- 172.21.15.78:0/860799546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 msgr2=0x7f57f0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f580ed1d700 1 --2- 172.21.15.78:0/860799546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 0x7f57f0003d00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f580400c530 tx=0x7f5804002210).stop 2023-08-17T17:49:27.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f580d2ba700 1 -- 172.21.15.78:0/860799546 reap_dead start 2023-08-17T17:49:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f580ed1d700 1 -- 172.21.15.78:0/860799546 shutdown_connections 2023-08-17T17:49:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f580ed1d700 1 -- 172.21.15.78:0/860799546 >> 172.21.15.78:0/860799546 conn(0x7f5808092330 msgr2=0x7f5808062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f580ed1d700 1 -- 172.21.15.78:0/860799546 shutdown_connections 2023-08-17T17:49:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.193+0000 7f580ed1d700 1 -- 172.21.15.78:0/860799546 wait complete. 2023-08-17T17:49:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.194+0000 7f580ed1d700 1 Processor -- start 2023-08-17T17:49:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.195+0000 7f580ed1d700 1 -- start start 2023-08-17T17:49:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.195+0000 7f580ed1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 0x7f58080c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.195+0000 7f580ed1d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5808151d60 0x7f58080c1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.195+0000 7f580ed1d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58081530c0 0x7f5808153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.195+0000 7f580ed1d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5808153a30 con 0x7f57f00038e0 2023-08-17T17:49:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.195+0000 7f580ed1d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58081521e0 con 0x7f5808151d60 2023-08-17T17:49:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.195+0000 7f580ed1d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080c1fe0 con 0x7f58081530c0 2023-08-17T17:49:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.195+0000 7f580cab9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 0x7f58080c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.195+0000 7f580cab9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 0x7f58080c0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56644/0 (socket says 172.21.15.78:56644) 2023-08-17T17:49:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.195+0000 7f580cab9700 1 -- 172.21.15.78:0/1695347466 learned_addr learned my addr 172.21.15.78:0/1695347466 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f57fffff700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5808151d60 0x7f58080c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f580d2ba700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58081530c0 0x7f5808153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f580cab9700 1 -- 172.21.15.78:0/1695347466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58081530c0 msgr2=0x7f5808153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f580cab9700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58081530c0 0x7f5808153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f580cab9700 1 -- 172.21.15.78:0/1695347466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5808151d60 msgr2=0x7f58080c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f580cab9700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5808151d60 0x7f58080c1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f580cab9700 1 -- 172.21.15.78:0/1695347466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080c22c0 con 0x7f57f00038e0 2023-08-17T17:49:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f580d2ba700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58081530c0 0x7f5808153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f57fffff700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5808151d60 0x7f58080c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f580cab9700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 0x7f58080c0f60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f57f0004480 tx=0x7f5804015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f57fcff9700 1 -- 172.21.15.78:0/1695347466 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58040074f0 con 0x7f57f00038e0 2023-08-17T17:49:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f57fcff9700 1 -- 172.21.15.78:0/1695347466 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5804007650 con 0x7f57f00038e0 2023-08-17T17:49:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f580ed1d700 1 -- 172.21.15.78:0/1695347466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58080c25a0 con 0x7f57f00038e0 2023-08-17T17:49:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f57fcff9700 1 -- 172.21.15.78:0/1695347466 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804007a10 con 0x7f57f00038e0 2023-08-17T17:49:27.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.196+0000 7f580ed1d700 1 -- 172.21.15.78:0/1695347466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58080c2b60 con 0x7f57f00038e0 2023-08-17T17:49:27.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.197+0000 7f580ed1d700 1 -- 172.21.15.78:0/1695347466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58080bde20 con 0x7f57f00038e0 2023-08-17T17:49:27.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.197+0000 7f57fcff9700 1 -- 172.21.15.78:0/1695347466 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f580401d070 con 0x7f57f00038e0 2023-08-17T17:49:27.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.197+0000 7f57fcff9700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57f405ed90 0x7f57f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.198+0000 7f57fcff9700 1 -- 172.21.15.78:0/1695347466 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f580407aad0 con 0x7f57f00038e0 2023-08-17T17:49:27.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.198+0000 7f57fffff700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57f405ed90 0x7f57f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.198+0000 7f57fffff700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57f405ed90 0x7f57f4061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5808065d50 tx=0x7f57f8008040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:27.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.202+0000 7f57fcff9700 1 -- 172.21.15.78:0/1695347466 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f580404c070 con 0x7f57f00038e0 2023-08-17T17:49:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.365+0000 7f580ed1d700 1 -- 172.21.15.78:0/1695347466 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5808047350 con 0x7f57f405ed90 2023-08-17T17:49:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.375+0000 7f57fcff9700 1 -- 172.21.15.78:0/1695347466 <== mgr.6066 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361138 (secure 0 0 0) 0x7f5808047350 con 0x7f57f405ed90 2023-08-17T17:49:27.379 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:27.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 -- 172.21.15.78:0/1695347466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57f405ed90 msgr2=0x7f57f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57f405ed90 0x7f57f4061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5808065d50 tx=0x7f57f8008040).stop 2023-08-17T17:49:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 -- 172.21.15.78:0/1695347466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 msgr2=0x7f58080c0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 0x7f58080c0f60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f57f0004480 tx=0x7f5804015000).stop 2023-08-17T17:49:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 -- 172.21.15.78:0/1695347466 shutdown_connections 2023-08-17T17:49:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f57f405ed90 0x7f57f4061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58081530c0 0x7f5808153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00038e0 0x7f58080c0f60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 --2- 172.21.15.78:0/1695347466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5808151d60 0x7f58080c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 -- 172.21.15.78:0/1695347466 >> 172.21.15.78:0/1695347466 conn(0x7f5808092330 msgr2=0x7f58080665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 -- 172.21.15.78:0/1695347466 shutdown_connections 2023-08-17T17:49:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.379+0000 7f580ed1d700 1 -- 172.21.15.78:0/1695347466 wait complete. 2023-08-17T17:49:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:49:27.391 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-17T17:49:26.698712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408672,"kb_used_data":7328,"kb_used_omap":0,"kb_used_meta":2401280,"kb_avail":752566048,"statfs":{"total":773094113280,"available":770627633152,"internally_reserved":0,"allocated":7503872,"data_stored":3653924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458910720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-25853,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-40,"num_write_kb":-52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.542571"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.694959+0000","last_change":"2023-08-17T17:49:19.690957+0000","last_active":"2023-08-17T17:49:19.694959+0000","last_peered":"2023-08-17T17:49:19.694959+0000","last_clean":"2023-08-17T17:49:19.694959+0000","last_became_active":"2023-08-17T17:49:19.690636+0000","last_became_peered":"2023-08-17T17:49:19.690636+0000","last_unstale":"2023-08-17T17:49:19.694959+0000","last_undegraded":"2023-08-17T17:49:19.694959+0000","last_fullsized":"2023-08-17T17:49:19.694959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"76'3","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696465+0000","last_change":"2023-08-17T17:49:19.322111+0000","last_active":"2023-08-17T17:49:19.696465+0000","last_peered":"2023-08-17T17:49:19.696465+0000","last_clean":"2023-08-17T17:49:19.696465+0000","last_became_active":"2023-08-17T17:49:19.321778+0000","last_became_peered":"2023-08-17T17:49:19.321778+0000","last_unstale":"2023-08-17T17:49:19.696465+0000","last_undegraded":"2023-08-17T17:49:19.696465+0000","last_fullsized":"2023-08-17T17:49:19.696465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.703035+0000","last_change":"2023-08-17T17:49:19.699664+0000","last_active":"2023-08-17T17:49:19.703035+0000","last_peered":"2023-08-17T17:49:19.703035+0000","last_clean":"2023-08-17T17:49:19.703035+0000","last_became_active":"2023-08-17T17:49:19.699416+0000","last_became_peered":"2023-08-17T17:49:19.699416+0000","last_unstale":"2023-08-17T17:49:19.703035+0000","last_undegraded":"2023-08-17T17:49:19.703035+0000","last_fullsized":"2023-08-17T17:49:19.703035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.683793+0000","last_change":"2023-08-17T17:49:19.322333+0000","last_active":"2023-08-17T17:49:19.683793+0000","last_peered":"2023-08-17T17:49:19.683793+0000","last_clean":"2023-08-17T17:49:19.683793+0000","last_became_active":"2023-08-17T17:49:19.322077+0000","last_became_peered":"2023-08-17T17:49:19.322077+0000","last_unstale":"2023-08-17T17:49:19.683793+0000","last_undegraded":"2023-08-17T17:49:19.683793+0000","last_fullsized":"2023-08-17T17:49:19.683793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696286+0000","last_change":"2023-08-17T17:49:19.691522+0000","last_active":"2023-08-17T17:49:19.696286+0000","last_peered":"2023-08-17T17:49:19.696286+0000","last_clean":"2023-08-17T17:49:19.696286+0000","last_became_active":"2023-08-17T17:49:19.691238+0000","last_became_peered":"2023-08-17T17:49:19.691238+0000","last_unstale":"2023-08-17T17:49:19.696286+0000","last_undegraded":"2023-08-17T17:49:19.696286+0000","last_fullsized":"2023-08-17T17:49:19.696286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.687606+0000","last_change":"2023-08-17T17:49:19.333619+0000","last_active":"2023-08-17T17:49:19.687606+0000","last_peered":"2023-08-17T17:49:19.687606+0000","last_clean":"2023-08-17T17:49:19.687606+0000","last_became_active":"2023-08-17T17:49:19.333272+0000","last_became_peered":"2023-08-17T17:49:19.333272+0000","last_unstale":"2023-08-17T17:49:19.687606+0000","last_undegraded":"2023-08-17T17:49:19.687606+0000","last_fullsized":"2023-08-17T17:49:19.687606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696885+0000","last_change":"2023-08-17T17:49:19.694730+0000","last_active":"2023-08-17T17:49:19.696885+0000","last_peered":"2023-08-17T17:49:19.696885+0000","last_clean":"2023-08-17T17:49:19.696885+0000","last_became_active":"2023-08-17T17:49:19.694310+0000","last_became_peered":"2023-08-17T17:49:19.694310+0000","last_unstale":"2023-08-17T17:49:19.696885+0000","last_undegraded":"2023-08-17T17:49:19.696885+0000","last_fullsized":"2023-08-17T17:49:19.696885+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697892+0000","last_change":"2023-08-17T17:49:19.325701+0000","last_active":"2023-08-17T17:49:19.697892+0000","last_peered":"2023-08-17T17:49:19.697892+0000","last_clean":"2023-08-17T17:49:19.697892+0000","last_became_active":"2023-08-17T17:49:19.325396+0000","last_became_peered":"2023-08-17T17:49:19.325396+0000","last_unstale":"2023-08-17T17:49:19.697892+0000","last_undegraded":"2023-08-17T17:49:19.697892+0000","last_fullsized":"2023-08-17T17:49:19.697892+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.702592+0000","last_change":"2023-08-17T17:49:19.702124+0000","last_active":"2023-08-17T17:49:19.702592+0000","last_peered":"2023-08-17T17:49:19.702592+0000","last_clean":"2023-08-17T17:49:19.702592+0000","last_became_active":"2023-08-17T17:49:19.701784+0000","last_became_peered":"2023-08-17T17:49:19.701784+0000","last_unstale":"2023-08-17T17:49:19.702592+0000","last_undegraded":"2023-08-17T17:49:19.702592+0000","last_fullsized":"2023-08-17T17:49:19.702592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697525+0000","last_change":"2023-08-17T17:49:19.327117+0000","last_active":"2023-08-17T17:49:19.697525+0000","last_peered":"2023-08-17T17:49:19.697525+0000","last_clean":"2023-08-17T17:49:19.697525+0000","last_became_active":"2023-08-17T17:49:19.326840+0000","last_became_peered":"2023-08-17T17:49:19.326840+0000","last_unstale":"2023-08-17T17:49:19.697525+0000","last_undegraded":"2023-08-17T17:49:19.697525+0000","last_fullsized":"2023-08-17T17:49:19.697525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.704103+0000","last_change":"2023-08-17T17:49:19.702021+0000","last_active":"2023-08-17T17:49:19.704103+0000","last_peered":"2023-08-17T17:49:19.704103+0000","last_clean":"2023-08-17T17:49:19.704103+0000","last_became_active":"2023-08-17T17:49:19.701619+0000","last_became_peered":"2023-08-17T17:49:19.701619+0000","last_unstale":"2023-08-17T17:49:19.704103+0000","last_undegraded":"2023-08-17T17:49:19.704103+0000","last_fullsized":"2023-08-17T17:49:19.704103+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695445+0000","last_change":"2023-08-17T17:49:19.319123+0000","last_active":"2023-08-17T17:49:19.695445+0000","last_peered":"2023-08-17T17:49:19.695445+0000","last_clean":"2023-08-17T17:49:19.695445+0000","last_became_active":"2023-08-17T17:49:19.318595+0000","last_became_peered":"2023-08-17T17:49:19.318595+0000","last_unstale":"2023-08-17T17:49:19.695445+0000","last_undegraded":"2023-08-17T17:49:19.695445+0000","last_fullsized":"2023-08-17T17:49:19.695445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.701023+0000","last_change":"2023-08-17T17:49:19.698449+0000","last_active":"2023-08-17T17:49:19.701023+0000","last_peered":"2023-08-17T17:49:19.701023+0000","last_clean":"2023-08-17T17:49:19.701023+0000","last_became_active":"2023-08-17T17:49:19.698164+0000","last_became_peered":"2023-08-17T17:49:19.698164+0000","last_unstale":"2023-08-17T17:49:19.701023+0000","last_undegraded":"2023-08-17T17:49:19.701023+0000","last_fullsized":"2023-08-17T17:49:19.701023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681922+0000","last_change":"2023-08-17T17:49:19.329857+0000","last_active":"2023-08-17T17:49:19.681922+0000","last_peered":"2023-08-17T17:49:19.681922+0000","last_clean":"2023-08-17T17:49:19.681922+0000","last_became_active":"2023-08-17T17:49:19.329112+0000","last_became_peered":"2023-08-17T17:49:19.329112+0000","last_unstale":"2023-08-17T17:49:19.681922+0000","last_undegraded":"2023-08-17T17:49:19.681922+0000","last_fullsized":"2023-08-17T17:49:19.681922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706159+0000","last_change":"2023-08-17T17:49:19.704778+0000","last_active":"2023-08-17T17:49:19.706159+0000","last_peered":"2023-08-17T17:49:19.706159+0000","last_clean":"2023-08-17T17:49:19.706159+0000","last_became_active":"2023-08-17T17:49:19.704347+0000","last_became_peered":"2023-08-17T17:49:19.704347+0000","last_unstale":"2023-08-17T17:49:19.706159+0000","last_undegraded":"2023-08-17T17:49:19.706159+0000","last_fullsized":"2023-08-17T17:49:19.706159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.683781+0000","last_change":"2023-08-17T17:49:19.324543+0000","last_active":"2023-08-17T17:49:19.683781+0000","last_peered":"2023-08-17T17:49:19.683781+0000","last_clean":"2023-08-17T17:49:19.683781+0000","last_became_active":"2023-08-17T17:49:19.324266+0000","last_became_peered":"2023-08-17T17:49:19.324266+0000","last_unstale":"2023-08-17T17:49:19.683781+0000","last_undegraded":"2023-08-17T17:49:19.683781+0000","last_fullsized":"2023-08-17T17:49:19.683781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.702368+0000","last_change":"2023-08-17T17:49:19.701599+0000","last_active":"2023-08-17T17:49:19.702368+0000","last_peered":"2023-08-17T17:49:19.702368+0000","last_clean":"2023-08-17T17:49:19.702368+0000","last_became_active":"2023-08-17T17:49:19.701264+0000","last_became_peered":"2023-08-17T17:49:19.701264+0000","last_unstale":"2023-08-17T17:49:19.702368+0000","last_undegraded":"2023-08-17T17:49:19.702368+0000","last_fullsized":"2023-08-17T17:49:19.702368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.683972+0000","last_change":"2023-08-17T17:49:19.325582+0000","last_active":"2023-08-17T17:49:19.683972+0000","last_peered":"2023-08-17T17:49:19.683972+0000","last_clean":"2023-08-17T17:49:19.683972+0000","last_became_active":"2023-08-17T17:49:19.325292+0000","last_became_peered":"2023-08-17T17:49:19.325292+0000","last_unstale":"2023-08-17T17:49:19.683972+0000","last_undegraded":"2023-08-17T17:49:19.683972+0000","last_fullsized":"2023-08-17T17:49:19.683972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699202+0000","last_change":"2023-08-17T17:49:19.697630+0000","last_active":"2023-08-17T17:49:19.699202+0000","last_peered":"2023-08-17T17:49:19.699202+0000","last_clean":"2023-08-17T17:49:19.699202+0000","last_became_active":"2023-08-17T17:49:19.697302+0000","last_became_peered":"2023-08-17T17:49:19.697302+0000","last_unstale":"2023-08-17T17:49:19.699202+0000","last_undegraded":"2023-08-17T17:49:19.699202+0000","last_fullsized":"2023-08-17T17:49:19.699202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.677683+0000","last_change":"2023-08-17T17:49:19.327360+0000","last_active":"2023-08-17T17:49:19.677683+0000","last_peered":"2023-08-17T17:49:19.677683+0000","last_clean":"2023-08-17T17:49:19.677683+0000","last_became_active":"2023-08-17T17:49:19.327081+0000","last_became_peered":"2023-08-17T17:49:19.327081+0000","last_unstale":"2023-08-17T17:49:19.677683+0000","last_undegraded":"2023-08-17T17:49:19.677683+0000","last_fullsized":"2023-08-17T17:49:19.677683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.702822+0000","last_change":"2023-08-17T17:49:19.700495+0000","last_active":"2023-08-17T17:49:19.702822+0000","last_peered":"2023-08-17T17:49:19.702822+0000","last_clean":"2023-08-17T17:49:19.702822+0000","last_became_active":"2023-08-17T17:49:19.700216+0000","last_became_peered":"2023-08-17T17:49:19.700216+0000","last_unstale":"2023-08-17T17:49:19.702822+0000","last_undegraded":"2023-08-17T17:49:19.702822+0000","last_fullsized":"2023-08-17T17:49:19.702822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.677845+0000","last_change":"2023-08-17T17:49:19.323045+0000","last_active":"2023-08-17T17:49:19.677845+0000","last_peered":"2023-08-17T17:49:19.677845+0000","last_clean":"2023-08-17T17:49:19.677845+0000","last_became_active":"2023-08-17T17:49:19.322755+0000","last_became_peered":"2023-08-17T17:49:19.322755+0000","last_unstale":"2023-08-17T17:49:19.677845+0000","last_undegraded":"2023-08-17T17:49:19.677845+0000","last_fullsized":"2023-08-17T17:49:19.677845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.708720+0000","last_change":"2023-08-17T17:49:19.707969+0000","last_active":"2023-08-17T17:49:19.708720+0000","last_peered":"2023-08-17T17:49:19.708720+0000","last_clean":"2023-08-17T17:49:19.708720+0000","last_became_active":"2023-08-17T17:49:19.707674+0000","last_became_peered":"2023-08-17T17:49:19.707674+0000","last_unstale":"2023-08-17T17:49:19.708720+0000","last_undegraded":"2023-08-17T17:49:19.708720+0000","last_fullsized":"2023-08-17T17:49:19.708720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"76'4","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.707837+0000","last_change":"2023-08-17T17:49:19.330926+0000","last_active":"2023-08-17T17:49:19.707837+0000","last_peered":"2023-08-17T17:49:19.707837+0000","last_clean":"2023-08-17T17:49:19.707837+0000","last_became_active":"2023-08-17T17:49:19.330379+0000","last_became_peered":"2023-08-17T17:49:19.330379+0000","last_unstale":"2023-08-17T17:49:19.707837+0000","last_undegraded":"2023-08-17T17:49:19.707837+0000","last_fullsized":"2023-08-17T17:49:19.707837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700818+0000","last_change":"2023-08-17T17:49:19.697399+0000","last_active":"2023-08-17T17:49:19.700818+0000","last_peered":"2023-08-17T17:49:19.700818+0000","last_clean":"2023-08-17T17:49:19.700818+0000","last_became_active":"2023-08-17T17:49:19.697133+0000","last_became_peered":"2023-08-17T17:49:19.697133+0000","last_unstale":"2023-08-17T17:49:19.700818+0000","last_undegraded":"2023-08-17T17:49:19.700818+0000","last_fullsized":"2023-08-17T17:49:19.700818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.703884+0000","last_change":"2023-08-17T17:49:19.331576+0000","last_active":"2023-08-17T17:49:19.703884+0000","last_peered":"2023-08-17T17:49:19.703884+0000","last_clean":"2023-08-17T17:49:19.703884+0000","last_became_active":"2023-08-17T17:49:19.331285+0000","last_became_peered":"2023-08-17T17:49:19.331285+0000","last_unstale":"2023-08-17T17:49:19.703884+0000","last_undegraded":"2023-08-17T17:49:19.703884+0000","last_fullsized":"2023-08-17T17:49:19.703884+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.702924+0000","last_change":"2023-08-17T17:49:19.701187+0000","last_active":"2023-08-17T17:49:19.702924+0000","last_peered":"2023-08-17T17:49:19.702924+0000","last_clean":"2023-08-17T17:49:19.702924+0000","last_became_active":"2023-08-17T17:49:19.700922+0000","last_became_peered":"2023-08-17T17:49:19.700922+0000","last_unstale":"2023-08-17T17:49:19.702924+0000","last_undegraded":"2023-08-17T17:49:19.702924+0000","last_fullsized":"2023-08-17T17:49:19.702924+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.682345+0000","last_change":"2023-08-17T17:49:19.323917+0000","last_active":"2023-08-17T17:49:19.682345+0000","last_peered":"2023-08-17T17:49:19.682345+0000","last_clean":"2023-08-17T17:49:19.682345+0000","last_became_active":"2023-08-17T17:49:19.323538+0000","last_became_peered":"2023-08-17T17:49:19.323538+0000","last_unstale":"2023-08-17T17:49:19.682345+0000","last_undegraded":"2023-08-17T17:49:19.682345+0000","last_fullsized":"2023-08-17T17:49:19.682345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.702539+0000","last_change":"2023-08-17T17:49:19.696962+0000","last_active":"2023-08-17T17:49:19.702539+0000","last_peered":"2023-08-17T17:49:19.702539+0000","last_clean":"2023-08-17T17:49:19.702539+0000","last_became_active":"2023-08-17T17:49:19.696322+0000","last_became_peered":"2023-08-17T17:49:19.696322+0000","last_unstale":"2023-08-17T17:49:19.702539+0000","last_undegraded":"2023-08-17T17:49:19.702539+0000","last_fullsized":"2023-08-17T17:49:19.702539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681991+0000","last_change":"2023-08-17T17:49:19.329416+0000","last_active":"2023-08-17T17:49:19.681991+0000","last_peered":"2023-08-17T17:49:19.681991+0000","last_clean":"2023-08-17T17:49:19.681991+0000","last_became_active":"2023-08-17T17:49:19.328707+0000","last_became_peered":"2023-08-17T17:49:19.328707+0000","last_unstale":"2023-08-17T17:49:19.681991+0000","last_undegraded":"2023-08-17T17:49:19.681991+0000","last_fullsized":"2023-08-17T17:49:19.681991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697849+0000","last_change":"2023-08-17T17:49:19.694511+0000","last_active":"2023-08-17T17:49:19.697849+0000","last_peered":"2023-08-17T17:49:19.697849+0000","last_clean":"2023-08-17T17:49:19.697849+0000","last_became_active":"2023-08-17T17:49:19.694182+0000","last_became_peered":"2023-08-17T17:49:19.694182+0000","last_unstale":"2023-08-17T17:49:19.697849+0000","last_undegraded":"2023-08-17T17:49:19.697849+0000","last_fullsized":"2023-08-17T17:49:19.697849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"76'4","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.703992+0000","last_change":"2023-08-17T17:49:19.327993+0000","last_active":"2023-08-17T17:49:19.703992+0000","last_peered":"2023-08-17T17:49:19.703992+0000","last_clean":"2023-08-17T17:49:19.703992+0000","last_became_active":"2023-08-17T17:49:19.327700+0000","last_became_peered":"2023-08-17T17:49:19.327700+0000","last_unstale":"2023-08-17T17:49:19.703992+0000","last_undegraded":"2023-08-17T17:49:19.703992+0000","last_fullsized":"2023-08-17T17:49:19.703992+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700976+0000","last_change":"2023-08-17T17:49:19.699243+0000","last_active":"2023-08-17T17:49:19.700976+0000","last_peered":"2023-08-17T17:49:19.700976+0000","last_clean":"2023-08-17T17:49:19.700976+0000","last_became_active":"2023-08-17T17:49:19.698952+0000","last_became_peered":"2023-08-17T17:49:19.698952+0000","last_unstale":"2023-08-17T17:49:19.700976+0000","last_undegraded":"2023-08-17T17:49:19.700976+0000","last_fullsized":"2023-08-17T17:49:19.700976+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684131+0000","last_change":"2023-08-17T17:49:19.328079+0000","last_active":"2023-08-17T17:49:19.684131+0000","last_peered":"2023-08-17T17:49:19.684131+0000","last_clean":"2023-08-17T17:49:19.684131+0000","last_became_active":"2023-08-17T17:49:19.327794+0000","last_became_peered":"2023-08-17T17:49:19.327794+0000","last_unstale":"2023-08-17T17:49:19.684131+0000","last_undegraded":"2023-08-17T17:49:19.684131+0000","last_fullsized":"2023-08-17T17:49:19.684131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.704868+0000","last_change":"2023-08-17T17:49:19.694776+0000","last_active":"2023-08-17T17:49:19.704868+0000","last_peered":"2023-08-17T17:49:19.704868+0000","last_clean":"2023-08-17T17:49:19.704868+0000","last_became_active":"2023-08-17T17:49:19.694363+0000","last_became_peered":"2023-08-17T17:49:19.694363+0000","last_unstale":"2023-08-17T17:49:19.704868+0000","last_undegraded":"2023-08-17T17:49:19.704868+0000","last_fullsized":"2023-08-17T17:49:19.704868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.687583+0000","last_change":"2023-08-17T17:49:19.335785+0000","last_active":"2023-08-17T17:49:19.687583+0000","last_peered":"2023-08-17T17:49:19.687583+0000","last_clean":"2023-08-17T17:49:19.687583+0000","last_became_active":"2023-08-17T17:49:19.335488+0000","last_became_peered":"2023-08-17T17:49:19.335488+0000","last_unstale":"2023-08-17T17:49:19.687583+0000","last_undegraded":"2023-08-17T17:49:19.687583+0000","last_fullsized":"2023-08-17T17:49:19.687583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695636+0000","last_change":"2023-08-17T17:49:19.693865+0000","last_active":"2023-08-17T17:49:19.695636+0000","last_peered":"2023-08-17T17:49:19.695636+0000","last_clean":"2023-08-17T17:49:19.695636+0000","last_became_active":"2023-08-17T17:49:19.692912+0000","last_became_peered":"2023-08-17T17:49:19.692912+0000","last_unstale":"2023-08-17T17:49:19.695636+0000","last_undegraded":"2023-08-17T17:49:19.695636+0000","last_fullsized":"2023-08-17T17:49:19.695636+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696482+0000","last_change":"2023-08-17T17:49:19.322192+0000","last_active":"2023-08-17T17:49:19.696482+0000","last_peered":"2023-08-17T17:49:19.696482+0000","last_clean":"2023-08-17T17:49:19.696482+0000","last_became_active":"2023-08-17T17:49:19.321913+0000","last_became_peered":"2023-08-17T17:49:19.321913+0000","last_unstale":"2023-08-17T17:49:19.696482+0000","last_undegraded":"2023-08-17T17:49:19.696482+0000","last_fullsized":"2023-08-17T17:49:19.696482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696868+0000","last_change":"2023-08-17T17:49:19.694568+0000","last_active":"2023-08-17T17:49:19.696868+0000","last_peered":"2023-08-17T17:49:19.696868+0000","last_clean":"2023-08-17T17:49:19.696868+0000","last_became_active":"2023-08-17T17:49:19.693972+0000","last_became_peered":"2023-08-17T17:49:19.693972+0000","last_unstale":"2023-08-17T17:49:19.696868+0000","last_undegraded":"2023-08-17T17:49:19.696868+0000","last_fullsized":"2023-08-17T17:49:19.696868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684427+0000","last_change":"2023-08-17T17:49:19.326035+0000","last_active":"2023-08-17T17:49:19.684427+0000","last_peered":"2023-08-17T17:49:19.684427+0000","last_clean":"2023-08-17T17:49:19.684427+0000","last_became_active":"2023-08-17T17:49:19.325780+0000","last_became_peered":"2023-08-17T17:49:19.325780+0000","last_unstale":"2023-08-17T17:49:19.684427+0000","last_undegraded":"2023-08-17T17:49:19.684427+0000","last_fullsized":"2023-08-17T17:49:19.684427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.702134+0000","last_change":"2023-08-17T17:49:19.696765+0000","last_active":"2023-08-17T17:49:19.702134+0000","last_peered":"2023-08-17T17:49:19.702134+0000","last_clean":"2023-08-17T17:49:19.702134+0000","last_became_active":"2023-08-17T17:49:19.696474+0000","last_became_peered":"2023-08-17T17:49:19.696474+0000","last_unstale":"2023-08-17T17:49:19.702134+0000","last_undegraded":"2023-08-17T17:49:19.702134+0000","last_fullsized":"2023-08-17T17:49:19.702134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706168+0000","last_change":"2023-08-17T17:49:19.333623+0000","last_active":"2023-08-17T17:49:19.706168+0000","last_peered":"2023-08-17T17:49:19.706168+0000","last_clean":"2023-08-17T17:49:19.706168+0000","last_became_active":"2023-08-17T17:49:19.333170+0000","last_became_peered":"2023-08-17T17:49:19.333170+0000","last_unstale":"2023-08-17T17:49:19.706168+0000","last_undegraded":"2023-08-17T17:49:19.706168+0000","last_fullsized":"2023-08-17T17:49:19.706168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706469+0000","last_change":"2023-08-17T17:49:19.701973+0000","last_active":"2023-08-17T17:49:19.706469+0000","last_peered":"2023-08-17T17:49:19.706469+0000","last_clean":"2023-08-17T17:49:19.706469+0000","last_became_active":"2023-08-17T17:49:19.701713+0000","last_became_peered":"2023-08-17T17:49:19.701713+0000","last_unstale":"2023-08-17T17:49:19.706469+0000","last_undegraded":"2023-08-17T17:49:19.706469+0000","last_fullsized":"2023-08-17T17:49:19.706469+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684099+0000","last_change":"2023-08-17T17:49:19.321366+0000","last_active":"2023-08-17T17:49:19.684099+0000","last_peered":"2023-08-17T17:49:19.684099+0000","last_clean":"2023-08-17T17:49:19.684099+0000","last_became_active":"2023-08-17T17:49:19.321072+0000","last_became_peered":"2023-08-17T17:49:19.321072+0000","last_unstale":"2023-08-17T17:49:19.684099+0000","last_undegraded":"2023-08-17T17:49:19.684099+0000","last_fullsized":"2023-08-17T17:49:19.684099+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706501+0000","last_change":"2023-08-17T17:49:19.701970+0000","last_active":"2023-08-17T17:49:19.706501+0000","last_peered":"2023-08-17T17:49:19.706501+0000","last_clean":"2023-08-17T17:49:19.706501+0000","last_became_active":"2023-08-17T17:49:19.701703+0000","last_became_peered":"2023-08-17T17:49:19.701703+0000","last_unstale":"2023-08-17T17:49:19.706501+0000","last_undegraded":"2023-08-17T17:49:19.706501+0000","last_fullsized":"2023-08-17T17:49:19.706501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692372+0000","last_change":"2023-08-17T17:49:19.336558+0000","last_active":"2023-08-17T17:49:19.692372+0000","last_peered":"2023-08-17T17:49:19.692372+0000","last_clean":"2023-08-17T17:49:19.692372+0000","last_became_active":"2023-08-17T17:49:19.336291+0000","last_became_peered":"2023-08-17T17:49:19.336291+0000","last_unstale":"2023-08-17T17:49:19.692372+0000","last_undegraded":"2023-08-17T17:49:19.692372+0000","last_fullsized":"2023-08-17T17:49:19.692372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695605+0000","last_change":"2023-08-17T17:49:19.687375+0000","last_active":"2023-08-17T17:49:19.695605+0000","last_peered":"2023-08-17T17:49:19.695605+0000","last_clean":"2023-08-17T17:49:19.695605+0000","last_became_active":"2023-08-17T17:49:19.687084+0000","last_became_peered":"2023-08-17T17:49:19.687084+0000","last_unstale":"2023-08-17T17:49:19.695605+0000","last_undegraded":"2023-08-17T17:49:19.695605+0000","last_fullsized":"2023-08-17T17:49:19.695605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.687570+0000","last_change":"2023-08-17T17:49:19.335235+0000","last_active":"2023-08-17T17:49:19.687570+0000","last_peered":"2023-08-17T17:49:19.687570+0000","last_clean":"2023-08-17T17:49:19.687570+0000","last_became_active":"2023-08-17T17:49:19.334926+0000","last_became_peered":"2023-08-17T17:49:19.334926+0000","last_unstale":"2023-08-17T17:49:19.687570+0000","last_undegraded":"2023-08-17T17:49:19.687570+0000","last_fullsized":"2023-08-17T17:49:19.687570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706545+0000","last_change":"2023-08-17T17:49:19.703178+0000","last_active":"2023-08-17T17:49:19.706545+0000","last_peered":"2023-08-17T17:49:19.706545+0000","last_clean":"2023-08-17T17:49:19.706545+0000","last_became_active":"2023-08-17T17:49:19.702906+0000","last_became_peered":"2023-08-17T17:49:19.702906+0000","last_unstale":"2023-08-17T17:49:19.706545+0000","last_undegraded":"2023-08-17T17:49:19.706545+0000","last_fullsized":"2023-08-17T17:49:19.706545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681958+0000","last_change":"2023-08-17T17:49:19.320286+0000","last_active":"2023-08-17T17:49:19.681958+0000","last_peered":"2023-08-17T17:49:19.681958+0000","last_clean":"2023-08-17T17:49:19.681958+0000","last_became_active":"2023-08-17T17:49:19.320004+0000","last_became_peered":"2023-08-17T17:49:19.320004+0000","last_unstale":"2023-08-17T17:49:19.681958+0000","last_undegraded":"2023-08-17T17:49:19.681958+0000","last_fullsized":"2023-08-17T17:49:19.681958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699164+0000","last_change":"2023-08-17T17:49:19.696763+0000","last_active":"2023-08-17T17:49:19.699164+0000","last_peered":"2023-08-17T17:49:19.699164+0000","last_clean":"2023-08-17T17:49:19.699164+0000","last_became_active":"2023-08-17T17:49:19.693241+0000","last_became_peered":"2023-08-17T17:49:19.693241+0000","last_unstale":"2023-08-17T17:49:19.699164+0000","last_undegraded":"2023-08-17T17:49:19.699164+0000","last_fullsized":"2023-08-17T17:49:19.699164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.682947+0000","last_change":"2023-08-17T17:49:19.325997+0000","last_active":"2023-08-17T17:49:19.682947+0000","last_peered":"2023-08-17T17:49:19.682947+0000","last_clean":"2023-08-17T17:49:19.682947+0000","last_became_active":"2023-08-17T17:49:19.325180+0000","last_became_peered":"2023-08-17T17:49:19.325180+0000","last_unstale":"2023-08-17T17:49:19.682947+0000","last_undegraded":"2023-08-17T17:49:19.682947+0000","last_fullsized":"2023-08-17T17:49:19.682947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697779+0000","last_change":"2023-08-17T17:49:19.693095+0000","last_active":"2023-08-17T17:49:19.697779+0000","last_peered":"2023-08-17T17:49:19.697779+0000","last_clean":"2023-08-17T17:49:19.697779+0000","last_became_active":"2023-08-17T17:49:19.692720+0000","last_became_peered":"2023-08-17T17:49:19.692720+0000","last_unstale":"2023-08-17T17:49:19.697779+0000","last_undegraded":"2023-08-17T17:49:19.697779+0000","last_fullsized":"2023-08-17T17:49:19.697779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.688656+0000","last_change":"2023-08-17T17:49:19.327881+0000","last_active":"2023-08-17T17:49:19.688656+0000","last_peered":"2023-08-17T17:49:19.688656+0000","last_clean":"2023-08-17T17:49:19.688656+0000","last_became_active":"2023-08-17T17:49:19.327652+0000","last_became_peered":"2023-08-17T17:49:19.327652+0000","last_unstale":"2023-08-17T17:49:19.688656+0000","last_undegraded":"2023-08-17T17:49:19.688656+0000","last_fullsized":"2023-08-17T17:49:19.688656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697873+0000","last_change":"2023-08-17T17:49:19.693081+0000","last_active":"2023-08-17T17:49:19.697873+0000","last_peered":"2023-08-17T17:49:19.697873+0000","last_clean":"2023-08-17T17:49:19.697873+0000","last_became_active":"2023-08-17T17:49:19.692808+0000","last_became_peered":"2023-08-17T17:49:19.692808+0000","last_unstale":"2023-08-17T17:49:19.697873+0000","last_undegraded":"2023-08-17T17:49:19.697873+0000","last_fullsized":"2023-08-17T17:49:19.697873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681842+0000","last_change":"2023-08-17T17:49:19.326742+0000","last_active":"2023-08-17T17:49:19.681842+0000","last_peered":"2023-08-17T17:49:19.681842+0000","last_clean":"2023-08-17T17:49:19.681842+0000","last_became_active":"2023-08-17T17:49:19.326380+0000","last_became_peered":"2023-08-17T17:49:19.326380+0000","last_unstale":"2023-08-17T17:49:19.681842+0000","last_undegraded":"2023-08-17T17:49:19.681842+0000","last_fullsized":"2023-08-17T17:49:19.681842+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695130+0000","last_change":"2023-08-17T17:49:19.692243+0000","last_active":"2023-08-17T17:49:19.695130+0000","last_peered":"2023-08-17T17:49:19.695130+0000","last_clean":"2023-08-17T17:49:19.695130+0000","last_became_active":"2023-08-17T17:49:19.692016+0000","last_became_peered":"2023-08-17T17:49:19.692016+0000","last_unstale":"2023-08-17T17:49:19.695130+0000","last_undegraded":"2023-08-17T17:49:19.695130+0000","last_fullsized":"2023-08-17T17:49:19.695130+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.683727+0000","last_change":"2023-08-17T17:49:19.329807+0000","last_active":"2023-08-17T17:49:19.683727+0000","last_peered":"2023-08-17T17:49:19.683727+0000","last_clean":"2023-08-17T17:49:19.683727+0000","last_became_active":"2023-08-17T17:49:19.329559+0000","last_became_peered":"2023-08-17T17:49:19.329559+0000","last_unstale":"2023-08-17T17:49:19.683727+0000","last_undegraded":"2023-08-17T17:49:19.683727+0000","last_fullsized":"2023-08-17T17:49:19.683727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696991+0000","last_change":"2023-08-17T17:49:19.690145+0000","last_active":"2023-08-17T17:49:19.696991+0000","last_peered":"2023-08-17T17:49:19.696991+0000","last_clean":"2023-08-17T17:49:19.696991+0000","last_became_active":"2023-08-17T17:49:19.689032+0000","last_became_peered":"2023-08-17T17:49:19.689032+0000","last_unstale":"2023-08-17T17:49:19.696991+0000","last_undegraded":"2023-08-17T17:49:19.696991+0000","last_fullsized":"2023-08-17T17:49:19.696991+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693405+0000","last_change":"2023-08-17T17:49:19.333863+0000","last_active":"2023-08-17T17:49:19.693405+0000","last_peered":"2023-08-17T17:49:19.693405+0000","last_clean":"2023-08-17T17:49:19.693405+0000","last_became_active":"2023-08-17T17:49:19.333293+0000","last_became_peered":"2023-08-17T17:49:19.333293+0000","last_unstale":"2023-08-17T17:49:19.693405+0000","last_undegraded":"2023-08-17T17:49:19.693405+0000","last_fullsized":"2023-08-17T17:49:19.693405+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.698088+0000","last_change":"2023-08-17T17:49:19.694448+0000","last_active":"2023-08-17T17:49:19.698088+0000","last_peered":"2023-08-17T17:49:19.698088+0000","last_clean":"2023-08-17T17:49:19.698088+0000","last_became_active":"2023-08-17T17:49:19.694151+0000","last_became_peered":"2023-08-17T17:49:19.694151+0000","last_unstale":"2023-08-17T17:49:19.698088+0000","last_undegraded":"2023-08-17T17:49:19.698088+0000","last_fullsized":"2023-08-17T17:49:19.698088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.682114+0000","last_change":"2023-08-17T17:49:19.320718+0000","last_active":"2023-08-17T17:49:19.682114+0000","last_peered":"2023-08-17T17:49:19.682114+0000","last_clean":"2023-08-17T17:49:19.682114+0000","last_became_active":"2023-08-17T17:49:19.320287+0000","last_became_peered":"2023-08-17T17:49:19.320287+0000","last_unstale":"2023-08-17T17:49:19.682114+0000","last_undegraded":"2023-08-17T17:49:19.682114+0000","last_fullsized":"2023-08-17T17:49:19.682114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.708121+0000","last_change":"2023-08-17T17:49:19.707216+0000","last_active":"2023-08-17T17:49:19.708121+0000","last_peered":"2023-08-17T17:49:19.708121+0000","last_clean":"2023-08-17T17:49:19.708121+0000","last_became_active":"2023-08-17T17:49:19.706916+0000","last_became_peered":"2023-08-17T17:49:19.706916+0000","last_unstale":"2023-08-17T17:49:19.708121+0000","last_undegraded":"2023-08-17T17:49:19.708121+0000","last_fullsized":"2023-08-17T17:49:19.708121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.688084+0000","last_change":"2023-08-17T17:49:19.319827+0000","last_active":"2023-08-17T17:49:19.688084+0000","last_peered":"2023-08-17T17:49:19.688084+0000","last_clean":"2023-08-17T17:49:19.688084+0000","last_became_active":"2023-08-17T17:49:19.319566+0000","last_became_peered":"2023-08-17T17:49:19.319566+0000","last_unstale":"2023-08-17T17:49:19.688084+0000","last_undegraded":"2023-08-17T17:49:19.688084+0000","last_fullsized":"2023-08-17T17:49:19.688084+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706059+0000","last_change":"2023-08-17T17:49:19.701268+0000","last_active":"2023-08-17T17:49:19.706059+0000","last_peered":"2023-08-17T17:49:19.706059+0000","last_clean":"2023-08-17T17:49:19.706059+0000","last_became_active":"2023-08-17T17:49:19.701002+0000","last_became_peered":"2023-08-17T17:49:19.701002+0000","last_unstale":"2023-08-17T17:49:19.706059+0000","last_undegraded":"2023-08-17T17:49:19.706059+0000","last_fullsized":"2023-08-17T17:49:19.706059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.693280+0000","last_change":"2023-08-17T17:49:19.323093+0000","last_active":"2023-08-17T17:49:19.693280+0000","last_peered":"2023-08-17T17:49:19.693280+0000","last_clean":"2023-08-17T17:49:19.693280+0000","last_became_active":"2023-08-17T17:49:19.322816+0000","last_became_peered":"2023-08-17T17:49:19.322816+0000","last_unstale":"2023-08-17T17:49:19.693280+0000","last_undegraded":"2023-08-17T17:49:19.693280+0000","last_fullsized":"2023-08-17T17:49:19.693280+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.699135+0000","last_change":"2023-08-17T17:49:19.696576+0000","last_active":"2023-08-17T17:49:19.699135+0000","last_peered":"2023-08-17T17:49:19.699135+0000","last_clean":"2023-08-17T17:49:19.699135+0000","last_became_active":"2023-08-17T17:49:19.696279+0000","last_became_peered":"2023-08-17T17:49:19.696279+0000","last_unstale":"2023-08-17T17:49:19.699135+0000","last_undegraded":"2023-08-17T17:49:19.699135+0000","last_fullsized":"2023-08-17T17:49:19.699135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696066+0000","last_change":"2023-08-17T17:49:19.330805+0000","last_active":"2023-08-17T17:49:19.696066+0000","last_peered":"2023-08-17T17:49:19.696066+0000","last_clean":"2023-08-17T17:49:19.696066+0000","last_became_active":"2023-08-17T17:49:19.330398+0000","last_became_peered":"2023-08-17T17:49:19.330398+0000","last_unstale":"2023-08-17T17:49:19.696066+0000","last_undegraded":"2023-08-17T17:49:19.696066+0000","last_fullsized":"2023-08-17T17:49:19.696066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695305+0000","last_change":"2023-08-17T17:49:19.691581+0000","last_active":"2023-08-17T17:49:19.695305+0000","last_peered":"2023-08-17T17:49:19.695305+0000","last_clean":"2023-08-17T17:49:19.695305+0000","last_became_active":"2023-08-17T17:49:19.691339+0000","last_became_peered":"2023-08-17T17:49:19.691339+0000","last_unstale":"2023-08-17T17:49:19.695305+0000","last_undegraded":"2023-08-17T17:49:19.695305+0000","last_fullsized":"2023-08-17T17:49:19.695305+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.703129+0000","last_change":"2023-08-17T17:49:19.329057+0000","last_active":"2023-08-17T17:49:19.703129+0000","last_peered":"2023-08-17T17:49:19.703129+0000","last_clean":"2023-08-17T17:49:19.703129+0000","last_became_active":"2023-08-17T17:49:19.328426+0000","last_became_peered":"2023-08-17T17:49:19.328426+0000","last_unstale":"2023-08-17T17:49:19.703129+0000","last_undegraded":"2023-08-17T17:49:19.703129+0000","last_fullsized":"2023-08-17T17:49:19.703129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.703014+0000","last_change":"2023-08-17T17:49:19.699229+0000","last_active":"2023-08-17T17:49:19.703014+0000","last_peered":"2023-08-17T17:49:19.703014+0000","last_clean":"2023-08-17T17:49:19.703014+0000","last_became_active":"2023-08-17T17:49:19.698921+0000","last_became_peered":"2023-08-17T17:49:19.698921+0000","last_unstale":"2023-08-17T17:49:19.703014+0000","last_undegraded":"2023-08-17T17:49:19.703014+0000","last_fullsized":"2023-08-17T17:49:19.703014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.689040+0000","last_change":"2023-08-17T17:49:19.322832+0000","last_active":"2023-08-17T17:49:19.689040+0000","last_peered":"2023-08-17T17:49:19.689040+0000","last_clean":"2023-08-17T17:49:19.689040+0000","last_became_active":"2023-08-17T17:49:19.322554+0000","last_became_peered":"2023-08-17T17:49:19.322554+0000","last_unstale":"2023-08-17T17:49:19.689040+0000","last_undegraded":"2023-08-17T17:49:19.689040+0000","last_fullsized":"2023-08-17T17:49:19.689040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691034+0000","last_change":"2023-08-17T17:49:19.684718+0000","last_active":"2023-08-17T17:49:19.691034+0000","last_peered":"2023-08-17T17:49:19.691034+0000","last_clean":"2023-08-17T17:49:19.691034+0000","last_became_active":"2023-08-17T17:49:19.684444+0000","last_became_peered":"2023-08-17T17:49:19.684444+0000","last_unstale":"2023-08-17T17:49:19.691034+0000","last_undegraded":"2023-08-17T17:49:19.691034+0000","last_fullsized":"2023-08-17T17:49:19.691034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.683792+0000","last_change":"2023-08-17T17:49:19.326042+0000","last_active":"2023-08-17T17:49:19.683792+0000","last_peered":"2023-08-17T17:49:19.683792+0000","last_clean":"2023-08-17T17:49:19.683792+0000","last_became_active":"2023-08-17T17:49:19.325675+0000","last_became_peered":"2023-08-17T17:49:19.325675+0000","last_unstale":"2023-08-17T17:49:19.683792+0000","last_undegraded":"2023-08-17T17:49:19.683792+0000","last_fullsized":"2023-08-17T17:49:19.683792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696336+0000","last_change":"2023-08-17T17:49:19.691116+0000","last_active":"2023-08-17T17:49:19.696336+0000","last_peered":"2023-08-17T17:49:19.696336+0000","last_clean":"2023-08-17T17:49:19.696336+0000","last_became_active":"2023-08-17T17:49:19.690769+0000","last_became_peered":"2023-08-17T17:49:19.690769+0000","last_unstale":"2023-08-17T17:49:19.696336+0000","last_undegraded":"2023-08-17T17:49:19.696336+0000","last_fullsized":"2023-08-17T17:49:19.696336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684130+0000","last_change":"2023-08-17T17:49:19.319420+0000","last_active":"2023-08-17T17:49:19.684130+0000","last_peered":"2023-08-17T17:49:19.684130+0000","last_clean":"2023-08-17T17:49:19.684130+0000","last_became_active":"2023-08-17T17:49:19.319142+0000","last_became_peered":"2023-08-17T17:49:19.319142+0000","last_unstale":"2023-08-17T17:49:19.684130+0000","last_undegraded":"2023-08-17T17:49:19.684130+0000","last_fullsized":"2023-08-17T17:49:19.684130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.705755+0000","last_change":"2023-08-17T17:49:19.702158+0000","last_active":"2023-08-17T17:49:19.705755+0000","last_peered":"2023-08-17T17:49:19.705755+0000","last_clean":"2023-08-17T17:49:19.705755+0000","last_became_active":"2023-08-17T17:49:19.701889+0000","last_became_peered":"2023-08-17T17:49:19.701889+0000","last_unstale":"2023-08-17T17:49:19.705755+0000","last_undegraded":"2023-08-17T17:49:19.705755+0000","last_fullsized":"2023-08-17T17:49:19.705755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684131+0000","last_change":"2023-08-17T17:49:19.326823+0000","last_active":"2023-08-17T17:49:19.684131+0000","last_peered":"2023-08-17T17:49:19.684131+0000","last_clean":"2023-08-17T17:49:19.684131+0000","last_became_active":"2023-08-17T17:49:19.326542+0000","last_became_peered":"2023-08-17T17:49:19.326542+0000","last_unstale":"2023-08-17T17:49:19.684131+0000","last_undegraded":"2023-08-17T17:49:19.684131+0000","last_fullsized":"2023-08-17T17:49:19.684131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696850+0000","last_change":"2023-08-17T17:49:19.694817+0000","last_active":"2023-08-17T17:49:19.696850+0000","last_peered":"2023-08-17T17:49:19.696850+0000","last_clean":"2023-08-17T17:49:19.696850+0000","last_became_active":"2023-08-17T17:49:19.694557+0000","last_became_peered":"2023-08-17T17:49:19.694557+0000","last_unstale":"2023-08-17T17:49:19.696850+0000","last_undegraded":"2023-08-17T17:49:19.696850+0000","last_fullsized":"2023-08-17T17:49:19.696850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.687475+0000","last_change":"2023-08-17T17:49:19.334413+0000","last_active":"2023-08-17T17:49:19.687475+0000","last_peered":"2023-08-17T17:49:19.687475+0000","last_clean":"2023-08-17T17:49:19.687475+0000","last_became_active":"2023-08-17T17:49:19.334147+0000","last_became_peered":"2023-08-17T17:49:19.334147+0000","last_unstale":"2023-08-17T17:49:19.687475+0000","last_undegraded":"2023-08-17T17:49:19.687475+0000","last_fullsized":"2023-08-17T17:49:19.687475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696480+0000","last_change":"2023-08-17T17:49:19.686510+0000","last_active":"2023-08-17T17:49:19.696480+0000","last_peered":"2023-08-17T17:49:19.696480+0000","last_clean":"2023-08-17T17:49:19.696480+0000","last_became_active":"2023-08-17T17:49:19.686240+0000","last_became_peered":"2023-08-17T17:49:19.686240+0000","last_unstale":"2023-08-17T17:49:19.696480+0000","last_undegraded":"2023-08-17T17:49:19.696480+0000","last_fullsized":"2023-08-17T17:49:19.696480+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.691123+0000","last_change":"2023-08-17T17:49:19.338168+0000","last_active":"2023-08-17T17:49:19.691123+0000","last_peered":"2023-08-17T17:49:19.691123+0000","last_clean":"2023-08-17T17:49:19.691123+0000","last_became_active":"2023-08-17T17:49:19.337884+0000","last_became_peered":"2023-08-17T17:49:19.337884+0000","last_unstale":"2023-08-17T17:49:19.691123+0000","last_undegraded":"2023-08-17T17:49:19.691123+0000","last_fullsized":"2023-08-17T17:49:19.691123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696915+0000","last_change":"2023-08-17T17:49:19.693724+0000","last_active":"2023-08-17T17:49:19.696915+0000","last_peered":"2023-08-17T17:49:19.696915+0000","last_clean":"2023-08-17T17:49:19.696915+0000","last_became_active":"2023-08-17T17:49:19.693492+0000","last_became_peered":"2023-08-17T17:49:19.693492+0000","last_unstale":"2023-08-17T17:49:19.696915+0000","last_undegraded":"2023-08-17T17:49:19.696915+0000","last_fullsized":"2023-08-17T17:49:19.696915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684418+0000","last_change":"2023-08-17T17:49:19.329035+0000","last_active":"2023-08-17T17:49:19.684418+0000","last_peered":"2023-08-17T17:49:19.684418+0000","last_clean":"2023-08-17T17:49:19.684418+0000","last_became_active":"2023-08-17T17:49:19.328686+0000","last_became_peered":"2023-08-17T17:49:19.328686+0000","last_unstale":"2023-08-17T17:49:19.684418+0000","last_undegraded":"2023-08-17T17:49:19.684418+0000","last_fullsized":"2023-08-17T17:49:19.684418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.705753+0000","last_change":"2023-08-17T17:49:19.700364+0000","last_active":"2023-08-17T17:49:19.705753+0000","last_peered":"2023-08-17T17:49:19.705753+0000","last_clean":"2023-08-17T17:49:19.705753+0000","last_became_active":"2023-08-17T17:49:19.699817+0000","last_became_peered":"2023-08-17T17:49:19.699817+0000","last_unstale":"2023-08-17T17:49:19.705753+0000","last_undegraded":"2023-08-17T17:49:19.705753+0000","last_fullsized":"2023-08-17T17:49:19.705753+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"76'3","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706629+0000","last_change":"2023-08-17T17:49:19.336413+0000","last_active":"2023-08-17T17:49:19.706629+0000","last_peered":"2023-08-17T17:49:19.706629+0000","last_clean":"2023-08-17T17:49:19.706629+0000","last_became_active":"2023-08-17T17:49:19.335592+0000","last_became_peered":"2023-08-17T17:49:19.335592+0000","last_unstale":"2023-08-17T17:49:19.706629+0000","last_undegraded":"2023-08-17T17:49:19.706629+0000","last_fullsized":"2023-08-17T17:49:19.706629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695586+0000","last_change":"2023-08-17T17:49:19.693521+0000","last_active":"2023-08-17T17:49:19.695586+0000","last_peered":"2023-08-17T17:49:19.695586+0000","last_clean":"2023-08-17T17:49:19.695586+0000","last_became_active":"2023-08-17T17:49:19.692996+0000","last_became_peered":"2023-08-17T17:49:19.692996+0000","last_unstale":"2023-08-17T17:49:19.695586+0000","last_undegraded":"2023-08-17T17:49:19.695586+0000","last_fullsized":"2023-08-17T17:49:19.695586+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696616+0000","last_change":"2023-08-17T17:49:19.324642+0000","last_active":"2023-08-17T17:49:19.696616+0000","last_peered":"2023-08-17T17:49:19.696616+0000","last_clean":"2023-08-17T17:49:19.696616+0000","last_became_active":"2023-08-17T17:49:19.324327+0000","last_became_peered":"2023-08-17T17:49:19.324327+0000","last_unstale":"2023-08-17T17:49:19.696616+0000","last_undegraded":"2023-08-17T17:49:19.696616+0000","last_fullsized":"2023-08-17T17:49:19.696616+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706895+0000","last_change":"2023-08-17T17:49:19.706327+0000","last_active":"2023-08-17T17:49:19.706895+0000","last_peered":"2023-08-17T17:49:19.706895+0000","last_clean":"2023-08-17T17:49:19.706895+0000","last_became_active":"2023-08-17T17:49:19.705295+0000","last_became_peered":"2023-08-17T17:49:19.705295+0000","last_unstale":"2023-08-17T17:49:19.706895+0000","last_undegraded":"2023-08-17T17:49:19.706895+0000","last_fullsized":"2023-08-17T17:49:19.706895+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706377+0000","last_change":"2023-08-17T17:49:19.332436+0000","last_active":"2023-08-17T17:49:19.706377+0000","last_peered":"2023-08-17T17:49:19.706377+0000","last_clean":"2023-08-17T17:49:19.706377+0000","last_became_active":"2023-08-17T17:49:19.332146+0000","last_became_peered":"2023-08-17T17:49:19.332146+0000","last_unstale":"2023-08-17T17:49:19.706377+0000","last_undegraded":"2023-08-17T17:49:19.706377+0000","last_fullsized":"2023-08-17T17:49:19.706377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697708+0000","last_change":"2023-08-17T17:49:19.691991+0000","last_active":"2023-08-17T17:49:19.697708+0000","last_peered":"2023-08-17T17:49:19.697708+0000","last_clean":"2023-08-17T17:49:19.697708+0000","last_became_active":"2023-08-17T17:49:19.691732+0000","last_became_peered":"2023-08-17T17:49:19.691732+0000","last_unstale":"2023-08-17T17:49:19.697708+0000","last_undegraded":"2023-08-17T17:49:19.697708+0000","last_fullsized":"2023-08-17T17:49:19.697708+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681310+0000","last_change":"2023-08-17T17:49:19.325834+0000","last_active":"2023-08-17T17:49:19.681310+0000","last_peered":"2023-08-17T17:49:19.681310+0000","last_clean":"2023-08-17T17:49:19.681310+0000","last_became_active":"2023-08-17T17:49:19.325261+0000","last_became_peered":"2023-08-17T17:49:19.325261+0000","last_unstale":"2023-08-17T17:49:19.681310+0000","last_undegraded":"2023-08-17T17:49:19.681310+0000","last_fullsized":"2023-08-17T17:49:19.681310+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.705733+0000","last_change":"2023-08-17T17:49:19.700149+0000","last_active":"2023-08-17T17:49:19.705733+0000","last_peered":"2023-08-17T17:49:19.705733+0000","last_clean":"2023-08-17T17:49:19.705733+0000","last_became_active":"2023-08-17T17:49:19.699838+0000","last_became_peered":"2023-08-17T17:49:19.699838+0000","last_unstale":"2023-08-17T17:49:19.705733+0000","last_undegraded":"2023-08-17T17:49:19.705733+0000","last_fullsized":"2023-08-17T17:49:19.705733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692476+0000","last_change":"2023-08-17T17:49:19.336190+0000","last_active":"2023-08-17T17:49:19.692476+0000","last_peered":"2023-08-17T17:49:19.692476+0000","last_clean":"2023-08-17T17:49:19.692476+0000","last_became_active":"2023-08-17T17:49:19.335782+0000","last_became_peered":"2023-08-17T17:49:19.335782+0000","last_unstale":"2023-08-17T17:49:19.692476+0000","last_undegraded":"2023-08-17T17:49:19.692476+0000","last_fullsized":"2023-08-17T17:49:19.692476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700526+0000","last_change":"2023-08-17T17:49:19.696597+0000","last_active":"2023-08-17T17:49:19.700526+0000","last_peered":"2023-08-17T17:49:19.700526+0000","last_clean":"2023-08-17T17:49:19.700526+0000","last_became_active":"2023-08-17T17:49:19.696332+0000","last_became_peered":"2023-08-17T17:49:19.696332+0000","last_unstale":"2023-08-17T17:49:19.700526+0000","last_undegraded":"2023-08-17T17:49:19.700526+0000","last_fullsized":"2023-08-17T17:49:19.700526+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"76'4","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.705835+0000","last_change":"2023-08-17T17:49:19.329884+0000","last_active":"2023-08-17T17:49:19.705835+0000","last_peered":"2023-08-17T17:49:19.705835+0000","last_clean":"2023-08-17T17:49:19.705835+0000","last_became_active":"2023-08-17T17:49:19.329498+0000","last_became_peered":"2023-08-17T17:49:19.329498+0000","last_unstale":"2023-08-17T17:49:19.705835+0000","last_undegraded":"2023-08-17T17:49:19.705835+0000","last_fullsized":"2023-08-17T17:49:19.705835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700489+0000","last_change":"2023-08-17T17:49:19.697409+0000","last_active":"2023-08-17T17:49:19.700489+0000","last_peered":"2023-08-17T17:49:19.700489+0000","last_clean":"2023-08-17T17:49:19.700489+0000","last_became_active":"2023-08-17T17:49:19.697183+0000","last_became_peered":"2023-08-17T17:49:19.697183+0000","last_unstale":"2023-08-17T17:49:19.700489+0000","last_undegraded":"2023-08-17T17:49:19.700489+0000","last_fullsized":"2023-08-17T17:49:19.700489+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.702623+0000","last_change":"2023-08-17T17:49:19.334434+0000","last_active":"2023-08-17T17:49:19.702623+0000","last_peered":"2023-08-17T17:49:19.702623+0000","last_clean":"2023-08-17T17:49:19.702623+0000","last_became_active":"2023-08-17T17:49:19.334142+0000","last_became_peered":"2023-08-17T17:49:19.334142+0000","last_unstale":"2023-08-17T17:49:19.702623+0000","last_undegraded":"2023-08-17T17:49:19.702623+0000","last_fullsized":"2023-08-17T17:49:19.702623+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695612+0000","last_change":"2023-08-17T17:49:19.691035+0000","last_active":"2023-08-17T17:49:19.695612+0000","last_peered":"2023-08-17T17:49:19.695612+0000","last_clean":"2023-08-17T17:49:19.695612+0000","last_became_active":"2023-08-17T17:49:19.690605+0000","last_became_peered":"2023-08-17T17:49:19.690605+0000","last_unstale":"2023-08-17T17:49:19.695612+0000","last_undegraded":"2023-08-17T17:49:19.695612+0000","last_fullsized":"2023-08-17T17:49:19.695612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.683061+0000","last_change":"2023-08-17T17:49:19.326698+0000","last_active":"2023-08-17T17:49:19.683061+0000","last_peered":"2023-08-17T17:49:19.683061+0000","last_clean":"2023-08-17T17:49:19.683061+0000","last_became_active":"2023-08-17T17:49:19.326167+0000","last_became_peered":"2023-08-17T17:49:19.326167+0000","last_unstale":"2023-08-17T17:49:19.683061+0000","last_undegraded":"2023-08-17T17:49:19.683061+0000","last_fullsized":"2023-08-17T17:49:19.683061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.697760+0000","last_change":"2023-08-17T17:49:19.692710+0000","last_active":"2023-08-17T17:49:19.697760+0000","last_peered":"2023-08-17T17:49:19.697760+0000","last_clean":"2023-08-17T17:49:19.697760+0000","last_became_active":"2023-08-17T17:49:19.692379+0000","last_became_peered":"2023-08-17T17:49:19.692379+0000","last_unstale":"2023-08-17T17:49:19.697760+0000","last_undegraded":"2023-08-17T17:49:19.697760+0000","last_fullsized":"2023-08-17T17:49:19.697760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.688763+0000","last_change":"2023-08-17T17:49:19.329215+0000","last_active":"2023-08-17T17:49:19.688763+0000","last_peered":"2023-08-17T17:49:19.688763+0000","last_clean":"2023-08-17T17:49:19.688763+0000","last_became_active":"2023-08-17T17:49:19.328771+0000","last_became_peered":"2023-08-17T17:49:19.328771+0000","last_unstale":"2023-08-17T17:49:19.688763+0000","last_undegraded":"2023-08-17T17:49:19.688763+0000","last_fullsized":"2023-08-17T17:49:19.688763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.703714+0000","last_change":"2023-08-17T17:49:19.694579+0000","last_active":"2023-08-17T17:49:19.703714+0000","last_peered":"2023-08-17T17:49:19.703714+0000","last_clean":"2023-08-17T17:49:19.703714+0000","last_became_active":"2023-08-17T17:49:19.694271+0000","last_became_peered":"2023-08-17T17:49:19.694271+0000","last_unstale":"2023-08-17T17:49:19.703714+0000","last_undegraded":"2023-08-17T17:49:19.703714+0000","last_fullsized":"2023-08-17T17:49:19.703714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.677519+0000","last_change":"2023-08-17T17:49:19.324396+0000","last_active":"2023-08-17T17:49:19.677519+0000","last_peered":"2023-08-17T17:49:19.677519+0000","last_clean":"2023-08-17T17:49:19.677519+0000","last_became_active":"2023-08-17T17:49:19.324119+0000","last_became_peered":"2023-08-17T17:49:19.324119+0000","last_unstale":"2023-08-17T17:49:19.677519+0000","last_undegraded":"2023-08-17T17:49:19.677519+0000","last_fullsized":"2023-08-17T17:49:19.677519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.705609+0000","last_change":"2023-08-17T17:49:19.695903+0000","last_active":"2023-08-17T17:49:19.705609+0000","last_peered":"2023-08-17T17:49:19.705609+0000","last_clean":"2023-08-17T17:49:19.705609+0000","last_became_active":"2023-08-17T17:49:19.695703+0000","last_became_peered":"2023-08-17T17:49:19.695703+0000","last_unstale":"2023-08-17T17:49:19.705609+0000","last_undegraded":"2023-08-17T17:49:19.705609+0000","last_fullsized":"2023-08-17T17:49:19.705609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692758+0000","last_change":"2023-08-17T17:49:19.336789+0000","last_active":"2023-08-17T17:49:19.692758+0000","last_peered":"2023-08-17T17:49:19.692758+0000","last_clean":"2023-08-17T17:49:19.692758+0000","last_became_active":"2023-08-17T17:49:19.335638+0000","last_became_peered":"2023-08-17T17:49:19.335638+0000","last_unstale":"2023-08-17T17:49:19.692758+0000","last_undegraded":"2023-08-17T17:49:19.692758+0000","last_fullsized":"2023-08-17T17:49:19.692758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706626+0000","last_change":"2023-08-17T17:49:19.705699+0000","last_active":"2023-08-17T17:49:19.706626+0000","last_peered":"2023-08-17T17:49:19.706626+0000","last_clean":"2023-08-17T17:49:19.706626+0000","last_became_active":"2023-08-17T17:49:19.704548+0000","last_became_peered":"2023-08-17T17:49:19.704548+0000","last_unstale":"2023-08-17T17:49:19.706626+0000","last_undegraded":"2023-08-17T17:49:19.706626+0000","last_fullsized":"2023-08-17T17:49:19.706626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684195+0000","last_change":"2023-08-17T17:49:19.323231+0000","last_active":"2023-08-17T17:49:19.684195+0000","last_peered":"2023-08-17T17:49:19.684195+0000","last_clean":"2023-08-17T17:49:19.684195+0000","last_became_active":"2023-08-17T17:49:19.322950+0000","last_became_peered":"2023-08-17T17:49:19.322950+0000","last_unstale":"2023-08-17T17:49:19.684195+0000","last_undegraded":"2023-08-17T17:49:19.684195+0000","last_fullsized":"2023-08-17T17:49:19.684195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.696841+0000","last_change":"2023-08-17T17:49:19.693994+0000","last_active":"2023-08-17T17:49:19.696841+0000","last_peered":"2023-08-17T17:49:19.696841+0000","last_clean":"2023-08-17T17:49:19.696841+0000","last_became_active":"2023-08-17T17:49:19.693700+0000","last_became_peered":"2023-08-17T17:49:19.693700+0000","last_unstale":"2023-08-17T17:49:19.696841+0000","last_undegraded":"2023-08-17T17:49:19.696841+0000","last_fullsized":"2023-08-17T17:49:19.696841+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684229+0000","last_change":"2023-08-17T17:49:19.326736+0000","last_active":"2023-08-17T17:49:19.684229+0000","last_peered":"2023-08-17T17:49:19.684229+0000","last_clean":"2023-08-17T17:49:19.684229+0000","last_became_active":"2023-08-17T17:49:19.326484+0000","last_became_peered":"2023-08-17T17:49:19.326484+0000","last_unstale":"2023-08-17T17:49:19.684229+0000","last_undegraded":"2023-08-17T17:49:19.684229+0000","last_fullsized":"2023-08-17T17:49:19.684229+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.700719+0000","last_change":"2023-08-17T17:49:19.697399+0000","last_active":"2023-08-17T17:49:19.700719+0000","last_peered":"2023-08-17T17:49:19.700719+0000","last_clean":"2023-08-17T17:49:19.700719+0000","last_became_active":"2023-08-17T17:49:19.697168+0000","last_became_peered":"2023-08-17T17:49:19.697168+0000","last_unstale":"2023-08-17T17:49:19.700719+0000","last_undegraded":"2023-08-17T17:49:19.700719+0000","last_fullsized":"2023-08-17T17:49:19.700719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.677107+0000","last_change":"2023-08-17T17:49:19.327542+0000","last_active":"2023-08-17T17:49:19.677107+0000","last_peered":"2023-08-17T17:49:19.677107+0000","last_clean":"2023-08-17T17:49:19.677107+0000","last_became_active":"2023-08-17T17:49:19.327106+0000","last_became_peered":"2023-08-17T17:49:19.327106+0000","last_unstale":"2023-08-17T17:49:19.677107+0000","last_undegraded":"2023-08-17T17:49:19.677107+0000","last_fullsized":"2023-08-17T17:49:19.677107+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.708109+0000","last_change":"2023-08-17T17:49:19.707215+0000","last_active":"2023-08-17T17:49:19.708109+0000","last_peered":"2023-08-17T17:49:19.708109+0000","last_clean":"2023-08-17T17:49:19.708109+0000","last_became_active":"2023-08-17T17:49:19.706948+0000","last_became_peered":"2023-08-17T17:49:19.706948+0000","last_unstale":"2023-08-17T17:49:19.708109+0000","last_undegraded":"2023-08-17T17:49:19.708109+0000","last_fullsized":"2023-08-17T17:49:19.708109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.702940+0000","last_change":"2023-08-17T17:49:19.326553+0000","last_active":"2023-08-17T17:49:19.702940+0000","last_peered":"2023-08-17T17:49:19.702940+0000","last_clean":"2023-08-17T17:49:19.702940+0000","last_became_active":"2023-08-17T17:49:19.326246+0000","last_became_peered":"2023-08-17T17:49:19.326246+0000","last_unstale":"2023-08-17T17:49:19.702940+0000","last_undegraded":"2023-08-17T17:49:19.702940+0000","last_fullsized":"2023-08-17T17:49:19.702940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.677415+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:49:19.677415+0000","last_peered":"2023-08-17T17:49:19.677415+0000","last_clean":"2023-08-17T17:49:19.677415+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:49:19.677415+0000","last_undegraded":"2023-08-17T17:49:19.677415+0000","last_fullsized":"2023-08-17T17:49:19.677415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.701749+0000","last_change":"2023-08-17T17:49:19.691614+0000","last_active":"2023-08-17T17:49:19.701749+0000","last_peered":"2023-08-17T17:49:19.701749+0000","last_clean":"2023-08-17T17:49:19.701749+0000","last_became_active":"2023-08-17T17:49:19.691423+0000","last_became_peered":"2023-08-17T17:49:19.691423+0000","last_unstale":"2023-08-17T17:49:19.701749+0000","last_undegraded":"2023-08-17T17:49:19.701749+0000","last_fullsized":"2023-08-17T17:49:19.701749+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.688010+0000","last_change":"2023-08-17T17:49:19.330639+0000","last_active":"2023-08-17T17:49:19.688010+0000","last_peered":"2023-08-17T17:49:19.688010+0000","last_clean":"2023-08-17T17:49:19.688010+0000","last_became_active":"2023-08-17T17:49:19.330350+0000","last_became_peered":"2023-08-17T17:49:19.330350+0000","last_unstale":"2023-08-17T17:49:19.688010+0000","last_undegraded":"2023-08-17T17:49:19.688010+0000","last_fullsized":"2023-08-17T17:49:19.688010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681492+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:49:19.681492+0000","last_peered":"2023-08-17T17:49:19.681492+0000","last_clean":"2023-08-17T17:49:19.681492+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:49:19.681492+0000","last_undegraded":"2023-08-17T17:49:19.681492+0000","last_fullsized":"2023-08-17T17:49:19.681492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692437+0000","last_change":"2023-08-17T17:49:19.686082+0000","last_active":"2023-08-17T17:49:19.692437+0000","last_peered":"2023-08-17T17:49:19.692437+0000","last_clean":"2023-08-17T17:49:19.692437+0000","last_became_active":"2023-08-17T17:49:19.685741+0000","last_became_peered":"2023-08-17T17:49:19.685741+0000","last_unstale":"2023-08-17T17:49:19.692437+0000","last_undegraded":"2023-08-17T17:49:19.692437+0000","last_fullsized":"2023-08-17T17:49:19.692437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.681414+0000","last_change":"2023-08-17T17:49:19.326004+0000","last_active":"2023-08-17T17:49:19.681414+0000","last_peered":"2023-08-17T17:49:19.681414+0000","last_clean":"2023-08-17T17:49:19.681414+0000","last_became_active":"2023-08-17T17:49:19.325565+0000","last_became_peered":"2023-08-17T17:49:19.325565+0000","last_unstale":"2023-08-17T17:49:19.681414+0000","last_undegraded":"2023-08-17T17:49:19.681414+0000","last_fullsized":"2023-08-17T17:49:19.681414+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.682136+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:49:19.682136+0000","last_peered":"2023-08-17T17:49:19.682136+0000","last_clean":"2023-08-17T17:49:19.682136+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:49:19.682136+0000","last_undegraded":"2023-08-17T17:49:19.682136+0000","last_fullsized":"2023-08-17T17:49:19.682136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706140+0000","last_change":"2023-08-17T17:49:19.704608+0000","last_active":"2023-08-17T17:49:19.706140+0000","last_peered":"2023-08-17T17:49:19.706140+0000","last_clean":"2023-08-17T17:49:19.706140+0000","last_became_active":"2023-08-17T17:49:19.704055+0000","last_became_peered":"2023-08-17T17:49:19.704055+0000","last_unstale":"2023-08-17T17:49:19.706140+0000","last_undegraded":"2023-08-17T17:49:19.706140+0000","last_fullsized":"2023-08-17T17:49:19.706140+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.683874+0000","last_change":"2023-08-17T17:49:19.323676+0000","last_active":"2023-08-17T17:49:19.683874+0000","last_peered":"2023-08-17T17:49:19.683874+0000","last_clean":"2023-08-17T17:49:19.683874+0000","last_became_active":"2023-08-17T17:49:19.323413+0000","last_became_peered":"2023-08-17T17:49:19.323413+0000","last_unstale":"2023-08-17T17:49:19.683874+0000","last_undegraded":"2023-08-17T17:49:19.683874+0000","last_fullsized":"2023-08-17T17:49:19.683874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.683157+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:49:19.683157+0000","last_peered":"2023-08-17T17:49:19.683157+0000","last_clean":"2023-08-17T17:49:19.683157+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:49:19.683157+0000","last_undegraded":"2023-08-17T17:49:19.683157+0000","last_fullsized":"2023-08-17T17:49:19.683157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":57,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.692650+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:49:19.692650+0000","last_peered":"2023-08-17T17:49:19.692650+0000","last_clean":"2023-08-17T17:49:19.692650+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:49:19.692650+0000","last_undegraded":"2023-08-17T17:49:19.692650+0000","last_fullsized":"2023-08-17T17:49:19.692650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695989+0000","last_change":"2023-08-17T17:49:19.692902+0000","last_active":"2023-08-17T17:49:19.695989+0000","last_peered":"2023-08-17T17:49:19.695989+0000","last_clean":"2023-08-17T17:49:19.695989+0000","last_became_active":"2023-08-17T17:49:19.691771+0000","last_became_peered":"2023-08-17T17:49:19.691771+0000","last_unstale":"2023-08-17T17:49:19.695989+0000","last_undegraded":"2023-08-17T17:49:19.695989+0000","last_fullsized":"2023-08-17T17:49:19.695989+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.705328+0000","last_change":"2023-08-17T17:49:19.327899+0000","last_active":"2023-08-17T17:49:19.705328+0000","last_peered":"2023-08-17T17:49:19.705328+0000","last_clean":"2023-08-17T17:49:19.705328+0000","last_became_active":"2023-08-17T17:49:19.327616+0000","last_became_peered":"2023-08-17T17:49:19.327616+0000","last_unstale":"2023-08-17T17:49:19.705328+0000","last_undegraded":"2023-08-17T17:49:19.705328+0000","last_fullsized":"2023-08-17T17:49:19.705328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695757+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:49:19.695757+0000","last_peered":"2023-08-17T17:49:19.695757+0000","last_clean":"2023-08-17T17:49:19.695757+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:49:19.695757+0000","last_undegraded":"2023-08-17T17:49:19.695757+0000","last_fullsized":"2023-08-17T17:49:19.695757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.705767+0000","last_change":"2023-08-17T17:49:19.700688+0000","last_active":"2023-08-17T17:49:19.705767+0000","last_peered":"2023-08-17T17:49:19.705767+0000","last_clean":"2023-08-17T17:49:19.705767+0000","last_became_active":"2023-08-17T17:49:19.700158+0000","last_became_peered":"2023-08-17T17:49:19.700158+0000","last_unstale":"2023-08-17T17:49:19.705767+0000","last_undegraded":"2023-08-17T17:49:19.705767+0000","last_fullsized":"2023-08-17T17:49:19.705767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.706913+0000","last_change":"2023-08-17T17:49:19.335888+0000","last_active":"2023-08-17T17:49:19.706913+0000","last_peered":"2023-08-17T17:49:19.706913+0000","last_clean":"2023-08-17T17:49:19.706913+0000","last_became_active":"2023-08-17T17:49:19.335473+0000","last_became_peered":"2023-08-17T17:49:19.335473+0000","last_unstale":"2023-08-17T17:49:19.706913+0000","last_undegraded":"2023-08-17T17:49:19.706913+0000","last_fullsized":"2023-08-17T17:49:19.706913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.687362+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:49:19.687362+0000","last_peered":"2023-08-17T17:49:19.687362+0000","last_clean":"2023-08-17T17:49:19.687362+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:49:19.687362+0000","last_undegraded":"2023-08-17T17:49:19.687362+0000","last_fullsized":"2023-08-17T17:49:19.687362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.695617+0000","last_change":"2023-08-17T17:49:19.693028+0000","last_active":"2023-08-17T17:49:19.695617+0000","last_peered":"2023-08-17T17:49:19.695617+0000","last_clean":"2023-08-17T17:49:19.695617+0000","last_became_active":"2023-08-17T17:49:19.692600+0000","last_became_peered":"2023-08-17T17:49:19.692600+0000","last_unstale":"2023-08-17T17:49:19.695617+0000","last_undegraded":"2023-08-17T17:49:19.695617+0000","last_fullsized":"2023-08-17T17:49:19.695617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.688090+0000","last_change":"2023-08-17T17:49:19.336579+0000","last_active":"2023-08-17T17:49:19.688090+0000","last_peered":"2023-08-17T17:49:19.688090+0000","last_clean":"2023-08-17T17:49:19.688090+0000","last_became_active":"2023-08-17T17:49:19.336142+0000","last_became_peered":"2023-08-17T17:49:19.336142+0000","last_unstale":"2023-08-17T17:49:19.688090+0000","last_undegraded":"2023-08-17T17:49:19.688090+0000","last_fullsized":"2023-08-17T17:49:19.688090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.677731+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:49:19.677731+0000","last_peered":"2023-08-17T17:49:19.677731+0000","last_clean":"2023-08-17T17:49:19.677731+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:49:19.677731+0000","last_undegraded":"2023-08-17T17:49:19.677731+0000","last_fullsized":"2023-08-17T17:49:19.677731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.701741+0000","last_change":"2023-08-17T17:49:19.692672+0000","last_active":"2023-08-17T17:49:19.701741+0000","last_peered":"2023-08-17T17:49:19.701741+0000","last_clean":"2023-08-17T17:49:19.701741+0000","last_became_active":"2023-08-17T17:49:19.692387+0000","last_became_peered":"2023-08-17T17:49:19.692387+0000","last_unstale":"2023-08-17T17:49:19.701741+0000","last_undegraded":"2023-08-17T17:49:19.701741+0000","last_fullsized":"2023-08-17T17:49:19.701741+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:19.301191+0000","last_clean_scrub_stamp":"2023-08-17T17:49:19.301191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.684519+0000","last_change":"2023-08-17T17:49:19.325361+0000","last_active":"2023-08-17T17:49:19.684519+0000","last_peered":"2023-08-17T17:49:19.684519+0000","last_clean":"2023-08-17T17:49:19.684519+0000","last_became_active":"2023-08-17T17:49:19.325094+0000","last_became_peered":"2023-08-17T17:49:19.325094+0000","last_unstale":"2023-08-17T17:49:19.684519+0000","last_undegraded":"2023-08-17T17:49:19.684519+0000","last_fullsized":"2023-08-17T17:49:19.684519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:18.296114+0000","last_clean_scrub_stamp":"2023-08-17T17:49:18.296114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-17T17:49:19.688116+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:49:19.688116+0000","last_peered":"2023-08-17T17:49:19.688116+0000","last_clean":"2023-08-17T17:49:19.688116+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:49:19.688116+0000","last_undegraded":"2023-08-17T17:49:19.688116+0000","last_fullsized":"2023-08-17T17:49:19.688116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":942080,"data_stored":457180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.28999999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.745,"5min":0.78100000000000003,"15min":0.80000000000000004},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.32600000000000001,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.48199999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":0.80100000000000005,"15min":0.85499999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.34499999999999997,"5min":0.34000000000000002,"15min":0.26300000000000001},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.372,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.72799999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.746},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575030,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302104,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069736,"statfs":{"total":96636764160,"available":96327409664,"internally_reserved":0,"allocated":933888,"data_stored":456198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.436,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.46100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.33000000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.498},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.745,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84599999999999997,"5min":0.879,"15min":1.0609999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.377},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.498,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.32700000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68200000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.34200000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.77300000000000002,"15min":1.026},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.58799999999999997,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":1.51,"15min":1.51},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Aug 17 17:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.74399999999999999,"5min":0.872,"15min":1.0740000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.79900000000000004},"last":0.79600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":946176,"data_stored":456920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.34699999999999998},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.371},"min":{"1min":0.28899999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53800000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.36199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.22800000000000001},"max":{"1min":0.47599999999999998,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41199999999999998,"15min":0.40699999999999997},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.56899999999999995,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.61399999999999999,"5min":0.625,"15min":0.66600000000000004},"last":0.378},{"interface":"front","average":{"1min":0.442,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.35499999999999998,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.59199999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.317}]},{"osd":4,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.46600000000000003,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.624,"15min":0.61699999999999999},"min":{"1min":0.51000000000000001,"5min":0.39500000000000002,"15min":0.39000000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.63}]},{"osd":5,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63900000000000001,"15min":0.623},"min":{"1min":0.497,"5min":0.39700000000000002,"15min":0.34399999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.331},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.66100000000000003,"15min":0.63200000000000001},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.54800000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.345},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.39800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.68700000000000006,"15min":0.65700000000000003},"min":{"1min":0.59799999999999998,"5min":0.42399999999999999,"15min":0.40899999999999997},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.68700000000000006,"15min":0.65800000000000003},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.41199999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.71299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298004,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073836,"statfs":{"total":96636764160,"available":96331608064,"internally_reserved":0,"allocated":929792,"data_stored":456164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.23400000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.54000000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.23899999999999999,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.66200000000000003},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36099999999999999,"15min":0.36399999999999999},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46300000000000002,"5min":0.54100000000000004,"15min":0.60099999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40300000000000002},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51500000000000001,"5min":0.58199999999999996,"15min":0.65200000000000002},"last":0.372}]},{"osd":3,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.32500000000000001,"5min":0.26600000000000001,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.55400000000000005,"15min":0.66200000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40899999999999997,"15min":0.40999999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.52700000000000002,"5min":0.56999999999999995,"15min":0.65700000000000003},"last":0.315}]},{"osd":4,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.90000000000000002,"15min":1.3300000000000001},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.63400000000000001,"15min":0.61499999999999999},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.391},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.71799999999999997,"15min":0.67400000000000004},"min":{"1min":0.53200000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.6109999999999998,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":0.997,"15min":1.544},"last":0.435}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":456788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.372},"min":{"1min":0.28899999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54100000000000004,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.60799999999999998,"5min":1.268,"15min":1.268},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40300000000000002,"15min":0.40000000000000002},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.222},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.46999999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64800000000000002,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.51,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.622},"min":{"1min":0.49399999999999999,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.63300000000000001},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.5509999999999999,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.751}]},{"osd":6,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.627,"15min":0.60699999999999998},"min":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.39700000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.53200000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:48:41 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70199999999999996,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3859999999999999,"5min":2.984,"15min":2.984},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.48899999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":456788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.191},"max":{"1min":0.48399999999999999,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.249},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38,"15min":0.376},"min":{"1min":0.255,"5min":0.25,"15min":0.224},"max":{"1min":0.53200000000000003,"5min":0.60599999999999998,"15min":0.71799999999999997},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38100000000000001,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.215},"max":{"1min":0.57599999999999996,"5min":0.61099999999999999,"15min":0.73799999999999999},"last":0.312},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39600000000000002,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.22600000000000001},"max":{"1min":0.51600000000000001,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"min":{"1min":0.30599999999999999,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41299999999999998},"min":{"1min":0.35999999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.71099999999999997},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.45400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.89000000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.272,"5min":1.272,"15min":2.1309999999999998},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.38100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.443,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.65400000000000003,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.65700000000000003,"15min":0.63600000000000001},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Aug 17 17:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.66600000000000004,"15min":0.65000000000000002},"min":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.504},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.55100000000000005,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":1.014,"5min":1.016,"15min":2.1669999999999998},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":456808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.752,"5min":0.76900000000000002,"15min":0.89100000000000001},"last":0.44},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.504}]},{"osd":1,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.51200000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.84799999999999998},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.44800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76200000000000001,"5min":0.77900000000000003,"15min":0.80100000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.85699999999999998},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.34100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.39100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68000000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68899999999999995,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.627}]},{"osd":7,"last update":"Thu Aug 17 17:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":0.82199999999999995,"15min":0.91900000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77900000000000003,"5min":0.877,"15min":1.056},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":457078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.434,"5min":0.32900000000000001,"15min":0.27700000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.2609999999999999},"last":0.441},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.317,"15min":0.31},"max":{"1min":1.022,"5min":1.022,"15min":1.1499999999999999},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.242},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.29799999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.622,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.252},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.49299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.274},"last":0.433}]},{"osd":3,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.179},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.3080000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.35499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.75,"15min":1.0620000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":1.0740000000000001},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.42199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":1.01},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.44700000000000001,"5min":0.33300000000000002,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.77000000000000002,"15min":1.1020000000000001},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.79700000000000004,"5min":0.82299999999999995,"15min":1.038},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.498,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":1.1279999999999999},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:49:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T17:49:27.399 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T17:49:27.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.550+0000 7f7800964700 1 Processor -- start 2023-08-17T17:49:27.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.550+0000 7f7800964700 1 -- start start 2023-08-17T17:49:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f7800964700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77fc0c7e10 0x7f77fc0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f7800964700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc0c6970 con 0x7f77fc0c0f10 2023-08-17T17:49:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f7800964700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc0cac90 con 0x7f77fc154110 2023-08-17T17:49:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f7800964700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77fc0c6040 con 0x7f77fc0c7e10 2023-08-17T17:49:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77fad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77fc0c7e10 0x7f77fc0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77f9d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f77fc0c0f10 0x7f77fc0c9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35108/0 (socket says 172.21.15.78:35108) 2023-08-17T17:49:27.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77f9d9b700 1 -- 172.21.15.78:0/1828396303 learned_addr learned my addr 172.21.15.78:0/1828396303 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:27.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77fad9d700 1 -- 172.21.15.78:0/1828396303 >> v1:172.21.15.150:6789/0 conn(0x7f77fc154110 legacy=0x7f77fc0c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:27.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77fad9d700 1 -- 172.21.15.78:0/1828396303 >> v1:172.21.15.78:6789/0 conn(0x7f77fc0c0f10 legacy=0x7f77fc0c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77fad9d700 1 -- 172.21.15.78:0/1828396303 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0c6320 con 0x7f77fc0c7e10 2023-08-17T17:49:27.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77f959a700 1 -- 172.21.15.78:0/1828396303 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061780864 0 0) 0x7f77fc0c6970 con 0x7f77fc0c0f10 2023-08-17T17:49:27.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77fad9d700 1 --2- 172.21.15.78:0/1828396303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 0x7f77fc0ca650 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f77ec009760 tx=0x7f77ec009060).ready entity=mon.0 client_cookie=895bb566a2583b91 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:27.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77f959a700 1 -- 172.21.15.78:0/1828396303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00b520 con 0x7f77fc0c7e10 2023-08-17T17:49:27.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77f959a700 1 -- 172.21.15.78:0/1828396303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec00b680 con 0x7f77fc0c7e10 2023-08-17T17:49:27.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.551+0000 7f77f959a700 1 -- 172.21.15.78:0/1828396303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00ba00 con 0x7f77fc0c7e10 2023-08-17T17:49:27.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.552+0000 7f7800964700 1 -- 172.21.15.78:0/1828396303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 msgr2=0x7f77fc0ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.552+0000 7f7800964700 1 --2- 172.21.15.78:0/1828396303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 0x7f77fc0ca650 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f77ec009760 tx=0x7f77ec009060).stop 2023-08-17T17:49:27.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.552+0000 7f7800964700 1 -- 172.21.15.78:0/1828396303 shutdown_connections 2023-08-17T17:49:27.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.552+0000 7f7800964700 1 --2- 172.21.15.78:0/1828396303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 0x7f77fc0ca650 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.552+0000 7f7800964700 1 -- 172.21.15.78:0/1828396303 >> 172.21.15.78:0/1828396303 conn(0x7f77fc094650 msgr2=0x7f77fc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:27.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.552+0000 7f7800964700 1 -- 172.21.15.78:0/1828396303 shutdown_connections 2023-08-17T17:49:27.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.552+0000 7f7800964700 1 -- 172.21.15.78:0/1828396303 wait complete. 2023-08-17T17:49:27.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.553+0000 7f7800964700 1 Processor -- start 2023-08-17T17:49:27.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.553+0000 7f7800964700 1 -- start start 2023-08-17T17:49:27.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f7800964700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77fc0c0f10 0x7f77fc14dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f7800964700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 0x7f77fc151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f7800964700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77fc154110 0x7f77fc063190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f7800964700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc153050 con 0x7f77fc0c7e10 2023-08-17T17:49:27.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f7800964700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc095bc0 con 0x7f77fc154110 2023-08-17T17:49:27.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f7800964700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc095e80 con 0x7f77fc0c0f10 2023-08-17T17:49:27.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77f9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 0x7f77fc151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77f9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 0x7f77fc151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56664/0 (socket says 172.21.15.78:56664) 2023-08-17T17:49:27.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77f9d9b700 1 -- 172.21.15.78:0/251925503 learned_addr learned my addr 172.21.15.78:0/251925503 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:27.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77fad9d700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77fc154110 0x7f77fc063190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77fa59c700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77fc0c0f10 0x7f77fc14dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77f9d9b700 1 -- 172.21.15.78:0/251925503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77fc0c0f10 msgr2=0x7f77fc14dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77f9d9b700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77fc0c0f10 0x7f77fc14dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77f9d9b700 1 -- 172.21.15.78:0/251925503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77fc154110 msgr2=0x7f77fc063190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77f9d9b700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77fc154110 0x7f77fc063190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77f9d9b700 1 -- 172.21.15.78:0/251925503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec0092a0 con 0x7f77fc0c7e10 2023-08-17T17:49:27.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77fa59c700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77fc0c0f10 0x7f77fc14dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:27.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.554+0000 7f77f9d9b700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 0x7f77fc151f10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f77e400c4a0 tx=0x7f77e4007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:27.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.555+0000 7f77f27fc700 1 -- 172.21.15.78:0/251925503 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40072e0 con 0x7f77fc0c7e10 2023-08-17T17:49:27.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.555+0000 7f77f27fc700 1 -- 172.21.15.78:0/251925503 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e4007440 con 0x7f77fc0c7e10 2023-08-17T17:49:27.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.555+0000 7f7800964700 1 -- 172.21.15.78:0/251925503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc1527b0 con 0x7f77fc0c7e10 2023-08-17T17:49:27.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.555+0000 7f77f27fc700 1 -- 172.21.15.78:0/251925503 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40057a0 con 0x7f77fc0c7e10 2023-08-17T17:49:27.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.555+0000 7f7800964700 1 -- 172.21.15.78:0/251925503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc152d70 con 0x7f77fc0c7e10 2023-08-17T17:49:27.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.556+0000 7f7800964700 1 -- 172.21.15.78:0/251925503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77fc0b0fc0 con 0x7f77fc0c7e10 2023-08-17T17:49:27.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.556+0000 7f77f27fc700 1 -- 172.21.15.78:0/251925503 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f77e4010070 con 0x7f77fc0c7e10 2023-08-17T17:49:27.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.556+0000 7f77f27fc700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77dc05ed90 0x7f77dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.556+0000 7f77f27fc700 1 -- 172.21.15.78:0/251925503 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f77e4079200 con 0x7f77fc0c7e10 2023-08-17T17:49:27.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.556+0000 7f77fa59c700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77dc05ed90 0x7f77dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.557+0000 7f77fa59c700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77dc05ed90 0x7f77dc061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f77f4007b00 tx=0x7f77f4008040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:27.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.560+0000 7f77f27fc700 1 -- 172.21.15.78:0/251925503 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77e404a7a0 con 0x7f77fc0c7e10 2023-08-17T17:49:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.787+0000 7f7800964700 1 -- 172.21.15.78:0/251925503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f77fc047350 con 0x7f77fc0c7e10 2023-08-17T17:49:27.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.791+0000 7f77f27fc700 1 -- 172.21.15.78:0/251925503 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f77e404ddc0 con 0x7f77fc0c7e10 2023-08-17T17:49:27.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 -- 172.21.15.78:0/251925503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77dc05ed90 msgr2=0x7f77dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77dc05ed90 0x7f77dc061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f77f4007b00 tx=0x7f77f4008040).stop 2023-08-17T17:49:27.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 -- 172.21.15.78:0/251925503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 msgr2=0x7f77fc151f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 0x7f77fc151f10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f77e400c4a0 tx=0x7f77e4007c30).stop 2023-08-17T17:49:27.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 -- 172.21.15.78:0/251925503 shutdown_connections 2023-08-17T17:49:27.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77dc05ed90 0x7f77dc061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77fc154110 0x7f77fc063190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77fc0c0f10 0x7f77fc14dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 --2- 172.21.15.78:0/251925503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77fc0c7e10 0x7f77fc151f10 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 -- 172.21.15.78:0/251925503 >> 172.21.15.78:0/251925503 conn(0x7f77fc094650 msgr2=0x7f77fc0b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:27.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 -- 172.21.15.78:0/251925503 shutdown_connections 2023-08-17T17:49:27.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.793+0000 7f7800964700 1 -- 172.21.15.78:0/251925503 wait complete. 2023-08-17T17:49:27.795 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-08-17T17:49:27.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:27.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.917+0000 7fbebea1b700 1 Processor -- start 2023-08-17T17:49:27.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.917+0000 7fbebea1b700 1 -- start start 2023-08-17T17:49:27.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebea1b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 0x7fbeb8063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebea1b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbeb80a8050 0x7fbeb80642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebea1b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb8063960 con 0x7fbeb80c01b0 2023-08-17T17:49:27.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebea1b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb8063030 con 0x7fbeb80a8050 2023-08-17T17:49:27.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebea1b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb8063310 con 0x7fbeb80a7bd0 2023-08-17T17:49:27.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebd218700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 0x7fbeb8063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebe21a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbeb80a8050 0x7fbeb80642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebd218700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 0x7fbeb8063df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:45572/0 (socket says 172.21.15.78:45572) 2023-08-17T17:49:27.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebe21a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbeb80a8050 0x7fbeb80642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:38810/0 (socket says 172.21.15.78:38810) 2023-08-17T17:49:27.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebd218700 1 -- 172.21.15.78:0/3142394644 learned_addr learned my addr 172.21.15.78:0/3142394644 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:27.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.918+0000 7fbebda19700 1 --1- 172.21.15.78:0/3142394644 >> v1:172.21.15.150:6789/0 conn(0x7fbeb80c01b0 0x7fbeb80c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:47412/0 (socket says 172.21.15.78:47412) 2023-08-17T17:49:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebe21a700 1 -- 172.21.15.78:0/3142394644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 msgr2=0x7fbeb8063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebe21a700 1 --2- 172.21.15.78:0/3142394644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 0x7fbeb8063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebe21a700 1 -- 172.21.15.78:0/3142394644 >> v1:172.21.15.150:6789/0 conn(0x7fbeb80c01b0 legacy=0x7fbeb80c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebca17700 1 -- 172.21.15.78:0/3142394644 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677680231 0 0) 0x7fbeb8063960 con 0x7fbeb80c01b0 2023-08-17T17:49:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebe21a700 1 -- 172.21.15.78:0/3142394644 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb80635f0 con 0x7fbeb80a8050 2023-08-17T17:49:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebd218700 1 --2- 172.21.15.78:0/3142394644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 0x7fbeb8063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebe21a700 1 --2- 172.21.15.78:0/3142394644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb80a8050 0x7fbeb80642e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fbeb0009760 tx=0x7fbeb0009060).ready entity=mon.1 client_cookie=7c3ef88423616b7e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebca17700 1 -- 172.21.15.78:0/3142394644 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb000f510 con 0x7fbeb80a8050 2023-08-17T17:49:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebca17700 1 -- 172.21.15.78:0/3142394644 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb000f670 con 0x7fbeb80a8050 2023-08-17T17:49:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebca17700 1 -- 172.21.15.78:0/3142394644 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb000f9f0 con 0x7fbeb80a8050 2023-08-17T17:49:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebea1b700 1 -- 172.21.15.78:0/3142394644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb80a8050 msgr2=0x7fbeb80642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebea1b700 1 --2- 172.21.15.78:0/3142394644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb80a8050 0x7fbeb80642e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fbeb0009760 tx=0x7fbeb0009060).stop 2023-08-17T17:49:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebea1b700 1 -- 172.21.15.78:0/3142394644 shutdown_connections 2023-08-17T17:49:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebea1b700 1 --2- 172.21.15.78:0/3142394644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb80a8050 0x7fbeb80642e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebea1b700 1 --2- 172.21.15.78:0/3142394644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 0x7fbeb8063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.919+0000 7fbebea1b700 1 -- 172.21.15.78:0/3142394644 >> 172.21.15.78:0/3142394644 conn(0x7fbeb806a6c0 msgr2=0x7fbeb80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.920+0000 7fbebea1b700 1 -- 172.21.15.78:0/3142394644 shutdown_connections 2023-08-17T17:49:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.920+0000 7fbebea1b700 1 -- 172.21.15.78:0/3142394644 wait complete. 2023-08-17T17:49:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.921+0000 7fbebea1b700 1 Processor -- start 2023-08-17T17:49:27.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.921+0000 7fbebea1b700 1 -- start start 2023-08-17T17:49:27.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.921+0000 7fbebea1b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 0x7fbeb814cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.921+0000 7fbebea1b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeb80a8050 0x7fbeb8153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.921+0000 7fbebea1b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb80c01b0 0x7fbeb814d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.921+0000 7fbebea1b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb80b0050 con 0x7fbeb80a8050 2023-08-17T17:49:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.921+0000 7fbebea1b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb80aefb0 con 0x7fbeb80c01b0 2023-08-17T17:49:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.921+0000 7fbebea1b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb80af290 con 0x7fbeb80a7bd0 2023-08-17T17:49:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebd218700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeb80a8050 0x7fbeb8153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebd218700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeb80a8050 0x7fbeb8153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56678/0 (socket says 172.21.15.78:56678) 2023-08-17T17:49:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebd218700 1 -- 172.21.15.78:0/4149703115 learned_addr learned my addr 172.21.15.78:0/4149703115 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebe21a700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb80c01b0 0x7fbeb814d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebda19700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 0x7fbeb814cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebd218700 1 -- 172.21.15.78:0/4149703115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 msgr2=0x7fbeb814cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebd218700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 0x7fbeb814cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebd218700 1 -- 172.21.15.78:0/4149703115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb80c01b0 msgr2=0x7fbeb814d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebd218700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb80c01b0 0x7fbeb814d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebd218700 1 -- 172.21.15.78:0/4149703115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea8009370 con 0x7fbeb80a8050 2023-08-17T17:49:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebe21a700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb80c01b0 0x7fbeb814d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebd218700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeb80a8050 0x7fbeb8153090 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fbea800ea20 tx=0x7fbea80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbeadffb700 1 -- 172.21.15.78:0/4149703115 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea800c850 con 0x7fbeb80a8050 2023-08-17T17:49:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbeadffb700 1 -- 172.21.15.78:0/4149703115 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea800c9b0 con 0x7fbeb80a8050 2023-08-17T17:49:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebea1b700 1 -- 172.21.15.78:0/4149703115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb00092a0 con 0x7fbeb80a8050 2023-08-17T17:49:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbeadffb700 1 -- 172.21.15.78:0/4149703115 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea800cd30 con 0x7fbeb80a8050 2023-08-17T17:49:27.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.922+0000 7fbebea1b700 1 -- 172.21.15.78:0/4149703115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb80af620 con 0x7fbeb80a8050 2023-08-17T17:49:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.923+0000 7fbebea1b700 1 -- 172.21.15.78:0/4149703115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb8083af0 con 0x7fbeb80a8050 2023-08-17T17:49:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.923+0000 7fbeadffb700 1 -- 172.21.15.78:0/4149703115 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbea8022070 con 0x7fbeb80a8050 2023-08-17T17:49:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.924+0000 7fbeadffb700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbe9c05edc0 0x7fbe9c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.924+0000 7fbeadffb700 1 -- 172.21.15.78:0/4149703115 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbea807a020 con 0x7fbeb80a8050 2023-08-17T17:49:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.924+0000 7fbebda19700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbe9c05edc0 0x7fbe9c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:27.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.924+0000 7fbebda19700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbe9c05edc0 0x7fbe9c061280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbeb4007550 tx=0x7fbeb4005ad0).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:27.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:27.928+0000 7fbeadffb700 1 -- 172.21.15.78:0/4149703115 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbea804b5c0 con 0x7fbeb80a8050 2023-08-17T17:49:28.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.131+0000 7fbebea1b700 1 -- 172.21.15.78:0/4149703115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbeb80c63e0 con 0x7fbeb80a8050 2023-08-17T17:49:28.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.131+0000 7fbeadffb700 1 -- 172.21.15.78:0/4149703115 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fbea8016020 con 0x7fbeb80a8050 2023-08-17T17:49:28.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:28.132 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2895715400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2895715400},{"type":"v1","addr":"172.21.15.150:6834","nonce":2895715400}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1604940701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1604940701},{"type":"v1","addr":"172.21.15.78:6836","nonce":1604940701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6234,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1676496794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1676496794},{"type":"v1","addr":"172.21.15.78:6837","nonce":1676496794}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:19.673872+0000","modified":"2023-08-17T17:49:21.684217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6246":{"gid":6246,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3219133912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3219133912},{"type":"v1","addr":"172.21.15.150:6835","nonce":3219133912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T17:49:28.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 -- 172.21.15.78:0/4149703115 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbe9c05edc0 msgr2=0x7fbe9c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbe9c05edc0 0x7fbe9c061280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbeb4007550 tx=0x7fbeb4005ad0).stop 2023-08-17T17:49:28.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 -- 172.21.15.78:0/4149703115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeb80a8050 msgr2=0x7fbeb8153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeb80a8050 0x7fbeb8153090 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fbea800ea20 tx=0x7fbea80090f0).stop 2023-08-17T17:49:28.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 -- 172.21.15.78:0/4149703115 shutdown_connections 2023-08-17T17:49:28.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbe9c05edc0 0x7fbe9c061280 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeb80c01b0 0x7fbeb814d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeb80a7bd0 0x7fbeb814cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 --2- 172.21.15.78:0/4149703115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeb80a8050 0x7fbeb8153090 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 -- 172.21.15.78:0/4149703115 >> 172.21.15.78:0/4149703115 conn(0x7fbeb806a6c0 msgr2=0x7fbeb814ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:28.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 -- 172.21.15.78:0/4149703115 shutdown_connections 2023-08-17T17:49:28.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.133+0000 7fbebea1b700 1 -- 172.21.15.78:0/4149703115 wait complete. 2023-08-17T17:49:28.135 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 25 2023-08-17T17:49:28.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T17:49:19.673872+0000', 'modified': '2023-08-17T17:49:21.684217+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6246}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6246': {'gid': 6246, 'name': 'd', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/3219133912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 3219133912}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 3219133912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T17:49:28.547 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T17:49:28.547 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-17T17:49:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.663+0000 7f6aaf031700 1 Processor -- start 2023-08-17T17:49:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.663+0000 7f6aaf031700 1 -- start start 2023-08-17T17:49:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.664+0000 7f6aaf031700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6aa8139100 0x7f6aa80685e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.664+0000 7f6aaf031700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8155250 0x7f6aa81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.664+0000 7f6aaf031700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa8065aa0 con 0x7f6aa8068200 2023-08-17T17:49:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.664+0000 7f6aaf031700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa8069a20 con 0x7f6aa8139100 2023-08-17T17:49:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.664+0000 7f6aaf031700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80c1e50 con 0x7f6aa8155250 2023-08-17T17:49:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aad5ce700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8155250 0x7f6aa81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aa7fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6aa8139100 0x7f6aa80685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aad5ce700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8155250 0x7f6aa81556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:41932/0 (socket says 172.21.15.78:41932) 2023-08-17T17:49:28.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aad5ce700 1 -- 172.21.15.78:0/2016889180 learned_addr learned my addr 172.21.15.78:0/2016889180 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:28.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aad5ce700 1 -- 172.21.15.78:0/2016889180 >> v2:172.21.15.150:3300/0 conn(0x7f6aa8139100 msgr2=0x7f6aa80685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:28.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/2016889180 >> v2:172.21.15.150:3300/0 conn(0x7f6aa8139100 0x7f6aa80685e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aad5ce700 1 -- 172.21.15.78:0/2016889180 >> v1:172.21.15.150:6789/0 conn(0x7f6aa8068200 legacy=0x7f6aa8064ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aad5ce700 1 -- 172.21.15.78:0/2016889180 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa8155bd0 con 0x7f6aa8155250 2023-08-17T17:49:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/2016889180 >> v2:172.21.15.150:3300/0 conn(0x7f6aa8139100 0x7f6aa80685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/2016889180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8155250 0x7f6aa81556e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6aa0006fd0 tx=0x7f6aa00090f0).ready entity=mon.2 client_cookie=18c58365bb55888c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aa77fe700 1 -- 172.21.15.78:0/2016889180 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa000b580 con 0x7f6aa8155250 2023-08-17T17:49:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aa77fe700 1 -- 172.21.15.78:0/2016889180 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa000b6e0 con 0x7f6aa8155250 2023-08-17T17:49:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.665+0000 7f6aa77fe700 1 -- 172.21.15.78:0/2016889180 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa000ba60 con 0x7f6aa8155250 2023-08-17T17:49:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.666+0000 7f6aaf031700 1 -- 172.21.15.78:0/2016889180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8155250 msgr2=0x7f6aa81556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.666+0000 7f6aaf031700 1 --2- 172.21.15.78:0/2016889180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8155250 0x7f6aa81556e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6aa0006fd0 tx=0x7f6aa00090f0).stop 2023-08-17T17:49:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.666+0000 7f6aaf031700 1 -- 172.21.15.78:0/2016889180 shutdown_connections 2023-08-17T17:49:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.666+0000 7f6aaf031700 1 --2- 172.21.15.78:0/2016889180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8155250 0x7f6aa81556e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.666+0000 7f6aaf031700 1 --2- 172.21.15.78:0/2016889180 >> v2:172.21.15.150:3300/0 conn(0x7f6aa8139100 0x7f6aa80685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.666+0000 7f6aaf031700 1 -- 172.21.15.78:0/2016889180 >> 172.21.15.78:0/2016889180 conn(0x7f6aa80c7520 msgr2=0x7f6aa80c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.666+0000 7f6aaf031700 1 -- 172.21.15.78:0/2016889180 shutdown_connections 2023-08-17T17:49:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.666+0000 7f6aaf031700 1 -- 172.21.15.78:0/2016889180 wait complete. 2023-08-17T17:49:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.667+0000 7f6aaf031700 1 Processor -- start 2023-08-17T17:49:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.667+0000 7f6aaf031700 1 -- start start 2023-08-17T17:49:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aaf031700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa8068200 0x7f6aa8131200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aaf031700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8139100 0x7f6aa81316f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aaf031700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aa8155250 0x7f6aa8132ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aaf031700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa813b060 con 0x7f6aa8068200 2023-08-17T17:49:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aaf031700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa813a450 con 0x7f6aa8155250 2023-08-17T17:49:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aaf031700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa813a730 con 0x7f6aa8139100 2023-08-17T17:49:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aacdcd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa8068200 0x7f6aa8131200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aacdcd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa8068200 0x7f6aa8131200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58728/0 (socket says 172.21.15.78:58728) 2023-08-17T17:49:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aacdcd700 1 -- 172.21.15.78:0/3046764764 learned_addr learned my addr 172.21.15.78:0/3046764764 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aa8155250 0x7f6aa8132ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8139100 0x7f6aa81316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aacdcd700 1 -- 172.21.15.78:0/3046764764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8139100 msgr2=0x7f6aa81316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8139100 0x7f6aa81316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aacdcd700 1 -- 172.21.15.78:0/3046764764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aa8155250 msgr2=0x7f6aa8132ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aa8155250 0x7f6aa8132ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aacdcd700 1 -- 172.21.15.78:0/3046764764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0092a0 con 0x7f6aa8068200 2023-08-17T17:49:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8139100 0x7f6aa81316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa8068200 0x7f6aa8131200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f6a9800c840 tx=0x7f6a98001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.668+0000 7f6aa4ff9700 1 -- 172.21.15.78:0/3046764764 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98006a20 con 0x7f6aa8068200 2023-08-17T17:49:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.669+0000 7f6aa4ff9700 1 -- 172.21.15.78:0/3046764764 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a98006b80 con 0x7f6aa8068200 2023-08-17T17:49:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.669+0000 7f6aaf031700 1 -- 172.21.15.78:0/3046764764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa0009370 con 0x7f6aa8068200 2023-08-17T17:49:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.669+0000 7f6aa4ff9700 1 -- 172.21.15.78:0/3046764764 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98007020 con 0x7f6aa8068200 2023-08-17T17:49:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.669+0000 7f6aaf031700 1 -- 172.21.15.78:0/3046764764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa813acf0 con 0x7f6aa8068200 2023-08-17T17:49:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.670+0000 7f6aa4ff9700 1 -- 172.21.15.78:0/3046764764 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6a98018020 con 0x7f6aa8068200 2023-08-17T17:49:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.670+0000 7f6aa4ff9700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6a9405ed90 0x7f6a94061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.670+0000 7f6aa4ff9700 1 -- 172.21.15.78:0/3046764764 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6a98079800 con 0x7f6aa8068200 2023-08-17T17:49:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.670+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6a9405ed90 0x7f6a94061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.671+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6a9405ed90 0x7f6a94061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6a9c009270 tx=0x7f6a9c008040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.672+0000 7f6ac09c6b80 1 Processor -- start 2023-08-17T17:49:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.672+0000 7f6ac09c6b80 1 -- start start 2023-08-17T17:49:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b290bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931f30 0x5605b294d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 0x5605b294dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b28cfd00 con 0x5605b2931f30 2023-08-17T17:49:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b2846cb0 con 0x5605b294d840 2023-08-17T17:49:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605b285bc90 con 0x5605b2931b50 2023-08-17T17:49:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6aa7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931f30 0x5605b294d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6aa7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931f30 0x5605b294d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58730/0 (socket says 172.21.15.78:58730) 2023-08-17T17:49:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6aa7fff700 1 -- 172.21.15.78:0/1629731498 learned_addr learned my addr 172.21.15.78:0/1629731498 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/1629731498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b290bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/1629731498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 0x5605b294dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6aa7fff700 1 -- 172.21.15.78:0/1629731498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 msgr2=0x5605b290bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/1629731498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b290bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6aa7fff700 1 -- 172.21.15.78:0/1629731498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 msgr2=0x5605b294dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.673+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/1629731498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 0x5605b294dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6aa7fff700 1 -- 172.21.15.78:0/1629731498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605b26fe310 con 0x5605b2931f30 2023-08-17T17:49:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/1629731498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 0x5605b294dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/1629731498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931f30 0x5605b294d350 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f6a9c010a80 tx=0x7f6a9c015000).ready entity=mon.0 client_cookie=b0ce5d15b54bab43 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6a8dffb700 1 -- 172.21.15.78:0/1629731498 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c014ab0 con 0x5605b2931f30 2023-08-17T17:49:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6a8dffb700 1 -- 172.21.15.78:0/1629731498 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c014c10 con 0x5605b2931f30 2023-08-17T17:49:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6a8dffb700 1 -- 172.21.15.78:0/1629731498 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c01f400 con 0x5605b2931f30 2023-08-17T17:49:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/1629731498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931f30 msgr2=0x5605b294d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/1629731498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931f30 0x5605b294d350 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f6a9c010a80 tx=0x7f6a9c015000).stop 2023-08-17T17:49:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/1629731498 shutdown_connections 2023-08-17T17:49:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/1629731498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 0x5605b294dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/1629731498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b290bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/1629731498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931f30 0x5605b294d350 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/1629731498 >> 172.21.15.78:0/1629731498 conn(0x5605b26c6e40 msgr2=0x5605b2952d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/1629731498 shutdown_connections 2023-08-17T17:49:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.674+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/1629731498 wait complete. 2023-08-17T17:49:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.675+0000 7f6ac09c6b80 1 -- start start 2023-08-17T17:49:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.675+0000 7f6ac09c6b80 1 Processor -- start 2023-08-17T17:49:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931b50 0x5605b294e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931f30 0x5605b294e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 0x5605b294bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b2822ef0 con 0x5605b2931b50 2023-08-17T17:49:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b28278d0 con 0x5605b294d840 2023-08-17T17:49:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605b294eb60 con 0x5605b2931f30 2023-08-17T17:49:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6ac09c6b80 10 client.0 ll_register_callbacks cb 0x5605b28c9ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:49:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aacdcd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931b50 0x5605b294e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aacdcd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931b50 0x5605b294e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58732/0 (socket says 172.21.15.78:58732) 2023-08-17T17:49:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aacdcd700 1 -- 172.21.15.78:0/651985308 learned_addr learned my addr 172.21.15.78:0/651985308 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 0x5605b294bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931f30 0x5605b294e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aacdcd700 1 -- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931f30 msgr2=0x5605b294e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931f30 0x5605b294e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aacdcd700 1 -- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 msgr2=0x5605b294bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 0x5605b294bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aacdcd700 1 -- 172.21.15.78:0/651985308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c00e030 con 0x5605b2931b50 2023-08-17T17:49:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931b50 0x5605b294e180 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f6a9804cf00 tx=0x7f6a9800f000).ready entity=mon.0 client_cookie=e8fffc46d81ac103 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.676+0000 7f6a86ffd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:49:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6a86ffd700 1 -- 172.21.15.78:0/651985308 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9804de40 con 0x5605b2931b50 2023-08-17T17:49:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/651985308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605b29040f0 con 0x5605b2931b50 2023-08-17T17:49:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6a86ffd700 1 -- 172.21.15.78:0/651985308 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6a9804dfa0 con 0x5605b2931b50 2023-08-17T17:49:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6a86ffd700 1 -- 172.21.15.78:0/651985308 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a9804ed90 con 0x5605b2931b50 2023-08-17T17:49:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6ac09c6b80 10 client.6420 fetch_fsmap learned FSMap version 25 2023-08-17T17:49:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/651985308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x5605b2854e70 con 0x5605b2931b50 2023-08-17T17:49:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6a86ffd700 1 -- 172.21.15.78:0/651985308 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5605b29040f0 con 0x5605b2931b50 2023-08-17T17:49:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6a86ffd700 1 -- 172.21.15.78:0/651985308 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6a9805f020 con 0x5605b2931b50 2023-08-17T17:49:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6ac09c6b80 10 client.6420 fetch_fsmap finished waiting for FSMap version 25 2023-08-17T17:49:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6ac09c6b80 10 client.6420 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-17T17:49:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6ac09c6b80 20 client.6420 populate_metadata read hostname 'smithi078' 2023-08-17T17:49:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:6833/3219133912,v1:172.21.15.150:6835/3219133912] conn(0x5605b29307d0 0x5605b2930bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6ac09c6b80 4 client.6420 mds_command: new command op to 6246 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T17:49:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/651985308 --> [v2:172.21.15.150:6833/3219133912,v1:172.21.15.150:6835/3219133912] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5605b28d3b50 con 0x5605b29307d0 2023-08-17T17:49:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.677+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:6833/3219133912,v1:172.21.15.150:6835/3219133912] conn(0x5605b29307d0 0x5605b2930bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.678+0000 7f6a86ffd700 10 client.6420 ms_handle_connect on v2:172.21.15.150:6833/3219133912 2023-08-17T17:49:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.678+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:6833/3219133912,v1:172.21.15.150:6835/3219133912] conn(0x5605b29307d0 0x5605b2930bb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=436c4f6169eee0cb server_cookie=95114b627095966c in_seq=0 out_seq=0 2023-08-17T17:49:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.678+0000 7f6a86ffd700 1 -- 172.21.15.78:0/651985308 <== mds.0 v2:172.21.15.150:6833/3219133912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5605b28d3b50 con 0x5605b29307d0 2023-08-17T17:49:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.678+0000 7f6a86ffd700 10 client.6420 handle_command_reply: tid=0 2023-08-17T17:49:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.678+0000 7f6ac09c6b80 1 client.6420 shutdown 2023-08-17T17:49:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/651985308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931b50 msgr2=0x5605b294e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931b50 0x5605b294e180 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f6a9804cf00 tx=0x7f6a9800f000).stop 2023-08-17T17:49:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/651985308 shutdown_connections 2023-08-17T17:49:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:6833/3219133912,v1:172.21.15.150:6835/3219133912] conn(0x5605b29307d0 0x5605b2930bb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b294d840 0x5605b294bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6a86ffd700 0 client.6420 ms_handle_reset on v2:172.21.15.150:6833/3219133912 2023-08-17T17:49:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b2931b50 0x5605b294e180 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/651985308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931f30 0x5605b294e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/651985308 >> 172.21.15.78:0/651985308 conn(0x5605b26c6e40 msgr2=0x5605b294cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/651985308 shutdown_connections 2023-08-17T17:49:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/651985308 wait complete. 2023-08-17T17:49:28.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.679+0000 7f6ac09c6b80 20 client.6420 trim_cache size 0 max 16384 2023-08-17T17:49:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.695+0000 7f6ac09c6b80 1 Processor -- start 2023-08-17T17:49:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.695+0000 7f6ac09c6b80 1 -- start start 2023-08-17T17:49:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b290ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b2931f30 0x5605b290bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b29072c0 con 0x5605b294d840 2023-08-17T17:49:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b2952b70 con 0x5605b2931f30 2023-08-17T17:49:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605b2923f20 con 0x5605b2931b50 2023-08-17T17:49:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aad5ce700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aad5ce700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58742/0 (socket says 172.21.15.78:58742) 2023-08-17T17:49:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aad5ce700 1 -- 172.21.15.78:0/3115895725 learned_addr learned my addr 172.21.15.78:0/3115895725 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/3115895725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b2931f30 0x5605b290bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/3115895725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b290ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aad5ce700 1 -- 172.21.15.78:0/3115895725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 msgr2=0x5605b290ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/3115895725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b290ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aad5ce700 1 -- 172.21.15.78:0/3115895725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b2931f30 msgr2=0x5605b290bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/3115895725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b2931f30 0x5605b290bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aad5ce700 1 -- 172.21.15.78:0/3115895725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa80c68a0 con 0x5605b294d840 2023-08-17T17:49:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/3115895725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294cbc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f6aa0009ea0 tx=0x7f6aa0017000).ready entity=mon.0 client_cookie=dc077964ed4b3861 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.696+0000 7f6a8e7fc700 1 -- 172.21.15.78:0/3115895725 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0023070 con 0x5605b294d840 2023-08-17T17:49:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6a8e7fc700 1 -- 172.21.15.78:0/3115895725 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa000b850 con 0x5605b294d840 2023-08-17T17:49:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6a8e7fc700 1 -- 172.21.15.78:0/3115895725 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa001d660 con 0x5605b294d840 2023-08-17T17:49:28.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/3115895725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 msgr2=0x5605b294cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/3115895725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294cbc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f6aa0009ea0 tx=0x7f6aa0017000).stop 2023-08-17T17:49:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/3115895725 shutdown_connections 2023-08-17T17:49:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/3115895725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294cbc0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/3115895725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b290ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/3115895725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b2931f30 0x5605b290bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/3115895725 >> 172.21.15.78:0/3115895725 conn(0x5605b26c6e40 msgr2=0x5605b2908820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/3115895725 shutdown_connections 2023-08-17T17:49:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.697+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/3115895725 wait complete. 2023-08-17T17:49:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.698+0000 7f6ac09c6b80 1 -- start start 2023-08-17T17:49:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.698+0000 7f6ac09c6b80 1 Processor -- start 2023-08-17T17:49:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b2926100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b2931f30 0x5605b294cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6ac09c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b2923390 con 0x5605b294d840 2023-08-17T17:49:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b294d520 con 0x5605b2931f30 2023-08-17T17:49:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6ac09c6b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605b29bb8a0 con 0x5605b2931b50 2023-08-17T17:49:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6ac09c6b80 10 client.0 ll_register_callbacks cb 0x5605b28c9ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:49:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aad5ce700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aad5ce700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58750/0 (socket says 172.21.15.78:58750) 2023-08-17T17:49:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aad5ce700 1 -- 172.21.15.78:0/4038711982 learned_addr learned my addr 172.21.15.78:0/4038711982 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aa7fff700 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b2931f30 0x5605b294cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b2926100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aad5ce700 1 -- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 msgr2=0x5605b2926100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b2926100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aad5ce700 1 -- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b2931f30 msgr2=0x5605b294cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b2931f30 0x5605b294cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aad5ce700 1 -- 172.21.15.78:0/4038711982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa8155bd0 con 0x5605b294d840 2023-08-17T17:49:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6aad5ce700 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294d030 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f6aa000bfb0 tx=0x7f6aa0023000).ready entity=mon.0 client_cookie=e3e489c6d29422c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.699+0000 7f6a86ffd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:49:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6a86ffd700 1 -- 172.21.15.78:0/4038711982 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa001dc20 con 0x5605b294d840 2023-08-17T17:49:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6a86ffd700 1 -- 172.21.15.78:0/4038711982 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6aa001dd80 con 0x5605b294d840 2023-08-17T17:49:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/4038711982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a9c014c10 con 0x5605b294d840 2023-08-17T17:49:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6a86ffd700 1 -- 172.21.15.78:0/4038711982 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6aa0028620 con 0x5605b294d840 2023-08-17T17:49:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6ac09c6b80 10 client.6426 fetch_fsmap learned FSMap version 25 2023-08-17T17:49:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/4038711982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x5605b2850480 con 0x5605b294d840 2023-08-17T17:49:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6a86ffd700 1 -- 172.21.15.78:0/4038711982 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c014c10 con 0x5605b294d840 2023-08-17T17:49:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6a86ffd700 1 -- 172.21.15.78:0/4038711982 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6aa0009830 con 0x5605b294d840 2023-08-17T17:49:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6ac09c6b80 10 client.6426 fetch_fsmap finished waiting for FSMap version 25 2023-08-17T17:49:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6ac09c6b80 10 client.6426 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-17T17:49:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6ac09c6b80 20 client.6426 populate_metadata read hostname 'smithi078' 2023-08-17T17:49:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:6833/3219133912,v1:172.21.15.150:6835/3219133912] conn(0x5605b2937a50 0x5605b2937e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6ac09c6b80 4 client.6426 mds_command: new command op to 6246 tid=0[{"prefix": "status"}] 2023-08-17T17:49:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/4038711982 --> [v2:172.21.15.150:6833/3219133912,v1:172.21.15.150:6835/3219133912] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5605b26c2ca0 con 0x5605b2937a50 2023-08-17T17:49:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:6833/3219133912,v1:172.21.15.150:6835/3219133912] conn(0x5605b2937a50 0x5605b2937e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6a86ffd700 10 client.6426 ms_handle_connect on v2:172.21.15.150:6833/3219133912 2023-08-17T17:49:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.700+0000 7f6aacdcd700 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:6833/3219133912,v1:172.21.15.150:6835/3219133912] conn(0x5605b2937a50 0x5605b2937e30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=31a24ccf663918b1 server_cookie=ab734a358e4f9105 in_seq=0 out_seq=0 2023-08-17T17:49:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6a86ffd700 1 -- 172.21.15.78:0/4038711982 <== mds.0 v2:172.21.15.150:6833/3219133912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5605b26c2ca0 con 0x5605b2937a50 2023-08-17T17:49:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6a86ffd700 10 client.6426 handle_command_reply: tid=0 2023-08-17T17:49:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 client.6426 shutdown 2023-08-17T17:49:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/4038711982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 msgr2=0x5605b294d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294d030 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f6aa000bfb0 tx=0x7f6aa0023000).stop 2023-08-17T17:49:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/4038711982 shutdown_connections 2023-08-17T17:49:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:6833/3219133912,v1:172.21.15.150:6835/3219133912] conn(0x5605b2937a50 0x5605b2937e30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605b294d840 0x5605b294d030 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6a86ffd700 0 client.6426 ms_handle_reset on v2:172.21.15.150:6833/3219133912 2023-08-17T17:49:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5605b2931b50 0x5605b2926100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 --2- 172.21.15.78:0/4038711982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605b2931f30 0x5605b294cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/4038711982 >> 172.21.15.78:0/4038711982 conn(0x5605b26c6e40 msgr2=0x5605b29388a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/4038711982 shutdown_connections 2023-08-17T17:49:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 1 -- 172.21.15.78:0/4038711982 wait complete. 2023-08-17T17:49:28.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6ac09c6b80 20 client.6426 trim_cache size 0 max 16384 2023-08-17T17:49:28.711 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:49:28.711 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T17:49:28.711 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T17:49:28.711 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 6246, 2023-08-17T17:49:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T17:49:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T17:49:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T17:49:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 9.0255553670000008, 2023-08-17T17:49:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 25, 2023-08-17T17:49:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 77, 2023-08-17T17:49:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 77, 2023-08-17T17:49:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 13.52731981 2023-08-17T17:49:28.713 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:49:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6aaf031700 1 -- 172.21.15.78:0/3046764764 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6a9405ed90 msgr2=0x7f6a94061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6aaf031700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6a9405ed90 0x7f6a94061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6a9c009270 tx=0x7f6a9c008040).stop 2023-08-17T17:49:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6aaf031700 1 -- 172.21.15.78:0/3046764764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa8068200 msgr2=0x7f6aa8131200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.701+0000 7f6aaf031700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa8068200 0x7f6aa8131200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f6a9800c840 tx=0x7f6a98001660).stop 2023-08-17T17:49:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.702+0000 7f6aaf031700 1 -- 172.21.15.78:0/3046764764 shutdown_connections 2023-08-17T17:49:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.702+0000 7f6aaf031700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6a9405ed90 0x7f6a94061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.702+0000 7f6aaf031700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aa8155250 0x7f6aa8132ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.702+0000 7f6aaf031700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa8068200 0x7f6aa8131200 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.702+0000 7f6aaf031700 1 --2- 172.21.15.78:0/3046764764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6aa8139100 0x7f6aa81316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.702+0000 7f6aaf031700 1 -- 172.21.15.78:0/3046764764 >> 172.21.15.78:0/3046764764 conn(0x7f6aa80c7520 msgr2=0x7f6aa80bc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.702+0000 7f6aaf031700 1 -- 172.21.15.78:0/3046764764 shutdown_connections 2023-08-17T17:49:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.702+0000 7f6aaf031700 1 -- 172.21.15.78:0/3046764764 wait complete. 2023-08-17T17:49:28.716 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T17:49:28.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.817+0000 7f132ac6b700 1 Processor -- start 2023-08-17T17:49:28.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.817+0000 7f132ac6b700 1 -- start start 2023-08-17T17:49:28.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f132ac6b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13240c1100 0x7f13240c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f132ac6b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f13241546b0 0x7f1324154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f132ac6b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13240c8670 con 0x7f13240c8290 2023-08-17T17:49:28.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f132ac6b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240c5f50 con 0x7f13241546b0 2023-08-17T17:49:28.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f132ac6b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13241552f0 con 0x7f13240c1100 2023-08-17T17:49:28.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f1329208700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f13241546b0 0x7f1324154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f1328a07700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f13240c8290 0x7f13240c09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54972/0 (socket says 172.21.15.78:54972) 2023-08-17T17:49:28.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f1328a07700 1 -- 172.21.15.78:0/792891410 learned_addr learned my addr 172.21.15.78:0/792891410 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:28.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f1323fff700 1 --2- 172.21.15.78:0/792891410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13240c1100 0x7f13240c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f1329208700 1 -- 172.21.15.78:0/792891410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13240c1100 msgr2=0x7f13240c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:28.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f1329208700 1 --2- 172.21.15.78:0/792891410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13240c1100 0x7f13240c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f1329208700 1 -- 172.21.15.78:0/792891410 >> v1:172.21.15.78:6789/0 conn(0x7f13240c8290 legacy=0x7f13240c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f13237fe700 1 -- 172.21.15.78:0/792891410 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155769576 0 0) 0x7f13240c8670 con 0x7f13240c8290 2023-08-17T17:49:28.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f1329208700 1 -- 172.21.15.78:0/792891410 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13241555d0 con 0x7f13241546b0 2023-08-17T17:49:28.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f1329208700 1 --2- 172.21.15.78:0/792891410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13241546b0 0x7f1324154b10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f131c009e60 tx=0x7f131c009780).ready entity=mon.0 client_cookie=38024d185e1e8f55 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:28.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f13237fe700 1 -- 172.21.15.78:0/792891410 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c00e070 con 0x7f13241546b0 2023-08-17T17:49:28.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f13237fe700 1 -- 172.21.15.78:0/792891410 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c00bc30 con 0x7f13241546b0 2023-08-17T17:49:28.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.818+0000 7f13237fe700 1 -- 172.21.15.78:0/792891410 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c012410 con 0x7f13241546b0 2023-08-17T17:49:28.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.819+0000 7f132ac6b700 1 -- 172.21.15.78:0/792891410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13241546b0 msgr2=0x7f1324154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.819+0000 7f132ac6b700 1 --2- 172.21.15.78:0/792891410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13241546b0 0x7f1324154b10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f131c009e60 tx=0x7f131c009780).stop 2023-08-17T17:49:28.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.819+0000 7f132ac6b700 1 -- 172.21.15.78:0/792891410 shutdown_connections 2023-08-17T17:49:28.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.819+0000 7f132ac6b700 1 --2- 172.21.15.78:0/792891410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13241546b0 0x7f1324154b10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.819+0000 7f132ac6b700 1 --2- 172.21.15.78:0/792891410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13240c1100 0x7f13240c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.819+0000 7f132ac6b700 1 -- 172.21.15.78:0/792891410 >> 172.21.15.78:0/792891410 conn(0x7f1324084df0 msgr2=0x7f1324094710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:28.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.819+0000 7f132ac6b700 1 -- 172.21.15.78:0/792891410 shutdown_connections 2023-08-17T17:49:28.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.819+0000 7f132ac6b700 1 -- 172.21.15.78:0/792891410 wait complete. 2023-08-17T17:49:28.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.820+0000 7f132ac6b700 1 Processor -- start 2023-08-17T17:49:28.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.820+0000 7f132ac6b700 1 -- start start 2023-08-17T17:49:28.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f132ac6b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13240c1100 0x7f1324152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f132ac6b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13240c8290 0x7f1324158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f132ac6b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13241546b0 0x7f1324159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f132ac6b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13240a9ec0 con 0x7f13240c1100 2023-08-17T17:49:28.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f132ac6b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1324159980 con 0x7f13240c8290 2023-08-17T17:49:28.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f132ac6b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13240aafc0 con 0x7f13241546b0 2023-08-17T17:49:28.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1328a07700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13240c1100 0x7f1324152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1328a07700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13240c1100 0x7f1324152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58768/0 (socket says 172.21.15.78:58768) 2023-08-17T17:49:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1328a07700 1 -- 172.21.15.78:0/3833456447 learned_addr learned my addr 172.21.15.78:0/3833456447 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1323fff700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13240c8290 0x7f1324158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1329208700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13241546b0 0x7f1324159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1328a07700 1 -- 172.21.15.78:0/3833456447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13241546b0 msgr2=0x7f1324159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1328a07700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13241546b0 0x7f1324159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1328a07700 1 -- 172.21.15.78:0/3833456447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13240c8290 msgr2=0x7f1324158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1328a07700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13240c8290 0x7f1324158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1328a07700 1 -- 172.21.15.78:0/3833456447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c009a20 con 0x7f13240c1100 2023-08-17T17:49:28.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1323fff700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13240c8290 0x7f1324158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:28.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.821+0000 7f1328a07700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13240c1100 0x7f1324152fb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f131800c4e0 tx=0x7f1318007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:28.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.822+0000 7f1320ff9700 1 -- 172.21.15.78:0/3833456447 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13180072e0 con 0x7f13240c1100 2023-08-17T17:49:28.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.822+0000 7f1320ff9700 1 -- 172.21.15.78:0/3833456447 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318007440 con 0x7f13240c1100 2023-08-17T17:49:28.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.822+0000 7f132ac6b700 1 -- 172.21.15.78:0/3833456447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13240abb40 con 0x7f13240c1100 2023-08-17T17:49:28.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.822+0000 7f1320ff9700 1 -- 172.21.15.78:0/3833456447 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13180057a0 con 0x7f13240c1100 2023-08-17T17:49:28.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.822+0000 7f132ac6b700 1 -- 172.21.15.78:0/3833456447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13240ab4f0 con 0x7f13240c1100 2023-08-17T17:49:28.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.823+0000 7f132ac6b700 1 -- 172.21.15.78:0/3833456447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1324047350 con 0x7f13240c1100 2023-08-17T17:49:28.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.823+0000 7f1320ff9700 1 -- 172.21.15.78:0/3833456447 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f131801a060 con 0x7f13240c1100 2023-08-17T17:49:28.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.823+0000 7f1320ff9700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f130805ed60 0x7f1308061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:28.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.823+0000 7f1320ff9700 1 -- 172.21.15.78:0/3833456447 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1318079480 con 0x7f13240c1100 2023-08-17T17:49:28.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.823+0000 7f1323fff700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f130805ed60 0x7f1308061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:28.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.824+0000 7f1323fff700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f130805ed60 0x7f1308061220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f13240adbc0 tx=0x7f1310008040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:28.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:28.827+0000 7f1320ff9700 1 -- 172.21.15.78:0/3833456447 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f131804aa20 con 0x7f13240c1100 2023-08-17T17:49:29.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.031+0000 7f132ac6b700 1 -- 172.21.15.78:0/3833456447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f13240c61f0 con 0x7f13240c1100 2023-08-17T17:49:29.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.031+0000 7f1320ff9700 1 -- 172.21.15.78:0/3833456447 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1318018020 con 0x7f13240c1100 2023-08-17T17:49:29.032 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:49:29.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 -- 172.21.15.78:0/3833456447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f130805ed60 msgr2=0x7f1308061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:29.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f130805ed60 0x7f1308061220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f13240adbc0 tx=0x7f1310008040).stop 2023-08-17T17:49:29.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 -- 172.21.15.78:0/3833456447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13240c1100 msgr2=0x7f1324152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:29.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13240c1100 0x7f1324152fb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f131800c4e0 tx=0x7f1318007c70).stop 2023-08-17T17:49:29.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 -- 172.21.15.78:0/3833456447 shutdown_connections 2023-08-17T17:49:29.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f130805ed60 0x7f1308061220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13241546b0 0x7f1324159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13240c1100 0x7f1324152fb0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 --2- 172.21.15.78:0/3833456447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13240c8290 0x7f1324158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 -- 172.21.15.78:0/3833456447 >> 172.21.15.78:0/3833456447 conn(0x7f1324084df0 msgr2=0x7f13241536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:29.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 -- 172.21.15.78:0/3833456447 shutdown_connections 2023-08-17T17:49:29.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.033+0000 7f132ac6b700 1 -- 172.21.15.78:0/3833456447 wait complete. 2023-08-17T17:49:29.044 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T17:49:29.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:49:29.045 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T17:49:29.045 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T17:49:29.045 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T17:49:29.046 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T17:49:29.046 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T17:49:29.046 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:49:29.046 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:49:29.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:49:29.047 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T17:49:29.062 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:49:29.062 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:49:29.062 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:49:29.062 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:49:29.062 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:49:29.062 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:49:29.063 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:49:29.063 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:49:29.063 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T17:49:29.063 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:49:29.063 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:49:29.063 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T17:49:29.063 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:49:29.063 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:49:29.064 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:49:29.064 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:49:29.064 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:49:29.064 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 41310sec preferred_lft 41310sec 2023-08-17T17:49:29.064 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T17:49:29.064 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:49:29.064 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:49:29.065 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:49:29.065 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T17:49:29.065 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:49:29.065 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T17:49:29.065 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:49:29.065 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:49:29.065 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T17:49:29.065 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link 2023-08-17T17:49:29.066 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:49:29.066 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:49:29.066 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T17:49:29.066 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::54:39ff:fe93:1c36/64 scope link 2023-08-17T17:49:29.066 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:49:29.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:49:29.067 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:49:29.124 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T17:49:29.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:49:29.126 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T17:49:29.181 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T17:49:29.181 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:49:29.181 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:49:29.181 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:49:29.182 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:49:29.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:49:29.182 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:49:29.183 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:49:29.183 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:49:29.183 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:49:29.184 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:49:29.184 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:49:29.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:49:29.281 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:49:29.295 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T17:49:29.295 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T17:49:29.296 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:49:29.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:49:29.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T17:49:29.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:49:29.359 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T17:49:29.413 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:49:29.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:49:29.491 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:49:29.491 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:49:29.516 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:49:29.517 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:49:29.519 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:49:29.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:49:29.520 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T17:49:29.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-17T17:49:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.737+0000 7ff5fb59e700 1 Processor -- start 2023-08-17T17:49:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.737+0000 7ff5fb59e700 1 -- start start 2023-08-17T17:49:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fb59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5fc153f80 0x7ff5fc0a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc0cb890 0x7ff5fc0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fb59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc0c9ca0 con 0x7ff5fc154360 2023-08-17T17:49:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fb59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc0c96b0 con 0x7ff5fc153f80 2023-08-17T17:49:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0c0080 con 0x7ff5fc0cb890 2023-08-17T17:49:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fa59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5fc153f80 0x7ff5fc0a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fa59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5fc153f80 0x7ff5fc0a7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58778/0 (socket says 172.21.15.78:58778) 2023-08-17T17:49:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fa59c700 1 -- 172.21.15.78:0/783286801 learned_addr learned my addr 172.21.15.78:0/783286801 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5f1d9b700 1 --2- 172.21.15.78:0/783286801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc0cb890 0x7ff5fc0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fa59c700 1 -- 172.21.15.78:0/783286801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc0cb890 msgr2=0x7ff5fc0c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fa59c700 1 --2- 172.21.15.78:0/783286801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc0cb890 0x7ff5fc0c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fa59c700 1 -- 172.21.15.78:0/783286801 >> v1:172.21.15.150:6789/0 conn(0x7ff5fc154360 legacy=0x7ff5fc0ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5fa59c700 1 -- 172.21.15.78:0/783286801 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0c0360 con 0x7ff5fc153f80 2023-08-17T17:49:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.738+0000 7ff5f1d9b700 1 --2- 172.21.15.78:0/783286801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc0cb890 0x7ff5fc0c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5fa59c700 1 --2- 172.21.15.78:0/783286801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 0x7ff5fc0a7b80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7ff5ec009810 tx=0x7ff5ec009060).ready entity=mon.0 client_cookie=7a56adaeb7f08752 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5f9d9b700 1 -- 172.21.15.78:0/783286801 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec005880 con 0x7ff5fc153f80 2023-08-17T17:49:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5f9d9b700 1 -- 172.21.15.78:0/783286801 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec0059e0 con 0x7ff5fc153f80 2023-08-17T17:49:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5f9d9b700 1 -- 172.21.15.78:0/783286801 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec005d60 con 0x7ff5fc153f80 2023-08-17T17:49:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5fb59e700 1 -- 172.21.15.78:0/783286801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 msgr2=0x7ff5fc0a7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5fb59e700 1 --2- 172.21.15.78:0/783286801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 0x7ff5fc0a7b80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7ff5ec009810 tx=0x7ff5ec009060).stop 2023-08-17T17:49:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5fb59e700 1 -- 172.21.15.78:0/783286801 shutdown_connections 2023-08-17T17:49:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5fb59e700 1 --2- 172.21.15.78:0/783286801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 0x7ff5fc0a7b80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5fb59e700 1 --2- 172.21.15.78:0/783286801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc0cb890 0x7ff5fc0c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5fb59e700 1 -- 172.21.15.78:0/783286801 >> 172.21.15.78:0/783286801 conn(0x7ff5fc06a400 msgr2=0x7ff5fc0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5fb59e700 1 -- 172.21.15.78:0/783286801 shutdown_connections 2023-08-17T17:49:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.739+0000 7ff5fb59e700 1 -- 172.21.15.78:0/783286801 wait complete. 2023-08-17T17:49:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.740+0000 7ff5fb59e700 1 Processor -- start 2023-08-17T17:49:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5fb59e700 1 -- start start 2023-08-17T17:49:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5fb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5fc0cb890 0x7ff5fc159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5fb59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 0x7ff5fc0ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5fb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc154360 0x7ff5fc0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5fb59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0cab10 con 0x7ff5fc153f80 2023-08-17T17:49:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5fb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc1654f0 con 0x7ff5fc0cb890 2023-08-17T17:49:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5fb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc164950 con 0x7ff5fc154360 2023-08-17T17:49:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5f1d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 0x7ff5fc0ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5f1d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 0x7ff5fc0ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58786/0 (socket says 172.21.15.78:58786) 2023-08-17T17:49:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5f1d9b700 1 -- 172.21.15.78:0/2854141783 learned_addr learned my addr 172.21.15.78:0/2854141783 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5fa59c700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5fc0cb890 0x7ff5fc159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.741+0000 7ff5fad9d700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc154360 0x7ff5fc0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5f1d9b700 1 -- 172.21.15.78:0/2854141783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc154360 msgr2=0x7ff5fc0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5f1d9b700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc154360 0x7ff5fc0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5f1d9b700 1 -- 172.21.15.78:0/2854141783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5fc0cb890 msgr2=0x7ff5fc159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5f1d9b700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5fc0cb890 0x7ff5fc159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5f1d9b700 1 -- 172.21.15.78:0/2854141783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec009300 con 0x7ff5fc153f80 2023-08-17T17:49:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5f1d9b700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 0x7ff5fc0ca130 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7ff5e400d8c0 tx=0x7ff5e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5f2ffd700 1 -- 172.21.15.78:0/2854141783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4011590 con 0x7ff5fc153f80 2023-08-17T17:49:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5f2ffd700 1 -- 172.21.15.78:0/2854141783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e40116f0 con 0x7ff5fc153f80 2023-08-17T17:49:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5fb59e700 1 -- 172.21.15.78:0/2854141783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc165980 con 0x7ff5fc153f80 2023-08-17T17:49:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5f2ffd700 1 -- 172.21.15.78:0/2854141783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4011a70 con 0x7ff5fc153f80 2023-08-17T17:49:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.742+0000 7ff5fb59e700 1 -- 172.21.15.78:0/2854141783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc164ea0 con 0x7ff5fc153f80 2023-08-17T17:49:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.743+0000 7ff5fb59e700 1 -- 172.21.15.78:0/2854141783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc065230 con 0x7ff5fc153f80 2023-08-17T17:49:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.743+0000 7ff5f2ffd700 1 -- 172.21.15.78:0/2854141783 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff5e4012420 con 0x7ff5fc153f80 2023-08-17T17:49:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.743+0000 7ff5f2ffd700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5dc05ed90 0x7ff5dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.744+0000 7ff5f2ffd700 1 -- 172.21.15.78:0/2854141783 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff5e40796d0 con 0x7ff5fc153f80 2023-08-17T17:49:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.744+0000 7ff5fa59c700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5dc05ed90 0x7ff5dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.744+0000 7ff5fa59c700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5dc05ed90 0x7ff5dc061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff5ec009fd0 tx=0x7ff5ec016000).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.747+0000 7ff5f2ffd700 1 -- 172.21.15.78:0/2854141783 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff5e404ac10 con 0x7ff5fc153f80 2023-08-17T17:49:29.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.936+0000 7ff5fb59e700 1 -- 172.21.15.78:0/2854141783 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5fc0c9930 con 0x7ff5dc05ed90 2023-08-17T17:49:29.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.938+0000 7ff5f2ffd700 1 -- 172.21.15.78:0/2854141783 <== mgr.6066 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff5fc0c9930 con 0x7ff5dc05ed90 2023-08-17T17:49:29.938 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:49:29.938 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:29.938 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephfs" 2023-08-17T17:49:29.939 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:29.939 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:49:29.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 -- 172.21.15.78:0/2854141783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5dc05ed90 msgr2=0x7ff5dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:29.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5dc05ed90 0x7ff5dc061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff5ec009fd0 tx=0x7ff5ec016000).stop 2023-08-17T17:49:29.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 -- 172.21.15.78:0/2854141783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 msgr2=0x7ff5fc0ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:29.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 0x7ff5fc0ca130 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7ff5e400d8c0 tx=0x7ff5e4008040).stop 2023-08-17T17:49:29.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 -- 172.21.15.78:0/2854141783 shutdown_connections 2023-08-17T17:49:29.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff5dc05ed90 0x7ff5dc061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5fc154360 0x7ff5fc0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5fc0cb890 0x7ff5fc159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 --2- 172.21.15.78:0/2854141783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5fc153f80 0x7ff5fc0ca130 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:29.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 -- 172.21.15.78:0/2854141783 >> 172.21.15.78:0/2854141783 conn(0x7ff5fc06a400 msgr2=0x7ff5fc152510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:29.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 -- 172.21.15.78:0/2854141783 shutdown_connections 2023-08-17T17:49:29.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:29.940+0000 7ff5fb59e700 1 -- 172.21.15.78:0/2854141783 wait complete. 2023-08-17T17:49:29.952 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-17T17:49:30.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.067+0000 7f6000621700 1 Processor -- start 2023-08-17T17:49:30.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.067+0000 7f6000621700 1 -- start start 2023-08-17T17:49:30.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.068+0000 7f6000621700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ff80aa4d0 0x7f5ff80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.068+0000 7f6000621700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80c5810 0x7f5ff80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.068+0000 7f6000621700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80649b0 con 0x7f5ff80aa0f0 2023-08-17T17:49:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.068+0000 7f6000621700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff80c6170 con 0x7f5ff80aa4d0 2023-08-17T17:49:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.068+0000 7f6000621700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8063420 con 0x7f5ff80c5810 2023-08-17T17:49:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.068+0000 7f5ffebbe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80c5810 0x7f5ff80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.068+0000 7f5ffdbbc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ff80aa4d0 0x7f5ff80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.068+0000 7f5ffebbe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80c5810 0x7f5ff80c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:42028/0 (socket says 172.21.15.78:42028) 2023-08-17T17:49:30.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.068+0000 7f5ffebbe700 1 -- 172.21.15.78:0/2449456219 learned_addr learned my addr 172.21.15.78:0/2449456219 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.069+0000 7f5ffebbe700 1 -- 172.21.15.78:0/2449456219 >> v2:172.21.15.150:3300/0 conn(0x7f5ff80aa4d0 msgr2=0x7f5ff80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.069+0000 7f5ffebbe700 1 --2- 172.21.15.78:0/2449456219 >> v2:172.21.15.150:3300/0 conn(0x7f5ff80aa4d0 0x7f5ff80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.069+0000 7f5ffebbe700 1 -- 172.21.15.78:0/2449456219 >> v1:172.21.15.150:6789/0 conn(0x7f5ff80aa0f0 legacy=0x7f5ff80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.069+0000 7f5ffebbe700 1 -- 172.21.15.78:0/2449456219 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8063700 con 0x7f5ff80c5810 2023-08-17T17:49:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.069+0000 7f5ffebbe700 1 --2- 172.21.15.78:0/2449456219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80c5810 0x7f5ff80c5c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5ff0009f20 tx=0x7f5ff0009840).ready entity=mon.2 client_cookie=a77f44230aaa541e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.069+0000 7f5ffd3bb700 1 -- 172.21.15.78:0/2449456219 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000e070 con 0x7f5ff80c5810 2023-08-17T17:49:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.069+0000 7f5ffd3bb700 1 -- 172.21.15.78:0/2449456219 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff000b9d0 con 0x7f5ff80c5810 2023-08-17T17:49:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.069+0000 7f5ffd3bb700 1 -- 172.21.15.78:0/2449456219 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000bd50 con 0x7f5ff80c5810 2023-08-17T17:49:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.070+0000 7f6000621700 1 -- 172.21.15.78:0/2449456219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80c5810 msgr2=0x7f5ff80c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.070+0000 7f6000621700 1 --2- 172.21.15.78:0/2449456219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80c5810 0x7f5ff80c5c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5ff0009f20 tx=0x7f5ff0009840).stop 2023-08-17T17:49:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.070+0000 7f6000621700 1 -- 172.21.15.78:0/2449456219 shutdown_connections 2023-08-17T17:49:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.070+0000 7f6000621700 1 --2- 172.21.15.78:0/2449456219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80c5810 0x7f5ff80c5c80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.070+0000 7f6000621700 1 --2- 172.21.15.78:0/2449456219 >> v2:172.21.15.150:3300/0 conn(0x7f5ff80aa4d0 0x7f5ff80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.070+0000 7f6000621700 1 -- 172.21.15.78:0/2449456219 >> 172.21.15.78:0/2449456219 conn(0x7f5ff806a6a0 msgr2=0x7f5ff80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.070+0000 7f6000621700 1 -- 172.21.15.78:0/2449456219 shutdown_connections 2023-08-17T17:49:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.070+0000 7f6000621700 1 -- 172.21.15.78:0/2449456219 wait complete. 2023-08-17T17:49:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.071+0000 7f6000621700 1 Processor -- start 2023-08-17T17:49:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.071+0000 7f6000621700 1 -- start start 2023-08-17T17:49:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f6000621700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80aa0f0 0x7f5ff814bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f6000621700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff80aa4d0 0x7f5ff814d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f6000621700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff80c5810 0x7f5ff80afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f6000621700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80ae220 con 0x7f5ff80c5810 2023-08-17T17:49:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f6000621700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80adf20 con 0x7f5ff80aa4d0 2023-08-17T17:49:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f6000621700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80ad6e0 con 0x7f5ff80aa0f0 2023-08-17T17:49:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffebbe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff80c5810 0x7f5ff80afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffebbe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff80c5810 0x7f5ff80afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58798/0 (socket says 172.21.15.78:58798) 2023-08-17T17:49:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffebbe700 1 -- 172.21.15.78:0/3828852478 learned_addr learned my addr 172.21.15.78:0/3828852478 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffdbbc700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff80aa4d0 0x7f5ff814d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffe3bd700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80aa0f0 0x7f5ff814bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffebbe700 1 -- 172.21.15.78:0/3828852478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80aa0f0 msgr2=0x7f5ff814bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffebbe700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80aa0f0 0x7f5ff814bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffebbe700 1 -- 172.21.15.78:0/3828852478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff80aa4d0 msgr2=0x7f5ff814d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffebbe700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff80aa4d0 0x7f5ff814d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffebbe700 1 -- 172.21.15.78:0/3828852478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff0009ae0 con 0x7f5ff80c5810 2023-08-17T17:49:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ffebbe700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff80c5810 0x7f5ff80afa10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f5ff000be70 tx=0x7f5ff0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ff67fc700 1 -- 172.21.15.78:0/3828852478 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00092e0 con 0x7f5ff80c5810 2023-08-17T17:49:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ff67fc700 1 -- 172.21.15.78:0/3828852478 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0007610 con 0x7f5ff80c5810 2023-08-17T17:49:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f5ff67fc700 1 -- 172.21.15.78:0/3828852478 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00079d0 con 0x7f5ff80c5810 2023-08-17T17:49:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f6000621700 1 -- 172.21.15.78:0/3828852478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff80b04b0 con 0x7f5ff80c5810 2023-08-17T17:49:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.072+0000 7f6000621700 1 -- 172.21.15.78:0/3828852478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff80b0a70 con 0x7f5ff80c5810 2023-08-17T17:49:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.073+0000 7f6000621700 1 -- 172.21.15.78:0/3828852478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff80ae390 con 0x7f5ff80c5810 2023-08-17T17:49:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.074+0000 7f5ff67fc700 1 -- 172.21.15.78:0/3828852478 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5ff0026030 con 0x7f5ff80c5810 2023-08-17T17:49:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.074+0000 7f5ff67fc700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe405ed90 0x7f5fe4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.074+0000 7f5ff67fc700 1 -- 172.21.15.78:0/3828852478 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ff007b7b0 con 0x7f5ff80c5810 2023-08-17T17:49:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.074+0000 7f5ffe3bd700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe405ed90 0x7f5fe4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.075+0000 7f5ffe3bd700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe405ed90 0x7f5fe4061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5fe8003630 tx=0x7f5fe8009040).ready entity=mgr.6066 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:30.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.078+0000 7f5ff67fc700 1 -- 172.21.15.78:0/3828852478 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ff004ce00 con 0x7f5ff80c5810 2023-08-17T17:49:30.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:30.282+0000 7f6000621700 1 -- 172.21.15.78:0/3828852478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f5ff8046af0 con 0x7f5ff80c5810 2023-08-17T17:49:31.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.252+0000 7f5ff67fc700 1 -- 172.21.15.78:0/3828852478 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 25) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f5ff00796b0 con 0x7f5ff80c5810 2023-08-17T17:49:31.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.254+0000 7f5ff67fc700 1 -- 172.21.15.78:0/3828852478 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v25) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5ff00438e0 con 0x7f5ff80c5810 2023-08-17T17:49:31.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 -- 172.21.15.78:0/3828852478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe405ed90 msgr2=0x7f5fe4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe405ed90 0x7f5fe4061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5fe8003630 tx=0x7f5fe8009040).stop 2023-08-17T17:49:31.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 -- 172.21.15.78:0/3828852478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff80c5810 msgr2=0x7f5ff80afa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff80c5810 0x7f5ff80afa10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f5ff000be70 tx=0x7f5ff0009840).stop 2023-08-17T17:49:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 -- 172.21.15.78:0/3828852478 shutdown_connections 2023-08-17T17:49:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe405ed90 0x7f5fe4061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ff80c5810 0x7f5ff80afa10 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ff80aa0f0 0x7f5ff814bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 --2- 172.21.15.78:0/3828852478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff80aa4d0 0x7f5ff814d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 -- 172.21.15.78:0/3828852478 >> 172.21.15.78:0/3828852478 conn(0x7f5ff806a6a0 msgr2=0x7f5ff8153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:31.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 -- 172.21.15.78:0/3828852478 shutdown_connections 2023-08-17T17:49:31.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.256+0000 7f6000621700 1 -- 172.21.15.78:0/3828852478 wait complete. 2023-08-17T17:49:31.270 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-17T17:49:31.392 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:31.391+0000 7fa43575a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:49:31.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.392+0000 7f823b471700 1 Processor -- start 2023-08-17T17:49:31.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.392+0000 7f823b471700 1 -- start start 2023-08-17T17:49:31.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f823b471700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f823414e680 0x7f82340c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f823b471700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8234069a20 0x7f82340c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f823b471700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82340c5990 con 0x7f823414ea60 2023-08-17T17:49:31.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f823b471700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82340bcc10 con 0x7f823414e680 2023-08-17T17:49:31.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f823b471700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82340c4120 con 0x7f8234069a20 2023-08-17T17:49:31.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f823920d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f823414e680 0x7f82340c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:31.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f823920d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f823414e680 0x7f82340c2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58814/0 (socket says 172.21.15.78:58814) 2023-08-17T17:49:31.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f823920d700 1 -- 172.21.15.78:0/54632486 learned_addr learned my addr 172.21.15.78:0/54632486 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:31.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f8238a0c700 1 --1- 172.21.15.78:0/54632486 >> v1:172.21.15.78:6789/0 conn(0x7f823414ea60 0x7f8234069310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54978/0 (socket says 172.21.15.78:54978) 2023-08-17T17:49:31.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f8239a0e700 1 --2- 172.21.15.78:0/54632486 >> v2:172.21.15.150:3300/0 conn(0x7f8234069a20 0x7f82340c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:31.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f823920d700 1 -- 172.21.15.78:0/54632486 >> v2:172.21.15.150:3300/0 conn(0x7f8234069a20 msgr2=0x7f82340c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:31.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.393+0000 7f823920d700 1 --2- 172.21.15.78:0/54632486 >> v2:172.21.15.150:3300/0 conn(0x7f8234069a20 0x7f82340c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f823920d700 1 -- 172.21.15.78:0/54632486 >> v1:172.21.15.78:6789/0 conn(0x7f823414ea60 legacy=0x7f8234069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f822bfff700 1 -- 172.21.15.78:0/54632486 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007511749 0 0) 0x7f82340c5990 con 0x7f823414ea60 2023-08-17T17:49:31.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f823920d700 1 -- 172.21.15.78:0/54632486 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340c3880 con 0x7f823414e680 2023-08-17T17:49:31.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f823920d700 1 --2- 172.21.15.78:0/54632486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414e680 0x7f82340c2da0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f82340beaa0 tx=0x7f82240090f0).ready entity=mon.0 client_cookie=27a465c09597971b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:31.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f822bfff700 1 -- 172.21.15.78:0/54632486 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400b520 con 0x7f823414e680 2023-08-17T17:49:31.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f822bfff700 1 -- 172.21.15.78:0/54632486 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822400b680 con 0x7f823414e680 2023-08-17T17:49:31.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f822bfff700 1 -- 172.21.15.78:0/54632486 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400ba00 con 0x7f823414e680 2023-08-17T17:49:31.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f823b471700 1 -- 172.21.15.78:0/54632486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414e680 msgr2=0x7f82340c2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f823b471700 1 --2- 172.21.15.78:0/54632486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414e680 0x7f82340c2da0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f82340beaa0 tx=0x7f82240090f0).stop 2023-08-17T17:49:31.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f823b471700 1 -- 172.21.15.78:0/54632486 shutdown_connections 2023-08-17T17:49:31.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f823b471700 1 --2- 172.21.15.78:0/54632486 >> v2:172.21.15.150:3300/0 conn(0x7f8234069a20 0x7f82340c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f823b471700 1 --2- 172.21.15.78:0/54632486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414e680 0x7f82340c2da0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.394+0000 7f823b471700 1 -- 172.21.15.78:0/54632486 >> 172.21.15.78:0/54632486 conn(0x7f82340c7b80 msgr2=0x7f82340c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:31.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.395+0000 7f823b471700 1 -- 172.21.15.78:0/54632486 shutdown_connections 2023-08-17T17:49:31.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.395+0000 7f823b471700 1 -- 172.21.15.78:0/54632486 wait complete. 2023-08-17T17:49:31.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.396+0000 7f823b471700 1 Processor -- start 2023-08-17T17:49:31.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.396+0000 7f823b471700 1 -- start start 2023-08-17T17:49:31.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f823b471700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8234069a20 0x7f82340a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f823b471700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f823414e680 0x7f8234146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f823b471700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414ea60 0x7f82340a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f823b471700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340a8d30 con 0x7f823414ea60 2023-08-17T17:49:31.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f823b471700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340a8120 con 0x7f8234069a20 2023-08-17T17:49:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f823b471700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82340a8400 con 0x7f823414e680 2023-08-17T17:49:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f8239a0e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414ea60 0x7f82340a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f8239a0e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414ea60 0x7f82340a7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58826/0 (socket says 172.21.15.78:58826) 2023-08-17T17:49:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f8239a0e700 1 -- 172.21.15.78:0/3597325022 learned_addr learned my addr 172.21.15.78:0/3597325022 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f823920d700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8234069a20 0x7f82340a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f8238a0c700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f823414e680 0x7f8234146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f8239a0e700 1 -- 172.21.15.78:0/3597325022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f823414e680 msgr2=0x7f8234146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f8239a0e700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f823414e680 0x7f8234146960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f8239a0e700 1 -- 172.21.15.78:0/3597325022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8234069a20 msgr2=0x7f82340a91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f8239a0e700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8234069a20 0x7f82340a91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f8239a0e700 1 -- 172.21.15.78:0/3597325022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8224009370 con 0x7f823414ea60 2023-08-17T17:49:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f8239a0e700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414ea60 0x7f82340a7660 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f822c009ef0 tx=0x7f822c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:31.402 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f5b208c7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:49:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f82297fa700 1 -- 172.21.15.78:0/3597325022 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c00cb70 con 0x7f823414ea60 2023-08-17T17:49:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f82297fa700 1 -- 172.21.15.78:0/3597325022 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c00f040 con 0x7f823414ea60 2023-08-17T17:49:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f82297fa700 1 -- 172.21.15.78:0/3597325022 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c013400 con 0x7f823414ea60 2023-08-17T17:49:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f823b471700 1 -- 172.21.15.78:0/3597325022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82340a86e0 con 0x7f823414ea60 2023-08-17T17:49:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.397+0000 7f823b471700 1 -- 172.21.15.78:0/3597325022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8234157d90 con 0x7f823414ea60 2023-08-17T17:49:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.398+0000 7f823b471700 1 -- 172.21.15.78:0/3597325022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82340a8ea0 con 0x7f823414ea60 2023-08-17T17:49:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.399+0000 7f82297fa700 1 -- 172.21.15.78:0/3597325022 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f822c0137b0 con 0x7f823414ea60 2023-08-17T17:49:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.399+0000 7f82297fa700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f821805ede0 0x7f82180612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.399+0000 7f823920d700 1 -- 172.21.15.78:0/3597325022 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f821805ede0 msgr2=0x7f82180612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.399+0000 7f82297fa700 1 -- 172.21.15.78:0/3597325022 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f822c07a5a0 con 0x7f823414ea60 2023-08-17T17:49:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.399+0000 7f823920d700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f821805ede0 0x7f82180612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.403+0000 7f82297fa700 1 -- 172.21.15.78:0/3597325022 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f822c04bbc0 con 0x7f823414ea60 2023-08-17T17:49:31.456 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:31.455+0000 7fa43575a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:49:31.463 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:31.463+0000 7f5b208c7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:49:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.575+0000 7f823b471700 1 -- 172.21.15.78:0/3597325022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f82340c3b60 con 0x7f823414ea60 2023-08-17T17:49:31.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.579+0000 7f82297fa700 1 -- 172.21.15.78:0/3597325022 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7f822c04f1e0 con 0x7f823414ea60 2023-08-17T17:49:31.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 -- 172.21.15.78:0/3597325022 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f821805ede0 msgr2=0x7f82180612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:31.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f821805ede0 0x7f82180612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:31.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 -- 172.21.15.78:0/3597325022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414ea60 msgr2=0x7f82340a7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414ea60 0x7f82340a7660 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f822c009ef0 tx=0x7f822c00b040).stop 2023-08-17T17:49:31.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 -- 172.21.15.78:0/3597325022 shutdown_connections 2023-08-17T17:49:31.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f821805ede0 0x7f82180612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:31.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f823414ea60 0x7f82340a7660 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8234069a20 0x7f82340a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 --2- 172.21.15.78:0/3597325022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f823414e680 0x7f8234146960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 -- 172.21.15.78:0/3597325022 >> 172.21.15.78:0/3597325022 conn(0x7f82340c7b80 msgr2=0x7f82340bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 -- 172.21.15.78:0/3597325022 shutdown_connections 2023-08-17T17:49:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.581+0000 7f823b471700 1 -- 172.21.15.78:0/3597325022 wait complete. 2023-08-17T17:49:31.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:49:31.593 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-17T17:49:31.611 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-17T17:49:31.731 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:31.731+0000 7fa43575a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:49:31.747 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:31.746+0000 7f5b208c7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:49:31.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.769+0000 7fec71ef1700 1 Processor -- start 2023-08-17T17:49:31.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.770+0000 7fec71ef1700 1 -- start start 2023-08-17T17:49:31.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.770+0000 7fec71ef1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c063aa0 0x7fec6c0c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.770+0000 7fec71ef1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c0bcc80 con 0x7fec6c0c2810 2023-08-17T17:49:31.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.770+0000 7fec71ef1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c0bced0 con 0x7fec6c0c37f0 2023-08-17T17:49:31.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.770+0000 7fec71ef1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0bd1b0 con 0x7fec6c063aa0 2023-08-17T17:49:31.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec6b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fec6c0c2810 0x7fec6c0c2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54988/0 (socket says 172.21.15.78:54988) 2023-08-17T17:49:31.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec6b7fe700 1 -- 172.21.15.78:0/3605688632 learned_addr learned my addr 172.21.15.78:0/3605688632 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:31.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec63fff700 1 --2- 172.21.15.78:0/3605688632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c063aa0 0x7fec6c0c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:31.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec6affd700 1 -- 172.21.15.78:0/3605688632 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377996099 0 0) 0x7fec6c0bcc80 con 0x7fec6c0c2810 2023-08-17T17:49:31.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec6affd700 1 -- 172.21.15.78:0/3605688632 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec580033f0 con 0x7fec6c0c2810 2023-08-17T17:49:31.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec63fff700 1 -- 172.21.15.78:0/3605688632 >> v1:172.21.15.150:6789/0 conn(0x7fec6c0c37f0 legacy=0x7fec6c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec6affd700 1 -- 172.21.15.78:0/3605688632 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487158347 0 0) 0x7fec6c0bced0 con 0x7fec6c0c37f0 2023-08-17T17:49:31.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec63fff700 1 -- 172.21.15.78:0/3605688632 >> v1:172.21.15.78:6789/0 conn(0x7fec6c0c2810 legacy=0x7fec6c0c2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec63fff700 1 -- 172.21.15.78:0/3605688632 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c0bd490 con 0x7fec6c063aa0 2023-08-17T17:49:31.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec63fff700 1 --2- 172.21.15.78:0/3605688632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c063aa0 0x7fec6c0c3300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fec54009790 tx=0x7fec54009060).ready entity=mon.2 client_cookie=4cd2200abb23f7ee server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:31.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec6affd700 1 -- 172.21.15.78:0/3605688632 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0015f0 con 0x7fec6c063aa0 2023-08-17T17:49:31.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec6affd700 1 -- 172.21.15.78:0/3605688632 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec54012410 con 0x7fec6c063aa0 2023-08-17T17:49:31.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.771+0000 7fec6affd700 1 -- 172.21.15.78:0/3605688632 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54012790 con 0x7fec6c063aa0 2023-08-17T17:49:31.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.772+0000 7fec71ef1700 1 -- 172.21.15.78:0/3605688632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c063aa0 msgr2=0x7fec6c0c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.772+0000 7fec71ef1700 1 --2- 172.21.15.78:0/3605688632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c063aa0 0x7fec6c0c3300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fec54009790 tx=0x7fec54009060).stop 2023-08-17T17:49:31.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.772+0000 7fec71ef1700 1 -- 172.21.15.78:0/3605688632 shutdown_connections 2023-08-17T17:49:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.772+0000 7fec71ef1700 1 --2- 172.21.15.78:0/3605688632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c063aa0 0x7fec6c0c3300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.772+0000 7fec71ef1700 1 -- 172.21.15.78:0/3605688632 >> 172.21.15.78:0/3605688632 conn(0x7fec6c0c3db0 msgr2=0x7fec6c0c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.772+0000 7fec71ef1700 1 -- 172.21.15.78:0/3605688632 shutdown_connections 2023-08-17T17:49:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.772+0000 7fec71ef1700 1 -- 172.21.15.78:0/3605688632 wait complete. 2023-08-17T17:49:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.773+0000 7fec71ef1700 1 Processor -- start 2023-08-17T17:49:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.773+0000 7fec71ef1700 1 -- start start 2023-08-17T17:49:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec71ef1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c063aa0 0x7fec6c151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec71ef1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6c0c2810 0x7fec6c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec71ef1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c0c37f0 0x7fec6c14a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec71ef1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0a7ab0 con 0x7fec6c0c37f0 2023-08-17T17:49:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec71ef1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0a6ea0 con 0x7fec6c0c2810 2023-08-17T17:49:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec71ef1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0a7180 con 0x7fec6c063aa0 2023-08-17T17:49:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c0c37f0 0x7fec6c14a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c063aa0 0x7fec6c151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec63fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6c0c2810 0x7fec6c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c063aa0 0x7fec6c151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:42076/0 (socket says 172.21.15.78:42076) 2023-08-17T17:49:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c0c37f0 0x7fec6c14a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58840/0 (socket says 172.21.15.78:58840) 2023-08-17T17:49:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec6b7fe700 1 -- 172.21.15.78:0/1014656009 learned_addr learned my addr 172.21.15.78:0/1014656009 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec6b7fe700 1 -- 172.21.15.78:0/1014656009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6c0c2810 msgr2=0x7fec6c154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec6b7fe700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6c0c2810 0x7fec6c154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec6b7fe700 1 -- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c0c37f0 msgr2=0x7fec6c14a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.774+0000 7fec6b7fe700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c0c37f0 0x7fec6c14a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.775+0000 7fec6b7fe700 1 -- 172.21.15.78:0/1014656009 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec540092a0 con 0x7fec6c063aa0 2023-08-17T17:49:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.775+0000 7fec6bfff700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c0c37f0 0x7fec6c14a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.775+0000 7fec6b7fe700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c063aa0 0x7fec6c151530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fec5c00c870 tx=0x7fec5c002c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.775+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c007320 con 0x7fec6c063aa0 2023-08-17T17:49:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.775+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c0074a0 con 0x7fec6c063aa0 2023-08-17T17:49:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.775+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0058c0 con 0x7fec6c063aa0 2023-08-17T17:49:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.775+0000 7fec71ef1700 1 -- 172.21.15.78:0/1014656009 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c0a7460 con 0x7fec6c063aa0 2023-08-17T17:49:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.775+0000 7fec71ef1700 1 -- 172.21.15.78:0/1014656009 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c154670 con 0x7fec6c063aa0 2023-08-17T17:49:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.776+0000 7fec71ef1700 1 -- 172.21.15.78:0/1014656009 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c0676a0 con 0x7fec6c063aa0 2023-08-17T17:49:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.776+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 25) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fec5c010030 con 0x7fec6c063aa0 2023-08-17T17:49:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.776+0000 7fec637fe700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 0x7fec4c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.776+0000 7fec63fff700 1 -- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 msgr2=0x7fec4c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.777+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fec5c079a00 con 0x7fec6c063aa0 2023-08-17T17:49:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.777+0000 7fec63fff700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 0x7fec4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.781+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec5c04afa0 con 0x7fec6c063aa0 2023-08-17T17:49:31.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.975+0000 7fec71ef1700 1 -- 172.21.15.78:0/1014656009 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fec6c0c48d0 con 0x7fec4c05ede0 2023-08-17T17:49:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.978+0000 7fec63fff700 1 -- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 msgr2=0x7fec4c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:31.978+0000 7fec63fff700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 0x7fec4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:32.342 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:32.341+0000 7fa43575a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:49:32.362 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:32.361+0000 7f5b208c7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:49:32.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:32.379+0000 7fec63fff700 1 -- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 msgr2=0x7fec4c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:32.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:32.379+0000 7fec63fff700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 0x7fec4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T17:49:32.413 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:32.413+0000 7fa43575a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:49:32.435 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:32.434+0000 7f5b208c7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:49:32.600 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:32.599+0000 7fa43575a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:49:32.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:49:32.618 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:49:32.620 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:32.619+0000 7f5b208c7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:49:33.024 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:33.024+0000 7fa43575a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:49:33.041 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:33.040+0000 7f5b208c7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:49:33.127 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:33.126+0000 7fa43575a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:33.144 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:33.143+0000 7f5b208c7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:33.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:33.180+0000 7fec63fff700 1 -- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 msgr2=0x7fec4c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:33.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:33.180+0000 7fec63fff700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 0x7fec4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T17:49:33.279 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:33.278+0000 7fa43575a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:33.295 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:33.294+0000 7f5b208c7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:33.353 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:33.353+0000 7fa43575a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:49:33.369 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:33.368+0000 7f5b208c7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:49:33.421 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:33.420+0000 7fa43575a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:49:33.436 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:33.435+0000 7f5b208c7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:49:33.677 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:33.676+0000 7fa43575a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:49:33.692 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:33.691+0000 7f5b208c7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:49:33.861 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:33.861+0000 7fa43575a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:33.877 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:33.876+0000 7f5b208c7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:34.507 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:34.506+0000 7fa43575a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:49:34.520 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:34.519+0000 7f5b208c7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:49:34.574 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:34.574+0000 7fa43575a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:49:34.588 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:34.587+0000 7f5b208c7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:49:34.649 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:34.648+0000 7fa43575a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:49:34.663 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:34.662+0000 7f5b208c7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:49:34.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:34.781+0000 7fec63fff700 1 -- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 msgr2=0x7fec4c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:34.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:34.781+0000 7fec63fff700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 0x7fec4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-17T17:49:34.793 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:34.792+0000 7fa43575a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:49:34.808 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:34.807+0000 7f5b208c7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:49:34.863 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:34.862+0000 7fa43575a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:49:34.878 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:34.877+0000 7f5b208c7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:49:34.978 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:34.977+0000 7fa43575a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:49:34.992 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:34.991+0000 7f5b208c7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:49:35.084 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:35.084+0000 7fa43575a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:35.097 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.096+0000 7f5b208c7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:35.378 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:35.377+0000 7fa43575a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:49:35.385 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.384+0000 7f5b208c7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:49:35.447 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:35.447+0000 7fa43575a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:49:35.456 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.455+0000 7f5b208c7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:49:35.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:35.475+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mgrmap(e 26) v1 ==== 75109+0+0 (secure 0 0 0) 0x7fec5c077900 con 0x7fec6c063aa0 2023-08-17T17:49:35.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:35.475+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 msgr2=0x7fec4c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:35.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:35.476+0000 7fec637fe700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 0x7fec4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:35.549 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.548+0000 7f5a9c09f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:35.550 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.548+0000 7f5a9c09f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:35.550 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.548+0000 7f5a9c09f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:35.550 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.548+0000 7f5a9c09f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:35.550 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.548+0000 7f5a9c09f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:35.550 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.548+0000 7f5a9f0a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:35.550 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.548+0000 7f5a9f0a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:35.550 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.548+0000 7f5a9f0a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:35.551 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.548+0000 7f5a9f0a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:35.551 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:35.548+0000 7f5a9f0a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:36.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.480+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 <== mon.2 v2:172.21.15.150:3301/0 8 ==== mgrmap(e 27) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fec5c077c80 con 0x7fec6c063aa0 2023-08-17T17:49:36.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.480+0000 7fec637fe700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 0x7fec4c02fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:36.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.480+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fec6c0c48d0 con 0x7fec4c05ede0 2023-08-17T17:49:36.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.499+0000 7fec63fff700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 0x7fec4c02fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:36.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.500+0000 7fec63fff700 1 --2- 172.21.15.78:0/1014656009 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fec4c05ede0 0x7fec4c02fd40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fec6c063f00 tx=0x7fec54009060).ready entity=mgr.6459 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:36.502 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:36.501+0000 7f5ace34e700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-17T17:49:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.501+0000 7fec637fe700 1 -- 172.21.15.78:0/1014656009 <== mgr.6459 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fec6c0c48d0 con 0x7fec4c05ede0 2023-08-17T17:49:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-17T17:49:36.508 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-17T17:49:36.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:49:36.509 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-17T17:49:36.527 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-17T17:49:36.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.687+0000 7f9b5a2d0700 1 Processor -- start 2023-08-17T17:49:36.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.687+0000 7f9b5a2d0700 1 -- start start 2023-08-17T17:49:36.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.688+0000 7f9b5a2d0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b541582f0 0x7f9b540c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:36.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.688+0000 7f9b5a2d0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b540c6620 con 0x7f9b54151a40 2023-08-17T17:49:36.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.688+0000 7f9b5a2d0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b540c6900 con 0x7f9b54151e20 2023-08-17T17:49:36.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.688+0000 7f9b5a2d0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540c6be0 con 0x7f9b541582f0 2023-08-17T17:49:36.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.688+0000 7f9b592ce700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9b54151a40 0x7f9b540c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54994/0 (socket says 172.21.15.78:54994) 2023-08-17T17:49:36.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.688+0000 7f9b592ce700 1 -- 172.21.15.78:0/1731781768 learned_addr learned my addr 172.21.15.78:0/1731781768 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:36.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b59acf700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b541582f0 0x7f9b540c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:36.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082498267 0 0) 0x7f9b540c6620 con 0x7f9b54151a40 2023-08-17T17:49:36.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b400033f0 con 0x7f9b54151a40 2023-08-17T17:49:36.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696978812 0 0) 0x7f9b540c6900 con 0x7f9b54151e20 2023-08-17T17:49:36.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b540c6620 con 0x7f9b54151e20 2023-08-17T17:49:36.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1215386165 0 0) 0x7f9b400033f0 con 0x7f9b54151a40 2023-08-17T17:49:36.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b541582f0 msgr2=0x7f9b540c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:36.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b541582f0 0x7f9b540c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:36.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 >> v1:172.21.15.150:6789/0 conn(0x7f9b54151e20 legacy=0x7f9b54157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:36.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b540c6ec0 con 0x7f9b54151a40 2023-08-17T17:49:36.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f9b500015f0 con 0x7f9b54151a40 2023-08-17T17:49:36.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 >> v1:172.21.15.78:6789/0 conn(0x7f9b54151a40 legacy=0x7f9b540c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:36.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b541582f0 0x7f9b40003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:36.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b40003fb0 0x7f9b40004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:36.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b40004b80 0x7f9b40005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:36.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540c6be0 con 0x7f9b40003fb0 2023-08-17T17:49:36.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4000b990 con 0x7f9b40004b80 2023-08-17T17:49:36.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4000bb50 con 0x7f9b541582f0 2023-08-17T17:49:36.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b58acd700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b40003fb0 0x7f9b40004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:36.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b592ce700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b541582f0 0x7f9b40003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:36.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b59acf700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b40004b80 0x7f9b40005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:36.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b58acd700 1 -- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b541582f0 msgr2=0x7f9b40003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:36.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b58acd700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b541582f0 0x7f9b40003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:36.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b58acd700 1 -- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b40004b80 msgr2=0x7f9b40005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:36.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b58acd700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b40004b80 0x7f9b40005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:36.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.689+0000 7f9b58acd700 1 -- 172.21.15.78:0/1731781768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b400033f0 con 0x7f9b40003fb0 2023-08-17T17:49:36.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b58acd700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b40003fb0 0x7f9b40004690 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f9b440018e0 tx=0x7f9b44007c00).ready entity=mon.0 client_cookie=2f8f879d31e33e77 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:36.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44007020 con 0x7f9b40003fb0 2023-08-17T17:49:36.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b44007180 con 0x7f9b40003fb0 2023-08-17T17:49:36.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b4bfff700 1 -- 172.21.15.78:0/1731781768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44007520 con 0x7f9b40003fb0 2023-08-17T17:49:36.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1731781768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b40003fb0 msgr2=0x7f9b40004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:36.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b5a2d0700 1 --2- 172.21.15.78:0/1731781768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b40003fb0 0x7f9b40004690 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f9b440018e0 tx=0x7f9b44007c00).stop 2023-08-17T17:49:36.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b59acf700 1 -- 172.21.15.78:0/1731781768 reap_dead start 2023-08-17T17:49:36.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1731781768 shutdown_connections 2023-08-17T17:49:36.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1731781768 >> 172.21.15.78:0/1731781768 conn(0x7f9b540943b0 msgr2=0x7f9b5406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:36.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1731781768 shutdown_connections 2023-08-17T17:49:36.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.690+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1731781768 wait complete. 2023-08-17T17:49:36.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.691+0000 7f9b5a2d0700 1 Processor -- start 2023-08-17T17:49:36.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.691+0000 7f9b5a2d0700 1 -- start start 2023-08-17T17:49:36.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.692+0000 7f9b5a2d0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b40003fb0 0x7f9b540aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:36.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.692+0000 7f9b5a2d0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b540c46d0 0x7f9b5414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:36.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.692+0000 7f9b5a2d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156940 0x7f9b54156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:36.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.692+0000 7f9b5a2d0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540abb40 con 0x7f9b54156940 2023-08-17T17:49:36.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.692+0000 7f9b5a2d0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54157290 con 0x7f9b540c46d0 2023-08-17T17:49:36.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.692+0000 7f9b5a2d0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540aaf30 con 0x7f9b40003fb0 2023-08-17T17:49:36.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.692+0000 7f9b59acf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156940 0x7f9b54156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:36.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.692+0000 7f9b59acf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156940 0x7f9b54156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58960/0 (socket says 172.21.15.78:58960) 2023-08-17T17:49:36.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.692+0000 7f9b59acf700 1 -- 172.21.15.78:0/1104468702 learned_addr learned my addr 172.21.15.78:0/1104468702 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:36.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b592ce700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b40003fb0 0x7f9b540aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:36.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b58acd700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b540c46d0 0x7f9b5414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:36.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b59acf700 1 -- 172.21.15.78:0/1104468702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b40003fb0 msgr2=0x7f9b540aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:36.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b59acf700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b40003fb0 0x7f9b540aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:36.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b59acf700 1 -- 172.21.15.78:0/1104468702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b540c46d0 msgr2=0x7f9b5414bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:36.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b59acf700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b540c46d0 0x7f9b5414bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:36.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b59acf700 1 -- 172.21.15.78:0/1104468702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b540ab210 con 0x7f9b54156940 2023-08-17T17:49:36.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b59acf700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156940 0x7f9b54156da0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f9b54155790 tx=0x7f9b4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:36.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b497fa700 1 -- 172.21.15.78:0/1104468702 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00e040 con 0x7f9b54156940 2023-08-17T17:49:36.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b497fa700 1 -- 172.21.15.78:0/1104468702 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c00f040 con 0x7f9b54156940 2023-08-17T17:49:36.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b497fa700 1 -- 172.21.15.78:0/1104468702 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00fe20 con 0x7f9b54156940 2023-08-17T17:49:36.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1104468702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b540ab4f0 con 0x7f9b54156940 2023-08-17T17:49:36.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.693+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1104468702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b540c4b50 con 0x7f9b54156940 2023-08-17T17:49:36.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.694+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1104468702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b54082f90 con 0x7f9b54156940 2023-08-17T17:49:36.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.694+0000 7f9b497fa700 1 -- 172.21.15.78:0/1104468702 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 27) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f9b4c015660 con 0x7f9b54156940 2023-08-17T17:49:36.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.695+0000 7f9b497fa700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b3805ed40 0x7f9b38061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:36.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.695+0000 7f9b497fa700 1 -- 172.21.15.78:0/1104468702 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9b4c07a7a0 con 0x7f9b54156940 2023-08-17T17:49:36.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.695+0000 7f9b592ce700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b3805ed40 0x7f9b38061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:36.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.695+0000 7f9b592ce700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b3805ed40 0x7f9b38061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9b50002e10 tx=0x7f9b50009040).ready entity=mgr.6459 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:36.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.699+0000 7f9b497fa700 1 -- 172.21.15.78:0/1104468702 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b4c04bcd0 con 0x7f9b54156940 2023-08-17T17:49:36.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:36.904+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1104468702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f9b5405f910 con 0x7f9b54156940 2023-08-17T17:49:37.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.529+0000 7f9b497fa700 1 -- 172.21.15.78:0/1104468702 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f9b4c078690 con 0x7f9b54156940 2023-08-17T17:49:37.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.530+0000 7f9b497fa700 1 -- 172.21.15.78:0/1104468702 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v28) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9b4c0710f0 con 0x7f9b54156940 2023-08-17T17:49:37.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.532+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1104468702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b3805ed40 msgr2=0x7f9b38061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:37.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.532+0000 7f9b5a2d0700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b3805ed40 0x7f9b38061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9b50002e10 tx=0x7f9b50009040).stop 2023-08-17T17:49:37.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.532+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1104468702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156940 msgr2=0x7f9b54156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:37.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.532+0000 7f9b5a2d0700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156940 0x7f9b54156da0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f9b54155790 tx=0x7f9b4c00b040).stop 2023-08-17T17:49:37.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.532+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1104468702 shutdown_connections 2023-08-17T17:49:37.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.532+0000 7f9b5a2d0700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9b3805ed40 0x7f9b38061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:37.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.532+0000 7f9b5a2d0700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156940 0x7f9b54156da0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:37.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.532+0000 7f9b5a2d0700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b40003fb0 0x7f9b540aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:37.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.532+0000 7f9b5a2d0700 1 --2- 172.21.15.78:0/1104468702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b540c46d0 0x7f9b5414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:37.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.532+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1104468702 >> 172.21.15.78:0/1104468702 conn(0x7f9b540943b0 msgr2=0x7f9b5414c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:37.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.533+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1104468702 shutdown_connections 2023-08-17T17:49:37.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.533+0000 7f9b5a2d0700 1 -- 172.21.15.78:0/1104468702 wait complete. 2023-08-17T17:49:37.547 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:49:37.547 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:49:37.583 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:49:37.621 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:49:37.621 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T17:49:37.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:49:37.622 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T17:49:37.666 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:49:37.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:49:37.667 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T17:49:37.674 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:37.673+0000 7fce70bc4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:49:37.678 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:37.678+0000 7f56436f2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:49:37.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:37.741 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:37.740+0000 7fce70bc4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:49:37.743 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:37.743+0000 7f56436f2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:49:37.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.844+0000 7f999e2ae700 1 Processor -- start 2023-08-17T17:49:37.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.844+0000 7f999e2ae700 1 -- start start 2023-08-17T17:49:37.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.845+0000 7f999e2ae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9998069760 0x7f999815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:37.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.845+0000 7f999e2ae700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99980c2c10 con 0x7f999806a2c0 2023-08-17T17:49:37.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.845+0000 7f999e2ae700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99981552e0 con 0x7f999813a640 2023-08-17T17:49:37.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.845+0000 7f999e2ae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99981555c0 con 0x7f9998069760 2023-08-17T17:49:37.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.845+0000 7f99977fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f999806a2c0 0x7f9998069050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55024/0 (socket says 172.21.15.78:55024) 2023-08-17T17:49:37.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.845+0000 7f99977fe700 1 -- 172.21.15.78:0/562940911 learned_addr learned my addr 172.21.15.78:0/562940911 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:37.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f999c84b700 1 --2- 172.21.15.78:0/562940911 >> v2:172.21.15.150:3300/0 conn(0x7f9998069760 0x7f999815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:37.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f9996ffd700 1 -- 172.21.15.78:0/562940911 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420648211 0 0) 0x7f99980c2c10 con 0x7f999806a2c0 2023-08-17T17:49:37.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f9996ffd700 1 -- 172.21.15.78:0/562940911 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99800033f0 con 0x7f999806a2c0 2023-08-17T17:49:37.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f999c84b700 1 -- 172.21.15.78:0/562940911 >> v1:172.21.15.150:6789/0 conn(0x7f999813a640 legacy=0x7f9998154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:37.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f9996ffd700 1 -- 172.21.15.78:0/562940911 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 138286445 0 0) 0x7f99800033f0 con 0x7f999806a2c0 2023-08-17T17:49:37.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f999c84b700 1 -- 172.21.15.78:0/562940911 >> v1:172.21.15.78:6789/0 conn(0x7f999806a2c0 legacy=0x7f9998069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:37.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f999c84b700 1 -- 172.21.15.78:0/562940911 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99981558a0 con 0x7f9998069760 2023-08-17T17:49:37.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f999c84b700 1 --2- 172.21.15.78:0/562940911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9998069760 0x7f999815bec0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f9990009e60 tx=0x7f9990009780).ready entity=mon.1 client_cookie=fb4ea7b1e490635e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:37.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f9996ffd700 1 -- 172.21.15.78:0/562940911 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999000e070 con 0x7f9998069760 2023-08-17T17:49:37.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f9996ffd700 1 -- 172.21.15.78:0/562940911 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999000b850 con 0x7f9998069760 2023-08-17T17:49:37.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.846+0000 7f9996ffd700 1 -- 172.21.15.78:0/562940911 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988001470 con 0x7f9998069760 2023-08-17T17:49:37.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.847+0000 7f999e2ae700 1 -- 172.21.15.78:0/562940911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9998069760 msgr2=0x7f999815bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:37.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.847+0000 7f999e2ae700 1 --2- 172.21.15.78:0/562940911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9998069760 0x7f999815bec0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f9990009e60 tx=0x7f9990009780).stop 2023-08-17T17:49:37.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.847+0000 7f999e2ae700 1 -- 172.21.15.78:0/562940911 shutdown_connections 2023-08-17T17:49:37.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.847+0000 7f999e2ae700 1 --2- 172.21.15.78:0/562940911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9998069760 0x7f999815bec0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:37.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.847+0000 7f999e2ae700 1 -- 172.21.15.78:0/562940911 >> 172.21.15.78:0/562940911 conn(0x7f99980c7b00 msgr2=0x7f99980c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:37.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.847+0000 7f999e2ae700 1 -- 172.21.15.78:0/562940911 shutdown_connections 2023-08-17T17:49:37.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.847+0000 7f999e2ae700 1 -- 172.21.15.78:0/562940911 wait complete. 2023-08-17T17:49:37.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.848+0000 7f999e2ae700 1 Processor -- start 2023-08-17T17:49:37.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.848+0000 7f999e2ae700 1 -- start start 2023-08-17T17:49:37.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f999e2ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9998069760 0x7f99980a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:37.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f999e2ae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f999806a2c0 0x7f99980ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:37.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f999e2ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f999813a640 0x7f9998151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:37.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f999e2ae700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99980ac310 con 0x7f999806a2c0 2023-08-17T17:49:37.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f999e2ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99980ac5f0 con 0x7f999813a640 2023-08-17T17:49:37.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f999e2ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99980ac8d0 con 0x7f9998069760 2023-08-17T17:49:37.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f99977fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f999806a2c0 0x7f99980ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:37.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f99977fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f999806a2c0 0x7f99980ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59000/0 (socket says 172.21.15.78:59000) 2023-08-17T17:49:37.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f99977fe700 1 -- 172.21.15.78:0/1310075273 learned_addr learned my addr 172.21.15.78:0/1310075273 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:37.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f9997fff700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9998069760 0x7f99980a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:37.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f999c84b700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f999813a640 0x7f9998151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:37.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f99977fe700 1 -- 172.21.15.78:0/1310075273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9998069760 msgr2=0x7f99980a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:37.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f99977fe700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9998069760 0x7f99980a83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:37.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f99977fe700 1 -- 172.21.15.78:0/1310075273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f999813a640 msgr2=0x7f9998151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:37.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f99977fe700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f999813a640 0x7f9998151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:37.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.849+0000 7f99977fe700 1 -- 172.21.15.78:0/1310075273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9990009a20 con 0x7f999806a2c0 2023-08-17T17:49:37.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.850+0000 7f99977fe700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f999806a2c0 0x7f99980ad3b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f998800c730 tx=0x7f9988001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:37.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.850+0000 7f997ffff700 1 -- 172.21.15.78:0/1310075273 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988007170 con 0x7f999806a2c0 2023-08-17T17:49:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.850+0000 7f997ffff700 1 -- 172.21.15.78:0/1310075273 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9988007310 con 0x7f999806a2c0 2023-08-17T17:49:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.850+0000 7f997ffff700 1 -- 172.21.15.78:0/1310075273 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99880048c0 con 0x7f999806a2c0 2023-08-17T17:49:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.850+0000 7f999e2ae700 1 -- 172.21.15.78:0/1310075273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99980acbb0 con 0x7f999806a2c0 2023-08-17T17:49:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.850+0000 7f999e2ae700 1 -- 172.21.15.78:0/1310075273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99980ad8a0 con 0x7f999806a2c0 2023-08-17T17:49:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.851+0000 7f997ffff700 1 -- 172.21.15.78:0/1310075273 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f9988004c30 con 0x7f999806a2c0 2023-08-17T17:49:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.851+0000 7f999e2ae700 1 -- 172.21.15.78:0/1310075273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99980ad0d0 con 0x7f999806a2c0 2023-08-17T17:49:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.851+0000 7f997ffff700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f998405ee10 0x7f99840612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.852+0000 7f9997fff700 1 -- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f998405ee10 msgr2=0x7f99840612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:37.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.852+0000 7f997ffff700 1 -- 172.21.15.78:0/1310075273 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9988079820 con 0x7f999806a2c0 2023-08-17T17:49:37.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.852+0000 7f9997fff700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f998405ee10 0x7f99840612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:37.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:37.856+0000 7f997ffff700 1 -- 172.21.15.78:0/1310075273 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99980ad0d0 con 0x7f999806a2c0 2023-08-17T17:49:38.019 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:38.019+0000 7f56436f2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:49:38.045 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:38.044+0000 7fce70bc4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:49:38.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.053+0000 7f9997fff700 1 -- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f998405ee10 msgr2=0x7f99840612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:38.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.053+0000 7f9997fff700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f998405ee10 0x7f99840612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:38.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.088+0000 7f999e2ae700 1 -- 172.21.15.78:0/1310075273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99980ad0d0 con 0x7f999806a2c0 2023-08-17T17:49:38.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.088+0000 7f997ffff700 1 -- 172.21.15.78:0/1310075273 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f99980ad0d0 con 0x7f999806a2c0 2023-08-17T17:49:38.090 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:38.090 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2895715400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2895715400},{"type":"v1","addr":"172.21.15.150:6834","nonce":2895715400}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1604940701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1604940701},{"type":"v1","addr":"172.21.15.78:6836","nonce":1604940701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6234,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1676496794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1676496794},{"type":"v1","addr":"172.21.15.78:6837","nonce":1676496794}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:19.673872+0000","modified":"2023-08-17T17:49:21.684217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6246":{"gid":6246,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3219133912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3219133912},{"type":"v1","addr":"172.21.15.150:6835","nonce":3219133912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T17:49:38.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 -- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f998405ee10 msgr2=0x7f99840612d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:38.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f998405ee10 0x7f99840612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:38.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 -- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f999806a2c0 msgr2=0x7f99980ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f999806a2c0 0x7f99980ad3b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f998800c730 tx=0x7f9988001aa0).stop 2023-08-17T17:49:38.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 -- 172.21.15.78:0/1310075273 shutdown_connections 2023-08-17T17:49:38.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f998405ee10 0x7f99840612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:38.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f999813a640 0x7f9998151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9998069760 0x7f99980a83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 --2- 172.21.15.78:0/1310075273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f999806a2c0 0x7f99980ad3b0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 -- 172.21.15.78:0/1310075273 >> 172.21.15.78:0/1310075273 conn(0x7f99980c7b00 msgr2=0x7f99980c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:38.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 -- 172.21.15.78:0/1310075273 shutdown_connections 2023-08-17T17:49:38.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.090+0000 7f999e2ae700 1 -- 172.21.15.78:0/1310075273 wait complete. 2023-08-17T17:49:38.094 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 25 2023-08-17T17:49:38.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:38.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.259+0000 7f185ec1e700 1 Processor -- start 2023-08-17T17:49:38.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.259+0000 7f185ec1e700 1 -- start start 2023-08-17T17:49:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185ec1e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1858066660 0x7f18580c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185ec1e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1858066a40 0x7f1858151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185ec1e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18580c6040 con 0x7f18580c5b50 2023-08-17T17:49:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185ec1e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1858069b00 con 0x7f1858066a40 2023-08-17T17:49:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185ec1e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1858069f90 con 0x7f1858066660 2023-08-17T17:49:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185d1bb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1858066a40 0x7f1858151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f1857fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f18580c5b50 0x7f18580624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55040/0 (socket says 172.21.15.78:55040) 2023-08-17T17:49:38.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185d1bb700 1 --2- 172.21.15.78:0/1628089278 >> v2:172.21.15.78:3300/0 conn(0x7f1858066a40 0x7f1858151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59016/0 (socket says 172.21.15.78:59016) 2023-08-17T17:49:38.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f1857fff700 1 -- 172.21.15.78:0/1628089278 learned_addr learned my addr 172.21.15.78:0/1628089278 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:38.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185c9ba700 1 --2- 172.21.15.78:0/1628089278 >> v2:172.21.15.150:3300/0 conn(0x7f1858066660 0x7f18580c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185d1bb700 1 -- 172.21.15.78:0/1628089278 >> v2:172.21.15.150:3300/0 conn(0x7f1858066660 msgr2=0x7f18580c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:38.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185d1bb700 1 --2- 172.21.15.78:0/1628089278 >> v2:172.21.15.150:3300/0 conn(0x7f1858066660 0x7f18580c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185d1bb700 1 -- 172.21.15.78:0/1628089278 >> v1:172.21.15.78:6789/0 conn(0x7f18580c5b50 legacy=0x7f18580624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185d1bb700 1 -- 172.21.15.78:0/1628089278 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18580691d0 con 0x7f1858066a40 2023-08-17T17:49:38.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f185d1bb700 1 --2- 172.21.15.78:0/1628089278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 0x7f1858151570 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f1858068550 tx=0x7f1850009780).ready entity=mon.0 client_cookie=ada81392b49c5f2a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:38.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f18577fe700 1 -- 172.21.15.78:0/1628089278 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185000e070 con 0x7f1858066a40 2023-08-17T17:49:38.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.260+0000 7f18577fe700 1 -- 172.21.15.78:0/1628089278 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185000bb60 con 0x7f1858066a40 2023-08-17T17:49:38.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.261+0000 7f18577fe700 1 -- 172.21.15.78:0/1628089278 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1850012410 con 0x7f1858066a40 2023-08-17T17:49:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.261+0000 7f185ec1e700 1 -- 172.21.15.78:0/1628089278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 msgr2=0x7f1858151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.261+0000 7f185ec1e700 1 --2- 172.21.15.78:0/1628089278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 0x7f1858151570 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f1858068550 tx=0x7f1850009780).stop 2023-08-17T17:49:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.261+0000 7f185ec1e700 1 -- 172.21.15.78:0/1628089278 shutdown_connections 2023-08-17T17:49:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.261+0000 7f185ec1e700 1 --2- 172.21.15.78:0/1628089278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 0x7f1858151570 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.261+0000 7f185ec1e700 1 --2- 172.21.15.78:0/1628089278 >> v2:172.21.15.150:3300/0 conn(0x7f1858066660 0x7f18580c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.261+0000 7f185ec1e700 1 -- 172.21.15.78:0/1628089278 >> 172.21.15.78:0/1628089278 conn(0x7f18580c7b00 msgr2=0x7f18580c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.261+0000 7f185ec1e700 1 -- 172.21.15.78:0/1628089278 shutdown_connections 2023-08-17T17:49:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.261+0000 7f185ec1e700 1 -- 172.21.15.78:0/1628089278 wait complete. 2023-08-17T17:49:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.262+0000 7f185ec1e700 1 Processor -- start 2023-08-17T17:49:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.262+0000 7f185ec1e700 1 -- start start 2023-08-17T17:49:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f185ec1e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1858066660 0x7f18580beba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f185ec1e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 0x7f18581686e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f185ec1e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18580c5b50 0x7f1858148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f185ec1e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18580bfeb0 con 0x7f1858066a40 2023-08-17T17:49:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f185ec1e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1858168bd0 con 0x7f18580c5b50 2023-08-17T17:49:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f185ec1e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1858148840 con 0x7f1858066660 2023-08-17T17:49:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f1857fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 0x7f18581686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f1857fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 0x7f18581686e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59024/0 (socket says 172.21.15.78:59024) 2023-08-17T17:49:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f1857fff700 1 -- 172.21.15.78:0/2001104916 learned_addr learned my addr 172.21.15.78:0/2001104916 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f185d1bb700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18580c5b50 0x7f1858148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f185c9ba700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1858066660 0x7f18580beba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.263+0000 7f1857fff700 1 -- 172.21.15.78:0/2001104916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1858066660 msgr2=0x7f18580beba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.264+0000 7f1857fff700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1858066660 0x7f18580beba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.264+0000 7f1857fff700 1 -- 172.21.15.78:0/2001104916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18580c5b50 msgr2=0x7f1858148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.264+0000 7f1857fff700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18580c5b50 0x7f1858148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.264+0000 7f1857fff700 1 -- 172.21.15.78:0/2001104916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850009a20 con 0x7f1858066a40 2023-08-17T17:49:38.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.264+0000 7f1857fff700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 0x7f18581686e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f184400c440 tx=0x7f1844007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:38.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.264+0000 7f1854ff9700 1 -- 172.21.15.78:0/2001104916 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440070d0 con 0x7f1858066a40 2023-08-17T17:49:38.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.264+0000 7f1854ff9700 1 -- 172.21.15.78:0/2001104916 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1844007230 con 0x7f1858066a40 2023-08-17T17:49:38.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.264+0000 7f1854ff9700 1 -- 172.21.15.78:0/2001104916 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440075d0 con 0x7f1858066a40 2023-08-17T17:49:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.264+0000 7f185ec1e700 1 -- 172.21.15.78:0/2001104916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18580bf230 con 0x7f1858066a40 2023-08-17T17:49:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.264+0000 7f185ec1e700 1 -- 172.21.15.78:0/2001104916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18580bf7f0 con 0x7f1858066a40 2023-08-17T17:49:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.265+0000 7f185ec1e700 1 -- 172.21.15.78:0/2001104916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18580bfff0 con 0x7f1858066a40 2023-08-17T17:49:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.265+0000 7f1854ff9700 1 -- 172.21.15.78:0/2001104916 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f1844010070 con 0x7f1858066a40 2023-08-17T17:49:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.266+0000 7f1854ff9700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183c05edb0 0x7f183c061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.266+0000 7f185c9ba700 1 -- 172.21.15.78:0/2001104916 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183c05edb0 msgr2=0x7f183c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.266+0000 7f1854ff9700 1 -- 172.21.15.78:0/2001104916 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f1844078ee0 con 0x7f1858066a40 2023-08-17T17:49:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.266+0000 7f185c9ba700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183c05edb0 0x7f183c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:38.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.270+0000 7f1854ff9700 1 -- 172.21.15.78:0/2001104916 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f184404a300 con 0x7f1858066a40 2023-08-17T17:49:38.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.441+0000 7f185ec1e700 1 -- 172.21.15.78:0/2001104916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18580c6040 con 0x7f1858066a40 2023-08-17T17:49:38.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.442+0000 7f1854ff9700 1 -- 172.21.15.78:0/2001104916 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17222 (secure 0 0 0) 0x7f18580c6040 con 0x7f1858066a40 2023-08-17T17:49:38.443 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:38.444 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":78,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:35.469135+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:18.219880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:18.637834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/688373490":"2023-08-18T17:49:35.469105+0000","172.21.15.78:6833/119464":"2023-08-18T17:49:35.469105+0000","172.21.15.78:6832/119464":"2023-08-18T17:49:35.469105+0000","172.21.15.78:0/3671427962":"2023-08-18T17:49:35.469105+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:38.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 -- 172.21.15.78:0/2001104916 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183c05edb0 msgr2=0x7f183c061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183c05edb0 0x7f183c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 -- 172.21.15.78:0/2001104916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 msgr2=0x7f18581686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 0x7f18581686e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f184400c440 tx=0x7f1844007e10).stop 2023-08-17T17:49:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 -- 172.21.15.78:0/2001104916 shutdown_connections 2023-08-17T17:49:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183c05edb0 0x7f183c061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18580c5b50 0x7f1858148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1858066660 0x7f18580beba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 --2- 172.21.15.78:0/2001104916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1858066a40 0x7f18581686e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 -- 172.21.15.78:0/2001104916 >> 172.21.15.78:0/2001104916 conn(0x7f18580c7b00 msgr2=0x7f18580c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:38.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 -- 172.21.15.78:0/2001104916 shutdown_connections 2023-08-17T17:49:38.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.444+0000 7f185ec1e700 1 -- 172.21.15.78:0/2001104916 wait complete. 2023-08-17T17:49:38.458 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:49:18.219880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:49:18.637834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:49:38.459 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:49:38.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.580+0000 7f3b12b29700 1 Processor -- start 2023-08-17T17:49:38.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.580+0000 7f3b12b29700 1 -- start start 2023-08-17T17:49:38.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b12b29700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b0c14ea30 0x7f3b0c06b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b12b29700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b0c0c51b0 0x7f3b0c1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b12b29700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b0c063600 0x7f3b0c063ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b12b29700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c0bd260 con 0x7f3b0c0c51b0 2023-08-17T17:49:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b12b29700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c063fa0 con 0x7f3b0c063600 2023-08-17T17:49:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b12b29700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c151d70 con 0x7f3b0c14ea30 2023-08-17T17:49:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b11326700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b0c0c51b0 0x7f3b0c1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b11326700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b0c0c51b0 0x7f3b0c1514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60938/0 (socket says 172.21.15.78:60938) 2023-08-17T17:49:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b11326700 1 -- 172.21.15.78:0/3269631452 learned_addr learned my addr 172.21.15.78:0/3269631452 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b11b27700 1 --2- 172.21.15.78:0/3269631452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b0c14ea30 0x7f3b0c06b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.581+0000 7f3b12328700 1 --2- 172.21.15.78:0/3269631452 >> v2:172.21.15.150:3300/0 conn(0x7f3b0c063600 0x7f3b0c063ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b11326700 1 -- 172.21.15.78:0/3269631452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b0c14ea30 msgr2=0x7f3b0c06b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b11326700 1 --2- 172.21.15.78:0/3269631452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b0c14ea30 0x7f3b0c06b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b11326700 1 -- 172.21.15.78:0/3269631452 >> v2:172.21.15.150:3300/0 conn(0x7f3b0c063600 msgr2=0x7f3b0c063ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b11326700 1 --2- 172.21.15.78:0/3269631452 >> v2:172.21.15.150:3300/0 conn(0x7f3b0c063600 0x7f3b0c063ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b11326700 1 -- 172.21.15.78:0/3269631452 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c152050 con 0x7f3b0c0c51b0 2023-08-17T17:49:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b11326700 1 --2- 172.21.15.78:0/3269631452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c0c51b0 0x7f3b0c1514b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f3b0c06ad00 tx=0x7f3b080090f0).ready entity=mon.0 client_cookie=dbf545f717b75228 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b10b25700 1 -- 172.21.15.78:0/3269631452 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800f510 con 0x7f3b0c0c51b0 2023-08-17T17:49:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b10b25700 1 -- 172.21.15.78:0/3269631452 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0800f670 con 0x7f3b0c0c51b0 2023-08-17T17:49:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b10b25700 1 -- 172.21.15.78:0/3269631452 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800f9f0 con 0x7f3b0c0c51b0 2023-08-17T17:49:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b12b29700 1 -- 172.21.15.78:0/3269631452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c0c51b0 msgr2=0x7f3b0c1514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b12b29700 1 --2- 172.21.15.78:0/3269631452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c0c51b0 0x7f3b0c1514b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f3b0c06ad00 tx=0x7f3b080090f0).stop 2023-08-17T17:49:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b12b29700 1 -- 172.21.15.78:0/3269631452 shutdown_connections 2023-08-17T17:49:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b12b29700 1 --2- 172.21.15.78:0/3269631452 >> v2:172.21.15.150:3300/0 conn(0x7f3b0c063600 0x7f3b0c063ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b12b29700 1 --2- 172.21.15.78:0/3269631452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b0c14ea30 0x7f3b0c06b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b12b29700 1 --2- 172.21.15.78:0/3269631452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c0c51b0 0x7f3b0c1514b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.582+0000 7f3b12b29700 1 -- 172.21.15.78:0/3269631452 >> 172.21.15.78:0/3269631452 conn(0x7f3b0c0c3e20 msgr2=0x7f3b0c0c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.583+0000 7f3b12b29700 1 -- 172.21.15.78:0/3269631452 shutdown_connections 2023-08-17T17:49:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.583+0000 7f3b12b29700 1 -- 172.21.15.78:0/3269631452 wait complete. 2023-08-17T17:49:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.584+0000 7f3b12b29700 1 Processor -- start 2023-08-17T17:49:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.584+0000 7f3b12b29700 1 -- start start 2023-08-17T17:49:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.584+0000 7f3b12b29700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b0c063600 0x7f3b0c165c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.584+0000 7f3b12b29700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b0c0c51b0 0x7f3b0c0ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.584+0000 7f3b12b29700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c14ea30 0x7f3b0c0aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.584+0000 7f3b12b29700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0acf20 con 0x7f3b0c14ea30 2023-08-17T17:49:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.584+0000 7f3b12b29700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c166280 con 0x7f3b0c0c51b0 2023-08-17T17:49:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.584+0000 7f3b12b29700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c166560 con 0x7f3b0c063600 2023-08-17T17:49:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12328700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c14ea30 0x7f3b0c0aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12328700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c14ea30 0x7f3b0c0aca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60954/0 (socket says 172.21.15.78:60954) 2023-08-17T17:49:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b11b27700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b0c063600 0x7f3b0c165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12328700 1 -- 172.21.15.78:0/3035241554 learned_addr learned my addr 172.21.15.78:0/3035241554 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b11326700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b0c0c51b0 0x7f3b0c0ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12328700 1 -- 172.21.15.78:0/3035241554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b0c063600 msgr2=0x7f3b0c165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12328700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b0c063600 0x7f3b0c165c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12328700 1 -- 172.21.15.78:0/3035241554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b0c0c51b0 msgr2=0x7f3b0c0ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12328700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b0c0c51b0 0x7f3b0c0ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12328700 1 -- 172.21.15.78:0/3035241554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b08009370 con 0x7f3b0c14ea30 2023-08-17T17:49:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b11326700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b0c0c51b0 0x7f3b0c0ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12328700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c14ea30 0x7f3b0c0aca30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f3b04009e90 tx=0x7f3b0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b01ffb700 1 -- 172.21.15.78:0/3035241554 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400cb50 con 0x7f3b0c14ea30 2023-08-17T17:49:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b01ffb700 1 -- 172.21.15.78:0/3035241554 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400f040 con 0x7f3b0c14ea30 2023-08-17T17:49:38.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12b29700 1 -- 172.21.15.78:0/3035241554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c166840 con 0x7f3b0c14ea30 2023-08-17T17:49:38.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b01ffb700 1 -- 172.21.15.78:0/3035241554 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400cec0 con 0x7f3b0c14ea30 2023-08-17T17:49:38.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.585+0000 7f3b12b29700 1 -- 172.21.15.78:0/3035241554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c162890 con 0x7f3b0c14ea30 2023-08-17T17:49:38.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.586+0000 7f3b12b29700 1 -- 172.21.15.78:0/3035241554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c163ae0 con 0x7f3b0c14ea30 2023-08-17T17:49:38.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.586+0000 7f3b01ffb700 1 -- 172.21.15.78:0/3035241554 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f3b04013610 con 0x7f3b0c14ea30 2023-08-17T17:49:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.587+0000 7f3b01ffb700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3af005ede0 0x7f3af00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.587+0000 7f3b11b27700 1 -- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3af005ede0 msgr2=0x7f3af00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.587+0000 7f3b01ffb700 1 -- 172.21.15.78:0/3035241554 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f3b0407a7a0 con 0x7f3b0c14ea30 2023-08-17T17:49:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.587+0000 7f3b11b27700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3af005ede0 0x7f3af00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.594+0000 7f3b01ffb700 1 -- 172.21.15.78:0/3035241554 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b0c163ae0 con 0x7f3b0c14ea30 2023-08-17T17:49:38.637 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:38.636+0000 7f56436f2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:49:38.689 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:38.688+0000 7fce70bc4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:49:38.709 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:38.708+0000 7f56436f2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:49:38.762 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:38.761+0000 7fce70bc4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:49:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.788+0000 7f3b11b27700 1 -- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3af005ede0 msgr2=0x7f3af00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.788+0000 7f3b11b27700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3af005ede0 0x7f3af00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:38.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.796+0000 7f3b12b29700 1 -- 172.21.15.78:0/3035241554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3b0c163ae0 con 0x7f3b0c14ea30 2023-08-17T17:49:38.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.797+0000 7f3b01ffb700 1 -- 172.21.15.78:0/3035241554 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v78) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3b0c163ae0 con 0x7f3b0c14ea30 2023-08-17T17:49:38.798 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:49:38.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 -- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3af005ede0 msgr2=0x7f3af00612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3af005ede0 0x7f3af00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 -- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c14ea30 msgr2=0x7f3b0c0aca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c14ea30 0x7f3b0c0aca30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f3b04009e90 tx=0x7f3b0400b040).stop 2023-08-17T17:49:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 -- 172.21.15.78:0/3035241554 shutdown_connections 2023-08-17T17:49:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3af005ede0 0x7f3af00612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0c14ea30 0x7f3b0c0aca30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b0c063600 0x7f3b0c165c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 --2- 172.21.15.78:0/3035241554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b0c0c51b0 0x7f3b0c0ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 -- 172.21.15.78:0/3035241554 >> 172.21.15.78:0/3035241554 conn(0x7f3b0c0c3e20 msgr2=0x7f3b0c14f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:38.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 -- 172.21.15.78:0/3035241554 shutdown_connections 2023-08-17T17:49:38.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.799+0000 7f3b12b29700 1 -- 172.21.15.78:0/3035241554 wait complete. 2023-08-17T17:49:38.813 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:49:38.896 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:38.895+0000 7f56436f2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:49:38.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.932+0000 7fd73cbaa700 1 Processor -- start 2023-08-17T17:49:38.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.932+0000 7fd73cbaa700 1 -- start start 2023-08-17T17:49:38.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd73cbaa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7380c4790 0x7fd738064a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd73cbaa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd738062cd0 0x7fd7380c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd73cbaa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd7380c5300 0x7fd7380c5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd73cbaa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd738155400 con 0x7fd7380c4790 2023-08-17T17:49:38.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd73cbaa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7380c5c80 con 0x7fd7380c5300 2023-08-17T17:49:38.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd73cbaa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380c30d0 con 0x7fd738062cd0 2023-08-17T17:49:38.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd7377fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7380c4790 0x7fd738064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd7377fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7380c4790 0x7fd738064a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60962/0 (socket says 172.21.15.78:60962) 2023-08-17T17:49:38.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd7377fe700 1 -- 172.21.15.78:0/3883139781 learned_addr learned my addr 172.21.15.78:0/3883139781 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:38.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd737fff700 1 --2- 172.21.15.78:0/3883139781 >> v2:172.21.15.150:3300/0 conn(0x7fd7380c5300 0x7fd7380c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd736ffd700 1 --2- 172.21.15.78:0/3883139781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd738062cd0 0x7fd7380c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd7377fe700 1 -- 172.21.15.78:0/3883139781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd738062cd0 msgr2=0x7fd7380c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:38.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd7377fe700 1 --2- 172.21.15.78:0/3883139781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd738062cd0 0x7fd7380c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd7377fe700 1 -- 172.21.15.78:0/3883139781 >> v2:172.21.15.150:3300/0 conn(0x7fd7380c5300 msgr2=0x7fd7380c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd7377fe700 1 --2- 172.21.15.78:0/3883139781 >> v2:172.21.15.150:3300/0 conn(0x7fd7380c5300 0x7fd7380c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd7377fe700 1 -- 172.21.15.78:0/3883139781 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7381547f0 con 0x7fd7380c4790 2023-08-17T17:49:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd736ffd700 1 --2- 172.21.15.78:0/3883139781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd738062cd0 0x7fd7380c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd737fff700 1 --2- 172.21.15.78:0/3883139781 >> v2:172.21.15.150:3300/0 conn(0x7fd7380c5300 0x7fd7380c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.933+0000 7fd7377fe700 1 --2- 172.21.15.78:0/3883139781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 0x7fd738064a90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fd738069ef0 tx=0x7fd728009060).ready entity=mon.0 client_cookie=ffc8fb06c890fd88 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd7367fc700 1 -- 172.21.15.78:0/3883139781 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728005880 con 0x7fd7380c4790 2023-08-17T17:49:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd7367fc700 1 -- 172.21.15.78:0/3883139781 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7280059e0 con 0x7fd7380c4790 2023-08-17T17:49:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd7367fc700 1 -- 172.21.15.78:0/3883139781 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728005d60 con 0x7fd7380c4790 2023-08-17T17:49:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd73cbaa700 1 -- 172.21.15.78:0/3883139781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 msgr2=0x7fd738064a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd73cbaa700 1 --2- 172.21.15.78:0/3883139781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 0x7fd738064a90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fd738069ef0 tx=0x7fd728009060).stop 2023-08-17T17:49:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd73cbaa700 1 -- 172.21.15.78:0/3883139781 shutdown_connections 2023-08-17T17:49:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd73cbaa700 1 --2- 172.21.15.78:0/3883139781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 0x7fd738064a90 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd73cbaa700 1 --2- 172.21.15.78:0/3883139781 >> v2:172.21.15.150:3300/0 conn(0x7fd7380c5300 0x7fd7380c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd73cbaa700 1 --2- 172.21.15.78:0/3883139781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd738062cd0 0x7fd7380c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd73cbaa700 1 -- 172.21.15.78:0/3883139781 >> 172.21.15.78:0/3883139781 conn(0x7fd73806a660 msgr2=0x7fd7380921a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd73cbaa700 1 -- 172.21.15.78:0/3883139781 shutdown_connections 2023-08-17T17:49:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.934+0000 7fd73cbaa700 1 -- 172.21.15.78:0/3883139781 wait complete. 2023-08-17T17:49:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.935+0000 7fd73cbaa700 1 Processor -- start 2023-08-17T17:49:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.935+0000 7fd73cbaa700 1 -- start start 2023-08-17T17:49:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd73cbaa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd738062cd0 0x7fd7380a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd73cbaa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 0x7fd7380acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd73cbaa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7380c5300 0x7fd7381529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd73cbaa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380ae280 con 0x7fd7380c4790 2023-08-17T17:49:38.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd73cbaa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380a9ec0 con 0x7fd738062cd0 2023-08-17T17:49:38.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd73cbaa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380ad390 con 0x7fd7380c5300 2023-08-17T17:49:38.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd736ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 0x7fd7380acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd736ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 0x7fd7380acea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60978/0 (socket says 172.21.15.78:60978) 2023-08-17T17:49:38.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd736ffd700 1 -- 172.21.15.78:0/2279808403 learned_addr learned my addr 172.21.15.78:0/2279808403 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:38.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd737fff700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7380c5300 0x7fd7381529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.936+0000 7fd7377fe700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd738062cd0 0x7fd7380a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:38.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd736ffd700 1 -- 172.21.15.78:0/2279808403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7380c5300 msgr2=0x7fd7381529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd736ffd700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7380c5300 0x7fd7381529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd736ffd700 1 -- 172.21.15.78:0/2279808403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd738062cd0 msgr2=0x7fd7380a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:38.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd736ffd700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd738062cd0 0x7fd7380a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:38.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd736ffd700 1 -- 172.21.15.78:0/2279808403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd728009300 con 0x7fd7380c4790 2023-08-17T17:49:38.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd736ffd700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 0x7fd7380acea0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fd72000d8c0 tx=0x7fd720008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:38.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd72f7fe700 1 -- 172.21.15.78:0/2279808403 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720011590 con 0x7fd7380c4790 2023-08-17T17:49:38.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd72f7fe700 1 -- 172.21.15.78:0/2279808403 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7200116f0 con 0x7fd7380c4790 2023-08-17T17:49:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd72f7fe700 1 -- 172.21.15.78:0/2279808403 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720011a70 con 0x7fd7380c4790 2023-08-17T17:49:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd73cbaa700 1 -- 172.21.15.78:0/2279808403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7380a8700 con 0x7fd7380c4790 2023-08-17T17:49:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.937+0000 7fd73cbaa700 1 -- 172.21.15.78:0/2279808403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7380a8f40 con 0x7fd7380c4790 2023-08-17T17:49:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.938+0000 7fd73cbaa700 1 -- 172.21.15.78:0/2279808403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73805f910 con 0x7fd7380c4790 2023-08-17T17:49:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.938+0000 7fd72f7fe700 1 -- 172.21.15.78:0/2279808403 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fd720012420 con 0x7fd7380c4790 2023-08-17T17:49:38.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.938+0000 7fd72f7fe700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd71805ede0 0x7fd7180612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.939+0000 7fd7377fe700 1 -- 172.21.15.78:0/2279808403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd71805ede0 msgr2=0x7fd7180612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.939+0000 7fd72f7fe700 1 -- 172.21.15.78:0/2279808403 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd7200796e0 con 0x7fd7380c4790 2023-08-17T17:49:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.939+0000 7fd7377fe700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd71805ede0 0x7fd7180612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:38.943+0000 7fd72f7fe700 1 -- 172.21.15.78:0/2279808403 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd72004aaa0 con 0x7fd7380c4790 2023-08-17T17:49:38.959 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:38.958+0000 7fce70bc4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:49:39.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.112+0000 7fd73cbaa700 1 -- 172.21.15.78:0/2279808403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd738154b30 con 0x7fd7380c4790 2023-08-17T17:49:39.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.113+0000 7fd72f7fe700 1 -- 172.21.15.78:0/2279808403 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd72004e0c0 con 0x7fd7380c4790 2023-08-17T17:49:39.114 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:49:39.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 -- 172.21.15.78:0/2279808403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd71805ede0 msgr2=0x7fd7180612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:39.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd71805ede0 0x7fd7180612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:39.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 -- 172.21.15.78:0/2279808403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 msgr2=0x7fd7380acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 0x7fd7380acea0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fd72000d8c0 tx=0x7fd720008040).stop 2023-08-17T17:49:39.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 -- 172.21.15.78:0/2279808403 shutdown_connections 2023-08-17T17:49:39.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd71805ede0 0x7fd7180612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:39.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7380c5300 0x7fd7381529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd738062cd0 0x7fd7380a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 --2- 172.21.15.78:0/2279808403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7380c4790 0x7fd7380acea0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 -- 172.21.15.78:0/2279808403 >> 172.21.15.78:0/2279808403 conn(0x7fd73806a660 msgr2=0x7fd738066390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:39.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 -- 172.21.15.78:0/2279808403 shutdown_connections 2023-08-17T17:49:39.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.115+0000 7fd73cbaa700 1 -- 172.21.15.78:0/2279808403 wait complete. 2023-08-17T17:49:39.128 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:49:39.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.248+0000 7fef95156700 1 Processor -- start 2023-08-17T17:49:39.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.248+0000 7fef95156700 1 -- start start 2023-08-17T17:49:39.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.249+0000 7fef95156700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef90065100 0x7fef90152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.249+0000 7fef95156700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef9006b280 0x7fef900624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.249+0000 7fef95156700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef900bc610 con 0x7fef9014f9d0 2023-08-17T17:49:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.249+0000 7fef95156700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef900bc310 con 0x7fef9006b280 2023-08-17T17:49:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.249+0000 7fef95156700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef90066550 con 0x7fef90065100 2023-08-17T17:49:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.249+0000 7fef8f59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef9006b280 0x7fef900624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.249+0000 7fef8f59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef9006b280 0x7fef900624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60994/0 (socket says 172.21.15.78:60994) 2023-08-17T17:49:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.249+0000 7fef8f59e700 1 -- 172.21.15.78:0/2169310371 learned_addr learned my addr 172.21.15.78:0/2169310371 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.249+0000 7fef8e59c700 1 --2- 172.21.15.78:0/2169310371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef90065100 0x7fef90152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef8f59e700 1 -- 172.21.15.78:0/2169310371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef90065100 msgr2=0x7fef90152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef8f59e700 1 --2- 172.21.15.78:0/2169310371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef90065100 0x7fef90152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef8f59e700 1 -- 172.21.15.78:0/2169310371 >> v1:172.21.15.150:6789/0 conn(0x7fef9014f9d0 legacy=0x7fef900649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef8f59e700 1 -- 172.21.15.78:0/2169310371 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef900be1c0 con 0x7fef9006b280 2023-08-17T17:49:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef8dd9b700 1 -- 172.21.15.78:0/2169310371 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118332795 0 0) 0x7fef900bc610 con 0x7fef9014f9d0 2023-08-17T17:49:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef8f59e700 1 --2- 172.21.15.78:0/2169310371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9006b280 0x7fef900624f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fef88009f20 tx=0x7fef88009840).ready entity=mon.0 client_cookie=ad1fe26c5c17b7a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef8dd9b700 1 -- 172.21.15.78:0/2169310371 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800e070 con 0x7fef9006b280 2023-08-17T17:49:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef8dd9b700 1 -- 172.21.15.78:0/2169310371 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8800b9d0 con 0x7fef9006b280 2023-08-17T17:49:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef8dd9b700 1 -- 172.21.15.78:0/2169310371 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800bd50 con 0x7fef9006b280 2023-08-17T17:49:39.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef95156700 1 -- 172.21.15.78:0/2169310371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9006b280 msgr2=0x7fef900624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.250+0000 7fef95156700 1 --2- 172.21.15.78:0/2169310371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9006b280 0x7fef900624f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fef88009f20 tx=0x7fef88009840).stop 2023-08-17T17:49:39.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.251+0000 7fef95156700 1 -- 172.21.15.78:0/2169310371 shutdown_connections 2023-08-17T17:49:39.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.251+0000 7fef95156700 1 --2- 172.21.15.78:0/2169310371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9006b280 0x7fef900624f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.251+0000 7fef95156700 1 --2- 172.21.15.78:0/2169310371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef90065100 0x7fef90152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.251+0000 7fef95156700 1 -- 172.21.15.78:0/2169310371 >> 172.21.15.78:0/2169310371 conn(0x7fef900c3db0 msgr2=0x7fef900c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:39.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.251+0000 7fef95156700 1 -- 172.21.15.78:0/2169310371 shutdown_connections 2023-08-17T17:49:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.251+0000 7fef95156700 1 -- 172.21.15.78:0/2169310371 wait complete. 2023-08-17T17:49:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.252+0000 7fef95156700 1 Processor -- start 2023-08-17T17:49:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.252+0000 7fef95156700 1 -- start start 2023-08-17T17:49:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef95156700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef90065100 0x7fef900aa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef95156700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9006b280 0x7fef9014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef95156700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9014f9d0 0x7fef900c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef95156700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9014d870 con 0x7fef9014f9d0 2023-08-17T17:49:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef95156700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef900ab580 con 0x7fef90065100 2023-08-17T17:49:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef95156700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef900c0d60 con 0x7fef9006b280 2023-08-17T17:49:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9014f9d0 0x7fef900c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8e59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9006b280 0x7fef9014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9014f9d0 0x7fef900c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32772/0 (socket says 172.21.15.78:32772) 2023-08-17T17:49:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8f59e700 1 -- 172.21.15.78:0/3192024500 learned_addr learned my addr 172.21.15.78:0/3192024500 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8ed9d700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef90065100 0x7fef900aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8f59e700 1 -- 172.21.15.78:0/3192024500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9006b280 msgr2=0x7fef9014d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8f59e700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9006b280 0x7fef9014d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8f59e700 1 -- 172.21.15.78:0/3192024500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef90065100 msgr2=0x7fef900aa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8f59e700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef90065100 0x7fef900aa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8f59e700 1 -- 172.21.15.78:0/3192024500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef88009ae0 con 0x7fef9014f9d0 2023-08-17T17:49:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef8f59e700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9014f9d0 0x7fef900c0870 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fef8800be70 tx=0x7fef88009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.253+0000 7fef76ffd700 1 -- 172.21.15.78:0/3192024500 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef880092e0 con 0x7fef9014f9d0 2023-08-17T17:49:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.254+0000 7fef76ffd700 1 -- 172.21.15.78:0/3192024500 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8801e470 con 0x7fef9014f9d0 2023-08-17T17:49:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.254+0000 7fef95156700 1 -- 172.21.15.78:0/3192024500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef900aa970 con 0x7fef9014f9d0 2023-08-17T17:49:39.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.254+0000 7fef76ffd700 1 -- 172.21.15.78:0/3192024500 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8801e830 con 0x7fef9014f9d0 2023-08-17T17:49:39.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.254+0000 7fef95156700 1 -- 172.21.15.78:0/3192024500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef900aaf30 con 0x7fef9014f9d0 2023-08-17T17:49:39.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.254+0000 7fef95156700 1 -- 172.21.15.78:0/3192024500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef900ab710 con 0x7fef9014f9d0 2023-08-17T17:49:39.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.255+0000 7fef76ffd700 1 -- 172.21.15.78:0/3192024500 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fef88025030 con 0x7fef9014f9d0 2023-08-17T17:49:39.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.256+0000 7fef76ffd700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef7c05edb0 0x7fef7c061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.256+0000 7fef8ed9d700 1 -- 172.21.15.78:0/3192024500 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef7c05edb0 msgr2=0x7fef7c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:39.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.256+0000 7fef76ffd700 1 -- 172.21.15.78:0/3192024500 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fef8807b230 con 0x7fef9014f9d0 2023-08-17T17:49:39.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.256+0000 7fef8ed9d700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef7c05edb0 0x7fef7c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:39.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.260+0000 7fef76ffd700 1 -- 172.21.15.78:0/3192024500 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef8804c700 con 0x7fef9014f9d0 2023-08-17T17:49:39.318 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:39.318+0000 7f56436f2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:49:39.397 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:39.396+0000 7fce70bc4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:49:39.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:39.421+0000 7f56436f2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:39.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.428+0000 7fef95156700 1 -- 172.21.15.78:0/3192024500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef90046af0 con 0x7fef9014f9d0 2023-08-17T17:49:39.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.428+0000 7fef76ffd700 1 -- 172.21.15.78:0/3192024500 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef88023020 con 0x7fef9014f9d0 2023-08-17T17:49:39.430 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:49:39.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 -- 172.21.15.78:0/3192024500 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef7c05edb0 msgr2=0x7fef7c061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:39.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef7c05edb0 0x7fef7c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:39.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 -- 172.21.15.78:0/3192024500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9014f9d0 msgr2=0x7fef900c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9014f9d0 0x7fef900c0870 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fef8800be70 tx=0x7fef88009840).stop 2023-08-17T17:49:39.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 -- 172.21.15.78:0/3192024500 shutdown_connections 2023-08-17T17:49:39.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef7c05edb0 0x7fef7c061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:39.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef9014f9d0 0x7fef900c0870 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef90065100 0x7fef900aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 --2- 172.21.15.78:0/3192024500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef9006b280 0x7fef9014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 -- 172.21.15.78:0/3192024500 >> 172.21.15.78:0/3192024500 conn(0x7fef900c3db0 msgr2=0x7fef90063700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:39.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 -- 172.21.15.78:0/3192024500 shutdown_connections 2023-08-17T17:49:39.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.430+0000 7fef95156700 1 -- 172.21.15.78:0/3192024500 wait complete. 2023-08-17T17:49:39.444 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:49:39.508 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:39.507+0000 7fce70bc4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:39.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.564+0000 7f06e259f700 1 Processor -- start 2023-08-17T17:49:39.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.564+0000 7f06e259f700 1 -- start start 2023-08-17T17:49:39.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.565+0000 7f06e259f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06dc1506a0 0x7f06dc0bd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.565+0000 7f06e259f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 0x7f06dc0c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.565+0000 7f06e259f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc0bd270 con 0x7f06dc1502c0 2023-08-17T17:49:39.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.565+0000 7f06e259f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc150b20 con 0x7f06dc1506a0 2023-08-17T17:49:39.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.565+0000 7f06e259f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0be080 con 0x7f06dc0bdbf0 2023-08-17T17:49:39.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.565+0000 7f06e159d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f06dc1502c0 0x7f06dc0c5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35260/0 (socket says 172.21.15.78:35260) 2023-08-17T17:49:39.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.565+0000 7f06e159d700 1 -- 172.21.15.78:0/4127415386 learned_addr learned my addr 172.21.15.78:0/4127415386 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:39.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.565+0000 7f06e0d9c700 1 --2- 172.21.15.78:0/4127415386 >> v2:172.21.15.150:3300/0 conn(0x7f06dc1506a0 0x7f06dc0bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.565+0000 7f06e1d9e700 1 --2- 172.21.15.78:0/4127415386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 0x7f06dc0c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.565+0000 7f06d3fff700 1 -- 172.21.15.78:0/4127415386 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231774389 0 0) 0x7f06dc0bd270 con 0x7f06dc1502c0 2023-08-17T17:49:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06d3fff700 1 -- 172.21.15.78:0/4127415386 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c80033f0 con 0x7f06dc1502c0 2023-08-17T17:49:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06e0d9c700 1 -- 172.21.15.78:0/4127415386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 msgr2=0x7f06dc0c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06e0d9c700 1 --2- 172.21.15.78:0/4127415386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 0x7f06dc0c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06e0d9c700 1 -- 172.21.15.78:0/4127415386 >> v1:172.21.15.78:6789/0 conn(0x7f06dc1502c0 legacy=0x7f06dc0c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06d3fff700 1 -- 172.21.15.78:0/4127415386 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835542574 0 0) 0x7f06c80033f0 con 0x7f06dc1502c0 2023-08-17T17:49:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06e0d9c700 1 -- 172.21.15.78:0/4127415386 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0bc660 con 0x7f06dc1506a0 2023-08-17T17:49:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06e1d9e700 1 --2- 172.21.15.78:0/4127415386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 0x7f06dc0c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:39.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06e0d9c700 1 --2- 172.21.15.78:0/4127415386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06dc1506a0 0x7f06dc0bd700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f06d8009760 tx=0x7f06d8009060).ready entity=mon.1 client_cookie=9262f0ac71c43910 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:39.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06d3fff700 1 -- 172.21.15.78:0/4127415386 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800d4a0 con 0x7f06dc1506a0 2023-08-17T17:49:39.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06d3fff700 1 -- 172.21.15.78:0/4127415386 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d800d600 con 0x7f06dc1506a0 2023-08-17T17:49:39.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.566+0000 7f06d3fff700 1 -- 172.21.15.78:0/4127415386 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800d980 con 0x7f06dc1506a0 2023-08-17T17:49:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.567+0000 7f06e259f700 1 -- 172.21.15.78:0/4127415386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06dc1506a0 msgr2=0x7f06dc0bd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.567+0000 7f06e259f700 1 --2- 172.21.15.78:0/4127415386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06dc1506a0 0x7f06dc0bd700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f06d8009760 tx=0x7f06d8009060).stop 2023-08-17T17:49:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.567+0000 7f06e259f700 1 -- 172.21.15.78:0/4127415386 shutdown_connections 2023-08-17T17:49:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.567+0000 7f06e259f700 1 --2- 172.21.15.78:0/4127415386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 0x7f06dc0c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.567+0000 7f06e259f700 1 --2- 172.21.15.78:0/4127415386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06dc1506a0 0x7f06dc0bd700 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.567+0000 7f06e259f700 1 -- 172.21.15.78:0/4127415386 >> 172.21.15.78:0/4127415386 conn(0x7f06dc0c3e20 msgr2=0x7f06dc0c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.567+0000 7f06e259f700 1 -- 172.21.15.78:0/4127415386 shutdown_connections 2023-08-17T17:49:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.567+0000 7f06e259f700 1 -- 172.21.15.78:0/4127415386 wait complete. 2023-08-17T17:49:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.568+0000 7f06e259f700 1 Processor -- start 2023-08-17T17:49:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.568+0000 7f06e259f700 1 -- start start 2023-08-17T17:49:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e259f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 0x7f06dc13b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e259f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06dc1502c0 0x7f06dc0a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e259f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06dc1506a0 0x7f06dc0a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e259f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc13d3f0 con 0x7f06dc1502c0 2023-08-17T17:49:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e259f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0a9a50 con 0x7f06dc1506a0 2023-08-17T17:49:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e259f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc13cb50 con 0x7f06dc0bdbf0 2023-08-17T17:49:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e0d9c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06dc1502c0 0x7f06dc0a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e0d9c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06dc1502c0 0x7f06dc0a9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32774/0 (socket says 172.21.15.78:32774) 2023-08-17T17:49:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e0d9c700 1 -- 172.21.15.78:0/3229823075 learned_addr learned my addr 172.21.15.78:0/3229823075 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e159d700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 0x7f06dc13b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e1d9e700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06dc1506a0 0x7f06dc0a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e0d9c700 1 -- 172.21.15.78:0/3229823075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 msgr2=0x7f06dc13b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e0d9c700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 0x7f06dc13b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e0d9c700 1 -- 172.21.15.78:0/3229823075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06dc1506a0 msgr2=0x7f06dc0a9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e0d9c700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06dc1506a0 0x7f06dc0a9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.569+0000 7f06e0d9c700 1 -- 172.21.15.78:0/3229823075 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4009a20 con 0x7f06dc1502c0 2023-08-17T17:49:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.570+0000 7f06e0d9c700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06dc1502c0 0x7f06dc0a9070 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f06d8009d50 tx=0x7f06d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.570+0000 7f06d17fa700 1 -- 172.21.15.78:0/3229823075 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800dd40 con 0x7f06dc1502c0 2023-08-17T17:49:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.570+0000 7f06d17fa700 1 -- 172.21.15.78:0/3229823075 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d800d770 con 0x7f06dc1502c0 2023-08-17T17:49:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.570+0000 7f06e259f700 1 -- 172.21.15.78:0/3229823075 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d80092a0 con 0x7f06dc1502c0 2023-08-17T17:49:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.570+0000 7f06d17fa700 1 -- 172.21.15.78:0/3229823075 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800dea0 con 0x7f06dc1502c0 2023-08-17T17:49:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.570+0000 7f06e259f700 1 -- 172.21.15.78:0/3229823075 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc13d110 con 0x7f06dc1502c0 2023-08-17T17:49:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.571+0000 7f06e259f700 1 -- 172.21.15.78:0/3229823075 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc05f910 con 0x7f06dc1502c0 2023-08-17T17:49:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.571+0000 7f06d17fa700 1 -- 172.21.15.78:0/3229823075 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f06d8024030 con 0x7f06dc1502c0 2023-08-17T17:49:39.577 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:39.576+0000 7f56436f2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:39.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.571+0000 7f06d17fa700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06c005ede0 0x7f06c00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.572+0000 7f06e159d700 1 -- 172.21.15.78:0/3229823075 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06c005ede0 msgr2=0x7f06c00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:39.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.572+0000 7f06d17fa700 1 -- 172.21.15.78:0/3229823075 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f06d807aba0 con 0x7f06dc1502c0 2023-08-17T17:49:39.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.572+0000 7f06e159d700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06c005ede0 0x7f06c00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:39.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.579+0000 7f06d17fa700 1 -- 172.21.15.78:0/3229823075 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f06d804bfc0 con 0x7f06dc1502c0 2023-08-17T17:49:39.652 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:39.652+0000 7f56436f2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:49:39.670 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:39.669+0000 7fce70bc4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:39.721 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:39.720+0000 7f56436f2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:49:39.747 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:39.746+0000 7fce70bc4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:49:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.749+0000 7f06e259f700 1 -- 172.21.15.78:0/3229823075 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06dc0bc940 con 0x7f06dc1502c0 2023-08-17T17:49:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.750+0000 7f06d17fa700 1 -- 172.21.15.78:0/3229823075 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06d8022020 con 0x7f06dc1502c0 2023-08-17T17:49:39.751 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:49:39.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.751+0000 7f06e259f700 1 -- 172.21.15.78:0/3229823075 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06c005ede0 msgr2=0x7f06c00612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:39.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.751+0000 7f06e259f700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06c005ede0 0x7f06c00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:39.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.751+0000 7f06e259f700 1 -- 172.21.15.78:0/3229823075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06dc1502c0 msgr2=0x7f06dc0a9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.751+0000 7f06e259f700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06dc1502c0 0x7f06dc0a9070 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f06d8009d50 tx=0x7f06d8016000).stop 2023-08-17T17:49:39.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.752+0000 7f06e259f700 1 -- 172.21.15.78:0/3229823075 shutdown_connections 2023-08-17T17:49:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.752+0000 7f06e259f700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06c005ede0 0x7f06c00612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.752+0000 7f06e259f700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06dc1506a0 0x7f06dc0a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.752+0000 7f06e259f700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc0bdbf0 0x7f06dc13b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.752+0000 7f06e259f700 1 --2- 172.21.15.78:0/3229823075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06dc1502c0 0x7f06dc0a9070 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.752+0000 7f06e259f700 1 -- 172.21.15.78:0/3229823075 >> 172.21.15.78:0/3229823075 conn(0x7f06dc0c3e20 msgr2=0x7f06dc068850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.752+0000 7f06e259f700 1 -- 172.21.15.78:0/3229823075 shutdown_connections 2023-08-17T17:49:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.752+0000 7f06e259f700 1 -- 172.21.15.78:0/3229823075 wait complete. 2023-08-17T17:49:39.765 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:39.820 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:39.819+0000 7fce70bc4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:49:39.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.880+0000 7fa04c7f8700 1 Processor -- start 2023-08-17T17:49:39.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.880+0000 7fa04c7f8700 1 -- start start 2023-08-17T17:49:39.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.881+0000 7fa04c7f8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa04406a2c0 0x7fa044069050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.881+0000 7fa04c7f8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0440c2c10 con 0x7fa04413aa20 2023-08-17T17:49:39.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.881+0000 7fa04c7f8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0441552e0 con 0x7fa04413a640 2023-08-17T17:49:39.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.881+0000 7fa04c7f8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0441555c0 con 0x7fa04406a2c0 2023-08-17T17:49:39.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.881+0000 7fa04ad95700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa04413aa20 0x7fa0440c33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35264/0 (socket says 172.21.15.78:35264) 2023-08-17T17:49:39.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.881+0000 7fa04ad95700 1 -- 172.21.15.78:0/670049577 learned_addr learned my addr 172.21.15.78:0/670049577 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:39.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049d93700 1 --2- 172.21.15.78:0/670049577 >> v2:172.21.15.150:3300/0 conn(0x7fa04406a2c0 0x7fa044069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049592700 1 -- 172.21.15.78:0/670049577 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207022 0 0) 0x7fa0440c2c10 con 0x7fa04413aa20 2023-08-17T17:49:39.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049592700 1 -- 172.21.15.78:0/670049577 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0300033f0 con 0x7fa04413aa20 2023-08-17T17:49:39.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049592700 1 -- 172.21.15.78:0/670049577 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422635765 0 0) 0x7fa0441552e0 con 0x7fa04413a640 2023-08-17T17:49:39.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049592700 1 -- 172.21.15.78:0/670049577 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0440c2c10 con 0x7fa04413a640 2023-08-17T17:49:39.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049592700 1 -- 172.21.15.78:0/670049577 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 170687500 0 0) 0x7fa0300033f0 con 0x7fa04413aa20 2023-08-17T17:49:39.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049d93700 1 -- 172.21.15.78:0/670049577 >> v1:172.21.15.150:6789/0 conn(0x7fa04413a640 legacy=0x7fa044154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049d93700 1 -- 172.21.15.78:0/670049577 >> v1:172.21.15.78:6789/0 conn(0x7fa04413aa20 legacy=0x7fa0440c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049d93700 1 -- 172.21.15.78:0/670049577 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0441558a0 con 0x7fa04406a2c0 2023-08-17T17:49:39.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049d93700 1 --2- 172.21.15.78:0/670049577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04406a2c0 0x7fa044069050 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fa040009760 tx=0x7fa040009060).ready entity=mon.1 client_cookie=1b1034039d4d7292 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:39.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049592700 1 -- 172.21.15.78:0/670049577 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0017f0 con 0x7fa04406a2c0 2023-08-17T17:49:39.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049592700 1 -- 172.21.15.78:0/670049577 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040011400 con 0x7fa04406a2c0 2023-08-17T17:49:39.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.882+0000 7fa049592700 1 -- 172.21.15.78:0/670049577 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040011780 con 0x7fa04406a2c0 2023-08-17T17:49:39.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.883+0000 7fa04c7f8700 1 -- 172.21.15.78:0/670049577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04406a2c0 msgr2=0x7fa044069050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.883+0000 7fa04c7f8700 1 --2- 172.21.15.78:0/670049577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04406a2c0 0x7fa044069050 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fa040009760 tx=0x7fa040009060).stop 2023-08-17T17:49:39.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.883+0000 7fa04c7f8700 1 -- 172.21.15.78:0/670049577 shutdown_connections 2023-08-17T17:49:39.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.883+0000 7fa04c7f8700 1 --2- 172.21.15.78:0/670049577 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04406a2c0 0x7fa044069050 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.883+0000 7fa04c7f8700 1 -- 172.21.15.78:0/670049577 >> 172.21.15.78:0/670049577 conn(0x7fa0440c7b00 msgr2=0x7fa0440c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:39.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.883+0000 7fa04c7f8700 1 -- 172.21.15.78:0/670049577 shutdown_connections 2023-08-17T17:49:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.883+0000 7fa04c7f8700 1 -- 172.21.15.78:0/670049577 wait complete. 2023-08-17T17:49:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.884+0000 7fa04c7f8700 1 Processor -- start 2023-08-17T17:49:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.884+0000 7fa04c7f8700 1 -- start start 2023-08-17T17:49:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa04c7f8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04406a2c0 0x7fa04412d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa04c7f8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04413a640 0x7fa0440a8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa04c7f8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04413aa20 0x7fa0440a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa04c7f8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440ab290 con 0x7fa04413a640 2023-08-17T17:49:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa04c7f8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440c1820 con 0x7fa04406a2c0 2023-08-17T17:49:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa04c7f8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa044165310 con 0x7fa04413aa20 2023-08-17T17:49:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa049d93700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04413a640 0x7fa0440a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa049d93700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04413a640 0x7fa0440a8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32790/0 (socket says 172.21.15.78:32790) 2023-08-17T17:49:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa049d93700 1 -- 172.21.15.78:0/2060891759 learned_addr learned my addr 172.21.15.78:0/2060891759 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa04a594700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04406a2c0 0x7fa04412d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa04ad95700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04413aa20 0x7fa0440a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa049d93700 1 -- 172.21.15.78:0/2060891759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04413aa20 msgr2=0x7fa0440a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa049d93700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04413aa20 0x7fa0440a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa049d93700 1 -- 172.21.15.78:0/2060891759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04406a2c0 msgr2=0x7fa04412d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:39.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa049d93700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04406a2c0 0x7fa04412d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:39.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa049d93700 1 -- 172.21.15.78:0/2060891759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0400092a0 con 0x7fa04413a640 2023-08-17T17:49:39.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa04ad95700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04413aa20 0x7fa0440a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:39.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa049d93700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04413a640 0x7fa0440a8990 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fa040009d50 tx=0x7fa040016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:39.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa0367fc700 1 -- 172.21.15.78:0/2060891759 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0400107c0 con 0x7fa04413a640 2023-08-17T17:49:39.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa0367fc700 1 -- 172.21.15.78:0/2060891759 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040010920 con 0x7fa04413a640 2023-08-17T17:49:39.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa04c7f8700 1 -- 172.21.15.78:0/2060891759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0441655f0 con 0x7fa04413a640 2023-08-17T17:49:39.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.885+0000 7fa0367fc700 1 -- 172.21.15.78:0/2060891759 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040010ca0 con 0x7fa04413a640 2023-08-17T17:49:39.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.886+0000 7fa04c7f8700 1 -- 172.21.15.78:0/2060891759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0440aaf20 con 0x7fa04413a640 2023-08-17T17:49:39.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.886+0000 7fa04c7f8700 1 -- 172.21.15.78:0/2060891759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa044064610 con 0x7fa04413a640 2023-08-17T17:49:39.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.887+0000 7fa0367fc700 1 -- 172.21.15.78:0/2060891759 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fa04000f070 con 0x7fa04413a640 2023-08-17T17:49:39.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.887+0000 7fa0367fc700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa02805ede0 0x7fa0280612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:39.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.887+0000 7fa04a594700 1 -- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa02805ede0 msgr2=0x7fa0280612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:39.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.887+0000 7fa0367fc700 1 -- 172.21.15.78:0/2060891759 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa04007b0d0 con 0x7fa04413a640 2023-08-17T17:49:39.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.887+0000 7fa04a594700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa02805ede0 0x7fa0280612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:39.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:39.891+0000 7fa0367fc700 1 -- 172.21.15.78:0/2060891759 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa044064610 con 0x7fa04413a640 2023-08-17T17:49:39.981 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:39.980+0000 7f56436f2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:49:40.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.088+0000 7fa04a594700 1 -- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa02805ede0 msgr2=0x7fa0280612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:40.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.088+0000 7fa04a594700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa02805ede0 0x7fa0280612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:40.090 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:40.088+0000 7fce70bc4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:49:40.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.102+0000 7fa04c7f8700 1 -- 172.21.15.78:0/2060891759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa044064610 con 0x7fa04413a640 2023-08-17T17:49:40.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.103+0000 7fa0367fc700 1 -- 172.21.15.78:0/2060891759 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fa044064610 con 0x7fa04413a640 2023-08-17T17:49:40.104 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:40.104 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2895715400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2895715400},{"type":"v1","addr":"172.21.15.150:6834","nonce":2895715400}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1604940701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1604940701},{"type":"v1","addr":"172.21.15.78:6836","nonce":1604940701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6234,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1676496794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1676496794},{"type":"v1","addr":"172.21.15.78:6837","nonce":1676496794}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:19.673872+0000","modified":"2023-08-17T17:49:21.684217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6246":{"gid":6246,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3219133912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3219133912},{"type":"v1","addr":"172.21.15.150:6835","nonce":3219133912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T17:49:40.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 -- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa02805ede0 msgr2=0x7fa0280612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:40.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa02805ede0 0x7fa0280612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:40.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 -- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04413a640 msgr2=0x7fa0440a8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04413a640 0x7fa0440a8990 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fa040009d50 tx=0x7fa040016000).stop 2023-08-17T17:49:40.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 -- 172.21.15.78:0/2060891759 shutdown_connections 2023-08-17T17:49:40.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa02805ede0 0x7fa0280612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:40.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04413aa20 0x7fa0440a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04406a2c0 0x7fa04412d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 --2- 172.21.15.78:0/2060891759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04413a640 0x7fa0440a8990 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 -- 172.21.15.78:0/2060891759 >> 172.21.15.78:0/2060891759 conn(0x7fa0440c7b00 msgr2=0x7fa0440c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:40.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 -- 172.21.15.78:0/2060891759 shutdown_connections 2023-08-17T17:49:40.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.105+0000 7fa04c7f8700 1 -- 172.21.15.78:0/2060891759 wait complete. 2023-08-17T17:49:40.108 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 25 2023-08-17T17:49:40.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:40.165 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:40.164+0000 7f56436f2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:40.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.237+0000 7fa02e2dc700 1 Processor -- start 2023-08-17T17:49:40.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.237+0000 7fa02e2dc700 1 -- start start 2023-08-17T17:49:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.237+0000 7fa02e2dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa028066a40 0x7fa0280624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.237+0000 7fa02e2dc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0280629e0 0x7fa028151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.237+0000 7fa02e2dc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0280c6040 con 0x7fa028066660 2023-08-17T17:49:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.237+0000 7fa02e2dc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa028069b00 con 0x7fa0280629e0 2023-08-17T17:49:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.237+0000 7fa02e2dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa028062e70 con 0x7fa028066a40 2023-08-17T17:49:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa02c879700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0280629e0 0x7fa028151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa02c879700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0280629e0 0x7fa028151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32802/0 (socket says 172.21.15.78:32802) 2023-08-17T17:49:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa02c879700 1 -- 172.21.15.78:0/3665044933 learned_addr learned my addr 172.21.15.78:0/3665044933 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa0277fe700 1 --2- 172.21.15.78:0/3665044933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa028066a40 0x7fa0280624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa02c879700 1 -- 172.21.15.78:0/3665044933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa028066a40 msgr2=0x7fa0280624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa02c879700 1 --2- 172.21.15.78:0/3665044933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa028066a40 0x7fa0280624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa02c879700 1 -- 172.21.15.78:0/3665044933 >> v1:172.21.15.150:6789/0 conn(0x7fa028066660 legacy=0x7fa0280c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa02c879700 1 -- 172.21.15.78:0/3665044933 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028069f90 con 0x7fa0280629e0 2023-08-17T17:49:40.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa02c879700 1 --2- 172.21.15.78:0/3665044933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0280629e0 0x7fa028151570 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fa020009f20 tx=0x7fa020009840).ready entity=mon.0 client_cookie=f3f8d956dd2bf02 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:40.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa026ffd700 1 -- 172.21.15.78:0/3665044933 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02000e070 con 0x7fa0280629e0 2023-08-17T17:49:40.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa026ffd700 1 -- 172.21.15.78:0/3665044933 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02000b9d0 con 0x7fa0280629e0 2023-08-17T17:49:40.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.238+0000 7fa026ffd700 1 -- 172.21.15.78:0/3665044933 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02000bd50 con 0x7fa0280629e0 2023-08-17T17:49:40.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.239+0000 7fa02e2dc700 1 -- 172.21.15.78:0/3665044933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0280629e0 msgr2=0x7fa028151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.239+0000 7fa02e2dc700 1 --2- 172.21.15.78:0/3665044933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0280629e0 0x7fa028151570 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fa020009f20 tx=0x7fa020009840).stop 2023-08-17T17:49:40.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.239+0000 7fa02e2dc700 1 -- 172.21.15.78:0/3665044933 shutdown_connections 2023-08-17T17:49:40.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.239+0000 7fa02e2dc700 1 --2- 172.21.15.78:0/3665044933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0280629e0 0x7fa028151570 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.239+0000 7fa02e2dc700 1 --2- 172.21.15.78:0/3665044933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa028066a40 0x7fa0280624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.239+0000 7fa02e2dc700 1 -- 172.21.15.78:0/3665044933 >> 172.21.15.78:0/3665044933 conn(0x7fa0280c7b00 msgr2=0x7fa0280c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:40.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.239+0000 7fa02e2dc700 1 -- 172.21.15.78:0/3665044933 shutdown_connections 2023-08-17T17:49:40.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.239+0000 7fa02e2dc700 1 -- 172.21.15.78:0/3665044933 wait complete. 2023-08-17T17:49:40.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.240+0000 7fa02e2dc700 1 Processor -- start 2023-08-17T17:49:40.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.240+0000 7fa02e2dc700 1 -- start start 2023-08-17T17:49:40.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa02e2dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0280629e0 0x7fa028151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa02e2dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa028066660 0x7fa0280abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa02e2dc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa028066a40 0x7fa0280ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa02e2dc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280a8730 con 0x7fa028066a40 2023-08-17T17:49:40.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa02e2dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280a8a10 con 0x7fa028066660 2023-08-17T17:49:40.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa02e2dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280ab100 con 0x7fa0280629e0 2023-08-17T17:49:40.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa02c879700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa028066a40 0x7fa0280ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa02c879700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa028066a40 0x7fa0280ac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32814/0 (socket says 172.21.15.78:32814) 2023-08-17T17:49:40.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa027fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0280629e0 0x7fa028151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa02c879700 1 -- 172.21.15.78:0/315852812 learned_addr learned my addr 172.21.15.78:0/315852812 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:40.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.241+0000 7fa0277fe700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa028066660 0x7fa0280abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa02c879700 1 -- 172.21.15.78:0/315852812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0280629e0 msgr2=0x7fa028151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa02c879700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0280629e0 0x7fa028151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa02c879700 1 -- 172.21.15.78:0/315852812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa028066660 msgr2=0x7fa0280abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa02c879700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa028066660 0x7fa0280abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa02c879700 1 -- 172.21.15.78:0/315852812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa020009ae0 con 0x7fa028066a40 2023-08-17T17:49:40.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa0277fe700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa028066660 0x7fa0280abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:40.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa027fff700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0280629e0 0x7fa028151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:40.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa02c879700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa028066a40 0x7fa0280ac2e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fa02000be70 tx=0x7fa020009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:40.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa00ffff700 1 -- 172.21.15.78:0/315852812 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0200092e0 con 0x7fa028066a40 2023-08-17T17:49:40.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa00ffff700 1 -- 172.21.15.78:0/315852812 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02001e470 con 0x7fa028066a40 2023-08-17T17:49:40.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa02e2dc700 1 -- 172.21.15.78:0/315852812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0280ab3e0 con 0x7fa028066a40 2023-08-17T17:49:40.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa00ffff700 1 -- 172.21.15.78:0/315852812 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02001e830 con 0x7fa028066a40 2023-08-17T17:49:40.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.242+0000 7fa02e2dc700 1 -- 172.21.15.78:0/315852812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0280aad60 con 0x7fa028066a40 2023-08-17T17:49:40.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.243+0000 7fa02e2dc700 1 -- 172.21.15.78:0/315852812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa028047350 con 0x7fa028066a40 2023-08-17T17:49:40.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.244+0000 7fa00ffff700 1 -- 172.21.15.78:0/315852812 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fa020025030 con 0x7fa028066a40 2023-08-17T17:49:40.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.244+0000 7fa00ffff700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa01405ede0 0x7fa0140612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.244+0000 7fa027fff700 1 -- 172.21.15.78:0/315852812 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa01405ede0 msgr2=0x7fa0140612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:40.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.244+0000 7fa00ffff700 1 -- 172.21.15.78:0/315852812 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa02007b300 con 0x7fa028066a40 2023-08-17T17:49:40.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.244+0000 7fa027fff700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa01405ede0 0x7fa0140612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:40.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.248+0000 7fa00ffff700 1 -- 172.21.15.78:0/315852812 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa02004c6c0 con 0x7fa028066a40 2023-08-17T17:49:40.281 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:40.280+0000 7fce70bc4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:49:40.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.417+0000 7fa02e2dc700 1 -- 172.21.15.78:0/315852812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0280aa5e0 con 0x7fa028066a40 2023-08-17T17:49:40.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.418+0000 7fa00ffff700 1 -- 172.21.15.78:0/315852812 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17222 (secure 0 0 0) 0x7fa020023070 con 0x7fa028066a40 2023-08-17T17:49:40.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:40.420 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":78,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:35.469135+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:18.219880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:18.637834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/688373490":"2023-08-18T17:49:35.469105+0000","172.21.15.78:6833/119464":"2023-08-18T17:49:35.469105+0000","172.21.15.78:6832/119464":"2023-08-18T17:49:35.469105+0000","172.21.15.78:0/3671427962":"2023-08-18T17:49:35.469105+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.420+0000 7fa02e2dc700 1 -- 172.21.15.78:0/315852812 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa01405ede0 msgr2=0x7fa0140612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.420+0000 7fa02e2dc700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa01405ede0 0x7fa0140612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.420+0000 7fa02e2dc700 1 -- 172.21.15.78:0/315852812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa028066a40 msgr2=0x7fa0280ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.420+0000 7fa02e2dc700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa028066a40 0x7fa0280ac2e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fa02000be70 tx=0x7fa020009840).stop 2023-08-17T17:49:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.421+0000 7fa02e2dc700 1 -- 172.21.15.78:0/315852812 shutdown_connections 2023-08-17T17:49:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.421+0000 7fa02e2dc700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa01405ede0 0x7fa0140612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.421+0000 7fa02e2dc700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa028066a40 0x7fa0280ac2e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.421+0000 7fa02e2dc700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0280629e0 0x7fa028151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.421+0000 7fa02e2dc700 1 --2- 172.21.15.78:0/315852812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa028066660 0x7fa0280abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.421+0000 7fa02e2dc700 1 -- 172.21.15.78:0/315852812 >> 172.21.15.78:0/315852812 conn(0x7fa0280c7b00 msgr2=0x7fa0280a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.421+0000 7fa02e2dc700 1 -- 172.21.15.78:0/315852812 shutdown_connections 2023-08-17T17:49:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.421+0000 7fa02e2dc700 1 -- 172.21.15.78:0/315852812 wait complete. 2023-08-17T17:49:40.434 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T17:49:40.435 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:40.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.550+0000 7fdb18c35700 1 Processor -- start 2023-08-17T17:49:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.550+0000 7fdb18c35700 1 -- start start 2023-08-17T17:49:40.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.551+0000 7fdb18c35700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdb14062fe0 0x7fdb140c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.551+0000 7fdb18c35700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb140c3580 con 0x7fdb140c2070 2023-08-17T17:49:40.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.551+0000 7fdb18c35700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb140c3a10 con 0x7fdb140624f0 2023-08-17T17:49:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.551+0000 7fdb18c35700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb140c2970 con 0x7fdb14062fe0 2023-08-17T17:49:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.551+0000 7fdb11d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdb14062fe0 0x7fdb140c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.551+0000 7fdb12d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdb140c2070 0x7fdb1415a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35276/0 (socket says 172.21.15.78:35276) 2023-08-17T17:49:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.551+0000 7fdb12d9d700 1 -- 172.21.15.78:0/3971750188 learned_addr learned my addr 172.21.15.78:0/3971750188 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.551+0000 7fdb11d9b700 1 --2- 172.21.15.78:0/3971750188 >> v2:172.21.15.78:3300/0 conn(0x7fdb14062fe0 0x7fdb140c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32828/0 (socket says 172.21.15.78:32828) 2023-08-17T17:49:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.552+0000 7fdb11d9b700 1 -- 172.21.15.78:0/3971750188 >> v1:172.21.15.150:6789/0 conn(0x7fdb140624f0 legacy=0x7fdb140628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.552+0000 7fdb11d9b700 1 -- 172.21.15.78:0/3971750188 >> v1:172.21.15.78:6789/0 conn(0x7fdb140c2070 legacy=0x7fdb1415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.552+0000 7fdb11d9b700 1 -- 172.21.15.78:0/3971750188 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb140c2c50 con 0x7fdb14062fe0 2023-08-17T17:49:40.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.552+0000 7fdb11d9b700 1 --2- 172.21.15.78:0/3971750188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb14062fe0 0x7fdb140c1b80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fdb0400a900 tx=0x7fdb0400a200).ready entity=mon.0 client_cookie=f73a7199df0a743f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:40.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.552+0000 7fdb1159a700 1 -- 172.21.15.78:0/3971750188 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400a270 con 0x7fdb14062fe0 2023-08-17T17:49:40.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.552+0000 7fdb1159a700 1 -- 172.21.15.78:0/3971750188 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400c970 con 0x7fdb14062fe0 2023-08-17T17:49:40.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.552+0000 7fdb1159a700 1 -- 172.21.15.78:0/3971750188 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400ccf0 con 0x7fdb14062fe0 2023-08-17T17:49:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.553+0000 7fdb18c35700 1 -- 172.21.15.78:0/3971750188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb14062fe0 msgr2=0x7fdb140c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.553+0000 7fdb18c35700 1 --2- 172.21.15.78:0/3971750188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb14062fe0 0x7fdb140c1b80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fdb0400a900 tx=0x7fdb0400a200).stop 2023-08-17T17:49:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.553+0000 7fdb18c35700 1 -- 172.21.15.78:0/3971750188 shutdown_connections 2023-08-17T17:49:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.553+0000 7fdb18c35700 1 --2- 172.21.15.78:0/3971750188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb14062fe0 0x7fdb140c1b80 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.553+0000 7fdb18c35700 1 -- 172.21.15.78:0/3971750188 >> 172.21.15.78:0/3971750188 conn(0x7fdb140c3d40 msgr2=0x7fdb140c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.553+0000 7fdb18c35700 1 -- 172.21.15.78:0/3971750188 shutdown_connections 2023-08-17T17:49:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.553+0000 7fdb18c35700 1 -- 172.21.15.78:0/3971750188 wait complete. 2023-08-17T17:49:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.554+0000 7fdb18c35700 1 Processor -- start 2023-08-17T17:49:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.554+0000 7fdb18c35700 1 -- start start 2023-08-17T17:49:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb18c35700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140624f0 0x7fdb140bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb18c35700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb14062fe0 0x7fdb140c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb18c35700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140c2070 0x7fdb1414a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb18c35700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb140c0c30 con 0x7fdb140624f0 2023-08-17T17:49:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb18c35700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1414d900 con 0x7fdb14062fe0 2023-08-17T17:49:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb18c35700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14148bf0 con 0x7fdb140c2070 2023-08-17T17:49:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb1259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140624f0 0x7fdb140bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb1259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140624f0 0x7fdb140bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32842/0 (socket says 172.21.15.78:32842) 2023-08-17T17:49:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb1259c700 1 -- 172.21.15.78:0/2989809711 learned_addr learned my addr 172.21.15.78:0/2989809711 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb12d9d700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140c2070 0x7fdb1414a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb11d9b700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb14062fe0 0x7fdb140c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb1259c700 1 -- 172.21.15.78:0/2989809711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140c2070 msgr2=0x7fdb1414a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb1259c700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140c2070 0x7fdb1414a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb1259c700 1 -- 172.21.15.78:0/2989809711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb14062fe0 msgr2=0x7fdb140c03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb1259c700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb14062fe0 0x7fdb140c03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb1259c700 1 -- 172.21.15.78:0/2989809711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0400a440 con 0x7fdb140624f0 2023-08-17T17:49:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb1259c700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140624f0 0x7fdb140bfee0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fdb0800c4f0 tx=0x7fdb08007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb027fc700 1 -- 172.21.15.78:0/2989809711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800ce60 con 0x7fdb140624f0 2023-08-17T17:49:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb027fc700 1 -- 172.21.15.78:0/2989809711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb08001e90 con 0x7fdb140624f0 2023-08-17T17:49:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb18c35700 1 -- 172.21.15.78:0/2989809711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1414cfd0 con 0x7fdb140624f0 2023-08-17T17:49:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.555+0000 7fdb027fc700 1 -- 172.21.15.78:0/2989809711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08007250 con 0x7fdb140624f0 2023-08-17T17:49:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.556+0000 7fdb18c35700 1 -- 172.21.15.78:0/2989809711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1414d590 con 0x7fdb140624f0 2023-08-17T17:49:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.556+0000 7fdb18c35700 1 -- 172.21.15.78:0/2989809711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb14047350 con 0x7fdb140624f0 2023-08-17T17:49:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.557+0000 7fdb027fc700 1 -- 172.21.15.78:0/2989809711 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fdb08010070 con 0x7fdb140624f0 2023-08-17T17:49:40.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.557+0000 7fdb027fc700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdaf405ede0 0x7fdaf40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.557+0000 7fdb11d9b700 1 -- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdaf405ede0 msgr2=0x7fdaf40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:40.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.557+0000 7fdb027fc700 1 -- 172.21.15.78:0/2989809711 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fdb08079430 con 0x7fdb140624f0 2023-08-17T17:49:40.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.557+0000 7fdb11d9b700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdaf405ede0 0x7fdaf40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:40.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.561+0000 7fdb027fc700 1 -- 172.21.15.78:0/2989809711 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb0804a850 con 0x7fdb140624f0 2023-08-17T17:49:40.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.758+0000 7fdb11d9b700 1 -- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdaf405ede0 msgr2=0x7fdaf40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:40.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.758+0000 7fdb11d9b700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdaf405ede0 0x7fdaf40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:40.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.774+0000 7fdb18c35700 1 -- 172.21.15.78:0/2989809711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb1405ec60 con 0x7fdb140624f0 2023-08-17T17:49:40.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.774+0000 7fdb027fc700 1 -- 172.21.15.78:0/2989809711 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fdb0804de70 con 0x7fdb140624f0 2023-08-17T17:49:40.776 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:40.776 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2895715400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2895715400},{"type":"v1","addr":"172.21.15.150:6834","nonce":2895715400}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1604940701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1604940701},{"type":"v1","addr":"172.21.15.78:6836","nonce":1604940701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6234,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1676496794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1676496794},{"type":"v1","addr":"172.21.15.78:6837","nonce":1676496794}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:19.673872+0000","modified":"2023-08-17T17:49:21.684217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6246":{"gid":6246,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3219133912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3219133912},{"type":"v1","addr":"172.21.15.150:6835","nonce":3219133912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T17:49:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 -- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdaf405ede0 msgr2=0x7fdaf40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdaf405ede0 0x7fdaf40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 -- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140624f0 msgr2=0x7fdb140bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140624f0 0x7fdb140bfee0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fdb0800c4f0 tx=0x7fdb08007e00).stop 2023-08-17T17:49:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 -- 172.21.15.78:0/2989809711 shutdown_connections 2023-08-17T17:49:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdaf405ede0 0x7fdaf40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140c2070 0x7fdb1414a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140624f0 0x7fdb140bfee0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 --2- 172.21.15.78:0/2989809711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb14062fe0 0x7fdb140c03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 -- 172.21.15.78:0/2989809711 >> 172.21.15.78:0/2989809711 conn(0x7fdb140c3d40 msgr2=0x7fdb140c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:40.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 -- 172.21.15.78:0/2989809711 shutdown_connections 2023-08-17T17:49:40.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.776+0000 7fdb18c35700 1 -- 172.21.15.78:0/2989809711 wait complete. 2023-08-17T17:49:40.779 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 25 2023-08-17T17:49:40.790 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:40.821 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:40.821+0000 7f56436f2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:49:40.890 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:40.889+0000 7f56436f2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:49:40.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.909+0000 7f70fc919700 1 Processor -- start 2023-08-17T17:49:40.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.909+0000 7f70fc919700 1 -- start start 2023-08-17T17:49:40.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.910+0000 7f70fc919700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8151de0 0x7f70f80bc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.910+0000 7f70fc919700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f80c6da0 con 0x7f70f8068fd0 2023-08-17T17:49:40.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.910+0000 7f70fc919700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f80c2880 con 0x7f70f81509f0 2023-08-17T17:49:40.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.910+0000 7f70fc919700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80bcdf0 con 0x7f70f8151de0 2023-08-17T17:49:40.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.910+0000 7f70f7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f70f8068fd0 0x7f70f80c3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35280/0 (socket says 172.21.15.78:35280) 2023-08-17T17:49:40.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.910+0000 7f70f7fff700 1 -- 172.21.15.78:0/3750345112 learned_addr learned my addr 172.21.15.78:0/3750345112 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:40.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.910+0000 7f70effff700 1 --2- 172.21.15.78:0/3750345112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8151de0 0x7f70f80bc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70f6ffd700 1 -- 172.21.15.78:0/3750345112 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382504491 0 0) 0x7f70f80c6da0 con 0x7f70f8068fd0 2023-08-17T17:49:40.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70f6ffd700 1 -- 172.21.15.78:0/3750345112 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e40033f0 con 0x7f70f8068fd0 2023-08-17T17:49:40.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70f6ffd700 1 -- 172.21.15.78:0/3750345112 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520702017 0 0) 0x7f70f80c2880 con 0x7f70f81509f0 2023-08-17T17:49:40.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70f6ffd700 1 -- 172.21.15.78:0/3750345112 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f80c6da0 con 0x7f70f81509f0 2023-08-17T17:49:40.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70effff700 1 -- 172.21.15.78:0/3750345112 >> v1:172.21.15.150:6789/0 conn(0x7f70f81509f0 legacy=0x7f70f80c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70effff700 1 -- 172.21.15.78:0/3750345112 >> v1:172.21.15.78:6789/0 conn(0x7f70f8068fd0 legacy=0x7f70f80c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70effff700 1 -- 172.21.15.78:0/3750345112 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80c6ac0 con 0x7f70f8151de0 2023-08-17T17:49:40.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70effff700 1 --2- 172.21.15.78:0/3750345112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8151de0 0x7f70f80bc900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f70e0009790 tx=0x7f70e0009060).ready entity=mon.2 client_cookie=bbc68699de468451 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:40.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70f6ffd700 1 -- 172.21.15.78:0/3750345112 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e000f510 con 0x7f70f8151de0 2023-08-17T17:49:40.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70f6ffd700 1 -- 172.21.15.78:0/3750345112 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e000f670 con 0x7f70f8151de0 2023-08-17T17:49:40.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.911+0000 7f70f6ffd700 1 -- 172.21.15.78:0/3750345112 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e000f9f0 con 0x7f70f8151de0 2023-08-17T17:49:40.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.912+0000 7f70fc919700 1 -- 172.21.15.78:0/3750345112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8151de0 msgr2=0x7f70f80bc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.912+0000 7f70fc919700 1 --2- 172.21.15.78:0/3750345112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8151de0 0x7f70f80bc900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f70e0009790 tx=0x7f70e0009060).stop 2023-08-17T17:49:40.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.912+0000 7f70fc919700 1 -- 172.21.15.78:0/3750345112 shutdown_connections 2023-08-17T17:49:40.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.912+0000 7f70fc919700 1 --2- 172.21.15.78:0/3750345112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8151de0 0x7f70f80bc900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.912+0000 7f70fc919700 1 -- 172.21.15.78:0/3750345112 >> 172.21.15.78:0/3750345112 conn(0x7f70f80c4440 msgr2=0x7f70f80c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:40.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.912+0000 7f70fc919700 1 -- 172.21.15.78:0/3750345112 shutdown_connections 2023-08-17T17:49:40.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.912+0000 7f70fc919700 1 -- 172.21.15.78:0/3750345112 wait complete. 2023-08-17T17:49:40.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.913+0000 7f70fc919700 1 Processor -- start 2023-08-17T17:49:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.913+0000 7f70fc919700 1 -- start start 2023-08-17T17:49:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70fc919700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8068fd0 0x7f70f814a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70fc919700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70f81509f0 0x7f70f8149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70fc919700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70f8151de0 0x7f70f80ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70fc919700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80ab400 con 0x7f70f8151de0 2023-08-17T17:49:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70fc919700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8149d60 con 0x7f70f81509f0 2023-08-17T17:49:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70fc919700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80aa050 con 0x7f70f8068fd0 2023-08-17T17:49:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70f8151de0 0x7f70f80ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70f8151de0 0x7f70f80ac350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32852/0 (socket says 172.21.15.78:32852) 2023-08-17T17:49:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f7fff700 1 -- 172.21.15.78:0/3288663807 learned_addr learned my addr 172.21.15.78:0/3288663807 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f77fe700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8068fd0 0x7f70f814a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70effff700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70f81509f0 0x7f70f8149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f7fff700 1 -- 172.21.15.78:0/3288663807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8068fd0 msgr2=0x7f70f814a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f7fff700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8068fd0 0x7f70f814a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f7fff700 1 -- 172.21.15.78:0/3288663807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70f81509f0 msgr2=0x7f70f8149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f7fff700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70f81509f0 0x7f70f8149870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f7fff700 1 -- 172.21.15.78:0/3288663807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00092a0 con 0x7f70f8151de0 2023-08-17T17:49:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f77fe700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8068fd0 0x7f70f814a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70f7fff700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70f8151de0 0x7f70f80ac350 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f70f0001560 tx=0x7f70f0001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70ef7fe700 1 -- 172.21.15.78:0/3288663807 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0005d30 con 0x7f70f8151de0 2023-08-17T17:49:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70ef7fe700 1 -- 172.21.15.78:0/3288663807 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f0005e90 con 0x7f70f8151de0 2023-08-17T17:49:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70ef7fe700 1 -- 172.21.15.78:0/3288663807 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0007340 con 0x7f70f8151de0 2023-08-17T17:49:40.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.914+0000 7f70fc919700 1 -- 172.21.15.78:0/3288663807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f80ab6a0 con 0x7f70f8151de0 2023-08-17T17:49:40.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.915+0000 7f70fc919700 1 -- 172.21.15.78:0/3288663807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f80be310 con 0x7f70f8151de0 2023-08-17T17:49:40.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.915+0000 7f70fc919700 1 -- 172.21.15.78:0/3288663807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f80a84e0 con 0x7f70f8151de0 2023-08-17T17:49:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.916+0000 7f70ef7fe700 1 -- 172.21.15.78:0/3288663807 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f70f0010030 con 0x7f70f8151de0 2023-08-17T17:49:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.916+0000 7f70ef7fe700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f70d805ede0 0x7f70d80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.916+0000 7f70f77fe700 1 -- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f70d805ede0 msgr2=0x7f70d80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.917+0000 7f70ef7fe700 1 -- 172.21.15.78:0/3288663807 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f70f0079b70 con 0x7f70f8151de0 2023-08-17T17:49:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.917+0000 7f70f77fe700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f70d805ede0 0x7f70d80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:40.921+0000 7f70ef7fe700 1 -- 172.21.15.78:0/3288663807 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f70f80a84e0 con 0x7f70f8151de0 2023-08-17T17:49:40.960 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:40.959+0000 7fce70bc4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:49:40.966 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:40.965+0000 7f56436f2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:49:41.031 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:41.030+0000 7fce70bc4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:49:41.109 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:41.108+0000 7fce70bc4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:49:41.112 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:41.112+0000 7f56436f2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:49:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.118+0000 7f70f77fe700 1 -- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f70d805ede0 msgr2=0x7f70d80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.118+0000 7f70f77fe700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f70d805ede0 0x7f70d80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.131+0000 7f70fc919700 1 -- 172.21.15.78:0/3288663807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70f80a84e0 con 0x7f70f8151de0 2023-08-17T17:49:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.131+0000 7f70ef7fe700 1 -- 172.21.15.78:0/3288663807 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f70f80a84e0 con 0x7f70f8151de0 2023-08-17T17:49:41.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:41.133 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2895715400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2895715400},{"type":"v1","addr":"172.21.15.150:6834","nonce":2895715400}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1604940701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1604940701},{"type":"v1","addr":"172.21.15.78:6836","nonce":1604940701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6234,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1676496794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1676496794},{"type":"v1","addr":"172.21.15.78:6837","nonce":1676496794}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:19.673872+0000","modified":"2023-08-17T17:49:21.684217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6246":{"gid":6246,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3219133912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3219133912},{"type":"v1","addr":"172.21.15.150:6835","nonce":3219133912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T17:49:41.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 -- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f70d805ede0 msgr2=0x7f70d80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f70d805ede0 0x7f70d80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 -- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70f8151de0 msgr2=0x7f70f80ac350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70f8151de0 0x7f70f80ac350 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f70f0001560 tx=0x7f70f0001650).stop 2023-08-17T17:49:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 -- 172.21.15.78:0/3288663807 shutdown_connections 2023-08-17T17:49:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f70d805ede0 0x7f70d80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70f8151de0 0x7f70f80ac350 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70f8068fd0 0x7f70f814a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 --2- 172.21.15.78:0/3288663807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70f81509f0 0x7f70f8149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 -- 172.21.15.78:0/3288663807 >> 172.21.15.78:0/3288663807 conn(0x7f70f80c4440 msgr2=0x7f70f80661c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:41.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 -- 172.21.15.78:0/3288663807 shutdown_connections 2023-08-17T17:49:41.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.133+0000 7f70fc919700 1 -- 172.21.15.78:0/3288663807 wait complete. 2023-08-17T17:49:41.136 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 25 2023-08-17T17:49:41.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:41.182 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:41.182+0000 7f56436f2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:49:41.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.261+0000 7f6b122b6700 1 Processor -- start 2023-08-17T17:49:41.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.261+0000 7f6b122b6700 1 -- start start 2023-08-17T17:49:41.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.262+0000 7f6b122b6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b0c066a40 0x7f6b0c0624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.262+0000 7f6b122b6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0c0c6040 con 0x7f6b0c066660 2023-08-17T17:49:41.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.262+0000 7f6b122b6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0c069b00 con 0x7f6b0c0629e0 2023-08-17T17:49:41.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.262+0000 7f6b122b6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0c062e50 con 0x7f6b0c066a40 2023-08-17T17:49:41.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.262+0000 7f6b0bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6b0c066660 0x7f6b0c0c5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35288/0 (socket says 172.21.15.78:35288) 2023-08-17T17:49:41.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.262+0000 7f6b0bfff700 1 -- 172.21.15.78:0/3754072745 learned_addr learned my addr 172.21.15.78:0/3754072745 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:41.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.262+0000 7f6b0b7fe700 1 --2- 172.21.15.78:0/3754072745 >> v2:172.21.15.150:3300/0 conn(0x7f6b0c066a40 0x7f6b0c0624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:41.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.263+0000 7f6b0affd700 1 -- 172.21.15.78:0/3754072745 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124677790 0 0) 0x7f6af4001110 con 0x7f6b0c066660 2023-08-17T17:49:41.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.263+0000 7f6b0affd700 1 -- 172.21.15.78:0/3754072745 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af80033f0 con 0x7f6b0c066660 2023-08-17T17:49:41.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.263+0000 7f6b0b7fe700 1 -- 172.21.15.78:0/3754072745 >> v1:172.21.15.150:6789/0 conn(0x7f6b0c0629e0 legacy=0x7f6b0c151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.263+0000 7f6b0affd700 1 -- 172.21.15.78:0/3754072745 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338050615 0 0) 0x7f6b0c069b00 con 0x7f6b0c0629e0 2023-08-17T17:49:41.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.263+0000 7f6b0b7fe700 1 -- 172.21.15.78:0/3754072745 >> v1:172.21.15.78:6789/0 conn(0x7f6b0c066660 legacy=0x7f6b0c0c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.263+0000 7f6b0b7fe700 1 -- 172.21.15.78:0/3754072745 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c069f90 con 0x7f6b0c066a40 2023-08-17T17:49:41.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.263+0000 7f6b0b7fe700 1 --2- 172.21.15.78:0/3754072745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0c066a40 0x7f6b0c0624f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f6afc009760 tx=0x7f6afc009060).ready entity=mon.1 client_cookie=a75b78512f04f345 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:41.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.263+0000 7f6b0affd700 1 -- 172.21.15.78:0/3754072745 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc00d4a0 con 0x7f6b0c066a40 2023-08-17T17:49:41.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.263+0000 7f6b0affd700 1 -- 172.21.15.78:0/3754072745 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc00d600 con 0x7f6b0c066a40 2023-08-17T17:49:41.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.263+0000 7f6b0affd700 1 -- 172.21.15.78:0/3754072745 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc00d980 con 0x7f6b0c066a40 2023-08-17T17:49:41.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.264+0000 7f6b122b6700 1 -- 172.21.15.78:0/3754072745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0c066a40 msgr2=0x7f6b0c0624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.264+0000 7f6b122b6700 1 --2- 172.21.15.78:0/3754072745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0c066a40 0x7f6b0c0624f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f6afc009760 tx=0x7f6afc009060).stop 2023-08-17T17:49:41.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.264+0000 7f6b122b6700 1 -- 172.21.15.78:0/3754072745 shutdown_connections 2023-08-17T17:49:41.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.264+0000 7f6b122b6700 1 --2- 172.21.15.78:0/3754072745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0c066a40 0x7f6b0c0624f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.264+0000 7f6b122b6700 1 -- 172.21.15.78:0/3754072745 >> 172.21.15.78:0/3754072745 conn(0x7f6b0c0c7b00 msgr2=0x7f6b0c0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:41.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.264+0000 7f6b122b6700 1 -- 172.21.15.78:0/3754072745 shutdown_connections 2023-08-17T17:49:41.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.264+0000 7f6b122b6700 1 -- 172.21.15.78:0/3754072745 wait complete. 2023-08-17T17:49:41.268 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:41.264+0000 7fce70bc4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:49:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.265+0000 7f6b122b6700 1 Processor -- start 2023-08-17T17:49:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.265+0000 7f6b122b6700 1 -- start start 2023-08-17T17:49:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b122b6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0c0629e0 0x7f6b0c0a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b122b6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b0c066660 0x7f6b0c0c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b122b6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b0c066a40 0x7f6b0c151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b122b6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c0c1ec0 con 0x7f6b0c066a40 2023-08-17T17:49:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b122b6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c0ac5b0 con 0x7f6b0c0629e0 2023-08-17T17:49:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b122b6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c0c1c10 con 0x7f6b0c066660 2023-08-17T17:49:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b10853700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b0c066a40 0x7f6b0c151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b10853700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b0c066a40 0x7f6b0c151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32858/0 (socket says 172.21.15.78:32858) 2023-08-17T17:49:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b10853700 1 -- 172.21.15.78:0/1717272014 learned_addr learned my addr 172.21.15.78:0/1717272014 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b0bfff700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0c0629e0 0x7f6b0c0a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b0b7fe700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b0c066660 0x7f6b0c0c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b10853700 1 -- 172.21.15.78:0/1717272014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b0c066660 msgr2=0x7f6b0c0c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b10853700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b0c066660 0x7f6b0c0c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b10853700 1 -- 172.21.15.78:0/1717272014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0c0629e0 msgr2=0x7f6b0c0a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b10853700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0c0629e0 0x7f6b0c0a9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b10853700 1 -- 172.21.15.78:0/1717272014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0092a0 con 0x7f6b0c066a40 2023-08-17T17:49:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b10853700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b0c066a40 0x7f6b0c151c50 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f6b0400c7e0 tx=0x7f6b04007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b03fff700 1 -- 172.21.15.78:0/1717272014 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04010510 con 0x7f6b0c066a40 2023-08-17T17:49:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.266+0000 7f6b03fff700 1 -- 172.21.15.78:0/1717272014 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b04010670 con 0x7f6b0c066a40 2023-08-17T17:49:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.267+0000 7f6b122b6700 1 -- 172.21.15.78:0/1717272014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0c0abc80 con 0x7f6b0c066a40 2023-08-17T17:49:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.267+0000 7f6b03fff700 1 -- 172.21.15.78:0/1717272014 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04010a10 con 0x7f6b0c066a40 2023-08-17T17:49:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.267+0000 7f6b122b6700 1 -- 172.21.15.78:0/1717272014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0c0ac240 con 0x7f6b0c066a40 2023-08-17T17:49:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.267+0000 7f6b122b6700 1 -- 172.21.15.78:0/1717272014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0c047350 con 0x7f6b0c066a40 2023-08-17T17:49:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.268+0000 7f6b03fff700 1 -- 172.21.15.78:0/1717272014 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f6b04003020 con 0x7f6b0c066a40 2023-08-17T17:49:41.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.269+0000 7f6b03fff700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6aec05ede0 0x7f6aec0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.269+0000 7f6b0bfff700 1 -- 172.21.15.78:0/1717272014 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6aec05ede0 msgr2=0x7f6aec0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:41.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.269+0000 7f6b03fff700 1 -- 172.21.15.78:0/1717272014 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f6b04079990 con 0x7f6b0c066a40 2023-08-17T17:49:41.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.269+0000 7f6b0bfff700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6aec05ede0 0x7f6aec0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:41.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.273+0000 7f6b03fff700 1 -- 172.21.15.78:0/1717272014 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6b0404adb0 con 0x7f6b0c066a40 2023-08-17T17:49:41.299 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:41.299+0000 7f56436f2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:49:41.340 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:41.339+0000 7fce70bc4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:49:41.406 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:41.406+0000 7f56436f2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:41.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.441+0000 7f6b122b6700 1 -- 172.21.15.78:0/1717272014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b0c0aa5e0 con 0x7f6b0c066a40 2023-08-17T17:49:41.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.442+0000 7f6b03fff700 1 -- 172.21.15.78:0/1717272014 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17222 (secure 0 0 0) 0x7f6b0404e3d0 con 0x7f6b0c066a40 2023-08-17T17:49:41.443 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:41.443 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":78,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:35.469135+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:18.219880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:18.637834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/688373490":"2023-08-18T17:49:35.469105+0000","172.21.15.78:6833/119464":"2023-08-18T17:49:35.469105+0000","172.21.15.78:6832/119464":"2023-08-18T17:49:35.469105+0000","172.21.15.78:0/3671427962":"2023-08-18T17:49:35.469105+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.443+0000 7f6b122b6700 1 -- 172.21.15.78:0/1717272014 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6aec05ede0 msgr2=0x7f6aec0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.443+0000 7f6b122b6700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6aec05ede0 0x7f6aec0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.443+0000 7f6b122b6700 1 -- 172.21.15.78:0/1717272014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b0c066a40 msgr2=0x7f6b0c151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.443+0000 7f6b122b6700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b0c066a40 0x7f6b0c151c50 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f6b0400c7e0 tx=0x7f6b04007f70).stop 2023-08-17T17:49:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.443+0000 7f6b122b6700 1 -- 172.21.15.78:0/1717272014 shutdown_connections 2023-08-17T17:49:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.443+0000 7f6b122b6700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6aec05ede0 0x7f6aec0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.443+0000 7f6b122b6700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b0c066a40 0x7f6b0c151c50 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.443+0000 7f6b122b6700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0c0629e0 0x7f6b0c0a9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.443+0000 7f6b122b6700 1 --2- 172.21.15.78:0/1717272014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b0c066660 0x7f6b0c0c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.443+0000 7f6b122b6700 1 -- 172.21.15.78:0/1717272014 >> 172.21.15.78:0/1717272014 conn(0x7f6b0c0c7b00 msgr2=0x7f6b0c156fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.444+0000 7f6b122b6700 1 -- 172.21.15.78:0/1717272014 shutdown_connections 2023-08-17T17:49:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.444+0000 7f6b122b6700 1 -- 172.21.15.78:0/1717272014 wait complete. 2023-08-17T17:49:41.457 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T17:49:41.458 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:41.456+0000 7fce70bc4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:49:41.573 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:41.572+0000 7fce70bc4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:49:41.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.575+0000 7fae3e061700 1 Processor -- start 2023-08-17T17:49:41.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.575+0000 7fae3e061700 1 -- start start 2023-08-17T17:49:41.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.575+0000 7fae3e061700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 0x7fae380bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.575+0000 7fae3e061700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fae38150d90 0x7fae381551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.575+0000 7fae3e061700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae380c2860 con 0x7fae38064f00 2023-08-17T17:49:41.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.575+0000 7fae3e061700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae380694e0 con 0x7fae38150d90 2023-08-17T17:49:41.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae3e061700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae380697c0 con 0x7fae381509b0 2023-08-17T17:49:41.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae37fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fae38064f00 0x7fae380bc110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35290/0 (socket says 172.21.15.78:35290) 2023-08-17T17:49:41.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae37fff700 1 -- 172.21.15.78:0/752866592 learned_addr learned my addr 172.21.15.78:0/752866592 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:41.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae377fe700 1 --2- 172.21.15.78:0/752866592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 0x7fae380bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:41.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae36ffd700 1 --2- 172.21.15.78:0/752866592 >> v2:172.21.15.150:3300/0 conn(0x7fae38150d90 0x7fae381551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:41.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae367fc700 1 -- 172.21.15.78:0/752866592 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368706623 0 0) 0x7fae380c2860 con 0x7fae38064f00 2023-08-17T17:49:41.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae367fc700 1 -- 172.21.15.78:0/752866592 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae240033f0 con 0x7fae38064f00 2023-08-17T17:49:41.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae377fe700 1 -- 172.21.15.78:0/752866592 >> v2:172.21.15.150:3300/0 conn(0x7fae38150d90 msgr2=0x7fae381551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:41.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae377fe700 1 --2- 172.21.15.78:0/752866592 >> v2:172.21.15.150:3300/0 conn(0x7fae38150d90 0x7fae381551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae377fe700 1 -- 172.21.15.78:0/752866592 >> v1:172.21.15.78:6789/0 conn(0x7fae38064f00 legacy=0x7fae380bc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae377fe700 1 -- 172.21.15.78:0/752866592 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38069aa0 con 0x7fae381509b0 2023-08-17T17:49:41.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae36ffd700 1 --2- 172.21.15.78:0/752866592 >> v2:172.21.15.150:3300/0 conn(0x7fae38150d90 0x7fae381551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:41.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae377fe700 1 --2- 172.21.15.78:0/752866592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 0x7fae380bdca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fae28009e60 tx=0x7fae28009780).ready entity=mon.2 client_cookie=abb82be961b7eb54 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:41.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae367fc700 1 -- 172.21.15.78:0/752866592 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800e070 con 0x7fae381509b0 2023-08-17T17:49:41.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae367fc700 1 -- 172.21.15.78:0/752866592 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2800bab0 con 0x7fae381509b0 2023-08-17T17:49:41.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.576+0000 7fae367fc700 1 -- 172.21.15.78:0/752866592 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800be30 con 0x7fae381509b0 2023-08-17T17:49:41.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.577+0000 7fae3e061700 1 -- 172.21.15.78:0/752866592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 msgr2=0x7fae380bdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.577+0000 7fae3e061700 1 --2- 172.21.15.78:0/752866592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 0x7fae380bdca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fae28009e60 tx=0x7fae28009780).stop 2023-08-17T17:49:41.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.577+0000 7fae3e061700 1 -- 172.21.15.78:0/752866592 shutdown_connections 2023-08-17T17:49:41.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.577+0000 7fae3e061700 1 --2- 172.21.15.78:0/752866592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 0x7fae380bdca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.577+0000 7fae3e061700 1 --2- 172.21.15.78:0/752866592 >> v2:172.21.15.150:3300/0 conn(0x7fae38150d90 0x7fae381551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.577+0000 7fae3e061700 1 -- 172.21.15.78:0/752866592 >> 172.21.15.78:0/752866592 conn(0x7fae380c4720 msgr2=0x7fae380647f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:41.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.577+0000 7fae3e061700 1 -- 172.21.15.78:0/752866592 shutdown_connections 2023-08-17T17:49:41.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.577+0000 7fae3e061700 1 -- 172.21.15.78:0/752866592 wait complete. 2023-08-17T17:49:41.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.578+0000 7fae3e061700 1 Processor -- start 2023-08-17T17:49:41.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.578+0000 7fae3e061700 1 -- start start 2023-08-17T17:49:41.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae3e061700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae38064f00 0x7fae38165bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae3e061700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 0x7fae38163010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae3e061700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae38150d90 0x7fae38154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae3e061700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae38166420 con 0x7fae38150d90 2023-08-17T17:49:41.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae3e061700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae380c1c40 con 0x7fae38064f00 2023-08-17T17:49:41.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae3e061700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae38152f00 con 0x7fae381509b0 2023-08-17T17:49:41.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae37fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae38150d90 0x7fae38154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:41.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae37fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae38150d90 0x7fae38154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32868/0 (socket says 172.21.15.78:32868) 2023-08-17T17:49:41.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae37fff700 1 -- 172.21.15.78:0/1087438654 learned_addr learned my addr 172.21.15.78:0/1087438654 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:41.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae377fe700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae38064f00 0x7fae38165bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:41.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.579+0000 7fae36ffd700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 0x7fae38163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:41.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae37fff700 1 -- 172.21.15.78:0/1087438654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 msgr2=0x7fae38163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae37fff700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 0x7fae38163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae37fff700 1 -- 172.21.15.78:0/1087438654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae38064f00 msgr2=0x7fae38165bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:41.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae37fff700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae38064f00 0x7fae38165bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:41.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae37fff700 1 -- 172.21.15.78:0/1087438654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200092a0 con 0x7fae38150d90 2023-08-17T17:49:41.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae377fe700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae38064f00 0x7fae38165bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:41.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae37fff700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae38150d90 0x7fae38154f60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fae300010e0 tx=0x7fae30007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:41.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae2f7fe700 1 -- 172.21.15.78:0/1087438654 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300070d0 con 0x7fae38150d90 2023-08-17T17:49:41.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae2f7fe700 1 -- 172.21.15.78:0/1087438654 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30007230 con 0x7fae38150d90 2023-08-17T17:49:41.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae3e061700 1 -- 172.21.15.78:0/1087438654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae28009a20 con 0x7fae38150d90 2023-08-17T17:49:41.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae2f7fe700 1 -- 172.21.15.78:0/1087438654 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300075b0 con 0x7fae38150d90 2023-08-17T17:49:41.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.580+0000 7fae3e061700 1 -- 172.21.15.78:0/1087438654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae38152b90 con 0x7fae38150d90 2023-08-17T17:49:41.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.581+0000 7fae3e061700 1 -- 172.21.15.78:0/1087438654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae38153090 con 0x7fae38150d90 2023-08-17T17:49:41.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.581+0000 7fae2f7fe700 1 -- 172.21.15.78:0/1087438654 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fae3001a060 con 0x7fae38150d90 2023-08-17T17:49:41.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.582+0000 7fae2f7fe700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae1805edb0 0x7fae18061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:41.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.582+0000 7fae377fe700 1 -- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae1805edb0 msgr2=0x7fae18061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:41.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.582+0000 7fae2f7fe700 1 -- 172.21.15.78:0/1087438654 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fae300795b0 con 0x7fae38150d90 2023-08-17T17:49:41.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.582+0000 7fae377fe700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae1805edb0 0x7fae18061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:49:41.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.589+0000 7fae2f7fe700 1 -- 172.21.15.78:0/1087438654 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae3004a9d0 con 0x7fae38150d90 2023-08-17T17:49:41.699 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:41.698+0000 7f56436f2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:49:41.769 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:49:41.769+0000 7f56436f2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:49:41.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.783+0000 7fae377fe700 1 -- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae1805edb0 msgr2=0x7fae18061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:49:41.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.783+0000 7fae377fe700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae1805edb0 0x7fae18061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:49:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.801+0000 7fae3e061700 1 -- 172.21.15.78:0/1087438654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fae38069d80 con 0x7fae38150d90 2023-08-17T17:49:41.874 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:41.873+0000 7fce70bc4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:49:41.945 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:41.944+0000 7fce70bc4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:49:41.965 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:41.965 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:41.965 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:41.965 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:41.966 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2023-08-17T17:49:41.966 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:49:41.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.964+0000 7fae2f7fe700 1 -- 172.21.15.78:0/1087438654 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 29) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fae30010070 con 0x7fae38150d90 2023-08-17T17:49:41.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.964+0000 7fae2f7fe700 1 -- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae1805edb0 msgr2=0x7fae18061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:49:41.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:41.964+0000 7fae2f7fe700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae1805edb0 0x7fae18061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:41.969 INFO:tasks.ceph.mds.d.smithi150.stderr: -2103> 2023-08-17T17:49:25.599+0000 7fab2d465700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:49:41.971 INFO:tasks.ceph.mds.d.smithi150.stderr: -7> 2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:41.972 INFO:tasks.ceph.mds.d.smithi150.stderr: -6> 2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:41.972 INFO:tasks.ceph.mds.d.smithi150.stderr: -5> 2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:41.972 INFO:tasks.ceph.mds.d.smithi150.stderr: -4> 2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:49:41.972 INFO:tasks.ceph.mds.d.smithi150.stderr: -3> 2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2023-08-17T17:49:41.972 INFO:tasks.ceph.mds.d.smithi150.stderr: -1> 2023-08-17T17:49:41.964+0000 7fab29c5e700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:49:41.989 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:49:42.027 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:42.026+0000 7fcdf2ba9700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:42.027 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:42.026+0000 7fcdf2ba9700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:42.028 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:42.026+0000 7fcdf2ba9700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:42.028 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:42.026+0000 7fcdf2ba9700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:42.028 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:42.026+0000 7fcdf2ba9700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:42.028 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:42.026+0000 7fcdf0ba5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:42.028 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:42.026+0000 7fcdf0ba5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:42.028 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:42.026+0000 7fcdf0ba5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:42.028 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:42.026+0000 7fcdf0ba5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:42.029 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:49:42.026+0000 7fcdf0ba5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:49:42.532 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T17:49:42.531+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T17:49:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.537+0000 7fae2f7fe700 1 -- 172.21.15.78:0/1087438654 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7fae300768d0 con 0x7fae38150d90 2023-08-17T17:49:42.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.539+0000 7fae3e061700 1 -- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae38150d90 msgr2=0x7fae38154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:42.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.539+0000 7fae3e061700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae38150d90 0x7fae38154f60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fae300010e0 tx=0x7fae30007c50).stop 2023-08-17T17:49:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.539+0000 7fae3e061700 1 -- 172.21.15.78:0/1087438654 shutdown_connections 2023-08-17T17:49:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.539+0000 7fae3e061700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae1805edb0 0x7fae18061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:49:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.539+0000 7fae3e061700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae38150d90 0x7fae38154f60 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.539+0000 7fae3e061700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae38064f00 0x7fae38165bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.539+0000 7fae3e061700 1 --2- 172.21.15.78:0/1087438654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae381509b0 0x7fae38163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.539+0000 7fae3e061700 1 -- 172.21.15.78:0/1087438654 >> 172.21.15.78:0/1087438654 conn(0x7fae380c4720 msgr2=0x7fae380bd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.539+0000 7fae3e061700 1 -- 172.21.15.78:0/1087438654 shutdown_connections 2023-08-17T17:49:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.539+0000 7fae3e061700 1 -- 172.21.15.78:0/1087438654 wait complete. 2023-08-17T17:49:42.542 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T17:49:42.552 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T17:49:42.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.666+0000 7f4786a30700 1 Processor -- start 2023-08-17T17:49:42.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.666+0000 7f4786a30700 1 -- start start 2023-08-17T17:49:42.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.667+0000 7f4786a30700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47800aa0f0 0x7f47800644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:42.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.667+0000 7f4786a30700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f47800c5810 0x7f47800c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:42.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.667+0000 7f4786a30700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47800649b0 con 0x7f47800aa4d0 2023-08-17T17:49:42.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.667+0000 7f4786a30700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47800c6170 con 0x7f47800aa0f0 2023-08-17T17:49:42.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.667+0000 7f4786a30700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4780063420 con 0x7f47800c5810 2023-08-17T17:49:42.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.667+0000 7f477ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47800aa0f0 0x7f47800644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:42.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.667+0000 7f477ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47800aa0f0 0x7f47800644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32956/0 (socket says 172.21.15.78:32956) 2023-08-17T17:49:42.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.667+0000 7f477ffff700 1 -- 172.21.15.78:0/2103311907 learned_addr learned my addr 172.21.15.78:0/2103311907 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:42.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f4784fcd700 1 --2- 172.21.15.78:0/2103311907 >> v2:172.21.15.150:3300/0 conn(0x7f47800c5810 0x7f47800c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:42.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f477ffff700 1 -- 172.21.15.78:0/2103311907 >> v2:172.21.15.150:3300/0 conn(0x7f47800c5810 msgr2=0x7f47800c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:42.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f477ffff700 1 --2- 172.21.15.78:0/2103311907 >> v2:172.21.15.150:3300/0 conn(0x7f47800c5810 0x7f47800c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:42.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f477ffff700 1 -- 172.21.15.78:0/2103311907 >> v1:172.21.15.78:6789/0 conn(0x7f47800aa4d0 legacy=0x7f47800c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:42.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f477ffff700 1 -- 172.21.15.78:0/2103311907 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4780063700 con 0x7f47800aa0f0 2023-08-17T17:49:42.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f477ffff700 1 --2- 172.21.15.78:0/2103311907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa0f0 0x7f47800644c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f4780159090 tx=0x7f47700090f0).ready entity=mon.0 client_cookie=92b0afb0d0fcbe2d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:42.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f477effd700 1 -- 172.21.15.78:0/2103311907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000b520 con 0x7f47800aa0f0 2023-08-17T17:49:42.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f477effd700 1 -- 172.21.15.78:0/2103311907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000b680 con 0x7f47800aa0f0 2023-08-17T17:49:42.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f477effd700 1 -- 172.21.15.78:0/2103311907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000ba00 con 0x7f47800aa0f0 2023-08-17T17:49:42.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f4786a30700 1 -- 172.21.15.78:0/2103311907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa0f0 msgr2=0x7f47800644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:42.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.668+0000 7f4786a30700 1 --2- 172.21.15.78:0/2103311907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa0f0 0x7f47800644c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f4780159090 tx=0x7f47700090f0).stop 2023-08-17T17:49:42.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.669+0000 7f4786a30700 1 -- 172.21.15.78:0/2103311907 shutdown_connections 2023-08-17T17:49:42.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.669+0000 7f4786a30700 1 --2- 172.21.15.78:0/2103311907 >> v2:172.21.15.150:3300/0 conn(0x7f47800c5810 0x7f47800c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:42.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.669+0000 7f4786a30700 1 --2- 172.21.15.78:0/2103311907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa0f0 0x7f47800644c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:42.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.669+0000 7f4786a30700 1 -- 172.21.15.78:0/2103311907 >> 172.21.15.78:0/2103311907 conn(0x7f478006a6a0 msgr2=0x7f47800caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:42.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.669+0000 7f4786a30700 1 -- 172.21.15.78:0/2103311907 shutdown_connections 2023-08-17T17:49:42.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.669+0000 7f4786a30700 1 -- 172.21.15.78:0/2103311907 wait complete. 2023-08-17T17:49:42.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.670+0000 7f4786a30700 1 Processor -- start 2023-08-17T17:49:42.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.670+0000 7f4786a30700 1 -- start start 2023-08-17T17:49:42.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f4786a30700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47800aa0f0 0x7f47800c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:42.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f4786a30700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa4d0 0x7f47800c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:42.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f4786a30700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47800c5810 0x7f47800c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:42.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f4786a30700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4780144da0 con 0x7f47800aa4d0 2023-08-17T17:49:42.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f4786a30700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4780141dc0 con 0x7f47800aa0f0 2023-08-17T17:49:42.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f4786a30700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4780142900 con 0x7f47800c5810 2023-08-17T17:49:42.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f477f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa4d0 0x7f47800c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:42.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f477f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa4d0 0x7f47800c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32962/0 (socket says 172.21.15.78:32962) 2023-08-17T17:49:42.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f477f7fe700 1 -- 172.21.15.78:0/1264877749 learned_addr learned my addr 172.21.15.78:0/1264877749 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:42.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f477ffff700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47800aa0f0 0x7f47800c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:42.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f4784fcd700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47800c5810 0x7f47800c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:42.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f477f7fe700 1 -- 172.21.15.78:0/1264877749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47800c5810 msgr2=0x7f47800c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:42.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f477f7fe700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47800c5810 0x7f47800c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:42.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f477f7fe700 1 -- 172.21.15.78:0/1264877749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47800aa0f0 msgr2=0x7f47800c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:42.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f477f7fe700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47800aa0f0 0x7f47800c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:42.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f477f7fe700 1 -- 172.21.15.78:0/1264877749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770009370 con 0x7f47800aa4d0 2023-08-17T17:49:42.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f477f7fe700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa4d0 0x7f47800c4fe0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f477400c4c0 tx=0x7f4774007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:42.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.671+0000 7f4767fff700 1 -- 172.21.15.78:0/1264877749 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477400ce10 con 0x7f47800aa4d0 2023-08-17T17:49:42.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.672+0000 7f4767fff700 1 -- 172.21.15.78:0/1264877749 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4774007020 con 0x7f47800aa4d0 2023-08-17T17:49:42.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.672+0000 7f4786a30700 1 -- 172.21.15.78:0/1264877749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4780141fd0 con 0x7f47800aa4d0 2023-08-17T17:49:42.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.672+0000 7f4767fff700 1 -- 172.21.15.78:0/1264877749 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740073c0 con 0x7f47800aa4d0 2023-08-17T17:49:42.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.672+0000 7f4786a30700 1 -- 172.21.15.78:0/1264877749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4780142590 con 0x7f47800aa4d0 2023-08-17T17:49:42.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.673+0000 7f4786a30700 1 -- 172.21.15.78:0/1264877749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4780142ab0 con 0x7f47800aa4d0 2023-08-17T17:49:42.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.673+0000 7f4767fff700 1 -- 172.21.15.78:0/1264877749 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 29) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f4774010070 con 0x7f47800aa4d0 2023-08-17T17:49:42.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.673+0000 7f4767fff700 1 -- 172.21.15.78:0/1264877749 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f4774078d00 con 0x7f47800aa4d0 2023-08-17T17:49:42.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.677+0000 7f4767fff700 1 -- 172.21.15.78:0/1264877749 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f47740478f0 con 0x7f47800aa4d0 2023-08-17T17:49:42.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.881+0000 7f4786a30700 1 -- 172.21.15.78:0/1264877749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4780046af0 con 0x7f47800aa4d0 2023-08-17T17:49:42.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.967+0000 7f4767fff700 1 -- 172.21.15.78:0/1264877749 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 30) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f4774076ac0 con 0x7f47800aa4d0 2023-08-17T17:49:42.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.968+0000 7f4767fff700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f476c0301b0 0x7f476c067760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:42.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.969+0000 7f477ffff700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f476c0301b0 0x7f476c067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:42.970+0000 7f477ffff700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f476c0301b0 0x7f476c067760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4770009130 tx=0x7f4770017000).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:43.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.537+0000 7f4767fff700 1 -- 172.21.15.78:0/1264877749 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f477406f920 con 0x7f47800aa4d0 2023-08-17T17:49:43.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.539+0000 7f4786a30700 1 -- 172.21.15.78:0/1264877749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f476c0301b0 msgr2=0x7f476c067760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:43.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.539+0000 7f4786a30700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f476c0301b0 0x7f476c067760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4770009130 tx=0x7f4770017000).stop 2023-08-17T17:49:43.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.539+0000 7f4786a30700 1 -- 172.21.15.78:0/1264877749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa4d0 msgr2=0x7f47800c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:43.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.539+0000 7f4786a30700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa4d0 0x7f47800c4fe0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f477400c4c0 tx=0x7f4774007dd0).stop 2023-08-17T17:49:43.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.539+0000 7f4786a30700 1 -- 172.21.15.78:0/1264877749 shutdown_connections 2023-08-17T17:49:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.539+0000 7f4786a30700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f476c0301b0 0x7f476c067760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.539+0000 7f4786a30700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47800c5810 0x7f47800c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.539+0000 7f4786a30700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47800aa0f0 0x7f47800c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.539+0000 7f4786a30700 1 --2- 172.21.15.78:0/1264877749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47800aa4d0 0x7f47800c4fe0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.539+0000 7f4786a30700 1 -- 172.21.15.78:0/1264877749 >> 172.21.15.78:0/1264877749 conn(0x7f478006a6a0 msgr2=0x7f47800a8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.540+0000 7f4786a30700 1 -- 172.21.15.78:0/1264877749 shutdown_connections 2023-08-17T17:49:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.540+0000 7f4786a30700 1 -- 172.21.15.78:0/1264877749 wait complete. 2023-08-17T17:49:43.553 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T17:49:43.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.667+0000 7f1897d8f700 1 Processor -- start 2023-08-17T17:49:43.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.667+0000 7f1897d8f700 1 -- start start 2023-08-17T17:49:43.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1897d8f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18900aa0f0 0x7f18900644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:43.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1897d8f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18900649b0 con 0x7f18900c5810 2023-08-17T17:49:43.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1897d8f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1890063420 con 0x7f18900aa4d0 2023-08-17T17:49:43.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1897d8f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1890063700 con 0x7f18900aa0f0 2023-08-17T17:49:43.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1895b2b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18900aa0f0 0x7f18900644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:43.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1895b2b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18900aa0f0 0x7f18900644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32968/0 (socket says 172.21.15.78:32968) 2023-08-17T17:49:43.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f189632c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f18900c5810 0x7f18900a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35310/0 (socket says 172.21.15.78:35310) 2023-08-17T17:49:43.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1895b2b700 1 -- 172.21.15.78:0/804360017 learned_addr learned my addr 172.21.15.78:0/804360017 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:43.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1895b2b700 1 -- 172.21.15.78:0/804360017 >> v1:172.21.15.150:6789/0 conn(0x7f18900aa4d0 legacy=0x7f18900c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:43.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1895b2b700 1 -- 172.21.15.78:0/804360017 >> v1:172.21.15.78:6789/0 conn(0x7f18900c5810 legacy=0x7f18900a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:43.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1894b29700 1 -- 172.21.15.78:0/804360017 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712311413 0 0) 0x7f18900649b0 con 0x7f18900c5810 2023-08-17T17:49:43.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.668+0000 7f1895b2b700 1 -- 172.21.15.78:0/804360017 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900639e0 con 0x7f18900aa0f0 2023-08-17T17:49:43.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1895b2b700 1 --2- 172.21.15.78:0/804360017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa0f0 0x7f18900644c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f188c009f20 tx=0x7f188c009840).ready entity=mon.0 client_cookie=59e8f6543365d4c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:43.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1894b29700 1 -- 172.21.15.78:0/804360017 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00e070 con 0x7f18900aa0f0 2023-08-17T17:49:43.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1894b29700 1 -- 172.21.15.78:0/804360017 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c00ba80 con 0x7f18900aa0f0 2023-08-17T17:49:43.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1894b29700 1 -- 172.21.15.78:0/804360017 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00be00 con 0x7f18900aa0f0 2023-08-17T17:49:43.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1897d8f700 1 -- 172.21.15.78:0/804360017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa0f0 msgr2=0x7f18900644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:43.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1897d8f700 1 --2- 172.21.15.78:0/804360017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa0f0 0x7f18900644c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f188c009f20 tx=0x7f188c009840).stop 2023-08-17T17:49:43.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1897d8f700 1 -- 172.21.15.78:0/804360017 shutdown_connections 2023-08-17T17:49:43.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1897d8f700 1 --2- 172.21.15.78:0/804360017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa0f0 0x7f18900644c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:43.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1897d8f700 1 -- 172.21.15.78:0/804360017 >> 172.21.15.78:0/804360017 conn(0x7f189006a6a0 msgr2=0x7f18900caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:43.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1897d8f700 1 -- 172.21.15.78:0/804360017 shutdown_connections 2023-08-17T17:49:43.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.669+0000 7f1897d8f700 1 -- 172.21.15.78:0/804360017 wait complete. 2023-08-17T17:49:43.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.670+0000 7f1897d8f700 1 Processor -- start 2023-08-17T17:49:43.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.670+0000 7f1897d8f700 1 -- start start 2023-08-17T17:49:43.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f1897d8f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18900aa0f0 0x7f18900ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:43.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f1897d8f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa4d0 0x7f18901587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:43.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f1897d8f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18900c5810 0x7f1890150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:43.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f1897d8f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18900c1ac0 con 0x7f18900aa4d0 2023-08-17T17:49:43.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f1897d8f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18900ad800 con 0x7f18900c5810 2023-08-17T17:49:43.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f1897d8f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18900c1d10 con 0x7f18900aa0f0 2023-08-17T17:49:43.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f189532a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa4d0 0x7f18901587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:43.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f189532a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa4d0 0x7f18901587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32980/0 (socket says 172.21.15.78:32980) 2023-08-17T17:49:43.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f189532a700 1 -- 172.21.15.78:0/2311467650 learned_addr learned my addr 172.21.15.78:0/2311467650 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:43.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f1895b2b700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18900aa0f0 0x7f18900ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:43.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.671+0000 7f189632c700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18900c5810 0x7f1890150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:43.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f189532a700 1 -- 172.21.15.78:0/2311467650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18900aa0f0 msgr2=0x7f18900ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:43.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f189532a700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18900aa0f0 0x7f18900ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:43.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f189532a700 1 -- 172.21.15.78:0/2311467650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18900c5810 msgr2=0x7f1890150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:43.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f189532a700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18900c5810 0x7f1890150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:43.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f189532a700 1 -- 172.21.15.78:0/2311467650 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c009ae0 con 0x7f18900aa4d0 2023-08-17T17:49:43.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f189532a700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa4d0 0x7f18901587f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f188000c4c0 tx=0x7f1880007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:43.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f1885ffb700 1 -- 172.21.15.78:0/2311467650 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188000ce10 con 0x7f18900aa4d0 2023-08-17T17:49:43.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f1885ffb700 1 -- 172.21.15.78:0/2311467650 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880007020 con 0x7f18900aa4d0 2023-08-17T17:49:43.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f1897d8f700 1 -- 172.21.15.78:0/2311467650 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18900c1ff0 con 0x7f18900aa4d0 2023-08-17T17:49:43.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f1885ffb700 1 -- 172.21.15.78:0/2311467650 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18800073e0 con 0x7f18900aa4d0 2023-08-17T17:49:43.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.672+0000 7f1897d8f700 1 -- 172.21.15.78:0/2311467650 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1890158ce0 con 0x7f18900aa4d0 2023-08-17T17:49:43.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.673+0000 7f1897d8f700 1 -- 172.21.15.78:0/2311467650 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1890083980 con 0x7f18900aa4d0 2023-08-17T17:49:43.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.673+0000 7f1885ffb700 1 -- 172.21.15.78:0/2311467650 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 30) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f1880010070 con 0x7f18900aa4d0 2023-08-17T17:49:43.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.674+0000 7f1885ffb700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f187405ecf0 0x7f18740611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:43.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.674+0000 7f1885ffb700 1 -- 172.21.15.78:0/2311467650 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f1880078ce0 con 0x7f18900aa4d0 2023-08-17T17:49:43.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.674+0000 7f1895b2b700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f187405ecf0 0x7f18740611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:43.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.674+0000 7f1895b2b700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f187405ecf0 0x7f18740611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f188c00c010 tx=0x7f188c009840).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:43.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.678+0000 7f1885ffb700 1 -- 172.21.15.78:0/2311467650 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18800478f0 con 0x7f18900aa4d0 2023-08-17T17:49:43.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:43.845+0000 7f1897d8f700 1 -- 172.21.15.78:0/2311467650 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f18900cbd40 con 0x7f18900aa4d0 2023-08-17T17:49:44.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.540+0000 7f1885ffb700 1 -- 172.21.15.78:0/2311467650 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) v1 ==== 181+0+0 (secure 0 0 0) 0x7f188004a0e0 con 0x7f18900aa4d0 2023-08-17T17:49:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.543+0000 7f1897d8f700 1 -- 172.21.15.78:0/2311467650 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f187405ecf0 msgr2=0x7f18740611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.543+0000 7f1897d8f700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f187405ecf0 0x7f18740611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f188c00c010 tx=0x7f188c009840).stop 2023-08-17T17:49:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.543+0000 7f1897d8f700 1 -- 172.21.15.78:0/2311467650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa4d0 msgr2=0x7f18901587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.543+0000 7f1897d8f700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa4d0 0x7f18901587f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f188000c4c0 tx=0x7f1880007dd0).stop 2023-08-17T17:49:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.543+0000 7f1897d8f700 1 -- 172.21.15.78:0/2311467650 shutdown_connections 2023-08-17T17:49:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.543+0000 7f1897d8f700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f187405ecf0 0x7f18740611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:44.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.543+0000 7f1897d8f700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18900c5810 0x7f1890150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:44.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.543+0000 7f1897d8f700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18900aa0f0 0x7f18900ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:44.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.543+0000 7f1897d8f700 1 --2- 172.21.15.78:0/2311467650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18900aa4d0 0x7f18901587f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:44.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.544+0000 7f1897d8f700 1 -- 172.21.15.78:0/2311467650 >> 172.21.15.78:0/2311467650 conn(0x7f189006a6a0 msgr2=0x7f18900a81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:44.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.544+0000 7f1897d8f700 1 -- 172.21.15.78:0/2311467650 shutdown_connections 2023-08-17T17:49:44.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.544+0000 7f1897d8f700 1 -- 172.21.15.78:0/2311467650 wait complete. 2023-08-17T17:49:44.547 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T17:49:44.557 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T17:49:44.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.675+0000 7f5219b21700 1 Processor -- start 2023-08-17T17:49:44.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.675+0000 7f5219b21700 1 -- start start 2023-08-17T17:49:44.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.676+0000 7f5219b21700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140c5f20 0x7f52140644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:44.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.676+0000 7f5219b21700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52140649b0 con 0x7f52140aa4d0 2023-08-17T17:49:44.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.676+0000 7f5219b21700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5214063420 con 0x7f52140aa0f0 2023-08-17T17:49:44.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.676+0000 7f5219b21700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5214063700 con 0x7f52140c5f20 2023-08-17T17:49:44.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.676+0000 7f520affd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f52140aa4d0 0x7f52140c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35326/0 (socket says 172.21.15.78:35326) 2023-08-17T17:49:44.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.676+0000 7f520affd700 1 -- 172.21.15.78:0/2212348034 learned_addr learned my addr 172.21.15.78:0/2212348034 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:44.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.676+0000 7f5213fff700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140c5f20 0x7f52140644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:44.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.676+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419457425 0 0) 0x7f52140649b0 con 0x7f52140aa4d0 2023-08-17T17:49:44.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.676+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f40033f0 con 0x7f52140aa4d0 2023-08-17T17:49:44.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 266547835 0 0) 0x7f51f40033f0 con 0x7f52140aa4d0 2023-08-17T17:49:44.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140c5f20 msgr2=0x7f52140644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:44.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140c5f20 0x7f52140644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:44.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 >> v1:172.21.15.150:6789/0 conn(0x7f52140aa0f0 legacy=0x7f52140c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:44.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52140639e0 con 0x7f52140aa4d0 2023-08-17T17:49:44.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f51fc001470 con 0x7f52140aa4d0 2023-08-17T17:49:44.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 >> v1:172.21.15.78:6789/0 conn(0x7f52140aa4d0 legacy=0x7f52140c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:44.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 0x7f51f4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:44.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140c5f20 0x7f51f4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:44.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f4004b80 0x7f51f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:44.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5214063700 con 0x7f51f4003910 2023-08-17T17:49:44.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400b8e0 con 0x7f51f4004b80 2023-08-17T17:49:44.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400ba50 con 0x7f52140c5f20 2023-08-17T17:49:44.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f52137fe700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 0x7f51f4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:44.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f520affd700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140c5f20 0x7f51f4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:44.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5213fff700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f4004b80 0x7f51f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:44.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f52137fe700 1 -- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140c5f20 msgr2=0x7f51f4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:44.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f52137fe700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140c5f20 0x7f51f4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:44.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f52137fe700 1 -- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f4004b80 msgr2=0x7f51f4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:44.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f52137fe700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f4004b80 0x7f51f4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:44.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f52137fe700 1 -- 172.21.15.78:0/2212348034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40033f0 con 0x7f51f4003910 2023-08-17T17:49:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f52137fe700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 0x7f51f4003cf0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f5204001820 tx=0x7f5204007b90).ready entity=mon.0 client_cookie=c8c6d12ac6849438 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204007ea0 con 0x7f51f4003910 2023-08-17T17:49:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204012400 con 0x7f51f4003910 2023-08-17T17:49:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.677+0000 7f5212ffd700 1 -- 172.21.15.78:0/2212348034 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040127c0 con 0x7f51f4003910 2023-08-17T17:49:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.678+0000 7f5219b21700 1 -- 172.21.15.78:0/2212348034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 msgr2=0x7f51f4003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.678+0000 7f5219b21700 1 --2- 172.21.15.78:0/2212348034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 0x7f51f4003cf0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f5204001820 tx=0x7f5204007b90).stop 2023-08-17T17:49:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.678+0000 7f5213fff700 1 -- 172.21.15.78:0/2212348034 reap_dead start 2023-08-17T17:49:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.678+0000 7f5219b21700 1 -- 172.21.15.78:0/2212348034 shutdown_connections 2023-08-17T17:49:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.678+0000 7f5219b21700 1 -- 172.21.15.78:0/2212348034 >> 172.21.15.78:0/2212348034 conn(0x7f521406a6a0 msgr2=0x7f52140caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.678+0000 7f5219b21700 1 -- 172.21.15.78:0/2212348034 shutdown_connections 2023-08-17T17:49:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.678+0000 7f5219b21700 1 -- 172.21.15.78:0/2212348034 wait complete. 2023-08-17T17:49:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.679+0000 7f5219b21700 1 Processor -- start 2023-08-17T17:49:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.679+0000 7f5219b21700 1 -- start start 2023-08-17T17:49:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f5219b21700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 0x7f52140acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f5219b21700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140ab980 0x7f52141469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f5219b21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5214146eb0 0x7f52141561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f5219b21700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52140abeb0 con 0x7f51f4003910 2023-08-17T17:49:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f5219b21700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52140ac190 con 0x7f5214146eb0 2023-08-17T17:49:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f5219b21700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52140ac470 con 0x7f52140ab980 2023-08-17T17:49:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f52137fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 0x7f52140acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f52137fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 0x7f52140acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32986/0 (socket says 172.21.15.78:32986) 2023-08-17T17:49:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f52137fe700 1 -- 172.21.15.78:0/3659394810 learned_addr learned my addr 172.21.15.78:0/3659394810 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f5213fff700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5214146eb0 0x7f52141561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f520affd700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140ab980 0x7f52141469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f52137fe700 1 -- 172.21.15.78:0/3659394810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140ab980 msgr2=0x7f52141469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f52137fe700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140ab980 0x7f52141469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f52137fe700 1 -- 172.21.15.78:0/3659394810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5214146eb0 msgr2=0x7f52141561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f52137fe700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5214146eb0 0x7f52141561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f52137fe700 1 -- 172.21.15.78:0/3659394810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52140ac750 con 0x7f51f4003910 2023-08-17T17:49:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f52137fe700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 0x7f52140acc80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f51f40045b0 tx=0x7f5204016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.680+0000 7f520bfff700 1 -- 172.21.15.78:0/3659394810 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204007ea0 con 0x7f51f4003910 2023-08-17T17:49:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.681+0000 7f520bfff700 1 -- 172.21.15.78:0/3659394810 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204007030 con 0x7f51f4003910 2023-08-17T17:49:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.681+0000 7f520bfff700 1 -- 172.21.15.78:0/3659394810 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040073d0 con 0x7f51f4003910 2023-08-17T17:49:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.681+0000 7f5219b21700 1 -- 172.21.15.78:0/3659394810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52140ad170 con 0x7f51f4003910 2023-08-17T17:49:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.681+0000 7f5219b21700 1 -- 172.21.15.78:0/3659394810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5214156870 con 0x7f51f4003910 2023-08-17T17:49:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.681+0000 7f5219b21700 1 -- 172.21.15.78:0/3659394810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5214164810 con 0x7f51f4003910 2023-08-17T17:49:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.682+0000 7f520bfff700 1 -- 172.21.15.78:0/3659394810 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 30) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f5204018070 con 0x7f51f4003910 2023-08-17T17:49:44.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.682+0000 7f520bfff700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f51f805ecf0 0x7f51f80611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:44.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.682+0000 7f520bfff700 1 -- 172.21.15.78:0/3659394810 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f520407a4b0 con 0x7f51f4003910 2023-08-17T17:49:44.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.682+0000 7f520affd700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f51f805ecf0 0x7f51f80611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:44.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.682+0000 7f520affd700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f51f805ecf0 0x7f51f80611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f52140c8380 tx=0x7f51fc009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:44.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.686+0000 7f520bfff700 1 -- 172.21.15.78:0/3659394810 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f520404bb80 con 0x7f51f4003910 2023-08-17T17:49:44.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.852+0000 7f5219b21700 1 -- 172.21.15.78:0/3659394810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52140abeb0 con 0x7f51f4003910 2023-08-17T17:49:44.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:44.974+0000 7f520bfff700 1 -- 172.21.15.78:0/3659394810 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f520401b040 con 0x7f51f4003910 2023-08-17T17:49:45.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.542+0000 7f520bfff700 1 -- 172.21.15.78:0/3659394810 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5204041320 con 0x7f51f4003910 2023-08-17T17:49:45.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 -- 172.21.15.78:0/3659394810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f51f805ecf0 msgr2=0x7f51f80611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f51f805ecf0 0x7f51f80611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f52140c8380 tx=0x7f51fc009040).stop 2023-08-17T17:49:45.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 -- 172.21.15.78:0/3659394810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 msgr2=0x7f52140acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 0x7f52140acc80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f51f40045b0 tx=0x7f5204016000).stop 2023-08-17T17:49:45.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 -- 172.21.15.78:0/3659394810 shutdown_connections 2023-08-17T17:49:45.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f51f805ecf0 0x7f51f80611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5214146eb0 0x7f52141561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4003910 0x7f52140acc80 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 --2- 172.21.15.78:0/3659394810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140ab980 0x7f52141469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 -- 172.21.15.78:0/3659394810 >> 172.21.15.78:0/3659394810 conn(0x7f521406a6a0 msgr2=0x7f52140a95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:45.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 -- 172.21.15.78:0/3659394810 shutdown_connections 2023-08-17T17:49:45.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.544+0000 7f5219b21700 1 -- 172.21.15.78:0/3659394810 wait complete. 2023-08-17T17:49:45.547 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T17:49:45.559 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T17:49:45.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.679+0000 7f76e5add700 1 Processor -- start 2023-08-17T17:49:45.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.679+0000 7f76e5add700 1 -- start start 2023-08-17T17:49:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.679+0000 7f76e5add700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0062c00 0x7f76e00c2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.679+0000 7f76e5add700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e0156340 con 0x7f76e0134ed0 2023-08-17T17:49:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.679+0000 7f76e5add700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e00c2900 con 0x7f76e0152e90 2023-08-17T17:49:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.679+0000 7f76e5add700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00c2710 con 0x7f76e0062c00 2023-08-17T17:49:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76df7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f76e0134ed0 0x7f76e00624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35340/0 (socket says 172.21.15.78:35340) 2023-08-17T17:49:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76df7fe700 1 -- 172.21.15.78:0/3025048814 learned_addr learned my addr 172.21.15.78:0/3025048814 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76deffd700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0062c00 0x7f76e00c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978635590 0 0) 0x7f76e0156340 con 0x7f76e0134ed0 2023-08-17T17:49:45.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c80033f0 con 0x7f76e0134ed0 2023-08-17T17:49:45.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 736971652 0 0) 0x7f76c80033f0 con 0x7f76e0134ed0 2023-08-17T17:49:45.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0062c00 msgr2=0x7f76e00c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:45.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0062c00 0x7f76e00c2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 >> v1:172.21.15.150:6789/0 conn(0x7f76e0152e90 legacy=0x7f76e015bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e0155a10 con 0x7f76e0134ed0 2023-08-17T17:49:45.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f76d0001470 con 0x7f76e0134ed0 2023-08-17T17:49:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 >> v1:172.21.15.78:6789/0 conn(0x7f76e0134ed0 legacy=0x7f76e00624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c8003910 0x7f76c8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0062c00 0x7f76c8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76c8004b80 0x7f76c8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c800b8e0 con 0x7f76c8004b80 2023-08-17T17:49:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c800ba20 con 0x7f76c8003910 2023-08-17T17:49:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c800bb90 con 0x7f76e0062c00 2023-08-17T17:49:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76dffff700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76c8004b80 0x7f76c8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76deffd700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0062c00 0x7f76c8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.680+0000 7f76df7fe700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c8003910 0x7f76c8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76dffff700 1 -- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0062c00 msgr2=0x7f76c8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76dffff700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0062c00 0x7f76c8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76dffff700 1 -- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c8003910 msgr2=0x7f76c8003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76dffff700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76c8003910 0x7f76c8003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76dffff700 1 -- 172.21.15.78:0/3025048814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80033f0 con 0x7f76c8004b80 2023-08-17T17:49:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76dffff700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76c8004b80 0x7f76c8005000 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f76d8001f20 tx=0x7f76d8007f10).ready entity=mon.0 client_cookie=f7f5ba756b75d6f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80017e0 con 0x7f76c8004b80 2023-08-17T17:49:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d800c670 con 0x7f76c8004b80 2023-08-17T17:49:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76de7fc700 1 -- 172.21.15.78:0/3025048814 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d800c9f0 con 0x7f76c8004b80 2023-08-17T17:49:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76e5add700 1 -- 172.21.15.78:0/3025048814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76c8004b80 msgr2=0x7f76c8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76e5add700 1 --2- 172.21.15.78:0/3025048814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76c8004b80 0x7f76c8005000 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f76d8001f20 tx=0x7f76d8007f10).stop 2023-08-17T17:49:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76dffff700 1 -- 172.21.15.78:0/3025048814 reap_dead start 2023-08-17T17:49:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76e5add700 1 -- 172.21.15.78:0/3025048814 shutdown_connections 2023-08-17T17:49:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76e5add700 1 -- 172.21.15.78:0/3025048814 >> 172.21.15.78:0/3025048814 conn(0x7f76e00c7b80 msgr2=0x7f76e00c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76e5add700 1 -- 172.21.15.78:0/3025048814 shutdown_connections 2023-08-17T17:49:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.681+0000 7f76e5add700 1 -- 172.21.15.78:0/3025048814 wait complete. 2023-08-17T17:49:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76e5add700 1 Processor -- start 2023-08-17T17:49:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76e5add700 1 -- start start 2023-08-17T17:49:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76e5add700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e0136ca0 0x7f76e0162b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76e5add700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e00ad800 0x7f76e01355f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76e5add700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0135ae0 0x7f76e0153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76e5add700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0163060 con 0x7f76e0136ca0 2023-08-17T17:49:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76e5add700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0135f60 con 0x7f76e00ad800 2023-08-17T17:49:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76e5add700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0136240 con 0x7f76e0135ae0 2023-08-17T17:49:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76df7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e0136ca0 0x7f76e0162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76df7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e0136ca0 0x7f76e0162b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33014/0 (socket says 172.21.15.78:33014) 2023-08-17T17:49:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.683+0000 7f76df7fe700 1 -- 172.21.15.78:0/3679349373 learned_addr learned my addr 172.21.15.78:0/3679349373 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76deffd700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e00ad800 0x7f76e01355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76dffff700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0135ae0 0x7f76e0153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76df7fe700 1 -- 172.21.15.78:0/3679349373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0135ae0 msgr2=0x7f76e0153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76df7fe700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0135ae0 0x7f76e0153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76df7fe700 1 -- 172.21.15.78:0/3679349373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e00ad800 msgr2=0x7f76e01355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76df7fe700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e00ad800 0x7f76e01355f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76df7fe700 1 -- 172.21.15.78:0/3679349373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e0162090 con 0x7f76e0136ca0 2023-08-17T17:49:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76df7fe700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e0136ca0 0x7f76e0162b70 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f76d00077c0 tx=0x7f76d0001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76c77fe700 1 -- 172.21.15.78:0/3679349373 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0011590 con 0x7f76e0136ca0 2023-08-17T17:49:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76c77fe700 1 -- 172.21.15.78:0/3679349373 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d00116f0 con 0x7f76e0136ca0 2023-08-17T17:49:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76c77fe700 1 -- 172.21.15.78:0/3679349373 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0011a70 con 0x7f76e0136ca0 2023-08-17T17:49:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76e5add700 1 -- 172.21.15.78:0/3679349373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e0162370 con 0x7f76e0136ca0 2023-08-17T17:49:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.684+0000 7f76e5add700 1 -- 172.21.15.78:0/3679349373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e0137080 con 0x7f76e0136ca0 2023-08-17T17:49:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.685+0000 7f76e5add700 1 -- 172.21.15.78:0/3679349373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e0162890 con 0x7f76e0136ca0 2023-08-17T17:49:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.685+0000 7f76c77fe700 1 -- 172.21.15.78:0/3679349373 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f76d001c360 con 0x7f76e0136ca0 2023-08-17T17:49:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.686+0000 7f76c77fe700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f76cc05ed90 0x7f76cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.686+0000 7f76deffd700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f76cc05ed90 0x7f76cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.686+0000 7f76c77fe700 1 -- 172.21.15.78:0/3679349373 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f76d00791f0 con 0x7f76e0136ca0 2023-08-17T17:49:45.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.686+0000 7f76deffd700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f76cc05ed90 0x7f76cc061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f76d4006d50 tx=0x7f76d4008040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:45.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.690+0000 7f76c77fe700 1 -- 172.21.15.78:0/3679349373 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f76d00498f0 con 0x7f76e0136ca0 2023-08-17T17:49:45.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.855+0000 7f76e5add700 1 -- 172.21.15.78:0/3679349373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f76e0068270 con 0x7f76e0136ca0 2023-08-17T17:49:45.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.859+0000 7f76c77fe700 1 -- 172.21.15.78:0/3679349373 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f76d0019030 con 0x7f76e0136ca0 2023-08-17T17:49:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 -- 172.21.15.78:0/3679349373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f76cc05ed90 msgr2=0x7f76cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f76cc05ed90 0x7f76cc061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f76d4006d50 tx=0x7f76d4008040).stop 2023-08-17T17:49:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 -- 172.21.15.78:0/3679349373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e0136ca0 msgr2=0x7f76e0162b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e0136ca0 0x7f76e0162b70 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f76d00077c0 tx=0x7f76d0001e70).stop 2023-08-17T17:49:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 -- 172.21.15.78:0/3679349373 shutdown_connections 2023-08-17T17:49:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f76cc05ed90 0x7f76cc061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76e0135ae0 0x7f76e0153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e0136ca0 0x7f76e0162b70 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 --2- 172.21.15.78:0/3679349373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e00ad800 0x7f76e01355f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 -- 172.21.15.78:0/3679349373 >> 172.21.15.78:0/3679349373 conn(0x7f76e00c7b80 msgr2=0x7f76e0066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 -- 172.21.15.78:0/3679349373 shutdown_connections 2023-08-17T17:49:45.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.861+0000 7f76e5add700 1 -- 172.21.15.78:0/3679349373 wait complete. 2023-08-17T17:49:45.874 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-17T17:49:45.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.986+0000 7ffae7592700 1 Processor -- start 2023-08-17T17:49:45.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.986+0000 7ffae7592700 1 -- start start 2023-08-17T17:49:45.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.987+0000 7ffae7592700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffae00aa0f0 0x7ffae00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.987+0000 7ffae7592700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffae00aa4d0 0x7ffae00c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.987+0000 7ffae7592700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae00649b0 con 0x7ffae00c5810 2023-08-17T17:49:45.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.987+0000 7ffae7592700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae0063420 con 0x7ffae00aa4d0 2023-08-17T17:49:45.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.987+0000 7ffae7592700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae0063700 con 0x7ffae00aa0f0 2023-08-17T17:49:45.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.987+0000 7ffae4b2d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffae00aa4d0 0x7ffae00c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.987+0000 7ffae5b2f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ffae00c5810 0x7ffae00a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35350/0 (socket says 172.21.15.78:35350) 2023-08-17T17:49:45.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.987+0000 7ffae5b2f700 1 -- 172.21.15.78:0/181520979 learned_addr learned my addr 172.21.15.78:0/181520979 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:45.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.987+0000 7ffae532e700 1 --2- 172.21.15.78:0/181520979 >> v2:172.21.15.150:3300/0 conn(0x7ffae00aa0f0 0x7ffae00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae4b2d700 1 -- 172.21.15.78:0/181520979 >> v2:172.21.15.150:3300/0 conn(0x7ffae00aa0f0 msgr2=0x7ffae00644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:45.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae4b2d700 1 --2- 172.21.15.78:0/181520979 >> v2:172.21.15.150:3300/0 conn(0x7ffae00aa0f0 0x7ffae00644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae4b2d700 1 -- 172.21.15.78:0/181520979 >> v1:172.21.15.78:6789/0 conn(0x7ffae00c5810 legacy=0x7ffae00a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae4b2d700 1 -- 172.21.15.78:0/181520979 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae00639e0 con 0x7ffae00aa4d0 2023-08-17T17:49:45.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffad7fff700 1 -- 172.21.15.78:0/181520979 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621202939 0 0) 0x7ffae00649b0 con 0x7ffae00c5810 2023-08-17T17:49:45.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae4b2d700 1 --2- 172.21.15.78:0/181520979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00aa4d0 0x7ffae00c0e10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7ffae00cade0 tx=0x7ffad0009060).ready entity=mon.0 client_cookie=61e58eb944659923 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:45.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffad7fff700 1 -- 172.21.15.78:0/181520979 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad000b580 con 0x7ffae00aa4d0 2023-08-17T17:49:45.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffad7fff700 1 -- 172.21.15.78:0/181520979 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad000b6e0 con 0x7ffae00aa4d0 2023-08-17T17:49:45.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffad7fff700 1 -- 172.21.15.78:0/181520979 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad000ba60 con 0x7ffae00aa4d0 2023-08-17T17:49:45.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae7592700 1 -- 172.21.15.78:0/181520979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00aa4d0 msgr2=0x7ffae00c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae7592700 1 --2- 172.21.15.78:0/181520979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00aa4d0 0x7ffae00c0e10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7ffae00cade0 tx=0x7ffad0009060).stop 2023-08-17T17:49:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae7592700 1 -- 172.21.15.78:0/181520979 shutdown_connections 2023-08-17T17:49:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae7592700 1 --2- 172.21.15.78:0/181520979 >> v2:172.21.15.150:3300/0 conn(0x7ffae00aa0f0 0x7ffae00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae7592700 1 --2- 172.21.15.78:0/181520979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00aa4d0 0x7ffae00c0e10 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae7592700 1 -- 172.21.15.78:0/181520979 >> 172.21.15.78:0/181520979 conn(0x7ffae006a6a0 msgr2=0x7ffae00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae7592700 1 -- 172.21.15.78:0/181520979 shutdown_connections 2023-08-17T17:49:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.988+0000 7ffae7592700 1 -- 172.21.15.78:0/181520979 wait complete. 2023-08-17T17:49:45.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.990+0000 7ffae7592700 1 Processor -- start 2023-08-17T17:49:45.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.990+0000 7ffae7592700 1 -- start start 2023-08-17T17:49:45.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.990+0000 7ffae7592700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffae00aa0f0 0x7ffae00ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.990+0000 7ffae7592700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffae00aa4d0 0x7ffae0152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae7592700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00c5810 0x7ffae00ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae7592700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae0157870 con 0x7ffae00c5810 2023-08-17T17:49:45.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae7592700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae0153430 con 0x7ffae00aa0f0 2023-08-17T17:49:45.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae7592700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00ad7b0 con 0x7ffae00aa4d0 2023-08-17T17:49:45.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae5b2f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00c5810 0x7ffae00ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae5b2f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00c5810 0x7ffae00ac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33036/0 (socket says 172.21.15.78:33036) 2023-08-17T17:49:45.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae5b2f700 1 -- 172.21.15.78:0/95404654 learned_addr learned my addr 172.21.15.78:0/95404654 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:45.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae4b2d700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffae00aa4d0 0x7ffae0152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae532e700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffae00aa0f0 0x7ffae00ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae5b2f700 1 -- 172.21.15.78:0/95404654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffae00aa4d0 msgr2=0x7ffae0152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae5b2f700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffae00aa4d0 0x7ffae0152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae5b2f700 1 -- 172.21.15.78:0/95404654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffae00aa0f0 msgr2=0x7ffae00ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:45.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae5b2f700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffae00aa0f0 0x7ffae00ad1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:45.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae5b2f700 1 -- 172.21.15.78:0/95404654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00092a0 con 0x7ffae00c5810 2023-08-17T17:49:45.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae4b2d700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffae00aa4d0 0x7ffae0152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:45.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae532e700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffae00aa0f0 0x7ffae00ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:45.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae5b2f700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00c5810 0x7ffae00ac9c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7ffad800c730 tx=0x7ffad8001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:45.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffad57fa700 1 -- 172.21.15.78:0/95404654 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8005d30 con 0x7ffae00c5810 2023-08-17T17:49:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffad57fa700 1 -- 172.21.15.78:0/95404654 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad8005e90 con 0x7ffae00c5810 2023-08-17T17:49:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae7592700 1 -- 172.21.15.78:0/95404654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae0156f40 con 0x7ffae00c5810 2023-08-17T17:49:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffad57fa700 1 -- 172.21.15.78:0/95404654 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8007340 con 0x7ffae00c5810 2023-08-17T17:49:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.991+0000 7ffae7592700 1 -- 172.21.15.78:0/95404654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae0157500 con 0x7ffae00c5810 2023-08-17T17:49:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.992+0000 7ffae7592700 1 -- 172.21.15.78:0/95404654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae0083980 con 0x7ffae00c5810 2023-08-17T17:49:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.993+0000 7ffad57fa700 1 -- 172.21.15.78:0/95404654 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ffad8010030 con 0x7ffae00c5810 2023-08-17T17:49:45.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.993+0000 7ffad57fa700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffac405ed90 0x7ffac4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:45.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.993+0000 7ffad57fa700 1 -- 172.21.15.78:0/95404654 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5742+0+0 (secure 0 0 0) 0x7ffad8079840 con 0x7ffae00c5810 2023-08-17T17:49:45.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.993+0000 7ffae532e700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffac405ed90 0x7ffac4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:45.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.993+0000 7ffae532e700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffac405ed90 0x7ffac4061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ffadc0098c0 tx=0x7ffadc008040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:45.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:45.997+0000 7ffad57fa700 1 -- 172.21.15.78:0/95404654 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffad804af60 con 0x7ffae00c5810 2023-08-17T17:49:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.160+0000 7ffae7592700 1 -- 172.21.15.78:0/95404654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ffae0046af0 con 0x7ffae00c5810 2023-08-17T17:49:46.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.165+0000 7ffad57fa700 1 -- 172.21.15.78:0/95404654 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v13) v1 ==== 120+0+0 (secure 0 0 0) 0x7ffad804e580 con 0x7ffae00c5810 2023-08-17T17:49:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.167+0000 7ffae7592700 1 -- 172.21.15.78:0/95404654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffac405ed90 msgr2=0x7ffac4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.167+0000 7ffae7592700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffac405ed90 0x7ffac4061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ffadc0098c0 tx=0x7ffadc008040).stop 2023-08-17T17:49:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.167+0000 7ffae7592700 1 -- 172.21.15.78:0/95404654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00c5810 msgr2=0x7ffae00ac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.167+0000 7ffae7592700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00c5810 0x7ffae00ac9c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7ffad800c730 tx=0x7ffad8001520).stop 2023-08-17T17:49:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.168+0000 7ffae7592700 1 -- 172.21.15.78:0/95404654 shutdown_connections 2023-08-17T17:49:46.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.168+0000 7ffae7592700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffac405ed90 0x7ffac4061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.168+0000 7ffae7592700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae00c5810 0x7ffae00ac9c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.168+0000 7ffae7592700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffae00aa0f0 0x7ffae00ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.168+0000 7ffae7592700 1 --2- 172.21.15.78:0/95404654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffae00aa4d0 0x7ffae0152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.168+0000 7ffae7592700 1 -- 172.21.15.78:0/95404654 >> 172.21.15.78:0/95404654 conn(0x7ffae006a6a0 msgr2=0x7ffae00a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:46.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.168+0000 7ffae7592700 1 -- 172.21.15.78:0/95404654 shutdown_connections 2023-08-17T17:49:46.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.168+0000 7ffae7592700 1 -- 172.21.15.78:0/95404654 wait complete. 2023-08-17T17:49:46.181 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-08-17T17:49:46.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.292+0000 7f2473a7e700 1 Processor -- start 2023-08-17T17:49:46.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.293+0000 7f2473a7e700 1 -- start start 2023-08-17T17:49:46.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.293+0000 7f2473a7e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f246c0bef00 0x7f246c064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.293+0000 7f2473a7e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f246c065140 0x7f246c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.293+0000 7f2473a7e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c0c4040 con 0x7f246c0a7fe0 2023-08-17T17:49:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.293+0000 7f2473a7e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c0c7080 con 0x7f246c065140 2023-08-17T17:49:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.293+0000 7f2473a7e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0655f0 con 0x7f246c0bef00 2023-08-17T17:49:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f247201b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f246c065140 0x7f246c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f247181a700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f246c0a7fe0 0x7f246c0be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35356/0 (socket says 172.21.15.78:35356) 2023-08-17T17:49:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f247181a700 1 -- 172.21.15.78:0/56125596 learned_addr learned my addr 172.21.15.78:0/56125596 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f2471019700 1 --2- 172.21.15.78:0/56125596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f246c0bef00 0x7f246c064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f247201b700 1 -- 172.21.15.78:0/56125596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f246c0bef00 msgr2=0x7f246c064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f247201b700 1 --2- 172.21.15.78:0/56125596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f246c0bef00 0x7f246c064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f247201b700 1 -- 172.21.15.78:0/56125596 >> v1:172.21.15.78:6789/0 conn(0x7f246c0a7fe0 legacy=0x7f246c0be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f2470818700 1 -- 172.21.15.78:0/56125596 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857530570 0 0) 0x7f246c0c4040 con 0x7f246c0a7fe0 2023-08-17T17:49:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f247201b700 1 -- 172.21.15.78:0/56125596 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0c3430 con 0x7f246c065140 2023-08-17T17:49:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f247201b700 1 --2- 172.21.15.78:0/56125596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 0x7f246c0c6b90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f2464009760 tx=0x7f2464009060).ready entity=mon.0 client_cookie=d307a40fe92d0594 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f2470818700 1 -- 172.21.15.78:0/56125596 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400b580 con 0x7f246c065140 2023-08-17T17:49:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f2470818700 1 -- 172.21.15.78:0/56125596 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246400b6e0 con 0x7f246c065140 2023-08-17T17:49:46.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.294+0000 7f2470818700 1 -- 172.21.15.78:0/56125596 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400ba60 con 0x7f246c065140 2023-08-17T17:49:46.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.295+0000 7f2473a7e700 1 -- 172.21.15.78:0/56125596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 msgr2=0x7f246c0c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.295+0000 7f2473a7e700 1 --2- 172.21.15.78:0/56125596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 0x7f246c0c6b90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f2464009760 tx=0x7f2464009060).stop 2023-08-17T17:49:46.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.295+0000 7f2473a7e700 1 -- 172.21.15.78:0/56125596 shutdown_connections 2023-08-17T17:49:46.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.295+0000 7f2473a7e700 1 --2- 172.21.15.78:0/56125596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 0x7f246c0c6b90 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.295+0000 7f2473a7e700 1 --2- 172.21.15.78:0/56125596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f246c0bef00 0x7f246c064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.295+0000 7f2473a7e700 1 -- 172.21.15.78:0/56125596 >> 172.21.15.78:0/56125596 conn(0x7f246c092330 msgr2=0x7f246c062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.295+0000 7f2473a7e700 1 -- 172.21.15.78:0/56125596 shutdown_connections 2023-08-17T17:49:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.295+0000 7f2473a7e700 1 -- 172.21.15.78:0/56125596 wait complete. 2023-08-17T17:49:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.296+0000 7f2473a7e700 1 Processor -- start 2023-08-17T17:49:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.296+0000 7f2473a7e700 1 -- start start 2023-08-17T17:49:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2473a7e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 0x7f246c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2473a7e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f246c0a7fe0 0x7f246c0ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2473a7e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f246c0bef00 0x7f246c0a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2473a7e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0ad4e0 con 0x7f246c065140 2023-08-17T17:49:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2473a7e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0ac970 con 0x7f246c0a7fe0 2023-08-17T17:49:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2473a7e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0acc40 con 0x7f246c0bef00 2023-08-17T17:49:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f247181a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 0x7f246c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f247181a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 0x7f246c1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33060/0 (socket says 172.21.15.78:33060) 2023-08-17T17:49:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f247181a700 1 -- 172.21.15.78:0/485544082 learned_addr learned my addr 172.21.15.78:0/485544082 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2471019700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f246c0a7fe0 0x7f246c0ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f247201b700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f246c0bef00 0x7f246c0a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f247181a700 1 -- 172.21.15.78:0/485544082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f246c0bef00 msgr2=0x7f246c0a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f247181a700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f246c0bef00 0x7f246c0a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f247181a700 1 -- 172.21.15.78:0/485544082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f246c0a7fe0 msgr2=0x7f246c0ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f247181a700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f246c0a7fe0 0x7f246c0ac480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f247181a700 1 -- 172.21.15.78:0/485544082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640092a0 con 0x7f246c065140 2023-08-17T17:49:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f247181a700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 0x7f246c1553d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f246800c960 tx=0x7f2468001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2461ffb700 1 -- 172.21.15.78:0/485544082 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468005d30 con 0x7f246c065140 2023-08-17T17:49:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2461ffb700 1 -- 172.21.15.78:0/485544082 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2468005e90 con 0x7f246c065140 2023-08-17T17:49:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2473a7e700 1 -- 172.21.15.78:0/485544082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c0acf20 con 0x7f246c065140 2023-08-17T17:49:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.297+0000 7f2461ffb700 1 -- 172.21.15.78:0/485544082 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468007320 con 0x7f246c065140 2023-08-17T17:49:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.298+0000 7f2473a7e700 1 -- 172.21.15.78:0/485544082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c1563e0 con 0x7f246c065140 2023-08-17T17:49:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.298+0000 7f2473a7e700 1 -- 172.21.15.78:0/485544082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c047350 con 0x7f246c065140 2023-08-17T17:49:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.299+0000 7f2461ffb700 1 -- 172.21.15.78:0/485544082 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2468010030 con 0x7f246c065140 2023-08-17T17:49:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.299+0000 7f2461ffb700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f245005edc0 0x7f2450061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.299+0000 7f2461ffb700 1 -- 172.21.15.78:0/485544082 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f24680798c0 con 0x7f246c065140 2023-08-17T17:49:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.299+0000 7f2471019700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f245005edc0 0x7f2450061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.299+0000 7f2471019700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f245005edc0 0x7f2450061280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f246c0aa8c0 tx=0x7f245c008040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:46.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.303+0000 7f2461ffb700 1 -- 172.21.15.78:0/485544082 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f246804afe0 con 0x7f246c065140 2023-08-17T17:49:46.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.529+0000 7f2473a7e700 1 -- 172.21.15.78:0/485544082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f246c05f410 con 0x7f246c065140 2023-08-17T17:49:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.551+0000 7f2461ffb700 1 -- 172.21.15.78:0/485544082 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v553) v1 ==== 156+0+0 (secure 0 0 0) 0x7f246804e600 con 0x7f246c065140 2023-08-17T17:49:46.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 -- 172.21.15.78:0/485544082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f245005edc0 msgr2=0x7f2450061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f245005edc0 0x7f2450061280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f246c0aa8c0 tx=0x7f245c008040).stop 2023-08-17T17:49:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 -- 172.21.15.78:0/485544082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 msgr2=0x7f246c1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 0x7f246c1553d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f246800c960 tx=0x7f2468001630).stop 2023-08-17T17:49:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 -- 172.21.15.78:0/485544082 shutdown_connections 2023-08-17T17:49:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f245005edc0 0x7f2450061280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f246c0bef00 0x7f246c0a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c065140 0x7f246c1553d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 --2- 172.21.15.78:0/485544082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f246c0a7fe0 0x7f246c0ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 -- 172.21.15.78:0/485544082 >> 172.21.15.78:0/485544082 conn(0x7f246c092330 msgr2=0x7f246c0c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:46.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 -- 172.21.15.78:0/485544082 shutdown_connections 2023-08-17T17:49:46.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.553+0000 7f2473a7e700 1 -- 172.21.15.78:0/485544082 wait complete. 2023-08-17T17:49:46.566 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-08-17T17:49:46.567 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-08-17T17:49:46.567 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-17T17:49:46.567 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-08-17T17:49:46.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.679+0000 7fe4cbab5700 1 Processor -- start 2023-08-17T17:49:46.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.680+0000 7fe4cbab5700 1 -- start start 2023-08-17T17:49:46.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.680+0000 7fe4cbab5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe4c4154140 0x7fe4c40c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.680+0000 7fe4cbab5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4c40a7c40 0x7fe4c40c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.680+0000 7fe4cbab5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c4154520 con 0x7fe4c40a80b0 2023-08-17T17:49:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.680+0000 7fe4cbab5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c40c91e0 con 0x7fe4c40a7c40 2023-08-17T17:49:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.680+0000 7fe4cbab5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c40c94c0 con 0x7fe4c4154140 2023-08-17T17:49:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c9050700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4c40a7c40 0x7fe4c40c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c9050700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4c40a7c40 0x7fe4c40c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33074/0 (socket says 172.21.15.78:33074) 2023-08-17T17:49:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c9050700 1 -- 172.21.15.78:0/1496075723 learned_addr learned my addr 172.21.15.78:0/1496075723 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c9851700 1 --2- 172.21.15.78:0/1496075723 >> v2:172.21.15.150:3300/0 conn(0x7fe4c4154140 0x7fe4c40c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c9050700 1 -- 172.21.15.78:0/1496075723 >> v2:172.21.15.150:3300/0 conn(0x7fe4c4154140 msgr2=0x7fe4c40c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:46.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c9050700 1 --2- 172.21.15.78:0/1496075723 >> v2:172.21.15.150:3300/0 conn(0x7fe4c4154140 0x7fe4c40c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c9050700 1 -- 172.21.15.78:0/1496075723 >> v1:172.21.15.150:6789/0 conn(0x7fe4c40a80b0 legacy=0x7fe4c40ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:46.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c9050700 1 -- 172.21.15.78:0/1496075723 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c40c97a0 con 0x7fe4c40a7c40 2023-08-17T17:49:46.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c9050700 1 --2- 172.21.15.78:0/1496075723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 0x7fe4c40c0900 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fe4c40625b0 tx=0x7fe4b40090f0).ready entity=mon.0 client_cookie=dcb80c9efbac75da server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:46.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c884f700 1 -- 172.21.15.78:0/1496075723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b400b5a0 con 0x7fe4c40a7c40 2023-08-17T17:49:46.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c884f700 1 -- 172.21.15.78:0/1496075723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b400b700 con 0x7fe4c40a7c40 2023-08-17T17:49:46.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4c884f700 1 -- 172.21.15.78:0/1496075723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b400ba80 con 0x7fe4c40a7c40 2023-08-17T17:49:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4cbab5700 1 -- 172.21.15.78:0/1496075723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 msgr2=0x7fe4c40c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.681+0000 7fe4cbab5700 1 --2- 172.21.15.78:0/1496075723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 0x7fe4c40c0900 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fe4c40625b0 tx=0x7fe4b40090f0).stop 2023-08-17T17:49:46.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.682+0000 7fe4cbab5700 1 -- 172.21.15.78:0/1496075723 shutdown_connections 2023-08-17T17:49:46.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.682+0000 7fe4cbab5700 1 --2- 172.21.15.78:0/1496075723 >> v2:172.21.15.150:3300/0 conn(0x7fe4c4154140 0x7fe4c40c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.682+0000 7fe4cbab5700 1 --2- 172.21.15.78:0/1496075723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 0x7fe4c40c0900 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.682+0000 7fe4cbab5700 1 -- 172.21.15.78:0/1496075723 >> 172.21.15.78:0/1496075723 conn(0x7fe4c4094510 msgr2=0x7fe4c406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:46.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.682+0000 7fe4cbab5700 1 -- 172.21.15.78:0/1496075723 shutdown_connections 2023-08-17T17:49:46.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.682+0000 7fe4cbab5700 1 -- 172.21.15.78:0/1496075723 wait complete. 2023-08-17T17:49:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.683+0000 7fe4cbab5700 1 Processor -- start 2023-08-17T17:49:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.683+0000 7fe4cbab5700 1 -- start start 2023-08-17T17:49:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.683+0000 7fe4cbab5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 0x7fe4c4140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.683+0000 7fe4cbab5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c40a80b0 0x7fe4c4064020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.683+0000 7fe4cbab5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c4154140 0x7fe4c4064510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4cbab5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c4064a00 con 0x7fe4c40a7c40 2023-08-17T17:49:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4cbab5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c40a8e60 con 0x7fe4c4154140 2023-08-17T17:49:46.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4cbab5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c4140e30 con 0x7fe4c40a80b0 2023-08-17T17:49:46.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4c9851700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 0x7fe4c4140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4c9851700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 0x7fe4c4140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33090/0 (socket says 172.21.15.78:33090) 2023-08-17T17:49:46.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4c9851700 1 -- 172.21.15.78:0/4091244943 learned_addr learned my addr 172.21.15.78:0/4091244943 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:46.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4ca052700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c4154140 0x7fe4c4064510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4c9050700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c40a80b0 0x7fe4c4064020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4c9851700 1 -- 172.21.15.78:0/4091244943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c40a80b0 msgr2=0x7fe4c4064020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4c9851700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c40a80b0 0x7fe4c4064020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4c9851700 1 -- 172.21.15.78:0/4091244943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c4154140 msgr2=0x7fe4c4064510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4c9851700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c4154140 0x7fe4c4064510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4c9851700 1 -- 172.21.15.78:0/4091244943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4009370 con 0x7fe4c40a7c40 2023-08-17T17:49:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4ca052700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c4154140 0x7fe4c4064510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4c9851700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 0x7fe4c4140940 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fe4c000e190 tx=0x7fe4c0009920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4b9ffb700 1 -- 172.21.15.78:0/4091244943 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c000ee30 con 0x7fe4c40a7c40 2023-08-17T17:49:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4b9ffb700 1 -- 172.21.15.78:0/4091244943 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c0014400 con 0x7fe4c40a7c40 2023-08-17T17:49:46.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4b9ffb700 1 -- 172.21.15.78:0/4091244943 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0014780 con 0x7fe4c40a7c40 2023-08-17T17:49:46.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4cbab5700 1 -- 172.21.15.78:0/4091244943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c4150c20 con 0x7fe4c40a7c40 2023-08-17T17:49:46.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.684+0000 7fe4cbab5700 1 -- 172.21.15.78:0/4091244943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c40a8810 con 0x7fe4c40a7c40 2023-08-17T17:49:46.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.685+0000 7fe4cbab5700 1 -- 172.21.15.78:0/4091244943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c4047350 con 0x7fe4c40a7c40 2023-08-17T17:49:46.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.685+0000 7fe4b9ffb700 1 -- 172.21.15.78:0/4091244943 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe4c001b030 con 0x7fe4c40a7c40 2023-08-17T17:49:46.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.686+0000 7fe4b9ffb700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4a805ed90 0x7fe4a8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:46.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.686+0000 7fe4b9ffb700 1 -- 172.21.15.78:0/4091244943 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fe4c0079da0 con 0x7fe4c40a7c40 2023-08-17T17:49:46.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.686+0000 7fe4c9050700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4a805ed90 0x7fe4a8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:46.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.686+0000 7fe4c9050700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4a805ed90 0x7fe4a8061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe4b4009130 tx=0x7fe4b4015000).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:46.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.690+0000 7fe4b9ffb700 1 -- 172.21.15.78:0/4091244943 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe4c004b460 con 0x7fe4c40a7c40 2023-08-17T17:49:46.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:46.922+0000 7fe4cbab5700 1 -- 172.21.15.78:0/4091244943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fe4c4153290 con 0x7fe4c40a7c40 2023-08-17T17:49:47.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.553+0000 7fe4b9ffb700 1 -- 172.21.15.78:0/4091244943 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v554) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe4c004ea80 con 0x7fe4c40a7c40 2023-08-17T17:49:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 -- 172.21.15.78:0/4091244943 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4a805ed90 msgr2=0x7fe4a8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4a805ed90 0x7fe4a8061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe4b4009130 tx=0x7fe4b4015000).stop 2023-08-17T17:49:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 -- 172.21.15.78:0/4091244943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 msgr2=0x7fe4c4140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 0x7fe4c4140940 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fe4c000e190 tx=0x7fe4c0009920).stop 2023-08-17T17:49:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 -- 172.21.15.78:0/4091244943 shutdown_connections 2023-08-17T17:49:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe4a805ed90 0x7fe4a8061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c4154140 0x7fe4c4064510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40a7c40 0x7fe4c4140940 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 --2- 172.21.15.78:0/4091244943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c40a80b0 0x7fe4c4064020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 -- 172.21.15.78:0/4091244943 >> 172.21.15.78:0/4091244943 conn(0x7fe4c4094510 msgr2=0x7fe4c40ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 -- 172.21.15.78:0/4091244943 shutdown_connections 2023-08-17T17:49:47.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.555+0000 7fe4cbab5700 1 -- 172.21.15.78:0/4091244943 wait complete. 2023-08-17T17:49:47.568 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T17:49:47.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.683+0000 7fdb5ec6d700 1 Processor -- start 2023-08-17T17:49:47.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.684+0000 7fdb5ec6d700 1 -- start start 2023-08-17T17:49:47.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.684+0000 7fdb5ec6d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdb580bc980 0x7fdb580695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:47.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.684+0000 7fdb5ec6d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581506c0 0x7fdb580c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:47.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.684+0000 7fdb5ec6d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580bd2d0 con 0x7fdb581502e0 2023-08-17T17:49:47.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.684+0000 7fdb5ec6d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb58069130 con 0x7fdb580bc980 2023-08-17T17:49:47.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.684+0000 7fdb5ec6d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580c1f40 con 0x7fdb581506c0 2023-08-17T17:49:47.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.684+0000 7fdb4ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdb580bc980 0x7fdb580695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:47.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb5ca09700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdb581502e0 0x7fdb580bc270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35370/0 (socket says 172.21.15.78:35370) 2023-08-17T17:49:47.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb5ca09700 1 -- 172.21.15.78:0/3274529783 learned_addr learned my addr 172.21.15.78:0/3274529783 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:47.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb5d20a700 1 --2- 172.21.15.78:0/3274529783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581506c0 0x7fdb580c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:47.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb4ffff700 1 -- 172.21.15.78:0/3274529783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581506c0 msgr2=0x7fdb580c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:47.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb4ffff700 1 --2- 172.21.15.78:0/3274529783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581506c0 0x7fdb580c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb4ffff700 1 -- 172.21.15.78:0/3274529783 >> v1:172.21.15.78:6789/0 conn(0x7fdb581502e0 legacy=0x7fdb580bc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:47.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb4f7fe700 1 -- 172.21.15.78:0/3274529783 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286646969 0 0) 0x7fdb580bd2d0 con 0x7fdb581502e0 2023-08-17T17:49:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb4ffff700 1 -- 172.21.15.78:0/3274529783 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580bd520 con 0x7fdb580bc980 2023-08-17T17:49:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb4ffff700 1 --2- 172.21.15.78:0/3274529783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb580bc980 0x7fdb580695c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fdb48009760 tx=0x7fdb48009060).ready entity=mon.0 client_cookie=40a15879beeb0883 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb4f7fe700 1 -- 172.21.15.78:0/3274529783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb480090d0 con 0x7fdb580bc980 2023-08-17T17:49:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb4f7fe700 1 -- 172.21.15.78:0/3274529783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800b580 con 0x7fdb580bc980 2023-08-17T17:49:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb4f7fe700 1 -- 172.21.15.78:0/3274529783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800b900 con 0x7fdb580bc980 2023-08-17T17:49:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/3274529783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb580bc980 msgr2=0x7fdb580695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.685+0000 7fdb5ec6d700 1 --2- 172.21.15.78:0/3274529783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb580bc980 0x7fdb580695c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fdb48009760 tx=0x7fdb48009060).stop 2023-08-17T17:49:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.686+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/3274529783 shutdown_connections 2023-08-17T17:49:47.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.686+0000 7fdb5ec6d700 1 --2- 172.21.15.78:0/3274529783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581506c0 0x7fdb580c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.686+0000 7fdb5ec6d700 1 --2- 172.21.15.78:0/3274529783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb580bc980 0x7fdb580695c0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.686+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/3274529783 >> 172.21.15.78:0/3274529783 conn(0x7fdb580c6a80 msgr2=0x7fdb580c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:47.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.686+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/3274529783 shutdown_connections 2023-08-17T17:49:47.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.686+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/3274529783 wait complete. 2023-08-17T17:49:47.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.687+0000 7fdb5ec6d700 1 Processor -- start 2023-08-17T17:49:47.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.687+0000 7fdb5ec6d700 1 -- start start 2023-08-17T17:49:47.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5ec6d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb580bc980 0x7fdb581425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:47.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5ec6d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581502e0 0x7fdb58152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:47.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5ec6d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb581506c0 0x7fdb580bf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:47.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5ec6d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580aa200 con 0x7fdb581506c0 2023-08-17T17:49:47.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5ec6d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580bf4f0 con 0x7fdb580bc980 2023-08-17T17:49:47.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5ec6d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58151510 con 0x7fdb581502e0 2023-08-17T17:49:47.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5d20a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb581506c0 0x7fdb580bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:47.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5d20a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb581506c0 0x7fdb580bf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33108/0 (socket says 172.21.15.78:33108) 2023-08-17T17:49:47.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5d20a700 1 -- 172.21.15.78:0/450405913 learned_addr learned my addr 172.21.15.78:0/450405913 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:47.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5ca09700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb580bc980 0x7fdb581425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:47.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb4ffff700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581502e0 0x7fdb58152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:47.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5d20a700 1 -- 172.21.15.78:0/450405913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581502e0 msgr2=0x7fdb58152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:47.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5d20a700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581502e0 0x7fdb58152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5d20a700 1 -- 172.21.15.78:0/450405913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb580bc980 msgr2=0x7fdb581425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:47.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5d20a700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb580bc980 0x7fdb581425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5d20a700 1 -- 172.21.15.78:0/450405913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480092a0 con 0x7fdb581506c0 2023-08-17T17:49:47.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5ca09700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb580bc980 0x7fdb581425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:47.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb4ffff700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581502e0 0x7fdb58152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:47.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5d20a700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb581506c0 0x7fdb580bf810 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7fdb5000d5e0 tx=0x7fdb50008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:47.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb4cff9700 1 -- 172.21.15.78:0/450405913 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50011590 con 0x7fdb581506c0 2023-08-17T17:49:47.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb4cff9700 1 -- 172.21.15.78:0/450405913 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb500116f0 con 0x7fdb581506c0 2023-08-17T17:49:47.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/450405913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58151760 con 0x7fdb581506c0 2023-08-17T17:49:47.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb4cff9700 1 -- 172.21.15.78:0/450405913 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50011a70 con 0x7fdb581506c0 2023-08-17T17:49:47.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.688+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/450405913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb58151d20 con 0x7fdb581506c0 2023-08-17T17:49:47.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.689+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/450405913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb580aa6f0 con 0x7fdb581506c0 2023-08-17T17:49:47.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.690+0000 7fdb4cff9700 1 -- 172.21.15.78:0/450405913 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdb50012420 con 0x7fdb581506c0 2023-08-17T17:49:47.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.690+0000 7fdb4cff9700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb4405ed90 0x7fdb44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:47.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.690+0000 7fdb4cff9700 1 -- 172.21.15.78:0/450405913 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fdb500794c0 con 0x7fdb581506c0 2023-08-17T17:49:47.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.690+0000 7fdb5ca09700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb4405ed90 0x7fdb44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:47.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.690+0000 7fdb5ca09700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb4405ed90 0x7fdb44061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdb580a9740 tx=0x7fdb54009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:47.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.694+0000 7fdb4cff9700 1 -- 172.21.15.78:0/450405913 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb5004ab80 con 0x7fdb581506c0 2023-08-17T17:49:47.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.855+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/450405913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdb580bd860 con 0x7fdb581506c0 2023-08-17T17:49:47.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.859+0000 7fdb4cff9700 1 -- 172.21.15.78:0/450405913 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdb50011e60 con 0x7fdb581506c0 2023-08-17T17:49:47.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/450405913 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb4405ed90 msgr2=0x7fdb44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:47.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb4405ed90 0x7fdb44061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdb580a9740 tx=0x7fdb54009040).stop 2023-08-17T17:49:47.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/450405913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb581506c0 msgr2=0x7fdb580bf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:47.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb581506c0 0x7fdb580bf810 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7fdb5000d5e0 tx=0x7fdb50008040).stop 2023-08-17T17:49:47.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/450405913 shutdown_connections 2023-08-17T17:49:47.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdb4405ed90 0x7fdb44061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb581506c0 0x7fdb580bf810 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb580bc980 0x7fdb581425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 --2- 172.21.15.78:0/450405913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb581502e0 0x7fdb58152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:47.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/450405913 >> 172.21.15.78:0/450405913 conn(0x7fdb580c6a80 msgr2=0x7fdb580c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:47.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/450405913 shutdown_connections 2023-08-17T17:49:47.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:47.861+0000 7fdb5ec6d700 1 -- 172.21.15.78:0/450405913 wait complete. 2023-08-17T17:49:47.874 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:49:47.874 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:49:47.916 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:49:47.967 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:49:47.967 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T17:49:47.968 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:48.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.079+0000 7f3d5c9a4700 1 Processor -- start 2023-08-17T17:49:48.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.079+0000 7f3d5c9a4700 1 -- start start 2023-08-17T17:49:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.080+0000 7f3d5c9a4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d58154140 0x7f3d580c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.080+0000 7f3d5c9a4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d580c1010 0x7f3d580ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.080+0000 7f3d5c9a4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d58154520 con 0x7f3d580a7c40 2023-08-17T17:49:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.080+0000 7f3d5c9a4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d580c91e0 con 0x7f3d580c1010 2023-08-17T17:49:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.080+0000 7f3d5c9a4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580c94c0 con 0x7f3d58154140 2023-08-17T17:49:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.080+0000 7f3d56d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d580c1010 0x7f3d580ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.080+0000 7f3d4dd9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3d580a7c40 0x7f3d580c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35376/0 (socket says 172.21.15.78:35376) 2023-08-17T17:49:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.080+0000 7f3d4dd9b700 1 -- 172.21.15.78:0/1345916364 learned_addr learned my addr 172.21.15.78:0/1345916364 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.080+0000 7f3d5659c700 1 --2- 172.21.15.78:0/1345916364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d58154140 0x7f3d580c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d56d9d700 1 -- 172.21.15.78:0/1345916364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d58154140 msgr2=0x7f3d580c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d56d9d700 1 --2- 172.21.15.78:0/1345916364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d58154140 0x7f3d580c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d56d9d700 1 -- 172.21.15.78:0/1345916364 >> v1:172.21.15.78:6789/0 conn(0x7f3d580a7c40 legacy=0x7f3d580c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d55d9b700 1 -- 172.21.15.78:0/1345916364 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100176049 0 0) 0x7f3d58154520 con 0x7f3d580a7c40 2023-08-17T17:49:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d56d9d700 1 -- 172.21.15.78:0/1345916364 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d580c97a0 con 0x7f3d580c1010 2023-08-17T17:49:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d56d9d700 1 --2- 172.21.15.78:0/1345916364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 0x7f3d580ca280 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f3d50009e60 tx=0x7f3d50009780).ready entity=mon.0 client_cookie=53b985a2a30424f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d55d9b700 1 -- 172.21.15.78:0/1345916364 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000e070 con 0x7f3d580c1010 2023-08-17T17:49:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d55d9b700 1 -- 172.21.15.78:0/1345916364 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5000bb60 con 0x7f3d580c1010 2023-08-17T17:49:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d55d9b700 1 -- 172.21.15.78:0/1345916364 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50012410 con 0x7f3d580c1010 2023-08-17T17:49:48.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/1345916364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 msgr2=0x7f3d580ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d5c9a4700 1 --2- 172.21.15.78:0/1345916364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 0x7f3d580ca280 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f3d50009e60 tx=0x7f3d50009780).stop 2023-08-17T17:49:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/1345916364 shutdown_connections 2023-08-17T17:49:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d5c9a4700 1 --2- 172.21.15.78:0/1345916364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 0x7f3d580ca280 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d5c9a4700 1 --2- 172.21.15.78:0/1345916364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d58154140 0x7f3d580c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/1345916364 >> 172.21.15.78:0/1345916364 conn(0x7f3d58094510 msgr2=0x7f3d5806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/1345916364 shutdown_connections 2023-08-17T17:49:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.081+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/1345916364 wait complete. 2023-08-17T17:49:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.083+0000 7f3d5c9a4700 1 Processor -- start 2023-08-17T17:49:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.083+0000 7f3d5c9a4700 1 -- start start 2023-08-17T17:49:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.083+0000 7f3d5c9a4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d580a7c40 0x7f3d580b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.083+0000 7f3d5c9a4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 0x7f3d5814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.083+0000 7f3d5c9a4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d58154140 0x7f3d580a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.083+0000 7f3d5c9a4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580a8080 con 0x7f3d580c1010 2023-08-17T17:49:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.083+0000 7f3d5c9a4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580b07e0 con 0x7f3d58154140 2023-08-17T17:49:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.083+0000 7f3d5c9a4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580b0ac0 con 0x7f3d580a7c40 2023-08-17T17:49:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 0x7f3d5814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 0x7f3d5814de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33122/0 (socket says 172.21.15.78:33122) 2023-08-17T17:49:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4dd9b700 1 -- 172.21.15.78:0/2084298440 learned_addr learned my addr 172.21.15.78:0/2084298440 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d5659c700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d580a7c40 0x7f3d580b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d56d9d700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d58154140 0x7f3d580a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4dd9b700 1 -- 172.21.15.78:0/2084298440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d580a7c40 msgr2=0x7f3d580b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4dd9b700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d580a7c40 0x7f3d580b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4dd9b700 1 -- 172.21.15.78:0/2084298440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d58154140 msgr2=0x7f3d580a8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4dd9b700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d58154140 0x7f3d580a8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4dd9b700 1 -- 172.21.15.78:0/2084298440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d50009a20 con 0x7f3d580c1010 2023-08-17T17:49:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4dd9b700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 0x7f3d5814de50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f3d4000c490 tx=0x7f3d40007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4effd700 1 -- 172.21.15.78:0/2084298440 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000ce90 con 0x7f3d580c1010 2023-08-17T17:49:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4effd700 1 -- 172.21.15.78:0/2084298440 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d400072e0 con 0x7f3d580c1010 2023-08-17T17:49:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/2084298440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d580a8290 con 0x7f3d580c1010 2023-08-17T17:49:48.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d4effd700 1 -- 172.21.15.78:0/2084298440 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40007680 con 0x7f3d580c1010 2023-08-17T17:49:48.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.084+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/2084298440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5814eec0 con 0x7f3d580c1010 2023-08-17T17:49:48.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.085+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/2084298440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d580b0ce0 con 0x7f3d580c1010 2023-08-17T17:49:48.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.085+0000 7f3d4effd700 1 -- 172.21.15.78:0/2084298440 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3d4001a060 con 0x7f3d580c1010 2023-08-17T17:49:48.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.086+0000 7f3d4effd700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d3805ed90 0x7f3d38061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.086+0000 7f3d4effd700 1 -- 172.21.15.78:0/2084298440 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f3d40079060 con 0x7f3d580c1010 2023-08-17T17:49:48.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.086+0000 7f3d5659c700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d3805ed90 0x7f3d38061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.086+0000 7f3d5659c700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d3805ed90 0x7f3d38061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3d48009c30 tx=0x7f3d48009060).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:48.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.090+0000 7f3d4effd700 1 -- 172.21.15.78:0/2084298440 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d4004a780 con 0x7f3d580c1010 2023-08-17T17:49:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.291+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/2084298440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d58047350 con 0x7f3d580c1010 2023-08-17T17:49:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.292+0000 7f3d4effd700 1 -- 172.21.15.78:0/2084298440 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f3d4004dda0 con 0x7f3d580c1010 2023-08-17T17:49:48.293 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:48.294 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2895715400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2895715400},{"type":"v1","addr":"172.21.15.150:6834","nonce":2895715400}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6109,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2331989523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2331989523},{"type":"v1","addr":"172.21.15.150:6835","nonce":2331989523}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/1604940701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1604940701},{"type":"v1","addr":"172.21.15.78:6836","nonce":1604940701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6234,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1676496794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1676496794},{"type":"v1","addr":"172.21.15.78:6837","nonce":1676496794}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2023-08-17T17:49:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/2084298440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d3805ed90 msgr2=0x7f3d38061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d3805ed90 0x7f3d38061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3d48009c30 tx=0x7f3d48009060).stop 2023-08-17T17:49:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/2084298440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 msgr2=0x7f3d5814de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 0x7f3d5814de50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f3d4000c490 tx=0x7f3d40007e60).stop 2023-08-17T17:49:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/2084298440 shutdown_connections 2023-08-17T17:49:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d3805ed90 0x7f3d38061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d58154140 0x7f3d580a8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d580a7c40 0x7f3d580b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 --2- 172.21.15.78:0/2084298440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d580c1010 0x7f3d5814de50 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/2084298440 >> 172.21.15.78:0/2084298440 conn(0x7f3d58094510 msgr2=0x7f3d58152810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/2084298440 shutdown_connections 2023-08-17T17:49:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.294+0000 7f3d5c9a4700 1 -- 172.21.15.78:0/2084298440 wait complete. 2023-08-17T17:49:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 27 2023-08-17T17:49:48.307 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T17:49:48.307 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T17:49:48.307 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T17:49:48.308 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:49:48.308 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T17:49:48.308 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T17:49:48.308 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T17:49:48.308 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:49:48.309 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T17:49:48.309 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T17:49:48.309 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T17:49:48.309 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:49:48.310 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T17:49:48.310 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T17:49:48.310 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T17:49:48.310 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:49:48.315 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T17:49:48.316 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T17:49:48.317 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T17:49:48.317 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T17:49:48.320 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T17:49:48.320 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T17:49:48.321 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T17:49:48.321 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T17:49:48.358 INFO:tasks.ceph.mds.a:Started 2023-08-17T17:49:48.358 DEBUG:teuthology.parallel:result is None 2023-08-17T17:49:48.359 INFO:tasks.ceph.mds.c:Started 2023-08-17T17:49:48.359 DEBUG:teuthology.parallel:result is None 2023-08-17T17:49:48.362 INFO:tasks.ceph.mds.b:Started 2023-08-17T17:49:48.363 DEBUG:teuthology.parallel:result is None 2023-08-17T17:49:48.363 INFO:tasks.ceph.mds.d:Started 2023-08-17T17:49:48.364 DEBUG:teuthology.parallel:result is None 2023-08-17T17:49:48.364 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T17:49:48.430 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:49:48.430 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T17:49:48.441 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T17:49:48.442 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:49:48.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.490+0000 7f33bd38c700 1 Processor -- start 2023-08-17T17:49:48.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.490+0000 7f33bd38c700 1 -- start start 2023-08-17T17:49:48.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.491+0000 7f33bd38c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b81541a0 0x7f33b80a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.491+0000 7f33bd38c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f33b80c0560 0x7f33b80c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.491+0000 7f33bd38c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b80c8df0 con 0x7f33b8154580 2023-08-17T17:49:48.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.491+0000 7f33bd38c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b80a8190 con 0x7f33b80c0560 2023-08-17T17:49:48.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.491+0000 7f33bd38c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80c9970 con 0x7f33b81541a0 2023-08-17T17:49:48.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.491+0000 7f33affff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f33b8154580 0x7f33b80bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35392/0 (socket says 172.21.15.78:35392) 2023-08-17T17:49:48.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.491+0000 7f33affff700 1 -- 172.21.15.78:0/842901414 learned_addr learned my addr 172.21.15.78:0/842901414 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:48.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b6ffd700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b81541a0 0x7f33b80a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b77fe700 1 --2- 172.21.15.78:0/842901414 >> v2:172.21.15.150:3300/0 conn(0x7f33b80c0560 0x7f33b80c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618344850 0 0) 0x7f33b80c8df0 con 0x7f33b8154580 2023-08-17T17:49:48.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a40033f0 con 0x7f33b8154580 2023-08-17T17:49:48.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1943814215 0 0) 0x7f33a40033f0 con 0x7f33b8154580 2023-08-17T17:49:48.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b81541a0 msgr2=0x7f33b80a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:48.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b81541a0 0x7f33b80a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 >> v2:172.21.15.150:3300/0 conn(0x7f33b80c0560 msgr2=0x7f33b80c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:48.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 --2- 172.21.15.78:0/842901414 >> v2:172.21.15.150:3300/0 conn(0x7f33b80c0560 0x7f33b80c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80c9040 con 0x7f33b8154580 2023-08-17T17:49:48.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f33a0001470 con 0x7f33b8154580 2023-08-17T17:49:48.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 >> v1:172.21.15.78:6789/0 conn(0x7f33b8154580 legacy=0x7f33b80bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:48.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33a40038e0 0x7f33a4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b81541a0 0x7f33a4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a4004b80 0x7f33a4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80a8190 con 0x7f33a4004b80 2023-08-17T17:49:48.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80c9970 con 0x7f33a40038e0 2023-08-17T17:49:48.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a400b8e0 con 0x7f33b81541a0 2023-08-17T17:49:48.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b77fe700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a4004b80 0x7f33a4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b6ffd700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33a40038e0 0x7f33a4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33affff700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b81541a0 0x7f33a4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b77fe700 1 -- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b81541a0 msgr2=0x7f33a4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:48.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b77fe700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b81541a0 0x7f33a4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b77fe700 1 -- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33a40038e0 msgr2=0x7f33a4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:48.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b77fe700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33a40038e0 0x7f33a4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b77fe700 1 -- 172.21.15.78:0/842901414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a40033f0 con 0x7f33a4004b80 2023-08-17T17:49:48.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.492+0000 7f33b77fe700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a4004b80 0x7f33a4005000 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f33b000e210 tx=0x7f33b000b040).ready entity=mon.0 client_cookie=473eb4bc2e9dc205 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:48.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.493+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0009ac0 con 0x7f33a4004b80 2023-08-17T17:49:48.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.493+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b000f040 con 0x7f33a4004b80 2023-08-17T17:49:48.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.493+0000 7f33b67fc700 1 -- 172.21.15.78:0/842901414 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b000ecd0 con 0x7f33a4004b80 2023-08-17T17:49:48.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.493+0000 7f33bd38c700 1 -- 172.21.15.78:0/842901414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a4004b80 msgr2=0x7f33a4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:48.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.493+0000 7f33bd38c700 1 --2- 172.21.15.78:0/842901414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a4004b80 0x7f33a4005000 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f33b000e210 tx=0x7f33b000b040).stop 2023-08-17T17:49:48.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.493+0000 7f33b77fe700 1 -- 172.21.15.78:0/842901414 reap_dead start 2023-08-17T17:49:48.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.493+0000 7f33bd38c700 1 -- 172.21.15.78:0/842901414 shutdown_connections 2023-08-17T17:49:48.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.493+0000 7f33bd38c700 1 -- 172.21.15.78:0/842901414 >> 172.21.15.78:0/842901414 conn(0x7f33b806a400 msgr2=0x7f33b80caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:48.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.493+0000 7f33bd38c700 1 -- 172.21.15.78:0/842901414 shutdown_connections 2023-08-17T17:49:48.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.493+0000 7f33bd38c700 1 -- 172.21.15.78:0/842901414 wait complete. 2023-08-17T17:49:48.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.494+0000 7f33bd38c700 1 Processor -- start 2023-08-17T17:49:48.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.494+0000 7f33bd38c700 1 -- start start 2023-08-17T17:49:48.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33bd38c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b80ad580 0x7f33b80ab550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33bd38c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b80aba40 0x7f33b80c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33bd38c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b80c4230 0x7f33b80c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33bd38c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81515d0 con 0x7f33b80ad580 2023-08-17T17:49:48.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33bd38c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8152150 con 0x7f33b80aba40 2023-08-17T17:49:48.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33bd38c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8151820 con 0x7f33b80c4230 2023-08-17T17:49:48.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33b6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b80ad580 0x7f33b80ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33b6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b80ad580 0x7f33b80ab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33188/0 (socket says 172.21.15.78:33188) 2023-08-17T17:49:48.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33b6ffd700 1 -- 172.21.15.78:0/2132254658 learned_addr learned my addr 172.21.15.78:0/2132254658 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:48.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33affff700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b80aba40 0x7f33b80c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33b77fe700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b80c4230 0x7f33b80c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33b6ffd700 1 -- 172.21.15.78:0/2132254658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b80c4230 msgr2=0x7f33b80c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:48.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33b6ffd700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b80c4230 0x7f33b80c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33b6ffd700 1 -- 172.21.15.78:0/2132254658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b80aba40 msgr2=0x7f33b80c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:48.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33b6ffd700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b80aba40 0x7f33b80c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:48.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.495+0000 7f33b6ffd700 1 -- 172.21.15.78:0/2132254658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8151b00 con 0x7f33b80ad580 2023-08-17T17:49:48.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.496+0000 7f33b6ffd700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b80ad580 0x7f33b80ab550 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f33a80119f0 tx=0x7f33a8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:48.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.496+0000 7f33aeffd700 1 -- 172.21.15.78:0/2132254658 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800f760 con 0x7f33b80ad580 2023-08-17T17:49:48.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.496+0000 7f33aeffd700 1 -- 172.21.15.78:0/2132254658 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800f8c0 con 0x7f33b80ad580 2023-08-17T17:49:48.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.496+0000 7f33bd38c700 1 -- 172.21.15.78:0/2132254658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b8151de0 con 0x7f33b80ad580 2023-08-17T17:49:48.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.496+0000 7f33aeffd700 1 -- 172.21.15.78:0/2132254658 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800fc40 con 0x7f33b80ad580 2023-08-17T17:49:48.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.496+0000 7f33bd38c700 1 -- 172.21.15.78:0/2132254658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b80c2c30 con 0x7f33b80ad580 2023-08-17T17:49:48.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.497+0000 7f33bd38c700 1 -- 172.21.15.78:0/2132254658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b8047350 con 0x7f33b80ad580 2023-08-17T17:49:48.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.497+0000 7f33aeffd700 1 -- 172.21.15.78:0/2132254658 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f33a800fda0 con 0x7f33b80ad580 2023-08-17T17:49:48.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.498+0000 7f33aeffd700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f339805ed90 0x7f3398061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:48.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.498+0000 7f33affff700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f339805ed90 0x7f3398061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:48.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.498+0000 7f33aeffd700 1 -- 172.21.15.78:0/2132254658 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f33a8079f80 con 0x7f33b80ad580 2023-08-17T17:49:48.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.498+0000 7f33affff700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f339805ed90 0x7f3398061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f33b80c6dd0 tx=0x7f33a00077c0).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:48.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.502+0000 7f33aeffd700 1 -- 172.21.15.78:0/2132254658 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f33a804b6a0 con 0x7f33b80ad580 2023-08-17T17:49:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:48.678+0000 7f33bd38c700 1 -- 172.21.15.78:0/2132254658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f33b80c9320 con 0x7f33b80ad580 2023-08-17T17:49:49.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.555+0000 7f33aeffd700 1 -- 172.21.15.78:0/2132254658 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7f33a804ecc0 con 0x7f33b80ad580 2023-08-17T17:49:49.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 -- 172.21.15.78:0/2132254658 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f339805ed90 msgr2=0x7f3398061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:49.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f339805ed90 0x7f3398061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f33b80c6dd0 tx=0x7f33a00077c0).stop 2023-08-17T17:49:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 -- 172.21.15.78:0/2132254658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b80ad580 msgr2=0x7f33b80ab550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b80ad580 0x7f33b80ab550 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f33a80119f0 tx=0x7f33a8009060).stop 2023-08-17T17:49:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 -- 172.21.15.78:0/2132254658 shutdown_connections 2023-08-17T17:49:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f339805ed90 0x7f3398061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b80c4230 0x7f33b80c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b80ad580 0x7f33b80ab550 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 --2- 172.21.15.78:0/2132254658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b80aba40 0x7f33b80c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 -- 172.21.15.78:0/2132254658 >> 172.21.15.78:0/2132254658 conn(0x7f33b806a400 msgr2=0x7f33b80cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 -- 172.21.15.78:0/2132254658 shutdown_connections 2023-08-17T17:49:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.558+0000 7f33bd38c700 1 -- 172.21.15.78:0/2132254658 wait complete. 2023-08-17T17:49:49.561 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-08-17T17:49:49.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T17:49:49.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.688+0000 7fb3509e1700 1 Processor -- start 2023-08-17T17:49:49.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.688+0000 7fb3509e1700 1 -- start start 2023-08-17T17:49:49.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.689+0000 7fb3509e1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb34c0c01b0 0x7fb34c0c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:49.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.689+0000 7fb3509e1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a8050 0x7fb34c064500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:49.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.689+0000 7fb3509e1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c063960 con 0x7fb34c0a7bd0 2023-08-17T17:49:49.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.689+0000 7fb3509e1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0649f0 con 0x7fb34c0c01b0 2023-08-17T17:49:49.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.689+0000 7fb3509e1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c063030 con 0x7fb34c0a8050 2023-08-17T17:49:49.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.689+0000 7fb34bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a8050 0x7fb34c064500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:49.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.689+0000 7fb34b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb34c0c01b0 0x7fb34c0c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:49.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.689+0000 7fb34bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a8050 0x7fb34c064500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:53460/0 (socket says 172.21.15.78:53460) 2023-08-17T17:49:49.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.689+0000 7fb34bfff700 1 -- 172.21.15.78:0/3895500400 learned_addr learned my addr 172.21.15.78:0/3895500400 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:49.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.690+0000 7fb34b7fe700 1 -- 172.21.15.78:0/3895500400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a8050 msgr2=0x7fb34c064500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:49.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.690+0000 7fb34b7fe700 1 --2- 172.21.15.78:0/3895500400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a8050 0x7fb34c064500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.690+0000 7fb34b7fe700 1 -- 172.21.15.78:0/3895500400 >> v1:172.21.15.150:6789/0 conn(0x7fb34c0a7bd0 legacy=0x7fb34c063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:49.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.690+0000 7fb34b7fe700 1 -- 172.21.15.78:0/3895500400 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c063310 con 0x7fb34c0c01b0 2023-08-17T17:49:49.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.690+0000 7fb34bfff700 1 --2- 172.21.15.78:0/3895500400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a8050 0x7fb34c064500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:49.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.690+0000 7fb34b7fe700 1 --2- 172.21.15.78:0/3895500400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c0c01b0 0x7fb34c0c5b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fb33c009e60 tx=0x7fb33c009780).ready entity=mon.1 client_cookie=a2f0ed10e2f6ac98 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:49.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.690+0000 7fb34a7fc700 1 -- 172.21.15.78:0/3895500400 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00e070 con 0x7fb34c0c01b0 2023-08-17T17:49:49.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.690+0000 7fb34a7fc700 1 -- 172.21.15.78:0/3895500400 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c00bb60 con 0x7fb34c0c01b0 2023-08-17T17:49:49.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.690+0000 7fb34a7fc700 1 -- 172.21.15.78:0/3895500400 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c012410 con 0x7fb34c0c01b0 2023-08-17T17:49:49.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.691+0000 7fb3509e1700 1 -- 172.21.15.78:0/3895500400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c0c01b0 msgr2=0x7fb34c0c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:49.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.691+0000 7fb3509e1700 1 --2- 172.21.15.78:0/3895500400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c0c01b0 0x7fb34c0c5b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fb33c009e60 tx=0x7fb33c009780).stop 2023-08-17T17:49:49.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.691+0000 7fb3509e1700 1 -- 172.21.15.78:0/3895500400 shutdown_connections 2023-08-17T17:49:49.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.691+0000 7fb3509e1700 1 --2- 172.21.15.78:0/3895500400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a8050 0x7fb34c064500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.691+0000 7fb3509e1700 1 --2- 172.21.15.78:0/3895500400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c0c01b0 0x7fb34c0c5b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.691+0000 7fb3509e1700 1 -- 172.21.15.78:0/3895500400 >> 172.21.15.78:0/3895500400 conn(0x7fb34c06a6c0 msgr2=0x7fb34c0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:49.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.691+0000 7fb3509e1700 1 -- 172.21.15.78:0/3895500400 shutdown_connections 2023-08-17T17:49:49.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.691+0000 7fb3509e1700 1 -- 172.21.15.78:0/3895500400 wait complete. 2023-08-17T17:49:49.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.692+0000 7fb3509e1700 1 Processor -- start 2023-08-17T17:49:49.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.692+0000 7fb3509e1700 1 -- start start 2023-08-17T17:49:49.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb3509e1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a7bd0 0x7fb34c1685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:49.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb3509e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb34c0a8050 0x7fb34c156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:49.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb3509e1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c0c01b0 0x7fb34c1644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:49.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb3509e1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c168120 con 0x7fb34c0a8050 2023-08-17T17:49:49.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb3509e1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c154850 con 0x7fb34c0c01b0 2023-08-17T17:49:49.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb3509e1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c165060 con 0x7fb34c0a7bd0 2023-08-17T17:49:49.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb34c0a8050 0x7fb34c156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:49.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb34c0a8050 0x7fb34c156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44796/0 (socket says 172.21.15.78:44796) 2023-08-17T17:49:49.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34affd700 1 -- 172.21.15.78:0/1114116634 learned_addr learned my addr 172.21.15.78:0/1114116634 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:49.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34b7fe700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a7bd0 0x7fb34c1685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:49.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34bfff700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c0c01b0 0x7fb34c1644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:49.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34affd700 1 -- 172.21.15.78:0/1114116634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a7bd0 msgr2=0x7fb34c1685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:49.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34affd700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a7bd0 0x7fb34c1685b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34affd700 1 -- 172.21.15.78:0/1114116634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c0c01b0 msgr2=0x7fb34c1644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:49.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34affd700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c0c01b0 0x7fb34c1644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34affd700 1 -- 172.21.15.78:0/1114116634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344009370 con 0x7fb34c0a8050 2023-08-17T17:49:49.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34bfff700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c0c01b0 0x7fb34c1644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:49.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb34affd700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb34c0a8050 0x7fb34c156e50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fb34000c4c0 tx=0x7fb340007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:49.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.693+0000 7fb3337fe700 1 -- 172.21.15.78:0/1114116634 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340007020 con 0x7fb34c0a8050 2023-08-17T17:49:49.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.694+0000 7fb3337fe700 1 -- 172.21.15.78:0/1114116634 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340001e90 con 0x7fb34c0a8050 2023-08-17T17:49:49.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.694+0000 7fb3509e1700 1 -- 172.21.15.78:0/1114116634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c009a20 con 0x7fb34c0a8050 2023-08-17T17:49:49.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.694+0000 7fb3337fe700 1 -- 172.21.15.78:0/1114116634 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400073b0 con 0x7fb34c0a8050 2023-08-17T17:49:49.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.694+0000 7fb3509e1700 1 -- 172.21.15.78:0/1114116634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c167db0 con 0x7fb34c0a8050 2023-08-17T17:49:49.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.695+0000 7fb3509e1700 1 -- 172.21.15.78:0/1114116634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c1682d0 con 0x7fb34c0a8050 2023-08-17T17:49:49.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.695+0000 7fb3337fe700 1 -- 172.21.15.78:0/1114116634 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb340010070 con 0x7fb34c0a8050 2023-08-17T17:49:49.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.695+0000 7fb3337fe700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb33805ed90 0x7fb338061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:49.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.695+0000 7fb3337fe700 1 -- 172.21.15.78:0/1114116634 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb340079020 con 0x7fb34c0a8050 2023-08-17T17:49:49.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.695+0000 7fb34b7fe700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb33805ed90 0x7fb338061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:49.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.696+0000 7fb34b7fe700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb33805ed90 0x7fb338061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb33c009fd0 tx=0x7fb33c009780).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:49.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.699+0000 7fb3337fe700 1 -- 172.21.15.78:0/1114116634 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb34c1682d0 con 0x7fb34c0a8050 2023-08-17T17:49:49.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.927+0000 7fb3509e1700 1 -- 172.21.15.78:0/1114116634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb34c164dc0 con 0x7fb34c0a8050 2023-08-17T17:49:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.928+0000 7fb3337fe700 1 -- 172.21.15.78:0/1114116634 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb34004a910 con 0x7fb34c0a8050 2023-08-17T17:49:49.929 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:49.929 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:49:49.929 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-08-17T17:49:49.930 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.930 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-08-17T17:49:49.930 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA==", 2023-08-17T17:49:49.930 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.930 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:49.930 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:49:49.930 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:49:49.930 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.931 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.931 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.931 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.931 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-08-17T17:49:49.931 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g==", 2023-08-17T17:49:49.931 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.931 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:49.932 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:49:49.932 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:49:49.932 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.932 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.932 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.932 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.932 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-08-17T17:49:49.932 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw==", 2023-08-17T17:49:49.933 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.933 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:49.933 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:49:49.933 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:49:49.933 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.933 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.933 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.934 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.934 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-08-17T17:49:49.934 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg==", 2023-08-17T17:49:49.934 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.934 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:49.934 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:49:49.934 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:49:49.934 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.935 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.935 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.935 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.935 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-08-17T17:49:49.935 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg==", 2023-08-17T17:49:49.935 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.935 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:49.935 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:49.936 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.936 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.936 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.936 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.936 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-08-17T17:49:49.936 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw==", 2023-08-17T17:49:49.936 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.937 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:49.937 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:49.937 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.937 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.937 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.937 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.937 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-08-17T17:49:49.937 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA==", 2023-08-17T17:49:49.938 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.938 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:49.938 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:49.938 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.938 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.938 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.938 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.938 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-08-17T17:49:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ==", 2023-08-17T17:49:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-08-17T17:49:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA==", 2023-08-17T17:49:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-08-17T17:49:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q==", 2023-08-17T17:49:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-08-17T17:49:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw==", 2023-08-17T17:49:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-08-17T17:49:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg==", 2023-08-17T17:49:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:49:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:49:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-08-17T17:49:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA==", 2023-08-17T17:49:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-08-17T17:49:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T17:49:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-08-17T17:49:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ==", 2023-08-17T17:49:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:49:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:49:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:49:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-08-17T17:49:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ==", 2023-08-17T17:49:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:49:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:49:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:49:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-08-17T17:49:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw==", 2023-08-17T17:49:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:49:49.949 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:49:49.949 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:49:49.949 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:49:49.949 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.949 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.949 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.949 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-08-17T17:49:49.949 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k6n2yGhAAldYlBQaNGCgXL0HA2ePHVg==", 2023-08-17T17:49:49.950 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.950 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:49:49.950 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:49:49.950 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:49:49.950 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.950 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.950 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.950 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.951 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-08-17T17:49:49.951 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg==", 2023-08-17T17:49:49.951 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.951 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:49:49.951 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:49:49.951 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.951 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.951 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:49.952 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:49.952 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-08-17T17:49:49.952 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA==", 2023-08-17T17:49:49.952 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:49:49.952 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:49:49.952 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:49:49.952 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:49:49.952 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.953 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:49.953 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-08-17T17:49:49.953 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:49:49.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 -- 172.21.15.78:0/1114116634 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb33805ed90 msgr2=0x7fb338061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:49.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb33805ed90 0x7fb338061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb33c009fd0 tx=0x7fb33c009780).stop 2023-08-17T17:49:49.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 -- 172.21.15.78:0/1114116634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb34c0a8050 msgr2=0x7fb34c156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb34c0a8050 0x7fb34c156e50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fb34000c4c0 tx=0x7fb340007e00).stop 2023-08-17T17:49:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 -- 172.21.15.78:0/1114116634 shutdown_connections 2023-08-17T17:49:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb33805ed90 0x7fb338061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb34c0c01b0 0x7fb34c1644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb34c0a7bd0 0x7fb34c1685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 --2- 172.21.15.78:0/1114116634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb34c0a8050 0x7fb34c156e50 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 -- 172.21.15.78:0/1114116634 >> 172.21.15.78:0/1114116634 conn(0x7fb34c06a6c0 msgr2=0x7fb34c0985c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 -- 172.21.15.78:0/1114116634 shutdown_connections 2023-08-17T17:49:49.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:49.930+0000 7fb3509e1700 1 -- 172.21.15.78:0/1114116634 wait complete. 2023-08-17T17:49:49.956 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:50.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.067+0000 7f4ef4e18700 1 Processor -- start 2023-08-17T17:49:50.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.067+0000 7f4ef4e18700 1 -- start start 2023-08-17T17:49:50.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.068+0000 7f4ef4e18700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef00650a0 0x7f4ef01516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.068+0000 7f4ef4e18700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef0155060 con 0x7f4ef00c1e80 2023-08-17T17:49:50.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.068+0000 7f4ef4e18700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef0151be0 con 0x7f4ef00c1a00 2023-08-17T17:49:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.068+0000 7f4ef4e18700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00699f0 con 0x7f4ef00650a0 2023-08-17T17:49:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.068+0000 7f4eeed9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4ef00c1e80 0x7f4ef0154950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44580/0 (socket says 172.21.15.78:44580) 2023-08-17T17:49:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.068+0000 7f4eeed9d700 1 -- 172.21.15.78:0/1064139337 learned_addr learned my addr 172.21.15.78:0/1064139337 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eee59c700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef00650a0 0x7f4ef01516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178172626 0 0) 0x7f4ef0155060 con 0x7f4ef00c1e80 2023-08-17T17:49:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4edc0033f0 con 0x7f4ef00c1e80 2023-08-17T17:49:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1649118692 0 0) 0x7f4edc0033f0 con 0x7f4ef00c1e80 2023-08-17T17:49:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef00650a0 msgr2=0x7f4ef01516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef00650a0 0x7f4ef01516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 >> v1:172.21.15.150:6789/0 conn(0x7f4ef00c1a00 legacy=0x7f4ef0154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0068950 con 0x7f4ef00c1e80 2023-08-17T17:49:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f4ee80017f0 con 0x7f4ef00c1e80 2023-08-17T17:49:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eee59c700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef00650a0 0x7f4ef01516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 >> v1:172.21.15.78:6789/0 conn(0x7f4ef00c1e80 legacy=0x7f4ef0154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef00650a0 0x7f4edc003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4edc003eb0 0x7f4edc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 0x7f4edc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc00b9c0 con 0x7f4edc004b80 2023-08-17T17:49:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc00bb30 con 0x7f4edc003eb0 2023-08-17T17:49:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc00bcf0 con 0x7f4ef00650a0 2023-08-17T17:49:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eeed9d700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 0x7f4edc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eee59c700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef00650a0 0x7f4edc003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4ee5d9b700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4edc003eb0 0x7f4edc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eeed9d700 1 -- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef00650a0 msgr2=0x7f4edc003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eeed9d700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef00650a0 0x7f4edc003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eeed9d700 1 -- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4edc003eb0 msgr2=0x7f4edc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eeed9d700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4edc003eb0 0x7f4edc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eeed9d700 1 -- 172.21.15.78:0/1064139337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc0033f0 con 0x7f4edc004b80 2023-08-17T17:49:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.069+0000 7f4eeed9d700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 0x7f4edc005000 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f4ee800c450 tx=0x7f4ee800c760).ready entity=mon.0 client_cookie=6e0bc1a5d37fa51c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.070+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8002030 con 0x7f4edc004b80 2023-08-17T17:49:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.070+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800cdf0 con 0x7f4edc004b80 2023-08-17T17:49:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.070+0000 7f4eedd9b700 1 -- 172.21.15.78:0/1064139337 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8005d50 con 0x7f4edc004b80 2023-08-17T17:49:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.070+0000 7f4ef4e18700 1 -- 172.21.15.78:0/1064139337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 msgr2=0x7f4edc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.070+0000 7f4ef4e18700 1 --2- 172.21.15.78:0/1064139337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 0x7f4edc005000 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f4ee800c450 tx=0x7f4ee800c760).stop 2023-08-17T17:49:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.070+0000 7f4eeed9d700 1 -- 172.21.15.78:0/1064139337 reap_dead start 2023-08-17T17:49:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.070+0000 7f4ef4e18700 1 -- 172.21.15.78:0/1064139337 shutdown_connections 2023-08-17T17:49:50.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.070+0000 7f4ef4e18700 1 -- 172.21.15.78:0/1064139337 >> 172.21.15.78:0/1064139337 conn(0x7f4ef0062fc0 msgr2=0x7f4ef00c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:50.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.070+0000 7f4ef4e18700 1 -- 172.21.15.78:0/1064139337 shutdown_connections 2023-08-17T17:49:50.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.070+0000 7f4ef4e18700 1 -- 172.21.15.78:0/1064139337 wait complete. 2023-08-17T17:49:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.071+0000 7f4ef4e18700 1 Processor -- start 2023-08-17T17:49:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.071+0000 7f4ef4e18700 1 -- start start 2023-08-17T17:49:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4ef4e18700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 0x7f4ef0142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4ef4e18700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef014f790 0x7f4ef014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4ef4e18700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef00bf090 0x7f4ef00bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4ef4e18700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0150100 con 0x7f4edc004b80 2023-08-17T17:49:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4ef4e18700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00bfd80 con 0x7f4ef00bf090 2023-08-17T17:49:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4ef4e18700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00c0060 con 0x7f4ef014f790 2023-08-17T17:49:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4eee59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 0x7f4ef0142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4eee59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 0x7f4ef0142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44804/0 (socket says 172.21.15.78:44804) 2023-08-17T17:49:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4eee59c700 1 -- 172.21.15.78:0/3948553964 learned_addr learned my addr 172.21.15.78:0/3948553964 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4eeed9d700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef00bf090 0x7f4ef00bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.072+0000 7f4ee5d9b700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef014f790 0x7f4ef014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4eee59c700 1 -- 172.21.15.78:0/3948553964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef014f790 msgr2=0x7f4ef014fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4eee59c700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef014f790 0x7f4ef014fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4eee59c700 1 -- 172.21.15.78:0/3948553964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef00bf090 msgr2=0x7f4ef00bf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4eee59c700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef00bf090 0x7f4ef00bf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4eee59c700 1 -- 172.21.15.78:0/3948553964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00c0340 con 0x7f4edc004b80 2023-08-17T17:49:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4ee5d9b700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef014f790 0x7f4ef014fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4eee59c700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 0x7f4ef0142f40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f4ee00108d0 tx=0x7f4ee0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4ee6ffd700 1 -- 172.21.15.78:0/3948553964 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0014680 con 0x7f4edc004b80 2023-08-17T17:49:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4ee6ffd700 1 -- 172.21.15.78:0/3948553964 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee00147e0 con 0x7f4edc004b80 2023-08-17T17:49:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4ef4e18700 1 -- 172.21.15.78:0/3948553964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef00c0620 con 0x7f4edc004b80 2023-08-17T17:49:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4ee6ffd700 1 -- 172.21.15.78:0/3948553964 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0014b60 con 0x7f4edc004b80 2023-08-17T17:49:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.073+0000 7f4ef4e18700 1 -- 172.21.15.78:0/3948553964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef0143430 con 0x7f4edc004b80 2023-08-17T17:49:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.074+0000 7f4ef4e18700 1 -- 172.21.15.78:0/3948553964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef0143620 con 0x7f4edc004b80 2023-08-17T17:49:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.074+0000 7f4ee6ffd700 1 -- 172.21.15.78:0/3948553964 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4ee000e480 con 0x7f4edc004b80 2023-08-17T17:49:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.074+0000 7f4ee6ffd700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ed005ed90 0x7f4ed0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.074+0000 7f4ee6ffd700 1 -- 172.21.15.78:0/3948553964 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4ee0079c50 con 0x7f4edc004b80 2023-08-17T17:49:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.074+0000 7f4ee5d9b700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ed005ed90 0x7f4ed0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.075+0000 7f4ee5d9b700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ed005ed90 0x7f4ed0061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4ef00a9560 tx=0x7f4ed8009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.079+0000 7f4ee6ffd700 1 -- 172.21.15.78:0/3948553964 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ee004b4e0 con 0x7f4edc004b80 2023-08-17T17:49:50.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.241+0000 7f4ef4e18700 1 -- 172.21.15.78:0/3948553964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ef0047350 con 0x7f4edc004b80 2023-08-17T17:49:50.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.242+0000 7f4ee6ffd700 1 -- 172.21.15.78:0/3948553964 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+13761 (secure 0 0 0) 0x7f4ee004eb00 con 0x7f4edc004b80 2023-08-17T17:49:50.243 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:50.244 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":87,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:49.553598+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 -- 172.21.15.78:0/3948553964 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ed005ed90 msgr2=0x7f4ed0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ed005ed90 0x7f4ed0061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4ef00a9560 tx=0x7f4ed8009040).stop 2023-08-17T17:49:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 -- 172.21.15.78:0/3948553964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 msgr2=0x7f4ef0142f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 0x7f4ef0142f40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f4ee00108d0 tx=0x7f4ee0008040).stop 2023-08-17T17:49:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 -- 172.21.15.78:0/3948553964 shutdown_connections 2023-08-17T17:49:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ed005ed90 0x7f4ed0061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef00bf090 0x7f4ef00bf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4edc004b80 0x7f4ef0142f40 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 --2- 172.21.15.78:0/3948553964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef014f790 0x7f4ef014fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 -- 172.21.15.78:0/3948553964 >> 172.21.15.78:0/3948553964 conn(0x7f4ef0062fc0 msgr2=0x7f4ef01541a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 -- 172.21.15.78:0/3948553964 shutdown_connections 2023-08-17T17:49:50.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.244+0000 7f4ef4e18700 1 -- 172.21.15.78:0/3948553964 wait complete. 2023-08-17T17:49:50.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T17:49:50.258 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:49:50.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.373+0000 7f01dc64a700 1 Processor -- start 2023-08-17T17:49:50.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.373+0000 7f01dc64a700 1 -- start start 2023-08-17T17:49:50.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.374+0000 7f01dc64a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01d40c5f20 0x7f01d40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.374+0000 7f01dc64a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d40649b0 con 0x7f01d40aa0f0 2023-08-17T17:49:50.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.374+0000 7f01dc64a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d4063420 con 0x7f01d40aa4d0 2023-08-17T17:49:50.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.374+0000 7f01dc64a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d4063700 con 0x7f01d40c5f20 2023-08-17T17:49:50.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.374+0000 7f01da3e6700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f01d40aa0f0 0x7f01d40c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44592/0 (socket says 172.21.15.78:44592) 2023-08-17T17:49:50.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.374+0000 7f01da3e6700 1 -- 172.21.15.78:0/2843401086 learned_addr learned my addr 172.21.15.78:0/2843401086 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:50.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.374+0000 7f01dabe7700 1 --2- 172.21.15.78:0/2843401086 >> v2:172.21.15.78:3300/0 conn(0x7f01d40c5f20 0x7f01d40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.374+0000 7f01dabe7700 1 -- 172.21.15.78:0/2843401086 >> v1:172.21.15.150:6789/0 conn(0x7f01d40aa4d0 legacy=0x7f01d40c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01dabe7700 1 -- 172.21.15.78:0/2843401086 >> v1:172.21.15.78:6789/0 conn(0x7f01d40aa0f0 legacy=0x7f01d40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01d93e4700 1 -- 172.21.15.78:0/2843401086 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231838165 0 0) 0x7f01d40649b0 con 0x7f01d40aa0f0 2023-08-17T17:49:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01dabe7700 1 -- 172.21.15.78:0/2843401086 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d40639e0 con 0x7f01d40c5f20 2023-08-17T17:49:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01dabe7700 1 --2- 172.21.15.78:0/2843401086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 0x7f01d40644c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f01cc009de0 tx=0x7f01cc009780).ready entity=mon.0 client_cookie=93e39b453841d5d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01d93e4700 1 -- 172.21.15.78:0/2843401086 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00e070 con 0x7f01d40c5f20 2023-08-17T17:49:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01d93e4700 1 -- 172.21.15.78:0/2843401086 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc00bae0 con 0x7f01d40c5f20 2023-08-17T17:49:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01d93e4700 1 -- 172.21.15.78:0/2843401086 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00be60 con 0x7f01d40c5f20 2023-08-17T17:49:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01dc64a700 1 -- 172.21.15.78:0/2843401086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 msgr2=0x7f01d40644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01dc64a700 1 --2- 172.21.15.78:0/2843401086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 0x7f01d40644c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f01cc009de0 tx=0x7f01cc009780).stop 2023-08-17T17:49:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01dc64a700 1 -- 172.21.15.78:0/2843401086 shutdown_connections 2023-08-17T17:49:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01dc64a700 1 --2- 172.21.15.78:0/2843401086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 0x7f01d40644c0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01dc64a700 1 -- 172.21.15.78:0/2843401086 >> 172.21.15.78:0/2843401086 conn(0x7f01d406a6a0 msgr2=0x7f01d40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01dc64a700 1 -- 172.21.15.78:0/2843401086 shutdown_connections 2023-08-17T17:49:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.375+0000 7f01dc64a700 1 -- 172.21.15.78:0/2843401086 wait complete. 2023-08-17T17:49:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.376+0000 7f01dc64a700 1 Processor -- start 2023-08-17T17:49:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01dc64a700 1 -- start start 2023-08-17T17:49:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01dc64a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d40aa0f0 0x7f01d4164c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01dc64a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01d40aa4d0 0x7f01d41576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01dc64a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 0x7f01d40af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01dc64a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40ad200 con 0x7f01d40c5f20 2023-08-17T17:49:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01dc64a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41647d0 con 0x7f01d40aa4d0 2023-08-17T17:49:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01dc64a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40ad560 con 0x7f01d40aa0f0 2023-08-17T17:49:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01dabe7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 0x7f01d40af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01dabe7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 0x7f01d40af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44834/0 (socket says 172.21.15.78:44834) 2023-08-17T17:49:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01dabe7700 1 -- 172.21.15.78:0/966198884 learned_addr learned my addr 172.21.15.78:0/966198884 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.377+0000 7f01d9be5700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01d40aa4d0 0x7f01d41576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01da3e6700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d40aa0f0 0x7f01d4164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01dabe7700 1 -- 172.21.15.78:0/966198884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d40aa0f0 msgr2=0x7f01d4164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01dabe7700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d40aa0f0 0x7f01d4164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01dabe7700 1 -- 172.21.15.78:0/966198884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01d40aa4d0 msgr2=0x7f01d41576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01dabe7700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01d40aa4d0 0x7f01d41576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01dabe7700 1 -- 172.21.15.78:0/966198884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009a20 con 0x7f01d40c5f20 2023-08-17T17:49:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01da3e6700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d40aa0f0 0x7f01d4164c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01dabe7700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 0x7f01d40af8b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f01cc00b6c0 tx=0x7f01cc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01ca7fc700 1 -- 172.21.15.78:0/966198884 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc01c660 con 0x7f01d40c5f20 2023-08-17T17:49:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01ca7fc700 1 -- 172.21.15.78:0/966198884 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc01c7c0 con 0x7f01d40c5f20 2023-08-17T17:49:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01dc64a700 1 -- 172.21.15.78:0/966198884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d40ad840 con 0x7f01d40c5f20 2023-08-17T17:49:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01ca7fc700 1 -- 172.21.15.78:0/966198884 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc01cb60 con 0x7f01d40c5f20 2023-08-17T17:49:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.378+0000 7f01dc64a700 1 -- 172.21.15.78:0/966198884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d4157bb0 con 0x7f01d40c5f20 2023-08-17T17:49:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.379+0000 7f01dc64a700 1 -- 172.21.15.78:0/966198884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d4164960 con 0x7f01d40c5f20 2023-08-17T17:49:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.379+0000 7f01ca7fc700 1 -- 172.21.15.78:0/966198884 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f01cc01d420 con 0x7f01d40c5f20 2023-08-17T17:49:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.380+0000 7f01ca7fc700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f01b805ed90 0x7f01b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.380+0000 7f01ca7fc700 1 -- 172.21.15.78:0/966198884 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f01cc07b830 con 0x7f01d40c5f20 2023-08-17T17:49:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.380+0000 7f01da3e6700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f01b805ed90 0x7f01b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.380+0000 7f01da3e6700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f01b805ed90 0x7f01b8061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f01d0001120 tx=0x7f01d0009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.384+0000 7f01ca7fc700 1 -- 172.21.15.78:0/966198884 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f01cc04d170 con 0x7f01d40c5f20 2023-08-17T17:49:50.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.546+0000 7f01dc64a700 1 -- 172.21.15.78:0/966198884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f01d4046af0 con 0x7f01d40c5f20 2023-08-17T17:49:50.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.546+0000 7f01ca7fc700 1 -- 172.21.15.78:0/966198884 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v87) v1 ==== 110+0+10 (secure 0 0 0) 0x7f01cc050790 con 0x7f01d40c5f20 2023-08-17T17:49:50.548 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:49:50.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 -- 172.21.15.78:0/966198884 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f01b805ed90 msgr2=0x7f01b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f01b805ed90 0x7f01b8061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f01d0001120 tx=0x7f01d0009040).stop 2023-08-17T17:49:50.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 -- 172.21.15.78:0/966198884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 msgr2=0x7f01d40af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 0x7f01d40af8b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f01cc00b6c0 tx=0x7f01cc009780).stop 2023-08-17T17:49:50.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 -- 172.21.15.78:0/966198884 shutdown_connections 2023-08-17T17:49:50.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f01b805ed90 0x7f01b8061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d40c5f20 0x7f01d40af8b0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d40aa0f0 0x7f01d4164c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 --2- 172.21.15.78:0/966198884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01d40aa4d0 0x7f01d41576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 -- 172.21.15.78:0/966198884 >> 172.21.15.78:0/966198884 conn(0x7f01d406a6a0 msgr2=0x7f01d40c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:50.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 -- 172.21.15.78:0/966198884 shutdown_connections 2023-08-17T17:49:50.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.548+0000 7f01dc64a700 1 -- 172.21.15.78:0/966198884 wait complete. 2023-08-17T17:49:50.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:49:50.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.675+0000 7f1cddc3b700 1 Processor -- start 2023-08-17T17:49:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.675+0000 7f1cddc3b700 1 -- start start 2023-08-17T17:49:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cddc3b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1cd80aa0f0 0x7f1cd80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cddc3b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1cd80aa4d0 0x7f1cd80c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cddc3b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80c5810 0x7f1cd80c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cddc3b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd80649b0 con 0x7f1cd80aa4d0 2023-08-17T17:49:50.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cddc3b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd80c6140 con 0x7f1cd80aa0f0 2023-08-17T17:49:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cddc3b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd8063420 con 0x7f1cd80c5810 2023-08-17T17:49:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cd6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1cd80aa4d0 0x7f1cd80c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cd6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1cd80aa4d0 0x7f1cd80c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44846/0 (socket says 172.21.15.78:44846) 2023-08-17T17:49:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cd6ffd700 1 -- 172.21.15.78:0/1399615560 learned_addr learned my addr 172.21.15.78:0/1399615560 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cd7fff700 1 --2- 172.21.15.78:0/1399615560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80c5810 0x7f1cd80c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cd6ffd700 1 -- 172.21.15.78:0/1399615560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80c5810 msgr2=0x7f1cd80c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cd6ffd700 1 --2- 172.21.15.78:0/1399615560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80c5810 0x7f1cd80c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cd77fe700 1 --2- 172.21.15.78:0/1399615560 >> v2:172.21.15.150:3300/0 conn(0x7f1cd80aa0f0 0x7f1cd80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cd6ffd700 1 -- 172.21.15.78:0/1399615560 >> v2:172.21.15.150:3300/0 conn(0x7f1cd80aa0f0 msgr2=0x7f1cd80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cd6ffd700 1 --2- 172.21.15.78:0/1399615560 >> v2:172.21.15.150:3300/0 conn(0x7f1cd80aa0f0 0x7f1cd80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.676+0000 7f1cd6ffd700 1 -- 172.21.15.78:0/1399615560 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8063700 con 0x7f1cd80aa4d0 2023-08-17T17:49:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cd7fff700 1 --2- 172.21.15.78:0/1399615560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80c5810 0x7f1cd80c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cd77fe700 1 --2- 172.21.15.78:0/1399615560 >> v2:172.21.15.150:3300/0 conn(0x7f1cd80aa0f0 0x7f1cd80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cd6ffd700 1 --2- 172.21.15.78:0/1399615560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80aa4d0 0x7f1cd80c0e10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f1cd80cade0 tx=0x7f1ccc0090f0).ready entity=mon.0 client_cookie=829481d7bd612047 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cd67fc700 1 -- 172.21.15.78:0/1399615560 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00b600 con 0x7f1cd80aa4d0 2023-08-17T17:49:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cd67fc700 1 -- 172.21.15.78:0/1399615560 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc00b760 con 0x7f1cd80aa4d0 2023-08-17T17:49:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cd67fc700 1 -- 172.21.15.78:0/1399615560 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00bae0 con 0x7f1cd80aa4d0 2023-08-17T17:49:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cddc3b700 1 -- 172.21.15.78:0/1399615560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80aa4d0 msgr2=0x7f1cd80c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cddc3b700 1 --2- 172.21.15.78:0/1399615560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80aa4d0 0x7f1cd80c0e10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f1cd80cade0 tx=0x7f1ccc0090f0).stop 2023-08-17T17:49:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cddc3b700 1 -- 172.21.15.78:0/1399615560 shutdown_connections 2023-08-17T17:49:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cddc3b700 1 --2- 172.21.15.78:0/1399615560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80c5810 0x7f1cd80c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cddc3b700 1 --2- 172.21.15.78:0/1399615560 >> v2:172.21.15.150:3300/0 conn(0x7f1cd80aa0f0 0x7f1cd80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cddc3b700 1 --2- 172.21.15.78:0/1399615560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80aa4d0 0x7f1cd80c0e10 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cddc3b700 1 -- 172.21.15.78:0/1399615560 >> 172.21.15.78:0/1399615560 conn(0x7f1cd806a6a0 msgr2=0x7f1cd80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cddc3b700 1 -- 172.21.15.78:0/1399615560 shutdown_connections 2023-08-17T17:49:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.677+0000 7f1cddc3b700 1 -- 172.21.15.78:0/1399615560 wait complete. 2023-08-17T17:49:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.679+0000 7f1cddc3b700 1 Processor -- start 2023-08-17T17:49:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.679+0000 7f1cddc3b700 1 -- start start 2023-08-17T17:49:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.679+0000 7f1cddc3b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cd80aa0f0 0x7f1cd80c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.679+0000 7f1cddc3b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80aa4d0 0x7f1cd8155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.679+0000 7f1cddc3b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80c5810 0x7f1cd81521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.679+0000 7f1cddc3b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80c3c00 con 0x7f1cd80c5810 2023-08-17T17:49:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.679+0000 7f1cddc3b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80c27e0 con 0x7f1cd80aa0f0 2023-08-17T17:49:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.679+0000 7f1cddc3b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80c2ac0 con 0x7f1cd80aa4d0 2023-08-17T17:49:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80c5810 0x7f1cd81521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80c5810 0x7f1cd81521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44848/0 (socket says 172.21.15.78:44848) 2023-08-17T17:49:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd7fff700 1 -- 172.21.15.78:0/3547151677 learned_addr learned my addr 172.21.15.78:0/3547151677 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd77fe700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cd80aa0f0 0x7f1cd80c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd6ffd700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80aa4d0 0x7f1cd8155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd7fff700 1 -- 172.21.15.78:0/3547151677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80aa4d0 msgr2=0x7f1cd8155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd7fff700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80aa4d0 0x7f1cd8155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd7fff700 1 -- 172.21.15.78:0/3547151677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cd80aa0f0 msgr2=0x7f1cd80c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd7fff700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cd80aa0f0 0x7f1cd80c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd7fff700 1 -- 172.21.15.78:0/3547151677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc009370 con 0x7f1cd80c5810 2023-08-17T17:49:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cd7fff700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80c5810 0x7f1cd81521f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f1cd000a380 tx=0x7f1cd0007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cbf7fe700 1 -- 172.21.15.78:0/3547151677 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000ae10 con 0x7f1cd80c5810 2023-08-17T17:49:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cbf7fe700 1 -- 172.21.15.78:0/3547151677 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd000d650 con 0x7f1cd80c5810 2023-08-17T17:49:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cddc3b700 1 -- 172.21.15.78:0/3547151677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd80c2da0 con 0x7f1cd80c5810 2023-08-17T17:49:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cbf7fe700 1 -- 172.21.15.78:0/3547151677 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000d9d0 con 0x7f1cd80c5810 2023-08-17T17:49:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.680+0000 7f1cddc3b700 1 -- 172.21.15.78:0/3547151677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd80c23d0 con 0x7f1cd80c5810 2023-08-17T17:49:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.681+0000 7f1cddc3b700 1 -- 172.21.15.78:0/3547151677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd8083980 con 0x7f1cd80c5810 2023-08-17T17:49:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.681+0000 7f1cbf7fe700 1 -- 172.21.15.78:0/3547151677 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1cd001d060 con 0x7f1cd80c5810 2023-08-17T17:49:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.682+0000 7f1cbf7fe700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc405ed90 0x7f1cc4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.682+0000 7f1cbf7fe700 1 -- 172.21.15.78:0/3547151677 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1cd007a0d0 con 0x7f1cd80c5810 2023-08-17T17:49:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.682+0000 7f1cd77fe700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc405ed90 0x7f1cc4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.682+0000 7f1cd77fe700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc405ed90 0x7f1cc4061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1cc800a9d0 tx=0x7f1cc8008040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.686+0000 7f1cbf7fe700 1 -- 172.21.15.78:0/3547151677 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1cd004b9c0 con 0x7f1cd80c5810 2023-08-17T17:49:50.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.847+0000 7f1cddc3b700 1 -- 172.21.15.78:0/3547151677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1cd8046af0 con 0x7f1cd80c5810 2023-08-17T17:49:50.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.847+0000 7f1cbf7fe700 1 -- 172.21.15.78:0/3547151677 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1cd001b020 con 0x7f1cd80c5810 2023-08-17T17:49:50.849 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:49:50.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 -- 172.21.15.78:0/3547151677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc405ed90 msgr2=0x7f1cc4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc405ed90 0x7f1cc4061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1cc800a9d0 tx=0x7f1cc8008040).stop 2023-08-17T17:49:50.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 -- 172.21.15.78:0/3547151677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80c5810 msgr2=0x7f1cd81521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80c5810 0x7f1cd81521f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f1cd000a380 tx=0x7f1cd0007900).stop 2023-08-17T17:49:50.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 -- 172.21.15.78:0/3547151677 shutdown_connections 2023-08-17T17:49:50.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc405ed90 0x7f1cc4061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80c5810 0x7f1cd81521f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cd80aa0f0 0x7f1cd80c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 --2- 172.21.15.78:0/3547151677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cd80aa4d0 0x7f1cd8155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 -- 172.21.15.78:0/3547151677 >> 172.21.15.78:0/3547151677 conn(0x7f1cd806a6a0 msgr2=0x7f1cd80ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:50.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 -- 172.21.15.78:0/3547151677 shutdown_connections 2023-08-17T17:49:50.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.849+0000 7f1cddc3b700 1 -- 172.21.15.78:0/3547151677 wait complete. 2023-08-17T17:49:50.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T17:49:50.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.973+0000 7fb67610a700 1 Processor -- start 2023-08-17T17:49:50.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.974+0000 7fb67610a700 1 -- start start 2023-08-17T17:49:50.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.974+0000 7fb67610a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb670154140 0x7fb6700c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.974+0000 7fb67610a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 0x7fb6700c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.974+0000 7fb67610a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb6700a8080 0x7fb6700c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.974+0000 7fb67610a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6700c12e0 con 0x7fb670154140 2023-08-17T17:49:50.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.974+0000 7fb67610a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb670154520 con 0x7fb6700a8080 2023-08-17T17:49:50.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.974+0000 7fb67610a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6700c91e0 con 0x7fb6700a7c40 2023-08-17T17:49:50.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.974+0000 7fb66f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb670154140 0x7fb6700c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.974+0000 7fb66f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb670154140 0x7fb6700c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44854/0 (socket says 172.21.15.78:44854) 2023-08-17T17:49:50.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.974+0000 7fb66f7fe700 1 -- 172.21.15.78:0/61071253 learned_addr learned my addr 172.21.15.78:0/61071253 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:50.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66effd700 1 --2- 172.21.15.78:0/61071253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 0x7fb6700c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66ffff700 1 --2- 172.21.15.78:0/61071253 >> v2:172.21.15.150:3300/0 conn(0x7fb6700a8080 0x7fb6700c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66f7fe700 1 -- 172.21.15.78:0/61071253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 msgr2=0x7fb6700c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:50.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66f7fe700 1 --2- 172.21.15.78:0/61071253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 0x7fb6700c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66f7fe700 1 -- 172.21.15.78:0/61071253 >> v2:172.21.15.150:3300/0 conn(0x7fb6700a8080 msgr2=0x7fb6700c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:50.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66f7fe700 1 --2- 172.21.15.78:0/61071253 >> v2:172.21.15.150:3300/0 conn(0x7fb6700a8080 0x7fb6700c0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66f7fe700 1 -- 172.21.15.78:0/61071253 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6700c94c0 con 0x7fb670154140 2023-08-17T17:49:50.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66effd700 1 --2- 172.21.15.78:0/61071253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 0x7fb6700c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:50.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66f7fe700 1 --2- 172.21.15.78:0/61071253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 0x7fb6700c6ee0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fb67006bd60 tx=0x7fb660009840).ready entity=mon.0 client_cookie=4ad0565fbc6d2971 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66e7fc700 1 -- 172.21.15.78:0/61071253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66000e070 con 0x7fb670154140 2023-08-17T17:49:50.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66e7fc700 1 -- 172.21.15.78:0/61071253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66000ba50 con 0x7fb670154140 2023-08-17T17:49:50.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb66e7fc700 1 -- 172.21.15.78:0/61071253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66000bdd0 con 0x7fb670154140 2023-08-17T17:49:50.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb67610a700 1 -- 172.21.15.78:0/61071253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 msgr2=0x7fb6700c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.975+0000 7fb67610a700 1 --2- 172.21.15.78:0/61071253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 0x7fb6700c6ee0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fb67006bd60 tx=0x7fb660009840).stop 2023-08-17T17:49:50.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.976+0000 7fb67610a700 1 -- 172.21.15.78:0/61071253 shutdown_connections 2023-08-17T17:49:50.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.976+0000 7fb67610a700 1 --2- 172.21.15.78:0/61071253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 0x7fb6700c6ee0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.976+0000 7fb67610a700 1 --2- 172.21.15.78:0/61071253 >> v2:172.21.15.150:3300/0 conn(0x7fb6700a8080 0x7fb6700c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.976+0000 7fb67610a700 1 --2- 172.21.15.78:0/61071253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 0x7fb6700c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.976+0000 7fb67610a700 1 -- 172.21.15.78:0/61071253 >> 172.21.15.78:0/61071253 conn(0x7fb670094510 msgr2=0x7fb67006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.976+0000 7fb67610a700 1 -- 172.21.15.78:0/61071253 shutdown_connections 2023-08-17T17:49:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.976+0000 7fb67610a700 1 -- 172.21.15.78:0/61071253 wait complete. 2023-08-17T17:49:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.977+0000 7fb67610a700 1 Processor -- start 2023-08-17T17:49:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.977+0000 7fb67610a700 1 -- start start 2023-08-17T17:49:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb67610a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 0x7fb670063b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb67610a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6700a8080 0x7fb6700ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb67610a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 0x7fb6700ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb67610a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67014e2d0 con 0x7fb670154140 2023-08-17T17:49:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb67610a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670153400 con 0x7fb6700a8080 2023-08-17T17:49:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb67610a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb670151b20 con 0x7fb6700a7c40 2023-08-17T17:49:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 0x7fb6700ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 0x7fb6700ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44866/0 (socket says 172.21.15.78:44866) 2023-08-17T17:49:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66ffff700 1 -- 172.21.15.78:0/523698621 learned_addr learned my addr 172.21.15.78:0/523698621 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:50.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66effd700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6700a8080 0x7fb6700ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66f7fe700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 0x7fb670063b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66ffff700 1 -- 172.21.15.78:0/523698621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 msgr2=0x7fb670063b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66ffff700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 0x7fb670063b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66ffff700 1 -- 172.21.15.78:0/523698621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6700a8080 msgr2=0x7fb6700ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:50.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66ffff700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6700a8080 0x7fb6700ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:50.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66ffff700 1 -- 172.21.15.78:0/523698621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660009ae0 con 0x7fb670154140 2023-08-17T17:49:50.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66f7fe700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 0x7fb670063b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:50.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb66ffff700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 0x7fb6700ae330 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fb66800d670 tx=0x7fb668008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb6577fe700 1 -- 172.21.15.78:0/523698621 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668011590 con 0x7fb670154140 2023-08-17T17:49:50.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb6577fe700 1 -- 172.21.15.78:0/523698621 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6680116f0 con 0x7fb670154140 2023-08-17T17:49:50.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb67610a700 1 -- 172.21.15.78:0/523698621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb670153120 con 0x7fb670154140 2023-08-17T17:49:50.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb6577fe700 1 -- 172.21.15.78:0/523698621 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668011a70 con 0x7fb670154140 2023-08-17T17:49:50.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.978+0000 7fb67610a700 1 -- 172.21.15.78:0/523698621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6701517b0 con 0x7fb670154140 2023-08-17T17:49:50.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.979+0000 7fb67610a700 1 -- 172.21.15.78:0/523698621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb670151cd0 con 0x7fb670154140 2023-08-17T17:49:50.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.980+0000 7fb6577fe700 1 -- 172.21.15.78:0/523698621 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb66801c460 con 0x7fb670154140 2023-08-17T17:49:50.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.980+0000 7fb6577fe700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb65c05ed90 0x7fb65c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:50.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.980+0000 7fb6577fe700 1 -- 172.21.15.78:0/523698621 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb668079620 con 0x7fb670154140 2023-08-17T17:49:50.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.980+0000 7fb66f7fe700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb65c05ed90 0x7fb65c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:50.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.980+0000 7fb66f7fe700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb65c05ed90 0x7fb65c061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb66000ba20 tx=0x7fb660009840).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:50.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:50.984+0000 7fb6577fe700 1 -- 172.21.15.78:0/523698621 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb670151cd0 con 0x7fb670154140 2023-08-17T17:49:51.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.150+0000 7fb67610a700 1 -- 172.21.15.78:0/523698621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb670151cd0 con 0x7fb670154140 2023-08-17T17:49:51.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.150+0000 7fb6577fe700 1 -- 172.21.15.78:0/523698621 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v87) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb670151cd0 con 0x7fb670154140 2023-08-17T17:49:51.152 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:51.152 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:49:51.152 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:51.152 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T17:49:51.153 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T17:49:51.153 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:49:51.153 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:49:51.153 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T17:49:51.153 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T17:49:51.153 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:49:51.153 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:49:51.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 -- 172.21.15.78:0/523698621 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb65c05ed90 msgr2=0x7fb65c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:51.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb65c05ed90 0x7fb65c061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb66000ba20 tx=0x7fb660009840).stop 2023-08-17T17:49:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 -- 172.21.15.78:0/523698621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 msgr2=0x7fb6700ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 0x7fb6700ae330 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fb66800d670 tx=0x7fb668008040).stop 2023-08-17T17:49:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 -- 172.21.15.78:0/523698621 shutdown_connections 2023-08-17T17:49:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb65c05ed90 0x7fb65c061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb670154140 0x7fb6700ae330 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6700a7c40 0x7fb670063b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 --2- 172.21.15.78:0/523698621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6700a8080 0x7fb6700ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 -- 172.21.15.78:0/523698621 >> 172.21.15.78:0/523698621 conn(0x7fb670094510 msgr2=0x7fb670150950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 -- 172.21.15.78:0/523698621 shutdown_connections 2023-08-17T17:49:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.153+0000 7fb67610a700 1 -- 172.21.15.78:0/523698621 wait complete. 2023-08-17T17:49:51.166 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T17:49:51.166 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T17:49:51.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.283+0000 7ff19eed6700 1 Processor -- start 2023-08-17T17:49:51.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.283+0000 7ff19eed6700 1 -- start start 2023-08-17T17:49:51.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.284+0000 7ff19eed6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff1980aa0f0 0x7ff1980644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:51.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.284+0000 7ff19eed6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff1980c5810 0x7ff1980c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:51.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.284+0000 7ff19eed6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980649b0 con 0x7ff1980aa4d0 2023-08-17T17:49:51.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.284+0000 7ff19eed6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1980c6170 con 0x7ff1980c5810 2023-08-17T17:49:51.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.284+0000 7ff19eed6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff198063420 con 0x7ff1980aa0f0 2023-08-17T17:49:51.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.284+0000 7ff19d473700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff1980c5810 0x7ff1980c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:51.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.284+0000 7ff18ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff1980aa4d0 0x7ff1980c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44594/0 (socket says 172.21.15.78:44594) 2023-08-17T17:49:51.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.284+0000 7ff18ffff700 1 -- 172.21.15.78:0/4029813318 learned_addr learned my addr 172.21.15.78:0/4029813318 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:51.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.284+0000 7ff19d473700 1 -- 172.21.15.78:0/4029813318 >> v2:172.21.15.150:3300/0 conn(0x7ff1980aa0f0 msgr2=0x7ff1980644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:51.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.284+0000 7ff19cc72700 1 --2- 172.21.15.78:0/4029813318 >> v2:172.21.15.150:3300/0 conn(0x7ff1980aa0f0 0x7ff1980644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:51.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19d473700 1 --2- 172.21.15.78:0/4029813318 >> v2:172.21.15.150:3300/0 conn(0x7ff1980aa0f0 0x7ff1980644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:51.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19d473700 1 -- 172.21.15.78:0/4029813318 >> v1:172.21.15.78:6789/0 conn(0x7ff1980aa4d0 legacy=0x7ff1980c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:51.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff18f7fe700 1 -- 172.21.15.78:0/4029813318 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609835131 0 0) 0x7ff1980649b0 con 0x7ff1980aa4d0 2023-08-17T17:49:51.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19d473700 1 -- 172.21.15.78:0/4029813318 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff198063700 con 0x7ff1980c5810 2023-08-17T17:49:51.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19d473700 1 --2- 172.21.15.78:0/4029813318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980c5810 0x7ff1980c5c80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7ff1980cade0 tx=0x7ff190009780).ready entity=mon.0 client_cookie=ab317e78d008f51f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:51.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff18f7fe700 1 -- 172.21.15.78:0/4029813318 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000e070 con 0x7ff1980c5810 2023-08-17T17:49:51.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff18f7fe700 1 -- 172.21.15.78:0/4029813318 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19000bc30 con 0x7ff1980c5810 2023-08-17T17:49:51.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff18f7fe700 1 -- 172.21.15.78:0/4029813318 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190012410 con 0x7ff1980c5810 2023-08-17T17:49:51.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19eed6700 1 -- 172.21.15.78:0/4029813318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980c5810 msgr2=0x7ff1980c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:51.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19eed6700 1 --2- 172.21.15.78:0/4029813318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980c5810 0x7ff1980c5c80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7ff1980cade0 tx=0x7ff190009780).stop 2023-08-17T17:49:51.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19eed6700 1 -- 172.21.15.78:0/4029813318 shutdown_connections 2023-08-17T17:49:51.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19eed6700 1 --2- 172.21.15.78:0/4029813318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980c5810 0x7ff1980c5c80 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:51.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19eed6700 1 --2- 172.21.15.78:0/4029813318 >> v2:172.21.15.150:3300/0 conn(0x7ff1980aa0f0 0x7ff1980644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:51.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19eed6700 1 -- 172.21.15.78:0/4029813318 >> 172.21.15.78:0/4029813318 conn(0x7ff19806a6a0 msgr2=0x7ff1980caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:51.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19eed6700 1 -- 172.21.15.78:0/4029813318 shutdown_connections 2023-08-17T17:49:51.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.285+0000 7ff19eed6700 1 -- 172.21.15.78:0/4029813318 wait complete. 2023-08-17T17:49:51.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.286+0000 7ff19eed6700 1 Processor -- start 2023-08-17T17:49:51.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.287+0000 7ff19eed6700 1 -- start start 2023-08-17T17:49:51.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.287+0000 7ff19eed6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980aa0f0 0x7ff198158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:51.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.287+0000 7ff19eed6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1980aa4d0 0x7ff198151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:51.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.287+0000 7ff19eed6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1980c5810 0x7ff1980af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:51.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.287+0000 7ff19eed6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980c1ac0 con 0x7ff1980aa0f0 2023-08-17T17:49:51.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.287+0000 7ff19eed6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980c2920 con 0x7ff1980c5810 2023-08-17T17:49:51.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.287+0000 7ff19eed6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff198158960 con 0x7ff1980aa4d0 2023-08-17T17:49:51.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19cc72700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980aa0f0 0x7ff198158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:51.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19cc72700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980aa0f0 0x7ff198158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44884/0 (socket says 172.21.15.78:44884) 2023-08-17T17:49:51.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19cc72700 1 -- 172.21.15.78:0/523961610 learned_addr learned my addr 172.21.15.78:0/523961610 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:51.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff18ffff700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1980aa4d0 0x7ff198151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:51.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19d473700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1980c5810 0x7ff1980af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:51.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19cc72700 1 -- 172.21.15.78:0/523961610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1980aa4d0 msgr2=0x7ff198151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:51.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19cc72700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1980aa4d0 0x7ff198151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:51.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19cc72700 1 -- 172.21.15.78:0/523961610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1980c5810 msgr2=0x7ff1980af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:51.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19cc72700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1980c5810 0x7ff1980af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:51.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19cc72700 1 -- 172.21.15.78:0/523961610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190009a20 con 0x7ff1980aa0f0 2023-08-17T17:49:51.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19d473700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1980c5810 0x7ff1980af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:51.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff18ffff700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1980aa4d0 0x7ff198151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:51.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19cc72700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980aa0f0 0x7ff198158470 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7ff19400c880 tx=0x7ff194008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:51.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff18cff9700 1 -- 172.21.15.78:0/523961610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194010580 con 0x7ff1980aa0f0 2023-08-17T17:49:51.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff18cff9700 1 -- 172.21.15.78:0/523961610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1940106e0 con 0x7ff1980aa0f0 2023-08-17T17:49:51.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19eed6700 1 -- 172.21.15.78:0/523961610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1980c1d10 con 0x7ff1980aa0f0 2023-08-17T17:49:51.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff18cff9700 1 -- 172.21.15.78:0/523961610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194010a60 con 0x7ff1980aa0f0 2023-08-17T17:49:51.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.288+0000 7ff19eed6700 1 -- 172.21.15.78:0/523961610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1980c22d0 con 0x7ff1980aa0f0 2023-08-17T17:49:51.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.289+0000 7ff19eed6700 1 -- 172.21.15.78:0/523961610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff198083980 con 0x7ff1980aa0f0 2023-08-17T17:49:51.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.289+0000 7ff18cff9700 1 -- 172.21.15.78:0/523961610 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff19401b460 con 0x7ff1980aa0f0 2023-08-17T17:49:51.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.290+0000 7ff18cff9700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 0x7ff184061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:51.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.290+0000 7ff18cff9700 1 -- 172.21.15.78:0/523961610 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff1940798a0 con 0x7ff1980aa0f0 2023-08-17T17:49:51.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.290+0000 7ff18ffff700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 0x7ff184061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:51.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.290+0000 7ff18ffff700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 0x7ff184061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff1980b0ba0 tx=0x7ff188009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:51.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.294+0000 7ff18cff9700 1 -- 172.21.15.78:0/523961610 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff19404b130 con 0x7ff1980aa0f0 2023-08-17T17:49:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:51.461+0000 7ff19eed6700 1 -- 172.21.15.78:0/523961610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7ff1980a80a0 con 0x7ff1980aa0f0 2023-08-17T17:49:52.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.236+0000 7ff18cff9700 1 -- 172.21.15.78:0/523961610 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v88) v1 ==== 152+0+0 (secure 0 0 0) 0x7ff1980a80a0 con 0x7ff1980aa0f0 2023-08-17T17:49:52.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.238+0000 7ff19eed6700 1 -- 172.21.15.78:0/523961610 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 msgr2=0x7ff184061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:52.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.238+0000 7ff19eed6700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 0x7ff184061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff1980b0ba0 tx=0x7ff188009040).stop 2023-08-17T17:49:52.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.238+0000 7ff19eed6700 1 -- 172.21.15.78:0/523961610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980aa0f0 msgr2=0x7ff198158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:52.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.238+0000 7ff19eed6700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980aa0f0 0x7ff198158470 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7ff19400c880 tx=0x7ff194008040).stop 2023-08-17T17:49:52.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.238+0000 7ff19eed6700 1 -- 172.21.15.78:0/523961610 shutdown_connections 2023-08-17T17:49:52.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.238+0000 7ff19eed6700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 0x7ff184061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:52.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.238+0000 7ff19eed6700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1980c5810 0x7ff1980af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:52.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.238+0000 7ff19eed6700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1980aa0f0 0x7ff198158470 secure :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0x7ff19400c880 tx=0x7ff194008040).stop 2023-08-17T17:49:52.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.238+0000 7ff19eed6700 1 --2- 172.21.15.78:0/523961610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1980aa4d0 0x7ff198151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:52.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.238+0000 7ff19eed6700 1 -- 172.21.15.78:0/523961610 >> 172.21.15.78:0/523961610 conn(0x7ff19806a6a0 msgr2=0x7ff198152bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:52.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.240+0000 7ff19eed6700 1 -- 172.21.15.78:0/523961610 shutdown_connections 2023-08-17T17:49:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.240+0000 7ff19eed6700 1 -- 172.21.15.78:0/523961610 wait complete. 2023-08-17T17:49:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T17:49:52.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T17:49:52.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.375+0000 7f46e6666700 1 Processor -- start 2023-08-17T17:49:52.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.375+0000 7f46e6666700 1 -- start start 2023-08-17T17:49:52.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46e6666700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f46e0154110 0x7f46e00c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:52.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46e6666700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f46e00c0cf0 0x7f46e00c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:52.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46e6666700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e00ca430 0x7f46e00c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:52.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46e6666700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e00c6970 con 0x7f46e0154110 2023-08-17T17:49:52.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46e6666700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e00c1150 con 0x7f46e00c0cf0 2023-08-17T17:49:52.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46e6666700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e00cac90 con 0x7f46e00ca430 2023-08-17T17:49:52.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46dffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f46e0154110 0x7f46e00c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:52.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46dffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f46e0154110 0x7f46e00c0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44888/0 (socket says 172.21.15.78:44888) 2023-08-17T17:49:52.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46dffff700 1 -- 172.21.15.78:0/4174691999 learned_addr learned my addr 172.21.15.78:0/4174691999 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:52.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46df7fe700 1 --2- 172.21.15.78:0/4174691999 >> v2:172.21.15.150:3300/0 conn(0x7f46e00c0cf0 0x7f46e00c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:52.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46e4c03700 1 --2- 172.21.15.78:0/4174691999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e00ca430 0x7f46e00c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:52.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46dffff700 1 -- 172.21.15.78:0/4174691999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e00ca430 msgr2=0x7f46e00c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:52.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46dffff700 1 --2- 172.21.15.78:0/4174691999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e00ca430 0x7f46e00c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:52.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46dffff700 1 -- 172.21.15.78:0/4174691999 >> v2:172.21.15.150:3300/0 conn(0x7f46e00c0cf0 msgr2=0x7f46e00c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:52.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46dffff700 1 --2- 172.21.15.78:0/4174691999 >> v2:172.21.15.150:3300/0 conn(0x7f46e00c0cf0 0x7f46e00c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:52.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46dffff700 1 -- 172.21.15.78:0/4174691999 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e00c6040 con 0x7f46e0154110 2023-08-17T17:49:52.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.376+0000 7f46dffff700 1 --2- 172.21.15.78:0/4174691999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e0154110 0x7f46e00c0800 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f46e00c0520 tx=0x7f46d00090f0).ready entity=mon.0 client_cookie=c1d9b5ee710ab820 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:52.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46deffd700 1 -- 172.21.15.78:0/4174691999 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000b600 con 0x7f46e0154110 2023-08-17T17:49:52.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46deffd700 1 -- 172.21.15.78:0/4174691999 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d000b760 con 0x7f46e0154110 2023-08-17T17:49:52.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46deffd700 1 -- 172.21.15.78:0/4174691999 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000bae0 con 0x7f46e0154110 2023-08-17T17:49:52.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46e6666700 1 -- 172.21.15.78:0/4174691999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e0154110 msgr2=0x7f46e00c0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:52.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46e6666700 1 --2- 172.21.15.78:0/4174691999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e0154110 0x7f46e00c0800 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f46e00c0520 tx=0x7f46d00090f0).stop 2023-08-17T17:49:52.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46e6666700 1 -- 172.21.15.78:0/4174691999 shutdown_connections 2023-08-17T17:49:52.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46e6666700 1 --2- 172.21.15.78:0/4174691999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e0154110 0x7f46e00c0800 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:52.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46e6666700 1 --2- 172.21.15.78:0/4174691999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e00ca430 0x7f46e00c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:52.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46e6666700 1 --2- 172.21.15.78:0/4174691999 >> v2:172.21.15.150:3300/0 conn(0x7f46e00c0cf0 0x7f46e00c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:52.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46e6666700 1 -- 172.21.15.78:0/4174691999 >> 172.21.15.78:0/4174691999 conn(0x7f46e0094650 msgr2=0x7f46e006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:52.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46e6666700 1 -- 172.21.15.78:0/4174691999 shutdown_connections 2023-08-17T17:49:52.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.377+0000 7f46e6666700 1 -- 172.21.15.78:0/4174691999 wait complete. 2023-08-17T17:49:52.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.378+0000 7f46e6666700 1 Processor -- start 2023-08-17T17:49:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.378+0000 7f46e6666700 1 -- start start 2023-08-17T17:49:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.379+0000 7f46e6666700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e00c0cf0 0x7f46e00a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.379+0000 7f46e6666700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e00ca430 0x7f46e00a8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.379+0000 7f46e6666700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e0154110 0x7f46e0095030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.379+0000 7f46e6666700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e00a86f0 con 0x7f46e00ca430 2023-08-17T17:49:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.379+0000 7f46e6666700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0095d80 con 0x7f46e00c0cf0 2023-08-17T17:49:52.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.379+0000 7f46e6666700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0096060 con 0x7f46e0154110 2023-08-17T17:49:52.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.379+0000 7f46df7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e00ca430 0x7f46e00a8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:52.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.379+0000 7f46df7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e00ca430 0x7f46e00a8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44894/0 (socket says 172.21.15.78:44894) 2023-08-17T17:49:52.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.379+0000 7f46df7fe700 1 -- 172.21.15.78:0/2063107873 learned_addr learned my addr 172.21.15.78:0/2063107873 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:52.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46dffff700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e00c0cf0 0x7f46e00a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:52.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46e4c03700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e0154110 0x7f46e0095030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:52.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46df7fe700 1 -- 172.21.15.78:0/2063107873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e0154110 msgr2=0x7f46e0095030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:52.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46df7fe700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e0154110 0x7f46e0095030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:52.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46df7fe700 1 -- 172.21.15.78:0/2063107873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e00c0cf0 msgr2=0x7f46e00a7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:52.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46df7fe700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e00c0cf0 0x7f46e00a7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:52.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46df7fe700 1 -- 172.21.15.78:0/2063107873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d0009370 con 0x7f46e00ca430 2023-08-17T17:49:52.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46dffff700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e00c0cf0 0x7f46e00a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:52.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46e4c03700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e0154110 0x7f46e0095030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:52.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46df7fe700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e00ca430 0x7f46e00a8200 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f46d400d890 tx=0x7f46d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:52.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46c7fff700 1 -- 172.21.15.78:0/2063107873 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d40125f0 con 0x7f46e00ca430 2023-08-17T17:49:52.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46c7fff700 1 -- 172.21.15.78:0/2063107873 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d4012750 con 0x7f46e00ca430 2023-08-17T17:49:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46e6666700 1 -- 172.21.15.78:0/2063107873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e0096340 con 0x7f46e00ca430 2023-08-17T17:49:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46c7fff700 1 -- 172.21.15.78:0/2063107873 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4012ad0 con 0x7f46e00ca430 2023-08-17T17:49:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.380+0000 7f46e6666700 1 -- 172.21.15.78:0/2063107873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e0095520 con 0x7f46e00ca430 2023-08-17T17:49:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.381+0000 7f46e6666700 1 -- 172.21.15.78:0/2063107873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e0047350 con 0x7f46e00ca430 2023-08-17T17:49:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.381+0000 7f46c7fff700 1 -- 172.21.15.78:0/2063107873 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f46d4013480 con 0x7f46e00ca430 2023-08-17T17:49:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.382+0000 7f46c7fff700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f46cc05ed90 0x7f46cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:52.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.382+0000 7f46c7fff700 1 -- 172.21.15.78:0/2063107873 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f46d4079880 con 0x7f46e00ca430 2023-08-17T17:49:52.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.382+0000 7f46dffff700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f46cc05ed90 0x7f46cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:52.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.382+0000 7f46dffff700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f46cc05ed90 0x7f46cc061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f46d0009fd0 tx=0x7f46d0017000).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:52.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.386+0000 7f46c7fff700 1 -- 172.21.15.78:0/2063107873 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46d404b020 con 0x7f46e00ca430 2023-08-17T17:49:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:52.550+0000 7f46e6666700 1 -- 172.21.15.78:0/2063107873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f46e00c6320 con 0x7f46e00ca430 2023-08-17T17:49:53.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.243+0000 7f46c7fff700 1 -- 172.21.15.78:0/2063107873 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v89) v1 ==== 170+0+0 (secure 0 0 0) 0x7f46d404e640 con 0x7f46e00ca430 2023-08-17T17:49:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.251+0000 7f46e6666700 1 -- 172.21.15.78:0/2063107873 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f46cc05ed90 msgr2=0x7f46cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.251+0000 7f46e6666700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f46cc05ed90 0x7f46cc061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f46d0009fd0 tx=0x7f46d0017000).stop 2023-08-17T17:49:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.251+0000 7f46e6666700 1 -- 172.21.15.78:0/2063107873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e00ca430 msgr2=0x7f46e00a8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.251+0000 7f46e6666700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e00ca430 0x7f46e00a8200 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f46d400d890 tx=0x7f46d4008040).stop 2023-08-17T17:49:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.251+0000 7f46e6666700 1 -- 172.21.15.78:0/2063107873 shutdown_connections 2023-08-17T17:49:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.251+0000 7f46e6666700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f46cc05ed90 0x7f46cc061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.251+0000 7f46e6666700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46e0154110 0x7f46e0095030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.251+0000 7f46e6666700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e00c0cf0 0x7f46e00a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.251+0000 7f46e6666700 1 --2- 172.21.15.78:0/2063107873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e00ca430 0x7f46e00a8200 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.251+0000 7f46e6666700 1 -- 172.21.15.78:0/2063107873 >> 172.21.15.78:0/2063107873 conn(0x7f46e0094650 msgr2=0x7f46e00c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.252+0000 7f46e6666700 1 -- 172.21.15.78:0/2063107873 shutdown_connections 2023-08-17T17:49:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.252+0000 7f46e6666700 1 -- 172.21.15.78:0/2063107873 wait complete. 2023-08-17T17:49:53.259 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T17:49:53.277 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T17:49:53.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.391+0000 7fed4759e700 1 Processor -- start 2023-08-17T17:49:53.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.391+0000 7fed4759e700 1 -- start start 2023-08-17T17:49:53.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fed48151e20 0x7fed480c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4759e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480c6620 con 0x7fed48157be0 2023-08-17T17:49:53.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480c6900 con 0x7fed48151a40 2023-08-17T17:49:53.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed480c6be0 con 0x7fed48151e20 2023-08-17T17:49:53.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed46d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fed48157be0 0x7fed480c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44610/0 (socket says 172.21.15.78:44610) 2023-08-17T17:49:53.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed46d9d700 1 -- 172.21.15.78:0/3333591492 learned_addr learned my addr 172.21.15.78:0/3333591492 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:53.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed45d9b700 1 --2- 172.21.15.78:0/3333591492 >> v2:172.21.15.150:3300/0 conn(0x7fed48151e20 0x7fed480c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891975084 0 0) 0x7fed480c6620 con 0x7fed48157be0 2023-08-17T17:49:53.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed300033f0 con 0x7fed48157be0 2023-08-17T17:49:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 808065950 0 0) 0x7fed300033f0 con 0x7fed48157be0 2023-08-17T17:49:53.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 >> v2:172.21.15.150:3300/0 conn(0x7fed48151e20 msgr2=0x7fed480c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:53.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4559a700 1 --2- 172.21.15.78:0/3333591492 >> v2:172.21.15.150:3300/0 conn(0x7fed48151e20 0x7fed480c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 >> v1:172.21.15.150:6789/0 conn(0x7fed48151a40 legacy=0x7fed480c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480c6ec0 con 0x7fed48157be0 2023-08-17T17:49:53.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.392+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fed400017f0 con 0x7fed48157be0 2023-08-17T17:49:53.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 >> v1:172.21.15.78:6789/0 conn(0x7fed48157be0 legacy=0x7fed480c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4559a700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed300038e0 0x7fed30003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4559a700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed30004690 0x7fed30004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4559a700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed30005000 0x7fed3000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480c6be0 con 0x7fed30004690 2023-08-17T17:49:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3000be00 con 0x7fed30005000 2023-08-17T17:49:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3000bfc0 con 0x7fed300038e0 2023-08-17T17:49:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed45d9b700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed30004690 0x7fed30004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4659c700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed300038e0 0x7fed30003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed46d9d700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed30005000 0x7fed3000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed45d9b700 1 -- 172.21.15.78:0/3333591492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed300038e0 msgr2=0x7fed30003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:53.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed45d9b700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed300038e0 0x7fed30003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed45d9b700 1 -- 172.21.15.78:0/3333591492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed30005000 msgr2=0x7fed3000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:53.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed45d9b700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed30005000 0x7fed3000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed45d9b700 1 -- 172.21.15.78:0/3333591492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed300033f0 con 0x7fed30004690 2023-08-17T17:49:53.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed46d9d700 1 -- 172.21.15.78:0/3333591492 reap_dead start 2023-08-17T17:49:53.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed45d9b700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed30004690 0x7fed30004b10 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fed3c006fd0 tx=0x7fed3c006f40).ready entity=mon.0 client_cookie=5cbbae9f589d7e53 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:53.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c009430 con 0x7fed30004690 2023-08-17T17:49:53.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c00e640 con 0x7fed30004690 2023-08-17T17:49:53.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.393+0000 7fed4559a700 1 -- 172.21.15.78:0/3333591492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00e9c0 con 0x7fed30004690 2023-08-17T17:49:53.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.394+0000 7fed4759e700 1 -- 172.21.15.78:0/3333591492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed30004690 msgr2=0x7fed30004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.394+0000 7fed4759e700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed30004690 0x7fed30004b10 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fed3c006fd0 tx=0x7fed3c006f40).stop 2023-08-17T17:49:53.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.394+0000 7fed4759e700 1 -- 172.21.15.78:0/3333591492 shutdown_connections 2023-08-17T17:49:53.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.394+0000 7fed4759e700 1 --2- 172.21.15.78:0/3333591492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed30004690 0x7fed30004b10 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.394+0000 7fed4759e700 1 -- 172.21.15.78:0/3333591492 >> 172.21.15.78:0/3333591492 conn(0x7fed480943b0 msgr2=0x7fed4806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:53.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.394+0000 7fed4759e700 1 -- 172.21.15.78:0/3333591492 shutdown_connections 2023-08-17T17:49:53.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.394+0000 7fed4759e700 1 -- 172.21.15.78:0/3333591492 wait complete. 2023-08-17T17:49:53.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.395+0000 7fed4759e700 1 Processor -- start 2023-08-17T17:49:53.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.395+0000 7fed4759e700 1 -- start start 2023-08-17T17:49:53.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed4759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed30004690 0x7fed480ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed4759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed480b05b0 0x7fed48164750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed4759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed48164c40 0x7fed48157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed4759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed481650c0 con 0x7fed480b05b0 2023-08-17T17:49:53.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed4759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480ad3a0 con 0x7fed48164c40 2023-08-17T17:49:53.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed4759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed48165610 con 0x7fed30004690 2023-08-17T17:49:53.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed45d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed480b05b0 0x7fed48164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed45d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed480b05b0 0x7fed48164750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44904/0 (socket says 172.21.15.78:44904) 2023-08-17T17:49:53.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed45d9b700 1 -- 172.21.15.78:0/2292702912 learned_addr learned my addr 172.21.15.78:0/2292702912 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:53.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed4659c700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed30004690 0x7fed480ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed46d9d700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed48164c40 0x7fed48157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed45d9b700 1 -- 172.21.15.78:0/2292702912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed30004690 msgr2=0x7fed480ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed45d9b700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed30004690 0x7fed480ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed45d9b700 1 -- 172.21.15.78:0/2292702912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed48164c40 msgr2=0x7fed48157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed45d9b700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed48164c40 0x7fed48157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed45d9b700 1 -- 172.21.15.78:0/2292702912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed48165330 con 0x7fed480b05b0 2023-08-17T17:49:53.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed45d9b700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed480b05b0 0x7fed48164750 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fed3000bdd0 tx=0x7fed3c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:53.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed367fc700 1 -- 172.21.15.78:0/2292702912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00ed70 con 0x7fed480b05b0 2023-08-17T17:49:53.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed367fc700 1 -- 172.21.15.78:0/2292702912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c00eed0 con 0x7fed480b05b0 2023-08-17T17:49:53.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed4759e700 1 -- 172.21.15.78:0/2292702912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed480ab650 con 0x7fed480b05b0 2023-08-17T17:49:53.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed367fc700 1 -- 172.21.15.78:0/2292702912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00e9e0 con 0x7fed480b05b0 2023-08-17T17:49:53.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.396+0000 7fed4759e700 1 -- 172.21.15.78:0/2292702912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed480abc10 con 0x7fed480b05b0 2023-08-17T17:49:53.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.397+0000 7fed4759e700 1 -- 172.21.15.78:0/2292702912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed48082f90 con 0x7fed480b05b0 2023-08-17T17:49:53.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.398+0000 7fed367fc700 1 -- 172.21.15.78:0/2292702912 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fed3c02c020 con 0x7fed480b05b0 2023-08-17T17:49:53.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.398+0000 7fed367fc700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed2805edc0 0x7fed28061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.398+0000 7fed367fc700 1 -- 172.21.15.78:0/2292702912 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fed3c07b660 con 0x7fed480b05b0 2023-08-17T17:49:53.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.398+0000 7fed4659c700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed2805edc0 0x7fed28061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.399+0000 7fed4659c700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed2805edc0 0x7fed28061280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fed38007fd0 tx=0x7fed38007c00).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:53.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.402+0000 7fed367fc700 1 -- 172.21.15.78:0/2292702912 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed3c04cc60 con 0x7fed480b05b0 2023-08-17T17:49:53.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.606+0000 7fed4759e700 1 -- 172.21.15.78:0/2292702912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fed4805f910 con 0x7fed480b05b0 2023-08-17T17:49:53.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.614+0000 7fed367fc700 1 -- 172.21.15.78:0/2292702912 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v29) v1 ==== 174+0+0 (secure 0 0 0) 0x7fed3c016020 con 0x7fed480b05b0 2023-08-17T17:49:53.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.619+0000 7fed4759e700 1 -- 172.21.15.78:0/2292702912 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed2805edc0 msgr2=0x7fed28061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.619+0000 7fed4759e700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed2805edc0 0x7fed28061280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fed38007fd0 tx=0x7fed38007c00).stop 2023-08-17T17:49:53.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.619+0000 7fed4759e700 1 -- 172.21.15.78:0/2292702912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed480b05b0 msgr2=0x7fed48164750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.619+0000 7fed4759e700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed480b05b0 0x7fed48164750 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fed3000bdd0 tx=0x7fed3c01a000).stop 2023-08-17T17:49:53.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.619+0000 7fed4759e700 1 -- 172.21.15.78:0/2292702912 shutdown_connections 2023-08-17T17:49:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.619+0000 7fed4759e700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fed2805edc0 0x7fed28061280 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.619+0000 7fed4759e700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed48164c40 0x7fed48157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.619+0000 7fed4759e700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed30004690 0x7fed480ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.619+0000 7fed4759e700 1 --2- 172.21.15.78:0/2292702912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed480b05b0 0x7fed48164750 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.620+0000 7fed4759e700 1 -- 172.21.15.78:0/2292702912 >> 172.21.15.78:0/2292702912 conn(0x7fed480943b0 msgr2=0x7fed4814b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.620+0000 7fed4759e700 1 -- 172.21.15.78:0/2292702912 shutdown_connections 2023-08-17T17:49:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.620+0000 7fed4759e700 1 -- 172.21.15.78:0/2292702912 wait complete. 2023-08-17T17:49:53.627 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 11 and data pool 12 2023-08-17T17:49:53.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.755+0000 7f28a366f700 1 Processor -- start 2023-08-17T17:49:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.755+0000 7f28a366f700 1 -- start start 2023-08-17T17:49:53.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.756+0000 7f28a366f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c13a640 0x7f289c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.756+0000 7f28a366f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c0c2c10 con 0x7f289c069760 2023-08-17T17:49:53.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.756+0000 7f28a366f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c155010 con 0x7f289c06a2c0 2023-08-17T17:49:53.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.756+0000 7f28a366f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c1552e0 con 0x7f289c13a640 2023-08-17T17:49:53.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.756+0000 7f28a1c0c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f289c069760 0x7f289c0c33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44622/0 (socket says 172.21.15.78:44622) 2023-08-17T17:49:53.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.756+0000 7f28a1c0c700 1 -- 172.21.15.78:0/859565403 learned_addr learned my addr 172.21.15.78:0/859565403 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:53.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f28a140b700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c13a640 0x7f289c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556786598 0 0) 0x7f289c0c2c10 con 0x7f289c069760 2023-08-17T17:49:53.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28880033f0 con 0x7f289c069760 2023-08-17T17:49:53.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405517545 0 0) 0x7f289c155010 con 0x7f289c06a2c0 2023-08-17T17:49:53.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f289c0c2c10 con 0x7f289c06a2c0 2023-08-17T17:49:53.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 993794378 0 0) 0x7f28880033f0 con 0x7f289c069760 2023-08-17T17:49:53.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c13a640 msgr2=0x7f289c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:53.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c13a640 0x7f289c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 >> v1:172.21.15.150:6789/0 conn(0x7f289c06a2c0 legacy=0x7f289c069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c1555c0 con 0x7f289c069760 2023-08-17T17:49:53.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f2894001470 con 0x7f289c069760 2023-08-17T17:49:53.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 >> v1:172.21.15.78:6789/0 conn(0x7f289c069760 legacy=0x7f289c0c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2888003aa0 0x7f2888003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2888004690 0x7f2888004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c13a640 0x7f2888005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c1552e0 con 0x7f2888004690 2023-08-17T17:49:53.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288800b990 con 0x7f2888003aa0 2023-08-17T17:49:53.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288800bb20 con 0x7f289c13a640 2023-08-17T17:49:53.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f28a0c0a700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2888004690 0x7f2888004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f28a140b700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2888003aa0 0x7f2888003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f28a1c0c700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c13a640 0x7f2888005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f28a0c0a700 1 -- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c13a640 msgr2=0x7f2888005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:53.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f28a0c0a700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c13a640 0x7f2888005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f28a0c0a700 1 -- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2888003aa0 msgr2=0x7f2888003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:53.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f28a0c0a700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2888003aa0 0x7f2888003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f28a0c0a700 1 -- 172.21.15.78:0/859565403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880033f0 con 0x7f2888004690 2023-08-17T17:49:53.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.757+0000 7f28a1c0c700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c13a640 0x7f2888005020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:53.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f28a0c0a700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2888004690 0x7f2888004b10 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f288c001890 tx=0x7f288c007bb0).ready entity=mon.0 client_cookie=b56a0d8a359890d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:53.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c007020 con 0x7f2888004690 2023-08-17T17:49:53.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c007180 con 0x7f2888004690 2023-08-17T17:49:53.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f2893fff700 1 -- 172.21.15.78:0/859565403 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c007500 con 0x7f2888004690 2023-08-17T17:49:53.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f28a366f700 1 -- 172.21.15.78:0/859565403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2888004690 msgr2=0x7f2888004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f28a366f700 1 --2- 172.21.15.78:0/859565403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2888004690 0x7f2888004b10 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f288c001890 tx=0x7f288c007bb0).stop 2023-08-17T17:49:53.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f28a1c0c700 1 -- 172.21.15.78:0/859565403 reap_dead start 2023-08-17T17:49:53.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f28a366f700 1 -- 172.21.15.78:0/859565403 shutdown_connections 2023-08-17T17:49:53.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f28a366f700 1 -- 172.21.15.78:0/859565403 >> 172.21.15.78:0/859565403 conn(0x7f289c0c7b00 msgr2=0x7f289c0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:53.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f28a366f700 1 -- 172.21.15.78:0/859565403 shutdown_connections 2023-08-17T17:49:53.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.758+0000 7f28a366f700 1 -- 172.21.15.78:0/859565403 wait complete. 2023-08-17T17:49:53.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.759+0000 7f28a366f700 1 Processor -- start 2023-08-17T17:49:53.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.759+0000 7f28a366f700 1 -- start start 2023-08-17T17:49:53.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.760+0000 7f28a366f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2888004690 0x7f289c162360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.760+0000 7f28a366f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c0a7690 0x7f289c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.760+0000 7f28a366f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f289c1507b0 0x7f289c0bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.760+0000 7f28a366f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c165ad0 con 0x7f289c1507b0 2023-08-17T17:49:53.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.760+0000 7f28a366f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0a7b10 con 0x7f2888004690 2023-08-17T17:49:53.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.760+0000 7f28a366f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c162990 con 0x7f289c0a7690 2023-08-17T17:49:53.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a1c0c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f289c1507b0 0x7f289c0bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a1c0c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f289c1507b0 0x7f289c0bfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44918/0 (socket says 172.21.15.78:44918) 2023-08-17T17:49:53.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a1c0c700 1 -- 172.21.15.78:0/3801707354 learned_addr learned my addr 172.21.15.78:0/3801707354 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:53.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a140b700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2888004690 0x7f289c162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a0c0a700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c0a7690 0x7f289c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a1c0c700 1 -- 172.21.15.78:0/3801707354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c0a7690 msgr2=0x7f289c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a1c0c700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c0a7690 0x7f289c1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a1c0c700 1 -- 172.21.15.78:0/3801707354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2888004690 msgr2=0x7f289c162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a1c0c700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2888004690 0x7f289c162360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a1c0c700 1 -- 172.21.15.78:0/3801707354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c162c70 con 0x7f289c1507b0 2023-08-17T17:49:53.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a1c0c700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f289c1507b0 0x7f289c0bfda0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f289c0c88e0 tx=0x7f2894001060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:53.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28917fa700 1 -- 172.21.15.78:0/3801707354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894010450 con 0x7f289c1507b0 2023-08-17T17:49:53.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28917fa700 1 -- 172.21.15.78:0/3801707354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28940105d0 con 0x7f289c1507b0 2023-08-17T17:49:53.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a366f700 1 -- 172.21.15.78:0/3801707354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c162f50 con 0x7f289c1507b0 2023-08-17T17:49:53.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28917fa700 1 -- 172.21.15.78:0/3801707354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894010990 con 0x7f289c1507b0 2023-08-17T17:49:53.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.761+0000 7f28a366f700 1 -- 172.21.15.78:0/3801707354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c0c0290 con 0x7f289c1507b0 2023-08-17T17:49:53.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.762+0000 7f28a366f700 1 -- 172.21.15.78:0/3801707354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c047350 con 0x7f289c1507b0 2023-08-17T17:49:53.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.762+0000 7f28917fa700 1 -- 172.21.15.78:0/3801707354 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f289401a020 con 0x7f289c1507b0 2023-08-17T17:49:53.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.763+0000 7f28917fa700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f288005ed90 0x7f2880061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:53.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.763+0000 7f28917fa700 1 -- 172.21.15.78:0/3801707354 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2894079200 con 0x7f289c1507b0 2023-08-17T17:49:53.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.763+0000 7f28a140b700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f288005ed90 0x7f2880061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:53.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.763+0000 7f28a140b700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f288005ed90 0x7f2880061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f289c0adcd0 tx=0x7f289800b040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:53.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.767+0000 7f28917fa700 1 -- 172.21.15.78:0/3801707354 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f289404a7a0 con 0x7f289c1507b0 2023-08-17T17:49:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.930+0000 7f28a366f700 1 -- 172.21.15.78:0/3801707354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f289c0c5c30 con 0x7f289c1507b0 2023-08-17T17:49:53.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.931+0000 7f28917fa700 1 -- 172.21.15.78:0/3801707354 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16992 (secure 0 0 0) 0x7f289404ddc0 con 0x7f289c1507b0 2023-08-17T17:49:53.932 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:53.933 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":90,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:53.608206+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:51.485390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:52.574728+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:53.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 -- 172.21.15.78:0/3801707354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f288005ed90 msgr2=0x7f2880061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f288005ed90 0x7f2880061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f289c0adcd0 tx=0x7f289800b040).stop 2023-08-17T17:49:53.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 -- 172.21.15.78:0/3801707354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f289c1507b0 msgr2=0x7f289c0bfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:53.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f289c1507b0 0x7f289c0bfda0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f289c0c88e0 tx=0x7f2894001060).stop 2023-08-17T17:49:53.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 -- 172.21.15.78:0/3801707354 shutdown_connections 2023-08-17T17:49:53.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f288005ed90 0x7f2880061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f289c1507b0 0x7f289c0bfda0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2888004690 0x7f289c162360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 --2- 172.21.15.78:0/3801707354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f289c0a7690 0x7f289c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:53.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 -- 172.21.15.78:0/3801707354 >> 172.21.15.78:0/3801707354 conn(0x7f289c0c7b00 msgr2=0x7f289c066570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:53.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 -- 172.21.15.78:0/3801707354 shutdown_connections 2023-08-17T17:49:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:53.933+0000 7f28a366f700 1 -- 172.21.15.78:0/3801707354 wait complete. 2023-08-17T17:49:53.946 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.058+0000 7f1cecd39700 1 Processor -- start 2023-08-17T17:49:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.058+0000 7f1cecd39700 1 -- start start 2023-08-17T17:49:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.059+0000 7f1cecd39700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1ce8064180 0x7f1ce80c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.059+0000 7f1cecd39700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce80c4040 con 0x7f1ce80bef00 2023-08-17T17:49:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.059+0000 7f1cecd39700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce80c50d0 con 0x7f1ce80a7fe0 2023-08-17T17:49:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.059+0000 7f1cecd39700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce8064610 con 0x7f1ce8064180 2023-08-17T17:49:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.059+0000 7f1cddd9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1ce80bef00 0x7f1ce80c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44636/0 (socket says 172.21.15.78:44636) 2023-08-17T17:49:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.059+0000 7f1cddd9b700 1 -- 172.21.15.78:0/1300274041 learned_addr learned my addr 172.21.15.78:0/1300274041 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.059+0000 7f1ce6d9d700 1 --2- 172.21.15.78:0/1300274041 >> v2:172.21.15.150:3300/0 conn(0x7f1ce8064180 0x7f1ce80c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1ce5d9b700 1 -- 172.21.15.78:0/1300274041 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528790895 0 0) 0x7f1ce80c4040 con 0x7f1ce80bef00 2023-08-17T17:49:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1ce5d9b700 1 -- 172.21.15.78:0/1300274041 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd40033f0 con 0x7f1ce80bef00 2023-08-17T17:49:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1ce6d9d700 1 -- 172.21.15.78:0/1300274041 >> v1:172.21.15.150:6789/0 conn(0x7f1ce80a7fe0 legacy=0x7f1ce80be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1ce5d9b700 1 -- 172.21.15.78:0/1300274041 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469043033 0 0) 0x7f1ce80c50d0 con 0x7f1ce80a7fe0 2023-08-17T17:49:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1ce6d9d700 1 -- 172.21.15.78:0/1300274041 >> v1:172.21.15.78:6789/0 conn(0x7f1ce80bef00 legacy=0x7f1ce80c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1ce6d9d700 1 -- 172.21.15.78:0/1300274041 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80c3430 con 0x7f1ce8064180 2023-08-17T17:49:54.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1ce6d9d700 1 --2- 172.21.15.78:0/1300274041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce8064180 0x7f1ce80c4be0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f1ce0009e60 tx=0x7f1ce0009780).ready entity=mon.1 client_cookie=8d758ddc8b9533e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1ce5d9b700 1 -- 172.21.15.78:0/1300274041 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000e070 con 0x7f1ce8064180 2023-08-17T17:49:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1ce5d9b700 1 -- 172.21.15.78:0/1300274041 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000ba60 con 0x7f1ce8064180 2023-08-17T17:49:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1ce5d9b700 1 -- 172.21.15.78:0/1300274041 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000bde0 con 0x7f1ce8064180 2023-08-17T17:49:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1cecd39700 1 -- 172.21.15.78:0/1300274041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce8064180 msgr2=0x7f1ce80c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.060+0000 7f1cecd39700 1 --2- 172.21.15.78:0/1300274041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce8064180 0x7f1ce80c4be0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f1ce0009e60 tx=0x7f1ce0009780).stop 2023-08-17T17:49:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.061+0000 7f1cecd39700 1 -- 172.21.15.78:0/1300274041 shutdown_connections 2023-08-17T17:49:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.061+0000 7f1cecd39700 1 --2- 172.21.15.78:0/1300274041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce8064180 0x7f1ce80c4be0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.061+0000 7f1cecd39700 1 -- 172.21.15.78:0/1300274041 >> 172.21.15.78:0/1300274041 conn(0x7f1ce8092330 msgr2=0x7f1ce8062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.061+0000 7f1cecd39700 1 -- 172.21.15.78:0/1300274041 shutdown_connections 2023-08-17T17:49:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.061+0000 7f1cecd39700 1 -- 172.21.15.78:0/1300274041 wait complete. 2023-08-17T17:49:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.062+0000 7f1cecd39700 1 Processor -- start 2023-08-17T17:49:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.062+0000 7f1cecd39700 1 -- start start 2023-08-17T17:49:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cecd39700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ce8064180 0x7f1ce80c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cecd39700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce80a7fe0 0x7f1ce80a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cecd39700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ce80bef00 0x7f1ce814ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cecd39700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80c94a0 con 0x7f1ce80bef00 2023-08-17T17:49:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cecd39700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8154970 con 0x7f1ce80a7fe0 2023-08-17T17:49:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cecd39700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80a9d70 con 0x7f1ce8064180 2023-08-17T17:49:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ce80bef00 0x7f1ce814ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ce80bef00 0x7f1ce814ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44934/0 (socket says 172.21.15.78:44934) 2023-08-17T17:49:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce6d9d700 1 -- 172.21.15.78:0/4157608935 learned_addr learned my addr 172.21.15.78:0/4157608935 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cddd9b700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce80a7fe0 0x7f1ce80a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce659c700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ce8064180 0x7f1ce80c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce6d9d700 1 -- 172.21.15.78:0/4157608935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ce8064180 msgr2=0x7f1ce80c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce6d9d700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ce8064180 0x7f1ce80c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce6d9d700 1 -- 172.21.15.78:0/4157608935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce80a7fe0 msgr2=0x7f1ce80a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce6d9d700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce80a7fe0 0x7f1ce80a9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce6d9d700 1 -- 172.21.15.78:0/4157608935 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0009a20 con 0x7f1ce80bef00 2023-08-17T17:49:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce659c700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ce8064180 0x7f1ce80c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1ce6d9d700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ce80bef00 0x7f1ce814ff70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f1ce000b6c0 tx=0x7f1ce0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cdeffd700 1 -- 172.21.15.78:0/4157608935 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce001d650 con 0x7f1ce80bef00 2023-08-17T17:49:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cecd39700 1 -- 172.21.15.78:0/4157608935 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce8150460 con 0x7f1ce80bef00 2023-08-17T17:49:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cdeffd700 1 -- 172.21.15.78:0/4157608935 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce001d7b0 con 0x7f1ce80bef00 2023-08-17T17:49:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cdeffd700 1 -- 172.21.15.78:0/4157608935 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce001db50 con 0x7f1ce80bef00 2023-08-17T17:49:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.063+0000 7f1cecd39700 1 -- 172.21.15.78:0/4157608935 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce80aa2d0 con 0x7f1ce80bef00 2023-08-17T17:49:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.064+0000 7f1cecd39700 1 -- 172.21.15.78:0/4157608935 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce8154ae0 con 0x7f1ce80bef00 2023-08-17T17:49:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.065+0000 7f1cdeffd700 1 -- 172.21.15.78:0/4157608935 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1ce0024030 con 0x7f1ce80bef00 2023-08-17T17:49:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.065+0000 7f1cdeffd700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc805ed90 0x7f1cc8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.065+0000 7f1cdeffd700 1 -- 172.21.15.78:0/4157608935 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ce007b780 con 0x7f1ce80bef00 2023-08-17T17:49:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.065+0000 7f1ce659c700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc805ed90 0x7f1cc8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.065+0000 7f1ce659c700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc805ed90 0x7f1cc8061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1cd8007fd0 tx=0x7f1cd8009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.069+0000 7f1cdeffd700 1 -- 172.21.15.78:0/4157608935 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ce8154ae0 con 0x7f1ce80bef00 2023-08-17T17:49:54.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.232+0000 7f1cecd39700 1 -- 172.21.15.78:0/4157608935 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ce80aa910 con 0x7f1ce80bef00 2023-08-17T17:49:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.233+0000 7f1cdeffd700 1 -- 172.21.15.78:0/4157608935 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16992 (secure 0 0 0) 0x7f1ce0022070 con 0x7f1ce80bef00 2023-08-17T17:49:54.234 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:54.235 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":90,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:53.608206+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:51.485390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:52.574728+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.234+0000 7f1cecd39700 1 -- 172.21.15.78:0/4157608935 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc805ed90 msgr2=0x7f1cc8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.234+0000 7f1cecd39700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc805ed90 0x7f1cc8061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1cd8007fd0 tx=0x7f1cd8009040).stop 2023-08-17T17:49:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.234+0000 7f1cecd39700 1 -- 172.21.15.78:0/4157608935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ce80bef00 msgr2=0x7f1ce814ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.234+0000 7f1cecd39700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ce80bef00 0x7f1ce814ff70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f1ce000b6c0 tx=0x7f1ce0009780).stop 2023-08-17T17:49:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.234+0000 7f1cecd39700 1 -- 172.21.15.78:0/4157608935 shutdown_connections 2023-08-17T17:49:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.234+0000 7f1cecd39700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1cc805ed90 0x7f1cc8061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.234+0000 7f1cecd39700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ce80bef00 0x7f1ce814ff70 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.234+0000 7f1cecd39700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ce8064180 0x7f1ce80c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.234+0000 7f1cecd39700 1 --2- 172.21.15.78:0/4157608935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce80a7fe0 0x7f1ce80a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.234+0000 7f1cecd39700 1 -- 172.21.15.78:0/4157608935 >> 172.21.15.78:0/4157608935 conn(0x7f1ce8092330 msgr2=0x7f1ce80be2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.235+0000 7f1cecd39700 1 -- 172.21.15.78:0/4157608935 shutdown_connections 2023-08-17T17:49:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.235+0000 7f1cecd39700 1 -- 172.21.15.78:0/4157608935 wait complete. 2023-08-17T17:49:54.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T17:49:54.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.362+0000 7fa741eb3700 1 Processor -- start 2023-08-17T17:49:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.362+0000 7fa741eb3700 1 -- start start 2023-08-17T17:49:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa741eb3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa73c0aa0f0 0x7fa73c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa741eb3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa73c0aa4d0 0x7fa73c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa741eb3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa73c0c5810 0x7fa73c0c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa741eb3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0649b0 con 0x7fa73c0aa4d0 2023-08-17T17:49:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa741eb3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0c6140 con 0x7fa73c0aa0f0 2023-08-17T17:49:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa741eb3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c063420 con 0x7fa73c0c5810 2023-08-17T17:49:54.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa73c0aa4d0 0x7fa73c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa73c0aa4d0 0x7fa73c0c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44936/0 (socket says 172.21.15.78:44936) 2023-08-17T17:49:54.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73affd700 1 -- 172.21.15.78:0/1392284926 learned_addr learned my addr 172.21.15.78:0/1392284926 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:54.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73bfff700 1 --2- 172.21.15.78:0/1392284926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa73c0c5810 0x7fa73c0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73b7fe700 1 --2- 172.21.15.78:0/1392284926 >> v2:172.21.15.150:3300/0 conn(0x7fa73c0aa0f0 0x7fa73c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73affd700 1 -- 172.21.15.78:0/1392284926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa73c0c5810 msgr2=0x7fa73c0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:54.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73affd700 1 --2- 172.21.15.78:0/1392284926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa73c0c5810 0x7fa73c0c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73affd700 1 -- 172.21.15.78:0/1392284926 >> v2:172.21.15.150:3300/0 conn(0x7fa73c0aa0f0 msgr2=0x7fa73c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:54.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73affd700 1 --2- 172.21.15.78:0/1392284926 >> v2:172.21.15.150:3300/0 conn(0x7fa73c0aa0f0 0x7fa73c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73affd700 1 -- 172.21.15.78:0/1392284926 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c063700 con 0x7fa73c0aa4d0 2023-08-17T17:49:54.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73b7fe700 1 --2- 172.21.15.78:0/1392284926 >> v2:172.21.15.150:3300/0 conn(0x7fa73c0aa0f0 0x7fa73c0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:54.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.363+0000 7fa73affd700 1 --2- 172.21.15.78:0/1392284926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0aa4d0 0x7fa73c0c0e10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7fa73c0cade0 tx=0x7fa7300090f0).ready entity=mon.0 client_cookie=25ce44757aa8948b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:54.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa73a7fc700 1 -- 172.21.15.78:0/1392284926 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000b600 con 0x7fa73c0aa4d0 2023-08-17T17:49:54.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa73a7fc700 1 -- 172.21.15.78:0/1392284926 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73000b760 con 0x7fa73c0aa4d0 2023-08-17T17:49:54.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa73a7fc700 1 -- 172.21.15.78:0/1392284926 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000bae0 con 0x7fa73c0aa4d0 2023-08-17T17:49:54.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa741eb3700 1 -- 172.21.15.78:0/1392284926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0aa4d0 msgr2=0x7fa73c0c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa741eb3700 1 --2- 172.21.15.78:0/1392284926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0aa4d0 0x7fa73c0c0e10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7fa73c0cade0 tx=0x7fa7300090f0).stop 2023-08-17T17:49:54.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa741eb3700 1 -- 172.21.15.78:0/1392284926 shutdown_connections 2023-08-17T17:49:54.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa741eb3700 1 --2- 172.21.15.78:0/1392284926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa73c0c5810 0x7fa73c0c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa741eb3700 1 --2- 172.21.15.78:0/1392284926 >> v2:172.21.15.150:3300/0 conn(0x7fa73c0aa0f0 0x7fa73c0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa741eb3700 1 --2- 172.21.15.78:0/1392284926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0aa4d0 0x7fa73c0c0e10 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa741eb3700 1 -- 172.21.15.78:0/1392284926 >> 172.21.15.78:0/1392284926 conn(0x7fa73c06a6a0 msgr2=0x7fa73c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:54.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa741eb3700 1 -- 172.21.15.78:0/1392284926 shutdown_connections 2023-08-17T17:49:54.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.364+0000 7fa741eb3700 1 -- 172.21.15.78:0/1392284926 wait complete. 2023-08-17T17:49:54.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.365+0000 7fa741eb3700 1 Processor -- start 2023-08-17T17:49:54.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.365+0000 7fa741eb3700 1 -- start start 2023-08-17T17:49:54.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa741eb3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa73c0aa0f0 0x7fa73c1449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa741eb3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa73c0aa4d0 0x7fa73c0ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa741eb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0c5810 0x7fa73c0b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa741eb3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0aeff0 con 0x7fa73c0c5810 2023-08-17T17:49:54.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa741eb3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0af2d0 con 0x7fa73c0aa0f0 2023-08-17T17:49:54.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa741eb3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0af5b0 con 0x7fa73c0aa4d0 2023-08-17T17:49:54.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa73bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0c5810 0x7fa73c0b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa73bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0c5810 0x7fa73c0b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44940/0 (socket says 172.21.15.78:44940) 2023-08-17T17:49:54.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa73bfff700 1 -- 172.21.15.78:0/3358419756 learned_addr learned my addr 172.21.15.78:0/3358419756 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:54.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa73b7fe700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa73c0aa0f0 0x7fa73c1449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.366+0000 7fa73affd700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa73c0aa4d0 0x7fa73c0ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa73bfff700 1 -- 172.21.15.78:0/3358419756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa73c0aa4d0 msgr2=0x7fa73c0ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa73bfff700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa73c0aa4d0 0x7fa73c0ab0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa73bfff700 1 -- 172.21.15.78:0/3358419756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa73c0aa0f0 msgr2=0x7fa73c1449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa73bfff700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa73c0aa0f0 0x7fa73c1449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa73bfff700 1 -- 172.21.15.78:0/3358419756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa730009370 con 0x7fa73c0c5810 2023-08-17T17:49:54.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa73b7fe700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa73c0aa0f0 0x7fa73c1449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:54.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa73bfff700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0c5810 0x7fa73c0b0090 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fa73400c650 tx=0x7fa734008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:54.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa7237fe700 1 -- 172.21.15.78:0/3358419756 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734010580 con 0x7fa73c0c5810 2023-08-17T17:49:54.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa7237fe700 1 -- 172.21.15.78:0/3358419756 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7340106e0 con 0x7fa73c0c5810 2023-08-17T17:49:54.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa741eb3700 1 -- 172.21.15.78:0/3358419756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c0af890 con 0x7fa73c0c5810 2023-08-17T17:49:54.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa7237fe700 1 -- 172.21.15.78:0/3358419756 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734010a60 con 0x7fa73c0c5810 2023-08-17T17:49:54.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.367+0000 7fa741eb3700 1 -- 172.21.15.78:0/3358419756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c144e90 con 0x7fa73c0c5810 2023-08-17T17:49:54.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.368+0000 7fa741eb3700 1 -- 172.21.15.78:0/3358419756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c0afdb0 con 0x7fa73c0c5810 2023-08-17T17:49:54.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.368+0000 7fa7237fe700 1 -- 172.21.15.78:0/3358419756 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa73401b460 con 0x7fa73c0c5810 2023-08-17T17:49:54.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.369+0000 7fa7237fe700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa72805ed90 0x7fa728061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.369+0000 7fa7237fe700 1 -- 172.21.15.78:0/3358419756 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa734079bd0 con 0x7fa73c0c5810 2023-08-17T17:49:54.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.369+0000 7fa73b7fe700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa72805ed90 0x7fa728061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.369+0000 7fa73b7fe700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa72805ed90 0x7fa728061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa72c00d4a0 tx=0x7fa72c0075d0).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:54.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.373+0000 7fa7237fe700 1 -- 172.21.15.78:0/3358419756 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa73c0afdb0 con 0x7fa73c0c5810 2023-08-17T17:49:54.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.576+0000 7fa741eb3700 1 -- 172.21.15.78:0/3358419756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa73c0afdb0 con 0x7fa73c0c5810 2023-08-17T17:49:54.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.617+0000 7fa7237fe700 1 -- 172.21.15.78:0/3358419756 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa73c0afdb0 con 0x7fa73c0c5810 2023-08-17T17:49:54.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 -- 172.21.15.78:0/3358419756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa72805ed90 msgr2=0x7fa728061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa72805ed90 0x7fa728061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa72c00d4a0 tx=0x7fa72c0075d0).stop 2023-08-17T17:49:54.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 -- 172.21.15.78:0/3358419756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0c5810 msgr2=0x7fa73c0b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0c5810 0x7fa73c0b0090 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fa73400c650 tx=0x7fa734008040).stop 2023-08-17T17:49:54.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 -- 172.21.15.78:0/3358419756 shutdown_connections 2023-08-17T17:49:54.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa72805ed90 0x7fa728061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa73c0c5810 0x7fa73c0b0090 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa73c0aa0f0 0x7fa73c1449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 --2- 172.21.15.78:0/3358419756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa73c0aa4d0 0x7fa73c0ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 -- 172.21.15.78:0/3358419756 >> 172.21.15.78:0/3358419756 conn(0x7fa73c06a6a0 msgr2=0x7fa73c1530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:54.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 -- 172.21.15.78:0/3358419756 shutdown_connections 2023-08-17T17:49:54.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.619+0000 7fa741eb3700 1 -- 172.21.15.78:0/3358419756 wait complete. 2023-08-17T17:49:54.632 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T17:49:54.633 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T17:49:54.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.747+0000 7f0e9f563700 1 Processor -- start 2023-08-17T17:49:54.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.747+0000 7f0e9f563700 1 -- start start 2023-08-17T17:49:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9f563700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0e980aa0f0 0x7f0e980644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9f563700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e980c5810 0x7f0e980c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9f563700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980649b0 con 0x7f0e980aa4d0 2023-08-17T17:49:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9f563700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e980c6170 con 0x7f0e980aa0f0 2023-08-17T17:49:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9f563700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e98063420 con 0x7f0e980c5810 2023-08-17T17:49:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9d2ff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0e980aa0f0 0x7f0e980644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9d2ff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0e980aa0f0 0x7f0e980644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44954/0 (socket says 172.21.15.78:44954) 2023-08-17T17:49:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9d2ff700 1 -- 172.21.15.78:0/3575917502 learned_addr learned my addr 172.21.15.78:0/3575917502 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9cafe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0e980aa4d0 0x7f0e980c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44644/0 (socket says 172.21.15.78:44644) 2023-08-17T17:49:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9d2ff700 1 -- 172.21.15.78:0/3575917502 >> v2:172.21.15.150:3300/0 conn(0x7f0e980c5810 msgr2=0x7f0e980c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e9db00700 1 --2- 172.21.15.78:0/3575917502 >> v2:172.21.15.150:3300/0 conn(0x7f0e980c5810 0x7f0e980c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9d2ff700 1 --2- 172.21.15.78:0/3575917502 >> v2:172.21.15.150:3300/0 conn(0x7f0e980c5810 0x7f0e980c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9d2ff700 1 -- 172.21.15.78:0/3575917502 >> v1:172.21.15.78:6789/0 conn(0x7f0e980aa4d0 legacy=0x7f0e980c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.748+0000 7f0e8ffff700 1 -- 172.21.15.78:0/3575917502 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670327973 0 0) 0x7f0e980649b0 con 0x7f0e980aa4d0 2023-08-17T17:49:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9d2ff700 1 -- 172.21.15.78:0/3575917502 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98063700 con 0x7f0e980aa0f0 2023-08-17T17:49:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9d2ff700 1 --2- 172.21.15.78:0/3575917502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa0f0 0x7f0e980644c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f0e98159090 tx=0x7f0e940090f0).ready entity=mon.0 client_cookie=7b6ed53d6529e322 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e8ffff700 1 -- 172.21.15.78:0/3575917502 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400b600 con 0x7f0e980aa0f0 2023-08-17T17:49:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e8ffff700 1 -- 172.21.15.78:0/3575917502 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9400b760 con 0x7f0e980aa0f0 2023-08-17T17:49:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e8ffff700 1 -- 172.21.15.78:0/3575917502 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400bae0 con 0x7f0e980aa0f0 2023-08-17T17:49:54.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9f563700 1 -- 172.21.15.78:0/3575917502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa0f0 msgr2=0x7f0e980644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9f563700 1 --2- 172.21.15.78:0/3575917502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa0f0 0x7f0e980644c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f0e98159090 tx=0x7f0e940090f0).stop 2023-08-17T17:49:54.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9f563700 1 -- 172.21.15.78:0/3575917502 shutdown_connections 2023-08-17T17:49:54.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9f563700 1 --2- 172.21.15.78:0/3575917502 >> v2:172.21.15.150:3300/0 conn(0x7f0e980c5810 0x7f0e980c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9f563700 1 --2- 172.21.15.78:0/3575917502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa0f0 0x7f0e980644c0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9f563700 1 -- 172.21.15.78:0/3575917502 >> 172.21.15.78:0/3575917502 conn(0x7f0e9806a6a0 msgr2=0x7f0e980caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:54.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9f563700 1 -- 172.21.15.78:0/3575917502 shutdown_connections 2023-08-17T17:49:54.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.749+0000 7f0e9f563700 1 -- 172.21.15.78:0/3575917502 wait complete. 2023-08-17T17:49:54.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.750+0000 7f0e9f563700 1 Processor -- start 2023-08-17T17:49:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.750+0000 7f0e9f563700 1 -- start start 2023-08-17T17:49:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.751+0000 7f0e9f563700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e980aa0f0 0x7f0e980aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.751+0000 7f0e9f563700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa4d0 0x7f0e98148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.751+0000 7f0e9f563700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e980c5810 0x7f0e980ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.751+0000 7f0e9f563700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980b02a0 con 0x7f0e980aa4d0 2023-08-17T17:49:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.751+0000 7f0e9f563700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980b0580 con 0x7f0e980c5810 2023-08-17T17:49:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.751+0000 7f0e9f563700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980b0860 con 0x7f0e980aa0f0 2023-08-17T17:49:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.751+0000 7f0e9cafe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa4d0 0x7f0e98148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9cafe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa4d0 0x7f0e98148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44970/0 (socket says 172.21.15.78:44970) 2023-08-17T17:49:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9cafe700 1 -- 172.21.15.78:0/2569949081 learned_addr learned my addr 172.21.15.78:0/2569949081 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9db00700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e980c5810 0x7f0e980ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9d2ff700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e980aa0f0 0x7f0e980aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9cafe700 1 -- 172.21.15.78:0/2569949081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e980aa0f0 msgr2=0x7f0e980aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9cafe700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e980aa0f0 0x7f0e980aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9cafe700 1 -- 172.21.15.78:0/2569949081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e980c5810 msgr2=0x7f0e980ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:54.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9cafe700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e980c5810 0x7f0e980ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:54.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9cafe700 1 -- 172.21.15.78:0/2569949081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94009370 con 0x7f0e980aa4d0 2023-08-17T17:49:54.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9db00700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e980c5810 0x7f0e980ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:54.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9cafe700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa4d0 0x7f0e98148ba0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f0e8800c4e0 tx=0x7f0e88007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:54.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e8d7fa700 1 -- 172.21.15.78:0/2569949081 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880072e0 con 0x7f0e980aa4d0 2023-08-17T17:49:54.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e8d7fa700 1 -- 172.21.15.78:0/2569949081 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e88007440 con 0x7f0e980aa4d0 2023-08-17T17:49:54.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9f563700 1 -- 172.21.15.78:0/2569949081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e980b0b40 con 0x7f0e980aa4d0 2023-08-17T17:49:54.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e8d7fa700 1 -- 172.21.15.78:0/2569949081 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880058f0 con 0x7f0e980aa4d0 2023-08-17T17:49:54.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.752+0000 7f0e9f563700 1 -- 172.21.15.78:0/2569949081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e98149090 con 0x7f0e980aa4d0 2023-08-17T17:49:54.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.753+0000 7f0e9f563700 1 -- 172.21.15.78:0/2569949081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e980b0d30 con 0x7f0e980aa4d0 2023-08-17T17:49:54.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.753+0000 7f0e8d7fa700 1 -- 172.21.15.78:0/2569949081 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0e8801a060 con 0x7f0e980aa4d0 2023-08-17T17:49:54.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.754+0000 7f0e8d7fa700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0e7c05ed90 0x7f0e7c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:54.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.754+0000 7f0e9d2ff700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0e7c05ed90 0x7f0e7c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:54.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.754+0000 7f0e8d7fa700 1 -- 172.21.15.78:0/2569949081 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0e88079390 con 0x7f0e980aa4d0 2023-08-17T17:49:54.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.754+0000 7f0e9d2ff700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0e7c05ed90 0x7f0e7c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0e94009130 tx=0x7f0e94017000).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:54.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.758+0000 7f0e8d7fa700 1 -- 172.21.15.78:0/2569949081 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e8804a930 con 0x7f0e980aa4d0 2023-08-17T17:49:54.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:54.963+0000 7f0e9f563700 1 -- 172.21.15.78:0/2569949081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0e980b03e0 con 0x7f0e980aa4d0 2023-08-17T17:49:55.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.617+0000 7f0e8d7fa700 1 -- 172.21.15.78:0/2569949081 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0e980b03e0 con 0x7f0e980aa4d0 2023-08-17T17:49:55.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 -- 172.21.15.78:0/2569949081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0e7c05ed90 msgr2=0x7f0e7c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:55.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0e7c05ed90 0x7f0e7c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0e94009130 tx=0x7f0e94017000).stop 2023-08-17T17:49:55.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 -- 172.21.15.78:0/2569949081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa4d0 msgr2=0x7f0e98148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:55.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa4d0 0x7f0e98148ba0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f0e8800c4e0 tx=0x7f0e88007c60).stop 2023-08-17T17:49:55.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 -- 172.21.15.78:0/2569949081 shutdown_connections 2023-08-17T17:49:55.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0e7c05ed90 0x7f0e7c061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e980c5810 0x7f0e980ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e980aa0f0 0x7f0e980aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 --2- 172.21.15.78:0/2569949081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e980aa4d0 0x7f0e98148ba0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 -- 172.21.15.78:0/2569949081 >> 172.21.15.78:0/2569949081 conn(0x7f0e9806a6a0 msgr2=0x7f0e980ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:55.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 -- 172.21.15.78:0/2569949081 shutdown_connections 2023-08-17T17:49:55.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.620+0000 7f0e9f563700 1 -- 172.21.15.78:0/2569949081 wait complete. 2023-08-17T17:49:55.633 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T17:49:55.633 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:49:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.744+0000 7fcc501e7700 1 Processor -- start 2023-08-17T17:49:55.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.745+0000 7fcc501e7700 1 -- start start 2023-08-17T17:49:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.745+0000 7fcc501e7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc480c6ee0 0x7fcc480c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.745+0000 7fcc501e7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c0df0 0x7fcc480ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.745+0000 7fcc501e7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc480c7350 con 0x7fcc48154140 2023-08-17T17:49:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.745+0000 7fcc501e7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc480a8350 con 0x7fcc480c6ee0 2023-08-17T17:49:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.745+0000 7fcc501e7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc480c1280 con 0x7fcc480c0df0 2023-08-17T17:49:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.745+0000 7fcc4df83700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcc48154140 0x7fcc480a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44646/0 (socket says 172.21.15.78:44646) 2023-08-17T17:49:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.745+0000 7fcc4df83700 1 -- 172.21.15.78:0/2168891167 learned_addr learned my addr 172.21.15.78:0/2168891167 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4e784700 1 --2- 172.21.15.78:0/2168891167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c0df0 0x7fcc480ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4d782700 1 --2- 172.21.15.78:0/2168891167 >> v2:172.21.15.150:3300/0 conn(0x7fcc480c6ee0 0x7fcc480c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4cf81700 1 -- 172.21.15.78:0/2168891167 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664310459 0 0) 0x7fcc480c7350 con 0x7fcc48154140 2023-08-17T17:49:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4cf81700 1 -- 172.21.15.78:0/2168891167 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc340033f0 con 0x7fcc48154140 2023-08-17T17:49:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4e784700 1 -- 172.21.15.78:0/2168891167 >> v2:172.21.15.150:3300/0 conn(0x7fcc480c6ee0 msgr2=0x7fcc480c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4e784700 1 --2- 172.21.15.78:0/2168891167 >> v2:172.21.15.150:3300/0 conn(0x7fcc480c6ee0 0x7fcc480c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4e784700 1 -- 172.21.15.78:0/2168891167 >> v1:172.21.15.78:6789/0 conn(0x7fcc48154140 legacy=0x7fcc480a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4cf81700 1 -- 172.21.15.78:0/2168891167 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3508301870 0 0) 0x7fcc340033f0 con 0x7fcc48154140 2023-08-17T17:49:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4e784700 1 -- 172.21.15.78:0/2168891167 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc48154520 con 0x7fcc480c0df0 2023-08-17T17:49:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4d782700 1 --2- 172.21.15.78:0/2168891167 >> v2:172.21.15.150:3300/0 conn(0x7fcc480c6ee0 0x7fcc480c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:49:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4e784700 1 --2- 172.21.15.78:0/2168891167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c0df0 0x7fcc480ca280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcc40009760 tx=0x7fcc40009060).ready entity=mon.2 client_cookie=81342b558b43974a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4cf81700 1 -- 172.21.15.78:0/2168891167 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440017f0 con 0x7fcc480c0df0 2023-08-17T17:49:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4cf81700 1 -- 172.21.15.78:0/2168891167 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc40011400 con 0x7fcc480c0df0 2023-08-17T17:49:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.746+0000 7fcc4cf81700 1 -- 172.21.15.78:0/2168891167 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40011780 con 0x7fcc480c0df0 2023-08-17T17:49:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.747+0000 7fcc501e7700 1 -- 172.21.15.78:0/2168891167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c0df0 msgr2=0x7fcc480ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.747+0000 7fcc501e7700 1 --2- 172.21.15.78:0/2168891167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c0df0 0x7fcc480ca280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcc40009760 tx=0x7fcc40009060).stop 2023-08-17T17:49:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.747+0000 7fcc501e7700 1 -- 172.21.15.78:0/2168891167 shutdown_connections 2023-08-17T17:49:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.747+0000 7fcc501e7700 1 --2- 172.21.15.78:0/2168891167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c0df0 0x7fcc480ca280 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.747+0000 7fcc501e7700 1 --2- 172.21.15.78:0/2168891167 >> v2:172.21.15.150:3300/0 conn(0x7fcc480c6ee0 0x7fcc480c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.747+0000 7fcc501e7700 1 -- 172.21.15.78:0/2168891167 >> 172.21.15.78:0/2168891167 conn(0x7fcc48094510 msgr2=0x7fcc4806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.747+0000 7fcc501e7700 1 -- 172.21.15.78:0/2168891167 shutdown_connections 2023-08-17T17:49:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.747+0000 7fcc501e7700 1 -- 172.21.15.78:0/2168891167 wait complete. 2023-08-17T17:49:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.748+0000 7fcc501e7700 1 Processor -- start 2023-08-17T17:49:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.748+0000 7fcc501e7700 1 -- start start 2023-08-17T17:49:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc501e7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc480c0df0 0x7fcc4814caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc501e7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c6ee0 0x7fcc48064020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc501e7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48154140 0x7fcc48064510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc501e7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48064a00 con 0x7fcc48154140 2023-08-17T17:49:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc501e7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48155780 con 0x7fcc480c0df0 2023-08-17T17:49:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc501e7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48154b70 con 0x7fcc480c6ee0 2023-08-17T17:49:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4e784700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48154140 0x7fcc48064510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4e784700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48154140 0x7fcc48064510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44986/0 (socket says 172.21.15.78:44986) 2023-08-17T17:49:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4e784700 1 -- 172.21.15.78:0/3678460788 learned_addr learned my addr 172.21.15.78:0/3678460788 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4d782700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c6ee0 0x7fcc48064020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4df83700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc480c0df0 0x7fcc4814caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4e784700 1 -- 172.21.15.78:0/3678460788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c6ee0 msgr2=0x7fcc48064020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4e784700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c6ee0 0x7fcc48064020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4e784700 1 -- 172.21.15.78:0/3678460788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc480c0df0 msgr2=0x7fcc4814caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4e784700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc480c0df0 0x7fcc4814caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4e784700 1 -- 172.21.15.78:0/3678460788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380092a0 con 0x7fcc48154140 2023-08-17T17:49:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4df83700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc480c0df0 0x7fcc4814caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:55.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc4e784700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48154140 0x7fcc48064510 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7fcc40009d50 tx=0x7fcc40016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:55.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc3dffb700 1 -- 172.21.15.78:0/3678460788 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40010bb0 con 0x7fcc48154140 2023-08-17T17:49:55.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc3dffb700 1 -- 172.21.15.78:0/3678460788 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc40010d10 con 0x7fcc48154140 2023-08-17T17:49:55.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc501e7700 1 -- 172.21.15.78:0/3678460788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc400092a0 con 0x7fcc48154140 2023-08-17T17:49:55.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.749+0000 7fcc3dffb700 1 -- 172.21.15.78:0/3678460788 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4001d660 con 0x7fcc48154140 2023-08-17T17:49:55.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.750+0000 7fcc501e7700 1 -- 172.21.15.78:0/3678460788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc48155130 con 0x7fcc48154140 2023-08-17T17:49:55.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.750+0000 7fcc501e7700 1 -- 172.21.15.78:0/3678460788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc48047350 con 0x7fcc48154140 2023-08-17T17:49:55.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.751+0000 7fcc3dffb700 1 -- 172.21.15.78:0/3678460788 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcc40024030 con 0x7fcc48154140 2023-08-17T17:49:55.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.751+0000 7fcc3dffb700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc2c05ed90 0x7fcc2c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.751+0000 7fcc3dffb700 1 -- 172.21.15.78:0/3678460788 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcc4007a8f0 con 0x7fcc48154140 2023-08-17T17:49:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.751+0000 7fcc4df83700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc2c05ed90 0x7fcc2c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.751+0000 7fcc4df83700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc2c05ed90 0x7fcc2c061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcc44001560 tx=0x7fcc44009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.755+0000 7fcc3dffb700 1 -- 172.21.15.78:0/3678460788 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc4004be90 con 0x7fcc48154140 2023-08-17T17:49:55.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.958+0000 7fcc501e7700 1 -- 172.21.15.78:0/3678460788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc480c91e0 con 0x7fcc48154140 2023-08-17T17:49:55.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.958+0000 7fcc3dffb700 1 -- 172.21.15.78:0/3678460788 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fcc40022070 con 0x7fcc48154140 2023-08-17T17:49:55.960 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:55.960 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3356030675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3356030675},{"type":"v1","addr":"172.21.15.150:6835","nonce":3356030675}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/807522916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":807522916},{"type":"v1","addr":"172.21.15.78:6837","nonce":807522916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3165905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3165905348},{"type":"v1","addr":"172.21.15.150:6834","nonce":3165905348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:53.608560+0000","modified":"2023-08-17T17:49:55.616581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/4042380652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4042380652},{"type":"v1","addr":"172.21.15.78:6836","nonce":4042380652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T17:49:55.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 -- 172.21.15.78:0/3678460788 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc2c05ed90 msgr2=0x7fcc2c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:55.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc2c05ed90 0x7fcc2c061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcc44001560 tx=0x7fcc44009040).stop 2023-08-17T17:49:55.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 -- 172.21.15.78:0/3678460788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48154140 msgr2=0x7fcc48064510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:55.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48154140 0x7fcc48064510 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7fcc40009d50 tx=0x7fcc40016000).stop 2023-08-17T17:49:55.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 -- 172.21.15.78:0/3678460788 shutdown_connections 2023-08-17T17:49:55.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc2c05ed90 0x7fcc2c061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48154140 0x7fcc48064510 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc480c0df0 0x7fcc4814caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 --2- 172.21.15.78:0/3678460788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc480c6ee0 0x7fcc48064020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:55.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 -- 172.21.15.78:0/3678460788 >> 172.21.15.78:0/3678460788 conn(0x7fcc48094510 msgr2=0x7fcc480c06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:55.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 -- 172.21.15.78:0/3678460788 shutdown_connections 2023-08-17T17:49:55.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:55.961+0000 7fcc501e7700 1 -- 172.21.15.78:0/3678460788 wait complete. 2023-08-17T17:49:55.964 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 31 2023-08-17T17:49:55.974 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:49:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.086+0000 7f0b2c843700 1 Processor -- start 2023-08-17T17:49:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.086+0000 7f0b2c843700 1 -- start start 2023-08-17T17:49:56.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b2c843700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b280a8050 0x7f0b28064500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b2c843700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b28063960 con 0x7f0b280c01b0 2023-08-17T17:49:56.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b2c843700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b28063030 con 0x7f0b280a7bd0 2023-08-17T17:49:56.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b2c843700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b280649f0 con 0x7f0b280a8050 2023-08-17T17:49:56.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b26d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0b280c01b0 0x7f0b280c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44650/0 (socket says 172.21.15.78:44650) 2023-08-17T17:49:56.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b26d9d700 1 -- 172.21.15.78:0/2714034375 learned_addr learned my addr 172.21.15.78:0/2714034375 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:56.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b2759e700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b280a8050 0x7f0b28064500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617908710 0 0) 0x7f0b28063960 con 0x7f0b280c01b0 2023-08-17T17:49:56.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b140033f0 con 0x7f0b280c01b0 2023-08-17T17:49:56.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 443580733 0 0) 0x7f0b140033f0 con 0x7f0b280c01b0 2023-08-17T17:49:56.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b280a8050 msgr2=0x7f0b28064500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:56.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b280a8050 0x7f0b28064500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 >> v1:172.21.15.150:6789/0 conn(0x7f0b280a7bd0 legacy=0x7f0b28063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b28063310 con 0x7f0b280c01b0 2023-08-17T17:49:56.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f0b200017f0 con 0x7f0b280c01b0 2023-08-17T17:49:56.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 >> v1:172.21.15.78:6789/0 conn(0x7f0b280c01b0 legacy=0x7f0b280c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b14003910 0x7f0b14003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b280a8050 0x7f0b14004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b14004b80 0x7f0b14005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1400b910 con 0x7f0b14004b80 2023-08-17T17:49:56.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1400ba80 con 0x7f0b14003910 2023-08-17T17:49:56.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.087+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1400bc40 con 0x7f0b280a8050 2023-08-17T17:49:56.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2759e700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b14004b80 0x7f0b14005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2659c700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b280a8050 0x7f0b14004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b26d9d700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b14003910 0x7f0b14003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2759e700 1 -- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b280a8050 msgr2=0x7f0b14004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2759e700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b280a8050 0x7f0b14004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2759e700 1 -- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b14003910 msgr2=0x7f0b14003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2759e700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b14003910 0x7f0b14003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2759e700 1 -- 172.21.15.78:0/2714034375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140033f0 con 0x7f0b14004b80 2023-08-17T17:49:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2659c700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b280a8050 0x7f0b14004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2759e700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b14004b80 0x7f0b14005000 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f0b280cb990 tx=0x7f0b18009060).ready entity=mon.0 client_cookie=314aa45cf1afcfbe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18009e90 con 0x7f0b14004b80 2023-08-17T17:49:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b18009430 con 0x7f0b14004b80 2023-08-17T17:49:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b25d9b700 1 -- 172.21.15.78:0/2714034375 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800e820 con 0x7f0b14004b80 2023-08-17T17:49:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2c843700 1 -- 172.21.15.78:0/2714034375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b14004b80 msgr2=0x7f0b14005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2c843700 1 --2- 172.21.15.78:0/2714034375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b14004b80 0x7f0b14005000 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f0b280cb990 tx=0x7f0b18009060).stop 2023-08-17T17:49:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2759e700 1 -- 172.21.15.78:0/2714034375 reap_dead start 2023-08-17T17:49:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2c843700 1 -- 172.21.15.78:0/2714034375 shutdown_connections 2023-08-17T17:49:56.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.088+0000 7f0b2c843700 1 -- 172.21.15.78:0/2714034375 >> 172.21.15.78:0/2714034375 conn(0x7f0b2806a6c0 msgr2=0x7f0b280cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:56.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.089+0000 7f0b2c843700 1 -- 172.21.15.78:0/2714034375 shutdown_connections 2023-08-17T17:49:56.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.089+0000 7f0b2c843700 1 -- 172.21.15.78:0/2714034375 wait complete. 2023-08-17T17:49:56.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.090+0000 7f0b2c843700 1 Processor -- start 2023-08-17T17:49:56.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.090+0000 7f0b2c843700 1 -- start start 2023-08-17T17:49:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2c843700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b28149920 0x7f0b281559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2c843700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b280ad030 0x7f0b281500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2c843700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b28063df0 0x7f0b28064270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2c843700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b280c2db0 con 0x7f0b28149920 2023-08-17T17:49:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2c843700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b280c3c10 con 0x7f0b280ad030 2023-08-17T17:49:56.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2c843700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b28064760 con 0x7f0b28063df0 2023-08-17T17:49:56.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b26d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b28149920 0x7f0b281559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b26d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b28149920 0x7f0b281559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45006/0 (socket says 172.21.15.78:45006) 2023-08-17T17:49:56.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b26d9d700 1 -- 172.21.15.78:0/1748518590 learned_addr learned my addr 172.21.15.78:0/1748518590 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:56.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2659c700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b280ad030 0x7f0b281500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2759e700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b28063df0 0x7f0b28064270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b26d9d700 1 -- 172.21.15.78:0/1748518590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b28063df0 msgr2=0x7f0b28064270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b26d9d700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b28063df0 0x7f0b28064270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b26d9d700 1 -- 172.21.15.78:0/1748518590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b280ad030 msgr2=0x7f0b281500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b26d9d700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b280ad030 0x7f0b281500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b26d9d700 1 -- 172.21.15.78:0/1748518590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b280c3000 con 0x7f0b28149920 2023-08-17T17:49:56.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2659c700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b280ad030 0x7f0b281500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:56.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b26d9d700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b28149920 0x7f0b281559b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f0b20007760 tx=0x7f0b280638d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:56.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b1effd700 1 -- 172.21.15.78:0/1748518590 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000e770 con 0x7f0b28149920 2023-08-17T17:49:56.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b1effd700 1 -- 172.21.15.78:0/1748518590 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b20010040 con 0x7f0b28149920 2023-08-17T17:49:56.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2c843700 1 -- 172.21.15.78:0/1748518590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b280c32e0 con 0x7f0b28149920 2023-08-17T17:49:56.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b1effd700 1 -- 172.21.15.78:0/1748518590 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000eae0 con 0x7f0b28149920 2023-08-17T17:49:56.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.091+0000 7f0b2c843700 1 -- 172.21.15.78:0/1748518590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b280c38a0 con 0x7f0b28149920 2023-08-17T17:49:56.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.092+0000 7f0b2c843700 1 -- 172.21.15.78:0/1748518590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b28083af0 con 0x7f0b28149920 2023-08-17T17:49:56.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.093+0000 7f0b1effd700 1 -- 172.21.15.78:0/1748518590 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0b20015400 con 0x7f0b28149920 2023-08-17T17:49:56.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.093+0000 7f0b1effd700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b0805ed90 0x7f0b08061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.093+0000 7f0b1effd700 1 -- 172.21.15.78:0/1748518590 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b20079e10 con 0x7f0b28149920 2023-08-17T17:49:56.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.093+0000 7f0b2659c700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b0805ed90 0x7f0b08061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.093+0000 7f0b2659c700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b0805ed90 0x7f0b08061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0b10007fd0 tx=0x7f0b1000c040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:56.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.097+0000 7f0b1effd700 1 -- 172.21.15.78:0/1748518590 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b2004b350 con 0x7f0b28149920 2023-08-17T17:49:56.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.260+0000 7f0b2c843700 1 -- 172.21.15.78:0/1748518590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b280635f0 con 0x7f0b28149920 2023-08-17T17:49:56.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.261+0000 7f0b1effd700 1 -- 172.21.15.78:0/1748518590 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16979 (secure 0 0 0) 0x7f0b2004e970 con 0x7f0b28149920 2023-08-17T17:49:56.263 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:56.263 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":91,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:49:54.610119+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:51.485390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:52.574728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:49:56.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.263+0000 7f0b2c843700 1 -- 172.21.15.78:0/1748518590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b0805ed90 msgr2=0x7f0b08061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.263+0000 7f0b2c843700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b0805ed90 0x7f0b08061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0b10007fd0 tx=0x7f0b1000c040).stop 2023-08-17T17:49:56.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.263+0000 7f0b2c843700 1 -- 172.21.15.78:0/1748518590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b28149920 msgr2=0x7f0b281559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.263+0000 7f0b2c843700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b28149920 0x7f0b281559b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f0b20007760 tx=0x7f0b280638d0).stop 2023-08-17T17:49:56.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.263+0000 7f0b2c843700 1 -- 172.21.15.78:0/1748518590 shutdown_connections 2023-08-17T17:49:56.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.263+0000 7f0b2c843700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0b0805ed90 0x7f0b08061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.263+0000 7f0b2c843700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b28063df0 0x7f0b28064270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.263+0000 7f0b2c843700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b28149920 0x7f0b281559b0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.263+0000 7f0b2c843700 1 --2- 172.21.15.78:0/1748518590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b280ad030 0x7f0b281500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.263+0000 7f0b2c843700 1 -- 172.21.15.78:0/1748518590 >> 172.21.15.78:0/1748518590 conn(0x7f0b2806a6c0 msgr2=0x7f0b280a8430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:56.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.264+0000 7f0b2c843700 1 -- 172.21.15.78:0/1748518590 shutdown_connections 2023-08-17T17:49:56.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.264+0000 7f0b2c843700 1 -- 172.21.15.78:0/1748518590 wait complete. 2023-08-17T17:49:56.277 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T17:49:56.277 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:49:56.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.389+0000 7f689608c700 1 Processor -- start 2023-08-17T17:49:56.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.389+0000 7f689608c700 1 -- start start 2023-08-17T17:49:56.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.390+0000 7f689608c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6890064180 0x7f68900c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.390+0000 7f689608c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68900c4040 con 0x7f68900bef00 2023-08-17T17:49:56.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.390+0000 7f689608c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68900c50d0 con 0x7f68900a7fe0 2023-08-17T17:49:56.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.390+0000 7f689608c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6890064610 con 0x7f6890064180 2023-08-17T17:49:56.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.390+0000 7f688effd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f68900bef00 0x7f68900c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44664/0 (socket says 172.21.15.78:44664) 2023-08-17T17:49:56.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.390+0000 7f688effd700 1 -- 172.21.15.78:0/1901765895 learned_addr learned my addr 172.21.15.78:0/1901765895 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:56.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688ffff700 1 --2- 172.21.15.78:0/1901765895 >> v2:172.21.15.150:3300/0 conn(0x7f6890064180 0x7f68900c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773323341 0 0) 0x7f68900c4040 con 0x7f68900bef00 2023-08-17T17:49:56.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68780033f0 con 0x7f68900bef00 2023-08-17T17:49:56.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3357576709 0 0) 0x7f68780033f0 con 0x7f68900bef00 2023-08-17T17:49:56.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 >> v2:172.21.15.150:3300/0 conn(0x7f6890064180 msgr2=0x7f68900c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:56.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 --2- 172.21.15.78:0/1901765895 >> v2:172.21.15.150:3300/0 conn(0x7f6890064180 0x7f68900c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 >> v1:172.21.15.150:6789/0 conn(0x7f68900a7fe0 legacy=0x7f68900be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900c3430 con 0x7f68900bef00 2023-08-17T17:49:56.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f6884001470 con 0x7f68900bef00 2023-08-17T17:49:56.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 >> v1:172.21.15.78:6789/0 conn(0x7f68900bef00 legacy=0x7f68900c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68780038e0 0x7f6878003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6878004690 0x7f6878004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878005000 0x7f687800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687800bdd0 con 0x7f6878005000 2023-08-17T17:49:56.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687800bf40 con 0x7f6878004690 2023-08-17T17:49:56.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687800c100 con 0x7f68780038e0 2023-08-17T17:49:56.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688ffff700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878005000 0x7f687800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688effd700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6878004690 0x7f6878004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688f7fe700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68780038e0 0x7f6878003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688ffff700 1 -- 172.21.15.78:0/1901765895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68780038e0 msgr2=0x7f6878003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:56.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688ffff700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68780038e0 0x7f6878003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688ffff700 1 -- 172.21.15.78:0/1901765895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6878004690 msgr2=0x7f6878004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688ffff700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6878004690 0x7f6878004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688ffff700 1 -- 172.21.15.78:0/1901765895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780033f0 con 0x7f6878005000 2023-08-17T17:49:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688effd700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6878004690 0x7f6878004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688ffff700 1 -- 172.21.15.78:0/1901765895 reap_dead start 2023-08-17T17:49:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.391+0000 7f688ffff700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878005000 0x7f687800b8e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f6888009a60 tx=0x7f6888009060).ready entity=mon.0 client_cookie=bd41ed24f16b4b04 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.392+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888009ea0 con 0x7f6878005000 2023-08-17T17:49:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.392+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888009430 con 0x7f6878005000 2023-08-17T17:49:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.392+0000 7f688e7fc700 1 -- 172.21.15.78:0/1901765895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800e890 con 0x7f6878005000 2023-08-17T17:49:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.392+0000 7f689608c700 1 -- 172.21.15.78:0/1901765895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878005000 msgr2=0x7f687800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.392+0000 7f689608c700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878005000 0x7f687800b8e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f6888009a60 tx=0x7f6888009060).stop 2023-08-17T17:49:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.392+0000 7f689608c700 1 -- 172.21.15.78:0/1901765895 shutdown_connections 2023-08-17T17:49:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.392+0000 7f689608c700 1 --2- 172.21.15.78:0/1901765895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6878005000 0x7f687800b8e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.392+0000 7f689608c700 1 -- 172.21.15.78:0/1901765895 >> 172.21.15.78:0/1901765895 conn(0x7f6890092330 msgr2=0x7f6890062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.392+0000 7f689608c700 1 -- 172.21.15.78:0/1901765895 shutdown_connections 2023-08-17T17:49:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.392+0000 7f689608c700 1 -- 172.21.15.78:0/1901765895 wait complete. 2023-08-17T17:49:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.393+0000 7f689608c700 1 Processor -- start 2023-08-17T17:49:56.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.393+0000 7f689608c700 1 -- start start 2023-08-17T17:49:56.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f689608c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6878005000 0x7f68900a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f689608c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6890142a60 0x7f68900c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f689608c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68900c7f80 0x7f68900c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f689608c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900c0200 con 0x7f6890142a60 2023-08-17T17:49:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f689608c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900c0e00 con 0x7f68900c7f80 2023-08-17T17:49:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f689608c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68900c88f0 con 0x7f6878005000 2023-08-17T17:49:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f688effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6890142a60 0x7f68900c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f688effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6890142a60 0x7f68900c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45016/0 (socket says 172.21.15.78:45016) 2023-08-17T17:49:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f688effd700 1 -- 172.21.15.78:0/1042667250 learned_addr learned my addr 172.21.15.78:0/1042667250 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:56.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f688f7fe700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6878005000 0x7f68900a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.394+0000 7f688ffff700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68900c7f80 0x7f68900c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f688effd700 1 -- 172.21.15.78:0/1042667250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6878005000 msgr2=0x7f68900a83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f688effd700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6878005000 0x7f68900a83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f688effd700 1 -- 172.21.15.78:0/1042667250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68900c7f80 msgr2=0x7f68900c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f688effd700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68900c7f80 0x7f68900c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f688effd700 1 -- 172.21.15.78:0/1042667250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900a8a50 con 0x7f6890142a60 2023-08-17T17:49:56.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f688effd700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6890142a60 0x7f68900c7a90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f688400e930 tx=0x7f6884001d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:56.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f68777fe700 1 -- 172.21.15.78:0/1042667250 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400ee70 con 0x7f6890142a60 2023-08-17T17:49:56.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f68777fe700 1 -- 172.21.15.78:0/1042667250 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6884010040 con 0x7f6890142a60 2023-08-17T17:49:56.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f689608c700 1 -- 172.21.15.78:0/1042667250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68900c04d0 con 0x7f6890142a60 2023-08-17T17:49:56.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f68777fe700 1 -- 172.21.15.78:0/1042667250 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6884005470 con 0x7f6890142a60 2023-08-17T17:49:56.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.395+0000 7f689608c700 1 -- 172.21.15.78:0/1042667250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68900c0a90 con 0x7f6890142a60 2023-08-17T17:49:56.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.396+0000 7f689608c700 1 -- 172.21.15.78:0/1042667250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68900c0c50 con 0x7f6890142a60 2023-08-17T17:49:56.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.396+0000 7f68777fe700 1 -- 172.21.15.78:0/1042667250 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f68840048c0 con 0x7f6890142a60 2023-08-17T17:49:56.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.396+0000 7f68777fe700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f687c05ed90 0x7f687c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.396+0000 7f68777fe700 1 -- 172.21.15.78:0/1042667250 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6884079820 con 0x7f6890142a60 2023-08-17T17:49:56.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.396+0000 7f688f7fe700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f687c05ed90 0x7f687c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.397+0000 7f688f7fe700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f687c05ed90 0x7f687c061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6880007fd0 tx=0x7f6880009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:56.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.401+0000 7f68777fe700 1 -- 172.21.15.78:0/1042667250 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f688404adc0 con 0x7f6890142a60 2023-08-17T17:49:56.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.559+0000 7f689608c700 1 -- 172.21.15.78:0/1042667250 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68900c3710 con 0x7f687c05ed90 2023-08-17T17:49:56.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.569+0000 7f68777fe700 1 -- 172.21.15.78:0/1042667250 <== mgr.6522 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352482 (secure 0 0 0) 0x7f68900c3710 con 0x7f687c05ed90 2023-08-17T17:49:56.573 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:56.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 -- 172.21.15.78:0/1042667250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f687c05ed90 msgr2=0x7f687c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f687c05ed90 0x7f687c061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6880007fd0 tx=0x7f6880009040).stop 2023-08-17T17:49:56.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 -- 172.21.15.78:0/1042667250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6890142a60 msgr2=0x7f68900c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6890142a60 0x7f68900c7a90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f688400e930 tx=0x7f6884001d00).stop 2023-08-17T17:49:56.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 -- 172.21.15.78:0/1042667250 shutdown_connections 2023-08-17T17:49:56.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f687c05ed90 0x7f687c061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68900c7f80 0x7f68900c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6878005000 0x7f68900a83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 --2- 172.21.15.78:0/1042667250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6890142a60 0x7f68900c7a90 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 -- 172.21.15.78:0/1042667250 >> 172.21.15.78:0/1042667250 conn(0x7f6890092330 msgr2=0x7f68900be3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:56.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 -- 172.21.15.78:0/1042667250 shutdown_connections 2023-08-17T17:49:56.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.573+0000 7f689608c700 1 -- 172.21.15.78:0/1042667250 wait complete. 2023-08-17T17:49:56.577 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:49:56.586 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:49:55.973581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2409680,"kb_used_data":8336,"kb_used_omap":0,"kb_used_meta":2401280,"kb_avail":752565040,"statfs":{"total":773094113280,"available":770626600960,"internally_reserved":0,"allocated":8536064,"data_stored":4182324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458910720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10153,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.566444"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.246224+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242958+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244753+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242183+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241407+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243729+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239829+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243758+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240572+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239773+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244156+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241380+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244050+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240915+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244943+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239856+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242233+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241418+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242863+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244416+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239702+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239040+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242346+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242324+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238323+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240429+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243532+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238343+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.245281+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240318+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238561+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243332+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241860+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243820+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.245171+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244298+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238189+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239816+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244025+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240933+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243847+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239218+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241064+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243409+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238445+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242668+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240415+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243991+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238635+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244840+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244734+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243281+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242441+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240520+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242979+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241049+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240660+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801537+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:49:49.801537+0000","last_peered":"2023-08-17T17:49:49.801537+0000","last_clean":"2023-08-17T17:49:49.801537+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:49:49.801537+0000","last_undegraded":"2023-08-17T17:49:49.801537+0000","last_fullsized":"2023-08-17T17:49:49.801537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243503+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801791+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:49:49.801791+0000","last_peered":"2023-08-17T17:49:49.801791+0000","last_clean":"2023-08-17T17:49:49.801791+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:49:49.801791+0000","last_undegraded":"2023-08-17T17:49:49.801791+0000","last_fullsized":"2023-08-17T17:49:49.801791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243451+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.556953+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:49:49.556953+0000","last_peered":"2023-08-17T17:49:49.556953+0000","last_clean":"2023-08-17T17:49:49.556953+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:49:49.556953+0000","last_undegraded":"2023-08-17T17:49:49.556953+0000","last_fullsized":"2023-08-17T17:49:49.556953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243509+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801763+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:49:49.801763+0000","last_peered":"2023-08-17T17:49:49.801763+0000","last_clean":"2023-08-17T17:49:49.801763+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:49:49.801763+0000","last_undegraded":"2023-08-17T17:49:49.801763+0000","last_fullsized":"2023-08-17T17:49:49.801763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.558432+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:49:49.558432+0000","last_peered":"2023-08-17T17:49:49.558432+0000","last_clean":"2023-08-17T17:49:49.558432+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:49:49.558432+0000","last_undegraded":"2023-08-17T17:49:49.558432+0000","last_fullsized":"2023-08-17T17:49:49.558432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243581+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.558435+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:49:49.558435+0000","last_peered":"2023-08-17T17:49:49.558435+0000","last_clean":"2023-08-17T17:49:49.558435+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:49:49.558435+0000","last_undegraded":"2023-08-17T17:49:49.558435+0000","last_fullsized":"2023-08-17T17:49:49.558435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241807+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.558432+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:49:49.558432+0000","last_peered":"2023-08-17T17:49:49.558432+0000","last_clean":"2023-08-17T17:49:49.558432+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:49:49.558432+0000","last_undegraded":"2023-08-17T17:49:49.558432+0000","last_fullsized":"2023-08-17T17:49:49.558432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243310+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801531+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:49:49.801531+0000","last_peered":"2023-08-17T17:49:49.801531+0000","last_clean":"2023-08-17T17:49:49.801531+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:49:49.801531+0000","last_undegraded":"2023-08-17T17:49:49.801531+0000","last_fullsized":"2023-08-17T17:49:49.801531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238927+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801536+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:49:49.801536+0000","last_peered":"2023-08-17T17:49:49.801536+0000","last_clean":"2023-08-17T17:49:49.801536+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:49:49.801536+0000","last_undegraded":"2023-08-17T17:49:49.801536+0000","last_fullsized":"2023-08-17T17:49:49.801536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.61899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.745},{"interface":"front","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.69299999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77500000000000002,"15min":0.80000000000000004},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63200000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":1.23,"15min":1.23},"last":0.88}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.64500000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.621}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.75700000000000001,"15min":0.95999999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.755}]},{"osd":6,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73199999999999998,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72699999999999998,"5min":0.79400000000000004,"15min":0.90200000000000002},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85599999999999998,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66700000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.755,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.65700000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.879,"15min":1.0609999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.60299999999999998},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80100000000000005,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.26800000000000002},"max":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.77300000000000002,"15min":1.026},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.34200000000000003},"max":{"1min":0.81299999999999994,"5min":1.51,"15min":1.51},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.872,"15min":1.0740000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.58199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47099999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.378,"15min":0.373},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.40400000000000003,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.60399999999999998,"5min":0.625,"15min":0.66600000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40899999999999997,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.53600000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.624,"15min":0.622},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":1.2989999999999999,"15min":1.331},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2629999999999999,"15min":1.345},"last":0.752},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83599999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.89900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52600000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.65200000000000002},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.66200000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.65700000000000003},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.97999999999999998,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.443},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.432},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.87,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.88300000000000001,"5min":1.677,"15min":1.677},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.087,"5min":1.51,"15min":1.51},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0069999999999999,"5min":1.325,"15min":1.391},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89600000000000002,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.544},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.49399999999999999,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45200000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.40100000000000002},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51800000000000002,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.38},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54800000000000004,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.311,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.52300000000000002,"5min":1.268,"15min":1.268},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.98799999999999999,"5min":1.417,"15min":1.417},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2869999999999999,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.2629999999999999,"5min":1.544,"15min":1.544},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":1.232,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0840000000000001,"5min":1.415,"15min":1.415},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68500000000000005,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88600000000000001,"5min":2.984,"15min":2.984},"last":0.504},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":0.45700000000000002,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.245,"5min":0.245,"15min":0.224},"max":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.71799999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.378},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.39200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":0.54600000000000004,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.439,"15min":0.42399999999999999},"min":{"1min":0.32200000000000001,"5min":0.245,"15min":0.245},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.378}]},{"osd":4,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.89000000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1989999999999998,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.626,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.466,"15min":1.466},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.48,"15min":1.48},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"max":{"1min":3.4780000000000002,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.58399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.012,"5min":1.252,"15min":1.252},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.47799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.28199999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66500000000000004,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35699999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.378},{"interface":"front","average":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.373,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.91900000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78000000000000003,"5min":0.877,"15min":1.056},"last":0.42199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575034,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.27700000000000002},"max":{"1min":0.66300000000000003,"5min":1.165,"15min":1.2609999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.31},"max":{"1min":0.627,"5min":1.022,"15min":1.1499999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.29599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.242},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":1.0580000000000001,"15min":1.252},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":1.153,"15min":1.274},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.379},"max":{"1min":0.68799999999999994,"5min":1.0920000000000001,"15min":1.179},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.3080000000000001},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.747,"5min":0.75,"15min":1.0620000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.497,"15min":0.495},"min":{"1min":0.314,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":0.78300000000000003,"15min":1.0740000000000001},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":1.01},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.1020000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.73599999999999999,"5min":0.82299999999999995,"15min":1.038},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.1279999999999999},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:49:56.593 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:49:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.737+0000 7f50b7174700 1 Processor -- start 2023-08-17T17:49:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.737+0000 7f50b7174700 1 -- start start 2023-08-17T17:49:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b7174700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50b01575e0 0x7f50b0095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b7174700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b0096720 con 0x7f50b0157200 2023-08-17T17:49:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b7174700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b00c57f0 con 0x7f50b0096300 2023-08-17T17:49:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b7174700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b00c5ad0 con 0x7f50b01575e0 2023-08-17T17:49:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b5971700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50b01575e0 0x7f50b0095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b5971700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50b01575e0 0x7f50b0095e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45032/0 (socket says 172.21.15.78:45032) 2023-08-17T17:49:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b5971700 1 -- 172.21.15.78:0/192872193 learned_addr learned my addr 172.21.15.78:0/192872193 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b6172700 1 --1- 172.21.15.78:0/192872193 >> v1:172.21.15.78:6789/0 conn(0x7f50b0157200 0x7f50b00a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44674/0 (socket says 172.21.15.78:44674) 2023-08-17T17:49:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b5971700 1 -- 172.21.15.78:0/192872193 >> v1:172.21.15.150:6789/0 conn(0x7f50b0096300 legacy=0x7f50b0064380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b5971700 1 -- 172.21.15.78:0/192872193 >> v1:172.21.15.78:6789/0 conn(0x7f50b0157200 legacy=0x7f50b00a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.738+0000 7f50b5170700 1 -- 172.21.15.78:0/192872193 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830562839 0 0) 0x7f50b0096720 con 0x7f50b0157200 2023-08-17T17:49:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b5971700 1 -- 172.21.15.78:0/192872193 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00c5db0 con 0x7f50b01575e0 2023-08-17T17:49:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b5971700 1 --2- 172.21.15.78:0/192872193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 0x7f50b0095e10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f50a0006fd0 tx=0x7f50a00090f0).ready entity=mon.0 client_cookie=43dda7728ac34acf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b5170700 1 -- 172.21.15.78:0/192872193 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a000b600 con 0x7f50b01575e0 2023-08-17T17:49:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b5170700 1 -- 172.21.15.78:0/192872193 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a000b760 con 0x7f50b01575e0 2023-08-17T17:49:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b5170700 1 -- 172.21.15.78:0/192872193 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a000bae0 con 0x7f50b01575e0 2023-08-17T17:49:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b7174700 1 -- 172.21.15.78:0/192872193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 msgr2=0x7f50b0095e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b7174700 1 --2- 172.21.15.78:0/192872193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 0x7f50b0095e10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f50a0006fd0 tx=0x7f50a00090f0).stop 2023-08-17T17:49:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b7174700 1 -- 172.21.15.78:0/192872193 shutdown_connections 2023-08-17T17:49:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b7174700 1 --2- 172.21.15.78:0/192872193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 0x7f50b0095e10 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b7174700 1 -- 172.21.15.78:0/192872193 >> 172.21.15.78:0/192872193 conn(0x7f50b00624f0 msgr2=0x7f50b0062900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b7174700 1 -- 172.21.15.78:0/192872193 shutdown_connections 2023-08-17T17:49:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.739+0000 7f50b7174700 1 -- 172.21.15.78:0/192872193 wait complete. 2023-08-17T17:49:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.740+0000 7f50b7174700 1 Processor -- start 2023-08-17T17:49:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.740+0000 7f50b7174700 1 -- start start 2023-08-17T17:49:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b7174700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50b0096300 0x7f50b0165450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b7174700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50b0157200 0x7f50b01676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b7174700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 0x7f50b0150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b7174700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0151a90 con 0x7f50b01575e0 2023-08-17T17:49:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b7174700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0165940 con 0x7f50b0096300 2023-08-17T17:49:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b7174700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b014e9d0 con 0x7f50b0157200 2023-08-17T17:49:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b6973700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 0x7f50b0150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b6973700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 0x7f50b0150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45038/0 (socket says 172.21.15.78:45038) 2023-08-17T17:49:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b6973700 1 -- 172.21.15.78:0/3520813770 learned_addr learned my addr 172.21.15.78:0/3520813770 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b6172700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50b0096300 0x7f50b0165450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.741+0000 7f50b5971700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50b0157200 0x7f50b01676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50b6973700 1 -- 172.21.15.78:0/3520813770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50b0157200 msgr2=0x7f50b01676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50b6973700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50b0157200 0x7f50b01676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50b6973700 1 -- 172.21.15.78:0/3520813770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50b0096300 msgr2=0x7f50b0165450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50b6973700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50b0096300 0x7f50b0165450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50b6973700 1 -- 172.21.15.78:0/3520813770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a0009370 con 0x7f50b01575e0 2023-08-17T17:49:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50b6973700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 0x7f50b0150300 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f50a8002230 tx=0x7f50a80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50a67fc700 1 -- 172.21.15.78:0/3520813770 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800e4a0 con 0x7f50b01575e0 2023-08-17T17:49:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50a67fc700 1 -- 172.21.15.78:0/3520813770 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800e600 con 0x7f50b01575e0 2023-08-17T17:49:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50a67fc700 1 -- 172.21.15.78:0/3520813770 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800e980 con 0x7f50b01575e0 2023-08-17T17:49:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50b7174700 1 -- 172.21.15.78:0/3520813770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b014ecb0 con 0x7f50b01575e0 2023-08-17T17:49:56.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.742+0000 7f50b7174700 1 -- 172.21.15.78:0/3520813770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b0151720 con 0x7f50b01575e0 2023-08-17T17:49:56.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.743+0000 7f50b7174700 1 -- 172.21.15.78:0/3520813770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b0065220 con 0x7f50b01575e0 2023-08-17T17:49:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.743+0000 7f50a67fc700 1 -- 172.21.15.78:0/3520813770 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f50a8019030 con 0x7f50b01575e0 2023-08-17T17:49:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.743+0000 7f50a67fc700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f509405ed90 0x7f5094061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.744+0000 7f50a67fc700 1 -- 172.21.15.78:0/3520813770 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f50a8079050 con 0x7f50b01575e0 2023-08-17T17:49:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.744+0000 7f50b6172700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f509405ed90 0x7f5094061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.744+0000 7f50b6172700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f509405ed90 0x7f5094061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f50b01535b0 tx=0x7f50ac007bb0).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.747+0000 7f50a67fc700 1 -- 172.21.15.78:0/3520813770 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f50a80488f0 con 0x7f50b01575e0 2023-08-17T17:49:56.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.907+0000 7f50b7174700 1 -- 172.21.15.78:0/3520813770 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50b00bf3e0 con 0x7f509405ed90 2023-08-17T17:49:56.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.916+0000 7f50a67fc700 1 -- 172.21.15.78:0/3520813770 <== mgr.6522 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352482 (secure 0 0 0) 0x7f50b00bf3e0 con 0x7f509405ed90 2023-08-17T17:49:56.921 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:56.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.919+0000 7f50b7174700 1 -- 172.21.15.78:0/3520813770 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f509405ed90 msgr2=0x7f5094061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.919+0000 7f50b7174700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f509405ed90 0x7f5094061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f50b01535b0 tx=0x7f50ac007bb0).stop 2023-08-17T17:49:56.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.920+0000 7f50b7174700 1 -- 172.21.15.78:0/3520813770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 msgr2=0x7f50b0150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:56.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.920+0000 7f50b7174700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 0x7f50b0150300 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f50a8002230 tx=0x7f50a80015e0).stop 2023-08-17T17:49:56.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.920+0000 7f50b7174700 1 -- 172.21.15.78:0/3520813770 shutdown_connections 2023-08-17T17:49:56.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.920+0000 7f50b7174700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f509405ed90 0x7f5094061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.920+0000 7f50b7174700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b01575e0 0x7f50b0150300 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.920+0000 7f50b7174700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50b0096300 0x7f50b0165450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.920+0000 7f50b7174700 1 --2- 172.21.15.78:0/3520813770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50b0157200 0x7f50b01676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:56.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.920+0000 7f50b7174700 1 -- 172.21.15.78:0/3520813770 >> 172.21.15.78:0/3520813770 conn(0x7f50b00624f0 msgr2=0x7f50b00678d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:56.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.920+0000 7f50b7174700 1 -- 172.21.15.78:0/3520813770 shutdown_connections 2023-08-17T17:49:56.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:56.920+0000 7f50b7174700 1 -- 172.21.15.78:0/3520813770 wait complete. 2023-08-17T17:49:56.924 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:49:56.933 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:49:55.973581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2409680,"kb_used_data":8336,"kb_used_omap":0,"kb_used_meta":2401280,"kb_avail":752565040,"statfs":{"total":773094113280,"available":770626600960,"internally_reserved":0,"allocated":8536064,"data_stored":4182324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458910720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10153,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.566444"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.246224+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242958+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244753+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242183+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241407+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243729+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239829+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243758+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240572+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239773+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244156+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241380+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244050+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240915+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244943+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239856+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242233+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241418+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242863+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244416+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239702+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239040+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242346+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242324+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238323+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240429+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243532+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238343+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.245281+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240318+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238561+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243332+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241860+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243820+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.245171+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244298+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238189+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239816+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244025+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240933+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243847+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239218+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241064+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243409+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238445+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242668+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240415+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243991+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238635+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244840+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244734+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243281+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242441+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240520+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242979+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241049+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240660+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801537+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:49:49.801537+0000","last_peered":"2023-08-17T17:49:49.801537+0000","last_clean":"2023-08-17T17:49:49.801537+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:49:49.801537+0000","last_undegraded":"2023-08-17T17:49:49.801537+0000","last_fullsized":"2023-08-17T17:49:49.801537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243503+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801791+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:49:49.801791+0000","last_peered":"2023-08-17T17:49:49.801791+0000","last_clean":"2023-08-17T17:49:49.801791+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:49:49.801791+0000","last_undegraded":"2023-08-17T17:49:49.801791+0000","last_fullsized":"2023-08-17T17:49:49.801791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243451+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.556953+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:49:49.556953+0000","last_peered":"2023-08-17T17:49:49.556953+0000","last_clean":"2023-08-17T17:49:49.556953+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:49:49.556953+0000","last_undegraded":"2023-08-17T17:49:49.556953+0000","last_fullsized":"2023-08-17T17:49:49.556953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243509+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801763+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:49:49.801763+0000","last_peered":"2023-08-17T17:49:49.801763+0000","last_clean":"2023-08-17T17:49:49.801763+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:49:49.801763+0000","last_undegraded":"2023-08-17T17:49:49.801763+0000","last_fullsized":"2023-08-17T17:49:49.801763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.558432+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:49:49.558432+0000","last_peered":"2023-08-17T17:49:49.558432+0000","last_clean":"2023-08-17T17:49:49.558432+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:49:49.558432+0000","last_undegraded":"2023-08-17T17:49:49.558432+0000","last_fullsized":"2023-08-17T17:49:49.558432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243581+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.558435+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:49:49.558435+0000","last_peered":"2023-08-17T17:49:49.558435+0000","last_clean":"2023-08-17T17:49:49.558435+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:49:49.558435+0000","last_undegraded":"2023-08-17T17:49:49.558435+0000","last_fullsized":"2023-08-17T17:49:49.558435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241807+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.558432+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:49:49.558432+0000","last_peered":"2023-08-17T17:49:49.558432+0000","last_clean":"2023-08-17T17:49:49.558432+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:49:49.558432+0000","last_undegraded":"2023-08-17T17:49:49.558432+0000","last_fullsized":"2023-08-17T17:49:49.558432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243310+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801531+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:49:49.801531+0000","last_peered":"2023-08-17T17:49:49.801531+0000","last_clean":"2023-08-17T17:49:49.801531+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:49:49.801531+0000","last_undegraded":"2023-08-17T17:49:49.801531+0000","last_fullsized":"2023-08-17T17:49:49.801531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238927+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801536+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:49:49.801536+0000","last_peered":"2023-08-17T17:49:49.801536+0000","last_clean":"2023-08-17T17:49:49.801536+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:49:49.801536+0000","last_undegraded":"2023-08-17T17:49:49.801536+0000","last_fullsized":"2023-08-17T17:49:49.801536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.61899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.745},{"interface":"front","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.69299999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77500000000000002,"15min":0.80000000000000004},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63200000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":1.23,"15min":1.23},"last":0.88}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.64500000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.621}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.75700000000000001,"15min":0.95999999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.755}]},{"osd":6,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73199999999999998,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72699999999999998,"5min":0.79400000000000004,"15min":0.90200000000000002},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85599999999999998,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66700000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.755,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.65700000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.879,"15min":1.0609999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.60299999999999998},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80100000000000005,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.26800000000000002},"max":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.77300000000000002,"15min":1.026},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.34200000000000003},"max":{"1min":0.81299999999999994,"5min":1.51,"15min":1.51},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.872,"15min":1.0740000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.58199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47099999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.378,"15min":0.373},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.40400000000000003,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.60399999999999998,"5min":0.625,"15min":0.66600000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40899999999999997,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.53600000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.624,"15min":0.622},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":1.2989999999999999,"15min":1.331},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2629999999999999,"15min":1.345},"last":0.752},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83599999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.89900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52600000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.65200000000000002},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.66200000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.65700000000000003},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.97999999999999998,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.443},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.432},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.87,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.88300000000000001,"5min":1.677,"15min":1.677},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.087,"5min":1.51,"15min":1.51},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0069999999999999,"5min":1.325,"15min":1.391},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89600000000000002,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.544},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.49399999999999999,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45200000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.40100000000000002},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51800000000000002,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.38},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54800000000000004,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.311,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.52300000000000002,"5min":1.268,"15min":1.268},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.98799999999999999,"5min":1.417,"15min":1.417},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2869999999999999,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.2629999999999999,"5min":1.544,"15min":1.544},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":1.232,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0840000000000001,"5min":1.415,"15min":1.415},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68500000000000005,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88600000000000001,"5min":2.984,"15min":2.984},"last":0.504},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":0.45700000000000002,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.245,"5min":0.245,"15min":0.224},"max":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.71799999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.378},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.39200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":0.54600000000000004,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.439,"15min":0.42399999999999999},"min":{"1min":0.32200000000000001,"5min":0.245,"15min":0.245},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.378}]},{"osd":4,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.89000000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1989999999999998,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.626,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.466,"15min":1.466},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.48,"15min":1.48},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"max":{"1min":3.4780000000000002,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.58399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.012,"5min":1.252,"15min":1.252},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.47799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.28199999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66500000000000004,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35699999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.378},{"interface":"front","average":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.373,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.91900000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78000000000000003,"5min":0.877,"15min":1.056},"last":0.42199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575034,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.27700000000000002},"max":{"1min":0.66300000000000003,"5min":1.165,"15min":1.2609999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.31},"max":{"1min":0.627,"5min":1.022,"15min":1.1499999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.29599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.242},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":1.0580000000000001,"15min":1.252},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":1.153,"15min":1.274},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.379},"max":{"1min":0.68799999999999994,"5min":1.0920000000000001,"15min":1.179},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.3080000000000001},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.747,"5min":0.75,"15min":1.0620000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.497,"15min":0.495},"min":{"1min":0.314,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":0.78300000000000003,"15min":1.0740000000000001},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":1.01},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.1020000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.73599999999999999,"5min":0.82299999999999995,"15min":1.038},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.1279999999999999},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:49:56.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:49:57.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.085+0000 7f8e0c323700 1 Processor -- start 2023-08-17T17:49:57.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.085+0000 7f8e0c323700 1 -- start start 2023-08-17T17:49:57.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0c323700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8e04062c00 0x7f8e04151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0c323700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e040c6040 con 0x7f8e04066a40 2023-08-17T17:49:57.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0c323700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e04069b00 con 0x7f8e04066660 2023-08-17T17:49:57.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0c323700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e04069f90 con 0x7f8e04062c00 2023-08-17T17:49:57.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0a8c0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8e04062c00 0x7f8e04151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0a8c0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8e04062c00 0x7f8e04151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45044/0 (socket says 172.21.15.78:45044) 2023-08-17T17:49:57.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e098be700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8e04066a40 0x7f8e040624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44686/0 (socket says 172.21.15.78:44686) 2023-08-17T17:49:57.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0a8c0700 1 -- 172.21.15.78:0/679248035 learned_addr learned my addr 172.21.15.78:0/679248035 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:57.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0a8c0700 1 -- 172.21.15.78:0/679248035 >> v1:172.21.15.150:6789/0 conn(0x7f8e04066660 legacy=0x7f8e040c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:57.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0a8c0700 1 -- 172.21.15.78:0/679248035 >> v1:172.21.15.78:6789/0 conn(0x7f8e04066a40 legacy=0x7f8e040624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0a8c0700 1 -- 172.21.15.78:0/679248035 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e040c5d70 con 0x7f8e04062c00 2023-08-17T17:49:57.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e090bd700 1 -- 172.21.15.78:0/679248035 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084243841 0 0) 0x7f8df4001110 con 0x7f8e04066a40 2023-08-17T17:49:57.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e0a8c0700 1 --2- 172.21.15.78:0/679248035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04062c00 0x7f8e04151570 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f8dfc009f20 tx=0x7f8dfc009840).ready entity=mon.0 client_cookie=82eb18c5a5a48b6c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:57.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e090bd700 1 -- 172.21.15.78:0/679248035 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00e070 con 0x7f8e04062c00 2023-08-17T17:49:57.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e090bd700 1 -- 172.21.15.78:0/679248035 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc00ba40 con 0x7f8e04062c00 2023-08-17T17:49:57.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.086+0000 7f8e090bd700 1 -- 172.21.15.78:0/679248035 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00bdc0 con 0x7f8e04062c00 2023-08-17T17:49:57.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.087+0000 7f8e0c323700 1 -- 172.21.15.78:0/679248035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04062c00 msgr2=0x7f8e04151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.087+0000 7f8e0c323700 1 --2- 172.21.15.78:0/679248035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04062c00 0x7f8e04151570 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f8dfc009f20 tx=0x7f8dfc009840).stop 2023-08-17T17:49:57.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.087+0000 7f8e0c323700 1 -- 172.21.15.78:0/679248035 shutdown_connections 2023-08-17T17:49:57.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.087+0000 7f8e0c323700 1 --2- 172.21.15.78:0/679248035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04062c00 0x7f8e04151570 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.087+0000 7f8e0c323700 1 -- 172.21.15.78:0/679248035 >> 172.21.15.78:0/679248035 conn(0x7f8e040c7b00 msgr2=0x7f8e040c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:57.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.087+0000 7f8e0c323700 1 -- 172.21.15.78:0/679248035 shutdown_connections 2023-08-17T17:49:57.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.087+0000 7f8e0c323700 1 -- 172.21.15.78:0/679248035 wait complete. 2023-08-17T17:49:57.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.088+0000 7f8e0c323700 1 Processor -- start 2023-08-17T17:49:57.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.088+0000 7f8e0c323700 1 -- start start 2023-08-17T17:49:57.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0c323700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e04062c00 0x7f8e040ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0c323700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04066660 0x7f8e04167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0c323700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e04066a40 0x7f8e04150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0c323700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04165830 con 0x7f8e04066660 2023-08-17T17:49:57.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0c323700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e041681e0 con 0x7f8e04062c00 2023-08-17T17:49:57.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0c323700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04168460 con 0x7f8e04066a40 2023-08-17T17:49:57.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e098be700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04066660 0x7f8e04167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e098be700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04066660 0x7f8e04167cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45060/0 (socket says 172.21.15.78:45060) 2023-08-17T17:49:57.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e098be700 1 -- 172.21.15.78:0/4140329167 learned_addr learned my addr 172.21.15.78:0/4140329167 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:57.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0a8c0700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e04066a40 0x7f8e04150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e098be700 1 -- 172.21.15.78:0/4140329167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e04066a40 msgr2=0x7f8e04150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0a0bf700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e04062c00 0x7f8e040ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e098be700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e04066a40 0x7f8e04150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e098be700 1 -- 172.21.15.78:0/4140329167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e04062c00 msgr2=0x7f8e040ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e098be700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e04062c00 0x7f8e040ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e098be700 1 -- 172.21.15.78:0/4140329167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc009ae0 con 0x7f8e04066660 2023-08-17T17:49:57.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0a0bf700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e04062c00 0x7f8e040ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:57.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0a8c0700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e04066a40 0x7f8e04150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:49:57.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e098be700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04066660 0x7f8e04167cf0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f8df400c490 tx=0x7f8df4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:57.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8dfa7fc700 1 -- 172.21.15.78:0/4140329167 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df40072e0 con 0x7f8e04066660 2023-08-17T17:49:57.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8dfa7fc700 1 -- 172.21.15.78:0/4140329167 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df4007460 con 0x7f8e04066660 2023-08-17T17:49:57.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0c323700 1 -- 172.21.15.78:0/4140329167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e04168740 con 0x7f8e04066660 2023-08-17T17:49:57.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8dfa7fc700 1 -- 172.21.15.78:0/4140329167 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4005930 con 0x7f8e04066660 2023-08-17T17:49:57.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.089+0000 7f8e0c323700 1 -- 172.21.15.78:0/4140329167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e04165a60 con 0x7f8e04066660 2023-08-17T17:49:57.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.090+0000 7f8e0c323700 1 -- 172.21.15.78:0/4140329167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e04047350 con 0x7f8e04066660 2023-08-17T17:49:57.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.091+0000 7f8dfa7fc700 1 -- 172.21.15.78:0/4140329167 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8df401a060 con 0x7f8e04066660 2023-08-17T17:49:57.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.091+0000 7f8dfa7fc700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8de805ed90 0x7f8de8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.091+0000 7f8dfa7fc700 1 -- 172.21.15.78:0/4140329167 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8df40790a0 con 0x7f8e04066660 2023-08-17T17:49:57.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.091+0000 7f8e0a0bf700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8de805ed90 0x7f8de8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.092+0000 7f8e0a0bf700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8de805ed90 0x7f8de8061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8e000026f0 tx=0x7f8e00009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:57.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.095+0000 7f8dfa7fc700 1 -- 172.21.15.78:0/4140329167 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8df404a640 con 0x7f8e04066660 2023-08-17T17:49:57.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.255+0000 7f8e0c323700 1 -- 172.21.15.78:0/4140329167 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e040c6040 con 0x7f8de805ed90 2023-08-17T17:49:57.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.264+0000 7f8dfa7fc700 1 -- 172.21.15.78:0/4140329167 <== mgr.6522 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352482 (secure 0 0 0) 0x7f8e040c6040 con 0x7f8de805ed90 2023-08-17T17:49:57.269 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 -- 172.21.15.78:0/4140329167 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8de805ed90 msgr2=0x7f8de8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8de805ed90 0x7f8de8061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8e000026f0 tx=0x7f8e00009040).stop 2023-08-17T17:49:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 -- 172.21.15.78:0/4140329167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04066660 msgr2=0x7f8e04167cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04066660 0x7f8e04167cf0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f8df400c490 tx=0x7f8df4007db0).stop 2023-08-17T17:49:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 -- 172.21.15.78:0/4140329167 shutdown_connections 2023-08-17T17:49:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8de805ed90 0x7f8de8061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e04066a40 0x7f8e04150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e04062c00 0x7f8e040ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 --2- 172.21.15.78:0/4140329167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e04066660 0x7f8e04167cf0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 -- 172.21.15.78:0/4140329167 >> 172.21.15.78:0/4140329167 conn(0x7f8e040c7b00 msgr2=0x7f8e04155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 -- 172.21.15.78:0/4140329167 shutdown_connections 2023-08-17T17:49:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.268+0000 7f8e0c323700 1 -- 172.21.15.78:0/4140329167 wait complete. 2023-08-17T17:49:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:49:57.281 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:49:55.973581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2409680,"kb_used_data":8336,"kb_used_omap":0,"kb_used_meta":2401280,"kb_avail":752565040,"statfs":{"total":773094113280,"available":770626600960,"internally_reserved":0,"allocated":8536064,"data_stored":4182324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458910720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10153,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.566444"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.246224+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242958+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244753+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242183+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241407+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243729+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239829+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243758+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240572+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239773+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244156+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241380+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244050+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240915+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244943+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239856+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242233+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241418+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242863+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244416+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239702+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239040+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242346+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242324+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238323+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240429+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243532+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238343+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.245281+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240318+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238561+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243332+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241860+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243820+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.245171+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244298+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238189+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239816+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244025+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240933+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243847+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239218+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241064+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243409+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238445+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242668+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240415+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243991+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238635+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244840+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244734+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243281+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242441+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240520+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242979+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241049+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240660+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801537+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:49:49.801537+0000","last_peered":"2023-08-17T17:49:49.801537+0000","last_clean":"2023-08-17T17:49:49.801537+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:49:49.801537+0000","last_undegraded":"2023-08-17T17:49:49.801537+0000","last_fullsized":"2023-08-17T17:49:49.801537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243503+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801791+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:49:49.801791+0000","last_peered":"2023-08-17T17:49:49.801791+0000","last_clean":"2023-08-17T17:49:49.801791+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:49:49.801791+0000","last_undegraded":"2023-08-17T17:49:49.801791+0000","last_fullsized":"2023-08-17T17:49:49.801791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243451+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.556953+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:49:49.556953+0000","last_peered":"2023-08-17T17:49:49.556953+0000","last_clean":"2023-08-17T17:49:49.556953+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:49:49.556953+0000","last_undegraded":"2023-08-17T17:49:49.556953+0000","last_fullsized":"2023-08-17T17:49:49.556953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243509+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801763+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:49:49.801763+0000","last_peered":"2023-08-17T17:49:49.801763+0000","last_clean":"2023-08-17T17:49:49.801763+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:49:49.801763+0000","last_undegraded":"2023-08-17T17:49:49.801763+0000","last_fullsized":"2023-08-17T17:49:49.801763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.558432+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:49:49.558432+0000","last_peered":"2023-08-17T17:49:49.558432+0000","last_clean":"2023-08-17T17:49:49.558432+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:49:49.558432+0000","last_undegraded":"2023-08-17T17:49:49.558432+0000","last_fullsized":"2023-08-17T17:49:49.558432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243581+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.558435+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:49:49.558435+0000","last_peered":"2023-08-17T17:49:49.558435+0000","last_clean":"2023-08-17T17:49:49.558435+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:49:49.558435+0000","last_undegraded":"2023-08-17T17:49:49.558435+0000","last_fullsized":"2023-08-17T17:49:49.558435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.241807+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.558432+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:49:49.558432+0000","last_peered":"2023-08-17T17:49:49.558432+0000","last_clean":"2023-08-17T17:49:49.558432+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:49:49.558432+0000","last_undegraded":"2023-08-17T17:49:49.558432+0000","last_fullsized":"2023-08-17T17:49:49.558432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243310+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801531+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:49:49.801531+0000","last_peered":"2023-08-17T17:49:49.801531+0000","last_clean":"2023-08-17T17:49:49.801531+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:49:49.801531+0000","last_undegraded":"2023-08-17T17:49:49.801531+0000","last_fullsized":"2023-08-17T17:49:49.801531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238927+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801536+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:49:49.801536+0000","last_peered":"2023-08-17T17:49:49.801536+0000","last_clean":"2023-08-17T17:49:49.801536+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:49:49.801536+0000","last_undegraded":"2023-08-17T17:49:49.801536+0000","last_fullsized":"2023-08-17T17:49:49.801536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.61899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.745},{"interface":"front","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.69299999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77500000000000002,"15min":0.80000000000000004},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63200000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":1.23,"15min":1.23},"last":0.88}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.64500000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.621}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.75700000000000001,"15min":0.95999999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.755}]},{"osd":6,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73199999999999998,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72699999999999998,"5min":0.79400000000000004,"15min":0.90200000000000002},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85599999999999998,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66700000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.755,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.65700000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.879,"15min":1.0609999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.60299999999999998},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80100000000000005,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.26800000000000002},"max":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.77300000000000002,"15min":1.026},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.34200000000000003},"max":{"1min":0.81299999999999994,"5min":1.51,"15min":1.51},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.872,"15min":1.0740000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.58199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47099999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.378,"15min":0.373},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.40400000000000003,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.60399999999999998,"5min":0.625,"15min":0.66600000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40899999999999997,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.53600000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.624,"15min":0.622},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":1.2989999999999999,"15min":1.331},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2629999999999999,"15min":1.345},"last":0.752},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83599999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.89900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52600000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.65200000000000002},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.66200000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.65700000000000003},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.97999999999999998,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.443},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.432},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.87,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.88300000000000001,"5min":1.677,"15min":1.677},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.087,"5min":1.51,"15min":1.51},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0069999999999999,"5min":1.325,"15min":1.391},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89600000000000002,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.544},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.49399999999999999,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45200000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.40100000000000002},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51800000000000002,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.38},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54800000000000004,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.311,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.52300000000000002,"5min":1.268,"15min":1.268},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.98799999999999999,"5min":1.417,"15min":1.417},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2869999999999999,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.2629999999999999,"5min":1.544,"15min":1.544},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":1.232,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0840000000000001,"5min":1.415,"15min":1.415},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68500000000000005,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88600000000000001,"5min":2.984,"15min":2.984},"last":0.504},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":0.45700000000000002,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.245,"5min":0.245,"15min":0.224},"max":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.71799999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.378},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.39200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":0.54600000000000004,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.439,"15min":0.42399999999999999},"min":{"1min":0.32200000000000001,"5min":0.245,"15min":0.245},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.378}]},{"osd":4,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.89000000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1989999999999998,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.626,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.466,"15min":1.466},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.48,"15min":1.48},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"max":{"1min":3.4780000000000002,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.58399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":1073152,"data_stored":525901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.012,"5min":1.252,"15min":1.252},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.47799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.28199999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66500000000000004,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35699999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.378},{"interface":"front","average":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.373,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.91900000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78000000000000003,"5min":0.877,"15min":1.056},"last":0.42199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575034,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.27700000000000002},"max":{"1min":0.66300000000000003,"5min":1.165,"15min":1.2609999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.31},"max":{"1min":0.627,"5min":1.022,"15min":1.1499999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.29599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.242},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":1.0580000000000001,"15min":1.252},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":1.153,"15min":1.274},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.379},"max":{"1min":0.68799999999999994,"5min":1.0920000000000001,"15min":1.179},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.3080000000000001},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.747,"5min":0.75,"15min":1.0620000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.497,"15min":0.495},"min":{"1min":0.314,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":0.78300000000000003,"15min":1.0740000000000001},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":1.01},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.1020000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.73599999999999999,"5min":0.82299999999999995,"15min":1.038},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.1279999999999999},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:49:57.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-08-17T17:49:57.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-08-17T17:49:57.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.246224+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-08-17T17:49:57.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-08-17T17:49:57.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.242958+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:57.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-08-17T17:49:57.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-08-17T17:49:57.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.244753+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:49:57.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-08-17T17:49:57.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-08-17T17:49:57.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.242183+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:49:57.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-08-17T17:49:57.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-08-17T17:49:57.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.241407+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:57.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-08-17T17:49:57.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-08-17T17:49:57.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243729+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:57.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-08-17T17:49:57.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-08-17T17:49:57.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.239829+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:49:57.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-08-17T17:49:57.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-08-17T17:49:57.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243758+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:57.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-08-17T17:49:57.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-08-17T17:49:57.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.240572+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:57.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-08-17T17:49:57.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-08-17T17:49:57.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.239773+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:49:57.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-08-17T17:49:57.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-08-17T17:49:57.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.244156+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-08-17T17:49:57.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-08-17T17:49:57.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.241380+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:49:57.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-08-17T17:49:57.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-08-17T17:49:57.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.244050+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:49:57.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-08-17T17:49:57.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-08-17T17:49:57.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.240915+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:57.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-08-17T17:49:57.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-08-17T17:49:57.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.244943+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:49:57.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-08-17T17:49:57.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-08-17T17:49:57.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.239856+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:49:57.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-08-17T17:49:57.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-08-17T17:49:57.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.242233+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:57.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-08-17T17:49:57.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-08-17T17:49:57.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.241418+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:49:57.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-08-17T17:49:57.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-08-17T17:49:57.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.242863+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:57.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-08-17T17:49:57.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-08-17T17:49:57.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.244416+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:49:57.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-08-17T17:49:57.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-08-17T17:49:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.239702+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:49:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-08-17T17:49:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-08-17T17:49:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.239040+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:49:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-08-17T17:49:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-08-17T17:49:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.242346+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-08-17T17:49:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-08-17T17:49:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.242324+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-08-17T17:49:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-08-17T17:49:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.238323+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:49:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-08-17T17:49:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-08-17T17:49:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.240429+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:49:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-08-17T17:49:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-08-17T17:49:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243532+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:49:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-08-17T17:49:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-08-17T17:49:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.238343+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:49:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-08-17T17:49:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-08-17T17:49:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.245281+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:49:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-08-17T17:49:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-08-17T17:49:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.240318+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:49:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-08-17T17:49:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-08-17T17:49:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.238561+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:49:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-08-17T17:49:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-08-17T17:49:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243332+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-08-17T17:49:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-08-17T17:49:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.241860+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-08-17T17:49:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-08-17T17:49:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243820+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-08-17T17:49:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-08-17T17:49:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.245171+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-08-17T17:49:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-08-17T17:49:57.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.244298+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:57.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-08-17T17:49:57.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-08-17T17:49:57.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.238189+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:49:57.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-08-17T17:49:57.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-08-17T17:49:57.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.239816+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:49:57.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-08-17T17:49:57.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-08-17T17:49:57.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.244025+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:49:57.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-08-17T17:49:57.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-08-17T17:49:57.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.240933+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:57.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-08-17T17:49:57.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-08-17T17:49:57.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243847+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-08-17T17:49:57.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-08-17T17:49:57.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.239218+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:49:57.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-08-17T17:49:57.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-08-17T17:49:57.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.241064+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:57.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-08-17T17:49:57.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-08-17T17:49:57.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243409+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:57.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-08-17T17:49:57.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-08-17T17:49:57.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.238445+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:49:57.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-08-17T17:49:57.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-08-17T17:49:57.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.242668+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-08-17T17:49:57.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-08-17T17:49:57.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.240415+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:57.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-08-17T17:49:57.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-08-17T17:49:57.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243991+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:49:57.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-08-17T17:49:57.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-08-17T17:49:57.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.238635+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:49:57.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-08-17T17:49:57.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-08-17T17:49:57.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.244840+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:49:57.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-08-17T17:49:57.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-08-17T17:49:57.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.244734+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-08-17T17:49:57.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-08-17T17:49:57.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243281+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-08-17T17:49:57.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-08-17T17:49:57.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.242441+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:57.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-08-17T17:49:57.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-08-17T17:49:57.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.240520+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:57.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-08-17T17:49:57.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-08-17T17:49:57.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.242979+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:49:57.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-08-17T17:49:57.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-08-17T17:49:57.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.241049+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:49:57.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-08-17T17:49:57.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-08-17T17:49:57.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.240660+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:49:57.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-08-17T17:49:57.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-08-17T17:49:57.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243503+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:49:57.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-08-17T17:49:57.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-08-17T17:49:57.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243451+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:49:57.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-08-17T17:49:57.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-08-17T17:49:57.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243509+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:49:57.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-08-17T17:49:57.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-08-17T17:49:57.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243581+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:49:57.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-08-17T17:49:57.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-08-17T17:49:57.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.241807+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:49:57.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-08-17T17:49:57.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-08-17T17:49:57.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.243310+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:49:57.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-08-17T17:49:57.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:49:53.235692+0000', 'last_change': '2023-08-17T17:49:53.235692+0000', 'last_active': '2023-08-17T17:49:53.235692+0000', 'last_peered': '2023-08-17T17:49:53.235692+0000', 'last_clean': '2023-08-17T17:49:53.235692+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:53.235692+0000', 'last_undegraded': '2023-08-17T17:49:53.235692+0000', 'last_fullsized': '2023-08-17T17:49:53.235692+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:53.235692+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:49:57.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-08-17T17:49:57.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:49:52.233635+0000', 'last_change': '2023-08-17T17:49:52.238927+0000', 'last_active': '2023-08-17T17:49:52.233635+0000', 'last_peered': '2023-08-17T17:49:52.233635+0000', 'last_clean': '2023-08-17T17:49:52.233635+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:49:52.233635+0000', 'last_undegraded': '2023-08-17T17:49:52.233635+0000', 'last_fullsized': '2023-08-17T17:49:52.233635+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'last_clean_scrub_stamp': '2023-08-17T17:49:52.233635+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:49:57.370 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T17:49:57.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.481+0000 7f56a708e700 1 Processor -- start 2023-08-17T17:49:57.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.481+0000 7f56a708e700 1 -- start start 2023-08-17T17:49:57.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.481+0000 7f56a708e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f56a0154090 0x7f56a00c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.481+0000 7f56a708e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154470 0x7f56a00a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.481+0000 7f56a708e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a00aa450 con 0x7f56a00a7d30 2023-08-17T17:49:57.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.481+0000 7f56a708e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a00c8940 con 0x7f56a0154090 2023-08-17T17:49:57.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.481+0000 7f56a708e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00c6860 con 0x7f56a0154470 2023-08-17T17:49:57.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56a4e2a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f56a0154090 0x7f56a00c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56a4e2a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f56a0154090 0x7f56a00c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45070/0 (socket says 172.21.15.78:45070) 2023-08-17T17:49:57.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56a562b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f56a00a7d30 0x7f56a00c07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44690/0 (socket says 172.21.15.78:44690) 2023-08-17T17:49:57.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56a4e2a700 1 -- 172.21.15.78:0/458932824 learned_addr learned my addr 172.21.15.78:0/458932824 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:57.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f5697fff700 1 --2- 172.21.15.78:0/458932824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154470 0x7f56a00a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56a4e2a700 1 -- 172.21.15.78:0/458932824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154470 msgr2=0x7f56a00a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:57.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56a4e2a700 1 --2- 172.21.15.78:0/458932824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154470 0x7f56a00a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56a4e2a700 1 -- 172.21.15.78:0/458932824 >> v1:172.21.15.78:6789/0 conn(0x7f56a00a7d30 legacy=0x7f56a00c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56977fe700 1 -- 172.21.15.78:0/458932824 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376381861 0 0) 0x7f5698001110 con 0x7f56a00a7d30 2023-08-17T17:49:57.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56a4e2a700 1 -- 172.21.15.78:0/458932824 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00aa690 con 0x7f56a0154090 2023-08-17T17:49:57.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f5697fff700 1 --2- 172.21.15.78:0/458932824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154470 0x7f56a00a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:57.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56a4e2a700 1 --2- 172.21.15.78:0/458932824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a0154090 0x7f56a00c8450 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f569c009f20 tx=0x7f569c009840).ready entity=mon.0 client_cookie=d128d520dae0e593 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:57.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56977fe700 1 -- 172.21.15.78:0/458932824 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00e070 con 0x7f56a0154090 2023-08-17T17:49:57.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56977fe700 1 -- 172.21.15.78:0/458932824 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c00ba80 con 0x7f56a0154090 2023-08-17T17:49:57.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.482+0000 7f56977fe700 1 -- 172.21.15.78:0/458932824 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00be00 con 0x7f56a0154090 2023-08-17T17:49:57.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.483+0000 7f56a708e700 1 -- 172.21.15.78:0/458932824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a0154090 msgr2=0x7f56a00c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.483+0000 7f56a708e700 1 --2- 172.21.15.78:0/458932824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a0154090 0x7f56a00c8450 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f569c009f20 tx=0x7f569c009840).stop 2023-08-17T17:49:57.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.483+0000 7f56a708e700 1 -- 172.21.15.78:0/458932824 shutdown_connections 2023-08-17T17:49:57.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.483+0000 7f56a708e700 1 --2- 172.21.15.78:0/458932824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a0154090 0x7f56a00c8450 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.483+0000 7f56a708e700 1 --2- 172.21.15.78:0/458932824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154470 0x7f56a00a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.483+0000 7f56a708e700 1 -- 172.21.15.78:0/458932824 >> 172.21.15.78:0/458932824 conn(0x7f56a0094670 msgr2=0x7f56a006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:57.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.483+0000 7f56a708e700 1 -- 172.21.15.78:0/458932824 shutdown_connections 2023-08-17T17:49:57.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.483+0000 7f56a708e700 1 -- 172.21.15.78:0/458932824 wait complete. 2023-08-17T17:49:57.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.484+0000 7f56a708e700 1 Processor -- start 2023-08-17T17:49:57.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.484+0000 7f56a708e700 1 -- start start 2023-08-17T17:49:57.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a708e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a00a7d30 0x7f56a0164610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a708e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154090 0x7f56a00c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a708e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56a0154470 0x7f56a014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a708e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0165600 con 0x7f56a00a7d30 2023-08-17T17:49:57.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a708e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00c3640 con 0x7f56a0154470 2023-08-17T17:49:57.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a708e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0164b00 con 0x7f56a0154090 2023-08-17T17:49:57.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a4e2a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a00a7d30 0x7f56a0164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a4e2a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a00a7d30 0x7f56a0164610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45078/0 (socket says 172.21.15.78:45078) 2023-08-17T17:49:57.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a4e2a700 1 -- 172.21.15.78:0/1216270038 learned_addr learned my addr 172.21.15.78:0/1216270038 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:57.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f5697fff700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154090 0x7f56a00c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a562b700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56a0154470 0x7f56a014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a4e2a700 1 -- 172.21.15.78:0/1216270038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154090 msgr2=0x7f56a00c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a4e2a700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154090 0x7f56a00c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a4e2a700 1 -- 172.21.15.78:0/1216270038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56a0154470 msgr2=0x7f56a014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a4e2a700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56a0154470 0x7f56a014ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a4e2a700 1 -- 172.21.15.78:0/1216270038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c009ae0 con 0x7f56a00a7d30 2023-08-17T17:49:57.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f5697fff700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154090 0x7f56a00c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:57.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a4e2a700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a00a7d30 0x7f56a0164610 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f569c00c010 tx=0x7f569c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:57.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f5694ff9700 1 -- 172.21.15.78:0/1216270038 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00bbf0 con 0x7f56a00a7d30 2023-08-17T17:49:57.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f5694ff9700 1 -- 172.21.15.78:0/1216270038 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c00bd70 con 0x7f56a00a7d30 2023-08-17T17:49:57.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a708e700 1 -- 172.21.15.78:0/1216270038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a0164d60 con 0x7f56a00a7d30 2023-08-17T17:49:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f5694ff9700 1 -- 172.21.15.78:0/1216270038 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c01e6c0 con 0x7f56a00a7d30 2023-08-17T17:49:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.485+0000 7f56a708e700 1 -- 172.21.15.78:0/1216270038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a0165320 con 0x7f56a00a7d30 2023-08-17T17:49:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.486+0000 7f56a708e700 1 -- 172.21.15.78:0/1216270038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a00c3920 con 0x7f56a00a7d30 2023-08-17T17:49:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.487+0000 7f5694ff9700 1 -- 172.21.15.78:0/1216270038 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f569c025030 con 0x7f56a00a7d30 2023-08-17T17:49:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.487+0000 7f5694ff9700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f568c05ed90 0x7f568c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.487+0000 7f5694ff9700 1 -- 172.21.15.78:0/1216270038 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f569c07b020 con 0x7f56a00a7d30 2023-08-17T17:49:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.487+0000 7f5697fff700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f568c05ed90 0x7f568c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.487+0000 7f5697fff700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f568c05ed90 0x7f568c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f56a006aae0 tx=0x7f5690008040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:57.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.491+0000 7f5694ff9700 1 -- 172.21.15.78:0/1216270038 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f569c04c670 con 0x7f56a00a7d30 2023-08-17T17:49:57.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.720+0000 7f56a708e700 1 -- 172.21.15.78:0/1216270038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f56a0047350 con 0x7f56a00a7d30 2023-08-17T17:49:57.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.721+0000 7f5694ff9700 1 -- 172.21.15.78:0/1216270038 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1108 (secure 0 0 0) 0x7f569c023070 con 0x7f56a00a7d30 2023-08-17T17:49:57.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:57.723 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":951,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":91,"num_osds":8,"num_up_osds":8,"osd_up_since":1692293655,"num_in_osds":8,"osd_in_since":1692293648,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2467512320,"bytes_avail":770626600960,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":31,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6714}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-17T17:48:11.469437+0000","services":{}},"progress_events":{}} 2023-08-17T17:49:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 -- 172.21.15.78:0/1216270038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f568c05ed90 msgr2=0x7f568c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f568c05ed90 0x7f568c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f56a006aae0 tx=0x7f5690008040).stop 2023-08-17T17:49:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 -- 172.21.15.78:0/1216270038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a00a7d30 msgr2=0x7f56a0164610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a00a7d30 0x7f56a0164610 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f569c00c010 tx=0x7f569c009840).stop 2023-08-17T17:49:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 -- 172.21.15.78:0/1216270038 shutdown_connections 2023-08-17T17:49:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f568c05ed90 0x7f568c061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56a0154470 0x7f56a014ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a00a7d30 0x7f56a0164610 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 --2- 172.21.15.78:0/1216270038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56a0154090 0x7f56a00c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 -- 172.21.15.78:0/1216270038 >> 172.21.15.78:0/1216270038 conn(0x7f56a0094670 msgr2=0x7f56a0063150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 -- 172.21.15.78:0/1216270038 shutdown_connections 2023-08-17T17:49:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.723+0000 7f56a708e700 1 -- 172.21.15.78:0/1216270038 wait complete. 2023-08-17T17:49:57.736 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-17T17:49:57.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:49:57.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.847+0000 7f3cd2d7c700 1 Processor -- start 2023-08-17T17:49:57.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.847+0000 7f3cd2d7c700 1 -- start start 2023-08-17T17:49:57.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.848+0000 7f3cd2d7c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3ccc062c00 0x7f3ccc151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.848+0000 7f3cd2d7c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc0c6040 con 0x7f3ccc066a40 2023-08-17T17:49:57.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.848+0000 7f3cd2d7c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc069b00 con 0x7f3ccc066660 2023-08-17T17:49:57.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.848+0000 7f3cd2d7c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ccc069f90 con 0x7f3ccc062c00 2023-08-17T17:49:57.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.848+0000 7f3cc3fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3ccc066a40 0x7f3ccc0624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44706/0 (socket says 172.21.15.78:44706) 2023-08-17T17:49:57.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.848+0000 7f3cc3fff700 1 -- 172.21.15.78:0/664459450 learned_addr learned my addr 172.21.15.78:0/664459450 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:49:57.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cd1319700 1 --2- 172.21.15.78:0/664459450 >> v2:172.21.15.150:3300/0 conn(0x7f3ccc062c00 0x7f3ccc151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365090551 0 0) 0x7f3cbc001110 con 0x7f3ccc066a40 2023-08-17T17:49:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb40033f0 con 0x7f3ccc066a40 2023-08-17T17:49:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 779493935 0 0) 0x7f3cb40033f0 con 0x7f3ccc066a40 2023-08-17T17:49:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 >> v2:172.21.15.150:3300/0 conn(0x7f3ccc062c00 msgr2=0x7f3ccc151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 --2- 172.21.15.78:0/664459450 >> v2:172.21.15.150:3300/0 conn(0x7f3ccc062c00 0x7f3ccc151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 >> v1:172.21.15.150:6789/0 conn(0x7f3ccc066660 legacy=0x7f3ccc0c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0c5d70 con 0x7f3ccc066a40 2023-08-17T17:49:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3cbc001600 con 0x7f3ccc066a40 2023-08-17T17:49:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 >> v1:172.21.15.78:6789/0 conn(0x7f3ccc066a40 legacy=0x7f3ccc0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40038e0 0x7f3cb4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4004690 0x7f3cb4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3cb400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc069f90 con 0x7f3cb4005000 2023-08-17T17:49:57.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb400bf60 con 0x7f3cb40038e0 2023-08-17T17:49:57.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb400c0f0 con 0x7f3cb4004690 2023-08-17T17:49:57.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cd1319700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3cb400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cd0b18700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40038e0 0x7f3cb4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc3fff700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4004690 0x7f3cb4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cd1319700 1 -- 172.21.15.78:0/664459450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4004690 msgr2=0x7f3cb4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:57.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cd1319700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4004690 0x7f3cb4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cd1319700 1 -- 172.21.15.78:0/664459450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40038e0 msgr2=0x7f3cb4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:49:57.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cd1319700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40038e0 0x7f3cb4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cd1319700 1 -- 172.21.15.78:0/664459450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40033f0 con 0x7f3cb4005000 2023-08-17T17:49:57.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.849+0000 7f3cc3fff700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4004690 0x7f3cb4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:57.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cd1319700 1 -- 172.21.15.78:0/664459450 reap_dead start 2023-08-17T17:49:57.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cd1319700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3cb400b8e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f3cc4009a80 tx=0x7f3cc4009060).ready entity=mon.0 client_cookie=a7c18783064bee22 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:57.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4009430 con 0x7f3cb4005000 2023-08-17T17:49:57.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc400e640 con 0x7f3cb4005000 2023-08-17T17:49:57.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cc37fe700 1 -- 172.21.15.78:0/664459450 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc400ea00 con 0x7f3cb4005000 2023-08-17T17:49:57.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/664459450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 msgr2=0x7f3cb400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cd2d7c700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3cb400b8e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f3cc4009a80 tx=0x7f3cc4009060).stop 2023-08-17T17:49:57.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/664459450 shutdown_connections 2023-08-17T17:49:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cd2d7c700 1 --2- 172.21.15.78:0/664459450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3cb400b8e0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/664459450 >> 172.21.15.78:0/664459450 conn(0x7f3ccc0c7b00 msgr2=0x7f3ccc0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/664459450 shutdown_connections 2023-08-17T17:49:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.850+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/664459450 wait complete. 2023-08-17T17:49:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.851+0000 7f3cd2d7c700 1 Processor -- start 2023-08-17T17:49:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd2d7c700 1 -- start start 2023-08-17T17:49:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd2d7c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3ccc0c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd2d7c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ccc0ad230 0x7f3ccc0ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd2d7c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc156ea0 0x7f3ccc157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd2d7c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0adba0 con 0x7f3cb4005000 2023-08-17T17:49:57.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd2d7c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0bf8a0 con 0x7f3ccc156ea0 2023-08-17T17:49:57.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd2d7c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc157810 con 0x7f3ccc0ad230 2023-08-17T17:49:57.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd0b18700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3ccc0c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd0b18700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3ccc0c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45096/0 (socket says 172.21.15.78:45096) 2023-08-17T17:49:57.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd0b18700 1 -- 172.21.15.78:0/756571289 learned_addr learned my addr 172.21.15.78:0/756571289 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:49:57.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.852+0000 7f3cd1319700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc156ea0 0x7f3ccc157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cc3fff700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ccc0ad230 0x7f3ccc0ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cd0b18700 1 -- 172.21.15.78:0/756571289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ccc0ad230 msgr2=0x7f3ccc0ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cd0b18700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ccc0ad230 0x7f3ccc0ad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cd0b18700 1 -- 172.21.15.78:0/756571289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc156ea0 msgr2=0x7f3ccc157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cd0b18700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc156ea0 0x7f3ccc157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cd0b18700 1 -- 172.21.15.78:0/756571289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0c5a50 con 0x7f3cb4005000 2023-08-17T17:49:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cc3fff700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ccc0ad230 0x7f3ccc0ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:49:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cd0b18700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3ccc0c5560 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f3cc800e9c0 tx=0x7f3cc8007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cc0ff9700 1 -- 172.21.15.78:0/756571289 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc800eeb0 con 0x7f3cb4005000 2023-08-17T17:49:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cc0ff9700 1 -- 172.21.15.78:0/756571289 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc8001800 con 0x7f3cb4005000 2023-08-17T17:49:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/756571289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc153210 con 0x7f3cb4005000 2023-08-17T17:49:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cc0ff9700 1 -- 172.21.15.78:0/756571289 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8001b80 con 0x7f3cb4005000 2023-08-17T17:49:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.853+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/756571289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc0bef70 con 0x7f3cb4005000 2023-08-17T17:49:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.854+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/756571289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc047350 con 0x7f3cb4005000 2023-08-17T17:49:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.854+0000 7f3cc0ff9700 1 -- 172.21.15.78:0/756571289 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3cc800c7e0 con 0x7f3cb4005000 2023-08-17T17:49:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.855+0000 7f3cc0ff9700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3cb805ed90 0x7f3cb8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:49:57.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.855+0000 7f3cc0ff9700 1 -- 172.21.15.78:0/756571289 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3cc80797e0 con 0x7f3cb4005000 2023-08-17T17:49:57.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.855+0000 7f3cc3fff700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3cb805ed90 0x7f3cb8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:49:57.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.855+0000 7f3cc3fff700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3cb805ed90 0x7f3cb8061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3ccc168b20 tx=0x7f3cbc009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:49:57.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:57.859+0000 7f3cc0ff9700 1 -- 172.21.15.78:0/756571289 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3cc80498f0 con 0x7f3cb4005000 2023-08-17T17:49:58.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.023+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/756571289 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ccc0bf9e0 con 0x7f3cb805ed90 2023-08-17T17:49:58.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.032+0000 7f3cc0ff9700 1 -- 172.21.15.78:0/756571289 <== mgr.6522 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358770 (secure 0 0 0) 0x7f3cbc0057e0 con 0x7f3cb805ed90 2023-08-17T17:49:58.037 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:49:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/756571289 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3cb805ed90 msgr2=0x7f3cb8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3cb805ed90 0x7f3cb8061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3ccc168b20 tx=0x7f3cbc009040).stop 2023-08-17T17:49:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/756571289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 msgr2=0x7f3ccc0c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:49:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3ccc0c5560 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f3cc800e9c0 tx=0x7f3cc8007f30).stop 2023-08-17T17:49:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/756571289 shutdown_connections 2023-08-17T17:49:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3cb805ed90 0x7f3cb8061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc156ea0 0x7f3ccc157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cb4005000 0x7f3ccc0c5560 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 --2- 172.21.15.78:0/756571289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ccc0ad230 0x7f3ccc0ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:49:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/756571289 >> 172.21.15.78:0/756571289 conn(0x7f3ccc0c7b00 msgr2=0x7f3ccc0a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:49:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/756571289 shutdown_connections 2023-08-17T17:49:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:49:58.036+0000 7f3cd2d7c700 1 -- 172.21.15.78:0/756571289 wait complete. 2023-08-17T17:49:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:49:58.049 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-08-17T17:49:57.973955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1558,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":244,"acting":244,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2414064,"kb_used_data":8624,"kb_used_omap":0,"kb_used_meta":2405376,"kb_avail":752560656,"statfs":{"total":773094113280,"available":770622111744,"internally_reserved":0,"allocated":8830976,"data_stored":4322002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2463105024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10153,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.566444"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638539+0000","last_change":"2023-08-17T17:49:53.631693+0000","last_active":"2023-08-17T17:49:53.638539+0000","last_peered":"2023-08-17T17:49:53.638539+0000","last_clean":"2023-08-17T17:49:53.638539+0000","last_became_active":"2023-08-17T17:49:53.631421+0000","last_became_peered":"2023-08-17T17:49:53.631421+0000","last_unstale":"2023-08-17T17:49:53.638539+0000","last_undegraded":"2023-08-17T17:49:53.638539+0000","last_fullsized":"2023-08-17T17:49:53.638539+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"90'3","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630307+0000","last_change":"2023-08-17T17:49:53.267798+0000","last_active":"2023-08-17T17:49:53.630307+0000","last_peered":"2023-08-17T17:49:53.630307+0000","last_clean":"2023-08-17T17:49:53.630307+0000","last_became_active":"2023-08-17T17:49:53.267515+0000","last_became_peered":"2023-08-17T17:49:53.267515+0000","last_unstale":"2023-08-17T17:49:53.630307+0000","last_undegraded":"2023-08-17T17:49:53.630307+0000","last_fullsized":"2023-08-17T17:49:53.630307+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242958+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.639206+0000","last_change":"2023-08-17T17:49:53.632269+0000","last_active":"2023-08-17T17:49:53.639206+0000","last_peered":"2023-08-17T17:49:53.639206+0000","last_clean":"2023-08-17T17:49:53.639206+0000","last_became_active":"2023-08-17T17:49:53.632017+0000","last_became_peered":"2023-08-17T17:49:53.632017+0000","last_unstale":"2023-08-17T17:49:53.639206+0000","last_undegraded":"2023-08-17T17:49:53.639206+0000","last_fullsized":"2023-08-17T17:49:53.639206+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.614687+0000","last_change":"2023-08-17T17:49:53.262282+0000","last_active":"2023-08-17T17:49:53.614687+0000","last_peered":"2023-08-17T17:49:53.614687+0000","last_clean":"2023-08-17T17:49:53.614687+0000","last_became_active":"2023-08-17T17:49:53.262006+0000","last_became_peered":"2023-08-17T17:49:53.262006+0000","last_unstale":"2023-08-17T17:49:53.614687+0000","last_undegraded":"2023-08-17T17:49:53.614687+0000","last_fullsized":"2023-08-17T17:49:53.614687+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638415+0000","last_change":"2023-08-17T17:49:53.632067+0000","last_active":"2023-08-17T17:49:53.638415+0000","last_peered":"2023-08-17T17:49:53.638415+0000","last_clean":"2023-08-17T17:49:53.638415+0000","last_became_active":"2023-08-17T17:49:53.631808+0000","last_became_peered":"2023-08-17T17:49:53.631808+0000","last_unstale":"2023-08-17T17:49:53.638415+0000","last_undegraded":"2023-08-17T17:49:53.638415+0000","last_fullsized":"2023-08-17T17:49:53.638415+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.640578+0000","last_change":"2023-08-17T17:49:53.271791+0000","last_active":"2023-08-17T17:49:53.640578+0000","last_peered":"2023-08-17T17:49:53.640578+0000","last_clean":"2023-08-17T17:49:53.640578+0000","last_became_active":"2023-08-17T17:49:53.271606+0000","last_became_peered":"2023-08-17T17:49:53.271606+0000","last_unstale":"2023-08-17T17:49:53.640578+0000","last_undegraded":"2023-08-17T17:49:53.640578+0000","last_fullsized":"2023-08-17T17:49:53.640578+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631521+0000","last_change":"2023-08-17T17:49:53.264163+0000","last_active":"2023-08-17T17:49:53.631521+0000","last_peered":"2023-08-17T17:49:53.631521+0000","last_clean":"2023-08-17T17:49:53.631521+0000","last_became_active":"2023-08-17T17:49:53.263880+0000","last_became_peered":"2023-08-17T17:49:53.263880+0000","last_unstale":"2023-08-17T17:49:53.631521+0000","last_undegraded":"2023-08-17T17:49:53.631521+0000","last_fullsized":"2023-08-17T17:49:53.631521+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641066+0000","last_change":"2023-08-17T17:49:53.632465+0000","last_active":"2023-08-17T17:49:53.641066+0000","last_peered":"2023-08-17T17:49:53.641066+0000","last_clean":"2023-08-17T17:49:53.641066+0000","last_became_active":"2023-08-17T17:49:53.632122+0000","last_became_peered":"2023-08-17T17:49:53.632122+0000","last_unstale":"2023-08-17T17:49:53.641066+0000","last_undegraded":"2023-08-17T17:49:53.641066+0000","last_fullsized":"2023-08-17T17:49:53.641066+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243729+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642539+0000","last_change":"2023-08-17T17:49:53.639102+0000","last_active":"2023-08-17T17:49:53.642539+0000","last_peered":"2023-08-17T17:49:53.642539+0000","last_clean":"2023-08-17T17:49:53.642539+0000","last_became_active":"2023-08-17T17:49:53.638803+0000","last_became_peered":"2023-08-17T17:49:53.638803+0000","last_unstale":"2023-08-17T17:49:53.642539+0000","last_undegraded":"2023-08-17T17:49:53.642539+0000","last_fullsized":"2023-08-17T17:49:53.642539+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239829+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630896+0000","last_change":"2023-08-17T17:49:53.628939+0000","last_active":"2023-08-17T17:49:53.630896+0000","last_peered":"2023-08-17T17:49:53.630896+0000","last_clean":"2023-08-17T17:49:53.630896+0000","last_became_active":"2023-08-17T17:49:53.628609+0000","last_became_peered":"2023-08-17T17:49:53.628609+0000","last_unstale":"2023-08-17T17:49:53.630896+0000","last_undegraded":"2023-08-17T17:49:53.630896+0000","last_fullsized":"2023-08-17T17:49:53.630896+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243758+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630942+0000","last_change":"2023-08-17T17:49:53.627791+0000","last_active":"2023-08-17T17:49:53.630942+0000","last_peered":"2023-08-17T17:49:53.630942+0000","last_clean":"2023-08-17T17:49:53.630942+0000","last_became_active":"2023-08-17T17:49:53.627208+0000","last_became_peered":"2023-08-17T17:49:53.627208+0000","last_unstale":"2023-08-17T17:49:53.630942+0000","last_undegraded":"2023-08-17T17:49:53.630942+0000","last_fullsized":"2023-08-17T17:49:53.630942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619854+0000","last_change":"2023-08-17T17:49:53.259607+0000","last_active":"2023-08-17T17:49:53.619854+0000","last_peered":"2023-08-17T17:49:53.619854+0000","last_clean":"2023-08-17T17:49:53.619854+0000","last_became_active":"2023-08-17T17:49:53.258654+0000","last_became_peered":"2023-08-17T17:49:53.258654+0000","last_unstale":"2023-08-17T17:49:53.619854+0000","last_undegraded":"2023-08-17T17:49:53.619854+0000","last_fullsized":"2023-08-17T17:49:53.619854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642614+0000","last_change":"2023-08-17T17:49:53.641446+0000","last_active":"2023-08-17T17:49:53.642614+0000","last_peered":"2023-08-17T17:49:53.642614+0000","last_clean":"2023-08-17T17:49:53.642614+0000","last_became_active":"2023-08-17T17:49:53.641179+0000","last_became_peered":"2023-08-17T17:49:53.641179+0000","last_unstale":"2023-08-17T17:49:53.642614+0000","last_undegraded":"2023-08-17T17:49:53.642614+0000","last_fullsized":"2023-08-17T17:49:53.642614+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617843+0000","last_change":"2023-08-17T17:49:53.263343+0000","last_active":"2023-08-17T17:49:53.617843+0000","last_peered":"2023-08-17T17:49:53.617843+0000","last_clean":"2023-08-17T17:49:53.617843+0000","last_became_active":"2023-08-17T17:49:53.263085+0000","last_became_peered":"2023-08-17T17:49:53.263085+0000","last_unstale":"2023-08-17T17:49:53.617843+0000","last_undegraded":"2023-08-17T17:49:53.617843+0000","last_fullsized":"2023-08-17T17:49:53.617843+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.639177+0000","last_change":"2023-08-17T17:49:53.625393+0000","last_active":"2023-08-17T17:49:53.639177+0000","last_peered":"2023-08-17T17:49:53.639177+0000","last_clean":"2023-08-17T17:49:53.639177+0000","last_became_active":"2023-08-17T17:49:53.625119+0000","last_became_peered":"2023-08-17T17:49:53.625119+0000","last_unstale":"2023-08-17T17:49:53.639177+0000","last_undegraded":"2023-08-17T17:49:53.639177+0000","last_fullsized":"2023-08-17T17:49:53.639177+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617213+0000","last_change":"2023-08-17T17:49:53.270010+0000","last_active":"2023-08-17T17:49:53.617213+0000","last_peered":"2023-08-17T17:49:53.617213+0000","last_clean":"2023-08-17T17:49:53.617213+0000","last_became_active":"2023-08-17T17:49:53.269690+0000","last_became_peered":"2023-08-17T17:49:53.269690+0000","last_unstale":"2023-08-17T17:49:53.617213+0000","last_undegraded":"2023-08-17T17:49:53.617213+0000","last_fullsized":"2023-08-17T17:49:53.617213+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642944+0000","last_change":"2023-08-17T17:49:53.640910+0000","last_active":"2023-08-17T17:49:53.642944+0000","last_peered":"2023-08-17T17:49:53.642944+0000","last_clean":"2023-08-17T17:49:53.642944+0000","last_became_active":"2023-08-17T17:49:53.640659+0000","last_became_peered":"2023-08-17T17:49:53.640659+0000","last_unstale":"2023-08-17T17:49:53.642944+0000","last_undegraded":"2023-08-17T17:49:53.642944+0000","last_fullsized":"2023-08-17T17:49:53.642944+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"90'4","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.648359+0000","last_change":"2023-08-17T17:49:53.264709+0000","last_active":"2023-08-17T17:49:53.648359+0000","last_peered":"2023-08-17T17:49:53.648359+0000","last_clean":"2023-08-17T17:49:53.648359+0000","last_became_active":"2023-08-17T17:49:53.264073+0000","last_became_peered":"2023-08-17T17:49:53.264073+0000","last_unstale":"2023-08-17T17:49:53.648359+0000","last_undegraded":"2023-08-17T17:49:53.648359+0000","last_fullsized":"2023-08-17T17:49:53.648359+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.634616+0000","last_change":"2023-08-17T17:49:53.261048+0000","last_active":"2023-08-17T17:49:53.634616+0000","last_peered":"2023-08-17T17:49:53.634616+0000","last_clean":"2023-08-17T17:49:53.634616+0000","last_became_active":"2023-08-17T17:49:53.260747+0000","last_became_peered":"2023-08-17T17:49:53.260747+0000","last_unstale":"2023-08-17T17:49:53.634616+0000","last_undegraded":"2023-08-17T17:49:53.634616+0000","last_fullsized":"2023-08-17T17:49:53.634616+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635906+0000","last_change":"2023-08-17T17:49:53.633359+0000","last_active":"2023-08-17T17:49:53.635906+0000","last_peered":"2023-08-17T17:49:53.635906+0000","last_clean":"2023-08-17T17:49:53.635906+0000","last_became_active":"2023-08-17T17:49:53.632947+0000","last_became_peered":"2023-08-17T17:49:53.632947+0000","last_unstale":"2023-08-17T17:49:53.635906+0000","last_undegraded":"2023-08-17T17:49:53.635906+0000","last_fullsized":"2023-08-17T17:49:53.635906+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.627092+0000","last_change":"2023-08-17T17:49:53.266502+0000","last_active":"2023-08-17T17:49:53.627092+0000","last_peered":"2023-08-17T17:49:53.627092+0000","last_clean":"2023-08-17T17:49:53.627092+0000","last_became_active":"2023-08-17T17:49:53.266301+0000","last_became_peered":"2023-08-17T17:49:53.266301+0000","last_unstale":"2023-08-17T17:49:53.627092+0000","last_undegraded":"2023-08-17T17:49:53.627092+0000","last_fullsized":"2023-08-17T17:49:53.627092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.618917+0000","last_change":"2023-08-17T17:49:53.258908+0000","last_active":"2023-08-17T17:49:53.618917+0000","last_peered":"2023-08-17T17:49:53.618917+0000","last_clean":"2023-08-17T17:49:53.618917+0000","last_became_active":"2023-08-17T17:49:53.258631+0000","last_became_peered":"2023-08-17T17:49:53.258631+0000","last_unstale":"2023-08-17T17:49:53.618917+0000","last_undegraded":"2023-08-17T17:49:53.618917+0000","last_fullsized":"2023-08-17T17:49:53.618917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641636+0000","last_change":"2023-08-17T17:49:53.640614+0000","last_active":"2023-08-17T17:49:53.641636+0000","last_peered":"2023-08-17T17:49:53.641636+0000","last_clean":"2023-08-17T17:49:53.641636+0000","last_became_active":"2023-08-17T17:49:53.640262+0000","last_became_peered":"2023-08-17T17:49:53.640262+0000","last_unstale":"2023-08-17T17:49:53.641636+0000","last_undegraded":"2023-08-17T17:49:53.641636+0000","last_fullsized":"2023-08-17T17:49:53.641636+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"90'4","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631040+0000","last_change":"2023-08-17T17:49:53.269722+0000","last_active":"2023-08-17T17:49:53.631040+0000","last_peered":"2023-08-17T17:49:53.631040+0000","last_clean":"2023-08-17T17:49:53.631040+0000","last_became_active":"2023-08-17T17:49:53.269348+0000","last_became_peered":"2023-08-17T17:49:53.269348+0000","last_unstale":"2023-08-17T17:49:53.631040+0000","last_undegraded":"2023-08-17T17:49:53.631040+0000","last_fullsized":"2023-08-17T17:49:53.631040+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642642+0000","last_change":"2023-08-17T17:49:53.639387+0000","last_active":"2023-08-17T17:49:53.642642+0000","last_peered":"2023-08-17T17:49:53.642642+0000","last_clean":"2023-08-17T17:49:53.642642+0000","last_became_active":"2023-08-17T17:49:53.639031+0000","last_became_peered":"2023-08-17T17:49:53.639031+0000","last_unstale":"2023-08-17T17:49:53.642642+0000","last_undegraded":"2023-08-17T17:49:53.642642+0000","last_fullsized":"2023-08-17T17:49:53.642642+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619697+0000","last_change":"2023-08-17T17:49:53.263731+0000","last_active":"2023-08-17T17:49:53.619697+0000","last_peered":"2023-08-17T17:49:53.619697+0000","last_clean":"2023-08-17T17:49:53.619697+0000","last_became_active":"2023-08-17T17:49:53.259341+0000","last_became_peered":"2023-08-17T17:49:53.259341+0000","last_unstale":"2023-08-17T17:49:53.619697+0000","last_undegraded":"2023-08-17T17:49:53.619697+0000","last_fullsized":"2023-08-17T17:49:53.619697+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631222+0000","last_change":"2023-08-17T17:49:53.628183+0000","last_active":"2023-08-17T17:49:53.631222+0000","last_peered":"2023-08-17T17:49:53.631222+0000","last_clean":"2023-08-17T17:49:53.631222+0000","last_became_active":"2023-08-17T17:49:53.627886+0000","last_became_peered":"2023-08-17T17:49:53.627886+0000","last_unstale":"2023-08-17T17:49:53.631222+0000","last_undegraded":"2023-08-17T17:49:53.631222+0000","last_fullsized":"2023-08-17T17:49:53.631222+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.633478+0000","last_change":"2023-08-17T17:49:53.269509+0000","last_active":"2023-08-17T17:49:53.633478+0000","last_peered":"2023-08-17T17:49:53.633478+0000","last_clean":"2023-08-17T17:49:53.633478+0000","last_became_active":"2023-08-17T17:49:53.268452+0000","last_became_peered":"2023-08-17T17:49:53.268452+0000","last_unstale":"2023-08-17T17:49:53.633478+0000","last_undegraded":"2023-08-17T17:49:53.633478+0000","last_fullsized":"2023-08-17T17:49:53.633478+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642923+0000","last_change":"2023-08-17T17:49:53.641002+0000","last_active":"2023-08-17T17:49:53.642923+0000","last_peered":"2023-08-17T17:49:53.642923+0000","last_clean":"2023-08-17T17:49:53.642923+0000","last_became_active":"2023-08-17T17:49:53.640388+0000","last_became_peered":"2023-08-17T17:49:53.640388+0000","last_unstale":"2023-08-17T17:49:53.642923+0000","last_undegraded":"2023-08-17T17:49:53.642923+0000","last_fullsized":"2023-08-17T17:49:53.642923+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242863+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635276+0000","last_change":"2023-08-17T17:49:53.631927+0000","last_active":"2023-08-17T17:49:53.635276+0000","last_peered":"2023-08-17T17:49:53.635276+0000","last_clean":"2023-08-17T17:49:53.635276+0000","last_became_active":"2023-08-17T17:49:53.631653+0000","last_became_peered":"2023-08-17T17:49:53.631653+0000","last_unstale":"2023-08-17T17:49:53.635276+0000","last_undegraded":"2023-08-17T17:49:53.635276+0000","last_fullsized":"2023-08-17T17:49:53.635276+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.622614+0000","last_change":"2023-08-17T17:49:53.265475+0000","last_active":"2023-08-17T17:49:53.622614+0000","last_peered":"2023-08-17T17:49:53.622614+0000","last_clean":"2023-08-17T17:49:53.622614+0000","last_became_active":"2023-08-17T17:49:53.265202+0000","last_became_peered":"2023-08-17T17:49:53.265202+0000","last_unstale":"2023-08-17T17:49:53.622614+0000","last_undegraded":"2023-08-17T17:49:53.622614+0000","last_fullsized":"2023-08-17T17:49:53.622614+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642634+0000","last_change":"2023-08-17T17:49:53.635200+0000","last_active":"2023-08-17T17:49:53.642634+0000","last_peered":"2023-08-17T17:49:53.642634+0000","last_clean":"2023-08-17T17:49:53.642634+0000","last_became_active":"2023-08-17T17:49:53.634327+0000","last_became_peered":"2023-08-17T17:49:53.634327+0000","last_unstale":"2023-08-17T17:49:53.642634+0000","last_undegraded":"2023-08-17T17:49:53.642634+0000","last_fullsized":"2023-08-17T17:49:53.642634+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.634809+0000","last_change":"2023-08-17T17:49:53.265673+0000","last_active":"2023-08-17T17:49:53.634809+0000","last_peered":"2023-08-17T17:49:53.634809+0000","last_clean":"2023-08-17T17:49:53.634809+0000","last_became_active":"2023-08-17T17:49:53.265279+0000","last_became_peered":"2023-08-17T17:49:53.265279+0000","last_unstale":"2023-08-17T17:49:53.634809+0000","last_undegraded":"2023-08-17T17:49:53.634809+0000","last_fullsized":"2023-08-17T17:49:53.634809+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638961+0000","last_change":"2023-08-17T17:49:53.628039+0000","last_active":"2023-08-17T17:49:53.638961+0000","last_peered":"2023-08-17T17:49:53.638961+0000","last_clean":"2023-08-17T17:49:53.638961+0000","last_became_active":"2023-08-17T17:49:53.627742+0000","last_became_peered":"2023-08-17T17:49:53.627742+0000","last_unstale":"2023-08-17T17:49:53.638961+0000","last_undegraded":"2023-08-17T17:49:53.638961+0000","last_fullsized":"2023-08-17T17:49:53.638961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619002+0000","last_change":"2023-08-17T17:49:53.263875+0000","last_active":"2023-08-17T17:49:53.619002+0000","last_peered":"2023-08-17T17:49:53.619002+0000","last_clean":"2023-08-17T17:49:53.619002+0000","last_became_active":"2023-08-17T17:49:53.263534+0000","last_became_peered":"2023-08-17T17:49:53.263534+0000","last_unstale":"2023-08-17T17:49:53.619002+0000","last_undegraded":"2023-08-17T17:49:53.619002+0000","last_fullsized":"2023-08-17T17:49:53.619002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641112+0000","last_change":"2023-08-17T17:49:53.631678+0000","last_active":"2023-08-17T17:49:53.641112+0000","last_peered":"2023-08-17T17:49:53.641112+0000","last_clean":"2023-08-17T17:49:53.641112+0000","last_became_active":"2023-08-17T17:49:53.631420+0000","last_became_peered":"2023-08-17T17:49:53.631420+0000","last_unstale":"2023-08-17T17:49:53.641112+0000","last_undegraded":"2023-08-17T17:49:53.641112+0000","last_fullsized":"2023-08-17T17:49:53.641112+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.616926+0000","last_change":"2023-08-17T17:49:53.267009+0000","last_active":"2023-08-17T17:49:53.616926+0000","last_peered":"2023-08-17T17:49:53.616926+0000","last_clean":"2023-08-17T17:49:53.616926+0000","last_became_active":"2023-08-17T17:49:53.266748+0000","last_became_peered":"2023-08-17T17:49:53.266748+0000","last_unstale":"2023-08-17T17:49:53.616926+0000","last_undegraded":"2023-08-17T17:49:53.616926+0000","last_fullsized":"2023-08-17T17:49:53.616926+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.629495+0000","last_change":"2023-08-17T17:49:53.626538+0000","last_active":"2023-08-17T17:49:53.629495+0000","last_peered":"2023-08-17T17:49:53.629495+0000","last_clean":"2023-08-17T17:49:53.629495+0000","last_became_active":"2023-08-17T17:49:53.626256+0000","last_became_peered":"2023-08-17T17:49:53.626256+0000","last_unstale":"2023-08-17T17:49:53.629495+0000","last_undegraded":"2023-08-17T17:49:53.629495+0000","last_fullsized":"2023-08-17T17:49:53.629495+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619649+0000","last_change":"2023-08-17T17:49:53.271964+0000","last_active":"2023-08-17T17:49:53.619649+0000","last_peered":"2023-08-17T17:49:53.619649+0000","last_clean":"2023-08-17T17:49:53.619649+0000","last_became_active":"2023-08-17T17:49:53.271684+0000","last_became_peered":"2023-08-17T17:49:53.271684+0000","last_unstale":"2023-08-17T17:49:53.619649+0000","last_undegraded":"2023-08-17T17:49:53.619649+0000","last_fullsized":"2023-08-17T17:49:53.619649+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630960+0000","last_change":"2023-08-17T17:49:53.629070+0000","last_active":"2023-08-17T17:49:53.630960+0000","last_peered":"2023-08-17T17:49:53.630960+0000","last_clean":"2023-08-17T17:49:53.630960+0000","last_became_active":"2023-08-17T17:49:53.628575+0000","last_became_peered":"2023-08-17T17:49:53.628575+0000","last_unstale":"2023-08-17T17:49:53.630960+0000","last_undegraded":"2023-08-17T17:49:53.630960+0000","last_fullsized":"2023-08-17T17:49:53.630960+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617966+0000","last_change":"2023-08-17T17:49:53.264902+0000","last_active":"2023-08-17T17:49:53.617966+0000","last_peered":"2023-08-17T17:49:53.617966+0000","last_clean":"2023-08-17T17:49:53.617966+0000","last_became_active":"2023-08-17T17:49:53.264635+0000","last_became_peered":"2023-08-17T17:49:53.264635+0000","last_unstale":"2023-08-17T17:49:53.617966+0000","last_undegraded":"2023-08-17T17:49:53.617966+0000","last_fullsized":"2023-08-17T17:49:53.617966+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.643125+0000","last_change":"2023-08-17T17:49:53.637672+0000","last_active":"2023-08-17T17:49:53.643125+0000","last_peered":"2023-08-17T17:49:53.643125+0000","last_clean":"2023-08-17T17:49:53.643125+0000","last_became_active":"2023-08-17T17:49:53.637459+0000","last_became_peered":"2023-08-17T17:49:53.637459+0000","last_unstale":"2023-08-17T17:49:53.643125+0000","last_undegraded":"2023-08-17T17:49:53.643125+0000","last_fullsized":"2023-08-17T17:49:53.643125+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240429+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.633769+0000","last_change":"2023-08-17T17:49:53.632775+0000","last_active":"2023-08-17T17:49:53.633769+0000","last_peered":"2023-08-17T17:49:53.633769+0000","last_clean":"2023-08-17T17:49:53.633769+0000","last_became_active":"2023-08-17T17:49:53.632501+0000","last_became_peered":"2023-08-17T17:49:53.632501+0000","last_unstale":"2023-08-17T17:49:53.633769+0000","last_undegraded":"2023-08-17T17:49:53.633769+0000","last_fullsized":"2023-08-17T17:49:53.633769+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.614759+0000","last_change":"2023-08-17T17:49:53.261899+0000","last_active":"2023-08-17T17:49:53.614759+0000","last_peered":"2023-08-17T17:49:53.614759+0000","last_clean":"2023-08-17T17:49:53.614759+0000","last_became_active":"2023-08-17T17:49:53.261642+0000","last_became_peered":"2023-08-17T17:49:53.261642+0000","last_unstale":"2023-08-17T17:49:53.614759+0000","last_undegraded":"2023-08-17T17:49:53.614759+0000","last_fullsized":"2023-08-17T17:49:53.614759+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.634671+0000","last_change":"2023-08-17T17:49:53.629382+0000","last_active":"2023-08-17T17:49:53.634671+0000","last_peered":"2023-08-17T17:49:53.634671+0000","last_clean":"2023-08-17T17:49:53.634671+0000","last_became_active":"2023-08-17T17:49:53.629098+0000","last_became_peered":"2023-08-17T17:49:53.629098+0000","last_unstale":"2023-08-17T17:49:53.634671+0000","last_undegraded":"2023-08-17T17:49:53.634671+0000","last_fullsized":"2023-08-17T17:49:53.634671+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617976+0000","last_change":"2023-08-17T17:49:53.263471+0000","last_active":"2023-08-17T17:49:53.617976+0000","last_peered":"2023-08-17T17:49:53.617976+0000","last_clean":"2023-08-17T17:49:53.617976+0000","last_became_active":"2023-08-17T17:49:53.263187+0000","last_became_peered":"2023-08-17T17:49:53.263187+0000","last_unstale":"2023-08-17T17:49:53.617976+0000","last_undegraded":"2023-08-17T17:49:53.617976+0000","last_fullsized":"2023-08-17T17:49:53.617976+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.629389+0000","last_change":"2023-08-17T17:49:53.626856+0000","last_active":"2023-08-17T17:49:53.629389+0000","last_peered":"2023-08-17T17:49:53.629389+0000","last_clean":"2023-08-17T17:49:53.629389+0000","last_became_active":"2023-08-17T17:49:53.626591+0000","last_became_peered":"2023-08-17T17:49:53.626591+0000","last_unstale":"2023-08-17T17:49:53.629389+0000","last_undegraded":"2023-08-17T17:49:53.629389+0000","last_fullsized":"2023-08-17T17:49:53.629389+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.614432+0000","last_change":"2023-08-17T17:49:53.265578+0000","last_active":"2023-08-17T17:49:53.614432+0000","last_peered":"2023-08-17T17:49:53.614432+0000","last_clean":"2023-08-17T17:49:53.614432+0000","last_became_active":"2023-08-17T17:49:53.265329+0000","last_became_peered":"2023-08-17T17:49:53.265329+0000","last_unstale":"2023-08-17T17:49:53.614432+0000","last_undegraded":"2023-08-17T17:49:53.614432+0000","last_fullsized":"2023-08-17T17:49:53.614432+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630522+0000","last_change":"2023-08-17T17:49:53.626127+0000","last_active":"2023-08-17T17:49:53.630522+0000","last_peered":"2023-08-17T17:49:53.630522+0000","last_clean":"2023-08-17T17:49:53.630522+0000","last_became_active":"2023-08-17T17:49:53.625815+0000","last_became_peered":"2023-08-17T17:49:53.625815+0000","last_unstale":"2023-08-17T17:49:53.630522+0000","last_undegraded":"2023-08-17T17:49:53.630522+0000","last_fullsized":"2023-08-17T17:49:53.630522+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.240318+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238561+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642641+0000","last_change":"2023-08-17T17:49:53.639283+0000","last_active":"2023-08-17T17:49:53.642641+0000","last_peered":"2023-08-17T17:49:53.642641+0000","last_clean":"2023-08-17T17:49:53.642641+0000","last_became_active":"2023-08-17T17:49:53.639006+0000","last_became_peered":"2023-08-17T17:49:53.639006+0000","last_unstale":"2023-08-17T17:49:53.642641+0000","last_undegraded":"2023-08-17T17:49:53.642641+0000","last_fullsized":"2023-08-17T17:49:53.642641+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243332+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.640605+0000","last_change":"2023-08-17T17:49:53.628717+0000","last_active":"2023-08-17T17:49:53.640605+0000","last_peered":"2023-08-17T17:49:53.640605+0000","last_clean":"2023-08-17T17:49:53.640605+0000","last_became_active":"2023-08-17T17:49:53.628491+0000","last_became_peered":"2023-08-17T17:49:53.628491+0000","last_unstale":"2023-08-17T17:49:53.640605+0000","last_undegraded":"2023-08-17T17:49:53.640605+0000","last_fullsized":"2023-08-17T17:49:53.640605+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.640402+0000","last_change":"2023-08-17T17:49:53.261049+0000","last_active":"2023-08-17T17:49:53.640402+0000","last_peered":"2023-08-17T17:49:53.640402+0000","last_clean":"2023-08-17T17:49:53.640402+0000","last_became_active":"2023-08-17T17:49:53.259006+0000","last_became_peered":"2023-08-17T17:49:53.259006+0000","last_unstale":"2023-08-17T17:49:53.640402+0000","last_undegraded":"2023-08-17T17:49:53.640402+0000","last_fullsized":"2023-08-17T17:49:53.640402+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.633884+0000","last_change":"2023-08-17T17:49:53.629473+0000","last_active":"2023-08-17T17:49:53.633884+0000","last_peered":"2023-08-17T17:49:53.633884+0000","last_clean":"2023-08-17T17:49:53.633884+0000","last_became_active":"2023-08-17T17:49:53.629201+0000","last_became_peered":"2023-08-17T17:49:53.629201+0000","last_unstale":"2023-08-17T17:49:53.633884+0000","last_undegraded":"2023-08-17T17:49:53.633884+0000","last_fullsized":"2023-08-17T17:49:53.633884+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.629757+0000","last_change":"2023-08-17T17:49:53.268991+0000","last_active":"2023-08-17T17:49:53.629757+0000","last_peered":"2023-08-17T17:49:53.629757+0000","last_clean":"2023-08-17T17:49:53.629757+0000","last_became_active":"2023-08-17T17:49:53.268695+0000","last_became_peered":"2023-08-17T17:49:53.268695+0000","last_unstale":"2023-08-17T17:49:53.629757+0000","last_undegraded":"2023-08-17T17:49:53.629757+0000","last_fullsized":"2023-08-17T17:49:53.629757+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641711+0000","last_change":"2023-08-17T17:49:53.640954+0000","last_active":"2023-08-17T17:49:53.641711+0000","last_peered":"2023-08-17T17:49:53.641711+0000","last_clean":"2023-08-17T17:49:53.641711+0000","last_became_active":"2023-08-17T17:49:53.640592+0000","last_became_peered":"2023-08-17T17:49:53.640592+0000","last_unstale":"2023-08-17T17:49:53.641711+0000","last_undegraded":"2023-08-17T17:49:53.641711+0000","last_fullsized":"2023-08-17T17:49:53.641711+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.636102+0000","last_change":"2023-08-17T17:49:53.262454+0000","last_active":"2023-08-17T17:49:53.636102+0000","last_peered":"2023-08-17T17:49:53.636102+0000","last_clean":"2023-08-17T17:49:53.636102+0000","last_became_active":"2023-08-17T17:49:53.262157+0000","last_became_peered":"2023-08-17T17:49:53.262157+0000","last_unstale":"2023-08-17T17:49:53.636102+0000","last_undegraded":"2023-08-17T17:49:53.636102+0000","last_fullsized":"2023-08-17T17:49:53.636102+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635296+0000","last_change":"2023-08-17T17:49:53.631950+0000","last_active":"2023-08-17T17:49:53.635296+0000","last_peered":"2023-08-17T17:49:53.635296+0000","last_clean":"2023-08-17T17:49:53.635296+0000","last_became_active":"2023-08-17T17:49:53.631705+0000","last_became_peered":"2023-08-17T17:49:53.631705+0000","last_unstale":"2023-08-17T17:49:53.635296+0000","last_undegraded":"2023-08-17T17:49:53.635296+0000","last_fullsized":"2023-08-17T17:49:53.635296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.244298+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.637172+0000","last_change":"2023-08-17T17:49:53.634055+0000","last_active":"2023-08-17T17:49:53.637172+0000","last_peered":"2023-08-17T17:49:53.637172+0000","last_clean":"2023-08-17T17:49:53.637172+0000","last_became_active":"2023-08-17T17:49:53.633798+0000","last_became_peered":"2023-08-17T17:49:53.633798+0000","last_unstale":"2023-08-17T17:49:53.637172+0000","last_undegraded":"2023-08-17T17:49:53.637172+0000","last_fullsized":"2023-08-17T17:49:53.637172+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619563+0000","last_change":"2023-08-17T17:49:53.265862+0000","last_active":"2023-08-17T17:49:53.619563+0000","last_peered":"2023-08-17T17:49:53.619563+0000","last_clean":"2023-08-17T17:49:53.619563+0000","last_became_active":"2023-08-17T17:49:53.264607+0000","last_became_peered":"2023-08-17T17:49:53.264607+0000","last_unstale":"2023-08-17T17:49:53.619563+0000","last_undegraded":"2023-08-17T17:49:53.619563+0000","last_fullsized":"2023-08-17T17:49:53.619563+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635887+0000","last_change":"2023-08-17T17:49:53.633197+0000","last_active":"2023-08-17T17:49:53.635887+0000","last_peered":"2023-08-17T17:49:53.635887+0000","last_clean":"2023-08-17T17:49:53.635887+0000","last_became_active":"2023-08-17T17:49:53.632626+0000","last_became_peered":"2023-08-17T17:49:53.632626+0000","last_unstale":"2023-08-17T17:49:53.635887+0000","last_undegraded":"2023-08-17T17:49:53.635887+0000","last_fullsized":"2023-08-17T17:49:53.635887+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239816+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641621+0000","last_change":"2023-08-17T17:49:53.640584+0000","last_active":"2023-08-17T17:49:53.641621+0000","last_peered":"2023-08-17T17:49:53.641621+0000","last_clean":"2023-08-17T17:49:53.641621+0000","last_became_active":"2023-08-17T17:49:53.640251+0000","last_became_peered":"2023-08-17T17:49:53.640251+0000","last_unstale":"2023-08-17T17:49:53.641621+0000","last_undegraded":"2023-08-17T17:49:53.641621+0000","last_fullsized":"2023-08-17T17:49:53.641621+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619015+0000","last_change":"2023-08-17T17:49:53.261333+0000","last_active":"2023-08-17T17:49:53.619015+0000","last_peered":"2023-08-17T17:49:53.619015+0000","last_clean":"2023-08-17T17:49:53.619015+0000","last_became_active":"2023-08-17T17:49:53.261035+0000","last_became_peered":"2023-08-17T17:49:53.261035+0000","last_unstale":"2023-08-17T17:49:53.619015+0000","last_undegraded":"2023-08-17T17:49:53.619015+0000","last_fullsized":"2023-08-17T17:49:53.619015+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619246+0000","last_change":"2023-08-17T17:49:53.260000+0000","last_active":"2023-08-17T17:49:53.619246+0000","last_peered":"2023-08-17T17:49:53.619246+0000","last_clean":"2023-08-17T17:49:53.619246+0000","last_became_active":"2023-08-17T17:49:53.259723+0000","last_became_peered":"2023-08-17T17:49:53.259723+0000","last_unstale":"2023-08-17T17:49:53.619246+0000","last_undegraded":"2023-08-17T17:49:53.619246+0000","last_fullsized":"2023-08-17T17:49:53.619246+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.636466+0000","last_change":"2023-08-17T17:49:53.632609+0000","last_active":"2023-08-17T17:49:53.636466+0000","last_peered":"2023-08-17T17:49:53.636466+0000","last_clean":"2023-08-17T17:49:53.636466+0000","last_became_active":"2023-08-17T17:49:53.632277+0000","last_became_peered":"2023-08-17T17:49:53.632277+0000","last_unstale":"2023-08-17T17:49:53.636466+0000","last_undegraded":"2023-08-17T17:49:53.636466+0000","last_fullsized":"2023-08-17T17:49:53.636466+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.618821+0000","last_change":"2023-08-17T17:49:53.268879+0000","last_active":"2023-08-17T17:49:53.618821+0000","last_peered":"2023-08-17T17:49:53.618821+0000","last_clean":"2023-08-17T17:49:53.618821+0000","last_became_active":"2023-08-17T17:49:53.268603+0000","last_became_peered":"2023-08-17T17:49:53.268603+0000","last_unstale":"2023-08-17T17:49:53.618821+0000","last_undegraded":"2023-08-17T17:49:53.618821+0000","last_fullsized":"2023-08-17T17:49:53.618821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.239218+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.639224+0000","last_change":"2023-08-17T17:49:53.634725+0000","last_active":"2023-08-17T17:49:53.639224+0000","last_peered":"2023-08-17T17:49:53.639224+0000","last_clean":"2023-08-17T17:49:53.639224+0000","last_became_active":"2023-08-17T17:49:53.634465+0000","last_became_peered":"2023-08-17T17:49:53.634465+0000","last_unstale":"2023-08-17T17:49:53.639224+0000","last_undegraded":"2023-08-17T17:49:53.639224+0000","last_fullsized":"2023-08-17T17:49:53.639224+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"90'3","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641753+0000","last_change":"2023-08-17T17:49:53.266068+0000","last_active":"2023-08-17T17:49:53.641753+0000","last_peered":"2023-08-17T17:49:53.641753+0000","last_clean":"2023-08-17T17:49:53.641753+0000","last_became_active":"2023-08-17T17:49:53.265765+0000","last_became_peered":"2023-08-17T17:49:53.265765+0000","last_unstale":"2023-08-17T17:49:53.641753+0000","last_undegraded":"2023-08-17T17:49:53.641753+0000","last_fullsized":"2023-08-17T17:49:53.641753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.643027+0000","last_change":"2023-08-17T17:49:53.637510+0000","last_active":"2023-08-17T17:49:53.643027+0000","last_peered":"2023-08-17T17:49:53.643027+0000","last_clean":"2023-08-17T17:49:53.643027+0000","last_became_active":"2023-08-17T17:49:53.637250+0000","last_became_peered":"2023-08-17T17:49:53.637250+0000","last_unstale":"2023-08-17T17:49:53.643027+0000","last_undegraded":"2023-08-17T17:49:53.643027+0000","last_fullsized":"2023-08-17T17:49:53.643027+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.243409+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238445+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619189+0000","last_change":"2023-08-17T17:49:53.267316+0000","last_active":"2023-08-17T17:49:53.619189+0000","last_peered":"2023-08-17T17:49:53.619189+0000","last_clean":"2023-08-17T17:49:53.619189+0000","last_became_active":"2023-08-17T17:49:53.267022+0000","last_became_peered":"2023-08-17T17:49:53.267022+0000","last_unstale":"2023-08-17T17:49:53.619189+0000","last_undegraded":"2023-08-17T17:49:53.619189+0000","last_fullsized":"2023-08-17T17:49:53.619189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619102+0000","last_change":"2023-08-17T17:49:53.259478+0000","last_active":"2023-08-17T17:49:53.619102+0000","last_peered":"2023-08-17T17:49:53.619102+0000","last_clean":"2023-08-17T17:49:53.619102+0000","last_became_active":"2023-08-17T17:49:53.259204+0000","last_became_peered":"2023-08-17T17:49:53.259204+0000","last_unstale":"2023-08-17T17:49:53.619102+0000","last_undegraded":"2023-08-17T17:49:53.619102+0000","last_fullsized":"2023-08-17T17:49:53.619102+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"90'4","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.639849+0000","last_change":"2023-08-17T17:49:53.268916+0000","last_active":"2023-08-17T17:49:53.639849+0000","last_peered":"2023-08-17T17:49:53.639849+0000","last_clean":"2023-08-17T17:49:53.639849+0000","last_became_active":"2023-08-17T17:49:53.268646+0000","last_became_peered":"2023-08-17T17:49:53.268646+0000","last_unstale":"2023-08-17T17:49:53.639849+0000","last_undegraded":"2023-08-17T17:49:53.639849+0000","last_fullsized":"2023-08-17T17:49:53.639849+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630693+0000","last_change":"2023-08-17T17:49:53.623562+0000","last_active":"2023-08-17T17:49:53.630693+0000","last_peered":"2023-08-17T17:49:53.630693+0000","last_clean":"2023-08-17T17:49:53.630693+0000","last_became_active":"2023-08-17T17:49:53.623282+0000","last_became_peered":"2023-08-17T17:49:53.623282+0000","last_unstale":"2023-08-17T17:49:53.630693+0000","last_undegraded":"2023-08-17T17:49:53.630693+0000","last_fullsized":"2023-08-17T17:49:53.630693+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.238635+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.626214+0000","last_change":"2023-08-17T17:49:53.254206+0000","last_active":"2023-08-17T17:49:53.626214+0000","last_peered":"2023-08-17T17:49:53.626214+0000","last_clean":"2023-08-17T17:49:53.626214+0000","last_became_active":"2023-08-17T17:49:53.253940+0000","last_became_peered":"2023-08-17T17:49:53.253940+0000","last_unstale":"2023-08-17T17:49:53.626214+0000","last_undegraded":"2023-08-17T17:49:53.626214+0000","last_fullsized":"2023-08-17T17:49:53.626214+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642336+0000","last_change":"2023-08-17T17:49:53.641285+0000","last_active":"2023-08-17T17:49:53.642336+0000","last_peered":"2023-08-17T17:49:53.642336+0000","last_clean":"2023-08-17T17:49:53.642336+0000","last_became_active":"2023-08-17T17:49:53.640945+0000","last_became_peered":"2023-08-17T17:49:53.640945+0000","last_unstale":"2023-08-17T17:49:53.642336+0000","last_undegraded":"2023-08-17T17:49:53.642336+0000","last_fullsized":"2023-08-17T17:49:53.642336+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617122+0000","last_change":"2023-08-17T17:49:53.267832+0000","last_active":"2023-08-17T17:49:53.617122+0000","last_peered":"2023-08-17T17:49:53.617122+0000","last_clean":"2023-08-17T17:49:53.617122+0000","last_became_active":"2023-08-17T17:49:53.266963+0000","last_became_peered":"2023-08-17T17:49:53.266963+0000","last_unstale":"2023-08-17T17:49:53.617122+0000","last_undegraded":"2023-08-17T17:49:53.617122+0000","last_fullsized":"2023-08-17T17:49:53.617122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.637088+0000","last_change":"2023-08-17T17:49:53.633961+0000","last_active":"2023-08-17T17:49:53.637088+0000","last_peered":"2023-08-17T17:49:53.637088+0000","last_clean":"2023-08-17T17:49:53.637088+0000","last_became_active":"2023-08-17T17:49:53.633706+0000","last_became_peered":"2023-08-17T17:49:53.633706+0000","last_unstale":"2023-08-17T17:49:53.637088+0000","last_undegraded":"2023-08-17T17:49:53.637088+0000","last_fullsized":"2023-08-17T17:49:53.637088+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.616772+0000","last_change":"2023-08-17T17:49:53.271828+0000","last_active":"2023-08-17T17:49:53.616772+0000","last_peered":"2023-08-17T17:49:53.616772+0000","last_clean":"2023-08-17T17:49:53.616772+0000","last_became_active":"2023-08-17T17:49:53.271523+0000","last_became_peered":"2023-08-17T17:49:53.271523+0000","last_unstale":"2023-08-17T17:49:53.616772+0000","last_undegraded":"2023-08-17T17:49:53.616772+0000","last_fullsized":"2023-08-17T17:49:53.616772+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242441+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.623573+0000","last_change":"2023-08-17T17:49:53.262326+0000","last_active":"2023-08-17T17:49:53.623573+0000","last_peered":"2023-08-17T17:49:53.623573+0000","last_clean":"2023-08-17T17:49:53.623573+0000","last_became_active":"2023-08-17T17:49:53.262025+0000","last_became_peered":"2023-08-17T17:49:53.262025+0000","last_unstale":"2023-08-17T17:49:53.623573+0000","last_undegraded":"2023-08-17T17:49:53.623573+0000","last_fullsized":"2023-08-17T17:49:53.623573+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641091+0000","last_change":"2023-08-17T17:49:53.631026+0000","last_active":"2023-08-17T17:49:53.641091+0000","last_peered":"2023-08-17T17:49:53.641091+0000","last_clean":"2023-08-17T17:49:53.641091+0000","last_became_active":"2023-08-17T17:49:53.630774+0000","last_became_peered":"2023-08-17T17:49:53.630774+0000","last_unstale":"2023-08-17T17:49:53.641091+0000","last_undegraded":"2023-08-17T17:49:53.641091+0000","last_fullsized":"2023-08-17T17:49:53.641091+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:49:52.233635+0000","last_change":"2023-08-17T17:49:52.242979+0000","last_active":"2023-08-17T17:49:52.233635+0000","last_peered":"2023-08-17T17:49:52.233635+0000","last_clean":"2023-08-17T17:49:52.233635+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:52.233635+0000","last_undegraded":"2023-08-17T17:49:52.233635+0000","last_fullsized":"2023-08-17T17:49:52.233635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641200+0000","last_change":"2023-08-17T17:49:53.635396+0000","last_active":"2023-08-17T17:49:53.641200+0000","last_peered":"2023-08-17T17:49:53.641200+0000","last_clean":"2023-08-17T17:49:53.641200+0000","last_became_active":"2023-08-17T17:49:53.633825+0000","last_became_peered":"2023-08-17T17:49:53.633825+0000","last_unstale":"2023-08-17T17:49:53.641200+0000","last_undegraded":"2023-08-17T17:49:53.641200+0000","last_fullsized":"2023-08-17T17:49:53.641200+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.624395+0000","last_change":"2023-08-17T17:49:53.262912+0000","last_active":"2023-08-17T17:49:53.624395+0000","last_peered":"2023-08-17T17:49:53.624395+0000","last_clean":"2023-08-17T17:49:53.624395+0000","last_became_active":"2023-08-17T17:49:53.262677+0000","last_became_peered":"2023-08-17T17:49:53.262677+0000","last_unstale":"2023-08-17T17:49:53.624395+0000","last_undegraded":"2023-08-17T17:49:53.624395+0000","last_fullsized":"2023-08-17T17:49:53.624395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642706+0000","last_change":"2023-08-17T17:49:53.636632+0000","last_active":"2023-08-17T17:49:53.642706+0000","last_peered":"2023-08-17T17:49:53.642706+0000","last_clean":"2023-08-17T17:49:53.642706+0000","last_became_active":"2023-08-17T17:49:53.636349+0000","last_became_peered":"2023-08-17T17:49:53.636349+0000","last_unstale":"2023-08-17T17:49:53.642706+0000","last_undegraded":"2023-08-17T17:49:53.642706+0000","last_fullsized":"2023-08-17T17:49:53.642706+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.620975+0000","last_change":"2023-08-17T17:49:53.264411+0000","last_active":"2023-08-17T17:49:53.620975+0000","last_peered":"2023-08-17T17:49:53.620975+0000","last_clean":"2023-08-17T17:49:53.620975+0000","last_became_active":"2023-08-17T17:49:53.264067+0000","last_became_peered":"2023-08-17T17:49:53.264067+0000","last_unstale":"2023-08-17T17:49:53.620975+0000","last_undegraded":"2023-08-17T17:49:53.620975+0000","last_fullsized":"2023-08-17T17:49:53.620975+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.625489+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:49:53.625489+0000","last_peered":"2023-08-17T17:49:53.625489+0000","last_clean":"2023-08-17T17:49:53.625489+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:49:53.625489+0000","last_undegraded":"2023-08-17T17:49:53.625489+0000","last_fullsized":"2023-08-17T17:49:53.625489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635802+0000","last_change":"2023-08-17T17:49:53.630669+0000","last_active":"2023-08-17T17:49:53.635802+0000","last_peered":"2023-08-17T17:49:53.635802+0000","last_clean":"2023-08-17T17:49:53.635802+0000","last_became_active":"2023-08-17T17:49:53.630420+0000","last_became_peered":"2023-08-17T17:49:53.630420+0000","last_unstale":"2023-08-17T17:49:53.635802+0000","last_undegraded":"2023-08-17T17:49:53.635802+0000","last_fullsized":"2023-08-17T17:49:53.635802+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.634698+0000","last_change":"2023-08-17T17:49:53.258430+0000","last_active":"2023-08-17T17:49:53.634698+0000","last_peered":"2023-08-17T17:49:53.634698+0000","last_clean":"2023-08-17T17:49:53.634698+0000","last_became_active":"2023-08-17T17:49:53.258167+0000","last_became_peered":"2023-08-17T17:49:53.258167+0000","last_unstale":"2023-08-17T17:49:53.634698+0000","last_undegraded":"2023-08-17T17:49:53.634698+0000","last_fullsized":"2023-08-17T17:49:53.634698+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801791+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:49:49.801791+0000","last_peered":"2023-08-17T17:49:49.801791+0000","last_clean":"2023-08-17T17:49:49.801791+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:49:49.801791+0000","last_undegraded":"2023-08-17T17:49:49.801791+0000","last_fullsized":"2023-08-17T17:49:49.801791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:49:53.235692+0000","last_change":"2023-08-17T17:49:53.235692+0000","last_active":"2023-08-17T17:49:53.235692+0000","last_peered":"2023-08-17T17:49:53.235692+0000","last_clean":"2023-08-17T17:49:53.235692+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:49:53.235692+0000","last_undegraded":"2023-08-17T17:49:53.235692+0000","last_fullsized":"2023-08-17T17:49:53.235692+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.613841+0000","last_change":"2023-08-17T17:49:53.268772+0000","last_active":"2023-08-17T17:49:53.613841+0000","last_peered":"2023-08-17T17:49:53.613841+0000","last_clean":"2023-08-17T17:49:53.613841+0000","last_became_active":"2023-08-17T17:49:53.268457+0000","last_became_peered":"2023-08-17T17:49:53.268457+0000","last_unstale":"2023-08-17T17:49:53.613841+0000","last_undegraded":"2023-08-17T17:49:53.613841+0000","last_fullsized":"2023-08-17T17:49:53.613841+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619180+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:49:53.619180+0000","last_peered":"2023-08-17T17:49:53.619180+0000","last_clean":"2023-08-17T17:49:53.619180+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:49:53.619180+0000","last_undegraded":"2023-08-17T17:49:53.619180+0000","last_fullsized":"2023-08-17T17:49:53.619180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.640363+0000","last_change":"2023-08-17T17:49:53.633814+0000","last_active":"2023-08-17T17:49:53.640363+0000","last_peered":"2023-08-17T17:49:53.640363+0000","last_clean":"2023-08-17T17:49:53.640363+0000","last_became_active":"2023-08-17T17:49:53.633519+0000","last_became_peered":"2023-08-17T17:49:53.633519+0000","last_unstale":"2023-08-17T17:49:53.640363+0000","last_undegraded":"2023-08-17T17:49:53.640363+0000","last_fullsized":"2023-08-17T17:49:53.640363+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.614983+0000","last_change":"2023-08-17T17:49:53.268981+0000","last_active":"2023-08-17T17:49:53.614983+0000","last_peered":"2023-08-17T17:49:53.614983+0000","last_clean":"2023-08-17T17:49:53.614983+0000","last_became_active":"2023-08-17T17:49:53.268665+0000","last_became_peered":"2023-08-17T17:49:53.268665+0000","last_unstale":"2023-08-17T17:49:53.614983+0000","last_undegraded":"2023-08-17T17:49:53.614983+0000","last_fullsized":"2023-08-17T17:49:53.614983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801763+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:49:49.801763+0000","last_peered":"2023-08-17T17:49:49.801763+0000","last_clean":"2023-08-17T17:49:49.801763+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:49:49.801763+0000","last_undegraded":"2023-08-17T17:49:49.801763+0000","last_fullsized":"2023-08-17T17:49:49.801763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619744+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:49:53.619744+0000","last_peered":"2023-08-17T17:49:53.619744+0000","last_clean":"2023-08-17T17:49:53.619744+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:49:53.619744+0000","last_undegraded":"2023-08-17T17:49:53.619744+0000","last_fullsized":"2023-08-17T17:49:53.619744+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635834+0000","last_change":"2023-08-17T17:49:53.631405+0000","last_active":"2023-08-17T17:49:53.635834+0000","last_peered":"2023-08-17T17:49:53.635834+0000","last_clean":"2023-08-17T17:49:53.635834+0000","last_became_active":"2023-08-17T17:49:53.631129+0000","last_became_peered":"2023-08-17T17:49:53.631129+0000","last_unstale":"2023-08-17T17:49:53.635834+0000","last_undegraded":"2023-08-17T17:49:53.635834+0000","last_fullsized":"2023-08-17T17:49:53.635834+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.613839+0000","last_change":"2023-08-17T17:49:53.259170+0000","last_active":"2023-08-17T17:49:53.613839+0000","last_peered":"2023-08-17T17:49:53.613839+0000","last_clean":"2023-08-17T17:49:53.613839+0000","last_became_active":"2023-08-17T17:49:53.258918+0000","last_became_peered":"2023-08-17T17:49:53.258918+0000","last_unstale":"2023-08-17T17:49:53.613839+0000","last_undegraded":"2023-08-17T17:49:53.613839+0000","last_fullsized":"2023-08-17T17:49:53.613839+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.620238+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:49:53.620238+0000","last_peered":"2023-08-17T17:49:53.620238+0000","last_clean":"2023-08-17T17:49:53.620238+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:49:53.620238+0000","last_undegraded":"2023-08-17T17:49:53.620238+0000","last_fullsized":"2023-08-17T17:49:53.620238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.639081+0000","last_change":"2023-08-17T17:49:53.634580+0000","last_active":"2023-08-17T17:49:53.639081+0000","last_peered":"2023-08-17T17:49:53.639081+0000","last_clean":"2023-08-17T17:49:53.639081+0000","last_became_active":"2023-08-17T17:49:53.634300+0000","last_became_peered":"2023-08-17T17:49:53.634300+0000","last_unstale":"2023-08-17T17:49:53.639081+0000","last_undegraded":"2023-08-17T17:49:53.639081+0000","last_fullsized":"2023-08-17T17:49:53.639081+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.625295+0000","last_change":"2023-08-17T17:49:53.264851+0000","last_active":"2023-08-17T17:49:53.625295+0000","last_peered":"2023-08-17T17:49:53.625295+0000","last_clean":"2023-08-17T17:49:53.625295+0000","last_became_active":"2023-08-17T17:49:53.264406+0000","last_became_peered":"2023-08-17T17:49:53.264406+0000","last_unstale":"2023-08-17T17:49:53.625295+0000","last_undegraded":"2023-08-17T17:49:53.625295+0000","last_fullsized":"2023-08-17T17:49:53.625295+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617649+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:49:53.617649+0000","last_peered":"2023-08-17T17:49:53.617649+0000","last_clean":"2023-08-17T17:49:53.617649+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:49:53.617649+0000","last_undegraded":"2023-08-17T17:49:53.617649+0000","last_fullsized":"2023-08-17T17:49:53.617649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638916+0000","last_change":"2023-08-17T17:49:53.626870+0000","last_active":"2023-08-17T17:49:53.638916+0000","last_peered":"2023-08-17T17:49:53.638916+0000","last_clean":"2023-08-17T17:49:53.638916+0000","last_became_active":"2023-08-17T17:49:53.626620+0000","last_became_peered":"2023-08-17T17:49:53.626620+0000","last_unstale":"2023-08-17T17:49:53.638916+0000","last_undegraded":"2023-08-17T17:49:53.638916+0000","last_fullsized":"2023-08-17T17:49:53.638916+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.640733+0000","last_change":"2023-08-17T17:49:53.266125+0000","last_active":"2023-08-17T17:49:53.640733+0000","last_peered":"2023-08-17T17:49:53.640733+0000","last_clean":"2023-08-17T17:49:53.640733+0000","last_became_active":"2023-08-17T17:49:53.265840+0000","last_became_peered":"2023-08-17T17:49:53.265840+0000","last_unstale":"2023-08-17T17:49:53.640733+0000","last_undegraded":"2023-08-17T17:49:53.640733+0000","last_fullsized":"2023-08-17T17:49:53.640733+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.633556+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:49:53.633556+0000","last_peered":"2023-08-17T17:49:53.633556+0000","last_clean":"2023-08-17T17:49:53.633556+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:49:53.633556+0000","last_undegraded":"2023-08-17T17:49:53.633556+0000","last_fullsized":"2023-08-17T17:49:53.633556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631932+0000","last_change":"2023-08-17T17:49:53.627207+0000","last_active":"2023-08-17T17:49:53.631932+0000","last_peered":"2023-08-17T17:49:53.631932+0000","last_clean":"2023-08-17T17:49:53.631932+0000","last_became_active":"2023-08-17T17:49:53.626917+0000","last_became_peered":"2023-08-17T17:49:53.626917+0000","last_unstale":"2023-08-17T17:49:53.631932+0000","last_undegraded":"2023-08-17T17:49:53.631932+0000","last_fullsized":"2023-08-17T17:49:53.631932+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.637746+0000","last_change":"2023-08-17T17:49:53.262629+0000","last_active":"2023-08-17T17:49:53.637746+0000","last_peered":"2023-08-17T17:49:53.637746+0000","last_clean":"2023-08-17T17:49:53.637746+0000","last_became_active":"2023-08-17T17:49:53.262340+0000","last_became_peered":"2023-08-17T17:49:53.262340+0000","last_unstale":"2023-08-17T17:49:53.637746+0000","last_undegraded":"2023-08-17T17:49:53.637746+0000","last_fullsized":"2023-08-17T17:49:53.637746+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-17T17:49:49.801536+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:49:49.801536+0000","last_peered":"2023-08-17T17:49:49.801536+0000","last_clean":"2023-08-17T17:49:49.801536+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:49:49.801536+0000","last_undegraded":"2023-08-17T17:49:49.801536+0000","last_fullsized":"2023-08-17T17:49:49.801536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":1558,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":547039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.61899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.498}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.69299999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77500000000000002,"15min":0.80000000000000004},"last":0.44}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63200000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":1.23,"15min":1.23},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.64500000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.75700000000000001,"15min":0.95999999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.624}]},{"osd":6,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73199999999999998,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72699999999999998,"5min":0.79400000000000004,"15min":0.90200000000000002},"last":0.60999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85599999999999998,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66700000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.755,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.65700000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.879,"15min":1.0609999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.60299999999999998},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80100000000000005,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.26800000000000002},"max":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.77300000000000002,"15min":1.026},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.34200000000000003},"max":{"1min":0.81299999999999994,"5min":1.51,"15min":1.51},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.872,"15min":1.0740000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.58199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302292,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069548,"statfs":{"total":96636764160,"available":96327217152,"internally_reserved":0,"allocated":1126400,"data_stored":547537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47099999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.25},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.378,"15min":0.373},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.40400000000000003,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.60399999999999998,"5min":0.625,"15min":0.66600000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40899999999999997,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.53600000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.624,"15min":0.622},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":1.2989999999999999,"15min":1.331},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2629999999999999,"15min":1.345},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.5}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83599999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.59799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":1110016,"data_stored":546463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52600000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.253},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.65200000000000002},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.66200000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.65700000000000003},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.97999999999999998,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.432},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.87,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.88300000000000001,"5min":1.677,"15min":1.677},"last":0.495}]},{"osd":6,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.087,"5min":1.51,"15min":1.51},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0069999999999999,"5min":1.325,"15min":1.391},"last":0.442}]},{"osd":7,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89600000000000002,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.544},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575036,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302288,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":1122304,"data_stored":547999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.49399999999999999,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.248},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45200000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.40100000000000002},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51800000000000002,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54800000000000004,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.311,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.52300000000000002,"5min":1.268,"15min":1.268},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.309}]},{"osd":4,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.98799999999999999,"5min":1.417,"15min":1.417},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2869999999999999,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.2629999999999999,"5min":1.544,"15min":1.544},"last":0.437},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":1.232,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0840000000000001,"5min":1.415,"15min":1.415},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68500000000000005,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88600000000000001,"5min":2.984,"15min":2.984},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.46500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302276,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069564,"statfs":{"total":96636764160,"available":96327233536,"internally_reserved":0,"allocated":1110016,"data_stored":546463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":0.45700000000000002,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.316},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.245,"5min":0.245,"15min":0.224},"max":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.71799999999999997},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.378},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.379},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.39200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":0.54600000000000004,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.439,"15min":0.42399999999999999},"min":{"1min":0.32200000000000001,"5min":0.245,"15min":0.245},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.89000000000000001},"last":0.626},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1989999999999998,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.626,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.466,"15min":1.466},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.48,"15min":1.48},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"max":{"1min":3.4780000000000002,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.496}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302288,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":1122304,"data_stored":547141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.012,"5min":1.252,"15min":1.252},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.47799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.28199999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66500000000000004,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35699999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.378},{"interface":"front","average":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.373,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.91900000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78000000000000003,"5min":0.877,"15min":1.056},"last":0.42199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575034,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":1060864,"data_stored":519680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.27700000000000002},"max":{"1min":0.66300000000000003,"5min":1.165,"15min":1.2609999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.31},"max":{"1min":0.627,"5min":1.022,"15min":1.1499999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.29599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.242},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":1.0580000000000001,"15min":1.252},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":1.153,"15min":1.274},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.379},"max":{"1min":0.68799999999999994,"5min":1.0920000000000001,"15min":1.179},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.3080000000000001},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.747,"5min":0.75,"15min":1.0620000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.497,"15min":0.495},"min":{"1min":0.314,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":0.78300000000000003,"15min":1.0740000000000001},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":1.01},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.1020000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.73599999999999999,"5min":0.82299999999999995,"15min":1.038},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.1279999999999999},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:49:58.867 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:49:58.866+0000 7f9b5a531700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:50:01.057 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:50:01.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.180+0000 7fe4b08f6700 1 Processor -- start 2023-08-17T17:50:01.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.180+0000 7fe4b08f6700 1 -- start start 2023-08-17T17:50:01.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4b08f6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4ac0c2a00 0x7fe4ac0c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4b08f6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac152130 con 0x7fe4ac069b00 2023-08-17T17:50:01.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4b08f6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac0685b0 con 0x7fe4ac0a8a30 2023-08-17T17:50:01.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4b08f6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac0c1e50 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4aa59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4ac0c2a00 0x7fe4ac0c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4ab59e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe4ac069b00 0x7fe4ac0bbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48678/0 (socket says 172.21.15.78:48678) 2023-08-17T17:50:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4aa59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4ac0c2a00 0x7fe4ac0c1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52504/0 (socket says 172.21.15.78:52504) 2023-08-17T17:50:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4ab59e700 1 -- 172.21.15.78:0/3837055091 learned_addr learned my addr 172.21.15.78:0/3837055091 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4aa59c700 1 -- 172.21.15.78:0/3837055091 >> v1:172.21.15.150:6789/0 conn(0x7fe4ac0a8a30 legacy=0x7fe4ac0c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4aa59c700 1 -- 172.21.15.78:0/3837055091 >> v1:172.21.15.78:6789/0 conn(0x7fe4ac069b00 legacy=0x7fe4ac0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.181+0000 7fe4aa59c700 1 -- 172.21.15.78:0/3837055091 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac0bb930 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4aa59c700 1 --2- 172.21.15.78:0/3837055091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 0x7fe4ac0c1960 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fe494009760 tx=0x7fe494009060).ready entity=mon.0 client_cookie=52b9e93c0c187acc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4a9d9b700 1 -- 172.21.15.78:0/3837055091 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400b520 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4a9d9b700 1 -- 172.21.15.78:0/3837055091 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400b680 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4a9d9b700 1 -- 172.21.15.78:0/3837055091 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400ba00 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4b08f6700 1 -- 172.21.15.78:0/3837055091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 msgr2=0x7fe4ac0c1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4b08f6700 1 --2- 172.21.15.78:0/3837055091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 0x7fe4ac0c1960 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fe494009760 tx=0x7fe494009060).stop 2023-08-17T17:50:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4b08f6700 1 -- 172.21.15.78:0/3837055091 shutdown_connections 2023-08-17T17:50:01.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4b08f6700 1 --2- 172.21.15.78:0/3837055091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 0x7fe4ac0c1960 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4b08f6700 1 -- 172.21.15.78:0/3837055091 >> 172.21.15.78:0/3837055091 conn(0x7fe4ac0c7320 msgr2=0x7fe4ac0c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:01.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4b08f6700 1 -- 172.21.15.78:0/3837055091 shutdown_connections 2023-08-17T17:50:01.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.182+0000 7fe4b08f6700 1 -- 172.21.15.78:0/3837055091 wait complete. 2023-08-17T17:50:01.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4b08f6700 1 Processor -- start 2023-08-17T17:50:01.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4b08f6700 1 -- start start 2023-08-17T17:50:01.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4b08f6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4ac069b00 0x7fe4ac0a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4b08f6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4ac0a8a30 0x7fe4ac162020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4b08f6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 0x7fe4ac0a63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4b08f6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0aaf00 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4b08f6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac166e00 con 0x7fe4ac069b00 2023-08-17T17:50:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4b08f6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac166970 con 0x7fe4ac0a8a30 2023-08-17T17:50:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4ab59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 0x7fe4ac0a63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4ab59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 0x7fe4ac0a63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52506/0 (socket says 172.21.15.78:52506) 2023-08-17T17:50:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.184+0000 7fe4ab59e700 1 -- 172.21.15.78:0/347501499 learned_addr learned my addr 172.21.15.78:0/347501499 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4aad9d700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4ac069b00 0x7fe4ac0a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4aa59c700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4ac0a8a30 0x7fe4ac162020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4ab59e700 1 -- 172.21.15.78:0/347501499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4ac0a8a30 msgr2=0x7fe4ac162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4ab59e700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4ac0a8a30 0x7fe4ac162020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4ab59e700 1 -- 172.21.15.78:0/347501499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4ac069b00 msgr2=0x7fe4ac0a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4ab59e700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4ac069b00 0x7fe4ac0a9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4ab59e700 1 -- 172.21.15.78:0/347501499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940092a0 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4ab59e700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 0x7fe4ac0a63b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fe49c00c440 tx=0x7fe49c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4a2ffd700 1 -- 172.21.15.78:0/347501499 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0072e0 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4a2ffd700 1 -- 172.21.15.78:0/347501499 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c007440 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4b08f6700 1 -- 172.21.15.78:0/347501499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac166040 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4a2ffd700 1 -- 172.21.15.78:0/347501499 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0057a0 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.185+0000 7fe4b08f6700 1 -- 172.21.15.78:0/347501499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac166600 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.186+0000 7fe4b08f6700 1 -- 172.21.15.78:0/347501499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac0c7730 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.186+0000 7fe4a2ffd700 1 -- 172.21.15.78:0/347501499 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe49c01a060 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.187+0000 7fe4a2ffd700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe48c05ed90 0x7fe48c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.187+0000 7fe4a2ffd700 1 -- 172.21.15.78:0/347501499 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe49c0790b0 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.187+0000 7fe4aad9d700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe48c05ed90 0x7fe48c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.187+0000 7fe4aad9d700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe48c05ed90 0x7fe48c061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe4a4007fd0 tx=0x7fe4a4009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.191+0000 7fe4a2ffd700 1 -- 172.21.15.78:0/347501499 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe49c04a650 con 0x7fe4ac0c2a00 2023-08-17T17:50:01.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.357+0000 7fe4b08f6700 1 -- 172.21.15.78:0/347501499 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4ac152130 con 0x7fe48c05ed90 2023-08-17T17:50:01.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.366+0000 7fe4a2ffd700 1 -- 172.21.15.78:0/347501499 <== mgr.6522 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360853 (secure 0 0 0) 0x7fe4ac152130 con 0x7fe48c05ed90 2023-08-17T17:50:01.371 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 -- 172.21.15.78:0/347501499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe48c05ed90 msgr2=0x7fe48c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe48c05ed90 0x7fe48c061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe4a4007fd0 tx=0x7fe4a4009040).stop 2023-08-17T17:50:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 -- 172.21.15.78:0/347501499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 msgr2=0x7fe4ac0a63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 0x7fe4ac0a63b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fe49c00c440 tx=0x7fe49c007d70).stop 2023-08-17T17:50:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 -- 172.21.15.78:0/347501499 shutdown_connections 2023-08-17T17:50:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe48c05ed90 0x7fe48c061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4ac0c2a00 0x7fe4ac0a63b0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4ac069b00 0x7fe4ac0a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 --2- 172.21.15.78:0/347501499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4ac0a8a30 0x7fe4ac162020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 -- 172.21.15.78:0/347501499 >> 172.21.15.78:0/347501499 conn(0x7fe4ac0c7320 msgr2=0x7fe4ac064960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 -- 172.21.15.78:0/347501499 shutdown_connections 2023-08-17T17:50:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.370+0000 7fe4b08f6700 1 -- 172.21.15.78:0/347501499 wait complete. 2023-08-17T17:50:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:50:01.383 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-17T17:49:59.974385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":250,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2414176,"kb_used_data":8736,"kb_used_omap":0,"kb_used_meta":2405376,"kb_avail":752560544,"statfs":{"total":773094113280,"available":770621997056,"internally_reserved":0,"allocated":8945664,"data_stored":4376316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2463105024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9405,"num_objects":-18,"num_object_clones":0,"num_object_copies":-36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-54,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.566874"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638539+0000","last_change":"2023-08-17T17:49:53.631693+0000","last_active":"2023-08-17T17:49:53.638539+0000","last_peered":"2023-08-17T17:49:53.638539+0000","last_clean":"2023-08-17T17:49:53.638539+0000","last_became_active":"2023-08-17T17:49:53.631421+0000","last_became_peered":"2023-08-17T17:49:53.631421+0000","last_unstale":"2023-08-17T17:49:53.638539+0000","last_undegraded":"2023-08-17T17:49:53.638539+0000","last_fullsized":"2023-08-17T17:49:53.638539+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"90'3","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630307+0000","last_change":"2023-08-17T17:49:53.267798+0000","last_active":"2023-08-17T17:49:53.630307+0000","last_peered":"2023-08-17T17:49:53.630307+0000","last_clean":"2023-08-17T17:49:53.630307+0000","last_became_active":"2023-08-17T17:49:53.267515+0000","last_became_peered":"2023-08-17T17:49:53.267515+0000","last_unstale":"2023-08-17T17:49:53.630307+0000","last_undegraded":"2023-08-17T17:49:53.630307+0000","last_fullsized":"2023-08-17T17:49:53.630307+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638782+0000","last_change":"2023-08-17T17:49:53.633203+0000","last_active":"2023-08-17T17:49:53.638782+0000","last_peered":"2023-08-17T17:49:53.638782+0000","last_clean":"2023-08-17T17:49:53.638782+0000","last_became_active":"2023-08-17T17:49:53.632829+0000","last_became_peered":"2023-08-17T17:49:53.632829+0000","last_unstale":"2023-08-17T17:49:53.638782+0000","last_undegraded":"2023-08-17T17:49:53.638782+0000","last_fullsized":"2023-08-17T17:49:53.638782+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.618072+0000","last_change":"2023-08-17T17:49:53.267679+0000","last_active":"2023-08-17T17:49:53.618072+0000","last_peered":"2023-08-17T17:49:53.618072+0000","last_clean":"2023-08-17T17:49:53.618072+0000","last_became_active":"2023-08-17T17:49:53.267389+0000","last_became_peered":"2023-08-17T17:49:53.267389+0000","last_unstale":"2023-08-17T17:49:53.618072+0000","last_undegraded":"2023-08-17T17:49:53.618072+0000","last_fullsized":"2023-08-17T17:49:53.618072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.639206+0000","last_change":"2023-08-17T17:49:53.632269+0000","last_active":"2023-08-17T17:49:53.639206+0000","last_peered":"2023-08-17T17:49:53.639206+0000","last_clean":"2023-08-17T17:49:53.639206+0000","last_became_active":"2023-08-17T17:49:53.632017+0000","last_became_peered":"2023-08-17T17:49:53.632017+0000","last_unstale":"2023-08-17T17:49:53.639206+0000","last_undegraded":"2023-08-17T17:49:53.639206+0000","last_fullsized":"2023-08-17T17:49:53.639206+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.614687+0000","last_change":"2023-08-17T17:49:53.262282+0000","last_active":"2023-08-17T17:49:53.614687+0000","last_peered":"2023-08-17T17:49:53.614687+0000","last_clean":"2023-08-17T17:49:53.614687+0000","last_became_active":"2023-08-17T17:49:53.262006+0000","last_became_peered":"2023-08-17T17:49:53.262006+0000","last_unstale":"2023-08-17T17:49:53.614687+0000","last_undegraded":"2023-08-17T17:49:53.614687+0000","last_fullsized":"2023-08-17T17:49:53.614687+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638415+0000","last_change":"2023-08-17T17:49:53.632067+0000","last_active":"2023-08-17T17:49:53.638415+0000","last_peered":"2023-08-17T17:49:53.638415+0000","last_clean":"2023-08-17T17:49:53.638415+0000","last_became_active":"2023-08-17T17:49:53.631808+0000","last_became_peered":"2023-08-17T17:49:53.631808+0000","last_unstale":"2023-08-17T17:49:53.638415+0000","last_undegraded":"2023-08-17T17:49:53.638415+0000","last_fullsized":"2023-08-17T17:49:53.638415+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.640578+0000","last_change":"2023-08-17T17:49:53.271791+0000","last_active":"2023-08-17T17:49:53.640578+0000","last_peered":"2023-08-17T17:49:53.640578+0000","last_clean":"2023-08-17T17:49:53.640578+0000","last_became_active":"2023-08-17T17:49:53.271606+0000","last_became_peered":"2023-08-17T17:49:53.271606+0000","last_unstale":"2023-08-17T17:49:53.640578+0000","last_undegraded":"2023-08-17T17:49:53.640578+0000","last_fullsized":"2023-08-17T17:49:53.640578+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.625840+0000","last_change":"2023-08-17T17:49:53.623845+0000","last_active":"2023-08-17T17:49:53.625840+0000","last_peered":"2023-08-17T17:49:53.625840+0000","last_clean":"2023-08-17T17:49:53.625840+0000","last_became_active":"2023-08-17T17:49:53.623102+0000","last_became_peered":"2023-08-17T17:49:53.623102+0000","last_unstale":"2023-08-17T17:49:53.625840+0000","last_undegraded":"2023-08-17T17:49:53.625840+0000","last_fullsized":"2023-08-17T17:49:53.625840+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631521+0000","last_change":"2023-08-17T17:49:53.264163+0000","last_active":"2023-08-17T17:49:53.631521+0000","last_peered":"2023-08-17T17:49:53.631521+0000","last_clean":"2023-08-17T17:49:53.631521+0000","last_became_active":"2023-08-17T17:49:53.263880+0000","last_became_peered":"2023-08-17T17:49:53.263880+0000","last_unstale":"2023-08-17T17:49:53.631521+0000","last_undegraded":"2023-08-17T17:49:53.631521+0000","last_fullsized":"2023-08-17T17:49:53.631521+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641066+0000","last_change":"2023-08-17T17:49:53.632465+0000","last_active":"2023-08-17T17:49:53.641066+0000","last_peered":"2023-08-17T17:49:53.641066+0000","last_clean":"2023-08-17T17:49:53.641066+0000","last_became_active":"2023-08-17T17:49:53.632122+0000","last_became_peered":"2023-08-17T17:49:53.632122+0000","last_unstale":"2023-08-17T17:49:53.641066+0000","last_undegraded":"2023-08-17T17:49:53.641066+0000","last_fullsized":"2023-08-17T17:49:53.641066+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631276+0000","last_change":"2023-08-17T17:49:53.269402+0000","last_active":"2023-08-17T17:49:53.631276+0000","last_peered":"2023-08-17T17:49:53.631276+0000","last_clean":"2023-08-17T17:49:53.631276+0000","last_became_active":"2023-08-17T17:49:53.268056+0000","last_became_peered":"2023-08-17T17:49:53.268056+0000","last_unstale":"2023-08-17T17:49:53.631276+0000","last_undegraded":"2023-08-17T17:49:53.631276+0000","last_fullsized":"2023-08-17T17:49:53.631276+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642539+0000","last_change":"2023-08-17T17:49:53.639102+0000","last_active":"2023-08-17T17:49:53.642539+0000","last_peered":"2023-08-17T17:49:53.642539+0000","last_clean":"2023-08-17T17:49:53.642539+0000","last_became_active":"2023-08-17T17:49:53.638803+0000","last_became_peered":"2023-08-17T17:49:53.638803+0000","last_unstale":"2023-08-17T17:49:53.642539+0000","last_undegraded":"2023-08-17T17:49:53.642539+0000","last_fullsized":"2023-08-17T17:49:53.642539+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.613538+0000","last_change":"2023-08-17T17:49:53.265509+0000","last_active":"2023-08-17T17:49:53.613538+0000","last_peered":"2023-08-17T17:49:53.613538+0000","last_clean":"2023-08-17T17:49:53.613538+0000","last_became_active":"2023-08-17T17:49:53.262096+0000","last_became_peered":"2023-08-17T17:49:53.262096+0000","last_unstale":"2023-08-17T17:49:53.613538+0000","last_undegraded":"2023-08-17T17:49:53.613538+0000","last_fullsized":"2023-08-17T17:49:53.613538+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630896+0000","last_change":"2023-08-17T17:49:53.628939+0000","last_active":"2023-08-17T17:49:53.630896+0000","last_peered":"2023-08-17T17:49:53.630896+0000","last_clean":"2023-08-17T17:49:53.630896+0000","last_became_active":"2023-08-17T17:49:53.628609+0000","last_became_peered":"2023-08-17T17:49:53.628609+0000","last_unstale":"2023-08-17T17:49:53.630896+0000","last_undegraded":"2023-08-17T17:49:53.630896+0000","last_fullsized":"2023-08-17T17:49:53.630896+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617215+0000","last_change":"2023-08-17T17:49:53.266083+0000","last_active":"2023-08-17T17:49:53.617215+0000","last_peered":"2023-08-17T17:49:53.617215+0000","last_clean":"2023-08-17T17:49:53.617215+0000","last_became_active":"2023-08-17T17:49:53.265558+0000","last_became_peered":"2023-08-17T17:49:53.265558+0000","last_unstale":"2023-08-17T17:49:53.617215+0000","last_undegraded":"2023-08-17T17:49:53.617215+0000","last_fullsized":"2023-08-17T17:49:53.617215+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630942+0000","last_change":"2023-08-17T17:49:53.627791+0000","last_active":"2023-08-17T17:49:53.630942+0000","last_peered":"2023-08-17T17:49:53.630942+0000","last_clean":"2023-08-17T17:49:53.630942+0000","last_became_active":"2023-08-17T17:49:53.627208+0000","last_became_peered":"2023-08-17T17:49:53.627208+0000","last_unstale":"2023-08-17T17:49:53.630942+0000","last_undegraded":"2023-08-17T17:49:53.630942+0000","last_fullsized":"2023-08-17T17:49:53.630942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619854+0000","last_change":"2023-08-17T17:49:53.259607+0000","last_active":"2023-08-17T17:49:53.619854+0000","last_peered":"2023-08-17T17:49:53.619854+0000","last_clean":"2023-08-17T17:49:53.619854+0000","last_became_active":"2023-08-17T17:49:53.258654+0000","last_became_peered":"2023-08-17T17:49:53.258654+0000","last_unstale":"2023-08-17T17:49:53.619854+0000","last_undegraded":"2023-08-17T17:49:53.619854+0000","last_fullsized":"2023-08-17T17:49:53.619854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642614+0000","last_change":"2023-08-17T17:49:53.641446+0000","last_active":"2023-08-17T17:49:53.642614+0000","last_peered":"2023-08-17T17:49:53.642614+0000","last_clean":"2023-08-17T17:49:53.642614+0000","last_became_active":"2023-08-17T17:49:53.641179+0000","last_became_peered":"2023-08-17T17:49:53.641179+0000","last_unstale":"2023-08-17T17:49:53.642614+0000","last_undegraded":"2023-08-17T17:49:53.642614+0000","last_fullsized":"2023-08-17T17:49:53.642614+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617843+0000","last_change":"2023-08-17T17:49:53.263343+0000","last_active":"2023-08-17T17:49:53.617843+0000","last_peered":"2023-08-17T17:49:53.617843+0000","last_clean":"2023-08-17T17:49:53.617843+0000","last_became_active":"2023-08-17T17:49:53.263085+0000","last_became_peered":"2023-08-17T17:49:53.263085+0000","last_unstale":"2023-08-17T17:49:53.617843+0000","last_undegraded":"2023-08-17T17:49:53.617843+0000","last_fullsized":"2023-08-17T17:49:53.617843+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.639177+0000","last_change":"2023-08-17T17:49:53.625393+0000","last_active":"2023-08-17T17:49:53.639177+0000","last_peered":"2023-08-17T17:49:53.639177+0000","last_clean":"2023-08-17T17:49:53.639177+0000","last_became_active":"2023-08-17T17:49:53.625119+0000","last_became_peered":"2023-08-17T17:49:53.625119+0000","last_unstale":"2023-08-17T17:49:53.639177+0000","last_undegraded":"2023-08-17T17:49:53.639177+0000","last_fullsized":"2023-08-17T17:49:53.639177+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617213+0000","last_change":"2023-08-17T17:49:53.270010+0000","last_active":"2023-08-17T17:49:53.617213+0000","last_peered":"2023-08-17T17:49:53.617213+0000","last_clean":"2023-08-17T17:49:53.617213+0000","last_became_active":"2023-08-17T17:49:53.269690+0000","last_became_peered":"2023-08-17T17:49:53.269690+0000","last_unstale":"2023-08-17T17:49:53.617213+0000","last_undegraded":"2023-08-17T17:49:53.617213+0000","last_fullsized":"2023-08-17T17:49:53.617213+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642944+0000","last_change":"2023-08-17T17:49:53.640910+0000","last_active":"2023-08-17T17:49:53.642944+0000","last_peered":"2023-08-17T17:49:53.642944+0000","last_clean":"2023-08-17T17:49:53.642944+0000","last_became_active":"2023-08-17T17:49:53.640659+0000","last_became_peered":"2023-08-17T17:49:53.640659+0000","last_unstale":"2023-08-17T17:49:53.642944+0000","last_undegraded":"2023-08-17T17:49:53.642944+0000","last_fullsized":"2023-08-17T17:49:53.642944+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"90'4","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.648359+0000","last_change":"2023-08-17T17:49:53.264709+0000","last_active":"2023-08-17T17:49:53.648359+0000","last_peered":"2023-08-17T17:49:53.648359+0000","last_clean":"2023-08-17T17:49:53.648359+0000","last_became_active":"2023-08-17T17:49:53.264073+0000","last_became_peered":"2023-08-17T17:49:53.264073+0000","last_unstale":"2023-08-17T17:49:53.648359+0000","last_undegraded":"2023-08-17T17:49:53.648359+0000","last_fullsized":"2023-08-17T17:49:53.648359+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.636079+0000","last_change":"2023-08-17T17:49:53.633430+0000","last_active":"2023-08-17T17:49:53.636079+0000","last_peered":"2023-08-17T17:49:53.636079+0000","last_clean":"2023-08-17T17:49:53.636079+0000","last_became_active":"2023-08-17T17:49:53.633041+0000","last_became_peered":"2023-08-17T17:49:53.633041+0000","last_unstale":"2023-08-17T17:49:53.636079+0000","last_undegraded":"2023-08-17T17:49:53.636079+0000","last_fullsized":"2023-08-17T17:49:53.636079+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.634616+0000","last_change":"2023-08-17T17:49:53.261048+0000","last_active":"2023-08-17T17:49:53.634616+0000","last_peered":"2023-08-17T17:49:53.634616+0000","last_clean":"2023-08-17T17:49:53.634616+0000","last_became_active":"2023-08-17T17:49:53.260747+0000","last_became_peered":"2023-08-17T17:49:53.260747+0000","last_unstale":"2023-08-17T17:49:53.634616+0000","last_undegraded":"2023-08-17T17:49:53.634616+0000","last_fullsized":"2023-08-17T17:49:53.634616+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635906+0000","last_change":"2023-08-17T17:49:53.633359+0000","last_active":"2023-08-17T17:49:53.635906+0000","last_peered":"2023-08-17T17:49:53.635906+0000","last_clean":"2023-08-17T17:49:53.635906+0000","last_became_active":"2023-08-17T17:49:53.632947+0000","last_became_peered":"2023-08-17T17:49:53.632947+0000","last_unstale":"2023-08-17T17:49:53.635906+0000","last_undegraded":"2023-08-17T17:49:53.635906+0000","last_fullsized":"2023-08-17T17:49:53.635906+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.627092+0000","last_change":"2023-08-17T17:49:53.266502+0000","last_active":"2023-08-17T17:49:53.627092+0000","last_peered":"2023-08-17T17:49:53.627092+0000","last_clean":"2023-08-17T17:49:53.627092+0000","last_became_active":"2023-08-17T17:49:53.266301+0000","last_became_peered":"2023-08-17T17:49:53.266301+0000","last_unstale":"2023-08-17T17:49:53.627092+0000","last_undegraded":"2023-08-17T17:49:53.627092+0000","last_fullsized":"2023-08-17T17:49:53.627092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.625296+0000","last_change":"2023-08-17T17:49:53.622973+0000","last_active":"2023-08-17T17:49:53.625296+0000","last_peered":"2023-08-17T17:49:53.625296+0000","last_clean":"2023-08-17T17:49:53.625296+0000","last_became_active":"2023-08-17T17:49:53.622576+0000","last_became_peered":"2023-08-17T17:49:53.622576+0000","last_unstale":"2023-08-17T17:49:53.625296+0000","last_undegraded":"2023-08-17T17:49:53.625296+0000","last_fullsized":"2023-08-17T17:49:53.625296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.618917+0000","last_change":"2023-08-17T17:49:53.258908+0000","last_active":"2023-08-17T17:49:53.618917+0000","last_peered":"2023-08-17T17:49:53.618917+0000","last_clean":"2023-08-17T17:49:53.618917+0000","last_became_active":"2023-08-17T17:49:53.258631+0000","last_became_peered":"2023-08-17T17:49:53.258631+0000","last_unstale":"2023-08-17T17:49:53.618917+0000","last_undegraded":"2023-08-17T17:49:53.618917+0000","last_fullsized":"2023-08-17T17:49:53.618917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641636+0000","last_change":"2023-08-17T17:49:53.640614+0000","last_active":"2023-08-17T17:49:53.641636+0000","last_peered":"2023-08-17T17:49:53.641636+0000","last_clean":"2023-08-17T17:49:53.641636+0000","last_became_active":"2023-08-17T17:49:53.640262+0000","last_became_peered":"2023-08-17T17:49:53.640262+0000","last_unstale":"2023-08-17T17:49:53.641636+0000","last_undegraded":"2023-08-17T17:49:53.641636+0000","last_fullsized":"2023-08-17T17:49:53.641636+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"90'4","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631040+0000","last_change":"2023-08-17T17:49:53.269722+0000","last_active":"2023-08-17T17:49:53.631040+0000","last_peered":"2023-08-17T17:49:53.631040+0000","last_clean":"2023-08-17T17:49:53.631040+0000","last_became_active":"2023-08-17T17:49:53.269348+0000","last_became_peered":"2023-08-17T17:49:53.269348+0000","last_unstale":"2023-08-17T17:49:53.631040+0000","last_undegraded":"2023-08-17T17:49:53.631040+0000","last_fullsized":"2023-08-17T17:49:53.631040+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642642+0000","last_change":"2023-08-17T17:49:53.639387+0000","last_active":"2023-08-17T17:49:53.642642+0000","last_peered":"2023-08-17T17:49:53.642642+0000","last_clean":"2023-08-17T17:49:53.642642+0000","last_became_active":"2023-08-17T17:49:53.639031+0000","last_became_peered":"2023-08-17T17:49:53.639031+0000","last_unstale":"2023-08-17T17:49:53.642642+0000","last_undegraded":"2023-08-17T17:49:53.642642+0000","last_fullsized":"2023-08-17T17:49:53.642642+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619697+0000","last_change":"2023-08-17T17:49:53.263731+0000","last_active":"2023-08-17T17:49:53.619697+0000","last_peered":"2023-08-17T17:49:53.619697+0000","last_clean":"2023-08-17T17:49:53.619697+0000","last_became_active":"2023-08-17T17:49:53.259341+0000","last_became_peered":"2023-08-17T17:49:53.259341+0000","last_unstale":"2023-08-17T17:49:53.619697+0000","last_undegraded":"2023-08-17T17:49:53.619697+0000","last_fullsized":"2023-08-17T17:49:53.619697+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631222+0000","last_change":"2023-08-17T17:49:53.628183+0000","last_active":"2023-08-17T17:49:53.631222+0000","last_peered":"2023-08-17T17:49:53.631222+0000","last_clean":"2023-08-17T17:49:53.631222+0000","last_became_active":"2023-08-17T17:49:53.627886+0000","last_became_peered":"2023-08-17T17:49:53.627886+0000","last_unstale":"2023-08-17T17:49:53.631222+0000","last_undegraded":"2023-08-17T17:49:53.631222+0000","last_fullsized":"2023-08-17T17:49:53.631222+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.633478+0000","last_change":"2023-08-17T17:49:53.269509+0000","last_active":"2023-08-17T17:49:53.633478+0000","last_peered":"2023-08-17T17:49:53.633478+0000","last_clean":"2023-08-17T17:49:53.633478+0000","last_became_active":"2023-08-17T17:49:53.268452+0000","last_became_peered":"2023-08-17T17:49:53.268452+0000","last_unstale":"2023-08-17T17:49:53.633478+0000","last_undegraded":"2023-08-17T17:49:53.633478+0000","last_fullsized":"2023-08-17T17:49:53.633478+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642923+0000","last_change":"2023-08-17T17:49:53.641002+0000","last_active":"2023-08-17T17:49:53.642923+0000","last_peered":"2023-08-17T17:49:53.642923+0000","last_clean":"2023-08-17T17:49:53.642923+0000","last_became_active":"2023-08-17T17:49:53.640388+0000","last_became_peered":"2023-08-17T17:49:53.640388+0000","last_unstale":"2023-08-17T17:49:53.642923+0000","last_undegraded":"2023-08-17T17:49:53.642923+0000","last_fullsized":"2023-08-17T17:49:53.642923+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641516+0000","last_change":"2023-08-17T17:49:53.261035+0000","last_active":"2023-08-17T17:49:53.641516+0000","last_peered":"2023-08-17T17:49:53.641516+0000","last_clean":"2023-08-17T17:49:53.641516+0000","last_became_active":"2023-08-17T17:49:53.260215+0000","last_became_peered":"2023-08-17T17:49:53.260215+0000","last_unstale":"2023-08-17T17:49:53.641516+0000","last_undegraded":"2023-08-17T17:49:53.641516+0000","last_fullsized":"2023-08-17T17:49:53.641516+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635276+0000","last_change":"2023-08-17T17:49:53.631927+0000","last_active":"2023-08-17T17:49:53.635276+0000","last_peered":"2023-08-17T17:49:53.635276+0000","last_clean":"2023-08-17T17:49:53.635276+0000","last_became_active":"2023-08-17T17:49:53.631653+0000","last_became_peered":"2023-08-17T17:49:53.631653+0000","last_unstale":"2023-08-17T17:49:53.635276+0000","last_undegraded":"2023-08-17T17:49:53.635276+0000","last_fullsized":"2023-08-17T17:49:53.635276+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.622614+0000","last_change":"2023-08-17T17:49:53.265475+0000","last_active":"2023-08-17T17:49:53.622614+0000","last_peered":"2023-08-17T17:49:53.622614+0000","last_clean":"2023-08-17T17:49:53.622614+0000","last_became_active":"2023-08-17T17:49:53.265202+0000","last_became_peered":"2023-08-17T17:49:53.265202+0000","last_unstale":"2023-08-17T17:49:53.622614+0000","last_undegraded":"2023-08-17T17:49:53.622614+0000","last_fullsized":"2023-08-17T17:49:53.622614+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642634+0000","last_change":"2023-08-17T17:49:53.635200+0000","last_active":"2023-08-17T17:49:53.642634+0000","last_peered":"2023-08-17T17:49:53.642634+0000","last_clean":"2023-08-17T17:49:53.642634+0000","last_became_active":"2023-08-17T17:49:53.634327+0000","last_became_peered":"2023-08-17T17:49:53.634327+0000","last_unstale":"2023-08-17T17:49:53.642634+0000","last_undegraded":"2023-08-17T17:49:53.642634+0000","last_fullsized":"2023-08-17T17:49:53.642634+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.634809+0000","last_change":"2023-08-17T17:49:53.265673+0000","last_active":"2023-08-17T17:49:53.634809+0000","last_peered":"2023-08-17T17:49:53.634809+0000","last_clean":"2023-08-17T17:49:53.634809+0000","last_became_active":"2023-08-17T17:49:53.265279+0000","last_became_peered":"2023-08-17T17:49:53.265279+0000","last_unstale":"2023-08-17T17:49:53.634809+0000","last_undegraded":"2023-08-17T17:49:53.634809+0000","last_fullsized":"2023-08-17T17:49:53.634809+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638961+0000","last_change":"2023-08-17T17:49:53.628039+0000","last_active":"2023-08-17T17:49:53.638961+0000","last_peered":"2023-08-17T17:49:53.638961+0000","last_clean":"2023-08-17T17:49:53.638961+0000","last_became_active":"2023-08-17T17:49:53.627742+0000","last_became_peered":"2023-08-17T17:49:53.627742+0000","last_unstale":"2023-08-17T17:49:53.638961+0000","last_undegraded":"2023-08-17T17:49:53.638961+0000","last_fullsized":"2023-08-17T17:49:53.638961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619002+0000","last_change":"2023-08-17T17:49:53.263875+0000","last_active":"2023-08-17T17:49:53.619002+0000","last_peered":"2023-08-17T17:49:53.619002+0000","last_clean":"2023-08-17T17:49:53.619002+0000","last_became_active":"2023-08-17T17:49:53.263534+0000","last_became_peered":"2023-08-17T17:49:53.263534+0000","last_unstale":"2023-08-17T17:49:53.619002+0000","last_undegraded":"2023-08-17T17:49:53.619002+0000","last_fullsized":"2023-08-17T17:49:53.619002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641112+0000","last_change":"2023-08-17T17:49:53.631678+0000","last_active":"2023-08-17T17:49:53.641112+0000","last_peered":"2023-08-17T17:49:53.641112+0000","last_clean":"2023-08-17T17:49:53.641112+0000","last_became_active":"2023-08-17T17:49:53.631420+0000","last_became_peered":"2023-08-17T17:49:53.631420+0000","last_unstale":"2023-08-17T17:49:53.641112+0000","last_undegraded":"2023-08-17T17:49:53.641112+0000","last_fullsized":"2023-08-17T17:49:53.641112+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.616926+0000","last_change":"2023-08-17T17:49:53.267009+0000","last_active":"2023-08-17T17:49:53.616926+0000","last_peered":"2023-08-17T17:49:53.616926+0000","last_clean":"2023-08-17T17:49:53.616926+0000","last_became_active":"2023-08-17T17:49:53.266748+0000","last_became_peered":"2023-08-17T17:49:53.266748+0000","last_unstale":"2023-08-17T17:49:53.616926+0000","last_undegraded":"2023-08-17T17:49:53.616926+0000","last_fullsized":"2023-08-17T17:49:53.616926+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.629495+0000","last_change":"2023-08-17T17:49:53.626538+0000","last_active":"2023-08-17T17:49:53.629495+0000","last_peered":"2023-08-17T17:49:53.629495+0000","last_clean":"2023-08-17T17:49:53.629495+0000","last_became_active":"2023-08-17T17:49:53.626256+0000","last_became_peered":"2023-08-17T17:49:53.626256+0000","last_unstale":"2023-08-17T17:49:53.629495+0000","last_undegraded":"2023-08-17T17:49:53.629495+0000","last_fullsized":"2023-08-17T17:49:53.629495+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619649+0000","last_change":"2023-08-17T17:49:53.271964+0000","last_active":"2023-08-17T17:49:53.619649+0000","last_peered":"2023-08-17T17:49:53.619649+0000","last_clean":"2023-08-17T17:49:53.619649+0000","last_became_active":"2023-08-17T17:49:53.271684+0000","last_became_peered":"2023-08-17T17:49:53.271684+0000","last_unstale":"2023-08-17T17:49:53.619649+0000","last_undegraded":"2023-08-17T17:49:53.619649+0000","last_fullsized":"2023-08-17T17:49:53.619649+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630960+0000","last_change":"2023-08-17T17:49:53.629070+0000","last_active":"2023-08-17T17:49:53.630960+0000","last_peered":"2023-08-17T17:49:53.630960+0000","last_clean":"2023-08-17T17:49:53.630960+0000","last_became_active":"2023-08-17T17:49:53.628575+0000","last_became_peered":"2023-08-17T17:49:53.628575+0000","last_unstale":"2023-08-17T17:49:53.630960+0000","last_undegraded":"2023-08-17T17:49:53.630960+0000","last_fullsized":"2023-08-17T17:49:53.630960+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617966+0000","last_change":"2023-08-17T17:49:53.264902+0000","last_active":"2023-08-17T17:49:53.617966+0000","last_peered":"2023-08-17T17:49:53.617966+0000","last_clean":"2023-08-17T17:49:53.617966+0000","last_became_active":"2023-08-17T17:49:53.264635+0000","last_became_peered":"2023-08-17T17:49:53.264635+0000","last_unstale":"2023-08-17T17:49:53.617966+0000","last_undegraded":"2023-08-17T17:49:53.617966+0000","last_fullsized":"2023-08-17T17:49:53.617966+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.643125+0000","last_change":"2023-08-17T17:49:53.637672+0000","last_active":"2023-08-17T17:49:53.643125+0000","last_peered":"2023-08-17T17:49:53.643125+0000","last_clean":"2023-08-17T17:49:53.643125+0000","last_became_active":"2023-08-17T17:49:53.637459+0000","last_became_peered":"2023-08-17T17:49:53.637459+0000","last_unstale":"2023-08-17T17:49:53.643125+0000","last_undegraded":"2023-08-17T17:49:53.643125+0000","last_fullsized":"2023-08-17T17:49:53.643125+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.614038+0000","last_change":"2023-08-17T17:49:53.269914+0000","last_active":"2023-08-17T17:49:53.614038+0000","last_peered":"2023-08-17T17:49:53.614038+0000","last_clean":"2023-08-17T17:49:53.614038+0000","last_became_active":"2023-08-17T17:49:53.269625+0000","last_became_peered":"2023-08-17T17:49:53.269625+0000","last_unstale":"2023-08-17T17:49:53.614038+0000","last_undegraded":"2023-08-17T17:49:53.614038+0000","last_fullsized":"2023-08-17T17:49:53.614038+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.633769+0000","last_change":"2023-08-17T17:49:53.632775+0000","last_active":"2023-08-17T17:49:53.633769+0000","last_peered":"2023-08-17T17:49:53.633769+0000","last_clean":"2023-08-17T17:49:53.633769+0000","last_became_active":"2023-08-17T17:49:53.632501+0000","last_became_peered":"2023-08-17T17:49:53.632501+0000","last_unstale":"2023-08-17T17:49:53.633769+0000","last_undegraded":"2023-08-17T17:49:53.633769+0000","last_fullsized":"2023-08-17T17:49:53.633769+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.614759+0000","last_change":"2023-08-17T17:49:53.261899+0000","last_active":"2023-08-17T17:49:53.614759+0000","last_peered":"2023-08-17T17:49:53.614759+0000","last_clean":"2023-08-17T17:49:53.614759+0000","last_became_active":"2023-08-17T17:49:53.261642+0000","last_became_peered":"2023-08-17T17:49:53.261642+0000","last_unstale":"2023-08-17T17:49:53.614759+0000","last_undegraded":"2023-08-17T17:49:53.614759+0000","last_fullsized":"2023-08-17T17:49:53.614759+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.634671+0000","last_change":"2023-08-17T17:49:53.629382+0000","last_active":"2023-08-17T17:49:53.634671+0000","last_peered":"2023-08-17T17:49:53.634671+0000","last_clean":"2023-08-17T17:49:53.634671+0000","last_became_active":"2023-08-17T17:49:53.629098+0000","last_became_peered":"2023-08-17T17:49:53.629098+0000","last_unstale":"2023-08-17T17:49:53.634671+0000","last_undegraded":"2023-08-17T17:49:53.634671+0000","last_fullsized":"2023-08-17T17:49:53.634671+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617976+0000","last_change":"2023-08-17T17:49:53.263471+0000","last_active":"2023-08-17T17:49:53.617976+0000","last_peered":"2023-08-17T17:49:53.617976+0000","last_clean":"2023-08-17T17:49:53.617976+0000","last_became_active":"2023-08-17T17:49:53.263187+0000","last_became_peered":"2023-08-17T17:49:53.263187+0000","last_unstale":"2023-08-17T17:49:53.617976+0000","last_undegraded":"2023-08-17T17:49:53.617976+0000","last_fullsized":"2023-08-17T17:49:53.617976+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.629389+0000","last_change":"2023-08-17T17:49:53.626856+0000","last_active":"2023-08-17T17:49:53.629389+0000","last_peered":"2023-08-17T17:49:53.629389+0000","last_clean":"2023-08-17T17:49:53.629389+0000","last_became_active":"2023-08-17T17:49:53.626591+0000","last_became_peered":"2023-08-17T17:49:53.626591+0000","last_unstale":"2023-08-17T17:49:53.629389+0000","last_undegraded":"2023-08-17T17:49:53.629389+0000","last_fullsized":"2023-08-17T17:49:53.629389+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.614432+0000","last_change":"2023-08-17T17:49:53.265578+0000","last_active":"2023-08-17T17:49:53.614432+0000","last_peered":"2023-08-17T17:49:53.614432+0000","last_clean":"2023-08-17T17:49:53.614432+0000","last_became_active":"2023-08-17T17:49:53.265329+0000","last_became_peered":"2023-08-17T17:49:53.265329+0000","last_unstale":"2023-08-17T17:49:53.614432+0000","last_undegraded":"2023-08-17T17:49:53.614432+0000","last_fullsized":"2023-08-17T17:49:53.614432+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630522+0000","last_change":"2023-08-17T17:49:53.626127+0000","last_active":"2023-08-17T17:49:53.630522+0000","last_peered":"2023-08-17T17:49:53.630522+0000","last_clean":"2023-08-17T17:49:53.630522+0000","last_became_active":"2023-08-17T17:49:53.625815+0000","last_became_peered":"2023-08-17T17:49:53.625815+0000","last_unstale":"2023-08-17T17:49:53.630522+0000","last_undegraded":"2023-08-17T17:49:53.630522+0000","last_fullsized":"2023-08-17T17:49:53.630522+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.613203+0000","last_change":"2023-08-17T17:49:53.268995+0000","last_active":"2023-08-17T17:49:53.613203+0000","last_peered":"2023-08-17T17:49:53.613203+0000","last_clean":"2023-08-17T17:49:53.613203+0000","last_became_active":"2023-08-17T17:49:53.268689+0000","last_became_peered":"2023-08-17T17:49:53.268689+0000","last_unstale":"2023-08-17T17:49:53.613203+0000","last_undegraded":"2023-08-17T17:49:53.613203+0000","last_fullsized":"2023-08-17T17:49:53.613203+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635973+0000","last_change":"2023-08-17T17:49:53.632973+0000","last_active":"2023-08-17T17:49:53.635973+0000","last_peered":"2023-08-17T17:49:53.635973+0000","last_clean":"2023-08-17T17:49:53.635973+0000","last_became_active":"2023-08-17T17:49:53.632667+0000","last_became_peered":"2023-08-17T17:49:53.632667+0000","last_unstale":"2023-08-17T17:49:53.635973+0000","last_undegraded":"2023-08-17T17:49:53.635973+0000","last_fullsized":"2023-08-17T17:49:53.635973+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.613515+0000","last_change":"2023-08-17T17:49:53.262280+0000","last_active":"2023-08-17T17:49:53.613515+0000","last_peered":"2023-08-17T17:49:53.613515+0000","last_clean":"2023-08-17T17:49:53.613515+0000","last_became_active":"2023-08-17T17:49:53.261820+0000","last_became_peered":"2023-08-17T17:49:53.261820+0000","last_unstale":"2023-08-17T17:49:53.613515+0000","last_undegraded":"2023-08-17T17:49:53.613515+0000","last_fullsized":"2023-08-17T17:49:53.613515+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642641+0000","last_change":"2023-08-17T17:49:53.639283+0000","last_active":"2023-08-17T17:49:53.642641+0000","last_peered":"2023-08-17T17:49:53.642641+0000","last_clean":"2023-08-17T17:49:53.642641+0000","last_became_active":"2023-08-17T17:49:53.639006+0000","last_became_peered":"2023-08-17T17:49:53.639006+0000","last_unstale":"2023-08-17T17:49:53.642641+0000","last_undegraded":"2023-08-17T17:49:53.642641+0000","last_fullsized":"2023-08-17T17:49:53.642641+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617160+0000","last_change":"2023-08-17T17:49:53.270013+0000","last_active":"2023-08-17T17:49:53.617160+0000","last_peered":"2023-08-17T17:49:53.617160+0000","last_clean":"2023-08-17T17:49:53.617160+0000","last_became_active":"2023-08-17T17:49:53.268017+0000","last_became_peered":"2023-08-17T17:49:53.268017+0000","last_unstale":"2023-08-17T17:49:53.617160+0000","last_undegraded":"2023-08-17T17:49:53.617160+0000","last_fullsized":"2023-08-17T17:49:53.617160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.640605+0000","last_change":"2023-08-17T17:49:53.628717+0000","last_active":"2023-08-17T17:49:53.640605+0000","last_peered":"2023-08-17T17:49:53.640605+0000","last_clean":"2023-08-17T17:49:53.640605+0000","last_became_active":"2023-08-17T17:49:53.628491+0000","last_became_peered":"2023-08-17T17:49:53.628491+0000","last_unstale":"2023-08-17T17:49:53.640605+0000","last_undegraded":"2023-08-17T17:49:53.640605+0000","last_fullsized":"2023-08-17T17:49:53.640605+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.640402+0000","last_change":"2023-08-17T17:49:53.261049+0000","last_active":"2023-08-17T17:49:53.640402+0000","last_peered":"2023-08-17T17:49:53.640402+0000","last_clean":"2023-08-17T17:49:53.640402+0000","last_became_active":"2023-08-17T17:49:53.259006+0000","last_became_peered":"2023-08-17T17:49:53.259006+0000","last_unstale":"2023-08-17T17:49:53.640402+0000","last_undegraded":"2023-08-17T17:49:53.640402+0000","last_fullsized":"2023-08-17T17:49:53.640402+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.633884+0000","last_change":"2023-08-17T17:49:53.629473+0000","last_active":"2023-08-17T17:49:53.633884+0000","last_peered":"2023-08-17T17:49:53.633884+0000","last_clean":"2023-08-17T17:49:53.633884+0000","last_became_active":"2023-08-17T17:49:53.629201+0000","last_became_peered":"2023-08-17T17:49:53.629201+0000","last_unstale":"2023-08-17T17:49:53.633884+0000","last_undegraded":"2023-08-17T17:49:53.633884+0000","last_fullsized":"2023-08-17T17:49:53.633884+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.629757+0000","last_change":"2023-08-17T17:49:53.268991+0000","last_active":"2023-08-17T17:49:53.629757+0000","last_peered":"2023-08-17T17:49:53.629757+0000","last_clean":"2023-08-17T17:49:53.629757+0000","last_became_active":"2023-08-17T17:49:53.268695+0000","last_became_peered":"2023-08-17T17:49:53.268695+0000","last_unstale":"2023-08-17T17:49:53.629757+0000","last_undegraded":"2023-08-17T17:49:53.629757+0000","last_fullsized":"2023-08-17T17:49:53.629757+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641711+0000","last_change":"2023-08-17T17:49:53.640954+0000","last_active":"2023-08-17T17:49:53.641711+0000","last_peered":"2023-08-17T17:49:53.641711+0000","last_clean":"2023-08-17T17:49:53.641711+0000","last_became_active":"2023-08-17T17:49:53.640592+0000","last_became_peered":"2023-08-17T17:49:53.640592+0000","last_unstale":"2023-08-17T17:49:53.641711+0000","last_undegraded":"2023-08-17T17:49:53.641711+0000","last_fullsized":"2023-08-17T17:49:53.641711+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.636102+0000","last_change":"2023-08-17T17:49:53.262454+0000","last_active":"2023-08-17T17:49:53.636102+0000","last_peered":"2023-08-17T17:49:53.636102+0000","last_clean":"2023-08-17T17:49:53.636102+0000","last_became_active":"2023-08-17T17:49:53.262157+0000","last_became_peered":"2023-08-17T17:49:53.262157+0000","last_unstale":"2023-08-17T17:49:53.636102+0000","last_undegraded":"2023-08-17T17:49:53.636102+0000","last_fullsized":"2023-08-17T17:49:53.636102+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635296+0000","last_change":"2023-08-17T17:49:53.631950+0000","last_active":"2023-08-17T17:49:53.635296+0000","last_peered":"2023-08-17T17:49:53.635296+0000","last_clean":"2023-08-17T17:49:53.635296+0000","last_became_active":"2023-08-17T17:49:53.631705+0000","last_became_peered":"2023-08-17T17:49:53.631705+0000","last_unstale":"2023-08-17T17:49:53.635296+0000","last_undegraded":"2023-08-17T17:49:53.635296+0000","last_fullsized":"2023-08-17T17:49:53.635296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619909+0000","last_change":"2023-08-17T17:49:53.269249+0000","last_active":"2023-08-17T17:49:53.619909+0000","last_peered":"2023-08-17T17:49:53.619909+0000","last_clean":"2023-08-17T17:49:53.619909+0000","last_became_active":"2023-08-17T17:49:53.268648+0000","last_became_peered":"2023-08-17T17:49:53.268648+0000","last_unstale":"2023-08-17T17:49:53.619909+0000","last_undegraded":"2023-08-17T17:49:53.619909+0000","last_fullsized":"2023-08-17T17:49:53.619909+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.637172+0000","last_change":"2023-08-17T17:49:53.634055+0000","last_active":"2023-08-17T17:49:53.637172+0000","last_peered":"2023-08-17T17:49:53.637172+0000","last_clean":"2023-08-17T17:49:53.637172+0000","last_became_active":"2023-08-17T17:49:53.633798+0000","last_became_peered":"2023-08-17T17:49:53.633798+0000","last_unstale":"2023-08-17T17:49:53.637172+0000","last_undegraded":"2023-08-17T17:49:53.637172+0000","last_fullsized":"2023-08-17T17:49:53.637172+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619563+0000","last_change":"2023-08-17T17:49:53.265862+0000","last_active":"2023-08-17T17:49:53.619563+0000","last_peered":"2023-08-17T17:49:53.619563+0000","last_clean":"2023-08-17T17:49:53.619563+0000","last_became_active":"2023-08-17T17:49:53.264607+0000","last_became_peered":"2023-08-17T17:49:53.264607+0000","last_unstale":"2023-08-17T17:49:53.619563+0000","last_undegraded":"2023-08-17T17:49:53.619563+0000","last_fullsized":"2023-08-17T17:49:53.619563+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635887+0000","last_change":"2023-08-17T17:49:53.633197+0000","last_active":"2023-08-17T17:49:53.635887+0000","last_peered":"2023-08-17T17:49:53.635887+0000","last_clean":"2023-08-17T17:49:53.635887+0000","last_became_active":"2023-08-17T17:49:53.632626+0000","last_became_peered":"2023-08-17T17:49:53.632626+0000","last_unstale":"2023-08-17T17:49:53.635887+0000","last_undegraded":"2023-08-17T17:49:53.635887+0000","last_fullsized":"2023-08-17T17:49:53.635887+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.613321+0000","last_change":"2023-08-17T17:49:53.263878+0000","last_active":"2023-08-17T17:49:53.613321+0000","last_peered":"2023-08-17T17:49:53.613321+0000","last_clean":"2023-08-17T17:49:53.613321+0000","last_became_active":"2023-08-17T17:49:53.263594+0000","last_became_peered":"2023-08-17T17:49:53.263594+0000","last_unstale":"2023-08-17T17:49:53.613321+0000","last_undegraded":"2023-08-17T17:49:53.613321+0000","last_fullsized":"2023-08-17T17:49:53.613321+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641621+0000","last_change":"2023-08-17T17:49:53.640584+0000","last_active":"2023-08-17T17:49:53.641621+0000","last_peered":"2023-08-17T17:49:53.641621+0000","last_clean":"2023-08-17T17:49:53.641621+0000","last_became_active":"2023-08-17T17:49:53.640251+0000","last_became_peered":"2023-08-17T17:49:53.640251+0000","last_unstale":"2023-08-17T17:49:53.641621+0000","last_undegraded":"2023-08-17T17:49:53.641621+0000","last_fullsized":"2023-08-17T17:49:53.641621+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619015+0000","last_change":"2023-08-17T17:49:53.261333+0000","last_active":"2023-08-17T17:49:53.619015+0000","last_peered":"2023-08-17T17:49:53.619015+0000","last_clean":"2023-08-17T17:49:53.619015+0000","last_became_active":"2023-08-17T17:49:53.261035+0000","last_became_peered":"2023-08-17T17:49:53.261035+0000","last_unstale":"2023-08-17T17:49:53.619015+0000","last_undegraded":"2023-08-17T17:49:53.619015+0000","last_fullsized":"2023-08-17T17:49:53.619015+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631284+0000","last_change":"2023-08-17T17:49:53.627615+0000","last_active":"2023-08-17T17:49:53.631284+0000","last_peered":"2023-08-17T17:49:53.631284+0000","last_clean":"2023-08-17T17:49:53.631284+0000","last_became_active":"2023-08-17T17:49:53.627229+0000","last_became_peered":"2023-08-17T17:49:53.627229+0000","last_unstale":"2023-08-17T17:49:53.631284+0000","last_undegraded":"2023-08-17T17:49:53.631284+0000","last_fullsized":"2023-08-17T17:49:53.631284+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619246+0000","last_change":"2023-08-17T17:49:53.260000+0000","last_active":"2023-08-17T17:49:53.619246+0000","last_peered":"2023-08-17T17:49:53.619246+0000","last_clean":"2023-08-17T17:49:53.619246+0000","last_became_active":"2023-08-17T17:49:53.259723+0000","last_became_peered":"2023-08-17T17:49:53.259723+0000","last_unstale":"2023-08-17T17:49:53.619246+0000","last_undegraded":"2023-08-17T17:49:53.619246+0000","last_fullsized":"2023-08-17T17:49:53.619246+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.636466+0000","last_change":"2023-08-17T17:49:53.632609+0000","last_active":"2023-08-17T17:49:53.636466+0000","last_peered":"2023-08-17T17:49:53.636466+0000","last_clean":"2023-08-17T17:49:53.636466+0000","last_became_active":"2023-08-17T17:49:53.632277+0000","last_became_peered":"2023-08-17T17:49:53.632277+0000","last_unstale":"2023-08-17T17:49:53.636466+0000","last_undegraded":"2023-08-17T17:49:53.636466+0000","last_fullsized":"2023-08-17T17:49:53.636466+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.618821+0000","last_change":"2023-08-17T17:49:53.268879+0000","last_active":"2023-08-17T17:49:53.618821+0000","last_peered":"2023-08-17T17:49:53.618821+0000","last_clean":"2023-08-17T17:49:53.618821+0000","last_became_active":"2023-08-17T17:49:53.268603+0000","last_became_peered":"2023-08-17T17:49:53.268603+0000","last_unstale":"2023-08-17T17:49:53.618821+0000","last_undegraded":"2023-08-17T17:49:53.618821+0000","last_fullsized":"2023-08-17T17:49:53.618821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.624880+0000","last_change":"2023-08-17T17:49:53.622269+0000","last_active":"2023-08-17T17:49:53.624880+0000","last_peered":"2023-08-17T17:49:53.624880+0000","last_clean":"2023-08-17T17:49:53.624880+0000","last_became_active":"2023-08-17T17:49:53.621979+0000","last_became_peered":"2023-08-17T17:49:53.621979+0000","last_unstale":"2023-08-17T17:49:53.624880+0000","last_undegraded":"2023-08-17T17:49:53.624880+0000","last_fullsized":"2023-08-17T17:49:53.624880+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.614126+0000","last_change":"2023-08-17T17:49:53.265009+0000","last_active":"2023-08-17T17:49:53.614126+0000","last_peered":"2023-08-17T17:49:53.614126+0000","last_clean":"2023-08-17T17:49:53.614126+0000","last_became_active":"2023-08-17T17:49:53.262402+0000","last_became_peered":"2023-08-17T17:49:53.262402+0000","last_unstale":"2023-08-17T17:49:53.614126+0000","last_undegraded":"2023-08-17T17:49:53.614126+0000","last_fullsized":"2023-08-17T17:49:53.614126+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.639224+0000","last_change":"2023-08-17T17:49:53.634725+0000","last_active":"2023-08-17T17:49:53.639224+0000","last_peered":"2023-08-17T17:49:53.639224+0000","last_clean":"2023-08-17T17:49:53.639224+0000","last_became_active":"2023-08-17T17:49:53.634465+0000","last_became_peered":"2023-08-17T17:49:53.634465+0000","last_unstale":"2023-08-17T17:49:53.639224+0000","last_undegraded":"2023-08-17T17:49:53.639224+0000","last_fullsized":"2023-08-17T17:49:53.639224+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"90'3","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641753+0000","last_change":"2023-08-17T17:49:53.266068+0000","last_active":"2023-08-17T17:49:53.641753+0000","last_peered":"2023-08-17T17:49:53.641753+0000","last_clean":"2023-08-17T17:49:53.641753+0000","last_became_active":"2023-08-17T17:49:53.265765+0000","last_became_peered":"2023-08-17T17:49:53.265765+0000","last_unstale":"2023-08-17T17:49:53.641753+0000","last_undegraded":"2023-08-17T17:49:53.641753+0000","last_fullsized":"2023-08-17T17:49:53.641753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.643027+0000","last_change":"2023-08-17T17:49:53.637510+0000","last_active":"2023-08-17T17:49:53.643027+0000","last_peered":"2023-08-17T17:49:53.643027+0000","last_clean":"2023-08-17T17:49:53.643027+0000","last_became_active":"2023-08-17T17:49:53.637250+0000","last_became_peered":"2023-08-17T17:49:53.637250+0000","last_unstale":"2023-08-17T17:49:53.643027+0000","last_undegraded":"2023-08-17T17:49:53.643027+0000","last_fullsized":"2023-08-17T17:49:53.643027+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631596+0000","last_change":"2023-08-17T17:49:53.269457+0000","last_active":"2023-08-17T17:49:53.631596+0000","last_peered":"2023-08-17T17:49:53.631596+0000","last_clean":"2023-08-17T17:49:53.631596+0000","last_became_active":"2023-08-17T17:49:53.268202+0000","last_became_peered":"2023-08-17T17:49:53.268202+0000","last_unstale":"2023-08-17T17:49:53.631596+0000","last_undegraded":"2023-08-17T17:49:53.631596+0000","last_fullsized":"2023-08-17T17:49:53.631596+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.618460+0000","last_change":"2023-08-17T17:49:53.615898+0000","last_active":"2023-08-17T17:49:53.618460+0000","last_peered":"2023-08-17T17:49:53.618460+0000","last_clean":"2023-08-17T17:49:53.618460+0000","last_became_active":"2023-08-17T17:49:53.615563+0000","last_became_peered":"2023-08-17T17:49:53.615563+0000","last_unstale":"2023-08-17T17:49:53.618460+0000","last_undegraded":"2023-08-17T17:49:53.618460+0000","last_fullsized":"2023-08-17T17:49:53.618460+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631533+0000","last_change":"2023-08-17T17:49:53.262603+0000","last_active":"2023-08-17T17:49:53.631533+0000","last_peered":"2023-08-17T17:49:53.631533+0000","last_clean":"2023-08-17T17:49:53.631533+0000","last_became_active":"2023-08-17T17:49:53.262302+0000","last_became_peered":"2023-08-17T17:49:53.262302+0000","last_unstale":"2023-08-17T17:49:53.631533+0000","last_undegraded":"2023-08-17T17:49:53.631533+0000","last_fullsized":"2023-08-17T17:49:53.631533+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642298+0000","last_change":"2023-08-17T17:49:53.641275+0000","last_active":"2023-08-17T17:49:53.642298+0000","last_peered":"2023-08-17T17:49:53.642298+0000","last_clean":"2023-08-17T17:49:53.642298+0000","last_became_active":"2023-08-17T17:49:53.641006+0000","last_became_peered":"2023-08-17T17:49:53.641006+0000","last_unstale":"2023-08-17T17:49:53.642298+0000","last_undegraded":"2023-08-17T17:49:53.642298+0000","last_fullsized":"2023-08-17T17:49:53.642298+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619189+0000","last_change":"2023-08-17T17:49:53.267316+0000","last_active":"2023-08-17T17:49:53.619189+0000","last_peered":"2023-08-17T17:49:53.619189+0000","last_clean":"2023-08-17T17:49:53.619189+0000","last_became_active":"2023-08-17T17:49:53.267022+0000","last_became_peered":"2023-08-17T17:49:53.267022+0000","last_unstale":"2023-08-17T17:49:53.619189+0000","last_undegraded":"2023-08-17T17:49:53.619189+0000","last_fullsized":"2023-08-17T17:49:53.619189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638696+0000","last_change":"2023-08-17T17:49:53.631222+0000","last_active":"2023-08-17T17:49:53.638696+0000","last_peered":"2023-08-17T17:49:53.638696+0000","last_clean":"2023-08-17T17:49:53.638696+0000","last_became_active":"2023-08-17T17:49:53.630915+0000","last_became_peered":"2023-08-17T17:49:53.630915+0000","last_unstale":"2023-08-17T17:49:53.638696+0000","last_undegraded":"2023-08-17T17:49:53.638696+0000","last_fullsized":"2023-08-17T17:49:53.638696+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619102+0000","last_change":"2023-08-17T17:49:53.259478+0000","last_active":"2023-08-17T17:49:53.619102+0000","last_peered":"2023-08-17T17:49:53.619102+0000","last_clean":"2023-08-17T17:49:53.619102+0000","last_became_active":"2023-08-17T17:49:53.259204+0000","last_became_peered":"2023-08-17T17:49:53.259204+0000","last_unstale":"2023-08-17T17:49:53.619102+0000","last_undegraded":"2023-08-17T17:49:53.619102+0000","last_fullsized":"2023-08-17T17:49:53.619102+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642280+0000","last_change":"2023-08-17T17:49:53.640426+0000","last_active":"2023-08-17T17:49:53.642280+0000","last_peered":"2023-08-17T17:49:53.642280+0000","last_clean":"2023-08-17T17:49:53.642280+0000","last_became_active":"2023-08-17T17:49:53.640171+0000","last_became_peered":"2023-08-17T17:49:53.640171+0000","last_unstale":"2023-08-17T17:49:53.642280+0000","last_undegraded":"2023-08-17T17:49:53.642280+0000","last_fullsized":"2023-08-17T17:49:53.642280+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"90'4","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.639849+0000","last_change":"2023-08-17T17:49:53.268916+0000","last_active":"2023-08-17T17:49:53.639849+0000","last_peered":"2023-08-17T17:49:53.639849+0000","last_clean":"2023-08-17T17:49:53.639849+0000","last_became_active":"2023-08-17T17:49:53.268646+0000","last_became_peered":"2023-08-17T17:49:53.268646+0000","last_unstale":"2023-08-17T17:49:53.639849+0000","last_undegraded":"2023-08-17T17:49:53.639849+0000","last_fullsized":"2023-08-17T17:49:53.639849+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.630693+0000","last_change":"2023-08-17T17:49:53.623562+0000","last_active":"2023-08-17T17:49:53.630693+0000","last_peered":"2023-08-17T17:49:53.630693+0000","last_clean":"2023-08-17T17:49:53.630693+0000","last_became_active":"2023-08-17T17:49:53.623282+0000","last_became_peered":"2023-08-17T17:49:53.623282+0000","last_unstale":"2023-08-17T17:49:53.630693+0000","last_undegraded":"2023-08-17T17:49:53.630693+0000","last_fullsized":"2023-08-17T17:49:53.630693+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641006+0000","last_change":"2023-08-17T17:49:53.264493+0000","last_active":"2023-08-17T17:49:53.641006+0000","last_peered":"2023-08-17T17:49:53.641006+0000","last_clean":"2023-08-17T17:49:53.641006+0000","last_became_active":"2023-08-17T17:49:53.262698+0000","last_became_peered":"2023-08-17T17:49:53.262698+0000","last_unstale":"2023-08-17T17:49:53.641006+0000","last_undegraded":"2023-08-17T17:49:53.641006+0000","last_fullsized":"2023-08-17T17:49:53.641006+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638801+0000","last_change":"2023-08-17T17:49:53.635499+0000","last_active":"2023-08-17T17:49:53.638801+0000","last_peered":"2023-08-17T17:49:53.638801+0000","last_clean":"2023-08-17T17:49:53.638801+0000","last_became_active":"2023-08-17T17:49:53.635246+0000","last_became_peered":"2023-08-17T17:49:53.635246+0000","last_unstale":"2023-08-17T17:49:53.638801+0000","last_undegraded":"2023-08-17T17:49:53.638801+0000","last_fullsized":"2023-08-17T17:49:53.638801+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.626214+0000","last_change":"2023-08-17T17:49:53.254206+0000","last_active":"2023-08-17T17:49:53.626214+0000","last_peered":"2023-08-17T17:49:53.626214+0000","last_clean":"2023-08-17T17:49:53.626214+0000","last_became_active":"2023-08-17T17:49:53.253940+0000","last_became_peered":"2023-08-17T17:49:53.253940+0000","last_unstale":"2023-08-17T17:49:53.626214+0000","last_undegraded":"2023-08-17T17:49:53.626214+0000","last_fullsized":"2023-08-17T17:49:53.626214+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642336+0000","last_change":"2023-08-17T17:49:53.641285+0000","last_active":"2023-08-17T17:49:53.642336+0000","last_peered":"2023-08-17T17:49:53.642336+0000","last_clean":"2023-08-17T17:49:53.642336+0000","last_became_active":"2023-08-17T17:49:53.640945+0000","last_became_peered":"2023-08-17T17:49:53.640945+0000","last_unstale":"2023-08-17T17:49:53.642336+0000","last_undegraded":"2023-08-17T17:49:53.642336+0000","last_fullsized":"2023-08-17T17:49:53.642336+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617122+0000","last_change":"2023-08-17T17:49:53.267832+0000","last_active":"2023-08-17T17:49:53.617122+0000","last_peered":"2023-08-17T17:49:53.617122+0000","last_clean":"2023-08-17T17:49:53.617122+0000","last_became_active":"2023-08-17T17:49:53.266963+0000","last_became_peered":"2023-08-17T17:49:53.266963+0000","last_unstale":"2023-08-17T17:49:53.617122+0000","last_undegraded":"2023-08-17T17:49:53.617122+0000","last_fullsized":"2023-08-17T17:49:53.617122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.637088+0000","last_change":"2023-08-17T17:49:53.633961+0000","last_active":"2023-08-17T17:49:53.637088+0000","last_peered":"2023-08-17T17:49:53.637088+0000","last_clean":"2023-08-17T17:49:53.637088+0000","last_became_active":"2023-08-17T17:49:53.633706+0000","last_became_peered":"2023-08-17T17:49:53.633706+0000","last_unstale":"2023-08-17T17:49:53.637088+0000","last_undegraded":"2023-08-17T17:49:53.637088+0000","last_fullsized":"2023-08-17T17:49:53.637088+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.616772+0000","last_change":"2023-08-17T17:49:53.271828+0000","last_active":"2023-08-17T17:49:53.616772+0000","last_peered":"2023-08-17T17:49:53.616772+0000","last_clean":"2023-08-17T17:49:53.616772+0000","last_became_active":"2023-08-17T17:49:53.271523+0000","last_became_peered":"2023-08-17T17:49:53.271523+0000","last_unstale":"2023-08-17T17:49:53.616772+0000","last_undegraded":"2023-08-17T17:49:53.616772+0000","last_fullsized":"2023-08-17T17:49:53.616772+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642271+0000","last_change":"2023-08-17T17:49:53.640512+0000","last_active":"2023-08-17T17:49:53.642271+0000","last_peered":"2023-08-17T17:49:53.642271+0000","last_clean":"2023-08-17T17:49:53.642271+0000","last_became_active":"2023-08-17T17:49:53.640229+0000","last_became_peered":"2023-08-17T17:49:53.640229+0000","last_unstale":"2023-08-17T17:49:53.642271+0000","last_undegraded":"2023-08-17T17:49:53.642271+0000","last_fullsized":"2023-08-17T17:49:53.642271+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.616922+0000","last_change":"2023-08-17T17:49:53.270990+0000","last_active":"2023-08-17T17:49:53.616922+0000","last_peered":"2023-08-17T17:49:53.616922+0000","last_clean":"2023-08-17T17:49:53.616922+0000","last_became_active":"2023-08-17T17:49:53.270738+0000","last_became_peered":"2023-08-17T17:49:53.270738+0000","last_unstale":"2023-08-17T17:49:53.616922+0000","last_undegraded":"2023-08-17T17:49:53.616922+0000","last_fullsized":"2023-08-17T17:49:53.616922+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.632023+0000","last_change":"2023-08-17T17:49:53.628197+0000","last_active":"2023-08-17T17:49:53.632023+0000","last_peered":"2023-08-17T17:49:53.632023+0000","last_clean":"2023-08-17T17:49:53.632023+0000","last_became_active":"2023-08-17T17:49:53.627928+0000","last_became_peered":"2023-08-17T17:49:53.627928+0000","last_unstale":"2023-08-17T17:49:53.632023+0000","last_undegraded":"2023-08-17T17:49:53.632023+0000","last_fullsized":"2023-08-17T17:49:53.632023+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.623573+0000","last_change":"2023-08-17T17:49:53.262326+0000","last_active":"2023-08-17T17:49:53.623573+0000","last_peered":"2023-08-17T17:49:53.623573+0000","last_clean":"2023-08-17T17:49:53.623573+0000","last_became_active":"2023-08-17T17:49:53.262025+0000","last_became_peered":"2023-08-17T17:49:53.262025+0000","last_unstale":"2023-08-17T17:49:53.623573+0000","last_undegraded":"2023-08-17T17:49:53.623573+0000","last_fullsized":"2023-08-17T17:49:53.623573+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641091+0000","last_change":"2023-08-17T17:49:53.631026+0000","last_active":"2023-08-17T17:49:53.641091+0000","last_peered":"2023-08-17T17:49:53.641091+0000","last_clean":"2023-08-17T17:49:53.641091+0000","last_became_active":"2023-08-17T17:49:53.630774+0000","last_became_peered":"2023-08-17T17:49:53.630774+0000","last_unstale":"2023-08-17T17:49:53.641091+0000","last_undegraded":"2023-08-17T17:49:53.641091+0000","last_fullsized":"2023-08-17T17:49:53.641091+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619274+0000","last_change":"2023-08-17T17:49:53.262845+0000","last_active":"2023-08-17T17:49:53.619274+0000","last_peered":"2023-08-17T17:49:53.619274+0000","last_clean":"2023-08-17T17:49:53.619274+0000","last_became_active":"2023-08-17T17:49:53.262553+0000","last_became_peered":"2023-08-17T17:49:53.262553+0000","last_unstale":"2023-08-17T17:49:53.619274+0000","last_undegraded":"2023-08-17T17:49:53.619274+0000","last_fullsized":"2023-08-17T17:49:53.619274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.641200+0000","last_change":"2023-08-17T17:49:53.635396+0000","last_active":"2023-08-17T17:49:53.641200+0000","last_peered":"2023-08-17T17:49:53.641200+0000","last_clean":"2023-08-17T17:49:53.641200+0000","last_became_active":"2023-08-17T17:49:53.633825+0000","last_became_peered":"2023-08-17T17:49:53.633825+0000","last_unstale":"2023-08-17T17:49:53.641200+0000","last_undegraded":"2023-08-17T17:49:53.641200+0000","last_fullsized":"2023-08-17T17:49:53.641200+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.624395+0000","last_change":"2023-08-17T17:49:53.262912+0000","last_active":"2023-08-17T17:49:53.624395+0000","last_peered":"2023-08-17T17:49:53.624395+0000","last_clean":"2023-08-17T17:49:53.624395+0000","last_became_active":"2023-08-17T17:49:53.262677+0000","last_became_peered":"2023-08-17T17:49:53.262677+0000","last_unstale":"2023-08-17T17:49:53.624395+0000","last_undegraded":"2023-08-17T17:49:53.624395+0000","last_fullsized":"2023-08-17T17:49:53.624395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.642706+0000","last_change":"2023-08-17T17:49:53.636632+0000","last_active":"2023-08-17T17:49:53.642706+0000","last_peered":"2023-08-17T17:49:53.642706+0000","last_clean":"2023-08-17T17:49:53.642706+0000","last_became_active":"2023-08-17T17:49:53.636349+0000","last_became_peered":"2023-08-17T17:49:53.636349+0000","last_unstale":"2023-08-17T17:49:53.642706+0000","last_undegraded":"2023-08-17T17:49:53.642706+0000","last_fullsized":"2023-08-17T17:49:53.642706+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.620975+0000","last_change":"2023-08-17T17:49:53.264411+0000","last_active":"2023-08-17T17:49:53.620975+0000","last_peered":"2023-08-17T17:49:53.620975+0000","last_clean":"2023-08-17T17:49:53.620975+0000","last_became_active":"2023-08-17T17:49:53.264067+0000","last_became_peered":"2023-08-17T17:49:53.264067+0000","last_unstale":"2023-08-17T17:49:53.620975+0000","last_undegraded":"2023-08-17T17:49:53.620975+0000","last_fullsized":"2023-08-17T17:49:53.620975+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.625489+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:49:53.625489+0000","last_peered":"2023-08-17T17:49:53.625489+0000","last_clean":"2023-08-17T17:49:53.625489+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:49:53.625489+0000","last_undegraded":"2023-08-17T17:49:53.625489+0000","last_fullsized":"2023-08-17T17:49:53.625489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635802+0000","last_change":"2023-08-17T17:49:53.630669+0000","last_active":"2023-08-17T17:49:53.635802+0000","last_peered":"2023-08-17T17:49:53.635802+0000","last_clean":"2023-08-17T17:49:53.635802+0000","last_became_active":"2023-08-17T17:49:53.630420+0000","last_became_peered":"2023-08-17T17:49:53.630420+0000","last_unstale":"2023-08-17T17:49:53.635802+0000","last_undegraded":"2023-08-17T17:49:53.635802+0000","last_fullsized":"2023-08-17T17:49:53.635802+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.634698+0000","last_change":"2023-08-17T17:49:53.258430+0000","last_active":"2023-08-17T17:49:53.634698+0000","last_peered":"2023-08-17T17:49:53.634698+0000","last_clean":"2023-08-17T17:49:53.634698+0000","last_became_active":"2023-08-17T17:49:53.258167+0000","last_became_peered":"2023-08-17T17:49:53.258167+0000","last_unstale":"2023-08-17T17:49:53.634698+0000","last_undegraded":"2023-08-17T17:49:53.634698+0000","last_fullsized":"2023-08-17T17:49:53.634698+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":77,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.613435+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:49:53.613435+0000","last_peered":"2023-08-17T17:49:53.613435+0000","last_clean":"2023-08-17T17:49:53.613435+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:49:53.613435+0000","last_undegraded":"2023-08-17T17:49:53.613435+0000","last_fullsized":"2023-08-17T17:49:53.613435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.627718+0000","last_change":"2023-08-17T17:49:53.626008+0000","last_active":"2023-08-17T17:49:53.627718+0000","last_peered":"2023-08-17T17:49:53.627718+0000","last_clean":"2023-08-17T17:49:53.627718+0000","last_became_active":"2023-08-17T17:49:53.625671+0000","last_became_peered":"2023-08-17T17:49:53.625671+0000","last_unstale":"2023-08-17T17:49:53.627718+0000","last_undegraded":"2023-08-17T17:49:53.627718+0000","last_fullsized":"2023-08-17T17:49:53.627718+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.613841+0000","last_change":"2023-08-17T17:49:53.268772+0000","last_active":"2023-08-17T17:49:53.613841+0000","last_peered":"2023-08-17T17:49:53.613841+0000","last_clean":"2023-08-17T17:49:53.613841+0000","last_became_active":"2023-08-17T17:49:53.268457+0000","last_became_peered":"2023-08-17T17:49:53.268457+0000","last_unstale":"2023-08-17T17:49:53.613841+0000","last_undegraded":"2023-08-17T17:49:53.613841+0000","last_fullsized":"2023-08-17T17:49:53.613841+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619180+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:49:53.619180+0000","last_peered":"2023-08-17T17:49:53.619180+0000","last_clean":"2023-08-17T17:49:53.619180+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:49:53.619180+0000","last_undegraded":"2023-08-17T17:49:53.619180+0000","last_fullsized":"2023-08-17T17:49:53.619180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.640363+0000","last_change":"2023-08-17T17:49:53.633814+0000","last_active":"2023-08-17T17:49:53.640363+0000","last_peered":"2023-08-17T17:49:53.640363+0000","last_clean":"2023-08-17T17:49:53.640363+0000","last_became_active":"2023-08-17T17:49:53.633519+0000","last_became_peered":"2023-08-17T17:49:53.633519+0000","last_unstale":"2023-08-17T17:49:53.640363+0000","last_undegraded":"2023-08-17T17:49:53.640363+0000","last_fullsized":"2023-08-17T17:49:53.640363+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.614983+0000","last_change":"2023-08-17T17:49:53.268981+0000","last_active":"2023-08-17T17:49:53.614983+0000","last_peered":"2023-08-17T17:49:53.614983+0000","last_clean":"2023-08-17T17:49:53.614983+0000","last_became_active":"2023-08-17T17:49:53.268665+0000","last_became_peered":"2023-08-17T17:49:53.268665+0000","last_unstale":"2023-08-17T17:49:53.614983+0000","last_undegraded":"2023-08-17T17:49:53.614983+0000","last_fullsized":"2023-08-17T17:49:53.614983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":77,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.613333+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:49:53.613333+0000","last_peered":"2023-08-17T17:49:53.613333+0000","last_clean":"2023-08-17T17:49:53.613333+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:49:53.613333+0000","last_undegraded":"2023-08-17T17:49:53.613333+0000","last_fullsized":"2023-08-17T17:49:53.613333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619744+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:49:53.619744+0000","last_peered":"2023-08-17T17:49:53.619744+0000","last_clean":"2023-08-17T17:49:53.619744+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:49:53.619744+0000","last_undegraded":"2023-08-17T17:49:53.619744+0000","last_fullsized":"2023-08-17T17:49:53.619744+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.635834+0000","last_change":"2023-08-17T17:49:53.631405+0000","last_active":"2023-08-17T17:49:53.635834+0000","last_peered":"2023-08-17T17:49:53.635834+0000","last_clean":"2023-08-17T17:49:53.635834+0000","last_became_active":"2023-08-17T17:49:53.631129+0000","last_became_peered":"2023-08-17T17:49:53.631129+0000","last_unstale":"2023-08-17T17:49:53.635834+0000","last_undegraded":"2023-08-17T17:49:53.635834+0000","last_fullsized":"2023-08-17T17:49:53.635834+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.613839+0000","last_change":"2023-08-17T17:49:53.259170+0000","last_active":"2023-08-17T17:49:53.613839+0000","last_peered":"2023-08-17T17:49:53.613839+0000","last_clean":"2023-08-17T17:49:53.613839+0000","last_became_active":"2023-08-17T17:49:53.258918+0000","last_became_peered":"2023-08-17T17:49:53.258918+0000","last_unstale":"2023-08-17T17:49:53.613839+0000","last_undegraded":"2023-08-17T17:49:53.613839+0000","last_fullsized":"2023-08-17T17:49:53.613839+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.620238+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:49:53.620238+0000","last_peered":"2023-08-17T17:49:53.620238+0000","last_clean":"2023-08-17T17:49:53.620238+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:49:53.620238+0000","last_undegraded":"2023-08-17T17:49:53.620238+0000","last_fullsized":"2023-08-17T17:49:53.620238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.639081+0000","last_change":"2023-08-17T17:49:53.634580+0000","last_active":"2023-08-17T17:49:53.639081+0000","last_peered":"2023-08-17T17:49:53.639081+0000","last_clean":"2023-08-17T17:49:53.639081+0000","last_became_active":"2023-08-17T17:49:53.634300+0000","last_became_peered":"2023-08-17T17:49:53.634300+0000","last_unstale":"2023-08-17T17:49:53.639081+0000","last_undegraded":"2023-08-17T17:49:53.639081+0000","last_fullsized":"2023-08-17T17:49:53.639081+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.625295+0000","last_change":"2023-08-17T17:49:53.264851+0000","last_active":"2023-08-17T17:49:53.625295+0000","last_peered":"2023-08-17T17:49:53.625295+0000","last_clean":"2023-08-17T17:49:53.625295+0000","last_became_active":"2023-08-17T17:49:53.264406+0000","last_became_peered":"2023-08-17T17:49:53.264406+0000","last_unstale":"2023-08-17T17:49:53.625295+0000","last_undegraded":"2023-08-17T17:49:53.625295+0000","last_fullsized":"2023-08-17T17:49:53.625295+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.617649+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:49:53.617649+0000","last_peered":"2023-08-17T17:49:53.617649+0000","last_clean":"2023-08-17T17:49:53.617649+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:49:53.617649+0000","last_undegraded":"2023-08-17T17:49:53.617649+0000","last_fullsized":"2023-08-17T17:49:53.617649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.638916+0000","last_change":"2023-08-17T17:49:53.626870+0000","last_active":"2023-08-17T17:49:53.638916+0000","last_peered":"2023-08-17T17:49:53.638916+0000","last_clean":"2023-08-17T17:49:53.638916+0000","last_became_active":"2023-08-17T17:49:53.626620+0000","last_became_peered":"2023-08-17T17:49:53.626620+0000","last_unstale":"2023-08-17T17:49:53.638916+0000","last_undegraded":"2023-08-17T17:49:53.638916+0000","last_fullsized":"2023-08-17T17:49:53.638916+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.640733+0000","last_change":"2023-08-17T17:49:53.266125+0000","last_active":"2023-08-17T17:49:53.640733+0000","last_peered":"2023-08-17T17:49:53.640733+0000","last_clean":"2023-08-17T17:49:53.640733+0000","last_became_active":"2023-08-17T17:49:53.265840+0000","last_became_peered":"2023-08-17T17:49:53.265840+0000","last_unstale":"2023-08-17T17:49:53.640733+0000","last_undegraded":"2023-08-17T17:49:53.640733+0000","last_fullsized":"2023-08-17T17:49:53.640733+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.633556+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:49:53.633556+0000","last_peered":"2023-08-17T17:49:53.633556+0000","last_clean":"2023-08-17T17:49:53.633556+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:49:53.633556+0000","last_undegraded":"2023-08-17T17:49:53.633556+0000","last_fullsized":"2023-08-17T17:49:53.633556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.631932+0000","last_change":"2023-08-17T17:49:53.627207+0000","last_active":"2023-08-17T17:49:53.631932+0000","last_peered":"2023-08-17T17:49:53.631932+0000","last_clean":"2023-08-17T17:49:53.631932+0000","last_became_active":"2023-08-17T17:49:53.626917+0000","last_became_peered":"2023-08-17T17:49:53.626917+0000","last_unstale":"2023-08-17T17:49:53.631932+0000","last_undegraded":"2023-08-17T17:49:53.631932+0000","last_fullsized":"2023-08-17T17:49:53.631932+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:53.235692+0000","last_clean_scrub_stamp":"2023-08-17T17:49:53.235692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.637746+0000","last_change":"2023-08-17T17:49:53.262629+0000","last_active":"2023-08-17T17:49:53.637746+0000","last_peered":"2023-08-17T17:49:53.637746+0000","last_clean":"2023-08-17T17:49:53.637746+0000","last_became_active":"2023-08-17T17:49:53.262340+0000","last_became_peered":"2023-08-17T17:49:53.262340+0000","last_unstale":"2023-08-17T17:49:53.637746+0000","last_undegraded":"2023-08-17T17:49:53.637746+0000","last_fullsized":"2023-08-17T17:49:53.637746+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:49:52.233635+0000","last_clean_scrub_stamp":"2023-08-17T17:49:52.233635+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-08-17T17:49:53.619253+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:49:53.619253+0000","last_peered":"2023-08-17T17:49:53.619253+0000","last_clean":"2023-08-17T17:49:53.619253+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:49:53.619253+0000","last_undegraded":"2023-08-17T17:49:53.619253+0000","last_fullsized":"2023-08-17T17:49:53.619253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":547039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.61899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.498}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.69299999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77500000000000002,"15min":0.80000000000000004},"last":0.44}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63200000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":1.23,"15min":1.23},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.64500000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.75700000000000001,"15min":0.95999999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.624}]},{"osd":6,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73199999999999998,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72699999999999998,"5min":0.79400000000000004,"15min":0.90200000000000002},"last":0.60999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302288,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":1122304,"data_stored":547177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85599999999999998,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66700000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.439}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.755,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.65700000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.879,"15min":1.0609999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.60299999999999998},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80100000000000005,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.26800000000000002},"max":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.77300000000000002,"15min":1.026},"last":0.29299999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.38},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.34200000000000003},"max":{"1min":0.81299999999999994,"5min":1.51,"15min":1.51},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.872,"15min":1.0740000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.46100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302292,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069548,"statfs":{"total":96636764160,"available":96327217152,"internally_reserved":0,"allocated":1126400,"data_stored":547537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47099999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.25},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.378,"15min":0.373},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.40400000000000003,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.60399999999999998,"5min":0.625,"15min":0.66600000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40899999999999997,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.53600000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.624,"15min":0.622},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":1.2989999999999999,"15min":1.331},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2629999999999999,"15min":1.345},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.5}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83599999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.59799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":1110016,"data_stored":546463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52600000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.253},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.65200000000000002},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.66200000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.65700000000000003},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.97999999999999998,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.432},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.87,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.88300000000000001,"5min":1.677,"15min":1.677},"last":0.495}]},{"osd":6,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.087,"5min":1.51,"15min":1.51},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0069999999999999,"5min":1.325,"15min":1.391},"last":0.442}]},{"osd":7,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89600000000000002,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.544},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575036,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302288,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":1122304,"data_stored":547999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.49399999999999999,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.248},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45200000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.40100000000000002},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51800000000000002,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54800000000000004,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.311,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.52300000000000002,"5min":1.268,"15min":1.268},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.309}]},{"osd":4,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.98799999999999999,"5min":1.417,"15min":1.417},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2869999999999999,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.2629999999999999,"5min":1.544,"15min":1.544},"last":0.437},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":1.232,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0840000000000001,"5min":1.415,"15min":1.415},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68500000000000005,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88600000000000001,"5min":2.984,"15min":2.984},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.46500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302276,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069564,"statfs":{"total":96636764160,"available":96327233536,"internally_reserved":0,"allocated":1110016,"data_stored":546463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":0.45700000000000002,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.316},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.245,"5min":0.245,"15min":0.224},"max":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.71799999999999997},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.378},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.379},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.39200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":0.54600000000000004,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.439,"15min":0.42399999999999999},"min":{"1min":0.32200000000000001,"5min":0.245,"15min":0.245},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.89000000000000001},"last":0.626},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1989999999999998,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.626,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.466,"15min":1.466},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.48,"15min":1.48},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"max":{"1min":3.4780000000000002,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.496}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302288,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":1122304,"data_stored":547141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.012,"5min":1.252,"15min":1.252},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.47799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.28199999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66500000000000004,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35699999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.378},{"interface":"front","average":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.373,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.91900000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78000000000000003,"5min":0.877,"15min":1.056},"last":0.42199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":1114112,"data_stored":546497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.27700000000000002},"max":{"1min":0.66300000000000003,"5min":1.165,"15min":1.2609999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.31},"max":{"1min":0.627,"5min":1.022,"15min":1.1499999999999999},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.29599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.242},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":1.0580000000000001,"15min":1.252},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":1.153,"15min":1.274},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.379},"max":{"1min":0.68799999999999994,"5min":1.0920000000000001,"15min":1.179},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.3080000000000001},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.747,"5min":0.75,"15min":1.0620000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.497,"15min":0.495},"min":{"1min":0.314,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":0.78300000000000003,"15min":1.0740000000000001},"last":0.437}]},{"osd":6,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":1.01},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.1020000000000001},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.73599999999999999,"5min":0.82299999999999995,"15min":1.038},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.1279999999999999},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:50:01.429 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T17:50:01.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T17:50:01.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.548+0000 7f172cc7e700 1 Processor -- start 2023-08-17T17:50:01.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.548+0000 7f172cc7e700 1 -- start start 2023-08-17T17:50:01.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f172cc7e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280c7e10 0x7f17280ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f172cc7e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280c6970 con 0x7f17280c0f10 2023-08-17T17:50:01.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f172cc7e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280cac90 con 0x7f1728154110 2023-08-17T17:50:01.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f172cc7e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c6040 con 0x7f17280c7e10 2023-08-17T17:50:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f171dd9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f17280c0f10 0x7f17280c9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48688/0 (socket says 172.21.15.78:48688) 2023-08-17T17:50:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f171dd9b700 1 -- 172.21.15.78:0/1609886460 learned_addr learned my addr 172.21.15.78:0/1609886460 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f1726d9d700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280c7e10 0x7f17280ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499523803 0 0) 0x7f17280c6970 con 0x7f17280c0f10 2023-08-17T17:50:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17140033f0 con 0x7f17280c0f10 2023-08-17T17:50:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928955747 0 0) 0x7f17280cac90 con 0x7f1728154110 2023-08-17T17:50:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17280c6970 con 0x7f1728154110 2023-08-17T17:50:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3520426456 0 0) 0x7f17140033f0 con 0x7f17280c0f10 2023-08-17T17:50:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280c7e10 msgr2=0x7f17280ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f1725d9b700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280c7e10 0x7f17280ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 >> v1:172.21.15.150:6789/0 conn(0x7f1728154110 legacy=0x7f17280c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.549+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280c6320 con 0x7f17280c0f10 2023-08-17T17:50:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f1710001470 con 0x7f17280c0f10 2023-08-17T17:50:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 >> v1:172.21.15.78:6789/0 conn(0x7f17280c0f10 legacy=0x7f17280c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280c7e10 0x7f1714003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1714003fb0 0x7f1714004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1714004b80 0x7f1714005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c6040 con 0x7f1714003fb0 2023-08-17T17:50:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171400b990 con 0x7f1714004b80 2023-08-17T17:50:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171400bb50 con 0x7f17280c7e10 2023-08-17T17:50:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f171dd9b700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1714003fb0 0x7f1714004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f172659c700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280c7e10 0x7f1714003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1726d9d700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1714004b80 0x7f1714005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f171dd9b700 1 -- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280c7e10 msgr2=0x7f1714003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f171dd9b700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280c7e10 0x7f1714003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f171dd9b700 1 -- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1714004b80 msgr2=0x7f1714005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f171dd9b700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1714004b80 0x7f1714005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f171dd9b700 1 -- 172.21.15.78:0/1609886460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140033f0 con 0x7f1714003fb0 2023-08-17T17:50:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f171dd9b700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1714003fb0 0x7f1714004690 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f171000c0e0 tx=0x7f1710001e10).ready entity=mon.0 client_cookie=cfd7d35c858ed3ec server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171000ca10 con 0x7f1714003fb0 2023-08-17T17:50:01.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171000cb70 con 0x7f1714003fb0 2023-08-17T17:50:01.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.550+0000 7f1725d9b700 1 -- 172.21.15.78:0/1609886460 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17100070d0 con 0x7f1714003fb0 2023-08-17T17:50:01.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.551+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609886460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1714003fb0 msgr2=0x7f1714004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.551+0000 7f172cc7e700 1 --2- 172.21.15.78:0/1609886460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1714003fb0 0x7f1714004690 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f171000c0e0 tx=0x7f1710001e10).stop 2023-08-17T17:50:01.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.551+0000 7f1726d9d700 1 -- 172.21.15.78:0/1609886460 reap_dead start 2023-08-17T17:50:01.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.551+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609886460 shutdown_connections 2023-08-17T17:50:01.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.551+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609886460 >> 172.21.15.78:0/1609886460 conn(0x7f1728094650 msgr2=0x7f172806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:01.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.551+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609886460 shutdown_connections 2023-08-17T17:50:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.551+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609886460 wait complete. 2023-08-17T17:50:01.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.552+0000 7f172cc7e700 1 Processor -- start 2023-08-17T17:50:01.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.552+0000 7f172cc7e700 1 -- start start 2023-08-17T17:50:01.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f172cc7e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1714003fb0 0x7f17280aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f172cc7e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1728155710 0x7f1728155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f172cc7e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280aaa40 0x7f17280aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f172cc7e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280ae670 con 0x7f1728155710 2023-08-17T17:50:01.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f172cc7e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280ab390 con 0x7f1714003fb0 2023-08-17T17:50:01.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f172cc7e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280ab620 con 0x7f17280aaa40 2023-08-17T17:50:01.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f171dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1728155710 0x7f1728155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f171dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1728155710 0x7f1728155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52536/0 (socket says 172.21.15.78:52536) 2023-08-17T17:50:01.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f171dd9b700 1 -- 172.21.15.78:0/1609900318 learned_addr learned my addr 172.21.15.78:0/1609900318 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:01.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f1726d9d700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280aaa40 0x7f17280aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f172659c700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1714003fb0 0x7f17280aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f171dd9b700 1 -- 172.21.15.78:0/1609900318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280aaa40 msgr2=0x7f17280aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f171dd9b700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280aaa40 0x7f17280aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f171dd9b700 1 -- 172.21.15.78:0/1609900318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1714003fb0 msgr2=0x7f17280aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f171dd9b700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1714003fb0 0x7f17280aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f171dd9b700 1 -- 172.21.15.78:0/1609900318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280ab900 con 0x7f1728155710 2023-08-17T17:50:01.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f172659c700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1714003fb0 0x7f17280aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:01.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f171dd9b700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1728155710 0x7f1728155b90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f1710000c00 tx=0x7f1710015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:01.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.553+0000 7f171effd700 1 -- 172.21.15.78:0/1609900318 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710001640 con 0x7f1728155710 2023-08-17T17:50:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.554+0000 7f171effd700 1 -- 172.21.15.78:0/1609900318 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17100046b0 con 0x7f1728155710 2023-08-17T17:50:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.554+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609900318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280adfb0 con 0x7f1728155710 2023-08-17T17:50:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.554+0000 7f171effd700 1 -- 172.21.15.78:0/1609900318 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710004a70 con 0x7f1728155710 2023-08-17T17:50:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.554+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609900318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17280abf20 con 0x7f1728155710 2023-08-17T17:50:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.555+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609900318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1728047350 con 0x7f1728155710 2023-08-17T17:50:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.555+0000 7f171effd700 1 -- 172.21.15.78:0/1609900318 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1710010070 con 0x7f1728155710 2023-08-17T17:50:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.555+0000 7f171effd700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f170805edc0 0x7f1708061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.555+0000 7f171effd700 1 -- 172.21.15.78:0/1609900318 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f171001c040 con 0x7f1728155710 2023-08-17T17:50:01.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.555+0000 7f172659c700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f170805edc0 0x7f1708061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.556+0000 7f172659c700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f170805edc0 0x7f1708061280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1718000f60 tx=0x7f1718009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:01.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.559+0000 7f171effd700 1 -- 172.21.15.78:0/1609900318 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f171004bfc0 con 0x7f1728155710 2023-08-17T17:50:01.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.791+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609900318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f17280c6600 con 0x7f1728155710 2023-08-17T17:50:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.794+0000 7f171effd700 1 -- 172.21.15.78:0/1609900318 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f171004f5e0 con 0x7f1728155710 2023-08-17T17:50:01.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.796+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609900318 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f170805edc0 msgr2=0x7f1708061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.796+0000 7f172cc7e700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f170805edc0 0x7f1708061280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1718000f60 tx=0x7f1718009040).stop 2023-08-17T17:50:01.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.796+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609900318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1728155710 msgr2=0x7f1728155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.796+0000 7f172cc7e700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1728155710 0x7f1728155b90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f1710000c00 tx=0x7f1710015000).stop 2023-08-17T17:50:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.797+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609900318 shutdown_connections 2023-08-17T17:50:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.797+0000 7f172cc7e700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f170805edc0 0x7f1708061280 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.797+0000 7f172cc7e700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17280aaa40 0x7f17280aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.797+0000 7f172cc7e700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1714003fb0 0x7f17280aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.797+0000 7f172cc7e700 1 --2- 172.21.15.78:0/1609900318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1728155710 0x7f1728155b90 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.797+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609900318 >> 172.21.15.78:0/1609900318 conn(0x7f1728094650 msgr2=0x7f17280648a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.797+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609900318 shutdown_connections 2023-08-17T17:50:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.797+0000 7f172cc7e700 1 -- 172.21.15.78:0/1609900318 wait complete. 2023-08-17T17:50:01.800 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-08-17T17:50:01.810 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:50:01.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.921+0000 7f77d469b700 1 Processor -- start 2023-08-17T17:50:01.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.921+0000 7f77d469b700 1 -- start start 2023-08-17T17:50:01.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.922+0000 7f77d469b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77cc150e10 0x7f77cc0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.922+0000 7f77d469b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc06b580 con 0x7f77cc063b10 2023-08-17T17:50:01.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.922+0000 7f77d469b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc0bcb10 con 0x7f77cc0bd6b0 2023-08-17T17:50:01.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.922+0000 7f77d469b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0bc200 con 0x7f77cc150e10 2023-08-17T17:50:01.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.922+0000 7f77d1c36700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f77cc063b10 0x7f77cc0bcfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48696/0 (socket says 172.21.15.78:48696) 2023-08-17T17:50:01.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.922+0000 7f77d1c36700 1 -- 172.21.15.78:0/2493514081 learned_addr learned my addr 172.21.15.78:0/2493514081 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:01.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d2437700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77cc150e10 0x7f77cc0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515719941 0 0) 0x7f77cc06b580 con 0x7f77cc063b10 2023-08-17T17:50:01.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b80033f0 con 0x7f77cc063b10 2023-08-17T17:50:01.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4184544681 0 0) 0x7f77b80033f0 con 0x7f77cc063b10 2023-08-17T17:50:01.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77cc150e10 msgr2=0x7f77cc0aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:01.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77cc150e10 0x7f77cc0aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 >> v1:172.21.15.150:6789/0 conn(0x7f77cc0bd6b0 legacy=0x7f77cc0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc0c37a0 con 0x7f77cc063b10 2023-08-17T17:50:01.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f77bc001470 con 0x7f77cc063b10 2023-08-17T17:50:01.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 >> v1:172.21.15.78:6789/0 conn(0x7f77cc063b10 legacy=0x7f77cc0bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77b8003910 0x7f77b8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77b8004690 0x7f77b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77cc150e10 0x7f77b8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0bc200 con 0x7f77b8004690 2023-08-17T17:50:01.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b800db20 con 0x7f77b8003910 2023-08-17T17:50:01.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b800dce0 con 0x7f77cc150e10 2023-08-17T17:50:01.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d1c36700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77b8004690 0x7f77b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d2437700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77b8003910 0x7f77b8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.923+0000 7f77d2c38700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77cc150e10 0x7f77b8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d1c36700 1 -- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77cc150e10 msgr2=0x7f77b8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:01.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d1c36700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77cc150e10 0x7f77b8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d1c36700 1 -- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77b8003910 msgr2=0x7f77b8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:01.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d1c36700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77b8003910 0x7f77b8003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d1c36700 1 -- 172.21.15.78:0/2493514081 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b80033f0 con 0x7f77b8004690 2023-08-17T17:50:01.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d1c36700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77b8004690 0x7f77b8004b10 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f77bc00c160 tx=0x7f77bc001e50).ready entity=mon.0 client_cookie=e3389ce326a93dd3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:01.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc007a20 con 0x7f77b8004690 2023-08-17T17:50:01.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc00ca90 con 0x7f77b8004690 2023-08-17T17:50:01.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d1435700 1 -- 172.21.15.78:0/2493514081 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00ce10 con 0x7f77b8004690 2023-08-17T17:50:01.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d469b700 1 -- 172.21.15.78:0/2493514081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77b8004690 msgr2=0x7f77b8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d469b700 1 --2- 172.21.15.78:0/2493514081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77b8004690 0x7f77b8004b10 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f77bc00c160 tx=0x7f77bc001e50).stop 2023-08-17T17:50:01.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d2c38700 1 -- 172.21.15.78:0/2493514081 reap_dead start 2023-08-17T17:50:01.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d469b700 1 -- 172.21.15.78:0/2493514081 shutdown_connections 2023-08-17T17:50:01.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d469b700 1 -- 172.21.15.78:0/2493514081 >> 172.21.15.78:0/2493514081 conn(0x7f77cc0c3d40 msgr2=0x7f77cc0c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:01.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d469b700 1 -- 172.21.15.78:0/2493514081 shutdown_connections 2023-08-17T17:50:01.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.924+0000 7f77d469b700 1 -- 172.21.15.78:0/2493514081 wait complete. 2023-08-17T17:50:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.925+0000 7f77d469b700 1 Processor -- start 2023-08-17T17:50:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d469b700 1 -- start start 2023-08-17T17:50:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d469b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77b8004690 0x7f77cc151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d469b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77cc14c420 0x7f77cc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d469b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77cc14fa00 0x7f77cc14fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d469b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc14c8a0 con 0x7f77cc14fa00 2023-08-17T17:50:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d469b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc150370 con 0x7f77cc14c420 2023-08-17T17:50:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d469b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc152170 con 0x7f77b8004690 2023-08-17T17:50:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d2c38700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77cc14fa00 0x7f77cc14fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d2c38700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77cc14fa00 0x7f77cc14fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52548/0 (socket says 172.21.15.78:52548) 2023-08-17T17:50:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d2c38700 1 -- 172.21.15.78:0/1035456549 learned_addr learned my addr 172.21.15.78:0/1035456549 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.926+0000 7f77d2437700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77b8004690 0x7f77cc151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77d1c36700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77cc14c420 0x7f77cc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77d2c38700 1 -- 172.21.15.78:0/1035456549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77b8004690 msgr2=0x7f77cc151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77d2c38700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77b8004690 0x7f77cc151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77d2c38700 1 -- 172.21.15.78:0/1035456549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77cc14c420 msgr2=0x7f77cc0a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77d2c38700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77cc14c420 0x7f77cc0a50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77d2c38700 1 -- 172.21.15.78:0/1035456549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc152450 con 0x7f77cc14fa00 2023-08-17T17:50:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77d2c38700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77cc14fa00 0x7f77cc14fe80 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f77cc06a050 tx=0x7f77c4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77c27fc700 1 -- 172.21.15.78:0/1035456549 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4002e90 con 0x7f77cc14fa00 2023-08-17T17:50:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77c27fc700 1 -- 172.21.15.78:0/1035456549 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c40114c0 con 0x7f77cc14fa00 2023-08-17T17:50:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77d469b700 1 -- 172.21.15.78:0/1035456549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77cc152730 con 0x7f77cc14fa00 2023-08-17T17:50:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77c27fc700 1 -- 172.21.15.78:0/1035456549 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4011880 con 0x7f77cc14fa00 2023-08-17T17:50:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.927+0000 7f77d469b700 1 -- 172.21.15.78:0/1035456549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77cc152cf0 con 0x7f77cc14fa00 2023-08-17T17:50:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.928+0000 7f77d469b700 1 -- 172.21.15.78:0/1035456549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77cc153060 con 0x7f77cc14fa00 2023-08-17T17:50:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.928+0000 7f77c27fc700 1 -- 172.21.15.78:0/1035456549 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f77c401a030 con 0x7f77cc14fa00 2023-08-17T17:50:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.929+0000 7f77c27fc700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77b005ed60 0x7f77b0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.929+0000 7f77c27fc700 1 -- 172.21.15.78:0/1035456549 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f77c40791a0 con 0x7f77cc14fa00 2023-08-17T17:50:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.929+0000 7f77d2437700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77b005ed60 0x7f77b0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.929+0000 7f77d2437700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77b005ed60 0x7f77b0061220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f77c80094d0 tx=0x7f77c800b040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:01.933+0000 7f77c27fc700 1 -- 172.21.15.78:0/1035456549 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77c404a740 con 0x7f77cc14fa00 2023-08-17T17:50:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.137+0000 7f77d469b700 1 -- 172.21.15.78:0/1035456549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77cc047350 con 0x7f77cc14fa00 2023-08-17T17:50:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.138+0000 7f77c27fc700 1 -- 172.21.15.78:0/1035456549 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f77c404dd60 con 0x7f77cc14fa00 2023-08-17T17:50:02.139 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:02.139 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3356030675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3356030675},{"type":"v1","addr":"172.21.15.150:6835","nonce":3356030675}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/807522916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":807522916},{"type":"v1","addr":"172.21.15.78:6837","nonce":807522916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3165905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3165905348},{"type":"v1","addr":"172.21.15.150:6834","nonce":3165905348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:53.608560+0000","modified":"2023-08-17T17:49:55.616581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/4042380652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4042380652},{"type":"v1","addr":"172.21.15.78:6836","nonce":4042380652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T17:50:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 -- 172.21.15.78:0/1035456549 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77b005ed60 msgr2=0x7f77b0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77b005ed60 0x7f77b0061220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f77c80094d0 tx=0x7f77c800b040).stop 2023-08-17T17:50:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 -- 172.21.15.78:0/1035456549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77cc14fa00 msgr2=0x7f77cc14fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77cc14fa00 0x7f77cc14fe80 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f77cc06a050 tx=0x7f77c4007bb0).stop 2023-08-17T17:50:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 -- 172.21.15.78:0/1035456549 shutdown_connections 2023-08-17T17:50:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77b005ed60 0x7f77b0061220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77cc14fa00 0x7f77cc14fe80 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77b8004690 0x7f77cc151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 --2- 172.21.15.78:0/1035456549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77cc14c420 0x7f77cc0a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 -- 172.21.15.78:0/1035456549 >> 172.21.15.78:0/1035456549 conn(0x7f77cc0c3d40 msgr2=0x7f77cc0bcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 -- 172.21.15.78:0/1035456549 shutdown_connections 2023-08-17T17:50:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.140+0000 7f77d469b700 1 -- 172.21.15.78:0/1035456549 wait complete. 2023-08-17T17:50:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 31 2023-08-17T17:50:02.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T17:49:53.608560+0000', 'modified': '2023-08-17T17:49:55.616581+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6714}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6714': {'gid': 6714, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6836/4042380652', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 4042380652}, {'type': 'v1', 'addr': '172.21.15.78:6836', 'nonce': 4042380652}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T17:50:02.555 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T17:50:02.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-17T17:50:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.668+0000 7f8d816ab700 1 Processor -- start 2023-08-17T17:50:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.668+0000 7f8d816ab700 1 -- start start 2023-08-17T17:50:02.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d816ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 0x7f8d7c0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d816ab700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c0c9ca0 con 0x7f8d7c0cb890 2023-08-17T17:50:02.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d816ab700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c0c96b0 con 0x7f8d7c153f80 2023-08-17T17:50:02.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d816ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0a8290 con 0x7f8d7c0c0e30 2023-08-17T17:50:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d7b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8d7c0cb890 0x7f8d7c0c0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48702/0 (socket says 172.21.15.78:48702) 2023-08-17T17:50:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d7b7fe700 1 -- 172.21.15.78:0/1087830840 learned_addr learned my addr 172.21.15.78:0/1087830840 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d80eaa700 1 --2- 172.21.15.78:0/1087830840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 0x7f8d7c0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d7affd700 1 -- 172.21.15.78:0/1087830840 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330008627 0 0) 0x7f8d7c0c9ca0 con 0x7f8d7c0cb890 2023-08-17T17:50:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d7affd700 1 -- 172.21.15.78:0/1087830840 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d640033f0 con 0x7f8d7c0cb890 2023-08-17T17:50:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d7affd700 1 -- 172.21.15.78:0/1087830840 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485097983 0 0) 0x7f8d7c0c96b0 con 0x7f8d7c153f80 2023-08-17T17:50:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d7affd700 1 -- 172.21.15.78:0/1087830840 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d7c0c9ca0 con 0x7f8d7c153f80 2023-08-17T17:50:02.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d7affd700 1 -- 172.21.15.78:0/1087830840 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616700676 0 0) 0x7f8d640033f0 con 0x7f8d7c0cb890 2023-08-17T17:50:02.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d80eaa700 1 -- 172.21.15.78:0/1087830840 >> v1:172.21.15.150:6789/0 conn(0x7f8d7c153f80 legacy=0x7f8d7c0a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d80eaa700 1 -- 172.21.15.78:0/1087830840 >> v1:172.21.15.78:6789/0 conn(0x7f8d7c0cb890 legacy=0x7f8d7c0c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.669+0000 7f8d80eaa700 1 -- 172.21.15.78:0/1087830840 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0c0080 con 0x7f8d7c0c0e30 2023-08-17T17:50:02.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d80eaa700 1 --2- 172.21.15.78:0/1087830840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 0x7f8d7c0c6c60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8d74009ec0 tx=0x7f8d74009780).ready entity=mon.2 client_cookie=3e321aec1e4390f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:02.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d7affd700 1 -- 172.21.15.78:0/1087830840 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400e070 con 0x7f8d7c0c0e30 2023-08-17T17:50:02.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d7affd700 1 -- 172.21.15.78:0/1087830840 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7400b870 con 0x7f8d7c0c0e30 2023-08-17T17:50:02.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d7affd700 1 -- 172.21.15.78:0/1087830840 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70001470 con 0x7f8d7c0c0e30 2023-08-17T17:50:02.674 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:50:02.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d816ab700 1 -- 172.21.15.78:0/1087830840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 msgr2=0x7f8d7c0c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d816ab700 1 --2- 172.21.15.78:0/1087830840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 0x7f8d7c0c6c60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8d74009ec0 tx=0x7f8d74009780).stop 2023-08-17T17:50:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d816ab700 1 -- 172.21.15.78:0/1087830840 shutdown_connections 2023-08-17T17:50:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d816ab700 1 --2- 172.21.15.78:0/1087830840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 0x7f8d7c0c6c60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d816ab700 1 -- 172.21.15.78:0/1087830840 >> 172.21.15.78:0/1087830840 conn(0x7f8d7c06a400 msgr2=0x7f8d7c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d816ab700 1 -- 172.21.15.78:0/1087830840 shutdown_connections 2023-08-17T17:50:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.670+0000 7f8d816ab700 1 -- 172.21.15.78:0/1087830840 wait complete. 2023-08-17T17:50:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.671+0000 7f8d816ab700 1 Processor -- start 2023-08-17T17:50:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.672+0000 7f8d816ab700 1 -- start start 2023-08-17T17:50:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.672+0000 7f8d816ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 0x7f8d7c1570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.672+0000 7f8d816ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d7c0cb890 0x7f8d7c1406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.672+0000 7f8d816ab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7c153f80 0x7f8d7c155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.672+0000 7f8d816ab700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c156c90 con 0x7f8d7c153f80 2023-08-17T17:50:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.672+0000 7f8d816ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c156010 con 0x7f8d7c0cb890 2023-08-17T17:50:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.672+0000 7f8d816ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c1562f0 con 0x7f8d7c0c0e30 2023-08-17T17:50:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.672+0000 7f8d80eaa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7c153f80 0x7f8d7c155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d80eaa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7c153f80 0x7f8d7c155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52558/0 (socket says 172.21.15.78:52558) 2023-08-17T17:50:02.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d80eaa700 1 -- 172.21.15.78:0/1709054292 learned_addr learned my addr 172.21.15.78:0/1709054292 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:02.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d7c0cb890 0x7f8d7c1406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 0x7f8d7c1570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d80eaa700 1 -- 172.21.15.78:0/1709054292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 msgr2=0x7f8d7c1570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d80eaa700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 0x7f8d7c1570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d80eaa700 1 -- 172.21.15.78:0/1709054292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d7c0cb890 msgr2=0x7f8d7c1406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d80eaa700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d7c0cb890 0x7f8d7c1406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d80eaa700 1 -- 172.21.15.78:0/1709054292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74009a20 con 0x7f8d7c153f80 2023-08-17T17:50:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 0x7f8d7c1570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d80eaa700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7c153f80 0x7f8d7c155550 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f8d74010000 tx=0x7f8d74009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d63fff700 1 -- 172.21.15.78:0/1709054292 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400bed0 con 0x7f8d7c153f80 2023-08-17T17:50:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d63fff700 1 -- 172.21.15.78:0/1709054292 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d740125d0 con 0x7f8d7c153f80 2023-08-17T17:50:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d63fff700 1 -- 172.21.15.78:0/1709054292 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74012950 con 0x7f8d7c153f80 2023-08-17T17:50:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d816ab700 1 -- 172.21.15.78:0/1709054292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c1565d0 con 0x7f8d7c153f80 2023-08-17T17:50:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.673+0000 7f8d816ab700 1 -- 172.21.15.78:0/1709054292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c1575a0 con 0x7f8d7c153f80 2023-08-17T17:50:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.674+0000 7f8d63fff700 1 -- 172.21.15.78:0/1709054292 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8d74026030 con 0x7f8d7c153f80 2023-08-17T17:50:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.675+0000 7f8d63fff700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d6805ed90 0x7f8d68061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.675+0000 7f8d63fff700 1 -- 172.21.15.78:0/1709054292 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8d7407b8c0 con 0x7f8d7c153f80 2023-08-17T17:50:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.675+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d6805ed90 0x7f8d68061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.675+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d6805ed90 0x7f8d68061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8d6c003750 tx=0x7f8d6c009040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:02.682 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:50:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.677+0000 7f8d942a2b80 1 Processor -- start 2023-08-17T17:50:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.677+0000 7f8d942a2b80 1 -- start start 2023-08-17T17:50:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221adbdd0 0x559221adc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221ad70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221ad75a0 0x559221ad7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559221aa1d00 con 0x559221adbdd0 2023-08-17T17:50:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559221a18cb0 con 0x559221b24a70 2023-08-17T17:50:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x559221a2dc90 con 0x559221ad75a0 2023-08-17T17:50:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221adbdd0 0x559221adc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221adbdd0 0x559221adc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52570/0 (socket says 172.21.15.78:52570) 2023-08-17T17:50:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7bfff700 1 -- 172.21.15.78:0/601037256 learned_addr learned my addr 172.21.15.78:0/601037256 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d80eaa700 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221ad75a0 0x559221ad7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221ad70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7bfff700 1 -- 172.21.15.78:0/601037256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221ad75a0 msgr2=0x559221ad7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221ad75a0 0x559221ad7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7bfff700 1 -- 172.21.15.78:0/601037256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 msgr2=0x559221ad70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221ad70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7bfff700 1 -- 172.21.15.78:0/601037256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592218d0310 con 0x559221adbdd0 2023-08-17T17:50:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221ad70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d80eaa700 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221ad75a0 0x559221ad7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.678+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221adbdd0 0x559221adc1b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f8d6c0176c0 tx=0x7f8d6c012000).ready entity=mon.0 client_cookie=6e98842c83bab40d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d617fa700 1 -- 172.21.15.78:0/601037256 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c01c070 con 0x559221adbdd0 2023-08-17T17:50:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d617fa700 1 -- 172.21.15.78:0/601037256 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c017320 con 0x559221adbdd0 2023-08-17T17:50:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d617fa700 1 -- 172.21.15.78:0/601037256 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c014480 con 0x559221adbdd0 2023-08-17T17:50:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d942a2b80 1 -- 172.21.15.78:0/601037256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221adbdd0 msgr2=0x559221adc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221adbdd0 0x559221adc1b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f8d6c0176c0 tx=0x7f8d6c012000).stop 2023-08-17T17:50:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d942a2b80 1 -- 172.21.15.78:0/601037256 shutdown_connections 2023-08-17T17:50:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221ad75a0 0x559221ad7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221adbdd0 0x559221adc1b0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/601037256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221ad70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d942a2b80 1 -- 172.21.15.78:0/601037256 >> 172.21.15.78:0/601037256 conn(0x559221898e40 msgr2=0x559221b24f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d942a2b80 1 -- 172.21.15.78:0/601037256 shutdown_connections 2023-08-17T17:50:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.679+0000 7f8d942a2b80 1 -- 172.21.15.78:0/601037256 wait complete. 2023-08-17T17:50:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.680+0000 7f8d942a2b80 1 -- start start 2023-08-17T17:50:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.680+0000 7f8d942a2b80 1 Processor -- start 2023-08-17T17:50:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b33ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 0x559221b20980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221b0a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592219f4ef0 con 0x559221ad75a0 2023-08-17T17:50:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592219f98d0 con 0x559221b24a70 2023-08-17T17:50:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x559221b31f60 con 0x559221adbdd0 2023-08-17T17:50:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d942a2b80 10 client.0 ll_register_callbacks cb 0x559221a9bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:50:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d7bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b33ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d7bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b33ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52582/0 (socket says 172.21.15.78:52582) 2023-08-17T17:50:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d7bfff700 1 -- 172.21.15.78:0/4064379433 learned_addr learned my addr 172.21.15.78:0/4064379433 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 0x559221b20980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d7bfff700 1 -- 172.21.15.78:0/4064379433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 msgr2=0x559221b20980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 0x559221b20980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d80eaa700 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221b0a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d7bfff700 1 -- 172.21.15.78:0/4064379433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 msgr2=0x559221b0a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221b0a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d7bfff700 1 -- 172.21.15.78:0/4064379433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c00f040 con 0x559221ad75a0 2023-08-17T17:50:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b33ab0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f8d6c008fd0 tx=0x7f8d6c014000).ready entity=mon.0 client_cookie=ab182bebd378f143 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d5a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:50:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/4064379433 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c028070 con 0x559221ad75a0 2023-08-17T17:50:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.681+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/4064379433 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8d6c014b10 con 0x559221ad75a0 2023-08-17T17:50:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d942a2b80 1 -- 172.21.15.78:0/4064379433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559221ad6340 con 0x559221ad75a0 2023-08-17T17:50:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/4064379433 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d6c00e4c0 con 0x559221ad75a0 2023-08-17T17:50:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d942a2b80 10 client.6894 fetch_fsmap learned FSMap version 31 2023-08-17T17:50:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d942a2b80 1 -- 172.21.15.78:0/4064379433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x559221a26e70 con 0x559221ad75a0 2023-08-17T17:50:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/4064379433 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559221ad6340 con 0x559221ad75a0 2023-08-17T17:50:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/4064379433 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8d6c00e620 con 0x559221ad75a0 2023-08-17T17:50:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d942a2b80 10 client.6894 fetch_fsmap finished waiting for FSMap version 31 2023-08-17T17:50:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d942a2b80 10 client.6894 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T17:50:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d942a2b80 20 client.6894 populate_metadata read hostname 'smithi078' 2023-08-17T17:50:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.78:6834/4042380652,v1:172.21.15.78:6836/4042380652] conn(0x559221b06b20 0x559221b06f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d942a2b80 4 client.6894 mds_command: new command op to 6714 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T17:50:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d942a2b80 1 -- 172.21.15.78:0/4064379433 --> [v2:172.21.15.78:6834/4042380652,v1:172.21.15.78:6836/4042380652] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559221aa5b50 con 0x559221b06b20 2023-08-17T17:50:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.78:6834/4042380652,v1:172.21.15.78:6836/4042380652] conn(0x559221b06b20 0x559221b06f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d5a7fc700 10 client.6894 ms_handle_connect on v2:172.21.15.78:6834/4042380652 2023-08-17T17:50:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.682+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.78:6834/4042380652,v1:172.21.15.78:6836/4042380652] conn(0x559221b06b20 0x559221b06f00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8883ef8679b767f4 server_cookie=a1cbdf321827cd9b in_seq=0 out_seq=0 2023-08-17T17:50:02.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/4064379433 <== mds.0 v2:172.21.15.78:6834/4042380652 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x559221aa5b50 con 0x559221b06b20 2023-08-17T17:50:02.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d5a7fc700 10 client.6894 handle_command_reply: tid=0 2023-08-17T17:50:02.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 client.6894 shutdown 2023-08-17T17:50:02.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 -- 172.21.15.78:0/4064379433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 msgr2=0x559221b33ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b33ab0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f8d6c008fd0 tx=0x7f8d6c014000).stop 2023-08-17T17:50:02.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 -- 172.21.15.78:0/4064379433 shutdown_connections 2023-08-17T17:50:02.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221b0a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.78:6834/4042380652,v1:172.21.15.78:6836/4042380652] conn(0x559221b06b20 0x559221b06f00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b33ab0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/4064379433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 0x559221b20980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d5a7fc700 0 client.6894 ms_handle_reset on v2:172.21.15.78:6834/4042380652 2023-08-17T17:50:02.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 -- 172.21.15.78:0/4064379433 >> 172.21.15.78:0/4064379433 conn(0x559221898e40 msgr2=0x559221adc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:02.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 -- 172.21.15.78:0/4064379433 shutdown_connections 2023-08-17T17:50:02.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 1 -- 172.21.15.78:0/4064379433 wait complete. 2023-08-17T17:50:02.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.683+0000 7f8d942a2b80 20 client.6894 trim_cache size 0 max 16384 2023-08-17T17:50:02.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.700+0000 7f8d942a2b80 1 Processor -- start 2023-08-17T17:50:02.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.700+0000 7f8d942a2b80 1 -- start start 2023-08-17T17:50:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221adbdd0 0x559221ad7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221b24a70 0x559221ad9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559221ad8390 con 0x559221ad75a0 2023-08-17T17:50:02.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559221b1ef20 con 0x559221adbdd0 2023-08-17T17:50:02.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x559221ad8c50 con 0x559221b24a70 2023-08-17T17:50:02.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d7bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d7bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52586/0 (socket says 172.21.15.78:52586) 2023-08-17T17:50:02.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d7bfff700 1 -- 172.21.15.78:0/3137902103 learned_addr learned my addr 172.21.15.78:0/3137902103 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:02.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/3137902103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221adbdd0 0x559221ad7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.701+0000 7f8d80eaa700 1 --2- 172.21.15.78:0/3137902103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221b24a70 0x559221ad9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d7bfff700 1 -- 172.21.15.78:0/3137902103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221b24a70 msgr2=0x559221ad9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:02.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/3137902103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221b24a70 0x559221ad9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d7bfff700 1 -- 172.21.15.78:0/3137902103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221adbdd0 msgr2=0x559221ad7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:02.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/3137902103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221adbdd0 0x559221ad7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d7bfff700 1 -- 172.21.15.78:0/3137902103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559221b07260 con 0x559221ad75a0 2023-08-17T17:50:02.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/3137902103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b094a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f8d6c00ea70 tx=0x7f8d6c028000).ready entity=mon.0 client_cookie=1f5fb94a0d7d10df server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:02.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d61ffb700 1 -- 172.21.15.78:0/3137902103 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c014b10 con 0x559221ad75a0 2023-08-17T17:50:02.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d61ffb700 1 -- 172.21.15.78:0/3137902103 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c00eb30 con 0x559221ad75a0 2023-08-17T17:50:02.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d61ffb700 1 -- 172.21.15.78:0/3137902103 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00ed70 con 0x559221ad75a0 2023-08-17T17:50:02.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d942a2b80 1 -- 172.21.15.78:0/3137902103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 msgr2=0x559221b094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.702+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/3137902103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b094a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f8d6c00ea70 tx=0x7f8d6c028000).stop 2023-08-17T17:50:02.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.703+0000 7f8d942a2b80 1 -- 172.21.15.78:0/3137902103 shutdown_connections 2023-08-17T17:50:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.703+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/3137902103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221b24a70 0x559221ad9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.703+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/3137902103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b094a0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.703+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/3137902103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221adbdd0 0x559221ad7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.703+0000 7f8d942a2b80 1 -- 172.21.15.78:0/3137902103 >> 172.21.15.78:0/3137902103 conn(0x559221898e40 msgr2=0x559221b24f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.703+0000 7f8d942a2b80 1 -- 172.21.15.78:0/3137902103 shutdown_connections 2023-08-17T17:50:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.703+0000 7f8d942a2b80 1 -- 172.21.15.78:0/3137902103 wait complete. 2023-08-17T17:50:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.703+0000 7f8d942a2b80 1 -- start start 2023-08-17T17:50:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.703+0000 7f8d942a2b80 1 Processor -- start 2023-08-17T17:50:02.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b08270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 0x559221b85030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d942a2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221b85520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559221b87130 con 0x559221ad75a0 2023-08-17T17:50:02.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559221b85a10 con 0x559221b24a70 2023-08-17T17:50:02.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d942a2b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x559221b047f0 con 0x559221adbdd0 2023-08-17T17:50:02.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d942a2b80 10 client.0 ll_register_callbacks cb 0x559221a9bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:50:02.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b08270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b08270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52602/0 (socket says 172.21.15.78:52602) 2023-08-17T17:50:02.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7bfff700 1 -- 172.21.15.78:0/2052512072 learned_addr learned my addr 172.21.15.78:0/2052512072 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:02.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 0x559221b85030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d80eaa700 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221b85520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7bfff700 1 -- 172.21.15.78:0/2052512072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 msgr2=0x559221b85030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:02.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 0x559221b85030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7bfff700 1 -- 172.21.15.78:0/2052512072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 msgr2=0x559221b85520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:02.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221b85520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7bfff700 1 -- 172.21.15.78:0/2052512072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559221a26e70 con 0x559221ad75a0 2023-08-17T17:50:02.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 0x559221b85030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:02.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d7bfff700 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b08270 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f8d6c022ac0 tx=0x7f8d6c039000).ready entity=mon.0 client_cookie=59333f3a822c9881 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:02.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.704+0000 7f8d5a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:50:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/2052512072 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c028030 con 0x559221ad75a0 2023-08-17T17:50:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/2052512072 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8d6c022d00 con 0x559221ad75a0 2023-08-17T17:50:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d942a2b80 1 -- 172.21.15.78:0/2052512072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d6c017320 con 0x559221ad75a0 2023-08-17T17:50:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/2052512072 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d6c014a40 con 0x559221ad75a0 2023-08-17T17:50:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d942a2b80 10 client.6900 fetch_fsmap learned FSMap version 31 2023-08-17T17:50:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d942a2b80 1 -- 172.21.15.78:0/2052512072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x559221a22480 con 0x559221ad75a0 2023-08-17T17:50:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/2052512072 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c017320 con 0x559221ad75a0 2023-08-17T17:50:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/2052512072 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8d6c00e3f0 con 0x559221ad75a0 2023-08-17T17:50:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d942a2b80 10 client.6900 fetch_fsmap finished waiting for FSMap version 31 2023-08-17T17:50:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d942a2b80 10 client.6900 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T17:50:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d942a2b80 20 client.6900 populate_metadata read hostname 'smithi078' 2023-08-17T17:50:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.78:6834/4042380652,v1:172.21.15.78:6836/4042380652] conn(0x559221b1d480 0x559221b1d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d942a2b80 4 client.6900 mds_command: new command op to 6714 tid=0[{"prefix": "status"}] 2023-08-17T17:50:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d942a2b80 1 -- 172.21.15.78:0/2052512072 --> [v2:172.21.15.78:6834/4042380652,v1:172.21.15.78:6836/4042380652] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559221894ca0 con 0x559221b1d480 2023-08-17T17:50:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.78:6834/4042380652,v1:172.21.15.78:6836/4042380652] conn(0x559221b1d480 0x559221b1d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d5a7fc700 10 client.6900 ms_handle_connect on v2:172.21.15.78:6834/4042380652 2023-08-17T17:50:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.705+0000 7f8d7b7fe700 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.78:6834/4042380652,v1:172.21.15.78:6836/4042380652] conn(0x559221b1d480 0x559221b1d860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d42ed3b4cbe23b75 server_cookie=69a39021bc0a82c9 in_seq=0 out_seq=0 2023-08-17T17:50:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d5a7fc700 1 -- 172.21.15.78:0/2052512072 <== mds.0 v2:172.21.15.78:6834/4042380652 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x559221894ca0 con 0x559221b1d480 2023-08-17T17:50:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d5a7fc700 10 client.6900 handle_command_reply: tid=0 2023-08-17T17:50:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 client.6900 shutdown 2023-08-17T17:50:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 -- 172.21.15.78:0/2052512072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 msgr2=0x559221b08270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b08270 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f8d6c022ac0 tx=0x7f8d6c039000).stop 2023-08-17T17:50:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 -- 172.21.15.78:0/2052512072 shutdown_connections 2023-08-17T17:50:02.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559221b24a70 0x559221b85520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.78:6834/4042380652,v1:172.21.15.78:6836/4042380652] conn(0x559221b1d480 0x559221b1d860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559221ad75a0 0x559221b08270 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 --2- 172.21.15.78:0/2052512072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559221adbdd0 0x559221b85030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d5a7fc700 0 client.6900 ms_handle_reset on v2:172.21.15.78:6834/4042380652 2023-08-17T17:50:02.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 -- 172.21.15.78:0/2052512072 >> 172.21.15.78:0/2052512072 conn(0x559221898e40 msgr2=0x559221b24f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:02.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 -- 172.21.15.78:0/2052512072 shutdown_connections 2023-08-17T17:50:02.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 1 -- 172.21.15.78:0/2052512072 wait complete. 2023-08-17T17:50:02.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d942a2b80 20 client.6900 trim_cache size 0 max 16384 2023-08-17T17:50:02.718 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:50:02.718 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T17:50:02.718 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T17:50:02.718 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 6714, 2023-08-17T17:50:02.719 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T17:50:02.719 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T17:50:02.719 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T17:50:02.719 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 9.0971468249999994, 2023-08-17T17:50:02.719 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 31, 2023-08-17T17:50:02.719 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 91, 2023-08-17T17:50:02.719 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 91, 2023-08-17T17:50:02.719 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 14.275377895 2023-08-17T17:50:02.720 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:50:02.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d816ab700 1 -- 172.21.15.78:0/1709054292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d6805ed90 msgr2=0x7f8d68061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d816ab700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d6805ed90 0x7f8d68061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8d6c003750 tx=0x7f8d6c009040).stop 2023-08-17T17:50:02.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d816ab700 1 -- 172.21.15.78:0/1709054292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7c153f80 msgr2=0x7f8d7c155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d816ab700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7c153f80 0x7f8d7c155550 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f8d74010000 tx=0x7f8d74009780).stop 2023-08-17T17:50:02.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d816ab700 1 -- 172.21.15.78:0/1709054292 shutdown_connections 2023-08-17T17:50:02.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d816ab700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d6805ed90 0x7f8d68061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d816ab700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7c153f80 0x7f8d7c155550 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d816ab700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d7c0c0e30 0x7f8d7c1570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d816ab700 1 --2- 172.21.15.78:0/1709054292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d7c0cb890 0x7f8d7c1406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.706+0000 7f8d816ab700 1 -- 172.21.15.78:0/1709054292 >> 172.21.15.78:0/1709054292 conn(0x7f8d7c06a400 msgr2=0x7f8d7c159240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:02.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.707+0000 7f8d816ab700 1 -- 172.21.15.78:0/1709054292 shutdown_connections 2023-08-17T17:50:02.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.707+0000 7f8d816ab700 1 -- 172.21.15.78:0/1709054292 wait complete. 2023-08-17T17:50:02.723 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T17:50:02.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.878+0000 7f184e249700 1 Processor -- start 2023-08-17T17:50:02.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.878+0000 7f184e249700 1 -- start start 2023-08-17T17:50:02.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f184e249700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1848152010 0x7f18480c3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f184e249700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18481523f0 0x7f18480c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f184e249700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18480ab010 0x7f18480ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f184e249700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18480c3ff0 con 0x7f18480ab010 2023-08-17T17:50:02.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f184e249700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18481528b0 con 0x7f18481523f0 2023-08-17T17:50:02.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f184e249700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1848152b90 con 0x7f1848152010 2023-08-17T17:50:02.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f1847fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18480ab010 0x7f18480ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f1847fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18480ab010 0x7f18480ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52610/0 (socket says 172.21.15.78:52610) 2023-08-17T17:50:02.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f1847fff700 1 -- 172.21.15.78:0/3614325025 learned_addr learned my addr 172.21.15.78:0/3614325025 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:02.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f18477fe700 1 --2- 172.21.15.78:0/3614325025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1848152010 0x7f18480c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.879+0000 7f1846ffd700 1 --2- 172.21.15.78:0/3614325025 >> v2:172.21.15.150:3300/0 conn(0x7f18481523f0 0x7f18480c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f1847fff700 1 -- 172.21.15.78:0/3614325025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1848152010 msgr2=0x7f18480c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f1847fff700 1 --2- 172.21.15.78:0/3614325025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1848152010 0x7f18480c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f1847fff700 1 -- 172.21.15.78:0/3614325025 >> v2:172.21.15.150:3300/0 conn(0x7f18481523f0 msgr2=0x7f18480c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f1847fff700 1 --2- 172.21.15.78:0/3614325025 >> v2:172.21.15.150:3300/0 conn(0x7f18481523f0 0x7f18480c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f1847fff700 1 -- 172.21.15.78:0/3614325025 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848152e70 con 0x7f18480ab010 2023-08-17T17:50:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f18477fe700 1 --2- 172.21.15.78:0/3614325025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1848152010 0x7f18480c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f1847fff700 1 --2- 172.21.15.78:0/3614325025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480ab010 0x7f18480ab4a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f1848060620 tx=0x7f1840009840).ready entity=mon.0 client_cookie=6173b0875ec7c83a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f18467fc700 1 -- 172.21.15.78:0/3614325025 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000e070 con 0x7f18480ab010 2023-08-17T17:50:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f18467fc700 1 -- 172.21.15.78:0/3614325025 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184000ba20 con 0x7f18480ab010 2023-08-17T17:50:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f18467fc700 1 -- 172.21.15.78:0/3614325025 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000bda0 con 0x7f18480ab010 2023-08-17T17:50:02.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f184e249700 1 -- 172.21.15.78:0/3614325025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480ab010 msgr2=0x7f18480ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f184e249700 1 --2- 172.21.15.78:0/3614325025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480ab010 0x7f18480ab4a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f1848060620 tx=0x7f1840009840).stop 2023-08-17T17:50:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f184e249700 1 -- 172.21.15.78:0/3614325025 shutdown_connections 2023-08-17T17:50:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f184e249700 1 --2- 172.21.15.78:0/3614325025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480ab010 0x7f18480ab4a0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f184e249700 1 --2- 172.21.15.78:0/3614325025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1848152010 0x7f18480c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f184e249700 1 --2- 172.21.15.78:0/3614325025 >> v2:172.21.15.150:3300/0 conn(0x7f18481523f0 0x7f18480c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f184e249700 1 -- 172.21.15.78:0/3614325025 >> 172.21.15.78:0/3614325025 conn(0x7f18480624e0 msgr2=0x7f18480628c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f184e249700 1 -- 172.21.15.78:0/3614325025 shutdown_connections 2023-08-17T17:50:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.880+0000 7f184e249700 1 -- 172.21.15.78:0/3614325025 wait complete. 2023-08-17T17:50:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.882+0000 7f184e249700 1 Processor -- start 2023-08-17T17:50:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.882+0000 7f184e249700 1 -- start start 2023-08-17T17:50:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.882+0000 7f184e249700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18480ab010 0x7f18480aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.882+0000 7f184e249700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1848152010 0x7f184814a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.882+0000 7f184e249700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18481523f0 0x7f184814be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.882+0000 7f184e249700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184814b9b0 con 0x7f1848152010 2023-08-17T17:50:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.882+0000 7f184e249700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184814ab20 con 0x7f18481523f0 2023-08-17T17:50:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.882+0000 7f184e249700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184814ada0 con 0x7f18480ab010 2023-08-17T17:50:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1846ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1848152010 0x7f184814a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1846ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1848152010 0x7f184814a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52616/0 (socket says 172.21.15.78:52616) 2023-08-17T17:50:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1846ffd700 1 -- 172.21.15.78:0/1644715986 learned_addr learned my addr 172.21.15.78:0/1644715986 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f18477fe700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18480ab010 0x7f18480aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1847fff700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18481523f0 0x7f184814be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1846ffd700 1 -- 172.21.15.78:0/1644715986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18480ab010 msgr2=0x7f18480aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1846ffd700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18480ab010 0x7f18480aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1846ffd700 1 -- 172.21.15.78:0/1644715986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18481523f0 msgr2=0x7f184814be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1846ffd700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18481523f0 0x7f184814be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1846ffd700 1 -- 172.21.15.78:0/1644715986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1840009ae0 con 0x7f1848152010 2023-08-17T17:50:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1847fff700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18481523f0 0x7f184814be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f1846ffd700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1848152010 0x7f184814a630 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f183c00e900 tx=0x7f183c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f182f7fe700 1 -- 172.21.15.78:0/1644715986 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00c640 con 0x7f1848152010 2023-08-17T17:50:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f182f7fe700 1 -- 172.21.15.78:0/1644715986 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c00c7a0 con 0x7f1848152010 2023-08-17T17:50:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f184e249700 1 -- 172.21.15.78:0/1644715986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184814b080 con 0x7f1848152010 2023-08-17T17:50:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f182f7fe700 1 -- 172.21.15.78:0/1644715986 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00cb20 con 0x7f1848152010 2023-08-17T17:50:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.883+0000 7f184e249700 1 -- 172.21.15.78:0/1644715986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184814b640 con 0x7f1848152010 2023-08-17T17:50:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.884+0000 7f184e249700 1 -- 172.21.15.78:0/1644715986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184814bb60 con 0x7f1848152010 2023-08-17T17:50:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.884+0000 7f182f7fe700 1 -- 172.21.15.78:0/1644715986 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f183c022070 con 0x7f1848152010 2023-08-17T17:50:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.885+0000 7f182f7fe700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183405ed90 0x7f1834061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.885+0000 7f182f7fe700 1 -- 172.21.15.78:0/1644715986 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f183c079d80 con 0x7f1848152010 2023-08-17T17:50:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.885+0000 7f18477fe700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183405ed90 0x7f1834061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.885+0000 7f18477fe700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183405ed90 0x7f1834061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1838006d80 tx=0x7f1838008040).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:02.889+0000 7f182f7fe700 1 -- 172.21.15.78:0/1644715986 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f184814bb60 con 0x7f1848152010 2023-08-17T17:50:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.094+0000 7f184e249700 1 -- 172.21.15.78:0/1644715986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f184814baf0 con 0x7f1848152010 2023-08-17T17:50:03.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.095+0000 7f182f7fe700 1 -- 172.21.15.78:0/1644715986 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f183c07b070 con 0x7f1848152010 2023-08-17T17:50:03.096 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:50:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 -- 172.21.15.78:0/1644715986 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183405ed90 msgr2=0x7f1834061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183405ed90 0x7f1834061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1838006d80 tx=0x7f1838008040).stop 2023-08-17T17:50:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 -- 172.21.15.78:0/1644715986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1848152010 msgr2=0x7f184814a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1848152010 0x7f184814a630 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f183c00e900 tx=0x7f183c009060).stop 2023-08-17T17:50:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 -- 172.21.15.78:0/1644715986 shutdown_connections 2023-08-17T17:50:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f183405ed90 0x7f1834061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18481523f0 0x7f184814be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18480ab010 0x7f18480aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 --2- 172.21.15.78:0/1644715986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1848152010 0x7f184814a630 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 -- 172.21.15.78:0/1644715986 >> 172.21.15.78:0/1644715986 conn(0x7f18480624e0 msgr2=0x7f18480c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 -- 172.21.15.78:0/1644715986 shutdown_connections 2023-08-17T17:50:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.097+0000 7f184e249700 1 -- 172.21.15.78:0/1644715986 wait complete. 2023-08-17T17:50:03.108 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T17:50:03.109 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:50:03.109 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T17:50:03.109 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T17:50:03.110 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T17:50:03.110 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T17:50:03.110 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T17:50:03.110 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:50:03.111 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:50:03.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:03.111 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T17:50:03.126 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:50:03.126 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:50:03.126 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:50:03.126 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:03.126 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:50:03.127 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:03.127 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:50:03.127 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:50:03.127 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T17:50:03.127 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:50:03.127 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:50:03.128 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T17:50:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:50:03.128 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:50:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:50:03.128 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:50:03.128 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:50:03.128 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 41276sec preferred_lft 41276sec 2023-08-17T17:50:03.129 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T17:50:03.129 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:50:03.129 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:50:03.129 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T17:50:03.129 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:03.129 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T17:50:03.129 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:03.130 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:50:03.130 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T17:50:03.130 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link 2023-08-17T17:50:03.130 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:03.130 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:50:03.130 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T17:50:03.130 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::54:39ff:fe93:1c36/64 scope link 2023-08-17T17:50:03.131 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:03.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:03.131 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:50:03.189 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T17:50:03.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:03.190 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T17:50:03.245 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T17:50:03.246 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:50:03.246 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:50:03.246 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:50:03.246 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:50:03.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:03.247 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:50:03.247 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:50:03.247 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:50:03.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:50:03.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:50:03.248 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:50:03.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:03.346 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:50:03.360 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T17:50:03.360 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T17:50:03.360 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:50:03.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:03.361 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T17:50:03.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:03.424 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T17:50:03.478 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:50:03.479 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:50:03.556 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:50:03.556 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:50:03.581 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:50:03.581 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:50:03.583 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:50:03.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:03.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T17:50:03.647 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-17T17:50:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.801+0000 7f55fbfff700 1 Processor -- start 2023-08-17T17:50:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.801+0000 7f55fbfff700 1 -- start start 2023-08-17T17:50:03.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55fbfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55fc153f80 0x7f55fc0a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:03.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55fbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f55fc0cb890 0x7f55fc0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55fbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 0x7f55fc0c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55fbfff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0c1100 con 0x7f55fc153f80 2023-08-17T17:50:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55fbfff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0c9ca0 con 0x7f55fc0cb890 2023-08-17T17:50:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55fbfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c96b0 con 0x7f55fc154360 2023-08-17T17:50:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55faffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55fc153f80 0x7f55fc0a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55faffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55fc153f80 0x7f55fc0a7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52622/0 (socket says 172.21.15.78:52622) 2023-08-17T17:50:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55faffd700 1 -- 172.21.15.78:0/3282428979 learned_addr learned my addr 172.21.15.78:0/3282428979 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55faffd700 1 -- 172.21.15.78:0/3282428979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 msgr2=0x7f55fc0c0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55fb7fe700 1 --2- 172.21.15.78:0/3282428979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 0x7f55fc0c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55fa7fc700 1 --2- 172.21.15.78:0/3282428979 >> v2:172.21.15.150:3300/0 conn(0x7f55fc0cb890 0x7f55fc0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55faffd700 1 --2- 172.21.15.78:0/3282428979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 0x7f55fc0c0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55faffd700 1 -- 172.21.15.78:0/3282428979 >> v2:172.21.15.150:3300/0 conn(0x7f55fc0cb890 msgr2=0x7f55fc0c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55faffd700 1 --2- 172.21.15.78:0/3282428979 >> v2:172.21.15.150:3300/0 conn(0x7f55fc0cb890 0x7f55fc0c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55faffd700 1 -- 172.21.15.78:0/3282428979 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0c0080 con 0x7f55fc153f80 2023-08-17T17:50:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55faffd700 1 --2- 172.21.15.78:0/3282428979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 0x7f55fc0a7b80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f55ec009810 tx=0x7f55ec009060).ready entity=mon.0 client_cookie=c9484b212d5af97e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:03.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55f9ffb700 1 -- 172.21.15.78:0/3282428979 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec005880 con 0x7f55fc153f80 2023-08-17T17:50:03.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.802+0000 7f55f9ffb700 1 -- 172.21.15.78:0/3282428979 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0059e0 con 0x7f55fc153f80 2023-08-17T17:50:03.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.803+0000 7f55f9ffb700 1 -- 172.21.15.78:0/3282428979 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec005d60 con 0x7f55fc153f80 2023-08-17T17:50:03.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.803+0000 7f55fbfff700 1 -- 172.21.15.78:0/3282428979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 msgr2=0x7f55fc0a7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:03.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.803+0000 7f55fbfff700 1 --2- 172.21.15.78:0/3282428979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 0x7f55fc0a7b80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f55ec009810 tx=0x7f55ec009060).stop 2023-08-17T17:50:03.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.803+0000 7f55fbfff700 1 -- 172.21.15.78:0/3282428979 shutdown_connections 2023-08-17T17:50:03.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.803+0000 7f55fbfff700 1 --2- 172.21.15.78:0/3282428979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 0x7f55fc0a7b80 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.803+0000 7f55fbfff700 1 --2- 172.21.15.78:0/3282428979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 0x7f55fc0c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.803+0000 7f55fbfff700 1 --2- 172.21.15.78:0/3282428979 >> v2:172.21.15.150:3300/0 conn(0x7f55fc0cb890 0x7f55fc0c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.803+0000 7f55fbfff700 1 -- 172.21.15.78:0/3282428979 >> 172.21.15.78:0/3282428979 conn(0x7f55fc06a400 msgr2=0x7f55fc0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.803+0000 7f55fbfff700 1 -- 172.21.15.78:0/3282428979 shutdown_connections 2023-08-17T17:50:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.803+0000 7f55fbfff700 1 -- 172.21.15.78:0/3282428979 wait complete. 2023-08-17T17:50:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.804+0000 7f55fbfff700 1 Processor -- start 2023-08-17T17:50:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.804+0000 7f55fbfff700 1 -- start start 2023-08-17T17:50:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.805+0000 7f55fbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0cb890 0x7f55fc0c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.805+0000 7f55fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 0x7f55fc0ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.805+0000 7f55fbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 0x7f55fc1427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.805+0000 7f55fbfff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c4ef0 con 0x7f55fc153f80 2023-08-17T17:50:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.805+0000 7f55fbfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c4a60 con 0x7f55fc0cb890 2023-08-17T17:50:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.805+0000 7f55fbfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c3e50 con 0x7f55fc154360 2023-08-17T17:50:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.805+0000 7f55fa7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 0x7f55fc0ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.805+0000 7f55fa7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 0x7f55fc0ade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52638/0 (socket says 172.21.15.78:52638) 2023-08-17T17:50:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.805+0000 7f55fa7fc700 1 -- 172.21.15.78:0/1987558660 learned_addr learned my addr 172.21.15.78:0/1987558660 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:03.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.805+0000 7f55fb7fe700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 0x7f55fc1427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:03.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55faffd700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0cb890 0x7f55fc0c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:03.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55fa7fc700 1 -- 172.21.15.78:0/1987558660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 msgr2=0x7f55fc1427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:03.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55fa7fc700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 0x7f55fc1427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55fa7fc700 1 -- 172.21.15.78:0/1987558660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0cb890 msgr2=0x7f55fc0c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:03.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55fa7fc700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0cb890 0x7f55fc0c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:03.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55fa7fc700 1 -- 172.21.15.78:0/1987558660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec009300 con 0x7f55fc153f80 2023-08-17T17:50:03.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55fb7fe700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 0x7f55fc1427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:03.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55faffd700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0cb890 0x7f55fc0c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:03.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55fa7fc700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 0x7f55fc0ade60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f55f000c880 tx=0x7f55f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:03.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55e2ffd700 1 -- 172.21.15.78:0/1987558660 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0010580 con 0x7f55fc153f80 2023-08-17T17:50:03.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55e2ffd700 1 -- 172.21.15.78:0/1987558660 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f00106e0 con 0x7f55fc153f80 2023-08-17T17:50:03.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55e2ffd700 1 -- 172.21.15.78:0/1987558660 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0010a60 con 0x7f55fc153f80 2023-08-17T17:50:03.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55fbfff700 1 -- 172.21.15.78:0/1987558660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc0c4130 con 0x7f55fc153f80 2023-08-17T17:50:03.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.806+0000 7f55fbfff700 1 -- 172.21.15.78:0/1987558660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc0c46f0 con 0x7f55fc153f80 2023-08-17T17:50:03.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.807+0000 7f55fbfff700 1 -- 172.21.15.78:0/1987558660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc065230 con 0x7f55fc153f80 2023-08-17T17:50:03.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.807+0000 7f55e2ffd700 1 -- 172.21.15.78:0/1987558660 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f55f001b460 con 0x7f55fc153f80 2023-08-17T17:50:03.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.807+0000 7f55e2ffd700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55e805ed60 0x7f55e8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:03.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.808+0000 7f55e2ffd700 1 -- 172.21.15.78:0/1987558660 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f55f0079ca0 con 0x7f55fc153f80 2023-08-17T17:50:03.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.808+0000 7f55faffd700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55e805ed60 0x7f55e8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:03.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.808+0000 7f55faffd700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55e805ed60 0x7f55e8061220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f55ec009fd0 tx=0x7f55ec016000).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:03.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.812+0000 7f55e2ffd700 1 -- 172.21.15.78:0/1987558660 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55f007e070 con 0x7f55fc153f80 2023-08-17T17:50:03.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:03.998+0000 7f55fbfff700 1 -- 172.21.15.78:0/1987558660 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f55fc0c0360 con 0x7f55e805ed60 2023-08-17T17:50:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.000+0000 7f55e2ffd700 1 -- 172.21.15.78:0/1987558660 <== mgr.6522 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f55fc0c0360 con 0x7f55e805ed60 2023-08-17T17:50:04.001 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:50:04.001 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:04.001 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephfs" 2023-08-17T17:50:04.001 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:04.001 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:50:04.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 -- 172.21.15.78:0/1987558660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55e805ed60 msgr2=0x7f55e8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:04.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55e805ed60 0x7f55e8061220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f55ec009fd0 tx=0x7f55ec016000).stop 2023-08-17T17:50:04.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 -- 172.21.15.78:0/1987558660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 msgr2=0x7f55fc0ade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:04.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 0x7f55fc0ade60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f55f000c880 tx=0x7f55f0008040).stop 2023-08-17T17:50:04.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 -- 172.21.15.78:0/1987558660 shutdown_connections 2023-08-17T17:50:04.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55e805ed60 0x7f55e8061220 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:04.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc154360 0x7f55fc1427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:04.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0cb890 0x7f55fc0c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:04.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 --2- 172.21.15.78:0/1987558660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55fc153f80 0x7f55fc0ade60 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:04.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 -- 172.21.15.78:0/1987558660 >> 172.21.15.78:0/1987558660 conn(0x7f55fc06a400 msgr2=0x7f55fc0c5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:04.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 -- 172.21.15.78:0/1987558660 shutdown_connections 2023-08-17T17:50:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.002+0000 7f55fbfff700 1 -- 172.21.15.78:0/1987558660 wait complete. 2023-08-17T17:50:04.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-17T17:50:04.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.128+0000 7fe496cea700 1 Processor -- start 2023-08-17T17:50:04.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.128+0000 7fe496cea700 1 -- start start 2023-08-17T17:50:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.129+0000 7fe496cea700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe4900aa0f0 0x7fe4900644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.129+0000 7fe496cea700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4900aa4d0 0x7fe4900c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.129+0000 7fe496cea700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4900649b0 con 0x7fe4900c5810 2023-08-17T17:50:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.129+0000 7fe496cea700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe490063420 con 0x7fe4900aa4d0 2023-08-17T17:50:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.129+0000 7fe496cea700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe490063700 con 0x7fe4900aa0f0 2023-08-17T17:50:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.129+0000 7fe487fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4900aa4d0 0x7fe4900c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.129+0000 7fe487fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4900aa4d0 0x7fe4900c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52644/0 (socket says 172.21.15.78:52644) 2023-08-17T17:50:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.129+0000 7fe487fff700 1 -- 172.21.15.78:0/3794338803 learned_addr learned my addr 172.21.15.78:0/3794338803 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.129+0000 7fe494a86700 1 --2- 172.21.15.78:0/3794338803 >> v2:172.21.15.150:3300/0 conn(0x7fe4900aa0f0 0x7fe4900644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe487fff700 1 -- 172.21.15.78:0/3794338803 >> v2:172.21.15.150:3300/0 conn(0x7fe4900aa0f0 msgr2=0x7fe4900644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe487fff700 1 --2- 172.21.15.78:0/3794338803 >> v2:172.21.15.150:3300/0 conn(0x7fe4900aa0f0 0x7fe4900644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe487fff700 1 -- 172.21.15.78:0/3794338803 >> v1:172.21.15.150:6789/0 conn(0x7fe4900c5810 legacy=0x7fe4900a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe487fff700 1 -- 172.21.15.78:0/3794338803 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900639e0 con 0x7fe4900aa4d0 2023-08-17T17:50:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe487fff700 1 --2- 172.21.15.78:0/3794338803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa4d0 0x7fe4900c0e10 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7fe4900cade0 tx=0x7fe4800090f0).ready entity=mon.0 client_cookie=7126e1e39ad67292 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe4877fe700 1 -- 172.21.15.78:0/3794338803 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48000b600 con 0x7fe4900aa4d0 2023-08-17T17:50:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe4877fe700 1 -- 172.21.15.78:0/3794338803 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48000b760 con 0x7fe4900aa4d0 2023-08-17T17:50:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe4877fe700 1 -- 172.21.15.78:0/3794338803 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48000bae0 con 0x7fe4900aa4d0 2023-08-17T17:50:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe496cea700 1 -- 172.21.15.78:0/3794338803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa4d0 msgr2=0x7fe4900c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe496cea700 1 --2- 172.21.15.78:0/3794338803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa4d0 0x7fe4900c0e10 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7fe4900cade0 tx=0x7fe4800090f0).stop 2023-08-17T17:50:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe496cea700 1 -- 172.21.15.78:0/3794338803 shutdown_connections 2023-08-17T17:50:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe496cea700 1 --2- 172.21.15.78:0/3794338803 >> v2:172.21.15.150:3300/0 conn(0x7fe4900aa0f0 0x7fe4900644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe496cea700 1 --2- 172.21.15.78:0/3794338803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa4d0 0x7fe4900c0e10 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe496cea700 1 -- 172.21.15.78:0/3794338803 >> 172.21.15.78:0/3794338803 conn(0x7fe49006a6a0 msgr2=0x7fe4900caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe496cea700 1 -- 172.21.15.78:0/3794338803 shutdown_connections 2023-08-17T17:50:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.130+0000 7fe496cea700 1 -- 172.21.15.78:0/3794338803 wait complete. 2023-08-17T17:50:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.131+0000 7fe496cea700 1 Processor -- start 2023-08-17T17:50:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.132+0000 7fe496cea700 1 -- start start 2023-08-17T17:50:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.132+0000 7fe496cea700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa0f0 0x7fe4900ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.132+0000 7fe496cea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4900aa4d0 0x7fe4900b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.132+0000 7fe496cea700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4900c5810 0x7fe4901508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.132+0000 7fe496cea700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4900acc70 con 0x7fe4900aa0f0 2023-08-17T17:50:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.132+0000 7fe496cea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4900c1c60 con 0x7fe4900aa4d0 2023-08-17T17:50:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.132+0000 7fe496cea700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4900c1f40 con 0x7fe4900c5810 2023-08-17T17:50:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe494a86700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa0f0 0x7fe4900ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe494a86700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa0f0 0x7fe4900ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52652/0 (socket says 172.21.15.78:52652) 2023-08-17T17:50:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe494a86700 1 -- 172.21.15.78:0/1908250572 learned_addr learned my addr 172.21.15.78:0/1908250572 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe487fff700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4900aa4d0 0x7fe4900b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe495287700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4900c5810 0x7fe4901508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:04.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe494a86700 1 -- 172.21.15.78:0/1908250572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4900c5810 msgr2=0x7fe4901508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:04.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe494a86700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4900c5810 0x7fe4901508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:04.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe494a86700 1 -- 172.21.15.78:0/1908250572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4900aa4d0 msgr2=0x7fe4900b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:04.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe494a86700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4900aa4d0 0x7fe4900b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:04.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe494a86700 1 -- 172.21.15.78:0/1908250572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480009370 con 0x7fe4900aa0f0 2023-08-17T17:50:04.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe494a86700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa0f0 0x7fe4900ac390 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fe48c00d890 tx=0x7fe48c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:04.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe484ff9700 1 -- 172.21.15.78:0/1908250572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c011590 con 0x7fe4900aa0f0 2023-08-17T17:50:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe484ff9700 1 -- 172.21.15.78:0/1908250572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c0116f0 con 0x7fe4900aa0f0 2023-08-17T17:50:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe496cea700 1 -- 172.21.15.78:0/1908250572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4900c2220 con 0x7fe4900aa0f0 2023-08-17T17:50:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe484ff9700 1 -- 172.21.15.78:0/1908250572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c011a70 con 0x7fe4900aa0f0 2023-08-17T17:50:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.133+0000 7fe496cea700 1 -- 172.21.15.78:0/1908250572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4900aca40 con 0x7fe4900aa0f0 2023-08-17T17:50:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.134+0000 7fe496cea700 1 -- 172.21.15.78:0/1908250572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4900c1ac0 con 0x7fe4900aa0f0 2023-08-17T17:50:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.134+0000 7fe484ff9700 1 -- 172.21.15.78:0/1908250572 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe48c01c460 con 0x7fe4900aa0f0 2023-08-17T17:50:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.135+0000 7fe484ff9700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe47c05ed60 0x7fe47c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.135+0000 7fe484ff9700 1 -- 172.21.15.78:0/1908250572 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe48c079930 con 0x7fe4900aa0f0 2023-08-17T17:50:04.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.135+0000 7fe487fff700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe47c05ed60 0x7fe47c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:04.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.135+0000 7fe487fff700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe47c05ed60 0x7fe47c061220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe4900cade0 tx=0x7fe480017000).ready entity=mgr.6522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:04.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.139+0000 7fe484ff9700 1 -- 172.21.15.78:0/1908250572 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe4900c1ac0 con 0x7fe4900aa0f0 2023-08-17T17:50:04.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:04.346+0000 7fe496cea700 1 -- 172.21.15.78:0/1908250572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe4900c1ac0 con 0x7fe4900aa0f0 2023-08-17T17:50:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.247+0000 7fe484ff9700 1 -- 172.21.15.78:0/1908250572 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 32) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fe48c077830 con 0x7fe4900aa0f0 2023-08-17T17:50:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.249+0000 7fe484ff9700 1 -- 172.21.15.78:0/1908250572 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v32) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe48c0726c0 con 0x7fe4900aa0f0 2023-08-17T17:50:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 -- 172.21.15.78:0/1908250572 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe47c05ed60 msgr2=0x7fe47c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe47c05ed60 0x7fe47c061220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe4900cade0 tx=0x7fe480017000).stop 2023-08-17T17:50:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 -- 172.21.15.78:0/1908250572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa0f0 msgr2=0x7fe4900ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa0f0 0x7fe4900ac390 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fe48c00d890 tx=0x7fe48c008040).stop 2023-08-17T17:50:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 -- 172.21.15.78:0/1908250572 shutdown_connections 2023-08-17T17:50:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe47c05ed60 0x7fe47c061220 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4900c5810 0x7fe4901508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4900aa0f0 0x7fe4900ac390 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 --2- 172.21.15.78:0/1908250572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4900aa4d0 0x7fe4900b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 -- 172.21.15.78:0/1908250572 >> 172.21.15.78:0/1908250572 conn(0x7fe49006a6a0 msgr2=0x7fe4900a9450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 -- 172.21.15.78:0/1908250572 shutdown_connections 2023-08-17T17:50:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.251+0000 7fe496cea700 1 -- 172.21.15.78:0/1908250572 wait complete. 2023-08-17T17:50:05.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-17T17:50:05.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.386+0000 7f1c1170a700 1 Processor -- start 2023-08-17T17:50:05.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.386+0000 7f1c1170a700 1 -- start start 2023-08-17T17:50:05.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.387+0000 7f1c1170a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c0c14e680 0x7f1c0c0c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.387+0000 7f1c1170a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1c0c069a20 0x7f1c0c0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.387+0000 7f1c1170a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c0c5990 con 0x7f1c0c14ea60 2023-08-17T17:50:05.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.387+0000 7f1c1170a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0c0bcc10 con 0x7f1c0c14e680 2023-08-17T17:50:05.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.387+0000 7f1c1170a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0c0c4120 con 0x7f1c0c069a20 2023-08-17T17:50:05.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.387+0000 7f1c0affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c0c14e680 0x7f1c0c0c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:05.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.387+0000 7f1c0affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c0c14e680 0x7f1c0c0c2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52682/0 (socket says 172.21.15.78:52682) 2023-08-17T17:50:05.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.387+0000 7f1c0affd700 1 -- 172.21.15.78:0/3487292076 learned_addr learned my addr 172.21.15.78:0/3487292076 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.388+0000 7f1c0b7fe700 1 --2- 172.21.15.78:0/3487292076 >> v2:172.21.15.150:3300/0 conn(0x7f1c0c069a20 0x7f1c0c0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.388+0000 7f1c0affd700 1 -- 172.21.15.78:0/3487292076 >> v2:172.21.15.150:3300/0 conn(0x7f1c0c069a20 msgr2=0x7f1c0c0c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.388+0000 7f1c0affd700 1 --2- 172.21.15.78:0/3487292076 >> v2:172.21.15.150:3300/0 conn(0x7f1c0c069a20 0x7f1c0c0c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.388+0000 7f1c0affd700 1 -- 172.21.15.78:0/3487292076 >> v1:172.21.15.78:6789/0 conn(0x7f1c0c14ea60 legacy=0x7f1c0c069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.388+0000 7f1c0affd700 1 -- 172.21.15.78:0/3487292076 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0c3880 con 0x7f1c0c14e680 2023-08-17T17:50:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.388+0000 7f1c0affd700 1 --2- 172.21.15.78:0/3487292076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14e680 0x7f1c0c0c2da0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f1c0c0beaa0 tx=0x7f1c0000b3b0).ready entity=mon.0 client_cookie=62bce2033243d3b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.388+0000 7f1c09ffb700 1 -- 172.21.15.78:0/3487292076 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000da40 con 0x7f1c0c14e680 2023-08-17T17:50:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.388+0000 7f1c09ffb700 1 -- 172.21.15.78:0/3487292076 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0000dba0 con 0x7f1c0c14e680 2023-08-17T17:50:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.388+0000 7f1c09ffb700 1 -- 172.21.15.78:0/3487292076 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00010470 con 0x7f1c0c14e680 2023-08-17T17:50:05.392 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:05.390+0000 7f76b9888680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:50:05.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.389+0000 7f1c1170a700 1 -- 172.21.15.78:0/3487292076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14e680 msgr2=0x7f1c0c0c2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.389+0000 7f1c1170a700 1 --2- 172.21.15.78:0/3487292076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14e680 0x7f1c0c0c2da0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f1c0c0beaa0 tx=0x7f1c0000b3b0).stop 2023-08-17T17:50:05.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.389+0000 7f1c1170a700 1 -- 172.21.15.78:0/3487292076 shutdown_connections 2023-08-17T17:50:05.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.389+0000 7f1c1170a700 1 --2- 172.21.15.78:0/3487292076 >> v2:172.21.15.150:3300/0 conn(0x7f1c0c069a20 0x7f1c0c0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.389+0000 7f1c1170a700 1 --2- 172.21.15.78:0/3487292076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14e680 0x7f1c0c0c2da0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.389+0000 7f1c1170a700 1 -- 172.21.15.78:0/3487292076 >> 172.21.15.78:0/3487292076 conn(0x7f1c0c0c7b80 msgr2=0x7f1c0c0c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:05.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.389+0000 7f1c1170a700 1 -- 172.21.15.78:0/3487292076 shutdown_connections 2023-08-17T17:50:05.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.389+0000 7f1c1170a700 1 -- 172.21.15.78:0/3487292076 wait complete. 2023-08-17T17:50:05.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.390+0000 7f1c1170a700 1 Processor -- start 2023-08-17T17:50:05.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.390+0000 7f1c1170a700 1 -- start start 2023-08-17T17:50:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c1170a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c069a20 0x7f1c0c13c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c1170a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c0c14e680 0x7f1c0c1609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c1170a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14ea60 0x7f1c0c0c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c1170a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0ac3f0 con 0x7f1c0c14ea60 2023-08-17T17:50:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c1170a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c160fe0 con 0x7f1c0c069a20 2023-08-17T17:50:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c1170a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c1612c0 con 0x7f1c0c14e680 2023-08-17T17:50:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14ea60 0x7f1c0c0c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14ea60 0x7f1c0c0c0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52698/0 (socket says 172.21.15.78:52698) 2023-08-17T17:50:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0b7fe700 1 -- 172.21.15.78:0/2352980210 learned_addr learned my addr 172.21.15.78:0/2352980210 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0affd700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c069a20 0x7f1c0c13c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0a7fc700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c0c14e680 0x7f1c0c1609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0b7fe700 1 -- 172.21.15.78:0/2352980210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c0c14e680 msgr2=0x7f1c0c1609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0b7fe700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c0c14e680 0x7f1c0c1609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0b7fe700 1 -- 172.21.15.78:0/2352980210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c069a20 msgr2=0x7f1c0c13c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0b7fe700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c069a20 0x7f1c0c13c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0b7fe700 1 -- 172.21.15.78:0/2352980210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0000b610 con 0x7f1c0c14ea60 2023-08-17T17:50:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1c0b7fe700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14ea60 0x7f1c0c0c0a80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f1c04009ef0 tx=0x7f1c0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.391+0000 7f1bf2ffd700 1 -- 172.21.15.78:0/2352980210 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0400cb70 con 0x7f1c0c14ea60 2023-08-17T17:50:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.392+0000 7f1bf2ffd700 1 -- 172.21.15.78:0/2352980210 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0400f040 con 0x7f1c0c14ea60 2023-08-17T17:50:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.392+0000 7f1c1170a700 1 -- 172.21.15.78:0/2352980210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0c1615a0 con 0x7f1c0c14ea60 2023-08-17T17:50:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.392+0000 7f1bf2ffd700 1 -- 172.21.15.78:0/2352980210 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04013400 con 0x7f1c0c14ea60 2023-08-17T17:50:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.392+0000 7f1c1170a700 1 -- 172.21.15.78:0/2352980210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c0c0f70 con 0x7f1c0c14ea60 2023-08-17T17:50:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.392+0000 7f1c1170a700 1 -- 172.21.15.78:0/2352980210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c068270 con 0x7f1c0c14ea60 2023-08-17T17:50:05.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.393+0000 7f1bf2ffd700 1 -- 172.21.15.78:0/2352980210 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 32) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f1c040137b0 con 0x7f1c0c14ea60 2023-08-17T17:50:05.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.393+0000 7f1bf2ffd700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1bf805ede0 0x7f1bf80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.393+0000 7f1c0affd700 1 -- 172.21.15.78:0/2352980210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1bf805ede0 msgr2=0x7f1bf80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.394+0000 7f1bf2ffd700 1 -- 172.21.15.78:0/2352980210 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1c0407a500 con 0x7f1c0c14ea60 2023-08-17T17:50:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.394+0000 7f1c0affd700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1bf805ede0 0x7f1bf80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:05.400 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:05.394+0000 7f33329ea680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:50:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.398+0000 7f1bf2ffd700 1 -- 172.21.15.78:0/2352980210 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1c0404baa0 con 0x7f1c0c14ea60 2023-08-17T17:50:05.455 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:05.454+0000 7f76b9888680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:50:05.460 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:05.459+0000 7f33329ea680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:50:05.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.573+0000 7f1c1170a700 1 -- 172.21.15.78:0/2352980210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f1c0c069800 con 0x7f1c0c14ea60 2023-08-17T17:50:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.576+0000 7f1bf2ffd700 1 -- 172.21.15.78:0/2352980210 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v15)=0 v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1c0404f0c0 con 0x7f1c0c14ea60 2023-08-17T17:50:05.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 -- 172.21.15.78:0/2352980210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1bf805ede0 msgr2=0x7f1bf80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1bf805ede0 0x7f1bf80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 -- 172.21.15.78:0/2352980210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14ea60 msgr2=0x7f1c0c0c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14ea60 0x7f1c0c0c0a80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f1c04009ef0 tx=0x7f1c0400b040).stop 2023-08-17T17:50:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 -- 172.21.15.78:0/2352980210 shutdown_connections 2023-08-17T17:50:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1bf805ede0 0x7f1bf80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c0c14ea60 0x7f1c0c0c0a80 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c069a20 0x7f1c0c13c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 --2- 172.21.15.78:0/2352980210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c0c14e680 0x7f1c0c1609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 -- 172.21.15.78:0/2352980210 >> 172.21.15.78:0/2352980210 conn(0x7f1c0c0c7b80 msgr2=0x7f1c0c0c6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 -- 172.21.15.78:0/2352980210 shutdown_connections 2023-08-17T17:50:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.578+0000 7f1c1170a700 1 -- 172.21.15.78:0/2352980210 wait complete. 2023-08-17T17:50:05.592 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-17T17:50:05.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.710+0000 7ff1f9038700 1 Processor -- start 2023-08-17T17:50:05.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.710+0000 7ff1f9038700 1 -- start start 2023-08-17T17:50:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.711+0000 7ff1f9038700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f4138410 0x7ff1f41387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.711+0000 7ff1f9038700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f40beb60 con 0x7ff1f40a7780 2023-08-17T17:50:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.711+0000 7ff1f9038700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f4065630 con 0x7ff1f40c86c0 2023-08-17T17:50:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.711+0000 7ff1f9038700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40bcbd0 con 0x7ff1f4138410 2023-08-17T17:50:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.711+0000 7ff1f359e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff1f40a7780 0x7ff1f40624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48738/0 (socket says 172.21.15.78:48738) 2023-08-17T17:50:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.711+0000 7ff1f359e700 1 -- 172.21.15.78:0/4005976434 learned_addr learned my addr 172.21.15.78:0/4005976434 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f2d9d700 1 --2- 172.21.15.78:0/4005976434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f4138410 0x7ff1f41387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f1d9b700 1 -- 172.21.15.78:0/4005976434 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170878558 0 0) 0x7ff1f40beb60 con 0x7ff1f40a7780 2023-08-17T17:50:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f1d9b700 1 -- 172.21.15.78:0/4005976434 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1dc0033f0 con 0x7ff1f40a7780 2023-08-17T17:50:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f1d9b700 1 -- 172.21.15.78:0/4005976434 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183690963 0 0) 0x7ff1f4065630 con 0x7ff1f40c86c0 2023-08-17T17:50:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f1d9b700 1 -- 172.21.15.78:0/4005976434 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f40beb60 con 0x7ff1f40c86c0 2023-08-17T17:50:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f2d9d700 1 -- 172.21.15.78:0/4005976434 >> v1:172.21.15.150:6789/0 conn(0x7ff1f40c86c0 legacy=0x7ff1f41564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f2d9d700 1 -- 172.21.15.78:0/4005976434 >> v1:172.21.15.78:6789/0 conn(0x7ff1f40a7780 legacy=0x7ff1f40624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f2d9d700 1 -- 172.21.15.78:0/4005976434 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40bceb0 con 0x7ff1f4138410 2023-08-17T17:50:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f2d9d700 1 --2- 172.21.15.78:0/4005976434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f4138410 0x7ff1f41387f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff1e8009790 tx=0x7ff1e8009060).ready entity=mon.2 client_cookie=8924e10803d27c88 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:05.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f1d9b700 1 -- 172.21.15.78:0/4005976434 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e800f510 con 0x7ff1f4138410 2023-08-17T17:50:05.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f1d9b700 1 -- 172.21.15.78:0/4005976434 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e800f670 con 0x7ff1f4138410 2023-08-17T17:50:05.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.712+0000 7ff1f1d9b700 1 -- 172.21.15.78:0/4005976434 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e800f9f0 con 0x7ff1f4138410 2023-08-17T17:50:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.713+0000 7ff1f9038700 1 -- 172.21.15.78:0/4005976434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f4138410 msgr2=0x7ff1f41387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.713+0000 7ff1f9038700 1 --2- 172.21.15.78:0/4005976434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f4138410 0x7ff1f41387f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff1e8009790 tx=0x7ff1e8009060).stop 2023-08-17T17:50:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.713+0000 7ff1f9038700 1 -- 172.21.15.78:0/4005976434 shutdown_connections 2023-08-17T17:50:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.713+0000 7ff1f9038700 1 --2- 172.21.15.78:0/4005976434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f4138410 0x7ff1f41387f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.713+0000 7ff1f9038700 1 -- 172.21.15.78:0/4005976434 >> 172.21.15.78:0/4005976434 conn(0x7ff1f40c7bd0 msgr2=0x7ff1f40c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.713+0000 7ff1f9038700 1 -- 172.21.15.78:0/4005976434 shutdown_connections 2023-08-17T17:50:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.713+0000 7ff1f9038700 1 -- 172.21.15.78:0/4005976434 wait complete. 2023-08-17T17:50:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.714+0000 7ff1f9038700 1 Processor -- start 2023-08-17T17:50:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.714+0000 7ff1f9038700 1 -- start start 2023-08-17T17:50:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f9038700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f40a7780 0x7ff1f413a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f9038700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f40c86c0 0x7ff1f41398d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f9038700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1f4138410 0x7ff1f4151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f9038700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f413a740 con 0x7ff1f40c86c0 2023-08-17T17:50:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f9038700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f413b560 con 0x7ff1f4138410 2023-08-17T17:50:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f9038700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f4139dc0 con 0x7ff1f40a7780 2023-08-17T17:50:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f40c86c0 0x7ff1f41398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f40c86c0 0x7ff1f41398d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52708/0 (socket says 172.21.15.78:52708) 2023-08-17T17:50:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f259c700 1 -- 172.21.15.78:0/2208891174 learned_addr learned my addr 172.21.15.78:0/2208891174 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f2d9d700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f40a7780 0x7ff1f413a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f259c700 1 -- 172.21.15.78:0/2208891174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f40a7780 msgr2=0x7ff1f413a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f259c700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1f40a7780 0x7ff1f413a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f259c700 1 -- 172.21.15.78:0/2208891174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1f4138410 msgr2=0x7ff1f4151790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-17T17:50:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f259c700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1f4138410 0x7ff1f4151790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.715+0000 7ff1f259c700 1 -- 172.21.15.78:0/2208891174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e80092a0 con 0x7ff1f40c86c0 2023-08-17T17:50:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.716+0000 7ff1f259c700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1f40c86c0 0x7ff1f41398d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7ff1e400c4c0 tx=0x7ff1e4007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.716+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400f470 con 0x7ff1f40c86c0 2023-08-17T17:50:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.716+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e400f5d0 con 0x7ff1f40c86c0 2023-08-17T17:50:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.716+0000 7ff1f9038700 1 -- 172.21.15.78:0/2208891174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f413a950 con 0x7ff1f40c86c0 2023-08-17T17:50:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.716+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400f970 con 0x7ff1f40c86c0 2023-08-17T17:50:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.716+0000 7ff1f9038700 1 -- 172.21.15.78:0/2208891174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f413af90 con 0x7ff1f40c86c0 2023-08-17T17:50:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.717+0000 7ff1f9038700 1 -- 172.21.15.78:0/2208891174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f40c57d0 con 0x7ff1f40c86c0 2023-08-17T17:50:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.717+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 32) v1 ==== 75259+0+0 (secure 0 0 0) 0x7ff1e4019030 con 0x7ff1f40c86c0 2023-08-17T17:50:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.717+0000 7ff1daffd700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 0x7ff1e00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.717+0000 7ff1f2d9d700 1 -- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 msgr2=0x7ff1e00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.717+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff1e4079050 con 0x7ff1f40c86c0 2023-08-17T17:50:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.717+0000 7ff1f2d9d700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 0x7ff1e00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:05.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.724+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff1e404a5f0 con 0x7ff1f40c86c0 2023-08-17T17:50:05.729 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:05.728+0000 7f76b9888680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:50:05.747 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:05.746+0000 7f33329ea680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:50:05.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.916+0000 7ff1f9038700 1 -- 172.21.15.78:0/2208891174 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1f413b2b0 con 0x7ff1e005ede0 2023-08-17T17:50:05.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.918+0000 7ff1f2d9d700 1 -- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 msgr2=0x7ff1e00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:05.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:05.918+0000 7ff1f2d9d700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 0x7ff1e00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:50:06.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:06.319+0000 7ff1f2d9d700 1 -- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 msgr2=0x7ff1e00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:06.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:06.319+0000 7ff1f2d9d700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 0x7ff1e00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T17:50:06.345 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:06.340+0000 7f76b9888680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:50:06.360 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:06.359+0000 7f33329ea680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:50:06.412 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:06.411+0000 7f76b9888680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:50:06.432 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:06.431+0000 7f33329ea680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:50:06.599 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:06.598+0000 7f76b9888680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:50:06.618 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:06.617+0000 7f33329ea680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:50:07.016 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:07.016+0000 7f76b9888680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:50:07.032 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:07.031+0000 7f33329ea680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:50:07.119 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:07.119+0000 7f76b9888680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:07.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:07.120+0000 7ff1f2d9d700 1 -- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 msgr2=0x7ff1e00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:07.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:07.120+0000 7ff1f2d9d700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 0x7ff1e00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T17:50:07.135 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:07.134+0000 7f33329ea680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:07.272 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:07.271+0000 7f76b9888680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:07.287 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:07.286+0000 7f33329ea680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:07.346 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:07.345+0000 7f76b9888680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:50:07.361 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:07.360+0000 7f33329ea680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:50:07.415 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:07.415+0000 7f76b9888680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:50:07.428 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:07.427+0000 7f33329ea680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:50:07.672 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:07.671+0000 7f76b9888680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:50:07.685 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:07.684+0000 7f33329ea680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:50:07.857 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:07.856+0000 7f76b9888680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:07.881 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:07.879+0000 7f33329ea680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:08.506 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:08.505+0000 7f76b9888680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:50:08.526 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:08.525+0000 7f33329ea680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:50:08.572 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:08.572+0000 7f76b9888680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:50:08.594 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:08.593+0000 7f33329ea680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:50:08.648 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:08.648+0000 7f76b9888680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:50:08.671 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:08.669+0000 7f33329ea680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:50:08.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:08.721+0000 7ff1f2d9d700 1 -- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 msgr2=0x7ff1e00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:08.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:08.721+0000 7ff1f2d9d700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 0x7ff1e00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-17T17:50:08.793 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:08.792+0000 7f76b9888680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:50:08.817 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:08.816+0000 7f33329ea680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:50:08.863 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:08.862+0000 7f76b9888680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:50:08.888 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:08.887+0000 7f33329ea680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:50:08.977 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:08.976+0000 7f76b9888680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:50:09.002 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.001+0000 7f33329ea680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:50:09.084 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:09.084+0000 7f76b9888680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:09.109 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.108+0000 7f33329ea680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:09.377 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:09.376+0000 7f76b9888680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:50:09.396 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.395+0000 7f33329ea680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:50:09.447 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:09.446+0000 7f76b9888680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:50:09.467 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.466+0000 7f33329ea680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:50:09.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:09.485+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 33) v1 ==== 75109+0+0 (secure 0 0 0) 0x7ff1e4010070 con 0x7ff1f40c86c0 2023-08-17T17:50:09.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:09.486+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 msgr2=0x7ff1e00612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:09.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:09.486+0000 7ff1daffd700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 0x7ff1e00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:09.553 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.552+0000 7f32ae1c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:09.553 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.552+0000 7f32ae1c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:09.553 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.552+0000 7f32ae1c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:09.553 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.552+0000 7f32ae1c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:09.554 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.552+0000 7f32ae1c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:09.554 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.552+0000 7f32b11c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:09.554 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.552+0000 7f32b11c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:09.554 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.552+0000 7f32b11c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:09.554 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.552+0000 7f32b11c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:09.554 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:09.552+0000 7f32b11c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:10.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.489+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mgrmap(e 34) v1 ==== 75179+0+0 (secure 0 0 0) 0x7ff1e400fd20 con 0x7ff1f40c86c0 2023-08-17T17:50:10.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.489+0000 7ff1daffd700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 0x7ff1e002fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:10.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.489+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1f413b2b0 con 0x7ff1e005ede0 2023-08-17T17:50:10.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.489+0000 7ff1f2d9d700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 0x7ff1e002fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:10.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.490+0000 7ff1f2d9d700 1 --2- 172.21.15.78:0/2208891174 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff1e005ede0 0x7ff1e002fd40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff1e8009fd0 tx=0x7ff1e8017000).ready entity=mgr.6930 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:10.493 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:10.492+0000 7f32e0471700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-17T17:50:10.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.493+0000 7ff1daffd700 1 -- 172.21.15.78:0/2208891174 <== mgr.6930 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7ff1f413b2b0 con 0x7ff1e005ede0 2023-08-17T17:50:10.495 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-17T17:50:10.499 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-17T17:50:10.500 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-17T17:50:10.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.615+0000 7f9c4a8c4700 1 Processor -- start 2023-08-17T17:50:10.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.615+0000 7f9c4a8c4700 1 -- start start 2023-08-17T17:50:10.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c4a8c4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9c440aa0f0 0x7f9c440644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:10.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c4a8c4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9c440c5810 0x7f9c440c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:10.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c4a8c4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c440649b0 con 0x7f9c440aa4d0 2023-08-17T17:50:10.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c4a8c4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c440c6170 con 0x7f9c440aa0f0 2023-08-17T17:50:10.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c4a8c4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c44063420 con 0x7f9c440c5810 2023-08-17T17:50:10.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c43fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9c440aa0f0 0x7f9c440644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:10.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c3bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9c440aa4d0 0x7f9c440c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51324/0 (socket says 172.21.15.78:51324) 2023-08-17T17:50:10.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c3bfff700 1 -- 172.21.15.78:0/490075443 learned_addr learned my addr 172.21.15.78:0/490075443 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:10.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c48e61700 1 --2- 172.21.15.78:0/490075443 >> v2:172.21.15.150:3300/0 conn(0x7f9c440c5810 0x7f9c440c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:10.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c43fff700 1 -- 172.21.15.78:0/490075443 >> v2:172.21.15.150:3300/0 conn(0x7f9c440c5810 msgr2=0x7f9c440c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:10.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c43fff700 1 --2- 172.21.15.78:0/490075443 >> v2:172.21.15.150:3300/0 conn(0x7f9c440c5810 0x7f9c440c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:10.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c43fff700 1 -- 172.21.15.78:0/490075443 >> v1:172.21.15.78:6789/0 conn(0x7f9c440aa4d0 legacy=0x7f9c440c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:10.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c43fff700 1 -- 172.21.15.78:0/490075443 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44063700 con 0x7f9c440aa0f0 2023-08-17T17:50:10.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c437fe700 1 -- 172.21.15.78:0/490075443 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212774434 0 0) 0x7f9c440649b0 con 0x7f9c440aa4d0 2023-08-17T17:50:10.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c43fff700 1 --2- 172.21.15.78:0/490075443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440aa0f0 0x7f9c440644c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f9c44159090 tx=0x7f9c34009060).ready entity=mon.0 client_cookie=d373301d90ee6a69 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:10.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c437fe700 1 -- 172.21.15.78:0/490075443 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400b580 con 0x7f9c440aa0f0 2023-08-17T17:50:10.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c437fe700 1 -- 172.21.15.78:0/490075443 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3400b6e0 con 0x7f9c440aa0f0 2023-08-17T17:50:10.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.616+0000 7f9c437fe700 1 -- 172.21.15.78:0/490075443 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400ba60 con 0x7f9c440aa0f0 2023-08-17T17:50:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.617+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/490075443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440aa0f0 msgr2=0x7f9c440644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.617+0000 7f9c4a8c4700 1 --2- 172.21.15.78:0/490075443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440aa0f0 0x7f9c440644c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f9c44159090 tx=0x7f9c34009060).stop 2023-08-17T17:50:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.617+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/490075443 shutdown_connections 2023-08-17T17:50:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.617+0000 7f9c4a8c4700 1 --2- 172.21.15.78:0/490075443 >> v2:172.21.15.150:3300/0 conn(0x7f9c440c5810 0x7f9c440c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.617+0000 7f9c4a8c4700 1 --2- 172.21.15.78:0/490075443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440aa0f0 0x7f9c440644c0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.617+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/490075443 >> 172.21.15.78:0/490075443 conn(0x7f9c4406a6a0 msgr2=0x7f9c440caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.617+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/490075443 shutdown_connections 2023-08-17T17:50:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.617+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/490075443 wait complete. 2023-08-17T17:50:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.618+0000 7f9c4a8c4700 1 Processor -- start 2023-08-17T17:50:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.618+0000 7f9c4a8c4700 1 -- start start 2023-08-17T17:50:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c4a8c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c440aa0f0 0x7f9c44165c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c4a8c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c440aa4d0 0x7f9c440c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:10.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c4a8c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440c5810 0x7f9c441675c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:10.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c4a8c4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44166180 con 0x7f9c440c5810 2023-08-17T17:50:10.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c4a8c4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c440c4c50 con 0x7f9c440aa4d0 2023-08-17T17:50:10.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c4a8c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c440ae570 con 0x7f9c440aa0f0 2023-08-17T17:50:10.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c48e61700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440c5810 0x7f9c441675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:10.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c48e61700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440c5810 0x7f9c441675c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38186/0 (socket says 172.21.15.78:38186) 2023-08-17T17:50:10.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c48e61700 1 -- 172.21.15.78:0/970309184 learned_addr learned my addr 172.21.15.78:0/970309184 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:10.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c3bfff700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c440aa4d0 0x7f9c440c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:10.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c43fff700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c440aa0f0 0x7f9c44165c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:10.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c48e61700 1 -- 172.21.15.78:0/970309184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c440aa0f0 msgr2=0x7f9c44165c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:10.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c48e61700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c440aa0f0 0x7f9c44165c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:10.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c48e61700 1 -- 172.21.15.78:0/970309184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c440aa4d0 msgr2=0x7f9c440c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:10.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c48e61700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c440aa4d0 0x7f9c440c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:10.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c48e61700 1 -- 172.21.15.78:0/970309184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340092a0 con 0x7f9c440c5810 2023-08-17T17:50:10.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.619+0000 7f9c48e61700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440c5810 0x7f9c441675c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f9c3c007f20 tx=0x7f9c3c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.620+0000 7f9c40ff9700 1 -- 172.21.15.78:0/970309184 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00eb90 con 0x7f9c440c5810 2023-08-17T17:50:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.620+0000 7f9c40ff9700 1 -- 172.21.15.78:0/970309184 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c00ecf0 con 0x7f9c440c5810 2023-08-17T17:50:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.620+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/970309184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c440ae850 con 0x7f9c440c5810 2023-08-17T17:50:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.620+0000 7f9c40ff9700 1 -- 172.21.15.78:0/970309184 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c014610 con 0x7f9c440c5810 2023-08-17T17:50:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.620+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/970309184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c440aee10 con 0x7f9c440c5810 2023-08-17T17:50:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.620+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/970309184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c440af030 con 0x7f9c440c5810 2023-08-17T17:50:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.621+0000 7f9c40ff9700 1 -- 172.21.15.78:0/970309184 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f9c3c01b030 con 0x7f9c440c5810 2023-08-17T17:50:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.621+0000 7f9c40ff9700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9c2405ed40 0x7f9c24061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.621+0000 7f9c40ff9700 1 -- 172.21.15.78:0/970309184 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9c3c079e00 con 0x7f9c440c5810 2023-08-17T17:50:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.621+0000 7f9c43fff700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9c2405ed40 0x7f9c24061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.622+0000 7f9c43fff700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9c2405ed40 0x7f9c24061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9c34009fd0 tx=0x7f9c34017000).ready entity=mgr.6930 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.626+0000 7f9c40ff9700 1 -- 172.21.15.78:0/970309184 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c3c04b390 con 0x7f9c440c5810 2023-08-17T17:50:10.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:10.829+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/970309184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f9c44046af0 con 0x7f9c440c5810 2023-08-17T17:50:11.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.524+0000 7f9c40ff9700 1 -- 172.21.15.78:0/970309184 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f9c3c012070 con 0x7f9c440c5810 2023-08-17T17:50:11.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.525+0000 7f9c40ff9700 1 -- 172.21.15.78:0/970309184 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9c3c072680 con 0x7f9c440c5810 2023-08-17T17:50:11.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/970309184 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9c2405ed40 msgr2=0x7f9c24061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:11.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9c2405ed40 0x7f9c24061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9c34009fd0 tx=0x7f9c34017000).stop 2023-08-17T17:50:11.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/970309184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440c5810 msgr2=0x7f9c441675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:11.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440c5810 0x7f9c441675c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f9c3c007f20 tx=0x7f9c3c009860).stop 2023-08-17T17:50:11.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/970309184 shutdown_connections 2023-08-17T17:50:11.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9c2405ed40 0x7f9c24061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:11.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c440c5810 0x7f9c441675c0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:11.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c440aa0f0 0x7f9c44165c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:11.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 --2- 172.21.15.78:0/970309184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c440aa4d0 0x7f9c440c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:11.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/970309184 >> 172.21.15.78:0/970309184 conn(0x7f9c4406a6a0 msgr2=0x7f9c440a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:11.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/970309184 shutdown_connections 2023-08-17T17:50:11.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.528+0000 7f9c4a8c4700 1 -- 172.21.15.78:0/970309184 wait complete. 2023-08-17T17:50:11.546 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:50:11.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:50:11.592 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:50:11.631 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:50:11.631 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T17:50:11.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:50:11.632 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T17:50:11.668 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:11.668+0000 7f955cc9f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:50:11.670 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:50:11.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:11.670 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T17:50:11.676 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:11.675+0000 7f2884fd0680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:50:11.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:50:11.731 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:11.730+0000 7f955cc9f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:50:11.742 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:11.741+0000 7f2884fd0680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:50:11.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.846+0000 7fc963deb700 1 Processor -- start 2023-08-17T17:50:11.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.846+0000 7fc963deb700 1 -- start start 2023-08-17T17:50:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc963deb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc95c0650a0 0x7fc95c1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc963deb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc95c0c1a00 0x7fc95c0c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc963deb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c0c23a0 con 0x7fc95c154240 2023-08-17T17:50:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc963deb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95c0699f0 con 0x7fc95c0650a0 2023-08-17T17:50:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc963deb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95c151be0 con 0x7fc95c0c1a00 2023-08-17T17:50:11.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc961b87700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc95c0650a0 0x7fc95c1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:11.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc961b87700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc95c0650a0 0x7fc95c1516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38216/0 (socket says 172.21.15.78:38216) 2023-08-17T17:50:11.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc961b87700 1 -- 172.21.15.78:0/4240457321 learned_addr learned my addr 172.21.15.78:0/4240457321 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:11.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc961386700 1 --2- 172.21.15.78:0/4240457321 >> v2:172.21.15.150:3300/0 conn(0x7fc95c0c1a00 0x7fc95c0c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:11.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc961b87700 1 -- 172.21.15.78:0/4240457321 >> v2:172.21.15.150:3300/0 conn(0x7fc95c0c1a00 msgr2=0x7fc95c0c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:11.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc961b87700 1 --2- 172.21.15.78:0/4240457321 >> v2:172.21.15.150:3300/0 conn(0x7fc95c0c1a00 0x7fc95c0c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:11.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc961b87700 1 -- 172.21.15.78:0/4240457321 >> v1:172.21.15.150:6789/0 conn(0x7fc95c154240 legacy=0x7fc95c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:11.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.847+0000 7fc961b87700 1 -- 172.21.15.78:0/4240457321 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c068950 con 0x7fc95c0650a0 2023-08-17T17:50:11.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc961b87700 1 --2- 172.21.15.78:0/4240457321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0650a0 0x7fc95c1516f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fc95c067af0 tx=0x7fc94c0090f0).ready entity=mon.0 client_cookie=5e631abaff54d278 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:11.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc960b85700 1 -- 172.21.15.78:0/4240457321 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c00b520 con 0x7fc95c0650a0 2023-08-17T17:50:11.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc960b85700 1 -- 172.21.15.78:0/4240457321 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c00b680 con 0x7fc95c0650a0 2023-08-17T17:50:11.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc960b85700 1 -- 172.21.15.78:0/4240457321 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c00ba00 con 0x7fc95c0650a0 2023-08-17T17:50:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc963deb700 1 -- 172.21.15.78:0/4240457321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0650a0 msgr2=0x7fc95c1516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc963deb700 1 --2- 172.21.15.78:0/4240457321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0650a0 0x7fc95c1516f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fc95c067af0 tx=0x7fc94c0090f0).stop 2023-08-17T17:50:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc963deb700 1 -- 172.21.15.78:0/4240457321 shutdown_connections 2023-08-17T17:50:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc963deb700 1 --2- 172.21.15.78:0/4240457321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0650a0 0x7fc95c1516f0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:11.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc963deb700 1 --2- 172.21.15.78:0/4240457321 >> v2:172.21.15.150:3300/0 conn(0x7fc95c0c1a00 0x7fc95c0c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:11.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc963deb700 1 -- 172.21.15.78:0/4240457321 >> 172.21.15.78:0/4240457321 conn(0x7fc95c062fc0 msgr2=0x7fc95c0c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:11.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc963deb700 1 -- 172.21.15.78:0/4240457321 shutdown_connections 2023-08-17T17:50:11.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.848+0000 7fc963deb700 1 -- 172.21.15.78:0/4240457321 wait complete. 2023-08-17T17:50:11.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.849+0000 7fc963deb700 1 Processor -- start 2023-08-17T17:50:11.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc963deb700 1 -- start start 2023-08-17T17:50:11.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc963deb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c0650a0 0x7fc95c149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc963deb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0c1a00 0x7fc95c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc963deb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c154240 0x7fc95c0c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc963deb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c154ed0 con 0x7fc95c0c1a00 2023-08-17T17:50:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc963deb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0be560 con 0x7fc95c154240 2023-08-17T17:50:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc963deb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0bdc30 con 0x7fc95c0650a0 2023-08-17T17:50:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc961386700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0c1a00 0x7fc95c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc961386700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0c1a00 0x7fc95c154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38230/0 (socket says 172.21.15.78:38230) 2023-08-17T17:50:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc961386700 1 -- 172.21.15.78:0/2752793806 learned_addr learned my addr 172.21.15.78:0/2752793806 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc962388700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c154240 0x7fc95c0c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.850+0000 7fc961b87700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c0650a0 0x7fc95c149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc961386700 1 -- 172.21.15.78:0/2752793806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c0650a0 msgr2=0x7fc95c149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc961386700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c0650a0 0x7fc95c149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc961386700 1 -- 172.21.15.78:0/2752793806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c154240 msgr2=0x7fc95c0c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc961386700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c154240 0x7fc95c0c0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc961386700 1 -- 172.21.15.78:0/2752793806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c009370 con 0x7fc95c0c1a00 2023-08-17T17:50:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc961386700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0c1a00 0x7fc95c154680 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fc95800e980 tx=0x7fc958009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc951ffb700 1 -- 172.21.15.78:0/2752793806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958012600 con 0x7fc95c0c1a00 2023-08-17T17:50:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc951ffb700 1 -- 172.21.15.78:0/2752793806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958012760 con 0x7fc95c0c1a00 2023-08-17T17:50:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc951ffb700 1 -- 172.21.15.78:0/2752793806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958012ae0 con 0x7fc95c0c1a00 2023-08-17T17:50:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc963deb700 1 -- 172.21.15.78:0/2752793806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c0bdf10 con 0x7fc95c0c1a00 2023-08-17T17:50:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.851+0000 7fc963deb700 1 -- 172.21.15.78:0/2752793806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c149900 con 0x7fc95c0c1a00 2023-08-17T17:50:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.852+0000 7fc963deb700 1 -- 172.21.15.78:0/2752793806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c047350 con 0x7fc95c0c1a00 2023-08-17T17:50:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.852+0000 7fc951ffb700 1 -- 172.21.15.78:0/2752793806 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc958022070 con 0x7fc95c0c1a00 2023-08-17T17:50:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.853+0000 7fc951ffb700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc94005ede0 0x7fc9400612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.853+0000 7fc961b87700 1 -- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc94005ede0 msgr2=0x7fc9400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.853+0000 7fc951ffb700 1 -- 172.21.15.78:0/2752793806 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc95807a010 con 0x7fc95c0c1a00 2023-08-17T17:50:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.853+0000 7fc961b87700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc94005ede0 0x7fc9400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:11.857+0000 7fc951ffb700 1 -- 172.21.15.78:0/2752793806 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc95804b430 con 0x7fc95c0c1a00 2023-08-17T17:50:12.003 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:12.003+0000 7f955cc9f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:50:12.026 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:12.026+0000 7f2884fd0680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:50:12.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.054+0000 7fc961b87700 1 -- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc94005ede0 msgr2=0x7fc9400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:12.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.054+0000 7fc961b87700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc94005ede0 0x7fc9400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:50:12.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.066+0000 7fc963deb700 1 -- 172.21.15.78:0/2752793806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc95c0be6a0 con 0x7fc95c0c1a00 2023-08-17T17:50:12.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.067+0000 7fc951ffb700 1 -- 172.21.15.78:0/2752793806 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc958016020 con 0x7fc95c0c1a00 2023-08-17T17:50:12.067 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:12.067 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3356030675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3356030675},{"type":"v1","addr":"172.21.15.150:6835","nonce":3356030675}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/807522916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":807522916},{"type":"v1","addr":"172.21.15.78:6837","nonce":807522916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3165905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3165905348},{"type":"v1","addr":"172.21.15.150:6834","nonce":3165905348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:53.608560+0000","modified":"2023-08-17T17:49:55.616581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/4042380652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4042380652},{"type":"v1","addr":"172.21.15.78:6836","nonce":4042380652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T17:50:12.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.068+0000 7fc963deb700 1 -- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc94005ede0 msgr2=0x7fc9400612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:12.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc94005ede0 0x7fc9400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:12.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 -- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0c1a00 msgr2=0x7fc95c154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0c1a00 0x7fc95c154680 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fc95800e980 tx=0x7fc958009060).stop 2023-08-17T17:50:12.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 -- 172.21.15.78:0/2752793806 shutdown_connections 2023-08-17T17:50:12.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc94005ede0 0x7fc9400612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:12.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c154240 0x7fc95c0c0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c0650a0 0x7fc95c149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 --2- 172.21.15.78:0/2752793806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95c0c1a00 0x7fc95c154680 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 -- 172.21.15.78:0/2752793806 >> 172.21.15.78:0/2752793806 conn(0x7fc95c062fc0 msgr2=0x7fc95c0c4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:12.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 -- 172.21.15.78:0/2752793806 shutdown_connections 2023-08-17T17:50:12.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.069+0000 7fc963deb700 1 -- 172.21.15.78:0/2752793806 wait complete. 2023-08-17T17:50:12.071 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 31 2023-08-17T17:50:12.081 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:50:12.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.235+0000 7f313a8c4700 1 Processor -- start 2023-08-17T17:50:12.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.235+0000 7f313a8c4700 1 -- start start 2023-08-17T17:50:12.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.236+0000 7f313a8c4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31340a7fe0 0x7f3134064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.236+0000 7f313a8c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3134065140 0x7f31340c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.236+0000 7f313a8c4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31340c4040 con 0x7f31340be7f0 2023-08-17T17:50:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.236+0000 7f313a8c4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31340c7080 con 0x7f31340a7fe0 2023-08-17T17:50:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.236+0000 7f313a8c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31340c3430 con 0x7f3134065140 2023-08-17T17:50:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.236+0000 7f3138e61700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f31340be7f0 0x7f31340c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51326/0 (socket says 172.21.15.78:51326) 2023-08-17T17:50:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.236+0000 7f3138e61700 1 -- 172.21.15.78:0/3314164048 learned_addr learned my addr 172.21.15.78:0/3314164048 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3133fff700 1 --2- 172.21.15.78:0/3314164048 >> v2:172.21.15.150:3300/0 conn(0x7f31340a7fe0 0x7f3134064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f31337fe700 1 --2- 172.21.15.78:0/3314164048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3134065140 0x7f31340c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3132ffd700 1 -- 172.21.15.78:0/3314164048 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098486855 0 0) 0x7f31340c4040 con 0x7f31340be7f0 2023-08-17T17:50:12.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3132ffd700 1 -- 172.21.15.78:0/3314164048 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f311c0033f0 con 0x7f31340be7f0 2023-08-17T17:50:12.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3133fff700 1 -- 172.21.15.78:0/3314164048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3134065140 msgr2=0x7f31340c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:12.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3133fff700 1 --2- 172.21.15.78:0/3314164048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3134065140 0x7f31340c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3133fff700 1 -- 172.21.15.78:0/3314164048 >> v1:172.21.15.78:6789/0 conn(0x7f31340be7f0 legacy=0x7f31340c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3133fff700 1 -- 172.21.15.78:0/3314164048 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31340c3710 con 0x7f31340a7fe0 2023-08-17T17:50:12.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f31337fe700 1 --2- 172.21.15.78:0/3314164048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3134065140 0x7f31340c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:50:12.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3133fff700 1 --2- 172.21.15.78:0/3314164048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31340a7fe0 0x7f3134064180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f3128009760 tx=0x7f3128009060).ready entity=mon.1 client_cookie=4f2c5f17977ddb1a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:12.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3132ffd700 1 -- 172.21.15.78:0/3314164048 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312800d4a0 con 0x7f31340a7fe0 2023-08-17T17:50:12.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3132ffd700 1 -- 172.21.15.78:0/3314164048 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312800d600 con 0x7f31340a7fe0 2023-08-17T17:50:12.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.237+0000 7f3132ffd700 1 -- 172.21.15.78:0/3314164048 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312800d980 con 0x7f31340a7fe0 2023-08-17T17:50:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.238+0000 7f313a8c4700 1 -- 172.21.15.78:0/3314164048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31340a7fe0 msgr2=0x7f3134064180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.238+0000 7f313a8c4700 1 --2- 172.21.15.78:0/3314164048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31340a7fe0 0x7f3134064180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f3128009760 tx=0x7f3128009060).stop 2023-08-17T17:50:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.238+0000 7f313a8c4700 1 -- 172.21.15.78:0/3314164048 shutdown_connections 2023-08-17T17:50:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.238+0000 7f313a8c4700 1 --2- 172.21.15.78:0/3314164048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31340a7fe0 0x7f3134064180 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.238+0000 7f313a8c4700 1 --2- 172.21.15.78:0/3314164048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3134065140 0x7f31340c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.238+0000 7f313a8c4700 1 -- 172.21.15.78:0/3314164048 >> 172.21.15.78:0/3314164048 conn(0x7f3134092330 msgr2=0x7f3134062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:12.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.238+0000 7f313a8c4700 1 -- 172.21.15.78:0/3314164048 shutdown_connections 2023-08-17T17:50:12.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.238+0000 7f313a8c4700 1 -- 172.21.15.78:0/3314164048 wait complete. 2023-08-17T17:50:12.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.239+0000 7f313a8c4700 1 Processor -- start 2023-08-17T17:50:12.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.239+0000 7f313a8c4700 1 -- start start 2023-08-17T17:50:12.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f313a8c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3134065140 0x7f3134153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f313a8c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31340a7fe0 0x7f3134152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f313a8c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31340be7f0 0x7f3134152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f313a8c4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3134155de0 con 0x7f3134065140 2023-08-17T17:50:12.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f313a8c4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3134152d10 con 0x7f31340be7f0 2023-08-17T17:50:12.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f313a8c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31340a90d0 con 0x7f31340a7fe0 2023-08-17T17:50:12.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f3133fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3134065140 0x7f3134153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f3133fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3134065140 0x7f3134153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38238/0 (socket says 172.21.15.78:38238) 2023-08-17T17:50:12.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f3133fff700 1 -- 172.21.15.78:0/588011688 learned_addr learned my addr 172.21.15.78:0/588011688 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:12.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f3138e61700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31340be7f0 0x7f3134152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f31337fe700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31340a7fe0 0x7f3134152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f3133fff700 1 -- 172.21.15.78:0/588011688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31340a7fe0 msgr2=0x7f3134152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f3133fff700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31340a7fe0 0x7f3134152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f3133fff700 1 -- 172.21.15.78:0/588011688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31340be7f0 msgr2=0x7f3134152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f3133fff700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31340be7f0 0x7f3134152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.240+0000 7f3133fff700 1 -- 172.21.15.78:0/588011688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31240092a0 con 0x7f3134065140 2023-08-17T17:50:12.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.241+0000 7f3133fff700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3134065140 0x7f3134153120 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f3134069a00 tx=0x7f3128016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:12.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.241+0000 7f311bfff700 1 -- 172.21.15.78:0/588011688 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312800dd30 con 0x7f3134065140 2023-08-17T17:50:12.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.241+0000 7f311bfff700 1 -- 172.21.15.78:0/588011688 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312800de90 con 0x7f3134065140 2023-08-17T17:50:12.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.241+0000 7f311bfff700 1 -- 172.21.15.78:0/588011688 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312800d980 con 0x7f3134065140 2023-08-17T17:50:12.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.241+0000 7f313a8c4700 1 -- 172.21.15.78:0/588011688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31280092a0 con 0x7f3134065140 2023-08-17T17:50:12.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.241+0000 7f313a8c4700 1 -- 172.21.15.78:0/588011688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31340a9690 con 0x7f3134065140 2023-08-17T17:50:12.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.242+0000 7f313a8c4700 1 -- 172.21.15.78:0/588011688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3134047350 con 0x7f3134065140 2023-08-17T17:50:12.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.242+0000 7f311bfff700 1 -- 172.21.15.78:0/588011688 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f312800f070 con 0x7f3134065140 2023-08-17T17:50:12.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.242+0000 7f311bfff700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f312005ede0 0x7f31200612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.243+0000 7f31337fe700 1 -- 172.21.15.78:0/588011688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f312005ede0 msgr2=0x7f31200612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:12.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.243+0000 7f311bfff700 1 -- 172.21.15.78:0/588011688 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f312807b380 con 0x7f3134065140 2023-08-17T17:50:12.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.243+0000 7f31337fe700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f312005ede0 0x7f31200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:12.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.250+0000 7f311bfff700 1 -- 172.21.15.78:0/588011688 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f312804c7a0 con 0x7f3134065140 2023-08-17T17:50:12.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.419+0000 7f313a8c4700 1 -- 172.21.15.78:0/588011688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f313405f410 con 0x7f3134065140 2023-08-17T17:50:12.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.420+0000 7f311bfff700 1 -- 172.21.15.78:0/588011688 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17224 (secure 0 0 0) 0x7f312804fdc0 con 0x7f3134065140 2023-08-17T17:50:12.421 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":92,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:50:09.481109+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:51.485390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:52.574728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/2878211067":"2023-08-18T17:50:09.481078+0000","172.21.15.78:6833/119464":"2023-08-18T17:50:09.481078+0000","172.21.15.78:6832/119464":"2023-08-18T17:50:09.481078+0000","172.21.15.78:0/2512351909":"2023-08-18T17:50:09.481078+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:50:12.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 -- 172.21.15.78:0/588011688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f312005ede0 msgr2=0x7f31200612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:12.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f312005ede0 0x7f31200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:12.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 -- 172.21.15.78:0/588011688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3134065140 msgr2=0x7f3134153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3134065140 0x7f3134153120 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f3134069a00 tx=0x7f3128016000).stop 2023-08-17T17:50:12.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 -- 172.21.15.78:0/588011688 shutdown_connections 2023-08-17T17:50:12.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f312005ede0 0x7f31200612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:12.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31340be7f0 0x7f3134152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3134065140 0x7f3134153120 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 --2- 172.21.15.78:0/588011688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31340a7fe0 0x7f3134152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 -- 172.21.15.78:0/588011688 >> 172.21.15.78:0/588011688 conn(0x7f3134092330 msgr2=0x7f31340c6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:12.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 -- 172.21.15.78:0/588011688 shutdown_connections 2023-08-17T17:50:12.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.422+0000 7f313a8c4700 1 -- 172.21.15.78:0/588011688 wait complete. 2023-08-17T17:50:12.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:49:51.485390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:49:52.574728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:50:12.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:50:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.556+0000 7ff6ba382700 1 Processor -- start 2023-08-17T17:50:12.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.556+0000 7ff6ba382700 1 -- start start 2023-08-17T17:50:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.557+0000 7ff6ba382700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6b40626b0 0x7ff6b40bc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.557+0000 7ff6ba382700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff6b414ea10 0x7ff6b4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.557+0000 7ff6ba382700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40649f0 con 0x7ff6b4062a90 2023-08-17T17:50:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.557+0000 7ff6ba382700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b4063450 con 0x7ff6b40626b0 2023-08-17T17:50:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.557+0000 7ff6ba382700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b4063730 con 0x7ff6b414ea10 2023-08-17T17:50:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.557+0000 7ff6b3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6b40626b0 0x7ff6b40bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.557+0000 7ff6b3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6b40626b0 0x7ff6b40bc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38248/0 (socket says 172.21.15.78:38248) 2023-08-17T17:50:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.557+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1906291542 learned_addr learned my addr 172.21.15.78:0/1906291542 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.558+0000 7ff6b891f700 1 --2- 172.21.15.78:0/1906291542 >> v2:172.21.15.150:3300/0 conn(0x7ff6b414ea10 0x7ff6b4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.558+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1906291542 >> v2:172.21.15.150:3300/0 conn(0x7ff6b414ea10 msgr2=0x7ff6b4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.558+0000 7ff6b3fff700 1 --2- 172.21.15.78:0/1906291542 >> v2:172.21.15.150:3300/0 conn(0x7ff6b414ea10 0x7ff6b4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.558+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1906291542 >> v1:172.21.15.150:6789/0 conn(0x7ff6b4062a90 legacy=0x7ff6b414e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.558+0000 7ff6b3fff700 1 -- 172.21.15.78:0/1906291542 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4063a10 con 0x7ff6b40626b0 2023-08-17T17:50:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.558+0000 7ff6b3fff700 1 --2- 172.21.15.78:0/1906291542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b40626b0 0x7ff6b40bc430 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7ff6b4155710 tx=0x7ff6a8009060).ready entity=mon.0 client_cookie=385738566b0b4998 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.558+0000 7ff6b2ffd700 1 -- 172.21.15.78:0/1906291542 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8005880 con 0x7ff6b40626b0 2023-08-17T17:50:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.558+0000 7ff6b2ffd700 1 -- 172.21.15.78:0/1906291542 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a80059e0 con 0x7ff6b40626b0 2023-08-17T17:50:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.558+0000 7ff6b2ffd700 1 -- 172.21.15.78:0/1906291542 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8005d60 con 0x7ff6b40626b0 2023-08-17T17:50:12.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.559+0000 7ff6ba382700 1 -- 172.21.15.78:0/1906291542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b40626b0 msgr2=0x7ff6b40bc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.559+0000 7ff6ba382700 1 --2- 172.21.15.78:0/1906291542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b40626b0 0x7ff6b40bc430 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7ff6b4155710 tx=0x7ff6a8009060).stop 2023-08-17T17:50:12.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.559+0000 7ff6ba382700 1 -- 172.21.15.78:0/1906291542 shutdown_connections 2023-08-17T17:50:12.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.559+0000 7ff6ba382700 1 --2- 172.21.15.78:0/1906291542 >> v2:172.21.15.150:3300/0 conn(0x7ff6b414ea10 0x7ff6b4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.559+0000 7ff6ba382700 1 --2- 172.21.15.78:0/1906291542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b40626b0 0x7ff6b40bc430 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.559+0000 7ff6ba382700 1 -- 172.21.15.78:0/1906291542 >> 172.21.15.78:0/1906291542 conn(0x7ff6b40c3db0 msgr2=0x7ff6b40c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:12.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.559+0000 7ff6ba382700 1 -- 172.21.15.78:0/1906291542 shutdown_connections 2023-08-17T17:50:12.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.559+0000 7ff6ba382700 1 -- 172.21.15.78:0/1906291542 wait complete. 2023-08-17T17:50:12.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.560+0000 7ff6ba382700 1 Processor -- start 2023-08-17T17:50:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.560+0000 7ff6ba382700 1 -- start start 2023-08-17T17:50:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6ba382700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40626b0 0x7ff6b4136d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6ba382700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b4062a90 0x7ff6b40c0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6ba382700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6b414ea10 0x7ff6b40c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6ba382700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40c1170 con 0x7ff6b4062a90 2023-08-17T17:50:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6ba382700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40bfbc0 con 0x7ff6b414ea10 2023-08-17T17:50:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6ba382700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b414ee90 con 0x7ff6b40626b0 2023-08-17T17:50:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b4062a90 0x7ff6b40c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b4062a90 0x7ff6b40c0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38264/0 (socket says 172.21.15.78:38264) 2023-08-17T17:50:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b37fe700 1 -- 172.21.15.78:0/4225619740 learned_addr learned my addr 172.21.15.78:0/4225619740 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b891f700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6b414ea10 0x7ff6b40c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b3fff700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40626b0 0x7ff6b4136d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b37fe700 1 -- 172.21.15.78:0/4225619740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40626b0 msgr2=0x7ff6b4136d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b37fe700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40626b0 0x7ff6b4136d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b37fe700 1 -- 172.21.15.78:0/4225619740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6b414ea10 msgr2=0x7ff6b40c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b37fe700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6b414ea10 0x7ff6b40c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b37fe700 1 -- 172.21.15.78:0/4225619740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8009300 con 0x7ff6b4062a90 2023-08-17T17:50:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6b37fe700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b4062a90 0x7ff6b40c0790 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7ff6a400c4f0 tx=0x7ff6a4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff69bfff700 1 -- 172.21.15.78:0/4225619740 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a400ce60 con 0x7ff6b4062a90 2023-08-17T17:50:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff69bfff700 1 -- 172.21.15.78:0/4225619740 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a4001e90 con 0x7ff6b4062a90 2023-08-17T17:50:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff69bfff700 1 -- 172.21.15.78:0/4225619740 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4007250 con 0x7ff6b4062a90 2023-08-17T17:50:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.561+0000 7ff6ba382700 1 -- 172.21.15.78:0/4225619740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b414f170 con 0x7ff6b4062a90 2023-08-17T17:50:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.562+0000 7ff6ba382700 1 -- 172.21.15.78:0/4225619740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b414f730 con 0x7ff6b4062a90 2023-08-17T17:50:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.562+0000 7ff6ba382700 1 -- 172.21.15.78:0/4225619740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b40676a0 con 0x7ff6b4062a90 2023-08-17T17:50:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.563+0000 7ff69bfff700 1 -- 172.21.15.78:0/4225619740 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ff6a4010070 con 0x7ff6b4062a90 2023-08-17T17:50:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.563+0000 7ff69bfff700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6a005ede0 0x7ff6a00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.563+0000 7ff6b3fff700 1 -- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6a005ede0 msgr2=0x7ff6a00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.563+0000 7ff69bfff700 1 -- 172.21.15.78:0/4225619740 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff6a4079420 con 0x7ff6b4062a90 2023-08-17T17:50:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.563+0000 7ff6b3fff700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6a005ede0 0x7ff6a00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.567+0000 7ff69bfff700 1 -- 172.21.15.78:0/4225619740 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff6a404a840 con 0x7ff6b4062a90 2023-08-17T17:50:12.615 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:12.614+0000 7f955cc9f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:50:12.670 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:12.670+0000 7f2884fd0680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:50:12.686 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:12.686+0000 7f955cc9f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:50:12.743 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:12.743+0000 7f2884fd0680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:50:12.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.764+0000 7ff6b3fff700 1 -- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6a005ede0 msgr2=0x7ff6a00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:12.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.764+0000 7ff6b3fff700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6a005ede0 0x7ff6a00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:50:12.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.768+0000 7ff6ba382700 1 -- 172.21.15.78:0/4225619740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff6b4063cf0 con 0x7ff6b4062a90 2023-08-17T17:50:12.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.769+0000 7ff69bfff700 1 -- 172.21.15.78:0/4225619740 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v92) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff6a404de60 con 0x7ff6b4062a90 2023-08-17T17:50:12.769 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:50:12.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 -- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6a005ede0 msgr2=0x7ff6a00612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:12.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6a005ede0 0x7ff6a00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:12.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 -- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b4062a90 msgr2=0x7ff6b40c0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b4062a90 0x7ff6b40c0790 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7ff6a400c4f0 tx=0x7ff6a4007e00).stop 2023-08-17T17:50:12.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 -- 172.21.15.78:0/4225619740 shutdown_connections 2023-08-17T17:50:12.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6a005ede0 0x7ff6a00612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:12.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6b414ea10 0x7ff6b40c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40626b0 0x7ff6b4136d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 --2- 172.21.15.78:0/4225619740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b4062a90 0x7ff6b40c0790 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 -- 172.21.15.78:0/4225619740 >> 172.21.15.78:0/4225619740 conn(0x7ff6b40c3db0 msgr2=0x7ff6b4155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:12.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 -- 172.21.15.78:0/4225619740 shutdown_connections 2023-08-17T17:50:12.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.771+0000 7ff6ba382700 1 -- 172.21.15.78:0/4225619740 wait complete. 2023-08-17T17:50:12.784 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:50:12.872 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:12.871+0000 7f955cc9f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:50:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.904+0000 7f1c4fd95700 1 Processor -- start 2023-08-17T17:50:12.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.904+0000 7f1c4fd95700 1 -- start start 2023-08-17T17:50:12.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4fd95700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c48154ab0 0x7f1c48154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4fd95700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c48155510 0x7f1c481507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4fd95700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c480c2b00 con 0x7f1c48150cb0 2023-08-17T17:50:12.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4fd95700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c480c1da0 con 0x7f1c48155510 2023-08-17T17:50:12.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4fd95700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480c1f80 con 0x7f1c48154ab0 2023-08-17T17:50:12.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4d330700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c48155510 0x7f1c481507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4e332700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1c48150cb0 0x7f1c480c4960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51338/0 (socket says 172.21.15.78:51338) 2023-08-17T17:50:12.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4e332700 1 -- 172.21.15.78:0/1447812069 learned_addr learned my addr 172.21.15.78:0/1447812069 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:12.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4db31700 1 --2- 172.21.15.78:0/1447812069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c48154ab0 0x7f1c48154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4d330700 1 -- 172.21.15.78:0/1447812069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c48154ab0 msgr2=0x7f1c48154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:12.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4d330700 1 --2- 172.21.15.78:0/1447812069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c48154ab0 0x7f1c48154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4cb2f700 1 -- 172.21.15.78:0/1447812069 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150875098 0 0) 0x7f1c480c2b00 con 0x7f1c48150cb0 2023-08-17T17:50:12.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4d330700 1 -- 172.21.15.78:0/1447812069 >> v1:172.21.15.78:6789/0 conn(0x7f1c48150cb0 legacy=0x7f1c480c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.906+0000 7f1c4d330700 1 -- 172.21.15.78:0/1447812069 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c480c2260 con 0x7f1c48155510 2023-08-17T17:50:12.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.907+0000 7f1c4d330700 1 --2- 172.21.15.78:0/1447812069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48155510 0x7f1c481507c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f1c44009760 tx=0x7f1c44009060).ready entity=mon.0 client_cookie=41841fc98c76968c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:12.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.907+0000 7f1c4cb2f700 1 -- 172.21.15.78:0/1447812069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4400f510 con 0x7f1c48155510 2023-08-17T17:50:12.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.907+0000 7f1c4cb2f700 1 -- 172.21.15.78:0/1447812069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4400f670 con 0x7f1c48155510 2023-08-17T17:50:12.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.907+0000 7f1c4cb2f700 1 -- 172.21.15.78:0/1447812069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4400f9f0 con 0x7f1c48155510 2023-08-17T17:50:12.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.908+0000 7f1c4fd95700 1 -- 172.21.15.78:0/1447812069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48155510 msgr2=0x7f1c481507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.908+0000 7f1c4fd95700 1 --2- 172.21.15.78:0/1447812069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48155510 0x7f1c481507c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f1c44009760 tx=0x7f1c44009060).stop 2023-08-17T17:50:12.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.908+0000 7f1c4fd95700 1 -- 172.21.15.78:0/1447812069 shutdown_connections 2023-08-17T17:50:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.908+0000 7f1c4fd95700 1 --2- 172.21.15.78:0/1447812069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c48154ab0 0x7f1c48154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.908+0000 7f1c4fd95700 1 --2- 172.21.15.78:0/1447812069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48155510 0x7f1c481507c0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.908+0000 7f1c4fd95700 1 -- 172.21.15.78:0/1447812069 >> 172.21.15.78:0/1447812069 conn(0x7f1c480c6a80 msgr2=0x7f1c480c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.908+0000 7f1c4fd95700 1 -- 172.21.15.78:0/1447812069 shutdown_connections 2023-08-17T17:50:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.908+0000 7f1c4fd95700 1 -- 172.21.15.78:0/1447812069 wait complete. 2023-08-17T17:50:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.909+0000 7f1c4fd95700 1 Processor -- start 2023-08-17T17:50:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.909+0000 7f1c4fd95700 1 -- start start 2023-08-17T17:50:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4fd95700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c48150cb0 0x7f1c4813e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4fd95700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48154ab0 0x7f1c4813ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4fd95700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c48155510 0x7f1c480656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4fd95700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4813c570 con 0x7f1c48154ab0 2023-08-17T17:50:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4fd95700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4813ed40 con 0x7f1c48155510 2023-08-17T17:50:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4fd95700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4813bf20 con 0x7f1c48150cb0 2023-08-17T17:50:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4d330700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48154ab0 0x7f1c4813ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4d330700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48154ab0 0x7f1c4813ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38290/0 (socket says 172.21.15.78:38290) 2023-08-17T17:50:12.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4d330700 1 -- 172.21.15.78:0/2879712749 learned_addr learned my addr 172.21.15.78:0/2879712749 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:12.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4db31700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c48150cb0 0x7f1c4813e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4e332700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c48155510 0x7f1c480656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:12.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4d330700 1 -- 172.21.15.78:0/2879712749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c48150cb0 msgr2=0x7f1c4813e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4d330700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c48150cb0 0x7f1c4813e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4d330700 1 -- 172.21.15.78:0/2879712749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c48155510 msgr2=0x7f1c480656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:12.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4d330700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c48155510 0x7f1c480656c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:12.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4d330700 1 -- 172.21.15.78:0/2879712749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c440092a0 con 0x7f1c48154ab0 2023-08-17T17:50:12.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4d330700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48154ab0 0x7f1c4813ca00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f1c4806a930 tx=0x7f1c44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:12.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c3dffb700 1 -- 172.21.15.78:0/2879712749 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4400fe80 con 0x7f1c48154ab0 2023-08-17T17:50:12.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c3dffb700 1 -- 172.21.15.78:0/2879712749 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4400f7e0 con 0x7f1c48154ab0 2023-08-17T17:50:12.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c4fd95700 1 -- 172.21.15.78:0/2879712749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4813c200 con 0x7f1c48154ab0 2023-08-17T17:50:12.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.910+0000 7f1c3dffb700 1 -- 172.21.15.78:0/2879712749 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4401b620 con 0x7f1c48154ab0 2023-08-17T17:50:12.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.911+0000 7f1c4fd95700 1 -- 172.21.15.78:0/2879712749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4813bc20 con 0x7f1c48154ab0 2023-08-17T17:50:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.911+0000 7f1c4fd95700 1 -- 172.21.15.78:0/2879712749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4813c6e0 con 0x7f1c48154ab0 2023-08-17T17:50:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.912+0000 7f1c3dffb700 1 -- 172.21.15.78:0/2879712749 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f1c4402b070 con 0x7f1c48154ab0 2023-08-17T17:50:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.912+0000 7f1c3dffb700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c2c05ede0 0x7f1c2c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.912+0000 7f1c4db31700 1 -- 172.21.15.78:0/2879712749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c2c05ede0 msgr2=0x7f1c2c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.912+0000 7f1c3dffb700 1 -- 172.21.15.78:0/2879712749 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f1c4407b610 con 0x7f1c48154ab0 2023-08-17T17:50:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.912+0000 7f1c4db31700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c2c05ede0 0x7f1c2c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:12.916+0000 7f1c3dffb700 1 -- 172.21.15.78:0/2879712749 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1c4404ca30 con 0x7f1c48154ab0 2023-08-17T17:50:12.941 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:12.941+0000 7f2884fd0680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:50:13.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.091+0000 7f1c4fd95700 1 -- 172.21.15.78:0/2879712749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1c480c2540 con 0x7f1c48154ab0 2023-08-17T17:50:13.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.091+0000 7f1c3dffb700 1 -- 172.21.15.78:0/2879712749 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v92) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1c4401f0a0 con 0x7f1c48154ab0 2023-08-17T17:50:13.092 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:50:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 -- 172.21.15.78:0/2879712749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c2c05ede0 msgr2=0x7f1c2c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c2c05ede0 0x7f1c2c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 -- 172.21.15.78:0/2879712749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48154ab0 msgr2=0x7f1c4813ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48154ab0 0x7f1c4813ca00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f1c4806a930 tx=0x7f1c44017000).stop 2023-08-17T17:50:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 -- 172.21.15.78:0/2879712749 shutdown_connections 2023-08-17T17:50:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1c2c05ede0 0x7f1c2c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c48155510 0x7f1c480656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c48150cb0 0x7f1c4813e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 --2- 172.21.15.78:0/2879712749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c48154ab0 0x7f1c4813ca00 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 -- 172.21.15.78:0/2879712749 >> 172.21.15.78:0/2879712749 conn(0x7f1c480c6a80 msgr2=0x7f1c480bc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 -- 172.21.15.78:0/2879712749 shutdown_connections 2023-08-17T17:50:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.093+0000 7f1c4fd95700 1 -- 172.21.15.78:0/2879712749 wait complete. 2023-08-17T17:50:13.105 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:50:13.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.226+0000 7ffa70706700 1 Processor -- start 2023-08-17T17:50:13.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.226+0000 7ffa70706700 1 -- start start 2023-08-17T17:50:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.227+0000 7ffa70706700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffa680aa0f0 0x7ffa680644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.227+0000 7ffa70706700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680c5810 0x7ffa680c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.227+0000 7ffa70706700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa680649b0 con 0x7ffa680aa4d0 2023-08-17T17:50:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.227+0000 7ffa70706700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa680c6170 con 0x7ffa680aa0f0 2023-08-17T17:50:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.227+0000 7ffa70706700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa68063420 con 0x7ffa680c5810 2023-08-17T17:50:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6e4a2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffa680aa0f0 0x7ffa680644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6eca3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680c5810 0x7ffa680c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6dca1700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ffa680aa4d0 0x7ffa680c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:47308/0 (socket says 172.21.15.78:47308) 2023-08-17T17:50:13.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6dca1700 1 -- 172.21.15.78:0/3986310206 learned_addr learned my addr 172.21.15.78:0/3986310206 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:13.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6e4a2700 1 -- 172.21.15.78:0/3986310206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680c5810 msgr2=0x7ffa680c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:13.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6e4a2700 1 --2- 172.21.15.78:0/3986310206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680c5810 0x7ffa680c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6e4a2700 1 -- 172.21.15.78:0/3986310206 >> v1:172.21.15.150:6789/0 conn(0x7ffa680aa4d0 legacy=0x7ffa680c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6d4a0700 1 -- 172.21.15.78:0/3986310206 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497888504 0 0) 0x7ffa680649b0 con 0x7ffa680aa4d0 2023-08-17T17:50:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6e4a2700 1 -- 172.21.15.78:0/3986310206 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68063700 con 0x7ffa680aa0f0 2023-08-17T17:50:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6eca3700 1 --2- 172.21.15.78:0/3986310206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680c5810 0x7ffa680c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:50:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6e4a2700 1 --2- 172.21.15.78:0/3986310206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa680aa0f0 0x7ffa680644c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7ffa58009760 tx=0x7ffa58009060).ready entity=mon.1 client_cookie=72e6ac6e40ec218c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6d4a0700 1 -- 172.21.15.78:0/3986310206 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800f510 con 0x7ffa680aa0f0 2023-08-17T17:50:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6d4a0700 1 -- 172.21.15.78:0/3986310206 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5800f670 con 0x7ffa680aa0f0 2023-08-17T17:50:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.228+0000 7ffa6d4a0700 1 -- 172.21.15.78:0/3986310206 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800f9f0 con 0x7ffa680aa0f0 2023-08-17T17:50:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.229+0000 7ffa70706700 1 -- 172.21.15.78:0/3986310206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa680aa0f0 msgr2=0x7ffa680644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.229+0000 7ffa70706700 1 --2- 172.21.15.78:0/3986310206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa680aa0f0 0x7ffa680644c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7ffa58009760 tx=0x7ffa58009060).stop 2023-08-17T17:50:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.229+0000 7ffa70706700 1 -- 172.21.15.78:0/3986310206 shutdown_connections 2023-08-17T17:50:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.229+0000 7ffa70706700 1 --2- 172.21.15.78:0/3986310206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680c5810 0x7ffa680c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.229+0000 7ffa70706700 1 --2- 172.21.15.78:0/3986310206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa680aa0f0 0x7ffa680644c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.229+0000 7ffa70706700 1 -- 172.21.15.78:0/3986310206 >> 172.21.15.78:0/3986310206 conn(0x7ffa6806a6a0 msgr2=0x7ffa680caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.229+0000 7ffa70706700 1 -- 172.21.15.78:0/3986310206 shutdown_connections 2023-08-17T17:50:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.229+0000 7ffa70706700 1 -- 172.21.15.78:0/3986310206 wait complete. 2023-08-17T17:50:13.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.231+0000 7ffa70706700 1 Processor -- start 2023-08-17T17:50:13.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.231+0000 7ffa70706700 1 -- start start 2023-08-17T17:50:13.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.232+0000 7ffa70706700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa680aa0f0 0x7ffa680ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.232+0000 7ffa70706700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680aa4d0 0x7ffa680c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.232+0000 7ffa70706700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa680c5810 0x7ffa68142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.232+0000 7ffa70706700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680c3500 con 0x7ffa680aa0f0 2023-08-17T17:50:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.232+0000 7ffa70706700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680ab1a0 con 0x7ffa680c5810 2023-08-17T17:50:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.232+0000 7ffa70706700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680c3220 con 0x7ffa680aa4d0 2023-08-17T17:50:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6e4a2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa680aa0f0 0x7ffa680ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6e4a2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa680aa0f0 0x7ffa680ab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38292/0 (socket says 172.21.15.78:38292) 2023-08-17T17:50:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6e4a2700 1 -- 172.21.15.78:0/3187497368 learned_addr learned my addr 172.21.15.78:0/3187497368 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6eca3700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa680c5810 0x7ffa68142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6dca1700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680aa4d0 0x7ffa680c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6e4a2700 1 -- 172.21.15.78:0/3187497368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680aa4d0 msgr2=0x7ffa680c29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6e4a2700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680aa4d0 0x7ffa680c29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6e4a2700 1 -- 172.21.15.78:0/3187497368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa680c5810 msgr2=0x7ffa68142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6e4a2700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa680c5810 0x7ffa68142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6e4a2700 1 -- 172.21.15.78:0/3187497368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa60009a20 con 0x7ffa680aa0f0 2023-08-17T17:50:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa6e4a2700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa680aa0f0 0x7ffa680ab630 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7ffa58009e00 tx=0x7ffa58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa5e7fc700 1 -- 172.21.15.78:0/3187497368 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800f7e0 con 0x7ffa680aa0f0 2023-08-17T17:50:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa5e7fc700 1 -- 172.21.15.78:0/3187497368 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5800f940 con 0x7ffa680aa0f0 2023-08-17T17:50:13.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa5e7fc700 1 -- 172.21.15.78:0/3187497368 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5801b690 con 0x7ffa680aa0f0 2023-08-17T17:50:13.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa70706700 1 -- 172.21.15.78:0/3187497368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa580092a0 con 0x7ffa680aa0f0 2023-08-17T17:50:13.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.233+0000 7ffa70706700 1 -- 172.21.15.78:0/3187497368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa680aae30 con 0x7ffa680aa0f0 2023-08-17T17:50:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.234+0000 7ffa5e7fc700 1 -- 172.21.15.78:0/3187497368 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ffa5800f070 con 0x7ffa680aa0f0 2023-08-17T17:50:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.234+0000 7ffa70706700 1 -- 172.21.15.78:0/3187497368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa680aa9b0 con 0x7ffa680aa0f0 2023-08-17T17:50:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.235+0000 7ffa5e7fc700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa4c05ede0 0x7ffa4c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.235+0000 7ffa6dca1700 1 -- 172.21.15.78:0/3187497368 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa4c05ede0 msgr2=0x7ffa4c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.235+0000 7ffa5e7fc700 1 -- 172.21.15.78:0/3187497368 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ffa5807b390 con 0x7ffa680aa0f0 2023-08-17T17:50:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.235+0000 7ffa6dca1700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa4c05ede0 0x7ffa4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:13.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.239+0000 7ffa5e7fc700 1 -- 172.21.15.78:0/3187497368 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa680aa9b0 con 0x7ffa680aa0f0 2023-08-17T17:50:13.292 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:13.291+0000 7f955cc9f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:50:13.383 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:13.383+0000 7f2884fd0680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:50:13.395 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:13.394+0000 7f955cc9f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:13.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.408+0000 7ffa70706700 1 -- 172.21.15.78:0/3187497368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa680aa9b0 con 0x7ffa680aa0f0 2023-08-17T17:50:13.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.409+0000 7ffa5e7fc700 1 -- 172.21.15.78:0/3187497368 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa680aa9b0 con 0x7ffa680aa0f0 2023-08-17T17:50:13.409 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:50:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 -- 172.21.15.78:0/3187497368 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa4c05ede0 msgr2=0x7ffa4c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa4c05ede0 0x7ffa4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 -- 172.21.15.78:0/3187497368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa680aa0f0 msgr2=0x7ffa680ab630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa680aa0f0 0x7ffa680ab630 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7ffa58009e00 tx=0x7ffa58017000).stop 2023-08-17T17:50:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 -- 172.21.15.78:0/3187497368 shutdown_connections 2023-08-17T17:50:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa4c05ede0 0x7ffa4c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa680c5810 0x7ffa68142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa680aa0f0 0x7ffa680ab630 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 --2- 172.21.15.78:0/3187497368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa680aa4d0 0x7ffa680c29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 -- 172.21.15.78:0/3187497368 >> 172.21.15.78:0/3187497368 conn(0x7ffa6806a6a0 msgr2=0x7ffa681519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:13.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 -- 172.21.15.78:0/3187497368 shutdown_connections 2023-08-17T17:50:13.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.412+0000 7ffa70706700 1 -- 172.21.15.78:0/3187497368 wait complete. 2023-08-17T17:50:13.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:50:13.499 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:13.499+0000 7f2884fd0680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:13.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.547+0000 7f2c6b59e700 1 Processor -- start 2023-08-17T17:50:13.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.547+0000 7f2c6b59e700 1 -- start start 2023-08-17T17:50:13.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c6c1506a0 0x7f2c6c0bd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6b59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c0bd270 con 0x7f2c6c1502c0 2023-08-17T17:50:13.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c0bc660 con 0x7f2c6c0bdbf0 2023-08-17T17:50:13.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c150b20 con 0x7f2c6c1506a0 2023-08-17T17:50:13.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6a59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2c6c1502c0 0x7f2c6c0c5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51350/0 (socket says 172.21.15.78:51350) 2023-08-17T17:50:13.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6a59c700 1 -- 172.21.15.78:0/2562964726 learned_addr learned my addr 172.21.15.78:0/2562964726 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:13.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c69d9b700 1 --2- 172.21.15.78:0/2562964726 >> v2:172.21.15.150:3300/0 conn(0x7f2c6c1506a0 0x7f2c6c0bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6959a700 1 -- 172.21.15.78:0/2562964726 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885047153 0 0) 0x7f2c6c0bd270 con 0x7f2c6c1502c0 2023-08-17T17:50:13.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6959a700 1 -- 172.21.15.78:0/2562964726 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c580033f0 con 0x7f2c6c1502c0 2023-08-17T17:50:13.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6959a700 1 -- 172.21.15.78:0/2562964726 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767116750 0 0) 0x7f2c6c0bc660 con 0x7f2c6c0bdbf0 2023-08-17T17:50:13.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6959a700 1 -- 172.21.15.78:0/2562964726 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c6c0bd270 con 0x7f2c6c0bdbf0 2023-08-17T17:50:13.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c69d9b700 1 -- 172.21.15.78:0/2562964726 >> v1:172.21.15.150:6789/0 conn(0x7f2c6c0bdbf0 legacy=0x7f2c6c0c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c69d9b700 1 -- 172.21.15.78:0/2562964726 >> v1:172.21.15.78:6789/0 conn(0x7f2c6c1502c0 legacy=0x7f2c6c0c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c69d9b700 1 -- 172.21.15.78:0/2562964726 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0bc940 con 0x7f2c6c1506a0 2023-08-17T17:50:13.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c69d9b700 1 --2- 172.21.15.78:0/2562964726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c6c1506a0 0x7f2c6c0bd700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f2c54009760 tx=0x7f2c54009060).ready entity=mon.1 client_cookie=c42e66bff4014d39 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:13.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.548+0000 7f2c6959a700 1 -- 172.21.15.78:0/2562964726 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400d4a0 con 0x7f2c6c1506a0 2023-08-17T17:50:13.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.549+0000 7f2c6959a700 1 -- 172.21.15.78:0/2562964726 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5400d600 con 0x7f2c6c1506a0 2023-08-17T17:50:13.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.549+0000 7f2c6959a700 1 -- 172.21.15.78:0/2562964726 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400d980 con 0x7f2c6c1506a0 2023-08-17T17:50:13.552 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:13.547+0000 7f955cc9f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:13.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.549+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2562964726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c6c1506a0 msgr2=0x7f2c6c0bd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.549+0000 7f2c6b59e700 1 --2- 172.21.15.78:0/2562964726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c6c1506a0 0x7f2c6c0bd700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f2c54009760 tx=0x7f2c54009060).stop 2023-08-17T17:50:13.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.549+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2562964726 shutdown_connections 2023-08-17T17:50:13.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.549+0000 7f2c6b59e700 1 --2- 172.21.15.78:0/2562964726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c6c1506a0 0x7f2c6c0bd700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.549+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2562964726 >> 172.21.15.78:0/2562964726 conn(0x7f2c6c0c3e20 msgr2=0x7f2c6c0c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:13.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.549+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2562964726 shutdown_connections 2023-08-17T17:50:13.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.549+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2562964726 wait complete. 2023-08-17T17:50:13.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.550+0000 7f2c6b59e700 1 Processor -- start 2023-08-17T17:50:13.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.550+0000 7f2c6b59e700 1 -- start start 2023-08-17T17:50:13.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c6b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c6c0bdbf0 0x7f2c6c0c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c6b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c6c1502c0 0x7f2c6c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c6b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c6c1506a0 0x7f2c6c140a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c6b59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0c18e0 con 0x7f2c6c1502c0 2023-08-17T17:50:13.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c6b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0c2260 con 0x7f2c6c1506a0 2023-08-17T17:50:13.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c6b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0ab1d0 con 0x7f2c6c0bdbf0 2023-08-17T17:50:13.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c69d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c6c1502c0 0x7f2c6c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c69d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c6c1502c0 0x7f2c6c068a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38302/0 (socket says 172.21.15.78:38302) 2023-08-17T17:50:13.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c69d9b700 1 -- 172.21.15.78:0/2260278971 learned_addr learned my addr 172.21.15.78:0/2260278971 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:13.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c6a59c700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c6c0bdbf0 0x7f2c6c0c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.551+0000 7f2c6ad9d700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c6c1506a0 0x7f2c6c140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c69d9b700 1 -- 172.21.15.78:0/2260278971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c6c0bdbf0 msgr2=0x7f2c6c0c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c69d9b700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c6c0bdbf0 0x7f2c6c0c1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c69d9b700 1 -- 172.21.15.78:0/2260278971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c6c1506a0 msgr2=0x7f2c6c140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c69d9b700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c6c1506a0 0x7f2c6c140a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c69d9b700 1 -- 172.21.15.78:0/2260278971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c540092a0 con 0x7f2c6c1502c0 2023-08-17T17:50:13.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c69d9b700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c6c1502c0 0x7f2c6c068a10 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f2c54009d50 tx=0x7f2c54016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:13.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c627fc700 1 -- 172.21.15.78:0/2260278971 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400dcf0 con 0x7f2c6c1502c0 2023-08-17T17:50:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c627fc700 1 -- 172.21.15.78:0/2260278971 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5400de50 con 0x7f2c6c1502c0 2023-08-17T17:50:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2260278971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c0c1290 con 0x7f2c6c1502c0 2023-08-17T17:50:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c627fc700 1 -- 172.21.15.78:0/2260278971 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400d980 con 0x7f2c6c1502c0 2023-08-17T17:50:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.552+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2260278971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c0c0f40 con 0x7f2c6c1502c0 2023-08-17T17:50:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.553+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2260278971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c05f910 con 0x7f2c6c1502c0 2023-08-17T17:50:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.553+0000 7f2c627fc700 1 -- 172.21.15.78:0/2260278971 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f2c54024030 con 0x7f2c6c1502c0 2023-08-17T17:50:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.553+0000 7f2c627fc700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c4c05ede0 0x7f2c4c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.554+0000 7f2c6a59c700 1 -- 172.21.15.78:0/2260278971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c4c05ede0 msgr2=0x7f2c4c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.554+0000 7f2c627fc700 1 -- 172.21.15.78:0/2260278971 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2c5407a880 con 0x7f2c6c1502c0 2023-08-17T17:50:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.554+0000 7f2c6a59c700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c4c05ede0 0x7f2c4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.557+0000 7f2c627fc700 1 -- 172.21.15.78:0/2260278971 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c5404bdf0 con 0x7f2c6c1502c0 2023-08-17T17:50:13.623 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:13.623+0000 7f955cc9f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:50:13.658 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:13.658+0000 7f2884fd0680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:13.690 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:13.690+0000 7f955cc9f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:50:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.728+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2260278971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c6c0c1a20 con 0x7f2c6c1502c0 2023-08-17T17:50:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.728+0000 7f2c627fc700 1 -- 172.21.15.78:0/2260278971 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c54022020 con 0x7f2c6c1502c0 2023-08-17T17:50:13.728 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:50:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2260278971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c4c05ede0 msgr2=0x7f2c4c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c4c05ede0 0x7f2c4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2260278971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c6c1502c0 msgr2=0x7f2c6c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c6c1502c0 0x7f2c6c068a10 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f2c54009d50 tx=0x7f2c54016000).stop 2023-08-17T17:50:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2260278971 shutdown_connections 2023-08-17T17:50:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c4c05ede0 0x7f2c4c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c6c1506a0 0x7f2c6c140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c6c0bdbf0 0x7f2c6c0c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 --2- 172.21.15.78:0/2260278971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c6c1502c0 0x7f2c6c068a10 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2260278971 >> 172.21.15.78:0/2260278971 conn(0x7f2c6c0c3e20 msgr2=0x7f2c6c0c4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:13.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2260278971 shutdown_connections 2023-08-17T17:50:13.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.730+0000 7f2c6b59e700 1 -- 172.21.15.78:0/2260278971 wait complete. 2023-08-17T17:50:13.735 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:13.735+0000 7f2884fd0680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:50:13.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:50:13.808 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:13.808+0000 7f2884fd0680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:50:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.859+0000 7fe46359e700 1 Processor -- start 2023-08-17T17:50:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.859+0000 7fe46359e700 1 -- start start 2023-08-17T17:50:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.860+0000 7fe46359e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4640c5060 0x7fe46406b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.860+0000 7fe46359e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4640ace90 con 0x7fe464069bb0 2023-08-17T17:50:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.860+0000 7fe46359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4640c6d10 con 0x7fe4640bc0c0 2023-08-17T17:50:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.860+0000 7fe46359e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4640c6ff0 con 0x7fe4640c5060 2023-08-17T17:50:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.860+0000 7fe461d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4640c5060 0x7fe46406b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.861+0000 7fe46259c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe464069bb0 0x7fe464069f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51352/0 (socket says 172.21.15.78:51352) 2023-08-17T17:50:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.861+0000 7fe46259c700 1 -- 172.21.15.78:0/2032400303 learned_addr learned my addr 172.21.15.78:0/2032400303 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.861+0000 7fe461d9b700 1 -- 172.21.15.78:0/2032400303 >> v1:172.21.15.150:6789/0 conn(0x7fe4640bc0c0 legacy=0x7fe4640bc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.861+0000 7fe461d9b700 1 -- 172.21.15.78:0/2032400303 >> v1:172.21.15.78:6789/0 conn(0x7fe464069bb0 legacy=0x7fe464069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.861+0000 7fe461d9b700 1 -- 172.21.15.78:0/2032400303 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4640acb20 con 0x7fe4640c5060 2023-08-17T17:50:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.861+0000 7fe46159a700 1 -- 172.21.15.78:0/2032400303 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581798132 0 0) 0x7fe4640ace90 con 0x7fe464069bb0 2023-08-17T17:50:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.861+0000 7fe461d9b700 1 --2- 172.21.15.78:0/2032400303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 0x7fe46406b490 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fe458009760 tx=0x7fe458009060).ready entity=mon.0 client_cookie=3002909730bbc531 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.861+0000 7fe46159a700 1 -- 172.21.15.78:0/2032400303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800b610 con 0x7fe4640c5060 2023-08-17T17:50:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.861+0000 7fe46159a700 1 -- 172.21.15.78:0/2032400303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45800b770 con 0x7fe4640c5060 2023-08-17T17:50:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.861+0000 7fe46159a700 1 -- 172.21.15.78:0/2032400303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800baf0 con 0x7fe4640c5060 2023-08-17T17:50:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.862+0000 7fe46359e700 1 -- 172.21.15.78:0/2032400303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 msgr2=0x7fe46406b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.862+0000 7fe46359e700 1 --2- 172.21.15.78:0/2032400303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 0x7fe46406b490 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fe458009760 tx=0x7fe458009060).stop 2023-08-17T17:50:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.862+0000 7fe46359e700 1 -- 172.21.15.78:0/2032400303 shutdown_connections 2023-08-17T17:50:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.862+0000 7fe46359e700 1 --2- 172.21.15.78:0/2032400303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 0x7fe46406b490 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.862+0000 7fe46359e700 1 -- 172.21.15.78:0/2032400303 >> 172.21.15.78:0/2032400303 conn(0x7fe4640aabf0 msgr2=0x7fe4640ac270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.862+0000 7fe46359e700 1 -- 172.21.15.78:0/2032400303 shutdown_connections 2023-08-17T17:50:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.862+0000 7fe46359e700 1 -- 172.21.15.78:0/2032400303 wait complete. 2023-08-17T17:50:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.863+0000 7fe46359e700 1 Processor -- start 2023-08-17T17:50:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.863+0000 7fe46359e700 1 -- start start 2023-08-17T17:50:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe46359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe464069bb0 0x7fe4640a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe46359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4640bc0c0 0x7fe464149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe46359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 0x7fe4641647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe46359e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4640a87a0 con 0x7fe4640c5060 2023-08-17T17:50:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe46359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4640a7b90 con 0x7fe4640bc0c0 2023-08-17T17:50:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe46359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4640a7e70 con 0x7fe464069bb0 2023-08-17T17:50:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe462d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 0x7fe4641647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe462d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 0x7fe4641647c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38308/0 (socket says 172.21.15.78:38308) 2023-08-17T17:50:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe462d9d700 1 -- 172.21.15.78:0/572062832 learned_addr learned my addr 172.21.15.78:0/572062832 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe461d9b700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4640bc0c0 0x7fe464149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe46259c700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe464069bb0 0x7fe4640a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe462d9d700 1 -- 172.21.15.78:0/572062832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe464069bb0 msgr2=0x7fe4640a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe462d9d700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe464069bb0 0x7fe4640a7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe462d9d700 1 -- 172.21.15.78:0/572062832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4640bc0c0 msgr2=0x7fe464149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe462d9d700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4640bc0c0 0x7fe464149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe462d9d700 1 -- 172.21.15.78:0/572062832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4580092a0 con 0x7fe4640c5060 2023-08-17T17:50:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe462d9d700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 0x7fe4641647c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fe45c00c7c0 tx=0x7fe45c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:13.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.864+0000 7fe4527fc700 1 -- 172.21.15.78:0/572062832 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c010510 con 0x7fe4640c5060 2023-08-17T17:50:13.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.865+0000 7fe4527fc700 1 -- 172.21.15.78:0/572062832 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c010670 con 0x7fe4640c5060 2023-08-17T17:50:13.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.865+0000 7fe46359e700 1 -- 172.21.15.78:0/572062832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4640a8150 con 0x7fe4640c5060 2023-08-17T17:50:13.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.865+0000 7fe4527fc700 1 -- 172.21.15.78:0/572062832 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c0109f0 con 0x7fe4640c5060 2023-08-17T17:50:13.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.865+0000 7fe46359e700 1 -- 172.21.15.78:0/572062832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4640a7780 con 0x7fe4640c5060 2023-08-17T17:50:13.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.866+0000 7fe46359e700 1 -- 172.21.15.78:0/572062832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46406ab40 con 0x7fe4640c5060 2023-08-17T17:50:13.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.866+0000 7fe4527fc700 1 -- 172.21.15.78:0/572062832 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fe45c010070 con 0x7fe4640c5060 2023-08-17T17:50:13.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.866+0000 7fe4527fc700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe44405ede0 0x7fe4440612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:13.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.866+0000 7fe46259c700 1 -- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe44405ede0 msgr2=0x7fe4440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:13.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.866+0000 7fe4527fc700 1 -- 172.21.15.78:0/572062832 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fe45c079960 con 0x7fe4640c5060 2023-08-17T17:50:13.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.866+0000 7fe46259c700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe44405ede0 0x7fe4440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:13.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:13.870+0000 7fe4527fc700 1 -- 172.21.15.78:0/572062832 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe45c04ad80 con 0x7fe4640c5060 2023-08-17T17:50:13.949 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:13.948+0000 7f955cc9f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:50:14.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.067+0000 7fe46259c700 1 -- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe44405ede0 msgr2=0x7fe4440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:14.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.067+0000 7fe46259c700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe44405ede0 0x7fe4440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:50:14.078 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:14.078+0000 7f2884fd0680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:50:14.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.083+0000 7fe46359e700 1 -- 172.21.15.78:0/572062832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4640c4d60 con 0x7fe4640c5060 2023-08-17T17:50:14.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.084+0000 7fe4527fc700 1 -- 172.21.15.78:0/572062832 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fe45c04e3a0 con 0x7fe4640c5060 2023-08-17T17:50:14.084 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:14.085 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3356030675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3356030675},{"type":"v1","addr":"172.21.15.150:6835","nonce":3356030675}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/807522916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":807522916},{"type":"v1","addr":"172.21.15.78:6837","nonce":807522916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3165905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3165905348},{"type":"v1","addr":"172.21.15.150:6834","nonce":3165905348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:53.608560+0000","modified":"2023-08-17T17:49:55.616581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/4042380652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4042380652},{"type":"v1","addr":"172.21.15.78:6836","nonce":4042380652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T17:50:14.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.085+0000 7fe46359e700 1 -- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe44405ede0 msgr2=0x7fe4440612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:14.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe44405ede0 0x7fe4440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:14.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 -- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 msgr2=0x7fe4641647c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 0x7fe4641647c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fe45c00c7c0 tx=0x7fe45c0015e0).stop 2023-08-17T17:50:14.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 -- 172.21.15.78:0/572062832 shutdown_connections 2023-08-17T17:50:14.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe44405ede0 0x7fe4440612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:14.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4640c5060 0x7fe4641647c0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe464069bb0 0x7fe4640a7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 --2- 172.21.15.78:0/572062832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4640bc0c0 0x7fe464149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 -- 172.21.15.78:0/572062832 >> 172.21.15.78:0/572062832 conn(0x7fe4640aabf0 msgr2=0x7fe464065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:14.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 -- 172.21.15.78:0/572062832 shutdown_connections 2023-08-17T17:50:14.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.086+0000 7fe46359e700 1 -- 172.21.15.78:0/572062832 wait complete. 2023-08-17T17:50:14.088 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 31 2023-08-17T17:50:14.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:50:14.135 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:14.134+0000 7f955cc9f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.216+0000 7f55f5937700 1 Processor -- start 2023-08-17T17:50:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.216+0000 7f55f5937700 1 -- start start 2023-08-17T17:50:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55f5937700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f55f014e290 0x7f55f014e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55f5937700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55f00643e0 0x7f55f0157c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55f5937700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55f0064890 0x7f55f0158150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55f5937700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f0158640 con 0x7f55f00643e0 2023-08-17T17:50:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55f5937700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f0063bb0 con 0x7f55f014e290 2023-08-17T17:50:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55f5937700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0062fa0 con 0x7f55f0064890 2023-08-17T17:50:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55ee7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55f00643e0 0x7f55f0157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55ee7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55f00643e0 0x7f55f0157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38314/0 (socket says 172.21.15.78:38314) 2023-08-17T17:50:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55ee7fc700 1 -- 172.21.15.78:0/3970559349 learned_addr learned my addr 172.21.15.78:0/3970559349 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55eeffd700 1 --2- 172.21.15.78:0/3970559349 >> v2:172.21.15.150:3300/0 conn(0x7f55f014e290 0x7f55f014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55ef7fe700 1 --2- 172.21.15.78:0/3970559349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55f0064890 0x7f55f0158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55ee7fc700 1 -- 172.21.15.78:0/3970559349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55f0064890 msgr2=0x7f55f0158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55ee7fc700 1 --2- 172.21.15.78:0/3970559349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55f0064890 0x7f55f0158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55ee7fc700 1 -- 172.21.15.78:0/3970559349 >> v2:172.21.15.150:3300/0 conn(0x7f55f014e290 msgr2=0x7f55f014e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55ee7fc700 1 --2- 172.21.15.78:0/3970559349 >> v2:172.21.15.150:3300/0 conn(0x7f55f014e290 0x7f55f014e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55ee7fc700 1 -- 172.21.15.78:0/3970559349 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0063280 con 0x7f55f00643e0 2023-08-17T17:50:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55eeffd700 1 --2- 172.21.15.78:0/3970559349 >> v2:172.21.15.150:3300/0 conn(0x7f55f014e290 0x7f55f014e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55ee7fc700 1 --2- 172.21.15.78:0/3970559349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f00643e0 0x7f55f0157c60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f55f0067b70 tx=0x7f55e40090f0).ready entity=mon.0 client_cookie=f6b913d806ab13a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55edffb700 1 -- 172.21.15.78:0/3970559349 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e400b600 con 0x7f55f00643e0 2023-08-17T17:50:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55edffb700 1 -- 172.21.15.78:0/3970559349 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e400b760 con 0x7f55f00643e0 2023-08-17T17:50:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.217+0000 7f55edffb700 1 -- 172.21.15.78:0/3970559349 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e400bae0 con 0x7f55f00643e0 2023-08-17T17:50:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.218+0000 7f55f5937700 1 -- 172.21.15.78:0/3970559349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f00643e0 msgr2=0x7f55f0157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.218+0000 7f55f5937700 1 --2- 172.21.15.78:0/3970559349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f00643e0 0x7f55f0157c60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f55f0067b70 tx=0x7f55e40090f0).stop 2023-08-17T17:50:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.218+0000 7f55f5937700 1 -- 172.21.15.78:0/3970559349 shutdown_connections 2023-08-17T17:50:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.218+0000 7f55f5937700 1 --2- 172.21.15.78:0/3970559349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55f0064890 0x7f55f0158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.218+0000 7f55f5937700 1 --2- 172.21.15.78:0/3970559349 >> v2:172.21.15.150:3300/0 conn(0x7f55f014e290 0x7f55f014e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.218+0000 7f55f5937700 1 --2- 172.21.15.78:0/3970559349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f00643e0 0x7f55f0157c60 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.218+0000 7f55f5937700 1 -- 172.21.15.78:0/3970559349 >> 172.21.15.78:0/3970559349 conn(0x7f55f00c3d40 msgr2=0x7f55f00c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.218+0000 7f55f5937700 1 -- 172.21.15.78:0/3970559349 shutdown_connections 2023-08-17T17:50:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.218+0000 7f55f5937700 1 -- 172.21.15.78:0/3970559349 wait complete. 2023-08-17T17:50:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.219+0000 7f55f5937700 1 Processor -- start 2023-08-17T17:50:14.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.220+0000 7f55f5937700 1 -- start start 2023-08-17T17:50:14.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.220+0000 7f55f5937700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f00643e0 0x7f55f0164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.220+0000 7f55f5937700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f0064890 0x7f55f013d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.220+0000 7f55f5937700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55f014e290 0x7f55f00acc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.220+0000 7f55f5937700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0167ad0 con 0x7f55f0064890 2023-08-17T17:50:14.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.220+0000 7f55f5937700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0136150 con 0x7f55f00643e0 2023-08-17T17:50:14.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.220+0000 7f55f5937700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0164990 con 0x7f55f014e290 2023-08-17T17:50:14.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.220+0000 7f55ee7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f0064890 0x7f55f013d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.220+0000 7f55ee7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f0064890 0x7f55f013d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38330/0 (socket says 172.21.15.78:38330) 2023-08-17T17:50:14.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.220+0000 7f55ee7fc700 1 -- 172.21.15.78:0/227550011 learned_addr learned my addr 172.21.15.78:0/227550011 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:14.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55eeffd700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f00643e0 0x7f55f0164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55ef7fe700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55f014e290 0x7f55f00acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55ee7fc700 1 -- 172.21.15.78:0/227550011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55f014e290 msgr2=0x7f55f00acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55ee7fc700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55f014e290 0x7f55f00acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55ee7fc700 1 -- 172.21.15.78:0/227550011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f00643e0 msgr2=0x7f55f0164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55ee7fc700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f00643e0 0x7f55f0164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55ee7fc700 1 -- 172.21.15.78:0/227550011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e4009370 con 0x7f55f0064890 2023-08-17T17:50:14.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55eeffd700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f00643e0 0x7f55f0164360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:50:14.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55ee7fc700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f0064890 0x7f55f013d8c0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f55e4006fd0 tx=0x7f55e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:14.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55d6ffd700 1 -- 172.21.15.78:0/227550011 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e400b8d0 con 0x7f55f0064890 2023-08-17T17:50:14.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55d6ffd700 1 -- 172.21.15.78:0/227550011 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e400ba30 con 0x7f55f0064890 2023-08-17T17:50:14.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55f5937700 1 -- 172.21.15.78:0/227550011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f0164c70 con 0x7f55f0064890 2023-08-17T17:50:14.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55d6ffd700 1 -- 172.21.15.78:0/227550011 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e401b690 con 0x7f55f0064890 2023-08-17T17:50:14.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.221+0000 7f55f5937700 1 -- 172.21.15.78:0/227550011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f00ad150 con 0x7f55f0064890 2023-08-17T17:50:14.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.222+0000 7f55f5937700 1 -- 172.21.15.78:0/227550011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f0047350 con 0x7f55f0064890 2023-08-17T17:50:14.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.222+0000 7f55d6ffd700 1 -- 172.21.15.78:0/227550011 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f55e400f070 con 0x7f55f0064890 2023-08-17T17:50:14.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.223+0000 7f55d6ffd700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55dc05ede0 0x7f55dc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.223+0000 7f55eeffd700 1 -- 172.21.15.78:0/227550011 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55dc05ede0 msgr2=0x7f55dc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:14.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.223+0000 7f55d6ffd700 1 -- 172.21.15.78:0/227550011 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f55e407b210 con 0x7f55f0064890 2023-08-17T17:50:14.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.223+0000 7f55eeffd700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55dc05ede0 0x7f55dc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:14.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.227+0000 7f55d6ffd700 1 -- 172.21.15.78:0/227550011 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55e404c6b0 con 0x7f55f0064890 2023-08-17T17:50:14.270 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:14.270+0000 7f2884fd0680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.395+0000 7f55f5937700 1 -- 172.21.15.78:0/227550011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55f005ec60 con 0x7f55f0064890 2023-08-17T17:50:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.396+0000 7f55d6ffd700 1 -- 172.21.15.78:0/227550011 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17224 (secure 0 0 0) 0x7f55e404fcd0 con 0x7f55f0064890 2023-08-17T17:50:14.397 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:14.397 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":92,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:50:09.481109+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:51.485390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:52.574728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/2878211067":"2023-08-18T17:50:09.481078+0000","172.21.15.78:6833/119464":"2023-08-18T17:50:09.481078+0000","172.21.15.78:6832/119464":"2023-08-18T17:50:09.481078+0000","172.21.15.78:0/2512351909":"2023-08-18T17:50:09.481078+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:50:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 -- 172.21.15.78:0/227550011 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55dc05ede0 msgr2=0x7f55dc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55dc05ede0 0x7f55dc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 -- 172.21.15.78:0/227550011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f0064890 msgr2=0x7f55f013d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f0064890 0x7f55f013d8c0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f55e4006fd0 tx=0x7f55e4017000).stop 2023-08-17T17:50:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 -- 172.21.15.78:0/227550011 shutdown_connections 2023-08-17T17:50:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55dc05ede0 0x7f55dc0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55f014e290 0x7f55f00acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f00643e0 0x7f55f0164360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 --2- 172.21.15.78:0/227550011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f0064890 0x7f55f013d8c0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 -- 172.21.15.78:0/227550011 >> 172.21.15.78:0/227550011 conn(0x7f55f00c3d40 msgr2=0x7f55f00bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 -- 172.21.15.78:0/227550011 shutdown_connections 2023-08-17T17:50:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.398+0000 7f55f5937700 1 -- 172.21.15.78:0/227550011 wait complete. 2023-08-17T17:50:14.411 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T17:50:14.412 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:50:14.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.527+0000 7ff0a96c4700 1 Processor -- start 2023-08-17T17:50:14.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.527+0000 7ff0a96c4700 1 -- start start 2023-08-17T17:50:14.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a96c4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0a40c01b0 0x7ff0a40c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a96c4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff0a40a7bd0 0x7ff0a4063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a96c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 0x7ff0a40642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a96c4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a4063960 con 0x7ff0a40a7bd0 2023-08-17T17:50:14.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a96c4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a4063030 con 0x7ff0a40c01b0 2023-08-17T17:50:14.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a96c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a4063310 con 0x7ff0a40a8050 2023-08-17T17:50:14.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff0a40a7bd0 0x7ff0a4063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff0a40a7bd0 0x7ff0a4063df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38336/0 (socket says 172.21.15.78:38336) 2023-08-17T17:50:14.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a37fe700 1 -- 172.21.15.78:0/1576732264 learned_addr learned my addr 172.21.15.78:0/1576732264 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:14.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a8ec3700 1 --2- 172.21.15.78:0/1576732264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 0x7ff0a40642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.528+0000 7ff0a3fff700 1 --2- 172.21.15.78:0/1576732264 >> v2:172.21.15.150:3300/0 conn(0x7ff0a40c01b0 0x7ff0a40c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a37fe700 1 -- 172.21.15.78:0/1576732264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 msgr2=0x7ff0a40642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:14.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a37fe700 1 --2- 172.21.15.78:0/1576732264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 0x7ff0a40642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a37fe700 1 -- 172.21.15.78:0/1576732264 >> v2:172.21.15.150:3300/0 conn(0x7ff0a40c01b0 msgr2=0x7ff0a40c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:14.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a37fe700 1 --2- 172.21.15.78:0/1576732264 >> v2:172.21.15.150:3300/0 conn(0x7ff0a40c01b0 0x7ff0a40c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a37fe700 1 -- 172.21.15.78:0/1576732264 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40635f0 con 0x7ff0a40a7bd0 2023-08-17T17:50:14.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a3fff700 1 --2- 172.21.15.78:0/1576732264 >> v2:172.21.15.150:3300/0 conn(0x7ff0a40c01b0 0x7ff0a40c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:50:14.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a37fe700 1 --2- 172.21.15.78:0/1576732264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40a7bd0 0x7ff0a4063df0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7ff0a405e020 tx=0x7ff0980090f0).ready entity=mon.0 client_cookie=10bd99dd5c8b255a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:14.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a2ffd700 1 -- 172.21.15.78:0/1576732264 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800f510 con 0x7ff0a40a7bd0 2023-08-17T17:50:14.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a2ffd700 1 -- 172.21.15.78:0/1576732264 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09800f670 con 0x7ff0a40a7bd0 2023-08-17T17:50:14.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a2ffd700 1 -- 172.21.15.78:0/1576732264 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800fa10 con 0x7ff0a40a7bd0 2023-08-17T17:50:14.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1576732264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40a7bd0 msgr2=0x7ff0a4063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.529+0000 7ff0a96c4700 1 --2- 172.21.15.78:0/1576732264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40a7bd0 0x7ff0a4063df0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7ff0a405e020 tx=0x7ff0980090f0).stop 2023-08-17T17:50:14.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.530+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1576732264 shutdown_connections 2023-08-17T17:50:14.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.530+0000 7ff0a96c4700 1 --2- 172.21.15.78:0/1576732264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 0x7ff0a40642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.530+0000 7ff0a96c4700 1 --2- 172.21.15.78:0/1576732264 >> v2:172.21.15.150:3300/0 conn(0x7ff0a40c01b0 0x7ff0a40c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.530+0000 7ff0a96c4700 1 --2- 172.21.15.78:0/1576732264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40a7bd0 0x7ff0a4063df0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.530+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1576732264 >> 172.21.15.78:0/1576732264 conn(0x7ff0a406a6c0 msgr2=0x7ff0a40cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:14.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.530+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1576732264 shutdown_connections 2023-08-17T17:50:14.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.530+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1576732264 wait complete. 2023-08-17T17:50:14.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.531+0000 7ff0a96c4700 1 Processor -- start 2023-08-17T17:50:14.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.531+0000 7ff0a96c4700 1 -- start start 2023-08-17T17:50:14.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a96c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a40a7bd0 0x7ff0a40c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a96c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 0x7ff0a40af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a96c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40c01b0 0x7ff0a40af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a96c4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40ad670 con 0x7ff0a40c01b0 2023-08-17T17:50:14.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a96c4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a41574b0 con 0x7ff0a40a7bd0 2023-08-17T17:50:14.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a96c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a4156ef0 con 0x7ff0a40a8050 2023-08-17T17:50:14.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a8ec3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40c01b0 0x7ff0a40af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a8ec3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40c01b0 0x7ff0a40af570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38344/0 (socket says 172.21.15.78:38344) 2023-08-17T17:50:14.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a8ec3700 1 -- 172.21.15.78:0/1715777098 learned_addr learned my addr 172.21.15.78:0/1715777098 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:14.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a3fff700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a40a7bd0 0x7ff0a40c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a37fe700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 0x7ff0a40af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a8ec3700 1 -- 172.21.15.78:0/1715777098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 msgr2=0x7ff0a40af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a8ec3700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 0x7ff0a40af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a8ec3700 1 -- 172.21.15.78:0/1715777098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a40a7bd0 msgr2=0x7ff0a40c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a8ec3700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a40a7bd0 0x7ff0a40c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a8ec3700 1 -- 172.21.15.78:0/1715777098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0940092a0 con 0x7ff0a40c01b0 2023-08-17T17:50:14.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a37fe700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 0x7ff0a40af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:14.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a8ec3700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40c01b0 0x7ff0a40af570 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7ff09c009ec0 tx=0x7ff09c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:14.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff08bfff700 1 -- 172.21.15.78:0/1715777098 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00cc20 con 0x7ff0a40c01b0 2023-08-17T17:50:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff08bfff700 1 -- 172.21.15.78:0/1715777098 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c00f040 con 0x7ff0a40c01b0 2023-08-17T17:50:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff08bfff700 1 -- 172.21.15.78:0/1715777098 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c013400 con 0x7ff0a40c01b0 2023-08-17T17:50:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1715777098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff098009370 con 0x7ff0a40c01b0 2023-08-17T17:50:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.532+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1715777098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a4154650 con 0x7ff0a40c01b0 2023-08-17T17:50:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.534+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1715777098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a41544b0 con 0x7ff0a40c01b0 2023-08-17T17:50:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.534+0000 7ff08bfff700 1 -- 172.21.15.78:0/1715777098 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ff09c013770 con 0x7ff0a40c01b0 2023-08-17T17:50:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.534+0000 7ff08bfff700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff09005ede0 0x7ff0900612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.534+0000 7ff0a3fff700 1 -- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff09005ede0 msgr2=0x7ff0900612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:14.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.534+0000 7ff08bfff700 1 -- 172.21.15.78:0/1715777098 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff09c07a7f0 con 0x7ff0a40c01b0 2023-08-17T17:50:14.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.534+0000 7ff0a3fff700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff09005ede0 0x7ff0900612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:14.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.538+0000 7ff08bfff700 1 -- 172.21.15.78:0/1715777098 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0a41544b0 con 0x7ff0a40c01b0 2023-08-17T17:50:14.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.735+0000 7ff0a3fff700 1 -- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff09005ede0 msgr2=0x7ff0900612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:14.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.735+0000 7ff0a3fff700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff09005ede0 0x7ff0900612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:50:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.750+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1715777098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0a41544b0 con 0x7ff0a40c01b0 2023-08-17T17:50:14.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.751+0000 7ff08bfff700 1 -- 172.21.15.78:0/1715777098 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4494 (secure 0 0 0) 0x7ff0a41544b0 con 0x7ff0a40c01b0 2023-08-17T17:50:14.751 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:14.752 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3356030675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3356030675},{"type":"v1","addr":"172.21.15.150:6835","nonce":3356030675}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/807522916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":807522916},{"type":"v1","addr":"172.21.15.78:6837","nonce":807522916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3165905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3165905348},{"type":"v1","addr":"172.21.15.150:6834","nonce":3165905348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:53.608560+0000","modified":"2023-08-17T17:49:55.616581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/4042380652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4042380652},{"type":"v1","addr":"172.21.15.78:6836","nonce":4042380652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T17:50:14.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff09005ede0 msgr2=0x7ff0900612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:14.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff09005ede0 0x7ff0900612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:14.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40c01b0 msgr2=0x7ff0a40af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40c01b0 0x7ff0a40af570 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7ff09c009ec0 tx=0x7ff09c00b040).stop 2023-08-17T17:50:14.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1715777098 shutdown_connections 2023-08-17T17:50:14.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff09005ede0 0x7ff0900612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:14.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0a40c01b0 0x7ff0a40af570 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a40a7bd0 0x7ff0a40c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 --2- 172.21.15.78:0/1715777098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a40a8050 0x7ff0a40af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1715777098 >> 172.21.15.78:0/1715777098 conn(0x7ff0a406a6c0 msgr2=0x7ff0a41534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:14.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1715777098 shutdown_connections 2023-08-17T17:50:14.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.754+0000 7ff0a96c4700 1 -- 172.21.15.78:0/1715777098 wait complete. 2023-08-17T17:50:14.756 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 31 2023-08-17T17:50:14.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:50:14.786 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:14.786+0000 7f955cc9f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:50:14.854 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:14.853+0000 7f955cc9f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:50:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.891+0000 7f98f8d35700 1 Processor -- start 2023-08-17T17:50:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.891+0000 7f98f8d35700 1 -- start start 2023-08-17T17:50:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f8d35700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98f40624f0 0x7f98f40628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f8d35700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98f40c2290 0x7f98f415a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f8d35700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f40c3580 con 0x7f98f4062dc0 2023-08-17T17:50:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f8d35700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f40c26e0 con 0x7f98f40624f0 2023-08-17T17:50:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f8d35700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40c3a10 con 0x7f98f40c2290 2023-08-17T17:50:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f259c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98f40624f0 0x7f98f40628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f259c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98f40624f0 0x7f98f40628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38354/0 (socket says 172.21.15.78:38354) 2023-08-17T17:50:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f1d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f98f4062dc0 0x7f98f40c1b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51366/0 (socket says 172.21.15.78:51366) 2023-08-17T17:50:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f259c700 1 -- 172.21.15.78:0/685660615 learned_addr learned my addr 172.21.15.78:0/685660615 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f259c700 1 -- 172.21.15.78:0/685660615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98f40c2290 msgr2=0x7f98f415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f259c700 1 --2- 172.21.15.78:0/685660615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98f40c2290 0x7f98f415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f259c700 1 -- 172.21.15.78:0/685660615 >> v1:172.21.15.78:6789/0 conn(0x7f98f4062dc0 legacy=0x7f98f40c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f159a700 1 -- 172.21.15.78:0/685660615 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682546324 0 0) 0x7f98f40c3580 con 0x7f98f4062dc0 2023-08-17T17:50:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.892+0000 7f98f259c700 1 -- 172.21.15.78:0/685660615 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f40c2970 con 0x7f98f40624f0 2023-08-17T17:50:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f259c700 1 --2- 172.21.15.78:0/685660615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 0x7f98f40628d0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f98e8006fd0 tx=0x7f98e80090f0).ready entity=mon.0 client_cookie=d171d4804aa895f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f159a700 1 -- 172.21.15.78:0/685660615 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e800b600 con 0x7f98f40624f0 2023-08-17T17:50:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f159a700 1 -- 172.21.15.78:0/685660615 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e800b760 con 0x7f98f40624f0 2023-08-17T17:50:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f159a700 1 -- 172.21.15.78:0/685660615 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e800bb00 con 0x7f98f40624f0 2023-08-17T17:50:14.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f8d35700 1 -- 172.21.15.78:0/685660615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 msgr2=0x7f98f40628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f8d35700 1 --2- 172.21.15.78:0/685660615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 0x7f98f40628d0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f98e8006fd0 tx=0x7f98e80090f0).stop 2023-08-17T17:50:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f8d35700 1 -- 172.21.15.78:0/685660615 shutdown_connections 2023-08-17T17:50:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f8d35700 1 --2- 172.21.15.78:0/685660615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98f40c2290 0x7f98f415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f8d35700 1 --2- 172.21.15.78:0/685660615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 0x7f98f40628d0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f8d35700 1 -- 172.21.15.78:0/685660615 >> 172.21.15.78:0/685660615 conn(0x7f98f40c3d40 msgr2=0x7f98f40c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f8d35700 1 -- 172.21.15.78:0/685660615 shutdown_connections 2023-08-17T17:50:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.893+0000 7f98f8d35700 1 -- 172.21.15.78:0/685660615 wait complete. 2023-08-17T17:50:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.894+0000 7f98f8d35700 1 Processor -- start 2023-08-17T17:50:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.894+0000 7f98f8d35700 1 -- start start 2023-08-17T17:50:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.895+0000 7f98f8d35700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 0x7f98f415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.895+0000 7f98f8d35700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f4062dc0 0x7f98f4162590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.895+0000 7f98f8d35700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98f40c2290 0x7f98f4162a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.895+0000 7f98f8d35700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40bf0d0 con 0x7f98f40624f0 2023-08-17T17:50:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.895+0000 7f98f8d35700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40be4c0 con 0x7f98f4062dc0 2023-08-17T17:50:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.895+0000 7f98f8d35700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40be7a0 con 0x7f98f40c2290 2023-08-17T17:50:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.895+0000 7f98f259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 0x7f98f415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.895+0000 7f98f259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 0x7f98f415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38358/0 (socket says 172.21.15.78:38358) 2023-08-17T17:50:14.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.895+0000 7f98f259c700 1 -- 172.21.15.78:0/2342154000 learned_addr learned my addr 172.21.15.78:0/2342154000 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:14.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f259c700 1 -- 172.21.15.78:0/2342154000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98f40c2290 msgr2=0x7f98f4162a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f2d9d700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98f40c2290 0x7f98f4162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f1d9b700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f4062dc0 0x7f98f4162590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:14.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f259c700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98f40c2290 0x7f98f4162a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f259c700 1 -- 172.21.15.78:0/2342154000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f4062dc0 msgr2=0x7f98f4162590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f259c700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f4062dc0 0x7f98f4162590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f259c700 1 -- 172.21.15.78:0/2342154000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e8009370 con 0x7f98f40624f0 2023-08-17T17:50:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f2d9d700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98f40c2290 0x7f98f4162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f1d9b700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f4062dc0 0x7f98f4162590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f259c700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 0x7f98f415fab0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f98e8009f50 tx=0x7f98e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98e27fc700 1 -- 172.21.15.78:0/2342154000 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e800b8d0 con 0x7f98f40624f0 2023-08-17T17:50:14.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98e27fc700 1 -- 172.21.15.78:0/2342154000 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e800ba30 con 0x7f98f40624f0 2023-08-17T17:50:14.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f8d35700 1 -- 172.21.15.78:0/2342154000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f40bea80 con 0x7f98f40624f0 2023-08-17T17:50:14.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98e27fc700 1 -- 172.21.15.78:0/2342154000 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e801c670 con 0x7f98f40624f0 2023-08-17T17:50:14.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.896+0000 7f98f8d35700 1 -- 172.21.15.78:0/2342154000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f415ffa0 con 0x7f98f40624f0 2023-08-17T17:50:14.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.897+0000 7f98f8d35700 1 -- 172.21.15.78:0/2342154000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f40bf3b0 con 0x7f98f40624f0 2023-08-17T17:50:14.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.897+0000 7f98e27fc700 1 -- 172.21.15.78:0/2342154000 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f98e802c070 con 0x7f98f40624f0 2023-08-17T17:50:14.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.898+0000 7f98e27fc700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98d405ede0 0x7f98d40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:14.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.898+0000 7f98f1d9b700 1 -- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98d405ede0 msgr2=0x7f98d40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:14.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.898+0000 7f98e27fc700 1 -- 172.21.15.78:0/2342154000 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f98e807b8c0 con 0x7f98f40624f0 2023-08-17T17:50:14.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.898+0000 7f98f1d9b700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98d405ede0 0x7f98d40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:14.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:14.902+0000 7f98e27fc700 1 -- 172.21.15.78:0/2342154000 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f98e804cce0 con 0x7f98f40624f0 2023-08-17T17:50:14.929 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:14.929+0000 7f955cc9f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:50:14.959 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:14.959+0000 7f2884fd0680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:50:15.031 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:15.031+0000 7f2884fd0680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:50:15.074 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:15.074+0000 7f955cc9f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:50:15.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.099+0000 7f98f1d9b700 1 -- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98d405ede0 msgr2=0x7f98d40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:15.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.099+0000 7f98f1d9b700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98d405ede0 0x7f98d40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:50:15.109 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:15.109+0000 7f2884fd0680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:50:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.113+0000 7f98f8d35700 1 -- 172.21.15.78:0/2342154000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98f4047350 con 0x7f98f40624f0 2023-08-17T17:50:15.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.114+0000 7f98e27fc700 1 -- 172.21.15.78:0/2342154000 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f98f4047350 con 0x7f98f40624f0 2023-08-17T17:50:15.114 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:15.114 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3356030675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3356030675},{"type":"v1","addr":"172.21.15.150:6835","nonce":3356030675}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/807522916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":807522916},{"type":"v1","addr":"172.21.15.78:6837","nonce":807522916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3165905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3165905348},{"type":"v1","addr":"172.21.15.150:6834","nonce":3165905348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:49:53.608560+0000","modified":"2023-08-17T17:49:55.616581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/4042380652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4042380652},{"type":"v1","addr":"172.21.15.78:6836","nonce":4042380652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T17:50:15.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 -- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98d405ede0 msgr2=0x7f98d40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:15.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98d405ede0 0x7f98d40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:15.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 -- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 msgr2=0x7f98f415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 0x7f98f415fab0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f98e8009f50 tx=0x7f98e8017000).stop 2023-08-17T17:50:15.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 -- 172.21.15.78:0/2342154000 shutdown_connections 2023-08-17T17:50:15.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98d405ede0 0x7f98d40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:15.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98f40c2290 0x7f98f4162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98f40624f0 0x7f98f415fab0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 --2- 172.21.15.78:0/2342154000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f4062dc0 0x7f98f4162590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 -- 172.21.15.78:0/2342154000 >> 172.21.15.78:0/2342154000 conn(0x7f98f40c3d40 msgr2=0x7f98f40c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:15.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 -- 172.21.15.78:0/2342154000 shutdown_connections 2023-08-17T17:50:15.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.116+0000 7f98f8d35700 1 -- 172.21.15.78:0/2342154000 wait complete. 2023-08-17T17:50:15.118 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 31 2023-08-17T17:50:15.129 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:50:15.145 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:15.144+0000 7f955cc9f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:50:15.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.245+0000 7ff0c6b0d700 1 Processor -- start 2023-08-17T17:50:15.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.245+0000 7ff0c6b0d700 1 -- start start 2023-08-17T17:50:15.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c6b0d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff0c0064180 0x7ff0c00c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c6b0d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c00c4040 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c6b0d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c00c50d0 con 0x7ff0c00bef00 2023-08-17T17:50:15.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c6b0d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c0064610 con 0x7ff0c0064180 2023-08-17T17:50:15.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c50aa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff0c0064180 0x7ff0c00c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:15.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c48a9700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff0c00a7fe0 0x7ff0c00be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51382/0 (socket says 172.21.15.78:51382) 2023-08-17T17:50:15.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c50aa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff0c0064180 0x7ff0c00c4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38374/0 (socket says 172.21.15.78:38374) 2023-08-17T17:50:15.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c48a9700 1 -- 172.21.15.78:0/3269437645 learned_addr learned my addr 172.21.15.78:0/3269437645 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:15.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c50aa700 1 -- 172.21.15.78:0/3269437645 >> v1:172.21.15.150:6789/0 conn(0x7ff0c00bef00 legacy=0x7ff0c00c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c50aa700 1 -- 172.21.15.78:0/3269437645 >> v1:172.21.15.78:6789/0 conn(0x7ff0c00a7fe0 legacy=0x7ff0c00be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0bf7fe700 1 -- 172.21.15.78:0/3269437645 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807179956 0 0) 0x7ff0c00c4040 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c50aa700 1 -- 172.21.15.78:0/3269437645 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00c3430 con 0x7ff0c0064180 2023-08-17T17:50:15.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0c50aa700 1 --2- 172.21.15.78:0/3269437645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c0064180 0x7ff0c00c4be0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7ff0b8009e60 tx=0x7ff0b8009780).ready entity=mon.0 client_cookie=6e301a0f773f3040 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:15.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0bf7fe700 1 -- 172.21.15.78:0/3269437645 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b800e070 con 0x7ff0c0064180 2023-08-17T17:50:15.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0bf7fe700 1 -- 172.21.15.78:0/3269437645 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b800bc30 con 0x7ff0c0064180 2023-08-17T17:50:15.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.246+0000 7ff0bf7fe700 1 -- 172.21.15.78:0/3269437645 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8012410 con 0x7ff0c0064180 2023-08-17T17:50:15.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.247+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3269437645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c0064180 msgr2=0x7ff0c00c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.247+0000 7ff0c6b0d700 1 --2- 172.21.15.78:0/3269437645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c0064180 0x7ff0c00c4be0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7ff0b8009e60 tx=0x7ff0b8009780).stop 2023-08-17T17:50:15.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.247+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3269437645 shutdown_connections 2023-08-17T17:50:15.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.247+0000 7ff0c6b0d700 1 --2- 172.21.15.78:0/3269437645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c0064180 0x7ff0c00c4be0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.247+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3269437645 >> 172.21.15.78:0/3269437645 conn(0x7ff0c0092330 msgr2=0x7ff0c0062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:15.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.247+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3269437645 shutdown_connections 2023-08-17T17:50:15.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.247+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3269437645 wait complete. 2023-08-17T17:50:15.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.248+0000 7ff0c6b0d700 1 Processor -- start 2023-08-17T17:50:15.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.248+0000 7ff0c6b0d700 1 -- start start 2023-08-17T17:50:15.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0c6b0d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0c0064180 0x7ff0c00a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0c6b0d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c00a7fe0 0x7ff0c00aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0c6b0d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0c00bef00 0x7ff0c00c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0c6b0d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00ab270 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0c6b0d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00aad50 con 0x7ff0c00bef00 2023-08-17T17:50:15.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0c6b0d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00c1730 con 0x7ff0c0064180 2023-08-17T17:50:15.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0bffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c00a7fe0 0x7ff0c00aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:15.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0bffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c00a7fe0 0x7ff0c00aa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38380/0 (socket says 172.21.15.78:38380) 2023-08-17T17:50:15.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0bffff700 1 -- 172.21.15.78:0/3512392088 learned_addr learned my addr 172.21.15.78:0/3512392088 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:15.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0c48a9700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0c0064180 0x7ff0c00a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:15.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.249+0000 7ff0c50aa700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0c00bef00 0x7ff0c00c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:15.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0bffff700 1 -- 172.21.15.78:0/3512392088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0c0064180 msgr2=0x7ff0c00a97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0bffff700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0c0064180 0x7ff0c00a97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0bffff700 1 -- 172.21.15.78:0/3512392088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0c00bef00 msgr2=0x7ff0c00c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0bffff700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0c00bef00 0x7ff0c00c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0bffff700 1 -- 172.21.15.78:0/3512392088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8009a20 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0bffff700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c00a7fe0 0x7ff0c00aa860 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7ff0ac00c440 tx=0x7ff0ac007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:15.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0bcff9700 1 -- 172.21.15.78:0/3512392088 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac007020 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0bcff9700 1 -- 172.21.15.78:0/3512392088 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac007180 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3512392088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c0154100 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0bcff9700 1 -- 172.21.15.78:0/3512392088 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac007520 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.250+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3512392088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c00aaf90 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.251+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3512392088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c00c18a0 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.251+0000 7ff0bcff9700 1 -- 172.21.15.78:0/3512392088 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ff0ac010070 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.252+0000 7ff0bcff9700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff0a405ede0 0x7ff0a40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.252+0000 7ff0c48a9700 1 -- 172.21.15.78:0/3512392088 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff0a405ede0 msgr2=0x7ff0a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:15.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.252+0000 7ff0bcff9700 1 -- 172.21.15.78:0/3512392088 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff0ac079490 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.252+0000 7ff0c48a9700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff0a405ede0 0x7ff0a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:15.259 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:15.259+0000 7f955cc9f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:50:15.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.259+0000 7ff0bcff9700 1 -- 172.21.15.78:0/3512392088 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0ac04a8b0 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.271 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:15.271+0000 7f2884fd0680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:50:15.345 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:15.345+0000 7f2884fd0680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:50:15.368 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:15.367+0000 7f955cc9f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.430+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3512392088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0c0047350 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.432+0000 7ff0bcff9700 1 -- 172.21.15.78:0/3512392088 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17224 (secure 0 0 0) 0x7ff0ac04ded0 con 0x7ff0c00a7fe0 2023-08-17T17:50:15.432 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:15.433 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":92,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:50:09.481109+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:49:51.485390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T17:49:52.574728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/2878211067":"2023-08-18T17:50:09.481078+0000","172.21.15.78:6833/119464":"2023-08-18T17:50:09.481078+0000","172.21.15.78:6832/119464":"2023-08-18T17:50:09.481078+0000","172.21.15.78:0/2512351909":"2023-08-18T17:50:09.481078+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:50:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3512392088 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff0a405ede0 msgr2=0x7ff0a40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff0a405ede0 0x7ff0a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3512392088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c00a7fe0 msgr2=0x7ff0c00aa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c00a7fe0 0x7ff0c00aa860 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7ff0ac00c440 tx=0x7ff0ac007dd0).stop 2023-08-17T17:50:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3512392088 shutdown_connections 2023-08-17T17:50:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff0a405ede0 0x7ff0a40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0c00bef00 0x7ff0c00c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0c0064180 0x7ff0c00a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 --2- 172.21.15.78:0/3512392088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0c00a7fe0 0x7ff0c00aa860 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3512392088 >> 172.21.15.78:0/3512392088 conn(0x7ff0c0092330 msgr2=0x7ff0c0067590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3512392088 shutdown_connections 2023-08-17T17:50:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.434+0000 7ff0c6b0d700 1 -- 172.21.15.78:0/3512392088 wait complete. 2023-08-17T17:50:15.446 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T17:50:15.468 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:15.468+0000 7f2884fd0680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:50:15.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.563+0000 7fd2480db700 1 Processor -- start 2023-08-17T17:50:15.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.564+0000 7fd2480db700 1 -- start start 2023-08-17T17:50:15.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.564+0000 7fd2480db700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd2401541a0 0x7fd2400a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.564+0000 7fd2480db700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2400c0560 0x7fd2400c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.564+0000 7fd2480db700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2400c8df0 con 0x7fd240154580 2023-08-17T17:50:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.564+0000 7fd2480db700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2400a8190 con 0x7fd2401541a0 2023-08-17T17:50:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.564+0000 7fd2480db700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400c9970 con 0x7fd2400c0560 2023-08-17T17:50:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd246678700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2400c0560 0x7fd2400c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd245e77700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd2401541a0 0x7fd2400a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd246678700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2400c0560 0x7fd2400c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:57514/0 (socket says 172.21.15.78:57514) 2023-08-17T17:50:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd246678700 1 -- 172.21.15.78:0/2977700147 learned_addr learned my addr 172.21.15.78:0/2977700147 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd245676700 1 --1- 172.21.15.78:0/2977700147 >> v1:172.21.15.150:6789/0 conn(0x7fd240154580 0x7fd2400bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:47322/0 (socket says 172.21.15.78:47322) 2023-08-17T17:50:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd246678700 1 -- 172.21.15.78:0/2977700147 >> v2:172.21.15.150:3300/0 conn(0x7fd2401541a0 msgr2=0x7fd2400a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd246678700 1 --2- 172.21.15.78:0/2977700147 >> v2:172.21.15.150:3300/0 conn(0x7fd2401541a0 0x7fd2400a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd246678700 1 -- 172.21.15.78:0/2977700147 >> v1:172.21.15.150:6789/0 conn(0x7fd240154580 legacy=0x7fd2400bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd246678700 1 -- 172.21.15.78:0/2977700147 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400c9040 con 0x7fd2400c0560 2023-08-17T17:50:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd245e77700 1 --2- 172.21.15.78:0/2977700147 >> v2:172.21.15.150:3300/0 conn(0x7fd2401541a0 0x7fd2400a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:50:15.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd246678700 1 --2- 172.21.15.78:0/2977700147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2400c0560 0x7fd2400c6f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd238009f20 tx=0x7fd238009840).ready entity=mon.2 client_cookie=dca74d9165115362 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:15.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd244e75700 1 -- 172.21.15.78:0/2977700147 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800e070 con 0x7fd2400c0560 2023-08-17T17:50:15.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd244e75700 1 -- 172.21.15.78:0/2977700147 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800b9d0 con 0x7fd2400c0560 2023-08-17T17:50:15.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.565+0000 7fd244e75700 1 -- 172.21.15.78:0/2977700147 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800bd50 con 0x7fd2400c0560 2023-08-17T17:50:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.566+0000 7fd2480db700 1 -- 172.21.15.78:0/2977700147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2400c0560 msgr2=0x7fd2400c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.566+0000 7fd2480db700 1 --2- 172.21.15.78:0/2977700147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2400c0560 0x7fd2400c6f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd238009f20 tx=0x7fd238009840).stop 2023-08-17T17:50:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.566+0000 7fd2480db700 1 -- 172.21.15.78:0/2977700147 shutdown_connections 2023-08-17T17:50:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.566+0000 7fd2480db700 1 --2- 172.21.15.78:0/2977700147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2400c0560 0x7fd2400c6f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.566+0000 7fd2480db700 1 --2- 172.21.15.78:0/2977700147 >> v2:172.21.15.150:3300/0 conn(0x7fd2401541a0 0x7fd2400a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.566+0000 7fd2480db700 1 -- 172.21.15.78:0/2977700147 >> 172.21.15.78:0/2977700147 conn(0x7fd24006a400 msgr2=0x7fd2400caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.566+0000 7fd2480db700 1 -- 172.21.15.78:0/2977700147 shutdown_connections 2023-08-17T17:50:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.566+0000 7fd2480db700 1 -- 172.21.15.78:0/2977700147 wait complete. 2023-08-17T17:50:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.567+0000 7fd2480db700 1 Processor -- start 2023-08-17T17:50:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.567+0000 7fd2480db700 1 -- start start 2023-08-17T17:50:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd2480db700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2400c0560 0x7fd2400ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd2480db700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2401541a0 0x7fd2400ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd2480db700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd240154580 0x7fd2400afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd2480db700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24014f790 con 0x7fd2400c0560 2023-08-17T17:50:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd2480db700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240146bc0 con 0x7fd240154580 2023-08-17T17:50:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd2480db700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400ae860 con 0x7fd2401541a0 2023-08-17T17:50:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd245e77700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2400c0560 0x7fd2400ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd245e77700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2400c0560 0x7fd2400ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38386/0 (socket says 172.21.15.78:38386) 2023-08-17T17:50:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd245e77700 1 -- 172.21.15.78:0/897819078 learned_addr learned my addr 172.21.15.78:0/897819078 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd245676700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2401541a0 0x7fd2400ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd246678700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd240154580 0x7fd2400afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd245e77700 1 -- 172.21.15.78:0/897819078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2401541a0 msgr2=0x7fd2400ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd245e77700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2401541a0 0x7fd2400ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd245e77700 1 -- 172.21.15.78:0/897819078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd240154580 msgr2=0x7fd2400afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd245e77700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd240154580 0x7fd2400afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd245e77700 1 -- 172.21.15.78:0/897819078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300092a0 con 0x7fd2400c0560 2023-08-17T17:50:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.568+0000 7fd245e77700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2400c0560 0x7fd2400ade80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fd23000e980 tx=0x7fd230009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.569+0000 7fd235ffb700 1 -- 172.21.15.78:0/897819078 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230012600 con 0x7fd2400c0560 2023-08-17T17:50:15.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.569+0000 7fd235ffb700 1 -- 172.21.15.78:0/897819078 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230012760 con 0x7fd2400c0560 2023-08-17T17:50:15.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.569+0000 7fd2480db700 1 -- 172.21.15.78:0/897819078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd238009ae0 con 0x7fd2400c0560 2023-08-17T17:50:15.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.569+0000 7fd235ffb700 1 -- 172.21.15.78:0/897819078 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230012ae0 con 0x7fd2400c0560 2023-08-17T17:50:15.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.569+0000 7fd2480db700 1 -- 172.21.15.78:0/897819078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2400c2c70 con 0x7fd2400c0560 2023-08-17T17:50:15.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.570+0000 7fd235ffb700 1 -- 172.21.15.78:0/897819078 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fd230022070 con 0x7fd2400c0560 2023-08-17T17:50:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.570+0000 7fd2480db700 1 -- 172.21.15.78:0/897819078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2400c32c0 con 0x7fd2400c0560 2023-08-17T17:50:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.570+0000 7fd235ffb700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd22405ede0 0x7fd2240612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.570+0000 7fd245676700 1 -- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd22405ede0 msgr2=0x7fd2240612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.570+0000 7fd235ffb700 1 -- 172.21.15.78:0/897819078 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd23007a010 con 0x7fd2400c0560 2023-08-17T17:50:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.570+0000 7fd245676700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd22405ede0 0x7fd2240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.575+0000 7fd235ffb700 1 -- 172.21.15.78:0/897819078 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd23004b430 con 0x7fd2400c0560 2023-08-17T17:50:15.592 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:15.592+0000 7f2884fd0680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:15.660 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:15.659+0000 7f955cc9f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:50:15.729 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:15.729+0000 7f955cc9f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:50:15.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.771+0000 7fd245676700 1 -- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd22405ede0 msgr2=0x7fd2240612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:15.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.771+0000 7fd245676700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd22405ede0 0x7fd2240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:50:15.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.799+0000 7fd2480db700 1 -- 172.21.15.78:0/897819078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd240047350 con 0x7fd2400c0560 2023-08-17T17:50:15.896 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:15.895+0000 7f2884fd0680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:50:15.969 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:15.969+0000 7f2884fd0680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:50:15.988 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:50:15.988+0000 7f9b56d2a700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:50:15.988 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:50:15.988+0000 7f9b56d2a700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:50:15.988 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:50:15.988+0000 7f9b56d2a700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:50:15.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.988+0000 7fd235ffb700 1 -- 172.21.15.78:0/897819078 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 36) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fd230077d90 con 0x7fd2400c0560 2023-08-17T17:50:15.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.988+0000 7fd235ffb700 1 -- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd22405ede0 msgr2=0x7fd2240612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:15.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:15.988+0000 7fd235ffb700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd22405ede0 0x7fd2240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:15.991 INFO:tasks.ceph.mds.c.smithi078.stderr: -1133> 2023-08-17T17:49:58.866+0000 7f9b5a531700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:50:15.993 INFO:tasks.ceph.mds.c.smithi078.stderr: -5> 2023-08-17T17:50:15.988+0000 7f9b56d2a700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:50:15.993 INFO:tasks.ceph.mds.c.smithi078.stderr: -3> 2023-08-17T17:50:15.988+0000 7f9b56d2a700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:50:15.993 INFO:tasks.ceph.mds.c.smithi078.stderr: -1> 2023-08-17T17:50:15.988+0000 7f9b56d2a700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:50:16.011 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:50:16.049 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:16.049+0000 7f2804fb1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:16.049 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:16.049+0000 7f2804fb1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:16.049 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:16.049+0000 7f2804fb1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:16.049 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:16.049+0000 7f2804fb1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:16.050 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:16.049+0000 7f2804fb1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:16.050 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:16.049+0000 7f2807fb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:16.050 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:16.049+0000 7f2807fb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:16.050 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:16.049+0000 7f2807fb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:16.051 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:16.049+0000 7f2807fb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:16.051 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:16.049+0000 7f2807fb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:16.527 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T17:50:16.527+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T17:50:16.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.536+0000 7fd235ffb700 1 -- 172.21.15.78:0/897819078 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd23006c990 con 0x7fd2400c0560 2023-08-17T17:50:16.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.538+0000 7fd2480db700 1 -- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2400c0560 msgr2=0x7fd2400ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:16.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.538+0000 7fd2480db700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2400c0560 0x7fd2400ade80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fd23000e980 tx=0x7fd230009060).stop 2023-08-17T17:50:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.538+0000 7fd2480db700 1 -- 172.21.15.78:0/897819078 shutdown_connections 2023-08-17T17:50:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.538+0000 7fd2480db700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd22405ede0 0x7fd2240612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.538+0000 7fd2480db700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd240154580 0x7fd2400afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.538+0000 7fd2480db700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2400c0560 0x7fd2400ade80 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.538+0000 7fd2480db700 1 --2- 172.21.15.78:0/897819078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2401541a0 0x7fd2400ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.538+0000 7fd2480db700 1 -- 172.21.15.78:0/897819078 >> 172.21.15.78:0/897819078 conn(0x7fd24006a400 msgr2=0x7fd2401592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.538+0000 7fd2480db700 1 -- 172.21.15.78:0/897819078 shutdown_connections 2023-08-17T17:50:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.538+0000 7fd2480db700 1 -- 172.21.15.78:0/897819078 wait complete. 2023-08-17T17:50:16.540 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T17:50:16.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T17:50:16.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.705+0000 7f6948958700 1 Processor -- start 2023-08-17T17:50:16.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.705+0000 7f6948958700 1 -- start start 2023-08-17T17:50:16.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f6948958700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6944151a40 0x7f69440c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:16.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f6948958700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6944151e20 0x7f69440c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:16.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f6948958700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69440c6620 con 0x7f6944157be0 2023-08-17T17:50:16.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f6948958700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69440c6900 con 0x7f6944151a40 2023-08-17T17:50:16.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f6948958700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69440c6be0 con 0x7f6944151e20 2023-08-17T17:50:16.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f69437fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6944151a40 0x7f69440c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:16.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f69437fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6944151a40 0x7f69440c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38482/0 (socket says 172.21.15.78:38482) 2023-08-17T17:50:16.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f69437fe700 1 -- 172.21.15.78:0/1552635520 learned_addr learned my addr 172.21.15.78:0/1552635520 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:16.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f6942ffd700 1 --2- 172.21.15.78:0/1552635520 >> v2:172.21.15.150:3300/0 conn(0x7f6944151e20 0x7f69440c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:16.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f69437fe700 1 -- 172.21.15.78:0/1552635520 >> v2:172.21.15.150:3300/0 conn(0x7f6944151e20 msgr2=0x7f69440c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:16.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f69437fe700 1 --2- 172.21.15.78:0/1552635520 >> v2:172.21.15.150:3300/0 conn(0x7f6944151e20 0x7f69440c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:16.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f69437fe700 1 -- 172.21.15.78:0/1552635520 >> v1:172.21.15.150:6789/0 conn(0x7f6944157be0 legacy=0x7f6944154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:16.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f69437fe700 1 -- 172.21.15.78:0/1552635520 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69440c6ec0 con 0x7f6944151a40 2023-08-17T17:50:16.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f6942ffd700 1 --2- 172.21.15.78:0/1552635520 >> v2:172.21.15.150:3300/0 conn(0x7f6944151e20 0x7f69440c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:16.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.706+0000 7f69437fe700 1 --2- 172.21.15.78:0/1552635520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151a40 0x7f69440c8260 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f6944065360 tx=0x7f6934009060).ready entity=mon.0 client_cookie=bea2b028db2eb796 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:16.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f69427fc700 1 -- 172.21.15.78:0/1552635520 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6934005880 con 0x7f6944151a40 2023-08-17T17:50:16.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f69427fc700 1 -- 172.21.15.78:0/1552635520 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69340059e0 con 0x7f6944151a40 2023-08-17T17:50:16.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f69427fc700 1 -- 172.21.15.78:0/1552635520 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6934005d60 con 0x7f6944151a40 2023-08-17T17:50:16.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f6948958700 1 -- 172.21.15.78:0/1552635520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151a40 msgr2=0x7f69440c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:16.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f6948958700 1 --2- 172.21.15.78:0/1552635520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151a40 0x7f69440c8260 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f6944065360 tx=0x7f6934009060).stop 2023-08-17T17:50:16.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f6948958700 1 -- 172.21.15.78:0/1552635520 shutdown_connections 2023-08-17T17:50:16.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f6948958700 1 --2- 172.21.15.78:0/1552635520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151a40 0x7f69440c8260 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:16.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f6948958700 1 --2- 172.21.15.78:0/1552635520 >> v2:172.21.15.150:3300/0 conn(0x7f6944151e20 0x7f69440c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:16.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f6948958700 1 -- 172.21.15.78:0/1552635520 >> 172.21.15.78:0/1552635520 conn(0x7f69440943b0 msgr2=0x7f694406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:16.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f6948958700 1 -- 172.21.15.78:0/1552635520 shutdown_connections 2023-08-17T17:50:16.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.707+0000 7f6948958700 1 -- 172.21.15.78:0/1552635520 wait complete. 2023-08-17T17:50:16.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.708+0000 7f6948958700 1 Processor -- start 2023-08-17T17:50:16.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.708+0000 7f6948958700 1 -- start start 2023-08-17T17:50:16.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f6948958700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6944151a40 0x7f6944168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:16.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f6948958700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151e20 0x7f69440c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:16.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f6948958700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6944157be0 0x7f69440adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:16.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f6948958700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69440c2d90 con 0x7f6944151e20 2023-08-17T17:50:16.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f6948958700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69440c2270 con 0x7f6944157be0 2023-08-17T17:50:16.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f6948958700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69440c24f0 con 0x7f6944151a40 2023-08-17T17:50:16.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f6942ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151e20 0x7f69440c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:16.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f6942ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151e20 0x7f69440c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38484/0 (socket says 172.21.15.78:38484) 2023-08-17T17:50:16.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f6942ffd700 1 -- 172.21.15.78:0/3785108399 learned_addr learned my addr 172.21.15.78:0/3785108399 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:16.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f6943fff700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6944157be0 0x7f69440adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:16.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.709+0000 7f69437fe700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6944151a40 0x7f6944168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:16.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f6942ffd700 1 -- 172.21.15.78:0/3785108399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6944151a40 msgr2=0x7f6944168ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:16.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f6942ffd700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6944151a40 0x7f6944168ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:16.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f6942ffd700 1 -- 172.21.15.78:0/3785108399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6944157be0 msgr2=0x7f69440adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:16.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f6942ffd700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6944157be0 0x7f69440adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:16.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f6942ffd700 1 -- 172.21.15.78:0/3785108399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6934009300 con 0x7f6944151e20 2023-08-17T17:50:16.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f6942ffd700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151e20 0x7f69440c1d80 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f693800d890 tx=0x7f6938008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f692b7fe700 1 -- 172.21.15.78:0/3785108399 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938017070 con 0x7f6944151e20 2023-08-17T17:50:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f692b7fe700 1 -- 172.21.15.78:0/3785108399 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6938005880 con 0x7f6944151e20 2023-08-17T17:50:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f6948958700 1 -- 172.21.15.78:0/3785108399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69440c27d0 con 0x7f6944151e20 2023-08-17T17:50:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f692b7fe700 1 -- 172.21.15.78:0/3785108399 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938005c00 con 0x7f6944151e20 2023-08-17T17:50:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.710+0000 7f6948958700 1 -- 172.21.15.78:0/3785108399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69440c3c20 con 0x7f6944151e20 2023-08-17T17:50:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.711+0000 7f6948958700 1 -- 172.21.15.78:0/3785108399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69440c3de0 con 0x7f6944151e20 2023-08-17T17:50:16.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.711+0000 7f692b7fe700 1 -- 172.21.15.78:0/3785108399 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 36) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f6938006020 con 0x7f6944151e20 2023-08-17T17:50:16.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.712+0000 7f692b7fe700 1 -- 172.21.15.78:0/3785108399 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f6938079df0 con 0x7f6944151e20 2023-08-17T17:50:16.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.716+0000 7f692b7fe700 1 -- 172.21.15.78:0/3785108399 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f693804b140 con 0x7f6944151e20 2023-08-17T17:50:16.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.919+0000 7f6948958700 1 -- 172.21.15.78:0/3785108399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6944082f90 con 0x7f6944151e20 2023-08-17T17:50:16.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.991+0000 7f692b7fe700 1 -- 172.21.15.78:0/3785108399 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 37) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f6938077aa0 con 0x7f6944151e20 2023-08-17T17:50:16.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.992+0000 7f692b7fe700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69300301b0 0x7f69300677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:16.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.992+0000 7f69437fe700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69300301b0 0x7f69300677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:16.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:16.994+0000 7f69437fe700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69300301b0 0x7f69300677e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f693400b3c0 tx=0x7f6934016000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:17.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.539+0000 7f692b7fe700 1 -- 172.21.15.78:0/3785108399 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f693806ee50 con 0x7f6944151e20 2023-08-17T17:50:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 -- 172.21.15.78:0/3785108399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69300301b0 msgr2=0x7f69300677e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69300301b0 0x7f69300677e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f693400b3c0 tx=0x7f6934016000).stop 2023-08-17T17:50:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 -- 172.21.15.78:0/3785108399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151e20 msgr2=0x7f69440c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151e20 0x7f69440c1d80 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f693800d890 tx=0x7f6938008040).stop 2023-08-17T17:50:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 -- 172.21.15.78:0/3785108399 shutdown_connections 2023-08-17T17:50:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69300301b0 0x7f69300677e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6944157be0 0x7f69440adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6944151a40 0x7f6944168ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 --2- 172.21.15.78:0/3785108399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6944151e20 0x7f69440c1d80 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 -- 172.21.15.78:0/3785108399 >> 172.21.15.78:0/3785108399 conn(0x7f69440943b0 msgr2=0x7f694406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 -- 172.21.15.78:0/3785108399 shutdown_connections 2023-08-17T17:50:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.542+0000 7f6948958700 1 -- 172.21.15.78:0/3785108399 wait complete. 2023-08-17T17:50:17.554 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T17:50:17.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.672+0000 7f22f9c34700 1 Processor -- start 2023-08-17T17:50:17.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.672+0000 7f22f9c34700 1 -- start start 2023-08-17T17:50:17.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.673+0000 7f22f9c34700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22f40aa4d0 0x7f22f40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:17.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.673+0000 7f22f9c34700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c5810 0x7f22f40c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:17.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.673+0000 7f22f9c34700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f40649b0 con 0x7f22f40aa0f0 2023-08-17T17:50:17.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.673+0000 7f22f9c34700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f40c6170 con 0x7f22f40aa4d0 2023-08-17T17:50:17.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.673+0000 7f22f9c34700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f4063420 con 0x7f22f40c5810 2023-08-17T17:50:17.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.673+0000 7f22f37fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f22f40aa0f0 0x7f22f40c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51386/0 (socket says 172.21.15.78:51386) 2023-08-17T17:50:17.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.673+0000 7f22f37fe700 1 -- 172.21.15.78:0/4070499516 learned_addr learned my addr 172.21.15.78:0/4070499516 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:17.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496312150 0 0) 0x7f22f40649b0 con 0x7f22f40aa0f0 2023-08-17T17:50:17.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f2ffd700 1 --2- 172.21.15.78:0/4070499516 >> v2:172.21.15.150:3300/0 conn(0x7f22f40aa4d0 0x7f22f40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:17.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22dc0033f0 con 0x7f22f40aa0f0 2023-08-17T17:50:17.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f3fff700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c5810 0x7f22f40c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:17.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2182278609 0 0) 0x7f22dc0033f0 con 0x7f22f40aa0f0 2023-08-17T17:50:17.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c5810 msgr2=0x7f22f40c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:17.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c5810 0x7f22f40c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:17.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 >> v2:172.21.15.150:3300/0 conn(0x7f22f40aa4d0 msgr2=0x7f22f40644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:17.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 --2- 172.21.15.78:0/4070499516 >> v2:172.21.15.150:3300/0 conn(0x7f22f40aa4d0 0x7f22f40644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:17.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4063700 con 0x7f22f40aa0f0 2023-08-17T17:50:17.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f22e4001470 con 0x7f22f40aa0f0 2023-08-17T17:50:17.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 >> v1:172.21.15.78:6789/0 conn(0x7f22f40aa0f0 legacy=0x7f22f40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:17.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 0x7f22dc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:17.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc004690 0x7f22dc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:17.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c5810 0x7f22dc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:17.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40c6170 con 0x7f22dc0038e0 2023-08-17T17:50:17.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f4063420 con 0x7f22dc004690 2023-08-17T17:50:17.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc00b8e0 con 0x7f22f40c5810 2023-08-17T17:50:17.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f37fe700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 0x7f22dc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:17.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f2ffd700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc004690 0x7f22dc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:17.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f3fff700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c5810 0x7f22dc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:17.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f37fe700 1 -- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c5810 msgr2=0x7f22dc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:17.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f37fe700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c5810 0x7f22dc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:17.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f37fe700 1 -- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc004690 msgr2=0x7f22dc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:17.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f37fe700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc004690 0x7f22dc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:17.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.674+0000 7f22f37fe700 1 -- 172.21.15.78:0/4070499516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0033f0 con 0x7f22dc0038e0 2023-08-17T17:50:17.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f37fe700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 0x7f22dc003d00 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f22e400c210 tx=0x7f22e4001e90).ready entity=mon.0 client_cookie=e4c24dba0df4628d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:17.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4007a60 con 0x7f22dc0038e0 2023-08-17T17:50:17.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e400cae0 con 0x7f22dc0038e0 2023-08-17T17:50:17.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f27fc700 1 -- 172.21.15.78:0/4070499516 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e400ce60 con 0x7f22dc0038e0 2023-08-17T17:50:17.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f9c34700 1 -- 172.21.15.78:0/4070499516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 msgr2=0x7f22dc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:17.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f9c34700 1 --2- 172.21.15.78:0/4070499516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 0x7f22dc003d00 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f22e400c210 tx=0x7f22e4001e90).stop 2023-08-17T17:50:17.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f3fff700 1 -- 172.21.15.78:0/4070499516 reap_dead start 2023-08-17T17:50:17.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f9c34700 1 -- 172.21.15.78:0/4070499516 shutdown_connections 2023-08-17T17:50:17.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f9c34700 1 -- 172.21.15.78:0/4070499516 >> 172.21.15.78:0/4070499516 conn(0x7f22f406a6a0 msgr2=0x7f22f40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:17.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f9c34700 1 -- 172.21.15.78:0/4070499516 shutdown_connections 2023-08-17T17:50:17.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.675+0000 7f22f9c34700 1 -- 172.21.15.78:0/4070499516 wait complete. 2023-08-17T17:50:17.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f9c34700 1 Processor -- start 2023-08-17T17:50:17.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f9c34700 1 -- start start 2023-08-17T17:50:17.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f9c34700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 0x7f22f4151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f9c34700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c1ac0 0x7f22f40c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f9c34700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22f40c3680 0x7f22f40c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f9c34700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f4154ae0 con 0x7f22dc0038e0 2023-08-17T17:50:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f9c34700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40c3190 con 0x7f22f40c3680 2023-08-17T17:50:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f9c34700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40c3ff0 con 0x7f22f40c1ac0 2023-08-17T17:50:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 0x7f22f4151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 0x7f22f4151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38492/0 (socket says 172.21.15.78:38492) 2023-08-17T17:50:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.677+0000 7f22f37fe700 1 -- 172.21.15.78:0/460942223 learned_addr learned my addr 172.21.15.78:0/460942223 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22f2ffd700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c1ac0 0x7f22f40c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22f37fe700 1 -- 172.21.15.78:0/460942223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c1ac0 msgr2=0x7f22f40c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22f37fe700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c1ac0 0x7f22f40c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22f37fe700 1 -- 172.21.15.78:0/460942223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22f40c3680 msgr2=0x7f22f40c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22f37fe700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22f40c3680 0x7f22f40c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22f37fe700 1 -- 172.21.15.78:0/460942223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f40c2580 con 0x7f22dc0038e0 2023-08-17T17:50:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22f2ffd700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c1ac0 0x7f22f40c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:17.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22f37fe700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 0x7f22f4151260 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f22e4001730 tx=0x7f22e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:17.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22db7fe700 1 -- 172.21.15.78:0/460942223 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e40076c0 con 0x7f22dc0038e0 2023-08-17T17:50:17.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22db7fe700 1 -- 172.21.15.78:0/460942223 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e40046b0 con 0x7f22dc0038e0 2023-08-17T17:50:17.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22f9c34700 1 -- 172.21.15.78:0/460942223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f40c2860 con 0x7f22dc0038e0 2023-08-17T17:50:17.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22db7fe700 1 -- 172.21.15.78:0/460942223 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4004a70 con 0x7f22dc0038e0 2023-08-17T17:50:17.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.678+0000 7f22f9c34700 1 -- 172.21.15.78:0/460942223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f40c2e20 con 0x7f22dc0038e0 2023-08-17T17:50:17.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.679+0000 7f22f9c34700 1 -- 172.21.15.78:0/460942223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f4083980 con 0x7f22dc0038e0 2023-08-17T17:50:17.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.679+0000 7f22db7fe700 1 -- 172.21.15.78:0/460942223 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 37) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f22e401d070 con 0x7f22dc0038e0 2023-08-17T17:50:17.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.680+0000 7f22db7fe700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f22e005ed20 0x7f22e00611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:17.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.680+0000 7f22db7fe700 1 -- 172.21.15.78:0/460942223 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f22e407aa10 con 0x7f22dc0038e0 2023-08-17T17:50:17.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.680+0000 7f22f2ffd700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f22e005ed20 0x7f22e00611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:17.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.680+0000 7f22f2ffd700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f22e005ed20 0x7f22e00611e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f22e8006c40 tx=0x7f22e8008040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:17.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.684+0000 7f22db7fe700 1 -- 172.21.15.78:0/460942223 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22e404be70 con 0x7f22dc0038e0 2023-08-17T17:50:17.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:17.849+0000 7f22f9c34700 1 -- 172.21.15.78:0/460942223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f22f4063cb0 con 0x7f22dc0038e0 2023-08-17T17:50:18.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.542+0000 7f22db7fe700 1 -- 172.21.15.78:0/460942223 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) v1 ==== 181+0+0 (secure 0 0 0) 0x7f22f4063cb0 con 0x7f22dc0038e0 2023-08-17T17:50:18.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.544+0000 7f22f9c34700 1 -- 172.21.15.78:0/460942223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f22e005ed20 msgr2=0x7f22e00611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:18.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.544+0000 7f22f9c34700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f22e005ed20 0x7f22e00611e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f22e8006c40 tx=0x7f22e8008040).stop 2023-08-17T17:50:18.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.544+0000 7f22f9c34700 1 -- 172.21.15.78:0/460942223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 msgr2=0x7f22f4151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:18.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.544+0000 7f22f9c34700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 0x7f22f4151260 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f22e4001730 tx=0x7f22e4015000).stop 2023-08-17T17:50:18.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.545+0000 7f22f9c34700 1 -- 172.21.15.78:0/460942223 shutdown_connections 2023-08-17T17:50:18.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.545+0000 7f22f9c34700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f22e005ed20 0x7f22e00611e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:18.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.545+0000 7f22f9c34700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22f40c3680 0x7f22f40c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:18.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.545+0000 7f22f9c34700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc0038e0 0x7f22f4151260 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:18.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.545+0000 7f22f9c34700 1 --2- 172.21.15.78:0/460942223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22f40c1ac0 0x7f22f40c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:18.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.545+0000 7f22f9c34700 1 -- 172.21.15.78:0/460942223 >> 172.21.15.78:0/460942223 conn(0x7f22f406a6a0 msgr2=0x7f22f40c78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:18.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.545+0000 7f22f9c34700 1 -- 172.21.15.78:0/460942223 shutdown_connections 2023-08-17T17:50:18.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.545+0000 7f22f9c34700 1 -- 172.21.15.78:0/460942223 wait complete. 2023-08-17T17:50:18.547 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T17:50:18.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T17:50:18.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.677+0000 7fcef9410700 1 Processor -- start 2023-08-17T17:50:18.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.677+0000 7fcef9410700 1 -- start start 2023-08-17T17:50:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fcef9410700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcef40aa4d0 0x7fcef40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fcef9410700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40c5810 0x7fcef40c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fcef9410700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef40649b0 con 0x7fcef40aa0f0 2023-08-17T17:50:18.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fcef9410700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40c6170 con 0x7fcef40aa4d0 2023-08-17T17:50:18.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fcef9410700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef4063420 con 0x7fcef40c5810 2023-08-17T17:50:18.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fcef2ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcef40aa0f0 0x7fcef40c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57666/0 (socket says 172.21.15.78:57666) 2023-08-17T17:50:18.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fcef2ffd700 1 -- 172.21.15.78:0/2188864598 learned_addr learned my addr 172.21.15.78:0/2188864598 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:18.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fceea7fc700 1 --2- 172.21.15.78:0/2188864598 >> v2:172.21.15.150:3300/0 conn(0x7fcef40aa4d0 0x7fcef40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:18.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800099405 0 0) 0x7fcef40649b0 con 0x7fcef40aa0f0 2023-08-17T17:50:18.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee00033f0 con 0x7fcef40aa0f0 2023-08-17T17:50:18.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.678+0000 7fcef37fe700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40c5810 0x7fcef40c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:18.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1557993355 0 0) 0x7fcee00033f0 con 0x7fcef40aa0f0 2023-08-17T17:50:18.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40c5810 msgr2=0x7fcef40c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:18.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40c5810 0x7fcef40c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:18.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 >> v2:172.21.15.150:3300/0 conn(0x7fcef40aa4d0 msgr2=0x7fcef40644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:18.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 --2- 172.21.15.78:0/2188864598 >> v2:172.21.15.150:3300/0 conn(0x7fcef40aa4d0 0x7fcef40644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:18.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef4063700 con 0x7fcef40aa0f0 2023-08-17T17:50:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fcee4001470 con 0x7fcef40aa0f0 2023-08-17T17:50:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 >> v1:172.21.15.78:6789/0 conn(0x7fcef40aa0f0 legacy=0x7fcef40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee00038e0 0x7fcee0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40c5810 0x7fcee0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 0x7fcee0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40c6170 con 0x7fcee0004b80 2023-08-17T17:50:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef4063420 con 0x7fcee00038e0 2023-08-17T17:50:18.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee000b8e0 con 0x7fcef40c5810 2023-08-17T17:50:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef37fe700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 0x7fcee0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef2ffd700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee00038e0 0x7fcee0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fceea7fc700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40c5810 0x7fcee0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef37fe700 1 -- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40c5810 msgr2=0x7fcee0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef37fe700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40c5810 0x7fcee0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef37fe700 1 -- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee00038e0 msgr2=0x7fcee0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef37fe700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee00038e0 0x7fcee0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef37fe700 1 -- 172.21.15.78:0/2188864598 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00033f0 con 0x7fcee0004b80 2023-08-17T17:50:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fceea7fc700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40c5810 0x7fcee0004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef2ffd700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee00038e0 0x7fcee0003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef37fe700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 0x7fcee0005000 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fceec00e1c0 tx=0x7fceec00b040).ready entity=mon.0 client_cookie=6840d7a9d11bc6ad server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec009ac0 con 0x7fcee0004b80 2023-08-17T17:50:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec00f040 con 0x7fcee0004b80 2023-08-17T17:50:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.679+0000 7fcef27fc700 1 -- 172.21.15.78:0/2188864598 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec00eca0 con 0x7fcee0004b80 2023-08-17T17:50:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.680+0000 7fcef9410700 1 -- 172.21.15.78:0/2188864598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 msgr2=0x7fcee0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.680+0000 7fcef9410700 1 --2- 172.21.15.78:0/2188864598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 0x7fcee0005000 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fceec00e1c0 tx=0x7fceec00b040).stop 2023-08-17T17:50:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.680+0000 7fcef37fe700 1 -- 172.21.15.78:0/2188864598 reap_dead start 2023-08-17T17:50:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.680+0000 7fcef9410700 1 -- 172.21.15.78:0/2188864598 shutdown_connections 2023-08-17T17:50:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.680+0000 7fcef9410700 1 -- 172.21.15.78:0/2188864598 >> 172.21.15.78:0/2188864598 conn(0x7fcef406a6a0 msgr2=0x7fcef40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.680+0000 7fcef9410700 1 -- 172.21.15.78:0/2188864598 shutdown_connections 2023-08-17T17:50:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.680+0000 7fcef9410700 1 -- 172.21.15.78:0/2188864598 wait complete. 2023-08-17T17:50:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.681+0000 7fcef9410700 1 Processor -- start 2023-08-17T17:50:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.681+0000 7fcef9410700 1 -- start start 2023-08-17T17:50:18.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef9410700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 0x7fcef414cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef9410700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40af2f0 0x7fcef40af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef9410700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcef40abfb0 0x7fcef40ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef9410700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40b0950 con 0x7fcee0004b80 2023-08-17T17:50:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef9410700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40ac920 con 0x7fcef40abfb0 2023-08-17T17:50:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef9410700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40afd40 con 0x7fcef40af2f0 2023-08-17T17:50:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 0x7fcef414cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:18.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 0x7fcef414cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33686/0 (socket says 172.21.15.78:33686) 2023-08-17T17:50:18.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef2ffd700 1 -- 172.21.15.78:0/2747619329 learned_addr learned my addr 172.21.15.78:0/2747619329 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:18.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fceea7fc700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40af2f0 0x7fcef40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:18.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef37fe700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcef40abfb0 0x7fcef40ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:18.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef2ffd700 1 -- 172.21.15.78:0/2747619329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40af2f0 msgr2=0x7fcef40af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:18.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef2ffd700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40af2f0 0x7fcef40af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:18.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef2ffd700 1 -- 172.21.15.78:0/2747619329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcef40abfb0 msgr2=0x7fcef40ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:18.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef2ffd700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcef40abfb0 0x7fcef40ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:18.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef2ffd700 1 -- 172.21.15.78:0/2747619329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef40b0020 con 0x7fcee0004b80 2023-08-17T17:50:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef2ffd700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 0x7fcef414cc70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fcee400e7b0 tx=0x7fcee4001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fceeb7fe700 1 -- 172.21.15.78:0/2747619329 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4010490 con 0x7fcee0004b80 2023-08-17T17:50:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fceeb7fe700 1 -- 172.21.15.78:0/2747619329 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee4010040 con 0x7fcee0004b80 2023-08-17T17:50:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fcef9410700 1 -- 172.21.15.78:0/2747619329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef40b0300 con 0x7fcee0004b80 2023-08-17T17:50:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.682+0000 7fceeb7fe700 1 -- 172.21.15.78:0/2747619329 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4010820 con 0x7fcee0004b80 2023-08-17T17:50:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.683+0000 7fcef9410700 1 -- 172.21.15.78:0/2747619329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef414d160 con 0x7fcee0004b80 2023-08-17T17:50:18.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.684+0000 7fcef9410700 1 -- 172.21.15.78:0/2747619329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef40b0c30 con 0x7fcee0004b80 2023-08-17T17:50:18.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.684+0000 7fceeb7fe700 1 -- 172.21.15.78:0/2747619329 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 37) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fcee401b020 con 0x7fcee0004b80 2023-08-17T17:50:18.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.684+0000 7fceeb7fe700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fced405ecf0 0x7fced40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:18.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.684+0000 7fceeb7fe700 1 -- 172.21.15.78:0/2747619329 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcee4079190 con 0x7fcee0004b80 2023-08-17T17:50:18.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.684+0000 7fceea7fc700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fced405ecf0 0x7fced40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:18.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.684+0000 7fceea7fc700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fced405ecf0 0x7fced40611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcedc006b00 tx=0x7fcedc008040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:18.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.688+0000 7fceeb7fe700 1 -- 172.21.15.78:0/2747619329 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcee404a7b0 con 0x7fcee0004b80 2023-08-17T17:50:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.850+0000 7fcef9410700 1 -- 172.21.15.78:0/2747619329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcef40a9830 con 0x7fcee0004b80 2023-08-17T17:50:18.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:18.996+0000 7fceeb7fe700 1 -- 172.21.15.78:0/2747619329 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcee4077110 con 0x7fcee0004b80 2023-08-17T17:50:19.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.550+0000 7fceeb7fe700 1 -- 172.21.15.78:0/2747619329 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcee4075a30 con 0x7fcee0004b80 2023-08-17T17:50:19.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 -- 172.21.15.78:0/2747619329 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fced405ecf0 msgr2=0x7fced40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:19.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fced405ecf0 0x7fced40611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcedc006b00 tx=0x7fcedc008040).stop 2023-08-17T17:50:19.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 -- 172.21.15.78:0/2747619329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 msgr2=0x7fcef414cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:19.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 0x7fcef414cc70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fcee400e7b0 tx=0x7fcee4001e90).stop 2023-08-17T17:50:19.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 -- 172.21.15.78:0/2747619329 shutdown_connections 2023-08-17T17:50:19.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fced405ecf0 0x7fced40611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:19.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcef40abfb0 0x7fcef40ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:19.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee0004b80 0x7fcef414cc70 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:19.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 --2- 172.21.15.78:0/2747619329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef40af2f0 0x7fcef40af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:19.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 -- 172.21.15.78:0/2747619329 >> 172.21.15.78:0/2747619329 conn(0x7fcef406a6a0 msgr2=0x7fcef40c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:19.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 -- 172.21.15.78:0/2747619329 shutdown_connections 2023-08-17T17:50:19.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.553+0000 7fcef9410700 1 -- 172.21.15.78:0/2747619329 wait complete. 2023-08-17T17:50:19.555 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T17:50:19.566 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T17:50:19.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.681+0000 7f8f61134700 1 Processor -- start 2023-08-17T17:50:19.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.681+0000 7f8f61134700 1 -- start start 2023-08-17T17:50:19.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.682+0000 7f8f61134700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8f5c13a740 0x7f8f5c069f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.682+0000 7f8f61134700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f5c0624f0 0x7f8f5c062970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.682+0000 7f8f61134700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c069b00 con 0x7f8f5c1545e0 2023-08-17T17:50:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.682+0000 7f8f61134700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c155640 con 0x7f8f5c0624f0 2023-08-17T17:50:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.682+0000 7f8f61134700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c155140 con 0x7f8f5c13a740 2023-08-17T17:50:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.682+0000 7f8f5259c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f5c0624f0 0x7f8f5c062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.682+0000 7f8f5b59e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8f5c1545e0 0x7f8f5c154a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57672/0 (socket says 172.21.15.78:57672) 2023-08-17T17:50:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.682+0000 7f8f5b59e700 1 -- 172.21.15.78:0/2512398344 learned_addr learned my addr 172.21.15.78:0/2512398344 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f5259c700 1 -- 172.21.15.78:0/2512398344 >> v2:172.21.15.150:3300/0 conn(0x7f8f5c13a740 msgr2=0x7f8f5c069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f5259c700 1 --2- 172.21.15.78:0/2512398344 >> v2:172.21.15.150:3300/0 conn(0x7f8f5c13a740 0x7f8f5c069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f5259c700 1 -- 172.21.15.78:0/2512398344 >> v1:172.21.15.78:6789/0 conn(0x7f8f5c1545e0 legacy=0x7f8f5c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:19.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f5259c700 1 -- 172.21.15.78:0/2512398344 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c062e60 con 0x7f8f5c0624f0 2023-08-17T17:50:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f5a59c700 1 -- 172.21.15.78:0/2512398344 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656499362 0 0) 0x7f8f5c069b00 con 0x7f8f5c1545e0 2023-08-17T17:50:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f5259c700 1 --2- 172.21.15.78:0/2512398344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c0624f0 0x7f8f5c062970 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f8f5c069110 tx=0x7f8f44009060).ready entity=mon.0 client_cookie=db8f92b96f98c7d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f5a59c700 1 -- 172.21.15.78:0/2512398344 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400b580 con 0x7f8f5c0624f0 2023-08-17T17:50:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f5a59c700 1 -- 172.21.15.78:0/2512398344 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4400b6e0 con 0x7f8f5c0624f0 2023-08-17T17:50:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f5a59c700 1 -- 172.21.15.78:0/2512398344 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400ba60 con 0x7f8f5c0624f0 2023-08-17T17:50:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f61134700 1 -- 172.21.15.78:0/2512398344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c0624f0 msgr2=0x7f8f5c062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f61134700 1 --2- 172.21.15.78:0/2512398344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c0624f0 0x7f8f5c062970 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f8f5c069110 tx=0x7f8f44009060).stop 2023-08-17T17:50:19.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f61134700 1 -- 172.21.15.78:0/2512398344 shutdown_connections 2023-08-17T17:50:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f61134700 1 --2- 172.21.15.78:0/2512398344 >> v2:172.21.15.150:3300/0 conn(0x7f8f5c13a740 0x7f8f5c069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f61134700 1 --2- 172.21.15.78:0/2512398344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c0624f0 0x7f8f5c062970 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f61134700 1 -- 172.21.15.78:0/2512398344 >> 172.21.15.78:0/2512398344 conn(0x7f8f5c0c7b80 msgr2=0x7f8f5c0c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f61134700 1 -- 172.21.15.78:0/2512398344 shutdown_connections 2023-08-17T17:50:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.683+0000 7f8f61134700 1 -- 172.21.15.78:0/2512398344 wait complete. 2023-08-17T17:50:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.685+0000 7f8f61134700 1 Processor -- start 2023-08-17T17:50:19.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.685+0000 7f8f61134700 1 -- start start 2023-08-17T17:50:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.685+0000 7f8f61134700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f5c0624f0 0x7f8f5c1684a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f61134700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c13a740 0x7f8f5c153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f61134700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5c1545e0 0x7f8f5c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f61134700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0abcc0 con 0x7f8f5c13a740 2023-08-17T17:50:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f61134700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c168990 con 0x7f8f5c1545e0 2023-08-17T17:50:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f61134700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0ab0b0 con 0x7f8f5c0624f0 2023-08-17T17:50:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f5259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c13a740 0x7f8f5c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f5259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c13a740 0x7f8f5c153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33696/0 (socket says 172.21.15.78:33696) 2023-08-17T17:50:19.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f5259c700 1 -- 172.21.15.78:0/4056015466 learned_addr learned my addr 172.21.15.78:0/4056015466 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:19.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f5b59e700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5c1545e0 0x7f8f5c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:19.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f5259c700 1 -- 172.21.15.78:0/4056015466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f5c0624f0 msgr2=0x7f8f5c1684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:19.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f5259c700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f5c0624f0 0x7f8f5c1684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:19.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f5259c700 1 -- 172.21.15.78:0/4056015466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5c1545e0 msgr2=0x7f8f5c0a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:19.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f5259c700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5c1545e0 0x7f8f5c0a5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:19.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f5259c700 1 -- 172.21.15.78:0/4056015466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440092a0 con 0x7f8f5c13a740 2023-08-17T17:50:19.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f5259c700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c13a740 0x7f8f5c153730 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f8f5c068d20 tx=0x7f8f44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:19.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f537fe700 1 -- 172.21.15.78:0/4056015466 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400b850 con 0x7f8f5c13a740 2023-08-17T17:50:19.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f537fe700 1 -- 172.21.15.78:0/4056015466 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4400b9b0 con 0x7f8f5c13a740 2023-08-17T17:50:19.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f537fe700 1 -- 172.21.15.78:0/4056015466 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4401b620 con 0x7f8f5c13a740 2023-08-17T17:50:19.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f61134700 1 -- 172.21.15.78:0/4056015466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5c0ab390 con 0x7f8f5c13a740 2023-08-17T17:50:19.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.686+0000 7f8f61134700 1 -- 172.21.15.78:0/4056015466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c0ab950 con 0x7f8f5c13a740 2023-08-17T17:50:19.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.687+0000 7f8f61134700 1 -- 172.21.15.78:0/4056015466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c0abe30 con 0x7f8f5c13a740 2023-08-17T17:50:19.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.687+0000 7f8f537fe700 1 -- 172.21.15.78:0/4056015466 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8f4400f070 con 0x7f8f5c13a740 2023-08-17T17:50:19.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.688+0000 7f8f537fe700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f3c05ed90 0x7f8f3c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:19.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.688+0000 7f8f537fe700 1 -- 172.21.15.78:0/4056015466 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f8f4407af00 con 0x7f8f5c13a740 2023-08-17T17:50:19.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.688+0000 7f8f5ad9d700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f3c05ed90 0x7f8f3c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:19.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.688+0000 7f8f5ad9d700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f3c05ed90 0x7f8f3c061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8f4c009700 tx=0x7f8f4c006c30).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:19.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.692+0000 7f8f537fe700 1 -- 172.21.15.78:0/4056015466 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8f4404c620 con 0x7f8f5c13a740 2023-08-17T17:50:19.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.855+0000 7f8f61134700 1 -- 172.21.15.78:0/4056015466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8f5c068270 con 0x7f8f5c13a740 2023-08-17T17:50:19.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.859+0000 7f8f537fe700 1 -- 172.21.15.78:0/4056015466 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8f4404fc40 con 0x7f8f5c13a740 2023-08-17T17:50:19.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.862+0000 7f8f61134700 1 -- 172.21.15.78:0/4056015466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f3c05ed90 msgr2=0x7f8f3c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:19.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.862+0000 7f8f61134700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f3c05ed90 0x7f8f3c061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8f4c009700 tx=0x7f8f4c006c30).stop 2023-08-17T17:50:19.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.862+0000 7f8f61134700 1 -- 172.21.15.78:0/4056015466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c13a740 msgr2=0x7f8f5c153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:19.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.862+0000 7f8f61134700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c13a740 0x7f8f5c153730 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f8f5c068d20 tx=0x7f8f44017000).stop 2023-08-17T17:50:19.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.863+0000 7f8f61134700 1 -- 172.21.15.78:0/4056015466 shutdown_connections 2023-08-17T17:50:19.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.863+0000 7f8f61134700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8f3c05ed90 0x7f8f3c061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:19.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.863+0000 7f8f61134700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5c1545e0 0x7f8f5c0a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:19.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.863+0000 7f8f61134700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f5c0624f0 0x7f8f5c1684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:19.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.863+0000 7f8f61134700 1 --2- 172.21.15.78:0/4056015466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5c13a740 0x7f8f5c153730 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:19.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.863+0000 7f8f61134700 1 -- 172.21.15.78:0/4056015466 >> 172.21.15.78:0/4056015466 conn(0x7f8f5c0c7b80 msgr2=0x7f8f5c1567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:19.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.863+0000 7f8f61134700 1 -- 172.21.15.78:0/4056015466 shutdown_connections 2023-08-17T17:50:19.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.863+0000 7f8f61134700 1 -- 172.21.15.78:0/4056015466 wait complete. 2023-08-17T17:50:19.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-17T17:50:19.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.991+0000 7fdf5141f700 1 Processor -- start 2023-08-17T17:50:19.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.991+0000 7fdf5141f700 1 -- start start 2023-08-17T17:50:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.992+0000 7fdf5141f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdf4c0aa0f0 0x7fdf4c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.992+0000 7fdf5141f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdf4c0aa4d0 0x7fdf4c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.992+0000 7fdf5141f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4c0649b0 con 0x7fdf4c0c5810 2023-08-17T17:50:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.992+0000 7fdf5141f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4c063420 con 0x7fdf4c0aa0f0 2023-08-17T17:50:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.992+0000 7fdf5141f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4c063700 con 0x7fdf4c0aa4d0 2023-08-17T17:50:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.992+0000 7fdf4affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdf4c0aa0f0 0x7fdf4c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.992+0000 7fdf4affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdf4c0aa0f0 0x7fdf4c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33706/0 (socket says 172.21.15.78:33706) 2023-08-17T17:50:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.992+0000 7fdf4affd700 1 -- 172.21.15.78:0/2436096791 learned_addr learned my addr 172.21.15.78:0/2436096791 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf4affd700 1 -- 172.21.15.78:0/2436096791 >> v2:172.21.15.150:3300/0 conn(0x7fdf4c0aa4d0 msgr2=0x7fdf4c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf4affd700 1 --2- 172.21.15.78:0/2436096791 >> v2:172.21.15.150:3300/0 conn(0x7fdf4c0aa4d0 0x7fdf4c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf4affd700 1 -- 172.21.15.78:0/2436096791 >> v1:172.21.15.150:6789/0 conn(0x7fdf4c0c5810 legacy=0x7fdf4c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf4affd700 1 -- 172.21.15.78:0/2436096791 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c0639e0 con 0x7fdf4c0aa0f0 2023-08-17T17:50:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf4affd700 1 --2- 172.21.15.78:0/2436096791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa0f0 0x7fdf4c0644c0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fdf4c159060 tx=0x7fdf3c0090f0).ready entity=mon.0 client_cookie=10ff83ae2a3e6d62 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:19.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf4a7fc700 1 -- 172.21.15.78:0/2436096791 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00b5a0 con 0x7fdf4c0aa0f0 2023-08-17T17:50:19.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf4a7fc700 1 -- 172.21.15.78:0/2436096791 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c00b700 con 0x7fdf4c0aa0f0 2023-08-17T17:50:19.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf4a7fc700 1 -- 172.21.15.78:0/2436096791 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00ba80 con 0x7fdf4c0aa0f0 2023-08-17T17:50:19.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf5141f700 1 -- 172.21.15.78:0/2436096791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa0f0 msgr2=0x7fdf4c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:19.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf5141f700 1 --2- 172.21.15.78:0/2436096791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa0f0 0x7fdf4c0644c0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fdf4c159060 tx=0x7fdf3c0090f0).stop 2023-08-17T17:50:19.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf5141f700 1 -- 172.21.15.78:0/2436096791 shutdown_connections 2023-08-17T17:50:19.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf5141f700 1 --2- 172.21.15.78:0/2436096791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa0f0 0x7fdf4c0644c0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:19.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf5141f700 1 --2- 172.21.15.78:0/2436096791 >> v2:172.21.15.150:3300/0 conn(0x7fdf4c0aa4d0 0x7fdf4c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf5141f700 1 -- 172.21.15.78:0/2436096791 >> 172.21.15.78:0/2436096791 conn(0x7fdf4c06a6a0 msgr2=0x7fdf4c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf5141f700 1 -- 172.21.15.78:0/2436096791 shutdown_connections 2023-08-17T17:50:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.993+0000 7fdf5141f700 1 -- 172.21.15.78:0/2436096791 wait complete. 2023-08-17T17:50:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.995+0000 7fdf5141f700 1 Processor -- start 2023-08-17T17:50:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.995+0000 7fdf5141f700 1 -- start start 2023-08-17T17:50:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.995+0000 7fdf5141f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4c0aa0f0 0x7fdf4c0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.995+0000 7fdf5141f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa4d0 0x7fdf4c0c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.995+0000 7fdf5141f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf4c0c5810 0x7fdf4c164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.995+0000 7fdf5141f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c0afeb0 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.995+0000 7fdf5141f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c169000 con 0x7fdf4c0aa0f0 2023-08-17T17:50:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.995+0000 7fdf5141f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c0c4a70 con 0x7fdf4c0c5810 2023-08-17T17:50:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.995+0000 7fdf427fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa4d0 0x7fdf4c0c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf427fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa4d0 0x7fdf4c0c1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33716/0 (socket says 172.21.15.78:33716) 2023-08-17T17:50:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf427fc700 1 -- 172.21.15.78:0/2470960993 learned_addr learned my addr 172.21.15.78:0/2470960993 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf4affd700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4c0aa0f0 0x7fdf4c0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf4b7fe700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf4c0c5810 0x7fdf4c164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf427fc700 1 -- 172.21.15.78:0/2470960993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf4c0c5810 msgr2=0x7fdf4c164300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf427fc700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf4c0c5810 0x7fdf4c164300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf427fc700 1 -- 172.21.15.78:0/2470960993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4c0aa0f0 msgr2=0x7fdf4c0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf427fc700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4c0aa0f0 0x7fdf4c0b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf427fc700 1 -- 172.21.15.78:0/2470960993 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c009370 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf4b7fe700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf4c0c5810 0x7fdf4c164300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf427fc700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa4d0 0x7fdf4c0c1ac0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fdf3400b500 tx=0x7fdf340090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf437fe700 1 -- 172.21.15.78:0/2470960993 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34002320 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf437fe700 1 -- 172.21.15.78:0/2470960993 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf340024a0 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf437fe700 1 -- 172.21.15.78:0/2470960993 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34002860 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf5141f700 1 -- 172.21.15.78:0/2470960993 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4c0c4d50 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.996+0000 7fdf5141f700 1 -- 172.21.15.78:0/2470960993 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4c0c1fb0 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.997+0000 7fdf5141f700 1 -- 172.21.15.78:0/2470960993 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4c0b0020 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.997+0000 7fdf437fe700 1 -- 172.21.15.78:0/2470960993 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdf3400f030 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.998+0000 7fdf437fe700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf2c05ed90 0x7fdf2c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.998+0000 7fdf437fe700 1 -- 172.21.15.78:0/2470960993 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fdf34079630 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.998+0000 7fdf4affd700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf2c05ed90 0x7fdf2c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:19.998+0000 7fdf4affd700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf2c05ed90 0x7fdf2c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fdf3c009130 tx=0x7fdf3c015000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:20.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.002+0000 7fdf437fe700 1 -- 172.21.15.78:0/2470960993 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf3404ad50 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.167+0000 7fdf5141f700 1 -- 172.21.15.78:0/2470960993 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fdf4c158e40 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.171+0000 7fdf437fe700 1 -- 172.21.15.78:0/2470960993 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v17) v1 ==== 120+0+0 (secure 0 0 0) 0x7fdf3404e370 con 0x7fdf4c0aa4d0 2023-08-17T17:50:20.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 -- 172.21.15.78:0/2470960993 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf2c05ed90 msgr2=0x7fdf2c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf2c05ed90 0x7fdf2c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fdf3c009130 tx=0x7fdf3c015000).stop 2023-08-17T17:50:20.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 -- 172.21.15.78:0/2470960993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa4d0 msgr2=0x7fdf4c0c1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa4d0 0x7fdf4c0c1ac0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fdf3400b500 tx=0x7fdf340090f0).stop 2023-08-17T17:50:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 -- 172.21.15.78:0/2470960993 shutdown_connections 2023-08-17T17:50:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf2c05ed90 0x7fdf2c061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf4c0c5810 0x7fdf4c164300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4c0aa0f0 0x7fdf4c0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 --2- 172.21.15.78:0/2470960993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf4c0aa4d0 0x7fdf4c0c1ac0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 -- 172.21.15.78:0/2470960993 >> 172.21.15.78:0/2470960993 conn(0x7fdf4c06a6a0 msgr2=0x7fdf4c0c03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 -- 172.21.15.78:0/2470960993 shutdown_connections 2023-08-17T17:50:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.174+0000 7fdf5141f700 1 -- 172.21.15.78:0/2470960993 wait complete. 2023-08-17T17:50:20.186 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-08-17T17:50:20.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.298+0000 7f97aa1bc700 1 Processor -- start 2023-08-17T17:50:20.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.299+0000 7f97aa1bc700 1 -- start start 2023-08-17T17:50:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.299+0000 7f97aa1bc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f97a4154140 0x7f97a40c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.299+0000 7f97aa1bc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97a40a7c40 0x7f97a40c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.299+0000 7f97aa1bc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a4154520 con 0x7f97a40a80b0 2023-08-17T17:50:20.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.299+0000 7f97aa1bc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a40c91e0 con 0x7f97a40a7c40 2023-08-17T17:50:20.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.299+0000 7f97aa1bc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a40c94c0 con 0x7f97a4154140 2023-08-17T17:50:20.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.299+0000 7f97a2ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97a40a7c40 0x7f97a40c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a2ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97a40a7c40 0x7f97a40c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33718/0 (socket says 172.21.15.78:33718) 2023-08-17T17:50:20.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a3fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f97a40a80b0 0x7f97a40ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57680/0 (socket says 172.21.15.78:57680) 2023-08-17T17:50:20.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a2ffd700 1 -- 172.21.15.78:0/761053043 learned_addr learned my addr 172.21.15.78:0/761053043 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:20.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a37fe700 1 --2- 172.21.15.78:0/761053043 >> v2:172.21.15.150:3300/0 conn(0x7f97a4154140 0x7f97a40c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a2ffd700 1 -- 172.21.15.78:0/761053043 >> v2:172.21.15.150:3300/0 conn(0x7f97a4154140 msgr2=0x7f97a40c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a2ffd700 1 --2- 172.21.15.78:0/761053043 >> v2:172.21.15.150:3300/0 conn(0x7f97a4154140 0x7f97a40c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a2ffd700 1 -- 172.21.15.78:0/761053043 >> v1:172.21.15.78:6789/0 conn(0x7f97a40a80b0 legacy=0x7f97a40ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a27fc700 1 -- 172.21.15.78:0/761053043 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991928417 0 0) 0x7f97a4154520 con 0x7f97a40a80b0 2023-08-17T17:50:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a2ffd700 1 -- 172.21.15.78:0/761053043 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a40c97a0 con 0x7f97a40a7c40 2023-08-17T17:50:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a37fe700 1 --2- 172.21.15.78:0/761053043 >> v2:172.21.15.150:3300/0 conn(0x7f97a4154140 0x7f97a40c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a2ffd700 1 --2- 172.21.15.78:0/761053043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 0x7f97a40c0900 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f97a40625b0 tx=0x7f97980090f0).ready entity=mon.0 client_cookie=546d09653355050a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:20.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a27fc700 1 -- 172.21.15.78:0/761053043 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800b600 con 0x7f97a40a7c40 2023-08-17T17:50:20.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a27fc700 1 -- 172.21.15.78:0/761053043 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800b760 con 0x7f97a40a7c40 2023-08-17T17:50:20.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.300+0000 7f97a27fc700 1 -- 172.21.15.78:0/761053043 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800bae0 con 0x7f97a40a7c40 2023-08-17T17:50:20.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.301+0000 7f97aa1bc700 1 -- 172.21.15.78:0/761053043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 msgr2=0x7f97a40c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.301+0000 7f97aa1bc700 1 --2- 172.21.15.78:0/761053043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 0x7f97a40c0900 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f97a40625b0 tx=0x7f97980090f0).stop 2023-08-17T17:50:20.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.301+0000 7f97aa1bc700 1 -- 172.21.15.78:0/761053043 shutdown_connections 2023-08-17T17:50:20.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.301+0000 7f97aa1bc700 1 --2- 172.21.15.78:0/761053043 >> v2:172.21.15.150:3300/0 conn(0x7f97a4154140 0x7f97a40c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.301+0000 7f97aa1bc700 1 --2- 172.21.15.78:0/761053043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 0x7f97a40c0900 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.301+0000 7f97aa1bc700 1 -- 172.21.15.78:0/761053043 >> 172.21.15.78:0/761053043 conn(0x7f97a4094510 msgr2=0x7f97a406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:20.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.301+0000 7f97aa1bc700 1 -- 172.21.15.78:0/761053043 shutdown_connections 2023-08-17T17:50:20.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.301+0000 7f97aa1bc700 1 -- 172.21.15.78:0/761053043 wait complete. 2023-08-17T17:50:20.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.302+0000 7f97aa1bc700 1 Processor -- start 2023-08-17T17:50:20.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.302+0000 7f97aa1bc700 1 -- start start 2023-08-17T17:50:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97aa1bc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 0x7f97a41494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97aa1bc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a40a80b0 0x7f97a40aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97aa1bc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a4154140 0x7f97a40ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97aa1bc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40abf00 con 0x7f97a40a7c40 2023-08-17T17:50:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97aa1bc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40acb80 con 0x7f97a4154140 2023-08-17T17:50:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97aa1bc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40af620 con 0x7f97a40a80b0 2023-08-17T17:50:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 0x7f97a41494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 0x7f97a41494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33728/0 (socket says 172.21.15.78:33728) 2023-08-17T17:50:20.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a37fe700 1 -- 172.21.15.78:0/445543288 learned_addr learned my addr 172.21.15.78:0/445543288 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:20.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a3fff700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a4154140 0x7f97a40ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a37fe700 1 -- 172.21.15.78:0/445543288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a40a80b0 msgr2=0x7f97a40aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a2ffd700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a40a80b0 0x7f97a40aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a37fe700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a40a80b0 0x7f97a40aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a37fe700 1 -- 172.21.15.78:0/445543288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a4154140 msgr2=0x7f97a40ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a37fe700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a4154140 0x7f97a40ac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a37fe700 1 -- 172.21.15.78:0/445543288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798009370 con 0x7f97a40a7c40 2023-08-17T17:50:20.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a3fff700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a4154140 0x7f97a40ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:20.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a2ffd700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a40a80b0 0x7f97a40aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:20.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97a37fe700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 0x7f97a41494a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f979400a400 tx=0x7f9794007910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:20.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f978b7fe700 1 -- 172.21.15.78:0/445543288 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979400d650 con 0x7f97a40a7c40 2023-08-17T17:50:20.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f978b7fe700 1 -- 172.21.15.78:0/445543288 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979400d7b0 con 0x7f97a40a7c40 2023-08-17T17:50:20.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97aa1bc700 1 -- 172.21.15.78:0/445543288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a40af900 con 0x7f97a40a7c40 2023-08-17T17:50:20.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f978b7fe700 1 -- 172.21.15.78:0/445543288 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979400db30 con 0x7f97a40a7c40 2023-08-17T17:50:20.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.303+0000 7f97aa1bc700 1 -- 172.21.15.78:0/445543288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a40ac890 con 0x7f97a40a7c40 2023-08-17T17:50:20.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.304+0000 7f97aa1bc700 1 -- 172.21.15.78:0/445543288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a40aff50 con 0x7f97a40a7c40 2023-08-17T17:50:20.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.305+0000 7f978b7fe700 1 -- 172.21.15.78:0/445543288 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f979401d060 con 0x7f97a40a7c40 2023-08-17T17:50:20.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.305+0000 7f978b7fe700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979005ed90 0x7f9790061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.305+0000 7f978b7fe700 1 -- 172.21.15.78:0/445543288 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f979407a2c0 con 0x7f97a40a7c40 2023-08-17T17:50:20.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.305+0000 7f97a2ffd700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979005ed90 0x7f9790061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.305+0000 7f97a2ffd700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979005ed90 0x7f9790061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f97a40c4f30 tx=0x7f9798017000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:20.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.309+0000 7f978b7fe700 1 -- 172.21.15.78:0/445543288 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f979404b980 con 0x7f97a40a7c40 2023-08-17T17:50:20.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.542+0000 7f97aa1bc700 1 -- 172.21.15.78:0/445543288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f97a4047350 con 0x7f97a40a7c40 2023-08-17T17:50:20.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.549+0000 7f978b7fe700 1 -- 172.21.15.78:0/445543288 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v582) v1 ==== 166+0+0 (secure 0 0 0) 0x7f979401b020 con 0x7f97a40a7c40 2023-08-17T17:50:20.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 -- 172.21.15.78:0/445543288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979005ed90 msgr2=0x7f9790061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979005ed90 0x7f9790061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f97a40c4f30 tx=0x7f9798017000).stop 2023-08-17T17:50:20.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 -- 172.21.15.78:0/445543288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 msgr2=0x7f97a41494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 0x7f97a41494a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f979400a400 tx=0x7f9794007910).stop 2023-08-17T17:50:20.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 -- 172.21.15.78:0/445543288 shutdown_connections 2023-08-17T17:50:20.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f979005ed90 0x7f9790061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a4154140 0x7f97a40ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a40a7c40 0x7f97a41494a0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 --2- 172.21.15.78:0/445543288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a40a80b0 0x7f97a40aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 -- 172.21.15.78:0/445543288 >> 172.21.15.78:0/445543288 conn(0x7f97a4094510 msgr2=0x7f97a40ca670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:20.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 -- 172.21.15.78:0/445543288 shutdown_connections 2023-08-17T17:50:20.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.551+0000 7f97aa1bc700 1 -- 172.21.15.78:0/445543288 wait complete. 2023-08-17T17:50:20.563 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-08-17T17:50:20.563 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-17T17:50:20.564 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-08-17T17:50:20.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.676+0000 7fbbd3fff700 1 Processor -- start 2023-08-17T17:50:20.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.676+0000 7fbbd3fff700 1 -- start start 2023-08-17T17:50:20.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.677+0000 7fbbd3fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 0x7fbbd40a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.677+0000 7fbbd3fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbbd4069b10 0x7fbbd4150620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.677+0000 7fbbd3fff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd4069680 con 0x7fbbd4150b10 2023-08-17T17:50:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.677+0000 7fbbd3fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd40c28f0 con 0x7fbbd4069b10 2023-08-17T17:50:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.677+0000 7fbbd3fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4068ab0 con 0x7fbbd40a59b0 2023-08-17T17:50:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.677+0000 7fbbd37fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbbd4150b10 0x7fbbd40c1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57682/0 (socket says 172.21.15.78:57682) 2023-08-17T17:50:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.677+0000 7fbbd37fe700 1 -- 172.21.15.78:0/575517282 learned_addr learned my addr 172.21.15.78:0/575517282 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:20.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.677+0000 7fbbd2ffd700 1 --2- 172.21.15.78:0/575517282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 0x7fbbd40a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.677+0000 7fbbca7fc700 1 --2- 172.21.15.78:0/575517282 >> v2:172.21.15.150:3300/0 conn(0x7fbbd4069b10 0x7fbbd4150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd27fc700 1 -- 172.21.15.78:0/575517282 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605757124 0 0) 0x7fbbd4069680 con 0x7fbbd4150b10 2023-08-17T17:50:20.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd27fc700 1 -- 172.21.15.78:0/575517282 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc00033f0 con 0x7fbbd4150b10 2023-08-17T17:50:20.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd27fc700 1 -- 172.21.15.78:0/575517282 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1299441234 0 0) 0x7fbbc00033f0 con 0x7fbbd4150b10 2023-08-17T17:50:20.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd2ffd700 1 -- 172.21.15.78:0/575517282 >> v2:172.21.15.150:3300/0 conn(0x7fbbd4069b10 msgr2=0x7fbbd4150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd2ffd700 1 --2- 172.21.15.78:0/575517282 >> v2:172.21.15.150:3300/0 conn(0x7fbbd4069b10 0x7fbbd4150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd2ffd700 1 -- 172.21.15.78:0/575517282 >> v1:172.21.15.78:6789/0 conn(0x7fbbd4150b10 legacy=0x7fbbd40c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd2ffd700 1 -- 172.21.15.78:0/575517282 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd4068d50 con 0x7fbbd40a59b0 2023-08-17T17:50:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbca7fc700 1 --2- 172.21.15.78:0/575517282 >> v2:172.21.15.150:3300/0 conn(0x7fbbd4069b10 0x7fbbd4150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:50:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd2ffd700 1 --2- 172.21.15.78:0/575517282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 0x7fbbd40a5d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbbc4006fd0 tx=0x7fbbc4006f40).ready entity=mon.2 client_cookie=6835774e7b835b54 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd27fc700 1 -- 172.21.15.78:0/575517282 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0017f0 con 0x7fbbd40a59b0 2023-08-17T17:50:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd27fc700 1 -- 172.21.15.78:0/575517282 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc4005880 con 0x7fbbd40a59b0 2023-08-17T17:50:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.678+0000 7fbbd27fc700 1 -- 172.21.15.78:0/575517282 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4005c00 con 0x7fbbd40a59b0 2023-08-17T17:50:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.679+0000 7fbbd3fff700 1 -- 172.21.15.78:0/575517282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 msgr2=0x7fbbd40a5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.679+0000 7fbbd3fff700 1 --2- 172.21.15.78:0/575517282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 0x7fbbd40a5d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbbc4006fd0 tx=0x7fbbc4006f40).stop 2023-08-17T17:50:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.679+0000 7fbbd3fff700 1 -- 172.21.15.78:0/575517282 shutdown_connections 2023-08-17T17:50:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.679+0000 7fbbd3fff700 1 --2- 172.21.15.78:0/575517282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 0x7fbbd40a5d90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.679+0000 7fbbd3fff700 1 --2- 172.21.15.78:0/575517282 >> v2:172.21.15.150:3300/0 conn(0x7fbbd4069b10 0x7fbbd4150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.679+0000 7fbbd3fff700 1 -- 172.21.15.78:0/575517282 >> 172.21.15.78:0/575517282 conn(0x7fbbd40c7320 msgr2=0x7fbbd40c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.679+0000 7fbbd3fff700 1 -- 172.21.15.78:0/575517282 shutdown_connections 2023-08-17T17:50:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.679+0000 7fbbd3fff700 1 -- 172.21.15.78:0/575517282 wait complete. 2023-08-17T17:50:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.680+0000 7fbbd3fff700 1 Processor -- start 2023-08-17T17:50:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.680+0000 7fbbd3fff700 1 -- start start 2023-08-17T17:50:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4069b10 0x7fbbd40a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd3fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 0x7fbbd4165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd4150b10 0x7fbbd40a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd3fff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4166150 con 0x7fbbd4150b10 2023-08-17T17:50:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd3fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40a4090 con 0x7fbbd4069b10 2023-08-17T17:50:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd3fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40a2090 con 0x7fbbd40a59b0 2023-08-17T17:50:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd4150b10 0x7fbbd40a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd4150b10 0x7fbbd40a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33732/0 (socket says 172.21.15.78:33732) 2023-08-17T17:50:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd37fe700 1 -- 172.21.15.78:0/2158613085 learned_addr learned my addr 172.21.15.78:0/2158613085 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbca7fc700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 0x7fbbd4165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd2ffd700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4069b10 0x7fbbd40a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd37fe700 1 -- 172.21.15.78:0/2158613085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 msgr2=0x7fbbd4165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd37fe700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 0x7fbbd4165240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd37fe700 1 -- 172.21.15.78:0/2158613085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4069b10 msgr2=0x7fbbd40a25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:20.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd37fe700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4069b10 0x7fbbd40a25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:20.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd37fe700 1 -- 172.21.15.78:0/2158613085 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc0092a0 con 0x7fbbd4150b10 2023-08-17T17:50:20.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd37fe700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd4150b10 0x7fbbd40a0460 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fbbcc00c930 tx=0x7fbbcc007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:20.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbcb7fe700 1 -- 172.21.15.78:0/2158613085 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc004c40 con 0x7fbbd4150b10 2023-08-17T17:50:20.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbcb7fe700 1 -- 172.21.15.78:0/2158613085 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc004da0 con 0x7fbbd4150b10 2023-08-17T17:50:20.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd3fff700 1 -- 172.21.15.78:0/2158613085 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc4009250 con 0x7fbbd4150b10 2023-08-17T17:50:20.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbcb7fe700 1 -- 172.21.15.78:0/2158613085 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0073a0 con 0x7fbbd4150b10 2023-08-17T17:50:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.681+0000 7fbbd3fff700 1 -- 172.21.15.78:0/2158613085 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd4165b90 con 0x7fbbd4150b10 2023-08-17T17:50:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.682+0000 7fbbd3fff700 1 -- 172.21.15.78:0/2158613085 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd40a3e60 con 0x7fbbd4150b10 2023-08-17T17:50:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.683+0000 7fbbcb7fe700 1 -- 172.21.15.78:0/2158613085 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbbcc010070 con 0x7fbbd4150b10 2023-08-17T17:50:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.684+0000 7fbbcb7fe700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbbb405edc0 0x7fbbb4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.684+0000 7fbbcb7fe700 1 -- 172.21.15.78:0/2158613085 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fbbcc079990 con 0x7fbbd4150b10 2023-08-17T17:50:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.684+0000 7fbbd2ffd700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbbb405edc0 0x7fbbb4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.684+0000 7fbbd2ffd700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbbb405edc0 0x7fbbb4061280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fbbc4006fa0 tx=0x7fbbc4015000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.687+0000 7fbbcb7fe700 1 -- 172.21.15.78:0/2158613085 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbbcc04b130 con 0x7fbbd4150b10 2023-08-17T17:50:20.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:20.917+0000 7fbbd3fff700 1 -- 172.21.15.78:0/2158613085 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7fbbd40a3e60 con 0x7fbbd4150b10 2023-08-17T17:50:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.551+0000 7fbbcb7fe700 1 -- 172.21.15.78:0/2158613085 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v583) v1 ==== 186+0+0 (secure 0 0 0) 0x7fbbd40a3e60 con 0x7fbbd4150b10 2023-08-17T17:50:21.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 -- 172.21.15.78:0/2158613085 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbbb405edc0 msgr2=0x7fbbb4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:21.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbbb405edc0 0x7fbbb4061280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fbbc4006fa0 tx=0x7fbbc4015000).stop 2023-08-17T17:50:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 -- 172.21.15.78:0/2158613085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd4150b10 msgr2=0x7fbbd40a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd4150b10 0x7fbbd40a0460 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fbbcc00c930 tx=0x7fbbcc007af0).stop 2023-08-17T17:50:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 -- 172.21.15.78:0/2158613085 shutdown_connections 2023-08-17T17:50:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbbb405edc0 0x7fbbb4061280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd4150b10 0x7fbbd40a0460 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd4069b10 0x7fbbd40a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 --2- 172.21.15.78:0/2158613085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd40a59b0 0x7fbbd4165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 -- 172.21.15.78:0/2158613085 >> 172.21.15.78:0/2158613085 conn(0x7fbbd40c7320 msgr2=0x7fbbd40ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:21.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 -- 172.21.15.78:0/2158613085 shutdown_connections 2023-08-17T17:50:21.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.553+0000 7fbbd3fff700 1 -- 172.21.15.78:0/2158613085 wait complete. 2023-08-17T17:50:21.566 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T17:50:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.682+0000 7fb0518af700 1 Processor -- start 2023-08-17T17:50:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.682+0000 7fb0518af700 1 -- start start 2023-08-17T17:50:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.683+0000 7fb0518af700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa0f0 0x7fb04c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.683+0000 7fb0518af700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb04c0aa4d0 0x7fb04c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.683+0000 7fb0518af700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c0649b0 con 0x7fb04c0c5810 2023-08-17T17:50:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.683+0000 7fb0518af700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c063420 con 0x7fb04c0aa4d0 2023-08-17T17:50:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.683+0000 7fb0518af700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c063700 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.683+0000 7fb04affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa0f0 0x7fb04c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb0427fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb04c0aa4d0 0x7fb04c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb04affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa0f0 0x7fb04c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:46010/0 (socket says 172.21.15.78:46010) 2023-08-17T17:50:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb04affd700 1 -- 172.21.15.78:0/2786645997 learned_addr learned my addr 172.21.15.78:0/2786645997 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb04affd700 1 -- 172.21.15.78:0/2786645997 >> v2:172.21.15.150:3300/0 conn(0x7fb04c0aa4d0 msgr2=0x7fb04c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb04affd700 1 --2- 172.21.15.78:0/2786645997 >> v2:172.21.15.150:3300/0 conn(0x7fb04c0aa4d0 0x7fb04c0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb04affd700 1 -- 172.21.15.78:0/2786645997 >> v1:172.21.15.150:6789/0 conn(0x7fb04c0c5810 legacy=0x7fb04c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb04affd700 1 -- 172.21.15.78:0/2786645997 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0639e0 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb04affd700 1 --2- 172.21.15.78:0/2786645997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa0f0 0x7fb04c0644c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fb03c006fd0 tx=0x7fb03c0090f0).ready entity=mon.2 client_cookie=d85844c834b9e9dd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb04a7fc700 1 -- 172.21.15.78:0/2786645997 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00b580 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb04a7fc700 1 -- 172.21.15.78:0/2786645997 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c00b6e0 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.684+0000 7fb04a7fc700 1 -- 172.21.15.78:0/2786645997 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00ba60 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.685+0000 7fb0518af700 1 -- 172.21.15.78:0/2786645997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa0f0 msgr2=0x7fb04c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.685+0000 7fb0518af700 1 --2- 172.21.15.78:0/2786645997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa0f0 0x7fb04c0644c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fb03c006fd0 tx=0x7fb03c0090f0).stop 2023-08-17T17:50:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.685+0000 7fb0518af700 1 -- 172.21.15.78:0/2786645997 shutdown_connections 2023-08-17T17:50:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.685+0000 7fb0518af700 1 --2- 172.21.15.78:0/2786645997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa0f0 0x7fb04c0644c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.685+0000 7fb0518af700 1 --2- 172.21.15.78:0/2786645997 >> v2:172.21.15.150:3300/0 conn(0x7fb04c0aa4d0 0x7fb04c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.685+0000 7fb0518af700 1 -- 172.21.15.78:0/2786645997 >> 172.21.15.78:0/2786645997 conn(0x7fb04c06a6a0 msgr2=0x7fb04c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.685+0000 7fb0518af700 1 -- 172.21.15.78:0/2786645997 shutdown_connections 2023-08-17T17:50:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.685+0000 7fb0518af700 1 -- 172.21.15.78:0/2786645997 wait complete. 2023-08-17T17:50:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.686+0000 7fb0518af700 1 Processor -- start 2023-08-17T17:50:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.686+0000 7fb0518af700 1 -- start start 2023-08-17T17:50:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb0518af700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb04c0aa0f0 0x7fb04c0c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb0518af700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa4d0 0x7fb04c1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb0518af700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb04c0c5810 0x7fb04c151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb0518af700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c1521c0 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb0518af700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c13f490 con 0x7fb04c0c5810 2023-08-17T17:50:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb0518af700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c164da0 con 0x7fb04c0aa4d0 2023-08-17T17:50:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb04affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb04c0aa0f0 0x7fb04c0c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb04affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb04c0aa0f0 0x7fb04c0c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33744/0 (socket says 172.21.15.78:33744) 2023-08-17T17:50:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb04affd700 1 -- 172.21.15.78:0/2351550546 learned_addr learned my addr 172.21.15.78:0/2351550546 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb0427fc700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa4d0 0x7fb04c1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb04b7fe700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb04c0c5810 0x7fb04c151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb04affd700 1 -- 172.21.15.78:0/2351550546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa4d0 msgr2=0x7fb04c1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb04affd700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa4d0 0x7fb04c1517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb04affd700 1 -- 172.21.15.78:0/2351550546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb04c0c5810 msgr2=0x7fb04c151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb04affd700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb04c0c5810 0x7fb04c151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb04affd700 1 -- 172.21.15.78:0/2351550546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c009370 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb04affd700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb04c0aa0f0 0x7fb04c0c31f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fb03c009130 tx=0x7fb03c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.687+0000 7fb0437fe700 1 -- 172.21.15.78:0/2351550546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c000bc0 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.688+0000 7fb0437fe700 1 -- 172.21.15.78:0/2351550546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c00b850 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.688+0000 7fb0518af700 1 -- 172.21.15.78:0/2351550546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c165060 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.688+0000 7fb0437fe700 1 -- 172.21.15.78:0/2351550546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c000d20 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.688+0000 7fb0518af700 1 -- 172.21.15.78:0/2351550546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c165620 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.688+0000 7fb0518af700 1 -- 172.21.15.78:0/2351550546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c0643c0 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.689+0000 7fb0437fe700 1 -- 172.21.15.78:0/2351550546 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb03c02c070 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.689+0000 7fb0437fe700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb02c05ed90 0x7fb02c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.689+0000 7fb0437fe700 1 -- 172.21.15.78:0/2351550546 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fb03c07b780 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.689+0000 7fb0427fc700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb02c05ed90 0x7fb02c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.689+0000 7fb0427fc700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb02c05ed90 0x7fb02c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb04c0a7ea0 tx=0x7fb034009060).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.693+0000 7fb0437fe700 1 -- 172.21.15.78:0/2351550546 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb03c04cea0 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.858+0000 7fb0518af700 1 -- 172.21.15.78:0/2351550546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb04c153290 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.864+0000 7fb0437fe700 1 -- 172.21.15.78:0/2351550546 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb03c02a070 con 0x7fb04c0aa0f0 2023-08-17T17:50:21.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 -- 172.21.15.78:0/2351550546 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb02c05ed90 msgr2=0x7fb02c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:21.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb02c05ed90 0x7fb02c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb04c0a7ea0 tx=0x7fb034009060).stop 2023-08-17T17:50:21.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 -- 172.21.15.78:0/2351550546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb04c0aa0f0 msgr2=0x7fb04c0c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:21.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb04c0aa0f0 0x7fb04c0c31f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fb03c009130 tx=0x7fb03c017000).stop 2023-08-17T17:50:21.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 -- 172.21.15.78:0/2351550546 shutdown_connections 2023-08-17T17:50:21.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb02c05ed90 0x7fb02c061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb04c0c5810 0x7fb04c151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb04c0aa0f0 0x7fb04c0c31f0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 --2- 172.21.15.78:0/2351550546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb04c0aa4d0 0x7fb04c1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 -- 172.21.15.78:0/2351550546 >> 172.21.15.78:0/2351550546 conn(0x7fb04c06a6a0 msgr2=0x7fb04c0a9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 -- 172.21.15.78:0/2351550546 shutdown_connections 2023-08-17T17:50:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:21.866+0000 7fb0518af700 1 -- 172.21.15.78:0/2351550546 wait complete. 2023-08-17T17:50:21.878 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:50:21.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:50:21.910 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:50:21.954 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:50:21.954 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T17:50:21.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:50:22.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.068+0000 7f192ad6b700 1 Processor -- start 2023-08-17T17:50:22.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.068+0000 7f192ad6b700 1 -- start start 2023-08-17T17:50:22.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f192ad6b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 0x7f19240c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f192ad6b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f19240a7bd0 0x7f1924063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f192ad6b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1924063960 con 0x7f19240a8050 2023-08-17T17:50:22.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f192ad6b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240649f0 con 0x7f19240a7bd0 2023-08-17T17:50:22.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f192ad6b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1924063030 con 0x7f19240c01b0 2023-08-17T17:50:22.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f192a56a700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f19240a8050 0x7f19240642e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57696/0 (socket says 172.21.15.78:57696) 2023-08-17T17:50:22.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f192a56a700 1 -- 172.21.15.78:0/3341088810 learned_addr learned my addr 172.21.15.78:0/3341088810 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:22.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f1929d69700 1 --2- 172.21.15.78:0/3341088810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 0x7f19240c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f1929568700 1 --2- 172.21.15.78:0/3341088810 >> v2:172.21.15.150:3300/0 conn(0x7f19240a7bd0 0x7f1924063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f1928d67700 1 -- 172.21.15.78:0/3341088810 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466247633 0 0) 0x7f1924063960 con 0x7f19240a8050 2023-08-17T17:50:22.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.069+0000 7f1928d67700 1 -- 172.21.15.78:0/3341088810 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f190c0033f0 con 0x7f19240a8050 2023-08-17T17:50:22.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f1929d69700 1 -- 172.21.15.78:0/3341088810 >> v2:172.21.15.150:3300/0 conn(0x7f19240a7bd0 msgr2=0x7f1924063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:22.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f1929d69700 1 --2- 172.21.15.78:0/3341088810 >> v2:172.21.15.150:3300/0 conn(0x7f19240a7bd0 0x7f1924063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f1929d69700 1 -- 172.21.15.78:0/3341088810 >> v1:172.21.15.78:6789/0 conn(0x7f19240a8050 legacy=0x7f19240642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:22.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f1929d69700 1 -- 172.21.15.78:0/3341088810 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924063310 con 0x7f19240c01b0 2023-08-17T17:50:22.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f1929d69700 1 --2- 172.21.15.78:0/3341088810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 0x7f19240c5b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f191c009760 tx=0x7f191c009060).ready entity=mon.2 client_cookie=16ab64d5c22500c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:22.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f1928d67700 1 -- 172.21.15.78:0/3341088810 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00d4a0 con 0x7f19240c01b0 2023-08-17T17:50:22.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f1928d67700 1 -- 172.21.15.78:0/3341088810 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00d600 con 0x7f19240c01b0 2023-08-17T17:50:22.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f1928d67700 1 -- 172.21.15.78:0/3341088810 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00d980 con 0x7f19240c01b0 2023-08-17T17:50:22.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f192ad6b700 1 -- 172.21.15.78:0/3341088810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 msgr2=0x7f19240c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:22.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f192ad6b700 1 --2- 172.21.15.78:0/3341088810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 0x7f19240c5b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f191c009760 tx=0x7f191c009060).stop 2023-08-17T17:50:22.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f192ad6b700 1 -- 172.21.15.78:0/3341088810 shutdown_connections 2023-08-17T17:50:22.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f192ad6b700 1 --2- 172.21.15.78:0/3341088810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 0x7f19240c5b90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f192ad6b700 1 --2- 172.21.15.78:0/3341088810 >> v2:172.21.15.150:3300/0 conn(0x7f19240a7bd0 0x7f1924063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.070+0000 7f192ad6b700 1 -- 172.21.15.78:0/3341088810 >> 172.21.15.78:0/3341088810 conn(0x7f192406a6c0 msgr2=0x7f19240cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:22.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.071+0000 7f192ad6b700 1 -- 172.21.15.78:0/3341088810 shutdown_connections 2023-08-17T17:50:22.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.071+0000 7f192ad6b700 1 -- 172.21.15.78:0/3341088810 wait complete. 2023-08-17T17:50:22.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f192ad6b700 1 Processor -- start 2023-08-17T17:50:22.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f192ad6b700 1 -- start start 2023-08-17T17:50:22.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f192ad6b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19240a7bd0 0x7f19241497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f192ad6b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19240a8050 0x7f19241564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f192ad6b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 0x7f19241569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f192ad6b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924156ed0 con 0x7f19240a7bd0 2023-08-17T17:50:22.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f192ad6b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b0c80 con 0x7f19240a8050 2023-08-17T17:50:22.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f192ad6b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240aaa90 con 0x7f19240c01b0 2023-08-17T17:50:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f1929d69700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19240a7bd0 0x7f19241497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f1929d69700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19240a7bd0 0x7f19241497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33746/0 (socket says 172.21.15.78:33746) 2023-08-17T17:50:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.072+0000 7f1929d69700 1 -- 172.21.15.78:0/2686629838 learned_addr learned my addr 172.21.15.78:0/2686629838 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f192a56a700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 0x7f19241569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f1929568700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19240a8050 0x7f19241564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f1929d69700 1 -- 172.21.15.78:0/2686629838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 msgr2=0x7f19241569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f1929d69700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 0x7f19241569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f1929d69700 1 -- 172.21.15.78:0/2686629838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19240a8050 msgr2=0x7f19241564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f1929d69700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19240a8050 0x7f19241564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f1929d69700 1 -- 172.21.15.78:0/2686629838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c0092a0 con 0x7f19240a7bd0 2023-08-17T17:50:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f1929d69700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19240a7bd0 0x7f19241497e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f191c009d50 tx=0x7f191c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f1921ffb700 1 -- 172.21.15.78:0/2686629838 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00dd40 con 0x7f19240a7bd0 2023-08-17T17:50:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f1921ffb700 1 -- 172.21.15.78:0/2686629838 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00d770 con 0x7f19240a7bd0 2023-08-17T17:50:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f192ad6b700 1 -- 172.21.15.78:0/2686629838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19240b03e0 con 0x7f19240a7bd0 2023-08-17T17:50:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f1921ffb700 1 -- 172.21.15.78:0/2686629838 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00dea0 con 0x7f19240a7bd0 2023-08-17T17:50:22.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.073+0000 7f192ad6b700 1 -- 172.21.15.78:0/2686629838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19240b09a0 con 0x7f19240a7bd0 2023-08-17T17:50:22.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.074+0000 7f192ad6b700 1 -- 172.21.15.78:0/2686629838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1924083af0 con 0x7f19240a7bd0 2023-08-17T17:50:22.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.075+0000 7f1921ffb700 1 -- 172.21.15.78:0/2686629838 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f191c023020 con 0x7f19240a7bd0 2023-08-17T17:50:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.075+0000 7f1921ffb700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f191005ed90 0x7f1910061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.075+0000 7f1921ffb700 1 -- 172.21.15.78:0/2686629838 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f191c07b330 con 0x7f19240a7bd0 2023-08-17T17:50:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.075+0000 7f1929568700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f191005ed90 0x7f1910061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.075+0000 7f1929568700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f191005ed90 0x7f1910061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f1924098880 tx=0x7f1918008040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.079+0000 7f1921ffb700 1 -- 172.21.15.78:0/2686629838 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f191c04ca50 con 0x7f19240a7bd0 2023-08-17T17:50:22.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.281+0000 7f192ad6b700 1 -- 172.21.15.78:0/2686629838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19240635f0 con 0x7f19240a7bd0 2023-08-17T17:50:22.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.282+0000 7f1921ffb700 1 -- 172.21.15.78:0/2686629838 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f191c050070 con 0x7f19240a7bd0 2023-08-17T17:50:22.282 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:22.282 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3356030675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3356030675},{"type":"v1","addr":"172.21.15.150:6835","nonce":3356030675}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/807522916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":807522916},{"type":"v1","addr":"172.21.15.78:6837","nonce":807522916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/3165905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3165905348},{"type":"v1","addr":"172.21.15.150:6834","nonce":3165905348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":7074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/2667778426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2667778426},{"type":"v1","addr":"172.21.15.78:6836","nonce":2667778426}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[]} 2023-08-17T17:50:22.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 -- 172.21.15.78:0/2686629838 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f191005ed90 msgr2=0x7f1910061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:22.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f191005ed90 0x7f1910061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f1924098880 tx=0x7f1918008040).stop 2023-08-17T17:50:22.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 -- 172.21.15.78:0/2686629838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19240a7bd0 msgr2=0x7f19241497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:22.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19240a7bd0 0x7f19241497e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f191c009d50 tx=0x7f191c016000).stop 2023-08-17T17:50:22.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 -- 172.21.15.78:0/2686629838 shutdown_connections 2023-08-17T17:50:22.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f191005ed90 0x7f1910061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19240c01b0 0x7f19241569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19240a7bd0 0x7f19241497e0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 --2- 172.21.15.78:0/2686629838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19240a8050 0x7f19241564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 -- 172.21.15.78:0/2686629838 >> 172.21.15.78:0/2686629838 conn(0x7f192406a6c0 msgr2=0x7f19241536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:22.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 -- 172.21.15.78:0/2686629838 shutdown_connections 2023-08-17T17:50:22.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.284+0000 7f192ad6b700 1 -- 172.21.15.78:0/2686629838 wait complete. 2023-08-17T17:50:22.286 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 33 2023-08-17T17:50:22.296 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T17:50:22.297 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T17:50:22.297 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T17:50:22.297 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:50:22.297 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T17:50:22.297 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T17:50:22.298 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T17:50:22.298 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:50:22.298 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T17:50:22.298 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T17:50:22.299 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T17:50:22.299 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:50:22.299 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T17:50:22.299 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T17:50:22.299 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T17:50:22.300 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:50:22.305 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T17:50:22.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T17:50:22.306 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T17:50:22.307 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T17:50:22.309 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T17:50:22.310 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T17:50:22.310 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T17:50:22.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T17:50:22.347 INFO:tasks.ceph.mds.a:Started 2023-08-17T17:50:22.348 DEBUG:teuthology.parallel:result is None 2023-08-17T17:50:22.349 INFO:tasks.ceph.mds.c:Started 2023-08-17T17:50:22.349 DEBUG:teuthology.parallel:result is None 2023-08-17T17:50:22.351 INFO:tasks.ceph.mds.b:Started 2023-08-17T17:50:22.352 DEBUG:teuthology.parallel:result is None 2023-08-17T17:50:22.352 INFO:tasks.ceph.mds.d:Started 2023-08-17T17:50:22.352 DEBUG:teuthology.parallel:result is None 2023-08-17T17:50:22.353 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T17:50:22.419 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T17:50:22.420 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:50:22.433 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:50:22.434 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T17:50:22.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.475+0000 7f033a449700 1 Processor -- start 2023-08-17T17:50:22.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.475+0000 7f033a449700 1 -- start start 2023-08-17T17:50:22.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f033a449700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03341541a0 0x7f03340a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f033a449700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0334154580 0x7f03340bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f033a449700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03340c0340 0x7f03340c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f033a449700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03340a8190 con 0x7f0334154580 2023-08-17T17:50:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f033a449700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03340c8df0 con 0x7f03340c0340 2023-08-17T17:50:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f033a449700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03340c9970 con 0x7f03341541a0 2023-08-17T17:50:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f03337fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0334154580 0x7f03340bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f03337fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0334154580 0x7f03340bfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33806/0 (socket says 172.21.15.78:33806) 2023-08-17T17:50:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f03337fe700 1 -- 172.21.15.78:0/2518343570 learned_addr learned my addr 172.21.15.78:0/2518343570 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f03389e6700 1 --2- 172.21.15.78:0/2518343570 >> v2:172.21.15.150:3300/0 conn(0x7f03340c0340 0x7f03340c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f0333fff700 1 --2- 172.21.15.78:0/2518343570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03341541a0 0x7f03340a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f03337fe700 1 -- 172.21.15.78:0/2518343570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03341541a0 msgr2=0x7f03340a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f03337fe700 1 --2- 172.21.15.78:0/2518343570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03341541a0 0x7f03340a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f03337fe700 1 -- 172.21.15.78:0/2518343570 >> v2:172.21.15.150:3300/0 conn(0x7f03340c0340 msgr2=0x7f03340c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f03337fe700 1 --2- 172.21.15.78:0/2518343570 >> v2:172.21.15.150:3300/0 conn(0x7f03340c0340 0x7f03340c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f03337fe700 1 -- 172.21.15.78:0/2518343570 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03340c0770 con 0x7f0334154580 2023-08-17T17:50:22.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.476+0000 7f03337fe700 1 --2- 172.21.15.78:0/2518343570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0334154580 0x7f03340bfe50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f0334085a70 tx=0x7f03280090f0).ready entity=mon.0 client_cookie=2fa1daf497d51c55 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:22.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.477+0000 7f0332ffd700 1 -- 172.21.15.78:0/2518343570 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800f510 con 0x7f0334154580 2023-08-17T17:50:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.477+0000 7f0332ffd700 1 -- 172.21.15.78:0/2518343570 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032800f670 con 0x7f0334154580 2023-08-17T17:50:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.477+0000 7f0332ffd700 1 -- 172.21.15.78:0/2518343570 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800fa10 con 0x7f0334154580 2023-08-17T17:50:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.478+0000 7f033a449700 1 -- 172.21.15.78:0/2518343570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0334154580 msgr2=0x7f03340bfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.478+0000 7f033a449700 1 --2- 172.21.15.78:0/2518343570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0334154580 0x7f03340bfe50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f0334085a70 tx=0x7f03280090f0).stop 2023-08-17T17:50:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.478+0000 7f033a449700 1 -- 172.21.15.78:0/2518343570 shutdown_connections 2023-08-17T17:50:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.478+0000 7f033a449700 1 --2- 172.21.15.78:0/2518343570 >> v2:172.21.15.150:3300/0 conn(0x7f03340c0340 0x7f03340c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.478+0000 7f033a449700 1 --2- 172.21.15.78:0/2518343570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03341541a0 0x7f03340a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.478+0000 7f033a449700 1 --2- 172.21.15.78:0/2518343570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0334154580 0x7f03340bfe50 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.478+0000 7f033a449700 1 -- 172.21.15.78:0/2518343570 >> 172.21.15.78:0/2518343570 conn(0x7f033406a400 msgr2=0x7f03340caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.478+0000 7f033a449700 1 -- 172.21.15.78:0/2518343570 shutdown_connections 2023-08-17T17:50:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.478+0000 7f033a449700 1 -- 172.21.15.78:0/2518343570 wait complete. 2023-08-17T17:50:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.479+0000 7f033a449700 1 Processor -- start 2023-08-17T17:50:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.479+0000 7f033a449700 1 -- start start 2023-08-17T17:50:22.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f033a449700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03340c0340 0x7f03340c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f033a449700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03341541a0 0x7f0334157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f033a449700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0334154580 0x7f03341499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f033a449700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0334159200 con 0x7f03341541a0 2023-08-17T17:50:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f033a449700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03341585f0 con 0x7f03340c0340 2023-08-17T17:50:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f033a449700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03341588d0 con 0x7f0334154580 2023-08-17T17:50:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f03337fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03341541a0 0x7f0334157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f03337fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03341541a0 0x7f0334157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33818/0 (socket says 172.21.15.78:33818) 2023-08-17T17:50:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f03337fe700 1 -- 172.21.15.78:0/1241385831 learned_addr learned my addr 172.21.15.78:0/1241385831 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f0333fff700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03340c0340 0x7f03340c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f03389e6700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0334154580 0x7f03341499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f03337fe700 1 -- 172.21.15.78:0/1241385831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0334154580 msgr2=0x7f03341499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f03337fe700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0334154580 0x7f03341499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f03337fe700 1 -- 172.21.15.78:0/1241385831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03340c0340 msgr2=0x7f03340c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.480+0000 7f03337fe700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03340c0340 0x7f03340c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.481+0000 7f03337fe700 1 -- 172.21.15.78:0/1241385831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0328009370 con 0x7f03341541a0 2023-08-17T17:50:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.481+0000 7f03337fe700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03341541a0 0x7f0334157da0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f0334083b60 tx=0x7f0328016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.481+0000 7f031bfff700 1 -- 172.21.15.78:0/1241385831 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328006d90 con 0x7f03341541a0 2023-08-17T17:50:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.481+0000 7f031bfff700 1 -- 172.21.15.78:0/1241385831 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328000bc0 con 0x7f03341541a0 2023-08-17T17:50:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.481+0000 7f033a449700 1 -- 172.21.15.78:0/1241385831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0334158bb0 con 0x7f03341541a0 2023-08-17T17:50:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.481+0000 7f031bfff700 1 -- 172.21.15.78:0/1241385831 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032801b430 con 0x7f03341541a0 2023-08-17T17:50:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.481+0000 7f033a449700 1 -- 172.21.15.78:0/1241385831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0334159690 con 0x7f03341541a0 2023-08-17T17:50:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.482+0000 7f033a449700 1 -- 172.21.15.78:0/1241385831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03340852e0 con 0x7f03341541a0 2023-08-17T17:50:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.483+0000 7f031bfff700 1 -- 172.21.15.78:0/1241385831 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0328017040 con 0x7f03341541a0 2023-08-17T17:50:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.483+0000 7f031bfff700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f032005ed60 0x7f0320061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:22.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.483+0000 7f031bfff700 1 -- 172.21.15.78:0/1241385831 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f032807af10 con 0x7f03341541a0 2023-08-17T17:50:22.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.483+0000 7f0333fff700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f032005ed60 0x7f0320061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:22.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.483+0000 7f0333fff700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f032005ed60 0x7f0320061220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f0324009b90 tx=0x7f0324009060).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:22.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.487+0000 7f031bfff700 1 -- 172.21.15.78:0/1241385831 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f032804c630 con 0x7f03341541a0 2023-08-17T17:50:22.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:22.669+0000 7f033a449700 1 -- 172.21.15.78:0/1241385831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0334047350 con 0x7f03341541a0 2023-08-17T17:50:23.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.556+0000 7f031bfff700 1 -- 172.21.15.78:0/1241385831 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v101) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0328015070 con 0x7f03341541a0 2023-08-17T17:50:23.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 -- 172.21.15.78:0/1241385831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f032005ed60 msgr2=0x7f0320061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:23.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f032005ed60 0x7f0320061220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f0324009b90 tx=0x7f0324009060).stop 2023-08-17T17:50:23.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 -- 172.21.15.78:0/1241385831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03341541a0 msgr2=0x7f0334157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:23.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03341541a0 0x7f0334157da0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f0334083b60 tx=0x7f0328016000).stop 2023-08-17T17:50:23.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 -- 172.21.15.78:0/1241385831 shutdown_connections 2023-08-17T17:50:23.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f032005ed60 0x7f0320061220 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0334154580 0x7f03341499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03340c0340 0x7f03340c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 --2- 172.21.15.78:0/1241385831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03341541a0 0x7f0334157da0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 -- 172.21.15.78:0/1241385831 >> 172.21.15.78:0/1241385831 conn(0x7f033406a400 msgr2=0x7f03340c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:23.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 -- 172.21.15.78:0/1241385831 shutdown_connections 2023-08-17T17:50:23.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.558+0000 7f033a449700 1 -- 172.21.15.78:0/1241385831 wait complete. 2023-08-17T17:50:23.560 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-08-17T17:50:23.571 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T17:50:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.685+0000 7fd7effff700 1 Processor -- start 2023-08-17T17:50:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.685+0000 7fd7effff700 1 -- start start 2023-08-17T17:50:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7effff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7f00a7bd0 0x7fd7f0063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7effff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7f00a8050 0x7fd7f00642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7effff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f0063960 con 0x7fd7f00c01b0 2023-08-17T17:50:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7effff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f0063030 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7effff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f0063310 con 0x7fd7f00a8050 2023-08-17T17:50:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7e67fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7f00a7bd0 0x7fd7f0063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7e67fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7f00a7bd0 0x7fd7f0063df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33832/0 (socket says 172.21.15.78:33832) 2023-08-17T17:50:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7e67fc700 1 -- 172.21.15.78:0/3862109176 learned_addr learned my addr 172.21.15.78:0/3862109176 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7ef7fe700 1 --2- 172.21.15.78:0/3862109176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7f00a8050 0x7fd7f00642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7e67fc700 1 -- 172.21.15.78:0/3862109176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7f00a8050 msgr2=0x7fd7f00642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7e67fc700 1 --2- 172.21.15.78:0/3862109176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7f00a8050 0x7fd7f00642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7e67fc700 1 -- 172.21.15.78:0/3862109176 >> v1:172.21.15.150:6789/0 conn(0x7fd7f00c01b0 legacy=0x7fd7f00c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7e67fc700 1 -- 172.21.15.78:0/3862109176 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00635f0 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.686+0000 7fd7ef7fe700 1 --2- 172.21.15.78:0/3862109176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7f00a8050 0x7fd7f00642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7e67fc700 1 --2- 172.21.15.78:0/3862109176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 0x7fd7f0063df0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fd7d8006fd0 tx=0x7fd7d80090f0).ready entity=mon.0 client_cookie=a6c0e16f671ff0f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7ee7fc700 1 -- 172.21.15.78:0/3862109176 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d800b600 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7ee7fc700 1 -- 172.21.15.78:0/3862109176 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d800b760 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7ee7fc700 1 -- 172.21.15.78:0/3862109176 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d800bae0 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7effff700 1 -- 172.21.15.78:0/3862109176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 msgr2=0x7fd7f0063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:23.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7effff700 1 --2- 172.21.15.78:0/3862109176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 0x7fd7f0063df0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fd7d8006fd0 tx=0x7fd7d80090f0).stop 2023-08-17T17:50:23.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7effff700 1 -- 172.21.15.78:0/3862109176 shutdown_connections 2023-08-17T17:50:23.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7effff700 1 --2- 172.21.15.78:0/3862109176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7f00a8050 0x7fd7f00642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7effff700 1 --2- 172.21.15.78:0/3862109176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 0x7fd7f0063df0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7effff700 1 -- 172.21.15.78:0/3862109176 >> 172.21.15.78:0/3862109176 conn(0x7fd7f006a6c0 msgr2=0x7fd7f00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:23.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7effff700 1 -- 172.21.15.78:0/3862109176 shutdown_connections 2023-08-17T17:50:23.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.687+0000 7fd7effff700 1 -- 172.21.15.78:0/3862109176 wait complete. 2023-08-17T17:50:23.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.688+0000 7fd7effff700 1 Processor -- start 2023-08-17T17:50:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.689+0000 7fd7effff700 1 -- start start 2023-08-17T17:50:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.689+0000 7fd7effff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 0x7fd7f00c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.689+0000 7fd7effff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7f00a8050 0x7fd7f014d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.689+0000 7fd7effff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7f00c01b0 0x7fd7f00adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.689+0000 7fd7effff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00b0330 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.689+0000 7fd7effff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00c2b30 con 0x7fd7f00c01b0 2023-08-17T17:50:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.689+0000 7fd7effff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f0154c10 con 0x7fd7f00a8050 2023-08-17T17:50:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.689+0000 7fd7eeffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 0x7fd7f00c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.689+0000 7fd7eeffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 0x7fd7f00c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33846/0 (socket says 172.21.15.78:33846) 2023-08-17T17:50:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.689+0000 7fd7eeffd700 1 -- 172.21.15.78:0/1467606498 learned_addr learned my addr 172.21.15.78:0/1467606498 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7eeffd700 1 -- 172.21.15.78:0/1467606498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7f00a8050 msgr2=0x7fd7f014d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7eeffd700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7f00a8050 0x7fd7f014d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7ef7fe700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7f00c01b0 0x7fd7f00adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7eeffd700 1 -- 172.21.15.78:0/1467606498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7f00c01b0 msgr2=0x7fd7f00adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7eeffd700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7f00c01b0 0x7fd7f00adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7eeffd700 1 -- 172.21.15.78:0/1467606498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8009370 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7eeffd700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 0x7fd7f00c2640 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fd7e000b460 tx=0x7fd7e0006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7e77fe700 1 -- 172.21.15.78:0/1467606498 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0012410 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7e77fe700 1 -- 172.21.15.78:0/1467606498 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e0012570 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7e77fe700 1 -- 172.21.15.78:0/1467606498 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0012930 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7effff700 1 -- 172.21.15.78:0/1467606498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f00b0050 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.690+0000 7fd7effff700 1 -- 172.21.15.78:0/1467606498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f01548a0 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.691+0000 7fd7effff700 1 -- 172.21.15.78:0/1467606498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f0153cf0 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.691+0000 7fd7e77fe700 1 -- 172.21.15.78:0/1467606498 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd7e000f030 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.692+0000 7fd7e77fe700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7d005ed90 0x7fd7d0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:23.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.692+0000 7fd7e77fe700 1 -- 172.21.15.78:0/1467606498 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd7e0079500 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.692+0000 7fd7e67fc700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7d005ed90 0x7fd7d0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:23.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.692+0000 7fd7e67fc700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7d005ed90 0x7fd7d0061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd7f014f4a0 tx=0x7fd7d8017000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:23.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.696+0000 7fd7e77fe700 1 -- 172.21.15.78:0/1467606498 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7e004adf0 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.921+0000 7fd7effff700 1 -- 172.21.15.78:0/1467606498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd7f0154420 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.922+0000 7fd7e77fe700 1 -- 172.21.15.78:0/1467606498 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd7f0154420 con 0x7fd7f00a7bd0 2023-08-17T17:50:23.922 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:23.922 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:50:23.922 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-08-17T17:50:23.923 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.923 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-08-17T17:50:23.923 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA==", 2023-08-17T17:50:23.923 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.923 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:50:23.923 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:50:23.923 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:50:23.923 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.924 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.924 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.924 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.924 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-08-17T17:50:23.924 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g==", 2023-08-17T17:50:23.924 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.924 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:50:23.925 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:50:23.925 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:50:23.925 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.925 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.925 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.925 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.925 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-08-17T17:50:23.926 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw==", 2023-08-17T17:50:23.926 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.926 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:50:23.926 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:50:23.926 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:50:23.926 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.926 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.926 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.927 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.927 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-08-17T17:50:23.927 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg==", 2023-08-17T17:50:23.927 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.927 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:50:23.927 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:50:23.927 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:50:23.927 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.928 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.928 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.928 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.928 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-08-17T17:50:23.928 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg==", 2023-08-17T17:50:23.928 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.928 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:50:23.929 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:50:23.929 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.929 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.929 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.929 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.929 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-08-17T17:50:23.929 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw==", 2023-08-17T17:50:23.929 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.930 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:50:23.930 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:50:23.930 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.930 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.930 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.930 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.930 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-08-17T17:50:23.930 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA==", 2023-08-17T17:50:23.931 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.931 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:50:23.931 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:50:23.931 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.931 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.931 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.931 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.931 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-08-17T17:50:23.932 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ==", 2023-08-17T17:50:23.932 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.932 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:50:23.932 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:50:23.932 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.932 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.932 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.933 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.933 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-08-17T17:50:23.933 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA==", 2023-08-17T17:50:23.933 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.933 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:50:23.933 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:50:23.933 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.933 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.934 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.934 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.934 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-08-17T17:50:23.934 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q==", 2023-08-17T17:50:23.934 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.934 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:50:23.934 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:50:23.934 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.935 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.935 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.935 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.935 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-08-17T17:50:23.935 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw==", 2023-08-17T17:50:23.935 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.935 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:50:23.935 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:50:23.936 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.936 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.936 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.936 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.936 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-08-17T17:50:23.936 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg==", 2023-08-17T17:50:23.936 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.937 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:50:23.937 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:50:23.937 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.937 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.937 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.937 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.937 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-08-17T17:50:23.937 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA==", 2023-08-17T17:50:23.938 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.938 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:50:23.938 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-08-17T17:50:23.938 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T17:50:23.938 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.938 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.938 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.939 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-08-17T17:50:23.939 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ==", 2023-08-17T17:50:23.939 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.939 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:50:23.939 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:50:23.939 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:50:23.939 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:50:23.939 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.940 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.940 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.940 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-08-17T17:50:23.940 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ==", 2023-08-17T17:50:23.940 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.940 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:50:23.940 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:50:23.941 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:50:23.941 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:50:23.941 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.941 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.941 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.941 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-08-17T17:50:23.941 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw==", 2023-08-17T17:50:23.941 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.942 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:50:23.942 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:50:23.942 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:50:23.942 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:50:23.942 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.942 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.942 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.943 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-08-17T17:50:23.943 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k6n2yGhAAldYlBQaNGCgXL0HA2ePHVg==", 2023-08-17T17:50:23.943 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.943 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:50:23.943 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:50:23.943 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:50:23.943 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.943 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.944 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.944 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.944 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-08-17T17:50:23.944 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg==", 2023-08-17T17:50:23.944 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.944 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:50:23.944 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:50:23.945 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.945 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.945 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:23.945 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:23.945 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-08-17T17:50:23.945 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA==", 2023-08-17T17:50:23.945 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:50:23.945 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:50:23.946 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:50:23.946 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:50:23.946 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.946 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:23.946 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-08-17T17:50:23.946 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:50:23.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 -- 172.21.15.78:0/1467606498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7d005ed90 msgr2=0x7fd7d0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:23.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7d005ed90 0x7fd7d0061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd7f014f4a0 tx=0x7fd7d8017000).stop 2023-08-17T17:50:23.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 -- 172.21.15.78:0/1467606498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 msgr2=0x7fd7f00c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:23.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 0x7fd7f00c2640 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fd7e000b460 tx=0x7fd7e0006f20).stop 2023-08-17T17:50:23.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 -- 172.21.15.78:0/1467606498 shutdown_connections 2023-08-17T17:50:23.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7d005ed90 0x7fd7d0061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7f00c01b0 0x7fd7f00adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f00a7bd0 0x7fd7f00c2640 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:23.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 --2- 172.21.15.78:0/1467606498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7f00a8050 0x7fd7f014d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:23.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 -- 172.21.15.78:0/1467606498 >> 172.21.15.78:0/1467606498 conn(0x7fd7f006a6c0 msgr2=0x7fd7f00c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:23.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 -- 172.21.15.78:0/1467606498 shutdown_connections 2023-08-17T17:50:23.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:23.923+0000 7fd7effff700 1 -- 172.21.15.78:0/1467606498 wait complete. 2023-08-17T17:50:23.949 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:50:24.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.063+0000 7f2212238700 1 Processor -- start 2023-08-17T17:50:24.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.063+0000 7f2212238700 1 -- start start 2023-08-17T17:50:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2212238700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f220c0c62f0 0x7f220c0bd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2212238700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f220c0c66d0 0x7f220c0c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2212238700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c068110 con 0x7f220c1535e0 2023-08-17T17:50:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2212238700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c0638d0 con 0x7f220c0c66d0 2023-08-17T17:50:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2212238700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c0bdf80 con 0x7f220c0c62f0 2023-08-17T17:50:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2210a35700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f220c0c66d0 0x7f220c0c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2210a35700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f220c0c66d0 0x7f220c0c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33850/0 (socket says 172.21.15.78:33850) 2023-08-17T17:50:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2210a35700 1 -- 172.21.15.78:0/3641252754 learned_addr learned my addr 172.21.15.78:0/3641252754 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2211236700 1 --2- 172.21.15.78:0/3641252754 >> v2:172.21.15.150:3300/0 conn(0x7f220c0c62f0 0x7f220c0bd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2210a35700 1 -- 172.21.15.78:0/3641252754 >> v2:172.21.15.150:3300/0 conn(0x7f220c0c62f0 msgr2=0x7f220c0bd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2210a35700 1 --2- 172.21.15.78:0/3641252754 >> v2:172.21.15.150:3300/0 conn(0x7f220c0c62f0 0x7f220c0bd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2210a35700 1 -- 172.21.15.78:0/3641252754 >> v1:172.21.15.150:6789/0 conn(0x7f220c1535e0 legacy=0x7f220c153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2210a35700 1 -- 172.21.15.78:0/3641252754 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c062fa0 con 0x7f220c0c66d0 2023-08-17T17:50:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.064+0000 7f2210a35700 1 --2- 172.21.15.78:0/3641252754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c0c66d0 0x7f220c0c6b30 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f220c06c200 tx=0x7f21fc0090f0).ready entity=mon.0 client_cookie=cd926fe4db99ea8d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2203fff700 1 -- 172.21.15.78:0/3641252754 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc00b600 con 0x7f220c0c66d0 2023-08-17T17:50:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2203fff700 1 -- 172.21.15.78:0/3641252754 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc00b760 con 0x7f220c0c66d0 2023-08-17T17:50:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2203fff700 1 -- 172.21.15.78:0/3641252754 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc00bae0 con 0x7f220c0c66d0 2023-08-17T17:50:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2212238700 1 -- 172.21.15.78:0/3641252754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c0c66d0 msgr2=0x7f220c0c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2212238700 1 --2- 172.21.15.78:0/3641252754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c0c66d0 0x7f220c0c6b30 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f220c06c200 tx=0x7f21fc0090f0).stop 2023-08-17T17:50:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2212238700 1 -- 172.21.15.78:0/3641252754 shutdown_connections 2023-08-17T17:50:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2212238700 1 --2- 172.21.15.78:0/3641252754 >> v2:172.21.15.150:3300/0 conn(0x7f220c0c62f0 0x7f220c0bd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2212238700 1 --2- 172.21.15.78:0/3641252754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c0c66d0 0x7f220c0c6b30 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2212238700 1 -- 172.21.15.78:0/3641252754 >> 172.21.15.78:0/3641252754 conn(0x7f220c0aabf0 msgr2=0x7f220c0ac270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2212238700 1 -- 172.21.15.78:0/3641252754 shutdown_connections 2023-08-17T17:50:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.065+0000 7f2212238700 1 -- 172.21.15.78:0/3641252754 wait complete. 2023-08-17T17:50:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.066+0000 7f2212238700 1 Processor -- start 2023-08-17T17:50:24.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.066+0000 7f2212238700 1 -- start start 2023-08-17T17:50:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.067+0000 7f2212238700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f220c0c62f0 0x7f220c0c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.067+0000 7f2212238700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f220c0c66d0 0x7f220c0a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.067+0000 7f2212238700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c1535e0 0x7f220c069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.067+0000 7f2212238700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c163fc0 con 0x7f220c1535e0 2023-08-17T17:50:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.067+0000 7f2212238700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c167a50 con 0x7f220c0c66d0 2023-08-17T17:50:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.067+0000 7f2212238700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c167d30 con 0x7f220c0c62f0 2023-08-17T17:50:24.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.067+0000 7f2211a37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c1535e0 0x7f220c069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.067+0000 7f2211a37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c1535e0 0x7f220c069d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33854/0 (socket says 172.21.15.78:33854) 2023-08-17T17:50:24.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.067+0000 7f2211a37700 1 -- 172.21.15.78:0/670998879 learned_addr learned my addr 172.21.15.78:0/670998879 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:24.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2210a35700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f220c0c66d0 0x7f220c0a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2211236700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f220c0c62f0 0x7f220c0c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2211a37700 1 -- 172.21.15.78:0/670998879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f220c0c62f0 msgr2=0x7f220c0c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2211a37700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f220c0c62f0 0x7f220c0c2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2211a37700 1 -- 172.21.15.78:0/670998879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f220c0c66d0 msgr2=0x7f220c0a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2211a37700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f220c0c66d0 0x7f220c0a9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2211a37700 1 -- 172.21.15.78:0/670998879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc009370 con 0x7f220c1535e0 2023-08-17T17:50:24.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2210a35700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f220c0c66d0 0x7f220c0a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:24.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2211a37700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c1535e0 0x7f220c069d70 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f220400c7c0 tx=0x7f2204001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f22017fa700 1 -- 172.21.15.78:0/670998879 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204010510 con 0x7f220c1535e0 2023-08-17T17:50:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f22017fa700 1 -- 172.21.15.78:0/670998879 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2204010670 con 0x7f220c1535e0 2023-08-17T17:50:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2212238700 1 -- 172.21.15.78:0/670998879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c168010 con 0x7f220c1535e0 2023-08-17T17:50:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f22017fa700 1 -- 172.21.15.78:0/670998879 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040109f0 con 0x7f220c1535e0 2023-08-17T17:50:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.068+0000 7f2212238700 1 -- 172.21.15.78:0/670998879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c0c2f10 con 0x7f220c1535e0 2023-08-17T17:50:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.069+0000 7f2212238700 1 -- 172.21.15.78:0/670998879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c164110 con 0x7f220c1535e0 2023-08-17T17:50:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.069+0000 7f22017fa700 1 -- 172.21.15.78:0/670998879 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2204010070 con 0x7f220c1535e0 2023-08-17T17:50:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.070+0000 7f22017fa700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f21f005ed90 0x7f21f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.070+0000 7f22017fa700 1 -- 172.21.15.78:0/670998879 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2204079410 con 0x7f220c1535e0 2023-08-17T17:50:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.070+0000 7f2211236700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f21f005ed90 0x7f21f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.070+0000 7f2211236700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f21f005ed90 0x7f21f0061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f220800c940 tx=0x7f2208008040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.074+0000 7f22017fa700 1 -- 172.21.15.78:0/670998879 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f220c164110 con 0x7f220c1535e0 2023-08-17T17:50:24.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.239+0000 7f2212238700 1 -- 172.21.15.78:0/670998879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f220c164110 con 0x7f220c1535e0 2023-08-17T17:50:24.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.240+0000 7f22017fa700 1 -- 172.21.15.78:0/670998879 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+13762 (secure 0 0 0) 0x7f220c164110 con 0x7f220c1535e0 2023-08-17T17:50:24.241 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":101,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:50:23.552981+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:50:24.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 -- 172.21.15.78:0/670998879 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f21f005ed90 msgr2=0x7f21f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f21f005ed90 0x7f21f0061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f220800c940 tx=0x7f2208008040).stop 2023-08-17T17:50:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 -- 172.21.15.78:0/670998879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c1535e0 msgr2=0x7f220c069d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c1535e0 0x7f220c069d70 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f220400c7c0 tx=0x7f2204001510).stop 2023-08-17T17:50:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 -- 172.21.15.78:0/670998879 shutdown_connections 2023-08-17T17:50:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f21f005ed90 0x7f21f0061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f220c1535e0 0x7f220c069d70 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f220c0c62f0 0x7f220c0c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 --2- 172.21.15.78:0/670998879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f220c0c66d0 0x7f220c0a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 -- 172.21.15.78:0/670998879 >> 172.21.15.78:0/670998879 conn(0x7f220c0aabf0 msgr2=0x7f220c062800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 -- 172.21.15.78:0/670998879 shutdown_connections 2023-08-17T17:50:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.242+0000 7f2212238700 1 -- 172.21.15.78:0/670998879 wait complete. 2023-08-17T17:50:24.254 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T17:50:24.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:50:24.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.370+0000 7ff3c9358700 1 Processor -- start 2023-08-17T17:50:24.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.370+0000 7ff3c9358700 1 -- start start 2023-08-17T17:50:24.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.371+0000 7ff3c9358700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff3c40aa4d0 0x7ff3c40644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.371+0000 7ff3c9358700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40c5810 0x7ff3c40c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.371+0000 7ff3c9358700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c40649b0 con 0x7ff3c40aa0f0 2023-08-17T17:50:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.371+0000 7ff3c9358700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c40c6170 con 0x7ff3c40aa4d0 2023-08-17T17:50:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.371+0000 7ff3c9358700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4063420 con 0x7ff3c40c5810 2023-08-17T17:50:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.371+0000 7ff3c2ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff3c40aa0f0 0x7ff3c40c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57722/0 (socket says 172.21.15.78:57722) 2023-08-17T17:50:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.371+0000 7ff3c2ffd700 1 -- 172.21.15.78:0/3762318854 learned_addr learned my addr 172.21.15.78:0/3762318854 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.371+0000 7ff3ba7fc700 1 --2- 172.21.15.78:0/3762318854 >> v2:172.21.15.150:3300/0 conn(0x7ff3c40aa4d0 0x7ff3c40644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.371+0000 7ff3c37fe700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40c5810 0x7ff3c40c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.371+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73053504 0 0) 0x7ff3c40649b0 con 0x7ff3c40aa0f0 2023-08-17T17:50:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b00033f0 con 0x7ff3c40aa0f0 2023-08-17T17:50:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2934621181 0 0) 0x7ff3b00033f0 con 0x7ff3c40aa0f0 2023-08-17T17:50:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40c5810 msgr2=0x7ff3c40c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40c5810 0x7ff3c40c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 >> v2:172.21.15.150:3300/0 conn(0x7ff3c40aa4d0 msgr2=0x7ff3c40644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 --2- 172.21.15.78:0/3762318854 >> v2:172.21.15.150:3300/0 conn(0x7ff3c40aa4d0 0x7ff3c40644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4063700 con 0x7ff3c40aa0f0 2023-08-17T17:50:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7ff3b4001470 con 0x7ff3c40aa0f0 2023-08-17T17:50:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 >> v1:172.21.15.78:6789/0 conn(0x7ff3c40aa0f0 legacy=0x7ff3c40c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3b00038e0 0x7ff3b0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 0x7ff3b0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40c5810 0x7ff3b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40c6170 con 0x7ff3b0004690 2023-08-17T17:50:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4063420 con 0x7ff3b00038e0 2023-08-17T17:50:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b000b8e0 con 0x7ff3c40c5810 2023-08-17T17:50:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3ba7fc700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 0x7ff3b0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c37fe700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40c5810 0x7ff3b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c2ffd700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3b00038e0 0x7ff3b0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3ba7fc700 1 -- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40c5810 msgr2=0x7ff3b0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3ba7fc700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40c5810 0x7ff3b0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3ba7fc700 1 -- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3b00038e0 msgr2=0x7ff3b0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3ba7fc700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3b00038e0 0x7ff3b0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3ba7fc700 1 -- 172.21.15.78:0/3762318854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b00033f0 con 0x7ff3b0004690 2023-08-17T17:50:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c2ffd700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3b00038e0 0x7ff3b0003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3ba7fc700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 0x7ff3b0004b10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7ff3c40aa980 tx=0x7ff3ac009060).ready entity=mon.0 client_cookie=e29a3efbeed4a1c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac009e90 con 0x7ff3b0004690 2023-08-17T17:50:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ac009430 con 0x7ff3b0004690 2023-08-17T17:50:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.372+0000 7ff3c27fc700 1 -- 172.21.15.78:0/3762318854 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00e850 con 0x7ff3b0004690 2023-08-17T17:50:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.373+0000 7ff3c9358700 1 -- 172.21.15.78:0/3762318854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 msgr2=0x7ff3b0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.373+0000 7ff3c9358700 1 --2- 172.21.15.78:0/3762318854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 0x7ff3b0004b10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7ff3c40aa980 tx=0x7ff3ac009060).stop 2023-08-17T17:50:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.373+0000 7ff3c37fe700 1 -- 172.21.15.78:0/3762318854 reap_dead start 2023-08-17T17:50:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.373+0000 7ff3c9358700 1 -- 172.21.15.78:0/3762318854 shutdown_connections 2023-08-17T17:50:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.373+0000 7ff3c9358700 1 -- 172.21.15.78:0/3762318854 >> 172.21.15.78:0/3762318854 conn(0x7ff3c406a6a0 msgr2=0x7ff3c40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.373+0000 7ff3c9358700 1 -- 172.21.15.78:0/3762318854 shutdown_connections 2023-08-17T17:50:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.373+0000 7ff3c9358700 1 -- 172.21.15.78:0/3762318854 wait complete. 2023-08-17T17:50:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.374+0000 7ff3c9358700 1 Processor -- start 2023-08-17T17:50:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.374+0000 7ff3c9358700 1 -- start start 2023-08-17T17:50:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c9358700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 0x7ff3c40aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c9358700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40afcd0 0x7ff3c4145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c9358700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c40a8460 0x7ff3c40a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c9358700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40c23f0 con 0x7ff3b0004690 2023-08-17T17:50:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c9358700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40a8dd0 con 0x7ff3c40a8460 2023-08-17T17:50:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c9358700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40b0520 con 0x7ff3c40afcd0 2023-08-17T17:50:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 0x7ff3c40aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 0x7ff3c40aebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33876/0 (socket says 172.21.15.78:33876) 2023-08-17T17:50:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c2ffd700 1 -- 172.21.15.78:0/1835447594 learned_addr learned my addr 172.21.15.78:0/1835447594 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3ba7fc700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40afcd0 0x7ff3c4145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c37fe700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c40a8460 0x7ff3c40a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c2ffd700 1 -- 172.21.15.78:0/1835447594 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40afcd0 msgr2=0x7ff3c4145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c2ffd700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40afcd0 0x7ff3c4145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c2ffd700 1 -- 172.21.15.78:0/1835447594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c40a8460 msgr2=0x7ff3c40a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c2ffd700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c40a8460 0x7ff3c40a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.375+0000 7ff3c2ffd700 1 -- 172.21.15.78:0/1835447594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40c1ac0 con 0x7ff3b0004690 2023-08-17T17:50:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.376+0000 7ff3c2ffd700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 0x7ff3c40aebe0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7ff3b400e8b0 tx=0x7ff3b40014c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.376+0000 7ff3bb7fe700 1 -- 172.21.15.78:0/1835447594 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4010520 con 0x7ff3b0004690 2023-08-17T17:50:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.376+0000 7ff3bb7fe700 1 -- 172.21.15.78:0/1835447594 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b4010680 con 0x7ff3b0004690 2023-08-17T17:50:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.376+0000 7ff3c9358700 1 -- 172.21.15.78:0/1835447594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c40c1da0 con 0x7ff3b0004690 2023-08-17T17:50:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.376+0000 7ff3bb7fe700 1 -- 172.21.15.78:0/1835447594 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4010a00 con 0x7ff3b0004690 2023-08-17T17:50:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.376+0000 7ff3c9358700 1 -- 172.21.15.78:0/1835447594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c40b0150 con 0x7ff3b0004690 2023-08-17T17:50:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.377+0000 7ff3c9358700 1 -- 172.21.15.78:0/1835447594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c4083980 con 0x7ff3b0004690 2023-08-17T17:50:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.377+0000 7ff3bb7fe700 1 -- 172.21.15.78:0/1835447594 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff3b401a020 con 0x7ff3b0004690 2023-08-17T17:50:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.377+0000 7ff3bb7fe700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3a405ed90 0x7ff3a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.378+0000 7ff3bb7fe700 1 -- 172.21.15.78:0/1835447594 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff3b40791d0 con 0x7ff3b0004690 2023-08-17T17:50:24.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.378+0000 7ff3ba7fc700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3a405ed90 0x7ff3a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.378+0000 7ff3ba7fc700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3a405ed90 0x7ff3a4061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff3ac0095a0 tx=0x7ff3ac01a000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.381+0000 7ff3bb7fe700 1 -- 172.21.15.78:0/1835447594 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3b404aa60 con 0x7ff3b0004690 2023-08-17T17:50:24.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.543+0000 7ff3c9358700 1 -- 172.21.15.78:0/1835447594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff3c4046af0 con 0x7ff3b0004690 2023-08-17T17:50:24.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.543+0000 7ff3bb7fe700 1 -- 172.21.15.78:0/1835447594 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v101) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff3b404e080 con 0x7ff3b0004690 2023-08-17T17:50:24.544 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:50:24.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.545+0000 7ff3c9358700 1 -- 172.21.15.78:0/1835447594 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3a405ed90 msgr2=0x7ff3a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.545+0000 7ff3c9358700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3a405ed90 0x7ff3a4061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff3ac0095a0 tx=0x7ff3ac01a000).stop 2023-08-17T17:50:24.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.545+0000 7ff3c9358700 1 -- 172.21.15.78:0/1835447594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 msgr2=0x7ff3c40aebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.545+0000 7ff3c9358700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 0x7ff3c40aebe0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7ff3b400e8b0 tx=0x7ff3b40014c0).stop 2023-08-17T17:50:24.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.545+0000 7ff3c9358700 1 -- 172.21.15.78:0/1835447594 shutdown_connections 2023-08-17T17:50:24.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.545+0000 7ff3c9358700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff3a405ed90 0x7ff3a4061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.545+0000 7ff3c9358700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3c40a8460 0x7ff3c40a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.545+0000 7ff3c9358700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0004690 0x7ff3c40aebe0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.545+0000 7ff3c9358700 1 --2- 172.21.15.78:0/1835447594 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3c40afcd0 0x7ff3c4145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.545+0000 7ff3c9358700 1 -- 172.21.15.78:0/1835447594 >> 172.21.15.78:0/1835447594 conn(0x7ff3c406a6a0 msgr2=0x7ff3c4151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.546+0000 7ff3c9358700 1 -- 172.21.15.78:0/1835447594 shutdown_connections 2023-08-17T17:50:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.546+0000 7ff3c9358700 1 -- 172.21.15.78:0/1835447594 wait complete. 2023-08-17T17:50:24.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:50:24.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.673+0000 7fd1d224d700 1 Processor -- start 2023-08-17T17:50:24.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.673+0000 7fd1d224d700 1 -- start start 2023-08-17T17:50:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1d224d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1cc0aa0f0 0x7fd1cc0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1d224d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd1cc0c5810 0x7fd1cc0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1d224d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0649b0 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1d224d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c6170 con 0x7fd1cc0aa0f0 2023-08-17T17:50:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1d224d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc063420 con 0x7fd1cc0c5810 2023-08-17T17:50:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1cb7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1cc0aa0f0 0x7fd1cc0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1cb7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1cc0aa0f0 0x7fd1cc0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33884/0 (socket says 172.21.15.78:33884) 2023-08-17T17:50:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1cb7fe700 1 -- 172.21.15.78:0/131430753 learned_addr learned my addr 172.21.15.78:0/131430753 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1cb7fe700 1 -- 172.21.15.78:0/131430753 >> v2:172.21.15.150:3300/0 conn(0x7fd1cc0c5810 msgr2=0x7fd1cc0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1cb7fe700 1 --2- 172.21.15.78:0/131430753 >> v2:172.21.15.150:3300/0 conn(0x7fd1cc0c5810 0x7fd1cc0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1cb7fe700 1 -- 172.21.15.78:0/131430753 >> v1:172.21.15.150:6789/0 conn(0x7fd1cc0aa4d0 legacy=0x7fd1cc0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.674+0000 7fd1cb7fe700 1 -- 172.21.15.78:0/131430753 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc063700 con 0x7fd1cc0aa0f0 2023-08-17T17:50:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1cb7fe700 1 --2- 172.21.15.78:0/131430753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa0f0 0x7fd1cc0644c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7fd1cc159090 tx=0x7fd1bc009840).ready entity=mon.0 client_cookie=dbe41446c651a391 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1ca7fc700 1 -- 172.21.15.78:0/131430753 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00e070 con 0x7fd1cc0aa0f0 2023-08-17T17:50:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1ca7fc700 1 -- 172.21.15.78:0/131430753 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc00ba10 con 0x7fd1cc0aa0f0 2023-08-17T17:50:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1ca7fc700 1 -- 172.21.15.78:0/131430753 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00bd90 con 0x7fd1cc0aa0f0 2023-08-17T17:50:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1d224d700 1 -- 172.21.15.78:0/131430753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa0f0 msgr2=0x7fd1cc0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1d224d700 1 --2- 172.21.15.78:0/131430753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa0f0 0x7fd1cc0644c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7fd1cc159090 tx=0x7fd1bc009840).stop 2023-08-17T17:50:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1d224d700 1 -- 172.21.15.78:0/131430753 shutdown_connections 2023-08-17T17:50:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1d224d700 1 --2- 172.21.15.78:0/131430753 >> v2:172.21.15.150:3300/0 conn(0x7fd1cc0c5810 0x7fd1cc0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:24.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1d224d700 1 --2- 172.21.15.78:0/131430753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa0f0 0x7fd1cc0644c0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1d224d700 1 -- 172.21.15.78:0/131430753 >> 172.21.15.78:0/131430753 conn(0x7fd1cc06a6a0 msgr2=0x7fd1cc0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:24.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1d224d700 1 -- 172.21.15.78:0/131430753 shutdown_connections 2023-08-17T17:50:24.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.675+0000 7fd1d224d700 1 -- 172.21.15.78:0/131430753 wait complete. 2023-08-17T17:50:24.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1d224d700 1 Processor -- start 2023-08-17T17:50:24.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1d224d700 1 -- start start 2023-08-17T17:50:24.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1d224d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1cc0aa0f0 0x7fd1cc167730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1d224d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa4d0 0x7fd1cc0c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1d224d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1cc0c5810 0x7fd1cc0c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1d224d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c3190 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1d224d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c2580 con 0x7fd1cc0c5810 2023-08-17T17:50:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1d224d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c2860 con 0x7fd1cc0aa0f0 2023-08-17T17:50:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1caffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa4d0 0x7fd1cc0c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1caffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa4d0 0x7fd1cc0c1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33892/0 (socket says 172.21.15.78:33892) 2023-08-17T17:50:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.677+0000 7fd1caffd700 1 -- 172.21.15.78:0/1907881002 learned_addr learned my addr 172.21.15.78:0/1907881002 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1caffd700 1 -- 172.21.15.78:0/1907881002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1cc0aa0f0 msgr2=0x7fd1cc167730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1caffd700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1cc0aa0f0 0x7fd1cc167730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1cbfff700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1cc0c5810 0x7fd1cc0c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1caffd700 1 -- 172.21.15.78:0/1907881002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1cc0c5810 msgr2=0x7fd1cc0c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1caffd700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1cc0c5810 0x7fd1cc0c1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1caffd700 1 -- 172.21.15.78:0/1907881002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc009ae0 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1caffd700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa4d0 0x7fd1cc0c1ac0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7fd1c000b470 tx=0x7fd1c0006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1b37fe700 1 -- 172.21.15.78:0/1907881002 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0012410 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1b37fe700 1 -- 172.21.15.78:0/1907881002 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c0012590 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1d224d700 1 -- 172.21.15.78:0/1907881002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc0c2b40 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1b37fe700 1 -- 172.21.15.78:0/1907881002 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0012950 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.678+0000 7fd1d224d700 1 -- 172.21.15.78:0/1907881002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc0ad390 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.679+0000 7fd1d224d700 1 -- 172.21.15.78:0/1907881002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc1649e0 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.679+0000 7fd1b37fe700 1 -- 172.21.15.78:0/1907881002 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd1c000f030 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.680+0000 7fd1b37fe700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd1b805ed90 0x7fd1b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.680+0000 7fd1b37fe700 1 -- 172.21.15.78:0/1907881002 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd1c0079490 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.680+0000 7fd1cb7fe700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd1b805ed90 0x7fd1b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.680+0000 7fd1cb7fe700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd1b805ed90 0x7fd1b8061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd1bc00b9e0 tx=0x7fd1bc009840).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.684+0000 7fd1b37fe700 1 -- 172.21.15.78:0/1907881002 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd1c004ac70 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.844+0000 7fd1d224d700 1 -- 172.21.15.78:0/1907881002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd1cc0c32d0 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.845+0000 7fd1b37fe700 1 -- 172.21.15.78:0/1907881002 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v101) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd1cc0c32d0 con 0x7fd1cc0aa4d0 2023-08-17T17:50:24.845 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:50:24.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 -- 172.21.15.78:0/1907881002 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd1b805ed90 msgr2=0x7fd1b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd1b805ed90 0x7fd1b8061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd1bc00b9e0 tx=0x7fd1bc009840).stop 2023-08-17T17:50:24.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 -- 172.21.15.78:0/1907881002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa4d0 msgr2=0x7fd1cc0c1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa4d0 0x7fd1cc0c1ac0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7fd1c000b470 tx=0x7fd1c0006f90).stop 2023-08-17T17:50:24.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 -- 172.21.15.78:0/1907881002 shutdown_connections 2023-08-17T17:50:24.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd1b805ed90 0x7fd1b8061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1cc0c5810 0x7fd1cc0c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1cc0aa0f0 0x7fd1cc167730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:24.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 --2- 172.21.15.78:0/1907881002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1cc0aa4d0 0x7fd1cc0c1ac0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 -- 172.21.15.78:0/1907881002 >> 172.21.15.78:0/1907881002 conn(0x7fd1cc06a6a0 msgr2=0x7fd1cc0a8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:24.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 -- 172.21.15.78:0/1907881002 shutdown_connections 2023-08-17T17:50:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.847+0000 7fd1d224d700 1 -- 172.21.15.78:0/1907881002 wait complete. 2023-08-17T17:50:24.859 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T17:50:24.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.971+0000 7ff38603d700 1 Processor -- start 2023-08-17T17:50:24.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.971+0000 7ff38603d700 1 -- start start 2023-08-17T17:50:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.972+0000 7ff38603d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3800c6ee0 0x7ff3800c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.972+0000 7ff38603d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3800c7350 con 0x7ff3800c0df0 2023-08-17T17:50:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.972+0000 7ff38603d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3800a8350 con 0x7ff380154140 2023-08-17T17:50:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.972+0000 7ff38603d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3800c1240 con 0x7ff3800c6ee0 2023-08-17T17:50:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.972+0000 7ff37effd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3800c6ee0 0x7ff3800c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.972+0000 7ff37ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff3800c0df0 0x7ff3800ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57738/0 (socket says 172.21.15.78:57738) 2023-08-17T17:50:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.972+0000 7ff37effd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3800c6ee0 0x7ff3800c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33906/0 (socket says 172.21.15.78:33906) 2023-08-17T17:50:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.972+0000 7ff37ffff700 1 -- 172.21.15.78:0/242904433 learned_addr learned my addr 172.21.15.78:0/242904433 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff37effd700 1 -- 172.21.15.78:0/242904433 >> v1:172.21.15.150:6789/0 conn(0x7ff380154140 legacy=0x7ff3800a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff37effd700 1 -- 172.21.15.78:0/242904433 >> v1:172.21.15.78:6789/0 conn(0x7ff3800c0df0 legacy=0x7ff3800ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff37effd700 1 -- 172.21.15.78:0/242904433 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380154520 con 0x7ff3800c6ee0 2023-08-17T17:50:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff37e7fc700 1 -- 172.21.15.78:0/242904433 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584361518 0 0) 0x7ff3800c7350 con 0x7ff3800c0df0 2023-08-17T17:50:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff37effd700 1 --2- 172.21.15.78:0/242904433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3800c6ee0 0x7ff3800c0900 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7ff374009760 tx=0x7ff374009060).ready entity=mon.0 client_cookie=a5e5583ad07427c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff37e7fc700 1 -- 172.21.15.78:0/242904433 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37400b520 con 0x7ff3800c6ee0 2023-08-17T17:50:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff37e7fc700 1 -- 172.21.15.78:0/242904433 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37400b680 con 0x7ff3800c6ee0 2023-08-17T17:50:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff37e7fc700 1 -- 172.21.15.78:0/242904433 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37400ba00 con 0x7ff3800c6ee0 2023-08-17T17:50:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff38603d700 1 -- 172.21.15.78:0/242904433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3800c6ee0 msgr2=0x7ff3800c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff38603d700 1 --2- 172.21.15.78:0/242904433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3800c6ee0 0x7ff3800c0900 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7ff374009760 tx=0x7ff374009060).stop 2023-08-17T17:50:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff38603d700 1 -- 172.21.15.78:0/242904433 shutdown_connections 2023-08-17T17:50:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff38603d700 1 --2- 172.21.15.78:0/242904433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3800c6ee0 0x7ff3800c0900 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff38603d700 1 -- 172.21.15.78:0/242904433 >> 172.21.15.78:0/242904433 conn(0x7ff380094510 msgr2=0x7ff38006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff38603d700 1 -- 172.21.15.78:0/242904433 shutdown_connections 2023-08-17T17:50:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.973+0000 7ff38603d700 1 -- 172.21.15.78:0/242904433 wait complete. 2023-08-17T17:50:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.975+0000 7ff38603d700 1 Processor -- start 2023-08-17T17:50:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.975+0000 7ff38603d700 1 -- start start 2023-08-17T17:50:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.975+0000 7ff38603d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3800c0df0 0x7ff38014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.975+0000 7ff38603d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3800c6ee0 0x7ff380155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff38603d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff380154140 0x7ff3801550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff38603d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff380155cf0 con 0x7ff380154140 2023-08-17T17:50:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff38603d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800ade40 con 0x7ff3800c6ee0 2023-08-17T17:50:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff38603d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3801555d0 con 0x7ff3800c0df0 2023-08-17T17:50:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff380154140 0x7ff3801550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff380154140 0x7ff3801550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33908/0 (socket says 172.21.15.78:33908) 2023-08-17T17:50:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37ffff700 1 -- 172.21.15.78:0/3969314754 learned_addr learned my addr 172.21.15.78:0/3969314754 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37effd700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3800c6ee0 0x7ff380155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37f7fe700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3800c0df0 0x7ff38014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37ffff700 1 -- 172.21.15.78:0/3969314754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3800c0df0 msgr2=0x7ff38014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37ffff700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3800c0df0 0x7ff38014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37ffff700 1 -- 172.21.15.78:0/3969314754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3800c6ee0 msgr2=0x7ff380155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37ffff700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3800c6ee0 0x7ff380155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37ffff700 1 -- 172.21.15.78:0/3969314754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740092a0 con 0x7ff380154140 2023-08-17T17:50:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37effd700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3800c6ee0 0x7ff380155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff37ffff700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff380154140 0x7ff3801550e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7ff37800c490 tx=0x7ff378007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff3677fe700 1 -- 172.21.15.78:0/3969314754 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780072e0 con 0x7ff380154140 2023-08-17T17:50:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff3677fe700 1 -- 172.21.15.78:0/3969314754 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378007440 con 0x7ff380154140 2023-08-17T17:50:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff38603d700 1 -- 172.21.15.78:0/3969314754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff380155ee0 con 0x7ff380154140 2023-08-17T17:50:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff3677fe700 1 -- 172.21.15.78:0/3969314754 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780057a0 con 0x7ff380154140 2023-08-17T17:50:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.976+0000 7ff38603d700 1 -- 172.21.15.78:0/3969314754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3801564a0 con 0x7ff380154140 2023-08-17T17:50:24.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.977+0000 7ff38603d700 1 -- 172.21.15.78:0/3969314754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3800adff0 con 0x7ff380154140 2023-08-17T17:50:24.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.978+0000 7ff3677fe700 1 -- 172.21.15.78:0/3969314754 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff37801a060 con 0x7ff380154140 2023-08-17T17:50:24.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.978+0000 7ff3677fe700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff36c05ed90 0x7ff36c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:24.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.978+0000 7ff3677fe700 1 -- 172.21.15.78:0/3969314754 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff378078fa0 con 0x7ff380154140 2023-08-17T17:50:24.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.978+0000 7ff37f7fe700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff36c05ed90 0x7ff36c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:24.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.978+0000 7ff37f7fe700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff36c05ed90 0x7ff36c061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff370006fd0 tx=0x7ff370008040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:24.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:24.982+0000 7ff3677fe700 1 -- 172.21.15.78:0/3969314754 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3800adff0 con 0x7ff380154140 2023-08-17T17:50:25.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.145+0000 7ff38603d700 1 -- 172.21.15.78:0/3969314754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff3800adff0 con 0x7ff380154140 2023-08-17T17:50:25.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.146+0000 7ff3677fe700 1 -- 172.21.15.78:0/3969314754 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v101) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff3800adff0 con 0x7ff380154140 2023-08-17T17:50:25.146 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:25.146 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:50:25.147 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:25.147 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T17:50:25.147 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T17:50:25.147 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:50:25.147 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:25.147 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T17:50:25.147 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T17:50:25.148 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:25.148 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:50:25.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 -- 172.21.15.78:0/3969314754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff36c05ed90 msgr2=0x7ff36c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff36c05ed90 0x7ff36c061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff370006fd0 tx=0x7ff370008040).stop 2023-08-17T17:50:25.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 -- 172.21.15.78:0/3969314754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff380154140 msgr2=0x7ff3801550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff380154140 0x7ff3801550e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7ff37800c490 tx=0x7ff378007c10).stop 2023-08-17T17:50:25.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 -- 172.21.15.78:0/3969314754 shutdown_connections 2023-08-17T17:50:25.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff36c05ed90 0x7ff36c061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff380154140 0x7ff3801550e0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3800c0df0 0x7ff38014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 --2- 172.21.15.78:0/3969314754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3800c6ee0 0x7ff380155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 -- 172.21.15.78:0/3969314754 >> 172.21.15.78:0/3969314754 conn(0x7ff380094510 msgr2=0x7ff3800a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:25.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 -- 172.21.15.78:0/3969314754 shutdown_connections 2023-08-17T17:50:25.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.148+0000 7ff38603d700 1 -- 172.21.15.78:0/3969314754 wait complete. 2023-08-17T17:50:25.160 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T17:50:25.160 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T17:50:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.277+0000 7f8adc8fc700 1 Processor -- start 2023-08-17T17:50:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.277+0000 7f8adc8fc700 1 -- start start 2023-08-17T17:50:25.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8adc8fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80aa0f0 0x7f8ad80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8adc8fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ad80aa4d0 0x7f8ad80c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8adc8fc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad80649b0 con 0x7f8ad80c5810 2023-08-17T17:50:25.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8adc8fc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad8063420 con 0x7f8ad80aa4d0 2023-08-17T17:50:25.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8adc8fc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8063700 con 0x7f8ad80aa0f0 2023-08-17T17:50:25.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad5d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ad80aa4d0 0x7f8ad80c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad6d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8ad80c5810 0x7f8ad80a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57750/0 (socket says 172.21.15.78:57750) 2023-08-17T17:50:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad5d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ad80aa4d0 0x7f8ad80c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33910/0 (socket says 172.21.15.78:33910) 2023-08-17T17:50:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad6d9d700 1 -- 172.21.15.78:0/2261157719 learned_addr learned my addr 172.21.15.78:0/2261157719 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad659c700 1 --2- 172.21.15.78:0/2261157719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80aa0f0 0x7f8ad80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad5d9b700 1 -- 172.21.15.78:0/2261157719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80aa0f0 msgr2=0x7f8ad80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad5d9b700 1 --2- 172.21.15.78:0/2261157719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80aa0f0 0x7f8ad80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad559a700 1 -- 172.21.15.78:0/2261157719 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531080595 0 0) 0x7f8ad80649b0 con 0x7f8ad80c5810 2023-08-17T17:50:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad5d9b700 1 -- 172.21.15.78:0/2261157719 >> v1:172.21.15.78:6789/0 conn(0x7f8ad80c5810 legacy=0x7f8ad80a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad5d9b700 1 -- 172.21.15.78:0/2261157719 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80639e0 con 0x7f8ad80aa4d0 2023-08-17T17:50:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad5d9b700 1 --2- 172.21.15.78:0/2261157719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80aa4d0 0x7f8ad80c0e10 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f8ac0009760 tx=0x7f8ac0009060).ready entity=mon.0 client_cookie=3a4aafe4119942ff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad559a700 1 -- 172.21.15.78:0/2261157719 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000b580 con 0x7f8ad80aa4d0 2023-08-17T17:50:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad559a700 1 -- 172.21.15.78:0/2261157719 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac000b6e0 con 0x7f8ad80aa4d0 2023-08-17T17:50:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.278+0000 7f8ad559a700 1 -- 172.21.15.78:0/2261157719 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000ba60 con 0x7f8ad80aa4d0 2023-08-17T17:50:25.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.279+0000 7f8adc8fc700 1 -- 172.21.15.78:0/2261157719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80aa4d0 msgr2=0x7f8ad80c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.279+0000 7f8adc8fc700 1 --2- 172.21.15.78:0/2261157719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80aa4d0 0x7f8ad80c0e10 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f8ac0009760 tx=0x7f8ac0009060).stop 2023-08-17T17:50:25.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.279+0000 7f8adc8fc700 1 -- 172.21.15.78:0/2261157719 shutdown_connections 2023-08-17T17:50:25.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.279+0000 7f8adc8fc700 1 --2- 172.21.15.78:0/2261157719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80aa0f0 0x7f8ad80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.279+0000 7f8adc8fc700 1 --2- 172.21.15.78:0/2261157719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80aa4d0 0x7f8ad80c0e10 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.279+0000 7f8adc8fc700 1 -- 172.21.15.78:0/2261157719 >> 172.21.15.78:0/2261157719 conn(0x7f8ad806a6a0 msgr2=0x7f8ad80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:25.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.279+0000 7f8adc8fc700 1 -- 172.21.15.78:0/2261157719 shutdown_connections 2023-08-17T17:50:25.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.279+0000 7f8adc8fc700 1 -- 172.21.15.78:0/2261157719 wait complete. 2023-08-17T17:50:25.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.280+0000 7f8adc8fc700 1 Processor -- start 2023-08-17T17:50:25.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.280+0000 7f8adc8fc700 1 -- start start 2023-08-17T17:50:25.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8adc8fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80aa0f0 0x7f8ad80c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8adc8fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80aa4d0 0x7f8ad8141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8adc8fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5810 0x7f8ad80a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8adc8fc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80c5360 con 0x7f8ad80c5810 2023-08-17T17:50:25.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8adc8fc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80c23a0 con 0x7f8ad80aa4d0 2023-08-17T17:50:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8adc8fc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad813f1a0 con 0x7f8ad80aa0f0 2023-08-17T17:50:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5810 0x7f8ad80a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5810 0x7f8ad80a7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33912/0 (socket says 172.21.15.78:33912) 2023-08-17T17:50:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad6d9d700 1 -- 172.21.15.78:0/997939028 learned_addr learned my addr 172.21.15.78:0/997939028 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad659c700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80aa0f0 0x7f8ad80c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad5d9b700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80aa4d0 0x7f8ad8141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad6d9d700 1 -- 172.21.15.78:0/997939028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80aa0f0 msgr2=0x7f8ad80c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad6d9d700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80aa0f0 0x7f8ad80c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad6d9d700 1 -- 172.21.15.78:0/997939028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80aa4d0 msgr2=0x7f8ad8141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad6d9d700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80aa4d0 0x7f8ad8141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad6d9d700 1 -- 172.21.15.78:0/997939028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac00092a0 con 0x7f8ad80c5810 2023-08-17T17:50:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad5d9b700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80aa4d0 0x7f8ad8141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.281+0000 7f8ad6d9d700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5810 0x7f8ad80a7f30 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f8ac800c490 tx=0x7f8ac8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.282+0000 7f8ace7fc700 1 -- 172.21.15.78:0/997939028 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac800ce00 con 0x7f8ad80c5810 2023-08-17T17:50:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.282+0000 7f8ace7fc700 1 -- 172.21.15.78:0/997939028 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac80072e0 con 0x7f8ad80c5810 2023-08-17T17:50:25.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.282+0000 7f8adc8fc700 1 -- 172.21.15.78:0/997939028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad80c5080 con 0x7f8ad80c5810 2023-08-17T17:50:25.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.282+0000 7f8ace7fc700 1 -- 172.21.15.78:0/997939028 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80057a0 con 0x7f8ad80c5810 2023-08-17T17:50:25.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.282+0000 7f8adc8fc700 1 -- 172.21.15.78:0/997939028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad813ee30 con 0x7f8ad80c5810 2023-08-17T17:50:25.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.283+0000 7f8adc8fc700 1 -- 172.21.15.78:0/997939028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad813e9b0 con 0x7f8ad80c5810 2023-08-17T17:50:25.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.283+0000 7f8ace7fc700 1 -- 172.21.15.78:0/997939028 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8ac801a060 con 0x7f8ad80c5810 2023-08-17T17:50:25.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.283+0000 7f8ace7fc700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8ab805ed90 0x7f8ab8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.283+0000 7f8ace7fc700 1 -- 172.21.15.78:0/997939028 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8ac8078de0 con 0x7f8ad80c5810 2023-08-17T17:50:25.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.283+0000 7f8ad659c700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8ab805ed90 0x7f8ab8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.284+0000 7f8ad659c700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8ab805ed90 0x7f8ab8061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8ad0009fd0 tx=0x7f8ad0009880).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.287+0000 7f8ace7fc700 1 -- 172.21.15.78:0/997939028 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ad813e9b0 con 0x7f8ad80c5810 2023-08-17T17:50:25.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.451+0000 7f8adc8fc700 1 -- 172.21.15.78:0/997939028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f8ad813e9b0 con 0x7f8ad80c5810 2023-08-17T17:50:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.576+0000 7f8ace7fc700 1 -- 172.21.15.78:0/997939028 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v102) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8ad813e9b0 con 0x7f8ad80c5810 2023-08-17T17:50:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.579+0000 7f8adc8fc700 1 -- 172.21.15.78:0/997939028 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8ab805ed90 msgr2=0x7f8ab8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.579+0000 7f8adc8fc700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8ab805ed90 0x7f8ab8061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8ad0009fd0 tx=0x7f8ad0009880).stop 2023-08-17T17:50:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.579+0000 7f8adc8fc700 1 -- 172.21.15.78:0/997939028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5810 msgr2=0x7f8ad80a7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.579+0000 7f8adc8fc700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5810 0x7f8ad80a7f30 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f8ac800c490 tx=0x7f8ac8007e10).stop 2023-08-17T17:50:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.579+0000 7f8adc8fc700 1 -- 172.21.15.78:0/997939028 shutdown_connections 2023-08-17T17:50:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.579+0000 7f8adc8fc700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8ab805ed90 0x7f8ab8061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.579+0000 7f8adc8fc700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5810 0x7f8ad80a7f30 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.579+0000 7f8adc8fc700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80aa0f0 0x7f8ad80c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.579+0000 7f8adc8fc700 1 --2- 172.21.15.78:0/997939028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80aa4d0 0x7f8ad8141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.579+0000 7f8adc8fc700 1 -- 172.21.15.78:0/997939028 >> 172.21.15.78:0/997939028 conn(0x7f8ad806a6a0 msgr2=0x7f8ad8152f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:25.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.580+0000 7f8adc8fc700 1 -- 172.21.15.78:0/997939028 shutdown_connections 2023-08-17T17:50:25.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.580+0000 7f8adc8fc700 1 -- 172.21.15.78:0/997939028 wait complete. 2023-08-17T17:50:25.583 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T17:50:25.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T17:50:25.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.715+0000 7f5a2552c700 1 Processor -- start 2023-08-17T17:50:25.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.716+0000 7f5a2552c700 1 -- start start 2023-08-17T17:50:25.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.716+0000 7f5a2552c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5a2014ea40 0x7f5a200bca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.716+0000 7f5a2552c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a200c3150 con 0x7f5a20068ff0 2023-08-17T17:50:25.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.716+0000 7f5a2552c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a20151d10 con 0x7f5a2014e660 2023-08-17T17:50:25.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.716+0000 7f5a2552c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a20151ff0 con 0x7f5a2014ea40 2023-08-17T17:50:25.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a24d2b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5a20068ff0 0x7f5a200c35e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57752/0 (socket says 172.21.15.78:57752) 2023-08-17T17:50:25.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a24d2b700 1 -- 172.21.15.78:0/2334291931 learned_addr learned my addr 172.21.15.78:0/2334291931 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:25.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1f7fe700 1 --2- 172.21.15.78:0/2334291931 >> v2:172.21.15.150:3300/0 conn(0x7f5a2014ea40 0x7f5a200bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458702817 0 0) 0x7f5a200c3150 con 0x7f5a20068ff0 2023-08-17T17:50:25.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a080033f0 con 0x7f5a20068ff0 2023-08-17T17:50:25.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1148782776 0 0) 0x7f5a080033f0 con 0x7f5a20068ff0 2023-08-17T17:50:25.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 >> v2:172.21.15.150:3300/0 conn(0x7f5a2014ea40 msgr2=0x7f5a200bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:25.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 --2- 172.21.15.78:0/2334291931 >> v2:172.21.15.150:3300/0 conn(0x7f5a2014ea40 0x7f5a200bca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 >> v1:172.21.15.150:6789/0 conn(0x7f5a2014e660 legacy=0x7f5a201511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a200c2de0 con 0x7f5a20068ff0 2023-08-17T17:50:25.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f5a180017f0 con 0x7f5a20068ff0 2023-08-17T17:50:25.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 >> v1:172.21.15.78:6789/0 conn(0x7f5a20068ff0 legacy=0x7f5a200c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a080038e0 0x7f5a08003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a08004690 0x7f5a08004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a08005050 0x7f5a0800daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20151ff0 con 0x7f5a08005050 2023-08-17T17:50:25.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0800e1f0 con 0x7f5a08004690 2023-08-17T17:50:25.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0800e3b0 con 0x7f5a080038e0 2023-08-17T17:50:25.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a24d2b700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a08005050 0x7f5a0800daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1f7fe700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a08004690 0x7f5a08004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.717+0000 7f5a1ffff700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a080038e0 0x7f5a08003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a24d2b700 1 -- 172.21.15.78:0/2334291931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a080038e0 msgr2=0x7f5a08003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:25.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a24d2b700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a080038e0 0x7f5a08003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a24d2b700 1 -- 172.21.15.78:0/2334291931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a08004690 msgr2=0x7f5a08004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:25.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a24d2b700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a08004690 0x7f5a08004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a24d2b700 1 -- 172.21.15.78:0/2334291931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a080033f0 con 0x7f5a08005050 2023-08-17T17:50:25.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a1ffff700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a080038e0 0x7f5a08003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:25.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a24d2b700 1 -- 172.21.15.78:0/2334291931 reap_dead start 2023-08-17T17:50:25.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a24d2b700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a08005050 0x7f5a0800daf0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f5a1800c5c0 tx=0x7f5a200bcf00).ready entity=mon.0 client_cookie=c405060d3b8fc050 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:25.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800cdc0 con 0x7f5a08005050 2023-08-17T17:50:25.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a18005b20 con 0x7f5a08005050 2023-08-17T17:50:25.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a1effd700 1 -- 172.21.15.78:0/2334291931 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18005ea0 con 0x7f5a08005050 2023-08-17T17:50:25.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a2552c700 1 -- 172.21.15.78:0/2334291931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a08005050 msgr2=0x7f5a0800daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a2552c700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a08005050 0x7f5a0800daf0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f5a1800c5c0 tx=0x7f5a200bcf00).stop 2023-08-17T17:50:25.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a2552c700 1 -- 172.21.15.78:0/2334291931 shutdown_connections 2023-08-17T17:50:25.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a2552c700 1 --2- 172.21.15.78:0/2334291931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a08005050 0x7f5a0800daf0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a2552c700 1 -- 172.21.15.78:0/2334291931 >> 172.21.15.78:0/2334291931 conn(0x7f5a200c7ab0 msgr2=0x7f5a200c7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:25.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a2552c700 1 -- 172.21.15.78:0/2334291931 shutdown_connections 2023-08-17T17:50:25.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.718+0000 7f5a2552c700 1 -- 172.21.15.78:0/2334291931 wait complete. 2023-08-17T17:50:25.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.719+0000 7f5a2552c700 1 Processor -- start 2023-08-17T17:50:25.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.720+0000 7f5a2552c700 1 -- start start 2023-08-17T17:50:25.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.720+0000 7f5a2552c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a08005050 0x7f5a20152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.720+0000 7f5a2552c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2014d9f0 0x7f5a200ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.720+0000 7f5a2552c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a2014c5c0 0x7f5a2014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.720+0000 7f5a2552c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20155240 con 0x7f5a2014d9f0 2023-08-17T17:50:25.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.720+0000 7f5a2552c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2014cf30 con 0x7f5a2014c5c0 2023-08-17T17:50:25.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.720+0000 7f5a2552c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2014d3e0 con 0x7f5a08005050 2023-08-17T17:50:25.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.720+0000 7f5a1f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2014d9f0 0x7f5a200ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a1f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2014d9f0 0x7f5a200ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33930/0 (socket says 172.21.15.78:33930) 2023-08-17T17:50:25.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a1f7fe700 1 -- 172.21.15.78:0/615128313 learned_addr learned my addr 172.21.15.78:0/615128313 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:25.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a24d2b700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a2014c5c0 0x7f5a2014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a1ffff700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a08005050 0x7f5a20152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a1f7fe700 1 -- 172.21.15.78:0/615128313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a08005050 msgr2=0x7f5a20152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a1f7fe700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a08005050 0x7f5a20152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a1f7fe700 1 -- 172.21.15.78:0/615128313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a2014c5c0 msgr2=0x7f5a2014ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a1f7fe700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a2014c5c0 0x7f5a2014ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a1f7fe700 1 -- 172.21.15.78:0/615128313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a201549e0 con 0x7f5a2014d9f0 2023-08-17T17:50:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a24d2b700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a2014c5c0 0x7f5a2014ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a1f7fe700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2014d9f0 0x7f5a200ad1b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f5a14011a20 tx=0x7f5a14009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a07fff700 1 -- 172.21.15.78:0/615128313 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14011e90 con 0x7f5a2014d9f0 2023-08-17T17:50:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a07fff700 1 -- 172.21.15.78:0/615128313 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1400f940 con 0x7f5a2014d9f0 2023-08-17T17:50:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a2552c700 1 -- 172.21.15.78:0/615128313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a20153560 con 0x7f5a2014d9f0 2023-08-17T17:50:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a07fff700 1 -- 172.21.15.78:0/615128313 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1400fcc0 con 0x7f5a2014d9f0 2023-08-17T17:50:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.721+0000 7f5a2552c700 1 -- 172.21.15.78:0/615128313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a20154f60 con 0x7f5a2014d9f0 2023-08-17T17:50:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.722+0000 7f5a2552c700 1 -- 172.21.15.78:0/615128313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a20068330 con 0x7f5a2014d9f0 2023-08-17T17:50:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.723+0000 7f5a07fff700 1 -- 172.21.15.78:0/615128313 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5a14024070 con 0x7f5a2014d9f0 2023-08-17T17:50:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.723+0000 7f5a07fff700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a0c05ed60 0x7f5a0c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.723+0000 7f5a07fff700 1 -- 172.21.15.78:0/615128313 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f5a1407a100 con 0x7f5a2014d9f0 2023-08-17T17:50:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.723+0000 7f5a1ffff700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a0c05ed60 0x7f5a0c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.724+0000 7f5a1ffff700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a0c05ed60 0x7f5a0c061220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5a10000c00 tx=0x7f5a10009040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.728+0000 7f5a07fff700 1 -- 172.21.15.78:0/615128313 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a1404b880 con 0x7f5a2014d9f0 2023-08-17T17:50:25.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:25.893+0000 7f5a2552c700 1 -- 172.21.15.78:0/615128313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5a2005e730 con 0x7f5a2014d9f0 2023-08-17T17:50:26.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.582+0000 7f5a07fff700 1 -- 172.21.15.78:0/615128313 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v103) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5a14022020 con 0x7f5a2014d9f0 2023-08-17T17:50:26.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.589+0000 7f5a2552c700 1 -- 172.21.15.78:0/615128313 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a0c05ed60 msgr2=0x7f5a0c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:26.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.589+0000 7f5a2552c700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a0c05ed60 0x7f5a0c061220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5a10000c00 tx=0x7f5a10009040).stop 2023-08-17T17:50:26.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.589+0000 7f5a2552c700 1 -- 172.21.15.78:0/615128313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2014d9f0 msgr2=0x7f5a200ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:26.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.589+0000 7f5a2552c700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2014d9f0 0x7f5a200ad1b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f5a14011a20 tx=0x7f5a14009060).stop 2023-08-17T17:50:26.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.590+0000 7f5a2552c700 1 -- 172.21.15.78:0/615128313 shutdown_connections 2023-08-17T17:50:26.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.590+0000 7f5a2552c700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5a0c05ed60 0x7f5a0c061220 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:26.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.590+0000 7f5a2552c700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a2014c5c0 0x7f5a2014ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.590+0000 7f5a2552c700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a08005050 0x7f5a20152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.590+0000 7f5a2552c700 1 --2- 172.21.15.78:0/615128313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2014d9f0 0x7f5a200ad1b0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.590+0000 7f5a2552c700 1 -- 172.21.15.78:0/615128313 >> 172.21.15.78:0/615128313 conn(0x7f5a200c7ab0 msgr2=0x7f5a2014aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.591+0000 7f5a2552c700 1 -- 172.21.15.78:0/615128313 shutdown_connections 2023-08-17T17:50:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.591+0000 7f5a2552c700 1 -- 172.21.15.78:0/615128313 wait complete. 2023-08-17T17:50:26.597 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T17:50:26.614 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T17:50:26.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.730+0000 7f1020053700 1 Processor -- start 2023-08-17T17:50:26.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.730+0000 7f1020053700 1 -- start start 2023-08-17T17:50:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.731+0000 7f1020053700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 0x7f10180644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.731+0000 7f1020053700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10180649b0 con 0x7f10180aa0f0 2023-08-17T17:50:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.731+0000 7f1020053700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1018063420 con 0x7f10180aa4d0 2023-08-17T17:50:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.731+0000 7f1020053700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1018063700 con 0x7f10180c5f20 2023-08-17T17:50:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.731+0000 7f101ddef700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f10180aa0f0 0x7f10180c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57762/0 (socket says 172.21.15.78:57762) 2023-08-17T17:50:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.731+0000 7f101ddef700 1 -- 172.21.15.78:0/4207102168 learned_addr learned my addr 172.21.15.78:0/4207102168 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.731+0000 7f101e5f0700 1 --2- 172.21.15.78:0/4207102168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 0x7f10180644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.731+0000 7f101cded700 1 -- 172.21.15.78:0/4207102168 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570231525 0 0) 0x7f10180649b0 con 0x7f10180aa0f0 2023-08-17T17:50:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101cded700 1 -- 172.21.15.78:0/4207102168 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10040033f0 con 0x7f10180aa0f0 2023-08-17T17:50:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101cded700 1 -- 172.21.15.78:0/4207102168 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451535735 0 0) 0x7f1018063420 con 0x7f10180aa4d0 2023-08-17T17:50:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101cded700 1 -- 172.21.15.78:0/4207102168 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10180649b0 con 0x7f10180aa4d0 2023-08-17T17:50:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101e5f0700 1 -- 172.21.15.78:0/4207102168 >> v1:172.21.15.150:6789/0 conn(0x7f10180aa4d0 legacy=0x7f10180c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101cded700 1 -- 172.21.15.78:0/4207102168 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4180384711 0 0) 0x7f10040033f0 con 0x7f10180aa0f0 2023-08-17T17:50:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101e5f0700 1 -- 172.21.15.78:0/4207102168 >> v1:172.21.15.78:6789/0 conn(0x7f10180aa0f0 legacy=0x7f10180c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101e5f0700 1 -- 172.21.15.78:0/4207102168 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10180639e0 con 0x7f10180c5f20 2023-08-17T17:50:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101e5f0700 1 --2- 172.21.15.78:0/4207102168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 0x7f10180644c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1010009790 tx=0x7f1010009060).ready entity=mon.2 client_cookie=ed946cf320ab9d13 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101cded700 1 -- 172.21.15.78:0/4207102168 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10140017f0 con 0x7f10180c5f20 2023-08-17T17:50:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101cded700 1 -- 172.21.15.78:0/4207102168 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1010011400 con 0x7f10180c5f20 2023-08-17T17:50:26.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.732+0000 7f101cded700 1 -- 172.21.15.78:0/4207102168 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1010011780 con 0x7f10180c5f20 2023-08-17T17:50:26.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.733+0000 7f1020053700 1 -- 172.21.15.78:0/4207102168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 msgr2=0x7f10180644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:26.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.733+0000 7f1020053700 1 --2- 172.21.15.78:0/4207102168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 0x7f10180644c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1010009790 tx=0x7f1010009060).stop 2023-08-17T17:50:26.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.733+0000 7f1020053700 1 -- 172.21.15.78:0/4207102168 shutdown_connections 2023-08-17T17:50:26.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.733+0000 7f1020053700 1 --2- 172.21.15.78:0/4207102168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 0x7f10180644c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:26.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.733+0000 7f1020053700 1 -- 172.21.15.78:0/4207102168 >> 172.21.15.78:0/4207102168 conn(0x7f101806a6a0 msgr2=0x7f10180caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:26.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.733+0000 7f1020053700 1 -- 172.21.15.78:0/4207102168 shutdown_connections 2023-08-17T17:50:26.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.733+0000 7f1020053700 1 -- 172.21.15.78:0/4207102168 wait complete. 2023-08-17T17:50:26.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.734+0000 7f1020053700 1 Processor -- start 2023-08-17T17:50:26.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.734+0000 7f1020053700 1 -- start start 2023-08-17T17:50:26.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f1020053700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10180aa0f0 0x7f10180ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:26.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f1020053700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10180aa4d0 0x7f1018145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:26.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f1020053700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 0x7f1018150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:26.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f1020053700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10180c1ac0 con 0x7f10180aa4d0 2023-08-17T17:50:26.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f1020053700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10180c51b0 con 0x7f10180aa0f0 2023-08-17T17:50:26.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f1020053700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10180a9570 con 0x7f10180c5f20 2023-08-17T17:50:26.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101d5ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10180aa4d0 0x7f1018145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:26.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101d5ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10180aa4d0 0x7f1018145b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33938/0 (socket says 172.21.15.78:33938) 2023-08-17T17:50:26.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101d5ee700 1 -- 172.21.15.78:0/148987391 learned_addr learned my addr 172.21.15.78:0/148987391 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:26.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101e5f0700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 0x7f1018150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:26.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101ddef700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10180aa0f0 0x7f10180ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:26.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101d5ee700 1 -- 172.21.15.78:0/148987391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 msgr2=0x7f1018150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:26.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101d5ee700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 0x7f1018150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:26.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101d5ee700 1 -- 172.21.15.78:0/148987391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10180aa0f0 msgr2=0x7f10180ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:26.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101d5ee700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10180aa0f0 0x7f10180ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:26.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101d5ee700 1 -- 172.21.15.78:0/148987391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100092a0 con 0x7f10180aa4d0 2023-08-17T17:50:26.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f101d5ee700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10180aa4d0 0x7f1018145b70 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f100800c450 tx=0x7f1008007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:26.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f100dffb700 1 -- 172.21.15.78:0/148987391 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008012400 con 0x7f10180aa4d0 2023-08-17T17:50:26.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f100dffb700 1 -- 172.21.15.78:0/148987391 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008012560 con 0x7f10180aa4d0 2023-08-17T17:50:26.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f100dffb700 1 -- 172.21.15.78:0/148987391 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008012920 con 0x7f10180aa4d0 2023-08-17T17:50:26.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.735+0000 7f1020053700 1 -- 172.21.15.78:0/148987391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1018146060 con 0x7f10180aa4d0 2023-08-17T17:50:26.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.736+0000 7f1020053700 1 -- 172.21.15.78:0/148987391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10180c1ff0 con 0x7f10180aa4d0 2023-08-17T17:50:26.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.736+0000 7f1020053700 1 -- 172.21.15.78:0/148987391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10180c52f0 con 0x7f10180aa4d0 2023-08-17T17:50:26.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.737+0000 7f100dffb700 1 -- 172.21.15.78:0/148987391 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1008019030 con 0x7f10180aa4d0 2023-08-17T17:50:26.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.737+0000 7f100dffb700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ffc05ed90 0x7f0ffc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:26.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.737+0000 7f100dffb700 1 -- 172.21.15.78:0/148987391 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f1008079070 con 0x7f10180aa4d0 2023-08-17T17:50:26.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.737+0000 7f101ddef700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ffc05ed90 0x7f0ffc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:26.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.738+0000 7f101ddef700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ffc05ed90 0x7f0ffc061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1014001560 tx=0x7f1014000f40).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:26.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.742+0000 7f100dffb700 1 -- 172.21.15.78:0/148987391 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f10180c52f0 con 0x7f10180aa4d0 2023-08-17T17:50:26.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.943+0000 7f1020053700 1 -- 172.21.15.78:0/148987391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f10180c52f0 con 0x7f10180aa4d0 2023-08-17T17:50:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.955+0000 7f100dffb700 1 -- 172.21.15.78:0/148987391 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v35) v1 ==== 174+0+0 (secure 0 0 0) 0x7f10180c52f0 con 0x7f10180aa4d0 2023-08-17T17:50:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.961+0000 7f1020053700 1 -- 172.21.15.78:0/148987391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ffc05ed90 msgr2=0x7f0ffc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.961+0000 7f1020053700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ffc05ed90 0x7f0ffc061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1014001560 tx=0x7f1014000f40).stop 2023-08-17T17:50:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.961+0000 7f1020053700 1 -- 172.21.15.78:0/148987391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10180aa4d0 msgr2=0x7f1018145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.961+0000 7f1020053700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10180aa4d0 0x7f1018145b70 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f100800c450 tx=0x7f1008007c60).stop 2023-08-17T17:50:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.961+0000 7f1020053700 1 -- 172.21.15.78:0/148987391 shutdown_connections 2023-08-17T17:50:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.961+0000 7f1020053700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ffc05ed90 0x7f0ffc061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.961+0000 7f1020053700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10180c5f20 0x7f1018150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.961+0000 7f1020053700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10180aa0f0 0x7f10180ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.961+0000 7f1020053700 1 --2- 172.21.15.78:0/148987391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10180aa4d0 0x7f1018145b70 secure :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0x7f100800c450 tx=0x7f1008007c60).stop 2023-08-17T17:50:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.961+0000 7f1020053700 1 -- 172.21.15.78:0/148987391 >> 172.21.15.78:0/148987391 conn(0x7f101806a6a0 msgr2=0x7f1018151c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:26.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.963+0000 7f1020053700 1 -- 172.21.15.78:0/148987391 shutdown_connections 2023-08-17T17:50:26.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:26.964+0000 7f1020053700 1 -- 172.21.15.78:0/148987391 wait complete. 2023-08-17T17:50:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 13 and data pool 14 2023-08-17T17:50:26.982 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:50:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.095+0000 7feccd98f700 1 Processor -- start 2023-08-17T17:50:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.095+0000 7feccd98f700 1 -- start start 2023-08-17T17:50:27.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccd98f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fecc8157be0 0x7fecc80c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccd98f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fecc8157fc0 0x7fecc80699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccd98f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecc8139fd0 0x7fecc813a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccd98f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc81583e0 con 0x7fecc8157be0 2023-08-17T17:50:27.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccd98f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc80bc900 con 0x7fecc8157fc0 2023-08-17T17:50:27.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccd98f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc813a950 con 0x7fecc8139fd0 2023-08-17T17:50:27.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccc98d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fecc8157be0 0x7fecc80c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccc98d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fecc8157be0 0x7fecc80c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33948/0 (socket says 172.21.15.78:33948) 2023-08-17T17:50:27.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccc98d700 1 -- 172.21.15.78:0/3388132411 learned_addr learned my addr 172.21.15.78:0/3388132411 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:27.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7fecc7fff700 1 --2- 172.21.15.78:0/3388132411 >> v2:172.21.15.150:3300/0 conn(0x7fecc8157fc0 0x7fecc80699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccd18e700 1 --2- 172.21.15.78:0/3388132411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecc8139fd0 0x7fecc813a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccc98d700 1 -- 172.21.15.78:0/3388132411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecc8139fd0 msgr2=0x7fecc813a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:27.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccc98d700 1 --2- 172.21.15.78:0/3388132411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecc8139fd0 0x7fecc813a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccc98d700 1 -- 172.21.15.78:0/3388132411 >> v2:172.21.15.150:3300/0 conn(0x7fecc8157fc0 msgr2=0x7fecc80699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccc98d700 1 --2- 172.21.15.78:0/3388132411 >> v2:172.21.15.150:3300/0 conn(0x7fecc8157fc0 0x7fecc80699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccc98d700 1 -- 172.21.15.78:0/3388132411 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc80c55a0 con 0x7fecc8157be0 2023-08-17T17:50:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.096+0000 7feccc98d700 1 --2- 172.21.15.78:0/3388132411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8157be0 0x7fecc80c7430 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fecc806c170 tx=0x7fecbc0090f0).ready entity=mon.0 client_cookie=8e902112769864a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7fecc77fe700 1 -- 172.21.15.78:0/3388132411 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00f510 con 0x7fecc8157be0 2023-08-17T17:50:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7fecc77fe700 1 -- 172.21.15.78:0/3388132411 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc00f670 con 0x7fecc8157be0 2023-08-17T17:50:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7fecc77fe700 1 -- 172.21.15.78:0/3388132411 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00fa10 con 0x7fecc8157be0 2023-08-17T17:50:27.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7feccd98f700 1 -- 172.21.15.78:0/3388132411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8157be0 msgr2=0x7fecc80c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7feccd98f700 1 --2- 172.21.15.78:0/3388132411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8157be0 0x7fecc80c7430 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fecc806c170 tx=0x7fecbc0090f0).stop 2023-08-17T17:50:27.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7feccd98f700 1 -- 172.21.15.78:0/3388132411 shutdown_connections 2023-08-17T17:50:27.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7feccd98f700 1 --2- 172.21.15.78:0/3388132411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8157be0 0x7fecc80c7430 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7feccd98f700 1 --2- 172.21.15.78:0/3388132411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecc8139fd0 0x7fecc813a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7feccd98f700 1 --2- 172.21.15.78:0/3388132411 >> v2:172.21.15.150:3300/0 conn(0x7fecc8157fc0 0x7fecc80699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7feccd98f700 1 -- 172.21.15.78:0/3388132411 >> 172.21.15.78:0/3388132411 conn(0x7fecc80c4440 msgr2=0x7fecc80c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:27.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7feccd98f700 1 -- 172.21.15.78:0/3388132411 shutdown_connections 2023-08-17T17:50:27.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.097+0000 7feccd98f700 1 -- 172.21.15.78:0/3388132411 wait complete. 2023-08-17T17:50:27.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.098+0000 7feccd98f700 1 Processor -- start 2023-08-17T17:50:27.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.098+0000 7feccd98f700 1 -- start start 2023-08-17T17:50:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7feccd98f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8139fd0 0x7fecc80aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7feccd98f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecc8157be0 0x7fecc80c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7feccd98f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecc8157fc0 0x7fecc8167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7feccd98f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80c0110 con 0x7fecc8139fd0 2023-08-17T17:50:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7feccd98f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc8168770 con 0x7fecc8157be0 2023-08-17T17:50:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7feccd98f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80c1890 con 0x7fecc8157fc0 2023-08-17T17:50:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7feccc98d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8139fd0 0x7fecc80aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7feccc98d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8139fd0 0x7fecc80aa950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33962/0 (socket says 172.21.15.78:33962) 2023-08-17T17:50:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7feccc98d700 1 -- 172.21.15.78:0/3214861452 learned_addr learned my addr 172.21.15.78:0/3214861452 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7feccd18e700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecc8157fc0 0x7fecc8167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.099+0000 7fecc7fff700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecc8157be0 0x7fecc80c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7feccc98d700 1 -- 172.21.15.78:0/3214861452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecc8157fc0 msgr2=0x7fecc8167930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7feccc98d700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecc8157fc0 0x7fecc8167930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7feccc98d700 1 -- 172.21.15.78:0/3214861452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecc8157be0 msgr2=0x7fecc80c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7feccc98d700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecc8157be0 0x7fecc80c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7feccc98d700 1 -- 172.21.15.78:0/3214861452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc009370 con 0x7fecc8139fd0 2023-08-17T17:50:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7feccc98d700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8139fd0 0x7fecc80aa950 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fecbc011fc0 tx=0x7fecbc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7fecc4ff9700 1 -- 172.21.15.78:0/3214861452 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00fea0 con 0x7fecc8139fd0 2023-08-17T17:50:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7fecc4ff9700 1 -- 172.21.15.78:0/3214861452 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc00f7e0 con 0x7fecc8139fd0 2023-08-17T17:50:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7fecc4ff9700 1 -- 172.21.15.78:0/3214861452 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc024470 con 0x7fecc8139fd0 2023-08-17T17:50:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7feccd98f700 1 -- 172.21.15.78:0/3214861452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc80c15b0 con 0x7fecc8139fd0 2023-08-17T17:50:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.100+0000 7feccd98f700 1 -- 172.21.15.78:0/3214861452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc80bfda0 con 0x7fecc8139fd0 2023-08-17T17:50:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.101+0000 7feccd98f700 1 -- 172.21.15.78:0/3214861452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc80c03f0 con 0x7fecc8139fd0 2023-08-17T17:50:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.101+0000 7fecc4ff9700 1 -- 172.21.15.78:0/3214861452 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fecbc00f070 con 0x7fecc8139fd0 2023-08-17T17:50:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.101+0000 7fecc4ff9700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecac05ed90 0x7fecac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.102+0000 7fecc4ff9700 1 -- 172.21.15.78:0/3214861452 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fecbc07b680 con 0x7fecc8139fd0 2023-08-17T17:50:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.102+0000 7fecc7fff700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecac05ed90 0x7fecac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.102+0000 7fecc7fff700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecac05ed90 0x7fecac061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fecc80aa6a0 tx=0x7fecb4008040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.106+0000 7fecc4ff9700 1 -- 172.21.15.78:0/3214861452 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fecbc04cc20 con 0x7fecc8139fd0 2023-08-17T17:50:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.267+0000 7feccd98f700 1 -- 172.21.15.78:0/3214861452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecc80c5880 con 0x7fecc8139fd0 2023-08-17T17:50:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.268+0000 7fecc4ff9700 1 -- 172.21.15.78:0/3214861452 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+17003 (secure 0 0 0) 0x7fecbc029020 con 0x7fecc8139fd0 2023-08-17T17:50:27.269 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:27.269 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":104,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:50:26.944591+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:50:25.474971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T17:50:25.916399+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:50:27.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.270+0000 7feccd98f700 1 -- 172.21.15.78:0/3214861452 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecac05ed90 msgr2=0x7fecac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.270+0000 7feccd98f700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecac05ed90 0x7fecac061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fecc80aa6a0 tx=0x7fecb4008040).stop 2023-08-17T17:50:27.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.270+0000 7feccd98f700 1 -- 172.21.15.78:0/3214861452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8139fd0 msgr2=0x7fecc80aa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.270+0000 7feccd98f700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8139fd0 0x7fecc80aa950 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fecbc011fc0 tx=0x7fecbc017000).stop 2023-08-17T17:50:27.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.270+0000 7feccd98f700 1 -- 172.21.15.78:0/3214861452 shutdown_connections 2023-08-17T17:50:27.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.270+0000 7feccd98f700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecac05ed90 0x7fecac061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.270+0000 7feccd98f700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecc8157fc0 0x7fecc8167930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.270+0000 7feccd98f700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecc8139fd0 0x7fecc80aa950 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.270+0000 7feccd98f700 1 --2- 172.21.15.78:0/3214861452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecc8157be0 0x7fecc80c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.270+0000 7feccd98f700 1 -- 172.21.15.78:0/3214861452 >> 172.21.15.78:0/3214861452 conn(0x7fecc80c4440 msgr2=0x7fecc80a63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.271+0000 7feccd98f700 1 -- 172.21.15.78:0/3214861452 shutdown_connections 2023-08-17T17:50:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.271+0000 7feccd98f700 1 -- 172.21.15.78:0/3214861452 wait complete. 2023-08-17T17:50:27.283 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:50:27.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.395+0000 7f4e42aad700 1 Processor -- start 2023-08-17T17:50:27.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.395+0000 7f4e42aad700 1 -- start start 2023-08-17T17:50:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e42aad700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e3c154140 0x7f4e3c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e42aad700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e3c0a7c40 0x7f4e3c0c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e42aad700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c154520 con 0x7f4e3c0a8080 2023-08-17T17:50:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e42aad700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c0c91e0 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e42aad700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0c94c0 con 0x7f4e3c154140 2023-08-17T17:50:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e33fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e3c0a7c40 0x7f4e3c0c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e33fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e3c0a7c40 0x7f4e3c0c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33968/0 (socket says 172.21.15.78:33968) 2023-08-17T17:50:27.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e33fff700 1 -- 172.21.15.78:0/587155449 learned_addr learned my addr 172.21.15.78:0/587155449 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:27.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e4104a700 1 --1- 172.21.15.78:0/587155449 >> v1:172.21.15.78:6789/0 conn(0x7f4e3c0a8080 0x7f4e3c0ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57776/0 (socket says 172.21.15.78:57776) 2023-08-17T17:50:27.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e40849700 1 --2- 172.21.15.78:0/587155449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e3c154140 0x7f4e3c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e33fff700 1 -- 172.21.15.78:0/587155449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e3c154140 msgr2=0x7f4e3c0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:27.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e33fff700 1 --2- 172.21.15.78:0/587155449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e3c154140 0x7f4e3c0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e33fff700 1 -- 172.21.15.78:0/587155449 >> v1:172.21.15.78:6789/0 conn(0x7f4e3c0a8080 legacy=0x7f4e3c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e33fff700 1 -- 172.21.15.78:0/587155449 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0c97a0 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.396+0000 7f4e337fe700 1 -- 172.21.15.78:0/587155449 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036965320 0 0) 0x7f4e3c154520 con 0x7f4e3c0a8080 2023-08-17T17:50:27.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e33fff700 1 --2- 172.21.15.78:0/587155449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 0x7f4e3c0c0900 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f4e2c006fd0 tx=0x7f4e2c0090f0).ready entity=mon.0 client_cookie=553191d37df4bf9f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:27.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e337fe700 1 -- 172.21.15.78:0/587155449 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00b580 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e337fe700 1 -- 172.21.15.78:0/587155449 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c00b6e0 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e337fe700 1 -- 172.21.15.78:0/587155449 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00ba60 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e42aad700 1 -- 172.21.15.78:0/587155449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 msgr2=0x7f4e3c0c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e42aad700 1 --2- 172.21.15.78:0/587155449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 0x7f4e3c0c0900 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f4e2c006fd0 tx=0x7f4e2c0090f0).stop 2023-08-17T17:50:27.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e42aad700 1 -- 172.21.15.78:0/587155449 shutdown_connections 2023-08-17T17:50:27.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e42aad700 1 --2- 172.21.15.78:0/587155449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e3c154140 0x7f4e3c0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e42aad700 1 --2- 172.21.15.78:0/587155449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 0x7f4e3c0c0900 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e42aad700 1 -- 172.21.15.78:0/587155449 >> 172.21.15.78:0/587155449 conn(0x7f4e3c094510 msgr2=0x7f4e3c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e42aad700 1 -- 172.21.15.78:0/587155449 shutdown_connections 2023-08-17T17:50:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.397+0000 7f4e42aad700 1 -- 172.21.15.78:0/587155449 wait complete. 2023-08-17T17:50:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.398+0000 7f4e42aad700 1 Processor -- start 2023-08-17T17:50:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.398+0000 7f4e42aad700 1 -- start start 2023-08-17T17:50:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e42aad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 0x7f4e3c14cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e42aad700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e3c0a8080 0x7f4e3c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e42aad700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e3c154140 0x7f4e3c0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e42aad700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0ac780 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e42aad700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0aca60 con 0x7f4e3c0a8080 2023-08-17T17:50:27.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e42aad700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0acd40 con 0x7f4e3c154140 2023-08-17T17:50:27.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e40849700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 0x7f4e3c14cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e40849700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 0x7f4e3c14cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33972/0 (socket says 172.21.15.78:33972) 2023-08-17T17:50:27.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e40849700 1 -- 172.21.15.78:0/2225846390 learned_addr learned my addr 172.21.15.78:0/2225846390 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:27.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e33fff700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e3c0a8080 0x7f4e3c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.399+0000 7f4e4104a700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e3c154140 0x7f4e3c0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e40849700 1 -- 172.21.15.78:0/2225846390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e3c154140 msgr2=0x7f4e3c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e40849700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e3c154140 0x7f4e3c0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e40849700 1 -- 172.21.15.78:0/2225846390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e3c0a8080 msgr2=0x7f4e3c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e40849700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e3c0a8080 0x7f4e3c0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e40849700 1 -- 172.21.15.78:0/2225846390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c009370 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e33fff700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e3c0a8080 0x7f4e3c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:27.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e40849700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 0x7f4e3c14cc30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f4e38009e70 tx=0x7f4e3800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:27.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e30ff9700 1 -- 172.21.15.78:0/2225846390 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800cbd0 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e30ff9700 1 -- 172.21.15.78:0/2225846390 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3800f040 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e42aad700 1 -- 172.21.15.78:0/2225846390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c0ad020 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e30ff9700 1 -- 172.21.15.78:0/2225846390 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38013400 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.400+0000 7f4e42aad700 1 -- 172.21.15.78:0/2225846390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c14d120 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.401+0000 7f4e42aad700 1 -- 172.21.15.78:0/2225846390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c0842f0 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.401+0000 7f4e30ff9700 1 -- 172.21.15.78:0/2225846390 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4e380137b0 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.401+0000 7f4e30ff9700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e2805ed60 0x7f4e28061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.401+0000 7f4e30ff9700 1 -- 172.21.15.78:0/2225846390 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4e3807a5c0 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.402+0000 7f4e33fff700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e2805ed60 0x7f4e28061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.402+0000 7f4e33fff700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e2805ed60 0x7f4e28061220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4e2c006fd0 tx=0x7f4e2c017000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:27.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.406+0000 7f4e30ff9700 1 -- 172.21.15.78:0/2225846390 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e3804bb60 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.570+0000 7f4e42aad700 1 -- 172.21.15.78:0/2225846390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e3c047350 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.571+0000 7f4e30ff9700 1 -- 172.21.15.78:0/2225846390 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+17003 (secure 0 0 0) 0x7f4e3804f180 con 0x7f4e3c0a7c40 2023-08-17T17:50:27.571 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:27.572 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":104,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:50:26.944591+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:50:25.474971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T17:50:25.916399+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:50:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.572+0000 7f4e42aad700 1 -- 172.21.15.78:0/2225846390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e2805ed60 msgr2=0x7f4e28061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.572+0000 7f4e42aad700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e2805ed60 0x7f4e28061220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4e2c006fd0 tx=0x7f4e2c017000).stop 2023-08-17T17:50:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.572+0000 7f4e42aad700 1 -- 172.21.15.78:0/2225846390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 msgr2=0x7f4e3c14cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.572+0000 7f4e42aad700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 0x7f4e3c14cc30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f4e38009e70 tx=0x7f4e3800b040).stop 2023-08-17T17:50:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.573+0000 7f4e42aad700 1 -- 172.21.15.78:0/2225846390 shutdown_connections 2023-08-17T17:50:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.573+0000 7f4e42aad700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e2805ed60 0x7f4e28061220 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.573+0000 7f4e42aad700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e3c154140 0x7f4e3c0ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.573+0000 7f4e42aad700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e3c0a7c40 0x7f4e3c14cc30 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.573+0000 7f4e42aad700 1 --2- 172.21.15.78:0/2225846390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e3c0a8080 0x7f4e3c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.573+0000 7f4e42aad700 1 -- 172.21.15.78:0/2225846390 >> 172.21.15.78:0/2225846390 conn(0x7f4e3c094510 msgr2=0x7f4e3c14ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.573+0000 7f4e42aad700 1 -- 172.21.15.78:0/2225846390 shutdown_connections 2023-08-17T17:50:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.573+0000 7f4e42aad700 1 -- 172.21.15.78:0/2225846390 wait complete. 2023-08-17T17:50:27.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T17:50:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.701+0000 7f2c2e1a9700 1 Processor -- start 2023-08-17T17:50:27.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.701+0000 7f2c2e1a9700 1 -- start start 2023-08-17T17:50:27.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.702+0000 7f2c2e1a9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c280c5f20 0x7f2c280644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.702+0000 7f2c2e1a9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c280649b0 con 0x7f2c280aa4d0 2023-08-17T17:50:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.702+0000 7f2c2e1a9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c28063420 con 0x7f2c280aa0f0 2023-08-17T17:50:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.702+0000 7f2c2e1a9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c28063700 con 0x7f2c280c5f20 2023-08-17T17:50:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.702+0000 7f2c27fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c280c5f20 0x7f2c280644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.702+0000 7f2c26ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2c280aa4d0 0x7f2c280c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57782/0 (socket says 172.21.15.78:57782) 2023-08-17T17:50:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.702+0000 7f2c27fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c280c5f20 0x7f2c280644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33984/0 (socket says 172.21.15.78:33984) 2023-08-17T17:50:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.702+0000 7f2c26ffd700 1 -- 172.21.15.78:0/4147260848 learned_addr learned my addr 172.21.15.78:0/4147260848 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:27.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c27fff700 1 -- 172.21.15.78:0/4147260848 >> v1:172.21.15.150:6789/0 conn(0x7f2c280aa0f0 legacy=0x7f2c280c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c27fff700 1 -- 172.21.15.78:0/4147260848 >> v1:172.21.15.78:6789/0 conn(0x7f2c280aa4d0 legacy=0x7f2c280c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c267fc700 1 -- 172.21.15.78:0/4147260848 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229346868 0 0) 0x7f2c280649b0 con 0x7f2c280aa4d0 2023-08-17T17:50:27.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c27fff700 1 -- 172.21.15.78:0/4147260848 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280639e0 con 0x7f2c280c5f20 2023-08-17T17:50:27.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c27fff700 1 --2- 172.21.15.78:0/4147260848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 0x7f2c280644c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f2c20009760 tx=0x7f2c20009060).ready entity=mon.0 client_cookie=3abdd0961c9c0e8f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:27.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c267fc700 1 -- 172.21.15.78:0/4147260848 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000b580 con 0x7f2c280c5f20 2023-08-17T17:50:27.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c267fc700 1 -- 172.21.15.78:0/4147260848 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000b6e0 con 0x7f2c280c5f20 2023-08-17T17:50:27.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c267fc700 1 -- 172.21.15.78:0/4147260848 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000ba60 con 0x7f2c280c5f20 2023-08-17T17:50:27.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/4147260848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 msgr2=0x7f2c280644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c2e1a9700 1 --2- 172.21.15.78:0/4147260848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 0x7f2c280644c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f2c20009760 tx=0x7f2c20009060).stop 2023-08-17T17:50:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/4147260848 shutdown_connections 2023-08-17T17:50:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c2e1a9700 1 --2- 172.21.15.78:0/4147260848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 0x7f2c280644c0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/4147260848 >> 172.21.15.78:0/4147260848 conn(0x7f2c2806a6a0 msgr2=0x7f2c280caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/4147260848 shutdown_connections 2023-08-17T17:50:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.703+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/4147260848 wait complete. 2023-08-17T17:50:27.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c2e1a9700 1 Processor -- start 2023-08-17T17:50:27.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c2e1a9700 1 -- start start 2023-08-17T17:50:27.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c2e1a9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280aa0f0 0x7f2c28142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c2e1a9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280aa4d0 0x7f2c28157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c2e1a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 0x7f2c280ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c2e1a9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280aee20 con 0x7f2c280c5f20 2023-08-17T17:50:27.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c2e1a9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280ac310 con 0x7f2c280aa4d0 2023-08-17T17:50:27.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c2e1a9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280ae860 con 0x7f2c280aa0f0 2023-08-17T17:50:27.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c27fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 0x7f2c280ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c27fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 0x7f2c280ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34000/0 (socket says 172.21.15.78:34000) 2023-08-17T17:50:27.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.705+0000 7f2c27fff700 1 -- 172.21.15.78:0/2079254196 learned_addr learned my addr 172.21.15.78:0/2079254196 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:27.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c26ffd700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280aa4d0 0x7f2c28157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c277fe700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280aa0f0 0x7f2c28142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c27fff700 1 -- 172.21.15.78:0/2079254196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280aa0f0 msgr2=0x7f2c28142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c27fff700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280aa0f0 0x7f2c28142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c27fff700 1 -- 172.21.15.78:0/2079254196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280aa4d0 msgr2=0x7f2c28157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c27fff700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280aa4d0 0x7f2c28157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c27fff700 1 -- 172.21.15.78:0/2079254196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c200092a0 con 0x7f2c280c5f20 2023-08-17T17:50:27.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c277fe700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280aa0f0 0x7f2c28142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:27.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c27fff700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 0x7f2c280ade80 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f2c20009eb0 tx=0x7f2c20017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:27.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c0f7fe700 1 -- 172.21.15.78:0/2079254196 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000ba60 con 0x7f2c280c5f20 2023-08-17T17:50:27.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c0f7fe700 1 -- 172.21.15.78:0/2079254196 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2001b440 con 0x7f2c280c5f20 2023-08-17T17:50:27.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/2079254196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c280aeb40 con 0x7f2c280c5f20 2023-08-17T17:50:27.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c0f7fe700 1 -- 172.21.15.78:0/2079254196 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2001b7c0 con 0x7f2c280c5f20 2023-08-17T17:50:27.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.706+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/2079254196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c280ac820 con 0x7f2c280c5f20 2023-08-17T17:50:27.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.707+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/2079254196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c28083980 con 0x7f2c280c5f20 2023-08-17T17:50:27.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.707+0000 7f2c0f7fe700 1 -- 172.21.15.78:0/2079254196 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2c2002a070 con 0x7f2c280c5f20 2023-08-17T17:50:27.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.708+0000 7f2c0f7fe700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c1405ed90 0x7f2c14061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:27.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.708+0000 7f2c0f7fe700 1 -- 172.21.15.78:0/2079254196 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2c2007b4c0 con 0x7f2c280c5f20 2023-08-17T17:50:27.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.708+0000 7f2c277fe700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c1405ed90 0x7f2c14061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:27.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.708+0000 7f2c277fe700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c1405ed90 0x7f2c14061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2c18007fd0 tx=0x7f2c18009040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:27.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.712+0000 7f2c0f7fe700 1 -- 172.21.15.78:0/2079254196 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c2004ca00 con 0x7f2c280c5f20 2023-08-17T17:50:27.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.917+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/2079254196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2c280cbd40 con 0x7f2c280c5f20 2023-08-17T17:50:27.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.951+0000 7f2c0f7fe700 1 -- 172.21.15.78:0/2079254196 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2c200280b0 con 0x7f2c280c5f20 2023-08-17T17:50:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/2079254196 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c1405ed90 msgr2=0x7f2c14061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c1405ed90 0x7f2c14061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2c18007fd0 tx=0x7f2c18009040).stop 2023-08-17T17:50:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/2079254196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 msgr2=0x7f2c280ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 0x7f2c280ade80 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f2c20009eb0 tx=0x7f2c20017000).stop 2023-08-17T17:50:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/2079254196 shutdown_connections 2023-08-17T17:50:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c1405ed90 0x7f2c14061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c280c5f20 0x7f2c280ade80 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280aa0f0 0x7f2c28142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 --2- 172.21.15.78:0/2079254196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280aa4d0 0x7f2c28157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/2079254196 >> 172.21.15.78:0/2079254196 conn(0x7f2c2806a6a0 msgr2=0x7f2c280c78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/2079254196 shutdown_connections 2023-08-17T17:50:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:27.953+0000 7f2c2e1a9700 1 -- 172.21.15.78:0/2079254196 wait complete. 2023-08-17T17:50:27.966 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T17:50:27.967 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T17:50:28.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.082+0000 7fe5e759e700 1 Processor -- start 2023-08-17T17:50:28.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.082+0000 7fe5e759e700 1 -- start start 2023-08-17T17:50:28.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.083+0000 7fe5e759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5e8151a40 0x7fe5e80c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:28.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.083+0000 7fe5e759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5e8151e20 0x7fe5e80c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:28.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.083+0000 7fe5e759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e80c6620 con 0x7fe5e8157be0 2023-08-17T17:50:28.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.083+0000 7fe5e759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e80c6900 con 0x7fe5e8151a40 2023-08-17T17:50:28.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.083+0000 7fe5e759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e80c6be0 con 0x7fe5e8151e20 2023-08-17T17:50:28.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.083+0000 7fe5e659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5e8151a40 0x7fe5e80c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:28.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5e8151a40 0x7fe5e80c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34016/0 (socket says 172.21.15.78:34016) 2023-08-17T17:50:28.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e659c700 1 -- 172.21.15.78:0/980714921 learned_addr learned my addr 172.21.15.78:0/980714921 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:28.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5ddd9b700 1 --2- 172.21.15.78:0/980714921 >> v2:172.21.15.150:3300/0 conn(0x7fe5e8151e20 0x7fe5e80c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:28.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e659c700 1 -- 172.21.15.78:0/980714921 >> v2:172.21.15.150:3300/0 conn(0x7fe5e8151e20 msgr2=0x7fe5e80c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:28.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e659c700 1 --2- 172.21.15.78:0/980714921 >> v2:172.21.15.150:3300/0 conn(0x7fe5e8151e20 0x7fe5e80c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:28.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e659c700 1 -- 172.21.15.78:0/980714921 >> v1:172.21.15.150:6789/0 conn(0x7fe5e8157be0 legacy=0x7fe5e8154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:28.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e659c700 1 -- 172.21.15.78:0/980714921 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e80c6ec0 con 0x7fe5e8151a40 2023-08-17T17:50:28.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e659c700 1 --2- 172.21.15.78:0/980714921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151a40 0x7fe5e80c8260 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7fe5e8065360 tx=0x7fe5d8009060).ready entity=mon.0 client_cookie=fd290bd1aeedb685 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:28.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e5d9b700 1 -- 172.21.15.78:0/980714921 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8005880 con 0x7fe5e8151a40 2023-08-17T17:50:28.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e5d9b700 1 -- 172.21.15.78:0/980714921 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d80059e0 con 0x7fe5e8151a40 2023-08-17T17:50:28.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e5d9b700 1 -- 172.21.15.78:0/980714921 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8005d60 con 0x7fe5e8151a40 2023-08-17T17:50:28.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e759e700 1 -- 172.21.15.78:0/980714921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151a40 msgr2=0x7fe5e80c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:28.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.084+0000 7fe5e759e700 1 --2- 172.21.15.78:0/980714921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151a40 0x7fe5e80c8260 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7fe5e8065360 tx=0x7fe5d8009060).stop 2023-08-17T17:50:28.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.085+0000 7fe5e759e700 1 -- 172.21.15.78:0/980714921 shutdown_connections 2023-08-17T17:50:28.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.085+0000 7fe5e759e700 1 --2- 172.21.15.78:0/980714921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151a40 0x7fe5e80c8260 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:28.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.085+0000 7fe5e759e700 1 --2- 172.21.15.78:0/980714921 >> v2:172.21.15.150:3300/0 conn(0x7fe5e8151e20 0x7fe5e80c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:28.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.085+0000 7fe5e759e700 1 -- 172.21.15.78:0/980714921 >> 172.21.15.78:0/980714921 conn(0x7fe5e80943b0 msgr2=0x7fe5e806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:28.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.085+0000 7fe5e759e700 1 -- 172.21.15.78:0/980714921 shutdown_connections 2023-08-17T17:50:28.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.085+0000 7fe5e759e700 1 -- 172.21.15.78:0/980714921 wait complete. 2023-08-17T17:50:28.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.086+0000 7fe5e759e700 1 Processor -- start 2023-08-17T17:50:28.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.086+0000 7fe5e759e700 1 -- start start 2023-08-17T17:50:28.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5e759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5e8151a40 0x7fe5e80c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:28.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5e759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151e20 0x7fe5e80c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:28.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5e759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5e8157be0 0x7fe5e80bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:28.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5e759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8168bc0 con 0x7fe5e8151e20 2023-08-17T17:50:28.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5e759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8168040 con 0x7fe5e8151a40 2023-08-17T17:50:28.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5e759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8168320 con 0x7fe5e8157be0 2023-08-17T17:50:28.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5ddd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151e20 0x7fe5e80c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:28.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5ddd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151e20 0x7fe5e80c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34022/0 (socket says 172.21.15.78:34022) 2023-08-17T17:50:28.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5ddd9b700 1 -- 172.21.15.78:0/2329008965 learned_addr learned my addr 172.21.15.78:0/2329008965 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:28.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5e659c700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5e8151a40 0x7fe5e80c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:28.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5e6d9d700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5e8157be0 0x7fe5e80bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:28.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5ddd9b700 1 -- 172.21.15.78:0/2329008965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5e8157be0 msgr2=0x7fe5e80bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:28.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5ddd9b700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5e8157be0 0x7fe5e80bfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:28.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5ddd9b700 1 -- 172.21.15.78:0/2329008965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5e8151a40 msgr2=0x7fe5e80c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:28.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5ddd9b700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5e8151a40 0x7fe5e80c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:28.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5ddd9b700 1 -- 172.21.15.78:0/2329008965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d8009300 con 0x7fe5e8151e20 2023-08-17T17:50:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5ddd9b700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151e20 0x7fe5e80c4520 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fe5d000d860 tx=0x7fe5d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5deffd700 1 -- 172.21.15.78:0/2329008965 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0011590 con 0x7fe5e8151e20 2023-08-17T17:50:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5deffd700 1 -- 172.21.15.78:0/2329008965 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d00116f0 con 0x7fe5e8151e20 2023-08-17T17:50:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5e759e700 1 -- 172.21.15.78:0/2329008965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e8168600 con 0x7fe5e8151e20 2023-08-17T17:50:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5deffd700 1 -- 172.21.15.78:0/2329008965 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0011a70 con 0x7fe5e8151e20 2023-08-17T17:50:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.087+0000 7fe5e759e700 1 -- 172.21.15.78:0/2329008965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e8167c60 con 0x7fe5e8151e20 2023-08-17T17:50:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.088+0000 7fe5e759e700 1 -- 172.21.15.78:0/2329008965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e80ab480 con 0x7fe5e8151e20 2023-08-17T17:50:28.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.089+0000 7fe5deffd700 1 -- 172.21.15.78:0/2329008965 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe5d001c460 con 0x7fe5e8151e20 2023-08-17T17:50:28.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.089+0000 7fe5deffd700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5c805ed90 0x7fe5c8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:28.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.089+0000 7fe5deffd700 1 -- 172.21.15.78:0/2329008965 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe5d0079c40 con 0x7fe5e8151e20 2023-08-17T17:50:28.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.089+0000 7fe5e659c700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5c805ed90 0x7fe5c8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:28.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.089+0000 7fe5e659c700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5c805ed90 0x7fe5c8061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe5d800b360 tx=0x7fe5d8016000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:28.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.093+0000 7fe5deffd700 1 -- 172.21.15.78:0/2329008965 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe5e80ab480 con 0x7fe5e8151e20 2023-08-17T17:50:28.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.298+0000 7fe5e759e700 1 -- 172.21.15.78:0/2329008965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe5e80ab480 con 0x7fe5e8151e20 2023-08-17T17:50:28.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.960+0000 7fe5deffd700 1 -- 172.21.15.78:0/2329008965 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe5e80ab480 con 0x7fe5e8151e20 2023-08-17T17:50:28.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 -- 172.21.15.78:0/2329008965 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5c805ed90 msgr2=0x7fe5c8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:28.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5c805ed90 0x7fe5c8061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe5d800b360 tx=0x7fe5d8016000).stop 2023-08-17T17:50:28.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 -- 172.21.15.78:0/2329008965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151e20 msgr2=0x7fe5e80c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:28.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151e20 0x7fe5e80c4520 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fe5d000d860 tx=0x7fe5d0008040).stop 2023-08-17T17:50:28.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 -- 172.21.15.78:0/2329008965 shutdown_connections 2023-08-17T17:50:28.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5c805ed90 0x7fe5c8061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:28.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5e8157be0 0x7fe5e80bfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:28.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5e8151a40 0x7fe5e80c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:28.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 --2- 172.21.15.78:0/2329008965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5e8151e20 0x7fe5e80c4520 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:28.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 -- 172.21.15.78:0/2329008965 >> 172.21.15.78:0/2329008965 conn(0x7fe5e80943b0 msgr2=0x7fe5e80c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:28.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 -- 172.21.15.78:0/2329008965 shutdown_connections 2023-08-17T17:50:28.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:28.962+0000 7fe5e759e700 1 -- 172.21.15.78:0/2329008965 wait complete. 2023-08-17T17:50:28.975 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T17:50:28.976 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:50:29.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.089+0000 7f178e078700 1 Processor -- start 2023-08-17T17:50:29.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.089+0000 7f178e078700 1 -- start start 2023-08-17T17:50:29.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.090+0000 7f178e078700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 0x7f17880c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.090+0000 7f178e078700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17880a7c40 0x7f17880c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.090+0000 7f178e078700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1788154520 con 0x7f17880a8080 2023-08-17T17:50:29.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.090+0000 7f178e078700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17880c91e0 con 0x7f17880a7c40 2023-08-17T17:50:29.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.090+0000 7f178e078700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17880c94c0 con 0x7f1788154140 2023-08-17T17:50:29.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.090+0000 7f1786ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17880a7c40 0x7f17880c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.090+0000 7f1787fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f17880a8080 0x7f17880ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51452/0 (socket says 172.21.15.78:51452) 2023-08-17T17:50:29.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.090+0000 7f1787fff700 1 -- 172.21.15.78:0/2068226182 learned_addr learned my addr 172.21.15.78:0/2068226182 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.090+0000 7f17877fe700 1 --2- 172.21.15.78:0/2068226182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 0x7f17880c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f1786ffd700 1 -- 172.21.15.78:0/2068226182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 msgr2=0x7f17880c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f1786ffd700 1 --2- 172.21.15.78:0/2068226182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 0x7f17880c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f1786ffd700 1 -- 172.21.15.78:0/2068226182 >> v1:172.21.15.78:6789/0 conn(0x7f17880a8080 legacy=0x7f17880ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f17867fc700 1 -- 172.21.15.78:0/2068226182 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632705954 0 0) 0x7f1788154520 con 0x7f17880a8080 2023-08-17T17:50:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f1786ffd700 1 -- 172.21.15.78:0/2068226182 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17880c97a0 con 0x7f17880a7c40 2023-08-17T17:50:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f17877fe700 1 --2- 172.21.15.78:0/2068226182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 0x7f17880c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f1786ffd700 1 --2- 172.21.15.78:0/2068226182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a7c40 0x7f17880c0900 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f177c009760 tx=0x7f177c009060).ready entity=mon.0 client_cookie=83e0ec00b7cacc76 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f17867fc700 1 -- 172.21.15.78:0/2068226182 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00b580 con 0x7f17880a7c40 2023-08-17T17:50:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f17867fc700 1 -- 172.21.15.78:0/2068226182 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c00b6e0 con 0x7f17880a7c40 2023-08-17T17:50:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f17867fc700 1 -- 172.21.15.78:0/2068226182 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00ba60 con 0x7f17880a7c40 2023-08-17T17:50:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f178e078700 1 -- 172.21.15.78:0/2068226182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a7c40 msgr2=0x7f17880c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f178e078700 1 --2- 172.21.15.78:0/2068226182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a7c40 0x7f17880c0900 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f177c009760 tx=0x7f177c009060).stop 2023-08-17T17:50:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f178e078700 1 -- 172.21.15.78:0/2068226182 shutdown_connections 2023-08-17T17:50:29.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f178e078700 1 --2- 172.21.15.78:0/2068226182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 0x7f17880c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f178e078700 1 --2- 172.21.15.78:0/2068226182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a7c40 0x7f17880c0900 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f178e078700 1 -- 172.21.15.78:0/2068226182 >> 172.21.15.78:0/2068226182 conn(0x7f1788094510 msgr2=0x7f178806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:29.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f178e078700 1 -- 172.21.15.78:0/2068226182 shutdown_connections 2023-08-17T17:50:29.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.091+0000 7f178e078700 1 -- 172.21.15.78:0/2068226182 wait complete. 2023-08-17T17:50:29.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.093+0000 7f178e078700 1 Processor -- start 2023-08-17T17:50:29.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.093+0000 7f178e078700 1 -- start start 2023-08-17T17:50:29.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.093+0000 7f178e078700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17880a7c40 0x7f17880ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.093+0000 7f178e078700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a8080 0x7f178814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.093+0000 7f178e078700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 0x7f17880aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.093+0000 7f178e078700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17881503a0 con 0x7f17880a8080 2023-08-17T17:50:29.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.093+0000 7f178e078700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178814f790 con 0x7f17880a7c40 2023-08-17T17:50:29.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.093+0000 7f178e078700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178814fa70 con 0x7f1788154140 2023-08-17T17:50:29.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f1786ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a8080 0x7f178814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f1786ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a8080 0x7f178814e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37004/0 (socket says 172.21.15.78:37004) 2023-08-17T17:50:29.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f1786ffd700 1 -- 172.21.15.78:0/238591418 learned_addr learned my addr 172.21.15.78:0/238591418 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:29.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f1787fff700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 0x7f17880aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f17877fe700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17880a7c40 0x7f17880ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f1786ffd700 1 -- 172.21.15.78:0/238591418 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 msgr2=0x7f17880aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f1786ffd700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 0x7f17880aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f1786ffd700 1 -- 172.21.15.78:0/238591418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17880a7c40 msgr2=0x7f17880ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f1786ffd700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17880a7c40 0x7f17880ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f1786ffd700 1 -- 172.21.15.78:0/238591418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c0092a0 con 0x7f17880a8080 2023-08-17T17:50:29.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f1786ffd700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a8080 0x7f178814e8e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f178806c200 tx=0x7f177c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:29.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f176f7fe700 1 -- 172.21.15.78:0/238591418 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00b850 con 0x7f17880a8080 2023-08-17T17:50:29.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f176f7fe700 1 -- 172.21.15.78:0/238591418 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c00b9b0 con 0x7f17880a8080 2023-08-17T17:50:29.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f176f7fe700 1 -- 172.21.15.78:0/238591418 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c01b620 con 0x7f17880a8080 2023-08-17T17:50:29.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f178e078700 1 -- 172.21.15.78:0/238591418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178814fd50 con 0x7f17880a8080 2023-08-17T17:50:29.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.094+0000 7f178e078700 1 -- 172.21.15.78:0/238591418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17880acdf0 con 0x7f17880a8080 2023-08-17T17:50:29.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.095+0000 7f178e078700 1 -- 172.21.15.78:0/238591418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1788150510 con 0x7f17880a8080 2023-08-17T17:50:29.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.095+0000 7f176f7fe700 1 -- 172.21.15.78:0/238591418 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f177c021030 con 0x7f17880a8080 2023-08-17T17:50:29.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.096+0000 7f176f7fe700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f177405ed90 0x7f1774061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.096+0000 7f176f7fe700 1 -- 172.21.15.78:0/238591418 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f177c07b9b0 con 0x7f17880a8080 2023-08-17T17:50:29.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.096+0000 7f17877fe700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f177405ed90 0x7f1774061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.096+0000 7f17877fe700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f177405ed90 0x7f1774061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f177800a9d0 tx=0x7f1778008040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:29.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.100+0000 7f176f7fe700 1 -- 172.21.15.78:0/238591418 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f177c04cf30 con 0x7f17880a8080 2023-08-17T17:50:29.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.304+0000 7f178e078700 1 -- 172.21.15.78:0/238591418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1788047350 con 0x7f17880a8080 2023-08-17T17:50:29.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.304+0000 7f176f7fe700 1 -- 172.21.15.78:0/238591418 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f177c01f020 con 0x7f17880a8080 2023-08-17T17:50:29.305 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:29.305 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2389298534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2389298534},{"type":"v1","addr":"172.21.15.150:6833","nonce":2389298534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2314598053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2314598053},{"type":"v1","addr":"172.21.15.150:6835","nonce":2314598053}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/687308464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":687308464},{"type":"v1","addr":"172.21.15.78:6836","nonce":687308464}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:50:26.944921+0000","modified":"2023-08-17T17:50:28.955568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7170":{"gid":7170,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/886333866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":886333866},{"type":"v1","addr":"172.21.15.78:6837","nonce":886333866}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T17:50:29.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 -- 172.21.15.78:0/238591418 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f177405ed90 msgr2=0x7f1774061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f177405ed90 0x7f1774061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f177800a9d0 tx=0x7f1778008040).stop 2023-08-17T17:50:29.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 -- 172.21.15.78:0/238591418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a8080 msgr2=0x7f178814e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a8080 0x7f178814e8e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f178806c200 tx=0x7f177c017000).stop 2023-08-17T17:50:29.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 -- 172.21.15.78:0/238591418 shutdown_connections 2023-08-17T17:50:29.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f177405ed90 0x7f1774061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1788154140 0x7f17880aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17880a7c40 0x7f17880ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 --2- 172.21.15.78:0/238591418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17880a8080 0x7f178814e8e0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 -- 172.21.15.78:0/238591418 >> 172.21.15.78:0/238591418 conn(0x7f1788094510 msgr2=0x7f1788063e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:29.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 -- 172.21.15.78:0/238591418 shutdown_connections 2023-08-17T17:50:29.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.306+0000 7f178e078700 1 -- 172.21.15.78:0/238591418 wait complete. 2023-08-17T17:50:29.308 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 37 2023-08-17T17:50:29.318 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:50:29.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.431+0000 7f74592a3700 1 Processor -- start 2023-08-17T17:50:29.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.431+0000 7f74592a3700 1 -- start start 2023-08-17T17:50:29.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.431+0000 7f74592a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454154140 0x7f74540c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.431+0000 7f74592a3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74540a7c40 0x7f74540c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.431+0000 7f74592a3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7454154520 con 0x7f74540a8080 2023-08-17T17:50:29.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.431+0000 7f74592a3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74540c91e0 con 0x7f74540a7c40 2023-08-17T17:50:29.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.431+0000 7f74592a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74540c94c0 con 0x7f7454154140 2023-08-17T17:50:29.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f74537fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f74540a8080 0x7f74540ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51464/0 (socket says 172.21.15.78:51464) 2023-08-17T17:50:29.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f74537fe700 1 -- 172.21.15.78:0/2330951028 learned_addr learned my addr 172.21.15.78:0/2330951028 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:29.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f7452ffd700 1 --2- 172.21.15.78:0/2330951028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454154140 0x7f74540c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f744a7fc700 1 --2- 172.21.15.78:0/2330951028 >> v2:172.21.15.150:3300/0 conn(0x7f74540a7c40 0x7f74540c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f74527fc700 1 -- 172.21.15.78:0/2330951028 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375353120 0 0) 0x7f7454154520 con 0x7f74540a8080 2023-08-17T17:50:29.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f74527fc700 1 -- 172.21.15.78:0/2330951028 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74400033f0 con 0x7f74540a8080 2023-08-17T17:50:29.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f74527fc700 1 -- 172.21.15.78:0/2330951028 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1909470354 0 0) 0x7f74400033f0 con 0x7f74540a8080 2023-08-17T17:50:29.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f744a7fc700 1 -- 172.21.15.78:0/2330951028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454154140 msgr2=0x7f74540c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:29.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f744a7fc700 1 --2- 172.21.15.78:0/2330951028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454154140 0x7f74540c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f744a7fc700 1 -- 172.21.15.78:0/2330951028 >> v1:172.21.15.78:6789/0 conn(0x7f74540a8080 legacy=0x7f74540ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f744a7fc700 1 -- 172.21.15.78:0/2330951028 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74540c97a0 con 0x7f74540a7c40 2023-08-17T17:50:29.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f7452ffd700 1 --2- 172.21.15.78:0/2330951028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454154140 0x7f74540c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:50:29.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f744a7fc700 1 --2- 172.21.15.78:0/2330951028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74540a7c40 0x7f74540c0900 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f743c009760 tx=0x7f743c009060).ready entity=mon.1 client_cookie=d604acdf41d3c320 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:29.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f74527fc700 1 -- 172.21.15.78:0/2330951028 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0017f0 con 0x7f74540a7c40 2023-08-17T17:50:29.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f74527fc700 1 -- 172.21.15.78:0/2330951028 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c011400 con 0x7f74540a7c40 2023-08-17T17:50:29.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.432+0000 7f74527fc700 1 -- 172.21.15.78:0/2330951028 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c011780 con 0x7f74540a7c40 2023-08-17T17:50:29.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.433+0000 7f74592a3700 1 -- 172.21.15.78:0/2330951028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74540a7c40 msgr2=0x7f74540c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.433+0000 7f74592a3700 1 --2- 172.21.15.78:0/2330951028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74540a7c40 0x7f74540c0900 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f743c009760 tx=0x7f743c009060).stop 2023-08-17T17:50:29.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.433+0000 7f74592a3700 1 -- 172.21.15.78:0/2330951028 shutdown_connections 2023-08-17T17:50:29.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.433+0000 7f74592a3700 1 --2- 172.21.15.78:0/2330951028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454154140 0x7f74540c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.433+0000 7f74592a3700 1 --2- 172.21.15.78:0/2330951028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74540a7c40 0x7f74540c0900 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.433+0000 7f74592a3700 1 -- 172.21.15.78:0/2330951028 >> 172.21.15.78:0/2330951028 conn(0x7f7454094510 msgr2=0x7f745406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:29.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.433+0000 7f74592a3700 1 -- 172.21.15.78:0/2330951028 shutdown_connections 2023-08-17T17:50:29.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.433+0000 7f74592a3700 1 -- 172.21.15.78:0/2330951028 wait complete. 2023-08-17T17:50:29.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.434+0000 7f74592a3700 1 Processor -- start 2023-08-17T17:50:29.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.434+0000 7f74592a3700 1 -- start start 2023-08-17T17:50:29.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f74592a3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74540a7c40 0x7f74540ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f74592a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74540a8080 0x7f74540afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f74592a3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7454154140 0x7f745414ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f74592a3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74540c2660 con 0x7f74540a7c40 2023-08-17T17:50:29.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f74592a3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74540b0ca0 con 0x7f7454154140 2023-08-17T17:50:29.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f74592a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74540b06e0 con 0x7f74540a8080 2023-08-17T17:50:29.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f7452ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74540a7c40 0x7f74540ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f7452ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74540a7c40 0x7f74540ae9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37008/0 (socket says 172.21.15.78:37008) 2023-08-17T17:50:29.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f7452ffd700 1 -- 172.21.15.78:0/2097513207 learned_addr learned my addr 172.21.15.78:0/2097513207 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:29.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f744a7fc700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74540a8080 0x7f74540afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f74537fe700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7454154140 0x7f745414ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f7452ffd700 1 -- 172.21.15.78:0/2097513207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74540a8080 msgr2=0x7f74540afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f7452ffd700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74540a8080 0x7f74540afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f7452ffd700 1 -- 172.21.15.78:0/2097513207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7454154140 msgr2=0x7f745414ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f7452ffd700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7454154140 0x7f745414ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f7452ffd700 1 -- 172.21.15.78:0/2097513207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74440092a0 con 0x7f74540a7c40 2023-08-17T17:50:29.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.435+0000 7f74537fe700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7454154140 0x7f745414ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:29.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.436+0000 7f7452ffd700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74540a7c40 0x7f74540ae9f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f744400ea50 tx=0x7f7444009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:29.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.436+0000 7f744b7fe700 1 -- 172.21.15.78:0/2097513207 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744400c850 con 0x7f74540a7c40 2023-08-17T17:50:29.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.436+0000 7f744b7fe700 1 -- 172.21.15.78:0/2097513207 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744400c9b0 con 0x7f74540a7c40 2023-08-17T17:50:29.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.436+0000 7f74592a3700 1 -- 172.21.15.78:0/2097513207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c0092a0 con 0x7f74540a7c40 2023-08-17T17:50:29.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.436+0000 7f744b7fe700 1 -- 172.21.15.78:0/2097513207 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744400cd30 con 0x7f74540a7c40 2023-08-17T17:50:29.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.436+0000 7f74592a3700 1 -- 172.21.15.78:0/2097513207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74540c22f0 con 0x7f74540a7c40 2023-08-17T17:50:29.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.437+0000 7f74592a3700 1 -- 172.21.15.78:0/2097513207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74540c2940 con 0x7f74540a7c40 2023-08-17T17:50:29.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.437+0000 7f744b7fe700 1 -- 172.21.15.78:0/2097513207 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7444022070 con 0x7f74540a7c40 2023-08-17T17:50:29.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.437+0000 7f744b7fe700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f743405ed90 0x7f7434061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.438+0000 7f744b7fe700 1 -- 172.21.15.78:0/2097513207 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f744407a180 con 0x7f74540a7c40 2023-08-17T17:50:29.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.438+0000 7f744a7fc700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f743405ed90 0x7f7434061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.438+0000 7f744a7fc700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f743405ed90 0x7f7434061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f743c009760 tx=0x7f743c016000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.441+0000 7f744b7fe700 1 -- 172.21.15.78:0/2097513207 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f744404f150 con 0x7f74540a7c40 2023-08-17T17:50:29.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.608+0000 7f74592a3700 1 -- 172.21.15.78:0/2097513207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74540c6970 con 0x7f74540a7c40 2023-08-17T17:50:29.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.609+0000 7f744b7fe700 1 -- 172.21.15.78:0/2097513207 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+16990 (secure 0 0 0) 0x7f744404ed40 con 0x7f74540a7c40 2023-08-17T17:50:29.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:29.610 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":105,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:50:27.946767+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:50:25.474971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T17:50:25.916399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:50:29.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 -- 172.21.15.78:0/2097513207 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f743405ed90 msgr2=0x7f7434061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f743405ed90 0x7f7434061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f743c009760 tx=0x7f743c016000).stop 2023-08-17T17:50:29.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 -- 172.21.15.78:0/2097513207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74540a7c40 msgr2=0x7f74540ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74540a7c40 0x7f74540ae9f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f744400ea50 tx=0x7f7444009060).stop 2023-08-17T17:50:29.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 -- 172.21.15.78:0/2097513207 shutdown_connections 2023-08-17T17:50:29.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f743405ed90 0x7f7434061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7454154140 0x7f745414ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74540a7c40 0x7f74540ae9f0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 --2- 172.21.15.78:0/2097513207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74540a8080 0x7f74540afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 -- 172.21.15.78:0/2097513207 >> 172.21.15.78:0/2097513207 conn(0x7f7454094510 msgr2=0x7f74540ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:29.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 -- 172.21.15.78:0/2097513207 shutdown_connections 2023-08-17T17:50:29.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.611+0000 7f74592a3700 1 -- 172.21.15.78:0/2097513207 wait complete. 2023-08-17T17:50:29.623 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T17:50:29.624 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:50:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.736+0000 7f94e57dc700 1 Processor -- start 2023-08-17T17:50:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.736+0000 7f94e57dc700 1 -- start start 2023-08-17T17:50:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.737+0000 7f94e57dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94e0154140 0x7f94e00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.737+0000 7f94e57dc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f94e00a7c40 0x7f94e00c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.737+0000 7f94e57dc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e0154520 con 0x7f94e00a8080 2023-08-17T17:50:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.737+0000 7f94e57dc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e00c91e0 con 0x7f94e00a7c40 2023-08-17T17:50:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.737+0000 7f94e57dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00c94c0 con 0x7f94e0154140 2023-08-17T17:50:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.737+0000 7f94df7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f94e00a8080 0x7f94e00ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51474/0 (socket says 172.21.15.78:51474) 2023-08-17T17:50:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.737+0000 7f94df7fe700 1 -- 172.21.15.78:0/3913746272 learned_addr learned my addr 172.21.15.78:0/3913746272 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.737+0000 7f94d7fff700 1 --2- 172.21.15.78:0/3913746272 >> v2:172.21.15.150:3300/0 conn(0x7f94e00a7c40 0x7f94e00c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.737+0000 7f94deffd700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94e0154140 0x7f94e00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625257862 0 0) 0x7f94e0154520 con 0x7f94e00a8080 2023-08-17T17:50:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94cc0033f0 con 0x7f94e00a8080 2023-08-17T17:50:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3598886343 0 0) 0x7f94cc0033f0 con 0x7f94e00a8080 2023-08-17T17:50:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94e0154140 msgr2=0x7f94e00c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94e0154140 0x7f94e00c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 >> v2:172.21.15.150:3300/0 conn(0x7f94e00a7c40 msgr2=0x7f94e00c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 --2- 172.21.15.78:0/3913746272 >> v2:172.21.15.150:3300/0 conn(0x7f94e00a7c40 0x7f94e00c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00c97a0 con 0x7f94e00a8080 2023-08-17T17:50:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f94d80017f0 con 0x7f94e00a8080 2023-08-17T17:50:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 >> v1:172.21.15.78:6789/0 conn(0x7f94e00a8080 legacy=0x7f94e00ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94cc0038e0 0x7f94cc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94cc004690 0x7f94cc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94cc005000 0x7f94cc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00c91e0 con 0x7f94cc0038e0 2023-08-17T17:50:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00c94c0 con 0x7f94cc005000 2023-08-17T17:50:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc00bdd0 con 0x7f94cc004690 2023-08-17T17:50:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94deffd700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94e0154140 0x7f94e00c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:50:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94d7fff700 1 --2- 172.21.15.78:0/3913746272 >> v2:172.21.15.150:3300/0 conn(0x7f94e00a7c40 0x7f94e00c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:50:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94deffd700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94cc0038e0 0x7f94cc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94df7fe700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94cc005000 0x7f94cc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94d7fff700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94cc004690 0x7f94cc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94deffd700 1 -- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94cc004690 msgr2=0x7f94cc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94deffd700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94cc004690 0x7f94cc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94deffd700 1 -- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94cc005000 msgr2=0x7f94cc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94deffd700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94cc005000 0x7f94cc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94deffd700 1 -- 172.21.15.78:0/3913746272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc0033f0 con 0x7f94cc0038e0 2023-08-17T17:50:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.738+0000 7f94deffd700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94cc0038e0 0x7f94cc003d00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f94d0009ad0 tx=0x7f94d0009060).ready entity=mon.0 client_cookie=12b6191f177e74ce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.739+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d00094d0 con 0x7f94cc0038e0 2023-08-17T17:50:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.739+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d000e640 con 0x7f94cc0038e0 2023-08-17T17:50:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.739+0000 7f94de7fc700 1 -- 172.21.15.78:0/3913746272 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000ea00 con 0x7f94cc0038e0 2023-08-17T17:50:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.739+0000 7f94e57dc700 1 -- 172.21.15.78:0/3913746272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94cc0038e0 msgr2=0x7f94cc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.739+0000 7f94e57dc700 1 --2- 172.21.15.78:0/3913746272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94cc0038e0 0x7f94cc003d00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f94d0009ad0 tx=0x7f94d0009060).stop 2023-08-17T17:50:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.739+0000 7f94df7fe700 1 -- 172.21.15.78:0/3913746272 reap_dead start 2023-08-17T17:50:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.739+0000 7f94e57dc700 1 -- 172.21.15.78:0/3913746272 shutdown_connections 2023-08-17T17:50:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.739+0000 7f94e57dc700 1 -- 172.21.15.78:0/3913746272 >> 172.21.15.78:0/3913746272 conn(0x7f94e0094510 msgr2=0x7f94e006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.739+0000 7f94e57dc700 1 -- 172.21.15.78:0/3913746272 shutdown_connections 2023-08-17T17:50:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.739+0000 7f94e57dc700 1 -- 172.21.15.78:0/3913746272 wait complete. 2023-08-17T17:50:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.740+0000 7f94e57dc700 1 Processor -- start 2023-08-17T17:50:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.740+0000 7f94e57dc700 1 -- start start 2023-08-17T17:50:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94e57dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94cc0038e0 0x7f94e00ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94e57dc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e01684a0 0x7f94e01497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94e57dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0149cd0 0x7f94e0156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94e57dc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00acd90 con 0x7f94e01684a0 2023-08-17T17:50:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94e57dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00ac3f0 con 0x7f94e0149cd0 2023-08-17T17:50:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94e57dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00ac6d0 con 0x7f94cc0038e0 2023-08-17T17:50:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e01684a0 0x7f94e01497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e01684a0 0x7f94e01497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37034/0 (socket says 172.21.15.78:37034) 2023-08-17T17:50:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94d7fff700 1 -- 172.21.15.78:0/1764692247 learned_addr learned my addr 172.21.15.78:0/1764692247 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94deffd700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94cc0038e0 0x7f94e00ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94df7fe700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0149cd0 0x7f94e0156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94d7fff700 1 -- 172.21.15.78:0/1764692247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94cc0038e0 msgr2=0x7f94e00ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94d7fff700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94cc0038e0 0x7f94e00ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94d7fff700 1 -- 172.21.15.78:0/1764692247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0149cd0 msgr2=0x7f94e0156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94d7fff700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0149cd0 0x7f94e0156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.741+0000 7f94d7fff700 1 -- 172.21.15.78:0/1764692247 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00ac9b0 con 0x7f94e01684a0 2023-08-17T17:50:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.742+0000 7f94d7fff700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e01684a0 0x7f94e01497e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f94c8011b40 tx=0x7f94c8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.742+0000 7f94d6ffd700 1 -- 172.21.15.78:0/1764692247 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c800fa10 con 0x7f94e01684a0 2023-08-17T17:50:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.742+0000 7f94d6ffd700 1 -- 172.21.15.78:0/1764692247 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c800fb70 con 0x7f94e01684a0 2023-08-17T17:50:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.742+0000 7f94e57dc700 1 -- 172.21.15.78:0/1764692247 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e00ac030 con 0x7f94e01684a0 2023-08-17T17:50:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.742+0000 7f94d6ffd700 1 -- 172.21.15.78:0/1764692247 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8014440 con 0x7f94e01684a0 2023-08-17T17:50:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.742+0000 7f94e57dc700 1 -- 172.21.15.78:0/1764692247 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e0157410 con 0x7f94e01684a0 2023-08-17T17:50:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.743+0000 7f94e57dc700 1 -- 172.21.15.78:0/1764692247 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00aced0 con 0x7f94e01684a0 2023-08-17T17:50:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.743+0000 7f94d6ffd700 1 -- 172.21.15.78:0/1764692247 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f94c8024070 con 0x7f94e01684a0 2023-08-17T17:50:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.743+0000 7f94d6ffd700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f94c005ed90 0x7f94c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.743+0000 7f94d6ffd700 1 -- 172.21.15.78:0/1764692247 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f94c807a3f0 con 0x7f94e01684a0 2023-08-17T17:50:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.743+0000 7f94deffd700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f94c005ed90 0x7f94c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.744+0000 7f94deffd700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f94c005ed90 0x7f94c0061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f94d0006a10 tx=0x7f94d0019000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.748+0000 7f94d6ffd700 1 -- 172.21.15.78:0/1764692247 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f94e00aced0 con 0x7f94e01684a0 2023-08-17T17:50:29.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.906+0000 7f94e57dc700 1 -- 172.21.15.78:0/1764692247 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94e00aced0 con 0x7f94c005ed90 2023-08-17T17:50:29.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.916+0000 7f94d6ffd700 1 -- 172.21.15.78:0/1764692247 <== mgr.6990 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361309 (secure 0 0 0) 0x7f94e00aced0 con 0x7f94c005ed90 2023-08-17T17:50:29.920 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 -- 172.21.15.78:0/1764692247 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f94c005ed90 msgr2=0x7f94c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f94c005ed90 0x7f94c0061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f94d0006a10 tx=0x7f94d0019000).stop 2023-08-17T17:50:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 -- 172.21.15.78:0/1764692247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e01684a0 msgr2=0x7f94e01497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e01684a0 0x7f94e01497e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f94c8011b40 tx=0x7f94c8009060).stop 2023-08-17T17:50:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 -- 172.21.15.78:0/1764692247 shutdown_connections 2023-08-17T17:50:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f94c005ed90 0x7f94c0061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e0149cd0 0x7f94e0156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94cc0038e0 0x7f94e00ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 --2- 172.21.15.78:0/1764692247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e01684a0 0x7f94e01497e0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:29.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 -- 172.21.15.78:0/1764692247 >> 172.21.15.78:0/1764692247 conn(0x7f94e0094510 msgr2=0x7f94e0159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:29.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 -- 172.21.15.78:0/1764692247 shutdown_connections 2023-08-17T17:50:29.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:29.920+0000 7f94e57dc700 1 -- 172.21.15.78:0/1764692247 wait complete. 2023-08-17T17:50:29.923 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:50:29.932 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-17T17:50:27.998680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419364,"kb_used_data":9828,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752555356,"statfs":{"total":773094113280,"available":770616684544,"internally_reserved":0,"allocated":10063872,"data_stored":4949637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4468,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.585568"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971421+0000","last_change":"2023-08-17T17:50:26.971421+0000","last_active":"2023-08-17T17:50:26.971421+0000","last_peered":"2023-08-17T17:50:26.971421+0000","last_clean":"2023-08-17T17:50:26.971421+0000","last_became_active":"2023-08-17T17:50:26.971141+0000","last_became_peered":"2023-08-17T17:50:26.971141+0000","last_unstale":"2023-08-17T17:50:26.971421+0000","last_undegraded":"2023-08-17T17:50:26.971421+0000","last_fullsized":"2023-08-17T17:50:26.971421+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"104'3","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.975631+0000","last_change":"2023-08-17T17:50:26.602015+0000","last_active":"2023-08-17T17:50:26.975631+0000","last_peered":"2023-08-17T17:50:26.975631+0000","last_clean":"2023-08-17T17:50:26.975631+0000","last_became_active":"2023-08-17T17:50:26.601711+0000","last_became_peered":"2023-08-17T17:50:26.601711+0000","last_unstale":"2023-08-17T17:50:26.975631+0000","last_undegraded":"2023-08-17T17:50:26.975631+0000","last_fullsized":"2023-08-17T17:50:26.975631+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.975618+0000","last_change":"2023-08-17T17:50:26.975618+0000","last_active":"2023-08-17T17:50:26.975618+0000","last_peered":"2023-08-17T17:50:26.975618+0000","last_clean":"2023-08-17T17:50:26.975618+0000","last_became_active":"2023-08-17T17:50:26.975304+0000","last_became_peered":"2023-08-17T17:50:26.975304+0000","last_unstale":"2023-08-17T17:50:26.975618+0000","last_undegraded":"2023-08-17T17:50:26.975618+0000","last_fullsized":"2023-08-17T17:50:26.975618+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609654+0000","last_change":"2023-08-17T17:50:26.603008+0000","last_active":"2023-08-17T17:50:26.609654+0000","last_peered":"2023-08-17T17:50:26.609654+0000","last_clean":"2023-08-17T17:50:26.609654+0000","last_became_active":"2023-08-17T17:50:26.602733+0000","last_became_peered":"2023-08-17T17:50:26.602733+0000","last_unstale":"2023-08-17T17:50:26.609654+0000","last_undegraded":"2023-08-17T17:50:26.609654+0000","last_fullsized":"2023-08-17T17:50:26.609654+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.967406+0000","last_change":"2023-08-17T17:50:26.967406+0000","last_active":"2023-08-17T17:50:26.967406+0000","last_peered":"2023-08-17T17:50:26.967406+0000","last_clean":"2023-08-17T17:50:26.967406+0000","last_became_active":"2023-08-17T17:50:26.967199+0000","last_became_peered":"2023-08-17T17:50:26.967199+0000","last_unstale":"2023-08-17T17:50:26.967406+0000","last_undegraded":"2023-08-17T17:50:26.967406+0000","last_fullsized":"2023-08-17T17:50:26.967406+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.606308+0000","last_change":"2023-08-17T17:50:26.605142+0000","last_active":"2023-08-17T17:50:26.606308+0000","last_peered":"2023-08-17T17:50:26.606308+0000","last_clean":"2023-08-17T17:50:26.606308+0000","last_became_active":"2023-08-17T17:50:26.604864+0000","last_became_peered":"2023-08-17T17:50:26.604864+0000","last_unstale":"2023-08-17T17:50:26.606308+0000","last_undegraded":"2023-08-17T17:50:26.606308+0000","last_fullsized":"2023-08-17T17:50:26.606308+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.967968+0000","last_change":"2023-08-17T17:50:26.967968+0000","last_active":"2023-08-17T17:50:26.967968+0000","last_peered":"2023-08-17T17:50:26.967968+0000","last_clean":"2023-08-17T17:50:26.967968+0000","last_became_active":"2023-08-17T17:50:26.967718+0000","last_became_peered":"2023-08-17T17:50:26.967718+0000","last_unstale":"2023-08-17T17:50:26.967968+0000","last_undegraded":"2023-08-17T17:50:26.967968+0000","last_fullsized":"2023-08-17T17:50:26.967968+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"104'2","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965700+0000","last_change":"2023-08-17T17:50:26.603823+0000","last_active":"2023-08-17T17:50:26.965700+0000","last_peered":"2023-08-17T17:50:26.965700+0000","last_clean":"2023-08-17T17:50:26.965700+0000","last_became_active":"2023-08-17T17:50:26.603564+0000","last_became_peered":"2023-08-17T17:50:26.603564+0000","last_unstale":"2023-08-17T17:50:26.965700+0000","last_undegraded":"2023-08-17T17:50:26.965700+0000","last_fullsized":"2023-08-17T17:50:26.965700+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.968626+0000","last_change":"2023-08-17T17:50:26.968626+0000","last_active":"2023-08-17T17:50:26.968626+0000","last_peered":"2023-08-17T17:50:26.968626+0000","last_clean":"2023-08-17T17:50:26.968626+0000","last_became_active":"2023-08-17T17:50:26.968343+0000","last_became_peered":"2023-08-17T17:50:26.968343+0000","last_unstale":"2023-08-17T17:50:26.968626+0000","last_undegraded":"2023-08-17T17:50:26.968626+0000","last_fullsized":"2023-08-17T17:50:26.968626+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.956037+0000","last_change":"2023-08-17T17:50:26.601591+0000","last_active":"2023-08-17T17:50:26.956037+0000","last_peered":"2023-08-17T17:50:26.956037+0000","last_clean":"2023-08-17T17:50:26.956037+0000","last_became_active":"2023-08-17T17:50:26.601103+0000","last_became_peered":"2023-08-17T17:50:26.601103+0000","last_unstale":"2023-08-17T17:50:26.956037+0000","last_undegraded":"2023-08-17T17:50:26.956037+0000","last_fullsized":"2023-08-17T17:50:26.956037+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.970538+0000","last_change":"2023-08-17T17:50:26.970538+0000","last_active":"2023-08-17T17:50:26.970538+0000","last_peered":"2023-08-17T17:50:26.970538+0000","last_clean":"2023-08-17T17:50:26.970538+0000","last_became_active":"2023-08-17T17:50:26.970245+0000","last_became_peered":"2023-08-17T17:50:26.970245+0000","last_unstale":"2023-08-17T17:50:26.970538+0000","last_undegraded":"2023-08-17T17:50:26.970538+0000","last_fullsized":"2023-08-17T17:50:26.970538+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.956791+0000","last_change":"2023-08-17T17:50:26.608027+0000","last_active":"2023-08-17T17:50:26.956791+0000","last_peered":"2023-08-17T17:50:26.956791+0000","last_clean":"2023-08-17T17:50:26.956791+0000","last_became_active":"2023-08-17T17:50:26.607714+0000","last_became_peered":"2023-08-17T17:50:26.607714+0000","last_unstale":"2023-08-17T17:50:26.956791+0000","last_undegraded":"2023-08-17T17:50:26.956791+0000","last_fullsized":"2023-08-17T17:50:26.956791+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965850+0000","last_change":"2023-08-17T17:50:26.965850+0000","last_active":"2023-08-17T17:50:26.965850+0000","last_peered":"2023-08-17T17:50:26.965850+0000","last_clean":"2023-08-17T17:50:26.965850+0000","last_became_active":"2023-08-17T17:50:26.965449+0000","last_became_peered":"2023-08-17T17:50:26.965449+0000","last_unstale":"2023-08-17T17:50:26.965850+0000","last_undegraded":"2023-08-17T17:50:26.965850+0000","last_fullsized":"2023-08-17T17:50:26.965850+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.610044+0000","last_change":"2023-08-17T17:50:26.606171+0000","last_active":"2023-08-17T17:50:26.610044+0000","last_peered":"2023-08-17T17:50:26.610044+0000","last_clean":"2023-08-17T17:50:26.610044+0000","last_became_active":"2023-08-17T17:50:26.605856+0000","last_became_peered":"2023-08-17T17:50:26.605856+0000","last_unstale":"2023-08-17T17:50:26.610044+0000","last_undegraded":"2023-08-17T17:50:26.610044+0000","last_fullsized":"2023-08-17T17:50:26.610044+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.974324+0000","last_change":"2023-08-17T17:50:26.974324+0000","last_active":"2023-08-17T17:50:26.974324+0000","last_peered":"2023-08-17T17:50:26.974324+0000","last_clean":"2023-08-17T17:50:26.974324+0000","last_became_active":"2023-08-17T17:50:26.974026+0000","last_became_peered":"2023-08-17T17:50:26.974026+0000","last_unstale":"2023-08-17T17:50:26.974324+0000","last_undegraded":"2023-08-17T17:50:26.974324+0000","last_fullsized":"2023-08-17T17:50:26.974324+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.601772+0000","last_change":"2023-08-17T17:50:26.597059+0000","last_active":"2023-08-17T17:50:26.601772+0000","last_peered":"2023-08-17T17:50:26.601772+0000","last_clean":"2023-08-17T17:50:26.601772+0000","last_became_active":"2023-08-17T17:50:26.596756+0000","last_became_peered":"2023-08-17T17:50:26.596756+0000","last_unstale":"2023-08-17T17:50:26.601772+0000","last_undegraded":"2023-08-17T17:50:26.601772+0000","last_fullsized":"2023-08-17T17:50:26.601772+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.963969+0000","last_change":"2023-08-17T17:50:26.963969+0000","last_active":"2023-08-17T17:50:26.963969+0000","last_peered":"2023-08-17T17:50:26.963969+0000","last_clean":"2023-08-17T17:50:26.963969+0000","last_became_active":"2023-08-17T17:50:26.963727+0000","last_became_peered":"2023-08-17T17:50:26.963727+0000","last_unstale":"2023-08-17T17:50:26.963969+0000","last_undegraded":"2023-08-17T17:50:26.963969+0000","last_fullsized":"2023-08-17T17:50:26.963969+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.600886+0000","last_change":"2023-08-17T17:50:26.595568+0000","last_active":"2023-08-17T17:50:26.600886+0000","last_peered":"2023-08-17T17:50:26.600886+0000","last_clean":"2023-08-17T17:50:26.600886+0000","last_became_active":"2023-08-17T17:50:26.595249+0000","last_became_peered":"2023-08-17T17:50:26.595249+0000","last_unstale":"2023-08-17T17:50:26.600886+0000","last_undegraded":"2023-08-17T17:50:26.600886+0000","last_fullsized":"2023-08-17T17:50:26.600886+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.974648+0000","last_change":"2023-08-17T17:50:26.974648+0000","last_active":"2023-08-17T17:50:26.974648+0000","last_peered":"2023-08-17T17:50:26.974648+0000","last_clean":"2023-08-17T17:50:26.974648+0000","last_became_active":"2023-08-17T17:50:26.973943+0000","last_became_peered":"2023-08-17T17:50:26.973943+0000","last_unstale":"2023-08-17T17:50:26.974648+0000","last_undegraded":"2023-08-17T17:50:26.974648+0000","last_fullsized":"2023-08-17T17:50:26.974648+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.601462+0000","last_change":"2023-08-17T17:50:26.597997+0000","last_active":"2023-08-17T17:50:26.601462+0000","last_peered":"2023-08-17T17:50:26.601462+0000","last_clean":"2023-08-17T17:50:26.601462+0000","last_became_active":"2023-08-17T17:50:26.597529+0000","last_became_peered":"2023-08-17T17:50:26.597529+0000","last_unstale":"2023-08-17T17:50:26.601462+0000","last_undegraded":"2023-08-17T17:50:26.601462+0000","last_fullsized":"2023-08-17T17:50:26.601462+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966104+0000","last_change":"2023-08-17T17:50:26.966104+0000","last_active":"2023-08-17T17:50:26.966104+0000","last_peered":"2023-08-17T17:50:26.966104+0000","last_clean":"2023-08-17T17:50:26.966104+0000","last_became_active":"2023-08-17T17:50:26.965811+0000","last_became_peered":"2023-08-17T17:50:26.965811+0000","last_unstale":"2023-08-17T17:50:26.966104+0000","last_undegraded":"2023-08-17T17:50:26.966104+0000","last_fullsized":"2023-08-17T17:50:26.966104+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609723+0000","last_change":"2023-08-17T17:50:26.602704+0000","last_active":"2023-08-17T17:50:26.609723+0000","last_peered":"2023-08-17T17:50:26.609723+0000","last_clean":"2023-08-17T17:50:26.609723+0000","last_became_active":"2023-08-17T17:50:26.602449+0000","last_became_peered":"2023-08-17T17:50:26.602449+0000","last_unstale":"2023-08-17T17:50:26.609723+0000","last_undegraded":"2023-08-17T17:50:26.609723+0000","last_fullsized":"2023-08-17T17:50:26.609723+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.960178+0000","last_change":"2023-08-17T17:50:26.960178+0000","last_active":"2023-08-17T17:50:26.960178+0000","last_peered":"2023-08-17T17:50:26.960178+0000","last_clean":"2023-08-17T17:50:26.960178+0000","last_became_active":"2023-08-17T17:50:26.959773+0000","last_became_peered":"2023-08-17T17:50:26.959773+0000","last_unstale":"2023-08-17T17:50:26.960178+0000","last_undegraded":"2023-08-17T17:50:26.960178+0000","last_fullsized":"2023-08-17T17:50:26.960178+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"104'4","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.974396+0000","last_change":"2023-08-17T17:50:26.597895+0000","last_active":"2023-08-17T17:50:26.974396+0000","last_peered":"2023-08-17T17:50:26.974396+0000","last_clean":"2023-08-17T17:50:26.974396+0000","last_became_active":"2023-08-17T17:50:26.597608+0000","last_became_peered":"2023-08-17T17:50:26.597608+0000","last_unstale":"2023-08-17T17:50:26.974396+0000","last_undegraded":"2023-08-17T17:50:26.974396+0000","last_fullsized":"2023-08-17T17:50:26.974396+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973850+0000","last_change":"2023-08-17T17:50:26.973850+0000","last_active":"2023-08-17T17:50:26.973850+0000","last_peered":"2023-08-17T17:50:26.973850+0000","last_clean":"2023-08-17T17:50:26.973850+0000","last_became_active":"2023-08-17T17:50:26.973519+0000","last_became_peered":"2023-08-17T17:50:26.973519+0000","last_unstale":"2023-08-17T17:50:26.973850+0000","last_undegraded":"2023-08-17T17:50:26.973850+0000","last_fullsized":"2023-08-17T17:50:26.973850+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965001+0000","last_change":"2023-08-17T17:50:26.602514+0000","last_active":"2023-08-17T17:50:26.965001+0000","last_peered":"2023-08-17T17:50:26.965001+0000","last_clean":"2023-08-17T17:50:26.965001+0000","last_became_active":"2023-08-17T17:50:26.601978+0000","last_became_peered":"2023-08-17T17:50:26.601978+0000","last_unstale":"2023-08-17T17:50:26.965001+0000","last_undegraded":"2023-08-17T17:50:26.965001+0000","last_fullsized":"2023-08-17T17:50:26.965001+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.960942+0000","last_change":"2023-08-17T17:50:26.960942+0000","last_active":"2023-08-17T17:50:26.960942+0000","last_peered":"2023-08-17T17:50:26.960942+0000","last_clean":"2023-08-17T17:50:26.960942+0000","last_became_active":"2023-08-17T17:50:26.960677+0000","last_became_peered":"2023-08-17T17:50:26.960677+0000","last_unstale":"2023-08-17T17:50:26.960942+0000","last_undegraded":"2023-08-17T17:50:26.960942+0000","last_fullsized":"2023-08-17T17:50:26.960942+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609931+0000","last_change":"2023-08-17T17:50:26.605723+0000","last_active":"2023-08-17T17:50:26.609931+0000","last_peered":"2023-08-17T17:50:26.609931+0000","last_clean":"2023-08-17T17:50:26.609931+0000","last_became_active":"2023-08-17T17:50:26.602981+0000","last_became_peered":"2023-08-17T17:50:26.602981+0000","last_unstale":"2023-08-17T17:50:26.609931+0000","last_undegraded":"2023-08-17T17:50:26.609931+0000","last_fullsized":"2023-08-17T17:50:26.609931+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965876+0000","last_change":"2023-08-17T17:50:26.965876+0000","last_active":"2023-08-17T17:50:26.965876+0000","last_peered":"2023-08-17T17:50:26.965876+0000","last_clean":"2023-08-17T17:50:26.965876+0000","last_became_active":"2023-08-17T17:50:26.965595+0000","last_became_peered":"2023-08-17T17:50:26.965595+0000","last_unstale":"2023-08-17T17:50:26.965876+0000","last_undegraded":"2023-08-17T17:50:26.965876+0000","last_fullsized":"2023-08-17T17:50:26.965876+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609053+0000","last_change":"2023-08-17T17:50:26.598776+0000","last_active":"2023-08-17T17:50:26.609053+0000","last_peered":"2023-08-17T17:50:26.609053+0000","last_clean":"2023-08-17T17:50:26.609053+0000","last_became_active":"2023-08-17T17:50:26.598327+0000","last_became_peered":"2023-08-17T17:50:26.598327+0000","last_unstale":"2023-08-17T17:50:26.609053+0000","last_undegraded":"2023-08-17T17:50:26.609053+0000","last_fullsized":"2023-08-17T17:50:26.609053+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.969033+0000","last_change":"2023-08-17T17:50:26.969033+0000","last_active":"2023-08-17T17:50:26.969033+0000","last_peered":"2023-08-17T17:50:26.969033+0000","last_clean":"2023-08-17T17:50:26.969033+0000","last_became_active":"2023-08-17T17:50:26.968771+0000","last_became_peered":"2023-08-17T17:50:26.968771+0000","last_unstale":"2023-08-17T17:50:26.969033+0000","last_undegraded":"2023-08-17T17:50:26.969033+0000","last_fullsized":"2023-08-17T17:50:26.969033+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"104'4","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.970483+0000","last_change":"2023-08-17T17:50:26.600025+0000","last_active":"2023-08-17T17:50:26.970483+0000","last_peered":"2023-08-17T17:50:26.970483+0000","last_clean":"2023-08-17T17:50:26.970483+0000","last_became_active":"2023-08-17T17:50:26.599746+0000","last_became_peered":"2023-08-17T17:50:26.599746+0000","last_unstale":"2023-08-17T17:50:26.970483+0000","last_undegraded":"2023-08-17T17:50:26.970483+0000","last_fullsized":"2023-08-17T17:50:26.970483+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.963618+0000","last_change":"2023-08-17T17:50:26.963618+0000","last_active":"2023-08-17T17:50:26.963618+0000","last_peered":"2023-08-17T17:50:26.963618+0000","last_clean":"2023-08-17T17:50:26.963618+0000","last_became_active":"2023-08-17T17:50:26.963340+0000","last_became_peered":"2023-08-17T17:50:26.963340+0000","last_unstale":"2023-08-17T17:50:26.963618+0000","last_undegraded":"2023-08-17T17:50:26.963618+0000","last_fullsized":"2023-08-17T17:50:26.963618+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.601248+0000","last_change":"2023-08-17T17:50:26.596649+0000","last_active":"2023-08-17T17:50:26.601248+0000","last_peered":"2023-08-17T17:50:26.601248+0000","last_clean":"2023-08-17T17:50:26.601248+0000","last_became_active":"2023-08-17T17:50:26.596376+0000","last_became_peered":"2023-08-17T17:50:26.596376+0000","last_unstale":"2023-08-17T17:50:26.601248+0000","last_undegraded":"2023-08-17T17:50:26.601248+0000","last_fullsized":"2023-08-17T17:50:26.601248+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.974808+0000","last_change":"2023-08-17T17:50:26.974808+0000","last_active":"2023-08-17T17:50:26.974808+0000","last_peered":"2023-08-17T17:50:26.974808+0000","last_clean":"2023-08-17T17:50:26.974808+0000","last_became_active":"2023-08-17T17:50:26.974242+0000","last_became_peered":"2023-08-17T17:50:26.974242+0000","last_unstale":"2023-08-17T17:50:26.974808+0000","last_undegraded":"2023-08-17T17:50:26.974808+0000","last_fullsized":"2023-08-17T17:50:26.974808+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609729+0000","last_change":"2023-08-17T17:50:26.603507+0000","last_active":"2023-08-17T17:50:26.609729+0000","last_peered":"2023-08-17T17:50:26.609729+0000","last_clean":"2023-08-17T17:50:26.609729+0000","last_became_active":"2023-08-17T17:50:26.602644+0000","last_became_peered":"2023-08-17T17:50:26.602644+0000","last_unstale":"2023-08-17T17:50:26.609729+0000","last_undegraded":"2023-08-17T17:50:26.609729+0000","last_fullsized":"2023-08-17T17:50:26.609729+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.967524+0000","last_change":"2023-08-17T17:50:26.967524+0000","last_active":"2023-08-17T17:50:26.967524+0000","last_peered":"2023-08-17T17:50:26.967524+0000","last_clean":"2023-08-17T17:50:26.967524+0000","last_became_active":"2023-08-17T17:50:26.967234+0000","last_became_peered":"2023-08-17T17:50:26.967234+0000","last_unstale":"2023-08-17T17:50:26.967524+0000","last_undegraded":"2023-08-17T17:50:26.967524+0000","last_fullsized":"2023-08-17T17:50:26.967524+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.955606+0000","last_change":"2023-08-17T17:50:26.590522+0000","last_active":"2023-08-17T17:50:26.955606+0000","last_peered":"2023-08-17T17:50:26.955606+0000","last_clean":"2023-08-17T17:50:26.955606+0000","last_became_active":"2023-08-17T17:50:26.590236+0000","last_became_peered":"2023-08-17T17:50:26.590236+0000","last_unstale":"2023-08-17T17:50:26.955606+0000","last_undegraded":"2023-08-17T17:50:26.955606+0000","last_fullsized":"2023-08-17T17:50:26.955606+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973266+0000","last_change":"2023-08-17T17:50:26.973266+0000","last_active":"2023-08-17T17:50:26.973266+0000","last_peered":"2023-08-17T17:50:26.973266+0000","last_clean":"2023-08-17T17:50:26.973266+0000","last_became_active":"2023-08-17T17:50:26.973037+0000","last_became_peered":"2023-08-17T17:50:26.973037+0000","last_unstale":"2023-08-17T17:50:26.973266+0000","last_undegraded":"2023-08-17T17:50:26.973266+0000","last_fullsized":"2023-08-17T17:50:26.973266+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609881+0000","last_change":"2023-08-17T17:50:26.605551+0000","last_active":"2023-08-17T17:50:26.609881+0000","last_peered":"2023-08-17T17:50:26.609881+0000","last_clean":"2023-08-17T17:50:26.609881+0000","last_became_active":"2023-08-17T17:50:26.605288+0000","last_became_peered":"2023-08-17T17:50:26.605288+0000","last_unstale":"2023-08-17T17:50:26.609881+0000","last_undegraded":"2023-08-17T17:50:26.609881+0000","last_fullsized":"2023-08-17T17:50:26.609881+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.959397+0000","last_change":"2023-08-17T17:50:26.959397+0000","last_active":"2023-08-17T17:50:26.959397+0000","last_peered":"2023-08-17T17:50:26.959397+0000","last_clean":"2023-08-17T17:50:26.959397+0000","last_became_active":"2023-08-17T17:50:26.959128+0000","last_became_peered":"2023-08-17T17:50:26.959128+0000","last_unstale":"2023-08-17T17:50:26.959397+0000","last_undegraded":"2023-08-17T17:50:26.959397+0000","last_fullsized":"2023-08-17T17:50:26.959397+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.957209+0000","last_change":"2023-08-17T17:50:26.609463+0000","last_active":"2023-08-17T17:50:26.957209+0000","last_peered":"2023-08-17T17:50:26.957209+0000","last_clean":"2023-08-17T17:50:26.957209+0000","last_became_active":"2023-08-17T17:50:26.608991+0000","last_became_peered":"2023-08-17T17:50:26.608991+0000","last_unstale":"2023-08-17T17:50:26.957209+0000","last_undegraded":"2023-08-17T17:50:26.957209+0000","last_fullsized":"2023-08-17T17:50:26.957209+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972134+0000","last_change":"2023-08-17T17:50:26.972134+0000","last_active":"2023-08-17T17:50:26.972134+0000","last_peered":"2023-08-17T17:50:26.972134+0000","last_clean":"2023-08-17T17:50:26.972134+0000","last_became_active":"2023-08-17T17:50:26.971656+0000","last_became_peered":"2023-08-17T17:50:26.971656+0000","last_unstale":"2023-08-17T17:50:26.972134+0000","last_undegraded":"2023-08-17T17:50:26.972134+0000","last_fullsized":"2023-08-17T17:50:26.972134+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.603604+0000","last_change":"2023-08-17T17:50:26.599599+0000","last_active":"2023-08-17T17:50:26.603604+0000","last_peered":"2023-08-17T17:50:26.603604+0000","last_clean":"2023-08-17T17:50:26.603604+0000","last_became_active":"2023-08-17T17:50:26.599284+0000","last_became_peered":"2023-08-17T17:50:26.599284+0000","last_unstale":"2023-08-17T17:50:26.603604+0000","last_undegraded":"2023-08-17T17:50:26.603604+0000","last_fullsized":"2023-08-17T17:50:26.603604+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.964987+0000","last_change":"2023-08-17T17:50:26.964987+0000","last_active":"2023-08-17T17:50:26.964987+0000","last_peered":"2023-08-17T17:50:26.964987+0000","last_clean":"2023-08-17T17:50:26.964987+0000","last_became_active":"2023-08-17T17:50:26.964702+0000","last_became_peered":"2023-08-17T17:50:26.964702+0000","last_unstale":"2023-08-17T17:50:26.964987+0000","last_undegraded":"2023-08-17T17:50:26.964987+0000","last_fullsized":"2023-08-17T17:50:26.964987+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609698+0000","last_change":"2023-08-17T17:50:26.603332+0000","last_active":"2023-08-17T17:50:26.609698+0000","last_peered":"2023-08-17T17:50:26.609698+0000","last_clean":"2023-08-17T17:50:26.609698+0000","last_became_active":"2023-08-17T17:50:26.603037+0000","last_became_peered":"2023-08-17T17:50:26.603037+0000","last_unstale":"2023-08-17T17:50:26.609698+0000","last_undegraded":"2023-08-17T17:50:26.609698+0000","last_fullsized":"2023-08-17T17:50:26.609698+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971532+0000","last_change":"2023-08-17T17:50:26.971532+0000","last_active":"2023-08-17T17:50:26.971532+0000","last_peered":"2023-08-17T17:50:26.971532+0000","last_clean":"2023-08-17T17:50:26.971532+0000","last_became_active":"2023-08-17T17:50:26.970852+0000","last_became_peered":"2023-08-17T17:50:26.970852+0000","last_unstale":"2023-08-17T17:50:26.971532+0000","last_undegraded":"2023-08-17T17:50:26.971532+0000","last_fullsized":"2023-08-17T17:50:26.971532+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.610026+0000","last_change":"2023-08-17T17:50:26.606278+0000","last_active":"2023-08-17T17:50:26.610026+0000","last_peered":"2023-08-17T17:50:26.610026+0000","last_clean":"2023-08-17T17:50:26.610026+0000","last_became_active":"2023-08-17T17:50:26.602539+0000","last_became_peered":"2023-08-17T17:50:26.602539+0000","last_unstale":"2023-08-17T17:50:26.610026+0000","last_undegraded":"2023-08-17T17:50:26.610026+0000","last_fullsized":"2023-08-17T17:50:26.610026+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.977038+0000","last_change":"2023-08-17T17:50:26.977038+0000","last_active":"2023-08-17T17:50:26.977038+0000","last_peered":"2023-08-17T17:50:26.977038+0000","last_clean":"2023-08-17T17:50:26.977038+0000","last_became_active":"2023-08-17T17:50:26.976621+0000","last_became_peered":"2023-08-17T17:50:26.976621+0000","last_unstale":"2023-08-17T17:50:26.977038+0000","last_undegraded":"2023-08-17T17:50:26.977038+0000","last_fullsized":"2023-08-17T17:50:26.977038+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609769+0000","last_change":"2023-08-17T17:50:26.603229+0000","last_active":"2023-08-17T17:50:26.609769+0000","last_peered":"2023-08-17T17:50:26.609769+0000","last_clean":"2023-08-17T17:50:26.609769+0000","last_became_active":"2023-08-17T17:50:26.602939+0000","last_became_peered":"2023-08-17T17:50:26.602939+0000","last_unstale":"2023-08-17T17:50:26.609769+0000","last_undegraded":"2023-08-17T17:50:26.609769+0000","last_fullsized":"2023-08-17T17:50:26.609769+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.976894+0000","last_change":"2023-08-17T17:50:26.976894+0000","last_active":"2023-08-17T17:50:26.976894+0000","last_peered":"2023-08-17T17:50:26.976894+0000","last_clean":"2023-08-17T17:50:26.976894+0000","last_became_active":"2023-08-17T17:50:26.976621+0000","last_became_peered":"2023-08-17T17:50:26.976621+0000","last_unstale":"2023-08-17T17:50:26.976894+0000","last_undegraded":"2023-08-17T17:50:26.976894+0000","last_fullsized":"2023-08-17T17:50:26.976894+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.613734+0000","last_change":"2023-08-17T17:50:26.610393+0000","last_active":"2023-08-17T17:50:26.613734+0000","last_peered":"2023-08-17T17:50:26.613734+0000","last_clean":"2023-08-17T17:50:26.613734+0000","last_became_active":"2023-08-17T17:50:26.610072+0000","last_became_peered":"2023-08-17T17:50:26.610072+0000","last_unstale":"2023-08-17T17:50:26.613734+0000","last_undegraded":"2023-08-17T17:50:26.613734+0000","last_fullsized":"2023-08-17T17:50:26.613734+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971363+0000","last_change":"2023-08-17T17:50:26.971363+0000","last_active":"2023-08-17T17:50:26.971363+0000","last_peered":"2023-08-17T17:50:26.971363+0000","last_clean":"2023-08-17T17:50:26.971363+0000","last_became_active":"2023-08-17T17:50:26.971071+0000","last_became_peered":"2023-08-17T17:50:26.971071+0000","last_unstale":"2023-08-17T17:50:26.971363+0000","last_undegraded":"2023-08-17T17:50:26.971363+0000","last_fullsized":"2023-08-17T17:50:26.971363+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.604132+0000","last_change":"2023-08-17T17:50:26.595919+0000","last_active":"2023-08-17T17:50:26.604132+0000","last_peered":"2023-08-17T17:50:26.604132+0000","last_clean":"2023-08-17T17:50:26.604132+0000","last_became_active":"2023-08-17T17:50:26.595652+0000","last_became_peered":"2023-08-17T17:50:26.595652+0000","last_unstale":"2023-08-17T17:50:26.604132+0000","last_undegraded":"2023-08-17T17:50:26.604132+0000","last_fullsized":"2023-08-17T17:50:26.604132+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971364+0000","last_change":"2023-08-17T17:50:26.971364+0000","last_active":"2023-08-17T17:50:26.971364+0000","last_peered":"2023-08-17T17:50:26.971364+0000","last_clean":"2023-08-17T17:50:26.971364+0000","last_became_active":"2023-08-17T17:50:26.971059+0000","last_became_peered":"2023-08-17T17:50:26.971059+0000","last_unstale":"2023-08-17T17:50:26.971364+0000","last_undegraded":"2023-08-17T17:50:26.971364+0000","last_fullsized":"2023-08-17T17:50:26.971364+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.606394+0000","last_change":"2023-08-17T17:50:26.602995+0000","last_active":"2023-08-17T17:50:26.606394+0000","last_peered":"2023-08-17T17:50:26.606394+0000","last_clean":"2023-08-17T17:50:26.606394+0000","last_became_active":"2023-08-17T17:50:26.602313+0000","last_became_peered":"2023-08-17T17:50:26.602313+0000","last_unstale":"2023-08-17T17:50:26.606394+0000","last_undegraded":"2023-08-17T17:50:26.606394+0000","last_fullsized":"2023-08-17T17:50:26.606394+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972665+0000","last_change":"2023-08-17T17:50:26.972665+0000","last_active":"2023-08-17T17:50:26.972665+0000","last_peered":"2023-08-17T17:50:26.972665+0000","last_clean":"2023-08-17T17:50:26.972665+0000","last_became_active":"2023-08-17T17:50:26.971997+0000","last_became_peered":"2023-08-17T17:50:26.971997+0000","last_unstale":"2023-08-17T17:50:26.972665+0000","last_undegraded":"2023-08-17T17:50:26.972665+0000","last_fullsized":"2023-08-17T17:50:26.972665+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.596683+0000","last_change":"2023-08-17T17:50:26.592933+0000","last_active":"2023-08-17T17:50:26.596683+0000","last_peered":"2023-08-17T17:50:26.596683+0000","last_clean":"2023-08-17T17:50:26.596683+0000","last_became_active":"2023-08-17T17:50:26.592675+0000","last_became_peered":"2023-08-17T17:50:26.592675+0000","last_unstale":"2023-08-17T17:50:26.596683+0000","last_undegraded":"2023-08-17T17:50:26.596683+0000","last_fullsized":"2023-08-17T17:50:26.596683+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.967080+0000","last_change":"2023-08-17T17:50:26.967080+0000","last_active":"2023-08-17T17:50:26.967080+0000","last_peered":"2023-08-17T17:50:26.967080+0000","last_clean":"2023-08-17T17:50:26.967080+0000","last_became_active":"2023-08-17T17:50:26.966765+0000","last_became_peered":"2023-08-17T17:50:26.966765+0000","last_unstale":"2023-08-17T17:50:26.967080+0000","last_undegraded":"2023-08-17T17:50:26.967080+0000","last_fullsized":"2023-08-17T17:50:26.967080+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609976+0000","last_change":"2023-08-17T17:50:26.604005+0000","last_active":"2023-08-17T17:50:26.609976+0000","last_peered":"2023-08-17T17:50:26.609976+0000","last_clean":"2023-08-17T17:50:26.609976+0000","last_became_active":"2023-08-17T17:50:26.603445+0000","last_became_peered":"2023-08-17T17:50:26.603445+0000","last_unstale":"2023-08-17T17:50:26.609976+0000","last_undegraded":"2023-08-17T17:50:26.609976+0000","last_fullsized":"2023-08-17T17:50:26.609976+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.960909+0000","last_change":"2023-08-17T17:50:26.960909+0000","last_active":"2023-08-17T17:50:26.960909+0000","last_peered":"2023-08-17T17:50:26.960909+0000","last_clean":"2023-08-17T17:50:26.960909+0000","last_became_active":"2023-08-17T17:50:26.960613+0000","last_became_peered":"2023-08-17T17:50:26.960613+0000","last_unstale":"2023-08-17T17:50:26.960909+0000","last_undegraded":"2023-08-17T17:50:26.960909+0000","last_fullsized":"2023-08-17T17:50:26.960909+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.601479+0000","last_change":"2023-08-17T17:50:26.597208+0000","last_active":"2023-08-17T17:50:26.601479+0000","last_peered":"2023-08-17T17:50:26.601479+0000","last_clean":"2023-08-17T17:50:26.601479+0000","last_became_active":"2023-08-17T17:50:26.596906+0000","last_became_peered":"2023-08-17T17:50:26.596906+0000","last_unstale":"2023-08-17T17:50:26.601479+0000","last_undegraded":"2023-08-17T17:50:26.601479+0000","last_fullsized":"2023-08-17T17:50:26.601479+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973152+0000","last_change":"2023-08-17T17:50:26.973152+0000","last_active":"2023-08-17T17:50:26.973152+0000","last_peered":"2023-08-17T17:50:26.973152+0000","last_clean":"2023-08-17T17:50:26.973152+0000","last_became_active":"2023-08-17T17:50:26.972840+0000","last_became_peered":"2023-08-17T17:50:26.972840+0000","last_unstale":"2023-08-17T17:50:26.973152+0000","last_undegraded":"2023-08-17T17:50:26.973152+0000","last_fullsized":"2023-08-17T17:50:26.973152+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.606707+0000","last_change":"2023-08-17T17:50:26.603857+0000","last_active":"2023-08-17T17:50:26.606707+0000","last_peered":"2023-08-17T17:50:26.606707+0000","last_clean":"2023-08-17T17:50:26.606707+0000","last_became_active":"2023-08-17T17:50:26.603557+0000","last_became_peered":"2023-08-17T17:50:26.603557+0000","last_unstale":"2023-08-17T17:50:26.606707+0000","last_undegraded":"2023-08-17T17:50:26.606707+0000","last_fullsized":"2023-08-17T17:50:26.606707+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.970759+0000","last_change":"2023-08-17T17:50:26.970759+0000","last_active":"2023-08-17T17:50:26.970759+0000","last_peered":"2023-08-17T17:50:26.970759+0000","last_clean":"2023-08-17T17:50:26.970759+0000","last_became_active":"2023-08-17T17:50:26.970486+0000","last_became_peered":"2023-08-17T17:50:26.970486+0000","last_unstale":"2023-08-17T17:50:26.970759+0000","last_undegraded":"2023-08-17T17:50:26.970759+0000","last_fullsized":"2023-08-17T17:50:26.970759+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.963574+0000","last_change":"2023-08-17T17:50:26.609268+0000","last_active":"2023-08-17T17:50:26.963574+0000","last_peered":"2023-08-17T17:50:26.963574+0000","last_clean":"2023-08-17T17:50:26.963574+0000","last_became_active":"2023-08-17T17:50:26.609007+0000","last_became_peered":"2023-08-17T17:50:26.609007+0000","last_unstale":"2023-08-17T17:50:26.963574+0000","last_undegraded":"2023-08-17T17:50:26.963574+0000","last_fullsized":"2023-08-17T17:50:26.963574+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966231+0000","last_change":"2023-08-17T17:50:26.966231+0000","last_active":"2023-08-17T17:50:26.966231+0000","last_peered":"2023-08-17T17:50:26.966231+0000","last_clean":"2023-08-17T17:50:26.966231+0000","last_became_active":"2023-08-17T17:50:26.964496+0000","last_became_peered":"2023-08-17T17:50:26.964496+0000","last_unstale":"2023-08-17T17:50:26.966231+0000","last_undegraded":"2023-08-17T17:50:26.966231+0000","last_fullsized":"2023-08-17T17:50:26.966231+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.956450+0000","last_change":"2023-08-17T17:50:26.600744+0000","last_active":"2023-08-17T17:50:26.956450+0000","last_peered":"2023-08-17T17:50:26.956450+0000","last_clean":"2023-08-17T17:50:26.956450+0000","last_became_active":"2023-08-17T17:50:26.600410+0000","last_became_peered":"2023-08-17T17:50:26.600410+0000","last_unstale":"2023-08-17T17:50:26.956450+0000","last_undegraded":"2023-08-17T17:50:26.956450+0000","last_fullsized":"2023-08-17T17:50:26.956450+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971897+0000","last_change":"2023-08-17T17:50:26.971897+0000","last_active":"2023-08-17T17:50:26.971897+0000","last_peered":"2023-08-17T17:50:26.971897+0000","last_clean":"2023-08-17T17:50:26.971897+0000","last_became_active":"2023-08-17T17:50:26.971601+0000","last_became_peered":"2023-08-17T17:50:26.971601+0000","last_unstale":"2023-08-17T17:50:26.971897+0000","last_undegraded":"2023-08-17T17:50:26.971897+0000","last_fullsized":"2023-08-17T17:50:26.971897+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"104'2","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.968021+0000","last_change":"2023-08-17T17:50:26.610491+0000","last_active":"2023-08-17T17:50:26.968021+0000","last_peered":"2023-08-17T17:50:26.968021+0000","last_clean":"2023-08-17T17:50:26.968021+0000","last_became_active":"2023-08-17T17:50:26.610125+0000","last_became_peered":"2023-08-17T17:50:26.610125+0000","last_unstale":"2023-08-17T17:50:26.968021+0000","last_undegraded":"2023-08-17T17:50:26.968021+0000","last_fullsized":"2023-08-17T17:50:26.968021+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966720+0000","last_change":"2023-08-17T17:50:26.966720+0000","last_active":"2023-08-17T17:50:26.966720+0000","last_peered":"2023-08-17T17:50:26.966720+0000","last_clean":"2023-08-17T17:50:26.966720+0000","last_became_active":"2023-08-17T17:50:26.966435+0000","last_became_peered":"2023-08-17T17:50:26.966435+0000","last_unstale":"2023-08-17T17:50:26.966720+0000","last_undegraded":"2023-08-17T17:50:26.966720+0000","last_fullsized":"2023-08-17T17:50:26.966720+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609785+0000","last_change":"2023-08-17T17:50:26.604032+0000","last_active":"2023-08-17T17:50:26.609785+0000","last_peered":"2023-08-17T17:50:26.609785+0000","last_clean":"2023-08-17T17:50:26.609785+0000","last_became_active":"2023-08-17T17:50:26.603746+0000","last_became_peered":"2023-08-17T17:50:26.603746+0000","last_unstale":"2023-08-17T17:50:26.609785+0000","last_undegraded":"2023-08-17T17:50:26.609785+0000","last_fullsized":"2023-08-17T17:50:26.609785+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.968027+0000","last_change":"2023-08-17T17:50:26.968027+0000","last_active":"2023-08-17T17:50:26.968027+0000","last_peered":"2023-08-17T17:50:26.968027+0000","last_clean":"2023-08-17T17:50:26.968027+0000","last_became_active":"2023-08-17T17:50:26.965680+0000","last_became_peered":"2023-08-17T17:50:26.965680+0000","last_unstale":"2023-08-17T17:50:26.968027+0000","last_undegraded":"2023-08-17T17:50:26.968027+0000","last_fullsized":"2023-08-17T17:50:26.968027+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.608946+0000","last_change":"2023-08-17T17:50:26.606729+0000","last_active":"2023-08-17T17:50:26.608946+0000","last_peered":"2023-08-17T17:50:26.608946+0000","last_clean":"2023-08-17T17:50:26.608946+0000","last_became_active":"2023-08-17T17:50:26.606444+0000","last_became_peered":"2023-08-17T17:50:26.606444+0000","last_unstale":"2023-08-17T17:50:26.608946+0000","last_undegraded":"2023-08-17T17:50:26.608946+0000","last_fullsized":"2023-08-17T17:50:26.608946+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.969552+0000","last_change":"2023-08-17T17:50:26.969552+0000","last_active":"2023-08-17T17:50:26.969552+0000","last_peered":"2023-08-17T17:50:26.969552+0000","last_clean":"2023-08-17T17:50:26.969552+0000","last_became_active":"2023-08-17T17:50:26.969297+0000","last_became_peered":"2023-08-17T17:50:26.969297+0000","last_unstale":"2023-08-17T17:50:26.969552+0000","last_undegraded":"2023-08-17T17:50:26.969552+0000","last_fullsized":"2023-08-17T17:50:26.969552+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609997+0000","last_change":"2023-08-17T17:50:26.606847+0000","last_active":"2023-08-17T17:50:26.609997+0000","last_peered":"2023-08-17T17:50:26.609997+0000","last_clean":"2023-08-17T17:50:26.609997+0000","last_became_active":"2023-08-17T17:50:26.606606+0000","last_became_peered":"2023-08-17T17:50:26.606606+0000","last_unstale":"2023-08-17T17:50:26.609997+0000","last_undegraded":"2023-08-17T17:50:26.609997+0000","last_fullsized":"2023-08-17T17:50:26.609997+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965879+0000","last_change":"2023-08-17T17:50:26.965879+0000","last_active":"2023-08-17T17:50:26.965879+0000","last_peered":"2023-08-17T17:50:26.965879+0000","last_clean":"2023-08-17T17:50:26.965879+0000","last_became_active":"2023-08-17T17:50:26.964396+0000","last_became_peered":"2023-08-17T17:50:26.964396+0000","last_unstale":"2023-08-17T17:50:26.965879+0000","last_undegraded":"2023-08-17T17:50:26.965879+0000","last_fullsized":"2023-08-17T17:50:26.965879+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609028+0000","last_change":"2023-08-17T17:50:26.598595+0000","last_active":"2023-08-17T17:50:26.609028+0000","last_peered":"2023-08-17T17:50:26.609028+0000","last_clean":"2023-08-17T17:50:26.609028+0000","last_became_active":"2023-08-17T17:50:26.597974+0000","last_became_peered":"2023-08-17T17:50:26.597974+0000","last_unstale":"2023-08-17T17:50:26.609028+0000","last_undegraded":"2023-08-17T17:50:26.609028+0000","last_fullsized":"2023-08-17T17:50:26.609028+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.974176+0000","last_change":"2023-08-17T17:50:26.974176+0000","last_active":"2023-08-17T17:50:26.974176+0000","last_peered":"2023-08-17T17:50:26.974176+0000","last_clean":"2023-08-17T17:50:26.974176+0000","last_became_active":"2023-08-17T17:50:26.973888+0000","last_became_peered":"2023-08-17T17:50:26.973888+0000","last_unstale":"2023-08-17T17:50:26.974176+0000","last_undegraded":"2023-08-17T17:50:26.974176+0000","last_fullsized":"2023-08-17T17:50:26.974176+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.613355+0000","last_change":"2023-08-17T17:50:26.609696+0000","last_active":"2023-08-17T17:50:26.613355+0000","last_peered":"2023-08-17T17:50:26.613355+0000","last_clean":"2023-08-17T17:50:26.613355+0000","last_became_active":"2023-08-17T17:50:26.609450+0000","last_became_peered":"2023-08-17T17:50:26.609450+0000","last_unstale":"2023-08-17T17:50:26.613355+0000","last_undegraded":"2023-08-17T17:50:26.613355+0000","last_fullsized":"2023-08-17T17:50:26.613355+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966329+0000","last_change":"2023-08-17T17:50:26.966329+0000","last_active":"2023-08-17T17:50:26.966329+0000","last_peered":"2023-08-17T17:50:26.966329+0000","last_clean":"2023-08-17T17:50:26.966329+0000","last_became_active":"2023-08-17T17:50:26.966029+0000","last_became_peered":"2023-08-17T17:50:26.966029+0000","last_unstale":"2023-08-17T17:50:26.966329+0000","last_undegraded":"2023-08-17T17:50:26.966329+0000","last_fullsized":"2023-08-17T17:50:26.966329+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.605765+0000","last_change":"2023-08-17T17:50:26.602039+0000","last_active":"2023-08-17T17:50:26.605765+0000","last_peered":"2023-08-17T17:50:26.605765+0000","last_clean":"2023-08-17T17:50:26.605765+0000","last_became_active":"2023-08-17T17:50:26.601757+0000","last_became_peered":"2023-08-17T17:50:26.601757+0000","last_unstale":"2023-08-17T17:50:26.605765+0000","last_undegraded":"2023-08-17T17:50:26.605765+0000","last_fullsized":"2023-08-17T17:50:26.605765+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.975110+0000","last_change":"2023-08-17T17:50:26.975110+0000","last_active":"2023-08-17T17:50:26.975110+0000","last_peered":"2023-08-17T17:50:26.975110+0000","last_clean":"2023-08-17T17:50:26.975110+0000","last_became_active":"2023-08-17T17:50:26.974860+0000","last_became_peered":"2023-08-17T17:50:26.974860+0000","last_unstale":"2023-08-17T17:50:26.975110+0000","last_undegraded":"2023-08-17T17:50:26.975110+0000","last_fullsized":"2023-08-17T17:50:26.975110+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609136+0000","last_change":"2023-08-17T17:50:26.598844+0000","last_active":"2023-08-17T17:50:26.609136+0000","last_peered":"2023-08-17T17:50:26.609136+0000","last_clean":"2023-08-17T17:50:26.609136+0000","last_became_active":"2023-08-17T17:50:26.598581+0000","last_became_peered":"2023-08-17T17:50:26.598581+0000","last_unstale":"2023-08-17T17:50:26.609136+0000","last_undegraded":"2023-08-17T17:50:26.609136+0000","last_fullsized":"2023-08-17T17:50:26.609136+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966567+0000","last_change":"2023-08-17T17:50:26.966567+0000","last_active":"2023-08-17T17:50:26.966567+0000","last_peered":"2023-08-17T17:50:26.966567+0000","last_clean":"2023-08-17T17:50:26.966567+0000","last_became_active":"2023-08-17T17:50:26.966270+0000","last_became_peered":"2023-08-17T17:50:26.966270+0000","last_unstale":"2023-08-17T17:50:26.966567+0000","last_undegraded":"2023-08-17T17:50:26.966567+0000","last_fullsized":"2023-08-17T17:50:26.966567+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"104'3","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973669+0000","last_change":"2023-08-17T17:50:26.600520+0000","last_active":"2023-08-17T17:50:26.973669+0000","last_peered":"2023-08-17T17:50:26.973669+0000","last_clean":"2023-08-17T17:50:26.973669+0000","last_became_active":"2023-08-17T17:50:26.600172+0000","last_became_peered":"2023-08-17T17:50:26.600172+0000","last_unstale":"2023-08-17T17:50:26.973669+0000","last_undegraded":"2023-08-17T17:50:26.973669+0000","last_fullsized":"2023-08-17T17:50:26.973669+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.960061+0000","last_change":"2023-08-17T17:50:26.960061+0000","last_active":"2023-08-17T17:50:26.960061+0000","last_peered":"2023-08-17T17:50:26.960061+0000","last_clean":"2023-08-17T17:50:26.960061+0000","last_became_active":"2023-08-17T17:50:26.959812+0000","last_became_peered":"2023-08-17T17:50:26.959812+0000","last_unstale":"2023-08-17T17:50:26.960061+0000","last_undegraded":"2023-08-17T17:50:26.960061+0000","last_fullsized":"2023-08-17T17:50:26.960061+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"104'2","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966311+0000","last_change":"2023-08-17T17:50:26.599586+0000","last_active":"2023-08-17T17:50:26.966311+0000","last_peered":"2023-08-17T17:50:26.966311+0000","last_clean":"2023-08-17T17:50:26.966311+0000","last_became_active":"2023-08-17T17:50:26.599322+0000","last_became_peered":"2023-08-17T17:50:26.599322+0000","last_unstale":"2023-08-17T17:50:26.966311+0000","last_undegraded":"2023-08-17T17:50:26.966311+0000","last_fullsized":"2023-08-17T17:50:26.966311+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.969603+0000","last_change":"2023-08-17T17:50:26.969603+0000","last_active":"2023-08-17T17:50:26.969603+0000","last_peered":"2023-08-17T17:50:26.969603+0000","last_clean":"2023-08-17T17:50:26.969603+0000","last_became_active":"2023-08-17T17:50:26.968570+0000","last_became_peered":"2023-08-17T17:50:26.968570+0000","last_unstale":"2023-08-17T17:50:26.969603+0000","last_undegraded":"2023-08-17T17:50:26.969603+0000","last_fullsized":"2023-08-17T17:50:26.969603+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965124+0000","last_change":"2023-08-17T17:50:26.609759+0000","last_active":"2023-08-17T17:50:26.965124+0000","last_peered":"2023-08-17T17:50:26.965124+0000","last_clean":"2023-08-17T17:50:26.965124+0000","last_became_active":"2023-08-17T17:50:26.609448+0000","last_became_peered":"2023-08-17T17:50:26.609448+0000","last_unstale":"2023-08-17T17:50:26.965124+0000","last_undegraded":"2023-08-17T17:50:26.965124+0000","last_fullsized":"2023-08-17T17:50:26.965124+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.964938+0000","last_change":"2023-08-17T17:50:26.964938+0000","last_active":"2023-08-17T17:50:26.964938+0000","last_peered":"2023-08-17T17:50:26.964938+0000","last_clean":"2023-08-17T17:50:26.964938+0000","last_became_active":"2023-08-17T17:50:26.964662+0000","last_became_peered":"2023-08-17T17:50:26.964662+0000","last_unstale":"2023-08-17T17:50:26.964938+0000","last_undegraded":"2023-08-17T17:50:26.964938+0000","last_fullsized":"2023-08-17T17:50:26.964938+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609212+0000","last_change":"2023-08-17T17:50:26.600783+0000","last_active":"2023-08-17T17:50:26.609212+0000","last_peered":"2023-08-17T17:50:26.609212+0000","last_clean":"2023-08-17T17:50:26.609212+0000","last_became_active":"2023-08-17T17:50:26.597137+0000","last_became_peered":"2023-08-17T17:50:26.597137+0000","last_unstale":"2023-08-17T17:50:26.609212+0000","last_undegraded":"2023-08-17T17:50:26.609212+0000","last_fullsized":"2023-08-17T17:50:26.609212+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972068+0000","last_change":"2023-08-17T17:50:26.972068+0000","last_active":"2023-08-17T17:50:26.972068+0000","last_peered":"2023-08-17T17:50:26.972068+0000","last_clean":"2023-08-17T17:50:26.972068+0000","last_became_active":"2023-08-17T17:50:26.971776+0000","last_became_peered":"2023-08-17T17:50:26.971776+0000","last_unstale":"2023-08-17T17:50:26.972068+0000","last_undegraded":"2023-08-17T17:50:26.972068+0000","last_fullsized":"2023-08-17T17:50:26.972068+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609741+0000","last_change":"2023-08-17T17:50:26.603507+0000","last_active":"2023-08-17T17:50:26.609741+0000","last_peered":"2023-08-17T17:50:26.609741+0000","last_clean":"2023-08-17T17:50:26.609741+0000","last_became_active":"2023-08-17T17:50:26.603225+0000","last_became_peered":"2023-08-17T17:50:26.603225+0000","last_unstale":"2023-08-17T17:50:26.609741+0000","last_undegraded":"2023-08-17T17:50:26.609741+0000","last_fullsized":"2023-08-17T17:50:26.609741+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972726+0000","last_change":"2023-08-17T17:50:26.972726+0000","last_active":"2023-08-17T17:50:26.972726+0000","last_peered":"2023-08-17T17:50:26.972726+0000","last_clean":"2023-08-17T17:50:26.972726+0000","last_became_active":"2023-08-17T17:50:26.972434+0000","last_became_peered":"2023-08-17T17:50:26.972434+0000","last_unstale":"2023-08-17T17:50:26.972726+0000","last_undegraded":"2023-08-17T17:50:26.972726+0000","last_fullsized":"2023-08-17T17:50:26.972726+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"104'4","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.964301+0000","last_change":"2023-08-17T17:50:26.596640+0000","last_active":"2023-08-17T17:50:26.964301+0000","last_peered":"2023-08-17T17:50:26.964301+0000","last_clean":"2023-08-17T17:50:26.964301+0000","last_became_active":"2023-08-17T17:50:26.595904+0000","last_became_peered":"2023-08-17T17:50:26.595904+0000","last_unstale":"2023-08-17T17:50:26.964301+0000","last_undegraded":"2023-08-17T17:50:26.964301+0000","last_fullsized":"2023-08-17T17:50:26.964301+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.970467+0000","last_change":"2023-08-17T17:50:26.970467+0000","last_active":"2023-08-17T17:50:26.970467+0000","last_peered":"2023-08-17T17:50:26.970467+0000","last_clean":"2023-08-17T17:50:26.970467+0000","last_became_active":"2023-08-17T17:50:26.970186+0000","last_became_peered":"2023-08-17T17:50:26.970186+0000","last_unstale":"2023-08-17T17:50:26.970467+0000","last_undegraded":"2023-08-17T17:50:26.970467+0000","last_fullsized":"2023-08-17T17:50:26.970467+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"104'2","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.975223+0000","last_change":"2023-08-17T17:50:26.605483+0000","last_active":"2023-08-17T17:50:26.975223+0000","last_peered":"2023-08-17T17:50:26.975223+0000","last_clean":"2023-08-17T17:50:26.975223+0000","last_became_active":"2023-08-17T17:50:26.605053+0000","last_became_peered":"2023-08-17T17:50:26.605053+0000","last_unstale":"2023-08-17T17:50:26.975223+0000","last_undegraded":"2023-08-17T17:50:26.975223+0000","last_fullsized":"2023-08-17T17:50:26.975223+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.977731+0000","last_change":"2023-08-17T17:50:26.977731+0000","last_active":"2023-08-17T17:50:26.977731+0000","last_peered":"2023-08-17T17:50:26.977731+0000","last_clean":"2023-08-17T17:50:26.977731+0000","last_became_active":"2023-08-17T17:50:26.977505+0000","last_became_peered":"2023-08-17T17:50:26.977505+0000","last_unstale":"2023-08-17T17:50:26.977731+0000","last_undegraded":"2023-08-17T17:50:26.977731+0000","last_fullsized":"2023-08-17T17:50:26.977731+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.601185+0000","last_change":"2023-08-17T17:50:26.595153+0000","last_active":"2023-08-17T17:50:26.601185+0000","last_peered":"2023-08-17T17:50:26.601185+0000","last_clean":"2023-08-17T17:50:26.601185+0000","last_became_active":"2023-08-17T17:50:26.594838+0000","last_became_peered":"2023-08-17T17:50:26.594838+0000","last_unstale":"2023-08-17T17:50:26.601185+0000","last_undegraded":"2023-08-17T17:50:26.601185+0000","last_fullsized":"2023-08-17T17:50:26.601185+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965724+0000","last_change":"2023-08-17T17:50:26.965724+0000","last_active":"2023-08-17T17:50:26.965724+0000","last_peered":"2023-08-17T17:50:26.965724+0000","last_clean":"2023-08-17T17:50:26.965724+0000","last_became_active":"2023-08-17T17:50:26.965486+0000","last_became_peered":"2023-08-17T17:50:26.965486+0000","last_unstale":"2023-08-17T17:50:26.965724+0000","last_undegraded":"2023-08-17T17:50:26.965724+0000","last_fullsized":"2023-08-17T17:50:26.965724+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.608714+0000","last_change":"2023-08-17T17:50:26.604392+0000","last_active":"2023-08-17T17:50:26.608714+0000","last_peered":"2023-08-17T17:50:26.608714+0000","last_clean":"2023-08-17T17:50:26.608714+0000","last_became_active":"2023-08-17T17:50:26.604096+0000","last_became_peered":"2023-08-17T17:50:26.604096+0000","last_unstale":"2023-08-17T17:50:26.608714+0000","last_undegraded":"2023-08-17T17:50:26.608714+0000","last_fullsized":"2023-08-17T17:50:26.608714+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972497+0000","last_change":"2023-08-17T17:50:26.972497+0000","last_active":"2023-08-17T17:50:26.972497+0000","last_peered":"2023-08-17T17:50:26.972497+0000","last_clean":"2023-08-17T17:50:26.972497+0000","last_became_active":"2023-08-17T17:50:26.972207+0000","last_became_peered":"2023-08-17T17:50:26.972207+0000","last_unstale":"2023-08-17T17:50:26.972497+0000","last_undegraded":"2023-08-17T17:50:26.972497+0000","last_fullsized":"2023-08-17T17:50:26.972497+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.611710+0000","last_change":"2023-08-17T17:50:26.608024+0000","last_active":"2023-08-17T17:50:26.611710+0000","last_peered":"2023-08-17T17:50:26.611710+0000","last_clean":"2023-08-17T17:50:26.611710+0000","last_became_active":"2023-08-17T17:50:26.607740+0000","last_became_peered":"2023-08-17T17:50:26.607740+0000","last_unstale":"2023-08-17T17:50:26.611710+0000","last_undegraded":"2023-08-17T17:50:26.611710+0000","last_fullsized":"2023-08-17T17:50:26.611710+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973179+0000","last_change":"2023-08-17T17:50:26.973179+0000","last_active":"2023-08-17T17:50:26.973179+0000","last_peered":"2023-08-17T17:50:26.973179+0000","last_clean":"2023-08-17T17:50:26.973179+0000","last_became_active":"2023-08-17T17:50:26.972859+0000","last_became_peered":"2023-08-17T17:50:26.972859+0000","last_unstale":"2023-08-17T17:50:26.973179+0000","last_undegraded":"2023-08-17T17:50:26.973179+0000","last_fullsized":"2023-08-17T17:50:26.973179+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609074+0000","last_change":"2023-08-17T17:50:26.601003+0000","last_active":"2023-08-17T17:50:26.609074+0000","last_peered":"2023-08-17T17:50:26.609074+0000","last_clean":"2023-08-17T17:50:26.609074+0000","last_became_active":"2023-08-17T17:50:26.597182+0000","last_became_peered":"2023-08-17T17:50:26.597182+0000","last_unstale":"2023-08-17T17:50:26.609074+0000","last_undegraded":"2023-08-17T17:50:26.609074+0000","last_fullsized":"2023-08-17T17:50:26.609074+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.959398+0000","last_change":"2023-08-17T17:50:26.959398+0000","last_active":"2023-08-17T17:50:26.959398+0000","last_peered":"2023-08-17T17:50:26.959398+0000","last_clean":"2023-08-17T17:50:26.959398+0000","last_became_active":"2023-08-17T17:50:26.959150+0000","last_became_peered":"2023-08-17T17:50:26.959150+0000","last_unstale":"2023-08-17T17:50:26.959398+0000","last_undegraded":"2023-08-17T17:50:26.959398+0000","last_fullsized":"2023-08-17T17:50:26.959398+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.600057+0000","last_change":"2023-08-17T17:50:26.593550+0000","last_active":"2023-08-17T17:50:26.600057+0000","last_peered":"2023-08-17T17:50:26.600057+0000","last_clean":"2023-08-17T17:50:26.600057+0000","last_became_active":"2023-08-17T17:50:26.593193+0000","last_became_peered":"2023-08-17T17:50:26.593193+0000","last_unstale":"2023-08-17T17:50:26.600057+0000","last_undegraded":"2023-08-17T17:50:26.600057+0000","last_fullsized":"2023-08-17T17:50:26.600057+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971611+0000","last_change":"2023-08-17T17:50:26.971611+0000","last_active":"2023-08-17T17:50:26.971611+0000","last_peered":"2023-08-17T17:50:26.971611+0000","last_clean":"2023-08-17T17:50:26.971611+0000","last_became_active":"2023-08-17T17:50:26.971336+0000","last_became_peered":"2023-08-17T17:50:26.971336+0000","last_unstale":"2023-08-17T17:50:26.971611+0000","last_undegraded":"2023-08-17T17:50:26.971611+0000","last_fullsized":"2023-08-17T17:50:26.971611+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.613632+0000","last_change":"2023-08-17T17:50:26.611983+0000","last_active":"2023-08-17T17:50:26.613632+0000","last_peered":"2023-08-17T17:50:26.613632+0000","last_clean":"2023-08-17T17:50:26.613632+0000","last_became_active":"2023-08-17T17:50:26.611774+0000","last_became_peered":"2023-08-17T17:50:26.611774+0000","last_unstale":"2023-08-17T17:50:26.613632+0000","last_undegraded":"2023-08-17T17:50:26.613632+0000","last_fullsized":"2023-08-17T17:50:26.613632+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.963217+0000","last_change":"2023-08-17T17:50:26.963217+0000","last_active":"2023-08-17T17:50:26.963217+0000","last_peered":"2023-08-17T17:50:26.963217+0000","last_clean":"2023-08-17T17:50:26.963217+0000","last_became_active":"2023-08-17T17:50:26.962914+0000","last_became_peered":"2023-08-17T17:50:26.962914+0000","last_unstale":"2023-08-17T17:50:26.963217+0000","last_undegraded":"2023-08-17T17:50:26.963217+0000","last_fullsized":"2023-08-17T17:50:26.963217+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.605834+0000","last_change":"2023-08-17T17:50:26.603169+0000","last_active":"2023-08-17T17:50:26.605834+0000","last_peered":"2023-08-17T17:50:26.605834+0000","last_clean":"2023-08-17T17:50:26.605834+0000","last_became_active":"2023-08-17T17:50:26.602904+0000","last_became_peered":"2023-08-17T17:50:26.602904+0000","last_unstale":"2023-08-17T17:50:26.605834+0000","last_undegraded":"2023-08-17T17:50:26.605834+0000","last_fullsized":"2023-08-17T17:50:26.605834+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.961496+0000","last_change":"2023-08-17T17:50:26.961496+0000","last_active":"2023-08-17T17:50:26.961496+0000","last_peered":"2023-08-17T17:50:26.961496+0000","last_clean":"2023-08-17T17:50:26.961496+0000","last_became_active":"2023-08-17T17:50:26.961301+0000","last_became_peered":"2023-08-17T17:50:26.961301+0000","last_unstale":"2023-08-17T17:50:26.961496+0000","last_undegraded":"2023-08-17T17:50:26.961496+0000","last_fullsized":"2023-08-17T17:50:26.961496+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.956645+0000","last_change":"2023-08-17T17:50:26.595239+0000","last_active":"2023-08-17T17:50:26.956645+0000","last_peered":"2023-08-17T17:50:26.956645+0000","last_clean":"2023-08-17T17:50:26.956645+0000","last_became_active":"2023-08-17T17:50:26.594928+0000","last_became_peered":"2023-08-17T17:50:26.594928+0000","last_unstale":"2023-08-17T17:50:26.956645+0000","last_undegraded":"2023-08-17T17:50:26.956645+0000","last_fullsized":"2023-08-17T17:50:26.956645+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.584778+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:50:26.584778+0000","last_peered":"2023-08-17T17:50:26.584778+0000","last_clean":"2023-08-17T17:50:26.584778+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:50:26.584778+0000","last_undegraded":"2023-08-17T17:50:26.584778+0000","last_fullsized":"2023-08-17T17:50:26.584778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972734+0000","last_change":"2023-08-17T17:50:26.972734+0000","last_active":"2023-08-17T17:50:26.972734+0000","last_peered":"2023-08-17T17:50:26.972734+0000","last_clean":"2023-08-17T17:50:26.972734+0000","last_became_active":"2023-08-17T17:50:26.970914+0000","last_became_peered":"2023-08-17T17:50:26.970914+0000","last_unstale":"2023-08-17T17:50:26.972734+0000","last_undegraded":"2023-08-17T17:50:26.972734+0000","last_fullsized":"2023-08-17T17:50:26.972734+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.604173+0000","last_change":"2023-08-17T17:50:26.600966+0000","last_active":"2023-08-17T17:50:26.604173+0000","last_peered":"2023-08-17T17:50:26.604173+0000","last_clean":"2023-08-17T17:50:26.604173+0000","last_became_active":"2023-08-17T17:50:26.600565+0000","last_became_peered":"2023-08-17T17:50:26.600565+0000","last_unstale":"2023-08-17T17:50:26.604173+0000","last_undegraded":"2023-08-17T17:50:26.604173+0000","last_fullsized":"2023-08-17T17:50:26.604173+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.589145+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:50:26.589145+0000","last_peered":"2023-08-17T17:50:26.589145+0000","last_clean":"2023-08-17T17:50:26.589145+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:50:26.589145+0000","last_undegraded":"2023-08-17T17:50:26.589145+0000","last_fullsized":"2023-08-17T17:50:26.589145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973626+0000","last_change":"2023-08-17T17:50:26.973626+0000","last_active":"2023-08-17T17:50:26.973626+0000","last_peered":"2023-08-17T17:50:26.973626+0000","last_clean":"2023-08-17T17:50:26.973626+0000","last_became_active":"2023-08-17T17:50:26.973218+0000","last_became_peered":"2023-08-17T17:50:26.973218+0000","last_unstale":"2023-08-17T17:50:26.973626+0000","last_undegraded":"2023-08-17T17:50:26.973626+0000","last_fullsized":"2023-08-17T17:50:26.973626+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"104'2","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.968743+0000","last_change":"2023-08-17T17:50:26.602841+0000","last_active":"2023-08-17T17:50:26.968743+0000","last_peered":"2023-08-17T17:50:26.968743+0000","last_clean":"2023-08-17T17:50:26.968743+0000","last_became_active":"2023-08-17T17:50:26.602288+0000","last_became_peered":"2023-08-17T17:50:26.602288+0000","last_unstale":"2023-08-17T17:50:26.968743+0000","last_undegraded":"2023-08-17T17:50:26.968743+0000","last_fullsized":"2023-08-17T17:50:26.968743+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.588523+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:50:26.588523+0000","last_peered":"2023-08-17T17:50:26.588523+0000","last_clean":"2023-08-17T17:50:26.588523+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:50:26.588523+0000","last_undegraded":"2023-08-17T17:50:26.588523+0000","last_fullsized":"2023-08-17T17:50:26.588523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972365+0000","last_change":"2023-08-17T17:50:26.972365+0000","last_active":"2023-08-17T17:50:26.972365+0000","last_peered":"2023-08-17T17:50:26.972365+0000","last_clean":"2023-08-17T17:50:26.972365+0000","last_became_active":"2023-08-17T17:50:26.971992+0000","last_became_peered":"2023-08-17T17:50:26.971992+0000","last_unstale":"2023-08-17T17:50:26.972365+0000","last_undegraded":"2023-08-17T17:50:26.972365+0000","last_fullsized":"2023-08-17T17:50:26.972365+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.599733+0000","last_change":"2023-08-17T17:50:26.592980+0000","last_active":"2023-08-17T17:50:26.599733+0000","last_peered":"2023-08-17T17:50:26.599733+0000","last_clean":"2023-08-17T17:50:26.599733+0000","last_became_active":"2023-08-17T17:50:26.592715+0000","last_became_peered":"2023-08-17T17:50:26.592715+0000","last_unstale":"2023-08-17T17:50:26.599733+0000","last_undegraded":"2023-08-17T17:50:26.599733+0000","last_fullsized":"2023-08-17T17:50:26.599733+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.587351+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:50:26.587351+0000","last_peered":"2023-08-17T17:50:26.587351+0000","last_clean":"2023-08-17T17:50:26.587351+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:50:26.587351+0000","last_undegraded":"2023-08-17T17:50:26.587351+0000","last_fullsized":"2023-08-17T17:50:26.587351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.596113+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:50:26.596113+0000","last_peered":"2023-08-17T17:50:26.596113+0000","last_clean":"2023-08-17T17:50:26.596113+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:50:26.596113+0000","last_undegraded":"2023-08-17T17:50:26.596113+0000","last_fullsized":"2023-08-17T17:50:26.596113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972484+0000","last_change":"2023-08-17T17:50:26.972484+0000","last_active":"2023-08-17T17:50:26.972484+0000","last_peered":"2023-08-17T17:50:26.972484+0000","last_clean":"2023-08-17T17:50:26.972484+0000","last_became_active":"2023-08-17T17:50:26.972182+0000","last_became_peered":"2023-08-17T17:50:26.972182+0000","last_unstale":"2023-08-17T17:50:26.972484+0000","last_undegraded":"2023-08-17T17:50:26.972484+0000","last_fullsized":"2023-08-17T17:50:26.972484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.963448+0000","last_change":"2023-08-17T17:50:26.603423+0000","last_active":"2023-08-17T17:50:26.963448+0000","last_peered":"2023-08-17T17:50:26.963448+0000","last_clean":"2023-08-17T17:50:26.963448+0000","last_became_active":"2023-08-17T17:50:26.603076+0000","last_became_peered":"2023-08-17T17:50:26.603076+0000","last_unstale":"2023-08-17T17:50:26.963448+0000","last_undegraded":"2023-08-17T17:50:26.963448+0000","last_fullsized":"2023-08-17T17:50:26.963448+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.599093+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:50:26.599093+0000","last_peered":"2023-08-17T17:50:26.599093+0000","last_clean":"2023-08-17T17:50:26.599093+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:50:26.599093+0000","last_undegraded":"2023-08-17T17:50:26.599093+0000","last_fullsized":"2023-08-17T17:50:26.599093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.967174+0000","last_change":"2023-08-17T17:50:26.967174+0000","last_active":"2023-08-17T17:50:26.967174+0000","last_peered":"2023-08-17T17:50:26.967174+0000","last_clean":"2023-08-17T17:50:26.967174+0000","last_became_active":"2023-08-17T17:50:26.966917+0000","last_became_peered":"2023-08-17T17:50:26.966917+0000","last_unstale":"2023-08-17T17:50:26.967174+0000","last_undegraded":"2023-08-17T17:50:26.967174+0000","last_fullsized":"2023-08-17T17:50:26.967174+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609827+0000","last_change":"2023-08-17T17:50:26.603032+0000","last_active":"2023-08-17T17:50:26.609827+0000","last_peered":"2023-08-17T17:50:26.609827+0000","last_clean":"2023-08-17T17:50:26.609827+0000","last_became_active":"2023-08-17T17:50:26.602587+0000","last_became_peered":"2023-08-17T17:50:26.602587+0000","last_unstale":"2023-08-17T17:50:26.609827+0000","last_undegraded":"2023-08-17T17:50:26.609827+0000","last_fullsized":"2023-08-17T17:50:26.609827+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.597755+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:50:26.597755+0000","last_peered":"2023-08-17T17:50:26.597755+0000","last_clean":"2023-08-17T17:50:26.597755+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:50:26.597755+0000","last_undegraded":"2023-08-17T17:50:26.597755+0000","last_fullsized":"2023-08-17T17:50:26.597755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.962931+0000","last_change":"2023-08-17T17:50:26.962931+0000","last_active":"2023-08-17T17:50:26.962931+0000","last_peered":"2023-08-17T17:50:26.962931+0000","last_clean":"2023-08-17T17:50:26.962931+0000","last_became_active":"2023-08-17T17:50:26.962652+0000","last_became_peered":"2023-08-17T17:50:26.962652+0000","last_unstale":"2023-08-17T17:50:26.962931+0000","last_undegraded":"2023-08-17T17:50:26.962931+0000","last_fullsized":"2023-08-17T17:50:26.962931+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.600852+0000","last_change":"2023-08-17T17:50:26.595464+0000","last_active":"2023-08-17T17:50:26.600852+0000","last_peered":"2023-08-17T17:50:26.600852+0000","last_clean":"2023-08-17T17:50:26.600852+0000","last_became_active":"2023-08-17T17:50:26.595174+0000","last_became_peered":"2023-08-17T17:50:26.595174+0000","last_unstale":"2023-08-17T17:50:26.600852+0000","last_undegraded":"2023-08-17T17:50:26.600852+0000","last_fullsized":"2023-08-17T17:50:26.600852+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.584495+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:50:26.584495+0000","last_peered":"2023-08-17T17:50:26.584495+0000","last_clean":"2023-08-17T17:50:26.584495+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:50:26.584495+0000","last_undegraded":"2023-08-17T17:50:26.584495+0000","last_fullsized":"2023-08-17T17:50:26.584495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965479+0000","last_change":"2023-08-17T17:50:26.965479+0000","last_active":"2023-08-17T17:50:26.965479+0000","last_peered":"2023-08-17T17:50:26.965479+0000","last_clean":"2023-08-17T17:50:26.965479+0000","last_became_active":"2023-08-17T17:50:26.965210+0000","last_became_peered":"2023-08-17T17:50:26.965210+0000","last_unstale":"2023-08-17T17:50:26.965479+0000","last_undegraded":"2023-08-17T17:50:26.965479+0000","last_fullsized":"2023-08-17T17:50:26.965479+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609924+0000","last_change":"2023-08-17T17:50:26.606171+0000","last_active":"2023-08-17T17:50:26.609924+0000","last_peered":"2023-08-17T17:50:26.609924+0000","last_clean":"2023-08-17T17:50:26.609924+0000","last_became_active":"2023-08-17T17:50:26.602191+0000","last_became_peered":"2023-08-17T17:50:26.602191+0000","last_unstale":"2023-08-17T17:50:26.609924+0000","last_undegraded":"2023-08-17T17:50:26.609924+0000","last_fullsized":"2023-08-17T17:50:26.609924+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.593730+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:50:26.593730+0000","last_peered":"2023-08-17T17:50:26.593730+0000","last_clean":"2023-08-17T17:50:26.593730+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:50:26.593730+0000","last_undegraded":"2023-08-17T17:50:26.593730+0000","last_fullsized":"2023-08-17T17:50:26.593730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575041,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302416,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069424,"statfs":{"total":96636764160,"available":96327090176,"internally_reserved":0,"allocated":1253376,"data_stored":616200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.61899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.496},{"interface":"front","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.504}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.69299999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77500000000000002,"15min":0.80000000000000004},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63200000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":1.23,"15min":1.23},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.64500000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.439},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.75700000000000001,"15min":0.95999999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73199999999999998,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72699999999999998,"5min":0.79400000000000004,"15min":0.90200000000000002},"last":0.52900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302416,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069424,"statfs":{"total":96636764160,"available":96327090176,"internally_reserved":0,"allocated":1253376,"data_stored":616200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85599999999999998,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66700000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.755,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.65700000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.503}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.879,"15min":1.0609999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.60299999999999998},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80100000000000005,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.26800000000000002},"max":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.432},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.77300000000000002,"15min":1.026},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.34200000000000003},"max":{"1min":0.81299999999999994,"5min":1.51,"15min":1.51},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.872,"15min":1.0740000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.56699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":1265664,"data_stored":622879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47099999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.378,"15min":0.373},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.308},{"interface":"front","average":{"1min":0.377,"5min":0.40400000000000003,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.60399999999999998,"5min":0.625,"15min":0.66600000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40899999999999997,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.53600000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.624,"15min":0.622},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":1.2989999999999999,"15min":1.331},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.374}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2629999999999999,"15min":1.345},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.433}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83599999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.48899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":1265664,"data_stored":622879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52600000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.312},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.65200000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.66200000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.65700000000000003},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.97999999999999998,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.499},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.432},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.87,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.88300000000000001,"5min":1.677,"15min":1.677},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.087,"5min":1.51,"15min":1.51},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0069999999999999,"5min":1.325,"15min":1.391},"last":0.52800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89600000000000002,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.544},"last":0.57099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302416,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069424,"statfs":{"total":96636764160,"available":96327090176,"internally_reserved":0,"allocated":1253376,"data_stored":616200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.49399999999999999,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45200000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.40100000000000002},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51800000000000002,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54800000000000004,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.311,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.52300000000000002,"5min":1.268,"15min":1.268},"last":0.375},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.308}]},{"osd":4,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.98799999999999999,"5min":1.417,"15min":1.417},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2869999999999999,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.2629999999999999,"5min":1.544,"15min":1.544},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":1.232,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0840000000000001,"5min":1.415,"15min":1.415},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68500000000000005,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88600000000000001,"5min":2.984,"15min":2.984},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302416,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069424,"statfs":{"total":96636764160,"available":96327090176,"internally_reserved":0,"allocated":1253376,"data_stored":616200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":0.45700000000000002,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.245,"5min":0.245,"15min":0.224},"max":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.71799999999999997},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.378},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.39200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":0.54600000000000004,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.31}]},{"osd":2,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.317},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.439,"15min":0.42399999999999999},"min":{"1min":0.32200000000000001,"5min":0.245,"15min":0.245},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.26200000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.89000000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1989999999999998,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.626,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.442}]},{"osd":6,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.466,"15min":1.466},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.505}]},{"osd":7,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.48,"15min":1.48},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"max":{"1min":3.4780000000000002,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.45000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":1265664,"data_stored":622879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.379}]},{"osd":1,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.012,"5min":1.252,"15min":1.252},"last":0.5},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.47799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.28199999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66500000000000004,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.745},{"interface":"front","average":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.373,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.91900000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78000000000000003,"5min":0.877,"15min":1.056},"last":0.78000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302416,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069424,"statfs":{"total":96636764160,"available":96327090176,"internally_reserved":0,"allocated":1253376,"data_stored":616200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.27700000000000002},"max":{"1min":0.66300000000000003,"5min":1.165,"15min":1.2609999999999999},"last":0.441},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.31},"max":{"1min":0.627,"5min":1.022,"15min":1.1499999999999999},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.29599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.242},"last":0.495},{"interface":"front","average":{"1min":0.495,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":1.0580000000000001,"15min":1.252},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":1.153,"15min":1.274},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.379},"max":{"1min":0.68799999999999994,"5min":1.0920000000000001,"15min":1.179},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.3080000000000001},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.747,"5min":0.75,"15min":1.0620000000000001},"last":0.62},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.497,"15min":0.495},"min":{"1min":0.314,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":0.78300000000000003,"15min":1.0740000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":1.01},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.1020000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.73599999999999999,"5min":0.82299999999999995,"15min":1.038},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.1279999999999999},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:50:29.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:50:30.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.086+0000 7f0256764700 1 Processor -- start 2023-08-17T17:50:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.086+0000 7f0256764700 1 -- start start 2023-08-17T17:50:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f0256764700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0250134ff0 0x7f02501353d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f0256764700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02500624f0 0x7f02500629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f0256764700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0250152b50 0x7f0250152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f0256764700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0250066d50 con 0x7f0250134ff0 2023-08-17T17:50:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f0256764700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025006a060 con 0x7f02500624f0 2023-08-17T17:50:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f0256764700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0250069050 con 0x7f0250152b50 2023-08-17T17:50:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f024ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0250134ff0 0x7f02501353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f024ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0250134ff0 0x7f02501353d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37042/0 (socket says 172.21.15.78:37042) 2023-08-17T17:50:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f024ffff700 1 -- 172.21.15.78:0/3197413772 learned_addr learned my addr 172.21.15.78:0/3197413772 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f0254d01700 1 --2- 172.21.15.78:0/3197413772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0250152b50 0x7f0250152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.087+0000 7f024f7fe700 1 --2- 172.21.15.78:0/3197413772 >> v2:172.21.15.150:3300/0 conn(0x7f02500624f0 0x7f02500629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f024ffff700 1 -- 172.21.15.78:0/3197413772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0250152b50 msgr2=0x7f0250152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f024ffff700 1 --2- 172.21.15.78:0/3197413772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0250152b50 0x7f0250152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f024ffff700 1 -- 172.21.15.78:0/3197413772 >> v2:172.21.15.150:3300/0 conn(0x7f02500624f0 msgr2=0x7f02500629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f024ffff700 1 --2- 172.21.15.78:0/3197413772 >> v2:172.21.15.150:3300/0 conn(0x7f02500624f0 0x7f02500629a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f024ffff700 1 -- 172.21.15.78:0/3197413772 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250062e90 con 0x7f0250134ff0 2023-08-17T17:50:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f024ffff700 1 --2- 172.21.15.78:0/3197413772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0250134ff0 0x7f02501353d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f025014ce90 tx=0x7f02400090f0).ready entity=mon.0 client_cookie=bc405ed2db243048 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f024effd700 1 -- 172.21.15.78:0/3197413772 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000b600 con 0x7f0250134ff0 2023-08-17T17:50:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f024effd700 1 -- 172.21.15.78:0/3197413772 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024000b760 con 0x7f0250134ff0 2023-08-17T17:50:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f024effd700 1 -- 172.21.15.78:0/3197413772 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000bae0 con 0x7f0250134ff0 2023-08-17T17:50:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f0256764700 1 -- 172.21.15.78:0/3197413772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0250134ff0 msgr2=0x7f02501353d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f0256764700 1 --2- 172.21.15.78:0/3197413772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0250134ff0 0x7f02501353d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f025014ce90 tx=0x7f02400090f0).stop 2023-08-17T17:50:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f0256764700 1 -- 172.21.15.78:0/3197413772 shutdown_connections 2023-08-17T17:50:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f0256764700 1 --2- 172.21.15.78:0/3197413772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0250134ff0 0x7f02501353d0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f0256764700 1 --2- 172.21.15.78:0/3197413772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0250152b50 0x7f0250152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f0256764700 1 --2- 172.21.15.78:0/3197413772 >> v2:172.21.15.150:3300/0 conn(0x7f02500624f0 0x7f02500629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.088+0000 7f0256764700 1 -- 172.21.15.78:0/3197413772 >> 172.21.15.78:0/3197413772 conn(0x7f02500c7b00 msgr2=0x7f02500c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.089+0000 7f0256764700 1 -- 172.21.15.78:0/3197413772 shutdown_connections 2023-08-17T17:50:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.089+0000 7f0256764700 1 -- 172.21.15.78:0/3197413772 wait complete. 2023-08-17T17:50:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.090+0000 7f0256764700 1 Processor -- start 2023-08-17T17:50:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.090+0000 7f0256764700 1 -- start start 2023-08-17T17:50:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0256764700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02500624f0 0x7f0250134760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0256764700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0250134ff0 0x7f02500ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0256764700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0250152b50 0x7f02500acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0256764700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02501622e0 con 0x7f02500624f0 2023-08-17T17:50:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0256764700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02500ad190 con 0x7f0250134ff0 2023-08-17T17:50:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0256764700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0250138bb0 con 0x7f0250152b50 2023-08-17T17:50:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f024ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02500624f0 0x7f0250134760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f024ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02500624f0 0x7f0250134760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37050/0 (socket says 172.21.15.78:37050) 2023-08-17T17:50:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f024ffff700 1 -- 172.21.15.78:0/3971265447 learned_addr learned my addr 172.21.15.78:0/3971265447 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f024ffff700 1 -- 172.21.15.78:0/3971265447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0250152b50 msgr2=0x7f02500acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f024ffff700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0250152b50 0x7f02500acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f024ffff700 1 -- 172.21.15.78:0/3971265447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0250134ff0 msgr2=0x7f02500ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f024ffff700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0250134ff0 0x7f02500ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f024ffff700 1 -- 172.21.15.78:0/3971265447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0240009370 con 0x7f02500624f0 2023-08-17T17:50:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f024ffff700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02500624f0 0x7f0250134760 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f025005f3a0 tx=0x7f0240017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0237fff700 1 -- 172.21.15.78:0/3971265447 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000b8d0 con 0x7f02500624f0 2023-08-17T17:50:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0237fff700 1 -- 172.21.15.78:0/3971265447 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024000ba30 con 0x7f02500624f0 2023-08-17T17:50:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0237fff700 1 -- 172.21.15.78:0/3971265447 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024001c670 con 0x7f02500624f0 2023-08-17T17:50:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0256764700 1 -- 172.21.15.78:0/3971265447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0250162e00 con 0x7f02500624f0 2023-08-17T17:50:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.091+0000 7f0256764700 1 -- 172.21.15.78:0/3971265447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0250163290 con 0x7f02500624f0 2023-08-17T17:50:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.092+0000 7f0256764700 1 -- 172.21.15.78:0/3971265447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02501630e0 con 0x7f02500624f0 2023-08-17T17:50:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.093+0000 7f0237fff700 1 -- 172.21.15.78:0/3971265447 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f024002c070 con 0x7f02500624f0 2023-08-17T17:50:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.093+0000 7f0237fff700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f023c05ed90 0x7f023c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.093+0000 7f0237fff700 1 -- 172.21.15.78:0/3971265447 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f024007b860 con 0x7f02500624f0 2023-08-17T17:50:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.093+0000 7f024f7fe700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f023c05ed90 0x7f023c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.093+0000 7f024f7fe700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f023c05ed90 0x7f023c061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0250151d70 tx=0x7f0244008040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.097+0000 7f0237fff700 1 -- 172.21.15.78:0/3971265447 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f024004ce00 con 0x7f02500624f0 2023-08-17T17:50:30.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.254+0000 7f0256764700 1 -- 172.21.15.78:0/3971265447 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0250047350 con 0x7f023c05ed90 2023-08-17T17:50:30.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.263+0000 7f0237fff700 1 -- 172.21.15.78:0/3971265447 <== mgr.6990 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361309 (secure 0 0 0) 0x7f0250047350 con 0x7f023c05ed90 2023-08-17T17:50:30.267 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 -- 172.21.15.78:0/3971265447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f023c05ed90 msgr2=0x7f023c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f023c05ed90 0x7f023c061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0250151d70 tx=0x7f0244008040).stop 2023-08-17T17:50:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 -- 172.21.15.78:0/3971265447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02500624f0 msgr2=0x7f0250134760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02500624f0 0x7f0250134760 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f025005f3a0 tx=0x7f0240017000).stop 2023-08-17T17:50:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 -- 172.21.15.78:0/3971265447 shutdown_connections 2023-08-17T17:50:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f023c05ed90 0x7f023c061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0250152b50 0x7f02500acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02500624f0 0x7f0250134760 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 --2- 172.21.15.78:0/3971265447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0250134ff0 0x7f02500ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 -- 172.21.15.78:0/3971265447 >> 172.21.15.78:0/3971265447 conn(0x7f02500c7b00 msgr2=0x7f02500ab240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 -- 172.21.15.78:0/3971265447 shutdown_connections 2023-08-17T17:50:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.267+0000 7f0256764700 1 -- 172.21.15.78:0/3971265447 wait complete. 2023-08-17T17:50:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:50:30.279 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:50:29.999108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419364,"kb_used_data":9828,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752555356,"statfs":{"total":773094113280,"available":770616684544,"internally_reserved":0,"allocated":10063872,"data_stored":4949637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4468,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.585996"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971421+0000","last_change":"2023-08-17T17:50:26.971421+0000","last_active":"2023-08-17T17:50:26.971421+0000","last_peered":"2023-08-17T17:50:26.971421+0000","last_clean":"2023-08-17T17:50:26.971421+0000","last_became_active":"2023-08-17T17:50:26.971141+0000","last_became_peered":"2023-08-17T17:50:26.971141+0000","last_unstale":"2023-08-17T17:50:26.971421+0000","last_undegraded":"2023-08-17T17:50:26.971421+0000","last_fullsized":"2023-08-17T17:50:26.971421+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"104'3","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.975631+0000","last_change":"2023-08-17T17:50:26.602015+0000","last_active":"2023-08-17T17:50:26.975631+0000","last_peered":"2023-08-17T17:50:26.975631+0000","last_clean":"2023-08-17T17:50:26.975631+0000","last_became_active":"2023-08-17T17:50:26.601711+0000","last_became_peered":"2023-08-17T17:50:26.601711+0000","last_unstale":"2023-08-17T17:50:26.975631+0000","last_undegraded":"2023-08-17T17:50:26.975631+0000","last_fullsized":"2023-08-17T17:50:26.975631+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.975618+0000","last_change":"2023-08-17T17:50:26.975618+0000","last_active":"2023-08-17T17:50:26.975618+0000","last_peered":"2023-08-17T17:50:26.975618+0000","last_clean":"2023-08-17T17:50:26.975618+0000","last_became_active":"2023-08-17T17:50:26.975304+0000","last_became_peered":"2023-08-17T17:50:26.975304+0000","last_unstale":"2023-08-17T17:50:26.975618+0000","last_undegraded":"2023-08-17T17:50:26.975618+0000","last_fullsized":"2023-08-17T17:50:26.975618+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609654+0000","last_change":"2023-08-17T17:50:26.603008+0000","last_active":"2023-08-17T17:50:26.609654+0000","last_peered":"2023-08-17T17:50:26.609654+0000","last_clean":"2023-08-17T17:50:26.609654+0000","last_became_active":"2023-08-17T17:50:26.602733+0000","last_became_peered":"2023-08-17T17:50:26.602733+0000","last_unstale":"2023-08-17T17:50:26.609654+0000","last_undegraded":"2023-08-17T17:50:26.609654+0000","last_fullsized":"2023-08-17T17:50:26.609654+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.967406+0000","last_change":"2023-08-17T17:50:26.967406+0000","last_active":"2023-08-17T17:50:26.967406+0000","last_peered":"2023-08-17T17:50:26.967406+0000","last_clean":"2023-08-17T17:50:26.967406+0000","last_became_active":"2023-08-17T17:50:26.967199+0000","last_became_peered":"2023-08-17T17:50:26.967199+0000","last_unstale":"2023-08-17T17:50:26.967406+0000","last_undegraded":"2023-08-17T17:50:26.967406+0000","last_fullsized":"2023-08-17T17:50:26.967406+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.606308+0000","last_change":"2023-08-17T17:50:26.605142+0000","last_active":"2023-08-17T17:50:26.606308+0000","last_peered":"2023-08-17T17:50:26.606308+0000","last_clean":"2023-08-17T17:50:26.606308+0000","last_became_active":"2023-08-17T17:50:26.604864+0000","last_became_peered":"2023-08-17T17:50:26.604864+0000","last_unstale":"2023-08-17T17:50:26.606308+0000","last_undegraded":"2023-08-17T17:50:26.606308+0000","last_fullsized":"2023-08-17T17:50:26.606308+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.967968+0000","last_change":"2023-08-17T17:50:26.967968+0000","last_active":"2023-08-17T17:50:26.967968+0000","last_peered":"2023-08-17T17:50:26.967968+0000","last_clean":"2023-08-17T17:50:26.967968+0000","last_became_active":"2023-08-17T17:50:26.967718+0000","last_became_peered":"2023-08-17T17:50:26.967718+0000","last_unstale":"2023-08-17T17:50:26.967968+0000","last_undegraded":"2023-08-17T17:50:26.967968+0000","last_fullsized":"2023-08-17T17:50:26.967968+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"104'2","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965700+0000","last_change":"2023-08-17T17:50:26.603823+0000","last_active":"2023-08-17T17:50:26.965700+0000","last_peered":"2023-08-17T17:50:26.965700+0000","last_clean":"2023-08-17T17:50:26.965700+0000","last_became_active":"2023-08-17T17:50:26.603564+0000","last_became_peered":"2023-08-17T17:50:26.603564+0000","last_unstale":"2023-08-17T17:50:26.965700+0000","last_undegraded":"2023-08-17T17:50:26.965700+0000","last_fullsized":"2023-08-17T17:50:26.965700+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.968626+0000","last_change":"2023-08-17T17:50:26.968626+0000","last_active":"2023-08-17T17:50:26.968626+0000","last_peered":"2023-08-17T17:50:26.968626+0000","last_clean":"2023-08-17T17:50:26.968626+0000","last_became_active":"2023-08-17T17:50:26.968343+0000","last_became_peered":"2023-08-17T17:50:26.968343+0000","last_unstale":"2023-08-17T17:50:26.968626+0000","last_undegraded":"2023-08-17T17:50:26.968626+0000","last_fullsized":"2023-08-17T17:50:26.968626+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.956037+0000","last_change":"2023-08-17T17:50:26.601591+0000","last_active":"2023-08-17T17:50:26.956037+0000","last_peered":"2023-08-17T17:50:26.956037+0000","last_clean":"2023-08-17T17:50:26.956037+0000","last_became_active":"2023-08-17T17:50:26.601103+0000","last_became_peered":"2023-08-17T17:50:26.601103+0000","last_unstale":"2023-08-17T17:50:26.956037+0000","last_undegraded":"2023-08-17T17:50:26.956037+0000","last_fullsized":"2023-08-17T17:50:26.956037+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.970538+0000","last_change":"2023-08-17T17:50:26.970538+0000","last_active":"2023-08-17T17:50:26.970538+0000","last_peered":"2023-08-17T17:50:26.970538+0000","last_clean":"2023-08-17T17:50:26.970538+0000","last_became_active":"2023-08-17T17:50:26.970245+0000","last_became_peered":"2023-08-17T17:50:26.970245+0000","last_unstale":"2023-08-17T17:50:26.970538+0000","last_undegraded":"2023-08-17T17:50:26.970538+0000","last_fullsized":"2023-08-17T17:50:26.970538+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.956791+0000","last_change":"2023-08-17T17:50:26.608027+0000","last_active":"2023-08-17T17:50:26.956791+0000","last_peered":"2023-08-17T17:50:26.956791+0000","last_clean":"2023-08-17T17:50:26.956791+0000","last_became_active":"2023-08-17T17:50:26.607714+0000","last_became_peered":"2023-08-17T17:50:26.607714+0000","last_unstale":"2023-08-17T17:50:26.956791+0000","last_undegraded":"2023-08-17T17:50:26.956791+0000","last_fullsized":"2023-08-17T17:50:26.956791+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965850+0000","last_change":"2023-08-17T17:50:26.965850+0000","last_active":"2023-08-17T17:50:26.965850+0000","last_peered":"2023-08-17T17:50:26.965850+0000","last_clean":"2023-08-17T17:50:26.965850+0000","last_became_active":"2023-08-17T17:50:26.965449+0000","last_became_peered":"2023-08-17T17:50:26.965449+0000","last_unstale":"2023-08-17T17:50:26.965850+0000","last_undegraded":"2023-08-17T17:50:26.965850+0000","last_fullsized":"2023-08-17T17:50:26.965850+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.610044+0000","last_change":"2023-08-17T17:50:26.606171+0000","last_active":"2023-08-17T17:50:26.610044+0000","last_peered":"2023-08-17T17:50:26.610044+0000","last_clean":"2023-08-17T17:50:26.610044+0000","last_became_active":"2023-08-17T17:50:26.605856+0000","last_became_peered":"2023-08-17T17:50:26.605856+0000","last_unstale":"2023-08-17T17:50:26.610044+0000","last_undegraded":"2023-08-17T17:50:26.610044+0000","last_fullsized":"2023-08-17T17:50:26.610044+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.974324+0000","last_change":"2023-08-17T17:50:26.974324+0000","last_active":"2023-08-17T17:50:26.974324+0000","last_peered":"2023-08-17T17:50:26.974324+0000","last_clean":"2023-08-17T17:50:26.974324+0000","last_became_active":"2023-08-17T17:50:26.974026+0000","last_became_peered":"2023-08-17T17:50:26.974026+0000","last_unstale":"2023-08-17T17:50:26.974324+0000","last_undegraded":"2023-08-17T17:50:26.974324+0000","last_fullsized":"2023-08-17T17:50:26.974324+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.601772+0000","last_change":"2023-08-17T17:50:26.597059+0000","last_active":"2023-08-17T17:50:26.601772+0000","last_peered":"2023-08-17T17:50:26.601772+0000","last_clean":"2023-08-17T17:50:26.601772+0000","last_became_active":"2023-08-17T17:50:26.596756+0000","last_became_peered":"2023-08-17T17:50:26.596756+0000","last_unstale":"2023-08-17T17:50:26.601772+0000","last_undegraded":"2023-08-17T17:50:26.601772+0000","last_fullsized":"2023-08-17T17:50:26.601772+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.963969+0000","last_change":"2023-08-17T17:50:26.963969+0000","last_active":"2023-08-17T17:50:26.963969+0000","last_peered":"2023-08-17T17:50:26.963969+0000","last_clean":"2023-08-17T17:50:26.963969+0000","last_became_active":"2023-08-17T17:50:26.963727+0000","last_became_peered":"2023-08-17T17:50:26.963727+0000","last_unstale":"2023-08-17T17:50:26.963969+0000","last_undegraded":"2023-08-17T17:50:26.963969+0000","last_fullsized":"2023-08-17T17:50:26.963969+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.600886+0000","last_change":"2023-08-17T17:50:26.595568+0000","last_active":"2023-08-17T17:50:26.600886+0000","last_peered":"2023-08-17T17:50:26.600886+0000","last_clean":"2023-08-17T17:50:26.600886+0000","last_became_active":"2023-08-17T17:50:26.595249+0000","last_became_peered":"2023-08-17T17:50:26.595249+0000","last_unstale":"2023-08-17T17:50:26.600886+0000","last_undegraded":"2023-08-17T17:50:26.600886+0000","last_fullsized":"2023-08-17T17:50:26.600886+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.974648+0000","last_change":"2023-08-17T17:50:26.974648+0000","last_active":"2023-08-17T17:50:26.974648+0000","last_peered":"2023-08-17T17:50:26.974648+0000","last_clean":"2023-08-17T17:50:26.974648+0000","last_became_active":"2023-08-17T17:50:26.973943+0000","last_became_peered":"2023-08-17T17:50:26.973943+0000","last_unstale":"2023-08-17T17:50:26.974648+0000","last_undegraded":"2023-08-17T17:50:26.974648+0000","last_fullsized":"2023-08-17T17:50:26.974648+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.601462+0000","last_change":"2023-08-17T17:50:26.597997+0000","last_active":"2023-08-17T17:50:26.601462+0000","last_peered":"2023-08-17T17:50:26.601462+0000","last_clean":"2023-08-17T17:50:26.601462+0000","last_became_active":"2023-08-17T17:50:26.597529+0000","last_became_peered":"2023-08-17T17:50:26.597529+0000","last_unstale":"2023-08-17T17:50:26.601462+0000","last_undegraded":"2023-08-17T17:50:26.601462+0000","last_fullsized":"2023-08-17T17:50:26.601462+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966104+0000","last_change":"2023-08-17T17:50:26.966104+0000","last_active":"2023-08-17T17:50:26.966104+0000","last_peered":"2023-08-17T17:50:26.966104+0000","last_clean":"2023-08-17T17:50:26.966104+0000","last_became_active":"2023-08-17T17:50:26.965811+0000","last_became_peered":"2023-08-17T17:50:26.965811+0000","last_unstale":"2023-08-17T17:50:26.966104+0000","last_undegraded":"2023-08-17T17:50:26.966104+0000","last_fullsized":"2023-08-17T17:50:26.966104+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609723+0000","last_change":"2023-08-17T17:50:26.602704+0000","last_active":"2023-08-17T17:50:26.609723+0000","last_peered":"2023-08-17T17:50:26.609723+0000","last_clean":"2023-08-17T17:50:26.609723+0000","last_became_active":"2023-08-17T17:50:26.602449+0000","last_became_peered":"2023-08-17T17:50:26.602449+0000","last_unstale":"2023-08-17T17:50:26.609723+0000","last_undegraded":"2023-08-17T17:50:26.609723+0000","last_fullsized":"2023-08-17T17:50:26.609723+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.960178+0000","last_change":"2023-08-17T17:50:26.960178+0000","last_active":"2023-08-17T17:50:26.960178+0000","last_peered":"2023-08-17T17:50:26.960178+0000","last_clean":"2023-08-17T17:50:26.960178+0000","last_became_active":"2023-08-17T17:50:26.959773+0000","last_became_peered":"2023-08-17T17:50:26.959773+0000","last_unstale":"2023-08-17T17:50:26.960178+0000","last_undegraded":"2023-08-17T17:50:26.960178+0000","last_fullsized":"2023-08-17T17:50:26.960178+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"104'4","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.974396+0000","last_change":"2023-08-17T17:50:26.597895+0000","last_active":"2023-08-17T17:50:26.974396+0000","last_peered":"2023-08-17T17:50:26.974396+0000","last_clean":"2023-08-17T17:50:26.974396+0000","last_became_active":"2023-08-17T17:50:26.597608+0000","last_became_peered":"2023-08-17T17:50:26.597608+0000","last_unstale":"2023-08-17T17:50:26.974396+0000","last_undegraded":"2023-08-17T17:50:26.974396+0000","last_fullsized":"2023-08-17T17:50:26.974396+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973850+0000","last_change":"2023-08-17T17:50:26.973850+0000","last_active":"2023-08-17T17:50:26.973850+0000","last_peered":"2023-08-17T17:50:26.973850+0000","last_clean":"2023-08-17T17:50:26.973850+0000","last_became_active":"2023-08-17T17:50:26.973519+0000","last_became_peered":"2023-08-17T17:50:26.973519+0000","last_unstale":"2023-08-17T17:50:26.973850+0000","last_undegraded":"2023-08-17T17:50:26.973850+0000","last_fullsized":"2023-08-17T17:50:26.973850+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965001+0000","last_change":"2023-08-17T17:50:26.602514+0000","last_active":"2023-08-17T17:50:26.965001+0000","last_peered":"2023-08-17T17:50:26.965001+0000","last_clean":"2023-08-17T17:50:26.965001+0000","last_became_active":"2023-08-17T17:50:26.601978+0000","last_became_peered":"2023-08-17T17:50:26.601978+0000","last_unstale":"2023-08-17T17:50:26.965001+0000","last_undegraded":"2023-08-17T17:50:26.965001+0000","last_fullsized":"2023-08-17T17:50:26.965001+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.960942+0000","last_change":"2023-08-17T17:50:26.960942+0000","last_active":"2023-08-17T17:50:26.960942+0000","last_peered":"2023-08-17T17:50:26.960942+0000","last_clean":"2023-08-17T17:50:26.960942+0000","last_became_active":"2023-08-17T17:50:26.960677+0000","last_became_peered":"2023-08-17T17:50:26.960677+0000","last_unstale":"2023-08-17T17:50:26.960942+0000","last_undegraded":"2023-08-17T17:50:26.960942+0000","last_fullsized":"2023-08-17T17:50:26.960942+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609931+0000","last_change":"2023-08-17T17:50:26.605723+0000","last_active":"2023-08-17T17:50:26.609931+0000","last_peered":"2023-08-17T17:50:26.609931+0000","last_clean":"2023-08-17T17:50:26.609931+0000","last_became_active":"2023-08-17T17:50:26.602981+0000","last_became_peered":"2023-08-17T17:50:26.602981+0000","last_unstale":"2023-08-17T17:50:26.609931+0000","last_undegraded":"2023-08-17T17:50:26.609931+0000","last_fullsized":"2023-08-17T17:50:26.609931+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965876+0000","last_change":"2023-08-17T17:50:26.965876+0000","last_active":"2023-08-17T17:50:26.965876+0000","last_peered":"2023-08-17T17:50:26.965876+0000","last_clean":"2023-08-17T17:50:26.965876+0000","last_became_active":"2023-08-17T17:50:26.965595+0000","last_became_peered":"2023-08-17T17:50:26.965595+0000","last_unstale":"2023-08-17T17:50:26.965876+0000","last_undegraded":"2023-08-17T17:50:26.965876+0000","last_fullsized":"2023-08-17T17:50:26.965876+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609053+0000","last_change":"2023-08-17T17:50:26.598776+0000","last_active":"2023-08-17T17:50:26.609053+0000","last_peered":"2023-08-17T17:50:26.609053+0000","last_clean":"2023-08-17T17:50:26.609053+0000","last_became_active":"2023-08-17T17:50:26.598327+0000","last_became_peered":"2023-08-17T17:50:26.598327+0000","last_unstale":"2023-08-17T17:50:26.609053+0000","last_undegraded":"2023-08-17T17:50:26.609053+0000","last_fullsized":"2023-08-17T17:50:26.609053+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.969033+0000","last_change":"2023-08-17T17:50:26.969033+0000","last_active":"2023-08-17T17:50:26.969033+0000","last_peered":"2023-08-17T17:50:26.969033+0000","last_clean":"2023-08-17T17:50:26.969033+0000","last_became_active":"2023-08-17T17:50:26.968771+0000","last_became_peered":"2023-08-17T17:50:26.968771+0000","last_unstale":"2023-08-17T17:50:26.969033+0000","last_undegraded":"2023-08-17T17:50:26.969033+0000","last_fullsized":"2023-08-17T17:50:26.969033+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"104'4","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.970483+0000","last_change":"2023-08-17T17:50:26.600025+0000","last_active":"2023-08-17T17:50:26.970483+0000","last_peered":"2023-08-17T17:50:26.970483+0000","last_clean":"2023-08-17T17:50:26.970483+0000","last_became_active":"2023-08-17T17:50:26.599746+0000","last_became_peered":"2023-08-17T17:50:26.599746+0000","last_unstale":"2023-08-17T17:50:26.970483+0000","last_undegraded":"2023-08-17T17:50:26.970483+0000","last_fullsized":"2023-08-17T17:50:26.970483+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.963618+0000","last_change":"2023-08-17T17:50:26.963618+0000","last_active":"2023-08-17T17:50:26.963618+0000","last_peered":"2023-08-17T17:50:26.963618+0000","last_clean":"2023-08-17T17:50:26.963618+0000","last_became_active":"2023-08-17T17:50:26.963340+0000","last_became_peered":"2023-08-17T17:50:26.963340+0000","last_unstale":"2023-08-17T17:50:26.963618+0000","last_undegraded":"2023-08-17T17:50:26.963618+0000","last_fullsized":"2023-08-17T17:50:26.963618+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.601248+0000","last_change":"2023-08-17T17:50:26.596649+0000","last_active":"2023-08-17T17:50:26.601248+0000","last_peered":"2023-08-17T17:50:26.601248+0000","last_clean":"2023-08-17T17:50:26.601248+0000","last_became_active":"2023-08-17T17:50:26.596376+0000","last_became_peered":"2023-08-17T17:50:26.596376+0000","last_unstale":"2023-08-17T17:50:26.601248+0000","last_undegraded":"2023-08-17T17:50:26.601248+0000","last_fullsized":"2023-08-17T17:50:26.601248+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.974808+0000","last_change":"2023-08-17T17:50:26.974808+0000","last_active":"2023-08-17T17:50:26.974808+0000","last_peered":"2023-08-17T17:50:26.974808+0000","last_clean":"2023-08-17T17:50:26.974808+0000","last_became_active":"2023-08-17T17:50:26.974242+0000","last_became_peered":"2023-08-17T17:50:26.974242+0000","last_unstale":"2023-08-17T17:50:26.974808+0000","last_undegraded":"2023-08-17T17:50:26.974808+0000","last_fullsized":"2023-08-17T17:50:26.974808+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609729+0000","last_change":"2023-08-17T17:50:26.603507+0000","last_active":"2023-08-17T17:50:26.609729+0000","last_peered":"2023-08-17T17:50:26.609729+0000","last_clean":"2023-08-17T17:50:26.609729+0000","last_became_active":"2023-08-17T17:50:26.602644+0000","last_became_peered":"2023-08-17T17:50:26.602644+0000","last_unstale":"2023-08-17T17:50:26.609729+0000","last_undegraded":"2023-08-17T17:50:26.609729+0000","last_fullsized":"2023-08-17T17:50:26.609729+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.967524+0000","last_change":"2023-08-17T17:50:26.967524+0000","last_active":"2023-08-17T17:50:26.967524+0000","last_peered":"2023-08-17T17:50:26.967524+0000","last_clean":"2023-08-17T17:50:26.967524+0000","last_became_active":"2023-08-17T17:50:26.967234+0000","last_became_peered":"2023-08-17T17:50:26.967234+0000","last_unstale":"2023-08-17T17:50:26.967524+0000","last_undegraded":"2023-08-17T17:50:26.967524+0000","last_fullsized":"2023-08-17T17:50:26.967524+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.955606+0000","last_change":"2023-08-17T17:50:26.590522+0000","last_active":"2023-08-17T17:50:26.955606+0000","last_peered":"2023-08-17T17:50:26.955606+0000","last_clean":"2023-08-17T17:50:26.955606+0000","last_became_active":"2023-08-17T17:50:26.590236+0000","last_became_peered":"2023-08-17T17:50:26.590236+0000","last_unstale":"2023-08-17T17:50:26.955606+0000","last_undegraded":"2023-08-17T17:50:26.955606+0000","last_fullsized":"2023-08-17T17:50:26.955606+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973266+0000","last_change":"2023-08-17T17:50:26.973266+0000","last_active":"2023-08-17T17:50:26.973266+0000","last_peered":"2023-08-17T17:50:26.973266+0000","last_clean":"2023-08-17T17:50:26.973266+0000","last_became_active":"2023-08-17T17:50:26.973037+0000","last_became_peered":"2023-08-17T17:50:26.973037+0000","last_unstale":"2023-08-17T17:50:26.973266+0000","last_undegraded":"2023-08-17T17:50:26.973266+0000","last_fullsized":"2023-08-17T17:50:26.973266+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609881+0000","last_change":"2023-08-17T17:50:26.605551+0000","last_active":"2023-08-17T17:50:26.609881+0000","last_peered":"2023-08-17T17:50:26.609881+0000","last_clean":"2023-08-17T17:50:26.609881+0000","last_became_active":"2023-08-17T17:50:26.605288+0000","last_became_peered":"2023-08-17T17:50:26.605288+0000","last_unstale":"2023-08-17T17:50:26.609881+0000","last_undegraded":"2023-08-17T17:50:26.609881+0000","last_fullsized":"2023-08-17T17:50:26.609881+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.959397+0000","last_change":"2023-08-17T17:50:26.959397+0000","last_active":"2023-08-17T17:50:26.959397+0000","last_peered":"2023-08-17T17:50:26.959397+0000","last_clean":"2023-08-17T17:50:26.959397+0000","last_became_active":"2023-08-17T17:50:26.959128+0000","last_became_peered":"2023-08-17T17:50:26.959128+0000","last_unstale":"2023-08-17T17:50:26.959397+0000","last_undegraded":"2023-08-17T17:50:26.959397+0000","last_fullsized":"2023-08-17T17:50:26.959397+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.957209+0000","last_change":"2023-08-17T17:50:26.609463+0000","last_active":"2023-08-17T17:50:26.957209+0000","last_peered":"2023-08-17T17:50:26.957209+0000","last_clean":"2023-08-17T17:50:26.957209+0000","last_became_active":"2023-08-17T17:50:26.608991+0000","last_became_peered":"2023-08-17T17:50:26.608991+0000","last_unstale":"2023-08-17T17:50:26.957209+0000","last_undegraded":"2023-08-17T17:50:26.957209+0000","last_fullsized":"2023-08-17T17:50:26.957209+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972134+0000","last_change":"2023-08-17T17:50:26.972134+0000","last_active":"2023-08-17T17:50:26.972134+0000","last_peered":"2023-08-17T17:50:26.972134+0000","last_clean":"2023-08-17T17:50:26.972134+0000","last_became_active":"2023-08-17T17:50:26.971656+0000","last_became_peered":"2023-08-17T17:50:26.971656+0000","last_unstale":"2023-08-17T17:50:26.972134+0000","last_undegraded":"2023-08-17T17:50:26.972134+0000","last_fullsized":"2023-08-17T17:50:26.972134+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.603604+0000","last_change":"2023-08-17T17:50:26.599599+0000","last_active":"2023-08-17T17:50:26.603604+0000","last_peered":"2023-08-17T17:50:26.603604+0000","last_clean":"2023-08-17T17:50:26.603604+0000","last_became_active":"2023-08-17T17:50:26.599284+0000","last_became_peered":"2023-08-17T17:50:26.599284+0000","last_unstale":"2023-08-17T17:50:26.603604+0000","last_undegraded":"2023-08-17T17:50:26.603604+0000","last_fullsized":"2023-08-17T17:50:26.603604+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.964987+0000","last_change":"2023-08-17T17:50:26.964987+0000","last_active":"2023-08-17T17:50:26.964987+0000","last_peered":"2023-08-17T17:50:26.964987+0000","last_clean":"2023-08-17T17:50:26.964987+0000","last_became_active":"2023-08-17T17:50:26.964702+0000","last_became_peered":"2023-08-17T17:50:26.964702+0000","last_unstale":"2023-08-17T17:50:26.964987+0000","last_undegraded":"2023-08-17T17:50:26.964987+0000","last_fullsized":"2023-08-17T17:50:26.964987+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609698+0000","last_change":"2023-08-17T17:50:26.603332+0000","last_active":"2023-08-17T17:50:26.609698+0000","last_peered":"2023-08-17T17:50:26.609698+0000","last_clean":"2023-08-17T17:50:26.609698+0000","last_became_active":"2023-08-17T17:50:26.603037+0000","last_became_peered":"2023-08-17T17:50:26.603037+0000","last_unstale":"2023-08-17T17:50:26.609698+0000","last_undegraded":"2023-08-17T17:50:26.609698+0000","last_fullsized":"2023-08-17T17:50:26.609698+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971532+0000","last_change":"2023-08-17T17:50:26.971532+0000","last_active":"2023-08-17T17:50:26.971532+0000","last_peered":"2023-08-17T17:50:26.971532+0000","last_clean":"2023-08-17T17:50:26.971532+0000","last_became_active":"2023-08-17T17:50:26.970852+0000","last_became_peered":"2023-08-17T17:50:26.970852+0000","last_unstale":"2023-08-17T17:50:26.971532+0000","last_undegraded":"2023-08-17T17:50:26.971532+0000","last_fullsized":"2023-08-17T17:50:26.971532+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.610026+0000","last_change":"2023-08-17T17:50:26.606278+0000","last_active":"2023-08-17T17:50:26.610026+0000","last_peered":"2023-08-17T17:50:26.610026+0000","last_clean":"2023-08-17T17:50:26.610026+0000","last_became_active":"2023-08-17T17:50:26.602539+0000","last_became_peered":"2023-08-17T17:50:26.602539+0000","last_unstale":"2023-08-17T17:50:26.610026+0000","last_undegraded":"2023-08-17T17:50:26.610026+0000","last_fullsized":"2023-08-17T17:50:26.610026+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.977038+0000","last_change":"2023-08-17T17:50:26.977038+0000","last_active":"2023-08-17T17:50:26.977038+0000","last_peered":"2023-08-17T17:50:26.977038+0000","last_clean":"2023-08-17T17:50:26.977038+0000","last_became_active":"2023-08-17T17:50:26.976621+0000","last_became_peered":"2023-08-17T17:50:26.976621+0000","last_unstale":"2023-08-17T17:50:26.977038+0000","last_undegraded":"2023-08-17T17:50:26.977038+0000","last_fullsized":"2023-08-17T17:50:26.977038+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609769+0000","last_change":"2023-08-17T17:50:26.603229+0000","last_active":"2023-08-17T17:50:26.609769+0000","last_peered":"2023-08-17T17:50:26.609769+0000","last_clean":"2023-08-17T17:50:26.609769+0000","last_became_active":"2023-08-17T17:50:26.602939+0000","last_became_peered":"2023-08-17T17:50:26.602939+0000","last_unstale":"2023-08-17T17:50:26.609769+0000","last_undegraded":"2023-08-17T17:50:26.609769+0000","last_fullsized":"2023-08-17T17:50:26.609769+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.976894+0000","last_change":"2023-08-17T17:50:26.976894+0000","last_active":"2023-08-17T17:50:26.976894+0000","last_peered":"2023-08-17T17:50:26.976894+0000","last_clean":"2023-08-17T17:50:26.976894+0000","last_became_active":"2023-08-17T17:50:26.976621+0000","last_became_peered":"2023-08-17T17:50:26.976621+0000","last_unstale":"2023-08-17T17:50:26.976894+0000","last_undegraded":"2023-08-17T17:50:26.976894+0000","last_fullsized":"2023-08-17T17:50:26.976894+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.613734+0000","last_change":"2023-08-17T17:50:26.610393+0000","last_active":"2023-08-17T17:50:26.613734+0000","last_peered":"2023-08-17T17:50:26.613734+0000","last_clean":"2023-08-17T17:50:26.613734+0000","last_became_active":"2023-08-17T17:50:26.610072+0000","last_became_peered":"2023-08-17T17:50:26.610072+0000","last_unstale":"2023-08-17T17:50:26.613734+0000","last_undegraded":"2023-08-17T17:50:26.613734+0000","last_fullsized":"2023-08-17T17:50:26.613734+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971363+0000","last_change":"2023-08-17T17:50:26.971363+0000","last_active":"2023-08-17T17:50:26.971363+0000","last_peered":"2023-08-17T17:50:26.971363+0000","last_clean":"2023-08-17T17:50:26.971363+0000","last_became_active":"2023-08-17T17:50:26.971071+0000","last_became_peered":"2023-08-17T17:50:26.971071+0000","last_unstale":"2023-08-17T17:50:26.971363+0000","last_undegraded":"2023-08-17T17:50:26.971363+0000","last_fullsized":"2023-08-17T17:50:26.971363+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.604132+0000","last_change":"2023-08-17T17:50:26.595919+0000","last_active":"2023-08-17T17:50:26.604132+0000","last_peered":"2023-08-17T17:50:26.604132+0000","last_clean":"2023-08-17T17:50:26.604132+0000","last_became_active":"2023-08-17T17:50:26.595652+0000","last_became_peered":"2023-08-17T17:50:26.595652+0000","last_unstale":"2023-08-17T17:50:26.604132+0000","last_undegraded":"2023-08-17T17:50:26.604132+0000","last_fullsized":"2023-08-17T17:50:26.604132+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971364+0000","last_change":"2023-08-17T17:50:26.971364+0000","last_active":"2023-08-17T17:50:26.971364+0000","last_peered":"2023-08-17T17:50:26.971364+0000","last_clean":"2023-08-17T17:50:26.971364+0000","last_became_active":"2023-08-17T17:50:26.971059+0000","last_became_peered":"2023-08-17T17:50:26.971059+0000","last_unstale":"2023-08-17T17:50:26.971364+0000","last_undegraded":"2023-08-17T17:50:26.971364+0000","last_fullsized":"2023-08-17T17:50:26.971364+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.606394+0000","last_change":"2023-08-17T17:50:26.602995+0000","last_active":"2023-08-17T17:50:26.606394+0000","last_peered":"2023-08-17T17:50:26.606394+0000","last_clean":"2023-08-17T17:50:26.606394+0000","last_became_active":"2023-08-17T17:50:26.602313+0000","last_became_peered":"2023-08-17T17:50:26.602313+0000","last_unstale":"2023-08-17T17:50:26.606394+0000","last_undegraded":"2023-08-17T17:50:26.606394+0000","last_fullsized":"2023-08-17T17:50:26.606394+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972665+0000","last_change":"2023-08-17T17:50:26.972665+0000","last_active":"2023-08-17T17:50:26.972665+0000","last_peered":"2023-08-17T17:50:26.972665+0000","last_clean":"2023-08-17T17:50:26.972665+0000","last_became_active":"2023-08-17T17:50:26.971997+0000","last_became_peered":"2023-08-17T17:50:26.971997+0000","last_unstale":"2023-08-17T17:50:26.972665+0000","last_undegraded":"2023-08-17T17:50:26.972665+0000","last_fullsized":"2023-08-17T17:50:26.972665+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.596683+0000","last_change":"2023-08-17T17:50:26.592933+0000","last_active":"2023-08-17T17:50:26.596683+0000","last_peered":"2023-08-17T17:50:26.596683+0000","last_clean":"2023-08-17T17:50:26.596683+0000","last_became_active":"2023-08-17T17:50:26.592675+0000","last_became_peered":"2023-08-17T17:50:26.592675+0000","last_unstale":"2023-08-17T17:50:26.596683+0000","last_undegraded":"2023-08-17T17:50:26.596683+0000","last_fullsized":"2023-08-17T17:50:26.596683+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.967080+0000","last_change":"2023-08-17T17:50:26.967080+0000","last_active":"2023-08-17T17:50:26.967080+0000","last_peered":"2023-08-17T17:50:26.967080+0000","last_clean":"2023-08-17T17:50:26.967080+0000","last_became_active":"2023-08-17T17:50:26.966765+0000","last_became_peered":"2023-08-17T17:50:26.966765+0000","last_unstale":"2023-08-17T17:50:26.967080+0000","last_undegraded":"2023-08-17T17:50:26.967080+0000","last_fullsized":"2023-08-17T17:50:26.967080+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609976+0000","last_change":"2023-08-17T17:50:26.604005+0000","last_active":"2023-08-17T17:50:26.609976+0000","last_peered":"2023-08-17T17:50:26.609976+0000","last_clean":"2023-08-17T17:50:26.609976+0000","last_became_active":"2023-08-17T17:50:26.603445+0000","last_became_peered":"2023-08-17T17:50:26.603445+0000","last_unstale":"2023-08-17T17:50:26.609976+0000","last_undegraded":"2023-08-17T17:50:26.609976+0000","last_fullsized":"2023-08-17T17:50:26.609976+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.960909+0000","last_change":"2023-08-17T17:50:26.960909+0000","last_active":"2023-08-17T17:50:26.960909+0000","last_peered":"2023-08-17T17:50:26.960909+0000","last_clean":"2023-08-17T17:50:26.960909+0000","last_became_active":"2023-08-17T17:50:26.960613+0000","last_became_peered":"2023-08-17T17:50:26.960613+0000","last_unstale":"2023-08-17T17:50:26.960909+0000","last_undegraded":"2023-08-17T17:50:26.960909+0000","last_fullsized":"2023-08-17T17:50:26.960909+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.601479+0000","last_change":"2023-08-17T17:50:26.597208+0000","last_active":"2023-08-17T17:50:26.601479+0000","last_peered":"2023-08-17T17:50:26.601479+0000","last_clean":"2023-08-17T17:50:26.601479+0000","last_became_active":"2023-08-17T17:50:26.596906+0000","last_became_peered":"2023-08-17T17:50:26.596906+0000","last_unstale":"2023-08-17T17:50:26.601479+0000","last_undegraded":"2023-08-17T17:50:26.601479+0000","last_fullsized":"2023-08-17T17:50:26.601479+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973152+0000","last_change":"2023-08-17T17:50:26.973152+0000","last_active":"2023-08-17T17:50:26.973152+0000","last_peered":"2023-08-17T17:50:26.973152+0000","last_clean":"2023-08-17T17:50:26.973152+0000","last_became_active":"2023-08-17T17:50:26.972840+0000","last_became_peered":"2023-08-17T17:50:26.972840+0000","last_unstale":"2023-08-17T17:50:26.973152+0000","last_undegraded":"2023-08-17T17:50:26.973152+0000","last_fullsized":"2023-08-17T17:50:26.973152+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.606707+0000","last_change":"2023-08-17T17:50:26.603857+0000","last_active":"2023-08-17T17:50:26.606707+0000","last_peered":"2023-08-17T17:50:26.606707+0000","last_clean":"2023-08-17T17:50:26.606707+0000","last_became_active":"2023-08-17T17:50:26.603557+0000","last_became_peered":"2023-08-17T17:50:26.603557+0000","last_unstale":"2023-08-17T17:50:26.606707+0000","last_undegraded":"2023-08-17T17:50:26.606707+0000","last_fullsized":"2023-08-17T17:50:26.606707+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.970759+0000","last_change":"2023-08-17T17:50:26.970759+0000","last_active":"2023-08-17T17:50:26.970759+0000","last_peered":"2023-08-17T17:50:26.970759+0000","last_clean":"2023-08-17T17:50:26.970759+0000","last_became_active":"2023-08-17T17:50:26.970486+0000","last_became_peered":"2023-08-17T17:50:26.970486+0000","last_unstale":"2023-08-17T17:50:26.970759+0000","last_undegraded":"2023-08-17T17:50:26.970759+0000","last_fullsized":"2023-08-17T17:50:26.970759+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.963574+0000","last_change":"2023-08-17T17:50:26.609268+0000","last_active":"2023-08-17T17:50:26.963574+0000","last_peered":"2023-08-17T17:50:26.963574+0000","last_clean":"2023-08-17T17:50:26.963574+0000","last_became_active":"2023-08-17T17:50:26.609007+0000","last_became_peered":"2023-08-17T17:50:26.609007+0000","last_unstale":"2023-08-17T17:50:26.963574+0000","last_undegraded":"2023-08-17T17:50:26.963574+0000","last_fullsized":"2023-08-17T17:50:26.963574+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966231+0000","last_change":"2023-08-17T17:50:26.966231+0000","last_active":"2023-08-17T17:50:26.966231+0000","last_peered":"2023-08-17T17:50:26.966231+0000","last_clean":"2023-08-17T17:50:26.966231+0000","last_became_active":"2023-08-17T17:50:26.964496+0000","last_became_peered":"2023-08-17T17:50:26.964496+0000","last_unstale":"2023-08-17T17:50:26.966231+0000","last_undegraded":"2023-08-17T17:50:26.966231+0000","last_fullsized":"2023-08-17T17:50:26.966231+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.956450+0000","last_change":"2023-08-17T17:50:26.600744+0000","last_active":"2023-08-17T17:50:26.956450+0000","last_peered":"2023-08-17T17:50:26.956450+0000","last_clean":"2023-08-17T17:50:26.956450+0000","last_became_active":"2023-08-17T17:50:26.600410+0000","last_became_peered":"2023-08-17T17:50:26.600410+0000","last_unstale":"2023-08-17T17:50:26.956450+0000","last_undegraded":"2023-08-17T17:50:26.956450+0000","last_fullsized":"2023-08-17T17:50:26.956450+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971897+0000","last_change":"2023-08-17T17:50:26.971897+0000","last_active":"2023-08-17T17:50:26.971897+0000","last_peered":"2023-08-17T17:50:26.971897+0000","last_clean":"2023-08-17T17:50:26.971897+0000","last_became_active":"2023-08-17T17:50:26.971601+0000","last_became_peered":"2023-08-17T17:50:26.971601+0000","last_unstale":"2023-08-17T17:50:26.971897+0000","last_undegraded":"2023-08-17T17:50:26.971897+0000","last_fullsized":"2023-08-17T17:50:26.971897+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"104'2","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.968021+0000","last_change":"2023-08-17T17:50:26.610491+0000","last_active":"2023-08-17T17:50:26.968021+0000","last_peered":"2023-08-17T17:50:26.968021+0000","last_clean":"2023-08-17T17:50:26.968021+0000","last_became_active":"2023-08-17T17:50:26.610125+0000","last_became_peered":"2023-08-17T17:50:26.610125+0000","last_unstale":"2023-08-17T17:50:26.968021+0000","last_undegraded":"2023-08-17T17:50:26.968021+0000","last_fullsized":"2023-08-17T17:50:26.968021+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966720+0000","last_change":"2023-08-17T17:50:26.966720+0000","last_active":"2023-08-17T17:50:26.966720+0000","last_peered":"2023-08-17T17:50:26.966720+0000","last_clean":"2023-08-17T17:50:26.966720+0000","last_became_active":"2023-08-17T17:50:26.966435+0000","last_became_peered":"2023-08-17T17:50:26.966435+0000","last_unstale":"2023-08-17T17:50:26.966720+0000","last_undegraded":"2023-08-17T17:50:26.966720+0000","last_fullsized":"2023-08-17T17:50:26.966720+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609785+0000","last_change":"2023-08-17T17:50:26.604032+0000","last_active":"2023-08-17T17:50:26.609785+0000","last_peered":"2023-08-17T17:50:26.609785+0000","last_clean":"2023-08-17T17:50:26.609785+0000","last_became_active":"2023-08-17T17:50:26.603746+0000","last_became_peered":"2023-08-17T17:50:26.603746+0000","last_unstale":"2023-08-17T17:50:26.609785+0000","last_undegraded":"2023-08-17T17:50:26.609785+0000","last_fullsized":"2023-08-17T17:50:26.609785+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.968027+0000","last_change":"2023-08-17T17:50:26.968027+0000","last_active":"2023-08-17T17:50:26.968027+0000","last_peered":"2023-08-17T17:50:26.968027+0000","last_clean":"2023-08-17T17:50:26.968027+0000","last_became_active":"2023-08-17T17:50:26.965680+0000","last_became_peered":"2023-08-17T17:50:26.965680+0000","last_unstale":"2023-08-17T17:50:26.968027+0000","last_undegraded":"2023-08-17T17:50:26.968027+0000","last_fullsized":"2023-08-17T17:50:26.968027+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.608946+0000","last_change":"2023-08-17T17:50:26.606729+0000","last_active":"2023-08-17T17:50:26.608946+0000","last_peered":"2023-08-17T17:50:26.608946+0000","last_clean":"2023-08-17T17:50:26.608946+0000","last_became_active":"2023-08-17T17:50:26.606444+0000","last_became_peered":"2023-08-17T17:50:26.606444+0000","last_unstale":"2023-08-17T17:50:26.608946+0000","last_undegraded":"2023-08-17T17:50:26.608946+0000","last_fullsized":"2023-08-17T17:50:26.608946+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.969552+0000","last_change":"2023-08-17T17:50:26.969552+0000","last_active":"2023-08-17T17:50:26.969552+0000","last_peered":"2023-08-17T17:50:26.969552+0000","last_clean":"2023-08-17T17:50:26.969552+0000","last_became_active":"2023-08-17T17:50:26.969297+0000","last_became_peered":"2023-08-17T17:50:26.969297+0000","last_unstale":"2023-08-17T17:50:26.969552+0000","last_undegraded":"2023-08-17T17:50:26.969552+0000","last_fullsized":"2023-08-17T17:50:26.969552+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609997+0000","last_change":"2023-08-17T17:50:26.606847+0000","last_active":"2023-08-17T17:50:26.609997+0000","last_peered":"2023-08-17T17:50:26.609997+0000","last_clean":"2023-08-17T17:50:26.609997+0000","last_became_active":"2023-08-17T17:50:26.606606+0000","last_became_peered":"2023-08-17T17:50:26.606606+0000","last_unstale":"2023-08-17T17:50:26.609997+0000","last_undegraded":"2023-08-17T17:50:26.609997+0000","last_fullsized":"2023-08-17T17:50:26.609997+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965879+0000","last_change":"2023-08-17T17:50:26.965879+0000","last_active":"2023-08-17T17:50:26.965879+0000","last_peered":"2023-08-17T17:50:26.965879+0000","last_clean":"2023-08-17T17:50:26.965879+0000","last_became_active":"2023-08-17T17:50:26.964396+0000","last_became_peered":"2023-08-17T17:50:26.964396+0000","last_unstale":"2023-08-17T17:50:26.965879+0000","last_undegraded":"2023-08-17T17:50:26.965879+0000","last_fullsized":"2023-08-17T17:50:26.965879+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609028+0000","last_change":"2023-08-17T17:50:26.598595+0000","last_active":"2023-08-17T17:50:26.609028+0000","last_peered":"2023-08-17T17:50:26.609028+0000","last_clean":"2023-08-17T17:50:26.609028+0000","last_became_active":"2023-08-17T17:50:26.597974+0000","last_became_peered":"2023-08-17T17:50:26.597974+0000","last_unstale":"2023-08-17T17:50:26.609028+0000","last_undegraded":"2023-08-17T17:50:26.609028+0000","last_fullsized":"2023-08-17T17:50:26.609028+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.974176+0000","last_change":"2023-08-17T17:50:26.974176+0000","last_active":"2023-08-17T17:50:26.974176+0000","last_peered":"2023-08-17T17:50:26.974176+0000","last_clean":"2023-08-17T17:50:26.974176+0000","last_became_active":"2023-08-17T17:50:26.973888+0000","last_became_peered":"2023-08-17T17:50:26.973888+0000","last_unstale":"2023-08-17T17:50:26.974176+0000","last_undegraded":"2023-08-17T17:50:26.974176+0000","last_fullsized":"2023-08-17T17:50:26.974176+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.613355+0000","last_change":"2023-08-17T17:50:26.609696+0000","last_active":"2023-08-17T17:50:26.613355+0000","last_peered":"2023-08-17T17:50:26.613355+0000","last_clean":"2023-08-17T17:50:26.613355+0000","last_became_active":"2023-08-17T17:50:26.609450+0000","last_became_peered":"2023-08-17T17:50:26.609450+0000","last_unstale":"2023-08-17T17:50:26.613355+0000","last_undegraded":"2023-08-17T17:50:26.613355+0000","last_fullsized":"2023-08-17T17:50:26.613355+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966329+0000","last_change":"2023-08-17T17:50:26.966329+0000","last_active":"2023-08-17T17:50:26.966329+0000","last_peered":"2023-08-17T17:50:26.966329+0000","last_clean":"2023-08-17T17:50:26.966329+0000","last_became_active":"2023-08-17T17:50:26.966029+0000","last_became_peered":"2023-08-17T17:50:26.966029+0000","last_unstale":"2023-08-17T17:50:26.966329+0000","last_undegraded":"2023-08-17T17:50:26.966329+0000","last_fullsized":"2023-08-17T17:50:26.966329+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.605765+0000","last_change":"2023-08-17T17:50:26.602039+0000","last_active":"2023-08-17T17:50:26.605765+0000","last_peered":"2023-08-17T17:50:26.605765+0000","last_clean":"2023-08-17T17:50:26.605765+0000","last_became_active":"2023-08-17T17:50:26.601757+0000","last_became_peered":"2023-08-17T17:50:26.601757+0000","last_unstale":"2023-08-17T17:50:26.605765+0000","last_undegraded":"2023-08-17T17:50:26.605765+0000","last_fullsized":"2023-08-17T17:50:26.605765+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.975110+0000","last_change":"2023-08-17T17:50:26.975110+0000","last_active":"2023-08-17T17:50:26.975110+0000","last_peered":"2023-08-17T17:50:26.975110+0000","last_clean":"2023-08-17T17:50:26.975110+0000","last_became_active":"2023-08-17T17:50:26.974860+0000","last_became_peered":"2023-08-17T17:50:26.974860+0000","last_unstale":"2023-08-17T17:50:26.975110+0000","last_undegraded":"2023-08-17T17:50:26.975110+0000","last_fullsized":"2023-08-17T17:50:26.975110+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609136+0000","last_change":"2023-08-17T17:50:26.598844+0000","last_active":"2023-08-17T17:50:26.609136+0000","last_peered":"2023-08-17T17:50:26.609136+0000","last_clean":"2023-08-17T17:50:26.609136+0000","last_became_active":"2023-08-17T17:50:26.598581+0000","last_became_peered":"2023-08-17T17:50:26.598581+0000","last_unstale":"2023-08-17T17:50:26.609136+0000","last_undegraded":"2023-08-17T17:50:26.609136+0000","last_fullsized":"2023-08-17T17:50:26.609136+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966567+0000","last_change":"2023-08-17T17:50:26.966567+0000","last_active":"2023-08-17T17:50:26.966567+0000","last_peered":"2023-08-17T17:50:26.966567+0000","last_clean":"2023-08-17T17:50:26.966567+0000","last_became_active":"2023-08-17T17:50:26.966270+0000","last_became_peered":"2023-08-17T17:50:26.966270+0000","last_unstale":"2023-08-17T17:50:26.966567+0000","last_undegraded":"2023-08-17T17:50:26.966567+0000","last_fullsized":"2023-08-17T17:50:26.966567+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"104'3","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973669+0000","last_change":"2023-08-17T17:50:26.600520+0000","last_active":"2023-08-17T17:50:26.973669+0000","last_peered":"2023-08-17T17:50:26.973669+0000","last_clean":"2023-08-17T17:50:26.973669+0000","last_became_active":"2023-08-17T17:50:26.600172+0000","last_became_peered":"2023-08-17T17:50:26.600172+0000","last_unstale":"2023-08-17T17:50:26.973669+0000","last_undegraded":"2023-08-17T17:50:26.973669+0000","last_fullsized":"2023-08-17T17:50:26.973669+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.960061+0000","last_change":"2023-08-17T17:50:26.960061+0000","last_active":"2023-08-17T17:50:26.960061+0000","last_peered":"2023-08-17T17:50:26.960061+0000","last_clean":"2023-08-17T17:50:26.960061+0000","last_became_active":"2023-08-17T17:50:26.959812+0000","last_became_peered":"2023-08-17T17:50:26.959812+0000","last_unstale":"2023-08-17T17:50:26.960061+0000","last_undegraded":"2023-08-17T17:50:26.960061+0000","last_fullsized":"2023-08-17T17:50:26.960061+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"104'2","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.966311+0000","last_change":"2023-08-17T17:50:26.599586+0000","last_active":"2023-08-17T17:50:26.966311+0000","last_peered":"2023-08-17T17:50:26.966311+0000","last_clean":"2023-08-17T17:50:26.966311+0000","last_became_active":"2023-08-17T17:50:26.599322+0000","last_became_peered":"2023-08-17T17:50:26.599322+0000","last_unstale":"2023-08-17T17:50:26.966311+0000","last_undegraded":"2023-08-17T17:50:26.966311+0000","last_fullsized":"2023-08-17T17:50:26.966311+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.969603+0000","last_change":"2023-08-17T17:50:26.969603+0000","last_active":"2023-08-17T17:50:26.969603+0000","last_peered":"2023-08-17T17:50:26.969603+0000","last_clean":"2023-08-17T17:50:26.969603+0000","last_became_active":"2023-08-17T17:50:26.968570+0000","last_became_peered":"2023-08-17T17:50:26.968570+0000","last_unstale":"2023-08-17T17:50:26.969603+0000","last_undegraded":"2023-08-17T17:50:26.969603+0000","last_fullsized":"2023-08-17T17:50:26.969603+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965124+0000","last_change":"2023-08-17T17:50:26.609759+0000","last_active":"2023-08-17T17:50:26.965124+0000","last_peered":"2023-08-17T17:50:26.965124+0000","last_clean":"2023-08-17T17:50:26.965124+0000","last_became_active":"2023-08-17T17:50:26.609448+0000","last_became_peered":"2023-08-17T17:50:26.609448+0000","last_unstale":"2023-08-17T17:50:26.965124+0000","last_undegraded":"2023-08-17T17:50:26.965124+0000","last_fullsized":"2023-08-17T17:50:26.965124+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.964938+0000","last_change":"2023-08-17T17:50:26.964938+0000","last_active":"2023-08-17T17:50:26.964938+0000","last_peered":"2023-08-17T17:50:26.964938+0000","last_clean":"2023-08-17T17:50:26.964938+0000","last_became_active":"2023-08-17T17:50:26.964662+0000","last_became_peered":"2023-08-17T17:50:26.964662+0000","last_unstale":"2023-08-17T17:50:26.964938+0000","last_undegraded":"2023-08-17T17:50:26.964938+0000","last_fullsized":"2023-08-17T17:50:26.964938+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609212+0000","last_change":"2023-08-17T17:50:26.600783+0000","last_active":"2023-08-17T17:50:26.609212+0000","last_peered":"2023-08-17T17:50:26.609212+0000","last_clean":"2023-08-17T17:50:26.609212+0000","last_became_active":"2023-08-17T17:50:26.597137+0000","last_became_peered":"2023-08-17T17:50:26.597137+0000","last_unstale":"2023-08-17T17:50:26.609212+0000","last_undegraded":"2023-08-17T17:50:26.609212+0000","last_fullsized":"2023-08-17T17:50:26.609212+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972068+0000","last_change":"2023-08-17T17:50:26.972068+0000","last_active":"2023-08-17T17:50:26.972068+0000","last_peered":"2023-08-17T17:50:26.972068+0000","last_clean":"2023-08-17T17:50:26.972068+0000","last_became_active":"2023-08-17T17:50:26.971776+0000","last_became_peered":"2023-08-17T17:50:26.971776+0000","last_unstale":"2023-08-17T17:50:26.972068+0000","last_undegraded":"2023-08-17T17:50:26.972068+0000","last_fullsized":"2023-08-17T17:50:26.972068+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609741+0000","last_change":"2023-08-17T17:50:26.603507+0000","last_active":"2023-08-17T17:50:26.609741+0000","last_peered":"2023-08-17T17:50:26.609741+0000","last_clean":"2023-08-17T17:50:26.609741+0000","last_became_active":"2023-08-17T17:50:26.603225+0000","last_became_peered":"2023-08-17T17:50:26.603225+0000","last_unstale":"2023-08-17T17:50:26.609741+0000","last_undegraded":"2023-08-17T17:50:26.609741+0000","last_fullsized":"2023-08-17T17:50:26.609741+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972726+0000","last_change":"2023-08-17T17:50:26.972726+0000","last_active":"2023-08-17T17:50:26.972726+0000","last_peered":"2023-08-17T17:50:26.972726+0000","last_clean":"2023-08-17T17:50:26.972726+0000","last_became_active":"2023-08-17T17:50:26.972434+0000","last_became_peered":"2023-08-17T17:50:26.972434+0000","last_unstale":"2023-08-17T17:50:26.972726+0000","last_undegraded":"2023-08-17T17:50:26.972726+0000","last_fullsized":"2023-08-17T17:50:26.972726+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"104'4","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.964301+0000","last_change":"2023-08-17T17:50:26.596640+0000","last_active":"2023-08-17T17:50:26.964301+0000","last_peered":"2023-08-17T17:50:26.964301+0000","last_clean":"2023-08-17T17:50:26.964301+0000","last_became_active":"2023-08-17T17:50:26.595904+0000","last_became_peered":"2023-08-17T17:50:26.595904+0000","last_unstale":"2023-08-17T17:50:26.964301+0000","last_undegraded":"2023-08-17T17:50:26.964301+0000","last_fullsized":"2023-08-17T17:50:26.964301+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.970467+0000","last_change":"2023-08-17T17:50:26.970467+0000","last_active":"2023-08-17T17:50:26.970467+0000","last_peered":"2023-08-17T17:50:26.970467+0000","last_clean":"2023-08-17T17:50:26.970467+0000","last_became_active":"2023-08-17T17:50:26.970186+0000","last_became_peered":"2023-08-17T17:50:26.970186+0000","last_unstale":"2023-08-17T17:50:26.970467+0000","last_undegraded":"2023-08-17T17:50:26.970467+0000","last_fullsized":"2023-08-17T17:50:26.970467+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"104'2","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.975223+0000","last_change":"2023-08-17T17:50:26.605483+0000","last_active":"2023-08-17T17:50:26.975223+0000","last_peered":"2023-08-17T17:50:26.975223+0000","last_clean":"2023-08-17T17:50:26.975223+0000","last_became_active":"2023-08-17T17:50:26.605053+0000","last_became_peered":"2023-08-17T17:50:26.605053+0000","last_unstale":"2023-08-17T17:50:26.975223+0000","last_undegraded":"2023-08-17T17:50:26.975223+0000","last_fullsized":"2023-08-17T17:50:26.975223+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.977731+0000","last_change":"2023-08-17T17:50:26.977731+0000","last_active":"2023-08-17T17:50:26.977731+0000","last_peered":"2023-08-17T17:50:26.977731+0000","last_clean":"2023-08-17T17:50:26.977731+0000","last_became_active":"2023-08-17T17:50:26.977505+0000","last_became_peered":"2023-08-17T17:50:26.977505+0000","last_unstale":"2023-08-17T17:50:26.977731+0000","last_undegraded":"2023-08-17T17:50:26.977731+0000","last_fullsized":"2023-08-17T17:50:26.977731+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.601185+0000","last_change":"2023-08-17T17:50:26.595153+0000","last_active":"2023-08-17T17:50:26.601185+0000","last_peered":"2023-08-17T17:50:26.601185+0000","last_clean":"2023-08-17T17:50:26.601185+0000","last_became_active":"2023-08-17T17:50:26.594838+0000","last_became_peered":"2023-08-17T17:50:26.594838+0000","last_unstale":"2023-08-17T17:50:26.601185+0000","last_undegraded":"2023-08-17T17:50:26.601185+0000","last_fullsized":"2023-08-17T17:50:26.601185+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965724+0000","last_change":"2023-08-17T17:50:26.965724+0000","last_active":"2023-08-17T17:50:26.965724+0000","last_peered":"2023-08-17T17:50:26.965724+0000","last_clean":"2023-08-17T17:50:26.965724+0000","last_became_active":"2023-08-17T17:50:26.965486+0000","last_became_peered":"2023-08-17T17:50:26.965486+0000","last_unstale":"2023-08-17T17:50:26.965724+0000","last_undegraded":"2023-08-17T17:50:26.965724+0000","last_fullsized":"2023-08-17T17:50:26.965724+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.608714+0000","last_change":"2023-08-17T17:50:26.604392+0000","last_active":"2023-08-17T17:50:26.608714+0000","last_peered":"2023-08-17T17:50:26.608714+0000","last_clean":"2023-08-17T17:50:26.608714+0000","last_became_active":"2023-08-17T17:50:26.604096+0000","last_became_peered":"2023-08-17T17:50:26.604096+0000","last_unstale":"2023-08-17T17:50:26.608714+0000","last_undegraded":"2023-08-17T17:50:26.608714+0000","last_fullsized":"2023-08-17T17:50:26.608714+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972497+0000","last_change":"2023-08-17T17:50:26.972497+0000","last_active":"2023-08-17T17:50:26.972497+0000","last_peered":"2023-08-17T17:50:26.972497+0000","last_clean":"2023-08-17T17:50:26.972497+0000","last_became_active":"2023-08-17T17:50:26.972207+0000","last_became_peered":"2023-08-17T17:50:26.972207+0000","last_unstale":"2023-08-17T17:50:26.972497+0000","last_undegraded":"2023-08-17T17:50:26.972497+0000","last_fullsized":"2023-08-17T17:50:26.972497+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.611710+0000","last_change":"2023-08-17T17:50:26.608024+0000","last_active":"2023-08-17T17:50:26.611710+0000","last_peered":"2023-08-17T17:50:26.611710+0000","last_clean":"2023-08-17T17:50:26.611710+0000","last_became_active":"2023-08-17T17:50:26.607740+0000","last_became_peered":"2023-08-17T17:50:26.607740+0000","last_unstale":"2023-08-17T17:50:26.611710+0000","last_undegraded":"2023-08-17T17:50:26.611710+0000","last_fullsized":"2023-08-17T17:50:26.611710+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973179+0000","last_change":"2023-08-17T17:50:26.973179+0000","last_active":"2023-08-17T17:50:26.973179+0000","last_peered":"2023-08-17T17:50:26.973179+0000","last_clean":"2023-08-17T17:50:26.973179+0000","last_became_active":"2023-08-17T17:50:26.972859+0000","last_became_peered":"2023-08-17T17:50:26.972859+0000","last_unstale":"2023-08-17T17:50:26.973179+0000","last_undegraded":"2023-08-17T17:50:26.973179+0000","last_fullsized":"2023-08-17T17:50:26.973179+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609074+0000","last_change":"2023-08-17T17:50:26.601003+0000","last_active":"2023-08-17T17:50:26.609074+0000","last_peered":"2023-08-17T17:50:26.609074+0000","last_clean":"2023-08-17T17:50:26.609074+0000","last_became_active":"2023-08-17T17:50:26.597182+0000","last_became_peered":"2023-08-17T17:50:26.597182+0000","last_unstale":"2023-08-17T17:50:26.609074+0000","last_undegraded":"2023-08-17T17:50:26.609074+0000","last_fullsized":"2023-08-17T17:50:26.609074+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.959398+0000","last_change":"2023-08-17T17:50:26.959398+0000","last_active":"2023-08-17T17:50:26.959398+0000","last_peered":"2023-08-17T17:50:26.959398+0000","last_clean":"2023-08-17T17:50:26.959398+0000","last_became_active":"2023-08-17T17:50:26.959150+0000","last_became_peered":"2023-08-17T17:50:26.959150+0000","last_unstale":"2023-08-17T17:50:26.959398+0000","last_undegraded":"2023-08-17T17:50:26.959398+0000","last_fullsized":"2023-08-17T17:50:26.959398+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.600057+0000","last_change":"2023-08-17T17:50:26.593550+0000","last_active":"2023-08-17T17:50:26.600057+0000","last_peered":"2023-08-17T17:50:26.600057+0000","last_clean":"2023-08-17T17:50:26.600057+0000","last_became_active":"2023-08-17T17:50:26.593193+0000","last_became_peered":"2023-08-17T17:50:26.593193+0000","last_unstale":"2023-08-17T17:50:26.600057+0000","last_undegraded":"2023-08-17T17:50:26.600057+0000","last_fullsized":"2023-08-17T17:50:26.600057+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.971611+0000","last_change":"2023-08-17T17:50:26.971611+0000","last_active":"2023-08-17T17:50:26.971611+0000","last_peered":"2023-08-17T17:50:26.971611+0000","last_clean":"2023-08-17T17:50:26.971611+0000","last_became_active":"2023-08-17T17:50:26.971336+0000","last_became_peered":"2023-08-17T17:50:26.971336+0000","last_unstale":"2023-08-17T17:50:26.971611+0000","last_undegraded":"2023-08-17T17:50:26.971611+0000","last_fullsized":"2023-08-17T17:50:26.971611+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.613632+0000","last_change":"2023-08-17T17:50:26.611983+0000","last_active":"2023-08-17T17:50:26.613632+0000","last_peered":"2023-08-17T17:50:26.613632+0000","last_clean":"2023-08-17T17:50:26.613632+0000","last_became_active":"2023-08-17T17:50:26.611774+0000","last_became_peered":"2023-08-17T17:50:26.611774+0000","last_unstale":"2023-08-17T17:50:26.613632+0000","last_undegraded":"2023-08-17T17:50:26.613632+0000","last_fullsized":"2023-08-17T17:50:26.613632+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.963217+0000","last_change":"2023-08-17T17:50:26.963217+0000","last_active":"2023-08-17T17:50:26.963217+0000","last_peered":"2023-08-17T17:50:26.963217+0000","last_clean":"2023-08-17T17:50:26.963217+0000","last_became_active":"2023-08-17T17:50:26.962914+0000","last_became_peered":"2023-08-17T17:50:26.962914+0000","last_unstale":"2023-08-17T17:50:26.963217+0000","last_undegraded":"2023-08-17T17:50:26.963217+0000","last_fullsized":"2023-08-17T17:50:26.963217+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.605834+0000","last_change":"2023-08-17T17:50:26.603169+0000","last_active":"2023-08-17T17:50:26.605834+0000","last_peered":"2023-08-17T17:50:26.605834+0000","last_clean":"2023-08-17T17:50:26.605834+0000","last_became_active":"2023-08-17T17:50:26.602904+0000","last_became_peered":"2023-08-17T17:50:26.602904+0000","last_unstale":"2023-08-17T17:50:26.605834+0000","last_undegraded":"2023-08-17T17:50:26.605834+0000","last_fullsized":"2023-08-17T17:50:26.605834+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.961496+0000","last_change":"2023-08-17T17:50:26.961496+0000","last_active":"2023-08-17T17:50:26.961496+0000","last_peered":"2023-08-17T17:50:26.961496+0000","last_clean":"2023-08-17T17:50:26.961496+0000","last_became_active":"2023-08-17T17:50:26.961301+0000","last_became_peered":"2023-08-17T17:50:26.961301+0000","last_unstale":"2023-08-17T17:50:26.961496+0000","last_undegraded":"2023-08-17T17:50:26.961496+0000","last_fullsized":"2023-08-17T17:50:26.961496+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.956645+0000","last_change":"2023-08-17T17:50:26.595239+0000","last_active":"2023-08-17T17:50:26.956645+0000","last_peered":"2023-08-17T17:50:26.956645+0000","last_clean":"2023-08-17T17:50:26.956645+0000","last_became_active":"2023-08-17T17:50:26.594928+0000","last_became_peered":"2023-08-17T17:50:26.594928+0000","last_unstale":"2023-08-17T17:50:26.956645+0000","last_undegraded":"2023-08-17T17:50:26.956645+0000","last_fullsized":"2023-08-17T17:50:26.956645+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.584778+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:50:26.584778+0000","last_peered":"2023-08-17T17:50:26.584778+0000","last_clean":"2023-08-17T17:50:26.584778+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:50:26.584778+0000","last_undegraded":"2023-08-17T17:50:26.584778+0000","last_fullsized":"2023-08-17T17:50:26.584778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972734+0000","last_change":"2023-08-17T17:50:26.972734+0000","last_active":"2023-08-17T17:50:26.972734+0000","last_peered":"2023-08-17T17:50:26.972734+0000","last_clean":"2023-08-17T17:50:26.972734+0000","last_became_active":"2023-08-17T17:50:26.970914+0000","last_became_peered":"2023-08-17T17:50:26.970914+0000","last_unstale":"2023-08-17T17:50:26.972734+0000","last_undegraded":"2023-08-17T17:50:26.972734+0000","last_fullsized":"2023-08-17T17:50:26.972734+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.604173+0000","last_change":"2023-08-17T17:50:26.600966+0000","last_active":"2023-08-17T17:50:26.604173+0000","last_peered":"2023-08-17T17:50:26.604173+0000","last_clean":"2023-08-17T17:50:26.604173+0000","last_became_active":"2023-08-17T17:50:26.600565+0000","last_became_peered":"2023-08-17T17:50:26.600565+0000","last_unstale":"2023-08-17T17:50:26.604173+0000","last_undegraded":"2023-08-17T17:50:26.604173+0000","last_fullsized":"2023-08-17T17:50:26.604173+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.589145+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:50:26.589145+0000","last_peered":"2023-08-17T17:50:26.589145+0000","last_clean":"2023-08-17T17:50:26.589145+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:50:26.589145+0000","last_undegraded":"2023-08-17T17:50:26.589145+0000","last_fullsized":"2023-08-17T17:50:26.589145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.973626+0000","last_change":"2023-08-17T17:50:26.973626+0000","last_active":"2023-08-17T17:50:26.973626+0000","last_peered":"2023-08-17T17:50:26.973626+0000","last_clean":"2023-08-17T17:50:26.973626+0000","last_became_active":"2023-08-17T17:50:26.973218+0000","last_became_peered":"2023-08-17T17:50:26.973218+0000","last_unstale":"2023-08-17T17:50:26.973626+0000","last_undegraded":"2023-08-17T17:50:26.973626+0000","last_fullsized":"2023-08-17T17:50:26.973626+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"104'2","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.968743+0000","last_change":"2023-08-17T17:50:26.602841+0000","last_active":"2023-08-17T17:50:26.968743+0000","last_peered":"2023-08-17T17:50:26.968743+0000","last_clean":"2023-08-17T17:50:26.968743+0000","last_became_active":"2023-08-17T17:50:26.602288+0000","last_became_peered":"2023-08-17T17:50:26.602288+0000","last_unstale":"2023-08-17T17:50:26.968743+0000","last_undegraded":"2023-08-17T17:50:26.968743+0000","last_fullsized":"2023-08-17T17:50:26.968743+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.588523+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:50:26.588523+0000","last_peered":"2023-08-17T17:50:26.588523+0000","last_clean":"2023-08-17T17:50:26.588523+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:50:26.588523+0000","last_undegraded":"2023-08-17T17:50:26.588523+0000","last_fullsized":"2023-08-17T17:50:26.588523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972365+0000","last_change":"2023-08-17T17:50:26.972365+0000","last_active":"2023-08-17T17:50:26.972365+0000","last_peered":"2023-08-17T17:50:26.972365+0000","last_clean":"2023-08-17T17:50:26.972365+0000","last_became_active":"2023-08-17T17:50:26.971992+0000","last_became_peered":"2023-08-17T17:50:26.971992+0000","last_unstale":"2023-08-17T17:50:26.972365+0000","last_undegraded":"2023-08-17T17:50:26.972365+0000","last_fullsized":"2023-08-17T17:50:26.972365+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.599733+0000","last_change":"2023-08-17T17:50:26.592980+0000","last_active":"2023-08-17T17:50:26.599733+0000","last_peered":"2023-08-17T17:50:26.599733+0000","last_clean":"2023-08-17T17:50:26.599733+0000","last_became_active":"2023-08-17T17:50:26.592715+0000","last_became_peered":"2023-08-17T17:50:26.592715+0000","last_unstale":"2023-08-17T17:50:26.599733+0000","last_undegraded":"2023-08-17T17:50:26.599733+0000","last_fullsized":"2023-08-17T17:50:26.599733+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.587351+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:50:26.587351+0000","last_peered":"2023-08-17T17:50:26.587351+0000","last_clean":"2023-08-17T17:50:26.587351+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:50:26.587351+0000","last_undegraded":"2023-08-17T17:50:26.587351+0000","last_fullsized":"2023-08-17T17:50:26.587351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.596113+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:50:26.596113+0000","last_peered":"2023-08-17T17:50:26.596113+0000","last_clean":"2023-08-17T17:50:26.596113+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:50:26.596113+0000","last_undegraded":"2023-08-17T17:50:26.596113+0000","last_fullsized":"2023-08-17T17:50:26.596113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.972484+0000","last_change":"2023-08-17T17:50:26.972484+0000","last_active":"2023-08-17T17:50:26.972484+0000","last_peered":"2023-08-17T17:50:26.972484+0000","last_clean":"2023-08-17T17:50:26.972484+0000","last_became_active":"2023-08-17T17:50:26.972182+0000","last_became_peered":"2023-08-17T17:50:26.972182+0000","last_unstale":"2023-08-17T17:50:26.972484+0000","last_undegraded":"2023-08-17T17:50:26.972484+0000","last_fullsized":"2023-08-17T17:50:26.972484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"104'1","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.963448+0000","last_change":"2023-08-17T17:50:26.603423+0000","last_active":"2023-08-17T17:50:26.963448+0000","last_peered":"2023-08-17T17:50:26.963448+0000","last_clean":"2023-08-17T17:50:26.963448+0000","last_became_active":"2023-08-17T17:50:26.603076+0000","last_became_peered":"2023-08-17T17:50:26.603076+0000","last_unstale":"2023-08-17T17:50:26.963448+0000","last_undegraded":"2023-08-17T17:50:26.963448+0000","last_fullsized":"2023-08-17T17:50:26.963448+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.599093+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:50:26.599093+0000","last_peered":"2023-08-17T17:50:26.599093+0000","last_clean":"2023-08-17T17:50:26.599093+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:50:26.599093+0000","last_undegraded":"2023-08-17T17:50:26.599093+0000","last_fullsized":"2023-08-17T17:50:26.599093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.967174+0000","last_change":"2023-08-17T17:50:26.967174+0000","last_active":"2023-08-17T17:50:26.967174+0000","last_peered":"2023-08-17T17:50:26.967174+0000","last_clean":"2023-08-17T17:50:26.967174+0000","last_became_active":"2023-08-17T17:50:26.966917+0000","last_became_peered":"2023-08-17T17:50:26.966917+0000","last_unstale":"2023-08-17T17:50:26.967174+0000","last_undegraded":"2023-08-17T17:50:26.967174+0000","last_fullsized":"2023-08-17T17:50:26.967174+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609827+0000","last_change":"2023-08-17T17:50:26.603032+0000","last_active":"2023-08-17T17:50:26.609827+0000","last_peered":"2023-08-17T17:50:26.609827+0000","last_clean":"2023-08-17T17:50:26.609827+0000","last_became_active":"2023-08-17T17:50:26.602587+0000","last_became_peered":"2023-08-17T17:50:26.602587+0000","last_unstale":"2023-08-17T17:50:26.609827+0000","last_undegraded":"2023-08-17T17:50:26.609827+0000","last_fullsized":"2023-08-17T17:50:26.609827+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.597755+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:50:26.597755+0000","last_peered":"2023-08-17T17:50:26.597755+0000","last_clean":"2023-08-17T17:50:26.597755+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:50:26.597755+0000","last_undegraded":"2023-08-17T17:50:26.597755+0000","last_fullsized":"2023-08-17T17:50:26.597755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.962931+0000","last_change":"2023-08-17T17:50:26.962931+0000","last_active":"2023-08-17T17:50:26.962931+0000","last_peered":"2023-08-17T17:50:26.962931+0000","last_clean":"2023-08-17T17:50:26.962931+0000","last_became_active":"2023-08-17T17:50:26.962652+0000","last_became_peered":"2023-08-17T17:50:26.962652+0000","last_unstale":"2023-08-17T17:50:26.962931+0000","last_undegraded":"2023-08-17T17:50:26.962931+0000","last_fullsized":"2023-08-17T17:50:26.962931+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.600852+0000","last_change":"2023-08-17T17:50:26.595464+0000","last_active":"2023-08-17T17:50:26.600852+0000","last_peered":"2023-08-17T17:50:26.600852+0000","last_clean":"2023-08-17T17:50:26.600852+0000","last_became_active":"2023-08-17T17:50:26.595174+0000","last_became_peered":"2023-08-17T17:50:26.595174+0000","last_unstale":"2023-08-17T17:50:26.600852+0000","last_undegraded":"2023-08-17T17:50:26.600852+0000","last_fullsized":"2023-08-17T17:50:26.600852+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.584495+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:50:26.584495+0000","last_peered":"2023-08-17T17:50:26.584495+0000","last_clean":"2023-08-17T17:50:26.584495+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:50:26.584495+0000","last_undegraded":"2023-08-17T17:50:26.584495+0000","last_fullsized":"2023-08-17T17:50:26.584495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.965479+0000","last_change":"2023-08-17T17:50:26.965479+0000","last_active":"2023-08-17T17:50:26.965479+0000","last_peered":"2023-08-17T17:50:26.965479+0000","last_clean":"2023-08-17T17:50:26.965479+0000","last_became_active":"2023-08-17T17:50:26.965210+0000","last_became_peered":"2023-08-17T17:50:26.965210+0000","last_unstale":"2023-08-17T17:50:26.965479+0000","last_undegraded":"2023-08-17T17:50:26.965479+0000","last_fullsized":"2023-08-17T17:50:26.965479+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:26.575387+0000","last_clean_scrub_stamp":"2023-08-17T17:50:26.575387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.609924+0000","last_change":"2023-08-17T17:50:26.606171+0000","last_active":"2023-08-17T17:50:26.609924+0000","last_peered":"2023-08-17T17:50:26.609924+0000","last_clean":"2023-08-17T17:50:26.609924+0000","last_became_active":"2023-08-17T17:50:26.602191+0000","last_became_peered":"2023-08-17T17:50:26.602191+0000","last_unstale":"2023-08-17T17:50:26.609924+0000","last_undegraded":"2023-08-17T17:50:26.609924+0000","last_fullsized":"2023-08-17T17:50:26.609924+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:50:25.568153+0000","last_clean_scrub_stamp":"2023-08-17T17:50:25.568153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-17T17:50:26.593730+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:50:26.593730+0000","last_peered":"2023-08-17T17:50:26.593730+0000","last_clean":"2023-08-17T17:50:26.593730+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:50:26.593730+0000","last_undegraded":"2023-08-17T17:50:26.593730+0000","last_fullsized":"2023-08-17T17:50:26.593730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575041,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302416,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069424,"statfs":{"total":96636764160,"available":96327090176,"internally_reserved":0,"allocated":1253376,"data_stored":616200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26000000000000001},"max":{"1min":0.61899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.496},{"interface":"front","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.504}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.69299999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77500000000000002,"15min":0.80000000000000004},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63200000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":1.23,"15min":1.23},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.64500000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.439},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.76900000000000002,"15min":0.86099999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.75700000000000001,"15min":0.95999999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73199999999999998,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72699999999999998,"5min":0.79400000000000004,"15min":0.90200000000000002},"last":0.52900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302416,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069424,"statfs":{"total":96636764160,"available":96327090176,"internally_reserved":0,"allocated":1253376,"data_stored":616200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85599999999999998,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66700000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.755,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.65700000000000003,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.503}]},{"osd":2,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.879,"15min":1.0609999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.60299999999999998},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.373},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":1.1080000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80100000000000005,"5min":0.96999999999999997,"15min":1.0780000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.26800000000000002},"max":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.432},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.77300000000000002,"15min":1.026},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.34200000000000003},"max":{"1min":0.81299999999999994,"5min":1.51,"15min":1.51},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.872,"15min":1.0740000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.56699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":1265664,"data_stored":622879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47099999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.378,"15min":0.373},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.72999999999999998},"last":0.308},{"interface":"front","average":{"1min":0.377,"5min":0.40400000000000003,"15min":0.40600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.219},"max":{"1min":0.58399999999999996,"5min":0.66300000000000003,"15min":0.83199999999999996},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.60399999999999998,"5min":0.625,"15min":0.66600000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40899999999999997,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.53600000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.624,"15min":0.622},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":1.2989999999999999,"15min":1.331},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.374}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":1.2629999999999999,"15min":1.345},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83799999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.433}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83599999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89900000000000002,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.48899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":1265664,"data_stored":622879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52600000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.312},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.65200000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.23499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.66200000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.23200000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.65700000000000003},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.97999999999999998,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.499},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.432},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.87,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.88300000000000001,"5min":1.677,"15min":1.677},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.087,"5min":1.51,"15min":1.51},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0069999999999999,"5min":1.325,"15min":1.391},"last":0.52800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89600000000000002,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.544},"last":0.57099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302416,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069424,"statfs":{"total":96636764160,"available":96327090176,"internally_reserved":0,"allocated":1253376,"data_stored":616200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.34999999999999998,"15min":0.35199999999999998},"min":{"1min":0.22700000000000001,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":0.49399999999999999,"5min":0.66300000000000003,"15min":0.81100000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.379,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45200000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.40100000000000002},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51800000000000002,"5min":0.59699999999999998,"15min":0.70199999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54800000000000004,"5min":0.61699999999999999,"15min":0.82299999999999995},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.311,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.52300000000000002,"5min":1.268,"15min":1.268},"last":0.375},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.222},"max":{"1min":0.46600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.308}]},{"osd":4,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.98799999999999999,"5min":1.417,"15min":1.417},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2869999999999999,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39000000000000001},"max":{"1min":1.2629999999999999,"5min":1.544,"15min":1.544},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":1.232,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0840000000000001,"5min":1.415,"15min":1.415},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68500000000000005,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88600000000000001,"5min":2.984,"15min":2.984},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302416,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069424,"statfs":{"total":96636764160,"available":96327090176,"internally_reserved":0,"allocated":1253376,"data_stored":616200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":0.45700000000000002,"5min":0.53100000000000003,"15min":0.69999999999999996},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.245,"5min":0.245,"15min":0.224},"max":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.71799999999999997},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.378},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38900000000000001,"15min":0.39200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":0.54600000000000004,"5min":0.57699999999999996,"15min":0.73199999999999998},"last":0.31}]},{"osd":2,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.317},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.439,"15min":0.42399999999999999},"min":{"1min":0.32200000000000001,"5min":0.245,"15min":0.245},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.26200000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.89000000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1989999999999998,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.626,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.442}]},{"osd":6,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.466,"15min":1.466},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.505}]},{"osd":7,"last update":"Thu Aug 17 17:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.48,"15min":1.48},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"max":{"1min":3.4780000000000002,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.45000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":1265664,"data_stored":622879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.379}]},{"osd":1,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.012,"5min":1.252,"15min":1.252},"last":0.5},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.47799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.28199999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66500000000000004,"5min":0.73199999999999998,"15min":0.86399999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.745},{"interface":"front","average":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":0.81299999999999994,"15min":0.94899999999999995},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Aug 17 17:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.373,"15min":0.33400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.91900000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78000000000000003,"5min":0.877,"15min":1.056},"last":0.78000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302416,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069424,"statfs":{"total":96636764160,"available":96327090176,"internally_reserved":0,"allocated":1253376,"data_stored":616200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.27700000000000002},"max":{"1min":0.66300000000000003,"5min":1.165,"15min":1.2609999999999999},"last":0.441},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.31},"max":{"1min":0.627,"5min":1.022,"15min":1.1499999999999999},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.29599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.242},"last":0.495},{"interface":"front","average":{"1min":0.495,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.0329999999999999,"15min":1.1399999999999999},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":1.0580000000000001,"15min":1.252},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.69699999999999995,"5min":1.153,"15min":1.274},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.379},"max":{"1min":0.68799999999999994,"5min":1.0920000000000001,"15min":1.179},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.3080000000000001},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.747,"5min":0.75,"15min":1.0620000000000001},"last":0.62},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.497,"15min":0.495},"min":{"1min":0.314,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":0.78300000000000003,"15min":1.0740000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":1.01},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.1020000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.73599999999999999,"5min":0.82299999999999995,"15min":1.038},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.36199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.1279999999999999},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:50:30.287 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T17:50:30.288 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T17:50:30.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.438+0000 7ffa35378700 1 Processor -- start 2023-08-17T17:50:30.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.438+0000 7ffa35378700 1 -- start start 2023-08-17T17:50:30.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa35378700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa30154110 0x7ffa300c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa35378700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa300c0cf0 0x7ffa300c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa35378700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffa300ca430 0x7ffa300c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa35378700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300c6970 con 0x7ffa300c0cf0 2023-08-17T17:50:30.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa35378700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300c1150 con 0x7ffa300ca430 2023-08-17T17:50:30.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa35378700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300cac90 con 0x7ffa30154110 2023-08-17T17:50:30.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa267fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa300c0cf0 0x7ffa300c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa267fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa300c0cf0 0x7ffa300c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37056/0 (socket says 172.21.15.78:37056) 2023-08-17T17:50:30.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa267fc700 1 -- 172.21.15.78:0/451979543 learned_addr learned my addr 172.21.15.78:0/451979543 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:30.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa2effd700 1 --2- 172.21.15.78:0/451979543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa30154110 0x7ffa300c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa2f7fe700 1 --2- 172.21.15.78:0/451979543 >> v2:172.21.15.150:3300/0 conn(0x7ffa300ca430 0x7ffa300c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa267fc700 1 -- 172.21.15.78:0/451979543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa30154110 msgr2=0x7ffa300c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:30.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa267fc700 1 --2- 172.21.15.78:0/451979543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa30154110 0x7ffa300c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa267fc700 1 -- 172.21.15.78:0/451979543 >> v2:172.21.15.150:3300/0 conn(0x7ffa300ca430 msgr2=0x7ffa300c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:30.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa267fc700 1 --2- 172.21.15.78:0/451979543 >> v2:172.21.15.150:3300/0 conn(0x7ffa300ca430 0x7ffa300c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa267fc700 1 -- 172.21.15.78:0/451979543 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300c6040 con 0x7ffa300c0cf0 2023-08-17T17:50:30.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.439+0000 7ffa2f7fe700 1 --2- 172.21.15.78:0/451979543 >> v2:172.21.15.150:3300/0 conn(0x7ffa300ca430 0x7ffa300c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:30.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa267fc700 1 --2- 172.21.15.78:0/451979543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 0x7ffa300c9f40 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7ffa3006c150 tx=0x7ffa180090f0).ready entity=mon.0 client_cookie=ffddf8f28c9227d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:30.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa2e7fc700 1 -- 172.21.15.78:0/451979543 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800b520 con 0x7ffa300c0cf0 2023-08-17T17:50:30.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa2e7fc700 1 -- 172.21.15.78:0/451979543 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1800b680 con 0x7ffa300c0cf0 2023-08-17T17:50:30.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa2e7fc700 1 -- 172.21.15.78:0/451979543 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800ba00 con 0x7ffa300c0cf0 2023-08-17T17:50:30.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa35378700 1 -- 172.21.15.78:0/451979543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 msgr2=0x7ffa300c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa35378700 1 --2- 172.21.15.78:0/451979543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 0x7ffa300c9f40 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7ffa3006c150 tx=0x7ffa180090f0).stop 2023-08-17T17:50:30.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa35378700 1 -- 172.21.15.78:0/451979543 shutdown_connections 2023-08-17T17:50:30.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa35378700 1 --2- 172.21.15.78:0/451979543 >> v2:172.21.15.150:3300/0 conn(0x7ffa300ca430 0x7ffa300c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa35378700 1 --2- 172.21.15.78:0/451979543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa30154110 0x7ffa300c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa35378700 1 --2- 172.21.15.78:0/451979543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 0x7ffa300c9f40 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa35378700 1 -- 172.21.15.78:0/451979543 >> 172.21.15.78:0/451979543 conn(0x7ffa30094650 msgr2=0x7ffa3006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:30.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa35378700 1 -- 172.21.15.78:0/451979543 shutdown_connections 2023-08-17T17:50:30.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.440+0000 7ffa35378700 1 -- 172.21.15.78:0/451979543 wait complete. 2023-08-17T17:50:30.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa35378700 1 Processor -- start 2023-08-17T17:50:30.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa35378700 1 -- start start 2023-08-17T17:50:30.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa35378700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 0x7ffa3014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa35378700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa300ca430 0x7ffa300ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa35378700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa30154110 0x7ffa300ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa35378700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300acb60 con 0x7ffa300c0cf0 2023-08-17T17:50:30.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa35378700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300ae8c0 con 0x7ffa300ca430 2023-08-17T17:50:30.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa35378700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300af440 con 0x7ffa30154110 2023-08-17T17:50:30.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa2effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 0x7ffa3014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa2effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 0x7ffa3014dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37064/0 (socket says 172.21.15.78:37064) 2023-08-17T17:50:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.442+0000 7ffa2effd700 1 -- 172.21.15.78:0/3923642811 learned_addr learned my addr 172.21.15.78:0/3923642811 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa2effd700 1 -- 172.21.15.78:0/3923642811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa30154110 msgr2=0x7ffa300ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa2effd700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa30154110 0x7ffa300ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa2effd700 1 -- 172.21.15.78:0/3923642811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa300ca430 msgr2=0x7ffa300ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa2effd700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa300ca430 0x7ffa300ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa2effd700 1 -- 172.21.15.78:0/3923642811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18009370 con 0x7ffa300c0cf0 2023-08-17T17:50:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa2effd700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 0x7ffa3014dd10 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7ffa2000e980 tx=0x7ffa20009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:30.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa277fe700 1 -- 172.21.15.78:0/3923642811 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000c850 con 0x7ffa300c0cf0 2023-08-17T17:50:30.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa277fe700 1 -- 172.21.15.78:0/3923642811 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2000c9b0 con 0x7ffa300c0cf0 2023-08-17T17:50:30.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa35378700 1 -- 172.21.15.78:0/3923642811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa300aeb10 con 0x7ffa300c0cf0 2023-08-17T17:50:30.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa277fe700 1 -- 172.21.15.78:0/3923642811 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000cd30 con 0x7ffa300c0cf0 2023-08-17T17:50:30.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.443+0000 7ffa35378700 1 -- 172.21.15.78:0/3923642811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa300af0d0 con 0x7ffa300c0cf0 2023-08-17T17:50:30.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.444+0000 7ffa35378700 1 -- 172.21.15.78:0/3923642811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa30047350 con 0x7ffa300c0cf0 2023-08-17T17:50:30.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.444+0000 7ffa277fe700 1 -- 172.21.15.78:0/3923642811 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ffa20022070 con 0x7ffa300c0cf0 2023-08-17T17:50:30.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.445+0000 7ffa277fe700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa1005ed90 0x7ffa10061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.445+0000 7ffa277fe700 1 -- 172.21.15.78:0/3923642811 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffa20079fd0 con 0x7ffa300c0cf0 2023-08-17T17:50:30.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.445+0000 7ffa267fc700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa1005ed90 0x7ffa10061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.445+0000 7ffa267fc700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa1005ed90 0x7ffa10061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ffa3006c150 tx=0x7ffa18017000).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:30.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.449+0000 7ffa277fe700 1 -- 172.21.15.78:0/3923642811 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa2004b570 con 0x7ffa300c0cf0 2023-08-17T17:50:30.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.674+0000 7ffa35378700 1 -- 172.21.15.78:0/3923642811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ffa300c6320 con 0x7ffa300c0cf0 2023-08-17T17:50:30.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.678+0000 7ffa277fe700 1 -- 172.21.15.78:0/3923642811 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7ffa20016020 con 0x7ffa300c0cf0 2023-08-17T17:50:30.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 -- 172.21.15.78:0/3923642811 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa1005ed90 msgr2=0x7ffa10061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa1005ed90 0x7ffa10061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ffa3006c150 tx=0x7ffa18017000).stop 2023-08-17T17:50:30.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 -- 172.21.15.78:0/3923642811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 msgr2=0x7ffa3014dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 0x7ffa3014dd10 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7ffa2000e980 tx=0x7ffa20009060).stop 2023-08-17T17:50:30.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 -- 172.21.15.78:0/3923642811 shutdown_connections 2023-08-17T17:50:30.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ffa1005ed90 0x7ffa10061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa30154110 0x7ffa300ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:30.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa300c0cf0 0x7ffa3014dd10 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 --2- 172.21.15.78:0/3923642811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa300ca430 0x7ffa300ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:30.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 -- 172.21.15.78:0/3923642811 >> 172.21.15.78:0/3923642811 conn(0x7ffa30094650 msgr2=0x7ffa300c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:30.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 -- 172.21.15.78:0/3923642811 shutdown_connections 2023-08-17T17:50:30.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.680+0000 7ffa35378700 1 -- 172.21.15.78:0/3923642811 wait complete. 2023-08-17T17:50:30.683 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-08-17T17:50:30.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:50:30.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.804+0000 7f78d9064700 1 Processor -- start 2023-08-17T17:50:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.804+0000 7f78d9064700 1 -- start start 2023-08-17T17:50:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.805+0000 7f78d9064700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f78d40a7bd0 0x7f78d4063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.805+0000 7f78d9064700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40a8050 0x7f78d40642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.805+0000 7f78d9064700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d4063960 con 0x7f78d40c01b0 2023-08-17T17:50:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.805+0000 7f78d9064700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d4063030 con 0x7f78d40a7bd0 2023-08-17T17:50:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.805+0000 7f78d9064700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d4063310 con 0x7f78d40a8050 2023-08-17T17:50:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.805+0000 7f78d8863700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40a8050 0x7f78d40642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.805+0000 7f78d37fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f78d40a7bd0 0x7f78d4063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.805+0000 7f78d8863700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40a8050 0x7f78d40642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:54844/0 (socket says 172.21.15.78:54844) 2023-08-17T17:50:30.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.805+0000 7f78d8863700 1 -- 172.21.15.78:0/3693712302 learned_addr learned my addr 172.21.15.78:0/3693712302 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:30.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.805+0000 7f78d3fff700 1 --1- 172.21.15.78:0/3693712302 >> v1:172.21.15.150:6789/0 conn(0x7f78d40c01b0 0x7f78d40c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:40430/0 (socket says 172.21.15.78:40430) 2023-08-17T17:50:30.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d8863700 1 -- 172.21.15.78:0/3693712302 >> v2:172.21.15.150:3300/0 conn(0x7f78d40a7bd0 msgr2=0x7f78d4063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:30.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d8863700 1 --2- 172.21.15.78:0/3693712302 >> v2:172.21.15.150:3300/0 conn(0x7f78d40a7bd0 0x7f78d4063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d8863700 1 -- 172.21.15.78:0/3693712302 >> v1:172.21.15.150:6789/0 conn(0x7f78d40c01b0 legacy=0x7f78d40c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d8863700 1 -- 172.21.15.78:0/3693712302 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d40635f0 con 0x7f78d40a8050 2023-08-17T17:50:30.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d8863700 1 --2- 172.21.15.78:0/3693712302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40a8050 0x7f78d40642e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f78cc009f20 tx=0x7f78cc009840).ready entity=mon.2 client_cookie=dee742ddc614634e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:30.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d2ffd700 1 -- 172.21.15.78:0/3693712302 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00e070 con 0x7f78d40a8050 2023-08-17T17:50:30.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d2ffd700 1 -- 172.21.15.78:0/3693712302 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc00b9d0 con 0x7f78d40a8050 2023-08-17T17:50:30.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d2ffd700 1 -- 172.21.15.78:0/3693712302 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00bd50 con 0x7f78d40a8050 2023-08-17T17:50:30.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d9064700 1 -- 172.21.15.78:0/3693712302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40a8050 msgr2=0x7f78d40642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d9064700 1 --2- 172.21.15.78:0/3693712302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40a8050 0x7f78d40642e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f78cc009f20 tx=0x7f78cc009840).stop 2023-08-17T17:50:30.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d9064700 1 -- 172.21.15.78:0/3693712302 shutdown_connections 2023-08-17T17:50:30.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d9064700 1 --2- 172.21.15.78:0/3693712302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40a8050 0x7f78d40642e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d9064700 1 --2- 172.21.15.78:0/3693712302 >> v2:172.21.15.150:3300/0 conn(0x7f78d40a7bd0 0x7f78d4063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.806+0000 7f78d9064700 1 -- 172.21.15.78:0/3693712302 >> 172.21.15.78:0/3693712302 conn(0x7f78d406a6c0 msgr2=0x7f78d40cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:30.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.807+0000 7f78d9064700 1 -- 172.21.15.78:0/3693712302 shutdown_connections 2023-08-17T17:50:30.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.807+0000 7f78d9064700 1 -- 172.21.15.78:0/3693712302 wait complete. 2023-08-17T17:50:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.808+0000 7f78d9064700 1 Processor -- start 2023-08-17T17:50:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.808+0000 7f78d9064700 1 -- start start 2023-08-17T17:50:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.808+0000 7f78d9064700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78d40a7bd0 0x7f78d4165290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.808+0000 7f78d9064700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d40a8050 0x7f78d40c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d9064700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40c01b0 0x7f78d41645e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d9064700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d40c4e00 con 0x7f78d40a8050 2023-08-17T17:50:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d9064700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d40ab9c0 con 0x7f78d40a7bd0 2023-08-17T17:50:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d9064700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d40abca0 con 0x7f78d40c01b0 2023-08-17T17:50:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d40a8050 0x7f78d40c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d40a8050 0x7f78d40c1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37066/0 (socket says 172.21.15.78:37066) 2023-08-17T17:50:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d37fe700 1 -- 172.21.15.78:0/1582286001 learned_addr learned my addr 172.21.15.78:0/1582286001 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:30.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d3fff700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78d40a7bd0 0x7f78d4165290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d8863700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40c01b0 0x7f78d41645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d37fe700 1 -- 172.21.15.78:0/1582286001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40c01b0 msgr2=0x7f78d41645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d37fe700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40c01b0 0x7f78d41645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d37fe700 1 -- 172.21.15.78:0/1582286001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78d40a7bd0 msgr2=0x7f78d4165290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:30.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d37fe700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78d40a7bd0 0x7f78d4165290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:30.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d37fe700 1 -- 172.21.15.78:0/1582286001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc009ae0 con 0x7f78d40a8050 2023-08-17T17:50:30.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d37fe700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d40a8050 0x7f78d40c1fa0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f78c800e930 tx=0x7f78c8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:30.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78bbfff700 1 -- 172.21.15.78:0/1582286001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8012600 con 0x7f78d40a8050 2023-08-17T17:50:30.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78bbfff700 1 -- 172.21.15.78:0/1582286001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c8012760 con 0x7f78d40a8050 2023-08-17T17:50:30.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d9064700 1 -- 172.21.15.78:0/1582286001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d40abf80 con 0x7f78d40a8050 2023-08-17T17:50:30.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78bbfff700 1 -- 172.21.15.78:0/1582286001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8012ae0 con 0x7f78d40a8050 2023-08-17T17:50:30.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.809+0000 7f78d9064700 1 -- 172.21.15.78:0/1582286001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d40c2650 con 0x7f78d40a8050 2023-08-17T17:50:30.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.810+0000 7f78d9064700 1 -- 172.21.15.78:0/1582286001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d4083af0 con 0x7f78d40a8050 2023-08-17T17:50:30.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.810+0000 7f78bbfff700 1 -- 172.21.15.78:0/1582286001 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f78c8022070 con 0x7f78d40a8050 2023-08-17T17:50:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.811+0000 7f78bbfff700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78c005ed90 0x7f78c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.811+0000 7f78bbfff700 1 -- 172.21.15.78:0/1582286001 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f78c8079e10 con 0x7f78d40a8050 2023-08-17T17:50:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.811+0000 7f78d3fff700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78c005ed90 0x7f78c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.811+0000 7f78d3fff700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78c005ed90 0x7f78c0061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f78c4007fd0 tx=0x7f78c4007d30).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:30.815+0000 7f78bbfff700 1 -- 172.21.15.78:0/1582286001 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78c804b3b0 con 0x7f78d40a8050 2023-08-17T17:50:31.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.019+0000 7f78d9064700 1 -- 172.21.15.78:0/1582286001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78d40c63e0 con 0x7f78d40a8050 2023-08-17T17:50:31.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.020+0000 7f78bbfff700 1 -- 172.21.15.78:0/1582286001 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f78c804e9d0 con 0x7f78d40a8050 2023-08-17T17:50:31.021 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:31.021 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2389298534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2389298534},{"type":"v1","addr":"172.21.15.150:6833","nonce":2389298534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2314598053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2314598053},{"type":"v1","addr":"172.21.15.150:6835","nonce":2314598053}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/687308464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":687308464},{"type":"v1","addr":"172.21.15.78:6836","nonce":687308464}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:50:26.944921+0000","modified":"2023-08-17T17:50:28.955568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7170":{"gid":7170,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/886333866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":886333866},{"type":"v1","addr":"172.21.15.78:6837","nonce":886333866}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T17:50:31.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.021+0000 7f78d9064700 1 -- 172.21.15.78:0/1582286001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78c005ed90 msgr2=0x7f78c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.021+0000 7f78d9064700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78c005ed90 0x7f78c0061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f78c4007fd0 tx=0x7f78c4007d30).stop 2023-08-17T17:50:31.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.021+0000 7f78d9064700 1 -- 172.21.15.78:0/1582286001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d40a8050 msgr2=0x7f78d40c1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.021+0000 7f78d9064700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d40a8050 0x7f78d40c1fa0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f78c800e930 tx=0x7f78c8009060).stop 2023-08-17T17:50:31.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.022+0000 7f78d9064700 1 -- 172.21.15.78:0/1582286001 shutdown_connections 2023-08-17T17:50:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.022+0000 7f78d9064700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78c005ed90 0x7f78c0061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.022+0000 7f78d9064700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78d40c01b0 0x7f78d41645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.022+0000 7f78d9064700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78d40a7bd0 0x7f78d4165290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.022+0000 7f78d9064700 1 --2- 172.21.15.78:0/1582286001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d40a8050 0x7f78d40c1fa0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.022+0000 7f78d9064700 1 -- 172.21.15.78:0/1582286001 >> 172.21.15.78:0/1582286001 conn(0x7f78d406a6c0 msgr2=0x7f78d414f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.022+0000 7f78d9064700 1 -- 172.21.15.78:0/1582286001 shutdown_connections 2023-08-17T17:50:31.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.022+0000 7f78d9064700 1 -- 172.21.15.78:0/1582286001 wait complete. 2023-08-17T17:50:31.025 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 37 2023-08-17T17:50:31.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T17:50:26.944921+0000', 'modified': '2023-08-17T17:50:28.955568+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7170}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7170': {'gid': 7170, 'name': 'c', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/886333866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6835', 'nonce': 886333866}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 886333866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T17:50:31.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T17:50:31.438 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-17T17:50:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.550+0000 7f6079245700 1 Processor -- start 2023-08-17T17:50:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.550+0000 7f6079245700 1 -- start start 2023-08-17T17:50:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.551+0000 7f6079245700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 0x7f60740a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.551+0000 7f6079245700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740c7690 con 0x7f60740c0560 2023-08-17T17:50:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.551+0000 7f6079245700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740c8df0 con 0x7f60741541a0 2023-08-17T17:50:31.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.551+0000 7f6079245700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60740a8190 con 0x7f6074154580 2023-08-17T17:50:31.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.551+0000 7f607359e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f60740c0560 0x7f60740c6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51476/0 (socket says 172.21.15.78:51476) 2023-08-17T17:50:31.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.551+0000 7f607359e700 1 -- 172.21.15.78:0/908907091 learned_addr learned my addr 172.21.15.78:0/908907091 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:31.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.551+0000 7f606a59c700 1 --2- 172.21.15.78:0/908907091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 0x7f60740a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.551+0000 7f607259c700 1 -- 172.21.15.78:0/908907091 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341435167 0 0) 0x7f606c001490 con 0x7f60740c0560 2023-08-17T17:50:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.551+0000 7f607259c700 1 -- 172.21.15.78:0/908907091 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60600033f0 con 0x7f60740c0560 2023-08-17T17:50:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.552+0000 7f607259c700 1 -- 172.21.15.78:0/908907091 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226825844 0 0) 0x7f60740c8df0 con 0x7f60741541a0 2023-08-17T17:50:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.552+0000 7f607259c700 1 -- 172.21.15.78:0/908907091 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f606c001490 con 0x7f60741541a0 2023-08-17T17:50:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.552+0000 7f607259c700 1 -- 172.21.15.78:0/908907091 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3052785356 0 0) 0x7f60600033f0 con 0x7f60740c0560 2023-08-17T17:50:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.552+0000 7f606a59c700 1 -- 172.21.15.78:0/908907091 >> v1:172.21.15.150:6789/0 conn(0x7f60741541a0 legacy=0x7f60740bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.552+0000 7f606a59c700 1 -- 172.21.15.78:0/908907091 >> v1:172.21.15.78:6789/0 conn(0x7f60740c0560 legacy=0x7f60740c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.552+0000 7f606a59c700 1 -- 172.21.15.78:0/908907091 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740c9970 con 0x7f6074154580 2023-08-17T17:50:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.552+0000 7f606a59c700 1 --2- 172.21.15.78:0/908907091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 0x7f60740a7ca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f605c009790 tx=0x7f605c009060).ready entity=mon.2 client_cookie=c73dc45533559c6e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.552+0000 7f607259c700 1 -- 172.21.15.78:0/908907091 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c001900 con 0x7f6074154580 2023-08-17T17:50:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.552+0000 7f607259c700 1 -- 172.21.15.78:0/908907091 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c0090d0 con 0x7f6074154580 2023-08-17T17:50:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.552+0000 7f607259c700 1 -- 172.21.15.78:0/908907091 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c011610 con 0x7f6074154580 2023-08-17T17:50:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.553+0000 7f6079245700 1 -- 172.21.15.78:0/908907091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 msgr2=0x7f60740a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.553+0000 7f6079245700 1 --2- 172.21.15.78:0/908907091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 0x7f60740a7ca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f605c009790 tx=0x7f605c009060).stop 2023-08-17T17:50:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.553+0000 7f6079245700 1 -- 172.21.15.78:0/908907091 shutdown_connections 2023-08-17T17:50:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.553+0000 7f6079245700 1 --2- 172.21.15.78:0/908907091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 0x7f60740a7ca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.553+0000 7f6079245700 1 -- 172.21.15.78:0/908907091 >> 172.21.15.78:0/908907091 conn(0x7f607406a400 msgr2=0x7f60740caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.553+0000 7f6079245700 1 -- 172.21.15.78:0/908907091 shutdown_connections 2023-08-17T17:50:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.553+0000 7f6079245700 1 -- 172.21.15.78:0/908907091 wait complete. 2023-08-17T17:50:31.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.554+0000 7f6079245700 1 Processor -- start 2023-08-17T17:50:31.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.554+0000 7f6079245700 1 -- start start 2023-08-17T17:50:31.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f6079245700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740c0560 0x7f60740ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f6079245700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60741541a0 0x7f607414dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f6079245700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 0x7f6074154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f6079245700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074150c40 con 0x7f60741541a0 2023-08-17T17:50:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f6079245700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074150f20 con 0x7f60740c0560 2023-08-17T17:50:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f6079245700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60741573f0 con 0x7f6074154580 2023-08-17T17:50:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f606a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60741541a0 0x7f607414dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f606a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60741541a0 0x7f607414dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37070/0 (socket says 172.21.15.78:37070) 2023-08-17T17:50:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f606a59c700 1 -- 172.21.15.78:0/1636234096 learned_addr learned my addr 172.21.15.78:0/1636234096 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f607359e700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 0x7f6074154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f6072d9d700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740c0560 0x7f60740ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f606a59c700 1 -- 172.21.15.78:0/1636234096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 msgr2=0x7f6074154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f606a59c700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 0x7f6074154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f606a59c700 1 -- 172.21.15.78:0/1636234096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740c0560 msgr2=0x7f60740ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f606a59c700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740c0560 0x7f60740ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f606a59c700 1 -- 172.21.15.78:0/1636234096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c0092a0 con 0x7f60741541a0 2023-08-17T17:50:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f6072d9d700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740c0560 0x7f60740ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f607359e700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 0x7f6074154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f606a59c700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60741541a0 0x7f607414dd00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f605c009d80 tx=0x7f605c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.555+0000 7f606b7fe700 1 -- 172.21.15.78:0/1636234096 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c0069b0 con 0x7f60741541a0 2023-08-17T17:50:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.556+0000 7f606b7fe700 1 -- 172.21.15.78:0/1636234096 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c0107c0 con 0x7f60741541a0 2023-08-17T17:50:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.556+0000 7f6079245700 1 -- 172.21.15.78:0/1636234096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60741576d0 con 0x7f60741541a0 2023-08-17T17:50:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.556+0000 7f606b7fe700 1 -- 172.21.15.78:0/1636234096 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c010b60 con 0x7f60741541a0 2023-08-17T17:50:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.556+0000 7f6079245700 1 -- 172.21.15.78:0/1636234096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60740aeb60 con 0x7f60741541a0 2023-08-17T17:50:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.557+0000 7f606b7fe700 1 -- 172.21.15.78:0/1636234096 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f605c023020 con 0x7f60741541a0 2023-08-17T17:50:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.557+0000 7f606b7fe700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f605405ed90 0x7f6054061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.557+0000 7f606b7fe700 1 -- 172.21.15.78:0/1636234096 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f605c07b100 con 0x7f60741541a0 2023-08-17T17:50:31.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.557+0000 7f6072d9d700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f605405ed90 0x7f6054061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.558+0000 7f6072d9d700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f605405ed90 0x7f6054061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6064000c00 tx=0x7f6064009040).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:31.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.559+0000 7f608abdab80 1 Processor -- start 2023-08-17T17:50:31.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.560+0000 7f608abdab80 1 -- start start 2023-08-17T17:50:31.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.560+0000 7f608abdab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f2086c20 0x5577f2087000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.560+0000 7f608abdab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 0x5577f2081f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.560+0000 7f608abdab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f2082870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.560+0000 7f608abdab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f204cd00 con 0x5577f20823f0 2023-08-17T17:50:31.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.560+0000 7f608abdab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f1fc3cb0 con 0x5577f2086c20 2023-08-17T17:50:31.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.560+0000 7f608abdab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577f1fd8c90 con 0x5577f20cf8c0 2023-08-17T17:50:31.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.560+0000 7f607359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f2082870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.560+0000 7f607359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f2082870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37076/0 (socket says 172.21.15.78:37076) 2023-08-17T17:50:31.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.560+0000 7f607359e700 1 -- 172.21.15.78:0/1767854408 learned_addr learned my addr 172.21.15.78:0/1767854408 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f6072d9d700 1 --2- 172.21.15.78:0/1767854408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f2086c20 0x5577f2087000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f606a59c700 1 --2- 172.21.15.78:0/1767854408 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 0x5577f2081f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f607359e700 1 -- 172.21.15.78:0/1767854408 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 msgr2=0x5577f2081f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f607359e700 1 --2- 172.21.15.78:0/1767854408 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 0x5577f2081f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f607359e700 1 -- 172.21.15.78:0/1767854408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f2086c20 msgr2=0x5577f2087000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f607359e700 1 --2- 172.21.15.78:0/1767854408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f2086c20 0x5577f2087000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f607359e700 1 -- 172.21.15.78:0/1767854408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577f1e7b310 con 0x5577f20823f0 2023-08-17T17:50:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f607359e700 1 --2- 172.21.15.78:0/1767854408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f2082870 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f606c007ee0 tx=0x7f606c009040).ready entity=mon.0 client_cookie=726e00895e1441de server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:31.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f6053fff700 1 -- 172.21.15.78:0/1767854408 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c00dcb0 con 0x5577f20823f0 2023-08-17T17:50:31.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f6053fff700 1 -- 172.21.15.78:0/1767854408 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c00de10 con 0x5577f20823f0 2023-08-17T17:50:31.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.561+0000 7f6053fff700 1 -- 172.21.15.78:0/1767854408 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c004c40 con 0x5577f20823f0 2023-08-17T17:50:31.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 -- 172.21.15.78:0/1767854408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 msgr2=0x5577f2082870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 --2- 172.21.15.78:0/1767854408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f2082870 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f606c007ee0 tx=0x7f606c009040).stop 2023-08-17T17:50:31.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 -- 172.21.15.78:0/1767854408 shutdown_connections 2023-08-17T17:50:31.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 --2- 172.21.15.78:0/1767854408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f2082870 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 --2- 172.21.15.78:0/1767854408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f2086c20 0x5577f2087000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 --2- 172.21.15.78:0/1767854408 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 0x5577f2081f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 -- 172.21.15.78:0/1767854408 >> 172.21.15.78:0/1767854408 conn(0x5577f1e43e40 msgr2=0x5577f20cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 -- 172.21.15.78:0/1767854408 shutdown_connections 2023-08-17T17:50:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 -- 172.21.15.78:0/1767854408 wait complete. 2023-08-17T17:50:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 -- start start 2023-08-17T17:50:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.562+0000 7f608abdab80 1 Processor -- start 2023-08-17T17:50:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.563+0000 7f608abdab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20823f0 0x5577f20a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.563+0000 7f608abdab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f2086c20 0x5577f20cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.563+0000 7f608abdab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 0x5577f20a7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.563+0000 7f608abdab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f1f9fef0 con 0x5577f2086c20 2023-08-17T17:50:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.563+0000 7f608abdab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f1fa48d0 con 0x5577f20823f0 2023-08-17T17:50:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.563+0000 7f608abdab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577f20a8380 con 0x5577f20cf8c0 2023-08-17T17:50:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.563+0000 7f608abdab80 10 client.0 ll_register_callbacks cb 0x5577f2046ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:50:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.563+0000 7f606a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f2086c20 0x5577f20cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.563+0000 7f606a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f2086c20 0x5577f20cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37078/0 (socket says 172.21.15.78:37078) 2023-08-17T17:50:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.563+0000 7f606a59c700 1 -- 172.21.15.78:0/508193974 learned_addr learned my addr 172.21.15.78:0/508193974 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f6072d9d700 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20823f0 0x5577f20a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f607359e700 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 0x5577f20a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f606a59c700 1 -- 172.21.15.78:0/508193974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 msgr2=0x5577f20a7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f606a59c700 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 0x5577f20a7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f606a59c700 1 -- 172.21.15.78:0/508193974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20823f0 msgr2=0x5577f20a8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f606a59c700 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20823f0 0x5577f20a8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f606a59c700 1 -- 172.21.15.78:0/508193974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c007a60 con 0x5577f2086c20 2023-08-17T17:50:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f607359e700 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 0x5577f20a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f6072d9d700 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20823f0 0x5577f20a8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:50:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f606a59c700 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f2086c20 0x5577f20cb860 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f605c04c860 tx=0x7f605c054040).ready entity=mon.0 client_cookie=4bd7bb9051587daa server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f60517fa700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:50:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f60517fa700 1 -- 172.21.15.78:0/508193974 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c04cc20 con 0x5577f2086c20 2023-08-17T17:50:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f60517fa700 1 -- 172.21.15.78:0/508193974 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f605c024e30 con 0x5577f2086c20 2023-08-17T17:50:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f608abdab80 1 -- 172.21.15.78:0/508193974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5577f20810f0 con 0x5577f2086c20 2023-08-17T17:50:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f60517fa700 1 -- 172.21.15.78:0/508193974 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f605c04fa60 con 0x5577f2086c20 2023-08-17T17:50:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f608abdab80 10 client.7323 fetch_fsmap learned FSMap version 37 2023-08-17T17:50:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f608abdab80 1 -- 172.21.15.78:0/508193974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5577f1fd1e70 con 0x5577f2086c20 2023-08-17T17:50:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f60517fa700 1 -- 172.21.15.78:0/508193974 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5577f20810f0 con 0x5577f2086c20 2023-08-17T17:50:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f60517fa700 1 -- 172.21.15.78:0/508193974 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f605c04c150 con 0x5577f2086c20 2023-08-17T17:50:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f608abdab80 10 client.7323 fetch_fsmap finished waiting for FSMap version 37 2023-08-17T17:50:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f608abdab80 10 client.7323 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T17:50:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f608abdab80 20 client.7323 populate_metadata read hostname 'smithi078' 2023-08-17T17:50:31.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f608abdab80 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.78:6835/886333866,v1:172.21.15.78:6837/886333866] conn(0x5577f20cd4c0 0x5577f20cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f608abdab80 4 client.7323 mds_command: new command op to 7170 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T17:50:31.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.564+0000 7f608abdab80 1 -- 172.21.15.78:0/508193974 --> [v2:172.21.15.78:6835/886333866,v1:172.21.15.78:6837/886333866] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5577f2050b50 con 0x5577f20cd4c0 2023-08-17T17:50:31.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.565+0000 7f6072d9d700 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.78:6835/886333866,v1:172.21.15.78:6837/886333866] conn(0x5577f20cd4c0 0x5577f20cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.565+0000 7f60517fa700 10 client.7323 ms_handle_connect on v2:172.21.15.78:6835/886333866 2023-08-17T17:50:31.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.565+0000 7f6072d9d700 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.78:6835/886333866,v1:172.21.15.78:6837/886333866] conn(0x5577f20cd4c0 0x5577f20cd8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bbe400217bfbfc1a server_cookie=7be8c042ebaba3b6 in_seq=0 out_seq=0 2023-08-17T17:50:31.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.565+0000 7f60517fa700 1 -- 172.21.15.78:0/508193974 <== mds.0 v2:172.21.15.78:6835/886333866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5577f2050b50 con 0x5577f20cd4c0 2023-08-17T17:50:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.565+0000 7f60517fa700 10 client.7323 handle_command_reply: tid=0 2023-08-17T17:50:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.565+0000 7f608abdab80 1 client.7323 shutdown 2023-08-17T17:50:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 1 -- 172.21.15.78:0/508193974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f2086c20 msgr2=0x5577f20cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f2086c20 0x5577f20cb860 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f605c04c860 tx=0x7f605c054040).stop 2023-08-17T17:50:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 1 -- 172.21.15.78:0/508193974 shutdown_connections 2023-08-17T17:50:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.78:6835/886333866,v1:172.21.15.78:6837/886333866] conn(0x5577f20cd4c0 0x5577f20cd8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f20cf8c0 0x5577f20a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f60517fa700 0 client.7323 ms_handle_reset on v2:172.21.15.78:6835/886333866 2023-08-17T17:50:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20823f0 0x5577f20a8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 1 --2- 172.21.15.78:0/508193974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f2086c20 0x5577f20cb860 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 1 -- 172.21.15.78:0/508193974 >> 172.21.15.78:0/508193974 conn(0x5577f1e43e40 msgr2=0x5577f20827d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 1 -- 172.21.15.78:0/508193974 shutdown_connections 2023-08-17T17:50:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 1 -- 172.21.15.78:0/508193974 wait complete. 2023-08-17T17:50:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.566+0000 7f608abdab80 20 client.7323 trim_cache size 0 max 16384 2023-08-17T17:50:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.582+0000 7f608abdab80 1 Processor -- start 2023-08-17T17:50:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.582+0000 7f608abdab80 1 -- start start 2023-08-17T17:50:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f608abdab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f608abdab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f2086c20 0x5577f20b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f608abdab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20cd4c0 0x5577f20cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f608abdab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f20891c0 con 0x5577f20823f0 2023-08-17T17:50:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f608abdab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f20cf610 con 0x5577f20cd4c0 2023-08-17T17:50:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f608abdab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577f207de30 con 0x5577f2086c20 2023-08-17T17:50:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f6072d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f6072d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37084/0 (socket says 172.21.15.78:37084) 2023-08-17T17:50:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f6072d9d700 1 -- 172.21.15.78:0/2005010069 learned_addr learned my addr 172.21.15.78:0/2005010069 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f6072d9d700 1 -- 172.21.15.78:0/2005010069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f2086c20 msgr2=0x5577f20b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f606a59c700 1 --2- 172.21.15.78:0/2005010069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f2086c20 0x5577f20b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f6072d9d700 1 --2- 172.21.15.78:0/2005010069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f2086c20 0x5577f20b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f6072d9d700 1 -- 172.21.15.78:0/2005010069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20cd4c0 msgr2=0x5577f20cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f6072d9d700 1 --2- 172.21.15.78:0/2005010069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20cd4c0 0x5577f20cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f6072d9d700 1 -- 172.21.15.78:0/2005010069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577f1fcd480 con 0x5577f20823f0 2023-08-17T17:50:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.583+0000 7f6072d9d700 1 --2- 172.21.15.78:0/2005010069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20b1c00 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f60640126c0 tx=0x7f6064012000).ready entity=mon.0 client_cookie=3644fc28fcfa99d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f606896f700 1 -- 172.21.15.78:0/2005010069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640236e0 con 0x5577f20823f0 2023-08-17T17:50:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f606896f700 1 -- 172.21.15.78:0/2005010069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064023840 con 0x5577f20823f0 2023-08-17T17:50:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f606896f700 1 -- 172.21.15.78:0/2005010069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640239b0 con 0x5577f20823f0 2023-08-17T17:50:31.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f608abdab80 1 -- 172.21.15.78:0/2005010069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 msgr2=0x5577f20b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f608abdab80 1 --2- 172.21.15.78:0/2005010069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20b1c00 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f60640126c0 tx=0x7f6064012000).stop 2023-08-17T17:50:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f608abdab80 1 -- 172.21.15.78:0/2005010069 shutdown_connections 2023-08-17T17:50:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f608abdab80 1 --2- 172.21.15.78:0/2005010069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20cd4c0 0x5577f20cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f608abdab80 1 --2- 172.21.15.78:0/2005010069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20b1c00 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f608abdab80 1 --2- 172.21.15.78:0/2005010069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f2086c20 0x5577f20b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f608abdab80 1 -- 172.21.15.78:0/2005010069 >> 172.21.15.78:0/2005010069 conn(0x5577f1e43e40 msgr2=0x5577f2084e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f608abdab80 1 -- 172.21.15.78:0/2005010069 shutdown_connections 2023-08-17T17:50:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.584+0000 7f608abdab80 1 -- 172.21.15.78:0/2005010069 wait complete. 2023-08-17T17:50:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.585+0000 7f608abdab80 1 -- start start 2023-08-17T17:50:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.585+0000 7f608abdab80 1 Processor -- start 2023-08-17T17:50:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f608abdab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20dabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f608abdab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f2086c20 0x5577f20db0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f608abdab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20cd4c0 0x5577f20cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f608abdab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f20ae830 con 0x5577f20823f0 2023-08-17T17:50:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f608abdab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f20ae9a0 con 0x5577f20cd4c0 2023-08-17T17:50:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f608abdab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577f20a7820 con 0x5577f2086c20 2023-08-17T17:50:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f608abdab80 10 client.0 ll_register_callbacks cb 0x5577f2046ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:50:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f6072d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20dabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f6072d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20dabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37092/0 (socket says 172.21.15.78:37092) 2023-08-17T17:50:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f6072d9d700 1 -- 172.21.15.78:0/3402200750 learned_addr learned my addr 172.21.15.78:0/3402200750 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f606a59c700 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f2086c20 0x5577f20db0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f607359e700 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20cd4c0 0x5577f20cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f6072d9d700 1 -- 172.21.15.78:0/3402200750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f2086c20 msgr2=0x5577f20db0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f6072d9d700 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f2086c20 0x5577f20db0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f6072d9d700 1 -- 172.21.15.78:0/3402200750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20cd4c0 msgr2=0x5577f20cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f6072d9d700 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20cd4c0 0x5577f20cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f6072d9d700 1 -- 172.21.15.78:0/3402200750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606401a040 con 0x5577f20823f0 2023-08-17T17:50:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f6072d9d700 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20dabc0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f6064007fd0 tx=0x7f6064014000).ready entity=mon.0 client_cookie=f17ec3f02cec3d39 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f60517fa700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:50:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f60517fa700 1 -- 172.21.15.78:0/3402200750 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640239b0 con 0x5577f20823f0 2023-08-17T17:50:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f60517fa700 1 -- 172.21.15.78:0/3402200750 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6064022d20 con 0x5577f20823f0 2023-08-17T17:50:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f608abdab80 1 -- 172.21.15.78:0/3402200750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f606c00de10 con 0x5577f20823f0 2023-08-17T17:50:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f60517fa700 1 -- 172.21.15.78:0/3402200750 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60640236e0 con 0x5577f20823f0 2023-08-17T17:50:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f608abdab80 10 client.7329 fetch_fsmap learned FSMap version 37 2023-08-17T17:50:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.586+0000 7f608abdab80 1 -- 172.21.15.78:0/3402200750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5577f1fcd1d0 con 0x5577f20823f0 2023-08-17T17:50:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f60517fa700 1 -- 172.21.15.78:0/3402200750 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c00de10 con 0x5577f20823f0 2023-08-17T17:50:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f60517fa700 1 -- 172.21.15.78:0/3402200750 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6064034020 con 0x5577f20823f0 2023-08-17T17:50:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f608abdab80 10 client.7329 fetch_fsmap finished waiting for FSMap version 37 2023-08-17T17:50:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f608abdab80 10 client.7329 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T17:50:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f608abdab80 20 client.7329 populate_metadata read hostname 'smithi078' 2023-08-17T17:50:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f608abdab80 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.78:6835/886333866,v1:172.21.15.78:6837/886333866] conn(0x5577f20cf8c0 0x5577f20ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f608abdab80 4 client.7329 mds_command: new command op to 7170 tid=0[{"prefix": "status"}] 2023-08-17T17:50:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f608abdab80 1 -- 172.21.15.78:0/3402200750 --> [v2:172.21.15.78:6835/886333866,v1:172.21.15.78:6837/886333866] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5577f1e3fca0 con 0x5577f20cf8c0 2023-08-17T17:50:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f606a59c700 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.78:6835/886333866,v1:172.21.15.78:6837/886333866] conn(0x5577f20cf8c0 0x5577f20ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f60517fa700 10 client.7329 ms_handle_connect on v2:172.21.15.78:6835/886333866 2023-08-17T17:50:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f606a59c700 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.78:6835/886333866,v1:172.21.15.78:6837/886333866] conn(0x5577f20cf8c0 0x5577f20ce100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3aec8eb395681bc6 server_cookie=8c88b33a933e20c in_seq=0 out_seq=0 2023-08-17T17:50:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f60517fa700 1 -- 172.21.15.78:0/3402200750 <== mds.0 v2:172.21.15.78:6835/886333866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5577f1e3fca0 con 0x5577f20cf8c0 2023-08-17T17:50:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f60517fa700 10 client.7329 handle_command_reply: tid=0 2023-08-17T17:50:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f608abdab80 1 client.7329 shutdown 2023-08-17T17:50:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f608abdab80 1 -- 172.21.15.78:0/3402200750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 msgr2=0x5577f20dabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.587+0000 7f608abdab80 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20dabc0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f6064007fd0 tx=0x7f6064014000).stop 2023-08-17T17:50:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f608abdab80 1 -- 172.21.15.78:0/3402200750 shutdown_connections 2023-08-17T17:50:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f608abdab80 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.78:6835/886333866,v1:172.21.15.78:6837/886333866] conn(0x5577f20cf8c0 0x5577f20ce100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f608abdab80 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577f20cd4c0 0x5577f20cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f608abdab80 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5577f20823f0 0x5577f20dabc0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f608abdab80 1 --2- 172.21.15.78:0/3402200750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5577f2086c20 0x5577f20db0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f60517fa700 0 client.7329 ms_handle_reset on v2:172.21.15.78:6835/886333866 2023-08-17T17:50:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f608abdab80 1 -- 172.21.15.78:0/3402200750 >> 172.21.15.78:0/3402200750 conn(0x5577f1e43e40 msgr2=0x5577f20b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f608abdab80 1 -- 172.21.15.78:0/3402200750 shutdown_connections 2023-08-17T17:50:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f608abdab80 1 -- 172.21.15.78:0/3402200750 wait complete. 2023-08-17T17:50:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f608abdab80 20 client.7329 trim_cache size 0 max 16384 2023-08-17T17:50:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:50:31.599 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T17:50:31.599 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T17:50:31.599 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 7170, 2023-08-17T17:50:31.599 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T17:50:31.599 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T17:50:31.600 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T17:50:31.600 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 4.6422307680000001, 2023-08-17T17:50:31.600 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 37, 2023-08-17T17:50:31.600 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 105, 2023-08-17T17:50:31.600 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 105, 2023-08-17T17:50:31.600 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 9.1670162600000005 2023-08-17T17:50:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:50:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 -- 172.21.15.78:0/1636234096 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f605405ed90 msgr2=0x7f6054061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f605405ed90 0x7f6054061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6064000c00 tx=0x7f6064009040).stop 2023-08-17T17:50:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 -- 172.21.15.78:0/1636234096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60741541a0 msgr2=0x7f607414dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60741541a0 0x7f607414dd00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f605c009d80 tx=0x7f605c016000).stop 2023-08-17T17:50:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 -- 172.21.15.78:0/1636234096 shutdown_connections 2023-08-17T17:50:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f605405ed90 0x7f6054061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074154580 0x7f6074154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740c0560 0x7f60740ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 --2- 172.21.15.78:0/1636234096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60741541a0 0x7f607414dd00 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 -- 172.21.15.78:0/1636234096 >> 172.21.15.78:0/1636234096 conn(0x7f607406a400 msgr2=0x7f607414f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 -- 172.21.15.78:0/1636234096 shutdown_connections 2023-08-17T17:50:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.588+0000 7f6079245700 1 -- 172.21.15.78:0/1636234096 wait complete. 2023-08-17T17:50:31.603 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T17:50:31.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.702+0000 7fd764d87700 1 Processor -- start 2023-08-17T17:50:31.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.702+0000 7fd764d87700 1 -- start start 2023-08-17T17:50:31.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.703+0000 7fd764d87700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7600c8290 0x7fd7600c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.703+0000 7fd764d87700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd760154dc0 0x7fd7600c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.703+0000 7fd764d87700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7600c1360 con 0x7fd7600c09f0 2023-08-17T17:50:31.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.703+0000 7fd764d87700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7600c8670 con 0x7fd760154dc0 2023-08-17T17:50:31.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.703+0000 7fd764d87700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600c5f50 con 0x7fd7600c8290 2023-08-17T17:50:31.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.703+0000 7fd75ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd760154dc0 0x7fd7600c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.703+0000 7fd75e59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7600c8290 0x7fd7600c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.703+0000 7fd75e59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7600c8290 0x7fd7600c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:54934/0 (socket says 172.21.15.78:54934) 2023-08-17T17:50:31.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.703+0000 7fd75ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd760154dc0 0x7fd7600c0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:40854/0 (socket says 172.21.15.78:40854) 2023-08-17T17:50:31.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.703+0000 7fd75e59c700 1 -- 172.21.15.78:0/876398209 learned_addr learned my addr 172.21.15.78:0/876398209 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd75ed9d700 1 -- 172.21.15.78:0/876398209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7600c8290 msgr2=0x7fd7600c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd75ed9d700 1 --2- 172.21.15.78:0/876398209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7600c8290 0x7fd7600c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd75ed9d700 1 -- 172.21.15.78:0/876398209 >> v1:172.21.15.150:6789/0 conn(0x7fd7600c09f0 legacy=0x7fd7601546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd75dd9b700 1 -- 172.21.15.78:0/876398209 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844227536 0 0) 0x7fd7600c1360 con 0x7fd7600c09f0 2023-08-17T17:50:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd75ed9d700 1 -- 172.21.15.78:0/876398209 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7601552f0 con 0x7fd760154dc0 2023-08-17T17:50:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd75ed9d700 1 --2- 172.21.15.78:0/876398209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd760154dc0 0x7fd7600c0e70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fd758009e60 tx=0x7fd758009780).ready entity=mon.1 client_cookie=20cc18756b8395c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd75dd9b700 1 -- 172.21.15.78:0/876398209 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800e070 con 0x7fd760154dc0 2023-08-17T17:50:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd75dd9b700 1 -- 172.21.15.78:0/876398209 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75800bb60 con 0x7fd760154dc0 2023-08-17T17:50:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd75dd9b700 1 -- 172.21.15.78:0/876398209 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758012410 con 0x7fd760154dc0 2023-08-17T17:50:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd764d87700 1 -- 172.21.15.78:0/876398209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd760154dc0 msgr2=0x7fd7600c0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd764d87700 1 --2- 172.21.15.78:0/876398209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd760154dc0 0x7fd7600c0e70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fd758009e60 tx=0x7fd758009780).stop 2023-08-17T17:50:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd764d87700 1 -- 172.21.15.78:0/876398209 shutdown_connections 2023-08-17T17:50:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd764d87700 1 --2- 172.21.15.78:0/876398209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd760154dc0 0x7fd7600c0e70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd764d87700 1 --2- 172.21.15.78:0/876398209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7600c8290 0x7fd7600c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd764d87700 1 -- 172.21.15.78:0/876398209 >> 172.21.15.78:0/876398209 conn(0x7fd760084df0 msgr2=0x7fd760094710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:31.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd764d87700 1 -- 172.21.15.78:0/876398209 shutdown_connections 2023-08-17T17:50:31.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.704+0000 7fd764d87700 1 -- 172.21.15.78:0/876398209 wait complete. 2023-08-17T17:50:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.706+0000 7fd764d87700 1 Processor -- start 2023-08-17T17:50:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.706+0000 7fd764d87700 1 -- start start 2023-08-17T17:50:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.706+0000 7fd764d87700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600c09f0 0x7fd760153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.706+0000 7fd764d87700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7600c8290 0x7fd7600adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.706+0000 7fd764d87700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd760154dc0 0x7fd7600ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.706+0000 7fd764d87700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600ae9a0 con 0x7fd7600c8290 2023-08-17T17:50:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.706+0000 7fd764d87700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600af1c0 con 0x7fd7600c09f0 2023-08-17T17:50:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.706+0000 7fd764d87700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600aeba0 con 0x7fd760154dc0 2023-08-17T17:50:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd755d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7600c8290 0x7fd7600adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd755d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7600c8290 0x7fd7600adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37104/0 (socket says 172.21.15.78:37104) 2023-08-17T17:50:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd755d9b700 1 -- 172.21.15.78:0/1323641120 learned_addr learned my addr 172.21.15.78:0/1323641120 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd75ed9d700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd760154dc0 0x7fd7600ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd75e59c700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600c09f0 0x7fd760153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd755d9b700 1 -- 172.21.15.78:0/1323641120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd760154dc0 msgr2=0x7fd7600ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd755d9b700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd760154dc0 0x7fd7600ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd755d9b700 1 -- 172.21.15.78:0/1323641120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600c09f0 msgr2=0x7fd760153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd755d9b700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600c09f0 0x7fd760153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd755d9b700 1 -- 172.21.15.78:0/1323641120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758009a20 con 0x7fd7600c8290 2023-08-17T17:50:31.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd75ed9d700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd760154dc0 0x7fd7600ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:50:31.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd755d9b700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7600c8290 0x7fd7600adfc0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fd74800c490 tx=0x7fd748007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:31.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd756ffd700 1 -- 172.21.15.78:0/1323641120 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748001ea0 con 0x7fd7600c8290 2023-08-17T17:50:31.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd756ffd700 1 -- 172.21.15.78:0/1323641120 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74800ce90 con 0x7fd7600c8290 2023-08-17T17:50:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd764d87700 1 -- 172.21.15.78:0/1323641120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7600aee80 con 0x7fd7600c8290 2023-08-17T17:50:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd756ffd700 1 -- 172.21.15.78:0/1323641120 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748007250 con 0x7fd7600c8290 2023-08-17T17:50:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.707+0000 7fd764d87700 1 -- 172.21.15.78:0/1323641120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7600af760 con 0x7fd7600c8290 2023-08-17T17:50:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.708+0000 7fd764d87700 1 -- 172.21.15.78:0/1323641120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd760047350 con 0x7fd7600c8290 2023-08-17T17:50:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.708+0000 7fd756ffd700 1 -- 172.21.15.78:0/1323641120 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd748010070 con 0x7fd7600c8290 2023-08-17T17:50:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.709+0000 7fd756ffd700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd74005ed90 0x7fd740061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.709+0000 7fd756ffd700 1 -- 172.21.15.78:0/1323641120 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd7480792c0 con 0x7fd7600c8290 2023-08-17T17:50:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.709+0000 7fd75e59c700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd74005ed90 0x7fd740061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.709+0000 7fd75e59c700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd74005ed90 0x7fd740061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd750006bc0 tx=0x7fd7500090f0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.713+0000 7fd756ffd700 1 -- 172.21.15.78:0/1323641120 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd74804a860 con 0x7fd7600c8290 2023-08-17T17:50:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.918+0000 7fd764d87700 1 -- 172.21.15.78:0/1323641120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd7600c8850 con 0x7fd7600c8290 2023-08-17T17:50:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.919+0000 7fd756ffd700 1 -- 172.21.15.78:0/1323641120 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd74804de80 con 0x7fd7600c8290 2023-08-17T17:50:31.920 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:50:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 -- 172.21.15.78:0/1323641120 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd74005ed90 msgr2=0x7fd740061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd74005ed90 0x7fd740061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd750006bc0 tx=0x7fd7500090f0).stop 2023-08-17T17:50:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 -- 172.21.15.78:0/1323641120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7600c8290 msgr2=0x7fd7600adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7600c8290 0x7fd7600adfc0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fd74800c490 tx=0x7fd748007dd0).stop 2023-08-17T17:50:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 -- 172.21.15.78:0/1323641120 shutdown_connections 2023-08-17T17:50:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd74005ed90 0x7fd740061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd760154dc0 0x7fd7600ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7600c09f0 0x7fd760153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 --2- 172.21.15.78:0/1323641120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7600c8290 0x7fd7600adfc0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 -- 172.21.15.78:0/1323641120 >> 172.21.15.78:0/1323641120 conn(0x7fd760084df0 msgr2=0x7fd760064d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 -- 172.21.15.78:0/1323641120 shutdown_connections 2023-08-17T17:50:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:31.921+0000 7fd764d87700 1 -- 172.21.15.78:0/1323641120 wait complete. 2023-08-17T17:50:31.932 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T17:50:31.933 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:50:31.933 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T17:50:31.933 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T17:50:31.934 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T17:50:31.934 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T17:50:31.934 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T17:50:31.934 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:50:31.935 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:50:31.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:31.935 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T17:50:31.950 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:50:31.950 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:50:31.950 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:50:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:50:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:31.951 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:50:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:50:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T17:50:31.951 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:50:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:50:31.952 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T17:50:31.952 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:50:31.952 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:50:31.952 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:50:31.952 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:50:31.952 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:50:31.952 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 41247sec preferred_lft 41247sec 2023-08-17T17:50:31.953 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T17:50:31.953 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:31.953 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:50:31.953 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:50:31.953 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T17:50:31.953 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:31.953 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T17:50:31.953 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:31.954 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:50:31.954 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T17:50:31.954 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link 2023-08-17T17:50:31.954 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:31.954 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:50:31.954 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T17:50:31.954 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::54:39ff:fe93:1c36/64 scope link 2023-08-17T17:50:31.954 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:50:31.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:31.955 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:50:32.013 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T17:50:32.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:32.014 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T17:50:32.069 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T17:50:32.069 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:50:32.069 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:50:32.069 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:50:32.069 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:50:32.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:32.070 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:50:32.070 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:50:32.071 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:50:32.071 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:50:32.071 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:50:32.071 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:50:32.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:32.168 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:50:32.182 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T17:50:32.182 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T17:50:32.182 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:50:32.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:32.183 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T17:50:32.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:32.246 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T17:50:32.300 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:50:32.300 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:50:32.379 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:50:32.379 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:50:32.404 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:50:32.404 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:50:32.406 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:50:32.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:50:32.407 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T17:50:32.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-17T17:50:32.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.623+0000 7f6294c76700 1 Processor -- start 2023-08-17T17:50:32.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.623+0000 7f6294c76700 1 -- start start 2023-08-17T17:50:32.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f6294c76700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6290069310 0x7f62900696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f6294c76700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62900c5ae0 0x7f62900c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f6294c76700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6290065ff0 con 0x7f6290066480 2023-08-17T17:50:32.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f6294c76700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62900653e0 con 0x7f62900c5ae0 2023-08-17T17:50:32.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f6294c76700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900656c0 con 0x7f6290069310 2023-08-17T17:50:32.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f628ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62900c5ae0 0x7f62900c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:32.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f628ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62900c5ae0 0x7f62900c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37114/0 (socket says 172.21.15.78:37114) 2023-08-17T17:50:32.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f628ed9d700 1 -- 172.21.15.78:0/4143720632 learned_addr learned my addr 172.21.15.78:0/4143720632 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:32.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f628ed9d700 1 -- 172.21.15.78:0/4143720632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6290069310 msgr2=0x7f62900696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:32.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f628ed9d700 1 --2- 172.21.15.78:0/4143720632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6290069310 0x7f62900696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:32.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f628ed9d700 1 -- 172.21.15.78:0/4143720632 >> v1:172.21.15.150:6789/0 conn(0x7f6290066480 legacy=0x7f62900c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:32.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f628ed9d700 1 -- 172.21.15.78:0/4143720632 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900659a0 con 0x7f62900c5ae0 2023-08-17T17:50:32.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.624+0000 7f628ed9d700 1 --2- 172.21.15.78:0/4143720632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62900c5ae0 0x7f62900c5f70 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f6288009f20 tx=0x7f6288009840).ready entity=mon.0 client_cookie=f65552ef5e1e568b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:32.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f628dd9b700 1 -- 172.21.15.78:0/4143720632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628800e070 con 0x7f62900c5ae0 2023-08-17T17:50:32.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f628dd9b700 1 -- 172.21.15.78:0/4143720632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628800ba40 con 0x7f62900c5ae0 2023-08-17T17:50:32.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f628dd9b700 1 -- 172.21.15.78:0/4143720632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628800bdc0 con 0x7f62900c5ae0 2023-08-17T17:50:32.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f6294c76700 1 -- 172.21.15.78:0/4143720632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62900c5ae0 msgr2=0x7f62900c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:32.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f6294c76700 1 --2- 172.21.15.78:0/4143720632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62900c5ae0 0x7f62900c5f70 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f6288009f20 tx=0x7f6288009840).stop 2023-08-17T17:50:32.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f6294c76700 1 -- 172.21.15.78:0/4143720632 shutdown_connections 2023-08-17T17:50:32.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f6294c76700 1 --2- 172.21.15.78:0/4143720632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62900c5ae0 0x7f62900c5f70 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:32.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f6294c76700 1 --2- 172.21.15.78:0/4143720632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6290069310 0x7f62900696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:32.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f6294c76700 1 -- 172.21.15.78:0/4143720632 >> 172.21.15.78:0/4143720632 conn(0x7f62900c8680 msgr2=0x7f62900c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:32.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f6294c76700 1 -- 172.21.15.78:0/4143720632 shutdown_connections 2023-08-17T17:50:32.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.625+0000 7f6294c76700 1 -- 172.21.15.78:0/4143720632 wait complete. 2023-08-17T17:50:32.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.626+0000 7f6294c76700 1 Processor -- start 2023-08-17T17:50:32.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.626+0000 7f6294c76700 1 -- start start 2023-08-17T17:50:32.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f6294c76700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6290066480 0x7f62900bf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f6294c76700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6290069310 0x7f629014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f6294c76700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62900c5ae0 0x7f62901651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f6294c76700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629014d780 con 0x7f6290069310 2023-08-17T17:50:32.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f6294c76700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629014dcb0 con 0x7f6290066480 2023-08-17T17:50:32.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f6294c76700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900a9120 con 0x7f62900c5ae0 2023-08-17T17:50:32.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f6285d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6290069310 0x7f629014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:32.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f6285d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6290069310 0x7f629014d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37130/0 (socket says 172.21.15.78:37130) 2023-08-17T17:50:32.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f6285d9b700 1 -- 172.21.15.78:0/4068379597 learned_addr learned my addr 172.21.15.78:0/4068379597 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:32.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f628e59c700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6290066480 0x7f62900bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:32.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f628ed9d700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62900c5ae0 0x7f62901651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:32.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.627+0000 7f6285d9b700 1 -- 172.21.15.78:0/4068379597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62900c5ae0 msgr2=0x7f62901651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:32.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.628+0000 7f6285d9b700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62900c5ae0 0x7f62901651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:32.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.628+0000 7f6285d9b700 1 -- 172.21.15.78:0/4068379597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6290066480 msgr2=0x7f62900bf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:32.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.628+0000 7f6285d9b700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6290066480 0x7f62900bf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.628+0000 7f6285d9b700 1 -- 172.21.15.78:0/4068379597 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6288009ae0 con 0x7f6290069310 2023-08-17T17:50:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.628+0000 7f6285d9b700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6290069310 0x7f629014d290 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f627800c490 tx=0x7f6278007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.628+0000 7f6286ffd700 1 -- 172.21.15.78:0/4068379597 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278007020 con 0x7f6290069310 2023-08-17T17:50:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.628+0000 7f6286ffd700 1 -- 172.21.15.78:0/4068379597 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62780071a0 con 0x7f6290069310 2023-08-17T17:50:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.628+0000 7f6294c76700 1 -- 172.21.15.78:0/4068379597 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62901656e0 con 0x7f6290069310 2023-08-17T17:50:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.628+0000 7f6286ffd700 1 -- 172.21.15.78:0/4068379597 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278007560 con 0x7f6290069310 2023-08-17T17:50:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.628+0000 7f6294c76700 1 -- 172.21.15.78:0/4068379597 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62900a8ad0 con 0x7f6290069310 2023-08-17T17:50:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.629+0000 7f6294c76700 1 -- 172.21.15.78:0/4068379597 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6290047350 con 0x7f6290069310 2023-08-17T17:50:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.629+0000 7f6286ffd700 1 -- 172.21.15.78:0/4068379597 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6278010070 con 0x7f6290069310 2023-08-17T17:50:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.629+0000 7f6286ffd700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f627005ed90 0x7f6270061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.630+0000 7f6286ffd700 1 -- 172.21.15.78:0/4068379597 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6278079670 con 0x7f6290069310 2023-08-17T17:50:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.630+0000 7f628e59c700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f627005ed90 0x7f6270061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.630+0000 7f628e59c700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f627005ed90 0x7f6270061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6290157bb0 tx=0x7f6280009060).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.633+0000 7f6286ffd700 1 -- 172.21.15.78:0/4068379597 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f627804ab00 con 0x7f6290069310 2023-08-17T17:50:32.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:50:32.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:50:32.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.830+0000 7f6294c76700 1 -- 172.21.15.78:0/4068379597 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f62900a9260 con 0x7f627005ed90 2023-08-17T17:50:32.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.831+0000 7f6286ffd700 1 -- 172.21.15.78:0/4068379597 <== mgr.6990 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f62900a9260 con 0x7f627005ed90 2023-08-17T17:50:32.832 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:50:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:50:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephfs" 2023-08-17T17:50:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:50:32.833 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:50:32.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 -- 172.21.15.78:0/4068379597 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f627005ed90 msgr2=0x7f6270061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:32.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f627005ed90 0x7f6270061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6290157bb0 tx=0x7f6280009060).stop 2023-08-17T17:50:32.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 -- 172.21.15.78:0/4068379597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6290069310 msgr2=0x7f629014d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:32.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6290069310 0x7f629014d290 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f627800c490 tx=0x7f6278007da0).stop 2023-08-17T17:50:32.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 -- 172.21.15.78:0/4068379597 shutdown_connections 2023-08-17T17:50:32.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f627005ed90 0x7f6270061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:32.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62900c5ae0 0x7f62901651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:32.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6290066480 0x7f62900bf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:32.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 --2- 172.21.15.78:0/4068379597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6290069310 0x7f629014d290 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:32.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 -- 172.21.15.78:0/4068379597 >> 172.21.15.78:0/4068379597 conn(0x7f62900c8680 msgr2=0x7f629014fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:32.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 -- 172.21.15.78:0/4068379597 shutdown_connections 2023-08-17T17:50:32.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.833+0000 7f6294c76700 1 -- 172.21.15.78:0/4068379597 wait complete. 2023-08-17T17:50:32.846 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-17T17:50:32.873 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:50:32.872+0000 7f3e547a0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:50:32.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.988+0000 7fb63ed21700 1 Processor -- start 2023-08-17T17:50:32.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.988+0000 7fb63ed21700 1 -- start start 2023-08-17T17:50:32.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63ed21700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb6381582f0 0x7fb6380c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63ed21700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6380c6620 con 0x7fb638151a40 2023-08-17T17:50:32.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63ed21700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6380c6900 con 0x7fb638151e20 2023-08-17T17:50:32.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63ed21700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6380c6be0 con 0x7fb6381582f0 2023-08-17T17:50:32.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63dd1f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb638151a40 0x7fb6380c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51486/0 (socket says 172.21.15.78:51486) 2023-08-17T17:50:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63e520700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb6381582f0 0x7fb6380c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63dd1f700 1 -- 172.21.15.78:0/2676191332 learned_addr learned my addr 172.21.15.78:0/2676191332 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63cd1d700 1 -- 172.21.15.78:0/2676191332 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840412098 0 0) 0x7fb6380c6620 con 0x7fb638151a40 2023-08-17T17:50:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63cd1d700 1 -- 172.21.15.78:0/2676191332 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6240033f0 con 0x7fb638151a40 2023-08-17T17:50:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63e520700 1 -- 172.21.15.78:0/2676191332 >> v1:172.21.15.150:6789/0 conn(0x7fb638151e20 legacy=0x7fb638157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63e520700 1 -- 172.21.15.78:0/2676191332 >> v1:172.21.15.78:6789/0 conn(0x7fb638151a40 legacy=0x7fb6380c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63e520700 1 -- 172.21.15.78:0/2676191332 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380c6ec0 con 0x7fb6381582f0 2023-08-17T17:50:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63e520700 1 --2- 172.21.15.78:0/2676191332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6381582f0 0x7fb6380c8260 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7fb630009760 tx=0x7fb630009060).ready entity=mon.0 client_cookie=2d03ab8ce3d96f3b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63cd1d700 1 -- 172.21.15.78:0/2676191332 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000f510 con 0x7fb6381582f0 2023-08-17T17:50:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63cd1d700 1 -- 172.21.15.78:0/2676191332 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63000f670 con 0x7fb6381582f0 2023-08-17T17:50:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.989+0000 7fb63cd1d700 1 -- 172.21.15.78:0/2676191332 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000f9f0 con 0x7fb6381582f0 2023-08-17T17:50:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.990+0000 7fb63ed21700 1 -- 172.21.15.78:0/2676191332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6381582f0 msgr2=0x7fb6380c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.990+0000 7fb63ed21700 1 --2- 172.21.15.78:0/2676191332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6381582f0 0x7fb6380c8260 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7fb630009760 tx=0x7fb630009060).stop 2023-08-17T17:50:32.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.990+0000 7fb63ed21700 1 -- 172.21.15.78:0/2676191332 shutdown_connections 2023-08-17T17:50:32.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.990+0000 7fb63ed21700 1 --2- 172.21.15.78:0/2676191332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6381582f0 0x7fb6380c8260 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:32.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.990+0000 7fb63ed21700 1 -- 172.21.15.78:0/2676191332 >> 172.21.15.78:0/2676191332 conn(0x7fb6380943b0 msgr2=0x7fb63806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:32.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.990+0000 7fb63ed21700 1 -- 172.21.15.78:0/2676191332 shutdown_connections 2023-08-17T17:50:32.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.990+0000 7fb63ed21700 1 -- 172.21.15.78:0/2676191332 wait complete. 2023-08-17T17:50:32.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.991+0000 7fb63ed21700 1 Processor -- start 2023-08-17T17:50:32.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.991+0000 7fb63ed21700 1 -- start start 2023-08-17T17:50:32.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63ed21700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb638151a40 0x7fb6380c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63ed21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb638151e20 0x7fb638144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63ed21700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6381582f0 0x7fb6380ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63ed21700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380ab800 con 0x7fb638151a40 2023-08-17T17:50:32.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63ed21700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380abae0 con 0x7fb638151e20 2023-08-17T17:50:32.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63ed21700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380abdc0 con 0x7fb6381582f0 2023-08-17T17:50:32.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63dd1f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb638151a40 0x7fb6380c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:32.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63dd1f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb638151a40 0x7fb6380c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37146/0 (socket says 172.21.15.78:37146) 2023-08-17T17:50:32.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63dd1f700 1 -- 172.21.15.78:0/3541187323 learned_addr learned my addr 172.21.15.78:0/3541187323 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:32.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63d51e700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb638151e20 0x7fb638144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:32.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63e520700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6381582f0 0x7fb6380ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63dd1f700 1 -- 172.21.15.78:0/3541187323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6381582f0 msgr2=0x7fb6380ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63dd1f700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6381582f0 0x7fb6380ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63dd1f700 1 -- 172.21.15.78:0/3541187323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb638151e20 msgr2=0x7fb638144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63dd1f700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb638151e20 0x7fb638144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63dd1f700 1 -- 172.21.15.78:0/3541187323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300092a0 con 0x7fb638151a40 2023-08-17T17:50:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.992+0000 7fb63dd1f700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb638151a40 0x7fb6380c25f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fb63400c810 tx=0x7fb634007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.993+0000 7fb62dffb700 1 -- 172.21.15.78:0/3541187323 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634005c00 con 0x7fb638151a40 2023-08-17T17:50:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.993+0000 7fb62dffb700 1 -- 172.21.15.78:0/3541187323 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634005d60 con 0x7fb638151a40 2023-08-17T17:50:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.993+0000 7fb63ed21700 1 -- 172.21.15.78:0/3541187323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6380ac0a0 con 0x7fb638151a40 2023-08-17T17:50:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.993+0000 7fb62dffb700 1 -- 172.21.15.78:0/3541187323 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634007320 con 0x7fb638151a40 2023-08-17T17:50:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.993+0000 7fb63ed21700 1 -- 172.21.15.78:0/3541187323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb638144fc0 con 0x7fb638151a40 2023-08-17T17:50:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.994+0000 7fb63ed21700 1 -- 172.21.15.78:0/3541187323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb638082f90 con 0x7fb638151a40 2023-08-17T17:50:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.994+0000 7fb62dffb700 1 -- 172.21.15.78:0/3541187323 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb634010030 con 0x7fb638151a40 2023-08-17T17:50:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.995+0000 7fb62dffb700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61c05ed90 0x7fb61c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.995+0000 7fb62dffb700 1 -- 172.21.15.78:0/3541187323 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb634079960 con 0x7fb638151a40 2023-08-17T17:50:33.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.995+0000 7fb63d51e700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61c05ed90 0x7fb61c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:33.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.995+0000 7fb63d51e700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61c05ed90 0x7fb61c061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb6380ad5e0 tx=0x7fb628007d70).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:33.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:32.999+0000 7fb62dffb700 1 -- 172.21.15.78:0/3541187323 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb63404af00 con 0x7fb638151a40 2023-08-17T17:50:33.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.205+0000 7fb63ed21700 1 -- 172.21.15.78:0/3541187323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb6380ab940 con 0x7fb638151a40 2023-08-17T17:50:33.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.982+0000 7fb62dffb700 1 -- 172.21.15.78:0/3541187323 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 39) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fb634077860 con 0x7fb638151a40 2023-08-17T17:50:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.984+0000 7fb62dffb700 1 -- 172.21.15.78:0/3541187323 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v39) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb634072bb0 con 0x7fb638151a40 2023-08-17T17:50:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 -- 172.21.15.78:0/3541187323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61c05ed90 msgr2=0x7fb61c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61c05ed90 0x7fb61c061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb6380ad5e0 tx=0x7fb628007d70).stop 2023-08-17T17:50:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 -- 172.21.15.78:0/3541187323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb638151a40 msgr2=0x7fb6380c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb638151a40 0x7fb6380c25f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fb63400c810 tx=0x7fb634007e80).stop 2023-08-17T17:50:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 -- 172.21.15.78:0/3541187323 shutdown_connections 2023-08-17T17:50:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb61c05ed90 0x7fb61c061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:33.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6381582f0 0x7fb6380ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:33.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb638151a40 0x7fb6380c25f0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:33.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 --2- 172.21.15.78:0/3541187323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb638151e20 0x7fb638144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:33.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 -- 172.21.15.78:0/3541187323 >> 172.21.15.78:0/3541187323 conn(0x7fb6380943b0 msgr2=0x7fb63814b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:33.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 -- 172.21.15.78:0/3541187323 shutdown_connections 2023-08-17T17:50:33.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:33.986+0000 7fb63ed21700 1 -- 172.21.15.78:0/3541187323 wait complete. 2023-08-17T17:50:34.005 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-17T17:50:34.122 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:34.120+0000 7f69e2f21680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:50:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.125+0000 7fecffa16700 1 Processor -- start 2023-08-17T17:50:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.125+0000 7fecffa16700 1 -- start start 2023-08-17T17:50:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.126+0000 7fecffa16700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fecf813a740 0x7fecf8069f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.126+0000 7fecffa16700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf8069b00 con 0x7fecf8154cf0 2023-08-17T17:50:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.126+0000 7fecffa16700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf813ab20 con 0x7fecf80624f0 2023-08-17T17:50:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.126+0000 7fecffa16700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf8155640 con 0x7fecf813a740 2023-08-17T17:50:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.126+0000 7fecfdfb3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fecf8154cf0 0x7fecf80c2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51502/0 (socket says 172.21.15.78:51502) 2023-08-17T17:50:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.126+0000 7fecfdfb3700 1 -- 172.21.15.78:0/1174121872 learned_addr learned my addr 172.21.15.78:0/1174121872 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7fecfd7b2700 1 --2- 172.21.15.78:0/1174121872 >> v2:172.21.15.150:3300/0 conn(0x7fecf813a740 0x7fecf8069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7feceffff700 1 -- 172.21.15.78:0/1174121872 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396092345 0 0) 0x7fecf8069b00 con 0x7fecf8154cf0 2023-08-17T17:50:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7feceffff700 1 -- 172.21.15.78:0/1174121872 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece40033f0 con 0x7fecf8154cf0 2023-08-17T17:50:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7fecfd7b2700 1 -- 172.21.15.78:0/1174121872 >> v1:172.21.15.150:6789/0 conn(0x7fecf80624f0 legacy=0x7fecf81545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7fecfd7b2700 1 -- 172.21.15.78:0/1174121872 >> v1:172.21.15.78:6789/0 conn(0x7fecf8154cf0 legacy=0x7fecf80c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7feceffff700 1 -- 172.21.15.78:0/1174121872 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2224225490 0 0) 0x7fece40033f0 con 0x7fecf8154cf0 2023-08-17T17:50:34.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7fecfd7b2700 1 -- 172.21.15.78:0/1174121872 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf8155360 con 0x7fecf813a740 2023-08-17T17:50:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7fecfd7b2700 1 --2- 172.21.15.78:0/1174121872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf813a740 0x7fecf8069f90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fece8009760 tx=0x7fece8009060).ready entity=mon.1 client_cookie=804af717721e80c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7feceffff700 1 -- 172.21.15.78:0/1174121872 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00017f0 con 0x7fecf813a740 2023-08-17T17:50:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7feceffff700 1 -- 172.21.15.78:0/1174121872 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8011400 con 0x7fecf813a740 2023-08-17T17:50:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.127+0000 7feceffff700 1 -- 172.21.15.78:0/1174121872 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8011780 con 0x7fecf813a740 2023-08-17T17:50:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.128+0000 7fecffa16700 1 -- 172.21.15.78:0/1174121872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf813a740 msgr2=0x7fecf8069f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.128+0000 7fecffa16700 1 --2- 172.21.15.78:0/1174121872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf813a740 0x7fecf8069f90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fece8009760 tx=0x7fece8009060).stop 2023-08-17T17:50:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.128+0000 7fecffa16700 1 -- 172.21.15.78:0/1174121872 shutdown_connections 2023-08-17T17:50:34.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.128+0000 7fecffa16700 1 --2- 172.21.15.78:0/1174121872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf813a740 0x7fecf8069f90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.128+0000 7fecffa16700 1 -- 172.21.15.78:0/1174121872 >> 172.21.15.78:0/1174121872 conn(0x7fecf80c7b80 msgr2=0x7fecf80c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:34.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.128+0000 7fecffa16700 1 -- 172.21.15.78:0/1174121872 shutdown_connections 2023-08-17T17:50:34.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.128+0000 7fecffa16700 1 -- 172.21.15.78:0/1174121872 wait complete. 2023-08-17T17:50:34.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.129+0000 7fecffa16700 1 Processor -- start 2023-08-17T17:50:34.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.129+0000 7fecffa16700 1 -- start start 2023-08-17T17:50:34.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecffa16700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf80624f0 0x7fecf80a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecffa16700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf813a740 0x7fecf81378e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecffa16700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf8154cf0 0x7fecf8167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecffa16700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80a8e50 con 0x7fecf80624f0 2023-08-17T17:50:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecffa16700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80a99d0 con 0x7fecf813a740 2023-08-17T17:50:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecffa16700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80a90a0 con 0x7fecf8154cf0 2023-08-17T17:50:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfd7b2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf80624f0 0x7fecf80a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfd7b2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf80624f0 0x7fecf80a9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37170/0 (socket says 172.21.15.78:37170) 2023-08-17T17:50:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfd7b2700 1 -- 172.21.15.78:0/1740151215 learned_addr learned my addr 172.21.15.78:0/1740151215 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfdfb3700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf8154cf0 0x7fecf8167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfcfb1700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf813a740 0x7fecf81378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfd7b2700 1 -- 172.21.15.78:0/1740151215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf8154cf0 msgr2=0x7fecf8167fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfd7b2700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf8154cf0 0x7fecf8167fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfd7b2700 1 -- 172.21.15.78:0/1740151215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf813a740 msgr2=0x7fecf81378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfd7b2700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf813a740 0x7fecf81378e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfd7b2700 1 -- 172.21.15.78:0/1740151215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece80092a0 con 0x7fecf80624f0 2023-08-17T17:50:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.130+0000 7fecfd7b2700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf80624f0 0x7fecf80a9e60 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7fece8009e00 tx=0x7fece8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.131+0000 7feced7fa700 1 -- 172.21.15.78:0/1740151215 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8010800 con 0x7fecf80624f0 2023-08-17T17:50:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.131+0000 7feced7fa700 1 -- 172.21.15.78:0/1740151215 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8010960 con 0x7fecf80624f0 2023-08-17T17:50:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.131+0000 7fecffa16700 1 -- 172.21.15.78:0/1740151215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf80a9380 con 0x7fecf80624f0 2023-08-17T17:50:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.131+0000 7feced7fa700 1 -- 172.21.15.78:0/1740151215 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8010d20 con 0x7fecf80624f0 2023-08-17T17:50:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.131+0000 7fecffa16700 1 -- 172.21.15.78:0/1740151215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf8137dd0 con 0x7fecf80624f0 2023-08-17T17:50:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.132+0000 7fecffa16700 1 -- 172.21.15.78:0/1740151215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf80a9cb0 con 0x7fecf80624f0 2023-08-17T17:50:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.132+0000 7feced7fa700 1 -- 172.21.15.78:0/1740151215 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 39) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fece800f070 con 0x7fecf80624f0 2023-08-17T17:50:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.132+0000 7feced7fa700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecdc05ee10 0x7fecdc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.132+0000 7fecfcfb1700 1 -- 172.21.15.78:0/1740151215 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecdc05ee10 msgr2=0x7fecdc0612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.133+0000 7feced7fa700 1 -- 172.21.15.78:0/1740151215 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fece807ae80 con 0x7fecf80624f0 2023-08-17T17:50:34.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.133+0000 7fecfcfb1700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecdc05ee10 0x7fecdc0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:34.138 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:34.134+0000 7fb6d9859680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:50:34.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.136+0000 7feced7fa700 1 -- 172.21.15.78:0/1740151215 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fece804c420 con 0x7fecf80624f0 2023-08-17T17:50:34.184 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:34.182+0000 7f69e2f21680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:50:34.200 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:34.199+0000 7fb6d9859680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:50:34.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.308+0000 7fecffa16700 1 -- 172.21.15.78:0/1740151215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fecf8068270 con 0x7fecf80624f0 2023-08-17T17:50:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.313+0000 7feced7fa700 1 -- 172.21.15.78:0/1740151215 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v19)=0 v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fece8016030 con 0x7fecf80624f0 2023-08-17T17:50:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.315+0000 7fecffa16700 1 -- 172.21.15.78:0/1740151215 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecdc05ee10 msgr2=0x7fecdc0612d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.315+0000 7fecffa16700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecdc05ee10 0x7fecdc0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.315+0000 7fecffa16700 1 -- 172.21.15.78:0/1740151215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf80624f0 msgr2=0x7fecf80a9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.315+0000 7fecffa16700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf80624f0 0x7fecf80a9e60 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7fece8009e00 tx=0x7fece8014000).stop 2023-08-17T17:50:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.316+0000 7fecffa16700 1 -- 172.21.15.78:0/1740151215 shutdown_connections 2023-08-17T17:50:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.316+0000 7fecffa16700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fecdc05ee10 0x7fecdc0612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:34.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.316+0000 7fecffa16700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf8154cf0 0x7fecf8167fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.316+0000 7fecffa16700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf80624f0 0x7fecf80a9e60 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.316+0000 7fecffa16700 1 --2- 172.21.15.78:0/1740151215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf813a740 0x7fecf81378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.316+0000 7fecffa16700 1 -- 172.21.15.78:0/1740151215 >> 172.21.15.78:0/1740151215 conn(0x7fecf80c7b80 msgr2=0x7fecf8156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:34.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.316+0000 7fecffa16700 1 -- 172.21.15.78:0/1740151215 shutdown_connections 2023-08-17T17:50:34.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.316+0000 7fecffa16700 1 -- 172.21.15.78:0/1740151215 wait complete. 2023-08-17T17:50:34.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-08-17T17:50:34.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.450+0000 7f195bef7700 1 Processor -- start 2023-08-17T17:50:34.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.450+0000 7f195bef7700 1 -- start start 2023-08-17T17:50:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f195bef7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f195413a500 0x7f19540bcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f195bef7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195413a8e0 0x7f19540aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f195bef7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f19540bd830 0x7f19540bdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f195bef7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540652c0 con 0x7f195413a500 2023-08-17T17:50:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f195bef7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540be180 con 0x7f19540bd830 2023-08-17T17:50:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f195bef7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1954065560 con 0x7f195413a8e0 2023-08-17T17:50:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1959c93700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f195413a500 0x7f19540bcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1959c93700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f195413a500 0x7f19540bcb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37180/0 (socket says 172.21.15.78:37180) 2023-08-17T17:50:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1959c93700 1 -- 172.21.15.78:0/16819479 learned_addr learned my addr 172.21.15.78:0/16819479 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1959492700 1 --2- 172.21.15.78:0/16819479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195413a8e0 0x7f19540aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f195a494700 1 --2- 172.21.15.78:0/16819479 >> v2:172.21.15.150:3300/0 conn(0x7f19540bd830 0x7f19540bdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1959c93700 1 -- 172.21.15.78:0/16819479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195413a8e0 msgr2=0x7f19540aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1959c93700 1 --2- 172.21.15.78:0/16819479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195413a8e0 0x7f19540aac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1959c93700 1 -- 172.21.15.78:0/16819479 >> v2:172.21.15.150:3300/0 conn(0x7f19540bd830 msgr2=0x7f19540bdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:50:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1959c93700 1 --2- 172.21.15.78:0/16819479 >> v2:172.21.15.150:3300/0 conn(0x7f19540bd830 0x7f19540bdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1959c93700 1 -- 172.21.15.78:0/16819479 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1954065840 con 0x7f195413a500 2023-08-17T17:50:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1959c93700 1 --2- 172.21.15.78:0/16819479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 0x7f19540bcb30 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f1954068e60 tx=0x7f19500090f0).ready entity=mon.0 client_cookie=f5944098d9ecc544 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.451+0000 7f1958c91700 1 -- 172.21.15.78:0/16819479 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195000f510 con 0x7f195413a500 2023-08-17T17:50:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f1958c91700 1 -- 172.21.15.78:0/16819479 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195000f670 con 0x7f195413a500 2023-08-17T17:50:34.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f1958c91700 1 -- 172.21.15.78:0/16819479 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195000fa10 con 0x7f195413a500 2023-08-17T17:50:34.456 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:34.454+0000 7f69e2f21680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:50:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f195bef7700 1 -- 172.21.15.78:0/16819479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 msgr2=0x7f19540bcb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f195bef7700 1 --2- 172.21.15.78:0/16819479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 0x7f19540bcb30 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f1954068e60 tx=0x7f19500090f0).stop 2023-08-17T17:50:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f195bef7700 1 -- 172.21.15.78:0/16819479 shutdown_connections 2023-08-17T17:50:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f195bef7700 1 --2- 172.21.15.78:0/16819479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 0x7f19540bcb30 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f195bef7700 1 --2- 172.21.15.78:0/16819479 >> v2:172.21.15.150:3300/0 conn(0x7f19540bd830 0x7f19540bdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f195bef7700 1 --2- 172.21.15.78:0/16819479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195413a8e0 0x7f19540aac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f195bef7700 1 -- 172.21.15.78:0/16819479 >> 172.21.15.78:0/16819479 conn(0x7f19540c7bd0 msgr2=0x7f19540c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f195bef7700 1 -- 172.21.15.78:0/16819479 shutdown_connections 2023-08-17T17:50:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.452+0000 7f195bef7700 1 -- 172.21.15.78:0/16819479 wait complete. 2023-08-17T17:50:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.453+0000 7f195bef7700 1 Processor -- start 2023-08-17T17:50:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.453+0000 7f195bef7700 1 -- start start 2023-08-17T17:50:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.454+0000 7f195bef7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19540bd830 0x7f1954151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.454+0000 7f195bef7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 0x7f19540c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.454+0000 7f195bef7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195413a8e0 0x7f19540c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.454+0000 7f195bef7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540c5030 con 0x7f195413a500 2023-08-17T17:50:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.454+0000 7f195bef7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19541524c0 con 0x7f19540bd830 2023-08-17T17:50:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.454+0000 7f195bef7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540bfcf0 con 0x7f195413a8e0 2023-08-17T17:50:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.454+0000 7f1959492700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 0x7f19540c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:34.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.454+0000 7f1959492700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 0x7f19540c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37184/0 (socket says 172.21.15.78:37184) 2023-08-17T17:50:34.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.454+0000 7f1959492700 1 -- 172.21.15.78:0/152301660 learned_addr learned my addr 172.21.15.78:0/152301660 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:34.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.454+0000 7f195a494700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195413a8e0 0x7f19540c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:34.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f1959492700 1 -- 172.21.15.78:0/152301660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195413a8e0 msgr2=0x7f19540c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:34.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f1959492700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195413a8e0 0x7f19540c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:34.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f1959492700 1 -- 172.21.15.78:0/152301660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19540bd830 msgr2=0x7f1954151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f1959492700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19540bd830 0x7f1954151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f1959492700 1 -- 172.21.15.78:0/152301660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1950009370 con 0x7f195413a500 2023-08-17T17:50:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f1959492700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 0x7f19540c4650 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f194400e930 tx=0x7f1944009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944012600 con 0x7f195413a500 2023-08-17T17:50:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944012760 con 0x7f195413a500 2023-08-17T17:50:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f195bef7700 1 -- 172.21.15.78:0/152301660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19540bffd0 con 0x7f195413a500 2023-08-17T17:50:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944012ae0 con 0x7f195413a500 2023-08-17T17:50:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.455+0000 7f195bef7700 1 -- 172.21.15.78:0/152301660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19540c0590 con 0x7f195413a500 2023-08-17T17:50:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.456+0000 7f195bef7700 1 -- 172.21.15.78:0/152301660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19540c57d0 con 0x7f195413a500 2023-08-17T17:50:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.457+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 39) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f1944022070 con 0x7f195413a500 2023-08-17T17:50:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.458+0000 7f1949ffb700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f19380612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.458+0000 7f1959c93700 1 -- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 msgr2=0x7f19380612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.458+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f194407a4c0 con 0x7f195413a500 2023-08-17T17:50:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.458+0000 7f1959c93700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f19380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:50:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.461+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f194404b9d0 con 0x7f195413a500 2023-08-17T17:50:34.490 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:34.489+0000 7fb6d9859680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:50:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.659+0000 7f1959c93700 1 -- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 msgr2=0x7f19380612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.659+0000 7f1959c93700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f19380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:50:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:34.659+0000 7f195bef7700 1 -- 172.21.15.78:0/152301660 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1954065b20 con 0x7f193805ede0 2023-08-17T17:50:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:35.060+0000 7f1959c93700 1 -- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 msgr2=0x7f19380612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:35.060+0000 7f1959c93700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f19380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T17:50:35.070 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:35.068+0000 7f69e2f21680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:50:35.111 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:35.110+0000 7fb6d9859680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:50:35.142 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:35.140+0000 7f69e2f21680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:50:35.182 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:35.181+0000 7fb6d9859680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:50:35.326 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:35.325+0000 7f69e2f21680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:50:35.368 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:35.367+0000 7fb6d9859680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:50:35.743 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:35.741+0000 7f69e2f21680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:50:35.786 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:35.785+0000 7fb6d9859680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:50:35.846 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:35.845+0000 7f69e2f21680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:35.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:35.861+0000 7f1959c93700 1 -- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 msgr2=0x7f19380612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:35.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:35.861+0000 7f1959c93700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f19380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T17:50:35.890 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:35.889+0000 7fb6d9859680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:35.998 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:35.997+0000 7f69e2f21680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:36.043 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:36.042+0000 7fb6d9859680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:36.074 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:36.072+0000 7f69e2f21680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:50:36.118 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:36.117+0000 7fb6d9859680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:50:36.141 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:36.140+0000 7f69e2f21680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:50:36.185 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:36.184+0000 7fb6d9859680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:50:36.399 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:36.397+0000 7f69e2f21680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:50:36.444 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:36.442+0000 7fb6d9859680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:50:36.582 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:36.580+0000 7f69e2f21680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:36.626 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:36.625+0000 7fb6d9859680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:50:37.225 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:37.223+0000 7f69e2f21680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:50:37.273 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:37.272+0000 7fb6d9859680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:50:37.293 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:37.291+0000 7f69e2f21680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:50:37.341 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:37.340+0000 7fb6d9859680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:50:37.368 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:37.367+0000 7f69e2f21680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:50:37.417 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:37.416+0000 7fb6d9859680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:50:37.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:37.462+0000 7f1959c93700 1 -- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 msgr2=0x7f19380612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:50:37.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:37.462+0000 7f1959c93700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f19380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-17T17:50:37.513 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:37.512+0000 7f69e2f21680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:50:37.565 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:37.564+0000 7fb6d9859680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:50:37.583 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:37.582+0000 7f69e2f21680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:50:37.637 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:37.635+0000 7fb6d9859680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:50:37.698 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:37.696+0000 7f69e2f21680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:50:37.751 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:37.750+0000 7fb6d9859680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:50:37.804 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:37.803+0000 7f69e2f21680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:37.858 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:37.857+0000 7fb6d9859680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:50:38.093 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:38.092+0000 7f69e2f21680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:50:38.148 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.147+0000 7fb6d9859680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:50:38.164 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:50:38.163+0000 7f69e2f21680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:50:38.220 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.219+0000 7fb6d9859680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:50:38.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:38.233+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 40) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f1944078330 con 0x7f195413a500 2023-08-17T17:50:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:38.247+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mgrmap(e 41) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f19440786b0 con 0x7f195413a500 2023-08-17T17:50:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:38.247+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 msgr2=0x7f19380612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:50:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:38.247+0000 7f1949ffb700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f19380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:38.303 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.302+0000 7fb658037700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:38.303 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.302+0000 7fb658037700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:38.304 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.302+0000 7fb655031700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:38.304 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.302+0000 7fb658037700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:38.304 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.302+0000 7fb655031700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:38.304 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.302+0000 7fb658037700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:38.304 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.302+0000 7fb655031700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:38.304 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.302+0000 7fb658037700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:38.304 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.302+0000 7fb655031700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:38.305 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:50:38.302+0000 7fb655031700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:50:39.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.253+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 <== mon.0 v2:172.21.15.78:3300/0 9 ==== mgrmap(e 42) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f194403a730 con 0x7f195413a500 2023-08-17T17:50:39.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.254+0000 7f1949ffb700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f1938061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:39.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.254+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1954065b20 con 0x7f193805ede0 2023-08-17T17:50:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.255+0000 7f1959c93700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f1938061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.257+0000 7f1959c93700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f1938061220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1954068e60 tx=0x7f1950017000).ready entity=mgr.7356 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.275+0000 7f1949ffb700 1 -- 172.21.15.78:0/152301660 <== mgr.7356 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f1954065b20 con 0x7f193805ede0 2023-08-17T17:50:39.277 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /bad-path 2023-08-17T17:50:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 -- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 msgr2=0x7f1938061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f1938061220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1954068e60 tx=0x7f1950017000).stop 2023-08-17T17:50:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 -- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 msgr2=0x7f19540c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 0x7f19540c4650 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f194400e930 tx=0x7f1944009060).stop 2023-08-17T17:50:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 -- 172.21.15.78:0/152301660 shutdown_connections 2023-08-17T17:50:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f193805ede0 0x7f1938061220 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195413a8e0 0x7f19540c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19540bd830 0x7f1954151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:50:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 --2- 172.21.15.78:0/152301660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f195413a500 0x7f19540c4650 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 -- 172.21.15.78:0/152301660 >> 172.21.15.78:0/152301660 conn(0x7f19540c7bd0 msgr2=0x7f19540ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 -- 172.21.15.78:0/152301660 shutdown_connections 2023-08-17T17:50:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.277+0000 7f195bef7700 1 -- 172.21.15.78:0/152301660 wait complete. 2023-08-17T17:50:39.292 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-08-17T17:50:39.292 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-08-17T17:50:39.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.409+0000 7fa39dee8700 1 Processor -- start 2023-08-17T17:50:39.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.409+0000 7fa39dee8700 1 -- start start 2023-08-17T17:50:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.409+0000 7fa39dee8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3980c5f20 0x7fa3980644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.409+0000 7fa39dee8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3980649b0 con 0x7fa3980aa0f0 2023-08-17T17:50:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.409+0000 7fa39dee8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa398063420 con 0x7fa3980aa4d0 2023-08-17T17:50:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.409+0000 7fa39dee8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa398063700 con 0x7fa3980c5f20 2023-08-17T17:50:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa397fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3980c5f20 0x7fa3980644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa3977fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa3980aa0f0 0x7fa3980c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41008/0 (socket says 172.21.15.78:41008) 2023-08-17T17:50:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa3977fe700 1 -- 172.21.15.78:0/3616705646 learned_addr learned my addr 172.21.15.78:0/3616705646 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:50:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa397fff700 1 -- 172.21.15.78:0/3616705646 >> v1:172.21.15.150:6789/0 conn(0x7fa3980aa4d0 legacy=0x7fa3980c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa397fff700 1 -- 172.21.15.78:0/3616705646 >> v1:172.21.15.78:6789/0 conn(0x7fa3980aa0f0 legacy=0x7fa3980c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa3967fc700 1 -- 172.21.15.78:0/3616705646 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019927930 0 0) 0x7fa3980649b0 con 0x7fa3980aa0f0 2023-08-17T17:50:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa397fff700 1 -- 172.21.15.78:0/3616705646 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3980639e0 con 0x7fa3980c5f20 2023-08-17T17:50:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa397fff700 1 --2- 172.21.15.78:0/3616705646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980c5f20 0x7fa3980644c0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fa390009760 tx=0x7fa390009060).ready entity=mon.0 client_cookie=7f47119ba88fb5e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa3967fc700 1 -- 172.21.15.78:0/3616705646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39000b580 con 0x7fa3980c5f20 2023-08-17T17:50:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa3967fc700 1 -- 172.21.15.78:0/3616705646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39000b6e0 con 0x7fa3980c5f20 2023-08-17T17:50:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.410+0000 7fa3967fc700 1 -- 172.21.15.78:0/3616705646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39000ba60 con 0x7fa3980c5f20 2023-08-17T17:50:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.411+0000 7fa39dee8700 1 -- 172.21.15.78:0/3616705646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980c5f20 msgr2=0x7fa3980644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.411+0000 7fa39dee8700 1 --2- 172.21.15.78:0/3616705646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980c5f20 0x7fa3980644c0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fa390009760 tx=0x7fa390009060).stop 2023-08-17T17:50:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.411+0000 7fa39dee8700 1 -- 172.21.15.78:0/3616705646 shutdown_connections 2023-08-17T17:50:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.411+0000 7fa39dee8700 1 --2- 172.21.15.78:0/3616705646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980c5f20 0x7fa3980644c0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.411+0000 7fa39dee8700 1 -- 172.21.15.78:0/3616705646 >> 172.21.15.78:0/3616705646 conn(0x7fa39806a6a0 msgr2=0x7fa3980caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.411+0000 7fa39dee8700 1 -- 172.21.15.78:0/3616705646 shutdown_connections 2023-08-17T17:50:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.411+0000 7fa39dee8700 1 -- 172.21.15.78:0/3616705646 wait complete. 2023-08-17T17:50:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.412+0000 7fa39dee8700 1 Processor -- start 2023-08-17T17:50:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.412+0000 7fa39dee8700 1 -- start start 2023-08-17T17:50:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa39dee8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3980aa0f0 0x7fa398147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa39dee8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980aa4d0 0x7fa3980c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa39dee8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3980c5f20 0x7fa3980c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa39dee8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3980ac950 con 0x7fa3980aa4d0 2023-08-17T17:50:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa39dee8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3981574a0 con 0x7fa3980c5f20 2023-08-17T17:50:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa39dee8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3980ac670 con 0x7fa3980aa0f0 2023-08-17T17:50:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa396ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980aa4d0 0x7fa3980c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa396ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980aa4d0 0x7fa3980c2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52420/0 (socket says 172.21.15.78:52420) 2023-08-17T17:50:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa396ffd700 1 -- 172.21.15.78:0/341896586 learned_addr learned my addr 172.21.15.78:0/341896586 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:50:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa397fff700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3980c5f20 0x7fa3980c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa3977fe700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3980aa0f0 0x7fa398147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa396ffd700 1 -- 172.21.15.78:0/341896586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3980aa0f0 msgr2=0x7fa398147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa396ffd700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3980aa0f0 0x7fa398147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa396ffd700 1 -- 172.21.15.78:0/341896586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3980c5f20 msgr2=0x7fa3980c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa396ffd700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3980c5f20 0x7fa3980c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa396ffd700 1 -- 172.21.15.78:0/341896586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3900092a0 con 0x7fa3980aa4d0 2023-08-17T17:50:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa396ffd700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980aa4d0 0x7fa3980c2830 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fa38c00c4c0 tx=0x7fa38c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.413+0000 7fa37f7fe700 1 -- 172.21.15.78:0/341896586 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00ce10 con 0x7fa3980aa4d0 2023-08-17T17:50:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.414+0000 7fa37f7fe700 1 -- 172.21.15.78:0/341896586 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c007020 con 0x7fa3980aa4d0 2023-08-17T17:50:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.414+0000 7fa39dee8700 1 -- 172.21.15.78:0/341896586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa398156e50 con 0x7fa3980aa4d0 2023-08-17T17:50:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.414+0000 7fa37f7fe700 1 -- 172.21.15.78:0/341896586 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0073c0 con 0x7fa3980aa4d0 2023-08-17T17:50:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.414+0000 7fa39dee8700 1 -- 172.21.15.78:0/341896586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa398147f30 con 0x7fa3980aa4d0 2023-08-17T17:50:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.414+0000 7fa39dee8700 1 -- 172.21.15.78:0/341896586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa398156cb0 con 0x7fa3980aa4d0 2023-08-17T17:50:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.415+0000 7fa37f7fe700 1 -- 172.21.15.78:0/341896586 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 42) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fa38c010070 con 0x7fa3980aa4d0 2023-08-17T17:50:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.415+0000 7fa37f7fe700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa38405ed40 0x7fa384061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:50:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.415+0000 7fa37f7fe700 1 -- 172.21.15.78:0/341896586 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa38c078cd0 con 0x7fa3980aa4d0 2023-08-17T17:50:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.415+0000 7fa3977fe700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa38405ed40 0x7fa384061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:50:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.416+0000 7fa3977fe700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa38405ed40 0x7fa384061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa388001560 tx=0x7fa388007f10).ready entity=mgr.7356 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:50:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.419+0000 7fa37f7fe700 1 -- 172.21.15.78:0/341896586 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa38c0478f0 con 0x7fa3980aa4d0 2023-08-17T17:50:39.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.606+0000 7fa39dee8700 1 -- 172.21.15.78:0/341896586 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa398157630 con 0x7fa38405ed40 2023-08-17T17:50:39.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.609+0000 7fa37f7fe700 1 -- 172.21.15.78:0/341896586 <== mgr.7356 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7fa398157630 con 0x7fa38405ed40 2023-08-17T17:50:39.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:50:39.610 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:50:39", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-08-17T17:50:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 -- 172.21.15.78:0/341896586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa38405ed40 msgr2=0x7fa384061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa38405ed40 0x7fa384061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa388001560 tx=0x7fa388007f10).stop 2023-08-17T17:50:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 -- 172.21.15.78:0/341896586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980aa4d0 msgr2=0x7fa3980c2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:50:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980aa4d0 0x7fa3980c2830 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fa38c00c4c0 tx=0x7fa38c007dd0).stop 2023-08-17T17:50:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 -- 172.21.15.78:0/341896586 shutdown_connections 2023-08-17T17:50:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa38405ed40 0x7fa384061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3980c5f20 0x7fa3980c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3980aa0f0 0x7fa398147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 --2- 172.21.15.78:0/341896586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3980aa4d0 0x7fa3980c2830 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:50:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 -- 172.21.15.78:0/341896586 >> 172.21.15.78:0/341896586 conn(0x7fa39806a6a0 msgr2=0x7fa3980b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:50:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 -- 172.21.15.78:0/341896586 shutdown_connections 2023-08-17T17:50:39.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:50:39.611+0000 7fa39dee8700 1 -- 172.21.15.78:0/341896586 wait complete. 2023-08-17T17:50:39.624 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:50:39", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-08-17T17:51:00.280 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:00.279+0000 7fb648017700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:00.281 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:00.279+0000 7fb648017700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:00.281 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:00.279+0000 7fb648017700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:00.281 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:00.279+0000 7fb648017700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:00.281 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:00.279+0000 7fb648017700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:02.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:51:02.821 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:51:32.910 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:51:32.912 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:51:39.626 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-08-17T17:51:39.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.758+0000 7fb3c7ade700 1 Processor -- start 2023-08-17T17:51:39.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.759+0000 7fb3c7ade700 1 -- start start 2023-08-17T17:51:39.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.759+0000 7fb3c7ade700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00aa4d0 0x7fb3c00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:39.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.759+0000 7fb3c7ade700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3c00c5810 0x7fb3c00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:39.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.759+0000 7fb3c7ade700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00649b0 con 0x7fb3c00aa0f0 2023-08-17T17:51:39.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.759+0000 7fb3c7ade700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c00c6150 con 0x7fb3c00c5810 2023-08-17T17:51:39.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.759+0000 7fb3c7ade700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0063420 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c5079700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00aa4d0 0x7fb3c00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c607b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3c00c5810 0x7fb3c00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c587a700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb3c00aa0f0 0x7fb3c00c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:38344/0 (socket says 172.21.15.78:38344) 2023-08-17T17:51:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c587a700 1 -- 172.21.15.78:0/4203107950 learned_addr learned my addr 172.21.15.78:0/4203107950 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c607b700 1 -- 172.21.15.78:0/4203107950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00aa4d0 msgr2=0x7fb3c00644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c607b700 1 --2- 172.21.15.78:0/4203107950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00aa4d0 0x7fb3c00644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c607b700 1 -- 172.21.15.78:0/4203107950 >> v1:172.21.15.150:6789/0 conn(0x7fb3c00aa0f0 legacy=0x7fb3c00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c4878700 1 -- 172.21.15.78:0/4203107950 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028711083 0 0) 0x7fb3c00649b0 con 0x7fb3c00aa0f0 2023-08-17T17:51:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c607b700 1 -- 172.21.15.78:0/4203107950 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0063700 con 0x7fb3c00c5810 2023-08-17T17:51:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c5079700 1 --2- 172.21.15.78:0/4203107950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00aa4d0 0x7fb3c00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:51:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.760+0000 7fb3c607b700 1 --2- 172.21.15.78:0/4203107950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3c00c5810 0x7fb3c00c5c60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fb3b8009760 tx=0x7fb3b8009060).ready entity=mon.1 client_cookie=3ca2cef756f93b8a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c4878700 1 -- 172.21.15.78:0/4203107950 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800f510 con 0x7fb3c00c5810 2023-08-17T17:51:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c4878700 1 -- 172.21.15.78:0/4203107950 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b800f670 con 0x7fb3c00c5810 2023-08-17T17:51:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c4878700 1 -- 172.21.15.78:0/4203107950 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800f9f0 con 0x7fb3c00c5810 2023-08-17T17:51:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c7ade700 1 -- 172.21.15.78:0/4203107950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3c00c5810 msgr2=0x7fb3c00c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c7ade700 1 --2- 172.21.15.78:0/4203107950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3c00c5810 0x7fb3c00c5c60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fb3b8009760 tx=0x7fb3b8009060).stop 2023-08-17T17:51:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c7ade700 1 -- 172.21.15.78:0/4203107950 shutdown_connections 2023-08-17T17:51:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c7ade700 1 --2- 172.21.15.78:0/4203107950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3c00c5810 0x7fb3c00c5c60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c7ade700 1 --2- 172.21.15.78:0/4203107950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00aa4d0 0x7fb3c00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c7ade700 1 -- 172.21.15.78:0/4203107950 >> 172.21.15.78:0/4203107950 conn(0x7fb3c006a6a0 msgr2=0x7fb3c00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c7ade700 1 -- 172.21.15.78:0/4203107950 shutdown_connections 2023-08-17T17:51:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.761+0000 7fb3c7ade700 1 -- 172.21.15.78:0/4203107950 wait complete. 2023-08-17T17:51:39.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.762+0000 7fb3c7ade700 1 Processor -- start 2023-08-17T17:51:39.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.763+0000 7fb3c7ade700 1 -- start start 2023-08-17T17:51:39.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.763+0000 7fb3c7ade700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3c00aa0f0 0x7fb3c00afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:39.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.763+0000 7fb3c7ade700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3c00aa4d0 0x7fb3c00a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:39.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.763+0000 7fb3c7ade700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00c5810 0x7fb3c00c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:39.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.763+0000 7fb3c7ade700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c01642b0 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.763+0000 7fb3c7ade700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00b0380 con 0x7fb3c00aa0f0 2023-08-17T17:51:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.763+0000 7fb3c7ade700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00b0660 con 0x7fb3c00c5810 2023-08-17T17:51:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.763+0000 7fb3c5079700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3c00aa4d0 0x7fb3c00a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.763+0000 7fb3c5079700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3c00aa4d0 0x7fb3c00a90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42856/0 (socket says 172.21.15.78:42856) 2023-08-17T17:51:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.763+0000 7fb3c5079700 1 -- 172.21.15.78:0/1102603243 learned_addr learned my addr 172.21.15.78:0/1102603243 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3c607b700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00c5810 0x7fb3c00c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3c587a700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3c00aa0f0 0x7fb3c00afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3c5079700 1 -- 172.21.15.78:0/1102603243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00c5810 msgr2=0x7fb3c00c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3c5079700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00c5810 0x7fb3c00c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3c5079700 1 -- 172.21.15.78:0/1102603243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3c00aa0f0 msgr2=0x7fb3c00afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3c5079700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3c00aa0f0 0x7fb3c00afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3c5079700 1 -- 172.21.15.78:0/1102603243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b00092a0 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3c5079700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3c00aa4d0 0x7fb3c00a90b0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fb3b000ea20 tx=0x7fb3b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3b5ffb700 1 -- 172.21.15.78:0/1102603243 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000ee60 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3b5ffb700 1 -- 172.21.15.78:0/1102603243 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b000c850 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3c7ade700 1 -- 172.21.15.78:0/1102603243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b80092a0 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3b5ffb700 1 -- 172.21.15.78:0/1102603243 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000cbd0 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.764+0000 7fb3c7ade700 1 -- 172.21.15.78:0/1102603243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c00b0c20 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.765+0000 7fb3c7ade700 1 -- 172.21.15.78:0/1102603243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c0164600 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.766+0000 7fb3b5ffb700 1 -- 172.21.15.78:0/1102603243 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 44) v1 ==== 75419+0+0 (secure 0 0 0) 0x7fb3b0022070 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.766+0000 7fb3b5ffb700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3a405ef00 0x7fb3a40613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.766+0000 7fb3b5ffb700 1 -- 172.21.15.78:0/1102603243 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fb3b007a190 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.766+0000 7fb3c587a700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3a405ef00 0x7fb3a40613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.766+0000 7fb3c587a700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3a405ef00 0x7fb3a40613c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb3bc001560 tx=0x7fb3bc007f30).ready entity=mgr.7356 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.770+0000 7fb3b5ffb700 1 -- 172.21.15.78:0/1102603243 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3b004b570 con 0x7fb3c00aa4d0 2023-08-17T17:51:39.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.957+0000 7fb3c7ade700 1 -- 172.21.15.78:0/1102603243 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3c01643f0 con 0x7fb3a405ef00 2023-08-17T17:51:39.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.959+0000 7fb3b5ffb700 1 -- 172.21.15.78:0/1102603243 <== mgr.7356 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7fb3c01643f0 con 0x7fb3a405ef00 2023-08-17T17:51:39.960 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:39.960 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:50:39", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-08-17T17:51:39.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 -- 172.21.15.78:0/1102603243 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3a405ef00 msgr2=0x7fb3a40613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:39.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3a405ef00 0x7fb3a40613c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb3bc001560 tx=0x7fb3bc007f30).stop 2023-08-17T17:51:39.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 -- 172.21.15.78:0/1102603243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3c00aa4d0 msgr2=0x7fb3c00a90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:39.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3c00aa4d0 0x7fb3c00a90b0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fb3b000ea20 tx=0x7fb3b0009060).stop 2023-08-17T17:51:39.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 -- 172.21.15.78:0/1102603243 shutdown_connections 2023-08-17T17:51:39.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb3a405ef00 0x7fb3a40613c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:39.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00c5810 0x7fb3c00c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:39.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3c00aa0f0 0x7fb3c00afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:39.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 --2- 172.21.15.78:0/1102603243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3c00aa4d0 0x7fb3c00a90b0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:39.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 -- 172.21.15.78:0/1102603243 >> 172.21.15.78:0/1102603243 conn(0x7fb3c006a6a0 msgr2=0x7fb3c0152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:39.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.960+0000 7fb3c7ade700 1 -- 172.21.15.78:0/1102603243 shutdown_connections 2023-08-17T17:51:39.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:39.961+0000 7fb3c7ade700 1 -- 172.21.15.78:0/1102603243 wait complete. 2023-08-17T17:51:39.973 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:50:39", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-08-17T17:51:39.973 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-08-17T17:51:40.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.089+0000 7f5d330d8700 1 Processor -- start 2023-08-17T17:51:40.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.089+0000 7f5d330d8700 1 -- start start 2023-08-17T17:51:40.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d330d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0c5f20 0x7f5d2c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d330d8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c0649b0 con 0x7f5d2c0aa0f0 2023-08-17T17:51:40.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d330d8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c063420 con 0x7f5d2c0aa4d0 2023-08-17T17:51:40.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d330d8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c063700 con 0x7f5d2c0c5f20 2023-08-17T17:51:40.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d30e74700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5d2c0aa0f0 0x7f5d2c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57348/0 (socket says 172.21.15.78:57348) 2023-08-17T17:51:40.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d30e74700 1 -- 172.21.15.78:0/3086698660 learned_addr learned my addr 172.21.15.78:0/3086698660 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:40.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d31675700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0c5f20 0x7f5d2c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988695700 0 0) 0x7f5d2c0649b0 con 0x7f5d2c0aa0f0 2023-08-17T17:51:40.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d140033f0 con 0x7f5d2c0aa0f0 2023-08-17T17:51:40.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2258742407 0 0) 0x7f5d140033f0 con 0x7f5d2c0aa0f0 2023-08-17T17:51:40.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0c5f20 msgr2=0x7f5d2c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:40.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0c5f20 0x7f5d2c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 >> v1:172.21.15.150:6789/0 conn(0x7f5d2c0aa4d0 legacy=0x7f5d2c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0639e0 con 0x7f5d2c0aa0f0 2023-08-17T17:51:40.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f5d280017f0 con 0x7f5d2c0aa0f0 2023-08-17T17:51:40.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 >> v1:172.21.15.78:6789/0 conn(0x7f5d2c0aa0f0 legacy=0x7f5d2c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0c5f20 0x7f5d14003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d14003e40 0x7f5d14004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d14004b80 0x7f5d14005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c063700 con 0x7f5d14004b80 2023-08-17T17:51:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1400b990 con 0x7f5d14003e40 2023-08-17T17:51:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1400bb50 con 0x7f5d2c0c5f20 2023-08-17T17:51:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d31675700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d14004b80 0x7f5d14005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d30e74700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0c5f20 0x7f5d14003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.090+0000 7f5d23fff700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d14003e40 0x7f5d14004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d31675700 1 -- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0c5f20 msgr2=0x7f5d14003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d31675700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0c5f20 0x7f5d14003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d31675700 1 -- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d14003e40 msgr2=0x7f5d14004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d31675700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d14003e40 0x7f5d14004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d31675700 1 -- 172.21.15.78:0/3086698660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d140033f0 con 0x7f5d14004b80 2023-08-17T17:51:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d31675700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d14004b80 0x7f5d14005000 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f5d24009a60 tx=0x7f5d24009060).ready entity=mon.0 client_cookie=e436aa07f0d2fa8a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24009ea0 con 0x7f5d14004b80 2023-08-17T17:51:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d24009430 con 0x7f5d14004b80 2023-08-17T17:51:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d237fe700 1 -- 172.21.15.78:0/3086698660 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2400e870 con 0x7f5d14004b80 2023-08-17T17:51:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d330d8700 1 -- 172.21.15.78:0/3086698660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d14004b80 msgr2=0x7f5d14005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d330d8700 1 --2- 172.21.15.78:0/3086698660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d14004b80 0x7f5d14005000 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f5d24009a60 tx=0x7f5d24009060).stop 2023-08-17T17:51:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d31675700 1 -- 172.21.15.78:0/3086698660 reap_dead start 2023-08-17T17:51:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d330d8700 1 -- 172.21.15.78:0/3086698660 shutdown_connections 2023-08-17T17:51:40.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.091+0000 7f5d330d8700 1 -- 172.21.15.78:0/3086698660 >> 172.21.15.78:0/3086698660 conn(0x7f5d2c06a6a0 msgr2=0x7f5d2c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:40.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.092+0000 7f5d330d8700 1 -- 172.21.15.78:0/3086698660 shutdown_connections 2023-08-17T17:51:40.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.092+0000 7f5d330d8700 1 -- 172.21.15.78:0/3086698660 wait complete. 2023-08-17T17:51:40.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.093+0000 7f5d330d8700 1 Processor -- start 2023-08-17T17:51:40.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.093+0000 7f5d330d8700 1 -- start start 2023-08-17T17:51:40.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.093+0000 7f5d330d8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c151380 0x7f5d2c0abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d330d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0abfe0 0x7f5d2c1649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d330d8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d2c164ed0 0x7f5d2c0c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d330d8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c165350 con 0x7f5d2c151380 2023-08-17T17:51:40.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d330d8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0ab660 con 0x7f5d2c164ed0 2023-08-17T17:51:40.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d330d8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0aaa50 con 0x7f5d2c0abfe0 2023-08-17T17:51:40.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d30e74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c151380 0x7f5d2c0abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d30e74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c151380 0x7f5d2c0abaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42874/0 (socket says 172.21.15.78:42874) 2023-08-17T17:51:40.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d30e74700 1 -- 172.21.15.78:0/2617868617 learned_addr learned my addr 172.21.15.78:0/2617868617 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:40.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d23fff700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0abfe0 0x7f5d2c1649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d31675700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d2c164ed0 0x7f5d2c0c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d30e74700 1 -- 172.21.15.78:0/2617868617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0abfe0 msgr2=0x7f5d2c1649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d30e74700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0abfe0 0x7f5d2c1649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d30e74700 1 -- 172.21.15.78:0/2617868617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d2c164ed0 msgr2=0x7f5d2c0c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d30e74700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d2c164ed0 0x7f5d2c0c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d30e74700 1 -- 172.21.15.78:0/2617868617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0aad30 con 0x7f5d2c151380 2023-08-17T17:51:40.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d23fff700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0abfe0 0x7f5d2c1649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:40.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d30e74700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c151380 0x7f5d2c0abaf0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f5d28007740 tx=0x7f5d28007d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:40.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d20ff9700 1 -- 172.21.15.78:0/2617868617 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800f9d0 con 0x7f5d2c151380 2023-08-17T17:51:40.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d20ff9700 1 -- 172.21.15.78:0/2617868617 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800fb30 con 0x7f5d2c151380 2023-08-17T17:51:40.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d330d8700 1 -- 172.21.15.78:0/2617868617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c0ab010 con 0x7f5d2c151380 2023-08-17T17:51:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d20ff9700 1 -- 172.21.15.78:0/2617868617 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800fed0 con 0x7f5d2c151380 2023-08-17T17:51:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.094+0000 7f5d330d8700 1 -- 172.21.15.78:0/2617868617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c151760 con 0x7f5d2c151380 2023-08-17T17:51:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.095+0000 7f5d330d8700 1 -- 172.21.15.78:0/2617868617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c0ac3c0 con 0x7f5d2c151380 2023-08-17T17:51:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.096+0000 7f5d20ff9700 1 -- 172.21.15.78:0/2617868617 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 44) v1 ==== 75419+0+0 (secure 0 0 0) 0x7f5d2801b030 con 0x7f5d2c151380 2023-08-17T17:51:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.096+0000 7f5d20ff9700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5d1805ef00 0x7f5d180613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.096+0000 7f5d20ff9700 1 -- 172.21.15.78:0/2617868617 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f5d28079ab0 con 0x7f5d2c151380 2023-08-17T17:51:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.096+0000 7f5d23fff700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5d1805ef00 0x7f5d180613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.096+0000 7f5d23fff700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5d1805ef00 0x7f5d180613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5d1c007cc0 tx=0x7f5d1c009040).ready entity=mgr.7356 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:40.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.100+0000 7f5d20ff9700 1 -- 172.21.15.78:0/2617868617 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d2804ae90 con 0x7f5d2c151380 2023-08-17T17:51:40.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.287+0000 7f5d330d8700 1 -- 172.21.15.78:0/2617868617 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d2c0ab7a0 con 0x7f5d1805ef00 2023-08-17T17:51:40.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.291+0000 7f5d20ff9700 1 -- 172.21.15.78:0/2617868617 <== mgr.7356 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f5d1c003680 con 0x7f5d1805ef00 2023-08-17T17:51:40.292 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /bad-path 2023-08-17T17:51:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 -- 172.21.15.78:0/2617868617 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5d1805ef00 msgr2=0x7f5d180613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5d1805ef00 0x7f5d180613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5d1c007cc0 tx=0x7f5d1c009040).stop 2023-08-17T17:51:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 -- 172.21.15.78:0/2617868617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c151380 msgr2=0x7f5d2c0abaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c151380 0x7f5d2c0abaf0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f5d28007740 tx=0x7f5d28007d50).stop 2023-08-17T17:51:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 -- 172.21.15.78:0/2617868617 shutdown_connections 2023-08-17T17:51:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5d1805ef00 0x7f5d180613c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d2c164ed0 0x7f5d2c0c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c151380 0x7f5d2c0abaf0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 --2- 172.21.15.78:0/2617868617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d2c0abfe0 0x7f5d2c1649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 -- 172.21.15.78:0/2617868617 >> 172.21.15.78:0/2617868617 conn(0x7f5d2c06a6a0 msgr2=0x7f5d2c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 -- 172.21.15.78:0/2617868617 shutdown_connections 2023-08-17T17:51:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.293+0000 7f5d330d8700 1 -- 172.21.15.78:0/2617868617 wait complete. 2023-08-17T17:51:40.306 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-08-17T17:51:40.306 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-17T17:51:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.419+0000 7f0ace81a700 1 Processor -- start 2023-08-17T17:51:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.419+0000 7f0ace81a700 1 -- start start 2023-08-17T17:51:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.420+0000 7f0ace81a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0ac80aa4d0 0x7f0ac80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.420+0000 7f0ace81a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0ac80c5810 0x7f0ac80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.420+0000 7f0ace81a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80649b0 con 0x7f0ac80aa0f0 2023-08-17T17:51:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.420+0000 7f0ace81a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac80c6170 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.420+0000 7f0ace81a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac8063420 con 0x7f0ac80c5810 2023-08-17T17:51:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.420+0000 7f0ac77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0ac80aa4d0 0x7f0ac80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.420+0000 7f0ac7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0ac80aa0f0 0x7f0ac80c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57364/0 (socket says 172.21.15.78:57364) 2023-08-17T17:51:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.420+0000 7f0ac7fff700 1 -- 172.21.15.78:0/3191020128 learned_addr learned my addr 172.21.15.78:0/3191020128 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.420+0000 7f0accdb7700 1 --2- 172.21.15.78:0/3191020128 >> v2:172.21.15.150:3300/0 conn(0x7f0ac80c5810 0x7f0ac80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ac77fe700 1 -- 172.21.15.78:0/3191020128 >> v2:172.21.15.150:3300/0 conn(0x7f0ac80c5810 msgr2=0x7f0ac80c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ac77fe700 1 --2- 172.21.15.78:0/3191020128 >> v2:172.21.15.150:3300/0 conn(0x7f0ac80c5810 0x7f0ac80c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ac77fe700 1 -- 172.21.15.78:0/3191020128 >> v1:172.21.15.78:6789/0 conn(0x7f0ac80aa0f0 legacy=0x7f0ac80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ac77fe700 1 -- 172.21.15.78:0/3191020128 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8063700 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ac6ffd700 1 -- 172.21.15.78:0/3191020128 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243279074 0 0) 0x7f0ac80649b0 con 0x7f0ac80aa0f0 2023-08-17T17:51:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0accdb7700 1 --2- 172.21.15.78:0/3191020128 >> v2:172.21.15.150:3300/0 conn(0x7f0ac80c5810 0x7f0ac80c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ac77fe700 1 --2- 172.21.15.78:0/3191020128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 0x7f0ac80644c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f0ac8159090 tx=0x7f0abc009060).ready entity=mon.0 client_cookie=9267e5557c656cef server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ac6ffd700 1 -- 172.21.15.78:0/3191020128 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00b580 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ac6ffd700 1 -- 172.21.15.78:0/3191020128 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc00b6e0 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ac6ffd700 1 -- 172.21.15.78:0/3191020128 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00ba60 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ace81a700 1 -- 172.21.15.78:0/3191020128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 msgr2=0x7f0ac80644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ace81a700 1 --2- 172.21.15.78:0/3191020128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 0x7f0ac80644c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f0ac8159090 tx=0x7f0abc009060).stop 2023-08-17T17:51:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ace81a700 1 -- 172.21.15.78:0/3191020128 shutdown_connections 2023-08-17T17:51:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ace81a700 1 --2- 172.21.15.78:0/3191020128 >> v2:172.21.15.150:3300/0 conn(0x7f0ac80c5810 0x7f0ac80c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ace81a700 1 --2- 172.21.15.78:0/3191020128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 0x7f0ac80644c0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ace81a700 1 -- 172.21.15.78:0/3191020128 >> 172.21.15.78:0/3191020128 conn(0x7f0ac806a6a0 msgr2=0x7f0ac80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ace81a700 1 -- 172.21.15.78:0/3191020128 shutdown_connections 2023-08-17T17:51:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.421+0000 7f0ace81a700 1 -- 172.21.15.78:0/3191020128 wait complete. 2023-08-17T17:51:40.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.422+0000 7f0ace81a700 1 Processor -- start 2023-08-17T17:51:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.423+0000 7f0ace81a700 1 -- start start 2023-08-17T17:51:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.423+0000 7f0ace81a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ac80aa0f0 0x7f0ac80c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.423+0000 7f0ace81a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 0x7f0ac80c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.423+0000 7f0ace81a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ac80c5810 0x7f0ac8146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.423+0000 7f0ace81a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac80c3050 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.423+0000 7f0ace81a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac80c3290 con 0x7f0ac80c5810 2023-08-17T17:51:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.423+0000 7f0ace81a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac80c3570 con 0x7f0ac80aa0f0 2023-08-17T17:51:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.423+0000 7f0ac77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 0x7f0ac80c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.423+0000 7f0ac77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 0x7f0ac80c2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42890/0 (socket says 172.21.15.78:42890) 2023-08-17T17:51:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.423+0000 7f0ac77fe700 1 -- 172.21.15.78:0/1463424651 learned_addr learned my addr 172.21.15.78:0/1463424651 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0accdb7700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ac80c5810 0x7f0ac8146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0ac7fff700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ac80aa0f0 0x7f0ac80c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0ac77fe700 1 -- 172.21.15.78:0/1463424651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ac80aa0f0 msgr2=0x7f0ac80c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0ac77fe700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ac80aa0f0 0x7f0ac80c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0ac77fe700 1 -- 172.21.15.78:0/1463424651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ac80c5810 msgr2=0x7f0ac8146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0ac77fe700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ac80c5810 0x7f0ac8146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0ac77fe700 1 -- 172.21.15.78:0/1463424651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc0092a0 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0ac77fe700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 0x7f0ac80c2b60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f0abc011000 tx=0x7f0abc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0aaffff700 1 -- 172.21.15.78:0/1463424651 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00b850 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0aaffff700 1 -- 172.21.15.78:0/1463424651 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc00b9b0 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0ace81a700 1 -- 172.21.15.78:0/1463424651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac80c3850 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0aaffff700 1 -- 172.21.15.78:0/1463424651 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc01b660 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.424+0000 7f0ace81a700 1 -- 172.21.15.78:0/1463424651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac8147440 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.425+0000 7f0ace81a700 1 -- 172.21.15.78:0/1463424651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac8083980 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.425+0000 7f0aaffff700 1 -- 172.21.15.78:0/1463424651 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 44) v1 ==== 75419+0+0 (secure 0 0 0) 0x7f0abc02b070 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.426+0000 7f0aaffff700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ab405ef30 0x7f0ab40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.426+0000 7f0aaffff700 1 -- 172.21.15.78:0/1463424651 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f0abc07b820 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.426+0000 7f0ac7fff700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ab405ef30 0x7f0ab40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.426+0000 7f0ac7fff700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ab405ef30 0x7f0ab40613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0ab80011e0 tx=0x7f0ab8009040).ready entity=mgr.7356 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.430+0000 7f0aaffff700 1 -- 172.21.15.78:0/1463424651 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0abc04cc00 con 0x7f0ac80aa4d0 2023-08-17T17:51:40.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:40.639+0000 7f0ace81a700 1 -- 172.21.15.78:0/1463424651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f0ac8046af0 con 0x7f0ac80aa4d0 2023-08-17T17:51:41.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.291+0000 7f0aaffff700 1 -- 172.21.15.78:0/1463424651 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f0abc021030 con 0x7f0ac80aa4d0 2023-08-17T17:51:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.293+0000 7f0aaffff700 1 -- 172.21.15.78:0/1463424651 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v45) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0abc0427f0 con 0x7f0ac80aa4d0 2023-08-17T17:51:41.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 -- 172.21.15.78:0/1463424651 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ab405ef30 msgr2=0x7f0ab40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:41.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ab405ef30 0x7f0ab40613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0ab80011e0 tx=0x7f0ab8009040).stop 2023-08-17T17:51:41.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 -- 172.21.15.78:0/1463424651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 msgr2=0x7f0ac80c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:41.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 0x7f0ac80c2b60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f0abc011000 tx=0x7f0abc017000).stop 2023-08-17T17:51:41.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 -- 172.21.15.78:0/1463424651 shutdown_connections 2023-08-17T17:51:41.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ab405ef30 0x7f0ab40613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:41.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ac80c5810 0x7f0ac8146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:41.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ac80aa0f0 0x7f0ac80c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:41.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 --2- 172.21.15.78:0/1463424651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ac80aa4d0 0x7f0ac80c2b60 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:41.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 -- 172.21.15.78:0/1463424651 >> 172.21.15.78:0/1463424651 conn(0x7f0ac806a6a0 msgr2=0x7f0ac80c4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:41.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 -- 172.21.15.78:0/1463424651 shutdown_connections 2023-08-17T17:51:41.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.295+0000 7f0ace81a700 1 -- 172.21.15.78:0/1463424651 wait complete. 2023-08-17T17:51:41.308 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:51:41.309 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:51:41.345 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:51:41.387 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:51:41.387 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T17:51:41.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:51:41.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T17:51:41.421 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:51:41.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:51:41.422 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T17:51:41.437 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:41.436+0000 7f59e5207680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:51:41.437 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:41.437+0000 7f3d06f02680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:51:41.451 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:51:41.500 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:41.500+0000 7f3d06f02680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:51:41.502 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:41.501+0000 7f59e5207680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:51:41.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.607+0000 7f1dbf8c1700 1 Processor -- start 2023-08-17T17:51:41.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.607+0000 7f1dbf8c1700 1 -- start start 2023-08-17T17:51:41.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.608+0000 7f1dbf8c1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 0x7f1db80c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:41.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.608+0000 7f1dbf8c1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db8065820 con 0x7f1db81375e0 2023-08-17T17:51:41.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.608+0000 7f1dbf8c1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db80c14b0 con 0x7f1db8137e30 2023-08-17T17:51:41.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.608+0000 7f1dbf8c1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80c1790 con 0x7f1db80c0ff0 2023-08-17T17:51:41.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.608+0000 7f1dbd65d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1db81375e0 0x7f1db8065110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57380/0 (socket says 172.21.15.78:57380) 2023-08-17T17:51:41.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.608+0000 7f1dbd65d700 1 -- 172.21.15.78:0/1022837215 learned_addr learned my addr 172.21.15.78:0/1022837215 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:41.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.608+0000 7f1dbce5c700 1 --2- 172.21.15.78:0/1022837215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 0x7f1db80c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:41.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1daffff700 1 -- 172.21.15.78:0/1022837215 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021433580 0 0) 0x7f1db8065820 con 0x7f1db81375e0 2023-08-17T17:51:41.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1daffff700 1 -- 172.21.15.78:0/1022837215 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1da40033f0 con 0x7f1db81375e0 2023-08-17T17:51:41.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1daffff700 1 -- 172.21.15.78:0/1022837215 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222530867 0 0) 0x7f1db80c14b0 con 0x7f1db8137e30 2023-08-17T17:51:41.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1daffff700 1 -- 172.21.15.78:0/1022837215 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db8065820 con 0x7f1db8137e30 2023-08-17T17:51:41.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1daffff700 1 -- 172.21.15.78:0/1022837215 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 925797046 0 0) 0x7f1da40033f0 con 0x7f1db81375e0 2023-08-17T17:51:41.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1dbce5c700 1 -- 172.21.15.78:0/1022837215 >> v1:172.21.15.150:6789/0 conn(0x7f1db8137e30 legacy=0x7f1db8069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:41.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1dbce5c700 1 -- 172.21.15.78:0/1022837215 >> v1:172.21.15.78:6789/0 conn(0x7f1db81375e0 legacy=0x7f1db8065110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:41.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1dbce5c700 1 -- 172.21.15.78:0/1022837215 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db80c1a70 con 0x7f1db80c0ff0 2023-08-17T17:51:41.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1dbce5c700 1 --2- 172.21.15.78:0/1022837215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 0x7f1db80c57d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1db4009790 tx=0x7f1db4009060).ready entity=mon.2 client_cookie=98e7da4657b99444 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:41.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1daffff700 1 -- 172.21.15.78:0/1022837215 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8001470 con 0x7f1db80c0ff0 2023-08-17T17:51:41.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1daffff700 1 -- 172.21.15.78:0/1022837215 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db4011400 con 0x7f1db80c0ff0 2023-08-17T17:51:41.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.609+0000 7f1daffff700 1 -- 172.21.15.78:0/1022837215 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4011780 con 0x7f1db80c0ff0 2023-08-17T17:51:41.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.610+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1022837215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 msgr2=0x7f1db80c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.610+0000 7f1dbf8c1700 1 --2- 172.21.15.78:0/1022837215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 0x7f1db80c57d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1db4009790 tx=0x7f1db4009060).stop 2023-08-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.610+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1022837215 shutdown_connections 2023-08-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.610+0000 7f1dbf8c1700 1 --2- 172.21.15.78:0/1022837215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 0x7f1db80c57d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.610+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1022837215 >> 172.21.15.78:0/1022837215 conn(0x7f1db8062fc0 msgr2=0x7f1db80c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.610+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1022837215 shutdown_connections 2023-08-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.610+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1022837215 wait complete. 2023-08-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.611+0000 7f1dbf8c1700 1 Processor -- start 2023-08-17T17:51:41.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.611+0000 7f1dbf8c1700 1 -- start start 2023-08-17T17:51:41.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbf8c1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 0x7f1db8136130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:41.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbf8c1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1db81375e0 0x7f1db80c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:41.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbf8c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1db8137e30 0x7f1db80c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:41.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbf8c1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db8152550 con 0x7f1db8137e30 2023-08-17T17:51:41.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbf8c1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80c61b0 con 0x7f1db81375e0 2023-08-17T17:51:41.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbf8c1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db8162010 con 0x7f1db80c0ff0 2023-08-17T17:51:41.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbde5e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1db8137e30 0x7f1db80c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:41.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbd65d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 0x7f1db8136130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:41.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbde5e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1db8137e30 0x7f1db80c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42920/0 (socket says 172.21.15.78:42920) 2023-08-17T17:51:41.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbde5e700 1 -- 172.21.15.78:0/1209037246 learned_addr learned my addr 172.21.15.78:0/1209037246 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:41.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbce5c700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1db81375e0 0x7f1db80c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:41.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbde5e700 1 -- 172.21.15.78:0/1209037246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 msgr2=0x7f1db8136130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:41.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbde5e700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 0x7f1db8136130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:41.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbde5e700 1 -- 172.21.15.78:0/1209037246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1db81375e0 msgr2=0x7f1db80c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:41.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbde5e700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1db81375e0 0x7f1db80c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:41.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbde5e700 1 -- 172.21.15.78:0/1209037246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40092a0 con 0x7f1db8137e30 2023-08-17T17:51:41.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.612+0000 7f1dbde5e700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1db8137e30 0x7f1db80c5cc0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f1db000c740 tx=0x7f1db000ca50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:41.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.613+0000 7f1dad7fa700 1 -- 172.21.15.78:0/1209037246 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db000e4a0 con 0x7f1db8137e30 2023-08-17T17:51:41.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.613+0000 7f1dad7fa700 1 -- 172.21.15.78:0/1209037246 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db000e600 con 0x7f1db8137e30 2023-08-17T17:51:41.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.613+0000 7f1dad7fa700 1 -- 172.21.15.78:0/1209037246 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db000e980 con 0x7f1db8137e30 2023-08-17T17:51:41.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.613+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1209037246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db8161020 con 0x7f1db8137e30 2023-08-17T17:51:41.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.613+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1209037246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db8153230 con 0x7f1db8137e30 2023-08-17T17:51:41.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.614+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1209037246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db8047350 con 0x7f1db8137e30 2023-08-17T17:51:41.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.614+0000 7f1dad7fa700 1 -- 172.21.15.78:0/1209037246 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f1db0019030 con 0x7f1db8137e30 2023-08-17T17:51:41.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.614+0000 7f1dad7fa700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1d9c05ee80 0x7f1d9c061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:41.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.614+0000 7f1dbd65d700 1 -- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1d9c05ee80 msgr2=0x7f1d9c061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:41.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.614+0000 7f1dad7fa700 1 -- 172.21.15.78:0/1209037246 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f1db0079310 con 0x7f1db8137e30 2023-08-17T17:51:41.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.614+0000 7f1dbd65d700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1d9c05ee80 0x7f1d9c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:41.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.618+0000 7f1dad7fa700 1 -- 172.21.15.78:0/1209037246 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1db00488f0 con 0x7f1db8137e30 2023-08-17T17:51:41.775 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:41.774+0000 7f3d06f02680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:51:41.789 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:41.788+0000 7f59e5207680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:51:41.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.815+0000 7f1dbd65d700 1 -- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1d9c05ee80 msgr2=0x7f1d9c061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:41.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.815+0000 7f1dbd65d700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1d9c05ee80 0x7f1d9c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:51:41.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.833+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1209037246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1db80c1db0 con 0x7f1db8137e30 2023-08-17T17:51:41.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.833+0000 7f1dad7fa700 1 -- 172.21.15.78:0/1209037246 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f1db0017070 con 0x7f1db8137e30 2023-08-17T17:51:41.835 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:41.835 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2389298534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2389298534},{"type":"v1","addr":"172.21.15.150:6833","nonce":2389298534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2314598053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2314598053},{"type":"v1","addr":"172.21.15.150:6835","nonce":2314598053}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/687308464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":687308464},{"type":"v1","addr":"172.21.15.78:6836","nonce":687308464}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:50:26.944921+0000","modified":"2023-08-17T17:50:28.955568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7170":{"gid":7170,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/886333866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":886333866},{"type":"v1","addr":"172.21.15.78:6837","nonce":886333866}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T17:51:41.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.835+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1d9c05ee80 msgr2=0x7f1d9c061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:41.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.835+0000 7f1dbf8c1700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1d9c05ee80 0x7f1d9c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:41.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.835+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1db8137e30 msgr2=0x7f1db80c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:41.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.835+0000 7f1dbf8c1700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1db8137e30 0x7f1db80c5cc0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f1db000c740 tx=0x7f1db000ca50).stop 2023-08-17T17:51:41.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.835+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1209037246 shutdown_connections 2023-08-17T17:51:41.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.836+0000 7f1dbf8c1700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1d9c05ee80 0x7f1d9c061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:41.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.836+0000 7f1dbf8c1700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1db8137e30 0x7f1db80c5cc0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:41.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.836+0000 7f1dbf8c1700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1db80c0ff0 0x7f1db8136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:41.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.836+0000 7f1dbf8c1700 1 --2- 172.21.15.78:0/1209037246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1db81375e0 0x7f1db80c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:41.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.836+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1209037246 >> 172.21.15.78:0/1209037246 conn(0x7f1db8062fc0 msgr2=0x7f1db80c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:41.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.836+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1209037246 shutdown_connections 2023-08-17T17:51:41.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:41.836+0000 7f1dbf8c1700 1 -- 172.21.15.78:0/1209037246 wait complete. 2023-08-17T17:51:41.839 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 37 2023-08-17T17:51:41.849 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:51:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.005+0000 7f30e7b75700 1 Processor -- start 2023-08-17T17:51:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.005+0000 7f30e7b75700 1 -- start start 2023-08-17T17:51:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e7b75700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f30e0066a40 0x7f30e00624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e7b75700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e00c6040 con 0x7f30e00629e0 2023-08-17T17:51:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e7b75700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e0069b00 con 0x7f30e0066660 2023-08-17T17:51:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e7b75700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e0062e50 con 0x7f30e0066a40 2023-08-17T17:51:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e5110700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f30e0066a40 0x7f30e00624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e5110700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f30e0066a40 0x7f30e00624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42936/0 (socket says 172.21.15.78:42936) 2023-08-17T17:51:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e5110700 1 -- 172.21.15.78:0/736940900 learned_addr learned my addr 172.21.15.78:0/736940900 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e6112700 1 --1- 172.21.15.78:0/736940900 >> v1:172.21.15.78:6789/0 conn(0x7f30e00629e0 0x7f30e0151570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57396/0 (socket says 172.21.15.78:57396) 2023-08-17T17:51:42.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e5110700 1 -- 172.21.15.78:0/736940900 >> v1:172.21.15.150:6789/0 conn(0x7f30e0066660 legacy=0x7f30e00c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e5110700 1 -- 172.21.15.78:0/736940900 >> v1:172.21.15.78:6789/0 conn(0x7f30e00629e0 legacy=0x7f30e0151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e5110700 1 -- 172.21.15.78:0/736940900 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0069f90 con 0x7f30e0066a40 2023-08-17T17:51:42.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e5110700 1 --2- 172.21.15.78:0/736940900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066a40 0x7f30e00624f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f30d0006fd0 tx=0x7f30d00090f0).ready entity=mon.0 client_cookie=ccdd0f6bd6ce1bd9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e490f700 1 -- 172.21.15.78:0/736940900 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000b600 con 0x7f30e0066a40 2023-08-17T17:51:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.006+0000 7f30e490f700 1 -- 172.21.15.78:0/736940900 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d000b760 con 0x7f30e0066a40 2023-08-17T17:51:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.007+0000 7f30e490f700 1 -- 172.21.15.78:0/736940900 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000bae0 con 0x7f30e0066a40 2023-08-17T17:51:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.007+0000 7f30e7b75700 1 -- 172.21.15.78:0/736940900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066a40 msgr2=0x7f30e00624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.007+0000 7f30e7b75700 1 --2- 172.21.15.78:0/736940900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066a40 0x7f30e00624f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f30d0006fd0 tx=0x7f30d00090f0).stop 2023-08-17T17:51:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.007+0000 7f30e7b75700 1 -- 172.21.15.78:0/736940900 shutdown_connections 2023-08-17T17:51:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.007+0000 7f30e7b75700 1 --2- 172.21.15.78:0/736940900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066a40 0x7f30e00624f0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.007+0000 7f30e7b75700 1 -- 172.21.15.78:0/736940900 >> 172.21.15.78:0/736940900 conn(0x7f30e00c7b00 msgr2=0x7f30e00c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:42.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.007+0000 7f30e7b75700 1 -- 172.21.15.78:0/736940900 shutdown_connections 2023-08-17T17:51:42.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.007+0000 7f30e7b75700 1 -- 172.21.15.78:0/736940900 wait complete. 2023-08-17T17:51:42.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.008+0000 7f30e7b75700 1 Processor -- start 2023-08-17T17:51:42.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.008+0000 7f30e7b75700 1 -- start start 2023-08-17T17:51:42.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e7b75700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30e00629e0 0x7f30e00a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e7b75700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066660 0x7f30e0152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e7b75700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30e0066a40 0x7f30e00a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e7b75700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00a8030 con 0x7f30e0066660 2023-08-17T17:51:42.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e7b75700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00a8310 con 0x7f30e00629e0 2023-08-17T17:51:42.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e7b75700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00a85f0 con 0x7f30e0066a40 2023-08-17T17:51:42.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e5110700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066660 0x7f30e0152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e5110700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066660 0x7f30e0152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42940/0 (socket says 172.21.15.78:42940) 2023-08-17T17:51:42.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e5110700 1 -- 172.21.15.78:0/3494266302 learned_addr learned my addr 172.21.15.78:0/3494266302 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:42.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e5911700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30e00629e0 0x7f30e00a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e6112700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30e0066a40 0x7f30e00a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e5110700 1 -- 172.21.15.78:0/3494266302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30e0066a40 msgr2=0x7f30e00a75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e5110700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30e0066a40 0x7f30e00a75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e5110700 1 -- 172.21.15.78:0/3494266302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30e00629e0 msgr2=0x7f30e00a90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e5110700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30e00629e0 0x7f30e00a90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.009+0000 7f30e5110700 1 -- 172.21.15.78:0/3494266302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d0009370 con 0x7f30e0066660 2023-08-17T17:51:42.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.010+0000 7f30e5110700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066660 0x7f30e0152d60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f30d0011000 tx=0x7f30d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:42.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.010+0000 7f30d5ffb700 1 -- 172.21.15.78:0/3494266302 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000b8d0 con 0x7f30e0066660 2023-08-17T17:51:42.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.010+0000 7f30d5ffb700 1 -- 172.21.15.78:0/3494266302 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d000ba30 con 0x7f30e0066660 2023-08-17T17:51:42.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.010+0000 7f30e7b75700 1 -- 172.21.15.78:0/3494266302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e00a88d0 con 0x7f30e0066660 2023-08-17T17:51:42.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.010+0000 7f30d5ffb700 1 -- 172.21.15.78:0/3494266302 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d001c670 con 0x7f30e0066660 2023-08-17T17:51:42.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.010+0000 7f30e7b75700 1 -- 172.21.15.78:0/3494266302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e0153250 con 0x7f30e0066660 2023-08-17T17:51:42.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.011+0000 7f30e7b75700 1 -- 172.21.15.78:0/3494266302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e0047350 con 0x7f30e0066660 2023-08-17T17:51:42.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.011+0000 7f30d5ffb700 1 -- 172.21.15.78:0/3494266302 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f30d0022020 con 0x7f30e0066660 2023-08-17T17:51:42.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.012+0000 7f30d5ffb700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30c405eeb0 0x7f30c4061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.012+0000 7f30e5911700 1 -- 172.21.15.78:0/3494266302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30c405eeb0 msgr2=0x7f30c4061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.012+0000 7f30d5ffb700 1 -- 172.21.15.78:0/3494266302 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f30d007b780 con 0x7f30e0066660 2023-08-17T17:51:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.012+0000 7f30e5911700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30c405eeb0 0x7f30c4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.016+0000 7f30d5ffb700 1 -- 172.21.15.78:0/3494266302 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f30d004cb60 con 0x7f30e0066660 2023-08-17T17:51:42.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.186+0000 7f30e7b75700 1 -- 172.21.15.78:0/3494266302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30e00c64b0 con 0x7f30e0066660 2023-08-17T17:51:42.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.186+0000 7f30d5ffb700 1 -- 172.21.15.78:0/3494266302 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17476 (secure 0 0 0) 0x7f30d0050180 con 0x7f30e0066660 2023-08-17T17:51:42.188 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:42.188 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":108,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:51:39.269545+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:50:25.474971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T17:50:25.916399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.11","mappings":[{"from":1,"to":3}]},{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":5}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1815432402":"2023-08-18T17:50:38.236003+0000","172.21.15.78:6833/119464":"2023-08-18T17:50:38.236003+0000","172.21.15.78:6832/119464":"2023-08-18T17:50:38.236003+0000","172.21.15.78:0/148577813":"2023-08-18T17:50:38.236003+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:51:42.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 -- 172.21.15.78:0/3494266302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30c405eeb0 msgr2=0x7f30c4061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:42.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30c405eeb0 0x7f30c4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:42.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 -- 172.21.15.78:0/3494266302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066660 msgr2=0x7f30e0152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066660 0x7f30e0152d60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f30d0011000 tx=0x7f30d0017000).stop 2023-08-17T17:51:42.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 -- 172.21.15.78:0/3494266302 shutdown_connections 2023-08-17T17:51:42.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f30c405eeb0 0x7f30c4061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:42.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30e0066a40 0x7f30e00a75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30e00629e0 0x7f30e00a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 --2- 172.21.15.78:0/3494266302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e0066660 0x7f30e0152d60 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 -- 172.21.15.78:0/3494266302 >> 172.21.15.78:0/3494266302 conn(0x7f30e00c7b00 msgr2=0x7f30e00c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:42.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 -- 172.21.15.78:0/3494266302 shutdown_connections 2023-08-17T17:51:42.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.188+0000 7f30e7b75700 1 -- 172.21.15.78:0/3494266302 wait complete. 2023-08-17T17:51:42.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:50:25.474971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:50:25.916399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:51:42.203 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:51:42.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.323+0000 7f73ff59e700 1 Processor -- start 2023-08-17T17:51:42.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.323+0000 7f73ff59e700 1 -- start start 2023-08-17T17:51:42.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73ff59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7400154e50 0x7f74000c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73ff59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74000c54c0 con 0x7f74001517c0 2023-08-17T17:51:42.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73ff59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74000c5cd0 con 0x7f7400151ba0 2023-08-17T17:51:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73ff59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74000c7620 con 0x7f7400154e50 2023-08-17T17:51:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73fe59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f74001517c0 0x7f74000695b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57410/0 (socket says 172.21.15.78:57410) 2023-08-17T17:51:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73fe59c700 1 -- 172.21.15.78:0/1864755142 learned_addr learned my addr 172.21.15.78:0/1864755142 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73fed9d700 1 --2- 172.21.15.78:0/1864755142 >> v2:172.21.15.150:3300/0 conn(0x7f7400154e50 0x7f74000c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73fd59a700 1 -- 172.21.15.78:0/1864755142 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006796388 0 0) 0x7f74000c54c0 con 0x7f74001517c0 2023-08-17T17:51:42.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73fd59a700 1 -- 172.21.15.78:0/1864755142 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e80033f0 con 0x7f74001517c0 2023-08-17T17:51:42.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73fed9d700 1 -- 172.21.15.78:0/1864755142 >> v1:172.21.15.150:6789/0 conn(0x7f7400151ba0 legacy=0x7f74000bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73fed9d700 1 -- 172.21.15.78:0/1864755142 >> v1:172.21.15.78:6789/0 conn(0x7f74001517c0 legacy=0x7f74000695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73fed9d700 1 -- 172.21.15.78:0/1864755142 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74000c5710 con 0x7f7400154e50 2023-08-17T17:51:42.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.324+0000 7f73fed9d700 1 --2- 172.21.15.78:0/1864755142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7400154e50 0x7f74000c7130 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f73f8009e60 tx=0x7f73f8009780).ready entity=mon.1 client_cookie=2ca0e3883af10e63 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:42.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.325+0000 7f73fd59a700 1 -- 172.21.15.78:0/1864755142 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f800e070 con 0x7f7400154e50 2023-08-17T17:51:42.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.325+0000 7f73fd59a700 1 -- 172.21.15.78:0/1864755142 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f800bb60 con 0x7f7400154e50 2023-08-17T17:51:42.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.325+0000 7f73fd59a700 1 -- 172.21.15.78:0/1864755142 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8012410 con 0x7f7400154e50 2023-08-17T17:51:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.325+0000 7f73ff59e700 1 -- 172.21.15.78:0/1864755142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7400154e50 msgr2=0x7f74000c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.325+0000 7f73ff59e700 1 --2- 172.21.15.78:0/1864755142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7400154e50 0x7f74000c7130 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f73f8009e60 tx=0x7f73f8009780).stop 2023-08-17T17:51:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.325+0000 7f73ff59e700 1 -- 172.21.15.78:0/1864755142 shutdown_connections 2023-08-17T17:51:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.325+0000 7f73ff59e700 1 --2- 172.21.15.78:0/1864755142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7400154e50 0x7f74000c7130 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.325+0000 7f73ff59e700 1 -- 172.21.15.78:0/1864755142 >> 172.21.15.78:0/1864755142 conn(0x7f74000640d0 msgr2=0x7f74000c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.325+0000 7f73ff59e700 1 -- 172.21.15.78:0/1864755142 shutdown_connections 2023-08-17T17:51:42.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.325+0000 7f73ff59e700 1 -- 172.21.15.78:0/1864755142 wait complete. 2023-08-17T17:51:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.326+0000 7f73ff59e700 1 Processor -- start 2023-08-17T17:51:42.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.326+0000 7f73ff59e700 1 -- start start 2023-08-17T17:51:42.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73ff59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74001517c0 0x7f74000c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73ff59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7400151ba0 0x7f74001501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73ff59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7400154e50 0x7f74001506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73ff59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7400150bb0 con 0x7f7400154e50 2023-08-17T17:51:42.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73ff59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74000bed90 con 0x7f7400151ba0 2023-08-17T17:51:42.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73ff59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74000a6190 con 0x7f74001517c0 2023-08-17T17:51:42.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73fed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7400154e50 0x7f74001506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73fed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7400154e50 0x7f74001506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42950/0 (socket says 172.21.15.78:42950) 2023-08-17T17:51:42.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73fed9d700 1 -- 172.21.15.78:0/3476644971 learned_addr learned my addr 172.21.15.78:0/3476644971 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:42.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73fe59c700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74001517c0 0x7f74000c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.327+0000 7f73fdd9b700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7400151ba0 0x7f74001501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73fed9d700 1 -- 172.21.15.78:0/3476644971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74001517c0 msgr2=0x7f74000c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73fed9d700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74001517c0 0x7f74000c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73fed9d700 1 -- 172.21.15.78:0/3476644971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7400151ba0 msgr2=0x7f74001501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73fed9d700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7400151ba0 0x7f74001501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73fed9d700 1 -- 172.21.15.78:0/3476644971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8009a20 con 0x7f7400154e50 2023-08-17T17:51:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73fed9d700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7400154e50 0x7f74001506c0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f73f80094d0 tx=0x7f73f8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73ee7fc700 1 -- 172.21.15.78:0/3476644971 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f801d630 con 0x7f7400154e50 2023-08-17T17:51:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73ee7fc700 1 -- 172.21.15.78:0/3476644971 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f801d790 con 0x7f7400154e50 2023-08-17T17:51:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73ff59e700 1 -- 172.21.15.78:0/3476644971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74000a6470 con 0x7f7400154e50 2023-08-17T17:51:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73ee7fc700 1 -- 172.21.15.78:0/3476644971 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f801db30 con 0x7f7400154e50 2023-08-17T17:51:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.328+0000 7f73ff59e700 1 -- 172.21.15.78:0/3476644971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74000a6a30 con 0x7f7400154e50 2023-08-17T17:51:42.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.329+0000 7f73ff59e700 1 -- 172.21.15.78:0/3476644971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74000bef90 con 0x7f7400154e50 2023-08-17T17:51:42.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.329+0000 7f73ee7fc700 1 -- 172.21.15.78:0/3476644971 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f73f8026410 con 0x7f7400154e50 2023-08-17T17:51:42.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.329+0000 7f73ee7fc700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73e005eeb0 0x7f73e0061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.330+0000 7f73fe59c700 1 -- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73e005eeb0 msgr2=0x7f73e0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:42.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.330+0000 7f73ee7fc700 1 -- 172.21.15.78:0/3476644971 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f73f807c050 con 0x7f7400154e50 2023-08-17T17:51:42.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.330+0000 7f73fe59c700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73e005eeb0 0x7f73e0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:42.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.334+0000 7f73ee7fc700 1 -- 172.21.15.78:0/3476644971 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f74000bef90 con 0x7f7400154e50 2023-08-17T17:51:42.388 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:42.387+0000 7f3d06f02680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:51:42.441 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:42.436+0000 7f59e5207680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:51:42.459 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:42.459+0000 7f3d06f02680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:51:42.511 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:42.510+0000 7f59e5207680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:51:42.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.531+0000 7f73fe59c700 1 -- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73e005eeb0 msgr2=0x7f73e0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:42.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.531+0000 7f73fe59c700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73e005eeb0 0x7f73e0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:51:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.544+0000 7f73ff59e700 1 -- 172.21.15.78:0/3476644971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f74000bef50 con 0x7f7400154e50 2023-08-17T17:51:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.544+0000 7f73ee7fc700 1 -- 172.21.15.78:0/3476644971 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7f73f804d480 con 0x7f7400154e50 2023-08-17T17:51:42.545 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:51:42.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 -- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73e005eeb0 msgr2=0x7f73e0061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73e005eeb0 0x7f73e0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 -- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7400154e50 msgr2=0x7f74001506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7400154e50 0x7f74001506c0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f73f80094d0 tx=0x7f73f8009780).stop 2023-08-17T17:51:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 -- 172.21.15.78:0/3476644971 shutdown_connections 2023-08-17T17:51:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f73e005eeb0 0x7f73e0061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7400154e50 0x7f74001506c0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74001517c0 0x7f74000c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 --2- 172.21.15.78:0/3476644971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7400151ba0 0x7f74001501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 -- 172.21.15.78:0/3476644971 >> 172.21.15.78:0/3476644971 conn(0x7f74000640d0 msgr2=0x7f7400069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:42.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 -- 172.21.15.78:0/3476644971 shutdown_connections 2023-08-17T17:51:42.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.546+0000 7f73ff59e700 1 -- 172.21.15.78:0/3476644971 wait complete. 2023-08-17T17:51:42.560 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:51:42.647 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:42.646+0000 7f3d06f02680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:51:42.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.678+0000 7fbb6385a700 1 Processor -- start 2023-08-17T17:51:42.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.679+0000 7fbb6385a700 1 -- start start 2023-08-17T17:51:42.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.679+0000 7fbb6385a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbb5c096520 0x7fbb5c0be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.679+0000 7fbb6385a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 0x7fbb5c0c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.679+0000 7fbb6385a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c0c3e10 con 0x7fbb5c1578f0 2023-08-17T17:51:42.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.679+0000 7fbb6385a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5c0bf5c0 con 0x7fbb5c096520 2023-08-17T17:51:42.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.679+0000 7fbb6385a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0c32d0 con 0x7fbb5c0bf0e0 2023-08-17T17:51:42.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb60df5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbb5c096520 0x7fbb5c0be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb60df5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbb5c096520 0x7fbb5c0be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42960/0 (socket says 172.21.15.78:42960) 2023-08-17T17:51:42.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb60df5700 1 -- 172.21.15.78:0/1833945683 learned_addr learned my addr 172.21.15.78:0/1833945683 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:42.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb61df7700 1 --2- 172.21.15.78:0/1833945683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 0x7fbb5c0c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb60df5700 1 -- 172.21.15.78:0/1833945683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 msgr2=0x7fbb5c0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb60df5700 1 --2- 172.21.15.78:0/1833945683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 0x7fbb5c0c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb60df5700 1 -- 172.21.15.78:0/1833945683 >> v1:172.21.15.150:6789/0 conn(0x7fbb5c1578f0 legacy=0x7fbb5c095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb60df5700 1 -- 172.21.15.78:0/1833945683 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c0c34e0 con 0x7fbb5c096520 2023-08-17T17:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb61df7700 1 --2- 172.21.15.78:0/1833945683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 0x7fbb5c0c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb60df5700 1 --2- 172.21.15.78:0/1833945683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c096520 0x7fbb5c0be210 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fbb58006fd0 tx=0x7fbb580090f0).ready entity=mon.0 client_cookie=6d92b56bbf402c36 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:42.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb4ffff700 1 -- 172.21.15.78:0/1833945683 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800b600 con 0x7fbb5c096520 2023-08-17T17:51:42.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb4ffff700 1 -- 172.21.15.78:0/1833945683 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5800b760 con 0x7fbb5c096520 2023-08-17T17:51:42.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.680+0000 7fbb4ffff700 1 -- 172.21.15.78:0/1833945683 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800bb00 con 0x7fbb5c096520 2023-08-17T17:51:42.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.681+0000 7fbb6385a700 1 -- 172.21.15.78:0/1833945683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c096520 msgr2=0x7fbb5c0be210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.681+0000 7fbb6385a700 1 --2- 172.21.15.78:0/1833945683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c096520 0x7fbb5c0be210 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fbb58006fd0 tx=0x7fbb580090f0).stop 2023-08-17T17:51:42.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.681+0000 7fbb6385a700 1 -- 172.21.15.78:0/1833945683 shutdown_connections 2023-08-17T17:51:42.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.681+0000 7fbb6385a700 1 --2- 172.21.15.78:0/1833945683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 0x7fbb5c0c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.681+0000 7fbb6385a700 1 --2- 172.21.15.78:0/1833945683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c096520 0x7fbb5c0be210 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.681+0000 7fbb6385a700 1 -- 172.21.15.78:0/1833945683 >> 172.21.15.78:0/1833945683 conn(0x7fbb5c062f80 msgr2=0x7fbb5c0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:42.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.681+0000 7fbb6385a700 1 -- 172.21.15.78:0/1833945683 shutdown_connections 2023-08-17T17:51:42.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.681+0000 7fbb6385a700 1 -- 172.21.15.78:0/1833945683 wait complete. 2023-08-17T17:51:42.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.683+0000 7fbb6385a700 1 Processor -- start 2023-08-17T17:51:42.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.683+0000 7fbb6385a700 1 -- start start 2023-08-17T17:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.684+0000 7fbb6385a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb5c096520 0x7fbb5c149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.684+0000 7fbb6385a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 0x7fbb5c155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb6385a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c1578f0 0x7fbb5c0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb6385a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0ad330 con 0x7fbb5c1578f0 2023-08-17T17:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb6385a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0ae150 con 0x7fbb5c096520 2023-08-17T17:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb6385a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0ad540 con 0x7fbb5c0bf0e0 2023-08-17T17:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb61df7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c1578f0 0x7fbb5c0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb61df7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c1578f0 0x7fbb5c0ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42962/0 (socket says 172.21.15.78:42962) 2023-08-17T17:51:42.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb61df7700 1 -- 172.21.15.78:0/338815664 learned_addr learned my addr 172.21.15.78:0/338815664 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb615f6700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb5c096520 0x7fbb5c149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb60df5700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 0x7fbb5c155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb61df7700 1 -- 172.21.15.78:0/338815664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 msgr2=0x7fbb5c155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb61df7700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 0x7fbb5c155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb61df7700 1 -- 172.21.15.78:0/338815664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb5c096520 msgr2=0x7fbb5c149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb61df7700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb5c096520 0x7fbb5c149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb61df7700 1 -- 172.21.15.78:0/338815664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58009370 con 0x7fbb5c1578f0 2023-08-17T17:51:42.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb61df7700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c1578f0 0x7fbb5c0ae5e0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fbb5400d150 tx=0x7fbb54009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:42.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb4d7fa700 1 -- 172.21.15.78:0/338815664 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400dc30 con 0x7fbb5c1578f0 2023-08-17T17:51:42.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb4d7fa700 1 -- 172.21.15.78:0/338815664 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5400f040 con 0x7fbb5c1578f0 2023-08-17T17:51:42.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb4d7fa700 1 -- 172.21.15.78:0/338815664 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540133f0 con 0x7fbb5c1578f0 2023-08-17T17:51:42.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb6385a700 1 -- 172.21.15.78:0/338815664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c0ad820 con 0x7fbb5c1578f0 2023-08-17T17:51:42.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.685+0000 7fbb6385a700 1 -- 172.21.15.78:0/338815664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c0adde0 con 0x7fbb5c1578f0 2023-08-17T17:51:42.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.686+0000 7fbb6385a700 1 -- 172.21.15.78:0/338815664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c0ae2e0 con 0x7fbb5c1578f0 2023-08-17T17:51:42.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.687+0000 7fbb4d7fa700 1 -- 172.21.15.78:0/338815664 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fbb540137e0 con 0x7fbb5c1578f0 2023-08-17T17:51:42.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.687+0000 7fbb4d7fa700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbb4005eeb0 0x7fbb40061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:42.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.687+0000 7fbb615f6700 1 -- 172.21.15.78:0/338815664 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbb4005eeb0 msgr2=0x7fbb40061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:42.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.687+0000 7fbb4d7fa700 1 -- 172.21.15.78:0/338815664 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fbb5407b2c0 con 0x7fbb5c1578f0 2023-08-17T17:51:42.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.688+0000 7fbb615f6700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbb4005eeb0 0x7fbb40061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:42.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.692+0000 7fbb4d7fa700 1 -- 172.21.15.78:0/338815664 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbb5404c720 con 0x7fbb5c1578f0 2023-08-17T17:51:42.709 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:42.708+0000 7f59e5207680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:51:42.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.862+0000 7fbb6385a700 1 -- 172.21.15.78:0/338815664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb5c0c37c0 con 0x7fbb5c1578f0 2023-08-17T17:51:42.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.863+0000 7fbb4d7fa700 1 -- 172.21.15.78:0/338815664 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb5404fd40 con 0x7fbb5c1578f0 2023-08-17T17:51:42.864 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:51:42.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 -- 172.21.15.78:0/338815664 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbb4005eeb0 msgr2=0x7fbb40061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:42.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbb4005eeb0 0x7fbb40061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:42.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 -- 172.21.15.78:0/338815664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c1578f0 msgr2=0x7fbb5c0ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:42.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c1578f0 0x7fbb5c0ae5e0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fbb5400d150 tx=0x7fbb54009a50).stop 2023-08-17T17:51:42.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 -- 172.21.15.78:0/338815664 shutdown_connections 2023-08-17T17:51:42.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbb4005eeb0 0x7fbb40061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:42.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb5c1578f0 0x7fbb5c0ae5e0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb5c096520 0x7fbb5c149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 --2- 172.21.15.78:0/338815664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb5c0bf0e0 0x7fbb5c155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:42.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 -- 172.21.15.78:0/338815664 >> 172.21.15.78:0/338815664 conn(0x7fbb5c062f80 msgr2=0x7fbb5c0c4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:42.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 -- 172.21.15.78:0/338815664 shutdown_connections 2023-08-17T17:51:42.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.865+0000 7fbb6385a700 1 -- 172.21.15.78:0/338815664 wait complete. 2023-08-17T17:51:42.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:51:43.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.999+0000 7fdd256cd700 1 Processor -- start 2023-08-17T17:51:43.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.999+0000 7fdd256cd700 1 -- start start 2023-08-17T17:51:43.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.999+0000 7fdd256cd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdd200aa4d0 0x7fdd200644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.999+0000 7fdd256cd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 0x7fdd200c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:42.999+0000 7fdd256cd700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd200649b0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd256cd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd200c6170 con 0x7fdd200aa4d0 2023-08-17T17:51:43.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd256cd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd20063420 con 0x7fdd200c5810 2023-08-17T17:51:43.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1effd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdd200aa0f0 0x7fdd200c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57422/0 (socket says 172.21.15.78:57422) 2023-08-17T17:51:43.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1effd700 1 -- 172.21.15.78:0/2306088214 learned_addr learned my addr 172.21.15.78:0/2306088214 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:43.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1f7fe700 1 --2- 172.21.15.78:0/2306088214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 0x7fdd200c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1e7fc700 1 --2- 172.21.15.78:0/2306088214 >> v2:172.21.15.150:3300/0 conn(0x7fdd200aa4d0 0x7fdd200644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1dffb700 1 -- 172.21.15.78:0/2306088214 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427980766 0 0) 0x7fdd200649b0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1dffb700 1 -- 172.21.15.78:0/2306088214 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd080033f0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1f7fe700 1 -- 172.21.15.78:0/2306088214 >> v2:172.21.15.150:3300/0 conn(0x7fdd200aa4d0 msgr2=0x7fdd200644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:43.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1f7fe700 1 --2- 172.21.15.78:0/2306088214 >> v2:172.21.15.150:3300/0 conn(0x7fdd200aa4d0 0x7fdd200644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1f7fe700 1 -- 172.21.15.78:0/2306088214 >> v1:172.21.15.78:6789/0 conn(0x7fdd200aa0f0 legacy=0x7fdd200c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1dffb700 1 -- 172.21.15.78:0/2306088214 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80265504 0 0) 0x7fdd080033f0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1f7fe700 1 -- 172.21.15.78:0/2306088214 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd20063700 con 0x7fdd200c5810 2023-08-17T17:51:43.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1e7fc700 1 --2- 172.21.15.78:0/2306088214 >> v2:172.21.15.150:3300/0 conn(0x7fdd200aa4d0 0x7fdd200644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:51:43.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.000+0000 7fdd1f7fe700 1 --2- 172.21.15.78:0/2306088214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 0x7fdd200c5c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fdd18009e60 tx=0x7fdd18009780).ready entity=mon.2 client_cookie=a673337890a64242 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:43.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd1dffb700 1 -- 172.21.15.78:0/2306088214 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1800e070 con 0x7fdd200c5810 2023-08-17T17:51:43.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd1dffb700 1 -- 172.21.15.78:0/2306088214 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1800b7a0 con 0x7fdd200c5810 2023-08-17T17:51:43.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd1dffb700 1 -- 172.21.15.78:0/2306088214 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10001470 con 0x7fdd200c5810 2023-08-17T17:51:43.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd256cd700 1 -- 172.21.15.78:0/2306088214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 msgr2=0x7fdd200c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd256cd700 1 --2- 172.21.15.78:0/2306088214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 0x7fdd200c5c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fdd18009e60 tx=0x7fdd18009780).stop 2023-08-17T17:51:43.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd256cd700 1 -- 172.21.15.78:0/2306088214 shutdown_connections 2023-08-17T17:51:43.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd256cd700 1 --2- 172.21.15.78:0/2306088214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 0x7fdd200c5c80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd256cd700 1 --2- 172.21.15.78:0/2306088214 >> v2:172.21.15.150:3300/0 conn(0x7fdd200aa4d0 0x7fdd200644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd256cd700 1 -- 172.21.15.78:0/2306088214 >> 172.21.15.78:0/2306088214 conn(0x7fdd2006a6a0 msgr2=0x7fdd200caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:43.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd256cd700 1 -- 172.21.15.78:0/2306088214 shutdown_connections 2023-08-17T17:51:43.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.001+0000 7fdd256cd700 1 -- 172.21.15.78:0/2306088214 wait complete. 2023-08-17T17:51:43.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.002+0000 7fdd256cd700 1 Processor -- start 2023-08-17T17:51:43.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.002+0000 7fdd256cd700 1 -- start start 2023-08-17T17:51:43.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd256cd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd200aa0f0 0x7fdd20165710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd256cd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd200aa4d0 0x7fdd200a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd256cd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 0x7fdd20167b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd256cd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200b02f0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd256cd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd20168a00 con 0x7fdd200aa4d0 2023-08-17T17:51:43.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd256cd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd20168720 con 0x7fdd200c5810 2023-08-17T17:51:43.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd1effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd200aa0f0 0x7fdd20165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd1effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd200aa0f0 0x7fdd20165710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42972/0 (socket says 172.21.15.78:42972) 2023-08-17T17:51:43.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd1effd700 1 -- 172.21.15.78:0/2944552758 learned_addr learned my addr 172.21.15.78:0/2944552758 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:43.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd1f7fe700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 0x7fdd20167b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.003+0000 7fdd1e7fc700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd200aa4d0 0x7fdd200a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd1effd700 1 -- 172.21.15.78:0/2944552758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 msgr2=0x7fdd20167b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd1effd700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 0x7fdd20167b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd1effd700 1 -- 172.21.15.78:0/2944552758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd200aa4d0 msgr2=0x7fdd200a91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd1effd700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd200aa4d0 0x7fdd200a91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd1effd700 1 -- 172.21.15.78:0/2944552758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd140092a0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd1effd700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd200aa0f0 0x7fdd20165710 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fdd1000c810 tx=0x7fdd10001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:43.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd06ffd700 1 -- 172.21.15.78:0/2944552758 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10007170 con 0x7fdd200aa0f0 2023-08-17T17:51:43.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd256cd700 1 -- 172.21.15.78:0/2944552758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd18009a20 con 0x7fdd200aa0f0 2023-08-17T17:51:43.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd06ffd700 1 -- 172.21.15.78:0/2944552758 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd100072d0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd06ffd700 1 -- 172.21.15.78:0/2944552758 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd100048c0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.004+0000 7fdd256cd700 1 -- 172.21.15.78:0/2944552758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2014dc70 con 0x7fdd200aa0f0 2023-08-17T17:51:43.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.005+0000 7fdd256cd700 1 -- 172.21.15.78:0/2944552758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2014d7f0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.006+0000 7fdd06ffd700 1 -- 172.21.15.78:0/2944552758 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fdd10004c70 con 0x7fdd200aa0f0 2023-08-17T17:51:43.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.006+0000 7fdd06ffd700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdd0c05eeb0 0x7fdd0c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.006+0000 7fdd1e7fc700 1 -- 172.21.15.78:0/2944552758 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdd0c05eeb0 msgr2=0x7fdd0c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:43.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.006+0000 7fdd06ffd700 1 -- 172.21.15.78:0/2944552758 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fdd10079990 con 0x7fdd200aa0f0 2023-08-17T17:51:43.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.006+0000 7fdd1e7fc700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdd0c05eeb0 0x7fdd0c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:43.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.012+0000 7fdd06ffd700 1 -- 172.21.15.78:0/2944552758 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdd2014d7f0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.069 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:43.069+0000 7f3d06f02680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:51:43.151 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:43.150+0000 7f59e5207680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:51:43.172 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:43.171+0000 7f3d06f02680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:51:43.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.183+0000 7fdd256cd700 1 -- 172.21.15.78:0/2944552758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd2014d7f0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.183+0000 7fdd06ffd700 1 -- 172.21.15.78:0/2944552758 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd2014d7f0 con 0x7fdd200aa0f0 2023-08-17T17:51:43.185 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:51:43.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 -- 172.21.15.78:0/2944552758 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdd0c05eeb0 msgr2=0x7fdd0c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:43.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdd0c05eeb0 0x7fdd0c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:43.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 -- 172.21.15.78:0/2944552758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd200aa0f0 msgr2=0x7fdd20165710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd200aa0f0 0x7fdd20165710 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fdd1000c810 tx=0x7fdd10001ab0).stop 2023-08-17T17:51:43.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 -- 172.21.15.78:0/2944552758 shutdown_connections 2023-08-17T17:51:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdd0c05eeb0 0x7fdd0c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd200c5810 0x7fdd20167b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd200aa0f0 0x7fdd20165710 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 --2- 172.21.15.78:0/2944552758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd200aa4d0 0x7fdd200a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 -- 172.21.15.78:0/2944552758 >> 172.21.15.78:0/2944552758 conn(0x7fdd2006a6a0 msgr2=0x7fdd200a85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 -- 172.21.15.78:0/2944552758 shutdown_connections 2023-08-17T17:51:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.185+0000 7fdd256cd700 1 -- 172.21.15.78:0/2944552758 wait complete. 2023-08-17T17:51:43.199 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:51:43.261 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:43.260+0000 7f59e5207680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:51:43.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.318+0000 7f1213097700 1 Processor -- start 2023-08-17T17:51:43.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.318+0000 7f1213097700 1 -- start start 2023-08-17T17:51:43.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1213097700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f120c153f10 0x7f120c0640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1213097700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c0c7990 0x7f120c0be0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1213097700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120c0bdc30 con 0x7f120c064590 2023-08-17T17:51:43.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1213097700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120c064a10 con 0x7f120c153f10 2023-08-17T17:51:43.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1213097700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0c7df0 con 0x7f120c0c7990 2023-08-17T17:51:43.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1211634700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c0c7990 0x7f120c0be0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1210e33700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f120c153f10 0x7f120c0640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1211634700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c0c7990 0x7f120c0be0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:49216/0 (socket says 172.21.15.78:49216) 2023-08-17T17:51:43.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1210e33700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f120c153f10 0x7f120c0640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:42450/0 (socket says 172.21.15.78:42450) 2023-08-17T17:51:43.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1211634700 1 -- 172.21.15.78:0/2749368596 learned_addr learned my addr 172.21.15.78:0/2749368596 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:43.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f120bfff700 1 --1- 172.21.15.78:0/2749368596 >> v1:172.21.15.150:6789/0 conn(0x7f120c064590 0x7f120c0c7280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:38370/0 (socket says 172.21.15.78:38370) 2023-08-17T17:51:43.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1210e33700 1 -- 172.21.15.78:0/2749368596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c0c7990 msgr2=0x7f120c0be0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:43.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1210e33700 1 --2- 172.21.15.78:0/2749368596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c0c7990 0x7f120c0be0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1210e33700 1 -- 172.21.15.78:0/2749368596 >> v1:172.21.15.150:6789/0 conn(0x7f120c064590 legacy=0x7f120c0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f120b7fe700 1 -- 172.21.15.78:0/2749368596 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051200826 0 0) 0x7f120c0bdc30 con 0x7f120c064590 2023-08-17T17:51:43.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1210e33700 1 -- 172.21.15.78:0/2749368596 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c0c80b0 con 0x7f120c153f10 2023-08-17T17:51:43.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.319+0000 7f1211634700 1 --2- 172.21.15.78:0/2749368596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c0c7990 0x7f120c0be0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:51:43.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f1210e33700 1 --2- 172.21.15.78:0/2749368596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f120c153f10 0x7f120c0640a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f1200006fd0 tx=0x7f1200006f40).ready entity=mon.1 client_cookie=448c6740296ce569 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:43.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f120b7fe700 1 -- 172.21.15.78:0/2749368596 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200005880 con 0x7f120c153f10 2023-08-17T17:51:43.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f120b7fe700 1 -- 172.21.15.78:0/2749368596 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12000059e0 con 0x7f120c153f10 2023-08-17T17:51:43.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f120b7fe700 1 -- 172.21.15.78:0/2749368596 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200005d60 con 0x7f120c153f10 2023-08-17T17:51:43.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f1213097700 1 -- 172.21.15.78:0/2749368596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f120c153f10 msgr2=0x7f120c0640a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f1213097700 1 --2- 172.21.15.78:0/2749368596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f120c153f10 0x7f120c0640a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f1200006fd0 tx=0x7f1200006f40).stop 2023-08-17T17:51:43.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f1213097700 1 -- 172.21.15.78:0/2749368596 shutdown_connections 2023-08-17T17:51:43.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f1213097700 1 --2- 172.21.15.78:0/2749368596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c0c7990 0x7f120c0be0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f1213097700 1 --2- 172.21.15.78:0/2749368596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f120c153f10 0x7f120c0640a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f1213097700 1 -- 172.21.15.78:0/2749368596 >> 172.21.15.78:0/2749368596 conn(0x7f120c0922f0 msgr2=0x7f120c062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:43.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f1213097700 1 -- 172.21.15.78:0/2749368596 shutdown_connections 2023-08-17T17:51:43.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.320+0000 7f1213097700 1 -- 172.21.15.78:0/2749368596 wait complete. 2023-08-17T17:51:43.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.322+0000 7f1213097700 1 Processor -- start 2023-08-17T17:51:43.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.322+0000 7f1213097700 1 -- start start 2023-08-17T17:51:43.326 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:43.325+0000 7f3d06f02680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:51:43.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.322+0000 7f1213097700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f120c064590 0x7f120c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.322+0000 7f1213097700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120c0c7990 0x7f120c14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.322+0000 7f1213097700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c153f10 0x7f120c0acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1213097700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0acb30 con 0x7f120c0c7990 2023-08-17T17:51:43.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1213097700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0abf20 con 0x7f120c064590 2023-08-17T17:51:43.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1213097700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0ac200 con 0x7f120c153f10 2023-08-17T17:51:43.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f120bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120c0c7990 0x7f120c14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f120bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120c0c7990 0x7f120c14e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42986/0 (socket says 172.21.15.78:42986) 2023-08-17T17:51:43.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f120bfff700 1 -- 172.21.15.78:0/3225150223 learned_addr learned my addr 172.21.15.78:0/3225150223 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:43.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1211634700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c153f10 0x7f120c0acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1210e33700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f120c064590 0x7f120c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f120bfff700 1 -- 172.21.15.78:0/3225150223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c153f10 msgr2=0x7f120c0acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f120bfff700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c153f10 0x7f120c0acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f120bfff700 1 -- 172.21.15.78:0/3225150223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f120c064590 msgr2=0x7f120c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f120bfff700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f120c064590 0x7f120c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f120bfff700 1 -- 172.21.15.78:0/3225150223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1204009ae0 con 0x7f120c0c7990 2023-08-17T17:51:43.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1211634700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c153f10 0x7f120c0acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:51:43.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f120bfff700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120c0c7990 0x7f120c14e0e0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f11f800c560 tx=0x7f11f8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:43.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1208ff9700 1 -- 172.21.15.78:0/3225150223 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80072e0 con 0x7f120c0c7990 2023-08-17T17:51:43.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1213097700 1 -- 172.21.15.78:0/3225150223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1200009250 con 0x7f120c0c7990 2023-08-17T17:51:43.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1208ff9700 1 -- 172.21.15.78:0/3225150223 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8007440 con 0x7f120c0c7990 2023-08-17T17:51:43.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1208ff9700 1 -- 172.21.15.78:0/3225150223 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80058f0 con 0x7f120c0c7990 2023-08-17T17:51:43.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.323+0000 7f1213097700 1 -- 172.21.15.78:0/3225150223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120c0ac840 con 0x7f120c0c7990 2023-08-17T17:51:43.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.324+0000 7f1213097700 1 -- 172.21.15.78:0/3225150223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120c0acca0 con 0x7f120c0c7990 2023-08-17T17:51:43.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.325+0000 7f1208ff9700 1 -- 172.21.15.78:0/3225150223 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f11f8010070 con 0x7f120c0c7990 2023-08-17T17:51:43.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.325+0000 7f1208ff9700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f11f005ee80 0x7f11f0061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.325+0000 7f1210e33700 1 -- 172.21.15.78:0/3225150223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f11f005ee80 msgr2=0x7f11f0061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:43.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.325+0000 7f1208ff9700 1 -- 172.21.15.78:0/3225150223 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f11f80793b0 con 0x7f120c0c7990 2023-08-17T17:51:43.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.325+0000 7f1210e33700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f11f005ee80 0x7f11f0061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:43.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.332+0000 7f1208ff9700 1 -- 172.21.15.78:0/3225150223 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f11f804a810 con 0x7f120c0c7990 2023-08-17T17:51:43.401 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:43.401+0000 7f3d06f02680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:51:43.423 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:43.421+0000 7f59e5207680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:51:43.468 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:43.468+0000 7f3d06f02680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:51:43.499 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:43.498+0000 7f59e5207680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:51:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.502+0000 7f1213097700 1 -- 172.21.15.78:0/3225150223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f120c0c8390 con 0x7f120c0c7990 2023-08-17T17:51:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.503+0000 7f1208ff9700 1 -- 172.21.15.78:0/3225150223 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11f804de30 con 0x7f120c0c7990 2023-08-17T17:51:43.504 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:51:43.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 -- 172.21.15.78:0/3225150223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f11f005ee80 msgr2=0x7f11f0061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:43.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f11f005ee80 0x7f11f0061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:43.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 -- 172.21.15.78:0/3225150223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120c0c7990 msgr2=0x7f120c14e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120c0c7990 0x7f120c14e0e0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f11f800c560 tx=0x7f11f8007c90).stop 2023-08-17T17:51:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 -- 172.21.15.78:0/3225150223 shutdown_connections 2023-08-17T17:51:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f11f005ee80 0x7f11f0061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f120c153f10 0x7f120c0acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f120c064590 0x7f120c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 --2- 172.21.15.78:0/3225150223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120c0c7990 0x7f120c14e0e0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 -- 172.21.15.78:0/3225150223 >> 172.21.15.78:0/3225150223 conn(0x7f120c0922f0 msgr2=0x7f120c0a6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 -- 172.21.15.78:0/3225150223 shutdown_connections 2023-08-17T17:51:43.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.505+0000 7f1213097700 1 -- 172.21.15.78:0/3225150223 wait complete. 2023-08-17T17:51:43.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:51:43.573 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:43.572+0000 7f59e5207680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:51:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.633+0000 7f329092c700 1 Processor -- start 2023-08-17T17:51:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.633+0000 7f329092c700 1 -- start start 2023-08-17T17:51:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.634+0000 7f329092c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f328c1575e0 0x7f328c095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.634+0000 7f329092c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f328c096300 0x7f328c064380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.634+0000 7f329092c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328c096720 con 0x7f328c157200 2023-08-17T17:51:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.634+0000 7f329092c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328c0c57f0 con 0x7f328c1575e0 2023-08-17T17:51:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.634+0000 7f329092c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0c5ad0 con 0x7f328c096300 2023-08-17T17:51:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.634+0000 7f3283fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f328c1575e0 0x7f328c095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.634+0000 7f3283fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f328c1575e0 0x7f328c095e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42990/0 (socket says 172.21.15.78:42990) 2023-08-17T17:51:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.634+0000 7f3283fff700 1 -- 172.21.15.78:0/3809594577 learned_addr learned my addr 172.21.15.78:0/3809594577 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.634+0000 7f328bfff700 1 --2- 172.21.15.78:0/3809594577 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f328c096300 0x7f328c064380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f3283fff700 1 -- 172.21.15.78:0/3809594577 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f328c096300 msgr2=0x7f328c064380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f3283fff700 1 --2- 172.21.15.78:0/3809594577 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f328c096300 0x7f328c064380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f3283fff700 1 -- 172.21.15.78:0/3809594577 >> v1:172.21.15.150:6789/0 conn(0x7f328c157200 legacy=0x7f328c0a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f328affd700 1 -- 172.21.15.78:0/3809594577 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720236744 0 0) 0x7f328c096720 con 0x7f328c157200 2023-08-17T17:51:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f3283fff700 1 -- 172.21.15.78:0/3809594577 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c0c5db0 con 0x7f328c1575e0 2023-08-17T17:51:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f3283fff700 1 --2- 172.21.15.78:0/3809594577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c1575e0 0x7f328c095e10 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f3274006fd0 tx=0x7f32740090f0).ready entity=mon.0 client_cookie=5d91013ebf8effc9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f328affd700 1 -- 172.21.15.78:0/3809594577 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400b580 con 0x7f328c1575e0 2023-08-17T17:51:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f328affd700 1 -- 172.21.15.78:0/3809594577 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400b6e0 con 0x7f328c1575e0 2023-08-17T17:51:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f328affd700 1 -- 172.21.15.78:0/3809594577 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400ba60 con 0x7f328c1575e0 2023-08-17T17:51:43.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f329092c700 1 -- 172.21.15.78:0/3809594577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c1575e0 msgr2=0x7f328c095e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.635+0000 7f329092c700 1 --2- 172.21.15.78:0/3809594577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c1575e0 0x7f328c095e10 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f3274006fd0 tx=0x7f32740090f0).stop 2023-08-17T17:51:43.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.636+0000 7f329092c700 1 -- 172.21.15.78:0/3809594577 shutdown_connections 2023-08-17T17:51:43.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.636+0000 7f329092c700 1 --2- 172.21.15.78:0/3809594577 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f328c096300 0x7f328c064380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.636+0000 7f329092c700 1 --2- 172.21.15.78:0/3809594577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c1575e0 0x7f328c095e10 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.636+0000 7f329092c700 1 -- 172.21.15.78:0/3809594577 >> 172.21.15.78:0/3809594577 conn(0x7f328c0624f0 msgr2=0x7f328c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:43.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.636+0000 7f329092c700 1 -- 172.21.15.78:0/3809594577 shutdown_connections 2023-08-17T17:51:43.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.636+0000 7f329092c700 1 -- 172.21.15.78:0/3809594577 wait complete. 2023-08-17T17:51:43.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.637+0000 7f329092c700 1 Processor -- start 2023-08-17T17:51:43.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.637+0000 7f329092c700 1 -- start start 2023-08-17T17:51:43.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.637+0000 7f329092c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f328c096300 0x7f328c164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.637+0000 7f329092c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c157200 0x7f328c0abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.637+0000 7f329092c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f328c1575e0 0x7f328c164f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.637+0000 7f329092c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0acd70 con 0x7f328c157200 2023-08-17T17:51:43.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.637+0000 7f329092c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c165410 con 0x7f328c096300 2023-08-17T17:51:43.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.637+0000 7f329092c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0c2930 con 0x7f328c1575e0 2023-08-17T17:51:43.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.637+0000 7f3283fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c157200 0x7f328c0abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f3283fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c157200 0x7f328c0abad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42992/0 (socket says 172.21.15.78:42992) 2023-08-17T17:51:43.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f3283fff700 1 -- 172.21.15.78:0/1985124389 learned_addr learned my addr 172.21.15.78:0/1985124389 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:43.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f328b7fe700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f328c096300 0x7f328c164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f328bfff700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f328c1575e0 0x7f328c164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f3283fff700 1 -- 172.21.15.78:0/1985124389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f328c1575e0 msgr2=0x7f328c164f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f3283fff700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f328c1575e0 0x7f328c164f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f3283fff700 1 -- 172.21.15.78:0/1985124389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f328c096300 msgr2=0x7f328c164410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f3283fff700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f328c096300 0x7f328c164410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f3283fff700 1 -- 172.21.15.78:0/1985124389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3274009370 con 0x7f328c157200 2023-08-17T17:51:43.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f3283fff700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c157200 0x7f328c0abad0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f328c065a30 tx=0x7f3274017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:43.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f32837fe700 1 -- 172.21.15.78:0/1985124389 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274000bc0 con 0x7f328c157200 2023-08-17T17:51:43.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f32837fe700 1 -- 172.21.15.78:0/1985124389 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400b850 con 0x7f328c157200 2023-08-17T17:51:43.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f329092c700 1 -- 172.21.15.78:0/1985124389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c0ac160 con 0x7f328c157200 2023-08-17T17:51:43.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f32837fe700 1 -- 172.21.15.78:0/1985124389 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274000d20 con 0x7f328c157200 2023-08-17T17:51:43.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.638+0000 7f329092c700 1 -- 172.21.15.78:0/1985124389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c0ac720 con 0x7f328c157200 2023-08-17T17:51:43.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.639+0000 7f329092c700 1 -- 172.21.15.78:0/1985124389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c069430 con 0x7f328c157200 2023-08-17T17:51:43.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.640+0000 7f32837fe700 1 -- 172.21.15.78:0/1985124389 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f327400f070 con 0x7f328c157200 2023-08-17T17:51:43.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.640+0000 7f32837fe700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f326c05eeb0 0x7f326c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.640+0000 7f328b7fe700 1 -- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f326c05eeb0 msgr2=0x7f326c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:43.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.640+0000 7f32837fe700 1 -- 172.21.15.78:0/1985124389 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f327407b420 con 0x7f328c157200 2023-08-17T17:51:43.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.640+0000 7f328b7fe700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f326c05eeb0 0x7f326c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:43.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.644+0000 7f32837fe700 1 -- 172.21.15.78:0/1985124389 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f327404c6f0 con 0x7f328c157200 2023-08-17T17:51:43.728 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:43.728+0000 7f3d06f02680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:51:43.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.841+0000 7f328b7fe700 1 -- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f326c05eeb0 msgr2=0x7f326c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:43.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.841+0000 7f328b7fe700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f326c05eeb0 0x7f326c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:51:43.842 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:43.841+0000 7f59e5207680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:51:43.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.855+0000 7f329092c700 1 -- 172.21.15.78:0/1985124389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f328c0c6090 con 0x7f328c157200 2023-08-17T17:51:43.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.856+0000 7f32837fe700 1 -- 172.21.15.78:0/1985124389 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f3274079750 con 0x7f328c157200 2023-08-17T17:51:43.857 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:43.857 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2389298534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2389298534},{"type":"v1","addr":"172.21.15.150:6833","nonce":2389298534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2314598053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2314598053},{"type":"v1","addr":"172.21.15.150:6835","nonce":2314598053}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/687308464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":687308464},{"type":"v1","addr":"172.21.15.78:6836","nonce":687308464}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:50:26.944921+0000","modified":"2023-08-17T17:50:28.955568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7170":{"gid":7170,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/886333866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":886333866},{"type":"v1","addr":"172.21.15.78:6837","nonce":886333866}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T17:51:43.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 -- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f326c05eeb0 msgr2=0x7f326c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:43.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f326c05eeb0 0x7f326c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:43.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 -- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c157200 msgr2=0x7f328c0abad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c157200 0x7f328c0abad0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f328c065a30 tx=0x7f3274017000).stop 2023-08-17T17:51:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 -- 172.21.15.78:0/1985124389 shutdown_connections 2023-08-17T17:51:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f326c05eeb0 0x7f326c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f328c1575e0 0x7f328c164f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f328c096300 0x7f328c164410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 --2- 172.21.15.78:0/1985124389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f328c157200 0x7f328c0abad0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 -- 172.21.15.78:0/1985124389 >> 172.21.15.78:0/1985124389 conn(0x7f328c0624f0 msgr2=0x7f328c0c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 -- 172.21.15.78:0/1985124389 shutdown_connections 2023-08-17T17:51:43.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.858+0000 7f329092c700 1 -- 172.21.15.78:0/1985124389 wait complete. 2023-08-17T17:51:43.861 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 37 2023-08-17T17:51:43.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:51:43.913 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:43.913+0000 7f3d06f02680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:51:43.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.989+0000 7f1239ad5700 1 Processor -- start 2023-08-17T17:51:43.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.989+0000 7f1239ad5700 1 -- start start 2023-08-17T17:51:43.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.989+0000 7f1239ad5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12340c6ee0 0x7f12340c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.989+0000 7f1239ad5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12340c0df0 0x7f12340ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.989+0000 7f1239ad5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340c7350 con 0x7f1234154140 2023-08-17T17:51:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.989+0000 7f1239ad5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12340a8350 con 0x7f12340c6ee0 2023-08-17T17:51:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.989+0000 7f1239ad5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340c1280 con 0x7f12340c0df0 2023-08-17T17:51:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f1232ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12340c6ee0 0x7f12340c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f1232ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12340c6ee0 0x7f12340c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43004/0 (socket says 172.21.15.78:43004) 2023-08-17T17:51:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f1232ffd700 1 -- 172.21.15.78:0/686459988 learned_addr learned my addr 172.21.15.78:0/686459988 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f1233fff700 1 --2- 172.21.15.78:0/686459988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12340c0df0 0x7f12340ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f1232ffd700 1 -- 172.21.15.78:0/686459988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12340c0df0 msgr2=0x7f12340ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f1232ffd700 1 --2- 172.21.15.78:0/686459988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12340c0df0 0x7f12340ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f1232ffd700 1 -- 172.21.15.78:0/686459988 >> v1:172.21.15.150:6789/0 conn(0x7f1234154140 legacy=0x7f12340a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f1232ffd700 1 -- 172.21.15.78:0/686459988 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234154520 con 0x7f12340c6ee0 2023-08-17T17:51:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f1232ffd700 1 --2- 172.21.15.78:0/686459988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c6ee0 0x7f12340c0900 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f1228006fd0 tx=0x7f12280090f0).ready entity=mon.0 client_cookie=dc00ac1c7047c7e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f12327fc700 1 -- 172.21.15.78:0/686459988 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122800b580 con 0x7f12340c6ee0 2023-08-17T17:51:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f12327fc700 1 -- 172.21.15.78:0/686459988 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122800b6e0 con 0x7f12340c6ee0 2023-08-17T17:51:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.990+0000 7f12327fc700 1 -- 172.21.15.78:0/686459988 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122800ba60 con 0x7f12340c6ee0 2023-08-17T17:51:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.991+0000 7f1239ad5700 1 -- 172.21.15.78:0/686459988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c6ee0 msgr2=0x7f12340c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.991+0000 7f1239ad5700 1 --2- 172.21.15.78:0/686459988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c6ee0 0x7f12340c0900 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f1228006fd0 tx=0x7f12280090f0).stop 2023-08-17T17:51:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.991+0000 7f1239ad5700 1 -- 172.21.15.78:0/686459988 shutdown_connections 2023-08-17T17:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.991+0000 7f1239ad5700 1 --2- 172.21.15.78:0/686459988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12340c0df0 0x7f12340ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.991+0000 7f1239ad5700 1 --2- 172.21.15.78:0/686459988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c6ee0 0x7f12340c0900 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.991+0000 7f1239ad5700 1 -- 172.21.15.78:0/686459988 >> 172.21.15.78:0/686459988 conn(0x7f1234094510 msgr2=0x7f123406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.991+0000 7f1239ad5700 1 -- 172.21.15.78:0/686459988 shutdown_connections 2023-08-17T17:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.991+0000 7f1239ad5700 1 -- 172.21.15.78:0/686459988 wait complete. 2023-08-17T17:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.992+0000 7f1239ad5700 1 Processor -- start 2023-08-17T17:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.992+0000 7f1239ad5700 1 -- start start 2023-08-17T17:51:43.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f1239ad5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c0df0 0x7f12340ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f1239ad5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12340c6ee0 0x7f12340c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f1239ad5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1234154140 0x7f123414e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:43.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f1239ad5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340c3020 con 0x7f12340c0df0 2023-08-17T17:51:43.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f1239ad5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340c33a0 con 0x7f1234154140 2023-08-17T17:51:43.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f1239ad5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340c2780 con 0x7f12340c6ee0 2023-08-17T17:51:43.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f12337fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c0df0 0x7f12340ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f12337fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c0df0 0x7f12340ad620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43020/0 (socket says 172.21.15.78:43020) 2023-08-17T17:51:43.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f12337fe700 1 -- 172.21.15.78:0/1874982387 learned_addr learned my addr 172.21.15.78:0/1874982387 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:43.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f1232ffd700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12340c6ee0 0x7f12340c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.993+0000 7f1233fff700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1234154140 0x7f123414e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:43.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f12337fe700 1 -- 172.21.15.78:0/1874982387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12340c6ee0 msgr2=0x7f12340c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f12337fe700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12340c6ee0 0x7f12340c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:43.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f12337fe700 1 -- 172.21.15.78:0/1874982387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1234154140 msgr2=0x7f123414e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:43.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f12337fe700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1234154140 0x7f123414e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f12337fe700 1 -- 172.21.15.78:0/1874982387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228009370 con 0x7f12340c0df0 2023-08-17T17:51:44.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f12337fe700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c0df0 0x7f12340ad620 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f122400c440 tx=0x7f1224007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:44.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f121b7fe700 1 -- 172.21.15.78:0/1874982387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224007020 con 0x7f12340c0df0 2023-08-17T17:51:44.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f121b7fe700 1 -- 172.21.15.78:0/1874982387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1224007180 con 0x7f12340c0df0 2023-08-17T17:51:44.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f1239ad5700 1 -- 172.21.15.78:0/1874982387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340c2a60 con 0x7f12340c0df0 2023-08-17T17:51:44.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f121b7fe700 1 -- 172.21.15.78:0/1874982387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224007520 con 0x7f12340c0df0 2023-08-17T17:51:44.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.994+0000 7f1239ad5700 1 -- 172.21.15.78:0/1874982387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12340c2420 con 0x7f12340c0df0 2023-08-17T17:51:44.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.995+0000 7f1239ad5700 1 -- 172.21.15.78:0/1874982387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1234047350 con 0x7f12340c0df0 2023-08-17T17:51:44.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.995+0000 7f121b7fe700 1 -- 172.21.15.78:0/1874982387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f1224010070 con 0x7f12340c0df0 2023-08-17T17:51:44.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.996+0000 7f121b7fe700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005eeb0 0x7f1220061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.996+0000 7f1232ffd700 1 -- 172.21.15.78:0/1874982387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005eeb0 msgr2=0x7f1220061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.996+0000 7f121b7fe700 1 -- 172.21.15.78:0/1874982387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f1224078e50 con 0x7f12340c0df0 2023-08-17T17:51:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:43.996+0000 7f1232ffd700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005eeb0 0x7f1220061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.005+0000 7f121b7fe700 1 -- 172.21.15.78:0/1874982387 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12240478f0 con 0x7f12340c0df0 2023-08-17T17:51:44.035 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:44.034+0000 7f59e5207680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:51:44.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.176+0000 7f1239ad5700 1 -- 172.21.15.78:0/1874982387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12340c91e0 con 0x7f12340c0df0 2023-08-17T17:51:44.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.178+0000 7f121b7fe700 1 -- 172.21.15.78:0/1874982387 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17476 (secure 0 0 0) 0x7f122404a230 con 0x7f12340c0df0 2023-08-17T17:51:44.179 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:44.179 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":108,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:51:39.269545+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:50:25.474971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T17:50:25.916399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.11","mappings":[{"from":1,"to":3}]},{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":5}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1815432402":"2023-08-18T17:50:38.236003+0000","172.21.15.78:6833/119464":"2023-08-18T17:50:38.236003+0000","172.21.15.78:6832/119464":"2023-08-18T17:50:38.236003+0000","172.21.15.78:0/148577813":"2023-08-18T17:50:38.236003+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:51:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 -- 172.21.15.78:0/1874982387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005eeb0 msgr2=0x7f1220061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005eeb0 0x7f1220061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 -- 172.21.15.78:0/1874982387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c0df0 msgr2=0x7f12340ad620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c0df0 0x7f12340ad620 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f122400c440 tx=0x7f1224007e00).stop 2023-08-17T17:51:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 -- 172.21.15.78:0/1874982387 shutdown_connections 2023-08-17T17:51:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f122005eeb0 0x7f1220061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1234154140 0x7f123414e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12340c0df0 0x7f12340ad620 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 --2- 172.21.15.78:0/1874982387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12340c6ee0 0x7f12340c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 -- 172.21.15.78:0/1874982387 >> 172.21.15.78:0/1874982387 conn(0x7f1234094510 msgr2=0x7f1234064920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:44.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 -- 172.21.15.78:0/1874982387 shutdown_connections 2023-08-17T17:51:44.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.180+0000 7f1239ad5700 1 -- 172.21.15.78:0/1874982387 wait complete. 2023-08-17T17:51:44.193 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T17:51:44.194 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:51:44.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.309+0000 7f1a60648700 1 Processor -- start 2023-08-17T17:51:44.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.309+0000 7f1a60648700 1 -- start start 2023-08-17T17:51:44.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.310+0000 7f1a60648700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1a580624f0 0x7f1a580628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.310+0000 7f1a60648700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58062dc0 0x7f1a580c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.310+0000 7f1a60648700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a580c3580 con 0x7f1a580c2070 2023-08-17T17:51:44.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.310+0000 7f1a60648700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a580c3a10 con 0x7f1a580624f0 2023-08-17T17:51:44.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.310+0000 7f1a60648700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580c2970 con 0x7f1a58062dc0 2023-08-17T17:51:44.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.310+0000 7f1a5e3e4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1a580624f0 0x7f1a580628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.310+0000 7f1a5ebe5700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1a580c2070 0x7f1a580bc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57424/0 (socket says 172.21.15.78:57424) 2023-08-17T17:51:44.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.310+0000 7f1a5ebe5700 1 -- 172.21.15.78:0/2078151323 learned_addr learned my addr 172.21.15.78:0/2078151323 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:44.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.310+0000 7f1a5dbe3700 1 --2- 172.21.15.78:0/2078151323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58062dc0 0x7f1a580c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.311+0000 7f1a5d3e2700 1 -- 172.21.15.78:0/2078151323 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128631591 0 0) 0x7f1a580c3580 con 0x7f1a580c2070 2023-08-17T17:51:44.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.311+0000 7f1a5d3e2700 1 -- 172.21.15.78:0/2078151323 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a440033f0 con 0x7f1a580c2070 2023-08-17T17:51:44.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.311+0000 7f1a5e3e4700 1 -- 172.21.15.78:0/2078151323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58062dc0 msgr2=0x7f1a580c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.311+0000 7f1a5e3e4700 1 --2- 172.21.15.78:0/2078151323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58062dc0 0x7f1a580c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.311+0000 7f1a5e3e4700 1 -- 172.21.15.78:0/2078151323 >> v1:172.21.15.78:6789/0 conn(0x7f1a580c2070 legacy=0x7f1a580bc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.311+0000 7f1a5e3e4700 1 -- 172.21.15.78:0/2078151323 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a580c2c50 con 0x7f1a580624f0 2023-08-17T17:51:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.311+0000 7f1a5e3e4700 1 --2- 172.21.15.78:0/2078151323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a580624f0 0x7f1a580628d0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f1a4800ba00 tx=0x7f1a48006f30).ready entity=mon.0 client_cookie=e058a9e13892f64c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.311+0000 7f1a5d3e2700 1 -- 172.21.15.78:0/2078151323 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800b3c0 con 0x7f1a580624f0 2023-08-17T17:51:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.311+0000 7f1a5d3e2700 1 -- 172.21.15.78:0/2078151323 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4800d9c0 con 0x7f1a580624f0 2023-08-17T17:51:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.311+0000 7f1a5d3e2700 1 -- 172.21.15.78:0/2078151323 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800dd40 con 0x7f1a580624f0 2023-08-17T17:51:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.312+0000 7f1a60648700 1 -- 172.21.15.78:0/2078151323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a580624f0 msgr2=0x7f1a580628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.312+0000 7f1a60648700 1 --2- 172.21.15.78:0/2078151323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a580624f0 0x7f1a580628d0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f1a4800ba00 tx=0x7f1a48006f30).stop 2023-08-17T17:51:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.312+0000 7f1a60648700 1 -- 172.21.15.78:0/2078151323 shutdown_connections 2023-08-17T17:51:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.312+0000 7f1a60648700 1 --2- 172.21.15.78:0/2078151323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a580624f0 0x7f1a580628d0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.312+0000 7f1a60648700 1 --2- 172.21.15.78:0/2078151323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a58062dc0 0x7f1a580c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.312+0000 7f1a60648700 1 -- 172.21.15.78:0/2078151323 >> 172.21.15.78:0/2078151323 conn(0x7f1a580c3d40 msgr2=0x7f1a580c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.312+0000 7f1a60648700 1 -- 172.21.15.78:0/2078151323 shutdown_connections 2023-08-17T17:51:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.312+0000 7f1a60648700 1 -- 172.21.15.78:0/2078151323 wait complete. 2023-08-17T17:51:44.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.313+0000 7f1a60648700 1 Processor -- start 2023-08-17T17:51:44.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.313+0000 7f1a60648700 1 -- start start 2023-08-17T17:51:44.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a60648700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a580624f0 0x7f1a5814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a60648700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a58062dc0 0x7f1a58149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a60648700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a580c2070 0x7f1a5814a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a60648700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580aa250 con 0x7f1a58062dc0 2023-08-17T17:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a60648700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580be340 con 0x7f1a580624f0 2023-08-17T17:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a60648700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580be620 con 0x7f1a580c2070 2023-08-17T17:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5dbe3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a58062dc0 0x7f1a58149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5dbe3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a58062dc0 0x7f1a58149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43038/0 (socket says 172.21.15.78:43038) 2023-08-17T17:51:44.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5dbe3700 1 -- 172.21.15.78:0/3021455924 learned_addr learned my addr 172.21.15.78:0/3021455924 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:44.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5ebe5700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a580c2070 0x7f1a5814a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5e3e4700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a580624f0 0x7f1a5814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5dbe3700 1 -- 172.21.15.78:0/3021455924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a580c2070 msgr2=0x7f1a5814a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:44.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5dbe3700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a580c2070 0x7f1a5814a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5dbe3700 1 -- 172.21.15.78:0/3021455924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a580624f0 msgr2=0x7f1a5814b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:44.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5dbe3700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a580624f0 0x7f1a5814b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5dbe3700 1 -- 172.21.15.78:0/3021455924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4800b540 con 0x7f1a58062dc0 2023-08-17T17:51:44.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a5dbe3700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a58062dc0 0x7f1a58149180 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f1a5400e950 tx=0x7f1a54009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:44.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a4e7fc700 1 -- 172.21.15.78:0/3021455924 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54009530 con 0x7f1a58062dc0 2023-08-17T17:51:44.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a4e7fc700 1 -- 172.21.15.78:0/3021455924 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54012600 con 0x7f1a58062dc0 2023-08-17T17:51:44.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a60648700 1 -- 172.21.15.78:0/3021455924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a580be900 con 0x7f1a58062dc0 2023-08-17T17:51:44.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.314+0000 7f1a4e7fc700 1 -- 172.21.15.78:0/3021455924 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54012980 con 0x7f1a58062dc0 2023-08-17T17:51:44.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.315+0000 7f1a60648700 1 -- 172.21.15.78:0/3021455924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a580beec0 con 0x7f1a58062dc0 2023-08-17T17:51:44.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.315+0000 7f1a60648700 1 -- 172.21.15.78:0/3021455924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a58153380 con 0x7f1a58062dc0 2023-08-17T17:51:44.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.316+0000 7f1a4e7fc700 1 -- 172.21.15.78:0/3021455924 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f1a54022070 con 0x7f1a58062dc0 2023-08-17T17:51:44.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.316+0000 7f1a4e7fc700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1a3c05eeb0 0x7f1a3c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.316+0000 7f1a5e3e4700 1 -- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1a3c05eeb0 msgr2=0x7f1a3c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:44.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.316+0000 7f1a4e7fc700 1 -- 172.21.15.78:0/3021455924 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f1a5407a120 con 0x7f1a58062dc0 2023-08-17T17:51:44.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.316+0000 7f1a5e3e4700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1a3c05eeb0 0x7f1a3c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:44.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.320+0000 7f1a4e7fc700 1 -- 172.21.15.78:0/3021455924 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1a58153380 con 0x7f1a58062dc0 2023-08-17T17:51:44.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.517+0000 7f1a5e3e4700 1 -- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1a3c05eeb0 msgr2=0x7f1a3c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:44.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.517+0000 7f1a5e3e4700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1a3c05eeb0 0x7f1a3c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:51:44.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.531+0000 7f1a60648700 1 -- 172.21.15.78:0/3021455924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a58153380 con 0x7f1a58062dc0 2023-08-17T17:51:44.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.531+0000 7f1a4e7fc700 1 -- 172.21.15.78:0/3021455924 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f1a58153380 con 0x7f1a58062dc0 2023-08-17T17:51:44.532 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:44.533 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2389298534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2389298534},{"type":"v1","addr":"172.21.15.150:6833","nonce":2389298534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2314598053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2314598053},{"type":"v1","addr":"172.21.15.150:6835","nonce":2314598053}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/687308464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":687308464},{"type":"v1","addr":"172.21.15.78:6836","nonce":687308464}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:50:26.944921+0000","modified":"2023-08-17T17:50:28.955568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7170":{"gid":7170,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/886333866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":886333866},{"type":"v1","addr":"172.21.15.78:6837","nonce":886333866}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T17:51:44.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 -- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1a3c05eeb0 msgr2=0x7f1a3c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:44.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1a3c05eeb0 0x7f1a3c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:44.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 -- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a58062dc0 msgr2=0x7f1a58149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:44.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a58062dc0 0x7f1a58149180 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f1a5400e950 tx=0x7f1a54009060).stop 2023-08-17T17:51:44.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 -- 172.21.15.78:0/3021455924 shutdown_connections 2023-08-17T17:51:44.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1a3c05eeb0 0x7f1a3c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:44.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a580c2070 0x7f1a5814a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a580624f0 0x7f1a5814b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 --2- 172.21.15.78:0/3021455924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a58062dc0 0x7f1a58149180 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 -- 172.21.15.78:0/3021455924 >> 172.21.15.78:0/3021455924 conn(0x7f1a580c3d40 msgr2=0x7f1a58063240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:44.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 -- 172.21.15.78:0/3021455924 shutdown_connections 2023-08-17T17:51:44.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.533+0000 7f1a60648700 1 -- 172.21.15.78:0/3021455924 wait complete. 2023-08-17T17:51:44.537 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 37 2023-08-17T17:51:44.547 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:51:44.567 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:44.566+0000 7f3d06f02680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:51:44.635 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:44.635+0000 7f3d06f02680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:51:44.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.666+0000 7f9eb1925700 1 Processor -- start 2023-08-17T17:51:44.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.666+0000 7f9eb1925700 1 -- start start 2023-08-17T17:51:44.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.667+0000 7f9eb1925700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eac066660 0x7f9eac0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.667+0000 7f9eb1925700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9eac0c5b50 0x7f9eac0624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.667+0000 7f9eb1925700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9eac066a40 0x7f9eac0629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.667+0000 7f9eb1925700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0c6040 con 0x7f9eac066a40 2023-08-17T17:51:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.667+0000 7f9eb1925700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac062ed0 con 0x7f9eac0c5b50 2023-08-17T17:51:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.667+0000 7f9eb1925700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac069b00 con 0x7f9eac066660 2023-08-17T17:51:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eab7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9eac066a40 0x7f9eac0629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eab7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9eac066a40 0x7f9eac0629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43044/0 (socket says 172.21.15.78:43044) 2023-08-17T17:51:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eab7fe700 1 -- 172.21.15.78:0/1129708298 learned_addr learned my addr 172.21.15.78:0/1129708298 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eaaffd700 1 --2- 172.21.15.78:0/1129708298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eac066660 0x7f9eac0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eaa7fc700 1 --2- 172.21.15.78:0/1129708298 >> v2:172.21.15.150:3300/0 conn(0x7f9eac0c5b50 0x7f9eac0624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eab7fe700 1 -- 172.21.15.78:0/1129708298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eac066660 msgr2=0x7f9eac0c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eab7fe700 1 --2- 172.21.15.78:0/1129708298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eac066660 0x7f9eac0c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eab7fe700 1 -- 172.21.15.78:0/1129708298 >> v2:172.21.15.150:3300/0 conn(0x7f9eac0c5b50 msgr2=0x7f9eac0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eab7fe700 1 --2- 172.21.15.78:0/1129708298 >> v2:172.21.15.150:3300/0 conn(0x7f9eac0c5b50 0x7f9eac0624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eab7fe700 1 -- 172.21.15.78:0/1129708298 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac069f90 con 0x7f9eac066a40 2023-08-17T17:51:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9eab7fe700 1 --2- 172.21.15.78:0/1129708298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066a40 0x7f9eac0629e0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f9eac05ece0 tx=0x7f9ea4009840).ready entity=mon.0 client_cookie=769d70875a199f95 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9ea9ffb700 1 -- 172.21.15.78:0/1129708298 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400e070 con 0x7f9eac066a40 2023-08-17T17:51:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9ea9ffb700 1 -- 172.21.15.78:0/1129708298 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea400b970 con 0x7f9eac066a40 2023-08-17T17:51:44.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.668+0000 7f9ea9ffb700 1 -- 172.21.15.78:0/1129708298 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400bcf0 con 0x7f9eac066a40 2023-08-17T17:51:44.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.669+0000 7f9eb1925700 1 -- 172.21.15.78:0/1129708298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066a40 msgr2=0x7f9eac0629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:44.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.669+0000 7f9eb1925700 1 --2- 172.21.15.78:0/1129708298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066a40 0x7f9eac0629e0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f9eac05ece0 tx=0x7f9ea4009840).stop 2023-08-17T17:51:44.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.669+0000 7f9eb1925700 1 -- 172.21.15.78:0/1129708298 shutdown_connections 2023-08-17T17:51:44.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.669+0000 7f9eb1925700 1 --2- 172.21.15.78:0/1129708298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066a40 0x7f9eac0629e0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.669+0000 7f9eb1925700 1 --2- 172.21.15.78:0/1129708298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eac066660 0x7f9eac0c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.669+0000 7f9eb1925700 1 --2- 172.21.15.78:0/1129708298 >> v2:172.21.15.150:3300/0 conn(0x7f9eac0c5b50 0x7f9eac0624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.669+0000 7f9eb1925700 1 -- 172.21.15.78:0/1129708298 >> 172.21.15.78:0/1129708298 conn(0x7f9eac0c7b00 msgr2=0x7f9eac0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:44.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.669+0000 7f9eb1925700 1 -- 172.21.15.78:0/1129708298 shutdown_connections 2023-08-17T17:51:44.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.669+0000 7f9eb1925700 1 -- 172.21.15.78:0/1129708298 wait complete. 2023-08-17T17:51:44.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.670+0000 7f9eb1925700 1 Processor -- start 2023-08-17T17:51:44.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.670+0000 7f9eb1925700 1 -- start start 2023-08-17T17:51:44.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eb1925700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066660 0x7f9eac0a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eb1925700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eac066a40 0x7f9eac0a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eb1925700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eac0c5b50 0x7f9eac0c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eb1925700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0a9980 con 0x7f9eac066660 2023-08-17T17:51:44.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eb1925700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c3390 con 0x7f9eac0c5b50 2023-08-17T17:51:44.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eb1925700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0a9350 con 0x7f9eac066a40 2023-08-17T17:51:44.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eaaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066660 0x7f9eac0a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eaaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066660 0x7f9eac0a8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43060/0 (socket says 172.21.15.78:43060) 2023-08-17T17:51:44.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eaaffd700 1 -- 172.21.15.78:0/3594508443 learned_addr learned my addr 172.21.15.78:0/3594508443 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:44.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eab7fe700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eac0c5b50 0x7f9eac0c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eaa7fc700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eac066a40 0x7f9eac0a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:44.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eaaffd700 1 -- 172.21.15.78:0/3594508443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eac066a40 msgr2=0x7f9eac0a9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:44.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eaaffd700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eac066a40 0x7f9eac0a9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eaaffd700 1 -- 172.21.15.78:0/3594508443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eac0c5b50 msgr2=0x7f9eac0c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:44.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eaaffd700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eac0c5b50 0x7f9eac0c2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eaaffd700 1 -- 172.21.15.78:0/3594508443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea4009ae0 con 0x7f9eac066660 2023-08-17T17:51:44.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.671+0000 7f9eaaffd700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066660 0x7f9eac0a8d70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f9ea000e950 tx=0x7f9ea0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:44.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.672+0000 7f9e92ffd700 1 -- 172.21.15.78:0/3594508443 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0012600 con 0x7f9eac066660 2023-08-17T17:51:44.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.672+0000 7f9e92ffd700 1 -- 172.21.15.78:0/3594508443 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0012760 con 0x7f9eac066660 2023-08-17T17:51:44.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.672+0000 7f9eb1925700 1 -- 172.21.15.78:0/3594508443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac0c3640 con 0x7f9eac066660 2023-08-17T17:51:44.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.672+0000 7f9e92ffd700 1 -- 172.21.15.78:0/3594508443 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0012ae0 con 0x7f9eac066660 2023-08-17T17:51:44.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.672+0000 7f9eb1925700 1 -- 172.21.15.78:0/3594508443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac0a9610 con 0x7f9eac066660 2023-08-17T17:51:44.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.673+0000 7f9eb1925700 1 -- 172.21.15.78:0/3594508443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac0a9c60 con 0x7f9eac066660 2023-08-17T17:51:44.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.673+0000 7f9e92ffd700 1 -- 172.21.15.78:0/3594508443 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f9ea0022070 con 0x7f9eac066660 2023-08-17T17:51:44.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.673+0000 7f9e92ffd700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805eeb0 0x7f9e98061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:44.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.673+0000 7f9eaa7fc700 1 -- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805eeb0 msgr2=0x7f9e98061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:44.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.673+0000 7f9e92ffd700 1 -- 172.21.15.78:0/3594508443 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f9ea007a200 con 0x7f9eac066660 2023-08-17T17:51:44.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.673+0000 7f9eaa7fc700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805eeb0 0x7f9e98061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:44.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.677+0000 7f9e92ffd700 1 -- 172.21.15.78:0/3594508443 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ea004b5e0 con 0x7f9eac066660 2023-08-17T17:51:44.712 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:44.712+0000 7f3d06f02680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:51:44.715 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:44.714+0000 7f59e5207680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:51:44.786 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:44.785+0000 7f59e5207680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:51:44.857 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:44.857+0000 7f3d06f02680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:51:44.863 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:44.862+0000 7f59e5207680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:51:44.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.874+0000 7f9eaa7fc700 1 -- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805eeb0 msgr2=0x7f9e98061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:44.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.874+0000 7f9eaa7fc700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805eeb0 0x7f9e98061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:51:44.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.888+0000 7f9eb1925700 1 -- 172.21.15.78:0/3594508443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9eac0aa300 con 0x7f9eac066660 2023-08-17T17:51:44.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.888+0000 7f9e92ffd700 1 -- 172.21.15.78:0/3594508443 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f9ea0016090 con 0x7f9eac066660 2023-08-17T17:51:44.890 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:44.890 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2389298534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2389298534},{"type":"v1","addr":"172.21.15.150:6833","nonce":2389298534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2314598053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2314598053},{"type":"v1","addr":"172.21.15.150:6835","nonce":2314598053}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/687308464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":687308464},{"type":"v1","addr":"172.21.15.78:6836","nonce":687308464}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:50:26.944921+0000","modified":"2023-08-17T17:50:28.955568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7170":{"gid":7170,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/886333866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":886333866},{"type":"v1","addr":"172.21.15.78:6837","nonce":886333866}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T17:51:44.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 -- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805eeb0 msgr2=0x7f9e98061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:44.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805eeb0 0x7f9e98061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:44.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 -- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066660 msgr2=0x7f9eac0a8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:44.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066660 0x7f9eac0a8d70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f9ea000e950 tx=0x7f9ea0009060).stop 2023-08-17T17:51:44.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 -- 172.21.15.78:0/3594508443 shutdown_connections 2023-08-17T17:51:44.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f9e9805eeb0 0x7f9e98061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:44.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eac0c5b50 0x7f9eac0c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eac066660 0x7f9eac0a8d70 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 --2- 172.21.15.78:0/3594508443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eac066a40 0x7f9eac0a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:44.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 -- 172.21.15.78:0/3594508443 >> 172.21.15.78:0/3594508443 conn(0x7f9eac0c7b00 msgr2=0x7f9eac152660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:44.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 -- 172.21.15.78:0/3594508443 shutdown_connections 2023-08-17T17:51:44.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:44.891+0000 7f9eb1925700 1 -- 172.21.15.78:0/3594508443 wait complete. 2023-08-17T17:51:44.894 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 37 2023-08-17T17:51:44.904 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:51:44.927 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:44.926+0000 7f3d06f02680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:51:45.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.019+0000 7fefbe73c700 1 Processor -- start 2023-08-17T17:51:45.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.019+0000 7fefbe73c700 1 -- start start 2023-08-17T17:51:45.021 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.019+0000 7f59e5207680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:51:45.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefbe73c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fefb8154140 0x7fefb80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefbe73c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefb80a7c40 0x7fefb80c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefbe73c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fefb80a8080 0x7fefb80c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefbe73c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb80c12e0 con 0x7fefb8154140 2023-08-17T17:51:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefbe73c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb8154520 con 0x7fefb80a8080 2023-08-17T17:51:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefbe73c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80c91e0 con 0x7fefb80a7c40 2023-08-17T17:51:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefb7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fefb8154140 0x7fefb80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefb7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fefb8154140 0x7fefb80c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43070/0 (socket says 172.21.15.78:43070) 2023-08-17T17:51:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefb7fff700 1 -- 172.21.15.78:0/1117724337 learned_addr learned my addr 172.21.15.78:0/1117724337 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefb77fe700 1 --2- 172.21.15.78:0/1117724337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefb80a7c40 0x7fefb80c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefbccd9700 1 --2- 172.21.15.78:0/1117724337 >> v2:172.21.15.150:3300/0 conn(0x7fefb80a8080 0x7fefb80c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefb7fff700 1 -- 172.21.15.78:0/1117724337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefb80a7c40 msgr2=0x7fefb80c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefb7fff700 1 --2- 172.21.15.78:0/1117724337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefb80a7c40 0x7fefb80c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefb7fff700 1 -- 172.21.15.78:0/1117724337 >> v2:172.21.15.150:3300/0 conn(0x7fefb80a8080 msgr2=0x7fefb80c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefb7fff700 1 --2- 172.21.15.78:0/1117724337 >> v2:172.21.15.150:3300/0 conn(0x7fefb80a8080 0x7fefb80c0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefb7fff700 1 -- 172.21.15.78:0/1117724337 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80c94c0 con 0x7fefb8154140 2023-08-17T17:51:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.020+0000 7fefb7fff700 1 --2- 172.21.15.78:0/1117724337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 0x7fefb80c6ee0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7fefb806bd60 tx=0x7fefa80090f0).ready entity=mon.0 client_cookie=da55c66d015892f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefb6ffd700 1 -- 172.21.15.78:0/1117724337 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa800f510 con 0x7fefb8154140 2023-08-17T17:51:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefb6ffd700 1 -- 172.21.15.78:0/1117724337 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa800f670 con 0x7fefb8154140 2023-08-17T17:51:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefb6ffd700 1 -- 172.21.15.78:0/1117724337 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa800fa10 con 0x7fefb8154140 2023-08-17T17:51:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefbe73c700 1 -- 172.21.15.78:0/1117724337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 msgr2=0x7fefb80c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefbe73c700 1 --2- 172.21.15.78:0/1117724337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 0x7fefb80c6ee0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7fefb806bd60 tx=0x7fefa80090f0).stop 2023-08-17T17:51:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefbe73c700 1 -- 172.21.15.78:0/1117724337 shutdown_connections 2023-08-17T17:51:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefbe73c700 1 --2- 172.21.15.78:0/1117724337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 0x7fefb80c6ee0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefbe73c700 1 --2- 172.21.15.78:0/1117724337 >> v2:172.21.15.150:3300/0 conn(0x7fefb80a8080 0x7fefb80c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefbe73c700 1 --2- 172.21.15.78:0/1117724337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefb80a7c40 0x7fefb80c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefbe73c700 1 -- 172.21.15.78:0/1117724337 >> 172.21.15.78:0/1117724337 conn(0x7fefb8094510 msgr2=0x7fefb806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefbe73c700 1 -- 172.21.15.78:0/1117724337 shutdown_connections 2023-08-17T17:51:45.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.021+0000 7fefbe73c700 1 -- 172.21.15.78:0/1117724337 wait complete. 2023-08-17T17:51:45.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.022+0000 7fefbe73c700 1 Processor -- start 2023-08-17T17:51:45.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.023+0000 7fefbe73c700 1 -- start start 2023-08-17T17:51:45.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.023+0000 7fefbe73c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefb80a7c40 0x7fefb80afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.023+0000 7fefbe73c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefb80a8080 0x7fefb80c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.023+0000 7fefbe73c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 0x7fefb80c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.023+0000 7fefbe73c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80c1f30 con 0x7fefb8154140 2023-08-17T17:51:45.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.023+0000 7fefbe73c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80c2210 con 0x7fefb80a7c40 2023-08-17T17:51:45.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.023+0000 7fefbe73c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80c24f0 con 0x7fefb80a8080 2023-08-17T17:51:45.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.023+0000 7fefbccd9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 0x7fefb80c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.023+0000 7fefbccd9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 0x7fefb80c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43084/0 (socket says 172.21.15.78:43084) 2023-08-17T17:51:45.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.023+0000 7fefbccd9700 1 -- 172.21.15.78:0/61223850 learned_addr learned my addr 172.21.15.78:0/61223850 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:45.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fefb77fe700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefb80a8080 0x7fefb80c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fefb7fff700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefb80a7c40 0x7fefb80afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fefbccd9700 1 -- 172.21.15.78:0/61223850 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefb80a8080 msgr2=0x7fefb80c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:45.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fefbccd9700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefb80a8080 0x7fefb80c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fefbccd9700 1 -- 172.21.15.78:0/61223850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefb80a7c40 msgr2=0x7fefb80afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:45.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fefbccd9700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefb80a7c40 0x7fefb80afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fefbccd9700 1 -- 172.21.15.78:0/61223850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8009370 con 0x7fefb8154140 2023-08-17T17:51:45.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fefbccd9700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 0x7fefb80c49d0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fefb0009ec0 tx=0x7fefb000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:45.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fef9ffff700 1 -- 172.21.15.78:0/61223850 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000cc20 con 0x7fefb8154140 2023-08-17T17:51:45.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fef9ffff700 1 -- 172.21.15.78:0/61223850 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb000f040 con 0x7fefb8154140 2023-08-17T17:51:45.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fefbe73c700 1 -- 172.21.15.78:0/61223850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb80c27d0 con 0x7fefb8154140 2023-08-17T17:51:45.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fef9ffff700 1 -- 172.21.15.78:0/61223850 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0013400 con 0x7fefb8154140 2023-08-17T17:51:45.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.024+0000 7fefbe73c700 1 -- 172.21.15.78:0/61223850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb80b0100 con 0x7fefb8154140 2023-08-17T17:51:45.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.025+0000 7fefbe73c700 1 -- 172.21.15.78:0/61223850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb80c2cf0 con 0x7fefb8154140 2023-08-17T17:51:45.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.026+0000 7fef9ffff700 1 -- 172.21.15.78:0/61223850 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fefb0013770 con 0x7fefb8154140 2023-08-17T17:51:45.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.026+0000 7fef9ffff700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fefa405eeb0 0x7fefa4061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.026+0000 7fefb7fff700 1 -- 172.21.15.78:0/61223850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fefa405eeb0 msgr2=0x7fefa4061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:45.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.026+0000 7fef9ffff700 1 -- 172.21.15.78:0/61223850 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fefb007a7a0 con 0x7fefb8154140 2023-08-17T17:51:45.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.026+0000 7fefb7fff700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fefa405eeb0 0x7fefa4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:45.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.030+0000 7fef9ffff700 1 -- 172.21.15.78:0/61223850 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fefb004bb80 con 0x7fefb8154140 2023-08-17T17:51:45.042 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:45.041+0000 7f3d06f02680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:51:45.095 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.094+0000 7f59e5207680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:51:45.149 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:45.149+0000 7f3d06f02680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:51:45.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.199+0000 7fefbe73c700 1 -- 172.21.15.78:0/61223850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefb8047350 con 0x7fefb8154140 2023-08-17T17:51:45.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.200+0000 7fef9ffff700 1 -- 172.21.15.78:0/61223850 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17476 (secure 0 0 0) 0x7fefb004f1a0 con 0x7fefb8154140 2023-08-17T17:51:45.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:45.202 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":108,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:51:39.269545+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:50:25.474971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T17:50:25.916399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.11","mappings":[{"from":1,"to":3}]},{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":5}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1815432402":"2023-08-18T17:50:38.236003+0000","172.21.15.78:6833/119464":"2023-08-18T17:50:38.236003+0000","172.21.15.78:6832/119464":"2023-08-18T17:50:38.236003+0000","172.21.15.78:0/148577813":"2023-08-18T17:50:38.236003+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:51:45.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 -- 172.21.15.78:0/61223850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fefa405eeb0 msgr2=0x7fefa4061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fefa405eeb0 0x7fefa4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 -- 172.21.15.78:0/61223850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 msgr2=0x7fefb80c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 0x7fefb80c49d0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fefb0009ec0 tx=0x7fefb000b040).stop 2023-08-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 -- 172.21.15.78:0/61223850 shutdown_connections 2023-08-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fefa405eeb0 0x7fefa4061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8154140 0x7fefb80c49d0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefb80a7c40 0x7fefb80afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 --2- 172.21.15.78:0/61223850 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefb80a8080 0x7fefb80c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 -- 172.21.15.78:0/61223850 >> 172.21.15.78:0/61223850 conn(0x7fefb8094510 msgr2=0x7fefb8063e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 -- 172.21.15.78:0/61223850 shutdown_connections 2023-08-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.202+0000 7fefbe73c700 1 -- 172.21.15.78:0/61223850 wait complete. 2023-08-17T17:51:45.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T17:51:45.217 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.215+0000 7f59e5207680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:51:45.332 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.331+0000 7f59e5207680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:51:45.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.332+0000 7f6002cdc700 1 Processor -- start 2023-08-17T17:51:45.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.332+0000 7f6002cdc700 1 -- start start 2023-08-17T17:51:45.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f6002cdc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ffc062c00 0x7f5ffc154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f6002cdc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc069e90 con 0x7f5ffc0a6bd0 2023-08-17T17:51:45.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f6002cdc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc069280 con 0x7f5ffc153ea0 2023-08-17T17:51:45.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f6002cdc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc069560 con 0x7f5ffc062c00 2023-08-17T17:51:45.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f5ffbfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5ffc0a6bd0 0x7f5ffc0624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57440/0 (socket says 172.21.15.78:57440) 2023-08-17T17:51:45.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f5ffbfff700 1 -- 172.21.15.78:0/1343249866 learned_addr learned my addr 172.21.15.78:0/1343249866 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:45.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f6001279700 1 --2- 172.21.15.78:0/1343249866 >> v2:172.21.15.150:3300/0 conn(0x7f5ffc062c00 0x7f5ffc154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098653546 0 0) 0x7f5ffc069e90 con 0x7f5ffc0a6bd0 2023-08-17T17:51:45.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fec0033f0 con 0x7f5ffc0a6bd0 2023-08-17T17:51:45.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300498072 0 0) 0x7f5ffc069280 con 0x7f5ffc153ea0 2023-08-17T17:51:45.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.333+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ffc069e90 con 0x7f5ffc153ea0 2023-08-17T17:51:45.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3666592274 0 0) 0x7f5fec0033f0 con 0x7f5ffc0a6bd0 2023-08-17T17:51:45.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 >> v2:172.21.15.150:3300/0 conn(0x7f5ffc062c00 msgr2=0x7f5ffc154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:45.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 --2- 172.21.15.78:0/1343249866 >> v2:172.21.15.150:3300/0 conn(0x7f5ffc062c00 0x7f5ffc154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 >> v1:172.21.15.150:6789/0 conn(0x7f5ffc153ea0 legacy=0x7f5ffc0c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:45.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc069840 con 0x7f5ffc0a6bd0 2023-08-17T17:51:45.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f5fe8001470 con 0x7f5ffc0a6bd0 2023-08-17T17:51:45.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f6001279700 1 --2- 172.21.15.78:0/1343249866 >> v2:172.21.15.150:3300/0 conn(0x7f5ffc062c00 0x7f5ffc154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:51:45.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 >> v1:172.21.15.78:6789/0 conn(0x7f5ffc0a6bd0 legacy=0x7f5ffc0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:45.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fec003af0 0x7f5fec003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fec004690 0x7f5fec004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5fec00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc069560 con 0x7f5fec005000 2023-08-17T17:51:45.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec00bf90 con 0x7f5fec004690 2023-08-17T17:51:45.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec00c150 con 0x7f5fec003af0 2023-08-17T17:51:45.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f6001279700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5fec00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffbfff700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fec004690 0x7f5fec004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f6000a78700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fec003af0 0x7f5fec003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f6001279700 1 -- 172.21.15.78:0/1343249866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fec003af0 msgr2=0x7f5fec003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:45.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f6001279700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5fec003af0 0x7f5fec003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f6001279700 1 -- 172.21.15.78:0/1343249866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fec004690 msgr2=0x7f5fec004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:45.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f6001279700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fec004690 0x7f5fec004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f6001279700 1 -- 172.21.15.78:0/1343249866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0033f0 con 0x7f5fec005000 2023-08-17T17:51:45.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f6001279700 1 -- 172.21.15.78:0/1343249866 reap_dead start 2023-08-17T17:51:45.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f6001279700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5fec00b8e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f5ffc063000 tx=0x7f5ff400b040).ready entity=mon.0 client_cookie=1def911f3e8371f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:45.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4017070 con 0x7f5fec005000 2023-08-17T17:51:45.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff400f040 con 0x7f5fec005000 2023-08-17T17:51:45.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.334+0000 7f5ffb7fe700 1 -- 172.21.15.78:0/1343249866 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400ee70 con 0x7f5fec005000 2023-08-17T17:51:45.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.335+0000 7f6002cdc700 1 -- 172.21.15.78:0/1343249866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 msgr2=0x7f5fec00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:45.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.335+0000 7f6002cdc700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5fec00b8e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f5ffc063000 tx=0x7f5ff400b040).stop 2023-08-17T17:51:45.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.335+0000 7f6002cdc700 1 -- 172.21.15.78:0/1343249866 shutdown_connections 2023-08-17T17:51:45.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.335+0000 7f6002cdc700 1 --2- 172.21.15.78:0/1343249866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5fec00b8e0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.335+0000 7f6002cdc700 1 -- 172.21.15.78:0/1343249866 >> 172.21.15.78:0/1343249866 conn(0x7f5ffc0c8680 msgr2=0x7f5ffc0c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:45.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.335+0000 7f6002cdc700 1 -- 172.21.15.78:0/1343249866 shutdown_connections 2023-08-17T17:51:45.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.335+0000 7f6002cdc700 1 -- 172.21.15.78:0/1343249866 wait complete. 2023-08-17T17:51:45.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.336+0000 7f6002cdc700 1 Processor -- start 2023-08-17T17:51:45.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.336+0000 7f6002cdc700 1 -- start start 2023-08-17T17:51:45.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6002cdc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5ffc141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6002cdc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ffc0a7790 0x7f5ffc14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6002cdc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ffc0a8120 0x7f5ffc0a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6002cdc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0a7f00 con 0x7f5fec005000 2023-08-17T17:51:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6002cdc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0a93e0 con 0x7f5ffc0a8120 2023-08-17T17:51:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6002cdc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0a9870 con 0x7f5ffc0a7790 2023-08-17T17:51:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6000a78700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5ffc141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6000a78700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5ffc141960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43110/0 (socket says 172.21.15.78:43110) 2023-08-17T17:51:45.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6000a78700 1 -- 172.21.15.78:0/2644222365 learned_addr learned my addr 172.21.15.78:0/2644222365 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:45.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6001279700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ffc0a8120 0x7f5ffc0a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f5ffbfff700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ffc0a7790 0x7f5ffc14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:45.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6000a78700 1 -- 172.21.15.78:0/2644222365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ffc0a7790 msgr2=0x7f5ffc14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:45.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6000a78700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ffc0a7790 0x7f5ffc14ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6000a78700 1 -- 172.21.15.78:0/2644222365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ffc0a8120 msgr2=0x7f5ffc0a8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:45.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6000a78700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ffc0a8120 0x7f5ffc0a8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:45.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6000a78700 1 -- 172.21.15.78:0/2644222365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc0a7c20 con 0x7f5fec005000 2023-08-17T17:51:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.337+0000 7f6001279700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ffc0a8120 0x7f5ffc0a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:51:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.338+0000 7f6000a78700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5ffc141960 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f5ff0007720 tx=0x7f5ff0007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.338+0000 7f5ff8ff9700 1 -- 172.21.15.78:0/2644222365 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000f690 con 0x7f5fec005000 2023-08-17T17:51:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.338+0000 7f5ff8ff9700 1 -- 172.21.15.78:0/2644222365 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff000f7f0 con 0x7f5fec005000 2023-08-17T17:51:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.338+0000 7f6002cdc700 1 -- 172.21.15.78:0/2644222365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc0a8d90 con 0x7f5fec005000 2023-08-17T17:51:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.338+0000 7f5ff8ff9700 1 -- 172.21.15.78:0/2644222365 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000fb90 con 0x7f5fec005000 2023-08-17T17:51:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.338+0000 7f6002cdc700 1 -- 172.21.15.78:0/2644222365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc141e50 con 0x7f5fec005000 2023-08-17T17:51:45.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.339+0000 7f6002cdc700 1 -- 172.21.15.78:0/2644222365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc047350 con 0x7f5fec005000 2023-08-17T17:51:45.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.339+0000 7f5ff8ff9700 1 -- 172.21.15.78:0/2644222365 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 45) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f5ff001b030 con 0x7f5fec005000 2023-08-17T17:51:45.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.340+0000 7f5ff8ff9700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe005eeb0 0x7f5fe0061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:45.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.340+0000 7f5ffbfff700 1 -- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe005eeb0 msgr2=0x7f5fe0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:45.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.340+0000 7f5ff8ff9700 1 -- 172.21.15.78:0/2644222365 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f5ff0079b10 con 0x7f5fec005000 2023-08-17T17:51:45.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.340+0000 7f5ffbfff700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe005eeb0 0x7f5fe0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:51:45.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.344+0000 7f5ff8ff9700 1 -- 172.21.15.78:0/2644222365 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ff004aef0 con 0x7f5fec005000 2023-08-17T17:51:45.443 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:45.442+0000 7f3d06f02680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:51:45.514 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:51:45.513+0000 7f3d06f02680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:51:45.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.541+0000 7f5ffbfff700 1 -- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe005eeb0 msgr2=0x7f5fe0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:51:45.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.541+0000 7f5ffbfff700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe005eeb0 0x7f5fe0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:51:45.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.558+0000 7f6002cdc700 1 -- 172.21.15.78:0/2644222365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5ffc069b20 con 0x7f5fec005000 2023-08-17T17:51:45.632 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.631+0000 7f59e5207680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:51:45.705 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.704+0000 7f59e5207680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:51:45.727 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:51:45.726+0000 7f3e50f99700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:51:45.727 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:51:45.726+0000 7f3e50f99700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:51:45.727 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-08-17T17:51:45.726+0000 7f3e50f99700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:51:45.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.726+0000 7f5ff8ff9700 1 -- 172.21.15.78:0/2644222365 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 46) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f5ff0077850 con 0x7f5fec005000 2023-08-17T17:51:45.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.726+0000 7f5ff8ff9700 1 -- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe005eeb0 msgr2=0x7f5fe0061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:51:45.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:45.726+0000 7f5ff8ff9700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe005eeb0 0x7f5fe0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:45.734 INFO:tasks.ceph.mds.c.smithi078.stderr: -5436> 2023-08-17T17:50:32.872+0000 7f3e547a0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:51:45.741 INFO:tasks.ceph.mds.c.smithi078.stderr: -5> 2023-08-17T17:51:45.726+0000 7f3e50f99700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:51:45.741 INFO:tasks.ceph.mds.c.smithi078.stderr: -4> 2023-08-17T17:51:45.726+0000 7f3e50f99700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:51:45.741 INFO:tasks.ceph.mds.c.smithi078.stderr: -2> 2023-08-17T17:51:45.726+0000 7f3e50f99700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:51:45.760 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:51:45.789 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.788+0000 7f59649e7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:45.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.788+0000 7f59649e7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:45.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.788+0000 7f59649e7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:45.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.788+0000 7f59649e7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:45.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.788+0000 7f59649e7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:45.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.788+0000 7f59681ee700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:45.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.788+0000 7f59681ee700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:45.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.788+0000 7f59681ee700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:45.791 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.788+0000 7f59681ee700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:45.791 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:51:45.788+0000 7f59681ee700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:51:46.294 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T17:51:46.293+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T17:51:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.300+0000 7f5ff8ff9700 1 -- 172.21.15.78:0/2644222365 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5ff006eb80 con 0x7f5fec005000 2023-08-17T17:51:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.302+0000 7f6002cdc700 1 -- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 msgr2=0x7f5ffc141960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.302+0000 7f6002cdc700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5ffc141960 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f5ff0007720 tx=0x7f5ff0007bb0).stop 2023-08-17T17:51:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.302+0000 7f6002cdc700 1 -- 172.21.15.78:0/2644222365 shutdown_connections 2023-08-17T17:51:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.302+0000 7f6002cdc700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5fe005eeb0 0x7f5fe0061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.302+0000 7f6002cdc700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ffc0a8120 0x7f5ffc0a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.302+0000 7f6002cdc700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec005000 0x7f5ffc141960 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.302+0000 7f6002cdc700 1 --2- 172.21.15.78:0/2644222365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ffc0a7790 0x7f5ffc14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.302+0000 7f6002cdc700 1 -- 172.21.15.78:0/2644222365 >> 172.21.15.78:0/2644222365 conn(0x7f5ffc0c8680 msgr2=0x7f5ffc0624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.302+0000 7f6002cdc700 1 -- 172.21.15.78:0/2644222365 shutdown_connections 2023-08-17T17:51:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.302+0000 7f6002cdc700 1 -- 172.21.15.78:0/2644222365 wait complete. 2023-08-17T17:51:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T17:51:46.316 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T17:51:46.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.429+0000 7f69c4ce1700 1 Processor -- start 2023-08-17T17:51:46.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.429+0000 7f69c4ce1700 1 -- start start 2023-08-17T17:51:46.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.430+0000 7f69c4ce1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f69c00aa0f0 0x7f69c00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:46.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.430+0000 7f69c4ce1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c00649b0 con 0x7f69c00aa4d0 2023-08-17T17:51:46.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.430+0000 7f69c4ce1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c0063420 con 0x7f69c00c5810 2023-08-17T17:51:46.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.430+0000 7f69c4ce1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c0063700 con 0x7f69c00aa0f0 2023-08-17T17:51:46.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.430+0000 7f69b5d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f69c00aa4d0 0x7f69c00c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57462/0 (socket says 172.21.15.78:57462) 2023-08-17T17:51:46.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.430+0000 7f69b5d9b700 1 -- 172.21.15.78:0/3723873354 learned_addr learned my addr 172.21.15.78:0/3723873354 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:46.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.430+0000 7f69be59c700 1 --2- 172.21.15.78:0/3723873354 >> v2:172.21.15.150:3300/0 conn(0x7f69c00aa0f0 0x7f69c00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:46.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.430+0000 7f69bdd9b700 1 -- 172.21.15.78:0/3723873354 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670467313 0 0) 0x7f69c00649b0 con 0x7f69c00aa4d0 2023-08-17T17:51:46.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.430+0000 7f69bdd9b700 1 -- 172.21.15.78:0/3723873354 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69ac0033f0 con 0x7f69c00aa4d0 2023-08-17T17:51:46.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69be59c700 1 -- 172.21.15.78:0/3723873354 >> v1:172.21.15.150:6789/0 conn(0x7f69c00c5810 legacy=0x7f69c00a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:46.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69be59c700 1 -- 172.21.15.78:0/3723873354 >> v1:172.21.15.78:6789/0 conn(0x7f69c00aa4d0 legacy=0x7f69c00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:46.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69be59c700 1 -- 172.21.15.78:0/3723873354 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c00639e0 con 0x7f69c00aa0f0 2023-08-17T17:51:46.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69be59c700 1 --2- 172.21.15.78:0/3723873354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69c00aa0f0 0x7f69c00644c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f69b0009760 tx=0x7f69b0009060).ready entity=mon.1 client_cookie=36840322cfc48c56 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:46.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69bdd9b700 1 -- 172.21.15.78:0/3723873354 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000f510 con 0x7f69c00aa0f0 2023-08-17T17:51:46.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69bdd9b700 1 -- 172.21.15.78:0/3723873354 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b000f670 con 0x7f69c00aa0f0 2023-08-17T17:51:46.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69bdd9b700 1 -- 172.21.15.78:0/3723873354 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000f9f0 con 0x7f69c00aa0f0 2023-08-17T17:51:46.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69c4ce1700 1 -- 172.21.15.78:0/3723873354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69c00aa0f0 msgr2=0x7f69c00644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:46.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69c4ce1700 1 --2- 172.21.15.78:0/3723873354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69c00aa0f0 0x7f69c00644c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f69b0009760 tx=0x7f69b0009060).stop 2023-08-17T17:51:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69c4ce1700 1 -- 172.21.15.78:0/3723873354 shutdown_connections 2023-08-17T17:51:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69c4ce1700 1 --2- 172.21.15.78:0/3723873354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69c00aa0f0 0x7f69c00644c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69c4ce1700 1 -- 172.21.15.78:0/3723873354 >> 172.21.15.78:0/3723873354 conn(0x7f69c006a6a0 msgr2=0x7f69c00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69c4ce1700 1 -- 172.21.15.78:0/3723873354 shutdown_connections 2023-08-17T17:51:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.431+0000 7f69c4ce1700 1 -- 172.21.15.78:0/3723873354 wait complete. 2023-08-17T17:51:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.433+0000 7f69c4ce1700 1 Processor -- start 2023-08-17T17:51:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.433+0000 7f69c4ce1700 1 -- start start 2023-08-17T17:51:46.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.433+0000 7f69c4ce1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69c00aa0f0 0x7f69c00a8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:46.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.433+0000 7f69c4ce1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69c00aa4d0 0x7f69c00afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:46.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.433+0000 7f69c4ce1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69c00c5810 0x7f69c00b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:46.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.433+0000 7f69c4ce1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c01434b0 con 0x7f69c00c5810 2023-08-17T17:51:46.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.433+0000 7f69c4ce1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c00c1ac0 con 0x7f69c00aa4d0 2023-08-17T17:51:46.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.433+0000 7f69c4ce1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c00c2360 con 0x7f69c00aa0f0 2023-08-17T17:51:46.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69bed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69c00c5810 0x7f69c00b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:46.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69bed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69c00c5810 0x7f69c00b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43204/0 (socket says 172.21.15.78:43204) 2023-08-17T17:51:46.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69bed9d700 1 -- 172.21.15.78:0/2423626839 learned_addr learned my addr 172.21.15.78:0/2423626839 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:46.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69b5d9b700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69c00aa4d0 0x7f69c00afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:46.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69be59c700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69c00aa0f0 0x7f69c00a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:46.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69bed9d700 1 -- 172.21.15.78:0/2423626839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69c00aa0f0 msgr2=0x7f69c00a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:46.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69bed9d700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69c00aa0f0 0x7f69c00a8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:46.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69bed9d700 1 -- 172.21.15.78:0/2423626839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69c00aa4d0 msgr2=0x7f69c00afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:46.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69bed9d700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69c00aa4d0 0x7f69c00afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:46.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69bed9d700 1 -- 172.21.15.78:0/2423626839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b00092a0 con 0x7f69c00c5810 2023-08-17T17:51:46.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69bed9d700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69c00c5810 0x7f69c00b01b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f69b800c7f0 tx=0x7f69b8001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:46.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69b6ffd700 1 -- 172.21.15.78:0/2423626839 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8010510 con 0x7f69c00c5810 2023-08-17T17:51:46.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69b6ffd700 1 -- 172.21.15.78:0/2423626839 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b8010670 con 0x7f69c00c5810 2023-08-17T17:51:46.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69c4ce1700 1 -- 172.21.15.78:0/2423626839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c00b0780 con 0x7f69c00c5810 2023-08-17T17:51:46.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69b6ffd700 1 -- 172.21.15.78:0/2423626839 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b80109f0 con 0x7f69c00c5810 2023-08-17T17:51:46.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.434+0000 7f69c4ce1700 1 -- 172.21.15.78:0/2423626839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c00c1ff0 con 0x7f69c00c5810 2023-08-17T17:51:46.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.435+0000 7f69c4ce1700 1 -- 172.21.15.78:0/2423626839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c0083980 con 0x7f69c00c5810 2023-08-17T17:51:46.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.436+0000 7f69b6ffd700 1 -- 172.21.15.78:0/2423626839 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 46) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f69b8010070 con 0x7f69c00c5810 2023-08-17T17:51:46.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.436+0000 7f69b6ffd700 1 -- 172.21.15.78:0/2423626839 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6782+0+0 (secure 0 0 0) 0x7f69b80798f0 con 0x7f69c00c5810 2023-08-17T17:51:46.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.440+0000 7f69b6ffd700 1 -- 172.21.15.78:0/2423626839 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f69b804ac40 con 0x7f69c00c5810 2023-08-17T17:51:46.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.648+0000 7f69c4ce1700 1 -- 172.21.15.78:0/2423626839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f69c0046af0 con 0x7f69c00c5810 2023-08-17T17:51:46.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.728+0000 7f69b6ffd700 1 -- 172.21.15.78:0/2423626839 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 47) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f69b8077600 con 0x7f69c00c5810 2023-08-17T17:51:46.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.729+0000 7f69b6ffd700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69a0030180 0x7f69a0067a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:46.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.729+0000 7f69be59c700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69a0030180 0x7f69a0067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:46.731+0000 7f69be59c700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69a0030180 0x7f69a0067a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f69b000f640 tx=0x7f69b0017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:47.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.303+0000 7f69b6ffd700 1 -- 172.21.15.78:0/2423626839 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f69b806f810 con 0x7f69c00c5810 2023-08-17T17:51:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 -- 172.21.15.78:0/2423626839 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69a0030180 msgr2=0x7f69a0067a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69a0030180 0x7f69a0067a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f69b000f640 tx=0x7f69b0017000).stop 2023-08-17T17:51:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 -- 172.21.15.78:0/2423626839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69c00c5810 msgr2=0x7f69c00b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69c00c5810 0x7f69c00b01b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f69b800c7f0 tx=0x7f69b8001510).stop 2023-08-17T17:51:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 -- 172.21.15.78:0/2423626839 shutdown_connections 2023-08-17T17:51:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f69a0030180 0x7f69a0067a30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69c00c5810 0x7f69c00b01b0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69c00aa0f0 0x7f69c00a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 --2- 172.21.15.78:0/2423626839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69c00aa4d0 0x7f69c00afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 -- 172.21.15.78:0/2423626839 >> 172.21.15.78:0/2423626839 conn(0x7f69c006a6a0 msgr2=0x7f69c01519c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.305+0000 7f69c4ce1700 1 -- 172.21.15.78:0/2423626839 shutdown_connections 2023-08-17T17:51:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.306+0000 7f69c4ce1700 1 -- 172.21.15.78:0/2423626839 wait complete. 2023-08-17T17:51:47.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T17:51:47.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.435+0000 7f4e18ff0700 1 Processor -- start 2023-08-17T17:51:47.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.435+0000 7f4e18ff0700 1 -- start start 2023-08-17T17:51:47.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e18ff0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e14151a40 0x7f4e140c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:47.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e18ff0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4e14157be0 0x7f4e14158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:47.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e18ff0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e14158520 con 0x7f4e14151e20 2023-08-17T17:51:47.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e18ff0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140c6620 con 0x7f4e14151a40 2023-08-17T17:51:47.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e18ff0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140c6900 con 0x7f4e14157be0 2023-08-17T17:51:47.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e137fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e14151a40 0x7f4e140c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:47.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e137fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e14151a40 0x7f4e140c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43212/0 (socket says 172.21.15.78:43212) 2023-08-17T17:51:47.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e137fe700 1 -- 172.21.15.78:0/3696730074 learned_addr learned my addr 172.21.15.78:0/3696730074 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:47.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e137fe700 1 -- 172.21.15.78:0/3696730074 >> v2:172.21.15.150:3300/0 conn(0x7f4e14157be0 msgr2=0x7f4e14158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:47.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e13fff700 1 --2- 172.21.15.78:0/3696730074 >> v2:172.21.15.150:3300/0 conn(0x7f4e14157be0 0x7f4e14158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:47.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e137fe700 1 --2- 172.21.15.78:0/3696730074 >> v2:172.21.15.150:3300/0 conn(0x7f4e14157be0 0x7f4e14158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:47.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e137fe700 1 -- 172.21.15.78:0/3696730074 >> v1:172.21.15.150:6789/0 conn(0x7f4e14151e20 legacy=0x7f4e140c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:47.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e137fe700 1 -- 172.21.15.78:0/3696730074 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140c6be0 con 0x7f4e14151a40 2023-08-17T17:51:47.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e13fff700 1 --2- 172.21.15.78:0/3696730074 >> v2:172.21.15.150:3300/0 conn(0x7f4e14157be0 0x7f4e14158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:47.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e137fe700 1 --2- 172.21.15.78:0/3696730074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14151a40 0x7f4e140c8260 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f4e14155770 tx=0x7f4e08009060).ready entity=mon.0 client_cookie=d12296eea73f1373 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:47.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.436+0000 7f4e127fc700 1 -- 172.21.15.78:0/3696730074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08005880 con 0x7f4e14151a40 2023-08-17T17:51:47.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.437+0000 7f4e127fc700 1 -- 172.21.15.78:0/3696730074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e080059e0 con 0x7f4e14151a40 2023-08-17T17:51:47.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.437+0000 7f4e127fc700 1 -- 172.21.15.78:0/3696730074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08005d60 con 0x7f4e14151a40 2023-08-17T17:51:47.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.437+0000 7f4e18ff0700 1 -- 172.21.15.78:0/3696730074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14151a40 msgr2=0x7f4e140c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:47.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.437+0000 7f4e18ff0700 1 --2- 172.21.15.78:0/3696730074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14151a40 0x7f4e140c8260 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f4e14155770 tx=0x7f4e08009060).stop 2023-08-17T17:51:47.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.437+0000 7f4e18ff0700 1 -- 172.21.15.78:0/3696730074 shutdown_connections 2023-08-17T17:51:47.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.437+0000 7f4e18ff0700 1 --2- 172.21.15.78:0/3696730074 >> v2:172.21.15.150:3300/0 conn(0x7f4e14157be0 0x7f4e14158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:47.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.437+0000 7f4e18ff0700 1 --2- 172.21.15.78:0/3696730074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14151a40 0x7f4e140c8260 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:47.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.437+0000 7f4e18ff0700 1 -- 172.21.15.78:0/3696730074 >> 172.21.15.78:0/3696730074 conn(0x7f4e140943b0 msgr2=0x7f4e1406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:47.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.437+0000 7f4e18ff0700 1 -- 172.21.15.78:0/3696730074 shutdown_connections 2023-08-17T17:51:47.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.437+0000 7f4e18ff0700 1 -- 172.21.15.78:0/3696730074 wait complete. 2023-08-17T17:51:47.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.438+0000 7f4e18ff0700 1 Processor -- start 2023-08-17T17:51:47.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.438+0000 7f4e18ff0700 1 -- start start 2023-08-17T17:51:47.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e18ff0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e14151a40 0x7f4e140c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:47.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e18ff0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e14151e20 0x7f4e140aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:47.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e18ff0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14157be0 0x7f4e140aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:47.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e18ff0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140c4ae0 con 0x7f4e14157be0 2023-08-17T17:51:47.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e18ff0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140c1eb0 con 0x7f4e14151e20 2023-08-17T17:51:47.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e18ff0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140ab080 con 0x7f4e14151a40 2023-08-17T17:51:47.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e13fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14157be0 0x7f4e140aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:47.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e13fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14157be0 0x7f4e140aaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43228/0 (socket says 172.21.15.78:43228) 2023-08-17T17:51:47.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e13fff700 1 -- 172.21.15.78:0/786028534 learned_addr learned my addr 172.21.15.78:0/786028534 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:47.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e137fe700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e14151a40 0x7f4e140c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:47.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.439+0000 7f4e12ffd700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e14151e20 0x7f4e140aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:47.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4e13fff700 1 -- 172.21.15.78:0/786028534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e14151a40 msgr2=0x7f4e140c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:47.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4e13fff700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e14151a40 0x7f4e140c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:47.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4e13fff700 1 -- 172.21.15.78:0/786028534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e14151e20 msgr2=0x7f4e140aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:47.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4e13fff700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e14151e20 0x7f4e140aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:47.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4e13fff700 1 -- 172.21.15.78:0/786028534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08009300 con 0x7f4e14157be0 2023-08-17T17:51:47.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4e13fff700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14157be0 0x7f4e140aaa00 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f4e0c00cef0 tx=0x7f4e0c007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:47.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4dfb7fe700 1 -- 172.21.15.78:0/786028534 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00ad20 con 0x7f4e14157be0 2023-08-17T17:51:47.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4dfb7fe700 1 -- 172.21.15.78:0/786028534 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c00ae80 con 0x7f4e14157be0 2023-08-17T17:51:47.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4e18ff0700 1 -- 172.21.15.78:0/786028534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e140ab360 con 0x7f4e14157be0 2023-08-17T17:51:47.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4dfb7fe700 1 -- 172.21.15.78:0/786028534 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c016610 con 0x7f4e14157be0 2023-08-17T17:51:47.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.440+0000 7f4e18ff0700 1 -- 172.21.15.78:0/786028534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140ab640 con 0x7f4e14157be0 2023-08-17T17:51:47.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.441+0000 7f4e18ff0700 1 -- 172.21.15.78:0/786028534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e140c2390 con 0x7f4e14157be0 2023-08-17T17:51:47.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.441+0000 7f4dfb7fe700 1 -- 172.21.15.78:0/786028534 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 47) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f4e0c01d060 con 0x7f4e14157be0 2023-08-17T17:51:47.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.442+0000 7f4dfb7fe700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e0005ecf0 0x7f4e000611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:47.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.442+0000 7f4dfb7fe700 1 -- 172.21.15.78:0/786028534 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6782+0+0 (secure 0 0 0) 0x7f4e0c07a2e0 con 0x7f4e14157be0 2023-08-17T17:51:47.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.442+0000 7f4e137fe700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e0005ecf0 0x7f4e000611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:47.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.442+0000 7f4e137fe700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e0005ecf0 0x7f4e000611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f4e0800b360 tx=0x7f4e08016000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:47.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.446+0000 7f4dfb7fe700 1 -- 172.21.15.78:0/786028534 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e140c2390 con 0x7f4e14157be0 2023-08-17T17:51:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:47.610+0000 7f4e18ff0700 1 -- 172.21.15.78:0/786028534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4e140c2390 con 0x7f4e14157be0 2023-08-17T17:51:48.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.306+0000 7f4dfb7fe700 1 -- 172.21.15.78:0/786028534 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4e140c2390 con 0x7f4e14157be0 2023-08-17T17:51:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 -- 172.21.15.78:0/786028534 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e0005ecf0 msgr2=0x7f4e000611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e0005ecf0 0x7f4e000611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f4e0800b360 tx=0x7f4e08016000).stop 2023-08-17T17:51:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 -- 172.21.15.78:0/786028534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14157be0 msgr2=0x7f4e140aaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14157be0 0x7f4e140aaa00 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f4e0c00cef0 tx=0x7f4e0c007860).stop 2023-08-17T17:51:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 -- 172.21.15.78:0/786028534 shutdown_connections 2023-08-17T17:51:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e0005ecf0 0x7f4e000611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e14157be0 0x7f4e140aaa00 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e14151a40 0x7f4e140c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 --2- 172.21.15.78:0/786028534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e14151e20 0x7f4e140aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 -- 172.21.15.78:0/786028534 >> 172.21.15.78:0/786028534 conn(0x7f4e140943b0 msgr2=0x7f4e14064670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.308+0000 7f4e18ff0700 1 -- 172.21.15.78:0/786028534 shutdown_connections 2023-08-17T17:51:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.309+0000 7f4e18ff0700 1 -- 172.21.15.78:0/786028534 wait complete. 2023-08-17T17:51:48.312 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T17:51:48.322 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T17:51:48.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.437+0000 7fae45cc6700 1 Processor -- start 2023-08-17T17:51:48.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.438+0000 7fae45cc6700 1 -- start start 2023-08-17T17:51:48.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.438+0000 7fae45cc6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae400aa0f0 0x7fae400644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:48.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.438+0000 7fae45cc6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae400649b0 con 0x7fae400c5810 2023-08-17T17:51:48.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.438+0000 7fae45cc6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae40063420 con 0x7fae400aa4d0 2023-08-17T17:51:48.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.438+0000 7fae45cc6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae40063700 con 0x7fae400aa0f0 2023-08-17T17:51:48.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.438+0000 7fae3ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fae400c5810 0x7fae400a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57470/0 (socket says 172.21.15.78:57470) 2023-08-17T17:51:48.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.438+0000 7fae3ffff700 1 -- 172.21.15.78:0/3659380381 learned_addr learned my addr 172.21.15.78:0/3659380381 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:48.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3f7fe700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae400aa0f0 0x7fae400644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:48.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157543792 0 0) 0x7fae400649b0 con 0x7fae400c5810 2023-08-17T17:51:48.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae280033f0 con 0x7fae400c5810 2023-08-17T17:51:48.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246374903 0 0) 0x7fae40063420 con 0x7fae400aa4d0 2023-08-17T17:51:48.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae400649b0 con 0x7fae400aa4d0 2023-08-17T17:51:48.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 323639649 0 0) 0x7fae280033f0 con 0x7fae400c5810 2023-08-17T17:51:48.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae400aa0f0 msgr2=0x7fae400644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae400aa0f0 0x7fae400644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 >> v1:172.21.15.150:6789/0 conn(0x7fae400aa4d0 legacy=0x7fae400c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae400639e0 con 0x7fae400c5810 2023-08-17T17:51:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fae38001770 con 0x7fae400c5810 2023-08-17T17:51:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 >> v1:172.21.15.78:6789/0 conn(0x7fae400c5810 legacy=0x7fae400a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae28003aa0 0x7fae28003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae28004690 0x7fae28004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:48.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae400aa0f0 0x7fae28005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:48.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae40063700 con 0x7fae28003aa0 2023-08-17T17:51:48.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2800b990 con 0x7fae28004690 2023-08-17T17:51:48.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2800bb20 con 0x7fae400aa0f0 2023-08-17T17:51:48.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3f7fe700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae28003aa0 0x7fae28003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:48.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3ffff700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae400aa0f0 0x7fae28005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:48.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3effd700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae28004690 0x7fae28004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3f7fe700 1 -- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae400aa0f0 msgr2=0x7fae28005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3f7fe700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae400aa0f0 0x7fae28005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3f7fe700 1 -- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae28004690 msgr2=0x7fae28004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.439+0000 7fae3f7fe700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae28004690 0x7fae28004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae3f7fe700 1 -- 172.21.15.78:0/3659380381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae280033f0 con 0x7fae28003aa0 2023-08-17T17:51:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae3ffff700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae400aa0f0 0x7fae28005020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae3f7fe700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae28003aa0 0x7fae28003ea0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fae30009ab0 tx=0x7fae30009060).ready entity=mon.0 client_cookie=64d4862fe61ac7e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30009430 con 0x7fae28003aa0 2023-08-17T17:51:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3000e640 con 0x7fae28003aa0 2023-08-17T17:51:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae3e7fc700 1 -- 172.21.15.78:0/3659380381 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3000e9c0 con 0x7fae28003aa0 2023-08-17T17:51:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae45cc6700 1 -- 172.21.15.78:0/3659380381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae28003aa0 msgr2=0x7fae28003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae45cc6700 1 --2- 172.21.15.78:0/3659380381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae28003aa0 0x7fae28003ea0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fae30009ab0 tx=0x7fae30009060).stop 2023-08-17T17:51:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae3ffff700 1 -- 172.21.15.78:0/3659380381 reap_dead start 2023-08-17T17:51:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae45cc6700 1 -- 172.21.15.78:0/3659380381 shutdown_connections 2023-08-17T17:51:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae45cc6700 1 -- 172.21.15.78:0/3659380381 >> 172.21.15.78:0/3659380381 conn(0x7fae4006a6a0 msgr2=0x7fae400caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae45cc6700 1 -- 172.21.15.78:0/3659380381 shutdown_connections 2023-08-17T17:51:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.440+0000 7fae45cc6700 1 -- 172.21.15.78:0/3659380381 wait complete. 2023-08-17T17:51:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae45cc6700 1 Processor -- start 2023-08-17T17:51:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae45cc6700 1 -- start start 2023-08-17T17:51:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae45cc6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae28003aa0 0x7fae400ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae45cc6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae401528a0 0x7fae40152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae45cc6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae40098220 0x7fae400986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae45cc6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400ab360 con 0x7fae40098220 2023-08-17T17:51:48.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae45cc6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400c4a00 con 0x7fae28003aa0 2023-08-17T17:51:48.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae45cc6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae400ad780 con 0x7fae401528a0 2023-08-17T17:51:48.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae3ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae40098220 0x7fae400986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:48.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae3ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae40098220 0x7fae400986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43240/0 (socket says 172.21.15.78:43240) 2023-08-17T17:51:48.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.442+0000 7fae3ffff700 1 -- 172.21.15.78:0/3238469558 learned_addr learned my addr 172.21.15.78:0/3238469558 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:48.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae3effd700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae401528a0 0x7fae40152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:48.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae3f7fe700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae28003aa0 0x7fae400ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:48.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae3ffff700 1 -- 172.21.15.78:0/3238469558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae401528a0 msgr2=0x7fae40152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:48.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae3ffff700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae401528a0 0x7fae40152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:48.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae3ffff700 1 -- 172.21.15.78:0/3238469558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae28003aa0 msgr2=0x7fae400ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:48.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae3ffff700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae28003aa0 0x7fae400ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:48.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae3ffff700 1 -- 172.21.15.78:0/3238469558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae40098b90 con 0x7fae40098220 2023-08-17T17:51:48.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae3ffff700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae40098220 0x7fae400986a0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fae400c5bf0 tx=0x7fae38007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:48.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae277fe700 1 -- 172.21.15.78:0/3238469558 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae380079e0 con 0x7fae40098220 2023-08-17T17:51:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae277fe700 1 -- 172.21.15.78:0/3238469558 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae38004c40 con 0x7fae40098220 2023-08-17T17:51:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae277fe700 1 -- 172.21.15.78:0/3238469558 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800e620 con 0x7fae40098220 2023-08-17T17:51:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae45cc6700 1 -- 172.21.15.78:0/3238469558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae40165390 con 0x7fae40098220 2023-08-17T17:51:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.443+0000 7fae45cc6700 1 -- 172.21.15.78:0/3238469558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae400aad10 con 0x7fae40098220 2023-08-17T17:51:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.444+0000 7fae45cc6700 1 -- 172.21.15.78:0/3238469558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae40083980 con 0x7fae40098220 2023-08-17T17:51:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.444+0000 7fae277fe700 1 -- 172.21.15.78:0/3238469558 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 47) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fae3801e070 con 0x7fae40098220 2023-08-17T17:51:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.445+0000 7fae277fe700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae2c05ecf0 0x7fae2c0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.445+0000 7fae277fe700 1 -- 172.21.15.78:0/3238469558 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6315+0+0 (secure 0 0 0) 0x7fae38079360 con 0x7fae40098220 2023-08-17T17:51:48.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.445+0000 7fae3f7fe700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae2c05ecf0 0x7fae2c0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:48.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.445+0000 7fae3f7fe700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae2c05ecf0 0x7fae2c0611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fae4005eb70 tx=0x7fae3001a000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:48.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.449+0000 7fae277fe700 1 -- 172.21.15.78:0/3238469558 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae3804a880 con 0x7fae40098220 2023-08-17T17:51:48.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.616+0000 7fae45cc6700 1 -- 172.21.15.78:0/3238469558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae400cbd40 con 0x7fae40098220 2023-08-17T17:51:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:48.737+0000 7fae277fe700 1 -- 172.21.15.78:0/3238469558 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fae38077240 con 0x7fae40098220 2023-08-17T17:51:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.314+0000 7fae277fe700 1 -- 172.21.15.78:0/3238469558 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v112) v1 ==== 169+0+0 (secure 0 0 0) 0x7fae38072960 con 0x7fae40098220 2023-08-17T17:51:49.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.317+0000 7fae45cc6700 1 -- 172.21.15.78:0/3238469558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae2c05ecf0 msgr2=0x7fae2c0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.317+0000 7fae45cc6700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae2c05ecf0 0x7fae2c0611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fae4005eb70 tx=0x7fae3001a000).stop 2023-08-17T17:51:49.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.317+0000 7fae45cc6700 1 -- 172.21.15.78:0/3238469558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae40098220 msgr2=0x7fae400986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.317+0000 7fae45cc6700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae40098220 0x7fae400986a0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fae400c5bf0 tx=0x7fae38007eb0).stop 2023-08-17T17:51:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.317+0000 7fae45cc6700 1 -- 172.21.15.78:0/3238469558 shutdown_connections 2023-08-17T17:51:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.318+0000 7fae45cc6700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fae2c05ecf0 0x7fae2c0611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.318+0000 7fae45cc6700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae40098220 0x7fae400986a0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.318+0000 7fae45cc6700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae28003aa0 0x7fae400ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.318+0000 7fae45cc6700 1 --2- 172.21.15.78:0/3238469558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae401528a0 0x7fae40152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.318+0000 7fae45cc6700 1 -- 172.21.15.78:0/3238469558 >> 172.21.15.78:0/3238469558 conn(0x7fae4006a6a0 msgr2=0x7fae400c4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:49.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.318+0000 7fae45cc6700 1 -- 172.21.15.78:0/3238469558 shutdown_connections 2023-08-17T17:51:49.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.318+0000 7fae45cc6700 1 -- 172.21.15.78:0/3238469558 wait complete. 2023-08-17T17:51:49.321 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T17:51:49.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T17:51:49.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.449+0000 7fa5b272a700 1 Processor -- start 2023-08-17T17:51:49.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.449+0000 7fa5b272a700 1 -- start start 2023-08-17T17:51:49.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5b272a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5ac0aa4d0 0x7fa5ac0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5b272a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c5810 0x7fa5ac0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5b272a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ac0649b0 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5b272a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c6170 con 0x7fa5ac0aa4d0 2023-08-17T17:51:49.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5b272a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac063420 con 0x7fa5ac0c5810 2023-08-17T17:51:49.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5ab7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5ac0aa4d0 0x7fa5ac0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5ab7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5ac0aa4d0 0x7fa5ac0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35108/0 (socket says 172.21.15.78:35108) 2023-08-17T17:51:49.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5ab7fe700 1 -- 172.21.15.78:0/4289582677 learned_addr learned my addr 172.21.15.78:0/4289582677 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5b0cc7700 1 --2- 172.21.15.78:0/4289582677 >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c5810 0x7fa5ac0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5ab7fe700 1 -- 172.21.15.78:0/4289582677 >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c5810 msgr2=0x7fa5ac0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5ab7fe700 1 --2- 172.21.15.78:0/4289582677 >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c5810 0x7fa5ac0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5ab7fe700 1 -- 172.21.15.78:0/4289582677 >> v1:172.21.15.150:6789/0 conn(0x7fa5ac0aa0f0 legacy=0x7fa5ac0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5ab7fe700 1 -- 172.21.15.78:0/4289582677 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac063700 con 0x7fa5ac0aa4d0 2023-08-17T17:51:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.450+0000 7fa5b0cc7700 1 --2- 172.21.15.78:0/4289582677 >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c5810 0x7fa5ac0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5ab7fe700 1 --2- 172.21.15.78:0/4289582677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa4d0 0x7fa5ac0644c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fa5ac159090 tx=0x7fa5a00090f0).ready entity=mon.0 client_cookie=959232228bec8a70 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5aaffd700 1 -- 172.21.15.78:0/4289582677 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000b5a0 con 0x7fa5ac0aa4d0 2023-08-17T17:51:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5aaffd700 1 -- 172.21.15.78:0/4289582677 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000b700 con 0x7fa5ac0aa4d0 2023-08-17T17:51:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5aaffd700 1 -- 172.21.15.78:0/4289582677 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000ba80 con 0x7fa5ac0aa4d0 2023-08-17T17:51:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5b272a700 1 -- 172.21.15.78:0/4289582677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa4d0 msgr2=0x7fa5ac0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5b272a700 1 --2- 172.21.15.78:0/4289582677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa4d0 0x7fa5ac0644c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fa5ac159090 tx=0x7fa5a00090f0).stop 2023-08-17T17:51:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5b272a700 1 -- 172.21.15.78:0/4289582677 shutdown_connections 2023-08-17T17:51:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5b272a700 1 --2- 172.21.15.78:0/4289582677 >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c5810 0x7fa5ac0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5b272a700 1 --2- 172.21.15.78:0/4289582677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa4d0 0x7fa5ac0644c0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5b272a700 1 -- 172.21.15.78:0/4289582677 >> 172.21.15.78:0/4289582677 conn(0x7fa5ac06a6a0 msgr2=0x7fa5ac0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5b272a700 1 -- 172.21.15.78:0/4289582677 shutdown_connections 2023-08-17T17:51:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.451+0000 7fa5b272a700 1 -- 172.21.15.78:0/4289582677 wait complete. 2023-08-17T17:51:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.452+0000 7fa5b272a700 1 Processor -- start 2023-08-17T17:51:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.453+0000 7fa5b272a700 1 -- start start 2023-08-17T17:51:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.453+0000 7fa5b272a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa0f0 0x7fa5ac0c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.453+0000 7fa5b272a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac0aa4d0 0x7fa5ac0c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.453+0000 7fa5b272a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac0c5810 0x7fa5ac1680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.453+0000 7fa5b272a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c30d0 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.453+0000 7fa5b272a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c24c0 con 0x7fa5ac0c5810 2023-08-17T17:51:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.453+0000 7fa5b272a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c27a0 con 0x7fa5ac0aa4d0 2023-08-17T17:51:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.453+0000 7fa5abfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa0f0 0x7fa5ac0c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.453+0000 7fa5abfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa0f0 0x7fa5ac0c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35120/0 (socket says 172.21.15.78:35120) 2023-08-17T17:51:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.453+0000 7fa5abfff700 1 -- 172.21.15.78:0/3012357593 learned_addr learned my addr 172.21.15.78:0/3012357593 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa5abfff700 1 -- 172.21.15.78:0/3012357593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac0aa4d0 msgr2=0x7fa5ac0c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa5abfff700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac0aa4d0 0x7fa5ac0c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:49.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa5b0cc7700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac0c5810 0x7fa5ac1680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa5abfff700 1 -- 172.21.15.78:0/3012357593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac0c5810 msgr2=0x7fa5ac1680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa5abfff700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac0c5810 0x7fa5ac1680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa5abfff700 1 -- 172.21.15.78:0/3012357593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0009370 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa5abfff700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa0f0 0x7fa5ac0c1ee0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fa59c00c440 tx=0x7fa59c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:49.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa593fff700 1 -- 172.21.15.78:0/3012357593 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00f470 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa593fff700 1 -- 172.21.15.78:0/3012357593 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c00f5f0 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa5b272a700 1 -- 172.21.15.78:0/3012357593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac0c2a80 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa593fff700 1 -- 172.21.15.78:0/3012357593 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00f9b0 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.454+0000 7fa5b272a700 1 -- 172.21.15.78:0/3012357593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac155e00 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.455+0000 7fa5b272a700 1 -- 172.21.15.78:0/3012357593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac083980 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.455+0000 7fa593fff700 1 -- 172.21.15.78:0/3012357593 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa59c019030 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.455+0000 7fa593fff700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa59805ed90 0x7fa598061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.456+0000 7fa593fff700 1 -- 172.21.15.78:0/3012357593 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5785+0+0 (secure 0 0 0) 0x7fa59c078e00 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.456+0000 7fa5ab7fe700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa59805ed90 0x7fa598061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.456+0000 7fa5ab7fe700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa59805ed90 0x7fa598061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa5ac159090 tx=0x7fa5a0015000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:49.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.459+0000 7fa593fff700 1 -- 172.21.15.78:0/3012357593 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa59c0488f0 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.627+0000 7fa5b272a700 1 -- 172.21.15.78:0/3012357593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa5ac0a8020 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.630+0000 7fa593fff700 1 -- 172.21.15.78:0/3012357593 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa59c04dfd0 con 0x7fa5ac0aa0f0 2023-08-17T17:51:49.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 -- 172.21.15.78:0/3012357593 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa59805ed90 msgr2=0x7fa598061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa59805ed90 0x7fa598061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa5ac159090 tx=0x7fa5a0015000).stop 2023-08-17T17:51:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 -- 172.21.15.78:0/3012357593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa0f0 msgr2=0x7fa5ac0c1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa0f0 0x7fa5ac0c1ee0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fa59c00c440 tx=0x7fa59c007de0).stop 2023-08-17T17:51:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 -- 172.21.15.78:0/3012357593 shutdown_connections 2023-08-17T17:51:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa59805ed90 0x7fa598061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac0c5810 0x7fa5ac1680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0aa0f0 0x7fa5ac0c1ee0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 --2- 172.21.15.78:0/3012357593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac0aa4d0 0x7fa5ac0c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:49.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 -- 172.21.15.78:0/3012357593 >> 172.21.15.78:0/3012357593 conn(0x7fa5ac06a6a0 msgr2=0x7fa5ac0a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:49.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 -- 172.21.15.78:0/3012357593 shutdown_connections 2023-08-17T17:51:49.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.632+0000 7fa5b272a700 1 -- 172.21.15.78:0/3012357593 wait complete. 2023-08-17T17:51:49.645 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-17T17:51:49.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.767+0000 7f1ea33b8700 1 Processor -- start 2023-08-17T17:51:49.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.768+0000 7f1ea33b8700 1 -- start start 2023-08-17T17:51:49.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.768+0000 7f1ea33b8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1e9c0aa4d0 0x7f1e9c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.768+0000 7f1ea33b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1e9c0c5810 0x7f1e9c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.768+0000 7f1ea33b8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c0649b0 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.768+0000 7f1ea33b8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9c0c6170 con 0x7f1e9c0aa4d0 2023-08-17T17:51:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.768+0000 7f1ea33b8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9c063420 con 0x7f1e9c0c5810 2023-08-17T17:51:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1ea1154700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1e9c0aa0f0 0x7f1e9c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41506/0 (socket says 172.21.15.78:41506) 2023-08-17T17:51:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1ea0953700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1e9c0aa4d0 0x7f1e9c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1ea1154700 1 -- 172.21.15.78:0/3077918532 learned_addr learned my addr 172.21.15.78:0/3077918532 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1ea1955700 1 --2- 172.21.15.78:0/3077918532 >> v2:172.21.15.150:3300/0 conn(0x7f1e9c0c5810 0x7f1e9c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1ea0953700 1 -- 172.21.15.78:0/3077918532 >> v2:172.21.15.150:3300/0 conn(0x7f1e9c0c5810 msgr2=0x7f1e9c0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1ea0953700 1 --2- 172.21.15.78:0/3077918532 >> v2:172.21.15.150:3300/0 conn(0x7f1e9c0c5810 0x7f1e9c0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1ea0953700 1 -- 172.21.15.78:0/3077918532 >> v1:172.21.15.78:6789/0 conn(0x7f1e9c0aa0f0 legacy=0x7f1e9c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1e93fff700 1 -- 172.21.15.78:0/3077918532 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601170288 0 0) 0x7f1e9c0649b0 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1ea0953700 1 -- 172.21.15.78:0/3077918532 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c063700 con 0x7f1e9c0aa4d0 2023-08-17T17:51:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1ea0953700 1 --2- 172.21.15.78:0/3077918532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa4d0 0x7f1e9c0644c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f1e9c159090 tx=0x7f1e8c009060).ready entity=mon.0 client_cookie=f040b5be0fb88b7f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1e93fff700 1 -- 172.21.15.78:0/3077918532 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00b580 con 0x7f1e9c0aa4d0 2023-08-17T17:51:49.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1e93fff700 1 -- 172.21.15.78:0/3077918532 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c00b6e0 con 0x7f1e9c0aa4d0 2023-08-17T17:51:49.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.769+0000 7f1e93fff700 1 -- 172.21.15.78:0/3077918532 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00ba60 con 0x7f1e9c0aa4d0 2023-08-17T17:51:49.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.770+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3077918532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa4d0 msgr2=0x7f1e9c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.770+0000 7f1ea33b8700 1 --2- 172.21.15.78:0/3077918532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa4d0 0x7f1e9c0644c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f1e9c159090 tx=0x7f1e8c009060).stop 2023-08-17T17:51:49.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.770+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3077918532 shutdown_connections 2023-08-17T17:51:49.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.770+0000 7f1ea33b8700 1 --2- 172.21.15.78:0/3077918532 >> v2:172.21.15.150:3300/0 conn(0x7f1e9c0c5810 0x7f1e9c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.770+0000 7f1ea33b8700 1 --2- 172.21.15.78:0/3077918532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa4d0 0x7f1e9c0644c0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.770+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3077918532 >> 172.21.15.78:0/3077918532 conn(0x7f1e9c06a6a0 msgr2=0x7f1e9c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.770+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3077918532 shutdown_connections 2023-08-17T17:51:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.770+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3077918532 wait complete. 2023-08-17T17:51:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.771+0000 7f1ea33b8700 1 Processor -- start 2023-08-17T17:51:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.771+0000 7f1ea33b8700 1 -- start start 2023-08-17T17:51:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea33b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa0f0 0x7f1e9c0c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea33b8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0aa4d0 0x7f1e9c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea33b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e9c0c5810 0x7f1e9c0a7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea33b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c164670 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea33b8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c0c1fb0 con 0x7f1e9c0aa4d0 2023-08-17T17:51:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea33b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c0c2280 con 0x7f1e9c0c5810 2023-08-17T17:51:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1154700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa0f0 0x7f1e9c0c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1154700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa0f0 0x7f1e9c0c1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35130/0 (socket says 172.21.15.78:35130) 2023-08-17T17:51:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1154700 1 -- 172.21.15.78:0/3233832209 learned_addr learned my addr 172.21.15.78:0/3233832209 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea0953700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0aa4d0 0x7f1e9c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1955700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e9c0c5810 0x7f1e9c0a7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1154700 1 -- 172.21.15.78:0/3233832209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e9c0c5810 msgr2=0x7f1e9c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1154700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e9c0c5810 0x7f1e9c0a7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1154700 1 -- 172.21.15.78:0/3233832209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0aa4d0 msgr2=0x7f1e9c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1154700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0aa4d0 0x7f1e9c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1154700 1 -- 172.21.15.78:0/3233832209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c0092a0 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1955700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e9c0c5810 0x7f1e9c0a7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:49.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.772+0000 7f1ea1154700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa0f0 0x7f1e9c0c1ac0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f1e9800c4e0 tx=0x7f1e98007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:49.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.773+0000 7f1e917fa700 1 -- 172.21.15.78:0/3233832209 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e980072e0 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.773+0000 7f1e917fa700 1 -- 172.21.15.78:0/3233832209 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e98007440 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.773+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3233832209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c0c2560 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.773+0000 7f1e917fa700 1 -- 172.21.15.78:0/3233832209 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e980057a0 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.773+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3233832209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9c0c2b20 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.774+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3233832209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9c0adaa0 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.774+0000 7f1e917fa700 1 -- 172.21.15.78:0/3233832209 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1e9801a060 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.774+0000 7f1e917fa700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1e8005ed90 0x7f1e80061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.774+0000 7f1ea0953700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1e8005ed90 0x7f1e80061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.774+0000 7f1e917fa700 1 -- 172.21.15.78:0/3233832209 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5785+0+0 (secure 0 0 0) 0x7f1e98079130 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.775+0000 7f1ea0953700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1e8005ed90 0x7f1e80061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1e9c159090 tx=0x7f1e8c017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.778+0000 7f1e917fa700 1 -- 172.21.15.78:0/3233832209 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e9804a820 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.942+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3233832209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f1e9c046af0 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.947+0000 7f1e917fa700 1 -- 172.21.15.78:0/3233832209 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v21) v1 ==== 120+0+0 (secure 0 0 0) 0x7f1e980180b0 con 0x7f1e9c0aa0f0 2023-08-17T17:51:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.949+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3233832209 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1e8005ed90 msgr2=0x7f1e80061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.949+0000 7f1ea33b8700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1e8005ed90 0x7f1e80061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1e9c159090 tx=0x7f1e8c017000).stop 2023-08-17T17:51:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.949+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3233832209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa0f0 msgr2=0x7f1e9c0c1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:49.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.949+0000 7f1ea33b8700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa0f0 0x7f1e9c0c1ac0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f1e9800c4e0 tx=0x7f1e98007c70).stop 2023-08-17T17:51:49.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.950+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3233832209 shutdown_connections 2023-08-17T17:51:49.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.950+0000 7f1ea33b8700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1e8005ed90 0x7f1e80061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.950+0000 7f1ea33b8700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e9c0c5810 0x7f1e9c0a7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.950+0000 7f1ea33b8700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e9c0aa0f0 0x7f1e9c0c1ac0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.950+0000 7f1ea33b8700 1 --2- 172.21.15.78:0/3233832209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0aa4d0 0x7f1e9c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.950+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3233832209 >> 172.21.15.78:0/3233832209 conn(0x7f1e9c06a6a0 msgr2=0x7f1e9c0a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.950+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3233832209 shutdown_connections 2023-08-17T17:51:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:49.950+0000 7f1ea33b8700 1 -- 172.21.15.78:0/3233832209 wait complete. 2023-08-17T17:51:49.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-08-17T17:51:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.074+0000 7efdbe881700 1 Processor -- start 2023-08-17T17:51:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.074+0000 7efdbe881700 1 -- start start 2023-08-17T17:51:50.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.074+0000 7efdbe881700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efdb813a640 0x7efdb8154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:50.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdbe881700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb806a2c0 0x7efdb8069050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:50.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdbe881700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb80c2c10 con 0x7efdb813aa20 2023-08-17T17:51:50.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdbe881700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb8155010 con 0x7efdb813a640 2023-08-17T17:51:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdbe881700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb81552e0 con 0x7efdb806a2c0 2023-08-17T17:51:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdbce1e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efdb813aa20 0x7efdb8151590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41510/0 (socket says 172.21.15.78:41510) 2023-08-17T17:51:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdbce1e700 1 -- 172.21.15.78:0/82824905 learned_addr learned my addr 172.21.15.78:0/82824905 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307121285 0 0) 0x7efdb80c2c10 con 0x7efdb813aa20 2023-08-17T17:51:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda00033f0 con 0x7efdb813aa20 2023-08-17T17:51:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb77fe700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb806a2c0 0x7efdb8069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:50.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb7fff700 1 --2- 172.21.15.78:0/82824905 >> v2:172.21.15.150:3300/0 conn(0x7efdb813a640 0x7efdb8154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1685150693 0 0) 0x7efda00033f0 con 0x7efdb813aa20 2023-08-17T17:51:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb806a2c0 msgr2=0x7efdb8069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb806a2c0 0x7efdb8069050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 >> v2:172.21.15.150:3300/0 conn(0x7efdb813a640 msgr2=0x7efdb8154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 --2- 172.21.15.78:0/82824905 >> v2:172.21.15.150:3300/0 conn(0x7efdb813a640 0x7efdb8154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb81555c0 con 0x7efdb813aa20 2023-08-17T17:51:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7efdb00017f0 con 0x7efdb813aa20 2023-08-17T17:51:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb77fe700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb806a2c0 0x7efdb8069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb7fff700 1 --2- 172.21.15.78:0/82824905 >> v2:172.21.15.150:3300/0 conn(0x7efdb813a640 0x7efdb8154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 >> v1:172.21.15.78:6789/0 conn(0x7efdb813aa20 legacy=0x7efdb8151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efda00038e0 0x7efda0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb806a2c0 0x7efda0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda0004b80 0x7efda0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8155010 con 0x7efda00038e0 2023-08-17T17:51:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb81552e0 con 0x7efda0004b80 2023-08-17T17:51:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda000b910 con 0x7efdb806a2c0 2023-08-17T17:51:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.075+0000 7efdb7fff700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efda00038e0 0x7efda0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb77fe700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb806a2c0 0x7efda0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdbce1e700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda0004b80 0x7efda0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb7fff700 1 -- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb806a2c0 msgr2=0x7efda0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb7fff700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb806a2c0 0x7efda0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb7fff700 1 -- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda0004b80 msgr2=0x7efda0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb7fff700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda0004b80 0x7efda0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb7fff700 1 -- 172.21.15.78:0/82824905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda00033f0 con 0x7efda00038e0 2023-08-17T17:51:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb77fe700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb806a2c0 0x7efda0004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdbce1e700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda0004b80 0x7efda0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb7fff700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efda00038e0 0x7efda0003d00 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7efda800bad0 tx=0x7efda8008040).ready entity=mon.0 client_cookie=75278fcf1c083f40 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800b410 con 0x7efda00038e0 2023-08-17T17:51:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda800d5d0 con 0x7efda00038e0 2023-08-17T17:51:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdb6ffd700 1 -- 172.21.15.78:0/82824905 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800d950 con 0x7efda00038e0 2023-08-17T17:51:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdbe881700 1 -- 172.21.15.78:0/82824905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efda00038e0 msgr2=0x7efda0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdbe881700 1 --2- 172.21.15.78:0/82824905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efda00038e0 0x7efda0003d00 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7efda800bad0 tx=0x7efda8008040).stop 2023-08-17T17:51:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdbce1e700 1 -- 172.21.15.78:0/82824905 reap_dead start 2023-08-17T17:51:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdbe881700 1 -- 172.21.15.78:0/82824905 shutdown_connections 2023-08-17T17:51:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdbe881700 1 -- 172.21.15.78:0/82824905 >> 172.21.15.78:0/82824905 conn(0x7efdb80c7b00 msgr2=0x7efdb80c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.076+0000 7efdbe881700 1 -- 172.21.15.78:0/82824905 shutdown_connections 2023-08-17T17:51:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.077+0000 7efdbe881700 1 -- 172.21.15.78:0/82824905 wait complete. 2023-08-17T17:51:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.078+0000 7efdbe881700 1 Processor -- start 2023-08-17T17:51:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.078+0000 7efdbe881700 1 -- start start 2023-08-17T17:51:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.078+0000 7efdbe881700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda00038e0 0x7efdb8162b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdbe881700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80a9e60 0x7efdb8165670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdbe881700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb80aa2e0 0x7efdb8165b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdbe881700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb81626d0 con 0x7efdb80a9e60 2023-08-17T17:51:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdbe881700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8163050 con 0x7efda00038e0 2023-08-17T17:51:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdbe881700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8151690 con 0x7efdb80aa2e0 2023-08-17T17:51:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdb77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80a9e60 0x7efdb8165670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdb77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80a9e60 0x7efdb8165670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35144/0 (socket says 172.21.15.78:35144) 2023-08-17T17:51:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdb77fe700 1 -- 172.21.15.78:0/1110436690 learned_addr learned my addr 172.21.15.78:0/1110436690 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdb7fff700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda00038e0 0x7efdb8162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdbce1e700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb80aa2e0 0x7efdb8165b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdb77fe700 1 -- 172.21.15.78:0/1110436690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb80aa2e0 msgr2=0x7efdb8165b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdb77fe700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb80aa2e0 0x7efdb8165b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdb77fe700 1 -- 172.21.15.78:0/1110436690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda00038e0 msgr2=0x7efdb8162b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdb77fe700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda00038e0 0x7efdb8162b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdb77fe700 1 -- 172.21.15.78:0/1110436690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb81620a0 con 0x7efdb80a9e60 2023-08-17T17:51:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdb77fe700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80a9e60 0x7efdb8165670 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7efdac00f6b0 tx=0x7efdac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efd9ffff700 1 -- 172.21.15.78:0/1110436690 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0115a0 con 0x7efdb80a9e60 2023-08-17T17:51:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efd9ffff700 1 -- 172.21.15.78:0/1110436690 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac011700 con 0x7efdb80a9e60 2023-08-17T17:51:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdbe881700 1 -- 172.21.15.78:0/1110436690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb8166110 con 0x7efdb80a9e60 2023-08-17T17:51:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efd9ffff700 1 -- 172.21.15.78:0/1110436690 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac011a80 con 0x7efdb80a9e60 2023-08-17T17:51:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.079+0000 7efdbe881700 1 -- 172.21.15.78:0/1110436690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb8162360 con 0x7efdb80a9e60 2023-08-17T17:51:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.080+0000 7efdbe881700 1 -- 172.21.15.78:0/1110436690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb8047350 con 0x7efdb80a9e60 2023-08-17T17:51:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.080+0000 7efd9ffff700 1 -- 172.21.15.78:0/1110436690 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efdac01d460 con 0x7efdb80a9e60 2023-08-17T17:51:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.081+0000 7efd9ffff700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efda405ed90 0x7efda4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.081+0000 7efdb7fff700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efda405ed90 0x7efda4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.081+0000 7efd9ffff700 1 -- 172.21.15.78:0/1110436690 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5785+0+0 (secure 0 0 0) 0x7efdac079bf0 con 0x7efdb80a9e60 2023-08-17T17:51:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.081+0000 7efdb7fff700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efda405ed90 0x7efda4061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efda8008010 tx=0x7efda8008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.085+0000 7efd9ffff700 1 -- 172.21.15.78:0/1110436690 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efdac04b280 con 0x7efdb80a9e60 2023-08-17T17:51:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:50.313+0000 7efdbe881700 1 -- 172.21.15.78:0/1110436690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7efdb806a0a0 con 0x7efdb80a9e60 2023-08-17T17:51:51.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.320+0000 7efd9ffff700 1 -- 172.21.15.78:0/1110436690 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v643) v1 ==== 183+0+0 (secure 0 0 0) 0x7efdac04e8a0 con 0x7efdb80a9e60 2023-08-17T17:51:51.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 -- 172.21.15.78:0/1110436690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efda405ed90 msgr2=0x7efda4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:51.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efda405ed90 0x7efda4061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efda8008010 tx=0x7efda8008040).stop 2023-08-17T17:51:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 -- 172.21.15.78:0/1110436690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80a9e60 msgr2=0x7efdb8165670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80a9e60 0x7efdb8165670 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7efdac00f6b0 tx=0x7efdac008040).stop 2023-08-17T17:51:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 -- 172.21.15.78:0/1110436690 shutdown_connections 2023-08-17T17:51:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7efda405ed90 0x7efda4061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdb80aa2e0 0x7efdb8165b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda00038e0 0x7efdb8162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 --2- 172.21.15.78:0/1110436690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80a9e60 0x7efdb8165670 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:51.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 -- 172.21.15.78:0/1110436690 >> 172.21.15.78:0/1110436690 conn(0x7efdb80c7b00 msgr2=0x7efdb8137600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:51.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 -- 172.21.15.78:0/1110436690 shutdown_connections 2023-08-17T17:51:51.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.323+0000 7efdbe881700 1 -- 172.21.15.78:0/1110436690 wait complete. 2023-08-17T17:51:51.336 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) ... ok 2023-08-17T17:51:51.337 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-08-17T17:51:51.337 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-17T17:51:51.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-08-17T17:51:51.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.449+0000 7f4fce067700 1 Processor -- start 2023-08-17T17:51:51.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.450+0000 7f4fce067700 1 -- start start 2023-08-17T17:51:51.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.450+0000 7f4fce067700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4fc8154140 0x7f4fc80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:51.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.450+0000 7f4fce067700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc8154520 con 0x7f4fc80c1010 2023-08-17T17:51:51.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.450+0000 7f4fce067700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc80c91e0 con 0x7f4fc80a7c40 2023-08-17T17:51:51.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.450+0000 7f4fce067700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc80c94c0 con 0x7f4fc8154140 2023-08-17T17:51:51.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.450+0000 7f4fc77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4fc8154140 0x7f4fc80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:51.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.450+0000 7f4fc7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4fc80c1010 0x7f4fc80ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41520/0 (socket says 172.21.15.78:41520) 2023-08-17T17:51:51.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.451+0000 7f4fc7fff700 1 -- 172.21.15.78:0/800785001 learned_addr learned my addr 172.21.15.78:0/800785001 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:51.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.451+0000 7f4fc77fe700 1 -- 172.21.15.78:0/800785001 >> v1:172.21.15.150:6789/0 conn(0x7f4fc80a7c40 legacy=0x7f4fc80c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.451+0000 7f4fc77fe700 1 -- 172.21.15.78:0/800785001 >> v1:172.21.15.78:6789/0 conn(0x7f4fc80c1010 legacy=0x7f4fc80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.451+0000 7f4fc67fc700 1 -- 172.21.15.78:0/800785001 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559764741 0 0) 0x7f4fc8154520 con 0x7f4fc80c1010 2023-08-17T17:51:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.451+0000 7f4fc77fe700 1 -- 172.21.15.78:0/800785001 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc80c97a0 con 0x7f4fc8154140 2023-08-17T17:51:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.451+0000 7f4fc77fe700 1 --2- 172.21.15.78:0/800785001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc8154140 0x7f4fc80c6ee0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f4fb8009e60 tx=0x7f4fb8009780).ready entity=mon.0 client_cookie=659a281c41179c8e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.451+0000 7f4fc67fc700 1 -- 172.21.15.78:0/800785001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb800e070 con 0x7f4fc8154140 2023-08-17T17:51:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.451+0000 7f4fc67fc700 1 -- 172.21.15.78:0/800785001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb800bbf0 con 0x7f4fc8154140 2023-08-17T17:51:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.451+0000 7f4fc67fc700 1 -- 172.21.15.78:0/800785001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8012410 con 0x7f4fc8154140 2023-08-17T17:51:51.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.452+0000 7f4fce067700 1 -- 172.21.15.78:0/800785001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc8154140 msgr2=0x7f4fc80c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:51.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.452+0000 7f4fce067700 1 --2- 172.21.15.78:0/800785001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc8154140 0x7f4fc80c6ee0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f4fb8009e60 tx=0x7f4fb8009780).stop 2023-08-17T17:51:51.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.452+0000 7f4fce067700 1 -- 172.21.15.78:0/800785001 shutdown_connections 2023-08-17T17:51:51.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.452+0000 7f4fce067700 1 --2- 172.21.15.78:0/800785001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc8154140 0x7f4fc80c6ee0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:51.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.452+0000 7f4fce067700 1 -- 172.21.15.78:0/800785001 >> 172.21.15.78:0/800785001 conn(0x7f4fc8094510 msgr2=0x7f4fc806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:51.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.452+0000 7f4fce067700 1 -- 172.21.15.78:0/800785001 shutdown_connections 2023-08-17T17:51:51.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.452+0000 7f4fce067700 1 -- 172.21.15.78:0/800785001 wait complete. 2023-08-17T17:51:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.453+0000 7f4fce067700 1 Processor -- start 2023-08-17T17:51:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.453+0000 7f4fce067700 1 -- start start 2023-08-17T17:51:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fce067700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc80a7c40 0x7f4fc8151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fce067700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fc80c1010 0x7f4fc80ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fce067700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fc8154140 0x7f4fc8164a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fce067700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80ada50 con 0x7f4fc80a7c40 2023-08-17T17:51:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fce067700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8164590 con 0x7f4fc80c1010 2023-08-17T17:51:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fce067700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8164290 con 0x7f4fc8154140 2023-08-17T17:51:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fc77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc80a7c40 0x7f4fc8151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fc77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc80a7c40 0x7f4fc8151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35162/0 (socket says 172.21.15.78:35162) 2023-08-17T17:51:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fc77fe700 1 -- 172.21.15.78:0/1861193624 learned_addr learned my addr 172.21.15.78:0/1861193624 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fc77fe700 1 -- 172.21.15.78:0/1861193624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fc8154140 msgr2=0x7f4fc8164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fc77fe700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fc8154140 0x7f4fc8164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fc77fe700 1 -- 172.21.15.78:0/1861193624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fc80c1010 msgr2=0x7f4fc80ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fc77fe700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fc80c1010 0x7f4fc80ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fc77fe700 1 -- 172.21.15.78:0/1861193624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8009a20 con 0x7f4fc80a7c40 2023-08-17T17:51:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fc77fe700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc80a7c40 0x7f4fc8151010 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f4fc80adbc0 tx=0x7f4fb8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:51.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4faf7fe700 1 -- 172.21.15.78:0/1861193624 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb801c660 con 0x7f4fc80a7c40 2023-08-17T17:51:51.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4faf7fe700 1 -- 172.21.15.78:0/1861193624 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb801c7c0 con 0x7f4fc80a7c40 2023-08-17T17:51:51.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fce067700 1 -- 172.21.15.78:0/1861193624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc80ad1b0 con 0x7f4fc80a7c40 2023-08-17T17:51:51.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4faf7fe700 1 -- 172.21.15.78:0/1861193624 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb801cb80 con 0x7f4fc80a7c40 2023-08-17T17:51:51.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.454+0000 7f4fce067700 1 -- 172.21.15.78:0/1861193624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc80ad770 con 0x7f4fc80a7c40 2023-08-17T17:51:51.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.455+0000 7f4fce067700 1 -- 172.21.15.78:0/1861193624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc8047350 con 0x7f4fc80a7c40 2023-08-17T17:51:51.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.456+0000 7f4faf7fe700 1 -- 172.21.15.78:0/1861193624 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4fb801d420 con 0x7f4fc80a7c40 2023-08-17T17:51:51.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.456+0000 7f4faf7fe700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4fb405ed90 0x7f4fb4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:51.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.456+0000 7f4faf7fe700 1 -- 172.21.15.78:0/1861193624 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5785+0+0 (secure 0 0 0) 0x7f4fb807ba60 con 0x7f4fc80a7c40 2023-08-17T17:51:51.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.456+0000 7f4fc6ffd700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4fb405ed90 0x7f4fb4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:51.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.456+0000 7f4fc6ffd700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4fb405ed90 0x7f4fb4061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4fc8154dc0 tx=0x7f4fbc006ae0).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:51.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.460+0000 7f4faf7fe700 1 -- 172.21.15.78:0/1861193624 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4fb804d0f0 con 0x7f4fc80a7c40 2023-08-17T17:51:51.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:51.686+0000 7f4fce067700 1 -- 172.21.15.78:0/1861193624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f4fc81535e0 con 0x7f4fc80a7c40 2023-08-17T17:51:52.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.325+0000 7f4faf7fe700 1 -- 172.21.15.78:0/1861193624 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v644) v1 ==== 151+0+0 (secure 0 0 0) 0x7f4fb8050710 con 0x7f4fc80a7c40 2023-08-17T17:51:52.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 -- 172.21.15.78:0/1861193624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4fb405ed90 msgr2=0x7f4fb4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:52.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4fb405ed90 0x7f4fb4061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4fc8154dc0 tx=0x7f4fbc006ae0).stop 2023-08-17T17:51:52.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 -- 172.21.15.78:0/1861193624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc80a7c40 msgr2=0x7f4fc8151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:52.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc80a7c40 0x7f4fc8151010 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f4fc80adbc0 tx=0x7f4fb8009780).stop 2023-08-17T17:51:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 -- 172.21.15.78:0/1861193624 shutdown_connections 2023-08-17T17:51:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4fb405ed90 0x7f4fb4061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fc8154140 0x7f4fc8164a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fc80a7c40 0x7f4fc8151010 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 --2- 172.21.15.78:0/1861193624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fc80c1010 0x7f4fc80ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:51:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 -- 172.21.15.78:0/1861193624 >> 172.21.15.78:0/1861193624 conn(0x7f4fc8094510 msgr2=0x7f4fc80c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 -- 172.21.15.78:0/1861193624 shutdown_connections 2023-08-17T17:51:52.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.327+0000 7f4fce067700 1 -- 172.21.15.78:0/1861193624 wait complete. 2023-08-17T17:51:52.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T17:51:52.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.455+0000 7fb4a6f08700 1 Processor -- start 2023-08-17T17:51:52.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.455+0000 7fb4a6f08700 1 -- start start 2023-08-17T17:51:52.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.456+0000 7fb4a6f08700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4a00aa0f0 0x7fb4a00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.456+0000 7fb4a6f08700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4a00c5810 0x7fb4a00c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.456+0000 7fb4a6f08700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a00649b0 con 0x7fb4a00aa4d0 2023-08-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.456+0000 7fb4a6f08700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a00c6170 con 0x7fb4a00c5810 2023-08-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.456+0000 7fb4a6f08700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a0063420 con 0x7fb4a00aa0f0 2023-08-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.456+0000 7fb4a54a5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4a00c5810 0x7fb4a00c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.456+0000 7fb4a54a5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4a00c5810 0x7fb4a00c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35168/0 (socket says 172.21.15.78:35168) 2023-08-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.456+0000 7fb4a54a5700 1 -- 172.21.15.78:0/2666053192 learned_addr learned my addr 172.21.15.78:0/2666053192 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.456+0000 7fb4a54a5700 1 -- 172.21.15.78:0/2666053192 >> v2:172.21.15.150:3300/0 conn(0x7fb4a00aa0f0 msgr2=0x7fb4a00644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.456+0000 7fb4a4ca4700 1 --2- 172.21.15.78:0/2666053192 >> v2:172.21.15.150:3300/0 conn(0x7fb4a00aa0f0 0x7fb4a00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a54a5700 1 --2- 172.21.15.78:0/2666053192 >> v2:172.21.15.150:3300/0 conn(0x7fb4a00aa0f0 0x7fb4a00644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a54a5700 1 -- 172.21.15.78:0/2666053192 >> v1:172.21.15.150:6789/0 conn(0x7fb4a00aa4d0 legacy=0x7fb4a00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a54a5700 1 -- 172.21.15.78:0/2666053192 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a0063700 con 0x7fb4a00c5810 2023-08-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a4ca4700 1 --2- 172.21.15.78:0/2666053192 >> v2:172.21.15.150:3300/0 conn(0x7fb4a00aa0f0 0x7fb4a00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:52.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a54a5700 1 --2- 172.21.15.78:0/2666053192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 0x7fb4a00c5c80 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fb4a00cade0 tx=0x7fb4980090f0).ready entity=mon.0 client_cookie=498904205eb924ec server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:52.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4977fe700 1 -- 172.21.15.78:0/2666053192 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49800b5a0 con 0x7fb4a00c5810 2023-08-17T17:51:52.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4977fe700 1 -- 172.21.15.78:0/2666053192 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49800b700 con 0x7fb4a00c5810 2023-08-17T17:51:52.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4977fe700 1 -- 172.21.15.78:0/2666053192 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49800ba80 con 0x7fb4a00c5810 2023-08-17T17:51:52.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2666053192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 msgr2=0x7fb4a00c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:52.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a6f08700 1 --2- 172.21.15.78:0/2666053192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 0x7fb4a00c5c80 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fb4a00cade0 tx=0x7fb4980090f0).stop 2023-08-17T17:51:52.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2666053192 shutdown_connections 2023-08-17T17:51:52.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a6f08700 1 --2- 172.21.15.78:0/2666053192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 0x7fb4a00c5c80 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a6f08700 1 --2- 172.21.15.78:0/2666053192 >> v2:172.21.15.150:3300/0 conn(0x7fb4a00aa0f0 0x7fb4a00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2666053192 >> 172.21.15.78:0/2666053192 conn(0x7fb4a006a6a0 msgr2=0x7fb4a00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:52.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2666053192 shutdown_connections 2023-08-17T17:51:52.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.457+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2666053192 wait complete. 2023-08-17T17:51:52.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.458+0000 7fb4a6f08700 1 Processor -- start 2023-08-17T17:51:52.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.459+0000 7fb4a6f08700 1 -- start start 2023-08-17T17:51:52.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.459+0000 7fb4a6f08700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4a00aa0f0 0x7fb4a0152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.459+0000 7fb4a6f08700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4a00aa4d0 0x7fb4a00ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.459+0000 7fb4a6f08700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 0x7fb4a00acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.459+0000 7fb4a6f08700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a01589b0 con 0x7fb4a00c5810 2023-08-17T17:51:52.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.459+0000 7fb4a6f08700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00ad2b0 con 0x7fb4a00aa4d0 2023-08-17T17:51:52.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.459+0000 7fb4a6f08700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00c3d60 con 0x7fb4a00aa0f0 2023-08-17T17:51:52.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a54a5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 0x7fb4a00acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a54a5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 0x7fb4a00acdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35178/0 (socket says 172.21.15.78:35178) 2023-08-17T17:51:52.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a54a5700 1 -- 172.21.15.78:0/2282759914 learned_addr learned my addr 172.21.15.78:0/2282759914 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:52.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a4ca4700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4a00aa0f0 0x7fb4a0152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb497fff700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4a00aa4d0 0x7fb4a00ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a54a5700 1 -- 172.21.15.78:0/2282759914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4a00aa0f0 msgr2=0x7fb4a0152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:52.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a54a5700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4a00aa0f0 0x7fb4a0152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a54a5700 1 -- 172.21.15.78:0/2282759914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4a00aa4d0 msgr2=0x7fb4a00ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:52.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a54a5700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4a00aa4d0 0x7fb4a00ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a54a5700 1 -- 172.21.15.78:0/2282759914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb498009370 con 0x7fb4a00c5810 2023-08-17T17:51:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb497fff700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4a00aa4d0 0x7fb4a00ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a54a5700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 0x7fb4a00acdc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fb498006df0 tx=0x7fb498015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb494ff9700 1 -- 172.21.15.78:0/2282759914 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49801b410 con 0x7fb4a00c5810 2023-08-17T17:51:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb494ff9700 1 -- 172.21.15.78:0/2282759914 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49801b570 con 0x7fb4a00c5810 2023-08-17T17:51:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2282759914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a01586d0 con 0x7fb4a00c5810 2023-08-17T17:51:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb494ff9700 1 -- 172.21.15.78:0/2282759914 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49801b930 con 0x7fb4a00c5810 2023-08-17T17:51:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.460+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2282759914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a00c39f0 con 0x7fb4a00c5810 2023-08-17T17:51:52.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.461+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2282759914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a00c3540 con 0x7fb4a00c5810 2023-08-17T17:51:52.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.461+0000 7fb494ff9700 1 -- 172.21.15.78:0/2282759914 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb49802b070 con 0x7fb4a00c5810 2023-08-17T17:51:52.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.462+0000 7fb494ff9700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb48c05ed90 0x7fb48c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.462+0000 7fb494ff9700 1 -- 172.21.15.78:0/2282759914 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5785+0+0 (secure 0 0 0) 0x7fb49807b570 con 0x7fb4a00c5810 2023-08-17T17:51:52.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.462+0000 7fb4a4ca4700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb48c05ed90 0x7fb48c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.462+0000 7fb4a4ca4700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb48c05ed90 0x7fb48c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb49c00e650 tx=0x7fb49c007710).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:52.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.466+0000 7fb494ff9700 1 -- 172.21.15.78:0/2282759914 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb49804cc60 con 0x7fb4a00c5810 2023-08-17T17:51:52.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.630+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2282759914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb4a00c3ea0 con 0x7fb4a00c5810 2023-08-17T17:51:52.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.633+0000 7fb494ff9700 1 -- 172.21.15.78:0/2282759914 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb49801f0c0 con 0x7fb4a00c5810 2023-08-17T17:51:52.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2282759914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb48c05ed90 msgr2=0x7fb48c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:52.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb48c05ed90 0x7fb48c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb49c00e650 tx=0x7fb49c007710).stop 2023-08-17T17:51:52.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2282759914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 msgr2=0x7fb4a00acdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:52.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 0x7fb4a00acdc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fb498006df0 tx=0x7fb498015000).stop 2023-08-17T17:51:52.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2282759914 shutdown_connections 2023-08-17T17:51:52.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb48c05ed90 0x7fb48c061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a00c5810 0x7fb4a00acdc0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4a00aa0f0 0x7fb4a0152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 --2- 172.21.15.78:0/2282759914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4a00aa4d0 0x7fb4a00ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2282759914 >> 172.21.15.78:0/2282759914 conn(0x7fb4a006a6a0 msgr2=0x7fb4a00b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:52.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2282759914 shutdown_connections 2023-08-17T17:51:52.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.635+0000 7fb4a6f08700 1 -- 172.21.15.78:0/2282759914 wait complete. 2023-08-17T17:51:52.648 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:51:52.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:51:52.686 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:51:52.740 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:51:52.740 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T17:51:52.741 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:51:52.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.852+0000 7fc8c47f5700 1 Processor -- start 2023-08-17T17:51:52.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.852+0000 7fc8c47f5700 1 -- start start 2023-08-17T17:51:52.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.853+0000 7fc8c47f5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8bc154140 0x7fc8bc0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.853+0000 7fc8c47f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8bc0c1010 0x7fc8bc0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.853+0000 7fc8c47f5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc154520 con 0x7fc8bc0a7c40 2023-08-17T17:51:52.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.853+0000 7fc8c47f5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0c91e0 con 0x7fc8bc154140 2023-08-17T17:51:52.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.853+0000 7fc8c47f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0c94c0 con 0x7fc8bc0c1010 2023-08-17T17:51:52.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.853+0000 7fc8c2591700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8bc154140 0x7fc8bc0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.853+0000 7fc8c2591700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8bc154140 0x7fc8bc0c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35188/0 (socket says 172.21.15.78:35188) 2023-08-17T17:51:52.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.853+0000 7fc8c2591700 1 -- 172.21.15.78:0/4269262756 learned_addr learned my addr 172.21.15.78:0/4269262756 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:52.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.853+0000 7fc8c2d92700 1 --2- 172.21.15.78:0/4269262756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8bc0c1010 0x7fc8bc0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c2591700 1 -- 172.21.15.78:0/4269262756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8bc0c1010 msgr2=0x7fc8bc0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:52.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c2591700 1 --2- 172.21.15.78:0/4269262756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8bc0c1010 0x7fc8bc0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c2591700 1 -- 172.21.15.78:0/4269262756 >> v1:172.21.15.150:6789/0 conn(0x7fc8bc0a7c40 legacy=0x7fc8bc0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:52.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c2591700 1 -- 172.21.15.78:0/4269262756 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0c97a0 con 0x7fc8bc154140 2023-08-17T17:51:52.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c2591700 1 --2- 172.21.15.78:0/4269262756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 0x7fc8bc0c6ee0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7fc8b8009f20 tx=0x7fc8b8009840).ready entity=mon.0 client_cookie=e9acf0e40b460fbc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:52.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c158f700 1 -- 172.21.15.78:0/4269262756 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800e070 con 0x7fc8bc154140 2023-08-17T17:51:52.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c158f700 1 -- 172.21.15.78:0/4269262756 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b800ba40 con 0x7fc8bc154140 2023-08-17T17:51:52.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c158f700 1 -- 172.21.15.78:0/4269262756 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800bdc0 con 0x7fc8bc154140 2023-08-17T17:51:52.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c47f5700 1 -- 172.21.15.78:0/4269262756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 msgr2=0x7fc8bc0c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:52.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c47f5700 1 --2- 172.21.15.78:0/4269262756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 0x7fc8bc0c6ee0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7fc8b8009f20 tx=0x7fc8b8009840).stop 2023-08-17T17:51:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c47f5700 1 -- 172.21.15.78:0/4269262756 shutdown_connections 2023-08-17T17:51:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c47f5700 1 --2- 172.21.15.78:0/4269262756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8bc0c1010 0x7fc8bc0ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c47f5700 1 --2- 172.21.15.78:0/4269262756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 0x7fc8bc0c6ee0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c47f5700 1 -- 172.21.15.78:0/4269262756 >> 172.21.15.78:0/4269262756 conn(0x7fc8bc094510 msgr2=0x7fc8bc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c47f5700 1 -- 172.21.15.78:0/4269262756 shutdown_connections 2023-08-17T17:51:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.854+0000 7fc8c47f5700 1 -- 172.21.15.78:0/4269262756 wait complete. 2023-08-17T17:51:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.855+0000 7fc8c47f5700 1 Processor -- start 2023-08-17T17:51:52.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c47f5700 1 -- start start 2023-08-17T17:51:52.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c47f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8bc0a7c40 0x7fc8bc0abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c47f5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0c1010 0x7fc8bc0ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c47f5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 0x7fc8bc0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c47f5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc13d3e0 con 0x7fc8bc154140 2023-08-17T17:51:52.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c47f5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0ad7f0 con 0x7fc8bc0c1010 2023-08-17T17:51:52.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c47f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0acbe0 con 0x7fc8bc0a7c40 2023-08-17T17:51:52.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c2d92700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 0x7fc8bc0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c2d92700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 0x7fc8bc0aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35196/0 (socket says 172.21.15.78:35196) 2023-08-17T17:51:52.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c2d92700 1 -- 172.21.15.78:0/462507117 learned_addr learned my addr 172.21.15.78:0/462507117 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:52.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.856+0000 7fc8c2591700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8bc0a7c40 0x7fc8bc0abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8c1d90700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0c1010 0x7fc8bc0ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8c2d92700 1 -- 172.21.15.78:0/462507117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8bc0a7c40 msgr2=0x7fc8bc0abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:52.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8c2d92700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8bc0a7c40 0x7fc8bc0abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8c2d92700 1 -- 172.21.15.78:0/462507117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0c1010 msgr2=0x7fc8bc0ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:52.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8c2d92700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0c1010 0x7fc8bc0ac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:52.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8c2d92700 1 -- 172.21.15.78:0/462507117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8009ae0 con 0x7fc8bc154140 2023-08-17T17:51:52.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8c1d90700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0c1010 0x7fc8bc0ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:52.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8c2d92700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 0x7fc8bc0aefc0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fc8b400d5b0 tx=0x7fc8b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:52.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8b27fc700 1 -- 172.21.15.78:0/462507117 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4011590 con 0x7fc8bc154140 2023-08-17T17:51:52.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8b27fc700 1 -- 172.21.15.78:0/462507117 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b40116f0 con 0x7fc8bc154140 2023-08-17T17:51:52.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8c47f5700 1 -- 172.21.15.78:0/462507117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc0acec0 con 0x7fc8bc154140 2023-08-17T17:51:52.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8b27fc700 1 -- 172.21.15.78:0/462507117 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4011a70 con 0x7fc8bc154140 2023-08-17T17:51:52.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.857+0000 7fc8c47f5700 1 -- 172.21.15.78:0/462507117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc0ad480 con 0x7fc8bc154140 2023-08-17T17:51:52.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.858+0000 7fc8c47f5700 1 -- 172.21.15.78:0/462507117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc0ad980 con 0x7fc8bc154140 2023-08-17T17:51:52.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.858+0000 7fc8b27fc700 1 -- 172.21.15.78:0/462507117 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc8b4012420 con 0x7fc8bc154140 2023-08-17T17:51:52.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.859+0000 7fc8b27fc700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc8a005ed60 0x7fc8a0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:52.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.859+0000 7fc8c2591700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc8a005ed60 0x7fc8a0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:52.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.859+0000 7fc8b27fc700 1 -- 172.21.15.78:0/462507117 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5785+0+0 (secure 0 0 0) 0x7fc8b4079460 con 0x7fc8bc154140 2023-08-17T17:51:52.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.859+0000 7fc8c2591700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc8a005ed60 0x7fc8a0061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc8b800c010 tx=0x7fc8b8009840).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:52.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:52.863+0000 7fc8b27fc700 1 -- 172.21.15.78:0/462507117 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc8b404aaf0 con 0x7fc8bc154140 2023-08-17T17:51:53.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.066+0000 7fc8c47f5700 1 -- 172.21.15.78:0/462507117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8bc047350 con 0x7fc8bc154140 2023-08-17T17:51:53.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.066+0000 7fc8b27fc700 1 -- 172.21.15.78:0/462507117 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fc8b404e110 con 0x7fc8bc154140 2023-08-17T17:51:53.068 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:53.068 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2389298534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2389298534},{"type":"v1","addr":"172.21.15.150:6833","nonce":2389298534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2314598053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2314598053},{"type":"v1","addr":"172.21.15.150:6835","nonce":2314598053}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/687308464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":687308464},{"type":"v1","addr":"172.21.15.78:6836","nonce":687308464}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7533,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2432679809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2432679809},{"type":"v1","addr":"172.21.15.78:6837","nonce":2432679809}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[]} 2023-08-17T17:51:53.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 -- 172.21.15.78:0/462507117 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc8a005ed60 msgr2=0x7fc8a0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:53.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc8a005ed60 0x7fc8a0061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc8b800c010 tx=0x7fc8b8009840).stop 2023-08-17T17:51:53.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 -- 172.21.15.78:0/462507117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 msgr2=0x7fc8bc0aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:53.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 0x7fc8bc0aefc0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fc8b400d5b0 tx=0x7fc8b4008040).stop 2023-08-17T17:51:53.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 -- 172.21.15.78:0/462507117 shutdown_connections 2023-08-17T17:51:53.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc8a005ed60 0x7fc8a0061220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:53.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154140 0x7fc8bc0aefc0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:53.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8bc0a7c40 0x7fc8bc0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:53.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 --2- 172.21.15.78:0/462507117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8bc0c1010 0x7fc8bc0ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:53.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 -- 172.21.15.78:0/462507117 >> 172.21.15.78:0/462507117 conn(0x7fc8bc094510 msgr2=0x7fc8bc0aa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:53.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 -- 172.21.15.78:0/462507117 shutdown_connections 2023-08-17T17:51:53.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.068+0000 7fc8c47f5700 1 -- 172.21.15.78:0/462507117 wait complete. 2023-08-17T17:51:53.071 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 39 2023-08-17T17:51:53.081 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T17:51:53.082 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T17:51:53.082 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T17:51:53.082 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:51:53.082 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T17:51:53.083 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T17:51:53.083 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T17:51:53.083 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:51:53.083 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T17:51:53.083 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T17:51:53.084 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T17:51:53.084 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:51:53.084 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T17:51:53.084 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T17:51:53.085 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T17:51:53.085 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:51:53.090 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T17:51:53.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T17:51:53.092 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T17:51:53.092 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T17:51:53.095 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T17:51:53.095 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T17:51:53.096 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T17:51:53.096 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T17:51:53.134 INFO:tasks.ceph.mds.a:Started 2023-08-17T17:51:53.134 DEBUG:teuthology.parallel:result is None 2023-08-17T17:51:53.135 INFO:tasks.ceph.mds.c:Started 2023-08-17T17:51:53.135 DEBUG:teuthology.parallel:result is None 2023-08-17T17:51:53.137 INFO:tasks.ceph.mds.b:Started 2023-08-17T17:51:53.137 DEBUG:teuthology.parallel:result is None 2023-08-17T17:51:53.138 INFO:tasks.ceph.mds.d:Started 2023-08-17T17:51:53.138 DEBUG:teuthology.parallel:result is None 2023-08-17T17:51:53.139 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T17:51:53.206 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:51:53.207 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T17:51:53.219 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T17:51:53.220 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:51:53.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.261+0000 7fd8ebf04700 1 Processor -- start 2023-08-17T17:51:53.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.261+0000 7fd8ebf04700 1 -- start start 2023-08-17T17:51:53.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8ebf04700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e41541a0 0x7fd8e40a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:53.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8ebf04700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8e40c0560 0x7fd8e40c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:53.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8ebf04700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e40c8df0 con 0x7fd8e4154580 2023-08-17T17:51:53.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8ebf04700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40a8190 con 0x7fd8e40c0560 2023-08-17T17:51:53.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8ebf04700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40c9970 con 0x7fd8e41541a0 2023-08-17T17:51:53.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e949f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd8e4154580 0x7fd8e40bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41552/0 (socket says 172.21.15.78:41552) 2023-08-17T17:51:53.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e949f700 1 -- 172.21.15.78:0/2137671224 learned_addr learned my addr 172.21.15.78:0/2137671224 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:53.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8ea4a1700 1 --2- 172.21.15.78:0/2137671224 >> v2:172.21.15.150:3300/0 conn(0x7fd8e40c0560 0x7fd8e40c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:53.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e9ca0700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e41541a0 0x7fd8e40a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:53.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853197324 0 0) 0x7fd8e40c8df0 con 0x7fd8e4154580 2023-08-17T17:51:53.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8cc0033f0 con 0x7fd8e4154580 2023-08-17T17:51:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2067578724 0 0) 0x7fd8cc0033f0 con 0x7fd8e4154580 2023-08-17T17:51:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e41541a0 msgr2=0x7fd8e40a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e41541a0 0x7fd8e40a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 >> v2:172.21.15.150:3300/0 conn(0x7fd8e40c0560 msgr2=0x7fd8e40c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 --2- 172.21.15.78:0/2137671224 >> v2:172.21.15.150:3300/0 conn(0x7fd8e40c0560 0x7fd8e40c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40c9040 con 0x7fd8e4154580 2023-08-17T17:51:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fd8d8001470 con 0x7fd8e4154580 2023-08-17T17:51:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e9ca0700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e41541a0 0x7fd8e40a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:51:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 >> v1:172.21.15.78:6789/0 conn(0x7fd8e4154580 legacy=0x7fd8e40bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8cc0038e0 0x7fd8cc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.262+0000 7fd8e8c9e700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 0x7fd8cc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e8c9e700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e41541a0 0x7fd8cc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40a8190 con 0x7fd8cc004690 2023-08-17T17:51:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40c9970 con 0x7fd8cc0038e0 2023-08-17T17:51:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc00b8e0 con 0x7fd8e41541a0 2023-08-17T17:51:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8ea4a1700 1 --2- 172.21.15.78:0/2137671224 >> v2:172.21.15.150:3300/0 conn(0x7fd8e40c0560 0x7fd8e40c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:51:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e949f700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 0x7fd8cc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e9ca0700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8cc0038e0 0x7fd8cc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8ea4a1700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e41541a0 0x7fd8cc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e949f700 1 -- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e41541a0 msgr2=0x7fd8cc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e949f700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e41541a0 0x7fd8cc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e949f700 1 -- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8cc0038e0 msgr2=0x7fd8cc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e949f700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8cc0038e0 0x7fd8cc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e949f700 1 -- 172.21.15.78:0/2137671224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc009a20 con 0x7fd8cc004690 2023-08-17T17:51:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8ea4a1700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e41541a0 0x7fd8cc005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e949f700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 0x7fd8cc004b10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fd8e40c8cf0 tx=0x7fd8d80077c0).ready entity=mon.0 client_cookie=7d4da7daf55aa76 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800cab0 con 0x7fd8cc004690 2023-08-17T17:51:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d800cc10 con 0x7fd8cc004690 2023-08-17T17:51:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.263+0000 7fd8e8c9e700 1 -- 172.21.15.78:0/2137671224 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80070d0 con 0x7fd8cc004690 2023-08-17T17:51:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.264+0000 7fd8ebf04700 1 -- 172.21.15.78:0/2137671224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 msgr2=0x7fd8cc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.264+0000 7fd8ebf04700 1 --2- 172.21.15.78:0/2137671224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 0x7fd8cc004b10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fd8e40c8cf0 tx=0x7fd8d80077c0).stop 2023-08-17T17:51:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.264+0000 7fd8ea4a1700 1 -- 172.21.15.78:0/2137671224 reap_dead start 2023-08-17T17:51:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.264+0000 7fd8ebf04700 1 -- 172.21.15.78:0/2137671224 shutdown_connections 2023-08-17T17:51:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.264+0000 7fd8ebf04700 1 -- 172.21.15.78:0/2137671224 >> 172.21.15.78:0/2137671224 conn(0x7fd8e406a400 msgr2=0x7fd8e40caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.264+0000 7fd8ebf04700 1 -- 172.21.15.78:0/2137671224 shutdown_connections 2023-08-17T17:51:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.264+0000 7fd8ebf04700 1 -- 172.21.15.78:0/2137671224 wait complete. 2023-08-17T17:51:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.265+0000 7fd8ebf04700 1 Processor -- start 2023-08-17T17:51:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.265+0000 7fd8ebf04700 1 -- start start 2023-08-17T17:51:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8ebf04700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 0x7fd8e40ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8ebf04700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e4159e60 0x7fd8e415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8ebf04700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e40b0000 0x7fd8e40b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8ebf04700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e41677c0 con 0x7fd8cc004690 2023-08-17T17:51:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8ebf04700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e4168020 con 0x7fd8e4159e60 2023-08-17T17:51:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8ebf04700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e415a7d0 con 0x7fd8e40b0000 2023-08-17T17:51:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e9ca0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 0x7fd8e40ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e9ca0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 0x7fd8e40ae590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35258/0 (socket says 172.21.15.78:35258) 2023-08-17T17:51:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e9ca0700 1 -- 172.21.15.78:0/862252970 learned_addr learned my addr 172.21.15.78:0/862252970 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8ea4a1700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e40b0000 0x7fd8e40b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e949f700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e4159e60 0x7fd8e415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e9ca0700 1 -- 172.21.15.78:0/862252970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e40b0000 msgr2=0x7fd8e40b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e9ca0700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e40b0000 0x7fd8e40b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e9ca0700 1 -- 172.21.15.78:0/862252970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e4159e60 msgr2=0x7fd8e415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e9ca0700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e4159e60 0x7fd8e415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e9ca0700 1 -- 172.21.15.78:0/862252970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40b0df0 con 0x7fd8cc004690 2023-08-17T17:51:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e9ca0700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 0x7fd8e40ae590 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7fd8dc00f340 tx=0x7fd8dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e1ffb700 1 -- 172.21.15.78:0/862252970 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc00e040 con 0x7fd8cc004690 2023-08-17T17:51:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e1ffb700 1 -- 172.21.15.78:0/862252970 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc00f040 con 0x7fd8cc004690 2023-08-17T17:51:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8ebf04700 1 -- 172.21.15.78:0/862252970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e41679d0 con 0x7fd8cc004690 2023-08-17T17:51:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8e1ffb700 1 -- 172.21.15.78:0/862252970 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc015660 con 0x7fd8cc004690 2023-08-17T17:51:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.266+0000 7fd8ebf04700 1 -- 172.21.15.78:0/862252970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e40aea80 con 0x7fd8cc004690 2023-08-17T17:51:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.267+0000 7fd8ebf04700 1 -- 172.21.15.78:0/862252970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e4047350 con 0x7fd8cc004690 2023-08-17T17:51:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.268+0000 7fd8e1ffb700 1 -- 172.21.15.78:0/862252970 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd8dc015a10 con 0x7fd8cc004690 2023-08-17T17:51:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.268+0000 7fd8e1ffb700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8d005ed90 0x7fd8d0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.268+0000 7fd8e1ffb700 1 -- 172.21.15.78:0/862252970 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5785+0+0 (secure 0 0 0) 0x7fd8dc07aa60 con 0x7fd8cc004690 2023-08-17T17:51:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.268+0000 7fd8e949f700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8d005ed90 0x7fd8d0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.268+0000 7fd8e949f700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8d005ed90 0x7fd8d0061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd8e40c8cf0 tx=0x7fd8d8015000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.272+0000 7fd8e1ffb700 1 -- 172.21.15.78:0/862252970 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd8dc04c0f0 con 0x7fd8cc004690 2023-08-17T17:51:53.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:53.449+0000 7fd8ebf04700 1 -- 172.21.15.78:0/862252970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd8e40c9320 con 0x7fd8cc004690 2023-08-17T17:51:54.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.333+0000 7fd8e1ffb700 1 -- 172.21.15.78:0/862252970 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v117) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd8dc04f710 con 0x7fd8cc004690 2023-08-17T17:51:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.335+0000 7fd8ebf04700 1 -- 172.21.15.78:0/862252970 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8d005ed90 msgr2=0x7fd8d0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.335+0000 7fd8ebf04700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8d005ed90 0x7fd8d0061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd8e40c8cf0 tx=0x7fd8d8015000).stop 2023-08-17T17:51:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.335+0000 7fd8ebf04700 1 -- 172.21.15.78:0/862252970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 msgr2=0x7fd8e40ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.335+0000 7fd8ebf04700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 0x7fd8e40ae590 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7fd8dc00f340 tx=0x7fd8dc00b040).stop 2023-08-17T17:51:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.335+0000 7fd8ebf04700 1 -- 172.21.15.78:0/862252970 shutdown_connections 2023-08-17T17:51:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.335+0000 7fd8ebf04700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8d005ed90 0x7fd8d0061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.335+0000 7fd8ebf04700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e40b0000 0x7fd8e40b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.335+0000 7fd8ebf04700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8cc004690 0x7fd8e40ae590 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.335+0000 7fd8ebf04700 1 --2- 172.21.15.78:0/862252970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e4159e60 0x7fd8e415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.335+0000 7fd8ebf04700 1 -- 172.21.15.78:0/862252970 >> 172.21.15.78:0/862252970 conn(0x7fd8e406a400 msgr2=0x7fd8e4063440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.336+0000 7fd8ebf04700 1 -- 172.21.15.78:0/862252970 shutdown_connections 2023-08-17T17:51:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.336+0000 7fd8ebf04700 1 -- 172.21.15.78:0/862252970 wait complete. 2023-08-17T17:51:54.339 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-08-17T17:51:54.350 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T17:51:54.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.463+0000 7f12cf4fc700 1 Processor -- start 2023-08-17T17:51:54.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.463+0000 7f12cf4fc700 1 -- start start 2023-08-17T17:51:54.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.464+0000 7f12cf4fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 0x7f12c8069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.464+0000 7f12cf4fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12c80c1f10 0x7f12c8067f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.464+0000 7f12cf4fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f12c8068430 0x7f12c80644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.464+0000 7f12cf4fc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c8069480 con 0x7f12c80c1f10 2023-08-17T17:51:54.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.464+0000 7f12cf4fc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c80a65a0 con 0x7f12c8068430 2023-08-17T17:51:54.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.464+0000 7f12cf4fc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c80c2d20 con 0x7f12c81553c0 2023-08-17T17:51:54.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.464+0000 7f12cca97700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12c80c1f10 0x7f12c8067f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cca97700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12c80c1f10 0x7f12c8067f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35270/0 (socket says 172.21.15.78:35270) 2023-08-17T17:51:54.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cca97700 1 -- 172.21.15.78:0/2434184854 learned_addr learned my addr 172.21.15.78:0/2434184854 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:54.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cd298700 1 --2- 172.21.15.78:0/2434184854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 0x7f12c8069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cda99700 1 --2- 172.21.15.78:0/2434184854 >> v2:172.21.15.150:3300/0 conn(0x7f12c8068430 0x7f12c80644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cca97700 1 -- 172.21.15.78:0/2434184854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 msgr2=0x7f12c8069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:54.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cca97700 1 --2- 172.21.15.78:0/2434184854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 0x7f12c8069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cca97700 1 -- 172.21.15.78:0/2434184854 >> v2:172.21.15.150:3300/0 conn(0x7f12c8068430 msgr2=0x7f12c80644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:54.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cca97700 1 --2- 172.21.15.78:0/2434184854 >> v2:172.21.15.150:3300/0 conn(0x7f12c8068430 0x7f12c80644d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cca97700 1 -- 172.21.15.78:0/2434184854 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8064040 con 0x7f12c80c1f10 2023-08-17T17:51:54.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cd298700 1 --2- 172.21.15.78:0/2434184854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 0x7f12c8069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:54.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cda99700 1 --2- 172.21.15.78:0/2434184854 >> v2:172.21.15.150:3300/0 conn(0x7f12c8068430 0x7f12c80644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:54.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cca97700 1 --2- 172.21.15.78:0/2434184854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c80c1f10 0x7f12c8067f40 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f12c80c1430 tx=0x7f12b80090f0).ready entity=mon.0 client_cookie=ab86d749952794e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:54.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12bffff700 1 -- 172.21.15.78:0/2434184854 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800b600 con 0x7f12c80c1f10 2023-08-17T17:51:54.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12bffff700 1 -- 172.21.15.78:0/2434184854 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b800b760 con 0x7f12c80c1f10 2023-08-17T17:51:54.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12bffff700 1 -- 172.21.15.78:0/2434184854 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800bae0 con 0x7f12c80c1f10 2023-08-17T17:51:54.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cf4fc700 1 -- 172.21.15.78:0/2434184854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c80c1f10 msgr2=0x7f12c8067f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.465+0000 7f12cf4fc700 1 --2- 172.21.15.78:0/2434184854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c80c1f10 0x7f12c8067f40 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f12c80c1430 tx=0x7f12b80090f0).stop 2023-08-17T17:51:54.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.466+0000 7f12cf4fc700 1 -- 172.21.15.78:0/2434184854 shutdown_connections 2023-08-17T17:51:54.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.466+0000 7f12cf4fc700 1 --2- 172.21.15.78:0/2434184854 >> v2:172.21.15.150:3300/0 conn(0x7f12c8068430 0x7f12c80644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.466+0000 7f12cf4fc700 1 --2- 172.21.15.78:0/2434184854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 0x7f12c8069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.466+0000 7f12cf4fc700 1 --2- 172.21.15.78:0/2434184854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c80c1f10 0x7f12c8067f40 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.466+0000 7f12cf4fc700 1 -- 172.21.15.78:0/2434184854 >> 172.21.15.78:0/2434184854 conn(0x7f12c8062fc0 msgr2=0x7f12c80c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:54.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.466+0000 7f12cf4fc700 1 -- 172.21.15.78:0/2434184854 shutdown_connections 2023-08-17T17:51:54.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.466+0000 7f12cf4fc700 1 -- 172.21.15.78:0/2434184854 wait complete. 2023-08-17T17:51:54.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.467+0000 7f12cf4fc700 1 Processor -- start 2023-08-17T17:51:54.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.467+0000 7f12cf4fc700 1 -- start start 2023-08-17T17:51:54.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cf4fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c8068430 0x7f12c81385b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cf4fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12c80c1f10 0x7f12c81569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cf4fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 0x7f12c8156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cf4fc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c8150e10 con 0x7f12c8068430 2023-08-17T17:51:54.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cf4fc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c81573b0 con 0x7f12c80c1f10 2023-08-17T17:51:54.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cf4fc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c8150190 con 0x7f12c81553c0 2023-08-17T17:51:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cd298700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c8068430 0x7f12c81385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cd298700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c8068430 0x7f12c81385b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35278/0 (socket says 172.21.15.78:35278) 2023-08-17T17:51:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cd298700 1 -- 172.21.15.78:0/1759908054 learned_addr learned my addr 172.21.15.78:0/1759908054 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cca97700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12c80c1f10 0x7f12c81569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cda99700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 0x7f12c8156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cd298700 1 -- 172.21.15.78:0/1759908054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 msgr2=0x7f12c8156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cd298700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 0x7f12c8156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cd298700 1 -- 172.21.15.78:0/1759908054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12c80c1f10 msgr2=0x7f12c81569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cd298700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12c80c1f10 0x7f12c81569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cd298700 1 -- 172.21.15.78:0/1759908054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8009370 con 0x7f12c8068430 2023-08-17T17:51:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cca97700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12c80c1f10 0x7f12c81569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cda99700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 0x7f12c8156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cd298700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c8068430 0x7f12c81385b0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f12c400c880 tx=0x7f12c4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12bd7fa700 1 -- 172.21.15.78:0/1759908054 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4010580 con 0x7f12c8068430 2023-08-17T17:51:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12bd7fa700 1 -- 172.21.15.78:0/1759908054 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c40106e0 con 0x7f12c8068430 2023-08-17T17:51:54.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cf4fc700 1 -- 172.21.15.78:0/1759908054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c8150470 con 0x7f12c8068430 2023-08-17T17:51:54.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12bd7fa700 1 -- 172.21.15.78:0/1759908054 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4010a60 con 0x7f12c8068430 2023-08-17T17:51:54.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.468+0000 7f12cf4fc700 1 -- 172.21.15.78:0/1759908054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c8150a30 con 0x7f12c8068430 2023-08-17T17:51:54.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.469+0000 7f12cf4fc700 1 -- 172.21.15.78:0/1759908054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c8150f50 con 0x7f12c8068430 2023-08-17T17:51:54.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.470+0000 7f12bd7fa700 1 -- 172.21.15.78:0/1759908054 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f12c401b460 con 0x7f12c8068430 2023-08-17T17:51:54.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.470+0000 7f12bd7fa700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f12ac05ed90 0x7f12ac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.470+0000 7f12bd7fa700 1 -- 172.21.15.78:0/1759908054 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f12c40799e0 con 0x7f12c8068430 2023-08-17T17:51:54.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.470+0000 7f12cca97700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f12ac05ed90 0x7f12ac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.470+0000 7f12cca97700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f12ac05ed90 0x7f12ac061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f12c80c1430 tx=0x7f12b8017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:54.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.474+0000 7f12bd7fa700 1 -- 172.21.15.78:0/1759908054 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12c8150f50 con 0x7f12c8068430 2023-08-17T17:51:54.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.701+0000 7f12cf4fc700 1 -- 172.21.15.78:0/1759908054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f12c8150f50 con 0x7f12c8068430 2023-08-17T17:51:54.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.702+0000 7f12bd7fa700 1 -- 172.21.15.78:0/1759908054 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f12c8150f50 con 0x7f12c8068430 2023-08-17T17:51:54.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:54.703 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:51:54.703 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-08-17T17:51:54.704 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.704 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-08-17T17:51:54.704 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA==", 2023-08-17T17:51:54.704 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.704 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:51:54.705 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:51:54.705 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:51:54.705 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.705 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.705 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.705 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.705 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-08-17T17:51:54.706 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g==", 2023-08-17T17:51:54.706 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.706 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:51:54.706 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:51:54.706 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:51:54.706 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.706 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.707 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.707 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.707 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-08-17T17:51:54.707 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw==", 2023-08-17T17:51:54.707 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.707 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:51:54.707 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:51:54.708 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:51:54.708 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.708 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.708 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.708 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.708 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-08-17T17:51:54.708 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg==", 2023-08-17T17:51:54.709 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.709 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:51:54.709 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:51:54.709 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:51:54.709 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.709 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.709 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.709 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.710 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-08-17T17:51:54.710 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg==", 2023-08-17T17:51:54.710 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.710 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:51:54.710 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:51:54.710 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.710 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.710 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.711 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.711 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-08-17T17:51:54.711 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw==", 2023-08-17T17:51:54.711 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.711 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:51:54.711 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:51:54.711 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.712 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.712 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.712 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.712 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-08-17T17:51:54.712 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA==", 2023-08-17T17:51:54.712 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.712 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:51:54.712 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:51:54.713 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.713 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.713 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.713 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.713 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-08-17T17:51:54.713 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ==", 2023-08-17T17:51:54.713 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.714 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:51:54.714 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:51:54.714 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.714 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.714 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.714 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.714 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-08-17T17:51:54.714 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA==", 2023-08-17T17:51:54.715 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.715 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:51:54.715 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:51:54.715 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.715 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.715 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.716 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.716 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-08-17T17:51:54.716 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q==", 2023-08-17T17:51:54.716 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.716 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:51:54.716 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:51:54.717 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.717 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.717 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.717 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.717 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-08-17T17:51:54.717 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw==", 2023-08-17T17:51:54.717 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.718 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:51:54.718 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:51:54.718 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.718 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.718 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.718 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.718 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-08-17T17:51:54.718 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg==", 2023-08-17T17:51:54.719 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.719 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:51:54.719 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:51:54.719 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.719 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.719 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.719 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.719 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-08-17T17:51:54.720 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA==", 2023-08-17T17:51:54.720 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.720 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:51:54.720 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-08-17T17:51:54.720 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T17:51:54.720 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.720 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.720 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.721 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-08-17T17:51:54.721 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ==", 2023-08-17T17:51:54.721 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.721 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:51:54.721 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:51:54.721 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:51:54.722 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:51:54.722 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.722 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.722 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.722 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-08-17T17:51:54.722 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ==", 2023-08-17T17:51:54.723 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.723 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:51:54.723 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:51:54.723 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:51:54.723 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:51:54.723 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.723 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.724 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.724 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-08-17T17:51:54.724 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw==", 2023-08-17T17:51:54.724 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.724 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:51:54.724 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:51:54.724 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:51:54.725 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:51:54.725 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.725 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.725 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.725 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-08-17T17:51:54.726 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k6n2yGhAAldYlBQaNGCgXL0HA2ePHVg==", 2023-08-17T17:51:54.726 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.726 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:51:54.726 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:51:54.726 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:51:54.726 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.726 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.726 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.727 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.727 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-08-17T17:51:54.727 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg==", 2023-08-17T17:51:54.727 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.727 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:51:54.727 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:51:54.727 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.728 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.728 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:54.728 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:54.728 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-08-17T17:51:54.728 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA==", 2023-08-17T17:51:54.728 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:51:54.728 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:51:54.728 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:51:54.729 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:51:54.729 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.729 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:54.729 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-08-17T17:51:54.729 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:51:54.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.703+0000 7f12cf4fc700 1 -- 172.21.15.78:0/1759908054 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f12ac05ed90 msgr2=0x7f12ac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.703+0000 7f12cf4fc700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f12ac05ed90 0x7f12ac061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f12c80c1430 tx=0x7f12b8017000).stop 2023-08-17T17:51:54.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.703+0000 7f12cf4fc700 1 -- 172.21.15.78:0/1759908054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c8068430 msgr2=0x7f12c81385b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.703+0000 7f12cf4fc700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c8068430 0x7f12c81385b0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f12c400c880 tx=0x7f12c4008040).stop 2023-08-17T17:51:54.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.704+0000 7f12cf4fc700 1 -- 172.21.15.78:0/1759908054 shutdown_connections 2023-08-17T17:51:54.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.704+0000 7f12cf4fc700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f12ac05ed90 0x7f12ac061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.704+0000 7f12cf4fc700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12c81553c0 0x7f12c8156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.704+0000 7f12cf4fc700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12c8068430 0x7f12c81385b0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.704+0000 7f12cf4fc700 1 --2- 172.21.15.78:0/1759908054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12c80c1f10 0x7f12c81569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.704+0000 7f12cf4fc700 1 -- 172.21.15.78:0/1759908054 >> 172.21.15.78:0/1759908054 conn(0x7f12c8062fc0 msgr2=0x7f12c80a7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:54.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.704+0000 7f12cf4fc700 1 -- 172.21.15.78:0/1759908054 shutdown_connections 2023-08-17T17:51:54.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.704+0000 7f12cf4fc700 1 -- 172.21.15.78:0/1759908054 wait complete. 2023-08-17T17:51:54.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:51:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.844+0000 7f98dbc3f700 1 Processor -- start 2023-08-17T17:51:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.844+0000 7f98dbc3f700 1 -- start start 2023-08-17T17:51:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98dbc3f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98d4154140 0x7f98d40c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98dbc3f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d40a7c40 0x7f98d40c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98dbc3f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d4154520 con 0x7f98d40a8080 2023-08-17T17:51:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98dbc3f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d40c91e0 con 0x7f98d4154140 2023-08-17T17:51:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98dbc3f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40c94c0 con 0x7f98d40a7c40 2023-08-17T17:51:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98d99db700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98d4154140 0x7f98d40c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98da1dc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f98d40a8080 0x7f98d40ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41568/0 (socket says 172.21.15.78:41568) 2023-08-17T17:51:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98da1dc700 1 -- 172.21.15.78:0/755935684 learned_addr learned my addr 172.21.15.78:0/755935684 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98d91da700 1 --2- 172.21.15.78:0/755935684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d40a7c40 0x7f98d40c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98d99db700 1 -- 172.21.15.78:0/755935684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d40a7c40 msgr2=0x7f98d40c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98d99db700 1 --2- 172.21.15.78:0/755935684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d40a7c40 0x7f98d40c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98d99db700 1 -- 172.21.15.78:0/755935684 >> v1:172.21.15.78:6789/0 conn(0x7f98d40a8080 legacy=0x7f98d40ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98d99db700 1 -- 172.21.15.78:0/755935684 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d40c97a0 con 0x7f98d4154140 2023-08-17T17:51:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98d89d9700 1 -- 172.21.15.78:0/755935684 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099989525 0 0) 0x7f98d4154520 con 0x7f98d40a8080 2023-08-17T17:51:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.845+0000 7f98d91da700 1 --2- 172.21.15.78:0/755935684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d40a7c40 0x7f98d40c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98d99db700 1 --2- 172.21.15.78:0/755935684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d4154140 0x7f98d40c6ee0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f98d0009e60 tx=0x7f98d0009780).ready entity=mon.0 client_cookie=bc64e2ec154b6c4d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98d89d9700 1 -- 172.21.15.78:0/755935684 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000e070 con 0x7f98d4154140 2023-08-17T17:51:54.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98d89d9700 1 -- 172.21.15.78:0/755935684 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d000bc30 con 0x7f98d4154140 2023-08-17T17:51:54.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98d89d9700 1 -- 172.21.15.78:0/755935684 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0012410 con 0x7f98d4154140 2023-08-17T17:51:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98dbc3f700 1 -- 172.21.15.78:0/755935684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d4154140 msgr2=0x7f98d40c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98dbc3f700 1 --2- 172.21.15.78:0/755935684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d4154140 0x7f98d40c6ee0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f98d0009e60 tx=0x7f98d0009780).stop 2023-08-17T17:51:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98dbc3f700 1 -- 172.21.15.78:0/755935684 shutdown_connections 2023-08-17T17:51:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98dbc3f700 1 --2- 172.21.15.78:0/755935684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d4154140 0x7f98d40c6ee0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98dbc3f700 1 --2- 172.21.15.78:0/755935684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d40a7c40 0x7f98d40c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98dbc3f700 1 -- 172.21.15.78:0/755935684 >> 172.21.15.78:0/755935684 conn(0x7f98d4094510 msgr2=0x7f98d406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98dbc3f700 1 -- 172.21.15.78:0/755935684 shutdown_connections 2023-08-17T17:51:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.846+0000 7f98dbc3f700 1 -- 172.21.15.78:0/755935684 wait complete. 2023-08-17T17:51:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.847+0000 7f98dbc3f700 1 Processor -- start 2023-08-17T17:51:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98dbc3f700 1 -- start start 2023-08-17T17:51:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98dbc3f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d40a7c40 0x7f98d413d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98dbc3f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d40a8080 0x7f98d4152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98dbc3f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d4154140 0x7f98d4152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98dbc3f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40c2cd0 con 0x7f98d40a7c40 2023-08-17T17:51:54.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98dbc3f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d413d6a0 con 0x7f98d40a8080 2023-08-17T17:51:54.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98dbc3f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40c20c0 con 0x7f98d4154140 2023-08-17T17:51:54.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98d99db700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d40a7c40 0x7f98d413d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98d99db700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d40a7c40 0x7f98d413d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35298/0 (socket says 172.21.15.78:35298) 2023-08-17T17:51:54.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98d99db700 1 -- 172.21.15.78:0/1098415558 learned_addr learned my addr 172.21.15.78:0/1098415558 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:54.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98da1dc700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d4154140 0x7f98d4152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.848+0000 7f98d91da700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d40a8080 0x7f98d4152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98d99db700 1 -- 172.21.15.78:0/1098415558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d4154140 msgr2=0x7f98d4152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98d99db700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d4154140 0x7f98d4152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98d99db700 1 -- 172.21.15.78:0/1098415558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d40a8080 msgr2=0x7f98d4152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:54.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98d99db700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d40a8080 0x7f98d4152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98d99db700 1 -- 172.21.15.78:0/1098415558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d0009a20 con 0x7f98d40a7c40 2023-08-17T17:51:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98d99db700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d40a7c40 0x7f98d413d1b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f98d000b6c0 tx=0x7f98d0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98c9ffb700 1 -- 172.21.15.78:0/1098415558 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0001010 con 0x7f98d40a7c40 2023-08-17T17:51:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98c9ffb700 1 -- 172.21.15.78:0/1098415558 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d001d630 con 0x7f98d40a7c40 2023-08-17T17:51:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98c9ffb700 1 -- 172.21.15.78:0/1098415558 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d001d9d0 con 0x7f98d40a7c40 2023-08-17T17:51:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98dbc3f700 1 -- 172.21.15.78:0/1098415558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d40c23a0 con 0x7f98d40a7c40 2023-08-17T17:51:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.849+0000 7f98dbc3f700 1 -- 172.21.15.78:0/1098415558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d40c2960 con 0x7f98d40a7c40 2023-08-17T17:51:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.850+0000 7f98dbc3f700 1 -- 172.21.15.78:0/1098415558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d4047350 con 0x7f98d40a7c40 2023-08-17T17:51:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.850+0000 7f98c9ffb700 1 -- 172.21.15.78:0/1098415558 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f98d0026410 con 0x7f98d40a7c40 2023-08-17T17:51:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.851+0000 7f98c9ffb700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98b805ed90 0x7f98b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.851+0000 7f98c9ffb700 1 -- 172.21.15.78:0/1098415558 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f98d007b8d0 con 0x7f98d40a7c40 2023-08-17T17:51:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.851+0000 7f98d91da700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98b805ed90 0x7f98b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.851+0000 7f98d91da700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98b805ed90 0x7f98b8061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f98d40aa910 tx=0x7f98c4008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:54.855+0000 7f98c9ffb700 1 -- 172.21.15.78:0/1098415558 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f98d004d160 con 0x7f98d40a7c40 2023-08-17T17:51:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.019+0000 7f98dbc3f700 1 -- 172.21.15.78:0/1098415558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98d40cad50 con 0x7f98d40a7c40 2023-08-17T17:51:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.020+0000 7f98c9ffb700 1 -- 172.21.15.78:0/1098415558 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+13771 (secure 0 0 0) 0x7f98d0050780 con 0x7f98d40a7c40 2023-08-17T17:51:55.022 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:55.022 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":117,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:51:54.327492+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:51:55.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 -- 172.21.15.78:0/1098415558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98b805ed90 msgr2=0x7f98b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98b805ed90 0x7f98b8061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f98d40aa910 tx=0x7f98c4008040).stop 2023-08-17T17:51:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 -- 172.21.15.78:0/1098415558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d40a7c40 msgr2=0x7f98d413d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d40a7c40 0x7f98d413d1b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f98d000b6c0 tx=0x7f98d0009780).stop 2023-08-17T17:51:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 -- 172.21.15.78:0/1098415558 shutdown_connections 2023-08-17T17:51:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f98b805ed90 0x7f98b8061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d4154140 0x7f98d4152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98d40a7c40 0x7f98d413d1b0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 --2- 172.21.15.78:0/1098415558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d40a8080 0x7f98d4152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 -- 172.21.15.78:0/1098415558 >> 172.21.15.78:0/1098415558 conn(0x7f98d4094510 msgr2=0x7f98d40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 -- 172.21.15.78:0/1098415558 shutdown_connections 2023-08-17T17:51:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.022+0000 7f98dbc3f700 1 -- 172.21.15.78:0/1098415558 wait complete. 2023-08-17T17:51:55.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T17:51:55.036 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:51:55.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.151+0000 7f1531f2b700 1 Processor -- start 2023-08-17T17:51:55.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.151+0000 7f1531f2b700 1 -- start start 2023-08-17T17:51:55.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f1531f2b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f152c151a40 0x7f152c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f1531f2b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f152c151e20 0x7f152c0c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f1531f2b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f152c157be0 0x7f152c158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f1531f2b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c158540 con 0x7f152c157be0 2023-08-17T17:51:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f1531f2b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c0c6620 con 0x7f152c151e20 2023-08-17T17:51:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f1531f2b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0c6900 con 0x7f152c151a40 2023-08-17T17:51:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f153172a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f152c157be0 0x7f152c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f153172a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f152c157be0 0x7f152c158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35310/0 (socket says 172.21.15.78:35310) 2023-08-17T17:51:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f153172a700 1 -- 172.21.15.78:0/2103280572 learned_addr learned my addr 172.21.15.78:0/2103280572 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f1530f29700 1 --2- 172.21.15.78:0/2103280572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f152c151a40 0x7f152c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f1523fff700 1 --2- 172.21.15.78:0/2103280572 >> v2:172.21.15.150:3300/0 conn(0x7f152c151e20 0x7f152c0c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f153172a700 1 -- 172.21.15.78:0/2103280572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f152c151a40 msgr2=0x7f152c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:55.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f153172a700 1 --2- 172.21.15.78:0/2103280572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f152c151a40 0x7f152c0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f153172a700 1 -- 172.21.15.78:0/2103280572 >> v2:172.21.15.150:3300/0 conn(0x7f152c151e20 msgr2=0x7f152c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:55.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f153172a700 1 --2- 172.21.15.78:0/2103280572 >> v2:172.21.15.150:3300/0 conn(0x7f152c151e20 0x7f152c0c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f153172a700 1 -- 172.21.15.78:0/2103280572 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0c6be0 con 0x7f152c157be0 2023-08-17T17:51:55.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f153172a700 1 --2- 172.21.15.78:0/2103280572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c157be0 0x7f152c158050 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f152c0b0f90 tx=0x7f15240090f0).ready entity=mon.0 client_cookie=6105e64c908f6361 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:55.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f15237fe700 1 -- 172.21.15.78:0/2103280572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400b600 con 0x7f152c157be0 2023-08-17T17:51:55.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f15237fe700 1 -- 172.21.15.78:0/2103280572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152400b760 con 0x7f152c157be0 2023-08-17T17:51:55.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.152+0000 7f15237fe700 1 -- 172.21.15.78:0/2103280572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400bae0 con 0x7f152c157be0 2023-08-17T17:51:55.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.153+0000 7f1531f2b700 1 -- 172.21.15.78:0/2103280572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c157be0 msgr2=0x7f152c158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.153+0000 7f1531f2b700 1 --2- 172.21.15.78:0/2103280572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c157be0 0x7f152c158050 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f152c0b0f90 tx=0x7f15240090f0).stop 2023-08-17T17:51:55.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.153+0000 7f1531f2b700 1 -- 172.21.15.78:0/2103280572 shutdown_connections 2023-08-17T17:51:55.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.153+0000 7f1531f2b700 1 --2- 172.21.15.78:0/2103280572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c157be0 0x7f152c158050 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.153+0000 7f1531f2b700 1 --2- 172.21.15.78:0/2103280572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f152c151a40 0x7f152c0c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.153+0000 7f1531f2b700 1 --2- 172.21.15.78:0/2103280572 >> v2:172.21.15.150:3300/0 conn(0x7f152c151e20 0x7f152c0c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.153+0000 7f1531f2b700 1 -- 172.21.15.78:0/2103280572 >> 172.21.15.78:0/2103280572 conn(0x7f152c0943b0 msgr2=0x7f152c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:55.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.153+0000 7f1531f2b700 1 -- 172.21.15.78:0/2103280572 shutdown_connections 2023-08-17T17:51:55.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.153+0000 7f1531f2b700 1 -- 172.21.15.78:0/2103280572 wait complete. 2023-08-17T17:51:55.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.154+0000 7f1531f2b700 1 Processor -- start 2023-08-17T17:51:55.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.154+0000 7f1531f2b700 1 -- start start 2023-08-17T17:51:55.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1531f2b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c151a40 0x7f152c0c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1531f2b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f152c151e20 0x7f152c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1531f2b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f152c157be0 0x7f152c14c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1531f2b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c156da0 con 0x7f152c151a40 2023-08-17T17:51:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1531f2b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0c2b70 con 0x7f152c157be0 2023-08-17T17:51:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1531f2b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0c2e50 con 0x7f152c151e20 2023-08-17T17:51:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1530f29700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c151a40 0x7f152c0c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1530f29700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c151a40 0x7f152c0c3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35322/0 (socket says 172.21.15.78:35322) 2023-08-17T17:51:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1530f29700 1 -- 172.21.15.78:0/1490652748 learned_addr learned my addr 172.21.15.78:0/1490652748 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1523fff700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f152c151e20 0x7f152c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f153172a700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f152c157be0 0x7f152c14c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1530f29700 1 -- 172.21.15.78:0/1490652748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f152c151e20 msgr2=0x7f152c1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1530f29700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f152c151e20 0x7f152c1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1530f29700 1 -- 172.21.15.78:0/1490652748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f152c157be0 msgr2=0x7f152c14c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1530f29700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f152c157be0 0x7f152c14c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1530f29700 1 -- 172.21.15.78:0/1490652748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524009370 con 0x7f152c151a40 2023-08-17T17:51:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f153172a700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f152c157be0 0x7f152c14c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.155+0000 7f1530f29700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c151a40 0x7f152c0c3c10 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f1528009fd0 tx=0x7f1528009970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:55.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.156+0000 7f1520ff9700 1 -- 172.21.15.78:0/1490652748 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152800edd0 con 0x7f152c151a40 2023-08-17T17:51:55.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.156+0000 7f1520ff9700 1 -- 172.21.15.78:0/1490652748 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1528014400 con 0x7f152c151a40 2023-08-17T17:51:55.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.156+0000 7f1531f2b700 1 -- 172.21.15.78:0/1490652748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c0c3130 con 0x7f152c151a40 2023-08-17T17:51:55.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.156+0000 7f1520ff9700 1 -- 172.21.15.78:0/1490652748 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528014780 con 0x7f152c151a40 2023-08-17T17:51:55.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.156+0000 7f1531f2b700 1 -- 172.21.15.78:0/1490652748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c0c36f0 con 0x7f152c151a40 2023-08-17T17:51:55.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.157+0000 7f1531f2b700 1 -- 172.21.15.78:0/1490652748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c0c38b0 con 0x7f152c151a40 2023-08-17T17:51:55.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.157+0000 7f1520ff9700 1 -- 172.21.15.78:0/1490652748 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f152801b030 con 0x7f152c151a40 2023-08-17T17:51:55.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.157+0000 7f1520ff9700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f151805ed90 0x7f1518061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.157+0000 7f1520ff9700 1 -- 172.21.15.78:0/1490652748 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1528079840 con 0x7f152c151a40 2023-08-17T17:51:55.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.158+0000 7f1523fff700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f151805ed90 0x7f1518061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.158+0000 7f1523fff700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f151805ed90 0x7f1518061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f151c006fd0 tx=0x7f151c008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:55.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.162+0000 7f1520ff9700 1 -- 172.21.15.78:0/1490652748 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f152804a8f0 con 0x7f152c151a40 2023-08-17T17:51:55.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.325+0000 7f1531f2b700 1 -- 172.21.15.78:0/1490652748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f152c157a20 con 0x7f152c151a40 2023-08-17T17:51:55.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.325+0000 7f1520ff9700 1 -- 172.21.15.78:0/1490652748 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v117) v1 ==== 110+0+10 (secure 0 0 0) 0x7f152804b180 con 0x7f152c151a40 2023-08-17T17:51:55.327 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:51:55.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 -- 172.21.15.78:0/1490652748 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f151805ed90 msgr2=0x7f1518061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f151805ed90 0x7f1518061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f151c006fd0 tx=0x7f151c008040).stop 2023-08-17T17:51:55.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 -- 172.21.15.78:0/1490652748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c151a40 msgr2=0x7f152c0c3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c151a40 0x7f152c0c3c10 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f1528009fd0 tx=0x7f1528009970).stop 2023-08-17T17:51:55.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 -- 172.21.15.78:0/1490652748 shutdown_connections 2023-08-17T17:51:55.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f151805ed90 0x7f1518061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f152c157be0 0x7f152c14c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c151a40 0x7f152c0c3c10 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 --2- 172.21.15.78:0/1490652748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f152c151e20 0x7f152c1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 -- 172.21.15.78:0/1490652748 >> 172.21.15.78:0/1490652748 conn(0x7f152c0943b0 msgr2=0x7f152c0c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:55.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 -- 172.21.15.78:0/1490652748 shutdown_connections 2023-08-17T17:51:55.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.327+0000 7f1531f2b700 1 -- 172.21.15.78:0/1490652748 wait complete. 2023-08-17T17:51:55.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:51:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.456+0000 7fd83a8af700 1 Processor -- start 2023-08-17T17:51:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.456+0000 7fd83a8af700 1 -- start start 2023-08-17T17:51:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.457+0000 7fd83a8af700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8340aa0f0 0x7fd8340644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.457+0000 7fd83a8af700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8340c5810 0x7fd8340c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.457+0000 7fd83a8af700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340649b0 con 0x7fd8340aa4d0 2023-08-17T17:51:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.457+0000 7fd83a8af700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340c6170 con 0x7fd8340c5810 2023-08-17T17:51:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.457+0000 7fd83a8af700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd834063420 con 0x7fd8340aa0f0 2023-08-17T17:51:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.457+0000 7fd838e4c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8340c5810 0x7fd8340c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.457+0000 7fd838e4c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8340c5810 0x7fd8340c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35328/0 (socket says 172.21.15.78:35328) 2023-08-17T17:51:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.457+0000 7fd838e4c700 1 -- 172.21.15.78:0/11886582 learned_addr learned my addr 172.21.15.78:0/11886582 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.457+0000 7fd833fff700 1 --2- 172.21.15.78:0/11886582 >> v2:172.21.15.150:3300/0 conn(0x7fd8340aa0f0 0x7fd8340644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd838e4c700 1 -- 172.21.15.78:0/11886582 >> v2:172.21.15.150:3300/0 conn(0x7fd8340aa0f0 msgr2=0x7fd8340644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd838e4c700 1 --2- 172.21.15.78:0/11886582 >> v2:172.21.15.150:3300/0 conn(0x7fd8340aa0f0 0x7fd8340644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd838e4c700 1 -- 172.21.15.78:0/11886582 >> v1:172.21.15.150:6789/0 conn(0x7fd8340aa4d0 legacy=0x7fd8340c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd838e4c700 1 -- 172.21.15.78:0/11886582 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd834063700 con 0x7fd8340c5810 2023-08-17T17:51:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd838e4c700 1 --2- 172.21.15.78:0/11886582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340c5810 0x7fd8340c5c80 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fd8340cade0 tx=0x7fd82c009840).ready entity=mon.0 client_cookie=8964ae053c2934eb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd832ffd700 1 -- 172.21.15.78:0/11886582 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00e070 con 0x7fd8340c5810 2023-08-17T17:51:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd832ffd700 1 -- 172.21.15.78:0/11886582 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c00ba10 con 0x7fd8340c5810 2023-08-17T17:51:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd832ffd700 1 -- 172.21.15.78:0/11886582 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00bd90 con 0x7fd8340c5810 2023-08-17T17:51:55.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd83a8af700 1 -- 172.21.15.78:0/11886582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340c5810 msgr2=0x7fd8340c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd83a8af700 1 --2- 172.21.15.78:0/11886582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340c5810 0x7fd8340c5c80 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fd8340cade0 tx=0x7fd82c009840).stop 2023-08-17T17:51:55.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd83a8af700 1 -- 172.21.15.78:0/11886582 shutdown_connections 2023-08-17T17:51:55.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd83a8af700 1 --2- 172.21.15.78:0/11886582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340c5810 0x7fd8340c5c80 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd83a8af700 1 --2- 172.21.15.78:0/11886582 >> v2:172.21.15.150:3300/0 conn(0x7fd8340aa0f0 0x7fd8340644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd83a8af700 1 -- 172.21.15.78:0/11886582 >> 172.21.15.78:0/11886582 conn(0x7fd83406a6a0 msgr2=0x7fd8340caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:55.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd83a8af700 1 -- 172.21.15.78:0/11886582 shutdown_connections 2023-08-17T17:51:55.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.458+0000 7fd83a8af700 1 -- 172.21.15.78:0/11886582 wait complete. 2023-08-17T17:51:55.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.460+0000 7fd83a8af700 1 Processor -- start 2023-08-17T17:51:55.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.460+0000 7fd83a8af700 1 -- start start 2023-08-17T17:51:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.460+0000 7fd83a8af700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340aa0f0 0x7fd8340c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.460+0000 7fd83a8af700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8340aa4d0 0x7fd8340c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.460+0000 7fd83a8af700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8340c5810 0x7fd834146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.460+0000 7fd83a8af700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340c3400 con 0x7fd8340aa0f0 2023-08-17T17:51:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.460+0000 7fd83a8af700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340aaec0 con 0x7fd8340c5810 2023-08-17T17:51:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.460+0000 7fd83a8af700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340c2e40 con 0x7fd8340aa4d0 2023-08-17T17:51:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd833fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340aa0f0 0x7fd8340c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd833fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340aa0f0 0x7fd8340c2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35338/0 (socket says 172.21.15.78:35338) 2023-08-17T17:51:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd833fff700 1 -- 172.21.15.78:0/272173894 learned_addr learned my addr 172.21.15.78:0/272173894 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd838e4c700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8340c5810 0x7fd834146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd8337fe700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8340aa4d0 0x7fd8340c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd833fff700 1 -- 172.21.15.78:0/272173894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8340aa4d0 msgr2=0x7fd8340c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd833fff700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8340aa4d0 0x7fd8340c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd833fff700 1 -- 172.21.15.78:0/272173894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8340c5810 msgr2=0x7fd834146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd833fff700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8340c5810 0x7fd834146a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd833fff700 1 -- 172.21.15.78:0/272173894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009ae0 con 0x7fd8340aa0f0 2023-08-17T17:51:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd838e4c700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8340c5810 0x7fd834146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd833fff700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340aa0f0 0x7fd8340c2480 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fd82400d890 tx=0x7fd824008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd81bfff700 1 -- 172.21.15.78:0/272173894 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8240125f0 con 0x7fd8340aa0f0 2023-08-17T17:51:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd81bfff700 1 -- 172.21.15.78:0/272173894 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824012750 con 0x7fd8340aa0f0 2023-08-17T17:51:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd83a8af700 1 -- 172.21.15.78:0/272173894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8340c3120 con 0x7fd8340aa0f0 2023-08-17T17:51:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd81bfff700 1 -- 172.21.15.78:0/272173894 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824012ad0 con 0x7fd8340aa0f0 2023-08-17T17:51:55.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.461+0000 7fd83a8af700 1 -- 172.21.15.78:0/272173894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8341444c0 con 0x7fd8340aa0f0 2023-08-17T17:51:55.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.462+0000 7fd83a8af700 1 -- 172.21.15.78:0/272173894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd834083980 con 0x7fd8340aa0f0 2023-08-17T17:51:55.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.462+0000 7fd81bfff700 1 -- 172.21.15.78:0/272173894 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd824013480 con 0x7fd8340aa0f0 2023-08-17T17:51:55.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.463+0000 7fd81bfff700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd82005ed90 0x7fd820061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.463+0000 7fd81bfff700 1 -- 172.21.15.78:0/272173894 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd824079b10 con 0x7fd8340aa0f0 2023-08-17T17:51:55.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.463+0000 7fd8337fe700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd82005ed90 0x7fd820061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.463+0000 7fd8337fe700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd82005ed90 0x7fd820061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd834158b70 tx=0x7fd828009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:55.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.467+0000 7fd81bfff700 1 -- 172.21.15.78:0/272173894 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd82404b3a0 con 0x7fd8340aa0f0 2023-08-17T17:51:55.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.628+0000 7fd83a8af700 1 -- 172.21.15.78:0/272173894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8340629b0 con 0x7fd8340aa0f0 2023-08-17T17:51:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.629+0000 7fd81bfff700 1 -- 172.21.15.78:0/272173894 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v117) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd82404e9c0 con 0x7fd8340aa0f0 2023-08-17T17:51:55.630 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:51:55.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 -- 172.21.15.78:0/272173894 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd82005ed90 msgr2=0x7fd820061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd82005ed90 0x7fd820061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd834158b70 tx=0x7fd828009040).stop 2023-08-17T17:51:55.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 -- 172.21.15.78:0/272173894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340aa0f0 msgr2=0x7fd8340c2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340aa0f0 0x7fd8340c2480 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fd82400d890 tx=0x7fd824008040).stop 2023-08-17T17:51:55.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 -- 172.21.15.78:0/272173894 shutdown_connections 2023-08-17T17:51:55.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd82005ed90 0x7fd820061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8340c5810 0x7fd834146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340aa0f0 0x7fd8340c2480 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 --2- 172.21.15.78:0/272173894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8340aa4d0 0x7fd8340c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 -- 172.21.15.78:0/272173894 >> 172.21.15.78:0/272173894 conn(0x7fd83406a6a0 msgr2=0x7fd834152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:55.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 -- 172.21.15.78:0/272173894 shutdown_connections 2023-08-17T17:51:55.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.631+0000 7fd83a8af700 1 -- 172.21.15.78:0/272173894 wait complete. 2023-08-17T17:51:55.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T17:51:55.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.755+0000 7fe990803700 1 Processor -- start 2023-08-17T17:51:55.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.755+0000 7fe990803700 1 -- start start 2023-08-17T17:51:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.756+0000 7fe990803700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe98c0c01b0 0x7fe98c0c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.756+0000 7fe990803700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe98c0a7bd0 0x7fe98c063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.756+0000 7fe990803700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c063960 con 0x7fe98c0a8050 2023-08-17T17:51:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.756+0000 7fe990803700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c0649f0 con 0x7fe98c0c01b0 2023-08-17T17:51:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.756+0000 7fe990803700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c063030 con 0x7fe98c0a7bd0 2023-08-17T17:51:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.756+0000 7fe98ad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe98c0c01b0 0x7fe98c0c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.756+0000 7fe98b59e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe98c0a8050 0x7fe98c0642e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41570/0 (socket says 172.21.15.78:41570) 2023-08-17T17:51:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe98b59e700 1 -- 172.21.15.78:0/312911055 learned_addr learned my addr 172.21.15.78:0/312911055 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe983fff700 1 --2- 172.21.15.78:0/312911055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe98c0a7bd0 0x7fe98c063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe98ad9d700 1 -- 172.21.15.78:0/312911055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe98c0a7bd0 msgr2=0x7fe98c063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe98ad9d700 1 --2- 172.21.15.78:0/312911055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe98c0a7bd0 0x7fe98c063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe98ad9d700 1 -- 172.21.15.78:0/312911055 >> v1:172.21.15.78:6789/0 conn(0x7fe98c0a8050 legacy=0x7fe98c0642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe98ad9d700 1 -- 172.21.15.78:0/312911055 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c063310 con 0x7fe98c0c01b0 2023-08-17T17:51:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe98a59c700 1 -- 172.21.15.78:0/312911055 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007164787 0 0) 0x7fe98c063960 con 0x7fe98c0a8050 2023-08-17T17:51:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe98ad9d700 1 --2- 172.21.15.78:0/312911055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 0x7fe98c0c5b90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fe97c009760 tx=0x7fe97c009060).ready entity=mon.0 client_cookie=e3c2b4ce7a723 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe98a59c700 1 -- 172.21.15.78:0/312911055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00b580 con 0x7fe98c0c01b0 2023-08-17T17:51:55.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe98a59c700 1 -- 172.21.15.78:0/312911055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c00b6e0 con 0x7fe98c0c01b0 2023-08-17T17:51:55.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.757+0000 7fe98a59c700 1 -- 172.21.15.78:0/312911055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00ba60 con 0x7fe98c0c01b0 2023-08-17T17:51:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.758+0000 7fe990803700 1 -- 172.21.15.78:0/312911055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 msgr2=0x7fe98c0c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.758+0000 7fe990803700 1 --2- 172.21.15.78:0/312911055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 0x7fe98c0c5b90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fe97c009760 tx=0x7fe97c009060).stop 2023-08-17T17:51:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.758+0000 7fe990803700 1 -- 172.21.15.78:0/312911055 shutdown_connections 2023-08-17T17:51:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.758+0000 7fe990803700 1 --2- 172.21.15.78:0/312911055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 0x7fe98c0c5b90 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.758+0000 7fe990803700 1 --2- 172.21.15.78:0/312911055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe98c0a7bd0 0x7fe98c063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.758+0000 7fe990803700 1 -- 172.21.15.78:0/312911055 >> 172.21.15.78:0/312911055 conn(0x7fe98c06a6c0 msgr2=0x7fe98c0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:55.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.758+0000 7fe990803700 1 -- 172.21.15.78:0/312911055 shutdown_connections 2023-08-17T17:51:55.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.758+0000 7fe990803700 1 -- 172.21.15.78:0/312911055 wait complete. 2023-08-17T17:51:55.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.759+0000 7fe990803700 1 Processor -- start 2023-08-17T17:51:55.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.759+0000 7fe990803700 1 -- start start 2023-08-17T17:51:55.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe990803700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe98c0a7bd0 0x7fe98c0c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe990803700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0a8050 0x7fe98c165130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe990803700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 0x7fe98c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe990803700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0c2cc0 con 0x7fe98c0c01b0 2023-08-17T17:51:55.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe990803700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c1556d0 con 0x7fe98c0a8050 2023-08-17T17:51:55.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe990803700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c1559b0 con 0x7fe98c0a7bd0 2023-08-17T17:51:55.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe98b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 0x7fe98c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe98b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 0x7fe98c0aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35366/0 (socket says 172.21.15.78:35366) 2023-08-17T17:51:55.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe98b59e700 1 -- 172.21.15.78:0/3010993824 learned_addr learned my addr 172.21.15.78:0/3010993824 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:55.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe98ad9d700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe98c0a7bd0 0x7fe98c0c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe983fff700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0a8050 0x7fe98c165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe98b59e700 1 -- 172.21.15.78:0/3010993824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe98c0a7bd0 msgr2=0x7fe98c0c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe98b59e700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe98c0a7bd0 0x7fe98c0c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe98b59e700 1 -- 172.21.15.78:0/3010993824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0a8050 msgr2=0x7fe98c165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe98b59e700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0a8050 0x7fe98c165130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe98b59e700 1 -- 172.21.15.78:0/3010993824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c0092a0 con 0x7fe98c0c01b0 2023-08-17T17:51:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe98b59e700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 0x7fe98c0aea20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7fe98400c760 tx=0x7fe984007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe982ffd700 1 -- 172.21.15.78:0/3010993824 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984005d30 con 0x7fe98c0c01b0 2023-08-17T17:51:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe982ffd700 1 -- 172.21.15.78:0/3010993824 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe984005e90 con 0x7fe98c0c01b0 2023-08-17T17:51:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe990803700 1 -- 172.21.15.78:0/3010993824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c155c90 con 0x7fe98c0c01b0 2023-08-17T17:51:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe982ffd700 1 -- 172.21.15.78:0/3010993824 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840072e0 con 0x7fe98c0c01b0 2023-08-17T17:51:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.760+0000 7fe990803700 1 -- 172.21.15.78:0/3010993824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c165620 con 0x7fe98c0c01b0 2023-08-17T17:51:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.761+0000 7fe990803700 1 -- 172.21.15.78:0/3010993824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c083af0 con 0x7fe98c0c01b0 2023-08-17T17:51:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.762+0000 7fe982ffd700 1 -- 172.21.15.78:0/3010993824 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe98401a060 con 0x7fe98c0c01b0 2023-08-17T17:51:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.762+0000 7fe982ffd700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe96c05ed90 0x7fe96c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.762+0000 7fe982ffd700 1 -- 172.21.15.78:0/3010993824 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe984079130 con 0x7fe98c0c01b0 2023-08-17T17:51:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.762+0000 7fe98ad9d700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe96c05ed90 0x7fe96c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.762+0000 7fe98ad9d700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe96c05ed90 0x7fe96c061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe97c00b340 tx=0x7fe97c017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.766+0000 7fe982ffd700 1 -- 172.21.15.78:0/3010993824 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe98404aa20 con 0x7fe98c0c01b0 2023-08-17T17:51:55.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.933+0000 7fe990803700 1 -- 172.21.15.78:0/3010993824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe98c0635f0 con 0x7fe98c0c01b0 2023-08-17T17:51:55.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.933+0000 7fe982ffd700 1 -- 172.21.15.78:0/3010993824 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v117) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe984018020 con 0x7fe98c0c01b0 2023-08-17T17:51:55.934 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:55.935 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:51:55.935 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:55.935 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T17:51:55.935 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T17:51:55.935 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:51:55.935 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:51:55.935 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T17:51:55.936 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T17:51:55.936 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:51:55.936 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:51:55.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 -- 172.21.15.78:0/3010993824 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe96c05ed90 msgr2=0x7fe96c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe96c05ed90 0x7fe96c061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe97c00b340 tx=0x7fe97c017000).stop 2023-08-17T17:51:55.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 -- 172.21.15.78:0/3010993824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 msgr2=0x7fe98c0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:55.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 0x7fe98c0aea20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7fe98400c760 tx=0x7fe984007ef0).stop 2023-08-17T17:51:55.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 -- 172.21.15.78:0/3010993824 shutdown_connections 2023-08-17T17:51:55.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe96c05ed90 0x7fe96c061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe98c0c01b0 0x7fe98c0aea20 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe98c0a7bd0 0x7fe98c0c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 --2- 172.21.15.78:0/3010993824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe98c0a8050 0x7fe98c165130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:55.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 -- 172.21.15.78:0/3010993824 >> 172.21.15.78:0/3010993824 conn(0x7fe98c06a6c0 msgr2=0x7fe98c0c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:55.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 -- 172.21.15.78:0/3010993824 shutdown_connections 2023-08-17T17:51:55.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:55.935+0000 7fe990803700 1 -- 172.21.15.78:0/3010993824 wait complete. 2023-08-17T17:51:55.948 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T17:51:55.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T17:51:56.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.066+0000 7f5ae431f700 1 Processor -- start 2023-08-17T17:51:56.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.066+0000 7f5ae431f700 1 -- start start 2023-08-17T17:51:56.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae431f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5adc0aa0f0 0x7f5adc0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae431f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5adc0c5810 0x7f5adc0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae431f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0649b0 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae431f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc0c6170 con 0x7f5adc0c5810 2023-08-17T17:51:56.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae431f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc063420 con 0x7f5adc0aa0f0 2023-08-17T17:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae28bc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5adc0c5810 0x7f5adc0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae28bc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5adc0c5810 0x7f5adc0c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35368/0 (socket says 172.21.15.78:35368) 2023-08-17T17:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae28bc700 1 -- 172.21.15.78:0/767618534 learned_addr learned my addr 172.21.15.78:0/767618534 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae20bb700 1 --2- 172.21.15.78:0/767618534 >> v2:172.21.15.150:3300/0 conn(0x7f5adc0aa0f0 0x7f5adc0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae28bc700 1 -- 172.21.15.78:0/767618534 >> v2:172.21.15.150:3300/0 conn(0x7f5adc0aa0f0 msgr2=0x7f5adc0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae28bc700 1 --2- 172.21.15.78:0/767618534 >> v2:172.21.15.150:3300/0 conn(0x7f5adc0aa0f0 0x7f5adc0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae28bc700 1 -- 172.21.15.78:0/767618534 >> v1:172.21.15.150:6789/0 conn(0x7f5adc0aa4d0 legacy=0x7f5adc0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:56.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.067+0000 7f5ae28bc700 1 -- 172.21.15.78:0/767618534 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc063700 con 0x7f5adc0c5810 2023-08-17T17:51:56.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae28bc700 1 --2- 172.21.15.78:0/767618534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0c5810 0x7f5adc0c5c80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f5adc0cade0 tx=0x7f5ad40090f0).ready entity=mon.0 client_cookie=a2d7d0bb0234bb48 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:56.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae10b9700 1 -- 172.21.15.78:0/767618534 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400b5a0 con 0x7f5adc0c5810 2023-08-17T17:51:56.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae10b9700 1 -- 172.21.15.78:0/767618534 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad400b700 con 0x7f5adc0c5810 2023-08-17T17:51:56.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae10b9700 1 -- 172.21.15.78:0/767618534 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400ba80 con 0x7f5adc0c5810 2023-08-17T17:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae431f700 1 -- 172.21.15.78:0/767618534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0c5810 msgr2=0x7f5adc0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae431f700 1 --2- 172.21.15.78:0/767618534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0c5810 0x7f5adc0c5c80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f5adc0cade0 tx=0x7f5ad40090f0).stop 2023-08-17T17:51:56.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae431f700 1 -- 172.21.15.78:0/767618534 shutdown_connections 2023-08-17T17:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae431f700 1 --2- 172.21.15.78:0/767618534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0c5810 0x7f5adc0c5c80 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae431f700 1 --2- 172.21.15.78:0/767618534 >> v2:172.21.15.150:3300/0 conn(0x7f5adc0aa0f0 0x7f5adc0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae431f700 1 -- 172.21.15.78:0/767618534 >> 172.21.15.78:0/767618534 conn(0x7f5adc06a6a0 msgr2=0x7f5adc0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae431f700 1 -- 172.21.15.78:0/767618534 shutdown_connections 2023-08-17T17:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.068+0000 7f5ae431f700 1 -- 172.21.15.78:0/767618534 wait complete. 2023-08-17T17:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.069+0000 7f5ae431f700 1 Processor -- start 2023-08-17T17:51:56.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.069+0000 7f5ae431f700 1 -- start start 2023-08-17T17:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae431f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5adc0aa0f0 0x7f5adc0ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae431f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0aa4d0 0x7f5adc152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae431f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5adc0c5810 0x7f5adc1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae431f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0abd30 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae431f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc155ee0 con 0x7f5adc0aa0f0 2023-08-17T17:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae431f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0aba50 con 0x7f5adc0c5810 2023-08-17T17:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae18ba700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0aa4d0 0x7f5adc152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae18ba700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0aa4d0 0x7f5adc152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35372/0 (socket says 172.21.15.78:35372) 2023-08-17T17:51:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae18ba700 1 -- 172.21.15.78:0/273749536 learned_addr learned my addr 172.21.15.78:0/273749536 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae28bc700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5adc0c5810 0x7f5adc1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.070+0000 7f5ae20bb700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5adc0aa0f0 0x7f5adc0ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ae18ba700 1 -- 172.21.15.78:0/273749536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5adc0c5810 msgr2=0x7f5adc1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ae18ba700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5adc0c5810 0x7f5adc1559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ae18ba700 1 -- 172.21.15.78:0/273749536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5adc0aa0f0 msgr2=0x7f5adc0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ae18ba700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5adc0aa0f0 0x7f5adc0ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ae18ba700 1 -- 172.21.15.78:0/273749536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4009370 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ae18ba700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0aa4d0 0x7f5adc152160 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f5acc00c490 tx=0x7f5acc007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ad27fc700 1 -- 172.21.15.78:0/273749536 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00f470 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ad27fc700 1 -- 172.21.15.78:0/273749536 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00f5d0 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ae431f700 1 -- 172.21.15.78:0/273749536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc0c2d00 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ad27fc700 1 -- 172.21.15.78:0/273749536 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00f990 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.071+0000 7f5ae431f700 1 -- 172.21.15.78:0/273749536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc0c32c0 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.072+0000 7f5ae431f700 1 -- 172.21.15.78:0/273749536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc0c2b60 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.072+0000 7f5ad27fc700 1 -- 172.21.15.78:0/273749536 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5acc019030 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.072+0000 7f5ad27fc700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ac005ed90 0x7f5ac0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.073+0000 7f5ad27fc700 1 -- 172.21.15.78:0/273749536 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5acc078b60 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.073+0000 7f5ae20bb700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ac005ed90 0x7f5ac0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.073+0000 7f5ae20bb700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ac005ed90 0x7f5ac0061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5ad80075a0 tx=0x7f5ad80097a0).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.077+0000 7f5ad27fc700 1 -- 172.21.15.78:0/273749536 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5acc0488f0 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.240+0000 7f5ae431f700 1 -- 172.21.15.78:0/273749536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f5adc152650 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.339+0000 7f5ad27fc700 1 -- 172.21.15.78:0/273749536 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v118) v1 ==== 152+0+0 (secure 0 0 0) 0x7f5acc017030 con 0x7f5adc0aa4d0 2023-08-17T17:51:56.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.341+0000 7f5ae431f700 1 -- 172.21.15.78:0/273749536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ac005ed90 msgr2=0x7f5ac0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:56.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.341+0000 7f5ae431f700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ac005ed90 0x7f5ac0061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5ad80075a0 tx=0x7f5ad80097a0).stop 2023-08-17T17:51:56.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.342+0000 7f5ae431f700 1 -- 172.21.15.78:0/273749536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0aa4d0 msgr2=0x7f5adc152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:56.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.342+0000 7f5ae431f700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0aa4d0 0x7f5adc152160 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f5acc00c490 tx=0x7f5acc007db0).stop 2023-08-17T17:51:56.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.342+0000 7f5ae431f700 1 -- 172.21.15.78:0/273749536 shutdown_connections 2023-08-17T17:51:56.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.342+0000 7f5ae431f700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ac005ed90 0x7f5ac0061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.342+0000 7f5ae431f700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5adc0c5810 0x7f5adc1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.342+0000 7f5ae431f700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5adc0aa0f0 0x7f5adc0ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.342+0000 7f5ae431f700 1 --2- 172.21.15.78:0/273749536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc0aa4d0 0x7f5adc152160 secure :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0x7f5acc00c490 tx=0x7f5acc007db0).stop 2023-08-17T17:51:56.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.342+0000 7f5ae431f700 1 -- 172.21.15.78:0/273749536 >> 172.21.15.78:0/273749536 conn(0x7f5adc06a6a0 msgr2=0x7f5adc0b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:56.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.343+0000 7f5ae431f700 1 -- 172.21.15.78:0/273749536 shutdown_connections 2023-08-17T17:51:56.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.343+0000 7f5ae431f700 1 -- 172.21.15.78:0/273749536 wait complete. 2023-08-17T17:51:56.346 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T17:51:56.359 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T17:51:56.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.477+0000 7f494e62a700 1 Processor -- start 2023-08-17T17:51:56.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.478+0000 7f494e62a700 1 -- start start 2023-08-17T17:51:56.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.478+0000 7f494e62a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49480c6000 0x7f49480c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.478+0000 7f494e62a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f49480bec90 0x7f49480c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.478+0000 7f494e62a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49481522f0 con 0x7f49480c5410 2023-08-17T17:51:56.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.478+0000 7f494e62a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49480c4fa0 con 0x7f49480c6000 2023-08-17T17:51:56.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.478+0000 7f494e62a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49480c4390 con 0x7f49480bec90 2023-08-17T17:51:56.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f494d628700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49480c6000 0x7f49480c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f494ce27700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f49480c5410 0x7f49480be580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41582/0 (socket says 172.21.15.78:41582) 2023-08-17T17:51:56.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f494ce27700 1 -- 172.21.15.78:0/630681026 learned_addr learned my addr 172.21.15.78:0/630681026 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:56.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f494de29700 1 --2- 172.21.15.78:0/630681026 >> v2:172.21.15.150:3300/0 conn(0x7f49480bec90 0x7f49480c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f494d628700 1 -- 172.21.15.78:0/630681026 >> v2:172.21.15.150:3300/0 conn(0x7f49480bec90 msgr2=0x7f49480c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:56.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f494d628700 1 --2- 172.21.15.78:0/630681026 >> v2:172.21.15.150:3300/0 conn(0x7f49480bec90 0x7f49480c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f494d628700 1 -- 172.21.15.78:0/630681026 >> v1:172.21.15.78:6789/0 conn(0x7f49480c5410 legacy=0x7f49480be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:56.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f493ffff700 1 -- 172.21.15.78:0/630681026 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691365101 0 0) 0x7f4938001110 con 0x7f49480c5410 2023-08-17T17:51:56.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f494d628700 1 -- 172.21.15.78:0/630681026 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49480c4670 con 0x7f49480c6000 2023-08-17T17:51:56.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f494d628700 1 --2- 172.21.15.78:0/630681026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c6000 0x7f49480c3b20 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f49480836e0 tx=0x7f4944009780).ready entity=mon.0 client_cookie=67d02715862cff8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:56.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f493ffff700 1 -- 172.21.15.78:0/630681026 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494400e070 con 0x7f49480c6000 2023-08-17T17:51:56.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f493ffff700 1 -- 172.21.15.78:0/630681026 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494400bb60 con 0x7f49480c6000 2023-08-17T17:51:56.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.479+0000 7f493ffff700 1 -- 172.21.15.78:0/630681026 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944012410 con 0x7f49480c6000 2023-08-17T17:51:56.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.480+0000 7f494e62a700 1 -- 172.21.15.78:0/630681026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c6000 msgr2=0x7f49480c3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:56.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.480+0000 7f494e62a700 1 --2- 172.21.15.78:0/630681026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c6000 0x7f49480c3b20 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f49480836e0 tx=0x7f4944009780).stop 2023-08-17T17:51:56.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.480+0000 7f494e62a700 1 -- 172.21.15.78:0/630681026 shutdown_connections 2023-08-17T17:51:56.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.480+0000 7f494e62a700 1 --2- 172.21.15.78:0/630681026 >> v2:172.21.15.150:3300/0 conn(0x7f49480bec90 0x7f49480c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.480+0000 7f494e62a700 1 --2- 172.21.15.78:0/630681026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c6000 0x7f49480c3b20 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.480+0000 7f494e62a700 1 -- 172.21.15.78:0/630681026 >> 172.21.15.78:0/630681026 conn(0x7f4948092380 msgr2=0x7f4948062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:56.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.480+0000 7f494e62a700 1 -- 172.21.15.78:0/630681026 shutdown_connections 2023-08-17T17:51:56.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.480+0000 7f494e62a700 1 -- 172.21.15.78:0/630681026 wait complete. 2023-08-17T17:51:56.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.481+0000 7f494e62a700 1 Processor -- start 2023-08-17T17:51:56.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.481+0000 7f494e62a700 1 -- start start 2023-08-17T17:51:56.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494e62a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49480bec90 0x7f4948064ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494e62a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c5410 0x7f4948149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494e62a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49480c6000 0x7f4948149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494e62a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4948096330 con 0x7f49480c5410 2023-08-17T17:51:56.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494e62a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4948093c60 con 0x7f49480c6000 2023-08-17T17:51:56.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494e62a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49480653b0 con 0x7f49480bec90 2023-08-17T17:51:56.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494ce27700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c5410 0x7f4948149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494ce27700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c5410 0x7f4948149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35380/0 (socket says 172.21.15.78:35380) 2023-08-17T17:51:56.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494ce27700 1 -- 172.21.15.78:0/2212240901 learned_addr learned my addr 172.21.15.78:0/2212240901 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:56.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494de29700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49480c6000 0x7f4948149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494d628700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49480bec90 0x7f4948064ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494ce27700 1 -- 172.21.15.78:0/2212240901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49480bec90 msgr2=0x7f4948064ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:56.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494ce27700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49480bec90 0x7f4948064ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494ce27700 1 -- 172.21.15.78:0/2212240901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49480c6000 msgr2=0x7f4948149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:56.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494ce27700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49480c6000 0x7f4948149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:56.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494ce27700 1 -- 172.21.15.78:0/2212240901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944009a20 con 0x7f49480c5410 2023-08-17T17:51:56.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494de29700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49480c6000 0x7f4948149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:56.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.482+0000 7f494ce27700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c5410 0x7f4948149050 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f493800c4e0 tx=0x7f4938007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:56.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.483+0000 7f493d7fa700 1 -- 172.21.15.78:0/2212240901 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380072e0 con 0x7f49480c5410 2023-08-17T17:51:56.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.483+0000 7f493d7fa700 1 -- 172.21.15.78:0/2212240901 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4938007440 con 0x7f49480c5410 2023-08-17T17:51:56.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.483+0000 7f493d7fa700 1 -- 172.21.15.78:0/2212240901 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380057a0 con 0x7f49480c5410 2023-08-17T17:51:56.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.483+0000 7f494e62a700 1 -- 172.21.15.78:0/2212240901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4948093050 con 0x7f49480c5410 2023-08-17T17:51:56.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.483+0000 7f494e62a700 1 -- 172.21.15.78:0/2212240901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4948093610 con 0x7f49480c5410 2023-08-17T17:51:56.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.484+0000 7f494e62a700 1 -- 172.21.15.78:0/2212240901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4948093dd0 con 0x7f49480c5410 2023-08-17T17:51:56.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.484+0000 7f493d7fa700 1 -- 172.21.15.78:0/2212240901 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4938010070 con 0x7f49480c5410 2023-08-17T17:51:56.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.485+0000 7f493d7fa700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f492c05ed90 0x7f492c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:56.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.485+0000 7f493d7fa700 1 -- 172.21.15.78:0/2212240901 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f4938078e90 con 0x7f49480c5410 2023-08-17T17:51:56.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.485+0000 7f494d628700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f492c05ed90 0x7f492c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.485+0000 7f494d628700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f492c05ed90 0x7f492c061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f49440097c0 tx=0x7f49480c4f10).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.489+0000 7f493d7fa700 1 -- 172.21.15.78:0/2212240901 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f493804a610 con 0x7f49480c5410 2023-08-17T17:51:56.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:56.652+0000 7f494e62a700 1 -- 172.21.15.78:0/2212240901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f49481522f0 con 0x7f49480c5410 2023-08-17T17:51:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.349+0000 7f493d7fa700 1 -- 172.21.15.78:0/2212240901 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v119) v1 ==== 170+0+0 (secure 0 0 0) 0x7f49481522f0 con 0x7f49480c5410 2023-08-17T17:51:57.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.355+0000 7f494e62a700 1 -- 172.21.15.78:0/2212240901 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f492c05ed90 msgr2=0x7f492c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.355+0000 7f494e62a700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f492c05ed90 0x7f492c061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f49440097c0 tx=0x7f49480c4f10).stop 2023-08-17T17:51:57.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.355+0000 7f494e62a700 1 -- 172.21.15.78:0/2212240901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c5410 msgr2=0x7f4948149050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.355+0000 7f494e62a700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c5410 0x7f4948149050 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f493800c4e0 tx=0x7f4938007ab0).stop 2023-08-17T17:51:57.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.356+0000 7f494e62a700 1 -- 172.21.15.78:0/2212240901 shutdown_connections 2023-08-17T17:51:57.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.356+0000 7f494e62a700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f492c05ed90 0x7f492c061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.356+0000 7f494e62a700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49480c6000 0x7f4948149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.356+0000 7f494e62a700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49480bec90 0x7f4948064ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.356+0000 7f494e62a700 1 --2- 172.21.15.78:0/2212240901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49480c5410 0x7f4948149050 secure :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0x7f493800c4e0 tx=0x7f4938007ab0).stop 2023-08-17T17:51:57.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.356+0000 7f494e62a700 1 -- 172.21.15.78:0/2212240901 >> 172.21.15.78:0/2212240901 conn(0x7f4948092380 msgr2=0x7f49480c6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:57.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.361+0000 7f494e62a700 1 -- 172.21.15.78:0/2212240901 shutdown_connections 2023-08-17T17:51:57.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.362+0000 7f494e62a700 1 -- 172.21.15.78:0/2212240901 wait complete. 2023-08-17T17:51:57.371 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T17:51:57.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T17:51:57.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.498+0000 7f4e4ea7e700 1 Processor -- start 2023-08-17T17:51:57.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.498+0000 7f4e4ea7e700 1 -- start start 2023-08-17T17:51:57.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.498+0000 7f4e4ea7e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4e481578f0 0x7f4e480be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.498+0000 7f4e4ea7e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e480bf0e0 0x7f4e48095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.498+0000 7f4e4ea7e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e480967b0 con 0x7f4e48096300 2023-08-17T17:51:57.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.498+0000 7f4e4ea7e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e480bf5c0 con 0x7f4e481578f0 2023-08-17T17:51:57.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.498+0000 7f4e4ea7e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480c32d0 con 0x7f4e480bf0e0 2023-08-17T17:51:57.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e4c81a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4e481578f0 0x7f4e480be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e3ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e480bf0e0 0x7f4e48095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e4c81a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4e481578f0 0x7f4e480be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:45448/0 (socket says 172.21.15.78:45448) 2023-08-17T17:51:57.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e4c81a700 1 -- 172.21.15.78:0/2831114109 learned_addr learned my addr 172.21.15.78:0/2831114109 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:57.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e4c81a700 1 -- 172.21.15.78:0/2831114109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e480bf0e0 msgr2=0x7f4e48095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e4c81a700 1 --2- 172.21.15.78:0/2831114109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e480bf0e0 0x7f4e48095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e4c81a700 1 -- 172.21.15.78:0/2831114109 >> v1:172.21.15.150:6789/0 conn(0x7f4e48096300 legacy=0x7f4e48064330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e3f7fe700 1 -- 172.21.15.78:0/2831114109 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497129317 0 0) 0x7f4e40001490 con 0x7f4e48096300 2023-08-17T17:51:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e4c81a700 1 -- 172.21.15.78:0/2831114109 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e480c3e10 con 0x7f4e481578f0 2023-08-17T17:51:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e3ffff700 1 --2- 172.21.15.78:0/2831114109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e480bf0e0 0x7f4e48095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:51:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.499+0000 7f4e4c81a700 1 --2- 172.21.15.78:0/2831114109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e481578f0 0x7f4e480be210 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f4e44006fd0 tx=0x7f4e440090f0).ready entity=mon.1 client_cookie=56051bc57ab1b82 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e3f7fe700 1 -- 172.21.15.78:0/2831114109 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400b580 con 0x7f4e481578f0 2023-08-17T17:51:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e3f7fe700 1 -- 172.21.15.78:0/2831114109 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4400b6e0 con 0x7f4e481578f0 2023-08-17T17:51:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e3f7fe700 1 -- 172.21.15.78:0/2831114109 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400ba60 con 0x7f4e481578f0 2023-08-17T17:51:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/2831114109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e481578f0 msgr2=0x7f4e480be210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e4ea7e700 1 --2- 172.21.15.78:0/2831114109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e481578f0 0x7f4e480be210 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f4e44006fd0 tx=0x7f4e440090f0).stop 2023-08-17T17:51:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/2831114109 shutdown_connections 2023-08-17T17:51:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e4ea7e700 1 --2- 172.21.15.78:0/2831114109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e481578f0 0x7f4e480be210 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e4ea7e700 1 --2- 172.21.15.78:0/2831114109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e480bf0e0 0x7f4e48095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/2831114109 >> 172.21.15.78:0/2831114109 conn(0x7f4e48062f80 msgr2=0x7f4e480c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/2831114109 shutdown_connections 2023-08-17T17:51:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.500+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/2831114109 wait complete. 2023-08-17T17:51:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.501+0000 7f4e4ea7e700 1 Processor -- start 2023-08-17T17:51:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.501+0000 7f4e4ea7e700 1 -- start start 2023-08-17T17:51:57.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e4ea7e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e48096300 0x7f4e4814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e4ea7e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e480bf0e0 0x7f4e480a7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e4ea7e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e481578f0 0x7f4e480a7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e4ea7e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480a6000 con 0x7f4e480bf0e0 2023-08-17T17:51:57.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e4ea7e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48150290 con 0x7f4e481578f0 2023-08-17T17:51:57.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e4ea7e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480a62a0 con 0x7f4e48096300 2023-08-17T17:51:57.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e3ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e480bf0e0 0x7f4e480a7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e3ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e480bf0e0 0x7f4e480a7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35390/0 (socket says 172.21.15.78:35390) 2023-08-17T17:51:57.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e3ffff700 1 -- 172.21.15.78:0/833244125 learned_addr learned my addr 172.21.15.78:0/833244125 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:57.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e4c81a700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e48096300 0x7f4e4814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.502+0000 7f4e4d01b700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e481578f0 0x7f4e480a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e3ffff700 1 -- 172.21.15.78:0/833244125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e48096300 msgr2=0x7f4e4814fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e3ffff700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e48096300 0x7f4e4814fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e3ffff700 1 -- 172.21.15.78:0/833244125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e481578f0 msgr2=0x7f4e480a7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e3ffff700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e481578f0 0x7f4e480a7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e3ffff700 1 -- 172.21.15.78:0/833244125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380092a0 con 0x7f4e480bf0e0 2023-08-17T17:51:57.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e3ffff700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e480bf0e0 0x7f4e480a7060 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f4e3800ea20 tx=0x7f4e38009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:57.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e3cff9700 1 -- 172.21.15.78:0/833244125 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800ee60 con 0x7f4e480bf0e0 2023-08-17T17:51:57.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e3cff9700 1 -- 172.21.15.78:0/833244125 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3800c850 con 0x7f4e480bf0e0 2023-08-17T17:51:57.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/833244125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e44009370 con 0x7f4e480bf0e0 2023-08-17T17:51:57.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e3cff9700 1 -- 172.21.15.78:0/833244125 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800cbd0 con 0x7f4e480bf0e0 2023-08-17T17:51:57.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.503+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/833244125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e480a6860 con 0x7f4e480bf0e0 2023-08-17T17:51:57.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.504+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/833244125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e480695e0 con 0x7f4e480bf0e0 2023-08-17T17:51:57.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.504+0000 7f4e3cff9700 1 -- 172.21.15.78:0/833244125 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4e38022070 con 0x7f4e480bf0e0 2023-08-17T17:51:57.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.505+0000 7f4e3cff9700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e3405ed90 0x7f4e34061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.505+0000 7f4e3cff9700 1 -- 172.21.15.78:0/833244125 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f4e38079e10 con 0x7f4e480bf0e0 2023-08-17T17:51:57.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.505+0000 7f4e4c81a700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e3405ed90 0x7f4e34061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.505+0000 7f4e4c81a700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e3405ed90 0x7f4e34061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4e44009130 tx=0x7f4e44017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:57.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.509+0000 7f4e3cff9700 1 -- 172.21.15.78:0/833244125 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e3804b410 con 0x7f4e480bf0e0 2023-08-17T17:51:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.712+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/833244125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4e48065cd0 con 0x7f4e480bf0e0 2023-08-17T17:51:57.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.720+0000 7f4e3cff9700 1 -- 172.21.15.78:0/833244125 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v41) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4e3804ea30 con 0x7f4e480bf0e0 2023-08-17T17:51:57.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.725+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/833244125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e3405ed90 msgr2=0x7f4e34061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.725+0000 7f4e4ea7e700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e3405ed90 0x7f4e34061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4e44009130 tx=0x7f4e44017000).stop 2023-08-17T17:51:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.726+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/833244125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e480bf0e0 msgr2=0x7f4e480a7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.726+0000 7f4e4ea7e700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e480bf0e0 0x7f4e480a7060 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f4e3800ea20 tx=0x7f4e38009060).stop 2023-08-17T17:51:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.726+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/833244125 shutdown_connections 2023-08-17T17:51:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.726+0000 7f4e4ea7e700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4e3405ed90 0x7f4e34061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.726+0000 7f4e4ea7e700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e481578f0 0x7f4e480a7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.726+0000 7f4e4ea7e700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4e48096300 0x7f4e4814fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.726+0000 7f4e4ea7e700 1 --2- 172.21.15.78:0/833244125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e480bf0e0 0x7f4e480a7060 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.726+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/833244125 >> 172.21.15.78:0/833244125 conn(0x7f4e48062f80 msgr2=0x7f4e481568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.726+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/833244125 shutdown_connections 2023-08-17T17:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.726+0000 7f4e4ea7e700 1 -- 172.21.15.78:0/833244125 wait complete. 2023-08-17T17:51:57.736 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 15 and data pool 16 2023-08-17T17:51:57.751 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:51:57.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.863+0000 7fa1276f6700 1 Processor -- start 2023-08-17T17:51:57.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.863+0000 7fa1276f6700 1 -- start start 2023-08-17T17:51:57.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.864+0000 7fa1276f6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa120154140 0x7fa1200c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.864+0000 7fa1276f6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa120154520 con 0x7fa1200c1010 2023-08-17T17:51:57.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.864+0000 7fa1276f6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1200c91e0 con 0x7fa1200a7c40 2023-08-17T17:51:57.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.864+0000 7fa1276f6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1200c94c0 con 0x7fa120154140 2023-08-17T17:51:57.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.864+0000 7fa125c93700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa1200c1010 0x7fa1200ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41596/0 (socket says 172.21.15.78:41596) 2023-08-17T17:51:57.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.864+0000 7fa125c93700 1 -- 172.21.15.78:0/2553933608 learned_addr learned my addr 172.21.15.78:0/2553933608 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:57.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.864+0000 7fa125492700 1 --2- 172.21.15.78:0/2553933608 >> v2:172.21.15.150:3300/0 conn(0x7fa120154140 0x7fa1200c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551533709 0 0) 0x7fa120154520 con 0x7fa1200c1010 2023-08-17T17:51:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa10c0033f0 con 0x7fa1200c1010 2023-08-17T17:51:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2851885921 0 0) 0x7fa10c0033f0 con 0x7fa1200c1010 2023-08-17T17:51:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 >> v2:172.21.15.150:3300/0 conn(0x7fa120154140 msgr2=0x7fa1200c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 --2- 172.21.15.78:0/2553933608 >> v2:172.21.15.150:3300/0 conn(0x7fa120154140 0x7fa1200c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 >> v1:172.21.15.150:6789/0 conn(0x7fa1200a7c40 legacy=0x7fa1200c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200c97a0 con 0x7fa1200c1010 2023-08-17T17:51:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fa1180017f0 con 0x7fa1200c1010 2023-08-17T17:51:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 >> v1:172.21.15.78:6789/0 conn(0x7fa1200c1010 legacy=0x7fa1200ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa10c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa10c004690 0x7fa10c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa10c005000 0x7fa10c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200c94c0 con 0x7fa10c0038e0 2023-08-17T17:51:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c00bf60 con 0x7fa10c005000 2023-08-17T17:51:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c00c0f0 con 0x7fa10c004690 2023-08-17T17:51:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa125492700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa10c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa125c93700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa10c005000 0x7fa10c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa124c91700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa10c004690 0x7fa10c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa125492700 1 -- 172.21.15.78:0/2553933608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa10c004690 msgr2=0x7fa10c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:57.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa125492700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa10c004690 0x7fa10c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa125492700 1 -- 172.21.15.78:0/2553933608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa10c005000 msgr2=0x7fa10c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:57.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa125492700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa10c005000 0x7fa10c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa125492700 1 -- 172.21.15.78:0/2553933608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c0033f0 con 0x7fa10c0038e0 2023-08-17T17:51:57.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa125c93700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa10c005000 0x7fa10c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:57.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa125c93700 1 -- 172.21.15.78:0/2553933608 reap_dead start 2023-08-17T17:51:57.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa125492700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa10c003d00 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7fa11c009a60 tx=0x7fa11c009060).ready entity=mon.0 client_cookie=da5d84c1f9fb168e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:57.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.865+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c009ea0 con 0x7fa10c0038e0 2023-08-17T17:51:57.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.866+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c009430 con 0x7fa10c0038e0 2023-08-17T17:51:57.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.866+0000 7fa117fff700 1 -- 172.21.15.78:0/2553933608 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00e870 con 0x7fa10c0038e0 2023-08-17T17:51:57.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.866+0000 7fa1276f6700 1 -- 172.21.15.78:0/2553933608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 msgr2=0x7fa10c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.866+0000 7fa1276f6700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa10c003d00 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7fa11c009a60 tx=0x7fa11c009060).stop 2023-08-17T17:51:57.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.866+0000 7fa1276f6700 1 -- 172.21.15.78:0/2553933608 shutdown_connections 2023-08-17T17:51:57.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.866+0000 7fa1276f6700 1 --2- 172.21.15.78:0/2553933608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa10c003d00 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.866+0000 7fa1276f6700 1 -- 172.21.15.78:0/2553933608 >> 172.21.15.78:0/2553933608 conn(0x7fa120094510 msgr2=0x7fa12006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:57.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.866+0000 7fa1276f6700 1 -- 172.21.15.78:0/2553933608 shutdown_connections 2023-08-17T17:51:57.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.866+0000 7fa1276f6700 1 -- 172.21.15.78:0/2553933608 wait complete. 2023-08-17T17:51:57.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.867+0000 7fa1276f6700 1 Processor -- start 2023-08-17T17:51:57.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.867+0000 7fa1276f6700 1 -- start start 2023-08-17T17:51:57.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa1276f6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa12014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa1276f6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa120063bf0 0x7fa120064070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa1276f6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1200aa970 0x7fa1200aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa1276f6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200abbb0 con 0x7fa10c0038e0 2023-08-17T17:51:57.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa1276f6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa120064560 con 0x7fa120063bf0 2023-08-17T17:51:57.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa1276f6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200ab5f0 con 0x7fa1200aa970 2023-08-17T17:51:57.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa125492700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa12014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa125492700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa12014ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35410/0 (socket says 172.21.15.78:35410) 2023-08-17T17:51:57.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa125492700 1 -- 172.21.15.78:0/3635090914 learned_addr learned my addr 172.21.15.78:0/3635090914 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:57.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa124c91700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa120063bf0 0x7fa120064070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa125c93700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1200aa970 0x7fa1200aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa125492700 1 -- 172.21.15.78:0/3635090914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1200aa970 msgr2=0x7fa1200aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa125492700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1200aa970 0x7fa1200aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa125492700 1 -- 172.21.15.78:0/3635090914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa120063bf0 msgr2=0x7fa120064070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:57.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa125492700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa120063bf0 0x7fa120064070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:57.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa125492700 1 -- 172.21.15.78:0/3635090914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200ab8d0 con 0x7fa10c0038e0 2023-08-17T17:51:57.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.868+0000 7fa125c93700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1200aa970 0x7fa1200aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:57.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.869+0000 7fa125492700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa12014ec50 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7fa10c005640 tx=0x7fa11c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:57.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.869+0000 7fa1157fa700 1 -- 172.21.15.78:0/3635090914 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c01ba60 con 0x7fa10c0038e0 2023-08-17T17:51:57.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.869+0000 7fa1157fa700 1 -- 172.21.15.78:0/3635090914 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c01bbe0 con 0x7fa10c0038e0 2023-08-17T17:51:57.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.869+0000 7fa1276f6700 1 -- 172.21.15.78:0/3635090914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1200adee0 con 0x7fa10c0038e0 2023-08-17T17:51:57.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.869+0000 7fa1157fa700 1 -- 172.21.15.78:0/3635090914 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c025440 con 0x7fa10c0038e0 2023-08-17T17:51:57.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.869+0000 7fa1276f6700 1 -- 172.21.15.78:0/3635090914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1200ab2e0 con 0x7fa10c0038e0 2023-08-17T17:51:57.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.870+0000 7fa1276f6700 1 -- 172.21.15.78:0/3635090914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1200ae380 con 0x7fa10c0038e0 2023-08-17T17:51:57.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.870+0000 7fa1157fa700 1 -- 172.21.15.78:0/3635090914 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa11c02b020 con 0x7fa10c0038e0 2023-08-17T17:51:57.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.870+0000 7fa1157fa700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa10405ed90 0x7fa104061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:57.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.870+0000 7fa1157fa700 1 -- 172.21.15.78:0/3635090914 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa11c07b3d0 con 0x7fa10c0038e0 2023-08-17T17:51:57.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.870+0000 7fa124c91700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa10405ed90 0x7fa104061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:57.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.871+0000 7fa124c91700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa10405ed90 0x7fa104061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa1200ad3b0 tx=0x7fa110009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:57.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:57.875+0000 7fa1157fa700 1 -- 172.21.15.78:0/3635090914 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa11c04c860 con 0x7fa10c0038e0 2023-08-17T17:51:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.038+0000 7fa1276f6700 1 -- 172.21.15.78:0/3635090914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1200ae530 con 0x7fa10c0038e0 2023-08-17T17:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.039+0000 7fa1157fa700 1 -- 172.21.15.78:0/3635090914 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+17004 (secure 0 0 0) 0x7fa11c016020 con 0x7fa10c0038e0 2023-08-17T17:51:58.041 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:58.041 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":120,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:51:57.714597+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:51:56.265536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T17:51:56.677038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:51:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 -- 172.21.15.78:0/3635090914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa10405ed90 msgr2=0x7fa104061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa10405ed90 0x7fa104061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa1200ad3b0 tx=0x7fa110009040).stop 2023-08-17T17:51:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 -- 172.21.15.78:0/3635090914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 msgr2=0x7fa12014ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa12014ec50 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7fa10c005640 tx=0x7fa11c01a000).stop 2023-08-17T17:51:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 -- 172.21.15.78:0/3635090914 shutdown_connections 2023-08-17T17:51:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa10405ed90 0x7fa104061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1200aa970 0x7fa1200aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa10c0038e0 0x7fa12014ec50 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 --2- 172.21.15.78:0/3635090914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa120063bf0 0x7fa120064070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 -- 172.21.15.78:0/3635090914 >> 172.21.15.78:0/3635090914 conn(0x7fa120094510 msgr2=0x7fa1201535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 -- 172.21.15.78:0/3635090914 shutdown_connections 2023-08-17T17:51:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.041+0000 7fa1276f6700 1 -- 172.21.15.78:0/3635090914 wait complete. 2023-08-17T17:51:58.055 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:51:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.167+0000 7f912c9cf700 1 Processor -- start 2023-08-17T17:51:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.167+0000 7f912c9cf700 1 -- start start 2023-08-17T17:51:58.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f912c9cf700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f91280c01b0 0x7f91280c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f912c9cf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f91280a7bd0 0x7f9128063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f912c9cf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 0x7f91280642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f912c9cf700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9128063960 con 0x7f91280c01b0 2023-08-17T17:51:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f912c9cf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9128063030 con 0x7f91280a7bd0 2023-08-17T17:51:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f912c9cf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9128063310 con 0x7f91280a8050 2023-08-17T17:51:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f91277fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f91280c01b0 0x7f91280c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f91277fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f91280c01b0 0x7f91280c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35414/0 (socket says 172.21.15.78:35414) 2023-08-17T17:51:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f91277fe700 1 -- 172.21.15.78:0/585182376 learned_addr learned my addr 172.21.15.78:0/585182376 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:58.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f9127fff700 1 --2- 172.21.15.78:0/585182376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 0x7f91280642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f91277fe700 1 -- 172.21.15.78:0/585182376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 msgr2=0x7f91280642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:58.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f9126ffd700 1 --2- 172.21.15.78:0/585182376 >> v2:172.21.15.150:3300/0 conn(0x7f91280a7bd0 0x7f9128063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f91277fe700 1 --2- 172.21.15.78:0/585182376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 0x7f91280642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f91277fe700 1 -- 172.21.15.78:0/585182376 >> v2:172.21.15.150:3300/0 conn(0x7f91280a7bd0 msgr2=0x7f9128063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:58.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f91277fe700 1 --2- 172.21.15.78:0/585182376 >> v2:172.21.15.150:3300/0 conn(0x7f91280a7bd0 0x7f9128063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f91277fe700 1 -- 172.21.15.78:0/585182376 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280635f0 con 0x7f91280c01b0 2023-08-17T17:51:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f9127fff700 1 --2- 172.21.15.78:0/585182376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 0x7f91280642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f9126ffd700 1 --2- 172.21.15.78:0/585182376 >> v2:172.21.15.150:3300/0 conn(0x7f91280a7bd0 0x7f9128063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f91277fe700 1 --2- 172.21.15.78:0/585182376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280c01b0 0x7f91280c5b90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f9128098d60 tx=0x7f91180090f0).ready entity=mon.0 client_cookie=9ce95d56463aab00 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.168+0000 7f91267fc700 1 -- 172.21.15.78:0/585182376 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800b600 con 0x7f91280c01b0 2023-08-17T17:51:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f91267fc700 1 -- 172.21.15.78:0/585182376 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911800b760 con 0x7f91280c01b0 2023-08-17T17:51:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f91267fc700 1 -- 172.21.15.78:0/585182376 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800bae0 con 0x7f91280c01b0 2023-08-17T17:51:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f912c9cf700 1 -- 172.21.15.78:0/585182376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280c01b0 msgr2=0x7f91280c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f912c9cf700 1 --2- 172.21.15.78:0/585182376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280c01b0 0x7f91280c5b90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f9128098d60 tx=0x7f91180090f0).stop 2023-08-17T17:51:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f912c9cf700 1 -- 172.21.15.78:0/585182376 shutdown_connections 2023-08-17T17:51:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f912c9cf700 1 --2- 172.21.15.78:0/585182376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280c01b0 0x7f91280c5b90 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f912c9cf700 1 --2- 172.21.15.78:0/585182376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 0x7f91280642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f912c9cf700 1 --2- 172.21.15.78:0/585182376 >> v2:172.21.15.150:3300/0 conn(0x7f91280a7bd0 0x7f9128063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f912c9cf700 1 -- 172.21.15.78:0/585182376 >> 172.21.15.78:0/585182376 conn(0x7f912806a6c0 msgr2=0x7f91280cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f912c9cf700 1 -- 172.21.15.78:0/585182376 shutdown_connections 2023-08-17T17:51:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.169+0000 7f912c9cf700 1 -- 172.21.15.78:0/585182376 wait complete. 2023-08-17T17:51:58.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.170+0000 7f912c9cf700 1 Processor -- start 2023-08-17T17:51:58.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.170+0000 7f912c9cf700 1 -- start start 2023-08-17T17:51:58.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f912c9cf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280a7bd0 0x7f91281644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f912c9cf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 0x7f91281649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f912c9cf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91280c01b0 0x7f91280acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f912c9cf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128167fe0 con 0x7f91280a7bd0 2023-08-17T17:51:58.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f912c9cf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128167410 con 0x7f91280c01b0 2023-08-17T17:51:58.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f912c9cf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91281676b0 con 0x7f91280a8050 2023-08-17T17:51:58.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f91277fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280a7bd0 0x7f91281644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f91277fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280a7bd0 0x7f91281644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35426/0 (socket says 172.21.15.78:35426) 2023-08-17T17:51:58.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f91277fe700 1 -- 172.21.15.78:0/1059824230 learned_addr learned my addr 172.21.15.78:0/1059824230 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:58.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f9126ffd700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 0x7f91281649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f9127fff700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91280c01b0 0x7f91280acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f91277fe700 1 -- 172.21.15.78:0/1059824230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 msgr2=0x7f91281649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f91277fe700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 0x7f91281649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f91277fe700 1 -- 172.21.15.78:0/1059824230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91280c01b0 msgr2=0x7f91280acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.171+0000 7f91277fe700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91280c01b0 0x7f91280acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.172+0000 7f91277fe700 1 -- 172.21.15.78:0/1059824230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118009370 con 0x7f91280a7bd0 2023-08-17T17:51:58.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.172+0000 7f91277fe700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280a7bd0 0x7f91281644b0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f9118009130 tx=0x7f9118017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:58.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.172+0000 7f910f7fe700 1 -- 172.21.15.78:0/1059824230 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800b8d0 con 0x7f91280a7bd0 2023-08-17T17:51:58.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.172+0000 7f910f7fe700 1 -- 172.21.15.78:0/1059824230 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911800ba30 con 0x7f91280a7bd0 2023-08-17T17:51:58.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.172+0000 7f912c9cf700 1 -- 172.21.15.78:0/1059824230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9128167990 con 0x7f91280a7bd0 2023-08-17T17:51:58.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.172+0000 7f910f7fe700 1 -- 172.21.15.78:0/1059824230 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911801c670 con 0x7f91280a7bd0 2023-08-17T17:51:58.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.172+0000 7f912c9cf700 1 -- 172.21.15.78:0/1059824230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91280ad490 con 0x7f91280a7bd0 2023-08-17T17:51:58.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.173+0000 7f912c9cf700 1 -- 172.21.15.78:0/1059824230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9128083af0 con 0x7f91280a7bd0 2023-08-17T17:51:58.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.173+0000 7f910f7fe700 1 -- 172.21.15.78:0/1059824230 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f911800f070 con 0x7f91280a7bd0 2023-08-17T17:51:58.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.173+0000 7f910f7fe700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f911405ed90 0x7f9114061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.173+0000 7f910f7fe700 1 -- 172.21.15.78:0/1059824230 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f911807b2a0 con 0x7f91280a7bd0 2023-08-17T17:51:58.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.173+0000 7f9126ffd700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f911405ed90 0x7f9114061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.174+0000 7f9126ffd700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f911405ed90 0x7f9114061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f91281573f0 tx=0x7f911c008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:58.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.178+0000 7f910f7fe700 1 -- 172.21.15.78:0/1059824230 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f911804c840 con 0x7f91280a7bd0 2023-08-17T17:51:58.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.341+0000 7f912c9cf700 1 -- 172.21.15.78:0/1059824230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91280c63e0 con 0x7f91280a7bd0 2023-08-17T17:51:58.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.342+0000 7f910f7fe700 1 -- 172.21.15.78:0/1059824230 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+17004 (secure 0 0 0) 0x7f9118020020 con 0x7f91280a7bd0 2023-08-17T17:51:58.344 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:51:58.344 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":120,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:51:57.714597+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:51:56.265536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T17:51:56.677038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:51:58.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 -- 172.21.15.78:0/1059824230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f911405ed90 msgr2=0x7f9114061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f911405ed90 0x7f9114061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f91281573f0 tx=0x7f911c008040).stop 2023-08-17T17:51:58.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 -- 172.21.15.78:0/1059824230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280a7bd0 msgr2=0x7f91281644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280a7bd0 0x7f91281644b0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f9118009130 tx=0x7f9118017000).stop 2023-08-17T17:51:58.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 -- 172.21.15.78:0/1059824230 shutdown_connections 2023-08-17T17:51:58.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f911405ed90 0x7f9114061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91280c01b0 0x7f91280acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91280a7bd0 0x7f91281644b0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 --2- 172.21.15.78:0/1059824230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91280a8050 0x7f91281649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 -- 172.21.15.78:0/1059824230 >> 172.21.15.78:0/1059824230 conn(0x7f912806a6c0 msgr2=0x7f91280c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 -- 172.21.15.78:0/1059824230 shutdown_connections 2023-08-17T17:51:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.344+0000 7f912c9cf700 1 -- 172.21.15.78:0/1059824230 wait complete. 2023-08-17T17:51:58.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T17:51:58.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.472+0000 7f3b33975700 1 Processor -- start 2023-08-17T17:51:58.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.472+0000 7f3b33975700 1 -- start start 2023-08-17T17:51:58.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.473+0000 7f3b33975700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b2c0aa4d0 0x7f3b2c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.473+0000 7f3b33975700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0649b0 con 0x7f3b2c0aa0f0 2023-08-17T17:51:58.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.473+0000 7f3b33975700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c063420 con 0x7f3b2c0c5810 2023-08-17T17:51:58.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.473+0000 7f3b33975700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c063700 con 0x7f3b2c0aa4d0 2023-08-17T17:51:58.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.473+0000 7f3b31711700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3b2c0aa0f0 0x7f3b2c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41606/0 (socket says 172.21.15.78:41606) 2023-08-17T17:51:58.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.473+0000 7f3b31711700 1 -- 172.21.15.78:0/3153296445 learned_addr learned my addr 172.21.15.78:0/3153296445 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:51:58.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.473+0000 7f3b30f10700 1 --2- 172.21.15.78:0/3153296445 >> v2:172.21.15.150:3300/0 conn(0x7f3b2c0aa4d0 0x7f3b2c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.473+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425539898 0 0) 0x7f3b2c0649b0 con 0x7f3b2c0aa0f0 2023-08-17T17:51:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.473+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b180033f0 con 0x7f3b2c0aa0f0 2023-08-17T17:51:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295354635 0 0) 0x7f3b2c063420 con 0x7f3b2c0c5810 2023-08-17T17:51:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b2c0649b0 con 0x7f3b2c0c5810 2023-08-17T17:51:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1931565260 0 0) 0x7f3b180033f0 con 0x7f3b2c0aa0f0 2023-08-17T17:51:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 >> v2:172.21.15.150:3300/0 conn(0x7f3b2c0aa4d0 msgr2=0x7f3b2c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 --2- 172.21.15.78:0/3153296445 >> v2:172.21.15.150:3300/0 conn(0x7f3b2c0aa4d0 0x7f3b2c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 >> v1:172.21.15.150:6789/0 conn(0x7f3b2c0c5810 legacy=0x7f3b2c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0639e0 con 0x7f3b2c0aa0f0 2023-08-17T17:51:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3b28001470 con 0x7f3b2c0aa0f0 2023-08-17T17:51:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 >> v1:172.21.15.78:6789/0 conn(0x7f3b2c0aa0f0 legacy=0x7f3b2c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b18003ac0 0x7f3b18003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b18004690 0x7f3b18004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b18005000 0x7f3b1800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c063700 con 0x7f3b18005000 2023-08-17T17:51:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1800beb0 con 0x7f3b18003ac0 2023-08-17T17:51:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1800c070 con 0x7f3b18004690 2023-08-17T17:51:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b31f12700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b18005000 0x7f3b1800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b31711700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b18003ac0 0x7f3b18003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b30f10700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b18004690 0x7f3b18004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b31f12700 1 -- 172.21.15.78:0/3153296445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b18004690 msgr2=0x7f3b18004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b31f12700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b18004690 0x7f3b18004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b31f12700 1 -- 172.21.15.78:0/3153296445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b18003ac0 msgr2=0x7f3b18003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:58.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b31f12700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b18003ac0 0x7f3b18003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b31f12700 1 -- 172.21.15.78:0/3153296445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180033f0 con 0x7f3b18005000 2023-08-17T17:51:58.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b31f12700 1 -- 172.21.15.78:0/3153296445 reap_dead start 2023-08-17T17:51:58.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b31f12700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b18005000 0x7f3b1800b8e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f3b24001f90 tx=0x7f3b24007f30).ready entity=mon.0 client_cookie=a2aaaa98daa40da0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:58.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240020f0 con 0x7f3b18005000 2023-08-17T17:51:58.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24006a20 con 0x7f3b18005000 2023-08-17T17:51:58.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.474+0000 7f3b23fff700 1 -- 172.21.15.78:0/3153296445 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24006da0 con 0x7f3b18005000 2023-08-17T17:51:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.475+0000 7f3b33975700 1 -- 172.21.15.78:0/3153296445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b18005000 msgr2=0x7f3b1800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.475+0000 7f3b33975700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b18005000 0x7f3b1800b8e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f3b24001f90 tx=0x7f3b24007f30).stop 2023-08-17T17:51:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.475+0000 7f3b33975700 1 -- 172.21.15.78:0/3153296445 shutdown_connections 2023-08-17T17:51:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.475+0000 7f3b33975700 1 --2- 172.21.15.78:0/3153296445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b18005000 0x7f3b1800b8e0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.475+0000 7f3b33975700 1 -- 172.21.15.78:0/3153296445 >> 172.21.15.78:0/3153296445 conn(0x7f3b2c06a6a0 msgr2=0x7f3b2c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.475+0000 7f3b33975700 1 -- 172.21.15.78:0/3153296445 shutdown_connections 2023-08-17T17:51:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.475+0000 7f3b33975700 1 -- 172.21.15.78:0/3153296445 wait complete. 2023-08-17T17:51:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.476+0000 7f3b33975700 1 Processor -- start 2023-08-17T17:51:58.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.476+0000 7f3b33975700 1 -- start start 2023-08-17T17:51:58.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b33975700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b18005000 0x7f3b2c168120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b33975700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b2c158790 0x7f3b2c1655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b33975700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2c0acb00 0x7f3b2c0acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b33975700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c152760 con 0x7f3b2c0acb00 2023-08-17T17:51:58.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b33975700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0c1a90 con 0x7f3b18005000 2023-08-17T17:51:58.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b33975700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0ad470 con 0x7f3b2c158790 2023-08-17T17:51:58.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b31f12700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2c0acb00 0x7f3b2c0acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b31f12700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2c0acb00 0x7f3b2c0acf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35442/0 (socket says 172.21.15.78:35442) 2023-08-17T17:51:58.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b31f12700 1 -- 172.21.15.78:0/2745035124 learned_addr learned my addr 172.21.15.78:0/2745035124 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:58.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b31711700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b18005000 0x7f3b2c168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b30f10700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b2c158790 0x7f3b2c1655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.477+0000 7f3b31f12700 1 -- 172.21.15.78:0/2745035124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b2c158790 msgr2=0x7f3b2c1655b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.478+0000 7f3b31f12700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b2c158790 0x7f3b2c1655b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.478+0000 7f3b31f12700 1 -- 172.21.15.78:0/2745035124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b18005000 msgr2=0x7f3b2c168120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.478+0000 7f3b31f12700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b18005000 0x7f3b2c168120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.478+0000 7f3b31f12700 1 -- 172.21.15.78:0/2745035124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c158c10 con 0x7f3b2c0acb00 2023-08-17T17:51:58.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.478+0000 7f3b31f12700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2c0acb00 0x7f3b2c0acf80 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f3b2c05e200 tx=0x7f3b24016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:58.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.478+0000 7f3b217fa700 1 -- 172.21.15.78:0/2745035124 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24013e50 con 0x7f3b2c0acb00 2023-08-17T17:51:58.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.478+0000 7f3b217fa700 1 -- 172.21.15.78:0/2745035124 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2401d430 con 0x7f3b2c0acb00 2023-08-17T17:51:58.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.478+0000 7f3b33975700 1 -- 172.21.15.78:0/2745035124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c168700 con 0x7f3b2c0acb00 2023-08-17T17:51:58.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.478+0000 7f3b217fa700 1 -- 172.21.15.78:0/2745035124 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2401d7d0 con 0x7f3b2c0acb00 2023-08-17T17:51:58.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.478+0000 7f3b33975700 1 -- 172.21.15.78:0/2745035124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c168cc0 con 0x7f3b2c0acb00 2023-08-17T17:51:58.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.479+0000 7f3b33975700 1 -- 172.21.15.78:0/2745035124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c083980 con 0x7f3b2c0acb00 2023-08-17T17:51:58.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.479+0000 7f3b217fa700 1 -- 172.21.15.78:0/2745035124 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3b24024030 con 0x7f3b2c0acb00 2023-08-17T17:51:58.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.479+0000 7f3b217fa700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b1005ed90 0x7f3b10061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.480+0000 7f3b217fa700 1 -- 172.21.15.78:0/2745035124 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3b2407aa70 con 0x7f3b2c0acb00 2023-08-17T17:51:58.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.480+0000 7f3b31711700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b1005ed90 0x7f3b10061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.480+0000 7f3b31711700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b1005ed90 0x7f3b10061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3b28001e30 tx=0x7f3b28001d20).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:58.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.484+0000 7f3b217fa700 1 -- 172.21.15.78:0/2745035124 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b2404c0c0 con 0x7f3b2c0acb00 2023-08-17T17:51:58.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.687+0000 7f3b33975700 1 -- 172.21.15.78:0/2745035124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3b2c0c1bd0 con 0x7f3b2c0acb00 2023-08-17T17:51:58.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.718+0000 7f3b217fa700 1 -- 172.21.15.78:0/2745035124 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3b2c0c1bd0 con 0x7f3b2c0acb00 2023-08-17T17:51:58.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 -- 172.21.15.78:0/2745035124 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b1005ed90 msgr2=0x7f3b10061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b1005ed90 0x7f3b10061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3b28001e30 tx=0x7f3b28001d20).stop 2023-08-17T17:51:58.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 -- 172.21.15.78:0/2745035124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2c0acb00 msgr2=0x7f3b2c0acf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2c0acb00 0x7f3b2c0acf80 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f3b2c05e200 tx=0x7f3b24016000).stop 2023-08-17T17:51:58.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 -- 172.21.15.78:0/2745035124 shutdown_connections 2023-08-17T17:51:58.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b1005ed90 0x7f3b10061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2c0acb00 0x7f3b2c0acf80 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b18005000 0x7f3b2c168120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 --2- 172.21.15.78:0/2745035124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b2c158790 0x7f3b2c1655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 -- 172.21.15.78:0/2745035124 >> 172.21.15.78:0/2745035124 conn(0x7f3b2c06a6a0 msgr2=0x7f3b2c0a84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:58.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 -- 172.21.15.78:0/2745035124 shutdown_connections 2023-08-17T17:51:58.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.720+0000 7f3b33975700 1 -- 172.21.15.78:0/2745035124 wait complete. 2023-08-17T17:51:58.734 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T17:51:58.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T17:51:58.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.849+0000 7f1f1964c700 1 Processor -- start 2023-08-17T17:51:58.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.849+0000 7f1f1964c700 1 -- start start 2023-08-17T17:51:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f1964c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f140aa0f0 0x7f1f140644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f1964c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa4d0 0x7f1f140c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f1964c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1f140c5810 0x7f1f140c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f1964c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140649b0 con 0x7f1f140aa0f0 2023-08-17T17:51:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f1964c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140c6120 con 0x7f1f140c5810 2023-08-17T17:51:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f1964c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14063420 con 0x7f1f140aa4d0 2023-08-17T17:51:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f12ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f140aa0f0 0x7f1f140644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f12ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f140aa0f0 0x7f1f140644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37420/0 (socket says 172.21.15.78:37420) 2023-08-17T17:51:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f12ffd700 1 -- 172.21.15.78:0/4177418726 learned_addr learned my addr 172.21.15.78:0/4177418726 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f137fe700 1 --2- 172.21.15.78:0/4177418726 >> v2:172.21.15.150:3300/0 conn(0x7f1f140c5810 0x7f1f140c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.850+0000 7f1f0a7fc700 1 --2- 172.21.15.78:0/4177418726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa4d0 0x7f1f140c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f12ffd700 1 -- 172.21.15.78:0/4177418726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa4d0 msgr2=0x7f1f140c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f12ffd700 1 --2- 172.21.15.78:0/4177418726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa4d0 0x7f1f140c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f12ffd700 1 -- 172.21.15.78:0/4177418726 >> v2:172.21.15.150:3300/0 conn(0x7f1f140c5810 msgr2=0x7f1f140c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f12ffd700 1 --2- 172.21.15.78:0/4177418726 >> v2:172.21.15.150:3300/0 conn(0x7f1f140c5810 0x7f1f140c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f12ffd700 1 -- 172.21.15.78:0/4177418726 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f14063700 con 0x7f1f140aa0f0 2023-08-17T17:51:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f0a7fc700 1 --2- 172.21.15.78:0/4177418726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa4d0 0x7f1f140c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:58.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f12ffd700 1 --2- 172.21.15.78:0/4177418726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa0f0 0x7f1f140644c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f1f14159060 tx=0x7f1f040090f0).ready entity=mon.0 client_cookie=51c5a337c5a830aa server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:58.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f127fc700 1 -- 172.21.15.78:0/4177418726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400b520 con 0x7f1f140aa0f0 2023-08-17T17:51:58.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f127fc700 1 -- 172.21.15.78:0/4177418726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0400b680 con 0x7f1f140aa0f0 2023-08-17T17:51:58.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f127fc700 1 -- 172.21.15.78:0/4177418726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400ba00 con 0x7f1f140aa0f0 2023-08-17T17:51:58.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f1964c700 1 -- 172.21.15.78:0/4177418726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa0f0 msgr2=0x7f1f140644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.851+0000 7f1f1964c700 1 --2- 172.21.15.78:0/4177418726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa0f0 0x7f1f140644c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f1f14159060 tx=0x7f1f040090f0).stop 2023-08-17T17:51:58.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.852+0000 7f1f1964c700 1 -- 172.21.15.78:0/4177418726 shutdown_connections 2023-08-17T17:51:58.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.852+0000 7f1f1964c700 1 --2- 172.21.15.78:0/4177418726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa0f0 0x7f1f140644c0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.852+0000 7f1f1964c700 1 --2- 172.21.15.78:0/4177418726 >> v2:172.21.15.150:3300/0 conn(0x7f1f140c5810 0x7f1f140c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.852+0000 7f1f1964c700 1 --2- 172.21.15.78:0/4177418726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa4d0 0x7f1f140c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.852+0000 7f1f1964c700 1 -- 172.21.15.78:0/4177418726 >> 172.21.15.78:0/4177418726 conn(0x7f1f1406a6a0 msgr2=0x7f1f140caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:58.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.852+0000 7f1f1964c700 1 -- 172.21.15.78:0/4177418726 shutdown_connections 2023-08-17T17:51:58.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.852+0000 7f1f1964c700 1 -- 172.21.15.78:0/4177418726 wait complete. 2023-08-17T17:51:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.853+0000 7f1f1964c700 1 Processor -- start 2023-08-17T17:51:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.853+0000 7f1f1964c700 1 -- start start 2023-08-17T17:51:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f1964c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa0f0 0x7f1f140ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f1964c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa4d0 0x7f1f141644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f1964c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f140c5810 0x7f1f140b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f1964c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c29c0 con 0x7f1f140aa4d0 2023-08-17T17:51:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f1964c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c2bd0 con 0x7f1f140c5810 2023-08-17T17:51:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f1964c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c2eb0 con 0x7f1f140aa0f0 2023-08-17T17:51:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa4d0 0x7f1f141644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa4d0 0x7f1f141644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37426/0 (socket says 172.21.15.78:37426) 2023-08-17T17:51:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0a7fc700 1 -- 172.21.15.78:0/72616169 learned_addr learned my addr 172.21.15.78:0/72616169 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f12ffd700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa0f0 0x7f1f140ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f137fe700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f140c5810 0x7f1f140b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0a7fc700 1 -- 172.21.15.78:0/72616169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa0f0 msgr2=0x7f1f140ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0a7fc700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa0f0 0x7f1f140ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0a7fc700 1 -- 172.21.15.78:0/72616169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f140c5810 msgr2=0x7f1f140b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0a7fc700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f140c5810 0x7f1f140b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0a7fc700 1 -- 172.21.15.78:0/72616169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04009370 con 0x7f1f140aa4d0 2023-08-17T17:51:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0a7fc700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa4d0 0x7f1f141644c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f1efc00d860 tx=0x7f1efc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0b7fe700 1 -- 172.21.15.78:0/72616169 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc011590 con 0x7f1f140aa4d0 2023-08-17T17:51:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0b7fe700 1 -- 172.21.15.78:0/72616169 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc0116f0 con 0x7f1f140aa4d0 2023-08-17T17:51:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f1964c700 1 -- 172.21.15.78:0/72616169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f140c3190 con 0x7f1f140aa4d0 2023-08-17T17:51:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f0b7fe700 1 -- 172.21.15.78:0/72616169 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc011a70 con 0x7f1f140aa4d0 2023-08-17T17:51:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.854+0000 7f1f1964c700 1 -- 172.21.15.78:0/72616169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f140ac910 con 0x7f1f140aa4d0 2023-08-17T17:51:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.855+0000 7f1f1964c700 1 -- 172.21.15.78:0/72616169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f14083980 con 0x7f1f140aa4d0 2023-08-17T17:51:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.856+0000 7f1f0b7fe700 1 -- 172.21.15.78:0/72616169 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1efc012420 con 0x7f1f140aa4d0 2023-08-17T17:51:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.856+0000 7f1f0b7fe700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ef405ed90 0x7f1ef4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:58.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.856+0000 7f1f0b7fe700 1 -- 172.21.15.78:0/72616169 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1efc079850 con 0x7f1f140aa4d0 2023-08-17T17:51:58.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.856+0000 7f1f12ffd700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ef405ed90 0x7f1ef4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:58.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.856+0000 7f1f12ffd700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ef405ed90 0x7f1ef4061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1f04009130 tx=0x7f1f04017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:58.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:58.860+0000 7f1f0b7fe700 1 -- 172.21.15.78:0/72616169 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1efc04ad90 con 0x7f1f140aa4d0 2023-08-17T17:51:59.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.068+0000 7f1f1964c700 1 -- 172.21.15.78:0/72616169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1f14046af0 con 0x7f1f140aa4d0 2023-08-17T17:51:59.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.722+0000 7f1f0b7fe700 1 -- 172.21.15.78:0/72616169 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1efc04e3b0 con 0x7f1f140aa4d0 2023-08-17T17:51:59.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 -- 172.21.15.78:0/72616169 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ef405ed90 msgr2=0x7f1ef4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:59.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ef405ed90 0x7f1ef4061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1f04009130 tx=0x7f1f04017000).stop 2023-08-17T17:51:59.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 -- 172.21.15.78:0/72616169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa4d0 msgr2=0x7f1f141644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:59.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa4d0 0x7f1f141644c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f1efc00d860 tx=0x7f1efc008040).stop 2023-08-17T17:51:59.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 -- 172.21.15.78:0/72616169 shutdown_connections 2023-08-17T17:51:59.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f1ef405ed90 0x7f1ef4061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f140c5810 0x7f1f140b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f140aa0f0 0x7f1f140ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 --2- 172.21.15.78:0/72616169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140aa4d0 0x7f1f141644c0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 -- 172.21.15.78:0/72616169 >> 172.21.15.78:0/72616169 conn(0x7f1f1406a6a0 msgr2=0x7f1f141517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:59.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 -- 172.21.15.78:0/72616169 shutdown_connections 2023-08-17T17:51:59.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.725+0000 7f1f1964c700 1 -- 172.21.15.78:0/72616169 wait complete. 2023-08-17T17:51:59.739 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T17:51:59.739 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:51:59.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.853+0000 7feb1c15e700 1 Processor -- start 2023-08-17T17:51:59.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.853+0000 7feb1c15e700 1 -- start start 2023-08-17T17:51:59.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb1c15e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feb14154140 0x7feb140c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:59.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb1c15e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a7c40 0x7feb140c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:59.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb1c15e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feb140a8080 0x7feb140c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:59.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb1c15e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140c12e0 con 0x7feb14154140 2023-08-17T17:51:59.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb1c15e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb14154520 con 0x7feb140a8080 2023-08-17T17:51:59.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb1c15e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c91e0 con 0x7feb140a7c40 2023-08-17T17:51:59.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb19efa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feb14154140 0x7feb140c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:59.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb19efa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feb14154140 0x7feb140c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37432/0 (socket says 172.21.15.78:37432) 2023-08-17T17:51:59.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb19efa700 1 -- 172.21.15.78:0/1341659542 learned_addr learned my addr 172.21.15.78:0/1341659542 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:59.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb196f9700 1 --2- 172.21.15.78:0/1341659542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a7c40 0x7feb140c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:59.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb1a6fb700 1 --2- 172.21.15.78:0/1341659542 >> v2:172.21.15.150:3300/0 conn(0x7feb140a8080 0x7feb140c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:59.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb19efa700 1 -- 172.21.15.78:0/1341659542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a7c40 msgr2=0x7feb140c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:59.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb19efa700 1 --2- 172.21.15.78:0/1341659542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a7c40 0x7feb140c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb19efa700 1 -- 172.21.15.78:0/1341659542 >> v2:172.21.15.150:3300/0 conn(0x7feb140a8080 msgr2=0x7feb140c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:51:59.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb19efa700 1 --2- 172.21.15.78:0/1341659542 >> v2:172.21.15.150:3300/0 conn(0x7feb140a8080 0x7feb140c0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb19efa700 1 -- 172.21.15.78:0/1341659542 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140c94c0 con 0x7feb14154140 2023-08-17T17:51:59.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb1a6fb700 1 --2- 172.21.15.78:0/1341659542 >> v2:172.21.15.150:3300/0 conn(0x7feb140a8080 0x7feb140c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:59.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb196f9700 1 --2- 172.21.15.78:0/1341659542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a7c40 0x7feb140c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:51:59.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb19efa700 1 --2- 172.21.15.78:0/1341659542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 0x7feb140c6ee0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7feb1406bd60 tx=0x7feb10009840).ready entity=mon.0 client_cookie=3f0ad85c45daa434 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:59.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb18ef8700 1 -- 172.21.15.78:0/1341659542 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1000e070 con 0x7feb14154140 2023-08-17T17:51:59.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb18ef8700 1 -- 172.21.15.78:0/1341659542 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1000ba50 con 0x7feb14154140 2023-08-17T17:51:59.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.854+0000 7feb18ef8700 1 -- 172.21.15.78:0/1341659542 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1000bdd0 con 0x7feb14154140 2023-08-17T17:51:59.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.855+0000 7feb1c15e700 1 -- 172.21.15.78:0/1341659542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 msgr2=0x7feb140c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:59.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.855+0000 7feb1c15e700 1 --2- 172.21.15.78:0/1341659542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 0x7feb140c6ee0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7feb1406bd60 tx=0x7feb10009840).stop 2023-08-17T17:51:59.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.855+0000 7feb1c15e700 1 -- 172.21.15.78:0/1341659542 shutdown_connections 2023-08-17T17:51:59.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.855+0000 7feb1c15e700 1 --2- 172.21.15.78:0/1341659542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 0x7feb140c6ee0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.855+0000 7feb1c15e700 1 --2- 172.21.15.78:0/1341659542 >> v2:172.21.15.150:3300/0 conn(0x7feb140a8080 0x7feb140c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.855+0000 7feb1c15e700 1 --2- 172.21.15.78:0/1341659542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a7c40 0x7feb140c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.855+0000 7feb1c15e700 1 -- 172.21.15.78:0/1341659542 >> 172.21.15.78:0/1341659542 conn(0x7feb14094510 msgr2=0x7feb1406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:51:59.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.855+0000 7feb1c15e700 1 -- 172.21.15.78:0/1341659542 shutdown_connections 2023-08-17T17:51:59.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.855+0000 7feb1c15e700 1 -- 172.21.15.78:0/1341659542 wait complete. 2023-08-17T17:51:59.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.856+0000 7feb1c15e700 1 Processor -- start 2023-08-17T17:51:59.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.856+0000 7feb1c15e700 1 -- start start 2023-08-17T17:51:59.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1c15e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb140a7c40 0x7feb140c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:59.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1c15e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a8080 0x7feb140aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:59.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1c15e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 0x7feb140c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:59.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1c15e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140ae530 con 0x7feb14154140 2023-08-17T17:51:59.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1c15e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c48e0 con 0x7feb140a7c40 2023-08-17T17:51:59.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1c15e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c4bc0 con 0x7feb140a8080 2023-08-17T17:51:59.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1a6fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 0x7feb140c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:59.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1a6fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 0x7feb140c32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37448/0 (socket says 172.21.15.78:37448) 2023-08-17T17:51:59.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1a6fb700 1 -- 172.21.15.78:0/1164822622 learned_addr learned my addr 172.21.15.78:0/1164822622 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:51:59.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb196f9700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a8080 0x7feb140aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:59.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb19efa700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb140a7c40 0x7feb140c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:59.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1a6fb700 1 -- 172.21.15.78:0/1164822622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a8080 msgr2=0x7feb140aae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:59.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1a6fb700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a8080 0x7feb140aae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1a6fb700 1 -- 172.21.15.78:0/1164822622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb140a7c40 msgr2=0x7feb140c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:51:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1a6fb700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb140a7c40 0x7feb140c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:51:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1a6fb700 1 -- 172.21.15.78:0/1164822622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb10009ae0 con 0x7feb14154140 2023-08-17T17:51:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb196f9700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a8080 0x7feb140aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:51:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb1a6fb700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 0x7feb140c32e0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7feb0c00c670 tx=0x7feb0c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.857+0000 7feb09ffb700 1 -- 172.21.15.78:0/1164822622 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c010580 con 0x7feb14154140 2023-08-17T17:51:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.858+0000 7feb09ffb700 1 -- 172.21.15.78:0/1164822622 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c0106e0 con 0x7feb14154140 2023-08-17T17:51:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.858+0000 7feb1c15e700 1 -- 172.21.15.78:0/1164822622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb140adee0 con 0x7feb14154140 2023-08-17T17:51:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.858+0000 7feb09ffb700 1 -- 172.21.15.78:0/1164822622 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c010a60 con 0x7feb14154140 2023-08-17T17:51:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.858+0000 7feb1c15e700 1 -- 172.21.15.78:0/1164822622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb140aab90 con 0x7feb14154140 2023-08-17T17:51:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.859+0000 7feb1c15e700 1 -- 172.21.15.78:0/1164822622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb140ae6e0 con 0x7feb14154140 2023-08-17T17:51:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.859+0000 7feb09ffb700 1 -- 172.21.15.78:0/1164822622 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feb0c01b460 con 0x7feb14154140 2023-08-17T17:51:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.859+0000 7feb09ffb700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf805ed90 0x7feaf8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:51:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.859+0000 7feb09ffb700 1 -- 172.21.15.78:0/1164822622 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feb0c079b60 con 0x7feb14154140 2023-08-17T17:51:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.859+0000 7feb19efa700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf805ed90 0x7feaf8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:51:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.860+0000 7feb19efa700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf805ed90 0x7feaf8061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7feb14167a00 tx=0x7feb10009840).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:51:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:51:59.863+0000 7feb09ffb700 1 -- 172.21.15.78:0/1164822622 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb0c04b0a0 con 0x7feb14154140 2023-08-17T17:52:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.066+0000 7feb1c15e700 1 -- 172.21.15.78:0/1164822622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb14047350 con 0x7feb14154140 2023-08-17T17:52:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.067+0000 7feb09ffb700 1 -- 172.21.15.78:0/1164822622 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7feb0c04e6c0 con 0x7feb14154140 2023-08-17T17:52:00.069 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:52:00.069 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2905752860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2905752860},{"type":"v1","addr":"172.21.15.150:6833","nonce":2905752860}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7620,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/652553934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":652553934},{"type":"v1","addr":"172.21.15.78:6836","nonce":652553934}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7623,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/728629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":728629628},{"type":"v1","addr":"172.21.15.78:6837","nonce":728629628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:51:57.714922+0000","modified":"2023-08-17T17:51:59.721521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7641":{"gid":7641,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3422834327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3422834327},{"type":"v1","addr":"172.21.15.150:6835","nonce":3422834327}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T17:52:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 -- 172.21.15.78:0/1164822622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf805ed90 msgr2=0x7feaf8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf805ed90 0x7feaf8061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7feb14167a00 tx=0x7feb10009840).stop 2023-08-17T17:52:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 -- 172.21.15.78:0/1164822622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 msgr2=0x7feb140c32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 0x7feb140c32e0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7feb0c00c670 tx=0x7feb0c008040).stop 2023-08-17T17:52:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 -- 172.21.15.78:0/1164822622 shutdown_connections 2023-08-17T17:52:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf805ed90 0x7feaf8061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb14154140 0x7feb140c32e0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb140a7c40 0x7feb140c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 --2- 172.21.15.78:0/1164822622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb140a8080 0x7feb140aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 -- 172.21.15.78:0/1164822622 >> 172.21.15.78:0/1164822622 conn(0x7feb14094510 msgr2=0x7feb140c6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 -- 172.21.15.78:0/1164822622 shutdown_connections 2023-08-17T17:52:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.069+0000 7feb1c15e700 1 -- 172.21.15.78:0/1164822622 wait complete. 2023-08-17T17:52:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 43 2023-08-17T17:52:00.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:52:00.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.193+0000 7fc4fd684700 1 Processor -- start 2023-08-17T17:52:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.193+0000 7fc4fd684700 1 -- start start 2023-08-17T17:52:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4fd684700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc4f80a7bd0 0x7fc4f8063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4fd684700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc4f80a8050 0x7fc4f80642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4fd684700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f8063960 con 0x7fc4f80c01b0 2023-08-17T17:52:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4fd684700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f8063030 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4fd684700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f8063310 con 0x7fc4f80a8050 2023-08-17T17:52:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4f77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc4f80a7bd0 0x7fc4f8063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4f7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc4f80c01b0 0x7fc4f80c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55658/0 (socket says 172.21.15.78:55658) 2023-08-17T17:52:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4f7fff700 1 -- 172.21.15.78:0/585389851 learned_addr learned my addr 172.21.15.78:0/585389851 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4f77fe700 1 -- 172.21.15.78:0/585389851 >> v2:172.21.15.150:3300/0 conn(0x7fc4f80a8050 msgr2=0x7fc4f80642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4f77fe700 1 --2- 172.21.15.78:0/585389851 >> v2:172.21.15.150:3300/0 conn(0x7fc4f80a8050 0x7fc4f80642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4f77fe700 1 -- 172.21.15.78:0/585389851 >> v1:172.21.15.78:6789/0 conn(0x7fc4f80c01b0 legacy=0x7fc4f80c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.194+0000 7fc4f6ffd700 1 -- 172.21.15.78:0/585389851 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562923038 0 0) 0x7fc4f8063960 con 0x7fc4f80c01b0 2023-08-17T17:52:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4f77fe700 1 -- 172.21.15.78:0/585389851 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f80635f0 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4f77fe700 1 --2- 172.21.15.78:0/585389851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 0x7fc4f8063df0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fc4f80cb970 tx=0x7fc4ec009060).ready entity=mon.0 client_cookie=684458581cf844a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4f6ffd700 1 -- 172.21.15.78:0/585389851 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00b580 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4f6ffd700 1 -- 172.21.15.78:0/585389851 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec00b6e0 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4f6ffd700 1 -- 172.21.15.78:0/585389851 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00ba60 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4fd684700 1 -- 172.21.15.78:0/585389851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 msgr2=0x7fc4f8063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4fd684700 1 --2- 172.21.15.78:0/585389851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 0x7fc4f8063df0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fc4f80cb970 tx=0x7fc4ec009060).stop 2023-08-17T17:52:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4fd684700 1 -- 172.21.15.78:0/585389851 shutdown_connections 2023-08-17T17:52:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4fd684700 1 --2- 172.21.15.78:0/585389851 >> v2:172.21.15.150:3300/0 conn(0x7fc4f80a8050 0x7fc4f80642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4fd684700 1 --2- 172.21.15.78:0/585389851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 0x7fc4f8063df0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4fd684700 1 -- 172.21.15.78:0/585389851 >> 172.21.15.78:0/585389851 conn(0x7fc4f806a6c0 msgr2=0x7fc4f80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4fd684700 1 -- 172.21.15.78:0/585389851 shutdown_connections 2023-08-17T17:52:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.195+0000 7fc4fd684700 1 -- 172.21.15.78:0/585389851 wait complete. 2023-08-17T17:52:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.196+0000 7fc4fd684700 1 Processor -- start 2023-08-17T17:52:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.197+0000 7fc4fd684700 1 -- start start 2023-08-17T17:52:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.197+0000 7fc4fd684700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 0x7fc4f81654c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.197+0000 7fc4fd684700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f80a8050 0x7fc4f8167160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.197+0000 7fc4fd684700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4f80c01b0 0x7fc4f8167980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.197+0000 7fc4fd684700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80b0e70 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.197+0000 7fc4fd684700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f8155d20 con 0x7fc4f80a8050 2023-08-17T17:52:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.197+0000 7fc4fd684700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80b0b90 con 0x7fc4f80c01b0 2023-08-17T17:52:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.197+0000 7fc4f7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 0x7fc4f81654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.197+0000 7fc4f7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 0x7fc4f81654c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37470/0 (socket says 172.21.15.78:37470) 2023-08-17T17:52:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.197+0000 7fc4f7fff700 1 -- 172.21.15.78:0/1519863359 learned_addr learned my addr 172.21.15.78:0/1519863359 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4f7fff700 1 -- 172.21.15.78:0/1519863359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4f80c01b0 msgr2=0x7fc4f8167980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4f7fff700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4f80c01b0 0x7fc4f8167980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4f7fff700 1 -- 172.21.15.78:0/1519863359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f80a8050 msgr2=0x7fc4f8167160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4f7fff700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f80a8050 0x7fc4f8167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4f7fff700 1 -- 172.21.15.78:0/1519863359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0092a0 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4f7fff700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 0x7fc4f81654c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7fc4e8001eb0 tx=0x7fc4e8007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4dffff700 1 -- 172.21.15.78:0/1519863359 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80072e0 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4dffff700 1 -- 172.21.15.78:0/1519863359 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e8007440 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4fd684700 1 -- 172.21.15.78:0/1519863359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f81556d0 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4dffff700 1 -- 172.21.15.78:0/1519863359 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80057a0 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.198+0000 7fc4fd684700 1 -- 172.21.15.78:0/1519863359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f8167650 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.199+0000 7fc4fd684700 1 -- 172.21.15.78:0/1519863359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f8083af0 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.199+0000 7fc4dffff700 1 -- 172.21.15.78:0/1519863359 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc4e801a060 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.199+0000 7fc4dffff700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4e405ed60 0x7fc4e4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.200+0000 7fc4dffff700 1 -- 172.21.15.78:0/1519863359 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc4e80792c0 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.200+0000 7fc4f77fe700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4e405ed60 0x7fc4e4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.200+0000 7fc4f77fe700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4e405ed60 0x7fc4e4061220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc4ec00b340 tx=0x7fc4ec017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.204+0000 7fc4dffff700 1 -- 172.21.15.78:0/1519863359 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4e804a860 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.367+0000 7fc4fd684700 1 -- 172.21.15.78:0/1519863359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4f80c63e0 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.368+0000 7fc4dffff700 1 -- 172.21.15.78:0/1519863359 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+16991 (secure 0 0 0) 0x7fc4e8018020 con 0x7fc4f80a7bd0 2023-08-17T17:52:00.370 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:52:00.370 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":121,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:51:58.716803+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:51:56.265536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T17:51:56.677038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:52:00.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 -- 172.21.15.78:0/1519863359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4e405ed60 msgr2=0x7fc4e4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4e405ed60 0x7fc4e4061220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc4ec00b340 tx=0x7fc4ec017000).stop 2023-08-17T17:52:00.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 -- 172.21.15.78:0/1519863359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 msgr2=0x7fc4f81654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 0x7fc4f81654c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7fc4e8001eb0 tx=0x7fc4e8007e90).stop 2023-08-17T17:52:00.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 -- 172.21.15.78:0/1519863359 shutdown_connections 2023-08-17T17:52:00.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc4e405ed60 0x7fc4e4061220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4f80c01b0 0x7fc4f8167980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:00.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f80a7bd0 0x7fc4f81654c0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 --2- 172.21.15.78:0/1519863359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f80a8050 0x7fc4f8167160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:00.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 -- 172.21.15.78:0/1519863359 >> 172.21.15.78:0/1519863359 conn(0x7fc4f806a6c0 msgr2=0x7fc4f80a8450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:00.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 -- 172.21.15.78:0/1519863359 shutdown_connections 2023-08-17T17:52:00.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.370+0000 7fc4fd684700 1 -- 172.21.15.78:0/1519863359 wait complete. 2023-08-17T17:52:00.383 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T17:52:00.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:52:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.495+0000 7f4410655700 1 Processor -- start 2023-08-17T17:52:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.495+0000 7f4410655700 1 -- start start 2023-08-17T17:52:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.496+0000 7f4410655700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4408154140 0x7f44080c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.496+0000 7f4410655700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f44080a7c40 0x7f44080c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.496+0000 7f4410655700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4408154520 con 0x7f44080a8080 2023-08-17T17:52:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.496+0000 7f4410655700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44080c91e0 con 0x7f44080a7c40 2023-08-17T17:52:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.496+0000 7f4410655700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44080c94c0 con 0x7f4408154140 2023-08-17T17:52:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440e3f1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4408154140 0x7f44080c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440dbf0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f44080a7c40 0x7f44080c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440dbf0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f44080a7c40 0x7f44080c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:46448/0 (socket says 172.21.15.78:46448) 2023-08-17T17:52:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440e3f1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4408154140 0x7f44080c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:38492/0 (socket says 172.21.15.78:38492) 2023-08-17T17:52:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440dbf0700 1 -- 172.21.15.78:0/3535418305 learned_addr learned my addr 172.21.15.78:0/3535418305 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440ebf2700 1 --1- 172.21.15.78:0/3535418305 >> v1:172.21.15.150:6789/0 conn(0x7f44080a8080 0x7f44080ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:55008/0 (socket says 172.21.15.78:55008) 2023-08-17T17:52:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440dbf0700 1 -- 172.21.15.78:0/3535418305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4408154140 msgr2=0x7f44080c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440dbf0700 1 --2- 172.21.15.78:0/3535418305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4408154140 0x7f44080c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440dbf0700 1 -- 172.21.15.78:0/3535418305 >> v1:172.21.15.150:6789/0 conn(0x7f44080a8080 legacy=0x7f44080ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440dbf0700 1 -- 172.21.15.78:0/3535418305 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44080c97a0 con 0x7f44080a7c40 2023-08-17T17:52:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440d3ef700 1 -- 172.21.15.78:0/3535418305 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544041485 0 0) 0x7f4408154520 con 0x7f44080a8080 2023-08-17T17:52:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440dbf0700 1 --2- 172.21.15.78:0/3535418305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44080a7c40 0x7f44080c0900 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f43f8006fd0 tx=0x7f43f80090f0).ready entity=mon.1 client_cookie=fecfe22088d2180d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440d3ef700 1 -- 172.21.15.78:0/3535418305 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f800b580 con 0x7f44080a7c40 2023-08-17T17:52:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440d3ef700 1 -- 172.21.15.78:0/3535418305 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f800b6e0 con 0x7f44080a7c40 2023-08-17T17:52:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.497+0000 7f440d3ef700 1 -- 172.21.15.78:0/3535418305 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f800ba60 con 0x7f44080a7c40 2023-08-17T17:52:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.498+0000 7f4410655700 1 -- 172.21.15.78:0/3535418305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44080a7c40 msgr2=0x7f44080c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.498+0000 7f4410655700 1 --2- 172.21.15.78:0/3535418305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44080a7c40 0x7f44080c0900 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f43f8006fd0 tx=0x7f43f80090f0).stop 2023-08-17T17:52:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.498+0000 7f4410655700 1 -- 172.21.15.78:0/3535418305 shutdown_connections 2023-08-17T17:52:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.498+0000 7f4410655700 1 --2- 172.21.15.78:0/3535418305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4408154140 0x7f44080c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.498+0000 7f4410655700 1 --2- 172.21.15.78:0/3535418305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44080a7c40 0x7f44080c0900 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.498+0000 7f4410655700 1 -- 172.21.15.78:0/3535418305 >> 172.21.15.78:0/3535418305 conn(0x7f4408094510 msgr2=0x7f440806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.498+0000 7f4410655700 1 -- 172.21.15.78:0/3535418305 shutdown_connections 2023-08-17T17:52:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.498+0000 7f4410655700 1 -- 172.21.15.78:0/3535418305 wait complete. 2023-08-17T17:52:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.499+0000 7f4410655700 1 Processor -- start 2023-08-17T17:52:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.499+0000 7f4410655700 1 -- start start 2023-08-17T17:52:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f4410655700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44080a7c40 0x7f440814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f4410655700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44080a8080 0x7f44080ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f4410655700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4408154140 0x7f44080ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f4410655700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080ac780 con 0x7f44080a7c40 2023-08-17T17:52:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f4410655700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080aca60 con 0x7f4408154140 2023-08-17T17:52:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f4410655700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44080acd40 con 0x7f44080a8080 2023-08-17T17:52:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440e3f1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44080a7c40 0x7f440814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440e3f1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44080a7c40 0x7f440814cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37478/0 (socket says 172.21.15.78:37478) 2023-08-17T17:52:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440e3f1700 1 -- 172.21.15.78:0/2431133407 learned_addr learned my addr 172.21.15.78:0/2431133407 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440dbf0700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44080a8080 0x7f44080ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440ebf2700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4408154140 0x7f44080ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440e3f1700 1 -- 172.21.15.78:0/2431133407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44080a8080 msgr2=0x7f44080ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440e3f1700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44080a8080 0x7f44080ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440e3f1700 1 -- 172.21.15.78:0/2431133407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4408154140 msgr2=0x7f44080ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440e3f1700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4408154140 0x7f44080ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440e3f1700 1 -- 172.21.15.78:0/2431133407 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f8009370 con 0x7f44080a7c40 2023-08-17T17:52:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.500+0000 7f440e3f1700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44080a7c40 0x7f440814cc30 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f440400e900 tx=0x7f4404009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.501+0000 7f43fe7fc700 1 -- 172.21.15.78:0/2431133407 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404012600 con 0x7f44080a7c40 2023-08-17T17:52:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.501+0000 7f43fe7fc700 1 -- 172.21.15.78:0/2431133407 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4404012760 con 0x7f44080a7c40 2023-08-17T17:52:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.501+0000 7f43fe7fc700 1 -- 172.21.15.78:0/2431133407 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404012ae0 con 0x7f44080a7c40 2023-08-17T17:52:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.501+0000 7f4410655700 1 -- 172.21.15.78:0/2431133407 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44080ad020 con 0x7f44080a7c40 2023-08-17T17:52:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.501+0000 7f4410655700 1 -- 172.21.15.78:0/2431133407 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440814d120 con 0x7f44080a7c40 2023-08-17T17:52:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.502+0000 7f4410655700 1 -- 172.21.15.78:0/2431133407 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44080842f0 con 0x7f44080a7c40 2023-08-17T17:52:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.502+0000 7f43fe7fc700 1 -- 172.21.15.78:0/2431133407 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4404022070 con 0x7f44080a7c40 2023-08-17T17:52:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.502+0000 7f43fe7fc700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f43ec05ed60 0x7f43ec061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.503+0000 7f43fe7fc700 1 -- 172.21.15.78:0/2431133407 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4404079c80 con 0x7f44080a7c40 2023-08-17T17:52:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.503+0000 7f440dbf0700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f43ec05ed60 0x7f43ec061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.503+0000 7f440dbf0700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f43ec05ed60 0x7f43ec061220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f43f8006fd0 tx=0x7f43f8017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.507+0000 7f43fe7fc700 1 -- 172.21.15.78:0/2431133407 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f440404b220 con 0x7f44080a7c40 2023-08-17T17:52:00.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.665+0000 7f4410655700 1 -- 172.21.15.78:0/2431133407 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4408047350 con 0x7f43ec05ed60 2023-08-17T17:52:00.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.675+0000 7f43fe7fc700 1 -- 172.21.15.78:0/2431133407 <== mgr.7446 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352795 (secure 0 0 0) 0x7f4408047350 con 0x7f43ec05ed60 2023-08-17T17:52:00.679 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:52:00.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 -- 172.21.15.78:0/2431133407 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f43ec05ed60 msgr2=0x7f43ec061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f43ec05ed60 0x7f43ec061220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f43f8006fd0 tx=0x7f43f8017000).stop 2023-08-17T17:52:00.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 -- 172.21.15.78:0/2431133407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44080a7c40 msgr2=0x7f440814cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44080a7c40 0x7f440814cc30 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f440400e900 tx=0x7f4404009060).stop 2023-08-17T17:52:00.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 -- 172.21.15.78:0/2431133407 shutdown_connections 2023-08-17T17:52:00.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f43ec05ed60 0x7f43ec061220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4408154140 0x7f44080ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44080a7c40 0x7f440814cc30 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 --2- 172.21.15.78:0/2431133407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44080a8080 0x7f44080ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 -- 172.21.15.78:0/2431133407 >> 172.21.15.78:0/2431133407 conn(0x7f4408094510 msgr2=0x7f440814ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 -- 172.21.15.78:0/2431133407 shutdown_connections 2023-08-17T17:52:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.678+0000 7f4410655700 1 -- 172.21.15.78:0/2431133407 wait complete. 2023-08-17T17:52:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:52:00.691 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:51:59.735767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2420856,"kb_used_data":11320,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553864,"statfs":{"total":773094113280,"available":770615156736,"internally_reserved":0,"allocated":11591680,"data_stored":5732186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5592,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.572279"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345811+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.349457+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345323+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344266+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350409+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345844+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345774+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345886+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345747+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.348969+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345835+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347657+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343961+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343146+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343953+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347186+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347854+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344335+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342725+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345431+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342732+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345831+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345823+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346721+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350665+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.349221+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347070+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350416+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347661+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342723+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344866+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345221+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344564+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342697+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345051+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346543+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346269+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342871+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344872+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343958+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345352+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345895+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346600+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.348771+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345272+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344610+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342285+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344777+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345448+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.348974+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350116+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346176+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344882+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.341711+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.351045+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.341688+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350546+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.334973+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:51:54.334973+0000","last_peered":"2023-08-17T17:51:54.334973+0000","last_clean":"2023-08-17T17:51:54.334973+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:51:54.334973+0000","last_undegraded":"2023-08-17T17:51:54.334973+0000","last_fullsized":"2023-08-17T17:51:54.334973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350175+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.335409+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:51:54.335409+0000","last_peered":"2023-08-17T17:51:54.335409+0000","last_clean":"2023-08-17T17:51:54.335409+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:51:54.335409+0000","last_undegraded":"2023-08-17T17:51:54.335409+0000","last_fullsized":"2023-08-17T17:51:54.335409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342765+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893437+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:51:54.893437+0000","last_peered":"2023-08-17T17:51:54.893437+0000","last_clean":"2023-08-17T17:51:54.893437+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:51:54.893437+0000","last_undegraded":"2023-08-17T17:51:54.893437+0000","last_fullsized":"2023-08-17T17:51:54.893437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342279+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.335408+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:51:54.335408+0000","last_peered":"2023-08-17T17:51:54.335408+0000","last_clean":"2023-08-17T17:51:54.335408+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:51:54.335408+0000","last_undegraded":"2023-08-17T17:51:54.335408+0000","last_fullsized":"2023-08-17T17:51:54.335408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893836+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:51:54.893836+0000","last_peered":"2023-08-17T17:51:54.893836+0000","last_clean":"2023-08-17T17:51:54.893836+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:51:54.893836+0000","last_undegraded":"2023-08-17T17:51:54.893836+0000","last_fullsized":"2023-08-17T17:51:54.893836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346236+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893835+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:51:54.893835+0000","last_peered":"2023-08-17T17:51:54.893835+0000","last_clean":"2023-08-17T17:51:54.893835+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:51:54.893835+0000","last_undegraded":"2023-08-17T17:51:54.893835+0000","last_fullsized":"2023-08-17T17:51:54.893835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342217+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":86,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893820+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:51:54.893820+0000","last_peered":"2023-08-17T17:51:54.893820+0000","last_clean":"2023-08-17T17:51:54.893820+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:51:54.893820+0000","last_undegraded":"2023-08-17T17:51:54.893820+0000","last_fullsized":"2023-08-17T17:51:54.893820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342263+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.335018+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:51:54.335018+0000","last_peered":"2023-08-17T17:51:54.335018+0000","last_clean":"2023-08-17T17:51:54.335018+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:51:54.335018+0000","last_undegraded":"2023-08-17T17:51:54.335018+0000","last_fullsized":"2023-08-17T17:51:54.335018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342223+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893761+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:51:54.893761+0000","last_peered":"2023-08-17T17:51:54.893761+0000","last_clean":"2023-08-17T17:51:54.893761+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:51:54.893761+0000","last_undegraded":"2023-08-17T17:51:54.893761+0000","last_fullsized":"2023-08-17T17:51:54.893761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575058,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1458176,"data_stored":721189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68899999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.70499999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.70099999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.55600000000000005},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.69399999999999995,"5min":0.745,"15min":0.80000000000000004},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.79300000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.72199999999999998,"5min":1.23,"15min":1.23},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73199999999999998,"5min":0.81599999999999995,"15min":0.86099999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.77200000000000002},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.505},"min":{"1min":0.38300000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.34200000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.746,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.628},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":0.82799999999999996,"15min":0.90200000000000002},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575058,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.71899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.505}]},{"osd":1,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.52300000000000002},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.629},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.62}]},{"osd":2,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.58599999999999997},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.75,"5min":0.879,"15min":1.0609999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.373},"max":{"1min":0.71399999999999997,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.68200000000000005,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48599999999999999,"15min":0.47299999999999998},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60099999999999998,"5min":0.748,"15min":0.77300000000000002},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47799999999999998},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.85799999999999998,"15min":1.51},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.41199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67800000000000005,"5min":0.872,"15min":0.872},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575059,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.42799999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.20599999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.436,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.34899999999999998,"15min":0.36299999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.41899999999999998,"5min":0.55300000000000005,"15min":0.70799999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.66300000000000003},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.41299999999999998,"15min":0.42799999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.48299999999999998,"5min":0.625,"15min":0.66600000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.39500000000000002,"15min":0.41199999999999998},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.45000000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.378,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.752,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.60799999999999998,"15min":0.61699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":1.2989999999999999,"15min":1.331},"last":0.626},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.755,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.625,"15min":0.627},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70099999999999996,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.628},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72999999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78900000000000003,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73899999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575058,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.35499999999999998},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.45200000000000001,"5min":0.54000000000000004,"15min":0.61599999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.372,"15min":0.38600000000000001},"min":{"1min":0.27100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.372}]},{"osd":2,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.34599999999999997,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.38600000000000001,"15min":0.40799999999999997},"min":{"1min":0.26800000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.40600000000000003},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.66200000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.28399999999999997,"15min":0.26200000000000001},"max":{"1min":0.54400000000000004,"5min":0.62,"15min":0.65700000000000003},"last":0.438}]},{"osd":4,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.623,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.442,"5min":0.435,"15min":0.432},"max":{"1min":0.85899999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.49099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.41799999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98199999999999998,"5min":1.677,"15min":1.677},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.88700000000000001,"5min":1.51,"15min":1.51},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.325,"15min":1.391},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.91100000000000003,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.67900000000000005},"min":{"1min":0.501,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0980000000000001,"15min":1.544},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575058,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1458176,"data_stored":721189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.34999999999999998},"min":{"1min":0.20300000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.51500000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.34999999999999998,"15min":0.372},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.24399999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39100000000000001,"15min":0.41599999999999998},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41199999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63,"5min":1.268,"15min":1.268},"last":0.374},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67200000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.46800000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73199999999999998,"5min":1.417,"15min":1.417},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.876,"5min":1.51,"15min":2.9220000000000002},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.443,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.544,"15min":1.544},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.63700000000000001},"min":{"1min":0.47199999999999998,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.93200000000000005,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85499999999999998,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":1.415,"15min":1.415},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91600000000000004,"5min":1.3859999999999999,"15min":2.984},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.48199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92400000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.628}]}]},{"osd":3,"up_from":13,"seq":55834575058,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48599999999999999,"5min":0.53100000000000003,"15min":0.56999999999999995},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36699999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.60599999999999998},"last":0.316}]},{"osd":1,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.25,"5min":0.214,"15min":0.214},"max":{"1min":0.63400000000000001,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.64200000000000002},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.39200000000000002},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.439,"15min":0.42699999999999999},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.75800000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85099999999999998,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83499999999999996,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.876,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.628},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":1.466,"15min":1.466},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.86499999999999999,"5min":1.48,"15min":1.48},"last":0.501},{"interface":"front","average":{"1min":0.626,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81100000000000005,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575059,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.26400000000000001},"max":{"1min":0.75900000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.71999999999999997,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.27800000000000002},"max":{"1min":0.79000000000000004,"5min":1.252,"15min":1.252},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70099999999999996,"5min":1.306,"15min":1.306},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.58999999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35599999999999998},"max":{"1min":0.80600000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":1.1160000000000001,"5min":1.444,"15min":1.444},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":1.482,"15min":1.482},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.74199999999999999,"5min":1.123,"15min":1.123},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.32900000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.5,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.78600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.5,"15min":0.47999999999999998},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81999999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81000000000000005,"5min":1.048,"15min":1.048},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.41899999999999998,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":1.056},"last":0.85099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":1.165,"15min":1.165},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75600000000000001,"5min":1.022,"15min":1.022},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.77500000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.71399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.78500000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.497},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.82099999999999995,"5min":1.153,"15min":1.153},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77300000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80600000000000005,"5min":1.036,"15min":1.036},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44900000000000001,"15min":0.44700000000000001},"min":{"1min":0.33700000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":0.747,"15min":0.75},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.59699999999999998,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.749},"last":0.622},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.874},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:52:00.699 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:52:00.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.844+0000 7ff1a86b5700 1 Processor -- start 2023-08-17T17:52:00.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.844+0000 7ff1a86b5700 1 -- start start 2023-08-17T17:52:00.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a86b5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff1a0154140 0x7ff1a00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a86b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1a00a7c40 0x7ff1a00c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a86b5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff1a00a8080 0x7ff1a00c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a86b5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a00c12e0 con 0x7ff1a0154140 2023-08-17T17:52:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a86b5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a0154520 con 0x7ff1a00a8080 2023-08-17T17:52:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a86b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00c91e0 con 0x7ff1a00a7c40 2023-08-17T17:52:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a6451700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff1a0154140 0x7ff1a00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a6451700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff1a0154140 0x7ff1a00c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37480/0 (socket says 172.21.15.78:37480) 2023-08-17T17:52:00.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a6451700 1 -- 172.21.15.78:0/2550760913 learned_addr learned my addr 172.21.15.78:0/2550760913 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:00.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a6c52700 1 --2- 172.21.15.78:0/2550760913 >> v2:172.21.15.150:3300/0 conn(0x7ff1a00a8080 0x7ff1a00c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.845+0000 7ff1a5c50700 1 --2- 172.21.15.78:0/2550760913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1a00a7c40 0x7ff1a00c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a6451700 1 -- 172.21.15.78:0/2550760913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1a00a7c40 msgr2=0x7ff1a00c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a6451700 1 --2- 172.21.15.78:0/2550760913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1a00a7c40 0x7ff1a00c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a6451700 1 -- 172.21.15.78:0/2550760913 >> v2:172.21.15.150:3300/0 conn(0x7ff1a00a8080 msgr2=0x7ff1a00c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a6451700 1 --2- 172.21.15.78:0/2550760913 >> v2:172.21.15.150:3300/0 conn(0x7ff1a00a8080 0x7ff1a00c0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a6451700 1 -- 172.21.15.78:0/2550760913 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00c94c0 con 0x7ff1a0154140 2023-08-17T17:52:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a6451700 1 --2- 172.21.15.78:0/2550760913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a0154140 0x7ff1a00c6ee0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7ff1a006bd60 tx=0x7ff19c009840).ready entity=mon.0 client_cookie=58c1a102bd5e7582 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a544f700 1 -- 172.21.15.78:0/2550760913 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00e070 con 0x7ff1a0154140 2023-08-17T17:52:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a544f700 1 -- 172.21.15.78:0/2550760913 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c00b970 con 0x7ff1a0154140 2023-08-17T17:52:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a544f700 1 -- 172.21.15.78:0/2550760913 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00bcf0 con 0x7ff1a0154140 2023-08-17T17:52:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a86b5700 1 -- 172.21.15.78:0/2550760913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a0154140 msgr2=0x7ff1a00c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a86b5700 1 --2- 172.21.15.78:0/2550760913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a0154140 0x7ff1a00c6ee0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7ff1a006bd60 tx=0x7ff19c009840).stop 2023-08-17T17:52:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a86b5700 1 -- 172.21.15.78:0/2550760913 shutdown_connections 2023-08-17T17:52:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a86b5700 1 --2- 172.21.15.78:0/2550760913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a0154140 0x7ff1a00c6ee0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a86b5700 1 --2- 172.21.15.78:0/2550760913 >> v2:172.21.15.150:3300/0 conn(0x7ff1a00a8080 0x7ff1a00c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a86b5700 1 --2- 172.21.15.78:0/2550760913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1a00a7c40 0x7ff1a00c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.846+0000 7ff1a86b5700 1 -- 172.21.15.78:0/2550760913 >> 172.21.15.78:0/2550760913 conn(0x7ff1a0094510 msgr2=0x7ff1a006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.847+0000 7ff1a86b5700 1 -- 172.21.15.78:0/2550760913 shutdown_connections 2023-08-17T17:52:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.847+0000 7ff1a86b5700 1 -- 172.21.15.78:0/2550760913 wait complete. 2023-08-17T17:52:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a86b5700 1 Processor -- start 2023-08-17T17:52:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a86b5700 1 -- start start 2023-08-17T17:52:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a86b5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a00a7c40 0x7ff1a00aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a86b5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a00a8080 0x7ff1a0151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a86b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1a0154140 0x7ff1a014ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a86b5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00afdb0 con 0x7ff1a00a7c40 2023-08-17T17:52:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a86b5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00b0240 con 0x7ff1a00a8080 2023-08-17T17:52:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a86b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a0152450 con 0x7ff1a0154140 2023-08-17T17:52:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a6451700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a00a7c40 0x7ff1a00aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a6451700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a00a7c40 0x7ff1a00aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37484/0 (socket says 172.21.15.78:37484) 2023-08-17T17:52:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.848+0000 7ff1a6451700 1 -- 172.21.15.78:0/404976459 learned_addr learned my addr 172.21.15.78:0/404976459 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1a6c52700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1a0154140 0x7ff1a014ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1a5c50700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a00a8080 0x7ff1a0151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1a6451700 1 -- 172.21.15.78:0/404976459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1a0154140 msgr2=0x7ff1a014ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1a6451700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1a0154140 0x7ff1a014ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1a6451700 1 -- 172.21.15.78:0/404976459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a00a8080 msgr2=0x7ff1a0151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1a6451700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a00a8080 0x7ff1a0151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1a6451700 1 -- 172.21.15.78:0/404976459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c009ae0 con 0x7ff1a00a7c40 2023-08-17T17:52:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1a6451700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a00a7c40 0x7ff1a00aeba0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7ff19c00b610 tx=0x7ff19c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1967fc700 1 -- 172.21.15.78:0/404976459 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00bae0 con 0x7ff1a00a7c40 2023-08-17T17:52:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1967fc700 1 -- 172.21.15.78:0/404976459 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c00bc40 con 0x7ff1a00a7c40 2023-08-17T17:52:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1a86b5700 1 -- 172.21.15.78:0/404976459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a00af1a0 con 0x7ff1a00a7c40 2023-08-17T17:52:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1967fc700 1 -- 172.21.15.78:0/404976459 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c01d6b0 con 0x7ff1a00a7c40 2023-08-17T17:52:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.849+0000 7ff1a86b5700 1 -- 172.21.15.78:0/404976459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a00af760 con 0x7ff1a00a7c40 2023-08-17T17:52:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.850+0000 7ff1a86b5700 1 -- 172.21.15.78:0/404976459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a0047350 con 0x7ff1a00a7c40 2023-08-17T17:52:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.850+0000 7ff1967fc700 1 -- 172.21.15.78:0/404976459 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff19c024030 con 0x7ff1a00a7c40 2023-08-17T17:52:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.851+0000 7ff1967fc700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 0x7ff184061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.851+0000 7ff1967fc700 1 -- 172.21.15.78:0/404976459 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff19c07ad90 con 0x7ff1a00a7c40 2023-08-17T17:52:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.851+0000 7ff1a5c50700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 0x7ff184061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.851+0000 7ff1a5c50700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 0x7ff184061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff1a01530b0 tx=0x7ff190008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:00.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:00.855+0000 7ff1967fc700 1 -- 172.21.15.78:0/404976459 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff19c04c330 con 0x7ff1a00a7c40 2023-08-17T17:52:01.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.013+0000 7ff1a86b5700 1 -- 172.21.15.78:0/404976459 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1a00afef0 con 0x7ff18405ed90 2023-08-17T17:52:01.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.022+0000 7ff1967fc700 1 -- 172.21.15.78:0/404976459 <== mgr.7446 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352795 (secure 0 0 0) 0x7ff1900098c0 con 0x7ff18405ed90 2023-08-17T17:52:01.026 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:52:01.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 -- 172.21.15.78:0/404976459 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 msgr2=0x7ff184061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 0x7ff184061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff1a01530b0 tx=0x7ff190008040).stop 2023-08-17T17:52:01.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 -- 172.21.15.78:0/404976459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a00a7c40 msgr2=0x7ff1a00aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a00a7c40 0x7ff1a00aeba0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7ff19c00b610 tx=0x7ff19c009840).stop 2023-08-17T17:52:01.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 -- 172.21.15.78:0/404976459 shutdown_connections 2023-08-17T17:52:01.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff18405ed90 0x7ff184061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1a0154140 0x7ff1a014ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a00a7c40 0x7ff1a00aeba0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 --2- 172.21.15.78:0/404976459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1a00a8080 0x7ff1a0151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 -- 172.21.15.78:0/404976459 >> 172.21.15.78:0/404976459 conn(0x7ff1a0094510 msgr2=0x7ff1a00c04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:01.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 -- 172.21.15.78:0/404976459 shutdown_connections 2023-08-17T17:52:01.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.025+0000 7ff1a86b5700 1 -- 172.21.15.78:0/404976459 wait complete. 2023-08-17T17:52:01.030 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:52:01.038 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:51:59.735767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2420856,"kb_used_data":11320,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553864,"statfs":{"total":773094113280,"available":770615156736,"internally_reserved":0,"allocated":11591680,"data_stored":5732186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5592,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.572279"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345811+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.349457+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345323+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344266+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350409+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345844+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345774+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345886+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345747+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.348969+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345835+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347657+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343961+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343146+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343953+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347186+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347854+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344335+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342725+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345431+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342732+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345831+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345823+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346721+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350665+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.349221+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347070+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350416+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347661+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342723+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344866+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345221+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344564+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342697+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345051+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346543+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346269+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342871+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344872+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343958+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345352+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345895+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346600+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.348771+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345272+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344610+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342285+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344777+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345448+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.348974+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350116+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346176+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344882+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.341711+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.351045+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.341688+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350546+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.334973+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:51:54.334973+0000","last_peered":"2023-08-17T17:51:54.334973+0000","last_clean":"2023-08-17T17:51:54.334973+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:51:54.334973+0000","last_undegraded":"2023-08-17T17:51:54.334973+0000","last_fullsized":"2023-08-17T17:51:54.334973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350175+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.335409+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:51:54.335409+0000","last_peered":"2023-08-17T17:51:54.335409+0000","last_clean":"2023-08-17T17:51:54.335409+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:51:54.335409+0000","last_undegraded":"2023-08-17T17:51:54.335409+0000","last_fullsized":"2023-08-17T17:51:54.335409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342765+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893437+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:51:54.893437+0000","last_peered":"2023-08-17T17:51:54.893437+0000","last_clean":"2023-08-17T17:51:54.893437+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:51:54.893437+0000","last_undegraded":"2023-08-17T17:51:54.893437+0000","last_fullsized":"2023-08-17T17:51:54.893437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342279+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.335408+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:51:54.335408+0000","last_peered":"2023-08-17T17:51:54.335408+0000","last_clean":"2023-08-17T17:51:54.335408+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:51:54.335408+0000","last_undegraded":"2023-08-17T17:51:54.335408+0000","last_fullsized":"2023-08-17T17:51:54.335408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893836+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:51:54.893836+0000","last_peered":"2023-08-17T17:51:54.893836+0000","last_clean":"2023-08-17T17:51:54.893836+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:51:54.893836+0000","last_undegraded":"2023-08-17T17:51:54.893836+0000","last_fullsized":"2023-08-17T17:51:54.893836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346236+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893835+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:51:54.893835+0000","last_peered":"2023-08-17T17:51:54.893835+0000","last_clean":"2023-08-17T17:51:54.893835+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:51:54.893835+0000","last_undegraded":"2023-08-17T17:51:54.893835+0000","last_fullsized":"2023-08-17T17:51:54.893835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342217+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":86,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893820+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:51:54.893820+0000","last_peered":"2023-08-17T17:51:54.893820+0000","last_clean":"2023-08-17T17:51:54.893820+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:51:54.893820+0000","last_undegraded":"2023-08-17T17:51:54.893820+0000","last_fullsized":"2023-08-17T17:51:54.893820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342263+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.335018+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:51:54.335018+0000","last_peered":"2023-08-17T17:51:54.335018+0000","last_clean":"2023-08-17T17:51:54.335018+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:51:54.335018+0000","last_undegraded":"2023-08-17T17:51:54.335018+0000","last_fullsized":"2023-08-17T17:51:54.335018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342223+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893761+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:51:54.893761+0000","last_peered":"2023-08-17T17:51:54.893761+0000","last_clean":"2023-08-17T17:51:54.893761+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:51:54.893761+0000","last_undegraded":"2023-08-17T17:51:54.893761+0000","last_fullsized":"2023-08-17T17:51:54.893761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575058,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1458176,"data_stored":721189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68899999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.70499999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.70099999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.55600000000000005},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.69399999999999995,"5min":0.745,"15min":0.80000000000000004},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.79300000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.72199999999999998,"5min":1.23,"15min":1.23},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73199999999999998,"5min":0.81599999999999995,"15min":0.86099999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.77200000000000002},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.505},"min":{"1min":0.38300000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.34200000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.746,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.628},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":0.82799999999999996,"15min":0.90200000000000002},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575058,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.71899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.505}]},{"osd":1,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.52300000000000002},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.629},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.62}]},{"osd":2,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.58599999999999997},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.75,"5min":0.879,"15min":1.0609999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.373},"max":{"1min":0.71399999999999997,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.68200000000000005,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48599999999999999,"15min":0.47299999999999998},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60099999999999998,"5min":0.748,"15min":0.77300000000000002},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47799999999999998},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.85799999999999998,"15min":1.51},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.41199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67800000000000005,"5min":0.872,"15min":0.872},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575059,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.42799999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.20599999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.436,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.34899999999999998,"15min":0.36299999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.41899999999999998,"5min":0.55300000000000005,"15min":0.70799999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.66300000000000003},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.41299999999999998,"15min":0.42799999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.48299999999999998,"5min":0.625,"15min":0.66600000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.39500000000000002,"15min":0.41199999999999998},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.45000000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.378,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.752,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.60799999999999998,"15min":0.61699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":1.2989999999999999,"15min":1.331},"last":0.626},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.755,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.625,"15min":0.627},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70099999999999996,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.628},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72999999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78900000000000003,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73899999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575058,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.35499999999999998},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.45200000000000001,"5min":0.54000000000000004,"15min":0.61599999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.372,"15min":0.38600000000000001},"min":{"1min":0.27100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.372}]},{"osd":2,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.34599999999999997,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.38600000000000001,"15min":0.40799999999999997},"min":{"1min":0.26800000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.40600000000000003},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.66200000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.28399999999999997,"15min":0.26200000000000001},"max":{"1min":0.54400000000000004,"5min":0.62,"15min":0.65700000000000003},"last":0.438}]},{"osd":4,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.623,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.442,"5min":0.435,"15min":0.432},"max":{"1min":0.85899999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.49099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.41799999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98199999999999998,"5min":1.677,"15min":1.677},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.88700000000000001,"5min":1.51,"15min":1.51},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.325,"15min":1.391},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.91100000000000003,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.67900000000000005},"min":{"1min":0.501,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0980000000000001,"15min":1.544},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575058,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1458176,"data_stored":721189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.34999999999999998},"min":{"1min":0.20300000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.51500000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.34999999999999998,"15min":0.372},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.24399999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39100000000000001,"15min":0.41599999999999998},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41199999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63,"5min":1.268,"15min":1.268},"last":0.374},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67200000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.46800000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73199999999999998,"5min":1.417,"15min":1.417},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.876,"5min":1.51,"15min":2.9220000000000002},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.443,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.544,"15min":1.544},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.63700000000000001},"min":{"1min":0.47199999999999998,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.93200000000000005,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85499999999999998,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":1.415,"15min":1.415},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91600000000000004,"5min":1.3859999999999999,"15min":2.984},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.48199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92400000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.628}]}]},{"osd":3,"up_from":13,"seq":55834575058,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48599999999999999,"5min":0.53100000000000003,"15min":0.56999999999999995},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36699999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.60599999999999998},"last":0.316}]},{"osd":1,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.25,"5min":0.214,"15min":0.214},"max":{"1min":0.63400000000000001,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.64200000000000002},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.39200000000000002},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.439,"15min":0.42699999999999999},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.75800000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85099999999999998,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83499999999999996,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.876,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.628},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":1.466,"15min":1.466},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.86499999999999999,"5min":1.48,"15min":1.48},"last":0.501},{"interface":"front","average":{"1min":0.626,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81100000000000005,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575059,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.26400000000000001},"max":{"1min":0.75900000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.71999999999999997,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.27800000000000002},"max":{"1min":0.79000000000000004,"5min":1.252,"15min":1.252},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70099999999999996,"5min":1.306,"15min":1.306},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.58999999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35599999999999998},"max":{"1min":0.80600000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":1.1160000000000001,"5min":1.444,"15min":1.444},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":1.482,"15min":1.482},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.74199999999999999,"5min":1.123,"15min":1.123},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.32900000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.5,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.78600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.5,"15min":0.47999999999999998},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81999999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81000000000000005,"5min":1.048,"15min":1.048},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.41899999999999998,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":1.056},"last":0.85099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":1.165,"15min":1.165},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75600000000000001,"5min":1.022,"15min":1.022},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.77500000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.71399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.78500000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.497},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.82099999999999995,"5min":1.153,"15min":1.153},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77300000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80600000000000005,"5min":1.036,"15min":1.036},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44900000000000001,"15min":0.44700000000000001},"min":{"1min":0.33700000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":0.747,"15min":0.75},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.59699999999999998,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.749},"last":0.622},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.874},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:52:01.046 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:52:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.190+0000 7fb520652700 1 Processor -- start 2023-08-17T17:52:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.190+0000 7fb520652700 1 -- start start 2023-08-17T17:52:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb520652700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb518154140 0x7fb5180c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb520652700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180c1010 0x7fb5180ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb520652700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb518154520 con 0x7fb5180a7c40 2023-08-17T17:52:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb520652700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180c91e0 con 0x7fb518154140 2023-08-17T17:52:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb520652700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180c94c0 con 0x7fb5180c1010 2023-08-17T17:52:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51dbed700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb5180a7c40 0x7fb5180c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55660/0 (socket says 172.21.15.78:55660) 2023-08-17T17:52:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51dbed700 1 -- 172.21.15.78:0/4203206727 learned_addr learned my addr 172.21.15.78:0/4203206727 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51e3ee700 1 --2- 172.21.15.78:0/4203206727 >> v2:172.21.15.150:3300/0 conn(0x7fb518154140 0x7fb5180c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51ebef700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180c1010 0x7fb5180ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589156431 0 0) 0x7fb518154520 con 0x7fb5180a7c40 2023-08-17T17:52:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5040033f0 con 0x7fb5180a7c40 2023-08-17T17:52:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232098579 0 0) 0x7fb5040033f0 con 0x7fb5180a7c40 2023-08-17T17:52:01.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180c1010 msgr2=0x7fb5180ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:01.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180c1010 0x7fb5180ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 >> v2:172.21.15.150:3300/0 conn(0x7fb518154140 msgr2=0x7fb5180c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:01.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 --2- 172.21.15.78:0/4203206727 >> v2:172.21.15.150:3300/0 conn(0x7fb518154140 0x7fb5180c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180c97a0 con 0x7fb5180a7c40 2023-08-17T17:52:01.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fb508001470 con 0x7fb5180a7c40 2023-08-17T17:52:01.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51e3ee700 1 --2- 172.21.15.78:0/4203206727 >> v2:172.21.15.150:3300/0 conn(0x7fb518154140 0x7fb5180c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:52:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 >> v1:172.21.15.78:6789/0 conn(0x7fb5180a7c40 legacy=0x7fb5180c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180c1010 0x7fb5040038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb504003e10 0x7fb504004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 0x7fb504005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180c91e0 con 0x7fb504004b80 2023-08-17T17:52:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180c94c0 con 0x7fb504003e10 2023-08-17T17:52:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.191+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50400b8e0 con 0x7fb5180c1010 2023-08-17T17:52:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51ebef700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 0x7fb504005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51e3ee700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180c1010 0x7fb5040038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51dbed700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb504003e10 0x7fb504004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51ebef700 1 -- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180c1010 msgr2=0x7fb5040038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51ebef700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180c1010 0x7fb5040038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51ebef700 1 -- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb504003e10 msgr2=0x7fb504004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51ebef700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb504003e10 0x7fb504004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51ebef700 1 -- 172.21.15.78:0/4203206727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040033f0 con 0x7fb504004b80 2023-08-17T17:52:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51dbed700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb504003e10 0x7fb504004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51ebef700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 0x7fb504005000 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fb5180c1410 tx=0x7fb510009060).ready entity=mon.0 client_cookie=813e692d4bdebe1f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510009430 con 0x7fb504004b80 2023-08-17T17:52:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb510009e70 con 0x7fb504004b80 2023-08-17T17:52:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb51d3ec700 1 -- 172.21.15.78:0/4203206727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000e850 con 0x7fb504004b80 2023-08-17T17:52:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb520652700 1 -- 172.21.15.78:0/4203206727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 msgr2=0x7fb504005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.192+0000 7fb520652700 1 --2- 172.21.15.78:0/4203206727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 0x7fb504005000 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fb5180c1410 tx=0x7fb510009060).stop 2023-08-17T17:52:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.193+0000 7fb51ebef700 1 -- 172.21.15.78:0/4203206727 reap_dead start 2023-08-17T17:52:01.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.193+0000 7fb520652700 1 -- 172.21.15.78:0/4203206727 shutdown_connections 2023-08-17T17:52:01.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.193+0000 7fb520652700 1 -- 172.21.15.78:0/4203206727 >> 172.21.15.78:0/4203206727 conn(0x7fb518094510 msgr2=0x7fb51806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:01.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.193+0000 7fb520652700 1 -- 172.21.15.78:0/4203206727 shutdown_connections 2023-08-17T17:52:01.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.193+0000 7fb520652700 1 -- 172.21.15.78:0/4203206727 wait complete. 2023-08-17T17:52:01.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.194+0000 7fb520652700 1 Processor -- start 2023-08-17T17:52:01.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.194+0000 7fb520652700 1 -- start start 2023-08-17T17:52:01.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.194+0000 7fb520652700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 0x7fb5181578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb520652700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180a9a50 0x7fb518164f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb520652700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb51814e4f0 0x7fb518150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb520652700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51814ece0 con 0x7fb504004b80 2023-08-17T17:52:01.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb520652700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180a9ee0 con 0x7fb51814e4f0 2023-08-17T17:52:01.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb520652700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb518156b30 con 0x7fb5180a9a50 2023-08-17T17:52:01.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb51e3ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 0x7fb5181578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb51e3ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 0x7fb5181578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37500/0 (socket says 172.21.15.78:37500) 2023-08-17T17:52:01.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb51e3ee700 1 -- 172.21.15.78:0/1971237125 learned_addr learned my addr 172.21.15.78:0/1971237125 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:01.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb51e3ee700 1 -- 172.21.15.78:0/1971237125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180a9a50 msgr2=0x7fb518164f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb51e3ee700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180a9a50 0x7fb518164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:01.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb51e3ee700 1 -- 172.21.15.78:0/1971237125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb51814e4f0 msgr2=0x7fb518150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb51e3ee700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb51814e4f0 0x7fb518150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:01.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb51e3ee700 1 -- 172.21.15.78:0/1971237125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518156e10 con 0x7fb504004b80 2023-08-17T17:52:01.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb51e3ee700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 0x7fb5181578f0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fb51400f1b0 tx=0x7fb51400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:01.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb50e7fc700 1 -- 172.21.15.78:0/1971237125 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51400e040 con 0x7fb504004b80 2023-08-17T17:52:01.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb50e7fc700 1 -- 172.21.15.78:0/1971237125 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51400f040 con 0x7fb504004b80 2023-08-17T17:52:01.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb520652700 1 -- 172.21.15.78:0/1971237125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5181570f0 con 0x7fb504004b80 2023-08-17T17:52:01.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb50e7fc700 1 -- 172.21.15.78:0/1971237125 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514015660 con 0x7fb504004b80 2023-08-17T17:52:01.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.195+0000 7fb520652700 1 -- 172.21.15.78:0/1971237125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb518157de0 con 0x7fb504004b80 2023-08-17T17:52:01.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.196+0000 7fb520652700 1 -- 172.21.15.78:0/1971237125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb518047350 con 0x7fb504004b80 2023-08-17T17:52:01.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.196+0000 7fb50e7fc700 1 -- 172.21.15.78:0/1971237125 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb514015a10 con 0x7fb504004b80 2023-08-17T17:52:01.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.197+0000 7fb50e7fc700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb4fc05ed90 0x7fb4fc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.197+0000 7fb50e7fc700 1 -- 172.21.15.78:0/1971237125 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb51407aca0 con 0x7fb504004b80 2023-08-17T17:52:01.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.197+0000 7fb51dbed700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb4fc05ed90 0x7fb4fc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.197+0000 7fb51dbed700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb4fc05ed90 0x7fb4fc061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb5080015a0 tx=0x7fb508001150).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:01.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.201+0000 7fb50e7fc700 1 -- 172.21.15.78:0/1971237125 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb51407f070 con 0x7fb504004b80 2023-08-17T17:52:01.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.362+0000 7fb520652700 1 -- 172.21.15.78:0/1971237125 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5181533f0 con 0x7fb4fc05ed90 2023-08-17T17:52:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.371+0000 7fb50e7fc700 1 -- 172.21.15.78:0/1971237125 <== mgr.7446 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352795 (secure 0 0 0) 0x7fb5181533f0 con 0x7fb4fc05ed90 2023-08-17T17:52:01.375 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:52:01.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 -- 172.21.15.78:0/1971237125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb4fc05ed90 msgr2=0x7fb4fc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb4fc05ed90 0x7fb4fc061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb5080015a0 tx=0x7fb508001150).stop 2023-08-17T17:52:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 -- 172.21.15.78:0/1971237125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 msgr2=0x7fb5181578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 0x7fb5181578f0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fb51400f1b0 tx=0x7fb51400b040).stop 2023-08-17T17:52:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 -- 172.21.15.78:0/1971237125 shutdown_connections 2023-08-17T17:52:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb4fc05ed90 0x7fb4fc061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb51814e4f0 0x7fb518150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb504004b80 0x7fb5181578f0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 --2- 172.21.15.78:0/1971237125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5180a9a50 0x7fb518164f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 -- 172.21.15.78:0/1971237125 >> 172.21.15.78:0/1971237125 conn(0x7fb518094510 msgr2=0x7fb5180643c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 -- 172.21.15.78:0/1971237125 shutdown_connections 2023-08-17T17:52:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.375+0000 7fb520652700 1 -- 172.21.15.78:0/1971237125 wait complete. 2023-08-17T17:52:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:52:01.388 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:51:59.735767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2420856,"kb_used_data":11320,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553864,"statfs":{"total":773094113280,"available":770615156736,"internally_reserved":0,"allocated":11591680,"data_stored":5732186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5592,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.572279"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345811+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.349457+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345323+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344266+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350409+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345844+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345774+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345886+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345747+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.348969+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345835+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347657+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343961+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343146+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343953+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347186+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347854+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344335+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342725+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345431+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342732+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345831+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345823+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346721+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350665+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.349221+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347070+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350416+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.347661+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342723+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344866+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345221+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344564+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342697+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345051+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346543+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346269+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342871+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344872+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.343958+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345352+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345895+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346600+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.348771+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345272+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344610+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342285+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344777+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.345448+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.348974+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350116+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346176+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.344882+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.341711+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.351045+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.341688+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350546+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.334973+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:51:54.334973+0000","last_peered":"2023-08-17T17:51:54.334973+0000","last_clean":"2023-08-17T17:51:54.334973+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:51:54.334973+0000","last_undegraded":"2023-08-17T17:51:54.334973+0000","last_fullsized":"2023-08-17T17:51:54.334973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.350175+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.335409+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:51:54.335409+0000","last_peered":"2023-08-17T17:51:54.335409+0000","last_clean":"2023-08-17T17:51:54.335409+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:51:54.335409+0000","last_undegraded":"2023-08-17T17:51:54.335409+0000","last_fullsized":"2023-08-17T17:51:54.335409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342765+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893437+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:51:54.893437+0000","last_peered":"2023-08-17T17:51:54.893437+0000","last_clean":"2023-08-17T17:51:54.893437+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:51:54.893437+0000","last_undegraded":"2023-08-17T17:51:54.893437+0000","last_fullsized":"2023-08-17T17:51:54.893437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342279+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.335408+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:51:54.335408+0000","last_peered":"2023-08-17T17:51:54.335408+0000","last_clean":"2023-08-17T17:51:54.335408+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:51:54.335408+0000","last_undegraded":"2023-08-17T17:51:54.335408+0000","last_fullsized":"2023-08-17T17:51:54.335408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893836+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:51:54.893836+0000","last_peered":"2023-08-17T17:51:54.893836+0000","last_clean":"2023-08-17T17:51:54.893836+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:51:54.893836+0000","last_undegraded":"2023-08-17T17:51:54.893836+0000","last_fullsized":"2023-08-17T17:51:54.893836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.346236+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893835+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:51:54.893835+0000","last_peered":"2023-08-17T17:51:54.893835+0000","last_clean":"2023-08-17T17:51:54.893835+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:51:54.893835+0000","last_undegraded":"2023-08-17T17:51:54.893835+0000","last_fullsized":"2023-08-17T17:51:54.893835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342217+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":86,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893820+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:51:54.893820+0000","last_peered":"2023-08-17T17:51:54.893820+0000","last_clean":"2023-08-17T17:51:54.893820+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:51:54.893820+0000","last_undegraded":"2023-08-17T17:51:54.893820+0000","last_fullsized":"2023-08-17T17:51:54.893820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342263+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.335018+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:51:54.335018+0000","last_peered":"2023-08-17T17:51:54.335018+0000","last_clean":"2023-08-17T17:51:54.335018+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:51:54.335018+0000","last_undegraded":"2023-08-17T17:51:54.335018+0000","last_fullsized":"2023-08-17T17:51:54.335018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:51:57.339481+0000","last_change":"2023-08-17T17:51:57.339481+0000","last_active":"2023-08-17T17:51:57.339481+0000","last_peered":"2023-08-17T17:51:57.339481+0000","last_clean":"2023-08-17T17:51:57.339481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:57.339481+0000","last_undegraded":"2023-08-17T17:51:57.339481+0000","last_fullsized":"2023-08-17T17:51:57.339481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:51:56.330431+0000","last_change":"2023-08-17T17:51:56.342223+0000","last_active":"2023-08-17T17:51:56.330431+0000","last_peered":"2023-08-17T17:51:56.330431+0000","last_clean":"2023-08-17T17:51:56.330431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:51:56.330431+0000","last_undegraded":"2023-08-17T17:51:56.330431+0000","last_fullsized":"2023-08-17T17:51:56.330431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-08-17T17:51:54.893761+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:51:54.893761+0000","last_peered":"2023-08-17T17:51:54.893761+0000","last_clean":"2023-08-17T17:51:54.893761+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:51:54.893761+0000","last_undegraded":"2023-08-17T17:51:54.893761+0000","last_fullsized":"2023-08-17T17:51:54.893761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575058,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1458176,"data_stored":721189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68899999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.70499999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.70099999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.55600000000000005},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.69399999999999995,"5min":0.745,"15min":0.80000000000000004},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.79300000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.72199999999999998,"5min":1.23,"15min":1.23},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73199999999999998,"5min":0.81599999999999995,"15min":0.86099999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.77200000000000002},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.505},"min":{"1min":0.38300000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.34200000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.746,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.628},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":0.82799999999999996,"15min":0.90200000000000002},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575058,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.71899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.505}]},{"osd":1,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.52300000000000002},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.629},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.62}]},{"osd":2,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.58599999999999997},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.75,"5min":0.879,"15min":1.0609999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.373},"max":{"1min":0.71399999999999997,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.68200000000000005,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48599999999999999,"15min":0.47299999999999998},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60099999999999998,"5min":0.748,"15min":0.77300000000000002},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47799999999999998},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.85799999999999998,"15min":1.51},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.41199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67800000000000005,"5min":0.872,"15min":0.872},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575059,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.42799999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.20599999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.436,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.34899999999999998,"15min":0.36299999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.41899999999999998,"5min":0.55300000000000005,"15min":0.70799999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.66300000000000003},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.41299999999999998,"15min":0.42799999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.48299999999999998,"5min":0.625,"15min":0.66600000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.39500000000000002,"15min":0.41199999999999998},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.45000000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.378,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.752,"5min":0.96099999999999997,"15min":1.0129999999999999},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.60799999999999998,"15min":0.61699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":1.2989999999999999,"15min":1.331},"last":0.626},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.755,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.625,"15min":0.627},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70099999999999996,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.628},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72999999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78900000000000003,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73899999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575058,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.35499999999999998},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.45200000000000001,"5min":0.54000000000000004,"15min":0.61599999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.372,"15min":0.38600000000000001},"min":{"1min":0.27100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.372}]},{"osd":2,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.34599999999999997,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.38600000000000001,"15min":0.40799999999999997},"min":{"1min":0.26800000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.40600000000000003},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.66200000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.28399999999999997,"15min":0.26200000000000001},"max":{"1min":0.54400000000000004,"5min":0.62,"15min":0.65700000000000003},"last":0.438}]},{"osd":4,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.623,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.442,"5min":0.435,"15min":0.432},"max":{"1min":0.85899999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.49099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.41799999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98199999999999998,"5min":1.677,"15min":1.677},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.88700000000000001,"5min":1.51,"15min":1.51},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.325,"15min":1.391},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.91100000000000003,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.67900000000000005},"min":{"1min":0.501,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0980000000000001,"15min":1.544},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575058,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1458176,"data_stored":721189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.34999999999999998},"min":{"1min":0.20300000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.51500000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.34999999999999998,"15min":0.372},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.24399999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39100000000000001,"15min":0.41599999999999998},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41199999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63,"5min":1.268,"15min":1.268},"last":0.374},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67200000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.46800000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73199999999999998,"5min":1.417,"15min":1.417},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.876,"5min":1.51,"15min":2.9220000000000002},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.443,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.544,"15min":1.544},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.63700000000000001},"min":{"1min":0.47199999999999998,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.93200000000000005,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85499999999999998,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":1.415,"15min":1.415},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91600000000000004,"5min":1.3859999999999999,"15min":2.984},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.48199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92400000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.628}]}]},{"osd":3,"up_from":13,"seq":55834575058,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48599999999999999,"5min":0.53100000000000003,"15min":0.56999999999999995},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36699999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.60599999999999998},"last":0.316}]},{"osd":1,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.25,"5min":0.214,"15min":0.214},"max":{"1min":0.63400000000000001,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.64200000000000002},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.39200000000000002},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.439,"15min":0.42699999999999999},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.75800000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85099999999999998,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83499999999999996,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.876,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.628},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":1.466,"15min":1.466},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.86499999999999999,"5min":1.48,"15min":1.48},"last":0.501},{"interface":"front","average":{"1min":0.626,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81100000000000005,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575059,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.26400000000000001},"max":{"1min":0.75900000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.71999999999999997,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.27800000000000002},"max":{"1min":0.79000000000000004,"5min":1.252,"15min":1.252},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70099999999999996,"5min":1.306,"15min":1.306},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.58999999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35599999999999998},"max":{"1min":0.80600000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":1.1160000000000001,"5min":1.444,"15min":1.444},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":1.482,"15min":1.482},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.74199999999999999,"5min":1.123,"15min":1.123},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.32900000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.5,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.78600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.5,"15min":0.47999999999999998},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81999999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81000000000000005,"5min":1.048,"15min":1.048},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.41899999999999998,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":1.056},"last":0.85099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1445888,"data_stored":714968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":1.165,"15min":1.165},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75600000000000001,"5min":1.022,"15min":1.022},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.77500000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.71399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.78500000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.497},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.82099999999999995,"5min":1.153,"15min":1.153},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77300000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80600000000000005,"5min":1.036,"15min":1.036},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44900000000000001,"15min":0.44700000000000001},"min":{"1min":0.33700000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":0.747,"15min":0.75},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.59699999999999998,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.749},"last":0.622},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.874},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:52:01.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2023-08-17T17:52:01.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-08-17T17:52:01.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345811+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:52:01.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2023-08-17T17:52:01.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-08-17T17:52:01.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.349457+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:52:01.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2023-08-17T17:52:01.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-08-17T17:52:01.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345323+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:52:01.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2023-08-17T17:52:01.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-08-17T17:52:01.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.344266+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:52:01.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2023-08-17T17:52:01.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-08-17T17:52:01.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.350409+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:52:01.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2023-08-17T17:52:01.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-08-17T17:52:01.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345844+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:52:01.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2023-08-17T17:52:01.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-08-17T17:52:01.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345774+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:52:01.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2023-08-17T17:52:01.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-08-17T17:52:01.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345886+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:52:01.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2023-08-17T17:52:01.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-08-17T17:52:01.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345747+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:52:01.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2023-08-17T17:52:01.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-08-17T17:52:01.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.348969+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:52:01.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2023-08-17T17:52:01.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-08-17T17:52:01.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345835+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:52:01.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2023-08-17T17:52:01.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-08-17T17:52:01.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.347657+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:52:01.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2023-08-17T17:52:01.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-08-17T17:52:01.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.343961+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:52:01.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2023-08-17T17:52:01.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-08-17T17:52:01.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.343146+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2023-08-17T17:52:01.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-08-17T17:52:01.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.343953+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:52:01.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2023-08-17T17:52:01.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-08-17T17:52:01.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.347186+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:52:01.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-08-17T17:52:01.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-08-17T17:52:01.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.347854+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:52:01.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-08-17T17:52:01.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-08-17T17:52:01.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.344335+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:52:01.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-08-17T17:52:01.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-08-17T17:52:01.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342725+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2023-08-17T17:52:01.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-08-17T17:52:01.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345431+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:52:01.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2023-08-17T17:52:01.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-08-17T17:52:01.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342732+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2023-08-17T17:52:01.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-08-17T17:52:01.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345831+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:52:01.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2023-08-17T17:52:01.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-08-17T17:52:01.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345823+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:52:01.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2023-08-17T17:52:01.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-08-17T17:52:01.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.346721+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:52:01.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2023-08-17T17:52:01.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-08-17T17:52:01.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.350665+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:52:01.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2023-08-17T17:52:01.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-08-17T17:52:01.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.349221+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:52:01.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2023-08-17T17:52:01.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-08-17T17:52:01.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.347070+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:52:01.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2023-08-17T17:52:01.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-08-17T17:52:01.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.350416+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:52:01.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2023-08-17T17:52:01.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-08-17T17:52:01.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.347661+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:52:01.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2023-08-17T17:52:01.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-08-17T17:52:01.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342723+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2023-08-17T17:52:01.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-08-17T17:52:01.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.344866+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:52:01.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2023-08-17T17:52:01.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-08-17T17:52:01.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345221+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:52:01.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-08-17T17:52:01.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-08-17T17:52:01.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.344564+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:52:01.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-08-17T17:52:01.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-08-17T17:52:01.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342697+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-08-17T17:52:01.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-08-17T17:52:01.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345051+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:52:01.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-08-17T17:52:01.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-08-17T17:52:01.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.346543+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:52:01.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-08-17T17:52:01.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-08-17T17:52:01.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.346269+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:52:01.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-08-17T17:52:01.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-08-17T17:52:01.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342871+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:52:01.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-08-17T17:52:01.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-08-17T17:52:01.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.344872+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:52:01.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-08-17T17:52:01.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-08-17T17:52:01.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.343958+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:52:01.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-08-17T17:52:01.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-08-17T17:52:01.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345352+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:52:01.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-08-17T17:52:01.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-08-17T17:52:01.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345895+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:52:01.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-08-17T17:52:01.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-08-17T17:52:01.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.346600+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:52:01.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-08-17T17:52:01.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-08-17T17:52:01.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.348771+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:52:01.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-08-17T17:52:01.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-08-17T17:52:01.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345272+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:52:01.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-08-17T17:52:01.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-08-17T17:52:01.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.344610+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:52:01.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-08-17T17:52:01.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-08-17T17:52:01.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342285+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-08-17T17:52:01.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-08-17T17:52:01.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.344777+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:52:01.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-08-17T17:52:01.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-08-17T17:52:01.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.345448+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:52:01.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-08-17T17:52:01.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-08-17T17:52:01.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.348974+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:52:01.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-08-17T17:52:01.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-08-17T17:52:01.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.350116+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:52:01.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-08-17T17:52:01.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-08-17T17:52:01.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.346176+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:52:01.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-08-17T17:52:01.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-08-17T17:52:01.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.344882+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:52:01.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-08-17T17:52:01.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-08-17T17:52:01.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.341711+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-08-17T17:52:01.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-08-17T17:52:01.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.351045+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:52:01.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-08-17T17:52:01.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-08-17T17:52:01.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.341688+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-08-17T17:52:01.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-08-17T17:52:01.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.350546+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:52:01.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-08-17T17:52:01.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-08-17T17:52:01.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.350175+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:52:01.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-08-17T17:52:01.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-08-17T17:52:01.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342765+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:52:01.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-08-17T17:52:01.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-08-17T17:52:01.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342279+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-08-17T17:52:01.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-08-17T17:52:01.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.346236+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:52:01.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-08-17T17:52:01.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-08-17T17:52:01.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342217+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-08-17T17:52:01.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-08-17T17:52:01.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342263+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-08-17T17:52:01.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:51:57.339481+0000', 'last_change': '2023-08-17T17:51:57.339481+0000', 'last_active': '2023-08-17T17:51:57.339481+0000', 'last_peered': '2023-08-17T17:51:57.339481+0000', 'last_clean': '2023-08-17T17:51:57.339481+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:57.339481+0000', 'last_undegraded': '2023-08-17T17:51:57.339481+0000', 'last_fullsized': '2023-08-17T17:51:57.339481+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:57.339481+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:52:01.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-08-17T17:52:01.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:51:56.330431+0000', 'last_change': '2023-08-17T17:51:56.342223+0000', 'last_active': '2023-08-17T17:51:56.330431+0000', 'last_peered': '2023-08-17T17:51:56.330431+0000', 'last_clean': '2023-08-17T17:51:56.330431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:51:56.330431+0000', 'last_undegraded': '2023-08-17T17:51:56.330431+0000', 'last_fullsized': '2023-08-17T17:51:56.330431+0000', 'mapping_epoch': 118, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 118, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'last_clean_scrub_stamp': '2023-08-17T17:51:56.330431+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:52:01.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T17:52:01.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.592+0000 7f81485c4700 1 Processor -- start 2023-08-17T17:52:01.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.592+0000 7f81485c4700 1 -- start start 2023-08-17T17:52:01.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.593+0000 7f81485c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8140154140 0x7f81400c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.593+0000 7f81485c4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f81400a7c40 0x7f81400c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.593+0000 7f81485c4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8140154520 con 0x7f81400a8080 2023-08-17T17:52:01.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.593+0000 7f81485c4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81400c91e0 con 0x7f81400a7c40 2023-08-17T17:52:01.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.593+0000 7f81485c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c94c0 con 0x7f8140154140 2023-08-17T17:52:01.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.593+0000 7f8146b61700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f81400a8080 0x7f81400ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55674/0 (socket says 172.21.15.78:55674) 2023-08-17T17:52:01.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.593+0000 7f8146b61700 1 -- 172.21.15.78:0/1983389151 learned_addr learned my addr 172.21.15.78:0/1983389151 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:01.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8146360700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8140154140 0x7f81400c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8145b5f700 1 --2- 172.21.15.78:0/1983389151 >> v2:172.21.15.150:3300/0 conn(0x7f81400a7c40 0x7f81400c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630936638 0 0) 0x7f8140154520 con 0x7f81400a8080 2023-08-17T17:52:01.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81280033f0 con 0x7f81400a8080 2023-08-17T17:52:01.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 688565308 0 0) 0x7f81280033f0 con 0x7f81400a8080 2023-08-17T17:52:01.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8140154140 msgr2=0x7f81400c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:01.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8140154140 0x7f81400c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 >> v2:172.21.15.150:3300/0 conn(0x7f81400a7c40 msgr2=0x7f81400c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:01.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 --2- 172.21.15.78:0/1983389151 >> v2:172.21.15.150:3300/0 conn(0x7f81400a7c40 0x7f81400c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81400c97a0 con 0x7f81400a8080 2023-08-17T17:52:01.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f8130001470 con 0x7f81400a8080 2023-08-17T17:52:01.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 >> v1:172.21.15.78:6789/0 conn(0x7f81400a8080 legacy=0x7f81400ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 0x7f8128003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8128004690 0x7f8128004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8140154140 0x7f8128005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c91e0 con 0x7f81280038e0 2023-08-17T17:52:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c94c0 con 0x7f8128004690 2023-08-17T17:52:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812800b8e0 con 0x7f8140154140 2023-08-17T17:52:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8146360700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 0x7f8128003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8145b5f700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8128004690 0x7f8128004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8146b61700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8140154140 0x7f8128005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8146360700 1 -- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8140154140 msgr2=0x7f8128005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8146360700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8140154140 0x7f8128005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8146360700 1 -- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8128004690 msgr2=0x7f8128004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8146360700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8128004690 0x7f8128004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8146360700 1 -- 172.21.15.78:0/1983389151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280033f0 con 0x7f81280038e0 2023-08-17T17:52:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.594+0000 7f8146b61700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8140154140 0x7f8128005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f8146360700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 0x7f8128003d00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f8138009a60 tx=0x7f8138009060).ready entity=mon.0 client_cookie=7e12937af2d85c1e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:01.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138009ea0 con 0x7f81280038e0 2023-08-17T17:52:01.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8138009430 con 0x7f81280038e0 2023-08-17T17:52:01.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f814535e700 1 -- 172.21.15.78:0/1983389151 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800e870 con 0x7f81280038e0 2023-08-17T17:52:01.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f81485c4700 1 -- 172.21.15.78:0/1983389151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 msgr2=0x7f8128003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f81485c4700 1 --2- 172.21.15.78:0/1983389151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 0x7f8128003d00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f8138009a60 tx=0x7f8138009060).stop 2023-08-17T17:52:01.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f8146b61700 1 -- 172.21.15.78:0/1983389151 reap_dead start 2023-08-17T17:52:01.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f81485c4700 1 -- 172.21.15.78:0/1983389151 shutdown_connections 2023-08-17T17:52:01.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f81485c4700 1 -- 172.21.15.78:0/1983389151 >> 172.21.15.78:0/1983389151 conn(0x7f8140094510 msgr2=0x7f814006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:01.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f81485c4700 1 -- 172.21.15.78:0/1983389151 shutdown_connections 2023-08-17T17:52:01.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.595+0000 7f81485c4700 1 -- 172.21.15.78:0/1983389151 wait complete. 2023-08-17T17:52:01.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.596+0000 7f81485c4700 1 Processor -- start 2023-08-17T17:52:01.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.596+0000 7f81485c4700 1 -- start start 2023-08-17T17:52:01.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f81485c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 0x7f81400ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f81485c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81400afb40 0x7f8140153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f81485c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8140153840 0x7f8140148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f81485c4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400ab600 con 0x7f81280038e0 2023-08-17T17:52:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f81485c4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8140152210 con 0x7f8140153840 2023-08-17T17:52:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f81485c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8140151640 con 0x7f81400afb40 2023-08-17T17:52:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f8146360700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 0x7f81400ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f8146360700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 0x7f81400ab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37516/0 (socket says 172.21.15.78:37516) 2023-08-17T17:52:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f8146360700 1 -- 172.21.15.78:0/456710599 learned_addr learned my addr 172.21.15.78:0/456710599 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f8145b5f700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81400afb40 0x7f8140153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f8146b61700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8140153840 0x7f8140148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f8146360700 1 -- 172.21.15.78:0/456710599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81400afb40 msgr2=0x7f8140153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.597+0000 7f8146360700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81400afb40 0x7f8140153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.598+0000 7f8146360700 1 -- 172.21.15.78:0/456710599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8140153840 msgr2=0x7f8140148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.598+0000 7f8146360700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8140153840 0x7f8140148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.598+0000 7f8146360700 1 -- 172.21.15.78:0/456710599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81401518e0 con 0x7f81280038e0 2023-08-17T17:52:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.598+0000 7f8146b61700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8140153840 0x7f8140148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.598+0000 7f8146360700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 0x7f81400ab110 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f813800e4b0 tx=0x7f813801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.598+0000 7f813e7fc700 1 -- 172.21.15.78:0/456710599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138020070 con 0x7f81280038e0 2023-08-17T17:52:01.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.598+0000 7f813e7fc700 1 -- 172.21.15.78:0/456710599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813801ba60 con 0x7f81280038e0 2023-08-17T17:52:01.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.598+0000 7f81485c4700 1 -- 172.21.15.78:0/456710599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8140151bc0 con 0x7f81280038e0 2023-08-17T17:52:01.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.598+0000 7f813e7fc700 1 -- 172.21.15.78:0/456710599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813801be20 con 0x7f81280038e0 2023-08-17T17:52:01.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.598+0000 7f81485c4700 1 -- 172.21.15.78:0/456710599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81400affc0 con 0x7f81280038e0 2023-08-17T17:52:01.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.599+0000 7f81485c4700 1 -- 172.21.15.78:0/456710599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8140047350 con 0x7f81280038e0 2023-08-17T17:52:01.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.599+0000 7f813e7fc700 1 -- 172.21.15.78:0/456710599 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8138025670 con 0x7f81280038e0 2023-08-17T17:52:01.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.599+0000 7f813e7fc700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f812c05edc0 0x7f812c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.600+0000 7f813e7fc700 1 -- 172.21.15.78:0/456710599 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f813807b1c0 con 0x7f81280038e0 2023-08-17T17:52:01.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.600+0000 7f8145b5f700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f812c05edc0 0x7f812c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.600+0000 7f8145b5f700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f812c05edc0 0x7f812c061280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8140159980 tx=0x7f813400b040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:01.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.604+0000 7f813e7fc700 1 -- 172.21.15.78:0/456710599 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f813804c760 con 0x7f81280038e0 2023-08-17T17:52:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.831+0000 7f81485c4700 1 -- 172.21.15.78:0/456710599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f81400c9a80 con 0x7f81280038e0 2023-08-17T17:52:01.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.831+0000 7f813e7fc700 1 -- 172.21.15.78:0/456710599 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1110 (secure 0 0 0) 0x7f8138016020 con 0x7f81280038e0 2023-08-17T17:52:01.833 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:52:01.833 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1075,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":121,"num_osds":8,"num_up_osds":8,"osd_up_since":1692293655,"num_in_osds":8,"osd_in_since":1692293648,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2478956544,"bytes_avail":770615156736,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":43,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7641}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-08-17T17:51:40.269875+0000","services":{}},"progress_events":{}} 2023-08-17T17:52:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 -- 172.21.15.78:0/456710599 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f812c05edc0 msgr2=0x7f812c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f812c05edc0 0x7f812c061280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8140159980 tx=0x7f813400b040).stop 2023-08-17T17:52:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 -- 172.21.15.78:0/456710599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 msgr2=0x7f81400ab110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 0x7f81400ab110 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f813800e4b0 tx=0x7f813801a000).stop 2023-08-17T17:52:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 -- 172.21.15.78:0/456710599 shutdown_connections 2023-08-17T17:52:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f812c05edc0 0x7f812c061280 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8140153840 0x7f8140148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280038e0 0x7f81400ab110 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 --2- 172.21.15.78:0/456710599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81400afb40 0x7f8140153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 -- 172.21.15.78:0/456710599 >> 172.21.15.78:0/456710599 conn(0x7f8140094510 msgr2=0x7f8140063980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 -- 172.21.15.78:0/456710599 shutdown_connections 2023-08-17T17:52:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.833+0000 7f81485c4700 1 -- 172.21.15.78:0/456710599 wait complete. 2023-08-17T17:52:01.846 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-17T17:52:01.847 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:52:01.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.958+0000 7f88198d6700 1 Processor -- start 2023-08-17T17:52:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.958+0000 7f88198d6700 1 -- start start 2023-08-17T17:52:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.959+0000 7f88198d6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 0x7f88140c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.959+0000 7f88198d6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f88140a7c40 0x7f88140c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.959+0000 7f88198d6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8814154520 con 0x7f88140a8080 2023-08-17T17:52:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.959+0000 7f88198d6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88140c91e0 con 0x7f88140a7c40 2023-08-17T17:52:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.959+0000 7f88198d6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88140c94c0 con 0x7f8814154140 2023-08-17T17:52:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.959+0000 7f880a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f88140a7c40 0x7f88140c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.959+0000 7f880a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f88140a7c40 0x7f88140c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37522/0 (socket says 172.21.15.78:37522) 2023-08-17T17:52:01.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.959+0000 7f880a7fc700 1 -- 172.21.15.78:0/3990296255 learned_addr learned my addr 172.21.15.78:0/3990296255 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:01.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.959+0000 7f8812ffd700 1 --2- 172.21.15.78:0/3990296255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 0x7f88140c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f880a7fc700 1 -- 172.21.15.78:0/3990296255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 msgr2=0x7f88140c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:01.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f880a7fc700 1 --2- 172.21.15.78:0/3990296255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 0x7f88140c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f880a7fc700 1 -- 172.21.15.78:0/3990296255 >> v1:172.21.15.150:6789/0 conn(0x7f88140a8080 legacy=0x7f88140ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f880a7fc700 1 -- 172.21.15.78:0/3990296255 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140c97a0 con 0x7f88140a7c40 2023-08-17T17:52:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f880a7fc700 1 --2- 172.21.15.78:0/3990296255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a7c40 0x7f88140c0900 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f87fc006fd0 tx=0x7f87fc0090f0).ready entity=mon.0 client_cookie=a507c359ad37fad7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88127fc700 1 -- 172.21.15.78:0/3990296255 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00b600 con 0x7f88140a7c40 2023-08-17T17:52:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88127fc700 1 -- 172.21.15.78:0/3990296255 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00b760 con 0x7f88140a7c40 2023-08-17T17:52:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88127fc700 1 -- 172.21.15.78:0/3990296255 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00bae0 con 0x7f88140a7c40 2023-08-17T17:52:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88198d6700 1 -- 172.21.15.78:0/3990296255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a7c40 msgr2=0x7f88140c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88198d6700 1 --2- 172.21.15.78:0/3990296255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a7c40 0x7f88140c0900 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f87fc006fd0 tx=0x7f87fc0090f0).stop 2023-08-17T17:52:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88198d6700 1 -- 172.21.15.78:0/3990296255 shutdown_connections 2023-08-17T17:52:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88198d6700 1 --2- 172.21.15.78:0/3990296255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 0x7f88140c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88198d6700 1 --2- 172.21.15.78:0/3990296255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a7c40 0x7f88140c0900 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88198d6700 1 -- 172.21.15.78:0/3990296255 >> 172.21.15.78:0/3990296255 conn(0x7f8814094510 msgr2=0x7f881406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88198d6700 1 -- 172.21.15.78:0/3990296255 shutdown_connections 2023-08-17T17:52:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.960+0000 7f88198d6700 1 -- 172.21.15.78:0/3990296255 wait complete. 2023-08-17T17:52:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.962+0000 7f88198d6700 1 Processor -- start 2023-08-17T17:52:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.962+0000 7f88198d6700 1 -- start start 2023-08-17T17:52:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.962+0000 7f88198d6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88140a7c40 0x7f88140ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.962+0000 7f88198d6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a8080 0x7f881414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.962+0000 7f88198d6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 0x7f88140c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.962+0000 7f88198d6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140aeed0 con 0x7f88140a8080 2023-08-17T17:52:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.962+0000 7f88198d6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140aece0 con 0x7f88140a7c40 2023-08-17T17:52:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.962+0000 7f88198d6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8814164a90 con 0x7f8814154140 2023-08-17T17:52:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.962+0000 7f880a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a8080 0x7f881414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.962+0000 7f880a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a8080 0x7f881414e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37532/0 (socket says 172.21.15.78:37532) 2023-08-17T17:52:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f880a7fc700 1 -- 172.21.15.78:0/2316768998 learned_addr learned my addr 172.21.15.78:0/2316768998 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f88137fe700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 0x7f88140c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f8812ffd700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88140a7c40 0x7f88140ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f880a7fc700 1 -- 172.21.15.78:0/2316768998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 msgr2=0x7f88140c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f880a7fc700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 0x7f88140c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f880a7fc700 1 -- 172.21.15.78:0/2316768998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88140a7c40 msgr2=0x7f88140ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f880a7fc700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88140a7c40 0x7f88140ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f880a7fc700 1 -- 172.21.15.78:0/2316768998 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc009370 con 0x7f88140a8080 2023-08-17T17:52:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f88137fe700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 0x7f88140c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:52:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f8812ffd700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88140a7c40 0x7f88140ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:52:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f880a7fc700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a8080 0x7f881414e100 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f87fc011000 tx=0x7f87fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f880b7fe700 1 -- 172.21.15.78:0/2316768998 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00b8d0 con 0x7f88140a8080 2023-08-17T17:52:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f880b7fe700 1 -- 172.21.15.78:0/2316768998 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00ba30 con 0x7f88140a8080 2023-08-17T17:52:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f88198d6700 1 -- 172.21.15.78:0/2316768998 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8814164f20 con 0x7f88140a8080 2023-08-17T17:52:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f880b7fe700 1 -- 172.21.15.78:0/2316768998 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc01b660 con 0x7f88140a8080 2023-08-17T17:52:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.963+0000 7f88198d6700 1 -- 172.21.15.78:0/2316768998 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8814164160 con 0x7f88140a8080 2023-08-17T17:52:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.964+0000 7f88198d6700 1 -- 172.21.15.78:0/2316768998 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8814047350 con 0x7f88140a8080 2023-08-17T17:52:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.964+0000 7f880b7fe700 1 -- 172.21.15.78:0/2316768998 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f87fc02b070 con 0x7f88140a8080 2023-08-17T17:52:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.965+0000 7f880b7fe700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87f405edc0 0x7f87f4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.965+0000 7f880b7fe700 1 -- 172.21.15.78:0/2316768998 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f87fc07b480 con 0x7f88140a8080 2023-08-17T17:52:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.965+0000 7f8812ffd700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87f405edc0 0x7f87f4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.965+0000 7f8812ffd700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87f405edc0 0x7f87f4061280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f88040098c0 tx=0x7f8804008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:01.969+0000 7f880b7fe700 1 -- 172.21.15.78:0/2316768998 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87fc04ca20 con 0x7f88140a8080 2023-08-17T17:52:02.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.127+0000 7f88198d6700 1 -- 172.21.15.78:0/2316768998 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88140632a0 con 0x7f87f405edc0 2023-08-17T17:52:02.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.136+0000 7f880b7fe700 1 -- 172.21.15.78:0/2316768998 <== mgr.7446 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361770 (secure 0 0 0) 0x7f88140632a0 con 0x7f87f405edc0 2023-08-17T17:52:02.141 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:52:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.139+0000 7f88198d6700 1 -- 172.21.15.78:0/2316768998 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87f405edc0 msgr2=0x7f87f4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.139+0000 7f88198d6700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87f405edc0 0x7f87f4061280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f88040098c0 tx=0x7f8804008040).stop 2023-08-17T17:52:02.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.139+0000 7f88198d6700 1 -- 172.21.15.78:0/2316768998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a8080 msgr2=0x7f881414e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:02.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.139+0000 7f88198d6700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a8080 0x7f881414e100 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f87fc011000 tx=0x7f87fc017000).stop 2023-08-17T17:52:02.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.139+0000 7f88198d6700 1 -- 172.21.15.78:0/2316768998 shutdown_connections 2023-08-17T17:52:02.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.139+0000 7f88198d6700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f87f405edc0 0x7f87f4061280 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:02.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.139+0000 7f88198d6700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8814154140 0x7f88140c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:02.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.139+0000 7f88198d6700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88140a7c40 0x7f88140ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:02.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.139+0000 7f88198d6700 1 --2- 172.21.15.78:0/2316768998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88140a8080 0x7f881414e100 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.139+0000 7f88198d6700 1 -- 172.21.15.78:0/2316768998 >> 172.21.15.78:0/2316768998 conn(0x7f8814094510 msgr2=0x7f8814153110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.140+0000 7f88198d6700 1 -- 172.21.15.78:0/2316768998 shutdown_connections 2023-08-17T17:52:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:02.140+0000 7f88198d6700 1 -- 172.21.15.78:0/2316768998 wait complete. 2023-08-17T17:52:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:52:02.153 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-08-17T17:52:01.736049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2421280,"kb_used_data":11744,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553440,"statfs":{"total":773094113280,"available":770614722560,"internally_reserved":0,"allocated":12025856,"data_stored":5938620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5592,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.572279"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741123+0000","last_change":"2023-08-17T17:51:57.736817+0000","last_active":"2023-08-17T17:51:57.741123+0000","last_peered":"2023-08-17T17:51:57.741123+0000","last_clean":"2023-08-17T17:51:57.741123+0000","last_became_active":"2023-08-17T17:51:57.736540+0000","last_became_peered":"2023-08-17T17:51:57.736540+0000","last_unstale":"2023-08-17T17:51:57.741123+0000","last_undegraded":"2023-08-17T17:51:57.741123+0000","last_fullsized":"2023-08-17T17:51:57.741123+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"120'3","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743818+0000","last_change":"2023-08-17T17:51:57.372019+0000","last_active":"2023-08-17T17:51:57.743818+0000","last_peered":"2023-08-17T17:51:57.743818+0000","last_clean":"2023-08-17T17:51:57.743818+0000","last_became_active":"2023-08-17T17:51:57.371744+0000","last_became_peered":"2023-08-17T17:51:57.371744+0000","last_unstale":"2023-08-17T17:51:57.743818+0000","last_undegraded":"2023-08-17T17:51:57.743818+0000","last_fullsized":"2023-08-17T17:51:57.743818+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746327+0000","last_change":"2023-08-17T17:51:57.741430+0000","last_active":"2023-08-17T17:51:57.746327+0000","last_peered":"2023-08-17T17:51:57.746327+0000","last_clean":"2023-08-17T17:51:57.746327+0000","last_became_active":"2023-08-17T17:51:57.741084+0000","last_became_peered":"2023-08-17T17:51:57.741084+0000","last_unstale":"2023-08-17T17:51:57.746327+0000","last_undegraded":"2023-08-17T17:51:57.746327+0000","last_fullsized":"2023-08-17T17:51:57.746327+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726506+0000","last_change":"2023-08-17T17:51:57.369427+0000","last_active":"2023-08-17T17:51:57.726506+0000","last_peered":"2023-08-17T17:51:57.726506+0000","last_clean":"2023-08-17T17:51:57.726506+0000","last_became_active":"2023-08-17T17:51:57.367170+0000","last_became_peered":"2023-08-17T17:51:57.367170+0000","last_unstale":"2023-08-17T17:51:57.726506+0000","last_undegraded":"2023-08-17T17:51:57.726506+0000","last_fullsized":"2023-08-17T17:51:57.726506+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746809+0000","last_change":"2023-08-17T17:51:57.744356+0000","last_active":"2023-08-17T17:51:57.746809+0000","last_peered":"2023-08-17T17:51:57.746809+0000","last_clean":"2023-08-17T17:51:57.746809+0000","last_became_active":"2023-08-17T17:51:57.744078+0000","last_became_peered":"2023-08-17T17:51:57.744078+0000","last_unstale":"2023-08-17T17:51:57.746809+0000","last_undegraded":"2023-08-17T17:51:57.746809+0000","last_fullsized":"2023-08-17T17:51:57.746809+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.728569+0000","last_change":"2023-08-17T17:51:57.371948+0000","last_active":"2023-08-17T17:51:57.728569+0000","last_peered":"2023-08-17T17:51:57.728569+0000","last_clean":"2023-08-17T17:51:57.728569+0000","last_became_active":"2023-08-17T17:51:57.371681+0000","last_became_peered":"2023-08-17T17:51:57.371681+0000","last_unstale":"2023-08-17T17:51:57.728569+0000","last_undegraded":"2023-08-17T17:51:57.728569+0000","last_fullsized":"2023-08-17T17:51:57.728569+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737858+0000","last_change":"2023-08-17T17:51:57.734487+0000","last_active":"2023-08-17T17:51:57.737858+0000","last_peered":"2023-08-17T17:51:57.737858+0000","last_clean":"2023-08-17T17:51:57.737858+0000","last_became_active":"2023-08-17T17:51:57.734220+0000","last_became_peered":"2023-08-17T17:51:57.734220+0000","last_unstale":"2023-08-17T17:51:57.737858+0000","last_undegraded":"2023-08-17T17:51:57.737858+0000","last_fullsized":"2023-08-17T17:51:57.737858+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740122+0000","last_change":"2023-08-17T17:51:57.374181+0000","last_active":"2023-08-17T17:51:57.740122+0000","last_peered":"2023-08-17T17:51:57.740122+0000","last_clean":"2023-08-17T17:51:57.740122+0000","last_became_active":"2023-08-17T17:51:57.373919+0000","last_became_peered":"2023-08-17T17:51:57.373919+0000","last_unstale":"2023-08-17T17:51:57.740122+0000","last_undegraded":"2023-08-17T17:51:57.740122+0000","last_fullsized":"2023-08-17T17:51:57.740122+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746873+0000","last_change":"2023-08-17T17:51:57.746014+0000","last_active":"2023-08-17T17:51:57.746873+0000","last_peered":"2023-08-17T17:51:57.746873+0000","last_clean":"2023-08-17T17:51:57.746873+0000","last_became_active":"2023-08-17T17:51:57.745746+0000","last_became_peered":"2023-08-17T17:51:57.745746+0000","last_unstale":"2023-08-17T17:51:57.746873+0000","last_undegraded":"2023-08-17T17:51:57.746873+0000","last_fullsized":"2023-08-17T17:51:57.746873+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.738418+0000","last_change":"2023-08-17T17:51:57.364492+0000","last_active":"2023-08-17T17:51:57.738418+0000","last_peered":"2023-08-17T17:51:57.738418+0000","last_clean":"2023-08-17T17:51:57.738418+0000","last_became_active":"2023-08-17T17:51:57.364152+0000","last_became_peered":"2023-08-17T17:51:57.364152+0000","last_unstale":"2023-08-17T17:51:57.738418+0000","last_undegraded":"2023-08-17T17:51:57.738418+0000","last_fullsized":"2023-08-17T17:51:57.738418+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743278+0000","last_change":"2023-08-17T17:51:57.737103+0000","last_active":"2023-08-17T17:51:57.743278+0000","last_peered":"2023-08-17T17:51:57.743278+0000","last_clean":"2023-08-17T17:51:57.743278+0000","last_became_active":"2023-08-17T17:51:57.735308+0000","last_became_peered":"2023-08-17T17:51:57.735308+0000","last_unstale":"2023-08-17T17:51:57.743278+0000","last_undegraded":"2023-08-17T17:51:57.743278+0000","last_fullsized":"2023-08-17T17:51:57.743278+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743460+0000","last_change":"2023-08-17T17:51:57.363803+0000","last_active":"2023-08-17T17:51:57.743460+0000","last_peered":"2023-08-17T17:51:57.743460+0000","last_clean":"2023-08-17T17:51:57.743460+0000","last_became_active":"2023-08-17T17:51:57.363514+0000","last_became_peered":"2023-08-17T17:51:57.363514+0000","last_unstale":"2023-08-17T17:51:57.743460+0000","last_undegraded":"2023-08-17T17:51:57.743460+0000","last_fullsized":"2023-08-17T17:51:57.743460+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745059+0000","last_change":"2023-08-17T17:51:57.737694+0000","last_active":"2023-08-17T17:51:57.745059+0000","last_peered":"2023-08-17T17:51:57.745059+0000","last_clean":"2023-08-17T17:51:57.745059+0000","last_became_active":"2023-08-17T17:51:57.737323+0000","last_became_peered":"2023-08-17T17:51:57.737323+0000","last_unstale":"2023-08-17T17:51:57.745059+0000","last_undegraded":"2023-08-17T17:51:57.745059+0000","last_fullsized":"2023-08-17T17:51:57.745059+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731079+0000","last_change":"2023-08-17T17:51:57.365742+0000","last_active":"2023-08-17T17:51:57.731079+0000","last_peered":"2023-08-17T17:51:57.731079+0000","last_clean":"2023-08-17T17:51:57.731079+0000","last_became_active":"2023-08-17T17:51:57.365407+0000","last_became_peered":"2023-08-17T17:51:57.365407+0000","last_unstale":"2023-08-17T17:51:57.731079+0000","last_undegraded":"2023-08-17T17:51:57.731079+0000","last_fullsized":"2023-08-17T17:51:57.731079+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746837+0000","last_change":"2023-08-17T17:51:57.743870+0000","last_active":"2023-08-17T17:51:57.746837+0000","last_peered":"2023-08-17T17:51:57.746837+0000","last_clean":"2023-08-17T17:51:57.746837+0000","last_became_active":"2023-08-17T17:51:57.743565+0000","last_became_peered":"2023-08-17T17:51:57.743565+0000","last_unstale":"2023-08-17T17:51:57.746837+0000","last_undegraded":"2023-08-17T17:51:57.746837+0000","last_fullsized":"2023-08-17T17:51:57.746837+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.727864+0000","last_change":"2023-08-17T17:51:57.366896+0000","last_active":"2023-08-17T17:51:57.727864+0000","last_peered":"2023-08-17T17:51:57.727864+0000","last_clean":"2023-08-17T17:51:57.727864+0000","last_became_active":"2023-08-17T17:51:57.366622+0000","last_became_peered":"2023-08-17T17:51:57.366622+0000","last_unstale":"2023-08-17T17:51:57.727864+0000","last_undegraded":"2023-08-17T17:51:57.727864+0000","last_fullsized":"2023-08-17T17:51:57.727864+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743559+0000","last_change":"2023-08-17T17:51:57.739042+0000","last_active":"2023-08-17T17:51:57.743559+0000","last_peered":"2023-08-17T17:51:57.743559+0000","last_clean":"2023-08-17T17:51:57.743559+0000","last_became_active":"2023-08-17T17:51:57.738803+0000","last_became_peered":"2023-08-17T17:51:57.738803+0000","last_unstale":"2023-08-17T17:51:57.743559+0000","last_undegraded":"2023-08-17T17:51:57.743559+0000","last_fullsized":"2023-08-17T17:51:57.743559+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.724725+0000","last_change":"2023-08-17T17:51:57.367641+0000","last_active":"2023-08-17T17:51:57.724725+0000","last_peered":"2023-08-17T17:51:57.724725+0000","last_clean":"2023-08-17T17:51:57.724725+0000","last_became_active":"2023-08-17T17:51:57.367429+0000","last_became_peered":"2023-08-17T17:51:57.367429+0000","last_unstale":"2023-08-17T17:51:57.724725+0000","last_undegraded":"2023-08-17T17:51:57.724725+0000","last_fullsized":"2023-08-17T17:51:57.724725+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743160+0000","last_change":"2023-08-17T17:51:57.739205+0000","last_active":"2023-08-17T17:51:57.743160+0000","last_peered":"2023-08-17T17:51:57.743160+0000","last_clean":"2023-08-17T17:51:57.743160+0000","last_became_active":"2023-08-17T17:51:57.738941+0000","last_became_peered":"2023-08-17T17:51:57.738941+0000","last_unstale":"2023-08-17T17:51:57.743160+0000","last_undegraded":"2023-08-17T17:51:57.743160+0000","last_fullsized":"2023-08-17T17:51:57.743160+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.727984+0000","last_change":"2023-08-17T17:51:57.364458+0000","last_active":"2023-08-17T17:51:57.727984+0000","last_peered":"2023-08-17T17:51:57.727984+0000","last_clean":"2023-08-17T17:51:57.727984+0000","last_became_active":"2023-08-17T17:51:57.363914+0000","last_became_peered":"2023-08-17T17:51:57.363914+0000","last_unstale":"2023-08-17T17:51:57.727984+0000","last_undegraded":"2023-08-17T17:51:57.727984+0000","last_fullsized":"2023-08-17T17:51:57.727984+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743819+0000","last_change":"2023-08-17T17:51:57.741274+0000","last_active":"2023-08-17T17:51:57.743819+0000","last_peered":"2023-08-17T17:51:57.743819+0000","last_clean":"2023-08-17T17:51:57.743819+0000","last_became_active":"2023-08-17T17:51:57.740966+0000","last_became_peered":"2023-08-17T17:51:57.740966+0000","last_unstale":"2023-08-17T17:51:57.743819+0000","last_undegraded":"2023-08-17T17:51:57.743819+0000","last_fullsized":"2023-08-17T17:51:57.743819+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731780+0000","last_change":"2023-08-17T17:51:57.365669+0000","last_active":"2023-08-17T17:51:57.731780+0000","last_peered":"2023-08-17T17:51:57.731780+0000","last_clean":"2023-08-17T17:51:57.731780+0000","last_became_active":"2023-08-17T17:51:57.364949+0000","last_became_peered":"2023-08-17T17:51:57.364949+0000","last_unstale":"2023-08-17T17:51:57.731780+0000","last_undegraded":"2023-08-17T17:51:57.731780+0000","last_fullsized":"2023-08-17T17:51:57.731780+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.727281+0000","last_change":"2023-08-17T17:51:57.724629+0000","last_active":"2023-08-17T17:51:57.727281+0000","last_peered":"2023-08-17T17:51:57.727281+0000","last_clean":"2023-08-17T17:51:57.727281+0000","last_became_active":"2023-08-17T17:51:57.724332+0000","last_became_peered":"2023-08-17T17:51:57.724332+0000","last_unstale":"2023-08-17T17:51:57.727281+0000","last_undegraded":"2023-08-17T17:51:57.727281+0000","last_fullsized":"2023-08-17T17:51:57.727281+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"120'4","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.751497+0000","last_change":"2023-08-17T17:51:57.364955+0000","last_active":"2023-08-17T17:51:57.751497+0000","last_peered":"2023-08-17T17:51:57.751497+0000","last_clean":"2023-08-17T17:51:57.751497+0000","last_became_active":"2023-08-17T17:51:57.364670+0000","last_became_peered":"2023-08-17T17:51:57.364670+0000","last_unstale":"2023-08-17T17:51:57.751497+0000","last_undegraded":"2023-08-17T17:51:57.751497+0000","last_fullsized":"2023-08-17T17:51:57.751497+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.748796+0000","last_change":"2023-08-17T17:51:57.744606+0000","last_active":"2023-08-17T17:51:57.748796+0000","last_peered":"2023-08-17T17:51:57.748796+0000","last_clean":"2023-08-17T17:51:57.748796+0000","last_became_active":"2023-08-17T17:51:57.742633+0000","last_became_peered":"2023-08-17T17:51:57.742633+0000","last_unstale":"2023-08-17T17:51:57.748796+0000","last_undegraded":"2023-08-17T17:51:57.748796+0000","last_fullsized":"2023-08-17T17:51:57.748796+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745168+0000","last_change":"2023-08-17T17:51:57.370269+0000","last_active":"2023-08-17T17:51:57.745168+0000","last_peered":"2023-08-17T17:51:57.745168+0000","last_clean":"2023-08-17T17:51:57.745168+0000","last_became_active":"2023-08-17T17:51:57.369996+0000","last_became_peered":"2023-08-17T17:51:57.369996+0000","last_unstale":"2023-08-17T17:51:57.745168+0000","last_undegraded":"2023-08-17T17:51:57.745168+0000","last_fullsized":"2023-08-17T17:51:57.745168+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745811+0000","last_change":"2023-08-17T17:51:57.741956+0000","last_active":"2023-08-17T17:51:57.745811+0000","last_peered":"2023-08-17T17:51:57.745811+0000","last_clean":"2023-08-17T17:51:57.745811+0000","last_became_active":"2023-08-17T17:51:57.741512+0000","last_became_peered":"2023-08-17T17:51:57.741512+0000","last_unstale":"2023-08-17T17:51:57.745811+0000","last_undegraded":"2023-08-17T17:51:57.745811+0000","last_fullsized":"2023-08-17T17:51:57.745811+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.720588+0000","last_change":"2023-08-17T17:51:57.361489+0000","last_active":"2023-08-17T17:51:57.720588+0000","last_peered":"2023-08-17T17:51:57.720588+0000","last_clean":"2023-08-17T17:51:57.720588+0000","last_became_active":"2023-08-17T17:51:57.360703+0000","last_became_peered":"2023-08-17T17:51:57.360703+0000","last_unstale":"2023-08-17T17:51:57.720588+0000","last_undegraded":"2023-08-17T17:51:57.720588+0000","last_fullsized":"2023-08-17T17:51:57.720588+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.747085+0000","last_change":"2023-08-17T17:51:57.743058+0000","last_active":"2023-08-17T17:51:57.747085+0000","last_peered":"2023-08-17T17:51:57.747085+0000","last_clean":"2023-08-17T17:51:57.747085+0000","last_became_active":"2023-08-17T17:51:57.742794+0000","last_became_peered":"2023-08-17T17:51:57.742794+0000","last_unstale":"2023-08-17T17:51:57.747085+0000","last_undegraded":"2023-08-17T17:51:57.747085+0000","last_fullsized":"2023-08-17T17:51:57.747085+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.728997+0000","last_change":"2023-08-17T17:51:57.371311+0000","last_active":"2023-08-17T17:51:57.728997+0000","last_peered":"2023-08-17T17:51:57.728997+0000","last_clean":"2023-08-17T17:51:57.728997+0000","last_became_active":"2023-08-17T17:51:57.370887+0000","last_became_peered":"2023-08-17T17:51:57.370887+0000","last_unstale":"2023-08-17T17:51:57.728997+0000","last_undegraded":"2023-08-17T17:51:57.728997+0000","last_fullsized":"2023-08-17T17:51:57.728997+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745590+0000","last_change":"2023-08-17T17:51:57.739371+0000","last_active":"2023-08-17T17:51:57.745590+0000","last_peered":"2023-08-17T17:51:57.745590+0000","last_clean":"2023-08-17T17:51:57.745590+0000","last_became_active":"2023-08-17T17:51:57.738960+0000","last_became_peered":"2023-08-17T17:51:57.738960+0000","last_unstale":"2023-08-17T17:51:57.745590+0000","last_undegraded":"2023-08-17T17:51:57.745590+0000","last_fullsized":"2023-08-17T17:51:57.745590+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"120'4","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743978+0000","last_change":"2023-08-17T17:51:57.371279+0000","last_active":"2023-08-17T17:51:57.743978+0000","last_peered":"2023-08-17T17:51:57.743978+0000","last_clean":"2023-08-17T17:51:57.743978+0000","last_became_active":"2023-08-17T17:51:57.370997+0000","last_became_peered":"2023-08-17T17:51:57.370997+0000","last_unstale":"2023-08-17T17:51:57.743978+0000","last_undegraded":"2023-08-17T17:51:57.743978+0000","last_fullsized":"2023-08-17T17:51:57.743978+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744380+0000","last_change":"2023-08-17T17:51:57.740264+0000","last_active":"2023-08-17T17:51:57.744380+0000","last_peered":"2023-08-17T17:51:57.744380+0000","last_clean":"2023-08-17T17:51:57.744380+0000","last_became_active":"2023-08-17T17:51:57.739934+0000","last_became_peered":"2023-08-17T17:51:57.739934+0000","last_unstale":"2023-08-17T17:51:57.744380+0000","last_undegraded":"2023-08-17T17:51:57.744380+0000","last_fullsized":"2023-08-17T17:51:57.744380+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.727698+0000","last_change":"2023-08-17T17:51:57.368671+0000","last_active":"2023-08-17T17:51:57.727698+0000","last_peered":"2023-08-17T17:51:57.727698+0000","last_clean":"2023-08-17T17:51:57.727698+0000","last_became_active":"2023-08-17T17:51:57.367279+0000","last_became_peered":"2023-08-17T17:51:57.367279+0000","last_unstale":"2023-08-17T17:51:57.727698+0000","last_undegraded":"2023-08-17T17:51:57.727698+0000","last_fullsized":"2023-08-17T17:51:57.727698+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744207+0000","last_change":"2023-08-17T17:51:57.742432+0000","last_active":"2023-08-17T17:51:57.744207+0000","last_peered":"2023-08-17T17:51:57.744207+0000","last_clean":"2023-08-17T17:51:57.744207+0000","last_became_active":"2023-08-17T17:51:57.742124+0000","last_became_peered":"2023-08-17T17:51:57.742124+0000","last_unstale":"2023-08-17T17:51:57.744207+0000","last_undegraded":"2023-08-17T17:51:57.744207+0000","last_fullsized":"2023-08-17T17:51:57.744207+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731660+0000","last_change":"2023-08-17T17:51:57.364545+0000","last_active":"2023-08-17T17:51:57.731660+0000","last_peered":"2023-08-17T17:51:57.731660+0000","last_clean":"2023-08-17T17:51:57.731660+0000","last_became_active":"2023-08-17T17:51:57.364328+0000","last_became_peered":"2023-08-17T17:51:57.364328+0000","last_unstale":"2023-08-17T17:51:57.731660+0000","last_undegraded":"2023-08-17T17:51:57.731660+0000","last_fullsized":"2023-08-17T17:51:57.731660+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744259+0000","last_change":"2023-08-17T17:51:57.738490+0000","last_active":"2023-08-17T17:51:57.744259+0000","last_peered":"2023-08-17T17:51:57.744259+0000","last_clean":"2023-08-17T17:51:57.744259+0000","last_became_active":"2023-08-17T17:51:57.738172+0000","last_became_peered":"2023-08-17T17:51:57.738172+0000","last_unstale":"2023-08-17T17:51:57.744259+0000","last_undegraded":"2023-08-17T17:51:57.744259+0000","last_fullsized":"2023-08-17T17:51:57.744259+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744210+0000","last_change":"2023-08-17T17:51:57.364693+0000","last_active":"2023-08-17T17:51:57.744210+0000","last_peered":"2023-08-17T17:51:57.744210+0000","last_clean":"2023-08-17T17:51:57.744210+0000","last_became_active":"2023-08-17T17:51:57.364380+0000","last_became_peered":"2023-08-17T17:51:57.364380+0000","last_unstale":"2023-08-17T17:51:57.744210+0000","last_undegraded":"2023-08-17T17:51:57.744210+0000","last_fullsized":"2023-08-17T17:51:57.744210+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739972+0000","last_change":"2023-08-17T17:51:57.736280+0000","last_active":"2023-08-17T17:51:57.739972+0000","last_peered":"2023-08-17T17:51:57.739972+0000","last_clean":"2023-08-17T17:51:57.739972+0000","last_became_active":"2023-08-17T17:51:57.736022+0000","last_became_peered":"2023-08-17T17:51:57.736022+0000","last_unstale":"2023-08-17T17:51:57.739972+0000","last_undegraded":"2023-08-17T17:51:57.739972+0000","last_fullsized":"2023-08-17T17:51:57.739972+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.724563+0000","last_change":"2023-08-17T17:51:57.366633+0000","last_active":"2023-08-17T17:51:57.724563+0000","last_peered":"2023-08-17T17:51:57.724563+0000","last_clean":"2023-08-17T17:51:57.724563+0000","last_became_active":"2023-08-17T17:51:57.366315+0000","last_became_peered":"2023-08-17T17:51:57.366315+0000","last_unstale":"2023-08-17T17:51:57.724563+0000","last_undegraded":"2023-08-17T17:51:57.724563+0000","last_fullsized":"2023-08-17T17:51:57.724563+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.748817+0000","last_change":"2023-08-17T17:51:57.745459+0000","last_active":"2023-08-17T17:51:57.748817+0000","last_peered":"2023-08-17T17:51:57.748817+0000","last_clean":"2023-08-17T17:51:57.748817+0000","last_became_active":"2023-08-17T17:51:57.744943+0000","last_became_peered":"2023-08-17T17:51:57.744943+0000","last_unstale":"2023-08-17T17:51:57.748817+0000","last_undegraded":"2023-08-17T17:51:57.748817+0000","last_fullsized":"2023-08-17T17:51:57.748817+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741504+0000","last_change":"2023-08-17T17:51:57.357092+0000","last_active":"2023-08-17T17:51:57.741504+0000","last_peered":"2023-08-17T17:51:57.741504+0000","last_clean":"2023-08-17T17:51:57.741504+0000","last_became_active":"2023-08-17T17:51:57.356635+0000","last_became_peered":"2023-08-17T17:51:57.356635+0000","last_unstale":"2023-08-17T17:51:57.741504+0000","last_undegraded":"2023-08-17T17:51:57.741504+0000","last_fullsized":"2023-08-17T17:51:57.741504+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743301+0000","last_change":"2023-08-17T17:51:57.737960+0000","last_active":"2023-08-17T17:51:57.743301+0000","last_peered":"2023-08-17T17:51:57.743301+0000","last_clean":"2023-08-17T17:51:57.743301+0000","last_became_active":"2023-08-17T17:51:57.737660+0000","last_became_peered":"2023-08-17T17:51:57.737660+0000","last_unstale":"2023-08-17T17:51:57.743301+0000","last_undegraded":"2023-08-17T17:51:57.743301+0000","last_fullsized":"2023-08-17T17:51:57.743301+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726298+0000","last_change":"2023-08-17T17:51:57.360703+0000","last_active":"2023-08-17T17:51:57.726298+0000","last_peered":"2023-08-17T17:51:57.726298+0000","last_clean":"2023-08-17T17:51:57.726298+0000","last_became_active":"2023-08-17T17:51:57.360437+0000","last_became_peered":"2023-08-17T17:51:57.360437+0000","last_unstale":"2023-08-17T17:51:57.726298+0000","last_undegraded":"2023-08-17T17:51:57.726298+0000","last_fullsized":"2023-08-17T17:51:57.726298+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744279+0000","last_change":"2023-08-17T17:51:57.742060+0000","last_active":"2023-08-17T17:51:57.744279+0000","last_peered":"2023-08-17T17:51:57.744279+0000","last_clean":"2023-08-17T17:51:57.744279+0000","last_became_active":"2023-08-17T17:51:57.741759+0000","last_became_peered":"2023-08-17T17:51:57.741759+0000","last_unstale":"2023-08-17T17:51:57.744279+0000","last_undegraded":"2023-08-17T17:51:57.744279+0000","last_fullsized":"2023-08-17T17:51:57.744279+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726338+0000","last_change":"2023-08-17T17:51:57.366381+0000","last_active":"2023-08-17T17:51:57.726338+0000","last_peered":"2023-08-17T17:51:57.726338+0000","last_clean":"2023-08-17T17:51:57.726338+0000","last_became_active":"2023-08-17T17:51:57.366077+0000","last_became_peered":"2023-08-17T17:51:57.366077+0000","last_unstale":"2023-08-17T17:51:57.726338+0000","last_undegraded":"2023-08-17T17:51:57.726338+0000","last_fullsized":"2023-08-17T17:51:57.726338+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740279+0000","last_change":"2023-08-17T17:51:57.739049+0000","last_active":"2023-08-17T17:51:57.740279+0000","last_peered":"2023-08-17T17:51:57.740279+0000","last_clean":"2023-08-17T17:51:57.740279+0000","last_became_active":"2023-08-17T17:51:57.738709+0000","last_became_peered":"2023-08-17T17:51:57.738709+0000","last_unstale":"2023-08-17T17:51:57.740279+0000","last_undegraded":"2023-08-17T17:51:57.740279+0000","last_fullsized":"2023-08-17T17:51:57.740279+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731154+0000","last_change":"2023-08-17T17:51:57.366793+0000","last_active":"2023-08-17T17:51:57.731154+0000","last_peered":"2023-08-17T17:51:57.731154+0000","last_clean":"2023-08-17T17:51:57.731154+0000","last_became_active":"2023-08-17T17:51:57.366484+0000","last_became_peered":"2023-08-17T17:51:57.366484+0000","last_unstale":"2023-08-17T17:51:57.731154+0000","last_undegraded":"2023-08-17T17:51:57.731154+0000","last_fullsized":"2023-08-17T17:51:57.731154+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741326+0000","last_change":"2023-08-17T17:51:57.738955+0000","last_active":"2023-08-17T17:51:57.741326+0000","last_peered":"2023-08-17T17:51:57.741326+0000","last_clean":"2023-08-17T17:51:57.741326+0000","last_became_active":"2023-08-17T17:51:57.738716+0000","last_became_peered":"2023-08-17T17:51:57.738716+0000","last_unstale":"2023-08-17T17:51:57.741326+0000","last_undegraded":"2023-08-17T17:51:57.741326+0000","last_fullsized":"2023-08-17T17:51:57.741326+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.729339+0000","last_change":"2023-08-17T17:51:57.369068+0000","last_active":"2023-08-17T17:51:57.729339+0000","last_peered":"2023-08-17T17:51:57.729339+0000","last_clean":"2023-08-17T17:51:57.729339+0000","last_became_active":"2023-08-17T17:51:57.368742+0000","last_became_peered":"2023-08-17T17:51:57.368742+0000","last_unstale":"2023-08-17T17:51:57.729339+0000","last_undegraded":"2023-08-17T17:51:57.729339+0000","last_fullsized":"2023-08-17T17:51:57.729339+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739588+0000","last_change":"2023-08-17T17:51:57.738483+0000","last_active":"2023-08-17T17:51:57.739588+0000","last_peered":"2023-08-17T17:51:57.739588+0000","last_clean":"2023-08-17T17:51:57.739588+0000","last_became_active":"2023-08-17T17:51:57.738191+0000","last_became_peered":"2023-08-17T17:51:57.738191+0000","last_unstale":"2023-08-17T17:51:57.739588+0000","last_undegraded":"2023-08-17T17:51:57.739588+0000","last_fullsized":"2023-08-17T17:51:57.739588+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726605+0000","last_change":"2023-08-17T17:51:57.369642+0000","last_active":"2023-08-17T17:51:57.726605+0000","last_peered":"2023-08-17T17:51:57.726605+0000","last_clean":"2023-08-17T17:51:57.726605+0000","last_became_active":"2023-08-17T17:51:57.368957+0000","last_became_peered":"2023-08-17T17:51:57.368957+0000","last_unstale":"2023-08-17T17:51:57.726605+0000","last_undegraded":"2023-08-17T17:51:57.726605+0000","last_fullsized":"2023-08-17T17:51:57.726605+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746823+0000","last_change":"2023-08-17T17:51:57.744601+0000","last_active":"2023-08-17T17:51:57.746823+0000","last_peered":"2023-08-17T17:51:57.746823+0000","last_clean":"2023-08-17T17:51:57.746823+0000","last_became_active":"2023-08-17T17:51:57.744301+0000","last_became_peered":"2023-08-17T17:51:57.744301+0000","last_unstale":"2023-08-17T17:51:57.746823+0000","last_undegraded":"2023-08-17T17:51:57.746823+0000","last_fullsized":"2023-08-17T17:51:57.746823+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731486+0000","last_change":"2023-08-17T17:51:57.373027+0000","last_active":"2023-08-17T17:51:57.731486+0000","last_peered":"2023-08-17T17:51:57.731486+0000","last_clean":"2023-08-17T17:51:57.731486+0000","last_became_active":"2023-08-17T17:51:57.372752+0000","last_became_peered":"2023-08-17T17:51:57.372752+0000","last_unstale":"2023-08-17T17:51:57.731486+0000","last_undegraded":"2023-08-17T17:51:57.731486+0000","last_fullsized":"2023-08-17T17:51:57.731486+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744097+0000","last_change":"2023-08-17T17:51:57.738437+0000","last_active":"2023-08-17T17:51:57.744097+0000","last_peered":"2023-08-17T17:51:57.744097+0000","last_clean":"2023-08-17T17:51:57.744097+0000","last_became_active":"2023-08-17T17:51:57.738185+0000","last_became_peered":"2023-08-17T17:51:57.738185+0000","last_unstale":"2023-08-17T17:51:57.744097+0000","last_undegraded":"2023-08-17T17:51:57.744097+0000","last_fullsized":"2023-08-17T17:51:57.744097+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.730883+0000","last_change":"2023-08-17T17:51:57.364469+0000","last_active":"2023-08-17T17:51:57.730883+0000","last_peered":"2023-08-17T17:51:57.730883+0000","last_clean":"2023-08-17T17:51:57.730883+0000","last_became_active":"2023-08-17T17:51:57.364172+0000","last_became_peered":"2023-08-17T17:51:57.364172+0000","last_unstale":"2023-08-17T17:51:57.730883+0000","last_undegraded":"2023-08-17T17:51:57.730883+0000","last_fullsized":"2023-08-17T17:51:57.730883+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.747690+0000","last_change":"2023-08-17T17:51:57.747265+0000","last_active":"2023-08-17T17:51:57.747690+0000","last_peered":"2023-08-17T17:51:57.747690+0000","last_clean":"2023-08-17T17:51:57.747690+0000","last_became_active":"2023-08-17T17:51:57.747038+0000","last_became_peered":"2023-08-17T17:51:57.747038+0000","last_unstale":"2023-08-17T17:51:57.747690+0000","last_undegraded":"2023-08-17T17:51:57.747690+0000","last_fullsized":"2023-08-17T17:51:57.747690+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726693+0000","last_change":"2023-08-17T17:51:57.366268+0000","last_active":"2023-08-17T17:51:57.726693+0000","last_peered":"2023-08-17T17:51:57.726693+0000","last_clean":"2023-08-17T17:51:57.726693+0000","last_became_active":"2023-08-17T17:51:57.365967+0000","last_became_peered":"2023-08-17T17:51:57.365967+0000","last_unstale":"2023-08-17T17:51:57.726693+0000","last_undegraded":"2023-08-17T17:51:57.726693+0000","last_fullsized":"2023-08-17T17:51:57.726693+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.738226+0000","last_change":"2023-08-17T17:51:57.729499+0000","last_active":"2023-08-17T17:51:57.738226+0000","last_peered":"2023-08-17T17:51:57.738226+0000","last_clean":"2023-08-17T17:51:57.738226+0000","last_became_active":"2023-08-17T17:51:57.729219+0000","last_became_peered":"2023-08-17T17:51:57.729219+0000","last_unstale":"2023-08-17T17:51:57.738226+0000","last_undegraded":"2023-08-17T17:51:57.738226+0000","last_fullsized":"2023-08-17T17:51:57.738226+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.720821+0000","last_change":"2023-08-17T17:51:57.372404+0000","last_active":"2023-08-17T17:51:57.720821+0000","last_peered":"2023-08-17T17:51:57.720821+0000","last_clean":"2023-08-17T17:51:57.720821+0000","last_became_active":"2023-08-17T17:51:57.369293+0000","last_became_peered":"2023-08-17T17:51:57.369293+0000","last_unstale":"2023-08-17T17:51:57.720821+0000","last_undegraded":"2023-08-17T17:51:57.720821+0000","last_fullsized":"2023-08-17T17:51:57.720821+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739316+0000","last_change":"2023-08-17T17:51:57.736259+0000","last_active":"2023-08-17T17:51:57.739316+0000","last_peered":"2023-08-17T17:51:57.739316+0000","last_clean":"2023-08-17T17:51:57.739316+0000","last_became_active":"2023-08-17T17:51:57.735993+0000","last_became_peered":"2023-08-17T17:51:57.735993+0000","last_unstale":"2023-08-17T17:51:57.739316+0000","last_undegraded":"2023-08-17T17:51:57.739316+0000","last_fullsized":"2023-08-17T17:51:57.739316+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.728905+0000","last_change":"2023-08-17T17:51:57.371137+0000","last_active":"2023-08-17T17:51:57.728905+0000","last_peered":"2023-08-17T17:51:57.728905+0000","last_clean":"2023-08-17T17:51:57.728905+0000","last_became_active":"2023-08-17T17:51:57.370549+0000","last_became_peered":"2023-08-17T17:51:57.370549+0000","last_unstale":"2023-08-17T17:51:57.728905+0000","last_undegraded":"2023-08-17T17:51:57.728905+0000","last_fullsized":"2023-08-17T17:51:57.728905+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743415+0000","last_change":"2023-08-17T17:51:57.735417+0000","last_active":"2023-08-17T17:51:57.743415+0000","last_peered":"2023-08-17T17:51:57.743415+0000","last_clean":"2023-08-17T17:51:57.743415+0000","last_became_active":"2023-08-17T17:51:57.735149+0000","last_became_peered":"2023-08-17T17:51:57.735149+0000","last_unstale":"2023-08-17T17:51:57.743415+0000","last_undegraded":"2023-08-17T17:51:57.743415+0000","last_fullsized":"2023-08-17T17:51:57.743415+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.727778+0000","last_change":"2023-08-17T17:51:57.370896+0000","last_active":"2023-08-17T17:51:57.727778+0000","last_peered":"2023-08-17T17:51:57.727778+0000","last_clean":"2023-08-17T17:51:57.727778+0000","last_became_active":"2023-08-17T17:51:57.370461+0000","last_became_peered":"2023-08-17T17:51:57.370461+0000","last_unstale":"2023-08-17T17:51:57.727778+0000","last_undegraded":"2023-08-17T17:51:57.727778+0000","last_fullsized":"2023-08-17T17:51:57.727778+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743295+0000","last_change":"2023-08-17T17:51:57.737945+0000","last_active":"2023-08-17T17:51:57.743295+0000","last_peered":"2023-08-17T17:51:57.743295+0000","last_clean":"2023-08-17T17:51:57.743295+0000","last_became_active":"2023-08-17T17:51:57.737421+0000","last_became_peered":"2023-08-17T17:51:57.737421+0000","last_unstale":"2023-08-17T17:51:57.743295+0000","last_undegraded":"2023-08-17T17:51:57.743295+0000","last_fullsized":"2023-08-17T17:51:57.743295+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740714+0000","last_change":"2023-08-17T17:51:57.370014+0000","last_active":"2023-08-17T17:51:57.740714+0000","last_peered":"2023-08-17T17:51:57.740714+0000","last_clean":"2023-08-17T17:51:57.740714+0000","last_became_active":"2023-08-17T17:51:57.369758+0000","last_became_peered":"2023-08-17T17:51:57.369758+0000","last_unstale":"2023-08-17T17:51:57.740714+0000","last_undegraded":"2023-08-17T17:51:57.740714+0000","last_fullsized":"2023-08-17T17:51:57.740714+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737832+0000","last_change":"2023-08-17T17:51:57.732634+0000","last_active":"2023-08-17T17:51:57.737832+0000","last_peered":"2023-08-17T17:51:57.737832+0000","last_clean":"2023-08-17T17:51:57.737832+0000","last_became_active":"2023-08-17T17:51:57.732286+0000","last_became_peered":"2023-08-17T17:51:57.732286+0000","last_unstale":"2023-08-17T17:51:57.737832+0000","last_undegraded":"2023-08-17T17:51:57.737832+0000","last_fullsized":"2023-08-17T17:51:57.737832+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737240+0000","last_change":"2023-08-17T17:51:57.361453+0000","last_active":"2023-08-17T17:51:57.737240+0000","last_peered":"2023-08-17T17:51:57.737240+0000","last_clean":"2023-08-17T17:51:57.737240+0000","last_became_active":"2023-08-17T17:51:57.361188+0000","last_became_peered":"2023-08-17T17:51:57.361188+0000","last_unstale":"2023-08-17T17:51:57.737240+0000","last_undegraded":"2023-08-17T17:51:57.737240+0000","last_fullsized":"2023-08-17T17:51:57.737240+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745028+0000","last_change":"2023-08-17T17:51:57.737391+0000","last_active":"2023-08-17T17:51:57.745028+0000","last_peered":"2023-08-17T17:51:57.745028+0000","last_clean":"2023-08-17T17:51:57.745028+0000","last_became_active":"2023-08-17T17:51:57.737078+0000","last_became_peered":"2023-08-17T17:51:57.737078+0000","last_unstale":"2023-08-17T17:51:57.745028+0000","last_undegraded":"2023-08-17T17:51:57.745028+0000","last_fullsized":"2023-08-17T17:51:57.745028+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745713+0000","last_change":"2023-08-17T17:51:57.370360+0000","last_active":"2023-08-17T17:51:57.745713+0000","last_peered":"2023-08-17T17:51:57.745713+0000","last_clean":"2023-08-17T17:51:57.745713+0000","last_became_active":"2023-08-17T17:51:57.370034+0000","last_became_peered":"2023-08-17T17:51:57.370034+0000","last_unstale":"2023-08-17T17:51:57.745713+0000","last_undegraded":"2023-08-17T17:51:57.745713+0000","last_fullsized":"2023-08-17T17:51:57.745713+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744325+0000","last_change":"2023-08-17T17:51:57.739218+0000","last_active":"2023-08-17T17:51:57.744325+0000","last_peered":"2023-08-17T17:51:57.744325+0000","last_clean":"2023-08-17T17:51:57.744325+0000","last_became_active":"2023-08-17T17:51:57.738554+0000","last_became_peered":"2023-08-17T17:51:57.738554+0000","last_unstale":"2023-08-17T17:51:57.744325+0000","last_undegraded":"2023-08-17T17:51:57.744325+0000","last_fullsized":"2023-08-17T17:51:57.744325+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.725512+0000","last_change":"2023-08-17T17:51:57.365354+0000","last_active":"2023-08-17T17:51:57.725512+0000","last_peered":"2023-08-17T17:51:57.725512+0000","last_clean":"2023-08-17T17:51:57.725512+0000","last_became_active":"2023-08-17T17:51:57.365019+0000","last_became_peered":"2023-08-17T17:51:57.365019+0000","last_unstale":"2023-08-17T17:51:57.725512+0000","last_undegraded":"2023-08-17T17:51:57.725512+0000","last_fullsized":"2023-08-17T17:51:57.725512+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746486+0000","last_change":"2023-08-17T17:51:57.744663+0000","last_active":"2023-08-17T17:51:57.746486+0000","last_peered":"2023-08-17T17:51:57.746486+0000","last_clean":"2023-08-17T17:51:57.746486+0000","last_became_active":"2023-08-17T17:51:57.744389+0000","last_became_peered":"2023-08-17T17:51:57.744389+0000","last_unstale":"2023-08-17T17:51:57.746486+0000","last_undegraded":"2023-08-17T17:51:57.746486+0000","last_fullsized":"2023-08-17T17:51:57.746486+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731333+0000","last_change":"2023-08-17T17:51:57.362646+0000","last_active":"2023-08-17T17:51:57.731333+0000","last_peered":"2023-08-17T17:51:57.731333+0000","last_clean":"2023-08-17T17:51:57.731333+0000","last_became_active":"2023-08-17T17:51:57.362354+0000","last_became_peered":"2023-08-17T17:51:57.362354+0000","last_unstale":"2023-08-17T17:51:57.731333+0000","last_undegraded":"2023-08-17T17:51:57.731333+0000","last_fullsized":"2023-08-17T17:51:57.731333+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745786+0000","last_change":"2023-08-17T17:51:57.741798+0000","last_active":"2023-08-17T17:51:57.745786+0000","last_peered":"2023-08-17T17:51:57.745786+0000","last_clean":"2023-08-17T17:51:57.745786+0000","last_became_active":"2023-08-17T17:51:57.740984+0000","last_became_peered":"2023-08-17T17:51:57.740984+0000","last_unstale":"2023-08-17T17:51:57.745786+0000","last_undegraded":"2023-08-17T17:51:57.745786+0000","last_fullsized":"2023-08-17T17:51:57.745786+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721305+0000","last_change":"2023-08-17T17:51:57.365254+0000","last_active":"2023-08-17T17:51:57.721305+0000","last_peered":"2023-08-17T17:51:57.721305+0000","last_clean":"2023-08-17T17:51:57.721305+0000","last_became_active":"2023-08-17T17:51:57.364944+0000","last_became_peered":"2023-08-17T17:51:57.364944+0000","last_unstale":"2023-08-17T17:51:57.721305+0000","last_undegraded":"2023-08-17T17:51:57.721305+0000","last_fullsized":"2023-08-17T17:51:57.721305+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.747096+0000","last_change":"2023-08-17T17:51:57.744940+0000","last_active":"2023-08-17T17:51:57.747096+0000","last_peered":"2023-08-17T17:51:57.747096+0000","last_clean":"2023-08-17T17:51:57.747096+0000","last_became_active":"2023-08-17T17:51:57.744588+0000","last_became_peered":"2023-08-17T17:51:57.744588+0000","last_unstale":"2023-08-17T17:51:57.747096+0000","last_undegraded":"2023-08-17T17:51:57.747096+0000","last_fullsized":"2023-08-17T17:51:57.747096+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.723988+0000","last_change":"2023-08-17T17:51:57.369414+0000","last_active":"2023-08-17T17:51:57.723988+0000","last_peered":"2023-08-17T17:51:57.723988+0000","last_clean":"2023-08-17T17:51:57.723988+0000","last_became_active":"2023-08-17T17:51:57.369043+0000","last_became_peered":"2023-08-17T17:51:57.369043+0000","last_unstale":"2023-08-17T17:51:57.723988+0000","last_undegraded":"2023-08-17T17:51:57.723988+0000","last_fullsized":"2023-08-17T17:51:57.723988+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743416+0000","last_change":"2023-08-17T17:51:57.740558+0000","last_active":"2023-08-17T17:51:57.743416+0000","last_peered":"2023-08-17T17:51:57.743416+0000","last_clean":"2023-08-17T17:51:57.743416+0000","last_became_active":"2023-08-17T17:51:57.740239+0000","last_became_peered":"2023-08-17T17:51:57.740239+0000","last_unstale":"2023-08-17T17:51:57.743416+0000","last_undegraded":"2023-08-17T17:51:57.743416+0000","last_fullsized":"2023-08-17T17:51:57.743416+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.729424+0000","last_change":"2023-08-17T17:51:57.373398+0000","last_active":"2023-08-17T17:51:57.729424+0000","last_peered":"2023-08-17T17:51:57.729424+0000","last_clean":"2023-08-17T17:51:57.729424+0000","last_became_active":"2023-08-17T17:51:57.370409+0000","last_became_peered":"2023-08-17T17:51:57.370409+0000","last_unstale":"2023-08-17T17:51:57.729424+0000","last_undegraded":"2023-08-17T17:51:57.729424+0000","last_fullsized":"2023-08-17T17:51:57.729424+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745620+0000","last_change":"2023-08-17T17:51:57.740077+0000","last_active":"2023-08-17T17:51:57.745620+0000","last_peered":"2023-08-17T17:51:57.745620+0000","last_clean":"2023-08-17T17:51:57.745620+0000","last_became_active":"2023-08-17T17:51:57.739793+0000","last_became_peered":"2023-08-17T17:51:57.739793+0000","last_unstale":"2023-08-17T17:51:57.745620+0000","last_undegraded":"2023-08-17T17:51:57.745620+0000","last_fullsized":"2023-08-17T17:51:57.745620+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.724757+0000","last_change":"2023-08-17T17:51:57.369908+0000","last_active":"2023-08-17T17:51:57.724757+0000","last_peered":"2023-08-17T17:51:57.724757+0000","last_clean":"2023-08-17T17:51:57.724757+0000","last_became_active":"2023-08-17T17:51:57.369537+0000","last_became_peered":"2023-08-17T17:51:57.369537+0000","last_unstale":"2023-08-17T17:51:57.724757+0000","last_undegraded":"2023-08-17T17:51:57.724757+0000","last_fullsized":"2023-08-17T17:51:57.724757+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743933+0000","last_change":"2023-08-17T17:51:57.737083+0000","last_active":"2023-08-17T17:51:57.743933+0000","last_peered":"2023-08-17T17:51:57.743933+0000","last_clean":"2023-08-17T17:51:57.743933+0000","last_became_active":"2023-08-17T17:51:57.736807+0000","last_became_peered":"2023-08-17T17:51:57.736807+0000","last_unstale":"2023-08-17T17:51:57.743933+0000","last_undegraded":"2023-08-17T17:51:57.743933+0000","last_fullsized":"2023-08-17T17:51:57.743933+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726788+0000","last_change":"2023-08-17T17:51:57.369827+0000","last_active":"2023-08-17T17:51:57.726788+0000","last_peered":"2023-08-17T17:51:57.726788+0000","last_clean":"2023-08-17T17:51:57.726788+0000","last_became_active":"2023-08-17T17:51:57.366551+0000","last_became_peered":"2023-08-17T17:51:57.366551+0000","last_unstale":"2023-08-17T17:51:57.726788+0000","last_undegraded":"2023-08-17T17:51:57.726788+0000","last_fullsized":"2023-08-17T17:51:57.726788+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740263+0000","last_change":"2023-08-17T17:51:57.735676+0000","last_active":"2023-08-17T17:51:57.740263+0000","last_peered":"2023-08-17T17:51:57.740263+0000","last_clean":"2023-08-17T17:51:57.740263+0000","last_became_active":"2023-08-17T17:51:57.735437+0000","last_became_peered":"2023-08-17T17:51:57.735437+0000","last_unstale":"2023-08-17T17:51:57.740263+0000","last_undegraded":"2023-08-17T17:51:57.740263+0000","last_fullsized":"2023-08-17T17:51:57.740263+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"120'3","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743909+0000","last_change":"2023-08-17T17:51:57.371270+0000","last_active":"2023-08-17T17:51:57.743909+0000","last_peered":"2023-08-17T17:51:57.743909+0000","last_clean":"2023-08-17T17:51:57.743909+0000","last_became_active":"2023-08-17T17:51:57.370968+0000","last_became_peered":"2023-08-17T17:51:57.370968+0000","last_unstale":"2023-08-17T17:51:57.743909+0000","last_undegraded":"2023-08-17T17:51:57.743909+0000","last_fullsized":"2023-08-17T17:51:57.743909+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744059+0000","last_change":"2023-08-17T17:51:57.737452+0000","last_active":"2023-08-17T17:51:57.744059+0000","last_peered":"2023-08-17T17:51:57.744059+0000","last_clean":"2023-08-17T17:51:57.744059+0000","last_became_active":"2023-08-17T17:51:57.736977+0000","last_became_peered":"2023-08-17T17:51:57.736977+0000","last_unstale":"2023-08-17T17:51:57.744059+0000","last_undegraded":"2023-08-17T17:51:57.744059+0000","last_fullsized":"2023-08-17T17:51:57.744059+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740860+0000","last_change":"2023-08-17T17:51:57.367346+0000","last_active":"2023-08-17T17:51:57.740860+0000","last_peered":"2023-08-17T17:51:57.740860+0000","last_clean":"2023-08-17T17:51:57.740860+0000","last_became_active":"2023-08-17T17:51:57.367074+0000","last_became_peered":"2023-08-17T17:51:57.367074+0000","last_unstale":"2023-08-17T17:51:57.740860+0000","last_undegraded":"2023-08-17T17:51:57.740860+0000","last_fullsized":"2023-08-17T17:51:57.740860+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739477+0000","last_change":"2023-08-17T17:51:57.729843+0000","last_active":"2023-08-17T17:51:57.739477+0000","last_peered":"2023-08-17T17:51:57.739477+0000","last_clean":"2023-08-17T17:51:57.739477+0000","last_became_active":"2023-08-17T17:51:57.729465+0000","last_became_peered":"2023-08-17T17:51:57.729465+0000","last_unstale":"2023-08-17T17:51:57.739477+0000","last_undegraded":"2023-08-17T17:51:57.739477+0000","last_fullsized":"2023-08-17T17:51:57.739477+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744005+0000","last_change":"2023-08-17T17:51:57.373407+0000","last_active":"2023-08-17T17:51:57.744005+0000","last_peered":"2023-08-17T17:51:57.744005+0000","last_clean":"2023-08-17T17:51:57.744005+0000","last_became_active":"2023-08-17T17:51:57.373134+0000","last_became_peered":"2023-08-17T17:51:57.373134+0000","last_unstale":"2023-08-17T17:51:57.744005+0000","last_undegraded":"2023-08-17T17:51:57.744005+0000","last_fullsized":"2023-08-17T17:51:57.744005+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741609+0000","last_change":"2023-08-17T17:51:57.739948+0000","last_active":"2023-08-17T17:51:57.741609+0000","last_peered":"2023-08-17T17:51:57.741609+0000","last_clean":"2023-08-17T17:51:57.741609+0000","last_became_active":"2023-08-17T17:51:57.739363+0000","last_became_peered":"2023-08-17T17:51:57.739363+0000","last_unstale":"2023-08-17T17:51:57.741609+0000","last_undegraded":"2023-08-17T17:51:57.741609+0000","last_fullsized":"2023-08-17T17:51:57.741609+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.730661+0000","last_change":"2023-08-17T17:51:57.366817+0000","last_active":"2023-08-17T17:51:57.730661+0000","last_peered":"2023-08-17T17:51:57.730661+0000","last_clean":"2023-08-17T17:51:57.730661+0000","last_became_active":"2023-08-17T17:51:57.366588+0000","last_became_peered":"2023-08-17T17:51:57.366588+0000","last_unstale":"2023-08-17T17:51:57.730661+0000","last_undegraded":"2023-08-17T17:51:57.730661+0000","last_fullsized":"2023-08-17T17:51:57.730661+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737211+0000","last_change":"2023-08-17T17:51:57.729428+0000","last_active":"2023-08-17T17:51:57.737211+0000","last_peered":"2023-08-17T17:51:57.737211+0000","last_clean":"2023-08-17T17:51:57.737211+0000","last_became_active":"2023-08-17T17:51:57.728206+0000","last_became_peered":"2023-08-17T17:51:57.728206+0000","last_unstale":"2023-08-17T17:51:57.737211+0000","last_undegraded":"2023-08-17T17:51:57.737211+0000","last_fullsized":"2023-08-17T17:51:57.737211+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.720475+0000","last_change":"2023-08-17T17:51:57.369190+0000","last_active":"2023-08-17T17:51:57.720475+0000","last_peered":"2023-08-17T17:51:57.720475+0000","last_clean":"2023-08-17T17:51:57.720475+0000","last_became_active":"2023-08-17T17:51:57.368840+0000","last_became_peered":"2023-08-17T17:51:57.368840+0000","last_unstale":"2023-08-17T17:51:57.720475+0000","last_undegraded":"2023-08-17T17:51:57.720475+0000","last_fullsized":"2023-08-17T17:51:57.720475+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745615+0000","last_change":"2023-08-17T17:51:57.739636+0000","last_active":"2023-08-17T17:51:57.745615+0000","last_peered":"2023-08-17T17:51:57.745615+0000","last_clean":"2023-08-17T17:51:57.745615+0000","last_became_active":"2023-08-17T17:51:57.739284+0000","last_became_peered":"2023-08-17T17:51:57.739284+0000","last_unstale":"2023-08-17T17:51:57.745615+0000","last_undegraded":"2023-08-17T17:51:57.745615+0000","last_fullsized":"2023-08-17T17:51:57.745615+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"120'4","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745978+0000","last_change":"2023-08-17T17:51:57.369481+0000","last_active":"2023-08-17T17:51:57.745978+0000","last_peered":"2023-08-17T17:51:57.745978+0000","last_clean":"2023-08-17T17:51:57.745978+0000","last_became_active":"2023-08-17T17:51:57.369020+0000","last_became_peered":"2023-08-17T17:51:57.369020+0000","last_unstale":"2023-08-17T17:51:57.745978+0000","last_undegraded":"2023-08-17T17:51:57.745978+0000","last_fullsized":"2023-08-17T17:51:57.745978+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740830+0000","last_change":"2023-08-17T17:51:57.732039+0000","last_active":"2023-08-17T17:51:57.740830+0000","last_peered":"2023-08-17T17:51:57.740830+0000","last_clean":"2023-08-17T17:51:57.740830+0000","last_became_active":"2023-08-17T17:51:57.731825+0000","last_became_peered":"2023-08-17T17:51:57.731825+0000","last_unstale":"2023-08-17T17:51:57.740830+0000","last_undegraded":"2023-08-17T17:51:57.740830+0000","last_fullsized":"2023-08-17T17:51:57.740830+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743513+0000","last_change":"2023-08-17T17:51:57.373060+0000","last_active":"2023-08-17T17:51:57.743513+0000","last_peered":"2023-08-17T17:51:57.743513+0000","last_clean":"2023-08-17T17:51:57.743513+0000","last_became_active":"2023-08-17T17:51:57.372812+0000","last_became_peered":"2023-08-17T17:51:57.372812+0000","last_unstale":"2023-08-17T17:51:57.743513+0000","last_undegraded":"2023-08-17T17:51:57.743513+0000","last_fullsized":"2023-08-17T17:51:57.743513+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744217+0000","last_change":"2023-08-17T17:51:57.736788+0000","last_active":"2023-08-17T17:51:57.744217+0000","last_peered":"2023-08-17T17:51:57.744217+0000","last_clean":"2023-08-17T17:51:57.744217+0000","last_became_active":"2023-08-17T17:51:57.736481+0000","last_became_peered":"2023-08-17T17:51:57.736481+0000","last_unstale":"2023-08-17T17:51:57.744217+0000","last_undegraded":"2023-08-17T17:51:57.744217+0000","last_fullsized":"2023-08-17T17:51:57.744217+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726694+0000","last_change":"2023-08-17T17:51:57.369233+0000","last_active":"2023-08-17T17:51:57.726694+0000","last_peered":"2023-08-17T17:51:57.726694+0000","last_clean":"2023-08-17T17:51:57.726694+0000","last_became_active":"2023-08-17T17:51:57.367183+0000","last_became_peered":"2023-08-17T17:51:57.367183+0000","last_unstale":"2023-08-17T17:51:57.726694+0000","last_undegraded":"2023-08-17T17:51:57.726694+0000","last_fullsized":"2023-08-17T17:51:57.726694+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740028+0000","last_change":"2023-08-17T17:51:57.734659+0000","last_active":"2023-08-17T17:51:57.740028+0000","last_peered":"2023-08-17T17:51:57.740028+0000","last_clean":"2023-08-17T17:51:57.740028+0000","last_became_active":"2023-08-17T17:51:57.734449+0000","last_became_peered":"2023-08-17T17:51:57.734449+0000","last_unstale":"2023-08-17T17:51:57.740028+0000","last_undegraded":"2023-08-17T17:51:57.740028+0000","last_fullsized":"2023-08-17T17:51:57.740028+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.728431+0000","last_change":"2023-08-17T17:51:57.364648+0000","last_active":"2023-08-17T17:51:57.728431+0000","last_peered":"2023-08-17T17:51:57.728431+0000","last_clean":"2023-08-17T17:51:57.728431+0000","last_became_active":"2023-08-17T17:51:57.364131+0000","last_became_peered":"2023-08-17T17:51:57.364131+0000","last_unstale":"2023-08-17T17:51:57.728431+0000","last_undegraded":"2023-08-17T17:51:57.728431+0000","last_fullsized":"2023-08-17T17:51:57.728431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744340+0000","last_change":"2023-08-17T17:51:57.739387+0000","last_active":"2023-08-17T17:51:57.744340+0000","last_peered":"2023-08-17T17:51:57.744340+0000","last_clean":"2023-08-17T17:51:57.744340+0000","last_became_active":"2023-08-17T17:51:57.738937+0000","last_became_peered":"2023-08-17T17:51:57.738937+0000","last_unstale":"2023-08-17T17:51:57.744340+0000","last_undegraded":"2023-08-17T17:51:57.744340+0000","last_fullsized":"2023-08-17T17:51:57.744340+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.725562+0000","last_change":"2023-08-17T17:51:57.364149+0000","last_active":"2023-08-17T17:51:57.725562+0000","last_peered":"2023-08-17T17:51:57.725562+0000","last_clean":"2023-08-17T17:51:57.725562+0000","last_became_active":"2023-08-17T17:51:57.363929+0000","last_became_peered":"2023-08-17T17:51:57.363929+0000","last_unstale":"2023-08-17T17:51:57.725562+0000","last_undegraded":"2023-08-17T17:51:57.725562+0000","last_fullsized":"2023-08-17T17:51:57.725562+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737894+0000","last_change":"2023-08-17T17:51:57.733674+0000","last_active":"2023-08-17T17:51:57.737894+0000","last_peered":"2023-08-17T17:51:57.737894+0000","last_clean":"2023-08-17T17:51:57.737894+0000","last_became_active":"2023-08-17T17:51:57.733409+0000","last_became_peered":"2023-08-17T17:51:57.733409+0000","last_unstale":"2023-08-17T17:51:57.737894+0000","last_undegraded":"2023-08-17T17:51:57.737894+0000","last_fullsized":"2023-08-17T17:51:57.737894+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.725301+0000","last_change":"2023-08-17T17:51:57.365415+0000","last_active":"2023-08-17T17:51:57.725301+0000","last_peered":"2023-08-17T17:51:57.725301+0000","last_clean":"2023-08-17T17:51:57.725301+0000","last_became_active":"2023-08-17T17:51:57.363570+0000","last_became_peered":"2023-08-17T17:51:57.363570+0000","last_unstale":"2023-08-17T17:51:57.725301+0000","last_undegraded":"2023-08-17T17:51:57.725301+0000","last_fullsized":"2023-08-17T17:51:57.725301+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743047+0000","last_change":"2023-08-17T17:51:57.739996+0000","last_active":"2023-08-17T17:51:57.743047+0000","last_peered":"2023-08-17T17:51:57.743047+0000","last_clean":"2023-08-17T17:51:57.743047+0000","last_became_active":"2023-08-17T17:51:57.739754+0000","last_became_peered":"2023-08-17T17:51:57.739754+0000","last_unstale":"2023-08-17T17:51:57.743047+0000","last_undegraded":"2023-08-17T17:51:57.743047+0000","last_fullsized":"2023-08-17T17:51:57.743047+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721808+0000","last_change":"2023-08-17T17:51:57.369647+0000","last_active":"2023-08-17T17:51:57.721808+0000","last_peered":"2023-08-17T17:51:57.721808+0000","last_clean":"2023-08-17T17:51:57.721808+0000","last_became_active":"2023-08-17T17:51:57.368437+0000","last_became_peered":"2023-08-17T17:51:57.368437+0000","last_unstale":"2023-08-17T17:51:57.721808+0000","last_undegraded":"2023-08-17T17:51:57.721808+0000","last_fullsized":"2023-08-17T17:51:57.721808+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744405+0000","last_change":"2023-08-17T17:51:57.740487+0000","last_active":"2023-08-17T17:51:57.744405+0000","last_peered":"2023-08-17T17:51:57.744405+0000","last_clean":"2023-08-17T17:51:57.744405+0000","last_became_active":"2023-08-17T17:51:57.740203+0000","last_became_peered":"2023-08-17T17:51:57.740203+0000","last_unstale":"2023-08-17T17:51:57.744405+0000","last_undegraded":"2023-08-17T17:51:57.744405+0000","last_fullsized":"2023-08-17T17:51:57.744405+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726204+0000","last_change":"2023-08-17T17:51:57.365317+0000","last_active":"2023-08-17T17:51:57.726204+0000","last_peered":"2023-08-17T17:51:57.726204+0000","last_clean":"2023-08-17T17:51:57.726204+0000","last_became_active":"2023-08-17T17:51:57.365017+0000","last_became_peered":"2023-08-17T17:51:57.365017+0000","last_unstale":"2023-08-17T17:51:57.726204+0000","last_undegraded":"2023-08-17T17:51:57.726204+0000","last_fullsized":"2023-08-17T17:51:57.726204+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739608+0000","last_change":"2023-08-17T17:51:57.730321+0000","last_active":"2023-08-17T17:51:57.739608+0000","last_peered":"2023-08-17T17:51:57.739608+0000","last_clean":"2023-08-17T17:51:57.739608+0000","last_became_active":"2023-08-17T17:51:57.730025+0000","last_became_peered":"2023-08-17T17:51:57.730025+0000","last_unstale":"2023-08-17T17:51:57.739608+0000","last_undegraded":"2023-08-17T17:51:57.739608+0000","last_fullsized":"2023-08-17T17:51:57.739608+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721179+0000","last_change":"2023-08-17T17:51:57.368192+0000","last_active":"2023-08-17T17:51:57.721179+0000","last_peered":"2023-08-17T17:51:57.721179+0000","last_clean":"2023-08-17T17:51:57.721179+0000","last_became_active":"2023-08-17T17:51:57.367639+0000","last_became_peered":"2023-08-17T17:51:57.367639+0000","last_unstale":"2023-08-17T17:51:57.721179+0000","last_undegraded":"2023-08-17T17:51:57.721179+0000","last_fullsized":"2023-08-17T17:51:57.721179+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743380+0000","last_change":"2023-08-17T17:51:57.740702+0000","last_active":"2023-08-17T17:51:57.743380+0000","last_peered":"2023-08-17T17:51:57.743380+0000","last_clean":"2023-08-17T17:51:57.743380+0000","last_became_active":"2023-08-17T17:51:57.740459+0000","last_became_peered":"2023-08-17T17:51:57.740459+0000","last_unstale":"2023-08-17T17:51:57.743380+0000","last_undegraded":"2023-08-17T17:51:57.743380+0000","last_fullsized":"2023-08-17T17:51:57.743380+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726207+0000","last_change":"2023-08-17T17:51:57.364948+0000","last_active":"2023-08-17T17:51:57.726207+0000","last_peered":"2023-08-17T17:51:57.726207+0000","last_clean":"2023-08-17T17:51:57.726207+0000","last_became_active":"2023-08-17T17:51:57.363868+0000","last_became_peered":"2023-08-17T17:51:57.363868+0000","last_unstale":"2023-08-17T17:51:57.726207+0000","last_undegraded":"2023-08-17T17:51:57.726207+0000","last_fullsized":"2023-08-17T17:51:57.726207+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.725611+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:51:57.725611+0000","last_peered":"2023-08-17T17:51:57.725611+0000","last_clean":"2023-08-17T17:51:57.725611+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:51:57.725611+0000","last_undegraded":"2023-08-17T17:51:57.725611+0000","last_fullsized":"2023-08-17T17:51:57.725611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737764+0000","last_change":"2023-08-17T17:51:57.730431+0000","last_active":"2023-08-17T17:51:57.737764+0000","last_peered":"2023-08-17T17:51:57.737764+0000","last_clean":"2023-08-17T17:51:57.737764+0000","last_became_active":"2023-08-17T17:51:57.730024+0000","last_became_peered":"2023-08-17T17:51:57.730024+0000","last_unstale":"2023-08-17T17:51:57.737764+0000","last_undegraded":"2023-08-17T17:51:57.737764+0000","last_fullsized":"2023-08-17T17:51:57.737764+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744867+0000","last_change":"2023-08-17T17:51:57.367564+0000","last_active":"2023-08-17T17:51:57.744867+0000","last_peered":"2023-08-17T17:51:57.744867+0000","last_clean":"2023-08-17T17:51:57.744867+0000","last_became_active":"2023-08-17T17:51:57.367308+0000","last_became_peered":"2023-08-17T17:51:57.367308+0000","last_unstale":"2023-08-17T17:51:57.744867+0000","last_undegraded":"2023-08-17T17:51:57.744867+0000","last_fullsized":"2023-08-17T17:51:57.744867+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721389+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:51:57.721389+0000","last_peered":"2023-08-17T17:51:57.721389+0000","last_clean":"2023-08-17T17:51:57.721389+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:51:57.721389+0000","last_undegraded":"2023-08-17T17:51:57.721389+0000","last_fullsized":"2023-08-17T17:51:57.721389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744078+0000","last_change":"2023-08-17T17:51:57.738130+0000","last_active":"2023-08-17T17:51:57.744078+0000","last_peered":"2023-08-17T17:51:57.744078+0000","last_clean":"2023-08-17T17:51:57.744078+0000","last_became_active":"2023-08-17T17:51:57.737864+0000","last_became_peered":"2023-08-17T17:51:57.737864+0000","last_unstale":"2023-08-17T17:51:57.744078+0000","last_undegraded":"2023-08-17T17:51:57.744078+0000","last_fullsized":"2023-08-17T17:51:57.744078+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721525+0000","last_change":"2023-08-17T17:51:57.361671+0000","last_active":"2023-08-17T17:51:57.721525+0000","last_peered":"2023-08-17T17:51:57.721525+0000","last_clean":"2023-08-17T17:51:57.721525+0000","last_became_active":"2023-08-17T17:51:57.361388+0000","last_became_peered":"2023-08-17T17:51:57.361388+0000","last_unstale":"2023-08-17T17:51:57.721525+0000","last_undegraded":"2023-08-17T17:51:57.721525+0000","last_fullsized":"2023-08-17T17:51:57.721525+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.720558+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:51:57.720558+0000","last_peered":"2023-08-17T17:51:57.720558+0000","last_clean":"2023-08-17T17:51:57.720558+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:51:57.720558+0000","last_undegraded":"2023-08-17T17:51:57.720558+0000","last_fullsized":"2023-08-17T17:51:57.720558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739943+0000","last_change":"2023-08-17T17:51:57.730970+0000","last_active":"2023-08-17T17:51:57.739943+0000","last_peered":"2023-08-17T17:51:57.739943+0000","last_clean":"2023-08-17T17:51:57.739943+0000","last_became_active":"2023-08-17T17:51:57.730658+0000","last_became_peered":"2023-08-17T17:51:57.730658+0000","last_unstale":"2023-08-17T17:51:57.739943+0000","last_undegraded":"2023-08-17T17:51:57.739943+0000","last_fullsized":"2023-08-17T17:51:57.739943+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737951+0000","last_change":"2023-08-17T17:51:57.364435+0000","last_active":"2023-08-17T17:51:57.737951+0000","last_peered":"2023-08-17T17:51:57.737951+0000","last_clean":"2023-08-17T17:51:57.737951+0000","last_became_active":"2023-08-17T17:51:57.364165+0000","last_became_peered":"2023-08-17T17:51:57.364165+0000","last_unstale":"2023-08-17T17:51:57.737951+0000","last_undegraded":"2023-08-17T17:51:57.737951+0000","last_fullsized":"2023-08-17T17:51:57.737951+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721754+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:51:57.721754+0000","last_peered":"2023-08-17T17:51:57.721754+0000","last_clean":"2023-08-17T17:51:57.721754+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:51:57.721754+0000","last_undegraded":"2023-08-17T17:51:57.721754+0000","last_fullsized":"2023-08-17T17:51:57.721754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":91,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731244+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:51:57.731244+0000","last_peered":"2023-08-17T17:51:57.731244+0000","last_clean":"2023-08-17T17:51:57.731244+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:51:57.731244+0000","last_undegraded":"2023-08-17T17:51:57.731244+0000","last_fullsized":"2023-08-17T17:51:57.731244+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746315+0000","last_change":"2023-08-17T17:51:57.741097+0000","last_active":"2023-08-17T17:51:57.746315+0000","last_peered":"2023-08-17T17:51:57.746315+0000","last_clean":"2023-08-17T17:51:57.746315+0000","last_became_active":"2023-08-17T17:51:57.740819+0000","last_became_peered":"2023-08-17T17:51:57.740819+0000","last_unstale":"2023-08-17T17:51:57.746315+0000","last_undegraded":"2023-08-17T17:51:57.746315+0000","last_fullsized":"2023-08-17T17:51:57.746315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731669+0000","last_change":"2023-08-17T17:51:57.365865+0000","last_active":"2023-08-17T17:51:57.731669+0000","last_peered":"2023-08-17T17:51:57.731669+0000","last_clean":"2023-08-17T17:51:57.731669+0000","last_became_active":"2023-08-17T17:51:57.365333+0000","last_became_peered":"2023-08-17T17:51:57.365333+0000","last_unstale":"2023-08-17T17:51:57.731669+0000","last_undegraded":"2023-08-17T17:51:57.731669+0000","last_fullsized":"2023-08-17T17:51:57.731669+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731332+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:51:57.731332+0000","last_peered":"2023-08-17T17:51:57.731332+0000","last_clean":"2023-08-17T17:51:57.731332+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:51:57.731332+0000","last_undegraded":"2023-08-17T17:51:57.731332+0000","last_fullsized":"2023-08-17T17:51:57.731332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741189+0000","last_change":"2023-08-17T17:51:57.738881+0000","last_active":"2023-08-17T17:51:57.741189+0000","last_peered":"2023-08-17T17:51:57.741189+0000","last_clean":"2023-08-17T17:51:57.741189+0000","last_became_active":"2023-08-17T17:51:57.738617+0000","last_became_peered":"2023-08-17T17:51:57.738617+0000","last_unstale":"2023-08-17T17:51:57.741189+0000","last_undegraded":"2023-08-17T17:51:57.741189+0000","last_fullsized":"2023-08-17T17:51:57.741189+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721086+0000","last_change":"2023-08-17T17:51:57.364102+0000","last_active":"2023-08-17T17:51:57.721086+0000","last_peered":"2023-08-17T17:51:57.721086+0000","last_clean":"2023-08-17T17:51:57.721086+0000","last_became_active":"2023-08-17T17:51:57.363772+0000","last_became_peered":"2023-08-17T17:51:57.363772+0000","last_unstale":"2023-08-17T17:51:57.721086+0000","last_undegraded":"2023-08-17T17:51:57.721086+0000","last_fullsized":"2023-08-17T17:51:57.721086+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.732686+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:51:57.732686+0000","last_peered":"2023-08-17T17:51:57.732686+0000","last_clean":"2023-08-17T17:51:57.732686+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:51:57.732686+0000","last_undegraded":"2023-08-17T17:51:57.732686+0000","last_fullsized":"2023-08-17T17:51:57.732686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745709+0000","last_change":"2023-08-17T17:51:57.741058+0000","last_active":"2023-08-17T17:51:57.745709+0000","last_peered":"2023-08-17T17:51:57.745709+0000","last_clean":"2023-08-17T17:51:57.745709+0000","last_became_active":"2023-08-17T17:51:57.740803+0000","last_became_peered":"2023-08-17T17:51:57.740803+0000","last_unstale":"2023-08-17T17:51:57.745709+0000","last_undegraded":"2023-08-17T17:51:57.745709+0000","last_fullsized":"2023-08-17T17:51:57.745709+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741206+0000","last_change":"2023-08-17T17:51:57.369234+0000","last_active":"2023-08-17T17:51:57.741206+0000","last_peered":"2023-08-17T17:51:57.741206+0000","last_clean":"2023-08-17T17:51:57.741206+0000","last_became_active":"2023-08-17T17:51:57.368856+0000","last_became_peered":"2023-08-17T17:51:57.368856+0000","last_unstale":"2023-08-17T17:51:57.741206+0000","last_undegraded":"2023-08-17T17:51:57.741206+0000","last_fullsized":"2023-08-17T17:51:57.741206+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726181+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:51:57.726181+0000","last_peered":"2023-08-17T17:51:57.726181+0000","last_clean":"2023-08-17T17:51:57.726181+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:51:57.726181+0000","last_undegraded":"2023-08-17T17:51:57.726181+0000","last_fullsized":"2023-08-17T17:51:57.726181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743178+0000","last_change":"2023-08-17T17:51:57.738747+0000","last_active":"2023-08-17T17:51:57.743178+0000","last_peered":"2023-08-17T17:51:57.743178+0000","last_clean":"2023-08-17T17:51:57.743178+0000","last_became_active":"2023-08-17T17:51:57.738474+0000","last_became_peered":"2023-08-17T17:51:57.738474+0000","last_unstale":"2023-08-17T17:51:57.743178+0000","last_undegraded":"2023-08-17T17:51:57.743178+0000","last_fullsized":"2023-08-17T17:51:57.743178+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.720925+0000","last_change":"2023-08-17T17:51:57.368741+0000","last_active":"2023-08-17T17:51:57.720925+0000","last_peered":"2023-08-17T17:51:57.720925+0000","last_clean":"2023-08-17T17:51:57.720925+0000","last_became_active":"2023-08-17T17:51:57.365350+0000","last_became_peered":"2023-08-17T17:51:57.365350+0000","last_unstale":"2023-08-17T17:51:57.720925+0000","last_undegraded":"2023-08-17T17:51:57.720925+0000","last_fullsized":"2023-08-17T17:51:57.720925+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.729573+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:51:57.729573+0000","last_peered":"2023-08-17T17:51:57.729573+0000","last_clean":"2023-08-17T17:51:57.729573+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:51:57.729573+0000","last_undegraded":"2023-08-17T17:51:57.729573+0000","last_fullsized":"2023-08-17T17:51:57.729573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575059,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1499136,"data_stored":741841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68899999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.70499999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.70099999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.55600000000000005},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.69399999999999995,"5min":0.745,"15min":0.80000000000000004},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.79300000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.72199999999999998,"5min":1.23,"15min":1.23},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73199999999999998,"5min":0.81599999999999995,"15min":0.86099999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.77200000000000002},"last":0.433}]},{"osd":5,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.505},"min":{"1min":0.38300000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.34200000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.746,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":0.82799999999999996,"15min":0.90200000000000002},"last":0.38100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575059,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302664,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069176,"statfs":{"total":96636764160,"available":96326836224,"internally_reserved":0,"allocated":1507328,"data_stored":742417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.71899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.52300000000000002},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.58599999999999997},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.75,"5min":0.879,"15min":1.0609999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.373},"max":{"1min":0.71399999999999997,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.68200000000000005,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.502},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48599999999999999,"15min":0.47299999999999998},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60099999999999998,"5min":0.748,"15min":0.77300000000000002},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47799999999999998},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.85799999999999998,"15min":1.51},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.41199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67800000000000005,"5min":0.872,"15min":0.872},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575060,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":1511424,"data_stored":743301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33500000000000002,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.42699999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.36399999999999999,"15min":0.373},"min":{"1min":0.28499999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.55100000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34399999999999997,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.216,"15min":0.216},"max":{"1min":0.50800000000000001,"5min":0.52000000000000002,"15min":0.70799999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.66300000000000003},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.42799999999999999},"min":{"1min":0.28000000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58899999999999997,"5min":0.625,"15min":0.66600000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39100000000000001,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.495,"5min":0.59199999999999997,"15min":0.63300000000000001},"last":0.26800000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82999999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.42799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78000000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.46100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80600000000000005,"5min":1.2989999999999999,"15min":1.331},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.45300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80100000000000005,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76100000000000001,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81200000000000006,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.48399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78900000000000003,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.78200000000000003,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.44500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575059,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302664,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069176,"statfs":{"total":96636764160,"available":96326836224,"internally_reserved":0,"allocated":1507328,"data_stored":742485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.35499999999999998},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.45200000000000001,"5min":0.54000000000000004,"15min":0.61599999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.372,"15min":0.38600000000000001},"min":{"1min":0.27100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.216}]},{"osd":2,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.34599999999999997,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.38600000000000001,"15min":0.40799999999999997},"min":{"1min":0.26800000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.307}]},{"osd":3,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.40600000000000003},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.66200000000000003},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.28399999999999997,"15min":0.26200000000000001},"max":{"1min":0.54400000000000004,"5min":0.62,"15min":0.65700000000000003},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.623,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.442,"5min":0.435,"15min":0.432},"max":{"1min":0.85899999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.49099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.41799999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98199999999999998,"5min":1.677,"15min":1.677},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.88700000000000001,"5min":1.51,"15min":1.51},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.325,"15min":1.391},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.91100000000000003,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.67900000000000005},"min":{"1min":0.501,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0980000000000001,"15min":1.544},"last":0.60399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":741855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.34999999999999998},"min":{"1min":0.20300000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.51500000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.34999999999999998,"15min":0.372},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.24399999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39100000000000001,"15min":0.41599999999999998},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41199999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63,"5min":1.268,"15min":1.268},"last":0.318},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67200000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.46800000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73199999999999998,"5min":1.417,"15min":1.417},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.876,"5min":1.51,"15min":2.9220000000000002},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.443,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.544,"15min":1.544},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.63700000000000001},"min":{"1min":0.47199999999999998,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.93200000000000005,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85499999999999998,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":1.415,"15min":1.415},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91600000000000004,"5min":1.3859999999999999,"15min":2.984},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.48199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92400000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1495040,"data_stored":741751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48599999999999999,"5min":0.53100000000000003,"15min":0.56999999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36699999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.60599999999999998},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.25,"5min":0.214,"15min":0.214},"max":{"1min":0.63400000000000001,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.64200000000000002},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.39200000000000002},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.439,"15min":0.42699999999999999},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.75800000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85099999999999998,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83499999999999996,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.876,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.628},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":1.466,"15min":1.466},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.86499999999999999,"5min":1.48,"15min":1.48},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81100000000000005,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.53300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575060,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":742665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.26400000000000001},"max":{"1min":0.75900000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.71999999999999997,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.27800000000000002},"max":{"1min":0.79000000000000004,"5min":1.252,"15min":1.252},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70099999999999996,"5min":1.306,"15min":1.306},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.58999999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35599999999999998},"max":{"1min":0.80600000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":1.1160000000000001,"5min":1.444,"15min":1.444},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":1.482,"15min":1.482},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.74199999999999999,"5min":1.123,"15min":1.123},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.32900000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.78600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":1.002}]},{"osd":6,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.5,"15min":0.47999999999999998},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81999999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81000000000000005,"5min":1.048,"15min":1.048},"last":0.751}]},{"osd":7,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.41899999999999998,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":1.056},"last":0.89000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575058,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1499136,"data_stored":742305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":1.165,"15min":1.165},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75600000000000001,"5min":1.022,"15min":1.022},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.77500000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.71399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.78500000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.82099999999999995,"5min":1.153,"15min":1.153},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77300000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80600000000000005,"5min":1.036,"15min":1.036},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44900000000000001,"15min":0.44700000000000001},"min":{"1min":0.33700000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":0.747,"15min":0.75},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.59699999999999998,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.749},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.751}]},{"osd":7,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.874},"last":0.88500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:52:02.980 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:52:02.983 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:52:03.640 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:52:03.640+0000 7f1d6c047700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:52:05.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:52:05.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.284+0000 7f626f175700 1 Processor -- start 2023-08-17T17:52:05.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.284+0000 7f626f175700 1 -- start start 2023-08-17T17:52:05.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.284+0000 7f626f175700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62680a7c90 0x7f62680c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.284+0000 7f626f175700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f62680be4d0 0x7f62680be900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.284+0000 7f626f175700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680bf210 con 0x7f6268151e40 2023-08-17T17:52:05.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.284+0000 7f626f175700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680c5a80 con 0x7f62680a7c90 2023-08-17T17:52:05.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.284+0000 7f626f175700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680c5450 con 0x7f62680be4d0 2023-08-17T17:52:05.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f626cf11700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6268151e40 0x7f6268152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55684/0 (socket says 172.21.15.78:55684) 2023-08-17T17:52:05.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f626cf11700 1 -- 172.21.15.78:0/983459444 learned_addr learned my addr 172.21.15.78:0/983459444 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:05.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625ffff700 1 --2- 172.21.15.78:0/983459444 >> v2:172.21.15.78:3300/0 conn(0x7f62680a7c90 0x7f62680c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f626d712700 1 --2- 172.21.15.78:0/983459444 >> v2:172.21.15.150:3300/0 conn(0x7f62680be4d0 0x7f62680be900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625f7fe700 1 -- 172.21.15.78:0/983459444 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332487908 0 0) 0x7f62680bf210 con 0x7f6268151e40 2023-08-17T17:52:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625f7fe700 1 -- 172.21.15.78:0/983459444 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62500033f0 con 0x7f6268151e40 2023-08-17T17:52:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625ffff700 1 -- 172.21.15.78:0/983459444 >> v2:172.21.15.150:3300/0 conn(0x7f62680be4d0 msgr2=0x7f62680be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625ffff700 1 --2- 172.21.15.78:0/983459444 >> v2:172.21.15.150:3300/0 conn(0x7f62680be4d0 0x7f62680be900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625ffff700 1 -- 172.21.15.78:0/983459444 >> v1:172.21.15.78:6789/0 conn(0x7f6268151e40 legacy=0x7f6268152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625ffff700 1 -- 172.21.15.78:0/983459444 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680bedf0 con 0x7f62680a7c90 2023-08-17T17:52:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625ffff700 1 --2- 172.21.15.78:0/983459444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 0x7f62680c5f10 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f62680aee40 tx=0x7f6258009060).ready entity=mon.0 client_cookie=a6da41506a85cb1c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625f7fe700 1 -- 172.21.15.78:0/983459444 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800f510 con 0x7f62680a7c90 2023-08-17T17:52:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625f7fe700 1 -- 172.21.15.78:0/983459444 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625800f670 con 0x7f62680a7c90 2023-08-17T17:52:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.285+0000 7f625f7fe700 1 -- 172.21.15.78:0/983459444 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800f9f0 con 0x7f62680a7c90 2023-08-17T17:52:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.286+0000 7f626f175700 1 -- 172.21.15.78:0/983459444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 msgr2=0x7f62680c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.286+0000 7f626f175700 1 --2- 172.21.15.78:0/983459444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 0x7f62680c5f10 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f62680aee40 tx=0x7f6258009060).stop 2023-08-17T17:52:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.286+0000 7f626f175700 1 -- 172.21.15.78:0/983459444 shutdown_connections 2023-08-17T17:52:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.286+0000 7f626f175700 1 --2- 172.21.15.78:0/983459444 >> v2:172.21.15.150:3300/0 conn(0x7f62680be4d0 0x7f62680be900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.286+0000 7f626f175700 1 --2- 172.21.15.78:0/983459444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 0x7f62680c5f10 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.286+0000 7f626f175700 1 -- 172.21.15.78:0/983459444 >> 172.21.15.78:0/983459444 conn(0x7f6268092330 msgr2=0x7f6268062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.286+0000 7f626f175700 1 -- 172.21.15.78:0/983459444 shutdown_connections 2023-08-17T17:52:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.286+0000 7f626f175700 1 -- 172.21.15.78:0/983459444 wait complete. 2023-08-17T17:52:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.287+0000 7f626f175700 1 Processor -- start 2023-08-17T17:52:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.287+0000 7f626f175700 1 -- start start 2023-08-17T17:52:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626f175700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 0x7f62681582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626f175700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62680be4d0 0x7f6268165ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626f175700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6268151e40 0x7f6268166090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626f175700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268166580 con 0x7f62680a7c90 2023-08-17T17:52:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626f175700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268156990 con 0x7f6268151e40 2023-08-17T17:52:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626f175700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6268155d80 con 0x7f62680be4d0 2023-08-17T17:52:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626cf11700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 0x7f62681582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626cf11700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 0x7f62681582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37550/0 (socket says 172.21.15.78:37550) 2023-08-17T17:52:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626cf11700 1 -- 172.21.15.78:0/1630188276 learned_addr learned my addr 172.21.15.78:0/1630188276 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626d712700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6268151e40 0x7f6268166090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f625ffff700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62680be4d0 0x7f6268165ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626cf11700 1 -- 172.21.15.78:0/1630188276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62680be4d0 msgr2=0x7f6268165ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626cf11700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62680be4d0 0x7f6268165ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626cf11700 1 -- 172.21.15.78:0/1630188276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6268151e40 msgr2=0x7f6268166090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626cf11700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6268151e40 0x7f6268166090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626cf11700 1 -- 172.21.15.78:0/1630188276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62580092a0 con 0x7f62680a7c90 2023-08-17T17:52:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626cf11700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 0x7f62681582c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f626400c410 tx=0x7f6264007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f625cff9700 1 -- 172.21.15.78:0/1630188276 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640072e0 con 0x7f62680a7c90 2023-08-17T17:52:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f625cff9700 1 -- 172.21.15.78:0/1630188276 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6264007440 con 0x7f62680a7c90 2023-08-17T17:52:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f626f175700 1 -- 172.21.15.78:0/1630188276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6268156060 con 0x7f62680a7c90 2023-08-17T17:52:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.288+0000 7f625cff9700 1 -- 172.21.15.78:0/1630188276 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640057a0 con 0x7f62680a7c90 2023-08-17T17:52:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.289+0000 7f626f175700 1 -- 172.21.15.78:0/1630188276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6268156620 con 0x7f62680a7c90 2023-08-17T17:52:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.290+0000 7f626f175700 1 -- 172.21.15.78:0/1630188276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6268062ed0 con 0x7f62680a7c90 2023-08-17T17:52:05.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.290+0000 7f625cff9700 1 -- 172.21.15.78:0/1630188276 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6264010070 con 0x7f62680a7c90 2023-08-17T17:52:05.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.290+0000 7f625cff9700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f625405ed90 0x7f6254061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.290+0000 7f625cff9700 1 -- 172.21.15.78:0/1630188276 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f62640790a0 con 0x7f62680a7c90 2023-08-17T17:52:05.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.290+0000 7f625ffff700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f625405ed90 0x7f6254061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.291+0000 7f625ffff700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f625405ed90 0x7f6254061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6268096cf0 tx=0x7f6258017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:05.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.294+0000 7f625cff9700 1 -- 172.21.15.78:0/1630188276 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f626404a640 con 0x7f62680a7c90 2023-08-17T17:52:05.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.459+0000 7f626f175700 1 -- 172.21.15.78:0/1630188276 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62680a8190 con 0x7f625405ed90 2023-08-17T17:52:05.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.468+0000 7f625cff9700 1 -- 172.21.15.78:0/1630188276 <== mgr.7446 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361770 (secure 0 0 0) 0x7f62680a8190 con 0x7f625405ed90 2023-08-17T17:52:05.473 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:52:05.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 -- 172.21.15.78:0/1630188276 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f625405ed90 msgr2=0x7f6254061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f625405ed90 0x7f6254061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6268096cf0 tx=0x7f6258017000).stop 2023-08-17T17:52:05.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 -- 172.21.15.78:0/1630188276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 msgr2=0x7f62681582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 0x7f62681582c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f626400c410 tx=0x7f6264007c70).stop 2023-08-17T17:52:05.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 -- 172.21.15.78:0/1630188276 shutdown_connections 2023-08-17T17:52:05.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f625405ed90 0x7f6254061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6268151e40 0x7f6268166090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62680a7c90 0x7f62681582c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 --2- 172.21.15.78:0/1630188276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62680be4d0 0x7f6268165ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 -- 172.21.15.78:0/1630188276 >> 172.21.15.78:0/1630188276 conn(0x7f6268092330 msgr2=0x7f62680ac080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:05.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 -- 172.21.15.78:0/1630188276 shutdown_connections 2023-08-17T17:52:05.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.472+0000 7f626f175700 1 -- 172.21.15.78:0/1630188276 wait complete. 2023-08-17T17:52:05.476 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:52:05.485 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-17T17:52:03.736539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2421280,"kb_used_data":11744,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553440,"statfs":{"total":773094113280,"available":770614722560,"internally_reserved":0,"allocated":12025856,"data_stored":5938620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5592,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.572769"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741123+0000","last_change":"2023-08-17T17:51:57.736817+0000","last_active":"2023-08-17T17:51:57.741123+0000","last_peered":"2023-08-17T17:51:57.741123+0000","last_clean":"2023-08-17T17:51:57.741123+0000","last_became_active":"2023-08-17T17:51:57.736540+0000","last_became_peered":"2023-08-17T17:51:57.736540+0000","last_unstale":"2023-08-17T17:51:57.741123+0000","last_undegraded":"2023-08-17T17:51:57.741123+0000","last_fullsized":"2023-08-17T17:51:57.741123+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"120'3","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743818+0000","last_change":"2023-08-17T17:51:57.372019+0000","last_active":"2023-08-17T17:51:57.743818+0000","last_peered":"2023-08-17T17:51:57.743818+0000","last_clean":"2023-08-17T17:51:57.743818+0000","last_became_active":"2023-08-17T17:51:57.371744+0000","last_became_peered":"2023-08-17T17:51:57.371744+0000","last_unstale":"2023-08-17T17:51:57.743818+0000","last_undegraded":"2023-08-17T17:51:57.743818+0000","last_fullsized":"2023-08-17T17:51:57.743818+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746327+0000","last_change":"2023-08-17T17:51:57.741430+0000","last_active":"2023-08-17T17:51:57.746327+0000","last_peered":"2023-08-17T17:51:57.746327+0000","last_clean":"2023-08-17T17:51:57.746327+0000","last_became_active":"2023-08-17T17:51:57.741084+0000","last_became_peered":"2023-08-17T17:51:57.741084+0000","last_unstale":"2023-08-17T17:51:57.746327+0000","last_undegraded":"2023-08-17T17:51:57.746327+0000","last_fullsized":"2023-08-17T17:51:57.746327+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726506+0000","last_change":"2023-08-17T17:51:57.369427+0000","last_active":"2023-08-17T17:51:57.726506+0000","last_peered":"2023-08-17T17:51:57.726506+0000","last_clean":"2023-08-17T17:51:57.726506+0000","last_became_active":"2023-08-17T17:51:57.367170+0000","last_became_peered":"2023-08-17T17:51:57.367170+0000","last_unstale":"2023-08-17T17:51:57.726506+0000","last_undegraded":"2023-08-17T17:51:57.726506+0000","last_fullsized":"2023-08-17T17:51:57.726506+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746809+0000","last_change":"2023-08-17T17:51:57.744356+0000","last_active":"2023-08-17T17:51:57.746809+0000","last_peered":"2023-08-17T17:51:57.746809+0000","last_clean":"2023-08-17T17:51:57.746809+0000","last_became_active":"2023-08-17T17:51:57.744078+0000","last_became_peered":"2023-08-17T17:51:57.744078+0000","last_unstale":"2023-08-17T17:51:57.746809+0000","last_undegraded":"2023-08-17T17:51:57.746809+0000","last_fullsized":"2023-08-17T17:51:57.746809+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.728569+0000","last_change":"2023-08-17T17:51:57.371948+0000","last_active":"2023-08-17T17:51:57.728569+0000","last_peered":"2023-08-17T17:51:57.728569+0000","last_clean":"2023-08-17T17:51:57.728569+0000","last_became_active":"2023-08-17T17:51:57.371681+0000","last_became_peered":"2023-08-17T17:51:57.371681+0000","last_unstale":"2023-08-17T17:51:57.728569+0000","last_undegraded":"2023-08-17T17:51:57.728569+0000","last_fullsized":"2023-08-17T17:51:57.728569+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737858+0000","last_change":"2023-08-17T17:51:57.734487+0000","last_active":"2023-08-17T17:51:57.737858+0000","last_peered":"2023-08-17T17:51:57.737858+0000","last_clean":"2023-08-17T17:51:57.737858+0000","last_became_active":"2023-08-17T17:51:57.734220+0000","last_became_peered":"2023-08-17T17:51:57.734220+0000","last_unstale":"2023-08-17T17:51:57.737858+0000","last_undegraded":"2023-08-17T17:51:57.737858+0000","last_fullsized":"2023-08-17T17:51:57.737858+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740122+0000","last_change":"2023-08-17T17:51:57.374181+0000","last_active":"2023-08-17T17:51:57.740122+0000","last_peered":"2023-08-17T17:51:57.740122+0000","last_clean":"2023-08-17T17:51:57.740122+0000","last_became_active":"2023-08-17T17:51:57.373919+0000","last_became_peered":"2023-08-17T17:51:57.373919+0000","last_unstale":"2023-08-17T17:51:57.740122+0000","last_undegraded":"2023-08-17T17:51:57.740122+0000","last_fullsized":"2023-08-17T17:51:57.740122+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746873+0000","last_change":"2023-08-17T17:51:57.746014+0000","last_active":"2023-08-17T17:51:57.746873+0000","last_peered":"2023-08-17T17:51:57.746873+0000","last_clean":"2023-08-17T17:51:57.746873+0000","last_became_active":"2023-08-17T17:51:57.745746+0000","last_became_peered":"2023-08-17T17:51:57.745746+0000","last_unstale":"2023-08-17T17:51:57.746873+0000","last_undegraded":"2023-08-17T17:51:57.746873+0000","last_fullsized":"2023-08-17T17:51:57.746873+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.738418+0000","last_change":"2023-08-17T17:51:57.364492+0000","last_active":"2023-08-17T17:51:57.738418+0000","last_peered":"2023-08-17T17:51:57.738418+0000","last_clean":"2023-08-17T17:51:57.738418+0000","last_became_active":"2023-08-17T17:51:57.364152+0000","last_became_peered":"2023-08-17T17:51:57.364152+0000","last_unstale":"2023-08-17T17:51:57.738418+0000","last_undegraded":"2023-08-17T17:51:57.738418+0000","last_fullsized":"2023-08-17T17:51:57.738418+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743278+0000","last_change":"2023-08-17T17:51:57.737103+0000","last_active":"2023-08-17T17:51:57.743278+0000","last_peered":"2023-08-17T17:51:57.743278+0000","last_clean":"2023-08-17T17:51:57.743278+0000","last_became_active":"2023-08-17T17:51:57.735308+0000","last_became_peered":"2023-08-17T17:51:57.735308+0000","last_unstale":"2023-08-17T17:51:57.743278+0000","last_undegraded":"2023-08-17T17:51:57.743278+0000","last_fullsized":"2023-08-17T17:51:57.743278+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743460+0000","last_change":"2023-08-17T17:51:57.363803+0000","last_active":"2023-08-17T17:51:57.743460+0000","last_peered":"2023-08-17T17:51:57.743460+0000","last_clean":"2023-08-17T17:51:57.743460+0000","last_became_active":"2023-08-17T17:51:57.363514+0000","last_became_peered":"2023-08-17T17:51:57.363514+0000","last_unstale":"2023-08-17T17:51:57.743460+0000","last_undegraded":"2023-08-17T17:51:57.743460+0000","last_fullsized":"2023-08-17T17:51:57.743460+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745059+0000","last_change":"2023-08-17T17:51:57.737694+0000","last_active":"2023-08-17T17:51:57.745059+0000","last_peered":"2023-08-17T17:51:57.745059+0000","last_clean":"2023-08-17T17:51:57.745059+0000","last_became_active":"2023-08-17T17:51:57.737323+0000","last_became_peered":"2023-08-17T17:51:57.737323+0000","last_unstale":"2023-08-17T17:51:57.745059+0000","last_undegraded":"2023-08-17T17:51:57.745059+0000","last_fullsized":"2023-08-17T17:51:57.745059+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731079+0000","last_change":"2023-08-17T17:51:57.365742+0000","last_active":"2023-08-17T17:51:57.731079+0000","last_peered":"2023-08-17T17:51:57.731079+0000","last_clean":"2023-08-17T17:51:57.731079+0000","last_became_active":"2023-08-17T17:51:57.365407+0000","last_became_peered":"2023-08-17T17:51:57.365407+0000","last_unstale":"2023-08-17T17:51:57.731079+0000","last_undegraded":"2023-08-17T17:51:57.731079+0000","last_fullsized":"2023-08-17T17:51:57.731079+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746837+0000","last_change":"2023-08-17T17:51:57.743870+0000","last_active":"2023-08-17T17:51:57.746837+0000","last_peered":"2023-08-17T17:51:57.746837+0000","last_clean":"2023-08-17T17:51:57.746837+0000","last_became_active":"2023-08-17T17:51:57.743565+0000","last_became_peered":"2023-08-17T17:51:57.743565+0000","last_unstale":"2023-08-17T17:51:57.746837+0000","last_undegraded":"2023-08-17T17:51:57.746837+0000","last_fullsized":"2023-08-17T17:51:57.746837+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.727864+0000","last_change":"2023-08-17T17:51:57.366896+0000","last_active":"2023-08-17T17:51:57.727864+0000","last_peered":"2023-08-17T17:51:57.727864+0000","last_clean":"2023-08-17T17:51:57.727864+0000","last_became_active":"2023-08-17T17:51:57.366622+0000","last_became_peered":"2023-08-17T17:51:57.366622+0000","last_unstale":"2023-08-17T17:51:57.727864+0000","last_undegraded":"2023-08-17T17:51:57.727864+0000","last_fullsized":"2023-08-17T17:51:57.727864+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743559+0000","last_change":"2023-08-17T17:51:57.739042+0000","last_active":"2023-08-17T17:51:57.743559+0000","last_peered":"2023-08-17T17:51:57.743559+0000","last_clean":"2023-08-17T17:51:57.743559+0000","last_became_active":"2023-08-17T17:51:57.738803+0000","last_became_peered":"2023-08-17T17:51:57.738803+0000","last_unstale":"2023-08-17T17:51:57.743559+0000","last_undegraded":"2023-08-17T17:51:57.743559+0000","last_fullsized":"2023-08-17T17:51:57.743559+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.724725+0000","last_change":"2023-08-17T17:51:57.367641+0000","last_active":"2023-08-17T17:51:57.724725+0000","last_peered":"2023-08-17T17:51:57.724725+0000","last_clean":"2023-08-17T17:51:57.724725+0000","last_became_active":"2023-08-17T17:51:57.367429+0000","last_became_peered":"2023-08-17T17:51:57.367429+0000","last_unstale":"2023-08-17T17:51:57.724725+0000","last_undegraded":"2023-08-17T17:51:57.724725+0000","last_fullsized":"2023-08-17T17:51:57.724725+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743160+0000","last_change":"2023-08-17T17:51:57.739205+0000","last_active":"2023-08-17T17:51:57.743160+0000","last_peered":"2023-08-17T17:51:57.743160+0000","last_clean":"2023-08-17T17:51:57.743160+0000","last_became_active":"2023-08-17T17:51:57.738941+0000","last_became_peered":"2023-08-17T17:51:57.738941+0000","last_unstale":"2023-08-17T17:51:57.743160+0000","last_undegraded":"2023-08-17T17:51:57.743160+0000","last_fullsized":"2023-08-17T17:51:57.743160+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.727984+0000","last_change":"2023-08-17T17:51:57.364458+0000","last_active":"2023-08-17T17:51:57.727984+0000","last_peered":"2023-08-17T17:51:57.727984+0000","last_clean":"2023-08-17T17:51:57.727984+0000","last_became_active":"2023-08-17T17:51:57.363914+0000","last_became_peered":"2023-08-17T17:51:57.363914+0000","last_unstale":"2023-08-17T17:51:57.727984+0000","last_undegraded":"2023-08-17T17:51:57.727984+0000","last_fullsized":"2023-08-17T17:51:57.727984+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743819+0000","last_change":"2023-08-17T17:51:57.741274+0000","last_active":"2023-08-17T17:51:57.743819+0000","last_peered":"2023-08-17T17:51:57.743819+0000","last_clean":"2023-08-17T17:51:57.743819+0000","last_became_active":"2023-08-17T17:51:57.740966+0000","last_became_peered":"2023-08-17T17:51:57.740966+0000","last_unstale":"2023-08-17T17:51:57.743819+0000","last_undegraded":"2023-08-17T17:51:57.743819+0000","last_fullsized":"2023-08-17T17:51:57.743819+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731780+0000","last_change":"2023-08-17T17:51:57.365669+0000","last_active":"2023-08-17T17:51:57.731780+0000","last_peered":"2023-08-17T17:51:57.731780+0000","last_clean":"2023-08-17T17:51:57.731780+0000","last_became_active":"2023-08-17T17:51:57.364949+0000","last_became_peered":"2023-08-17T17:51:57.364949+0000","last_unstale":"2023-08-17T17:51:57.731780+0000","last_undegraded":"2023-08-17T17:51:57.731780+0000","last_fullsized":"2023-08-17T17:51:57.731780+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.727281+0000","last_change":"2023-08-17T17:51:57.724629+0000","last_active":"2023-08-17T17:51:57.727281+0000","last_peered":"2023-08-17T17:51:57.727281+0000","last_clean":"2023-08-17T17:51:57.727281+0000","last_became_active":"2023-08-17T17:51:57.724332+0000","last_became_peered":"2023-08-17T17:51:57.724332+0000","last_unstale":"2023-08-17T17:51:57.727281+0000","last_undegraded":"2023-08-17T17:51:57.727281+0000","last_fullsized":"2023-08-17T17:51:57.727281+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"120'4","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.751497+0000","last_change":"2023-08-17T17:51:57.364955+0000","last_active":"2023-08-17T17:51:57.751497+0000","last_peered":"2023-08-17T17:51:57.751497+0000","last_clean":"2023-08-17T17:51:57.751497+0000","last_became_active":"2023-08-17T17:51:57.364670+0000","last_became_peered":"2023-08-17T17:51:57.364670+0000","last_unstale":"2023-08-17T17:51:57.751497+0000","last_undegraded":"2023-08-17T17:51:57.751497+0000","last_fullsized":"2023-08-17T17:51:57.751497+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.748796+0000","last_change":"2023-08-17T17:51:57.744606+0000","last_active":"2023-08-17T17:51:57.748796+0000","last_peered":"2023-08-17T17:51:57.748796+0000","last_clean":"2023-08-17T17:51:57.748796+0000","last_became_active":"2023-08-17T17:51:57.742633+0000","last_became_peered":"2023-08-17T17:51:57.742633+0000","last_unstale":"2023-08-17T17:51:57.748796+0000","last_undegraded":"2023-08-17T17:51:57.748796+0000","last_fullsized":"2023-08-17T17:51:57.748796+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745168+0000","last_change":"2023-08-17T17:51:57.370269+0000","last_active":"2023-08-17T17:51:57.745168+0000","last_peered":"2023-08-17T17:51:57.745168+0000","last_clean":"2023-08-17T17:51:57.745168+0000","last_became_active":"2023-08-17T17:51:57.369996+0000","last_became_peered":"2023-08-17T17:51:57.369996+0000","last_unstale":"2023-08-17T17:51:57.745168+0000","last_undegraded":"2023-08-17T17:51:57.745168+0000","last_fullsized":"2023-08-17T17:51:57.745168+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745811+0000","last_change":"2023-08-17T17:51:57.741956+0000","last_active":"2023-08-17T17:51:57.745811+0000","last_peered":"2023-08-17T17:51:57.745811+0000","last_clean":"2023-08-17T17:51:57.745811+0000","last_became_active":"2023-08-17T17:51:57.741512+0000","last_became_peered":"2023-08-17T17:51:57.741512+0000","last_unstale":"2023-08-17T17:51:57.745811+0000","last_undegraded":"2023-08-17T17:51:57.745811+0000","last_fullsized":"2023-08-17T17:51:57.745811+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.720588+0000","last_change":"2023-08-17T17:51:57.361489+0000","last_active":"2023-08-17T17:51:57.720588+0000","last_peered":"2023-08-17T17:51:57.720588+0000","last_clean":"2023-08-17T17:51:57.720588+0000","last_became_active":"2023-08-17T17:51:57.360703+0000","last_became_peered":"2023-08-17T17:51:57.360703+0000","last_unstale":"2023-08-17T17:51:57.720588+0000","last_undegraded":"2023-08-17T17:51:57.720588+0000","last_fullsized":"2023-08-17T17:51:57.720588+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.747085+0000","last_change":"2023-08-17T17:51:57.743058+0000","last_active":"2023-08-17T17:51:57.747085+0000","last_peered":"2023-08-17T17:51:57.747085+0000","last_clean":"2023-08-17T17:51:57.747085+0000","last_became_active":"2023-08-17T17:51:57.742794+0000","last_became_peered":"2023-08-17T17:51:57.742794+0000","last_unstale":"2023-08-17T17:51:57.747085+0000","last_undegraded":"2023-08-17T17:51:57.747085+0000","last_fullsized":"2023-08-17T17:51:57.747085+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.728997+0000","last_change":"2023-08-17T17:51:57.371311+0000","last_active":"2023-08-17T17:51:57.728997+0000","last_peered":"2023-08-17T17:51:57.728997+0000","last_clean":"2023-08-17T17:51:57.728997+0000","last_became_active":"2023-08-17T17:51:57.370887+0000","last_became_peered":"2023-08-17T17:51:57.370887+0000","last_unstale":"2023-08-17T17:51:57.728997+0000","last_undegraded":"2023-08-17T17:51:57.728997+0000","last_fullsized":"2023-08-17T17:51:57.728997+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745590+0000","last_change":"2023-08-17T17:51:57.739371+0000","last_active":"2023-08-17T17:51:57.745590+0000","last_peered":"2023-08-17T17:51:57.745590+0000","last_clean":"2023-08-17T17:51:57.745590+0000","last_became_active":"2023-08-17T17:51:57.738960+0000","last_became_peered":"2023-08-17T17:51:57.738960+0000","last_unstale":"2023-08-17T17:51:57.745590+0000","last_undegraded":"2023-08-17T17:51:57.745590+0000","last_fullsized":"2023-08-17T17:51:57.745590+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"120'4","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743978+0000","last_change":"2023-08-17T17:51:57.371279+0000","last_active":"2023-08-17T17:51:57.743978+0000","last_peered":"2023-08-17T17:51:57.743978+0000","last_clean":"2023-08-17T17:51:57.743978+0000","last_became_active":"2023-08-17T17:51:57.370997+0000","last_became_peered":"2023-08-17T17:51:57.370997+0000","last_unstale":"2023-08-17T17:51:57.743978+0000","last_undegraded":"2023-08-17T17:51:57.743978+0000","last_fullsized":"2023-08-17T17:51:57.743978+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744380+0000","last_change":"2023-08-17T17:51:57.740264+0000","last_active":"2023-08-17T17:51:57.744380+0000","last_peered":"2023-08-17T17:51:57.744380+0000","last_clean":"2023-08-17T17:51:57.744380+0000","last_became_active":"2023-08-17T17:51:57.739934+0000","last_became_peered":"2023-08-17T17:51:57.739934+0000","last_unstale":"2023-08-17T17:51:57.744380+0000","last_undegraded":"2023-08-17T17:51:57.744380+0000","last_fullsized":"2023-08-17T17:51:57.744380+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.727698+0000","last_change":"2023-08-17T17:51:57.368671+0000","last_active":"2023-08-17T17:51:57.727698+0000","last_peered":"2023-08-17T17:51:57.727698+0000","last_clean":"2023-08-17T17:51:57.727698+0000","last_became_active":"2023-08-17T17:51:57.367279+0000","last_became_peered":"2023-08-17T17:51:57.367279+0000","last_unstale":"2023-08-17T17:51:57.727698+0000","last_undegraded":"2023-08-17T17:51:57.727698+0000","last_fullsized":"2023-08-17T17:51:57.727698+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744207+0000","last_change":"2023-08-17T17:51:57.742432+0000","last_active":"2023-08-17T17:51:57.744207+0000","last_peered":"2023-08-17T17:51:57.744207+0000","last_clean":"2023-08-17T17:51:57.744207+0000","last_became_active":"2023-08-17T17:51:57.742124+0000","last_became_peered":"2023-08-17T17:51:57.742124+0000","last_unstale":"2023-08-17T17:51:57.744207+0000","last_undegraded":"2023-08-17T17:51:57.744207+0000","last_fullsized":"2023-08-17T17:51:57.744207+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731660+0000","last_change":"2023-08-17T17:51:57.364545+0000","last_active":"2023-08-17T17:51:57.731660+0000","last_peered":"2023-08-17T17:51:57.731660+0000","last_clean":"2023-08-17T17:51:57.731660+0000","last_became_active":"2023-08-17T17:51:57.364328+0000","last_became_peered":"2023-08-17T17:51:57.364328+0000","last_unstale":"2023-08-17T17:51:57.731660+0000","last_undegraded":"2023-08-17T17:51:57.731660+0000","last_fullsized":"2023-08-17T17:51:57.731660+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744259+0000","last_change":"2023-08-17T17:51:57.738490+0000","last_active":"2023-08-17T17:51:57.744259+0000","last_peered":"2023-08-17T17:51:57.744259+0000","last_clean":"2023-08-17T17:51:57.744259+0000","last_became_active":"2023-08-17T17:51:57.738172+0000","last_became_peered":"2023-08-17T17:51:57.738172+0000","last_unstale":"2023-08-17T17:51:57.744259+0000","last_undegraded":"2023-08-17T17:51:57.744259+0000","last_fullsized":"2023-08-17T17:51:57.744259+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744210+0000","last_change":"2023-08-17T17:51:57.364693+0000","last_active":"2023-08-17T17:51:57.744210+0000","last_peered":"2023-08-17T17:51:57.744210+0000","last_clean":"2023-08-17T17:51:57.744210+0000","last_became_active":"2023-08-17T17:51:57.364380+0000","last_became_peered":"2023-08-17T17:51:57.364380+0000","last_unstale":"2023-08-17T17:51:57.744210+0000","last_undegraded":"2023-08-17T17:51:57.744210+0000","last_fullsized":"2023-08-17T17:51:57.744210+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739972+0000","last_change":"2023-08-17T17:51:57.736280+0000","last_active":"2023-08-17T17:51:57.739972+0000","last_peered":"2023-08-17T17:51:57.739972+0000","last_clean":"2023-08-17T17:51:57.739972+0000","last_became_active":"2023-08-17T17:51:57.736022+0000","last_became_peered":"2023-08-17T17:51:57.736022+0000","last_unstale":"2023-08-17T17:51:57.739972+0000","last_undegraded":"2023-08-17T17:51:57.739972+0000","last_fullsized":"2023-08-17T17:51:57.739972+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.724563+0000","last_change":"2023-08-17T17:51:57.366633+0000","last_active":"2023-08-17T17:51:57.724563+0000","last_peered":"2023-08-17T17:51:57.724563+0000","last_clean":"2023-08-17T17:51:57.724563+0000","last_became_active":"2023-08-17T17:51:57.366315+0000","last_became_peered":"2023-08-17T17:51:57.366315+0000","last_unstale":"2023-08-17T17:51:57.724563+0000","last_undegraded":"2023-08-17T17:51:57.724563+0000","last_fullsized":"2023-08-17T17:51:57.724563+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.748817+0000","last_change":"2023-08-17T17:51:57.745459+0000","last_active":"2023-08-17T17:51:57.748817+0000","last_peered":"2023-08-17T17:51:57.748817+0000","last_clean":"2023-08-17T17:51:57.748817+0000","last_became_active":"2023-08-17T17:51:57.744943+0000","last_became_peered":"2023-08-17T17:51:57.744943+0000","last_unstale":"2023-08-17T17:51:57.748817+0000","last_undegraded":"2023-08-17T17:51:57.748817+0000","last_fullsized":"2023-08-17T17:51:57.748817+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741504+0000","last_change":"2023-08-17T17:51:57.357092+0000","last_active":"2023-08-17T17:51:57.741504+0000","last_peered":"2023-08-17T17:51:57.741504+0000","last_clean":"2023-08-17T17:51:57.741504+0000","last_became_active":"2023-08-17T17:51:57.356635+0000","last_became_peered":"2023-08-17T17:51:57.356635+0000","last_unstale":"2023-08-17T17:51:57.741504+0000","last_undegraded":"2023-08-17T17:51:57.741504+0000","last_fullsized":"2023-08-17T17:51:57.741504+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743301+0000","last_change":"2023-08-17T17:51:57.737960+0000","last_active":"2023-08-17T17:51:57.743301+0000","last_peered":"2023-08-17T17:51:57.743301+0000","last_clean":"2023-08-17T17:51:57.743301+0000","last_became_active":"2023-08-17T17:51:57.737660+0000","last_became_peered":"2023-08-17T17:51:57.737660+0000","last_unstale":"2023-08-17T17:51:57.743301+0000","last_undegraded":"2023-08-17T17:51:57.743301+0000","last_fullsized":"2023-08-17T17:51:57.743301+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726298+0000","last_change":"2023-08-17T17:51:57.360703+0000","last_active":"2023-08-17T17:51:57.726298+0000","last_peered":"2023-08-17T17:51:57.726298+0000","last_clean":"2023-08-17T17:51:57.726298+0000","last_became_active":"2023-08-17T17:51:57.360437+0000","last_became_peered":"2023-08-17T17:51:57.360437+0000","last_unstale":"2023-08-17T17:51:57.726298+0000","last_undegraded":"2023-08-17T17:51:57.726298+0000","last_fullsized":"2023-08-17T17:51:57.726298+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744279+0000","last_change":"2023-08-17T17:51:57.742060+0000","last_active":"2023-08-17T17:51:57.744279+0000","last_peered":"2023-08-17T17:51:57.744279+0000","last_clean":"2023-08-17T17:51:57.744279+0000","last_became_active":"2023-08-17T17:51:57.741759+0000","last_became_peered":"2023-08-17T17:51:57.741759+0000","last_unstale":"2023-08-17T17:51:57.744279+0000","last_undegraded":"2023-08-17T17:51:57.744279+0000","last_fullsized":"2023-08-17T17:51:57.744279+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726338+0000","last_change":"2023-08-17T17:51:57.366381+0000","last_active":"2023-08-17T17:51:57.726338+0000","last_peered":"2023-08-17T17:51:57.726338+0000","last_clean":"2023-08-17T17:51:57.726338+0000","last_became_active":"2023-08-17T17:51:57.366077+0000","last_became_peered":"2023-08-17T17:51:57.366077+0000","last_unstale":"2023-08-17T17:51:57.726338+0000","last_undegraded":"2023-08-17T17:51:57.726338+0000","last_fullsized":"2023-08-17T17:51:57.726338+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740279+0000","last_change":"2023-08-17T17:51:57.739049+0000","last_active":"2023-08-17T17:51:57.740279+0000","last_peered":"2023-08-17T17:51:57.740279+0000","last_clean":"2023-08-17T17:51:57.740279+0000","last_became_active":"2023-08-17T17:51:57.738709+0000","last_became_peered":"2023-08-17T17:51:57.738709+0000","last_unstale":"2023-08-17T17:51:57.740279+0000","last_undegraded":"2023-08-17T17:51:57.740279+0000","last_fullsized":"2023-08-17T17:51:57.740279+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731154+0000","last_change":"2023-08-17T17:51:57.366793+0000","last_active":"2023-08-17T17:51:57.731154+0000","last_peered":"2023-08-17T17:51:57.731154+0000","last_clean":"2023-08-17T17:51:57.731154+0000","last_became_active":"2023-08-17T17:51:57.366484+0000","last_became_peered":"2023-08-17T17:51:57.366484+0000","last_unstale":"2023-08-17T17:51:57.731154+0000","last_undegraded":"2023-08-17T17:51:57.731154+0000","last_fullsized":"2023-08-17T17:51:57.731154+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741326+0000","last_change":"2023-08-17T17:51:57.738955+0000","last_active":"2023-08-17T17:51:57.741326+0000","last_peered":"2023-08-17T17:51:57.741326+0000","last_clean":"2023-08-17T17:51:57.741326+0000","last_became_active":"2023-08-17T17:51:57.738716+0000","last_became_peered":"2023-08-17T17:51:57.738716+0000","last_unstale":"2023-08-17T17:51:57.741326+0000","last_undegraded":"2023-08-17T17:51:57.741326+0000","last_fullsized":"2023-08-17T17:51:57.741326+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.729339+0000","last_change":"2023-08-17T17:51:57.369068+0000","last_active":"2023-08-17T17:51:57.729339+0000","last_peered":"2023-08-17T17:51:57.729339+0000","last_clean":"2023-08-17T17:51:57.729339+0000","last_became_active":"2023-08-17T17:51:57.368742+0000","last_became_peered":"2023-08-17T17:51:57.368742+0000","last_unstale":"2023-08-17T17:51:57.729339+0000","last_undegraded":"2023-08-17T17:51:57.729339+0000","last_fullsized":"2023-08-17T17:51:57.729339+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739588+0000","last_change":"2023-08-17T17:51:57.738483+0000","last_active":"2023-08-17T17:51:57.739588+0000","last_peered":"2023-08-17T17:51:57.739588+0000","last_clean":"2023-08-17T17:51:57.739588+0000","last_became_active":"2023-08-17T17:51:57.738191+0000","last_became_peered":"2023-08-17T17:51:57.738191+0000","last_unstale":"2023-08-17T17:51:57.739588+0000","last_undegraded":"2023-08-17T17:51:57.739588+0000","last_fullsized":"2023-08-17T17:51:57.739588+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726605+0000","last_change":"2023-08-17T17:51:57.369642+0000","last_active":"2023-08-17T17:51:57.726605+0000","last_peered":"2023-08-17T17:51:57.726605+0000","last_clean":"2023-08-17T17:51:57.726605+0000","last_became_active":"2023-08-17T17:51:57.368957+0000","last_became_peered":"2023-08-17T17:51:57.368957+0000","last_unstale":"2023-08-17T17:51:57.726605+0000","last_undegraded":"2023-08-17T17:51:57.726605+0000","last_fullsized":"2023-08-17T17:51:57.726605+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746823+0000","last_change":"2023-08-17T17:51:57.744601+0000","last_active":"2023-08-17T17:51:57.746823+0000","last_peered":"2023-08-17T17:51:57.746823+0000","last_clean":"2023-08-17T17:51:57.746823+0000","last_became_active":"2023-08-17T17:51:57.744301+0000","last_became_peered":"2023-08-17T17:51:57.744301+0000","last_unstale":"2023-08-17T17:51:57.746823+0000","last_undegraded":"2023-08-17T17:51:57.746823+0000","last_fullsized":"2023-08-17T17:51:57.746823+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731486+0000","last_change":"2023-08-17T17:51:57.373027+0000","last_active":"2023-08-17T17:51:57.731486+0000","last_peered":"2023-08-17T17:51:57.731486+0000","last_clean":"2023-08-17T17:51:57.731486+0000","last_became_active":"2023-08-17T17:51:57.372752+0000","last_became_peered":"2023-08-17T17:51:57.372752+0000","last_unstale":"2023-08-17T17:51:57.731486+0000","last_undegraded":"2023-08-17T17:51:57.731486+0000","last_fullsized":"2023-08-17T17:51:57.731486+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744097+0000","last_change":"2023-08-17T17:51:57.738437+0000","last_active":"2023-08-17T17:51:57.744097+0000","last_peered":"2023-08-17T17:51:57.744097+0000","last_clean":"2023-08-17T17:51:57.744097+0000","last_became_active":"2023-08-17T17:51:57.738185+0000","last_became_peered":"2023-08-17T17:51:57.738185+0000","last_unstale":"2023-08-17T17:51:57.744097+0000","last_undegraded":"2023-08-17T17:51:57.744097+0000","last_fullsized":"2023-08-17T17:51:57.744097+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.730883+0000","last_change":"2023-08-17T17:51:57.364469+0000","last_active":"2023-08-17T17:51:57.730883+0000","last_peered":"2023-08-17T17:51:57.730883+0000","last_clean":"2023-08-17T17:51:57.730883+0000","last_became_active":"2023-08-17T17:51:57.364172+0000","last_became_peered":"2023-08-17T17:51:57.364172+0000","last_unstale":"2023-08-17T17:51:57.730883+0000","last_undegraded":"2023-08-17T17:51:57.730883+0000","last_fullsized":"2023-08-17T17:51:57.730883+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.747690+0000","last_change":"2023-08-17T17:51:57.747265+0000","last_active":"2023-08-17T17:51:57.747690+0000","last_peered":"2023-08-17T17:51:57.747690+0000","last_clean":"2023-08-17T17:51:57.747690+0000","last_became_active":"2023-08-17T17:51:57.747038+0000","last_became_peered":"2023-08-17T17:51:57.747038+0000","last_unstale":"2023-08-17T17:51:57.747690+0000","last_undegraded":"2023-08-17T17:51:57.747690+0000","last_fullsized":"2023-08-17T17:51:57.747690+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726693+0000","last_change":"2023-08-17T17:51:57.366268+0000","last_active":"2023-08-17T17:51:57.726693+0000","last_peered":"2023-08-17T17:51:57.726693+0000","last_clean":"2023-08-17T17:51:57.726693+0000","last_became_active":"2023-08-17T17:51:57.365967+0000","last_became_peered":"2023-08-17T17:51:57.365967+0000","last_unstale":"2023-08-17T17:51:57.726693+0000","last_undegraded":"2023-08-17T17:51:57.726693+0000","last_fullsized":"2023-08-17T17:51:57.726693+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.738226+0000","last_change":"2023-08-17T17:51:57.729499+0000","last_active":"2023-08-17T17:51:57.738226+0000","last_peered":"2023-08-17T17:51:57.738226+0000","last_clean":"2023-08-17T17:51:57.738226+0000","last_became_active":"2023-08-17T17:51:57.729219+0000","last_became_peered":"2023-08-17T17:51:57.729219+0000","last_unstale":"2023-08-17T17:51:57.738226+0000","last_undegraded":"2023-08-17T17:51:57.738226+0000","last_fullsized":"2023-08-17T17:51:57.738226+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.720821+0000","last_change":"2023-08-17T17:51:57.372404+0000","last_active":"2023-08-17T17:51:57.720821+0000","last_peered":"2023-08-17T17:51:57.720821+0000","last_clean":"2023-08-17T17:51:57.720821+0000","last_became_active":"2023-08-17T17:51:57.369293+0000","last_became_peered":"2023-08-17T17:51:57.369293+0000","last_unstale":"2023-08-17T17:51:57.720821+0000","last_undegraded":"2023-08-17T17:51:57.720821+0000","last_fullsized":"2023-08-17T17:51:57.720821+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739316+0000","last_change":"2023-08-17T17:51:57.736259+0000","last_active":"2023-08-17T17:51:57.739316+0000","last_peered":"2023-08-17T17:51:57.739316+0000","last_clean":"2023-08-17T17:51:57.739316+0000","last_became_active":"2023-08-17T17:51:57.735993+0000","last_became_peered":"2023-08-17T17:51:57.735993+0000","last_unstale":"2023-08-17T17:51:57.739316+0000","last_undegraded":"2023-08-17T17:51:57.739316+0000","last_fullsized":"2023-08-17T17:51:57.739316+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.728905+0000","last_change":"2023-08-17T17:51:57.371137+0000","last_active":"2023-08-17T17:51:57.728905+0000","last_peered":"2023-08-17T17:51:57.728905+0000","last_clean":"2023-08-17T17:51:57.728905+0000","last_became_active":"2023-08-17T17:51:57.370549+0000","last_became_peered":"2023-08-17T17:51:57.370549+0000","last_unstale":"2023-08-17T17:51:57.728905+0000","last_undegraded":"2023-08-17T17:51:57.728905+0000","last_fullsized":"2023-08-17T17:51:57.728905+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743415+0000","last_change":"2023-08-17T17:51:57.735417+0000","last_active":"2023-08-17T17:51:57.743415+0000","last_peered":"2023-08-17T17:51:57.743415+0000","last_clean":"2023-08-17T17:51:57.743415+0000","last_became_active":"2023-08-17T17:51:57.735149+0000","last_became_peered":"2023-08-17T17:51:57.735149+0000","last_unstale":"2023-08-17T17:51:57.743415+0000","last_undegraded":"2023-08-17T17:51:57.743415+0000","last_fullsized":"2023-08-17T17:51:57.743415+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.727778+0000","last_change":"2023-08-17T17:51:57.370896+0000","last_active":"2023-08-17T17:51:57.727778+0000","last_peered":"2023-08-17T17:51:57.727778+0000","last_clean":"2023-08-17T17:51:57.727778+0000","last_became_active":"2023-08-17T17:51:57.370461+0000","last_became_peered":"2023-08-17T17:51:57.370461+0000","last_unstale":"2023-08-17T17:51:57.727778+0000","last_undegraded":"2023-08-17T17:51:57.727778+0000","last_fullsized":"2023-08-17T17:51:57.727778+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743295+0000","last_change":"2023-08-17T17:51:57.737945+0000","last_active":"2023-08-17T17:51:57.743295+0000","last_peered":"2023-08-17T17:51:57.743295+0000","last_clean":"2023-08-17T17:51:57.743295+0000","last_became_active":"2023-08-17T17:51:57.737421+0000","last_became_peered":"2023-08-17T17:51:57.737421+0000","last_unstale":"2023-08-17T17:51:57.743295+0000","last_undegraded":"2023-08-17T17:51:57.743295+0000","last_fullsized":"2023-08-17T17:51:57.743295+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740714+0000","last_change":"2023-08-17T17:51:57.370014+0000","last_active":"2023-08-17T17:51:57.740714+0000","last_peered":"2023-08-17T17:51:57.740714+0000","last_clean":"2023-08-17T17:51:57.740714+0000","last_became_active":"2023-08-17T17:51:57.369758+0000","last_became_peered":"2023-08-17T17:51:57.369758+0000","last_unstale":"2023-08-17T17:51:57.740714+0000","last_undegraded":"2023-08-17T17:51:57.740714+0000","last_fullsized":"2023-08-17T17:51:57.740714+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737832+0000","last_change":"2023-08-17T17:51:57.732634+0000","last_active":"2023-08-17T17:51:57.737832+0000","last_peered":"2023-08-17T17:51:57.737832+0000","last_clean":"2023-08-17T17:51:57.737832+0000","last_became_active":"2023-08-17T17:51:57.732286+0000","last_became_peered":"2023-08-17T17:51:57.732286+0000","last_unstale":"2023-08-17T17:51:57.737832+0000","last_undegraded":"2023-08-17T17:51:57.737832+0000","last_fullsized":"2023-08-17T17:51:57.737832+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737240+0000","last_change":"2023-08-17T17:51:57.361453+0000","last_active":"2023-08-17T17:51:57.737240+0000","last_peered":"2023-08-17T17:51:57.737240+0000","last_clean":"2023-08-17T17:51:57.737240+0000","last_became_active":"2023-08-17T17:51:57.361188+0000","last_became_peered":"2023-08-17T17:51:57.361188+0000","last_unstale":"2023-08-17T17:51:57.737240+0000","last_undegraded":"2023-08-17T17:51:57.737240+0000","last_fullsized":"2023-08-17T17:51:57.737240+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745028+0000","last_change":"2023-08-17T17:51:57.737391+0000","last_active":"2023-08-17T17:51:57.745028+0000","last_peered":"2023-08-17T17:51:57.745028+0000","last_clean":"2023-08-17T17:51:57.745028+0000","last_became_active":"2023-08-17T17:51:57.737078+0000","last_became_peered":"2023-08-17T17:51:57.737078+0000","last_unstale":"2023-08-17T17:51:57.745028+0000","last_undegraded":"2023-08-17T17:51:57.745028+0000","last_fullsized":"2023-08-17T17:51:57.745028+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745713+0000","last_change":"2023-08-17T17:51:57.370360+0000","last_active":"2023-08-17T17:51:57.745713+0000","last_peered":"2023-08-17T17:51:57.745713+0000","last_clean":"2023-08-17T17:51:57.745713+0000","last_became_active":"2023-08-17T17:51:57.370034+0000","last_became_peered":"2023-08-17T17:51:57.370034+0000","last_unstale":"2023-08-17T17:51:57.745713+0000","last_undegraded":"2023-08-17T17:51:57.745713+0000","last_fullsized":"2023-08-17T17:51:57.745713+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744325+0000","last_change":"2023-08-17T17:51:57.739218+0000","last_active":"2023-08-17T17:51:57.744325+0000","last_peered":"2023-08-17T17:51:57.744325+0000","last_clean":"2023-08-17T17:51:57.744325+0000","last_became_active":"2023-08-17T17:51:57.738554+0000","last_became_peered":"2023-08-17T17:51:57.738554+0000","last_unstale":"2023-08-17T17:51:57.744325+0000","last_undegraded":"2023-08-17T17:51:57.744325+0000","last_fullsized":"2023-08-17T17:51:57.744325+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.725512+0000","last_change":"2023-08-17T17:51:57.365354+0000","last_active":"2023-08-17T17:51:57.725512+0000","last_peered":"2023-08-17T17:51:57.725512+0000","last_clean":"2023-08-17T17:51:57.725512+0000","last_became_active":"2023-08-17T17:51:57.365019+0000","last_became_peered":"2023-08-17T17:51:57.365019+0000","last_unstale":"2023-08-17T17:51:57.725512+0000","last_undegraded":"2023-08-17T17:51:57.725512+0000","last_fullsized":"2023-08-17T17:51:57.725512+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746486+0000","last_change":"2023-08-17T17:51:57.744663+0000","last_active":"2023-08-17T17:51:57.746486+0000","last_peered":"2023-08-17T17:51:57.746486+0000","last_clean":"2023-08-17T17:51:57.746486+0000","last_became_active":"2023-08-17T17:51:57.744389+0000","last_became_peered":"2023-08-17T17:51:57.744389+0000","last_unstale":"2023-08-17T17:51:57.746486+0000","last_undegraded":"2023-08-17T17:51:57.746486+0000","last_fullsized":"2023-08-17T17:51:57.746486+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731333+0000","last_change":"2023-08-17T17:51:57.362646+0000","last_active":"2023-08-17T17:51:57.731333+0000","last_peered":"2023-08-17T17:51:57.731333+0000","last_clean":"2023-08-17T17:51:57.731333+0000","last_became_active":"2023-08-17T17:51:57.362354+0000","last_became_peered":"2023-08-17T17:51:57.362354+0000","last_unstale":"2023-08-17T17:51:57.731333+0000","last_undegraded":"2023-08-17T17:51:57.731333+0000","last_fullsized":"2023-08-17T17:51:57.731333+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745786+0000","last_change":"2023-08-17T17:51:57.741798+0000","last_active":"2023-08-17T17:51:57.745786+0000","last_peered":"2023-08-17T17:51:57.745786+0000","last_clean":"2023-08-17T17:51:57.745786+0000","last_became_active":"2023-08-17T17:51:57.740984+0000","last_became_peered":"2023-08-17T17:51:57.740984+0000","last_unstale":"2023-08-17T17:51:57.745786+0000","last_undegraded":"2023-08-17T17:51:57.745786+0000","last_fullsized":"2023-08-17T17:51:57.745786+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721305+0000","last_change":"2023-08-17T17:51:57.365254+0000","last_active":"2023-08-17T17:51:57.721305+0000","last_peered":"2023-08-17T17:51:57.721305+0000","last_clean":"2023-08-17T17:51:57.721305+0000","last_became_active":"2023-08-17T17:51:57.364944+0000","last_became_peered":"2023-08-17T17:51:57.364944+0000","last_unstale":"2023-08-17T17:51:57.721305+0000","last_undegraded":"2023-08-17T17:51:57.721305+0000","last_fullsized":"2023-08-17T17:51:57.721305+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.747096+0000","last_change":"2023-08-17T17:51:57.744940+0000","last_active":"2023-08-17T17:51:57.747096+0000","last_peered":"2023-08-17T17:51:57.747096+0000","last_clean":"2023-08-17T17:51:57.747096+0000","last_became_active":"2023-08-17T17:51:57.744588+0000","last_became_peered":"2023-08-17T17:51:57.744588+0000","last_unstale":"2023-08-17T17:51:57.747096+0000","last_undegraded":"2023-08-17T17:51:57.747096+0000","last_fullsized":"2023-08-17T17:51:57.747096+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.723988+0000","last_change":"2023-08-17T17:51:57.369414+0000","last_active":"2023-08-17T17:51:57.723988+0000","last_peered":"2023-08-17T17:51:57.723988+0000","last_clean":"2023-08-17T17:51:57.723988+0000","last_became_active":"2023-08-17T17:51:57.369043+0000","last_became_peered":"2023-08-17T17:51:57.369043+0000","last_unstale":"2023-08-17T17:51:57.723988+0000","last_undegraded":"2023-08-17T17:51:57.723988+0000","last_fullsized":"2023-08-17T17:51:57.723988+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743416+0000","last_change":"2023-08-17T17:51:57.740558+0000","last_active":"2023-08-17T17:51:57.743416+0000","last_peered":"2023-08-17T17:51:57.743416+0000","last_clean":"2023-08-17T17:51:57.743416+0000","last_became_active":"2023-08-17T17:51:57.740239+0000","last_became_peered":"2023-08-17T17:51:57.740239+0000","last_unstale":"2023-08-17T17:51:57.743416+0000","last_undegraded":"2023-08-17T17:51:57.743416+0000","last_fullsized":"2023-08-17T17:51:57.743416+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.729424+0000","last_change":"2023-08-17T17:51:57.373398+0000","last_active":"2023-08-17T17:51:57.729424+0000","last_peered":"2023-08-17T17:51:57.729424+0000","last_clean":"2023-08-17T17:51:57.729424+0000","last_became_active":"2023-08-17T17:51:57.370409+0000","last_became_peered":"2023-08-17T17:51:57.370409+0000","last_unstale":"2023-08-17T17:51:57.729424+0000","last_undegraded":"2023-08-17T17:51:57.729424+0000","last_fullsized":"2023-08-17T17:51:57.729424+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745620+0000","last_change":"2023-08-17T17:51:57.740077+0000","last_active":"2023-08-17T17:51:57.745620+0000","last_peered":"2023-08-17T17:51:57.745620+0000","last_clean":"2023-08-17T17:51:57.745620+0000","last_became_active":"2023-08-17T17:51:57.739793+0000","last_became_peered":"2023-08-17T17:51:57.739793+0000","last_unstale":"2023-08-17T17:51:57.745620+0000","last_undegraded":"2023-08-17T17:51:57.745620+0000","last_fullsized":"2023-08-17T17:51:57.745620+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.724757+0000","last_change":"2023-08-17T17:51:57.369908+0000","last_active":"2023-08-17T17:51:57.724757+0000","last_peered":"2023-08-17T17:51:57.724757+0000","last_clean":"2023-08-17T17:51:57.724757+0000","last_became_active":"2023-08-17T17:51:57.369537+0000","last_became_peered":"2023-08-17T17:51:57.369537+0000","last_unstale":"2023-08-17T17:51:57.724757+0000","last_undegraded":"2023-08-17T17:51:57.724757+0000","last_fullsized":"2023-08-17T17:51:57.724757+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743933+0000","last_change":"2023-08-17T17:51:57.737083+0000","last_active":"2023-08-17T17:51:57.743933+0000","last_peered":"2023-08-17T17:51:57.743933+0000","last_clean":"2023-08-17T17:51:57.743933+0000","last_became_active":"2023-08-17T17:51:57.736807+0000","last_became_peered":"2023-08-17T17:51:57.736807+0000","last_unstale":"2023-08-17T17:51:57.743933+0000","last_undegraded":"2023-08-17T17:51:57.743933+0000","last_fullsized":"2023-08-17T17:51:57.743933+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726788+0000","last_change":"2023-08-17T17:51:57.369827+0000","last_active":"2023-08-17T17:51:57.726788+0000","last_peered":"2023-08-17T17:51:57.726788+0000","last_clean":"2023-08-17T17:51:57.726788+0000","last_became_active":"2023-08-17T17:51:57.366551+0000","last_became_peered":"2023-08-17T17:51:57.366551+0000","last_unstale":"2023-08-17T17:51:57.726788+0000","last_undegraded":"2023-08-17T17:51:57.726788+0000","last_fullsized":"2023-08-17T17:51:57.726788+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740263+0000","last_change":"2023-08-17T17:51:57.735676+0000","last_active":"2023-08-17T17:51:57.740263+0000","last_peered":"2023-08-17T17:51:57.740263+0000","last_clean":"2023-08-17T17:51:57.740263+0000","last_became_active":"2023-08-17T17:51:57.735437+0000","last_became_peered":"2023-08-17T17:51:57.735437+0000","last_unstale":"2023-08-17T17:51:57.740263+0000","last_undegraded":"2023-08-17T17:51:57.740263+0000","last_fullsized":"2023-08-17T17:51:57.740263+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"120'3","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743909+0000","last_change":"2023-08-17T17:51:57.371270+0000","last_active":"2023-08-17T17:51:57.743909+0000","last_peered":"2023-08-17T17:51:57.743909+0000","last_clean":"2023-08-17T17:51:57.743909+0000","last_became_active":"2023-08-17T17:51:57.370968+0000","last_became_peered":"2023-08-17T17:51:57.370968+0000","last_unstale":"2023-08-17T17:51:57.743909+0000","last_undegraded":"2023-08-17T17:51:57.743909+0000","last_fullsized":"2023-08-17T17:51:57.743909+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744059+0000","last_change":"2023-08-17T17:51:57.737452+0000","last_active":"2023-08-17T17:51:57.744059+0000","last_peered":"2023-08-17T17:51:57.744059+0000","last_clean":"2023-08-17T17:51:57.744059+0000","last_became_active":"2023-08-17T17:51:57.736977+0000","last_became_peered":"2023-08-17T17:51:57.736977+0000","last_unstale":"2023-08-17T17:51:57.744059+0000","last_undegraded":"2023-08-17T17:51:57.744059+0000","last_fullsized":"2023-08-17T17:51:57.744059+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740860+0000","last_change":"2023-08-17T17:51:57.367346+0000","last_active":"2023-08-17T17:51:57.740860+0000","last_peered":"2023-08-17T17:51:57.740860+0000","last_clean":"2023-08-17T17:51:57.740860+0000","last_became_active":"2023-08-17T17:51:57.367074+0000","last_became_peered":"2023-08-17T17:51:57.367074+0000","last_unstale":"2023-08-17T17:51:57.740860+0000","last_undegraded":"2023-08-17T17:51:57.740860+0000","last_fullsized":"2023-08-17T17:51:57.740860+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739477+0000","last_change":"2023-08-17T17:51:57.729843+0000","last_active":"2023-08-17T17:51:57.739477+0000","last_peered":"2023-08-17T17:51:57.739477+0000","last_clean":"2023-08-17T17:51:57.739477+0000","last_became_active":"2023-08-17T17:51:57.729465+0000","last_became_peered":"2023-08-17T17:51:57.729465+0000","last_unstale":"2023-08-17T17:51:57.739477+0000","last_undegraded":"2023-08-17T17:51:57.739477+0000","last_fullsized":"2023-08-17T17:51:57.739477+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744005+0000","last_change":"2023-08-17T17:51:57.373407+0000","last_active":"2023-08-17T17:51:57.744005+0000","last_peered":"2023-08-17T17:51:57.744005+0000","last_clean":"2023-08-17T17:51:57.744005+0000","last_became_active":"2023-08-17T17:51:57.373134+0000","last_became_peered":"2023-08-17T17:51:57.373134+0000","last_unstale":"2023-08-17T17:51:57.744005+0000","last_undegraded":"2023-08-17T17:51:57.744005+0000","last_fullsized":"2023-08-17T17:51:57.744005+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741609+0000","last_change":"2023-08-17T17:51:57.739948+0000","last_active":"2023-08-17T17:51:57.741609+0000","last_peered":"2023-08-17T17:51:57.741609+0000","last_clean":"2023-08-17T17:51:57.741609+0000","last_became_active":"2023-08-17T17:51:57.739363+0000","last_became_peered":"2023-08-17T17:51:57.739363+0000","last_unstale":"2023-08-17T17:51:57.741609+0000","last_undegraded":"2023-08-17T17:51:57.741609+0000","last_fullsized":"2023-08-17T17:51:57.741609+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.730661+0000","last_change":"2023-08-17T17:51:57.366817+0000","last_active":"2023-08-17T17:51:57.730661+0000","last_peered":"2023-08-17T17:51:57.730661+0000","last_clean":"2023-08-17T17:51:57.730661+0000","last_became_active":"2023-08-17T17:51:57.366588+0000","last_became_peered":"2023-08-17T17:51:57.366588+0000","last_unstale":"2023-08-17T17:51:57.730661+0000","last_undegraded":"2023-08-17T17:51:57.730661+0000","last_fullsized":"2023-08-17T17:51:57.730661+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737211+0000","last_change":"2023-08-17T17:51:57.729428+0000","last_active":"2023-08-17T17:51:57.737211+0000","last_peered":"2023-08-17T17:51:57.737211+0000","last_clean":"2023-08-17T17:51:57.737211+0000","last_became_active":"2023-08-17T17:51:57.728206+0000","last_became_peered":"2023-08-17T17:51:57.728206+0000","last_unstale":"2023-08-17T17:51:57.737211+0000","last_undegraded":"2023-08-17T17:51:57.737211+0000","last_fullsized":"2023-08-17T17:51:57.737211+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.720475+0000","last_change":"2023-08-17T17:51:57.369190+0000","last_active":"2023-08-17T17:51:57.720475+0000","last_peered":"2023-08-17T17:51:57.720475+0000","last_clean":"2023-08-17T17:51:57.720475+0000","last_became_active":"2023-08-17T17:51:57.368840+0000","last_became_peered":"2023-08-17T17:51:57.368840+0000","last_unstale":"2023-08-17T17:51:57.720475+0000","last_undegraded":"2023-08-17T17:51:57.720475+0000","last_fullsized":"2023-08-17T17:51:57.720475+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745615+0000","last_change":"2023-08-17T17:51:57.739636+0000","last_active":"2023-08-17T17:51:57.745615+0000","last_peered":"2023-08-17T17:51:57.745615+0000","last_clean":"2023-08-17T17:51:57.745615+0000","last_became_active":"2023-08-17T17:51:57.739284+0000","last_became_peered":"2023-08-17T17:51:57.739284+0000","last_unstale":"2023-08-17T17:51:57.745615+0000","last_undegraded":"2023-08-17T17:51:57.745615+0000","last_fullsized":"2023-08-17T17:51:57.745615+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"120'4","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745978+0000","last_change":"2023-08-17T17:51:57.369481+0000","last_active":"2023-08-17T17:51:57.745978+0000","last_peered":"2023-08-17T17:51:57.745978+0000","last_clean":"2023-08-17T17:51:57.745978+0000","last_became_active":"2023-08-17T17:51:57.369020+0000","last_became_peered":"2023-08-17T17:51:57.369020+0000","last_unstale":"2023-08-17T17:51:57.745978+0000","last_undegraded":"2023-08-17T17:51:57.745978+0000","last_fullsized":"2023-08-17T17:51:57.745978+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740830+0000","last_change":"2023-08-17T17:51:57.732039+0000","last_active":"2023-08-17T17:51:57.740830+0000","last_peered":"2023-08-17T17:51:57.740830+0000","last_clean":"2023-08-17T17:51:57.740830+0000","last_became_active":"2023-08-17T17:51:57.731825+0000","last_became_peered":"2023-08-17T17:51:57.731825+0000","last_unstale":"2023-08-17T17:51:57.740830+0000","last_undegraded":"2023-08-17T17:51:57.740830+0000","last_fullsized":"2023-08-17T17:51:57.740830+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743513+0000","last_change":"2023-08-17T17:51:57.373060+0000","last_active":"2023-08-17T17:51:57.743513+0000","last_peered":"2023-08-17T17:51:57.743513+0000","last_clean":"2023-08-17T17:51:57.743513+0000","last_became_active":"2023-08-17T17:51:57.372812+0000","last_became_peered":"2023-08-17T17:51:57.372812+0000","last_unstale":"2023-08-17T17:51:57.743513+0000","last_undegraded":"2023-08-17T17:51:57.743513+0000","last_fullsized":"2023-08-17T17:51:57.743513+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744217+0000","last_change":"2023-08-17T17:51:57.736788+0000","last_active":"2023-08-17T17:51:57.744217+0000","last_peered":"2023-08-17T17:51:57.744217+0000","last_clean":"2023-08-17T17:51:57.744217+0000","last_became_active":"2023-08-17T17:51:57.736481+0000","last_became_peered":"2023-08-17T17:51:57.736481+0000","last_unstale":"2023-08-17T17:51:57.744217+0000","last_undegraded":"2023-08-17T17:51:57.744217+0000","last_fullsized":"2023-08-17T17:51:57.744217+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726694+0000","last_change":"2023-08-17T17:51:57.369233+0000","last_active":"2023-08-17T17:51:57.726694+0000","last_peered":"2023-08-17T17:51:57.726694+0000","last_clean":"2023-08-17T17:51:57.726694+0000","last_became_active":"2023-08-17T17:51:57.367183+0000","last_became_peered":"2023-08-17T17:51:57.367183+0000","last_unstale":"2023-08-17T17:51:57.726694+0000","last_undegraded":"2023-08-17T17:51:57.726694+0000","last_fullsized":"2023-08-17T17:51:57.726694+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.740028+0000","last_change":"2023-08-17T17:51:57.734659+0000","last_active":"2023-08-17T17:51:57.740028+0000","last_peered":"2023-08-17T17:51:57.740028+0000","last_clean":"2023-08-17T17:51:57.740028+0000","last_became_active":"2023-08-17T17:51:57.734449+0000","last_became_peered":"2023-08-17T17:51:57.734449+0000","last_unstale":"2023-08-17T17:51:57.740028+0000","last_undegraded":"2023-08-17T17:51:57.740028+0000","last_fullsized":"2023-08-17T17:51:57.740028+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.728431+0000","last_change":"2023-08-17T17:51:57.364648+0000","last_active":"2023-08-17T17:51:57.728431+0000","last_peered":"2023-08-17T17:51:57.728431+0000","last_clean":"2023-08-17T17:51:57.728431+0000","last_became_active":"2023-08-17T17:51:57.364131+0000","last_became_peered":"2023-08-17T17:51:57.364131+0000","last_unstale":"2023-08-17T17:51:57.728431+0000","last_undegraded":"2023-08-17T17:51:57.728431+0000","last_fullsized":"2023-08-17T17:51:57.728431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744340+0000","last_change":"2023-08-17T17:51:57.739387+0000","last_active":"2023-08-17T17:51:57.744340+0000","last_peered":"2023-08-17T17:51:57.744340+0000","last_clean":"2023-08-17T17:51:57.744340+0000","last_became_active":"2023-08-17T17:51:57.738937+0000","last_became_peered":"2023-08-17T17:51:57.738937+0000","last_unstale":"2023-08-17T17:51:57.744340+0000","last_undegraded":"2023-08-17T17:51:57.744340+0000","last_fullsized":"2023-08-17T17:51:57.744340+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.725562+0000","last_change":"2023-08-17T17:51:57.364149+0000","last_active":"2023-08-17T17:51:57.725562+0000","last_peered":"2023-08-17T17:51:57.725562+0000","last_clean":"2023-08-17T17:51:57.725562+0000","last_became_active":"2023-08-17T17:51:57.363929+0000","last_became_peered":"2023-08-17T17:51:57.363929+0000","last_unstale":"2023-08-17T17:51:57.725562+0000","last_undegraded":"2023-08-17T17:51:57.725562+0000","last_fullsized":"2023-08-17T17:51:57.725562+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737894+0000","last_change":"2023-08-17T17:51:57.733674+0000","last_active":"2023-08-17T17:51:57.737894+0000","last_peered":"2023-08-17T17:51:57.737894+0000","last_clean":"2023-08-17T17:51:57.737894+0000","last_became_active":"2023-08-17T17:51:57.733409+0000","last_became_peered":"2023-08-17T17:51:57.733409+0000","last_unstale":"2023-08-17T17:51:57.737894+0000","last_undegraded":"2023-08-17T17:51:57.737894+0000","last_fullsized":"2023-08-17T17:51:57.737894+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.725301+0000","last_change":"2023-08-17T17:51:57.365415+0000","last_active":"2023-08-17T17:51:57.725301+0000","last_peered":"2023-08-17T17:51:57.725301+0000","last_clean":"2023-08-17T17:51:57.725301+0000","last_became_active":"2023-08-17T17:51:57.363570+0000","last_became_peered":"2023-08-17T17:51:57.363570+0000","last_unstale":"2023-08-17T17:51:57.725301+0000","last_undegraded":"2023-08-17T17:51:57.725301+0000","last_fullsized":"2023-08-17T17:51:57.725301+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743047+0000","last_change":"2023-08-17T17:51:57.739996+0000","last_active":"2023-08-17T17:51:57.743047+0000","last_peered":"2023-08-17T17:51:57.743047+0000","last_clean":"2023-08-17T17:51:57.743047+0000","last_became_active":"2023-08-17T17:51:57.739754+0000","last_became_peered":"2023-08-17T17:51:57.739754+0000","last_unstale":"2023-08-17T17:51:57.743047+0000","last_undegraded":"2023-08-17T17:51:57.743047+0000","last_fullsized":"2023-08-17T17:51:57.743047+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721808+0000","last_change":"2023-08-17T17:51:57.369647+0000","last_active":"2023-08-17T17:51:57.721808+0000","last_peered":"2023-08-17T17:51:57.721808+0000","last_clean":"2023-08-17T17:51:57.721808+0000","last_became_active":"2023-08-17T17:51:57.368437+0000","last_became_peered":"2023-08-17T17:51:57.368437+0000","last_unstale":"2023-08-17T17:51:57.721808+0000","last_undegraded":"2023-08-17T17:51:57.721808+0000","last_fullsized":"2023-08-17T17:51:57.721808+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744405+0000","last_change":"2023-08-17T17:51:57.740487+0000","last_active":"2023-08-17T17:51:57.744405+0000","last_peered":"2023-08-17T17:51:57.744405+0000","last_clean":"2023-08-17T17:51:57.744405+0000","last_became_active":"2023-08-17T17:51:57.740203+0000","last_became_peered":"2023-08-17T17:51:57.740203+0000","last_unstale":"2023-08-17T17:51:57.744405+0000","last_undegraded":"2023-08-17T17:51:57.744405+0000","last_fullsized":"2023-08-17T17:51:57.744405+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726204+0000","last_change":"2023-08-17T17:51:57.365317+0000","last_active":"2023-08-17T17:51:57.726204+0000","last_peered":"2023-08-17T17:51:57.726204+0000","last_clean":"2023-08-17T17:51:57.726204+0000","last_became_active":"2023-08-17T17:51:57.365017+0000","last_became_peered":"2023-08-17T17:51:57.365017+0000","last_unstale":"2023-08-17T17:51:57.726204+0000","last_undegraded":"2023-08-17T17:51:57.726204+0000","last_fullsized":"2023-08-17T17:51:57.726204+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739608+0000","last_change":"2023-08-17T17:51:57.730321+0000","last_active":"2023-08-17T17:51:57.739608+0000","last_peered":"2023-08-17T17:51:57.739608+0000","last_clean":"2023-08-17T17:51:57.739608+0000","last_became_active":"2023-08-17T17:51:57.730025+0000","last_became_peered":"2023-08-17T17:51:57.730025+0000","last_unstale":"2023-08-17T17:51:57.739608+0000","last_undegraded":"2023-08-17T17:51:57.739608+0000","last_fullsized":"2023-08-17T17:51:57.739608+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721179+0000","last_change":"2023-08-17T17:51:57.368192+0000","last_active":"2023-08-17T17:51:57.721179+0000","last_peered":"2023-08-17T17:51:57.721179+0000","last_clean":"2023-08-17T17:51:57.721179+0000","last_became_active":"2023-08-17T17:51:57.367639+0000","last_became_peered":"2023-08-17T17:51:57.367639+0000","last_unstale":"2023-08-17T17:51:57.721179+0000","last_undegraded":"2023-08-17T17:51:57.721179+0000","last_fullsized":"2023-08-17T17:51:57.721179+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743380+0000","last_change":"2023-08-17T17:51:57.740702+0000","last_active":"2023-08-17T17:51:57.743380+0000","last_peered":"2023-08-17T17:51:57.743380+0000","last_clean":"2023-08-17T17:51:57.743380+0000","last_became_active":"2023-08-17T17:51:57.740459+0000","last_became_peered":"2023-08-17T17:51:57.740459+0000","last_unstale":"2023-08-17T17:51:57.743380+0000","last_undegraded":"2023-08-17T17:51:57.743380+0000","last_fullsized":"2023-08-17T17:51:57.743380+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726207+0000","last_change":"2023-08-17T17:51:57.364948+0000","last_active":"2023-08-17T17:51:57.726207+0000","last_peered":"2023-08-17T17:51:57.726207+0000","last_clean":"2023-08-17T17:51:57.726207+0000","last_became_active":"2023-08-17T17:51:57.363868+0000","last_became_peered":"2023-08-17T17:51:57.363868+0000","last_unstale":"2023-08-17T17:51:57.726207+0000","last_undegraded":"2023-08-17T17:51:57.726207+0000","last_fullsized":"2023-08-17T17:51:57.726207+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.725611+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:51:57.725611+0000","last_peered":"2023-08-17T17:51:57.725611+0000","last_clean":"2023-08-17T17:51:57.725611+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:51:57.725611+0000","last_undegraded":"2023-08-17T17:51:57.725611+0000","last_fullsized":"2023-08-17T17:51:57.725611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737764+0000","last_change":"2023-08-17T17:51:57.730431+0000","last_active":"2023-08-17T17:51:57.737764+0000","last_peered":"2023-08-17T17:51:57.737764+0000","last_clean":"2023-08-17T17:51:57.737764+0000","last_became_active":"2023-08-17T17:51:57.730024+0000","last_became_peered":"2023-08-17T17:51:57.730024+0000","last_unstale":"2023-08-17T17:51:57.737764+0000","last_undegraded":"2023-08-17T17:51:57.737764+0000","last_fullsized":"2023-08-17T17:51:57.737764+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744867+0000","last_change":"2023-08-17T17:51:57.367564+0000","last_active":"2023-08-17T17:51:57.744867+0000","last_peered":"2023-08-17T17:51:57.744867+0000","last_clean":"2023-08-17T17:51:57.744867+0000","last_became_active":"2023-08-17T17:51:57.367308+0000","last_became_peered":"2023-08-17T17:51:57.367308+0000","last_unstale":"2023-08-17T17:51:57.744867+0000","last_undegraded":"2023-08-17T17:51:57.744867+0000","last_fullsized":"2023-08-17T17:51:57.744867+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721389+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:51:57.721389+0000","last_peered":"2023-08-17T17:51:57.721389+0000","last_clean":"2023-08-17T17:51:57.721389+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:51:57.721389+0000","last_undegraded":"2023-08-17T17:51:57.721389+0000","last_fullsized":"2023-08-17T17:51:57.721389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.744078+0000","last_change":"2023-08-17T17:51:57.738130+0000","last_active":"2023-08-17T17:51:57.744078+0000","last_peered":"2023-08-17T17:51:57.744078+0000","last_clean":"2023-08-17T17:51:57.744078+0000","last_became_active":"2023-08-17T17:51:57.737864+0000","last_became_peered":"2023-08-17T17:51:57.737864+0000","last_unstale":"2023-08-17T17:51:57.744078+0000","last_undegraded":"2023-08-17T17:51:57.744078+0000","last_fullsized":"2023-08-17T17:51:57.744078+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721525+0000","last_change":"2023-08-17T17:51:57.361671+0000","last_active":"2023-08-17T17:51:57.721525+0000","last_peered":"2023-08-17T17:51:57.721525+0000","last_clean":"2023-08-17T17:51:57.721525+0000","last_became_active":"2023-08-17T17:51:57.361388+0000","last_became_peered":"2023-08-17T17:51:57.361388+0000","last_unstale":"2023-08-17T17:51:57.721525+0000","last_undegraded":"2023-08-17T17:51:57.721525+0000","last_fullsized":"2023-08-17T17:51:57.721525+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.720558+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:51:57.720558+0000","last_peered":"2023-08-17T17:51:57.720558+0000","last_clean":"2023-08-17T17:51:57.720558+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:51:57.720558+0000","last_undegraded":"2023-08-17T17:51:57.720558+0000","last_fullsized":"2023-08-17T17:51:57.720558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.739943+0000","last_change":"2023-08-17T17:51:57.730970+0000","last_active":"2023-08-17T17:51:57.739943+0000","last_peered":"2023-08-17T17:51:57.739943+0000","last_clean":"2023-08-17T17:51:57.739943+0000","last_became_active":"2023-08-17T17:51:57.730658+0000","last_became_peered":"2023-08-17T17:51:57.730658+0000","last_unstale":"2023-08-17T17:51:57.739943+0000","last_undegraded":"2023-08-17T17:51:57.739943+0000","last_fullsized":"2023-08-17T17:51:57.739943+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"120'2","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.737951+0000","last_change":"2023-08-17T17:51:57.364435+0000","last_active":"2023-08-17T17:51:57.737951+0000","last_peered":"2023-08-17T17:51:57.737951+0000","last_clean":"2023-08-17T17:51:57.737951+0000","last_became_active":"2023-08-17T17:51:57.364165+0000","last_became_peered":"2023-08-17T17:51:57.364165+0000","last_unstale":"2023-08-17T17:51:57.737951+0000","last_undegraded":"2023-08-17T17:51:57.737951+0000","last_fullsized":"2023-08-17T17:51:57.737951+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721754+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:51:57.721754+0000","last_peered":"2023-08-17T17:51:57.721754+0000","last_clean":"2023-08-17T17:51:57.721754+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:51:57.721754+0000","last_undegraded":"2023-08-17T17:51:57.721754+0000","last_fullsized":"2023-08-17T17:51:57.721754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":91,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731244+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:51:57.731244+0000","last_peered":"2023-08-17T17:51:57.731244+0000","last_clean":"2023-08-17T17:51:57.731244+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:51:57.731244+0000","last_undegraded":"2023-08-17T17:51:57.731244+0000","last_fullsized":"2023-08-17T17:51:57.731244+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.746315+0000","last_change":"2023-08-17T17:51:57.741097+0000","last_active":"2023-08-17T17:51:57.746315+0000","last_peered":"2023-08-17T17:51:57.746315+0000","last_clean":"2023-08-17T17:51:57.746315+0000","last_became_active":"2023-08-17T17:51:57.740819+0000","last_became_peered":"2023-08-17T17:51:57.740819+0000","last_unstale":"2023-08-17T17:51:57.746315+0000","last_undegraded":"2023-08-17T17:51:57.746315+0000","last_fullsized":"2023-08-17T17:51:57.746315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731669+0000","last_change":"2023-08-17T17:51:57.365865+0000","last_active":"2023-08-17T17:51:57.731669+0000","last_peered":"2023-08-17T17:51:57.731669+0000","last_clean":"2023-08-17T17:51:57.731669+0000","last_became_active":"2023-08-17T17:51:57.365333+0000","last_became_peered":"2023-08-17T17:51:57.365333+0000","last_unstale":"2023-08-17T17:51:57.731669+0000","last_undegraded":"2023-08-17T17:51:57.731669+0000","last_fullsized":"2023-08-17T17:51:57.731669+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.731332+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:51:57.731332+0000","last_peered":"2023-08-17T17:51:57.731332+0000","last_clean":"2023-08-17T17:51:57.731332+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:51:57.731332+0000","last_undegraded":"2023-08-17T17:51:57.731332+0000","last_fullsized":"2023-08-17T17:51:57.731332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741189+0000","last_change":"2023-08-17T17:51:57.738881+0000","last_active":"2023-08-17T17:51:57.741189+0000","last_peered":"2023-08-17T17:51:57.741189+0000","last_clean":"2023-08-17T17:51:57.741189+0000","last_became_active":"2023-08-17T17:51:57.738617+0000","last_became_peered":"2023-08-17T17:51:57.738617+0000","last_unstale":"2023-08-17T17:51:57.741189+0000","last_undegraded":"2023-08-17T17:51:57.741189+0000","last_fullsized":"2023-08-17T17:51:57.741189+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.721086+0000","last_change":"2023-08-17T17:51:57.364102+0000","last_active":"2023-08-17T17:51:57.721086+0000","last_peered":"2023-08-17T17:51:57.721086+0000","last_clean":"2023-08-17T17:51:57.721086+0000","last_became_active":"2023-08-17T17:51:57.363772+0000","last_became_peered":"2023-08-17T17:51:57.363772+0000","last_unstale":"2023-08-17T17:51:57.721086+0000","last_undegraded":"2023-08-17T17:51:57.721086+0000","last_fullsized":"2023-08-17T17:51:57.721086+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.732686+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:51:57.732686+0000","last_peered":"2023-08-17T17:51:57.732686+0000","last_clean":"2023-08-17T17:51:57.732686+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:51:57.732686+0000","last_undegraded":"2023-08-17T17:51:57.732686+0000","last_fullsized":"2023-08-17T17:51:57.732686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.745709+0000","last_change":"2023-08-17T17:51:57.741058+0000","last_active":"2023-08-17T17:51:57.745709+0000","last_peered":"2023-08-17T17:51:57.745709+0000","last_clean":"2023-08-17T17:51:57.745709+0000","last_became_active":"2023-08-17T17:51:57.740803+0000","last_became_peered":"2023-08-17T17:51:57.740803+0000","last_unstale":"2023-08-17T17:51:57.745709+0000","last_undegraded":"2023-08-17T17:51:57.745709+0000","last_fullsized":"2023-08-17T17:51:57.745709+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"120'1","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.741206+0000","last_change":"2023-08-17T17:51:57.369234+0000","last_active":"2023-08-17T17:51:57.741206+0000","last_peered":"2023-08-17T17:51:57.741206+0000","last_clean":"2023-08-17T17:51:57.741206+0000","last_became_active":"2023-08-17T17:51:57.368856+0000","last_became_peered":"2023-08-17T17:51:57.368856+0000","last_unstale":"2023-08-17T17:51:57.741206+0000","last_undegraded":"2023-08-17T17:51:57.741206+0000","last_fullsized":"2023-08-17T17:51:57.741206+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.726181+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:51:57.726181+0000","last_peered":"2023-08-17T17:51:57.726181+0000","last_clean":"2023-08-17T17:51:57.726181+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:51:57.726181+0000","last_undegraded":"2023-08-17T17:51:57.726181+0000","last_fullsized":"2023-08-17T17:51:57.726181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.743178+0000","last_change":"2023-08-17T17:51:57.738747+0000","last_active":"2023-08-17T17:51:57.743178+0000","last_peered":"2023-08-17T17:51:57.743178+0000","last_clean":"2023-08-17T17:51:57.743178+0000","last_became_active":"2023-08-17T17:51:57.738474+0000","last_became_peered":"2023-08-17T17:51:57.738474+0000","last_unstale":"2023-08-17T17:51:57.743178+0000","last_undegraded":"2023-08-17T17:51:57.743178+0000","last_fullsized":"2023-08-17T17:51:57.743178+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:57.339481+0000","last_clean_scrub_stamp":"2023-08-17T17:51:57.339481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.720925+0000","last_change":"2023-08-17T17:51:57.368741+0000","last_active":"2023-08-17T17:51:57.720925+0000","last_peered":"2023-08-17T17:51:57.720925+0000","last_clean":"2023-08-17T17:51:57.720925+0000","last_became_active":"2023-08-17T17:51:57.365350+0000","last_became_peered":"2023-08-17T17:51:57.365350+0000","last_unstale":"2023-08-17T17:51:57.720925+0000","last_undegraded":"2023-08-17T17:51:57.720925+0000","last_fullsized":"2023-08-17T17:51:57.720925+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:51:56.330431+0000","last_clean_scrub_stamp":"2023-08-17T17:51:56.330431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-08-17T17:51:57.729573+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:51:57.729573+0000","last_peered":"2023-08-17T17:51:57.729573+0000","last_clean":"2023-08-17T17:51:57.729573+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:51:57.729573+0000","last_undegraded":"2023-08-17T17:51:57.729573+0000","last_fullsized":"2023-08-17T17:51:57.729573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575059,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1499136,"data_stored":741841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68899999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.70499999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.70099999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.55600000000000005},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.69399999999999995,"5min":0.745,"15min":0.80000000000000004},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.79300000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.72199999999999998,"5min":1.23,"15min":1.23},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73199999999999998,"5min":0.81599999999999995,"15min":0.86099999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":0.69499999999999995,"15min":0.85499999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.77200000000000002},"last":0.433}]},{"osd":5,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.505},"min":{"1min":0.38300000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.34200000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.746,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":0.82799999999999996,"15min":0.90200000000000002},"last":0.38100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575059,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302664,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069176,"statfs":{"total":96636764160,"available":96326836224,"internally_reserved":0,"allocated":1507328,"data_stored":742417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.71899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.52300000000000002},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.58599999999999997},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.75,"5min":0.879,"15min":1.0609999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.373},"max":{"1min":0.71399999999999997,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.68200000000000005,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.502},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48599999999999999,"15min":0.47299999999999998},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60099999999999998,"5min":0.748,"15min":0.77300000000000002},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47799999999999998},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.85799999999999998,"15min":1.51},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:51:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.41199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67800000000000005,"5min":0.872,"15min":0.872},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575060,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":1511424,"data_stored":743301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33500000000000002,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.42699999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.36399999999999999,"15min":0.373},"min":{"1min":0.28499999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.55100000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34399999999999997,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.216,"15min":0.216},"max":{"1min":0.50800000000000001,"5min":0.52000000000000002,"15min":0.70799999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.66300000000000003},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.42799999999999999},"min":{"1min":0.28000000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58899999999999997,"5min":0.625,"15min":0.66600000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39100000000000001,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.495,"5min":0.59199999999999997,"15min":0.63300000000000001},"last":0.26800000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82999999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.42799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78000000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.46100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80600000000000005,"5min":1.2989999999999999,"15min":1.331},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.45300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80100000000000005,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76100000000000001,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81200000000000006,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.48399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78900000000000003,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.78200000000000003,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.44500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575059,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302664,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069176,"statfs":{"total":96636764160,"available":96326836224,"internally_reserved":0,"allocated":1507328,"data_stored":742485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.35499999999999998},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.45200000000000001,"5min":0.54000000000000004,"15min":0.61599999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.372,"15min":0.38600000000000001},"min":{"1min":0.27100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.216}]},{"osd":2,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.34599999999999997,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.38600000000000001,"15min":0.40799999999999997},"min":{"1min":0.26800000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.307}]},{"osd":3,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.40600000000000003},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.66200000000000003},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.28399999999999997,"15min":0.26200000000000001},"max":{"1min":0.54400000000000004,"5min":0.62,"15min":0.65700000000000003},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.623,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.442,"5min":0.435,"15min":0.432},"max":{"1min":0.85899999999999999,"5min":0.99199999999999999,"15min":1.3300000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.49099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.41799999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98199999999999998,"5min":1.677,"15min":1.677},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.88700000000000001,"5min":1.51,"15min":1.51},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.325,"15min":1.391},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.91100000000000003,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.67900000000000005},"min":{"1min":0.501,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0980000000000001,"15min":1.544},"last":0.60399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":741855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.34999999999999998},"min":{"1min":0.20300000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.51500000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.34999999999999998,"15min":0.372},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.24399999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39100000000000001,"15min":0.41599999999999998},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41199999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63,"5min":1.268,"15min":1.268},"last":0.318},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67200000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.46800000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73199999999999998,"5min":1.417,"15min":1.417},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.876,"5min":1.51,"15min":2.9220000000000002},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.443,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.544,"15min":1.544},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.63700000000000001},"min":{"1min":0.47199999999999998,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.93200000000000005,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85499999999999998,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":1.415,"15min":1.415},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91600000000000004,"5min":1.3859999999999999,"15min":2.984},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.48199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92400000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1495040,"data_stored":741751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48599999999999999,"5min":0.53100000000000003,"15min":0.56999999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36699999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.60599999999999998},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.25,"5min":0.214,"15min":0.214},"max":{"1min":0.63400000000000001,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.64200000000000002},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.39200000000000002},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.439,"15min":0.42699999999999999},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.372,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.75800000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85099999999999998,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83499999999999996,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.876,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.628},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":1.466,"15min":1.466},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.86499999999999999,"5min":1.48,"15min":1.48},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81100000000000005,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.53300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575060,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":742665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.26400000000000001},"max":{"1min":0.75900000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.71999999999999997,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.27800000000000002},"max":{"1min":0.79000000000000004,"5min":1.252,"15min":1.252},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70099999999999996,"5min":1.306,"15min":1.306},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.58999999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35599999999999998},"max":{"1min":0.80600000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":1.1160000000000001,"5min":1.444,"15min":1.444},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":1.482,"15min":1.482},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.74199999999999999,"5min":1.123,"15min":1.123},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.32900000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.78600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":1.002}]},{"osd":6,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.5,"15min":0.47999999999999998},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81999999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81000000000000005,"5min":1.048,"15min":1.048},"last":0.751}]},{"osd":7,"last update":"Thu Aug 17 17:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.41899999999999998,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":1.056},"last":0.89000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575058,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1499136,"data_stored":742305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":1.165,"15min":1.165},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75600000000000001,"5min":1.022,"15min":1.022},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.77500000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.71399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.78500000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.82099999999999995,"5min":1.153,"15min":1.153},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77300000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80600000000000005,"5min":1.036,"15min":1.036},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44900000000000001,"15min":0.44700000000000001},"min":{"1min":0.33700000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":0.747,"15min":0.75},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.59699999999999998,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.749},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.751}]},{"osd":7,"last update":"Thu Aug 17 17:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.874},"last":0.88500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:52:05.493 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T17:52:05.494 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T17:52:05.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.644+0000 7fbf05460700 1 Processor -- start 2023-08-17T17:52:05.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.644+0000 7fbf05460700 1 -- start start 2023-08-17T17:52:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.645+0000 7fbf05460700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf000c0f10 0x7fbf000c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.645+0000 7fbf05460700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf000c6970 con 0x7fbf00154110 2023-08-17T17:52:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.645+0000 7fbf05460700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf000cac90 con 0x7fbf000c7e10 2023-08-17T17:52:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.645+0000 7fbf05460700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000c6040 con 0x7fbf000c0f10 2023-08-17T17:52:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.645+0000 7fbefeffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbf00154110 0x7fbf000c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55686/0 (socket says 172.21.15.78:55686) 2023-08-17T17:52:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.645+0000 7fbefeffd700 1 -- 172.21.15.78:0/2670883064 learned_addr learned my addr 172.21.15.78:0/2670883064 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbef7fff700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf000c0f10 0x7fbf000c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763700543 0 0) 0x7fbf000c6970 con 0x7fbf00154110 2023-08-17T17:52:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeec0033f0 con 0x7fbf00154110 2023-08-17T17:52:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038448601 0 0) 0x7fbf000cac90 con 0x7fbf000c7e10 2023-08-17T17:52:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf000c6970 con 0x7fbf000c7e10 2023-08-17T17:52:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2484526460 0 0) 0x7fbeec0033f0 con 0x7fbf00154110 2023-08-17T17:52:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf000c0f10 msgr2=0x7fbf000c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf000c0f10 0x7fbf000c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 >> v1:172.21.15.150:6789/0 conn(0x7fbf000c7e10 legacy=0x7fbf000ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf000c6320 con 0x7fbf00154110 2023-08-17T17:52:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fbef0001470 con 0x7fbf00154110 2023-08-17T17:52:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbef7fff700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf000c0f10 0x7fbf000c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:52:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 >> v1:172.21.15.78:6789/0 conn(0x7fbf00154110 legacy=0x7fbf000c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeec003aa0 0x7fbeec003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf000c0f10 0x7fbeec004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeec004b80 0x7fbeec005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000c6040 con 0x7fbeec003aa0 2023-08-17T17:52:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec00b910 con 0x7fbeec004b80 2023-08-17T17:52:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec00bad0 con 0x7fbf000c0f10 2023-08-17T17:52:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefeffd700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeec003aa0 0x7fbeec003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbef7fff700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf000c0f10 0x7fbeec004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbeff7fe700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeec004b80 0x7fbeec005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefeffd700 1 -- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf000c0f10 msgr2=0x7fbeec004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:05.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefeffd700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf000c0f10 0x7fbeec004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefeffd700 1 -- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeec004b80 msgr2=0x7fbeec005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:05.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefeffd700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeec004b80 0x7fbeec005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbefeffd700 1 -- 172.21.15.78:0/2670883064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee80092a0 con 0x7fbeec003aa0 2023-08-17T17:52:05.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.646+0000 7fbeff7fe700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbeec004b80 0x7fbeec005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:05.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbefeffd700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeec003aa0 0x7fbeec003ea0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fbef0007f80 tx=0x7fbef0001d40).ready entity=mon.0 client_cookie=65d1ef905c47a04f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:05.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000c9e0 con 0x7fbeec003aa0 2023-08-17T17:52:05.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000cb40 con 0x7fbeec003aa0 2023-08-17T17:52:05.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbefe7fc700 1 -- 172.21.15.78:0/2670883064 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00070d0 con 0x7fbeec003aa0 2023-08-17T17:52:05.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbf05460700 1 -- 172.21.15.78:0/2670883064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeec003aa0 msgr2=0x7fbeec003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbf05460700 1 --2- 172.21.15.78:0/2670883064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbeec003aa0 0x7fbeec003ea0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fbef0007f80 tx=0x7fbef0001d40).stop 2023-08-17T17:52:05.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbeff7fe700 1 -- 172.21.15.78:0/2670883064 reap_dead start 2023-08-17T17:52:05.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbf05460700 1 -- 172.21.15.78:0/2670883064 shutdown_connections 2023-08-17T17:52:05.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbf05460700 1 -- 172.21.15.78:0/2670883064 >> 172.21.15.78:0/2670883064 conn(0x7fbf00094650 msgr2=0x7fbf0006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:05.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbf05460700 1 -- 172.21.15.78:0/2670883064 shutdown_connections 2023-08-17T17:52:05.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.647+0000 7fbf05460700 1 -- 172.21.15.78:0/2670883064 wait complete. 2023-08-17T17:52:05.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.648+0000 7fbf05460700 1 Processor -- start 2023-08-17T17:52:05.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.649+0000 7fbf05460700 1 -- start start 2023-08-17T17:52:05.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.649+0000 7fbf05460700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeec003aa0 0x7fbf000ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.649+0000 7fbf05460700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf00163f40 0x7fbf001643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.649+0000 7fbf05460700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf000c3b50 0x7fbf000c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.649+0000 7fbf05460700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0014f770 con 0x7fbf00163f40 2023-08-17T17:52:05.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.649+0000 7fbf05460700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000acd30 con 0x7fbf000c3b50 2023-08-17T17:52:05.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.649+0000 7fbf05460700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000c2420 con 0x7fbeec003aa0 2023-08-17T17:52:05.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.649+0000 7fbef7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf00163f40 0x7fbf001643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.649+0000 7fbef7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf00163f40 0x7fbf001643c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37562/0 (socket says 172.21.15.78:37562) 2023-08-17T17:52:05.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.649+0000 7fbef7fff700 1 -- 172.21.15.78:0/1160721442 learned_addr learned my addr 172.21.15.78:0/1160721442 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:05.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbefeffd700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeec003aa0 0x7fbf000ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbef7fff700 1 -- 172.21.15.78:0/1160721442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeec003aa0 msgr2=0x7fbf000ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbef7fff700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeec003aa0 0x7fbf000ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbeff7fe700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf000c3b50 0x7fbf000c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbef7fff700 1 -- 172.21.15.78:0/1160721442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf000c3b50 msgr2=0x7fbf000c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbef7fff700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf000c3b50 0x7fbf000c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbef7fff700 1 -- 172.21.15.78:0/1160721442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf000c2700 con 0x7fbf00163f40 2023-08-17T17:52:05.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbef7fff700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf00163f40 0x7fbf001643c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fbee8011b40 tx=0x7fbee8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:05.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbef6ffd700 1 -- 172.21.15.78:0/1160721442 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800fa70 con 0x7fbf00163f40 2023-08-17T17:52:05.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbef6ffd700 1 -- 172.21.15.78:0/1160721442 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee800fbd0 con 0x7fbf00163f40 2023-08-17T17:52:05.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbef6ffd700 1 -- 172.21.15.78:0/1160721442 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8014440 con 0x7fbf00163f40 2023-08-17T17:52:05.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbf05460700 1 -- 172.21.15.78:0/1160721442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf000c29e0 con 0x7fbf00163f40 2023-08-17T17:52:05.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.650+0000 7fbf05460700 1 -- 172.21.15.78:0/1160721442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf000c2fa0 con 0x7fbf00163f40 2023-08-17T17:52:05.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.651+0000 7fbf05460700 1 -- 172.21.15.78:0/1160721442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf00047350 con 0x7fbf00163f40 2023-08-17T17:52:05.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.651+0000 7fbef6ffd700 1 -- 172.21.15.78:0/1160721442 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbee8014870 con 0x7fbf00163f40 2023-08-17T17:52:05.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.652+0000 7fbef6ffd700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbee005edc0 0x7fbee0061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:05.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.652+0000 7fbef6ffd700 1 -- 172.21.15.78:0/1160721442 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbee807a3c0 con 0x7fbf00163f40 2023-08-17T17:52:05.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.652+0000 7fbefeffd700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbee005edc0 0x7fbee0061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:05.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.652+0000 7fbefeffd700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbee005edc0 0x7fbee0061280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbef00010e0 tx=0x7fbef0015000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:05.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.656+0000 7fbef6ffd700 1 -- 172.21.15.78:0/1160721442 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbee804b960 con 0x7fbf00163f40 2023-08-17T17:52:05.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.888+0000 7fbf05460700 1 -- 172.21.15.78:0/1160721442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbf000c31c0 con 0x7fbf00163f40 2023-08-17T17:52:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.891+0000 7fbef6ffd700 1 -- 172.21.15.78:0/1160721442 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbee804ef80 con 0x7fbf00163f40 2023-08-17T17:52:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 -- 172.21.15.78:0/1160721442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbee005edc0 msgr2=0x7fbee0061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbee005edc0 0x7fbee0061280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbef00010e0 tx=0x7fbef0015000).stop 2023-08-17T17:52:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 -- 172.21.15.78:0/1160721442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf00163f40 msgr2=0x7fbf001643c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf00163f40 0x7fbf001643c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fbee8011b40 tx=0x7fbee8009060).stop 2023-08-17T17:52:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 -- 172.21.15.78:0/1160721442 shutdown_connections 2023-08-17T17:52:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbee005edc0 0x7fbee0061280 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf000c3b50 0x7fbf000c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbeec003aa0 0x7fbf000ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 --2- 172.21.15.78:0/1160721442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf00163f40 0x7fbf001643c0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:05.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 -- 172.21.15.78:0/1160721442 >> 172.21.15.78:0/1160721442 conn(0x7fbf00094650 msgr2=0x7fbf000c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:05.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 -- 172.21.15.78:0/1160721442 shutdown_connections 2023-08-17T17:52:05.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:05.893+0000 7fbf05460700 1 -- 172.21.15.78:0/1160721442 wait complete. 2023-08-17T17:52:05.896 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-08-17T17:52:05.906 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:52:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.019+0000 7f0ed5a85700 1 Processor -- start 2023-08-17T17:52:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.019+0000 7f0ed5a85700 1 -- start start 2023-08-17T17:52:06.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.019+0000 7f0ed5a85700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0ed00bef00 0x7f0ed0064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.019+0000 7f0ed5a85700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed00c4040 con 0x7f0ed00a7fe0 2023-08-17T17:52:06.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.019+0000 7f0ed5a85700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed00c3430 con 0x7f0ed0065140 2023-08-17T17:52:06.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.019+0000 7f0ed5a85700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed00c3710 con 0x7f0ed00bef00 2023-08-17T17:52:06.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ecf7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0ed00a7fe0 0x7f0ed00be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55688/0 (socket says 172.21.15.78:55688) 2023-08-17T17:52:06.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ecf7fe700 1 -- 172.21.15.78:0/3556334353 learned_addr learned my addr 172.21.15.78:0/3556334353 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473824796 0 0) 0x7f0ed00c4040 con 0x7f0ed00a7fe0 2023-08-17T17:52:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb80033f0 con 0x7f0ed00a7fe0 2023-08-17T17:52:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0eceffd700 1 --2- 172.21.15.78:0/3556334353 >> v2:172.21.15.150:3300/0 conn(0x7f0ed00bef00 0x7f0ed0064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 425059513 0 0) 0x7f0eb80033f0 con 0x7f0ed00a7fe0 2023-08-17T17:52:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 >> v2:172.21.15.150:3300/0 conn(0x7f0ed00bef00 msgr2=0x7f0ed0064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 --2- 172.21.15.78:0/3556334353 >> v2:172.21.15.150:3300/0 conn(0x7f0ed00bef00 0x7f0ed0064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 >> v1:172.21.15.150:6789/0 conn(0x7f0ed0065140 legacy=0x7f0ed00c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00c39f0 con 0x7f0ed00a7fe0 2023-08-17T17:52:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f0ec00017f0 con 0x7f0ed00a7fe0 2023-08-17T17:52:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 >> v1:172.21.15.78:6789/0 conn(0x7f0ed00a7fe0 legacy=0x7f0ed00be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eb80038e0 0x7f0eb8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eb8004690 0x7f0eb8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8005000 0x7f0eb800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00c3710 con 0x7f0eb8005000 2023-08-17T17:52:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb800beb0 con 0x7f0eb8004690 2023-08-17T17:52:06.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb800c070 con 0x7f0eb80038e0 2023-08-17T17:52:06.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ecffff700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8005000 0x7f0eb800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0eceffd700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eb8004690 0x7f0eb8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.020+0000 7f0ecf7fe700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eb80038e0 0x7f0eb8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ecffff700 1 -- 172.21.15.78:0/3556334353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eb80038e0 msgr2=0x7f0eb8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ecffff700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eb80038e0 0x7f0eb8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ecffff700 1 -- 172.21.15.78:0/3556334353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eb8004690 msgr2=0x7f0eb8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ecffff700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eb8004690 0x7f0eb8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ecffff700 1 -- 172.21.15.78:0/3556334353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80033f0 con 0x7f0eb8005000 2023-08-17T17:52:06.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ecffff700 1 -- 172.21.15.78:0/3556334353 reap_dead start 2023-08-17T17:52:06.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ecffff700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8005000 0x7f0eb800b8e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f0ec8001730 tx=0x7f0ec8007bb0).ready entity=mon.0 client_cookie=97f951e582fc8445 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8007020 con 0x7f0eb8005000 2023-08-17T17:52:06.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec8007180 con 0x7f0eb8005000 2023-08-17T17:52:06.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ece7fc700 1 -- 172.21.15.78:0/3556334353 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8007520 con 0x7f0eb8005000 2023-08-17T17:52:06.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3556334353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8005000 msgr2=0x7f0eb800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ed5a85700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8005000 0x7f0eb800b8e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f0ec8001730 tx=0x7f0ec8007bb0).stop 2023-08-17T17:52:06.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3556334353 shutdown_connections 2023-08-17T17:52:06.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ed5a85700 1 --2- 172.21.15.78:0/3556334353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8005000 0x7f0eb800b8e0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3556334353 >> 172.21.15.78:0/3556334353 conn(0x7f0ed0092330 msgr2=0x7f0ed0062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:06.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3556334353 shutdown_connections 2023-08-17T17:52:06.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.021+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3556334353 wait complete. 2023-08-17T17:52:06.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.023+0000 7f0ed5a85700 1 Processor -- start 2023-08-17T17:52:06.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.023+0000 7f0ed5a85700 1 -- start start 2023-08-17T17:52:06.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.023+0000 7f0ed5a85700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eb8005000 0x7f0ed00ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.023+0000 7f0ed5a85700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed00a7580 0x7f0ed00669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.023+0000 7f0ed5a85700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ed00a7a00 0x7f0ed0066ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.023+0000 7f0ed5a85700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00673b0 con 0x7f0ed00a7580 2023-08-17T17:52:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.023+0000 7f0ed5a85700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed01558b0 con 0x7f0eb8005000 2023-08-17T17:52:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.023+0000 7f0ed5a85700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0154ca0 con 0x7f0ed00a7a00 2023-08-17T17:52:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eceffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed00a7580 0x7f0ed00669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eceffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed00a7580 0x7f0ed00669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37578/0 (socket says 172.21.15.78:37578) 2023-08-17T17:52:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eceffd700 1 -- 172.21.15.78:0/3311730920 learned_addr learned my addr 172.21.15.78:0/3311730920 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:06.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0ecffff700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ed00a7a00 0x7f0ed0066ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eceffd700 1 -- 172.21.15.78:0/3311730920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ed00a7a00 msgr2=0x7f0ed0066ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eceffd700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ed00a7a00 0x7f0ed0066ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0ecf7fe700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eb8005000 0x7f0ed00ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eceffd700 1 -- 172.21.15.78:0/3311730920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eb8005000 msgr2=0x7f0ed00ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eceffd700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eb8005000 0x7f0ed00ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eceffd700 1 -- 172.21.15.78:0/3311730920 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0154f80 con 0x7f0ed00a7580 2023-08-17T17:52:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eceffd700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed00a7580 0x7f0ed00669d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f0ec40119c0 tx=0x7f0ec4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eb77fe700 1 -- 172.21.15.78:0/3311730920 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400f730 con 0x7f0ed00a7580 2023-08-17T17:52:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eb77fe700 1 -- 172.21.15.78:0/3311730920 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec400f890 con 0x7f0ed00a7580 2023-08-17T17:52:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3311730920 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed0155260 con 0x7f0ed00a7580 2023-08-17T17:52:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0eb77fe700 1 -- 172.21.15.78:0/3311730920 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400fc10 con 0x7f0ed00a7580 2023-08-17T17:52:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.024+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3311730920 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed00aea00 con 0x7f0ed00a7580 2023-08-17T17:52:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.025+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3311730920 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed0047350 con 0x7f0ed00a7580 2023-08-17T17:52:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.025+0000 7f0eb77fe700 1 -- 172.21.15.78:0/3311730920 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0ec4024070 con 0x7f0ed00a7580 2023-08-17T17:52:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.026+0000 7f0eb77fe700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ebc05ed90 0x7f0ebc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.026+0000 7f0eb77fe700 1 -- 172.21.15.78:0/3311730920 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0ec407a4f0 con 0x7f0ed00a7580 2023-08-17T17:52:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.026+0000 7f0ecf7fe700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ebc05ed90 0x7f0ebc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.026+0000 7f0ecf7fe700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ebc05ed90 0x7f0ebc061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0ec00012e0 tx=0x7f0ec0009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.030+0000 7f0eb77fe700 1 -- 172.21.15.78:0/3311730920 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ec404ba90 con 0x7f0ed00a7580 2023-08-17T17:52:06.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.233+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3311730920 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ed00c3cd0 con 0x7f0ed00a7580 2023-08-17T17:52:06.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.233+0000 7f0eb77fe700 1 -- 172.21.15.78:0/3311730920 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f0ec404f0b0 con 0x7f0ed00a7580 2023-08-17T17:52:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:52:06.235 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2905752860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2905752860},{"type":"v1","addr":"172.21.15.150:6833","nonce":2905752860}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7620,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/652553934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":652553934},{"type":"v1","addr":"172.21.15.78:6836","nonce":652553934}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7623,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/728629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":728629628},{"type":"v1","addr":"172.21.15.78:6837","nonce":728629628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:51:57.714922+0000","modified":"2023-08-17T17:51:59.721521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7641":{"gid":7641,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3422834327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3422834327},{"type":"v1","addr":"172.21.15.150:6835","nonce":3422834327}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T17:52:06.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3311730920 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ebc05ed90 msgr2=0x7f0ebc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ebc05ed90 0x7f0ebc061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0ec00012e0 tx=0x7f0ec0009040).stop 2023-08-17T17:52:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3311730920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed00a7580 msgr2=0x7f0ed00669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed00a7580 0x7f0ed00669d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f0ec40119c0 tx=0x7f0ec4009060).stop 2023-08-17T17:52:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3311730920 shutdown_connections 2023-08-17T17:52:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0ebc05ed90 0x7f0ebc061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ed00a7a00 0x7f0ed0066ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eb8005000 0x7f0ed00ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 --2- 172.21.15.78:0/3311730920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed00a7580 0x7f0ed00669d0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3311730920 >> 172.21.15.78:0/3311730920 conn(0x7f0ed0092330 msgr2=0x7f0ed0152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:06.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3311730920 shutdown_connections 2023-08-17T17:52:06.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.235+0000 7f0ed5a85700 1 -- 172.21.15.78:0/3311730920 wait complete. 2023-08-17T17:52:06.238 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 43 2023-08-17T17:52:06.650 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T17:51:57.714922+0000', 'modified': '2023-08-17T17:51:59.721521+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7641}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7641': {'gid': 7641, 'name': 'd', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/3422834327', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 3422834327}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 3422834327}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T17:52:06.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T17:52:06.651 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-17T17:52:06.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.766+0000 7f35d24fc700 1 Processor -- start 2023-08-17T17:52:06.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.766+0000 7f35d24fc700 1 -- start start 2023-08-17T17:52:06.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.766+0000 7f35d24fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc153ea0 0x7f35cc154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.766+0000 7f35d24fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f35cc0a6bd0 0x7f35cc0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.766+0000 7f35d24fc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc069e90 con 0x7f35cc0624f0 2023-08-17T17:52:06.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.766+0000 7f35d24fc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35cc0c5460 con 0x7f35cc0a6bd0 2023-08-17T17:52:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.766+0000 7f35d24fc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc069280 con 0x7f35cc153ea0 2023-08-17T17:52:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35d0a99700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f35cc0624f0 0x7f35cc157dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55704/0 (socket says 172.21.15.78:55704) 2023-08-17T17:52:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35d0a99700 1 -- 172.21.15.78:0/81879747 learned_addr learned my addr 172.21.15.78:0/81879747 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/81879747 >> v2:172.21.15.150:3300/0 conn(0x7f35cc0a6bd0 0x7f35cc0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35cbfff700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc153ea0 0x7f35cc154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798450234 0 0) 0x7f35cc069e90 con 0x7f35cc0624f0 2023-08-17T17:52:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35b40033f0 con 0x7f35cc0624f0 2023-08-17T17:52:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 757611244 0 0) 0x7f35b40033f0 con 0x7f35cc0624f0 2023-08-17T17:52:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc153ea0 msgr2=0x7f35cc154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc153ea0 0x7f35cc154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 >> v2:172.21.15.150:3300/0 conn(0x7f35cc0a6bd0 msgr2=0x7f35cc0c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 --2- 172.21.15.78:0/81879747 >> v2:172.21.15.150:3300/0 conn(0x7f35cc0a6bd0 0x7f35cc0c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc069560 con 0x7f35cc0624f0 2023-08-17T17:52:06.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f35c40017f0 con 0x7f35cc0624f0 2023-08-17T17:52:06.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 >> v1:172.21.15.78:6789/0 conn(0x7f35cc0624f0 legacy=0x7f35cc157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b40038e0 0x7f35b4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35b4004690 0x7f35b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc153ea0 0x7f35b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0c5460 con 0x7f35b4004690 2023-08-17T17:52:06.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc069280 con 0x7f35b40038e0 2023-08-17T17:52:06.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b400b8e0 con 0x7f35cc153ea0 2023-08-17T17:52:06.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35b4004690 0x7f35b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35cbfff700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b40038e0 0x7f35b4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.767+0000 7f35d0a99700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc153ea0 0x7f35b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35cb7fe700 1 -- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc153ea0 msgr2=0x7f35b4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc153ea0 0x7f35b4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35cb7fe700 1 -- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b40038e0 msgr2=0x7f35b4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b40038e0 0x7f35b4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35cb7fe700 1 -- 172.21.15.78:0/81879747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40033f0 con 0x7f35b4004690 2023-08-17T17:52:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35d0a99700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc153ea0 0x7f35b4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35cbfff700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b40038e0 0x7f35b4003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35b4004690 0x7f35b4004b10 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f35cc0a76c0 tx=0x7f35c0009060).ready entity=mon.0 client_cookie=a996c0f3aa531c08 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0009e90 con 0x7f35b4004690 2023-08-17T17:52:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0009430 con 0x7f35b4004690 2023-08-17T17:52:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35caffd700 1 -- 172.21.15.78:0/81879747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c000e850 con 0x7f35b4004690 2023-08-17T17:52:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35d24fc700 1 -- 172.21.15.78:0/81879747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35b4004690 msgr2=0x7f35b4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35d24fc700 1 --2- 172.21.15.78:0/81879747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35b4004690 0x7f35b4004b10 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f35cc0a76c0 tx=0x7f35c0009060).stop 2023-08-17T17:52:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35d0a99700 1 -- 172.21.15.78:0/81879747 reap_dead start 2023-08-17T17:52:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35d24fc700 1 -- 172.21.15.78:0/81879747 shutdown_connections 2023-08-17T17:52:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35d24fc700 1 -- 172.21.15.78:0/81879747 >> 172.21.15.78:0/81879747 conn(0x7f35cc0c8680 msgr2=0x7f35cc0c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35d24fc700 1 -- 172.21.15.78:0/81879747 shutdown_connections 2023-08-17T17:52:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.768+0000 7f35d24fc700 1 -- 172.21.15.78:0/81879747 wait complete. 2023-08-17T17:52:06.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.770+0000 7f35d24fc700 1 Processor -- start 2023-08-17T17:52:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.770+0000 7f35d24fc700 1 -- start start 2023-08-17T17:52:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.770+0000 7f35d24fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b4004690 0x7f35cc13e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.770+0000 7f35d24fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35cc155170 0x7f35cc0a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.770+0000 7f35d24fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc1555f0 0x7f35cc0a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.770+0000 7f35d24fc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0a9770 con 0x7f35cc155170 2023-08-17T17:52:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.770+0000 7f35d24fc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc157af0 con 0x7f35b4004690 2023-08-17T17:52:06.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.770+0000 7f35d24fc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc154ce0 con 0x7f35cc1555f0 2023-08-17T17:52:06.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35cc155170 0x7f35cc0a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35cc155170 0x7f35cc0a8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37594/0 (socket says 172.21.15.78:37594) 2023-08-17T17:52:06.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35cb7fe700 1 -- 172.21.15.78:0/2270168508 learned_addr learned my addr 172.21.15.78:0/2270168508 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:06.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35d0a99700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc1555f0 0x7f35cc0a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35cb7fe700 1 -- 172.21.15.78:0/2270168508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc1555f0 msgr2=0x7f35cc0a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc1555f0 0x7f35cc0a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35cbfff700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b4004690 0x7f35cc13e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35cb7fe700 1 -- 172.21.15.78:0/2270168508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b4004690 msgr2=0x7f35cc13e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b4004690 0x7f35cc13e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35cb7fe700 1 -- 172.21.15.78:0/2270168508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc1543b0 con 0x7f35cc155170 2023-08-17T17:52:06.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35d0a99700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc1555f0 0x7f35cc0a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:52:06.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35cc155170 0x7f35cc0a8d90 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f35b4004480 tx=0x7f35c001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35b3fff700 1 -- 172.21.15.78:0/2270168508 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c001da00 con 0x7f35cc155170 2023-08-17T17:52:06.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35b3fff700 1 -- 172.21.15.78:0/2270168508 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c001db60 con 0x7f35cc155170 2023-08-17T17:52:06.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35d24fc700 1 -- 172.21.15.78:0/2270168508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc154690 con 0x7f35cc155170 2023-08-17T17:52:06.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35b3fff700 1 -- 172.21.15.78:0/2270168508 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c001b450 con 0x7f35cc155170 2023-08-17T17:52:06.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.771+0000 7f35d24fc700 1 -- 172.21.15.78:0/2270168508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc13ec40 con 0x7f35cc155170 2023-08-17T17:52:06.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.772+0000 7f35b3fff700 1 -- 172.21.15.78:0/2270168508 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f35c001b880 con 0x7f35cc155170 2023-08-17T17:52:06.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.773+0000 7f35b3fff700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35b805ed90 0x7f35b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.773+0000 7f35b3fff700 1 -- 172.21.15.78:0/2270168508 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f35c007b770 con 0x7f35cc155170 2023-08-17T17:52:06.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.773+0000 7f35cbfff700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35b805ed90 0x7f35b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.773+0000 7f35cbfff700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35b805ed90 0x7f35b8061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f35bc006d80 tx=0x7f35bc008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.775+0000 7f35e3e91b80 1 Processor -- start 2023-08-17T17:52:06.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.775+0000 7f35e3e91b80 1 -- start start 2023-08-17T17:52:06.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 0x5588bb90c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9548c0 0x5588bb906f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9073f0 0x5588bb907870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb8d1d00 con 0x5588bb9548c0 2023-08-17T17:52:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb848cb0 con 0x5588bb90bc20 2023-08-17T17:52:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588bb85dc90 con 0x5588bb9073f0 2023-08-17T17:52:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9548c0 0x5588bb906f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9548c0 0x5588bb906f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37610/0 (socket says 172.21.15.78:37610) 2023-08-17T17:52:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35cb7fe700 1 -- 172.21.15.78:0/1146786177 learned_addr learned my addr 172.21.15.78:0/1146786177 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35d0a99700 1 --2- 172.21.15.78:0/1146786177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9073f0 0x5588bb907870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35cbfff700 1 --2- 172.21.15.78:0/1146786177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 0x5588bb90c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35cb7fe700 1 -- 172.21.15.78:0/1146786177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9073f0 msgr2=0x5588bb907870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/1146786177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9073f0 0x5588bb907870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35cb7fe700 1 -- 172.21.15.78:0/1146786177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 msgr2=0x5588bb90c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/1146786177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 0x5588bb90c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35cb7fe700 1 -- 172.21.15.78:0/1146786177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588bb700310 con 0x5588bb9548c0 2023-08-17T17:52:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/1146786177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9548c0 0x5588bb906f00 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f35c0079de0 tx=0x7f35c0011000).ready entity=mon.0 client_cookie=1303edbd81cb066f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.776+0000 7f35b17fa700 1 -- 172.21.15.78:0/1146786177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00068b0 con 0x5588bb9548c0 2023-08-17T17:52:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35b17fa700 1 -- 172.21.15.78:0/1146786177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c00502d0 con 0x5588bb9548c0 2023-08-17T17:52:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35b17fa700 1 -- 172.21.15.78:0/1146786177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0050910 con 0x5588bb9548c0 2023-08-17T17:52:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35e3e91b80 1 -- 172.21.15.78:0/1146786177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9548c0 msgr2=0x5588bb906f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/1146786177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9548c0 0x5588bb906f00 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f35c0079de0 tx=0x7f35c0011000).stop 2023-08-17T17:52:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35e3e91b80 1 -- 172.21.15.78:0/1146786177 shutdown_connections 2023-08-17T17:52:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/1146786177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9073f0 0x5588bb907870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/1146786177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 0x5588bb90c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/1146786177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9548c0 0x5588bb906f00 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35e3e91b80 1 -- 172.21.15.78:0/1146786177 >> 172.21.15.78:0/1146786177 conn(0x5588bb6c8e40 msgr2=0x5588bb954d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35e3e91b80 1 -- 172.21.15.78:0/1146786177 shutdown_connections 2023-08-17T17:52:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.777+0000 7f35e3e91b80 1 -- 172.21.15.78:0/1146786177 wait complete. 2023-08-17T17:52:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.778+0000 7f35e3e91b80 1 -- start start 2023-08-17T17:52:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.778+0000 7f35e3e91b80 1 Processor -- start 2023-08-17T17:52:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 0x5588bb936de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb93a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb935800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb824ef0 con 0x5588bb90bc20 2023-08-17T17:52:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb8298d0 con 0x5588bb9073f0 2023-08-17T17:52:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588bb936410 con 0x5588bb9548c0 2023-08-17T17:52:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35e3e91b80 10 client.0 ll_register_callbacks cb 0x5588bb8cbce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:52:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb93a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb93a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37618/0 (socket says 172.21.15.78:37618) 2023-08-17T17:52:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cb7fe700 1 -- 172.21.15.78:0/2158844019 learned_addr learned my addr 172.21.15.78:0/2158844019 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cbfff700 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 0x5588bb936de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35d0a99700 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb935800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cb7fe700 1 -- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 msgr2=0x5588bb935800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb935800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cb7fe700 1 -- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 msgr2=0x5588bb936de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 0x5588bb936de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cb7fe700 1 -- 172.21.15.78:0/2158844019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc13ec40 con 0x5588bb90bc20 2023-08-17T17:52:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cbfff700 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 0x5588bb936de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb93a8d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f35c004ce70 tx=0x7f35c0030000).ready entity=mon.0 client_cookie=4d203ac0c962d2da server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:52:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35aa7fc700 1 -- 172.21.15.78:0/2158844019 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c004d080 con 0x5588bb90bc20 2023-08-17T17:52:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35e3e91b80 1 -- 172.21.15.78:0/2158844019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588bb9060f0 con 0x5588bb90bc20 2023-08-17T17:52:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35aa7fc700 1 -- 172.21.15.78:0/2158844019 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f35c004d1e0 con 0x5588bb90bc20 2023-08-17T17:52:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35aa7fc700 1 -- 172.21.15.78:0/2158844019 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35c004fe60 con 0x5588bb90bc20 2023-08-17T17:52:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35e3e91b80 10 client.7800 fetch_fsmap learned FSMap version 43 2023-08-17T17:52:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.779+0000 7f35e3e91b80 1 -- 172.21.15.78:0/2158844019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x5588bb856e70 con 0x5588bb90bc20 2023-08-17T17:52:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35aa7fc700 1 -- 172.21.15.78:0/2158844019 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588bb9060f0 con 0x5588bb90bc20 2023-08-17T17:52:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35aa7fc700 1 -- 172.21.15.78:0/2158844019 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f35c0042070 con 0x5588bb90bc20 2023-08-17T17:52:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35e3e91b80 10 client.7800 fetch_fsmap finished waiting for FSMap version 43 2023-08-17T17:52:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35e3e91b80 10 client.7800 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-17T17:52:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35e3e91b80 20 client.7800 populate_metadata read hostname 'smithi078' 2023-08-17T17:52:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:6834/3422834327,v1:172.21.15.150:6835/3422834327] conn(0x5588bb9381f0 0x5588bb94e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35e3e91b80 4 client.7800 mds_command: new command op to 7641 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T17:52:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35e3e91b80 1 -- 172.21.15.78:0/2158844019 --> [v2:172.21.15.150:6834/3422834327,v1:172.21.15.150:6835/3422834327] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588bb8d5b50 con 0x5588bb9381f0 2023-08-17T17:52:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35cbfff700 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:6834/3422834327,v1:172.21.15.150:6835/3422834327] conn(0x5588bb9381f0 0x5588bb94e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35aa7fc700 10 client.7800 ms_handle_connect on v2:172.21.15.150:6834/3422834327 2023-08-17T17:52:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.780+0000 7f35cbfff700 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:6834/3422834327,v1:172.21.15.150:6835/3422834327] conn(0x5588bb9381f0 0x5588bb94e300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=da28047489dc5770 server_cookie=bb92d0785920b9ed in_seq=0 out_seq=0 2023-08-17T17:52:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35aa7fc700 1 -- 172.21.15.78:0/2158844019 <== mds.0 v2:172.21.15.150:6834/3422834327 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5588bb8d5b50 con 0x5588bb9381f0 2023-08-17T17:52:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35aa7fc700 10 client.7800 handle_command_reply: tid=0 2023-08-17T17:52:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 client.7800 shutdown 2023-08-17T17:52:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 -- 172.21.15.78:0/2158844019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 msgr2=0x5588bb93a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb93a8d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f35c004ce70 tx=0x7f35c0030000).stop 2023-08-17T17:52:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 -- 172.21.15.78:0/2158844019 shutdown_connections 2023-08-17T17:52:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:6834/3422834327,v1:172.21.15.150:6835/3422834327] conn(0x5588bb9381f0 0x5588bb94e300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb935800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 0x5588bb936de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/2158844019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb93a8d0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35aa7fc700 0 client.7800 ms_handle_reset on v2:172.21.15.150:6834/3422834327 2023-08-17T17:52:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 -- 172.21.15.78:0/2158844019 >> 172.21.15.78:0/2158844019 conn(0x5588bb6c8e40 msgr2=0x5588bb909c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 -- 172.21.15.78:0/2158844019 shutdown_connections 2023-08-17T17:52:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 1 -- 172.21.15.78:0/2158844019 wait complete. 2023-08-17T17:52:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.781+0000 7f35e3e91b80 20 client.7800 trim_cache size 0 max 16384 2023-08-17T17:52:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.797+0000 7f35e3e91b80 1 Processor -- start 2023-08-17T17:52:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.797+0000 7f35e3e91b80 1 -- start start 2023-08-17T17:52:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.798+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 0x5588bb94c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.798+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb9068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.798+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb906de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.798+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb90ca90 con 0x5588bb90bc20 2023-08-17T17:52:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.798+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb936ec0 con 0x5588bb9073f0 2023-08-17T17:52:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.798+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588bb93adf0 con 0x5588bb9548c0 2023-08-17T17:52:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.798+0000 7f35cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb9068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.798+0000 7f35cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb9068f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37620/0 (socket says 172.21.15.78:37620) 2023-08-17T17:52:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.798+0000 7f35cb7fe700 1 -- 172.21.15.78:0/4271908077 learned_addr learned my addr 172.21.15.78:0/4271908077 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35d0a99700 1 --2- 172.21.15.78:0/4271908077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb906de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35cbfff700 1 --2- 172.21.15.78:0/4271908077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 0x5588bb94c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35cb7fe700 1 -- 172.21.15.78:0/4271908077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 msgr2=0x5588bb906de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/4271908077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb906de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35cb7fe700 1 -- 172.21.15.78:0/4271908077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 msgr2=0x5588bb94c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/4271908077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 0x5588bb94c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35cb7fe700 1 -- 172.21.15.78:0/4271908077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588bb852480 con 0x5588bb90bc20 2023-08-17T17:52:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/4271908077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb9068f0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f35c0009840 tx=0x7f35c0038000).ready entity=mon.0 client_cookie=c3634c9e4aec5894 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35b1ffb700 1 -- 172.21.15.78:0/4271908077 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0024df0 con 0x5588bb90bc20 2023-08-17T17:52:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35b1ffb700 1 -- 172.21.15.78:0/4271908077 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c004fe60 con 0x5588bb90bc20 2023-08-17T17:52:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35b1ffb700 1 -- 172.21.15.78:0/4271908077 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0050ba0 con 0x5588bb90bc20 2023-08-17T17:52:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35e3e91b80 1 -- 172.21.15.78:0/4271908077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 msgr2=0x5588bb9068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/4271908077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb9068f0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f35c0009840 tx=0x7f35c0038000).stop 2023-08-17T17:52:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35e3e91b80 1 -- 172.21.15.78:0/4271908077 shutdown_connections 2023-08-17T17:52:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/4271908077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb906de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/4271908077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb9073f0 0x5588bb94c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/4271908077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb90bc20 0x5588bb9068f0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.799+0000 7f35e3e91b80 1 -- 172.21.15.78:0/4271908077 >> 172.21.15.78:0/4271908077 conn(0x5588bb6c8e40 msgr2=0x5588bb954cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.800+0000 7f35e3e91b80 1 -- 172.21.15.78:0/4271908077 shutdown_connections 2023-08-17T17:52:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.800+0000 7f35e3e91b80 1 -- 172.21.15.78:0/4271908077 wait complete. 2023-08-17T17:52:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.800+0000 7f35e3e91b80 1 -- start start 2023-08-17T17:52:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.800+0000 7f35e3e91b80 1 Processor -- start 2023-08-17T17:52:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9073f0 0x5588bb9351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 0x5588bb9099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35e3e91b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb909eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb94e5e0 con 0x5588bb9073f0 2023-08-17T17:52:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb90a3a0 con 0x5588bb90bc20 2023-08-17T17:52:06.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35e3e91b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588bb9b5fd0 con 0x5588bb9548c0 2023-08-17T17:52:06.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35e3e91b80 10 client.0 ll_register_callbacks cb 0x5588bb8cbce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:52:06.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9073f0 0x5588bb9351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9073f0 0x5588bb9351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37630/0 (socket says 172.21.15.78:37630) 2023-08-17T17:52:06.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cbfff700 1 -- 172.21.15.78:0/3478735737 learned_addr learned my addr 172.21.15.78:0/3478735737 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:06.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35d0a99700 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb909eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 0x5588bb9099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cbfff700 1 -- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 msgr2=0x5588bb909eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cbfff700 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb909eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cbfff700 1 -- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 msgr2=0x5588bb9099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cbfff700 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 0x5588bb9099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cbfff700 1 -- 172.21.15.78:0/3478735737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588bb856e70 con 0x5588bb9073f0 2023-08-17T17:52:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 0x5588bb9099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35cbfff700 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9073f0 0x5588bb9351a0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f35bc009480 tx=0x7f35bc024040).ready entity=mon.0 client_cookie=6259fd4cfaa34c63 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.801+0000 7f35aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:52:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35aa7fc700 1 -- 172.21.15.78:0/3478735737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc027030 con 0x5588bb9073f0 2023-08-17T17:52:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35aa7fc700 1 -- 172.21.15.78:0/3478735737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f35bc022610 con 0x5588bb9073f0 2023-08-17T17:52:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35e3e91b80 1 -- 172.21.15.78:0/3478735737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588bb960130 con 0x5588bb9073f0 2023-08-17T17:52:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35aa7fc700 1 -- 172.21.15.78:0/3478735737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35bc0229e0 con 0x5588bb9073f0 2023-08-17T17:52:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35e3e91b80 10 client.7806 fetch_fsmap learned FSMap version 43 2023-08-17T17:52:06.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35e3e91b80 1 -- 172.21.15.78:0/3478735737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x5588bb8521d0 con 0x5588bb9073f0 2023-08-17T17:52:06.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35aa7fc700 1 -- 172.21.15.78:0/3478735737 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588bb960130 con 0x5588bb9073f0 2023-08-17T17:52:06.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35aa7fc700 1 -- 172.21.15.78:0/3478735737 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f35bc022b40 con 0x5588bb9073f0 2023-08-17T17:52:06.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35e3e91b80 10 client.7806 fetch_fsmap finished waiting for FSMap version 43 2023-08-17T17:52:06.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35e3e91b80 10 client.7806 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-17T17:52:06.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35e3e91b80 20 client.7806 populate_metadata read hostname 'smithi078' 2023-08-17T17:52:06.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:6834/3422834327,v1:172.21.15.150:6835/3422834327] conn(0x5588bb969e00 0x5588bb96a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35e3e91b80 4 client.7806 mds_command: new command op to 7641 tid=0[{"prefix": "status"}] 2023-08-17T17:52:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35e3e91b80 1 -- 172.21.15.78:0/3478735737 --> [v2:172.21.15.150:6834/3422834327,v1:172.21.15.150:6835/3422834327] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f35c00502d0 con 0x5588bb969e00 2023-08-17T17:52:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.802+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:6834/3422834327,v1:172.21.15.150:6835/3422834327] conn(0x5588bb969e00 0x5588bb96a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35aa7fc700 10 client.7806 ms_handle_connect on v2:172.21.15.150:6834/3422834327 2023-08-17T17:52:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35cb7fe700 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:6834/3422834327,v1:172.21.15.150:6835/3422834327] conn(0x5588bb969e00 0x5588bb96a1e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=12d153760e37d710 server_cookie=2a4125170cd02c4a in_seq=0 out_seq=0 2023-08-17T17:52:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35aa7fc700 1 -- 172.21.15.78:0/3478735737 <== mds.0 v2:172.21.15.150:6834/3422834327 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f35c00502d0 con 0x5588bb969e00 2023-08-17T17:52:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35aa7fc700 10 client.7806 handle_command_reply: tid=0 2023-08-17T17:52:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 client.7806 shutdown 2023-08-17T17:52:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 -- 172.21.15.78:0/3478735737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9073f0 msgr2=0x5588bb9351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9073f0 0x5588bb9351a0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f35bc009480 tx=0x7f35bc024040).stop 2023-08-17T17:52:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 -- 172.21.15.78:0/3478735737 shutdown_connections 2023-08-17T17:52:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:6834/3422834327,v1:172.21.15.150:6835/3422834327] conn(0x5588bb969e00 0x5588bb96a1e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5588bb9548c0 0x5588bb909eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588bb9073f0 0x5588bb9351a0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 --2- 172.21.15.78:0/3478735737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5588bb90bc20 0x5588bb9099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35aa7fc700 0 client.7806 ms_handle_reset on v2:172.21.15.150:6834/3422834327 2023-08-17T17:52:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 -- 172.21.15.78:0/3478735737 >> 172.21.15.78:0/3478735737 conn(0x5588bb6c8e40 msgr2=0x5588bb908c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 -- 172.21.15.78:0/3478735737 shutdown_connections 2023-08-17T17:52:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 1 -- 172.21.15.78:0/3478735737 wait complete. 2023-08-17T17:52:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35e3e91b80 20 client.7806 trim_cache size 0 max 16384 2023-08-17T17:52:06.859 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:52:06.859 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T17:52:06.859 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T17:52:06.859 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 7641, 2023-08-17T17:52:06.859 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T17:52:06.859 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T17:52:06.859 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T17:52:06.860 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 9.0875220300000006, 2023-08-17T17:52:06.860 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 43, 2023-08-17T17:52:06.860 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 121, 2023-08-17T17:52:06.860 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 121, 2023-08-17T17:52:06.860 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 13.581616677 2023-08-17T17:52:06.860 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:52:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35d24fc700 1 -- 172.21.15.78:0/2270168508 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35b805ed90 msgr2=0x7f35b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35d24fc700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35b805ed90 0x7f35b8061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f35bc006d80 tx=0x7f35bc008040).stop 2023-08-17T17:52:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35d24fc700 1 -- 172.21.15.78:0/2270168508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35cc155170 msgr2=0x7f35cc0a8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35d24fc700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35cc155170 0x7f35cc0a8d90 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f35b4004480 tx=0x7f35c001a000).stop 2023-08-17T17:52:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35d24fc700 1 -- 172.21.15.78:0/2270168508 shutdown_connections 2023-08-17T17:52:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35d24fc700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35b805ed90 0x7f35b8061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35d24fc700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc1555f0 0x7f35cc0a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35d24fc700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35b4004690 0x7f35cc13e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.803+0000 7f35d24fc700 1 --2- 172.21.15.78:0/2270168508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35cc155170 0x7f35cc0a8d90 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.804+0000 7f35d24fc700 1 -- 172.21.15.78:0/2270168508 >> 172.21.15.78:0/2270168508 conn(0x7f35cc0c8680 msgr2=0x7f35cc063cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.804+0000 7f35d24fc700 1 -- 172.21.15.78:0/2270168508 shutdown_connections 2023-08-17T17:52:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.804+0000 7f35d24fc700 1 -- 172.21.15.78:0/2270168508 wait complete. 2023-08-17T17:52:06.864 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T17:52:06.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.962+0000 7f4f0709f700 1 Processor -- start 2023-08-17T17:52:06.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.962+0000 7f4f0709f700 1 -- start start 2023-08-17T17:52:06.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.963+0000 7f4f0709f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4f000c8290 0x7f4f000c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.963+0000 7f4f0709f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f000c8670 con 0x7f4f000c09f0 2023-08-17T17:52:06.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.963+0000 7f4f0709f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f000c5f50 con 0x7f4f00154dc0 2023-08-17T17:52:06.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.963+0000 7f4f0709f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f001552f0 con 0x7f4f000c8290 2023-08-17T17:52:06.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.963+0000 7f4efffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4f000c09f0 0x7f4f001546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55714/0 (socket says 172.21.15.78:55714) 2023-08-17T17:52:06.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.963+0000 7f4efffff700 1 -- 172.21.15.78:0/3352204497 learned_addr learned my addr 172.21.15.78:0/3352204497 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:06.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.963+0000 7f4f04e3b700 1 --2- 172.21.15.78:0/3352204497 >> v2:172.21.15.150:3300/0 conn(0x7f4f000c8290 0x7f4f000c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175911385 0 0) 0x7f4f000c8670 con 0x7f4f000c09f0 2023-08-17T17:52:06.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef00033f0 con 0x7f4f000c09f0 2023-08-17T17:52:06.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 443765075 0 0) 0x7f4ef00033f0 con 0x7f4f000c09f0 2023-08-17T17:52:06.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 >> v2:172.21.15.150:3300/0 conn(0x7f4f000c8290 msgr2=0x7f4f000c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 --2- 172.21.15.78:0/3352204497 >> v2:172.21.15.150:3300/0 conn(0x7f4f000c8290 0x7f4f000c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 >> v1:172.21.15.150:6789/0 conn(0x7f4f00154dc0 legacy=0x7f4f000c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f001555d0 con 0x7f4f000c09f0 2023-08-17T17:52:06.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f4eec001470 con 0x7f4f000c09f0 2023-08-17T17:52:06.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4f04e3b700 1 --2- 172.21.15.78:0/3352204497 >> v2:172.21.15.150:3300/0 conn(0x7f4f000c8290 0x7f4f000c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:52:06.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 >> v1:172.21.15.78:6789/0 conn(0x7f4f000c09f0 legacy=0x7f4f001546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef00038e0 0x7f4ef0003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef0004690 0x7f4ef0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ef0005070 0x7f4ef000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f001552f0 con 0x7f4ef0005070 2023-08-17T17:52:06.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef000c010 con 0x7f4ef00038e0 2023-08-17T17:52:06.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef000c1d0 con 0x7f4ef0004690 2023-08-17T17:52:06.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4f0563c700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ef0005070 0x7f4ef000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4f04e3b700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef00038e0 0x7f4ef0003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4efffff700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef0004690 0x7f4ef0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4f0563c700 1 -- 172.21.15.78:0/3352204497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef0004690 msgr2=0x7f4ef0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4f0563c700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef0004690 0x7f4ef0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4f0563c700 1 -- 172.21.15.78:0/3352204497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef00038e0 msgr2=0x7f4ef0003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:06.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4f0563c700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef00038e0 0x7f4ef0003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4f0563c700 1 -- 172.21.15.78:0/3352204497 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00033f0 con 0x7f4ef0005070 2023-08-17T17:52:06.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4efffff700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef0004690 0x7f4ef0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:06.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4f0563c700 1 -- 172.21.15.78:0/3352204497 reap_dead start 2023-08-17T17:52:06.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4f0563c700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ef0005070 0x7f4ef000b8e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f4ef8001e30 tx=0x7f4ef8007f30).ready entity=mon.0 client_cookie=b0684d7c5dcfdda1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8006a20 con 0x7f4ef0005070 2023-08-17T17:52:06.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef8006b80 con 0x7f4ef0005070 2023-08-17T17:52:06.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.964+0000 7f4eff7fe700 1 -- 172.21.15.78:0/3352204497 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800c5d0 con 0x7f4ef0005070 2023-08-17T17:52:06.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.965+0000 7f4f0709f700 1 -- 172.21.15.78:0/3352204497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ef0005070 msgr2=0x7f4ef000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.965+0000 7f4f0709f700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ef0005070 0x7f4ef000b8e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f4ef8001e30 tx=0x7f4ef8007f30).stop 2023-08-17T17:52:06.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.965+0000 7f4f0709f700 1 -- 172.21.15.78:0/3352204497 shutdown_connections 2023-08-17T17:52:06.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.965+0000 7f4f0709f700 1 --2- 172.21.15.78:0/3352204497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ef0005070 0x7f4ef000b8e0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.965+0000 7f4f0709f700 1 -- 172.21.15.78:0/3352204497 >> 172.21.15.78:0/3352204497 conn(0x7f4f00084df0 msgr2=0x7f4f00094710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:06.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.965+0000 7f4f0709f700 1 -- 172.21.15.78:0/3352204497 shutdown_connections 2023-08-17T17:52:06.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.965+0000 7f4f0709f700 1 -- 172.21.15.78:0/3352204497 wait complete. 2023-08-17T17:52:06.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.966+0000 7f4f0709f700 1 Processor -- start 2023-08-17T17:52:06.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.966+0000 7f4f0709f700 1 -- start start 2023-08-17T17:52:06.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0709f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef0005070 0x7f4f000b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0709f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f000ace50 0x7f4f000b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0709f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f000cb010 0x7f4f000cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0709f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0013f350 con 0x7f4f000cb010 2023-08-17T17:52:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0709f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000cb980 con 0x7f4ef0005070 2023-08-17T17:52:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0709f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000ad5c0 con 0x7f4f000ace50 2023-08-17T17:52:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0563c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f000cb010 0x7f4f000cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0563c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f000cb010 0x7f4f000cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37654/0 (socket says 172.21.15.78:37654) 2023-08-17T17:52:06.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0563c700 1 -- 172.21.15.78:0/2959167278 learned_addr learned my addr 172.21.15.78:0/2959167278 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4efffff700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f000ace50 0x7f4f000b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f04e3b700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef0005070 0x7f4f000b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0563c700 1 -- 172.21.15.78:0/2959167278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f000ace50 msgr2=0x7f4f000b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0563c700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f000ace50 0x7f4f000b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0563c700 1 -- 172.21.15.78:0/2959167278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef0005070 msgr2=0x7f4f000b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:06.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0563c700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef0005070 0x7f4f000b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:06.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0563c700 1 -- 172.21.15.78:0/2959167278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f000ad8a0 con 0x7f4f000cb010 2023-08-17T17:52:06.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.967+0000 7f4f0563c700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f000cb010 0x7f4f000cb490 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f4ef8009000 tx=0x7f4ef8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.968+0000 7f4efcff9700 1 -- 172.21.15.78:0/2959167278 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8006a20 con 0x7f4f000cb010 2023-08-17T17:52:06.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.968+0000 7f4efcff9700 1 -- 172.21.15.78:0/2959167278 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800c5d0 con 0x7f4f000cb010 2023-08-17T17:52:06.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.968+0000 7f4f0709f700 1 -- 172.21.15.78:0/2959167278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f000ae140 con 0x7f4f000cb010 2023-08-17T17:52:06.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.968+0000 7f4efcff9700 1 -- 172.21.15.78:0/2959167278 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8013d00 con 0x7f4f000cb010 2023-08-17T17:52:06.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.968+0000 7f4f0709f700 1 -- 172.21.15.78:0/2959167278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f000ad2d0 con 0x7f4f000cb010 2023-08-17T17:52:06.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.968+0000 7f4f0709f700 1 -- 172.21.15.78:0/2959167278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f000adae0 con 0x7f4f000cb010 2023-08-17T17:52:06.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.969+0000 7f4efcff9700 1 -- 172.21.15.78:0/2959167278 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4ef8025030 con 0x7f4f000cb010 2023-08-17T17:52:06.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.969+0000 7f4efcff9700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ee405edc0 0x7f4ee4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:06.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.969+0000 7f4efcff9700 1 -- 172.21.15.78:0/2959167278 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4ef807acb0 con 0x7f4f000cb010 2023-08-17T17:52:06.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.969+0000 7f4f04e3b700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ee405edc0 0x7f4ee4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:06.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.970+0000 7f4f04e3b700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ee405edc0 0x7f4ee4061280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4ef4006d80 tx=0x7f4ef4009060).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:06.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:06.973+0000 7f4efcff9700 1 -- 172.21.15.78:0/2959167278 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ef804c300 con 0x7f4f000cb010 2023-08-17T17:52:07.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.176+0000 7f4f0709f700 1 -- 172.21.15.78:0/2959167278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4f00047350 con 0x7f4f000cb010 2023-08-17T17:52:07.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.176+0000 7f4efcff9700 1 -- 172.21.15.78:0/2959167278 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4ef8023030 con 0x7f4f000cb010 2023-08-17T17:52:07.178 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:52:07.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 -- 172.21.15.78:0/2959167278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ee405edc0 msgr2=0x7f4ee4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:07.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ee405edc0 0x7f4ee4061280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4ef4006d80 tx=0x7f4ef4009060).stop 2023-08-17T17:52:07.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 -- 172.21.15.78:0/2959167278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f000cb010 msgr2=0x7f4f000cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:07.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f000cb010 0x7f4f000cb490 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f4ef8009000 tx=0x7f4ef8016000).stop 2023-08-17T17:52:07.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 -- 172.21.15.78:0/2959167278 shutdown_connections 2023-08-17T17:52:07.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4ee405edc0 0x7f4ee4061280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:07.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f000cb010 0x7f4f000cb490 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef0005070 0x7f4f000b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 --2- 172.21.15.78:0/2959167278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f000ace50 0x7f4f000b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 -- 172.21.15.78:0/2959167278 >> 172.21.15.78:0/2959167278 conn(0x7f4f00084df0 msgr2=0x7f4f000c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 -- 172.21.15.78:0/2959167278 shutdown_connections 2023-08-17T17:52:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.178+0000 7f4f0709f700 1 -- 172.21.15.78:0/2959167278 wait complete. 2023-08-17T17:52:07.190 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T17:52:07.190 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:52:07.191 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T17:52:07.191 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T17:52:07.191 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T17:52:07.191 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T17:52:07.192 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T17:52:07.192 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:52:07.192 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:52:07.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:52:07.193 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T17:52:07.208 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:52:07.208 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:52:07.208 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:52:07.208 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:52:07.208 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:52:07.209 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:52:07.209 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:52:07.209 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:52:07.209 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T17:52:07.209 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:52:07.209 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:52:07.210 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T17:52:07.210 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:52:07.210 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:52:07.210 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:52:07.210 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:52:07.210 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:52:07.210 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 41152sec preferred_lft 41152sec 2023-08-17T17:52:07.211 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T17:52:07.211 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:52:07.211 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:52:07.211 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:52:07.211 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T17:52:07.211 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:52:07.211 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T17:52:07.211 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:52:07.212 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:52:07.212 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T17:52:07.212 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link 2023-08-17T17:52:07.212 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:52:07.212 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:52:07.212 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T17:52:07.212 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::54:39ff:fe93:1c36/64 scope link 2023-08-17T17:52:07.213 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:52:07.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:52:07.213 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:52:07.270 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T17:52:07.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:52:07.272 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T17:52:07.326 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T17:52:07.326 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:52:07.327 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:52:07.327 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:52:07.327 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:52:07.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:52:07.328 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:52:07.328 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:52:07.328 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:52:07.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:52:07.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:52:07.329 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:52:07.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:52:07.426 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:52:07.440 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T17:52:07.440 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T17:52:07.440 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:52:07.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:52:07.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T17:52:07.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:52:07.504 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T17:52:07.558 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:52:07.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:52:07.636 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:52:07.636 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:52:07.660 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:52:07.661 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:52:07.663 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:52:07.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:52:07.663 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T17:52:07.728 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-17T17:52:07.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.881+0000 7fd3fd5ac700 1 Processor -- start 2023-08-17T17:52:07.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.881+0000 7fd3fd5ac700 1 -- start start 2023-08-17T17:52:07.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.881+0000 7fd3fd5ac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd3f81541a0 0x7fd3f80a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:07.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.881+0000 7fd3fd5ac700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd3f80c0560 0x7fd3f80c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:07.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.881+0000 7fd3fd5ac700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f80c8df0 con 0x7fd3f8154580 2023-08-17T17:52:07.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.881+0000 7fd3fd5ac700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f80a8190 con 0x7fd3f80c0560 2023-08-17T17:52:07.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.881+0000 7fd3fd5ac700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f80c9970 con 0x7fd3f81541a0 2023-08-17T17:52:07.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd3f80c0560 0x7fd3f80c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:07.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3ee7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd3f8154580 0x7fd3f80bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55726/0 (socket says 172.21.15.78:55726) 2023-08-17T17:52:07.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3ee7fc700 1 -- 172.21.15.78:0/3737654569 learned_addr learned my addr 172.21.15.78:0/3737654569 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:07.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f6ffd700 1 --2- 172.21.15.78:0/3737654569 >> v2:172.21.15.150:3300/0 conn(0x7fd3f81541a0 0x7fd3f80a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:07.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f77fe700 1 -- 172.21.15.78:0/3737654569 >> v2:172.21.15.150:3300/0 conn(0x7fd3f81541a0 msgr2=0x7fd3f80a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:07.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f77fe700 1 --2- 172.21.15.78:0/3737654569 >> v2:172.21.15.150:3300/0 conn(0x7fd3f81541a0 0x7fd3f80a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:07.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f77fe700 1 -- 172.21.15.78:0/3737654569 >> v1:172.21.15.78:6789/0 conn(0x7fd3f8154580 legacy=0x7fd3f80bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:07.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f77fe700 1 -- 172.21.15.78:0/3737654569 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f80c9040 con 0x7fd3f80c0560 2023-08-17T17:52:07.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f67fc700 1 -- 172.21.15.78:0/3737654569 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505160906 0 0) 0x7fd3f80c8df0 con 0x7fd3f8154580 2023-08-17T17:52:07.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f77fe700 1 --2- 172.21.15.78:0/3737654569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f80c0560 0x7fd3f80c6f80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7fd3f80cae50 tx=0x7fd3f0009780).ready entity=mon.0 client_cookie=6a6f9166dba97232 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:07.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f67fc700 1 -- 172.21.15.78:0/3737654569 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f000e070 con 0x7fd3f80c0560 2023-08-17T17:52:07.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f67fc700 1 -- 172.21.15.78:0/3737654569 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f000bc30 con 0x7fd3f80c0560 2023-08-17T17:52:07.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.882+0000 7fd3f67fc700 1 -- 172.21.15.78:0/3737654569 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0012410 con 0x7fd3f80c0560 2023-08-17T17:52:07.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.883+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/3737654569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f80c0560 msgr2=0x7fd3f80c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:07.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.883+0000 7fd3fd5ac700 1 --2- 172.21.15.78:0/3737654569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f80c0560 0x7fd3f80c6f80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7fd3f80cae50 tx=0x7fd3f0009780).stop 2023-08-17T17:52:07.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.883+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/3737654569 shutdown_connections 2023-08-17T17:52:07.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.883+0000 7fd3fd5ac700 1 --2- 172.21.15.78:0/3737654569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f80c0560 0x7fd3f80c6f80 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:07.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.883+0000 7fd3fd5ac700 1 --2- 172.21.15.78:0/3737654569 >> v2:172.21.15.150:3300/0 conn(0x7fd3f81541a0 0x7fd3f80a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:07.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.883+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/3737654569 >> 172.21.15.78:0/3737654569 conn(0x7fd3f806a400 msgr2=0x7fd3f80caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:07.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.883+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/3737654569 shutdown_connections 2023-08-17T17:52:07.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.883+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/3737654569 wait complete. 2023-08-17T17:52:07.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.884+0000 7fd3fd5ac700 1 Processor -- start 2023-08-17T17:52:07.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.884+0000 7fd3fd5ac700 1 -- start start 2023-08-17T17:52:07.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3fd5ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f80c0560 0x7fd3f80957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:07.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3fd5ac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f81541a0 0x7fd3f8142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:07.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3fd5ac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3f8154580 0x7fd3f8164490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:07.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3fd5ac700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f8096f30 con 0x7fd3f81541a0 2023-08-17T17:52:07.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3fd5ac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f81653d0 con 0x7fd3f8154580 2023-08-17T17:52:07.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3fd5ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80974b0 con 0x7fd3f80c0560 2023-08-17T17:52:07.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ee7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f81541a0 0x7fd3f8142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:07.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ee7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f81541a0 0x7fd3f8142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37676/0 (socket says 172.21.15.78:37676) 2023-08-17T17:52:07.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ee7fc700 1 -- 172.21.15.78:0/1805092648 learned_addr learned my addr 172.21.15.78:0/1805092648 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:07.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3f77fe700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3f8154580 0x7fd3f8164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:07.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3f6ffd700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f80c0560 0x7fd3f80957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:07.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ee7fc700 1 -- 172.21.15.78:0/1805092648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f80c0560 msgr2=0x7fd3f80957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:07.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ee7fc700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f80c0560 0x7fd3f80957c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:07.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ee7fc700 1 -- 172.21.15.78:0/1805092648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3f8154580 msgr2=0x7fd3f8164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:07.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ee7fc700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3f8154580 0x7fd3f8164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:07.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ee7fc700 1 -- 172.21.15.78:0/1805092648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0009a20 con 0x7fd3f81541a0 2023-08-17T17:52:07.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ee7fc700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f81541a0 0x7fd3f8142a60 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7fd3e0001eb0 tx=0x7fd3e0007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:07.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ef7fe700 1 -- 172.21.15.78:0/1805092648 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00072e0 con 0x7fd3f81541a0 2023-08-17T17:52:07.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ef7fe700 1 -- 172.21.15.78:0/1805092648 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e0007440 con 0x7fd3f81541a0 2023-08-17T17:52:07.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/1805092648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f8164e10 con 0x7fd3f81541a0 2023-08-17T17:52:07.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.885+0000 7fd3ef7fe700 1 -- 172.21.15.78:0/1805092648 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00057a0 con 0x7fd3f81541a0 2023-08-17T17:52:07.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.886+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/1805092648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f8097140 con 0x7fd3f81541a0 2023-08-17T17:52:07.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.886+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/1805092648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f8097660 con 0x7fd3f81541a0 2023-08-17T17:52:07.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.887+0000 7fd3ef7fe700 1 -- 172.21.15.78:0/1805092648 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd3e0010070 con 0x7fd3f81541a0 2023-08-17T17:52:07.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.887+0000 7fd3ef7fe700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd3d805ed90 0x7fd3d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:07.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.887+0000 7fd3ef7fe700 1 -- 172.21.15.78:0/1805092648 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd3e00791c0 con 0x7fd3f81541a0 2023-08-17T17:52:07.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.887+0000 7fd3f6ffd700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd3d805ed90 0x7fd3d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:07.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.887+0000 7fd3f6ffd700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd3d805ed90 0x7fd3d8061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd3e8006fd0 tx=0x7fd3e8008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:07.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:07.891+0000 7fd3ef7fe700 1 -- 172.21.15.78:0/1805092648 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd3f8097660 con 0x7fd3f81541a0 2023-08-17T17:52:08.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.079+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/1805092648 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3f8097620 con 0x7fd3d805ed90 2023-08-17T17:52:08.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.080+0000 7fd3ef7fe700 1 -- 172.21.15.78:0/1805092648 <== mgr.7446 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd3f8097620 con 0x7fd3d805ed90 2023-08-17T17:52:08.081 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:52:08.081 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:52:08.082 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephfs" 2023-08-17T17:52:08.082 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:52:08.082 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:52:08.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/1805092648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd3d805ed90 msgr2=0x7fd3d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:08.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd3d805ed90 0x7fd3d8061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd3e8006fd0 tx=0x7fd3e8008040).stop 2023-08-17T17:52:08.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/1805092648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f81541a0 msgr2=0x7fd3f8142a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:08.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f81541a0 0x7fd3f8142a60 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7fd3e0001eb0 tx=0x7fd3e0007c10).stop 2023-08-17T17:52:08.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/1805092648 shutdown_connections 2023-08-17T17:52:08.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd3d805ed90 0x7fd3d8061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:08.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3f8154580 0x7fd3f8164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:08.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f80c0560 0x7fd3f80957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:08.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 --2- 172.21.15.78:0/1805092648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f81541a0 0x7fd3f8142a60 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:08.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/1805092648 >> 172.21.15.78:0/1805092648 conn(0x7fd3f806a400 msgr2=0x7fd3f8063050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:08.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/1805092648 shutdown_connections 2023-08-17T17:52:08.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.082+0000 7fd3fd5ac700 1 -- 172.21.15.78:0/1805092648 wait complete. 2023-08-17T17:52:08.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-17T17:52:08.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.209+0000 7fd5bf022700 1 Processor -- start 2023-08-17T17:52:08.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.209+0000 7fd5bf022700 1 -- start start 2023-08-17T17:52:08.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5bf022700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b80c5f20 0x7fd5b80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:08.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5bf022700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b80649b0 con 0x7fd5b80aa0f0 2023-08-17T17:52:08.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5bf022700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b8063420 con 0x7fd5b80aa4d0 2023-08-17T17:52:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5bf022700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8063700 con 0x7fd5b80c5f20 2023-08-17T17:52:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5bcdbe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd5b80aa0f0 0x7fd5b80c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55728/0 (socket says 172.21.15.78:55728) 2023-08-17T17:52:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5bcdbe700 1 -- 172.21.15.78:0/2388730817 learned_addr learned my addr 172.21.15.78:0/2388730817 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5bd5bf700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b80c5f20 0x7fd5b80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462067342 0 0) 0x7fd5b80649b0 con 0x7fd5b80aa0f0 2023-08-17T17:52:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a80033f0 con 0x7fd5b80aa0f0 2023-08-17T17:52:08.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3583198088 0 0) 0x7fd5a80033f0 con 0x7fd5b80aa0f0 2023-08-17T17:52:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b80c5f20 msgr2=0x7fd5b80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b80c5f20 0x7fd5b80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 >> v1:172.21.15.150:6789/0 conn(0x7fd5b80aa4d0 legacy=0x7fd5b80c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80639e0 con 0x7fd5b80aa0f0 2023-08-17T17:52:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fd5ac001470 con 0x7fd5b80aa0f0 2023-08-17T17:52:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 >> v1:172.21.15.78:6789/0 conn(0x7fd5b80aa0f0 legacy=0x7fd5b80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b80c5f20 0x7fd5a8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.210+0000 7fd5b77fe700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a8003e40 0x7fd5a8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5b77fe700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a8004b80 0x7fd5a8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8063700 con 0x7fd5a8004b80 2023-08-17T17:52:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a800b990 con 0x7fd5a8003e40 2023-08-17T17:52:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a800bb50 con 0x7fd5b80c5f20 2023-08-17T17:52:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5bcdbe700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b80c5f20 0x7fd5a8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5bd5bf700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a8004b80 0x7fd5a8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5b7fff700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a8003e40 0x7fd5a8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5bd5bf700 1 -- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b80c5f20 msgr2=0x7fd5a8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5bd5bf700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b80c5f20 0x7fd5a8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5bd5bf700 1 -- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a8003e40 msgr2=0x7fd5a8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5bd5bf700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a8003e40 0x7fd5a8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5bd5bf700 1 -- 172.21.15.78:0/2388730817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a80033f0 con 0x7fd5a8004b80 2023-08-17T17:52:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5bd5bf700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a8004b80 0x7fd5a8005000 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7fd5b000e210 tx=0x7fd5b000b040).ready entity=mon.0 client_cookie=5099f96417219c2e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0009ac0 con 0x7fd5a8004b80 2023-08-17T17:52:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b000f040 con 0x7fd5a8004b80 2023-08-17T17:52:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.211+0000 7fd5b77fe700 1 -- 172.21.15.78:0/2388730817 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b000ecd0 con 0x7fd5a8004b80 2023-08-17T17:52:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.212+0000 7fd5bf022700 1 -- 172.21.15.78:0/2388730817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a8004b80 msgr2=0x7fd5a8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.212+0000 7fd5bf022700 1 --2- 172.21.15.78:0/2388730817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a8004b80 0x7fd5a8005000 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7fd5b000e210 tx=0x7fd5b000b040).stop 2023-08-17T17:52:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.212+0000 7fd5bd5bf700 1 -- 172.21.15.78:0/2388730817 reap_dead start 2023-08-17T17:52:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.212+0000 7fd5bf022700 1 -- 172.21.15.78:0/2388730817 shutdown_connections 2023-08-17T17:52:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.212+0000 7fd5bf022700 1 -- 172.21.15.78:0/2388730817 >> 172.21.15.78:0/2388730817 conn(0x7fd5b806a6a0 msgr2=0x7fd5b80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.212+0000 7fd5bf022700 1 -- 172.21.15.78:0/2388730817 shutdown_connections 2023-08-17T17:52:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.212+0000 7fd5bf022700 1 -- 172.21.15.78:0/2388730817 wait complete. 2023-08-17T17:52:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.213+0000 7fd5bf022700 1 Processor -- start 2023-08-17T17:52:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.213+0000 7fd5bf022700 1 -- start start 2023-08-17T17:52:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bf022700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b80c9750 0x7fd5b80c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bf022700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5b80c9b30 0x7fd5b80ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bf022700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b8142750 0x7fd5b8142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bf022700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b81430c0 con 0x7fd5b80c9750 2023-08-17T17:52:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bf022700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80c4c30 con 0x7fd5b80c9b30 2023-08-17T17:52:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bf022700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80aa9b0 con 0x7fd5b8142750 2023-08-17T17:52:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bcdbe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b80c9750 0x7fd5b80c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bcdbe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b80c9750 0x7fd5b80c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37702/0 (socket says 172.21.15.78:37702) 2023-08-17T17:52:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bcdbe700 1 -- 172.21.15.78:0/2373569253 learned_addr learned my addr 172.21.15.78:0/2373569253 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bd5bf700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b8142750 0x7fd5b8142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5b7fff700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5b80c9b30 0x7fd5b80ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bcdbe700 1 -- 172.21.15.78:0/2373569253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b8142750 msgr2=0x7fd5b8142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bcdbe700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b8142750 0x7fd5b8142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bcdbe700 1 -- 172.21.15.78:0/2373569253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5b80c9b30 msgr2=0x7fd5b80ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bcdbe700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5b80c9b30 0x7fd5b80ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bcdbe700 1 -- 172.21.15.78:0/2373569253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80aac90 con 0x7fd5b80c9750 2023-08-17T17:52:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5b7fff700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5b80c9b30 0x7fd5b80ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.214+0000 7fd5bcdbe700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b80c9750 0x7fd5b80c4650 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fd5ac0047f0 tx=0x7fd5ac001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.215+0000 7fd5b4ff9700 1 -- 172.21.15.78:0/2373569253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00f610 con 0x7fd5b80c9750 2023-08-17T17:52:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.215+0000 7fd5b4ff9700 1 -- 172.21.15.78:0/2373569253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac00f770 con 0x7fd5b80c9750 2023-08-17T17:52:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.215+0000 7fd5bf022700 1 -- 172.21.15.78:0/2373569253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b80aaf70 con 0x7fd5b80c9750 2023-08-17T17:52:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.215+0000 7fd5b4ff9700 1 -- 172.21.15.78:0/2373569253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00faf0 con 0x7fd5b80c9750 2023-08-17T17:52:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.215+0000 7fd5bf022700 1 -- 172.21.15.78:0/2373569253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b80ad8e0 con 0x7fd5b80c9750 2023-08-17T17:52:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.216+0000 7fd5bf022700 1 -- 172.21.15.78:0/2373569253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b80c9f10 con 0x7fd5b80c9750 2023-08-17T17:52:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.216+0000 7fd5b4ff9700 1 -- 172.21.15.78:0/2373569253 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 48) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd5ac01b030 con 0x7fd5b80c9750 2023-08-17T17:52:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.216+0000 7fd5b4ff9700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd59c05ed90 0x7fd59c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.216+0000 7fd5b4ff9700 1 -- 172.21.15.78:0/2373569253 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd5ac0795b0 con 0x7fd5b80c9750 2023-08-17T17:52:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.216+0000 7fd5b7fff700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd59c05ed90 0x7fd59c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.217+0000 7fd5b7fff700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd59c05ed90 0x7fd59c061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd5b80c2140 tx=0x7fd5a4009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:08.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.220+0000 7fd5b4ff9700 1 -- 172.21.15.78:0/2373569253 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd5ac04e580 con 0x7fd5b80c9750 2023-08-17T17:52:08.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:08.429+0000 7fd5bf022700 1 -- 172.21.15.78:0/2373569253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fd5b8046af0 con 0x7fd5b80c9750 2023-08-17T17:52:09.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.295+0000 7fd5b4ff9700 1 -- 172.21.15.78:0/2373569253 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 49) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fd5ac0774b0 con 0x7fd5b80c9750 2023-08-17T17:52:09.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.296+0000 7fd5b4ff9700 1 -- 172.21.15.78:0/2373569253 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v49) v1 ==== 92+0+0 (secure 0 0 0) 0x7fd5ac072300 con 0x7fd5b80c9750 2023-08-17T17:52:09.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 -- 172.21.15.78:0/2373569253 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd59c05ed90 msgr2=0x7fd59c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:09.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd59c05ed90 0x7fd59c061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd5b80c2140 tx=0x7fd5a4009040).stop 2023-08-17T17:52:09.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 -- 172.21.15.78:0/2373569253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b80c9750 msgr2=0x7fd5b80c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:09.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b80c9750 0x7fd5b80c4650 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fd5ac0047f0 tx=0x7fd5ac001e50).stop 2023-08-17T17:52:09.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 -- 172.21.15.78:0/2373569253 shutdown_connections 2023-08-17T17:52:09.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd59c05ed90 0x7fd59c061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5b8142750 0x7fd5b8142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b80c9750 0x7fd5b80c4650 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 --2- 172.21.15.78:0/2373569253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5b80c9b30 0x7fd5b80ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 -- 172.21.15.78:0/2373569253 >> 172.21.15.78:0/2373569253 conn(0x7fd5b806a6a0 msgr2=0x7fd5b8151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:09.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 -- 172.21.15.78:0/2373569253 shutdown_connections 2023-08-17T17:52:09.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.299+0000 7fd5bf022700 1 -- 172.21.15.78:0/2373569253 wait complete. 2023-08-17T17:52:09.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-17T17:52:09.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.433+0000 7f3d43297700 1 Processor -- start 2023-08-17T17:52:09.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.433+0000 7f3d43297700 1 -- start start 2023-08-17T17:52:09.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d43297700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d3c151f70 0x7f3d3c0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d43297700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3c0becc0 0x7f3d3c0be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d43297700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d3c152350 0x7f3d3c0be600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d43297700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3c0beaf0 con 0x7f3d3c151f70 2023-08-17T17:52:09.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d43297700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3c0c6c30 con 0x7f3d3c152350 2023-08-17T17:52:09.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d43297700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0c7a50 con 0x7f3d3c0becc0 2023-08-17T17:52:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d41033700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d3c151f70 0x7f3d3c0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d41033700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d3c151f70 0x7f3d3c0a5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41510/0 (socket says 172.21.15.78:41510) 2023-08-17T17:52:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d41033700 1 -- 172.21.15.78:0/73991993 learned_addr learned my addr 172.21.15.78:0/73991993 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d40832700 1 --2- 172.21.15.78:0/73991993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3c0becc0 0x7f3d3c0be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d41834700 1 --2- 172.21.15.78:0/73991993 >> v2:172.21.15.150:3300/0 conn(0x7f3d3c152350 0x7f3d3c0be600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d41033700 1 -- 172.21.15.78:0/73991993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3c0becc0 msgr2=0x7f3d3c0be110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d41033700 1 --2- 172.21.15.78:0/73991993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3c0becc0 0x7f3d3c0be110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d41033700 1 -- 172.21.15.78:0/73991993 >> v2:172.21.15.150:3300/0 conn(0x7f3d3c152350 msgr2=0x7f3d3c0be600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:09.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d41033700 1 --2- 172.21.15.78:0/73991993 >> v2:172.21.15.150:3300/0 conn(0x7f3d3c152350 0x7f3d3c0be600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d41033700 1 -- 172.21.15.78:0/73991993 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c0c6e40 con 0x7f3d3c151f70 2023-08-17T17:52:09.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.434+0000 7f3d41033700 1 --2- 172.21.15.78:0/73991993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 0x7f3d3c0a5b60 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f3d3c0833f0 tx=0x7f3d380090f0).ready entity=mon.0 client_cookie=2439a1dbf67e900 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:09.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d33fff700 1 -- 172.21.15.78:0/73991993 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3800f510 con 0x7f3d3c151f70 2023-08-17T17:52:09.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d33fff700 1 -- 172.21.15.78:0/73991993 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3800f670 con 0x7f3d3c151f70 2023-08-17T17:52:09.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d33fff700 1 -- 172.21.15.78:0/73991993 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3800f9f0 con 0x7f3d3c151f70 2023-08-17T17:52:09.439 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:09.436+0000 7f688544f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:52:09.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d43297700 1 -- 172.21.15.78:0/73991993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 msgr2=0x7f3d3c0a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:09.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d43297700 1 --2- 172.21.15.78:0/73991993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 0x7f3d3c0a5b60 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f3d3c0833f0 tx=0x7f3d380090f0).stop 2023-08-17T17:52:09.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d43297700 1 -- 172.21.15.78:0/73991993 shutdown_connections 2023-08-17T17:52:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d43297700 1 --2- 172.21.15.78:0/73991993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 0x7f3d3c0a5b60 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d43297700 1 --2- 172.21.15.78:0/73991993 >> v2:172.21.15.150:3300/0 conn(0x7f3d3c152350 0x7f3d3c0be600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d43297700 1 --2- 172.21.15.78:0/73991993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3c0becc0 0x7f3d3c0be110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d43297700 1 -- 172.21.15.78:0/73991993 >> 172.21.15.78:0/73991993 conn(0x7f3d3c062cd0 msgr2=0x7f3d3c0c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d43297700 1 -- 172.21.15.78:0/73991993 shutdown_connections 2023-08-17T17:52:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.435+0000 7f3d43297700 1 -- 172.21.15.78:0/73991993 wait complete. 2023-08-17T17:52:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.436+0000 7f3d43297700 1 Processor -- start 2023-08-17T17:52:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.437+0000 7f3d43297700 1 -- start start 2023-08-17T17:52:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.437+0000 7f3d43297700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3c0becc0 0x7f3d3c0bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.437+0000 7f3d43297700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 0x7f3d3c0c0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.437+0000 7f3d43297700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3c152350 0x7f3d3c0a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.437+0000 7f3d43297700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0c0650 con 0x7f3d3c151f70 2023-08-17T17:52:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.437+0000 7f3d43297700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c1527c0 con 0x7f3d3c152350 2023-08-17T17:52:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.437+0000 7f3d43297700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0c0850 con 0x7f3d3c0becc0 2023-08-17T17:52:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d40832700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 0x7f3d3c0c0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d40832700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 0x7f3d3c0c0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41512/0 (socket says 172.21.15.78:41512) 2023-08-17T17:52:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d40832700 1 -- 172.21.15.78:0/951729939 learned_addr learned my addr 172.21.15.78:0/951729939 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d41834700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3c152350 0x7f3d3c0a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d41033700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3c0becc0 0x7f3d3c0bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d40832700 1 -- 172.21.15.78:0/951729939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3c0becc0 msgr2=0x7f3d3c0bfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d40832700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3c0becc0 0x7f3d3c0bfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d40832700 1 -- 172.21.15.78:0/951729939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3c152350 msgr2=0x7f3d3c0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:09.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d40832700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3c152350 0x7f3d3c0a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d40832700 1 -- 172.21.15.78:0/951729939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d38009370 con 0x7f3d3c151f70 2023-08-17T17:52:09.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d40832700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 0x7f3d3c0c0160 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f3d2c00e900 tx=0x7f3d2c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:09.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d317fa700 1 -- 172.21.15.78:0/951729939 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c012600 con 0x7f3d3c151f70 2023-08-17T17:52:09.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d317fa700 1 -- 172.21.15.78:0/951729939 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c012760 con 0x7f3d3c151f70 2023-08-17T17:52:09.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d43297700 1 -- 172.21.15.78:0/951729939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3c0c0b30 con 0x7f3d3c151f70 2023-08-17T17:52:09.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d317fa700 1 -- 172.21.15.78:0/951729939 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c012ae0 con 0x7f3d3c151f70 2023-08-17T17:52:09.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.438+0000 7f3d43297700 1 -- 172.21.15.78:0/951729939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3c0c10f0 con 0x7f3d3c151f70 2023-08-17T17:52:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.439+0000 7f3d43297700 1 -- 172.21.15.78:0/951729939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3c0831f0 con 0x7f3d3c151f70 2023-08-17T17:52:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.440+0000 7f3d317fa700 1 -- 172.21.15.78:0/951729939 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 49) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f3d2c022070 con 0x7f3d3c151f70 2023-08-17T17:52:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.440+0000 7f3d317fa700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2005edb0 0x7f3d20061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.440+0000 7f3d41033700 1 -- 172.21.15.78:0/951729939 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2005edb0 msgr2=0x7f3d20061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:52:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.440+0000 7f3d317fa700 1 -- 172.21.15.78:0/951729939 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d2c079d10 con 0x7f3d3c151f70 2023-08-17T17:52:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.440+0000 7f3d41033700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2005edb0 0x7f3d20061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:52:09.447 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:09.441+0000 7f85907ab680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:52:09.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.444+0000 7f3d317fa700 1 -- 172.21.15.78:0/951729939 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d2c04b2b0 con 0x7f3d3c151f70 2023-08-17T17:52:09.501 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:09.500+0000 7f688544f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:52:09.507 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:09.506+0000 7f85907ab680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:52:09.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.616+0000 7f3d43297700 1 -- 172.21.15.78:0/951729939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f3d3c068460 con 0x7f3d3c151f70 2023-08-17T17:52:09.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.621+0000 7f3d317fa700 1 -- 172.21.15.78:0/951729939 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3d2c016020 con 0x7f3d3c151f70 2023-08-17T17:52:09.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 -- 172.21.15.78:0/951729939 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2005edb0 msgr2=0x7f3d20061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:52:09.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2005edb0 0x7f3d20061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:09.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 -- 172.21.15.78:0/951729939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 msgr2=0x7f3d3c0c0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:09.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 0x7f3d3c0c0160 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f3d2c00e900 tx=0x7f3d2c009060).stop 2023-08-17T17:52:09.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 -- 172.21.15.78:0/951729939 shutdown_connections 2023-08-17T17:52:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3d2005edb0 0x7f3d20061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3c152350 0x7f3d3c0a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3c0becc0 0x7f3d3c0bfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 --2- 172.21.15.78:0/951729939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d3c151f70 0x7f3d3c0c0160 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 -- 172.21.15.78:0/951729939 >> 172.21.15.78:0/951729939 conn(0x7f3d3c062cd0 msgr2=0x7f3d3c066f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 -- 172.21.15.78:0/951729939 shutdown_connections 2023-08-17T17:52:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.623+0000 7f3d43297700 1 -- 172.21.15.78:0/951729939 wait complete. 2023-08-17T17:52:09.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:09.637 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-17T17:52:09.655 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-17T17:52:09.778 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:09.776+0000 7f688544f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:52:09.794 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:09.793+0000 7f85907ab680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:52:09.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554723f700 1 Processor -- start 2023-08-17T17:52:09.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554723f700 1 -- start start 2023-08-17T17:52:09.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554723f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5540151a40 0x7f55400c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554723f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5540151e20 0x7f55400c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554723f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55400c6620 con 0x7f5540157be0 2023-08-17T17:52:09.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554723f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55400c6900 con 0x7f5540151a40 2023-08-17T17:52:09.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554723f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55400c6be0 con 0x7f5540151e20 2023-08-17T17:52:09.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554623d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5540151a40 0x7f55400c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f5546a3e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5540157be0 0x7f5540154610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43318/0 (socket says 172.21.15.78:43318) 2023-08-17T17:52:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554623d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5540151a40 0x7f55400c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41524/0 (socket says 172.21.15.78:41524) 2023-08-17T17:52:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f5546a3e700 1 -- 172.21.15.78:0/1121374515 learned_addr learned my addr 172.21.15.78:0/1121374515 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f5545a3c700 1 --2- 172.21.15.78:0/1121374515 >> v2:172.21.15.150:3300/0 conn(0x7f5540151e20 0x7f55400c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554623d700 1 -- 172.21.15.78:0/1121374515 >> v2:172.21.15.150:3300/0 conn(0x7f5540151e20 msgr2=0x7f55400c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554623d700 1 --2- 172.21.15.78:0/1121374515 >> v2:172.21.15.150:3300/0 conn(0x7f5540151e20 0x7f55400c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554623d700 1 -- 172.21.15.78:0/1121374515 >> v1:172.21.15.78:6789/0 conn(0x7f5540157be0 legacy=0x7f5540154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554623d700 1 -- 172.21.15.78:0/1121374515 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55400c6ec0 con 0x7f5540151a40 2023-08-17T17:52:09.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554523b700 1 -- 172.21.15.78:0/1121374515 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136800601 0 0) 0x7f55400c6620 con 0x7f5540157be0 2023-08-17T17:52:09.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f5545a3c700 1 --2- 172.21.15.78:0/1121374515 >> v2:172.21.15.150:3300/0 conn(0x7f5540151e20 0x7f55400c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:09.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.816+0000 7f554623d700 1 --2- 172.21.15.78:0/1121374515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151a40 0x7f55400c8260 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f5540065360 tx=0x7f553c006f40).ready entity=mon.0 client_cookie=5b5b64422cba6708 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:09.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554523b700 1 -- 172.21.15.78:0/1121374515 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c005880 con 0x7f5540151a40 2023-08-17T17:52:09.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554523b700 1 -- 172.21.15.78:0/1121374515 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0059e0 con 0x7f5540151a40 2023-08-17T17:52:09.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554523b700 1 -- 172.21.15.78:0/1121374515 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c005d60 con 0x7f5540151a40 2023-08-17T17:52:09.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554723f700 1 -- 172.21.15.78:0/1121374515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151a40 msgr2=0x7f55400c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554723f700 1 --2- 172.21.15.78:0/1121374515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151a40 0x7f55400c8260 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f5540065360 tx=0x7f553c006f40).stop 2023-08-17T17:52:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554723f700 1 -- 172.21.15.78:0/1121374515 shutdown_connections 2023-08-17T17:52:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554723f700 1 --2- 172.21.15.78:0/1121374515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151a40 0x7f55400c8260 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554723f700 1 --2- 172.21.15.78:0/1121374515 >> v2:172.21.15.150:3300/0 conn(0x7f5540151e20 0x7f55400c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554723f700 1 -- 172.21.15.78:0/1121374515 >> 172.21.15.78:0/1121374515 conn(0x7f55400943b0 msgr2=0x7f554006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554723f700 1 -- 172.21.15.78:0/1121374515 shutdown_connections 2023-08-17T17:52:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.817+0000 7f554723f700 1 -- 172.21.15.78:0/1121374515 wait complete. 2023-08-17T17:52:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.818+0000 7f554723f700 1 Processor -- start 2023-08-17T17:52:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.818+0000 7f554723f700 1 -- start start 2023-08-17T17:52:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f554723f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5540151a40 0x7f55401644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f554723f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151e20 0x7f554014dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f554723f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5540157be0 0x7f55400c1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f554723f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5540165440 con 0x7f5540151e20 2023-08-17T17:52:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f554723f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554014d820 con 0x7f5540151a40 2023-08-17T17:52:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f554723f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5540164e80 con 0x7f5540157be0 2023-08-17T17:52:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f5545a3c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151e20 0x7f554014dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f5545a3c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151e20 0x7f554014dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41528/0 (socket says 172.21.15.78:41528) 2023-08-17T17:52:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f5545a3c700 1 -- 172.21.15.78:0/2473516551 learned_addr learned my addr 172.21.15.78:0/2473516551 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f554623d700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5540151a40 0x7f55401644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f5546a3e700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5540157be0 0x7f55400c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f5545a3c700 1 -- 172.21.15.78:0/2473516551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5540157be0 msgr2=0x7f55400c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f5545a3c700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5540157be0 0x7f55400c1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f5545a3c700 1 -- 172.21.15.78:0/2473516551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5540151a40 msgr2=0x7f55401644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f5545a3c700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5540151a40 0x7f55401644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f5545a3c700 1 -- 172.21.15.78:0/2473516551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c009250 con 0x7f5540151e20 2023-08-17T17:52:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.819+0000 7f5546a3e700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5540157be0 0x7f55400c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.820+0000 7f5545a3c700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151e20 0x7f554014dcb0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f553000d890 tx=0x7f5530008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.820+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530017070 con 0x7f5540151e20 2023-08-17T17:52:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.820+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5530005880 con 0x7f5540151e20 2023-08-17T17:52:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.820+0000 7f554723f700 1 -- 172.21.15.78:0/2473516551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5540165160 con 0x7f5540151e20 2023-08-17T17:52:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.820+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530005c00 con 0x7f5540151e20 2023-08-17T17:52:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.820+0000 7f554723f700 1 -- 172.21.15.78:0/2473516551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55401649b0 con 0x7f5540151e20 2023-08-17T17:52:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.821+0000 7f554723f700 1 -- 172.21.15.78:0/2473516551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554014d310 con 0x7f5540151e20 2023-08-17T17:52:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.821+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 49) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f5530005f70 con 0x7f5540151e20 2023-08-17T17:52:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.821+0000 7f55367fc700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f55240612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.821+0000 7f554623d700 1 -- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 msgr2=0x7f55240612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:52:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.821+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5530079c90 con 0x7f5540151e20 2023-08-17T17:52:09.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.821+0000 7f554623d700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f55240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:52:09.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:09.830+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f554014d310 con 0x7f5540151e20 2023-08-17T17:52:10.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:10.023+0000 7f554623d700 1 -- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 msgr2=0x7f55240612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:52:10.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:10.023+0000 7f554623d700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f55240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:52:10.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:10.025+0000 7f554723f700 1 -- 172.21.15.78:0/2473516551 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f554014d310 con 0x7f552405ede0 2023-08-17T17:52:10.390 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:10.388+0000 7f688544f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:52:10.416 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:10.415+0000 7f85907ab680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:52:10.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:10.424+0000 7f554623d700 1 -- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 msgr2=0x7f55240612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:52:10.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:10.424+0000 7f554623d700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f55240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T17:52:10.462 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:10.460+0000 7f688544f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:52:10.489 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:10.488+0000 7f85907ab680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:52:10.649 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:10.647+0000 7f688544f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:52:10.675 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:10.674+0000 7f85907ab680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:52:11.068 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:11.067+0000 7f688544f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:52:11.095 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:11.095+0000 7f85907ab680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:52:11.172 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:11.171+0000 7f688544f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:52:11.199 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:11.199+0000 7f85907ab680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:52:11.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:11.226+0000 7f554623d700 1 -- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 msgr2=0x7f55240612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:52:11.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:11.226+0000 7f554623d700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f55240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T17:52:11.326 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:11.324+0000 7f688544f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:52:11.351 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:11.351+0000 7f85907ab680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:52:11.400 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:11.399+0000 7f688544f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:52:11.426 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:11.426+0000 7f85907ab680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:52:11.468 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:11.467+0000 7f688544f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:52:11.495 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:11.495+0000 7f85907ab680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:52:11.728 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:11.726+0000 7f688544f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:52:11.751 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:11.751+0000 7f85907ab680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:52:11.910 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:11.909+0000 7f688544f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:52:11.934 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:11.934+0000 7f85907ab680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:52:12.565 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:12.563+0000 7f688544f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:52:12.581 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:12.581+0000 7f85907ab680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:52:12.633 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:12.631+0000 7f688544f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:52:12.651 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:12.651+0000 7f85907ab680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:52:12.708 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:12.707+0000 7f688544f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:52:12.726 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:12.726+0000 7f85907ab680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:52:12.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:12.827+0000 7f554623d700 1 -- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 msgr2=0x7f55240612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:52:12.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:12.827+0000 7f554623d700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f55240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-17T17:52:12.855 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:12.854+0000 7f688544f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:52:12.875 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:12.875+0000 7f85907ab680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:52:12.926 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:12.924+0000 7f688544f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:52:12.946 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:12.946+0000 7f85907ab680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:52:13.040 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:13.039+0000 7f688544f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:52:13.062 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.062+0000 7f85907ab680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:52:13.149 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:13.147+0000 7f688544f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:52:13.170 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.170+0000 7f85907ab680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:52:13.441 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:13.440+0000 7f688544f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:52:13.461 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.461+0000 7f85907ab680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:52:13.512 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:52:13.511+0000 7f688544f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:52:13.533 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.533+0000 7f85907ab680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:52:13.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:13.553+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 50) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f5530077b90 con 0x7f5540151e20 2023-08-17T17:52:13.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:13.553+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 msgr2=0x7f55240612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:52:13.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:13.553+0000 7f55367fc700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f55240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:52:13.620 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.620+0000 7f850bf83700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:52:13.620 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.620+0000 7f850bf83700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:52:13.620 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.620+0000 7f850bf83700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:52:13.620 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.620+0000 7f850bf83700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:52:13.620 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.620+0000 7f850bf83700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:52:13.621 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.620+0000 7f850ef89700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:52:13.621 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.620+0000 7f850ef89700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:52:13.621 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.620+0000 7f850ef89700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:52:13.621 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.620+0000 7f850ef89700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:52:13.621 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:52:13.620+0000 7f850ef89700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:52:14.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.556+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mgrmap(e 51) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f5530077f10 con 0x7f5540151e20 2023-08-17T17:52:14.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.557+0000 7f55367fc700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f552402fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:14.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.557+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f554014d310 con 0x7f552405ede0 2023-08-17T17:52:14.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.558+0000 7f554623d700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f552402fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:14.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.572+0000 7f554623d700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f552402fd40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f553c006fa0 tx=0x7f553c016000).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:14.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.578+0000 7f55367fc700 1 -- 172.21.15.78:0/2473516551 <== mgr.7842 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f554014d310 con 0x7f552405ede0 2023-08-17T17:52:14.578 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path snap_test_dir1 2023-08-17T17:52:14.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 -- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 msgr2=0x7f552402fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:14.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f552402fd40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f553c006fa0 tx=0x7f553c016000).stop 2023-08-17T17:52:14.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 -- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151e20 msgr2=0x7f554014dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:14.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151e20 0x7f554014dcb0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f553000d890 tx=0x7f5530008040).stop 2023-08-17T17:52:14.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 -- 172.21.15.78:0/2473516551 shutdown_connections 2023-08-17T17:52:14.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f552405ede0 0x7f552402fd40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5540157be0 0x7f55400c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5540151a40 0x7f55401644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 --2- 172.21.15.78:0/2473516551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5540151e20 0x7f554014dcb0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 -- 172.21.15.78:0/2473516551 >> 172.21.15.78:0/2473516551 conn(0x7f55400943b0 msgr2=0x7f55401557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:14.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 -- 172.21.15.78:0/2473516551 shutdown_connections 2023-08-17T17:52:14.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.580+0000 7f554723f700 1 -- 172.21.15.78:0/2473516551 wait complete. 2023-08-17T17:52:14.594 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-17T17:52:14.594 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-17-17_53_00 in ~46s... 2023-08-17T17:52:14.595 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-08-17T17:52:14.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-17T17:52:14.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.714+0000 7f4a259d5700 1 Processor -- start 2023-08-17T17:52:14.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.714+0000 7f4a259d5700 1 -- start start 2023-08-17T17:52:14.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a259d5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4a200aa0f0 0x7f4a200644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a259d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200aa4d0 0x7f4a200c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a259d5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a200649b0 con 0x7f4a200c5810 2023-08-17T17:52:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a259d5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a20063420 con 0x7f4a200aa0f0 2023-08-17T17:52:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a259d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20063700 con 0x7f4a200aa4d0 2023-08-17T17:52:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a1effd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4a200aa0f0 0x7f4a200644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a1f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4a200c5810 0x7f4a200c5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43330/0 (socket says 172.21.15.78:43330) 2023-08-17T17:52:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a1f7fe700 1 -- 172.21.15.78:0/4131420794 learned_addr learned my addr 172.21.15.78:0/4131420794 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:52:14.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a167fc700 1 --2- 172.21.15.78:0/4131420794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200aa4d0 0x7f4a200c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:14.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a1effd700 1 -- 172.21.15.78:0/4131420794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200aa4d0 msgr2=0x7f4a200c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:52:14.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a1effd700 1 --2- 172.21.15.78:0/4131420794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200aa4d0 0x7f4a200c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a1effd700 1 -- 172.21.15.78:0/4131420794 >> v1:172.21.15.78:6789/0 conn(0x7f4a200c5810 legacy=0x7f4a200c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:14.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a1effd700 1 -- 172.21.15.78:0/4131420794 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200639e0 con 0x7f4a200aa0f0 2023-08-17T17:52:14.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a1e7fc700 1 -- 172.21.15.78:0/4131420794 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526251561 0 0) 0x7f4a200649b0 con 0x7f4a200c5810 2023-08-17T17:52:14.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a167fc700 1 --2- 172.21.15.78:0/4131420794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200aa4d0 0x7f4a200c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:52:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.715+0000 7f4a1effd700 1 --2- 172.21.15.78:0/4131420794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa0f0 0x7f4a200644c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f4a10009760 tx=0x7f4a10009060).ready entity=mon.0 client_cookie=76f00aed36fc7366 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a1e7fc700 1 -- 172.21.15.78:0/4131420794 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000b580 con 0x7f4a200aa0f0 2023-08-17T17:52:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a1e7fc700 1 -- 172.21.15.78:0/4131420794 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1000b6e0 con 0x7f4a200aa0f0 2023-08-17T17:52:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a1e7fc700 1 -- 172.21.15.78:0/4131420794 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000ba60 con 0x7f4a200aa0f0 2023-08-17T17:52:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a259d5700 1 -- 172.21.15.78:0/4131420794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa0f0 msgr2=0x7f4a200644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a259d5700 1 --2- 172.21.15.78:0/4131420794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa0f0 0x7f4a200644c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f4a10009760 tx=0x7f4a10009060).stop 2023-08-17T17:52:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a259d5700 1 -- 172.21.15.78:0/4131420794 shutdown_connections 2023-08-17T17:52:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a259d5700 1 --2- 172.21.15.78:0/4131420794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa0f0 0x7f4a200644c0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a259d5700 1 --2- 172.21.15.78:0/4131420794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200aa4d0 0x7f4a200c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a259d5700 1 -- 172.21.15.78:0/4131420794 >> 172.21.15.78:0/4131420794 conn(0x7f4a2006a6a0 msgr2=0x7f4a200caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:14.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a259d5700 1 -- 172.21.15.78:0/4131420794 shutdown_connections 2023-08-17T17:52:14.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.716+0000 7f4a259d5700 1 -- 172.21.15.78:0/4131420794 wait complete. 2023-08-17T17:52:14.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.717+0000 7f4a259d5700 1 Processor -- start 2023-08-17T17:52:14.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.717+0000 7f4a259d5700 1 -- start start 2023-08-17T17:52:14.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a259d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a200aa0f0 0x7f4a20142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:14.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a259d5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa4d0 0x7f4a200ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:14.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a259d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200c5810 0x7f4a200c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:14.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a259d5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200c35e0 con 0x7f4a200aa4d0 2023-08-17T17:52:14.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a259d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200c3300 con 0x7f4a200aa0f0 2023-08-17T17:52:14.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a259d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200ac980 con 0x7f4a200c5810 2023-08-17T17:52:14.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a167fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa4d0 0x7f4a200ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:14.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a167fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa4d0 0x7f4a200ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41634/0 (socket says 172.21.15.78:41634) 2023-08-17T17:52:14.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a167fc700 1 -- 172.21.15.78:0/3998553263 learned_addr learned my addr 172.21.15.78:0/3998553263 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:52:14.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a1f7fe700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200c5810 0x7f4a200c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:14.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.718+0000 7f4a1effd700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a200aa0f0 0x7f4a20142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:14.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a167fc700 1 -- 172.21.15.78:0/3998553263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200c5810 msgr2=0x7f4a200c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:14.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a167fc700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200c5810 0x7f4a200c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a167fc700 1 -- 172.21.15.78:0/3998553263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a200aa0f0 msgr2=0x7f4a20142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:14.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a167fc700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a200aa0f0 0x7f4a20142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a167fc700 1 -- 172.21.15.78:0/3998553263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a100092a0 con 0x7f4a200aa4d0 2023-08-17T17:52:14.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a167fc700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa4d0 0x7f4a200ad460 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f4a0800d860 tx=0x7f4a08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a177fe700 1 -- 172.21.15.78:0/3998553263 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800f520 con 0x7f4a200aa4d0 2023-08-17T17:52:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a177fe700 1 -- 172.21.15.78:0/3998553263 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0800f680 con 0x7f4a200aa4d0 2023-08-17T17:52:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a259d5700 1 -- 172.21.15.78:0/3998553263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a200acc60 con 0x7f4a200aa4d0 2023-08-17T17:52:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a177fe700 1 -- 172.21.15.78:0/3998553263 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800fa00 con 0x7f4a200aa4d0 2023-08-17T17:52:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.719+0000 7f4a259d5700 1 -- 172.21.15.78:0/3998553263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a20143030 con 0x7f4a200aa4d0 2023-08-17T17:52:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.720+0000 7f4a259d5700 1 -- 172.21.15.78:0/3998553263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a200ac7e0 con 0x7f4a200aa4d0 2023-08-17T17:52:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.720+0000 7f4a177fe700 1 -- 172.21.15.78:0/3998553263 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 51) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f4a0801a030 con 0x7f4a200aa4d0 2023-08-17T17:52:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.721+0000 7f4a177fe700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4a0005ed40 0x7f4a00061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:52:14.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.721+0000 7f4a177fe700 1 -- 172.21.15.78:0/3998553263 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f4a08079620 con 0x7f4a200aa4d0 2023-08-17T17:52:14.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.721+0000 7f4a1effd700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4a0005ed40 0x7f4a00061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:52:14.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.721+0000 7f4a1effd700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4a0005ed40 0x7f4a00061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4a1000b340 tx=0x7f4a10017000).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:52:14.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.725+0000 7f4a177fe700 1 -- 172.21.15.78:0/3998553263 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a200ac7e0 con 0x7f4a200aa4d0 2023-08-17T17:52:14.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.910+0000 7f4a259d5700 1 -- 172.21.15.78:0/3998553263 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a200ac7e0 con 0x7f4a0005ed40 2023-08-17T17:52:14.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.912+0000 7f4a177fe700 1 -- 172.21.15.78:0/3998553263 <== mgr.7842 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f4a200ac7e0 con 0x7f4a0005ed40 2023-08-17T17:52:14.912 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:52:14.913 INFO:teuthology.orchestra.run.smithi078.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-08-17T17:52:14.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 -- 172.21.15.78:0/3998553263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4a0005ed40 msgr2=0x7f4a00061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:14.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4a0005ed40 0x7f4a00061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4a1000b340 tx=0x7f4a10017000).stop 2023-08-17T17:52:14.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 -- 172.21.15.78:0/3998553263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa4d0 msgr2=0x7f4a200ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:52:14.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa4d0 0x7f4a200ad460 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f4a0800d860 tx=0x7f4a08008040).stop 2023-08-17T17:52:14.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 -- 172.21.15.78:0/3998553263 shutdown_connections 2023-08-17T17:52:14.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f4a0005ed40 0x7f4a00061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a200c5810 0x7f4a200c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a200aa0f0 0x7f4a20142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 --2- 172.21.15.78:0/3998553263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a200aa4d0 0x7f4a200ad460 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:52:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 -- 172.21.15.78:0/3998553263 >> 172.21.15.78:0/3998553263 conn(0x7f4a2006a6a0 msgr2=0x7f4a201517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:52:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 -- 172.21.15.78:0/3998553263 shutdown_connections 2023-08-17T17:52:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:52:14.914+0000 7f4a259d5700 1 -- 172.21.15.78:0/3998553263 wait complete. 2023-08-17T17:52:14.926 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-08-17T17:52:14.927 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-08-17T17:52:14.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:14.927 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:15.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:15.945 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:16.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:16.963 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:17.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:17.983 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:19.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:19.002 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:20.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:20.023 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:21.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:21.042 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:22.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:22.062 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:23.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:23.082 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:24.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:24.102 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:25.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:25.123 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:26.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:26.143 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:27.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:27.163 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:28.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:28.183 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:29.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:29.203 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:30.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:30.223 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:31.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:31.242 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:32.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:32.261 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:33.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:52:33.047 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:52:33.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:33.280 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:34.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:34.300 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:35.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:35.318 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:36.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:36.339 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:37.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:37.359 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:38.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:38.380 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:39.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:39.400 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:40.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:40.420 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:41.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:41.440 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:42.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:42.460 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:43.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:43.479 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:44.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:44.499 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:45.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:45.519 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:46.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:46.539 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:47.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:47.558 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:48.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:48.578 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:49.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:49.597 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:50.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:50.617 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:51.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:51.637 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:52.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:52.658 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:53.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:53.678 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:54.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:54.698 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:55.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:55.718 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:56.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:56.738 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:57.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:57.758 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:58.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:58.777 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:52:59.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:52:59.797 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:53:00.583 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:00.581+0000 7f84fef69700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:00.583 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:00.581+0000 7f84fef69700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:00.583 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:00.581+0000 7f84fef69700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:00.583 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:00.582+0000 7f84fef69700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:00.584 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:00.582+0000 7f84fef69700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:00.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:53:00.817 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:53:00.835 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_53_00_UTC 2023-08-17T17:53:00.836 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-17-17_53_00_UTC'] 2023-08-17T17:53:00.836 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692294734.5948806, now = 1692294780.8366444, timo = 46 2023-08-17T17:53:01.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-17T17:53:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.963+0000 7f159be88700 1 Processor -- start 2023-08-17T17:53:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.964+0000 7f159be88700 1 -- start start 2023-08-17T17:53:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.964+0000 7f159be88700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f159413bc70 0x7f15941563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.964+0000 7f159be88700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15941568d0 0x7f15940bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.964+0000 7f159be88700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15940a5a20 con 0x7f159413b890 2023-08-17T17:53:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.964+0000 7f159be88700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15940c32d0 con 0x7f159413bc70 2023-08-17T17:53:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.964+0000 7f159be88700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c3570 con 0x7f15941568d0 2023-08-17T17:53:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1599c24700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f159413b890 0x7f1594155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53722/0 (socket says 172.21.15.78:53722) 2023-08-17T17:53:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1599c24700 1 -- 172.21.15.78:0/3709307413 learned_addr learned my addr 172.21.15.78:0/3709307413 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1599423700 1 --2- 172.21.15.78:0/3709307413 >> v2:172.21.15.78:3300/0 conn(0x7f159413bc70 0x7f15941563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f159a425700 1 --2- 172.21.15.78:0/3709307413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15941568d0 0x7f15940bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1598c22700 1 -- 172.21.15.78:0/3709307413 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904877279 0 0) 0x7f15940a5a20 con 0x7f159413b890 2023-08-17T17:53:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1598c22700 1 -- 172.21.15.78:0/3709307413 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15800033f0 con 0x7f159413b890 2023-08-17T17:53:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1599423700 1 -- 172.21.15.78:0/3709307413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15941568d0 msgr2=0x7f15940bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1599423700 1 --2- 172.21.15.78:0/3709307413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15941568d0 0x7f15940bdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1599423700 1 -- 172.21.15.78:0/3709307413 >> v1:172.21.15.78:6789/0 conn(0x7f159413b890 legacy=0x7f1594155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1599423700 1 -- 172.21.15.78:0/3709307413 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940bfad0 con 0x7f159413bc70 2023-08-17T17:53:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1599423700 1 --2- 172.21.15.78:0/3709307413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 0x7f15941563e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f1584009760 tx=0x7f1584009060).ready entity=mon.0 client_cookie=1ddfc8e0a67b9456 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1598c22700 1 -- 172.21.15.78:0/3709307413 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400d4a0 con 0x7f159413bc70 2023-08-17T17:53:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1598c22700 1 -- 172.21.15.78:0/3709307413 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158400d600 con 0x7f159413bc70 2023-08-17T17:53:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.965+0000 7f1598c22700 1 -- 172.21.15.78:0/3709307413 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400d980 con 0x7f159413bc70 2023-08-17T17:53:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.966+0000 7f159be88700 1 -- 172.21.15.78:0/3709307413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 msgr2=0x7f15941563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.966+0000 7f159be88700 1 --2- 172.21.15.78:0/3709307413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 0x7f15941563e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f1584009760 tx=0x7f1584009060).stop 2023-08-17T17:53:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.966+0000 7f159be88700 1 -- 172.21.15.78:0/3709307413 shutdown_connections 2023-08-17T17:53:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.966+0000 7f159be88700 1 --2- 172.21.15.78:0/3709307413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15941568d0 0x7f15940bdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.966+0000 7f159be88700 1 --2- 172.21.15.78:0/3709307413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 0x7f15941563e0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.966+0000 7f159be88700 1 -- 172.21.15.78:0/3709307413 >> 172.21.15.78:0/3709307413 conn(0x7f1594062f80 msgr2=0x7f15940c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.966+0000 7f159be88700 1 -- 172.21.15.78:0/3709307413 shutdown_connections 2023-08-17T17:53:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.966+0000 7f159be88700 1 -- 172.21.15.78:0/3709307413 wait complete. 2023-08-17T17:53:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.967+0000 7f159be88700 1 Processor -- start 2023-08-17T17:53:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.967+0000 7f159be88700 1 -- start start 2023-08-17T17:53:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f159be88700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f159413b890 0x7f15941634e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f159be88700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 0x7f15940aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f159be88700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15941568d0 0x7f15940abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f159be88700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940ae730 con 0x7f159413bc70 2023-08-17T17:53:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f159be88700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15941639d0 con 0x7f159413b890 2023-08-17T17:53:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f159be88700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940ab6a0 con 0x7f15941568d0 2023-08-17T17:53:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1599423700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 0x7f15940aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1599423700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 0x7f15940aa610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48020/0 (socket says 172.21.15.78:48020) 2023-08-17T17:53:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1599423700 1 -- 172.21.15.78:0/1880009427 learned_addr learned my addr 172.21.15.78:0/1880009427 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f159a425700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15941568d0 0x7f15940abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1599c24700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f159413b890 0x7f15941634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1599423700 1 -- 172.21.15.78:0/1880009427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15941568d0 msgr2=0x7f15940abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1599423700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15941568d0 0x7f15940abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1599423700 1 -- 172.21.15.78:0/1880009427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f159413b890 msgr2=0x7f15941634e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1599423700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f159413b890 0x7f15941634e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1599423700 1 -- 172.21.15.78:0/1880009427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840092a0 con 0x7f159413bc70 2023-08-17T17:53:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1599423700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 0x7f15940aa610 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f15940605e0 tx=0x7f1584016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:01.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1589ffb700 1 -- 172.21.15.78:0/1880009427 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584000c90 con 0x7f159413bc70 2023-08-17T17:53:01.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1589ffb700 1 -- 172.21.15.78:0/1880009427 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158400d770 con 0x7f159413bc70 2023-08-17T17:53:01.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f159be88700 1 -- 172.21.15.78:0/1880009427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15940adab0 con 0x7f159413bc70 2023-08-17T17:53:01.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.968+0000 7f1589ffb700 1 -- 172.21.15.78:0/1880009427 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158401d640 con 0x7f159413bc70 2023-08-17T17:53:01.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.969+0000 7f159be88700 1 -- 172.21.15.78:0/1880009427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15940ae070 con 0x7f159413bc70 2023-08-17T17:53:01.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.970+0000 7f159be88700 1 -- 172.21.15.78:0/1880009427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15940a86d0 con 0x7f159413bc70 2023-08-17T17:53:01.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.970+0000 7f1589ffb700 1 -- 172.21.15.78:0/1880009427 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 52) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f158400f070 con 0x7f159413bc70 2023-08-17T17:53:01.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.970+0000 7f1589ffb700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f157805ee00 0x7f15780612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:01.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.970+0000 7f1589ffb700 1 -- 172.21.15.78:0/1880009427 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f158407b470 con 0x7f159413bc70 2023-08-17T17:53:01.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.970+0000 7f1599c24700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f157805ee00 0x7f15780612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:01.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.971+0000 7f1599c24700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f157805ee00 0x7f15780612c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1590005750 tx=0x7f1590009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:01.975+0000 7f1589ffb700 1 -- 172.21.15.78:0/1880009427 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f158404c8d0 con 0x7f159413bc70 2023-08-17T17:53:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.158+0000 7f159be88700 1 -- 172.21.15.78:0/1880009427 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1594069e60 con 0x7f157805ee00 2023-08-17T17:53:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.163+0000 7f1589ffb700 1 -- 172.21.15.78:0/1880009427 <== mgr.7842 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1594069e60 con 0x7f157805ee00 2023-08-17T17:53:02.164 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path snap_test_dir1 2023-08-17T17:53:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 -- 172.21.15.78:0/1880009427 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f157805ee00 msgr2=0x7f15780612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f157805ee00 0x7f15780612c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1590005750 tx=0x7f1590009040).stop 2023-08-17T17:53:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 -- 172.21.15.78:0/1880009427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 msgr2=0x7f15940aa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 0x7f15940aa610 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f15940605e0 tx=0x7f1584016000).stop 2023-08-17T17:53:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 -- 172.21.15.78:0/1880009427 shutdown_connections 2023-08-17T17:53:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f157805ee00 0x7f15780612c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15941568d0 0x7f15940abc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f159413b890 0x7f15941634e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 --2- 172.21.15.78:0/1880009427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f159413bc70 0x7f15940aa610 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 -- 172.21.15.78:0/1880009427 >> 172.21.15.78:0/1880009427 conn(0x7f1594062f80 msgr2=0x7f1594067bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 -- 172.21.15.78:0/1880009427 shutdown_connections 2023-08-17T17:53:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.164+0000 7f159be88700 1 -- 172.21.15.78:0/1880009427 wait complete. 2023-08-17T17:53:02.177 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-17T17:53:02.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:53:02.178 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T17:53:02.192 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_53_00_UTC 2023-08-17T17:53:02.193 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-17-17_53_00_UTC 2023-08-17T17:53:02.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:53:02.194 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-17-17_53_00_UTC) 2023-08-17T17:53:02.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:53:02.255 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-17T17:53:02.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-17T17:53:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.466+0000 7f2f60941700 1 Processor -- start 2023-08-17T17:53:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.466+0000 7f2f60941700 1 -- start start 2023-08-17T17:53:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f60941700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5c0c5f20 0x7f2f5c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f60941700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c0649b0 con 0x7f2f5c0aa4d0 2023-08-17T17:53:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f60941700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c063420 con 0x7f2f5c0aa0f0 2023-08-17T17:53:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f60941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c063700 con 0x7f2f5c0c5f20 2023-08-17T17:53:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f51d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2f5c0aa4d0 0x7f2f5c0c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53734/0 (socket says 172.21.15.78:53734) 2023-08-17T17:53:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f51d9b700 1 -- 172.21.15.78:0/3091429966 learned_addr learned my addr 172.21.15.78:0/3091429966 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f5ad9d700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5c0c5f20 0x7f2f5c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468968038 0 0) 0x7f2f5c0649b0 con 0x7f2f5c0aa4d0 2023-08-17T17:53:02.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f480033f0 con 0x7f2f5c0aa4d0 2023-08-17T17:53:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406593654 0 0) 0x7f2f5c063420 con 0x7f2f5c0aa0f0 2023-08-17T17:53:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f5c0649b0 con 0x7f2f5c0aa0f0 2023-08-17T17:53:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1993160162 0 0) 0x7f2f480033f0 con 0x7f2f5c0aa4d0 2023-08-17T17:53:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.467+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5c0c5f20 msgr2=0x7f2f5c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5c0c5f20 0x7f2f5c0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 >> v1:172.21.15.150:6789/0 conn(0x7f2f5c0aa0f0 legacy=0x7f2f5c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0639e0 con 0x7f2f5c0aa4d0 2023-08-17T17:53:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f2f44001470 con 0x7f2f5c0aa4d0 2023-08-17T17:53:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f5ad9d700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5c0c5f20 0x7f2f5c0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 >> v1:172.21.15.78:6789/0 conn(0x7f2f5c0aa4d0 legacy=0x7f2f5c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5c0c5f20 0x7f2f48003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f48003f90 0x7f2f48004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f48004b80 0x7f2f48005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c063700 con 0x7f2f48004b80 2023-08-17T17:53:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4800b940 con 0x7f2f48003f90 2023-08-17T17:53:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4800bb00 con 0x7f2f5c0c5f20 2023-08-17T17:53:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f5ad9d700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f48004b80 0x7f2f48005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f5a59c700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5c0c5f20 0x7f2f48003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f51d9b700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f48003f90 0x7f2f48004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f5ad9d700 1 -- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5c0c5f20 msgr2=0x7f2f48003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f5ad9d700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5c0c5f20 0x7f2f48003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f5ad9d700 1 -- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f48003f90 msgr2=0x7f2f48004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f5ad9d700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f48003f90 0x7f2f48004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f5ad9d700 1 -- 172.21.15.78:0/3091429966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009a20 con 0x7f2f48004b80 2023-08-17T17:53:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f5ad9d700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f48004b80 0x7f2f48005000 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f2f5400e3c0 tx=0x7f2f5400b040).ready entity=mon.0 client_cookie=324f51672195f3ad server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54009c50 con 0x7f2f48004b80 2023-08-17T17:53:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400f040 con 0x7f2f48004b80 2023-08-17T17:53:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.468+0000 7f2f59d9b700 1 -- 172.21.15.78:0/3091429966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400ee80 con 0x7f2f48004b80 2023-08-17T17:53:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.469+0000 7f2f60941700 1 -- 172.21.15.78:0/3091429966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f48004b80 msgr2=0x7f2f48005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.469+0000 7f2f60941700 1 --2- 172.21.15.78:0/3091429966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f48004b80 0x7f2f48005000 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f2f5400e3c0 tx=0x7f2f5400b040).stop 2023-08-17T17:53:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.469+0000 7f2f5ad9d700 1 -- 172.21.15.78:0/3091429966 reap_dead start 2023-08-17T17:53:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.469+0000 7f2f60941700 1 -- 172.21.15.78:0/3091429966 shutdown_connections 2023-08-17T17:53:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.469+0000 7f2f60941700 1 -- 172.21.15.78:0/3091429966 >> 172.21.15.78:0/3091429966 conn(0x7f2f5c06a6a0 msgr2=0x7f2f5c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.469+0000 7f2f60941700 1 -- 172.21.15.78:0/3091429966 shutdown_connections 2023-08-17T17:53:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.469+0000 7f2f60941700 1 -- 172.21.15.78:0/3091429966 wait complete. 2023-08-17T17:53:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.470+0000 7f2f60941700 1 Processor -- start 2023-08-17T17:53:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.470+0000 7f2f60941700 1 -- start start 2023-08-17T17:53:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f60941700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f48004b80 0x7f2f5c159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f60941700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c0c78a0 0x7f2f5c0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f60941700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c1644e0 0x7f2f5c164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f60941700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c165210 con 0x7f2f5c1644e0 2023-08-17T17:53:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f60941700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0ac7b0 con 0x7f2f5c0c78a0 2023-08-17T17:53:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f60941700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0c8210 con 0x7f2f48004b80 2023-08-17T17:53:02.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c1644e0 0x7f2f5c164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:02.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c1644e0 0x7f2f5c164960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48046/0 (socket says 172.21.15.78:48046) 2023-08-17T17:53:02.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f5ad9d700 1 -- 172.21.15.78:0/887180182 learned_addr learned my addr 172.21.15.78:0/887180182 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:02.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f51d9b700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c0c78a0 0x7f2f5c0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:02.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f5ad9d700 1 -- 172.21.15.78:0/887180182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f48004b80 msgr2=0x7f2f5c159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:02.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f5a59c700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f48004b80 0x7f2f5c159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:02.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f5ad9d700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f48004b80 0x7f2f5c159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:02.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f5ad9d700 1 -- 172.21.15.78:0/887180182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c0c78a0 msgr2=0x7f2f5c0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f5ad9d700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c0c78a0 0x7f2f5c0c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f5ad9d700 1 -- 172.21.15.78:0/887180182 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0abe80 con 0x7f2f5c1644e0 2023-08-17T17:53:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f51d9b700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c0c78a0 0x7f2f5c0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f5ad9d700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c1644e0 0x7f2f5c164960 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f2f54013940 tx=0x7f2f5401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f52ffd700 1 -- 172.21.15.78:0/887180182 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54021030 con 0x7f2f5c1644e0 2023-08-17T17:53:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f52ffd700 1 -- 172.21.15.78:0/887180182 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54013e90 con 0x7f2f5c1644e0 2023-08-17T17:53:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f60941700 1 -- 172.21.15.78:0/887180182 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c0ac160 con 0x7f2f5c1644e0 2023-08-17T17:53:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f52ffd700 1 -- 172.21.15.78:0/887180182 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5401d630 con 0x7f2f5c1644e0 2023-08-17T17:53:02.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.471+0000 7f2f60941700 1 -- 172.21.15.78:0/887180182 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c159b50 con 0x7f2f5c1644e0 2023-08-17T17:53:02.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.472+0000 7f2f60941700 1 -- 172.21.15.78:0/887180182 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c083980 con 0x7f2f5c1644e0 2023-08-17T17:53:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.473+0000 7f2f52ffd700 1 -- 172.21.15.78:0/887180182 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 53) v1 ==== 75419+0+0 (secure 0 0 0) 0x7f2f5401da20 con 0x7f2f5c1644e0 2023-08-17T17:53:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.473+0000 7f2f52ffd700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f3c05ef00 0x7f2f3c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.473+0000 7f2f52ffd700 1 -- 172.21.15.78:0/887180182 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2f54022070 con 0x7f2f5c1644e0 2023-08-17T17:53:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.473+0000 7f2f5a59c700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f3c05ef00 0x7f2f3c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.473+0000 7f2f5a59c700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f3c05ef00 0x7f2f3c0613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2f4c000c00 tx=0x7f2f4c009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.477+0000 7f2f52ffd700 1 -- 172.21.15.78:0/887180182 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f5404cc60 con 0x7f2f5c1644e0 2023-08-17T17:53:02.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:02.681+0000 7f2f60941700 1 -- 172.21.15.78:0/887180182 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f2f5c046af0 con 0x7f2f5c1644e0 2023-08-17T17:53:03.126 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:53:03.129 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:53:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.295+0000 7f2f52ffd700 1 -- 172.21.15.78:0/887180182 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f2f540795c0 con 0x7f2f5c1644e0 2023-08-17T17:53:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.296+0000 7f2f52ffd700 1 -- 172.21.15.78:0/887180182 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v54) v1 ==== 93+0+0 (secure 0 0 0) 0x7f2f540429b0 con 0x7f2f5c1644e0 2023-08-17T17:53:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 -- 172.21.15.78:0/887180182 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f3c05ef00 msgr2=0x7f2f3c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f3c05ef00 0x7f2f3c0613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2f4c000c00 tx=0x7f2f4c009040).stop 2023-08-17T17:53:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 -- 172.21.15.78:0/887180182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c1644e0 msgr2=0x7f2f5c164960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c1644e0 0x7f2f5c164960 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f2f54013940 tx=0x7f2f5401a000).stop 2023-08-17T17:53:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 -- 172.21.15.78:0/887180182 shutdown_connections 2023-08-17T17:53:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f3c05ef00 0x7f2f3c0613c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c1644e0 0x7f2f5c164960 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f48004b80 0x7f2f5c159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 --2- 172.21.15.78:0/887180182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f5c0c78a0 0x7f2f5c0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 -- 172.21.15.78:0/887180182 >> 172.21.15.78:0/887180182 conn(0x7f2f5c06a6a0 msgr2=0x7f2f5c0a8630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 -- 172.21.15.78:0/887180182 shutdown_connections 2023-08-17T17:53:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.298+0000 7f2f60941700 1 -- 172.21.15.78:0/887180182 wait complete. 2023-08-17T17:53:03.311 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:53:03.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:53:03.353 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:53:03.393 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:53:03.393 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T17:53:03.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:53:03.394 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T17:53:03.430 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:53:03.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:03.431 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T17:53:03.439 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:03.438+0000 7f5019367680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:53:03.441 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:03.440+0000 7fe0c9380680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:53:03.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:03.501 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:03.500+0000 7f5019367680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:53:03.506 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:03.505+0000 7fe0c9380680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:53:03.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.612+0000 7fb5a5f6c700 1 Processor -- start 2023-08-17T17:53:03.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.612+0000 7fb5a5f6c700 1 -- start start 2023-08-17T17:53:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb5a5f6c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a00c5060 0x7fb5a006b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb5a5f6c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a00ace90 con 0x7fb5a0069bb0 2023-08-17T17:53:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb5a5f6c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a00c6d10 con 0x7fb5a00bc0c0 2023-08-17T17:53:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb5a5f6c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c6ff0 con 0x7fb5a00c5060 2023-08-17T17:53:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb5a4f6a700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb5a0069bb0 0x7fb5a0069f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53762/0 (socket says 172.21.15.78:53762) 2023-08-17T17:53:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb5a4f6a700 1 -- 172.21.15.78:0/3511063270 learned_addr learned my addr 172.21.15.78:0/3511063270 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb59ffff700 1 --2- 172.21.15.78:0/3511063270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a00c5060 0x7fb5a006b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb59f7fe700 1 -- 172.21.15.78:0/3511063270 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043588435 0 0) 0x7fb5a00ace90 con 0x7fb5a0069bb0 2023-08-17T17:53:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb59f7fe700 1 -- 172.21.15.78:0/3511063270 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5900033f0 con 0x7fb5a0069bb0 2023-08-17T17:53:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb59f7fe700 1 -- 172.21.15.78:0/3511063270 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272734996 0 0) 0x7fb5a00c6d10 con 0x7fb5a00bc0c0 2023-08-17T17:53:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb59f7fe700 1 -- 172.21.15.78:0/3511063270 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a00ace90 con 0x7fb5a00bc0c0 2023-08-17T17:53:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb59ffff700 1 -- 172.21.15.78:0/3511063270 >> v1:172.21.15.150:6789/0 conn(0x7fb5a00bc0c0 legacy=0x7fb5a00bc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.613+0000 7fb59ffff700 1 -- 172.21.15.78:0/3511063270 >> v1:172.21.15.78:6789/0 conn(0x7fb5a0069bb0 legacy=0x7fb5a0069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb59ffff700 1 -- 172.21.15.78:0/3511063270 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00acb20 con 0x7fb5a00c5060 2023-08-17T17:53:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb59ffff700 1 --2- 172.21.15.78:0/3511063270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a00c5060 0x7fb5a006b490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb58c009790 tx=0x7fb58c009060).ready entity=mon.2 client_cookie=463ab0e3d57cdae5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb59f7fe700 1 -- 172.21.15.78:0/3511063270 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00f510 con 0x7fb5a00c5060 2023-08-17T17:53:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb59f7fe700 1 -- 172.21.15.78:0/3511063270 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c00f670 con 0x7fb5a00c5060 2023-08-17T17:53:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb59f7fe700 1 -- 172.21.15.78:0/3511063270 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00f9f0 con 0x7fb5a00c5060 2023-08-17T17:53:03.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/3511063270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a00c5060 msgr2=0x7fb5a006b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:03.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb5a5f6c700 1 --2- 172.21.15.78:0/3511063270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a00c5060 0x7fb5a006b490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb58c009790 tx=0x7fb58c009060).stop 2023-08-17T17:53:03.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/3511063270 shutdown_connections 2023-08-17T17:53:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb5a5f6c700 1 --2- 172.21.15.78:0/3511063270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a00c5060 0x7fb5a006b490 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/3511063270 >> 172.21.15.78:0/3511063270 conn(0x7fb5a00aabf0 msgr2=0x7fb5a00ac270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.614+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/3511063270 shutdown_connections 2023-08-17T17:53:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.615+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/3511063270 wait complete. 2023-08-17T17:53:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.616+0000 7fb5a5f6c700 1 Processor -- start 2023-08-17T17:53:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.616+0000 7fb5a5f6c700 1 -- start start 2023-08-17T17:53:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.616+0000 7fb5a5f6c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a0069bb0 0x7fb5a00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.616+0000 7fb5a5f6c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5a00bc0c0 0x7fb5a00a5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.616+0000 7fb5a5f6c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5a00c5060 0x7fb5a00a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.616+0000 7fb5a5f6c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00a4be0 con 0x7fb5a00c5060 2023-08-17T17:53:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.616+0000 7fb5a5f6c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00a3fd0 con 0x7fb5a00bc0c0 2023-08-17T17:53:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.616+0000 7fb5a5f6c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00a42b0 con 0x7fb5a0069bb0 2023-08-17T17:53:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a576b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5a00c5060 0x7fb5a00a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a576b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5a00c5060 0x7fb5a00a9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48082/0 (socket says 172.21.15.78:48082) 2023-08-17T17:53:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a576b700 1 -- 172.21.15.78:0/1711592648 learned_addr learned my addr 172.21.15.78:0/1711592648 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb59ffff700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5a00bc0c0 0x7fb5a00a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a4f6a700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a0069bb0 0x7fb5a00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a576b700 1 -- 172.21.15.78:0/1711592648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a0069bb0 msgr2=0x7fb5a00a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a576b700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a0069bb0 0x7fb5a00a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a576b700 1 -- 172.21.15.78:0/1711592648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5a00bc0c0 msgr2=0x7fb5a00a5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a576b700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5a00bc0c0 0x7fb5a00a5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a576b700 1 -- 172.21.15.78:0/1711592648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c0092a0 con 0x7fb5a00c5060 2023-08-17T17:53:03.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a576b700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5a00c5060 0x7fb5a00a9280 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fb59800c710 tx=0x7fb59800ca20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:03.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb59cff9700 1 -- 172.21.15.78:0/1711592648 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59800e4a0 con 0x7fb5a00c5060 2023-08-17T17:53:03.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb59cff9700 1 -- 172.21.15.78:0/1711592648 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59800e600 con 0x7fb5a00c5060 2023-08-17T17:53:03.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb59cff9700 1 -- 172.21.15.78:0/1711592648 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59800e980 con 0x7fb5a00c5060 2023-08-17T17:53:03.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/1711592648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a00a4590 con 0x7fb5a00c5060 2023-08-17T17:53:03.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.617+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/1711592648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a00a9770 con 0x7fb5a00c5060 2023-08-17T17:53:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.618+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/1711592648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a00a4d50 con 0x7fb5a00c5060 2023-08-17T17:53:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.619+0000 7fb59cff9700 1 -- 172.21.15.78:0/1711592648 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fb598019030 con 0x7fb5a00c5060 2023-08-17T17:53:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.619+0000 7fb59cff9700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb58405eeb0 0x7fb584061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:03.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.619+0000 7fb5a4f6a700 1 -- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb58405eeb0 msgr2=0x7fb584061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:03.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.619+0000 7fb59cff9700 1 -- 172.21.15.78:0/1711592648 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fb598079ab0 con 0x7fb5a00c5060 2023-08-17T17:53:03.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.619+0000 7fb5a4f6a700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb58405eeb0 0x7fb584061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:03.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.623+0000 7fb59cff9700 1 -- 172.21.15.78:0/1711592648 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb5980488f0 con 0x7fb5a00c5060 2023-08-17T17:53:03.776 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:03.775+0000 7f5019367680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:53:03.793 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:03.792+0000 7fe0c9380680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:53:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.820+0000 7fb5a4f6a700 1 -- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb58405eeb0 msgr2=0x7fb584061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.820+0000 7fb5a4f6a700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb58405eeb0 0x7fb584061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.834+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/1711592648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5a00c4d60 con 0x7fb5a00c5060 2023-08-17T17:53:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.835+0000 7fb59cff9700 1 -- 172.21.15.78:0/1711592648 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fb59804a740 con 0x7fb5a00c5060 2023-08-17T17:53:03.836 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:03.837 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2905752860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2905752860},{"type":"v1","addr":"172.21.15.150:6833","nonce":2905752860}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7620,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/652553934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":652553934},{"type":"v1","addr":"172.21.15.78:6836","nonce":652553934}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7623,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/728629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":728629628},{"type":"v1","addr":"172.21.15.78:6837","nonce":728629628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:51:57.714922+0000","modified":"2023-08-17T17:51:59.721521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7641":{"gid":7641,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3422834327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3422834327},{"type":"v1","addr":"172.21.15.150:6835","nonce":3422834327}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T17:53:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb58405eeb0 msgr2=0x7fb584061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb58405eeb0 0x7fb584061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5a00c5060 msgr2=0x7fb5a00a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5a00c5060 0x7fb5a00a9280 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fb59800c710 tx=0x7fb59800ca20).stop 2023-08-17T17:53:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/1711592648 shutdown_connections 2023-08-17T17:53:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb58405eeb0 0x7fb584061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5a00c5060 0x7fb5a00a9280 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5a0069bb0 0x7fb5a00a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 --2- 172.21.15.78:0/1711592648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5a00bc0c0 0x7fb5a00a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/1711592648 >> 172.21.15.78:0/1711592648 conn(0x7fb5a00aabf0 msgr2=0x7fb5a0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/1711592648 shutdown_connections 2023-08-17T17:53:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:03.837+0000 7fb5a5f6c700 1 -- 172.21.15.78:0/1711592648 wait complete. 2023-08-17T17:53:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 43 2023-08-17T17:53:03.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.006+0000 7f53ee282700 1 Processor -- start 2023-08-17T17:53:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.006+0000 7f53ee282700 1 -- start start 2023-08-17T17:53:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ee282700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f53e8069bb0 0x7f53e806b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ee282700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f53e80c5060 0x7f53e8069f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ee282700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e80ace90 con 0x7f53e80624f0 2023-08-17T17:53:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ee282700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e80c6ff0 con 0x7f53e8069bb0 2023-08-17T17:53:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ee282700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e80c6d10 con 0x7f53e80c5060 2023-08-17T17:53:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ed280700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f53e8069bb0 0x7f53e806b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53eda81700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f53e80624f0 0x7f53e8062940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53776/0 (socket says 172.21.15.78:53776) 2023-08-17T17:53:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ed280700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f53e8069bb0 0x7f53e806b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48090/0 (socket says 172.21.15.78:48090) 2023-08-17T17:53:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53eda81700 1 -- 172.21.15.78:0/2446905570 learned_addr learned my addr 172.21.15.78:0/2446905570 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53eca7f700 1 --2- 172.21.15.78:0/2446905570 >> v2:172.21.15.150:3300/0 conn(0x7f53e80c5060 0x7f53e8069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ed280700 1 -- 172.21.15.78:0/2446905570 >> v2:172.21.15.150:3300/0 conn(0x7f53e80c5060 msgr2=0x7f53e8069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ed280700 1 --2- 172.21.15.78:0/2446905570 >> v2:172.21.15.150:3300/0 conn(0x7f53e80c5060 0x7f53e8069f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ed280700 1 -- 172.21.15.78:0/2446905570 >> v1:172.21.15.78:6789/0 conn(0x7f53e80624f0 legacy=0x7f53e8062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53dffff700 1 -- 172.21.15.78:0/2446905570 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221808426 0 0) 0x7f53e80ace90 con 0x7f53e80624f0 2023-08-17T17:53:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ed280700 1 -- 172.21.15.78:0/2446905570 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e80acb20 con 0x7f53e8069bb0 2023-08-17T17:53:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53eca7f700 1 --2- 172.21.15.78:0/2446905570 >> v2:172.21.15.150:3300/0 conn(0x7f53e80c5060 0x7f53e8069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53ed280700 1 --2- 172.21.15.78:0/2446905570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 0x7f53e806b490 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f53e806c1e0 tx=0x7f53d8009060).ready entity=mon.0 client_cookie=75d577fe4c21435 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.008+0000 7f53dffff700 1 -- 172.21.15.78:0/2446905570 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d800b610 con 0x7f53e8069bb0 2023-08-17T17:53:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.009+0000 7f53dffff700 1 -- 172.21.15.78:0/2446905570 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d800b770 con 0x7f53e8069bb0 2023-08-17T17:53:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.009+0000 7f53dffff700 1 -- 172.21.15.78:0/2446905570 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d800baf0 con 0x7f53e8069bb0 2023-08-17T17:53:04.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.009+0000 7f53ee282700 1 -- 172.21.15.78:0/2446905570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 msgr2=0x7f53e806b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.009+0000 7f53ee282700 1 --2- 172.21.15.78:0/2446905570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 0x7f53e806b490 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f53e806c1e0 tx=0x7f53d8009060).stop 2023-08-17T17:53:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.009+0000 7f53ee282700 1 -- 172.21.15.78:0/2446905570 shutdown_connections 2023-08-17T17:53:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.009+0000 7f53ee282700 1 --2- 172.21.15.78:0/2446905570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 0x7f53e806b490 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.009+0000 7f53ee282700 1 --2- 172.21.15.78:0/2446905570 >> v2:172.21.15.150:3300/0 conn(0x7f53e80c5060 0x7f53e8069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.009+0000 7f53ee282700 1 -- 172.21.15.78:0/2446905570 >> 172.21.15.78:0/2446905570 conn(0x7f53e80aabf0 msgr2=0x7f53e80ac270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.009+0000 7f53ee282700 1 -- 172.21.15.78:0/2446905570 shutdown_connections 2023-08-17T17:53:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.009+0000 7f53ee282700 1 -- 172.21.15.78:0/2446905570 wait complete. 2023-08-17T17:53:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.011+0000 7f53ee282700 1 Processor -- start 2023-08-17T17:53:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.011+0000 7f53ee282700 1 -- start start 2023-08-17T17:53:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.011+0000 7f53ee282700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e80624f0 0x7f53e8147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.011+0000 7f53ee282700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 0x7f53e80a8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.011+0000 7f53ee282700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53e80c5060 0x7f53e80a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.011+0000 7f53ee282700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80a95f0 con 0x7f53e8069bb0 2023-08-17T17:53:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.011+0000 7f53ee282700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e81634f0 con 0x7f53e80624f0 2023-08-17T17:53:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.011+0000 7f53ee282700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e81637d0 con 0x7f53e80c5060 2023-08-17T17:53:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53eca7f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 0x7f53e80a8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53eca7f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 0x7f53e80a8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48106/0 (socket says 172.21.15.78:48106) 2023-08-17T17:53:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53eca7f700 1 -- 172.21.15.78:0/192115580 learned_addr learned my addr 172.21.15.78:0/192115580 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53ed280700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e80624f0 0x7f53e8147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53eda81700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53e80c5060 0x7f53e80a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53eca7f700 1 -- 172.21.15.78:0/192115580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53e80c5060 msgr2=0x7f53e80a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53eca7f700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53e80c5060 0x7f53e80a9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53eca7f700 1 -- 172.21.15.78:0/192115580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e80624f0 msgr2=0x7f53e8147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53eca7f700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e80624f0 0x7f53e8147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53eca7f700 1 -- 172.21.15.78:0/192115580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80092a0 con 0x7f53e8069bb0 2023-08-17T17:53:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53eca7f700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 0x7f53e80a8c10 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f53e400d890 tx=0x7f53e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53dd7fa700 1 -- 172.21.15.78:0/192115580 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4011590 con 0x7f53e8069bb0 2023-08-17T17:53:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53dd7fa700 1 -- 172.21.15.78:0/192115580 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e40116f0 con 0x7f53e8069bb0 2023-08-17T17:53:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53ee282700 1 -- 172.21.15.78:0/192115580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e8163ab0 con 0x7f53e8069bb0 2023-08-17T17:53:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53dd7fa700 1 -- 172.21.15.78:0/192115580 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4011a70 con 0x7f53e8069bb0 2023-08-17T17:53:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.012+0000 7f53ee282700 1 -- 172.21.15.78:0/192115580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e8164070 con 0x7f53e8069bb0 2023-08-17T17:53:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.013+0000 7f53ee282700 1 -- 172.21.15.78:0/192115580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e80c4d60 con 0x7f53e8069bb0 2023-08-17T17:53:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.014+0000 7f53dd7fa700 1 -- 172.21.15.78:0/192115580 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f53e4012420 con 0x7f53e8069bb0 2023-08-17T17:53:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.014+0000 7f53dd7fa700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f53cc05ee80 0x7f53cc061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.014+0000 7f53ed280700 1 -- 172.21.15.78:0/192115580 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f53cc05ee80 msgr2=0x7f53cc061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.014+0000 7f53dd7fa700 1 -- 172.21.15.78:0/192115580 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f53e4079770 con 0x7f53e8069bb0 2023-08-17T17:53:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.014+0000 7f53ed280700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f53cc05ee80 0x7f53cc061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.018+0000 7f53dd7fa700 1 -- 172.21.15.78:0/192115580 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f53e404ab80 con 0x7f53e8069bb0 2023-08-17T17:53:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.188+0000 7f53ee282700 1 -- 172.21.15.78:0/192115580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53e8068260 con 0x7f53e8069bb0 2023-08-17T17:53:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.189+0000 7f53dd7fa700 1 -- 172.21.15.78:0/192115580 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+17235 (secure 0 0 0) 0x7f53e4077e60 con 0x7f53e8069bb0 2023-08-17T17:53:04.190 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:04.191 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":122,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:52:13.546178+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:51:56.265536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T17:51:56.677038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/595103412":"2023-08-18T17:52:13.546134+0000","172.21.15.78:6833/119464":"2023-08-18T17:52:13.546134+0000","172.21.15.78:6832/119464":"2023-08-18T17:52:13.546134+0000","172.21.15.78:0/3551145828":"2023-08-18T17:52:13.546134+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 -- 172.21.15.78:0/192115580 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f53cc05ee80 msgr2=0x7f53cc061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f53cc05ee80 0x7f53cc061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 -- 172.21.15.78:0/192115580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 msgr2=0x7f53e80a8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 0x7f53e80a8c10 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f53e400d890 tx=0x7f53e4008040).stop 2023-08-17T17:53:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 -- 172.21.15.78:0/192115580 shutdown_connections 2023-08-17T17:53:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f53cc05ee80 0x7f53cc061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53e80c5060 0x7f53e80a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53e80624f0 0x7f53e8147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 --2- 172.21.15.78:0/192115580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53e8069bb0 0x7f53e80a8c10 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 -- 172.21.15.78:0/192115580 >> 172.21.15.78:0/192115580 conn(0x7f53e80aabf0 msgr2=0x7f53e80660b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:04.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 -- 172.21.15.78:0/192115580 shutdown_connections 2023-08-17T17:53:04.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.191+0000 7f53ee282700 1 -- 172.21.15.78:0/192115580 wait complete. 2023-08-17T17:53:04.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:51:56.265536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:51:56.677038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:53:04.205 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:53:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.325+0000 7f0741a70700 1 Processor -- start 2023-08-17T17:53:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.326+0000 7f0741a70700 1 -- start start 2023-08-17T17:53:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.326+0000 7f0741a70700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f073c14e680 0x7f073c0c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.326+0000 7f0741a70700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f073c14ea60 0x7f073c0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.326+0000 7f0741a70700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c0c5990 con 0x7f073c069310 2023-08-17T17:53:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.326+0000 7f0741a70700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073c0bcc10 con 0x7f073c14ea60 2023-08-17T17:53:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.326+0000 7f0741a70700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073c0c4120 con 0x7f073c14e680 2023-08-17T17:53:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.326+0000 7f0733fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f073c14ea60 0x7f073c0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f073bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f073c069310 0x7f073c1548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53778/0 (socket says 172.21.15.78:53778) 2023-08-17T17:53:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f073bfff700 1 -- 172.21.15.78:0/579386550 learned_addr learned my addr 172.21.15.78:0/579386550 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f073b7fe700 1 --2- 172.21.15.78:0/579386550 >> v2:172.21.15.150:3300/0 conn(0x7f073c14e680 0x7f073c0c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f0733fff700 1 -- 172.21.15.78:0/579386550 >> v2:172.21.15.150:3300/0 conn(0x7f073c14e680 msgr2=0x7f073c0c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:04.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f0733fff700 1 --2- 172.21.15.78:0/579386550 >> v2:172.21.15.150:3300/0 conn(0x7f073c14e680 0x7f073c0c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f0733fff700 1 -- 172.21.15.78:0/579386550 >> v1:172.21.15.78:6789/0 conn(0x7f073c069310 legacy=0x7f073c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f073affd700 1 -- 172.21.15.78:0/579386550 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973773421 0 0) 0x7f073c0c5990 con 0x7f073c069310 2023-08-17T17:53:04.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f0733fff700 1 -- 172.21.15.78:0/579386550 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0c3880 con 0x7f073c14ea60 2023-08-17T17:53:04.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f0733fff700 1 --2- 172.21.15.78:0/579386550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14ea60 0x7f073c0c3290 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f073c067380 tx=0x7f0724009060).ready entity=mon.0 client_cookie=ca96c76b37a4c639 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:04.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f073affd700 1 -- 172.21.15.78:0/579386550 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400b580 con 0x7f073c14ea60 2023-08-17T17:53:04.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f073affd700 1 -- 172.21.15.78:0/579386550 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072400b6e0 con 0x7f073c14ea60 2023-08-17T17:53:04.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.327+0000 7f073affd700 1 -- 172.21.15.78:0/579386550 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400ba60 con 0x7f073c14ea60 2023-08-17T17:53:04.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.328+0000 7f0741a70700 1 -- 172.21.15.78:0/579386550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14ea60 msgr2=0x7f073c0c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.328+0000 7f0741a70700 1 --2- 172.21.15.78:0/579386550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14ea60 0x7f073c0c3290 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f073c067380 tx=0x7f0724009060).stop 2023-08-17T17:53:04.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.328+0000 7f0741a70700 1 -- 172.21.15.78:0/579386550 shutdown_connections 2023-08-17T17:53:04.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.328+0000 7f0741a70700 1 --2- 172.21.15.78:0/579386550 >> v2:172.21.15.150:3300/0 conn(0x7f073c14e680 0x7f073c0c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.328+0000 7f0741a70700 1 --2- 172.21.15.78:0/579386550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14ea60 0x7f073c0c3290 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.328+0000 7f0741a70700 1 -- 172.21.15.78:0/579386550 >> 172.21.15.78:0/579386550 conn(0x7f073c0c7b80 msgr2=0x7f073c0c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:04.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.328+0000 7f0741a70700 1 -- 172.21.15.78:0/579386550 shutdown_connections 2023-08-17T17:53:04.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.328+0000 7f0741a70700 1 -- 172.21.15.78:0/579386550 wait complete. 2023-08-17T17:53:04.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.329+0000 7f0741a70700 1 Processor -- start 2023-08-17T17:53:04.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.329+0000 7f0741a70700 1 -- start start 2023-08-17T17:53:04.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0741a70700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f073c069310 0x7f073c143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0741a70700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14e680 0x7f073c0ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0741a70700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f073c14ea60 0x7f073c14d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0741a70700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0aa5c0 con 0x7f073c14e680 2023-08-17T17:53:04.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0741a70700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0a9a40 con 0x7f073c069310 2023-08-17T17:53:04.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0741a70700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0a9d20 con 0x7f073c14ea60 2023-08-17T17:53:04.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0733fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14e680 0x7f073c0ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0733fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14e680 0x7f073c0ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48120/0 (socket says 172.21.15.78:48120) 2023-08-17T17:53:04.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0733fff700 1 -- 172.21.15.78:0/546720985 learned_addr learned my addr 172.21.15.78:0/546720985 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:04.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f073b7fe700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f073c069310 0x7f073c143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f073bfff700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f073c14ea60 0x7f073c14d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0733fff700 1 -- 172.21.15.78:0/546720985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f073c14ea60 msgr2=0x7f073c14d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0733fff700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f073c14ea60 0x7f073c14d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0733fff700 1 -- 172.21.15.78:0/546720985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f073c069310 msgr2=0x7f073c143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0733fff700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f073c069310 0x7f073c143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0733fff700 1 -- 172.21.15.78:0/546720985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07240092a0 con 0x7f073c14e680 2023-08-17T17:53:04.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f073bfff700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f073c14ea60 0x7f073c14d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:04.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f0733fff700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14e680 0x7f073c0ad6c0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f0724009fd0 tx=0x7f0724017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:04.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.330+0000 7f07337fe700 1 -- 172.21.15.78:0/546720985 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400b850 con 0x7f073c14e680 2023-08-17T17:53:04.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.331+0000 7f0741a70700 1 -- 172.21.15.78:0/546720985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c0aa000 con 0x7f073c14e680 2023-08-17T17:53:04.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.331+0000 7f07337fe700 1 -- 172.21.15.78:0/546720985 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072400b9b0 con 0x7f073c14e680 2023-08-17T17:53:04.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.331+0000 7f07337fe700 1 -- 172.21.15.78:0/546720985 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072401b620 con 0x7f073c14e680 2023-08-17T17:53:04.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.331+0000 7f0741a70700 1 -- 172.21.15.78:0/546720985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c0adbb0 con 0x7f073c14e680 2023-08-17T17:53:04.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.331+0000 7f0741a70700 1 -- 172.21.15.78:0/546720985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073c068270 con 0x7f073c14e680 2023-08-17T17:53:04.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.332+0000 7f07337fe700 1 -- 172.21.15.78:0/546720985 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f072402b070 con 0x7f073c14e680 2023-08-17T17:53:04.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.333+0000 7f07337fe700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071c05eeb0 0x7f071c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.333+0000 7f073b7fe700 1 -- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071c05eeb0 msgr2=0x7f071c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:04.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.333+0000 7f07337fe700 1 -- 172.21.15.78:0/546720985 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f072407b630 con 0x7f073c14e680 2023-08-17T17:53:04.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.333+0000 7f073b7fe700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071c05eeb0 0x7f071c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:04.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.337+0000 7f07337fe700 1 -- 172.21.15.78:0/546720985 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f072404caa0 con 0x7f073c14e680 2023-08-17T17:53:04.392 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:04.390+0000 7f5019367680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:53:04.445 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:04.436+0000 7fe0c9380680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:53:04.463 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:04.462+0000 7f5019367680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:53:04.510 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:04.509+0000 7fe0c9380680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:53:04.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.534+0000 7f073b7fe700 1 -- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071c05eeb0 msgr2=0x7f071c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:04.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.534+0000 7f073b7fe700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071c05eeb0 0x7f071c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:04.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.540+0000 7f0741a70700 1 -- 172.21.15.78:0/546720985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f073c0c1b30 con 0x7f073c14e680 2023-08-17T17:53:04.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.540+0000 7f07337fe700 1 -- 172.21.15.78:0/546720985 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v122) v1 ==== 110+0+10 (secure 0 0 0) 0x7f07240290b0 con 0x7f073c14e680 2023-08-17T17:53:04.542 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:53:04.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 -- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071c05eeb0 msgr2=0x7f071c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:04.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071c05eeb0 0x7f071c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:04.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 -- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14e680 msgr2=0x7f073c0ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14e680 0x7f073c0ad6c0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f0724009fd0 tx=0x7f0724017000).stop 2023-08-17T17:53:04.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 -- 172.21.15.78:0/546720985 shutdown_connections 2023-08-17T17:53:04.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071c05eeb0 0x7f071c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:04.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f073c14ea60 0x7f073c14d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f073c069310 0x7f073c143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 --2- 172.21.15.78:0/546720985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f073c14e680 0x7f073c0ad6c0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 -- 172.21.15.78:0/546720985 >> 172.21.15.78:0/546720985 conn(0x7f073c0c7b80 msgr2=0x7f073c065dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:04.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 -- 172.21.15.78:0/546720985 shutdown_connections 2023-08-17T17:53:04.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.542+0000 7f0741a70700 1 -- 172.21.15.78:0/546720985 wait complete. 2023-08-17T17:53:04.556 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:53:04.650 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:04.649+0000 7f5019367680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:53:04.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.676+0000 7f422545f700 1 Processor -- start 2023-08-17T17:53:04.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.676+0000 7f422545f700 1 -- start start 2023-08-17T17:53:04.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f422545f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200aa250 0x7f42200c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f422545f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200c7ff0 con 0x7f42200c7b70 2023-08-17T17:53:04.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f422545f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200c71f0 con 0x7f42200c0de0 2023-08-17T17:53:04.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f422545f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42200c8770 con 0x7f42200aa250 2023-08-17T17:53:04.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f421e7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f42200c7b70 0x7f42200c06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53784/0 (socket says 172.21.15.78:53784) 2023-08-17T17:53:04.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f421e7fc700 1 -- 172.21.15.78:0/1008653979 learned_addr learned my addr 172.21.15.78:0/1008653979 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:04.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f421effd700 1 --2- 172.21.15.78:0/1008653979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200aa250 0x7f42200c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f421dffb700 1 -- 172.21.15.78:0/1008653979 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229487859 0 0) 0x7f42200c7ff0 con 0x7f42200c7b70 2023-08-17T17:53:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f421dffb700 1 -- 172.21.15.78:0/1008653979 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42080033f0 con 0x7f42200c7b70 2023-08-17T17:53:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f421dffb700 1 -- 172.21.15.78:0/1008653979 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707689610 0 0) 0x7f42200c71f0 con 0x7f42200c0de0 2023-08-17T17:53:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.677+0000 7f421dffb700 1 -- 172.21.15.78:0/1008653979 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42200c7ff0 con 0x7f42200c0de0 2023-08-17T17:53:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f421effd700 1 -- 172.21.15.78:0/1008653979 >> v1:172.21.15.150:6789/0 conn(0x7f42200c0de0 legacy=0x7f422015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f421effd700 1 -- 172.21.15.78:0/1008653979 >> v1:172.21.15.78:6789/0 conn(0x7f42200c7b70 legacy=0x7f42200c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f421effd700 1 -- 172.21.15.78:0/1008653979 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4220154400 con 0x7f42200aa250 2023-08-17T17:53:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f421effd700 1 --2- 172.21.15.78:0/1008653979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200aa250 0x7f42200c7680 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f4214009760 tx=0x7f4214006f40).ready entity=mon.2 client_cookie=b32f9cdfa90c7c18 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f421dffb700 1 -- 172.21.15.78:0/1008653979 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214005880 con 0x7f42200aa250 2023-08-17T17:53:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f421dffb700 1 -- 172.21.15.78:0/1008653979 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42140059e0 con 0x7f42200aa250 2023-08-17T17:53:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f421dffb700 1 -- 172.21.15.78:0/1008653979 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214005d60 con 0x7f42200aa250 2023-08-17T17:53:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f422545f700 1 -- 172.21.15.78:0/1008653979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200aa250 msgr2=0x7f42200c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f422545f700 1 --2- 172.21.15.78:0/1008653979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200aa250 0x7f42200c7680 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f4214009760 tx=0x7f4214006f40).stop 2023-08-17T17:53:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f422545f700 1 -- 172.21.15.78:0/1008653979 shutdown_connections 2023-08-17T17:53:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f422545f700 1 --2- 172.21.15.78:0/1008653979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200aa250 0x7f42200c7680 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.678+0000 7f422545f700 1 -- 172.21.15.78:0/1008653979 >> 172.21.15.78:0/1008653979 conn(0x7f42200944f0 msgr2=0x7f422006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:04.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.679+0000 7f422545f700 1 -- 172.21.15.78:0/1008653979 shutdown_connections 2023-08-17T17:53:04.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.679+0000 7f422545f700 1 -- 172.21.15.78:0/1008653979 wait complete. 2023-08-17T17:53:04.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.680+0000 7f422545f700 1 Processor -- start 2023-08-17T17:53:04.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.680+0000 7f422545f700 1 -- start start 2023-08-17T17:53:04.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.680+0000 7f422545f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42200aa250 0x7f4220155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.680+0000 7f422545f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42200c0de0 0x7f4220164260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.680+0000 7f422545f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200c7b70 0x7f4220157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f422545f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4220156080 con 0x7f42200aa250 2023-08-17T17:53:04.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f422545f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4220156360 con 0x7f42200c0de0 2023-08-17T17:53:04.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f422545f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4220156640 con 0x7f42200c7b70 2023-08-17T17:53:04.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42200aa250 0x7f4220155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42200aa250 0x7f4220155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48128/0 (socket says 172.21.15.78:48128) 2023-08-17T17:53:04.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421effd700 1 -- 172.21.15.78:0/3261558038 learned_addr learned my addr 172.21.15.78:0/3261558038 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:04.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421e7fc700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42200c0de0 0x7f4220164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421f7fe700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200c7b70 0x7f4220157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421effd700 1 -- 172.21.15.78:0/3261558038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200c7b70 msgr2=0x7f4220157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421effd700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200c7b70 0x7f4220157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421effd700 1 -- 172.21.15.78:0/3261558038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42200c0de0 msgr2=0x7f4220164260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421effd700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42200c0de0 0x7f4220164260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421effd700 1 -- 172.21.15.78:0/3261558038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4214009250 con 0x7f42200aa250 2023-08-17T17:53:04.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f421effd700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42200aa250 0x7f4220155af0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f4220062540 tx=0x7f4214015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:04.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f4206ffd700 1 -- 172.21.15.78:0/3261558038 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214005880 con 0x7f42200aa250 2023-08-17T17:53:04.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f4206ffd700 1 -- 172.21.15.78:0/3261558038 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421400d6b0 con 0x7f42200aa250 2023-08-17T17:53:04.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f422545f700 1 -- 172.21.15.78:0/3261558038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4220156920 con 0x7f42200aa250 2023-08-17T17:53:04.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f4206ffd700 1 -- 172.21.15.78:0/3261558038 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421400da30 con 0x7f42200aa250 2023-08-17T17:53:04.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.681+0000 7f422545f700 1 -- 172.21.15.78:0/3261558038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4220164750 con 0x7f42200aa250 2023-08-17T17:53:04.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.682+0000 7f4206ffd700 1 -- 172.21.15.78:0/3261558038 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f421400f070 con 0x7f42200aa250 2023-08-17T17:53:04.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.682+0000 7f422545f700 1 -- 172.21.15.78:0/3261558038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422005f910 con 0x7f42200aa250 2023-08-17T17:53:04.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.683+0000 7f4206ffd700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f420c05eeb0 0x7f420c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.683+0000 7f421e7fc700 1 -- 172.21.15.78:0/3261558038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f420c05eeb0 msgr2=0x7f420c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:04.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.683+0000 7f4206ffd700 1 -- 172.21.15.78:0/3261558038 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f421407b6d0 con 0x7f42200aa250 2023-08-17T17:53:04.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.683+0000 7f421e7fc700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f420c05eeb0 0x7f420c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:04.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.687+0000 7f4206ffd700 1 -- 172.21.15.78:0/3261558038 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f421404cb40 con 0x7f42200aa250 2023-08-17T17:53:04.707 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:04.706+0000 7fe0c9380680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:53:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.857+0000 7f422545f700 1 -- 172.21.15.78:0/3261558038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42200a9e70 con 0x7f42200aa250 2023-08-17T17:53:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.857+0000 7f4206ffd700 1 -- 172.21.15.78:0/3261558038 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v122) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4214050160 con 0x7f42200aa250 2023-08-17T17:53:04.859 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:53:04.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 -- 172.21.15.78:0/3261558038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f420c05eeb0 msgr2=0x7f420c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:04.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f420c05eeb0 0x7f420c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:04.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 -- 172.21.15.78:0/3261558038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42200aa250 msgr2=0x7f4220155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42200aa250 0x7f4220155af0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f4220062540 tx=0x7f4214015000).stop 2023-08-17T17:53:04.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 -- 172.21.15.78:0/3261558038 shutdown_connections 2023-08-17T17:53:04.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f420c05eeb0 0x7f420c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:04.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42200c7b70 0x7f4220157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42200aa250 0x7f4220155af0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 --2- 172.21.15.78:0/3261558038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42200c0de0 0x7f4220164260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 -- 172.21.15.78:0/3261558038 >> 172.21.15.78:0/3261558038 conn(0x7f42200944f0 msgr2=0x7f42200ca0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 -- 172.21.15.78:0/3261558038 shutdown_connections 2023-08-17T17:53:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.859+0000 7f422545f700 1 -- 172.21.15.78:0/3261558038 wait complete. 2023-08-17T17:53:04.873 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:53:04.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.993+0000 7f84d937e700 1 Processor -- start 2023-08-17T17:53:04.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.993+0000 7f84d937e700 1 -- start start 2023-08-17T17:53:04.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.994+0000 7f84d937e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84d40c8730 0x7f84d40624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.994+0000 7f84d937e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f84d40629e0 0x7f84d4065940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:04.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.994+0000 7f84d937e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40654b0 con 0x7f84d4138610 2023-08-17T17:53:04.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.994+0000 7f84d937e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d40bd3f0 con 0x7f84d40c8730 2023-08-17T17:53:04.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.994+0000 7f84d937e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d4065210 con 0x7f84d40629e0 2023-08-17T17:53:04.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.994+0000 7f84d37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84d40c8730 0x7f84d40624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.994+0000 7f84d37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84d40c8730 0x7f84d40624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48140/0 (socket says 172.21.15.78:48140) 2023-08-17T17:53:04.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.994+0000 7f84d37fe700 1 -- 172.21.15.78:0/1211173942 learned_addr learned my addr 172.21.15.78:0/1211173942 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:04.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.994+0000 7f84d8b7d700 1 --2- 172.21.15.78:0/1211173942 >> v2:172.21.15.150:3300/0 conn(0x7f84d40629e0 0x7f84d4065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:04.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d37fe700 1 -- 172.21.15.78:0/1211173942 >> v2:172.21.15.150:3300/0 conn(0x7f84d40629e0 msgr2=0x7f84d4065940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:04.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d37fe700 1 --2- 172.21.15.78:0/1211173942 >> v2:172.21.15.150:3300/0 conn(0x7f84d40629e0 0x7f84d4065940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:04.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d37fe700 1 -- 172.21.15.78:0/1211173942 >> v1:172.21.15.150:6789/0 conn(0x7f84d4138610 legacy=0x7f84d4069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:04.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d37fe700 1 -- 172.21.15.78:0/1211173942 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d4062e70 con 0x7f84d40c8730 2023-08-17T17:53:04.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d37fe700 1 --2- 172.21.15.78:0/1211173942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d40c8730 0x7f84d40624f0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f84d40aa880 tx=0x7f84c40090f0).ready entity=mon.0 client_cookie=ec1aaa97e504dc42 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d2ffd700 1 -- 172.21.15.78:0/1211173942 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c400b520 con 0x7f84d40c8730 2023-08-17T17:53:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d2ffd700 1 -- 172.21.15.78:0/1211173942 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c400b680 con 0x7f84d40c8730 2023-08-17T17:53:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d2ffd700 1 -- 172.21.15.78:0/1211173942 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c400ba00 con 0x7f84d40c8730 2023-08-17T17:53:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d937e700 1 -- 172.21.15.78:0/1211173942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d40c8730 msgr2=0x7f84d40624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d937e700 1 --2- 172.21.15.78:0/1211173942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d40c8730 0x7f84d40624f0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f84d40aa880 tx=0x7f84c40090f0).stop 2023-08-17T17:53:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d937e700 1 -- 172.21.15.78:0/1211173942 shutdown_connections 2023-08-17T17:53:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d937e700 1 --2- 172.21.15.78:0/1211173942 >> v2:172.21.15.150:3300/0 conn(0x7f84d40629e0 0x7f84d4065940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d937e700 1 --2- 172.21.15.78:0/1211173942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d40c8730 0x7f84d40624f0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.995+0000 7f84d937e700 1 -- 172.21.15.78:0/1211173942 >> 172.21.15.78:0/1211173942 conn(0x7f84d40c7c10 msgr2=0x7f84d40c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.996+0000 7f84d937e700 1 -- 172.21.15.78:0/1211173942 shutdown_connections 2023-08-17T17:53:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.996+0000 7f84d937e700 1 -- 172.21.15.78:0/1211173942 wait complete. 2023-08-17T17:53:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.997+0000 7f84d937e700 1 Processor -- start 2023-08-17T17:53:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.997+0000 7f84d937e700 1 -- start start 2023-08-17T17:53:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.997+0000 7f84d937e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d40629e0 0x7f84d40ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d937e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d40c8730 0x7f84d414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d937e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d4138610 0x7f84d40ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d937e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40c1c40 con 0x7f84d4138610 2023-08-17T17:53:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d937e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40ad990 con 0x7f84d40c8730 2023-08-17T17:53:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d937e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4152bd0 con 0x7f84d40629e0 2023-08-17T17:53:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d8b7d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d4138610 0x7f84d40ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d8b7d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d4138610 0x7f84d40ac6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48146/0 (socket says 172.21.15.78:48146) 2023-08-17T17:53:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d8b7d700 1 -- 172.21.15.78:0/837306528 learned_addr learned my addr 172.21.15.78:0/837306528 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d37fe700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d40c8730 0x7f84d414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d3fff700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d40629e0 0x7f84d40ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d8b7d700 1 -- 172.21.15.78:0/837306528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d40629e0 msgr2=0x7f84d40ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d8b7d700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d40629e0 0x7f84d40ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d8b7d700 1 -- 172.21.15.78:0/837306528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d40c8730 msgr2=0x7f84d414eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d8b7d700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d40c8730 0x7f84d414eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d8b7d700 1 -- 172.21.15.78:0/837306528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4009370 con 0x7f84d4138610 2023-08-17T17:53:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d8b7d700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d4138610 0x7f84d40ac6c0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f84cc009e90 tx=0x7f84cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84bbfff700 1 -- 172.21.15.78:0/837306528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00caa0 con 0x7f84d4138610 2023-08-17T17:53:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84bbfff700 1 -- 172.21.15.78:0/837306528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc00f040 con 0x7f84d4138610 2023-08-17T17:53:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d937e700 1 -- 172.21.15.78:0/837306528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d40be840 con 0x7f84d4138610 2023-08-17T17:53:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84bbfff700 1 -- 172.21.15.78:0/837306528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00ce10 con 0x7f84d4138610 2023-08-17T17:53:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.998+0000 7f84d937e700 1 -- 172.21.15.78:0/837306528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d40bee00 con 0x7f84d4138610 2023-08-17T17:53:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:04.999+0000 7f84d937e700 1 -- 172.21.15.78:0/837306528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d405f910 con 0x7f84d4138610 2023-08-17T17:53:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.000+0000 7f84bbfff700 1 -- 172.21.15.78:0/837306528 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f84cc013610 con 0x7f84d4138610 2023-08-17T17:53:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.000+0000 7f84bbfff700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f84c005eeb0 0x7f84c0061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.000+0000 7f84d3fff700 1 -- 172.21.15.78:0/837306528 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f84c005eeb0 msgr2=0x7f84c0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.000+0000 7f84bbfff700 1 -- 172.21.15.78:0/837306528 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f84cc07a660 con 0x7f84d4138610 2023-08-17T17:53:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.000+0000 7f84d3fff700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f84c005eeb0 0x7f84c0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.004+0000 7f84bbfff700 1 -- 172.21.15.78:0/837306528 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84cc04bad0 con 0x7f84d4138610 2023-08-17T17:53:05.072 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:05.071+0000 7f5019367680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:53:05.145 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:05.144+0000 7fe0c9380680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:53:05.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.173+0000 7f84d937e700 1 -- 172.21.15.78:0/837306528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84d4046af0 con 0x7f84d4138610 2023-08-17T17:53:05.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.173+0000 7f84bbfff700 1 -- 172.21.15.78:0/837306528 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v122) v1 ==== 104+0+11 (secure 0 0 0) 0x7f84cc04f0f0 con 0x7f84d4138610 2023-08-17T17:53:05.175 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:53:05.176 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:05.174+0000 7f5019367680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 -- 172.21.15.78:0/837306528 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f84c005eeb0 msgr2=0x7f84c0061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f84c005eeb0 0x7f84c0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 -- 172.21.15.78:0/837306528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d4138610 msgr2=0x7f84d40ac6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d4138610 0x7f84d40ac6c0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f84cc009e90 tx=0x7f84cc00b040).stop 2023-08-17T17:53:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 -- 172.21.15.78:0/837306528 shutdown_connections 2023-08-17T17:53:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f84c005eeb0 0x7f84c0061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d4138610 0x7f84d40ac6c0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d40629e0 0x7f84d40ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 --2- 172.21.15.78:0/837306528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d40c8730 0x7f84d414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 -- 172.21.15.78:0/837306528 >> 172.21.15.78:0/837306528 conn(0x7f84d40c7c10 msgr2=0x7f84d40c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 -- 172.21.15.78:0/837306528 shutdown_connections 2023-08-17T17:53:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.175+0000 7f84d937e700 1 -- 172.21.15.78:0/837306528 wait complete. 2023-08-17T17:53:05.189 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:53:05.256 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:05.255+0000 7fe0c9380680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:05.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.307+0000 7f74a6ae3700 1 Processor -- start 2023-08-17T17:53:05.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.307+0000 7f74a6ae3700 1 -- start start 2023-08-17T17:53:05.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f74a6ae3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74a0153e40 0x7f74a0154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f74a6ae3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a00640c0 0x7f74a0064f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f74a6ae3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a00c7ba0 con 0x7f74a00a5a80 2023-08-17T17:53:05.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f74a6ae3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a00c6f90 con 0x7f74a0153e40 2023-08-17T17:53:05.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f74a6ae3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00c7270 con 0x7f74a00640c0 2023-08-17T17:53:05.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f74a487f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74a0153e40 0x7f74a0154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f749ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a00640c0 0x7f74a0064f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f74a487f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74a0153e40 0x7f74a0154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:43738/0 (socket says 172.21.15.78:43738) 2023-08-17T17:53:05.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f74a5080700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f74a00a5a80 0x7f74a00be4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:52794/0 (socket says 172.21.15.78:52794) 2023-08-17T17:53:05.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f749ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a00640c0 0x7f74a0064f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:36480/0 (socket says 172.21.15.78:36480) 2023-08-17T17:53:05.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.308+0000 7f74a487f700 1 -- 172.21.15.78:0/3369694301 learned_addr learned my addr 172.21.15.78:0/3369694301 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:05.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.309+0000 7f749ffff700 1 -- 172.21.15.78:0/3369694301 >> v2:172.21.15.150:3300/0 conn(0x7f74a0153e40 msgr2=0x7f74a0154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:05.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.309+0000 7f749ffff700 1 --2- 172.21.15.78:0/3369694301 >> v2:172.21.15.150:3300/0 conn(0x7f74a0153e40 0x7f74a0154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.309+0000 7f749ffff700 1 -- 172.21.15.78:0/3369694301 >> v1:172.21.15.150:6789/0 conn(0x7f74a00a5a80 legacy=0x7f74a00be4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.309+0000 7f749ffff700 1 -- 172.21.15.78:0/3369694301 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a00c7550 con 0x7f74a00640c0 2023-08-17T17:53:05.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.309+0000 7f749f7fe700 1 -- 172.21.15.78:0/3369694301 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478393930 0 0) 0x7f74a00c7ba0 con 0x7f74a00a5a80 2023-08-17T17:53:05.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.309+0000 7f74a487f700 1 --2- 172.21.15.78:0/3369694301 >> v2:172.21.15.150:3300/0 conn(0x7f74a0153e40 0x7f74a0154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:05.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.309+0000 7f749ffff700 1 --2- 172.21.15.78:0/3369694301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a00640c0 0x7f74a0064f00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f748c009760 tx=0x7f748c009060).ready entity=mon.2 client_cookie=623ec648859e177a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:05.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.309+0000 7f749f7fe700 1 -- 172.21.15.78:0/3369694301 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c00f510 con 0x7f74a00640c0 2023-08-17T17:53:05.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.309+0000 7f749f7fe700 1 -- 172.21.15.78:0/3369694301 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c00f670 con 0x7f74a00640c0 2023-08-17T17:53:05.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.309+0000 7f749f7fe700 1 -- 172.21.15.78:0/3369694301 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c00f9f0 con 0x7f74a00640c0 2023-08-17T17:53:05.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.310+0000 7f74a6ae3700 1 -- 172.21.15.78:0/3369694301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a00640c0 msgr2=0x7f74a0064f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.310+0000 7f74a6ae3700 1 --2- 172.21.15.78:0/3369694301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a00640c0 0x7f74a0064f00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f748c009760 tx=0x7f748c009060).stop 2023-08-17T17:53:05.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.310+0000 7f74a6ae3700 1 -- 172.21.15.78:0/3369694301 shutdown_connections 2023-08-17T17:53:05.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.310+0000 7f74a6ae3700 1 --2- 172.21.15.78:0/3369694301 >> v2:172.21.15.150:3300/0 conn(0x7f74a0153e40 0x7f74a0154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.310+0000 7f74a6ae3700 1 --2- 172.21.15.78:0/3369694301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a00640c0 0x7f74a0064f00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.310+0000 7f74a6ae3700 1 -- 172.21.15.78:0/3369694301 >> 172.21.15.78:0/3369694301 conn(0x7f74a00923c0 msgr2=0x7f74a0062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:05.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.310+0000 7f74a6ae3700 1 -- 172.21.15.78:0/3369694301 shutdown_connections 2023-08-17T17:53:05.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.310+0000 7f74a6ae3700 1 -- 172.21.15.78:0/3369694301 wait complete. 2023-08-17T17:53:05.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.311+0000 7f74a6ae3700 1 Processor -- start 2023-08-17T17:53:05.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.311+0000 7f74a6ae3700 1 -- start start 2023-08-17T17:53:05.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f74a6ae3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74a00640c0 0x7f74a0168350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f74a6ae3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a00a5a80 0x7f74a00c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f74a6ae3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a0153e40 0x7f74a0152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f74a6ae3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00c45f0 con 0x7f74a00a5a80 2023-08-17T17:53:05.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f74a6ae3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00c5130 con 0x7f74a00640c0 2023-08-17T17:53:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f74a6ae3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00c4800 con 0x7f74a0153e40 2023-08-17T17:53:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f749ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a00a5a80 0x7f74a00c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f74a487f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74a00640c0 0x7f74a0168350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f749ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a00a5a80 0x7f74a00c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48156/0 (socket says 172.21.15.78:48156) 2023-08-17T17:53:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f749ffff700 1 -- 172.21.15.78:0/1490812643 learned_addr learned my addr 172.21.15.78:0/1490812643 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f74a5080700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a0153e40 0x7f74a0152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f749ffff700 1 -- 172.21.15.78:0/1490812643 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a0153e40 msgr2=0x7f74a0152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f749ffff700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a0153e40 0x7f74a0152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f749ffff700 1 -- 172.21.15.78:0/1490812643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74a00640c0 msgr2=0x7f74a0168350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.312+0000 7f749ffff700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74a00640c0 0x7f74a0168350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.313+0000 7f749ffff700 1 -- 172.21.15.78:0/1490812643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494009300 con 0x7f74a00a5a80 2023-08-17T17:53:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.313+0000 7f749ffff700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a00a5a80 0x7f74a00c55c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f74a00c73b0 tx=0x7f748c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:05.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.313+0000 7f749cff9700 1 -- 172.21.15.78:0/1490812643 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c00f7e0 con 0x7f74a00a5a80 2023-08-17T17:53:05.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.313+0000 7f749cff9700 1 -- 172.21.15.78:0/1490812643 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c00f960 con 0x7f74a00a5a80 2023-08-17T17:53:05.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.313+0000 7f74a6ae3700 1 -- 172.21.15.78:0/1490812643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c0092a0 con 0x7f74a00a5a80 2023-08-17T17:53:05.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.313+0000 7f749cff9700 1 -- 172.21.15.78:0/1490812643 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c01b660 con 0x7f74a00a5a80 2023-08-17T17:53:05.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.313+0000 7f74a6ae3700 1 -- 172.21.15.78:0/1490812643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a00c4dc0 con 0x7f74a00a5a80 2023-08-17T17:53:05.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.314+0000 7f74a6ae3700 1 -- 172.21.15.78:0/1490812643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a00c52c0 con 0x7f74a00a5a80 2023-08-17T17:53:05.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.314+0000 7f749cff9700 1 -- 172.21.15.78:0/1490812643 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f748c02b070 con 0x7f74a00a5a80 2023-08-17T17:53:05.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.315+0000 7f749cff9700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f748405eeb0 0x7f7484061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.315+0000 7f74a487f700 1 -- 172.21.15.78:0/1490812643 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f748405eeb0 msgr2=0x7f7484061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:05.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.315+0000 7f749cff9700 1 -- 172.21.15.78:0/1490812643 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f748c07b360 con 0x7f74a00a5a80 2023-08-17T17:53:05.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.315+0000 7f74a487f700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f748405eeb0 0x7f7484061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.319+0000 7f749cff9700 1 -- 172.21.15.78:0/1490812643 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f748c04c7d0 con 0x7f74a00a5a80 2023-08-17T17:53:05.331 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:05.329+0000 7f5019367680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:05.406 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:05.405+0000 7f5019367680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:53:05.423 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:05.422+0000 7fe0c9380680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:05.473 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:05.472+0000 7f5019367680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:53:05.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.497+0000 7f74a6ae3700 1 -- 172.21.15.78:0/1490812643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74a00c7830 con 0x7f74a00a5a80 2023-08-17T17:53:05.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.498+0000 7f749cff9700 1 -- 172.21.15.78:0/1490812643 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v122) v1 ==== 100+0+11 (secure 0 0 0) 0x7f748c04fdf0 con 0x7f74a00a5a80 2023-08-17T17:53:05.500 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:53:05.500 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:05.499+0000 7fe0c9380680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:53:05.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 -- 172.21.15.78:0/1490812643 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f748405eeb0 msgr2=0x7f7484061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:05.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f748405eeb0 0x7f7484061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:05.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 -- 172.21.15.78:0/1490812643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a00a5a80 msgr2=0x7f74a00c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a00a5a80 0x7f74a00c55c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f74a00c73b0 tx=0x7f748c017000).stop 2023-08-17T17:53:05.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 -- 172.21.15.78:0/1490812643 shutdown_connections 2023-08-17T17:53:05.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f748405eeb0 0x7f7484061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:05.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74a0153e40 0x7f74a0152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74a00640c0 0x7f74a0168350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 --2- 172.21.15.78:0/1490812643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a00a5a80 0x7f74a00c55c0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 -- 172.21.15.78:0/1490812643 >> 172.21.15.78:0/1490812643 conn(0x7f74a00923c0 msgr2=0x7f74a0152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:05.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 -- 172.21.15.78:0/1490812643 shutdown_connections 2023-08-17T17:53:05.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.500+0000 7f74a6ae3700 1 -- 172.21.15.78:0/1490812643 wait complete. 2023-08-17T17:53:05.514 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:05.574 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:05.573+0000 7fe0c9380680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:53:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.630+0000 7fb014b97700 1 Processor -- start 2023-08-17T17:53:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.630+0000 7fb014b97700 1 -- start start 2023-08-17T17:53:05.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.631+0000 7fb014b97700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb0100bef00 0x7fb010064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.631+0000 7fb014b97700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb010065140 0x7fb0100c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.631+0000 7fb014b97700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0100c4040 con 0x7fb0100a7fe0 2023-08-17T17:53:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.631+0000 7fb014b97700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0100c7080 con 0x7fb0100bef00 2023-08-17T17:53:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.631+0000 7fb014b97700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0100c3430 con 0x7fb010065140 2023-08-17T17:53:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.631+0000 7fb00dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb0100bef00 0x7fb010064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb0100bef00 0x7fb010064180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48160/0 (socket says 172.21.15.78:48160) 2023-08-17T17:53:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00dd9b700 1 -- 172.21.15.78:0/3792709300 learned_addr learned my addr 172.21.15.78:0/3792709300 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00ed9d700 1 --2- 172.21.15.78:0/3792709300 >> v2:172.21.15.150:3300/0 conn(0x7fb010065140 0x7fb0100c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00dd9b700 1 -- 172.21.15.78:0/3792709300 >> v2:172.21.15.150:3300/0 conn(0x7fb010065140 msgr2=0x7fb0100c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:05.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00dd9b700 1 --2- 172.21.15.78:0/3792709300 >> v2:172.21.15.150:3300/0 conn(0x7fb010065140 0x7fb0100c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00dd9b700 1 -- 172.21.15.78:0/3792709300 >> v1:172.21.15.150:6789/0 conn(0x7fb0100a7fe0 legacy=0x7fb0100be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00dd9b700 1 -- 172.21.15.78:0/3792709300 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0100c3710 con 0x7fb0100bef00 2023-08-17T17:53:05.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00dd9b700 1 --2- 172.21.15.78:0/3792709300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100bef00 0x7fb010064180 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fb01006a260 tx=0x7fb0000090f0).ready entity=mon.0 client_cookie=69f4a357d04eb2b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:05.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00d59a700 1 -- 172.21.15.78:0/3792709300 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00000b520 con 0x7fb0100bef00 2023-08-17T17:53:05.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00d59a700 1 -- 172.21.15.78:0/3792709300 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00000b680 con 0x7fb0100bef00 2023-08-17T17:53:05.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.632+0000 7fb00d59a700 1 -- 172.21.15.78:0/3792709300 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00000ba00 con 0x7fb0100bef00 2023-08-17T17:53:05.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.633+0000 7fb014b97700 1 -- 172.21.15.78:0/3792709300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100bef00 msgr2=0x7fb010064180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.633+0000 7fb014b97700 1 --2- 172.21.15.78:0/3792709300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100bef00 0x7fb010064180 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fb01006a260 tx=0x7fb0000090f0).stop 2023-08-17T17:53:05.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.633+0000 7fb014b97700 1 -- 172.21.15.78:0/3792709300 shutdown_connections 2023-08-17T17:53:05.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.633+0000 7fb014b97700 1 --2- 172.21.15.78:0/3792709300 >> v2:172.21.15.150:3300/0 conn(0x7fb010065140 0x7fb0100c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.633+0000 7fb014b97700 1 --2- 172.21.15.78:0/3792709300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100bef00 0x7fb010064180 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.633+0000 7fb014b97700 1 -- 172.21.15.78:0/3792709300 >> 172.21.15.78:0/3792709300 conn(0x7fb010092330 msgr2=0x7fb010062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:05.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.633+0000 7fb014b97700 1 -- 172.21.15.78:0/3792709300 shutdown_connections 2023-08-17T17:53:05.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.633+0000 7fb014b97700 1 -- 172.21.15.78:0/3792709300 wait complete. 2023-08-17T17:53:05.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.634+0000 7fb014b97700 1 Processor -- start 2023-08-17T17:53:05.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.634+0000 7fb014b97700 1 -- start start 2023-08-17T17:53:05.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb014b97700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb010065140 0x7fb010152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb014b97700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100a7fe0 0x7fb0100c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb014b97700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0100bef00 0x7fb0100c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb014b97700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0100c4eb0 con 0x7fb0100a7fe0 2023-08-17T17:53:05.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb014b97700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0100c0cb0 con 0x7fb010065140 2023-08-17T17:53:05.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb014b97700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0100c0f90 con 0x7fb0100bef00 2023-08-17T17:53:05.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100a7fe0 0x7fb0100c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100a7fe0 0x7fb0100c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48162/0 (socket says 172.21.15.78:48162) 2023-08-17T17:53:05.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00dd9b700 1 -- 172.21.15.78:0/728150449 learned_addr learned my addr 172.21.15.78:0/728150449 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:05.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00e59c700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb010065140 0x7fb010152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00ed9d700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0100bef00 0x7fb0100c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00dd9b700 1 -- 172.21.15.78:0/728150449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0100bef00 msgr2=0x7fb0100c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00dd9b700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0100bef00 0x7fb0100c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00dd9b700 1 -- 172.21.15.78:0/728150449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb010065140 msgr2=0x7fb010152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00dd9b700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb010065140 0x7fb010152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00dd9b700 1 -- 172.21.15.78:0/728150449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000009370 con 0x7fb0100a7fe0 2023-08-17T17:53:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb00dd9b700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100a7fe0 0x7fb0100c44d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fb000011000 tx=0x7fb000017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb0067fc700 1 -- 172.21.15.78:0/728150449 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00000be90 con 0x7fb0100a7fe0 2023-08-17T17:53:05.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb0067fc700 1 -- 172.21.15.78:0/728150449 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00000b7f0 con 0x7fb0100a7fe0 2023-08-17T17:53:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.635+0000 7fb014b97700 1 -- 172.21.15.78:0/728150449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0100c1270 con 0x7fb0100a7fe0 2023-08-17T17:53:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.636+0000 7fb0067fc700 1 -- 172.21.15.78:0/728150449 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00001c670 con 0x7fb0100a7fe0 2023-08-17T17:53:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.636+0000 7fb014b97700 1 -- 172.21.15.78:0/728150449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0100c1830 con 0x7fb0100a7fe0 2023-08-17T17:53:05.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.636+0000 7fb014b97700 1 -- 172.21.15.78:0/728150449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb010047350 con 0x7fb0100a7fe0 2023-08-17T17:53:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.637+0000 7fb0067fc700 1 -- 172.21.15.78:0/728150449 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fb00000f070 con 0x7fb0100a7fe0 2023-08-17T17:53:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.637+0000 7fb0067fc700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faff005eeb0 0x7faff0061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.637+0000 7fb00e59c700 1 -- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faff005eeb0 msgr2=0x7faff0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:05.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.637+0000 7fb0067fc700 1 -- 172.21.15.78:0/728150449 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fb00007b640 con 0x7fb0100a7fe0 2023-08-17T17:53:05.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.637+0000 7fb00e59c700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faff005eeb0 0x7faff0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:05.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.641+0000 7fb0067fc700 1 -- 172.21.15.78:0/728150449 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb00004cab0 con 0x7fb0100a7fe0 2023-08-17T17:53:05.733 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:05.732+0000 7f5019367680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:53:05.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.838+0000 7fb00e59c700 1 -- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faff005eeb0 msgr2=0x7faff0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:05.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.838+0000 7fb00e59c700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faff005eeb0 0x7faff0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:05.844 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:05.843+0000 7fe0c9380680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:53:05.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.851+0000 7fb014b97700 1 -- 172.21.15.78:0/728150449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0100c39f0 con 0x7fb0100a7fe0 2023-08-17T17:53:05.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.852+0000 7fb0067fc700 1 -- 172.21.15.78:0/728150449 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fb0000500d0 con 0x7fb0100a7fe0 2023-08-17T17:53:05.853 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:05.853 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2905752860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2905752860},{"type":"v1","addr":"172.21.15.150:6833","nonce":2905752860}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7620,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/652553934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":652553934},{"type":"v1","addr":"172.21.15.78:6836","nonce":652553934}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7623,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/728629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":728629628},{"type":"v1","addr":"172.21.15.78:6837","nonce":728629628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:51:57.714922+0000","modified":"2023-08-17T17:51:59.721521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7641":{"gid":7641,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3422834327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3422834327},{"type":"v1","addr":"172.21.15.150:6835","nonce":3422834327}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T17:53:05.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 -- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faff005eeb0 msgr2=0x7faff0061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:05.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faff005eeb0 0x7faff0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:05.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 -- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100a7fe0 msgr2=0x7fb0100c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100a7fe0 0x7fb0100c44d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fb000011000 tx=0x7fb000017000).stop 2023-08-17T17:53:05.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 -- 172.21.15.78:0/728150449 shutdown_connections 2023-08-17T17:53:05.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faff005eeb0 0x7faff0061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:05.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0100bef00 0x7fb0100c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb010065140 0x7fb010152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 --2- 172.21.15.78:0/728150449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100a7fe0 0x7fb0100c44d0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 -- 172.21.15.78:0/728150449 >> 172.21.15.78:0/728150449 conn(0x7fb010092330 msgr2=0x7fb0100c8160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:05.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 -- 172.21.15.78:0/728150449 shutdown_connections 2023-08-17T17:53:05.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.854+0000 7fb014b97700 1 -- 172.21.15.78:0/728150449 wait complete. 2023-08-17T17:53:05.857 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 43 2023-08-17T17:53:05.867 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:05.917 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:05.915+0000 7f5019367680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:05.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.986+0000 7fa9f2396700 1 Processor -- start 2023-08-17T17:53:05.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.986+0000 7fa9f2396700 1 -- start start 2023-08-17T17:53:05.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.987+0000 7fa9f2396700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa9ec06a2c0 0x7fa9ec069050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.987+0000 7fa9f2396700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa9ec13aa20 0x7fa9ec069540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.987+0000 7fa9f2396700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9ec0c2c10 con 0x7fa9ec13a640 2023-08-17T17:53:05.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.987+0000 7fa9f2396700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9ec069a30 con 0x7fa9ec06a2c0 2023-08-17T17:53:05.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.987+0000 7fa9f2396700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9ec1552e0 con 0x7fa9ec13aa20 2023-08-17T17:53:05.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.987+0000 7fa9eb7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa9ec06a2c0 0x7fa9ec069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.987+0000 7fa9ebfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa9ec13a640 0x7fa9ec154b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53790/0 (socket says 172.21.15.78:53790) 2023-08-17T17:53:05.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.987+0000 7fa9ebfff700 1 -- 172.21.15.78:0/1268240129 learned_addr learned my addr 172.21.15.78:0/1268240129 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:05.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.987+0000 7fa9f0933700 1 --2- 172.21.15.78:0/1268240129 >> v2:172.21.15.150:3300/0 conn(0x7fa9ec13aa20 0x7fa9ec069540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.988+0000 7fa9eb7fe700 1 -- 172.21.15.78:0/1268240129 >> v2:172.21.15.150:3300/0 conn(0x7fa9ec13aa20 msgr2=0x7fa9ec069540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:05.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.988+0000 7fa9eb7fe700 1 --2- 172.21.15.78:0/1268240129 >> v2:172.21.15.150:3300/0 conn(0x7fa9ec13aa20 0x7fa9ec069540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.988+0000 7fa9eb7fe700 1 -- 172.21.15.78:0/1268240129 >> v1:172.21.15.78:6789/0 conn(0x7fa9ec13a640 legacy=0x7fa9ec154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.988+0000 7fa9eb7fe700 1 -- 172.21.15.78:0/1268240129 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec1555c0 con 0x7fa9ec06a2c0 2023-08-17T17:53:05.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.988+0000 7fa9eaffd700 1 -- 172.21.15.78:0/1268240129 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189798168 0 0) 0x7fa9ec0c2c10 con 0x7fa9ec13a640 2023-08-17T17:53:05.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.988+0000 7fa9f0933700 1 --2- 172.21.15.78:0/1268240129 >> v2:172.21.15.150:3300/0 conn(0x7fa9ec13aa20 0x7fa9ec069540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:05.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.988+0000 7fa9eb7fe700 1 --2- 172.21.15.78:0/1268240129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec06a2c0 0x7fa9ec069050 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7fa9ec0c88e0 tx=0x7fa9e0009060).ready entity=mon.0 client_cookie=a983003388fb2474 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:05.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.988+0000 7fa9eaffd700 1 -- 172.21.15.78:0/1268240129 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000b580 con 0x7fa9ec06a2c0 2023-08-17T17:53:05.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.988+0000 7fa9eaffd700 1 -- 172.21.15.78:0/1268240129 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e000b6e0 con 0x7fa9ec06a2c0 2023-08-17T17:53:05.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.988+0000 7fa9eaffd700 1 -- 172.21.15.78:0/1268240129 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000ba60 con 0x7fa9ec06a2c0 2023-08-17T17:53:05.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.989+0000 7fa9f2396700 1 -- 172.21.15.78:0/1268240129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec06a2c0 msgr2=0x7fa9ec069050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.989+0000 7fa9f2396700 1 --2- 172.21.15.78:0/1268240129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec06a2c0 0x7fa9ec069050 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7fa9ec0c88e0 tx=0x7fa9e0009060).stop 2023-08-17T17:53:05.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.989+0000 7fa9f2396700 1 -- 172.21.15.78:0/1268240129 shutdown_connections 2023-08-17T17:53:05.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.989+0000 7fa9f2396700 1 --2- 172.21.15.78:0/1268240129 >> v2:172.21.15.150:3300/0 conn(0x7fa9ec13aa20 0x7fa9ec069540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.989+0000 7fa9f2396700 1 --2- 172.21.15.78:0/1268240129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec06a2c0 0x7fa9ec069050 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.989+0000 7fa9f2396700 1 -- 172.21.15.78:0/1268240129 >> 172.21.15.78:0/1268240129 conn(0x7fa9ec0c7b00 msgr2=0x7fa9ec0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:05.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.989+0000 7fa9f2396700 1 -- 172.21.15.78:0/1268240129 shutdown_connections 2023-08-17T17:53:05.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.989+0000 7fa9f2396700 1 -- 172.21.15.78:0/1268240129 wait complete. 2023-08-17T17:53:05.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.990+0000 7fa9f2396700 1 Processor -- start 2023-08-17T17:53:05.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.990+0000 7fa9f2396700 1 -- start start 2023-08-17T17:53:05.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9f2396700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06a2c0 0x7fa9ec1347e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9f2396700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec13a640 0x7fa9ec0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9f2396700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec13aa20 0x7fa9ec0ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9f2396700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0bec40 con 0x7fa9ec13a640 2023-08-17T17:53:05.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9f2396700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0beee0 con 0x7fa9ec13aa20 2023-08-17T17:53:05.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9f2396700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0bf1c0 con 0x7fa9ec06a2c0 2023-08-17T17:53:05.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9eb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec13a640 0x7fa9ec0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9eb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec13a640 0x7fa9ec0acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48190/0 (socket says 172.21.15.78:48190) 2023-08-17T17:53:05.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9eb7fe700 1 -- 172.21.15.78:0/3683451989 learned_addr learned my addr 172.21.15.78:0/3683451989 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:05.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9ebfff700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06a2c0 0x7fa9ec1347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9f0933700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec13aa20 0x7fa9ec0ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:05.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9eb7fe700 1 -- 172.21.15.78:0/3683451989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06a2c0 msgr2=0x7fa9ec1347e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9eb7fe700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06a2c0 0x7fa9ec1347e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9eb7fe700 1 -- 172.21.15.78:0/3683451989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec13aa20 msgr2=0x7fa9ec0ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:05.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9eb7fe700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec13aa20 0x7fa9ec0ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:05.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9eb7fe700 1 -- 172.21.15.78:0/3683451989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00092a0 con 0x7fa9ec13a640 2023-08-17T17:53:05.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9eb7fe700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec13a640 0x7fa9ec0acdf0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7fa9e0009fd0 tx=0x7fa9e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:05.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.991+0000 7fa9d3fff700 1 -- 172.21.15.78:0/3683451989 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0000bc0 con 0x7fa9ec13a640 2023-08-17T17:53:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.992+0000 7fa9f2396700 1 -- 172.21.15.78:0/3683451989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ec0bf4a0 con 0x7fa9ec13a640 2023-08-17T17:53:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.992+0000 7fa9d3fff700 1 -- 172.21.15.78:0/3683451989 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e000b850 con 0x7fa9ec13a640 2023-08-17T17:53:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.992+0000 7fa9d3fff700 1 -- 172.21.15.78:0/3683451989 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0000d20 con 0x7fa9ec13a640 2023-08-17T17:53:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.992+0000 7fa9f2396700 1 -- 172.21.15.78:0/3683451989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec0ad7d0 con 0x7fa9ec13a640 2023-08-17T17:53:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.992+0000 7fa9f2396700 1 -- 172.21.15.78:0/3683451989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec047350 con 0x7fa9ec13a640 2023-08-17T17:53:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.993+0000 7fa9d3fff700 1 -- 172.21.15.78:0/3683451989 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fa9e002a070 con 0x7fa9ec13a640 2023-08-17T17:53:05.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.993+0000 7fa9d3fff700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa9d805eeb0 0x7fa9d8061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:05.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.993+0000 7fa9ebfff700 1 -- 172.21.15.78:0/3683451989 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa9d805eeb0 msgr2=0x7fa9d8061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:05.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.993+0000 7fa9d3fff700 1 -- 172.21.15.78:0/3683451989 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa9e007b210 con 0x7fa9ec13a640 2023-08-17T17:53:05.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:05.993+0000 7fa9ebfff700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa9d805eeb0 0x7fa9d8061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:06.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.002+0000 7fa9d3fff700 1 -- 172.21.15.78:0/3683451989 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa9e004c680 con 0x7fa9ec13a640 2023-08-17T17:53:06.039 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:06.038+0000 7fe0c9380680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.169+0000 7fa9f2396700 1 -- 172.21.15.78:0/3683451989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9ec06a0a0 con 0x7fa9ec13a640 2023-08-17T17:53:06.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.171+0000 7fa9d3fff700 1 -- 172.21.15.78:0/3683451989 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+17235 (secure 0 0 0) 0x7fa9e0028090 con 0x7fa9ec13a640 2023-08-17T17:53:06.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:06.173 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":122,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:52:13.546178+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:51:56.265536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T17:51:56.677038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/595103412":"2023-08-18T17:52:13.546134+0000","172.21.15.78:6833/119464":"2023-08-18T17:52:13.546134+0000","172.21.15.78:6832/119464":"2023-08-18T17:52:13.546134+0000","172.21.15.78:0/3551145828":"2023-08-18T17:52:13.546134+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:06.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 -- 172.21.15.78:0/3683451989 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa9d805eeb0 msgr2=0x7fa9d8061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:06.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa9d805eeb0 0x7fa9d8061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:06.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 -- 172.21.15.78:0/3683451989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec13a640 msgr2=0x7fa9ec0acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec13a640 0x7fa9ec0acdf0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7fa9e0009fd0 tx=0x7fa9e0017000).stop 2023-08-17T17:53:06.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 -- 172.21.15.78:0/3683451989 shutdown_connections 2023-08-17T17:53:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa9d805eeb0 0x7fa9d8061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec13aa20 0x7fa9ec0ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06a2c0 0x7fa9ec1347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 --2- 172.21.15.78:0/3683451989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9ec13a640 0x7fa9ec0acdf0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 -- 172.21.15.78:0/3683451989 >> 172.21.15.78:0/3683451989 conn(0x7fa9ec0c7b00 msgr2=0x7fa9ec0be280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:06.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 -- 172.21.15.78:0/3683451989 shutdown_connections 2023-08-17T17:53:06.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.173+0000 7fa9f2396700 1 -- 172.21.15.78:0/3683451989 wait complete. 2023-08-17T17:53:06.186 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T17:53:06.187 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.302+0000 7f679ad80700 1 Processor -- start 2023-08-17T17:53:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.302+0000 7f679ad80700 1 -- start start 2023-08-17T17:53:06.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.303+0000 7f679ad80700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6794151e40 0x7f6794152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:06.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.303+0000 7f679ad80700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67940bf210 con 0x7f67940be4d0 2023-08-17T17:53:06.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.303+0000 7f679ad80700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67940c5a80 con 0x7f67940a7c90 2023-08-17T17:53:06.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.303+0000 7f679ad80700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67940c5450 con 0x7f6794151e40 2023-08-17T17:53:06.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.303+0000 7f679931d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f67940be4d0 0x7f67940be900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53806/0 (socket says 172.21.15.78:53806) 2023-08-17T17:53:06.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.303+0000 7f679931d700 1 -- 172.21.15.78:0/3591032352 learned_addr learned my addr 172.21.15.78:0/3591032352 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:06.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.303+0000 7f6798b1c700 1 --2- 172.21.15.78:0/3591032352 >> v2:172.21.15.150:3300/0 conn(0x7f6794151e40 0x7f6794152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:06.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f67937fe700 1 -- 172.21.15.78:0/3591032352 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819115451 0 0) 0x7f67940bf210 con 0x7f67940be4d0 2023-08-17T17:53:06.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f67937fe700 1 -- 172.21.15.78:0/3591032352 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67840033f0 con 0x7f67940be4d0 2023-08-17T17:53:06.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f67937fe700 1 -- 172.21.15.78:0/3591032352 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545272083 0 0) 0x7f67940c5a80 con 0x7f67940a7c90 2023-08-17T17:53:06.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f67937fe700 1 -- 172.21.15.78:0/3591032352 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67940bf210 con 0x7f67940a7c90 2023-08-17T17:53:06.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f67937fe700 1 -- 172.21.15.78:0/3591032352 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340437035 0 0) 0x7f67840033f0 con 0x7f67940be4d0 2023-08-17T17:53:06.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f6798b1c700 1 -- 172.21.15.78:0/3591032352 >> v1:172.21.15.150:6789/0 conn(0x7f67940a7c90 legacy=0x7f67940c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f6798b1c700 1 -- 172.21.15.78:0/3591032352 >> v1:172.21.15.78:6789/0 conn(0x7f67940be4d0 legacy=0x7f67940be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f6798b1c700 1 -- 172.21.15.78:0/3591032352 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67941533f0 con 0x7f6794151e40 2023-08-17T17:53:06.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f6798b1c700 1 --2- 172.21.15.78:0/3591032352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6794151e40 0x7f6794152f00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f6788009760 tx=0x7f6788009060).ready entity=mon.1 client_cookie=9119c6c0222a13e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:06.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f67937fe700 1 -- 172.21.15.78:0/3591032352 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c0017f0 con 0x7f6794151e40 2023-08-17T17:53:06.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f67937fe700 1 -- 172.21.15.78:0/3591032352 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6788011400 con 0x7f6794151e40 2023-08-17T17:53:06.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.304+0000 7f67937fe700 1 -- 172.21.15.78:0/3591032352 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788011780 con 0x7f6794151e40 2023-08-17T17:53:06.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.305+0000 7f679ad80700 1 -- 172.21.15.78:0/3591032352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6794151e40 msgr2=0x7f6794152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.305+0000 7f679ad80700 1 --2- 172.21.15.78:0/3591032352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6794151e40 0x7f6794152f00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f6788009760 tx=0x7f6788009060).stop 2023-08-17T17:53:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.305+0000 7f679ad80700 1 -- 172.21.15.78:0/3591032352 shutdown_connections 2023-08-17T17:53:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.305+0000 7f679ad80700 1 --2- 172.21.15.78:0/3591032352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6794151e40 0x7f6794152f00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.305+0000 7f679ad80700 1 -- 172.21.15.78:0/3591032352 >> 172.21.15.78:0/3591032352 conn(0x7f6794092330 msgr2=0x7f6794062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.305+0000 7f679ad80700 1 -- 172.21.15.78:0/3591032352 shutdown_connections 2023-08-17T17:53:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.305+0000 7f679ad80700 1 -- 172.21.15.78:0/3591032352 wait complete. 2023-08-17T17:53:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.306+0000 7f679ad80700 1 Processor -- start 2023-08-17T17:53:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.306+0000 7f679ad80700 1 -- start start 2023-08-17T17:53:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f679ad80700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67940a7c90 0x7f67940ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f679ad80700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940be4d0 0x7f679414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f679ad80700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6794151e40 0x7f67940c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f679ad80700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67940c7490 con 0x7f67940be4d0 2023-08-17T17:53:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f679ad80700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679414c620 con 0x7f67940a7c90 2023-08-17T17:53:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f679ad80700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67940c8420 con 0x7f6794151e40 2023-08-17T17:53:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6793fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940be4d0 0x7f679414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6793fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940be4d0 0x7f679414c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48192/0 (socket says 172.21.15.78:48192) 2023-08-17T17:53:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6793fff700 1 -- 172.21.15.78:0/25057149 learned_addr learned my addr 172.21.15.78:0/25057149 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f679931d700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6794151e40 0x7f67940c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6798b1c700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67940a7c90 0x7f67940ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6793fff700 1 -- 172.21.15.78:0/25057149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6794151e40 msgr2=0x7f67940c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6793fff700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6794151e40 0x7f67940c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6793fff700 1 -- 172.21.15.78:0/25057149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67940a7c90 msgr2=0x7f67940ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6793fff700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67940a7c90 0x7f67940ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6793fff700 1 -- 172.21.15.78:0/25057149 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880092a0 con 0x7f67940be4d0 2023-08-17T17:53:06.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6793fff700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940be4d0 0x7f679414c130 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f678000c4f0 tx=0x7f6780007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:06.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.307+0000 7f6790ff9700 1 -- 172.21.15.78:0/25057149 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000ce20 con 0x7f67940be4d0 2023-08-17T17:53:06.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.308+0000 7f679ad80700 1 -- 172.21.15.78:0/25057149 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67940c68c0 con 0x7f67940be4d0 2023-08-17T17:53:06.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.308+0000 7f6790ff9700 1 -- 172.21.15.78:0/25057149 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678000f470 con 0x7f67940be4d0 2023-08-17T17:53:06.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.308+0000 7f6790ff9700 1 -- 172.21.15.78:0/25057149 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000f810 con 0x7f67940be4d0 2023-08-17T17:53:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.308+0000 7f679ad80700 1 -- 172.21.15.78:0/25057149 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67940c6e40 con 0x7f67940be4d0 2023-08-17T17:53:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.308+0000 7f679ad80700 1 -- 172.21.15.78:0/25057149 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6794047350 con 0x7f67940be4d0 2023-08-17T17:53:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.309+0000 7f6790ff9700 1 -- 172.21.15.78:0/25057149 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f6780019030 con 0x7f67940be4d0 2023-08-17T17:53:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.309+0000 7f6790ff9700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f677805eeb0 0x7f6778061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.309+0000 7f6798b1c700 1 -- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f677805eeb0 msgr2=0x7f6778061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.309+0000 7f6790ff9700 1 -- 172.21.15.78:0/25057149 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f6780079120 con 0x7f67940be4d0 2023-08-17T17:53:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.309+0000 7f6798b1c700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f677805eeb0 0x7f6778061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:06.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.313+0000 7f6790ff9700 1 -- 172.21.15.78:0/25057149 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f678004a590 con 0x7f67940be4d0 2023-08-17T17:53:06.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.510+0000 7f6798b1c700 1 -- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f677805eeb0 msgr2=0x7f6778061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:06.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.510+0000 7f6798b1c700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f677805eeb0 0x7f6778061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:06.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.528+0000 7f679ad80700 1 -- 172.21.15.78:0/25057149 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f679405f410 con 0x7f67940be4d0 2023-08-17T17:53:06.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.529+0000 7f6790ff9700 1 -- 172.21.15.78:0/25057149 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f678004dbb0 con 0x7f67940be4d0 2023-08-17T17:53:06.530 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:06.530 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2905752860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2905752860},{"type":"v1","addr":"172.21.15.150:6833","nonce":2905752860}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7620,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/652553934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":652553934},{"type":"v1","addr":"172.21.15.78:6836","nonce":652553934}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7623,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/728629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":728629628},{"type":"v1","addr":"172.21.15.78:6837","nonce":728629628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:51:57.714922+0000","modified":"2023-08-17T17:51:59.721521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7641":{"gid":7641,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3422834327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3422834327},{"type":"v1","addr":"172.21.15.150:6835","nonce":3422834327}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T17:53:06.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 -- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f677805eeb0 msgr2=0x7f6778061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f677805eeb0 0x7f6778061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 -- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940be4d0 msgr2=0x7f679414c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940be4d0 0x7f679414c130 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f678000c4f0 tx=0x7f6780007c90).stop 2023-08-17T17:53:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 -- 172.21.15.78:0/25057149 shutdown_connections 2023-08-17T17:53:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f677805eeb0 0x7f6778061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6794151e40 0x7f67940c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67940a7c90 0x7f67940ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 --2- 172.21.15.78:0/25057149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940be4d0 0x7f679414c130 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 -- 172.21.15.78:0/25057149 >> 172.21.15.78:0/25057149 conn(0x7f6794092330 msgr2=0x7f6794062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 -- 172.21.15.78:0/25057149 shutdown_connections 2023-08-17T17:53:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.531+0000 7f679ad80700 1 -- 172.21.15.78:0/25057149 wait complete. 2023-08-17T17:53:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 43 2023-08-17T17:53:06.545 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:06.574 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:06.574+0000 7f5019367680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:53:06.643 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:06.642+0000 7f5019367680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:53:06.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.664+0000 7fea267a7700 1 Processor -- start 2023-08-17T17:53:06.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.664+0000 7fea267a7700 1 -- start start 2023-08-17T17:53:06.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.665+0000 7fea267a7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 0x7fea200c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:06.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.665+0000 7fea267a7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200c4040 con 0x7fea200bef00 2023-08-17T17:53:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.665+0000 7fea267a7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200c50d0 con 0x7fea200a7fe0 2023-08-17T17:53:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.665+0000 7fea267a7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea200c3430 con 0x7fea20064180 2023-08-17T17:53:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.665+0000 7fea1f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fea200bef00 0x7fea200c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53810/0 (socket says 172.21.15.78:53810) 2023-08-17T17:53:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.665+0000 7fea1f7fe700 1 -- 172.21.15.78:0/3036177319 learned_addr learned my addr 172.21.15.78:0/3036177319 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.665+0000 7fea24d44700 1 --2- 172.21.15.78:0/3036177319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 0x7fea200c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea1effd700 1 -- 172.21.15.78:0/3036177319 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969184945 0 0) 0x7fea200c4040 con 0x7fea200bef00 2023-08-17T17:53:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea1effd700 1 -- 172.21.15.78:0/3036177319 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea080033f0 con 0x7fea200bef00 2023-08-17T17:53:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea1effd700 1 -- 172.21.15.78:0/3036177319 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375569528 0 0) 0x7fea200c50d0 con 0x7fea200a7fe0 2023-08-17T17:53:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea1effd700 1 -- 172.21.15.78:0/3036177319 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea200c4040 con 0x7fea200a7fe0 2023-08-17T17:53:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea24d44700 1 -- 172.21.15.78:0/3036177319 >> v1:172.21.15.150:6789/0 conn(0x7fea200a7fe0 legacy=0x7fea200be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea24d44700 1 -- 172.21.15.78:0/3036177319 >> v1:172.21.15.78:6789/0 conn(0x7fea200bef00 legacy=0x7fea200c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea1effd700 1 -- 172.21.15.78:0/3036177319 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 378037796 0 0) 0x7fea080033f0 con 0x7fea200bef00 2023-08-17T17:53:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea24d44700 1 -- 172.21.15.78:0/3036177319 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea200c3710 con 0x7fea20064180 2023-08-17T17:53:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea24d44700 1 --2- 172.21.15.78:0/3036177319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 0x7fea200c4be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fea18009e90 tx=0x7fea18009780).ready entity=mon.2 client_cookie=5d6ceb2abdd461dc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea1effd700 1 -- 172.21.15.78:0/3036177319 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1800e070 con 0x7fea20064180 2023-08-17T17:53:06.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea1effd700 1 -- 172.21.15.78:0/3036177319 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1800b7a0 con 0x7fea20064180 2023-08-17T17:53:06.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.666+0000 7fea1effd700 1 -- 172.21.15.78:0/3036177319 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10001470 con 0x7fea20064180 2023-08-17T17:53:06.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.667+0000 7fea267a7700 1 -- 172.21.15.78:0/3036177319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 msgr2=0x7fea200c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.667+0000 7fea267a7700 1 --2- 172.21.15.78:0/3036177319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 0x7fea200c4be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fea18009e90 tx=0x7fea18009780).stop 2023-08-17T17:53:06.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.667+0000 7fea267a7700 1 -- 172.21.15.78:0/3036177319 shutdown_connections 2023-08-17T17:53:06.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.667+0000 7fea267a7700 1 --2- 172.21.15.78:0/3036177319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 0x7fea200c4be0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.667+0000 7fea267a7700 1 -- 172.21.15.78:0/3036177319 >> 172.21.15.78:0/3036177319 conn(0x7fea20092330 msgr2=0x7fea20062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:06.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.667+0000 7fea267a7700 1 -- 172.21.15.78:0/3036177319 shutdown_connections 2023-08-17T17:53:06.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.667+0000 7fea267a7700 1 -- 172.21.15.78:0/3036177319 wait complete. 2023-08-17T17:53:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.668+0000 7fea267a7700 1 Processor -- start 2023-08-17T17:53:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.668+0000 7fea267a7700 1 -- start start 2023-08-17T17:53:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea267a7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 0x7fea20152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea267a7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea200a7fe0 0x7fea201647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea267a7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea200bef00 0x7fea200ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea267a7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea20153270 con 0x7fea200bef00 2023-08-17T17:53:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea267a7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea20164c90 con 0x7fea200a7fe0 2023-08-17T17:53:06.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea267a7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea200ad5b0 con 0x7fea20064180 2023-08-17T17:53:06.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea24d44700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea200bef00 0x7fea200ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:06.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea1ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 0x7fea20152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:06.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea24d44700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea200bef00 0x7fea200ae650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48194/0 (socket says 172.21.15.78:48194) 2023-08-17T17:53:06.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea24d44700 1 -- 172.21.15.78:0/112933240 learned_addr learned my addr 172.21.15.78:0/112933240 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:06.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea1f7fe700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea200a7fe0 0x7fea201647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:06.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea24d44700 1 -- 172.21.15.78:0/112933240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 msgr2=0x7fea20152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea24d44700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 0x7fea20152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea24d44700 1 -- 172.21.15.78:0/112933240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea200a7fe0 msgr2=0x7fea201647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea24d44700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea200a7fe0 0x7fea201647a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea24d44700 1 -- 172.21.15.78:0/112933240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18009a20 con 0x7fea200bef00 2023-08-17T17:53:06.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.669+0000 7fea1ffff700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 0x7fea20152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:06.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.670+0000 7fea24d44700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea200bef00 0x7fea200ae650 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fea20069a00 tx=0x7fea18009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:06.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.670+0000 7fea07fff700 1 -- 172.21.15.78:0/112933240 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1801d440 con 0x7fea200bef00 2023-08-17T17:53:06.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.670+0000 7fea07fff700 1 -- 172.21.15.78:0/112933240 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1801d5a0 con 0x7fea200bef00 2023-08-17T17:53:06.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.670+0000 7fea267a7700 1 -- 172.21.15.78:0/112933240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea200ad890 con 0x7fea200bef00 2023-08-17T17:53:06.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.670+0000 7fea07fff700 1 -- 172.21.15.78:0/112933240 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1801d920 con 0x7fea200bef00 2023-08-17T17:53:06.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.670+0000 7fea267a7700 1 -- 172.21.15.78:0/112933240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea200ade50 con 0x7fea200bef00 2023-08-17T17:53:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.671+0000 7fea267a7700 1 -- 172.21.15.78:0/112933240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea20157b30 con 0x7fea200bef00 2023-08-17T17:53:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.671+0000 7fea07fff700 1 -- 172.21.15.78:0/112933240 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fea1801dcd0 con 0x7fea200bef00 2023-08-17T17:53:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.672+0000 7fea07fff700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fea0c05ee80 0x7fea0c061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.672+0000 7fea1ffff700 1 -- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fea0c05ee80 msgr2=0x7fea0c061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.672+0000 7fea07fff700 1 -- 172.21.15.78:0/112933240 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fea1807c030 con 0x7fea200bef00 2023-08-17T17:53:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.672+0000 7fea1ffff700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fea0c05ee80 0x7fea0c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.676+0000 7fea07fff700 1 -- 172.21.15.78:0/112933240 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fea180aa8f0 con 0x7fea200bef00 2023-08-17T17:53:06.720 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:06.720+0000 7f5019367680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:53:06.721 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:06.720+0000 7fe0c9380680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:53:06.791 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:06.790+0000 7fe0c9380680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:53:06.867 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:06.866+0000 7f5019367680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:53:06.867 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:06.866+0000 7fe0c9380680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:53:06.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.873+0000 7fea1ffff700 1 -- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fea0c05ee80 msgr2=0x7fea0c061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:06.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.873+0000 7fea1ffff700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fea0c05ee80 0x7fea0c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:06.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.885+0000 7fea267a7700 1 -- 172.21.15.78:0/112933240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea20047350 con 0x7fea200bef00 2023-08-17T17:53:06.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.886+0000 7fea07fff700 1 -- 172.21.15.78:0/112933240 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fea1804d410 con 0x7fea200bef00 2023-08-17T17:53:06.887 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:06.887 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2905752860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2905752860},{"type":"v1","addr":"172.21.15.150:6833","nonce":2905752860}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7620,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/652553934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":652553934},{"type":"v1","addr":"172.21.15.78:6836","nonce":652553934}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7623,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/728629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":728629628},{"type":"v1","addr":"172.21.15.78:6837","nonce":728629628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:51:57.714922+0000","modified":"2023-08-17T17:51:59.721521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7641":{"gid":7641,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/3422834327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3422834327},{"type":"v1","addr":"172.21.15.150:6835","nonce":3422834327}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T17:53:06.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 -- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fea0c05ee80 msgr2=0x7fea0c061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:06.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fea0c05ee80 0x7fea0c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:06.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 -- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea200bef00 msgr2=0x7fea200ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea200bef00 0x7fea200ae650 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fea20069a00 tx=0x7fea18009780).stop 2023-08-17T17:53:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 -- 172.21.15.78:0/112933240 shutdown_connections 2023-08-17T17:53:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fea0c05ee80 0x7fea0c061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea200bef00 0x7fea200ae650 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea20064180 0x7fea20152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 --2- 172.21.15.78:0/112933240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea200a7fe0 0x7fea201647a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:06.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 -- 172.21.15.78:0/112933240 >> 172.21.15.78:0/112933240 conn(0x7fea20092330 msgr2=0x7fea200a6590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:06.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 -- 172.21.15.78:0/112933240 shutdown_connections 2023-08-17T17:53:06.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:06.888+0000 7fea267a7700 1 -- 172.21.15.78:0/112933240 wait complete. 2023-08-17T17:53:06.891 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 43 2023-08-17T17:53:06.901 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:06.937 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:06.936+0000 7f5019367680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:53:07.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.017+0000 7f25f8e6c700 1 Processor -- start 2023-08-17T17:53:07.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.017+0000 7f25f8e6c700 1 -- start start 2023-08-17T17:53:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f8e6c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f25f414dd20 0x7f25f40c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f8e6c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f25f41545f0 0x7f25f40a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f8e6c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f4068c60 con 0x7f25f414e100 2023-08-17T17:53:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f8e6c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f4154d70 con 0x7f25f41545f0 2023-08-17T17:53:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f8e6c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f40c20c0 con 0x7f25f414dd20 2023-08-17T17:53:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f25f41545f0 0x7f25f40a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25eaffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f25f414e100 0x7f25f4153ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53824/0 (socket says 172.21.15.78:53824) 2023-08-17T17:53:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25eaffd700 1 -- 172.21.15.78:0/4255934745 learned_addr learned my addr 172.21.15.78:0/4255934745 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f37fe700 1 --2- 172.21.15.78:0/4255934745 >> v2:172.21.15.150:3300/0 conn(0x7f25f414dd20 0x7f25f40c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f3fff700 1 -- 172.21.15.78:0/4255934745 >> v2:172.21.15.150:3300/0 conn(0x7f25f414dd20 msgr2=0x7f25f40c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f3fff700 1 --2- 172.21.15.78:0/4255934745 >> v2:172.21.15.150:3300/0 conn(0x7f25f414dd20 0x7f25f40c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f3fff700 1 -- 172.21.15.78:0/4255934745 >> v1:172.21.15.78:6789/0 conn(0x7f25f414e100 legacy=0x7f25f4153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f3fff700 1 -- 172.21.15.78:0/4255934745 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40694f0 con 0x7f25f41545f0 2023-08-17T17:53:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f37fe700 1 --2- 172.21.15.78:0/4255934745 >> v2:172.21.15.150:3300/0 conn(0x7f25f414dd20 0x7f25f40c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.018+0000 7f25f3fff700 1 --2- 172.21.15.78:0/4255934745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f41545f0 0x7f25f40a54b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f25f4066050 tx=0x7f25ec009780).ready entity=mon.0 client_cookie=7e7f521337cf7e23 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f2ffd700 1 -- 172.21.15.78:0/4255934745 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00e070 con 0x7f25f41545f0 2023-08-17T17:53:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f2ffd700 1 -- 172.21.15.78:0/4255934745 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec00bc30 con 0x7f25f41545f0 2023-08-17T17:53:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f2ffd700 1 -- 172.21.15.78:0/4255934745 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec012410 con 0x7f25f41545f0 2023-08-17T17:53:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4255934745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f41545f0 msgr2=0x7f25f40a54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f8e6c700 1 --2- 172.21.15.78:0/4255934745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f41545f0 0x7f25f40a54b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f25f4066050 tx=0x7f25ec009780).stop 2023-08-17T17:53:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4255934745 shutdown_connections 2023-08-17T17:53:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f8e6c700 1 --2- 172.21.15.78:0/4255934745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f41545f0 0x7f25f40a54b0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f8e6c700 1 --2- 172.21.15.78:0/4255934745 >> v2:172.21.15.150:3300/0 conn(0x7f25f414dd20 0x7f25f40c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4255934745 >> 172.21.15.78:0/4255934745 conn(0x7f25f40c7320 msgr2=0x7f25f40c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4255934745 shutdown_connections 2023-08-17T17:53:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.019+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4255934745 wait complete. 2023-08-17T17:53:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.020+0000 7f25f8e6c700 1 Processor -- start 2023-08-17T17:53:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.021+0000 7f25f8e6c700 1 -- start start 2023-08-17T17:53:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.021+0000 7f25f8e6c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f414dd20 0x7f25f41431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.021+0000 7f25f8e6c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f414e100 0x7f25f4144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.021+0000 7f25f8e6c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f41545f0 0x7f25f4144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.021+0000 7f25f8e6c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4144a00 con 0x7f25f414e100 2023-08-17T17:53:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.021+0000 7f25f8e6c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4152dc0 con 0x7f25f41545f0 2023-08-17T17:53:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.021+0000 7f25f8e6c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f41530a0 con 0x7f25f414dd20 2023-08-17T17:53:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.021+0000 7f25eaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f414e100 0x7f25f4144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.021+0000 7f25eaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f414e100 0x7f25f4144020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48216/0 (socket says 172.21.15.78:48216) 2023-08-17T17:53:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.021+0000 7f25eaffd700 1 -- 172.21.15.78:0/4134127300 learned_addr learned my addr 172.21.15.78:0/4134127300 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25f37fe700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f414dd20 0x7f25f41431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25f3fff700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f41545f0 0x7f25f4144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25eaffd700 1 -- 172.21.15.78:0/4134127300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f414dd20 msgr2=0x7f25f41431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25eaffd700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f414dd20 0x7f25f41431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25eaffd700 1 -- 172.21.15.78:0/4134127300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f41545f0 msgr2=0x7f25f4144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25eaffd700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f41545f0 0x7f25f4144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25eaffd700 1 -- 172.21.15.78:0/4134127300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec009a20 con 0x7f25f414e100 2023-08-17T17:53:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25eaffd700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f414e100 0x7f25f4144020 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f25dc00c4c0 tx=0x7f25dc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25ebfff700 1 -- 172.21.15.78:0/4134127300 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00ce10 con 0x7f25f414e100 2023-08-17T17:53:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25ebfff700 1 -- 172.21.15.78:0/4134127300 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc0072e0 con 0x7f25f414e100 2023-08-17T17:53:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25ebfff700 1 -- 172.21.15.78:0/4134127300 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc007660 con 0x7f25f414e100 2023-08-17T17:53:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4134127300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f4153380 con 0x7f25f414e100 2023-08-17T17:53:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.022+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4134127300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f4143690 con 0x7f25f414e100 2023-08-17T17:53:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.023+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4134127300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4143960 con 0x7f25f414e100 2023-08-17T17:53:07.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.023+0000 7f25ebfff700 1 -- 172.21.15.78:0/4134127300 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f25dc010070 con 0x7f25f414e100 2023-08-17T17:53:07.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.024+0000 7f25ebfff700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f25d405eeb0 0x7f25d4061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.024+0000 7f25ebfff700 1 -- 172.21.15.78:0/4134127300 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f25dc078f80 con 0x7f25f414e100 2023-08-17T17:53:07.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.024+0000 7f25f37fe700 1 -- 172.21.15.78:0/4134127300 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f25d405eeb0 msgr2=0x7f25d4061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:07.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.024+0000 7f25f37fe700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f25d405eeb0 0x7f25d4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:07.030 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.027+0000 7fe0c9380680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:53:07.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.028+0000 7f25ebfff700 1 -- 172.21.15.78:0/4134127300 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f25dc04a3f0 con 0x7f25f414e100 2023-08-17T17:53:07.053 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:07.053+0000 7f5019367680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:53:07.104 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.103+0000 7fe0c9380680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:53:07.162 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:07.162+0000 7f5019367680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:07.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.200+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4134127300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25f4068c60 con 0x7f25f414e100 2023-08-17T17:53:07.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.201+0000 7f25ebfff700 1 -- 172.21.15.78:0/4134127300 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+17235 (secure 0 0 0) 0x7f25f4068c60 con 0x7f25f414e100 2023-08-17T17:53:07.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:07.202 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":122,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:52:13.546178+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:51:56.265536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T17:51:56.677038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/595103412":"2023-08-18T17:52:13.546134+0000","172.21.15.78:6833/119464":"2023-08-18T17:52:13.546134+0000","172.21.15.78:6832/119464":"2023-08-18T17:52:13.546134+0000","172.21.15.78:0/3551145828":"2023-08-18T17:52:13.546134+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:07.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4134127300 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f25d405eeb0 msgr2=0x7f25d4061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:07.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f25d405eeb0 0x7f25d4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:07.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4134127300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f414e100 msgr2=0x7f25f4144020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:07.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f414e100 0x7f25f4144020 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f25dc00c4c0 tx=0x7f25dc007de0).stop 2023-08-17T17:53:07.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4134127300 shutdown_connections 2023-08-17T17:53:07.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f25d405eeb0 0x7f25d4061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:07.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f41545f0 0x7f25f4144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f414dd20 0x7f25f41431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 --2- 172.21.15.78:0/4134127300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25f414e100 0x7f25f4144020 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4134127300 >> 172.21.15.78:0/4134127300 conn(0x7f25f40c7320 msgr2=0x7f25f40bba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:07.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4134127300 shutdown_connections 2023-08-17T17:53:07.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.203+0000 7f25f8e6c700 1 -- 172.21.15.78:0/4134127300 wait complete. 2023-08-17T17:53:07.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T17:53:07.225 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.224+0000 7fe0c9380680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:53:07.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.333+0000 7f2c7b59e700 1 Processor -- start 2023-08-17T17:53:07.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.333+0000 7f2c7b59e700 1 -- start start 2023-08-17T17:53:07.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c7b59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c7c154000 0x7f2c7c0a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c7b59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c0630c0 con 0x7f2c7c153c20 2023-08-17T17:53:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c7b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c0c62c0 con 0x7f2c7c0a4d60 2023-08-17T17:53:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c7b59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0624f0 con 0x7f2c7c154000 2023-08-17T17:53:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c79d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c7c154000 0x7f2c7c0a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c79d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c7c154000 0x7f2c7c0a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48226/0 (socket says 172.21.15.78:48226) 2023-08-17T17:53:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c79d9b700 1 -- 172.21.15.78:0/1305388776 learned_addr learned my addr 172.21.15.78:0/1305388776 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c79d9b700 1 -- 172.21.15.78:0/1305388776 >> v1:172.21.15.150:6789/0 conn(0x7f2c7c0a4d60 legacy=0x7f2c7c063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c79d9b700 1 -- 172.21.15.78:0/1305388776 >> v1:172.21.15.78:6789/0 conn(0x7f2c7c153c20 legacy=0x7f2c7c0c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:07.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c79d9b700 1 -- 172.21.15.78:0/1305388776 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c062790 con 0x7f2c7c154000 2023-08-17T17:53:07.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c79d9b700 1 --2- 172.21.15.78:0/1305388776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c154000 0x7f2c7c0a4870 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f2c70006fd0 tx=0x7f2c700090f0).ready entity=mon.0 client_cookie=7d574641e42fdde4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:07.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c7959a700 1 -- 172.21.15.78:0/1305388776 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000b600 con 0x7f2c7c154000 2023-08-17T17:53:07.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c7959a700 1 -- 172.21.15.78:0/1305388776 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7000b760 con 0x7f2c7c154000 2023-08-17T17:53:07.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.334+0000 7f2c7959a700 1 -- 172.21.15.78:0/1305388776 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000bae0 con 0x7f2c7c154000 2023-08-17T17:53:07.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.335+0000 7f2c7b59e700 1 -- 172.21.15.78:0/1305388776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c154000 msgr2=0x7f2c7c0a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:07.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.335+0000 7f2c7b59e700 1 --2- 172.21.15.78:0/1305388776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c154000 0x7f2c7c0a4870 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f2c70006fd0 tx=0x7f2c700090f0).stop 2023-08-17T17:53:07.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.335+0000 7f2c7b59e700 1 -- 172.21.15.78:0/1305388776 shutdown_connections 2023-08-17T17:53:07.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.335+0000 7f2c7b59e700 1 --2- 172.21.15.78:0/1305388776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c154000 0x7f2c7c0a4870 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.335+0000 7f2c7b59e700 1 -- 172.21.15.78:0/1305388776 >> 172.21.15.78:0/1305388776 conn(0x7f2c7c064830 msgr2=0x7f2c7c064c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:07.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.335+0000 7f2c7b59e700 1 -- 172.21.15.78:0/1305388776 shutdown_connections 2023-08-17T17:53:07.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.335+0000 7f2c7b59e700 1 -- 172.21.15.78:0/1305388776 wait complete. 2023-08-17T17:53:07.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.336+0000 7f2c7b59e700 1 Processor -- start 2023-08-17T17:53:07.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.336+0000 7f2c7b59e700 1 -- start start 2023-08-17T17:53:07.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c7b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c7c0a4d60 0x7f2c7c0be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c7b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c153c20 0x7f2c7c147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c7b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c7c154000 0x7f2c7c063550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c7b59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0ab3a0 con 0x7f2c7c153c20 2023-08-17T17:53:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c7b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0ab680 con 0x7f2c7c0a4d60 2023-08-17T17:53:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c7b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0ab960 con 0x7f2c7c154000 2023-08-17T17:53:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c79d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c153c20 0x7f2c7c147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c79d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c153c20 0x7f2c7c147cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48228/0 (socket says 172.21.15.78:48228) 2023-08-17T17:53:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c79d9b700 1 -- 172.21.15.78:0/360883373 learned_addr learned my addr 172.21.15.78:0/360883373 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c7a59c700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c7c0a4d60 0x7f2c7c0be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:07.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c7ad9d700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c7c154000 0x7f2c7c063550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:07.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c79d9b700 1 -- 172.21.15.78:0/360883373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c7c154000 msgr2=0x7f2c7c063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:07.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c79d9b700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c7c154000 0x7f2c7c063550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c79d9b700 1 -- 172.21.15.78:0/360883373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c7c0a4d60 msgr2=0x7f2c7c0be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:07.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c79d9b700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c7c0a4d60 0x7f2c7c0be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:07.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c79d9b700 1 -- 172.21.15.78:0/360883373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70009370 con 0x7f2c7c153c20 2023-08-17T17:53:07.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c79d9b700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c153c20 0x7f2c7c147cc0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f2c7c0673c0 tx=0x7f2c70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c6a7fc700 1 -- 172.21.15.78:0/360883373 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000bae0 con 0x7f2c7c153c20 2023-08-17T17:53:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c6a7fc700 1 -- 172.21.15.78:0/360883373 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c70000c90 con 0x7f2c7c153c20 2023-08-17T17:53:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c7b59e700 1 -- 172.21.15.78:0/360883373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c0abc40 con 0x7f2c7c153c20 2023-08-17T17:53:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.337+0000 7f2c6a7fc700 1 -- 172.21.15.78:0/360883373 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7001c670 con 0x7f2c7c153c20 2023-08-17T17:53:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.338+0000 7f2c7b59e700 1 -- 172.21.15.78:0/360883373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c0be7b0 con 0x7f2c7c153c20 2023-08-17T17:53:07.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.338+0000 7f2c7b59e700 1 -- 172.21.15.78:0/360883373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c067a50 con 0x7f2c7c153c20 2023-08-17T17:53:07.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.339+0000 7f2c6a7fc700 1 -- 172.21.15.78:0/360883373 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 54) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f2c7002c070 con 0x7f2c7c153c20 2023-08-17T17:53:07.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.339+0000 7f2c6a7fc700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c5c05ee80 0x7f2c5c061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:07.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.339+0000 7f2c7a59c700 1 -- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c5c05ee80 msgr2=0x7f2c5c061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:07.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.339+0000 7f2c6a7fc700 1 -- 172.21.15.78:0/360883373 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2c7007bb00 con 0x7f2c7c153c20 2023-08-17T17:53:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.339+0000 7f2c7a59c700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c5c05ee80 0x7f2c5c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:07.345 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.343+0000 7fe0c9380680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.343+0000 7f2c6a7fc700 1 -- 172.21.15.78:0/360883373 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c7004cf70 con 0x7f2c7c153c20 2023-08-17T17:53:07.457 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:07.456+0000 7f5019367680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:53:07.528 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:07.528+0000 7f5019367680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:53:07.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.540+0000 7f2c7a59c700 1 -- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c5c05ee80 msgr2=0x7f2c5c061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:07.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.540+0000 7f2c7a59c700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c5c05ee80 0x7f2c5c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:07.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.557+0000 7f2c7b59e700 1 -- 172.21.15.78:0/360883373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2c7c1485d0 con 0x7f2c7c153c20 2023-08-17T17:53:07.646 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.645+0000 7fe0c9380680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:53:07.718 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.717+0000 7fe0c9380680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:53:07.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.740+0000 7f2c6a7fc700 1 -- 172.21.15.78:0/360883373 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 55) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f2c7000f070 con 0x7f2c7c153c20 2023-08-17T17:53:07.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.740+0000 7f2c6a7fc700 1 -- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c5c05ee80 msgr2=0x7f2c5c061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:07.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:07.740+0000 7f2c6a7fc700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c5c05ee80 0x7f2c5c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:07.746 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:53:07.746+0000 7f1d68840700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:53:07.746 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:53:07.746+0000 7f1d68840700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:53:07.746 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T17:53:07.746+0000 7f1d68840700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:53:07.752 INFO:tasks.ceph.mds.d.smithi150.stderr: -7754> 2023-08-17T17:52:03.640+0000 7f1d6c047700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:53:07.760 INFO:tasks.ceph.mds.d.smithi150.stderr: -4> 2023-08-17T17:53:07.746+0000 7f1d68840700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:53:07.760 INFO:tasks.ceph.mds.d.smithi150.stderr: -3> 2023-08-17T17:53:07.746+0000 7f1d68840700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:53:07.760 INFO:tasks.ceph.mds.d.smithi150.stderr: -1> 2023-08-17T17:53:07.746+0000 7f1d68840700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:53:07.779 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:53:07.789 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.788+0000 7fe04c367700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:07.789 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.788+0000 7fe04c367700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:07.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.788+0000 7fe04c367700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:07.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.788+0000 7fe04c367700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:07.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.788+0000 7fe04c367700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:07.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.789+0000 7fe049361700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:07.791 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.789+0000 7fe049361700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:07.791 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.789+0000 7fe049361700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:07.791 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.789+0000 7fe049361700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:07.791 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:07.789+0000 7fe049361700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:08.298 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T17:53:08.297+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T17:53:08.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.305+0000 7f2c6a7fc700 1 -- 172.21.15.78:0/360883373 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2c70055830 con 0x7f2c7c153c20 2023-08-17T17:53:08.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.307+0000 7f2c7b59e700 1 -- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c153c20 msgr2=0x7f2c7c147cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:08.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.307+0000 7f2c7b59e700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c153c20 0x7f2c7c147cc0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f2c7c0673c0 tx=0x7f2c70017000).stop 2023-08-17T17:53:08.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.307+0000 7f2c7b59e700 1 -- 172.21.15.78:0/360883373 shutdown_connections 2023-08-17T17:53:08.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.307+0000 7f2c7b59e700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2c5c05ee80 0x7f2c5c061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:08.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.307+0000 7f2c7b59e700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c7c154000 0x7f2c7c063550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:08.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.307+0000 7f2c7b59e700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c7c0a4d60 0x7f2c7c0be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:08.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.307+0000 7f2c7b59e700 1 --2- 172.21.15.78:0/360883373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c7c153c20 0x7f2c7c147cc0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:08.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.307+0000 7f2c7b59e700 1 -- 172.21.15.78:0/360883373 >> 172.21.15.78:0/360883373 conn(0x7f2c7c064830 msgr2=0x7f2c7c0bc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:08.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.307+0000 7f2c7b59e700 1 -- 172.21.15.78:0/360883373 shutdown_connections 2023-08-17T17:53:08.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.307+0000 7f2c7b59e700 1 -- 172.21.15.78:0/360883373 wait complete. 2023-08-17T17:53:08.310 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T17:53:08.321 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T17:53:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.476+0000 7f557a635700 1 Processor -- start 2023-08-17T17:53:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.476+0000 7f557a635700 1 -- start start 2023-08-17T17:53:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f557a635700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f55740aa0f0 0x7f55740644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f557a635700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55740aa4d0 0x7f55740c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f557a635700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55740c5810 0x7f55740c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f557a635700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55740649b0 con 0x7f55740c5810 2023-08-17T17:53:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f557a635700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55740c6120 con 0x7f55740aa0f0 2023-08-17T17:53:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f557a635700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5574063420 con 0x7f55740aa4d0 2023-08-17T17:53:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5578bd2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55740c5810 0x7f55740c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5578bd2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55740c5810 0x7f55740c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48324/0 (socket says 172.21.15.78:48324) 2023-08-17T17:53:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5578bd2700 1 -- 172.21.15.78:0/785570085 learned_addr learned my addr 172.21.15.78:0/785570085 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5573fff700 1 --2- 172.21.15.78:0/785570085 >> v2:172.21.15.150:3300/0 conn(0x7f55740aa0f0 0x7f55740644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f55737fe700 1 --2- 172.21.15.78:0/785570085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55740aa4d0 0x7f55740c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5578bd2700 1 -- 172.21.15.78:0/785570085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55740aa4d0 msgr2=0x7f55740c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5578bd2700 1 --2- 172.21.15.78:0/785570085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55740aa4d0 0x7f55740c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5578bd2700 1 -- 172.21.15.78:0/785570085 >> v2:172.21.15.150:3300/0 conn(0x7f55740aa0f0 msgr2=0x7f55740644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5578bd2700 1 --2- 172.21.15.78:0/785570085 >> v2:172.21.15.150:3300/0 conn(0x7f55740aa0f0 0x7f55740644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5578bd2700 1 -- 172.21.15.78:0/785570085 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5574063700 con 0x7f55740c5810 2023-08-17T17:53:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5573fff700 1 --2- 172.21.15.78:0/785570085 >> v2:172.21.15.150:3300/0 conn(0x7f55740aa0f0 0x7f55740644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.477+0000 7f5578bd2700 1 --2- 172.21.15.78:0/785570085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740c5810 0x7f55740c5c30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f55740cade0 tx=0x7f556c009840).ready entity=mon.0 client_cookie=8787164a4d76a5f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f5572ffd700 1 -- 172.21.15.78:0/785570085 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00e070 con 0x7f55740c5810 2023-08-17T17:53:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f5572ffd700 1 -- 172.21.15.78:0/785570085 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c00ba50 con 0x7f55740c5810 2023-08-17T17:53:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f5572ffd700 1 -- 172.21.15.78:0/785570085 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00bdd0 con 0x7f55740c5810 2023-08-17T17:53:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f557a635700 1 -- 172.21.15.78:0/785570085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740c5810 msgr2=0x7f55740c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f557a635700 1 --2- 172.21.15.78:0/785570085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740c5810 0x7f55740c5c30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f55740cade0 tx=0x7f556c009840).stop 2023-08-17T17:53:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f557a635700 1 -- 172.21.15.78:0/785570085 shutdown_connections 2023-08-17T17:53:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f557a635700 1 --2- 172.21.15.78:0/785570085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740c5810 0x7f55740c5c30 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f557a635700 1 --2- 172.21.15.78:0/785570085 >> v2:172.21.15.150:3300/0 conn(0x7f55740aa0f0 0x7f55740644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f557a635700 1 --2- 172.21.15.78:0/785570085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55740aa4d0 0x7f55740c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f557a635700 1 -- 172.21.15.78:0/785570085 >> 172.21.15.78:0/785570085 conn(0x7f557406a6a0 msgr2=0x7f55740caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f557a635700 1 -- 172.21.15.78:0/785570085 shutdown_connections 2023-08-17T17:53:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.478+0000 7f557a635700 1 -- 172.21.15.78:0/785570085 wait complete. 2023-08-17T17:53:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.479+0000 7f557a635700 1 Processor -- start 2023-08-17T17:53:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.480+0000 7f557a635700 1 -- start start 2023-08-17T17:53:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.480+0000 7f557a635700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55740aa0f0 0x7f5574151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.480+0000 7f557a635700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740aa4d0 0x7f55740a7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.480+0000 7f557a635700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55740c5810 0x7f55740a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.480+0000 7f557a635700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740a85e0 con 0x7f55740aa4d0 2023-08-17T17:53:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.480+0000 7f557a635700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5574152490 con 0x7f55740aa0f0 2023-08-17T17:53:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.480+0000 7f557a635700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740aaa40 con 0x7f55740c5810 2023-08-17T17:53:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.480+0000 7f55737fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740aa4d0 0x7f55740a7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f55737fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740aa4d0 0x7f55740a7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48334/0 (socket says 172.21.15.78:48334) 2023-08-17T17:53:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f55737fe700 1 -- 172.21.15.78:0/1346797419 learned_addr learned my addr 172.21.15.78:0/1346797419 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f5578bd2700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55740c5810 0x7f55740a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f5573fff700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55740aa0f0 0x7f5574151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f55737fe700 1 -- 172.21.15.78:0/1346797419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55740c5810 msgr2=0x7f55740a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f55737fe700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55740c5810 0x7f55740a80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f55737fe700 1 -- 172.21.15.78:0/1346797419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55740aa0f0 msgr2=0x7f5574151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f55737fe700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55740aa0f0 0x7f5574151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f55737fe700 1 -- 172.21.15.78:0/1346797419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c009ae0 con 0x7f55740aa4d0 2023-08-17T17:53:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f5573fff700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55740aa0f0 0x7f5574151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f55737fe700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740aa4d0 0x7f55740a7c00 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f556800d8c0 tx=0x7f5568008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f555bfff700 1 -- 172.21.15.78:0/1346797419 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55680125f0 con 0x7f55740aa4d0 2023-08-17T17:53:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f555bfff700 1 -- 172.21.15.78:0/1346797419 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5568012750 con 0x7f55740aa4d0 2023-08-17T17:53:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f557a635700 1 -- 172.21.15.78:0/1346797419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55740c2660 con 0x7f55740aa4d0 2023-08-17T17:53:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f555bfff700 1 -- 172.21.15.78:0/1346797419 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568012ad0 con 0x7f55740aa4d0 2023-08-17T17:53:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.481+0000 7f557a635700 1 -- 172.21.15.78:0/1346797419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55740c2c20 con 0x7f55740aa4d0 2023-08-17T17:53:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.482+0000 7f557a635700 1 -- 172.21.15.78:0/1346797419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5574083980 con 0x7f55740aa4d0 2023-08-17T17:53:08.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.482+0000 7f555bfff700 1 -- 172.21.15.78:0/1346797419 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 55) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f5568013480 con 0x7f55740aa4d0 2023-08-17T17:53:08.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.483+0000 7f555bfff700 1 -- 172.21.15.78:0/1346797419 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f5568079e40 con 0x7f55740aa4d0 2023-08-17T17:53:08.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.487+0000 7f555bfff700 1 -- 172.21.15.78:0/1346797419 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f556804b1e0 con 0x7f55740aa4d0 2023-08-17T17:53:08.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.689+0000 7f557a635700 1 -- 172.21.15.78:0/1346797419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5574046af0 con 0x7f55740aa4d0 2023-08-17T17:53:08.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.744+0000 7f555bfff700 1 -- 172.21.15.78:0/1346797419 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 56) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f5568077ba0 con 0x7f55740aa4d0 2023-08-17T17:53:08.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.745+0000 7f555bfff700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55600301b0 0x7f55600678b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:08.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.745+0000 7f5573fff700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55600301b0 0x7f55600678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:08.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:08.746+0000 7f5573fff700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55600301b0 0x7f55600678b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f5564006fd0 tx=0x7f5564008040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:09.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.307+0000 7f555bfff700 1 -- 172.21.15.78:0/1346797419 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f556806e890 con 0x7f55740aa4d0 2023-08-17T17:53:09.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 -- 172.21.15.78:0/1346797419 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55600301b0 msgr2=0x7f55600678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:09.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55600301b0 0x7f55600678b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f5564006fd0 tx=0x7f5564008040).stop 2023-08-17T17:53:09.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 -- 172.21.15.78:0/1346797419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740aa4d0 msgr2=0x7f55740a7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:09.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740aa4d0 0x7f55740a7c00 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f556800d8c0 tx=0x7f5568008040).stop 2023-08-17T17:53:09.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 -- 172.21.15.78:0/1346797419 shutdown_connections 2023-08-17T17:53:09.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f55600301b0 0x7f55600678b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:09.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55740c5810 0x7f55740a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:09.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55740aa0f0 0x7f5574151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:09.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 --2- 172.21.15.78:0/1346797419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55740aa4d0 0x7f55740a7c00 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:09.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 -- 172.21.15.78:0/1346797419 >> 172.21.15.78:0/1346797419 conn(0x7f557406a6a0 msgr2=0x7f55740c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:09.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 -- 172.21.15.78:0/1346797419 shutdown_connections 2023-08-17T17:53:09.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.309+0000 7f557a635700 1 -- 172.21.15.78:0/1346797419 wait complete. 2023-08-17T17:53:09.323 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T17:53:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.442+0000 7fe1ffb0c700 1 Processor -- start 2023-08-17T17:53:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.442+0000 7fe1ffb0c700 1 -- start start 2023-08-17T17:53:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1ffb0c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1f80640c0 0x7fe1f8154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1ffb0c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f80c7ba0 con 0x7fe1f8153e40 2023-08-17T17:53:09.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1ffb0c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f80c6f90 con 0x7fe1f8064f00 2023-08-17T17:53:09.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1ffb0c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f80a6190 con 0x7fe1f80640c0 2023-08-17T17:53:09.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd8a8700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe1f8153e40 0x7fe1f80a5a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56732/0 (socket says 172.21.15.78:56732) 2023-08-17T17:53:09.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd8a8700 1 -- 172.21.15.78:0/3234167720 learned_addr learned my addr 172.21.15.78:0/3234167720 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:09.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd0a7700 1 --2- 172.21.15.78:0/3234167720 >> v2:172.21.15.150:3300/0 conn(0x7fe1f80640c0 0x7fe1f8154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:09.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422551218 0 0) 0x7fe1f80c7ba0 con 0x7fe1f8153e40 2023-08-17T17:53:09.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e40033f0 con 0x7fe1f8153e40 2023-08-17T17:53:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326794651 0 0) 0x7fe1f80c6f90 con 0x7fe1f8064f00 2023-08-17T17:53:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f80c7ba0 con 0x7fe1f8064f00 2023-08-17T17:53:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 969298187 0 0) 0x7fe1e40033f0 con 0x7fe1f8153e40 2023-08-17T17:53:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 >> v2:172.21.15.150:3300/0 conn(0x7fe1f80640c0 msgr2=0x7fe1f8154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 --2- 172.21.15.78:0/3234167720 >> v2:172.21.15.150:3300/0 conn(0x7fe1f80640c0 0x7fe1f8154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 >> v1:172.21.15.150:6789/0 conn(0x7fe1f8064f00 legacy=0x7fe1f80be4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f80c7270 con 0x7fe1f8153e40 2023-08-17T17:53:09.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fe1f40015f0 con 0x7fe1f8153e40 2023-08-17T17:53:09.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 >> v1:172.21.15.78:6789/0 conn(0x7fe1f8153e40 legacy=0x7fe1f80a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:09.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e4003ac0 0x7fe1e4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:09.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:09.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e4005000 0x7fe1e400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:09.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80a6190 con 0x7fe1e4004690 2023-08-17T17:53:09.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e400bf60 con 0x7fe1e4003ac0 2023-08-17T17:53:09.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e400c120 con 0x7fe1e4005000 2023-08-17T17:53:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd0a7700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd8a8700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e4003ac0 0x7fe1e4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fe0a9700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e4005000 0x7fe1e400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd0a7700 1 -- 172.21.15.78:0/3234167720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e4005000 msgr2=0x7fe1e400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd0a7700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e4005000 0x7fe1e400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd0a7700 1 -- 172.21.15.78:0/3234167720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e4003ac0 msgr2=0x7fe1e4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd0a7700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e4003ac0 0x7fe1e4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd0a7700 1 -- 172.21.15.78:0/3234167720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40033f0 con 0x7fe1e4004690 2023-08-17T17:53:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fe0a9700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e4005000 0x7fe1e400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fe0a9700 1 -- 172.21.15.78:0/3234167720 reap_dead start 2023-08-17T17:53:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fd0a7700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1e4004b10 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fe1e8009a80 tx=0x7fe1e8009060).ready entity=mon.0 client_cookie=45531a811096f9ff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.444+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8009430 con 0x7fe1e4004690 2023-08-17T17:53:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.445+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e800e640 con 0x7fe1e4004690 2023-08-17T17:53:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.445+0000 7fe1fc8a6700 1 -- 172.21.15.78:0/3234167720 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800e9c0 con 0x7fe1e4004690 2023-08-17T17:53:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.445+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/3234167720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 msgr2=0x7fe1e4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.445+0000 7fe1ffb0c700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1e4004b10 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fe1e8009a80 tx=0x7fe1e8009060).stop 2023-08-17T17:53:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.445+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/3234167720 shutdown_connections 2023-08-17T17:53:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.445+0000 7fe1ffb0c700 1 --2- 172.21.15.78:0/3234167720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1e4004b10 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.445+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/3234167720 >> 172.21.15.78:0/3234167720 conn(0x7fe1f80923c0 msgr2=0x7fe1f8062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.445+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/3234167720 shutdown_connections 2023-08-17T17:53:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.445+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/3234167720 wait complete. 2023-08-17T17:53:09.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.446+0000 7fe1ffb0c700 1 Processor -- start 2023-08-17T17:53:09.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.446+0000 7fe1ffb0c700 1 -- start start 2023-08-17T17:53:09.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1ffb0c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1f814f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:09.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1ffb0c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8151ae0 0x7fe1f81652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:09.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1ffb0c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f80bfdd0 0x7fe1f80c0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:09.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1ffb0c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80c1da0 con 0x7fe1e4004690 2023-08-17T17:53:09.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1ffb0c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80c0720 con 0x7fe1f8151ae0 2023-08-17T17:53:09.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1ffb0c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f81657c0 con 0x7fe1f80bfdd0 2023-08-17T17:53:09.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fd8a8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1f814f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:09.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fd8a8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1f814f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58912/0 (socket says 172.21.15.78:58912) 2023-08-17T17:53:09.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fd8a8700 1 -- 172.21.15.78:0/2965556990 learned_addr learned my addr 172.21.15.78:0/2965556990 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:09.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fe0a9700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f80bfdd0 0x7fe1f80c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:09.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fd0a7700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8151ae0 0x7fe1f81652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:09.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fd8a8700 1 -- 172.21.15.78:0/2965556990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f80bfdd0 msgr2=0x7fe1f80c0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:09.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fd8a8700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f80bfdd0 0x7fe1f80c0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:09.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fd8a8700 1 -- 172.21.15.78:0/2965556990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8151ae0 msgr2=0x7fe1f81652d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:09.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fd8a8700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8151ae0 0x7fe1f81652d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:09.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fd8a8700 1 -- 172.21.15.78:0/2965556990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f80c1190 con 0x7fe1e4004690 2023-08-17T17:53:09.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.447+0000 7fe1fd8a8700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1f814f020 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fe1f400f8b0 tx=0x7fe1f4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:09.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.448+0000 7fe1edffb700 1 -- 172.21.15.78:0/2965556990 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40070d0 con 0x7fe1e4004690 2023-08-17T17:53:09.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.448+0000 7fe1edffb700 1 -- 172.21.15.78:0/2965556990 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f4007230 con 0x7fe1e4004690 2023-08-17T17:53:09.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.448+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/2965556990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f80c1470 con 0x7fe1e4004690 2023-08-17T17:53:09.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.448+0000 7fe1edffb700 1 -- 172.21.15.78:0/2965556990 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4005880 con 0x7fe1e4004690 2023-08-17T17:53:09.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.448+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/2965556990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f80c1a30 con 0x7fe1e4004690 2023-08-17T17:53:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.449+0000 7fe1edffb700 1 -- 172.21.15.78:0/2965556990 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 56) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fe1f401a030 con 0x7fe1e4004690 2023-08-17T17:53:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.449+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/2965556990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f80c2110 con 0x7fe1e4004690 2023-08-17T17:53:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.449+0000 7fe1edffb700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1dc05ecc0 0x7fe1dc061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.449+0000 7fe1edffb700 1 -- 172.21.15.78:0/2965556990 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6693+0+0 (secure 0 0 0) 0x7fe1f4079450 con 0x7fe1e4004690 2023-08-17T17:53:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.449+0000 7fe1fd0a7700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1dc05ecc0 0x7fe1dc061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.450+0000 7fe1fd0a7700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1dc05ecc0 0x7fe1dc061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe1e8006d50 tx=0x7fe1e801a000).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:09.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.453+0000 7fe1edffb700 1 -- 172.21.15.78:0/2965556990 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1f404a850 con 0x7fe1e4004690 2023-08-17T17:53:09.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:09.618+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/2965556990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe1f80c7550 con 0x7fe1e4004690 2023-08-17T17:53:10.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.313+0000 7fe1edffb700 1 -- 172.21.15.78:0/2965556990 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v125) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe1f404de70 con 0x7fe1e4004690 2023-08-17T17:53:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.316+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/2965556990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1dc05ecc0 msgr2=0x7fe1dc061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.316+0000 7fe1ffb0c700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1dc05ecc0 0x7fe1dc061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe1e8006d50 tx=0x7fe1e801a000).stop 2023-08-17T17:53:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.316+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/2965556990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 msgr2=0x7fe1f814f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:10.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.316+0000 7fe1ffb0c700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1f814f020 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fe1f400f8b0 tx=0x7fe1f4009040).stop 2023-08-17T17:53:10.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.316+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/2965556990 shutdown_connections 2023-08-17T17:53:10.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.316+0000 7fe1ffb0c700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe1dc05ecc0 0x7fe1dc061180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:10.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.316+0000 7fe1ffb0c700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1f80bfdd0 0x7fe1f80c0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:10.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.316+0000 7fe1ffb0c700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e4004690 0x7fe1f814f020 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:10.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.316+0000 7fe1ffb0c700 1 --2- 172.21.15.78:0/2965556990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8151ae0 0x7fe1f81652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:10.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.317+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/2965556990 >> 172.21.15.78:0/2965556990 conn(0x7fe1f80923c0 msgr2=0x7fe1f8152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:10.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.317+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/2965556990 shutdown_connections 2023-08-17T17:53:10.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.317+0000 7fe1ffb0c700 1 -- 172.21.15.78:0/2965556990 wait complete. 2023-08-17T17:53:10.321 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T17:53:10.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T17:53:10.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.446+0000 7ffa06324700 1 Processor -- start 2023-08-17T17:53:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.446+0000 7ffa06324700 1 -- start start 2023-08-17T17:53:10.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.447+0000 7ffa06324700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa000aa0f0 0x7ffa000644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:10.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.447+0000 7ffa06324700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000c5810 0x7ffa000c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:10.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.447+0000 7ffa06324700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa000649b0 con 0x7ffa000aa4d0 2023-08-17T17:53:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.447+0000 7ffa06324700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa000c6170 con 0x7ffa000aa0f0 2023-08-17T17:53:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.447+0000 7ffa06324700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00063420 con 0x7ffa000c5810 2023-08-17T17:53:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.447+0000 7ff9fffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa000aa0f0 0x7ffa000644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.447+0000 7ff9fffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa000aa0f0 0x7ffa000644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58928/0 (socket says 172.21.15.78:58928) 2023-08-17T17:53:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.447+0000 7ff9fffff700 1 -- 172.21.15.78:0/1848298689 learned_addr learned my addr 172.21.15.78:0/1848298689 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ffa048c1700 1 --2- 172.21.15.78:0/1848298689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000c5810 0x7ffa000c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ff9fffff700 1 -- 172.21.15.78:0/1848298689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000c5810 msgr2=0x7ffa000c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ff9fffff700 1 --2- 172.21.15.78:0/1848298689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000c5810 0x7ffa000c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:10.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ff9fffff700 1 -- 172.21.15.78:0/1848298689 >> v1:172.21.15.150:6789/0 conn(0x7ffa000aa4d0 legacy=0x7ffa000c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:10.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ff9fffff700 1 -- 172.21.15.78:0/1848298689 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00063700 con 0x7ffa000aa0f0 2023-08-17T17:53:10.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ffa048c1700 1 --2- 172.21.15.78:0/1848298689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000c5810 0x7ffa000c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:10.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ff9fffff700 1 --2- 172.21.15.78:0/1848298689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000aa0f0 0x7ffa000644c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7ff9f0006fd0 tx=0x7ff9f00090f0).ready entity=mon.0 client_cookie=3f8d3d9825599c12 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:10.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ff9feffd700 1 -- 172.21.15.78:0/1848298689 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000b600 con 0x7ffa000aa0f0 2023-08-17T17:53:10.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ff9feffd700 1 -- 172.21.15.78:0/1848298689 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f000b760 con 0x7ffa000aa0f0 2023-08-17T17:53:10.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ff9feffd700 1 -- 172.21.15.78:0/1848298689 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000bae0 con 0x7ffa000aa0f0 2023-08-17T17:53:10.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ffa06324700 1 -- 172.21.15.78:0/1848298689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000aa0f0 msgr2=0x7ffa000644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:10.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ffa06324700 1 --2- 172.21.15.78:0/1848298689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000aa0f0 0x7ffa000644c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7ff9f0006fd0 tx=0x7ff9f00090f0).stop 2023-08-17T17:53:10.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ffa06324700 1 -- 172.21.15.78:0/1848298689 shutdown_connections 2023-08-17T17:53:10.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ffa06324700 1 --2- 172.21.15.78:0/1848298689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000c5810 0x7ffa000c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:10.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ffa06324700 1 --2- 172.21.15.78:0/1848298689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000aa0f0 0x7ffa000644c0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:10.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ffa06324700 1 -- 172.21.15.78:0/1848298689 >> 172.21.15.78:0/1848298689 conn(0x7ffa0006a6a0 msgr2=0x7ffa000caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:10.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ffa06324700 1 -- 172.21.15.78:0/1848298689 shutdown_connections 2023-08-17T17:53:10.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.448+0000 7ffa06324700 1 -- 172.21.15.78:0/1848298689 wait complete. 2023-08-17T17:53:10.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.450+0000 7ffa06324700 1 Processor -- start 2023-08-17T17:53:10.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.450+0000 7ffa06324700 1 -- start start 2023-08-17T17:53:10.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.450+0000 7ffa06324700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa000aa0f0 0x7ffa000c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:10.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.450+0000 7ffa06324700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000aa4d0 0x7ffa000ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:10.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.450+0000 7ffa06324700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000c5810 0x7ffa00151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:10.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa06324700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa000ac790 con 0x7ffa000c5810 2023-08-17T17:53:10.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa06324700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa000acc20 con 0x7ffa000aa0f0 2023-08-17T17:53:10.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa06324700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa000abb80 con 0x7ffa000aa4d0 2023-08-17T17:53:10.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa048c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000c5810 0x7ffa00151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:10.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa048c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000c5810 0x7ffa00151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58942/0 (socket says 172.21.15.78:58942) 2023-08-17T17:53:10.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa048c1700 1 -- 172.21.15.78:0/1414970956 learned_addr learned my addr 172.21.15.78:0/1414970956 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:10.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ff9fffff700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa000aa0f0 0x7ffa000c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:10.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ff9ff7fe700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000aa4d0 0x7ffa000ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:10.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa048c1700 1 -- 172.21.15.78:0/1414970956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000aa4d0 msgr2=0x7ffa000ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:10.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa048c1700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000aa4d0 0x7ffa000ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:10.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa048c1700 1 -- 172.21.15.78:0/1414970956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa000aa0f0 msgr2=0x7ffa000c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:10.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa048c1700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa000aa0f0 0x7ffa000c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:10.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa048c1700 1 -- 172.21.15.78:0/1414970956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009370 con 0x7ffa000c5810 2023-08-17T17:53:10.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa048c1700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000c5810 0x7ffa00151510 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7ff9f800a380 tx=0x7ff9f8007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:10.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ff9e7fff700 1 -- 172.21.15.78:0/1414970956 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8016470 con 0x7ffa000c5810 2023-08-17T17:53:10.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ff9e7fff700 1 -- 172.21.15.78:0/1414970956 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f80165d0 con 0x7ffa000c5810 2023-08-17T17:53:10.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa06324700 1 -- 172.21.15.78:0/1414970956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa000abe60 con 0x7ffa000c5810 2023-08-17T17:53:10.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ff9e7fff700 1 -- 172.21.15.78:0/1414970956 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8016950 con 0x7ffa000c5810 2023-08-17T17:53:10.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa06324700 1 -- 172.21.15.78:0/1414970956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa000ac420 con 0x7ffa000c5810 2023-08-17T17:53:10.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.452+0000 7ffa06324700 1 -- 172.21.15.78:0/1414970956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa000ac940 con 0x7ffa000c5810 2023-08-17T17:53:10.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.453+0000 7ff9e7fff700 1 -- 172.21.15.78:0/1414970956 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 56) v1 ==== 75162+0+0 (secure 0 0 0) 0x7ff9f800d440 con 0x7ffa000c5810 2023-08-17T17:53:10.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.453+0000 7ff9e7fff700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9ec05ecf0 0x7ff9ec0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:10.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.453+0000 7ff9e7fff700 1 -- 172.21.15.78:0/1414970956 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6227+0+0 (secure 0 0 0) 0x7ff9f807ab50 con 0x7ffa000c5810 2023-08-17T17:53:10.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.453+0000 7ff9fffff700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9ec05ecf0 0x7ff9ec0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.453+0000 7ff9fffff700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9ec05ecf0 0x7ff9ec0611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff9f0009130 tx=0x7ff9f0017000).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.457+0000 7ff9e7fff700 1 -- 172.21.15.78:0/1414970956 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa000ac940 con 0x7ffa000c5810 2023-08-17T17:53:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.621+0000 7ffa06324700 1 -- 172.21.15.78:0/1414970956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffa000ac940 con 0x7ffa000c5810 2023-08-17T17:53:10.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:10.748+0000 7ff9e7fff700 1 -- 172.21.15.78:0/1414970956 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff9f8078a80 con 0x7ffa000c5810 2023-08-17T17:53:11.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.284+0000 7ff9e7fff700 1 -- 172.21.15.78:0/1414970956 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v126) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff9f80773a0 con 0x7ffa000c5810 2023-08-17T17:53:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 -- 172.21.15.78:0/1414970956 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9ec05ecf0 msgr2=0x7ff9ec0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9ec05ecf0 0x7ff9ec0611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff9f0009130 tx=0x7ff9f0017000).stop 2023-08-17T17:53:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 -- 172.21.15.78:0/1414970956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000c5810 msgr2=0x7ffa00151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000c5810 0x7ffa00151510 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7ff9f800a380 tx=0x7ff9f8007900).stop 2023-08-17T17:53:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 -- 172.21.15.78:0/1414970956 shutdown_connections 2023-08-17T17:53:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff9ec05ecf0 0x7ff9ec0611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa000c5810 0x7ffa00151510 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa000aa0f0 0x7ffa000c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 --2- 172.21.15.78:0/1414970956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa000aa4d0 0x7ffa000ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 -- 172.21.15.78:0/1414970956 >> 172.21.15.78:0/1414970956 conn(0x7ffa0006a6a0 msgr2=0x7ffa000c4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 -- 172.21.15.78:0/1414970956 shutdown_connections 2023-08-17T17:53:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.287+0000 7ffa06324700 1 -- 172.21.15.78:0/1414970956 wait complete. 2023-08-17T17:53:11.291 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T17:53:11.300 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T17:53:11.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.415+0000 7f0dacd10700 1 Processor -- start 2023-08-17T17:53:11.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.415+0000 7f0dacd10700 1 -- start start 2023-08-17T17:53:11.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.416+0000 7f0dacd10700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0da80aa4d0 0x7f0da80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.416+0000 7f0dacd10700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0da80c5810 0x7f0da80c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.416+0000 7f0dacd10700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da80649b0 con 0x7f0da80aa0f0 2023-08-17T17:53:11.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.416+0000 7f0dacd10700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da80c6150 con 0x7f0da80c5810 2023-08-17T17:53:11.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.416+0000 7f0dacd10700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da8063420 con 0x7f0da80aa4d0 2023-08-17T17:53:11.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.416+0000 7f0da6d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0da80c5810 0x7f0da80c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.416+0000 7f0da659c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0da80aa0f0 0x7f0da80c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56734/0 (socket says 172.21.15.78:56734) 2023-08-17T17:53:11.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.416+0000 7f0da659c700 1 -- 172.21.15.78:0/3885255660 learned_addr learned my addr 172.21.15.78:0/3885255660 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:11.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0da6d9d700 1 -- 172.21.15.78:0/3885255660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0da80aa4d0 msgr2=0x7f0da80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:11.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0da6d9d700 1 --2- 172.21.15.78:0/3885255660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0da80aa4d0 0x7f0da80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:11.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0da6d9d700 1 -- 172.21.15.78:0/3885255660 >> v1:172.21.15.78:6789/0 conn(0x7f0da80aa0f0 legacy=0x7f0da80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0da5d9b700 1 -- 172.21.15.78:0/3885255660 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446006129 0 0) 0x7f0da80649b0 con 0x7f0da80aa0f0 2023-08-17T17:53:11.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0da6d9d700 1 -- 172.21.15.78:0/3885255660 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8063700 con 0x7f0da80c5810 2023-08-17T17:53:11.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0da6d9d700 1 --2- 172.21.15.78:0/3885255660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80c5810 0x7f0da80c5c60 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f0da0009e60 tx=0x7f0da0009780).ready entity=mon.0 client_cookie=d8c8043103f9b804 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:11.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0da5d9b700 1 -- 172.21.15.78:0/3885255660 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000e070 con 0x7f0da80c5810 2023-08-17T17:53:11.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0da5d9b700 1 -- 172.21.15.78:0/3885255660 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da000bc30 con 0x7f0da80c5810 2023-08-17T17:53:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0da5d9b700 1 -- 172.21.15.78:0/3885255660 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0012410 con 0x7f0da80c5810 2023-08-17T17:53:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0dacd10700 1 -- 172.21.15.78:0/3885255660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80c5810 msgr2=0x7f0da80c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0dacd10700 1 --2- 172.21.15.78:0/3885255660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80c5810 0x7f0da80c5c60 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f0da0009e60 tx=0x7f0da0009780).stop 2023-08-17T17:53:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0dacd10700 1 -- 172.21.15.78:0/3885255660 shutdown_connections 2023-08-17T17:53:11.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0dacd10700 1 --2- 172.21.15.78:0/3885255660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80c5810 0x7f0da80c5c60 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0dacd10700 1 --2- 172.21.15.78:0/3885255660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0da80aa4d0 0x7f0da80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:11.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0dacd10700 1 -- 172.21.15.78:0/3885255660 >> 172.21.15.78:0/3885255660 conn(0x7f0da806a6a0 msgr2=0x7f0da80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.417+0000 7f0dacd10700 1 -- 172.21.15.78:0/3885255660 shutdown_connections 2023-08-17T17:53:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.418+0000 7f0dacd10700 1 -- 172.21.15.78:0/3885255660 wait complete. 2023-08-17T17:53:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.419+0000 7f0dacd10700 1 Processor -- start 2023-08-17T17:53:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.419+0000 7f0dacd10700 1 -- start start 2023-08-17T17:53:11.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.419+0000 7f0dacd10700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0da80aa0f0 0x7f0da8151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.419+0000 7f0dacd10700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80aa4d0 0x7f0da80a9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.419+0000 7f0dacd10700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0da80c5810 0x7f0da8164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0dacd10700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da80c2bb0 con 0x7f0da80aa4d0 2023-08-17T17:53:11.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0dacd10700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da81521d0 con 0x7f0da80aa0f0 2023-08-17T17:53:11.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0dacd10700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da80c1fa0 con 0x7f0da80c5810 2023-08-17T17:53:11.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80aa4d0 0x7f0da80a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80aa4d0 0x7f0da80a9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58950/0 (socket says 172.21.15.78:58950) 2023-08-17T17:53:11.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9dd9b700 1 -- 172.21.15.78:0/1836795602 learned_addr learned my addr 172.21.15.78:0/1836795602 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:11.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0da659c700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0da80aa0f0 0x7f0da8151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0da6d9d700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0da80c5810 0x7f0da8164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9dd9b700 1 -- 172.21.15.78:0/1836795602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0da80c5810 msgr2=0x7f0da8164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9dd9b700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0da80c5810 0x7f0da8164430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9dd9b700 1 -- 172.21.15.78:0/1836795602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0da80aa0f0 msgr2=0x7f0da8151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9dd9b700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0da80aa0f0 0x7f0da8151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9dd9b700 1 -- 172.21.15.78:0/1836795602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0009a20 con 0x7f0da80aa4d0 2023-08-17T17:53:11.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9dd9b700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80aa4d0 0x7f0da80a9550 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f0d9000b530 tx=0x7f0d900090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:11.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9effd700 1 -- 172.21.15.78:0/1836795602 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90002320 con 0x7f0da80aa4d0 2023-08-17T17:53:11.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9effd700 1 -- 172.21.15.78:0/1836795602 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d900024a0 con 0x7f0da80aa4d0 2023-08-17T17:53:11.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0d9effd700 1 -- 172.21.15.78:0/1836795602 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90002860 con 0x7f0da80aa4d0 2023-08-17T17:53:11.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0dacd10700 1 -- 172.21.15.78:0/1836795602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da80c2280 con 0x7f0da80aa4d0 2023-08-17T17:53:11.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.420+0000 7f0dacd10700 1 -- 172.21.15.78:0/1836795602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da80c2840 con 0x7f0da80aa4d0 2023-08-17T17:53:11.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.421+0000 7f0dacd10700 1 -- 172.21.15.78:0/1836795602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da8083980 con 0x7f0da80aa4d0 2023-08-17T17:53:11.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.421+0000 7f0d9effd700 1 -- 172.21.15.78:0/1836795602 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0d9000f030 con 0x7f0da80aa4d0 2023-08-17T17:53:11.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.422+0000 7f0d9effd700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d8805ed90 0x7f0d88061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.422+0000 7f0d9effd700 1 -- 172.21.15.78:0/1836795602 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f0d90079640 con 0x7f0da80aa4d0 2023-08-17T17:53:11.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.422+0000 7f0da659c700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d8805ed90 0x7f0d88061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.422+0000 7f0da659c700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d8805ed90 0x7f0d88061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0d98007fd0 tx=0x7f0d98007dd0).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:11.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.426+0000 7f0d9effd700 1 -- 172.21.15.78:0/1836795602 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d9004ad10 con 0x7f0da80aa4d0 2023-08-17T17:53:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.603+0000 7f0dacd10700 1 -- 172.21.15.78:0/1836795602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0da8046af0 con 0x7f0da80aa4d0 2023-08-17T17:53:11.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.607+0000 7f0d9effd700 1 -- 172.21.15.78:0/1836795602 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0d9004e330 con 0x7f0da80aa4d0 2023-08-17T17:53:11.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 -- 172.21.15.78:0/1836795602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d8805ed90 msgr2=0x7f0d88061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d8805ed90 0x7f0d88061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0d98007fd0 tx=0x7f0d98007dd0).stop 2023-08-17T17:53:11.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 -- 172.21.15.78:0/1836795602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80aa4d0 msgr2=0x7f0da80a9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80aa4d0 0x7f0da80a9550 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f0d9000b530 tx=0x7f0d900090f0).stop 2023-08-17T17:53:11.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 -- 172.21.15.78:0/1836795602 shutdown_connections 2023-08-17T17:53:11.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0d8805ed90 0x7f0d88061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0da80c5810 0x7f0da8164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0da80aa0f0 0x7f0da8151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 --2- 172.21.15.78:0/1836795602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da80aa4d0 0x7f0da80a9550 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 -- 172.21.15.78:0/1836795602 >> 172.21.15.78:0/1836795602 conn(0x7f0da806a6a0 msgr2=0x7f0da8152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 -- 172.21.15.78:0/1836795602 shutdown_connections 2023-08-17T17:53:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.609+0000 7f0dacd10700 1 -- 172.21.15.78:0/1836795602 wait complete. 2023-08-17T17:53:11.621 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-17T17:53:11.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.735+0000 7fbc521ae700 1 Processor -- start 2023-08-17T17:53:11.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.735+0000 7fbc521ae700 1 -- start start 2023-08-17T17:53:11.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.736+0000 7fbc521ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c153ec0 0x7fbc4c0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.736+0000 7fbc521ae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbc4c0c7f60 0x7fbc4c15dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.736+0000 7fbc521ae700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4c0c6310 con 0x7fbc4c1542a0 2023-08-17T17:53:11.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.736+0000 7fbc521ae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c0c5d90 con 0x7fbc4c0c7f60 2023-08-17T17:53:11.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.736+0000 7fbc521ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c0c9a20 con 0x7fbc4c153ec0 2023-08-17T17:53:11.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.736+0000 7fbc4b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c153ec0 0x7fbc4c0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.736+0000 7fbc4bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbc4c0c7f60 0x7fbc4c15dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.736+0000 7fbc4b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c153ec0 0x7fbc4c0c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:53318/0 (socket says 172.21.15.78:53318) 2023-08-17T17:53:11.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.736+0000 7fbc4b7fe700 1 -- 172.21.15.78:0/3693625670 learned_addr learned my addr 172.21.15.78:0/3693625670 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:11.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.736+0000 7fbc4affd700 1 --1- 172.21.15.78:0/3693625670 >> v1:172.21.15.150:6789/0 conn(0x7fbc4c1542a0 0x7fbc4c0c7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:48810/0 (socket says 172.21.15.78:48810) 2023-08-17T17:53:11.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.737+0000 7fbc4bfff700 1 -- 172.21.15.78:0/3693625670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c153ec0 msgr2=0x7fbc4c0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:11.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.737+0000 7fbc4bfff700 1 --2- 172.21.15.78:0/3693625670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c153ec0 0x7fbc4c0c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.737+0000 7fbc4bfff700 1 -- 172.21.15.78:0/3693625670 >> v1:172.21.15.150:6789/0 conn(0x7fbc4c1542a0 legacy=0x7fbc4c0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.737+0000 7fbc4bfff700 1 -- 172.21.15.78:0/3693625670 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c0c9c40 con 0x7fbc4c0c7f60 2023-08-17T17:53:11.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.737+0000 7fbc4b7fe700 1 --2- 172.21.15.78:0/3693625670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c153ec0 0x7fbc4c0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:11.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.737+0000 7fbc4bfff700 1 --2- 172.21.15.78:0/3693625670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc4c0c7f60 0x7fbc4c15dbc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fbc44009e60 tx=0x7fbc44009780).ready entity=mon.1 client_cookie=c3e1cfe0aca951cf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:11.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.737+0000 7fbc4a7fc700 1 -- 172.21.15.78:0/3693625670 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400e070 con 0x7fbc4c0c7f60 2023-08-17T17:53:11.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.737+0000 7fbc4a7fc700 1 -- 172.21.15.78:0/3693625670 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4400bb60 con 0x7fbc4c0c7f60 2023-08-17T17:53:11.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.737+0000 7fbc4a7fc700 1 -- 172.21.15.78:0/3693625670 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc44012410 con 0x7fbc4c0c7f60 2023-08-17T17:53:11.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.738+0000 7fbc521ae700 1 -- 172.21.15.78:0/3693625670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc4c0c7f60 msgr2=0x7fbc4c15dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.738+0000 7fbc521ae700 1 --2- 172.21.15.78:0/3693625670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc4c0c7f60 0x7fbc4c15dbc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fbc44009e60 tx=0x7fbc44009780).stop 2023-08-17T17:53:11.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.738+0000 7fbc521ae700 1 -- 172.21.15.78:0/3693625670 shutdown_connections 2023-08-17T17:53:11.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.738+0000 7fbc521ae700 1 --2- 172.21.15.78:0/3693625670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc4c0c7f60 0x7fbc4c15dbc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.738+0000 7fbc521ae700 1 --2- 172.21.15.78:0/3693625670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c153ec0 0x7fbc4c0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.738+0000 7fbc521ae700 1 -- 172.21.15.78:0/3693625670 >> 172.21.15.78:0/3693625670 conn(0x7fbc4c084bb0 msgr2=0x7fbc4c0944d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:11.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.738+0000 7fbc521ae700 1 -- 172.21.15.78:0/3693625670 shutdown_connections 2023-08-17T17:53:11.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.738+0000 7fbc521ae700 1 -- 172.21.15.78:0/3693625670 wait complete. 2023-08-17T17:53:11.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.739+0000 7fbc521ae700 1 Processor -- start 2023-08-17T17:53:11.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.739+0000 7fbc521ae700 1 -- start start 2023-08-17T17:53:11.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc521ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c0c7f60 0x7fbc4c14ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc521ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc4c153ec0 0x7fbc4c063a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc521ae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc4c1542a0 0x7fbc4c063f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc521ae700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c064400 con 0x7fbc4c1542a0 2023-08-17T17:53:11.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc521ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c154920 con 0x7fbc4c153ec0 2023-08-17T17:53:11.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc521ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c0af5c0 con 0x7fbc4c0c7f60 2023-08-17T17:53:11.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc4c1542a0 0x7fbc4c063f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc4c1542a0 0x7fbc4c063f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58962/0 (socket says 172.21.15.78:58962) 2023-08-17T17:53:11.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4bfff700 1 -- 172.21.15.78:0/769895050 learned_addr learned my addr 172.21.15.78:0/769895050 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:11.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4affd700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc4c153ec0 0x7fbc4c063a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4b7fe700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c0c7f60 0x7fbc4c14ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4bfff700 1 -- 172.21.15.78:0/769895050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c0c7f60 msgr2=0x7fbc4c14ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4bfff700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c0c7f60 0x7fbc4c14ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4bfff700 1 -- 172.21.15.78:0/769895050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc4c153ec0 msgr2=0x7fbc4c063a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4bfff700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc4c153ec0 0x7fbc4c063a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4bfff700 1 -- 172.21.15.78:0/769895050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c009300 con 0x7fbc4c1542a0 2023-08-17T17:53:11.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc4bfff700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc4c1542a0 0x7fbc4c063f10 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fbc44011000 tx=0x7fbc44009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:11.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.740+0000 7fbc337fe700 1 -- 172.21.15.78:0/769895050 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4401c660 con 0x7fbc4c1542a0 2023-08-17T17:53:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.741+0000 7fbc337fe700 1 -- 172.21.15.78:0/769895050 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4401c7c0 con 0x7fbc4c1542a0 2023-08-17T17:53:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.741+0000 7fbc337fe700 1 -- 172.21.15.78:0/769895050 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4401cb80 con 0x7fbc4c1542a0 2023-08-17T17:53:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.741+0000 7fbc521ae700 1 -- 172.21.15.78:0/769895050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc44009a20 con 0x7fbc4c1542a0 2023-08-17T17:53:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.741+0000 7fbc521ae700 1 -- 172.21.15.78:0/769895050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c0afb80 con 0x7fbc4c1542a0 2023-08-17T17:53:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.742+0000 7fbc521ae700 1 -- 172.21.15.78:0/769895050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c065310 con 0x7fbc4c1542a0 2023-08-17T17:53:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.742+0000 7fbc337fe700 1 -- 172.21.15.78:0/769895050 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbc4401d420 con 0x7fbc4c1542a0 2023-08-17T17:53:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.742+0000 7fbc337fe700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbc3805ed60 0x7fbc38061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:11.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.742+0000 7fbc4b7fe700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbc3805ed60 0x7fbc38061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:11.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.742+0000 7fbc337fe700 1 -- 172.21.15.78:0/769895050 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fbc4407be00 con 0x7fbc4c1542a0 2023-08-17T17:53:11.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.743+0000 7fbc4b7fe700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbc3805ed60 0x7fbc38061220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbc3c0092d0 tx=0x7fbc3c008040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:11.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.746+0000 7fbc337fe700 1 -- 172.21.15.78:0/769895050 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc4404d470 con 0x7fbc4c1542a0 2023-08-17T17:53:11.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.910+0000 7fbc521ae700 1 -- 172.21.15.78:0/769895050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fbc4c046af0 con 0x7fbc4c1542a0 2023-08-17T17:53:11.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.913+0000 7fbc337fe700 1 -- 172.21.15.78:0/769895050 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7fbc44050a90 con 0x7fbc4c1542a0 2023-08-17T17:53:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 -- 172.21.15.78:0/769895050 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbc3805ed60 msgr2=0x7fbc38061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbc3805ed60 0x7fbc38061220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbc3c0092d0 tx=0x7fbc3c008040).stop 2023-08-17T17:53:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 -- 172.21.15.78:0/769895050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc4c1542a0 msgr2=0x7fbc4c063f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc4c1542a0 0x7fbc4c063f10 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fbc44011000 tx=0x7fbc44009780).stop 2023-08-17T17:53:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 -- 172.21.15.78:0/769895050 shutdown_connections 2023-08-17T17:53:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbc3805ed60 0x7fbc38061220 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc4c1542a0 0x7fbc4c063f10 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc4c0c7f60 0x7fbc4c14ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 --2- 172.21.15.78:0/769895050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc4c153ec0 0x7fbc4c063a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 -- 172.21.15.78:0/769895050 >> 172.21.15.78:0/769895050 conn(0x7fbc4c084bb0 msgr2=0x7fbc4c14f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 -- 172.21.15.78:0/769895050 shutdown_connections 2023-08-17T17:53:11.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:11.915+0000 7fbc521ae700 1 -- 172.21.15.78:0/769895050 wait complete. 2023-08-17T17:53:11.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-08-17T17:53:12.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.040+0000 7fd4f0880700 1 Processor -- start 2023-08-17T17:53:12.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.040+0000 7fd4f0880700 1 -- start start 2023-08-17T17:53:12.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.041+0000 7fd4f0880700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0c2110 0x7fd4ec1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.041+0000 7fd4f0880700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4ec0c4ee0 0x7fd4ec0c5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.041+0000 7fd4f0880700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec151be0 con 0x7fd4ec0650a0 2023-08-17T17:53:12.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.041+0000 7fd4f0880700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec0699f0 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.041+0000 7fd4f0880700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec068950 con 0x7fd4ec0c2110 2023-08-17T17:53:12.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.041+0000 7fd4ead9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4ec0c4ee0 0x7fd4ec0c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.041+0000 7fd4ead9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4ec0c4ee0 0x7fd4ec0c5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58972/0 (socket says 172.21.15.78:58972) 2023-08-17T17:53:12.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.041+0000 7fd4ead9d700 1 -- 172.21.15.78:0/2865937185 learned_addr learned my addr 172.21.15.78:0/2865937185 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:12.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4e1d9b700 1 --2- 172.21.15.78:0/2865937185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0c2110 0x7fd4ec1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4ead9d700 1 -- 172.21.15.78:0/2865937185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0c2110 msgr2=0x7fd4ec1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:12.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4ead9d700 1 --2- 172.21.15.78:0/2865937185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0c2110 0x7fd4ec1516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4ead9d700 1 -- 172.21.15.78:0/2865937185 >> v1:172.21.15.150:6789/0 conn(0x7fd4ec0650a0 legacy=0x7fd4ec0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:12.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4ead9d700 1 -- 172.21.15.78:0/2865937185 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec068c30 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4ead9d700 1 --2- 172.21.15.78:0/2865937185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 0x7fd4ec0c5370 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fd4e4009f20 tx=0x7fd4e4009840).ready entity=mon.0 client_cookie=a8442f6107f70ed4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:12.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4e9d9b700 1 -- 172.21.15.78:0/2865937185 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400e070 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4e9d9b700 1 -- 172.21.15.78:0/2865937185 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e400ba40 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4e9d9b700 1 -- 172.21.15.78:0/2865937185 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400bdc0 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4f0880700 1 -- 172.21.15.78:0/2865937185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 msgr2=0x7fd4ec0c5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:12.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4f0880700 1 --2- 172.21.15.78:0/2865937185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 0x7fd4ec0c5370 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fd4e4009f20 tx=0x7fd4e4009840).stop 2023-08-17T17:53:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4f0880700 1 -- 172.21.15.78:0/2865937185 shutdown_connections 2023-08-17T17:53:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4f0880700 1 --2- 172.21.15.78:0/2865937185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 0x7fd4ec0c5370 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4f0880700 1 --2- 172.21.15.78:0/2865937185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0c2110 0x7fd4ec1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4f0880700 1 -- 172.21.15.78:0/2865937185 >> 172.21.15.78:0/2865937185 conn(0x7fd4ec062fc0 msgr2=0x7fd4ec0c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4f0880700 1 -- 172.21.15.78:0/2865937185 shutdown_connections 2023-08-17T17:53:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.042+0000 7fd4f0880700 1 -- 172.21.15.78:0/2865937185 wait complete. 2023-08-17T17:53:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.044+0000 7fd4f0880700 1 Processor -- start 2023-08-17T17:53:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.044+0000 7fd4f0880700 1 -- start start 2023-08-17T17:53:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.044+0000 7fd4f0880700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4ec0650a0 0x7fd4ec134d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.044+0000 7fd4f0880700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0c2110 0x7fd4ec148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.044+0000 7fd4f0880700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 0x7fd4ec149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.044+0000 7fd4f0880700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec14a5d0 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.044+0000 7fd4f0880700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec149a50 con 0x7fd4ec0650a0 2023-08-17T17:53:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.044+0000 7fd4f0880700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec149d30 con 0x7fd4ec0c2110 2023-08-17T17:53:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4ead9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 0x7fd4ec149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4ead9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 0x7fd4ec149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58978/0 (socket says 172.21.15.78:58978) 2023-08-17T17:53:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4ead9d700 1 -- 172.21.15.78:0/1612745206 learned_addr learned my addr 172.21.15.78:0/1612745206 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4ead9d700 1 -- 172.21.15.78:0/1612745206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0c2110 msgr2=0x7fd4ec148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4ead9d700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0c2110 0x7fd4ec148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4ead9d700 1 -- 172.21.15.78:0/1612745206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4ec0650a0 msgr2=0x7fd4ec134d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4ea59c700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4ec0650a0 0x7fd4ec134d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4ead9d700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4ec0650a0 0x7fd4ec134d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4ead9d700 1 -- 172.21.15.78:0/1612745206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4009ae0 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4ead9d700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 0x7fd4ec149480 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fd4ec0bd990 tx=0x7fd4e4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4e2ffd700 1 -- 172.21.15.78:0/1612745206 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40092e0 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4e2ffd700 1 -- 172.21.15.78:0/1612745206 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e4007610 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4e2ffd700 1 -- 172.21.15.78:0/1612745206 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40079b0 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4f0880700 1 -- 172.21.15.78:0/1612745206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec14a010 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.045+0000 7fd4f0880700 1 -- 172.21.15.78:0/1612745206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec135220 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.046+0000 7fd4f0880700 1 -- 172.21.15.78:0/1612745206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec0a9a70 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.046+0000 7fd4e2ffd700 1 -- 172.21.15.78:0/1612745206 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd4e4025030 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.047+0000 7fd4e2ffd700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4cc05ed90 0x7fd4cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.047+0000 7fd4e2ffd700 1 -- 172.21.15.78:0/1612745206 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fd4e407b7a0 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.047+0000 7fd4ea59c700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4cc05ed90 0x7fd4cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.047+0000 7fd4ea59c700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4cc05ed90 0x7fd4cc061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd4dc007fd0 tx=0x7fd4dc009040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:12.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.051+0000 7fd4e2ffd700 1 -- 172.21.15.78:0/1612745206 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4ec0a9a70 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.275+0000 7fd4f0880700 1 -- 172.21.15.78:0/1612745206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fd4ec0a9a70 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.314+0000 7fd4e2ffd700 1 -- 172.21.15.78:0/1612745206 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v695) v1 ==== 148+0+0 (secure 0 0 0) 0x7fd4ec0a9a70 con 0x7fd4ec0c4ee0 2023-08-17T17:53:12.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 -- 172.21.15.78:0/1612745206 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4cc05ed90 msgr2=0x7fd4cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:12.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4cc05ed90 0x7fd4cc061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd4dc007fd0 tx=0x7fd4dc009040).stop 2023-08-17T17:53:12.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 -- 172.21.15.78:0/1612745206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 msgr2=0x7fd4ec149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:12.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 0x7fd4ec149480 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fd4ec0bd990 tx=0x7fd4e4009840).stop 2023-08-17T17:53:12.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 -- 172.21.15.78:0/1612745206 shutdown_connections 2023-08-17T17:53:12.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd4cc05ed90 0x7fd4cc061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4ec0c4ee0 0x7fd4ec149480 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4ec0650a0 0x7fd4ec134d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 --2- 172.21.15.78:0/1612745206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4ec0c2110 0x7fd4ec148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:12.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 -- 172.21.15.78:0/1612745206 >> 172.21.15.78:0/1612745206 conn(0x7fd4ec062fc0 msgr2=0x7fd4ec0c7050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:12.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 -- 172.21.15.78:0/1612745206 shutdown_connections 2023-08-17T17:53:12.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.316+0000 7fd4f0880700 1 -- 172.21.15.78:0/1612745206 wait complete. 2023-08-17T17:53:12.328 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-08-17T17:53:12.328 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-08-17T17:53:12.328 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-17T17:53:12.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-08-17T17:53:12.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.441+0000 7f99f5adf700 1 Processor -- start 2023-08-17T17:53:12.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.442+0000 7f99f5adf700 1 -- start start 2023-08-17T17:53:12.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.442+0000 7f99f5adf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f00bef00 0x7f99f0064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.442+0000 7f99f5adf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f99f0065140 0x7f99f00c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.442+0000 7f99f5adf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f00c4040 con 0x7f99f00a7fe0 2023-08-17T17:53:12.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.442+0000 7f99f5adf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f00c7080 con 0x7f99f0065140 2023-08-17T17:53:12.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.442+0000 7f99f5adf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00655f0 con 0x7f99f00bef00 2023-08-17T17:53:12.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99eeffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f00bef00 0x7f99f0064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99effff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f99f0065140 0x7f99f00c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99eeffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f00bef00 0x7f99f0064180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:53354/0 (socket says 172.21.15.78:53354) 2023-08-17T17:53:12.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99effff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f99f0065140 0x7f99f00c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:54060/0 (socket says 172.21.15.78:54060) 2023-08-17T17:53:12.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99eeffd700 1 -- 172.21.15.78:0/554581109 learned_addr learned my addr 172.21.15.78:0/554581109 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:12.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99effff700 1 -- 172.21.15.78:0/554581109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f00bef00 msgr2=0x7f99f0064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:12.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99effff700 1 --2- 172.21.15.78:0/554581109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f00bef00 0x7f99f0064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99effff700 1 -- 172.21.15.78:0/554581109 >> v1:172.21.15.150:6789/0 conn(0x7f99f00a7fe0 legacy=0x7f99f00be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:12.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99ee7fc700 1 -- 172.21.15.78:0/554581109 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196969315 0 0) 0x7f99f00c4040 con 0x7f99f00a7fe0 2023-08-17T17:53:12.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99effff700 1 -- 172.21.15.78:0/554581109 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f00c3430 con 0x7f99f0065140 2023-08-17T17:53:12.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.443+0000 7f99effff700 1 --2- 172.21.15.78:0/554581109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99f0065140 0x7f99f00c6b90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f99e8009760 tx=0x7f99e8009060).ready entity=mon.1 client_cookie=a6528a49d0a24d8a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:12.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99ee7fc700 1 -- 172.21.15.78:0/554581109 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e800f510 con 0x7f99f0065140 2023-08-17T17:53:12.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99ee7fc700 1 -- 172.21.15.78:0/554581109 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e800f670 con 0x7f99f0065140 2023-08-17T17:53:12.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99ee7fc700 1 -- 172.21.15.78:0/554581109 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e800f9f0 con 0x7f99f0065140 2023-08-17T17:53:12.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99f5adf700 1 -- 172.21.15.78:0/554581109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99f0065140 msgr2=0x7f99f00c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:12.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99f5adf700 1 --2- 172.21.15.78:0/554581109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99f0065140 0x7f99f00c6b90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f99e8009760 tx=0x7f99e8009060).stop 2023-08-17T17:53:12.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99f5adf700 1 -- 172.21.15.78:0/554581109 shutdown_connections 2023-08-17T17:53:12.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99f5adf700 1 --2- 172.21.15.78:0/554581109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99f0065140 0x7f99f00c6b90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99f5adf700 1 --2- 172.21.15.78:0/554581109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f00bef00 0x7f99f0064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99f5adf700 1 -- 172.21.15.78:0/554581109 >> 172.21.15.78:0/554581109 conn(0x7f99f0092330 msgr2=0x7f99f0062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:12.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99f5adf700 1 -- 172.21.15.78:0/554581109 shutdown_connections 2023-08-17T17:53:12.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.444+0000 7f99f5adf700 1 -- 172.21.15.78:0/554581109 wait complete. 2023-08-17T17:53:12.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.445+0000 7f99f5adf700 1 Processor -- start 2023-08-17T17:53:12.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.445+0000 7f99f5adf700 1 -- start start 2023-08-17T17:53:12.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99f5adf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f0065140 0x7f99f00aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99f5adf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99f00a7fe0 0x7f99f00abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99f5adf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f00bef00 0x7f99f0152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99f5adf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00ad2b0 con 0x7f99f00bef00 2023-08-17T17:53:12.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99f5adf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00a83c0 con 0x7f99f00a7fe0 2023-08-17T17:53:12.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99f5adf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00ac6a0 con 0x7f99f0065140 2023-08-17T17:53:12.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99effff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f00bef00 0x7f99f0152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99effff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f00bef00 0x7f99f0152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58994/0 (socket says 172.21.15.78:58994) 2023-08-17T17:53:12.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99effff700 1 -- 172.21.15.78:0/3085790145 learned_addr learned my addr 172.21.15.78:0/3085790145 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:12.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99eeffd700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99f00a7fe0 0x7f99f00abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.446+0000 7f99ef7fe700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f0065140 0x7f99f00aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99effff700 1 -- 172.21.15.78:0/3085790145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f0065140 msgr2=0x7f99f00aaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99effff700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f0065140 0x7f99f00aaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99effff700 1 -- 172.21.15.78:0/3085790145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99f00a7fe0 msgr2=0x7f99f00abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99effff700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99f00a7fe0 0x7f99f00abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99effff700 1 -- 172.21.15.78:0/3085790145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80092a0 con 0x7f99f00bef00 2023-08-17T17:53:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99effff700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f00bef00 0x7f99f0152e80 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f99e8009e00 tx=0x7f99e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99d77fe700 1 -- 172.21.15.78:0/3085790145 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8011600 con 0x7f99f00bef00 2023-08-17T17:53:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99d77fe700 1 -- 172.21.15.78:0/3085790145 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e801e070 con 0x7f99f00bef00 2023-08-17T17:53:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99f5adf700 1 -- 172.21.15.78:0/3085790145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f00ac980 con 0x7f99f00bef00 2023-08-17T17:53:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99d77fe700 1 -- 172.21.15.78:0/3085790145 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e80119b0 con 0x7f99f00bef00 2023-08-17T17:53:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.447+0000 7f99f5adf700 1 -- 172.21.15.78:0/3085790145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f00acf40 con 0x7f99f00bef00 2023-08-17T17:53:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.448+0000 7f99f5adf700 1 -- 172.21.15.78:0/3085790145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f00ad420 con 0x7f99f00bef00 2023-08-17T17:53:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.448+0000 7f99d77fe700 1 -- 172.21.15.78:0/3085790145 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f99e800f070 con 0x7f99f00bef00 2023-08-17T17:53:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.448+0000 7f99d77fe700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99dc05edc0 0x7f99dc061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.449+0000 7f99d77fe700 1 -- 172.21.15.78:0/3085790145 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f99e807ad20 con 0x7f99f00bef00 2023-08-17T17:53:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.449+0000 7f99ef7fe700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99dc05edc0 0x7f99dc061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.449+0000 7f99ef7fe700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99dc05edc0 0x7f99dc061280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f99e0001560 tx=0x7f99e0007f30).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.452+0000 7f99d77fe700 1 -- 172.21.15.78:0/3085790145 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99e804c3f0 con 0x7f99f00bef00 2023-08-17T17:53:12.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:12.681+0000 7f99f5adf700 1 -- 172.21.15.78:0/3085790145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f99f00c3710 con 0x7f99f00bef00 2023-08-17T17:53:13.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.316+0000 7f99d77fe700 1 -- 172.21.15.78:0/3085790145 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v696) v1 ==== 177+0+0 (secure 0 0 0) 0x7f99e8028070 con 0x7f99f00bef00 2023-08-17T17:53:13.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 -- 172.21.15.78:0/3085790145 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99dc05edc0 msgr2=0x7f99dc061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99dc05edc0 0x7f99dc061280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f99e0001560 tx=0x7f99e0007f30).stop 2023-08-17T17:53:13.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 -- 172.21.15.78:0/3085790145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f00bef00 msgr2=0x7f99f0152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f00bef00 0x7f99f0152e80 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f99e8009e00 tx=0x7f99e8017000).stop 2023-08-17T17:53:13.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 -- 172.21.15.78:0/3085790145 shutdown_connections 2023-08-17T17:53:13.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f99dc05edc0 0x7f99dc061280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f00bef00 0x7f99f0152e80 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99f0065140 0x7f99f00aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 --2- 172.21.15.78:0/3085790145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99f00a7fe0 0x7f99f00abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 -- 172.21.15.78:0/3085790145 >> 172.21.15.78:0/3085790145 conn(0x7f99f0092330 msgr2=0x7f99f00c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:13.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 -- 172.21.15.78:0/3085790145 shutdown_connections 2023-08-17T17:53:13.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.318+0000 7f99f5adf700 1 -- 172.21.15.78:0/3085790145 wait complete. 2023-08-17T17:53:13.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T17:53:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.484+0000 7fc4a5bbe700 1 Processor -- start 2023-08-17T17:53:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.484+0000 7fc4a5bbe700 1 -- start start 2023-08-17T17:53:13.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.485+0000 7fc4a5bbe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4a0151e20 0x7fc4a00c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.485+0000 7fc4a5bbe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc4a0157be0 0x7fc4a0158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.485+0000 7fc4a5bbe700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a0158560 con 0x7fc4a0151a40 2023-08-17T17:53:13.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.485+0000 7fc4a5bbe700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00c6620 con 0x7fc4a0157be0 2023-08-17T17:53:13.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.485+0000 7fc4a5bbe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a00c6900 con 0x7fc4a0151e20 2023-08-17T17:53:13.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.485+0000 7fc49ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4a0151e20 0x7fc4a00c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.485+0000 7fc4a53bd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc4a0157be0 0x7fc4a0158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.485+0000 7fc4a4bbc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc4a0151a40 0x7fc4a00c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:48840/0 (socket says 172.21.15.78:48840) 2023-08-17T17:53:13.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.485+0000 7fc4a4bbc700 1 -- 172.21.15.78:0/3345401254 learned_addr learned my addr 172.21.15.78:0/3345401254 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:13.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a53bd700 1 -- 172.21.15.78:0/3345401254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4a0151e20 msgr2=0x7fc4a00c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a53bd700 1 --2- 172.21.15.78:0/3345401254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4a0151e20 0x7fc4a00c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a53bd700 1 -- 172.21.15.78:0/3345401254 >> v1:172.21.15.150:6789/0 conn(0x7fc4a0151a40 legacy=0x7fc4a00c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc49f7fe700 1 -- 172.21.15.78:0/3345401254 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995521410 0 0) 0x7fc4a0158560 con 0x7fc4a0151a40 2023-08-17T17:53:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a53bd700 1 -- 172.21.15.78:0/3345401254 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a00c6be0 con 0x7fc4a0157be0 2023-08-17T17:53:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a53bd700 1 --2- 172.21.15.78:0/3345401254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4a0157be0 0x7fc4a0158070 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fc498009e60 tx=0x7fc498009780).ready entity=mon.1 client_cookie=504fd0e00ef659ba server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc49f7fe700 1 -- 172.21.15.78:0/3345401254 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49800e070 con 0x7fc4a0157be0 2023-08-17T17:53:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc49f7fe700 1 -- 172.21.15.78:0/3345401254 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49800bb60 con 0x7fc4a0157be0 2023-08-17T17:53:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc49f7fe700 1 -- 172.21.15.78:0/3345401254 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498012410 con 0x7fc4a0157be0 2023-08-17T17:53:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3345401254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4a0157be0 msgr2=0x7fc4a0158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a5bbe700 1 --2- 172.21.15.78:0/3345401254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4a0157be0 0x7fc4a0158070 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fc498009e60 tx=0x7fc498009780).stop 2023-08-17T17:53:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3345401254 shutdown_connections 2023-08-17T17:53:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a5bbe700 1 --2- 172.21.15.78:0/3345401254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4a0157be0 0x7fc4a0158070 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a5bbe700 1 --2- 172.21.15.78:0/3345401254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4a0151e20 0x7fc4a00c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3345401254 >> 172.21.15.78:0/3345401254 conn(0x7fc4a00943b0 msgr2=0x7fc4a006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3345401254 shutdown_connections 2023-08-17T17:53:13.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.486+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3345401254 wait complete. 2023-08-17T17:53:13.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.487+0000 7fc4a5bbe700 1 Processor -- start 2023-08-17T17:53:13.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.488+0000 7fc4a5bbe700 1 -- start start 2023-08-17T17:53:13.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.488+0000 7fc4a5bbe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4a0151a40 0x7fc4a0145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.488+0000 7fc4a5bbe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4a0151e20 0x7fc4a00c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.488+0000 7fc4a5bbe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0157be0 0x7fc4a00c1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.488+0000 7fc4a5bbe700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a00c18f0 con 0x7fc4a0157be0 2023-08-17T17:53:13.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.488+0000 7fc4a5bbe700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a00a81b0 con 0x7fc4a0151e20 2023-08-17T17:53:13.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.488+0000 7fc4a5bbe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0152e90 con 0x7fc4a0151a40 2023-08-17T17:53:13.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.488+0000 7fc4a53bd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0157be0 0x7fc4a00c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.488+0000 7fc4a53bd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0157be0 0x7fc4a00c1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59004/0 (socket says 172.21.15.78:59004) 2023-08-17T17:53:13.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.488+0000 7fc4a53bd700 1 -- 172.21.15.78:0/3286691326 learned_addr learned my addr 172.21.15.78:0/3286691326 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:13.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc49ffff700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4a0151e20 0x7fc4a00c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc4a4bbc700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4a0151a40 0x7fc4a0145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc4a53bd700 1 -- 172.21.15.78:0/3286691326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4a0151a40 msgr2=0x7fc4a0145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc4a53bd700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4a0151a40 0x7fc4a0145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc4a53bd700 1 -- 172.21.15.78:0/3286691326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4a0151e20 msgr2=0x7fc4a00c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc4a53bd700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4a0151e20 0x7fc4a00c0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc4a53bd700 1 -- 172.21.15.78:0/3286691326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc498009a20 con 0x7fc4a0157be0 2023-08-17T17:53:13.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc4a53bd700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0157be0 0x7fc4a00c1400 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fc49800b6c0 tx=0x7fc498009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:13.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc49cff9700 1 -- 172.21.15.78:0/3286691326 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49801d630 con 0x7fc4a0157be0 2023-08-17T17:53:13.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc49cff9700 1 -- 172.21.15.78:0/3286691326 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49801d790 con 0x7fc4a0157be0 2023-08-17T17:53:13.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3286691326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a00a8470 con 0x7fc4a0157be0 2023-08-17T17:53:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc49cff9700 1 -- 172.21.15.78:0/3286691326 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49801db50 con 0x7fc4a0157be0 2023-08-17T17:53:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.489+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3286691326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a00a8a30 con 0x7fc4a0157be0 2023-08-17T17:53:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.490+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3286691326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a0082f90 con 0x7fc4a0157be0 2023-08-17T17:53:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.490+0000 7fc49cff9700 1 -- 172.21.15.78:0/3286691326 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc498026410 con 0x7fc4a0157be0 2023-08-17T17:53:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.491+0000 7fc49cff9700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc48405ed90 0x7fc484061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.491+0000 7fc49cff9700 1 -- 172.21.15.78:0/3286691326 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fc49807bab0 con 0x7fc4a0157be0 2023-08-17T17:53:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.491+0000 7fc4a4bbc700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc48405ed90 0x7fc484061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.491+0000 7fc4a4bbc700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc48405ed90 0x7fc484061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc4a00c4720 tx=0x7fc494009040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.495+0000 7fc49cff9700 1 -- 172.21.15.78:0/3286691326 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc49804d120 con 0x7fc4a0157be0 2023-08-17T17:53:13.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.660+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3286691326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc4a005f910 con 0x7fc4a0157be0 2023-08-17T17:53:13.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.664+0000 7fc49cff9700 1 -- 172.21.15.78:0/3286691326 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc498050740 con 0x7fc4a0157be0 2023-08-17T17:53:13.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.665+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3286691326 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc48405ed90 msgr2=0x7fc484061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.665+0000 7fc4a5bbe700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc48405ed90 0x7fc484061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc4a00c4720 tx=0x7fc494009040).stop 2023-08-17T17:53:13.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.665+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3286691326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0157be0 msgr2=0x7fc4a00c1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.665+0000 7fc4a5bbe700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0157be0 0x7fc4a00c1400 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fc49800b6c0 tx=0x7fc498009780).stop 2023-08-17T17:53:13.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.666+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3286691326 shutdown_connections 2023-08-17T17:53:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.666+0000 7fc4a5bbe700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc48405ed90 0x7fc484061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.666+0000 7fc4a5bbe700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0157be0 0x7fc4a00c1400 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.666+0000 7fc4a5bbe700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4a0151a40 0x7fc4a0145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.666+0000 7fc4a5bbe700 1 --2- 172.21.15.78:0/3286691326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4a0151e20 0x7fc4a00c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.666+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3286691326 >> 172.21.15.78:0/3286691326 conn(0x7fc4a00943b0 msgr2=0x7fc4a00c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.666+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3286691326 shutdown_connections 2023-08-17T17:53:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.666+0000 7fc4a5bbe700 1 -- 172.21.15.78:0/3286691326 wait complete. 2023-08-17T17:53:13.677 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:53:13.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:53:13.723 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:53:13.766 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:53:13.766 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T17:53:13.767 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.878+0000 7f42a415a700 1 Processor -- start 2023-08-17T17:53:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.878+0000 7f42a415a700 1 -- start start 2023-08-17T17:53:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.879+0000 7f42a415a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f429c154140 0x7f429c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.879+0000 7f42a415a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429c154520 con 0x7f429c0a7c40 2023-08-17T17:53:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.879+0000 7f42a415a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429c0c91e0 con 0x7f429c0c1010 2023-08-17T17:53:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.879+0000 7f42a415a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c0c94c0 con 0x7f429c154140 2023-08-17T17:53:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.879+0000 7f42a16f5700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f429c0a7c40 0x7f429c0c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56744/0 (socket says 172.21.15.78:56744) 2023-08-17T17:53:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.879+0000 7f42a16f5700 1 -- 172.21.15.78:0/1103414546 learned_addr learned my addr 172.21.15.78:0/1103414546 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a1ef6700 1 --2- 172.21.15.78:0/1103414546 >> v2:172.21.15.150:3300/0 conn(0x7f429c154140 0x7f429c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940702006 0 0) 0x7f429c154520 con 0x7f429c0a7c40 2023-08-17T17:53:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42880033f0 con 0x7f429c0a7c40 2023-08-17T17:53:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2297002911 0 0) 0x7f42880033f0 con 0x7f429c0a7c40 2023-08-17T17:53:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 >> v2:172.21.15.150:3300/0 conn(0x7f429c154140 msgr2=0x7f429c0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 --2- 172.21.15.78:0/1103414546 >> v2:172.21.15.150:3300/0 conn(0x7f429c154140 0x7f429c0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 >> v1:172.21.15.150:6789/0 conn(0x7f429c0c1010 legacy=0x7f429c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c0c97a0 con 0x7f429c0a7c40 2023-08-17T17:53:13.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f428c001470 con 0x7f429c0a7c40 2023-08-17T17:53:13.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 >> v1:172.21.15.78:6789/0 conn(0x7f429c0a7c40 legacy=0x7f429c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f4288003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4288004690 0x7f4288004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4288005000 0x7f428800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0c94c0 con 0x7f42880038e0 2023-08-17T17:53:13.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428800bf60 con 0x7f4288004690 2023-08-17T17:53:13.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428800c0f0 con 0x7f4288005000 2023-08-17T17:53:13.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a1ef6700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f4288003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a16f5700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4288004690 0x7f4288004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a1ef6700 1 -- 172.21.15.78:0/1103414546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4288005000 msgr2=0x7f428800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:13.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a26f7700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4288005000 0x7f428800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a1ef6700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4288005000 0x7f428800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a1ef6700 1 -- 172.21.15.78:0/1103414546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4288004690 msgr2=0x7f4288004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:13.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a1ef6700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4288004690 0x7f4288004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a1ef6700 1 -- 172.21.15.78:0/1103414546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880033f0 con 0x7f42880038e0 2023-08-17T17:53:13.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a16f5700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4288004690 0x7f4288004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:13.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a26f7700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4288005000 0x7f428800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:13.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a26f7700 1 -- 172.21.15.78:0/1103414546 reap_dead start 2023-08-17T17:53:13.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.880+0000 7f42a1ef6700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f4288003d00 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f429800e1c0 tx=0x7f429800b040).ready entity=mon.0 client_cookie=a5063b6064320036 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:13.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.881+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298009ac0 con 0x7f42880038e0 2023-08-17T17:53:13.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.881+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429800f040 con 0x7f42880038e0 2023-08-17T17:53:13.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.881+0000 7f42a0ef4700 1 -- 172.21.15.78:0/1103414546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800eca0 con 0x7f42880038e0 2023-08-17T17:53:13.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.881+0000 7f42a415a700 1 -- 172.21.15.78:0/1103414546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 msgr2=0x7f4288003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.881+0000 7f42a415a700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f4288003d00 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f429800e1c0 tx=0x7f429800b040).stop 2023-08-17T17:53:13.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.881+0000 7f42a415a700 1 -- 172.21.15.78:0/1103414546 shutdown_connections 2023-08-17T17:53:13.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.881+0000 7f42a415a700 1 --2- 172.21.15.78:0/1103414546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f4288003d00 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.881+0000 7f42a415a700 1 -- 172.21.15.78:0/1103414546 >> 172.21.15.78:0/1103414546 conn(0x7f429c094510 msgr2=0x7f429c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:13.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.881+0000 7f42a415a700 1 -- 172.21.15.78:0/1103414546 shutdown_connections 2023-08-17T17:53:13.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.881+0000 7f42a415a700 1 -- 172.21.15.78:0/1103414546 wait complete. 2023-08-17T17:53:13.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.882+0000 7f42a415a700 1 Processor -- start 2023-08-17T17:53:13.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.882+0000 7f42a415a700 1 -- start start 2023-08-17T17:53:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a415a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f429c0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a415a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f429c0acf00 0x7f429c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a415a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f429c154710 0x7f429c153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a415a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0b0ce0 con 0x7f42880038e0 2023-08-17T17:53:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a415a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0ae9f0 con 0x7f429c154710 2023-08-17T17:53:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a415a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c151280 con 0x7f429c0acf00 2023-08-17T17:53:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a1ef6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f429c0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a1ef6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f429c0b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59022/0 (socket says 172.21.15.78:59022) 2023-08-17T17:53:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a1ef6700 1 -- 172.21.15.78:0/4271265722 learned_addr learned my addr 172.21.15.78:0/4271265722 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a26f7700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f429c154710 0x7f429c153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a16f5700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f429c0acf00 0x7f429c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a1ef6700 1 -- 172.21.15.78:0/4271265722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f429c0acf00 msgr2=0x7f429c150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a1ef6700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f429c0acf00 0x7f429c150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a1ef6700 1 -- 172.21.15.78:0/4271265722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f429c154710 msgr2=0x7f429c153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:13.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a1ef6700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f429c154710 0x7f429c153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:13.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a1ef6700 1 -- 172.21.15.78:0/4271265722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c0ae410 con 0x7f42880038e0 2023-08-17T17:53:13.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.883+0000 7f42a26f7700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f429c154710 0x7f429c153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:13.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.884+0000 7f42a1ef6700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f429c0b07f0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f4298013ab0 tx=0x7f429801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:13.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.884+0000 7f4291ffb700 1 -- 172.21.15.78:0/4271265722 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298027420 con 0x7f42880038e0 2023-08-17T17:53:13.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.884+0000 7f4291ffb700 1 -- 172.21.15.78:0/4271265722 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4298027580 con 0x7f42880038e0 2023-08-17T17:53:13.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.884+0000 7f42a415a700 1 -- 172.21.15.78:0/4271265722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c0ad380 con 0x7f42880038e0 2023-08-17T17:53:13.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.884+0000 7f4291ffb700 1 -- 172.21.15.78:0/4271265722 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298027730 con 0x7f42880038e0 2023-08-17T17:53:13.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.884+0000 7f42a415a700 1 -- 172.21.15.78:0/4271265722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c0ae680 con 0x7f42880038e0 2023-08-17T17:53:13.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.885+0000 7f42a415a700 1 -- 172.21.15.78:0/4271265722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c0ae270 con 0x7f42880038e0 2023-08-17T17:53:13.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.885+0000 7f4291ffb700 1 -- 172.21.15.78:0/4271265722 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f429802e070 con 0x7f42880038e0 2023-08-17T17:53:13.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.886+0000 7f4291ffb700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f428005ed60 0x7f4280061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:13.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.886+0000 7f4291ffb700 1 -- 172.21.15.78:0/4271265722 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f429807bbe0 con 0x7f42880038e0 2023-08-17T17:53:13.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.886+0000 7f42a16f5700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f428005ed60 0x7f4280061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:13.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.886+0000 7f42a16f5700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f428005ed60 0x7f4280061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f428c001ce0 tx=0x7f428c009040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:13.890+0000 7f4291ffb700 1 -- 172.21.15.78:0/4271265722 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f429c0ae270 con 0x7f42880038e0 2023-08-17T17:53:14.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.092+0000 7f42a415a700 1 -- 172.21.15.78:0/4271265722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f429c0ae270 con 0x7f42880038e0 2023-08-17T17:53:14.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.092+0000 7f4291ffb700 1 -- 172.21.15.78:0/4271265722 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f429c0ae270 con 0x7f42880038e0 2023-08-17T17:53:14.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:14.093 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2905752860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2905752860},{"type":"v1","addr":"172.21.15.150:6833","nonce":2905752860}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":6509,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3678190052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3678190052},{"type":"v1","addr":"172.21.15.150:6835","nonce":3678190052}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7620,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/652553934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":652553934},{"type":"v1","addr":"172.21.15.78:6836","nonce":652553934}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7623,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/728629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":728629628},{"type":"v1","addr":"172.21.15.78:6837","nonce":728629628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[]} 2023-08-17T17:53:14.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 -- 172.21.15.78:0/4271265722 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f428005ed60 msgr2=0x7f4280061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:14.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f428005ed60 0x7f4280061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f428c001ce0 tx=0x7f428c009040).stop 2023-08-17T17:53:14.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 -- 172.21.15.78:0/4271265722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 msgr2=0x7f429c0b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:14.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f429c0b07f0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f4298013ab0 tx=0x7f429801a000).stop 2023-08-17T17:53:14.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 -- 172.21.15.78:0/4271265722 shutdown_connections 2023-08-17T17:53:14.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f428005ed60 0x7f4280061220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:14.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f429c154710 0x7f429c153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:14.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42880038e0 0x7f429c0b07f0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:14.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 --2- 172.21.15.78:0/4271265722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f429c0acf00 0x7f429c150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:14.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 -- 172.21.15.78:0/4271265722 >> 172.21.15.78:0/4271265722 conn(0x7f429c094510 msgr2=0x7f429c063d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:14.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 -- 172.21.15.78:0/4271265722 shutdown_connections 2023-08-17T17:53:14.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.094+0000 7f42a415a700 1 -- 172.21.15.78:0/4271265722 wait complete. 2023-08-17T17:53:14.096 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 45 2023-08-17T17:53:14.106 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T17:53:14.106 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T17:53:14.107 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T17:53:14.107 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:53:14.107 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T17:53:14.107 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T17:53:14.107 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T17:53:14.108 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:53:14.108 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T17:53:14.108 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T17:53:14.108 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T17:53:14.109 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:53:14.109 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T17:53:14.109 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T17:53:14.109 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T17:53:14.109 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:53:14.115 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T17:53:14.115 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T17:53:14.116 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T17:53:14.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T17:53:14.118 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T17:53:14.119 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T17:53:14.119 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T17:53:14.120 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T17:53:14.157 INFO:tasks.ceph.mds.a:Started 2023-08-17T17:53:14.157 DEBUG:teuthology.parallel:result is None 2023-08-17T17:53:14.158 INFO:tasks.ceph.mds.c:Started 2023-08-17T17:53:14.158 DEBUG:teuthology.parallel:result is None 2023-08-17T17:53:14.160 INFO:tasks.ceph.mds.b:Started 2023-08-17T17:53:14.161 DEBUG:teuthology.parallel:result is None 2023-08-17T17:53:14.161 INFO:tasks.ceph.mds.d:Started 2023-08-17T17:53:14.162 DEBUG:teuthology.parallel:result is None 2023-08-17T17:53:14.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T17:53:14.230 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T17:53:14.230 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:53:14.240 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T17:53:14.241 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:53:14.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.284+0000 7fe369640700 1 Processor -- start 2023-08-17T17:53:14.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.284+0000 7fe369640700 1 -- start start 2023-08-17T17:53:14.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe369640700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe364153fa0 0x7fe3640a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:14.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe369640700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3640c7a40 con 0x7fe364064e20 2023-08-17T17:53:14.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe369640700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3640c6e30 con 0x7fe3640beb50 2023-08-17T17:53:14.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe369640700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3640c7110 con 0x7fe364153fa0 2023-08-17T17:53:14.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe3637fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe364064e20 0x7fe3640be440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56764/0 (socket says 172.21.15.78:56764) 2023-08-17T17:53:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe3637fe700 1 -- 172.21.15.78:0/2654863590 learned_addr learned my addr 172.21.15.78:0/2654863590 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe363fff700 1 --2- 172.21.15.78:0/2654863590 >> v2:172.21.15.150:3300/0 conn(0x7fe364153fa0 0x7fe3640a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe362ffd700 1 -- 172.21.15.78:0/2654863590 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232772984 0 0) 0x7fe3640c7a40 con 0x7fe364064e20 2023-08-17T17:53:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe362ffd700 1 -- 172.21.15.78:0/2654863590 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3500033f0 con 0x7fe364064e20 2023-08-17T17:53:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe362ffd700 1 -- 172.21.15.78:0/2654863590 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893909717 0 0) 0x7fe3640c6e30 con 0x7fe3640beb50 2023-08-17T17:53:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe362ffd700 1 -- 172.21.15.78:0/2654863590 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3640c7a40 con 0x7fe3640beb50 2023-08-17T17:53:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe362ffd700 1 -- 172.21.15.78:0/2654863590 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 986848072 0 0) 0x7fe3500033f0 con 0x7fe364064e20 2023-08-17T17:53:14.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe363fff700 1 -- 172.21.15.78:0/2654863590 >> v1:172.21.15.150:6789/0 conn(0x7fe3640beb50 legacy=0x7fe3640c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:14.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe363fff700 1 -- 172.21.15.78:0/2654863590 >> v1:172.21.15.78:6789/0 conn(0x7fe364064e20 legacy=0x7fe3640be440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:14.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.285+0000 7fe363fff700 1 -- 172.21.15.78:0/2654863590 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3640c73f0 con 0x7fe364153fa0 2023-08-17T17:53:14.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe363fff700 1 --2- 172.21.15.78:0/2654863590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe364153fa0 0x7fe3640a59f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fe354009760 tx=0x7fe354009060).ready entity=mon.1 client_cookie=e4ac5525c9668a09 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:14.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe362ffd700 1 -- 172.21.15.78:0/2654863590 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c001470 con 0x7fe364153fa0 2023-08-17T17:53:14.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe362ffd700 1 -- 172.21.15.78:0/2654863590 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354011400 con 0x7fe364153fa0 2023-08-17T17:53:14.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe362ffd700 1 -- 172.21.15.78:0/2654863590 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354011780 con 0x7fe364153fa0 2023-08-17T17:53:14.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe369640700 1 -- 172.21.15.78:0/2654863590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe364153fa0 msgr2=0x7fe3640a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:14.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe369640700 1 --2- 172.21.15.78:0/2654863590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe364153fa0 0x7fe3640a59f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fe354009760 tx=0x7fe354009060).stop 2023-08-17T17:53:14.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe369640700 1 -- 172.21.15.78:0/2654863590 shutdown_connections 2023-08-17T17:53:14.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe369640700 1 --2- 172.21.15.78:0/2654863590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe364153fa0 0x7fe3640a59f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:14.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe369640700 1 -- 172.21.15.78:0/2654863590 >> 172.21.15.78:0/2654863590 conn(0x7fe3640922c0 msgr2=0x7fe364062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:14.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe369640700 1 -- 172.21.15.78:0/2654863590 shutdown_connections 2023-08-17T17:53:14.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.286+0000 7fe369640700 1 -- 172.21.15.78:0/2654863590 wait complete. 2023-08-17T17:53:14.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.287+0000 7fe369640700 1 Processor -- start 2023-08-17T17:53:14.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.288+0000 7fe369640700 1 -- start start 2023-08-17T17:53:14.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.288+0000 7fe369640700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe364064e20 0x7fe364150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:14.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.288+0000 7fe369640700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3640beb50 0x7fe364164080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:14.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.288+0000 7fe369640700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe364153fa0 0x7fe36414f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:14.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.288+0000 7fe369640700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe364165080 con 0x7fe3640beb50 2023-08-17T17:53:14.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.288+0000 7fe369640700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe364150c00 con 0x7fe364153fa0 2023-08-17T17:53:14.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.288+0000 7fe369640700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3641678b0 con 0x7fe364064e20 2023-08-17T17:53:14.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.288+0000 7fe3637fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3640beb50 0x7fe364164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:14.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.288+0000 7fe3637fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3640beb50 0x7fe364164080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59060/0 (socket says 172.21.15.78:59060) 2023-08-17T17:53:14.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.288+0000 7fe3637fe700 1 -- 172.21.15.78:0/759888095 learned_addr learned my addr 172.21.15.78:0/759888095 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:14.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe368e3f700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe364153fa0 0x7fe36414f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:14.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe363fff700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe364064e20 0x7fe364150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:14.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe3637fe700 1 -- 172.21.15.78:0/759888095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe364064e20 msgr2=0x7fe364150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:14.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe3637fe700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe364064e20 0x7fe364150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:14.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe3637fe700 1 -- 172.21.15.78:0/759888095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe364153fa0 msgr2=0x7fe36414f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:14.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe3637fe700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe364153fa0 0x7fe36414f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:14.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe3637fe700 1 -- 172.21.15.78:0/759888095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540092a0 con 0x7fe3640beb50 2023-08-17T17:53:14.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe3637fe700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3640beb50 0x7fe364164080 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fe34c00c800 tx=0x7fe34c001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:14.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe35bfff700 1 -- 172.21.15.78:0/759888095 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c007170 con 0x7fe3640beb50 2023-08-17T17:53:14.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe35bfff700 1 -- 172.21.15.78:0/759888095 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c0072d0 con 0x7fe3640beb50 2023-08-17T17:53:14.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe35bfff700 1 -- 172.21.15.78:0/759888095 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c0048c0 con 0x7fe3640beb50 2023-08-17T17:53:14.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe369640700 1 -- 172.21.15.78:0/759888095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe364164570 con 0x7fe3640beb50 2023-08-17T17:53:14.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.289+0000 7fe369640700 1 -- 172.21.15.78:0/759888095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe364164ac0 con 0x7fe3640beb50 2023-08-17T17:53:14.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.290+0000 7fe369640700 1 -- 172.21.15.78:0/759888095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe364167680 con 0x7fe3640beb50 2023-08-17T17:53:14.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.291+0000 7fe35bfff700 1 -- 172.21.15.78:0/759888095 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe34c01b070 con 0x7fe3640beb50 2023-08-17T17:53:14.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.291+0000 7fe35bfff700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe34405ed90 0x7fe344061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:14.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.291+0000 7fe35bfff700 1 -- 172.21.15.78:0/759888095 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5785+0+0 (secure 0 0 0) 0x7fe34c079670 con 0x7fe3640beb50 2023-08-17T17:53:14.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.291+0000 7fe363fff700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe34405ed90 0x7fe344061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:14.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.291+0000 7fe363fff700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe34405ed90 0x7fe344061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe354009760 tx=0x7fe354016000).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:14.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.295+0000 7fe35bfff700 1 -- 172.21.15.78:0/759888095 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe34c0498f0 con 0x7fe3640beb50 2023-08-17T17:53:14.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:14.471+0000 7fe369640700 1 -- 172.21.15.78:0/759888095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe364167680 con 0x7fe3640beb50 2023-08-17T17:53:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.322+0000 7fe35bfff700 1 -- 172.21.15.78:0/759888095 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v131) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe364167680 con 0x7fe3640beb50 2023-08-17T17:53:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 -- 172.21.15.78:0/759888095 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe34405ed90 msgr2=0x7fe344061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe34405ed90 0x7fe344061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe354009760 tx=0x7fe354016000).stop 2023-08-17T17:53:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 -- 172.21.15.78:0/759888095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3640beb50 msgr2=0x7fe364164080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3640beb50 0x7fe364164080 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fe34c00c800 tx=0x7fe34c001b50).stop 2023-08-17T17:53:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 -- 172.21.15.78:0/759888095 shutdown_connections 2023-08-17T17:53:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe34405ed90 0x7fe344061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe364153fa0 0x7fe36414f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe364064e20 0x7fe364150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 --2- 172.21.15.78:0/759888095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3640beb50 0x7fe364164080 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 -- 172.21.15.78:0/759888095 >> 172.21.15.78:0/759888095 conn(0x7fe3640922c0 msgr2=0x7fe3640c5190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 -- 172.21.15.78:0/759888095 shutdown_connections 2023-08-17T17:53:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.324+0000 7fe369640700 1 -- 172.21.15.78:0/759888095 wait complete. 2023-08-17T17:53:15.326 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-08-17T17:53:15.336 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T17:53:15.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.448+0000 7f804b533700 1 Processor -- start 2023-08-17T17:53:15.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.448+0000 7f804b533700 1 -- start start 2023-08-17T17:53:15.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.449+0000 7f804b533700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8044154140 0x7f80440c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.449+0000 7f804b533700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8044154520 con 0x7f80440c1010 2023-08-17T17:53:15.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.449+0000 7f804b533700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80440c91e0 con 0x7f80440a7c40 2023-08-17T17:53:15.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.449+0000 7f804b533700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80440c94c0 con 0x7f8044154140 2023-08-17T17:53:15.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.449+0000 7f80492cf700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8044154140 0x7f80440c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.449+0000 7f8049ad0700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f80440c1010 0x7f80440ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56772/0 (socket says 172.21.15.78:56772) 2023-08-17T17:53:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.449+0000 7f8049ad0700 1 -- 172.21.15.78:0/1407507776 learned_addr learned my addr 172.21.15.78:0/1407507776 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f80492cf700 1 -- 172.21.15.78:0/1407507776 >> v1:172.21.15.150:6789/0 conn(0x7f80440a7c40 legacy=0x7f80440c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f80492cf700 1 -- 172.21.15.78:0/1407507776 >> v1:172.21.15.78:6789/0 conn(0x7f80440c1010 legacy=0x7f80440ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f80492cf700 1 -- 172.21.15.78:0/1407507776 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80440c97a0 con 0x7f8044154140 2023-08-17T17:53:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f803bfff700 1 -- 172.21.15.78:0/1407507776 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259957207 0 0) 0x7f8044154520 con 0x7f80440c1010 2023-08-17T17:53:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f80492cf700 1 --2- 172.21.15.78:0/1407507776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 0x7f80440c6ee0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f8040009e60 tx=0x7f8040009780).ready entity=mon.0 client_cookie=d64ed369c8fbc6f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:15.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f803bfff700 1 -- 172.21.15.78:0/1407507776 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804000e070 con 0x7f8044154140 2023-08-17T17:53:15.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f803bfff700 1 -- 172.21.15.78:0/1407507776 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804000bbf0 con 0x7f8044154140 2023-08-17T17:53:15.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f803bfff700 1 -- 172.21.15.78:0/1407507776 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8040012410 con 0x7f8044154140 2023-08-17T17:53:15.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f804b533700 1 -- 172.21.15.78:0/1407507776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 msgr2=0x7f80440c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f804b533700 1 --2- 172.21.15.78:0/1407507776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 0x7f80440c6ee0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f8040009e60 tx=0x7f8040009780).stop 2023-08-17T17:53:15.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f804b533700 1 -- 172.21.15.78:0/1407507776 shutdown_connections 2023-08-17T17:53:15.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f804b533700 1 --2- 172.21.15.78:0/1407507776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 0x7f80440c6ee0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f804b533700 1 -- 172.21.15.78:0/1407507776 >> 172.21.15.78:0/1407507776 conn(0x7f8044094510 msgr2=0x7f804406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f804b533700 1 -- 172.21.15.78:0/1407507776 shutdown_connections 2023-08-17T17:53:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.450+0000 7f804b533700 1 -- 172.21.15.78:0/1407507776 wait complete. 2023-08-17T17:53:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.452+0000 7f804b533700 1 Processor -- start 2023-08-17T17:53:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.452+0000 7f804b533700 1 -- start start 2023-08-17T17:53:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.452+0000 7f804b533700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80440a7c40 0x7f80441407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.452+0000 7f804b533700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80440c1010 0x7f80440aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.452+0000 7f804b533700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 0x7f80440aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.452+0000 7f804b533700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440ab350 con 0x7f8044154140 2023-08-17T17:53:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f804b533700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440c2700 con 0x7f80440c1010 2023-08-17T17:53:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f804b533700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80440c3280 con 0x7f80440a7c40 2023-08-17T17:53:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8049ad0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 0x7f80440aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8049ad0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 0x7f80440aae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59072/0 (socket says 172.21.15.78:59072) 2023-08-17T17:53:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8049ad0700 1 -- 172.21.15.78:0/4290715590 learned_addr learned my addr 172.21.15.78:0/4290715590 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8048ace700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80440c1010 0x7f80440aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f80492cf700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80440a7c40 0x7f80441407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8049ad0700 1 -- 172.21.15.78:0/4290715590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80440a7c40 msgr2=0x7f80441407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8049ad0700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80440a7c40 0x7f80441407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8049ad0700 1 -- 172.21.15.78:0/4290715590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80440c1010 msgr2=0x7f80440aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8049ad0700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80440c1010 0x7f80440aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8049ad0700 1 -- 172.21.15.78:0/4290715590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8040009a20 con 0x7f8044154140 2023-08-17T17:53:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8048ace700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80440c1010 0x7f80440aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f8049ad0700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 0x7f80440aae60 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f803c00c4c0 tx=0x7f803c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f80397fa700 1 -- 172.21.15.78:0/4290715590 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00cea0 con 0x7f8044154140 2023-08-17T17:53:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f80397fa700 1 -- 172.21.15.78:0/4290715590 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c0072e0 con 0x7f8044154140 2023-08-17T17:53:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f804b533700 1 -- 172.21.15.78:0/4290715590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80440c2950 con 0x7f8044154140 2023-08-17T17:53:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f80397fa700 1 -- 172.21.15.78:0/4290715590 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c007660 con 0x7f8044154140 2023-08-17T17:53:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.453+0000 7f804b533700 1 -- 172.21.15.78:0/4290715590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80440c2f90 con 0x7f8044154140 2023-08-17T17:53:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.454+0000 7f804b533700 1 -- 172.21.15.78:0/4290715590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8044047350 con 0x7f8044154140 2023-08-17T17:53:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.454+0000 7f80397fa700 1 -- 172.21.15.78:0/4290715590 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f803c01a060 con 0x7f8044154140 2023-08-17T17:53:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.455+0000 7f80397fa700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f802805ed90 0x7f8028061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.455+0000 7f80397fa700 1 -- 172.21.15.78:0/4290715590 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f803c078ea0 con 0x7f8044154140 2023-08-17T17:53:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.455+0000 7f80492cf700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f802805ed90 0x7f8028061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.455+0000 7f80492cf700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f802805ed90 0x7f8028061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f804000b9b0 tx=0x7f8040009780).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:15.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.459+0000 7f80397fa700 1 -- 172.21.15.78:0/4290715590 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f803c04a790 con 0x7f8044154140 2023-08-17T17:53:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.684+0000 7f804b533700 1 -- 172.21.15.78:0/4290715590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f80440c33c0 con 0x7f8044154140 2023-08-17T17:53:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.684+0000 7f80397fa700 1 -- 172.21.15.78:0/4290715590 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f803c04ddb0 con 0x7f8044154140 2023-08-17T17:53:15.684 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:15.685 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:53:15.685 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-08-17T17:53:15.685 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.685 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-08-17T17:53:15.685 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA==", 2023-08-17T17:53:15.685 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.685 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:15.686 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:53:15.686 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:53:15.686 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.686 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.686 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.686 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.686 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-08-17T17:53:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g==", 2023-08-17T17:53:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:53:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:53:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-08-17T17:53:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw==", 2023-08-17T17:53:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:53:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:53:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.689 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.689 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.689 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.689 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-08-17T17:53:15.689 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg==", 2023-08-17T17:53:15.689 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.689 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:15.689 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:53:15.690 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:53:15.690 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.690 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.690 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.690 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.690 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-08-17T17:53:15.690 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg==", 2023-08-17T17:53:15.691 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.691 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:15.691 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:15.691 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.691 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.691 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.691 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.691 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-08-17T17:53:15.692 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw==", 2023-08-17T17:53:15.692 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.692 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:15.692 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:15.692 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.692 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.692 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.692 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.693 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-08-17T17:53:15.693 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA==", 2023-08-17T17:53:15.693 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.693 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:15.693 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:15.693 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.693 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.694 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.694 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.694 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-08-17T17:53:15.694 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ==", 2023-08-17T17:53:15.694 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.694 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:15.694 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:15.694 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.695 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.695 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.695 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.695 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-08-17T17:53:15.695 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA==", 2023-08-17T17:53:15.695 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.695 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:15.695 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:15.696 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.696 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.696 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.696 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.696 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-08-17T17:53:15.696 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q==", 2023-08-17T17:53:15.696 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.696 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:15.697 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:15.697 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.697 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.697 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.697 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.697 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-08-17T17:53:15.697 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw==", 2023-08-17T17:53:15.697 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.698 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:15.698 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:15.698 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.698 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.698 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.698 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.698 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-08-17T17:53:15.699 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg==", 2023-08-17T17:53:15.699 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.699 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:15.699 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:15.699 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.699 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.699 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.699 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.700 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-08-17T17:53:15.700 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA==", 2023-08-17T17:53:15.700 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.700 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:15.700 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-08-17T17:53:15.700 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T17:53:15.700 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.701 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.701 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.701 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-08-17T17:53:15.701 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ==", 2023-08-17T17:53:15.701 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.701 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:15.701 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:53:15.701 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:53:15.702 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:53:15.702 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.702 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.702 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.702 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-08-17T17:53:15.702 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ==", 2023-08-17T17:53:15.702 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.702 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:15.703 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:53:15.703 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:53:15.703 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:53:15.703 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.703 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.703 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.703 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-08-17T17:53:15.703 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw==", 2023-08-17T17:53:15.704 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.704 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:15.704 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:53:15.704 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:53:15.704 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:53:15.704 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.704 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-08-17T17:53:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k6n2yGhAAldYlBQaNGCgXL0HA2ePHVg==", 2023-08-17T17:53:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:53:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:53:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:53:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.706 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.706 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.706 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.706 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-08-17T17:53:15.706 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg==", 2023-08-17T17:53:15.706 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.706 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:53:15.706 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:53:15.707 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.707 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.707 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:15.707 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:15.707 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-08-17T17:53:15.707 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA==", 2023-08-17T17:53:15.707 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:15.707 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:53:15.708 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:53:15.708 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:15.708 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.708 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:15.708 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-08-17T17:53:15.708 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:53:15.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 -- 172.21.15.78:0/4290715590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f802805ed90 msgr2=0x7f8028061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f802805ed90 0x7f8028061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f804000b9b0 tx=0x7f8040009780).stop 2023-08-17T17:53:15.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 -- 172.21.15.78:0/4290715590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 msgr2=0x7f80440aae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 0x7f80440aae60 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f803c00c4c0 tx=0x7f803c007c10).stop 2023-08-17T17:53:15.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 -- 172.21.15.78:0/4290715590 shutdown_connections 2023-08-17T17:53:15.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f802805ed90 0x7f8028061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8044154140 0x7f80440aae60 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80440a7c40 0x7f80441407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 --2- 172.21.15.78:0/4290715590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80440c1010 0x7f80440aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 -- 172.21.15.78:0/4290715590 >> 172.21.15.78:0/4290715590 conn(0x7f8044094510 msgr2=0x7f80440c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:15.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 -- 172.21.15.78:0/4290715590 shutdown_connections 2023-08-17T17:53:15.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.686+0000 7f804b533700 1 -- 172.21.15.78:0/4290715590 wait complete. 2023-08-17T17:53:15.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.824+0000 7fd8ee70c700 1 Processor -- start 2023-08-17T17:53:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.824+0000 7fd8ee70c700 1 -- start start 2023-08-17T17:53:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ee70c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8e80a7bd0 0x7fd8e8063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ee70c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8e80a8050 0x7fd8e80642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ee70c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e8063960 con 0x7fd8e80c01b0 2023-08-17T17:53:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ee70c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e8063030 con 0x7fd8e80a7bd0 2023-08-17T17:53:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ee70c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e8063310 con 0x7fd8e80a8050 2023-08-17T17:53:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ecf09700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8e80a7bd0 0x7fd8e8063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ed70a700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd8e80c01b0 0x7fd8e80c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56776/0 (socket says 172.21.15.78:56776) 2023-08-17T17:53:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ed70a700 1 -- 172.21.15.78:0/516301453 learned_addr learned my addr 172.21.15.78:0/516301453 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8edf0b700 1 --2- 172.21.15.78:0/516301453 >> v2:172.21.15.150:3300/0 conn(0x7fd8e80a8050 0x7fd8e80642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ecf09700 1 -- 172.21.15.78:0/516301453 >> v2:172.21.15.150:3300/0 conn(0x7fd8e80a8050 msgr2=0x7fd8e80642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:15.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ecf09700 1 --2- 172.21.15.78:0/516301453 >> v2:172.21.15.150:3300/0 conn(0x7fd8e80a8050 0x7fd8e80642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ecf09700 1 -- 172.21.15.78:0/516301453 >> v1:172.21.15.78:6789/0 conn(0x7fd8e80c01b0 legacy=0x7fd8e80c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8dffff700 1 -- 172.21.15.78:0/516301453 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911229260 0 0) 0x7fd8e8063960 con 0x7fd8e80c01b0 2023-08-17T17:53:15.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ecf09700 1 -- 172.21.15.78:0/516301453 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80635f0 con 0x7fd8e80a7bd0 2023-08-17T17:53:15.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.825+0000 7fd8ecf09700 1 --2- 172.21.15.78:0/516301453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a7bd0 0x7fd8e8063df0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7fd8e80cb970 tx=0x7fd8d8009060).ready entity=mon.0 client_cookie=6fce2a155122e5a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:15.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8dffff700 1 -- 172.21.15.78:0/516301453 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800b580 con 0x7fd8e80a7bd0 2023-08-17T17:53:15.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8dffff700 1 -- 172.21.15.78:0/516301453 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d800b6e0 con 0x7fd8e80a7bd0 2023-08-17T17:53:15.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8dffff700 1 -- 172.21.15.78:0/516301453 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800ba60 con 0x7fd8e80a7bd0 2023-08-17T17:53:15.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8ee70c700 1 -- 172.21.15.78:0/516301453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a7bd0 msgr2=0x7fd8e8063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8ee70c700 1 --2- 172.21.15.78:0/516301453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a7bd0 0x7fd8e8063df0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7fd8e80cb970 tx=0x7fd8d8009060).stop 2023-08-17T17:53:15.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8ee70c700 1 -- 172.21.15.78:0/516301453 shutdown_connections 2023-08-17T17:53:15.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8ee70c700 1 --2- 172.21.15.78:0/516301453 >> v2:172.21.15.150:3300/0 conn(0x7fd8e80a8050 0x7fd8e80642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8ee70c700 1 --2- 172.21.15.78:0/516301453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a7bd0 0x7fd8e8063df0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8ee70c700 1 -- 172.21.15.78:0/516301453 >> 172.21.15.78:0/516301453 conn(0x7fd8e806a6c0 msgr2=0x7fd8e80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:15.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8ee70c700 1 -- 172.21.15.78:0/516301453 shutdown_connections 2023-08-17T17:53:15.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.826+0000 7fd8ee70c700 1 -- 172.21.15.78:0/516301453 wait complete. 2023-08-17T17:53:15.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.827+0000 7fd8ee70c700 1 Processor -- start 2023-08-17T17:53:15.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.827+0000 7fd8ee70c700 1 -- start start 2023-08-17T17:53:15.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8ee70c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80a7bd0 0x7fd8e80ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8ee70c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a8050 0x7fd8e80ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8ee70c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80c01b0 0x7fd8e80ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8ee70c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e8146160 con 0x7fd8e80a8050 2023-08-17T17:53:15.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8ee70c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80c2ff0 con 0x7fd8e80c01b0 2023-08-17T17:53:15.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8ee70c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80ad1f0 con 0x7fd8e80a7bd0 2023-08-17T17:53:15.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8ecf09700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a8050 0x7fd8e80ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8ecf09700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a8050 0x7fd8e80ade90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59086/0 (socket says 172.21.15.78:59086) 2023-08-17T17:53:15.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8ecf09700 1 -- 172.21.15.78:0/1024377270 learned_addr learned my addr 172.21.15.78:0/1024377270 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:15.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8edf0b700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80c01b0 0x7fd8e80ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.828+0000 7fd8ed70a700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80a7bd0 0x7fd8e80ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8ecf09700 1 -- 172.21.15.78:0/1024377270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80a7bd0 msgr2=0x7fd8e80ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8ecf09700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80a7bd0 0x7fd8e80ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8ecf09700 1 -- 172.21.15.78:0/1024377270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80c01b0 msgr2=0x7fd8e80ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8ecf09700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80c01b0 0x7fd8e80ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8ecf09700 1 -- 172.21.15.78:0/1024377270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80092a0 con 0x7fd8e80a8050 2023-08-17T17:53:15.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8edf0b700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80c01b0 0x7fd8e80ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:15.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8ecf09700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a8050 0x7fd8e80ade90 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fd8e805f170 tx=0x7fd8d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:15.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8dd7fa700 1 -- 172.21.15.78:0/1024377270 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800b850 con 0x7fd8e80a8050 2023-08-17T17:53:15.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8dd7fa700 1 -- 172.21.15.78:0/1024377270 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d800b9b0 con 0x7fd8e80a8050 2023-08-17T17:53:15.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8ee70c700 1 -- 172.21.15.78:0/1024377270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e80acc30 con 0x7fd8e80a8050 2023-08-17T17:53:15.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8dd7fa700 1 -- 172.21.15.78:0/1024377270 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d801b660 con 0x7fd8e80a8050 2023-08-17T17:53:15.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.829+0000 7fd8ee70c700 1 -- 172.21.15.78:0/1024377270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e80c2c80 con 0x7fd8e80a8050 2023-08-17T17:53:15.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.830+0000 7fd8ee70c700 1 -- 172.21.15.78:0/1024377270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e80c31a0 con 0x7fd8e80a8050 2023-08-17T17:53:15.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.830+0000 7fd8dd7fa700 1 -- 172.21.15.78:0/1024377270 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd8d802b070 con 0x7fd8e80a8050 2023-08-17T17:53:15.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.831+0000 7fd8dd7fa700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8cc05ed60 0x7fd8cc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:15.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.831+0000 7fd8dd7fa700 1 -- 172.21.15.78:0/1024377270 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd8d807b190 con 0x7fd8e80a8050 2023-08-17T17:53:15.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.831+0000 7fd8ed70a700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8cc05ed60 0x7fd8cc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:15.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.831+0000 7fd8ed70a700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8cc05ed60 0x7fd8cc061220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd8e0007fd0 tx=0x7fd8e0009040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:15.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.835+0000 7fd8dd7fa700 1 -- 172.21.15.78:0/1024377270 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd8e80c31a0 con 0x7fd8e80a8050 2023-08-17T17:53:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.995+0000 7fd8ee70c700 1 -- 172.21.15.78:0/1024377270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8e80c31a0 con 0x7fd8e80a8050 2023-08-17T17:53:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.996+0000 7fd8dd7fa700 1 -- 172.21.15.78:0/1024377270 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+13771 (secure 0 0 0) 0x7fd8e80c31a0 con 0x7fd8e80a8050 2023-08-17T17:53:15.996 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:15.996 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":131,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:15.318483+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.997+0000 7fd8ee70c700 1 -- 172.21.15.78:0/1024377270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8cc05ed60 msgr2=0x7fd8cc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.997+0000 7fd8ee70c700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8cc05ed60 0x7fd8cc061220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd8e0007fd0 tx=0x7fd8e0009040).stop 2023-08-17T17:53:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.997+0000 7fd8ee70c700 1 -- 172.21.15.78:0/1024377270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a8050 msgr2=0x7fd8e80ade90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.997+0000 7fd8ee70c700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a8050 0x7fd8e80ade90 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fd8e805f170 tx=0x7fd8d8017000).stop 2023-08-17T17:53:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.998+0000 7fd8ee70c700 1 -- 172.21.15.78:0/1024377270 shutdown_connections 2023-08-17T17:53:15.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.998+0000 7fd8ee70c700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd8cc05ed60 0x7fd8cc061220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.998+0000 7fd8ee70c700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80c01b0 0x7fd8e80ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.998+0000 7fd8ee70c700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80a7bd0 0x7fd8e80ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.998+0000 7fd8ee70c700 1 --2- 172.21.15.78:0/1024377270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80a8050 0x7fd8e80ade90 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:15.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.998+0000 7fd8ee70c700 1 -- 172.21.15.78:0/1024377270 >> 172.21.15.78:0/1024377270 conn(0x7fd8e806a6c0 msgr2=0x7fd8e80c5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:15.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.998+0000 7fd8ee70c700 1 -- 172.21.15.78:0/1024377270 shutdown_connections 2023-08-17T17:53:15.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:15.998+0000 7fd8ee70c700 1 -- 172.21.15.78:0/1024377270 wait complete. 2023-08-17T17:53:16.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T17:53:16.010 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:53:16.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.125+0000 7f83a81f9700 1 Processor -- start 2023-08-17T17:53:16.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.125+0000 7f83a81f9700 1 -- start start 2023-08-17T17:53:16.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a81f9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f83a00aa0f0 0x7f83a00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a81f9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83a00aa4d0 0x7f83a00c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a81f9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a00649b0 con 0x7f83a00c5810 2023-08-17T17:53:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a81f9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a0063420 con 0x7f83a00aa4d0 2023-08-17T17:53:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a81f9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a0063700 con 0x7f83a00aa0f0 2023-08-17T17:53:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a5794700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83a00aa4d0 0x7f83a00c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a6796700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f83a00c5810 0x7f83a00a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56784/0 (socket says 172.21.15.78:56784) 2023-08-17T17:53:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a6796700 1 -- 172.21.15.78:0/4074779163 learned_addr learned my addr 172.21.15.78:0/4074779163 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a5f95700 1 --2- 172.21.15.78:0/4074779163 >> v2:172.21.15.150:3300/0 conn(0x7f83a00aa0f0 0x7f83a00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a5794700 1 -- 172.21.15.78:0/4074779163 >> v2:172.21.15.150:3300/0 conn(0x7f83a00aa0f0 msgr2=0x7f83a00644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:16.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a5794700 1 --2- 172.21.15.78:0/4074779163 >> v2:172.21.15.150:3300/0 conn(0x7f83a00aa0f0 0x7f83a00644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.126+0000 7f83a5794700 1 -- 172.21.15.78:0/4074779163 >> v1:172.21.15.78:6789/0 conn(0x7f83a00c5810 legacy=0x7f83a00a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a5794700 1 -- 172.21.15.78:0/4074779163 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a00639e0 con 0x7f83a00aa4d0 2023-08-17T17:53:16.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a5794700 1 --2- 172.21.15.78:0/4074779163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 0x7f83a00c0e10 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f83a00cade0 tx=0x7f8390009060).ready entity=mon.0 client_cookie=7ffa19eaf9908a72 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:16.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a4f93700 1 -- 172.21.15.78:0/4074779163 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000f510 con 0x7f83a00aa4d0 2023-08-17T17:53:16.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a4f93700 1 -- 172.21.15.78:0/4074779163 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839000f670 con 0x7f83a00aa4d0 2023-08-17T17:53:16.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a4f93700 1 -- 172.21.15.78:0/4074779163 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000f9f0 con 0x7f83a00aa4d0 2023-08-17T17:53:16.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a81f9700 1 -- 172.21.15.78:0/4074779163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 msgr2=0x7f83a00c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a81f9700 1 --2- 172.21.15.78:0/4074779163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 0x7f83a00c0e10 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f83a00cade0 tx=0x7f8390009060).stop 2023-08-17T17:53:16.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a81f9700 1 -- 172.21.15.78:0/4074779163 shutdown_connections 2023-08-17T17:53:16.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a81f9700 1 --2- 172.21.15.78:0/4074779163 >> v2:172.21.15.150:3300/0 conn(0x7f83a00aa0f0 0x7f83a00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a81f9700 1 --2- 172.21.15.78:0/4074779163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 0x7f83a00c0e10 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a81f9700 1 -- 172.21.15.78:0/4074779163 >> 172.21.15.78:0/4074779163 conn(0x7f83a006a6a0 msgr2=0x7f83a00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:16.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a81f9700 1 -- 172.21.15.78:0/4074779163 shutdown_connections 2023-08-17T17:53:16.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.127+0000 7f83a81f9700 1 -- 172.21.15.78:0/4074779163 wait complete. 2023-08-17T17:53:16.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.128+0000 7f83a81f9700 1 Processor -- start 2023-08-17T17:53:16.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.128+0000 7f83a81f9700 1 -- start start 2023-08-17T17:53:16.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.129+0000 7f83a81f9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83a00aa0f0 0x7f83a0156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.129+0000 7f83a81f9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 0x7f83a00aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.129+0000 7f83a81f9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83a00c5810 0x7f83a0154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.129+0000 7f83a81f9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00c3960 con 0x7f83a00aa4d0 2023-08-17T17:53:16.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.129+0000 7f83a81f9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00aaea0 con 0x7f83a00aa0f0 2023-08-17T17:53:16.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.129+0000 7f83a81f9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a01552c0 con 0x7f83a00c5810 2023-08-17T17:53:16.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.129+0000 7f83a5794700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 0x7f83a00aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.129+0000 7f83a5794700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 0x7f83a00aa9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59106/0 (socket says 172.21.15.78:59106) 2023-08-17T17:53:16.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.129+0000 7f83a5794700 1 -- 172.21.15.78:0/44161440 learned_addr learned my addr 172.21.15.78:0/44161440 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:16.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.129+0000 7f83a5f95700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83a00aa0f0 0x7f83a0156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a6796700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83a00c5810 0x7f83a0154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a5794700 1 -- 172.21.15.78:0/44161440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83a00c5810 msgr2=0x7f83a0154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a5794700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83a00c5810 0x7f83a0154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a5794700 1 -- 172.21.15.78:0/44161440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83a00aa0f0 msgr2=0x7f83a0156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a5794700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83a00aa0f0 0x7f83a0156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a5794700 1 -- 172.21.15.78:0/44161440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83900092a0 con 0x7f83a00aa4d0 2023-08-17T17:53:16.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a5f95700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83a00aa0f0 0x7f83a0156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:16.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a6796700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83a00c5810 0x7f83a0154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:16.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a5794700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 0x7f83a00aa9b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f83a005e180 tx=0x7f8390017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:16.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f8395ffb700 1 -- 172.21.15.78:0/44161440 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000f9f0 con 0x7f83a00aa4d0 2023-08-17T17:53:16.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f8395ffb700 1 -- 172.21.15.78:0/44161440 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8390000c90 con 0x7f83a00aa4d0 2023-08-17T17:53:16.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a81f9700 1 -- 172.21.15.78:0/44161440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a01555a0 con 0x7f83a00aa4d0 2023-08-17T17:53:16.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f8395ffb700 1 -- 172.21.15.78:0/44161440 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839001b660 con 0x7f83a00aa4d0 2023-08-17T17:53:16.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.130+0000 7f83a81f9700 1 -- 172.21.15.78:0/44161440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a0154fd0 con 0x7f83a00aa4d0 2023-08-17T17:53:16.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.131+0000 7f83a81f9700 1 -- 172.21.15.78:0/44161440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a0083980 con 0x7f83a00aa4d0 2023-08-17T17:53:16.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.131+0000 7f8395ffb700 1 -- 172.21.15.78:0/44161440 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f839000f070 con 0x7f83a00aa4d0 2023-08-17T17:53:16.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.132+0000 7f8395ffb700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f838405ed90 0x7f8384061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.132+0000 7f8395ffb700 1 -- 172.21.15.78:0/44161440 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f839007b1a0 con 0x7f83a00aa4d0 2023-08-17T17:53:16.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.132+0000 7f83a5f95700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f838405ed90 0x7f8384061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.132+0000 7f83a5f95700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f838405ed90 0x7f8384061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f839c007780 tx=0x7f839c00b040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:16.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.136+0000 7f8395ffb700 1 -- 172.21.15.78:0/44161440 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f839004ca90 con 0x7f83a00aa4d0 2023-08-17T17:53:16.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.299+0000 7f83a81f9700 1 -- 172.21.15.78:0/44161440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f83a00629b0 con 0x7f83a00aa4d0 2023-08-17T17:53:16.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.299+0000 7f8395ffb700 1 -- 172.21.15.78:0/44161440 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v131) v1 ==== 110+0+10 (secure 0 0 0) 0x7f83900500b0 con 0x7f83a00aa4d0 2023-08-17T17:53:16.299 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:53:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 -- 172.21.15.78:0/44161440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f838405ed90 msgr2=0x7f8384061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f838405ed90 0x7f8384061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f839c007780 tx=0x7f839c00b040).stop 2023-08-17T17:53:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 -- 172.21.15.78:0/44161440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 msgr2=0x7f83a00aa9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 0x7f83a00aa9b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f83a005e180 tx=0x7f8390017000).stop 2023-08-17T17:53:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 -- 172.21.15.78:0/44161440 shutdown_connections 2023-08-17T17:53:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f838405ed90 0x7f8384061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83a00c5810 0x7f83a0154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83a00aa0f0 0x7f83a0156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 --2- 172.21.15.78:0/44161440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a00aa4d0 0x7f83a00aa9b0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 -- 172.21.15.78:0/44161440 >> 172.21.15.78:0/44161440 conn(0x7f83a006a6a0 msgr2=0x7f83a00a8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 -- 172.21.15.78:0/44161440 shutdown_connections 2023-08-17T17:53:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.301+0000 7f83a81f9700 1 -- 172.21.15.78:0/44161440 wait complete. 2023-08-17T17:53:16.313 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:53:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.429+0000 7fa2fd390700 1 Processor -- start 2023-08-17T17:53:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.429+0000 7fa2fd390700 1 -- start start 2023-08-17T17:53:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.430+0000 7fa2fd390700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f80aa0f0 0x7fa2f80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.430+0000 7fa2fd390700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2f80c5810 0x7fa2f80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.430+0000 7fa2fd390700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f80649b0 con 0x7fa2f80aa4d0 2023-08-17T17:53:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.430+0000 7fa2fd390700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f80c6170 con 0x7fa2f80c5810 2023-08-17T17:53:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.430+0000 7fa2fd390700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f8063420 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.430+0000 7fa2f77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2f80c5810 0x7fa2f80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.430+0000 7fa2ee7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa2f80aa4d0 0x7fa2f80c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56794/0 (socket says 172.21.15.78:56794) 2023-08-17T17:53:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.430+0000 7fa2ee7fc700 1 -- 172.21.15.78:0/3746768998 learned_addr learned my addr 172.21.15.78:0/3746768998 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.430+0000 7fa2f6ffd700 1 --2- 172.21.15.78:0/3746768998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f80aa0f0 0x7fa2f80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2f77fe700 1 -- 172.21.15.78:0/3746768998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f80aa0f0 msgr2=0x7fa2f80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2f77fe700 1 --2- 172.21.15.78:0/3746768998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f80aa0f0 0x7fa2f80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2f77fe700 1 -- 172.21.15.78:0/3746768998 >> v1:172.21.15.78:6789/0 conn(0x7fa2f80aa4d0 legacy=0x7fa2f80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2f67fc700 1 -- 172.21.15.78:0/3746768998 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532936675 0 0) 0x7fa2f80649b0 con 0x7fa2f80aa4d0 2023-08-17T17:53:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2f77fe700 1 -- 172.21.15.78:0/3746768998 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f8063700 con 0x7fa2f80c5810 2023-08-17T17:53:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2f77fe700 1 --2- 172.21.15.78:0/3746768998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80c5810 0x7fa2f80c5c80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fa2f0009e60 tx=0x7fa2f0009780).ready entity=mon.0 client_cookie=38a25740f194392e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2f67fc700 1 -- 172.21.15.78:0/3746768998 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000e070 con 0x7fa2f80c5810 2023-08-17T17:53:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2f67fc700 1 -- 172.21.15.78:0/3746768998 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000bc30 con 0x7fa2f80c5810 2023-08-17T17:53:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2f67fc700 1 -- 172.21.15.78:0/3746768998 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0012410 con 0x7fa2f80c5810 2023-08-17T17:53:16.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2fd390700 1 -- 172.21.15.78:0/3746768998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80c5810 msgr2=0x7fa2f80c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2fd390700 1 --2- 172.21.15.78:0/3746768998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80c5810 0x7fa2f80c5c80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fa2f0009e60 tx=0x7fa2f0009780).stop 2023-08-17T17:53:16.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2fd390700 1 -- 172.21.15.78:0/3746768998 shutdown_connections 2023-08-17T17:53:16.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2fd390700 1 --2- 172.21.15.78:0/3746768998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80c5810 0x7fa2f80c5c80 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2fd390700 1 --2- 172.21.15.78:0/3746768998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f80aa0f0 0x7fa2f80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2fd390700 1 -- 172.21.15.78:0/3746768998 >> 172.21.15.78:0/3746768998 conn(0x7fa2f806a6a0 msgr2=0x7fa2f80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:16.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2fd390700 1 -- 172.21.15.78:0/3746768998 shutdown_connections 2023-08-17T17:53:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.431+0000 7fa2fd390700 1 -- 172.21.15.78:0/3746768998 wait complete. 2023-08-17T17:53:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.433+0000 7fa2fd390700 1 Processor -- start 2023-08-17T17:53:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.433+0000 7fa2fd390700 1 -- start start 2023-08-17T17:53:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.433+0000 7fa2fd390700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80aa0f0 0x7fa2f8145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.433+0000 7fa2fd390700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f80aa4d0 0x7fa2f80abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.433+0000 7fa2fd390700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f80c5810 0x7fa2f80affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.433+0000 7fa2fd390700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80ad860 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.433+0000 7fa2fd390700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80ad3d0 con 0x7fa2f80aa4d0 2023-08-17T17:53:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.433+0000 7fa2fd390700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80c4bc0 con 0x7fa2f80c5810 2023-08-17T17:53:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2f6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80aa0f0 0x7fa2f8145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2f6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80aa0f0 0x7fa2f8145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59116/0 (socket says 172.21.15.78:59116) 2023-08-17T17:53:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2f6ffd700 1 -- 172.21.15.78:0/3939487136 learned_addr learned my addr 172.21.15.78:0/3939487136 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2f6ffd700 1 -- 172.21.15.78:0/3939487136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f80c5810 msgr2=0x7fa2f80affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2f6ffd700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f80c5810 0x7fa2f80affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2f6ffd700 1 -- 172.21.15.78:0/3939487136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f80aa4d0 msgr2=0x7fa2f80abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2ee7fc700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f80aa4d0 0x7fa2f80abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2f6ffd700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f80aa4d0 0x7fa2f80abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2f6ffd700 1 -- 172.21.15.78:0/3939487136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0009a20 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2ee7fc700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f80aa4d0 0x7fa2f80abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2f6ffd700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80aa0f0 0x7fa2f8145a90 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fa2e800d8c0 tx=0x7fa2e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/3939487136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e80095b0 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/3939487136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e8009710 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2fd390700 1 -- 172.21.15.78:0/3939487136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f80ac7c0 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/3939487136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8009a90 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.434+0000 7fa2fd390700 1 -- 172.21.15.78:0/3939487136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f80acd80 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.435+0000 7fa2fd390700 1 -- 172.21.15.78:0/3939487136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f8083980 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.435+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/3939487136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa2e8013480 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.436+0000 7fa2ef7fe700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa2d805ed90 0x7fa2d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.436+0000 7fa2ee7fc700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa2d805ed90 0x7fa2d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.436+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/3939487136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa2e8079630 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.436+0000 7fa2ee7fc700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa2d805ed90 0x7fa2d8061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa2f8159030 tx=0x7fa2e0009040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:16.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.440+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/3939487136 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa2e804aec0 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.602+0000 7fa2fd390700 1 -- 172.21.15.78:0/3939487136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa2f8046af0 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.602+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/3939487136 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v131) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa2f8046af0 con 0x7fa2f80aa0f0 2023-08-17T17:53:16.603 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:53:16.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.604+0000 7fa2fd390700 1 -- 172.21.15.78:0/3939487136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa2d805ed90 msgr2=0x7fa2d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.604+0000 7fa2fd390700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa2d805ed90 0x7fa2d8061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa2f8159030 tx=0x7fa2e0009040).stop 2023-08-17T17:53:16.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.604+0000 7fa2fd390700 1 -- 172.21.15.78:0/3939487136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80aa0f0 msgr2=0x7fa2f8145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.604+0000 7fa2fd390700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80aa0f0 0x7fa2f8145a90 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fa2e800d8c0 tx=0x7fa2e8008040).stop 2023-08-17T17:53:16.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.604+0000 7fa2fd390700 1 -- 172.21.15.78:0/3939487136 shutdown_connections 2023-08-17T17:53:16.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.604+0000 7fa2fd390700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa2d805ed90 0x7fa2d8061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.604+0000 7fa2fd390700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f80c5810 0x7fa2f80affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:16.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.604+0000 7fa2fd390700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f80aa0f0 0x7fa2f8145a90 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.604+0000 7fa2fd390700 1 --2- 172.21.15.78:0/3939487136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f80aa4d0 0x7fa2f80abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.604+0000 7fa2fd390700 1 -- 172.21.15.78:0/3939487136 >> 172.21.15.78:0/3939487136 conn(0x7fa2f806a6a0 msgr2=0x7fa2f80ca660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:16.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.605+0000 7fa2fd390700 1 -- 172.21.15.78:0/3939487136 shutdown_connections 2023-08-17T17:53:16.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.605+0000 7fa2fd390700 1 -- 172.21.15.78:0/3939487136 wait complete. 2023-08-17T17:53:16.617 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T17:53:16.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.729+0000 7f2f78ca8700 1 Processor -- start 2023-08-17T17:53:16.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.729+0000 7f2f78ca8700 1 -- start start 2023-08-17T17:53:16.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.730+0000 7f2f78ca8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 0x7f2f74157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.730+0000 7f2f78ca8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2f74139fd0 0x7f2f7413a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.730+0000 7f2f78ca8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f740bc900 con 0x7f2f74157be0 2023-08-17T17:53:16.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.730+0000 7f2f78ca8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7413a920 con 0x7f2f74139fd0 2023-08-17T17:53:16.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.730+0000 7f2f78ca8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740c55a0 con 0x7f2f740c7430 2023-08-17T17:53:16.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.730+0000 7f2f73fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2f74139fd0 0x7f2f7413a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.730+0000 7f2f72ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 0x7f2f74157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.730+0000 7f2f73fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2f74139fd0 0x7f2f7413a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:54284/0 (socket says 172.21.15.78:54284) 2023-08-17T17:53:16.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.730+0000 7f2f73fff700 1 -- 172.21.15.78:0/1980349374 learned_addr learned my addr 172.21.15.78:0/1980349374 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:16.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.730+0000 7f2f737fe700 1 --1- 172.21.15.78:0/1980349374 >> v1:172.21.15.150:6789/0 conn(0x7f2f74157be0 0x7f2f740699e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:48886/0 (socket says 172.21.15.78:48886) 2023-08-17T17:53:16.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f73fff700 1 -- 172.21.15.78:0/1980349374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 msgr2=0x7f2f74157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:16.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f73fff700 1 --2- 172.21.15.78:0/1980349374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 0x7f2f74157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f73fff700 1 -- 172.21.15.78:0/1980349374 >> v1:172.21.15.150:6789/0 conn(0x7f2f74157be0 legacy=0x7f2f740699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f727fc700 1 -- 172.21.15.78:0/1980349374 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701613353 0 0) 0x7f2f740bc900 con 0x7f2f74157be0 2023-08-17T17:53:16.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f73fff700 1 -- 172.21.15.78:0/1980349374 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f740c5880 con 0x7f2f74139fd0 2023-08-17T17:53:16.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f72ffd700 1 --2- 172.21.15.78:0/1980349374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 0x7f2f74157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:16.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f73fff700 1 --2- 172.21.15.78:0/1980349374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74139fd0 0x7f2f7413a430 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f2f6c006fd0 tx=0x7f2f6c0090f0).ready entity=mon.1 client_cookie=b3a24f76fb97a2d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:16.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f727fc700 1 -- 172.21.15.78:0/1980349374 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00b580 con 0x7f2f74139fd0 2023-08-17T17:53:16.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f727fc700 1 -- 172.21.15.78:0/1980349374 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c00b6e0 con 0x7f2f74139fd0 2023-08-17T17:53:16.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f727fc700 1 -- 172.21.15.78:0/1980349374 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00ba60 con 0x7f2f74139fd0 2023-08-17T17:53:16.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1980349374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74139fd0 msgr2=0x7f2f7413a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f78ca8700 1 --2- 172.21.15.78:0/1980349374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74139fd0 0x7f2f7413a430 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f2f6c006fd0 tx=0x7f2f6c0090f0).stop 2023-08-17T17:53:16.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1980349374 shutdown_connections 2023-08-17T17:53:16.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f78ca8700 1 --2- 172.21.15.78:0/1980349374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74139fd0 0x7f2f7413a430 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f78ca8700 1 --2- 172.21.15.78:0/1980349374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 0x7f2f74157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1980349374 >> 172.21.15.78:0/1980349374 conn(0x7f2f740c4440 msgr2=0x7f2f740c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:16.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1980349374 shutdown_connections 2023-08-17T17:53:16.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.731+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1980349374 wait complete. 2023-08-17T17:53:16.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.733+0000 7f2f78ca8700 1 Processor -- start 2023-08-17T17:53:16.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.733+0000 7f2f78ca8700 1 -- start start 2023-08-17T17:53:16.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.733+0000 7f2f78ca8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 0x7f2f74153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.733+0000 7f2f78ca8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74139fd0 0x7f2f740a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.733+0000 7f2f78ca8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f74157be0 0x7f2f74136570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.733+0000 7f2f78ca8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f74165010 con 0x7f2f74157be0 2023-08-17T17:53:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.733+0000 7f2f78ca8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f74164400 con 0x7f2f74139fd0 2023-08-17T17:53:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.733+0000 7f2f78ca8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f741646e0 con 0x7f2f740c7430 2023-08-17T17:53:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f73fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f74157be0 0x7f2f74136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f73fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f74157be0 0x7f2f74136570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59122/0 (socket says 172.21.15.78:59122) 2023-08-17T17:53:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f73fff700 1 -- 172.21.15.78:0/1717947601 learned_addr learned my addr 172.21.15.78:0/1717947601 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f737fe700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 0x7f2f74153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f72ffd700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74139fd0 0x7f2f740a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f73fff700 1 -- 172.21.15.78:0/1717947601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 msgr2=0x7f2f74153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f73fff700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 0x7f2f74153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f73fff700 1 -- 172.21.15.78:0/1717947601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74139fd0 msgr2=0x7f2f740a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f73fff700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74139fd0 0x7f2f740a5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f73fff700 1 -- 172.21.15.78:0/1717947601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680092a0 con 0x7f2f74157be0 2023-08-17T17:53:16.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f72ffd700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74139fd0 0x7f2f740a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:16.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f73fff700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f74157be0 0x7f2f74136570 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f2f6c009130 tx=0x7f2f6c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:16.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f5b7fe700 1 -- 172.21.15.78:0/1717947601 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00b850 con 0x7f2f74157be0 2023-08-17T17:53:16.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f5b7fe700 1 -- 172.21.15.78:0/1717947601 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c00b9b0 con 0x7f2f74157be0 2023-08-17T17:53:16.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1717947601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c009370 con 0x7f2f74157be0 2023-08-17T17:53:16.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f5b7fe700 1 -- 172.21.15.78:0/1717947601 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c01c650 con 0x7f2f74157be0 2023-08-17T17:53:16.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.734+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1717947601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f74164ca0 con 0x7f2f74157be0 2023-08-17T17:53:16.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.735+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1717947601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f74165180 con 0x7f2f74157be0 2023-08-17T17:53:16.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.735+0000 7f2f5b7fe700 1 -- 172.21.15.78:0/1717947601 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2f6c02c070 con 0x7f2f74157be0 2023-08-17T17:53:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.736+0000 7f2f5b7fe700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f6005ed90 0x7f2f60061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.736+0000 7f2f5b7fe700 1 -- 172.21.15.78:0/1717947601 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2f6c07b660 con 0x7f2f74157be0 2023-08-17T17:53:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.736+0000 7f2f737fe700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f6005ed90 0x7f2f60061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.736+0000 7f2f737fe700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f6005ed90 0x7f2f60061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2f74137440 tx=0x7f2f64005ad0).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.740+0000 7f2f5b7fe700 1 -- 172.21.15.78:0/1717947601 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f6c04cf50 con 0x7f2f74157be0 2023-08-17T17:53:16.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.903+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1717947601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2f740c5b60 con 0x7f2f74157be0 2023-08-17T17:53:16.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.903+0000 7f2f5b7fe700 1 -- 172.21.15.78:0/1717947601 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v131) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2f6c02a070 con 0x7f2f74157be0 2023-08-17T17:53:16.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:16.904 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:53:16.904 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:16.904 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T17:53:16.905 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T17:53:16.905 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:16.905 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:16.905 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T17:53:16.905 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T17:53:16.905 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:16.905 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:53:16.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1717947601 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f6005ed90 msgr2=0x7f2f60061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f6005ed90 0x7f2f60061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2f74137440 tx=0x7f2f64005ad0).stop 2023-08-17T17:53:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1717947601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f74157be0 msgr2=0x7f2f74136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f74157be0 0x7f2f74136570 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f2f6c009130 tx=0x7f2f6c017000).stop 2023-08-17T17:53:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1717947601 shutdown_connections 2023-08-17T17:53:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f6005ed90 0x7f2f60061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f74157be0 0x7f2f74136570 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f740c7430 0x7f2f74153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 --2- 172.21.15.78:0/1717947601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74139fd0 0x7f2f740a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1717947601 >> 172.21.15.78:0/1717947601 conn(0x7f2f740c4440 msgr2=0x7f2f740bdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:16.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1717947601 shutdown_connections 2023-08-17T17:53:16.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:16.905+0000 7f2f78ca8700 1 -- 172.21.15.78:0/1717947601 wait complete. 2023-08-17T17:53:16.917 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T17:53:16.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T17:53:17.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.035+0000 7fef6febf700 1 Processor -- start 2023-08-17T17:53:17.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.035+0000 7fef6febf700 1 -- start start 2023-08-17T17:53:17.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6febf700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef680aa0f0 0x7fef680644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6febf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef680aa4d0 0x7fef680c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6febf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fef680c5810 0x7fef680c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6febf700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef680649b0 con 0x7fef680aa0f0 2023-08-17T17:53:17.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6febf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef680c6120 con 0x7fef680c5810 2023-08-17T17:53:17.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6febf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef68063420 con 0x7fef680aa4d0 2023-08-17T17:53:17.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6dc5b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef680aa0f0 0x7fef680644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6dc5b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef680aa0f0 0x7fef680644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59138/0 (socket says 172.21.15.78:59138) 2023-08-17T17:53:17.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6dc5b700 1 -- 172.21.15.78:0/2253317546 learned_addr learned my addr 172.21.15.78:0/2253317546 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:17.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6d45a700 1 --2- 172.21.15.78:0/2253317546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef680aa4d0 0x7fef680c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6e45c700 1 --2- 172.21.15.78:0/2253317546 >> v2:172.21.15.150:3300/0 conn(0x7fef680c5810 0x7fef680c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6dc5b700 1 -- 172.21.15.78:0/2253317546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef680aa4d0 msgr2=0x7fef680c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:17.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6dc5b700 1 --2- 172.21.15.78:0/2253317546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef680aa4d0 0x7fef680c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6dc5b700 1 -- 172.21.15.78:0/2253317546 >> v2:172.21.15.150:3300/0 conn(0x7fef680c5810 msgr2=0x7fef680c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:17.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6dc5b700 1 --2- 172.21.15.78:0/2253317546 >> v2:172.21.15.150:3300/0 conn(0x7fef680c5810 0x7fef680c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6dc5b700 1 -- 172.21.15.78:0/2253317546 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68063700 con 0x7fef680aa0f0 2023-08-17T17:53:17.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6dc5b700 1 --2- 172.21.15.78:0/2253317546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680aa0f0 0x7fef680644c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7fef68159060 tx=0x7fef60009840).ready entity=mon.0 client_cookie=d1fa2709b44c8d1e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:17.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.036+0000 7fef6cc59700 1 -- 172.21.15.78:0/2253317546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6000e070 con 0x7fef680aa0f0 2023-08-17T17:53:17.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6cc59700 1 -- 172.21.15.78:0/2253317546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6000ba50 con 0x7fef680aa0f0 2023-08-17T17:53:17.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6cc59700 1 -- 172.21.15.78:0/2253317546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6000bdd0 con 0x7fef680aa0f0 2023-08-17T17:53:17.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6febf700 1 -- 172.21.15.78:0/2253317546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680aa0f0 msgr2=0x7fef680644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:17.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6febf700 1 --2- 172.21.15.78:0/2253317546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680aa0f0 0x7fef680644c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7fef68159060 tx=0x7fef60009840).stop 2023-08-17T17:53:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6febf700 1 -- 172.21.15.78:0/2253317546 shutdown_connections 2023-08-17T17:53:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6febf700 1 --2- 172.21.15.78:0/2253317546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680aa0f0 0x7fef680644c0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6febf700 1 --2- 172.21.15.78:0/2253317546 >> v2:172.21.15.150:3300/0 conn(0x7fef680c5810 0x7fef680c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6febf700 1 --2- 172.21.15.78:0/2253317546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef680aa4d0 0x7fef680c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6febf700 1 -- 172.21.15.78:0/2253317546 >> 172.21.15.78:0/2253317546 conn(0x7fef6806a6a0 msgr2=0x7fef680caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6febf700 1 -- 172.21.15.78:0/2253317546 shutdown_connections 2023-08-17T17:53:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.037+0000 7fef6febf700 1 -- 172.21.15.78:0/2253317546 wait complete. 2023-08-17T17:53:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.038+0000 7fef6febf700 1 Processor -- start 2023-08-17T17:53:17.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.038+0000 7fef6febf700 1 -- start start 2023-08-17T17:53:17.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6febf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef680aa0f0 0x7fef681511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6febf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef680aa4d0 0x7fef681643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6febf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680c5810 0x7fef680c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6febf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef680c34c0 con 0x7fef680c5810 2023-08-17T17:53:17.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6febf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef680c31e0 con 0x7fef680aa0f0 2023-08-17T17:53:17.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6febf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef680ac1e0 con 0x7fef680aa4d0 2023-08-17T17:53:17.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6e45c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680c5810 0x7fef680c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6e45c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680c5810 0x7fef680c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59148/0 (socket says 172.21.15.78:59148) 2023-08-17T17:53:17.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6e45c700 1 -- 172.21.15.78:0/1807839709 learned_addr learned my addr 172.21.15.78:0/1807839709 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:17.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6dc5b700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef680aa0f0 0x7fef681511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6d45a700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef680aa4d0 0x7fef681643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6e45c700 1 -- 172.21.15.78:0/1807839709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef680aa4d0 msgr2=0x7fef681643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:17.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6e45c700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef680aa4d0 0x7fef681643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6e45c700 1 -- 172.21.15.78:0/1807839709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef680aa0f0 msgr2=0x7fef681511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:17.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6e45c700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef680aa0f0 0x7fef681511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6e45c700 1 -- 172.21.15.78:0/1807839709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60009ae0 con 0x7fef680c5810 2023-08-17T17:53:17.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.039+0000 7fef6e45c700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680c5810 0x7fef680c29b0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fef5800bfd0 tx=0x7fef58008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:17.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.040+0000 7fef65ffb700 1 -- 172.21.15.78:0/1807839709 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58011590 con 0x7fef680c5810 2023-08-17T17:53:17.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.040+0000 7fef65ffb700 1 -- 172.21.15.78:0/1807839709 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef580116f0 con 0x7fef680c5810 2023-08-17T17:53:17.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.040+0000 7fef6febf700 1 -- 172.21.15.78:0/1807839709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef680ac4c0 con 0x7fef680c5810 2023-08-17T17:53:17.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.040+0000 7fef65ffb700 1 -- 172.21.15.78:0/1807839709 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58011a70 con 0x7fef680c5810 2023-08-17T17:53:17.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.040+0000 7fef6febf700 1 -- 172.21.15.78:0/1807839709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef680c2ea0 con 0x7fef680c5810 2023-08-17T17:53:17.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.041+0000 7fef6febf700 1 -- 172.21.15.78:0/1807839709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef680ac9e0 con 0x7fef680c5810 2023-08-17T17:53:17.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.041+0000 7fef65ffb700 1 -- 172.21.15.78:0/1807839709 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fef5801c460 con 0x7fef680c5810 2023-08-17T17:53:17.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.042+0000 7fef65ffb700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef5405ed90 0x7fef54061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.042+0000 7fef6dc5b700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef5405ed90 0x7fef54061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.042+0000 7fef65ffb700 1 -- 172.21.15.78:0/1807839709 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fef58079510 con 0x7fef680c5810 2023-08-17T17:53:17.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.042+0000 7fef6dc5b700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef5405ed90 0x7fef54061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fef68159060 tx=0x7fef60009840).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:17.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.046+0000 7fef65ffb700 1 -- 172.21.15.78:0/1807839709 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef5804ada0 con 0x7fef680c5810 2023-08-17T17:53:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.210+0000 7fef6febf700 1 -- 172.21.15.78:0/1807839709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fef680c6960 con 0x7fef680c5810 2023-08-17T17:53:17.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.338+0000 7fef65ffb700 1 -- 172.21.15.78:0/1807839709 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v132) v1 ==== 152+0+0 (secure 0 0 0) 0x7fef58011e60 con 0x7fef680c5810 2023-08-17T17:53:17.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 -- 172.21.15.78:0/1807839709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef5405ed90 msgr2=0x7fef54061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:17.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef5405ed90 0x7fef54061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fef68159060 tx=0x7fef60009840).stop 2023-08-17T17:53:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 -- 172.21.15.78:0/1807839709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680c5810 msgr2=0x7fef680c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680c5810 0x7fef680c29b0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fef5800bfd0 tx=0x7fef58008040).stop 2023-08-17T17:53:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 -- 172.21.15.78:0/1807839709 shutdown_connections 2023-08-17T17:53:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fef5405ed90 0x7fef54061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef680c5810 0x7fef680c29b0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef680aa0f0 0x7fef681511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 --2- 172.21.15.78:0/1807839709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef680aa4d0 0x7fef681643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 -- 172.21.15.78:0/1807839709 >> 172.21.15.78:0/1807839709 conn(0x7fef6806a6a0 msgr2=0x7fef68151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:17.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 -- 172.21.15.78:0/1807839709 shutdown_connections 2023-08-17T17:53:17.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.342+0000 7fef6febf700 1 -- 172.21.15.78:0/1807839709 wait complete. 2023-08-17T17:53:17.347 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T17:53:17.357 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T17:53:17.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.476+0000 7f0f44dea700 1 Processor -- start 2023-08-17T17:53:17.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.476+0000 7f0f44dea700 1 -- start start 2023-08-17T17:53:17.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f44dea700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f400c0f10 0x7f0f400c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f44dea700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0f400c7e10 0x7f0f400ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f44dea700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f400c6970 con 0x7f0f40154110 2023-08-17T17:53:17.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f44dea700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f400cac90 con 0x7f0f400c7e10 2023-08-17T17:53:17.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f44dea700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400c6040 con 0x7f0f400c0f10 2023-08-17T17:53:17.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3e59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0f40154110 0x7f0f400c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56808/0 (socket says 172.21.15.78:56808) 2023-08-17T17:53:17.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3e59c700 1 -- 172.21.15.78:0/2622344890 learned_addr learned my addr 172.21.15.78:0/2622344890 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:17.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940642717 0 0) 0x7f0f400c6970 con 0x7f0f40154110 2023-08-17T17:53:17.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f280033f0 con 0x7f0f40154110 2023-08-17T17:53:17.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3ed9d700 1 --2- 172.21.15.78:0/2622344890 >> v2:172.21.15.150:3300/0 conn(0x7f0f400c7e10 0x7f0f400ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3dd9b700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f400c0f10 0x7f0f400c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 327936239 0 0) 0x7f0f280033f0 con 0x7f0f40154110 2023-08-17T17:53:17.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f400c0f10 msgr2=0x7f0f400c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:17.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f400c0f10 0x7f0f400c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 >> v2:172.21.15.150:3300/0 conn(0x7f0f400c7e10 msgr2=0x7f0f400ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:17.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 --2- 172.21.15.78:0/2622344890 >> v2:172.21.15.150:3300/0 conn(0x7f0f400c7e10 0x7f0f400ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f400c6320 con 0x7f0f40154110 2023-08-17T17:53:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f0f30001470 con 0x7f0f40154110 2023-08-17T17:53:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 >> v1:172.21.15.78:6789/0 conn(0x7f0f40154110 legacy=0x7f0f400c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f280038e0 0x7f0f28003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f400c0f10 0x7f0f28004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 0x7f0f28005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.477+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400cac90 con 0x7f0f28004b80 2023-08-17T17:53:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400c6040 con 0x7f0f280038e0 2023-08-17T17:53:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2800b8e0 con 0x7f0f400c0f10 2023-08-17T17:53:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3ed9d700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 0x7f0f28005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3e59c700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f280038e0 0x7f0f28003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3dd9b700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f400c0f10 0x7f0f28004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3ed9d700 1 -- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f400c0f10 msgr2=0x7f0f28004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3ed9d700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f400c0f10 0x7f0f28004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3ed9d700 1 -- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f280038e0 msgr2=0x7f0f28003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3ed9d700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f280038e0 0x7f0f28003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3ed9d700 1 -- 172.21.15.78:0/2622344890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280033f0 con 0x7f0f28004b80 2023-08-17T17:53:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3ed9d700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 0x7f0f28005000 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f0f400c82a0 tx=0x7f0f3800b040).ready entity=mon.0 client_cookie=d515afd0b140307a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38009ac0 con 0x7f0f28004b80 2023-08-17T17:53:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3800f040 con 0x7f0f28004b80 2023-08-17T17:53:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.478+0000 7f0f3d59a700 1 -- 172.21.15.78:0/2622344890 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3800eca0 con 0x7f0f28004b80 2023-08-17T17:53:17.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.479+0000 7f0f44dea700 1 -- 172.21.15.78:0/2622344890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 msgr2=0x7f0f28005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:17.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.479+0000 7f0f44dea700 1 --2- 172.21.15.78:0/2622344890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 0x7f0f28005000 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f0f400c82a0 tx=0x7f0f3800b040).stop 2023-08-17T17:53:17.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.479+0000 7f0f3ed9d700 1 -- 172.21.15.78:0/2622344890 reap_dead start 2023-08-17T17:53:17.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.479+0000 7f0f44dea700 1 -- 172.21.15.78:0/2622344890 shutdown_connections 2023-08-17T17:53:17.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.479+0000 7f0f44dea700 1 -- 172.21.15.78:0/2622344890 >> 172.21.15.78:0/2622344890 conn(0x7f0f40094650 msgr2=0x7f0f4006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:17.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.479+0000 7f0f44dea700 1 -- 172.21.15.78:0/2622344890 shutdown_connections 2023-08-17T17:53:17.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.479+0000 7f0f44dea700 1 -- 172.21.15.78:0/2622344890 wait complete. 2023-08-17T17:53:17.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.480+0000 7f0f44dea700 1 Processor -- start 2023-08-17T17:53:17.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.480+0000 7f0f44dea700 1 -- start start 2023-08-17T17:53:17.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f44dea700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 0x7f0f400c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f44dea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f400b08d0 0x7f0f40163ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f44dea700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f40164090 0x7f0f400a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f44dea700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400b0440 con 0x7f0f28004b80 2023-08-17T17:53:17.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f44dea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f401646b0 con 0x7f0f400b08d0 2023-08-17T17:53:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f44dea700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40164990 con 0x7f0f40164090 2023-08-17T17:53:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 0x7f0f400c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 0x7f0f400c4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59164/0 (socket says 172.21.15.78:59164) 2023-08-17T17:53:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3e59c700 1 -- 172.21.15.78:0/484712210 learned_addr learned my addr 172.21.15.78:0/484712210 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3ed9d700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f40164090 0x7f0f400a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3dd9b700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f400b08d0 0x7f0f40163ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3e59c700 1 -- 172.21.15.78:0/484712210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f40164090 msgr2=0x7f0f400a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:17.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3e59c700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f40164090 0x7f0f400a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3e59c700 1 -- 172.21.15.78:0/484712210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f400b08d0 msgr2=0x7f0f40163ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:17.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3e59c700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f400b08d0 0x7f0f40163ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:17.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3e59c700 1 -- 172.21.15.78:0/484712210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f400b00d0 con 0x7f0f28004b80 2023-08-17T17:53:17.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3ed9d700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f40164090 0x7f0f400a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:17.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f3e59c700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 0x7f0f400c4170 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f0f300016a0 tx=0x7f0f30001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:17.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f2e7fc700 1 -- 172.21.15.78:0/484712210 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30011590 con 0x7f0f28004b80 2023-08-17T17:53:17.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f2e7fc700 1 -- 172.21.15.78:0/484712210 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f300116f0 con 0x7f0f28004b80 2023-08-17T17:53:17.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f44dea700 1 -- 172.21.15.78:0/484712210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f40153270 con 0x7f0f28004b80 2023-08-17T17:53:17.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f2e7fc700 1 -- 172.21.15.78:0/484712210 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30011a70 con 0x7f0f28004b80 2023-08-17T17:53:17.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.481+0000 7f0f44dea700 1 -- 172.21.15.78:0/484712210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f400aa130 con 0x7f0f28004b80 2023-08-17T17:53:17.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.482+0000 7f0f44dea700 1 -- 172.21.15.78:0/484712210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f40164470 con 0x7f0f28004b80 2023-08-17T17:53:17.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.483+0000 7f0f2e7fc700 1 -- 172.21.15.78:0/484712210 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0f3001b030 con 0x7f0f28004b80 2023-08-17T17:53:17.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.483+0000 7f0f2e7fc700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0f2005ed90 0x7f0f20061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:17.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.483+0000 7f0f2e7fc700 1 -- 172.21.15.78:0/484712210 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f0f30079070 con 0x7f0f28004b80 2023-08-17T17:53:17.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.483+0000 7f0f3dd9b700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0f2005ed90 0x7f0f20061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:17.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.484+0000 7f0f3dd9b700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0f2005ed90 0x7f0f20061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0f4014f250 tx=0x7f0f34008040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:17.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.488+0000 7f0f2e7fc700 1 -- 172.21.15.78:0/484712210 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0f40164470 con 0x7f0f28004b80 2023-08-17T17:53:17.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:17.651+0000 7f0f44dea700 1 -- 172.21.15.78:0/484712210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0f40164470 con 0x7f0f28004b80 2023-08-17T17:53:18.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.344+0000 7f0f2e7fc700 1 -- 172.21.15.78:0/484712210 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v133) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0f40164470 con 0x7f0f28004b80 2023-08-17T17:53:18.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.349+0000 7f0f44dea700 1 -- 172.21.15.78:0/484712210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0f2005ed90 msgr2=0x7f0f20061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.349+0000 7f0f44dea700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0f2005ed90 0x7f0f20061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0f4014f250 tx=0x7f0f34008040).stop 2023-08-17T17:53:18.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.349+0000 7f0f44dea700 1 -- 172.21.15.78:0/484712210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 msgr2=0x7f0f400c4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.349+0000 7f0f44dea700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 0x7f0f400c4170 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f0f300016a0 tx=0x7f0f30001e90).stop 2023-08-17T17:53:18.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.354+0000 7f0f44dea700 1 -- 172.21.15.78:0/484712210 shutdown_connections 2023-08-17T17:53:18.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.354+0000 7f0f44dea700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0f2005ed90 0x7f0f20061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.354+0000 7f0f44dea700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f40164090 0x7f0f400a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.354+0000 7f0f44dea700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f28004b80 0x7f0f400c4170 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.354+0000 7f0f44dea700 1 --2- 172.21.15.78:0/484712210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f400b08d0 0x7f0f40163ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.354+0000 7f0f44dea700 1 -- 172.21.15.78:0/484712210 >> 172.21.15.78:0/484712210 conn(0x7f0f40094650 msgr2=0x7f0f400c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:18.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.355+0000 7f0f44dea700 1 -- 172.21.15.78:0/484712210 shutdown_connections 2023-08-17T17:53:18.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.356+0000 7f0f44dea700 1 -- 172.21.15.78:0/484712210 wait complete. 2023-08-17T17:53:18.362 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T17:53:18.377 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T17:53:18.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.493+0000 7fbd219da700 1 Processor -- start 2023-08-17T17:53:18.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.493+0000 7fbd219da700 1 -- start start 2023-08-17T17:53:18.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.494+0000 7fbd219da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.494+0000 7fbd219da700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbd1c0aa4d0 0x7fbd1c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.494+0000 7fbd219da700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c0649b0 con 0x7fbd1c0c5810 2023-08-17T17:53:18.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.494+0000 7fbd219da700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c063420 con 0x7fbd1c0aa4d0 2023-08-17T17:53:18.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.494+0000 7fbd219da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c063700 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.494+0000 7fbd127fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbd1c0aa4d0 0x7fbd1c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.494+0000 7fbd1affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.494+0000 7fbd1b7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fbd1c0c5810 0x7fbd1c0a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:48892/0 (socket says 172.21.15.78:48892) 2023-08-17T17:53:18.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.494+0000 7fbd1b7fe700 1 -- 172.21.15.78:0/2985967329 learned_addr learned my addr 172.21.15.78:0/2985967329 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:18.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd1a7fc700 1 -- 172.21.15.78:0/2985967329 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680156317 0 0) 0x7fbd1c0649b0 con 0x7fbd1c0c5810 2023-08-17T17:53:18.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd1a7fc700 1 -- 172.21.15.78:0/2985967329 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd080033f0 con 0x7fbd1c0c5810 2023-08-17T17:53:18.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd1affd700 1 -- 172.21.15.78:0/2985967329 >> v2:172.21.15.150:3300/0 conn(0x7fbd1c0aa4d0 msgr2=0x7fbd1c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:18.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd1affd700 1 --2- 172.21.15.78:0/2985967329 >> v2:172.21.15.150:3300/0 conn(0x7fbd1c0aa4d0 0x7fbd1c0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd1affd700 1 -- 172.21.15.78:0/2985967329 >> v1:172.21.15.150:6789/0 conn(0x7fbd1c0c5810 legacy=0x7fbd1c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd1affd700 1 -- 172.21.15.78:0/2985967329 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0639e0 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd127fc700 1 --2- 172.21.15.78:0/2985967329 >> v2:172.21.15.150:3300/0 conn(0x7fbd1c0aa4d0 0x7fbd1c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:18.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd1affd700 1 --2- 172.21.15.78:0/2985967329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0644c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fbd0c009760 tx=0x7fbd0c009060).ready entity=mon.2 client_cookie=dff0550136fbcd21 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:18.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd1a7fc700 1 -- 172.21.15.78:0/2985967329 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00d4a0 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd1a7fc700 1 -- 172.21.15.78:0/2985967329 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c00d600 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd1a7fc700 1 -- 172.21.15.78:0/2985967329 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00d980 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd219da700 1 -- 172.21.15.78:0/2985967329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0aa0f0 msgr2=0x7fbd1c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.495+0000 7fbd219da700 1 --2- 172.21.15.78:0/2985967329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0644c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fbd0c009760 tx=0x7fbd0c009060).stop 2023-08-17T17:53:18.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.496+0000 7fbd219da700 1 -- 172.21.15.78:0/2985967329 shutdown_connections 2023-08-17T17:53:18.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.496+0000 7fbd219da700 1 --2- 172.21.15.78:0/2985967329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0644c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.496+0000 7fbd219da700 1 --2- 172.21.15.78:0/2985967329 >> v2:172.21.15.150:3300/0 conn(0x7fbd1c0aa4d0 0x7fbd1c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.496+0000 7fbd219da700 1 -- 172.21.15.78:0/2985967329 >> 172.21.15.78:0/2985967329 conn(0x7fbd1c06a6a0 msgr2=0x7fbd1c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:18.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.496+0000 7fbd219da700 1 -- 172.21.15.78:0/2985967329 shutdown_connections 2023-08-17T17:53:18.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.496+0000 7fbd219da700 1 -- 172.21.15.78:0/2985967329 wait complete. 2023-08-17T17:53:18.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.497+0000 7fbd219da700 1 Processor -- start 2023-08-17T17:53:18.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.497+0000 7fbd219da700 1 -- start start 2023-08-17T17:53:18.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd219da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd219da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd1c0aa4d0 0x7fbd1c0afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd219da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0c5810 0x7fbd1c14b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd219da700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0ae900 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd219da700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0aebe0 con 0x7fbd1c0aa4d0 2023-08-17T17:53:18.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd219da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0aeec0 con 0x7fbd1c0c5810 2023-08-17T17:53:18.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd1affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd1affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59166/0 (socket says 172.21.15.78:59166) 2023-08-17T17:53:18.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd1affd700 1 -- 172.21.15.78:0/390148688 learned_addr learned my addr 172.21.15.78:0/390148688 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:18.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd127fc700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd1c0aa4d0 0x7fbd1c0afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd1b7fe700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0c5810 0x7fbd1c14b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd1affd700 1 -- 172.21.15.78:0/390148688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0c5810 msgr2=0x7fbd1c14b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd1affd700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0c5810 0x7fbd1c14b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd1affd700 1 -- 172.21.15.78:0/390148688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd1c0aa4d0 msgr2=0x7fbd1c0afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd1affd700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd1c0aa4d0 0x7fbd1c0afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd1affd700 1 -- 172.21.15.78:0/390148688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd040092a0 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd1affd700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0af9a0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7fbd0c009d50 tx=0x7fbd0c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:18.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd137fe700 1 -- 172.21.15.78:0/390148688 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c000bc0 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd137fe700 1 -- 172.21.15.78:0/390148688 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c00d770 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd137fe700 1 -- 172.21.15.78:0/390148688 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c000d20 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd219da700 1 -- 172.21.15.78:0/390148688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c0092a0 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.498+0000 7fbd219da700 1 -- 172.21.15.78:0/390148688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c0af480 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.499+0000 7fbd219da700 1 -- 172.21.15.78:0/390148688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c083980 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.500+0000 7fbd137fe700 1 -- 172.21.15.78:0/390148688 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbd0c00f070 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.500+0000 7fbd137fe700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbcfc05ed90 0x7fbcfc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.500+0000 7fbd137fe700 1 -- 172.21.15.78:0/390148688 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fbd0c07b190 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.500+0000 7fbd127fc700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbcfc05ed90 0x7fbcfc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.500+0000 7fbd127fc700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbcfc05ed90 0x7fbcfc061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbd1c084430 tx=0x7fbd04009060).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:18.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.504+0000 7fbd137fe700 1 -- 172.21.15.78:0/390148688 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbd0c04c790 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.710+0000 7fbd219da700 1 -- 172.21.15.78:0/390148688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbd1c0a85b0 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.718+0000 7fbd137fe700 1 -- 172.21.15.78:0/390148688 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbd1c0a85b0 con 0x7fbd1c0aa0f0 2023-08-17T17:53:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.723+0000 7fbd219da700 1 -- 172.21.15.78:0/390148688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbcfc05ed90 msgr2=0x7fbcfc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.723+0000 7fbd219da700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbcfc05ed90 0x7fbcfc061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbd1c084430 tx=0x7fbd04009060).stop 2023-08-17T17:53:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.723+0000 7fbd219da700 1 -- 172.21.15.78:0/390148688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c0aa0f0 msgr2=0x7fbd1c0af9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.723+0000 7fbd219da700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0af9a0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7fbd0c009d50 tx=0x7fbd0c016000).stop 2023-08-17T17:53:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.723+0000 7fbd219da700 1 -- 172.21.15.78:0/390148688 shutdown_connections 2023-08-17T17:53:18.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.723+0000 7fbd219da700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbcfc05ed90 0x7fbcfc061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.723+0000 7fbd219da700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd1c0c5810 0x7fbd1c14b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.723+0000 7fbd219da700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c0aa0f0 0x7fbd1c0af9a0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.723+0000 7fbd219da700 1 --2- 172.21.15.78:0/390148688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd1c0aa4d0 0x7fbd1c0afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.723+0000 7fbd219da700 1 -- 172.21.15.78:0/390148688 >> 172.21.15.78:0/390148688 conn(0x7fbd1c06a6a0 msgr2=0x7fbd1c0a8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:18.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.727+0000 7fbd219da700 1 -- 172.21.15.78:0/390148688 shutdown_connections 2023-08-17T17:53:18.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.727+0000 7fbd219da700 1 -- 172.21.15.78:0/390148688 wait complete. 2023-08-17T17:53:18.729 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 17 and data pool 18 2023-08-17T17:53:18.747 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:18.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.859+0000 7f6d809b2700 1 Processor -- start 2023-08-17T17:53:18.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.859+0000 7f6d809b2700 1 -- start start 2023-08-17T17:53:18.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.860+0000 7f6d809b2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6d7c154140 0x7f6d7c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.860+0000 7f6d809b2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7c154520 con 0x7f6d7c0c1010 2023-08-17T17:53:18.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.860+0000 7f6d809b2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7c0c91e0 con 0x7f6d7c0a7c40 2023-08-17T17:53:18.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.860+0000 7f6d809b2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7c0c94c0 con 0x7f6d7c154140 2023-08-17T17:53:18.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.860+0000 7f6d7ad9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6d7c0c1010 0x7f6d7c0ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40636/0 (socket says 172.21.15.78:40636) 2023-08-17T17:53:18.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.860+0000 7f6d7ad9d700 1 -- 172.21.15.78:0/3566749018 learned_addr learned my addr 172.21.15.78:0/3566749018 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:18.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.860+0000 7f6d7a59c700 1 --2- 172.21.15.78:0/3566749018 >> v2:172.21.15.150:3300/0 conn(0x7f6d7c154140 0x7f6d7c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.860+0000 7f6d79d9b700 1 -- 172.21.15.78:0/3566749018 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521126383 0 0) 0x7f6d7c154520 con 0x7f6d7c0c1010 2023-08-17T17:53:18.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.860+0000 7f6d79d9b700 1 -- 172.21.15.78:0/3566749018 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d680033f0 con 0x7f6d7c0c1010 2023-08-17T17:53:18.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d79d9b700 1 -- 172.21.15.78:0/3566749018 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332572316 0 0) 0x7f6d680033f0 con 0x7f6d7c0c1010 2023-08-17T17:53:18.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d7a59c700 1 -- 172.21.15.78:0/3566749018 >> v1:172.21.15.150:6789/0 conn(0x7f6d7c0a7c40 legacy=0x7f6d7c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d7a59c700 1 -- 172.21.15.78:0/3566749018 >> v1:172.21.15.78:6789/0 conn(0x7f6d7c0c1010 legacy=0x7f6d7c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d7a59c700 1 -- 172.21.15.78:0/3566749018 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c0c97a0 con 0x7f6d7c154140 2023-08-17T17:53:18.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d7a59c700 1 --2- 172.21.15.78:0/3566749018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d7c154140 0x7f6d7c0c6ee0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6d6c009760 tx=0x7f6d6c009060).ready entity=mon.1 client_cookie=69c458238bdd597f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:18.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d79d9b700 1 -- 172.21.15.78:0/3566749018 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d740017f0 con 0x7f6d7c154140 2023-08-17T17:53:18.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d79d9b700 1 -- 172.21.15.78:0/3566749018 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c009130 con 0x7f6d7c154140 2023-08-17T17:53:18.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d79d9b700 1 -- 172.21.15.78:0/3566749018 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c012620 con 0x7f6d7c154140 2023-08-17T17:53:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d809b2700 1 -- 172.21.15.78:0/3566749018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d7c154140 msgr2=0x7f6d7c0c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d809b2700 1 --2- 172.21.15.78:0/3566749018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d7c154140 0x7f6d7c0c6ee0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6d6c009760 tx=0x7f6d6c009060).stop 2023-08-17T17:53:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d809b2700 1 -- 172.21.15.78:0/3566749018 shutdown_connections 2023-08-17T17:53:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d809b2700 1 --2- 172.21.15.78:0/3566749018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d7c154140 0x7f6d7c0c6ee0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.861+0000 7f6d809b2700 1 -- 172.21.15.78:0/3566749018 >> 172.21.15.78:0/3566749018 conn(0x7f6d7c094510 msgr2=0x7f6d7c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.862+0000 7f6d809b2700 1 -- 172.21.15.78:0/3566749018 shutdown_connections 2023-08-17T17:53:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.862+0000 7f6d809b2700 1 -- 172.21.15.78:0/3566749018 wait complete. 2023-08-17T17:53:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.863+0000 7f6d809b2700 1 Processor -- start 2023-08-17T17:53:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.863+0000 7f6d809b2700 1 -- start start 2023-08-17T17:53:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.863+0000 7f6d809b2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d7c0a7c40 0x7f6d7c163950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.863+0000 7f6d809b2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d7c0c1010 0x7f6d7c150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d809b2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d7c154140 0x7f6d7c0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d809b2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c13d220 con 0x7f6d7c154140 2023-08-17T17:53:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d809b2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c0ac6f0 con 0x7f6d7c0a7c40 2023-08-17T17:53:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d809b2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c0ab850 con 0x7f6d7c0c1010 2023-08-17T17:53:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d7c154140 0x7f6d7c0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d7c154140 0x7f6d7c0acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59198/0 (socket says 172.21.15.78:59198) 2023-08-17T17:53:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7ad9d700 1 -- 172.21.15.78:0/765006383 learned_addr learned my addr 172.21.15.78:0/765006383 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7a59c700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d7c0a7c40 0x7f6d7c163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7ad9d700 1 -- 172.21.15.78:0/765006383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d7c0c1010 msgr2=0x7f6d7c150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d71d9b700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d7c0c1010 0x7f6d7c150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7ad9d700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d7c0c1010 0x7f6d7c150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7ad9d700 1 -- 172.21.15.78:0/765006383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d7c0a7c40 msgr2=0x7f6d7c163950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7ad9d700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d7c0a7c40 0x7f6d7c163950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7ad9d700 1 -- 172.21.15.78:0/765006383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0092a0 con 0x7f6d7c154140 2023-08-17T17:53:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7a59c700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d7c0a7c40 0x7f6d7c163950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d7ad9d700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d7c154140 0x7f6d7c0acb80 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f6d74001560 tx=0x7f6d74001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d72ffd700 1 -- 172.21.15.78:0/765006383 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74004c40 con 0x7f6d7c154140 2023-08-17T17:53:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d72ffd700 1 -- 172.21.15.78:0/765006383 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d74004de0 con 0x7f6d7c154140 2023-08-17T17:53:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d809b2700 1 -- 172.21.15.78:0/765006383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d7c1549d0 con 0x7f6d7c154140 2023-08-17T17:53:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d72ffd700 1 -- 172.21.15.78:0/765006383 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d740073c0 con 0x7f6d7c154140 2023-08-17T17:53:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.864+0000 7f6d809b2700 1 -- 172.21.15.78:0/765006383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7c0abe40 con 0x7f6d7c154140 2023-08-17T17:53:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.865+0000 7f6d809b2700 1 -- 172.21.15.78:0/765006383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7c047350 con 0x7f6d7c154140 2023-08-17T17:53:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.866+0000 7f6d72ffd700 1 -- 172.21.15.78:0/765006383 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6d7401b060 con 0x7f6d7c154140 2023-08-17T17:53:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.866+0000 7f6d72ffd700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6d5c05ed90 0x7f6d5c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.866+0000 7f6d72ffd700 1 -- 172.21.15.78:0/765006383 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6d7407a090 con 0x7f6d7c154140 2023-08-17T17:53:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.866+0000 7f6d7a59c700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6d5c05ed90 0x7f6d5c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.867+0000 7f6d7a59c700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6d5c05ed90 0x7f6d5c061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6d6c009760 tx=0x7f6d6c015000).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:18.870+0000 7f6d72ffd700 1 -- 172.21.15.78:0/765006383 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6d7404b5a0 con 0x7f6d7c154140 2023-08-17T17:53:19.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.033+0000 7f6d809b2700 1 -- 172.21.15.78:0/765006383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d7c0c63c0 con 0x7f6d7c154140 2023-08-17T17:53:19.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.034+0000 7f6d72ffd700 1 -- 172.21.15.78:0/765006383 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+17004 (secure 0 0 0) 0x7f6d74019030 con 0x7f6d7c154140 2023-08-17T17:53:19.035 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:19.035 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":134,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:18.711121+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:17.233530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:17.675099+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:19.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 -- 172.21.15.78:0/765006383 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6d5c05ed90 msgr2=0x7f6d5c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6d5c05ed90 0x7f6d5c061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6d6c009760 tx=0x7f6d6c015000).stop 2023-08-17T17:53:19.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 -- 172.21.15.78:0/765006383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d7c154140 msgr2=0x7f6d7c0acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d7c154140 0x7f6d7c0acb80 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f6d74001560 tx=0x7f6d74001d90).stop 2023-08-17T17:53:19.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 -- 172.21.15.78:0/765006383 shutdown_connections 2023-08-17T17:53:19.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6d5c05ed90 0x7f6d5c061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d7c154140 0x7f6d7c0acb80 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d7c0a7c40 0x7f6d7c163950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 --2- 172.21.15.78:0/765006383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d7c0c1010 0x7f6d7c150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 -- 172.21.15.78:0/765006383 >> 172.21.15.78:0/765006383 conn(0x7f6d7c094510 msgr2=0x7f6d7c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:19.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 -- 172.21.15.78:0/765006383 shutdown_connections 2023-08-17T17:53:19.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.036+0000 7f6d809b2700 1 -- 172.21.15.78:0/765006383 wait complete. 2023-08-17T17:53:19.049 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:19.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.161+0000 7f09d5be2700 1 Processor -- start 2023-08-17T17:53:19.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.161+0000 7f09d5be2700 1 -- start start 2023-08-17T17:53:19.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d5be2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09d00a8050 0x7f09d0064500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d5be2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d0063960 con 0x7f09d00a7bd0 2023-08-17T17:53:19.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d5be2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d0063030 con 0x7f09d00c01b0 2023-08-17T17:53:19.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d5be2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d00649f0 con 0x7f09d00a8050 2023-08-17T17:53:19.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d53e1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09d00a8050 0x7f09d0064500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d53e1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09d00a8050 0x7f09d0064500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59210/0 (socket says 172.21.15.78:59210) 2023-08-17T17:53:19.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d53e1700 1 -- 172.21.15.78:0/783148339 learned_addr learned my addr 172.21.15.78:0/783148339 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:19.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d53e1700 1 -- 172.21.15.78:0/783148339 >> v1:172.21.15.150:6789/0 conn(0x7f09d00c01b0 legacy=0x7f09d00c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d53e1700 1 -- 172.21.15.78:0/783148339 >> v1:172.21.15.78:6789/0 conn(0x7f09d00a7bd0 legacy=0x7f09d0063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09cf7fe700 1 -- 172.21.15.78:0/783148339 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240084518 0 0) 0x7f09d0063960 con 0x7f09d00a7bd0 2023-08-17T17:53:19.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d53e1700 1 -- 172.21.15.78:0/783148339 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0063310 con 0x7f09d00a8050 2023-08-17T17:53:19.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09d53e1700 1 --2- 172.21.15.78:0/783148339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00a8050 0x7f09d0064500 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f09b8006fd0 tx=0x7f09b80090f0).ready entity=mon.0 client_cookie=c04119b1e2fa9780 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:19.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09cf7fe700 1 -- 172.21.15.78:0/783148339 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b800b600 con 0x7f09d00a8050 2023-08-17T17:53:19.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09cf7fe700 1 -- 172.21.15.78:0/783148339 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b800b760 con 0x7f09d00a8050 2023-08-17T17:53:19.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.162+0000 7f09cf7fe700 1 -- 172.21.15.78:0/783148339 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b800bae0 con 0x7f09d00a8050 2023-08-17T17:53:19.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.163+0000 7f09d5be2700 1 -- 172.21.15.78:0/783148339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00a8050 msgr2=0x7f09d0064500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.163+0000 7f09d5be2700 1 --2- 172.21.15.78:0/783148339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00a8050 0x7f09d0064500 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f09b8006fd0 tx=0x7f09b80090f0).stop 2023-08-17T17:53:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.163+0000 7f09d5be2700 1 -- 172.21.15.78:0/783148339 shutdown_connections 2023-08-17T17:53:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.163+0000 7f09d5be2700 1 --2- 172.21.15.78:0/783148339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00a8050 0x7f09d0064500 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.163+0000 7f09d5be2700 1 -- 172.21.15.78:0/783148339 >> 172.21.15.78:0/783148339 conn(0x7f09d006a6c0 msgr2=0x7f09d00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.163+0000 7f09d5be2700 1 -- 172.21.15.78:0/783148339 shutdown_connections 2023-08-17T17:53:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.163+0000 7f09d5be2700 1 -- 172.21.15.78:0/783148339 wait complete. 2023-08-17T17:53:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.164+0000 7f09d5be2700 1 Processor -- start 2023-08-17T17:53:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.164+0000 7f09d5be2700 1 -- start start 2023-08-17T17:53:19.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d5be2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09d00a7bd0 0x7f09d0156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d5be2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d00a8050 0x7f09d00aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d5be2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00c01b0 0x7f09d0164b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d5be2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d014f160 con 0x7f09d00c01b0 2023-08-17T17:53:19.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d5be2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d00aab90 con 0x7f09d00a8050 2023-08-17T17:53:19.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d5be2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d00ad0e0 con 0x7f09d00a7bd0 2023-08-17T17:53:19.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d53e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00c01b0 0x7f09d0164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d53e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00c01b0 0x7f09d0164b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59214/0 (socket says 172.21.15.78:59214) 2023-08-17T17:53:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d53e1700 1 -- 172.21.15.78:0/1085315605 learned_addr learned my addr 172.21.15.78:0/1085315605 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09cffff700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d00a8050 0x7f09d00aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d4be0700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09d00a7bd0 0x7f09d0156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d53e1700 1 -- 172.21.15.78:0/1085315605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09d00a7bd0 msgr2=0x7f09d0156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d53e1700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09d00a7bd0 0x7f09d0156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.165+0000 7f09d53e1700 1 -- 172.21.15.78:0/1085315605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d00a8050 msgr2=0x7f09d00aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.166+0000 7f09d53e1700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d00a8050 0x7f09d00aa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.166+0000 7f09d53e1700 1 -- 172.21.15.78:0/1085315605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b8009370 con 0x7f09d00c01b0 2023-08-17T17:53:19.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.166+0000 7f09d53e1700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00c01b0 0x7f09d0164b10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f09b8009f50 tx=0x7f09b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:19.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.166+0000 7f09ccff9700 1 -- 172.21.15.78:0/1085315605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b800bae0 con 0x7f09d00c01b0 2023-08-17T17:53:19.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.166+0000 7f09ccff9700 1 -- 172.21.15.78:0/1085315605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b801c420 con 0x7f09d00c01b0 2023-08-17T17:53:19.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.166+0000 7f09d5be2700 1 -- 172.21.15.78:0/1085315605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d0165000 con 0x7f09d00c01b0 2023-08-17T17:53:19.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.166+0000 7f09ccff9700 1 -- 172.21.15.78:0/1085315605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b801c7a0 con 0x7f09d00c01b0 2023-08-17T17:53:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.166+0000 7f09d5be2700 1 -- 172.21.15.78:0/1085315605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d00ac7b0 con 0x7f09d00c01b0 2023-08-17T17:53:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.167+0000 7f09d5be2700 1 -- 172.21.15.78:0/1085315605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d0083af0 con 0x7f09d00c01b0 2023-08-17T17:53:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.167+0000 7f09ccff9700 1 -- 172.21.15.78:0/1085315605 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f09b802c070 con 0x7f09d00c01b0 2023-08-17T17:53:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.168+0000 7f09ccff9700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09b005ed90 0x7f09b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.168+0000 7f09ccff9700 1 -- 172.21.15.78:0/1085315605 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f09b807b980 con 0x7f09d00c01b0 2023-08-17T17:53:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.168+0000 7f09d4be0700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09b005ed90 0x7f09b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.168+0000 7f09d4be0700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09b005ed90 0x7f09b0061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f09d0157270 tx=0x7f09c8009040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:19.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.172+0000 7f09ccff9700 1 -- 172.21.15.78:0/1085315605 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09b804cf20 con 0x7f09d00c01b0 2023-08-17T17:53:19.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.333+0000 7f09d5be2700 1 -- 172.21.15.78:0/1085315605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09d00635f0 con 0x7f09d00c01b0 2023-08-17T17:53:19.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.334+0000 7f09ccff9700 1 -- 172.21.15.78:0/1085315605 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+17004 (secure 0 0 0) 0x7f09b802a030 con 0x7f09d00c01b0 2023-08-17T17:53:19.335 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:19.335 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":134,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:18.711121+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:17.233530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:17.675099+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:19.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 -- 172.21.15.78:0/1085315605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09b005ed90 msgr2=0x7f09b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09b005ed90 0x7f09b0061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f09d0157270 tx=0x7f09c8009040).stop 2023-08-17T17:53:19.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 -- 172.21.15.78:0/1085315605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00c01b0 msgr2=0x7f09d0164b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00c01b0 0x7f09d0164b10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f09b8009f50 tx=0x7f09b8017000).stop 2023-08-17T17:53:19.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 -- 172.21.15.78:0/1085315605 shutdown_connections 2023-08-17T17:53:19.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f09b005ed90 0x7f09b0061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09d00c01b0 0x7f09d0164b10 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09d00a7bd0 0x7f09d0156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 --2- 172.21.15.78:0/1085315605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09d00a8050 0x7f09d00aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 -- 172.21.15.78:0/1085315605 >> 172.21.15.78:0/1085315605 conn(0x7f09d006a6c0 msgr2=0x7f09d00c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:19.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 -- 172.21.15.78:0/1085315605 shutdown_connections 2023-08-17T17:53:19.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.336+0000 7f09d5be2700 1 -- 172.21.15.78:0/1085315605 wait complete. 2023-08-17T17:53:19.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T17:53:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.464+0000 7f6dd4a1d700 1 Processor -- start 2023-08-17T17:53:19.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.464+0000 7f6dd4a1d700 1 -- start start 2023-08-17T17:53:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dd4a1d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6dd00aa0f0 0x7f6dd00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dd4a1d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dd00c5810 0x7f6dd00c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dd4a1d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00649b0 con 0x7f6dd00aa4d0 2023-08-17T17:53:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dd4a1d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd00c6170 con 0x7f6dd00aa0f0 2023-08-17T17:53:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dd4a1d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0063420 con 0x7f6dd00c5810 2023-08-17T17:53:19.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dce59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6dd00aa0f0 0x7f6dd00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dce59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6dd00aa0f0 0x7f6dd00644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59230/0 (socket says 172.21.15.78:59230) 2023-08-17T17:53:19.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dce59c700 1 -- 172.21.15.78:0/1030540404 learned_addr learned my addr 172.21.15.78:0/1030540404 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:19.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dced9d700 1 --2- 172.21.15.78:0/1030540404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dd00c5810 0x7f6dd00c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dce59c700 1 -- 172.21.15.78:0/1030540404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dd00c5810 msgr2=0x7f6dd00c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:19.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dce59c700 1 --2- 172.21.15.78:0/1030540404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dd00c5810 0x7f6dd00c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dce59c700 1 -- 172.21.15.78:0/1030540404 >> v1:172.21.15.150:6789/0 conn(0x7f6dd00aa4d0 legacy=0x7f6dd00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.465+0000 7f6dce59c700 1 -- 172.21.15.78:0/1030540404 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0063700 con 0x7f6dd00aa0f0 2023-08-17T17:53:19.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dce59c700 1 --2- 172.21.15.78:0/1030540404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00aa0f0 0x7f6dd00644c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f6dc0006fd0 tx=0x7f6dc00090f0).ready entity=mon.0 client_cookie=c1c78dd02143c562 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:19.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dcdd9b700 1 -- 172.21.15.78:0/1030540404 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000b580 con 0x7f6dd00aa0f0 2023-08-17T17:53:19.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dcdd9b700 1 -- 172.21.15.78:0/1030540404 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc000b6e0 con 0x7f6dd00aa0f0 2023-08-17T17:53:19.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dcdd9b700 1 -- 172.21.15.78:0/1030540404 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000ba60 con 0x7f6dd00aa0f0 2023-08-17T17:53:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/1030540404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00aa0f0 msgr2=0x7f6dd00644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dd4a1d700 1 --2- 172.21.15.78:0/1030540404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00aa0f0 0x7f6dd00644c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f6dc0006fd0 tx=0x7f6dc00090f0).stop 2023-08-17T17:53:19.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/1030540404 shutdown_connections 2023-08-17T17:53:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dd4a1d700 1 --2- 172.21.15.78:0/1030540404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dd00c5810 0x7f6dd00c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dd4a1d700 1 --2- 172.21.15.78:0/1030540404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00aa0f0 0x7f6dd00644c0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/1030540404 >> 172.21.15.78:0/1030540404 conn(0x7f6dd006a6a0 msgr2=0x7f6dd00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/1030540404 shutdown_connections 2023-08-17T17:53:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.466+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/1030540404 wait complete. 2023-08-17T17:53:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dd4a1d700 1 Processor -- start 2023-08-17T17:53:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dd4a1d700 1 -- start start 2023-08-17T17:53:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dd4a1d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dd00aa0f0 0x7f6dd00b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dd4a1d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dd00aa4d0 0x7f6dd0164460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dd4a1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00c5810 0x7f6dd0164950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dd4a1d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00afdb0 con 0x7f6dd00c5810 2023-08-17T17:53:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dd4a1d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0152ee0 con 0x7f6dd00aa0f0 2023-08-17T17:53:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dd4a1d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00af1a0 con 0x7f6dd00aa4d0 2023-08-17T17:53:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dced9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00c5810 0x7f6dd0164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dced9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00c5810 0x7f6dd0164950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59244/0 (socket says 172.21.15.78:59244) 2023-08-17T17:53:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.468+0000 7f6dced9d700 1 -- 172.21.15.78:0/3042693562 learned_addr learned my addr 172.21.15.78:0/3042693562 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dce59c700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dd00aa0f0 0x7f6dd00b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dced9d700 1 -- 172.21.15.78:0/3042693562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dd00aa4d0 msgr2=0x7f6dd0164460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dced9d700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dd00aa4d0 0x7f6dd0164460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dced9d700 1 -- 172.21.15.78:0/3042693562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dd00aa0f0 msgr2=0x7f6dd00b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dced9d700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dd00aa0f0 0x7f6dd00b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dced9d700 1 -- 172.21.15.78:0/3042693562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0009370 con 0x7f6dd00c5810 2023-08-17T17:53:19.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dced9d700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00c5810 0x7f6dd0164950 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f6dc8009ec0 tx=0x7f6dc800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:19.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dc6ffd700 1 -- 172.21.15.78:0/3042693562 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800cc20 con 0x7f6dd00c5810 2023-08-17T17:53:19.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dc6ffd700 1 -- 172.21.15.78:0/3042693562 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc800f040 con 0x7f6dd00c5810 2023-08-17T17:53:19.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dc6ffd700 1 -- 172.21.15.78:0/3042693562 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8013400 con 0x7f6dd00c5810 2023-08-17T17:53:19.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/3042693562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd00af480 con 0x7f6dd00c5810 2023-08-17T17:53:19.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.469+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/3042693562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd00afa40 con 0x7f6dd00c5810 2023-08-17T17:53:19.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.470+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/3042693562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd00aff20 con 0x7f6dd00c5810 2023-08-17T17:53:19.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.470+0000 7f6dc6ffd700 1 -- 172.21.15.78:0/3042693562 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6dc80137b0 con 0x7f6dd00c5810 2023-08-17T17:53:19.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.471+0000 7f6dc6ffd700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6db005ed90 0x7f6db0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.471+0000 7f6dc6ffd700 1 -- 172.21.15.78:0/3042693562 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6dc807a500 con 0x7f6dd00c5810 2023-08-17T17:53:19.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.471+0000 7f6dce59c700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6db005ed90 0x7f6db0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.471+0000 7f6dce59c700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6db005ed90 0x7f6db0061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f6dc0009130 tx=0x7f6dc0017000).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:19.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.475+0000 7f6dc6ffd700 1 -- 172.21.15.78:0/3042693562 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6dc804baa0 con 0x7f6dd00c5810 2023-08-17T17:53:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.679+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/3042693562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6dd0083980 con 0x7f6dd00c5810 2023-08-17T17:53:19.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.715+0000 7f6dc6ffd700 1 -- 172.21.15.78:0/3042693562 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6dc804f0c0 con 0x7f6dd00c5810 2023-08-17T17:53:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/3042693562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6db005ed90 msgr2=0x7f6db0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6db005ed90 0x7f6db0061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f6dc0009130 tx=0x7f6dc0017000).stop 2023-08-17T17:53:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/3042693562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00c5810 msgr2=0x7f6dd0164950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00c5810 0x7f6dd0164950 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f6dc8009ec0 tx=0x7f6dc800b040).stop 2023-08-17T17:53:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/3042693562 shutdown_connections 2023-08-17T17:53:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6db005ed90 0x7f6db0061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd00c5810 0x7f6dd0164950 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dd00aa0f0 0x7f6dd00b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 --2- 172.21.15.78:0/3042693562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dd00aa4d0 0x7f6dd0164460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:19.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/3042693562 >> 172.21.15.78:0/3042693562 conn(0x7f6dd006a6a0 msgr2=0x7f6dd00ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:19.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/3042693562 shutdown_connections 2023-08-17T17:53:19.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.717+0000 7f6dd4a1d700 1 -- 172.21.15.78:0/3042693562 wait complete. 2023-08-17T17:53:19.730 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T17:53:19.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T17:53:19.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.847+0000 7f8b11fd9700 1 Processor -- start 2023-08-17T17:53:19.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.847+0000 7f8b11fd9700 1 -- start start 2023-08-17T17:53:19.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.848+0000 7f8b11fd9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8b0c0c7de0 0x7f8b0c0c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.848+0000 7f8b11fd9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c0c1070 0x7f8b0c0a8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.848+0000 7f8b11fd9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0c0a79f0 con 0x7f8b0c098650 2023-08-17T17:53:19.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.848+0000 7f8b11fd9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c0c1be0 con 0x7f8b0c0c7de0 2023-08-17T17:53:19.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.848+0000 7f8b11fd9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0c1900 con 0x7f8b0c0c1070 2023-08-17T17:53:19.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.848+0000 7f8b03fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8b0c0c7de0 0x7f8b0c0c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.848+0000 7f8b117d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c0c1070 0x7f8b0c0a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b03fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8b0c0c7de0 0x7f8b0c0c0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:35684/0 (socket says 172.21.15.78:35684) 2023-08-17T17:53:19.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b117d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c0c1070 0x7f8b0c0a8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:59924/0 (socket says 172.21.15.78:59924) 2023-08-17T17:53:19.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b03fff700 1 -- 172.21.15.78:0/1068188730 learned_addr learned my addr 172.21.15.78:0/1068188730 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:19.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b10fd7700 1 --1- 172.21.15.78:0/1068188730 >> v1:172.21.15.150:6789/0 conn(0x7f8b0c098650 0x7f8b0c0c76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:36576/0 (socket says 172.21.15.78:36576) 2023-08-17T17:53:19.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b03fff700 1 -- 172.21.15.78:0/1068188730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c0c1070 msgr2=0x7f8b0c0a8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:19.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b03fff700 1 --2- 172.21.15.78:0/1068188730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c0c1070 0x7f8b0c0a8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b03fff700 1 -- 172.21.15.78:0/1068188730 >> v1:172.21.15.150:6789/0 conn(0x7f8b0c098650 legacy=0x7f8b0c0c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b03fff700 1 -- 172.21.15.78:0/1068188730 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c0a7c90 con 0x7f8b0c0c7de0 2023-08-17T17:53:19.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b117d8700 1 --2- 172.21.15.78:0/1068188730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c0c1070 0x7f8b0c0a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:19.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b03fff700 1 --2- 172.21.15.78:0/1068188730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b0c0c7de0 0x7f8b0c0c0b80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f8afc006fd0 tx=0x7f8afc0090f0).ready entity=mon.1 client_cookie=d694ee423cfc5352 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:19.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b037fe700 1 -- 172.21.15.78:0/1068188730 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00b580 con 0x7f8b0c0c7de0 2023-08-17T17:53:19.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b037fe700 1 -- 172.21.15.78:0/1068188730 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc00b6e0 con 0x7f8b0c0c7de0 2023-08-17T17:53:19.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.849+0000 7f8b037fe700 1 -- 172.21.15.78:0/1068188730 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00ba60 con 0x7f8b0c0c7de0 2023-08-17T17:53:19.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.850+0000 7f8b11fd9700 1 -- 172.21.15.78:0/1068188730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b0c0c7de0 msgr2=0x7f8b0c0c0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.850+0000 7f8b11fd9700 1 --2- 172.21.15.78:0/1068188730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b0c0c7de0 0x7f8b0c0c0b80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f8afc006fd0 tx=0x7f8afc0090f0).stop 2023-08-17T17:53:19.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.850+0000 7f8b11fd9700 1 -- 172.21.15.78:0/1068188730 shutdown_connections 2023-08-17T17:53:19.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.850+0000 7f8b11fd9700 1 --2- 172.21.15.78:0/1068188730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c0c1070 0x7f8b0c0a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.850+0000 7f8b11fd9700 1 --2- 172.21.15.78:0/1068188730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b0c0c7de0 0x7f8b0c0c0b80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.850+0000 7f8b11fd9700 1 -- 172.21.15.78:0/1068188730 >> 172.21.15.78:0/1068188730 conn(0x7f8b0c069c20 msgr2=0x7f8b0c06a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:19.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.850+0000 7f8b11fd9700 1 -- 172.21.15.78:0/1068188730 shutdown_connections 2023-08-17T17:53:19.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.850+0000 7f8b11fd9700 1 -- 172.21.15.78:0/1068188730 wait complete. 2023-08-17T17:53:19.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.851+0000 7f8b11fd9700 1 Processor -- start 2023-08-17T17:53:19.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.851+0000 7f8b11fd9700 1 -- start start 2023-08-17T17:53:19.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b11fd9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c098650 0x7f8b0c163e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b11fd9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b0c0c1070 0x7f8b0c0aa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b11fd9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b0c0c7de0 0x7f8b0c1436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b11fd9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0c1d40 con 0x7f8b0c0c1070 2023-08-17T17:53:19.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b11fd9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c164480 con 0x7f8b0c0c7de0 2023-08-17T17:53:19.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b11fd9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c164760 con 0x7f8b0c098650 2023-08-17T17:53:19.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b03fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b0c0c1070 0x7f8b0c0aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b03fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b0c0c1070 0x7f8b0c0aa760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59258/0 (socket says 172.21.15.78:59258) 2023-08-17T17:53:19.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b03fff700 1 -- 172.21.15.78:0/4263920513 learned_addr learned my addr 172.21.15.78:0/4263920513 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:19.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b10fd7700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c098650 0x7f8b0c163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b117d8700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b0c0c7de0 0x7f8b0c1436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b03fff700 1 -- 172.21.15.78:0/4263920513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c098650 msgr2=0x7f8b0c163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b03fff700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c098650 0x7f8b0c163e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b03fff700 1 -- 172.21.15.78:0/4263920513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b0c0c7de0 msgr2=0x7f8b0c1436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:19.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b03fff700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b0c0c7de0 0x7f8b0c1436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:19.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b03fff700 1 -- 172.21.15.78:0/4263920513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04009a20 con 0x7f8b0c0c1070 2023-08-17T17:53:19.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.852+0000 7f8b03fff700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b0c0c1070 0x7f8b0c0aa760 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f8afc011000 tx=0x7f8afc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:19.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.853+0000 7f8b00ff9700 1 -- 172.21.15.78:0/4263920513 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc006a40 con 0x7f8b0c0c1070 2023-08-17T17:53:19.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.853+0000 7f8b00ff9700 1 -- 172.21.15.78:0/4263920513 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc00b850 con 0x7f8b0c0c1070 2023-08-17T17:53:19.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.853+0000 7f8b11fd9700 1 -- 172.21.15.78:0/4263920513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8afc009370 con 0x7f8b0c0c1070 2023-08-17T17:53:19.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.853+0000 7f8b00ff9700 1 -- 172.21.15.78:0/4263920513 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc01c670 con 0x7f8b0c0c1070 2023-08-17T17:53:19.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.853+0000 7f8b11fd9700 1 -- 172.21.15.78:0/4263920513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c164d20 con 0x7f8b0c0c1070 2023-08-17T17:53:19.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.854+0000 7f8b11fd9700 1 -- 172.21.15.78:0/4263920513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c0c1eb0 con 0x7f8b0c0c1070 2023-08-17T17:53:19.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.854+0000 7f8b00ff9700 1 -- 172.21.15.78:0/4263920513 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8afc022020 con 0x7f8b0c0c1070 2023-08-17T17:53:19.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.854+0000 7f8b00ff9700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8af805ed90 0x7f8af8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:19.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.854+0000 7f8b00ff9700 1 -- 172.21.15.78:0/4263920513 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8afc07b3c0 con 0x7f8b0c0c1070 2023-08-17T17:53:19.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.854+0000 7f8b10fd7700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8af805ed90 0x7f8af8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:19.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.855+0000 7f8b10fd7700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8af805ed90 0x7f8af8061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8b0c0a9580 tx=0x7f8b08007d30).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:19.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:19.858+0000 7f8b00ff9700 1 -- 172.21.15.78:0/4263920513 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8afc04c960 con 0x7f8b0c0c1070 2023-08-17T17:53:20.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.066+0000 7f8b11fd9700 1 -- 172.21.15.78:0/4263920513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8b0c05f910 con 0x7f8b0c0c1070 2023-08-17T17:53:20.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.727+0000 7f8b00ff9700 1 -- 172.21.15.78:0/4263920513 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8afc04ff80 con 0x7f8b0c0c1070 2023-08-17T17:53:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 -- 172.21.15.78:0/4263920513 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8af805ed90 msgr2=0x7f8af8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8af805ed90 0x7f8af8061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8b0c0a9580 tx=0x7f8b08007d30).stop 2023-08-17T17:53:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 -- 172.21.15.78:0/4263920513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b0c0c1070 msgr2=0x7f8b0c0aa760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b0c0c1070 0x7f8b0c0aa760 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f8afc011000 tx=0x7f8afc017000).stop 2023-08-17T17:53:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 -- 172.21.15.78:0/4263920513 shutdown_connections 2023-08-17T17:53:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8af805ed90 0x7f8af8061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b0c0c7de0 0x7f8b0c1436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b0c098650 0x7f8b0c163e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 --2- 172.21.15.78:0/4263920513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b0c0c1070 0x7f8b0c0aa760 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 -- 172.21.15.78:0/4263920513 >> 172.21.15.78:0/4263920513 conn(0x7f8b0c069c20 msgr2=0x7f8b0c0a9970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 -- 172.21.15.78:0/4263920513 shutdown_connections 2023-08-17T17:53:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.729+0000 7f8b11fd9700 1 -- 172.21.15.78:0/4263920513 wait complete. 2023-08-17T17:53:20.743 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T17:53:20.744 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:20.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.859+0000 7f043e477700 1 Processor -- start 2023-08-17T17:53:20.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.859+0000 7f043e477700 1 -- start start 2023-08-17T17:53:20.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f043e477700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0438154140 0x7f04380c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:20.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f043e477700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04380c1010 0x7f04380ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:20.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f043e477700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0438154520 con 0x7f04380a7c40 2023-08-17T17:53:20.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f043e477700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04380c91e0 con 0x7f04380c1010 2023-08-17T17:53:20.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f043e477700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04380c94c0 con 0x7f0438154140 2023-08-17T17:53:20.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f043ca14700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04380c1010 0x7f04380ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:20.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f0437fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0438154140 0x7f04380c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:20.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f04377fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f04380a7c40 0x7f04380c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:36578/0 (socket says 172.21.15.78:36578) 2023-08-17T17:53:20.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f0437fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0438154140 0x7f04380c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:59930/0 (socket says 172.21.15.78:59930) 2023-08-17T17:53:20.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f043ca14700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04380c1010 0x7f04380ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:35712/0 (socket says 172.21.15.78:35712) 2023-08-17T17:53:20.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.860+0000 7f04377fe700 1 -- 172.21.15.78:0/2296593170 learned_addr learned my addr 172.21.15.78:0/2296593170 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:20.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.861+0000 7f043ca14700 1 -- 172.21.15.78:0/2296593170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0438154140 msgr2=0x7f04380c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:20.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.861+0000 7f043ca14700 1 --2- 172.21.15.78:0/2296593170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0438154140 0x7f04380c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:20.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.861+0000 7f043ca14700 1 -- 172.21.15.78:0/2296593170 >> v1:172.21.15.150:6789/0 conn(0x7f04380a7c40 legacy=0x7f04380c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:20.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.861+0000 7f043ca14700 1 -- 172.21.15.78:0/2296593170 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04380c97a0 con 0x7f04380c1010 2023-08-17T17:53:20.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.861+0000 7f0436ffd700 1 -- 172.21.15.78:0/2296593170 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445241996 0 0) 0x7f0438154520 con 0x7f04380a7c40 2023-08-17T17:53:20.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.861+0000 7f0437fff700 1 --2- 172.21.15.78:0/2296593170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0438154140 0x7f04380c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:20.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.861+0000 7f043ca14700 1 --2- 172.21.15.78:0/2296593170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04380c1010 0x7f04380ca280 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f0430009e60 tx=0x7f0430009780).ready entity=mon.1 client_cookie=5468fcc51fb33d20 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:20.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.861+0000 7f0436ffd700 1 -- 172.21.15.78:0/2296593170 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043000e070 con 0x7f04380c1010 2023-08-17T17:53:20.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.861+0000 7f0436ffd700 1 -- 172.21.15.78:0/2296593170 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043000bb60 con 0x7f04380c1010 2023-08-17T17:53:20.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.861+0000 7f0436ffd700 1 -- 172.21.15.78:0/2296593170 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430012410 con 0x7f04380c1010 2023-08-17T17:53:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.862+0000 7f043e477700 1 -- 172.21.15.78:0/2296593170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04380c1010 msgr2=0x7f04380ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.862+0000 7f043e477700 1 --2- 172.21.15.78:0/2296593170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04380c1010 0x7f04380ca280 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f0430009e60 tx=0x7f0430009780).stop 2023-08-17T17:53:20.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.862+0000 7f043e477700 1 -- 172.21.15.78:0/2296593170 shutdown_connections 2023-08-17T17:53:20.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.862+0000 7f043e477700 1 --2- 172.21.15.78:0/2296593170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04380c1010 0x7f04380ca280 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:20.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.862+0000 7f043e477700 1 --2- 172.21.15.78:0/2296593170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0438154140 0x7f04380c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:20.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.862+0000 7f043e477700 1 -- 172.21.15.78:0/2296593170 >> 172.21.15.78:0/2296593170 conn(0x7f0438094510 msgr2=0x7f043806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:20.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.862+0000 7f043e477700 1 -- 172.21.15.78:0/2296593170 shutdown_connections 2023-08-17T17:53:20.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.862+0000 7f043e477700 1 -- 172.21.15.78:0/2296593170 wait complete. 2023-08-17T17:53:20.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.863+0000 7f043e477700 1 Processor -- start 2023-08-17T17:53:20.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.863+0000 7f043e477700 1 -- start start 2023-08-17T17:53:20.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f043e477700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04380a7c40 0x7f04380b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:20.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f043e477700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04380c1010 0x7f043814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:20.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f043e477700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0438154140 0x7f04380a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:20.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f043e477700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04380a8080 con 0x7f04380a7c40 2023-08-17T17:53:20.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f043e477700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04380b07e0 con 0x7f0438154140 2023-08-17T17:53:20.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f043e477700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04380b0ac0 con 0x7f04380c1010 2023-08-17T17:53:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f0437fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04380a7c40 0x7f04380b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f0437fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04380a7c40 0x7f04380b0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59272/0 (socket says 172.21.15.78:59272) 2023-08-17T17:53:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f0437fff700 1 -- 172.21.15.78:0/3306613667 learned_addr learned my addr 172.21.15.78:0/3306613667 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f04377fe700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04380c1010 0x7f043814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f043ca14700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0438154140 0x7f04380a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f0437fff700 1 -- 172.21.15.78:0/3306613667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04380c1010 msgr2=0x7f043814de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f0437fff700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04380c1010 0x7f043814de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f0437fff700 1 -- 172.21.15.78:0/3306613667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0438154140 msgr2=0x7f04380a8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f0437fff700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0438154140 0x7f04380a8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f0437fff700 1 -- 172.21.15.78:0/3306613667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280092a0 con 0x7f04380a7c40 2023-08-17T17:53:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f04377fe700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04380c1010 0x7f043814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f043ca14700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0438154140 0x7f04380a8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f0437fff700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04380a7c40 0x7f04380b0220 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f042800ea20 tx=0x7f0428009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f041ffff700 1 -- 172.21.15.78:0/3306613667 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042800c850 con 0x7f04380a7c40 2023-08-17T17:53:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f041ffff700 1 -- 172.21.15.78:0/3306613667 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042800c9b0 con 0x7f04380a7c40 2023-08-17T17:53:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f043e477700 1 -- 172.21.15.78:0/3306613667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0430009a20 con 0x7f04380a7c40 2023-08-17T17:53:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f041ffff700 1 -- 172.21.15.78:0/3306613667 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042800cd30 con 0x7f04380a7c40 2023-08-17T17:53:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.864+0000 7f043e477700 1 -- 172.21.15.78:0/3306613667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04380a8570 con 0x7f04380a7c40 2023-08-17T17:53:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.865+0000 7f043e477700 1 -- 172.21.15.78:0/3306613667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0438047350 con 0x7f04380a7c40 2023-08-17T17:53:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.866+0000 7f041ffff700 1 -- 172.21.15.78:0/3306613667 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0428022070 con 0x7f04380a7c40 2023-08-17T17:53:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.866+0000 7f041ffff700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f042405ed90 0x7f0424061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.866+0000 7f041ffff700 1 -- 172.21.15.78:0/3306613667 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f042807a010 con 0x7f04380a7c40 2023-08-17T17:53:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.866+0000 7f04377fe700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f042405ed90 0x7f0424061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:20.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.867+0000 7f04377fe700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f042405ed90 0x7f0424061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f04380b0710 tx=0x7f042c009040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:20.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:20.870+0000 7f041ffff700 1 -- 172.21.15.78:0/3306613667 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f042804b5b0 con 0x7f04380a7c40 2023-08-17T17:53:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.072+0000 7f043e477700 1 -- 172.21.15.78:0/3306613667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04380ca690 con 0x7f04380a7c40 2023-08-17T17:53:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.073+0000 7f041ffff700 1 -- 172.21.15.78:0/3306613667 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f042804ebd0 con 0x7f04380a7c40 2023-08-17T17:53:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:21.073 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2182410743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2182410743},{"type":"v1","addr":"172.21.15.150:6833","nonce":2182410743}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/4059280185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4059280185},{"type":"v1","addr":"172.21.15.150:6835","nonce":4059280185}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8106,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/984792555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":984792555},{"type":"v1","addr":"172.21.15.78:6836","nonce":984792555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:18.711473+0000","modified":"2023-08-17T17:53:20.721858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/1089949614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1089949614},{"type":"v1","addr":"172.21.15.78:6837","nonce":1089949614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T17:53:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 -- 172.21.15.78:0/3306613667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f042405ed90 msgr2=0x7f0424061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f042405ed90 0x7f0424061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f04380b0710 tx=0x7f042c009040).stop 2023-08-17T17:53:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 -- 172.21.15.78:0/3306613667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04380a7c40 msgr2=0x7f04380b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04380a7c40 0x7f04380b0220 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f042800ea20 tx=0x7f0428009060).stop 2023-08-17T17:53:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 -- 172.21.15.78:0/3306613667 shutdown_connections 2023-08-17T17:53:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f042405ed90 0x7f0424061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0438154140 0x7f04380a8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04380a7c40 0x7f04380b0220 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 --2- 172.21.15.78:0/3306613667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04380c1010 0x7f043814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 -- 172.21.15.78:0/3306613667 >> 172.21.15.78:0/3306613667 conn(0x7f0438094510 msgr2=0x7f0438152810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 -- 172.21.15.78:0/3306613667 shutdown_connections 2023-08-17T17:53:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.074+0000 7f043e477700 1 -- 172.21.15.78:0/3306613667 wait complete. 2023-08-17T17:53:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 49 2023-08-17T17:53:21.086 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:21.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.198+0000 7f3b71909700 1 Processor -- start 2023-08-17T17:53:21.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.199+0000 7f3b71909700 1 -- start start 2023-08-17T17:53:21.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.199+0000 7f3b71909700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c0a5d90 0x7f3b6c150620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.199+0000 7f3b71909700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6c069680 con 0x7f3b6c150b10 2023-08-17T17:53:21.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.199+0000 7f3b71909700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6c068ab0 con 0x7f3b6c0a59b0 2023-08-17T17:53:21.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.199+0000 7f3b71909700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c28f0 con 0x7f3b6c0a5d90 2023-08-17T17:53:21.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b71108700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3b6c150b10 0x7f3b6c0c1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40662/0 (socket says 172.21.15.78:40662) 2023-08-17T17:53:21.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b71108700 1 -- 172.21.15.78:0/932780469 learned_addr learned my addr 172.21.15.78:0/932780469 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:21.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6bfff700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c0a5d90 0x7f3b6c150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009348809 0 0) 0x7f3b6c069680 con 0x7f3b6c150b10 2023-08-17T17:53:21.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b5c0033f0 con 0x7f3b6c150b10 2023-08-17T17:53:21.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3865144762 0 0) 0x7f3b5c0033f0 con 0x7f3b6c150b10 2023-08-17T17:53:21.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c0a5d90 msgr2=0x7f3b6c150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:21.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c0a5d90 0x7f3b6c150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 >> v1:172.21.15.150:6789/0 conn(0x7f3b6c0a59b0 legacy=0x7f3b6c069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c068d50 con 0x7f3b6c150b10 2023-08-17T17:53:21.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3b640017f0 con 0x7f3b6c150b10 2023-08-17T17:53:21.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 >> v1:172.21.15.78:6789/0 conn(0x7f3b6c150b10 legacy=0x7f3b6c0c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c0a5d90 0x7f3b5c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b5c003e00 0x7f3b5c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c004b80 0x7f3b5c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c28f0 con 0x7f3b5c003e00 2023-08-17T17:53:21.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c00daf0 con 0x7f3b5c004b80 2023-08-17T17:53:21.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c00dcb0 con 0x7f3b6c0a5d90 2023-08-17T17:53:21.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b6bfff700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b5c003e00 0x7f3b5c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b70907700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c0a5d90 0x7f3b5c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.200+0000 7f3b71108700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c004b80 0x7f3b5c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b6bfff700 1 -- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c0a5d90 msgr2=0x7f3b5c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:21.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b6bfff700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c0a5d90 0x7f3b5c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b6bfff700 1 -- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c004b80 msgr2=0x7f3b5c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:21.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b6bfff700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c004b80 0x7f3b5c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b6bfff700 1 -- 172.21.15.78:0/932780469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0033f0 con 0x7f3b5c003e00 2023-08-17T17:53:21.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b6bfff700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b5c003e00 0x7f3b5c004690 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f3b58009a80 tx=0x7f3b58009060).ready entity=mon.0 client_cookie=4d25215e4cd0568c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:21.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58009430 con 0x7f3b5c003e00 2023-08-17T17:53:21.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5800e640 con 0x7f3b5c003e00 2023-08-17T17:53:21.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b6b7fe700 1 -- 172.21.15.78:0/932780469 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800e9c0 con 0x7f3b5c003e00 2023-08-17T17:53:21.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b71909700 1 -- 172.21.15.78:0/932780469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b5c003e00 msgr2=0x7f3b5c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b71909700 1 --2- 172.21.15.78:0/932780469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b5c003e00 0x7f3b5c004690 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f3b58009a80 tx=0x7f3b58009060).stop 2023-08-17T17:53:21.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b71108700 1 -- 172.21.15.78:0/932780469 reap_dead start 2023-08-17T17:53:21.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b71909700 1 -- 172.21.15.78:0/932780469 shutdown_connections 2023-08-17T17:53:21.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b71909700 1 -- 172.21.15.78:0/932780469 >> 172.21.15.78:0/932780469 conn(0x7f3b6c0c7320 msgr2=0x7f3b6c0c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:21.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b71909700 1 -- 172.21.15.78:0/932780469 shutdown_connections 2023-08-17T17:53:21.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.201+0000 7f3b71909700 1 -- 172.21.15.78:0/932780469 wait complete. 2023-08-17T17:53:21.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.203+0000 7f3b71909700 1 Processor -- start 2023-08-17T17:53:21.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.203+0000 7f3b71909700 1 -- start start 2023-08-17T17:53:21.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.203+0000 7f3b71909700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c003e00 0x7f3b6c0bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.203+0000 7f3b71909700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b6c0be6c0 0x7f3b6c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.203+0000 7f3b71909700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c14c7d0 0x7f3b6c0bb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.203+0000 7f3b71909700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0a6870 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.203+0000 7f3b71909700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c0840 con 0x7f3b5c003e00 2023-08-17T17:53:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.203+0000 7f3b71909700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c0b20 con 0x7f3b6c14c7d0 2023-08-17T17:53:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b6c0be6c0 0x7f3b6c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b6c0be6c0 0x7f3b6c14c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59288/0 (socket says 172.21.15.78:59288) 2023-08-17T17:53:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b6bfff700 1 -- 172.21.15.78:0/606336151 learned_addr learned my addr 172.21.15.78:0/606336151 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b70907700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c003e00 0x7f3b6c0bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b71108700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c14c7d0 0x7f3b6c0bb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b6bfff700 1 -- 172.21.15.78:0/606336151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c14c7d0 msgr2=0x7f3b6c0bb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b6bfff700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c14c7d0 0x7f3b6c0bb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b6bfff700 1 -- 172.21.15.78:0/606336151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c003e00 msgr2=0x7f3b6c0bff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b6bfff700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c003e00 0x7f3b6c0bff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b6bfff700 1 -- 172.21.15.78:0/606336151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0a6500 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b71108700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c14c7d0 0x7f3b6c0bb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:21.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b6bfff700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b6c0be6c0 0x7f3b6c14c2e0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f3b5c004610 tx=0x7f3b5801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:21.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b68ff9700 1 -- 172.21.15.78:0/606336151 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800e7b0 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b68ff9700 1 -- 172.21.15.78:0/606336151 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5800e930 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b71909700 1 -- 172.21.15.78:0/606336151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c0c0400 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b68ff9700 1 -- 172.21.15.78:0/606336151 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5801b6a0 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.204+0000 7f3b71909700 1 -- 172.21.15.78:0/606336151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c0bbeb0 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.205+0000 7f3b71909700 1 -- 172.21.15.78:0/606336151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6c0a6690 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.205+0000 7f3b68ff9700 1 -- 172.21.15.78:0/606336151 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3b5801ba90 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.206+0000 7f3b68ff9700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b5005ed90 0x7f3b50061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.206+0000 7f3b68ff9700 1 -- 172.21.15.78:0/606336151 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3b5807b860 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.206+0000 7f3b70907700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b5005ed90 0x7f3b50061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.206+0000 7f3b70907700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b5005ed90 0x7f3b50061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3b60001130 tx=0x7f3b60007c00).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.210+0000 7f3b68ff9700 1 -- 172.21.15.78:0/606336151 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b5804ceb0 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.374+0000 7f3b71909700 1 -- 172.21.15.78:0/606336151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b6c0c7730 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.375+0000 7f3b68ff9700 1 -- 172.21.15.78:0/606336151 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f3b5802b020 con 0x7f3b6c0be6c0 2023-08-17T17:53:21.376 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:21.376 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":135,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:19.713187+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:17.233530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:17.675099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 -- 172.21.15.78:0/606336151 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b5005ed90 msgr2=0x7f3b50061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b5005ed90 0x7f3b50061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3b60001130 tx=0x7f3b60007c00).stop 2023-08-17T17:53:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 -- 172.21.15.78:0/606336151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b6c0be6c0 msgr2=0x7f3b6c14c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b6c0be6c0 0x7f3b6c14c2e0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f3b5c004610 tx=0x7f3b5801a000).stop 2023-08-17T17:53:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 -- 172.21.15.78:0/606336151 shutdown_connections 2023-08-17T17:53:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3b5005ed90 0x7f3b50061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b6c14c7d0 0x7f3b6c0bb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c003e00 0x7f3b6c0bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 --2- 172.21.15.78:0/606336151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b6c0be6c0 0x7f3b6c14c2e0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 -- 172.21.15.78:0/606336151 >> 172.21.15.78:0/606336151 conn(0x7f3b6c0c7320 msgr2=0x7f3b6c0c1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:21.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 -- 172.21.15.78:0/606336151 shutdown_connections 2023-08-17T17:53:21.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.377+0000 7f3b71909700 1 -- 172.21.15.78:0/606336151 wait complete. 2023-08-17T17:53:21.389 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T17:53:21.389 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:53:21.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.501+0000 7f77d9126700 1 Processor -- start 2023-08-17T17:53:21.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.501+0000 7f77d9126700 1 -- start start 2023-08-17T17:53:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.502+0000 7f77d9126700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d40bef00 0x7f77d4064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.502+0000 7f77d9126700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d40c4040 con 0x7f77d40a7fe0 2023-08-17T17:53:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.502+0000 7f77d9126700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d40655f0 con 0x7f77d4065140 2023-08-17T17:53:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.502+0000 7f77d9126700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40c3430 con 0x7f77d40bef00 2023-08-17T17:53:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.502+0000 7f77d2d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f77d40a7fe0 0x7f77d40be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40678/0 (socket says 172.21.15.78:40678) 2023-08-17T17:53:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.502+0000 7f77d2d9d700 1 -- 172.21.15.78:0/4010910729 learned_addr learned my addr 172.21.15.78:0/4010910729 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.502+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895516923 0 0) 0x7f77d40c4040 con 0x7f77d40a7fe0 2023-08-17T17:53:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.502+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77bc0033f0 con 0x7f77d40a7fe0 2023-08-17T17:53:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d259c700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d40bef00 0x7f77d4064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521336532 0 0) 0x7f77bc0033f0 con 0x7f77d40a7fe0 2023-08-17T17:53:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d40bef00 msgr2=0x7f77d4064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d40bef00 0x7f77d4064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 >> v1:172.21.15.150:6789/0 conn(0x7f77d4065140 legacy=0x7f77d40c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40c3710 con 0x7f77d40a7fe0 2023-08-17T17:53:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f77c40017f0 con 0x7f77d40a7fe0 2023-08-17T17:53:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 >> v1:172.21.15.78:6789/0 conn(0x7f77d40a7fe0 legacy=0x7f77d40be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d40bef00 0x7f77bc003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77bc003ef0 0x7f77bc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc004b80 0x7f77bc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40c3430 con 0x7f77bc003ef0 2023-08-17T17:53:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc00ba90 con 0x7f77bc004b80 2023-08-17T17:53:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc00bc50 con 0x7f77d40bef00 2023-08-17T17:53:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d259c700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77bc003ef0 0x7f77bc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d2d9d700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d40bef00 0x7f77bc003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d359e700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc004b80 0x7f77bc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d259c700 1 -- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d40bef00 msgr2=0x7f77bc003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d259c700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d40bef00 0x7f77bc003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d259c700 1 -- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc004b80 msgr2=0x7f77bc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d259c700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc004b80 0x7f77bc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d259c700 1 -- 172.21.15.78:0/4010910729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc0033f0 con 0x7f77bc003ef0 2023-08-17T17:53:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d359e700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc004b80 0x7f77bc005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d259c700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77bc003ef0 0x7f77bc004690 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f77c800b9b0 tx=0x7f77c8008040).ready entity=mon.0 client_cookie=95440f8df9a48db3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.503+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8013480 con 0x7f77bc003ef0 2023-08-17T17:53:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.504+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c80135e0 con 0x7f77bc003ef0 2023-08-17T17:53:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.504+0000 7f77d1d9b700 1 -- 172.21.15.78:0/4010910729 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8013980 con 0x7f77bc003ef0 2023-08-17T17:53:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.504+0000 7f77d9126700 1 -- 172.21.15.78:0/4010910729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77bc003ef0 msgr2=0x7f77bc004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.504+0000 7f77d9126700 1 --2- 172.21.15.78:0/4010910729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77bc003ef0 0x7f77bc004690 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f77c800b9b0 tx=0x7f77c8008040).stop 2023-08-17T17:53:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.504+0000 7f77d359e700 1 -- 172.21.15.78:0/4010910729 reap_dead start 2023-08-17T17:53:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.504+0000 7f77d9126700 1 -- 172.21.15.78:0/4010910729 shutdown_connections 2023-08-17T17:53:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.504+0000 7f77d9126700 1 -- 172.21.15.78:0/4010910729 >> 172.21.15.78:0/4010910729 conn(0x7f77d4092330 msgr2=0x7f77d4062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.504+0000 7f77d9126700 1 -- 172.21.15.78:0/4010910729 shutdown_connections 2023-08-17T17:53:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.504+0000 7f77d9126700 1 -- 172.21.15.78:0/4010910729 wait complete. 2023-08-17T17:53:21.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.506+0000 7f77d9126700 1 Processor -- start 2023-08-17T17:53:21.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.506+0000 7f77d9126700 1 -- start start 2023-08-17T17:53:21.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.506+0000 7f77d9126700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc003ef0 0x7f77d40abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.506+0000 7f77d9126700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77d40a7190 0x7f77d40a7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.506+0000 7f77d9126700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d4153620 0x7f77d4153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.506+0000 7f77d9126700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40c0dd0 con 0x7f77d40a7190 2023-08-17T17:53:21.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.506+0000 7f77d9126700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40c1950 con 0x7f77bc003ef0 2023-08-17T17:53:21.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.506+0000 7f77d9126700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40c1020 con 0x7f77d4153620 2023-08-17T17:53:21.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.506+0000 7f77d259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77d40a7190 0x7f77d40a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77d40a7190 0x7f77d40a7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59306/0 (socket says 172.21.15.78:59306) 2023-08-17T17:53:21.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d259c700 1 -- 172.21.15.78:0/2465158058 learned_addr learned my addr 172.21.15.78:0/2465158058 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:21.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d2d9d700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc003ef0 0x7f77d40abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d359e700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d4153620 0x7f77d4153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d259c700 1 -- 172.21.15.78:0/2465158058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d4153620 msgr2=0x7f77d4153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d259c700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d4153620 0x7f77d4153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d259c700 1 -- 172.21.15.78:0/2465158058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc003ef0 msgr2=0x7f77d40abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d259c700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc003ef0 0x7f77d40abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d259c700 1 -- 172.21.15.78:0/2465158058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40c1300 con 0x7f77d40a7190 2023-08-17T17:53:21.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d359e700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d4153620 0x7f77d4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:21.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d259c700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77d40a7190 0x7f77d40a7610 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f77bc00ba60 tx=0x7f77c8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:21.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77baffd700 1 -- 172.21.15.78:0/2465158058 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8021070 con 0x7f77d40a7190 2023-08-17T17:53:21.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77baffd700 1 -- 172.21.15.78:0/2465158058 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c8005880 con 0x7f77d40a7190 2023-08-17T17:53:21.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d9126700 1 -- 172.21.15.78:0/2465158058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d40c15e0 con 0x7f77d40a7190 2023-08-17T17:53:21.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77baffd700 1 -- 172.21.15.78:0/2465158058 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8013980 con 0x7f77d40a7190 2023-08-17T17:53:21.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.507+0000 7f77d9126700 1 -- 172.21.15.78:0/2465158058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d41582d0 con 0x7f77d40a7190 2023-08-17T17:53:21.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.508+0000 7f77d9126700 1 -- 172.21.15.78:0/2465158058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d4047350 con 0x7f77d40a7190 2023-08-17T17:53:21.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.508+0000 7f77baffd700 1 -- 172.21.15.78:0/2465158058 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f77c8011590 con 0x7f77d40a7190 2023-08-17T17:53:21.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.509+0000 7f77baffd700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77c005ed90 0x7f77c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.509+0000 7f77baffd700 1 -- 172.21.15.78:0/2465158058 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f77c807b6d0 con 0x7f77d40a7190 2023-08-17T17:53:21.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.509+0000 7f77d2d9d700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77c005ed90 0x7f77c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.509+0000 7f77d2d9d700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77c005ed90 0x7f77c0061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f77c4002250 tx=0x7f77c4009040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:21.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.513+0000 7f77baffd700 1 -- 172.21.15.78:0/2465158058 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77c804cc10 con 0x7f77d40a7190 2023-08-17T17:53:21.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.671+0000 7f77d9126700 1 -- 172.21.15.78:0/2465158058 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77d40c39f0 con 0x7f77c005ed90 2023-08-17T17:53:21.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.681+0000 7f77baffd700 1 -- 172.21.15.78:0/2465158058 <== mgr.7932 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361715 (secure 0 0 0) 0x7f77d40c39f0 con 0x7f77c005ed90 2023-08-17T17:53:21.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 -- 172.21.15.78:0/2465158058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77c005ed90 msgr2=0x7f77c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77c005ed90 0x7f77c0061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f77c4002250 tx=0x7f77c4009040).stop 2023-08-17T17:53:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 -- 172.21.15.78:0/2465158058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77d40a7190 msgr2=0x7f77d40a7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77d40a7190 0x7f77d40a7610 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f77bc00ba60 tx=0x7f77c8008040).stop 2023-08-17T17:53:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 -- 172.21.15.78:0/2465158058 shutdown_connections 2023-08-17T17:53:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f77c005ed90 0x7f77c0061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77d4153620 0x7f77d4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc003ef0 0x7f77d40abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 --2- 172.21.15.78:0/2465158058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77d40a7190 0x7f77d40a7610 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 -- 172.21.15.78:0/2465158058 >> 172.21.15.78:0/2465158058 conn(0x7f77d4092330 msgr2=0x7f77d40be3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 -- 172.21.15.78:0/2465158058 shutdown_connections 2023-08-17T17:53:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.685+0000 7f77d9126700 1 -- 172.21.15.78:0/2465158058 wait complete. 2023-08-17T17:53:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:53:21.697 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-17T17:53:19.748663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2422432,"kb_used_data":12896,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752552288,"statfs":{"total":773094113280,"available":770613542912,"internally_reserved":0,"allocated":13205504,"data_stored":6553340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19378,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-67,"num_write_kb":-43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.589764"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738312+0000","last_change":"2023-08-17T17:53:18.738312+0000","last_active":"2023-08-17T17:53:18.738312+0000","last_peered":"2023-08-17T17:53:18.738312+0000","last_clean":"2023-08-17T17:53:18.738312+0000","last_became_active":"2023-08-17T17:53:18.738039+0000","last_became_peered":"2023-08-17T17:53:18.738039+0000","last_unstale":"2023-08-17T17:53:18.738312+0000","last_undegraded":"2023-08-17T17:53:18.738312+0000","last_fullsized":"2023-08-17T17:53:18.738312+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"134'3","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736115+0000","last_change":"2023-08-17T17:53:18.365392+0000","last_active":"2023-08-17T17:53:18.736115+0000","last_peered":"2023-08-17T17:53:18.736115+0000","last_clean":"2023-08-17T17:53:18.736115+0000","last_became_active":"2023-08-17T17:53:18.365007+0000","last_became_peered":"2023-08-17T17:53:18.365007+0000","last_unstale":"2023-08-17T17:53:18.736115+0000","last_undegraded":"2023-08-17T17:53:18.736115+0000","last_fullsized":"2023-08-17T17:53:18.736115+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.737952+0000","last_change":"2023-08-17T17:53:18.737952+0000","last_active":"2023-08-17T17:53:18.737952+0000","last_peered":"2023-08-17T17:53:18.737952+0000","last_clean":"2023-08-17T17:53:18.737952+0000","last_became_active":"2023-08-17T17:53:18.737687+0000","last_became_peered":"2023-08-17T17:53:18.737687+0000","last_unstale":"2023-08-17T17:53:18.737952+0000","last_undegraded":"2023-08-17T17:53:18.737952+0000","last_fullsized":"2023-08-17T17:53:18.737952+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368084+0000","last_change":"2023-08-17T17:53:18.363966+0000","last_active":"2023-08-17T17:53:18.368084+0000","last_peered":"2023-08-17T17:53:18.368084+0000","last_clean":"2023-08-17T17:53:18.368084+0000","last_became_active":"2023-08-17T17:53:18.363672+0000","last_became_peered":"2023-08-17T17:53:18.363672+0000","last_unstale":"2023-08-17T17:53:18.368084+0000","last_undegraded":"2023-08-17T17:53:18.368084+0000","last_fullsized":"2023-08-17T17:53:18.368084+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.739928+0000","last_change":"2023-08-17T17:53:18.739928+0000","last_active":"2023-08-17T17:53:18.739928+0000","last_peered":"2023-08-17T17:53:18.739928+0000","last_clean":"2023-08-17T17:53:18.739928+0000","last_became_active":"2023-08-17T17:53:18.739510+0000","last_became_peered":"2023-08-17T17:53:18.739510+0000","last_unstale":"2023-08-17T17:53:18.739928+0000","last_undegraded":"2023-08-17T17:53:18.739928+0000","last_fullsized":"2023-08-17T17:53:18.739928+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370868+0000","last_change":"2023-08-17T17:53:18.369381+0000","last_active":"2023-08-17T17:53:18.370868+0000","last_peered":"2023-08-17T17:53:18.370868+0000","last_clean":"2023-08-17T17:53:18.370868+0000","last_became_active":"2023-08-17T17:53:18.369108+0000","last_became_peered":"2023-08-17T17:53:18.369108+0000","last_unstale":"2023-08-17T17:53:18.370868+0000","last_undegraded":"2023-08-17T17:53:18.370868+0000","last_fullsized":"2023-08-17T17:53:18.370868+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.734732+0000","last_change":"2023-08-17T17:53:18.734732+0000","last_active":"2023-08-17T17:53:18.734732+0000","last_peered":"2023-08-17T17:53:18.734732+0000","last_clean":"2023-08-17T17:53:18.734732+0000","last_became_active":"2023-08-17T17:53:18.734428+0000","last_became_peered":"2023-08-17T17:53:18.734428+0000","last_unstale":"2023-08-17T17:53:18.734732+0000","last_undegraded":"2023-08-17T17:53:18.734732+0000","last_fullsized":"2023-08-17T17:53:18.734732+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"134'2","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738647+0000","last_change":"2023-08-17T17:53:18.361495+0000","last_active":"2023-08-17T17:53:18.738647+0000","last_peered":"2023-08-17T17:53:18.738647+0000","last_clean":"2023-08-17T17:53:18.738647+0000","last_became_active":"2023-08-17T17:53:18.361110+0000","last_became_peered":"2023-08-17T17:53:18.361110+0000","last_unstale":"2023-08-17T17:53:18.738647+0000","last_undegraded":"2023-08-17T17:53:18.738647+0000","last_fullsized":"2023-08-17T17:53:18.738647+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738761+0000","last_change":"2023-08-17T17:53:18.738761+0000","last_active":"2023-08-17T17:53:18.738761+0000","last_peered":"2023-08-17T17:53:18.738761+0000","last_clean":"2023-08-17T17:53:18.738761+0000","last_became_active":"2023-08-17T17:53:18.736610+0000","last_became_peered":"2023-08-17T17:53:18.736610+0000","last_unstale":"2023-08-17T17:53:18.738761+0000","last_undegraded":"2023-08-17T17:53:18.738761+0000","last_fullsized":"2023-08-17T17:53:18.738761+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.721707+0000","last_change":"2023-08-17T17:53:18.362519+0000","last_active":"2023-08-17T17:53:18.721707+0000","last_peered":"2023-08-17T17:53:18.721707+0000","last_clean":"2023-08-17T17:53:18.721707+0000","last_became_active":"2023-08-17T17:53:18.362209+0000","last_became_peered":"2023-08-17T17:53:18.362209+0000","last_unstale":"2023-08-17T17:53:18.721707+0000","last_undegraded":"2023-08-17T17:53:18.721707+0000","last_fullsized":"2023-08-17T17:53:18.721707+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.729425+0000","last_change":"2023-08-17T17:53:18.729425+0000","last_active":"2023-08-17T17:53:18.729425+0000","last_peered":"2023-08-17T17:53:18.729425+0000","last_clean":"2023-08-17T17:53:18.729425+0000","last_became_active":"2023-08-17T17:53:18.729126+0000","last_became_peered":"2023-08-17T17:53:18.729126+0000","last_unstale":"2023-08-17T17:53:18.729425+0000","last_undegraded":"2023-08-17T17:53:18.729425+0000","last_fullsized":"2023-08-17T17:53:18.729425+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.716451+0000","last_change":"2023-08-17T17:53:18.360522+0000","last_active":"2023-08-17T17:53:18.716451+0000","last_peered":"2023-08-17T17:53:18.716451+0000","last_clean":"2023-08-17T17:53:18.716451+0000","last_became_active":"2023-08-17T17:53:18.360235+0000","last_became_peered":"2023-08-17T17:53:18.360235+0000","last_unstale":"2023-08-17T17:53:18.716451+0000","last_undegraded":"2023-08-17T17:53:18.716451+0000","last_fullsized":"2023-08-17T17:53:18.716451+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736404+0000","last_change":"2023-08-17T17:53:18.736404+0000","last_active":"2023-08-17T17:53:18.736404+0000","last_peered":"2023-08-17T17:53:18.736404+0000","last_clean":"2023-08-17T17:53:18.736404+0000","last_became_active":"2023-08-17T17:53:18.736133+0000","last_became_peered":"2023-08-17T17:53:18.736133+0000","last_unstale":"2023-08-17T17:53:18.736404+0000","last_undegraded":"2023-08-17T17:53:18.736404+0000","last_fullsized":"2023-08-17T17:53:18.736404+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.363854+0000","last_change":"2023-08-17T17:53:18.362184+0000","last_active":"2023-08-17T17:53:18.363854+0000","last_peered":"2023-08-17T17:53:18.363854+0000","last_clean":"2023-08-17T17:53:18.363854+0000","last_became_active":"2023-08-17T17:53:18.361840+0000","last_became_peered":"2023-08-17T17:53:18.361840+0000","last_unstale":"2023-08-17T17:53:18.363854+0000","last_undegraded":"2023-08-17T17:53:18.363854+0000","last_fullsized":"2023-08-17T17:53:18.363854+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735430+0000","last_change":"2023-08-17T17:53:18.735430+0000","last_active":"2023-08-17T17:53:18.735430+0000","last_peered":"2023-08-17T17:53:18.735430+0000","last_clean":"2023-08-17T17:53:18.735430+0000","last_became_active":"2023-08-17T17:53:18.735111+0000","last_became_peered":"2023-08-17T17:53:18.735111+0000","last_unstale":"2023-08-17T17:53:18.735430+0000","last_undegraded":"2023-08-17T17:53:18.735430+0000","last_fullsized":"2023-08-17T17:53:18.735430+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370930+0000","last_change":"2023-08-17T17:53:18.366808+0000","last_active":"2023-08-17T17:53:18.370930+0000","last_peered":"2023-08-17T17:53:18.370930+0000","last_clean":"2023-08-17T17:53:18.370930+0000","last_became_active":"2023-08-17T17:53:18.366609+0000","last_became_peered":"2023-08-17T17:53:18.366609+0000","last_unstale":"2023-08-17T17:53:18.370930+0000","last_undegraded":"2023-08-17T17:53:18.370930+0000","last_fullsized":"2023-08-17T17:53:18.370930+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738513+0000","last_change":"2023-08-17T17:53:18.738513+0000","last_active":"2023-08-17T17:53:18.738513+0000","last_peered":"2023-08-17T17:53:18.738513+0000","last_clean":"2023-08-17T17:53:18.738513+0000","last_became_active":"2023-08-17T17:53:18.738272+0000","last_became_peered":"2023-08-17T17:53:18.738272+0000","last_unstale":"2023-08-17T17:53:18.738513+0000","last_undegraded":"2023-08-17T17:53:18.738513+0000","last_fullsized":"2023-08-17T17:53:18.738513+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.376653+0000","last_change":"2023-08-17T17:53:18.368296+0000","last_active":"2023-08-17T17:53:18.376653+0000","last_peered":"2023-08-17T17:53:18.376653+0000","last_clean":"2023-08-17T17:53:18.376653+0000","last_became_active":"2023-08-17T17:53:18.366638+0000","last_became_peered":"2023-08-17T17:53:18.366638+0000","last_unstale":"2023-08-17T17:53:18.376653+0000","last_undegraded":"2023-08-17T17:53:18.376653+0000","last_fullsized":"2023-08-17T17:53:18.376653+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733325+0000","last_change":"2023-08-17T17:53:18.733325+0000","last_active":"2023-08-17T17:53:18.733325+0000","last_peered":"2023-08-17T17:53:18.733325+0000","last_clean":"2023-08-17T17:53:18.733325+0000","last_became_active":"2023-08-17T17:53:18.733023+0000","last_became_peered":"2023-08-17T17:53:18.733023+0000","last_unstale":"2023-08-17T17:53:18.733325+0000","last_undegraded":"2023-08-17T17:53:18.733325+0000","last_fullsized":"2023-08-17T17:53:18.733325+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.372105+0000","last_change":"2023-08-17T17:53:18.361563+0000","last_active":"2023-08-17T17:53:18.372105+0000","last_peered":"2023-08-17T17:53:18.372105+0000","last_clean":"2023-08-17T17:53:18.372105+0000","last_became_active":"2023-08-17T17:53:18.361260+0000","last_became_peered":"2023-08-17T17:53:18.361260+0000","last_unstale":"2023-08-17T17:53:18.372105+0000","last_undegraded":"2023-08-17T17:53:18.372105+0000","last_fullsized":"2023-08-17T17:53:18.372105+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732243+0000","last_change":"2023-08-17T17:53:18.732243+0000","last_active":"2023-08-17T17:53:18.732243+0000","last_peered":"2023-08-17T17:53:18.732243+0000","last_clean":"2023-08-17T17:53:18.732243+0000","last_became_active":"2023-08-17T17:53:18.731980+0000","last_became_peered":"2023-08-17T17:53:18.731980+0000","last_unstale":"2023-08-17T17:53:18.732243+0000","last_undegraded":"2023-08-17T17:53:18.732243+0000","last_fullsized":"2023-08-17T17:53:18.732243+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367927+0000","last_change":"2023-08-17T17:53:18.360923+0000","last_active":"2023-08-17T17:53:18.367927+0000","last_peered":"2023-08-17T17:53:18.367927+0000","last_clean":"2023-08-17T17:53:18.367927+0000","last_became_active":"2023-08-17T17:53:18.359861+0000","last_became_peered":"2023-08-17T17:53:18.359861+0000","last_unstale":"2023-08-17T17:53:18.367927+0000","last_undegraded":"2023-08-17T17:53:18.367927+0000","last_fullsized":"2023-08-17T17:53:18.367927+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730420+0000","last_change":"2023-08-17T17:53:18.730420+0000","last_active":"2023-08-17T17:53:18.730420+0000","last_peered":"2023-08-17T17:53:18.730420+0000","last_clean":"2023-08-17T17:53:18.730420+0000","last_became_active":"2023-08-17T17:53:18.730141+0000","last_became_peered":"2023-08-17T17:53:18.730141+0000","last_unstale":"2023-08-17T17:53:18.730420+0000","last_undegraded":"2023-08-17T17:53:18.730420+0000","last_fullsized":"2023-08-17T17:53:18.730420+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"134'4","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.740001+0000","last_change":"2023-08-17T17:53:18.365404+0000","last_active":"2023-08-17T17:53:18.740001+0000","last_peered":"2023-08-17T17:53:18.740001+0000","last_clean":"2023-08-17T17:53:18.740001+0000","last_became_active":"2023-08-17T17:53:18.365054+0000","last_became_peered":"2023-08-17T17:53:18.365054+0000","last_unstale":"2023-08-17T17:53:18.740001+0000","last_undegraded":"2023-08-17T17:53:18.740001+0000","last_fullsized":"2023-08-17T17:53:18.740001+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.742043+0000","last_change":"2023-08-17T17:53:18.742043+0000","last_active":"2023-08-17T17:53:18.742043+0000","last_peered":"2023-08-17T17:53:18.742043+0000","last_clean":"2023-08-17T17:53:18.742043+0000","last_became_active":"2023-08-17T17:53:18.741560+0000","last_became_peered":"2023-08-17T17:53:18.741560+0000","last_unstale":"2023-08-17T17:53:18.742043+0000","last_undegraded":"2023-08-17T17:53:18.742043+0000","last_fullsized":"2023-08-17T17:53:18.742043+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.715612+0000","last_change":"2023-08-17T17:53:18.365671+0000","last_active":"2023-08-17T17:53:18.715612+0000","last_peered":"2023-08-17T17:53:18.715612+0000","last_clean":"2023-08-17T17:53:18.715612+0000","last_became_active":"2023-08-17T17:53:18.365383+0000","last_became_peered":"2023-08-17T17:53:18.365383+0000","last_unstale":"2023-08-17T17:53:18.715612+0000","last_undegraded":"2023-08-17T17:53:18.715612+0000","last_fullsized":"2023-08-17T17:53:18.715612+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733321+0000","last_change":"2023-08-17T17:53:18.733321+0000","last_active":"2023-08-17T17:53:18.733321+0000","last_peered":"2023-08-17T17:53:18.733321+0000","last_clean":"2023-08-17T17:53:18.733321+0000","last_became_active":"2023-08-17T17:53:18.732601+0000","last_became_peered":"2023-08-17T17:53:18.732601+0000","last_unstale":"2023-08-17T17:53:18.733321+0000","last_undegraded":"2023-08-17T17:53:18.733321+0000","last_fullsized":"2023-08-17T17:53:18.733321+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368626+0000","last_change":"2023-08-17T17:53:18.364597+0000","last_active":"2023-08-17T17:53:18.368626+0000","last_peered":"2023-08-17T17:53:18.368626+0000","last_clean":"2023-08-17T17:53:18.368626+0000","last_became_active":"2023-08-17T17:53:18.364238+0000","last_became_peered":"2023-08-17T17:53:18.364238+0000","last_unstale":"2023-08-17T17:53:18.368626+0000","last_undegraded":"2023-08-17T17:53:18.368626+0000","last_fullsized":"2023-08-17T17:53:18.368626+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738321+0000","last_change":"2023-08-17T17:53:18.738321+0000","last_active":"2023-08-17T17:53:18.738321+0000","last_peered":"2023-08-17T17:53:18.738321+0000","last_clean":"2023-08-17T17:53:18.738321+0000","last_became_active":"2023-08-17T17:53:18.736435+0000","last_became_peered":"2023-08-17T17:53:18.736435+0000","last_unstale":"2023-08-17T17:53:18.738321+0000","last_undegraded":"2023-08-17T17:53:18.738321+0000","last_fullsized":"2023-08-17T17:53:18.738321+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368769+0000","last_change":"2023-08-17T17:53:18.363445+0000","last_active":"2023-08-17T17:53:18.368769+0000","last_peered":"2023-08-17T17:53:18.368769+0000","last_clean":"2023-08-17T17:53:18.368769+0000","last_became_active":"2023-08-17T17:53:18.362848+0000","last_became_peered":"2023-08-17T17:53:18.362848+0000","last_unstale":"2023-08-17T17:53:18.368769+0000","last_undegraded":"2023-08-17T17:53:18.368769+0000","last_fullsized":"2023-08-17T17:53:18.368769+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733265+0000","last_change":"2023-08-17T17:53:18.733265+0000","last_active":"2023-08-17T17:53:18.733265+0000","last_peered":"2023-08-17T17:53:18.733265+0000","last_clean":"2023-08-17T17:53:18.733265+0000","last_became_active":"2023-08-17T17:53:18.732632+0000","last_became_peered":"2023-08-17T17:53:18.732632+0000","last_unstale":"2023-08-17T17:53:18.733265+0000","last_undegraded":"2023-08-17T17:53:18.733265+0000","last_fullsized":"2023-08-17T17:53:18.733265+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"134'4","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.741952+0000","last_change":"2023-08-17T17:53:18.370921+0000","last_active":"2023-08-17T17:53:18.741952+0000","last_peered":"2023-08-17T17:53:18.741952+0000","last_clean":"2023-08-17T17:53:18.741952+0000","last_became_active":"2023-08-17T17:53:18.370195+0000","last_became_peered":"2023-08-17T17:53:18.370195+0000","last_unstale":"2023-08-17T17:53:18.741952+0000","last_undegraded":"2023-08-17T17:53:18.741952+0000","last_fullsized":"2023-08-17T17:53:18.741952+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730829+0000","last_change":"2023-08-17T17:53:18.730829+0000","last_active":"2023-08-17T17:53:18.730829+0000","last_peered":"2023-08-17T17:53:18.730829+0000","last_clean":"2023-08-17T17:53:18.730829+0000","last_became_active":"2023-08-17T17:53:18.730158+0000","last_became_peered":"2023-08-17T17:53:18.730158+0000","last_unstale":"2023-08-17T17:53:18.730829+0000","last_undegraded":"2023-08-17T17:53:18.730829+0000","last_fullsized":"2023-08-17T17:53:18.730829+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367778+0000","last_change":"2023-08-17T17:53:18.361219+0000","last_active":"2023-08-17T17:53:18.367778+0000","last_peered":"2023-08-17T17:53:18.367778+0000","last_clean":"2023-08-17T17:53:18.367778+0000","last_became_active":"2023-08-17T17:53:18.361002+0000","last_became_peered":"2023-08-17T17:53:18.361002+0000","last_unstale":"2023-08-17T17:53:18.367778+0000","last_undegraded":"2023-08-17T17:53:18.367778+0000","last_fullsized":"2023-08-17T17:53:18.367778+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733395+0000","last_change":"2023-08-17T17:53:18.733395+0000","last_active":"2023-08-17T17:53:18.733395+0000","last_peered":"2023-08-17T17:53:18.733395+0000","last_clean":"2023-08-17T17:53:18.733395+0000","last_became_active":"2023-08-17T17:53:18.733119+0000","last_became_peered":"2023-08-17T17:53:18.733119+0000","last_unstale":"2023-08-17T17:53:18.733395+0000","last_undegraded":"2023-08-17T17:53:18.733395+0000","last_fullsized":"2023-08-17T17:53:18.733395+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.365848+0000","last_change":"2023-08-17T17:53:18.359326+0000","last_active":"2023-08-17T17:53:18.365848+0000","last_peered":"2023-08-17T17:53:18.365848+0000","last_clean":"2023-08-17T17:53:18.365848+0000","last_became_active":"2023-08-17T17:53:18.358628+0000","last_became_peered":"2023-08-17T17:53:18.358628+0000","last_unstale":"2023-08-17T17:53:18.365848+0000","last_undegraded":"2023-08-17T17:53:18.365848+0000","last_fullsized":"2023-08-17T17:53:18.365848+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.739769+0000","last_change":"2023-08-17T17:53:18.739769+0000","last_active":"2023-08-17T17:53:18.739769+0000","last_peered":"2023-08-17T17:53:18.739769+0000","last_clean":"2023-08-17T17:53:18.739769+0000","last_became_active":"2023-08-17T17:53:18.739164+0000","last_became_peered":"2023-08-17T17:53:18.739164+0000","last_unstale":"2023-08-17T17:53:18.739769+0000","last_undegraded":"2023-08-17T17:53:18.739769+0000","last_fullsized":"2023-08-17T17:53:18.739769+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.716308+0000","last_change":"2023-08-17T17:53:18.365512+0000","last_active":"2023-08-17T17:53:18.716308+0000","last_peered":"2023-08-17T17:53:18.716308+0000","last_clean":"2023-08-17T17:53:18.716308+0000","last_became_active":"2023-08-17T17:53:18.364541+0000","last_became_peered":"2023-08-17T17:53:18.364541+0000","last_unstale":"2023-08-17T17:53:18.716308+0000","last_undegraded":"2023-08-17T17:53:18.716308+0000","last_fullsized":"2023-08-17T17:53:18.716308+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732957+0000","last_change":"2023-08-17T17:53:18.732957+0000","last_active":"2023-08-17T17:53:18.732957+0000","last_peered":"2023-08-17T17:53:18.732957+0000","last_clean":"2023-08-17T17:53:18.732957+0000","last_became_active":"2023-08-17T17:53:18.732694+0000","last_became_peered":"2023-08-17T17:53:18.732694+0000","last_unstale":"2023-08-17T17:53:18.732957+0000","last_undegraded":"2023-08-17T17:53:18.732957+0000","last_fullsized":"2023-08-17T17:53:18.732957+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368490+0000","last_change":"2023-08-17T17:53:18.362569+0000","last_active":"2023-08-17T17:53:18.368490+0000","last_peered":"2023-08-17T17:53:18.368490+0000","last_clean":"2023-08-17T17:53:18.368490+0000","last_became_active":"2023-08-17T17:53:18.362281+0000","last_became_peered":"2023-08-17T17:53:18.362281+0000","last_unstale":"2023-08-17T17:53:18.368490+0000","last_undegraded":"2023-08-17T17:53:18.368490+0000","last_fullsized":"2023-08-17T17:53:18.368490+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735844+0000","last_change":"2023-08-17T17:53:18.735844+0000","last_active":"2023-08-17T17:53:18.735844+0000","last_peered":"2023-08-17T17:53:18.735844+0000","last_clean":"2023-08-17T17:53:18.735844+0000","last_became_active":"2023-08-17T17:53:18.735550+0000","last_became_peered":"2023-08-17T17:53:18.735550+0000","last_unstale":"2023-08-17T17:53:18.735844+0000","last_undegraded":"2023-08-17T17:53:18.735844+0000","last_fullsized":"2023-08-17T17:53:18.735844+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.722530+0000","last_change":"2023-08-17T17:53:18.356949+0000","last_active":"2023-08-17T17:53:18.722530+0000","last_peered":"2023-08-17T17:53:18.722530+0000","last_clean":"2023-08-17T17:53:18.722530+0000","last_became_active":"2023-08-17T17:53:18.356612+0000","last_became_peered":"2023-08-17T17:53:18.356612+0000","last_unstale":"2023-08-17T17:53:18.722530+0000","last_undegraded":"2023-08-17T17:53:18.722530+0000","last_fullsized":"2023-08-17T17:53:18.722530+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.729696+0000","last_change":"2023-08-17T17:53:18.729696+0000","last_active":"2023-08-17T17:53:18.729696+0000","last_peered":"2023-08-17T17:53:18.729696+0000","last_clean":"2023-08-17T17:53:18.729696+0000","last_became_active":"2023-08-17T17:53:18.729398+0000","last_became_peered":"2023-08-17T17:53:18.729398+0000","last_unstale":"2023-08-17T17:53:18.729696+0000","last_undegraded":"2023-08-17T17:53:18.729696+0000","last_fullsized":"2023-08-17T17:53:18.729696+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.369585+0000","last_change":"2023-08-17T17:53:18.367656+0000","last_active":"2023-08-17T17:53:18.369585+0000","last_peered":"2023-08-17T17:53:18.369585+0000","last_clean":"2023-08-17T17:53:18.369585+0000","last_became_active":"2023-08-17T17:53:18.366209+0000","last_became_peered":"2023-08-17T17:53:18.366209+0000","last_unstale":"2023-08-17T17:53:18.369585+0000","last_undegraded":"2023-08-17T17:53:18.369585+0000","last_fullsized":"2023-08-17T17:53:18.369585+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730906+0000","last_change":"2023-08-17T17:53:18.730906+0000","last_active":"2023-08-17T17:53:18.730906+0000","last_peered":"2023-08-17T17:53:18.730906+0000","last_clean":"2023-08-17T17:53:18.730906+0000","last_became_active":"2023-08-17T17:53:18.730600+0000","last_became_peered":"2023-08-17T17:53:18.730600+0000","last_unstale":"2023-08-17T17:53:18.730906+0000","last_undegraded":"2023-08-17T17:53:18.730906+0000","last_fullsized":"2023-08-17T17:53:18.730906+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367958+0000","last_change":"2023-08-17T17:53:18.362831+0000","last_active":"2023-08-17T17:53:18.367958+0000","last_peered":"2023-08-17T17:53:18.367958+0000","last_clean":"2023-08-17T17:53:18.367958+0000","last_became_active":"2023-08-17T17:53:18.362546+0000","last_became_peered":"2023-08-17T17:53:18.362546+0000","last_unstale":"2023-08-17T17:53:18.367958+0000","last_undegraded":"2023-08-17T17:53:18.367958+0000","last_fullsized":"2023-08-17T17:53:18.367958+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731466+0000","last_change":"2023-08-17T17:53:18.731466+0000","last_active":"2023-08-17T17:53:18.731466+0000","last_peered":"2023-08-17T17:53:18.731466+0000","last_clean":"2023-08-17T17:53:18.731466+0000","last_became_active":"2023-08-17T17:53:18.731078+0000","last_became_peered":"2023-08-17T17:53:18.731078+0000","last_unstale":"2023-08-17T17:53:18.731466+0000","last_undegraded":"2023-08-17T17:53:18.731466+0000","last_fullsized":"2023-08-17T17:53:18.731466+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.369091+0000","last_change":"2023-08-17T17:53:18.365288+0000","last_active":"2023-08-17T17:53:18.369091+0000","last_peered":"2023-08-17T17:53:18.369091+0000","last_clean":"2023-08-17T17:53:18.369091+0000","last_became_active":"2023-08-17T17:53:18.364730+0000","last_became_peered":"2023-08-17T17:53:18.364730+0000","last_unstale":"2023-08-17T17:53:18.369091+0000","last_undegraded":"2023-08-17T17:53:18.369091+0000","last_fullsized":"2023-08-17T17:53:18.369091+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732416+0000","last_change":"2023-08-17T17:53:18.732416+0000","last_active":"2023-08-17T17:53:18.732416+0000","last_peered":"2023-08-17T17:53:18.732416+0000","last_clean":"2023-08-17T17:53:18.732416+0000","last_became_active":"2023-08-17T17:53:18.732114+0000","last_became_peered":"2023-08-17T17:53:18.732114+0000","last_unstale":"2023-08-17T17:53:18.732416+0000","last_undegraded":"2023-08-17T17:53:18.732416+0000","last_fullsized":"2023-08-17T17:53:18.732416+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367802+0000","last_change":"2023-08-17T17:53:18.361359+0000","last_active":"2023-08-17T17:53:18.367802+0000","last_peered":"2023-08-17T17:53:18.367802+0000","last_clean":"2023-08-17T17:53:18.367802+0000","last_became_active":"2023-08-17T17:53:18.361121+0000","last_became_peered":"2023-08-17T17:53:18.361121+0000","last_unstale":"2023-08-17T17:53:18.367802+0000","last_undegraded":"2023-08-17T17:53:18.367802+0000","last_fullsized":"2023-08-17T17:53:18.367802+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.728542+0000","last_change":"2023-08-17T17:53:18.728542+0000","last_active":"2023-08-17T17:53:18.728542+0000","last_peered":"2023-08-17T17:53:18.728542+0000","last_clean":"2023-08-17T17:53:18.728542+0000","last_became_active":"2023-08-17T17:53:18.728239+0000","last_became_peered":"2023-08-17T17:53:18.728239+0000","last_unstale":"2023-08-17T17:53:18.728542+0000","last_undegraded":"2023-08-17T17:53:18.728542+0000","last_fullsized":"2023-08-17T17:53:18.728542+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.371291+0000","last_change":"2023-08-17T17:53:18.358905+0000","last_active":"2023-08-17T17:53:18.371291+0000","last_peered":"2023-08-17T17:53:18.371291+0000","last_clean":"2023-08-17T17:53:18.371291+0000","last_became_active":"2023-08-17T17:53:18.358614+0000","last_became_peered":"2023-08-17T17:53:18.358614+0000","last_unstale":"2023-08-17T17:53:18.371291+0000","last_undegraded":"2023-08-17T17:53:18.371291+0000","last_fullsized":"2023-08-17T17:53:18.371291+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.737560+0000","last_change":"2023-08-17T17:53:18.737560+0000","last_active":"2023-08-17T17:53:18.737560+0000","last_peered":"2023-08-17T17:53:18.737560+0000","last_clean":"2023-08-17T17:53:18.737560+0000","last_became_active":"2023-08-17T17:53:18.737298+0000","last_became_peered":"2023-08-17T17:53:18.737298+0000","last_unstale":"2023-08-17T17:53:18.737560+0000","last_undegraded":"2023-08-17T17:53:18.737560+0000","last_fullsized":"2023-08-17T17:53:18.737560+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.376615+0000","last_change":"2023-08-17T17:53:18.371496+0000","last_active":"2023-08-17T17:53:18.376615+0000","last_peered":"2023-08-17T17:53:18.376615+0000","last_clean":"2023-08-17T17:53:18.376615+0000","last_became_active":"2023-08-17T17:53:18.371200+0000","last_became_peered":"2023-08-17T17:53:18.371200+0000","last_unstale":"2023-08-17T17:53:18.376615+0000","last_undegraded":"2023-08-17T17:53:18.376615+0000","last_fullsized":"2023-08-17T17:53:18.376615+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738172+0000","last_change":"2023-08-17T17:53:18.738172+0000","last_active":"2023-08-17T17:53:18.738172+0000","last_peered":"2023-08-17T17:53:18.738172+0000","last_clean":"2023-08-17T17:53:18.738172+0000","last_became_active":"2023-08-17T17:53:18.737960+0000","last_became_peered":"2023-08-17T17:53:18.737960+0000","last_unstale":"2023-08-17T17:53:18.738172+0000","last_undegraded":"2023-08-17T17:53:18.738172+0000","last_fullsized":"2023-08-17T17:53:18.738172+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367845+0000","last_change":"2023-08-17T17:53:18.359352+0000","last_active":"2023-08-17T17:53:18.367845+0000","last_peered":"2023-08-17T17:53:18.367845+0000","last_clean":"2023-08-17T17:53:18.367845+0000","last_became_active":"2023-08-17T17:53:18.359051+0000","last_became_peered":"2023-08-17T17:53:18.359051+0000","last_unstale":"2023-08-17T17:53:18.367845+0000","last_undegraded":"2023-08-17T17:53:18.367845+0000","last_fullsized":"2023-08-17T17:53:18.367845+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735902+0000","last_change":"2023-08-17T17:53:18.735902+0000","last_active":"2023-08-17T17:53:18.735902+0000","last_peered":"2023-08-17T17:53:18.735902+0000","last_clean":"2023-08-17T17:53:18.735902+0000","last_became_active":"2023-08-17T17:53:18.735542+0000","last_became_peered":"2023-08-17T17:53:18.735542+0000","last_unstale":"2023-08-17T17:53:18.735902+0000","last_undegraded":"2023-08-17T17:53:18.735902+0000","last_fullsized":"2023-08-17T17:53:18.735902+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368005+0000","last_change":"2023-08-17T17:53:18.363363+0000","last_active":"2023-08-17T17:53:18.368005+0000","last_peered":"2023-08-17T17:53:18.368005+0000","last_clean":"2023-08-17T17:53:18.368005+0000","last_became_active":"2023-08-17T17:53:18.363054+0000","last_became_peered":"2023-08-17T17:53:18.363054+0000","last_unstale":"2023-08-17T17:53:18.368005+0000","last_undegraded":"2023-08-17T17:53:18.368005+0000","last_fullsized":"2023-08-17T17:53:18.368005+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731836+0000","last_change":"2023-08-17T17:53:18.731836+0000","last_active":"2023-08-17T17:53:18.731836+0000","last_peered":"2023-08-17T17:53:18.731836+0000","last_clean":"2023-08-17T17:53:18.731836+0000","last_became_active":"2023-08-17T17:53:18.731503+0000","last_became_peered":"2023-08-17T17:53:18.731503+0000","last_unstale":"2023-08-17T17:53:18.731836+0000","last_undegraded":"2023-08-17T17:53:18.731836+0000","last_fullsized":"2023-08-17T17:53:18.731836+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.363351+0000","last_change":"2023-08-17T17:53:18.357741+0000","last_active":"2023-08-17T17:53:18.363351+0000","last_peered":"2023-08-17T17:53:18.363351+0000","last_clean":"2023-08-17T17:53:18.363351+0000","last_became_active":"2023-08-17T17:53:18.357456+0000","last_became_peered":"2023-08-17T17:53:18.357456+0000","last_unstale":"2023-08-17T17:53:18.363351+0000","last_undegraded":"2023-08-17T17:53:18.363351+0000","last_fullsized":"2023-08-17T17:53:18.363351+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.739530+0000","last_change":"2023-08-17T17:53:18.739530+0000","last_active":"2023-08-17T17:53:18.739530+0000","last_peered":"2023-08-17T17:53:18.739530+0000","last_clean":"2023-08-17T17:53:18.739530+0000","last_became_active":"2023-08-17T17:53:18.739248+0000","last_became_peered":"2023-08-17T17:53:18.739248+0000","last_unstale":"2023-08-17T17:53:18.739530+0000","last_undegraded":"2023-08-17T17:53:18.739530+0000","last_fullsized":"2023-08-17T17:53:18.739530+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.376671+0000","last_change":"2023-08-17T17:53:18.364749+0000","last_active":"2023-08-17T17:53:18.376671+0000","last_peered":"2023-08-17T17:53:18.376671+0000","last_clean":"2023-08-17T17:53:18.376671+0000","last_became_active":"2023-08-17T17:53:18.363739+0000","last_became_peered":"2023-08-17T17:53:18.363739+0000","last_unstale":"2023-08-17T17:53:18.376671+0000","last_undegraded":"2023-08-17T17:53:18.376671+0000","last_fullsized":"2023-08-17T17:53:18.376671+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733482+0000","last_change":"2023-08-17T17:53:18.733482+0000","last_active":"2023-08-17T17:53:18.733482+0000","last_peered":"2023-08-17T17:53:18.733482+0000","last_clean":"2023-08-17T17:53:18.733482+0000","last_became_active":"2023-08-17T17:53:18.733188+0000","last_became_peered":"2023-08-17T17:53:18.733188+0000","last_unstale":"2023-08-17T17:53:18.733482+0000","last_undegraded":"2023-08-17T17:53:18.733482+0000","last_fullsized":"2023-08-17T17:53:18.733482+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.369141+0000","last_change":"2023-08-17T17:53:18.363880+0000","last_active":"2023-08-17T17:53:18.369141+0000","last_peered":"2023-08-17T17:53:18.369141+0000","last_clean":"2023-08-17T17:53:18.369141+0000","last_became_active":"2023-08-17T17:53:18.363575+0000","last_became_peered":"2023-08-17T17:53:18.363575+0000","last_unstale":"2023-08-17T17:53:18.369141+0000","last_undegraded":"2023-08-17T17:53:18.369141+0000","last_fullsized":"2023-08-17T17:53:18.369141+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730217+0000","last_change":"2023-08-17T17:53:18.730217+0000","last_active":"2023-08-17T17:53:18.730217+0000","last_peered":"2023-08-17T17:53:18.730217+0000","last_clean":"2023-08-17T17:53:18.730217+0000","last_became_active":"2023-08-17T17:53:18.729947+0000","last_became_peered":"2023-08-17T17:53:18.729947+0000","last_unstale":"2023-08-17T17:53:18.730217+0000","last_undegraded":"2023-08-17T17:53:18.730217+0000","last_fullsized":"2023-08-17T17:53:18.730217+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.720372+0000","last_change":"2023-08-17T17:53:18.362887+0000","last_active":"2023-08-17T17:53:18.720372+0000","last_peered":"2023-08-17T17:53:18.720372+0000","last_clean":"2023-08-17T17:53:18.720372+0000","last_became_active":"2023-08-17T17:53:18.362613+0000","last_became_peered":"2023-08-17T17:53:18.362613+0000","last_unstale":"2023-08-17T17:53:18.720372+0000","last_undegraded":"2023-08-17T17:53:18.720372+0000","last_fullsized":"2023-08-17T17:53:18.720372+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.734743+0000","last_change":"2023-08-17T17:53:18.734743+0000","last_active":"2023-08-17T17:53:18.734743+0000","last_peered":"2023-08-17T17:53:18.734743+0000","last_clean":"2023-08-17T17:53:18.734743+0000","last_became_active":"2023-08-17T17:53:18.734464+0000","last_became_peered":"2023-08-17T17:53:18.734464+0000","last_unstale":"2023-08-17T17:53:18.734743+0000","last_undegraded":"2023-08-17T17:53:18.734743+0000","last_fullsized":"2023-08-17T17:53:18.734743+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.717249+0000","last_change":"2023-08-17T17:53:18.364959+0000","last_active":"2023-08-17T17:53:18.717249+0000","last_peered":"2023-08-17T17:53:18.717249+0000","last_clean":"2023-08-17T17:53:18.717249+0000","last_became_active":"2023-08-17T17:53:18.364479+0000","last_became_peered":"2023-08-17T17:53:18.364479+0000","last_unstale":"2023-08-17T17:53:18.717249+0000","last_undegraded":"2023-08-17T17:53:18.717249+0000","last_fullsized":"2023-08-17T17:53:18.717249+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.742773+0000","last_change":"2023-08-17T17:53:18.742773+0000","last_active":"2023-08-17T17:53:18.742773+0000","last_peered":"2023-08-17T17:53:18.742773+0000","last_clean":"2023-08-17T17:53:18.742773+0000","last_became_active":"2023-08-17T17:53:18.742491+0000","last_became_peered":"2023-08-17T17:53:18.742491+0000","last_unstale":"2023-08-17T17:53:18.742773+0000","last_undegraded":"2023-08-17T17:53:18.742773+0000","last_fullsized":"2023-08-17T17:53:18.742773+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"134'2","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736596+0000","last_change":"2023-08-17T17:53:18.365556+0000","last_active":"2023-08-17T17:53:18.736596+0000","last_peered":"2023-08-17T17:53:18.736596+0000","last_clean":"2023-08-17T17:53:18.736596+0000","last_became_active":"2023-08-17T17:53:18.364887+0000","last_became_peered":"2023-08-17T17:53:18.364887+0000","last_unstale":"2023-08-17T17:53:18.736596+0000","last_undegraded":"2023-08-17T17:53:18.736596+0000","last_fullsized":"2023-08-17T17:53:18.736596+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730598+0000","last_change":"2023-08-17T17:53:18.730598+0000","last_active":"2023-08-17T17:53:18.730598+0000","last_peered":"2023-08-17T17:53:18.730598+0000","last_clean":"2023-08-17T17:53:18.730598+0000","last_became_active":"2023-08-17T17:53:18.730286+0000","last_became_peered":"2023-08-17T17:53:18.730286+0000","last_unstale":"2023-08-17T17:53:18.730598+0000","last_undegraded":"2023-08-17T17:53:18.730598+0000","last_fullsized":"2023-08-17T17:53:18.730598+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.369480+0000","last_change":"2023-08-17T17:53:18.365502+0000","last_active":"2023-08-17T17:53:18.369480+0000","last_peered":"2023-08-17T17:53:18.369480+0000","last_clean":"2023-08-17T17:53:18.369480+0000","last_became_active":"2023-08-17T17:53:18.365169+0000","last_became_peered":"2023-08-17T17:53:18.365169+0000","last_unstale":"2023-08-17T17:53:18.369480+0000","last_undegraded":"2023-08-17T17:53:18.369480+0000","last_fullsized":"2023-08-17T17:53:18.369480+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736983+0000","last_change":"2023-08-17T17:53:18.736983+0000","last_active":"2023-08-17T17:53:18.736983+0000","last_peered":"2023-08-17T17:53:18.736983+0000","last_clean":"2023-08-17T17:53:18.736983+0000","last_became_active":"2023-08-17T17:53:18.736687+0000","last_became_peered":"2023-08-17T17:53:18.736687+0000","last_unstale":"2023-08-17T17:53:18.736983+0000","last_undegraded":"2023-08-17T17:53:18.736983+0000","last_fullsized":"2023-08-17T17:53:18.736983+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370351+0000","last_change":"2023-08-17T17:53:18.366846+0000","last_active":"2023-08-17T17:53:18.370351+0000","last_peered":"2023-08-17T17:53:18.370351+0000","last_clean":"2023-08-17T17:53:18.370351+0000","last_became_active":"2023-08-17T17:53:18.366513+0000","last_became_peered":"2023-08-17T17:53:18.366513+0000","last_unstale":"2023-08-17T17:53:18.370351+0000","last_undegraded":"2023-08-17T17:53:18.370351+0000","last_fullsized":"2023-08-17T17:53:18.370351+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730576+0000","last_change":"2023-08-17T17:53:18.730576+0000","last_active":"2023-08-17T17:53:18.730576+0000","last_peered":"2023-08-17T17:53:18.730576+0000","last_clean":"2023-08-17T17:53:18.730576+0000","last_became_active":"2023-08-17T17:53:18.730271+0000","last_became_peered":"2023-08-17T17:53:18.730271+0000","last_unstale":"2023-08-17T17:53:18.730576+0000","last_undegraded":"2023-08-17T17:53:18.730576+0000","last_fullsized":"2023-08-17T17:53:18.730576+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.372023+0000","last_change":"2023-08-17T17:53:18.360902+0000","last_active":"2023-08-17T17:53:18.372023+0000","last_peered":"2023-08-17T17:53:18.372023+0000","last_clean":"2023-08-17T17:53:18.372023+0000","last_became_active":"2023-08-17T17:53:18.360360+0000","last_became_peered":"2023-08-17T17:53:18.360360+0000","last_unstale":"2023-08-17T17:53:18.372023+0000","last_undegraded":"2023-08-17T17:53:18.372023+0000","last_fullsized":"2023-08-17T17:53:18.372023+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.734873+0000","last_change":"2023-08-17T17:53:18.734873+0000","last_active":"2023-08-17T17:53:18.734873+0000","last_peered":"2023-08-17T17:53:18.734873+0000","last_clean":"2023-08-17T17:53:18.734873+0000","last_became_active":"2023-08-17T17:53:18.734610+0000","last_became_peered":"2023-08-17T17:53:18.734610+0000","last_unstale":"2023-08-17T17:53:18.734873+0000","last_undegraded":"2023-08-17T17:53:18.734873+0000","last_fullsized":"2023-08-17T17:53:18.734873+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.363081+0000","last_change":"2023-08-17T17:53:18.358641+0000","last_active":"2023-08-17T17:53:18.363081+0000","last_peered":"2023-08-17T17:53:18.363081+0000","last_clean":"2023-08-17T17:53:18.363081+0000","last_became_active":"2023-08-17T17:53:18.358368+0000","last_became_peered":"2023-08-17T17:53:18.358368+0000","last_unstale":"2023-08-17T17:53:18.363081+0000","last_undegraded":"2023-08-17T17:53:18.363081+0000","last_fullsized":"2023-08-17T17:53:18.363081+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731915+0000","last_change":"2023-08-17T17:53:18.731915+0000","last_active":"2023-08-17T17:53:18.731915+0000","last_peered":"2023-08-17T17:53:18.731915+0000","last_clean":"2023-08-17T17:53:18.731915+0000","last_became_active":"2023-08-17T17:53:18.731637+0000","last_became_peered":"2023-08-17T17:53:18.731637+0000","last_unstale":"2023-08-17T17:53:18.731915+0000","last_undegraded":"2023-08-17T17:53:18.731915+0000","last_fullsized":"2023-08-17T17:53:18.731915+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.379157+0000","last_change":"2023-08-17T17:53:18.371693+0000","last_active":"2023-08-17T17:53:18.379157+0000","last_peered":"2023-08-17T17:53:18.379157+0000","last_clean":"2023-08-17T17:53:18.379157+0000","last_became_active":"2023-08-17T17:53:18.370599+0000","last_became_peered":"2023-08-17T17:53:18.370599+0000","last_unstale":"2023-08-17T17:53:18.379157+0000","last_undegraded":"2023-08-17T17:53:18.379157+0000","last_fullsized":"2023-08-17T17:53:18.379157+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.742086+0000","last_change":"2023-08-17T17:53:18.742086+0000","last_active":"2023-08-17T17:53:18.742086+0000","last_peered":"2023-08-17T17:53:18.742086+0000","last_clean":"2023-08-17T17:53:18.742086+0000","last_became_active":"2023-08-17T17:53:18.741784+0000","last_became_peered":"2023-08-17T17:53:18.741784+0000","last_unstale":"2023-08-17T17:53:18.742086+0000","last_undegraded":"2023-08-17T17:53:18.742086+0000","last_fullsized":"2023-08-17T17:53:18.742086+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.716909+0000","last_change":"2023-08-17T17:53:18.363234+0000","last_active":"2023-08-17T17:53:18.716909+0000","last_peered":"2023-08-17T17:53:18.716909+0000","last_clean":"2023-08-17T17:53:18.716909+0000","last_became_active":"2023-08-17T17:53:18.362966+0000","last_became_peered":"2023-08-17T17:53:18.362966+0000","last_unstale":"2023-08-17T17:53:18.716909+0000","last_undegraded":"2023-08-17T17:53:18.716909+0000","last_fullsized":"2023-08-17T17:53:18.716909+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733209+0000","last_change":"2023-08-17T17:53:18.733209+0000","last_active":"2023-08-17T17:53:18.733209+0000","last_peered":"2023-08-17T17:53:18.733209+0000","last_clean":"2023-08-17T17:53:18.733209+0000","last_became_active":"2023-08-17T17:53:18.732718+0000","last_became_peered":"2023-08-17T17:53:18.732718+0000","last_unstale":"2023-08-17T17:53:18.733209+0000","last_undegraded":"2023-08-17T17:53:18.733209+0000","last_fullsized":"2023-08-17T17:53:18.733209+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"134'2","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.742637+0000","last_change":"2023-08-17T17:53:18.372373+0000","last_active":"2023-08-17T17:53:18.742637+0000","last_peered":"2023-08-17T17:53:18.742637+0000","last_clean":"2023-08-17T17:53:18.742637+0000","last_became_active":"2023-08-17T17:53:18.371650+0000","last_became_peered":"2023-08-17T17:53:18.371650+0000","last_unstale":"2023-08-17T17:53:18.742637+0000","last_undegraded":"2023-08-17T17:53:18.742637+0000","last_fullsized":"2023-08-17T17:53:18.742637+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735961+0000","last_change":"2023-08-17T17:53:18.735961+0000","last_active":"2023-08-17T17:53:18.735961+0000","last_peered":"2023-08-17T17:53:18.735961+0000","last_clean":"2023-08-17T17:53:18.735961+0000","last_became_active":"2023-08-17T17:53:18.735689+0000","last_became_peered":"2023-08-17T17:53:18.735689+0000","last_unstale":"2023-08-17T17:53:18.735961+0000","last_undegraded":"2023-08-17T17:53:18.735961+0000","last_fullsized":"2023-08-17T17:53:18.735961+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370748+0000","last_change":"2023-08-17T17:53:18.365753+0000","last_active":"2023-08-17T17:53:18.370748+0000","last_peered":"2023-08-17T17:53:18.370748+0000","last_clean":"2023-08-17T17:53:18.370748+0000","last_became_active":"2023-08-17T17:53:18.364915+0000","last_became_peered":"2023-08-17T17:53:18.364915+0000","last_unstale":"2023-08-17T17:53:18.370748+0000","last_undegraded":"2023-08-17T17:53:18.370748+0000","last_fullsized":"2023-08-17T17:53:18.370748+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732552+0000","last_change":"2023-08-17T17:53:18.732552+0000","last_active":"2023-08-17T17:53:18.732552+0000","last_peered":"2023-08-17T17:53:18.732552+0000","last_clean":"2023-08-17T17:53:18.732552+0000","last_became_active":"2023-08-17T17:53:18.732263+0000","last_became_peered":"2023-08-17T17:53:18.732263+0000","last_unstale":"2023-08-17T17:53:18.732552+0000","last_undegraded":"2023-08-17T17:53:18.732552+0000","last_fullsized":"2023-08-17T17:53:18.732552+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.373536+0000","last_change":"2023-08-17T17:53:18.371993+0000","last_active":"2023-08-17T17:53:18.373536+0000","last_peered":"2023-08-17T17:53:18.373536+0000","last_clean":"2023-08-17T17:53:18.373536+0000","last_became_active":"2023-08-17T17:53:18.371658+0000","last_became_peered":"2023-08-17T17:53:18.371658+0000","last_unstale":"2023-08-17T17:53:18.373536+0000","last_undegraded":"2023-08-17T17:53:18.373536+0000","last_fullsized":"2023-08-17T17:53:18.373536+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736356+0000","last_change":"2023-08-17T17:53:18.736356+0000","last_active":"2023-08-17T17:53:18.736356+0000","last_peered":"2023-08-17T17:53:18.736356+0000","last_clean":"2023-08-17T17:53:18.736356+0000","last_became_active":"2023-08-17T17:53:18.736117+0000","last_became_peered":"2023-08-17T17:53:18.736117+0000","last_unstale":"2023-08-17T17:53:18.736356+0000","last_undegraded":"2023-08-17T17:53:18.736356+0000","last_fullsized":"2023-08-17T17:53:18.736356+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.719457+0000","last_change":"2023-08-17T17:53:18.364009+0000","last_active":"2023-08-17T17:53:18.719457+0000","last_peered":"2023-08-17T17:53:18.719457+0000","last_clean":"2023-08-17T17:53:18.719457+0000","last_became_active":"2023-08-17T17:53:18.363718+0000","last_became_peered":"2023-08-17T17:53:18.363718+0000","last_unstale":"2023-08-17T17:53:18.719457+0000","last_undegraded":"2023-08-17T17:53:18.719457+0000","last_fullsized":"2023-08-17T17:53:18.719457+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732009+0000","last_change":"2023-08-17T17:53:18.732009+0000","last_active":"2023-08-17T17:53:18.732009+0000","last_peered":"2023-08-17T17:53:18.732009+0000","last_clean":"2023-08-17T17:53:18.732009+0000","last_became_active":"2023-08-17T17:53:18.731756+0000","last_became_peered":"2023-08-17T17:53:18.731756+0000","last_unstale":"2023-08-17T17:53:18.732009+0000","last_undegraded":"2023-08-17T17:53:18.732009+0000","last_fullsized":"2023-08-17T17:53:18.732009+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370841+0000","last_change":"2023-08-17T17:53:18.368414+0000","last_active":"2023-08-17T17:53:18.370841+0000","last_peered":"2023-08-17T17:53:18.370841+0000","last_clean":"2023-08-17T17:53:18.370841+0000","last_became_active":"2023-08-17T17:53:18.368203+0000","last_became_peered":"2023-08-17T17:53:18.368203+0000","last_unstale":"2023-08-17T17:53:18.370841+0000","last_undegraded":"2023-08-17T17:53:18.370841+0000","last_fullsized":"2023-08-17T17:53:18.370841+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738988+0000","last_change":"2023-08-17T17:53:18.738988+0000","last_active":"2023-08-17T17:53:18.738988+0000","last_peered":"2023-08-17T17:53:18.738988+0000","last_clean":"2023-08-17T17:53:18.738988+0000","last_became_active":"2023-08-17T17:53:18.737073+0000","last_became_peered":"2023-08-17T17:53:18.737073+0000","last_unstale":"2023-08-17T17:53:18.738988+0000","last_undegraded":"2023-08-17T17:53:18.738988+0000","last_fullsized":"2023-08-17T17:53:18.738988+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.366871+0000","last_change":"2023-08-17T17:53:18.359703+0000","last_active":"2023-08-17T17:53:18.366871+0000","last_peered":"2023-08-17T17:53:18.366871+0000","last_clean":"2023-08-17T17:53:18.366871+0000","last_became_active":"2023-08-17T17:53:18.359236+0000","last_became_peered":"2023-08-17T17:53:18.359236+0000","last_unstale":"2023-08-17T17:53:18.366871+0000","last_undegraded":"2023-08-17T17:53:18.366871+0000","last_fullsized":"2023-08-17T17:53:18.366871+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736401+0000","last_change":"2023-08-17T17:53:18.736401+0000","last_active":"2023-08-17T17:53:18.736401+0000","last_peered":"2023-08-17T17:53:18.736401+0000","last_clean":"2023-08-17T17:53:18.736401+0000","last_became_active":"2023-08-17T17:53:18.736166+0000","last_became_peered":"2023-08-17T17:53:18.736166+0000","last_unstale":"2023-08-17T17:53:18.736401+0000","last_undegraded":"2023-08-17T17:53:18.736401+0000","last_fullsized":"2023-08-17T17:53:18.736401+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368742+0000","last_change":"2023-08-17T17:53:18.364969+0000","last_active":"2023-08-17T17:53:18.368742+0000","last_peered":"2023-08-17T17:53:18.368742+0000","last_clean":"2023-08-17T17:53:18.368742+0000","last_became_active":"2023-08-17T17:53:18.364558+0000","last_became_peered":"2023-08-17T17:53:18.364558+0000","last_unstale":"2023-08-17T17:53:18.368742+0000","last_undegraded":"2023-08-17T17:53:18.368742+0000","last_fullsized":"2023-08-17T17:53:18.368742+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738031+0000","last_change":"2023-08-17T17:53:18.738031+0000","last_active":"2023-08-17T17:53:18.738031+0000","last_peered":"2023-08-17T17:53:18.738031+0000","last_clean":"2023-08-17T17:53:18.738031+0000","last_became_active":"2023-08-17T17:53:18.737581+0000","last_became_peered":"2023-08-17T17:53:18.737581+0000","last_unstale":"2023-08-17T17:53:18.738031+0000","last_undegraded":"2023-08-17T17:53:18.738031+0000","last_fullsized":"2023-08-17T17:53:18.738031+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"134'2","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735083+0000","last_change":"2023-08-17T17:53:18.369217+0000","last_active":"2023-08-17T17:53:18.735083+0000","last_peered":"2023-08-17T17:53:18.735083+0000","last_clean":"2023-08-17T17:53:18.735083+0000","last_became_active":"2023-08-17T17:53:18.368863+0000","last_became_peered":"2023-08-17T17:53:18.368863+0000","last_unstale":"2023-08-17T17:53:18.735083+0000","last_undegraded":"2023-08-17T17:53:18.735083+0000","last_fullsized":"2023-08-17T17:53:18.735083+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736908+0000","last_change":"2023-08-17T17:53:18.736908+0000","last_active":"2023-08-17T17:53:18.736908+0000","last_peered":"2023-08-17T17:53:18.736908+0000","last_clean":"2023-08-17T17:53:18.736908+0000","last_became_active":"2023-08-17T17:53:18.736652+0000","last_became_peered":"2023-08-17T17:53:18.736652+0000","last_unstale":"2023-08-17T17:53:18.736908+0000","last_undegraded":"2023-08-17T17:53:18.736908+0000","last_fullsized":"2023-08-17T17:53:18.736908+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.365861+0000","last_change":"2023-08-17T17:53:18.359507+0000","last_active":"2023-08-17T17:53:18.365861+0000","last_peered":"2023-08-17T17:53:18.365861+0000","last_clean":"2023-08-17T17:53:18.365861+0000","last_became_active":"2023-08-17T17:53:18.359046+0000","last_became_peered":"2023-08-17T17:53:18.359046+0000","last_unstale":"2023-08-17T17:53:18.365861+0000","last_undegraded":"2023-08-17T17:53:18.365861+0000","last_fullsized":"2023-08-17T17:53:18.365861+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738591+0000","last_change":"2023-08-17T17:53:18.738591+0000","last_active":"2023-08-17T17:53:18.738591+0000","last_peered":"2023-08-17T17:53:18.738591+0000","last_clean":"2023-08-17T17:53:18.738591+0000","last_became_active":"2023-08-17T17:53:18.738311+0000","last_became_peered":"2023-08-17T17:53:18.738311+0000","last_unstale":"2023-08-17T17:53:18.738591+0000","last_undegraded":"2023-08-17T17:53:18.738591+0000","last_fullsized":"2023-08-17T17:53:18.738591+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.363893+0000","last_change":"2023-08-17T17:53:18.358839+0000","last_active":"2023-08-17T17:53:18.363893+0000","last_peered":"2023-08-17T17:53:18.363893+0000","last_clean":"2023-08-17T17:53:18.363893+0000","last_became_active":"2023-08-17T17:53:18.358512+0000","last_became_peered":"2023-08-17T17:53:18.358512+0000","last_unstale":"2023-08-17T17:53:18.363893+0000","last_undegraded":"2023-08-17T17:53:18.363893+0000","last_fullsized":"2023-08-17T17:53:18.363893+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732945+0000","last_change":"2023-08-17T17:53:18.732945+0000","last_active":"2023-08-17T17:53:18.732945+0000","last_peered":"2023-08-17T17:53:18.732945+0000","last_clean":"2023-08-17T17:53:18.732945+0000","last_became_active":"2023-08-17T17:53:18.732671+0000","last_became_peered":"2023-08-17T17:53:18.732671+0000","last_unstale":"2023-08-17T17:53:18.732945+0000","last_undegraded":"2023-08-17T17:53:18.732945+0000","last_fullsized":"2023-08-17T17:53:18.732945+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.376691+0000","last_change":"2023-08-17T17:53:18.368558+0000","last_active":"2023-08-17T17:53:18.376691+0000","last_peered":"2023-08-17T17:53:18.376691+0000","last_clean":"2023-08-17T17:53:18.376691+0000","last_became_active":"2023-08-17T17:53:18.368209+0000","last_became_peered":"2023-08-17T17:53:18.368209+0000","last_unstale":"2023-08-17T17:53:18.376691+0000","last_undegraded":"2023-08-17T17:53:18.376691+0000","last_fullsized":"2023-08-17T17:53:18.376691+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735861+0000","last_change":"2023-08-17T17:53:18.735861+0000","last_active":"2023-08-17T17:53:18.735861+0000","last_peered":"2023-08-17T17:53:18.735861+0000","last_clean":"2023-08-17T17:53:18.735861+0000","last_became_active":"2023-08-17T17:53:18.735592+0000","last_became_peered":"2023-08-17T17:53:18.735592+0000","last_unstale":"2023-08-17T17:53:18.735861+0000","last_undegraded":"2023-08-17T17:53:18.735861+0000","last_fullsized":"2023-08-17T17:53:18.735861+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367986+0000","last_change":"2023-08-17T17:53:18.362985+0000","last_active":"2023-08-17T17:53:18.367986+0000","last_peered":"2023-08-17T17:53:18.367986+0000","last_clean":"2023-08-17T17:53:18.367986+0000","last_became_active":"2023-08-17T17:53:18.362476+0000","last_became_peered":"2023-08-17T17:53:18.362476+0000","last_unstale":"2023-08-17T17:53:18.367986+0000","last_undegraded":"2023-08-17T17:53:18.367986+0000","last_fullsized":"2023-08-17T17:53:18.367986+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736197+0000","last_change":"2023-08-17T17:53:18.736197+0000","last_active":"2023-08-17T17:53:18.736197+0000","last_peered":"2023-08-17T17:53:18.736197+0000","last_clean":"2023-08-17T17:53:18.736197+0000","last_became_active":"2023-08-17T17:53:18.735927+0000","last_became_peered":"2023-08-17T17:53:18.735927+0000","last_unstale":"2023-08-17T17:53:18.736197+0000","last_undegraded":"2023-08-17T17:53:18.736197+0000","last_fullsized":"2023-08-17T17:53:18.736197+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367937+0000","last_change":"2023-08-17T17:53:18.363727+0000","last_active":"2023-08-17T17:53:18.367937+0000","last_peered":"2023-08-17T17:53:18.367937+0000","last_clean":"2023-08-17T17:53:18.367937+0000","last_became_active":"2023-08-17T17:53:18.363443+0000","last_became_peered":"2023-08-17T17:53:18.363443+0000","last_unstale":"2023-08-17T17:53:18.367937+0000","last_undegraded":"2023-08-17T17:53:18.367937+0000","last_fullsized":"2023-08-17T17:53:18.367937+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.728412+0000","last_change":"2023-08-17T17:53:18.728412+0000","last_active":"2023-08-17T17:53:18.728412+0000","last_peered":"2023-08-17T17:53:18.728412+0000","last_clean":"2023-08-17T17:53:18.728412+0000","last_became_active":"2023-08-17T17:53:18.728126+0000","last_became_peered":"2023-08-17T17:53:18.728126+0000","last_unstale":"2023-08-17T17:53:18.728412+0000","last_undegraded":"2023-08-17T17:53:18.728412+0000","last_fullsized":"2023-08-17T17:53:18.728412+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.376650+0000","last_change":"2023-08-17T17:53:18.364561+0000","last_active":"2023-08-17T17:53:18.376650+0000","last_peered":"2023-08-17T17:53:18.376650+0000","last_clean":"2023-08-17T17:53:18.376650+0000","last_became_active":"2023-08-17T17:53:18.364277+0000","last_became_peered":"2023-08-17T17:53:18.364277+0000","last_unstale":"2023-08-17T17:53:18.376650+0000","last_undegraded":"2023-08-17T17:53:18.376650+0000","last_fullsized":"2023-08-17T17:53:18.376650+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731444+0000","last_change":"2023-08-17T17:53:18.731444+0000","last_active":"2023-08-17T17:53:18.731444+0000","last_peered":"2023-08-17T17:53:18.731444+0000","last_clean":"2023-08-17T17:53:18.731444+0000","last_became_active":"2023-08-17T17:53:18.731150+0000","last_became_peered":"2023-08-17T17:53:18.731150+0000","last_unstale":"2023-08-17T17:53:18.731444+0000","last_undegraded":"2023-08-17T17:53:18.731444+0000","last_fullsized":"2023-08-17T17:53:18.731444+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370894+0000","last_change":"2023-08-17T17:53:18.367385+0000","last_active":"2023-08-17T17:53:18.370894+0000","last_peered":"2023-08-17T17:53:18.370894+0000","last_clean":"2023-08-17T17:53:18.370894+0000","last_became_active":"2023-08-17T17:53:18.367063+0000","last_became_peered":"2023-08-17T17:53:18.367063+0000","last_unstale":"2023-08-17T17:53:18.370894+0000","last_undegraded":"2023-08-17T17:53:18.370894+0000","last_fullsized":"2023-08-17T17:53:18.370894+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732859+0000","last_change":"2023-08-17T17:53:18.732859+0000","last_active":"2023-08-17T17:53:18.732859+0000","last_peered":"2023-08-17T17:53:18.732859+0000","last_clean":"2023-08-17T17:53:18.732859+0000","last_became_active":"2023-08-17T17:53:18.732543+0000","last_became_peered":"2023-08-17T17:53:18.732543+0000","last_unstale":"2023-08-17T17:53:18.732859+0000","last_undegraded":"2023-08-17T17:53:18.732859+0000","last_fullsized":"2023-08-17T17:53:18.732859+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.373641+0000","last_change":"2023-08-17T17:53:18.371961+0000","last_active":"2023-08-17T17:53:18.373641+0000","last_peered":"2023-08-17T17:53:18.373641+0000","last_clean":"2023-08-17T17:53:18.373641+0000","last_became_active":"2023-08-17T17:53:18.371644+0000","last_became_peered":"2023-08-17T17:53:18.371644+0000","last_unstale":"2023-08-17T17:53:18.373641+0000","last_undegraded":"2023-08-17T17:53:18.373641+0000","last_fullsized":"2023-08-17T17:53:18.373641+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.353289+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:53:18.353289+0000","last_peered":"2023-08-17T17:53:18.353289+0000","last_clean":"2023-08-17T17:53:18.353289+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:53:18.353289+0000","last_undegraded":"2023-08-17T17:53:18.353289+0000","last_fullsized":"2023-08-17T17:53:18.353289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.737006+0000","last_change":"2023-08-17T17:53:18.737006+0000","last_active":"2023-08-17T17:53:18.737006+0000","last_peered":"2023-08-17T17:53:18.737006+0000","last_clean":"2023-08-17T17:53:18.737006+0000","last_became_active":"2023-08-17T17:53:18.736738+0000","last_became_peered":"2023-08-17T17:53:18.736738+0000","last_unstale":"2023-08-17T17:53:18.737006+0000","last_undegraded":"2023-08-17T17:53:18.737006+0000","last_fullsized":"2023-08-17T17:53:18.737006+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.369534+0000","last_change":"2023-08-17T17:53:18.366776+0000","last_active":"2023-08-17T17:53:18.369534+0000","last_peered":"2023-08-17T17:53:18.369534+0000","last_clean":"2023-08-17T17:53:18.369534+0000","last_became_active":"2023-08-17T17:53:18.365742+0000","last_became_peered":"2023-08-17T17:53:18.365742+0000","last_unstale":"2023-08-17T17:53:18.369534+0000","last_undegraded":"2023-08-17T17:53:18.369534+0000","last_fullsized":"2023-08-17T17:53:18.369534+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.352827+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:53:18.352827+0000","last_peered":"2023-08-17T17:53:18.352827+0000","last_clean":"2023-08-17T17:53:18.352827+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:53:18.352827+0000","last_undegraded":"2023-08-17T17:53:18.352827+0000","last_fullsized":"2023-08-17T17:53:18.352827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731504+0000","last_change":"2023-08-17T17:53:18.731504+0000","last_active":"2023-08-17T17:53:18.731504+0000","last_peered":"2023-08-17T17:53:18.731504+0000","last_clean":"2023-08-17T17:53:18.731504+0000","last_became_active":"2023-08-17T17:53:18.731241+0000","last_became_peered":"2023-08-17T17:53:18.731241+0000","last_unstale":"2023-08-17T17:53:18.731504+0000","last_undegraded":"2023-08-17T17:53:18.731504+0000","last_fullsized":"2023-08-17T17:53:18.731504+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367748+0000","last_change":"2023-08-17T17:53:18.363625+0000","last_active":"2023-08-17T17:53:18.367748+0000","last_peered":"2023-08-17T17:53:18.367748+0000","last_clean":"2023-08-17T17:53:18.367748+0000","last_became_active":"2023-08-17T17:53:18.363351+0000","last_became_peered":"2023-08-17T17:53:18.363351+0000","last_unstale":"2023-08-17T17:53:18.367748+0000","last_undegraded":"2023-08-17T17:53:18.367748+0000","last_fullsized":"2023-08-17T17:53:18.367748+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":102,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.355825+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:53:18.355825+0000","last_peered":"2023-08-17T17:53:18.355825+0000","last_clean":"2023-08-17T17:53:18.355825+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:53:18.355825+0000","last_undegraded":"2023-08-17T17:53:18.355825+0000","last_fullsized":"2023-08-17T17:53:18.355825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731340+0000","last_change":"2023-08-17T17:53:18.731340+0000","last_active":"2023-08-17T17:53:18.731340+0000","last_peered":"2023-08-17T17:53:18.731340+0000","last_clean":"2023-08-17T17:53:18.731340+0000","last_became_active":"2023-08-17T17:53:18.730705+0000","last_became_peered":"2023-08-17T17:53:18.730705+0000","last_unstale":"2023-08-17T17:53:18.731340+0000","last_undegraded":"2023-08-17T17:53:18.731340+0000","last_fullsized":"2023-08-17T17:53:18.731340+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"134'4","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.740425+0000","last_change":"2023-08-17T17:53:18.364945+0000","last_active":"2023-08-17T17:53:18.740425+0000","last_peered":"2023-08-17T17:53:18.740425+0000","last_clean":"2023-08-17T17:53:18.740425+0000","last_became_active":"2023-08-17T17:53:18.364670+0000","last_became_peered":"2023-08-17T17:53:18.364670+0000","last_unstale":"2023-08-17T17:53:18.740425+0000","last_undegraded":"2023-08-17T17:53:18.740425+0000","last_fullsized":"2023-08-17T17:53:18.740425+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.351612+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:53:18.351612+0000","last_peered":"2023-08-17T17:53:18.351612+0000","last_clean":"2023-08-17T17:53:18.351612+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:53:18.351612+0000","last_undegraded":"2023-08-17T17:53:18.351612+0000","last_fullsized":"2023-08-17T17:53:18.351612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":101,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.358640+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:53:18.358640+0000","last_peered":"2023-08-17T17:53:18.358640+0000","last_clean":"2023-08-17T17:53:18.358640+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:53:18.358640+0000","last_undegraded":"2023-08-17T17:53:18.358640+0000","last_fullsized":"2023-08-17T17:53:18.358640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.734207+0000","last_change":"2023-08-17T17:53:18.734207+0000","last_active":"2023-08-17T17:53:18.734207+0000","last_peered":"2023-08-17T17:53:18.734207+0000","last_clean":"2023-08-17T17:53:18.734207+0000","last_became_active":"2023-08-17T17:53:18.733902+0000","last_became_peered":"2023-08-17T17:53:18.733902+0000","last_unstale":"2023-08-17T17:53:18.734207+0000","last_undegraded":"2023-08-17T17:53:18.734207+0000","last_fullsized":"2023-08-17T17:53:18.734207+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.724710+0000","last_change":"2023-08-17T17:53:18.364869+0000","last_active":"2023-08-17T17:53:18.724710+0000","last_peered":"2023-08-17T17:53:18.724710+0000","last_clean":"2023-08-17T17:53:18.724710+0000","last_became_active":"2023-08-17T17:53:18.364597+0000","last_became_peered":"2023-08-17T17:53:18.364597+0000","last_unstale":"2023-08-17T17:53:18.724710+0000","last_undegraded":"2023-08-17T17:53:18.724710+0000","last_fullsized":"2023-08-17T17:53:18.724710+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.358740+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:53:18.358740+0000","last_peered":"2023-08-17T17:53:18.358740+0000","last_clean":"2023-08-17T17:53:18.358740+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:53:18.358740+0000","last_undegraded":"2023-08-17T17:53:18.358740+0000","last_fullsized":"2023-08-17T17:53:18.358740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736128+0000","last_change":"2023-08-17T17:53:18.736128+0000","last_active":"2023-08-17T17:53:18.736128+0000","last_peered":"2023-08-17T17:53:18.736128+0000","last_clean":"2023-08-17T17:53:18.736128+0000","last_became_active":"2023-08-17T17:53:18.735701+0000","last_became_peered":"2023-08-17T17:53:18.735701+0000","last_unstale":"2023-08-17T17:53:18.736128+0000","last_undegraded":"2023-08-17T17:53:18.736128+0000","last_fullsized":"2023-08-17T17:53:18.736128+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.363618+0000","last_change":"2023-08-17T17:53:18.358278+0000","last_active":"2023-08-17T17:53:18.363618+0000","last_peered":"2023-08-17T17:53:18.363618+0000","last_clean":"2023-08-17T17:53:18.363618+0000","last_became_active":"2023-08-17T17:53:18.357985+0000","last_became_peered":"2023-08-17T17:53:18.357985+0000","last_unstale":"2023-08-17T17:53:18.363618+0000","last_undegraded":"2023-08-17T17:53:18.363618+0000","last_fullsized":"2023-08-17T17:53:18.363618+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.357111+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:53:18.357111+0000","last_peered":"2023-08-17T17:53:18.357111+0000","last_clean":"2023-08-17T17:53:18.357111+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:53:18.357111+0000","last_undegraded":"2023-08-17T17:53:18.357111+0000","last_fullsized":"2023-08-17T17:53:18.357111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736054+0000","last_change":"2023-08-17T17:53:18.736054+0000","last_active":"2023-08-17T17:53:18.736054+0000","last_peered":"2023-08-17T17:53:18.736054+0000","last_clean":"2023-08-17T17:53:18.736054+0000","last_became_active":"2023-08-17T17:53:18.735794+0000","last_became_peered":"2023-08-17T17:53:18.735794+0000","last_unstale":"2023-08-17T17:53:18.736054+0000","last_undegraded":"2023-08-17T17:53:18.736054+0000","last_fullsized":"2023-08-17T17:53:18.736054+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"134'3","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.737758+0000","last_change":"2023-08-17T17:53:18.364960+0000","last_active":"2023-08-17T17:53:18.737758+0000","last_peered":"2023-08-17T17:53:18.737758+0000","last_clean":"2023-08-17T17:53:18.737758+0000","last_became_active":"2023-08-17T17:53:18.364638+0000","last_became_peered":"2023-08-17T17:53:18.364638+0000","last_unstale":"2023-08-17T17:53:18.737758+0000","last_undegraded":"2023-08-17T17:53:18.737758+0000","last_fullsized":"2023-08-17T17:53:18.737758+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.351694+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:53:18.351694+0000","last_peered":"2023-08-17T17:53:18.351694+0000","last_clean":"2023-08-17T17:53:18.351694+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:53:18.351694+0000","last_undegraded":"2023-08-17T17:53:18.351694+0000","last_fullsized":"2023-08-17T17:53:18.351694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.737230+0000","last_change":"2023-08-17T17:53:18.737230+0000","last_active":"2023-08-17T17:53:18.737230+0000","last_peered":"2023-08-17T17:53:18.737230+0000","last_clean":"2023-08-17T17:53:18.737230+0000","last_became_active":"2023-08-17T17:53:18.736949+0000","last_became_peered":"2023-08-17T17:53:18.736949+0000","last_unstale":"2023-08-17T17:53:18.737230+0000","last_undegraded":"2023-08-17T17:53:18.737230+0000","last_fullsized":"2023-08-17T17:53:18.737230+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"134'2","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.740336+0000","last_change":"2023-08-17T17:53:18.367467+0000","last_active":"2023-08-17T17:53:18.740336+0000","last_peered":"2023-08-17T17:53:18.740336+0000","last_clean":"2023-08-17T17:53:18.740336+0000","last_became_active":"2023-08-17T17:53:18.367181+0000","last_became_peered":"2023-08-17T17:53:18.367181+0000","last_unstale":"2023-08-17T17:53:18.740336+0000","last_undegraded":"2023-08-17T17:53:18.740336+0000","last_fullsized":"2023-08-17T17:53:18.740336+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.352485+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:53:18.352485+0000","last_peered":"2023-08-17T17:53:18.352485+0000","last_clean":"2023-08-17T17:53:18.352485+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:53:18.352485+0000","last_undegraded":"2023-08-17T17:53:18.352485+0000","last_fullsized":"2023-08-17T17:53:18.352485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575073,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302816,"kb_used_data":1624,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069024,"statfs":{"total":96636764160,"available":96326680576,"internally_reserved":0,"allocated":1662976,"data_stored":826284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.42099999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.75800000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.498}]},{"osd":1,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.83299999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.59699999999999998,"5min":0.745,"15min":0.80000000000000004},"last":0.623}]},{"osd":2,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.435},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.436,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":1.23,"15min":1.23},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76100000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.60999999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.86099999999999999},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.85499999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.90200000000000002},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575073,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302792,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069048,"statfs":{"total":96636764160,"available":96326705152,"internally_reserved":0,"allocated":1638400,"data_stored":812426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70499999999999996,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.60699999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69099999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.84599999999999997,"15min":1.0609999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.373},"max":{"1min":0.69699999999999995,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.46899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.67600000000000005,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.5}]},{"osd":4,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.443,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.75800000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.74199999999999999,"15min":0.77300000000000002},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":1.51},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.872},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.747,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.34799999999999998},"min":{"1min":0.25900000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45800000000000002,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.5,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.36399999999999999},"min":{"1min":0.26800000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.70799999999999996},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.63600000000000001,"15min":0.66300000000000003},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.33200000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"last":0.314},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.30399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.63300000000000001},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.89600000000000002,"15min":0.93200000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85299999999999998,"5min":1.2989999999999999,"15min":1.331},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84499999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86799999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.627},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.54000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575073,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.61599999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.377,"15min":0.38400000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.57099999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.36499999999999999},"min":{"1min":0.22800000000000001,"5min":0.19900000000000001,"15min":0.19400000000000001},"max":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.39500000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55400000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.41199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.26200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.378}]},{"osd":4,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0569999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.034,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.095,"5min":1.677,"15min":1.677},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.99099999999999999,"5min":1.51,"15min":1.51},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0740000000000001,"5min":1.325,"15min":1.391},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":1.103,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.505},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0980000000000001,"15min":1.544},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575073,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32900000000000001,"15min":0.34599999999999997},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49199999999999999,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.435}]},{"osd":1,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.503},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.41599999999999998},"min":{"1min":0.25600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.41899999999999998},"min":{"1min":0.308,"5min":0.27800000000000002,"15min":0.27200000000000002},"max":{"1min":0.58299999999999996,"5min":0.63,"15min":1.268},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88,"5min":1.417,"15min":1.417},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":1.51,"15min":2.9220000000000002},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":1.544,"15min":1.544},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.872,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":1.415,"15min":1.415},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.81499999999999995,"5min":1.3859999999999999,"15min":2.984},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.70899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.56299999999999994},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.375},"min":{"1min":0.251,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.54800000000000004,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38300000000000001,"15min":0.39100000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.63300000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.76700000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.629},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.78800000000000003,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86699999999999999,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":2.609},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.433,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.3260000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81699999999999995,"5min":1.466,"15min":1.466},"last":1.157},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.48,"15min":1.48},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82299999999999995,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":2.3490000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575074,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.26400000000000001},"max":{"1min":0.77000000000000002,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.441},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.81000000000000005,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.55200000000000005},"min":{"1min":0.45200000000000001,"5min":0.34300000000000003,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":1.252,"15min":1.252},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.306,"15min":1.306},"last":0.499}]},{"osd":2,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88800000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":1.444,"15min":1.444},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80600000000000005,"5min":1.482,"15min":1.482},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.86299999999999999,"5min":1.123,"15min":1.123},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.38},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":1.002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.48299999999999998},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.91100000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":1.048,"15min":1.048},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.056},"last":0.56100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575072,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69299999999999995,"5min":1.165,"15min":1.165},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":1.022,"15min":1.022},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.68500000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.41599999999999998,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.76400000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.441},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":1.153,"15min":1.153},"last":0.505}]},{"osd":3,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":1.036,"15min":1.036},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.255},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.379},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35899999999999999,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.498},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:53:21.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:53:21.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.850+0000 7f0fe02da700 1 Processor -- start 2023-08-17T17:53:21.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.850+0000 7f0fe02da700 1 -- start start 2023-08-17T17:53:21.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fe02da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80c6ee0 0x7f0fd80c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fe02da700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd80a8350 con 0x7f0fd80c0df0 2023-08-17T17:53:21.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fe02da700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd80c7320 con 0x7f0fd8154140 2023-08-17T17:53:21.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fe02da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80c1280 con 0x7f0fd80c6ee0 2023-08-17T17:53:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fde877700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0fd80c0df0 0x7f0fd80ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40680/0 (socket says 172.21.15.78:40680) 2023-08-17T17:53:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fde877700 1 -- 172.21.15.78:0/1056389246 learned_addr learned my addr 172.21.15.78:0/1056389246 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd875700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80c6ee0 0x7f0fd80c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279684169 0 0) 0x7f0fd80a8350 con 0x7f0fd80c0df0 2023-08-17T17:53:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc00033f0 con 0x7f0fd80c0df0 2023-08-17T17:53:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841443156 0 0) 0x7f0fd80c7320 con 0x7f0fd8154140 2023-08-17T17:53:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd80a8350 con 0x7f0fd8154140 2023-08-17T17:53:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3902434906 0 0) 0x7f0fc00033f0 con 0x7f0fd80c0df0 2023-08-17T17:53:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80c6ee0 msgr2=0x7f0fd80c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80c6ee0 0x7f0fd80c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 >> v1:172.21.15.150:6789/0 conn(0x7f0fd8154140 legacy=0x7f0fd80a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd8154520 con 0x7f0fd80c0df0 2023-08-17T17:53:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f0fd00017f0 con 0x7f0fd80c0df0 2023-08-17T17:53:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd875700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80c6ee0 0x7f0fd80c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 >> v1:172.21.15.78:6789/0 conn(0x7f0fd80c0df0 legacy=0x7f0fd80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc0003aa0 0x7f0fc0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80c6ee0 0x7f0fc0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc0004b80 0x7f0fc0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80c1280 con 0x7f0fc0004b80 2023-08-17T17:53:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc000b8e0 con 0x7f0fc0003aa0 2023-08-17T17:53:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc000ba70 con 0x7f0fd80c6ee0 2023-08-17T17:53:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.851+0000 7f0fde877700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc0004b80 0x7f0fc0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fde076700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc0003aa0 0x7f0fc0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fdd875700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80c6ee0 0x7f0fc0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fde877700 1 -- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80c6ee0 msgr2=0x7f0fc0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fde877700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80c6ee0 0x7f0fc0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fde877700 1 -- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc0003aa0 msgr2=0x7f0fc0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fde877700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc0003aa0 0x7f0fc0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fde877700 1 -- 172.21.15.78:0/1056389246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0092a0 con 0x7f0fc0004b80 2023-08-17T17:53:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fde877700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc0004b80 0x7f0fc0005000 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f0fd000c5c0 tx=0x7f0fd0007f40).ready entity=mon.0 client_cookie=7ab3704e4a58684c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd000cdc0 con 0x7f0fc0004b80 2023-08-17T17:53:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd0005b20 con 0x7f0fc0004b80 2023-08-17T17:53:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fdd074700 1 -- 172.21.15.78:0/1056389246 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0005ea0 con 0x7f0fc0004b80 2023-08-17T17:53:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fe02da700 1 -- 172.21.15.78:0/1056389246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc0004b80 msgr2=0x7f0fc0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fe02da700 1 --2- 172.21.15.78:0/1056389246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc0004b80 0x7f0fc0005000 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f0fd000c5c0 tx=0x7f0fd0007f40).stop 2023-08-17T17:53:21.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.852+0000 7f0fde877700 1 -- 172.21.15.78:0/1056389246 reap_dead start 2023-08-17T17:53:21.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.853+0000 7f0fe02da700 1 -- 172.21.15.78:0/1056389246 shutdown_connections 2023-08-17T17:53:21.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.853+0000 7f0fe02da700 1 -- 172.21.15.78:0/1056389246 >> 172.21.15.78:0/1056389246 conn(0x7f0fd8094510 msgr2=0x7f0fd806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:21.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.853+0000 7f0fe02da700 1 -- 172.21.15.78:0/1056389246 shutdown_connections 2023-08-17T17:53:21.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.853+0000 7f0fe02da700 1 -- 172.21.15.78:0/1056389246 wait complete. 2023-08-17T17:53:21.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.854+0000 7f0fe02da700 1 Processor -- start 2023-08-17T17:53:21.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.854+0000 7f0fe02da700 1 -- start start 2023-08-17T17:53:21.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.854+0000 7f0fe02da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc0004b80 0x7f0fd81686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.854+0000 7f0fe02da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80b0400 0x7f0fd80cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.854+0000 7f0fe02da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fd80cb640 0x7f0fd81646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.854+0000 7f0fe02da700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80cbac0 con 0x7f0fd80cb640 2023-08-17T17:53:21.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.854+0000 7f0fe02da700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd8168b90 con 0x7f0fc0004b80 2023-08-17T17:53:21.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.854+0000 7f0fe02da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80c22a0 con 0x7f0fd80b0400 2023-08-17T17:53:21.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde877700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fd80cb640 0x7f0fd81646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde877700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fd80cb640 0x7f0fd81646f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59316/0 (socket says 172.21.15.78:59316) 2023-08-17T17:53:21.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde877700 1 -- 172.21.15.78:0/2262516365 learned_addr learned my addr 172.21.15.78:0/2262516365 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:21.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fdd875700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80b0400 0x7f0fd80cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde076700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc0004b80 0x7f0fd81686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde877700 1 -- 172.21.15.78:0/2262516365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80b0400 msgr2=0x7f0fd80cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde877700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80b0400 0x7f0fd80cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde877700 1 -- 172.21.15.78:0/2262516365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc0004b80 msgr2=0x7f0fd81686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:21.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde877700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc0004b80 0x7f0fd81686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde877700 1 -- 172.21.15.78:0/2262516365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd80c2580 con 0x7f0fd80cb640 2023-08-17T17:53:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde076700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc0004b80 0x7f0fd81686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fdd875700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80b0400 0x7f0fd80cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fde877700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fd80cb640 0x7f0fd81646f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f0fd0000f80 tx=0x7f0fd0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fd67fc700 1 -- 172.21.15.78:0/2262516365 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd000cdc0 con 0x7f0fd80cb640 2023-08-17T17:53:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fd67fc700 1 -- 172.21.15.78:0/2262516365 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd0005c90 con 0x7f0fd80cb640 2023-08-17T17:53:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fe02da700 1 -- 172.21.15.78:0/2262516365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd80c2860 con 0x7f0fd80cb640 2023-08-17T17:53:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fd67fc700 1 -- 172.21.15.78:0/2262516365 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0013680 con 0x7f0fd80cb640 2023-08-17T17:53:21.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.855+0000 7f0fe02da700 1 -- 172.21.15.78:0/2262516365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd80c2e20 con 0x7f0fd80cb640 2023-08-17T17:53:21.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.856+0000 7f0fe02da700 1 -- 172.21.15.78:0/2262516365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd8064580 con 0x7f0fd80cb640 2023-08-17T17:53:21.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.856+0000 7f0fd67fc700 1 -- 172.21.15.78:0/2262516365 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0fd001d070 con 0x7f0fd80cb640 2023-08-17T17:53:21.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.857+0000 7f0fd67fc700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fc405ed90 0x7f0fc4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:21.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.857+0000 7f0fd67fc700 1 -- 172.21.15.78:0/2262516365 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0fd007a9e0 con 0x7f0fd80cb640 2023-08-17T17:53:21.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.857+0000 7f0fde076700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fc405ed90 0x7f0fc4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:21.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.857+0000 7f0fde076700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fc405ed90 0x7f0fc4061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0fc8003980 tx=0x7f0fc8009040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:21.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:21.861+0000 7f0fd67fc700 1 -- 172.21.15.78:0/2262516365 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fd004bf80 con 0x7f0fd80cb640 2023-08-17T17:53:22.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.019+0000 7f0fe02da700 1 -- 172.21.15.78:0/2262516365 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fd80c3010 con 0x7f0fc405ed90 2023-08-17T17:53:22.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.029+0000 7f0fd67fc700 1 -- 172.21.15.78:0/2262516365 <== mgr.7932 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361715 (secure 0 0 0) 0x7f0fd80c3010 con 0x7f0fc405ed90 2023-08-17T17:53:22.032 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 -- 172.21.15.78:0/2262516365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fc405ed90 msgr2=0x7f0fc4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fc405ed90 0x7f0fc4061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0fc8003980 tx=0x7f0fc8009040).stop 2023-08-17T17:53:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 -- 172.21.15.78:0/2262516365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fd80cb640 msgr2=0x7f0fd81646f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fd80cb640 0x7f0fd81646f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f0fd0000f80 tx=0x7f0fd0015000).stop 2023-08-17T17:53:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 -- 172.21.15.78:0/2262516365 shutdown_connections 2023-08-17T17:53:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0fc405ed90 0x7f0fc4061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fd80cb640 0x7f0fd81646f0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc0004b80 0x7f0fd81686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 --2- 172.21.15.78:0/2262516365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fd80b0400 0x7f0fd80cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 -- 172.21.15.78:0/2262516365 >> 172.21.15.78:0/2262516365 conn(0x7f0fd8094510 msgr2=0x7f0fd8152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 -- 172.21.15.78:0/2262516365 shutdown_connections 2023-08-17T17:53:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.032+0000 7f0fe02da700 1 -- 172.21.15.78:0/2262516365 wait complete. 2023-08-17T17:53:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:53:22.044 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:53:21.748977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2422432,"kb_used_data":12896,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752552288,"statfs":{"total":773094113280,"available":770613542912,"internally_reserved":0,"allocated":13205504,"data_stored":6553340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19378,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-67,"num_write_kb":-43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.590078"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738312+0000","last_change":"2023-08-17T17:53:18.738312+0000","last_active":"2023-08-17T17:53:18.738312+0000","last_peered":"2023-08-17T17:53:18.738312+0000","last_clean":"2023-08-17T17:53:18.738312+0000","last_became_active":"2023-08-17T17:53:18.738039+0000","last_became_peered":"2023-08-17T17:53:18.738039+0000","last_unstale":"2023-08-17T17:53:18.738312+0000","last_undegraded":"2023-08-17T17:53:18.738312+0000","last_fullsized":"2023-08-17T17:53:18.738312+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"134'3","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736115+0000","last_change":"2023-08-17T17:53:18.365392+0000","last_active":"2023-08-17T17:53:18.736115+0000","last_peered":"2023-08-17T17:53:18.736115+0000","last_clean":"2023-08-17T17:53:18.736115+0000","last_became_active":"2023-08-17T17:53:18.365007+0000","last_became_peered":"2023-08-17T17:53:18.365007+0000","last_unstale":"2023-08-17T17:53:18.736115+0000","last_undegraded":"2023-08-17T17:53:18.736115+0000","last_fullsized":"2023-08-17T17:53:18.736115+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.737952+0000","last_change":"2023-08-17T17:53:18.737952+0000","last_active":"2023-08-17T17:53:18.737952+0000","last_peered":"2023-08-17T17:53:18.737952+0000","last_clean":"2023-08-17T17:53:18.737952+0000","last_became_active":"2023-08-17T17:53:18.737687+0000","last_became_peered":"2023-08-17T17:53:18.737687+0000","last_unstale":"2023-08-17T17:53:18.737952+0000","last_undegraded":"2023-08-17T17:53:18.737952+0000","last_fullsized":"2023-08-17T17:53:18.737952+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368084+0000","last_change":"2023-08-17T17:53:18.363966+0000","last_active":"2023-08-17T17:53:18.368084+0000","last_peered":"2023-08-17T17:53:18.368084+0000","last_clean":"2023-08-17T17:53:18.368084+0000","last_became_active":"2023-08-17T17:53:18.363672+0000","last_became_peered":"2023-08-17T17:53:18.363672+0000","last_unstale":"2023-08-17T17:53:18.368084+0000","last_undegraded":"2023-08-17T17:53:18.368084+0000","last_fullsized":"2023-08-17T17:53:18.368084+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.739928+0000","last_change":"2023-08-17T17:53:18.739928+0000","last_active":"2023-08-17T17:53:18.739928+0000","last_peered":"2023-08-17T17:53:18.739928+0000","last_clean":"2023-08-17T17:53:18.739928+0000","last_became_active":"2023-08-17T17:53:18.739510+0000","last_became_peered":"2023-08-17T17:53:18.739510+0000","last_unstale":"2023-08-17T17:53:18.739928+0000","last_undegraded":"2023-08-17T17:53:18.739928+0000","last_fullsized":"2023-08-17T17:53:18.739928+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370868+0000","last_change":"2023-08-17T17:53:18.369381+0000","last_active":"2023-08-17T17:53:18.370868+0000","last_peered":"2023-08-17T17:53:18.370868+0000","last_clean":"2023-08-17T17:53:18.370868+0000","last_became_active":"2023-08-17T17:53:18.369108+0000","last_became_peered":"2023-08-17T17:53:18.369108+0000","last_unstale":"2023-08-17T17:53:18.370868+0000","last_undegraded":"2023-08-17T17:53:18.370868+0000","last_fullsized":"2023-08-17T17:53:18.370868+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.734732+0000","last_change":"2023-08-17T17:53:18.734732+0000","last_active":"2023-08-17T17:53:18.734732+0000","last_peered":"2023-08-17T17:53:18.734732+0000","last_clean":"2023-08-17T17:53:18.734732+0000","last_became_active":"2023-08-17T17:53:18.734428+0000","last_became_peered":"2023-08-17T17:53:18.734428+0000","last_unstale":"2023-08-17T17:53:18.734732+0000","last_undegraded":"2023-08-17T17:53:18.734732+0000","last_fullsized":"2023-08-17T17:53:18.734732+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"134'2","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738647+0000","last_change":"2023-08-17T17:53:18.361495+0000","last_active":"2023-08-17T17:53:18.738647+0000","last_peered":"2023-08-17T17:53:18.738647+0000","last_clean":"2023-08-17T17:53:18.738647+0000","last_became_active":"2023-08-17T17:53:18.361110+0000","last_became_peered":"2023-08-17T17:53:18.361110+0000","last_unstale":"2023-08-17T17:53:18.738647+0000","last_undegraded":"2023-08-17T17:53:18.738647+0000","last_fullsized":"2023-08-17T17:53:18.738647+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738761+0000","last_change":"2023-08-17T17:53:18.738761+0000","last_active":"2023-08-17T17:53:18.738761+0000","last_peered":"2023-08-17T17:53:18.738761+0000","last_clean":"2023-08-17T17:53:18.738761+0000","last_became_active":"2023-08-17T17:53:18.736610+0000","last_became_peered":"2023-08-17T17:53:18.736610+0000","last_unstale":"2023-08-17T17:53:18.738761+0000","last_undegraded":"2023-08-17T17:53:18.738761+0000","last_fullsized":"2023-08-17T17:53:18.738761+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.721707+0000","last_change":"2023-08-17T17:53:18.362519+0000","last_active":"2023-08-17T17:53:18.721707+0000","last_peered":"2023-08-17T17:53:18.721707+0000","last_clean":"2023-08-17T17:53:18.721707+0000","last_became_active":"2023-08-17T17:53:18.362209+0000","last_became_peered":"2023-08-17T17:53:18.362209+0000","last_unstale":"2023-08-17T17:53:18.721707+0000","last_undegraded":"2023-08-17T17:53:18.721707+0000","last_fullsized":"2023-08-17T17:53:18.721707+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.729425+0000","last_change":"2023-08-17T17:53:18.729425+0000","last_active":"2023-08-17T17:53:18.729425+0000","last_peered":"2023-08-17T17:53:18.729425+0000","last_clean":"2023-08-17T17:53:18.729425+0000","last_became_active":"2023-08-17T17:53:18.729126+0000","last_became_peered":"2023-08-17T17:53:18.729126+0000","last_unstale":"2023-08-17T17:53:18.729425+0000","last_undegraded":"2023-08-17T17:53:18.729425+0000","last_fullsized":"2023-08-17T17:53:18.729425+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.716451+0000","last_change":"2023-08-17T17:53:18.360522+0000","last_active":"2023-08-17T17:53:18.716451+0000","last_peered":"2023-08-17T17:53:18.716451+0000","last_clean":"2023-08-17T17:53:18.716451+0000","last_became_active":"2023-08-17T17:53:18.360235+0000","last_became_peered":"2023-08-17T17:53:18.360235+0000","last_unstale":"2023-08-17T17:53:18.716451+0000","last_undegraded":"2023-08-17T17:53:18.716451+0000","last_fullsized":"2023-08-17T17:53:18.716451+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736404+0000","last_change":"2023-08-17T17:53:18.736404+0000","last_active":"2023-08-17T17:53:18.736404+0000","last_peered":"2023-08-17T17:53:18.736404+0000","last_clean":"2023-08-17T17:53:18.736404+0000","last_became_active":"2023-08-17T17:53:18.736133+0000","last_became_peered":"2023-08-17T17:53:18.736133+0000","last_unstale":"2023-08-17T17:53:18.736404+0000","last_undegraded":"2023-08-17T17:53:18.736404+0000","last_fullsized":"2023-08-17T17:53:18.736404+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.363854+0000","last_change":"2023-08-17T17:53:18.362184+0000","last_active":"2023-08-17T17:53:18.363854+0000","last_peered":"2023-08-17T17:53:18.363854+0000","last_clean":"2023-08-17T17:53:18.363854+0000","last_became_active":"2023-08-17T17:53:18.361840+0000","last_became_peered":"2023-08-17T17:53:18.361840+0000","last_unstale":"2023-08-17T17:53:18.363854+0000","last_undegraded":"2023-08-17T17:53:18.363854+0000","last_fullsized":"2023-08-17T17:53:18.363854+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735430+0000","last_change":"2023-08-17T17:53:18.735430+0000","last_active":"2023-08-17T17:53:18.735430+0000","last_peered":"2023-08-17T17:53:18.735430+0000","last_clean":"2023-08-17T17:53:18.735430+0000","last_became_active":"2023-08-17T17:53:18.735111+0000","last_became_peered":"2023-08-17T17:53:18.735111+0000","last_unstale":"2023-08-17T17:53:18.735430+0000","last_undegraded":"2023-08-17T17:53:18.735430+0000","last_fullsized":"2023-08-17T17:53:18.735430+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370930+0000","last_change":"2023-08-17T17:53:18.366808+0000","last_active":"2023-08-17T17:53:18.370930+0000","last_peered":"2023-08-17T17:53:18.370930+0000","last_clean":"2023-08-17T17:53:18.370930+0000","last_became_active":"2023-08-17T17:53:18.366609+0000","last_became_peered":"2023-08-17T17:53:18.366609+0000","last_unstale":"2023-08-17T17:53:18.370930+0000","last_undegraded":"2023-08-17T17:53:18.370930+0000","last_fullsized":"2023-08-17T17:53:18.370930+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738513+0000","last_change":"2023-08-17T17:53:18.738513+0000","last_active":"2023-08-17T17:53:18.738513+0000","last_peered":"2023-08-17T17:53:18.738513+0000","last_clean":"2023-08-17T17:53:18.738513+0000","last_became_active":"2023-08-17T17:53:18.738272+0000","last_became_peered":"2023-08-17T17:53:18.738272+0000","last_unstale":"2023-08-17T17:53:18.738513+0000","last_undegraded":"2023-08-17T17:53:18.738513+0000","last_fullsized":"2023-08-17T17:53:18.738513+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.376653+0000","last_change":"2023-08-17T17:53:18.368296+0000","last_active":"2023-08-17T17:53:18.376653+0000","last_peered":"2023-08-17T17:53:18.376653+0000","last_clean":"2023-08-17T17:53:18.376653+0000","last_became_active":"2023-08-17T17:53:18.366638+0000","last_became_peered":"2023-08-17T17:53:18.366638+0000","last_unstale":"2023-08-17T17:53:18.376653+0000","last_undegraded":"2023-08-17T17:53:18.376653+0000","last_fullsized":"2023-08-17T17:53:18.376653+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733325+0000","last_change":"2023-08-17T17:53:18.733325+0000","last_active":"2023-08-17T17:53:18.733325+0000","last_peered":"2023-08-17T17:53:18.733325+0000","last_clean":"2023-08-17T17:53:18.733325+0000","last_became_active":"2023-08-17T17:53:18.733023+0000","last_became_peered":"2023-08-17T17:53:18.733023+0000","last_unstale":"2023-08-17T17:53:18.733325+0000","last_undegraded":"2023-08-17T17:53:18.733325+0000","last_fullsized":"2023-08-17T17:53:18.733325+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.372105+0000","last_change":"2023-08-17T17:53:18.361563+0000","last_active":"2023-08-17T17:53:18.372105+0000","last_peered":"2023-08-17T17:53:18.372105+0000","last_clean":"2023-08-17T17:53:18.372105+0000","last_became_active":"2023-08-17T17:53:18.361260+0000","last_became_peered":"2023-08-17T17:53:18.361260+0000","last_unstale":"2023-08-17T17:53:18.372105+0000","last_undegraded":"2023-08-17T17:53:18.372105+0000","last_fullsized":"2023-08-17T17:53:18.372105+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732243+0000","last_change":"2023-08-17T17:53:18.732243+0000","last_active":"2023-08-17T17:53:18.732243+0000","last_peered":"2023-08-17T17:53:18.732243+0000","last_clean":"2023-08-17T17:53:18.732243+0000","last_became_active":"2023-08-17T17:53:18.731980+0000","last_became_peered":"2023-08-17T17:53:18.731980+0000","last_unstale":"2023-08-17T17:53:18.732243+0000","last_undegraded":"2023-08-17T17:53:18.732243+0000","last_fullsized":"2023-08-17T17:53:18.732243+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367927+0000","last_change":"2023-08-17T17:53:18.360923+0000","last_active":"2023-08-17T17:53:18.367927+0000","last_peered":"2023-08-17T17:53:18.367927+0000","last_clean":"2023-08-17T17:53:18.367927+0000","last_became_active":"2023-08-17T17:53:18.359861+0000","last_became_peered":"2023-08-17T17:53:18.359861+0000","last_unstale":"2023-08-17T17:53:18.367927+0000","last_undegraded":"2023-08-17T17:53:18.367927+0000","last_fullsized":"2023-08-17T17:53:18.367927+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730420+0000","last_change":"2023-08-17T17:53:18.730420+0000","last_active":"2023-08-17T17:53:18.730420+0000","last_peered":"2023-08-17T17:53:18.730420+0000","last_clean":"2023-08-17T17:53:18.730420+0000","last_became_active":"2023-08-17T17:53:18.730141+0000","last_became_peered":"2023-08-17T17:53:18.730141+0000","last_unstale":"2023-08-17T17:53:18.730420+0000","last_undegraded":"2023-08-17T17:53:18.730420+0000","last_fullsized":"2023-08-17T17:53:18.730420+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"134'4","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.740001+0000","last_change":"2023-08-17T17:53:18.365404+0000","last_active":"2023-08-17T17:53:18.740001+0000","last_peered":"2023-08-17T17:53:18.740001+0000","last_clean":"2023-08-17T17:53:18.740001+0000","last_became_active":"2023-08-17T17:53:18.365054+0000","last_became_peered":"2023-08-17T17:53:18.365054+0000","last_unstale":"2023-08-17T17:53:18.740001+0000","last_undegraded":"2023-08-17T17:53:18.740001+0000","last_fullsized":"2023-08-17T17:53:18.740001+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.742043+0000","last_change":"2023-08-17T17:53:18.742043+0000","last_active":"2023-08-17T17:53:18.742043+0000","last_peered":"2023-08-17T17:53:18.742043+0000","last_clean":"2023-08-17T17:53:18.742043+0000","last_became_active":"2023-08-17T17:53:18.741560+0000","last_became_peered":"2023-08-17T17:53:18.741560+0000","last_unstale":"2023-08-17T17:53:18.742043+0000","last_undegraded":"2023-08-17T17:53:18.742043+0000","last_fullsized":"2023-08-17T17:53:18.742043+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.715612+0000","last_change":"2023-08-17T17:53:18.365671+0000","last_active":"2023-08-17T17:53:18.715612+0000","last_peered":"2023-08-17T17:53:18.715612+0000","last_clean":"2023-08-17T17:53:18.715612+0000","last_became_active":"2023-08-17T17:53:18.365383+0000","last_became_peered":"2023-08-17T17:53:18.365383+0000","last_unstale":"2023-08-17T17:53:18.715612+0000","last_undegraded":"2023-08-17T17:53:18.715612+0000","last_fullsized":"2023-08-17T17:53:18.715612+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733321+0000","last_change":"2023-08-17T17:53:18.733321+0000","last_active":"2023-08-17T17:53:18.733321+0000","last_peered":"2023-08-17T17:53:18.733321+0000","last_clean":"2023-08-17T17:53:18.733321+0000","last_became_active":"2023-08-17T17:53:18.732601+0000","last_became_peered":"2023-08-17T17:53:18.732601+0000","last_unstale":"2023-08-17T17:53:18.733321+0000","last_undegraded":"2023-08-17T17:53:18.733321+0000","last_fullsized":"2023-08-17T17:53:18.733321+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368626+0000","last_change":"2023-08-17T17:53:18.364597+0000","last_active":"2023-08-17T17:53:18.368626+0000","last_peered":"2023-08-17T17:53:18.368626+0000","last_clean":"2023-08-17T17:53:18.368626+0000","last_became_active":"2023-08-17T17:53:18.364238+0000","last_became_peered":"2023-08-17T17:53:18.364238+0000","last_unstale":"2023-08-17T17:53:18.368626+0000","last_undegraded":"2023-08-17T17:53:18.368626+0000","last_fullsized":"2023-08-17T17:53:18.368626+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738321+0000","last_change":"2023-08-17T17:53:18.738321+0000","last_active":"2023-08-17T17:53:18.738321+0000","last_peered":"2023-08-17T17:53:18.738321+0000","last_clean":"2023-08-17T17:53:18.738321+0000","last_became_active":"2023-08-17T17:53:18.736435+0000","last_became_peered":"2023-08-17T17:53:18.736435+0000","last_unstale":"2023-08-17T17:53:18.738321+0000","last_undegraded":"2023-08-17T17:53:18.738321+0000","last_fullsized":"2023-08-17T17:53:18.738321+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368769+0000","last_change":"2023-08-17T17:53:18.363445+0000","last_active":"2023-08-17T17:53:18.368769+0000","last_peered":"2023-08-17T17:53:18.368769+0000","last_clean":"2023-08-17T17:53:18.368769+0000","last_became_active":"2023-08-17T17:53:18.362848+0000","last_became_peered":"2023-08-17T17:53:18.362848+0000","last_unstale":"2023-08-17T17:53:18.368769+0000","last_undegraded":"2023-08-17T17:53:18.368769+0000","last_fullsized":"2023-08-17T17:53:18.368769+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733265+0000","last_change":"2023-08-17T17:53:18.733265+0000","last_active":"2023-08-17T17:53:18.733265+0000","last_peered":"2023-08-17T17:53:18.733265+0000","last_clean":"2023-08-17T17:53:18.733265+0000","last_became_active":"2023-08-17T17:53:18.732632+0000","last_became_peered":"2023-08-17T17:53:18.732632+0000","last_unstale":"2023-08-17T17:53:18.733265+0000","last_undegraded":"2023-08-17T17:53:18.733265+0000","last_fullsized":"2023-08-17T17:53:18.733265+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"134'4","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.741952+0000","last_change":"2023-08-17T17:53:18.370921+0000","last_active":"2023-08-17T17:53:18.741952+0000","last_peered":"2023-08-17T17:53:18.741952+0000","last_clean":"2023-08-17T17:53:18.741952+0000","last_became_active":"2023-08-17T17:53:18.370195+0000","last_became_peered":"2023-08-17T17:53:18.370195+0000","last_unstale":"2023-08-17T17:53:18.741952+0000","last_undegraded":"2023-08-17T17:53:18.741952+0000","last_fullsized":"2023-08-17T17:53:18.741952+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730829+0000","last_change":"2023-08-17T17:53:18.730829+0000","last_active":"2023-08-17T17:53:18.730829+0000","last_peered":"2023-08-17T17:53:18.730829+0000","last_clean":"2023-08-17T17:53:18.730829+0000","last_became_active":"2023-08-17T17:53:18.730158+0000","last_became_peered":"2023-08-17T17:53:18.730158+0000","last_unstale":"2023-08-17T17:53:18.730829+0000","last_undegraded":"2023-08-17T17:53:18.730829+0000","last_fullsized":"2023-08-17T17:53:18.730829+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367778+0000","last_change":"2023-08-17T17:53:18.361219+0000","last_active":"2023-08-17T17:53:18.367778+0000","last_peered":"2023-08-17T17:53:18.367778+0000","last_clean":"2023-08-17T17:53:18.367778+0000","last_became_active":"2023-08-17T17:53:18.361002+0000","last_became_peered":"2023-08-17T17:53:18.361002+0000","last_unstale":"2023-08-17T17:53:18.367778+0000","last_undegraded":"2023-08-17T17:53:18.367778+0000","last_fullsized":"2023-08-17T17:53:18.367778+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733395+0000","last_change":"2023-08-17T17:53:18.733395+0000","last_active":"2023-08-17T17:53:18.733395+0000","last_peered":"2023-08-17T17:53:18.733395+0000","last_clean":"2023-08-17T17:53:18.733395+0000","last_became_active":"2023-08-17T17:53:18.733119+0000","last_became_peered":"2023-08-17T17:53:18.733119+0000","last_unstale":"2023-08-17T17:53:18.733395+0000","last_undegraded":"2023-08-17T17:53:18.733395+0000","last_fullsized":"2023-08-17T17:53:18.733395+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.365848+0000","last_change":"2023-08-17T17:53:18.359326+0000","last_active":"2023-08-17T17:53:18.365848+0000","last_peered":"2023-08-17T17:53:18.365848+0000","last_clean":"2023-08-17T17:53:18.365848+0000","last_became_active":"2023-08-17T17:53:18.358628+0000","last_became_peered":"2023-08-17T17:53:18.358628+0000","last_unstale":"2023-08-17T17:53:18.365848+0000","last_undegraded":"2023-08-17T17:53:18.365848+0000","last_fullsized":"2023-08-17T17:53:18.365848+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.739769+0000","last_change":"2023-08-17T17:53:18.739769+0000","last_active":"2023-08-17T17:53:18.739769+0000","last_peered":"2023-08-17T17:53:18.739769+0000","last_clean":"2023-08-17T17:53:18.739769+0000","last_became_active":"2023-08-17T17:53:18.739164+0000","last_became_peered":"2023-08-17T17:53:18.739164+0000","last_unstale":"2023-08-17T17:53:18.739769+0000","last_undegraded":"2023-08-17T17:53:18.739769+0000","last_fullsized":"2023-08-17T17:53:18.739769+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.716308+0000","last_change":"2023-08-17T17:53:18.365512+0000","last_active":"2023-08-17T17:53:18.716308+0000","last_peered":"2023-08-17T17:53:18.716308+0000","last_clean":"2023-08-17T17:53:18.716308+0000","last_became_active":"2023-08-17T17:53:18.364541+0000","last_became_peered":"2023-08-17T17:53:18.364541+0000","last_unstale":"2023-08-17T17:53:18.716308+0000","last_undegraded":"2023-08-17T17:53:18.716308+0000","last_fullsized":"2023-08-17T17:53:18.716308+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732957+0000","last_change":"2023-08-17T17:53:18.732957+0000","last_active":"2023-08-17T17:53:18.732957+0000","last_peered":"2023-08-17T17:53:18.732957+0000","last_clean":"2023-08-17T17:53:18.732957+0000","last_became_active":"2023-08-17T17:53:18.732694+0000","last_became_peered":"2023-08-17T17:53:18.732694+0000","last_unstale":"2023-08-17T17:53:18.732957+0000","last_undegraded":"2023-08-17T17:53:18.732957+0000","last_fullsized":"2023-08-17T17:53:18.732957+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368490+0000","last_change":"2023-08-17T17:53:18.362569+0000","last_active":"2023-08-17T17:53:18.368490+0000","last_peered":"2023-08-17T17:53:18.368490+0000","last_clean":"2023-08-17T17:53:18.368490+0000","last_became_active":"2023-08-17T17:53:18.362281+0000","last_became_peered":"2023-08-17T17:53:18.362281+0000","last_unstale":"2023-08-17T17:53:18.368490+0000","last_undegraded":"2023-08-17T17:53:18.368490+0000","last_fullsized":"2023-08-17T17:53:18.368490+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735844+0000","last_change":"2023-08-17T17:53:18.735844+0000","last_active":"2023-08-17T17:53:18.735844+0000","last_peered":"2023-08-17T17:53:18.735844+0000","last_clean":"2023-08-17T17:53:18.735844+0000","last_became_active":"2023-08-17T17:53:18.735550+0000","last_became_peered":"2023-08-17T17:53:18.735550+0000","last_unstale":"2023-08-17T17:53:18.735844+0000","last_undegraded":"2023-08-17T17:53:18.735844+0000","last_fullsized":"2023-08-17T17:53:18.735844+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.722530+0000","last_change":"2023-08-17T17:53:18.356949+0000","last_active":"2023-08-17T17:53:18.722530+0000","last_peered":"2023-08-17T17:53:18.722530+0000","last_clean":"2023-08-17T17:53:18.722530+0000","last_became_active":"2023-08-17T17:53:18.356612+0000","last_became_peered":"2023-08-17T17:53:18.356612+0000","last_unstale":"2023-08-17T17:53:18.722530+0000","last_undegraded":"2023-08-17T17:53:18.722530+0000","last_fullsized":"2023-08-17T17:53:18.722530+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.729696+0000","last_change":"2023-08-17T17:53:18.729696+0000","last_active":"2023-08-17T17:53:18.729696+0000","last_peered":"2023-08-17T17:53:18.729696+0000","last_clean":"2023-08-17T17:53:18.729696+0000","last_became_active":"2023-08-17T17:53:18.729398+0000","last_became_peered":"2023-08-17T17:53:18.729398+0000","last_unstale":"2023-08-17T17:53:18.729696+0000","last_undegraded":"2023-08-17T17:53:18.729696+0000","last_fullsized":"2023-08-17T17:53:18.729696+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.369585+0000","last_change":"2023-08-17T17:53:18.367656+0000","last_active":"2023-08-17T17:53:18.369585+0000","last_peered":"2023-08-17T17:53:18.369585+0000","last_clean":"2023-08-17T17:53:18.369585+0000","last_became_active":"2023-08-17T17:53:18.366209+0000","last_became_peered":"2023-08-17T17:53:18.366209+0000","last_unstale":"2023-08-17T17:53:18.369585+0000","last_undegraded":"2023-08-17T17:53:18.369585+0000","last_fullsized":"2023-08-17T17:53:18.369585+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730906+0000","last_change":"2023-08-17T17:53:18.730906+0000","last_active":"2023-08-17T17:53:18.730906+0000","last_peered":"2023-08-17T17:53:18.730906+0000","last_clean":"2023-08-17T17:53:18.730906+0000","last_became_active":"2023-08-17T17:53:18.730600+0000","last_became_peered":"2023-08-17T17:53:18.730600+0000","last_unstale":"2023-08-17T17:53:18.730906+0000","last_undegraded":"2023-08-17T17:53:18.730906+0000","last_fullsized":"2023-08-17T17:53:18.730906+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367958+0000","last_change":"2023-08-17T17:53:18.362831+0000","last_active":"2023-08-17T17:53:18.367958+0000","last_peered":"2023-08-17T17:53:18.367958+0000","last_clean":"2023-08-17T17:53:18.367958+0000","last_became_active":"2023-08-17T17:53:18.362546+0000","last_became_peered":"2023-08-17T17:53:18.362546+0000","last_unstale":"2023-08-17T17:53:18.367958+0000","last_undegraded":"2023-08-17T17:53:18.367958+0000","last_fullsized":"2023-08-17T17:53:18.367958+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731466+0000","last_change":"2023-08-17T17:53:18.731466+0000","last_active":"2023-08-17T17:53:18.731466+0000","last_peered":"2023-08-17T17:53:18.731466+0000","last_clean":"2023-08-17T17:53:18.731466+0000","last_became_active":"2023-08-17T17:53:18.731078+0000","last_became_peered":"2023-08-17T17:53:18.731078+0000","last_unstale":"2023-08-17T17:53:18.731466+0000","last_undegraded":"2023-08-17T17:53:18.731466+0000","last_fullsized":"2023-08-17T17:53:18.731466+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.369091+0000","last_change":"2023-08-17T17:53:18.365288+0000","last_active":"2023-08-17T17:53:18.369091+0000","last_peered":"2023-08-17T17:53:18.369091+0000","last_clean":"2023-08-17T17:53:18.369091+0000","last_became_active":"2023-08-17T17:53:18.364730+0000","last_became_peered":"2023-08-17T17:53:18.364730+0000","last_unstale":"2023-08-17T17:53:18.369091+0000","last_undegraded":"2023-08-17T17:53:18.369091+0000","last_fullsized":"2023-08-17T17:53:18.369091+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732416+0000","last_change":"2023-08-17T17:53:18.732416+0000","last_active":"2023-08-17T17:53:18.732416+0000","last_peered":"2023-08-17T17:53:18.732416+0000","last_clean":"2023-08-17T17:53:18.732416+0000","last_became_active":"2023-08-17T17:53:18.732114+0000","last_became_peered":"2023-08-17T17:53:18.732114+0000","last_unstale":"2023-08-17T17:53:18.732416+0000","last_undegraded":"2023-08-17T17:53:18.732416+0000","last_fullsized":"2023-08-17T17:53:18.732416+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367802+0000","last_change":"2023-08-17T17:53:18.361359+0000","last_active":"2023-08-17T17:53:18.367802+0000","last_peered":"2023-08-17T17:53:18.367802+0000","last_clean":"2023-08-17T17:53:18.367802+0000","last_became_active":"2023-08-17T17:53:18.361121+0000","last_became_peered":"2023-08-17T17:53:18.361121+0000","last_unstale":"2023-08-17T17:53:18.367802+0000","last_undegraded":"2023-08-17T17:53:18.367802+0000","last_fullsized":"2023-08-17T17:53:18.367802+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.728542+0000","last_change":"2023-08-17T17:53:18.728542+0000","last_active":"2023-08-17T17:53:18.728542+0000","last_peered":"2023-08-17T17:53:18.728542+0000","last_clean":"2023-08-17T17:53:18.728542+0000","last_became_active":"2023-08-17T17:53:18.728239+0000","last_became_peered":"2023-08-17T17:53:18.728239+0000","last_unstale":"2023-08-17T17:53:18.728542+0000","last_undegraded":"2023-08-17T17:53:18.728542+0000","last_fullsized":"2023-08-17T17:53:18.728542+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.371291+0000","last_change":"2023-08-17T17:53:18.358905+0000","last_active":"2023-08-17T17:53:18.371291+0000","last_peered":"2023-08-17T17:53:18.371291+0000","last_clean":"2023-08-17T17:53:18.371291+0000","last_became_active":"2023-08-17T17:53:18.358614+0000","last_became_peered":"2023-08-17T17:53:18.358614+0000","last_unstale":"2023-08-17T17:53:18.371291+0000","last_undegraded":"2023-08-17T17:53:18.371291+0000","last_fullsized":"2023-08-17T17:53:18.371291+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.737560+0000","last_change":"2023-08-17T17:53:18.737560+0000","last_active":"2023-08-17T17:53:18.737560+0000","last_peered":"2023-08-17T17:53:18.737560+0000","last_clean":"2023-08-17T17:53:18.737560+0000","last_became_active":"2023-08-17T17:53:18.737298+0000","last_became_peered":"2023-08-17T17:53:18.737298+0000","last_unstale":"2023-08-17T17:53:18.737560+0000","last_undegraded":"2023-08-17T17:53:18.737560+0000","last_fullsized":"2023-08-17T17:53:18.737560+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.376615+0000","last_change":"2023-08-17T17:53:18.371496+0000","last_active":"2023-08-17T17:53:18.376615+0000","last_peered":"2023-08-17T17:53:18.376615+0000","last_clean":"2023-08-17T17:53:18.376615+0000","last_became_active":"2023-08-17T17:53:18.371200+0000","last_became_peered":"2023-08-17T17:53:18.371200+0000","last_unstale":"2023-08-17T17:53:18.376615+0000","last_undegraded":"2023-08-17T17:53:18.376615+0000","last_fullsized":"2023-08-17T17:53:18.376615+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738172+0000","last_change":"2023-08-17T17:53:18.738172+0000","last_active":"2023-08-17T17:53:18.738172+0000","last_peered":"2023-08-17T17:53:18.738172+0000","last_clean":"2023-08-17T17:53:18.738172+0000","last_became_active":"2023-08-17T17:53:18.737960+0000","last_became_peered":"2023-08-17T17:53:18.737960+0000","last_unstale":"2023-08-17T17:53:18.738172+0000","last_undegraded":"2023-08-17T17:53:18.738172+0000","last_fullsized":"2023-08-17T17:53:18.738172+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367845+0000","last_change":"2023-08-17T17:53:18.359352+0000","last_active":"2023-08-17T17:53:18.367845+0000","last_peered":"2023-08-17T17:53:18.367845+0000","last_clean":"2023-08-17T17:53:18.367845+0000","last_became_active":"2023-08-17T17:53:18.359051+0000","last_became_peered":"2023-08-17T17:53:18.359051+0000","last_unstale":"2023-08-17T17:53:18.367845+0000","last_undegraded":"2023-08-17T17:53:18.367845+0000","last_fullsized":"2023-08-17T17:53:18.367845+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735902+0000","last_change":"2023-08-17T17:53:18.735902+0000","last_active":"2023-08-17T17:53:18.735902+0000","last_peered":"2023-08-17T17:53:18.735902+0000","last_clean":"2023-08-17T17:53:18.735902+0000","last_became_active":"2023-08-17T17:53:18.735542+0000","last_became_peered":"2023-08-17T17:53:18.735542+0000","last_unstale":"2023-08-17T17:53:18.735902+0000","last_undegraded":"2023-08-17T17:53:18.735902+0000","last_fullsized":"2023-08-17T17:53:18.735902+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368005+0000","last_change":"2023-08-17T17:53:18.363363+0000","last_active":"2023-08-17T17:53:18.368005+0000","last_peered":"2023-08-17T17:53:18.368005+0000","last_clean":"2023-08-17T17:53:18.368005+0000","last_became_active":"2023-08-17T17:53:18.363054+0000","last_became_peered":"2023-08-17T17:53:18.363054+0000","last_unstale":"2023-08-17T17:53:18.368005+0000","last_undegraded":"2023-08-17T17:53:18.368005+0000","last_fullsized":"2023-08-17T17:53:18.368005+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731836+0000","last_change":"2023-08-17T17:53:18.731836+0000","last_active":"2023-08-17T17:53:18.731836+0000","last_peered":"2023-08-17T17:53:18.731836+0000","last_clean":"2023-08-17T17:53:18.731836+0000","last_became_active":"2023-08-17T17:53:18.731503+0000","last_became_peered":"2023-08-17T17:53:18.731503+0000","last_unstale":"2023-08-17T17:53:18.731836+0000","last_undegraded":"2023-08-17T17:53:18.731836+0000","last_fullsized":"2023-08-17T17:53:18.731836+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.363351+0000","last_change":"2023-08-17T17:53:18.357741+0000","last_active":"2023-08-17T17:53:18.363351+0000","last_peered":"2023-08-17T17:53:18.363351+0000","last_clean":"2023-08-17T17:53:18.363351+0000","last_became_active":"2023-08-17T17:53:18.357456+0000","last_became_peered":"2023-08-17T17:53:18.357456+0000","last_unstale":"2023-08-17T17:53:18.363351+0000","last_undegraded":"2023-08-17T17:53:18.363351+0000","last_fullsized":"2023-08-17T17:53:18.363351+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.739530+0000","last_change":"2023-08-17T17:53:18.739530+0000","last_active":"2023-08-17T17:53:18.739530+0000","last_peered":"2023-08-17T17:53:18.739530+0000","last_clean":"2023-08-17T17:53:18.739530+0000","last_became_active":"2023-08-17T17:53:18.739248+0000","last_became_peered":"2023-08-17T17:53:18.739248+0000","last_unstale":"2023-08-17T17:53:18.739530+0000","last_undegraded":"2023-08-17T17:53:18.739530+0000","last_fullsized":"2023-08-17T17:53:18.739530+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.376671+0000","last_change":"2023-08-17T17:53:18.364749+0000","last_active":"2023-08-17T17:53:18.376671+0000","last_peered":"2023-08-17T17:53:18.376671+0000","last_clean":"2023-08-17T17:53:18.376671+0000","last_became_active":"2023-08-17T17:53:18.363739+0000","last_became_peered":"2023-08-17T17:53:18.363739+0000","last_unstale":"2023-08-17T17:53:18.376671+0000","last_undegraded":"2023-08-17T17:53:18.376671+0000","last_fullsized":"2023-08-17T17:53:18.376671+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733482+0000","last_change":"2023-08-17T17:53:18.733482+0000","last_active":"2023-08-17T17:53:18.733482+0000","last_peered":"2023-08-17T17:53:18.733482+0000","last_clean":"2023-08-17T17:53:18.733482+0000","last_became_active":"2023-08-17T17:53:18.733188+0000","last_became_peered":"2023-08-17T17:53:18.733188+0000","last_unstale":"2023-08-17T17:53:18.733482+0000","last_undegraded":"2023-08-17T17:53:18.733482+0000","last_fullsized":"2023-08-17T17:53:18.733482+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.369141+0000","last_change":"2023-08-17T17:53:18.363880+0000","last_active":"2023-08-17T17:53:18.369141+0000","last_peered":"2023-08-17T17:53:18.369141+0000","last_clean":"2023-08-17T17:53:18.369141+0000","last_became_active":"2023-08-17T17:53:18.363575+0000","last_became_peered":"2023-08-17T17:53:18.363575+0000","last_unstale":"2023-08-17T17:53:18.369141+0000","last_undegraded":"2023-08-17T17:53:18.369141+0000","last_fullsized":"2023-08-17T17:53:18.369141+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730217+0000","last_change":"2023-08-17T17:53:18.730217+0000","last_active":"2023-08-17T17:53:18.730217+0000","last_peered":"2023-08-17T17:53:18.730217+0000","last_clean":"2023-08-17T17:53:18.730217+0000","last_became_active":"2023-08-17T17:53:18.729947+0000","last_became_peered":"2023-08-17T17:53:18.729947+0000","last_unstale":"2023-08-17T17:53:18.730217+0000","last_undegraded":"2023-08-17T17:53:18.730217+0000","last_fullsized":"2023-08-17T17:53:18.730217+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.720372+0000","last_change":"2023-08-17T17:53:18.362887+0000","last_active":"2023-08-17T17:53:18.720372+0000","last_peered":"2023-08-17T17:53:18.720372+0000","last_clean":"2023-08-17T17:53:18.720372+0000","last_became_active":"2023-08-17T17:53:18.362613+0000","last_became_peered":"2023-08-17T17:53:18.362613+0000","last_unstale":"2023-08-17T17:53:18.720372+0000","last_undegraded":"2023-08-17T17:53:18.720372+0000","last_fullsized":"2023-08-17T17:53:18.720372+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.734743+0000","last_change":"2023-08-17T17:53:18.734743+0000","last_active":"2023-08-17T17:53:18.734743+0000","last_peered":"2023-08-17T17:53:18.734743+0000","last_clean":"2023-08-17T17:53:18.734743+0000","last_became_active":"2023-08-17T17:53:18.734464+0000","last_became_peered":"2023-08-17T17:53:18.734464+0000","last_unstale":"2023-08-17T17:53:18.734743+0000","last_undegraded":"2023-08-17T17:53:18.734743+0000","last_fullsized":"2023-08-17T17:53:18.734743+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.717249+0000","last_change":"2023-08-17T17:53:18.364959+0000","last_active":"2023-08-17T17:53:18.717249+0000","last_peered":"2023-08-17T17:53:18.717249+0000","last_clean":"2023-08-17T17:53:18.717249+0000","last_became_active":"2023-08-17T17:53:18.364479+0000","last_became_peered":"2023-08-17T17:53:18.364479+0000","last_unstale":"2023-08-17T17:53:18.717249+0000","last_undegraded":"2023-08-17T17:53:18.717249+0000","last_fullsized":"2023-08-17T17:53:18.717249+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.742773+0000","last_change":"2023-08-17T17:53:18.742773+0000","last_active":"2023-08-17T17:53:18.742773+0000","last_peered":"2023-08-17T17:53:18.742773+0000","last_clean":"2023-08-17T17:53:18.742773+0000","last_became_active":"2023-08-17T17:53:18.742491+0000","last_became_peered":"2023-08-17T17:53:18.742491+0000","last_unstale":"2023-08-17T17:53:18.742773+0000","last_undegraded":"2023-08-17T17:53:18.742773+0000","last_fullsized":"2023-08-17T17:53:18.742773+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"134'2","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736596+0000","last_change":"2023-08-17T17:53:18.365556+0000","last_active":"2023-08-17T17:53:18.736596+0000","last_peered":"2023-08-17T17:53:18.736596+0000","last_clean":"2023-08-17T17:53:18.736596+0000","last_became_active":"2023-08-17T17:53:18.364887+0000","last_became_peered":"2023-08-17T17:53:18.364887+0000","last_unstale":"2023-08-17T17:53:18.736596+0000","last_undegraded":"2023-08-17T17:53:18.736596+0000","last_fullsized":"2023-08-17T17:53:18.736596+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730598+0000","last_change":"2023-08-17T17:53:18.730598+0000","last_active":"2023-08-17T17:53:18.730598+0000","last_peered":"2023-08-17T17:53:18.730598+0000","last_clean":"2023-08-17T17:53:18.730598+0000","last_became_active":"2023-08-17T17:53:18.730286+0000","last_became_peered":"2023-08-17T17:53:18.730286+0000","last_unstale":"2023-08-17T17:53:18.730598+0000","last_undegraded":"2023-08-17T17:53:18.730598+0000","last_fullsized":"2023-08-17T17:53:18.730598+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.369480+0000","last_change":"2023-08-17T17:53:18.365502+0000","last_active":"2023-08-17T17:53:18.369480+0000","last_peered":"2023-08-17T17:53:18.369480+0000","last_clean":"2023-08-17T17:53:18.369480+0000","last_became_active":"2023-08-17T17:53:18.365169+0000","last_became_peered":"2023-08-17T17:53:18.365169+0000","last_unstale":"2023-08-17T17:53:18.369480+0000","last_undegraded":"2023-08-17T17:53:18.369480+0000","last_fullsized":"2023-08-17T17:53:18.369480+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736983+0000","last_change":"2023-08-17T17:53:18.736983+0000","last_active":"2023-08-17T17:53:18.736983+0000","last_peered":"2023-08-17T17:53:18.736983+0000","last_clean":"2023-08-17T17:53:18.736983+0000","last_became_active":"2023-08-17T17:53:18.736687+0000","last_became_peered":"2023-08-17T17:53:18.736687+0000","last_unstale":"2023-08-17T17:53:18.736983+0000","last_undegraded":"2023-08-17T17:53:18.736983+0000","last_fullsized":"2023-08-17T17:53:18.736983+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370351+0000","last_change":"2023-08-17T17:53:18.366846+0000","last_active":"2023-08-17T17:53:18.370351+0000","last_peered":"2023-08-17T17:53:18.370351+0000","last_clean":"2023-08-17T17:53:18.370351+0000","last_became_active":"2023-08-17T17:53:18.366513+0000","last_became_peered":"2023-08-17T17:53:18.366513+0000","last_unstale":"2023-08-17T17:53:18.370351+0000","last_undegraded":"2023-08-17T17:53:18.370351+0000","last_fullsized":"2023-08-17T17:53:18.370351+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.730576+0000","last_change":"2023-08-17T17:53:18.730576+0000","last_active":"2023-08-17T17:53:18.730576+0000","last_peered":"2023-08-17T17:53:18.730576+0000","last_clean":"2023-08-17T17:53:18.730576+0000","last_became_active":"2023-08-17T17:53:18.730271+0000","last_became_peered":"2023-08-17T17:53:18.730271+0000","last_unstale":"2023-08-17T17:53:18.730576+0000","last_undegraded":"2023-08-17T17:53:18.730576+0000","last_fullsized":"2023-08-17T17:53:18.730576+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.372023+0000","last_change":"2023-08-17T17:53:18.360902+0000","last_active":"2023-08-17T17:53:18.372023+0000","last_peered":"2023-08-17T17:53:18.372023+0000","last_clean":"2023-08-17T17:53:18.372023+0000","last_became_active":"2023-08-17T17:53:18.360360+0000","last_became_peered":"2023-08-17T17:53:18.360360+0000","last_unstale":"2023-08-17T17:53:18.372023+0000","last_undegraded":"2023-08-17T17:53:18.372023+0000","last_fullsized":"2023-08-17T17:53:18.372023+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.734873+0000","last_change":"2023-08-17T17:53:18.734873+0000","last_active":"2023-08-17T17:53:18.734873+0000","last_peered":"2023-08-17T17:53:18.734873+0000","last_clean":"2023-08-17T17:53:18.734873+0000","last_became_active":"2023-08-17T17:53:18.734610+0000","last_became_peered":"2023-08-17T17:53:18.734610+0000","last_unstale":"2023-08-17T17:53:18.734873+0000","last_undegraded":"2023-08-17T17:53:18.734873+0000","last_fullsized":"2023-08-17T17:53:18.734873+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.363081+0000","last_change":"2023-08-17T17:53:18.358641+0000","last_active":"2023-08-17T17:53:18.363081+0000","last_peered":"2023-08-17T17:53:18.363081+0000","last_clean":"2023-08-17T17:53:18.363081+0000","last_became_active":"2023-08-17T17:53:18.358368+0000","last_became_peered":"2023-08-17T17:53:18.358368+0000","last_unstale":"2023-08-17T17:53:18.363081+0000","last_undegraded":"2023-08-17T17:53:18.363081+0000","last_fullsized":"2023-08-17T17:53:18.363081+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731915+0000","last_change":"2023-08-17T17:53:18.731915+0000","last_active":"2023-08-17T17:53:18.731915+0000","last_peered":"2023-08-17T17:53:18.731915+0000","last_clean":"2023-08-17T17:53:18.731915+0000","last_became_active":"2023-08-17T17:53:18.731637+0000","last_became_peered":"2023-08-17T17:53:18.731637+0000","last_unstale":"2023-08-17T17:53:18.731915+0000","last_undegraded":"2023-08-17T17:53:18.731915+0000","last_fullsized":"2023-08-17T17:53:18.731915+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.379157+0000","last_change":"2023-08-17T17:53:18.371693+0000","last_active":"2023-08-17T17:53:18.379157+0000","last_peered":"2023-08-17T17:53:18.379157+0000","last_clean":"2023-08-17T17:53:18.379157+0000","last_became_active":"2023-08-17T17:53:18.370599+0000","last_became_peered":"2023-08-17T17:53:18.370599+0000","last_unstale":"2023-08-17T17:53:18.379157+0000","last_undegraded":"2023-08-17T17:53:18.379157+0000","last_fullsized":"2023-08-17T17:53:18.379157+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.742086+0000","last_change":"2023-08-17T17:53:18.742086+0000","last_active":"2023-08-17T17:53:18.742086+0000","last_peered":"2023-08-17T17:53:18.742086+0000","last_clean":"2023-08-17T17:53:18.742086+0000","last_became_active":"2023-08-17T17:53:18.741784+0000","last_became_peered":"2023-08-17T17:53:18.741784+0000","last_unstale":"2023-08-17T17:53:18.742086+0000","last_undegraded":"2023-08-17T17:53:18.742086+0000","last_fullsized":"2023-08-17T17:53:18.742086+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.716909+0000","last_change":"2023-08-17T17:53:18.363234+0000","last_active":"2023-08-17T17:53:18.716909+0000","last_peered":"2023-08-17T17:53:18.716909+0000","last_clean":"2023-08-17T17:53:18.716909+0000","last_became_active":"2023-08-17T17:53:18.362966+0000","last_became_peered":"2023-08-17T17:53:18.362966+0000","last_unstale":"2023-08-17T17:53:18.716909+0000","last_undegraded":"2023-08-17T17:53:18.716909+0000","last_fullsized":"2023-08-17T17:53:18.716909+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.733209+0000","last_change":"2023-08-17T17:53:18.733209+0000","last_active":"2023-08-17T17:53:18.733209+0000","last_peered":"2023-08-17T17:53:18.733209+0000","last_clean":"2023-08-17T17:53:18.733209+0000","last_became_active":"2023-08-17T17:53:18.732718+0000","last_became_peered":"2023-08-17T17:53:18.732718+0000","last_unstale":"2023-08-17T17:53:18.733209+0000","last_undegraded":"2023-08-17T17:53:18.733209+0000","last_fullsized":"2023-08-17T17:53:18.733209+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"134'2","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.742637+0000","last_change":"2023-08-17T17:53:18.372373+0000","last_active":"2023-08-17T17:53:18.742637+0000","last_peered":"2023-08-17T17:53:18.742637+0000","last_clean":"2023-08-17T17:53:18.742637+0000","last_became_active":"2023-08-17T17:53:18.371650+0000","last_became_peered":"2023-08-17T17:53:18.371650+0000","last_unstale":"2023-08-17T17:53:18.742637+0000","last_undegraded":"2023-08-17T17:53:18.742637+0000","last_fullsized":"2023-08-17T17:53:18.742637+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735961+0000","last_change":"2023-08-17T17:53:18.735961+0000","last_active":"2023-08-17T17:53:18.735961+0000","last_peered":"2023-08-17T17:53:18.735961+0000","last_clean":"2023-08-17T17:53:18.735961+0000","last_became_active":"2023-08-17T17:53:18.735689+0000","last_became_peered":"2023-08-17T17:53:18.735689+0000","last_unstale":"2023-08-17T17:53:18.735961+0000","last_undegraded":"2023-08-17T17:53:18.735961+0000","last_fullsized":"2023-08-17T17:53:18.735961+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370748+0000","last_change":"2023-08-17T17:53:18.365753+0000","last_active":"2023-08-17T17:53:18.370748+0000","last_peered":"2023-08-17T17:53:18.370748+0000","last_clean":"2023-08-17T17:53:18.370748+0000","last_became_active":"2023-08-17T17:53:18.364915+0000","last_became_peered":"2023-08-17T17:53:18.364915+0000","last_unstale":"2023-08-17T17:53:18.370748+0000","last_undegraded":"2023-08-17T17:53:18.370748+0000","last_fullsized":"2023-08-17T17:53:18.370748+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732552+0000","last_change":"2023-08-17T17:53:18.732552+0000","last_active":"2023-08-17T17:53:18.732552+0000","last_peered":"2023-08-17T17:53:18.732552+0000","last_clean":"2023-08-17T17:53:18.732552+0000","last_became_active":"2023-08-17T17:53:18.732263+0000","last_became_peered":"2023-08-17T17:53:18.732263+0000","last_unstale":"2023-08-17T17:53:18.732552+0000","last_undegraded":"2023-08-17T17:53:18.732552+0000","last_fullsized":"2023-08-17T17:53:18.732552+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.373536+0000","last_change":"2023-08-17T17:53:18.371993+0000","last_active":"2023-08-17T17:53:18.373536+0000","last_peered":"2023-08-17T17:53:18.373536+0000","last_clean":"2023-08-17T17:53:18.373536+0000","last_became_active":"2023-08-17T17:53:18.371658+0000","last_became_peered":"2023-08-17T17:53:18.371658+0000","last_unstale":"2023-08-17T17:53:18.373536+0000","last_undegraded":"2023-08-17T17:53:18.373536+0000","last_fullsized":"2023-08-17T17:53:18.373536+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736356+0000","last_change":"2023-08-17T17:53:18.736356+0000","last_active":"2023-08-17T17:53:18.736356+0000","last_peered":"2023-08-17T17:53:18.736356+0000","last_clean":"2023-08-17T17:53:18.736356+0000","last_became_active":"2023-08-17T17:53:18.736117+0000","last_became_peered":"2023-08-17T17:53:18.736117+0000","last_unstale":"2023-08-17T17:53:18.736356+0000","last_undegraded":"2023-08-17T17:53:18.736356+0000","last_fullsized":"2023-08-17T17:53:18.736356+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.719457+0000","last_change":"2023-08-17T17:53:18.364009+0000","last_active":"2023-08-17T17:53:18.719457+0000","last_peered":"2023-08-17T17:53:18.719457+0000","last_clean":"2023-08-17T17:53:18.719457+0000","last_became_active":"2023-08-17T17:53:18.363718+0000","last_became_peered":"2023-08-17T17:53:18.363718+0000","last_unstale":"2023-08-17T17:53:18.719457+0000","last_undegraded":"2023-08-17T17:53:18.719457+0000","last_fullsized":"2023-08-17T17:53:18.719457+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732009+0000","last_change":"2023-08-17T17:53:18.732009+0000","last_active":"2023-08-17T17:53:18.732009+0000","last_peered":"2023-08-17T17:53:18.732009+0000","last_clean":"2023-08-17T17:53:18.732009+0000","last_became_active":"2023-08-17T17:53:18.731756+0000","last_became_peered":"2023-08-17T17:53:18.731756+0000","last_unstale":"2023-08-17T17:53:18.732009+0000","last_undegraded":"2023-08-17T17:53:18.732009+0000","last_fullsized":"2023-08-17T17:53:18.732009+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370841+0000","last_change":"2023-08-17T17:53:18.368414+0000","last_active":"2023-08-17T17:53:18.370841+0000","last_peered":"2023-08-17T17:53:18.370841+0000","last_clean":"2023-08-17T17:53:18.370841+0000","last_became_active":"2023-08-17T17:53:18.368203+0000","last_became_peered":"2023-08-17T17:53:18.368203+0000","last_unstale":"2023-08-17T17:53:18.370841+0000","last_undegraded":"2023-08-17T17:53:18.370841+0000","last_fullsized":"2023-08-17T17:53:18.370841+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738988+0000","last_change":"2023-08-17T17:53:18.738988+0000","last_active":"2023-08-17T17:53:18.738988+0000","last_peered":"2023-08-17T17:53:18.738988+0000","last_clean":"2023-08-17T17:53:18.738988+0000","last_became_active":"2023-08-17T17:53:18.737073+0000","last_became_peered":"2023-08-17T17:53:18.737073+0000","last_unstale":"2023-08-17T17:53:18.738988+0000","last_undegraded":"2023-08-17T17:53:18.738988+0000","last_fullsized":"2023-08-17T17:53:18.738988+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.366871+0000","last_change":"2023-08-17T17:53:18.359703+0000","last_active":"2023-08-17T17:53:18.366871+0000","last_peered":"2023-08-17T17:53:18.366871+0000","last_clean":"2023-08-17T17:53:18.366871+0000","last_became_active":"2023-08-17T17:53:18.359236+0000","last_became_peered":"2023-08-17T17:53:18.359236+0000","last_unstale":"2023-08-17T17:53:18.366871+0000","last_undegraded":"2023-08-17T17:53:18.366871+0000","last_fullsized":"2023-08-17T17:53:18.366871+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736401+0000","last_change":"2023-08-17T17:53:18.736401+0000","last_active":"2023-08-17T17:53:18.736401+0000","last_peered":"2023-08-17T17:53:18.736401+0000","last_clean":"2023-08-17T17:53:18.736401+0000","last_became_active":"2023-08-17T17:53:18.736166+0000","last_became_peered":"2023-08-17T17:53:18.736166+0000","last_unstale":"2023-08-17T17:53:18.736401+0000","last_undegraded":"2023-08-17T17:53:18.736401+0000","last_fullsized":"2023-08-17T17:53:18.736401+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.368742+0000","last_change":"2023-08-17T17:53:18.364969+0000","last_active":"2023-08-17T17:53:18.368742+0000","last_peered":"2023-08-17T17:53:18.368742+0000","last_clean":"2023-08-17T17:53:18.368742+0000","last_became_active":"2023-08-17T17:53:18.364558+0000","last_became_peered":"2023-08-17T17:53:18.364558+0000","last_unstale":"2023-08-17T17:53:18.368742+0000","last_undegraded":"2023-08-17T17:53:18.368742+0000","last_fullsized":"2023-08-17T17:53:18.368742+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738031+0000","last_change":"2023-08-17T17:53:18.738031+0000","last_active":"2023-08-17T17:53:18.738031+0000","last_peered":"2023-08-17T17:53:18.738031+0000","last_clean":"2023-08-17T17:53:18.738031+0000","last_became_active":"2023-08-17T17:53:18.737581+0000","last_became_peered":"2023-08-17T17:53:18.737581+0000","last_unstale":"2023-08-17T17:53:18.738031+0000","last_undegraded":"2023-08-17T17:53:18.738031+0000","last_fullsized":"2023-08-17T17:53:18.738031+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"134'2","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735083+0000","last_change":"2023-08-17T17:53:18.369217+0000","last_active":"2023-08-17T17:53:18.735083+0000","last_peered":"2023-08-17T17:53:18.735083+0000","last_clean":"2023-08-17T17:53:18.735083+0000","last_became_active":"2023-08-17T17:53:18.368863+0000","last_became_peered":"2023-08-17T17:53:18.368863+0000","last_unstale":"2023-08-17T17:53:18.735083+0000","last_undegraded":"2023-08-17T17:53:18.735083+0000","last_fullsized":"2023-08-17T17:53:18.735083+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736908+0000","last_change":"2023-08-17T17:53:18.736908+0000","last_active":"2023-08-17T17:53:18.736908+0000","last_peered":"2023-08-17T17:53:18.736908+0000","last_clean":"2023-08-17T17:53:18.736908+0000","last_became_active":"2023-08-17T17:53:18.736652+0000","last_became_peered":"2023-08-17T17:53:18.736652+0000","last_unstale":"2023-08-17T17:53:18.736908+0000","last_undegraded":"2023-08-17T17:53:18.736908+0000","last_fullsized":"2023-08-17T17:53:18.736908+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.365861+0000","last_change":"2023-08-17T17:53:18.359507+0000","last_active":"2023-08-17T17:53:18.365861+0000","last_peered":"2023-08-17T17:53:18.365861+0000","last_clean":"2023-08-17T17:53:18.365861+0000","last_became_active":"2023-08-17T17:53:18.359046+0000","last_became_peered":"2023-08-17T17:53:18.359046+0000","last_unstale":"2023-08-17T17:53:18.365861+0000","last_undegraded":"2023-08-17T17:53:18.365861+0000","last_fullsized":"2023-08-17T17:53:18.365861+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.738591+0000","last_change":"2023-08-17T17:53:18.738591+0000","last_active":"2023-08-17T17:53:18.738591+0000","last_peered":"2023-08-17T17:53:18.738591+0000","last_clean":"2023-08-17T17:53:18.738591+0000","last_became_active":"2023-08-17T17:53:18.738311+0000","last_became_peered":"2023-08-17T17:53:18.738311+0000","last_unstale":"2023-08-17T17:53:18.738591+0000","last_undegraded":"2023-08-17T17:53:18.738591+0000","last_fullsized":"2023-08-17T17:53:18.738591+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.363893+0000","last_change":"2023-08-17T17:53:18.358839+0000","last_active":"2023-08-17T17:53:18.363893+0000","last_peered":"2023-08-17T17:53:18.363893+0000","last_clean":"2023-08-17T17:53:18.363893+0000","last_became_active":"2023-08-17T17:53:18.358512+0000","last_became_peered":"2023-08-17T17:53:18.358512+0000","last_unstale":"2023-08-17T17:53:18.363893+0000","last_undegraded":"2023-08-17T17:53:18.363893+0000","last_fullsized":"2023-08-17T17:53:18.363893+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732945+0000","last_change":"2023-08-17T17:53:18.732945+0000","last_active":"2023-08-17T17:53:18.732945+0000","last_peered":"2023-08-17T17:53:18.732945+0000","last_clean":"2023-08-17T17:53:18.732945+0000","last_became_active":"2023-08-17T17:53:18.732671+0000","last_became_peered":"2023-08-17T17:53:18.732671+0000","last_unstale":"2023-08-17T17:53:18.732945+0000","last_undegraded":"2023-08-17T17:53:18.732945+0000","last_fullsized":"2023-08-17T17:53:18.732945+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.376691+0000","last_change":"2023-08-17T17:53:18.368558+0000","last_active":"2023-08-17T17:53:18.376691+0000","last_peered":"2023-08-17T17:53:18.376691+0000","last_clean":"2023-08-17T17:53:18.376691+0000","last_became_active":"2023-08-17T17:53:18.368209+0000","last_became_peered":"2023-08-17T17:53:18.368209+0000","last_unstale":"2023-08-17T17:53:18.376691+0000","last_undegraded":"2023-08-17T17:53:18.376691+0000","last_fullsized":"2023-08-17T17:53:18.376691+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.735861+0000","last_change":"2023-08-17T17:53:18.735861+0000","last_active":"2023-08-17T17:53:18.735861+0000","last_peered":"2023-08-17T17:53:18.735861+0000","last_clean":"2023-08-17T17:53:18.735861+0000","last_became_active":"2023-08-17T17:53:18.735592+0000","last_became_peered":"2023-08-17T17:53:18.735592+0000","last_unstale":"2023-08-17T17:53:18.735861+0000","last_undegraded":"2023-08-17T17:53:18.735861+0000","last_fullsized":"2023-08-17T17:53:18.735861+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367986+0000","last_change":"2023-08-17T17:53:18.362985+0000","last_active":"2023-08-17T17:53:18.367986+0000","last_peered":"2023-08-17T17:53:18.367986+0000","last_clean":"2023-08-17T17:53:18.367986+0000","last_became_active":"2023-08-17T17:53:18.362476+0000","last_became_peered":"2023-08-17T17:53:18.362476+0000","last_unstale":"2023-08-17T17:53:18.367986+0000","last_undegraded":"2023-08-17T17:53:18.367986+0000","last_fullsized":"2023-08-17T17:53:18.367986+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736197+0000","last_change":"2023-08-17T17:53:18.736197+0000","last_active":"2023-08-17T17:53:18.736197+0000","last_peered":"2023-08-17T17:53:18.736197+0000","last_clean":"2023-08-17T17:53:18.736197+0000","last_became_active":"2023-08-17T17:53:18.735927+0000","last_became_peered":"2023-08-17T17:53:18.735927+0000","last_unstale":"2023-08-17T17:53:18.736197+0000","last_undegraded":"2023-08-17T17:53:18.736197+0000","last_fullsized":"2023-08-17T17:53:18.736197+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367937+0000","last_change":"2023-08-17T17:53:18.363727+0000","last_active":"2023-08-17T17:53:18.367937+0000","last_peered":"2023-08-17T17:53:18.367937+0000","last_clean":"2023-08-17T17:53:18.367937+0000","last_became_active":"2023-08-17T17:53:18.363443+0000","last_became_peered":"2023-08-17T17:53:18.363443+0000","last_unstale":"2023-08-17T17:53:18.367937+0000","last_undegraded":"2023-08-17T17:53:18.367937+0000","last_fullsized":"2023-08-17T17:53:18.367937+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.728412+0000","last_change":"2023-08-17T17:53:18.728412+0000","last_active":"2023-08-17T17:53:18.728412+0000","last_peered":"2023-08-17T17:53:18.728412+0000","last_clean":"2023-08-17T17:53:18.728412+0000","last_became_active":"2023-08-17T17:53:18.728126+0000","last_became_peered":"2023-08-17T17:53:18.728126+0000","last_unstale":"2023-08-17T17:53:18.728412+0000","last_undegraded":"2023-08-17T17:53:18.728412+0000","last_fullsized":"2023-08-17T17:53:18.728412+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.376650+0000","last_change":"2023-08-17T17:53:18.364561+0000","last_active":"2023-08-17T17:53:18.376650+0000","last_peered":"2023-08-17T17:53:18.376650+0000","last_clean":"2023-08-17T17:53:18.376650+0000","last_became_active":"2023-08-17T17:53:18.364277+0000","last_became_peered":"2023-08-17T17:53:18.364277+0000","last_unstale":"2023-08-17T17:53:18.376650+0000","last_undegraded":"2023-08-17T17:53:18.376650+0000","last_fullsized":"2023-08-17T17:53:18.376650+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731444+0000","last_change":"2023-08-17T17:53:18.731444+0000","last_active":"2023-08-17T17:53:18.731444+0000","last_peered":"2023-08-17T17:53:18.731444+0000","last_clean":"2023-08-17T17:53:18.731444+0000","last_became_active":"2023-08-17T17:53:18.731150+0000","last_became_peered":"2023-08-17T17:53:18.731150+0000","last_unstale":"2023-08-17T17:53:18.731444+0000","last_undegraded":"2023-08-17T17:53:18.731444+0000","last_fullsized":"2023-08-17T17:53:18.731444+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.370894+0000","last_change":"2023-08-17T17:53:18.367385+0000","last_active":"2023-08-17T17:53:18.370894+0000","last_peered":"2023-08-17T17:53:18.370894+0000","last_clean":"2023-08-17T17:53:18.370894+0000","last_became_active":"2023-08-17T17:53:18.367063+0000","last_became_peered":"2023-08-17T17:53:18.367063+0000","last_unstale":"2023-08-17T17:53:18.370894+0000","last_undegraded":"2023-08-17T17:53:18.370894+0000","last_fullsized":"2023-08-17T17:53:18.370894+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.732859+0000","last_change":"2023-08-17T17:53:18.732859+0000","last_active":"2023-08-17T17:53:18.732859+0000","last_peered":"2023-08-17T17:53:18.732859+0000","last_clean":"2023-08-17T17:53:18.732859+0000","last_became_active":"2023-08-17T17:53:18.732543+0000","last_became_peered":"2023-08-17T17:53:18.732543+0000","last_unstale":"2023-08-17T17:53:18.732859+0000","last_undegraded":"2023-08-17T17:53:18.732859+0000","last_fullsized":"2023-08-17T17:53:18.732859+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.373641+0000","last_change":"2023-08-17T17:53:18.371961+0000","last_active":"2023-08-17T17:53:18.373641+0000","last_peered":"2023-08-17T17:53:18.373641+0000","last_clean":"2023-08-17T17:53:18.373641+0000","last_became_active":"2023-08-17T17:53:18.371644+0000","last_became_peered":"2023-08-17T17:53:18.371644+0000","last_unstale":"2023-08-17T17:53:18.373641+0000","last_undegraded":"2023-08-17T17:53:18.373641+0000","last_fullsized":"2023-08-17T17:53:18.373641+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.353289+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:53:18.353289+0000","last_peered":"2023-08-17T17:53:18.353289+0000","last_clean":"2023-08-17T17:53:18.353289+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:53:18.353289+0000","last_undegraded":"2023-08-17T17:53:18.353289+0000","last_fullsized":"2023-08-17T17:53:18.353289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.737006+0000","last_change":"2023-08-17T17:53:18.737006+0000","last_active":"2023-08-17T17:53:18.737006+0000","last_peered":"2023-08-17T17:53:18.737006+0000","last_clean":"2023-08-17T17:53:18.737006+0000","last_became_active":"2023-08-17T17:53:18.736738+0000","last_became_peered":"2023-08-17T17:53:18.736738+0000","last_unstale":"2023-08-17T17:53:18.737006+0000","last_undegraded":"2023-08-17T17:53:18.737006+0000","last_fullsized":"2023-08-17T17:53:18.737006+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.369534+0000","last_change":"2023-08-17T17:53:18.366776+0000","last_active":"2023-08-17T17:53:18.369534+0000","last_peered":"2023-08-17T17:53:18.369534+0000","last_clean":"2023-08-17T17:53:18.369534+0000","last_became_active":"2023-08-17T17:53:18.365742+0000","last_became_peered":"2023-08-17T17:53:18.365742+0000","last_unstale":"2023-08-17T17:53:18.369534+0000","last_undegraded":"2023-08-17T17:53:18.369534+0000","last_fullsized":"2023-08-17T17:53:18.369534+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.352827+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:53:18.352827+0000","last_peered":"2023-08-17T17:53:18.352827+0000","last_clean":"2023-08-17T17:53:18.352827+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:53:18.352827+0000","last_undegraded":"2023-08-17T17:53:18.352827+0000","last_fullsized":"2023-08-17T17:53:18.352827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731504+0000","last_change":"2023-08-17T17:53:18.731504+0000","last_active":"2023-08-17T17:53:18.731504+0000","last_peered":"2023-08-17T17:53:18.731504+0000","last_clean":"2023-08-17T17:53:18.731504+0000","last_became_active":"2023-08-17T17:53:18.731241+0000","last_became_peered":"2023-08-17T17:53:18.731241+0000","last_unstale":"2023-08-17T17:53:18.731504+0000","last_undegraded":"2023-08-17T17:53:18.731504+0000","last_fullsized":"2023-08-17T17:53:18.731504+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.367748+0000","last_change":"2023-08-17T17:53:18.363625+0000","last_active":"2023-08-17T17:53:18.367748+0000","last_peered":"2023-08-17T17:53:18.367748+0000","last_clean":"2023-08-17T17:53:18.367748+0000","last_became_active":"2023-08-17T17:53:18.363351+0000","last_became_peered":"2023-08-17T17:53:18.363351+0000","last_unstale":"2023-08-17T17:53:18.367748+0000","last_undegraded":"2023-08-17T17:53:18.367748+0000","last_fullsized":"2023-08-17T17:53:18.367748+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":102,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.355825+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:53:18.355825+0000","last_peered":"2023-08-17T17:53:18.355825+0000","last_clean":"2023-08-17T17:53:18.355825+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:53:18.355825+0000","last_undegraded":"2023-08-17T17:53:18.355825+0000","last_fullsized":"2023-08-17T17:53:18.355825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.731340+0000","last_change":"2023-08-17T17:53:18.731340+0000","last_active":"2023-08-17T17:53:18.731340+0000","last_peered":"2023-08-17T17:53:18.731340+0000","last_clean":"2023-08-17T17:53:18.731340+0000","last_became_active":"2023-08-17T17:53:18.730705+0000","last_became_peered":"2023-08-17T17:53:18.730705+0000","last_unstale":"2023-08-17T17:53:18.731340+0000","last_undegraded":"2023-08-17T17:53:18.731340+0000","last_fullsized":"2023-08-17T17:53:18.731340+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"134'4","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.740425+0000","last_change":"2023-08-17T17:53:18.364945+0000","last_active":"2023-08-17T17:53:18.740425+0000","last_peered":"2023-08-17T17:53:18.740425+0000","last_clean":"2023-08-17T17:53:18.740425+0000","last_became_active":"2023-08-17T17:53:18.364670+0000","last_became_peered":"2023-08-17T17:53:18.364670+0000","last_unstale":"2023-08-17T17:53:18.740425+0000","last_undegraded":"2023-08-17T17:53:18.740425+0000","last_fullsized":"2023-08-17T17:53:18.740425+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.351612+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:53:18.351612+0000","last_peered":"2023-08-17T17:53:18.351612+0000","last_clean":"2023-08-17T17:53:18.351612+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:53:18.351612+0000","last_undegraded":"2023-08-17T17:53:18.351612+0000","last_fullsized":"2023-08-17T17:53:18.351612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":101,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.358640+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:53:18.358640+0000","last_peered":"2023-08-17T17:53:18.358640+0000","last_clean":"2023-08-17T17:53:18.358640+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:53:18.358640+0000","last_undegraded":"2023-08-17T17:53:18.358640+0000","last_fullsized":"2023-08-17T17:53:18.358640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.734207+0000","last_change":"2023-08-17T17:53:18.734207+0000","last_active":"2023-08-17T17:53:18.734207+0000","last_peered":"2023-08-17T17:53:18.734207+0000","last_clean":"2023-08-17T17:53:18.734207+0000","last_became_active":"2023-08-17T17:53:18.733902+0000","last_became_peered":"2023-08-17T17:53:18.733902+0000","last_unstale":"2023-08-17T17:53:18.734207+0000","last_undegraded":"2023-08-17T17:53:18.734207+0000","last_fullsized":"2023-08-17T17:53:18.734207+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"134'1","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.724710+0000","last_change":"2023-08-17T17:53:18.364869+0000","last_active":"2023-08-17T17:53:18.724710+0000","last_peered":"2023-08-17T17:53:18.724710+0000","last_clean":"2023-08-17T17:53:18.724710+0000","last_became_active":"2023-08-17T17:53:18.364597+0000","last_became_peered":"2023-08-17T17:53:18.364597+0000","last_unstale":"2023-08-17T17:53:18.724710+0000","last_undegraded":"2023-08-17T17:53:18.724710+0000","last_fullsized":"2023-08-17T17:53:18.724710+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.358740+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:53:18.358740+0000","last_peered":"2023-08-17T17:53:18.358740+0000","last_clean":"2023-08-17T17:53:18.358740+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:53:18.358740+0000","last_undegraded":"2023-08-17T17:53:18.358740+0000","last_fullsized":"2023-08-17T17:53:18.358740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736128+0000","last_change":"2023-08-17T17:53:18.736128+0000","last_active":"2023-08-17T17:53:18.736128+0000","last_peered":"2023-08-17T17:53:18.736128+0000","last_clean":"2023-08-17T17:53:18.736128+0000","last_became_active":"2023-08-17T17:53:18.735701+0000","last_became_peered":"2023-08-17T17:53:18.735701+0000","last_unstale":"2023-08-17T17:53:18.736128+0000","last_undegraded":"2023-08-17T17:53:18.736128+0000","last_fullsized":"2023-08-17T17:53:18.736128+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.363618+0000","last_change":"2023-08-17T17:53:18.358278+0000","last_active":"2023-08-17T17:53:18.363618+0000","last_peered":"2023-08-17T17:53:18.363618+0000","last_clean":"2023-08-17T17:53:18.363618+0000","last_became_active":"2023-08-17T17:53:18.357985+0000","last_became_peered":"2023-08-17T17:53:18.357985+0000","last_unstale":"2023-08-17T17:53:18.363618+0000","last_undegraded":"2023-08-17T17:53:18.363618+0000","last_fullsized":"2023-08-17T17:53:18.363618+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.357111+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:53:18.357111+0000","last_peered":"2023-08-17T17:53:18.357111+0000","last_clean":"2023-08-17T17:53:18.357111+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:53:18.357111+0000","last_undegraded":"2023-08-17T17:53:18.357111+0000","last_fullsized":"2023-08-17T17:53:18.357111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.736054+0000","last_change":"2023-08-17T17:53:18.736054+0000","last_active":"2023-08-17T17:53:18.736054+0000","last_peered":"2023-08-17T17:53:18.736054+0000","last_clean":"2023-08-17T17:53:18.736054+0000","last_became_active":"2023-08-17T17:53:18.735794+0000","last_became_peered":"2023-08-17T17:53:18.735794+0000","last_unstale":"2023-08-17T17:53:18.736054+0000","last_undegraded":"2023-08-17T17:53:18.736054+0000","last_fullsized":"2023-08-17T17:53:18.736054+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"134'3","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.737758+0000","last_change":"2023-08-17T17:53:18.364960+0000","last_active":"2023-08-17T17:53:18.737758+0000","last_peered":"2023-08-17T17:53:18.737758+0000","last_clean":"2023-08-17T17:53:18.737758+0000","last_became_active":"2023-08-17T17:53:18.364638+0000","last_became_peered":"2023-08-17T17:53:18.364638+0000","last_unstale":"2023-08-17T17:53:18.737758+0000","last_undegraded":"2023-08-17T17:53:18.737758+0000","last_fullsized":"2023-08-17T17:53:18.737758+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.351694+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:53:18.351694+0000","last_peered":"2023-08-17T17:53:18.351694+0000","last_clean":"2023-08-17T17:53:18.351694+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:53:18.351694+0000","last_undegraded":"2023-08-17T17:53:18.351694+0000","last_fullsized":"2023-08-17T17:53:18.351694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.737230+0000","last_change":"2023-08-17T17:53:18.737230+0000","last_active":"2023-08-17T17:53:18.737230+0000","last_peered":"2023-08-17T17:53:18.737230+0000","last_clean":"2023-08-17T17:53:18.737230+0000","last_became_active":"2023-08-17T17:53:18.736949+0000","last_became_peered":"2023-08-17T17:53:18.736949+0000","last_unstale":"2023-08-17T17:53:18.737230+0000","last_undegraded":"2023-08-17T17:53:18.737230+0000","last_fullsized":"2023-08-17T17:53:18.737230+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:18.337942+0000","last_clean_scrub_stamp":"2023-08-17T17:53:18.337942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"134'2","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.740336+0000","last_change":"2023-08-17T17:53:18.367467+0000","last_active":"2023-08-17T17:53:18.740336+0000","last_peered":"2023-08-17T17:53:18.740336+0000","last_clean":"2023-08-17T17:53:18.740336+0000","last_became_active":"2023-08-17T17:53:18.367181+0000","last_became_peered":"2023-08-17T17:53:18.367181+0000","last_unstale":"2023-08-17T17:53:18.740336+0000","last_undegraded":"2023-08-17T17:53:18.740336+0000","last_fullsized":"2023-08-17T17:53:18.740336+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:17.333163+0000","last_clean_scrub_stamp":"2023-08-17T17:53:17.333163+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-17T17:53:18.352485+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:53:18.352485+0000","last_peered":"2023-08-17T17:53:18.352485+0000","last_clean":"2023-08-17T17:53:18.352485+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:53:18.352485+0000","last_undegraded":"2023-08-17T17:53:18.352485+0000","last_fullsized":"2023-08-17T17:53:18.352485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575073,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302816,"kb_used_data":1624,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069024,"statfs":{"total":96636764160,"available":96326680576,"internally_reserved":0,"allocated":1662976,"data_stored":826284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.42099999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.75800000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.498}]},{"osd":1,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.83299999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.59699999999999998,"5min":0.745,"15min":0.80000000000000004},"last":0.623}]},{"osd":2,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.435},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.436,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":1.23,"15min":1.23},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76100000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.60999999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.86099999999999999},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.85499999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.90200000000000002},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575073,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302792,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069048,"statfs":{"total":96636764160,"available":96326705152,"internally_reserved":0,"allocated":1638400,"data_stored":812426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70499999999999996,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.60699999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69099999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.84599999999999997,"15min":1.0609999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.373},"max":{"1min":0.69699999999999995,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.46899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.67600000000000005,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.5}]},{"osd":4,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.443,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.75800000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.74199999999999999,"15min":0.77300000000000002},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":1.51},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.872},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.747,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.34799999999999998},"min":{"1min":0.25900000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45800000000000002,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.5,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.36399999999999999},"min":{"1min":0.26800000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.70799999999999996},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.63600000000000001,"15min":0.66300000000000003},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.33200000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"last":0.314},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.30399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.63300000000000001},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.89600000000000002,"15min":0.93200000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85299999999999998,"5min":1.2989999999999999,"15min":1.331},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84499999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86799999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.627},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.54000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575073,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.61599999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.377,"15min":0.38400000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.57099999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.36499999999999999},"min":{"1min":0.22800000000000001,"5min":0.19900000000000001,"15min":0.19400000000000001},"max":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.39500000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55400000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.41199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.26200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.378}]},{"osd":4,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0569999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.034,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.095,"5min":1.677,"15min":1.677},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.99099999999999999,"5min":1.51,"15min":1.51},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0740000000000001,"5min":1.325,"15min":1.391},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":1.103,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.505},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0980000000000001,"15min":1.544},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575073,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32900000000000001,"15min":0.34599999999999997},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49199999999999999,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.435}]},{"osd":1,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.503},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.41599999999999998},"min":{"1min":0.25600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.41899999999999998},"min":{"1min":0.308,"5min":0.27800000000000002,"15min":0.27200000000000002},"max":{"1min":0.58299999999999996,"5min":0.63,"15min":1.268},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88,"5min":1.417,"15min":1.417},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":1.51,"15min":2.9220000000000002},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":1.544,"15min":1.544},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.872,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":1.415,"15min":1.415},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.81499999999999995,"5min":1.3859999999999999,"15min":2.984},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.70899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.56299999999999994},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.375},"min":{"1min":0.251,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.54800000000000004,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38300000000000001,"15min":0.39100000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.63300000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.76700000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.629},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.78800000000000003,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86699999999999999,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":2.609},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.433,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.3260000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81699999999999995,"5min":1.466,"15min":1.466},"last":1.157},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.48,"15min":1.48},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82299999999999995,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":2.3490000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575074,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.26400000000000001},"max":{"1min":0.77000000000000002,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.441},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.81000000000000005,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.55200000000000005},"min":{"1min":0.45200000000000001,"5min":0.34300000000000003,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":1.252,"15min":1.252},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.306,"15min":1.306},"last":0.499}]},{"osd":2,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88800000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":1.444,"15min":1.444},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80600000000000005,"5min":1.482,"15min":1.482},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.86299999999999999,"5min":1.123,"15min":1.123},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.38},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":1.002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.48299999999999998},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.91100000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":1.048,"15min":1.048},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.056},"last":0.56100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575072,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302804,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069036,"statfs":{"total":96636764160,"available":96326692864,"internally_reserved":0,"allocated":1650688,"data_stored":819105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69299999999999995,"5min":1.165,"15min":1.165},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":1.022,"15min":1.022},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.68500000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.41599999999999998,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.76400000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.441},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":1.153,"15min":1.153},"last":0.505}]},{"osd":3,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":1.036,"15min":1.036},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.255},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.379},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35899999999999999,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.498},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:53:22.051 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T17:53:22.052 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T17:53:22.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.202+0000 7f049b59e700 1 Processor -- start 2023-08-17T17:53:22.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.202+0000 7f049b59e700 1 -- start start 2023-08-17T17:53:22.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.203+0000 7f049b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f049c0c6000 0x7f049c0c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.203+0000 7f049b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0bec90 0x7f049c0c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.203+0000 7f049b59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c1522f0 con 0x7f049c0c5410 2023-08-17T17:53:22.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.203+0000 7f049b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0c4fa0 con 0x7f049c0c6000 2023-08-17T17:53:22.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.203+0000 7f049b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c4390 con 0x7f049c0bec90 2023-08-17T17:53:22.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.203+0000 7f0491d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f049c0c5410 0x7f049c0be580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40684/0 (socket says 172.21.15.78:40684) 2023-08-17T17:53:22.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.203+0000 7f0491d9b700 1 -- 172.21.15.78:0/2834245550 learned_addr learned my addr 172.21.15.78:0/2834245550 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:22.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f049a59c700 1 --2- 172.21.15.78:0/2834245550 >> v2:172.21.15.150:3300/0 conn(0x7f049c0c6000 0x7f049c0c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f049ad9d700 1 --2- 172.21.15.78:0/2834245550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0bec90 0x7f049c0c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f0499d9b700 1 -- 172.21.15.78:0/2834245550 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112572955 0 0) 0x7f0484001110 con 0x7f049c0c5410 2023-08-17T17:53:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f0499d9b700 1 -- 172.21.15.78:0/2834245550 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04880033f0 con 0x7f049c0c5410 2023-08-17T17:53:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f0499d9b700 1 -- 172.21.15.78:0/2834245550 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3686749071 0 0) 0x7f04880033f0 con 0x7f049c0c5410 2023-08-17T17:53:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f049ad9d700 1 -- 172.21.15.78:0/2834245550 >> v2:172.21.15.150:3300/0 conn(0x7f049c0c6000 msgr2=0x7f049c0c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f049ad9d700 1 --2- 172.21.15.78:0/2834245550 >> v2:172.21.15.150:3300/0 conn(0x7f049c0c6000 0x7f049c0c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f049ad9d700 1 -- 172.21.15.78:0/2834245550 >> v1:172.21.15.78:6789/0 conn(0x7f049c0c5410 legacy=0x7f049c0be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f049ad9d700 1 -- 172.21.15.78:0/2834245550 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0c4670 con 0x7f049c0bec90 2023-08-17T17:53:22.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f049ad9d700 1 --2- 172.21.15.78:0/2834245550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0bec90 0x7f049c0c6be0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f0494009e60 tx=0x7f0494009780).ready entity=mon.2 client_cookie=a1769848dc37d144 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:22.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f0499d9b700 1 -- 172.21.15.78:0/2834245550 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049400e070 con 0x7f049c0bec90 2023-08-17T17:53:22.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f0499d9b700 1 -- 172.21.15.78:0/2834245550 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049400b7a0 con 0x7f049c0bec90 2023-08-17T17:53:22.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.204+0000 7f0499d9b700 1 -- 172.21.15.78:0/2834245550 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484001600 con 0x7f049c0bec90 2023-08-17T17:53:22.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.205+0000 7f049b59e700 1 -- 172.21.15.78:0/2834245550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0bec90 msgr2=0x7f049c0c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.205+0000 7f049b59e700 1 --2- 172.21.15.78:0/2834245550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0bec90 0x7f049c0c6be0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f0494009e60 tx=0x7f0494009780).stop 2023-08-17T17:53:22.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.205+0000 7f049b59e700 1 -- 172.21.15.78:0/2834245550 shutdown_connections 2023-08-17T17:53:22.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.205+0000 7f049b59e700 1 --2- 172.21.15.78:0/2834245550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0bec90 0x7f049c0c6be0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.205+0000 7f049b59e700 1 --2- 172.21.15.78:0/2834245550 >> v2:172.21.15.150:3300/0 conn(0x7f049c0c6000 0x7f049c0c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.205+0000 7f049b59e700 1 -- 172.21.15.78:0/2834245550 >> 172.21.15.78:0/2834245550 conn(0x7f049c092380 msgr2=0x7f049c062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:22.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.205+0000 7f049b59e700 1 -- 172.21.15.78:0/2834245550 shutdown_connections 2023-08-17T17:53:22.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.205+0000 7f049b59e700 1 -- 172.21.15.78:0/2834245550 wait complete. 2023-08-17T17:53:22.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.206+0000 7f049b59e700 1 Processor -- start 2023-08-17T17:53:22.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.206+0000 7f049b59e700 1 -- start start 2023-08-17T17:53:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f049c0bec90 0x7f049c0c1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0c5410 0x7f049c149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f049c0c6000 0x7f049c0aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049b59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c154730 con 0x7f049c0c6000 2023-08-17T17:53:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c154cf0 con 0x7f049c0bec90 2023-08-17T17:53:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c20a0 con 0x7f049c0c5410 2023-08-17T17:53:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f049c0c6000 0x7f049c0aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f049c0c6000 0x7f049c0aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59322/0 (socket says 172.21.15.78:59322) 2023-08-17T17:53:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049ad9d700 1 -- 172.21.15.78:0/1499699288 learned_addr learned my addr 172.21.15.78:0/1499699288 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049a59c700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f049c0bec90 0x7f049c0c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f0491d9b700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0c5410 0x7f049c149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049ad9d700 1 -- 172.21.15.78:0/1499699288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0c5410 msgr2=0x7f049c149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049ad9d700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0c5410 0x7f049c149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049ad9d700 1 -- 172.21.15.78:0/1499699288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f049c0bec90 msgr2=0x7f049c0c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049ad9d700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f049c0bec90 0x7f049c0c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049ad9d700 1 -- 172.21.15.78:0/1499699288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494009a20 con 0x7f049c0c6000 2023-08-17T17:53:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049ad9d700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f049c0c6000 0x7f049c0aaca0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f049400b610 tx=0x7f0494009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f0492ffd700 1 -- 172.21.15.78:0/1499699288 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049401d420 con 0x7f049c0c6000 2023-08-17T17:53:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f0492ffd700 1 -- 172.21.15.78:0/1499699288 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049401d580 con 0x7f049c0c6000 2023-08-17T17:53:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f049b59e700 1 -- 172.21.15.78:0/1499699288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c0c2380 con 0x7f049c0c6000 2023-08-17T17:53:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.207+0000 7f0492ffd700 1 -- 172.21.15.78:0/1499699288 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049401d940 con 0x7f049c0c6000 2023-08-17T17:53:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.208+0000 7f049b59e700 1 -- 172.21.15.78:0/1499699288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c0c1d60 con 0x7f049c0c6000 2023-08-17T17:53:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.208+0000 7f049b59e700 1 -- 172.21.15.78:0/1499699288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c154e80 con 0x7f049c0c6000 2023-08-17T17:53:22.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.209+0000 7f0492ffd700 1 -- 172.21.15.78:0/1499699288 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f049401dcf0 con 0x7f049c0c6000 2023-08-17T17:53:22.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.209+0000 7f0492ffd700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f047c05ed90 0x7f047c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.209+0000 7f0492ffd700 1 -- 172.21.15.78:0/1499699288 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f049407ba50 con 0x7f049c0c6000 2023-08-17T17:53:22.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.209+0000 7f049a59c700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f047c05ed90 0x7f047c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.210+0000 7f049a59c700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f047c05ed90 0x7f047c061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f048c006fd0 tx=0x7f048c006f40).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:22.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.213+0000 7f0492ffd700 1 -- 172.21.15.78:0/1499699288 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f049404cff0 con 0x7f049c0c6000 2023-08-17T17:53:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.439+0000 7f049b59e700 1 -- 172.21.15.78:0/1499699288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f049c0c6850 con 0x7f049c0c6000 2023-08-17T17:53:22.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.443+0000 7f0492ffd700 1 -- 172.21.15.78:0/1499699288 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0494009880 con 0x7f049c0c6000 2023-08-17T17:53:22.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 -- 172.21.15.78:0/1499699288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f047c05ed90 msgr2=0x7f047c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f047c05ed90 0x7f047c061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f048c006fd0 tx=0x7f048c006f40).stop 2023-08-17T17:53:22.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 -- 172.21.15.78:0/1499699288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f049c0c6000 msgr2=0x7f049c0aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f049c0c6000 0x7f049c0aaca0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f049400b610 tx=0x7f0494009780).stop 2023-08-17T17:53:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 -- 172.21.15.78:0/1499699288 shutdown_connections 2023-08-17T17:53:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f047c05ed90 0x7f047c061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f049c0c6000 0x7f049c0aaca0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f049c0bec90 0x7f049c0c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 --2- 172.21.15.78:0/1499699288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f049c0c5410 0x7f049c149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 -- 172.21.15.78:0/1499699288 >> 172.21.15.78:0/1499699288 conn(0x7f049c092380 msgr2=0x7f049c0c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:22.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 -- 172.21.15.78:0/1499699288 shutdown_connections 2023-08-17T17:53:22.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.445+0000 7f049b59e700 1 -- 172.21.15.78:0/1499699288 wait complete. 2023-08-17T17:53:22.447 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-08-17T17:53:22.457 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:22.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.570+0000 7ff49c059700 1 Processor -- start 2023-08-17T17:53:22.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.570+0000 7ff49c059700 1 -- start start 2023-08-17T17:53:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.571+0000 7ff49c059700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff4940c1010 0x7ff4940ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.571+0000 7ff49c059700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940c7350 con 0x7ff4940c6ee0 2023-08-17T17:53:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.571+0000 7ff49c059700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940a8350 con 0x7ff494154140 2023-08-17T17:53:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.571+0000 7ff49c059700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff494154520 con 0x7ff4940c1010 2023-08-17T17:53:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.571+0000 7ff4995f4700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff4940c6ee0 0x7ff4940c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40690/0 (socket says 172.21.15.78:40690) 2023-08-17T17:53:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.571+0000 7ff4995f4700 1 -- 172.21.15.78:0/187189618 learned_addr learned my addr 172.21.15.78:0/187189618 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.571+0000 7ff49a5f6700 1 --2- 172.21.15.78:0/187189618 >> v2:172.21.15.150:3300/0 conn(0x7ff4940c1010 0x7ff4940ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.572+0000 7ff498df3700 1 -- 172.21.15.78:0/187189618 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922618560 0 0) 0x7ff4940c7350 con 0x7ff4940c6ee0 2023-08-17T17:53:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.572+0000 7ff498df3700 1 -- 172.21.15.78:0/187189618 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4800033f0 con 0x7ff4940c6ee0 2023-08-17T17:53:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.572+0000 7ff49a5f6700 1 -- 172.21.15.78:0/187189618 >> v1:172.21.15.150:6789/0 conn(0x7ff494154140 legacy=0x7ff4940a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.572+0000 7ff498df3700 1 -- 172.21.15.78:0/187189618 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867660348 0 0) 0x7ff4940a8350 con 0x7ff494154140 2023-08-17T17:53:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.572+0000 7ff49a5f6700 1 -- 172.21.15.78:0/187189618 >> v1:172.21.15.78:6789/0 conn(0x7ff4940c6ee0 legacy=0x7ff4940c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.572+0000 7ff49a5f6700 1 -- 172.21.15.78:0/187189618 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4940c91e0 con 0x7ff4940c1010 2023-08-17T17:53:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.572+0000 7ff49a5f6700 1 --2- 172.21.15.78:0/187189618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4940c1010 0x7ff4940ca280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7ff48c009760 tx=0x7ff48c009060).ready entity=mon.1 client_cookie=bfc0b4ef8a4def42 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.572+0000 7ff498df3700 1 -- 172.21.15.78:0/187189618 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff484001470 con 0x7ff4940c1010 2023-08-17T17:53:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.572+0000 7ff498df3700 1 -- 172.21.15.78:0/187189618 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c012410 con 0x7ff4940c1010 2023-08-17T17:53:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.572+0000 7ff498df3700 1 -- 172.21.15.78:0/187189618 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c012790 con 0x7ff4940c1010 2023-08-17T17:53:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.573+0000 7ff49c059700 1 -- 172.21.15.78:0/187189618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4940c1010 msgr2=0x7ff4940ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.573+0000 7ff49c059700 1 --2- 172.21.15.78:0/187189618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4940c1010 0x7ff4940ca280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7ff48c009760 tx=0x7ff48c009060).stop 2023-08-17T17:53:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.573+0000 7ff49c059700 1 -- 172.21.15.78:0/187189618 shutdown_connections 2023-08-17T17:53:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.573+0000 7ff49c059700 1 --2- 172.21.15.78:0/187189618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4940c1010 0x7ff4940ca280 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.573+0000 7ff49c059700 1 -- 172.21.15.78:0/187189618 >> 172.21.15.78:0/187189618 conn(0x7ff494094510 msgr2=0x7ff49406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.573+0000 7ff49c059700 1 -- 172.21.15.78:0/187189618 shutdown_connections 2023-08-17T17:53:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.573+0000 7ff49c059700 1 -- 172.21.15.78:0/187189618 wait complete. 2023-08-17T17:53:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.574+0000 7ff49c059700 1 Processor -- start 2023-08-17T17:53:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.574+0000 7ff49c059700 1 -- start start 2023-08-17T17:53:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.574+0000 7ff49c059700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4940c1010 0x7ff494141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.574+0000 7ff49c059700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4940c6ee0 0x7ff4940ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.574+0000 7ff49c059700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff494154140 0x7ff49414e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49c059700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940c3330 con 0x7ff494154140 2023-08-17T17:53:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49c059700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff494141e40 con 0x7ff4940c6ee0 2023-08-17T17:53:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49c059700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940c2720 con 0x7ff4940c1010 2023-08-17T17:53:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49a5f6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff494154140 0x7ff49414e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49a5f6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff494154140 0x7ff49414e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59332/0 (socket says 172.21.15.78:59332) 2023-08-17T17:53:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49a5f6700 1 -- 172.21.15.78:0/90152830 learned_addr learned my addr 172.21.15.78:0/90152830 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff4995f4700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4940c6ee0 0x7ff4940ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff499df5700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4940c1010 0x7ff494141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49a5f6700 1 -- 172.21.15.78:0/90152830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4940c1010 msgr2=0x7ff494141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49a5f6700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4940c1010 0x7ff494141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49a5f6700 1 -- 172.21.15.78:0/90152830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4940c6ee0 msgr2=0x7ff4940ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49a5f6700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4940c6ee0 0x7ff4940ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49a5f6700 1 -- 172.21.15.78:0/90152830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c0092a0 con 0x7ff494154140 2023-08-17T17:53:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff4995f4700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4940c6ee0 0x7ff4940ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff499df5700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4940c1010 0x7ff494141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49a5f6700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff494154140 0x7ff49414e4d0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7ff48c009e00 tx=0x7ff48c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff489ffb700 1 -- 172.21.15.78:0/90152830 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c011cd0 con 0x7ff494154140 2023-08-17T17:53:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff489ffb700 1 -- 172.21.15.78:0/90152830 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c011e30 con 0x7ff494154140 2023-08-17T17:53:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49c059700 1 -- 172.21.15.78:0/90152830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4940c2a00 con 0x7ff494154140 2023-08-17T17:53:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff489ffb700 1 -- 172.21.15.78:0/90152830 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c01d600 con 0x7ff494154140 2023-08-17T17:53:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.575+0000 7ff49c059700 1 -- 172.21.15.78:0/90152830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4940c2fc0 con 0x7ff494154140 2023-08-17T17:53:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.576+0000 7ff49c059700 1 -- 172.21.15.78:0/90152830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff494047350 con 0x7ff494154140 2023-08-17T17:53:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.577+0000 7ff489ffb700 1 -- 172.21.15.78:0/90152830 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff48c01a030 con 0x7ff494154140 2023-08-17T17:53:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.577+0000 7ff489ffb700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff47805ed60 0x7ff478061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.577+0000 7ff489ffb700 1 -- 172.21.15.78:0/90152830 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff48c07b660 con 0x7ff494154140 2023-08-17T17:53:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.577+0000 7ff499df5700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff47805ed60 0x7ff478061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.578+0000 7ff499df5700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff47805ed60 0x7ff478061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff490001df0 tx=0x7ff490009040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.581+0000 7ff489ffb700 1 -- 172.21.15.78:0/90152830 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff48c04cc00 con 0x7ff494154140 2023-08-17T17:53:22.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.784+0000 7ff49c059700 1 -- 172.21.15.78:0/90152830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff494047350 con 0x7ff494154140 2023-08-17T17:53:22.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.784+0000 7ff489ffb700 1 -- 172.21.15.78:0/90152830 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7ff48c050220 con 0x7ff494154140 2023-08-17T17:53:22.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:22.785 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2182410743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2182410743},{"type":"v1","addr":"172.21.15.150:6833","nonce":2182410743}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/4059280185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4059280185},{"type":"v1","addr":"172.21.15.150:6835","nonce":4059280185}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8106,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/984792555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":984792555},{"type":"v1","addr":"172.21.15.78:6836","nonce":984792555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:18.711473+0000","modified":"2023-08-17T17:53:20.721858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/1089949614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1089949614},{"type":"v1","addr":"172.21.15.78:6837","nonce":1089949614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T17:53:22.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 -- 172.21.15.78:0/90152830 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff47805ed60 msgr2=0x7ff478061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff47805ed60 0x7ff478061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff490001df0 tx=0x7ff490009040).stop 2023-08-17T17:53:22.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 -- 172.21.15.78:0/90152830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff494154140 msgr2=0x7ff49414e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:22.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff494154140 0x7ff49414e4d0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7ff48c009e00 tx=0x7ff48c015000).stop 2023-08-17T17:53:22.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 -- 172.21.15.78:0/90152830 shutdown_connections 2023-08-17T17:53:22.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff47805ed60 0x7ff478061220 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff494154140 0x7ff49414e4d0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4940c1010 0x7ff494141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 --2- 172.21.15.78:0/90152830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4940c6ee0 0x7ff4940ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:22.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 -- 172.21.15.78:0/90152830 >> 172.21.15.78:0/90152830 conn(0x7ff494094510 msgr2=0x7ff4940aa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:22.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 -- 172.21.15.78:0/90152830 shutdown_connections 2023-08-17T17:53:22.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:22.786+0000 7ff49c059700 1 -- 172.21.15.78:0/90152830 wait complete. 2023-08-17T17:53:22.788 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 49 2023-08-17T17:53:23.200 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T17:53:18.711473+0000', 'modified': '2023-08-17T17:53:20.721858+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8109': {'gid': 8109, 'name': 'a', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/1089949614', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6835', 'nonce': 1089949614}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 1089949614}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T17:53:23.200 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T17:53:23.200 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-17T17:53:23.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.315+0000 7f35ee4d5700 1 Processor -- start 2023-08-17T17:53:23.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.315+0000 7f35ee4d5700 1 -- start start 2023-08-17T17:53:23.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35ee4d5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f35e8154580 0x7f35e80a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35ee4d5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f35e80c0560 0x7f35e80c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35ee4d5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e80c8df0 con 0x7f35e81541a0 2023-08-17T17:53:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35ee4d5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e80a8190 con 0x7f35e8154580 2023-08-17T17:53:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35ee4d5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e80c9970 con 0x7f35e80c0560 2023-08-17T17:53:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35e77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f35e8154580 0x7f35e80a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35e7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f35e81541a0 0x7f35e80bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40704/0 (socket says 172.21.15.78:40704) 2023-08-17T17:53:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35e7fff700 1 -- 172.21.15.78:0/1942995811 learned_addr learned my addr 172.21.15.78:0/1942995811 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35e77fe700 1 -- 172.21.15.78:0/1942995811 >> v2:172.21.15.150:3300/0 conn(0x7f35e80c0560 msgr2=0x7f35e80c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35eca72700 1 --2- 172.21.15.78:0/1942995811 >> v2:172.21.15.150:3300/0 conn(0x7f35e80c0560 0x7f35e80c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35e6ffd700 1 -- 172.21.15.78:0/1942995811 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661769926 0 0) 0x7f35e80c8df0 con 0x7f35e81541a0 2023-08-17T17:53:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35e77fe700 1 --2- 172.21.15.78:0/1942995811 >> v2:172.21.15.150:3300/0 conn(0x7f35e80c0560 0x7f35e80c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35e77fe700 1 -- 172.21.15.78:0/1942995811 >> v1:172.21.15.78:6789/0 conn(0x7f35e81541a0 legacy=0x7f35e80bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35e77fe700 1 -- 172.21.15.78:0/1942995811 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80c9040 con 0x7f35e8154580 2023-08-17T17:53:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.316+0000 7f35eca72700 1 --2- 172.21.15.78:0/1942995811 >> v2:172.21.15.150:3300/0 conn(0x7f35e80c0560 0x7f35e80c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35e77fe700 1 --2- 172.21.15.78:0/1942995811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e8154580 0x7f35e80a7ca0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f35e8157d80 tx=0x7f35dc009060).ready entity=mon.0 client_cookie=7d9860b7478ba49e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35e6ffd700 1 -- 172.21.15.78:0/1942995811 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0090d0 con 0x7f35e8154580 2023-08-17T17:53:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35e6ffd700 1 -- 172.21.15.78:0/1942995811 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc00b580 con 0x7f35e8154580 2023-08-17T17:53:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35e6ffd700 1 -- 172.21.15.78:0/1942995811 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc00b900 con 0x7f35e8154580 2023-08-17T17:53:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35ee4d5700 1 -- 172.21.15.78:0/1942995811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e8154580 msgr2=0x7f35e80a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35ee4d5700 1 --2- 172.21.15.78:0/1942995811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e8154580 0x7f35e80a7ca0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f35e8157d80 tx=0x7f35dc009060).stop 2023-08-17T17:53:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35ee4d5700 1 -- 172.21.15.78:0/1942995811 shutdown_connections 2023-08-17T17:53:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35ee4d5700 1 --2- 172.21.15.78:0/1942995811 >> v2:172.21.15.150:3300/0 conn(0x7f35e80c0560 0x7f35e80c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35ee4d5700 1 --2- 172.21.15.78:0/1942995811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e8154580 0x7f35e80a7ca0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35ee4d5700 1 -- 172.21.15.78:0/1942995811 >> 172.21.15.78:0/1942995811 conn(0x7f35e806a400 msgr2=0x7f35e80caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35ee4d5700 1 -- 172.21.15.78:0/1942995811 shutdown_connections 2023-08-17T17:53:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.317+0000 7f35ee4d5700 1 -- 172.21.15.78:0/1942995811 wait complete. 2023-08-17T17:53:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.318+0000 7f35ee4d5700 1 Processor -- start 2023-08-17T17:53:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.319+0000 7f35ee4d5700 1 -- start start 2023-08-17T17:53:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.319+0000 7f35ee4d5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e80c0560 0x7f35e81573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.319+0000 7f35ee4d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e81541a0 0x7f35e8152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.319+0000 7f35ee4d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e8154580 0x7f35e81679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.319+0000 7f35ee4d5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e8156f40 con 0x7f35e80c0560 2023-08-17T17:53:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.319+0000 7f35ee4d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e8156330 con 0x7f35e81541a0 2023-08-17T17:53:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.319+0000 7f35ee4d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e8156610 con 0x7f35e8154580 2023-08-17T17:53:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.319+0000 7f35e7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e80c0560 0x7f35e81573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.319+0000 7f35e7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e80c0560 0x7f35e81573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59354/0 (socket says 172.21.15.78:59354) 2023-08-17T17:53:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.319+0000 7f35e7fff700 1 -- 172.21.15.78:0/2182333612 learned_addr learned my addr 172.21.15.78:0/2182333612 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35e77fe700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e81541a0 0x7f35e8152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35eca72700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e8154580 0x7f35e81679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35e7fff700 1 -- 172.21.15.78:0/2182333612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e8154580 msgr2=0x7f35e81679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35e7fff700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e8154580 0x7f35e81679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35e7fff700 1 -- 172.21.15.78:0/2182333612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e81541a0 msgr2=0x7f35e8152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35e7fff700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e81541a0 0x7f35e8152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35e7fff700 1 -- 172.21.15.78:0/2182333612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc0092a0 con 0x7f35e80c0560 2023-08-17T17:53:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35e77fe700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e81541a0 0x7f35e8152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35eca72700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e8154580 0x7f35e81679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35e7fff700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e80c0560 0x7f35e81573d0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f35d800c4e0 tx=0x7f35d8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35cffff700 1 -- 172.21.15.78:0/2182333612 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d80072e0 con 0x7f35e80c0560 2023-08-17T17:53:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35cffff700 1 -- 172.21.15.78:0/2182333612 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d8007440 con 0x7f35e80c0560 2023-08-17T17:53:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35cffff700 1 -- 172.21.15.78:0/2182333612 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d80057a0 con 0x7f35e80c0560 2023-08-17T17:53:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35ee4d5700 1 -- 172.21.15.78:0/2182333612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e81568f0 con 0x7f35e80c0560 2023-08-17T17:53:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.320+0000 7f35ee4d5700 1 -- 172.21.15.78:0/2182333612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e8155fe0 con 0x7f35e80c0560 2023-08-17T17:53:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.321+0000 7f35cffff700 1 -- 172.21.15.78:0/2182333612 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f35d8010070 con 0x7f35e80c0560 2023-08-17T17:53:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.322+0000 7f35cffff700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35d405ed90 0x7f35d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.322+0000 7f35cffff700 1 -- 172.21.15.78:0/2182333612 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f35d8079430 con 0x7f35e80c0560 2023-08-17T17:53:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.322+0000 7f35e77fe700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35d405ed90 0x7f35d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.322+0000 7f35e77fe700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35d405ed90 0x7f35d4061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f35e8157d80 tx=0x7f35dc017000).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:23.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.324+0000 7f35ffe6ab80 1 Processor -- start 2023-08-17T17:53:23.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.324+0000 7f35ffe6ab80 1 -- start start 2023-08-17T17:53:23.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe39c20 0x5621dfe3a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe828c0 0x5621dfe34f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe353f0 0x5621dfe35870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dfdffd00 con 0x5621dfe828c0 2023-08-17T17:53:23.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dfd76cb0 con 0x5621dfe353f0 2023-08-17T17:53:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621dfd8bc90 con 0x5621dfe39c20 2023-08-17T17:53:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35e77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe828c0 0x5621dfe34f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35e77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe828c0 0x5621dfe34f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59362/0 (socket says 172.21.15.78:59362) 2023-08-17T17:53:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35e77fe700 1 -- 172.21.15.78:0/1438543856 learned_addr learned my addr 172.21.15.78:0/1438543856 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35e7fff700 1 --2- 172.21.15.78:0/1438543856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe39c20 0x5621dfe3a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35eca72700 1 --2- 172.21.15.78:0/1438543856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe353f0 0x5621dfe35870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35e77fe700 1 -- 172.21.15.78:0/1438543856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe39c20 msgr2=0x5621dfe3a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35e77fe700 1 --2- 172.21.15.78:0/1438543856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe39c20 0x5621dfe3a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35e77fe700 1 -- 172.21.15.78:0/1438543856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe353f0 msgr2=0x5621dfe35870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35e77fe700 1 --2- 172.21.15.78:0/1438543856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe353f0 0x5621dfe35870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35e77fe700 1 -- 172.21.15.78:0/1438543856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621dfc2e310 con 0x5621dfe828c0 2023-08-17T17:53:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35e77fe700 1 --2- 172.21.15.78:0/1438543856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe828c0 0x5621dfe34f00 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f35dc00bd40 tx=0x7f35dc01e070).ready entity=mon.0 client_cookie=99460444226eb211 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35cd7fa700 1 -- 172.21.15.78:0/1438543856 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc01c8b0 con 0x5621dfe828c0 2023-08-17T17:53:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35cd7fa700 1 -- 172.21.15.78:0/1438543856 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc01ca10 con 0x5621dfe828c0 2023-08-17T17:53:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.325+0000 7f35cd7fa700 1 -- 172.21.15.78:0/1438543856 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc01cd90 con 0x5621dfe828c0 2023-08-17T17:53:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.326+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/1438543856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe828c0 msgr2=0x5621dfe34f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.326+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/1438543856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe828c0 0x5621dfe34f00 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f35dc00bd40 tx=0x7f35dc01e070).stop 2023-08-17T17:53:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.326+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/1438543856 shutdown_connections 2023-08-17T17:53:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.326+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/1438543856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe353f0 0x5621dfe35870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.326+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/1438543856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe39c20 0x5621dfe3a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.326+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/1438543856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe828c0 0x5621dfe34f00 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.326+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/1438543856 >> 172.21.15.78:0/1438543856 conn(0x5621dfbf6e40 msgr2=0x5621dfe82d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.326+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/1438543856 shutdown_connections 2023-08-17T17:53:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.326+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/1438543856 wait complete. 2023-08-17T17:53:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.327+0000 7f35ffe6ab80 1 -- start start 2023-08-17T17:53:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.327+0000 7f35ffe6ab80 1 Processor -- start 2023-08-17T17:53:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.327+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe353f0 0x5621dfe655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.327+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe62560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.327+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 0x5621dfe35870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.327+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dfd52ef0 con 0x5621dfe39c20 2023-08-17T17:53:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.327+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dfd578d0 con 0x5621dfe828c0 2023-08-17T17:53:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.327+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621dfe86940 con 0x5621dfe353f0 2023-08-17T17:53:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35ffe6ab80 10 client.0 ll_register_callbacks cb 0x5621dfdf9ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:53:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35e77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe62560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35e77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe62560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59370/0 (socket says 172.21.15.78:59370) 2023-08-17T17:53:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35e77fe700 1 -- 172.21.15.78:0/704371872 learned_addr learned my addr 172.21.15.78:0/704371872 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35e7fff700 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe353f0 0x5621dfe655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35eca72700 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 0x5621dfe35870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35e77fe700 1 -- 172.21.15.78:0/704371872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe353f0 msgr2=0x5621dfe655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35e77fe700 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe353f0 0x5621dfe655a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35e77fe700 1 -- 172.21.15.78:0/704371872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 msgr2=0x5621dfe35870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35e77fe700 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 0x5621dfe35870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35e77fe700 1 -- 172.21.15.78:0/704371872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e80c9040 con 0x5621dfe39c20 2023-08-17T17:53:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35eca72700 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 0x5621dfe35870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35e77fe700 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe62560 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f35dc00a010 tx=0x7f35dc027000).ready entity=mon.0 client_cookie=b9982e6d85c23fb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35c67fc700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:53:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35c67fc700 1 -- 172.21.15.78:0/704371872 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc034070 con 0x5621dfe39c20 2023-08-17T17:53:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/704371872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621dfe340f0 con 0x5621dfe39c20 2023-08-17T17:53:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35c67fc700 1 -- 172.21.15.78:0/704371872 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f35dc026610 con 0x5621dfe39c20 2023-08-17T17:53:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35c67fc700 1 -- 172.21.15.78:0/704371872 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35dc0269e0 con 0x5621dfe39c20 2023-08-17T17:53:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35ffe6ab80 10 client.8256 fetch_fsmap learned FSMap version 49 2023-08-17T17:53:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/704371872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5621dfd84e70 con 0x5621dfe39c20 2023-08-17T17:53:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.328+0000 7f35c67fc700 1 -- 172.21.15.78:0/704371872 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621dfe340f0 con 0x5621dfe39c20 2023-08-17T17:53:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35c67fc700 1 -- 172.21.15.78:0/704371872 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f35dc026b40 con 0x5621dfe39c20 2023-08-17T17:53:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35ffe6ab80 10 client.8256 fetch_fsmap finished waiting for FSMap version 49 2023-08-17T17:53:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35ffe6ab80 10 client.8256 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T17:53:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35ffe6ab80 20 client.8256 populate_metadata read hostname 'smithi078' 2023-08-17T17:53:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.78:6835/1089949614,v1:172.21.15.78:6837/1089949614] conn(0x5621dfe671d0 0x5621dfe675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35ffe6ab80 4 client.8256 mds_command: new command op to 8109 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T17:53:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/704371872 --> [v2:172.21.15.78:6835/1089949614,v1:172.21.15.78:6837/1089949614] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621dfe03b50 con 0x5621dfe671d0 2023-08-17T17:53:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35e7fff700 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.78:6835/1089949614,v1:172.21.15.78:6837/1089949614] conn(0x5621dfe671d0 0x5621dfe675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35c67fc700 10 client.8256 ms_handle_connect on v2:172.21.15.78:6835/1089949614 2023-08-17T17:53:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35e7fff700 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.78:6835/1089949614,v1:172.21.15.78:6837/1089949614] conn(0x5621dfe671d0 0x5621dfe675b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=14790a435b3dd8aa server_cookie=f61460110f104677 in_seq=0 out_seq=0 2023-08-17T17:53:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35c67fc700 1 -- 172.21.15.78:0/704371872 <== mds.0 v2:172.21.15.78:6835/1089949614 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5621dfe03b50 con 0x5621dfe671d0 2023-08-17T17:53:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35c67fc700 10 client.8256 handle_command_reply: tid=0 2023-08-17T17:53:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.329+0000 7f35ffe6ab80 1 client.8256 shutdown 2023-08-17T17:53:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/704371872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 msgr2=0x5621dfe62560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe62560 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f35dc00a010 tx=0x7f35dc027000).stop 2023-08-17T17:53:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/704371872 shutdown_connections 2023-08-17T17:53:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 0x5621dfe35870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe353f0 0x5621dfe655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.78:6835/1089949614,v1:172.21.15.78:6837/1089949614] conn(0x5621dfe671d0 0x5621dfe675b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/704371872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe62560 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35c67fc700 0 client.8256 ms_handle_reset on v2:172.21.15.78:6835/1089949614 2023-08-17T17:53:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/704371872 >> 172.21.15.78:0/704371872 conn(0x5621dfbf6e40 msgr2=0x5621dfe37c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/704371872 shutdown_connections 2023-08-17T17:53:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/704371872 wait complete. 2023-08-17T17:53:23.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.330+0000 7f35ffe6ab80 20 client.8256 trim_cache size 0 max 16384 2023-08-17T17:53:23.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.346+0000 7f35ffe6ab80 1 Processor -- start 2023-08-17T17:53:23.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.346+0000 7f35ffe6ab80 1 -- start start 2023-08-17T17:53:23.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe353f0 0x5621dfe608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe68350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 0x5621dfe68840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dfe33520 con 0x5621dfe39c20 2023-08-17T17:53:23.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dfe68d30 con 0x5621dfe828c0 2023-08-17T17:53:23.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621dfe611d0 con 0x5621dfe353f0 2023-08-17T17:53:23.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35e77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe68350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35e77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe68350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59372/0 (socket says 172.21.15.78:59372) 2023-08-17T17:53:23.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35e77fe700 1 -- 172.21.15.78:0/3766786771 learned_addr learned my addr 172.21.15.78:0/3766786771 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:23.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35e77fe700 1 -- 172.21.15.78:0/3766786771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe353f0 msgr2=0x5621dfe608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:23.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35e77fe700 1 --2- 172.21.15.78:0/3766786771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe353f0 0x5621dfe608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:23.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35e77fe700 1 -- 172.21.15.78:0/3766786771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 msgr2=0x5621dfe68840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:23.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35eca72700 1 --2- 172.21.15.78:0/3766786771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 0x5621dfe68840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35e77fe700 1 --2- 172.21.15.78:0/3766786771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 0x5621dfe68840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35e77fe700 1 -- 172.21.15.78:0/3766786771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621dfd80480 con 0x5621dfe39c20 2023-08-17T17:53:23.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35e77fe700 1 --2- 172.21.15.78:0/3766786771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe68350 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f35dc01f040 tx=0x7f35dc034000).ready entity=mon.0 client_cookie=2ccaa08922b933d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:23.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35cdffb700 1 -- 172.21.15.78:0/3766786771 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0069b0 con 0x5621dfe39c20 2023-08-17T17:53:23.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.347+0000 7f35cdffb700 1 -- 172.21.15.78:0/3766786771 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc0269e0 con 0x5621dfe39c20 2023-08-17T17:53:23.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.348+0000 7f35cdffb700 1 -- 172.21.15.78:0/3766786771 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc01e200 con 0x5621dfe39c20 2023-08-17T17:53:23.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.348+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3766786771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 msgr2=0x5621dfe68350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.348+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/3766786771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe68350 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f35dc01f040 tx=0x7f35dc034000).stop 2023-08-17T17:53:23.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.348+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3766786771 shutdown_connections 2023-08-17T17:53:23.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.348+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/3766786771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe828c0 0x5621dfe68840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.348+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/3766786771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe353f0 0x5621dfe608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:23.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.348+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/3766786771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe39c20 0x5621dfe68350 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.348+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3766786771 >> 172.21.15.78:0/3766786771 conn(0x5621dfbf6e40 msgr2=0x5621dfe36f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:23.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.348+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3766786771 shutdown_connections 2023-08-17T17:53:23.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.348+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3766786771 wait complete. 2023-08-17T17:53:23.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.349+0000 7f35ffe6ab80 1 -- start start 2023-08-17T17:53:23.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.349+0000 7f35ffe6ab80 1 Processor -- start 2023-08-17T17:53:23.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.349+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe353f0 0x5621dfe7bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.349+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe39c20 0x5621dfe685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.349+0000 7f35ffe6ab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe828c0 0x5621dfee6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.349+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dfee7c00 con 0x5621dfe353f0 2023-08-17T17:53:23.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.349+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621dfe7dcc0 con 0x5621dfe39c20 2023-08-17T17:53:23.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.349+0000 7f35ffe6ab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621dfe7b920 con 0x5621dfe828c0 2023-08-17T17:53:23.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.349+0000 7f35ffe6ab80 10 client.0 ll_register_callbacks cb 0x5621dfdf9ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:53:23.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35e7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe353f0 0x5621dfe7bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35e7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe353f0 0x5621dfe7bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59378/0 (socket says 172.21.15.78:59378) 2023-08-17T17:53:23.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35e7fff700 1 -- 172.21.15.78:0/3547124785 learned_addr learned my addr 172.21.15.78:0/3547124785 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:23.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35e7fff700 1 -- 172.21.15.78:0/3547124785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe828c0 msgr2=0x5621dfee6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:23.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35e7fff700 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe828c0 0x5621dfee6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:23.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35e7fff700 1 -- 172.21.15.78:0/3547124785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe39c20 msgr2=0x5621dfe685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:23.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35e7fff700 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe39c20 0x5621dfe685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:23.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35e7fff700 1 -- 172.21.15.78:0/3547124785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621dfd84e70 con 0x5621dfe353f0 2023-08-17T17:53:23.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35e7fff700 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe353f0 0x5621dfe7bdb0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f35d804e280 tx=0x7f35d800f000).ready entity=mon.0 client_cookie=c4086d9f7a8ba82d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:23.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35c67fc700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:53:23.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35c67fc700 1 -- 172.21.15.78:0/3547124785 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8062060 con 0x5621dfe353f0 2023-08-17T17:53:23.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35c67fc700 1 -- 172.21.15.78:0/3547124785 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f35d8079110 con 0x5621dfe353f0 2023-08-17T17:53:23.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3547124785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35dc01ca10 con 0x5621dfe353f0 2023-08-17T17:53:23.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35c67fc700 1 -- 172.21.15.78:0/3547124785 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35d8059040 con 0x5621dfe353f0 2023-08-17T17:53:23.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35ffe6ab80 10 client.8262 fetch_fsmap learned FSMap version 49 2023-08-17T17:53:23.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3547124785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5621dfd801d0 con 0x5621dfe353f0 2023-08-17T17:53:23.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35c67fc700 1 -- 172.21.15.78:0/3547124785 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc01ca10 con 0x5621dfe353f0 2023-08-17T17:53:23.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35c67fc700 1 -- 172.21.15.78:0/3547124785 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f35d804da70 con 0x5621dfe353f0 2023-08-17T17:53:23.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35ffe6ab80 10 client.8262 fetch_fsmap finished waiting for FSMap version 49 2023-08-17T17:53:23.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35ffe6ab80 10 client.8262 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T17:53:23.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35ffe6ab80 20 client.8262 populate_metadata read hostname 'smithi078' 2023-08-17T17:53:23.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.78:6835/1089949614,v1:172.21.15.78:6837/1089949614] conn(0x5621dfee6f00 0x5621dfee7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35ffe6ab80 4 client.8262 mds_command: new command op to 8109 tid=0[{"prefix": "status"}] 2023-08-17T17:53:23.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.350+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3547124785 --> [v2:172.21.15.78:6835/1089949614,v1:172.21.15.78:6837/1089949614] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5621dfbf2ca0 con 0x5621dfee6f00 2023-08-17T17:53:23.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35e77fe700 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.78:6835/1089949614,v1:172.21.15.78:6837/1089949614] conn(0x5621dfee6f00 0x5621dfee7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35e77fe700 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.78:6835/1089949614,v1:172.21.15.78:6837/1089949614] conn(0x5621dfee6f00 0x5621dfee7300 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c01d0b89654fc626 server_cookie=a1da768d93d3609d in_seq=0 out_seq=0 2023-08-17T17:53:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35c67fc700 10 client.8262 ms_handle_connect on v2:172.21.15.78:6835/1089949614 2023-08-17T17:53:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35c67fc700 1 -- 172.21.15.78:0/3547124785 <== mds.0 v2:172.21.15.78:6835/1089949614 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5621dfbf2ca0 con 0x5621dfee6f00 2023-08-17T17:53:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35c67fc700 10 client.8262 handle_command_reply: tid=0 2023-08-17T17:53:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 client.8262 shutdown 2023-08-17T17:53:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3547124785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe353f0 msgr2=0x5621dfe7bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe353f0 0x5621dfe7bdb0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f35d804e280 tx=0x7f35d800f000).stop 2023-08-17T17:53:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3547124785 shutdown_connections 2023-08-17T17:53:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5621dfe828c0 0x5621dfee6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.78:6835/1089949614,v1:172.21.15.78:6837/1089949614] conn(0x5621dfee6f00 0x5621dfee7300 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621dfe353f0 0x5621dfe7bdb0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35c67fc700 0 client.8262 ms_handle_reset on v2:172.21.15.78:6835/1089949614 2023-08-17T17:53:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 --2- 172.21.15.78:0/3547124785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5621dfe39c20 0x5621dfe685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3547124785 >> 172.21.15.78:0/3547124785 conn(0x5621dfbf6e40 msgr2=0x5621dfe30400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3547124785 shutdown_connections 2023-08-17T17:53:23.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 1 -- 172.21.15.78:0/3547124785 wait complete. 2023-08-17T17:53:23.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.351+0000 7f35ffe6ab80 20 client.8262 trim_cache size 0 max 16384 2023-08-17T17:53:23.361 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:53:23.361 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T17:53:23.361 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T17:53:23.361 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 8109, 2023-08-17T17:53:23.362 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T17:53:23.362 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T17:53:23.362 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T17:53:23.362 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 4.6384044089999996, 2023-08-17T17:53:23.362 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 49, 2023-08-17T17:53:23.362 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 135, 2023-08-17T17:53:23.362 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 135, 2023-08-17T17:53:23.362 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 9.1194213059999996 2023-08-17T17:53:23.363 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:53:23.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 -- 172.21.15.78:0/2182333612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35d405ed90 msgr2=0x7f35d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35d405ed90 0x7f35d4061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f35e8157d80 tx=0x7f35dc017000).stop 2023-08-17T17:53:23.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 -- 172.21.15.78:0/2182333612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e80c0560 msgr2=0x7f35e81573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e80c0560 0x7f35e81573d0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f35d800c4e0 tx=0x7f35d8007c70).stop 2023-08-17T17:53:23.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 -- 172.21.15.78:0/2182333612 shutdown_connections 2023-08-17T17:53:23.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f35d405ed90 0x7f35d4061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e8154580 0x7f35e81679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35e80c0560 0x7f35e81573d0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 --2- 172.21.15.78:0/2182333612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e81541a0 0x7f35e8152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 -- 172.21.15.78:0/2182333612 >> 172.21.15.78:0/2182333612 conn(0x7f35e806a400 msgr2=0x7f35e8063d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:23.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 -- 172.21.15.78:0/2182333612 shutdown_connections 2023-08-17T17:53:23.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.352+0000 7f35ee4d5700 1 -- 172.21.15.78:0/2182333612 wait complete. 2023-08-17T17:53:23.366 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T17:53:23.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.466+0000 7f6b0a6b3700 1 Processor -- start 2023-08-17T17:53:23.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.466+0000 7f6b0a6b3700 1 -- start start 2023-08-17T17:53:23.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.467+0000 7f6b0a6b3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6b040c4da0 0x7f6b040a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.467+0000 7f6b0a6b3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b04063b00 con 0x7f6b040a9b00 2023-08-17T17:53:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.467+0000 7f6b0a6b3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b041527d0 con 0x7f6b041523f0 2023-08-17T17:53:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.467+0000 7f6b0a6b3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b040631d0 con 0x7f6b040c4da0 2023-08-17T17:53:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.467+0000 7f6b037fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6b040c4da0 0x7f6b040a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.467+0000 7f6b08c50700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6b040a9b00 0x7f6b040ab840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40712/0 (socket says 172.21.15.78:40712) 2023-08-17T17:53:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.467+0000 7f6b08c50700 1 -- 172.21.15.78:0/3407211991 learned_addr learned my addr 172.21.15.78:0/3407211991 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b037fe700 1 -- 172.21.15.78:0/3407211991 >> v1:172.21.15.150:6789/0 conn(0x7f6b041523f0 legacy=0x7f6b040c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b037fe700 1 -- 172.21.15.78:0/3407211991 >> v1:172.21.15.78:6789/0 conn(0x7f6b040a9b00 legacy=0x7f6b040ab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b037fe700 1 -- 172.21.15.78:0/3407211991 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b040634b0 con 0x7f6b040c4da0 2023-08-17T17:53:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b02ffd700 1 -- 172.21.15.78:0/3407211991 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725145039 0 0) 0x7f6b04063b00 con 0x7f6b040a9b00 2023-08-17T17:53:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b037fe700 1 --2- 172.21.15.78:0/3407211991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b040c4da0 0x7f6b040a9610 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f6af8009760 tx=0x7f6af8009060).ready entity=mon.0 client_cookie=1daa74834ce55898 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b02ffd700 1 -- 172.21.15.78:0/3407211991 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800b520 con 0x7f6b040c4da0 2023-08-17T17:53:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b02ffd700 1 -- 172.21.15.78:0/3407211991 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af800b680 con 0x7f6b040c4da0 2023-08-17T17:53:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b02ffd700 1 -- 172.21.15.78:0/3407211991 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800ba00 con 0x7f6b040c4da0 2023-08-17T17:53:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3407211991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b040c4da0 msgr2=0x7f6b040a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b0a6b3700 1 --2- 172.21.15.78:0/3407211991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b040c4da0 0x7f6b040a9610 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f6af8009760 tx=0x7f6af8009060).stop 2023-08-17T17:53:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3407211991 shutdown_connections 2023-08-17T17:53:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b0a6b3700 1 --2- 172.21.15.78:0/3407211991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b040c4da0 0x7f6b040a9610 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3407211991 >> 172.21.15.78:0/3407211991 conn(0x7f6b040c7f50 msgr2=0x7f6b040c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.468+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3407211991 shutdown_connections 2023-08-17T17:53:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.469+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3407211991 wait complete. 2023-08-17T17:53:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.470+0000 7f6b0a6b3700 1 Processor -- start 2023-08-17T17:53:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.470+0000 7f6b0a6b3700 1 -- start start 2023-08-17T17:53:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.470+0000 7f6b0a6b3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b040a9b00 0x7f6b040a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b0a6b3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b040c4da0 0x7f6b0414fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b0a6b3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b041523f0 0x7f6b041500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b0a6b3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b04150590 con 0x7f6b041523f0 2023-08-17T17:53:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b0a6b3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b040bd5e0 con 0x7f6b040c4da0 2023-08-17T17:53:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b0a6b3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b040bd8c0 con 0x7f6b040a9b00 2023-08-17T17:53:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b08c50700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b041523f0 0x7f6b041500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b08c50700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b041523f0 0x7f6b041500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59398/0 (socket says 172.21.15.78:59398) 2023-08-17T17:53:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b08c50700 1 -- 172.21.15.78:0/3558707486 learned_addr learned my addr 172.21.15.78:0/3558707486 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b037fe700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b040c4da0 0x7f6b0414fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b03fff700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b040a9b00 0x7f6b040a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b08c50700 1 -- 172.21.15.78:0/3558707486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b040a9b00 msgr2=0x7f6b040a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b08c50700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b040a9b00 0x7f6b040a5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b08c50700 1 -- 172.21.15.78:0/3558707486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b040c4da0 msgr2=0x7f6b0414fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b08c50700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b040c4da0 0x7f6b0414fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b08c50700 1 -- 172.21.15.78:0/3558707486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af80092a0 con 0x7f6b041523f0 2023-08-17T17:53:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b08c50700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b041523f0 0x7f6b041500a0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f6afc00c730 tx=0x7f6afc001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6aebfff700 1 -- 172.21.15.78:0/3558707486 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc005d30 con 0x7f6b041523f0 2023-08-17T17:53:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6aebfff700 1 -- 172.21.15.78:0/3558707486 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc005e90 con 0x7f6b041523f0 2023-08-17T17:53:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6aebfff700 1 -- 172.21.15.78:0/3558707486 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc007340 con 0x7f6b041523f0 2023-08-17T17:53:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3558707486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b040bdba0 con 0x7f6b041523f0 2023-08-17T17:53:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.471+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3558707486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b04150960 con 0x7f6b041523f0 2023-08-17T17:53:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.472+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3558707486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b04047350 con 0x7f6b041523f0 2023-08-17T17:53:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.473+0000 7f6aebfff700 1 -- 172.21.15.78:0/3558707486 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6afc010030 con 0x7f6b041523f0 2023-08-17T17:53:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.473+0000 7f6aebfff700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6af005ed60 0x7f6af0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.473+0000 7f6aebfff700 1 -- 172.21.15.78:0/3558707486 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6afc079960 con 0x7f6b041523f0 2023-08-17T17:53:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.473+0000 7f6b03fff700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6af005ed60 0x7f6af0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.473+0000 7f6b03fff700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6af005ed60 0x7f6af0061220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6b041677d0 tx=0x7f6af4008040).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:23.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.477+0000 7f6aebfff700 1 -- 172.21.15.78:0/3558707486 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6afc04af00 con 0x7f6b041523f0 2023-08-17T17:53:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.681+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3558707486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6b04064f80 con 0x7f6b041523f0 2023-08-17T17:53:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.681+0000 7f6aebfff700 1 -- 172.21.15.78:0/3558707486 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6afc04e520 con 0x7f6b041523f0 2023-08-17T17:53:23.682 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:53:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.683+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3558707486 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6af005ed60 msgr2=0x7f6af0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.683+0000 7f6b0a6b3700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6af005ed60 0x7f6af0061220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6b041677d0 tx=0x7f6af4008040).stop 2023-08-17T17:53:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.683+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3558707486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b041523f0 msgr2=0x7f6b041500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.683+0000 7f6b0a6b3700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b041523f0 0x7f6b041500a0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f6afc00c730 tx=0x7f6afc001520).stop 2023-08-17T17:53:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.684+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3558707486 shutdown_connections 2023-08-17T17:53:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.684+0000 7f6b0a6b3700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f6af005ed60 0x7f6af0061220 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.684+0000 7f6b0a6b3700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b041523f0 0x7f6b041500a0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.684+0000 7f6b0a6b3700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b040a9b00 0x7f6b040a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.684+0000 7f6b0a6b3700 1 --2- 172.21.15.78:0/3558707486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b040c4da0 0x7f6b0414fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.684+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3558707486 >> 172.21.15.78:0/3558707486 conn(0x7f6b040c7f50 msgr2=0x7f6b040c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.684+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3558707486 shutdown_connections 2023-08-17T17:53:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:23.684+0000 7f6b0a6b3700 1 -- 172.21.15.78:0/3558707486 wait complete. 2023-08-17T17:53:23.694 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T17:53:23.695 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:53:23.695 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T17:53:23.695 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T17:53:23.695 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T17:53:23.696 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T17:53:23.696 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T17:53:23.696 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:53:23.696 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:53:23.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:23.697 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T17:53:23.712 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:53:23.712 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:53:23.712 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:53:23.712 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:23.712 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:53:23.713 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:23.713 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:53:23.713 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:53:23.713 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T17:53:23.713 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:53:23.713 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:53:23.713 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T17:53:23.714 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:53:23.714 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:53:23.714 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:53:23.714 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:53:23.714 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:53:23.714 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 41075sec preferred_lft 41075sec 2023-08-17T17:53:23.714 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T17:53:23.714 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:23.715 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:53:23.715 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:53:23.715 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T17:53:23.715 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:23.715 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T17:53:23.715 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:23.715 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:53:23.715 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T17:53:23.716 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link 2023-08-17T17:53:23.716 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:23.716 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:53:23.716 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T17:53:23.716 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::54:39ff:fe93:1c36/64 scope link 2023-08-17T17:53:23.716 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:23.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:23.717 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:53:23.775 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T17:53:23.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:23.777 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T17:53:23.832 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T17:53:23.832 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:53:23.832 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:53:23.832 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:53:23.832 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:53:23.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:23.833 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:53:23.833 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:53:23.834 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:53:23.834 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:53:23.834 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:53:23.834 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:53:23.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:23.931 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:53:23.945 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T17:53:23.946 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T17:53:23.946 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:53:23.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:23.946 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T17:53:24.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:24.010 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T17:53:24.064 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:53:24.064 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:53:24.142 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:53:24.142 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:53:24.166 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:53:24.166 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:53:24.168 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:53:24.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:24.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T17:53:24.232 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-17T17:53:24.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.386+0000 7f380da3b700 1 Processor -- start 2023-08-17T17:53:24.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.386+0000 7f380da3b700 1 -- start start 2023-08-17T17:53:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.387+0000 7f380da3b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3808153ea0 0x7f3808154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.387+0000 7f380da3b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3808069e90 con 0x7f38080a6bd0 2023-08-17T17:53:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.387+0000 7f380da3b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3808069280 con 0x7f38080624f0 2023-08-17T17:53:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.387+0000 7f380da3b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3808069560 con 0x7f3808153ea0 2023-08-17T17:53:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.387+0000 7f37fe7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f38080a6bd0 0x7f38080c4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40722/0 (socket says 172.21.15.78:40722) 2023-08-17T17:53:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.387+0000 7f37fe7fc700 1 -- 172.21.15.78:0/2124996420 learned_addr learned my addr 172.21.15.78:0/2124996420 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f3806ffd700 1 --2- 172.21.15.78:0/2124996420 >> v2:172.21.15.150:3300/0 conn(0x7f3808153ea0 0x7f3808154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f38067fc700 1 -- 172.21.15.78:0/2124996420 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702669107 0 0) 0x7f3808069e90 con 0x7f38080a6bd0 2023-08-17T17:53:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f38067fc700 1 -- 172.21.15.78:0/2124996420 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37f40033f0 con 0x7f38080a6bd0 2023-08-17T17:53:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f38067fc700 1 -- 172.21.15.78:0/2124996420 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692940945 0 0) 0x7f3808069280 con 0x7f38080624f0 2023-08-17T17:53:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f38067fc700 1 -- 172.21.15.78:0/2124996420 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3808069e90 con 0x7f38080624f0 2023-08-17T17:53:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f3806ffd700 1 -- 172.21.15.78:0/2124996420 >> v1:172.21.15.150:6789/0 conn(0x7f38080624f0 legacy=0x7f3808065240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f3806ffd700 1 -- 172.21.15.78:0/2124996420 >> v1:172.21.15.78:6789/0 conn(0x7f38080a6bd0 legacy=0x7f38080c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f38067fc700 1 -- 172.21.15.78:0/2124996420 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1413825268 0 0) 0x7f37f40033f0 con 0x7f38080a6bd0 2023-08-17T17:53:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f3806ffd700 1 -- 172.21.15.78:0/2124996420 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3808069840 con 0x7f3808153ea0 2023-08-17T17:53:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f3806ffd700 1 --2- 172.21.15.78:0/2124996420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3808153ea0 0x7f3808154280 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f37f8009760 tx=0x7f37f8009060).ready entity=mon.1 client_cookie=49dbb60247a6f4ef server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:24.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f38067fc700 1 -- 172.21.15.78:0/2124996420 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0001470 con 0x7f3808153ea0 2023-08-17T17:53:24.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f38067fc700 1 -- 172.21.15.78:0/2124996420 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f8011400 con 0x7f3808153ea0 2023-08-17T17:53:24.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.388+0000 7f38067fc700 1 -- 172.21.15.78:0/2124996420 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8011780 con 0x7f3808153ea0 2023-08-17T17:53:24.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.389+0000 7f380da3b700 1 -- 172.21.15.78:0/2124996420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3808153ea0 msgr2=0x7f3808154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.389+0000 7f380da3b700 1 --2- 172.21.15.78:0/2124996420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3808153ea0 0x7f3808154280 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f37f8009760 tx=0x7f37f8009060).stop 2023-08-17T17:53:24.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.389+0000 7f380da3b700 1 -- 172.21.15.78:0/2124996420 shutdown_connections 2023-08-17T17:53:24.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.389+0000 7f380da3b700 1 --2- 172.21.15.78:0/2124996420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3808153ea0 0x7f3808154280 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.389+0000 7f380da3b700 1 -- 172.21.15.78:0/2124996420 >> 172.21.15.78:0/2124996420 conn(0x7f38080c8680 msgr2=0x7f38080c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:24.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.389+0000 7f380da3b700 1 -- 172.21.15.78:0/2124996420 shutdown_connections 2023-08-17T17:53:24.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.389+0000 7f380da3b700 1 -- 172.21.15.78:0/2124996420 wait complete. 2023-08-17T17:53:24.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.390+0000 7f380da3b700 1 Processor -- start 2023-08-17T17:53:24.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.390+0000 7f380da3b700 1 -- start start 2023-08-17T17:53:24.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f380da3b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38080624f0 0x7f3808151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f380da3b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38080a6bd0 0x7f38081674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f380da3b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3808153ea0 0x7f3808062ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f380da3b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3808152f40 con 0x7f38080a6bd0 2023-08-17T17:53:24.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f380da3b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3808152330 con 0x7f38080624f0 2023-08-17T17:53:24.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f380da3b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3808152610 con 0x7f3808153ea0 2023-08-17T17:53:24.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f37fe7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38080a6bd0 0x7f38081674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f37fe7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38080a6bd0 0x7f38081674f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59406/0 (socket says 172.21.15.78:59406) 2023-08-17T17:53:24.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f37fe7fc700 1 -- 172.21.15.78:0/185073378 learned_addr learned my addr 172.21.15.78:0/185073378 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:24.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f3806ffd700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38080624f0 0x7f3808151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f38077fe700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3808153ea0 0x7f3808062ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f37fe7fc700 1 -- 172.21.15.78:0/185073378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3808153ea0 msgr2=0x7f3808062ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f37fe7fc700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3808153ea0 0x7f3808062ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f37fe7fc700 1 -- 172.21.15.78:0/185073378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38080624f0 msgr2=0x7f3808151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f37fe7fc700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38080624f0 0x7f3808151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f37fe7fc700 1 -- 172.21.15.78:0/185073378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f80092a0 con 0x7f38080a6bd0 2023-08-17T17:53:24.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.391+0000 7f38077fe700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3808153ea0 0x7f3808062ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:24.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.392+0000 7f37fe7fc700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38080a6bd0 0x7f38081674f0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f37f000c800 tx=0x7f37f0001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:24.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.392+0000 7f37ff7fe700 1 -- 172.21.15.78:0/185073378 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0007170 con 0x7f38080a6bd0 2023-08-17T17:53:24.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.392+0000 7f37ff7fe700 1 -- 172.21.15.78:0/185073378 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00072d0 con 0x7f38080a6bd0 2023-08-17T17:53:24.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.392+0000 7f380da3b700 1 -- 172.21.15.78:0/185073378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38081528f0 con 0x7f38080a6bd0 2023-08-17T17:53:24.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.392+0000 7f37ff7fe700 1 -- 172.21.15.78:0/185073378 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00048c0 con 0x7f38080a6bd0 2023-08-17T17:53:24.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.392+0000 7f380da3b700 1 -- 172.21.15.78:0/185073378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3808154d90 con 0x7f38080a6bd0 2023-08-17T17:53:24.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.393+0000 7f380da3b700 1 -- 172.21.15.78:0/185073378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3808047350 con 0x7f38080a6bd0 2023-08-17T17:53:24.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.393+0000 7f37ff7fe700 1 -- 172.21.15.78:0/185073378 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f37f0010070 con 0x7f38080a6bd0 2023-08-17T17:53:24.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.393+0000 7f37ff7fe700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f37e805ed90 0x7f37e8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.394+0000 7f37ff7fe700 1 -- 172.21.15.78:0/185073378 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f37f00794c0 con 0x7f38080a6bd0 2023-08-17T17:53:24.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.394+0000 7f3806ffd700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f37e805ed90 0x7f37e8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.394+0000 7f3806ffd700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f37e805ed90 0x7f37e8061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f37f8009760 tx=0x7f37f8016000).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:24.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.398+0000 7f37ff7fe700 1 -- 172.21.15.78:0/185073378 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37f004e490 con 0x7f38080a6bd0 2023-08-17T17:53:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.590+0000 7f380da3b700 1 -- 172.21.15.78:0/185073378 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3808152d90 con 0x7f37e805ed90 2023-08-17T17:53:24.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.592+0000 7f37ff7fe700 1 -- 172.21.15.78:0/185073378 <== mgr.7932 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3808152d90 con 0x7f37e805ed90 2023-08-17T17:53:24.592 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:53:24.592 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:24.592 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephfs" 2023-08-17T17:53:24.592 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:24.593 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:53:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 -- 172.21.15.78:0/185073378 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f37e805ed90 msgr2=0x7f37e8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f37e805ed90 0x7f37e8061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f37f8009760 tx=0x7f37f8016000).stop 2023-08-17T17:53:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 -- 172.21.15.78:0/185073378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38080a6bd0 msgr2=0x7f38081674f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38080a6bd0 0x7f38081674f0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f37f000c800 tx=0x7f37f0001b50).stop 2023-08-17T17:53:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 -- 172.21.15.78:0/185073378 shutdown_connections 2023-08-17T17:53:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f37e805ed90 0x7f37e8061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3808153ea0 0x7f3808062ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38080624f0 0x7f3808151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 --2- 172.21.15.78:0/185073378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38080a6bd0 0x7f38081674f0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 -- 172.21.15.78:0/185073378 >> 172.21.15.78:0/185073378 conn(0x7f38080c8680 msgr2=0x7f38080a4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 -- 172.21.15.78:0/185073378 shutdown_connections 2023-08-17T17:53:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.594+0000 7f380da3b700 1 -- 172.21.15.78:0/185073378 wait complete. 2023-08-17T17:53:24.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-17T17:53:24.669 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-08-17T17:53:24.669+0000 7fc57ef5f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:53:24.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.721+0000 7f7898295700 1 Processor -- start 2023-08-17T17:53:24.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.721+0000 7f7898295700 1 -- start start 2023-08-17T17:53:24.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f7898295700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f78900644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f7898295700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f78900c5810 0x7f78900c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f7898295700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78900649b0 con 0x7f78900aa4d0 2023-08-17T17:53:24.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f7898295700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78900c6170 con 0x7f78900c5810 2023-08-17T17:53:24.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f7898295700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7890063420 con 0x7f78900aa0f0 2023-08-17T17:53:24.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f7895830700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f78900aa4d0 0x7f78900c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40738/0 (socket says 172.21.15.78:40738) 2023-08-17T17:53:24.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f7895830700 1 -- 172.21.15.78:0/2430699265 learned_addr learned my addr 172.21.15.78:0/2430699265 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:24.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f7896031700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f78900644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f7896832700 1 --2- 172.21.15.78:0/2430699265 >> v2:172.21.15.150:3300/0 conn(0x7f78900c5810 0x7f78900c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707577031 0 0) 0x7f78900649b0 con 0x7f78900aa4d0 2023-08-17T17:53:24.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.722+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f787c0033f0 con 0x7f78900aa4d0 2023-08-17T17:53:24.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896168497 0 0) 0x7f787c0033f0 con 0x7f78900aa4d0 2023-08-17T17:53:24.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 msgr2=0x7f78900644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:24.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f78900644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 >> v2:172.21.15.150:3300/0 conn(0x7f78900c5810 msgr2=0x7f78900c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:24.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 --2- 172.21.15.78:0/2430699265 >> v2:172.21.15.150:3300/0 conn(0x7f78900c5810 0x7f78900c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7890063700 con 0x7f78900aa4d0 2023-08-17T17:53:24.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f7880001470 con 0x7f78900aa4d0 2023-08-17T17:53:24.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 >> v1:172.21.15.78:6789/0 conn(0x7f78900aa4d0 legacy=0x7f78900c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f787c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 0x7f787c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787c004b80 0x7f787c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900c6170 con 0x7f787c003e10 2023-08-17T17:53:24.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890063420 con 0x7f787c004b80 2023-08-17T17:53:24.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c00b8e0 con 0x7f78900aa0f0 2023-08-17T17:53:24.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f7895830700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 0x7f787c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f7896031700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f787c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f7896832700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787c004b80 0x7f787c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f7895830700 1 -- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 msgr2=0x7f787c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:24.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f7895830700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900aa0f0 0x7f787c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f7895830700 1 -- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787c004b80 msgr2=0x7f787c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:24.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f7895830700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787c004b80 0x7f787c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f7895830700 1 -- 172.21.15.78:0/2430699265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0033f0 con 0x7f787c003e10 2023-08-17T17:53:24.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f7896832700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787c004b80 0x7f787c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:24.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f7895830700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 0x7f787c004690 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f788000c210 tx=0x7f7880001e90).ready entity=mon.0 client_cookie=9131736b465dc00d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:24.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880007a60 con 0x7f787c003e10 2023-08-17T17:53:24.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788000caa0 con 0x7f787c003e10 2023-08-17T17:53:24.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.723+0000 7f789502f700 1 -- 172.21.15.78:0/2430699265 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788000ce20 con 0x7f787c003e10 2023-08-17T17:53:24.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.724+0000 7f7898295700 1 -- 172.21.15.78:0/2430699265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 msgr2=0x7f787c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.724+0000 7f7898295700 1 --2- 172.21.15.78:0/2430699265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 0x7f787c004690 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f788000c210 tx=0x7f7880001e90).stop 2023-08-17T17:53:24.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.724+0000 7f7896832700 1 -- 172.21.15.78:0/2430699265 reap_dead start 2023-08-17T17:53:24.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.724+0000 7f7898295700 1 -- 172.21.15.78:0/2430699265 shutdown_connections 2023-08-17T17:53:24.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.724+0000 7f7898295700 1 -- 172.21.15.78:0/2430699265 >> 172.21.15.78:0/2430699265 conn(0x7f789006a6a0 msgr2=0x7f78900caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:24.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.724+0000 7f7898295700 1 -- 172.21.15.78:0/2430699265 shutdown_connections 2023-08-17T17:53:24.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.724+0000 7f7898295700 1 -- 172.21.15.78:0/2430699265 wait complete. 2023-08-17T17:53:24.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.725+0000 7f7898295700 1 Processor -- start 2023-08-17T17:53:24.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.725+0000 7f7898295700 1 -- start start 2023-08-17T17:53:24.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7898295700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 0x7f78900c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7898295700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7890164510 0x7f7890153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7898295700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900abb50 0x7f78900ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7898295700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900c4220 con 0x7f787c003e10 2023-08-17T17:53:24.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7898295700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900c21b0 con 0x7f7890164510 2023-08-17T17:53:24.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7898295700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78901541d0 con 0x7f78900abb50 2023-08-17T17:53:24.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896031700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 0x7f78900c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896031700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 0x7f78900c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59416/0 (socket says 172.21.15.78:59416) 2023-08-17T17:53:24.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896031700 1 -- 172.21.15.78:0/3770817058 learned_addr learned my addr 172.21.15.78:0/3770817058 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896832700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900abb50 0x7f78900ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7895830700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7890164510 0x7f7890153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896031700 1 -- 172.21.15.78:0/3770817058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900abb50 msgr2=0x7f78900ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896031700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900abb50 0x7f78900ac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896031700 1 -- 172.21.15.78:0/3770817058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7890164510 msgr2=0x7f7890153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896031700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7890164510 0x7f7890153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896031700 1 -- 172.21.15.78:0/3770817058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900ab370 con 0x7f787c003e10 2023-08-17T17:53:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896832700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900abb50 0x7f78900ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:24.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.726+0000 7f7896031700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 0x7f78900c39d0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f788c011a20 tx=0x7f788c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:24.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.727+0000 7f78867fc700 1 -- 172.21.15.78:0/3770817058 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c00f940 con 0x7f787c003e10 2023-08-17T17:53:24.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.727+0000 7f78867fc700 1 -- 172.21.15.78:0/3770817058 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c00faa0 con 0x7f787c003e10 2023-08-17T17:53:24.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.727+0000 7f7898295700 1 -- 172.21.15.78:0/3770817058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78900ab610 con 0x7f787c003e10 2023-08-17T17:53:24.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.727+0000 7f78867fc700 1 -- 172.21.15.78:0/3770817058 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c00fe20 con 0x7f787c003e10 2023-08-17T17:53:24.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.727+0000 7f7898295700 1 -- 172.21.15.78:0/3770817058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78900c1b60 con 0x7f787c003e10 2023-08-17T17:53:24.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.728+0000 7f7898295700 1 -- 172.21.15.78:0/3770817058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7890083980 con 0x7f787c003e10 2023-08-17T17:53:24.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.728+0000 7f78867fc700 1 -- 172.21.15.78:0/3770817058 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 57) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f788c024070 con 0x7f787c003e10 2023-08-17T17:53:24.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.728+0000 7f78867fc700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787405ed90 0x7f7874061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:24.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.728+0000 7f78867fc700 1 -- 172.21.15.78:0/3770817058 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f788c07a530 con 0x7f787c003e10 2023-08-17T17:53:24.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.729+0000 7f7895830700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787405ed90 0x7f7874061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:24.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.729+0000 7f7895830700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787405ed90 0x7f7874061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7880000c00 tx=0x7f7880015000).ready entity=mgr.7932 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:24.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.732+0000 7f78867fc700 1 -- 172.21.15.78:0/3770817058 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f788c04bad0 con 0x7f787c003e10 2023-08-17T17:53:24.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:24.937+0000 7f7898295700 1 -- 172.21.15.78:0/3770817058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f78900cbd40 con 0x7f787c003e10 2023-08-17T17:53:25.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.751+0000 7f78867fc700 1 -- 172.21.15.78:0/3770817058 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 58) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f788c078430 con 0x7f787c003e10 2023-08-17T17:53:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.752+0000 7f78867fc700 1 -- 172.21.15.78:0/3770817058 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v58) v1 ==== 92+0+0 (secure 0 0 0) 0x7f788c070200 con 0x7f787c003e10 2023-08-17T17:53:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 -- 172.21.15.78:0/3770817058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787405ed90 msgr2=0x7f7874061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787405ed90 0x7f7874061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7880000c00 tx=0x7f7880015000).stop 2023-08-17T17:53:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 -- 172.21.15.78:0/3770817058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 msgr2=0x7f78900c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 0x7f78900c39d0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f788c011a20 tx=0x7f788c009060).stop 2023-08-17T17:53:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 -- 172.21.15.78:0/3770817058 shutdown_connections 2023-08-17T17:53:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f787405ed90 0x7f7874061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78900abb50 0x7f78900ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f787c003e10 0x7f78900c39d0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 --2- 172.21.15.78:0/3770817058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7890164510 0x7f7890153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 -- 172.21.15.78:0/3770817058 >> 172.21.15.78:0/3770817058 conn(0x7f789006a6a0 msgr2=0x7f78900a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 -- 172.21.15.78:0/3770817058 shutdown_connections 2023-08-17T17:53:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.754+0000 7f7898295700 1 -- 172.21.15.78:0/3770817058 wait complete. 2023-08-17T17:53:25.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-17T17:53:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.889+0000 7ff7191a0700 1 Processor -- start 2023-08-17T17:53:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.889+0000 7ff7191a0700 1 -- start start 2023-08-17T17:53:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.889+0000 7ff7191a0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff71413a740 0x7ff714069f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.889+0000 7ff7191a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff714154cf0 0x7ff714062970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.889+0000 7ff7191a0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff714069b00 con 0x7ff7140624f0 2023-08-17T17:53:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.889+0000 7ff7191a0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff714155180 con 0x7ff71413a740 2023-08-17T17:53:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.889+0000 7ff7191a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff714155640 con 0x7ff714154cf0 2023-08-17T17:53:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff712d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff71413a740 0x7ff714069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff712d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff71413a740 0x7ff714069f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59444/0 (socket says 172.21.15.78:59444) 2023-08-17T17:53:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff712d9d700 1 -- 172.21.15.78:0/1189530828 learned_addr learned my addr 172.21.15.78:0/1189530828 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff71359e700 1 --2- 172.21.15.78:0/1189530828 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff714154cf0 0x7ff714062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff712d9d700 1 -- 172.21.15.78:0/1189530828 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff714154cf0 msgr2=0x7ff714062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff712d9d700 1 --2- 172.21.15.78:0/1189530828 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff714154cf0 0x7ff714062970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff712d9d700 1 -- 172.21.15.78:0/1189530828 >> v1:172.21.15.150:6789/0 conn(0x7ff7140624f0 legacy=0x7ff7141545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff712d9d700 1 -- 172.21.15.78:0/1189530828 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff714062e60 con 0x7ff71413a740 2023-08-17T17:53:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff712d9d700 1 --2- 172.21.15.78:0/1189530828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff71413a740 0x7ff714069f90 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7ff704006fd0 tx=0x7ff7040090f0).ready entity=mon.0 client_cookie=db6b96957b2b7946 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff711d9b700 1 -- 172.21.15.78:0/1189530828 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70400b580 con 0x7ff71413a740 2023-08-17T17:53:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff711d9b700 1 -- 172.21.15.78:0/1189530828 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70400b6e0 con 0x7ff71413a740 2023-08-17T17:53:25.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.890+0000 7ff711d9b700 1 -- 172.21.15.78:0/1189530828 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70400ba60 con 0x7ff71413a740 2023-08-17T17:53:25.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.891+0000 7ff7191a0700 1 -- 172.21.15.78:0/1189530828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff71413a740 msgr2=0x7ff714069f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:25.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.891+0000 7ff7191a0700 1 --2- 172.21.15.78:0/1189530828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff71413a740 0x7ff714069f90 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7ff704006fd0 tx=0x7ff7040090f0).stop 2023-08-17T17:53:25.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.891+0000 7ff7191a0700 1 -- 172.21.15.78:0/1189530828 shutdown_connections 2023-08-17T17:53:25.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.891+0000 7ff7191a0700 1 --2- 172.21.15.78:0/1189530828 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff714154cf0 0x7ff714062970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:25.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.891+0000 7ff7191a0700 1 --2- 172.21.15.78:0/1189530828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff71413a740 0x7ff714069f90 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:25.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.891+0000 7ff7191a0700 1 -- 172.21.15.78:0/1189530828 >> 172.21.15.78:0/1189530828 conn(0x7ff7140c7b80 msgr2=0x7ff7140c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:25.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.891+0000 7ff7191a0700 1 -- 172.21.15.78:0/1189530828 shutdown_connections 2023-08-17T17:53:25.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.891+0000 7ff7191a0700 1 -- 172.21.15.78:0/1189530828 wait complete. 2023-08-17T17:53:25.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.893+0000 7ff7191a0700 1 Processor -- start 2023-08-17T17:53:25.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.893+0000 7ff7191a0700 1 -- start start 2023-08-17T17:53:25.895 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:25.893+0000 7f44590f3680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:53:25.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff7191a0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7140624f0 0x7ff7140a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:25.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff7191a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff71413a740 0x7ff7141641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:25.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff7191a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff714154cf0 0x7ff7141646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:25.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff7191a0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140a7920 con 0x7ff7140624f0 2023-08-17T17:53:25.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff7191a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140aca30 con 0x7ff714154cf0 2023-08-17T17:53:25.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff7191a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140a7b70 con 0x7ff71413a740 2023-08-17T17:53:25.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff712d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7140624f0 0x7ff7140a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:25.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff712d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7140624f0 0x7ff7140a9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59454/0 (socket says 172.21.15.78:59454) 2023-08-17T17:53:25.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff712d9d700 1 -- 172.21.15.78:0/3809288197 learned_addr learned my addr 172.21.15.78:0/3809288197 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:25.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff71259c700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff71413a740 0x7ff7141641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:25.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff71359e700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff714154cf0 0x7ff7141646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:25.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff712d9d700 1 -- 172.21.15.78:0/3809288197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff71413a740 msgr2=0x7ff7141641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:25.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff712d9d700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff71413a740 0x7ff7141641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:25.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff712d9d700 1 -- 172.21.15.78:0/3809288197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff714154cf0 msgr2=0x7ff7141646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:25.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff712d9d700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff714154cf0 0x7ff7141646c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:25.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.894+0000 7ff712d9d700 1 -- 172.21.15.78:0/3809288197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff704009370 con 0x7ff7140624f0 2023-08-17T17:53:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.895+0000 7ff712d9d700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7140624f0 0x7ff7140a9ce0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7ff704009130 tx=0x7ff704017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.895+0000 7ff6faffd700 1 -- 172.21.15.78:0/3809288197 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704000bc0 con 0x7ff7140624f0 2023-08-17T17:53:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.895+0000 7ff6faffd700 1 -- 172.21.15.78:0/3809288197 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70400b850 con 0x7ff7140624f0 2023-08-17T17:53:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.895+0000 7ff6faffd700 1 -- 172.21.15.78:0/3809288197 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704000d20 con 0x7ff7140624f0 2023-08-17T17:53:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.895+0000 7ff7191a0700 1 -- 172.21.15.78:0/3809288197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7140a7e50 con 0x7ff7140624f0 2023-08-17T17:53:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.895+0000 7ff7191a0700 1 -- 172.21.15.78:0/3809288197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7140aa1d0 con 0x7ff7140624f0 2023-08-17T17:53:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.896+0000 7ff7191a0700 1 -- 172.21.15.78:0/3809288197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff714068270 con 0x7ff7140624f0 2023-08-17T17:53:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.897+0000 7ff6faffd700 1 -- 172.21.15.78:0/3809288197 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 58) v1 ==== 75259+0+0 (secure 0 0 0) 0x7ff70402c070 con 0x7ff7140624f0 2023-08-17T17:53:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.897+0000 7ff6faffd700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff70005ede0 0x7ff7000612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.897+0000 7ff71259c700 1 -- 172.21.15.78:0/3809288197 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff70005ede0 msgr2=0x7ff7000612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.897+0000 7ff6faffd700 1 -- 172.21.15.78:0/3809288197 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff70407b670 con 0x7ff7140624f0 2023-08-17T17:53:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.897+0000 7ff71259c700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff70005ede0 0x7ff7000612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:25.901 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:25.900+0000 7fec94730680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:53:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:25.901+0000 7ff6faffd700 1 -- 172.21.15.78:0/3809288197 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff70404cc10 con 0x7ff7140624f0 2023-08-17T17:53:25.958 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:25.957+0000 7f44590f3680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:53:25.965 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:25.965+0000 7fec94730680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:53:26.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.072+0000 7ff7191a0700 1 -- 172.21.15.78:0/3809288197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ff71405f5a0 con 0x7ff7140624f0 2023-08-17T17:53:26.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.075+0000 7ff6faffd700 1 -- 172.21.15.78:0/3809288197 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff70402a020 con 0x7ff7140624f0 2023-08-17T17:53:26.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.077+0000 7ff7191a0700 1 -- 172.21.15.78:0/3809288197 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff70005ede0 msgr2=0x7ff7000612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:26.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.077+0000 7ff7191a0700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff70005ede0 0x7ff7000612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:26.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.077+0000 7ff7191a0700 1 -- 172.21.15.78:0/3809288197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7140624f0 msgr2=0x7ff7140a9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:26.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.077+0000 7ff7191a0700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7140624f0 0x7ff7140a9ce0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7ff704009130 tx=0x7ff704017000).stop 2023-08-17T17:53:26.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.077+0000 7ff7191a0700 1 -- 172.21.15.78:0/3809288197 shutdown_connections 2023-08-17T17:53:26.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.077+0000 7ff7191a0700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff70005ede0 0x7ff7000612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:26.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.077+0000 7ff7191a0700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff714154cf0 0x7ff7141646c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:26.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.077+0000 7ff7191a0700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7140624f0 0x7ff7140a9ce0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:26.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.077+0000 7ff7191a0700 1 --2- 172.21.15.78:0/3809288197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff71413a740 0x7ff7141641d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:26.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.077+0000 7ff7191a0700 1 -- 172.21.15.78:0/3809288197 >> 172.21.15.78:0/3809288197 conn(0x7ff7140c7b80 msgr2=0x7ff7141561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:26.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.078+0000 7ff7191a0700 1 -- 172.21.15.78:0/3809288197 shutdown_connections 2023-08-17T17:53:26.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.078+0000 7ff7191a0700 1 -- 172.21.15.78:0/3809288197 wait complete. 2023-08-17T17:53:26.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:53:26.090 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-17T17:53:26.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-08-17T17:53:26.235 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:26.234+0000 7f44590f3680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:53:26.250 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:26.250+0000 7fec94730680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:53:26.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.269+0000 7fa31d68a700 1 Processor -- start 2023-08-17T17:53:26.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.269+0000 7fa31d68a700 1 -- start start 2023-08-17T17:53:26.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa31d68a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa318151c70 0x7fa3180a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:26.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa31d68a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3180a5210 con 0x7fa318062c00 2023-08-17T17:53:26.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa31d68a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa318137690 con 0x7fa3180a4d60 2023-08-17T17:53:26.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa31d68a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa318063000 con 0x7fa318151c70 2023-08-17T17:53:26.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa3177fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa318062c00 0x7fa3180bc280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40754/0 (socket says 172.21.15.78:40754) 2023-08-17T17:53:26.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa3177fe700 1 -- 172.21.15.78:0/3543381454 learned_addr learned my addr 172.21.15.78:0/3543381454 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:26.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa316ffd700 1 --2- 172.21.15.78:0/3543381454 >> v2:172.21.15.150:3300/0 conn(0x7fa318151c70 0x7fa3180a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:26.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa315ffb700 1 -- 172.21.15.78:0/3543381454 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807320443 0 0) 0x7fa310001490 con 0x7fa318062c00 2023-08-17T17:53:26.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa315ffb700 1 -- 172.21.15.78:0/3543381454 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3000033f0 con 0x7fa318062c00 2023-08-17T17:53:26.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa315ffb700 1 -- 172.21.15.78:0/3543381454 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600089070 0 0) 0x7fa318137690 con 0x7fa3180a4d60 2023-08-17T17:53:26.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa315ffb700 1 -- 172.21.15.78:0/3543381454 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa310001490 con 0x7fa3180a4d60 2023-08-17T17:53:26.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa316ffd700 1 -- 172.21.15.78:0/3543381454 >> v1:172.21.15.150:6789/0 conn(0x7fa3180a4d60 legacy=0x7fa3180624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:26.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa316ffd700 1 -- 172.21.15.78:0/3543381454 >> v1:172.21.15.78:6789/0 conn(0x7fa318062c00 legacy=0x7fa3180bc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:26.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.270+0000 7fa316ffd700 1 -- 172.21.15.78:0/3543381454 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318063df0 con 0x7fa318151c70 2023-08-17T17:53:26.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa316ffd700 1 --2- 172.21.15.78:0/3543381454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318151c70 0x7fa3180a4870 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fa30c009760 tx=0x7fa30c009060).ready entity=mon.1 client_cookie=cdc7ad60a973e2f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:26.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa315ffb700 1 -- 172.21.15.78:0/3543381454 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00d4a0 con 0x7fa318151c70 2023-08-17T17:53:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa315ffb700 1 -- 172.21.15.78:0/3543381454 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c00d600 con 0x7fa318151c70 2023-08-17T17:53:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa315ffb700 1 -- 172.21.15.78:0/3543381454 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00d980 con 0x7fa318151c70 2023-08-17T17:53:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa31d68a700 1 -- 172.21.15.78:0/3543381454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318151c70 msgr2=0x7fa3180a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa31d68a700 1 --2- 172.21.15.78:0/3543381454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318151c70 0x7fa3180a4870 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fa30c009760 tx=0x7fa30c009060).stop 2023-08-17T17:53:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa31d68a700 1 -- 172.21.15.78:0/3543381454 shutdown_connections 2023-08-17T17:53:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa31d68a700 1 --2- 172.21.15.78:0/3543381454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318151c70 0x7fa3180a4870 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa31d68a700 1 -- 172.21.15.78:0/3543381454 >> 172.21.15.78:0/3543381454 conn(0x7fa3180c3c10 msgr2=0x7fa3180c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa31d68a700 1 -- 172.21.15.78:0/3543381454 shutdown_connections 2023-08-17T17:53:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.271+0000 7fa31d68a700 1 -- 172.21.15.78:0/3543381454 wait complete. 2023-08-17T17:53:26.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.273+0000 7fa31d68a700 1 Processor -- start 2023-08-17T17:53:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.273+0000 7fa31d68a700 1 -- start start 2023-08-17T17:53:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.273+0000 7fa31d68a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318062c00 0x7fa318136170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.273+0000 7fa31d68a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180a4d60 0x7fa31813bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.273+0000 7fa31d68a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa318151c70 0x7fa3180bd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.273+0000 7fa31d68a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31813c600 con 0x7fa3180a4d60 2023-08-17T17:53:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.273+0000 7fa31d68a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31813c8e0 con 0x7fa318062c00 2023-08-17T17:53:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.273+0000 7fa31d68a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31813cbc0 con 0x7fa318151c70 2023-08-17T17:53:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa3167fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180a4d60 0x7fa31813bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa316ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318062c00 0x7fa318136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa316ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318062c00 0x7fa318136170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:35980/0 (socket says 172.21.15.78:35980) 2023-08-17T17:53:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa316ffd700 1 -- 172.21.15.78:0/4075745225 learned_addr learned my addr 172.21.15.78:0/4075745225 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa3177fe700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa318151c70 0x7fa3180bd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa316ffd700 1 -- 172.21.15.78:0/4075745225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa318151c70 msgr2=0x7fa3180bd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa316ffd700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa318151c70 0x7fa3180bd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa316ffd700 1 -- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180a4d60 msgr2=0x7fa31813bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa316ffd700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180a4d60 0x7fa31813bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa316ffd700 1 -- 172.21.15.78:0/4075745225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0092a0 con 0x7fa318062c00 2023-08-17T17:53:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa3167fc700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180a4d60 0x7fa31813bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa316ffd700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318062c00 0x7fa318136170 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fa31806c260 tx=0x7fa30c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00dcf0 con 0x7fa318062c00 2023-08-17T17:53:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c00de50 con 0x7fa318062c00 2023-08-17T17:53:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa31d68a700 1 -- 172.21.15.78:0/4075745225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31813cea0 con 0x7fa318062c00 2023-08-17T17:53:26.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00d980 con 0x7fa318062c00 2023-08-17T17:53:26.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.274+0000 7fa31d68a700 1 -- 172.21.15.78:0/4075745225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa318136660 con 0x7fa318062c00 2023-08-17T17:53:26.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.275+0000 7fa31d68a700 1 -- 172.21.15.78:0/4075745225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31805f910 con 0x7fa318062c00 2023-08-17T17:53:26.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.276+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 58) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fa30c00f070 con 0x7fa318062c00 2023-08-17T17:53:26.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.276+0000 7fa2feffd700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa3040612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:26.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.276+0000 7fa3167fc700 1 -- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 msgr2=0x7fa3040612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:26.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.276+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa30c07b120 con 0x7fa318062c00 2023-08-17T17:53:26.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.276+0000 7fa3167fc700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa3040612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:26.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.280+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa30c04c6c0 con 0x7fa318062c00 2023-08-17T17:53:26.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.477+0000 7fa3167fc700 1 -- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 msgr2=0x7fa3040612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:26.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.477+0000 7fa3167fc700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa3040612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:26.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.482+0000 7fa31d68a700 1 -- 172.21.15.78:0/4075745225 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7fa31813ca20 con 0x7fa30405ede0 2023-08-17T17:53:26.861 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:26.860+0000 7f44590f3680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:53:26.875 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:26.875+0000 7fec94730680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:53:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.878+0000 7fa3167fc700 1 -- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 msgr2=0x7fa3040612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:26.878+0000 7fa3167fc700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa3040612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T17:53:26.934 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:26.933+0000 7f44590f3680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:53:26.948 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:26.948+0000 7fec94730680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:53:27.121 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:27.121+0000 7f44590f3680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:53:27.133 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:27.133+0000 7fec94730680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:53:27.545 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:27.544+0000 7f44590f3680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:53:27.552 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:27.552+0000 7fec94730680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:53:27.649 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:27.649+0000 7f44590f3680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:27.655 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:27.655+0000 7fec94730680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:27.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:27.679+0000 7fa3167fc700 1 -- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 msgr2=0x7fa3040612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:27.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:27.679+0000 7fa3167fc700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa3040612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T17:53:27.803 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:27.803+0000 7f44590f3680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:27.807 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:27.807+0000 7fec94730680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:27.879 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:27.878+0000 7f44590f3680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:53:27.880 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:27.880+0000 7fec94730680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:53:27.947 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:27.947+0000 7f44590f3680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:53:27.948 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:27.948+0000 7fec94730680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:53:28.204 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:28.204+0000 7fec94730680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:53:28.207 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:28.206+0000 7f44590f3680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:53:28.385 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:28.385+0000 7fec94730680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:28.390 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:28.390+0000 7f44590f3680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:29.033 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:29.033+0000 7fec94730680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:53:29.046 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:29.044+0000 7f44590f3680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:53:29.101 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:29.101+0000 7fec94730680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:53:29.114 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:29.114+0000 7f44590f3680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:53:29.177 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:29.177+0000 7fec94730680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:53:29.190 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:29.189+0000 7f44590f3680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:53:29.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:29.280+0000 7fa3167fc700 1 -- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 msgr2=0x7fa3040612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:29.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:29.280+0000 7fa3167fc700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa3040612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-17T17:53:29.324 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:29.324+0000 7fec94730680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:53:29.338 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:29.337+0000 7f44590f3680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:53:29.394 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:29.394+0000 7fec94730680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:53:29.408 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:29.407+0000 7f44590f3680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:53:29.510 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:29.510+0000 7fec94730680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:53:29.525 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:29.525+0000 7f44590f3680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:53:29.617 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:29.616+0000 7fec94730680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:29.634 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:29.634+0000 7f44590f3680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:29.906 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:29.905+0000 7fec94730680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:53:29.926 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:29.925+0000 7f44590f3680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:53:29.978 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:29.977+0000 7fec94730680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:53:30.000 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:29.999+0000 7f44590f3680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:53:30.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:30.000+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 59) v1 ==== 75109+0+0 (secure 0 0 0) 0x7fa30c079020 con 0x7fa318062c00 2023-08-17T17:53:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:30.001+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 msgr2=0x7fa3040612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:30.001+0000 7fa2feffd700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa3040612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:30.064 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:30.063+0000 7fec0ff08700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:30.064 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:30.063+0000 7fec0ff08700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:30.064 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:30.063+0000 7fec0ff08700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:30.064 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:30.063+0000 7fec0ff08700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:30.065 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:30.063+0000 7fec0ff08700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:30.065 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:30.063+0000 7fec12f0e700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:30.065 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:30.063+0000 7fec12f0e700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:30.065 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:30.063+0000 7fec12f0e700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:30.065 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:30.063+0000 7fec12f0e700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:30.065 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:30.063+0000 7fec12f0e700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:30.999+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 <== mon.1 v2:172.21.15.150:3300/0 8 ==== mgrmap(e 60) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fa30c0793a0 con 0x7fa318062c00 2023-08-17T17:53:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:30.999+0000 7fa2feffd700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa30402fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:30.999+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7fa31813ca20 con 0x7fa30405ede0 2023-08-17T17:53:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.000+0000 7fa3167fc700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa30402fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.001+0000 7fa3167fc700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa30402fd40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa308007fd0 tx=0x7fa308007bd0).ready entity=mgr.8295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:31.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.015+0000 7fa2feffd700 1 -- 172.21.15.78:0/4075745225 <== mgr.8295 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa31813ca20 con 0x7fa30405ede0 2023-08-17T17:53:31.017 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path snap_test_dir1 2023-08-17T17:53:31.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.017+0000 7fa31d68a700 1 -- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 msgr2=0x7fa30402fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.017+0000 7fa31d68a700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa30402fd40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa308007fd0 tx=0x7fa308007bd0).stop 2023-08-17T17:53:31.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.017+0000 7fa31d68a700 1 -- 172.21.15.78:0/4075745225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318062c00 msgr2=0x7fa318136170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.017+0000 7fa31d68a700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318062c00 0x7fa318136170 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fa31806c260 tx=0x7fa30c016000).stop 2023-08-17T17:53:31.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.017+0000 7fa31d68a700 1 -- 172.21.15.78:0/4075745225 shutdown_connections 2023-08-17T17:53:31.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.017+0000 7fa31d68a700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa30405ede0 0x7fa30402fd40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.017+0000 7fa31d68a700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa318151c70 0x7fa3180bd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.017+0000 7fa31d68a700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa318062c00 0x7fa318136170 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.017+0000 7fa31d68a700 1 --2- 172.21.15.78:0/4075745225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180a4d60 0x7fa31813bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.017+0000 7fa31d68a700 1 -- 172.21.15.78:0/4075745225 >> 172.21.15.78:0/4075745225 conn(0x7fa3180c3c10 msgr2=0x7fa318064f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:31.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.018+0000 7fa31d68a700 1 -- 172.21.15.78:0/4075745225 shutdown_connections 2023-08-17T17:53:31.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.018+0000 7fa31d68a700 1 -- 172.21.15.78:0/4075745225 wait complete. 2023-08-17T17:53:31.031 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-17T17:53:31.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-17T17:53:31.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.147+0000 7f2ac4119700 1 Processor -- start 2023-08-17T17:53:31.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.147+0000 7f2ac4119700 1 -- start start 2023-08-17T17:53:31.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.148+0000 7f2ac4119700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2abc0aa0f0 0x7f2abc0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.148+0000 7f2ac4119700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2abc0aa4d0 0x7f2abc0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.148+0000 7f2ac4119700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc0649b0 con 0x7f2abc0c5810 2023-08-17T17:53:31.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.148+0000 7f2ac4119700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc063420 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.148+0000 7f2ac4119700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc063700 con 0x7f2abc0aa0f0 2023-08-17T17:53:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.148+0000 7f2ac16b4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2abc0aa4d0 0x7f2abc0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.148+0000 7f2ac16b4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2abc0aa4d0 0x7f2abc0c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59096/0 (socket says 172.21.15.78:59096) 2023-08-17T17:53:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.148+0000 7f2ac16b4700 1 -- 172.21.15.78:0/3325182798 learned_addr learned my addr 172.21.15.78:0/3325182798 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.148+0000 7f2ac1eb5700 1 --2- 172.21.15.78:0/3325182798 >> v2:172.21.15.150:3300/0 conn(0x7f2abc0aa0f0 0x7f2abc0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac16b4700 1 -- 172.21.15.78:0/3325182798 >> v2:172.21.15.150:3300/0 conn(0x7f2abc0aa0f0 msgr2=0x7f2abc0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac16b4700 1 --2- 172.21.15.78:0/3325182798 >> v2:172.21.15.150:3300/0 conn(0x7f2abc0aa0f0 0x7f2abc0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac16b4700 1 -- 172.21.15.78:0/3325182798 >> v1:172.21.15.150:6789/0 conn(0x7f2abc0c5810 legacy=0x7f2abc0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac16b4700 1 -- 172.21.15.78:0/3325182798 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0639e0 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac16b4700 1 --2- 172.21.15.78:0/3325182798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 0x7f2abc0c0e10 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f2abc0cade0 tx=0x7f2aac0090f0).ready entity=mon.0 client_cookie=21e1a051c042b21c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:31.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac0eb3700 1 -- 172.21.15.78:0/3325182798 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00b600 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac0eb3700 1 -- 172.21.15.78:0/3325182798 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac00b760 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac0eb3700 1 -- 172.21.15.78:0/3325182798 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00bae0 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac4119700 1 -- 172.21.15.78:0/3325182798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 msgr2=0x7f2abc0c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac4119700 1 --2- 172.21.15.78:0/3325182798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 0x7f2abc0c0e10 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f2abc0cade0 tx=0x7f2aac0090f0).stop 2023-08-17T17:53:31.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac4119700 1 -- 172.21.15.78:0/3325182798 shutdown_connections 2023-08-17T17:53:31.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac4119700 1 --2- 172.21.15.78:0/3325182798 >> v2:172.21.15.150:3300/0 conn(0x7f2abc0aa0f0 0x7f2abc0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac4119700 1 --2- 172.21.15.78:0/3325182798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 0x7f2abc0c0e10 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac4119700 1 -- 172.21.15.78:0/3325182798 >> 172.21.15.78:0/3325182798 conn(0x7f2abc06a6a0 msgr2=0x7f2abc0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:31.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac4119700 1 -- 172.21.15.78:0/3325182798 shutdown_connections 2023-08-17T17:53:31.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.149+0000 7f2ac4119700 1 -- 172.21.15.78:0/3325182798 wait complete. 2023-08-17T17:53:31.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac4119700 1 Processor -- start 2023-08-17T17:53:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac4119700 1 -- start start 2023-08-17T17:53:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac4119700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2abc0aa0f0 0x7f2abc0ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac4119700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 0x7f2abc0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac4119700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2abc0c5810 0x7f2abc1508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac4119700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0acc70 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac4119700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0c1c60 con 0x7f2abc0c5810 2023-08-17T17:53:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac4119700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0c1f40 con 0x7f2abc0aa0f0 2023-08-17T17:53:31.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac16b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 0x7f2abc0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac16b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 0x7f2abc0b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59110/0 (socket says 172.21.15.78:59110) 2023-08-17T17:53:31.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.151+0000 7f2ac16b4700 1 -- 172.21.15.78:0/372279437 learned_addr learned my addr 172.21.15.78:0/372279437 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:31.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac1eb5700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2abc0aa0f0 0x7f2abc0ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac26b6700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2abc0c5810 0x7f2abc1508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac16b4700 1 -- 172.21.15.78:0/372279437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2abc0aa0f0 msgr2=0x7f2abc0ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac16b4700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2abc0aa0f0 0x7f2abc0ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac16b4700 1 -- 172.21.15.78:0/372279437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2abc0c5810 msgr2=0x7f2abc1508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac16b4700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2abc0c5810 0x7f2abc1508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac16b4700 1 -- 172.21.15.78:0/372279437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac009370 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac26b6700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2abc0c5810 0x7f2abc1508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:31.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac16b4700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 0x7f2abc0b0050 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f2aac011000 tx=0x7f2aac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:31.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ab1ffb700 1 -- 172.21.15.78:0/372279437 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00b8d0 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ab1ffb700 1 -- 172.21.15.78:0/372279437 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac00ba30 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac4119700 1 -- 172.21.15.78:0/372279437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc0c2220 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ab1ffb700 1 -- 172.21.15.78:0/372279437 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac01c630 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.152+0000 7f2ac4119700 1 -- 172.21.15.78:0/372279437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc0aca40 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.153+0000 7f2ac4119700 1 -- 172.21.15.78:0/372279437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2abc0c1ac0 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.153+0000 7f2ab1ffb700 1 -- 172.21.15.78:0/372279437 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 60) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f2aac02c070 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.154+0000 7f2ab1ffb700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2aa005ed10 0x7f2aa00611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.154+0000 7f2ab1ffb700 1 -- 172.21.15.78:0/372279437 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2aac07b770 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.154+0000 7f2ac1eb5700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2aa005ed10 0x7f2aa00611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.154+0000 7f2ac1eb5700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2aa005ed10 0x7f2aa00611d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2ab8007460 tx=0x7f2ab800b040).ready entity=mgr.8295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:31.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.158+0000 7f2ab1ffb700 1 -- 172.21.15.78:0/372279437 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2abc0c1ac0 con 0x7f2abc0aa4d0 2023-08-17T17:53:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.346+0000 7f2ac4119700 1 -- 172.21.15.78:0/372279437 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2abc0c1ac0 con 0x7f2aa005ed10 2023-08-17T17:53:31.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.350+0000 7f2ab1ffb700 1 -- 172.21.15.78:0/372279437 <== mgr.8295 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2abc0c1ac0 con 0x7f2aa005ed10 2023-08-17T17:53:31.351 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path snap_test_dir1 2023-08-17T17:53:31.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 -- 172.21.15.78:0/372279437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2aa005ed10 msgr2=0x7f2aa00611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2aa005ed10 0x7f2aa00611d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2ab8007460 tx=0x7f2ab800b040).stop 2023-08-17T17:53:31.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 -- 172.21.15.78:0/372279437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 msgr2=0x7f2abc0b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 0x7f2abc0b0050 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f2aac011000 tx=0x7f2aac017000).stop 2023-08-17T17:53:31.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 -- 172.21.15.78:0/372279437 shutdown_connections 2023-08-17T17:53:31.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2aa005ed10 0x7f2aa00611d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2abc0c5810 0x7f2abc1508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2abc0aa0f0 0x7f2abc0ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 --2- 172.21.15.78:0/372279437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2abc0aa4d0 0x7f2abc0b0050 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 -- 172.21.15.78:0/372279437 >> 172.21.15.78:0/372279437 conn(0x7f2abc06a6a0 msgr2=0x7f2abc0a9450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:31.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 -- 172.21.15.78:0/372279437 shutdown_connections 2023-08-17T17:53:31.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.352+0000 7f2ac4119700 1 -- 172.21.15.78:0/372279437 wait complete. 2023-08-17T17:53:31.365 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-17T17:53:31.365 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-17T17:53:31.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.480+0000 7fd06c6c1700 1 Processor -- start 2023-08-17T17:53:31.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.480+0000 7fd06c6c1700 1 -- start start 2023-08-17T17:53:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.481+0000 7fd06c6c1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd0640aa0f0 0x7fd0640644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.481+0000 7fd06c6c1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0640649b0 con 0x7fd0640aa4d0 2023-08-17T17:53:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.481+0000 7fd06c6c1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd064063420 con 0x7fd0640c5810 2023-08-17T17:53:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.481+0000 7fd06c6c1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd064063700 con 0x7fd0640aa0f0 2023-08-17T17:53:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.481+0000 7fd069c5c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd0640aa4d0 0x7fd0640c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38864/0 (socket says 172.21.15.78:38864) 2023-08-17T17:53:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.481+0000 7fd069c5c700 1 -- 172.21.15.78:0/2600418695 learned_addr learned my addr 172.21.15.78:0/2600418695 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.481+0000 7fd06a45d700 1 --2- 172.21.15.78:0/2600418695 >> v2:172.21.15.150:3300/0 conn(0x7fd0640aa0f0 0x7fd0640644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.481+0000 7fd06945b700 1 -- 172.21.15.78:0/2600418695 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556904815 0 0) 0x7fd0640649b0 con 0x7fd0640aa4d0 2023-08-17T17:53:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06945b700 1 -- 172.21.15.78:0/2600418695 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd04c0033f0 con 0x7fd0640aa4d0 2023-08-17T17:53:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06945b700 1 -- 172.21.15.78:0/2600418695 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803301771 0 0) 0x7fd064063420 con 0x7fd0640c5810 2023-08-17T17:53:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06945b700 1 -- 172.21.15.78:0/2600418695 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0640649b0 con 0x7fd0640c5810 2023-08-17T17:53:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06945b700 1 -- 172.21.15.78:0/2600418695 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 176056273 0 0) 0x7fd04c0033f0 con 0x7fd0640aa4d0 2023-08-17T17:53:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06a45d700 1 -- 172.21.15.78:0/2600418695 >> v1:172.21.15.150:6789/0 conn(0x7fd0640c5810 legacy=0x7fd0640a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06a45d700 1 -- 172.21.15.78:0/2600418695 >> v1:172.21.15.78:6789/0 conn(0x7fd0640aa4d0 legacy=0x7fd0640c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06a45d700 1 -- 172.21.15.78:0/2600418695 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640639e0 con 0x7fd0640aa0f0 2023-08-17T17:53:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06a45d700 1 --2- 172.21.15.78:0/2600418695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0640aa0f0 0x7fd0640644c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fd054009760 tx=0x7fd054009060).ready entity=mon.1 client_cookie=902c498cd672c930 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06945b700 1 -- 172.21.15.78:0/2600418695 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058001470 con 0x7fd0640aa0f0 2023-08-17T17:53:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06945b700 1 -- 172.21.15.78:0/2600418695 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd054011400 con 0x7fd0640aa0f0 2023-08-17T17:53:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.482+0000 7fd06945b700 1 -- 172.21.15.78:0/2600418695 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054011780 con 0x7fd0640aa0f0 2023-08-17T17:53:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.483+0000 7fd06c6c1700 1 -- 172.21.15.78:0/2600418695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0640aa0f0 msgr2=0x7fd0640644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.483+0000 7fd06c6c1700 1 --2- 172.21.15.78:0/2600418695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0640aa0f0 0x7fd0640644c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fd054009760 tx=0x7fd054009060).stop 2023-08-17T17:53:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.483+0000 7fd06c6c1700 1 -- 172.21.15.78:0/2600418695 shutdown_connections 2023-08-17T17:53:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.483+0000 7fd06c6c1700 1 --2- 172.21.15.78:0/2600418695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0640aa0f0 0x7fd0640644c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.483+0000 7fd06c6c1700 1 -- 172.21.15.78:0/2600418695 >> 172.21.15.78:0/2600418695 conn(0x7fd06406a6a0 msgr2=0x7fd0640caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.483+0000 7fd06c6c1700 1 -- 172.21.15.78:0/2600418695 shutdown_connections 2023-08-17T17:53:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.483+0000 7fd06c6c1700 1 -- 172.21.15.78:0/2600418695 wait complete. 2023-08-17T17:53:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.484+0000 7fd06c6c1700 1 Processor -- start 2023-08-17T17:53:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.484+0000 7fd06c6c1700 1 -- start start 2023-08-17T17:53:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06c6c1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0640aa0f0 0x7fd06414e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06c6c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0640aa4d0 0x7fd0640c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06c6c1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0640c5810 0x7fd0640ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06c6c1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06414e840 con 0x7fd0640aa4d0 2023-08-17T17:53:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06c6c1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640c2ce0 con 0x7fd0640aa0f0 2023-08-17T17:53:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06c6c1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640c2fc0 con 0x7fd0640c5810 2023-08-17T17:53:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd069c5c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0640aa4d0 0x7fd0640c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd069c5c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0640aa4d0 0x7fd0640c2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59114/0 (socket says 172.21.15.78:59114) 2023-08-17T17:53:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd069c5c700 1 -- 172.21.15.78:0/3410688482 learned_addr learned my addr 172.21.15.78:0/3410688482 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06a45d700 1 --2- 172.21.15.78:0/3410688482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0640aa0f0 0x7fd06414e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06ac5e700 1 --2- 172.21.15.78:0/3410688482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0640c5810 0x7fd0640ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd069c5c700 1 -- 172.21.15.78:0/3410688482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0640c5810 msgr2=0x7fd0640ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd069c5c700 1 --2- 172.21.15.78:0/3410688482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0640c5810 0x7fd0640ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd069c5c700 1 -- 172.21.15.78:0/3410688482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0640aa0f0 msgr2=0x7fd06414e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd069c5c700 1 --2- 172.21.15.78:0/3410688482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0640aa0f0 0x7fd06414e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd069c5c700 1 -- 172.21.15.78:0/3410688482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540092a0 con 0x7fd0640aa4d0 2023-08-17T17:53:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06ac5e700 1 --2- 172.21.15.78:0/3410688482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0640c5810 0x7fd0640ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd069c5c700 1 --2- 172.21.15.78:0/3410688482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0640aa4d0 0x7fd0640c2490 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7fd05800cb60 tx=0x7fd058001ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd0627fc700 1 -- 172.21.15.78:0/3410688482 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058007e10 con 0x7fd0640aa4d0 2023-08-17T17:53:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd0627fc700 1 -- 172.21.15.78:0/3410688482 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd058007320 con 0x7fd0640aa4d0 2023-08-17T17:53:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd0627fc700 1 -- 172.21.15.78:0/3410688482 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580057a0 con 0x7fd0640aa4d0 2023-08-17T17:53:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06c6c1700 1 -- 172.21.15.78:0/3410688482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0640c32a0 con 0x7fd0640aa4d0 2023-08-17T17:53:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.485+0000 7fd06c6c1700 1 -- 172.21.15.78:0/3410688482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0640c3860 con 0x7fd0640aa4d0 2023-08-17T17:53:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.486+0000 7fd06c6c1700 1 -- 172.21.15.78:0/3410688482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd064083980 con 0x7fd0640aa4d0 2023-08-17T17:53:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.487+0000 7fd0627fc700 1 -- 172.21.15.78:0/3410688482 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 60) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fd058010030 con 0x7fd0640aa4d0 2023-08-17T17:53:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.487+0000 7fd0627fc700 1 --2- 172.21.15.78:0/3410688482 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd05005ed40 0x7fd050061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.487+0000 7fd0627fc700 1 -- 172.21.15.78:0/3410688482 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd058079b00 con 0x7fd0640aa4d0 2023-08-17T17:53:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.487+0000 7fd06a45d700 1 --2- 172.21.15.78:0/3410688482 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd05005ed40 0x7fd050061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.487+0000 7fd06a45d700 1 --2- 172.21.15.78:0/3410688482 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd05005ed40 0x7fd050061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd054009760 tx=0x7fd054016000).ready entity=mgr.8295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.491+0000 7fd0627fc700 1 -- 172.21.15.78:0/3410688482 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd05804b090 con 0x7fd0640aa4d0 2023-08-17T17:53:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.676+0000 7fd06c6c1700 1 -- 172.21.15.78:0/3410688482 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0640cbd40 con 0x7fd05005ed40 2023-08-17T17:53:31.678 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:31.677+0000 7fec421b7700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-17T17:53:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.678+0000 7fd0627fc700 1 -- 172.21.15.78:0/3410688482 <== mgr.8295 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fd0640cbd40 con 0x7fd05005ed40 2023-08-17T17:53:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-17T17:53:31.683 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-17T17:53:31.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:53:31.684 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-17T17:53:31.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-17T17:53:31.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.853+0000 7f5bccd48700 1 Processor -- start 2023-08-17T17:53:31.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.853+0000 7f5bccd48700 1 -- start start 2023-08-17T17:53:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.854+0000 7f5bccd48700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bc80aa0f0 0x7f5bc80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.854+0000 7f5bccd48700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc80649b0 con 0x7f5bc80c5810 2023-08-17T17:53:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.854+0000 7f5bccd48700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc8063420 con 0x7f5bc80aa4d0 2023-08-17T17:53:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.854+0000 7f5bccd48700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8063700 con 0x7f5bc80aa0f0 2023-08-17T17:53:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.854+0000 7f5bc6d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5bc80c5810 0x7f5bc80a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38874/0 (socket says 172.21.15.78:38874) 2023-08-17T17:53:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.854+0000 7f5bc6d9d700 1 -- 172.21.15.78:0/1254170312 learned_addr learned my addr 172.21.15.78:0/1254170312 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:31.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.854+0000 7f5bc659c700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bc80aa0f0 0x7f5bc80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.854+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014858042 0 0) 0x7f5bc80649b0 con 0x7f5bc80c5810 2023-08-17T17:53:31.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.854+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb40033f0 con 0x7f5bc80c5810 2023-08-17T17:53:31.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1569380379 0 0) 0x7f5bb40033f0 con 0x7f5bc80c5810 2023-08-17T17:53:31.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bc80aa0f0 msgr2=0x7f5bc80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:31.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bc80aa0f0 0x7f5bc80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 >> v1:172.21.15.150:6789/0 conn(0x7f5bc80aa4d0 legacy=0x7f5bc80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc80639e0 con 0x7f5bc80c5810 2023-08-17T17:53:31.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f5bc00017f0 con 0x7f5bc80c5810 2023-08-17T17:53:31.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 >> v1:172.21.15.78:6789/0 conn(0x7f5bc80c5810 legacy=0x7f5bc80a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bb4003910 0x7f5bb4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bc80aa0f0 0x7f5bb4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb4004b80 0x7f5bb4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8063700 con 0x7f5bb4003910 2023-08-17T17:53:31.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb400b8e0 con 0x7f5bb4004b80 2023-08-17T17:53:31.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb400ba50 con 0x7f5bc80aa0f0 2023-08-17T17:53:31.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc659c700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bb4003910 0x7f5bb4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bbdd9b700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bc80aa0f0 0x7f5bb4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc6d9d700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb4004b80 0x7f5bb4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc659c700 1 -- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bc80aa0f0 msgr2=0x7f5bb4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:31.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc659c700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bc80aa0f0 0x7f5bb4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc659c700 1 -- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb4004b80 msgr2=0x7f5bb4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:31.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc659c700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bb4004b80 0x7f5bb4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc659c700 1 -- 172.21.15.78:0/1254170312 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb40033f0 con 0x7f5bb4003910 2023-08-17T17:53:31.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bbdd9b700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bc80aa0f0 0x7f5bb4004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:31.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc659c700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bb4003910 0x7f5bb4003cf0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f5bb8009a60 tx=0x7f5bb8009060).ready entity=mon.0 client_cookie=5ae068479a3c60a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:31.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8009ea0 con 0x7f5bb4003910 2023-08-17T17:53:31.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb8009430 con 0x7f5bb4003910 2023-08-17T17:53:31.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.855+0000 7f5bc5d9b700 1 -- 172.21.15.78:0/1254170312 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb800e810 con 0x7f5bb4003910 2023-08-17T17:53:31.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.856+0000 7f5bccd48700 1 -- 172.21.15.78:0/1254170312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bb4003910 msgr2=0x7f5bb4003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.856+0000 7f5bccd48700 1 --2- 172.21.15.78:0/1254170312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bb4003910 0x7f5bb4003cf0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f5bb8009a60 tx=0x7f5bb8009060).stop 2023-08-17T17:53:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.856+0000 7f5bc6d9d700 1 -- 172.21.15.78:0/1254170312 reap_dead start 2023-08-17T17:53:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.856+0000 7f5bccd48700 1 -- 172.21.15.78:0/1254170312 shutdown_connections 2023-08-17T17:53:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.856+0000 7f5bccd48700 1 -- 172.21.15.78:0/1254170312 >> 172.21.15.78:0/1254170312 conn(0x7f5bc806a6a0 msgr2=0x7f5bc80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.856+0000 7f5bccd48700 1 -- 172.21.15.78:0/1254170312 shutdown_connections 2023-08-17T17:53:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.856+0000 7f5bccd48700 1 -- 172.21.15.78:0/1254170312 wait complete. 2023-08-17T17:53:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.857+0000 7f5bccd48700 1 Processor -- start 2023-08-17T17:53:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.857+0000 7f5bccd48700 1 -- start start 2023-08-17T17:53:31.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bccd48700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bb4003910 0x7f5bc8168730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bccd48700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc81515b0 0x7f5bc80c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bccd48700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc80c3c90 0x7f5bc81647f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bccd48700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8168c20 con 0x7f5bc80c3c90 2023-08-17T17:53:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bccd48700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80c4110 con 0x7f5bc81515b0 2023-08-17T17:53:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bccd48700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80c1e10 con 0x7f5bb4003910 2023-08-17T17:53:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bc6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc80c3c90 0x7f5bc81647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bc6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc80c3c90 0x7f5bc81647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59128/0 (socket says 172.21.15.78:59128) 2023-08-17T17:53:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bc6d9d700 1 -- 172.21.15.78:0/900631851 learned_addr learned my addr 172.21.15.78:0/900631851 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bc659c700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bb4003910 0x7f5bc8168730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bbdd9b700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc81515b0 0x7f5bc80c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bc6d9d700 1 -- 172.21.15.78:0/900631851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bb4003910 msgr2=0x7f5bc8168730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bc6d9d700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bb4003910 0x7f5bc8168730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bc6d9d700 1 -- 172.21.15.78:0/900631851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc81515b0 msgr2=0x7f5bc80c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bc6d9d700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc81515b0 0x7f5bc80c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.858+0000 7f5bc6d9d700 1 -- 172.21.15.78:0/900631851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc80c20f0 con 0x7f5bc80c3c90 2023-08-17T17:53:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.859+0000 7f5bc6d9d700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc80c3c90 0x7f5bc81647f0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f5bc80c54f0 tx=0x7f5bc00018e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.859+0000 7f5bbeffd700 1 -- 172.21.15.78:0/900631851 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0010520 con 0x7f5bc80c3c90 2023-08-17T17:53:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.859+0000 7f5bbeffd700 1 -- 172.21.15.78:0/900631851 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc0010680 con 0x7f5bc80c3c90 2023-08-17T17:53:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.859+0000 7f5bccd48700 1 -- 172.21.15.78:0/900631851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc80c23d0 con 0x7f5bc80c3c90 2023-08-17T17:53:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.859+0000 7f5bbeffd700 1 -- 172.21.15.78:0/900631851 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0010a40 con 0x7f5bc80c3c90 2023-08-17T17:53:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.859+0000 7f5bccd48700 1 -- 172.21.15.78:0/900631851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc80c2990 con 0x7f5bc80c3c90 2023-08-17T17:53:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.860+0000 7f5bccd48700 1 -- 172.21.15.78:0/900631851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc8083980 con 0x7f5bc80c3c90 2023-08-17T17:53:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.860+0000 7f5bbeffd700 1 -- 172.21.15.78:0/900631851 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 60) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f5bc0014430 con 0x7f5bc80c3c90 2023-08-17T17:53:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.860+0000 7f5bbeffd700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ba805ed70 0x7f5ba8061230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.860+0000 7f5bbeffd700 1 -- 172.21.15.78:0/900631851 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5bc0079d20 con 0x7f5bc80c3c90 2023-08-17T17:53:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.861+0000 7f5bc659c700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ba805ed70 0x7f5ba8061230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:31.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.861+0000 7f5bc659c700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ba805ed70 0x7f5ba8061230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5bb8009820 tx=0x7f5bb801a000).ready entity=mgr.8295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:31.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:31.865+0000 7f5bbeffd700 1 -- 172.21.15.78:0/900631851 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5bc004b250 con 0x7f5bc80c3c90 2023-08-17T17:53:32.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:32.072+0000 7f5bccd48700 1 -- 172.21.15.78:0/900631851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f5bc8046af0 con 0x7f5bc80c3c90 2023-08-17T17:53:33.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.011+0000 7f5bbeffd700 1 -- 172.21.15.78:0/900631851 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f5bc001bdb0 con 0x7f5bc80c3c90 2023-08-17T17:53:33.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.012+0000 7f5bbeffd700 1 -- 172.21.15.78:0/900631851 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v61) v1 ==== 93+0+0 (secure 0 0 0) 0x7f5bc0076db0 con 0x7f5bc80c3c90 2023-08-17T17:53:33.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 -- 172.21.15.78:0/900631851 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ba805ed70 msgr2=0x7f5ba8061230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ba805ed70 0x7f5ba8061230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5bb8009820 tx=0x7f5bb801a000).stop 2023-08-17T17:53:33.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 -- 172.21.15.78:0/900631851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc80c3c90 msgr2=0x7f5bc81647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc80c3c90 0x7f5bc81647f0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f5bc80c54f0 tx=0x7f5bc00018e0).stop 2023-08-17T17:53:33.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 -- 172.21.15.78:0/900631851 shutdown_connections 2023-08-17T17:53:33.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ba805ed70 0x7f5ba8061230 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc80c3c90 0x7f5bc81647f0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bb4003910 0x7f5bc8168730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 --2- 172.21.15.78:0/900631851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc81515b0 0x7f5bc80c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 -- 172.21.15.78:0/900631851 >> 172.21.15.78:0/900631851 conn(0x7f5bc806a6a0 msgr2=0x7f5bc80ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:33.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 -- 172.21.15.78:0/900631851 shutdown_connections 2023-08-17T17:53:33.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.015+0000 7f5bccd48700 1 -- 172.21.15.78:0/900631851 wait complete. 2023-08-17T17:53:33.031 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:53:33.032 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:53:33.088 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:53:33.144 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:53:33.144 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T17:53:33.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:53:33.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T17:53:33.157 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:33.157+0000 7f5abc9fe680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:53:33.160 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:33.159+0000 7f57cbdff680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:53:33.191 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:53:33.192 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T17:53:33.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:33.192 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T17:53:33.221 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:33.220+0000 7f5abc9fe680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:53:33.227 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:33.226+0000 7f57cbdff680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:53:33.228 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:53:33.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:33.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.395+0000 7f92d8b5d700 1 Processor -- start 2023-08-17T17:53:33.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.395+0000 7f92d8b5d700 1 -- start start 2023-08-17T17:53:33.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.396+0000 7f92d8b5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 0x7f92d4095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.396+0000 7f92d8b5d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d4096770 con 0x7f92d4157200 2023-08-17T17:53:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.396+0000 7f92d8b5d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d40c57f0 con 0x7f92d4096300 2023-08-17T17:53:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.396+0000 7f92d8b5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40c5ad0 con 0x7f92d41575e0 2023-08-17T17:53:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.396+0000 7f92d37fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f92d4157200 0x7f92d40a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38896/0 (socket says 172.21.15.78:38896) 2023-08-17T17:53:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.396+0000 7f92d37fe700 1 -- 172.21.15.78:0/3155677383 learned_addr learned my addr 172.21.15.78:0/3155677383 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.396+0000 7f92cbfff700 1 --2- 172.21.15.78:0/3155677383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 0x7f92d4095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:33.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92d2ffd700 1 -- 172.21.15.78:0/3155677383 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115584300 0 0) 0x7f92d4096770 con 0x7f92d4157200 2023-08-17T17:53:33.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92d2ffd700 1 -- 172.21.15.78:0/3155677383 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c00033f0 con 0x7f92d4157200 2023-08-17T17:53:33.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92d2ffd700 1 -- 172.21.15.78:0/3155677383 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011835927 0 0) 0x7f92d40c57f0 con 0x7f92d4096300 2023-08-17T17:53:33.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92d2ffd700 1 -- 172.21.15.78:0/3155677383 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d4096770 con 0x7f92d4096300 2023-08-17T17:53:33.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92cbfff700 1 -- 172.21.15.78:0/3155677383 >> v1:172.21.15.150:6789/0 conn(0x7f92d4096300 legacy=0x7f92d4064380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92cbfff700 1 -- 172.21.15.78:0/3155677383 >> v1:172.21.15.78:6789/0 conn(0x7f92d4157200 legacy=0x7f92d40a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92cbfff700 1 -- 172.21.15.78:0/3155677383 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40c5db0 con 0x7f92d41575e0 2023-08-17T17:53:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92cbfff700 1 --2- 172.21.15.78:0/3155677383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 0x7f92d4095e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f92bc009790 tx=0x7f92bc009060).ready entity=mon.2 client_cookie=58fde9eea81c4df8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92d2ffd700 1 -- 172.21.15.78:0/3155677383 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00f510 con 0x7f92d41575e0 2023-08-17T17:53:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92d2ffd700 1 -- 172.21.15.78:0/3155677383 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc00f670 con 0x7f92d41575e0 2023-08-17T17:53:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.397+0000 7f92d2ffd700 1 -- 172.21.15.78:0/3155677383 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00f9f0 con 0x7f92d41575e0 2023-08-17T17:53:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.398+0000 7f92d8b5d700 1 -- 172.21.15.78:0/3155677383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 msgr2=0x7f92d4095e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.398+0000 7f92d8b5d700 1 --2- 172.21.15.78:0/3155677383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 0x7f92d4095e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f92bc009790 tx=0x7f92bc009060).stop 2023-08-17T17:53:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.398+0000 7f92d8b5d700 1 -- 172.21.15.78:0/3155677383 shutdown_connections 2023-08-17T17:53:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.398+0000 7f92d8b5d700 1 --2- 172.21.15.78:0/3155677383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 0x7f92d4095e10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.398+0000 7f92d8b5d700 1 -- 172.21.15.78:0/3155677383 >> 172.21.15.78:0/3155677383 conn(0x7f92d40624f0 msgr2=0x7f92d4062900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.398+0000 7f92d8b5d700 1 -- 172.21.15.78:0/3155677383 shutdown_connections 2023-08-17T17:53:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.398+0000 7f92d8b5d700 1 -- 172.21.15.78:0/3155677383 wait complete. 2023-08-17T17:53:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.399+0000 7f92d8b5d700 1 Processor -- start 2023-08-17T17:53:33.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.399+0000 7f92d8b5d700 1 -- start start 2023-08-17T17:53:33.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92d8b5d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92d4096300 0x7f92d40aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92d8b5d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92d4157200 0x7f92d4150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92d8b5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 0x7f92d4167f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92d8b5d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d414f440 con 0x7f92d4157200 2023-08-17T17:53:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92d8b5d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d414efb0 con 0x7f92d4096300 2023-08-17T17:53:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92d8b5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d414e3a0 con 0x7f92d41575e0 2023-08-17T17:53:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92d4157200 0x7f92d4150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92d4157200 0x7f92d4150670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59144/0 (socket says 172.21.15.78:59144) 2023-08-17T17:53:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cbfff700 1 -- 172.21.15.78:0/2528235688 learned_addr learned my addr 172.21.15.78:0/2528235688 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92d37fe700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92d4096300 0x7f92d40aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92d3fff700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 0x7f92d4167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cbfff700 1 -- 172.21.15.78:0/2528235688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 msgr2=0x7f92d4167f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cbfff700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 0x7f92d4167f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cbfff700 1 -- 172.21.15.78:0/2528235688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92d4096300 msgr2=0x7f92d40aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cbfff700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92d4096300 0x7f92d40aaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cbfff700 1 -- 172.21.15.78:0/2528235688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0092a0 con 0x7f92d4157200 2023-08-17T17:53:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92d37fe700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92d4096300 0x7f92d40aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:33.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cbfff700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92d4157200 0x7f92d4150670 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f92d4096920 tx=0x7f92bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:33.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cb7fe700 1 -- 172.21.15.78:0/2528235688 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00fe80 con 0x7f92d4157200 2023-08-17T17:53:33.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cb7fe700 1 -- 172.21.15.78:0/2528235688 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc00f7e0 con 0x7f92d4157200 2023-08-17T17:53:33.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92cb7fe700 1 -- 172.21.15.78:0/2528235688 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc01c630 con 0x7f92d4157200 2023-08-17T17:53:33.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.400+0000 7f92d8b5d700 1 -- 172.21.15.78:0/2528235688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d414e680 con 0x7f92d4157200 2023-08-17T17:53:33.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.401+0000 7f92d8b5d700 1 -- 172.21.15.78:0/2528235688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d414ec40 con 0x7f92d4157200 2023-08-17T17:53:33.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.401+0000 7f92d8b5d700 1 -- 172.21.15.78:0/2528235688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d414f140 con 0x7f92d4157200 2023-08-17T17:53:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.402+0000 7f92cb7fe700 1 -- 172.21.15.78:0/2528235688 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f92bc02c070 con 0x7f92d4157200 2023-08-17T17:53:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.402+0000 7f92cb7fe700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f92b405ede0 0x7f92b40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.402+0000 7f92d37fe700 1 -- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f92b405ede0 msgr2=0x7f92b40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.402+0000 7f92cb7fe700 1 -- 172.21.15.78:0/2528235688 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f92bc07b6a0 con 0x7f92d4157200 2023-08-17T17:53:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.402+0000 7f92d37fe700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f92b405ede0 0x7f92b40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.406+0000 7f92cb7fe700 1 -- 172.21.15.78:0/2528235688 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f92bc04cac0 con 0x7f92d4157200 2023-08-17T17:53:33.502 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:33.501+0000 7f5abc9fe680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:53:33.514 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:33.513+0000 7f57cbdff680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:53:33.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.603+0000 7f92d37fe700 1 -- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f92b405ede0 msgr2=0x7f92b40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:33.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.603+0000 7f92d37fe700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f92b405ede0 0x7f92b40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:33.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.620+0000 7f92d8b5d700 1 -- 172.21.15.78:0/2528235688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92d40c6090 con 0x7f92d4157200 2023-08-17T17:53:33.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.621+0000 7f92cb7fe700 1 -- 172.21.15.78:0/2528235688 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f92bc020090 con 0x7f92d4157200 2023-08-17T17:53:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:33.622 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2182410743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2182410743},{"type":"v1","addr":"172.21.15.150:6833","nonce":2182410743}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/4059280185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4059280185},{"type":"v1","addr":"172.21.15.150:6835","nonce":4059280185}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8106,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/984792555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":984792555},{"type":"v1","addr":"172.21.15.78:6836","nonce":984792555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:18.711473+0000","modified":"2023-08-17T17:53:20.721858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/1089949614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1089949614},{"type":"v1","addr":"172.21.15.78:6837","nonce":1089949614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T17:53:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.622+0000 7f92d8b5d700 1 -- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f92b405ede0 msgr2=0x7f92b40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f92b405ede0 0x7f92b40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 -- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92d4157200 msgr2=0x7f92d4150670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92d4157200 0x7f92d4150670 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f92d4096920 tx=0x7f92bc017000).stop 2023-08-17T17:53:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 -- 172.21.15.78:0/2528235688 shutdown_connections 2023-08-17T17:53:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f92b405ede0 0x7f92b40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d41575e0 0x7f92d4167f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92d4096300 0x7f92d40aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 --2- 172.21.15.78:0/2528235688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92d4157200 0x7f92d4150670 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 -- 172.21.15.78:0/2528235688 >> 172.21.15.78:0/2528235688 conn(0x7f92d40624f0 msgr2=0x7f92d4153670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 -- 172.21.15.78:0/2528235688 shutdown_connections 2023-08-17T17:53:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.623+0000 7f92d8b5d700 1 -- 172.21.15.78:0/2528235688 wait complete. 2023-08-17T17:53:33.626 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 49 2023-08-17T17:53:33.637 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:33.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.753+0000 7f06dacbd700 1 Processor -- start 2023-08-17T17:53:33.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.753+0000 7f06dacbd700 1 -- start start 2023-08-17T17:53:33.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.754+0000 7f06dacbd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d406a2c0 0x7f06d4069050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.754+0000 7f06dacbd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06d413aa20 0x7f06d4069540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.754+0000 7f06dacbd700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d40c2c10 con 0x7f06d413a640 2023-08-17T17:53:33.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.754+0000 7f06dacbd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d4069a30 con 0x7f06d413aa20 2023-08-17T17:53:33.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.754+0000 7f06dacbd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41552e0 con 0x7f06d406a2c0 2023-08-17T17:53:33.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.754+0000 7f06d8a59700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f06d413a640 0x7f06d4154b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38910/0 (socket says 172.21.15.78:38910) 2023-08-17T17:53:33.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.754+0000 7f06d8a59700 1 -- 172.21.15.78:0/2206288122 learned_addr learned my addr 172.21.15.78:0/2206288122 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:33.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.754+0000 7f06d925a700 1 --2- 172.21.15.78:0/2206288122 >> v2:172.21.15.150:3300/0 conn(0x7f06d413aa20 0x7f06d4069540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:33.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d3fff700 1 --2- 172.21.15.78:0/2206288122 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d406a2c0 0x7f06d4069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:33.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d37fe700 1 -- 172.21.15.78:0/2206288122 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000127956 0 0) 0x7f06d40c2c10 con 0x7f06d413a640 2023-08-17T17:53:33.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d37fe700 1 -- 172.21.15.78:0/2206288122 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c40033f0 con 0x7f06d413a640 2023-08-17T17:53:33.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d925a700 1 -- 172.21.15.78:0/2206288122 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d406a2c0 msgr2=0x7f06d4069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:33.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d925a700 1 --2- 172.21.15.78:0/2206288122 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d406a2c0 0x7f06d4069050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d925a700 1 -- 172.21.15.78:0/2206288122 >> v1:172.21.15.78:6789/0 conn(0x7f06d413a640 legacy=0x7f06d4154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d925a700 1 -- 172.21.15.78:0/2206288122 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d41555c0 con 0x7f06d413aa20 2023-08-17T17:53:33.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d3fff700 1 --2- 172.21.15.78:0/2206288122 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d406a2c0 0x7f06d4069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:33.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d925a700 1 --2- 172.21.15.78:0/2206288122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d413aa20 0x7f06d4069540 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f06cc009e60 tx=0x7f06cc009780).ready entity=mon.1 client_cookie=c4842f11724ee9a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d37fe700 1 -- 172.21.15.78:0/2206288122 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc00e070 con 0x7f06d413aa20 2023-08-17T17:53:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d37fe700 1 -- 172.21.15.78:0/2206288122 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc00bab0 con 0x7f06d413aa20 2023-08-17T17:53:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.755+0000 7f06d37fe700 1 -- 172.21.15.78:0/2206288122 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc00be30 con 0x7f06d413aa20 2023-08-17T17:53:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.756+0000 7f06dacbd700 1 -- 172.21.15.78:0/2206288122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d413aa20 msgr2=0x7f06d4069540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.756+0000 7f06dacbd700 1 --2- 172.21.15.78:0/2206288122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d413aa20 0x7f06d4069540 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f06cc009e60 tx=0x7f06cc009780).stop 2023-08-17T17:53:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.756+0000 7f06dacbd700 1 -- 172.21.15.78:0/2206288122 shutdown_connections 2023-08-17T17:53:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.756+0000 7f06dacbd700 1 --2- 172.21.15.78:0/2206288122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d413aa20 0x7f06d4069540 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.756+0000 7f06dacbd700 1 --2- 172.21.15.78:0/2206288122 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d406a2c0 0x7f06d4069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.756+0000 7f06dacbd700 1 -- 172.21.15.78:0/2206288122 >> 172.21.15.78:0/2206288122 conn(0x7f06d40c7b00 msgr2=0x7f06d40c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.756+0000 7f06dacbd700 1 -- 172.21.15.78:0/2206288122 shutdown_connections 2023-08-17T17:53:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.756+0000 7f06dacbd700 1 -- 172.21.15.78:0/2206288122 wait complete. 2023-08-17T17:53:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.757+0000 7f06dacbd700 1 Processor -- start 2023-08-17T17:53:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.757+0000 7f06dacbd700 1 -- start start 2023-08-17T17:53:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06dacbd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06d406a2c0 0x7f06d4137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06dacbd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d413a640 0x7f06d40ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06dacbd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d413aa20 0x7f06d40bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06dacbd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40c36c0 con 0x7f06d406a2c0 2023-08-17T17:53:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06dacbd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4137d10 con 0x7f06d413a640 2023-08-17T17:53:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06dacbd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40bfcc0 con 0x7f06d413aa20 2023-08-17T17:53:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d8a59700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06d406a2c0 0x7f06d4137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d8a59700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06d406a2c0 0x7f06d4137820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59162/0 (socket says 172.21.15.78:59162) 2023-08-17T17:53:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d8a59700 1 -- 172.21.15.78:0/1600418305 learned_addr learned my addr 172.21.15.78:0/1600418305 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d925a700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d413aa20 0x7f06d40bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d3fff700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d413a640 0x7f06d40ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d8a59700 1 -- 172.21.15.78:0/1600418305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d413aa20 msgr2=0x7f06d40bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d8a59700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d413aa20 0x7f06d40bedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d8a59700 1 -- 172.21.15.78:0/1600418305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d413a640 msgr2=0x7f06d40ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d8a59700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d413a640 0x7f06d40ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d8a59700 1 -- 172.21.15.78:0/1600418305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c00092a0 con 0x7f06d406a2c0 2023-08-17T17:53:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.758+0000 7f06d8a59700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06d406a2c0 0x7f06d4137820 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f06c800c590 tx=0x7f06c8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.759+0000 7f06d0ff9700 1 -- 172.21.15.78:0/1600418305 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c80072e0 con 0x7f06d406a2c0 2023-08-17T17:53:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.759+0000 7f06d0ff9700 1 -- 172.21.15.78:0/1600418305 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c8007440 con 0x7f06d406a2c0 2023-08-17T17:53:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.759+0000 7f06dacbd700 1 -- 172.21.15.78:0/1600418305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc009a20 con 0x7f06d406a2c0 2023-08-17T17:53:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.759+0000 7f06d0ff9700 1 -- 172.21.15.78:0/1600418305 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c80057a0 con 0x7f06d406a2c0 2023-08-17T17:53:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.759+0000 7f06dacbd700 1 -- 172.21.15.78:0/1600418305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d40c3350 con 0x7f06d406a2c0 2023-08-17T17:53:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.759+0000 7f06dacbd700 1 -- 172.21.15.78:0/1600418305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d4047350 con 0x7f06d406a2c0 2023-08-17T17:53:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.760+0000 7f06d0ff9700 1 -- 172.21.15.78:0/1600418305 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f06c801a060 con 0x7f06d406a2c0 2023-08-17T17:53:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.760+0000 7f06d0ff9700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06b805ede0 0x7f06b80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.760+0000 7f06d3fff700 1 -- 172.21.15.78:0/1600418305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06b805ede0 msgr2=0x7f06b80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.760+0000 7f06d0ff9700 1 -- 172.21.15.78:0/1600418305 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f06c8079010 con 0x7f06d406a2c0 2023-08-17T17:53:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.760+0000 7f06d3fff700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06b805ede0 0x7f06b80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.764+0000 7f06d0ff9700 1 -- 172.21.15.78:0/1600418305 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f06c804a430 con 0x7f06d406a2c0 2023-08-17T17:53:33.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.937+0000 7f06dacbd700 1 -- 172.21.15.78:0/1600418305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06d406a0a0 con 0x7f06d406a2c0 2023-08-17T17:53:33.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.938+0000 7f06d0ff9700 1 -- 172.21.15.78:0/1600418305 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+17235 (secure 0 0 0) 0x7f06c8018070 con 0x7f06d406a2c0 2023-08-17T17:53:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:33.940 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":136,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:29.991169+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:17.233530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:17.675099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1968964526":"2023-08-18T17:53:29.991127+0000","172.21.15.78:6833/119464":"2023-08-18T17:53:29.991127+0000","172.21.15.78:6832/119464":"2023-08-18T17:53:29.991127+0000","172.21.15.78:0/569216571":"2023-08-18T17:53:29.991127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:33.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 -- 172.21.15.78:0/1600418305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06b805ede0 msgr2=0x7f06b80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:33.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06b805ede0 0x7f06b80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:33.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 -- 172.21.15.78:0/1600418305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06d406a2c0 msgr2=0x7f06d4137820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:33.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06d406a2c0 0x7f06d4137820 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f06c800c590 tx=0x7f06c8007c80).stop 2023-08-17T17:53:33.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 -- 172.21.15.78:0/1600418305 shutdown_connections 2023-08-17T17:53:33.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f06b805ede0 0x7f06b80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:33.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d413aa20 0x7f06d40bedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06d406a2c0 0x7f06d4137820 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 --2- 172.21.15.78:0/1600418305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d413a640 0x7f06d40ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:33.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 -- 172.21.15.78:0/1600418305 >> 172.21.15.78:0/1600418305 conn(0x7f06d40c7b00 msgr2=0x7f06d40bd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:33.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 -- 172.21.15.78:0/1600418305 shutdown_connections 2023-08-17T17:53:33.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:33.940+0000 7f06dacbd700 1 -- 172.21.15.78:0/1600418305 wait complete. 2023-08-17T17:53:33.955 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:53:17.233530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:53:17.675099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T17:53:33.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:53:34.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.074+0000 7fe60ff74700 1 Processor -- start 2023-08-17T17:53:34.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.075+0000 7fe60ff74700 1 -- start start 2023-08-17T17:53:34.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.075+0000 7fe60ff74700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe6080624f0 0x7fe6080bddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.075+0000 7fe60ff74700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe6080bc260 0x7fe6080bc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.075+0000 7fe60ff74700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6080bd930 con 0x7fe6080628d0 2023-08-17T17:53:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.075+0000 7fe60ff74700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe608150950 con 0x7fe6080bc260 2023-08-17T17:53:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.075+0000 7fe60ff74700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6080bcd20 con 0x7fe6080624f0 2023-08-17T17:53:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60d50f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe6080bc260 0x7fe6080bc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60e511700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe6080628d0 0x7fe608062d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38926/0 (socket says 172.21.15.78:38926) 2023-08-17T17:53:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60e511700 1 -- 172.21.15.78:0/3570082539 learned_addr learned my addr 172.21.15.78:0/3570082539 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60dd10700 1 --2- 172.21.15.78:0/3570082539 >> v2:172.21.15.150:3300/0 conn(0x7fe6080624f0 0x7fe6080bddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60d50f700 1 -- 172.21.15.78:0/3570082539 >> v2:172.21.15.150:3300/0 conn(0x7fe6080624f0 msgr2=0x7fe6080bddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60d50f700 1 --2- 172.21.15.78:0/3570082539 >> v2:172.21.15.150:3300/0 conn(0x7fe6080624f0 0x7fe6080bddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60d50f700 1 -- 172.21.15.78:0/3570082539 >> v1:172.21.15.78:6789/0 conn(0x7fe6080628d0 legacy=0x7fe608062d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60d50f700 1 -- 172.21.15.78:0/3570082539 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080bd000 con 0x7fe6080bc260 2023-08-17T17:53:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60cd0e700 1 -- 172.21.15.78:0/3570082539 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224072446 0 0) 0x7fe6080bd930 con 0x7fe6080628d0 2023-08-17T17:53:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60d50f700 1 --2- 172.21.15.78:0/3570082539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080bc260 0x7fe6080bc6e0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fe6080c4ac0 tx=0x7fe604009060).ready entity=mon.0 client_cookie=8252b5c37eede63c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60cd0e700 1 -- 172.21.15.78:0/3570082539 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60400f510 con 0x7fe6080bc260 2023-08-17T17:53:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60cd0e700 1 -- 172.21.15.78:0/3570082539 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60400f670 con 0x7fe6080bc260 2023-08-17T17:53:34.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.076+0000 7fe60cd0e700 1 -- 172.21.15.78:0/3570082539 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60400f9f0 con 0x7fe6080bc260 2023-08-17T17:53:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.077+0000 7fe60ff74700 1 -- 172.21.15.78:0/3570082539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080bc260 msgr2=0x7fe6080bc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.077+0000 7fe60ff74700 1 --2- 172.21.15.78:0/3570082539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080bc260 0x7fe6080bc6e0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fe6080c4ac0 tx=0x7fe604009060).stop 2023-08-17T17:53:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.077+0000 7fe60ff74700 1 -- 172.21.15.78:0/3570082539 shutdown_connections 2023-08-17T17:53:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.077+0000 7fe60ff74700 1 --2- 172.21.15.78:0/3570082539 >> v2:172.21.15.150:3300/0 conn(0x7fe6080624f0 0x7fe6080bddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.077+0000 7fe60ff74700 1 --2- 172.21.15.78:0/3570082539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080bc260 0x7fe6080bc6e0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.077+0000 7fe60ff74700 1 -- 172.21.15.78:0/3570082539 >> 172.21.15.78:0/3570082539 conn(0x7fe6080c3da0 msgr2=0x7fe6080c41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.077+0000 7fe60ff74700 1 -- 172.21.15.78:0/3570082539 shutdown_connections 2023-08-17T17:53:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.077+0000 7fe60ff74700 1 -- 172.21.15.78:0/3570082539 wait complete. 2023-08-17T17:53:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.078+0000 7fe60ff74700 1 Processor -- start 2023-08-17T17:53:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.078+0000 7fe60ff74700 1 -- start start 2023-08-17T17:53:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60ff74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080624f0 0x7fe6080aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60ff74700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6080628d0 0x7fe60814f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60ff74700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6080bc260 0x7fe608143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60ff74700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080ab270 con 0x7fe6080624f0 2023-08-17T17:53:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60ff74700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080ab6f0 con 0x7fe6080628d0 2023-08-17T17:53:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60ff74700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080abcb0 con 0x7fe6080bc260 2023-08-17T17:53:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60dd10700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080624f0 0x7fe6080aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60dd10700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080624f0 0x7fe6080aad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59180/0 (socket says 172.21.15.78:59180) 2023-08-17T17:53:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60dd10700 1 -- 172.21.15.78:0/1883646622 learned_addr learned my addr 172.21.15.78:0/1883646622 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60d50f700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6080628d0 0x7fe60814f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60e511700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6080bc260 0x7fe608143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60dd10700 1 -- 172.21.15.78:0/1883646622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6080bc260 msgr2=0x7fe608143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60dd10700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6080bc260 0x7fe608143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60dd10700 1 -- 172.21.15.78:0/1883646622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6080628d0 msgr2=0x7fe60814f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60dd10700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6080628d0 0x7fe60814f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60dd10700 1 -- 172.21.15.78:0/1883646622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6040092a0 con 0x7fe6080624f0 2023-08-17T17:53:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe60dd10700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080624f0 0x7fe6080aad80 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7fe5f800e950 tx=0x7fe5f8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe5fdffb700 1 -- 172.21.15.78:0/1883646622 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8009530 con 0x7fe6080624f0 2023-08-17T17:53:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.079+0000 7fe5fdffb700 1 -- 172.21.15.78:0/1883646622 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8012600 con 0x7fe6080624f0 2023-08-17T17:53:34.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.080+0000 7fe60ff74700 1 -- 172.21.15.78:0/1883646622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60814fb30 con 0x7fe6080624f0 2023-08-17T17:53:34.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.080+0000 7fe5fdffb700 1 -- 172.21.15.78:0/1883646622 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8012980 con 0x7fe6080624f0 2023-08-17T17:53:34.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.080+0000 7fe60ff74700 1 -- 172.21.15.78:0/1883646622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe608150090 con 0x7fe6080624f0 2023-08-17T17:53:34.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.081+0000 7fe60ff74700 1 -- 172.21.15.78:0/1883646622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe608067bb0 con 0x7fe6080624f0 2023-08-17T17:53:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.081+0000 7fe5fdffb700 1 -- 172.21.15.78:0/1883646622 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fe5f8022070 con 0x7fe6080624f0 2023-08-17T17:53:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.081+0000 7fe5fdffb700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5ec05ede0 0x7fe5ec0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.081+0000 7fe60d50f700 1 -- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5ec05ede0 msgr2=0x7fe5ec0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.081+0000 7fe5fdffb700 1 -- 172.21.15.78:0/1883646622 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fe5f807a0c0 con 0x7fe6080624f0 2023-08-17T17:53:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.081+0000 7fe60d50f700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5ec05ede0 0x7fe5ec0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.085+0000 7fe5fdffb700 1 -- 172.21.15.78:0/1883646622 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe5f804b4e0 con 0x7fe6080624f0 2023-08-17T17:53:34.123 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:34.123+0000 7f5abc9fe680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:53:34.165 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:34.159+0000 7f57cbdff680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:53:34.195 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:34.195+0000 7f5abc9fe680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:53:34.233 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:34.232+0000 7f57cbdff680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:53:34.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.282+0000 7fe60d50f700 1 -- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5ec05ede0 msgr2=0x7fe5ec0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:34.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.282+0000 7fe60d50f700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5ec05ede0 0x7fe5ec0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:34.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.288+0000 7fe60ff74700 1 -- 172.21.15.78:0/1883646622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe6080bd2e0 con 0x7fe6080624f0 2023-08-17T17:53:34.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.289+0000 7fe5fdffb700 1 -- 172.21.15.78:0/1883646622 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v136) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe5f804eb00 con 0x7fe6080624f0 2023-08-17T17:53:34.290 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:53:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 -- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5ec05ede0 msgr2=0x7fe5ec0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5ec05ede0 0x7fe5ec0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 -- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080624f0 msgr2=0x7fe6080aad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080624f0 0x7fe6080aad80 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7fe5f800e950 tx=0x7fe5f8009060).stop 2023-08-17T17:53:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 -- 172.21.15.78:0/1883646622 shutdown_connections 2023-08-17T17:53:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe5ec05ede0 0x7fe5ec0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6080bc260 0x7fe608143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6080624f0 0x7fe6080aad80 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 --2- 172.21.15.78:0/1883646622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6080628d0 0x7fe60814f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 -- 172.21.15.78:0/1883646622 >> 172.21.15.78:0/1883646622 conn(0x7fe6080c3da0 msgr2=0x7fe608063500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 -- 172.21.15.78:0/1883646622 shutdown_connections 2023-08-17T17:53:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.291+0000 7fe60ff74700 1 -- 172.21.15.78:0/1883646622 wait complete. 2023-08-17T17:53:34.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:53:34.387 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:34.386+0000 7f5abc9fe680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:53:34.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.426+0000 7faf83b27700 1 Processor -- start 2023-08-17T17:53:34.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.426+0000 7faf83b27700 1 -- start start 2023-08-17T17:53:34.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.427+0000 7faf83b27700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faf7c14f9d0 0x7faf7c152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.427+0000 7faf83b27700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c0bc610 con 0x7faf7c065100 2023-08-17T17:53:34.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.427+0000 7faf83b27700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c0bc310 con 0x7faf7c06b280 2023-08-17T17:53:34.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.427+0000 7faf83b27700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c066550 con 0x7faf7c14f9d0 2023-08-17T17:53:34.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.427+0000 7faf820c4700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7faf7c065100 0x7faf7c0624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38928/0 (socket says 172.21.15.78:38928) 2023-08-17T17:53:34.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.427+0000 7faf820c4700 1 -- 172.21.15.78:0/2258914505 learned_addr learned my addr 172.21.15.78:0/2258914505 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:34.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.427+0000 7faf818c3700 1 --2- 172.21.15.78:0/2258914505 >> v2:172.21.15.150:3300/0 conn(0x7faf7c14f9d0 0x7faf7c152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.427+0000 7faf808c1700 1 -- 172.21.15.78:0/2258914505 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932135354 0 0) 0x7faf7c0bc610 con 0x7faf7c065100 2023-08-17T17:53:34.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.427+0000 7faf808c1700 1 -- 172.21.15.78:0/2258914505 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf680033f0 con 0x7faf7c065100 2023-08-17T17:53:34.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf818c3700 1 -- 172.21.15.78:0/2258914505 >> v1:172.21.15.150:6789/0 conn(0x7faf7c06b280 legacy=0x7faf7c0649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf818c3700 1 -- 172.21.15.78:0/2258914505 >> v1:172.21.15.78:6789/0 conn(0x7faf7c065100 legacy=0x7faf7c0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf818c3700 1 -- 172.21.15.78:0/2258914505 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c0be1c0 con 0x7faf7c14f9d0 2023-08-17T17:53:34.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf818c3700 1 --2- 172.21.15.78:0/2258914505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf7c14f9d0 0x7faf7c152ee0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7faf6c006fd0 tx=0x7faf6c006f40).ready entity=mon.1 client_cookie=33c2fea83eae8e9a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:34.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf808c1700 1 -- 172.21.15.78:0/2258914505 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c005880 con 0x7faf7c14f9d0 2023-08-17T17:53:34.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf808c1700 1 -- 172.21.15.78:0/2258914505 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c0059e0 con 0x7faf7c14f9d0 2023-08-17T17:53:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf808c1700 1 -- 172.21.15.78:0/2258914505 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c005d60 con 0x7faf7c14f9d0 2023-08-17T17:53:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf83b27700 1 -- 172.21.15.78:0/2258914505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf7c14f9d0 msgr2=0x7faf7c152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf83b27700 1 --2- 172.21.15.78:0/2258914505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf7c14f9d0 0x7faf7c152ee0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7faf6c006fd0 tx=0x7faf6c006f40).stop 2023-08-17T17:53:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf83b27700 1 -- 172.21.15.78:0/2258914505 shutdown_connections 2023-08-17T17:53:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf83b27700 1 --2- 172.21.15.78:0/2258914505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf7c14f9d0 0x7faf7c152ee0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.428+0000 7faf83b27700 1 -- 172.21.15.78:0/2258914505 >> 172.21.15.78:0/2258914505 conn(0x7faf7c0c3db0 msgr2=0x7faf7c0c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.429+0000 7faf83b27700 1 -- 172.21.15.78:0/2258914505 shutdown_connections 2023-08-17T17:53:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.429+0000 7faf83b27700 1 -- 172.21.15.78:0/2258914505 wait complete. 2023-08-17T17:53:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.430+0000 7faf83b27700 1 Processor -- start 2023-08-17T17:53:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.430+0000 7faf83b27700 1 -- start start 2023-08-17T17:53:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.430+0000 7faf83b27700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf7c065100 0x7faf7c14bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.430+0000 7faf83b27700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf7c06b280 0x7faf7c0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.430+0000 7faf83b27700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c14f9d0 0x7faf7c151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.430+0000 7faf83b27700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c14c440 con 0x7faf7c14f9d0 2023-08-17T17:53:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.430+0000 7faf83b27700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c1456e0 con 0x7faf7c065100 2023-08-17T17:53:34.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.430+0000 7faf83b27700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0bed70 con 0x7faf7c06b280 2023-08-17T17:53:34.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.430+0000 7faf820c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c14f9d0 0x7faf7c151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf820c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c14f9d0 0x7faf7c151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59192/0 (socket says 172.21.15.78:59192) 2023-08-17T17:53:34.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf820c4700 1 -- 172.21.15.78:0/3925443487 learned_addr learned my addr 172.21.15.78:0/3925443487 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:34.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf810c2700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf7c06b280 0x7faf7c0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf818c3700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf7c065100 0x7faf7c14bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf820c4700 1 -- 172.21.15.78:0/3925443487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf7c06b280 msgr2=0x7faf7c0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf820c4700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf7c06b280 0x7faf7c0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf820c4700 1 -- 172.21.15.78:0/3925443487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf7c065100 msgr2=0x7faf7c14bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf820c4700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf7c065100 0x7faf7c14bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf820c4700 1 -- 172.21.15.78:0/3925443487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c009250 con 0x7faf7c14f9d0 2023-08-17T17:53:34.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf820c4700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c14f9d0 0x7faf7c151000 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7faf7400c790 tx=0x7faf74007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:34.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf71ffb700 1 -- 172.21.15.78:0/3925443487 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74005d30 con 0x7faf7c14f9d0 2023-08-17T17:53:34.437 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:34.431+0000 7f57cbdff680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:53:34.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf71ffb700 1 -- 172.21.15.78:0/3925443487 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74005e90 con 0x7faf7c14f9d0 2023-08-17T17:53:34.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf83b27700 1 -- 172.21.15.78:0/3925443487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c0be4b0 con 0x7faf7c14f9d0 2023-08-17T17:53:34.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf71ffb700 1 -- 172.21.15.78:0/3925443487 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74007320 con 0x7faf7c14f9d0 2023-08-17T17:53:34.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.431+0000 7faf83b27700 1 -- 172.21.15.78:0/3925443487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c0bea80 con 0x7faf7c14f9d0 2023-08-17T17:53:34.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.432+0000 7faf83b27700 1 -- 172.21.15.78:0/3925443487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c0ac850 con 0x7faf7c14f9d0 2023-08-17T17:53:34.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.433+0000 7faf71ffb700 1 -- 172.21.15.78:0/3925443487 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7faf74010030 con 0x7faf7c14f9d0 2023-08-17T17:53:34.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.433+0000 7faf71ffb700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faf6005ede0 0x7faf600612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.433+0000 7faf818c3700 1 -- 172.21.15.78:0/3925443487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faf6005ede0 msgr2=0x7faf600612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:34.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.433+0000 7faf71ffb700 1 -- 172.21.15.78:0/3925443487 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7faf7407a120 con 0x7faf7c14f9d0 2023-08-17T17:53:34.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.433+0000 7faf818c3700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faf6005ede0 0x7faf600612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:34.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.437+0000 7faf71ffb700 1 -- 172.21.15.78:0/3925443487 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf7404b5c0 con 0x7faf7c14f9d0 2023-08-17T17:53:34.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.606+0000 7faf83b27700 1 -- 172.21.15.78:0/3925443487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf7c0beeb0 con 0x7faf7c14f9d0 2023-08-17T17:53:34.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.607+0000 7faf71ffb700 1 -- 172.21.15.78:0/3925443487 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v136) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf7404ebe0 con 0x7faf7c14f9d0 2023-08-17T17:53:34.608 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:53:34.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 -- 172.21.15.78:0/3925443487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faf6005ede0 msgr2=0x7faf600612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:34.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faf6005ede0 0x7faf600612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:34.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 -- 172.21.15.78:0/3925443487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c14f9d0 msgr2=0x7faf7c151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c14f9d0 0x7faf7c151000 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7faf7400c790 tx=0x7faf74007f90).stop 2023-08-17T17:53:34.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 -- 172.21.15.78:0/3925443487 shutdown_connections 2023-08-17T17:53:34.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7faf6005ede0 0x7faf600612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:34.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c14f9d0 0x7faf7c151000 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf7c065100 0x7faf7c14bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 --2- 172.21.15.78:0/3925443487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf7c06b280 0x7faf7c0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 -- 172.21.15.78:0/3925443487 >> 172.21.15.78:0/3925443487 conn(0x7faf7c0c3db0 msgr2=0x7faf7c0c5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:34.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 -- 172.21.15.78:0/3925443487 shutdown_connections 2023-08-17T17:53:34.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.609+0000 7faf83b27700 1 -- 172.21.15.78:0/3925443487 wait complete. 2023-08-17T17:53:34.623 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T17:53:34.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.744+0000 7fe29cd4c700 1 Processor -- start 2023-08-17T17:53:34.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.744+0000 7fe29cd4c700 1 -- start start 2023-08-17T17:53:34.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe29cd4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2981578f0 0x7fe2980be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe29cd4c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe2980bf0e0 0x7fe298095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe29cd4c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe298096300 0x7fe298064330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe29cd4c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2980bf5c0 con 0x7fe298096300 2023-08-17T17:53:34.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe29cd4c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2980c32d0 con 0x7fe2980bf0e0 2023-08-17T17:53:34.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe29cd4c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980c3e10 con 0x7fe2981578f0 2023-08-17T17:53:34.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe296d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe298096300 0x7fe298064330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe296d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe298096300 0x7fe298064330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59202/0 (socket says 172.21.15.78:59202) 2023-08-17T17:53:34.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe296d9d700 1 -- 172.21.15.78:0/458564330 learned_addr learned my addr 172.21.15.78:0/458564330 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:34.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe295d9b700 1 --2- 172.21.15.78:0/458564330 >> v2:172.21.15.150:3300/0 conn(0x7fe2980bf0e0 0x7fe298095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe29659c700 1 --2- 172.21.15.78:0/458564330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2981578f0 0x7fe2980be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe296d9d700 1 -- 172.21.15.78:0/458564330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2981578f0 msgr2=0x7fe2980be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe296d9d700 1 --2- 172.21.15.78:0/458564330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2981578f0 0x7fe2980be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe296d9d700 1 -- 172.21.15.78:0/458564330 >> v2:172.21.15.150:3300/0 conn(0x7fe2980bf0e0 msgr2=0x7fe298095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe296d9d700 1 --2- 172.21.15.78:0/458564330 >> v2:172.21.15.150:3300/0 conn(0x7fe2980bf0e0 0x7fe298095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe296d9d700 1 -- 172.21.15.78:0/458564330 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe298096750 con 0x7fe298096300 2023-08-17T17:53:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe295d9b700 1 --2- 172.21.15.78:0/458564330 >> v2:172.21.15.150:3300/0 conn(0x7fe2980bf0e0 0x7fe298095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe296d9d700 1 --2- 172.21.15.78:0/458564330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 0x7fe298064330 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7fe29805ff20 tx=0x7fe290009840).ready entity=mon.0 client_cookie=73d168c6a3279bec server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe29559a700 1 -- 172.21.15.78:0/458564330 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29000e070 con 0x7fe298096300 2023-08-17T17:53:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe29559a700 1 -- 172.21.15.78:0/458564330 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29000ba50 con 0x7fe298096300 2023-08-17T17:53:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.745+0000 7fe29559a700 1 -- 172.21.15.78:0/458564330 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29000bdd0 con 0x7fe298096300 2023-08-17T17:53:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.746+0000 7fe29cd4c700 1 -- 172.21.15.78:0/458564330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 msgr2=0x7fe298064330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.746+0000 7fe29cd4c700 1 --2- 172.21.15.78:0/458564330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 0x7fe298064330 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7fe29805ff20 tx=0x7fe290009840).stop 2023-08-17T17:53:34.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.746+0000 7fe29cd4c700 1 -- 172.21.15.78:0/458564330 shutdown_connections 2023-08-17T17:53:34.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.746+0000 7fe29cd4c700 1 --2- 172.21.15.78:0/458564330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 0x7fe298064330 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.746+0000 7fe29cd4c700 1 --2- 172.21.15.78:0/458564330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2981578f0 0x7fe2980be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.746+0000 7fe29cd4c700 1 --2- 172.21.15.78:0/458564330 >> v2:172.21.15.150:3300/0 conn(0x7fe2980bf0e0 0x7fe298095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.746+0000 7fe29cd4c700 1 -- 172.21.15.78:0/458564330 >> 172.21.15.78:0/458564330 conn(0x7fe298062f80 msgr2=0x7fe2980c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:34.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.746+0000 7fe29cd4c700 1 -- 172.21.15.78:0/458564330 shutdown_connections 2023-08-17T17:53:34.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.746+0000 7fe29cd4c700 1 -- 172.21.15.78:0/458564330 wait complete. 2023-08-17T17:53:34.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.747+0000 7fe29cd4c700 1 Processor -- start 2023-08-17T17:53:34.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.747+0000 7fe29cd4c700 1 -- start start 2023-08-17T17:53:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29cd4c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 0x7fe2980a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29cd4c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2980bf0e0 0x7fe29814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29cd4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2981578f0 0x7fe2980ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29cd4c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29814fcf0 con 0x7fe298096300 2023-08-17T17:53:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29cd4c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29814f830 con 0x7fe2980bf0e0 2023-08-17T17:53:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29cd4c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980a5e00 con 0x7fe2981578f0 2023-08-17T17:53:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 0x7fe2980a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 0x7fe2980a6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59208/0 (socket says 172.21.15.78:59208) 2023-08-17T17:53:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29659c700 1 -- 172.21.15.78:0/1108856709 learned_addr learned my addr 172.21.15.78:0/1108856709 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe296d9d700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2981578f0 0x7fe2980ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe295d9b700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2980bf0e0 0x7fe29814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29659c700 1 -- 172.21.15.78:0/1108856709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2981578f0 msgr2=0x7fe2980ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29659c700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2981578f0 0x7fe2980ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29659c700 1 -- 172.21.15.78:0/1108856709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2980bf0e0 msgr2=0x7fe29814f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.748+0000 7fe29659c700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2980bf0e0 0x7fe29814f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.749+0000 7fe29659c700 1 -- 172.21.15.78:0/1108856709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290009ae0 con 0x7fe298096300 2023-08-17T17:53:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.749+0000 7fe29659c700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 0x7fe2980a6ea0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7fe28800d890 tx=0x7fe288008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.749+0000 7fe2867fc700 1 -- 172.21.15.78:0/1108856709 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288011590 con 0x7fe298096300 2023-08-17T17:53:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.749+0000 7fe2867fc700 1 -- 172.21.15.78:0/1108856709 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2880116f0 con 0x7fe298096300 2023-08-17T17:53:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.749+0000 7fe29cd4c700 1 -- 172.21.15.78:0/1108856709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2980a60e0 con 0x7fe298096300 2023-08-17T17:53:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.749+0000 7fe2867fc700 1 -- 172.21.15.78:0/1108856709 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288011a70 con 0x7fe298096300 2023-08-17T17:53:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.749+0000 7fe29cd4c700 1 -- 172.21.15.78:0/1108856709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2980a66a0 con 0x7fe298096300 2023-08-17T17:53:34.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.750+0000 7fe29cd4c700 1 -- 172.21.15.78:0/1108856709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2980a73e0 con 0x7fe298096300 2023-08-17T17:53:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.750+0000 7fe2867fc700 1 -- 172.21.15.78:0/1108856709 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fe288012420 con 0x7fe298096300 2023-08-17T17:53:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.750+0000 7fe2867fc700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe27805ede0 0x7fe2780612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.751+0000 7fe295d9b700 1 -- 172.21.15.78:0/1108856709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe27805ede0 msgr2=0x7fe2780612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.751+0000 7fe2867fc700 1 -- 172.21.15.78:0/1108856709 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fe288079780 con 0x7fe298096300 2023-08-17T17:53:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.751+0000 7fe295d9b700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe27805ede0 0x7fe2780612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:34.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.754+0000 7fe2867fc700 1 -- 172.21.15.78:0/1108856709 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe28804ab40 con 0x7fe298096300 2023-08-17T17:53:34.813 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:34.812+0000 7f5abc9fe680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:53:34.876 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:34.875+0000 7f57cbdff680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:53:34.917 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:34.916+0000 7f5abc9fe680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:34.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.925+0000 7fe29cd4c700 1 -- 172.21.15.78:0/1108856709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2980a6cf0 con 0x7fe298096300 2023-08-17T17:53:34.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.925+0000 7fe2867fc700 1 -- 172.21.15.78:0/1108856709 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v136) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe288011e60 con 0x7fe298096300 2023-08-17T17:53:34.926 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:53:34.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 -- 172.21.15.78:0/1108856709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe27805ede0 msgr2=0x7fe2780612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:34.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe27805ede0 0x7fe2780612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:34.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 -- 172.21.15.78:0/1108856709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 msgr2=0x7fe2980a6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:34.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 0x7fe2980a6ea0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7fe28800d890 tx=0x7fe288008040).stop 2023-08-17T17:53:34.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 -- 172.21.15.78:0/1108856709 shutdown_connections 2023-08-17T17:53:34.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe27805ede0 0x7fe2780612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:34.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2981578f0 0x7fe2980ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe298096300 0x7fe2980a6ea0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 --2- 172.21.15.78:0/1108856709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2980bf0e0 0x7fe29814f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:34.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 -- 172.21.15.78:0/1108856709 >> 172.21.15.78:0/1108856709 conn(0x7fe298062f80 msgr2=0x7fe298066c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:34.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 -- 172.21.15.78:0/1108856709 shutdown_connections 2023-08-17T17:53:34.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:34.927+0000 7fe29cd4c700 1 -- 172.21.15.78:0/1108856709 wait complete. 2023-08-17T17:53:34.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T17:53:34.986 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:34.985+0000 7f57cbdff680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.060+0000 7f0a6f195700 1 Processor -- start 2023-08-17T17:53:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.060+0000 7f0a6f195700 1 -- start start 2023-08-17T17:53:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a6f195700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a680aa0f0 0x7f0a680644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a6f195700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a680aa4d0 0x7f0a680c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a6f195700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a680c5810 0x7f0a680c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a6f195700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a680649b0 con 0x7f0a680c5810 2023-08-17T17:53:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a6f195700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a680c6120 con 0x7f0a680aa0f0 2023-08-17T17:53:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a6f195700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68063420 con 0x7f0a680aa4d0 2023-08-17T17:53:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a6d732700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a680c5810 0x7f0a680c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a6d732700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a680c5810 0x7f0a680c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59222/0 (socket says 172.21.15.78:59222) 2023-08-17T17:53:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a6d732700 1 -- 172.21.15.78:0/4196985903 learned_addr learned my addr 172.21.15.78:0/4196985903 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:35.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a67fff700 1 --2- 172.21.15.78:0/4196985903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a680aa4d0 0x7f0a680c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.061+0000 7f0a6cf31700 1 --2- 172.21.15.78:0/4196985903 >> v2:172.21.15.150:3300/0 conn(0x7f0a680aa0f0 0x7f0a680644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.062+0000 7f0a6d732700 1 -- 172.21.15.78:0/4196985903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a680aa4d0 msgr2=0x7f0a680c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:35.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.062+0000 7f0a6d732700 1 --2- 172.21.15.78:0/4196985903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a680aa4d0 0x7f0a680c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.062+0000 7f0a6d732700 1 -- 172.21.15.78:0/4196985903 >> v2:172.21.15.150:3300/0 conn(0x7f0a680aa0f0 msgr2=0x7f0a680644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:35.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.062+0000 7f0a6d732700 1 --2- 172.21.15.78:0/4196985903 >> v2:172.21.15.150:3300/0 conn(0x7f0a680aa0f0 0x7f0a680644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.062+0000 7f0a6d732700 1 -- 172.21.15.78:0/4196985903 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a68063700 con 0x7f0a680c5810 2023-08-17T17:53:35.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.062+0000 7f0a6d732700 1 --2- 172.21.15.78:0/4196985903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680c5810 0x7f0a680c5c30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f0a680cade0 tx=0x7f0a60009840).ready entity=mon.0 client_cookie=7cb6c1be91fa8662 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:35.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.062+0000 7f0a677fe700 1 -- 172.21.15.78:0/4196985903 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000e070 con 0x7f0a680c5810 2023-08-17T17:53:35.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.062+0000 7f0a677fe700 1 -- 172.21.15.78:0/4196985903 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6000b970 con 0x7f0a680c5810 2023-08-17T17:53:35.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.062+0000 7f0a677fe700 1 -- 172.21.15.78:0/4196985903 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000bcf0 con 0x7f0a680c5810 2023-08-17T17:53:35.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.063+0000 7f0a6f195700 1 -- 172.21.15.78:0/4196985903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680c5810 msgr2=0x7f0a680c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.063+0000 7f0a6f195700 1 --2- 172.21.15.78:0/4196985903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680c5810 0x7f0a680c5c30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f0a680cade0 tx=0x7f0a60009840).stop 2023-08-17T17:53:35.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.063+0000 7f0a6f195700 1 -- 172.21.15.78:0/4196985903 shutdown_connections 2023-08-17T17:53:35.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.063+0000 7f0a6f195700 1 --2- 172.21.15.78:0/4196985903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680c5810 0x7f0a680c5c30 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.063+0000 7f0a6f195700 1 --2- 172.21.15.78:0/4196985903 >> v2:172.21.15.150:3300/0 conn(0x7f0a680aa0f0 0x7f0a680644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.063+0000 7f0a6f195700 1 --2- 172.21.15.78:0/4196985903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a680aa4d0 0x7f0a680c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.063+0000 7f0a6f195700 1 -- 172.21.15.78:0/4196985903 >> 172.21.15.78:0/4196985903 conn(0x7f0a6806a6a0 msgr2=0x7f0a680caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:35.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.063+0000 7f0a6f195700 1 -- 172.21.15.78:0/4196985903 shutdown_connections 2023-08-17T17:53:35.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.063+0000 7f0a6f195700 1 -- 172.21.15.78:0/4196985903 wait complete. 2023-08-17T17:53:35.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.064+0000 7f0a6f195700 1 Processor -- start 2023-08-17T17:53:35.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.064+0000 7f0a6f195700 1 -- start start 2023-08-17T17:53:35.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6f195700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680aa0f0 0x7f0a68167530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6f195700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a680aa4d0 0x7f0a680c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6f195700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a680c5810 0x7f0a68152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6f195700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680afcc0 con 0x7f0a680aa0f0 2023-08-17T17:53:35.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6f195700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680c33a0 con 0x7f0a680aa4d0 2023-08-17T17:53:35.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6f195700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680abe50 con 0x7f0a680c5810 2023-08-17T17:53:35.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6cf31700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680aa0f0 0x7f0a68167530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6cf31700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680aa0f0 0x7f0a68167530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59234/0 (socket says 172.21.15.78:59234) 2023-08-17T17:53:35.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6cf31700 1 -- 172.21.15.78:0/418953061 learned_addr learned my addr 172.21.15.78:0/418953061 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:35.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6d732700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a680c5810 0x7f0a68152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a67fff700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a680aa4d0 0x7f0a680c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6cf31700 1 -- 172.21.15.78:0/418953061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a680c5810 msgr2=0x7f0a68152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6cf31700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a680c5810 0x7f0a68152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6cf31700 1 -- 172.21.15.78:0/418953061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a680aa4d0 msgr2=0x7f0a680c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6cf31700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a680aa4d0 0x7f0a680c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6cf31700 1 -- 172.21.15.78:0/418953061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a60009ae0 con 0x7f0a680aa0f0 2023-08-17T17:53:35.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.065+0000 7f0a6cf31700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680aa0f0 0x7f0a68167530 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f0a5c00e900 tx=0x7f0a5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:35.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.066+0000 7f0a64ff9700 1 -- 172.21.15.78:0/418953061 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c012600 con 0x7f0a680aa0f0 2023-08-17T17:53:35.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.066+0000 7f0a64ff9700 1 -- 172.21.15.78:0/418953061 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c012760 con 0x7f0a680aa0f0 2023-08-17T17:53:35.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.066+0000 7f0a6f195700 1 -- 172.21.15.78:0/418953061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a68167b10 con 0x7f0a680aa0f0 2023-08-17T17:53:35.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.066+0000 7f0a64ff9700 1 -- 172.21.15.78:0/418953061 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c012ae0 con 0x7f0a680aa0f0 2023-08-17T17:53:35.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.066+0000 7f0a6f195700 1 -- 172.21.15.78:0/418953061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a68167ea0 con 0x7f0a680aa0f0 2023-08-17T17:53:35.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.067+0000 7f0a6f195700 1 -- 172.21.15.78:0/418953061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a68083980 con 0x7f0a680aa0f0 2023-08-17T17:53:35.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.067+0000 7f0a64ff9700 1 -- 172.21.15.78:0/418953061 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f0a5c022070 con 0x7f0a680aa0f0 2023-08-17T17:53:35.073 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:35.071+0000 7f5abc9fe680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:35.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.067+0000 7f0a64ff9700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0a4c05ede0 0x7f0a4c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.067+0000 7f0a67fff700 1 -- 172.21.15.78:0/418953061 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0a4c05ede0 msgr2=0x7f0a4c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:35.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.067+0000 7f0a64ff9700 1 -- 172.21.15.78:0/418953061 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f0a5c079e20 con 0x7f0a680aa0f0 2023-08-17T17:53:35.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.067+0000 7f0a67fff700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0a4c05ede0 0x7f0a4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:35.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.071+0000 7f0a64ff9700 1 -- 172.21.15.78:0/418953061 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0a5c04b240 con 0x7f0a680aa0f0 2023-08-17T17:53:35.148 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:35.147+0000 7f57cbdff680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:35.149 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:35.148+0000 7f5abc9fe680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:53:35.216 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:35.216+0000 7f5abc9fe680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:53:35.224 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:35.223+0000 7f57cbdff680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:53:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.241+0000 7f0a6f195700 1 -- 172.21.15.78:0/418953061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a68046af0 con 0x7f0a680aa0f0 2023-08-17T17:53:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.241+0000 7f0a64ff9700 1 -- 172.21.15.78:0/418953061 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v136) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a5c04e860 con 0x7f0a680aa0f0 2023-08-17T17:53:35.243 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T17:53:35.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 -- 172.21.15.78:0/418953061 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0a4c05ede0 msgr2=0x7f0a4c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:35.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0a4c05ede0 0x7f0a4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:35.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 -- 172.21.15.78:0/418953061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680aa0f0 msgr2=0x7f0a68167530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680aa0f0 0x7f0a68167530 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f0a5c00e900 tx=0x7f0a5c009060).stop 2023-08-17T17:53:35.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 -- 172.21.15.78:0/418953061 shutdown_connections 2023-08-17T17:53:35.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f0a4c05ede0 0x7f0a4c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:35.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a680c5810 0x7f0a68152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a680aa0f0 0x7f0a68167530 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 --2- 172.21.15.78:0/418953061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a680aa4d0 0x7f0a680c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 -- 172.21.15.78:0/418953061 >> 172.21.15.78:0/418953061 conn(0x7f0a6806a6a0 msgr2=0x7f0a680a91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:35.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 -- 172.21.15.78:0/418953061 shutdown_connections 2023-08-17T17:53:35.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.243+0000 7f0a6f195700 1 -- 172.21.15.78:0/418953061 wait complete. 2023-08-17T17:53:35.256 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:35.297 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:35.296+0000 7f57cbdff680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:53:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.371+0000 7fd7ce658700 1 Processor -- start 2023-08-17T17:53:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.371+0000 7fd7ce658700 1 -- start start 2023-08-17T17:53:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.372+0000 7fd7ce658700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c80bef00 0x7fd7c8064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7ce658700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd7c8065140 0x7fd7c80c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7ce658700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c80c4040 con 0x7fd7c80a7fe0 2023-08-17T17:53:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7ce658700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c80c7080 con 0x7fd7c8065140 2023-08-17T17:53:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7ce658700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c80655f0 con 0x7fd7c80bef00 2023-08-17T17:53:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd7c80a7fe0 0x7fd7c80be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38942/0 (socket says 172.21.15.78:38942) 2023-08-17T17:53:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c7fff700 1 -- 172.21.15.78:0/3065657239 learned_addr learned my addr 172.21.15.78:0/3065657239 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c77fe700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c80bef00 0x7fd7c8064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7ccbf5700 1 --2- 172.21.15.78:0/3065657239 >> v2:172.21.15.150:3300/0 conn(0x7fd7c8065140 0x7fd7c80c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448496890 0 0) 0x7fd7c80c4040 con 0x7fd7c80a7fe0 2023-08-17T17:53:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b00033f0 con 0x7fd7c80a7fe0 2023-08-17T17:53:35.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256053309 0 0) 0x7fd7b00033f0 con 0x7fd7c80a7fe0 2023-08-17T17:53:35.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c80bef00 msgr2=0x7fd7c8064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:35.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c80bef00 0x7fd7c8064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 >> v2:172.21.15.150:3300/0 conn(0x7fd7c8065140 msgr2=0x7fd7c80c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:35.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 --2- 172.21.15.78:0/3065657239 >> v2:172.21.15.150:3300/0 conn(0x7fd7c8065140 0x7fd7c80c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c80c3430 con 0x7fd7c80a7fe0 2023-08-17T17:53:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fd7bc001470 con 0x7fd7c80a7fe0 2023-08-17T17:53:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 >> v1:172.21.15.78:6789/0 conn(0x7fd7c80a7fe0 legacy=0x7fd7c80be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7b00038e0 0x7fd7b0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7b0004690 0x7fd7b0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c80bef00 0x7fd7b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c80c7080 con 0x7fd7b00038e0 2023-08-17T17:53:35.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c80655f0 con 0x7fd7b0004690 2023-08-17T17:53:35.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b000b8e0 con 0x7fd7c80bef00 2023-08-17T17:53:35.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7ccbf5700 1 --2- 172.21.15.78:0/3065657239 >> v2:172.21.15.150:3300/0 conn(0x7fd7c8065140 0x7fd7c80c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:35.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.373+0000 7fd7c7fff700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7b00038e0 0x7fd7b0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c77fe700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7b0004690 0x7fd7b0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7ccbf5700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c80bef00 0x7fd7b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c7fff700 1 -- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c80bef00 msgr2=0x7fd7b0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:35.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c7fff700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c80bef00 0x7fd7b0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c7fff700 1 -- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7b0004690 msgr2=0x7fd7b0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:35.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c7fff700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7b0004690 0x7fd7b0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c7fff700 1 -- 172.21.15.78:0/3065657239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00033f0 con 0x7fd7b00038e0 2023-08-17T17:53:35.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c77fe700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7b0004690 0x7fd7b0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:35.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c7fff700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7b00038e0 0x7fd7b0003d00 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fd7bc00c210 tx=0x7fd7bc001e90).ready entity=mon.0 client_cookie=85fe9bba054b86c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:35.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc007a60 con 0x7fd7b00038e0 2023-08-17T17:53:35.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc00cae0 con 0x7fd7b00038e0 2023-08-17T17:53:35.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7c6ffd700 1 -- 172.21.15.78:0/3065657239 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc00ce80 con 0x7fd7b00038e0 2023-08-17T17:53:35.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7ce658700 1 -- 172.21.15.78:0/3065657239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7b00038e0 msgr2=0x7fd7b0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.374+0000 7fd7ce658700 1 --2- 172.21.15.78:0/3065657239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7b00038e0 0x7fd7b0003d00 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fd7bc00c210 tx=0x7fd7bc001e90).stop 2023-08-17T17:53:35.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.375+0000 7fd7ccbf5700 1 -- 172.21.15.78:0/3065657239 reap_dead start 2023-08-17T17:53:35.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.375+0000 7fd7ce658700 1 -- 172.21.15.78:0/3065657239 shutdown_connections 2023-08-17T17:53:35.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.375+0000 7fd7ce658700 1 -- 172.21.15.78:0/3065657239 >> 172.21.15.78:0/3065657239 conn(0x7fd7c8092330 msgr2=0x7fd7c8062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:35.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.375+0000 7fd7ce658700 1 -- 172.21.15.78:0/3065657239 shutdown_connections 2023-08-17T17:53:35.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.375+0000 7fd7ce658700 1 -- 172.21.15.78:0/3065657239 wait complete. 2023-08-17T17:53:35.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.376+0000 7fd7ce658700 1 Processor -- start 2023-08-17T17:53:35.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.376+0000 7fd7ce658700 1 -- start start 2023-08-17T17:53:35.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7ce658700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7b00038e0 0x7fd7c80c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7ce658700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7c8151d60 0x7fd7c80c1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7ce658700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c81530c0 0x7fd7c8153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7ce658700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c8153a30 con 0x7fd7c8151d60 2023-08-17T17:53:35.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7ce658700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c81521e0 con 0x7fd7b00038e0 2023-08-17T17:53:35.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7ce658700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c80c1fe0 con 0x7fd7c81530c0 2023-08-17T17:53:35.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7c77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7c8151d60 0x7fd7c80c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7c77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7c8151d60 0x7fd7c80c1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59246/0 (socket says 172.21.15.78:59246) 2023-08-17T17:53:35.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7c77fe700 1 -- 172.21.15.78:0/1181915733 learned_addr learned my addr 172.21.15.78:0/1181915733 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:35.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7ccbf5700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c81530c0 0x7fd7c8153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7c7fff700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7b00038e0 0x7fd7c80c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7c77fe700 1 -- 172.21.15.78:0/1181915733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c81530c0 msgr2=0x7fd7c8153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7c77fe700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c81530c0 0x7fd7c8153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7c77fe700 1 -- 172.21.15.78:0/1181915733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7b00038e0 msgr2=0x7fd7c80c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7c77fe700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7b00038e0 0x7fd7c80c0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7c77fe700 1 -- 172.21.15.78:0/1181915733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c80c22c0 con 0x7fd7c8151d60 2023-08-17T17:53:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7c77fe700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7c8151d60 0x7fd7c80c1800 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fd7b8011690 tx=0x7fd7b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7affff700 1 -- 172.21.15.78:0/1181915733 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b80145f0 con 0x7fd7c8151d60 2023-08-17T17:53:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7affff700 1 -- 172.21.15.78:0/1181915733 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b8014750 con 0x7fd7c8151d60 2023-08-17T17:53:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7affff700 1 -- 172.21.15.78:0/1181915733 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8014b10 con 0x7fd7c8151d60 2023-08-17T17:53:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7ce658700 1 -- 172.21.15.78:0/1181915733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c80c25a0 con 0x7fd7c8151d60 2023-08-17T17:53:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.377+0000 7fd7ce658700 1 -- 172.21.15.78:0/1181915733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c80c2b60 con 0x7fd7c8151d60 2023-08-17T17:53:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.378+0000 7fd7ce658700 1 -- 172.21.15.78:0/1181915733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c80bde20 con 0x7fd7c8151d60 2023-08-17T17:53:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.379+0000 7fd7affff700 1 -- 172.21.15.78:0/1181915733 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fd7b8012040 con 0x7fd7c8151d60 2023-08-17T17:53:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.379+0000 7fd7affff700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7b405ede0 0x7fd7b40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.379+0000 7fd7c7fff700 1 -- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7b405ede0 msgr2=0x7fd7b40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.379+0000 7fd7affff700 1 -- 172.21.15.78:0/1181915733 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd7b807a280 con 0x7fd7c8151d60 2023-08-17T17:53:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.379+0000 7fd7c7fff700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7b405ede0 0x7fd7b40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.383+0000 7fd7affff700 1 -- 172.21.15.78:0/1181915733 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7b804b6a0 con 0x7fd7c8151d60 2023-08-17T17:53:35.478 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:35.477+0000 7f5abc9fe680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:53:35.568 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:35.567+0000 7f57cbdff680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:53:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.580+0000 7fd7c7fff700 1 -- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7b405ede0 msgr2=0x7fd7b40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.580+0000 7fd7c7fff700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7b405ede0 0x7fd7b40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:35.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.598+0000 7fd7ce658700 1 -- 172.21.15.78:0/1181915733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7c8047350 con 0x7fd7c8151d60 2023-08-17T17:53:35.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.598+0000 7fd7affff700 1 -- 172.21.15.78:0/1181915733 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fd7b804ecc0 con 0x7fd7c8151d60 2023-08-17T17:53:35.600 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:35.600 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2182410743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2182410743},{"type":"v1","addr":"172.21.15.150:6833","nonce":2182410743}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/4059280185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4059280185},{"type":"v1","addr":"172.21.15.150:6835","nonce":4059280185}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8106,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/984792555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":984792555},{"type":"v1","addr":"172.21.15.78:6836","nonce":984792555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:18.711473+0000","modified":"2023-08-17T17:53:20.721858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/1089949614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1089949614},{"type":"v1","addr":"172.21.15.78:6837","nonce":1089949614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T17:53:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 -- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7b405ede0 msgr2=0x7fd7b40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7b405ede0 0x7fd7b40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 -- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7c8151d60 msgr2=0x7fd7c80c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7c8151d60 0x7fd7c80c1800 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fd7b8011690 tx=0x7fd7b8008040).stop 2023-08-17T17:53:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 -- 172.21.15.78:0/1181915733 shutdown_connections 2023-08-17T17:53:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7b405ede0 0x7fd7b40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c81530c0 0x7fd7c8153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7b00038e0 0x7fd7c80c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 --2- 172.21.15.78:0/1181915733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7c8151d60 0x7fd7c80c1800 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 -- 172.21.15.78:0/1181915733 >> 172.21.15.78:0/1181915733 conn(0x7fd7c8092330 msgr2=0x7fd7c80665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 -- 172.21.15.78:0/1181915733 shutdown_connections 2023-08-17T17:53:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.600+0000 7fd7ce658700 1 -- 172.21.15.78:0/1181915733 wait complete. 2023-08-17T17:53:35.604 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 49 2023-08-17T17:53:35.614 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:35.664 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:35.663+0000 7f5abc9fe680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:35.759 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:35.758+0000 7f57cbdff680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:53:35.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.771+0000 7f5c222e0700 1 Processor -- start 2023-08-17T17:53:35.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.771+0000 7f5c222e0700 1 -- start start 2023-08-17T17:53:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c222e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c1c150e10 0x7f5c1c0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c222e0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5c1c0bd6b0 0x7f5c1c0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c222e0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1c06b580 con 0x7f5c1c063b10 2023-08-17T17:53:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c222e0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c0bcb10 con 0x7f5c1c0bd6b0 2023-08-17T17:53:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c222e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0bc200 con 0x7f5c1c150e10 2023-08-17T17:53:35.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c2087d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5c1c0bd6b0 0x7f5c1c0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c2087d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5c1c0bd6b0 0x7f5c1c0c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59260/0 (socket says 172.21.15.78:59260) 2023-08-17T17:53:35.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c2087d700 1 -- 172.21.15.78:0/2882695441 learned_addr learned my addr 172.21.15.78:0/2882695441 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:35.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c1bfff700 1 --2- 172.21.15.78:0/2882695441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c1c150e10 0x7f5c1c0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c2087d700 1 -- 172.21.15.78:0/2882695441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c1c150e10 msgr2=0x7f5c1c0aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:35.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.772+0000 7f5c2087d700 1 --2- 172.21.15.78:0/2882695441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c1c150e10 0x7f5c1c0aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c2087d700 1 -- 172.21.15.78:0/2882695441 >> v1:172.21.15.150:6789/0 conn(0x7f5c1c063b10 legacy=0x7f5c1c0bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c2087d700 1 -- 172.21.15.78:0/2882695441 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c0c37a0 con 0x7f5c1c0bd6b0 2023-08-17T17:53:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c2087d700 1 --2- 172.21.15.78:0/2882695441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c0bd6b0 0x7f5c1c0c24d0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f5c1400d1a0 tx=0x7f5c1400ba50).ready entity=mon.0 client_cookie=68ab63d175a0c2ab server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c1affd700 1 -- 172.21.15.78:0/2882695441 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14010070 con 0x7f5c1c0bd6b0 2023-08-17T17:53:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c1affd700 1 -- 172.21.15.78:0/2882695441 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1400b0d0 con 0x7f5c1c0bd6b0 2023-08-17T17:53:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c1affd700 1 -- 172.21.15.78:0/2882695441 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1400b450 con 0x7f5c1c0bd6b0 2023-08-17T17:53:35.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c222e0700 1 -- 172.21.15.78:0/2882695441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c0bd6b0 msgr2=0x7f5c1c0c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c222e0700 1 --2- 172.21.15.78:0/2882695441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c0bd6b0 0x7f5c1c0c24d0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f5c1400d1a0 tx=0x7f5c1400ba50).stop 2023-08-17T17:53:35.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c222e0700 1 -- 172.21.15.78:0/2882695441 shutdown_connections 2023-08-17T17:53:35.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c222e0700 1 --2- 172.21.15.78:0/2882695441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c0bd6b0 0x7f5c1c0c24d0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c222e0700 1 --2- 172.21.15.78:0/2882695441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c1c150e10 0x7f5c1c0aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c222e0700 1 -- 172.21.15.78:0/2882695441 >> 172.21.15.78:0/2882695441 conn(0x7f5c1c0c3d40 msgr2=0x7f5c1c0c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:35.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c222e0700 1 -- 172.21.15.78:0/2882695441 shutdown_connections 2023-08-17T17:53:35.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.773+0000 7f5c222e0700 1 -- 172.21.15.78:0/2882695441 wait complete. 2023-08-17T17:53:35.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.774+0000 7f5c222e0700 1 Processor -- start 2023-08-17T17:53:35.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.775+0000 7f5c222e0700 1 -- start start 2023-08-17T17:53:35.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.775+0000 7f5c222e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c1c063b10 0x7f5c1c0be340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.775+0000 7f5c222e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c1c0bd6b0 0x7f5c1c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.775+0000 7f5c222e0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c150e10 0x7f5c1c0c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.775+0000 7f5c222e0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c1547a0 con 0x7f5c1c150e10 2023-08-17T17:53:35.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.775+0000 7f5c222e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0bf410 con 0x7f5c1c063b10 2023-08-17T17:53:35.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.775+0000 7f5c222e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c1541e0 con 0x7f5c1c0bd6b0 2023-08-17T17:53:35.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c2087d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c150e10 0x7f5c1c0c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c2087d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c150e10 0x7f5c1c0c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59276/0 (socket says 172.21.15.78:59276) 2023-08-17T17:53:35.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c2087d700 1 -- 172.21.15.78:0/4250781948 learned_addr learned my addr 172.21.15.78:0/4250781948 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:35.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c1bfff700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c1c063b10 0x7f5c1c0be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c1b7fe700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c1c0bd6b0 0x7f5c1c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:35.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c2087d700 1 -- 172.21.15.78:0/4250781948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c1c0bd6b0 msgr2=0x7f5c1c14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c2087d700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c1c0bd6b0 0x7f5c1c14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c2087d700 1 -- 172.21.15.78:0/4250781948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c1c063b10 msgr2=0x7f5c1c0be340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c2087d700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c1c063b10 0x7f5c1c0be340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c2087d700 1 -- 172.21.15.78:0/4250781948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1400bcf0 con 0x7f5c1c150e10 2023-08-17T17:53:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c2087d700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c150e10 0x7f5c1c0c0870 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f5c1400d8f0 tx=0x7f5c1400ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c03fff700 1 -- 172.21.15.78:0/4250781948 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1400dec0 con 0x7f5c1c150e10 2023-08-17T17:53:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c03fff700 1 -- 172.21.15.78:0/4250781948 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c14015420 con 0x7f5c1c150e10 2023-08-17T17:53:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c222e0700 1 -- 172.21.15.78:0/4250781948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1c1544c0 con 0x7f5c1c150e10 2023-08-17T17:53:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c03fff700 1 -- 172.21.15.78:0/4250781948 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c140157a0 con 0x7f5c1c150e10 2023-08-17T17:53:35.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.776+0000 7f5c222e0700 1 -- 172.21.15.78:0/4250781948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c0bf0a0 con 0x7f5c1c150e10 2023-08-17T17:53:35.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.777+0000 7f5c222e0700 1 -- 172.21.15.78:0/4250781948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c151240 con 0x7f5c1c150e10 2023-08-17T17:53:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.778+0000 7f5c03fff700 1 -- 172.21.15.78:0/4250781948 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f5c1401d040 con 0x7f5c1c150e10 2023-08-17T17:53:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.778+0000 7f5c03fff700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c0805edb0 0x7f5c08061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.778+0000 7f5c1bfff700 1 -- 172.21.15.78:0/4250781948 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c0805edb0 msgr2=0x7f5c08061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.778+0000 7f5c03fff700 1 -- 172.21.15.78:0/4250781948 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5c1407d930 con 0x7f5c1c150e10 2023-08-17T17:53:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.778+0000 7f5c1bfff700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c0805edb0 0x7f5c08061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.782+0000 7f5c03fff700 1 -- 172.21.15.78:0/4250781948 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c1404ed50 con 0x7f5c1c150e10 2023-08-17T17:53:35.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.951+0000 7f5c222e0700 1 -- 172.21.15.78:0/4250781948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c1c0bc4c0 con 0x7f5c1c150e10 2023-08-17T17:53:35.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.952+0000 7f5c03fff700 1 -- 172.21.15.78:0/4250781948 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+17235 (secure 0 0 0) 0x7f5c14052370 con 0x7f5c1c150e10 2023-08-17T17:53:35.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:35.953 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":136,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:29.991169+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:17.233530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:17.675099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1968964526":"2023-08-18T17:53:29.991127+0000","172.21.15.78:6833/119464":"2023-08-18T17:53:29.991127+0000","172.21.15.78:6832/119464":"2023-08-18T17:53:29.991127+0000","172.21.15.78:0/569216571":"2023-08-18T17:53:29.991127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 -- 172.21.15.78:0/4250781948 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c0805edb0 msgr2=0x7f5c08061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c0805edb0 0x7f5c08061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 -- 172.21.15.78:0/4250781948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c150e10 msgr2=0x7f5c1c0c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c150e10 0x7f5c1c0c0870 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f5c1400d8f0 tx=0x7f5c1400ba50).stop 2023-08-17T17:53:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 -- 172.21.15.78:0/4250781948 shutdown_connections 2023-08-17T17:53:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c0805edb0 0x7f5c08061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c150e10 0x7f5c1c0c0870 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c1c063b10 0x7f5c1c0be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 --2- 172.21.15.78:0/4250781948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c1c0bd6b0 0x7f5c1c14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 -- 172.21.15.78:0/4250781948 >> 172.21.15.78:0/4250781948 conn(0x7f5c1c0c3d40 msgr2=0x7f5c1c0c2490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 -- 172.21.15.78:0/4250781948 shutdown_connections 2023-08-17T17:53:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:35.955+0000 7f5c222e0700 1 -- 172.21.15.78:0/4250781948 wait complete. 2023-08-17T17:53:35.973 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T17:53:35.973 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.090+0000 7fcfb5da7700 1 Processor -- start 2023-08-17T17:53:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.090+0000 7fcfb5da7700 1 -- start start 2023-08-17T17:53:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfb5da7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c1010 0x7fcfb00ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfb5da7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00c7350 con 0x7fcfb0154140 2023-08-17T17:53:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfb5da7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00a8350 con 0x7fcfb00c6ee0 2023-08-17T17:53:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfb5da7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0154520 con 0x7fcfb00c1010 2023-08-17T17:53:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaf7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcfb0154140 0x7fcfb00a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38958/0 (socket says 172.21.15.78:38958) 2023-08-17T17:53:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaf7fe700 1 -- 172.21.15.78:0/1442610995 learned_addr learned my addr 172.21.15.78:0/1442610995 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaffff700 1 --2- 172.21.15.78:0/1442610995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c1010 0x7fcfb00ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaeffd700 1 -- 172.21.15.78:0/1442610995 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762593534 0 0) 0x7fcfb00c7350 con 0x7fcfb0154140 2023-08-17T17:53:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaeffd700 1 -- 172.21.15.78:0/1442610995 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf9c0033f0 con 0x7fcfb0154140 2023-08-17T17:53:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaeffd700 1 -- 172.21.15.78:0/1442610995 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794338868 0 0) 0x7fcfb00a8350 con 0x7fcfb00c6ee0 2023-08-17T17:53:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaeffd700 1 -- 172.21.15.78:0/1442610995 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb00c7350 con 0x7fcfb00c6ee0 2023-08-17T17:53:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaffff700 1 -- 172.21.15.78:0/1442610995 >> v1:172.21.15.150:6789/0 conn(0x7fcfb00c6ee0 legacy=0x7fcfb00c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaffff700 1 -- 172.21.15.78:0/1442610995 >> v1:172.21.15.78:6789/0 conn(0x7fcfb0154140 legacy=0x7fcfb00a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaffff700 1 -- 172.21.15.78:0/1442610995 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb00c91e0 con 0x7fcfb00c1010 2023-08-17T17:53:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaffff700 1 --2- 172.21.15.78:0/1442610995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c1010 0x7fcfb00ca280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fcfa8009e90 tx=0x7fcfa8009780).ready entity=mon.2 client_cookie=4524165ef3e261fb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaeffd700 1 -- 172.21.15.78:0/1442610995 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800e070 con 0x7fcfb00c1010 2023-08-17T17:53:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.091+0000 7fcfaeffd700 1 -- 172.21.15.78:0/1442610995 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa800bab0 con 0x7fcfb00c1010 2023-08-17T17:53:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.092+0000 7fcfaeffd700 1 -- 172.21.15.78:0/1442610995 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800be30 con 0x7fcfb00c1010 2023-08-17T17:53:36.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.092+0000 7fcfb5da7700 1 -- 172.21.15.78:0/1442610995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c1010 msgr2=0x7fcfb00ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.092+0000 7fcfb5da7700 1 --2- 172.21.15.78:0/1442610995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c1010 0x7fcfb00ca280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fcfa8009e90 tx=0x7fcfa8009780).stop 2023-08-17T17:53:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.092+0000 7fcfb5da7700 1 -- 172.21.15.78:0/1442610995 shutdown_connections 2023-08-17T17:53:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.092+0000 7fcfb5da7700 1 --2- 172.21.15.78:0/1442610995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c1010 0x7fcfb00ca280 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.092+0000 7fcfb5da7700 1 -- 172.21.15.78:0/1442610995 >> 172.21.15.78:0/1442610995 conn(0x7fcfb0094510 msgr2=0x7fcfb006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.092+0000 7fcfb5da7700 1 -- 172.21.15.78:0/1442610995 shutdown_connections 2023-08-17T17:53:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.092+0000 7fcfb5da7700 1 -- 172.21.15.78:0/1442610995 wait complete. 2023-08-17T17:53:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.093+0000 7fcfb5da7700 1 Processor -- start 2023-08-17T17:53:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.093+0000 7fcfb5da7700 1 -- start start 2023-08-17T17:53:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfb5da7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfb00c1010 0x7fcfb00a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfb5da7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c6ee0 0x7fcfb00a8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfb5da7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb0154140 0x7fcfb00a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfb5da7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00a9a20 con 0x7fcfb0154140 2023-08-17T17:53:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfb5da7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00c3d30 con 0x7fcfb00c1010 2023-08-17T17:53:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfb5da7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00a89f0 con 0x7fcfb00c6ee0 2023-08-17T17:53:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfaffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb0154140 0x7fcfb00a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfaffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb0154140 0x7fcfb00a9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59280/0 (socket says 172.21.15.78:59280) 2023-08-17T17:53:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfaffff700 1 -- 172.21.15.78:0/216032473 learned_addr learned my addr 172.21.15.78:0/216032473 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfaf7fe700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfb00c1010 0x7fcfb00a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfa7fff700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c6ee0 0x7fcfb00a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfaffff700 1 -- 172.21.15.78:0/216032473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c6ee0 msgr2=0x7fcfb00a8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfaffff700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c6ee0 0x7fcfb00a8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfaffff700 1 -- 172.21.15.78:0/216032473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfb00c1010 msgr2=0x7fcfb00a9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfaffff700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfb00c1010 0x7fcfb00a9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.094+0000 7fcfaffff700 1 -- 172.21.15.78:0/216032473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8009a20 con 0x7fcfb0154140 2023-08-17T17:53:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.095+0000 7fcfaffff700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb0154140 0x7fcfb00a9fd0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fcfb006c200 tx=0x7fcfa8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.095+0000 7fcfa77fe700 1 -- 172.21.15.78:0/216032473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8013e60 con 0x7fcfb0154140 2023-08-17T17:53:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.095+0000 7fcfa77fe700 1 -- 172.21.15.78:0/216032473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa801d630 con 0x7fcfb0154140 2023-08-17T17:53:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.095+0000 7fcfb5da7700 1 -- 172.21.15.78:0/216032473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb01648e0 con 0x7fcfb0154140 2023-08-17T17:53:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.095+0000 7fcfa77fe700 1 -- 172.21.15.78:0/216032473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa801d9f0 con 0x7fcfb0154140 2023-08-17T17:53:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.095+0000 7fcfb5da7700 1 -- 172.21.15.78:0/216032473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb0164ea0 con 0x7fcfb0154140 2023-08-17T17:53:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.096+0000 7fcfb5da7700 1 -- 172.21.15.78:0/216032473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb00c3ec0 con 0x7fcfb0154140 2023-08-17T17:53:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.096+0000 7fcfa77fe700 1 -- 172.21.15.78:0/216032473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fcfa801dd60 con 0x7fcfb0154140 2023-08-17T17:53:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.096+0000 7fcfa77fe700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf9005ede0 0x7fcf900612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.096+0000 7fcfaf7fe700 1 -- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf9005ede0 msgr2=0x7fcf900612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.096+0000 7fcfa77fe700 1 -- 172.21.15.78:0/216032473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fcfa807bf30 con 0x7fcfb0154140 2023-08-17T17:53:36.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.096+0000 7fcfaf7fe700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf9005ede0 0x7fcf900612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:36.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.104+0000 7fcfa77fe700 1 -- 172.21.15.78:0/216032473 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcfa80aa8f0 con 0x7fcfb0154140 2023-08-17T17:53:36.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.297+0000 7fcfaf7fe700 1 -- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf9005ede0 msgr2=0x7fcf900612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:36.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.297+0000 7fcfaf7fe700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf9005ede0 0x7fcf900612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:36.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.317+0000 7fcfb5da7700 1 -- 172.21.15.78:0/216032473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfb0047350 con 0x7fcfb0154140 2023-08-17T17:53:36.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.317+0000 7fcfa77fe700 1 -- 172.21.15.78:0/216032473 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fcfb00c3ec0 con 0x7fcfb0154140 2023-08-17T17:53:36.319 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:36.319 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2182410743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2182410743},{"type":"v1","addr":"172.21.15.150:6833","nonce":2182410743}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/4059280185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4059280185},{"type":"v1","addr":"172.21.15.150:6835","nonce":4059280185}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8106,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/984792555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":984792555},{"type":"v1","addr":"172.21.15.78:6836","nonce":984792555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:18.711473+0000","modified":"2023-08-17T17:53:20.721858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/1089949614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1089949614},{"type":"v1","addr":"172.21.15.78:6837","nonce":1089949614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T17:53:36.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 -- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf9005ede0 msgr2=0x7fcf900612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:36.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf9005ede0 0x7fcf900612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:36.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 -- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb0154140 msgr2=0x7fcfb00a9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb0154140 0x7fcfb00a9fd0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fcfb006c200 tx=0x7fcfa8009780).stop 2023-08-17T17:53:36.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 -- 172.21.15.78:0/216032473 shutdown_connections 2023-08-17T17:53:36.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcf9005ede0 0x7fcf900612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:36.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb0154140 0x7fcfb00a9fd0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfb00c1010 0x7fcfb00a9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 --2- 172.21.15.78:0/216032473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb00c6ee0 0x7fcfb00a8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 -- 172.21.15.78:0/216032473 >> 172.21.15.78:0/216032473 conn(0x7fcfb0094510 msgr2=0x7fcfb014e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:36.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 -- 172.21.15.78:0/216032473 shutdown_connections 2023-08-17T17:53:36.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.320+0000 7fcfb5da7700 1 -- 172.21.15.78:0/216032473 wait complete. 2023-08-17T17:53:36.323 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 49 2023-08-17T17:53:36.326 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:36.326+0000 7f5abc9fe680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:53:36.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:36.396 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:36.395+0000 7f5abc9fe680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:53:36.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.451+0000 7f952a4df700 1 Processor -- start 2023-08-17T17:53:36.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.451+0000 7f952a4df700 1 -- start start 2023-08-17T17:53:36.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.452+0000 7f952a4df700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95240624f0 0x7f95240628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.452+0000 7f952a4df700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95240c2290 0x7f952415a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.452+0000 7f952a4df700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95240c3580 con 0x7f9524062dc0 2023-08-17T17:53:36.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.452+0000 7f952a4df700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95240c26e0 con 0x7f95240624f0 2023-08-17T17:53:36.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.452+0000 7f952a4df700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95240c3a10 con 0x7f95240c2290 2023-08-17T17:53:36.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.452+0000 7f9523fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95240624f0 0x7f95240628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.452+0000 7f9523fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95240624f0 0x7f95240628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59290/0 (socket says 172.21.15.78:59290) 2023-08-17T17:53:36.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.452+0000 7f9523fff700 1 -- 172.21.15.78:0/4284059003 learned_addr learned my addr 172.21.15.78:0/4284059003 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:36.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.452+0000 7f95237fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9524062dc0 0x7f95240c1b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38974/0 (socket says 172.21.15.78:38974) 2023-08-17T17:53:36.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.452+0000 7f9528a7c700 1 --2- 172.21.15.78:0/4284059003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95240c2290 0x7f952415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f9523fff700 1 -- 172.21.15.78:0/4284059003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95240c2290 msgr2=0x7f952415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:36.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f9523fff700 1 --2- 172.21.15.78:0/4284059003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95240c2290 0x7f952415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f9523fff700 1 -- 172.21.15.78:0/4284059003 >> v1:172.21.15.78:6789/0 conn(0x7f9524062dc0 legacy=0x7f95240c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f9523fff700 1 -- 172.21.15.78:0/4284059003 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240c2970 con 0x7f95240624f0 2023-08-17T17:53:36.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f9523fff700 1 --2- 172.21.15.78:0/4284059003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240624f0 0x7f95240628d0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f9518006fd0 tx=0x7f95180090f0).ready entity=mon.0 client_cookie=f12f13594e862de7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f9522ffd700 1 -- 172.21.15.78:0/4284059003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800f510 con 0x7f95240624f0 2023-08-17T17:53:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f9522ffd700 1 -- 172.21.15.78:0/4284059003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951800f670 con 0x7f95240624f0 2023-08-17T17:53:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f9522ffd700 1 -- 172.21.15.78:0/4284059003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800fa10 con 0x7f95240624f0 2023-08-17T17:53:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f952a4df700 1 -- 172.21.15.78:0/4284059003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240624f0 msgr2=0x7f95240628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f952a4df700 1 --2- 172.21.15.78:0/4284059003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240624f0 0x7f95240628d0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f9518006fd0 tx=0x7f95180090f0).stop 2023-08-17T17:53:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f952a4df700 1 -- 172.21.15.78:0/4284059003 shutdown_connections 2023-08-17T17:53:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f952a4df700 1 --2- 172.21.15.78:0/4284059003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95240c2290 0x7f952415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f952a4df700 1 --2- 172.21.15.78:0/4284059003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240624f0 0x7f95240628d0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.453+0000 7f952a4df700 1 -- 172.21.15.78:0/4284059003 >> 172.21.15.78:0/4284059003 conn(0x7f95240c3d40 msgr2=0x7f95240c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.454+0000 7f952a4df700 1 -- 172.21.15.78:0/4284059003 shutdown_connections 2023-08-17T17:53:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.454+0000 7f952a4df700 1 -- 172.21.15.78:0/4284059003 wait complete. 2023-08-17T17:53:36.458 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:36.455+0000 7f57cbdff680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:53:36.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.455+0000 7f952a4df700 1 Processor -- start 2023-08-17T17:53:36.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.455+0000 7f952a4df700 1 -- start start 2023-08-17T17:53:36.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f952a4df700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95240624f0 0x7f952414e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f952a4df700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9524062dc0 0x7f95240c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f952a4df700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240c2290 0x7f95240c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f952a4df700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95240c0e70 con 0x7f95240c2290 2023-08-17T17:53:36.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f952a4df700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952414e570 con 0x7f95240624f0 2023-08-17T17:53:36.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f952a4df700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9524150e00 con 0x7f9524062dc0 2023-08-17T17:53:36.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9528a7c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240c2290 0x7f95240c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9528a7c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240c2290 0x7f95240c0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59302/0 (socket says 172.21.15.78:59302) 2023-08-17T17:53:36.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9528a7c700 1 -- 172.21.15.78:0/2570718222 learned_addr learned my addr 172.21.15.78:0/2570718222 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:36.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f95237fe700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9524062dc0 0x7f95240c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9523fff700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95240624f0 0x7f952414e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9528a7c700 1 -- 172.21.15.78:0/2570718222 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9524062dc0 msgr2=0x7f95240c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9528a7c700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9524062dc0 0x7f95240c0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9528a7c700 1 -- 172.21.15.78:0/2570718222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95240624f0 msgr2=0x7f952414e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9528a7c700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95240624f0 0x7f952414e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9528a7c700 1 -- 172.21.15.78:0/2570718222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518009370 con 0x7f95240c2290 2023-08-17T17:53:36.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9523fff700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95240624f0 0x7f952414e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:36.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f9528a7c700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240c2290 0x7f95240c0980 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f951c007f20 tx=0x7f951c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:36.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f950bfff700 1 -- 172.21.15.78:0/2570718222 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c00eb90 con 0x7f95240c2290 2023-08-17T17:53:36.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f950bfff700 1 -- 172.21.15.78:0/2570718222 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c00ecf0 con 0x7f95240c2290 2023-08-17T17:53:36.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f952a4df700 1 -- 172.21.15.78:0/2570718222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95241510e0 con 0x7f95240c2290 2023-08-17T17:53:36.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f950bfff700 1 -- 172.21.15.78:0/2570718222 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c014610 con 0x7f95240c2290 2023-08-17T17:53:36.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.456+0000 7f952a4df700 1 -- 172.21.15.78:0/2570718222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95241516a0 con 0x7f95240c2290 2023-08-17T17:53:36.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.457+0000 7f952a4df700 1 -- 172.21.15.78:0/2570718222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9524047350 con 0x7f95240c2290 2023-08-17T17:53:36.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.458+0000 7f950bfff700 1 -- 172.21.15.78:0/2570718222 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f951c01b030 con 0x7f95240c2290 2023-08-17T17:53:36.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.458+0000 7f950bfff700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f951005ede0 0x7f95100612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.458+0000 7f9523fff700 1 -- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f951005ede0 msgr2=0x7f95100612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:36.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.458+0000 7f950bfff700 1 -- 172.21.15.78:0/2570718222 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f951c079ae0 con 0x7f95240c2290 2023-08-17T17:53:36.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.458+0000 7f9523fff700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f951005ede0 0x7f95100612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:36.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.462+0000 7f950bfff700 1 -- 172.21.15.78:0/2570718222 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f951c04afb0 con 0x7f95240c2290 2023-08-17T17:53:36.472 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:36.471+0000 7f5abc9fe680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:53:36.528 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:36.527+0000 7f57cbdff680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:53:36.607 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:36.606+0000 7f57cbdff680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:53:36.620 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:36.620+0000 7f5abc9fe680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:53:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.659+0000 7f9523fff700 1 -- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f951005ede0 msgr2=0x7f95100612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.659+0000 7f9523fff700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f951005ede0 0x7f95100612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:36.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.674+0000 7f952a4df700 1 -- 172.21.15.78:0/2570718222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95240c66b0 con 0x7f95240c2290 2023-08-17T17:53:36.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.674+0000 7f950bfff700 1 -- 172.21.15.78:0/2570718222 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f951c00ee60 con 0x7f95240c2290 2023-08-17T17:53:36.675 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:36.676 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2182410743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2182410743},{"type":"v1","addr":"172.21.15.150:6833","nonce":2182410743}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/4059280185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4059280185},{"type":"v1","addr":"172.21.15.150:6835","nonce":4059280185}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8106,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/984792555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":984792555},{"type":"v1","addr":"172.21.15.78:6836","nonce":984792555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:18.711473+0000","modified":"2023-08-17T17:53:20.721858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/1089949614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1089949614},{"type":"v1","addr":"172.21.15.78:6837","nonce":1089949614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T17:53:36.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 -- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f951005ede0 msgr2=0x7f95100612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f951005ede0 0x7f95100612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 -- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240c2290 msgr2=0x7f95240c0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240c2290 0x7f95240c0980 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f951c007f20 tx=0x7f951c009860).stop 2023-08-17T17:53:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 -- 172.21.15.78:0/2570718222 shutdown_connections 2023-08-17T17:53:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f951005ede0 0x7f95100612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95240c2290 0x7f95240c0980 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95240624f0 0x7f952414e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 --2- 172.21.15.78:0/2570718222 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9524062dc0 0x7f95240c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 -- 172.21.15.78:0/2570718222 >> 172.21.15.78:0/2570718222 conn(0x7f95240c3d40 msgr2=0x7f952406b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 -- 172.21.15.78:0/2570718222 shutdown_connections 2023-08-17T17:53:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.676+0000 7f952a4df700 1 -- 172.21.15.78:0/2570718222 wait complete. 2023-08-17T17:53:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 49 2023-08-17T17:53:36.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:36.692 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:36.691+0000 7f5abc9fe680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:53:36.763 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:36.762+0000 7f57cbdff680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:53:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.804+0000 7fc4911f9700 1 Processor -- start 2023-08-17T17:53:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.804+0000 7fc4911f9700 1 -- start start 2023-08-17T17:53:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc4911f9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc48c0bef00 0x7fc48c064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc4911f9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c065140 0x7fc48c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc4911f9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c0c4040 con 0x7fc48c0a7fe0 2023-08-17T17:53:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc4911f9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c0c7080 con 0x7fc48c0bef00 2023-08-17T17:53:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc4911f9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0655f0 con 0x7fc48c065140 2023-08-17T17:53:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc48a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc48c0bef00 0x7fc48c064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc48a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc48c0bef00 0x7fc48c064180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59312/0 (socket says 172.21.15.78:59312) 2023-08-17T17:53:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc48ad9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc48c0a7fe0 0x7fc48c0be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38988/0 (socket says 172.21.15.78:38988) 2023-08-17T17:53:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc48a59c700 1 -- 172.21.15.78:0/3181889093 learned_addr learned my addr 172.21.15.78:0/3181889093 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc48b59e700 1 --2- 172.21.15.78:0/3181889093 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c065140 0x7fc48c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc48a59c700 1 -- 172.21.15.78:0/3181889093 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c065140 msgr2=0x7fc48c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc48a59c700 1 --2- 172.21.15.78:0/3181889093 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c065140 0x7fc48c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc48a59c700 1 -- 172.21.15.78:0/3181889093 >> v1:172.21.15.78:6789/0 conn(0x7fc48c0a7fe0 legacy=0x7fc48c0be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc489d9b700 1 -- 172.21.15.78:0/3181889093 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701170113 0 0) 0x7fc48c0c4040 con 0x7fc48c0a7fe0 2023-08-17T17:53:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.805+0000 7fc48a59c700 1 -- 172.21.15.78:0/3181889093 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0c3430 con 0x7fc48c0bef00 2023-08-17T17:53:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc48a59c700 1 --2- 172.21.15.78:0/3181889093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c0bef00 0x7fc48c064180 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fc47c006fd0 tx=0x7fc47c0090f0).ready entity=mon.0 client_cookie=38727d4be736d92b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc489d9b700 1 -- 172.21.15.78:0/3181889093 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00b580 con 0x7fc48c0bef00 2023-08-17T17:53:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc489d9b700 1 -- 172.21.15.78:0/3181889093 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c00b6e0 con 0x7fc48c0bef00 2023-08-17T17:53:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc489d9b700 1 -- 172.21.15.78:0/3181889093 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00ba60 con 0x7fc48c0bef00 2023-08-17T17:53:36.810 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:36.807+0000 7f5abc9fe680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:53:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc4911f9700 1 -- 172.21.15.78:0/3181889093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c0bef00 msgr2=0x7fc48c064180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc4911f9700 1 --2- 172.21.15.78:0/3181889093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c0bef00 0x7fc48c064180 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fc47c006fd0 tx=0x7fc47c0090f0).stop 2023-08-17T17:53:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc4911f9700 1 -- 172.21.15.78:0/3181889093 shutdown_connections 2023-08-17T17:53:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc4911f9700 1 --2- 172.21.15.78:0/3181889093 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c065140 0x7fc48c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc4911f9700 1 --2- 172.21.15.78:0/3181889093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c0bef00 0x7fc48c064180 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc4911f9700 1 -- 172.21.15.78:0/3181889093 >> 172.21.15.78:0/3181889093 conn(0x7fc48c092330 msgr2=0x7fc48c062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc4911f9700 1 -- 172.21.15.78:0/3181889093 shutdown_connections 2023-08-17T17:53:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.806+0000 7fc4911f9700 1 -- 172.21.15.78:0/3181889093 wait complete. 2023-08-17T17:53:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc4911f9700 1 Processor -- start 2023-08-17T17:53:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc4911f9700 1 -- start start 2023-08-17T17:53:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc4911f9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c065140 0x7fc48c164500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc4911f9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0a7fe0 0x7fc48c0c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc4911f9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c0bef00 0x7fc48c165710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc4911f9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c164b90 con 0x7fc48c065140 2023-08-17T17:53:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc4911f9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c164e70 con 0x7fc48c0a7fe0 2023-08-17T17:53:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc4911f9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c165150 con 0x7fc48c0bef00 2023-08-17T17:53:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc48ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c065140 0x7fc48c164500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc48ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c065140 0x7fc48c164500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59324/0 (socket says 172.21.15.78:59324) 2023-08-17T17:53:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.808+0000 7fc48ad9d700 1 -- 172.21.15.78:0/2706440286 learned_addr learned my addr 172.21.15.78:0/2706440286 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc48a59c700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0a7fe0 0x7fc48c0c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc48b59e700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c0bef00 0x7fc48c165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc48ad9d700 1 -- 172.21.15.78:0/2706440286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c0bef00 msgr2=0x7fc48c165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc48ad9d700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c0bef00 0x7fc48c165710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc48ad9d700 1 -- 172.21.15.78:0/2706440286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0a7fe0 msgr2=0x7fc48c0c05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc48ad9d700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0a7fe0 0x7fc48c0c05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc48ad9d700 1 -- 172.21.15.78:0/2706440286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c009370 con 0x7fc48c065140 2023-08-17T17:53:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc48ad9d700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c065140 0x7fc48c164500 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7fc48000c560 tx=0x7fc480007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc472ffd700 1 -- 172.21.15.78:0/2706440286 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800072e0 con 0x7fc48c065140 2023-08-17T17:53:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc472ffd700 1 -- 172.21.15.78:0/2706440286 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc480007440 con 0x7fc48c065140 2023-08-17T17:53:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc4911f9700 1 -- 172.21.15.78:0/2706440286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c165430 con 0x7fc48c065140 2023-08-17T17:53:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc472ffd700 1 -- 172.21.15.78:0/2706440286 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800058f0 con 0x7fc48c065140 2023-08-17T17:53:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.809+0000 7fc4911f9700 1 -- 172.21.15.78:0/2706440286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c0c0ab0 con 0x7fc48c065140 2023-08-17T17:53:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.810+0000 7fc4911f9700 1 -- 172.21.15.78:0/2706440286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c047350 con 0x7fc48c065140 2023-08-17T17:53:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.810+0000 7fc472ffd700 1 -- 172.21.15.78:0/2706440286 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc48001a060 con 0x7fc48c065140 2023-08-17T17:53:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.811+0000 7fc472ffd700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47805edb0 0x7fc478061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.811+0000 7fc48a59c700 1 -- 172.21.15.78:0/2706440286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47805edb0 msgr2=0x7fc478061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.811+0000 7fc472ffd700 1 -- 172.21.15.78:0/2706440286 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc480079470 con 0x7fc48c065140 2023-08-17T17:53:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.811+0000 7fc48a59c700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47805edb0 0x7fc478061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.815+0000 7fc472ffd700 1 -- 172.21.15.78:0/2706440286 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc48004a890 con 0x7fc48c065140 2023-08-17T17:53:36.840 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:36.839+0000 7f57cbdff680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:53:36.918 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:36.917+0000 7f5abc9fe680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:36.960 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:36.959+0000 7f57cbdff680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:53:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.985+0000 7fc4911f9700 1 -- 172.21.15.78:0/2706440286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc48c1577f0 con 0x7fc48c065140 2023-08-17T17:53:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.986+0000 7fc472ffd700 1 -- 172.21.15.78:0/2706440286 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+17235 (secure 0 0 0) 0x7fc480018070 con 0x7fc48c065140 2023-08-17T17:53:36.988 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:36.988 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":136,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:29.991169+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:17.233530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:17.675099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1968964526":"2023-08-18T17:53:29.991127+0000","172.21.15.78:6833/119464":"2023-08-18T17:53:29.991127+0000","172.21.15.78:6832/119464":"2023-08-18T17:53:29.991127+0000","172.21.15.78:0/569216571":"2023-08-18T17:53:29.991127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.988+0000 7fc4911f9700 1 -- 172.21.15.78:0/2706440286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47805edb0 msgr2=0x7fc478061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.988+0000 7fc4911f9700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47805edb0 0x7fc478061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.988+0000 7fc4911f9700 1 -- 172.21.15.78:0/2706440286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c065140 msgr2=0x7fc48c164500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.988+0000 7fc4911f9700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c065140 0x7fc48c164500 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7fc48000c560 tx=0x7fc480007c90).stop 2023-08-17T17:53:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.988+0000 7fc4911f9700 1 -- 172.21.15.78:0/2706440286 shutdown_connections 2023-08-17T17:53:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.988+0000 7fc4911f9700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fc47805edb0 0x7fc478061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.988+0000 7fc4911f9700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c0bef00 0x7fc48c165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.988+0000 7fc4911f9700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc48c065140 0x7fc48c164500 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.988+0000 7fc4911f9700 1 --2- 172.21.15.78:0/2706440286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0a7fe0 0x7fc48c0c05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.988+0000 7fc4911f9700 1 -- 172.21.15.78:0/2706440286 >> 172.21.15.78:0/2706440286 conn(0x7fc48c092330 msgr2=0x7fc48c0a5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.989+0000 7fc4911f9700 1 -- 172.21.15.78:0/2706440286 shutdown_connections 2023-08-17T17:53:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:36.989+0000 7fc4911f9700 1 -- 172.21.15.78:0/2706440286 wait complete. 2023-08-17T17:53:37.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T17:53:37.076 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.075+0000 7f57cbdff680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:53:37.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.118+0000 7f19688de700 1 Processor -- start 2023-08-17T17:53:37.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.118+0000 7f19688de700 1 -- start start 2023-08-17T17:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.119+0000 7f19688de700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1964062c00 0x7f1964154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.119+0000 7f19688de700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1964069e90 con 0x7f19640a6bd0 2023-08-17T17:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.119+0000 7f19688de700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1964069280 con 0x7f1964153ea0 2023-08-17T17:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.119+0000 7f19688de700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1964069560 con 0x7f1964062c00 2023-08-17T17:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f1962d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1964062c00 0x7f1964154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f1962d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1964062c00 0x7f1964154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59330/0 (socket says 172.21.15.78:59330) 2023-08-17T17:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f1962d9d700 1 -- 172.21.15.78:0/2090279105 learned_addr learned my addr 172.21.15.78:0/2090279105 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f1961d9b700 1 --1- 172.21.15.78:0/2090279105 >> v1:172.21.15.78:6789/0 conn(0x7f19640a6bd0 0x7f19640624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39002/0 (socket says 172.21.15.78:39002) 2023-08-17T17:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f1962d9d700 1 -- 172.21.15.78:0/2090279105 >> v1:172.21.15.150:6789/0 conn(0x7f1964153ea0 legacy=0x7f19640c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f1962d9d700 1 -- 172.21.15.78:0/2090279105 >> v1:172.21.15.78:6789/0 conn(0x7f19640a6bd0 legacy=0x7f19640624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f196159a700 1 -- 172.21.15.78:0/2090279105 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980066961 0 0) 0x7f1964069e90 con 0x7f19640a6bd0 2023-08-17T17:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f1962d9d700 1 -- 172.21.15.78:0/2090279105 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964069840 con 0x7f1964062c00 2023-08-17T17:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f1962d9d700 1 --2- 172.21.15.78:0/2090279105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 0x7f1964154280 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f195c009f50 tx=0x7f195c009840).ready entity=mon.0 client_cookie=11146efce4b3df4e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f196159a700 1 -- 172.21.15.78:0/2090279105 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c00e070 con 0x7f1964062c00 2023-08-17T17:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f196159a700 1 -- 172.21.15.78:0/2090279105 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c00ba70 con 0x7f1964062c00 2023-08-17T17:53:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.120+0000 7f196159a700 1 -- 172.21.15.78:0/2090279105 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c00bdf0 con 0x7f1964062c00 2023-08-17T17:53:37.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.121+0000 7f19688de700 1 -- 172.21.15.78:0/2090279105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 msgr2=0x7f1964154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:37.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.121+0000 7f19688de700 1 --2- 172.21.15.78:0/2090279105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 0x7f1964154280 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f195c009f50 tx=0x7f195c009840).stop 2023-08-17T17:53:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.121+0000 7f19688de700 1 -- 172.21.15.78:0/2090279105 shutdown_connections 2023-08-17T17:53:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.121+0000 7f19688de700 1 --2- 172.21.15.78:0/2090279105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 0x7f1964154280 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.121+0000 7f19688de700 1 -- 172.21.15.78:0/2090279105 >> 172.21.15.78:0/2090279105 conn(0x7f19640c8680 msgr2=0x7f19640c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.121+0000 7f19688de700 1 -- 172.21.15.78:0/2090279105 shutdown_connections 2023-08-17T17:53:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.121+0000 7f19688de700 1 -- 172.21.15.78:0/2090279105 wait complete. 2023-08-17T17:53:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.122+0000 7f19688de700 1 Processor -- start 2023-08-17T17:53:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.122+0000 7f19688de700 1 -- start start 2023-08-17T17:53:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f19688de700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 0x7f19640a8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f19688de700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19640a6bd0 0x7f1964155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f19688de700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1964153ea0 0x7f196414c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f19688de700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19640a8ef0 con 0x7f1964062c00 2023-08-17T17:53:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f19688de700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1964156110 con 0x7f1964153ea0 2023-08-17T17:53:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f19688de700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19640aab60 con 0x7f19640a6bd0 2023-08-17T17:53:37.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f196259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 0x7f19640a8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:37.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f196259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 0x7f19640a8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59338/0 (socket says 172.21.15.78:59338) 2023-08-17T17:53:37.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f196259c700 1 -- 172.21.15.78:0/3420790888 learned_addr learned my addr 172.21.15.78:0/3420790888 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:37.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f1962d9d700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1964153ea0 0x7f196414c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:37.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f1961d9b700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19640a6bd0 0x7f1964155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:37.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f196259c700 1 -- 172.21.15.78:0/3420790888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19640a6bd0 msgr2=0x7f1964155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:37.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f196259c700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19640a6bd0 0x7f1964155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:37.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f196259c700 1 -- 172.21.15.78:0/3420790888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1964153ea0 msgr2=0x7f196414c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:37.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f196259c700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1964153ea0 0x7f196414c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f196259c700 1 -- 172.21.15.78:0/3420790888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c009ae0 con 0x7f1964062c00 2023-08-17T17:53:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f196259c700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 0x7f19640a8350 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f195400c440 tx=0x7f1954007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f195a7fc700 1 -- 172.21.15.78:0/3420790888 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954007020 con 0x7f1964062c00 2023-08-17T17:53:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f195a7fc700 1 -- 172.21.15.78:0/3420790888 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1954007180 con 0x7f1964062c00 2023-08-17T17:53:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f19688de700 1 -- 172.21.15.78:0/3420790888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19640a8930 con 0x7f1964062c00 2023-08-17T17:53:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.123+0000 7f195a7fc700 1 -- 172.21.15.78:0/3420790888 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954007520 con 0x7f1964062c00 2023-08-17T17:53:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.124+0000 7f19688de700 1 -- 172.21.15.78:0/3420790888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1964155da0 con 0x7f1964062c00 2023-08-17T17:53:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.124+0000 7f19688de700 1 -- 172.21.15.78:0/3420790888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1964155c00 con 0x7f1964062c00 2023-08-17T17:53:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.125+0000 7f195a7fc700 1 -- 172.21.15.78:0/3420790888 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 61) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f1954010070 con 0x7f1964062c00 2023-08-17T17:53:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.125+0000 7f195a7fc700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f194405ede0 0x7f19440612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.125+0000 7f1961d9b700 1 -- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f194405ede0 msgr2=0x7f19440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:37.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.125+0000 7f195a7fc700 1 -- 172.21.15.78:0/3420790888 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f1954078e50 con 0x7f1964062c00 2023-08-17T17:53:37.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.125+0000 7f1961d9b700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f194405ede0 0x7f19440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:53:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.133+0000 7f195a7fc700 1 -- 172.21.15.78:0/3420790888 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19540478f0 con 0x7f1964062c00 2023-08-17T17:53:37.210 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:37.210+0000 7f5abc9fe680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:53:37.282 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:53:37.281+0000 7f5abc9fe680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:53:37.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.326+0000 7f1961d9b700 1 -- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f194405ede0 msgr2=0x7f19440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:53:37.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.326+0000 7f1961d9b700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f194405ede0 0x7f19440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:53:37.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.348+0000 7f19688de700 1 -- 172.21.15.78:0/3420790888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1964047350 con 0x7f1964062c00 2023-08-17T17:53:37.379 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.378+0000 7f57cbdff680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:53:37.451 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.450+0000 7f57cbdff680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:53:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.472+0000 7f195a7fc700 1 -- 172.21.15.78:0/3420790888 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 62) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f1954076bd0 con 0x7f1964062c00 2023-08-17T17:53:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.472+0000 7f195a7fc700 1 -- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f194405ede0 msgr2=0x7f19440612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:53:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:37.472+0000 7f195a7fc700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f194405ede0 0x7f19440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:37.477 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-08-17T17:53:37.476+0000 7fc57b758700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:53:37.477 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-08-17T17:53:37.476+0000 7fc57b758700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:53:37.477 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-08-17T17:53:37.476+0000 7fc57b758700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:53:37.481 INFO:tasks.ceph.mds.a.smithi078.stderr: -1856> 2023-08-17T17:53:24.669+0000 7fc57ef5f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:53:37.483 INFO:tasks.ceph.mds.a.smithi078.stderr: -5> 2023-08-17T17:53:37.476+0000 7fc57b758700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T17:53:37.483 INFO:tasks.ceph.mds.a.smithi078.stderr: -3> 2023-08-17T17:53:37.476+0000 7fc57b758700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T17:53:37.483 INFO:tasks.ceph.mds.a.smithi078.stderr: -1> 2023-08-17T17:53:37.476+0000 7fc57b758700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T17:53:37.503 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T17:53:37.536 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.535+0000 7f574eda6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:37.536 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.535+0000 7f574eda6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:37.536 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.535+0000 7f574eda6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:37.536 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.535+0000 7f574eda6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:37.537 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.535+0000 7f574eda6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:37.537 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.535+0000 7f574bda0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:37.537 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.535+0000 7f574bda0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:37.537 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.535+0000 7f574bda0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:37.537 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.535+0000 7f574bda0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:37.537 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:53:37.535+0000 7f574bda0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:53:38.288 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T17:53:38.287+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T17:53:38.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.294+0000 7f195a7fc700 1 -- 172.21.15.78:0/3420790888 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f19540703b0 con 0x7f1964062c00 2023-08-17T17:53:38.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.296+0000 7f19688de700 1 -- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 msgr2=0x7f19640a8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:38.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.296+0000 7f19688de700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 0x7f19640a8350 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f195400c440 tx=0x7f1954007e00).stop 2023-08-17T17:53:38.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.296+0000 7f19688de700 1 -- 172.21.15.78:0/3420790888 shutdown_connections 2023-08-17T17:53:38.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.296+0000 7f19688de700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f194405ede0 0x7f19440612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:38.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.296+0000 7f19688de700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1964153ea0 0x7f196414c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:38.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.296+0000 7f19688de700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1964062c00 0x7f19640a8350 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:38.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.296+0000 7f19688de700 1 --2- 172.21.15.78:0/3420790888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19640a6bd0 0x7f1964155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:38.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.296+0000 7f19688de700 1 -- 172.21.15.78:0/3420790888 >> 172.21.15.78:0/3420790888 conn(0x7f19640c8680 msgr2=0x7f19640be210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:38.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.297+0000 7f19688de700 1 -- 172.21.15.78:0/3420790888 shutdown_connections 2023-08-17T17:53:38.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.297+0000 7f19688de700 1 -- 172.21.15.78:0/3420790888 wait complete. 2023-08-17T17:53:38.299 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T17:53:38.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T17:53:38.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.428+0000 7f544b59e700 1 Processor -- start 2023-08-17T17:53:38.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.428+0000 7f544b59e700 1 -- start start 2023-08-17T17:53:38.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544b59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f544c151a40 0x7f544c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:38.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f544c157be0 0x7f544c158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:38.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544c158520 con 0x7f544c151e20 2023-08-17T17:53:38.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544b59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c0c6620 con 0x7f544c151a40 2023-08-17T17:53:38.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c0c6900 con 0x7f544c157be0 2023-08-17T17:53:38.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f544c151a40 0x7f544c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:38.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f544c151a40 0x7f544c0c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59460/0 (socket says 172.21.15.78:59460) 2023-08-17T17:53:38.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544a59c700 1 -- 172.21.15.78:0/1591116224 learned_addr learned my addr 172.21.15.78:0/1591116224 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:38.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544ad9d700 1 --2- 172.21.15.78:0/1591116224 >> v2:172.21.15.150:3300/0 conn(0x7f544c157be0 0x7f544c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:38.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544a59c700 1 -- 172.21.15.78:0/1591116224 >> v2:172.21.15.150:3300/0 conn(0x7f544c157be0 msgr2=0x7f544c158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:38.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544a59c700 1 --2- 172.21.15.78:0/1591116224 >> v2:172.21.15.150:3300/0 conn(0x7f544c157be0 0x7f544c158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:38.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544a59c700 1 -- 172.21.15.78:0/1591116224 >> v1:172.21.15.150:6789/0 conn(0x7f544c151e20 legacy=0x7f544c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:38.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544a59c700 1 -- 172.21.15.78:0/1591116224 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c0c6be0 con 0x7f544c151a40 2023-08-17T17:53:38.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.429+0000 7f544a59c700 1 --2- 172.21.15.78:0/1591116224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151a40 0x7f544c0c8260 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f544c155770 tx=0x7f543c009060).ready entity=mon.0 client_cookie=7e64cb891d4bfc24 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:38.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544959a700 1 -- 172.21.15.78:0/1591116224 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c005880 con 0x7f544c151a40 2023-08-17T17:53:38.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544959a700 1 -- 172.21.15.78:0/1591116224 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c0059e0 con 0x7f544c151a40 2023-08-17T17:53:38.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544959a700 1 -- 172.21.15.78:0/1591116224 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c005d60 con 0x7f544c151a40 2023-08-17T17:53:38.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544b59e700 1 -- 172.21.15.78:0/1591116224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151a40 msgr2=0x7f544c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:38.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544b59e700 1 --2- 172.21.15.78:0/1591116224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151a40 0x7f544c0c8260 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f544c155770 tx=0x7f543c009060).stop 2023-08-17T17:53:38.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544b59e700 1 -- 172.21.15.78:0/1591116224 shutdown_connections 2023-08-17T17:53:38.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544b59e700 1 --2- 172.21.15.78:0/1591116224 >> v2:172.21.15.150:3300/0 conn(0x7f544c157be0 0x7f544c158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:38.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544b59e700 1 --2- 172.21.15.78:0/1591116224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151a40 0x7f544c0c8260 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:38.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544b59e700 1 -- 172.21.15.78:0/1591116224 >> 172.21.15.78:0/1591116224 conn(0x7f544c0943b0 msgr2=0x7f544c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:38.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544b59e700 1 -- 172.21.15.78:0/1591116224 shutdown_connections 2023-08-17T17:53:38.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.430+0000 7f544b59e700 1 -- 172.21.15.78:0/1591116224 wait complete. 2023-08-17T17:53:38.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.431+0000 7f544b59e700 1 Processor -- start 2023-08-17T17:53:38.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.431+0000 7f544b59e700 1 -- start start 2023-08-17T17:53:38.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f544b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f544c151a40 0x7f544c0ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:38.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f544b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151e20 0x7f544c0aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:38.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f544b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f544c157be0 0x7f544c0c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:38.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f544b59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0ae940 con 0x7f544c151e20 2023-08-17T17:53:38.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f544b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0aad60 con 0x7f544c157be0 2023-08-17T17:53:38.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f544b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0ab040 con 0x7f544c151a40 2023-08-17T17:53:38.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f5449d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151e20 0x7f544c0aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:38.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f5449d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151e20 0x7f544c0aa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59464/0 (socket says 172.21.15.78:59464) 2023-08-17T17:53:38.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f5449d9b700 1 -- 172.21.15.78:0/3905088848 learned_addr learned my addr 172.21.15.78:0/3905088848 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f544ad9d700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f544c157be0 0x7f544c0c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f544a59c700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f544c151a40 0x7f544c0ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f5449d9b700 1 -- 172.21.15.78:0/3905088848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f544c151a40 msgr2=0x7f544c0ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f5449d9b700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f544c151a40 0x7f544c0ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f5449d9b700 1 -- 172.21.15.78:0/3905088848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f544c157be0 msgr2=0x7f544c0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f5449d9b700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f544c157be0 0x7f544c0c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.432+0000 7f5449d9b700 1 -- 172.21.15.78:0/3905088848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c009300 con 0x7f544c151e20 2023-08-17T17:53:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.433+0000 7f5449d9b700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151e20 0x7f544c0aa510 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f544000c4c0 tx=0x7f5440007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.433+0000 7f543a7fc700 1 -- 172.21.15.78:0/3905088848 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000ce70 con 0x7f544c151e20 2023-08-17T17:53:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.433+0000 7f543a7fc700 1 -- 172.21.15.78:0/3905088848 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440007020 con 0x7f544c151e20 2023-08-17T17:53:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.433+0000 7f543a7fc700 1 -- 172.21.15.78:0/3905088848 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400073c0 con 0x7f544c151e20 2023-08-17T17:53:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.433+0000 7f544b59e700 1 -- 172.21.15.78:0/3905088848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544c0ab320 con 0x7f544c151e20 2023-08-17T17:53:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.433+0000 7f544b59e700 1 -- 172.21.15.78:0/3905088848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544c0aaa00 con 0x7f544c151e20 2023-08-17T17:53:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.434+0000 7f544b59e700 1 -- 172.21.15.78:0/3905088848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544c0ae430 con 0x7f544c151e20 2023-08-17T17:53:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.434+0000 7f543a7fc700 1 -- 172.21.15.78:0/3905088848 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 62) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f5440010070 con 0x7f544c151e20 2023-08-17T17:53:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.434+0000 7f543a7fc700 1 -- 172.21.15.78:0/3905088848 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f5440079410 con 0x7f544c151e20 2023-08-17T17:53:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.438+0000 7f543a7fc700 1 -- 172.21.15.78:0/3905088848 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f544c0ae430 con 0x7f544c151e20 2023-08-17T17:53:38.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.476+0000 7f543a7fc700 1 -- 172.21.15.78:0/3905088848 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 63) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f54400771d0 con 0x7f544c151e20 2023-08-17T17:53:38.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.477+0000 7f543a7fc700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f542c0301b0 0x7f542c067760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:38.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.478+0000 7f544a59c700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f542c0301b0 0x7f542c067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:38.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.478+0000 7f544a59c700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f542c0301b0 0x7f542c067760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f543c009fd0 tx=0x7f543c016000).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:38.650+0000 7f544b59e700 1 -- 172.21.15.78:0/3905088848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f544c0ae430 con 0x7f544c151e20 2023-08-17T17:53:39.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.481+0000 7f543a7fc700 1 -- 172.21.15.78:0/3905088848 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f544c0ae430 con 0x7f544c151e20 2023-08-17T17:53:39.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 -- 172.21.15.78:0/3905088848 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f542c0301b0 msgr2=0x7f542c067760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:39.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f542c0301b0 0x7f542c067760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f543c009fd0 tx=0x7f543c016000).stop 2023-08-17T17:53:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 -- 172.21.15.78:0/3905088848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151e20 msgr2=0x7f544c0aa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151e20 0x7f544c0aa510 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f544000c4c0 tx=0x7f5440007df0).stop 2023-08-17T17:53:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 -- 172.21.15.78:0/3905088848 shutdown_connections 2023-08-17T17:53:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f542c0301b0 0x7f542c067760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f544c157be0 0x7f544c0c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f544c151a40 0x7f544c0ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 --2- 172.21.15.78:0/3905088848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c151e20 0x7f544c0aa510 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:39.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 -- 172.21.15.78:0/3905088848 >> 172.21.15.78:0/3905088848 conn(0x7f544c0943b0 msgr2=0x7f544c0c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:39.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 -- 172.21.15.78:0/3905088848 shutdown_connections 2023-08-17T17:53:39.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.483+0000 7f544b59e700 1 -- 172.21.15.78:0/3905088848 wait complete. 2023-08-17T17:53:39.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T17:53:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.619+0000 7f05432e3700 1 Processor -- start 2023-08-17T17:53:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.619+0000 7f05432e3700 1 -- start start 2023-08-17T17:53:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.620+0000 7f05432e3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f053c096520 0x7f053c0be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.620+0000 7f05432e3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c0c3e10 con 0x7f053c0bf0e0 2023-08-17T17:53:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.620+0000 7f05432e3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c0c34e0 con 0x7f053c1578f0 2023-08-17T17:53:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.620+0000 7f05432e3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c0bf5c0 con 0x7f053c096520 2023-08-17T17:53:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.620+0000 7f0541880700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f053c0bf0e0 0x7f053c0c42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36162/0 (socket says 172.21.15.78:36162) 2023-08-17T17:53:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.620+0000 7f0541880700 1 -- 172.21.15.78:0/2023106617 learned_addr learned my addr 172.21.15.78:0/2023106617 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.620+0000 7f054087e700 1 --2- 172.21.15.78:0/2023106617 >> v2:172.21.15.150:3300/0 conn(0x7f053c096520 0x7f053c0be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.620+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048231533 0 0) 0x7f053c0c3e10 con 0x7f053c0bf0e0 2023-08-17T17:53:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05280033f0 con 0x7f053c0bf0e0 2023-08-17T17:53:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253456257 0 0) 0x7f053c0c34e0 con 0x7f053c1578f0 2023-08-17T17:53:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f053c0c3e10 con 0x7f053c1578f0 2023-08-17T17:53:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 908406988 0 0) 0x7f05280033f0 con 0x7f053c0bf0e0 2023-08-17T17:53:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 >> v2:172.21.15.150:3300/0 conn(0x7f053c096520 msgr2=0x7f053c0be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 --2- 172.21.15.78:0/2023106617 >> v2:172.21.15.150:3300/0 conn(0x7f053c096520 0x7f053c0be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:39.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 >> v1:172.21.15.150:6789/0 conn(0x7f053c1578f0 legacy=0x7f053c095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:39.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c0c37c0 con 0x7f053c0bf0e0 2023-08-17T17:53:39.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f05340017f0 con 0x7f053c0bf0e0 2023-08-17T17:53:39.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 >> v1:172.21.15.78:6789/0 conn(0x7f053c0bf0e0 legacy=0x7f053c0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:39.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0528003ac0 0x7f0528003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:39.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0528004690 0x7f0528004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:39.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0528005070 0x7f052800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:39.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0bf5c0 con 0x7f0528004690 2023-08-17T17:53:39.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052800c010 con 0x7f0528003ac0 2023-08-17T17:53:39.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052800c1d0 con 0x7f0528005070 2023-08-17T17:53:39.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f054087e700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0528004690 0x7f0528004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:39.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f054107f700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0528003ac0 0x7f0528003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:39.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0541880700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0528005070 0x7f052800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:39.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f054087e700 1 -- 172.21.15.78:0/2023106617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0528005070 msgr2=0x7f052800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f054087e700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0528005070 0x7f052800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f054087e700 1 -- 172.21.15.78:0/2023106617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0528003ac0 msgr2=0x7f0528003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f054087e700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0528003ac0 0x7f0528003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f0541880700 1 -- 172.21.15.78:0/2023106617 reap_dead start 2023-08-17T17:53:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f054087e700 1 -- 172.21.15.78:0/2023106617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280033f0 con 0x7f0528004690 2023-08-17T17:53:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.621+0000 7f054087e700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0528004690 0x7f0528004b10 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f053c096920 tx=0x7f052c009060).ready entity=mon.0 client_cookie=66f1129e9e382f27 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.622+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c009430 con 0x7f0528004690 2023-08-17T17:53:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.622+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c009e70 con 0x7f0528004690 2023-08-17T17:53:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.622+0000 7f0533fff700 1 -- 172.21.15.78:0/2023106617 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00e850 con 0x7f0528004690 2023-08-17T17:53:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.622+0000 7f05432e3700 1 -- 172.21.15.78:0/2023106617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0528004690 msgr2=0x7f0528004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.622+0000 7f05432e3700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0528004690 0x7f0528004b10 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f053c096920 tx=0x7f052c009060).stop 2023-08-17T17:53:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.622+0000 7f05432e3700 1 -- 172.21.15.78:0/2023106617 shutdown_connections 2023-08-17T17:53:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.622+0000 7f05432e3700 1 --2- 172.21.15.78:0/2023106617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0528004690 0x7f0528004b10 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.622+0000 7f05432e3700 1 -- 172.21.15.78:0/2023106617 >> 172.21.15.78:0/2023106617 conn(0x7f053c062f80 msgr2=0x7f053c0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.622+0000 7f05432e3700 1 -- 172.21.15.78:0/2023106617 shutdown_connections 2023-08-17T17:53:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.622+0000 7f05432e3700 1 -- 172.21.15.78:0/2023106617 wait complete. 2023-08-17T17:53:39.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.623+0000 7f05432e3700 1 Processor -- start 2023-08-17T17:53:39.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.623+0000 7f05432e3700 1 -- start start 2023-08-17T17:53:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f05432e3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0528004690 0x7f053c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f05432e3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f053c0a9690 0x7f053c155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f05432e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f053c150490 0x7f053c150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f05432e3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0a9b90 con 0x7f053c150490 2023-08-17T17:53:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f05432e3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0a9e70 con 0x7f0528004690 2023-08-17T17:53:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f05432e3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0aa150 con 0x7f053c0a9690 2023-08-17T17:53:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f0541880700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f053c150490 0x7f053c150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f0541880700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f053c150490 0x7f053c150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45824/0 (socket says 172.21.15.78:45824) 2023-08-17T17:53:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f0541880700 1 -- 172.21.15.78:0/1325288328 learned_addr learned my addr 172.21.15.78:0/1325288328 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f054107f700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0528004690 0x7f053c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.624+0000 7f054087e700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f053c0a9690 0x7f053c155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f0541880700 1 -- 172.21.15.78:0/1325288328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f053c0a9690 msgr2=0x7f053c155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f0541880700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f053c0a9690 0x7f053c155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f0541880700 1 -- 172.21.15.78:0/1325288328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0528004690 msgr2=0x7f053c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f0541880700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0528004690 0x7f053c14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f0541880700 1 -- 172.21.15.78:0/1325288328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c0aa430 con 0x7f053c150490 2023-08-17T17:53:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f0541880700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f053c150490 0x7f053c150910 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f053c05e1e0 tx=0x7f0534007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f05317fa700 1 -- 172.21.15.78:0/1325288328 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053400f8a0 con 0x7f053c150490 2023-08-17T17:53:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f05317fa700 1 -- 172.21.15.78:0/1325288328 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053400fa00 con 0x7f053c150490 2023-08-17T17:53:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f05432e3700 1 -- 172.21.15.78:0/1325288328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c0aa710 con 0x7f053c150490 2023-08-17T17:53:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f05317fa700 1 -- 172.21.15.78:0/1325288328 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053400fda0 con 0x7f053c150490 2023-08-17T17:53:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.625+0000 7f05432e3700 1 -- 172.21.15.78:0/1325288328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c1558d0 con 0x7f053c150490 2023-08-17T17:53:39.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.626+0000 7f05432e3700 1 -- 172.21.15.78:0/1325288328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c0aa950 con 0x7f053c150490 2023-08-17T17:53:39.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.626+0000 7f05317fa700 1 -- 172.21.15.78:0/1325288328 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 63) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f053401b030 con 0x7f053c150490 2023-08-17T17:53:39.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.627+0000 7f05317fa700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f052005ecf0 0x7f05200611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:39.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.627+0000 7f05317fa700 1 -- 172.21.15.78:0/1325288328 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f0534079610 con 0x7f053c150490 2023-08-17T17:53:39.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.627+0000 7f054107f700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f052005ecf0 0x7f05200611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:39.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.627+0000 7f054107f700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f052005ecf0 0x7f05200611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f05380010e0 tx=0x7f0538007bb0).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:39.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.631+0000 7f05317fa700 1 -- 172.21.15.78:0/1325288328 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f053404aa70 con 0x7f053c150490 2023-08-17T17:53:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:39.792+0000 7f05432e3700 1 -- 172.21.15.78:0/1325288328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f053c0695e0 con 0x7f053c150490 2023-08-17T17:53:40.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.481+0000 7f05317fa700 1 -- 172.21.15.78:0/1325288328 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f05340773d0 con 0x7f053c150490 2023-08-17T17:53:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.488+0000 7f05317fa700 1 -- 172.21.15.78:0/1325288328 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v139) v1 ==== 181+0+0 (secure 0 0 0) 0x7f05340721e0 con 0x7f053c150490 2023-08-17T17:53:40.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 -- 172.21.15.78:0/1325288328 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f052005ecf0 msgr2=0x7f05200611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f052005ecf0 0x7f05200611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f05380010e0 tx=0x7f0538007bb0).stop 2023-08-17T17:53:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 -- 172.21.15.78:0/1325288328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f053c150490 msgr2=0x7f053c150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f053c150490 0x7f053c150910 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f053c05e1e0 tx=0x7f0534007f20).stop 2023-08-17T17:53:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 -- 172.21.15.78:0/1325288328 shutdown_connections 2023-08-17T17:53:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f052005ecf0 0x7f05200611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f053c150490 0x7f053c150910 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0528004690 0x7f053c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:40.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 --2- 172.21.15.78:0/1325288328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f053c0a9690 0x7f053c155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:40.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 -- 172.21.15.78:0/1325288328 >> 172.21.15.78:0/1325288328 conn(0x7f053c062f80 msgr2=0x7f053c0c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:40.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.491+0000 7f05432e3700 1 -- 172.21.15.78:0/1325288328 shutdown_connections 2023-08-17T17:53:40.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.492+0000 7f05432e3700 1 -- 172.21.15.78:0/1325288328 wait complete. 2023-08-17T17:53:40.494 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T17:53:40.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T17:53:40.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.622+0000 7f7f13321700 1 Processor -- start 2023-08-17T17:53:40.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.622+0000 7f7f13321700 1 -- start start 2023-08-17T17:53:40.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f13321700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7f0c151e20 0x7f7f0c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:40.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f13321700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0c157be0 0x7f7f0c158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:40.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f13321700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c158560 con 0x7f7f0c151a40 2023-08-17T17:53:40.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f13321700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c0c6620 con 0x7f7f0c151e20 2023-08-17T17:53:40.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f13321700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0c6900 con 0x7f7f0c157be0 2023-08-17T17:53:40.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1231f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7f0c151a40 0x7f7f0c0c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36170/0 (socket says 172.21.15.78:36170) 2023-08-17T17:53:40.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1231f700 1 -- 172.21.15.78:0/1566183 learned_addr learned my addr 172.21.15.78:0/1566183 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:40.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463930889 0 0) 0x7f7f0c158560 con 0x7f7f0c151a40 2023-08-17T17:53:40.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef80033f0 con 0x7f7f0c151a40 2023-08-17T17:53:40.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f12b20700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0c157be0 0x7f7f0c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:40.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f11b1e700 1 --2- 172.21.15.78:0/1566183 >> v2:172.21.15.150:3300/0 conn(0x7f7f0c151e20 0x7f7f0c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:40.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1912112102 0 0) 0x7f7ef80033f0 con 0x7f7f0c151a40 2023-08-17T17:53:40.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0c157be0 msgr2=0x7f7f0c158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:40.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0c157be0 0x7f7f0c158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:40.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 >> v2:172.21.15.150:3300/0 conn(0x7f7f0c151e20 msgr2=0x7f7f0c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:40.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 --2- 172.21.15.78:0/1566183 >> v2:172.21.15.150:3300/0 conn(0x7f7f0c151e20 0x7f7f0c0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:40.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c0c6be0 con 0x7f7f0c151a40 2023-08-17T17:53:40.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f7efc0015f0 con 0x7f7f0c151a40 2023-08-17T17:53:40.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f11b1e700 1 --2- 172.21.15.78:0/1566183 >> v2:172.21.15.150:3300/0 conn(0x7f7f0c151e20 0x7f7f0c0c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:40.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 >> v1:172.21.15.78:6789/0 conn(0x7f7f0c151a40 legacy=0x7f7f0c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:40.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef80038e0 0x7f7ef8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:40.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef8004690 0x7f7ef8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:40.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0c157be0 0x7f7ef8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:40.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0c6620 con 0x7f7ef80038e0 2023-08-17T17:53:40.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0c6900 con 0x7f7ef8004690 2023-08-17T17:53:40.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef800b8e0 con 0x7f7f0c157be0 2023-08-17T17:53:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f1231f700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef80038e0 0x7f7ef8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.623+0000 7f7f11b1e700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef8004690 0x7f7ef8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f12b20700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0c157be0 0x7f7ef8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f1231f700 1 -- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0c157be0 msgr2=0x7f7ef8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f1231f700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0c157be0 0x7f7ef8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f1231f700 1 -- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef8004690 msgr2=0x7f7ef8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f1231f700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef8004690 0x7f7ef8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f1231f700 1 -- 172.21.15.78:0/1566183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80033f0 con 0x7f7ef80038e0 2023-08-17T17:53:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f1231f700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef80038e0 0x7f7ef8003d00 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f7efc00c210 tx=0x7f7efc0077a0).ready entity=mon.0 client_cookie=3b55c1e10900ee33 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0079d0 con 0x7f7ef80038e0 2023-08-17T17:53:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc00ca80 con 0x7f7ef80038e0 2023-08-17T17:53:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f1131d700 1 -- 172.21.15.78:0/1566183 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00ce00 con 0x7f7ef80038e0 2023-08-17T17:53:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f13321700 1 -- 172.21.15.78:0/1566183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef80038e0 msgr2=0x7f7ef8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f13321700 1 --2- 172.21.15.78:0/1566183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef80038e0 0x7f7ef8003d00 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f7efc00c210 tx=0x7f7efc0077a0).stop 2023-08-17T17:53:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f12b20700 1 -- 172.21.15.78:0/1566183 reap_dead start 2023-08-17T17:53:40.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f13321700 1 -- 172.21.15.78:0/1566183 shutdown_connections 2023-08-17T17:53:40.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f13321700 1 -- 172.21.15.78:0/1566183 >> 172.21.15.78:0/1566183 conn(0x7f7f0c0943b0 msgr2=0x7f7f0c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:40.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f13321700 1 -- 172.21.15.78:0/1566183 shutdown_connections 2023-08-17T17:53:40.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.624+0000 7f7f13321700 1 -- 172.21.15.78:0/1566183 wait complete. 2023-08-17T17:53:40.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f13321700 1 Processor -- start 2023-08-17T17:53:40.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f13321700 1 -- start start 2023-08-17T17:53:40.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f13321700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef80038e0 0x7f7f0c0ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:40.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f13321700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f0c164e30 0x7f7f0c0c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:40.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f13321700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c0c17a0 0x7f7f0c154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f13321700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0aa810 con 0x7f7f0c164e30 2023-08-17T17:53:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f13321700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0ac8e0 con 0x7f7f0c0c17a0 2023-08-17T17:53:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f13321700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0acbc0 con 0x7f7ef80038e0 2023-08-17T17:53:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f11b1e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f0c164e30 0x7f7f0c0c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f11b1e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f0c164e30 0x7f7f0c0c12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45842/0 (socket says 172.21.15.78:45842) 2023-08-17T17:53:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.626+0000 7f7f11b1e700 1 -- 172.21.15.78:0/1422749862 learned_addr learned my addr 172.21.15.78:0/1422749862 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f12b20700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c0c17a0 0x7f7f0c154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f11b1e700 1 -- 172.21.15.78:0/1422749862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef80038e0 msgr2=0x7f7f0c0ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f1231f700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef80038e0 0x7f7f0c0ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f11b1e700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef80038e0 0x7f7f0c0ac350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f11b1e700 1 -- 172.21.15.78:0/1422749862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c0c17a0 msgr2=0x7f7f0c154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f11b1e700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c0c17a0 0x7f7f0c154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f11b1e700 1 -- 172.21.15.78:0/1422749862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c0acea0 con 0x7f7f0c164e30 2023-08-17T17:53:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f1231f700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef80038e0 0x7f7f0c0ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:40.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f12b20700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c0c17a0 0x7f7f0c154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:40.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f11b1e700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f0c164e30 0x7f7f0c0c12b0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f7f080109b0 tx=0x7f7f08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:40.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f027fc700 1 -- 172.21.15.78:0/1422749862 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800e8d0 con 0x7f7f0c164e30 2023-08-17T17:53:40.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f027fc700 1 -- 172.21.15.78:0/1422749862 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0800ea30 con 0x7f7f0c164e30 2023-08-17T17:53:40.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f13321700 1 -- 172.21.15.78:0/1422749862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c0ad180 con 0x7f7f0c164e30 2023-08-17T17:53:40.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f027fc700 1 -- 172.21.15.78:0/1422749862 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800edb0 con 0x7f7f0c164e30 2023-08-17T17:53:40.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.627+0000 7f7f13321700 1 -- 172.21.15.78:0/1422749862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c154b10 con 0x7f7f0c164e30 2023-08-17T17:53:40.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.628+0000 7f7f13321700 1 -- 172.21.15.78:0/1422749862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c082f90 con 0x7f7f0c164e30 2023-08-17T17:53:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.628+0000 7f7f027fc700 1 -- 172.21.15.78:0/1422749862 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7f08024070 con 0x7f7f0c164e30 2023-08-17T17:53:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.629+0000 7f7f027fc700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ef005ed90 0x7f7ef0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.629+0000 7f7f027fc700 1 -- 172.21.15.78:0/1422749862 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7f0807a390 con 0x7f7f0c164e30 2023-08-17T17:53:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.629+0000 7f7f1231f700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ef005ed90 0x7f7ef0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.629+0000 7f7f1231f700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ef005ed90 0x7f7ef0061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f7f0c05eab0 tx=0x7f7efc013000).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.633+0000 7f7f027fc700 1 -- 172.21.15.78:0/1422749862 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f0804b8b0 con 0x7f7f0c164e30 2023-08-17T17:53:40.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:40.799+0000 7f7f13321700 1 -- 172.21.15.78:0/1422749862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f0c05f910 con 0x7f7f0c164e30 2023-08-17T17:53:41.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.489+0000 7f7f027fc700 1 -- 172.21.15.78:0/1422749862 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v140) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7f08018020 con 0x7f7f0c164e30 2023-08-17T17:53:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 -- 172.21.15.78:0/1422749862 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ef005ed90 msgr2=0x7f7ef0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ef005ed90 0x7f7ef0061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f7f0c05eab0 tx=0x7f7efc013000).stop 2023-08-17T17:53:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 -- 172.21.15.78:0/1422749862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f0c164e30 msgr2=0x7f7f0c0c12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f0c164e30 0x7f7f0c0c12b0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f7f080109b0 tx=0x7f7f08008040).stop 2023-08-17T17:53:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 -- 172.21.15.78:0/1422749862 shutdown_connections 2023-08-17T17:53:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f7ef005ed90 0x7f7ef0061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0c0c17a0 0x7f7f0c154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef80038e0 0x7f7f0c0ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 --2- 172.21.15.78:0/1422749862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f0c164e30 0x7f7f0c0c12b0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 -- 172.21.15.78:0/1422749862 >> 172.21.15.78:0/1422749862 conn(0x7f7f0c0943b0 msgr2=0x7f7f0c0bfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:41.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 -- 172.21.15.78:0/1422749862 shutdown_connections 2023-08-17T17:53:41.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.491+0000 7f7f13321700 1 -- 172.21.15.78:0/1422749862 wait complete. 2023-08-17T17:53:41.494 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T17:53:41.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T17:53:41.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.621+0000 7f3333c8d700 1 Processor -- start 2023-08-17T17:53:41.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.621+0000 7f3333c8d700 1 -- start start 2023-08-17T17:53:41.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f3333c8d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f332c0aa0f0 0x7f332c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f3333c8d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f332c0c5810 0x7f332c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f3333c8d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c0649b0 con 0x7f332c0aa4d0 2023-08-17T17:53:41.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f3333c8d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0c6170 con 0x7f332c0aa0f0 2023-08-17T17:53:41.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f3333c8d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c063420 con 0x7f332c0c5810 2023-08-17T17:53:41.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f3331a29700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f332c0aa0f0 0x7f332c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f3331a29700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f332c0aa0f0 0x7f332c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45848/0 (socket says 172.21.15.78:45848) 2023-08-17T17:53:41.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f3331a29700 1 -- 172.21.15.78:0/4011802069 learned_addr learned my addr 172.21.15.78:0/4011802069 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:41.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f333222a700 1 --2- 172.21.15.78:0/4011802069 >> v2:172.21.15.150:3300/0 conn(0x7f332c0c5810 0x7f332c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f3331a29700 1 -- 172.21.15.78:0/4011802069 >> v2:172.21.15.150:3300/0 conn(0x7f332c0c5810 msgr2=0x7f332c0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:41.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.622+0000 7f3331a29700 1 --2- 172.21.15.78:0/4011802069 >> v2:172.21.15.150:3300/0 conn(0x7f332c0c5810 0x7f332c0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3331a29700 1 -- 172.21.15.78:0/4011802069 >> v1:172.21.15.150:6789/0 conn(0x7f332c0aa4d0 legacy=0x7f332c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3331a29700 1 -- 172.21.15.78:0/4011802069 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c063700 con 0x7f332c0aa0f0 2023-08-17T17:53:41.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3331a29700 1 --2- 172.21.15.78:0/4011802069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0aa0f0 0x7f332c0644c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f332c159090 tx=0x7f33280090f0).ready entity=mon.0 client_cookie=3c14dcd20b080ba1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:41.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3330a27700 1 -- 172.21.15.78:0/4011802069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332800b600 con 0x7f332c0aa0f0 2023-08-17T17:53:41.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3330a27700 1 -- 172.21.15.78:0/4011802069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332800b760 con 0x7f332c0aa0f0 2023-08-17T17:53:41.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3330a27700 1 -- 172.21.15.78:0/4011802069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332800bae0 con 0x7f332c0aa0f0 2023-08-17T17:53:41.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3333c8d700 1 -- 172.21.15.78:0/4011802069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0aa0f0 msgr2=0x7f332c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3333c8d700 1 --2- 172.21.15.78:0/4011802069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0aa0f0 0x7f332c0644c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f332c159090 tx=0x7f33280090f0).stop 2023-08-17T17:53:41.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3333c8d700 1 -- 172.21.15.78:0/4011802069 shutdown_connections 2023-08-17T17:53:41.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3333c8d700 1 --2- 172.21.15.78:0/4011802069 >> v2:172.21.15.150:3300/0 conn(0x7f332c0c5810 0x7f332c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3333c8d700 1 --2- 172.21.15.78:0/4011802069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0aa0f0 0x7f332c0644c0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3333c8d700 1 -- 172.21.15.78:0/4011802069 >> 172.21.15.78:0/4011802069 conn(0x7f332c06a6a0 msgr2=0x7f332c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:41.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3333c8d700 1 -- 172.21.15.78:0/4011802069 shutdown_connections 2023-08-17T17:53:41.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.623+0000 7f3333c8d700 1 -- 172.21.15.78:0/4011802069 wait complete. 2023-08-17T17:53:41.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.624+0000 7f3333c8d700 1 Processor -- start 2023-08-17T17:53:41.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.625+0000 7f3333c8d700 1 -- start start 2023-08-17T17:53:41.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.625+0000 7f3333c8d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f332c0aa0f0 0x7f332c0c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.625+0000 7f3333c8d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f332c0aa4d0 0x7f332c0c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.625+0000 7f3333c8d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0c5810 0x7f332c0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.625+0000 7f3333c8d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c144da0 con 0x7f332c0c5810 2023-08-17T17:53:41.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.625+0000 7f3333c8d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c141dc0 con 0x7f332c0aa4d0 2023-08-17T17:53:41.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.625+0000 7f3333c8d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c142900 con 0x7f332c0aa0f0 2023-08-17T17:53:41.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.625+0000 7f333222a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0c5810 0x7f332c0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.625+0000 7f333222a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0c5810 0x7f332c0c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45852/0 (socket says 172.21.15.78:45852) 2023-08-17T17:53:41.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.625+0000 7f333222a700 1 -- 172.21.15.78:0/1422986996 learned_addr learned my addr 172.21.15.78:0/1422986996 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:41.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f3331a29700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f332c0aa0f0 0x7f332c0c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f3331228700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f332c0aa4d0 0x7f332c0c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f333222a700 1 -- 172.21.15.78:0/1422986996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f332c0aa0f0 msgr2=0x7f332c0c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f333222a700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f332c0aa0f0 0x7f332c0c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f333222a700 1 -- 172.21.15.78:0/1422986996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f332c0aa4d0 msgr2=0x7f332c0c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f333222a700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f332c0aa4d0 0x7f332c0c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f333222a700 1 -- 172.21.15.78:0/1422986996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3328009370 con 0x7f332c0c5810 2023-08-17T17:53:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f333222a700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0c5810 0x7f332c0c78a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f3324007f20 tx=0x7f3324009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f3321ffb700 1 -- 172.21.15.78:0/1422986996 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400eca0 con 0x7f332c0c5810 2023-08-17T17:53:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f3321ffb700 1 -- 172.21.15.78:0/1422986996 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400ee00 con 0x7f332c0c5810 2023-08-17T17:53:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f3333c8d700 1 -- 172.21.15.78:0/1422986996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c141fd0 con 0x7f332c0c5810 2023-08-17T17:53:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f3321ffb700 1 -- 172.21.15.78:0/1422986996 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324014610 con 0x7f332c0c5810 2023-08-17T17:53:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.626+0000 7f3333c8d700 1 -- 172.21.15.78:0/1422986996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c142590 con 0x7f332c0c5810 2023-08-17T17:53:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.627+0000 7f3333c8d700 1 -- 172.21.15.78:0/1422986996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c142ab0 con 0x7f332c0c5810 2023-08-17T17:53:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.627+0000 7f3321ffb700 1 -- 172.21.15.78:0/1422986996 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f332401b030 con 0x7f332c0c5810 2023-08-17T17:53:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.628+0000 7f3321ffb700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f331005ed90 0x7f3310061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.628+0000 7f3321ffb700 1 -- 172.21.15.78:0/1422986996 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f3324079d20 con 0x7f332c0c5810 2023-08-17T17:53:41.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.628+0000 7f3331a29700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f331005ed90 0x7f3310061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.628+0000 7f3331a29700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f331005ed90 0x7f3310061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3328009130 tx=0x7f3328017000).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:41.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.632+0000 7f3321ffb700 1 -- 172.21.15.78:0/1422986996 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f332c142ab0 con 0x7f332c0c5810 2023-08-17T17:53:41.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.794+0000 7f3333c8d700 1 -- 172.21.15.78:0/1422986996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f332c142a70 con 0x7f332c0c5810 2023-08-17T17:53:41.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.798+0000 7f3321ffb700 1 -- 172.21.15.78:0/1422986996 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f332404b3e0 con 0x7f332c0c5810 2023-08-17T17:53:41.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 -- 172.21.15.78:0/1422986996 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f331005ed90 msgr2=0x7f3310061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f331005ed90 0x7f3310061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3328009130 tx=0x7f3328017000).stop 2023-08-17T17:53:41.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 -- 172.21.15.78:0/1422986996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0c5810 msgr2=0x7f332c0c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0c5810 0x7f332c0c78a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f3324007f20 tx=0x7f3324009860).stop 2023-08-17T17:53:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 -- 172.21.15.78:0/1422986996 shutdown_connections 2023-08-17T17:53:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f331005ed90 0x7f3310061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332c0c5810 0x7f332c0c78a0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f332c0aa0f0 0x7f332c0c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 --2- 172.21.15.78:0/1422986996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f332c0aa4d0 0x7f332c0c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 -- 172.21.15.78:0/1422986996 >> 172.21.15.78:0/1422986996 conn(0x7f332c06a6a0 msgr2=0x7f332c0a8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:41.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 -- 172.21.15.78:0/1422986996 shutdown_connections 2023-08-17T17:53:41.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.800+0000 7f3333c8d700 1 -- 172.21.15.78:0/1422986996 wait complete. 2023-08-17T17:53:41.812 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-17T17:53:41.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.925+0000 7fe35fca9700 1 Processor -- start 2023-08-17T17:53:41.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.926+0000 7fe35fca9700 1 -- start start 2023-08-17T17:53:41.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.926+0000 7fe35fca9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3581578f0 0x7fe3580be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.926+0000 7fe35fca9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3580bf0e0 0x7fe358095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.926+0000 7fe35fca9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe358096300 0x7fe358064330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.926+0000 7fe35fca9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580bf5c0 con 0x7fe358096300 2023-08-17T17:53:41.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.926+0000 7fe35fca9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580c32d0 con 0x7fe3581578f0 2023-08-17T17:53:41.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.926+0000 7fe35fca9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580967b0 con 0x7fe3580bf0e0 2023-08-17T17:53:41.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35e246700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe358096300 0x7fe358064330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35e246700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe358096300 0x7fe358064330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45854/0 (socket says 172.21.15.78:45854) 2023-08-17T17:53:41.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35e246700 1 -- 172.21.15.78:0/1157730797 learned_addr learned my addr 172.21.15.78:0/1157730797 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:41.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35da45700 1 --2- 172.21.15.78:0/1157730797 >> v2:172.21.15.150:3300/0 conn(0x7fe3581578f0 0x7fe3580be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35d244700 1 --2- 172.21.15.78:0/1157730797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3580bf0e0 0x7fe358095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35e246700 1 -- 172.21.15.78:0/1157730797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3580bf0e0 msgr2=0x7fe358095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35e246700 1 --2- 172.21.15.78:0/1157730797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3580bf0e0 0x7fe358095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35e246700 1 -- 172.21.15.78:0/1157730797 >> v2:172.21.15.150:3300/0 conn(0x7fe3581578f0 msgr2=0x7fe3580be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35e246700 1 --2- 172.21.15.78:0/1157730797 >> v2:172.21.15.150:3300/0 conn(0x7fe3581578f0 0x7fe3580be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35e246700 1 -- 172.21.15.78:0/1157730797 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580c3e10 con 0x7fe358096300 2023-08-17T17:53:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35da45700 1 --2- 172.21.15.78:0/1157730797 >> v2:172.21.15.150:3300/0 conn(0x7fe3581578f0 0x7fe3580be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:41.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35e246700 1 --2- 172.21.15.78:0/1157730797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 0x7fe358064330 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fe3580605b0 tx=0x7fe3500090f0).ready entity=mon.0 client_cookie=7a937d6b67d2098d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:41.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35ca43700 1 -- 172.21.15.78:0/1157730797 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000b600 con 0x7fe358096300 2023-08-17T17:53:41.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35ca43700 1 -- 172.21.15.78:0/1157730797 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35000b760 con 0x7fe358096300 2023-08-17T17:53:41.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.927+0000 7fe35ca43700 1 -- 172.21.15.78:0/1157730797 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000bae0 con 0x7fe358096300 2023-08-17T17:53:41.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.928+0000 7fe35fca9700 1 -- 172.21.15.78:0/1157730797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 msgr2=0x7fe358064330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.928+0000 7fe35fca9700 1 --2- 172.21.15.78:0/1157730797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 0x7fe358064330 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fe3580605b0 tx=0x7fe3500090f0).stop 2023-08-17T17:53:41.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.928+0000 7fe35fca9700 1 -- 172.21.15.78:0/1157730797 shutdown_connections 2023-08-17T17:53:41.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.928+0000 7fe35fca9700 1 --2- 172.21.15.78:0/1157730797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 0x7fe358064330 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.928+0000 7fe35fca9700 1 --2- 172.21.15.78:0/1157730797 >> v2:172.21.15.150:3300/0 conn(0x7fe3581578f0 0x7fe3580be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.928+0000 7fe35fca9700 1 --2- 172.21.15.78:0/1157730797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3580bf0e0 0x7fe358095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:41.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.928+0000 7fe35fca9700 1 -- 172.21.15.78:0/1157730797 >> 172.21.15.78:0/1157730797 conn(0x7fe358062f80 msgr2=0x7fe3580c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:41.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.928+0000 7fe35fca9700 1 -- 172.21.15.78:0/1157730797 shutdown_connections 2023-08-17T17:53:41.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.928+0000 7fe35fca9700 1 -- 172.21.15.78:0/1157730797 wait complete. 2023-08-17T17:53:41.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.929+0000 7fe35fca9700 1 Processor -- start 2023-08-17T17:53:41.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.929+0000 7fe35fca9700 1 -- start start 2023-08-17T17:53:41.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35fca9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 0x7fe3580a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35fca9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3580bf0e0 0x7fe358158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35fca9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3581578f0 0x7fe358158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35fca9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580a63f0 con 0x7fe358096300 2023-08-17T17:53:41.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35fca9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580a8d10 con 0x7fe3581578f0 2023-08-17T17:53:41.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35fca9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580a8b00 con 0x7fe3580bf0e0 2023-08-17T17:53:41.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35da45700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 0x7fe3580a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35da45700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 0x7fe3580a8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45856/0 (socket says 172.21.15.78:45856) 2023-08-17T17:53:41.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35da45700 1 -- 172.21.15.78:0/3836215778 learned_addr learned my addr 172.21.15.78:0/3836215778 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:41.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35da45700 1 -- 172.21.15.78:0/3836215778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3580bf0e0 msgr2=0x7fe358158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35da45700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3580bf0e0 0x7fe358158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:41.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35da45700 1 -- 172.21.15.78:0/3836215778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3581578f0 msgr2=0x7fe358158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:41.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35da45700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3581578f0 0x7fe358158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:41.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35da45700 1 -- 172.21.15.78:0/3836215778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe350009370 con 0x7fe358096300 2023-08-17T17:53:41.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35da45700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 0x7fe3580a8610 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7fe35400d180 tx=0x7fe3540099f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:41.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe34dffb700 1 -- 172.21.15.78:0/3836215778 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35400de20 con 0x7fe358096300 2023-08-17T17:53:41.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe34dffb700 1 -- 172.21.15.78:0/3836215778 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35400f040 con 0x7fe358096300 2023-08-17T17:53:41.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35fca9700 1 -- 172.21.15.78:0/3836215778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3580a6660 con 0x7fe358096300 2023-08-17T17:53:41.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe34dffb700 1 -- 172.21.15.78:0/3836215778 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354013600 con 0x7fe358096300 2023-08-17T17:53:41.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.930+0000 7fe35fca9700 1 -- 172.21.15.78:0/3836215778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3580c2920 con 0x7fe358096300 2023-08-17T17:53:41.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.931+0000 7fe35fca9700 1 -- 172.21.15.78:0/3836215778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3580c2b10 con 0x7fe358096300 2023-08-17T17:53:41.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.932+0000 7fe34dffb700 1 -- 172.21.15.78:0/3836215778 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe3540139f0 con 0x7fe358096300 2023-08-17T17:53:41.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.932+0000 7fe34dffb700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe33c05ed90 0x7fe33c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:41.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.932+0000 7fe34dffb700 1 -- 172.21.15.78:0/3836215778 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fe35407a200 con 0x7fe358096300 2023-08-17T17:53:41.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.932+0000 7fe35d244700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe33c05ed90 0x7fe33c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:41.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.932+0000 7fe35d244700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe33c05ed90 0x7fe33c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe3580962a0 tx=0x7fe348008040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:41.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:41.936+0000 7fe34dffb700 1 -- 172.21.15.78:0/3836215778 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe35404b810 con 0x7fe358096300 2023-08-17T17:53:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.101+0000 7fe35fca9700 1 -- 172.21.15.78:0/3836215778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe3580c34e0 con 0x7fe358096300 2023-08-17T17:53:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.104+0000 7fe34dffb700 1 -- 172.21.15.78:0/3836215778 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v29) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe35404ee30 con 0x7fe358096300 2023-08-17T17:53:42.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 -- 172.21.15.78:0/3836215778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe33c05ed90 msgr2=0x7fe33c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe33c05ed90 0x7fe33c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe3580962a0 tx=0x7fe348008040).stop 2023-08-17T17:53:42.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 -- 172.21.15.78:0/3836215778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 msgr2=0x7fe3580a8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 0x7fe3580a8610 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7fe35400d180 tx=0x7fe3540099f0).stop 2023-08-17T17:53:42.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 -- 172.21.15.78:0/3836215778 shutdown_connections 2023-08-17T17:53:42.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fe33c05ed90 0x7fe33c061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:42.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3581578f0 0x7fe358158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:42.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe358096300 0x7fe3580a8610 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:42.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 --2- 172.21.15.78:0/3836215778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3580bf0e0 0x7fe358158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:42.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 -- 172.21.15.78:0/3836215778 >> 172.21.15.78:0/3836215778 conn(0x7fe358062f80 msgr2=0x7fe3580c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:42.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 -- 172.21.15.78:0/3836215778 shutdown_connections 2023-08-17T17:53:42.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.106+0000 7fe35fca9700 1 -- 172.21.15.78:0/3836215778 wait complete. 2023-08-17T17:53:42.119 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-08-17T17:53:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.230+0000 7f19adc70700 1 Processor -- start 2023-08-17T17:53:42.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.230+0000 7f19adc70700 1 -- start start 2023-08-17T17:53:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.231+0000 7f19adc70700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f19a80a7bd0 0x7f19a8063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.231+0000 7f19adc70700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19a80a8050 0x7f19a80642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.231+0000 7f19adc70700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a8063960 con 0x7f19a80c01b0 2023-08-17T17:53:42.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.231+0000 7f19adc70700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a8063030 con 0x7f19a80a8050 2023-08-17T17:53:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.231+0000 7f19adc70700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a8063310 con 0x7f19a80a7bd0 2023-08-17T17:53:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.231+0000 7f19ad46f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19a80a8050 0x7f19a80642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.231+0000 7f19ad46f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19a80a8050 0x7f19a80642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45868/0 (socket says 172.21.15.78:45868) 2023-08-17T17:53:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.231+0000 7f19ad46f700 1 -- 172.21.15.78:0/1692888081 learned_addr learned my addr 172.21.15.78:0/1692888081 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19ad46f700 1 -- 172.21.15.78:0/1692888081 >> v2:172.21.15.150:3300/0 conn(0x7f19a80a7bd0 msgr2=0x7f19a8063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19ad46f700 1 --2- 172.21.15.78:0/1692888081 >> v2:172.21.15.150:3300/0 conn(0x7f19a80a7bd0 0x7f19a8063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19ad46f700 1 -- 172.21.15.78:0/1692888081 >> v1:172.21.15.150:6789/0 conn(0x7f19a80c01b0 legacy=0x7f19a80c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:42.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19ad46f700 1 -- 172.21.15.78:0/1692888081 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a80635f0 con 0x7f19a80a8050 2023-08-17T17:53:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19ad46f700 1 --2- 172.21.15.78:0/1692888081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 0x7f19a80642e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f19a8098d60 tx=0x7f19a0009840).ready entity=mon.0 client_cookie=5b6244da33a51aff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f199f7fe700 1 -- 172.21.15.78:0/1692888081 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a000e070 con 0x7f19a80a8050 2023-08-17T17:53:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f199f7fe700 1 -- 172.21.15.78:0/1692888081 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a000ba10 con 0x7f19a80a8050 2023-08-17T17:53:42.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f199f7fe700 1 -- 172.21.15.78:0/1692888081 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a000bd90 con 0x7f19a80a8050 2023-08-17T17:53:42.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19adc70700 1 -- 172.21.15.78:0/1692888081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 msgr2=0x7f19a80642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19adc70700 1 --2- 172.21.15.78:0/1692888081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 0x7f19a80642e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f19a8098d60 tx=0x7f19a0009840).stop 2023-08-17T17:53:42.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19adc70700 1 -- 172.21.15.78:0/1692888081 shutdown_connections 2023-08-17T17:53:42.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19adc70700 1 --2- 172.21.15.78:0/1692888081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 0x7f19a80642e0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:42.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19adc70700 1 --2- 172.21.15.78:0/1692888081 >> v2:172.21.15.150:3300/0 conn(0x7f19a80a7bd0 0x7f19a8063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:42.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19adc70700 1 -- 172.21.15.78:0/1692888081 >> 172.21.15.78:0/1692888081 conn(0x7f19a806a6c0 msgr2=0x7f19a80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:42.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19adc70700 1 -- 172.21.15.78:0/1692888081 shutdown_connections 2023-08-17T17:53:42.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.232+0000 7f19adc70700 1 -- 172.21.15.78:0/1692888081 wait complete. 2023-08-17T17:53:42.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.233+0000 7f19adc70700 1 Processor -- start 2023-08-17T17:53:42.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.234+0000 7f19adc70700 1 -- start start 2023-08-17T17:53:42.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.234+0000 7f19adc70700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a80a7bd0 0x7f19a814ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.234+0000 7f19adc70700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 0x7f19a80c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.234+0000 7f19adc70700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19a80c01b0 0x7f19a80c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.234+0000 7f19adc70700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a814cf40 con 0x7f19a80a8050 2023-08-17T17:53:42.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.234+0000 7f19adc70700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80c8150 con 0x7f19a80a7bd0 2023-08-17T17:53:42.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.234+0000 7f19adc70700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80b0b30 con 0x7f19a80c01b0 2023-08-17T17:53:42.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.234+0000 7f199ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 0x7f19a80c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:42.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.234+0000 7f199ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 0x7f19a80c7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45874/0 (socket says 172.21.15.78:45874) 2023-08-17T17:53:42.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.234+0000 7f199ffff700 1 -- 172.21.15.78:0/800852195 learned_addr learned my addr 172.21.15.78:0/800852195 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:42.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f19acc6e700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a80a7bd0 0x7f19a814ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:42.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f199ffff700 1 -- 172.21.15.78:0/800852195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19a80c01b0 msgr2=0x7f19a80c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f199ffff700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19a80c01b0 0x7f19a80c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:42.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f199ffff700 1 -- 172.21.15.78:0/800852195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a80a7bd0 msgr2=0x7f19a814ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f199ffff700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a80a7bd0 0x7f19a814ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:42.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f199ffff700 1 -- 172.21.15.78:0/800852195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0009ae0 con 0x7f19a80a8050 2023-08-17T17:53:42.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f199ffff700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 0x7f19a80c7770 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f199800b560 tx=0x7f19980090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:42.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f199cff9700 1 -- 172.21.15.78:0/800852195 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199800d4a0 con 0x7f19a80a8050 2023-08-17T17:53:42.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f199cff9700 1 -- 172.21.15.78:0/800852195 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199800d620 con 0x7f19a80a8050 2023-08-17T17:53:42.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f19adc70700 1 -- 172.21.15.78:0/800852195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a80aeb00 con 0x7f19a80a8050 2023-08-17T17:53:42.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f199cff9700 1 -- 172.21.15.78:0/800852195 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199800d9e0 con 0x7f19a80a8050 2023-08-17T17:53:42.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.235+0000 7f19adc70700 1 -- 172.21.15.78:0/800852195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a80affb0 con 0x7f19a80a8050 2023-08-17T17:53:42.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.236+0000 7f19adc70700 1 -- 172.21.15.78:0/800852195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a80b0ce0 con 0x7f19a80a8050 2023-08-17T17:53:42.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.236+0000 7f199cff9700 1 -- 172.21.15.78:0/800852195 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f199800f030 con 0x7f19a80a8050 2023-08-17T17:53:42.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.237+0000 7f199cff9700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f199405ed90 0x7f1994061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.237+0000 7f199cff9700 1 -- 172.21.15.78:0/800852195 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f1998079730 con 0x7f19a80a8050 2023-08-17T17:53:42.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.237+0000 7f19acc6e700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f199405ed90 0x7f1994061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:42.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.237+0000 7f19acc6e700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f199405ed90 0x7f1994061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f19a4006fd0 tx=0x7f19a4008040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:42.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.241+0000 7f199cff9700 1 -- 172.21.15.78:0/800852195 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f199804ae50 con 0x7f19a80a8050 2023-08-17T17:53:42.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.481+0000 7f19adc70700 1 -- 172.21.15.78:0/800852195 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f19a80c63e0 con 0x7f19a80a8050 2023-08-17T17:53:42.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.490+0000 7f199cff9700 1 -- 172.21.15.78:0/800852195 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v721) v1 ==== 174+0+0 (secure 0 0 0) 0x7f199804e470 con 0x7f19a80a8050 2023-08-17T17:53:42.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 -- 172.21.15.78:0/800852195 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f199405ed90 msgr2=0x7f1994061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f199405ed90 0x7f1994061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f19a4006fd0 tx=0x7f19a4008040).stop 2023-08-17T17:53:42.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 -- 172.21.15.78:0/800852195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 msgr2=0x7f19a80c7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 0x7f19a80c7770 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f199800b560 tx=0x7f19980090f0).stop 2023-08-17T17:53:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 -- 172.21.15.78:0/800852195 shutdown_connections 2023-08-17T17:53:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f199405ed90 0x7f1994061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19a80c01b0 0x7f19a80c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19a80a7bd0 0x7f19a814ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 --2- 172.21.15.78:0/800852195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a80a8050 0x7f19a80c7770 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 -- 172.21.15.78:0/800852195 >> 172.21.15.78:0/800852195 conn(0x7f19a806a6c0 msgr2=0x7f19a8153610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 -- 172.21.15.78:0/800852195 shutdown_connections 2023-08-17T17:53:42.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.492+0000 7f19adc70700 1 -- 172.21.15.78:0/800852195 wait complete. 2023-08-17T17:53:42.505 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-08-17T17:53:42.505 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-08-17T17:53:42.505 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-17T17:53:42.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-08-17T17:53:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.616+0000 7fdc7bd10700 1 Processor -- start 2023-08-17T17:53:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.617+0000 7fdc7bd10700 1 -- start start 2023-08-17T17:53:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.617+0000 7fdc7bd10700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc74062c00 0x7fdc74151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.617+0000 7fdc7bd10700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc740c6040 con 0x7fdc74066a40 2023-08-17T17:53:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.617+0000 7fdc7bd10700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc74069b00 con 0x7fdc74066660 2023-08-17T17:53:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.617+0000 7fdc7bd10700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc74069f90 con 0x7fdc74062c00 2023-08-17T17:53:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.617+0000 7fdc7a2ad700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc74062c00 0x7fdc74151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.617+0000 7fdc792ab700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdc74066a40 0x7fdc740624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36172/0 (socket says 172.21.15.78:36172) 2023-08-17T17:53:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.618+0000 7fdc792ab700 1 -- 172.21.15.78:0/4102957431 learned_addr learned my addr 172.21.15.78:0/4102957431 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.618+0000 7fdc78aaa700 1 -- 172.21.15.78:0/4102957431 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991382458 0 0) 0x7fdc64001110 con 0x7fdc74066a40 2023-08-17T17:53:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.618+0000 7fdc78aaa700 1 -- 172.21.15.78:0/4102957431 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc600033f0 con 0x7fdc74066a40 2023-08-17T17:53:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.618+0000 7fdc7a2ad700 1 -- 172.21.15.78:0/4102957431 >> v1:172.21.15.150:6789/0 conn(0x7fdc74066660 legacy=0x7fdc740c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.618+0000 7fdc7a2ad700 1 -- 172.21.15.78:0/4102957431 >> v1:172.21.15.78:6789/0 conn(0x7fdc74066a40 legacy=0x7fdc740624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.618+0000 7fdc7a2ad700 1 -- 172.21.15.78:0/4102957431 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc740c5d70 con 0x7fdc74062c00 2023-08-17T17:53:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.618+0000 7fdc7a2ad700 1 --2- 172.21.15.78:0/4102957431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74062c00 0x7fdc74151570 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fdc6c009e60 tx=0x7fdc6c009780).ready entity=mon.0 client_cookie=bdb0c0c0c7bd4a8e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.618+0000 7fdc78aaa700 1 -- 172.21.15.78:0/4102957431 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c00e070 con 0x7fdc74062c00 2023-08-17T17:53:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.618+0000 7fdc78aaa700 1 -- 172.21.15.78:0/4102957431 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c00bb60 con 0x7fdc74062c00 2023-08-17T17:53:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.618+0000 7fdc78aaa700 1 -- 172.21.15.78:0/4102957431 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c012410 con 0x7fdc74062c00 2023-08-17T17:53:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.619+0000 7fdc7bd10700 1 -- 172.21.15.78:0/4102957431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74062c00 msgr2=0x7fdc74151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.619+0000 7fdc7bd10700 1 --2- 172.21.15.78:0/4102957431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74062c00 0x7fdc74151570 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fdc6c009e60 tx=0x7fdc6c009780).stop 2023-08-17T17:53:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.619+0000 7fdc7bd10700 1 -- 172.21.15.78:0/4102957431 shutdown_connections 2023-08-17T17:53:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.619+0000 7fdc7bd10700 1 --2- 172.21.15.78:0/4102957431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74062c00 0x7fdc74151570 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.619+0000 7fdc7bd10700 1 -- 172.21.15.78:0/4102957431 >> 172.21.15.78:0/4102957431 conn(0x7fdc740c7b00 msgr2=0x7fdc740c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.619+0000 7fdc7bd10700 1 -- 172.21.15.78:0/4102957431 shutdown_connections 2023-08-17T17:53:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.619+0000 7fdc7bd10700 1 -- 172.21.15.78:0/4102957431 wait complete. 2023-08-17T17:53:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.620+0000 7fdc7bd10700 1 Processor -- start 2023-08-17T17:53:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.620+0000 7fdc7bd10700 1 -- start start 2023-08-17T17:53:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7bd10700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc74062c00 0x7fdc741517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7bd10700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc74066660 0x7fdc740a9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7bd10700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74066a40 0x7fdc740a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7bd10700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc740a9f40 con 0x7fdc74066a40 2023-08-17T17:53:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7bd10700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc740a7fb0 con 0x7fdc74062c00 2023-08-17T17:53:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7bd10700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc740a8440 con 0x7fdc74066660 2023-08-17T17:53:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7a2ad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74066a40 0x7fdc740a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7a2ad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74066a40 0x7fdc740a9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45900/0 (socket says 172.21.15.78:45900) 2023-08-17T17:53:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7a2ad700 1 -- 172.21.15.78:0/2878474350 learned_addr learned my addr 172.21.15.78:0/2878474350 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc79aac700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc74062c00 0x7fdc741517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc792ab700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc74066660 0x7fdc740a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7a2ad700 1 -- 172.21.15.78:0/2878474350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc74066660 msgr2=0x7fdc740a9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7a2ad700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc74066660 0x7fdc740a9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7a2ad700 1 -- 172.21.15.78:0/2878474350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc74062c00 msgr2=0x7fdc741517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7a2ad700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc74062c00 0x7fdc741517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7a2ad700 1 -- 172.21.15.78:0/2878474350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c009a20 con 0x7fdc74066a40 2023-08-17T17:53:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc792ab700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc74066660 0x7fdc740a9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7a2ad700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74066a40 0x7fdc740a9910 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fdc7405f3a0 tx=0x7fdc6c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc69ffb700 1 -- 172.21.15.78:0/2878474350 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c01c660 con 0x7fdc74066a40 2023-08-17T17:53:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc69ffb700 1 -- 172.21.15.78:0/2878474350 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c01c7c0 con 0x7fdc74066a40 2023-08-17T17:53:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc7bd10700 1 -- 172.21.15.78:0/2878474350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc740a7680 con 0x7fdc74066a40 2023-08-17T17:53:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.621+0000 7fdc69ffb700 1 -- 172.21.15.78:0/2878474350 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c01cb60 con 0x7fdc74066a40 2023-08-17T17:53:42.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.622+0000 7fdc7bd10700 1 -- 172.21.15.78:0/2878474350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc740a7c40 con 0x7fdc74066a40 2023-08-17T17:53:42.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.622+0000 7fdc7bd10700 1 -- 172.21.15.78:0/2878474350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc740a8120 con 0x7fdc74066a40 2023-08-17T17:53:42.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.623+0000 7fdc69ffb700 1 -- 172.21.15.78:0/2878474350 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdc6c027460 con 0x7fdc74066a40 2023-08-17T17:53:42.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.623+0000 7fdc69ffb700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc5805ed90 0x7fdc58061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:42.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.623+0000 7fdc69ffb700 1 -- 172.21.15.78:0/2878474350 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fdc6c07bc80 con 0x7fdc74066a40 2023-08-17T17:53:42.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.623+0000 7fdc79aac700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc5805ed90 0x7fdc58061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:42.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.623+0000 7fdc79aac700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc5805ed90 0x7fdc58061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdc70003920 tx=0x7fdc70000bc0).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:42.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.627+0000 7fdc69ffb700 1 -- 172.21.15.78:0/2878474350 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdc6c04d3f0 con 0x7fdc74066a40 2023-08-17T17:53:42.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:42.853+0000 7fdc7bd10700 1 -- 172.21.15.78:0/2878474350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7fdc74047350 con 0x7fdc74066a40 2023-08-17T17:53:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.495+0000 7fdc69ffb700 1 -- 172.21.15.78:0/2878474350 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v722) v1 ==== 168+0+0 (secure 0 0 0) 0x7fdc6c050a10 con 0x7fdc74066a40 2023-08-17T17:53:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 -- 172.21.15.78:0/2878474350 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc5805ed90 msgr2=0x7fdc58061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc5805ed90 0x7fdc58061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdc70003920 tx=0x7fdc70000bc0).stop 2023-08-17T17:53:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 -- 172.21.15.78:0/2878474350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74066a40 msgr2=0x7fdc740a9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74066a40 0x7fdc740a9910 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fdc7405f3a0 tx=0x7fdc6c009780).stop 2023-08-17T17:53:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 -- 172.21.15.78:0/2878474350 shutdown_connections 2023-08-17T17:53:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdc5805ed90 0x7fdc58061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc74066a40 0x7fdc740a9910 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc74062c00 0x7fdc741517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 --2- 172.21.15.78:0/2878474350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc74066660 0x7fdc740a9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 -- 172.21.15.78:0/2878474350 >> 172.21.15.78:0/2878474350 conn(0x7fdc740c7b00 msgr2=0x7fdc74152890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 -- 172.21.15.78:0/2878474350 shutdown_connections 2023-08-17T17:53:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.497+0000 7fdc7bd10700 1 -- 172.21.15.78:0/2878474350 wait complete. 2023-08-17T17:53:43.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T17:53:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.627+0000 7fedefdfc700 1 Processor -- start 2023-08-17T17:53:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.627+0000 7fedefdfc700 1 -- start start 2023-08-17T17:53:43.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.628+0000 7fedefdfc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fede80aa0f0 0x7fede80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:43.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.628+0000 7fedefdfc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fede80c5810 0x7fede80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:43.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.628+0000 7fedefdfc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede80649b0 con 0x7fede80aa4d0 2023-08-17T17:53:43.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.628+0000 7fedefdfc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede80c6170 con 0x7fede80c5810 2023-08-17T17:53:43.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.628+0000 7fedefdfc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede8063420 con 0x7fede80aa0f0 2023-08-17T17:53:43.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.628+0000 7fedee399700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fede80c5810 0x7fede80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:43.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.628+0000 7fedee399700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fede80c5810 0x7fede80c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45902/0 (socket says 172.21.15.78:45902) 2023-08-17T17:53:43.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.628+0000 7fedee399700 1 -- 172.21.15.78:0/3965664000 learned_addr learned my addr 172.21.15.78:0/3965664000 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:43.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fededb98700 1 --2- 172.21.15.78:0/3965664000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fede80aa0f0 0x7fede80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:43.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fedee399700 1 -- 172.21.15.78:0/3965664000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fede80aa0f0 msgr2=0x7fede80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:43.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fedee399700 1 --2- 172.21.15.78:0/3965664000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fede80aa0f0 0x7fede80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fedee399700 1 -- 172.21.15.78:0/3965664000 >> v1:172.21.15.150:6789/0 conn(0x7fede80aa4d0 legacy=0x7fede80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:43.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fedee399700 1 -- 172.21.15.78:0/3965664000 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede8063700 con 0x7fede80c5810 2023-08-17T17:53:43.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fedee399700 1 --2- 172.21.15.78:0/3965664000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80c5810 0x7fede80c5c80 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fede0009f20 tx=0x7fede0009840).ready entity=mon.0 client_cookie=2c93f40198a1fdf5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fedecb96700 1 -- 172.21.15.78:0/3965664000 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000e070 con 0x7fede80c5810 2023-08-17T17:53:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fedecb96700 1 -- 172.21.15.78:0/3965664000 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede000b9d0 con 0x7fede80c5810 2023-08-17T17:53:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fedecb96700 1 -- 172.21.15.78:0/3965664000 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000bd50 con 0x7fede80c5810 2023-08-17T17:53:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fedefdfc700 1 -- 172.21.15.78:0/3965664000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80c5810 msgr2=0x7fede80c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.629+0000 7fedefdfc700 1 --2- 172.21.15.78:0/3965664000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80c5810 0x7fede80c5c80 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fede0009f20 tx=0x7fede0009840).stop 2023-08-17T17:53:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.630+0000 7fedefdfc700 1 -- 172.21.15.78:0/3965664000 shutdown_connections 2023-08-17T17:53:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.630+0000 7fedefdfc700 1 --2- 172.21.15.78:0/3965664000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80c5810 0x7fede80c5c80 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.630+0000 7fedefdfc700 1 --2- 172.21.15.78:0/3965664000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fede80aa0f0 0x7fede80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.630+0000 7fedefdfc700 1 -- 172.21.15.78:0/3965664000 >> 172.21.15.78:0/3965664000 conn(0x7fede806a6a0 msgr2=0x7fede80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.630+0000 7fedefdfc700 1 -- 172.21.15.78:0/3965664000 shutdown_connections 2023-08-17T17:53:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.630+0000 7fedefdfc700 1 -- 172.21.15.78:0/3965664000 wait complete. 2023-08-17T17:53:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.631+0000 7fedefdfc700 1 Processor -- start 2023-08-17T17:53:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.631+0000 7fedefdfc700 1 -- start start 2023-08-17T17:53:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.631+0000 7fedefdfc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fede80aa0f0 0x7fede814f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.631+0000 7fedefdfc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80aa4d0 0x7fede80c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.631+0000 7fedefdfc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fede80c5810 0x7fede80c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.631+0000 7fedefdfc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede80c8380 con 0x7fede80aa4d0 2023-08-17T17:53:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.631+0000 7fedefdfc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede8155c20 con 0x7fede80c5810 2023-08-17T17:53:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7fedefdfc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede80ad830 con 0x7fede80aa0f0 2023-08-17T17:53:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7feded397700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80aa4d0 0x7fede80c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7feded397700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80aa4d0 0x7fede80c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45906/0 (socket says 172.21.15.78:45906) 2023-08-17T17:53:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7feded397700 1 -- 172.21.15.78:0/2465326250 learned_addr learned my addr 172.21.15.78:0/2465326250 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7fededb98700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fede80aa0f0 0x7fede814f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7fedee399700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fede80c5810 0x7fede80c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7feded397700 1 -- 172.21.15.78:0/2465326250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fede80aa0f0 msgr2=0x7fede814f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:43.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7feded397700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fede80aa0f0 0x7fede814f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7feded397700 1 -- 172.21.15.78:0/2465326250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fede80c5810 msgr2=0x7fede80c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7feded397700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fede80c5810 0x7fede80c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7feded397700 1 -- 172.21.15.78:0/2465326250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0009ae0 con 0x7fede80aa4d0 2023-08-17T17:53:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7feded397700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80aa4d0 0x7fede80c79a0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fedd800c4c0 tx=0x7fedd8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7fedddffb700 1 -- 172.21.15.78:0/2465326250 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd800ce60 con 0x7fede80aa4d0 2023-08-17T17:53:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7fedddffb700 1 -- 172.21.15.78:0/2465326250 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd8007020 con 0x7fede80aa4d0 2023-08-17T17:53:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7fedefdfc700 1 -- 172.21.15.78:0/2465326250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede8156780 con 0x7fede80aa4d0 2023-08-17T17:53:43.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7fedddffb700 1 -- 172.21.15.78:0/2465326250 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd80073c0 con 0x7fede80aa4d0 2023-08-17T17:53:43.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.632+0000 7fedefdfc700 1 -- 172.21.15.78:0/2465326250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede814f8a0 con 0x7fede80aa4d0 2023-08-17T17:53:43.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.633+0000 7fedefdfc700 1 -- 172.21.15.78:0/2465326250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede8156910 con 0x7fede80aa4d0 2023-08-17T17:53:43.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.633+0000 7fedddffb700 1 -- 172.21.15.78:0/2465326250 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fedd8010070 con 0x7fede80aa4d0 2023-08-17T17:53:43.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.634+0000 7fedddffb700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedcc05ed90 0x7fedcc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:43.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.634+0000 7fedddffb700 1 -- 172.21.15.78:0/2465326250 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fedd8078b10 con 0x7fede80aa4d0 2023-08-17T17:53:43.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.634+0000 7fededb98700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedcc05ed90 0x7fedcc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:43.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.634+0000 7fededb98700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedcc05ed90 0x7fedcc061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fede4009c30 tx=0x7fede4009060).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:43.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.638+0000 7fedddffb700 1 -- 172.21.15.78:0/2465326250 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fedd80478f0 con 0x7fede80aa4d0 2023-08-17T17:53:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.801+0000 7fedefdfc700 1 -- 172.21.15.78:0/2465326250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fede8083980 con 0x7fede80aa4d0 2023-08-17T17:53:43.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.805+0000 7fedddffb700 1 -- 172.21.15.78:0/2465326250 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fedd804a230 con 0x7fede80aa4d0 2023-08-17T17:53:43.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 -- 172.21.15.78:0/2465326250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedcc05ed90 msgr2=0x7fedcc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:43.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedcc05ed90 0x7fedcc061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fede4009c30 tx=0x7fede4009060).stop 2023-08-17T17:53:43.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 -- 172.21.15.78:0/2465326250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80aa4d0 msgr2=0x7fede80c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:43.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80aa4d0 0x7fede80c79a0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fedd800c4c0 tx=0x7fedd8007dd0).stop 2023-08-17T17:53:43.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 -- 172.21.15.78:0/2465326250 shutdown_connections 2023-08-17T17:53:43.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedcc05ed90 0x7fedcc061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fede80c5810 0x7fede80c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fede80aa0f0 0x7fede814f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 --2- 172.21.15.78:0/2465326250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede80aa4d0 0x7fede80c79a0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:43.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 -- 172.21.15.78:0/2465326250 >> 172.21.15.78:0/2465326250 conn(0x7fede806a6a0 msgr2=0x7fede8152f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:43.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 -- 172.21.15.78:0/2465326250 shutdown_connections 2023-08-17T17:53:43.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:43.807+0000 7fedefdfc700 1 -- 172.21.15.78:0/2465326250 wait complete. 2023-08-17T17:53:43.820 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T17:53:43.820 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:53:43.859 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T17:53:43.904 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T17:53:43.904 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T17:53:43.904 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:44.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.015+0000 7f7902340700 1 Processor -- start 2023-08-17T17:53:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.015+0000 7f7902340700 1 -- start start 2023-08-17T17:53:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.016+0000 7f7902340700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78fc0a7fe0 0x7f78fc064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.016+0000 7f7902340700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f78fc0bef00 0x7f78fc0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.016+0000 7f7902340700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc0c4040 con 0x7f78fc065140 2023-08-17T17:53:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.016+0000 7f7902340700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc0c7080 con 0x7f78fc0bef00 2023-08-17T17:53:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.016+0000 7f7902340700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c3430 con 0x7f78fc0a7fe0 2023-08-17T17:53:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.016+0000 7f78fb7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f78fc065140 0x7f78fc0be7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36174/0 (socket says 172.21.15.78:36174) 2023-08-17T17:53:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.016+0000 7f78fb7fe700 1 -- 172.21.15.78:0/1151922700 learned_addr learned my addr 172.21.15.78:0/1151922700 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78fbfff700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78fc0a7fe0 0x7f78fc064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f79008dd700 1 --2- 172.21.15.78:0/1151922700 >> v2:172.21.15.150:3300/0 conn(0x7f78fc0bef00 0x7f78fc0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244410925 0 0) 0x7f78fc0c4040 con 0x7f78fc065140 2023-08-17T17:53:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e40033f0 con 0x7f78fc065140 2023-08-17T17:53:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1944439248 0 0) 0x7f78e40033f0 con 0x7f78fc065140 2023-08-17T17:53:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78fc0a7fe0 msgr2=0x7f78fc064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78fc0a7fe0 0x7f78fc064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 >> v2:172.21.15.150:3300/0 conn(0x7f78fc0bef00 msgr2=0x7f78fc0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 --2- 172.21.15.78:0/1151922700 >> v2:172.21.15.150:3300/0 conn(0x7f78fc0bef00 0x7f78fc0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0c3710 con 0x7f78fc065140 2023-08-17T17:53:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f78f0001470 con 0x7f78fc065140 2023-08-17T17:53:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 >> v1:172.21.15.78:6789/0 conn(0x7f78fc065140 legacy=0x7f78fc0be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78fc0a7fe0 0x7f78e40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e4003e10 0x7f78e4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78e4004b80 0x7f78e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c7080 con 0x7f78e4003e10 2023-08-17T17:53:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c3430 con 0x7f78e4004b80 2023-08-17T17:53:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e400b8e0 con 0x7f78fc0a7fe0 2023-08-17T17:53:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78fb7fe700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e4003e10 0x7f78e4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78fbfff700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78fc0a7fe0 0x7f78e40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f79008dd700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78e4004b80 0x7f78e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78fb7fe700 1 -- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78fc0a7fe0 msgr2=0x7f78e40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78fb7fe700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78fc0a7fe0 0x7f78e40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78fb7fe700 1 -- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78e4004b80 msgr2=0x7f78e4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78fb7fe700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78e4004b80 0x7f78e4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f78fb7fe700 1 -- 172.21.15.78:0/1151922700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e40033f0 con 0x7f78e4003e10 2023-08-17T17:53:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.017+0000 7f79008dd700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78e4004b80 0x7f78e4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f78fb7fe700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e4003e10 0x7f78e4004690 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f78f000c210 tx=0x7f78f0001e90).ready entity=mon.0 client_cookie=c674339ed404635e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0007a60 con 0x7f78e4003e10 2023-08-17T17:53:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f000caa0 con 0x7f78e4003e10 2023-08-17T17:53:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f78faffd700 1 -- 172.21.15.78:0/1151922700 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f000ce20 con 0x7f78e4003e10 2023-08-17T17:53:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f7902340700 1 -- 172.21.15.78:0/1151922700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e4003e10 msgr2=0x7f78e4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f7902340700 1 --2- 172.21.15.78:0/1151922700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e4003e10 0x7f78e4004690 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f78f000c210 tx=0x7f78f0001e90).stop 2023-08-17T17:53:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f79008dd700 1 -- 172.21.15.78:0/1151922700 reap_dead start 2023-08-17T17:53:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f7902340700 1 -- 172.21.15.78:0/1151922700 shutdown_connections 2023-08-17T17:53:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f7902340700 1 -- 172.21.15.78:0/1151922700 >> 172.21.15.78:0/1151922700 conn(0x7f78fc092330 msgr2=0x7f78fc062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f7902340700 1 -- 172.21.15.78:0/1151922700 shutdown_connections 2023-08-17T17:53:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.018+0000 7f7902340700 1 -- 172.21.15.78:0/1151922700 wait complete. 2023-08-17T17:53:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.019+0000 7f7902340700 1 Processor -- start 2023-08-17T17:53:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.019+0000 7f7902340700 1 -- start start 2023-08-17T17:53:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f7902340700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78e4003e10 0x7f78fc0c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f7902340700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78fc14de90 0x7f78fc0675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f7902340700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78fc14e310 0x7f78fc067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f7902340700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0abc20 con 0x7f78fc14e310 2023-08-17T17:53:44.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f7902340700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc067fc0 con 0x7f78fc14de90 2023-08-17T17:53:44.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f7902340700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0ac170 con 0x7f78e4003e10 2023-08-17T17:53:44.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f79008dd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78fc14e310 0x7f78fc067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f79008dd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78fc14e310 0x7f78fc067ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45918/0 (socket says 172.21.15.78:45918) 2023-08-17T17:53:44.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f79008dd700 1 -- 172.21.15.78:0/641664023 learned_addr learned my addr 172.21.15.78:0/641664023 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f78fbfff700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78e4003e10 0x7f78fc0c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.020+0000 7f78fb7fe700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78fc14de90 0x7f78fc0675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f79008dd700 1 -- 172.21.15.78:0/641664023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78e4003e10 msgr2=0x7f78fc0c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f79008dd700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78e4003e10 0x7f78fc0c1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f79008dd700 1 -- 172.21.15.78:0/641664023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78fc14de90 msgr2=0x7f78fc0675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f79008dd700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78fc14de90 0x7f78fc0675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f79008dd700 1 -- 172.21.15.78:0/641664023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0c2710 con 0x7f78fc14e310 2023-08-17T17:53:44.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f79008dd700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78fc14e310 0x7f78fc067ad0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f78fc0692c0 tx=0x7f78f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:44.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f78e3fff700 1 -- 172.21.15.78:0/641664023 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400e030 con 0x7f78fc14e310 2023-08-17T17:53:44.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f78e3fff700 1 -- 172.21.15.78:0/641664023 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f4011d00 con 0x7f78fc14e310 2023-08-17T17:53:44.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f78e3fff700 1 -- 172.21.15.78:0/641664023 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4009b70 con 0x7f78fc14e310 2023-08-17T17:53:44.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f7902340700 1 -- 172.21.15.78:0/641664023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc0c29f0 con 0x7f78fc14e310 2023-08-17T17:53:44.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.021+0000 7f7902340700 1 -- 172.21.15.78:0/641664023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc0c2370 con 0x7f78fc14e310 2023-08-17T17:53:44.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.022+0000 7f7902340700 1 -- 172.21.15.78:0/641664023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc0c2be0 con 0x7f78fc14e310 2023-08-17T17:53:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.022+0000 7f78e3fff700 1 -- 172.21.15.78:0/641664023 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f78f40158f0 con 0x7f78fc14e310 2023-08-17T17:53:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.022+0000 7f78e3fff700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ed90 0x7f78e8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.023+0000 7f78e3fff700 1 -- 172.21.15.78:0/641664023 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f78f400f070 con 0x7f78fc14e310 2023-08-17T17:53:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.023+0000 7f78fbfff700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ed90 0x7f78e8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.023+0000 7f78fbfff700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ed90 0x7f78e8061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f78ec006c40 tx=0x7f78ec008040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.026+0000 7f78e3fff700 1 -- 172.21.15.78:0/641664023 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78f404bb60 con 0x7f78fc14e310 2023-08-17T17:53:44.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.228+0000 7f7902340700 1 -- 172.21.15.78:0/641664023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78fc0c39f0 con 0x7f78fc14e310 2023-08-17T17:53:44.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.228+0000 7f78e3fff700 1 -- 172.21.15.78:0/641664023 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f78f404f180 con 0x7f78fc14e310 2023-08-17T17:53:44.230 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:44.230 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2182410743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2182410743},{"type":"v1","addr":"172.21.15.150:6833","nonce":2182410743}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/4059280185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4059280185},{"type":"v1","addr":"172.21.15.150:6835","nonce":4059280185}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4209580844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4209580844},{"type":"v1","addr":"172.21.15.78:6837","nonce":4209580844}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8106,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/984792555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":984792555},{"type":"v1","addr":"172.21.15.78:6836","nonce":984792555}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[]} 2023-08-17T17:53:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 -- 172.21.15.78:0/641664023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ed90 msgr2=0x7f78e8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ed90 0x7f78e8061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f78ec006c40 tx=0x7f78ec008040).stop 2023-08-17T17:53:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 -- 172.21.15.78:0/641664023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78fc14e310 msgr2=0x7f78fc067ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78fc14e310 0x7f78fc067ad0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f78fc0692c0 tx=0x7f78f400b040).stop 2023-08-17T17:53:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 -- 172.21.15.78:0/641664023 shutdown_connections 2023-08-17T17:53:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f78e805ed90 0x7f78e8061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78fc14e310 0x7f78fc067ad0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78e4003e10 0x7f78fc0c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 --2- 172.21.15.78:0/641664023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78fc14de90 0x7f78fc0675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 -- 172.21.15.78:0/641664023 >> 172.21.15.78:0/641664023 conn(0x7f78fc092330 msgr2=0x7f78fc0c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:44.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 -- 172.21.15.78:0/641664023 shutdown_connections 2023-08-17T17:53:44.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.230+0000 7f7902340700 1 -- 172.21.15.78:0/641664023 wait complete. 2023-08-17T17:53:44.233 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 51 2023-08-17T17:53:44.243 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T17:53:44.243 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T17:53:44.244 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T17:53:44.244 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:53:44.244 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T17:53:44.244 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T17:53:44.245 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T17:53:44.245 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:53:44.245 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T17:53:44.245 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T17:53:44.246 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T17:53:44.246 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:53:44.246 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T17:53:44.246 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T17:53:44.247 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T17:53:44.247 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T17:53:44.254 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T17:53:44.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T17:53:44.255 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T17:53:44.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T17:53:44.257 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T17:53:44.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T17:53:44.258 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T17:53:44.258 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T17:53:44.296 INFO:tasks.ceph.mds.a:Started 2023-08-17T17:53:44.296 DEBUG:teuthology.parallel:result is None 2023-08-17T17:53:44.297 INFO:tasks.ceph.mds.c:Started 2023-08-17T17:53:44.297 DEBUG:teuthology.parallel:result is None 2023-08-17T17:53:44.299 INFO:tasks.ceph.mds.b:Started 2023-08-17T17:53:44.299 DEBUG:teuthology.parallel:result is None 2023-08-17T17:53:44.300 INFO:tasks.ceph.mds.d:Started 2023-08-17T17:53:44.300 DEBUG:teuthology.parallel:result is None 2023-08-17T17:53:44.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T17:53:44.368 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T17:53:44.368 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T17:53:44.382 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T17:53:44.382 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T17:53:44.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.428+0000 7f5c54fc7700 1 Processor -- start 2023-08-17T17:53:44.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.428+0000 7f5c54fc7700 1 -- start start 2023-08-17T17:53:44.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.429+0000 7f5c54fc7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50153f80 0x7f5c500a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.429+0000 7f5c54fc7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c500c9ca0 con 0x7f5c500cb890 2023-08-17T17:53:44.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.429+0000 7f5c54fc7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c500c96b0 con 0x7f5c500c0e30 2023-08-17T17:53:44.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.429+0000 7f5c54fc7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c500c0080 con 0x7f5c50153f80 2023-08-17T17:53:44.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.429+0000 7f5c4effd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5c500cb890 0x7f5c500c0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36196/0 (socket says 172.21.15.78:36196) 2023-08-17T17:53:44.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.429+0000 7f5c4effd700 1 -- 172.21.15.78:0/1432110969 learned_addr learned my addr 172.21.15.78:0/1432110969 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:44.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.429+0000 7f5c4f7fe700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50153f80 0x7f5c500a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.429+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836405468 0 0) 0x7f5c500c9ca0 con 0x7f5c500cb890 2023-08-17T17:53:44.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.429+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c380033f0 con 0x7f5c500cb890 2023-08-17T17:53:44.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279679894 0 0) 0x7f5c380033f0 con 0x7f5c500cb890 2023-08-17T17:53:44.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50153f80 msgr2=0x7f5c500a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:44.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50153f80 0x7f5c500a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 >> v1:172.21.15.150:6789/0 conn(0x7f5c500c0e30 legacy=0x7f5c500ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c500c0360 con 0x7f5c500cb890 2023-08-17T17:53:44.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f5c44001470 con 0x7f5c500cb890 2023-08-17T17:53:44.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 >> v1:172.21.15.78:6789/0 conn(0x7f5c500cb890 legacy=0x7f5c500c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 0x7f5c38003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50153f80 0x7f5c38004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38004b80 0x7f5c38005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c500c0080 con 0x7f5c38003910 2023-08-17T17:53:44.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3800b910 con 0x7f5c38004b80 2023-08-17T17:53:44.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3800bad0 con 0x7f5c50153f80 2023-08-17T17:53:44.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4f7fe700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 0x7f5c38003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4effd700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50153f80 0x7f5c38004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4ffff700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38004b80 0x7f5c38005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4f7fe700 1 -- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50153f80 msgr2=0x7f5c38004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:44.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4f7fe700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c50153f80 0x7f5c38004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4f7fe700 1 -- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38004b80 msgr2=0x7f5c38005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:44.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4f7fe700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38004b80 0x7f5c38005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4f7fe700 1 -- 172.21.15.78:0/1432110969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c380033f0 con 0x7f5c38003910 2023-08-17T17:53:44.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4ffff700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38004b80 0x7f5c38005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:44.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4f7fe700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 0x7f5c38003d30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f5c4000e210 tx=0x7f5c4000b040).ready entity=mon.0 client_cookie=4f8a3b3fba47f70a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:44.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40009b10 con 0x7f5c38003910 2023-08-17T17:53:44.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000f040 con 0x7f5c38003910 2023-08-17T17:53:44.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.430+0000 7f5c4e7fc700 1 -- 172.21.15.78:0/1432110969 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000ece0 con 0x7f5c38003910 2023-08-17T17:53:44.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.431+0000 7f5c54fc7700 1 -- 172.21.15.78:0/1432110969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 msgr2=0x7f5c38003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.431+0000 7f5c54fc7700 1 --2- 172.21.15.78:0/1432110969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 0x7f5c38003d30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f5c4000e210 tx=0x7f5c4000b040).stop 2023-08-17T17:53:44.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.431+0000 7f5c4ffff700 1 -- 172.21.15.78:0/1432110969 reap_dead start 2023-08-17T17:53:44.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.431+0000 7f5c54fc7700 1 -- 172.21.15.78:0/1432110969 shutdown_connections 2023-08-17T17:53:44.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.431+0000 7f5c54fc7700 1 -- 172.21.15.78:0/1432110969 >> 172.21.15.78:0/1432110969 conn(0x7f5c5006a400 msgr2=0x7f5c500cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:44.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.431+0000 7f5c54fc7700 1 -- 172.21.15.78:0/1432110969 shutdown_connections 2023-08-17T17:53:44.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.431+0000 7f5c54fc7700 1 -- 172.21.15.78:0/1432110969 wait complete. 2023-08-17T17:53:44.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.432+0000 7f5c54fc7700 1 Processor -- start 2023-08-17T17:53:44.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.432+0000 7f5c54fc7700 1 -- start start 2023-08-17T17:53:44.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c54fc7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 0x7f5c5014fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c54fc7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c501500f0 0x7f5c500c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c54fc7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c501505d0 0x7f5c500c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c54fc7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c500c4970 con 0x7f5c38003910 2023-08-17T17:53:44.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c54fc7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c501586c0 con 0x7f5c501500f0 2023-08-17T17:53:44.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c54fc7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c501594e0 con 0x7f5c501505d0 2023-08-17T17:53:44.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c4f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 0x7f5c5014fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c4f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 0x7f5c5014fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45974/0 (socket says 172.21.15.78:45974) 2023-08-17T17:53:44.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c4f7fe700 1 -- 172.21.15.78:0/3948422926 learned_addr learned my addr 172.21.15.78:0/3948422926 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:44.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c4effd700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c501500f0 0x7f5c500c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c4ffff700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c501505d0 0x7f5c500c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c4f7fe700 1 -- 172.21.15.78:0/3948422926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c501505d0 msgr2=0x7f5c500c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c4f7fe700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c501505d0 0x7f5c500c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c4f7fe700 1 -- 172.21.15.78:0/3948422926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c501500f0 msgr2=0x7f5c500c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:44.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c4f7fe700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c501500f0 0x7f5c500c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:44.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.433+0000 7f5c4f7fe700 1 -- 172.21.15.78:0/3948422926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c501588d0 con 0x7f5c38003910 2023-08-17T17:53:44.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.434+0000 7f5c4f7fe700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 0x7f5c5014fc00 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f5c4000e800 tx=0x7f5c4001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:44.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.434+0000 7f5c377fe700 1 -- 172.21.15.78:0/3948422926 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40013b80 con 0x7f5c38003910 2023-08-17T17:53:44.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.434+0000 7f5c377fe700 1 -- 172.21.15.78:0/3948422926 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c40013d00 con 0x7f5c38003910 2023-08-17T17:53:44.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.434+0000 7f5c54fc7700 1 -- 172.21.15.78:0/3948422926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c50158bb0 con 0x7f5c38003910 2023-08-17T17:53:44.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.434+0000 7f5c377fe700 1 -- 172.21.15.78:0/3948422926 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c400266c0 con 0x7f5c38003910 2023-08-17T17:53:44.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.434+0000 7f5c54fc7700 1 -- 172.21.15.78:0/3948422926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c50159170 con 0x7f5c38003910 2023-08-17T17:53:44.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.435+0000 7f5c54fc7700 1 -- 172.21.15.78:0/3948422926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c50155270 con 0x7f5c38003910 2023-08-17T17:53:44.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.435+0000 7f5c377fe700 1 -- 172.21.15.78:0/3948422926 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5c40026a30 con 0x7f5c38003910 2023-08-17T17:53:44.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.435+0000 7f5c377fe700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3c05ed90 0x7f5c3c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:44.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.435+0000 7f5c377fe700 1 -- 172.21.15.78:0/3948422926 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f5c4007baf0 con 0x7f5c38003910 2023-08-17T17:53:44.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.435+0000 7f5c4effd700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3c05ed90 0x7f5c3c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:44.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.436+0000 7f5c4effd700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3c05ed90 0x7f5c3c061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5c440015a0 tx=0x7f5c44009040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:44.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.439+0000 7f5c377fe700 1 -- 172.21.15.78:0/3948422926 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c4004d210 con 0x7f5c38003910 2023-08-17T17:53:44.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:44.618+0000 7f5c54fc7700 1 -- 172.21.15.78:0/3948422926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5c50065230 con 0x7f5c38003910 2023-08-17T17:53:45.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.506+0000 7f5c377fe700 1 -- 172.21.15.78:0/3948422926 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v145) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5c40050830 con 0x7f5c38003910 2023-08-17T17:53:45.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 -- 172.21.15.78:0/3948422926 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3c05ed90 msgr2=0x7f5c3c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:45.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3c05ed90 0x7f5c3c061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5c440015a0 tx=0x7f5c44009040).stop 2023-08-17T17:53:45.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 -- 172.21.15.78:0/3948422926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 msgr2=0x7f5c5014fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:45.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 0x7f5c5014fc00 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f5c4000e800 tx=0x7f5c4001a000).stop 2023-08-17T17:53:45.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 -- 172.21.15.78:0/3948422926 shutdown_connections 2023-08-17T17:53:45.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5c3c05ed90 0x7f5c3c061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c501505d0 0x7f5c500c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38003910 0x7f5c5014fc00 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 --2- 172.21.15.78:0/3948422926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c501500f0 0x7f5c500c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 -- 172.21.15.78:0/3948422926 >> 172.21.15.78:0/3948422926 conn(0x7f5c5006a400 msgr2=0x7f5c500c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:45.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 -- 172.21.15.78:0/3948422926 shutdown_connections 2023-08-17T17:53:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.509+0000 7f5c54fc7700 1 -- 172.21.15.78:0/3948422926 wait complete. 2023-08-17T17:53:45.512 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-08-17T17:53:45.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T17:53:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.641+0000 7f4929b6c700 1 Processor -- start 2023-08-17T17:53:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.641+0000 7f4929b6c700 1 -- start start 2023-08-17T17:53:45.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.642+0000 7f4929b6c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49240a7fe0 0x7f4924064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:45.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.642+0000 7f4929b6c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4924065140 0x7f49240c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:45.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.642+0000 7f4929b6c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49240be7f0 0x7f49240beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:45.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.642+0000 7f4929b6c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49240bf190 con 0x7f49240be7f0 2023-08-17T17:53:45.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.642+0000 7f4929b6c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49240c4040 con 0x7f4924065140 2023-08-17T17:53:45.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.642+0000 7f4929b6c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240c7080 con 0x7f49240a7fe0 2023-08-17T17:53:45.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.642+0000 7f4923fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49240be7f0 0x7f49240beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:45.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.642+0000 7f4923fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49240be7f0 0x7f49240beca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45986/0 (socket says 172.21.15.78:45986) 2023-08-17T17:53:45.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.642+0000 7f4923fff700 1 -- 172.21.15.78:0/1432175194 learned_addr learned my addr 172.21.15.78:0/1432175194 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:45.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f4922ffd700 1 --2- 172.21.15.78:0/1432175194 >> v2:172.21.15.150:3300/0 conn(0x7f4924065140 0x7f49240c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f49237fe700 1 --2- 172.21.15.78:0/1432175194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49240a7fe0 0x7f4924064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f4923fff700 1 -- 172.21.15.78:0/1432175194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49240a7fe0 msgr2=0x7f4924064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f4923fff700 1 --2- 172.21.15.78:0/1432175194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49240a7fe0 0x7f4924064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f4923fff700 1 -- 172.21.15.78:0/1432175194 >> v2:172.21.15.150:3300/0 conn(0x7f4924065140 msgr2=0x7f49240c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f4923fff700 1 --2- 172.21.15.78:0/1432175194 >> v2:172.21.15.150:3300/0 conn(0x7f4924065140 0x7f49240c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f4923fff700 1 -- 172.21.15.78:0/1432175194 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240c3430 con 0x7f49240be7f0 2023-08-17T17:53:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f4923fff700 1 --2- 172.21.15.78:0/1432175194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240be7f0 0x7f49240beca0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f49240aef40 tx=0x7f491c0090f0).ready entity=mon.0 client_cookie=d60a313596240601 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f49227fc700 1 -- 172.21.15.78:0/1432175194 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00f510 con 0x7f49240be7f0 2023-08-17T17:53:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f49227fc700 1 -- 172.21.15.78:0/1432175194 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c00f670 con 0x7f49240be7f0 2023-08-17T17:53:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f49227fc700 1 -- 172.21.15.78:0/1432175194 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00f9f0 con 0x7f49240be7f0 2023-08-17T17:53:45.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f4929b6c700 1 -- 172.21.15.78:0/1432175194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240be7f0 msgr2=0x7f49240beca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:45.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.643+0000 7f4929b6c700 1 --2- 172.21.15.78:0/1432175194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240be7f0 0x7f49240beca0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f49240aef40 tx=0x7f491c0090f0).stop 2023-08-17T17:53:45.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.644+0000 7f4929b6c700 1 -- 172.21.15.78:0/1432175194 shutdown_connections 2023-08-17T17:53:45.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.644+0000 7f4929b6c700 1 --2- 172.21.15.78:0/1432175194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240be7f0 0x7f49240beca0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.644+0000 7f4929b6c700 1 --2- 172.21.15.78:0/1432175194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49240a7fe0 0x7f4924064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.644+0000 7f4929b6c700 1 --2- 172.21.15.78:0/1432175194 >> v2:172.21.15.150:3300/0 conn(0x7f4924065140 0x7f49240c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.644+0000 7f4929b6c700 1 -- 172.21.15.78:0/1432175194 >> 172.21.15.78:0/1432175194 conn(0x7f4924092330 msgr2=0x7f4924062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:45.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.644+0000 7f4929b6c700 1 -- 172.21.15.78:0/1432175194 shutdown_connections 2023-08-17T17:53:45.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.644+0000 7f4929b6c700 1 -- 172.21.15.78:0/1432175194 wait complete. 2023-08-17T17:53:45.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.645+0000 7f4929b6c700 1 Processor -- start 2023-08-17T17:53:45.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.645+0000 7f4929b6c700 1 -- start start 2023-08-17T17:53:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4929b6c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4924065140 0x7f4924156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4929b6c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240a7fe0 0x7f4924153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4929b6c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49240be7f0 0x7f4924153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4929b6c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4924156750 con 0x7f49240a7fe0 2023-08-17T17:53:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4929b6c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4924157550 con 0x7f4924065140 2023-08-17T17:53:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4929b6c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4924154160 con 0x7f49240be7f0 2023-08-17T17:53:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4922ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240a7fe0 0x7f4924153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:45.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4922ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240a7fe0 0x7f4924153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45998/0 (socket says 172.21.15.78:45998) 2023-08-17T17:53:45.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4922ffd700 1 -- 172.21.15.78:0/153264881 learned_addr learned my addr 172.21.15.78:0/153264881 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:45.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4923fff700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49240be7f0 0x7f4924153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:45.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4922ffd700 1 -- 172.21.15.78:0/153264881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49240be7f0 msgr2=0x7f4924153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:45.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f49237fe700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4924065140 0x7f4924156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:45.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4922ffd700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49240be7f0 0x7f4924153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4922ffd700 1 -- 172.21.15.78:0/153264881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4924065140 msgr2=0x7f4924156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:45.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4922ffd700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4924065140 0x7f4924156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4922ffd700 1 -- 172.21.15.78:0/153264881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c009370 con 0x7f49240a7fe0 2023-08-17T17:53:45.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4922ffd700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240a7fe0 0x7f4924153780 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f491800e8d0 tx=0x7f4918009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:45.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f490b7fe700 1 -- 172.21.15.78:0/153264881 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491800c640 con 0x7f49240a7fe0 2023-08-17T17:53:45.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f490b7fe700 1 -- 172.21.15.78:0/153264881 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491800c7a0 con 0x7f49240a7fe0 2023-08-17T17:53:45.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4929b6c700 1 -- 172.21.15.78:0/153264881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49241579e0 con 0x7f49240a7fe0 2023-08-17T17:53:45.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f490b7fe700 1 -- 172.21.15.78:0/153264881 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491800cb20 con 0x7f49240a7fe0 2023-08-17T17:53:45.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.646+0000 7f4929b6c700 1 -- 172.21.15.78:0/153264881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4924156ca0 con 0x7f49240a7fe0 2023-08-17T17:53:45.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.647+0000 7f4929b6c700 1 -- 172.21.15.78:0/153264881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49241576e0 con 0x7f49240a7fe0 2023-08-17T17:53:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.648+0000 7f490b7fe700 1 -- 172.21.15.78:0/153264881 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4918022070 con 0x7f49240a7fe0 2023-08-17T17:53:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.648+0000 7f490b7fe700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f491005ed90 0x7f4910061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.648+0000 7f490b7fe700 1 -- 172.21.15.78:0/153264881 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4918079a60 con 0x7f49240a7fe0 2023-08-17T17:53:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.648+0000 7f49237fe700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f491005ed90 0x7f4910061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:45.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.648+0000 7f49237fe700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f491005ed90 0x7f4910061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f49140076c0 tx=0x7f491400b040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:45.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.652+0000 7f490b7fe700 1 -- 172.21.15.78:0/153264881 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f491804b350 con 0x7f49240a7fe0 2023-08-17T17:53:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.879+0000 7f4929b6c700 1 -- 172.21.15.78:0/153264881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4924047350 con 0x7f49240a7fe0 2023-08-17T17:53:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.879+0000 7f490b7fe700 1 -- 172.21.15.78:0/153264881 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f491804e970 con 0x7f49240a7fe0 2023-08-17T17:53:45.880 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:45.881 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:53:45.881 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-08-17T17:53:45.881 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.881 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-08-17T17:53:45.881 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA==", 2023-08-17T17:53:45.881 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.881 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:45.882 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:53:45.882 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:53:45.882 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.882 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.882 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.882 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.882 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-08-17T17:53:45.883 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g==", 2023-08-17T17:53:45.883 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.883 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:45.883 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:53:45.883 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:53:45.883 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.883 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.883 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.884 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.884 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-08-17T17:53:45.884 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw==", 2023-08-17T17:53:45.884 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.884 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:45.884 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:53:45.884 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:53:45.885 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.885 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.885 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.885 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.885 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-08-17T17:53:45.886 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg==", 2023-08-17T17:53:45.886 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.886 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:45.886 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:53:45.887 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:53:45.887 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.887 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.887 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.887 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.887 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-08-17T17:53:45.888 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg==", 2023-08-17T17:53:45.888 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.888 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:45.888 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:45.888 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.888 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.888 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.889 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.889 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-08-17T17:53:45.889 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw==", 2023-08-17T17:53:45.889 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.889 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:45.889 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:45.890 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.890 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.890 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.890 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.890 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-08-17T17:53:45.890 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA==", 2023-08-17T17:53:45.890 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.890 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-08-17T17:53:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ==", 2023-08-17T17:53:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-08-17T17:53:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA==", 2023-08-17T17:53:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-08-17T17:53:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q==", 2023-08-17T17:53:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-08-17T17:53:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw==", 2023-08-17T17:53:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-08-17T17:53:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg==", 2023-08-17T17:53:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T17:53:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T17:53:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-08-17T17:53:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA==", 2023-08-17T17:53:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-08-17T17:53:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T17:53:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-08-17T17:53:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ==", 2023-08-17T17:53:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:53:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:53:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:53:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-08-17T17:53:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ==", 2023-08-17T17:53:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:53:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:53:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:53:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-08-17T17:53:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw==", 2023-08-17T17:53:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T17:53:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T17:53:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T17:53:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T17:53:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-08-17T17:53:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k6n2yGhAAldYlBQaNGCgXL0HA2ePHVg==", 2023-08-17T17:53:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:53:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T17:53:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T17:53:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-08-17T17:53:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg==", 2023-08-17T17:53:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:53:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:53:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-08-17T17:53:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA==", 2023-08-17T17:53:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T17:53:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T17:53:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T17:53:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T17:53:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.906 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:45.906 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-08-17T17:53:45.906 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:53:45.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 -- 172.21.15.78:0/153264881 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f491005ed90 msgr2=0x7f4910061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:45.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f491005ed90 0x7f4910061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f49140076c0 tx=0x7f491400b040).stop 2023-08-17T17:53:45.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 -- 172.21.15.78:0/153264881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240a7fe0 msgr2=0x7f4924153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:45.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240a7fe0 0x7f4924153780 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f491800e8d0 tx=0x7f4918009060).stop 2023-08-17T17:53:45.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 -- 172.21.15.78:0/153264881 shutdown_connections 2023-08-17T17:53:45.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f491005ed90 0x7f4910061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49240be7f0 0x7f4924153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4924065140 0x7f4924156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 --2- 172.21.15.78:0/153264881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49240a7fe0 0x7f4924153780 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:45.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 -- 172.21.15.78:0/153264881 >> 172.21.15.78:0/153264881 conn(0x7f4924092330 msgr2=0x7f4924066930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:45.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 -- 172.21.15.78:0/153264881 shutdown_connections 2023-08-17T17:53:45.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:45.881+0000 7f4929b6c700 1 -- 172.21.15.78:0/153264881 wait complete. 2023-08-17T17:53:45.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:46.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.021+0000 7f1886f88700 1 Processor -- start 2023-08-17T17:53:46.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.021+0000 7f1886f88700 1 -- start start 2023-08-17T17:53:46.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1886f88700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1880154140 0x7f18800c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1886f88700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18800a7c40 0x7f18800c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1886f88700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1880154520 con 0x7f18800a8080 2023-08-17T17:53:46.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1886f88700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18800c91e0 con 0x7f18800a7c40 2023-08-17T17:53:46.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1886f88700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18800c94c0 con 0x7f1880154140 2023-08-17T17:53:46.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1877fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18800a7c40 0x7f18800c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1877fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18800a7c40 0x7f18800c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46000/0 (socket says 172.21.15.78:46000) 2023-08-17T17:53:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1877fff700 1 -- 172.21.15.78:0/4222016484 learned_addr learned my addr 172.21.15.78:0/4222016484 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1884d24700 1 --2- 172.21.15.78:0/4222016484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1880154140 0x7f18800c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1877fff700 1 -- 172.21.15.78:0/4222016484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1880154140 msgr2=0x7f18800c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1877fff700 1 --2- 172.21.15.78:0/4222016484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1880154140 0x7f18800c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1877fff700 1 -- 172.21.15.78:0/4222016484 >> v1:172.21.15.150:6789/0 conn(0x7f18800a8080 legacy=0x7f18800ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.022+0000 7f1877fff700 1 -- 172.21.15.78:0/4222016484 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18800c97a0 con 0x7f18800a7c40 2023-08-17T17:53:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f1877fff700 1 --2- 172.21.15.78:0/4222016484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a7c40 0x7f18800c0900 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f1870006fd0 tx=0x7f18700090f0).ready entity=mon.0 client_cookie=2e5df7227ca0ca55 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f18777fe700 1 -- 172.21.15.78:0/4222016484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000b600 con 0x7f18800a7c40 2023-08-17T17:53:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f18777fe700 1 -- 172.21.15.78:0/4222016484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187000b760 con 0x7f18800a7c40 2023-08-17T17:53:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f18777fe700 1 -- 172.21.15.78:0/4222016484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000bae0 con 0x7f18800a7c40 2023-08-17T17:53:46.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f1886f88700 1 -- 172.21.15.78:0/4222016484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a7c40 msgr2=0x7f18800c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f1886f88700 1 --2- 172.21.15.78:0/4222016484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a7c40 0x7f18800c0900 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f1870006fd0 tx=0x7f18700090f0).stop 2023-08-17T17:53:46.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f1886f88700 1 -- 172.21.15.78:0/4222016484 shutdown_connections 2023-08-17T17:53:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f1886f88700 1 --2- 172.21.15.78:0/4222016484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1880154140 0x7f18800c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f1886f88700 1 --2- 172.21.15.78:0/4222016484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a7c40 0x7f18800c0900 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f1886f88700 1 -- 172.21.15.78:0/4222016484 >> 172.21.15.78:0/4222016484 conn(0x7f1880094510 msgr2=0x7f188006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f1886f88700 1 -- 172.21.15.78:0/4222016484 shutdown_connections 2023-08-17T17:53:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.023+0000 7f1886f88700 1 -- 172.21.15.78:0/4222016484 wait complete. 2023-08-17T17:53:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.024+0000 7f1886f88700 1 Processor -- start 2023-08-17T17:53:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1886f88700 1 -- start start 2023-08-17T17:53:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1886f88700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18800a7c40 0x7f18800ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1886f88700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a8080 0x7f18800b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1886f88700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1880154140 0x7f1880167270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1886f88700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1880167760 con 0x7f18800a8080 2023-08-17T17:53:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1886f88700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18800b04a0 con 0x7f18800a7c40 2023-08-17T17:53:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1886f88700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18800ae420 con 0x7f1880154140 2023-08-17T17:53:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1877fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a8080 0x7f18800b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1877fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a8080 0x7f18800b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46002/0 (socket says 172.21.15.78:46002) 2023-08-17T17:53:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1877fff700 1 -- 172.21.15.78:0/1322584066 learned_addr learned my addr 172.21.15.78:0/1322584066 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.025+0000 7f1884d24700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18800a7c40 0x7f18800ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1885525700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1880154140 0x7f1880167270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1877fff700 1 -- 172.21.15.78:0/1322584066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1880154140 msgr2=0x7f1880167270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1877fff700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1880154140 0x7f1880167270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1877fff700 1 -- 172.21.15.78:0/1322584066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18800a7c40 msgr2=0x7f18800ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1877fff700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18800a7c40 0x7f18800ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1877fff700 1 -- 172.21.15.78:0/1322584066 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870009370 con 0x7f18800a8080 2023-08-17T17:53:46.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1877fff700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a8080 0x7f18800b0930 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f1870011000 tx=0x7f1870017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1874ff9700 1 -- 172.21.15.78:0/1322584066 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000bea0 con 0x7f18800a8080 2023-08-17T17:53:46.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1874ff9700 1 -- 172.21.15.78:0/1322584066 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187000b8d0 con 0x7f18800a8080 2023-08-17T17:53:46.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1886f88700 1 -- 172.21.15.78:0/1322584066 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18800ae700 con 0x7f18800a8080 2023-08-17T17:53:46.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1874ff9700 1 -- 172.21.15.78:0/1322584066 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187001b640 con 0x7f18800a8080 2023-08-17T17:53:46.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.026+0000 7f1886f88700 1 -- 172.21.15.78:0/1322584066 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18800b0130 con 0x7f18800a8080 2023-08-17T17:53:46.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.027+0000 7f1886f88700 1 -- 172.21.15.78:0/1322584066 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18800afcb0 con 0x7f18800a8080 2023-08-17T17:53:46.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.027+0000 7f1874ff9700 1 -- 172.21.15.78:0/1322584066 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f187002b070 con 0x7f18800a8080 2023-08-17T17:53:46.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.028+0000 7f1874ff9700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f186c05ed90 0x7f186c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.028+0000 7f1874ff9700 1 -- 172.21.15.78:0/1322584066 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f187007afb0 con 0x7f18800a8080 2023-08-17T17:53:46.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.028+0000 7f1884d24700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f186c05ed90 0x7f186c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.028+0000 7f1884d24700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f186c05ed90 0x7f186c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f187c00bbc0 tx=0x7f187c008040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.032+0000 7f1874ff9700 1 -- 172.21.15.78:0/1322584066 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18800afcb0 con 0x7f18800a8080 2023-08-17T17:53:46.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.196+0000 7f1886f88700 1 -- 172.21.15.78:0/1322584066 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18800afcb0 con 0x7f18800a8080 2023-08-17T17:53:46.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.196+0000 7f1874ff9700 1 -- 172.21.15.78:0/1322584066 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+13771 (secure 0 0 0) 0x7f18800afcb0 con 0x7f18800a8080 2023-08-17T17:53:46.198 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:46.198 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":145,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:45.498966+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:46.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.198+0000 7f1886f88700 1 -- 172.21.15.78:0/1322584066 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f186c05ed90 msgr2=0x7f186c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.198+0000 7f1886f88700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f186c05ed90 0x7f186c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f187c00bbc0 tx=0x7f187c008040).stop 2023-08-17T17:53:46.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.198+0000 7f1886f88700 1 -- 172.21.15.78:0/1322584066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a8080 msgr2=0x7f18800b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.198+0000 7f1886f88700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a8080 0x7f18800b0930 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f1870011000 tx=0x7f1870017000).stop 2023-08-17T17:53:46.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.198+0000 7f1886f88700 1 -- 172.21.15.78:0/1322584066 shutdown_connections 2023-08-17T17:53:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.198+0000 7f1886f88700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f186c05ed90 0x7f186c061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.198+0000 7f1886f88700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1880154140 0x7f1880167270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.198+0000 7f1886f88700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18800a7c40 0x7f18800ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.198+0000 7f1886f88700 1 --2- 172.21.15.78:0/1322584066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18800a8080 0x7f18800b0930 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.199+0000 7f1886f88700 1 -- 172.21.15.78:0/1322584066 >> 172.21.15.78:0/1322584066 conn(0x7f1880094510 msgr2=0x7f18800c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.199+0000 7f1886f88700 1 -- 172.21.15.78:0/1322584066 shutdown_connections 2023-08-17T17:53:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.199+0000 7f1886f88700 1 -- 172.21.15.78:0/1322584066 wait complete. 2023-08-17T17:53:46.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T17:53:46.213 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T17:53:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.328+0000 7feb135fb700 1 Processor -- start 2023-08-17T17:53:46.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.328+0000 7feb135fb700 1 -- start start 2023-08-17T17:53:46.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.329+0000 7feb135fb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0c0aa0f0 0x7feb0c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.329+0000 7feb135fb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feb0c0c5810 0x7feb0c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.329+0000 7feb135fb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c0649b0 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.329+0000 7feb135fb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0c0c6170 con 0x7feb0c0c5810 2023-08-17T17:53:46.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.329+0000 7feb135fb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c063420 con 0x7feb0c0aa0f0 2023-08-17T17:53:46.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.329+0000 7feb11b98700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feb0c0c5810 0x7feb0c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.329+0000 7feb11b98700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feb0c0c5810 0x7feb0c0c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46012/0 (socket says 172.21.15.78:46012) 2023-08-17T17:53:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.329+0000 7feb11b98700 1 -- 172.21.15.78:0/172227448 learned_addr learned my addr 172.21.15.78:0/172227448 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb11397700 1 --2- 172.21.15.78:0/172227448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0c0aa0f0 0x7feb0c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb11b98700 1 -- 172.21.15.78:0/172227448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0c0aa0f0 msgr2=0x7feb0c0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb11b98700 1 --2- 172.21.15.78:0/172227448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0c0aa0f0 0x7feb0c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb11b98700 1 -- 172.21.15.78:0/172227448 >> v1:172.21.15.150:6789/0 conn(0x7feb0c0aa4d0 legacy=0x7feb0c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb11b98700 1 -- 172.21.15.78:0/172227448 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c063700 con 0x7feb0c0c5810 2023-08-17T17:53:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb11b98700 1 --2- 172.21.15.78:0/172227448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0c5810 0x7feb0c0c5c80 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7feb04009f20 tx=0x7feb04009840).ready entity=mon.0 client_cookie=2c1e10cda34ab474 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb03fff700 1 -- 172.21.15.78:0/172227448 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400e070 con 0x7feb0c0c5810 2023-08-17T17:53:46.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb03fff700 1 -- 172.21.15.78:0/172227448 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0400ba40 con 0x7feb0c0c5810 2023-08-17T17:53:46.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb03fff700 1 -- 172.21.15.78:0/172227448 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400bdc0 con 0x7feb0c0c5810 2023-08-17T17:53:46.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb135fb700 1 -- 172.21.15.78:0/172227448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0c5810 msgr2=0x7feb0c0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb135fb700 1 --2- 172.21.15.78:0/172227448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0c5810 0x7feb0c0c5c80 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7feb04009f20 tx=0x7feb04009840).stop 2023-08-17T17:53:46.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb135fb700 1 -- 172.21.15.78:0/172227448 shutdown_connections 2023-08-17T17:53:46.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb135fb700 1 --2- 172.21.15.78:0/172227448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0c5810 0x7feb0c0c5c80 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb135fb700 1 --2- 172.21.15.78:0/172227448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0c0aa0f0 0x7feb0c0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb135fb700 1 -- 172.21.15.78:0/172227448 >> 172.21.15.78:0/172227448 conn(0x7feb0c06a6a0 msgr2=0x7feb0c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:46.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb135fb700 1 -- 172.21.15.78:0/172227448 shutdown_connections 2023-08-17T17:53:46.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.330+0000 7feb135fb700 1 -- 172.21.15.78:0/172227448 wait complete. 2023-08-17T17:53:46.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.332+0000 7feb135fb700 1 Processor -- start 2023-08-17T17:53:46.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.332+0000 7feb135fb700 1 -- start start 2023-08-17T17:53:46.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.332+0000 7feb135fb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0c0aa0f0 0x7feb0c152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.332+0000 7feb135fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0aa4d0 0x7feb0c0c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb135fb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0c0c5810 0x7feb0c0acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb135fb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0b0400 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb135fb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0c4d60 con 0x7feb0c0c5810 2023-08-17T17:53:46.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb135fb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c1534a0 con 0x7feb0c0aa0f0 2023-08-17T17:53:46.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb10b96700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0aa4d0 0x7feb0c0c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb10b96700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0aa4d0 0x7feb0c0c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46026/0 (socket says 172.21.15.78:46026) 2023-08-17T17:53:46.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb10b96700 1 -- 172.21.15.78:0/1773086387 learned_addr learned my addr 172.21.15.78:0/1773086387 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:46.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb11397700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0c0aa0f0 0x7feb0c152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb11b98700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0c0c5810 0x7feb0c0acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb10b96700 1 -- 172.21.15.78:0/1773086387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0c0aa0f0 msgr2=0x7feb0c152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb10b96700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0c0aa0f0 0x7feb0c152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb10b96700 1 -- 172.21.15.78:0/1773086387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0c0c5810 msgr2=0x7feb0c0acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb10b96700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0c0c5810 0x7feb0c0acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb10b96700 1 -- 172.21.15.78:0/1773086387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04009ae0 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb11b98700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0c0c5810 0x7feb0c0acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:46.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb10b96700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0aa4d0 0x7feb0c0c2f10 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7feafc00c490 tx=0x7feafc007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb017fa700 1 -- 172.21.15.78:0/1773086387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc00ce90 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb017fa700 1 -- 172.21.15.78:0/1773086387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc00f470 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb017fa700 1 -- 172.21.15.78:0/1773086387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc00f830 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb135fb700 1 -- 172.21.15.78:0/1773086387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c0af7f0 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.333+0000 7feb135fb700 1 -- 172.21.15.78:0/1773086387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c0afdb0 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.334+0000 7feb135fb700 1 -- 172.21.15.78:0/1773086387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c083980 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.335+0000 7feb017fa700 1 -- 172.21.15.78:0/1773086387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feafc019030 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.335+0000 7feb017fa700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf005ed90 0x7feaf0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.335+0000 7feb017fa700 1 -- 172.21.15.78:0/1773086387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5269+0+0 (secure 0 0 0) 0x7feafc078af0 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.335+0000 7feb11397700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf005ed90 0x7feaf0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.335+0000 7feb11397700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf005ed90 0x7feaf0061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7feb0800ab30 tx=0x7feb08008040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.339+0000 7feb017fa700 1 -- 172.21.15.78:0/1773086387 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feafc0488f0 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.500+0000 7feb135fb700 1 -- 172.21.15.78:0/1773086387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7feb0c0b09d0 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.501+0000 7feb017fa700 1 -- 172.21.15.78:0/1773086387 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v145) v1 ==== 110+0+10 (secure 0 0 0) 0x7feb0c0b09d0 con 0x7feb0c0aa4d0 2023-08-17T17:53:46.502 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T17:53:46.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 -- 172.21.15.78:0/1773086387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf005ed90 msgr2=0x7feaf0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf005ed90 0x7feaf0061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7feb0800ab30 tx=0x7feb08008040).stop 2023-08-17T17:53:46.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 -- 172.21.15.78:0/1773086387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0aa4d0 msgr2=0x7feb0c0c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0aa4d0 0x7feb0c0c2f10 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7feafc00c490 tx=0x7feafc007db0).stop 2023-08-17T17:53:46.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 -- 172.21.15.78:0/1773086387 shutdown_connections 2023-08-17T17:53:46.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7feaf005ed90 0x7feaf0061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb0c0c5810 0x7feb0c0acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb0c0aa0f0 0x7feb0c152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 --2- 172.21.15.78:0/1773086387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c0aa4d0 0x7feb0c0c2f10 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 -- 172.21.15.78:0/1773086387 >> 172.21.15.78:0/1773086387 conn(0x7feb0c06a6a0 msgr2=0x7feb0c0a81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:46.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 -- 172.21.15.78:0/1773086387 shutdown_connections 2023-08-17T17:53:46.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.502+0000 7feb135fb700 1 -- 172.21.15.78:0/1773086387 wait complete. 2023-08-17T17:53:46.516 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T17:53:46.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.630+0000 7f8426fb7700 1 Processor -- start 2023-08-17T17:53:46.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.630+0000 7f8426fb7700 1 -- start start 2023-08-17T17:53:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f8426fb7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f84200aa0f0 0x7f84200644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f8426fb7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200c5810 0x7f84200c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f8426fb7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84200649b0 con 0x7f84200aa4d0 2023-08-17T17:53:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f8426fb7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84200c6170 con 0x7f84200aa0f0 2023-08-17T17:53:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f8426fb7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8420063420 con 0x7f84200c5810 2023-08-17T17:53:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f8417fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f84200aa4d0 0x7f84200c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36212/0 (socket says 172.21.15.78:36212) 2023-08-17T17:53:46.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f8417fff700 1 -- 172.21.15.78:0/333576131 learned_addr learned my addr 172.21.15.78:0/333576131 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:46.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f8425554700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200c5810 0x7f84200c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f8424d53700 1 --2- 172.21.15.78:0/333576131 >> v2:172.21.15.150:3300/0 conn(0x7f84200aa0f0 0x7f84200644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652774928 0 0) 0x7f84200649b0 con 0x7f84200aa4d0 2023-08-17T17:53:46.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.631+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84080033f0 con 0x7f84200aa4d0 2023-08-17T17:53:46.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 144716631 0 0) 0x7f84080033f0 con 0x7f84200aa4d0 2023-08-17T17:53:46.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200c5810 msgr2=0x7f84200c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200c5810 0x7f84200c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 >> v2:172.21.15.150:3300/0 conn(0x7f84200aa0f0 msgr2=0x7f84200644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 --2- 172.21.15.78:0/333576131 >> v2:172.21.15.150:3300/0 conn(0x7f84200aa0f0 0x7f84200644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8420063700 con 0x7f84200aa4d0 2023-08-17T17:53:46.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f8410001470 con 0x7f84200aa4d0 2023-08-17T17:53:46.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 >> v1:172.21.15.78:6789/0 conn(0x7f84200aa4d0 legacy=0x7f84200c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84080038e0 0x7f8408003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200c5810 0x7f8408004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 0x7f8408005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84200c6170 con 0x7f8408004b80 2023-08-17T17:53:46.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8420063420 con 0x7f84080038e0 2023-08-17T17:53:46.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840800b8e0 con 0x7f84200c5810 2023-08-17T17:53:46.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f8425554700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 0x7f8408005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f8424d53700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84080038e0 0x7f8408003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f8417fff700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200c5810 0x7f8408004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f8425554700 1 -- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200c5810 msgr2=0x7f8408004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f8425554700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200c5810 0x7f8408004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f8425554700 1 -- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84080038e0 msgr2=0x7f8408003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f8425554700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84080038e0 0x7f8408003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f8425554700 1 -- 172.21.15.78:0/333576131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84080033f0 con 0x7f8408004b80 2023-08-17T17:53:46.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f8417fff700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200c5810 0x7f8408004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:46.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f8425554700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 0x7f8408005000 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f841800e210 tx=0x7f841800b040).ready entity=mon.0 client_cookie=c1c428cde3984b25 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418009ac0 con 0x7f8408004b80 2023-08-17T17:53:46.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841800f040 con 0x7f8408004b80 2023-08-17T17:53:46.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.632+0000 7f84177fe700 1 -- 172.21.15.78:0/333576131 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841800ecd0 con 0x7f8408004b80 2023-08-17T17:53:46.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.633+0000 7f8426fb7700 1 -- 172.21.15.78:0/333576131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 msgr2=0x7f8408005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.633+0000 7f8426fb7700 1 --2- 172.21.15.78:0/333576131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 0x7f8408005000 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f841800e210 tx=0x7f841800b040).stop 2023-08-17T17:53:46.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.633+0000 7f8425554700 1 -- 172.21.15.78:0/333576131 reap_dead start 2023-08-17T17:53:46.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.633+0000 7f8426fb7700 1 -- 172.21.15.78:0/333576131 shutdown_connections 2023-08-17T17:53:46.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.633+0000 7f8426fb7700 1 -- 172.21.15.78:0/333576131 >> 172.21.15.78:0/333576131 conn(0x7f842006a6a0 msgr2=0x7f84200caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:46.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.633+0000 7f8426fb7700 1 -- 172.21.15.78:0/333576131 shutdown_connections 2023-08-17T17:53:46.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.633+0000 7f8426fb7700 1 -- 172.21.15.78:0/333576131 wait complete. 2023-08-17T17:53:46.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.634+0000 7f8426fb7700 1 Processor -- start 2023-08-17T17:53:46.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.634+0000 7f8426fb7700 1 -- start start 2023-08-17T17:53:46.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8426fb7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 0x7f84200ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8426fb7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200ab380 0x7f8420153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8426fb7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84200c3cc0 0x7f84200c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8426fb7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84200ac390 con 0x7f8408004b80 2023-08-17T17:53:46.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8426fb7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84200c4630 con 0x7f84200c3cc0 2023-08-17T17:53:46.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8426fb7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8420155210 con 0x7f84200ab380 2023-08-17T17:53:46.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8424d53700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 0x7f84200ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8424d53700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 0x7f84200ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46046/0 (socket says 172.21.15.78:46046) 2023-08-17T17:53:46.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8424d53700 1 -- 172.21.15.78:0/2448946789 learned_addr learned my addr 172.21.15.78:0/2448946789 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:46.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8417fff700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200ab380 0x7f8420153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8425554700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84200c3cc0 0x7f84200c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8424d53700 1 -- 172.21.15.78:0/2448946789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200ab380 msgr2=0x7f8420153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8424d53700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200ab380 0x7f8420153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8424d53700 1 -- 172.21.15.78:0/2448946789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84200c3cc0 msgr2=0x7f84200c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8424d53700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84200c3cc0 0x7f84200c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8424d53700 1 -- 172.21.15.78:0/2448946789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200abaf0 con 0x7f8408004b80 2023-08-17T17:53:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8425554700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84200c3cc0 0x7f84200c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.635+0000 7f8424d53700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 0x7f84200ad630 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f841c0119c0 tx=0x7f841c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.636+0000 7f8414ff9700 1 -- 172.21.15.78:0/2448946789 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c00f940 con 0x7f8408004b80 2023-08-17T17:53:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.636+0000 7f8414ff9700 1 -- 172.21.15.78:0/2448946789 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c00faa0 con 0x7f8408004b80 2023-08-17T17:53:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.636+0000 7f8426fb7700 1 -- 172.21.15.78:0/2448946789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84200abdd0 con 0x7f8408004b80 2023-08-17T17:53:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.636+0000 7f8414ff9700 1 -- 172.21.15.78:0/2448946789 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c00fe20 con 0x7f8408004b80 2023-08-17T17:53:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.636+0000 7f8426fb7700 1 -- 172.21.15.78:0/2448946789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84201554b0 con 0x7f8408004b80 2023-08-17T17:53:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.637+0000 7f8426fb7700 1 -- 172.21.15.78:0/2448946789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84201556d0 con 0x7f8408004b80 2023-08-17T17:53:46.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.637+0000 7f8414ff9700 1 -- 172.21.15.78:0/2448946789 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f841c024070 con 0x7f8408004b80 2023-08-17T17:53:46.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.637+0000 7f8414ff9700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f840c05edc0 0x7f840c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.637+0000 7f8414ff9700 1 -- 172.21.15.78:0/2448946789 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f841c07a180 con 0x7f8408004b80 2023-08-17T17:53:46.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.637+0000 7f8417fff700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f840c05edc0 0x7f840c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.638+0000 7f8417fff700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f840c05edc0 0x7f840c061280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f84100015a0 tx=0x7f8410007040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.641+0000 7f8414ff9700 1 -- 172.21.15.78:0/2448946789 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f841c04ba70 con 0x7f8408004b80 2023-08-17T17:53:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.802+0000 7f8426fb7700 1 -- 172.21.15.78:0/2448946789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8420083980 con 0x7f8408004b80 2023-08-17T17:53:46.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.803+0000 7f8414ff9700 1 -- 172.21.15.78:0/2448946789 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v145) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8420083980 con 0x7f8408004b80 2023-08-17T17:53:46.804 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T17:53:46.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.804+0000 7f8426fb7700 1 -- 172.21.15.78:0/2448946789 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f840c05edc0 msgr2=0x7f840c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.804+0000 7f8426fb7700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f840c05edc0 0x7f840c061280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f84100015a0 tx=0x7f8410007040).stop 2023-08-17T17:53:46.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.804+0000 7f8426fb7700 1 -- 172.21.15.78:0/2448946789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 msgr2=0x7f84200ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.804+0000 7f8426fb7700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 0x7f84200ad630 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f841c0119c0 tx=0x7f841c009060).stop 2023-08-17T17:53:46.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.805+0000 7f8426fb7700 1 -- 172.21.15.78:0/2448946789 shutdown_connections 2023-08-17T17:53:46.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.805+0000 7f8426fb7700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f840c05edc0 0x7f840c061280 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.805+0000 7f8426fb7700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84200c3cc0 0x7f84200c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.805+0000 7f8426fb7700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8408004b80 0x7f84200ad630 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.805+0000 7f8426fb7700 1 --2- 172.21.15.78:0/2448946789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84200ab380 0x7f8420153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.805+0000 7f8426fb7700 1 -- 172.21.15.78:0/2448946789 >> 172.21.15.78:0/2448946789 conn(0x7f842006a6a0 msgr2=0x7f84200a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:46.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.805+0000 7f8426fb7700 1 -- 172.21.15.78:0/2448946789 shutdown_connections 2023-08-17T17:53:46.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.805+0000 7f8426fb7700 1 -- 172.21.15.78:0/2448946789 wait complete. 2023-08-17T17:53:46.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T17:53:46.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.929+0000 7fcc62ed4700 1 Processor -- start 2023-08-17T17:53:46.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.929+0000 7fcc62ed4700 1 -- start start 2023-08-17T17:53:46.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.930+0000 7fcc62ed4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcc5c13a640 0x7fcc5c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.930+0000 7fcc62ed4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c069760 0x7fcc5c0c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.930+0000 7fcc62ed4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0c2c10 con 0x7fcc5c06a2c0 2023-08-17T17:53:46.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.930+0000 7fcc62ed4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c155010 con 0x7fcc5c13a640 2023-08-17T17:53:46.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.930+0000 7fcc62ed4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c1552e0 con 0x7fcc5c069760 2023-08-17T17:53:46.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.930+0000 7fcc53fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcc5c06a2c0 0x7fcc5c069050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36220/0 (socket says 172.21.15.78:36220) 2023-08-17T17:53:46.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.930+0000 7fcc53fff700 1 -- 172.21.15.78:0/1385232253 learned_addr learned my addr 172.21.15.78:0/1385232253 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:46.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc61471700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c069760 0x7fcc5c0c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc60c70700 1 --2- 172.21.15.78:0/1385232253 >> v2:172.21.15.150:3300/0 conn(0x7fcc5c13a640 0x7fcc5c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313919762 0 0) 0x7fcc5c0c2c10 con 0x7fcc5c06a2c0 2023-08-17T17:53:46.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc440033f0 con 0x7fcc5c06a2c0 2023-08-17T17:53:46.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2574512929 0 0) 0x7fcc440033f0 con 0x7fcc5c06a2c0 2023-08-17T17:53:46.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c069760 msgr2=0x7fcc5c0c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c069760 0x7fcc5c0c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 >> v2:172.21.15.150:3300/0 conn(0x7fcc5c13a640 msgr2=0x7fcc5c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 --2- 172.21.15.78:0/1385232253 >> v2:172.21.15.150:3300/0 conn(0x7fcc5c13a640 0x7fcc5c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c1555c0 con 0x7fcc5c06a2c0 2023-08-17T17:53:46.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fcc4c001470 con 0x7fcc5c06a2c0 2023-08-17T17:53:46.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 >> v1:172.21.15.78:6789/0 conn(0x7fcc5c06a2c0 legacy=0x7fcc5c069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440038e0 0x7fcc44003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc44004690 0x7fcc44004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c069760 0x7fcc44005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c155010 con 0x7fcc44004690 2023-08-17T17:53:46.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c1552e0 con 0x7fcc440038e0 2023-08-17T17:53:46.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4400b8e0 con 0x7fcc5c069760 2023-08-17T17:53:46.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc53fff700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc44004690 0x7fcc44004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc60c70700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440038e0 0x7fcc44003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc61471700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c069760 0x7fcc44005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc53fff700 1 -- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c069760 msgr2=0x7fcc44005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc53fff700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c069760 0x7fcc44005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc53fff700 1 -- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440038e0 msgr2=0x7fcc44003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:46.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc53fff700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440038e0 0x7fcc44003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc53fff700 1 -- 172.21.15.78:0/1385232253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440033f0 con 0x7fcc44004690 2023-08-17T17:53:46.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc60c70700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc440038e0 0x7fcc44003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:46.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.931+0000 7fcc53fff700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc44004690 0x7fcc44004b10 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fcc4c00c210 tx=0x7fcc4c001e90).ready entity=mon.0 client_cookie=68b71938f6d72922 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.932+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c007a60 con 0x7fcc44004690 2023-08-17T17:53:46.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.932+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c00cae0 con 0x7fcc44004690 2023-08-17T17:53:46.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.932+0000 7fcc537fe700 1 -- 172.21.15.78:0/1385232253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c00ce60 con 0x7fcc44004690 2023-08-17T17:53:46.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.932+0000 7fcc62ed4700 1 -- 172.21.15.78:0/1385232253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc44004690 msgr2=0x7fcc44004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.932+0000 7fcc62ed4700 1 --2- 172.21.15.78:0/1385232253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc44004690 0x7fcc44004b10 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fcc4c00c210 tx=0x7fcc4c001e90).stop 2023-08-17T17:53:46.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.932+0000 7fcc61471700 1 -- 172.21.15.78:0/1385232253 reap_dead start 2023-08-17T17:53:46.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.932+0000 7fcc62ed4700 1 -- 172.21.15.78:0/1385232253 shutdown_connections 2023-08-17T17:53:46.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.932+0000 7fcc62ed4700 1 -- 172.21.15.78:0/1385232253 >> 172.21.15.78:0/1385232253 conn(0x7fcc5c0c7b00 msgr2=0x7fcc5c0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:46.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.932+0000 7fcc62ed4700 1 -- 172.21.15.78:0/1385232253 shutdown_connections 2023-08-17T17:53:46.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.932+0000 7fcc62ed4700 1 -- 172.21.15.78:0/1385232253 wait complete. 2023-08-17T17:53:46.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.933+0000 7fcc62ed4700 1 Processor -- start 2023-08-17T17:53:46.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.933+0000 7fcc62ed4700 1 -- start start 2023-08-17T17:53:46.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc62ed4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc44004690 0x7fcc5c150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc62ed4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c0a0460 0x7fcc5c0bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc62ed4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc5c0c1440 0x7fcc5c139440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc62ed4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0c03a0 con 0x7fcc5c0c1440 2023-08-17T17:53:46.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc62ed4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0c0680 con 0x7fcc44004690 2023-08-17T17:53:46.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc62ed4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0c0960 con 0x7fcc5c0a0460 2023-08-17T17:53:46.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc61471700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc5c0c1440 0x7fcc5c139440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc61471700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc5c0c1440 0x7fcc5c139440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46072/0 (socket says 172.21.15.78:46072) 2023-08-17T17:53:46.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc61471700 1 -- 172.21.15.78:0/2287048980 learned_addr learned my addr 172.21.15.78:0/2287048980 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:46.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc53fff700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c0a0460 0x7fcc5c0bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc60c70700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc44004690 0x7fcc5c150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc61471700 1 -- 172.21.15.78:0/2287048980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c0a0460 msgr2=0x7fcc5c0bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.934+0000 7fcc61471700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c0a0460 0x7fcc5c0bfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.935+0000 7fcc61471700 1 -- 172.21.15.78:0/2287048980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc44004690 msgr2=0x7fcc5c150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:46.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.935+0000 7fcc61471700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc44004690 0x7fcc5c150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:46.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.935+0000 7fcc61471700 1 -- 172.21.15.78:0/2287048980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0c0c40 con 0x7fcc5c0c1440 2023-08-17T17:53:46.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.935+0000 7fcc53fff700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c0a0460 0x7fcc5c0bfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:46.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.935+0000 7fcc61471700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc5c0c1440 0x7fcc5c139440 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7fcc5c064910 tx=0x7fcc54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.935+0000 7fcc50ff9700 1 -- 172.21.15.78:0/2287048980 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54015440 con 0x7fcc5c0c1440 2023-08-17T17:53:46.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.935+0000 7fcc50ff9700 1 -- 172.21.15.78:0/2287048980 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc540155a0 con 0x7fcc5c0c1440 2023-08-17T17:53:46.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.935+0000 7fcc62ed4700 1 -- 172.21.15.78:0/2287048980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c0c0f20 con 0x7fcc5c0c1440 2023-08-17T17:53:46.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.935+0000 7fcc50ff9700 1 -- 172.21.15.78:0/2287048980 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54015940 con 0x7fcc5c0c1440 2023-08-17T17:53:46.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.935+0000 7fcc62ed4700 1 -- 172.21.15.78:0/2287048980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c0c0060 con 0x7fcc5c0c1440 2023-08-17T17:53:46.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.936+0000 7fcc62ed4700 1 -- 172.21.15.78:0/2287048980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c0c1110 con 0x7fcc5c0c1440 2023-08-17T17:53:46.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.936+0000 7fcc50ff9700 1 -- 172.21.15.78:0/2287048980 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcc5400f070 con 0x7fcc5c0c1440 2023-08-17T17:53:46.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.937+0000 7fcc50ff9700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc4805ed90 0x7fcc48061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:46.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.937+0000 7fcc60c70700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc4805ed90 0x7fcc48061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:46.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.937+0000 7fcc50ff9700 1 -- 172.21.15.78:0/2287048980 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fcc54079700 con 0x7fcc5c0c1440 2023-08-17T17:53:46.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.937+0000 7fcc60c70700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc4805ed90 0x7fcc48061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcc58009fd0 tx=0x7fcc5800b040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:46.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:46.941+0000 7fcc50ff9700 1 -- 172.21.15.78:0/2287048980 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc5404aff0 con 0x7fcc5c0c1440 2023-08-17T17:53:47.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.105+0000 7fcc62ed4700 1 -- 172.21.15.78:0/2287048980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcc5c047350 con 0x7fcc5c0c1440 2023-08-17T17:53:47.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.105+0000 7fcc50ff9700 1 -- 172.21.15.78:0/2287048980 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v145) v1 ==== 84+0+143 (secure 0 0 0) 0x7fcc5404e610 con 0x7fcc5c0c1440 2023-08-17T17:53:47.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:47.107 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:53:47.107 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:47.107 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T17:53:47.108 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T17:53:47.108 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T17:53:47.108 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:47.108 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T17:53:47.108 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T17:53:47.108 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:47.108 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:53:47.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.107+0000 7fcc62ed4700 1 -- 172.21.15.78:0/2287048980 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc4805ed90 msgr2=0x7fcc48061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.107+0000 7fcc62ed4700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc4805ed90 0x7fcc48061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcc58009fd0 tx=0x7fcc5800b040).stop 2023-08-17T17:53:47.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.107+0000 7fcc62ed4700 1 -- 172.21.15.78:0/2287048980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc5c0c1440 msgr2=0x7fcc5c139440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.107+0000 7fcc62ed4700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc5c0c1440 0x7fcc5c139440 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7fcc5c064910 tx=0x7fcc54008040).stop 2023-08-17T17:53:47.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.107+0000 7fcc62ed4700 1 -- 172.21.15.78:0/2287048980 shutdown_connections 2023-08-17T17:53:47.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.107+0000 7fcc62ed4700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fcc4805ed90 0x7fcc48061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.107+0000 7fcc62ed4700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc5c0c1440 0x7fcc5c139440 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.107+0000 7fcc62ed4700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc44004690 0x7fcc5c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.107+0000 7fcc62ed4700 1 --2- 172.21.15.78:0/2287048980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc5c0a0460 0x7fcc5c0bfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.107+0000 7fcc62ed4700 1 -- 172.21.15.78:0/2287048980 >> 172.21.15.78:0/2287048980 conn(0x7fcc5c0c7b00 msgr2=0x7fcc5c138a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:47.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.108+0000 7fcc62ed4700 1 -- 172.21.15.78:0/2287048980 shutdown_connections 2023-08-17T17:53:47.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.108+0000 7fcc62ed4700 1 -- 172.21.15.78:0/2287048980 wait complete. 2023-08-17T17:53:47.120 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T17:53:47.121 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T17:53:47.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.236+0000 7f572926a700 1 Processor -- start 2023-08-17T17:53:47.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.236+0000 7f572926a700 1 -- start start 2023-08-17T17:53:47.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f572926a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f572414e680 0x7f57240c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f572926a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f572414ea60 0x7f57240c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f572926a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57240c5990 con 0x7f5724069310 2023-08-17T17:53:47.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f572926a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57240bcc10 con 0x7f572414ea60 2023-08-17T17:53:47.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f572926a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c4120 con 0x7f572414e680 2023-08-17T17:53:47.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f57237fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5724069310 0x7f57241548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36232/0 (socket says 172.21.15.78:36232) 2023-08-17T17:53:47.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f571a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f572414ea60 0x7f57240c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f57237fe700 1 -- 172.21.15.78:0/580648706 learned_addr learned my addr 172.21.15.78:0/580648706 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:47.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f5722ffd700 1 --2- 172.21.15.78:0/580648706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f572414e680 0x7f57240c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f57227fc700 1 -- 172.21.15.78:0/580648706 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792578701 0 0) 0x7f57240c5990 con 0x7f5724069310 2023-08-17T17:53:47.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f57227fc700 1 -- 172.21.15.78:0/580648706 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57100033f0 con 0x7f5724069310 2023-08-17T17:53:47.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f571a7fc700 1 -- 172.21.15.78:0/580648706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f572414e680 msgr2=0x7f57240c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:47.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f571a7fc700 1 --2- 172.21.15.78:0/580648706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f572414e680 0x7f57240c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f571a7fc700 1 -- 172.21.15.78:0/580648706 >> v1:172.21.15.78:6789/0 conn(0x7f5724069310 legacy=0x7f57241548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.237+0000 7f571a7fc700 1 -- 172.21.15.78:0/580648706 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57240c3880 con 0x7f572414ea60 2023-08-17T17:53:47.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f571a7fc700 1 --2- 172.21.15.78:0/580648706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f572414ea60 0x7f57240c3290 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f570c009760 tx=0x7f570c009060).ready entity=mon.0 client_cookie=3e667df7fc1714fe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:47.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f57227fc700 1 -- 172.21.15.78:0/580648706 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c00d4a0 con 0x7f572414ea60 2023-08-17T17:53:47.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f57227fc700 1 -- 172.21.15.78:0/580648706 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c00d600 con 0x7f572414ea60 2023-08-17T17:53:47.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f57227fc700 1 -- 172.21.15.78:0/580648706 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c00d980 con 0x7f572414ea60 2023-08-17T17:53:47.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f572926a700 1 -- 172.21.15.78:0/580648706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f572414ea60 msgr2=0x7f57240c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f572926a700 1 --2- 172.21.15.78:0/580648706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f572414ea60 0x7f57240c3290 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f570c009760 tx=0x7f570c009060).stop 2023-08-17T17:53:47.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f572926a700 1 -- 172.21.15.78:0/580648706 shutdown_connections 2023-08-17T17:53:47.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f572926a700 1 --2- 172.21.15.78:0/580648706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f572414e680 0x7f57240c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f572926a700 1 --2- 172.21.15.78:0/580648706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f572414ea60 0x7f57240c3290 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f572926a700 1 -- 172.21.15.78:0/580648706 >> 172.21.15.78:0/580648706 conn(0x7f57240c7b80 msgr2=0x7f57240c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f572926a700 1 -- 172.21.15.78:0/580648706 shutdown_connections 2023-08-17T17:53:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.238+0000 7f572926a700 1 -- 172.21.15.78:0/580648706 wait complete. 2023-08-17T17:53:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.239+0000 7f572926a700 1 Processor -- start 2023-08-17T17:53:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.239+0000 7f572926a700 1 -- start start 2023-08-17T17:53:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f572926a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5724069310 0x7f5724162d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f572926a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f572414e680 0x7f57240a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f572926a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f572414ea60 0x7f5724165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f572926a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5724162890 con 0x7f5724069310 2023-08-17T17:53:47.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f572926a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5724162260 con 0x7f572414ea60 2023-08-17T17:53:47.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f572926a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5724166280 con 0x7f572414e680 2023-08-17T17:53:47.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f5722ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5724069310 0x7f5724162d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f5722ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5724069310 0x7f5724162d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46092/0 (socket says 172.21.15.78:46092) 2023-08-17T17:53:47.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f5722ffd700 1 -- 172.21.15.78:0/2197317950 learned_addr learned my addr 172.21.15.78:0/2197317950 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f571a7fc700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f572414e680 0x7f57240a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.240+0000 7f57237fe700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f572414ea60 0x7f5724165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f5722ffd700 1 -- 172.21.15.78:0/2197317950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f572414e680 msgr2=0x7f57240a9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f5722ffd700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f572414e680 0x7f57240a9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f5722ffd700 1 -- 172.21.15.78:0/2197317950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f572414ea60 msgr2=0x7f5724165830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f5722ffd700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f572414ea60 0x7f5724165830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f5722ffd700 1 -- 172.21.15.78:0/2197317950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c0092a0 con 0x7f5724069310 2023-08-17T17:53:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f5722ffd700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5724069310 0x7f5724162d20 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f5714009f10 tx=0x7f571400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f571b7fe700 1 -- 172.21.15.78:0/2197317950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571400cc80 con 0x7f5724069310 2023-08-17T17:53:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f571b7fe700 1 -- 172.21.15.78:0/2197317950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571400f040 con 0x7f5724069310 2023-08-17T17:53:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f572926a700 1 -- 172.21.15.78:0/2197317950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5724166560 con 0x7f5724069310 2023-08-17T17:53:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f571b7fe700 1 -- 172.21.15.78:0/2197317950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714013400 con 0x7f5724069310 2023-08-17T17:53:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.241+0000 7f572926a700 1 -- 172.21.15.78:0/2197317950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5724063240 con 0x7f5724069310 2023-08-17T17:53:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.242+0000 7f572926a700 1 -- 172.21.15.78:0/2197317950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5724162b70 con 0x7f5724069310 2023-08-17T17:53:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.242+0000 7f571b7fe700 1 -- 172.21.15.78:0/2197317950 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f57140137b0 con 0x7f5724069310 2023-08-17T17:53:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.242+0000 7f571b7fe700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f570405ed90 0x7f5704061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.243+0000 7f571b7fe700 1 -- 172.21.15.78:0/2197317950 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f571407a270 con 0x7f5724069310 2023-08-17T17:53:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.243+0000 7f571a7fc700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f570405ed90 0x7f5704061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.243+0000 7f571a7fc700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f570405ed90 0x7f5704061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f570c009760 tx=0x7f570c016000).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.247+0000 7f571b7fe700 1 -- 172.21.15.78:0/2197317950 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f571404bb60 con 0x7f5724069310 2023-08-17T17:53:47.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.412+0000 7f572926a700 1 -- 172.21.15.78:0/2197317950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f5724068270 con 0x7f5724069310 2023-08-17T17:53:47.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.514+0000 7f571b7fe700 1 -- 172.21.15.78:0/2197317950 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v146) v1 ==== 152+0+0 (secure 0 0 0) 0x7f571404f180 con 0x7f5724069310 2023-08-17T17:53:47.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.519+0000 7f572926a700 1 -- 172.21.15.78:0/2197317950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f570405ed90 msgr2=0x7f5704061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.519+0000 7f572926a700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f570405ed90 0x7f5704061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f570c009760 tx=0x7f570c016000).stop 2023-08-17T17:53:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.519+0000 7f572926a700 1 -- 172.21.15.78:0/2197317950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5724069310 msgr2=0x7f5724162d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.519+0000 7f572926a700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5724069310 0x7f5724162d20 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f5714009f10 tx=0x7f571400b040).stop 2023-08-17T17:53:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.519+0000 7f572926a700 1 -- 172.21.15.78:0/2197317950 shutdown_connections 2023-08-17T17:53:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.519+0000 7f572926a700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f570405ed90 0x7f5704061250 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0x7f570c009760 tx=0x7f570c016000).stop 2023-08-17T17:53:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.519+0000 7f572926a700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f572414ea60 0x7f5724165830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.519+0000 7f572926a700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5724069310 0x7f5724162d20 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.519+0000 7f572926a700 1 --2- 172.21.15.78:0/2197317950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f572414e680 0x7f57240a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.519+0000 7f572926a700 1 -- 172.21.15.78:0/2197317950 >> 172.21.15.78:0/2197317950 conn(0x7f57240c7b80 msgr2=0x7f57240662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.520+0000 7f572926a700 1 -- 172.21.15.78:0/2197317950 shutdown_connections 2023-08-17T17:53:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.520+0000 7f572926a700 1 -- 172.21.15.78:0/2197317950 wait complete. 2023-08-17T17:53:47.523 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T17:53:47.535 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T17:53:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.653+0000 7f3eed85c700 1 Processor -- start 2023-08-17T17:53:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.653+0000 7f3eed85c700 1 -- start start 2023-08-17T17:53:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3eed85c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c7e10 0x7f3ee80ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3eed85c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee80c6970 con 0x7f3ee80c0f10 2023-08-17T17:53:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3eed85c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee80cac90 con 0x7f3ee8154110 2023-08-17T17:53:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3eed85c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee80c6040 con 0x7f3ee80c7e10 2023-08-17T17:53:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3ee67fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3ee80c0f10 0x7f3ee80c9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36234/0 (socket says 172.21.15.78:36234) 2023-08-17T17:53:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3ee67fc700 1 -- 172.21.15.78:0/3324424871 learned_addr learned my addr 172.21.15.78:0/3324424871 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3ee77fe700 1 --2- 172.21.15.78:0/3324424871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c7e10 0x7f3ee80ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3ee5ffb700 1 -- 172.21.15.78:0/3324424871 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703086438 0 0) 0x7f3ee80c6970 con 0x7f3ee80c0f10 2023-08-17T17:53:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3ee5ffb700 1 -- 172.21.15.78:0/3324424871 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed40033f0 con 0x7f3ee80c0f10 2023-08-17T17:53:47.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3ee5ffb700 1 -- 172.21.15.78:0/3324424871 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204707528 0 0) 0x7f3ee80cac90 con 0x7f3ee8154110 2023-08-17T17:53:47.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3ee77fe700 1 -- 172.21.15.78:0/3324424871 >> v1:172.21.15.150:6789/0 conn(0x7f3ee8154110 legacy=0x7f3ee80c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3ee77fe700 1 -- 172.21.15.78:0/3324424871 >> v1:172.21.15.78:6789/0 conn(0x7f3ee80c0f10 legacy=0x7f3ee80c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3ee77fe700 1 -- 172.21.15.78:0/3324424871 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee80c6320 con 0x7f3ee80c7e10 2023-08-17T17:53:47.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.654+0000 7f3ee77fe700 1 --2- 172.21.15.78:0/3324424871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c7e10 0x7f3ee80ca650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3ed8009790 tx=0x7f3ed8009060).ready entity=mon.2 client_cookie=6ebaf467ad1d563e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.655+0000 7f3ee5ffb700 1 -- 172.21.15.78:0/3324424871 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800d4a0 con 0x7f3ee80c7e10 2023-08-17T17:53:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.655+0000 7f3ee5ffb700 1 -- 172.21.15.78:0/3324424871 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed800d600 con 0x7f3ee80c7e10 2023-08-17T17:53:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.655+0000 7f3ee5ffb700 1 -- 172.21.15.78:0/3324424871 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800d980 con 0x7f3ee80c7e10 2023-08-17T17:53:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.655+0000 7f3eed85c700 1 -- 172.21.15.78:0/3324424871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c7e10 msgr2=0x7f3ee80ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.655+0000 7f3eed85c700 1 --2- 172.21.15.78:0/3324424871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c7e10 0x7f3ee80ca650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3ed8009790 tx=0x7f3ed8009060).stop 2023-08-17T17:53:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.655+0000 7f3eed85c700 1 -- 172.21.15.78:0/3324424871 shutdown_connections 2023-08-17T17:53:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.655+0000 7f3eed85c700 1 --2- 172.21.15.78:0/3324424871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c7e10 0x7f3ee80ca650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.655+0000 7f3eed85c700 1 -- 172.21.15.78:0/3324424871 >> 172.21.15.78:0/3324424871 conn(0x7f3ee8094650 msgr2=0x7f3ee806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.655+0000 7f3eed85c700 1 -- 172.21.15.78:0/3324424871 shutdown_connections 2023-08-17T17:53:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.655+0000 7f3eed85c700 1 -- 172.21.15.78:0/3324424871 wait complete. 2023-08-17T17:53:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.656+0000 7f3eed85c700 1 Processor -- start 2023-08-17T17:53:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.656+0000 7f3eed85c700 1 -- start start 2023-08-17T17:53:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3eed85c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c0f10 0x7f3ee80acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3eed85c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee80c7e10 0x7f3ee80649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3eed85c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee8154110 0x7f3ee81634f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3eed85c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee814f380 con 0x7f3ee80c7e10 2023-08-17T17:53:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3eed85c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee8064ed0 con 0x7f3ee8154110 2023-08-17T17:53:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3eed85c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee8151fa0 con 0x7f3ee80c0f10 2023-08-17T17:53:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3ee67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee80c7e10 0x7f3ee80649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3ee67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee80c7e10 0x7f3ee80649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46106/0 (socket says 172.21.15.78:46106) 2023-08-17T17:53:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3ee67fc700 1 -- 172.21.15.78:0/3169470082 learned_addr learned my addr 172.21.15.78:0/3169470082 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3ee77fe700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee8154110 0x7f3ee81634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.657+0000 7f3ee6ffd700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c0f10 0x7f3ee80acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3ee67fc700 1 -- 172.21.15.78:0/3169470082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c0f10 msgr2=0x7f3ee80acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3ee67fc700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c0f10 0x7f3ee80acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3ee67fc700 1 -- 172.21.15.78:0/3169470082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee8154110 msgr2=0x7f3ee81634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3ee67fc700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee8154110 0x7f3ee81634f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3ee67fc700 1 -- 172.21.15.78:0/3169470082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80092a0 con 0x7f3ee80c7e10 2023-08-17T17:53:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3ee67fc700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee80c7e10 0x7f3ee80649e0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f3ed000c810 tx=0x7f3ed0007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3edeffd700 1 -- 172.21.15.78:0/3169470082 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0007170 con 0x7f3ee80c7e10 2023-08-17T17:53:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3edeffd700 1 -- 172.21.15.78:0/3169470082 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed00072d0 con 0x7f3ee80c7e10 2023-08-17T17:53:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3eed85c700 1 -- 172.21.15.78:0/3169470082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee8152280 con 0x7f3ee80c7e10 2023-08-17T17:53:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3edeffd700 1 -- 172.21.15.78:0/3169470082 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00048c0 con 0x7f3ee80c7e10 2023-08-17T17:53:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.658+0000 7f3eed85c700 1 -- 172.21.15.78:0/3169470082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee8152840 con 0x7f3ee80c7e10 2023-08-17T17:53:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.659+0000 7f3eed85c700 1 -- 172.21.15.78:0/3169470082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee8047350 con 0x7f3ee80c7e10 2023-08-17T17:53:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.659+0000 7f3edeffd700 1 -- 172.21.15.78:0/3169470082 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3ed001b070 con 0x7f3ee80c7e10 2023-08-17T17:53:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.660+0000 7f3edeffd700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ec805ed60 0x7f3ec8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.660+0000 7f3ee6ffd700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ec805ed60 0x7f3ec8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.660+0000 7f3edeffd700 1 -- 172.21.15.78:0/3169470082 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f3ed0078f70 con 0x7f3ee80c7e10 2023-08-17T17:53:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.660+0000 7f3ee6ffd700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ec805ed60 0x7f3ec8061220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3ee0001560 tx=0x7f3ee0007f30).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.664+0000 7f3edeffd700 1 -- 172.21.15.78:0/3169470082 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ed004a6f0 con 0x7f3ee80c7e10 2023-08-17T17:53:47.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:47.825+0000 7f3eed85c700 1 -- 172.21.15.78:0/3169470082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3ee8152e50 con 0x7f3ee80c7e10 2023-08-17T17:53:48.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.523+0000 7f3edeffd700 1 -- 172.21.15.78:0/3169470082 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v147) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3ed0019020 con 0x7f3ee80c7e10 2023-08-17T17:53:48.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.526+0000 7f3eed85c700 1 -- 172.21.15.78:0/3169470082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ec805ed60 msgr2=0x7f3ec8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:48.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.526+0000 7f3eed85c700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ec805ed60 0x7f3ec8061220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3ee0001560 tx=0x7f3ee0007f30).stop 2023-08-17T17:53:48.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.526+0000 7f3eed85c700 1 -- 172.21.15.78:0/3169470082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee80c7e10 msgr2=0x7f3ee80649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:48.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.526+0000 7f3eed85c700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee80c7e10 0x7f3ee80649e0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f3ed000c810 tx=0x7f3ed0007bc0).stop 2023-08-17T17:53:48.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.527+0000 7f3eed85c700 1 -- 172.21.15.78:0/3169470082 shutdown_connections 2023-08-17T17:53:48.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.527+0000 7f3eed85c700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f3ec805ed60 0x7f3ec8061220 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.527+0000 7f3eed85c700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee8154110 0x7f3ee81634f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.527+0000 7f3eed85c700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ee80c0f10 0x7f3ee80acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.527+0000 7f3eed85c700 1 --2- 172.21.15.78:0/3169470082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ee80c7e10 0x7f3ee80649e0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.527+0000 7f3eed85c700 1 -- 172.21.15.78:0/3169470082 >> 172.21.15.78:0/3169470082 conn(0x7f3ee8094650 msgr2=0x7f3ee814f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.528+0000 7f3eed85c700 1 -- 172.21.15.78:0/3169470082 shutdown_connections 2023-08-17T17:53:48.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.528+0000 7f3eed85c700 1 -- 172.21.15.78:0/3169470082 wait complete. 2023-08-17T17:53:48.540 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T17:53:48.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T17:53:48.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.673+0000 7f8d76f37700 1 Processor -- start 2023-08-17T17:53:48.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.673+0000 7f8d76f37700 1 -- start start 2023-08-17T17:53:48.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.674+0000 7f8d76f37700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8d700aa4d0 0x7f8d700644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:48.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.674+0000 7f8d76f37700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700c5810 0x7f8d700c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:48.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.674+0000 7f8d76f37700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d700649b0 con 0x7f8d700aa0f0 2023-08-17T17:53:48.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.674+0000 7f8d76f37700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d700c6170 con 0x7f8d700aa4d0 2023-08-17T17:53:48.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.674+0000 7f8d76f37700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70063420 con 0x7f8d700c5810 2023-08-17T17:53:48.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.674+0000 7f8d754d4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700c5810 0x7f8d700c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:48.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.674+0000 7f8d6ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8d700aa4d0 0x7f8d700644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:48.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.674+0000 7f8d754d4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700c5810 0x7f8d700c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:53224/0 (socket says 172.21.15.78:53224) 2023-08-17T17:53:48.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.674+0000 7f8d754d4700 1 -- 172.21.15.78:0/1966593340 learned_addr learned my addr 172.21.15.78:0/1966593340 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:48.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.674+0000 7f8d74cd3700 1 --1- 172.21.15.78:0/1966593340 >> v1:172.21.15.150:6789/0 conn(0x7f8d700aa0f0 0x7f8d700c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:60778/0 (socket says 172.21.15.78:60778) 2023-08-17T17:53:48.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.675+0000 7f8d754d4700 1 -- 172.21.15.78:0/1966593340 >> v2:172.21.15.150:3300/0 conn(0x7f8d700aa4d0 msgr2=0x7f8d700644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:48.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.675+0000 7f8d754d4700 1 --2- 172.21.15.78:0/1966593340 >> v2:172.21.15.150:3300/0 conn(0x7f8d700aa4d0 0x7f8d700644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.675+0000 7f8d754d4700 1 -- 172.21.15.78:0/1966593340 >> v1:172.21.15.150:6789/0 conn(0x7f8d700aa0f0 legacy=0x7f8d700c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:48.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.675+0000 7f8d754d4700 1 -- 172.21.15.78:0/1966593340 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70063700 con 0x7f8d700c5810 2023-08-17T17:53:48.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.675+0000 7f8d6ffff700 1 --2- 172.21.15.78:0/1966593340 >> v2:172.21.15.150:3300/0 conn(0x7f8d700aa4d0 0x7f8d700644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:53:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.675+0000 7f8d754d4700 1 --2- 172.21.15.78:0/1966593340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700c5810 0x7f8d700c5c80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8d68006fd0 tx=0x7f8d680090f0).ready entity=mon.2 client_cookie=98018e9dbc707b23 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.675+0000 7f8d6f7fe700 1 -- 172.21.15.78:0/1966593340 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6800b580 con 0x7f8d700c5810 2023-08-17T17:53:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.675+0000 7f8d6f7fe700 1 -- 172.21.15.78:0/1966593340 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6800b6e0 con 0x7f8d700c5810 2023-08-17T17:53:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.675+0000 7f8d6f7fe700 1 -- 172.21.15.78:0/1966593340 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6800ba60 con 0x7f8d700c5810 2023-08-17T17:53:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.676+0000 7f8d76f37700 1 -- 172.21.15.78:0/1966593340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700c5810 msgr2=0x7f8d700c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.676+0000 7f8d76f37700 1 --2- 172.21.15.78:0/1966593340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700c5810 0x7f8d700c5c80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8d68006fd0 tx=0x7f8d680090f0).stop 2023-08-17T17:53:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.676+0000 7f8d76f37700 1 -- 172.21.15.78:0/1966593340 shutdown_connections 2023-08-17T17:53:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.676+0000 7f8d76f37700 1 --2- 172.21.15.78:0/1966593340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700c5810 0x7f8d700c5c80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.676+0000 7f8d76f37700 1 --2- 172.21.15.78:0/1966593340 >> v2:172.21.15.150:3300/0 conn(0x7f8d700aa4d0 0x7f8d700644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.676+0000 7f8d76f37700 1 -- 172.21.15.78:0/1966593340 >> 172.21.15.78:0/1966593340 conn(0x7f8d7006a6a0 msgr2=0x7f8d700caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.676+0000 7f8d76f37700 1 -- 172.21.15.78:0/1966593340 shutdown_connections 2023-08-17T17:53:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.676+0000 7f8d76f37700 1 -- 172.21.15.78:0/1966593340 wait complete. 2023-08-17T17:53:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.677+0000 7f8d76f37700 1 Processor -- start 2023-08-17T17:53:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.677+0000 7f8d76f37700 1 -- start start 2023-08-17T17:53:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d76f37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d700aa0f0 0x7f8d700ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d76f37700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700aa4d0 0x7f8d701469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d76f37700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d700c5810 0x7f8d700c3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d76f37700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700aed40 con 0x7f8d700aa0f0 2023-08-17T17:53:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d76f37700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700af7c0 con 0x7f8d700c5810 2023-08-17T17:53:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d76f37700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70164570 con 0x7f8d700aa4d0 2023-08-17T17:53:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d74cd3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d700aa0f0 0x7f8d700ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d74cd3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d700aa0f0 0x7f8d700ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57408/0 (socket says 172.21.15.78:57408) 2023-08-17T17:53:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d74cd3700 1 -- 172.21.15.78:0/2068513585 learned_addr learned my addr 172.21.15.78:0/2068513585 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:48.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d754d4700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d700c5810 0x7f8d700c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:48.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d6ffff700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700aa4d0 0x7f8d701469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:48.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d74cd3700 1 -- 172.21.15.78:0/2068513585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700aa4d0 msgr2=0x7f8d701469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:48.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d74cd3700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700aa4d0 0x7f8d701469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d74cd3700 1 -- 172.21.15.78:0/2068513585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d700c5810 msgr2=0x7f8d700c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:48.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d74cd3700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d700c5810 0x7f8d700c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d74cd3700 1 -- 172.21.15.78:0/2068513585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d640092a0 con 0x7f8d700aa0f0 2023-08-17T17:53:48.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d74cd3700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d700aa0f0 0x7f8d700ae850 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f8d6000c790 tx=0x7f8d60001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:48.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d6cff9700 1 -- 172.21.15.78:0/2068513585 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60005c70 con 0x7f8d700aa0f0 2023-08-17T17:53:48.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d6cff9700 1 -- 172.21.15.78:0/2068513585 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60005dd0 con 0x7f8d700aa0f0 2023-08-17T17:53:48.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d76f37700 1 -- 172.21.15.78:0/2068513585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d68009370 con 0x7f8d700aa0f0 2023-08-17T17:53:48.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d6cff9700 1 -- 172.21.15.78:0/2068513585 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60007300 con 0x7f8d700aa0f0 2023-08-17T17:53:48.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.678+0000 7f8d76f37700 1 -- 172.21.15.78:0/2068513585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d700aef20 con 0x7f8d700aa0f0 2023-08-17T17:53:48.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.679+0000 7f8d76f37700 1 -- 172.21.15.78:0/2068513585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d70083980 con 0x7f8d700aa0f0 2023-08-17T17:53:48.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.680+0000 7f8d6cff9700 1 -- 172.21.15.78:0/2068513585 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8d60010070 con 0x7f8d700aa0f0 2023-08-17T17:53:48.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.680+0000 7f8d6cff9700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d5c05ed60 0x7f8d5c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:48.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.680+0000 7f8d6cff9700 1 -- 172.21.15.78:0/2068513585 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f8d600796f0 con 0x7f8d700aa0f0 2023-08-17T17:53:48.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.680+0000 7f8d6ffff700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d5c05ed60 0x7f8d5c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:48.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.681+0000 7f8d6ffff700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d5c05ed60 0x7f8d5c061220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8d70152850 tx=0x7f8d64009060).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:48.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.684+0000 7f8d6cff9700 1 -- 172.21.15.78:0/2068513585 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8d6004ad70 con 0x7f8d700aa0f0 2023-08-17T17:53:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.887+0000 7f8d76f37700 1 -- 172.21.15.78:0/2068513585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8d700cbd40 con 0x7f8d700aa0f0 2023-08-17T17:53:48.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.895+0000 7f8d6cff9700 1 -- 172.21.15.78:0/2068513585 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v53) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8d6004e390 con 0x7f8d700aa0f0 2023-08-17T17:53:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.898+0000 7f8d76f37700 1 -- 172.21.15.78:0/2068513585 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d5c05ed60 msgr2=0x7f8d5c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.898+0000 7f8d76f37700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d5c05ed60 0x7f8d5c061220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8d70152850 tx=0x7f8d64009060).stop 2023-08-17T17:53:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.898+0000 7f8d76f37700 1 -- 172.21.15.78:0/2068513585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d700aa0f0 msgr2=0x7f8d700ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.898+0000 7f8d76f37700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d700aa0f0 0x7f8d700ae850 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f8d6000c790 tx=0x7f8d60001560).stop 2023-08-17T17:53:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.899+0000 7f8d76f37700 1 -- 172.21.15.78:0/2068513585 shutdown_connections 2023-08-17T17:53:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.899+0000 7f8d76f37700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f8d5c05ed60 0x7f8d5c061220 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.899+0000 7f8d76f37700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d700c5810 0x7f8d700c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.899+0000 7f8d76f37700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d700aa0f0 0x7f8d700ae850 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.899+0000 7f8d76f37700 1 --2- 172.21.15.78:0/2068513585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d700aa4d0 0x7f8d701469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:48.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.899+0000 7f8d76f37700 1 -- 172.21.15.78:0/2068513585 >> 172.21.15.78:0/2068513585 conn(0x7f8d7006a6a0 msgr2=0x7f8d70152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:48.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.899+0000 7f8d76f37700 1 -- 172.21.15.78:0/2068513585 shutdown_connections 2023-08-17T17:53:48.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:48.900+0000 7f8d76f37700 1 -- 172.21.15.78:0/2068513585 wait complete. 2023-08-17T17:53:48.906 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 19 and data pool 20 2023-08-17T17:53:48.923 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:49.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.034+0000 7ff704350700 1 Processor -- start 2023-08-17T17:53:49.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.034+0000 7ff704350700 1 -- start start 2023-08-17T17:53:49.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.035+0000 7ff704350700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6fc0650a0 0x7ff6fc1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.035+0000 7ff704350700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc155060 con 0x7ff6fc0c1a00 2023-08-17T17:53:49.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.035+0000 7ff704350700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc151be0 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.035+0000 7ff704350700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0699f0 con 0x7ff6fc0650a0 2023-08-17T17:53:49.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.035+0000 7ff7020ec700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6fc0650a0 0x7ff6fc1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.036+0000 7ff7018eb700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff6fc0c1a00 0x7ff6fc154240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41126/0 (socket says 172.21.15.78:41126) 2023-08-17T17:53:49.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.036+0000 7ff7018eb700 1 -- 172.21.15.78:0/1333825143 learned_addr learned my addr 172.21.15.78:0/1333825143 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:49.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.036+0000 7ff7020ec700 1 -- 172.21.15.78:0/1333825143 >> v1:172.21.15.150:6789/0 conn(0x7ff6fc0c1eb0 legacy=0x7ff6fc154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:49.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.036+0000 7ff7020ec700 1 -- 172.21.15.78:0/1333825143 >> v1:172.21.15.78:6789/0 conn(0x7ff6fc0c1a00 legacy=0x7ff6fc154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.036+0000 7ff7020ec700 1 -- 172.21.15.78:0/1333825143 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc068950 con 0x7ff6fc0650a0 2023-08-17T17:53:49.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.036+0000 7ff7010ea700 1 -- 172.21.15.78:0/1333825143 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57771115 0 0) 0x7ff6fc155060 con 0x7ff6fc0c1a00 2023-08-17T17:53:49.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.036+0000 7ff7020ec700 1 --2- 172.21.15.78:0/1333825143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0650a0 0x7ff6fc1516f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7ff6f8009e60 tx=0x7ff6f8009780).ready entity=mon.0 client_cookie=1a4bb57ed7c2d056 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:49.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.036+0000 7ff7010ea700 1 -- 172.21.15.78:0/1333825143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f800e070 con 0x7ff6fc0650a0 2023-08-17T17:53:49.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.036+0000 7ff7010ea700 1 -- 172.21.15.78:0/1333825143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f800bbf0 con 0x7ff6fc0650a0 2023-08-17T17:53:49.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.036+0000 7ff7010ea700 1 -- 172.21.15.78:0/1333825143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8012410 con 0x7ff6fc0650a0 2023-08-17T17:53:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.037+0000 7ff704350700 1 -- 172.21.15.78:0/1333825143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0650a0 msgr2=0x7ff6fc1516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.037+0000 7ff704350700 1 --2- 172.21.15.78:0/1333825143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0650a0 0x7ff6fc1516f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7ff6f8009e60 tx=0x7ff6f8009780).stop 2023-08-17T17:53:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.037+0000 7ff704350700 1 -- 172.21.15.78:0/1333825143 shutdown_connections 2023-08-17T17:53:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.037+0000 7ff704350700 1 --2- 172.21.15.78:0/1333825143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0650a0 0x7ff6fc1516f0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.037+0000 7ff704350700 1 -- 172.21.15.78:0/1333825143 >> 172.21.15.78:0/1333825143 conn(0x7ff6fc062fc0 msgr2=0x7ff6fc0c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.037+0000 7ff704350700 1 -- 172.21.15.78:0/1333825143 shutdown_connections 2023-08-17T17:53:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.037+0000 7ff704350700 1 -- 172.21.15.78:0/1333825143 wait complete. 2023-08-17T17:53:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.038+0000 7ff704350700 1 Processor -- start 2023-08-17T17:53:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.038+0000 7ff704350700 1 -- start start 2023-08-17T17:53:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.038+0000 7ff704350700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6fc0650a0 0x7ff6fc0ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.038+0000 7ff704350700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6fc0c1a00 0x7ff6fc13e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.038+0000 7ff704350700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0c1eb0 0x7ff6fc14f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.038+0000 7ff704350700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0aaa70 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff704350700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc13ee60 con 0x7ff6fc0c1a00 2023-08-17T17:53:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff704350700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0ac010 con 0x7ff6fc0650a0 2023-08-17T17:53:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7028ed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0c1eb0 0x7ff6fc14f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7028ed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0c1eb0 0x7ff6fc14f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57416/0 (socket says 172.21.15.78:57416) 2023-08-17T17:53:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7028ed700 1 -- 172.21.15.78:0/847653327 learned_addr learned my addr 172.21.15.78:0/847653327 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7018eb700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6fc0c1a00 0x7ff6fc13e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7020ec700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6fc0650a0 0x7ff6fc0ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7028ed700 1 -- 172.21.15.78:0/847653327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6fc0650a0 msgr2=0x7ff6fc0ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7028ed700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6fc0650a0 0x7ff6fc0ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7028ed700 1 -- 172.21.15.78:0/847653327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6fc0c1a00 msgr2=0x7ff6fc13e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7028ed700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6fc0c1a00 0x7ff6fc13e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7028ed700 1 -- 172.21.15.78:0/847653327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8009a20 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7020ec700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6fc0650a0 0x7ff6fc0ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff7028ed700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0c1eb0 0x7ff6fc14f790 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7ff6f4009470 tx=0x7ff6f4006ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff6f27fc700 1 -- 172.21.15.78:0/847653327 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4013460 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff6f27fc700 1 -- 172.21.15.78:0/847653327 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f40135e0 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff704350700 1 -- 172.21.15.78:0/847653327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc0ab6e0 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff6f27fc700 1 -- 172.21.15.78:0/847653327 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40139a0 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.039+0000 7ff704350700 1 -- 172.21.15.78:0/847653327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc0abca0 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.040+0000 7ff704350700 1 -- 172.21.15.78:0/847653327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc0ac180 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.040+0000 7ff6f27fc700 1 -- 172.21.15.78:0/847653327 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff6f401a060 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.041+0000 7ff6f27fc700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6e005ed90 0x7ff6e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.041+0000 7ff6f27fc700 1 -- 172.21.15.78:0/847653327 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff6f40791d0 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.041+0000 7ff7020ec700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6e005ed90 0x7ff6e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.041+0000 7ff7020ec700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6e005ed90 0x7ff6e0061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff6f8009480 tx=0x7ff6f8009780).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:49.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.045+0000 7ff6f27fc700 1 -- 172.21.15.78:0/847653327 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff6f404a770 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.207+0000 7ff704350700 1 -- 172.21.15.78:0/847653327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6fc047350 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.208+0000 7ff6f27fc700 1 -- 172.21.15.78:0/847653327 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+17004 (secure 0 0 0) 0x7ff6f4018030 con 0x7ff6fc0c1eb0 2023-08-17T17:53:49.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:49.210 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":148,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:48.889002+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:47.436687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:47.849880+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:49.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 -- 172.21.15.78:0/847653327 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6e005ed90 msgr2=0x7ff6e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6e005ed90 0x7ff6e0061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff6f8009480 tx=0x7ff6f8009780).stop 2023-08-17T17:53:49.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 -- 172.21.15.78:0/847653327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0c1eb0 msgr2=0x7ff6fc14f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0c1eb0 0x7ff6fc14f790 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7ff6f4009470 tx=0x7ff6f4006ea0).stop 2023-08-17T17:53:49.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 -- 172.21.15.78:0/847653327 shutdown_connections 2023-08-17T17:53:49.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff6e005ed90 0x7ff6e0061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc0c1eb0 0x7ff6fc14f790 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6fc0650a0 0x7ff6fc0ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 --2- 172.21.15.78:0/847653327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6fc0c1a00 0x7ff6fc13e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 -- 172.21.15.78:0/847653327 >> 172.21.15.78:0/847653327 conn(0x7ff6fc062fc0 msgr2=0x7ff6fc0643f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:49.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 -- 172.21.15.78:0/847653327 shutdown_connections 2023-08-17T17:53:49.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.210+0000 7ff704350700 1 -- 172.21.15.78:0/847653327 wait complete. 2023-08-17T17:53:49.223 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:49.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.334+0000 7f297c1bf700 1 Processor -- start 2023-08-17T17:53:49.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.334+0000 7f297c1bf700 1 -- start start 2023-08-17T17:53:49.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.335+0000 7f297c1bf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2974154140 0x7f29740c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.335+0000 7f297c1bf700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29740c1010 0x7f29740ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.335+0000 7f297c1bf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2974154520 con 0x7f29740a7c40 2023-08-17T17:53:49.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.335+0000 7f297c1bf700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29740c91e0 con 0x7f29740c1010 2023-08-17T17:53:49.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.335+0000 7f297c1bf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29740c94c0 con 0x7f2974154140 2023-08-17T17:53:49.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.335+0000 7f297a75c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29740c1010 0x7f29740ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.335+0000 7f297a75c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29740c1010 0x7f29740ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57432/0 (socket says 172.21.15.78:57432) 2023-08-17T17:53:49.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.335+0000 7f297a75c700 1 -- 172.21.15.78:0/2453537048 learned_addr learned my addr 172.21.15.78:0/2453537048 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:49.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.335+0000 7f2979f5b700 1 --2- 172.21.15.78:0/2453537048 >> v2:172.21.15.150:3300/0 conn(0x7f2974154140 0x7f29740c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297a75c700 1 -- 172.21.15.78:0/2453537048 >> v2:172.21.15.150:3300/0 conn(0x7f2974154140 msgr2=0x7f29740c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:49.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297a75c700 1 --2- 172.21.15.78:0/2453537048 >> v2:172.21.15.150:3300/0 conn(0x7f2974154140 0x7f29740c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297a75c700 1 -- 172.21.15.78:0/2453537048 >> v1:172.21.15.150:6789/0 conn(0x7f29740a7c40 legacy=0x7f29740c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297a75c700 1 -- 172.21.15.78:0/2453537048 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29740c97a0 con 0x7f29740c1010 2023-08-17T17:53:49.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297a75c700 1 --2- 172.21.15.78:0/2453537048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 0x7f29740ca280 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f29740625b0 tx=0x7f296c0090f0).ready entity=mon.0 client_cookie=2ca778961b1e4e76 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:49.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f2978f59700 1 -- 172.21.15.78:0/2453537048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c00b600 con 0x7f29740c1010 2023-08-17T17:53:49.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f2978f59700 1 -- 172.21.15.78:0/2453537048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c00b760 con 0x7f29740c1010 2023-08-17T17:53:49.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f2978f59700 1 -- 172.21.15.78:0/2453537048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c00bae0 con 0x7f29740c1010 2023-08-17T17:53:49.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297c1bf700 1 -- 172.21.15.78:0/2453537048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 msgr2=0x7f29740ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297c1bf700 1 --2- 172.21.15.78:0/2453537048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 0x7f29740ca280 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f29740625b0 tx=0x7f296c0090f0).stop 2023-08-17T17:53:49.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297c1bf700 1 -- 172.21.15.78:0/2453537048 shutdown_connections 2023-08-17T17:53:49.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297c1bf700 1 --2- 172.21.15.78:0/2453537048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 0x7f29740ca280 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297c1bf700 1 --2- 172.21.15.78:0/2453537048 >> v2:172.21.15.150:3300/0 conn(0x7f2974154140 0x7f29740c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297c1bf700 1 -- 172.21.15.78:0/2453537048 >> 172.21.15.78:0/2453537048 conn(0x7f2974094510 msgr2=0x7f297406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:49.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297c1bf700 1 -- 172.21.15.78:0/2453537048 shutdown_connections 2023-08-17T17:53:49.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.336+0000 7f297c1bf700 1 -- 172.21.15.78:0/2453537048 wait complete. 2023-08-17T17:53:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.337+0000 7f297c1bf700 1 Processor -- start 2023-08-17T17:53:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297c1bf700 1 -- start start 2023-08-17T17:53:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297c1bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29740a7c40 0x7f29740af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297c1bf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 0x7f297414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297c1bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2974154140 0x7f2974150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297c1bf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29740afc90 con 0x7f29740c1010 2023-08-17T17:53:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297c1bf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29740aff70 con 0x7f29740a7c40 2023-08-17T17:53:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297c1bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29740b0250 con 0x7f2974154140 2023-08-17T17:53:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297975a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 0x7f297414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297975a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 0x7f297414e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57438/0 (socket says 172.21.15.78:57438) 2023-08-17T17:53:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297975a700 1 -- 172.21.15.78:0/3768330025 learned_addr learned my addr 172.21.15.78:0/3768330025 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.338+0000 7f297a75c700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2974154140 0x7f2974150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f2979f5b700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29740a7c40 0x7f29740af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f297975a700 1 -- 172.21.15.78:0/3768330025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2974154140 msgr2=0x7f2974150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f297975a700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2974154140 0x7f2974150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f297975a700 1 -- 172.21.15.78:0/3768330025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29740a7c40 msgr2=0x7f29740af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f297975a700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29740a7c40 0x7f29740af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f297975a700 1 -- 172.21.15.78:0/3768330025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c009370 con 0x7f29740c1010 2023-08-17T17:53:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f2979f5b700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29740a7c40 0x7f29740af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f297975a700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 0x7f297414e100 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f296400c440 tx=0x7f2964007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f2969ffb700 1 -- 172.21.15.78:0/3768330025 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400ce40 con 0x7f29740c1010 2023-08-17T17:53:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f2969ffb700 1 -- 172.21.15.78:0/3768330025 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2964007020 con 0x7f29740c1010 2023-08-17T17:53:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f297c1bf700 1 -- 172.21.15.78:0/3768330025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29740b0530 con 0x7f29740c1010 2023-08-17T17:53:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f2969ffb700 1 -- 172.21.15.78:0/3768330025 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29640073c0 con 0x7f29740c1010 2023-08-17T17:53:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.339+0000 7f297c1bf700 1 -- 172.21.15.78:0/3768330025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297414ebd0 con 0x7f29740c1010 2023-08-17T17:53:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.340+0000 7f297c1bf700 1 -- 172.21.15.78:0/3768330025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29740b0a50 con 0x7f29740c1010 2023-08-17T17:53:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.341+0000 7f2969ffb700 1 -- 172.21.15.78:0/3768330025 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2964010070 con 0x7f29740c1010 2023-08-17T17:53:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.341+0000 7f2969ffb700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f295805ed90 0x7f2958061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.341+0000 7f2969ffb700 1 -- 172.21.15.78:0/3768330025 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2964078cc0 con 0x7f29740c1010 2023-08-17T17:53:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.341+0000 7f2979f5b700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f295805ed90 0x7f2958061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.341+0000 7f2979f5b700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f295805ed90 0x7f2958061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f29700075e0 tx=0x7f29700097e0).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.345+0000 7f2969ffb700 1 -- 172.21.15.78:0/3768330025 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29640478f0 con 0x7f29740c1010 2023-08-17T17:53:49.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.508+0000 7f297c1bf700 1 -- 172.21.15.78:0/3768330025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2974047350 con 0x7f29740c1010 2023-08-17T17:53:49.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.508+0000 7f2969ffb700 1 -- 172.21.15.78:0/3768330025 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+17004 (secure 0 0 0) 0x7f29740b0a50 con 0x7f29740c1010 2023-08-17T17:53:49.510 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:49.510 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":148,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:48.889002+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:47.436687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:47.849880+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:49.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 -- 172.21.15.78:0/3768330025 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f295805ed90 msgr2=0x7f2958061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f295805ed90 0x7f2958061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f29700075e0 tx=0x7f29700097e0).stop 2023-08-17T17:53:49.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 -- 172.21.15.78:0/3768330025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 msgr2=0x7f297414e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 0x7f297414e100 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f296400c440 tx=0x7f2964007e00).stop 2023-08-17T17:53:49.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 -- 172.21.15.78:0/3768330025 shutdown_connections 2023-08-17T17:53:49.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f295805ed90 0x7f2958061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2974154140 0x7f2974150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29740a7c40 0x7f29740af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 --2- 172.21.15.78:0/3768330025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29740c1010 0x7f297414e100 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 -- 172.21.15.78:0/3768330025 >> 172.21.15.78:0/3768330025 conn(0x7f2974094510 msgr2=0x7f29740ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:49.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.510+0000 7f297c1bf700 1 -- 172.21.15.78:0/3768330025 shutdown_connections 2023-08-17T17:53:49.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.511+0000 7f297c1bf700 1 -- 172.21.15.78:0/3768330025 wait complete. 2023-08-17T17:53:49.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T17:53:49.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.638+0000 7fa347c60700 1 Processor -- start 2023-08-17T17:53:49.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.638+0000 7fa347c60700 1 -- start start 2023-08-17T17:53:49.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.639+0000 7fa347c60700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3400c5f20 0x7fa3400644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.639+0000 7fa347c60700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3400649b0 con 0x7fa3400aa0f0 2023-08-17T17:53:49.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.639+0000 7fa347c60700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa340063420 con 0x7fa3400aa4d0 2023-08-17T17:53:49.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.639+0000 7fa347c60700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa340063700 con 0x7fa3400c5f20 2023-08-17T17:53:49.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.639+0000 7fa3459fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa3400aa0f0 0x7fa3400c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41128/0 (socket says 172.21.15.78:41128) 2023-08-17T17:53:49.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.639+0000 7fa3459fc700 1 -- 172.21.15.78:0/1776072910 learned_addr learned my addr 172.21.15.78:0/1776072910 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:49.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.639+0000 7fa3461fd700 1 --2- 172.21.15.78:0/1776072910 >> v2:172.21.15.78:3300/0 conn(0x7fa3400c5f20 0x7fa3400644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.639+0000 7fa3449fa700 1 -- 172.21.15.78:0/1776072910 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376402046 0 0) 0x7fa3400649b0 con 0x7fa3400aa0f0 2023-08-17T17:53:49.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.639+0000 7fa3449fa700 1 -- 172.21.15.78:0/1776072910 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa32c0033f0 con 0x7fa3400aa0f0 2023-08-17T17:53:49.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa3461fd700 1 -- 172.21.15.78:0/1776072910 >> v1:172.21.15.150:6789/0 conn(0x7fa3400aa4d0 legacy=0x7fa3400c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:49.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa3461fd700 1 -- 172.21.15.78:0/1776072910 >> v1:172.21.15.78:6789/0 conn(0x7fa3400aa0f0 legacy=0x7fa3400c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa3461fd700 1 -- 172.21.15.78:0/1776072910 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400639e0 con 0x7fa3400c5f20 2023-08-17T17:53:49.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa3461fd700 1 --2- 172.21.15.78:0/1776072910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400c5f20 0x7fa3400644c0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fa338009e60 tx=0x7fa338009780).ready entity=mon.0 client_cookie=21125ac073bf20b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:49.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa3449fa700 1 -- 172.21.15.78:0/1776072910 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33800e070 con 0x7fa3400c5f20 2023-08-17T17:53:49.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa3449fa700 1 -- 172.21.15.78:0/1776072910 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33800bb60 con 0x7fa3400c5f20 2023-08-17T17:53:49.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa3449fa700 1 -- 172.21.15.78:0/1776072910 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338012410 con 0x7fa3400c5f20 2023-08-17T17:53:49.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa347c60700 1 -- 172.21.15.78:0/1776072910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400c5f20 msgr2=0x7fa3400644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa347c60700 1 --2- 172.21.15.78:0/1776072910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400c5f20 0x7fa3400644c0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fa338009e60 tx=0x7fa338009780).stop 2023-08-17T17:53:49.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa347c60700 1 -- 172.21.15.78:0/1776072910 shutdown_connections 2023-08-17T17:53:49.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa347c60700 1 --2- 172.21.15.78:0/1776072910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400c5f20 0x7fa3400644c0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa347c60700 1 -- 172.21.15.78:0/1776072910 >> 172.21.15.78:0/1776072910 conn(0x7fa34006a6a0 msgr2=0x7fa3400caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:49.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa347c60700 1 -- 172.21.15.78:0/1776072910 shutdown_connections 2023-08-17T17:53:49.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.640+0000 7fa347c60700 1 -- 172.21.15.78:0/1776072910 wait complete. 2023-08-17T17:53:49.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa347c60700 1 Processor -- start 2023-08-17T17:53:49.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa347c60700 1 -- start start 2023-08-17T17:53:49.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa347c60700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400aa0f0 0x7fa3401685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa347c60700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3400aa4d0 0x7fa340145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa347c60700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3400c5f20 0x7fa3400c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa347c60700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa340168ab0 con 0x7fa3400aa0f0 2023-08-17T17:53:49.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa347c60700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400ac400 con 0x7fa3400c5f20 2023-08-17T17:53:49.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa347c60700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400ac6e0 con 0x7fa3400aa4d0 2023-08-17T17:53:49.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa3459fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400aa0f0 0x7fa3401685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa3459fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400aa0f0 0x7fa3401685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57448/0 (socket says 172.21.15.78:57448) 2023-08-17T17:53:49.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.642+0000 7fa3459fc700 1 -- 172.21.15.78:0/1865708716 learned_addr learned my addr 172.21.15.78:0/1865708716 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:49.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa3459fc700 1 -- 172.21.15.78:0/1865708716 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3400aa4d0 msgr2=0x7fa340145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa3459fc700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3400aa4d0 0x7fa340145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:49.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa3459fc700 1 -- 172.21.15.78:0/1865708716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3400c5f20 msgr2=0x7fa3400c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa3459fc700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3400c5f20 0x7fa3400c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:49.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa3459fc700 1 -- 172.21.15.78:0/1865708716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338009a20 con 0x7fa3400aa0f0 2023-08-17T17:53:49.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa3459fc700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400aa0f0 0x7fa3401685c0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fa33c00c590 tx=0x7fa33c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:49.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa335ffb700 1 -- 172.21.15.78:0/1865708716 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c007e60 con 0x7fa3400aa0f0 2023-08-17T17:53:49.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa335ffb700 1 -- 172.21.15.78:0/1865708716 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c0072e0 con 0x7fa3400aa0f0 2023-08-17T17:53:49.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa347c60700 1 -- 172.21.15.78:0/1865708716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3400ac9c0 con 0x7fa3400aa0f0 2023-08-17T17:53:49.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa335ffb700 1 -- 172.21.15.78:0/1865708716 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0057a0 con 0x7fa3400aa0f0 2023-08-17T17:53:49.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.643+0000 7fa347c60700 1 -- 172.21.15.78:0/1865708716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3400acf80 con 0x7fa3400aa0f0 2023-08-17T17:53:49.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.644+0000 7fa347c60700 1 -- 172.21.15.78:0/1865708716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa340083980 con 0x7fa3400aa0f0 2023-08-17T17:53:49.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.644+0000 7fa335ffb700 1 -- 172.21.15.78:0/1865708716 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa33c01a060 con 0x7fa3400aa0f0 2023-08-17T17:53:49.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.645+0000 7fa335ffb700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa32405ed90 0x7fa324061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:49.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.645+0000 7fa335ffb700 1 -- 172.21.15.78:0/1865708716 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa33c078f40 con 0x7fa3400aa0f0 2023-08-17T17:53:49.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.645+0000 7fa3451fb700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa32405ed90 0x7fa324061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:49.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.645+0000 7fa3451fb700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa32405ed90 0x7fa324061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa340167b10 tx=0x7fa3300079c0).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:49.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.649+0000 7fa335ffb700 1 -- 172.21.15.78:0/1865708716 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa33c04a4e0 con 0x7fa3400aa0f0 2023-08-17T17:53:49.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.852+0000 7fa347c60700 1 -- 172.21.15.78:0/1865708716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa3400cbd40 con 0x7fa3400aa0f0 2023-08-17T17:53:49.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.895+0000 7fa335ffb700 1 -- 172.21.15.78:0/1865708716 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa33c018070 con 0x7fa3400aa0f0 2023-08-17T17:53:49.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 -- 172.21.15.78:0/1865708716 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa32405ed90 msgr2=0x7fa324061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa32405ed90 0x7fa324061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa340167b10 tx=0x7fa3300079c0).stop 2023-08-17T17:53:49.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 -- 172.21.15.78:0/1865708716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400aa0f0 msgr2=0x7fa3401685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:49.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400aa0f0 0x7fa3401685c0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fa33c00c590 tx=0x7fa33c007c80).stop 2023-08-17T17:53:49.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 -- 172.21.15.78:0/1865708716 shutdown_connections 2023-08-17T17:53:49.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa32405ed90 0x7fa324061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3400c5f20 0x7fa3400c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:49.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3400aa0f0 0x7fa3401685c0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:49.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 --2- 172.21.15.78:0/1865708716 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3400aa4d0 0x7fa340145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:49.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 -- 172.21.15.78:0/1865708716 >> 172.21.15.78:0/1865708716 conn(0x7fa34006a6a0 msgr2=0x7fa3400a8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:49.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 -- 172.21.15.78:0/1865708716 shutdown_connections 2023-08-17T17:53:49.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:49.898+0000 7fa347c60700 1 -- 172.21.15.78:0/1865708716 wait complete. 2023-08-17T17:53:49.911 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T17:53:49.911 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T17:53:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.025+0000 7fb180449700 1 Processor -- start 2023-08-17T17:53:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.025+0000 7fb180449700 1 -- start start 2023-08-17T17:53:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.026+0000 7fb180449700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780c5970 0x7fb178154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.026+0000 7fb180449700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780c2b00 con 0x7fb178155510 2023-08-17T17:53:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.026+0000 7fb180449700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17806a4c0 con 0x7fb178154ab0 2023-08-17T17:53:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.026+0000 7fb180449700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c1da0 con 0x7fb1780c5970 2023-08-17T17:53:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.026+0000 7fb17d9e4700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb178155510 0x7fb178068da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41130/0 (socket says 172.21.15.78:41130) 2023-08-17T17:53:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.026+0000 7fb17d9e4700 1 -- 172.21.15.78:0/1172044095 learned_addr learned my addr 172.21.15.78:0/1172044095 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17e9e6700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780c5970 0x7fb178154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537189106 0 0) 0x7fb1780c2b00 con 0x7fb178155510 2023-08-17T17:53:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1640033f0 con 0x7fb178155510 2023-08-17T17:53:50.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3033625662 0 0) 0x7fb1640033f0 con 0x7fb178155510 2023-08-17T17:53:50.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780c5970 msgr2=0x7fb178154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:50.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780c5970 0x7fb178154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:50.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 >> v1:172.21.15.150:6789/0 conn(0x7fb178154ab0 legacy=0x7fb1781507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:50.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780c1f80 con 0x7fb178155510 2023-08-17T17:53:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fb168001470 con 0x7fb178155510 2023-08-17T17:53:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 >> v1:172.21.15.78:6789/0 conn(0x7fb178155510 legacy=0x7fb178068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 0x7fb164003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780c5970 0x7fb164004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb164004b80 0x7fb164005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c1da0 con 0x7fb164003910 2023-08-17T17:53:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16400b8e0 con 0x7fb164004b80 2023-08-17T17:53:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16400ba50 con 0x7fb1780c5970 2023-08-17T17:53:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17e1e5700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 0x7fb164003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d9e4700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780c5970 0x7fb164004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17e9e6700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb164004b80 0x7fb164005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17e1e5700 1 -- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780c5970 msgr2=0x7fb164004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17e1e5700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780c5970 0x7fb164004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17e1e5700 1 -- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb164004b80 msgr2=0x7fb164005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17e1e5700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb164004b80 0x7fb164005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17e1e5700 1 -- 172.21.15.78:0/1172044095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640033f0 con 0x7fb164003910 2023-08-17T17:53:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17d9e4700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1780c5970 0x7fb164004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.027+0000 7fb17e1e5700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 0x7fb164003cf0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fb174001f20 tx=0x7fb174007f10).ready entity=mon.0 client_cookie=771674e66a518087 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.028+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740017e0 con 0x7fb164003910 2023-08-17T17:53:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.028+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17400c670 con 0x7fb164003910 2023-08-17T17:53:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.028+0000 7fb17d1e3700 1 -- 172.21.15.78:0/1172044095 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400ca10 con 0x7fb164003910 2023-08-17T17:53:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.028+0000 7fb180449700 1 -- 172.21.15.78:0/1172044095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 msgr2=0x7fb164003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.028+0000 7fb180449700 1 --2- 172.21.15.78:0/1172044095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 0x7fb164003cf0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fb174001f20 tx=0x7fb174007f10).stop 2023-08-17T17:53:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.028+0000 7fb17e9e6700 1 -- 172.21.15.78:0/1172044095 reap_dead start 2023-08-17T17:53:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.028+0000 7fb180449700 1 -- 172.21.15.78:0/1172044095 shutdown_connections 2023-08-17T17:53:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.028+0000 7fb180449700 1 -- 172.21.15.78:0/1172044095 >> 172.21.15.78:0/1172044095 conn(0x7fb1780c6a80 msgr2=0x7fb1780c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.028+0000 7fb180449700 1 -- 172.21.15.78:0/1172044095 shutdown_connections 2023-08-17T17:53:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.028+0000 7fb180449700 1 -- 172.21.15.78:0/1172044095 wait complete. 2023-08-17T17:53:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.029+0000 7fb180449700 1 Processor -- start 2023-08-17T17:53:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.029+0000 7fb180449700 1 -- start start 2023-08-17T17:53:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb180449700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 0x7fb178144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb180449700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb178148e60 0x7fb1780aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb180449700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1781404b0 0x7fb178147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb180449700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1781499a0 con 0x7fb164003910 2023-08-17T17:53:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb180449700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb178141050 con 0x7fb1781404b0 2023-08-17T17:53:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb180449700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780a9f40 con 0x7fb178148e60 2023-08-17T17:53:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17e1e5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 0x7fb178144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17e1e5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 0x7fb178144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57466/0 (socket says 172.21.15.78:57466) 2023-08-17T17:53:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17e1e5700 1 -- 172.21.15.78:0/1016206262 learned_addr learned my addr 172.21.15.78:0/1016206262 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17d9e4700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb178148e60 0x7fb1780aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17e9e6700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1781404b0 0x7fb178147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17e1e5700 1 -- 172.21.15.78:0/1016206262 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb178148e60 msgr2=0x7fb1780aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17e1e5700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb178148e60 0x7fb1780aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17e1e5700 1 -- 172.21.15.78:0/1016206262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1781404b0 msgr2=0x7fb178147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17e1e5700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1781404b0 0x7fb178147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17e1e5700 1 -- 172.21.15.78:0/1016206262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1781493e0 con 0x7fb164003910 2023-08-17T17:53:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.030+0000 7fb17e9e6700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1781404b0 0x7fb178147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.031+0000 7fb17e1e5700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 0x7fb178144930 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fb174007f70 tx=0x7fb174017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.031+0000 7fb16e7fc700 1 -- 172.21.15.78:0/1016206262 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400c9f0 con 0x7fb164003910 2023-08-17T17:53:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.031+0000 7fb16e7fc700 1 -- 172.21.15.78:0/1016206262 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174007040 con 0x7fb164003910 2023-08-17T17:53:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.031+0000 7fb16e7fc700 1 -- 172.21.15.78:0/1016206262 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740073c0 con 0x7fb164003910 2023-08-17T17:53:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.031+0000 7fb180449700 1 -- 172.21.15.78:0/1016206262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1781496c0 con 0x7fb164003910 2023-08-17T17:53:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.031+0000 7fb180449700 1 -- 172.21.15.78:0/1016206262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1780aa8c0 con 0x7fb164003910 2023-08-17T17:53:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.032+0000 7fb180449700 1 -- 172.21.15.78:0/1016206262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1780a9a30 con 0x7fb164003910 2023-08-17T17:53:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.032+0000 7fb16e7fc700 1 -- 172.21.15.78:0/1016206262 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb174010070 con 0x7fb164003910 2023-08-17T17:53:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.032+0000 7fb16e7fc700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb15c05edc0 0x7fb15c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.033+0000 7fb17d9e4700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb15c05edc0 0x7fb15c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.033+0000 7fb16e7fc700 1 -- 172.21.15.78:0/1016206262 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb17407ad70 con 0x7fb164003910 2023-08-17T17:53:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.033+0000 7fb17d9e4700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb15c05edc0 0x7fb15c061280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb1780acc20 tx=0x7fb168007040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.037+0000 7fb16e7fc700 1 -- 172.21.15.78:0/1016206262 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb1780a9a30 con 0x7fb164003910 2023-08-17T17:53:50.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.240+0000 7fb180449700 1 -- 172.21.15.78:0/1016206262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb1780a9a30 con 0x7fb164003910 2023-08-17T17:53:50.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.897+0000 7fb16e7fc700 1 -- 172.21.15.78:0/1016206262 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb1780a9a30 con 0x7fb164003910 2023-08-17T17:53:50.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 -- 172.21.15.78:0/1016206262 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb15c05edc0 msgr2=0x7fb15c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:50.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb15c05edc0 0x7fb15c061280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb1780acc20 tx=0x7fb168007040).stop 2023-08-17T17:53:50.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 -- 172.21.15.78:0/1016206262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 msgr2=0x7fb178144930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:50.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 0x7fb178144930 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fb174007f70 tx=0x7fb174017000).stop 2023-08-17T17:53:50.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 -- 172.21.15.78:0/1016206262 shutdown_connections 2023-08-17T17:53:50.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fb15c05edc0 0x7fb15c061280 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:50.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1781404b0 0x7fb178147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:50.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb164003910 0x7fb178144930 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:50.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 --2- 172.21.15.78:0/1016206262 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb178148e60 0x7fb1780aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:50.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 -- 172.21.15.78:0/1016206262 >> 172.21.15.78:0/1016206262 conn(0x7fb1780c6a80 msgr2=0x7fb17814af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:50.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 -- 172.21.15.78:0/1016206262 shutdown_connections 2023-08-17T17:53:50.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:50.899+0000 7fb180449700 1 -- 172.21.15.78:0/1016206262 wait complete. 2023-08-17T17:53:50.913 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T17:53:50.914 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:51.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.027+0000 7fedda18e700 1 Processor -- start 2023-08-17T17:53:51.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.027+0000 7fedda18e700 1 -- start start 2023-08-17T17:53:51.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.028+0000 7fedda18e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a7bd0 0x7fedd4063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.028+0000 7fedda18e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fedd40a8050 0x7fedd40642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.028+0000 7fedda18e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd4063960 con 0x7fedd40c01b0 2023-08-17T17:53:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.028+0000 7fedda18e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd4063030 con 0x7fedd40a8050 2023-08-17T17:53:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.028+0000 7fedda18e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4063310 con 0x7fedd40a7bd0 2023-08-17T17:53:51.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.028+0000 7fedd998d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fedd40a8050 0x7fedd40642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.028+0000 7fedd898b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a7bd0 0x7fedd4063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedd998d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fedd40a8050 0x7fedd40642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:45618/0 (socket says 172.21.15.78:45618) 2023-08-17T17:53:51.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedd998d700 1 -- 172.21.15.78:0/3910246508 learned_addr learned my addr 172.21.15.78:0/3910246508 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:51.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedd918c700 1 --1- 172.21.15.78:0/3910246508 >> v1:172.21.15.150:6789/0 conn(0x7fedd40c01b0 0x7fedd40c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:60816/0 (socket says 172.21.15.78:60816) 2023-08-17T17:53:51.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedd998d700 1 -- 172.21.15.78:0/3910246508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a7bd0 msgr2=0x7fedd4063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:51.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedd998d700 1 --2- 172.21.15.78:0/3910246508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a7bd0 0x7fedd4063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedd998d700 1 -- 172.21.15.78:0/3910246508 >> v1:172.21.15.150:6789/0 conn(0x7fedd40c01b0 legacy=0x7fedd40c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedd998d700 1 -- 172.21.15.78:0/3910246508 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd40635f0 con 0x7fedd40a8050 2023-08-17T17:53:51.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedc7fff700 1 -- 172.21.15.78:0/3910246508 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130418794 0 0) 0x7fedd4063960 con 0x7fedd40c01b0 2023-08-17T17:53:51.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedd998d700 1 --2- 172.21.15.78:0/3910246508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedd40a8050 0x7fedd40642e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fedcc009f20 tx=0x7fedcc009840).ready entity=mon.1 client_cookie=88e06ca9e87cbf16 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:51.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedc7fff700 1 -- 172.21.15.78:0/3910246508 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc00e070 con 0x7fedd40a8050 2023-08-17T17:53:51.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedc7fff700 1 -- 172.21.15.78:0/3910246508 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc00b9d0 con 0x7fedd40a8050 2023-08-17T17:53:51.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.029+0000 7fedc7fff700 1 -- 172.21.15.78:0/3910246508 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc00bd50 con 0x7fedd40a8050 2023-08-17T17:53:51.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.030+0000 7fedda18e700 1 -- 172.21.15.78:0/3910246508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedd40a8050 msgr2=0x7fedd40642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.030+0000 7fedda18e700 1 --2- 172.21.15.78:0/3910246508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedd40a8050 0x7fedd40642e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fedcc009f20 tx=0x7fedcc009840).stop 2023-08-17T17:53:51.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.030+0000 7fedda18e700 1 -- 172.21.15.78:0/3910246508 shutdown_connections 2023-08-17T17:53:51.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.030+0000 7fedda18e700 1 --2- 172.21.15.78:0/3910246508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedd40a8050 0x7fedd40642e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.030+0000 7fedda18e700 1 --2- 172.21.15.78:0/3910246508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a7bd0 0x7fedd4063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.030+0000 7fedda18e700 1 -- 172.21.15.78:0/3910246508 >> 172.21.15.78:0/3910246508 conn(0x7fedd406a6c0 msgr2=0x7fedd40cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:51.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.030+0000 7fedda18e700 1 -- 172.21.15.78:0/3910246508 shutdown_connections 2023-08-17T17:53:51.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.030+0000 7fedda18e700 1 -- 172.21.15.78:0/3910246508 wait complete. 2023-08-17T17:53:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.031+0000 7fedda18e700 1 Processor -- start 2023-08-17T17:53:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.031+0000 7fedda18e700 1 -- start start 2023-08-17T17:53:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedda18e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedd40a7bd0 0x7fedd40af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedda18e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a8050 0x7fedd40acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedda18e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd40c01b0 0x7fedd4167440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedda18e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40ad8d0 con 0x7fedd40c01b0 2023-08-17T17:53:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedda18e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40aec20 con 0x7fedd40a7bd0 2023-08-17T17:53:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedda18e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40ad5f0 con 0x7fedd40a8050 2023-08-17T17:53:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd998d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd40c01b0 0x7fedd4167440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd998d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd40c01b0 0x7fedd4167440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57472/0 (socket says 172.21.15.78:57472) 2023-08-17T17:53:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd998d700 1 -- 172.21.15.78:0/2015136358 learned_addr learned my addr 172.21.15.78:0/2015136358 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd918c700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedd40a7bd0 0x7fedd40af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd898b700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a8050 0x7fedd40acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd998d700 1 -- 172.21.15.78:0/2015136358 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a8050 msgr2=0x7fedd40acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd998d700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a8050 0x7fedd40acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd998d700 1 -- 172.21.15.78:0/2015136358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedd40a7bd0 msgr2=0x7fedd40af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd998d700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedd40a7bd0 0x7fedd40af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd998d700 1 -- 172.21.15.78:0/2015136358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc009ae0 con 0x7fedd40c01b0 2023-08-17T17:53:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd898b700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a8050 0x7fedd40acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.032+0000 7fedd998d700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd40c01b0 0x7fedd4167440 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fedd405f170 tx=0x7fedd40638d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.033+0000 7fedc57fa700 1 -- 172.21.15.78:0/2015136358 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc013e30 con 0x7fedd40c01b0 2023-08-17T17:53:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.033+0000 7fedc57fa700 1 -- 172.21.15.78:0/2015136358 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc01e470 con 0x7fedd40c01b0 2023-08-17T17:53:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.033+0000 7fedda18e700 1 -- 172.21.15.78:0/2015136358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd40aee40 con 0x7fedd40c01b0 2023-08-17T17:53:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.033+0000 7fedc57fa700 1 -- 172.21.15.78:0/2015136358 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc01e810 con 0x7fedd40c01b0 2023-08-17T17:53:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.033+0000 7fedda18e700 1 -- 172.21.15.78:0/2015136358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd40af400 con 0x7fedd40c01b0 2023-08-17T17:53:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.034+0000 7fedda18e700 1 -- 172.21.15.78:0/2015136358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd40af620 con 0x7fedd40c01b0 2023-08-17T17:53:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.034+0000 7fedc57fa700 1 -- 172.21.15.78:0/2015136358 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fedcc025030 con 0x7fedd40c01b0 2023-08-17T17:53:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.034+0000 7fedc57fa700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedb805ed90 0x7fedb8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.035+0000 7fedc57fa700 1 -- 172.21.15.78:0/2015136358 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fedcc07b160 con 0x7fedd40c01b0 2023-08-17T17:53:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.035+0000 7fedd918c700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedb805ed90 0x7fedb8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.035+0000 7fedd918c700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedb805ed90 0x7fedb8061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fedc8007750 tx=0x7fedc8007c90).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.039+0000 7fedc57fa700 1 -- 172.21.15.78:0/2015136358 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fedcc04c7b0 con 0x7fedd40c01b0 2023-08-17T17:53:51.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.240+0000 7fedda18e700 1 -- 172.21.15.78:0/2015136358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedd40c63e0 con 0x7fedd40c01b0 2023-08-17T17:53:51.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.241+0000 7fedc57fa700 1 -- 172.21.15.78:0/2015136358 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7fedcc023070 con 0x7fedd40c01b0 2023-08-17T17:53:51.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:51.243 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":55,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/948559321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":948559321},{"type":"v1","addr":"172.21.15.150:6834","nonce":948559321}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/323810610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":323810610},{"type":"v1","addr":"172.21.15.78:6836","nonce":323810610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/246455712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":246455712},{"type":"v1","addr":"172.21.15.78:6837","nonce":246455712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:48.889332+0000","modified":"2023-08-17T17:53:50.895449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1383305491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1383305491},{"type":"v1","addr":"172.21.15.150:6835","nonce":1383305491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T17:53:51.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 -- 172.21.15.78:0/2015136358 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedb805ed90 msgr2=0x7fedb8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedb805ed90 0x7fedb8061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fedc8007750 tx=0x7fedc8007c90).stop 2023-08-17T17:53:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 -- 172.21.15.78:0/2015136358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd40c01b0 msgr2=0x7fedd4167440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd40c01b0 0x7fedd4167440 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fedd405f170 tx=0x7fedd40638d0).stop 2023-08-17T17:53:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 -- 172.21.15.78:0/2015136358 shutdown_connections 2023-08-17T17:53:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fedb805ed90 0x7fedb8061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd40c01b0 0x7fedd4167440 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedd40a7bd0 0x7fedd40af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 --2- 172.21.15.78:0/2015136358 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedd40a8050 0x7fedd40acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 -- 172.21.15.78:0/2015136358 >> 172.21.15.78:0/2015136358 conn(0x7fedd406a6c0 msgr2=0x7fedd40983a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:51.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 -- 172.21.15.78:0/2015136358 shutdown_connections 2023-08-17T17:53:51.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.243+0000 7fedda18e700 1 -- 172.21.15.78:0/2015136358 wait complete. 2023-08-17T17:53:51.246 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 55 2023-08-17T17:53:51.256 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T17:53:51.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.368+0000 7f0526c1d700 1 Processor -- start 2023-08-17T17:53:51.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.368+0000 7f0526c1d700 1 -- start start 2023-08-17T17:53:51.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f0526c1d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f05200624f0 0x7f05200628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f0526c1d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0520062dc0 0x7f05200c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f0526c1d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05200c2070 0x7f05200bc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f0526c1d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05200c3580 con 0x7f05200c2070 2023-08-17T17:53:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f0526c1d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05200c3a10 con 0x7f05200624f0 2023-08-17T17:53:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f0526c1d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05200c2970 con 0x7f0520062dc0 2023-08-17T17:53:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05251ba700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05200c2070 0x7f05200bc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05251ba700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05200c2070 0x7f05200bc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57478/0 (socket says 172.21.15.78:57478) 2023-08-17T17:53:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05251ba700 1 -- 172.21.15.78:0/1263071423 learned_addr learned my addr 172.21.15.78:0/1263071423 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f051ffff700 1 --2- 172.21.15.78:0/1263071423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0520062dc0 0x7f05200c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05249b9700 1 --2- 172.21.15.78:0/1263071423 >> v2:172.21.15.150:3300/0 conn(0x7f05200624f0 0x7f05200628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05251ba700 1 -- 172.21.15.78:0/1263071423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0520062dc0 msgr2=0x7f05200c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05251ba700 1 --2- 172.21.15.78:0/1263071423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0520062dc0 0x7f05200c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05251ba700 1 -- 172.21.15.78:0/1263071423 >> v2:172.21.15.150:3300/0 conn(0x7f05200624f0 msgr2=0x7f05200628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05251ba700 1 --2- 172.21.15.78:0/1263071423 >> v2:172.21.15.150:3300/0 conn(0x7f05200624f0 0x7f05200628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05251ba700 1 -- 172.21.15.78:0/1263071423 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05200c2c50 con 0x7f05200c2070 2023-08-17T17:53:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05249b9700 1 --2- 172.21.15.78:0/1263071423 >> v2:172.21.15.150:3300/0 conn(0x7f05200624f0 0x7f05200628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f051ffff700 1 --2- 172.21.15.78:0/1263071423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0520062dc0 0x7f05200c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.369+0000 7f05251ba700 1 --2- 172.21.15.78:0/1263071423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 0x7f05200bc290 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f052006a050 tx=0x7f051800ba50).ready entity=mon.0 client_cookie=9931db45cba09ceb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f051f7fe700 1 -- 172.21.15.78:0/1263071423 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518010070 con 0x7f05200c2070 2023-08-17T17:53:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f051f7fe700 1 -- 172.21.15.78:0/1263071423 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051800de90 con 0x7f05200c2070 2023-08-17T17:53:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f051f7fe700 1 -- 172.21.15.78:0/1263071423 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051800b2e0 con 0x7f05200c2070 2023-08-17T17:53:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f0526c1d700 1 -- 172.21.15.78:0/1263071423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 msgr2=0x7f05200bc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f0526c1d700 1 --2- 172.21.15.78:0/1263071423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 0x7f05200bc290 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f052006a050 tx=0x7f051800ba50).stop 2023-08-17T17:53:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f0526c1d700 1 -- 172.21.15.78:0/1263071423 shutdown_connections 2023-08-17T17:53:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f0526c1d700 1 --2- 172.21.15.78:0/1263071423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 0x7f05200bc290 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f0526c1d700 1 --2- 172.21.15.78:0/1263071423 >> v2:172.21.15.150:3300/0 conn(0x7f05200624f0 0x7f05200628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f0526c1d700 1 --2- 172.21.15.78:0/1263071423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0520062dc0 0x7f05200c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f0526c1d700 1 -- 172.21.15.78:0/1263071423 >> 172.21.15.78:0/1263071423 conn(0x7f05200c3d40 msgr2=0x7f05200c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:51.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f0526c1d700 1 -- 172.21.15.78:0/1263071423 shutdown_connections 2023-08-17T17:53:51.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.370+0000 7f0526c1d700 1 -- 172.21.15.78:0/1263071423 wait complete. 2023-08-17T17:53:51.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.371+0000 7f0526c1d700 1 Processor -- start 2023-08-17T17:53:51.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.372+0000 7f0526c1d700 1 -- start start 2023-08-17T17:53:51.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.372+0000 7f0526c1d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05200624f0 0x7f05201509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.372+0000 7f0526c1d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0520062dc0 0x7f0520150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.372+0000 7f0526c1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 0x7f0520162e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.372+0000 7f0526c1d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052014b180 con 0x7f05200c2070 2023-08-17T17:53:51.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.372+0000 7f0526c1d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052014a600 con 0x7f0520062dc0 2023-08-17T17:53:51.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.372+0000 7f0526c1d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052014a8e0 con 0x7f05200624f0 2023-08-17T17:53:51.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.372+0000 7f05251ba700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 0x7f0520162e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.372+0000 7f05251ba700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 0x7f0520162e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57492/0 (socket says 172.21.15.78:57492) 2023-08-17T17:53:51.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.372+0000 7f05251ba700 1 -- 172.21.15.78:0/1569394370 learned_addr learned my addr 172.21.15.78:0/1569394370 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:51.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f05249b9700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05200624f0 0x7f05201509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f051ffff700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0520062dc0 0x7f0520150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f05251ba700 1 -- 172.21.15.78:0/1569394370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05200624f0 msgr2=0x7f05201509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f05251ba700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05200624f0 0x7f05201509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f05251ba700 1 -- 172.21.15.78:0/1569394370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0520062dc0 msgr2=0x7f0520150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f05251ba700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0520062dc0 0x7f0520150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f05251ba700 1 -- 172.21.15.78:0/1569394370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051800bcf0 con 0x7f05200c2070 2023-08-17T17:53:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f051ffff700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0520062dc0 0x7f0520150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f05251ba700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 0x7f0520162e20 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f051800d8c0 tx=0x7f05200c36c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f051cff9700 1 -- 172.21.15.78:0/1569394370 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05180154f0 con 0x7f05200c2070 2023-08-17T17:53:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f051cff9700 1 -- 172.21.15.78:0/1569394370 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518015650 con 0x7f05200c2070 2023-08-17T17:53:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f0526c1d700 1 -- 172.21.15.78:0/1569394370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052014abc0 con 0x7f05200c2070 2023-08-17T17:53:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f051cff9700 1 -- 172.21.15.78:0/1569394370 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05180159f0 con 0x7f05200c2070 2023-08-17T17:53:51.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.373+0000 7f0526c1d700 1 -- 172.21.15.78:0/1569394370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052014a1e0 con 0x7f05200c2070 2023-08-17T17:53:51.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.374+0000 7f0526c1d700 1 -- 172.21.15.78:0/1569394370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05200649d0 con 0x7f05200c2070 2023-08-17T17:53:51.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.374+0000 7f051cff9700 1 -- 172.21.15.78:0/1569394370 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f051801d040 con 0x7f05200c2070 2023-08-17T17:53:51.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.375+0000 7f051cff9700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f050405ed90 0x7f0504061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.375+0000 7f051cff9700 1 -- 172.21.15.78:0/1569394370 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f051807db30 con 0x7f05200c2070 2023-08-17T17:53:51.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.375+0000 7f05249b9700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f050405ed90 0x7f0504061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.375+0000 7f05249b9700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f050405ed90 0x7f0504061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f051400a9d0 tx=0x7f0514008040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:51.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.379+0000 7f051cff9700 1 -- 172.21.15.78:0/1569394370 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f051804f0d0 con 0x7f05200c2070 2023-08-17T17:53:51.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.542+0000 7f0526c1d700 1 -- 172.21.15.78:0/1569394370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0520047350 con 0x7f05200c2070 2023-08-17T17:53:51.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.542+0000 7f051cff9700 1 -- 172.21.15.78:0/1569394370 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f05180526f0 con 0x7f05200c2070 2023-08-17T17:53:51.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:51.545 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":149,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T17:53:49.891363+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:47.436687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:47.849880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T17:53:51.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.544+0000 7f0526c1d700 1 -- 172.21.15.78:0/1569394370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f050405ed90 msgr2=0x7f0504061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.544+0000 7f0526c1d700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f050405ed90 0x7f0504061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f051400a9d0 tx=0x7f0514008040).stop 2023-08-17T17:53:51.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.544+0000 7f0526c1d700 1 -- 172.21.15.78:0/1569394370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 msgr2=0x7f0520162e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.544+0000 7f0526c1d700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 0x7f0520162e20 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f051800d8c0 tx=0x7f05200c36c0).stop 2023-08-17T17:53:51.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.544+0000 7f0526c1d700 1 -- 172.21.15.78:0/1569394370 shutdown_connections 2023-08-17T17:53:51.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.544+0000 7f0526c1d700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f050405ed90 0x7f0504061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.544+0000 7f0526c1d700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05200c2070 0x7f0520162e20 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.544+0000 7f0526c1d700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05200624f0 0x7f05201509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.544+0000 7f0526c1d700 1 --2- 172.21.15.78:0/1569394370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0520062dc0 0x7f0520150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.544+0000 7f0526c1d700 1 -- 172.21.15.78:0/1569394370 >> 172.21.15.78:0/1569394370 conn(0x7f05200c3d40 msgr2=0x7f05200c4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:51.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.545+0000 7f0526c1d700 1 -- 172.21.15.78:0/1569394370 shutdown_connections 2023-08-17T17:53:51.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.545+0000 7f0526c1d700 1 -- 172.21.15.78:0/1569394370 wait complete. 2023-08-17T17:53:51.558 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T17:53:51.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:53:51.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.670+0000 7fa100749700 1 Processor -- start 2023-08-17T17:53:51.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.670+0000 7fa100749700 1 -- start start 2023-08-17T17:53:51.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.671+0000 7fa100749700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0f81375e0 0x7fa0f8065110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.671+0000 7fa100749700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c0ff0 0x7fa0f80c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.671+0000 7fa100749700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa0f8137e30 0x7fa0f80c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.671+0000 7fa100749700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80c61b0 con 0x7fa0f81375e0 2023-08-17T17:53:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.671+0000 7fa100749700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80c14b0 con 0x7fa0f8137e30 2023-08-17T17:53:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.671+0000 7fa100749700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c1790 con 0x7fa0f80c0ff0 2023-08-17T17:53:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.671+0000 7fa0fe4e5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0f81375e0 0x7fa0f8065110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.671+0000 7fa0fe4e5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0f81375e0 0x7fa0f8065110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57500/0 (socket says 172.21.15.78:57500) 2023-08-17T17:53:51.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fe4e5700 1 -- 172.21.15.78:0/1199403568 learned_addr learned my addr 172.21.15.78:0/1199403568 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fece6700 1 --2- 172.21.15.78:0/1199403568 >> v2:172.21.15.150:3300/0 conn(0x7fa0f8137e30 0x7fa0f80c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fdce4700 1 --2- 172.21.15.78:0/1199403568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c0ff0 0x7fa0f80c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fe4e5700 1 -- 172.21.15.78:0/1199403568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c0ff0 msgr2=0x7fa0f80c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fe4e5700 1 --2- 172.21.15.78:0/1199403568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c0ff0 0x7fa0f80c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fe4e5700 1 -- 172.21.15.78:0/1199403568 >> v2:172.21.15.150:3300/0 conn(0x7fa0f8137e30 msgr2=0x7fa0f80c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fe4e5700 1 --2- 172.21.15.78:0/1199403568 >> v2:172.21.15.150:3300/0 conn(0x7fa0f8137e30 0x7fa0f80c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fe4e5700 1 -- 172.21.15.78:0/1199403568 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f80c1a70 con 0x7fa0f81375e0 2023-08-17T17:53:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fe4e5700 1 --2- 172.21.15.78:0/1199403568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f81375e0 0x7fa0f8065110 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7fa0f806a750 tx=0x7fa0f4009840).ready entity=mon.0 client_cookie=60bc21afbba036b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fd4e3700 1 -- 172.21.15.78:0/1199403568 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f400e070 con 0x7fa0f81375e0 2023-08-17T17:53:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fd4e3700 1 -- 172.21.15.78:0/1199403568 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f400b970 con 0x7fa0f81375e0 2023-08-17T17:53:51.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.672+0000 7fa0fd4e3700 1 -- 172.21.15.78:0/1199403568 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f400bcf0 con 0x7fa0f81375e0 2023-08-17T17:53:51.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.673+0000 7fa100749700 1 -- 172.21.15.78:0/1199403568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f81375e0 msgr2=0x7fa0f8065110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.673+0000 7fa100749700 1 --2- 172.21.15.78:0/1199403568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f81375e0 0x7fa0f8065110 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7fa0f806a750 tx=0x7fa0f4009840).stop 2023-08-17T17:53:51.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.673+0000 7fa100749700 1 -- 172.21.15.78:0/1199403568 shutdown_connections 2023-08-17T17:53:51.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.673+0000 7fa100749700 1 --2- 172.21.15.78:0/1199403568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f81375e0 0x7fa0f8065110 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.673+0000 7fa100749700 1 --2- 172.21.15.78:0/1199403568 >> v2:172.21.15.150:3300/0 conn(0x7fa0f8137e30 0x7fa0f80c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.673+0000 7fa100749700 1 --2- 172.21.15.78:0/1199403568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c0ff0 0x7fa0f80c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.673+0000 7fa100749700 1 -- 172.21.15.78:0/1199403568 >> 172.21.15.78:0/1199403568 conn(0x7fa0f8062fc0 msgr2=0x7fa0f80c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:51.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.673+0000 7fa100749700 1 -- 172.21.15.78:0/1199403568 shutdown_connections 2023-08-17T17:53:51.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.673+0000 7fa100749700 1 -- 172.21.15.78:0/1199403568 wait complete. 2023-08-17T17:53:51.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.674+0000 7fa100749700 1 Processor -- start 2023-08-17T17:53:51.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.674+0000 7fa100749700 1 -- start start 2023-08-17T17:53:51.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa100749700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f80c0ff0 0x7fa0f80a9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa100749700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f81375e0 0x7fa0f80be080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa100749700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f8137e30 0x7fa0f80bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa100749700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f81636c0 con 0x7fa0f8137e30 2023-08-17T17:53:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa100749700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80bfe90 con 0x7fa0f80c0ff0 2023-08-17T17:53:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa100749700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c0170 con 0x7fa0f81375e0 2023-08-17T17:53:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fece6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f8137e30 0x7fa0f80bcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fece6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f8137e30 0x7fa0f80bcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57502/0 (socket says 172.21.15.78:57502) 2023-08-17T17:53:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fece6700 1 -- 172.21.15.78:0/4143144074 learned_addr learned my addr 172.21.15.78:0/4143144074 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:51.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fe4e5700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f80c0ff0 0x7fa0f80a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fdce4700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f81375e0 0x7fa0f80be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fece6700 1 -- 172.21.15.78:0/4143144074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f81375e0 msgr2=0x7fa0f80be080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fece6700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f81375e0 0x7fa0f80be080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fece6700 1 -- 172.21.15.78:0/4143144074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f80c0ff0 msgr2=0x7fa0f80a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fece6700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f80c0ff0 0x7fa0f80a9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fece6700 1 -- 172.21.15.78:0/4143144074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f4009ae0 con 0x7fa0f8137e30 2023-08-17T17:53:51.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0fece6700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f8137e30 0x7fa0f80bcad0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7fa0f000e900 tx=0x7fa0f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:51.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0ee7fc700 1 -- 172.21.15.78:0/4143144074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0012600 con 0x7fa0f8137e30 2023-08-17T17:53:51.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0ee7fc700 1 -- 172.21.15.78:0/4143144074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f0012760 con 0x7fa0f8137e30 2023-08-17T17:53:51.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa100749700 1 -- 172.21.15.78:0/4143144074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f80c0450 con 0x7fa0f8137e30 2023-08-17T17:53:51.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa0ee7fc700 1 -- 172.21.15.78:0/4143144074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0012ae0 con 0x7fa0f8137e30 2023-08-17T17:53:51.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.675+0000 7fa100749700 1 -- 172.21.15.78:0/4143144074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f80bfb60 con 0x7fa0f8137e30 2023-08-17T17:53:51.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.676+0000 7fa100749700 1 -- 172.21.15.78:0/4143144074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f8163830 con 0x7fa0f8137e30 2023-08-17T17:53:51.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.677+0000 7fa0ee7fc700 1 -- 172.21.15.78:0/4143144074 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa0f0022070 con 0x7fa0f8137e30 2023-08-17T17:53:51.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.677+0000 7fa0ee7fc700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed60 0x7fa0dc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:51.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.677+0000 7fa0ee7fc700 1 -- 172.21.15.78:0/4143144074 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa0f0079be0 con 0x7fa0f8137e30 2023-08-17T17:53:51.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.677+0000 7fa0fe4e5700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed60 0x7fa0dc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:51.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.677+0000 7fa0fe4e5700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed60 0x7fa0dc061220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa0f806a750 tx=0x7fa0f4009840).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:51.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.681+0000 7fa0ee7fc700 1 -- 172.21.15.78:0/4143144074 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa0f8163830 con 0x7fa0f8137e30 2023-08-17T17:53:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.839+0000 7fa100749700 1 -- 172.21.15.78:0/4143144074 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0f8163830 con 0x7fa0dc05ed60 2023-08-17T17:53:51.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.848+0000 7fa0ee7fc700 1 -- 172.21.15.78:0/4143144074 <== mgr.8364 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352930 (secure 0 0 0) 0x7fa0f8163830 con 0x7fa0dc05ed60 2023-08-17T17:53:51.853 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 -- 172.21.15.78:0/4143144074 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed60 msgr2=0x7fa0dc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed60 0x7fa0dc061220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa0f806a750 tx=0x7fa0f4009840).stop 2023-08-17T17:53:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 -- 172.21.15.78:0/4143144074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f8137e30 msgr2=0x7fa0f80bcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f8137e30 0x7fa0f80bcad0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7fa0f000e900 tx=0x7fa0f0009060).stop 2023-08-17T17:53:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 -- 172.21.15.78:0/4143144074 shutdown_connections 2023-08-17T17:53:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa0dc05ed60 0x7fa0dc061220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f8137e30 0x7fa0f80bcad0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f80c0ff0 0x7fa0f80a9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 --2- 172.21.15.78:0/4143144074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f81375e0 0x7fa0f80be080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 -- 172.21.15.78:0/4143144074 >> 172.21.15.78:0/4143144074 conn(0x7fa0f8062fc0 msgr2=0x7fa0f814ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 -- 172.21.15.78:0/4143144074 shutdown_connections 2023-08-17T17:53:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:51.852+0000 7fa100749700 1 -- 172.21.15.78:0/4143144074 wait complete. 2023-08-17T17:53:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:53:51.865 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:53:51.482267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427828,"kb_used_data":14196,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752546892,"statfs":{"total":773094113280,"available":770608017408,"internally_reserved":0,"allocated":14536704,"data_stored":7215579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10876,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.005216"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520973+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518391+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521887+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520181+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527201+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524561+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524279+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522549+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522433+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517850+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519687+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521868+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522048+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518305+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519562+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519990+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.525009+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520917+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519330+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520594+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526634+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519081+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522492+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519108+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518667+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520547+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519822+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517797+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521690+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520709+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526970+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.523865+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521863+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520130+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527550+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527051+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524596+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519633+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517843+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521809+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517758+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521840+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517278+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520305+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.523935+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520404+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526462+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517278+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520612+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524945+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524919+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517280+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517747+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526940+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517294+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519581+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526530+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.698832+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:53:46.698832+0000","last_peered":"2023-08-17T17:53:46.698832+0000","last_clean":"2023-08-17T17:53:46.698832+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:53:46.698832+0000","last_undegraded":"2023-08-17T17:53:46.698832+0000","last_fullsized":"2023-08-17T17:53:46.698832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521349+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.511068+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:53:45.511068+0000","last_peered":"2023-08-17T17:53:45.511068+0000","last_clean":"2023-08-17T17:53:45.511068+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:53:45.511068+0000","last_undegraded":"2023-08-17T17:53:45.511068+0000","last_fullsized":"2023-08-17T17:53:45.511068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517747+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.766756+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:53:45.766756+0000","last_peered":"2023-08-17T17:53:45.766756+0000","last_clean":"2023-08-17T17:53:45.766756+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:53:45.766756+0000","last_undegraded":"2023-08-17T17:53:45.766756+0000","last_fullsized":"2023-08-17T17:53:45.766756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527399+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.511090+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:53:45.511090+0000","last_peered":"2023-08-17T17:53:45.511090+0000","last_clean":"2023-08-17T17:53:45.511090+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:53:45.511090+0000","last_undegraded":"2023-08-17T17:53:45.511090+0000","last_fullsized":"2023-08-17T17:53:45.511090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699009+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:53:46.699009+0000","last_peered":"2023-08-17T17:53:46.699009+0000","last_clean":"2023-08-17T17:53:46.699009+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:53:46.699009+0000","last_undegraded":"2023-08-17T17:53:46.699009+0000","last_fullsized":"2023-08-17T17:53:46.699009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521822+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699007+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:53:46.699007+0000","last_peered":"2023-08-17T17:53:46.699007+0000","last_clean":"2023-08-17T17:53:46.699007+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:53:46.699007+0000","last_undegraded":"2023-08-17T17:53:46.699007+0000","last_fullsized":"2023-08-17T17:53:46.699007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526578+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699023+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:53:46.699023+0000","last_peered":"2023-08-17T17:53:46.699023+0000","last_clean":"2023-08-17T17:53:46.699023+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:53:46.699023+0000","last_undegraded":"2023-08-17T17:53:46.699023+0000","last_fullsized":"2023-08-17T17:53:46.699023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518244+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":115,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.698850+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:53:46.698850+0000","last_peered":"2023-08-17T17:53:46.698850+0000","last_clean":"2023-08-17T17:53:46.698850+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:53:46.698850+0000","last_undegraded":"2023-08-17T17:53:46.698850+0000","last_fullsized":"2023-08-17T17:53:46.698850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519579+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.252163+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:53:46.252163+0000","last_peered":"2023-08-17T17:53:46.252163+0000","last_clean":"2023-08-17T17:53:46.252163+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:53:46.252163+0000","last_undegraded":"2023-08-17T17:53:46.252163+0000","last_fullsized":"2023-08-17T17:53:46.252163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575078,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302956,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068884,"statfs":{"total":96636764160,"available":96326537216,"internally_reserved":0,"allocated":1806336,"data_stored":896504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.42099999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.75800000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.83299999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.59699999999999998,"5min":0.745,"15min":0.80000000000000004},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.436,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":1.23,"15min":1.23},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76100000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.60999999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.86099999999999999},"last":0.62}]},{"osd":4,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.85499999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.90200000000000002},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70499999999999996,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.623},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.60699999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69099999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.84599999999999997,"15min":1.0609999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.373},"max":{"1min":0.69699999999999995,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.46899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.67600000000000005,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.443,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.75800000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.74199999999999999,"15min":0.77300000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":1.51},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.872},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.747,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.34799999999999998},"min":{"1min":0.25900000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45800000000000002,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.5,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.36399999999999999},"min":{"1min":0.26800000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.70799999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.63600000000000001,"15min":0.66300000000000003},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.33200000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.30399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.63300000000000001},"last":0.376}]},{"osd":4,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.89600000000000002,"15min":0.93200000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85299999999999998,"5min":1.2989999999999999,"15min":1.331},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84499999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86799999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575078,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.61599999999999999},"last":0.308},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.377,"15min":0.38400000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.57099999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.36499999999999999},"min":{"1min":0.22800000000000001,"5min":0.19900000000000001,"15min":0.19400000000000001},"max":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.39500000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55400000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.41199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.26200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0569999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.034,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.095,"5min":1.677,"15min":1.677},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.99099999999999999,"5min":1.51,"15min":1.51},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0740000000000001,"5min":1.325,"15min":1.391},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":1.103,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0980000000000001,"15min":1.544},"last":0.68100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32900000000000001,"15min":0.34599999999999997},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.246},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49199999999999999,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.31}]},{"osd":1,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.41599999999999998},"min":{"1min":0.25600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.41899999999999998},"min":{"1min":0.308,"5min":0.27800000000000002,"15min":0.27200000000000002},"max":{"1min":0.58299999999999996,"5min":0.63,"15min":1.268},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88,"5min":1.417,"15min":1.417},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":1.51,"15min":2.9220000000000002},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":1.544,"15min":1.544},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.872,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.504},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":1.415,"15min":1.415},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.81499999999999995,"5min":1.3859999999999999,"15min":2.984},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575078,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.56299999999999994},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.375},"min":{"1min":0.251,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.54800000000000004,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.22},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38300000000000001,"15min":0.39100000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.63300000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.313}]},{"osd":4,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.76700000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.498},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.78800000000000003,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86699999999999999,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.433,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81699999999999995,"5min":1.466,"15min":1.466},"last":0.62},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.48,"15min":1.48},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82299999999999995,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.26400000000000001},"max":{"1min":0.77000000000000002,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.374},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.81000000000000005,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.55200000000000005},"min":{"1min":0.45200000000000001,"5min":0.34300000000000003,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":1.252,"15min":1.252},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.306,"15min":1.306},"last":0.502}]},{"osd":2,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88800000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":1.444,"15min":1.444},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80600000000000005,"5min":1.482,"15min":1.482},"last":0.433},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.86299999999999999,"5min":1.123,"15min":1.123},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":1.002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.48299999999999998},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.91100000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":1.048,"15min":1.048},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.056},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575077,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307064,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064776,"statfs":{"total":96636764160,"available":96322330624,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69299999999999995,"5min":1.165,"15min":1.165},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":1.022,"15min":1.022},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.68500000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.41599999999999998,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.76400000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.372},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":1.153,"15min":1.153},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":1.036,"15min":1.036},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.255},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.315},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35899999999999999,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.439},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.501}]},{"osd":7,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:53:51.874 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:53:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.016+0000 7fda3bb98700 1 Processor -- start 2023-08-17T17:53:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.016+0000 7fda3bb98700 1 -- start start 2023-08-17T17:53:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.017+0000 7fda3bb98700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda340a7fe0 0x7fda34064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.017+0000 7fda3bb98700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fda34065140 0x7fda340c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.017+0000 7fda3bb98700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340c4040 con 0x7fda340be7f0 2023-08-17T17:53:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.017+0000 7fda3bb98700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda340c7080 con 0x7fda34065140 2023-08-17T17:53:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.017+0000 7fda3bb98700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340c3430 con 0x7fda340a7fe0 2023-08-17T17:53:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.017+0000 7fda3a135700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fda340be7f0 0x7fda340c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41144/0 (socket says 172.21.15.78:41144) 2023-08-17T17:53:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.017+0000 7fda3a135700 1 -- 172.21.15.78:0/3738283383 learned_addr learned my addr 172.21.15.78:0/3738283383 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077644859 0 0) 0x7fda340c4040 con 0x7fda340be7f0 2023-08-17T17:53:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda39133700 1 --2- 172.21.15.78:0/3738283383 >> v2:172.21.15.150:3300/0 conn(0x7fda34065140 0x7fda340c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda200033f0 con 0x7fda340be7f0 2023-08-17T17:53:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda39934700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda340a7fe0 0x7fda34064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1113934586 0 0) 0x7fda200033f0 con 0x7fda340be7f0 2023-08-17T17:53:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda340a7fe0 msgr2=0x7fda34064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda340a7fe0 0x7fda34064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 >> v2:172.21.15.150:3300/0 conn(0x7fda34065140 msgr2=0x7fda340c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 --2- 172.21.15.78:0/3738283383 >> v2:172.21.15.150:3300/0 conn(0x7fda34065140 0x7fda340c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340c3710 con 0x7fda340be7f0 2023-08-17T17:53:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fda2c001470 con 0x7fda340be7f0 2023-08-17T17:53:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda39934700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda340a7fe0 0x7fda34064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 >> v1:172.21.15.78:6789/0 conn(0x7fda340be7f0 legacy=0x7fda340c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda200038e0 0x7fda20003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda20004690 0x7fda20004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda340a7fe0 0x7fda20005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340c7080 con 0x7fda200038e0 2023-08-17T17:53:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340c3430 con 0x7fda20004690 2023-08-17T17:53:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2000b8e0 con 0x7fda340a7fe0 2023-08-17T17:53:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda39934700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda200038e0 0x7fda20003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda39133700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda20004690 0x7fda20004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda3a135700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda340a7fe0 0x7fda20005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda39934700 1 -- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda340a7fe0 msgr2=0x7fda20005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda39934700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda340a7fe0 0x7fda20005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda39934700 1 -- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda20004690 msgr2=0x7fda20004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:52.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda39934700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda20004690 0x7fda20004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda39934700 1 -- 172.21.15.78:0/3738283383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda200033f0 con 0x7fda200038e0 2023-08-17T17:53:52.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.018+0000 7fda3a135700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda340a7fe0 0x7fda20005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:52.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda39934700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda200038e0 0x7fda20003d00 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fda30007580 tx=0x7fda300097d0).ready entity=mon.0 client_cookie=98d1dc05104290be server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:52.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30009ae0 con 0x7fda200038e0 2023-08-17T17:53:52.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda30007dd0 con 0x7fda200038e0 2023-08-17T17:53:52.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda38932700 1 -- 172.21.15.78:0/3738283383 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30015660 con 0x7fda200038e0 2023-08-17T17:53:52.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda3bb98700 1 -- 172.21.15.78:0/3738283383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda200038e0 msgr2=0x7fda20003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda3bb98700 1 --2- 172.21.15.78:0/3738283383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda200038e0 0x7fda20003d00 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fda30007580 tx=0x7fda300097d0).stop 2023-08-17T17:53:52.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda3a135700 1 -- 172.21.15.78:0/3738283383 reap_dead start 2023-08-17T17:53:52.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda3bb98700 1 -- 172.21.15.78:0/3738283383 shutdown_connections 2023-08-17T17:53:52.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda3bb98700 1 -- 172.21.15.78:0/3738283383 >> 172.21.15.78:0/3738283383 conn(0x7fda34092330 msgr2=0x7fda34062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:52.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda3bb98700 1 -- 172.21.15.78:0/3738283383 shutdown_connections 2023-08-17T17:53:52.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.019+0000 7fda3bb98700 1 -- 172.21.15.78:0/3738283383 wait complete. 2023-08-17T17:53:52.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.020+0000 7fda3bb98700 1 Processor -- start 2023-08-17T17:53:52.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.020+0000 7fda3bb98700 1 -- start start 2023-08-17T17:53:52.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda3bb98700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda200038e0 0x7fda3414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda3bb98700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda341521e0 0x7fda34152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda3bb98700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda34155b20 0x7fda34155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda3bb98700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda34156ef0 con 0x7fda341521e0 2023-08-17T17:53:52.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda3bb98700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda341501b0 con 0x7fda34155b20 2023-08-17T17:53:52.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda3bb98700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda34152b50 con 0x7fda200038e0 2023-08-17T17:53:52.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda39133700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda341521e0 0x7fda34152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda39133700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda341521e0 0x7fda34152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57524/0 (socket says 172.21.15.78:57524) 2023-08-17T17:53:52.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda39133700 1 -- 172.21.15.78:0/97995077 learned_addr learned my addr 172.21.15.78:0/97995077 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:52.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda3a135700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda34155b20 0x7fda34155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda39934700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda200038e0 0x7fda3414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda39133700 1 -- 172.21.15.78:0/97995077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda200038e0 msgr2=0x7fda3414dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda39133700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda200038e0 0x7fda3414dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda39133700 1 -- 172.21.15.78:0/97995077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda34155b20 msgr2=0x7fda34155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.021+0000 7fda39133700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda34155b20 0x7fda34155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.022+0000 7fda39133700 1 -- 172.21.15.78:0/97995077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda34156930 con 0x7fda341521e0 2023-08-17T17:53:52.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.022+0000 7fda39133700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda341521e0 0x7fda34152660 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fda24011a50 tx=0x7fda24009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:52.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.022+0000 7fda29ffb700 1 -- 172.21.15.78:0/97995077 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400f940 con 0x7fda341521e0 2023-08-17T17:53:52.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.022+0000 7fda29ffb700 1 -- 172.21.15.78:0/97995077 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2400faa0 con 0x7fda341521e0 2023-08-17T17:53:52.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.022+0000 7fda3bb98700 1 -- 172.21.15.78:0/97995077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda34156c10 con 0x7fda341521e0 2023-08-17T17:53:52.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.022+0000 7fda29ffb700 1 -- 172.21.15.78:0/97995077 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400fe20 con 0x7fda341521e0 2023-08-17T17:53:52.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.022+0000 7fda3bb98700 1 -- 172.21.15.78:0/97995077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3414e4c0 con 0x7fda341521e0 2023-08-17T17:53:52.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.023+0000 7fda3bb98700 1 -- 172.21.15.78:0/97995077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda34047350 con 0x7fda341521e0 2023-08-17T17:53:52.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.023+0000 7fda29ffb700 1 -- 172.21.15.78:0/97995077 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fda24024070 con 0x7fda341521e0 2023-08-17T17:53:52.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.024+0000 7fda29ffb700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 0x7fda18061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.024+0000 7fda29ffb700 1 -- 172.21.15.78:0/97995077 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fda2407a3b0 con 0x7fda341521e0 2023-08-17T17:53:52.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.024+0000 7fda39934700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 0x7fda18061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.024+0000 7fda39934700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 0x7fda18061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fda3000afd0 tx=0x7fda30018000).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:52.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.028+0000 7fda29ffb700 1 -- 172.21.15.78:0/97995077 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda2404b950 con 0x7fda341521e0 2023-08-17T17:53:52.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.186+0000 7fda3bb98700 1 -- 172.21.15.78:0/97995077 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda3405f410 con 0x7fda1805ed90 2023-08-17T17:53:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.195+0000 7fda29ffb700 1 -- 172.21.15.78:0/97995077 <== mgr.8364 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352930 (secure 0 0 0) 0x7fda3405f410 con 0x7fda1805ed90 2023-08-17T17:53:52.200 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:52.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 -- 172.21.15.78:0/97995077 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 msgr2=0x7fda18061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 0x7fda18061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fda3000afd0 tx=0x7fda30018000).stop 2023-08-17T17:53:52.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 -- 172.21.15.78:0/97995077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda341521e0 msgr2=0x7fda34152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda341521e0 0x7fda34152660 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fda24011a50 tx=0x7fda24009060).stop 2023-08-17T17:53:52.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 -- 172.21.15.78:0/97995077 shutdown_connections 2023-08-17T17:53:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fda1805ed90 0x7fda18061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda34155b20 0x7fda34155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda200038e0 0x7fda3414dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 --2- 172.21.15.78:0/97995077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda341521e0 0x7fda34152660 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 -- 172.21.15.78:0/97995077 >> 172.21.15.78:0/97995077 conn(0x7fda34092330 msgr2=0x7fda340c8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 -- 172.21.15.78:0/97995077 shutdown_connections 2023-08-17T17:53:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.199+0000 7fda3bb98700 1 -- 172.21.15.78:0/97995077 wait complete. 2023-08-17T17:53:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:53:52.212 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:53:51.482267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427828,"kb_used_data":14196,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752546892,"statfs":{"total":773094113280,"available":770608017408,"internally_reserved":0,"allocated":14536704,"data_stored":7215579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10876,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.005216"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520973+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518391+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521887+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520181+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527201+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524561+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524279+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522549+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522433+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517850+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519687+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521868+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522048+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518305+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519562+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519990+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.525009+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520917+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519330+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520594+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526634+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519081+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522492+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519108+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518667+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520547+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519822+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517797+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521690+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520709+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526970+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.523865+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521863+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520130+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527550+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527051+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524596+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519633+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517843+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521809+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517758+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521840+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517278+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520305+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.523935+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520404+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526462+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517278+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520612+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524945+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524919+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517280+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517747+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526940+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517294+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519581+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526530+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.698832+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:53:46.698832+0000","last_peered":"2023-08-17T17:53:46.698832+0000","last_clean":"2023-08-17T17:53:46.698832+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:53:46.698832+0000","last_undegraded":"2023-08-17T17:53:46.698832+0000","last_fullsized":"2023-08-17T17:53:46.698832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521349+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.511068+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:53:45.511068+0000","last_peered":"2023-08-17T17:53:45.511068+0000","last_clean":"2023-08-17T17:53:45.511068+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:53:45.511068+0000","last_undegraded":"2023-08-17T17:53:45.511068+0000","last_fullsized":"2023-08-17T17:53:45.511068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517747+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.766756+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:53:45.766756+0000","last_peered":"2023-08-17T17:53:45.766756+0000","last_clean":"2023-08-17T17:53:45.766756+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:53:45.766756+0000","last_undegraded":"2023-08-17T17:53:45.766756+0000","last_fullsized":"2023-08-17T17:53:45.766756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527399+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.511090+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:53:45.511090+0000","last_peered":"2023-08-17T17:53:45.511090+0000","last_clean":"2023-08-17T17:53:45.511090+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:53:45.511090+0000","last_undegraded":"2023-08-17T17:53:45.511090+0000","last_fullsized":"2023-08-17T17:53:45.511090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699009+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:53:46.699009+0000","last_peered":"2023-08-17T17:53:46.699009+0000","last_clean":"2023-08-17T17:53:46.699009+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:53:46.699009+0000","last_undegraded":"2023-08-17T17:53:46.699009+0000","last_fullsized":"2023-08-17T17:53:46.699009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521822+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699007+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:53:46.699007+0000","last_peered":"2023-08-17T17:53:46.699007+0000","last_clean":"2023-08-17T17:53:46.699007+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:53:46.699007+0000","last_undegraded":"2023-08-17T17:53:46.699007+0000","last_fullsized":"2023-08-17T17:53:46.699007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526578+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699023+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:53:46.699023+0000","last_peered":"2023-08-17T17:53:46.699023+0000","last_clean":"2023-08-17T17:53:46.699023+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:53:46.699023+0000","last_undegraded":"2023-08-17T17:53:46.699023+0000","last_fullsized":"2023-08-17T17:53:46.699023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518244+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":115,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.698850+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:53:46.698850+0000","last_peered":"2023-08-17T17:53:46.698850+0000","last_clean":"2023-08-17T17:53:46.698850+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:53:46.698850+0000","last_undegraded":"2023-08-17T17:53:46.698850+0000","last_fullsized":"2023-08-17T17:53:46.698850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519579+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.252163+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:53:46.252163+0000","last_peered":"2023-08-17T17:53:46.252163+0000","last_clean":"2023-08-17T17:53:46.252163+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:53:46.252163+0000","last_undegraded":"2023-08-17T17:53:46.252163+0000","last_fullsized":"2023-08-17T17:53:46.252163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575078,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302956,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068884,"statfs":{"total":96636764160,"available":96326537216,"internally_reserved":0,"allocated":1806336,"data_stored":896504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.42099999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.75800000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.83299999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.59699999999999998,"5min":0.745,"15min":0.80000000000000004},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.436,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":1.23,"15min":1.23},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76100000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.60999999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.86099999999999999},"last":0.62}]},{"osd":4,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.85499999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.90200000000000002},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70499999999999996,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.623},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.60699999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69099999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.84599999999999997,"15min":1.0609999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.373},"max":{"1min":0.69699999999999995,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.46899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.67600000000000005,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.443,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.75800000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.74199999999999999,"15min":0.77300000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":1.51},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.872},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.747,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.34799999999999998},"min":{"1min":0.25900000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45800000000000002,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.5,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.36399999999999999},"min":{"1min":0.26800000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.70799999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.63600000000000001,"15min":0.66300000000000003},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.33200000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.30399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.63300000000000001},"last":0.376}]},{"osd":4,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.89600000000000002,"15min":0.93200000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85299999999999998,"5min":1.2989999999999999,"15min":1.331},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84499999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86799999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575078,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.61599999999999999},"last":0.308},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.377,"15min":0.38400000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.57099999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.36499999999999999},"min":{"1min":0.22800000000000001,"5min":0.19900000000000001,"15min":0.19400000000000001},"max":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.39500000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55400000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.41199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.26200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0569999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.034,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.095,"5min":1.677,"15min":1.677},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.99099999999999999,"5min":1.51,"15min":1.51},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0740000000000001,"5min":1.325,"15min":1.391},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":1.103,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0980000000000001,"15min":1.544},"last":0.68100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32900000000000001,"15min":0.34599999999999997},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.246},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49199999999999999,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.31}]},{"osd":1,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.41599999999999998},"min":{"1min":0.25600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.41899999999999998},"min":{"1min":0.308,"5min":0.27800000000000002,"15min":0.27200000000000002},"max":{"1min":0.58299999999999996,"5min":0.63,"15min":1.268},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88,"5min":1.417,"15min":1.417},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":1.51,"15min":2.9220000000000002},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":1.544,"15min":1.544},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.872,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.504},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":1.415,"15min":1.415},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.81499999999999995,"5min":1.3859999999999999,"15min":2.984},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575078,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.56299999999999994},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.375},"min":{"1min":0.251,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.54800000000000004,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.22},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38300000000000001,"15min":0.39100000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.63300000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.313}]},{"osd":4,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.76700000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.498},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.78800000000000003,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86699999999999999,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.433,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81699999999999995,"5min":1.466,"15min":1.466},"last":0.62},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.48,"15min":1.48},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82299999999999995,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.26400000000000001},"max":{"1min":0.77000000000000002,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.374},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.81000000000000005,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.55200000000000005},"min":{"1min":0.45200000000000001,"5min":0.34300000000000003,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":1.252,"15min":1.252},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.306,"15min":1.306},"last":0.502}]},{"osd":2,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88800000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":1.444,"15min":1.444},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80600000000000005,"5min":1.482,"15min":1.482},"last":0.433},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.86299999999999999,"5min":1.123,"15min":1.123},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":1.002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.48299999999999998},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.91100000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":1.048,"15min":1.048},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.056},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575077,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307064,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064776,"statfs":{"total":96636764160,"available":96322330624,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69299999999999995,"5min":1.165,"15min":1.165},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":1.022,"15min":1.022},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.68500000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.41599999999999998,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.76400000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.372},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":1.153,"15min":1.153},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":1.036,"15min":1.036},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.255},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.315},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35899999999999999,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.439},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.501}]},{"osd":7,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:53:52.219 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:53:52.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.364+0000 7fa5161c4700 1 Processor -- start 2023-08-17T17:53:52.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.364+0000 7fa5161c4700 1 -- start start 2023-08-17T17:53:52.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.365+0000 7fa5161c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 0x7fa5100c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.365+0000 7fa5161c4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5100a7c40 0x7fa5100c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.365+0000 7fa5161c4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa510154520 con 0x7fa5100a8080 2023-08-17T17:53:52.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.365+0000 7fa5161c4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5100c91e0 con 0x7fa5100a7c40 2023-08-17T17:53:52.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.365+0000 7fa5161c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100c94c0 con 0x7fa510154140 2023-08-17T17:53:52.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.365+0000 7fa50effd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5100a7c40 0x7fa5100c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.365+0000 7fa50effd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5100a7c40 0x7fa5100c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57534/0 (socket says 172.21.15.78:57534) 2023-08-17T17:53:52.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.365+0000 7fa50effd700 1 -- 172.21.15.78:0/1027067953 learned_addr learned my addr 172.21.15.78:0/1027067953 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:52.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa50f7fe700 1 --2- 172.21.15.78:0/1027067953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 0x7fa5100c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa50effd700 1 -- 172.21.15.78:0/1027067953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 msgr2=0x7fa5100c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:52.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa50effd700 1 --2- 172.21.15.78:0/1027067953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 0x7fa5100c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa50effd700 1 -- 172.21.15.78:0/1027067953 >> v1:172.21.15.150:6789/0 conn(0x7fa5100a8080 legacy=0x7fa5100ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:52.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa50effd700 1 -- 172.21.15.78:0/1027067953 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5100c97a0 con 0x7fa5100a7c40 2023-08-17T17:53:52.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa50f7fe700 1 --2- 172.21.15.78:0/1027067953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 0x7fa5100c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:52.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa50effd700 1 --2- 172.21.15.78:0/1027067953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a7c40 0x7fa5100c0900 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7fa504006fd0 tx=0x7fa5040090f0).ready entity=mon.0 client_cookie=3833d5e845728ba8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:52.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa50e7fc700 1 -- 172.21.15.78:0/1027067953 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400b600 con 0x7fa5100a7c40 2023-08-17T17:53:52.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa50e7fc700 1 -- 172.21.15.78:0/1027067953 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50400b760 con 0x7fa5100a7c40 2023-08-17T17:53:52.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa50e7fc700 1 -- 172.21.15.78:0/1027067953 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400bae0 con 0x7fa5100a7c40 2023-08-17T17:53:52.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa5161c4700 1 -- 172.21.15.78:0/1027067953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a7c40 msgr2=0x7fa5100c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa5161c4700 1 --2- 172.21.15.78:0/1027067953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a7c40 0x7fa5100c0900 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7fa504006fd0 tx=0x7fa5040090f0).stop 2023-08-17T17:53:52.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa5161c4700 1 -- 172.21.15.78:0/1027067953 shutdown_connections 2023-08-17T17:53:52.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa5161c4700 1 --2- 172.21.15.78:0/1027067953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 0x7fa5100c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa5161c4700 1 --2- 172.21.15.78:0/1027067953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a7c40 0x7fa5100c0900 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa5161c4700 1 -- 172.21.15.78:0/1027067953 >> 172.21.15.78:0/1027067953 conn(0x7fa510094510 msgr2=0x7fa51006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:52.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa5161c4700 1 -- 172.21.15.78:0/1027067953 shutdown_connections 2023-08-17T17:53:52.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.366+0000 7fa5161c4700 1 -- 172.21.15.78:0/1027067953 wait complete. 2023-08-17T17:53:52.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.368+0000 7fa5161c4700 1 Processor -- start 2023-08-17T17:53:52.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.368+0000 7fa5161c4700 1 -- start start 2023-08-17T17:53:52.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.368+0000 7fa5161c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5100a7c40 0x7fa5100ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.368+0000 7fa5161c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a8080 0x7fa5100aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.368+0000 7fa5161c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 0x7fa5100affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.368+0000 7fa5161c4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100ab1a0 con 0x7fa5100a8080 2023-08-17T17:53:52.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.368+0000 7fa5161c4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100ab480 con 0x7fa5100a7c40 2023-08-17T17:53:52.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.368+0000 7fa5161c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100ab760 con 0x7fa510154140 2023-08-17T17:53:52.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a8080 0x7fa5100aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a8080 0x7fa5100aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57544/0 (socket says 172.21.15.78:57544) 2023-08-17T17:53:52.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50effd700 1 -- 172.21.15.78:0/2167082259 learned_addr learned my addr 172.21.15.78:0/2167082259 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:52.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50f7fe700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5100a7c40 0x7fa5100ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50effd700 1 -- 172.21.15.78:0/2167082259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 msgr2=0x7fa5100affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50ffff700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 0x7fa5100affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50effd700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 0x7fa5100affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50effd700 1 -- 172.21.15.78:0/2167082259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5100a7c40 msgr2=0x7fa5100ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50effd700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5100a7c40 0x7fa5100ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50effd700 1 -- 172.21.15.78:0/2167082259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504009370 con 0x7fa5100a8080 2023-08-17T17:53:52.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50ffff700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 0x7fa5100affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:52.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa50effd700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a8080 0x7fa5100aa970 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fa504011000 tx=0x7fa504017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:52.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa4f77fe700 1 -- 172.21.15.78:0/2167082259 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400bae0 con 0x7fa5100a8080 2023-08-17T17:53:52.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa4f77fe700 1 -- 172.21.15.78:0/2167082259 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa504000c90 con 0x7fa5100a8080 2023-08-17T17:53:52.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa5161c4700 1 -- 172.21.15.78:0/2167082259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5100abd60 con 0x7fa5100a8080 2023-08-17T17:53:52.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa4f77fe700 1 -- 172.21.15.78:0/2167082259 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50401c670 con 0x7fa5100a8080 2023-08-17T17:53:52.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.369+0000 7fa5161c4700 1 -- 172.21.15.78:0/2167082259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5100b04c0 con 0x7fa5100a8080 2023-08-17T17:53:52.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.370+0000 7fa5161c4700 1 -- 172.21.15.78:0/2167082259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5100c72f0 con 0x7fa5100a8080 2023-08-17T17:53:52.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.370+0000 7fa4f77fe700 1 -- 172.21.15.78:0/2167082259 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa50400f070 con 0x7fa5100a8080 2023-08-17T17:53:52.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.371+0000 7fa4f77fe700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4fc05ed60 0x7fa4fc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.371+0000 7fa4f77fe700 1 -- 172.21.15.78:0/2167082259 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa50407b410 con 0x7fa5100a8080 2023-08-17T17:53:52.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.371+0000 7fa50f7fe700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4fc05ed60 0x7fa4fc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.371+0000 7fa50f7fe700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4fc05ed60 0x7fa4fc061220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa50000e4b0 tx=0x7fa500007670).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:52.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.375+0000 7fa4f77fe700 1 -- 172.21.15.78:0/2167082259 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa50404cae0 con 0x7fa5100a8080 2023-08-17T17:53:52.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.534+0000 7fa5161c4700 1 -- 172.21.15.78:0/2167082259 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5100abbe0 con 0x7fa4fc05ed60 2023-08-17T17:53:52.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.544+0000 7fa4f77fe700 1 -- 172.21.15.78:0/2167082259 <== mgr.8364 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352930 (secure 0 0 0) 0x7fa50000ee60 con 0x7fa4fc05ed60 2023-08-17T17:53:52.548 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:52.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 -- 172.21.15.78:0/2167082259 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4fc05ed60 msgr2=0x7fa4fc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4fc05ed60 0x7fa4fc061220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa50000e4b0 tx=0x7fa500007670).stop 2023-08-17T17:53:52.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 -- 172.21.15.78:0/2167082259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a8080 msgr2=0x7fa5100aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a8080 0x7fa5100aa970 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fa504011000 tx=0x7fa504017000).stop 2023-08-17T17:53:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 -- 172.21.15.78:0/2167082259 shutdown_connections 2023-08-17T17:53:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fa4fc05ed60 0x7fa4fc061220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa510154140 0x7fa5100affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5100a7c40 0x7fa5100ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 --2- 172.21.15.78:0/2167082259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5100a8080 0x7fa5100aa970 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 -- 172.21.15.78:0/2167082259 >> 172.21.15.78:0/2167082259 conn(0x7fa510094510 msgr2=0x7fa5100cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 -- 172.21.15.78:0/2167082259 shutdown_connections 2023-08-17T17:53:52.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.547+0000 7fa5161c4700 1 -- 172.21.15.78:0/2167082259 wait complete. 2023-08-17T17:53:52.552 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:53:52.560 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:53:51.482267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427828,"kb_used_data":14196,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752546892,"statfs":{"total":773094113280,"available":770608017408,"internally_reserved":0,"allocated":14536704,"data_stored":7215579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10876,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.005216"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520973+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518391+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521887+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520181+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527201+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524561+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524279+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522549+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522433+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517850+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519687+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521868+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522048+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518305+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519562+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519990+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.525009+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520917+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519330+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520594+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526634+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519081+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522492+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519108+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518667+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520547+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519822+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517797+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521690+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520709+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526970+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.523865+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521863+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520130+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527550+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527051+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524596+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519633+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517843+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521809+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517758+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521840+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517278+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520305+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.523935+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520404+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526462+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517278+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520612+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524945+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524919+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517280+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517747+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526940+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517294+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519581+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526530+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.698832+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:53:46.698832+0000","last_peered":"2023-08-17T17:53:46.698832+0000","last_clean":"2023-08-17T17:53:46.698832+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:53:46.698832+0000","last_undegraded":"2023-08-17T17:53:46.698832+0000","last_fullsized":"2023-08-17T17:53:46.698832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521349+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.511068+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:53:45.511068+0000","last_peered":"2023-08-17T17:53:45.511068+0000","last_clean":"2023-08-17T17:53:45.511068+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:53:45.511068+0000","last_undegraded":"2023-08-17T17:53:45.511068+0000","last_fullsized":"2023-08-17T17:53:45.511068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517747+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.766756+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:53:45.766756+0000","last_peered":"2023-08-17T17:53:45.766756+0000","last_clean":"2023-08-17T17:53:45.766756+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:53:45.766756+0000","last_undegraded":"2023-08-17T17:53:45.766756+0000","last_fullsized":"2023-08-17T17:53:45.766756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527399+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.511090+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:53:45.511090+0000","last_peered":"2023-08-17T17:53:45.511090+0000","last_clean":"2023-08-17T17:53:45.511090+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:53:45.511090+0000","last_undegraded":"2023-08-17T17:53:45.511090+0000","last_fullsized":"2023-08-17T17:53:45.511090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699009+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:53:46.699009+0000","last_peered":"2023-08-17T17:53:46.699009+0000","last_clean":"2023-08-17T17:53:46.699009+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:53:46.699009+0000","last_undegraded":"2023-08-17T17:53:46.699009+0000","last_fullsized":"2023-08-17T17:53:46.699009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521822+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699007+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:53:46.699007+0000","last_peered":"2023-08-17T17:53:46.699007+0000","last_clean":"2023-08-17T17:53:46.699007+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:53:46.699007+0000","last_undegraded":"2023-08-17T17:53:46.699007+0000","last_fullsized":"2023-08-17T17:53:46.699007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526578+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699023+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:53:46.699023+0000","last_peered":"2023-08-17T17:53:46.699023+0000","last_clean":"2023-08-17T17:53:46.699023+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:53:46.699023+0000","last_undegraded":"2023-08-17T17:53:46.699023+0000","last_fullsized":"2023-08-17T17:53:46.699023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518244+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":115,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.698850+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:53:46.698850+0000","last_peered":"2023-08-17T17:53:46.698850+0000","last_clean":"2023-08-17T17:53:46.698850+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:53:46.698850+0000","last_undegraded":"2023-08-17T17:53:46.698850+0000","last_fullsized":"2023-08-17T17:53:46.698850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519579+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.252163+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:53:46.252163+0000","last_peered":"2023-08-17T17:53:46.252163+0000","last_clean":"2023-08-17T17:53:46.252163+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:53:46.252163+0000","last_undegraded":"2023-08-17T17:53:46.252163+0000","last_fullsized":"2023-08-17T17:53:46.252163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575078,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302956,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068884,"statfs":{"total":96636764160,"available":96326537216,"internally_reserved":0,"allocated":1806336,"data_stored":896504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.42099999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.75800000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.83299999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.59699999999999998,"5min":0.745,"15min":0.80000000000000004},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.436,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":1.23,"15min":1.23},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76100000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.60999999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.86099999999999999},"last":0.62}]},{"osd":4,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.85499999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.90200000000000002},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70499999999999996,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.623},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.60699999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69099999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.84599999999999997,"15min":1.0609999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.373},"max":{"1min":0.69699999999999995,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.46899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.67600000000000005,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.443,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.75800000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.74199999999999999,"15min":0.77300000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":1.51},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.872},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.747,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.34799999999999998},"min":{"1min":0.25900000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45800000000000002,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.5,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.36399999999999999},"min":{"1min":0.26800000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.70799999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.63600000000000001,"15min":0.66300000000000003},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.33200000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.30399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.63300000000000001},"last":0.376}]},{"osd":4,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.89600000000000002,"15min":0.93200000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85299999999999998,"5min":1.2989999999999999,"15min":1.331},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84499999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86799999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575078,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.61599999999999999},"last":0.308},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.377,"15min":0.38400000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.57099999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.36499999999999999},"min":{"1min":0.22800000000000001,"5min":0.19900000000000001,"15min":0.19400000000000001},"max":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.39500000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55400000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.41199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.26200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0569999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.034,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.095,"5min":1.677,"15min":1.677},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.99099999999999999,"5min":1.51,"15min":1.51},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0740000000000001,"5min":1.325,"15min":1.391},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":1.103,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0980000000000001,"15min":1.544},"last":0.68100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32900000000000001,"15min":0.34599999999999997},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.246},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49199999999999999,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.31}]},{"osd":1,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.41599999999999998},"min":{"1min":0.25600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.41899999999999998},"min":{"1min":0.308,"5min":0.27800000000000002,"15min":0.27200000000000002},"max":{"1min":0.58299999999999996,"5min":0.63,"15min":1.268},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88,"5min":1.417,"15min":1.417},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":1.51,"15min":2.9220000000000002},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":1.544,"15min":1.544},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.872,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.504},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":1.415,"15min":1.415},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.81499999999999995,"5min":1.3859999999999999,"15min":2.984},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575078,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.56299999999999994},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.375},"min":{"1min":0.251,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.54800000000000004,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.22},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38300000000000001,"15min":0.39100000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.63300000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.313}]},{"osd":4,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.76700000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.498},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.78800000000000003,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86699999999999999,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.433,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81699999999999995,"5min":1.466,"15min":1.466},"last":0.62},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.48,"15min":1.48},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82299999999999995,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.26400000000000001},"max":{"1min":0.77000000000000002,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.374},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.81000000000000005,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.55200000000000005},"min":{"1min":0.45200000000000001,"5min":0.34300000000000003,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":1.252,"15min":1.252},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.306,"15min":1.306},"last":0.502}]},{"osd":2,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88800000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":1.444,"15min":1.444},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80600000000000005,"5min":1.482,"15min":1.482},"last":0.433},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.86299999999999999,"5min":1.123,"15min":1.123},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":1.002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.48299999999999998},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.91100000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":1.048,"15min":1.048},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.056},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575077,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307064,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064776,"statfs":{"total":96636764160,"available":96322330624,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69299999999999995,"5min":1.165,"15min":1.165},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":1.022,"15min":1.022},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.68500000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.41599999999999998,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.76400000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.372},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":1.153,"15min":1.153},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":1.036,"15min":1.036},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.255},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.315},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35899999999999999,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.439},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.501}]},{"osd":7,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:53:52.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2023-08-17T17:53:52.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3f is not active+clean 2023-08-17T17:53:52.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.520973+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.39 is not active+clean 2023-08-17T17:53:52.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3e is not active+clean 2023-08-17T17:53:52.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.518391+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:53:52.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2023-08-17T17:53:52.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3d is not active+clean 2023-08-17T17:53:52.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.521887+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:53:52.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3b is not active+clean 2023-08-17T17:53:52.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3c is not active+clean 2023-08-17T17:53:52.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.520181+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3c is not active+clean 2023-08-17T17:53:52.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3b is not active+clean 2023-08-17T17:53:52.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.527201+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:53:52.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2023-08-17T17:53:52.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3a is not active+clean 2023-08-17T17:53:52.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.524561+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:53:52.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3e is not active+clean 2023-08-17T17:53:52.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.39 is not active+clean 2023-08-17T17:53:52.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.524279+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:53:52.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3f is not active+clean 2023-08-17T17:53:52.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.38 is not active+clean 2023-08-17T17:53:52.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.522549+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:53:52.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2023-08-17T17:53:52.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.37 is not active+clean 2023-08-17T17:53:52.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.522433+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:53:52.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.31 is not active+clean 2023-08-17T17:53:52.581 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.581 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.36 is not active+clean 2023-08-17T17:53:52.581 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.517850+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:53:52.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.32 is not active+clean 2023-08-17T17:53:52.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.35 is not active+clean 2023-08-17T17:53:52.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.519687+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:53:52.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2023-08-17T17:53:52.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.34 is not active+clean 2023-08-17T17:53:52.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.521868+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:53:52.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.34 is not active+clean 2023-08-17T17:53:52.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.33 is not active+clean 2023-08-17T17:53:52.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.522048+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.35 is not active+clean 2023-08-17T17:53:52.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.32 is not active+clean 2023-08-17T17:53:52.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.518305+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:53:52.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2023-08-17T17:53:52.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.31 is not active+clean 2023-08-17T17:53:52.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.519562+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2023-08-17T17:53:52.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.30 is not active+clean 2023-08-17T17:53:52.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.519990+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:53:52.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2023-08-17T17:53:52.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2f is not active+clean 2023-08-17T17:53:52.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.525009+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:53:52.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.29 is not active+clean 2023-08-17T17:53:52.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2e is not active+clean 2023-08-17T17:53:52.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.520917+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:53:52.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2a is not active+clean 2023-08-17T17:53:52.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2d is not active+clean 2023-08-17T17:53:52.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.519330+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:53:52.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2b is not active+clean 2023-08-17T17:53:52.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2c is not active+clean 2023-08-17T17:53:52.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.520594+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:53:52.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2c is not active+clean 2023-08-17T17:53:52.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2b is not active+clean 2023-08-17T17:53:52.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.526634+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:53:52.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2d is not active+clean 2023-08-17T17:53:52.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.596 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2a is not active+clean 2023-08-17T17:53:52.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.519081+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:53:52.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2e is not active+clean 2023-08-17T17:53:52.597 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.29 is not active+clean 2023-08-17T17:53:52.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.522492+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:53:52.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2023-08-17T17:53:52.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.28 is not active+clean 2023-08-17T17:53:52.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.519108+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T17:53:52.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2023-08-17T17:53:52.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.27 is not active+clean 2023-08-17T17:53:52.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.518667+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:53:52.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2023-08-17T17:53:52.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.26 is not active+clean 2023-08-17T17:53:52.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.520547+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:53:52.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2023-08-17T17:53:52.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.25 is not active+clean 2023-08-17T17:53:52.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.519822+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2023-08-17T17:53:52.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.24 is not active+clean 2023-08-17T17:53:52.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.517797+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:53:52.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2023-08-17T17:53:52.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.23 is not active+clean 2023-08-17T17:53:52.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.521690+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.25 is not active+clean 2023-08-17T17:53:52.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.22 is not active+clean 2023-08-17T17:53:52.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.520709+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2023-08-17T17:53:52.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.21 is not active+clean 2023-08-17T17:53:52.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.526970+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:53:52.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2023-08-17T17:53:52.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.20 is not active+clean 2023-08-17T17:53:52.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.523865+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:53:52.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-08-17T17:53:52.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1f is not active+clean 2023-08-17T17:53:52.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.521863+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:53:52.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-08-17T17:53:52.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1e is not active+clean 2023-08-17T17:53:52.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.520130+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:53:52.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-08-17T17:53:52.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1d is not active+clean 2023-08-17T17:53:52.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.527550+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:53:52.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2023-08-17T17:53:52.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1c is not active+clean 2023-08-17T17:53:52.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.527051+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:53:52.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-08-17T17:53:52.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1b is not active+clean 2023-08-17T17:53:52.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.524596+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:53:52.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-08-17T17:53:52.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1a is not active+clean 2023-08-17T17:53:52.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.519633+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:53:52.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2023-08-17T17:53:52.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.19 is not active+clean 2023-08-17T17:53:52.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.517843+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:53:52.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-08-17T17:53:52.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.18 is not active+clean 2023-08-17T17:53:52.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.521809+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:53:52.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-08-17T17:53:52.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.f is not active+clean 2023-08-17T17:53:52.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.517758+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:53:52.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-08-17T17:53:52.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.e is not active+clean 2023-08-17T17:53:52.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.521840+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:53:52.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-08-17T17:53:52.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.d is not active+clean 2023-08-17T17:53:52.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.517278+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:53:52.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-08-17T17:53:52.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.c is not active+clean 2023-08-17T17:53:52.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.520305+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:53:52.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2023-08-17T17:53:52.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.b is not active+clean 2023-08-17T17:53:52.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.523935+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:53:52.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-08-17T17:53:52.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.a is not active+clean 2023-08-17T17:53:52.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.520404+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2023-08-17T17:53:52.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.9 is not active+clean 2023-08-17T17:53:52.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.526462+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:53:52.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-08-17T17:53:52.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2023-08-17T17:53:52.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.517278+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:53:52.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2023-08-17T17:53:52.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.7 is not active+clean 2023-08-17T17:53:52.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.520612+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-08-17T17:53:52.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.6 is not active+clean 2023-08-17T17:53:52.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.524945+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:53:52.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-08-17T17:53:52.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.5 is not active+clean 2023-08-17T17:53:52.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.524919+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T17:53:52.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-08-17T17:53:52.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2023-08-17T17:53:52.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.517280+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:53:52.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-08-17T17:53:52.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3 is not active+clean 2023-08-17T17:53:52.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.517747+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:53:52.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-08-17T17:53:52.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2 is not active+clean 2023-08-17T17:53:52.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.526940+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:53:52.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-08-17T17:53:52.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2023-08-17T17:53:52.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.517294+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:53:52.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-08-17T17:53:52.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.0 is not active+clean 2023-08-17T17:53:52.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.519581+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T17:53:52.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-08-17T17:53:52.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.15 is not active+clean 2023-08-17T17:53:52.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.526530+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:53:52.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-08-17T17:53:52.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.13 is not active+clean 2023-08-17T17:53:52.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.521349+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2023-08-17T17:53:52.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2023-08-17T17:53:52.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.517747+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T17:53:52.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-08-17T17:53:52.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.12 is not active+clean 2023-08-17T17:53:52.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.527399+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:53:52.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-08-17T17:53:52.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.11 is not active+clean 2023-08-17T17:53:52.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.521822+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T17:53:52.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-08-17T17:53:52.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.14 is not active+clean 2023-08-17T17:53:52.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.526578+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T17:53:52.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2023-08-17T17:53:52.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.17 is not active+clean 2023-08-17T17:53:52.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.518244+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T17:53:52.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-08-17T17:53:52.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T17:53:48.512906+0000', 'last_change': '2023-08-17T17:53:48.512906+0000', 'last_active': '2023-08-17T17:53:48.512906+0000', 'last_peered': '2023-08-17T17:53:48.512906+0000', 'last_clean': '2023-08-17T17:53:48.512906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:48.512906+0000', 'last_undegraded': '2023-08-17T17:53:48.512906+0000', 'last_fullsized': '2023-08-17T17:53:48.512906+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:48.512906+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T17:53:52.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.16 is not active+clean 2023-08-17T17:53:52.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T17:53:47.508215+0000', 'last_change': '2023-08-17T17:53:47.519579+0000', 'last_active': '2023-08-17T17:53:47.508215+0000', 'last_peered': '2023-08-17T17:53:47.508215+0000', 'last_clean': '2023-08-17T17:53:47.508215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T17:53:47.508215+0000', 'last_undegraded': '2023-08-17T17:53:47.508215+0000', 'last_fullsized': '2023-08-17T17:53:47.508215+0000', 'mapping_epoch': 146, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 146, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'last_clean_scrub_stamp': '2023-08-17T17:53:47.508215+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T17:53:52.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T17:53:52.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.762+0000 7f14a0520700 1 Processor -- start 2023-08-17T17:53:52.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.762+0000 7f14a0520700 1 -- start start 2023-08-17T17:53:52.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.763+0000 7f14a0520700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f14980a7c90 0x7f14980c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.763+0000 7f14a0520700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14980bf210 con 0x7f14980be4d0 2023-08-17T17:53:52.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.763+0000 7f14a0520700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14980c5a80 con 0x7f1498151e40 2023-08-17T17:53:52.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.763+0000 7f14a0520700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14980c5450 con 0x7f14980a7c90 2023-08-17T17:53:52.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.763+0000 7f149dabb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f14980a7c90 0x7f14980c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.763+0000 7f149eabd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f14980be4d0 0x7f14980be900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41160/0 (socket says 172.21.15.78:41160) 2023-08-17T17:53:52.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.763+0000 7f149dabb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f14980a7c90 0x7f14980c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57556/0 (socket says 172.21.15.78:57556) 2023-08-17T17:53:52.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.763+0000 7f149eabd700 1 -- 172.21.15.78:0/2985271705 learned_addr learned my addr 172.21.15.78:0/2985271705 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:52.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.764+0000 7f149dabb700 1 -- 172.21.15.78:0/2985271705 >> v1:172.21.15.150:6789/0 conn(0x7f1498151e40 legacy=0x7f1498152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.764+0000 7f149dabb700 1 -- 172.21.15.78:0/2985271705 >> v1:172.21.15.78:6789/0 conn(0x7f14980be4d0 legacy=0x7f14980be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.764+0000 7f149d2ba700 1 -- 172.21.15.78:0/2985271705 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244780749 0 0) 0x7f14980bf210 con 0x7f14980be4d0 2023-08-17T17:53:52.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.764+0000 7f149dabb700 1 -- 172.21.15.78:0/2985271705 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14980a8190 con 0x7f14980a7c90 2023-08-17T17:53:52.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.764+0000 7f149dabb700 1 --2- 172.21.15.78:0/2985271705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14980a7c90 0x7f14980c5f10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f1488009760 tx=0x7f1488009060).ready entity=mon.0 client_cookie=2989f5c79aa6d013 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:52.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.764+0000 7f149d2ba700 1 -- 172.21.15.78:0/2985271705 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800b580 con 0x7f14980a7c90 2023-08-17T17:53:52.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.764+0000 7f149d2ba700 1 -- 172.21.15.78:0/2985271705 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800b6e0 con 0x7f14980a7c90 2023-08-17T17:53:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.764+0000 7f149d2ba700 1 -- 172.21.15.78:0/2985271705 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800ba60 con 0x7f14980a7c90 2023-08-17T17:53:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.765+0000 7f14a0520700 1 -- 172.21.15.78:0/2985271705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14980a7c90 msgr2=0x7f14980c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.765+0000 7f14a0520700 1 --2- 172.21.15.78:0/2985271705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14980a7c90 0x7f14980c5f10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f1488009760 tx=0x7f1488009060).stop 2023-08-17T17:53:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.765+0000 7f14a0520700 1 -- 172.21.15.78:0/2985271705 shutdown_connections 2023-08-17T17:53:52.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.765+0000 7f14a0520700 1 --2- 172.21.15.78:0/2985271705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14980a7c90 0x7f14980c5f10 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.765+0000 7f14a0520700 1 -- 172.21.15.78:0/2985271705 >> 172.21.15.78:0/2985271705 conn(0x7f1498092330 msgr2=0x7f1498062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:52.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.765+0000 7f14a0520700 1 -- 172.21.15.78:0/2985271705 shutdown_connections 2023-08-17T17:53:52.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.765+0000 7f14a0520700 1 -- 172.21.15.78:0/2985271705 wait complete. 2023-08-17T17:53:52.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.766+0000 7f14a0520700 1 Processor -- start 2023-08-17T17:53:52.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.766+0000 7f14a0520700 1 -- start start 2023-08-17T17:53:52.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f14a0520700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14980a7c90 0x7f14980c0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f14a0520700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14980be4d0 0x7f14980a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f14a0520700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1498151e40 0x7f14980a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f14a0520700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14980a9410 con 0x7f1498151e40 2023-08-17T17:53:52.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f14a0520700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14980c0b50 con 0x7f14980a7c90 2023-08-17T17:53:52.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f14a0520700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14980bff80 con 0x7f14980be4d0 2023-08-17T17:53:52.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149eabd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1498151e40 0x7f14980a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149eabd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1498151e40 0x7f14980a8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57566/0 (socket says 172.21.15.78:57566) 2023-08-17T17:53:52.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149eabd700 1 -- 172.21.15.78:0/2640170562 learned_addr learned my addr 172.21.15.78:0/2640170562 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:52.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149dabb700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14980be4d0 0x7f14980a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149e2bc700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14980a7c90 0x7f14980c0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149eabd700 1 -- 172.21.15.78:0/2640170562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14980be4d0 msgr2=0x7f14980a8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149eabd700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14980be4d0 0x7f14980a8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149eabd700 1 -- 172.21.15.78:0/2640170562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14980a7c90 msgr2=0x7f14980c0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:52.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149eabd700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14980a7c90 0x7f14980c0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:52.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149eabd700 1 -- 172.21.15.78:0/2640170562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14880092a0 con 0x7f1498151e40 2023-08-17T17:53:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149e2bc700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14980a7c90 0x7f14980c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149dabb700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14980be4d0 0x7f14980a8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f149eabd700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1498151e40 0x7f14980a8f20 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f149000c790 tx=0x7f1490007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f148e7fc700 1 -- 172.21.15.78:0/2640170562 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490005d30 con 0x7f1498151e40 2023-08-17T17:53:52.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f148e7fc700 1 -- 172.21.15.78:0/2640170562 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490007110 con 0x7f1498151e40 2023-08-17T17:53:52.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f14a0520700 1 -- 172.21.15.78:0/2640170562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14980c0220 con 0x7f1498151e40 2023-08-17T17:53:52.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f148e7fc700 1 -- 172.21.15.78:0/2640170562 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14900074d0 con 0x7f1498151e40 2023-08-17T17:53:52.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.767+0000 7f14a0520700 1 -- 172.21.15.78:0/2640170562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14980c07e0 con 0x7f1498151e40 2023-08-17T17:53:52.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.768+0000 7f14a0520700 1 -- 172.21.15.78:0/2640170562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14980c0d00 con 0x7f1498151e40 2023-08-17T17:53:52.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.769+0000 7f148e7fc700 1 -- 172.21.15.78:0/2640170562 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1490010030 con 0x7f1498151e40 2023-08-17T17:53:52.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.769+0000 7f148e7fc700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f147c05ed90 0x7f147c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:52.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.769+0000 7f148e7fc700 1 -- 172.21.15.78:0/2640170562 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1490079a20 con 0x7f1498151e40 2023-08-17T17:53:52.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.769+0000 7f149e2bc700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f147c05ed90 0x7f147c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:52.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.769+0000 7f149e2bc700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f147c05ed90 0x7f147c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1498157dd0 tx=0x7f1494009040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:52.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.773+0000 7f148e7fc700 1 -- 172.21.15.78:0/2640170562 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f149004afc0 con 0x7f1498151e40 2023-08-17T17:53:53.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.999+0000 7f14a0520700 1 -- 172.21.15.78:0/2640170562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f14980a8470 con 0x7f1498151e40 2023-08-17T17:53:53.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:52.999+0000 7f148e7fc700 1 -- 172.21.15.78:0/2640170562 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1110 (secure 0 0 0) 0x7f149004e5e0 con 0x7f1498151e40 2023-08-17T17:53:53.001 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:53.001 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1186,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":149,"num_osds":8,"num_up_osds":8,"osd_up_since":1692293655,"num_in_osds":8,"osd_in_since":1692293648,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2486095872,"bytes_avail":770608017408,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":55,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"b","status":"up:active","gid":8565}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-08-17T17:51:40.269875+0000","services":{}},"progress_events":{}} 2023-08-17T17:53:53.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 -- 172.21.15.78:0/2640170562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f147c05ed90 msgr2=0x7f147c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:53.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f147c05ed90 0x7f147c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1498157dd0 tx=0x7f1494009040).stop 2023-08-17T17:53:53.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 -- 172.21.15.78:0/2640170562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1498151e40 msgr2=0x7f14980a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:53.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1498151e40 0x7f14980a8f20 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f149000c790 tx=0x7f1490007f30).stop 2023-08-17T17:53:53.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 -- 172.21.15.78:0/2640170562 shutdown_connections 2023-08-17T17:53:53.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f147c05ed90 0x7f147c061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1498151e40 0x7f14980a8f20 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14980a7c90 0x7f14980c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 --2- 172.21.15.78:0/2640170562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14980be4d0 0x7f14980a8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 -- 172.21.15.78:0/2640170562 >> 172.21.15.78:0/2640170562 conn(0x7f1498092330 msgr2=0x7f14980a6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:53.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 -- 172.21.15.78:0/2640170562 shutdown_connections 2023-08-17T17:53:53.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.001+0000 7f14a0520700 1 -- 172.21.15.78:0/2640170562 wait complete. 2023-08-17T17:53:53.014 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-17T17:53:53.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:53:53.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.125+0000 7f576bf94700 1 Processor -- start 2023-08-17T17:53:53.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.126+0000 7f576bf94700 1 -- start start 2023-08-17T17:53:53.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.126+0000 7f576bf94700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5764154140 0x7f57640c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:53.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.126+0000 7f576bf94700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f57640a7c40 0x7f57640c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.126+0000 7f576bf94700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f57640a8080 0x7f57640c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.126+0000 7f576bf94700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640c12e0 con 0x7f57640a7c40 2023-08-17T17:53:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.126+0000 7f576bf94700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5764154520 con 0x7f57640a8080 2023-08-17T17:53:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576bf94700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640c91e0 con 0x7f5764154140 2023-08-17T17:53:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576952f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f57640a7c40 0x7f57640c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576952f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f57640a7c40 0x7f57640c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57582/0 (socket says 172.21.15.78:57582) 2023-08-17T17:53:53.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576952f700 1 -- 172.21.15.78:0/2539717816 learned_addr learned my addr 172.21.15.78:0/2539717816 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f5769d30700 1 --2- 172.21.15.78:0/2539717816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5764154140 0x7f57640c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576a531700 1 --2- 172.21.15.78:0/2539717816 >> v2:172.21.15.150:3300/0 conn(0x7f57640a8080 0x7f57640c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576952f700 1 -- 172.21.15.78:0/2539717816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5764154140 msgr2=0x7f57640c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576952f700 1 --2- 172.21.15.78:0/2539717816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5764154140 0x7f57640c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576952f700 1 -- 172.21.15.78:0/2539717816 >> v2:172.21.15.150:3300/0 conn(0x7f57640a8080 msgr2=0x7f57640c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576952f700 1 --2- 172.21.15.78:0/2539717816 >> v2:172.21.15.150:3300/0 conn(0x7f57640a8080 0x7f57640c0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576952f700 1 -- 172.21.15.78:0/2539717816 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640c94c0 con 0x7f57640a7c40 2023-08-17T17:53:53.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576a531700 1 --2- 172.21.15.78:0/2539717816 >> v2:172.21.15.150:3300/0 conn(0x7f57640a8080 0x7f57640c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:53.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f576952f700 1 --2- 172.21.15.78:0/2539717816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 0x7f57640c0900 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f576406bd60 tx=0x7f57580090f0).ready entity=mon.0 client_cookie=27235d92e91bf0f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:53.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f5768d2e700 1 -- 172.21.15.78:0/2539717816 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800b600 con 0x7f57640a7c40 2023-08-17T17:53:53.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f5768d2e700 1 -- 172.21.15.78:0/2539717816 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575800b760 con 0x7f57640a7c40 2023-08-17T17:53:53.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.127+0000 7f5768d2e700 1 -- 172.21.15.78:0/2539717816 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800bae0 con 0x7f57640a7c40 2023-08-17T17:53:53.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.128+0000 7f576bf94700 1 -- 172.21.15.78:0/2539717816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 msgr2=0x7f57640c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.128+0000 7f576bf94700 1 --2- 172.21.15.78:0/2539717816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 0x7f57640c0900 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f576406bd60 tx=0x7f57580090f0).stop 2023-08-17T17:53:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.128+0000 7f576bf94700 1 -- 172.21.15.78:0/2539717816 shutdown_connections 2023-08-17T17:53:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.128+0000 7f576bf94700 1 --2- 172.21.15.78:0/2539717816 >> v2:172.21.15.150:3300/0 conn(0x7f57640a8080 0x7f57640c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.128+0000 7f576bf94700 1 --2- 172.21.15.78:0/2539717816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5764154140 0x7f57640c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.128+0000 7f576bf94700 1 --2- 172.21.15.78:0/2539717816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 0x7f57640c0900 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.128+0000 7f576bf94700 1 -- 172.21.15.78:0/2539717816 >> 172.21.15.78:0/2539717816 conn(0x7f5764094510 msgr2=0x7f576406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.128+0000 7f576bf94700 1 -- 172.21.15.78:0/2539717816 shutdown_connections 2023-08-17T17:53:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.128+0000 7f576bf94700 1 -- 172.21.15.78:0/2539717816 wait complete. 2023-08-17T17:53:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.129+0000 7f576bf94700 1 Processor -- start 2023-08-17T17:53:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.129+0000 7f576bf94700 1 -- start start 2023-08-17T17:53:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f576bf94700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 0x7f57640ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f576bf94700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57640a8080 0x7f576414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:53.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f576bf94700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5764154140 0x7f5764152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f576bf94700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5764163f40 con 0x7f57640a7c40 2023-08-17T17:53:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f576bf94700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5764164220 con 0x7f5764154140 2023-08-17T17:53:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f576bf94700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5764164500 con 0x7f57640a8080 2023-08-17T17:53:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5769d30700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 0x7f57640ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5769d30700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 0x7f57640ad330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57584/0 (socket says 172.21.15.78:57584) 2023-08-17T17:53:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5769d30700 1 -- 172.21.15.78:0/2961955126 learned_addr learned my addr 172.21.15.78:0/2961955126 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f576952f700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57640a8080 0x7f576414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f576a531700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5764154140 0x7f5764152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5769d30700 1 -- 172.21.15.78:0/2961955126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57640a8080 msgr2=0x7f576414e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5769d30700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57640a8080 0x7f576414e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5769d30700 1 -- 172.21.15.78:0/2961955126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5764154140 msgr2=0x7f5764152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5769d30700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5764154140 0x7f5764152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5769d30700 1 -- 172.21.15.78:0/2961955126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5758009370 con 0x7f57640a7c40 2023-08-17T17:53:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5769d30700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 0x7f57640ad330 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f575400d860 tx=0x7f5754008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5761ffb700 1 -- 172.21.15.78:0/2961955126 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754011590 con 0x7f57640a7c40 2023-08-17T17:53:53.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5761ffb700 1 -- 172.21.15.78:0/2961955126 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57540116f0 con 0x7f57640a7c40 2023-08-17T17:53:53.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f576bf94700 1 -- 172.21.15.78:0/2961955126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57641647e0 con 0x7f57640a7c40 2023-08-17T17:53:53.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.130+0000 7f5761ffb700 1 -- 172.21.15.78:0/2961955126 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754011a70 con 0x7f57640a7c40 2023-08-17T17:53:53.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.131+0000 7f576bf94700 1 -- 172.21.15.78:0/2961955126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5764164da0 con 0x7f57640a7c40 2023-08-17T17:53:53.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.132+0000 7f576bf94700 1 -- 172.21.15.78:0/2961955126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5764047350 con 0x7f57640a7c40 2023-08-17T17:53:53.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.132+0000 7f5761ffb700 1 -- 172.21.15.78:0/2961955126 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5754012420 con 0x7f57640a7c40 2023-08-17T17:53:53.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.132+0000 7f5761ffb700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f575005ed90 0x7f5750061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:53.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.132+0000 7f5761ffb700 1 -- 172.21.15.78:0/2961955126 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5754079730 con 0x7f57640a7c40 2023-08-17T17:53:53.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.132+0000 7f576952f700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f575005ed90 0x7f5750061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:53.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.132+0000 7f576952f700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f575005ed90 0x7f5750061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f576406bd60 tx=0x7f5758017000).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:53.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.136+0000 7f5761ffb700 1 -- 172.21.15.78:0/2961955126 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f575404ac70 con 0x7f57640a7c40 2023-08-17T17:53:53.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.297+0000 7f576bf94700 1 -- 172.21.15.78:0/2961955126 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57640a94d0 con 0x7f575005ed90 2023-08-17T17:53:53.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.306+0000 7f5761ffb700 1 -- 172.21.15.78:0/2961955126 <== mgr.8364 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352930 (secure 0 0 0) 0x7f57640a94d0 con 0x7f575005ed90 2023-08-17T17:53:53.311 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 -- 172.21.15.78:0/2961955126 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f575005ed90 msgr2=0x7f5750061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f575005ed90 0x7f5750061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f576406bd60 tx=0x7f5758017000).stop 2023-08-17T17:53:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 -- 172.21.15.78:0/2961955126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 msgr2=0x7f57640ad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 0x7f57640ad330 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f575400d860 tx=0x7f5754008040).stop 2023-08-17T17:53:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 -- 172.21.15.78:0/2961955126 shutdown_connections 2023-08-17T17:53:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f575005ed90 0x7f5750061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5764154140 0x7f5764152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57640a7c40 0x7f57640ad330 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 --2- 172.21.15.78:0/2961955126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57640a8080 0x7f576414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 -- 172.21.15.78:0/2961955126 >> 172.21.15.78:0/2961955126 conn(0x7f5764094510 msgr2=0x7f57640cb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 -- 172.21.15.78:0/2961955126 shutdown_connections 2023-08-17T17:53:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:53.310+0000 7f576bf94700 1 -- 172.21.15.78:0/2961955126 wait complete. 2023-08-17T17:53:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:53:53.323 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T17:53:51.482267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427828,"kb_used_data":14196,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752546892,"statfs":{"total":773094113280,"available":770608017408,"internally_reserved":0,"allocated":14536704,"data_stored":7215579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10876,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.005216"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520973+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518391+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521887+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520181+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527201+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524561+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524279+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522549+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522433+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517850+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519687+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521868+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522048+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518305+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519562+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519990+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.525009+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520917+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519330+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520594+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526634+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519081+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.522492+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519108+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518667+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520547+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519822+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517797+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521690+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520709+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526970+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.523865+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521863+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520130+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527550+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527051+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524596+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519633+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517843+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521809+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517758+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521840+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517278+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520305+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.523935+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520404+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526462+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517278+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.520612+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524945+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.524919+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517280+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517747+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526940+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517294+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519581+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526530+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.698832+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:53:46.698832+0000","last_peered":"2023-08-17T17:53:46.698832+0000","last_clean":"2023-08-17T17:53:46.698832+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:53:46.698832+0000","last_undegraded":"2023-08-17T17:53:46.698832+0000","last_fullsized":"2023-08-17T17:53:46.698832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521349+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.511068+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:53:45.511068+0000","last_peered":"2023-08-17T17:53:45.511068+0000","last_clean":"2023-08-17T17:53:45.511068+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:53:45.511068+0000","last_undegraded":"2023-08-17T17:53:45.511068+0000","last_fullsized":"2023-08-17T17:53:45.511068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.517747+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.766756+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:53:45.766756+0000","last_peered":"2023-08-17T17:53:45.766756+0000","last_clean":"2023-08-17T17:53:45.766756+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:53:45.766756+0000","last_undegraded":"2023-08-17T17:53:45.766756+0000","last_fullsized":"2023-08-17T17:53:45.766756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.527399+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:45.511090+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:53:45.511090+0000","last_peered":"2023-08-17T17:53:45.511090+0000","last_clean":"2023-08-17T17:53:45.511090+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:53:45.511090+0000","last_undegraded":"2023-08-17T17:53:45.511090+0000","last_fullsized":"2023-08-17T17:53:45.511090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699009+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:53:46.699009+0000","last_peered":"2023-08-17T17:53:46.699009+0000","last_clean":"2023-08-17T17:53:46.699009+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:53:46.699009+0000","last_undegraded":"2023-08-17T17:53:46.699009+0000","last_fullsized":"2023-08-17T17:53:46.699009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.521822+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699007+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:53:46.699007+0000","last_peered":"2023-08-17T17:53:46.699007+0000","last_clean":"2023-08-17T17:53:46.699007+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:53:46.699007+0000","last_undegraded":"2023-08-17T17:53:46.699007+0000","last_fullsized":"2023-08-17T17:53:46.699007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.526578+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.699023+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:53:46.699023+0000","last_peered":"2023-08-17T17:53:46.699023+0000","last_clean":"2023-08-17T17:53:46.699023+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:53:46.699023+0000","last_undegraded":"2023-08-17T17:53:46.699023+0000","last_fullsized":"2023-08-17T17:53:46.699023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.518244+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":115,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.698850+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:53:46.698850+0000","last_peered":"2023-08-17T17:53:46.698850+0000","last_clean":"2023-08-17T17:53:46.698850+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:53:46.698850+0000","last_undegraded":"2023-08-17T17:53:46.698850+0000","last_fullsized":"2023-08-17T17:53:46.698850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T17:53:48.512906+0000","last_change":"2023-08-17T17:53:48.512906+0000","last_active":"2023-08-17T17:53:48.512906+0000","last_peered":"2023-08-17T17:53:48.512906+0000","last_clean":"2023-08-17T17:53:48.512906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:48.512906+0000","last_undegraded":"2023-08-17T17:53:48.512906+0000","last_fullsized":"2023-08-17T17:53:48.512906+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T17:53:47.508215+0000","last_change":"2023-08-17T17:53:47.519579+0000","last_active":"2023-08-17T17:53:47.508215+0000","last_peered":"2023-08-17T17:53:47.508215+0000","last_clean":"2023-08-17T17:53:47.508215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T17:53:47.508215+0000","last_undegraded":"2023-08-17T17:53:47.508215+0000","last_fullsized":"2023-08-17T17:53:47.508215+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-08-17T17:53:46.252163+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:53:46.252163+0000","last_peered":"2023-08-17T17:53:46.252163+0000","last_clean":"2023-08-17T17:53:46.252163+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:53:46.252163+0000","last_undegraded":"2023-08-17T17:53:46.252163+0000","last_fullsized":"2023-08-17T17:53:46.252163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575078,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302956,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068884,"statfs":{"total":96636764160,"available":96326537216,"internally_reserved":0,"allocated":1806336,"data_stored":896504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.42099999999999999,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.75800000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.83299999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.59699999999999998,"5min":0.745,"15min":0.80000000000000004},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.436,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":1.23,"15min":1.23},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76100000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.60999999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.86099999999999999},"last":0.62}]},{"osd":4,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.85499999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.26300000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73399999999999999,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Aug 17 17:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.88800000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.90200000000000002},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70499999999999996,"5min":0.88200000000000001,"15min":1.0980000000000001},"last":0.623},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50800000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.60699999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69099999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":1.1930000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.84599999999999997,"15min":1.0609999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.373},"max":{"1min":0.69699999999999995,"5min":0.91100000000000003,"15min":1.1080000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.58099999999999996},"min":{"1min":0.46899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.69899999999999995,"5min":0.88400000000000001,"15min":1.0780000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.67600000000000005,"5min":1.0509999999999999,"15min":1.1240000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.443,"15min":0.438},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.75800000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.74199999999999999,"15min":0.77300000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":1.51},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.872},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.747,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575079,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.34799999999999998},"min":{"1min":0.25900000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45800000000000002,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.5,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.36399999999999999},"min":{"1min":0.26800000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.70799999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.63600000000000001,"15min":0.66300000000000003},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.33200000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.30399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.63300000000000001},"last":0.376}]},{"osd":4,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.89600000000000002,"15min":0.93200000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85299999999999998,"5min":1.2989999999999999,"15min":1.331},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84499999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86799999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575078,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.61599999999999999},"last":0.308},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.377,"15min":0.38400000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.57099999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.36499999999999999},"min":{"1min":0.22800000000000001,"5min":0.19900000000000001,"15min":0.19400000000000001},"max":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.39500000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.25800000000000001},"max":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.65200000000000002},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39000000000000001,"15min":0.40300000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55400000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.41199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.26200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0569999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.034,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.095,"5min":1.677,"15min":1.677},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.99099999999999999,"5min":1.51,"15min":1.51},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0740000000000001,"5min":1.325,"15min":1.391},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Aug 17 17:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":1.103,"5min":5.6109999999999998,"15min":5.6109999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0980000000000001,"15min":1.544},"last":0.68100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575078,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32900000000000001,"15min":0.34599999999999997},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.246},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49199999999999999,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.31}]},{"osd":1,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.41599999999999998},"min":{"1min":0.25600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.41899999999999998},"min":{"1min":0.308,"5min":0.27800000000000002,"15min":0.27200000000000002},"max":{"1min":0.58299999999999996,"5min":0.63,"15min":1.268},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88,"5min":1.417,"15min":1.417},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":1.51,"15min":2.9220000000000002},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":1.544,"15min":1.544},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.872,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.504},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":1.415,"15min":1.415},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.81499999999999995,"5min":1.3859999999999999,"15min":2.984},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575078,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.56299999999999994},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.375},"min":{"1min":0.251,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.54800000000000004,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.22},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38300000000000001,"15min":0.39100000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.63300000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.313}]},{"osd":4,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.76700000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.498},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.78800000000000003,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86699999999999999,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.433,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81699999999999995,"5min":1.466,"15min":1.466},"last":0.62},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.48,"15min":1.48},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82299999999999995,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302968,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068872,"statfs":{"total":96636764160,"available":96326524928,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.26400000000000001},"max":{"1min":0.77000000000000002,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.374},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.81000000000000005,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.55200000000000005},"min":{"1min":0.45200000000000001,"5min":0.34300000000000003,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":1.252,"15min":1.252},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.306,"15min":1.306},"last":0.502}]},{"osd":2,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88800000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":1.444,"15min":1.444},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80600000000000005,"5min":1.482,"15min":1.482},"last":0.433},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.86299999999999999,"5min":1.123,"15min":1.123},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":1.002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.48299999999999998},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.91100000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":1.048,"15min":1.048},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.056},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575077,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307064,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064776,"statfs":{"total":96636764160,"available":96322330624,"internally_reserved":0,"allocated":1818624,"data_stored":902725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69299999999999995,"5min":1.165,"15min":1.165},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":1.022,"15min":1.022},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.68500000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.41599999999999998,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.76400000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.372},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":1.153,"15min":1.153},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":1.036,"15min":1.036},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.255},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.315},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35899999999999999,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.439},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.501}]},{"osd":7,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:53:54.812 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-08-17T17:53:54.811+0000 7f49edca1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T17:53:56.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T17:53:56.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.461+0000 7fd81bad4700 1 Processor -- start 2023-08-17T17:53:56.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.462+0000 7fd81bad4700 1 -- start start 2023-08-17T17:53:56.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.462+0000 7fd81bad4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd814069f30 0x7fd814067f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.462+0000 7fd81bad4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd814068430 0x7fd81415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81bad4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8140a65a0 con 0x7fd8141553c0 2023-08-17T17:53:56.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81bad4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd814069480 con 0x7fd814068430 2023-08-17T17:53:56.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81bad4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8140c2d20 con 0x7fd814069f30 2023-08-17T17:53:56.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81a071700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd814068430 0x7fd81415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81a071700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd814068430 0x7fd81415bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57600/0 (socket says 172.21.15.78:57600) 2023-08-17T17:53:56.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81a071700 1 -- 172.21.15.78:0/2882111246 learned_addr learned my addr 172.21.15.78:0/2882111246 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:56.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81906f700 1 --2- 172.21.15.78:0/2882111246 >> v2:172.21.15.150:3300/0 conn(0x7fd814069f30 0x7fd814067f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81a071700 1 -- 172.21.15.78:0/2882111246 >> v2:172.21.15.150:3300/0 conn(0x7fd814069f30 msgr2=0x7fd814067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:56.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81a071700 1 --2- 172.21.15.78:0/2882111246 >> v2:172.21.15.150:3300/0 conn(0x7fd814069f30 0x7fd814067f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81a071700 1 -- 172.21.15.78:0/2882111246 >> v1:172.21.15.150:6789/0 conn(0x7fd8141553c0 legacy=0x7fd8140c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:56.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81a071700 1 -- 172.21.15.78:0/2882111246 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd814064040 con 0x7fd814068430 2023-08-17T17:53:56.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81906f700 1 --2- 172.21.15.78:0/2882111246 >> v2:172.21.15.150:3300/0 conn(0x7fd814069f30 0x7fd814067f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T17:53:56.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81a071700 1 --2- 172.21.15.78:0/2882111246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd814068430 0x7fd81415bbf0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fd8140a9720 tx=0x7fd80c009840).ready entity=mon.0 client_cookie=3cf5f1e2f9dfd672 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:56.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81886e700 1 -- 172.21.15.78:0/2882111246 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c00e070 con 0x7fd814068430 2023-08-17T17:53:56.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81886e700 1 -- 172.21.15.78:0/2882111246 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c00ba50 con 0x7fd814068430 2023-08-17T17:53:56.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.463+0000 7fd81886e700 1 -- 172.21.15.78:0/2882111246 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c00bdd0 con 0x7fd814068430 2023-08-17T17:53:56.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.464+0000 7fd81bad4700 1 -- 172.21.15.78:0/2882111246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd814068430 msgr2=0x7fd81415bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:56.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.464+0000 7fd81bad4700 1 --2- 172.21.15.78:0/2882111246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd814068430 0x7fd81415bbf0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fd8140a9720 tx=0x7fd80c009840).stop 2023-08-17T17:53:56.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.464+0000 7fd81bad4700 1 -- 172.21.15.78:0/2882111246 shutdown_connections 2023-08-17T17:53:56.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.464+0000 7fd81bad4700 1 --2- 172.21.15.78:0/2882111246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd814068430 0x7fd81415bbf0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.464+0000 7fd81bad4700 1 --2- 172.21.15.78:0/2882111246 >> v2:172.21.15.150:3300/0 conn(0x7fd814069f30 0x7fd814067f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.464+0000 7fd81bad4700 1 -- 172.21.15.78:0/2882111246 >> 172.21.15.78:0/2882111246 conn(0x7fd814062fc0 msgr2=0x7fd8140c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:56.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.464+0000 7fd81bad4700 1 -- 172.21.15.78:0/2882111246 shutdown_connections 2023-08-17T17:53:56.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.464+0000 7fd81bad4700 1 -- 172.21.15.78:0/2882111246 wait complete. 2023-08-17T17:53:56.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.465+0000 7fd81bad4700 1 Processor -- start 2023-08-17T17:53:56.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.465+0000 7fd81bad4700 1 -- start start 2023-08-17T17:53:56.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd81bad4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd814068430 0x7fd8140c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd81bad4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd814069f30 0x7fd814151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd81bad4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8141553c0 0x7fd8140a7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd81bad4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140a8910 con 0x7fd8141553c0 2023-08-17T17:53:56.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd81bad4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140a6290 con 0x7fd814068430 2023-08-17T17:53:56.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd81bad4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140a5680 con 0x7fd814069f30 2023-08-17T17:53:56.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd81a071700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8141553c0 0x7fd8140a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd81a071700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8141553c0 0x7fd8140a7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57608/0 (socket says 172.21.15.78:57608) 2023-08-17T17:53:56.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd819870700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd814068430 0x7fd8140c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd81a071700 1 -- 172.21.15.78:0/1220833304 learned_addr learned my addr 172.21.15.78:0/1220833304 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:56.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.466+0000 7fd81906f700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd814069f30 0x7fd814151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd81a071700 1 -- 172.21.15.78:0/1220833304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd814069f30 msgr2=0x7fd814151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:56.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd81a071700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd814069f30 0x7fd814151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd81a071700 1 -- 172.21.15.78:0/1220833304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd814068430 msgr2=0x7fd8140c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:56.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd81a071700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd814068430 0x7fd8140c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd81a071700 1 -- 172.21.15.78:0/1220833304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c009ae0 con 0x7fd8141553c0 2023-08-17T17:53:56.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd81a071700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8141553c0 0x7fd8140a7460 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fd80c009fd0 tx=0x7fd80c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:56.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd809ffb700 1 -- 172.21.15.78:0/1220833304 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0032d0 con 0x7fd8141553c0 2023-08-17T17:53:56.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd809ffb700 1 -- 172.21.15.78:0/1220833304 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c0092e0 con 0x7fd8141553c0 2023-08-17T17:53:56.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd81bad4700 1 -- 172.21.15.78:0/1220833304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8140a5960 con 0x7fd8141553c0 2023-08-17T17:53:56.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd809ffb700 1 -- 172.21.15.78:0/1220833304 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c01d620 con 0x7fd8141553c0 2023-08-17T17:53:56.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.467+0000 7fd81bad4700 1 -- 172.21.15.78:0/1220833304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8140a5f20 con 0x7fd8141553c0 2023-08-17T17:53:56.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.468+0000 7fd81bad4700 1 -- 172.21.15.78:0/1220833304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd814047350 con 0x7fd8141553c0 2023-08-17T17:53:56.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.468+0000 7fd809ffb700 1 -- 172.21.15.78:0/1220833304 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd80c01b040 con 0x7fd8141553c0 2023-08-17T17:53:56.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.469+0000 7fd809ffb700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7f805ed90 0x7fd7f8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.469+0000 7fd809ffb700 1 -- 172.21.15.78:0/1220833304 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd80c07b4a0 con 0x7fd8141553c0 2023-08-17T17:53:56.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.469+0000 7fd819870700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7f805ed90 0x7fd7f8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.469+0000 7fd819870700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7f805ed90 0x7fd7f8061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd810003860 tx=0x7fd810007d40).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:56.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.473+0000 7fd809ffb700 1 -- 172.21.15.78:0/1220833304 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd80c04ca40 con 0x7fd8141553c0 2023-08-17T17:53:56.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.637+0000 7fd81bad4700 1 -- 172.21.15.78:0/1220833304 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8140a9cc0 con 0x7fd7f805ed90 2023-08-17T17:53:56.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.646+0000 7fd809ffb700 1 -- 172.21.15.78:0/1220833304 <== mgr.8364 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361868 (secure 0 0 0) 0x7fd8140a9cc0 con 0x7fd7f805ed90 2023-08-17T17:53:56.651 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:56.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 -- 172.21.15.78:0/1220833304 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7f805ed90 msgr2=0x7fd7f8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:56.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7f805ed90 0x7fd7f8061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd810003860 tx=0x7fd810007d40).stop 2023-08-17T17:53:56.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 -- 172.21.15.78:0/1220833304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8141553c0 msgr2=0x7fd8140a7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:56.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8141553c0 0x7fd8140a7460 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fd80c009fd0 tx=0x7fd80c009840).stop 2023-08-17T17:53:56.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 -- 172.21.15.78:0/1220833304 shutdown_connections 2023-08-17T17:53:56.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fd7f805ed90 0x7fd7f8061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8141553c0 0x7fd8140a7460 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd814068430 0x7fd8140c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 --2- 172.21.15.78:0/1220833304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd814069f30 0x7fd814151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 -- 172.21.15.78:0/1220833304 >> 172.21.15.78:0/1220833304 conn(0x7fd814062fc0 msgr2=0x7fd8140a6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:56.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 -- 172.21.15.78:0/1220833304 shutdown_connections 2023-08-17T17:53:56.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.650+0000 7fd81bad4700 1 -- 172.21.15.78:0/1220833304 wait complete. 2023-08-17T17:53:56.655 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T17:53:56.663 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-17T17:53:55.483095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":251,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428192,"kb_used_data":14560,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752546528,"statfs":{"total":773094113280,"available":770607644672,"internally_reserved":0,"allocated":14909440,"data_stored":7390908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10120,"num_objects":-16,"num_object_clones":0,"num_object_copies":-32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-47,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.005735"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.915605+0000","last_change":"2023-08-17T17:53:48.908739+0000","last_active":"2023-08-17T17:53:48.915605+0000","last_peered":"2023-08-17T17:53:48.915605+0000","last_clean":"2023-08-17T17:53:48.915605+0000","last_became_active":"2023-08-17T17:53:48.908422+0000","last_became_peered":"2023-08-17T17:53:48.908422+0000","last_unstale":"2023-08-17T17:53:48.915605+0000","last_undegraded":"2023-08-17T17:53:48.915605+0000","last_fullsized":"2023-08-17T17:53:48.915605+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"148'3","reported_seq":13,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919264+0000","last_change":"2023-08-17T17:53:48.544786+0000","last_active":"2023-08-17T17:53:48.919264+0000","last_peered":"2023-08-17T17:53:48.919264+0000","last_clean":"2023-08-17T17:53:48.919264+0000","last_became_active":"2023-08-17T17:53:48.544496+0000","last_became_peered":"2023-08-17T17:53:48.544496+0000","last_unstale":"2023-08-17T17:53:48.919264+0000","last_undegraded":"2023-08-17T17:53:48.919264+0000","last_fullsized":"2023-08-17T17:53:48.919264+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.924533+0000","last_change":"2023-08-17T17:53:48.923490+0000","last_active":"2023-08-17T17:53:48.924533+0000","last_peered":"2023-08-17T17:53:48.924533+0000","last_clean":"2023-08-17T17:53:48.924533+0000","last_became_active":"2023-08-17T17:53:48.923162+0000","last_became_peered":"2023-08-17T17:53:48.923162+0000","last_unstale":"2023-08-17T17:53:48.924533+0000","last_undegraded":"2023-08-17T17:53:48.924533+0000","last_fullsized":"2023-08-17T17:53:48.924533+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.897172+0000","last_change":"2023-08-17T17:53:48.544034+0000","last_active":"2023-08-17T17:53:48.897172+0000","last_peered":"2023-08-17T17:53:48.897172+0000","last_clean":"2023-08-17T17:53:48.897172+0000","last_became_active":"2023-08-17T17:53:48.543560+0000","last_became_peered":"2023-08-17T17:53:48.543560+0000","last_unstale":"2023-08-17T17:53:48.897172+0000","last_undegraded":"2023-08-17T17:53:48.897172+0000","last_fullsized":"2023-08-17T17:53:48.897172+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.909660+0000","last_change":"2023-08-17T17:53:48.905799+0000","last_active":"2023-08-17T17:53:48.909660+0000","last_peered":"2023-08-17T17:53:48.909660+0000","last_clean":"2023-08-17T17:53:48.909660+0000","last_became_active":"2023-08-17T17:53:48.905541+0000","last_became_peered":"2023-08-17T17:53:48.905541+0000","last_unstale":"2023-08-17T17:53:48.909660+0000","last_undegraded":"2023-08-17T17:53:48.909660+0000","last_fullsized":"2023-08-17T17:53:48.909660+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.904714+0000","last_change":"2023-08-17T17:53:48.548268+0000","last_active":"2023-08-17T17:53:48.904714+0000","last_peered":"2023-08-17T17:53:48.904714+0000","last_clean":"2023-08-17T17:53:48.904714+0000","last_became_active":"2023-08-17T17:53:48.547921+0000","last_became_peered":"2023-08-17T17:53:48.547921+0000","last_unstale":"2023-08-17T17:53:48.904714+0000","last_undegraded":"2023-08-17T17:53:48.904714+0000","last_fullsized":"2023-08-17T17:53:48.904714+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.920377+0000","last_change":"2023-08-17T17:53:48.916715+0000","last_active":"2023-08-17T17:53:48.920377+0000","last_peered":"2023-08-17T17:53:48.920377+0000","last_clean":"2023-08-17T17:53:48.920377+0000","last_became_active":"2023-08-17T17:53:48.916468+0000","last_became_peered":"2023-08-17T17:53:48.916468+0000","last_unstale":"2023-08-17T17:53:48.920377+0000","last_undegraded":"2023-08-17T17:53:48.920377+0000","last_fullsized":"2023-08-17T17:53:48.920377+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"148'2","reported_seq":12,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918850+0000","last_change":"2023-08-17T17:53:48.542459+0000","last_active":"2023-08-17T17:53:48.918850+0000","last_peered":"2023-08-17T17:53:48.918850+0000","last_clean":"2023-08-17T17:53:48.918850+0000","last_became_active":"2023-08-17T17:53:48.542197+0000","last_became_peered":"2023-08-17T17:53:48.542197+0000","last_unstale":"2023-08-17T17:53:48.918850+0000","last_undegraded":"2023-08-17T17:53:48.918850+0000","last_fullsized":"2023-08-17T17:53:48.918850+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.912356+0000","last_change":"2023-08-17T17:53:48.908822+0000","last_active":"2023-08-17T17:53:48.912356+0000","last_peered":"2023-08-17T17:53:48.912356+0000","last_clean":"2023-08-17T17:53:48.912356+0000","last_became_active":"2023-08-17T17:53:48.908548+0000","last_became_peered":"2023-08-17T17:53:48.908548+0000","last_unstale":"2023-08-17T17:53:48.912356+0000","last_undegraded":"2023-08-17T17:53:48.912356+0000","last_fullsized":"2023-08-17T17:53:48.912356+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.914283+0000","last_change":"2023-08-17T17:53:48.544006+0000","last_active":"2023-08-17T17:53:48.914283+0000","last_peered":"2023-08-17T17:53:48.914283+0000","last_clean":"2023-08-17T17:53:48.914283+0000","last_became_active":"2023-08-17T17:53:48.543554+0000","last_became_peered":"2023-08-17T17:53:48.543554+0000","last_unstale":"2023-08-17T17:53:48.914283+0000","last_undegraded":"2023-08-17T17:53:48.914283+0000","last_fullsized":"2023-08-17T17:53:48.914283+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.922391+0000","last_change":"2023-08-17T17:53:48.914179+0000","last_active":"2023-08-17T17:53:48.922391+0000","last_peered":"2023-08-17T17:53:48.922391+0000","last_clean":"2023-08-17T17:53:48.922391+0000","last_became_active":"2023-08-17T17:53:48.913857+0000","last_became_peered":"2023-08-17T17:53:48.913857+0000","last_unstale":"2023-08-17T17:53:48.922391+0000","last_undegraded":"2023-08-17T17:53:48.922391+0000","last_fullsized":"2023-08-17T17:53:48.922391+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.915690+0000","last_change":"2023-08-17T17:53:48.540619+0000","last_active":"2023-08-17T17:53:48.915690+0000","last_peered":"2023-08-17T17:53:48.915690+0000","last_clean":"2023-08-17T17:53:48.915690+0000","last_became_active":"2023-08-17T17:53:48.540327+0000","last_became_peered":"2023-08-17T17:53:48.540327+0000","last_unstale":"2023-08-17T17:53:48.915690+0000","last_undegraded":"2023-08-17T17:53:48.915690+0000","last_fullsized":"2023-08-17T17:53:48.915690+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.912144+0000","last_change":"2023-08-17T17:53:48.911036+0000","last_active":"2023-08-17T17:53:48.912144+0000","last_peered":"2023-08-17T17:53:48.912144+0000","last_clean":"2023-08-17T17:53:48.912144+0000","last_became_active":"2023-08-17T17:53:48.910429+0000","last_became_peered":"2023-08-17T17:53:48.910429+0000","last_unstale":"2023-08-17T17:53:48.912144+0000","last_undegraded":"2023-08-17T17:53:48.912144+0000","last_fullsized":"2023-08-17T17:53:48.912144+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.900491+0000","last_change":"2023-08-17T17:53:48.544898+0000","last_active":"2023-08-17T17:53:48.900491+0000","last_peered":"2023-08-17T17:53:48.900491+0000","last_clean":"2023-08-17T17:53:48.900491+0000","last_became_active":"2023-08-17T17:53:48.544578+0000","last_became_peered":"2023-08-17T17:53:48.544578+0000","last_unstale":"2023-08-17T17:53:48.900491+0000","last_undegraded":"2023-08-17T17:53:48.900491+0000","last_fullsized":"2023-08-17T17:53:48.900491+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.913568+0000","last_change":"2023-08-17T17:53:48.910472+0000","last_active":"2023-08-17T17:53:48.913568+0000","last_peered":"2023-08-17T17:53:48.913568+0000","last_clean":"2023-08-17T17:53:48.913568+0000","last_became_active":"2023-08-17T17:53:48.908408+0000","last_became_peered":"2023-08-17T17:53:48.908408+0000","last_unstale":"2023-08-17T17:53:48.913568+0000","last_undegraded":"2023-08-17T17:53:48.913568+0000","last_fullsized":"2023-08-17T17:53:48.913568+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.905185+0000","last_change":"2023-08-17T17:53:48.548909+0000","last_active":"2023-08-17T17:53:48.905185+0000","last_peered":"2023-08-17T17:53:48.905185+0000","last_clean":"2023-08-17T17:53:48.905185+0000","last_became_active":"2023-08-17T17:53:48.548511+0000","last_became_peered":"2023-08-17T17:53:48.548511+0000","last_unstale":"2023-08-17T17:53:48.905185+0000","last_undegraded":"2023-08-17T17:53:48.905185+0000","last_fullsized":"2023-08-17T17:53:48.905185+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.907348+0000","last_change":"2023-08-17T17:53:48.902636+0000","last_active":"2023-08-17T17:53:48.907348+0000","last_peered":"2023-08-17T17:53:48.907348+0000","last_clean":"2023-08-17T17:53:48.907348+0000","last_became_active":"2023-08-17T17:53:48.902463+0000","last_became_peered":"2023-08-17T17:53:48.902463+0000","last_unstale":"2023-08-17T17:53:48.907348+0000","last_undegraded":"2023-08-17T17:53:48.907348+0000","last_fullsized":"2023-08-17T17:53:48.907348+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.903979+0000","last_change":"2023-08-17T17:53:48.547922+0000","last_active":"2023-08-17T17:53:48.903979+0000","last_peered":"2023-08-17T17:53:48.903979+0000","last_clean":"2023-08-17T17:53:48.903979+0000","last_became_active":"2023-08-17T17:53:48.547628+0000","last_became_peered":"2023-08-17T17:53:48.547628+0000","last_unstale":"2023-08-17T17:53:48.903979+0000","last_undegraded":"2023-08-17T17:53:48.903979+0000","last_fullsized":"2023-08-17T17:53:48.903979+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919464+0000","last_change":"2023-08-17T17:53:48.914974+0000","last_active":"2023-08-17T17:53:48.919464+0000","last_peered":"2023-08-17T17:53:48.919464+0000","last_clean":"2023-08-17T17:53:48.919464+0000","last_became_active":"2023-08-17T17:53:48.914634+0000","last_became_peered":"2023-08-17T17:53:48.914634+0000","last_unstale":"2023-08-17T17:53:48.919464+0000","last_undegraded":"2023-08-17T17:53:48.919464+0000","last_fullsized":"2023-08-17T17:53:48.919464+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.897213+0000","last_change":"2023-08-17T17:53:48.543828+0000","last_active":"2023-08-17T17:53:48.897213+0000","last_peered":"2023-08-17T17:53:48.897213+0000","last_clean":"2023-08-17T17:53:48.897213+0000","last_became_active":"2023-08-17T17:53:48.543226+0000","last_became_peered":"2023-08-17T17:53:48.543226+0000","last_unstale":"2023-08-17T17:53:48.897213+0000","last_undegraded":"2023-08-17T17:53:48.897213+0000","last_fullsized":"2023-08-17T17:53:48.897213+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919521+0000","last_change":"2023-08-17T17:53:48.917834+0000","last_active":"2023-08-17T17:53:48.919521+0000","last_peered":"2023-08-17T17:53:48.919521+0000","last_clean":"2023-08-17T17:53:48.919521+0000","last_became_active":"2023-08-17T17:53:48.917177+0000","last_became_peered":"2023-08-17T17:53:48.917177+0000","last_unstale":"2023-08-17T17:53:48.919521+0000","last_undegraded":"2023-08-17T17:53:48.919521+0000","last_fullsized":"2023-08-17T17:53:48.919521+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.899573+0000","last_change":"2023-08-17T17:53:48.533845+0000","last_active":"2023-08-17T17:53:48.899573+0000","last_peered":"2023-08-17T17:53:48.899573+0000","last_clean":"2023-08-17T17:53:48.899573+0000","last_became_active":"2023-08-17T17:53:48.533450+0000","last_became_peered":"2023-08-17T17:53:48.533450+0000","last_unstale":"2023-08-17T17:53:48.899573+0000","last_undegraded":"2023-08-17T17:53:48.899573+0000","last_fullsized":"2023-08-17T17:53:48.899573+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.909784+0000","last_change":"2023-08-17T17:53:48.906697+0000","last_active":"2023-08-17T17:53:48.909784+0000","last_peered":"2023-08-17T17:53:48.909784+0000","last_clean":"2023-08-17T17:53:48.909784+0000","last_became_active":"2023-08-17T17:53:48.906435+0000","last_became_peered":"2023-08-17T17:53:48.906435+0000","last_unstale":"2023-08-17T17:53:48.909784+0000","last_undegraded":"2023-08-17T17:53:48.909784+0000","last_fullsized":"2023-08-17T17:53:48.909784+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"148'4","reported_seq":14,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.924279+0000","last_change":"2023-08-17T17:53:48.544215+0000","last_active":"2023-08-17T17:53:48.924279+0000","last_peered":"2023-08-17T17:53:48.924279+0000","last_clean":"2023-08-17T17:53:48.924279+0000","last_became_active":"2023-08-17T17:53:48.543018+0000","last_became_peered":"2023-08-17T17:53:48.543018+0000","last_unstale":"2023-08-17T17:53:48.924279+0000","last_undegraded":"2023-08-17T17:53:48.924279+0000","last_fullsized":"2023-08-17T17:53:48.924279+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919333+0000","last_change":"2023-08-17T17:53:48.914037+0000","last_active":"2023-08-17T17:53:48.919333+0000","last_peered":"2023-08-17T17:53:48.919333+0000","last_clean":"2023-08-17T17:53:48.919333+0000","last_became_active":"2023-08-17T17:53:48.913768+0000","last_became_peered":"2023-08-17T17:53:48.913768+0000","last_unstale":"2023-08-17T17:53:48.919333+0000","last_undegraded":"2023-08-17T17:53:48.919333+0000","last_fullsized":"2023-08-17T17:53:48.919333+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.917813+0000","last_change":"2023-08-17T17:53:48.546440+0000","last_active":"2023-08-17T17:53:48.917813+0000","last_peered":"2023-08-17T17:53:48.917813+0000","last_clean":"2023-08-17T17:53:48.917813+0000","last_became_active":"2023-08-17T17:53:48.546183+0000","last_became_peered":"2023-08-17T17:53:48.546183+0000","last_unstale":"2023-08-17T17:53:48.917813+0000","last_undegraded":"2023-08-17T17:53:48.917813+0000","last_fullsized":"2023-08-17T17:53:48.917813+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.920524+0000","last_change":"2023-08-17T17:53:48.919544+0000","last_active":"2023-08-17T17:53:48.920524+0000","last_peered":"2023-08-17T17:53:48.920524+0000","last_clean":"2023-08-17T17:53:48.920524+0000","last_became_active":"2023-08-17T17:53:48.919229+0000","last_became_peered":"2023-08-17T17:53:48.919229+0000","last_unstale":"2023-08-17T17:53:48.920524+0000","last_undegraded":"2023-08-17T17:53:48.920524+0000","last_fullsized":"2023-08-17T17:53:48.920524+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.895507+0000","last_change":"2023-08-17T17:53:48.539048+0000","last_active":"2023-08-17T17:53:48.895507+0000","last_peered":"2023-08-17T17:53:48.895507+0000","last_clean":"2023-08-17T17:53:48.895507+0000","last_became_active":"2023-08-17T17:53:48.538553+0000","last_became_peered":"2023-08-17T17:53:48.538553+0000","last_unstale":"2023-08-17T17:53:48.895507+0000","last_undegraded":"2023-08-17T17:53:48.895507+0000","last_fullsized":"2023-08-17T17:53:48.895507+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918577+0000","last_change":"2023-08-17T17:53:48.917346+0000","last_active":"2023-08-17T17:53:48.918577+0000","last_peered":"2023-08-17T17:53:48.918577+0000","last_clean":"2023-08-17T17:53:48.918577+0000","last_became_active":"2023-08-17T17:53:48.917075+0000","last_became_peered":"2023-08-17T17:53:48.917075+0000","last_unstale":"2023-08-17T17:53:48.918577+0000","last_undegraded":"2023-08-17T17:53:48.918577+0000","last_fullsized":"2023-08-17T17:53:48.918577+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.901952+0000","last_change":"2023-08-17T17:53:48.549156+0000","last_active":"2023-08-17T17:53:48.901952+0000","last_peered":"2023-08-17T17:53:48.901952+0000","last_clean":"2023-08-17T17:53:48.901952+0000","last_became_active":"2023-08-17T17:53:48.548877+0000","last_became_peered":"2023-08-17T17:53:48.548877+0000","last_unstale":"2023-08-17T17:53:48.901952+0000","last_undegraded":"2023-08-17T17:53:48.901952+0000","last_fullsized":"2023-08-17T17:53:48.901952+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918618+0000","last_change":"2023-08-17T17:53:48.914285+0000","last_active":"2023-08-17T17:53:48.918618+0000","last_peered":"2023-08-17T17:53:48.918618+0000","last_clean":"2023-08-17T17:53:48.918618+0000","last_became_active":"2023-08-17T17:53:48.913856+0000","last_became_peered":"2023-08-17T17:53:48.913856+0000","last_unstale":"2023-08-17T17:53:48.918618+0000","last_undegraded":"2023-08-17T17:53:48.918618+0000","last_fullsized":"2023-08-17T17:53:48.918618+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"148'4","reported_seq":14,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918568+0000","last_change":"2023-08-17T17:53:48.540893+0000","last_active":"2023-08-17T17:53:48.918568+0000","last_peered":"2023-08-17T17:53:48.918568+0000","last_clean":"2023-08-17T17:53:48.918568+0000","last_became_active":"2023-08-17T17:53:48.540622+0000","last_became_peered":"2023-08-17T17:53:48.540622+0000","last_unstale":"2023-08-17T17:53:48.918568+0000","last_undegraded":"2023-08-17T17:53:48.918568+0000","last_fullsized":"2023-08-17T17:53:48.918568+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.901354+0000","last_change":"2023-08-17T17:53:48.898880+0000","last_active":"2023-08-17T17:53:48.901354+0000","last_peered":"2023-08-17T17:53:48.901354+0000","last_clean":"2023-08-17T17:53:48.901354+0000","last_became_active":"2023-08-17T17:53:48.898620+0000","last_became_peered":"2023-08-17T17:53:48.898620+0000","last_unstale":"2023-08-17T17:53:48.901354+0000","last_undegraded":"2023-08-17T17:53:48.901354+0000","last_fullsized":"2023-08-17T17:53:48.901354+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.898346+0000","last_change":"2023-08-17T17:53:48.532688+0000","last_active":"2023-08-17T17:53:48.898346+0000","last_peered":"2023-08-17T17:53:48.898346+0000","last_clean":"2023-08-17T17:53:48.898346+0000","last_became_active":"2023-08-17T17:53:48.532417+0000","last_became_peered":"2023-08-17T17:53:48.532417+0000","last_unstale":"2023-08-17T17:53:48.898346+0000","last_undegraded":"2023-08-17T17:53:48.898346+0000","last_fullsized":"2023-08-17T17:53:48.898346+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.917759+0000","last_change":"2023-08-17T17:53:48.915102+0000","last_active":"2023-08-17T17:53:48.917759+0000","last_peered":"2023-08-17T17:53:48.917759+0000","last_clean":"2023-08-17T17:53:48.917759+0000","last_became_active":"2023-08-17T17:53:48.914837+0000","last_became_peered":"2023-08-17T17:53:48.914837+0000","last_unstale":"2023-08-17T17:53:48.917759+0000","last_undegraded":"2023-08-17T17:53:48.917759+0000","last_fullsized":"2023-08-17T17:53:48.917759+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.900789+0000","last_change":"2023-08-17T17:53:48.545706+0000","last_active":"2023-08-17T17:53:48.900789+0000","last_peered":"2023-08-17T17:53:48.900789+0000","last_clean":"2023-08-17T17:53:48.900789+0000","last_became_active":"2023-08-17T17:53:48.545441+0000","last_became_peered":"2023-08-17T17:53:48.545441+0000","last_unstale":"2023-08-17T17:53:48.900789+0000","last_undegraded":"2023-08-17T17:53:48.900789+0000","last_fullsized":"2023-08-17T17:53:48.900789+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918997+0000","last_change":"2023-08-17T17:53:48.912733+0000","last_active":"2023-08-17T17:53:48.918997+0000","last_peered":"2023-08-17T17:53:48.918997+0000","last_clean":"2023-08-17T17:53:48.918997+0000","last_became_active":"2023-08-17T17:53:48.912445+0000","last_became_peered":"2023-08-17T17:53:48.912445+0000","last_unstale":"2023-08-17T17:53:48.918997+0000","last_undegraded":"2023-08-17T17:53:48.918997+0000","last_fullsized":"2023-08-17T17:53:48.918997+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.917568+0000","last_change":"2023-08-17T17:53:48.533690+0000","last_active":"2023-08-17T17:53:48.917568+0000","last_peered":"2023-08-17T17:53:48.917568+0000","last_clean":"2023-08-17T17:53:48.917568+0000","last_became_active":"2023-08-17T17:53:48.533096+0000","last_became_peered":"2023-08-17T17:53:48.533096+0000","last_unstale":"2023-08-17T17:53:48.917568+0000","last_undegraded":"2023-08-17T17:53:48.917568+0000","last_fullsized":"2023-08-17T17:53:48.917568+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.912069+0000","last_change":"2023-08-17T17:53:48.901236+0000","last_active":"2023-08-17T17:53:48.912069+0000","last_peered":"2023-08-17T17:53:48.912069+0000","last_clean":"2023-08-17T17:53:48.912069+0000","last_became_active":"2023-08-17T17:53:48.900914+0000","last_became_peered":"2023-08-17T17:53:48.900914+0000","last_unstale":"2023-08-17T17:53:48.912069+0000","last_undegraded":"2023-08-17T17:53:48.912069+0000","last_fullsized":"2023-08-17T17:53:48.912069+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.901010+0000","last_change":"2023-08-17T17:53:48.542681+0000","last_active":"2023-08-17T17:53:48.901010+0000","last_peered":"2023-08-17T17:53:48.901010+0000","last_clean":"2023-08-17T17:53:48.901010+0000","last_became_active":"2023-08-17T17:53:48.542198+0000","last_became_peered":"2023-08-17T17:53:48.542198+0000","last_unstale":"2023-08-17T17:53:48.901010+0000","last_undegraded":"2023-08-17T17:53:48.901010+0000","last_fullsized":"2023-08-17T17:53:48.901010+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919555+0000","last_change":"2023-08-17T17:53:48.915013+0000","last_active":"2023-08-17T17:53:48.919555+0000","last_peered":"2023-08-17T17:53:48.919555+0000","last_clean":"2023-08-17T17:53:48.919555+0000","last_became_active":"2023-08-17T17:53:48.914749+0000","last_became_peered":"2023-08-17T17:53:48.914749+0000","last_unstale":"2023-08-17T17:53:48.919555+0000","last_undegraded":"2023-08-17T17:53:48.919555+0000","last_fullsized":"2023-08-17T17:53:48.919555+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.914381+0000","last_change":"2023-08-17T17:53:48.543839+0000","last_active":"2023-08-17T17:53:48.914381+0000","last_peered":"2023-08-17T17:53:48.914381+0000","last_clean":"2023-08-17T17:53:48.914381+0000","last_became_active":"2023-08-17T17:53:48.543161+0000","last_became_peered":"2023-08-17T17:53:48.543161+0000","last_unstale":"2023-08-17T17:53:48.914381+0000","last_undegraded":"2023-08-17T17:53:48.914381+0000","last_fullsized":"2023-08-17T17:53:48.914381+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.924141+0000","last_change":"2023-08-17T17:53:48.917555+0000","last_active":"2023-08-17T17:53:48.924141+0000","last_peered":"2023-08-17T17:53:48.924141+0000","last_clean":"2023-08-17T17:53:48.924141+0000","last_became_active":"2023-08-17T17:53:48.917283+0000","last_became_peered":"2023-08-17T17:53:48.917283+0000","last_unstale":"2023-08-17T17:53:48.924141+0000","last_undegraded":"2023-08-17T17:53:48.924141+0000","last_fullsized":"2023-08-17T17:53:48.924141+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.897944+0000","last_change":"2023-08-17T17:53:48.533419+0000","last_active":"2023-08-17T17:53:48.897944+0000","last_peered":"2023-08-17T17:53:48.897944+0000","last_clean":"2023-08-17T17:53:48.897944+0000","last_became_active":"2023-08-17T17:53:48.533166+0000","last_became_peered":"2023-08-17T17:53:48.533166+0000","last_unstale":"2023-08-17T17:53:48.897944+0000","last_undegraded":"2023-08-17T17:53:48.897944+0000","last_fullsized":"2023-08-17T17:53:48.897944+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.920366+0000","last_change":"2023-08-17T17:53:48.916861+0000","last_active":"2023-08-17T17:53:48.920366+0000","last_peered":"2023-08-17T17:53:48.920366+0000","last_clean":"2023-08-17T17:53:48.920366+0000","last_became_active":"2023-08-17T17:53:48.916577+0000","last_became_peered":"2023-08-17T17:53:48.916577+0000","last_unstale":"2023-08-17T17:53:48.920366+0000","last_undegraded":"2023-08-17T17:53:48.920366+0000","last_fullsized":"2023-08-17T17:53:48.920366+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.902784+0000","last_change":"2023-08-17T17:53:48.543975+0000","last_active":"2023-08-17T17:53:48.902784+0000","last_peered":"2023-08-17T17:53:48.902784+0000","last_clean":"2023-08-17T17:53:48.902784+0000","last_became_active":"2023-08-17T17:53:48.543641+0000","last_became_peered":"2023-08-17T17:53:48.543641+0000","last_unstale":"2023-08-17T17:53:48.902784+0000","last_undegraded":"2023-08-17T17:53:48.902784+0000","last_fullsized":"2023-08-17T17:53:48.902784+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.907295+0000","last_change":"2023-08-17T17:53:48.902324+0000","last_active":"2023-08-17T17:53:48.907295+0000","last_peered":"2023-08-17T17:53:48.907295+0000","last_clean":"2023-08-17T17:53:48.907295+0000","last_became_active":"2023-08-17T17:53:48.902030+0000","last_became_peered":"2023-08-17T17:53:48.902030+0000","last_unstale":"2023-08-17T17:53:48.907295+0000","last_undegraded":"2023-08-17T17:53:48.907295+0000","last_fullsized":"2023-08-17T17:53:48.907295+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.904425+0000","last_change":"2023-08-17T17:53:48.534730+0000","last_active":"2023-08-17T17:53:48.904425+0000","last_peered":"2023-08-17T17:53:48.904425+0000","last_clean":"2023-08-17T17:53:48.904425+0000","last_became_active":"2023-08-17T17:53:48.534429+0000","last_became_peered":"2023-08-17T17:53:48.534429+0000","last_unstale":"2023-08-17T17:53:48.904425+0000","last_undegraded":"2023-08-17T17:53:48.904425+0000","last_fullsized":"2023-08-17T17:53:48.904425+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.912146+0000","last_change":"2023-08-17T17:53:48.909101+0000","last_active":"2023-08-17T17:53:48.912146+0000","last_peered":"2023-08-17T17:53:48.912146+0000","last_clean":"2023-08-17T17:53:48.912146+0000","last_became_active":"2023-08-17T17:53:48.907720+0000","last_became_peered":"2023-08-17T17:53:48.907720+0000","last_unstale":"2023-08-17T17:53:48.912146+0000","last_undegraded":"2023-08-17T17:53:48.912146+0000","last_fullsized":"2023-08-17T17:53:48.912146+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.897899+0000","last_change":"2023-08-17T17:53:48.546300+0000","last_active":"2023-08-17T17:53:48.897899+0000","last_peered":"2023-08-17T17:53:48.897899+0000","last_clean":"2023-08-17T17:53:48.897899+0000","last_became_active":"2023-08-17T17:53:48.546013+0000","last_became_peered":"2023-08-17T17:53:48.546013+0000","last_unstale":"2023-08-17T17:53:48.897899+0000","last_undegraded":"2023-08-17T17:53:48.897899+0000","last_fullsized":"2023-08-17T17:53:48.897899+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.917151+0000","last_change":"2023-08-17T17:53:48.916254+0000","last_active":"2023-08-17T17:53:48.917151+0000","last_peered":"2023-08-17T17:53:48.917151+0000","last_clean":"2023-08-17T17:53:48.917151+0000","last_became_active":"2023-08-17T17:53:48.915282+0000","last_became_peered":"2023-08-17T17:53:48.915282+0000","last_unstale":"2023-08-17T17:53:48.917151+0000","last_undegraded":"2023-08-17T17:53:48.917151+0000","last_fullsized":"2023-08-17T17:53:48.917151+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.900886+0000","last_change":"2023-08-17T17:53:48.546273+0000","last_active":"2023-08-17T17:53:48.900886+0000","last_peered":"2023-08-17T17:53:48.900886+0000","last_clean":"2023-08-17T17:53:48.900886+0000","last_became_active":"2023-08-17T17:53:48.545984+0000","last_became_peered":"2023-08-17T17:53:48.545984+0000","last_unstale":"2023-08-17T17:53:48.900886+0000","last_undegraded":"2023-08-17T17:53:48.900886+0000","last_fullsized":"2023-08-17T17:53:48.900886+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.922726+0000","last_change":"2023-08-17T17:53:48.921345+0000","last_active":"2023-08-17T17:53:48.922726+0000","last_peered":"2023-08-17T17:53:48.922726+0000","last_clean":"2023-08-17T17:53:48.922726+0000","last_became_active":"2023-08-17T17:53:48.921103+0000","last_became_peered":"2023-08-17T17:53:48.921103+0000","last_unstale":"2023-08-17T17:53:48.922726+0000","last_undegraded":"2023-08-17T17:53:48.922726+0000","last_fullsized":"2023-08-17T17:53:48.922726+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.904895+0000","last_change":"2023-08-17T17:53:48.546627+0000","last_active":"2023-08-17T17:53:48.904895+0000","last_peered":"2023-08-17T17:53:48.904895+0000","last_clean":"2023-08-17T17:53:48.904895+0000","last_became_active":"2023-08-17T17:53:48.546250+0000","last_became_peered":"2023-08-17T17:53:48.546250+0000","last_unstale":"2023-08-17T17:53:48.904895+0000","last_undegraded":"2023-08-17T17:53:48.904895+0000","last_fullsized":"2023-08-17T17:53:48.904895+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.920282+0000","last_change":"2023-08-17T17:53:48.910249+0000","last_active":"2023-08-17T17:53:48.920282+0000","last_peered":"2023-08-17T17:53:48.920282+0000","last_clean":"2023-08-17T17:53:48.920282+0000","last_became_active":"2023-08-17T17:53:48.909584+0000","last_became_peered":"2023-08-17T17:53:48.909584+0000","last_unstale":"2023-08-17T17:53:48.920282+0000","last_undegraded":"2023-08-17T17:53:48.920282+0000","last_fullsized":"2023-08-17T17:53:48.920282+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.895806+0000","last_change":"2023-08-17T17:53:48.543491+0000","last_active":"2023-08-17T17:53:48.895806+0000","last_peered":"2023-08-17T17:53:48.895806+0000","last_clean":"2023-08-17T17:53:48.895806+0000","last_became_active":"2023-08-17T17:53:48.543146+0000","last_became_peered":"2023-08-17T17:53:48.543146+0000","last_unstale":"2023-08-17T17:53:48.895806+0000","last_undegraded":"2023-08-17T17:53:48.895806+0000","last_fullsized":"2023-08-17T17:53:48.895806+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918585+0000","last_change":"2023-08-17T17:53:48.917405+0000","last_active":"2023-08-17T17:53:48.918585+0000","last_peered":"2023-08-17T17:53:48.918585+0000","last_clean":"2023-08-17T17:53:48.918585+0000","last_became_active":"2023-08-17T17:53:48.917161+0000","last_became_peered":"2023-08-17T17:53:48.917161+0000","last_unstale":"2023-08-17T17:53:48.918585+0000","last_undegraded":"2023-08-17T17:53:48.918585+0000","last_fullsized":"2023-08-17T17:53:48.918585+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.905009+0000","last_change":"2023-08-17T17:53:48.549633+0000","last_active":"2023-08-17T17:53:48.905009+0000","last_peered":"2023-08-17T17:53:48.905009+0000","last_clean":"2023-08-17T17:53:48.905009+0000","last_became_active":"2023-08-17T17:53:48.549208+0000","last_became_peered":"2023-08-17T17:53:48.549208+0000","last_unstale":"2023-08-17T17:53:48.905009+0000","last_undegraded":"2023-08-17T17:53:48.905009+0000","last_fullsized":"2023-08-17T17:53:48.905009+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.917723+0000","last_change":"2023-08-17T17:53:48.915532+0000","last_active":"2023-08-17T17:53:48.917723+0000","last_peered":"2023-08-17T17:53:48.917723+0000","last_clean":"2023-08-17T17:53:48.917723+0000","last_became_active":"2023-08-17T17:53:48.915208+0000","last_became_peered":"2023-08-17T17:53:48.915208+0000","last_unstale":"2023-08-17T17:53:48.917723+0000","last_undegraded":"2023-08-17T17:53:48.917723+0000","last_fullsized":"2023-08-17T17:53:48.917723+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.908174+0000","last_change":"2023-08-17T17:53:48.549019+0000","last_active":"2023-08-17T17:53:48.908174+0000","last_peered":"2023-08-17T17:53:48.908174+0000","last_clean":"2023-08-17T17:53:48.908174+0000","last_became_active":"2023-08-17T17:53:48.548751+0000","last_became_peered":"2023-08-17T17:53:48.548751+0000","last_unstale":"2023-08-17T17:53:48.908174+0000","last_undegraded":"2023-08-17T17:53:48.908174+0000","last_fullsized":"2023-08-17T17:53:48.908174+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.922293+0000","last_change":"2023-08-17T17:53:48.919929+0000","last_active":"2023-08-17T17:53:48.922293+0000","last_peered":"2023-08-17T17:53:48.922293+0000","last_clean":"2023-08-17T17:53:48.922293+0000","last_became_active":"2023-08-17T17:53:48.919583+0000","last_became_peered":"2023-08-17T17:53:48.919583+0000","last_unstale":"2023-08-17T17:53:48.922293+0000","last_undegraded":"2023-08-17T17:53:48.922293+0000","last_fullsized":"2023-08-17T17:53:48.922293+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.908634+0000","last_change":"2023-08-17T17:53:48.542469+0000","last_active":"2023-08-17T17:53:48.908634+0000","last_peered":"2023-08-17T17:53:48.908634+0000","last_clean":"2023-08-17T17:53:48.908634+0000","last_became_active":"2023-08-17T17:53:48.541029+0000","last_became_peered":"2023-08-17T17:53:48.541029+0000","last_unstale":"2023-08-17T17:53:48.908634+0000","last_undegraded":"2023-08-17T17:53:48.908634+0000","last_fullsized":"2023-08-17T17:53:48.908634+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.922292+0000","last_change":"2023-08-17T17:53:48.919124+0000","last_active":"2023-08-17T17:53:48.922292+0000","last_peered":"2023-08-17T17:53:48.922292+0000","last_clean":"2023-08-17T17:53:48.922292+0000","last_became_active":"2023-08-17T17:53:48.918822+0000","last_became_peered":"2023-08-17T17:53:48.918822+0000","last_unstale":"2023-08-17T17:53:48.922292+0000","last_undegraded":"2023-08-17T17:53:48.922292+0000","last_fullsized":"2023-08-17T17:53:48.922292+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.897976+0000","last_change":"2023-08-17T17:53:48.545402+0000","last_active":"2023-08-17T17:53:48.897976+0000","last_peered":"2023-08-17T17:53:48.897976+0000","last_clean":"2023-08-17T17:53:48.897976+0000","last_became_active":"2023-08-17T17:53:48.545088+0000","last_became_peered":"2023-08-17T17:53:48.545088+0000","last_unstale":"2023-08-17T17:53:48.897976+0000","last_undegraded":"2023-08-17T17:53:48.897976+0000","last_fullsized":"2023-08-17T17:53:48.897976+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.916890+0000","last_change":"2023-08-17T17:53:48.914890+0000","last_active":"2023-08-17T17:53:48.916890+0000","last_peered":"2023-08-17T17:53:48.916890+0000","last_clean":"2023-08-17T17:53:48.916890+0000","last_became_active":"2023-08-17T17:53:48.914587+0000","last_became_peered":"2023-08-17T17:53:48.914587+0000","last_unstale":"2023-08-17T17:53:48.916890+0000","last_undegraded":"2023-08-17T17:53:48.916890+0000","last_fullsized":"2023-08-17T17:53:48.916890+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.921471+0000","last_change":"2023-08-17T17:53:48.544006+0000","last_active":"2023-08-17T17:53:48.921471+0000","last_peered":"2023-08-17T17:53:48.921471+0000","last_clean":"2023-08-17T17:53:48.921471+0000","last_became_active":"2023-08-17T17:53:48.543714+0000","last_became_peered":"2023-08-17T17:53:48.543714+0000","last_unstale":"2023-08-17T17:53:48.921471+0000","last_undegraded":"2023-08-17T17:53:48.921471+0000","last_fullsized":"2023-08-17T17:53:48.921471+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918929+0000","last_change":"2023-08-17T17:53:48.912642+0000","last_active":"2023-08-17T17:53:48.918929+0000","last_peered":"2023-08-17T17:53:48.918929+0000","last_clean":"2023-08-17T17:53:48.918929+0000","last_became_active":"2023-08-17T17:53:48.912375+0000","last_became_peered":"2023-08-17T17:53:48.912375+0000","last_unstale":"2023-08-17T17:53:48.918929+0000","last_undegraded":"2023-08-17T17:53:48.918929+0000","last_fullsized":"2023-08-17T17:53:48.918929+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.913254+0000","last_change":"2023-08-17T17:53:48.542148+0000","last_active":"2023-08-17T17:53:48.913254+0000","last_peered":"2023-08-17T17:53:48.913254+0000","last_clean":"2023-08-17T17:53:48.913254+0000","last_became_active":"2023-08-17T17:53:48.541870+0000","last_became_peered":"2023-08-17T17:53:48.541870+0000","last_unstale":"2023-08-17T17:53:48.913254+0000","last_undegraded":"2023-08-17T17:53:48.913254+0000","last_fullsized":"2023-08-17T17:53:48.913254+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918608+0000","last_change":"2023-08-17T17:53:48.915535+0000","last_active":"2023-08-17T17:53:48.918608+0000","last_peered":"2023-08-17T17:53:48.918608+0000","last_clean":"2023-08-17T17:53:48.918608+0000","last_became_active":"2023-08-17T17:53:48.915203+0000","last_became_peered":"2023-08-17T17:53:48.915203+0000","last_unstale":"2023-08-17T17:53:48.918608+0000","last_undegraded":"2023-08-17T17:53:48.918608+0000","last_fullsized":"2023-08-17T17:53:48.918608+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"148'2","reported_seq":12,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.922779+0000","last_change":"2023-08-17T17:53:48.550446+0000","last_active":"2023-08-17T17:53:48.922779+0000","last_peered":"2023-08-17T17:53:48.922779+0000","last_clean":"2023-08-17T17:53:48.922779+0000","last_became_active":"2023-08-17T17:53:48.550141+0000","last_became_peered":"2023-08-17T17:53:48.550141+0000","last_unstale":"2023-08-17T17:53:48.922779+0000","last_undegraded":"2023-08-17T17:53:48.922779+0000","last_fullsized":"2023-08-17T17:53:48.922779+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919463+0000","last_change":"2023-08-17T17:53:48.915904+0000","last_active":"2023-08-17T17:53:48.919463+0000","last_peered":"2023-08-17T17:53:48.919463+0000","last_clean":"2023-08-17T17:53:48.919463+0000","last_became_active":"2023-08-17T17:53:48.915365+0000","last_became_peered":"2023-08-17T17:53:48.915365+0000","last_unstale":"2023-08-17T17:53:48.919463+0000","last_undegraded":"2023-08-17T17:53:48.919463+0000","last_fullsized":"2023-08-17T17:53:48.919463+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.906803+0000","last_change":"2023-08-17T17:53:48.545895+0000","last_active":"2023-08-17T17:53:48.906803+0000","last_peered":"2023-08-17T17:53:48.906803+0000","last_clean":"2023-08-17T17:53:48.906803+0000","last_became_active":"2023-08-17T17:53:48.545637+0000","last_became_peered":"2023-08-17T17:53:48.545637+0000","last_unstale":"2023-08-17T17:53:48.906803+0000","last_undegraded":"2023-08-17T17:53:48.906803+0000","last_fullsized":"2023-08-17T17:53:48.906803+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.915844+0000","last_change":"2023-08-17T17:53:48.910467+0000","last_active":"2023-08-17T17:53:48.915844+0000","last_peered":"2023-08-17T17:53:48.915844+0000","last_clean":"2023-08-17T17:53:48.915844+0000","last_became_active":"2023-08-17T17:53:48.910185+0000","last_became_peered":"2023-08-17T17:53:48.910185+0000","last_unstale":"2023-08-17T17:53:48.915844+0000","last_undegraded":"2023-08-17T17:53:48.915844+0000","last_fullsized":"2023-08-17T17:53:48.915844+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.898157+0000","last_change":"2023-08-17T17:53:48.532621+0000","last_active":"2023-08-17T17:53:48.898157+0000","last_peered":"2023-08-17T17:53:48.898157+0000","last_clean":"2023-08-17T17:53:48.898157+0000","last_became_active":"2023-08-17T17:53:48.532330+0000","last_became_peered":"2023-08-17T17:53:48.532330+0000","last_unstale":"2023-08-17T17:53:48.898157+0000","last_undegraded":"2023-08-17T17:53:48.898157+0000","last_fullsized":"2023-08-17T17:53:48.898157+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.915942+0000","last_change":"2023-08-17T17:53:48.908873+0000","last_active":"2023-08-17T17:53:48.915942+0000","last_peered":"2023-08-17T17:53:48.915942+0000","last_clean":"2023-08-17T17:53:48.915942+0000","last_became_active":"2023-08-17T17:53:48.908559+0000","last_became_peered":"2023-08-17T17:53:48.908559+0000","last_unstale":"2023-08-17T17:53:48.915942+0000","last_undegraded":"2023-08-17T17:53:48.915942+0000","last_fullsized":"2023-08-17T17:53:48.915942+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.898535+0000","last_change":"2023-08-17T17:53:48.546529+0000","last_active":"2023-08-17T17:53:48.898535+0000","last_peered":"2023-08-17T17:53:48.898535+0000","last_clean":"2023-08-17T17:53:48.898535+0000","last_became_active":"2023-08-17T17:53:48.545449+0000","last_became_peered":"2023-08-17T17:53:48.545449+0000","last_unstale":"2023-08-17T17:53:48.898535+0000","last_undegraded":"2023-08-17T17:53:48.898535+0000","last_fullsized":"2023-08-17T17:53:48.898535+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.920328+0000","last_change":"2023-08-17T17:53:48.916322+0000","last_active":"2023-08-17T17:53:48.920328+0000","last_peered":"2023-08-17T17:53:48.920328+0000","last_clean":"2023-08-17T17:53:48.920328+0000","last_became_active":"2023-08-17T17:53:48.916026+0000","last_became_peered":"2023-08-17T17:53:48.916026+0000","last_unstale":"2023-08-17T17:53:48.920328+0000","last_undegraded":"2023-08-17T17:53:48.920328+0000","last_fullsized":"2023-08-17T17:53:48.920328+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.894953+0000","last_change":"2023-08-17T17:53:48.540642+0000","last_active":"2023-08-17T17:53:48.894953+0000","last_peered":"2023-08-17T17:53:48.894953+0000","last_clean":"2023-08-17T17:53:48.894953+0000","last_became_active":"2023-08-17T17:53:48.540376+0000","last_became_peered":"2023-08-17T17:53:48.540376+0000","last_unstale":"2023-08-17T17:53:48.894953+0000","last_undegraded":"2023-08-17T17:53:48.894953+0000","last_fullsized":"2023-08-17T17:53:48.894953+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.915891+0000","last_change":"2023-08-17T17:53:48.913756+0000","last_active":"2023-08-17T17:53:48.915891+0000","last_peered":"2023-08-17T17:53:48.915891+0000","last_clean":"2023-08-17T17:53:48.915891+0000","last_became_active":"2023-08-17T17:53:48.913454+0000","last_became_peered":"2023-08-17T17:53:48.913454+0000","last_unstale":"2023-08-17T17:53:48.915891+0000","last_undegraded":"2023-08-17T17:53:48.915891+0000","last_fullsized":"2023-08-17T17:53:48.915891+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.905301+0000","last_change":"2023-08-17T17:53:48.548881+0000","last_active":"2023-08-17T17:53:48.905301+0000","last_peered":"2023-08-17T17:53:48.905301+0000","last_clean":"2023-08-17T17:53:48.905301+0000","last_became_active":"2023-08-17T17:53:48.548494+0000","last_became_peered":"2023-08-17T17:53:48.548494+0000","last_unstale":"2023-08-17T17:53:48.905301+0000","last_undegraded":"2023-08-17T17:53:48.905301+0000","last_fullsized":"2023-08-17T17:53:48.905301+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.922215+0000","last_change":"2023-08-17T17:53:48.919429+0000","last_active":"2023-08-17T17:53:48.922215+0000","last_peered":"2023-08-17T17:53:48.922215+0000","last_clean":"2023-08-17T17:53:48.922215+0000","last_became_active":"2023-08-17T17:53:48.919150+0000","last_became_peered":"2023-08-17T17:53:48.919150+0000","last_unstale":"2023-08-17T17:53:48.922215+0000","last_undegraded":"2023-08-17T17:53:48.922215+0000","last_fullsized":"2023-08-17T17:53:48.922215+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.912202+0000","last_change":"2023-08-17T17:53:48.537914+0000","last_active":"2023-08-17T17:53:48.912202+0000","last_peered":"2023-08-17T17:53:48.912202+0000","last_clean":"2023-08-17T17:53:48.912202+0000","last_became_active":"2023-08-17T17:53:48.537611+0000","last_became_peered":"2023-08-17T17:53:48.537611+0000","last_unstale":"2023-08-17T17:53:48.912202+0000","last_undegraded":"2023-08-17T17:53:48.912202+0000","last_fullsized":"2023-08-17T17:53:48.912202+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.923906+0000","last_change":"2023-08-17T17:53:48.918318+0000","last_active":"2023-08-17T17:53:48.923906+0000","last_peered":"2023-08-17T17:53:48.923906+0000","last_clean":"2023-08-17T17:53:48.923906+0000","last_became_active":"2023-08-17T17:53:48.918020+0000","last_became_peered":"2023-08-17T17:53:48.918020+0000","last_unstale":"2023-08-17T17:53:48.923906+0000","last_undegraded":"2023-08-17T17:53:48.923906+0000","last_fullsized":"2023-08-17T17:53:48.923906+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"148'2","reported_seq":12,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.920041+0000","last_change":"2023-08-17T17:53:48.549664+0000","last_active":"2023-08-17T17:53:48.920041+0000","last_peered":"2023-08-17T17:53:48.920041+0000","last_clean":"2023-08-17T17:53:48.920041+0000","last_became_active":"2023-08-17T17:53:48.549393+0000","last_became_peered":"2023-08-17T17:53:48.549393+0000","last_unstale":"2023-08-17T17:53:48.920041+0000","last_undegraded":"2023-08-17T17:53:48.920041+0000","last_fullsized":"2023-08-17T17:53:48.920041+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.924049+0000","last_change":"2023-08-17T17:53:48.920069+0000","last_active":"2023-08-17T17:53:48.924049+0000","last_peered":"2023-08-17T17:53:48.924049+0000","last_clean":"2023-08-17T17:53:48.924049+0000","last_became_active":"2023-08-17T17:53:48.919901+0000","last_became_peered":"2023-08-17T17:53:48.919901+0000","last_unstale":"2023-08-17T17:53:48.924049+0000","last_undegraded":"2023-08-17T17:53:48.924049+0000","last_fullsized":"2023-08-17T17:53:48.924049+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.896342+0000","last_change":"2023-08-17T17:53:48.540721+0000","last_active":"2023-08-17T17:53:48.896342+0000","last_peered":"2023-08-17T17:53:48.896342+0000","last_clean":"2023-08-17T17:53:48.896342+0000","last_became_active":"2023-08-17T17:53:48.540443+0000","last_became_peered":"2023-08-17T17:53:48.540443+0000","last_unstale":"2023-08-17T17:53:48.896342+0000","last_undegraded":"2023-08-17T17:53:48.896342+0000","last_fullsized":"2023-08-17T17:53:48.896342+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.911481+0000","last_change":"2023-08-17T17:53:48.907945+0000","last_active":"2023-08-17T17:53:48.911481+0000","last_peered":"2023-08-17T17:53:48.911481+0000","last_clean":"2023-08-17T17:53:48.911481+0000","last_became_active":"2023-08-17T17:53:48.907686+0000","last_became_peered":"2023-08-17T17:53:48.907686+0000","last_unstale":"2023-08-17T17:53:48.911481+0000","last_undegraded":"2023-08-17T17:53:48.911481+0000","last_fullsized":"2023-08-17T17:53:48.911481+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.901058+0000","last_change":"2023-08-17T17:53:48.542501+0000","last_active":"2023-08-17T17:53:48.901058+0000","last_peered":"2023-08-17T17:53:48.901058+0000","last_clean":"2023-08-17T17:53:48.901058+0000","last_became_active":"2023-08-17T17:53:48.541748+0000","last_became_peered":"2023-08-17T17:53:48.541748+0000","last_unstale":"2023-08-17T17:53:48.901058+0000","last_undegraded":"2023-08-17T17:53:48.901058+0000","last_fullsized":"2023-08-17T17:53:48.901058+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.916201+0000","last_change":"2023-08-17T17:53:48.912291+0000","last_active":"2023-08-17T17:53:48.916201+0000","last_peered":"2023-08-17T17:53:48.916201+0000","last_clean":"2023-08-17T17:53:48.916201+0000","last_became_active":"2023-08-17T17:53:48.911987+0000","last_became_peered":"2023-08-17T17:53:48.911987+0000","last_unstale":"2023-08-17T17:53:48.916201+0000","last_undegraded":"2023-08-17T17:53:48.916201+0000","last_fullsized":"2023-08-17T17:53:48.916201+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.915375+0000","last_change":"2023-08-17T17:53:48.548741+0000","last_active":"2023-08-17T17:53:48.915375+0000","last_peered":"2023-08-17T17:53:48.915375+0000","last_clean":"2023-08-17T17:53:48.915375+0000","last_became_active":"2023-08-17T17:53:48.548429+0000","last_became_peered":"2023-08-17T17:53:48.548429+0000","last_unstale":"2023-08-17T17:53:48.915375+0000","last_undegraded":"2023-08-17T17:53:48.915375+0000","last_fullsized":"2023-08-17T17:53:48.915375+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919482+0000","last_change":"2023-08-17T17:53:48.917504+0000","last_active":"2023-08-17T17:53:48.919482+0000","last_peered":"2023-08-17T17:53:48.919482+0000","last_clean":"2023-08-17T17:53:48.919482+0000","last_became_active":"2023-08-17T17:53:48.915493+0000","last_became_peered":"2023-08-17T17:53:48.915493+0000","last_unstale":"2023-08-17T17:53:48.919482+0000","last_undegraded":"2023-08-17T17:53:48.919482+0000","last_fullsized":"2023-08-17T17:53:48.919482+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.908275+0000","last_change":"2023-08-17T17:53:48.545195+0000","last_active":"2023-08-17T17:53:48.908275+0000","last_peered":"2023-08-17T17:53:48.908275+0000","last_clean":"2023-08-17T17:53:48.908275+0000","last_became_active":"2023-08-17T17:53:48.544885+0000","last_became_peered":"2023-08-17T17:53:48.544885+0000","last_unstale":"2023-08-17T17:53:48.908275+0000","last_undegraded":"2023-08-17T17:53:48.908275+0000","last_fullsized":"2023-08-17T17:53:48.908275+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919470+0000","last_change":"2023-08-17T17:53:48.914629+0000","last_active":"2023-08-17T17:53:48.919470+0000","last_peered":"2023-08-17T17:53:48.919470+0000","last_clean":"2023-08-17T17:53:48.919470+0000","last_became_active":"2023-08-17T17:53:48.914357+0000","last_became_peered":"2023-08-17T17:53:48.914357+0000","last_unstale":"2023-08-17T17:53:48.919470+0000","last_undegraded":"2023-08-17T17:53:48.919470+0000","last_fullsized":"2023-08-17T17:53:48.919470+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.908744+0000","last_change":"2023-08-17T17:53:48.541752+0000","last_active":"2023-08-17T17:53:48.908744+0000","last_peered":"2023-08-17T17:53:48.908744+0000","last_clean":"2023-08-17T17:53:48.908744+0000","last_became_active":"2023-08-17T17:53:48.541137+0000","last_became_peered":"2023-08-17T17:53:48.541137+0000","last_unstale":"2023-08-17T17:53:48.908744+0000","last_undegraded":"2023-08-17T17:53:48.908744+0000","last_fullsized":"2023-08-17T17:53:48.908744+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.912135+0000","last_change":"2023-08-17T17:53:48.904871+0000","last_active":"2023-08-17T17:53:48.912135+0000","last_peered":"2023-08-17T17:53:48.912135+0000","last_clean":"2023-08-17T17:53:48.912135+0000","last_became_active":"2023-08-17T17:53:48.904586+0000","last_became_peered":"2023-08-17T17:53:48.904586+0000","last_unstale":"2023-08-17T17:53:48.912135+0000","last_undegraded":"2023-08-17T17:53:48.912135+0000","last_fullsized":"2023-08-17T17:53:48.912135+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.894974+0000","last_change":"2023-08-17T17:53:48.533101+0000","last_active":"2023-08-17T17:53:48.894974+0000","last_peered":"2023-08-17T17:53:48.894974+0000","last_clean":"2023-08-17T17:53:48.894974+0000","last_became_active":"2023-08-17T17:53:48.532920+0000","last_became_peered":"2023-08-17T17:53:48.532920+0000","last_unstale":"2023-08-17T17:53:48.894974+0000","last_undegraded":"2023-08-17T17:53:48.894974+0000","last_fullsized":"2023-08-17T17:53:48.894974+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.920386+0000","last_change":"2023-08-17T17:53:48.917598+0000","last_active":"2023-08-17T17:53:48.920386+0000","last_peered":"2023-08-17T17:53:48.920386+0000","last_clean":"2023-08-17T17:53:48.920386+0000","last_became_active":"2023-08-17T17:53:48.915894+0000","last_became_peered":"2023-08-17T17:53:48.915894+0000","last_unstale":"2023-08-17T17:53:48.920386+0000","last_undegraded":"2023-08-17T17:53:48.920386+0000","last_fullsized":"2023-08-17T17:53:48.920386+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"148'2","reported_seq":12,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.922720+0000","last_change":"2023-08-17T17:53:48.549140+0000","last_active":"2023-08-17T17:53:48.922720+0000","last_peered":"2023-08-17T17:53:48.922720+0000","last_clean":"2023-08-17T17:53:48.922720+0000","last_became_active":"2023-08-17T17:53:48.548842+0000","last_became_peered":"2023-08-17T17:53:48.548842+0000","last_unstale":"2023-08-17T17:53:48.922720+0000","last_undegraded":"2023-08-17T17:53:48.922720+0000","last_fullsized":"2023-08-17T17:53:48.922720+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918651+0000","last_change":"2023-08-17T17:53:48.909060+0000","last_active":"2023-08-17T17:53:48.918651+0000","last_peered":"2023-08-17T17:53:48.918651+0000","last_clean":"2023-08-17T17:53:48.918651+0000","last_became_active":"2023-08-17T17:53:48.908789+0000","last_became_peered":"2023-08-17T17:53:48.908789+0000","last_unstale":"2023-08-17T17:53:48.918651+0000","last_undegraded":"2023-08-17T17:53:48.918651+0000","last_fullsized":"2023-08-17T17:53:48.918651+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.899282+0000","last_change":"2023-08-17T17:53:48.538334+0000","last_active":"2023-08-17T17:53:48.899282+0000","last_peered":"2023-08-17T17:53:48.899282+0000","last_clean":"2023-08-17T17:53:48.899282+0000","last_became_active":"2023-08-17T17:53:48.538063+0000","last_became_peered":"2023-08-17T17:53:48.538063+0000","last_unstale":"2023-08-17T17:53:48.899282+0000","last_undegraded":"2023-08-17T17:53:48.899282+0000","last_fullsized":"2023-08-17T17:53:48.899282+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.924507+0000","last_change":"2023-08-17T17:53:48.923610+0000","last_active":"2023-08-17T17:53:48.924507+0000","last_peered":"2023-08-17T17:53:48.924507+0000","last_clean":"2023-08-17T17:53:48.924507+0000","last_became_active":"2023-08-17T17:53:48.923306+0000","last_became_peered":"2023-08-17T17:53:48.923306+0000","last_unstale":"2023-08-17T17:53:48.924507+0000","last_undegraded":"2023-08-17T17:53:48.924507+0000","last_fullsized":"2023-08-17T17:53:48.924507+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.899561+0000","last_change":"2023-08-17T17:53:48.540606+0000","last_active":"2023-08-17T17:53:48.899561+0000","last_peered":"2023-08-17T17:53:48.899561+0000","last_clean":"2023-08-17T17:53:48.899561+0000","last_became_active":"2023-08-17T17:53:48.540295+0000","last_became_peered":"2023-08-17T17:53:48.540295+0000","last_unstale":"2023-08-17T17:53:48.899561+0000","last_undegraded":"2023-08-17T17:53:48.899561+0000","last_fullsized":"2023-08-17T17:53:48.899561+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918422+0000","last_change":"2023-08-17T17:53:48.916972+0000","last_active":"2023-08-17T17:53:48.918422+0000","last_peered":"2023-08-17T17:53:48.918422+0000","last_clean":"2023-08-17T17:53:48.918422+0000","last_became_active":"2023-08-17T17:53:48.916689+0000","last_became_peered":"2023-08-17T17:53:48.916689+0000","last_unstale":"2023-08-17T17:53:48.918422+0000","last_undegraded":"2023-08-17T17:53:48.918422+0000","last_fullsized":"2023-08-17T17:53:48.918422+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.896897+0000","last_change":"2023-08-17T17:53:48.546250+0000","last_active":"2023-08-17T17:53:48.896897+0000","last_peered":"2023-08-17T17:53:48.896897+0000","last_clean":"2023-08-17T17:53:48.896897+0000","last_became_active":"2023-08-17T17:53:48.545955+0000","last_became_peered":"2023-08-17T17:53:48.545955+0000","last_unstale":"2023-08-17T17:53:48.896897+0000","last_undegraded":"2023-08-17T17:53:48.896897+0000","last_fullsized":"2023-08-17T17:53:48.896897+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.917261+0000","last_change":"2023-08-17T17:53:48.909474+0000","last_active":"2023-08-17T17:53:48.917261+0000","last_peered":"2023-08-17T17:53:48.917261+0000","last_clean":"2023-08-17T17:53:48.917261+0000","last_became_active":"2023-08-17T17:53:48.909199+0000","last_became_peered":"2023-08-17T17:53:48.909199+0000","last_unstale":"2023-08-17T17:53:48.917261+0000","last_undegraded":"2023-08-17T17:53:48.917261+0000","last_fullsized":"2023-08-17T17:53:48.917261+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.895102+0000","last_change":"2023-08-17T17:53:48.538654+0000","last_active":"2023-08-17T17:53:48.895102+0000","last_peered":"2023-08-17T17:53:48.895102+0000","last_clean":"2023-08-17T17:53:48.895102+0000","last_became_active":"2023-08-17T17:53:48.538289+0000","last_became_peered":"2023-08-17T17:53:48.538289+0000","last_unstale":"2023-08-17T17:53:48.895102+0000","last_undegraded":"2023-08-17T17:53:48.895102+0000","last_fullsized":"2023-08-17T17:53:48.895102+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918468+0000","last_change":"2023-08-17T17:53:48.913604+0000","last_active":"2023-08-17T17:53:48.918468+0000","last_peered":"2023-08-17T17:53:48.918468+0000","last_clean":"2023-08-17T17:53:48.918468+0000","last_became_active":"2023-08-17T17:53:48.913285+0000","last_became_peered":"2023-08-17T17:53:48.913285+0000","last_unstale":"2023-08-17T17:53:48.918468+0000","last_undegraded":"2023-08-17T17:53:48.918468+0000","last_fullsized":"2023-08-17T17:53:48.918468+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.911488+0000","last_change":"2023-08-17T17:53:48.546354+0000","last_active":"2023-08-17T17:53:48.911488+0000","last_peered":"2023-08-17T17:53:48.911488+0000","last_clean":"2023-08-17T17:53:48.911488+0000","last_became_active":"2023-08-17T17:53:48.546160+0000","last_became_peered":"2023-08-17T17:53:48.546160+0000","last_unstale":"2023-08-17T17:53:48.911488+0000","last_undegraded":"2023-08-17T17:53:48.911488+0000","last_fullsized":"2023-08-17T17:53:48.911488+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918560+0000","last_change":"2023-08-17T17:53:48.915485+0000","last_active":"2023-08-17T17:53:48.918560+0000","last_peered":"2023-08-17T17:53:48.918560+0000","last_clean":"2023-08-17T17:53:48.918560+0000","last_became_active":"2023-08-17T17:53:48.915238+0000","last_became_peered":"2023-08-17T17:53:48.915238+0000","last_unstale":"2023-08-17T17:53:48.918560+0000","last_undegraded":"2023-08-17T17:53:48.918560+0000","last_fullsized":"2023-08-17T17:53:48.918560+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.895060+0000","last_change":"2023-08-17T17:53:48.546387+0000","last_active":"2023-08-17T17:53:48.895060+0000","last_peered":"2023-08-17T17:53:48.895060+0000","last_clean":"2023-08-17T17:53:48.895060+0000","last_became_active":"2023-08-17T17:53:48.546063+0000","last_became_peered":"2023-08-17T17:53:48.546063+0000","last_unstale":"2023-08-17T17:53:48.895060+0000","last_undegraded":"2023-08-17T17:53:48.895060+0000","last_fullsized":"2023-08-17T17:53:48.895060+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.924733+0000","last_change":"2023-08-17T17:53:48.923758+0000","last_active":"2023-08-17T17:53:48.924733+0000","last_peered":"2023-08-17T17:53:48.924733+0000","last_clean":"2023-08-17T17:53:48.924733+0000","last_became_active":"2023-08-17T17:53:48.923469+0000","last_became_peered":"2023-08-17T17:53:48.923469+0000","last_unstale":"2023-08-17T17:53:48.924733+0000","last_undegraded":"2023-08-17T17:53:48.924733+0000","last_fullsized":"2023-08-17T17:53:48.924733+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.899507+0000","last_change":"2023-08-17T17:53:48.550714+0000","last_active":"2023-08-17T17:53:48.899507+0000","last_peered":"2023-08-17T17:53:48.899507+0000","last_clean":"2023-08-17T17:53:48.899507+0000","last_became_active":"2023-08-17T17:53:48.550411+0000","last_became_peered":"2023-08-17T17:53:48.550411+0000","last_unstale":"2023-08-17T17:53:48.899507+0000","last_undegraded":"2023-08-17T17:53:48.899507+0000","last_fullsized":"2023-08-17T17:53:48.899507+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.922705+0000","last_change":"2023-08-17T17:53:48.921059+0000","last_active":"2023-08-17T17:53:48.922705+0000","last_peered":"2023-08-17T17:53:48.922705+0000","last_clean":"2023-08-17T17:53:48.922705+0000","last_became_active":"2023-08-17T17:53:48.914088+0000","last_became_peered":"2023-08-17T17:53:48.914088+0000","last_unstale":"2023-08-17T17:53:48.922705+0000","last_undegraded":"2023-08-17T17:53:48.922705+0000","last_fullsized":"2023-08-17T17:53:48.922705+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"148'3","reported_seq":13,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.924220+0000","last_change":"2023-08-17T17:53:48.549271+0000","last_active":"2023-08-17T17:53:48.924220+0000","last_peered":"2023-08-17T17:53:48.924220+0000","last_clean":"2023-08-17T17:53:48.924220+0000","last_became_active":"2023-08-17T17:53:48.548952+0000","last_became_peered":"2023-08-17T17:53:48.548952+0000","last_unstale":"2023-08-17T17:53:48.924220+0000","last_undegraded":"2023-08-17T17:53:48.924220+0000","last_fullsized":"2023-08-17T17:53:48.924220+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.896969+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T17:53:48.896969+0000","last_peered":"2023-08-17T17:53:48.896969+0000","last_clean":"2023-08-17T17:53:48.896969+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T17:53:48.896969+0000","last_undegraded":"2023-08-17T17:53:48.896969+0000","last_fullsized":"2023-08-17T17:53:48.896969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.917057+0000","last_change":"2023-08-17T17:53:48.914982+0000","last_active":"2023-08-17T17:53:48.917057+0000","last_peered":"2023-08-17T17:53:48.917057+0000","last_clean":"2023-08-17T17:53:48.917057+0000","last_became_active":"2023-08-17T17:53:48.914660+0000","last_became_peered":"2023-08-17T17:53:48.914660+0000","last_unstale":"2023-08-17T17:53:48.917057+0000","last_undegraded":"2023-08-17T17:53:48.917057+0000","last_fullsized":"2023-08-17T17:53:48.917057+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919076+0000","last_change":"2023-08-17T17:53:48.547366+0000","last_active":"2023-08-17T17:53:48.919076+0000","last_peered":"2023-08-17T17:53:48.919076+0000","last_clean":"2023-08-17T17:53:48.919076+0000","last_became_active":"2023-08-17T17:53:48.547034+0000","last_became_peered":"2023-08-17T17:53:48.547034+0000","last_unstale":"2023-08-17T17:53:48.919076+0000","last_undegraded":"2023-08-17T17:53:48.919076+0000","last_fullsized":"2023-08-17T17:53:48.919076+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.894619+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T17:53:48.894619+0000","last_peered":"2023-08-17T17:53:48.894619+0000","last_clean":"2023-08-17T17:53:48.894619+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T17:53:48.894619+0000","last_undegraded":"2023-08-17T17:53:48.894619+0000","last_fullsized":"2023-08-17T17:53:48.894619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.914497+0000","last_change":"2023-08-17T17:53:48.905917+0000","last_active":"2023-08-17T17:53:48.914497+0000","last_peered":"2023-08-17T17:53:48.914497+0000","last_clean":"2023-08-17T17:53:48.914497+0000","last_became_active":"2023-08-17T17:53:48.905631+0000","last_became_peered":"2023-08-17T17:53:48.905631+0000","last_unstale":"2023-08-17T17:53:48.914497+0000","last_undegraded":"2023-08-17T17:53:48.914497+0000","last_fullsized":"2023-08-17T17:53:48.914497+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"148'4","reported_seq":14,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.922898+0000","last_change":"2023-08-17T17:53:48.549509+0000","last_active":"2023-08-17T17:53:48.922898+0000","last_peered":"2023-08-17T17:53:48.922898+0000","last_clean":"2023-08-17T17:53:48.922898+0000","last_became_active":"2023-08-17T17:53:48.549231+0000","last_became_peered":"2023-08-17T17:53:48.549231+0000","last_unstale":"2023-08-17T17:53:48.922898+0000","last_undegraded":"2023-08-17T17:53:48.922898+0000","last_fullsized":"2023-08-17T17:53:48.922898+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.902032+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T17:53:48.902032+0000","last_peered":"2023-08-17T17:53:48.902032+0000","last_clean":"2023-08-17T17:53:48.902032+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T17:53:48.902032+0000","last_undegraded":"2023-08-17T17:53:48.902032+0000","last_fullsized":"2023-08-17T17:53:48.902032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.922589+0000","last_change":"2023-08-17T17:53:48.920330+0000","last_active":"2023-08-17T17:53:48.922589+0000","last_peered":"2023-08-17T17:53:48.922589+0000","last_clean":"2023-08-17T17:53:48.922589+0000","last_became_active":"2023-08-17T17:53:48.920052+0000","last_became_peered":"2023-08-17T17:53:48.920052+0000","last_unstale":"2023-08-17T17:53:48.922589+0000","last_undegraded":"2023-08-17T17:53:48.922589+0000","last_fullsized":"2023-08-17T17:53:48.922589+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.911431+0000","last_change":"2023-08-17T17:53:48.541749+0000","last_active":"2023-08-17T17:53:48.911431+0000","last_peered":"2023-08-17T17:53:48.911431+0000","last_clean":"2023-08-17T17:53:48.911431+0000","last_became_active":"2023-08-17T17:53:48.541397+0000","last_became_peered":"2023-08-17T17:53:48.541397+0000","last_unstale":"2023-08-17T17:53:48.911431+0000","last_undegraded":"2023-08-17T17:53:48.911431+0000","last_fullsized":"2023-08-17T17:53:48.911431+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.895141+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T17:53:48.895141+0000","last_peered":"2023-08-17T17:53:48.895141+0000","last_clean":"2023-08-17T17:53:48.895141+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T17:53:48.895141+0000","last_undegraded":"2023-08-17T17:53:48.895141+0000","last_fullsized":"2023-08-17T17:53:48.895141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":115,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.906606+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T17:53:48.906606+0000","last_peered":"2023-08-17T17:53:48.906606+0000","last_clean":"2023-08-17T17:53:48.906606+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T17:53:48.906606+0000","last_undegraded":"2023-08-17T17:53:48.906606+0000","last_fullsized":"2023-08-17T17:53:48.906606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.918422+0000","last_change":"2023-08-17T17:53:48.915944+0000","last_active":"2023-08-17T17:53:48.918422+0000","last_peered":"2023-08-17T17:53:48.918422+0000","last_clean":"2023-08-17T17:53:48.918422+0000","last_became_active":"2023-08-17T17:53:48.915650+0000","last_became_peered":"2023-08-17T17:53:48.915650+0000","last_unstale":"2023-08-17T17:53:48.918422+0000","last_undegraded":"2023-08-17T17:53:48.918422+0000","last_fullsized":"2023-08-17T17:53:48.918422+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.902763+0000","last_change":"2023-08-17T17:53:48.547761+0000","last_active":"2023-08-17T17:53:48.902763+0000","last_peered":"2023-08-17T17:53:48.902763+0000","last_clean":"2023-08-17T17:53:48.902763+0000","last_became_active":"2023-08-17T17:53:48.543156+0000","last_became_peered":"2023-08-17T17:53:48.543156+0000","last_unstale":"2023-08-17T17:53:48.902763+0000","last_undegraded":"2023-08-17T17:53:48.902763+0000","last_fullsized":"2023-08-17T17:53:48.902763+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.906697+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T17:53:48.906697+0000","last_peered":"2023-08-17T17:53:48.906697+0000","last_clean":"2023-08-17T17:53:48.906697+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T17:53:48.906697+0000","last_undegraded":"2023-08-17T17:53:48.906697+0000","last_fullsized":"2023-08-17T17:53:48.906697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.920518+0000","last_change":"2023-08-17T17:53:48.913064+0000","last_active":"2023-08-17T17:53:48.920518+0000","last_peered":"2023-08-17T17:53:48.920518+0000","last_clean":"2023-08-17T17:53:48.920518+0000","last_became_active":"2023-08-17T17:53:48.912793+0000","last_became_peered":"2023-08-17T17:53:48.912793+0000","last_unstale":"2023-08-17T17:53:48.920518+0000","last_undegraded":"2023-08-17T17:53:48.920518+0000","last_fullsized":"2023-08-17T17:53:48.920518+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"148'2","reported_seq":12,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919783+0000","last_change":"2023-08-17T17:53:48.544934+0000","last_active":"2023-08-17T17:53:48.919783+0000","last_peered":"2023-08-17T17:53:48.919783+0000","last_clean":"2023-08-17T17:53:48.919783+0000","last_became_active":"2023-08-17T17:53:48.544671+0000","last_became_peered":"2023-08-17T17:53:48.544671+0000","last_unstale":"2023-08-17T17:53:48.919783+0000","last_undegraded":"2023-08-17T17:53:48.919783+0000","last_fullsized":"2023-08-17T17:53:48.919783+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":113,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.907498+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T17:53:48.907498+0000","last_peered":"2023-08-17T17:53:48.907498+0000","last_clean":"2023-08-17T17:53:48.907498+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T17:53:48.907498+0000","last_undegraded":"2023-08-17T17:53:48.907498+0000","last_fullsized":"2023-08-17T17:53:48.907498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.919710+0000","last_change":"2023-08-17T17:53:48.914664+0000","last_active":"2023-08-17T17:53:48.919710+0000","last_peered":"2023-08-17T17:53:48.919710+0000","last_clean":"2023-08-17T17:53:48.919710+0000","last_became_active":"2023-08-17T17:53:48.914399+0000","last_became_peered":"2023-08-17T17:53:48.914399+0000","last_unstale":"2023-08-17T17:53:48.919710+0000","last_undegraded":"2023-08-17T17:53:48.919710+0000","last_fullsized":"2023-08-17T17:53:48.919710+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.894967+0000","last_change":"2023-08-17T17:53:48.542007+0000","last_active":"2023-08-17T17:53:48.894967+0000","last_peered":"2023-08-17T17:53:48.894967+0000","last_clean":"2023-08-17T17:53:48.894967+0000","last_became_active":"2023-08-17T17:53:48.541731+0000","last_became_peered":"2023-08-17T17:53:48.541731+0000","last_unstale":"2023-08-17T17:53:48.894967+0000","last_undegraded":"2023-08-17T17:53:48.894967+0000","last_fullsized":"2023-08-17T17:53:48.894967+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.897251+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T17:53:48.897251+0000","last_peered":"2023-08-17T17:53:48.897251+0000","last_clean":"2023-08-17T17:53:48.897251+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T17:53:48.897251+0000","last_undegraded":"2023-08-17T17:53:48.897251+0000","last_fullsized":"2023-08-17T17:53:48.897251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.909711+0000","last_change":"2023-08-17T17:53:48.906257+0000","last_active":"2023-08-17T17:53:48.909711+0000","last_peered":"2023-08-17T17:53:48.909711+0000","last_clean":"2023-08-17T17:53:48.909711+0000","last_became_active":"2023-08-17T17:53:48.905999+0000","last_became_peered":"2023-08-17T17:53:48.905999+0000","last_unstale":"2023-08-17T17:53:48.909711+0000","last_undegraded":"2023-08-17T17:53:48.909711+0000","last_fullsized":"2023-08-17T17:53:48.909711+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:48.512906+0000","last_clean_scrub_stamp":"2023-08-17T17:53:48.512906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.904777+0000","last_change":"2023-08-17T17:53:48.547454+0000","last_active":"2023-08-17T17:53:48.904777+0000","last_peered":"2023-08-17T17:53:48.904777+0000","last_clean":"2023-08-17T17:53:48.904777+0000","last_became_active":"2023-08-17T17:53:48.547008+0000","last_became_peered":"2023-08-17T17:53:48.547008+0000","last_unstale":"2023-08-17T17:53:48.904777+0000","last_undegraded":"2023-08-17T17:53:48.904777+0000","last_fullsized":"2023-08-17T17:53:48.904777+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:53:47.508215+0000","last_clean_scrub_stamp":"2023-08-17T17:53:47.508215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":113,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-08-17T17:53:48.904161+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T17:53:48.904161+0000","last_peered":"2023-08-17T17:53:48.904161+0000","last_clean":"2023-08-17T17:53:48.904161+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T17:53:48.904161+0000","last_undegraded":"2023-08-17T17:53:48.904161+0000","last_fullsized":"2023-08-17T17:53:48.904161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575079,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303016,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068824,"statfs":{"total":96636764160,"available":96326475776,"internally_reserved":0,"allocated":1867776,"data_stored":924021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.52800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.26200000000000001},"max":{"1min":0.60199999999999998,"5min":0.76900000000000002,"15min":1.0509999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.32200000000000001,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.75800000000000001,"15min":1.1100000000000001},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.33400000000000002,"15min":0.28999999999999998},"max":{"1min":0.72699999999999998,"5min":0.84099999999999997,"15min":1.1439999999999999},"last":0.441},{"interface":"front","average":{"1min":0.499,"5min":0.50900000000000001,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":0.68500000000000005,"5min":0.69399999999999995,"15min":0.80000000000000004},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Aug 17 17:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.499,"15min":0.53400000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72799999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.503},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.56899999999999995},"min":{"1min":0.434,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.67900000000000005,"5min":0.88,"15min":1.23},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52800000000000002,"15min":0.56599999999999995},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.69799999999999995,"5min":0.76100000000000001,"15min":1.0429999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.81799999999999995,"15min":0.86099999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Aug 17 17:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45800000000000002,"15min":0.46400000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.68500000000000005,"5min":0.72599999999999998,"15min":0.85499999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48699999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73699999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.499,"15min":0.51000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68999999999999995,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66700000000000004,"5min":0.76200000000000001,"15min":0.93000000000000005},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54400000000000004,"15min":0.56100000000000005},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74199999999999999,"5min":0.82399999999999995,"15min":0.88800000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.34599999999999997,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67900000000000005,"5min":0.89300000000000002,"15min":0.90200000000000002},"last":0.36899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575079,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1863680,"data_stored":924269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.34300000000000003,"5min":0.33500000000000002,"15min":0.27500000000000002},"max":{"1min":0.746,"5min":0.85599999999999998,"15min":1.0980000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.49299999999999999,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71899999999999997,"15min":0.95999999999999996},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.496,"15min":0.51700000000000002},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66700000000000004,"5min":0.77600000000000002,"15min":0.94899999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50600000000000001,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":1.1930000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Aug 17 17:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.81100000000000005,"15min":1.0609999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55700000000000005,"15min":0.59499999999999997},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.373},"max":{"1min":0.69599999999999995,"5min":0.86699999999999999,"15min":1.1080000000000001},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Aug 17 17:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64800000000000002,"5min":0.80100000000000005,"15min":1.0780000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.73299999999999998,"5min":0.80800000000000005,"15min":1.1240000000000001},"last":0.62}]},{"osd":4,"last update":"Thu Aug 17 17:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45500000000000002,"15min":0.442},"min":{"1min":0.35299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63800000000000001,"5min":0.70499999999999996,"15min":0.75800000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.47899999999999998,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70099999999999996,"5min":0.74199999999999999,"15min":0.77300000000000002},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Aug 17 17:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47099999999999997,"15min":0.47799999999999998},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56799999999999995,"5min":0.80500000000000005,"15min":1.7330000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.47099999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70999999999999996,"5min":0.81299999999999994,"15min":1.51},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Aug 17 17:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.80200000000000005,"15min":0.872},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.45200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.67500000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575080,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303004,"kb_used_data":1812,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068836,"statfs":{"total":96636764160,"available":96326488064,"internally_reserved":0,"allocated":1855488,"data_stored":923287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.34799999999999998},"min":{"1min":0.25900000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45800000000000002,"5min":0.56000000000000005,"15min":0.57999999999999996},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.5,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.36399999999999999},"min":{"1min":0.26800000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.70799999999999996},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.63600000000000001,"15min":0.66300000000000003},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.33200000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.30399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.63300000000000001},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.89600000000000002,"15min":0.93200000000000005},"last":0.62},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85299999999999998,"5min":1.2989999999999999,"15min":1.331},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84499999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":1.2629999999999999,"15min":1.2929999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86799999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575079,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303016,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068824,"statfs":{"total":96636764160,"available":96326475776,"internally_reserved":0,"allocated":1867776,"data_stored":923413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 17:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34399999999999997,"15min":0.35299999999999998},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.61599999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.36699999999999999,"15min":0.38200000000000001},"min":{"1min":0.23999999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.54600000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34899999999999998,"15min":0.36299999999999999},"min":{"1min":0.24199999999999999,"5min":0.19900000000000001,"15min":0.19400000000000001},"max":{"1min":0.442,"5min":0.54600000000000004,"15min":0.60099999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.38700000000000001,"15min":0.40200000000000002},"min":{"1min":0.30499999999999999,"5min":0.26600000000000001,"15min":0.25800000000000001},"max":{"1min":0.51400000000000001,"5min":0.59999999999999998,"15min":0.63400000000000001},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56499999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.39400000000000002,"15min":0.41099999999999998},"min":{"1min":0.29299999999999998,"5min":0.28100000000000003,"15min":0.26200000000000001},"max":{"1min":0.46000000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.377}]},{"osd":4,"last update":"Thu Aug 17 17:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60299999999999998,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77700000000000002,"5min":1.0569999999999999,"15min":1.4810000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60699999999999998,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.754,"5min":1.044,"15min":1.3300000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Aug 17 17:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58299999999999996,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73899999999999999,"5min":1.034,"15min":1.6379999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59299999999999997,"15min":0.629},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76300000000000001,"5min":1.095,"15min":1.677},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Aug 17 17:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.61799999999999999},"min":{"1min":0.438,"5min":0.39300000000000002,"15min":0.372},"max":{"1min":0.71999999999999997,"5min":1.087,"15min":1.51},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.63500000000000001},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72499999999999998,"5min":1.0740000000000001,"15min":1.391},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Aug 17 17:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.66500000000000004},"min":{"1min":0.505,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.72399999999999998,"5min":1.103,"15min":5.6109999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.67300000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80100000000000005,"5min":1.0980000000000001,"15min":1.544},"last":0.80100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575079,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1863680,"data_stored":923875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32900000000000001,"15min":0.34599999999999997},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.252},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.37},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49199999999999999,"5min":0.54100000000000004,"15min":1.8160000000000001},"last":0.376}]},{"osd":1,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.59399999999999997,"15min":0.70199999999999996},"last":0.318},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.41599999999999998},"min":{"1min":0.25600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.61799999999999999},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.41899999999999998},"min":{"1min":0.308,"5min":0.27800000000000002,"15min":0.27200000000000002},"max":{"1min":0.58299999999999996,"5min":0.63,"15min":1.268},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88,"5min":1.417,"15min":1.417},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":1.51,"15min":2.9220000000000002},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":1.544,"15min":1.544},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.872,"5min":1.5509999999999999,"15min":2.9550000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":1.415,"15min":1.415},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Aug 17 17:52:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.81499999999999995,"5min":1.3859999999999999,"15min":2.984},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575079,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1863680,"data_stored":923931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.56299999999999994},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.375},"min":{"1min":0.251,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.54800000000000004,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.22},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38300000000000001,"15min":0.39100000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56799999999999995,"5min":0.59899999999999998,"15min":0.82299999999999995},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.63300000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.313}]},{"osd":4,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.29899999999999999},"max":{"1min":0.76700000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.498},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.78800000000000003,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86699999999999999,"5min":3.1989999999999998,"15min":3.1989999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.433,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81699999999999995,"5min":1.466,"15min":1.466},"last":0.62},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Aug 17 17:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.48,"15min":1.48},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82299999999999995,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834575080,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1863680,"data_stored":923911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.26400000000000001},"max":{"1min":0.77000000000000002,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.28999999999999998},"max":{"1min":0.81000000000000005,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.55200000000000005},"min":{"1min":0.45200000000000001,"5min":0.34300000000000003,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":1.252,"15min":1.252},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.306,"15min":1.306},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88800000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":1.444,"15min":1.444},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80600000000000005,"5min":1.482,"15min":1.482},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.86299999999999999,"5min":1.123,"15min":1.123},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.26700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":1.002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.48299999999999998},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.91100000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":1.048,"15min":1.048},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Aug 17 17:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.91900000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.056},"last":0.69499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575078,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307108,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064732,"statfs":{"total":96636764160,"available":96322285568,"internally_reserved":0,"allocated":1863680,"data_stored":924201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69299999999999995,"5min":1.165,"15min":1.165},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":1.022,"15min":1.022},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.495},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.29799999999999999},"max":{"1min":0.68500000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.41599999999999998,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.76400000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":1.153,"15min":1.153},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.622},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":1.036,"15min":1.036},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.255},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35899999999999999,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.502,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Aug 17 17:52:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.36199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T17:53:56.671 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T17:53:56.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T17:53:56.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.820+0000 7f9679154700 1 Processor -- start 2023-08-17T17:53:56.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.820+0000 7f9679154700 1 -- start start 2023-08-17T17:53:56.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.821+0000 7f9679154700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9674138a10 0x7f96740c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.821+0000 7f9679154700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96740bdca0 0x7f96740be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.821+0000 7f9679154700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96740c34e0 con 0x7f9674138630 2023-08-17T17:53:56.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.821+0000 7f9679154700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96740bfc60 con 0x7f96740bdca0 2023-08-17T17:53:56.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.821+0000 7f9679154700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96740a6ae0 con 0x7f9674138a10 2023-08-17T17:53:56.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.821+0000 7f967359e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96740bdca0 0x7f96740be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.821+0000 7f967359e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96740bdca0 0x7f96740be110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57620/0 (socket says 172.21.15.78:57620) 2023-08-17T17:53:56.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.821+0000 7f967359e700 1 -- 172.21.15.78:0/520687325 learned_addr learned my addr 172.21.15.78:0/520687325 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:56.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f967359e700 1 -- 172.21.15.78:0/520687325 >> v2:172.21.15.150:3300/0 conn(0x7f9674138a10 msgr2=0x7f96740c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:56.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f966a59c700 1 --2- 172.21.15.78:0/520687325 >> v2:172.21.15.150:3300/0 conn(0x7f9674138a10 0x7f96740c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f967359e700 1 --2- 172.21.15.78:0/520687325 >> v2:172.21.15.150:3300/0 conn(0x7f9674138a10 0x7f96740c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f967359e700 1 -- 172.21.15.78:0/520687325 >> v1:172.21.15.150:6789/0 conn(0x7f9674138630 legacy=0x7f96740c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:56.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f967359e700 1 -- 172.21.15.78:0/520687325 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740c37c0 con 0x7f96740bdca0 2023-08-17T17:53:56.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f967359e700 1 --2- 172.21.15.78:0/520687325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96740bdca0 0x7f96740be110 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f9674047a90 tx=0x7f966c009840).ready entity=mon.0 client_cookie=deedef233229bfec server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:56.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f967259c700 1 -- 172.21.15.78:0/520687325 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c00e070 con 0x7f96740bdca0 2023-08-17T17:53:56.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f967259c700 1 -- 172.21.15.78:0/520687325 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c00ba10 con 0x7f96740bdca0 2023-08-17T17:53:56.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f967259c700 1 -- 172.21.15.78:0/520687325 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c00bd90 con 0x7f96740bdca0 2023-08-17T17:53:56.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f9679154700 1 -- 172.21.15.78:0/520687325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96740bdca0 msgr2=0x7f96740be110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:56.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.822+0000 7f9679154700 1 --2- 172.21.15.78:0/520687325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96740bdca0 0x7f96740be110 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f9674047a90 tx=0x7f966c009840).stop 2023-08-17T17:53:56.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.823+0000 7f9679154700 1 -- 172.21.15.78:0/520687325 shutdown_connections 2023-08-17T17:53:56.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.823+0000 7f9679154700 1 --2- 172.21.15.78:0/520687325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96740bdca0 0x7f96740be110 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.823+0000 7f9679154700 1 --2- 172.21.15.78:0/520687325 >> v2:172.21.15.150:3300/0 conn(0x7f9674138a10 0x7f96740c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.823+0000 7f9679154700 1 -- 172.21.15.78:0/520687325 >> 172.21.15.78:0/520687325 conn(0x7f9674062fc0 msgr2=0x7f96740c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:56.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.823+0000 7f9679154700 1 -- 172.21.15.78:0/520687325 shutdown_connections 2023-08-17T17:53:56.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.823+0000 7f9679154700 1 -- 172.21.15.78:0/520687325 wait complete. 2023-08-17T17:53:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.824+0000 7f9679154700 1 Processor -- start 2023-08-17T17:53:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.824+0000 7f9679154700 1 -- start start 2023-08-17T17:53:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f9679154700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96740bdca0 0x7f9674137760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f9679154700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9674138630 0x7f96740ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f9679154700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9674138a10 0x7f96740ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f9679154700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96740c2db0 con 0x7f9674138a10 2023-08-17T17:53:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f9679154700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9674137c50 con 0x7f96740bdca0 2023-08-17T17:53:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f9679154700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96740c21a0 con 0x7f9674138630 2023-08-17T17:53:56.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f967359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9674138a10 0x7f96740ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f967359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9674138a10 0x7f96740ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57636/0 (socket says 172.21.15.78:57636) 2023-08-17T17:53:56.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f967359e700 1 -- 172.21.15.78:0/1071978515 learned_addr learned my addr 172.21.15.78:0/1071978515 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:56.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f9672d9d700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96740bdca0 0x7f9674137760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f967359e700 1 -- 172.21.15.78:0/1071978515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9674138630 msgr2=0x7f96740ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:56.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f967359e700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9674138630 0x7f96740ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:56.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f967359e700 1 -- 172.21.15.78:0/1071978515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96740bdca0 msgr2=0x7f9674137760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f967359e700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96740bdca0 0x7f9674137760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f967359e700 1 -- 172.21.15.78:0/1071978515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c009ae0 con 0x7f9674138a10 2023-08-17T17:53:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f9672d9d700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96740bdca0 0x7f9674137760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f967359e700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9674138a10 0x7f96740ae820 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f966c009540 tx=0x7f966c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f966b7fe700 1 -- 172.21.15.78:0/1071978515 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c0092e0 con 0x7f9674138a10 2023-08-17T17:53:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f966b7fe700 1 -- 172.21.15.78:0/1071978515 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c01e470 con 0x7f9674138a10 2023-08-17T17:53:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f9679154700 1 -- 172.21.15.78:0/1071978515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96740c2480 con 0x7f9674138a10 2023-08-17T17:53:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f966b7fe700 1 -- 172.21.15.78:0/1071978515 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c01e830 con 0x7f9674138a10 2023-08-17T17:53:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.825+0000 7f9679154700 1 -- 172.21.15.78:0/1071978515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96740c2a40 con 0x7f9674138a10 2023-08-17T17:53:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.826+0000 7f9679154700 1 -- 172.21.15.78:0/1071978515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9674047350 con 0x7f9674138a10 2023-08-17T17:53:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.826+0000 7f966b7fe700 1 -- 172.21.15.78:0/1071978515 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f966c025030 con 0x7f9674138a10 2023-08-17T17:53:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.827+0000 7f966b7fe700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f965405ed90 0x7f9654061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.827+0000 7f966b7fe700 1 -- 172.21.15.78:0/1071978515 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f966c07b230 con 0x7f9674138a10 2023-08-17T17:53:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.827+0000 7f9672d9d700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f965405ed90 0x7f9654061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.827+0000 7f9672d9d700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f965405ed90 0x7f9654061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f966400a820 tx=0x7f9664008040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:56.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:56.831+0000 7f966b7fe700 1 -- 172.21.15.78:0/1071978515 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f966c04c7d0 con 0x7f9674138a10 2023-08-17T17:53:57.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.059+0000 7f9679154700 1 -- 172.21.15.78:0/1071978515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f96741524d0 con 0x7f9674138a10 2023-08-17T17:53:57.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.063+0000 7f966b7fe700 1 -- 172.21.15.78:0/1071978515 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+0 (secure 0 0 0) 0x7f966c023070 con 0x7f9674138a10 2023-08-17T17:53:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.064+0000 7f9679154700 1 -- 172.21.15.78:0/1071978515 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f965405ed90 msgr2=0x7f9654061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.064+0000 7f9679154700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f965405ed90 0x7f9654061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f966400a820 tx=0x7f9664008040).stop 2023-08-17T17:53:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.064+0000 7f9679154700 1 -- 172.21.15.78:0/1071978515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9674138a10 msgr2=0x7f96740ae820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.064+0000 7f9679154700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9674138a10 0x7f96740ae820 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f966c009540 tx=0x7f966c009840).stop 2023-08-17T17:53:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.064+0000 7f9679154700 1 -- 172.21.15.78:0/1071978515 shutdown_connections 2023-08-17T17:53:57.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.064+0000 7f9679154700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f965405ed90 0x7f9654061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.065+0000 7f9679154700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9674138a10 0x7f96740ae820 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.065+0000 7f9679154700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96740bdca0 0x7f9674137760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.065+0000 7f9679154700 1 --2- 172.21.15.78:0/1071978515 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9674138630 0x7f96740ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:57.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.065+0000 7f9679154700 1 -- 172.21.15.78:0/1071978515 >> 172.21.15.78:0/1071978515 conn(0x7f9674062fc0 msgr2=0x7f96740c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:57.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.065+0000 7f9679154700 1 -- 172.21.15.78:0/1071978515 shutdown_connections 2023-08-17T17:53:57.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.065+0000 7f9679154700 1 -- 172.21.15.78:0/1071978515 wait complete. 2023-08-17T17:53:57.068 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-08-17T17:53:57.077 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T17:53:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.189+0000 7f336dc1d700 1 Processor -- start 2023-08-17T17:53:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.189+0000 7f336dc1d700 1 -- start start 2023-08-17T17:53:57.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.190+0000 7f336dc1d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f33680c2110 0x7f33681516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.190+0000 7f336dc1d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3368151be0 con 0x7f33680650a0 2023-08-17T17:53:57.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.190+0000 7f336dc1d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3368068950 con 0x7f33680c4ee0 2023-08-17T17:53:57.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.190+0000 7f336dc1d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33680699f0 con 0x7f33680c2110 2023-08-17T17:53:57.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.190+0000 7f3366ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f33680c2110 0x7f33681516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.190+0000 7f33677fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f33680650a0 0x7f33680c1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41176/0 (socket says 172.21.15.78:41176) 2023-08-17T17:53:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.190+0000 7f33677fe700 1 -- 172.21.15.78:0/3222626356 learned_addr learned my addr 172.21.15.78:0/3222626356 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.190+0000 7f3366ffd700 1 -- 172.21.15.78:0/3222626356 >> v1:172.21.15.150:6789/0 conn(0x7f33680c4ee0 legacy=0x7f33680c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.190+0000 7f3366ffd700 1 -- 172.21.15.78:0/3222626356 >> v1:172.21.15.78:6789/0 conn(0x7f33680650a0 legacy=0x7f33680c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f3366ffd700 1 -- 172.21.15.78:0/3222626356 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368068c30 con 0x7f33680c2110 2023-08-17T17:53:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f3366ffd700 1 --2- 172.21.15.78:0/3222626356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680c2110 0x7f33681516f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f335c009760 tx=0x7f335c009060).ready entity=mon.0 client_cookie=7d7c61e86c100fab server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f33667fc700 1 -- 172.21.15.78:0/3222626356 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00f510 con 0x7f33680c2110 2023-08-17T17:53:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f33667fc700 1 -- 172.21.15.78:0/3222626356 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c00f670 con 0x7f33680c2110 2023-08-17T17:53:57.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f33667fc700 1 -- 172.21.15.78:0/3222626356 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00f9f0 con 0x7f33680c2110 2023-08-17T17:53:57.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f336dc1d700 1 -- 172.21.15.78:0/3222626356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680c2110 msgr2=0x7f33681516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f336dc1d700 1 --2- 172.21.15.78:0/3222626356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680c2110 0x7f33681516f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f335c009760 tx=0x7f335c009060).stop 2023-08-17T17:53:57.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f336dc1d700 1 -- 172.21.15.78:0/3222626356 shutdown_connections 2023-08-17T17:53:57.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f336dc1d700 1 --2- 172.21.15.78:0/3222626356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680c2110 0x7f33681516f0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f336dc1d700 1 -- 172.21.15.78:0/3222626356 >> 172.21.15.78:0/3222626356 conn(0x7f3368062fc0 msgr2=0x7f33680c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:57.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f336dc1d700 1 -- 172.21.15.78:0/3222626356 shutdown_connections 2023-08-17T17:53:57.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.191+0000 7f336dc1d700 1 -- 172.21.15.78:0/3222626356 wait complete. 2023-08-17T17:53:57.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.193+0000 7f336dc1d700 1 Processor -- start 2023-08-17T17:53:57.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.193+0000 7f336dc1d700 1 -- start start 2023-08-17T17:53:57.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.193+0000 7f336dc1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680650a0 0x7f336813be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.193+0000 7f336dc1d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33680c2110 0x7f3368139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.193+0000 7f336dc1d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33680c4ee0 0x7f336814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.193+0000 7f336dc1d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3368139830 con 0x7f33680650a0 2023-08-17T17:53:57.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.193+0000 7f336dc1d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336813a650 con 0x7f33680c2110 2023-08-17T17:53:57.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.193+0000 7f336dc1d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3368139a40 con 0x7f33680c4ee0 2023-08-17T17:53:57.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.193+0000 7f33677fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680650a0 0x7f336813be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f33677fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680650a0 0x7f336813be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57650/0 (socket says 172.21.15.78:57650) 2023-08-17T17:53:57.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f33677fe700 1 -- 172.21.15.78:0/3806994338 learned_addr learned my addr 172.21.15.78:0/3806994338 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:57.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f3366ffd700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33680c2110 0x7f3368139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f3367fff700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33680c4ee0 0x7f336814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f33677fe700 1 -- 172.21.15.78:0/3806994338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33680c4ee0 msgr2=0x7f336814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f33677fe700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33680c4ee0 0x7f336814bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f33677fe700 1 -- 172.21.15.78:0/3806994338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33680c2110 msgr2=0x7f3368139340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f33677fe700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33680c2110 0x7f3368139340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f33677fe700 1 -- 172.21.15.78:0/3806994338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0092a0 con 0x7f33680650a0 2023-08-17T17:53:57.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f3367fff700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33680c4ee0 0x7f336814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:57.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f33677fe700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680650a0 0x7f336813be40 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f335800c510 tx=0x7f3358007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:57.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f334f7fe700 1 -- 172.21.15.78:0/3806994338 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580072e0 con 0x7f33680650a0 2023-08-17T17:53:57.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f334f7fe700 1 -- 172.21.15.78:0/3806994338 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358007440 con 0x7f33680650a0 2023-08-17T17:53:57.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f336dc1d700 1 -- 172.21.15.78:0/3806994338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3368139d20 con 0x7f33680650a0 2023-08-17T17:53:57.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f334f7fe700 1 -- 172.21.15.78:0/3806994338 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580057a0 con 0x7f33680650a0 2023-08-17T17:53:57.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.194+0000 7f336dc1d700 1 -- 172.21.15.78:0/3806994338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336813a2e0 con 0x7f33680650a0 2023-08-17T17:53:57.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.195+0000 7f336dc1d700 1 -- 172.21.15.78:0/3806994338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3368047350 con 0x7f33680650a0 2023-08-17T17:53:57.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.195+0000 7f334f7fe700 1 -- 172.21.15.78:0/3806994338 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3358010070 con 0x7f33680650a0 2023-08-17T17:53:57.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.196+0000 7f334f7fe700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f335405ed90 0x7f3354061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.196+0000 7f334f7fe700 1 -- 172.21.15.78:0/3806994338 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f33580791f0 con 0x7f33680650a0 2023-08-17T17:53:57.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.196+0000 7f3366ffd700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f335405ed90 0x7f3354061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.196+0000 7f3366ffd700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f335405ed90 0x7f3354061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f335c009760 tx=0x7f335c017000).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:57.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.200+0000 7f334f7fe700 1 -- 172.21.15.78:0/3806994338 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f335804a840 con 0x7f33680650a0 2023-08-17T17:53:57.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.403+0000 7f336dc1d700 1 -- 172.21.15.78:0/3806994338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33680c4a90 con 0x7f33680650a0 2023-08-17T17:53:57.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.404+0000 7f334f7fe700 1 -- 172.21.15.78:0/3806994338 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f335804de60 con 0x7f33680650a0 2023-08-17T17:53:57.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T17:53:57.405 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":55,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/948559321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":948559321},{"type":"v1","addr":"172.21.15.150:6834","nonce":948559321}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/323810610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":323810610},{"type":"v1","addr":"172.21.15.78:6836","nonce":323810610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/246455712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":246455712},{"type":"v1","addr":"172.21.15.78:6837","nonce":246455712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:48.889332+0000","modified":"2023-08-17T17:53:50.895449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1383305491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1383305491},{"type":"v1","addr":"172.21.15.150:6835","nonce":1383305491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T17:53:57.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 -- 172.21.15.78:0/3806994338 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f335405ed90 msgr2=0x7f3354061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f335405ed90 0x7f3354061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f335c009760 tx=0x7f335c017000).stop 2023-08-17T17:53:57.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 -- 172.21.15.78:0/3806994338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680650a0 msgr2=0x7f336813be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680650a0 0x7f336813be40 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f335800c510 tx=0x7f3358007d70).stop 2023-08-17T17:53:57.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 -- 172.21.15.78:0/3806994338 shutdown_connections 2023-08-17T17:53:57.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f335405ed90 0x7f3354061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33680c4ee0 0x7f336814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33680650a0 0x7f336813be40 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 --2- 172.21.15.78:0/3806994338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33680c2110 0x7f3368139340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 -- 172.21.15.78:0/3806994338 >> 172.21.15.78:0/3806994338 conn(0x7f3368062fc0 msgr2=0x7f33680c1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:57.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 -- 172.21.15.78:0/3806994338 shutdown_connections 2023-08-17T17:53:57.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.406+0000 7f336dc1d700 1 -- 172.21.15.78:0/3806994338 wait complete. 2023-08-17T17:53:57.409 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 55 2023-08-17T17:53:57.820 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T17:53:48.889332+0000', 'modified': '2023-08-17T17:53:50.895449+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8565}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8565': {'gid': 8565, 'name': 'b', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/1383305491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 1383305491}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 1383305491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T17:53:57.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T17:53:57.821 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-17T17:53:57.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.934+0000 7fdf33117700 1 Processor -- start 2023-08-17T17:53:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.934+0000 7fdf33117700 1 -- start start 2023-08-17T17:53:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.935+0000 7fdf33117700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c154580 0x7fdf2c0a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.935+0000 7fdf33117700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c0c7690 con 0x7fdf2c1541a0 2023-08-17T17:53:57.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.935+0000 7fdf33117700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c0c8df0 con 0x7fdf2c0c0560 2023-08-17T17:53:57.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.935+0000 7fdf33117700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0a8190 con 0x7fdf2c154580 2023-08-17T17:53:57.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.935+0000 7fdf30eb3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdf2c1541a0 0x7fdf2c0bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41190/0 (socket says 172.21.15.78:41190) 2023-08-17T17:53:57.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.935+0000 7fdf30eb3700 1 -- 172.21.15.78:0/3099391340 learned_addr learned my addr 172.21.15.78:0/3099391340 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:57.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.935+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865261665 0 0) 0x7fdf28001110 con 0x7fdf2c1541a0 2023-08-17T17:53:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.935+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf140033f0 con 0x7fdf2c1541a0 2023-08-17T17:53:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.935+0000 7fdf23fff700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c154580 0x7fdf2c0a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 153820875 0 0) 0x7fdf140033f0 con 0x7fdf2c1541a0 2023-08-17T17:53:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c154580 msgr2=0x7fdf2c0a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c154580 0x7fdf2c0a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 >> v1:172.21.15.150:6789/0 conn(0x7fdf2c0c0560 legacy=0x7fdf2c0c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0c9970 con 0x7fdf2c1541a0 2023-08-17T17:53:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fdf28001600 con 0x7fdf2c1541a0 2023-08-17T17:53:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 >> v1:172.21.15.78:6789/0 conn(0x7fdf2c1541a0 legacy=0x7fdf2c0bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c154580 0x7fdf14003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf14003ef0 0x7fdf14004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf14004b80 0x7fdf14005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0a8190 con 0x7fdf14004b80 2023-08-17T17:53:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1400bb20 con 0x7fdf14003ef0 2023-08-17T17:53:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1400bce0 con 0x7fdf2c154580 2023-08-17T17:53:57.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf316b4700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf14004b80 0x7fdf14005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf23fff700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf14003ef0 0x7fdf14004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c154580 0x7fdf14003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf316b4700 1 -- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c154580 msgr2=0x7fdf14003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf316b4700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c154580 0x7fdf14003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf316b4700 1 -- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf14003ef0 msgr2=0x7fdf14004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf316b4700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf14003ef0 0x7fdf14004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf316b4700 1 -- 172.21.15.78:0/3099391340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140033f0 con 0x7fdf14004b80 2023-08-17T17:53:57.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf316b4700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf14004b80 0x7fdf14005000 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7fdf24001e00 tx=0x7fdf24007f30).ready entity=mon.0 client_cookie=80792753a22767f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:57.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24006a20 con 0x7fdf14004b80 2023-08-17T17:53:57.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf24006b80 con 0x7fdf14004b80 2023-08-17T17:53:57.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.936+0000 7fdf237fe700 1 -- 172.21.15.78:0/3099391340 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400c5d0 con 0x7fdf14004b80 2023-08-17T17:53:57.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.937+0000 7fdf33117700 1 -- 172.21.15.78:0/3099391340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf14004b80 msgr2=0x7fdf14005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.937+0000 7fdf33117700 1 --2- 172.21.15.78:0/3099391340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf14004b80 0x7fdf14005000 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7fdf24001e00 tx=0x7fdf24007f30).stop 2023-08-17T17:53:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.937+0000 7fdf316b4700 1 -- 172.21.15.78:0/3099391340 reap_dead start 2023-08-17T17:53:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.937+0000 7fdf33117700 1 -- 172.21.15.78:0/3099391340 shutdown_connections 2023-08-17T17:53:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.937+0000 7fdf33117700 1 -- 172.21.15.78:0/3099391340 >> 172.21.15.78:0/3099391340 conn(0x7fdf2c06a400 msgr2=0x7fdf2c0caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.937+0000 7fdf33117700 1 -- 172.21.15.78:0/3099391340 shutdown_connections 2023-08-17T17:53:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.937+0000 7fdf33117700 1 -- 172.21.15.78:0/3099391340 wait complete. 2023-08-17T17:53:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.938+0000 7fdf33117700 1 Processor -- start 2023-08-17T17:53:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.938+0000 7fdf33117700 1 -- start start 2023-08-17T17:53:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf33117700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c0af550 0x7fdf2c0a8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf33117700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf2c0c4bd0 0x7fdf2c0a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf33117700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c0af930 0x7fdf2c0c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf33117700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0a9310 con 0x7fdf2c0c4bd0 2023-08-17T17:53:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf33117700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c4740 con 0x7fdf2c0af930 2023-08-17T17:53:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf33117700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c3b30 con 0x7fdf2c0af550 2023-08-17T17:53:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf23fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf2c0c4bd0 0x7fdf2c0a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf23fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf2c0c4bd0 0x7fdf2c0a8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57658/0 (socket says 172.21.15.78:57658) 2023-08-17T17:53:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf23fff700 1 -- 172.21.15.78:0/721743540 learned_addr learned my addr 172.21.15.78:0/721743540 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c0af550 0x7fdf2c0a8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf316b4700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c0af930 0x7fdf2c0c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf23fff700 1 -- 172.21.15.78:0/721743540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c0af550 msgr2=0x7fdf2c0a8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf23fff700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c0af550 0x7fdf2c0a8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf23fff700 1 -- 172.21.15.78:0/721743540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c0af930 msgr2=0x7fdf2c0c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf23fff700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c0af930 0x7fdf2c0c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.939+0000 7fdf23fff700 1 -- 172.21.15.78:0/721743540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0c3e10 con 0x7fdf2c0c4bd0 2023-08-17T17:53:57.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.940+0000 7fdf23fff700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf2c0c4bd0 0x7fdf2c0a8e20 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7fdf1c010960 tx=0x7fdf1c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:57.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.940+0000 7fdf20ff9700 1 -- 172.21.15.78:0/721743540 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00e7b0 con 0x7fdf2c0c4bd0 2023-08-17T17:53:57.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.940+0000 7fdf20ff9700 1 -- 172.21.15.78:0/721743540 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c00e910 con 0x7fdf2c0c4bd0 2023-08-17T17:53:57.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.940+0000 7fdf33117700 1 -- 172.21.15.78:0/721743540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c0c40f0 con 0x7fdf2c0c4bd0 2023-08-17T17:53:57.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.940+0000 7fdf20ff9700 1 -- 172.21.15.78:0/721743540 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00ec90 con 0x7fdf2c0c4bd0 2023-08-17T17:53:57.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.940+0000 7fdf33117700 1 -- 172.21.15.78:0/721743540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c0c37e0 con 0x7fdf2c0c4bd0 2023-08-17T17:53:57.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.941+0000 7fdf20ff9700 1 -- 172.21.15.78:0/721743540 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdf1c014680 con 0x7fdf2c0c4bd0 2023-08-17T17:53:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.941+0000 7fdf20ff9700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf1805ed90 0x7fdf18061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.942+0000 7fdf20ff9700 1 -- 172.21.15.78:0/721743540 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdf1c079e30 con 0x7fdf2c0c4bd0 2023-08-17T17:53:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.942+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf1805ed90 0x7fdf18061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.942+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf1805ed90 0x7fdf18061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdf28000e50 tx=0x7fdf280078d0).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:57.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.943+0000 7fdf44aacb80 1 Processor -- start 2023-08-17T17:53:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.944+0000 7fdf44aacb80 1 -- start start 2023-08-17T17:53:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.944+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1e7d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.944+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1ec58c0 0x561bc1e77f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.944+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e783f0 0x561bc1e78870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.944+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc1e42d00 con 0x561bc1e7cc20 2023-08-17T17:53:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.944+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc1db9cb0 con 0x561bc1ec58c0 2023-08-17T17:53:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.944+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bc1dcec90 con 0x561bc1e783f0 2023-08-17T17:53:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.944+0000 7fdf30eb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1e7d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.944+0000 7fdf30eb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1e7d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57670/0 (socket says 172.21.15.78:57670) 2023-08-17T17:53:57.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.944+0000 7fdf30eb3700 1 -- 172.21.15.78:0/3003041717 learned_addr learned my addr 172.21.15.78:0/3003041717 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:57.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf23fff700 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1ec58c0 0x561bc1e77f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf30eb3700 1 -- 172.21.15.78:0/3003041717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e783f0 msgr2=0x561bc1e78870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf316b4700 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e783f0 0x561bc1e78870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e783f0 0x561bc1e78870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf30eb3700 1 -- 172.21.15.78:0/3003041717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1ec58c0 msgr2=0x561bc1e77f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1ec58c0 0x561bc1e77f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf30eb3700 1 -- 172.21.15.78:0/3003041717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bc1c71310 con 0x561bc1e7cc20 2023-08-17T17:53:57.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf23fff700 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1ec58c0 0x561bc1e77f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:57.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf316b4700 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e783f0 0x561bc1e78870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:57.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1e7d000 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fdf28004860 tx=0x7fdf28006000).ready entity=mon.0 client_cookie=90392f3773b36c06 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:57.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf11ffb700 1 -- 172.21.15.78:0/3003041717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28001010 con 0x561bc1e7cc20 2023-08-17T17:53:57.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf11ffb700 1 -- 172.21.15.78:0/3003041717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf280176b0 con 0x561bc1e7cc20 2023-08-17T17:53:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf11ffb700 1 -- 172.21.15.78:0/3003041717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28017a30 con 0x561bc1e7cc20 2023-08-17T17:53:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf44aacb80 1 -- 172.21.15.78:0/3003041717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 msgr2=0x561bc1e7d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1e7d000 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fdf28004860 tx=0x7fdf28006000).stop 2023-08-17T17:53:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf44aacb80 1 -- 172.21.15.78:0/3003041717 shutdown_connections 2023-08-17T17:53:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e783f0 0x561bc1e78870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1e7d000 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/3003041717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1ec58c0 0x561bc1e77f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.945+0000 7fdf44aacb80 1 -- 172.21.15.78:0/3003041717 >> 172.21.15.78:0/3003041717 conn(0x561bc1c39e40 msgr2=0x561bc1ec5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.946+0000 7fdf44aacb80 1 -- 172.21.15.78:0/3003041717 shutdown_connections 2023-08-17T17:53:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.946+0000 7fdf44aacb80 1 -- 172.21.15.78:0/3003041717 wait complete. 2023-08-17T17:53:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.946+0000 7fdf44aacb80 1 -- start start 2023-08-17T17:53:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.946+0000 7fdf44aacb80 1 Processor -- start 2023-08-17T17:53:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e783f0 0x561bc1ec0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1ec5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1ec58c0 0x561bc1e9c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc1d95ef0 con 0x561bc1e7cc20 2023-08-17T17:53:57.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc1d9a8d0 con 0x561bc1e783f0 2023-08-17T17:53:57.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bc1ea6750 con 0x561bc1ec58c0 2023-08-17T17:53:57.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf44aacb80 10 client.0 ll_register_callbacks cb 0x561bc1e3cce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:53:57.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf23fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1ec5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf23fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1ec5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57682/0 (socket says 172.21.15.78:57682) 2023-08-17T17:53:57.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf23fff700 1 -- 172.21.15.78:0/1728361336 learned_addr learned my addr 172.21.15.78:0/1728361336 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:57.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e783f0 0x561bc1ec0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.947+0000 7fdf316b4700 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1ec58c0 0x561bc1e9c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf23fff700 1 -- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1ec58c0 msgr2=0x561bc1e9c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf23fff700 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1ec58c0 0x561bc1e9c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf23fff700 1 -- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e783f0 msgr2=0x561bc1ec0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf23fff700 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e783f0 0x561bc1ec0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf23fff700 1 -- 172.21.15.78:0/1728361336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c0c9970 con 0x561bc1e7cc20 2023-08-17T17:53:57.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf23fff700 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1ec5160 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fdf1c00b140 tx=0x7fdf1c013000).ready entity=mon.0 client_cookie=14119c60d01d2d47 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:57.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf0affd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:53:57.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf0affd700 1 -- 172.21.15.78:0/1728361336 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c04d500 con 0x561bc1e7cc20 2023-08-17T17:53:57.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf0affd700 1 -- 172.21.15.78:0/1728361336 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdf1c04e790 con 0x561bc1e7cc20 2023-08-17T17:53:57.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1728361336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bc1e770f0 con 0x561bc1e7cc20 2023-08-17T17:53:57.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf0affd700 1 -- 172.21.15.78:0/1728361336 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf1c04b090 con 0x561bc1e7cc20 2023-08-17T17:53:57.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf44aacb80 10 client.8724 fetch_fsmap learned FSMap version 55 2023-08-17T17:53:57.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1728361336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x561bc1dc7e70 con 0x561bc1e7cc20 2023-08-17T17:53:57.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf0affd700 1 -- 172.21.15.78:0/1728361336 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561bc1e770f0 con 0x561bc1e7cc20 2023-08-17T17:53:57.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf0affd700 1 -- 172.21.15.78:0/1728361336 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 55) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf1c04dff0 con 0x561bc1e7cc20 2023-08-17T17:53:57.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf44aacb80 10 client.8724 fetch_fsmap finished waiting for FSMap version 55 2023-08-17T17:53:57.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf44aacb80 10 client.8724 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-17T17:53:57.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf44aacb80 20 client.8724 populate_metadata read hostname 'smithi078' 2023-08-17T17:53:57.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:6833/1383305491,v1:172.21.15.150:6835/1383305491] conn(0x561bc1ec34d0 0x561bc1ea5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf44aacb80 4 client.8724 mds_command: new command op to 8565 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T17:53:57.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.948+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1728361336 --> [v2:172.21.15.150:6833/1383305491,v1:172.21.15.150:6835/1383305491] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561bc1e46b50 con 0x561bc1ec34d0 2023-08-17T17:53:57.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.949+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:6833/1383305491,v1:172.21.15.150:6835/1383305491] conn(0x561bc1ec34d0 0x561bc1ea5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.949+0000 7fdf0affd700 10 client.8724 ms_handle_connect on v2:172.21.15.150:6833/1383305491 2023-08-17T17:53:57.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.949+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:6833/1383305491,v1:172.21.15.150:6835/1383305491] conn(0x561bc1ec34d0 0x561bc1ea5a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3b8a18c4609876ac server_cookie=c4ae9ec7b5bd5667 in_seq=0 out_seq=0 2023-08-17T17:53:57.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf0affd700 1 -- 172.21.15.78:0/1728361336 <== mds.0 v2:172.21.15.150:6833/1383305491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x561bc1e46b50 con 0x561bc1ec34d0 2023-08-17T17:53:57.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf0affd700 10 client.8724 handle_command_reply: tid=0 2023-08-17T17:53:57.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 client.8724 shutdown 2023-08-17T17:53:57.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1728361336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 msgr2=0x561bc1ec5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1ec5160 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fdf1c00b140 tx=0x7fdf1c013000).stop 2023-08-17T17:53:57.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1728361336 shutdown_connections 2023-08-17T17:53:57.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:6833/1383305491,v1:172.21.15.150:6835/1383305491] conn(0x561bc1ec34d0 0x561bc1ea5a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1ec58c0 0x561bc1e9c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e783f0 0x561bc1ec0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1728361336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e7cc20 0x561bc1ec5160 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf0affd700 0 client.8724 ms_handle_reset on v2:172.21.15.150:6833/1383305491 2023-08-17T17:53:57.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1728361336 >> 172.21.15.78:0/1728361336 conn(0x561bc1c39e40 msgr2=0x561bc1e7ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:57.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1728361336 shutdown_connections 2023-08-17T17:53:57.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1728361336 wait complete. 2023-08-17T17:53:57.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.950+0000 7fdf44aacb80 20 client.8724 trim_cache size 0 max 16384 2023-08-17T17:53:57.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.966+0000 7fdf44aacb80 1 Processor -- start 2023-08-17T17:53:57.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.967+0000 7fdf44aacb80 1 -- start start 2023-08-17T17:53:57.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.967+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e783f0 0x561bc1ea35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.967+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e7cc20 0x561bc1ed0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.967+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1ec58c0 0x561bc1ed1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.967+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc1e7d670 con 0x561bc1e783f0 2023-08-17T17:53:57.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.967+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc1ed1560 con 0x561bc1e7cc20 2023-08-17T17:53:57.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.967+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bc1ec4e10 con 0x561bc1ec58c0 2023-08-17T17:53:57.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.967+0000 7fdf30eb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e783f0 0x561bc1ea35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.967+0000 7fdf30eb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e783f0 0x561bc1ea35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57692/0 (socket says 172.21.15.78:57692) 2023-08-17T17:53:57.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.967+0000 7fdf30eb3700 1 -- 172.21.15.78:0/3391399758 learned_addr learned my addr 172.21.15.78:0/3391399758 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:57.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf30eb3700 1 -- 172.21.15.78:0/3391399758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1ec58c0 msgr2=0x561bc1ed1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/3391399758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1ec58c0 0x561bc1ed1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:57.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf30eb3700 1 -- 172.21.15.78:0/3391399758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e7cc20 msgr2=0x561bc1ed0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/3391399758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e7cc20 0x561bc1ed0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:57.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf30eb3700 1 -- 172.21.15.78:0/3391399758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bc1dc3480 con 0x561bc1e783f0 2023-08-17T17:53:57.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/3391399758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e783f0 0x561bc1ea35a0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fdf28000d00 tx=0x7fdf28017f90).ready entity=mon.0 client_cookie=18a5eef4093e4977 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:57.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf127fc700 1 -- 172.21.15.78:0/3391399758 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2802a040 con 0x561bc1e783f0 2023-08-17T17:53:57.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf127fc700 1 -- 172.21.15.78:0/3391399758 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2802b040 con 0x561bc1e783f0 2023-08-17T17:53:57.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf127fc700 1 -- 172.21.15.78:0/3391399758 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28000ff0 con 0x561bc1e783f0 2023-08-17T17:53:57.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf44aacb80 1 -- 172.21.15.78:0/3391399758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e783f0 msgr2=0x561bc1ea35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/3391399758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e783f0 0x561bc1ea35a0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fdf28000d00 tx=0x7fdf28017f90).stop 2023-08-17T17:53:57.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf44aacb80 1 -- 172.21.15.78:0/3391399758 shutdown_connections 2023-08-17T17:53:57.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/3391399758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1ec58c0 0x561bc1ed1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:57.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/3391399758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1e783f0 0x561bc1ea35a0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/3391399758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e7cc20 0x561bc1ed0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:57.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf44aacb80 1 -- 172.21.15.78:0/3391399758 >> 172.21.15.78:0/3391399758 conn(0x561bc1c39e40 msgr2=0x561bc1e794b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:57.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf44aacb80 1 -- 172.21.15.78:0/3391399758 shutdown_connections 2023-08-17T17:53:57.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.968+0000 7fdf44aacb80 1 -- 172.21.15.78:0/3391399758 wait complete. 2023-08-17T17:53:57.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.969+0000 7fdf44aacb80 1 -- start start 2023-08-17T17:53:57.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.969+0000 7fdf44aacb80 1 Processor -- start 2023-08-17T17:53:57.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e783f0 0x561bc1f29e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e7cc20 0x561bc1e99eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf44aacb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1ec58c0 0x561bc1f2fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc1ebfdc0 con 0x561bc1ec58c0 2023-08-17T17:53:57.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc1f30840 con 0x561bc1e783f0 2023-08-17T17:53:57.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf44aacb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bc1ebfb70 con 0x561bc1e7cc20 2023-08-17T17:53:57.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf44aacb80 10 client.0 ll_register_callbacks cb 0x561bc1e3cce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T17:53:57.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf316b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1ec58c0 0x561bc1f2fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf316b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1ec58c0 0x561bc1f2fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57700/0 (socket says 172.21.15.78:57700) 2023-08-17T17:53:57.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf316b4700 1 -- 172.21.15.78:0/1085946937 learned_addr learned my addr 172.21.15.78:0/1085946937 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:57.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf23fff700 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e7cc20 0x561bc1e99eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e783f0 0x561bc1f29e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf316b4700 1 -- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e7cc20 msgr2=0x561bc1e99eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf316b4700 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e7cc20 0x561bc1e99eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf316b4700 1 -- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e783f0 msgr2=0x561bc1f29e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:57.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf316b4700 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e783f0 0x561bc1f29e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf316b4700 1 -- 172.21.15.78:0/1085946937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561bc1c71310 con 0x561bc1ec58c0 2023-08-17T17:53:57.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf316b4700 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1ec58c0 0x561bc1f2fcb0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7fdf2400c3c0 tx=0x7fdf24015000).ready entity=mon.0 client_cookie=8c133f3656ee985 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:57.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf0affd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T17:53:57.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf0affd700 1 -- 172.21.15.78:0/1085946937 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24024070 con 0x561bc1ec58c0 2023-08-17T17:53:57.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf0affd700 1 -- 172.21.15.78:0/1085946937 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdf24000fc0 con 0x561bc1ec58c0 2023-08-17T17:53:57.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.970+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1085946937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf280176b0 con 0x561bc1ec58c0 2023-08-17T17:53:57.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf0affd700 1 -- 172.21.15.78:0/1085946937 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf24020e60 con 0x561bc1ec58c0 2023-08-17T17:53:57.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf44aacb80 10 client.8730 fetch_fsmap learned FSMap version 55 2023-08-17T17:53:57.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1085946937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x561bc1dc31d0 con 0x561bc1ec58c0 2023-08-17T17:53:57.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf0affd700 1 -- 172.21.15.78:0/1085946937 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf280176b0 con 0x561bc1ec58c0 2023-08-17T17:53:57.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf0affd700 1 -- 172.21.15.78:0/1085946937 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 55) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf2400cb50 con 0x561bc1ec58c0 2023-08-17T17:53:57.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf44aacb80 10 client.8730 fetch_fsmap finished waiting for FSMap version 55 2023-08-17T17:53:57.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf44aacb80 10 client.8730 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-17T17:53:57.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf44aacb80 20 client.8730 populate_metadata read hostname 'smithi078' 2023-08-17T17:53:57.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:6833/1383305491,v1:172.21.15.150:6835/1383305491] conn(0x561bc1ec05c0 0x561bc1ec09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:57.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf44aacb80 4 client.8730 mds_command: new command op to 8565 tid=0[{"prefix": "status"}] 2023-08-17T17:53:57.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1085946937 --> [v2:172.21.15.150:6833/1383305491,v1:172.21.15.150:6835/1383305491] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561bc1c35ca0 con 0x561bc1ec05c0 2023-08-17T17:53:57.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:6833/1383305491,v1:172.21.15.150:6835/1383305491] conn(0x561bc1ec05c0 0x561bc1ec09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:57.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf0affd700 10 client.8730 ms_handle_connect on v2:172.21.15.150:6833/1383305491 2023-08-17T17:53:57.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.971+0000 7fdf30eb3700 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:6833/1383305491,v1:172.21.15.150:6835/1383305491] conn(0x561bc1ec05c0 0x561bc1ec09a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=749b24f918c5dad4 server_cookie=5382b3af85bc1b7d in_seq=0 out_seq=0 2023-08-17T17:53:57.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf0affd700 1 -- 172.21.15.78:0/1085946937 <== mds.0 v2:172.21.15.150:6833/1383305491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x561bc1c35ca0 con 0x561bc1ec05c0 2023-08-17T17:53:57.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf0affd700 10 client.8730 handle_command_reply: tid=0 2023-08-17T17:53:57.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 client.8730 shutdown 2023-08-17T17:53:57.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1085946937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1ec58c0 msgr2=0x561bc1f2fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1ec58c0 0x561bc1f2fcb0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7fdf2400c3c0 tx=0x7fdf24015000).stop 2023-08-17T17:53:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1085946937 shutdown_connections 2023-08-17T17:53:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:6833/1383305491,v1:172.21.15.150:6835/1383305491] conn(0x561bc1ec05c0 0x561bc1ec09a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bc1ec58c0 0x561bc1f2fcb0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bc1e783f0 0x561bc1f29e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 --2- 172.21.15.78:0/1085946937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561bc1e7cc20 0x561bc1e99eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf0affd700 0 client.8730 ms_handle_reset on v2:172.21.15.150:6833/1383305491 2023-08-17T17:53:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1085946937 >> 172.21.15.78:0/1085946937 conn(0x561bc1c39e40 msgr2=0x561bc1ed0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1085946937 shutdown_connections 2023-08-17T17:53:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 1 -- 172.21.15.78:0/1085946937 wait complete. 2023-08-17T17:53:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf44aacb80 20 client.8730 trim_cache size 0 max 16384 2023-08-17T17:53:57.983 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T17:53:57.983 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T17:53:57.983 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T17:53:57.984 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 8565, 2023-08-17T17:53:57.984 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T17:53:57.984 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T17:53:57.984 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T17:53:57.984 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 9.0820386079999995, 2023-08-17T17:53:57.984 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 55, 2023-08-17T17:53:57.984 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 149, 2023-08-17T17:53:57.985 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 149, 2023-08-17T17:53:57.985 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 13.589255614000001 2023-08-17T17:53:57.985 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T17:53:57.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf33117700 1 -- 172.21.15.78:0/721743540 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf1805ed90 msgr2=0x7fdf18061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf33117700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf1805ed90 0x7fdf18061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdf28000e50 tx=0x7fdf280078d0).stop 2023-08-17T17:53:57.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf33117700 1 -- 172.21.15.78:0/721743540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf2c0c4bd0 msgr2=0x7fdf2c0a8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:57.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf33117700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf2c0c4bd0 0x7fdf2c0a8e20 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7fdf1c010960 tx=0x7fdf1c008040).stop 2023-08-17T17:53:57.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.972+0000 7fdf33117700 1 -- 172.21.15.78:0/721743540 shutdown_connections 2023-08-17T17:53:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.973+0000 7fdf33117700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fdf1805ed90 0x7fdf18061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.973+0000 7fdf33117700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf2c0af930 0x7fdf2c0c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.973+0000 7fdf33117700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2c0af550 0x7fdf2c0a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.973+0000 7fdf33117700 1 --2- 172.21.15.78:0/721743540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf2c0c4bd0 0x7fdf2c0a8e20 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.973+0000 7fdf33117700 1 -- 172.21.15.78:0/721743540 >> 172.21.15.78:0/721743540 conn(0x7fdf2c06a400 msgr2=0x7fdf2c063b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.973+0000 7fdf33117700 1 -- 172.21.15.78:0/721743540 shutdown_connections 2023-08-17T17:53:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:57.973+0000 7fdf33117700 1 -- 172.21.15.78:0/721743540 wait complete. 2023-08-17T17:53:57.988 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T17:53:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.089+0000 7f5cbd67a700 1 Processor -- start 2023-08-17T17:53:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.089+0000 7f5cbd67a700 1 -- start start 2023-08-17T17:53:58.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.089+0000 7f5cbd67a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5cb8154340 0x7f5cb8154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:58.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.089+0000 7f5cbd67a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5cb80c1be0 0x7f5cb80c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:58.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cbd67a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb80624e0 con 0x7f5cb806b410 2023-08-17T17:53:58.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cbd67a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb80627c0 con 0x7f5cb80c1be0 2023-08-17T17:53:58.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cbd67a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb8069260 con 0x7f5cb8154340 2023-08-17T17:53:58.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5cb80c1be0 0x7f5cb80c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:58.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb67fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5cb806b410 0x7f5cb8068a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41202/0 (socket says 172.21.15.78:41202) 2023-08-17T17:53:58.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb67fc700 1 -- 172.21.15.78:0/3367889371 learned_addr learned my addr 172.21.15.78:0/3367889371 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:58.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb6ffd700 1 --2- 172.21.15.78:0/3367889371 >> v2:172.21.15.150:3300/0 conn(0x7f5cb8154340 0x7f5cb8154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:58.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb77fe700 1 -- 172.21.15.78:0/3367889371 >> v2:172.21.15.150:3300/0 conn(0x7f5cb8154340 msgr2=0x7f5cb8154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:58.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb77fe700 1 --2- 172.21.15.78:0/3367889371 >> v2:172.21.15.150:3300/0 conn(0x7f5cb8154340 0x7f5cb8154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:58.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb77fe700 1 -- 172.21.15.78:0/3367889371 >> v1:172.21.15.78:6789/0 conn(0x7f5cb806b410 legacy=0x7f5cb8068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:58.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb5ffb700 1 -- 172.21.15.78:0/3367889371 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373886292 0 0) 0x7f5cb80624e0 con 0x7f5cb806b410 2023-08-17T17:53:58.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb77fe700 1 -- 172.21.15.78:0/3367889371 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8069540 con 0x7f5cb80c1be0 2023-08-17T17:53:58.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb77fe700 1 --2- 172.21.15.78:0/3367889371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 0x7f5cb80c2090 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f5cb0009e60 tx=0x7f5cb0009780).ready entity=mon.0 client_cookie=d790d5a46d345ca8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:58.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb5ffb700 1 -- 172.21.15.78:0/3367889371 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb000e070 con 0x7f5cb80c1be0 2023-08-17T17:53:58.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb5ffb700 1 -- 172.21.15.78:0/3367889371 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb000bb20 con 0x7f5cb80c1be0 2023-08-17T17:53:58.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.090+0000 7f5cb5ffb700 1 -- 172.21.15.78:0/3367889371 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb000bea0 con 0x7f5cb80c1be0 2023-08-17T17:53:58.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.091+0000 7f5cbd67a700 1 -- 172.21.15.78:0/3367889371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 msgr2=0x7f5cb80c2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:58.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.091+0000 7f5cbd67a700 1 --2- 172.21.15.78:0/3367889371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 0x7f5cb80c2090 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f5cb0009e60 tx=0x7f5cb0009780).stop 2023-08-17T17:53:58.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.091+0000 7f5cbd67a700 1 -- 172.21.15.78:0/3367889371 shutdown_connections 2023-08-17T17:53:58.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.091+0000 7f5cbd67a700 1 --2- 172.21.15.78:0/3367889371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 0x7f5cb80c2090 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:58.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.091+0000 7f5cbd67a700 1 --2- 172.21.15.78:0/3367889371 >> v2:172.21.15.150:3300/0 conn(0x7f5cb8154340 0x7f5cb8154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:58.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.091+0000 7f5cbd67a700 1 -- 172.21.15.78:0/3367889371 >> 172.21.15.78:0/3367889371 conn(0x7f5cb80c4980 msgr2=0x7f5cb80663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:58.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.091+0000 7f5cbd67a700 1 -- 172.21.15.78:0/3367889371 shutdown_connections 2023-08-17T17:53:58.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.091+0000 7f5cbd67a700 1 -- 172.21.15.78:0/3367889371 wait complete. 2023-08-17T17:53:58.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.092+0000 7f5cbd67a700 1 Processor -- start 2023-08-17T17:53:58.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.092+0000 7f5cbd67a700 1 -- start start 2023-08-17T17:53:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cbd67a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cb806b410 0x7f5cb80a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cbd67a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 0x7f5cb80a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cbd67a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cb8154340 0x7f5cb8147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cbd67a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80a5ba0 con 0x7f5cb80c1be0 2023-08-17T17:53:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cbd67a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80a5e40 con 0x7f5cb806b410 2023-08-17T17:53:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cbd67a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80a6120 con 0x7f5cb8154340 2023-08-17T17:53:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 0x7f5cb80a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 0x7f5cb80a73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57706/0 (socket says 172.21.15.78:57706) 2023-08-17T17:53:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb67fc700 1 -- 172.21.15.78:0/4222831850 learned_addr learned my addr 172.21.15.78:0/4222831850 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb6ffd700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cb806b410 0x7f5cb80a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb77fe700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cb8154340 0x7f5cb8147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb67fc700 1 -- 172.21.15.78:0/4222831850 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cb8154340 msgr2=0x7f5cb8147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb67fc700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cb8154340 0x7f5cb8147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb67fc700 1 -- 172.21.15.78:0/4222831850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cb806b410 msgr2=0x7f5cb80a66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb67fc700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cb806b410 0x7f5cb80a66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb67fc700 1 -- 172.21.15.78:0/4222831850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb0009a20 con 0x7f5cb80c1be0 2023-08-17T17:53:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5cb67fc700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 0x7f5cb80a73e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f5cac00c440 tx=0x7f5cac007cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.093+0000 7f5c9effd700 1 -- 172.21.15.78:0/4222831850 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac00ce40 con 0x7f5cb80c1be0 2023-08-17T17:53:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.094+0000 7f5c9effd700 1 -- 172.21.15.78:0/4222831850 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac001e90 con 0x7f5cb80c1be0 2023-08-17T17:53:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.094+0000 7f5cbd67a700 1 -- 172.21.15.78:0/4222831850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb80a6400 con 0x7f5cb80c1be0 2023-08-17T17:53:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.094+0000 7f5c9effd700 1 -- 172.21.15.78:0/4222831850 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac007510 con 0x7f5cb80c1be0 2023-08-17T17:53:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.094+0000 7f5cbd67a700 1 -- 172.21.15.78:0/4222831850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb80a4d00 con 0x7f5cb80c1be0 2023-08-17T17:53:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.094+0000 7f5cbd67a700 1 -- 172.21.15.78:0/4222831850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb80ab720 con 0x7f5cb80c1be0 2023-08-17T17:53:58.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.095+0000 7f5c9effd700 1 -- 172.21.15.78:0/4222831850 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5cac01b070 con 0x7f5cb80c1be0 2023-08-17T17:53:58.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.095+0000 7f5c9effd700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ca405ed90 0x7f5ca4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:58.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.095+0000 7f5c9effd700 1 -- 172.21.15.78:0/4222831850 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5cac078f10 con 0x7f5cb80c1be0 2023-08-17T17:53:58.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.095+0000 7f5cb6ffd700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ca405ed90 0x7f5ca4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:58.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.096+0000 7f5cb6ffd700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ca405ed90 0x7f5ca4061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5ca8009b90 tx=0x7f5ca8009060).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:58.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.099+0000 7f5c9effd700 1 -- 172.21.15.78:0/4222831850 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5cb80ab720 con 0x7f5cb80c1be0 2023-08-17T17:53:58.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.302+0000 7f5cbd67a700 1 -- 172.21.15.78:0/4222831850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5cb80ab720 con 0x7f5cb80c1be0 2023-08-17T17:53:58.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.303+0000 7f5c9effd700 1 -- 172.21.15.78:0/4222831850 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5cb80ab720 con 0x7f5cb80c1be0 2023-08-17T17:53:58.304 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T17:53:58.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.304+0000 7f5cbd67a700 1 -- 172.21.15.78:0/4222831850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ca405ed90 msgr2=0x7f5ca4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:58.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.304+0000 7f5cbd67a700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ca405ed90 0x7f5ca4061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5ca8009b90 tx=0x7f5ca8009060).stop 2023-08-17T17:53:58.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.304+0000 7f5cbd67a700 1 -- 172.21.15.78:0/4222831850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 msgr2=0x7f5cb80a73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:58.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.304+0000 7f5cbd67a700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 0x7f5cb80a73e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f5cac00c440 tx=0x7f5cac007cd0).stop 2023-08-17T17:53:58.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.305+0000 7f5cbd67a700 1 -- 172.21.15.78:0/4222831850 shutdown_connections 2023-08-17T17:53:58.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.305+0000 7f5cbd67a700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f5ca405ed90 0x7f5ca4061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:58.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.305+0000 7f5cbd67a700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cb8154340 0x7f5cb8147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:58.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.305+0000 7f5cbd67a700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cb806b410 0x7f5cb80a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:58.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.305+0000 7f5cbd67a700 1 --2- 172.21.15.78:0/4222831850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb80c1be0 0x7f5cb80a73e0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:58.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.305+0000 7f5cbd67a700 1 -- 172.21.15.78:0/4222831850 >> 172.21.15.78:0/4222831850 conn(0x7f5cb80c4980 msgr2=0x7f5cb80c27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:58.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.305+0000 7f5cbd67a700 1 -- 172.21.15.78:0/4222831850 shutdown_connections 2023-08-17T17:53:58.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:58.305+0000 7f5cbd67a700 1 -- 172.21.15.78:0/4222831850 wait complete. 2023-08-17T17:53:58.316 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T17:53:58.317 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T17:53:58.317 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T17:53:58.317 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T17:53:58.317 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T17:53:58.318 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T17:53:58.318 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T17:53:58.318 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T17:53:58.318 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:53:58.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:58.319 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T17:53:58.334 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T17:53:58.334 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T17:53:58.334 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T17:53:58.334 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:58.334 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T17:53:58.334 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:58.335 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:53:58.335 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:53:58.335 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T17:53:58.335 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:53:58.335 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:53:58.335 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T17:53:58.335 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T17:53:58.335 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T17:53:58.336 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T17:53:58.336 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T17:53:58.336 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T17:53:58.336 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 41041sec preferred_lft 41041sec 2023-08-17T17:53:58.336 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T17:53:58.336 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:58.336 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T17:53:58.337 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff 2023-08-17T17:53:58.337 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T17:53:58.337 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:58.337 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T17:53:58.337 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:58.337 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:53:58.337 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T17:53:58.337 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link 2023-08-17T17:53:58.338 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:58.338 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T17:53:58.338 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T17:53:58.338 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::54:39ff:fe93:1c36/64 scope link 2023-08-17T17:53:58.338 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T17:53:58.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:58.339 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T17:53:58.396 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T17:53:58.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:58.398 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T17:53:58.453 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T17:53:58.453 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T17:53:58.453 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T17:53:58.453 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T17:53:58.454 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T17:53:58.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:58.454 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T17:53:58.455 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T17:53:58.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T17:53:58.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T17:53:58.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T17:53:58.456 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T17:53:58.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:58.553 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T17:53:58.567 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T17:53:58.568 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T17:53:58.568 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T17:53:58.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:58.569 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T17:53:58.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:58.632 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T17:53:58.686 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T17:53:58.686 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:53:58.764 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:53:58.764 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:53:58.790 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T17:53:58.790 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T17:53:58.791 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T17:53:58.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T17:53:58.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T17:53:58.856 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-17T17:53:59.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.009+0000 7fbae575f700 1 Processor -- start 2023-08-17T17:53:59.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.009+0000 7fbae575f700 1 -- start start 2023-08-17T17:53:59.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.010+0000 7fbae575f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbae01541a0 0x7fbae00a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.010+0000 7fbae575f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbae00c0560 0x7fbae00c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.010+0000 7fbae575f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae00c8df0 con 0x7fbae0154580 2023-08-17T17:53:59.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.010+0000 7fbae575f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00a8190 con 0x7fbae00c0560 2023-08-17T17:53:59.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.010+0000 7fbae575f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00c9970 con 0x7fbae01541a0 2023-08-17T17:53:59.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.010+0000 7fbadf7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbae00c0560 0x7fbae00c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:59.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.010+0000 7fbadf7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbae00c0560 0x7fbae00c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40802/0 (socket says 172.21.15.78:40802) 2023-08-17T17:53:59.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.010+0000 7fbadf7fe700 1 -- 172.21.15.78:0/3842638276 learned_addr learned my addr 172.21.15.78:0/3842638276 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:59.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.010+0000 7fbadeffd700 1 --2- 172.21.15.78:0/3842638276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbae01541a0 0x7fbae00a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:59.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbadf7fe700 1 -- 172.21.15.78:0/3842638276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbae01541a0 msgr2=0x7fbae00a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:59.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbadf7fe700 1 --2- 172.21.15.78:0/3842638276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbae01541a0 0x7fbae00a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbadf7fe700 1 -- 172.21.15.78:0/3842638276 >> v1:172.21.15.150:6789/0 conn(0x7fbae0154580 legacy=0x7fbae00bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbadf7fe700 1 -- 172.21.15.78:0/3842638276 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae00c9040 con 0x7fbae00c0560 2023-08-17T17:53:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbadf7fe700 1 --2- 172.21.15.78:0/3842638276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 0x7fbae00c6f80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7fbad8009f20 tx=0x7fbad8009840).ready entity=mon.0 client_cookie=908aa6fd3b8a1bf0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbade7fc700 1 -- 172.21.15.78:0/3842638276 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800e070 con 0x7fbae00c0560 2023-08-17T17:53:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbade7fc700 1 -- 172.21.15.78:0/3842638276 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800ba80 con 0x7fbae00c0560 2023-08-17T17:53:59.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbade7fc700 1 -- 172.21.15.78:0/3842638276 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800be00 con 0x7fbae00c0560 2023-08-17T17:53:59.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbae575f700 1 -- 172.21.15.78:0/3842638276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 msgr2=0x7fbae00c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbae575f700 1 --2- 172.21.15.78:0/3842638276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 0x7fbae00c6f80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7fbad8009f20 tx=0x7fbad8009840).stop 2023-08-17T17:53:59.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbae575f700 1 -- 172.21.15.78:0/3842638276 shutdown_connections 2023-08-17T17:53:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbae575f700 1 --2- 172.21.15.78:0/3842638276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 0x7fbae00c6f80 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbae575f700 1 --2- 172.21.15.78:0/3842638276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbae01541a0 0x7fbae00a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbae575f700 1 -- 172.21.15.78:0/3842638276 >> 172.21.15.78:0/3842638276 conn(0x7fbae006a400 msgr2=0x7fbae00caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbae575f700 1 -- 172.21.15.78:0/3842638276 shutdown_connections 2023-08-17T17:53:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.011+0000 7fbae575f700 1 -- 172.21.15.78:0/3842638276 wait complete. 2023-08-17T17:53:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.013+0000 7fbae575f700 1 Processor -- start 2023-08-17T17:53:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.013+0000 7fbae575f700 1 -- start start 2023-08-17T17:53:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.013+0000 7fbae575f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 0x7fbae014d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.013+0000 7fbae575f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbae01541a0 0x7fbae01655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.013+0000 7fbae575f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbae0154580 0x7fbae015a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.013+0000 7fbae575f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae015ac80 con 0x7fbae00c0560 2023-08-17T17:53:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.013+0000 7fbae575f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae0158860 con 0x7fbae0154580 2023-08-17T17:53:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.013+0000 7fbae575f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae0157f70 con 0x7fbae01541a0 2023-08-17T17:53:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbadeffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 0x7fbae014d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbadeffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 0x7fbae014d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40814/0 (socket says 172.21.15.78:40814) 2023-08-17T17:53:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbadeffd700 1 -- 172.21.15.78:0/172827173 learned_addr learned my addr 172.21.15.78:0/172827173 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbadeffd700 1 -- 172.21.15.78:0/172827173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbae01541a0 msgr2=0x7fbae01655b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbadeffd700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbae01541a0 0x7fbae01655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbadeffd700 1 -- 172.21.15.78:0/172827173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbae0154580 msgr2=0x7fbae015a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbadeffd700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbae0154580 0x7fbae015a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbadeffd700 1 -- 172.21.15.78:0/172827173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad8009ae0 con 0x7fbae00c0560 2023-08-17T17:53:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbadeffd700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 0x7fbae014d430 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fbad000d860 tx=0x7fbad0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbad77fe700 1 -- 172.21.15.78:0/172827173 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0011590 con 0x7fbae00c0560 2023-08-17T17:53:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbad77fe700 1 -- 172.21.15.78:0/172827173 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad00116f0 con 0x7fbae00c0560 2023-08-17T17:53:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbae575f700 1 -- 172.21.15.78:0/172827173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae0158210 con 0x7fbae00c0560 2023-08-17T17:53:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbad77fe700 1 -- 172.21.15.78:0/172827173 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0011a70 con 0x7fbae00c0560 2023-08-17T17:53:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.014+0000 7fbae575f700 1 -- 172.21.15.78:0/172827173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae00c46f0 con 0x7fbae00c0560 2023-08-17T17:53:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.015+0000 7fbae575f700 1 -- 172.21.15.78:0/172827173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae0047350 con 0x7fbae00c0560 2023-08-17T17:53:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.015+0000 7fbad77fe700 1 -- 172.21.15.78:0/172827173 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbad0012420 con 0x7fbae00c0560 2023-08-17T17:53:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.016+0000 7fbad77fe700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbac005ed60 0x7fbac0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.016+0000 7fbad77fe700 1 -- 172.21.15.78:0/172827173 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbad00796f0 con 0x7fbae00c0560 2023-08-17T17:53:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.016+0000 7fbad67fc700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbac005ed60 0x7fbac0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.016+0000 7fbad67fc700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbac005ed60 0x7fbac0061220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fbae00c33c0 tx=0x7fbac8007980).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.020+0000 7fbad77fe700 1 -- 172.21.15.78:0/172827173 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbad004ac30 con 0x7fbae00c0560 2023-08-17T17:53:59.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.209+0000 7fbae575f700 1 -- 172.21.15.78:0/172827173 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbae015aa20 con 0x7fbac005ed60 2023-08-17T17:53:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.211+0000 7fbad77fe700 1 -- 172.21.15.78:0/172827173 <== mgr.8364 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fbae015aa20 con 0x7fbac005ed60 2023-08-17T17:53:59.212 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T17:53:59.212 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T17:53:59.212 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephfs" 2023-08-17T17:53:59.212 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T17:53:59.212 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T17:53:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.212+0000 7fbae575f700 1 -- 172.21.15.78:0/172827173 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbac005ed60 msgr2=0x7fbac0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.212+0000 7fbae575f700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbac005ed60 0x7fbac0061220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fbae00c33c0 tx=0x7fbac8007980).stop 2023-08-17T17:53:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.212+0000 7fbae575f700 1 -- 172.21.15.78:0/172827173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 msgr2=0x7fbae014d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.212+0000 7fbae575f700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 0x7fbae014d430 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fbad000d860 tx=0x7fbad0008040).stop 2023-08-17T17:53:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.212+0000 7fbae575f700 1 -- 172.21.15.78:0/172827173 shutdown_connections 2023-08-17T17:53:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.212+0000 7fbae575f700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7fbac005ed60 0x7fbac0061220 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.212+0000 7fbae575f700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbae0154580 0x7fbae015a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.212+0000 7fbae575f700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbae00c0560 0x7fbae014d430 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.212+0000 7fbae575f700 1 --2- 172.21.15.78:0/172827173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbae01541a0 0x7fbae01655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:53:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.213+0000 7fbae575f700 1 -- 172.21.15.78:0/172827173 >> 172.21.15.78:0/172827173 conn(0x7fbae006a400 msgr2=0x7fbae0063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.213+0000 7fbae575f700 1 -- 172.21.15.78:0/172827173 shutdown_connections 2023-08-17T17:53:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.213+0000 7fbae575f700 1 -- 172.21.15.78:0/172827173 wait complete. 2023-08-17T17:53:59.226 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-17T17:53:59.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.338+0000 7f66dca79700 1 Processor -- start 2023-08-17T17:53:59.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.338+0000 7f66dca79700 1 -- start start 2023-08-17T17:53:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66dca79700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f66d80aa0f0 0x7f66d80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66dca79700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f66d80c5810 0x7f66d80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66dca79700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d80649b0 con 0x7f66d80aa4d0 2023-08-17T17:53:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66dca79700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d80c6170 con 0x7f66d80c5810 2023-08-17T17:53:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66dca79700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d8063420 con 0x7f66d80aa0f0 2023-08-17T17:53:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66d6d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f66d80c5810 0x7f66d80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66d5d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f66d80aa4d0 0x7f66d80c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41532/0 (socket says 172.21.15.78:41532) 2023-08-17T17:53:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66d5d9b700 1 -- 172.21.15.78:0/3192486776 learned_addr learned my addr 172.21.15.78:0/3192486776 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:53:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66d659c700 1 --2- 172.21.15.78:0/3192486776 >> v2:172.21.15.150:3300/0 conn(0x7f66d80aa0f0 0x7f66d80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66d6d9d700 1 -- 172.21.15.78:0/3192486776 >> v2:172.21.15.150:3300/0 conn(0x7f66d80aa0f0 msgr2=0x7f66d80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:53:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66d6d9d700 1 --2- 172.21.15.78:0/3192486776 >> v2:172.21.15.150:3300/0 conn(0x7f66d80aa0f0 0x7f66d80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66d6d9d700 1 -- 172.21.15.78:0/3192486776 >> v1:172.21.15.78:6789/0 conn(0x7f66d80aa4d0 legacy=0x7f66d80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66d559a700 1 -- 172.21.15.78:0/3192486776 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831358841 0 0) 0x7f66d80649b0 con 0x7f66d80aa4d0 2023-08-17T17:53:59.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66d6d9d700 1 -- 172.21.15.78:0/3192486776 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d8063700 con 0x7f66d80c5810 2023-08-17T17:53:59.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.339+0000 7f66d659c700 1 --2- 172.21.15.78:0/3192486776 >> v2:172.21.15.150:3300/0 conn(0x7f66d80aa0f0 0x7f66d80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T17:53:59.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66d6d9d700 1 --2- 172.21.15.78:0/3192486776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 0x7f66d80c5c80 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f66d80cade0 tx=0x7f66d0009780).ready entity=mon.0 client_cookie=72ce4eafc1e88ce2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:59.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66d559a700 1 -- 172.21.15.78:0/3192486776 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d000e070 con 0x7f66d80c5810 2023-08-17T17:53:59.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66d559a700 1 -- 172.21.15.78:0/3192486776 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d000bc30 con 0x7f66d80c5810 2023-08-17T17:53:59.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66d559a700 1 -- 172.21.15.78:0/3192486776 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0012410 con 0x7f66d80c5810 2023-08-17T17:53:59.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66dca79700 1 -- 172.21.15.78:0/3192486776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 msgr2=0x7f66d80c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66dca79700 1 --2- 172.21.15.78:0/3192486776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 0x7f66d80c5c80 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f66d80cade0 tx=0x7f66d0009780).stop 2023-08-17T17:53:59.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66dca79700 1 -- 172.21.15.78:0/3192486776 shutdown_connections 2023-08-17T17:53:59.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66dca79700 1 --2- 172.21.15.78:0/3192486776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 0x7f66d80c5c80 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66dca79700 1 --2- 172.21.15.78:0/3192486776 >> v2:172.21.15.150:3300/0 conn(0x7f66d80aa0f0 0x7f66d80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66dca79700 1 -- 172.21.15.78:0/3192486776 >> 172.21.15.78:0/3192486776 conn(0x7f66d806a6a0 msgr2=0x7f66d80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:59.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66dca79700 1 -- 172.21.15.78:0/3192486776 shutdown_connections 2023-08-17T17:53:59.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.340+0000 7f66dca79700 1 -- 172.21.15.78:0/3192486776 wait complete. 2023-08-17T17:53:59.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.341+0000 7f66dca79700 1 Processor -- start 2023-08-17T17:53:59.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.341+0000 7f66dca79700 1 -- start start 2023-08-17T17:53:59.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66dca79700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66d80aa0f0 0x7f66d8157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66dca79700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80aa4d0 0x7f66d8151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66dca79700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 0x7f66d80c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66dca79700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80ad310 con 0x7f66d80c5810 2023-08-17T17:53:59.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66dca79700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80ac740 con 0x7f66d80aa0f0 2023-08-17T17:53:59.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66dca79700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80ac9e0 con 0x7f66d80aa4d0 2023-08-17T17:53:59.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66d6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 0x7f66d80c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:59.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66d6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 0x7f66d80c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40828/0 (socket says 172.21.15.78:40828) 2023-08-17T17:53:59.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66d6d9d700 1 -- 172.21.15.78:0/3015901040 learned_addr learned my addr 172.21.15.78:0/3015901040 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:53:59.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66d659c700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66d80aa0f0 0x7f66d8157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:59.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.342+0000 7f66d5d9b700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80aa4d0 0x7f66d8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:59.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66d6d9d700 1 -- 172.21.15.78:0/3015901040 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80aa4d0 msgr2=0x7f66d8151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66d6d9d700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80aa4d0 0x7f66d8151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66d6d9d700 1 -- 172.21.15.78:0/3015901040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66d80aa0f0 msgr2=0x7f66d8157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66d6d9d700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66d80aa0f0 0x7f66d8157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66d6d9d700 1 -- 172.21.15.78:0/3015901040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d0009a20 con 0x7f66d80c5810 2023-08-17T17:53:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66d6d9d700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 0x7f66d80c9c90 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f66d805e180 tx=0x7f66d0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66c67fc700 1 -- 172.21.15.78:0/3015901040 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d00117d0 con 0x7f66d80c5810 2023-08-17T17:53:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66c67fc700 1 -- 172.21.15.78:0/3015901040 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d0011930 con 0x7f66d80c5810 2023-08-17T17:53:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66dca79700 1 -- 172.21.15.78:0/3015901040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d80accc0 con 0x7f66d80c5810 2023-08-17T17:53:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66c67fc700 1 -- 172.21.15.78:0/3015901040 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0011cf0 con 0x7f66d80c5810 2023-08-17T17:53:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.343+0000 7f66dca79700 1 -- 172.21.15.78:0/3015901040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d80ad7a0 con 0x7f66d80c5810 2023-08-17T17:53:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.344+0000 7f66dca79700 1 -- 172.21.15.78:0/3015901040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d80ad480 con 0x7f66d80c5810 2023-08-17T17:53:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.344+0000 7f66c67fc700 1 -- 172.21.15.78:0/3015901040 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 64) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f66d001d630 con 0x7f66d80c5810 2023-08-17T17:53:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.344+0000 7f66c67fc700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f66b805ed90 0x7f66b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:53:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.345+0000 7f66c67fc700 1 -- 172.21.15.78:0/3015901040 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f66d007bfa0 con 0x7f66d80c5810 2023-08-17T17:53:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.345+0000 7f66d659c700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f66b805ed90 0x7f66b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:53:59.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.345+0000 7f66d659c700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f66b805ed90 0x7f66b8061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f66c80088c0 tx=0x7f66c8008040).ready entity=mgr.8364 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:53:59.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.349+0000 7f66c67fc700 1 -- 172.21.15.78:0/3015901040 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f66d004d540 con 0x7f66d80c5810 2023-08-17T17:53:59.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.556+0000 7f66dca79700 1 -- 172.21.15.78:0/3015901040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f66d8046af0 con 0x7f66d80c5810 2023-08-17T17:53:59.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.921+0000 7f66c67fc700 1 -- 172.21.15.78:0/3015901040 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 65) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f66d0079ea0 con 0x7f66d80c5810 2023-08-17T17:53:59.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.922+0000 7f66c67fc700 1 -- 172.21.15.78:0/3015901040 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v65) v1 ==== 92+0+0 (secure 0 0 0) 0x7f66d0043490 con 0x7f66d80c5810 2023-08-17T17:53:59.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 -- 172.21.15.78:0/3015901040 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f66b805ed90 msgr2=0x7f66b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f66b805ed90 0x7f66b8061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f66c80088c0 tx=0x7f66c8008040).stop 2023-08-17T17:53:59.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 -- 172.21.15.78:0/3015901040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 msgr2=0x7f66d80c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:53:59.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 0x7f66d80c9c90 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f66d805e180 tx=0x7f66d0009780).stop 2023-08-17T17:53:59.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 -- 172.21.15.78:0/3015901040 shutdown_connections 2023-08-17T17:53:59.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f66b805ed90 0x7f66b8061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d80c5810 0x7f66d80c9c90 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66d80aa0f0 0x7f66d8157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 --2- 172.21.15.78:0/3015901040 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80aa4d0 0x7f66d8151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:53:59.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 -- 172.21.15.78:0/3015901040 >> 172.21.15.78:0/3015901040 conn(0x7f66d806a6a0 msgr2=0x7f66d80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:53:59.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 -- 172.21.15.78:0/3015901040 shutdown_connections 2023-08-17T17:53:59.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:53:59.924+0000 7f66dca79700 1 -- 172.21.15.78:0/3015901040 wait complete. 2023-08-17T17:53:59.938 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-17T17:54:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.056+0000 7f026b3b5700 1 Processor -- start 2023-08-17T17:54:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.057+0000 7f026b3b5700 1 -- start start 2023-08-17T17:54:00.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f026b3b5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f026413bc70 0x7f02641563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f026b3b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 0x7f02640bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f026b3b5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02640a5a20 con 0x7f026413b890 2023-08-17T17:54:00.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f026b3b5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02640c32d0 con 0x7f026413bc70 2023-08-17T17:54:00.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f026b3b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02640c3570 con 0x7f02641568d0 2023-08-17T17:54:00.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f0268950700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f026413bc70 0x7f02641563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f0269952700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 0x7f02640bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f0269151700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f026413b890 0x7f0264155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:45714/0 (socket says 172.21.15.78:45714) 2023-08-17T17:54:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f0269151700 1 -- 172.21.15.78:0/1034126271 learned_addr learned my addr 172.21.15.78:0/1034126271 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:54:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f0268950700 1 -- 172.21.15.78:0/1034126271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 msgr2=0x7f02640bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:54:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f0268950700 1 --2- 172.21.15.78:0/1034126271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 0x7f02640bdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f0268950700 1 -- 172.21.15.78:0/1034126271 >> v1:172.21.15.150:6789/0 conn(0x7f026413b890 legacy=0x7f0264155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f0268950700 1 -- 172.21.15.78:0/1034126271 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02640bfad0 con 0x7f026413bc70 2023-08-17T17:54:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f025bfff700 1 -- 172.21.15.78:0/1034126271 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319116376 0 0) 0x7f02640a5a20 con 0x7f026413b890 2023-08-17T17:54:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f0269952700 1 --2- 172.21.15.78:0/1034126271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 0x7f02640bdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T17:54:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.058+0000 7f0268950700 1 --2- 172.21.15.78:0/1034126271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f026413bc70 0x7f02641563e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f0260009760 tx=0x7f0260009060).ready entity=mon.1 client_cookie=532cec4b07e80a98 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:54:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f025bfff700 1 -- 172.21.15.78:0/1034126271 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000f510 con 0x7f026413bc70 2023-08-17T17:54:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f025bfff700 1 -- 172.21.15.78:0/1034126271 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000f670 con 0x7f026413bc70 2023-08-17T17:54:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f025bfff700 1 -- 172.21.15.78:0/1034126271 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000f9f0 con 0x7f026413bc70 2023-08-17T17:54:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f026b3b5700 1 -- 172.21.15.78:0/1034126271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f026413bc70 msgr2=0x7f02641563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f026b3b5700 1 --2- 172.21.15.78:0/1034126271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f026413bc70 0x7f02641563e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f0260009760 tx=0x7f0260009060).stop 2023-08-17T17:54:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f026b3b5700 1 -- 172.21.15.78:0/1034126271 shutdown_connections 2023-08-17T17:54:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f026b3b5700 1 --2- 172.21.15.78:0/1034126271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 0x7f02640bdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f026b3b5700 1 --2- 172.21.15.78:0/1034126271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f026413bc70 0x7f02641563e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f026b3b5700 1 -- 172.21.15.78:0/1034126271 >> 172.21.15.78:0/1034126271 conn(0x7f0264062f80 msgr2=0x7f02640c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:54:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f026b3b5700 1 -- 172.21.15.78:0/1034126271 shutdown_connections 2023-08-17T17:54:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.059+0000 7f026b3b5700 1 -- 172.21.15.78:0/1034126271 wait complete. 2023-08-17T17:54:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.060+0000 7f026b3b5700 1 Processor -- start 2023-08-17T17:54:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.060+0000 7f026b3b5700 1 -- start start 2023-08-17T17:54:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.061+0000 7f026b3b5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f026413b890 0x7f0264151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.061+0000 7f026b3b5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f026413bc70 0x7f0264064e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.061+0000 7f026b3b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 0x7f0264095e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.061+0000 7f026b3b5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02640ad890 con 0x7f026413bc70 2023-08-17T17:54:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.061+0000 7f026b3b5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02640acc80 con 0x7f026413b890 2023-08-17T17:54:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.061+0000 7f026b3b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02640acf60 con 0x7f02641568d0 2023-08-17T17:54:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0268950700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f026413bc70 0x7f0264064e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0268950700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f026413bc70 0x7f0264064e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40848/0 (socket says 172.21.15.78:40848) 2023-08-17T17:54:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0268950700 1 -- 172.21.15.78:0/3459228370 learned_addr learned my addr 172.21.15.78:0/3459228370 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:54:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0269151700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f026413b890 0x7f0264151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0269952700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 0x7f0264095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0268950700 1 -- 172.21.15.78:0/3459228370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 msgr2=0x7f0264095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0268950700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 0x7f0264095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0268950700 1 -- 172.21.15.78:0/3459228370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f026413b890 msgr2=0x7f0264151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0268950700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f026413b890 0x7f0264151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0268950700 1 -- 172.21.15.78:0/3459228370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c009a20 con 0x7f026413bc70 2023-08-17T17:54:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f0268950700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f026413bc70 0x7f0264064e70 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f0260011000 tx=0x7f0260017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:54:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f02597fa700 1 -- 172.21.15.78:0/3459228370 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000f7e0 con 0x7f026413bc70 2023-08-17T17:54:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f02597fa700 1 -- 172.21.15.78:0/3459228370 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000f960 con 0x7f026413bc70 2023-08-17T17:54:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f026b3b5700 1 -- 172.21.15.78:0/3459228370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02600092a0 con 0x7f026413bc70 2023-08-17T17:54:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f02597fa700 1 -- 172.21.15.78:0/3459228370 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026001b660 con 0x7f026413bc70 2023-08-17T17:54:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.062+0000 7f026b3b5700 1 -- 172.21.15.78:0/3459228370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02640ad520 con 0x7f026413bc70 2023-08-17T17:54:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.063+0000 7f026b3b5700 1 -- 172.21.15.78:0/3459228370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02640695e0 con 0x7f026413bc70 2023-08-17T17:54:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.064+0000 7f02597fa700 1 -- 172.21.15.78:0/3459228370 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 65) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f026002c070 con 0x7f026413bc70 2023-08-17T17:54:00.069 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:00.064+0000 7f3d8e962680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:54:00.070 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:00.064+0000 7fab439c4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T17:54:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.064+0000 7f02597fa700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f024805edb0 0x7f0248061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.064+0000 7f0269151700 1 -- 172.21.15.78:0/3459228370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f024805edb0 msgr2=0x7f0248061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:54:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.064+0000 7f02597fa700 1 -- 172.21.15.78:0/3459228370 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f026007b860 con 0x7f026413bc70 2023-08-17T17:54:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.064+0000 7f0269151700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f024805edb0 0x7f0248061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:54:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.068+0000 7f02597fa700 1 -- 172.21.15.78:0/3459228370 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f026004cec0 con 0x7f026413bc70 2023-08-17T17:54:00.128 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:00.127+0000 7fab439c4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:54:00.130 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:00.130+0000 7f3d8e962680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T17:54:00.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.241+0000 7f026b3b5700 1 -- 172.21.15.78:0/3459228370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f0264065cd0 con 0x7f026413bc70 2023-08-17T17:54:00.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.245+0000 7f02597fa700 1 -- 172.21.15.78:0/3459228370 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f02600504a0 con 0x7f026413bc70 2023-08-17T17:54:00.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.246+0000 7f026b3b5700 1 -- 172.21.15.78:0/3459228370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f024805edb0 msgr2=0x7f0248061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:54:00.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.246+0000 7f026b3b5700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f024805edb0 0x7f0248061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:54:00.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.246+0000 7f026b3b5700 1 -- 172.21.15.78:0/3459228370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f026413bc70 msgr2=0x7f0264064e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:00.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.246+0000 7f026b3b5700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f026413bc70 0x7f0264064e70 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f0260011000 tx=0x7f0260017000).stop 2023-08-17T17:54:00.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.247+0000 7f026b3b5700 1 -- 172.21.15.78:0/3459228370 shutdown_connections 2023-08-17T17:54:00.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.247+0000 7f026b3b5700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f024805edb0 0x7f0248061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:54:00.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.247+0000 7f026b3b5700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02641568d0 0x7f0264095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.247+0000 7f026b3b5700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f026413b890 0x7f0264151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.247+0000 7f026b3b5700 1 --2- 172.21.15.78:0/3459228370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f026413bc70 0x7f0264064e70 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.247+0000 7f026b3b5700 1 -- 172.21.15.78:0/3459228370 >> 172.21.15.78:0/3459228370 conn(0x7f0264062f80 msgr2=0x7f0264067b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:54:00.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.247+0000 7f026b3b5700 1 -- 172.21.15.78:0/3459228370 shutdown_connections 2023-08-17T17:54:00.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.247+0000 7f026b3b5700 1 -- 172.21.15.78:0/3459228370 wait complete. 2023-08-17T17:54:00.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:54:00.260 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-17T17:54:00.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T17:54:00.278 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-08-17T17:54:00.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-17T17:54:00.405 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:00.405+0000 7fab439c4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:54:00.418 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:00.417+0000 7f3d8e962680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T17:54:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.495+0000 7f3566239700 1 Processor -- start 2023-08-17T17:54:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.496+0000 7f3566239700 1 -- start start 2023-08-17T17:54:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.496+0000 7f3566239700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f35601578f0 0x7f35600be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.496+0000 7f3566239700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3560096520 0x7f35600c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.496+0000 7f3566239700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35600c3e10 con 0x7f35600bf0e0 2023-08-17T17:54:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f3566239700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35600bf5c0 con 0x7f35601578f0 2023-08-17T17:54:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f3566239700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35600c32d0 con 0x7f3560096520 2023-08-17T17:54:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f35601578f0 0x7f35600be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355effd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f35600bf0e0 0x7f3560095e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41548/0 (socket says 172.21.15.78:41548) 2023-08-17T17:54:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355effd700 1 -- 172.21.15.78:0/804548009 learned_addr learned my addr 172.21.15.78:0/804548009 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:54:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355ffff700 1 --2- 172.21.15.78:0/804548009 >> v2:172.21.15.150:3300/0 conn(0x7f3560096520 0x7f35600c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355f7fe700 1 -- 172.21.15.78:0/804548009 >> v2:172.21.15.150:3300/0 conn(0x7f3560096520 msgr2=0x7f35600c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:54:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355f7fe700 1 --2- 172.21.15.78:0/804548009 >> v2:172.21.15.150:3300/0 conn(0x7f3560096520 0x7f35600c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355f7fe700 1 -- 172.21.15.78:0/804548009 >> v1:172.21.15.78:6789/0 conn(0x7f35600bf0e0 legacy=0x7f3560095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355e7fc700 1 -- 172.21.15.78:0/804548009 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311528205 0 0) 0x7f35600c3e10 con 0x7f35600bf0e0 2023-08-17T17:54:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355f7fe700 1 -- 172.21.15.78:0/804548009 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600c34e0 con 0x7f35601578f0 2023-08-17T17:54:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355f7fe700 1 --2- 172.21.15.78:0/804548009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35601578f0 0x7f35600be210 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7f35600bdf10 tx=0x7f3548009060).ready entity=mon.0 client_cookie=4708edcd1a45f3b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:54:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355e7fc700 1 -- 172.21.15.78:0/804548009 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35480090d0 con 0x7f35601578f0 2023-08-17T17:54:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355e7fc700 1 -- 172.21.15.78:0/804548009 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354800b580 con 0x7f35601578f0 2023-08-17T17:54:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.497+0000 7f355e7fc700 1 -- 172.21.15.78:0/804548009 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800b900 con 0x7f35601578f0 2023-08-17T17:54:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.498+0000 7f3566239700 1 -- 172.21.15.78:0/804548009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35601578f0 msgr2=0x7f35600be210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.498+0000 7f3566239700 1 --2- 172.21.15.78:0/804548009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35601578f0 0x7f35600be210 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7f35600bdf10 tx=0x7f3548009060).stop 2023-08-17T17:54:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.498+0000 7f3566239700 1 -- 172.21.15.78:0/804548009 shutdown_connections 2023-08-17T17:54:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.498+0000 7f3566239700 1 --2- 172.21.15.78:0/804548009 >> v2:172.21.15.150:3300/0 conn(0x7f3560096520 0x7f35600c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.498+0000 7f3566239700 1 --2- 172.21.15.78:0/804548009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35601578f0 0x7f35600be210 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.498+0000 7f3566239700 1 -- 172.21.15.78:0/804548009 >> 172.21.15.78:0/804548009 conn(0x7f3560062f80 msgr2=0x7f35600c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:54:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.498+0000 7f3566239700 1 -- 172.21.15.78:0/804548009 shutdown_connections 2023-08-17T17:54:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.498+0000 7f3566239700 1 -- 172.21.15.78:0/804548009 wait complete. 2023-08-17T17:54:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.499+0000 7f3566239700 1 Processor -- start 2023-08-17T17:54:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.499+0000 7f3566239700 1 -- start start 2023-08-17T17:54:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f3566239700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3560096520 0x7f35600ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f3566239700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35600bf0e0 0x7f3560156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f3566239700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35601578f0 0x7f35600abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f3566239700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560168880 con 0x7f35600bf0e0 2023-08-17T17:54:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f3566239700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600ab840 con 0x7f3560096520 2023-08-17T17:54:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f3566239700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3560167d00 con 0x7f35601578f0 2023-08-17T17:54:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f355effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35600bf0e0 0x7f3560156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f355effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35600bf0e0 0x7f3560156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40874/0 (socket says 172.21.15.78:40874) 2023-08-17T17:54:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f355effd700 1 -- 172.21.15.78:0/2159862334 learned_addr learned my addr 172.21.15.78:0/2159862334 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:54:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f355f7fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3560096520 0x7f35600ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.500+0000 7f355ffff700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35601578f0 0x7f35600abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f355effd700 1 -- 172.21.15.78:0/2159862334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35601578f0 msgr2=0x7f35600abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f355effd700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35601578f0 0x7f35600abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f355effd700 1 -- 172.21.15.78:0/2159862334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3560096520 msgr2=0x7f35600ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f355effd700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3560096520 0x7f35600ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f355effd700 1 -- 172.21.15.78:0/2159862334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35480092a0 con 0x7f35600bf0e0 2023-08-17T17:54:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f355effd700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35600bf0e0 0x7f3560156780 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f355000c510 tx=0x7f3550007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:54:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000ce20 con 0x7f35600bf0e0 2023-08-17T17:54:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35500072e0 con 0x7f35600bf0e0 2023-08-17T17:54:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f3566239700 1 -- 172.21.15.78:0/2159862334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3560167fe0 con 0x7f35600bf0e0 2023-08-17T17:54:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550007660 con 0x7f35600bf0e0 2023-08-17T17:54:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.501+0000 7f3566239700 1 -- 172.21.15.78:0/2159862334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35601685a0 con 0x7f35600bf0e0 2023-08-17T17:54:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.502+0000 7f3566239700 1 -- 172.21.15.78:0/2159862334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35600695e0 con 0x7f35600bf0e0 2023-08-17T17:54:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.502+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 65) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f355001a060 con 0x7f35600bf0e0 2023-08-17T17:54:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.503+0000 7f35577fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f35400612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.503+0000 7f355f7fe700 1 -- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 msgr2=0x7f35400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:54:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.503+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3550079240 con 0x7f35600bf0e0 2023-08-17T17:54:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.503+0000 7f355f7fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f35400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T17:54:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.507+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f355004a7e0 con 0x7f35600bf0e0 2023-08-17T17:54:00.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.703+0000 7f3566239700 1 -- 172.21.15.78:0/2159862334 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3560046af0 con 0x7f354005ede0 2023-08-17T17:54:00.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.704+0000 7f355f7fe700 1 -- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 msgr2=0x7f35400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:54:00.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:00.704+0000 7f355f7fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f35400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T17:54:01.026 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:01.019+0000 7fab439c4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:54:01.040 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:01.039+0000 7f3d8e962680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T17:54:01.092 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:01.091+0000 7fab439c4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:54:01.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:01.105+0000 7f355f7fe700 1 -- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 msgr2=0x7f35400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:54:01.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:01.105+0000 7f355f7fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f35400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T17:54:01.112 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:01.111+0000 7f3d8e962680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T17:54:01.279 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:01.278+0000 7fab439c4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:54:01.298 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:01.297+0000 7f3d8e962680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T17:54:01.701 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:01.700+0000 7fab439c4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:54:01.716 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:01.715+0000 7f3d8e962680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T17:54:01.804 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:01.803+0000 7fab439c4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:54:01.819 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:01.818+0000 7f3d8e962680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:54:01.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:01.906+0000 7f355f7fe700 1 -- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 msgr2=0x7f35400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:54:01.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:01.906+0000 7f355f7fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f35400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T17:54:01.957 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:01.956+0000 7fab439c4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:54:01.969 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:01.968+0000 7f3d8e962680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T17:54:02.031 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:02.031+0000 7fab439c4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:54:02.044 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:02.043+0000 7f3d8e962680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T17:54:02.098 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:02.097+0000 7fab439c4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:54:02.112 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:02.111+0000 7f3d8e962680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T17:54:02.355 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:02.355+0000 7fab439c4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:54:02.368 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:02.367+0000 7f3d8e962680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T17:54:02.540 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:02.539+0000 7fab439c4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:54:02.550 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:02.549+0000 7f3d8e962680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T17:54:03.191 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:03.190+0000 7fab439c4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:54:03.196 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:03.195+0000 7f3d8e962680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T17:54:03.259 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:03.259+0000 7fab439c4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:54:03.264 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:03.263+0000 7f3d8e962680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T17:54:03.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:54:03.307 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:54:03.337 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:03.336+0000 7fab439c4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:54:03.342 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:03.341+0000 7f3d8e962680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T17:54:03.486 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:03.486+0000 7fab439c4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:54:03.491 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:03.490+0000 7f3d8e962680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T17:54:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:03.507+0000 7f355f7fe700 1 -- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 msgr2=0x7f35400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/119464 2023-08-17T17:54:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:03.507+0000 7f355f7fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f35400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-17T17:54:03.558 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:03.557+0000 7fab439c4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:54:03.561 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:03.560+0000 7f3d8e962680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T17:54:03.674 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:03.673+0000 7fab439c4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:54:03.676 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:03.675+0000 7f3d8e962680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T17:54:03.782 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:03.781+0000 7fab439c4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:54:03.783 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:03.782+0000 7f3d8e962680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T17:54:04.071 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.070+0000 7f3d8e962680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:54:04.072 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:04.071+0000 7fab439c4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T17:54:04.142 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.141+0000 7f3d8e962680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:54:04.143 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T17:54:04.142+0000 7fab439c4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T17:54:04.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:04.161+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 66) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f3550010070 con 0x7f35600bf0e0 2023-08-17T17:54:04.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:04.161+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 msgr2=0x7f35400612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T17:54:04.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:04.161+0000 7f35577fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f35400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T17:54:04.230 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.228+0000 7f3d0a13a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:54:04.230 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.228+0000 7f3d0a13a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:54:04.230 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.228+0000 7f3d0a13a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:54:04.230 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.228+0000 7f3d0a13a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:54:04.230 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.228+0000 7f3d0a13a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:54:04.230 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.228+0000 7f3d0d140700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:54:04.231 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.228+0000 7f3d0d140700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:54:04.231 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.228+0000 7f3d0d140700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:54:04.231 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.228+0000 7f3d0d140700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:54:04.231 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:54:04.229+0000 7f3d0d140700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:54:05.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.164+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mgrmap(e 67) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f35500774c0 con 0x7f35600bf0e0 2023-08-17T17:54:05.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.164+0000 7f35577fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f354002fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:05.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.164+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3560046af0 con 0x7f354005ede0 2023-08-17T17:54:05.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.166+0000 7f355f7fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f354002fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:05.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.167+0000 7f355f7fe700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f354002fd40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f354800b340 tx=0x7f3548017000).ready entity=mgr.8772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:54:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.181+0000 7f35577fe700 1 -- 172.21.15.78:0/2159862334 <== mgr.8772 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3560046af0 con 0x7f354005ede0 2023-08-17T17:54:05.182 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-08-17T17:54:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 -- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 msgr2=0x7f354002fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f354002fd40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f354800b340 tx=0x7f3548017000).stop 2023-08-17T17:54:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 -- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35600bf0e0 msgr2=0x7f3560156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:05.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35600bf0e0 0x7f3560156780 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f355000c510 tx=0x7f3550007c70).stop 2023-08-17T17:54:05.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 -- 172.21.15.78:0/2159862334 shutdown_connections 2023-08-17T17:54:05.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f354005ede0 0x7f354002fd40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35601578f0 0x7f35600abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3560096520 0x7f35600ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 --2- 172.21.15.78:0/2159862334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35600bf0e0 0x7f3560156780 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 -- 172.21.15.78:0/2159862334 >> 172.21.15.78:0/2159862334 conn(0x7f3560062f80 msgr2=0x7f35600a7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:54:05.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 -- 172.21.15.78:0/2159862334 shutdown_connections 2023-08-17T17:54:05.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.183+0000 7f3566239700 1 -- 172.21.15.78:0/2159862334 wait complete. 2023-08-17T17:54:05.196 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-08-17T17:54:05.197 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-17T17:54:05.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.313+0000 7f073253d700 1 Processor -- start 2023-08-17T17:54:05.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.313+0000 7f073253d700 1 -- start start 2023-08-17T17:54:05.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.314+0000 7f073253d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f072c0aa4d0 0x7f072c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:05.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.314+0000 7f073253d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f072c0c5810 0x7f072c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:05.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.314+0000 7f073253d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c0649b0 con 0x7f072c0aa0f0 2023-08-17T17:54:05.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.314+0000 7f073253d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c0c6170 con 0x7f072c0aa4d0 2023-08-17T17:54:05.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.314+0000 7f073253d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c063420 con 0x7f072c0c5810 2023-08-17T17:54:05.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f0730ada700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f072c0c5810 0x7f072c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f072c0aa4d0 0x7f072c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072bfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f072c0aa0f0 0x7f072c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:45716/0 (socket says 172.21.15.78:45716) 2023-08-17T17:54:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072bfff700 1 -- 172.21.15.78:0/1492084130 learned_addr learned my addr 172.21.15.78:0/1492084130 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T17:54:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072b7fe700 1 -- 172.21.15.78:0/1492084130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f072c0c5810 msgr2=0x7f072c0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T17:54:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072b7fe700 1 --2- 172.21.15.78:0/1492084130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f072c0c5810 0x7f072c0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072b7fe700 1 -- 172.21.15.78:0/1492084130 >> v1:172.21.15.150:6789/0 conn(0x7f072c0aa0f0 legacy=0x7f072c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072b7fe700 1 -- 172.21.15.78:0/1492084130 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c063700 con 0x7f072c0aa4d0 2023-08-17T17:54:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072affd700 1 -- 172.21.15.78:0/1492084130 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109802390 0 0) 0x7f072c0649b0 con 0x7f072c0aa0f0 2023-08-17T17:54:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072b7fe700 1 --2- 172.21.15.78:0/1492084130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0aa4d0 0x7f072c0644c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f0720009760 tx=0x7f0720009060).ready entity=mon.1 client_cookie=1d4bfc1259f4b48d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:54:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072affd700 1 -- 172.21.15.78:0/1492084130 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072000f510 con 0x7f072c0aa4d0 2023-08-17T17:54:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072affd700 1 -- 172.21.15.78:0/1492084130 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072000f670 con 0x7f072c0aa4d0 2023-08-17T17:54:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.315+0000 7f072affd700 1 -- 172.21.15.78:0/1492084130 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072000f9f0 con 0x7f072c0aa4d0 2023-08-17T17:54:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.316+0000 7f073253d700 1 -- 172.21.15.78:0/1492084130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0aa4d0 msgr2=0x7f072c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.316+0000 7f073253d700 1 --2- 172.21.15.78:0/1492084130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0aa4d0 0x7f072c0644c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f0720009760 tx=0x7f0720009060).stop 2023-08-17T17:54:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.316+0000 7f073253d700 1 -- 172.21.15.78:0/1492084130 shutdown_connections 2023-08-17T17:54:05.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.316+0000 7f073253d700 1 --2- 172.21.15.78:0/1492084130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f072c0c5810 0x7f072c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.316+0000 7f073253d700 1 --2- 172.21.15.78:0/1492084130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0aa4d0 0x7f072c0644c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.316+0000 7f073253d700 1 -- 172.21.15.78:0/1492084130 >> 172.21.15.78:0/1492084130 conn(0x7f072c06a6a0 msgr2=0x7f072c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:54:05.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.316+0000 7f073253d700 1 -- 172.21.15.78:0/1492084130 shutdown_connections 2023-08-17T17:54:05.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.316+0000 7f073253d700 1 -- 172.21.15.78:0/1492084130 wait complete. 2023-08-17T17:54:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.317+0000 7f073253d700 1 Processor -- start 2023-08-17T17:54:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.317+0000 7f073253d700 1 -- start start 2023-08-17T17:54:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f073253d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0aa0f0 0x7f072c0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f073253d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072c0aa4d0 0x7f072c145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f073253d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f072c0c5810 0x7f072c1554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f073253d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c15aeb0 con 0x7f072c0aa4d0 2023-08-17T17:54:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f073253d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0ace60 con 0x7f072c0aa0f0 2023-08-17T17:54:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f073253d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0abf70 con 0x7f072c0c5810 2023-08-17T17:54:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f072b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072c0aa4d0 0x7f072c145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f072b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072c0aa4d0 0x7f072c145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40986/0 (socket says 172.21.15.78:40986) 2023-08-17T17:54:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f072b7fe700 1 -- 172.21.15.78:0/4274132294 learned_addr learned my addr 172.21.15.78:0/4274132294 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T17:54:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f0730ada700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f072c0c5810 0x7f072c1554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f072bfff700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0aa0f0 0x7f072c0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f072b7fe700 1 -- 172.21.15.78:0/4274132294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f072c0c5810 msgr2=0x7f072c1554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f072b7fe700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f072c0c5810 0x7f072c1554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f072b7fe700 1 -- 172.21.15.78:0/4274132294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0aa0f0 msgr2=0x7f072c0ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f072b7fe700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0aa0f0 0x7f072c0ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f072b7fe700 1 -- 172.21.15.78:0/4274132294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07200092a0 con 0x7f072c0aa4d0 2023-08-17T17:54:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.318+0000 7f072b7fe700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072c0aa4d0 0x7f072c145be0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f0720011000 tx=0x7f0720017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:54:05.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.319+0000 7f0713fff700 1 -- 172.21.15.78:0/4274132294 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072000f7e0 con 0x7f072c0aa4d0 2023-08-17T17:54:05.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.319+0000 7f0713fff700 1 -- 172.21.15.78:0/4274132294 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072000f940 con 0x7f072c0aa4d0 2023-08-17T17:54:05.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.319+0000 7f0713fff700 1 -- 172.21.15.78:0/4274132294 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072001b660 con 0x7f072c0aa4d0 2023-08-17T17:54:05.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.319+0000 7f073253d700 1 -- 172.21.15.78:0/4274132294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c0ac250 con 0x7f072c0aa4d0 2023-08-17T17:54:05.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.319+0000 7f073253d700 1 -- 172.21.15.78:0/4274132294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c0ac810 con 0x7f072c0aa4d0 2023-08-17T17:54:05.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.320+0000 7f073253d700 1 -- 172.21.15.78:0/4274132294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c0acff0 con 0x7f072c0aa4d0 2023-08-17T17:54:05.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.320+0000 7f0713fff700 1 -- 172.21.15.78:0/4274132294 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 67) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f072000f070 con 0x7f072c0aa4d0 2023-08-17T17:54:05.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.320+0000 7f0713fff700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071805ed40 0x7f0718061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T17:54:05.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.320+0000 7f0713fff700 1 -- 172.21.15.78:0/4274132294 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f072007adf0 con 0x7f072c0aa4d0 2023-08-17T17:54:05.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.320+0000 7f072bfff700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071805ed40 0x7f0718061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T17:54:05.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.321+0000 7f072bfff700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071805ed40 0x7f0718061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f071c007fd0 tx=0x7f071c007dd0).ready entity=mgr.8772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T17:54:05.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.325+0000 7f0713fff700 1 -- 172.21.15.78:0/4274132294 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f072004c380 con 0x7f072c0aa4d0 2023-08-17T17:54:05.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.510+0000 7f073253d700 1 -- 172.21.15.78:0/4274132294 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f072c046af0 con 0x7f071805ed40 2023-08-17T17:54:05.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.516+0000 7f0713fff700 1 -- 172.21.15.78:0/4274132294 <== mgr.8772 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f072c046af0 con 0x7f071805ed40 2023-08-17T17:54:05.517 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-08-17T17:54:05.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 -- 172.21.15.78:0/4274132294 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071805ed40 msgr2=0x7f0718061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:05.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071805ed40 0x7f0718061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f071c007fd0 tx=0x7f071c007dd0).stop 2023-08-17T17:54:05.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 -- 172.21.15.78:0/4274132294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072c0aa4d0 msgr2=0x7f072c145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T17:54:05.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072c0aa4d0 0x7f072c145be0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f0720011000 tx=0x7f0720017000).stop 2023-08-17T17:54:05.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 -- 172.21.15.78:0/4274132294 shutdown_connections 2023-08-17T17:54:05.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f071805ed40 0x7f0718061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f072c0c5810 0x7f072c1554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f072c0aa0f0 0x7f072c0ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 --2- 172.21.15.78:0/4274132294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072c0aa4d0 0x7f072c145be0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T17:54:05.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 -- 172.21.15.78:0/4274132294 >> 172.21.15.78:0/4274132294 conn(0x7f072c06a6a0 msgr2=0x7f072c0c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T17:54:05.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 -- 172.21.15.78:0/4274132294 shutdown_connections 2023-08-17T17:54:05.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T17:54:05.518+0000 7f073253d700 1 -- 172.21.15.78:0/4274132294 wait complete. 2023-08-17T17:54:05.531 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-08-17T17:54:33.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:54:33.431 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:55:00.521 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:55:00.520+0000 7f3cfc91f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:55:00.522 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:55:00.520+0000 7f3cfc91f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:55:00.522 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:55:00.520+0000 7f3cfc91f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:55:00.522 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:55:00.520+0000 7f3cfc91f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:55:00.522 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T17:55:00.520+0000 7f3cfc91f700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T17:55:03.560 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:55:03.562 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:55:33.624 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:55:33.627 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:56:03.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:56:03.740 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:56:33.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:56:33.879 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:57:04.000 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:57:04.003 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:57:34.138 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:57:34.141 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:58:04.277 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:58:04.280 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:58:34.424 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:58:34.427 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:59:04.597 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:59:04.600 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:59:34.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T17:59:34.681 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:00:04.834 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:00:04.837 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:00:34.982 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:00:34.985 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:01:05.046 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:01:05.049 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:01:35.210 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:01:35.212 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:02:05.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:02:05.352 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:02:35.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:02:35.456 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:03:05.594 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:03:05.596 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:03:35.682 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:03:35.685 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:04:05.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:04:05.833 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:04:35.894 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:04:35.897 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:05:05.967 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:05:05.970 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:05:15.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:05:15.533 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-17T18:05:15.553 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_55_00_UTC 2023-08-17T18:05:15.554 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_56_00_UTC 2023-08-17T18:05:15.554 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_57_00_UTC 2023-08-17T18:05:15.554 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_58_00_UTC 2023-08-17T18:05:15.554 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_59_00_UTC 2023-08-17T18:05:15.554 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_00_00_UTC 2023-08-17T18:05:15.554 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_01_00_UTC 2023-08-17T18:05:15.555 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_02_00_UTC 2023-08-17T18:05:15.555 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_03_00_UTC 2023-08-17T18:05:15.555 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_04_00_UTC 2023-08-17T18:05:15.555 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_05_00_UTC 2023-08-17T18:05:15.556 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_55_00_UTC', 'scheduled-2023-08-17-17_56_00_UTC', 'scheduled-2023-08-17-17_57_00_UTC', 'scheduled-2023-08-17-17_58_00_UTC', 'scheduled-2023-08-17-17_59_00_UTC', 'scheduled-2023-08-17-18_00_00_UTC', 'scheduled-2023-08-17-18_01_00_UTC', 'scheduled-2023-08-17-18_02_00_UTC', 'scheduled-2023-08-17-18_03_00_UTC', 'scheduled-2023-08-17-18_04_00_UTC', 'scheduled-2023-08-17-18_05_00_UTC'] 2023-08-17T18:05:15.556 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-08-17T18:05:15.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.721+0000 7f2f2680e700 1 Processor -- start 2023-08-17T18:05:15.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.721+0000 7f2f2680e700 1 -- start start 2023-08-17T18:05:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.722+0000 7f2f2680e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2f20069a20 0x7f2f2015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.722+0000 7f2f2680e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f200c5990 con 0x7f2f2014ea60 2023-08-17T18:05:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.722+0000 7f2f2680e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f200bcc10 con 0x7f2f2014e680 2023-08-17T18:05:15.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.722+0000 7f2f2680e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f200c4120 con 0x7f2f20069a20 2023-08-17T18:05:15.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.722+0000 7f2f1f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2f2014ea60 0x7f2f20069310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60840/0 (socket says 172.21.15.78:60840) 2023-08-17T18:05:15.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.722+0000 7f2f1f7fe700 1 -- 172.21.15.78:0/4160096139 learned_addr learned my addr 172.21.15.78:0/4160096139 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:05:15.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.722+0000 7f2f24dab700 1 --2- 172.21.15.78:0/4160096139 >> v2:172.21.15.150:3300/0 conn(0x7f2f20069a20 0x7f2f2015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:15.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.722+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148359154 0 0) 0x7f2f200c5990 con 0x7f2f2014ea60 2023-08-17T18:05:15.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f080033f0 con 0x7f2f2014ea60 2023-08-17T18:05:15.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 482084367 0 0) 0x7f2f080033f0 con 0x7f2f2014ea60 2023-08-17T18:05:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 >> v2:172.21.15.150:3300/0 conn(0x7f2f20069a20 msgr2=0x7f2f2015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:05:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 --2- 172.21.15.78:0/4160096139 >> v2:172.21.15.150:3300/0 conn(0x7f2f20069a20 0x7f2f2015bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 >> v1:172.21.15.150:6789/0 conn(0x7f2f2014e680 legacy=0x7f2f200c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200c3880 con 0x7f2f2014ea60 2023-08-17T18:05:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f2f14001470 con 0x7f2f2014ea60 2023-08-17T18:05:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 >> v1:172.21.15.78:6789/0 conn(0x7f2f2014ea60 legacy=0x7f2f20069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f080038e0 0x7f2f08003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f08004690 0x7f2f08004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08005000 0x7f2f0800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200c4120 con 0x7f2f08004690 2023-08-17T18:05:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0800be00 con 0x7f2f08005000 2023-08-17T18:05:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0800bfc0 con 0x7f2f080038e0 2023-08-17T18:05:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1f7fe700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f08004690 0x7f2f08004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1ffff700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f080038e0 0x7f2f08003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f24dab700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08005000 0x7f2f0800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1f7fe700 1 -- 172.21.15.78:0/4160096139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f080038e0 msgr2=0x7f2f08003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:05:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1f7fe700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f080038e0 0x7f2f08003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1f7fe700 1 -- 172.21.15.78:0/4160096139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08005000 msgr2=0x7f2f0800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:05:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1f7fe700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08005000 0x7f2f0800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f24dab700 1 -- 172.21.15.78:0/4160096139 reap_dead start 2023-08-17T18:05:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1f7fe700 1 -- 172.21.15.78:0/4160096139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f080033f0 con 0x7f2f08004690 2023-08-17T18:05:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.723+0000 7f2f1f7fe700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f08004690 0x7f2f08004b10 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f2f1400c1e0 tx=0x7f2f201512d0).ready entity=mon.0 client_cookie=2ded0c4893cf58dd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:05:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.724+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14007a60 con 0x7f2f08004690 2023-08-17T18:05:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.724+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400ca30 con 0x7f2f08004690 2023-08-17T18:05:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.724+0000 7f2f1effd700 1 -- 172.21.15.78:0/4160096139 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400cdd0 con 0x7f2f08004690 2023-08-17T18:05:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.724+0000 7f2f2680e700 1 -- 172.21.15.78:0/4160096139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f08004690 msgr2=0x7f2f08004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.724+0000 7f2f2680e700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f08004690 0x7f2f08004b10 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f2f1400c1e0 tx=0x7f2f201512d0).stop 2023-08-17T18:05:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.724+0000 7f2f2680e700 1 -- 172.21.15.78:0/4160096139 shutdown_connections 2023-08-17T18:05:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.724+0000 7f2f2680e700 1 --2- 172.21.15.78:0/4160096139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f08004690 0x7f2f08004b10 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.724+0000 7f2f2680e700 1 -- 172.21.15.78:0/4160096139 >> 172.21.15.78:0/4160096139 conn(0x7f2f200c7b80 msgr2=0x7f2f200c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:05:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.724+0000 7f2f2680e700 1 -- 172.21.15.78:0/4160096139 shutdown_connections 2023-08-17T18:05:15.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.724+0000 7f2f2680e700 1 -- 172.21.15.78:0/4160096139 wait complete. 2023-08-17T18:05:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.725+0000 7f2f2680e700 1 Processor -- start 2023-08-17T18:05:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.726+0000 7f2f2680e700 1 -- start start 2023-08-17T18:05:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.726+0000 7f2f2680e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08004690 0x7f2f200aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.726+0000 7f2f2680e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f20151560 0x7f2f2014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.726+0000 7f2f2680e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f2014c6f0 0x7f2f200a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.726+0000 7f2f2680e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20162020 con 0x7f2f2014c6f0 2023-08-17T18:05:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.726+0000 7f2f2680e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f201659b0 con 0x7f2f08004690 2023-08-17T18:05:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.726+0000 7f2f2680e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20165c90 con 0x7f2f20151560 2023-08-17T18:05:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.726+0000 7f2f24dab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f2014c6f0 0x7f2f200a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.726+0000 7f2f24dab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f2014c6f0 0x7f2f200a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50496/0 (socket says 172.21.15.78:50496) 2023-08-17T18:05:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.726+0000 7f2f24dab700 1 -- 172.21.15.78:0/3186053802 learned_addr learned my addr 172.21.15.78:0/3186053802 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:05:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f1f7fe700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f20151560 0x7f2f2014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f1ffff700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08004690 0x7f2f200aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f24dab700 1 -- 172.21.15.78:0/3186053802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f20151560 msgr2=0x7f2f2014c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f24dab700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f20151560 0x7f2f2014c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f24dab700 1 -- 172.21.15.78:0/3186053802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08004690 msgr2=0x7f2f200aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f24dab700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08004690 0x7f2f200aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f24dab700 1 -- 172.21.15.78:0/3186053802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f20165f70 con 0x7f2f2014c6f0 2023-08-17T18:05:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f24dab700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f2014c6f0 0x7f2f200a9900 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f2f180094d0 tx=0x7f2f1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:05:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f07fff700 1 -- 172.21.15.78:0/3186053802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800e040 con 0x7f2f2014c6f0 2023-08-17T18:05:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f07fff700 1 -- 172.21.15.78:0/3186053802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1800f040 con 0x7f2f2014c6f0 2023-08-17T18:05:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f2680e700 1 -- 172.21.15.78:0/3186053802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f20166250 con 0x7f2f2014c6f0 2023-08-17T18:05:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f07fff700 1 -- 172.21.15.78:0/3186053802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800fe20 con 0x7f2f2014c6f0 2023-08-17T18:05:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.727+0000 7f2f2680e700 1 -- 172.21.15.78:0/3186053802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f201655f0 con 0x7f2f2014c6f0 2023-08-17T18:05:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.728+0000 7f2f2680e700 1 -- 172.21.15.78:0/3186053802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f20162170 con 0x7f2f2014c6f0 2023-08-17T18:05:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.728+0000 7f2f07fff700 1 -- 172.21.15.78:0/3186053802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 70) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f2f18015660 con 0x7f2f2014c6f0 2023-08-17T18:05:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.729+0000 7f2f07fff700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f0c05ee70 0x7f2f0c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.729+0000 7f2f07fff700 1 -- 172.21.15.78:0/3186053802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6351+0+0 (secure 0 0 0) 0x7f2f1807aa20 con 0x7f2f2014c6f0 2023-08-17T18:05:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.729+0000 7f2f1ffff700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f0c05ee70 0x7f2f0c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.729+0000 7f2f1ffff700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f0c05ee70 0x7f2f0c061330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2f10007fd0 tx=0x7f2f10009040).ready entity=mgr.8772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:05:15.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.733+0000 7f2f07fff700 1 -- 172.21.15.78:0/3186053802 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f20162170 con 0x7f2f2014c6f0 2023-08-17T18:05:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.920+0000 7f2f2680e700 1 -- 172.21.15.78:0/3186053802 --> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f20162170 con 0x7f2f0c05ee70 2023-08-17T18:05:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.922+0000 7f2f07fff700 1 -- 172.21.15.78:0/3186053802 <== mgr.8772 v2:172.21.15.78:6832/119464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f2f20162170 con 0x7f2f0c05ee70 2023-08-17T18:05:15.922 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:05:15.922 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:54:05", "first": "2023-08-17T17:55:00", "last": "2023-08-17T18:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-08-17T18:05:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 -- 172.21.15.78:0/3186053802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f0c05ee70 msgr2=0x7f2f0c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f0c05ee70 0x7f2f0c061330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2f10007fd0 tx=0x7f2f10009040).stop 2023-08-17T18:05:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 -- 172.21.15.78:0/3186053802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f2014c6f0 msgr2=0x7f2f200a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f2014c6f0 0x7f2f200a9900 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f2f180094d0 tx=0x7f2f1800b040).stop 2023-08-17T18:05:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 -- 172.21.15.78:0/3186053802 shutdown_connections 2023-08-17T18:05:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7f2f0c05ee70 0x7f2f0c061330 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f2014c6f0 0x7f2f200a9900 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08004690 0x7f2f200aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 --2- 172.21.15.78:0/3186053802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f20151560 0x7f2f2014c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 -- 172.21.15.78:0/3186053802 >> 172.21.15.78:0/3186053802 conn(0x7f2f200c7b80 msgr2=0x7f2f200c11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:05:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 -- 172.21.15.78:0/3186053802 shutdown_connections 2023-08-17T18:05:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:15.924+0000 7f2f2680e700 1 -- 172.21.15.78:0/3186053802 wait complete. 2023-08-17T18:05:15.935 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:54:05", "first": "2023-08-17T17:55:00", "last": "2023-08-17T18:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-08-17T18:05:15.935 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:54:05', 'first': '2023-08-17T17:55:00', 'last': '2023-08-17T18:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-08-17T18:05:15.936 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-17T18:05:16.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.048+0000 7ff65c5b3700 1 Processor -- start 2023-08-17T18:05:16.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.048+0000 7ff65c5b3700 1 -- start start 2023-08-17T18:05:16.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.049+0000 7ff65c5b3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6540c6ee0 0x7ff6540c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:16.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.049+0000 7ff65c5b3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff6540c0df0 0x7ff6540ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:16.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.049+0000 7ff65c5b3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6540a8350 con 0x7ff654154140 2023-08-17T18:05:16.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.049+0000 7ff65c5b3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6540c7320 con 0x7ff6540c0df0 2023-08-17T18:05:16.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.049+0000 7ff65c5b3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540c1280 con 0x7ff6540c6ee0 2023-08-17T18:05:16.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.049+0000 7ff65a34f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff654154140 0x7ff6540a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60846/0 (socket says 172.21.15.78:60846) 2023-08-17T18:05:16.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff65a34f700 1 -- 172.21.15.78:0/394893623 learned_addr learned my addr 172.21.15.78:0/394893623 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:05:16.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff65ab50700 1 --2- 172.21.15.78:0/394893623 >> v2:172.21.15.150:3300/0 conn(0x7ff6540c0df0 0x7ff6540ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:16.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff659b4e700 1 --2- 172.21.15.78:0/394893623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6540c6ee0 0x7ff6540c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:16.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff65934d700 1 -- 172.21.15.78:0/394893623 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984152849 0 0) 0x7ff6540a8350 con 0x7ff654154140 2023-08-17T18:05:16.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff65934d700 1 -- 172.21.15.78:0/394893623 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6400033f0 con 0x7ff654154140 2023-08-17T18:05:16.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff659b4e700 1 -- 172.21.15.78:0/394893623 >> v2:172.21.15.150:3300/0 conn(0x7ff6540c0df0 msgr2=0x7ff6540ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:05:16.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff659b4e700 1 --2- 172.21.15.78:0/394893623 >> v2:172.21.15.150:3300/0 conn(0x7ff6540c0df0 0x7ff6540ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:16.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff659b4e700 1 -- 172.21.15.78:0/394893623 >> v1:172.21.15.78:6789/0 conn(0x7ff654154140 legacy=0x7ff6540a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:16.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff659b4e700 1 -- 172.21.15.78:0/394893623 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654154520 con 0x7ff6540c6ee0 2023-08-17T18:05:16.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff659b4e700 1 --2- 172.21.15.78:0/394893623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6540c6ee0 0x7ff6540c0900 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff644009760 tx=0x7ff644009060).ready entity=mon.2 client_cookie=f7bf07d15e3c4752 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:05:16.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff65934d700 1 -- 172.21.15.78:0/394893623 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64400d4a0 con 0x7ff6540c6ee0 2023-08-17T18:05:16.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff65934d700 1 -- 172.21.15.78:0/394893623 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64400d600 con 0x7ff6540c6ee0 2023-08-17T18:05:16.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.050+0000 7ff65934d700 1 -- 172.21.15.78:0/394893623 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64400d980 con 0x7ff6540c6ee0 2023-08-17T18:05:16.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.051+0000 7ff65c5b3700 1 -- 172.21.15.78:0/394893623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6540c6ee0 msgr2=0x7ff6540c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:16.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.051+0000 7ff65c5b3700 1 --2- 172.21.15.78:0/394893623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6540c6ee0 0x7ff6540c0900 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff644009760 tx=0x7ff644009060).stop 2023-08-17T18:05:16.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.051+0000 7ff65c5b3700 1 -- 172.21.15.78:0/394893623 shutdown_connections 2023-08-17T18:05:16.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.051+0000 7ff65c5b3700 1 --2- 172.21.15.78:0/394893623 >> v2:172.21.15.150:3300/0 conn(0x7ff6540c0df0 0x7ff6540ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.051+0000 7ff65c5b3700 1 --2- 172.21.15.78:0/394893623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6540c6ee0 0x7ff6540c0900 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.051+0000 7ff65c5b3700 1 -- 172.21.15.78:0/394893623 >> 172.21.15.78:0/394893623 conn(0x7ff654094510 msgr2=0x7ff65406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:05:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.051+0000 7ff65c5b3700 1 -- 172.21.15.78:0/394893623 shutdown_connections 2023-08-17T18:05:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.051+0000 7ff65c5b3700 1 -- 172.21.15.78:0/394893623 wait complete. 2023-08-17T18:05:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.052+0000 7ff65c5b3700 1 Processor -- start 2023-08-17T18:05:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.052+0000 7ff65c5b3700 1 -- start start 2023-08-17T18:05:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65c5b3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6540c0df0 0x7ff6540c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:16.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65c5b3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6540c6ee0 0x7ff654140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:16.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65c5b3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff654154140 0x7ff6540ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:16.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65c5b3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540aa970 con 0x7ff6540c0df0 2023-08-17T18:05:16.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65c5b3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540ab790 con 0x7ff6540c6ee0 2023-08-17T18:05:16.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65c5b3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540aab80 con 0x7ff654154140 2023-08-17T18:05:16.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65a34f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6540c0df0 0x7ff6540c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:16.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65a34f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6540c0df0 0x7ff6540c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50512/0 (socket says 172.21.15.78:50512) 2023-08-17T18:05:16.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65a34f700 1 -- 172.21.15.78:0/2041058083 learned_addr learned my addr 172.21.15.78:0/2041058083 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:05:16.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65a34f700 1 -- 172.21.15.78:0/2041058083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff654154140 msgr2=0x7ff6540ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:16.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65a34f700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff654154140 0x7ff6540ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:05:16.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65a34f700 1 -- 172.21.15.78:0/2041058083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6540c6ee0 msgr2=0x7ff654140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:16.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65a34f700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6540c6ee0 0x7ff654140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:05:16.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65a34f700 1 -- 172.21.15.78:0/2041058083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440092a0 con 0x7ff6540c0df0 2023-08-17T18:05:16.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65a34f700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6540c0df0 0x7ff6540c7b30 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7ff65000c7c0 tx=0x7ff6500015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:05:16.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff64a7fc700 1 -- 172.21.15.78:0/2041058083 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650005d30 con 0x7ff6540c0df0 2023-08-17T18:05:16.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff64a7fc700 1 -- 172.21.15.78:0/2041058083 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650005e90 con 0x7ff6540c0df0 2023-08-17T18:05:16.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65c5b3700 1 -- 172.21.15.78:0/2041058083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6540aae60 con 0x7ff6540c0df0 2023-08-17T18:05:16.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff64a7fc700 1 -- 172.21.15.78:0/2041058083 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650007340 con 0x7ff6540c0df0 2023-08-17T18:05:16.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.053+0000 7ff65c5b3700 1 -- 172.21.15.78:0/2041058083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6540ab420 con 0x7ff6540c0df0 2023-08-17T18:05:16.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.054+0000 7ff65c5b3700 1 -- 172.21.15.78:0/2041058083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff654047350 con 0x7ff6540c0df0 2023-08-17T18:05:16.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.054+0000 7ff64a7fc700 1 -- 172.21.15.78:0/2041058083 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 70) v1 ==== 75339+0+0 (secure 0 0 0) 0x7ff650010030 con 0x7ff6540c0df0 2023-08-17T18:05:16.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.055+0000 7ff64a7fc700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff63805eea0 0x7ff638061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:05:16.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.055+0000 7ff64a7fc700 1 -- 172.21.15.78:0/2041058083 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6351+0+0 (secure 0 0 0) 0x7ff650079bb0 con 0x7ff6540c0df0 2023-08-17T18:05:16.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.055+0000 7ff659b4e700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff63805eea0 0x7ff638061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:05:16.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.055+0000 7ff659b4e700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff63805eea0 0x7ff638061360 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff654064740 tx=0x7ff644016000).ready entity=mgr.8772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:05:16.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.059+0000 7ff64a7fc700 1 -- 172.21.15.78:0/2041058083 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff650080080 con 0x7ff6540c0df0 2023-08-17T18:05:16.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.264+0000 7ff65c5b3700 1 -- 172.21.15.78:0/2041058083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff6540c91e0 con 0x7ff6540c0df0 2023-08-17T18:05:16.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.267+0000 7ff64a7fc700 1 -- 172.21.15.78:0/2041058083 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v70) v1 ==== 74+0+148681 (secure 0 0 0) 0x7ff65004b050 con 0x7ff6540c0df0 2023-08-17T18:05:16.268 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:05:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 -- 172.21.15.78:0/2041058083 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff63805eea0 msgr2=0x7ff638061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff63805eea0 0x7ff638061360 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff654064740 tx=0x7ff644016000).stop 2023-08-17T18:05:16.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 -- 172.21.15.78:0/2041058083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6540c0df0 msgr2=0x7ff6540c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:05:16.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6540c0df0 0x7ff6540c7b30 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7ff65000c7c0 tx=0x7ff6500015b0).stop 2023-08-17T18:05:16.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 -- 172.21.15.78:0/2041058083 shutdown_connections 2023-08-17T18:05:16.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.78:6832/119464,v1:172.21.15.78:6833/119464] conn(0x7ff63805eea0 0x7ff638061360 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:16.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff654154140 0x7ff6540ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:05:16.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6540c0df0 0x7ff6540c7b30 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:05:16.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 --2- 172.21.15.78:0/2041058083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6540c6ee0 0x7ff654140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:05:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 -- 172.21.15.78:0/2041058083 >> 172.21.15.78:0/2041058083 conn(0x7ff654094510 msgr2=0x7ff6540ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:05:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 -- 172.21.15.78:0/2041058083 shutdown_connections 2023-08-17T18:05:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:05:16.269+0000 7ff65c5b3700 1 -- 172.21.15.78:0/2041058083 wait complete. 2023-08-17T18:05:16.281 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":70,"active_gid":8772,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":119464},{"type":"v1","addr":"172.21.15.78:6833","nonce":119464}]},"active_addr":"172.21.15.78:6833/119464","active_change":"2023-08-17T17:54:04.156481+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":7870,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":150,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3977763008}]},{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1641268059}]},{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2748193833}]},{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":303775003}]}]} 2023-08-17T18:05:16.285 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2023-08-17T18:05:16.286 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-17T18:05:16.286 INFO:tasks.ceph.mgr.y:Stopping old one... 2023-08-17T18:05:16.286 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-17T18:05:16.287 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:05:16.311 INFO:tasks.ceph.mgr.y:Stopped 2023-08-17T18:05:16.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-17T18:05:16.353 INFO:tasks.ceph.mgr.y:Started 2023-08-17T18:05:16.527 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:16.527+0000 7f0affdd5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:05:16.590 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:16.591+0000 7f0affdd5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:05:16.861 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:16.861+0000 7f0affdd5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:05:17.468 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:17.468+0000 7f0affdd5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:05:17.539 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:17.539+0000 7f0affdd5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:05:17.726 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:17.726+0000 7f0affdd5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:05:18.142 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:18.142+0000 7f0affdd5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:05:18.244 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:18.244+0000 7f0affdd5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:05:18.395 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:18.395+0000 7f0affdd5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:05:18.469 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:18.469+0000 7f0affdd5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:05:18.535 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:18.535+0000 7f0affdd5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:05:18.790 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:18.790+0000 7f0affdd5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:05:18.971 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:18.971+0000 7f0affdd5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:05:19.615 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:19.615+0000 7f0affdd5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:05:19.684 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:19.684+0000 7f0affdd5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:05:19.758 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:19.758+0000 7f0affdd5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:05:19.904 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:19.904+0000 7f0affdd5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:05:19.974 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:19.974+0000 7f0affdd5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:05:20.088 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.088+0000 7f0affdd5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:05:20.195 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.195+0000 7f0affdd5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:05:20.484 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.484+0000 7f0affdd5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:05:20.555 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.555+0000 7f0affdd5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:05:20.646 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.645+0000 7f0a7adac700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:05:20.646 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.645+0000 7f0a7adac700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:05:20.646 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.645+0000 7f0a7adac700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:05:20.647 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.645+0000 7f0a7adac700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:05:20.647 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.645+0000 7f0a7adac700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:05:20.647 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.645+0000 7f0a7ddb2700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:05:20.647 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.646+0000 7f0a7ddb2700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:05:20.647 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.646+0000 7f0a7ddb2700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:05:20.647 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.646+0000 7f0a7ddb2700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:05:20.647 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:05:20.646+0000 7f0a7ddb2700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:05:36.106 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:05:36.110 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:06:00.638 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:06:00.637+0000 7f0a845bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:06:00.638 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:06:00.637+0000 7f0a845bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:06:00.638 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:06:00.637+0000 7f0a845bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:06:00.638 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:06:00.637+0000 7f0a845bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:06:00.639 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:06:00.637+0000 7f0a845bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:06:06.237 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:06:06.239 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:06:36.343 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:06:36.345 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:07:06.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:07:06.459 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:07:36.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:07:36.598 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:08:06.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:08:06.663 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:08:36.725 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:08:36.727 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:09:06.855 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:09:06.857 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:09:36.952 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:09:36.955 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:10:07.088 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:10:07.090 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:10:16.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-17T18:10:16.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.485+0000 7f3ee060a700 1 Processor -- start 2023-08-17T18:10:16.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.485+0000 7f3ee060a700 1 -- start start 2023-08-17T18:10:16.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.486+0000 7f3ee060a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3ed80aa4d0 0x7f3ed80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.486+0000 7f3ee060a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80c5810 0x7f3ed80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.486+0000 7f3ee060a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed80649b0 con 0x7f3ed80aa0f0 2023-08-17T18:10:16.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.486+0000 7f3ee060a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed80c6170 con 0x7f3ed80aa4d0 2023-08-17T18:10:16.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3ee060a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed8063420 con 0x7f3ed80c5810 2023-08-17T18:10:16.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3ede3a6700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3ed80aa0f0 0x7f3ed80c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48668/0 (socket says 172.21.15.78:48668) 2023-08-17T18:10:16.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3ede3a6700 1 -- 172.21.15.78:0/4021317126 learned_addr learned my addr 172.21.15.78:0/4021317126 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:16.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3eddba5700 1 --2- 172.21.15.78:0/4021317126 >> v2:172.21.15.150:3300/0 conn(0x7f3ed80aa4d0 0x7f3ed80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3edeba7700 1 --2- 172.21.15.78:0/4021317126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80c5810 0x7f3ed80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3edd3a4700 1 -- 172.21.15.78:0/4021317126 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819816027 0 0) 0x7f3ed80649b0 con 0x7f3ed80aa0f0 2023-08-17T18:10:16.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3edd3a4700 1 -- 172.21.15.78:0/4021317126 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec40033f0 con 0x7f3ed80aa0f0 2023-08-17T18:10:16.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3edeba7700 1 -- 172.21.15.78:0/4021317126 >> v2:172.21.15.150:3300/0 conn(0x7f3ed80aa4d0 msgr2=0x7f3ed80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:16.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3edeba7700 1 --2- 172.21.15.78:0/4021317126 >> v2:172.21.15.150:3300/0 conn(0x7f3ed80aa4d0 0x7f3ed80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3edd3a4700 1 -- 172.21.15.78:0/4021317126 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 810631328 0 0) 0x7f3ec40033f0 con 0x7f3ed80aa0f0 2023-08-17T18:10:16.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3edeba7700 1 -- 172.21.15.78:0/4021317126 >> v1:172.21.15.78:6789/0 conn(0x7f3ed80aa0f0 legacy=0x7f3ed80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:16.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3edeba7700 1 -- 172.21.15.78:0/4021317126 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8063700 con 0x7f3ed80c5810 2023-08-17T18:10:16.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3edeba7700 1 --2- 172.21.15.78:0/4021317126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80c5810 0x7f3ed80c5c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f3ed0009760 tx=0x7f3ed0009060).ready entity=mon.2 client_cookie=7947120becc9201d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:16.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.487+0000 7f3edd3a4700 1 -- 172.21.15.78:0/4021317126 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed40017f0 con 0x7f3ed80c5810 2023-08-17T18:10:16.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.488+0000 7f3edd3a4700 1 -- 172.21.15.78:0/4021317126 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0011400 con 0x7f3ed80c5810 2023-08-17T18:10:16.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.488+0000 7f3edd3a4700 1 -- 172.21.15.78:0/4021317126 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0011780 con 0x7f3ed80c5810 2023-08-17T18:10:16.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.488+0000 7f3ee060a700 1 -- 172.21.15.78:0/4021317126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80c5810 msgr2=0x7f3ed80c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:16.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.488+0000 7f3ee060a700 1 --2- 172.21.15.78:0/4021317126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80c5810 0x7f3ed80c5c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f3ed0009760 tx=0x7f3ed0009060).stop 2023-08-17T18:10:16.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.488+0000 7f3ee060a700 1 -- 172.21.15.78:0/4021317126 shutdown_connections 2023-08-17T18:10:16.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.488+0000 7f3ee060a700 1 --2- 172.21.15.78:0/4021317126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80c5810 0x7f3ed80c5c80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.488+0000 7f3ee060a700 1 --2- 172.21.15.78:0/4021317126 >> v2:172.21.15.150:3300/0 conn(0x7f3ed80aa4d0 0x7f3ed80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.488+0000 7f3ee060a700 1 -- 172.21.15.78:0/4021317126 >> 172.21.15.78:0/4021317126 conn(0x7f3ed806a6a0 msgr2=0x7f3ed80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.488+0000 7f3ee060a700 1 -- 172.21.15.78:0/4021317126 shutdown_connections 2023-08-17T18:10:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.488+0000 7f3ee060a700 1 -- 172.21.15.78:0/4021317126 wait complete. 2023-08-17T18:10:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.489+0000 7f3ee060a700 1 Processor -- start 2023-08-17T18:10:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.489+0000 7f3ee060a700 1 -- start start 2023-08-17T18:10:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3ee060a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80aa0f0 0x7f3ed80c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3ee060a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed80aa4d0 0x7f3ed8144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3ee060a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c5810 0x7f3ed8153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3ee060a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80abcf0 con 0x7f3ed80c5810 2023-08-17T18:10:16.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3ee060a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80c48d0 con 0x7f3ed80aa4d0 2023-08-17T18:10:16.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3ee060a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80ab6a0 con 0x7f3ed80aa0f0 2023-08-17T18:10:16.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3edeba7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c5810 0x7f3ed8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3edeba7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c5810 0x7f3ed8153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59030/0 (socket says 172.21.15.78:59030) 2023-08-17T18:10:16.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3edeba7700 1 -- 172.21.15.78:0/3376641362 learned_addr learned my addr 172.21.15.78:0/3376641362 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:16.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3ede3a6700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80aa0f0 0x7f3ed80c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3eddba5700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed80aa4d0 0x7f3ed8144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3edeba7700 1 -- 172.21.15.78:0/3376641362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80aa0f0 msgr2=0x7f3ed80c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3edeba7700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80aa0f0 0x7f3ed80c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3edeba7700 1 -- 172.21.15.78:0/3376641362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed80aa4d0 msgr2=0x7f3ed8144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3edeba7700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed80aa4d0 0x7f3ed8144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3edeba7700 1 -- 172.21.15.78:0/3376641362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00092a0 con 0x7f3ed80c5810 2023-08-17T18:10:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.490+0000 7f3edeba7700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c5810 0x7f3ed8153860 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f3ed0009d50 tx=0x7f3ed0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.491+0000 7f3ece7fc700 1 -- 172.21.15.78:0/3376641362 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0010a50 con 0x7f3ed80c5810 2023-08-17T18:10:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.491+0000 7f3ece7fc700 1 -- 172.21.15.78:0/3376641362 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0010bb0 con 0x7f3ed80c5810 2023-08-17T18:10:16.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.491+0000 7f3ee060a700 1 -- 172.21.15.78:0/3376641362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed80ab980 con 0x7f3ed80c5810 2023-08-17T18:10:16.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.491+0000 7f3ece7fc700 1 -- 172.21.15.78:0/3376641362 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed001d430 con 0x7f3ed80c5810 2023-08-17T18:10:16.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.491+0000 7f3ee060a700 1 -- 172.21.15.78:0/3376641362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed80a9240 con 0x7f3ed80c5810 2023-08-17T18:10:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.492+0000 7f3ee060a700 1 -- 172.21.15.78:0/3376641362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed8083980 con 0x7f3ed80c5810 2023-08-17T18:10:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.492+0000 7f3ece7fc700 1 -- 172.21.15.78:0/3376641362 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 75) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f3ed0024030 con 0x7f3ed80c5810 2023-08-17T18:10:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.492+0000 7f3ece7fc700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3ebc05eea0 0x7f3ebc061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.492+0000 7f3ece7fc700 1 -- 172.21.15.78:0/3376641362 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6523+0+0 (secure 0 0 0) 0x7f3ed007aba0 con 0x7f3ed80c5810 2023-08-17T18:10:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.492+0000 7f3ede3a6700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3ebc05eea0 0x7f3ebc061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.493+0000 7f3ede3a6700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3ebc05eea0 0x7f3ebc061360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3ed4001560 tx=0x7f3ed4001d80).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.496+0000 7f3ece7fc700 1 -- 172.21.15.78:0/3376641362 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ed004be80 con 0x7f3ed80c5810 2023-08-17T18:10:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.685+0000 7f3ee060a700 1 -- 172.21.15.78:0/3376641362 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ed80abe30 con 0x7f3ebc05eea0 2023-08-17T18:10:16.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.690+0000 7f3ece7fc700 1 -- 172.21.15.78:0/3376641362 <== mgr.8844 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f3ed400fb50 con 0x7f3ebc05eea0 2023-08-17T18:10:16.690 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-08-17T18:10:16.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 -- 172.21.15.78:0/3376641362 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3ebc05eea0 msgr2=0x7f3ebc061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:16.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3ebc05eea0 0x7f3ebc061360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3ed4001560 tx=0x7f3ed4001d80).stop 2023-08-17T18:10:16.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 -- 172.21.15.78:0/3376641362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c5810 msgr2=0x7f3ed8153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:16.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c5810 0x7f3ed8153860 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f3ed0009d50 tx=0x7f3ed0016000).stop 2023-08-17T18:10:16.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 -- 172.21.15.78:0/3376641362 shutdown_connections 2023-08-17T18:10:16.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3ebc05eea0 0x7f3ebc061360 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c5810 0x7f3ed8153860 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ed80aa0f0 0x7f3ed80c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 --2- 172.21.15.78:0/3376641362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ed80aa4d0 0x7f3ed8144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 -- 172.21.15.78:0/3376641362 >> 172.21.15.78:0/3376641362 conn(0x7f3ed806a6a0 msgr2=0x7f3ed80ca660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:16.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 -- 172.21.15.78:0/3376641362 shutdown_connections 2023-08-17T18:10:16.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.692+0000 7f3ee060a700 1 -- 172.21.15.78:0/3376641362 wait complete. 2023-08-17T18:10:16.703 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-08-17T18:10:16.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:16.704 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-17T18:10:16.719 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_55_00_UTC 2023-08-17T18:10:16.719 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_56_00_UTC 2023-08-17T18:10:16.720 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_57_00_UTC 2023-08-17T18:10:16.720 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_58_00_UTC 2023-08-17T18:10:16.720 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_59_00_UTC 2023-08-17T18:10:16.720 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_00_00_UTC 2023-08-17T18:10:16.720 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_01_00_UTC 2023-08-17T18:10:16.720 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_02_00_UTC 2023-08-17T18:10:16.720 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_03_00_UTC 2023-08-17T18:10:16.721 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_04_00_UTC 2023-08-17T18:10:16.721 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_05_00_UTC 2023-08-17T18:10:16.721 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_06_00_UTC 2023-08-17T18:10:16.721 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_07_00_UTC 2023-08-17T18:10:16.721 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_08_00_UTC 2023-08-17T18:10:16.721 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_09_00_UTC 2023-08-17T18:10:16.721 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_10_00_UTC 2023-08-17T18:10:16.722 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-17-17_55_00_UTC', 'scheduled-2023-08-17-17_56_00_UTC', 'scheduled-2023-08-17-17_57_00_UTC', 'scheduled-2023-08-17-17_58_00_UTC', 'scheduled-2023-08-17-17_59_00_UTC', 'scheduled-2023-08-17-18_00_00_UTC', 'scheduled-2023-08-17-18_01_00_UTC', 'scheduled-2023-08-17-18_02_00_UTC', 'scheduled-2023-08-17-18_03_00_UTC', 'scheduled-2023-08-17-18_04_00_UTC', 'scheduled-2023-08-17-18_05_00_UTC', 'scheduled-2023-08-17-18_06_00_UTC', 'scheduled-2023-08-17-18_07_00_UTC', 'scheduled-2023-08-17-18_08_00_UTC', 'scheduled-2023-08-17-18_09_00_UTC', 'scheduled-2023-08-17-18_10_00_UTC'] 2023-08-17T18:10:16.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-08-17T18:10:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.878+0000 7ff93ce1f700 1 Processor -- start 2023-08-17T18:10:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.878+0000 7ff93ce1f700 1 -- start start 2023-08-17T18:10:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff93ce1f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff9381578f0 0x7ff9380be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff93ce1f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff9380bf0e0 0x7ff938095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff93ce1f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 0x7ff938064330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff93ce1f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9380bf5c0 con 0x7ff9380bf0e0 2023-08-17T18:10:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff93ce1f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9380c32d0 con 0x7ff9381578f0 2023-08-17T18:10:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff93ce1f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380c3e10 con 0x7ff938096300 2023-08-17T18:10:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff92dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff9380bf0e0 0x7ff938095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff92dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff9380bf0e0 0x7ff938095e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59046/0 (socket says 172.21.15.78:59046) 2023-08-17T18:10:16.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff92dd9b700 1 -- 172.21.15.78:0/1259749687 learned_addr learned my addr 172.21.15.78:0/1259749687 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:16.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff92dd9b700 1 -- 172.21.15.78:0/1259749687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 msgr2=0x7ff938064330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:16.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff936d9d700 1 --2- 172.21.15.78:0/1259749687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 0x7ff938064330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff93659c700 1 --2- 172.21.15.78:0/1259749687 >> v2:172.21.15.150:3300/0 conn(0x7ff9381578f0 0x7ff9380be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff92dd9b700 1 --2- 172.21.15.78:0/1259749687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 0x7ff938064330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff92dd9b700 1 -- 172.21.15.78:0/1259749687 >> v2:172.21.15.150:3300/0 conn(0x7ff9381578f0 msgr2=0x7ff9380be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff92dd9b700 1 --2- 172.21.15.78:0/1259749687 >> v2:172.21.15.150:3300/0 conn(0x7ff9381578f0 0x7ff9380be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff92dd9b700 1 -- 172.21.15.78:0/1259749687 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938096790 con 0x7ff9380bf0e0 2023-08-17T18:10:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff92dd9b700 1 --2- 172.21.15.78:0/1259749687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9380bf0e0 0x7ff938095e10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7ff9380605b0 tx=0x7ff9200090f0).ready entity=mon.0 client_cookie=c65ee547e6c57ac8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff935d9b700 1 -- 172.21.15.78:0/1259749687 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92000b600 con 0x7ff9380bf0e0 2023-08-17T18:10:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.879+0000 7ff935d9b700 1 -- 172.21.15.78:0/1259749687 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92000b760 con 0x7ff9380bf0e0 2023-08-17T18:10:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.880+0000 7ff935d9b700 1 -- 172.21.15.78:0/1259749687 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92000bae0 con 0x7ff9380bf0e0 2023-08-17T18:10:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.880+0000 7ff93ce1f700 1 -- 172.21.15.78:0/1259749687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9380bf0e0 msgr2=0x7ff938095e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.880+0000 7ff93ce1f700 1 --2- 172.21.15.78:0/1259749687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9380bf0e0 0x7ff938095e10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7ff9380605b0 tx=0x7ff9200090f0).stop 2023-08-17T18:10:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.880+0000 7ff93ce1f700 1 -- 172.21.15.78:0/1259749687 shutdown_connections 2023-08-17T18:10:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.880+0000 7ff93ce1f700 1 --2- 172.21.15.78:0/1259749687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 0x7ff938064330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.880+0000 7ff93ce1f700 1 --2- 172.21.15.78:0/1259749687 >> v2:172.21.15.150:3300/0 conn(0x7ff9381578f0 0x7ff9380be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.880+0000 7ff93ce1f700 1 --2- 172.21.15.78:0/1259749687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9380bf0e0 0x7ff938095e10 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.880+0000 7ff93ce1f700 1 -- 172.21.15.78:0/1259749687 >> 172.21.15.78:0/1259749687 conn(0x7ff938062f80 msgr2=0x7ff9380c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.880+0000 7ff93ce1f700 1 -- 172.21.15.78:0/1259749687 shutdown_connections 2023-08-17T18:10:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.880+0000 7ff93ce1f700 1 -- 172.21.15.78:0/1259749687 wait complete. 2023-08-17T18:10:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.881+0000 7ff93ce1f700 1 Processor -- start 2023-08-17T18:10:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.881+0000 7ff93ce1f700 1 -- start start 2023-08-17T18:10:16.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff93ce1f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 0x7ff9380c1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff93ce1f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9380bf0e0 0x7ff93814bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff93ce1f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9381578f0 0x7ff9380aa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff93ce1f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380c1e60 con 0x7ff9381578f0 2023-08-17T18:10:16.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff93ce1f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380c2c60 con 0x7ff9380bf0e0 2023-08-17T18:10:16.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff93ce1f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93814c110 con 0x7ff938096300 2023-08-17T18:10:16.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff936d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9381578f0 0x7ff9380aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff936d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9381578f0 0x7ff9380aa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59060/0 (socket says 172.21.15.78:59060) 2023-08-17T18:10:16.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff936d9d700 1 -- 172.21.15.78:0/3906420334 learned_addr learned my addr 172.21.15.78:0/3906420334 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:16.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff93659c700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 0x7ff9380c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff92dd9b700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9380bf0e0 0x7ff93814bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff936d9d700 1 -- 172.21.15.78:0/3906420334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 msgr2=0x7ff9380c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:16.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff936d9d700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 0x7ff9380c1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff936d9d700 1 -- 172.21.15.78:0/3906420334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9380bf0e0 msgr2=0x7ff93814bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:16.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff936d9d700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9380bf0e0 0x7ff93814bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:16.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.882+0000 7ff936d9d700 1 -- 172.21.15.78:0/3906420334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920009370 con 0x7ff9381578f0 2023-08-17T18:10:16.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.883+0000 7ff93659c700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 0x7ff9380c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:16.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.883+0000 7ff936d9d700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9381578f0 0x7ff9380aa830 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7ff93000cf10 tx=0x7ff930007870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:16.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.883+0000 7ff92effd700 1 -- 172.21.15.78:0/3906420334 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93000ae60 con 0x7ff9381578f0 2023-08-17T18:10:16.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.883+0000 7ff92effd700 1 -- 172.21.15.78:0/3906420334 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff930016400 con 0x7ff9381578f0 2023-08-17T18:10:16.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.883+0000 7ff92effd700 1 -- 172.21.15.78:0/3906420334 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9300167a0 con 0x7ff9381578f0 2023-08-17T18:10:16.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.883+0000 7ff93ce1f700 1 -- 172.21.15.78:0/3906420334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9380c2050 con 0x7ff9381578f0 2023-08-17T18:10:16.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.883+0000 7ff93ce1f700 1 -- 172.21.15.78:0/3906420334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9380c2610 con 0x7ff9381578f0 2023-08-17T18:10:16.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.884+0000 7ff93ce1f700 1 -- 172.21.15.78:0/3906420334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9380c2df0 con 0x7ff9381578f0 2023-08-17T18:10:16.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.884+0000 7ff92effd700 1 -- 172.21.15.78:0/3906420334 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 75) v1 ==== 75339+0+0 (secure 0 0 0) 0x7ff93000e400 con 0x7ff9381578f0 2023-08-17T18:10:16.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.884+0000 7ff92effd700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff91805ee70 0x7ff918061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:16.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.884+0000 7ff92effd700 1 -- 172.21.15.78:0/3906420334 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6523+0+0 (secure 0 0 0) 0x7ff93007a900 con 0x7ff9381578f0 2023-08-17T18:10:16.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.884+0000 7ff93659c700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff91805ee70 0x7ff918061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:16.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.885+0000 7ff93659c700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff91805ee70 0x7ff918061330 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff92800b870 tx=0x7ff928008040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:16.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:16.889+0000 7ff92effd700 1 -- 172.21.15.78:0/3906420334 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff93004bd40 con 0x7ff9381578f0 2023-08-17T18:10:17.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.074+0000 7ff93ce1f700 1 -- 172.21.15.78:0/3906420334 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9380c34e0 con 0x7ff91805ee70 2023-08-17T18:10:17.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.075+0000 7ff92effd700 1 -- 172.21.15.78:0/3906420334 <== mgr.8844 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7ff9380c34e0 con 0x7ff91805ee70 2023-08-17T18:10:17.075 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:17.075 INFO:teuthology.orchestra.run.smithi078.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:54:05", "first": "2023-08-17T17:55:00", "last": "2023-08-17T18:10:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-08-17T18:10:17.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 -- 172.21.15.78:0/3906420334 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff91805ee70 msgr2=0x7ff918061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:17.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff91805ee70 0x7ff918061330 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff92800b870 tx=0x7ff928008040).stop 2023-08-17T18:10:17.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 -- 172.21.15.78:0/3906420334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9381578f0 msgr2=0x7ff9380aa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:17.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9381578f0 0x7ff9380aa830 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7ff93000cf10 tx=0x7ff930007870).stop 2023-08-17T18:10:17.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 -- 172.21.15.78:0/3906420334 shutdown_connections 2023-08-17T18:10:17.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff91805ee70 0x7ff918061330 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9381578f0 0x7ff9380aa830 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff938096300 0x7ff9380c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 --2- 172.21.15.78:0/3906420334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9380bf0e0 0x7ff93814bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 -- 172.21.15.78:0/3906420334 >> 172.21.15.78:0/3906420334 conn(0x7ff938062f80 msgr2=0x7ff938156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 -- 172.21.15.78:0/3906420334 shutdown_connections 2023-08-17T18:10:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.077+0000 7ff93ce1f700 1 -- 172.21.15.78:0/3906420334 wait complete. 2023-08-17T18:10:17.088 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-17T00:00:00", "created": "2023-08-17T17:54:05", "first": "2023-08-17T17:55:00", "last": "2023-08-17T18:10:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-08-17T18:10:17.089 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-08-17T00:00:00', 'created': '2023-08-17T17:54:05', 'first': '2023-08-17T17:55:00', 'last': '2023-08-17T18:10:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-08-17T18:10:17.089 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-17T18:10:17.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.206+0000 7f0fcd93b700 1 Processor -- start 2023-08-17T18:10:17.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.206+0000 7f0fcd93b700 1 -- start start 2023-08-17T18:10:17.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.207+0000 7f0fcd93b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 0x7f0fc80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:17.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.207+0000 7f0fcd93b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0fc80c5810 0x7f0fc80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:17.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.207+0000 7f0fcd93b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc80649b0 con 0x7f0fc80aa4d0 2023-08-17T18:10:17.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.207+0000 7f0fcd93b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc80c6170 con 0x7f0fc80c5810 2023-08-17T18:10:17.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.207+0000 7f0fcd93b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8063420 con 0x7f0fc80aa0f0 2023-08-17T18:10:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.207+0000 7f0fc6ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 0x7f0fc80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.207+0000 7f0fc77fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0fc80c5810 0x7f0fc80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc77fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0fc80c5810 0x7f0fc80c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:44678/0 (socket says 172.21.15.78:44678) 2023-08-17T18:10:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc6ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 0x7f0fc80644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:47270/0 (socket says 172.21.15.78:47270) 2023-08-17T18:10:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc77fe700 1 -- 172.21.15.78:0/233719638 learned_addr learned my addr 172.21.15.78:0/233719638 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fbe7fc700 1 --1- 172.21.15.78:0/233719638 >> v1:172.21.15.150:6789/0 conn(0x7f0fc80aa4d0 0x7f0fc80c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:58022/0 (socket says 172.21.15.78:58022) 2023-08-17T18:10:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc77fe700 1 -- 172.21.15.78:0/233719638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 msgr2=0x7f0fc80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc77fe700 1 --2- 172.21.15.78:0/233719638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 0x7f0fc80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc77fe700 1 -- 172.21.15.78:0/233719638 >> v1:172.21.15.150:6789/0 conn(0x7f0fc80aa4d0 legacy=0x7f0fc80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc77fe700 1 -- 172.21.15.78:0/233719638 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8063700 con 0x7f0fc80c5810 2023-08-17T18:10:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc6ffd700 1 --2- 172.21.15.78:0/233719638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 0x7f0fc80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc77fe700 1 --2- 172.21.15.78:0/233719638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc80c5810 0x7f0fc80c5c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f0fc0009f20 tx=0x7f0fc0009840).ready entity=mon.1 client_cookie=87fc18e2cf9d7000 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc67fc700 1 -- 172.21.15.78:0/233719638 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000e070 con 0x7f0fc80c5810 2023-08-17T18:10:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc67fc700 1 -- 172.21.15.78:0/233719638 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc000b9d0 con 0x7f0fc80c5810 2023-08-17T18:10:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.208+0000 7f0fc67fc700 1 -- 172.21.15.78:0/233719638 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000bd50 con 0x7f0fc80c5810 2023-08-17T18:10:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.209+0000 7f0fcd93b700 1 -- 172.21.15.78:0/233719638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc80c5810 msgr2=0x7f0fc80c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.209+0000 7f0fcd93b700 1 --2- 172.21.15.78:0/233719638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc80c5810 0x7f0fc80c5c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f0fc0009f20 tx=0x7f0fc0009840).stop 2023-08-17T18:10:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.209+0000 7f0fcd93b700 1 -- 172.21.15.78:0/233719638 shutdown_connections 2023-08-17T18:10:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.209+0000 7f0fcd93b700 1 --2- 172.21.15.78:0/233719638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc80c5810 0x7f0fc80c5c80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.209+0000 7f0fcd93b700 1 --2- 172.21.15.78:0/233719638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 0x7f0fc80644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.209+0000 7f0fcd93b700 1 -- 172.21.15.78:0/233719638 >> 172.21.15.78:0/233719638 conn(0x7f0fc806a6a0 msgr2=0x7f0fc80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.209+0000 7f0fcd93b700 1 -- 172.21.15.78:0/233719638 shutdown_connections 2023-08-17T18:10:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.209+0000 7f0fcd93b700 1 -- 172.21.15.78:0/233719638 wait complete. 2023-08-17T18:10:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.210+0000 7f0fcd93b700 1 Processor -- start 2023-08-17T18:10:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.210+0000 7f0fcd93b700 1 -- start start 2023-08-17T18:10:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fcd93b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 0x7f0fc8158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fcd93b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc80aa4d0 0x7f0fc81643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fcd93b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc80c5810 0x7f0fc80c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fcd93b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80af660 con 0x7f0fc80c5810 2023-08-17T18:10:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fcd93b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80c3500 con 0x7f0fc80aa4d0 2023-08-17T18:10:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fcd93b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80af8b0 con 0x7f0fc80aa0f0 2023-08-17T18:10:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fc77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc80c5810 0x7f0fc80c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fc77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc80c5810 0x7f0fc80c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59064/0 (socket says 172.21.15.78:59064) 2023-08-17T18:10:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fc77fe700 1 -- 172.21.15.78:0/3022563749 learned_addr learned my addr 172.21.15.78:0/3022563749 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fc6ffd700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 0x7f0fc8158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fbe7fc700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc80aa4d0 0x7f0fc81643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fc77fe700 1 -- 172.21.15.78:0/3022563749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 msgr2=0x7f0fc8158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fc77fe700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 0x7f0fc8158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fc77fe700 1 -- 172.21.15.78:0/3022563749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc80aa4d0 msgr2=0x7f0fc81643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fc77fe700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc80aa4d0 0x7f0fc81643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fc77fe700 1 -- 172.21.15.78:0/3022563749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb80092a0 con 0x7f0fc80c5810 2023-08-17T18:10:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.211+0000 7f0fc77fe700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc80c5810 0x7f0fc80c2ab0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f0fc000b610 tx=0x7f0fc0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.212+0000 7f0fbf7fe700 1 -- 172.21.15.78:0/3022563749 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc00092e0 con 0x7f0fc80c5810 2023-08-17T18:10:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.212+0000 7f0fbf7fe700 1 -- 172.21.15.78:0/3022563749 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc0007610 con 0x7f0fc80c5810 2023-08-17T18:10:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.212+0000 7f0fcd93b700 1 -- 172.21.15.78:0/3022563749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc0009ae0 con 0x7f0fc80c5810 2023-08-17T18:10:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.212+0000 7f0fbf7fe700 1 -- 172.21.15.78:0/3022563749 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc00079d0 con 0x7f0fc80c5810 2023-08-17T18:10:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.212+0000 7f0fcd93b700 1 -- 172.21.15.78:0/3022563749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc80afe70 con 0x7f0fc80c5810 2023-08-17T18:10:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.212+0000 7f0fcd93b700 1 -- 172.21.15.78:0/3022563749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc8083980 con 0x7f0fc80c5810 2023-08-17T18:10:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.213+0000 7f0fbf7fe700 1 -- 172.21.15.78:0/3022563749 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 75) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f0fc0025030 con 0x7f0fc80c5810 2023-08-17T18:10:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.213+0000 7f0fbf7fe700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0fa805ee70 0x7f0fa8061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:17.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.213+0000 7f0fbf7fe700 1 -- 172.21.15.78:0/3022563749 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6523+0+0 (secure 0 0 0) 0x7f0fc007b6e0 con 0x7f0fc80c5810 2023-08-17T18:10:17.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.213+0000 7f0fc6ffd700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0fa805ee70 0x7f0fa8061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:17.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.214+0000 7f0fc6ffd700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0fa805ee70 0x7f0fa8061330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0fb8009dc0 tx=0x7f0fb8009060).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:17.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.217+0000 7f0fbf7fe700 1 -- 172.21.15.78:0/3022563749 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fc004cb60 con 0x7f0fc80c5810 2023-08-17T18:10:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.404+0000 7f0fcd93b700 1 -- 172.21.15.78:0/3022563749 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fc8046af0 con 0x7f0fa805ee70 2023-08-17T18:10:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.408+0000 7f0fbf7fe700 1 -- 172.21.15.78:0/3022563749 <== mgr.8844 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7f0fc8046af0 con 0x7f0fa805ee70 2023-08-17T18:10:17.408 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-08-17T18:10:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 -- 172.21.15.78:0/3022563749 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0fa805ee70 msgr2=0x7f0fa8061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0fa805ee70 0x7f0fa8061330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0fb8009dc0 tx=0x7f0fb8009060).stop 2023-08-17T18:10:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 -- 172.21.15.78:0/3022563749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc80c5810 msgr2=0x7f0fc80c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc80c5810 0x7f0fc80c2ab0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f0fc000b610 tx=0x7f0fc0009840).stop 2023-08-17T18:10:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 -- 172.21.15.78:0/3022563749 shutdown_connections 2023-08-17T18:10:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0fa805ee70 0x7f0fa8061330 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc80c5810 0x7f0fc80c2ab0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fc80aa0f0 0x7f0fc8158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 --2- 172.21.15.78:0/3022563749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fc80aa4d0 0x7f0fc81643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 -- 172.21.15.78:0/3022563749 >> 172.21.15.78:0/3022563749 conn(0x7f0fc806a6a0 msgr2=0x7f0fc80a8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 -- 172.21.15.78:0/3022563749 shutdown_connections 2023-08-17T18:10:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:17.410+0000 7f0fcd93b700 1 -- 172.21.15.78:0/3022563749 wait complete. 2023-08-17T18:10:17.422 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-08-17T18:10:17.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.422 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-17T18:10:17.437 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_55_00_UTC 2023-08-17T18:10:17.437 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_56_00_UTC 2023-08-17T18:10:17.437 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_57_00_UTC 2023-08-17T18:10:17.437 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_58_00_UTC 2023-08-17T18:10:17.437 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-17_59_00_UTC 2023-08-17T18:10:17.438 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_00_00_UTC 2023-08-17T18:10:17.438 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_01_00_UTC 2023-08-17T18:10:17.438 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_02_00_UTC 2023-08-17T18:10:17.438 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_03_00_UTC 2023-08-17T18:10:17.438 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_04_00_UTC 2023-08-17T18:10:17.438 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_05_00_UTC 2023-08-17T18:10:17.438 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_06_00_UTC 2023-08-17T18:10:17.438 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_07_00_UTC 2023-08-17T18:10:17.439 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_08_00_UTC 2023-08-17T18:10:17.439 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_09_00_UTC 2023-08-17T18:10:17.439 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_10_00_UTC 2023-08-17T18:10:17.440 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-17_55_00_UTC 2023-08-17T18:10:17.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.440 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-17_55_00_UTC) 2023-08-17T18:10:17.500 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-17_56_00_UTC 2023-08-17T18:10:17.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.500 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-17_56_00_UTC) 2023-08-17T18:10:17.559 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-17_57_00_UTC 2023-08-17T18:10:17.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.560 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-17_57_00_UTC) 2023-08-17T18:10:17.619 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-17_58_00_UTC 2023-08-17T18:10:17.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.619 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-17_58_00_UTC) 2023-08-17T18:10:17.678 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-17_59_00_UTC 2023-08-17T18:10:17.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.679 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-17_59_00_UTC) 2023-08-17T18:10:17.737 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_00_00_UTC 2023-08-17T18:10:17.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.738 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_00_00_UTC) 2023-08-17T18:10:17.797 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_01_00_UTC 2023-08-17T18:10:17.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.798 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_01_00_UTC) 2023-08-17T18:10:17.857 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_02_00_UTC 2023-08-17T18:10:17.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.858 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_02_00_UTC) 2023-08-17T18:10:17.917 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_03_00_UTC 2023-08-17T18:10:17.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.918 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_03_00_UTC) 2023-08-17T18:10:17.977 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_04_00_UTC 2023-08-17T18:10:17.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:17.978 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_04_00_UTC) 2023-08-17T18:10:18.038 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_05_00_UTC 2023-08-17T18:10:18.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:18.039 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_05_00_UTC) 2023-08-17T18:10:18.100 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_06_00_UTC 2023-08-17T18:10:18.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:18.100 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_06_00_UTC) 2023-08-17T18:10:18.159 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_07_00_UTC 2023-08-17T18:10:18.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:18.159 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_07_00_UTC) 2023-08-17T18:10:18.217 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_08_00_UTC 2023-08-17T18:10:18.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:18.218 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_08_00_UTC) 2023-08-17T18:10:18.277 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_09_00_UTC 2023-08-17T18:10:18.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:18.278 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_09_00_UTC) 2023-08-17T18:10:18.337 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_10_00_UTC 2023-08-17T18:10:18.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:18.338 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-17-18_10_00_UTC) 2023-08-17T18:10:18.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:18.397 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-08-17T18:10:18.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-17T18:10:18.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.606+0000 7fbcbcd39700 1 Processor -- start 2023-08-17T18:10:18.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.606+0000 7fbcbcd39700 1 -- start start 2023-08-17T18:10:18.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.607+0000 7fbcbcd39700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbcb80aa0f0 0x7fbcb80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:18.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.607+0000 7fbcbcd39700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcb80aa4d0 0x7fbcb80c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:18.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.607+0000 7fbcbcd39700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb80649b0 con 0x7fbcb80c5810 2023-08-17T18:10:18.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.607+0000 7fbcbcd39700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb8063420 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.607+0000 7fbcbcd39700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8063700 con 0x7fbcb80aa4d0 2023-08-17T18:10:18.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.607+0000 7fbcb659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbcb80aa0f0 0x7fbcb80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:18.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.607+0000 7fbcb659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbcb80aa0f0 0x7fbcb80644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59298/0 (socket says 172.21.15.78:59298) 2023-08-17T18:10:18.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.607+0000 7fbcb659c700 1 -- 172.21.15.78:0/236497035 learned_addr learned my addr 172.21.15.78:0/236497035 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:18.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcb659c700 1 -- 172.21.15.78:0/236497035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcb80aa4d0 msgr2=0x7fbcb80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:18.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcb659c700 1 --2- 172.21.15.78:0/236497035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcb80aa4d0 0x7fbcb80c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:18.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcb659c700 1 -- 172.21.15.78:0/236497035 >> v1:172.21.15.150:6789/0 conn(0x7fbcb80c5810 legacy=0x7fbcb80c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:18.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcb659c700 1 -- 172.21.15.78:0/236497035 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80639e0 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcb659c700 1 --2- 172.21.15.78:0/236497035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 0x7fbcb80644c0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7fbca8006fd0 tx=0x7fbca80090f0).ready entity=mon.0 client_cookie=eefdbb3f6c2d6623 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:18.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcb5d9b700 1 -- 172.21.15.78:0/236497035 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca800b600 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcb5d9b700 1 -- 172.21.15.78:0/236497035 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca800b760 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcb5d9b700 1 -- 172.21.15.78:0/236497035 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca800bae0 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcbcd39700 1 -- 172.21.15.78:0/236497035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 msgr2=0x7fbcb80644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:18.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcbcd39700 1 --2- 172.21.15.78:0/236497035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 0x7fbcb80644c0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7fbca8006fd0 tx=0x7fbca80090f0).stop 2023-08-17T18:10:18.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcbcd39700 1 -- 172.21.15.78:0/236497035 shutdown_connections 2023-08-17T18:10:18.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcbcd39700 1 --2- 172.21.15.78:0/236497035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 0x7fbcb80644c0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:18.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcbcd39700 1 --2- 172.21.15.78:0/236497035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcb80aa4d0 0x7fbcb80c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:18.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcbcd39700 1 -- 172.21.15.78:0/236497035 >> 172.21.15.78:0/236497035 conn(0x7fbcb806a6a0 msgr2=0x7fbcb80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcbcd39700 1 -- 172.21.15.78:0/236497035 shutdown_connections 2023-08-17T18:10:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.608+0000 7fbcbcd39700 1 -- 172.21.15.78:0/236497035 wait complete. 2023-08-17T18:10:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.610+0000 7fbcbcd39700 1 Processor -- start 2023-08-17T18:10:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.610+0000 7fbcbcd39700 1 -- start start 2023-08-17T18:10:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.610+0000 7fbcbcd39700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 0x7fbcb8145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.610+0000 7fbcbcd39700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcb80aa4d0 0x7fbcb80c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.610+0000 7fbcbcd39700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcb80c5810 0x7fbcb80c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.610+0000 7fbcbcd39700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80ca460 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.610+0000 7fbcbcd39700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80aa9b0 con 0x7fbcb80aa4d0 2023-08-17T18:10:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.610+0000 7fbcbcd39700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80ab530 con 0x7fbcb80c5810 2023-08-17T18:10:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcb659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 0x7fbcb8145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcb659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 0x7fbcb8145d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59314/0 (socket says 172.21.15.78:59314) 2023-08-17T18:10:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcb659c700 1 -- 172.21.15.78:0/3759965862 learned_addr learned my addr 172.21.15.78:0/3759965862 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcb659c700 1 -- 172.21.15.78:0/3759965862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcb80c5810 msgr2=0x7fbcb80c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcb659c700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcb80c5810 0x7fbcb80c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:18.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcb659c700 1 -- 172.21.15.78:0/3759965862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcb80aa4d0 msgr2=0x7fbcb80c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:18.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcb659c700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcb80aa4d0 0x7fbcb80c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:18.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcb659c700 1 -- 172.21.15.78:0/3759965862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca8009370 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcb659c700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 0x7fbcb8145d10 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fbca8009f50 tx=0x7fbca8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:18.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcaeffd700 1 -- 172.21.15.78:0/3759965862 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca800b8d0 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcaeffd700 1 -- 172.21.15.78:0/3759965862 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca800ba30 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcaeffd700 1 -- 172.21.15.78:0/3759965862 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca80246c0 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcbcd39700 1 -- 172.21.15.78:0/3759965862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb80ab9c0 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.611+0000 7fbcbcd39700 1 -- 172.21.15.78:0/3759965862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb80aaee0 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.612+0000 7fbcbcd39700 1 -- 172.21.15.78:0/3759965862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb8083980 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.612+0000 7fbcaeffd700 1 -- 172.21.15.78:0/3759965862 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 75) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fbca800f070 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.613+0000 7fbcaeffd700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbc9805ee70 0x7fbc98061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:18.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.613+0000 7fbcaeffd700 1 -- 172.21.15.78:0/3759965862 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6523+0+0 (secure 0 0 0) 0x7fbca807bd00 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.613+0000 7fbcadd9b700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbc9805ee70 0x7fbc98061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:18.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.613+0000 7fbcadd9b700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbc9805ee70 0x7fbc98061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbcb80c8dc0 tx=0x7fbca0006c30).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:18.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.617+0000 7fbcaeffd700 1 -- 172.21.15.78:0/3759965862 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbca804cfe0 con 0x7fbcb80aa0f0 2023-08-17T18:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:18.825+0000 7fbcbcd39700 1 -- 172.21.15.78:0/3759965862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fbcb8046af0 con 0x7fbcb80aa0f0 2023-08-17T18:10:19.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.722+0000 7fbcaeffd700 1 -- 172.21.15.78:0/3759965862 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fbca8079940 con 0x7fbcb80aa0f0 2023-08-17T18:10:19.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.726+0000 7fbcaeffd700 1 -- 172.21.15.78:0/3759965862 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v76) v1 ==== 93+0+0 (secure 0 0 0) 0x7fbca8042a60 con 0x7fbcb80aa0f0 2023-08-17T18:10:19.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.729+0000 7fbcbcd39700 1 -- 172.21.15.78:0/3759965862 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbc9805ee70 msgr2=0x7fbc98061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:19.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.729+0000 7fbcbcd39700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbc9805ee70 0x7fbc98061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbcb80c8dc0 tx=0x7fbca0006c30).stop 2023-08-17T18:10:19.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.729+0000 7fbcbcd39700 1 -- 172.21.15.78:0/3759965862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 msgr2=0x7fbcb8145d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:19.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.729+0000 7fbcbcd39700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 0x7fbcb8145d10 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fbca8009f50 tx=0x7fbca8017000).stop 2023-08-17T18:10:19.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.731+0000 7fbcbcd39700 1 -- 172.21.15.78:0/3759965862 shutdown_connections 2023-08-17T18:10:19.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.731+0000 7fbcbcd39700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbc9805ee70 0x7fbc98061330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:19.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.731+0000 7fbcbcd39700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcb80c5810 0x7fbcb80c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:19.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.731+0000 7fbcbcd39700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb80aa0f0 0x7fbcb8145d10 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:19.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.731+0000 7fbcbcd39700 1 --2- 172.21.15.78:0/3759965862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcb80aa4d0 0x7fbcb80c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:19.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.731+0000 7fbcbcd39700 1 -- 172.21.15.78:0/3759965862 >> 172.21.15.78:0/3759965862 conn(0x7fbcb806a6a0 msgr2=0x7fbcb8151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:19.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.731+0000 7fbcbcd39700 1 -- 172.21.15.78:0/3759965862 shutdown_connections 2023-08-17T18:10:19.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:19.731+0000 7fbcbcd39700 1 -- 172.21.15.78:0/3759965862 wait complete. 2023-08-17T18:10:19.750 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T18:10:19.750 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T18:10:19.794 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T18:10:19.832 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T18:10:19.833 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T18:10:19.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:19.833 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T18:10:19.877 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T18:10:19.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:10:19.878 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T18:10:19.884 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:19.884+0000 7f131c17f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:10:19.884 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:19.883+0000 7fb8e2c5c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:10:19.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:10:19.955 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:19.953+0000 7f131c17f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:10:19.956 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:19.954+0000 7fb8e2c5c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:10:20.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.085+0000 7f0e26510700 1 Processor -- start 2023-08-17T18:10:20.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.096+0000 7f0e26510700 1 -- start start 2023-08-17T18:10:20.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.097+0000 7f0e26510700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e2013b6e0 0x7f0e200c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.097+0000 7f0e26510700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0e20064340 0x7f0e200c4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.097+0000 7f0e26510700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e201530b0 con 0x7f0e200c15c0 2023-08-17T18:10:20.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.097+0000 7f0e26510700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e200655e0 con 0x7f0e20064340 2023-08-17T18:10:20.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.097+0000 7f0e26510700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e200c2910 con 0x7f0e2013b6e0 2023-08-17T18:10:20.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.097+0000 7f0e1f7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0e200c15c0 0x7f0e20063c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:57106/0 (socket says 172.21.15.78:57106) 2023-08-17T18:10:20.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.097+0000 7f0e1f7fe700 1 -- 172.21.15.78:0/1176497606 learned_addr learned my addr 172.21.15.78:0/1176497606 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:20.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.097+0000 7f0e1ffff700 1 --2- 172.21.15.78:0/1176497606 >> v2:172.21.15.150:3300/0 conn(0x7f0e2013b6e0 0x7f0e200c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.098+0000 7f0e1ffff700 1 -- 172.21.15.78:0/1176497606 >> v2:172.21.15.78:3300/0 conn(0x7f0e20064340 msgr2=0x7f0e200c4630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-17T18:10:20.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.098+0000 7f0e1ffff700 1 --2- 172.21.15.78:0/1176497606 >> v2:172.21.15.78:3300/0 conn(0x7f0e20064340 0x7f0e200c4630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:20.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.098+0000 7f0e1ffff700 1 -- 172.21.15.78:0/1176497606 >> v1:172.21.15.150:6789/0 conn(0x7f0e200c15c0 legacy=0x7f0e20063c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.098+0000 7f0e1ffff700 1 -- 172.21.15.78:0/1176497606 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e200c1a40 con 0x7f0e2013b6e0 2023-08-17T18:10:20.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.099+0000 7f0e1ffff700 1 --2- 172.21.15.78:0/1176497606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e2013b6e0 0x7f0e200c10d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f0e200c10a0 tx=0x7f0e18009780).ready entity=mon.1 client_cookie=e209dede63e9c02a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:20.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.099+0000 7f0e1effd700 1 -- 172.21.15.78:0/1176497606 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800e070 con 0x7f0e2013b6e0 2023-08-17T18:10:20.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.099+0000 7f0e1effd700 1 -- 172.21.15.78:0/1176497606 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1800bc30 con 0x7f0e2013b6e0 2023-08-17T18:10:20.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.099+0000 7f0e1effd700 1 -- 172.21.15.78:0/1176497606 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18012410 con 0x7f0e2013b6e0 2023-08-17T18:10:20.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.100+0000 7f0e26510700 1 -- 172.21.15.78:0/1176497606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e2013b6e0 msgr2=0x7f0e200c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.100+0000 7f0e26510700 1 --2- 172.21.15.78:0/1176497606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e2013b6e0 0x7f0e200c10d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f0e200c10a0 tx=0x7f0e18009780).stop 2023-08-17T18:10:20.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.101+0000 7f0e26510700 1 -- 172.21.15.78:0/1176497606 shutdown_connections 2023-08-17T18:10:20.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.101+0000 7f0e26510700 1 --2- 172.21.15.78:0/1176497606 >> v2:172.21.15.78:3300/0 conn(0x7f0e20064340 0x7f0e200c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:20.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.101+0000 7f0e26510700 1 --2- 172.21.15.78:0/1176497606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e2013b6e0 0x7f0e200c10d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.101+0000 7f0e26510700 1 -- 172.21.15.78:0/1176497606 >> 172.21.15.78:0/1176497606 conn(0x7f0e20062fc0 msgr2=0x7f0e200c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:20.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.101+0000 7f0e26510700 1 -- 172.21.15.78:0/1176497606 shutdown_connections 2023-08-17T18:10:20.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.101+0000 7f0e26510700 1 -- 172.21.15.78:0/1176497606 wait complete. 2023-08-17T18:10:20.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.103+0000 7f0e26510700 1 Processor -- start 2023-08-17T18:10:20.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.103+0000 7f0e26510700 1 -- start start 2023-08-17T18:10:20.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.104+0000 7f0e26510700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e20064340 0x7f0e200c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.104+0000 7f0e26510700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e200c15c0 0x7f0e200bda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.104+0000 7f0e26510700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e2013b6e0 0x7f0e20158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.104+0000 7f0e26510700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200be250 con 0x7f0e200c15c0 2023-08-17T18:10:20.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.104+0000 7f0e26510700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200ab570 con 0x7f0e20064340 2023-08-17T18:10:20.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.104+0000 7f0e26510700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e20169260 con 0x7f0e2013b6e0 2023-08-17T18:10:20.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.104+0000 7f0e1ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e20064340 0x7f0e200c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.104+0000 7f0e1ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e20064340 0x7f0e200c0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:56808/0 (socket says 172.21.15.78:56808) 2023-08-17T18:10:20.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.105+0000 7f0e1ffff700 1 -- 172.21.15.78:0/4053826217 learned_addr learned my addr 172.21.15.78:0/4053826217 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:20.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.105+0000 7f0e1f7fe700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e200c15c0 0x7f0e200bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.105+0000 7f0e24aad700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e2013b6e0 0x7f0e20158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.105+0000 7f0e1f7fe700 1 -- 172.21.15.78:0/4053826217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e2013b6e0 msgr2=0x7f0e20158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.105+0000 7f0e1f7fe700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e2013b6e0 0x7f0e20158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.105+0000 7f0e1f7fe700 1 -- 172.21.15.78:0/4053826217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e20064340 msgr2=0x7f0e200c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.105+0000 7f0e1f7fe700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e20064340 0x7f0e200c0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.105+0000 7f0e1f7fe700 1 -- 172.21.15.78:0/4053826217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18009a20 con 0x7f0e200c15c0 2023-08-17T18:10:20.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.105+0000 7f0e24aad700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e2013b6e0 0x7f0e20158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:20.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.105+0000 7f0e1f7fe700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e200c15c0 0x7f0e200bda90 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f0e1000c470 tx=0x7f0e10007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:20.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.106+0000 7f0e0ffff700 1 -- 172.21.15.78:0/4053826217 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100070d0 con 0x7f0e200c15c0 2023-08-17T18:10:20.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.106+0000 7f0e0ffff700 1 -- 172.21.15.78:0/4053826217 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e10007230 con 0x7f0e200c15c0 2023-08-17T18:10:20.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.106+0000 7f0e26510700 1 -- 172.21.15.78:0/4053826217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e200bdf80 con 0x7f0e200c15c0 2023-08-17T18:10:20.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.106+0000 7f0e0ffff700 1 -- 172.21.15.78:0/4053826217 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100075b0 con 0x7f0e200c15c0 2023-08-17T18:10:20.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.106+0000 7f0e26510700 1 -- 172.21.15.78:0/4053826217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e200ab290 con 0x7f0e200c15c0 2023-08-17T18:10:20.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.107+0000 7f0e26510700 1 -- 172.21.15.78:0/4053826217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e201693f0 con 0x7f0e200c15c0 2023-08-17T18:10:20.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.108+0000 7f0e0ffff700 1 -- 172.21.15.78:0/4053826217 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f0e10010070 con 0x7f0e200c15c0 2023-08-17T18:10:20.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.108+0000 7f0e0ffff700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e0405edf0 0x7f0e040612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.109+0000 7f0e0ffff700 1 -- 172.21.15.78:0/4053826217 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6611+0+0 (secure 0 0 0) 0x7f0e100791a0 con 0x7f0e200c15c0 2023-08-17T18:10:20.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.112+0000 7f0e1ffff700 1 -- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e0405edf0 msgr2=0x7f0e040612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:20.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.112+0000 7f0e1ffff700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e0405edf0 0x7f0e040612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:20.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.114+0000 7f0e0ffff700 1 -- 172.21.15.78:0/4053826217 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e1004a530 con 0x7f0e200c15c0 2023-08-17T18:10:20.262 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:20.261+0000 7fb8e2c5c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:10:20.277 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:20.277+0000 7f131c17f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:10:20.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.313+0000 7f0e1ffff700 1 -- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e0405edf0 msgr2=0x7f0e040612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:20.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.313+0000 7f0e1ffff700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e0405edf0 0x7f0e040612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:10:20.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.326+0000 7f0e26510700 1 -- 172.21.15.78:0/4053826217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e20047350 con 0x7f0e200c15c0 2023-08-17T18:10:20.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.327+0000 7f0e0ffff700 1 -- 172.21.15.78:0/4053826217 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f0e1004db50 con 0x7f0e200c15c0 2023-08-17T18:10:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:20.327 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":55,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/948559321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":948559321},{"type":"v1","addr":"172.21.15.150:6834","nonce":948559321}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/323810610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":323810610},{"type":"v1","addr":"172.21.15.78:6836","nonce":323810610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/246455712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":246455712},{"type":"v1","addr":"172.21.15.78:6837","nonce":246455712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:48.889332+0000","modified":"2023-08-17T17:53:50.895449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1383305491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1383305491},{"type":"v1","addr":"172.21.15.150:6835","nonce":1383305491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T18:10:20.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 -- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e0405edf0 msgr2=0x7f0e040612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:20.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e0405edf0 0x7f0e040612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:20.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 -- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e200c15c0 msgr2=0x7f0e200bda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e200c15c0 0x7f0e200bda90 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f0e1000c470 tx=0x7f0e10007d90).stop 2023-08-17T18:10:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 -- 172.21.15.78:0/4053826217 shutdown_connections 2023-08-17T18:10:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e0405edf0 0x7f0e040612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e2013b6e0 0x7f0e20158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e20064340 0x7f0e200c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 --2- 172.21.15.78:0/4053826217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e200c15c0 0x7f0e200bda90 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 -- 172.21.15.78:0/4053826217 >> 172.21.15.78:0/4053826217 conn(0x7f0e20062fc0 msgr2=0x7f0e200c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 -- 172.21.15.78:0/4053826217 shutdown_connections 2023-08-17T18:10:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.329+0000 7f0e26510700 1 -- 172.21.15.78:0/4053826217 wait complete. 2023-08-17T18:10:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 55 2023-08-17T18:10:20.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:10:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.496+0000 7efca8db4700 1 Processor -- start 2023-08-17T18:10:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.497+0000 7efca8db4700 1 -- start start 2023-08-17T18:10:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca8db4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efca4066a40 0x7efca40624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca8db4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca40c6040 con 0x7efca40629e0 2023-08-17T18:10:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca8db4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca4069b00 con 0x7efca4066660 2023-08-17T18:10:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca8db4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca4062e50 con 0x7efca4066a40 2023-08-17T18:10:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca1d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efca4066a40 0x7efca40624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca2d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efca40629e0 0x7efca4151570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48004/0 (socket says 172.21.15.78:48004) 2023-08-17T18:10:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca2d9d700 1 -- 172.21.15.78:0/4078102043 learned_addr learned my addr 172.21.15.78:0/4078102043 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca1d9b700 1 -- 172.21.15.78:0/4078102043 >> v1:172.21.15.150:6789/0 conn(0x7efca4066660 legacy=0x7efca40c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca1d9b700 1 -- 172.21.15.78:0/4078102043 >> v1:172.21.15.78:6789/0 conn(0x7efca40629e0 legacy=0x7efca4151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca159a700 1 -- 172.21.15.78:0/4078102043 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518565611 0 0) 0x7efc9c001490 con 0x7efca40629e0 2023-08-17T18:10:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca1d9b700 1 -- 172.21.15.78:0/4078102043 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca4069f90 con 0x7efca4066a40 2023-08-17T18:10:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca1d9b700 1 --2- 172.21.15.78:0/4078102043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066a40 0x7efca40624f0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7efc8c009760 tx=0x7efc8c009060).ready entity=mon.0 client_cookie=72bd30537a6c7093 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca159a700 1 -- 172.21.15.78:0/4078102043 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00b580 con 0x7efca4066a40 2023-08-17T18:10:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca159a700 1 -- 172.21.15.78:0/4078102043 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c00b6e0 con 0x7efca4066a40 2023-08-17T18:10:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.498+0000 7efca159a700 1 -- 172.21.15.78:0/4078102043 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00ba60 con 0x7efca4066a40 2023-08-17T18:10:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.499+0000 7efca8db4700 1 -- 172.21.15.78:0/4078102043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066a40 msgr2=0x7efca40624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.499+0000 7efca8db4700 1 --2- 172.21.15.78:0/4078102043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066a40 0x7efca40624f0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7efc8c009760 tx=0x7efc8c009060).stop 2023-08-17T18:10:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.499+0000 7efca8db4700 1 -- 172.21.15.78:0/4078102043 shutdown_connections 2023-08-17T18:10:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.499+0000 7efca8db4700 1 --2- 172.21.15.78:0/4078102043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066a40 0x7efca40624f0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.499+0000 7efca8db4700 1 -- 172.21.15.78:0/4078102043 >> 172.21.15.78:0/4078102043 conn(0x7efca40c7b00 msgr2=0x7efca40c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.499+0000 7efca8db4700 1 -- 172.21.15.78:0/4078102043 shutdown_connections 2023-08-17T18:10:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.499+0000 7efca8db4700 1 -- 172.21.15.78:0/4078102043 wait complete. 2023-08-17T18:10:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.500+0000 7efca8db4700 1 Processor -- start 2023-08-17T18:10:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.500+0000 7efca8db4700 1 -- start start 2023-08-17T18:10:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca8db4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca40629e0 0x7efca4152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca8db4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066660 0x7efca40c0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca8db4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca4066a40 0x7efca40c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca8db4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40c11f0 con 0x7efca4066660 2023-08-17T18:10:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca8db4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40bfa60 con 0x7efca4066a40 2023-08-17T18:10:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca8db4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca40bfd40 con 0x7efca40629e0 2023-08-17T18:10:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca1d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066660 0x7efca40c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca1d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066660 0x7efca40c0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59358/0 (socket says 172.21.15.78:59358) 2023-08-17T18:10:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca1d9b700 1 -- 172.21.15.78:0/2266783009 learned_addr learned my addr 172.21.15.78:0/2266783009 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca2d9d700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca4066a40 0x7efca40c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca259c700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca40629e0 0x7efca4152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca1d9b700 1 -- 172.21.15.78:0/2266783009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca40629e0 msgr2=0x7efca4152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca1d9b700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca40629e0 0x7efca4152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca1d9b700 1 -- 172.21.15.78:0/2266783009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca4066a40 msgr2=0x7efca40c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca1d9b700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca4066a40 0x7efca40c0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.501+0000 7efca1d9b700 1 -- 172.21.15.78:0/2266783009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0092a0 con 0x7efca4066660 2023-08-17T18:10:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.502+0000 7efca1d9b700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066660 0x7efca40c0810 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7efca405f3a0 tx=0x7efc8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.502+0000 7efc9a7fc700 1 -- 172.21.15.78:0/2266783009 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00b850 con 0x7efca4066660 2023-08-17T18:10:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.502+0000 7efc9a7fc700 1 -- 172.21.15.78:0/2266783009 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c00b9b0 con 0x7efca4066660 2023-08-17T18:10:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.502+0000 7efca8db4700 1 -- 172.21.15.78:0/2266783009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca40c0020 con 0x7efca4066660 2023-08-17T18:10:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.502+0000 7efc9a7fc700 1 -- 172.21.15.78:0/2266783009 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c01b620 con 0x7efca4066660 2023-08-17T18:10:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.502+0000 7efca8db4700 1 -- 172.21.15.78:0/2266783009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca4152fb0 con 0x7efca4066660 2023-08-17T18:10:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.503+0000 7efca8db4700 1 -- 172.21.15.78:0/2266783009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca40a6fb0 con 0x7efca4066660 2023-08-17T18:10:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.503+0000 7efc9a7fc700 1 -- 172.21.15.78:0/2266783009 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7efc8c02b070 con 0x7efca4066660 2023-08-17T18:10:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.504+0000 7efc9a7fc700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc8405ee20 0x7efc840612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.504+0000 7efca259c700 1 -- 172.21.15.78:0/2266783009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc8405ee20 msgr2=0x7efc840612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.504+0000 7efc9a7fc700 1 -- 172.21.15.78:0/2266783009 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6611+0+0 (secure 0 0 0) 0x7efc8c07b650 con 0x7efca4066660 2023-08-17T18:10:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.504+0000 7efca259c700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc8405ee20 0x7efc840612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.508+0000 7efc9a7fc700 1 -- 172.21.15.78:0/2266783009 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc8c04c9e0 con 0x7efca4066660 2023-08-17T18:10:20.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.680+0000 7efca8db4700 1 -- 172.21.15.78:0/2266783009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efca4069790 con 0x7efca4066660 2023-08-17T18:10:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.681+0000 7efc9a7fc700 1 -- 172.21.15.78:0/2266783009 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+17744 (secure 0 0 0) 0x7efc8c029090 con 0x7efca4066660 2023-08-17T18:10:20.682 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:20.682 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":154,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:10:19.712207+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:47.436687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:47.849880+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":32,"snap_epoch":154,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.3f","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/3977763008":"2023-08-18T18:05:20.568126+0000","172.21.15.78:0/2748193833":"2023-08-18T18:05:20.568126+0000","172.21.15.78:0/303775003":"2023-08-18T18:05:20.568126+0000","172.21.15.78:0/1641268059":"2023-08-18T18:05:20.568126+0000","172.21.15.78:6833/119464":"2023-08-18T17:54:04.156331+0000","172.21.15.78:0/1601918675":"2023-08-18T17:54:04.156331+0000","172.21.15.78:6832/119464":"2023-08-18T17:54:04.156331+0000","172.21.15.78:0/1263954043":"2023-08-18T17:54:04.156331+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":20,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:10:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 -- 172.21.15.78:0/2266783009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc8405ee20 msgr2=0x7efc840612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc8405ee20 0x7efc840612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 -- 172.21.15.78:0/2266783009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066660 msgr2=0x7efca40c0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066660 0x7efca40c0810 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7efca405f3a0 tx=0x7efc8c017000).stop 2023-08-17T18:10:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 -- 172.21.15.78:0/2266783009 shutdown_connections 2023-08-17T18:10:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc8405ee20 0x7efc840612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca4066a40 0x7efca40c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca40629e0 0x7efca4152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 --2- 172.21.15.78:0/2266783009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca4066660 0x7efca40c0810 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 -- 172.21.15.78:0/2266783009 >> 172.21.15.78:0/2266783009 conn(0x7efca40c7b00 msgr2=0x7efca40a5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 -- 172.21.15.78:0/2266783009 shutdown_connections 2023-08-17T18:10:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.683+0000 7efca8db4700 1 -- 172.21.15.78:0/2266783009 wait complete. 2023-08-17T18:10:20.695 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T17:53:47.436687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T17:53:47.849880+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 32, 'snap_epoch': 154, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T18:10:20.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T18:10:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.817+0000 7fe05db06700 1 Processor -- start 2023-08-17T18:10:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.817+0000 7fe05db06700 1 -- start start 2023-08-17T18:10:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.818+0000 7fe05db06700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe05813a740 0x7fe058069f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.818+0000 7fe05db06700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0580624f0 0x7fe058062970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.818+0000 7fe05db06700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0581545e0 0x7fe058154a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.818+0000 7fe05db06700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe058155640 con 0x7fe0580624f0 2023-08-17T18:10:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.818+0000 7fe05db06700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe058069b00 con 0x7fe05813a740 2023-08-17T18:10:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.818+0000 7fe05db06700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe058062e60 con 0x7fe0581545e0 2023-08-17T18:10:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.818+0000 7fe056ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0580624f0 0x7fe058062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.818+0000 7fe056ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0580624f0 0x7fe058062970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59364/0 (socket says 172.21.15.78:59364) 2023-08-17T18:10:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.818+0000 7fe056ffd700 1 -- 172.21.15.78:0/709878899 learned_addr learned my addr 172.21.15.78:0/709878899 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe057fff700 1 --2- 172.21.15.78:0/709878899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0581545e0 0x7fe058154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe0577fe700 1 --2- 172.21.15.78:0/709878899 >> v2:172.21.15.150:3300/0 conn(0x7fe05813a740 0x7fe058069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe056ffd700 1 -- 172.21.15.78:0/709878899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0581545e0 msgr2=0x7fe058154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe056ffd700 1 --2- 172.21.15.78:0/709878899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0581545e0 0x7fe058154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe056ffd700 1 -- 172.21.15.78:0/709878899 >> v2:172.21.15.150:3300/0 conn(0x7fe05813a740 msgr2=0x7fe058069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe056ffd700 1 --2- 172.21.15.78:0/709878899 >> v2:172.21.15.150:3300/0 conn(0x7fe05813a740 0x7fe058069f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe056ffd700 1 -- 172.21.15.78:0/709878899 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05813ab20 con 0x7fe0580624f0 2023-08-17T18:10:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe056ffd700 1 --2- 172.21.15.78:0/709878899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 0x7fe058062970 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7fe058069110 tx=0x7fe0480090f0).ready entity=mon.0 client_cookie=2307def0275be89b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:20.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe0567fc700 1 -- 172.21.15.78:0/709878899 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800f510 con 0x7fe0580624f0 2023-08-17T18:10:20.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe0567fc700 1 -- 172.21.15.78:0/709878899 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04800f670 con 0x7fe0580624f0 2023-08-17T18:10:20.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.819+0000 7fe0567fc700 1 -- 172.21.15.78:0/709878899 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800f9f0 con 0x7fe0580624f0 2023-08-17T18:10:20.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.820+0000 7fe05db06700 1 -- 172.21.15.78:0/709878899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 msgr2=0x7fe058062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.820+0000 7fe05db06700 1 --2- 172.21.15.78:0/709878899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 0x7fe058062970 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7fe058069110 tx=0x7fe0480090f0).stop 2023-08-17T18:10:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.820+0000 7fe05db06700 1 -- 172.21.15.78:0/709878899 shutdown_connections 2023-08-17T18:10:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.820+0000 7fe05db06700 1 --2- 172.21.15.78:0/709878899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0581545e0 0x7fe058154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.820+0000 7fe05db06700 1 --2- 172.21.15.78:0/709878899 >> v2:172.21.15.150:3300/0 conn(0x7fe05813a740 0x7fe058069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.820+0000 7fe05db06700 1 --2- 172.21.15.78:0/709878899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 0x7fe058062970 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.820+0000 7fe05db06700 1 -- 172.21.15.78:0/709878899 >> 172.21.15.78:0/709878899 conn(0x7fe0580c7b80 msgr2=0x7fe0580c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.820+0000 7fe05db06700 1 -- 172.21.15.78:0/709878899 shutdown_connections 2023-08-17T18:10:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.820+0000 7fe05db06700 1 -- 172.21.15.78:0/709878899 wait complete. 2023-08-17T18:10:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.821+0000 7fe05db06700 1 Processor -- start 2023-08-17T18:10:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.821+0000 7fe05db06700 1 -- start start 2023-08-17T18:10:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe05db06700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 0x7fe0580acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe05db06700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05813a740 0x7fe0580aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe05db06700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0581545e0 0x7fe058066460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe05db06700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580bf940 con 0x7fe0580624f0 2023-08-17T18:10:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe05db06700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580ad110 con 0x7fe0581545e0 2023-08-17T18:10:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe05db06700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580adc10 con 0x7fe05813a740 2023-08-17T18:10:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe0577fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 0x7fe0580acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe0577fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 0x7fe0580acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59370/0 (socket says 172.21.15.78:59370) 2023-08-17T18:10:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe0577fe700 1 -- 172.21.15.78:0/1475621504 learned_addr learned my addr 172.21.15.78:0/1475621504 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe056ffd700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05813a740 0x7fe0580aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe057fff700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0581545e0 0x7fe058066460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe0577fe700 1 -- 172.21.15.78:0/1475621504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05813a740 msgr2=0x7fe0580aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe0577fe700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05813a740 0x7fe0580aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe0577fe700 1 -- 172.21.15.78:0/1475621504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0581545e0 msgr2=0x7fe058066460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe0577fe700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0581545e0 0x7fe058066460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe0577fe700 1 -- 172.21.15.78:0/1475621504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe048009370 con 0x7fe0580624f0 2023-08-17T18:10:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe0577fe700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 0x7fe0580acc20 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7fe04c00e930 tx=0x7fe04c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.822+0000 7fe03f7fe700 1 -- 172.21.15.78:0/1475621504 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c012600 con 0x7fe0580624f0 2023-08-17T18:10:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.823+0000 7fe03f7fe700 1 -- 172.21.15.78:0/1475621504 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c012760 con 0x7fe0580624f0 2023-08-17T18:10:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.823+0000 7fe05db06700 1 -- 172.21.15.78:0/1475621504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0580ad370 con 0x7fe0580624f0 2023-08-17T18:10:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.823+0000 7fe03f7fe700 1 -- 172.21.15.78:0/1475621504 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c012ae0 con 0x7fe0580624f0 2023-08-17T18:10:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.823+0000 7fe05db06700 1 -- 172.21.15.78:0/1475621504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0580ad930 con 0x7fe0580624f0 2023-08-17T18:10:20.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.824+0000 7fe05db06700 1 -- 172.21.15.78:0/1475621504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0580bfc20 con 0x7fe0580624f0 2023-08-17T18:10:20.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.824+0000 7fe03f7fe700 1 -- 172.21.15.78:0/1475621504 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fe04c022070 con 0x7fe0580624f0 2023-08-17T18:10:20.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.824+0000 7fe03f7fe700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe04405ee20 0x7fe0440612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:20.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.824+0000 7fe056ffd700 1 -- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe04405ee20 msgr2=0x7fe0440612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:20.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.824+0000 7fe03f7fe700 1 -- 172.21.15.78:0/1475621504 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6595+0+0 (secure 0 0 0) 0x7fe04c07a060 con 0x7fe0580624f0 2023-08-17T18:10:20.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.824+0000 7fe056ffd700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe04405ee20 0x7fe0440612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:20.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:20.832+0000 7fe03f7fe700 1 -- 172.21.15.78:0/1475621504 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe04c04b400 con 0x7fe0580624f0 2023-08-17T18:10:20.880 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:20.879+0000 7fb8e2c5c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:10:20.947 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:20.948+0000 7f131c17f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:10:20.956 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:20.955+0000 7fb8e2c5c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:10:21.015 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:21.015+0000 7f131c17f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:10:21.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.025+0000 7fe056ffd700 1 -- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe04405ee20 msgr2=0x7fe0440612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:21.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.025+0000 7fe056ffd700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe04405ee20 0x7fe0440612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:10:21.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.045+0000 7fe05db06700 1 -- 172.21.15.78:0/1475621504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe058068270 con 0x7fe0580624f0 2023-08-17T18:10:21.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.045+0000 7fe03f7fe700 1 -- 172.21.15.78:0/1475621504 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v155) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe04c04ea20 con 0x7fe0580624f0 2023-08-17T18:10:21.045 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T18:10:21.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 -- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe04405ee20 msgr2=0x7fe0440612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:21.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe04405ee20 0x7fe0440612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:21.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 -- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 msgr2=0x7fe0580acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 0x7fe0580acc20 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7fe04c00e930 tx=0x7fe04c009060).stop 2023-08-17T18:10:21.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 -- 172.21.15.78:0/1475621504 shutdown_connections 2023-08-17T18:10:21.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe04405ee20 0x7fe0440612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:21.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0581545e0 0x7fe058066460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580624f0 0x7fe0580acc20 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 --2- 172.21.15.78:0/1475621504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05813a740 0x7fe0580aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 -- 172.21.15.78:0/1475621504 >> 172.21.15.78:0/1475621504 conn(0x7fe0580c7b80 msgr2=0x7fe0580c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 -- 172.21.15.78:0/1475621504 shutdown_connections 2023-08-17T18:10:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.047+0000 7fe05db06700 1 -- 172.21.15.78:0/1475621504 wait complete. 2023-08-17T18:10:21.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T18:10:21.141 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:21.140+0000 7fb8e2c5c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:10:21.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.180+0000 7f57c6890700 1 Processor -- start 2023-08-17T18:10:21.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.180+0000 7f57c6890700 1 -- start start 2023-08-17T18:10:21.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57c6890700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57c014ea60 0x7f57c0069310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57c6890700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f57c0069800 0x7f57c00bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57c6890700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c00c5990 con 0x7f57c014e680 2023-08-17T18:10:21.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57c6890700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c00bcc10 con 0x7f57c0069800 2023-08-17T18:10:21.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57c6890700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0069c90 con 0x7f57c014ea60 2023-08-17T18:10:21.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57c4e2d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f57c0069800 0x7f57c00bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57bffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f57c014e680 0x7f57c00c2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48006/0 (socket says 172.21.15.78:48006) 2023-08-17T18:10:21.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57bffff700 1 -- 172.21.15.78:0/718281200 learned_addr learned my addr 172.21.15.78:0/718281200 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:21.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57bf7fe700 1 --2- 172.21.15.78:0/718281200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57c014ea60 0x7f57c0069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57beffd700 1 -- 172.21.15.78:0/718281200 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466988579 0 0) 0x7f57c00c5990 con 0x7f57c014e680 2023-08-17T18:10:21.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57beffd700 1 -- 172.21.15.78:0/718281200 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a80033f0 con 0x7f57c014e680 2023-08-17T18:10:21.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57c4e2d700 1 -- 172.21.15.78:0/718281200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57c014ea60 msgr2=0x7f57c0069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:21.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57c4e2d700 1 --2- 172.21.15.78:0/718281200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57c014ea60 0x7f57c0069310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57c4e2d700 1 -- 172.21.15.78:0/718281200 >> v1:172.21.15.78:6789/0 conn(0x7f57c014e680 legacy=0x7f57c00c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.182+0000 7f57c4e2d700 1 -- 172.21.15.78:0/718281200 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00c4120 con 0x7f57c0069800 2023-08-17T18:10:21.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.183+0000 7f57c4e2d700 1 --2- 172.21.15.78:0/718281200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0069800 0x7f57c00bd0a0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f57b8009e60 tx=0x7f57b8009780).ready entity=mon.0 client_cookie=b359a004b4cd959b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:21.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.183+0000 7f57beffd700 1 -- 172.21.15.78:0/718281200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800e070 con 0x7f57c0069800 2023-08-17T18:10:21.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.183+0000 7f57beffd700 1 -- 172.21.15.78:0/718281200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b800bab0 con 0x7f57c0069800 2023-08-17T18:10:21.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.183+0000 7f57beffd700 1 -- 172.21.15.78:0/718281200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800be30 con 0x7f57c0069800 2023-08-17T18:10:21.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.184+0000 7f57c6890700 1 -- 172.21.15.78:0/718281200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0069800 msgr2=0x7f57c00bd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.184+0000 7f57c6890700 1 --2- 172.21.15.78:0/718281200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0069800 0x7f57c00bd0a0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f57b8009e60 tx=0x7f57b8009780).stop 2023-08-17T18:10:21.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.184+0000 7f57c6890700 1 -- 172.21.15.78:0/718281200 shutdown_connections 2023-08-17T18:10:21.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.184+0000 7f57c6890700 1 --2- 172.21.15.78:0/718281200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0069800 0x7f57c00bd0a0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.184+0000 7f57c6890700 1 --2- 172.21.15.78:0/718281200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57c014ea60 0x7f57c0069310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.184+0000 7f57c6890700 1 -- 172.21.15.78:0/718281200 >> 172.21.15.78:0/718281200 conn(0x7f57c00c7b80 msgr2=0x7f57c00c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:21.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.184+0000 7f57c6890700 1 -- 172.21.15.78:0/718281200 shutdown_connections 2023-08-17T18:10:21.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.184+0000 7f57c6890700 1 -- 172.21.15.78:0/718281200 wait complete. 2023-08-17T18:10:21.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.185+0000 7f57c6890700 1 Processor -- start 2023-08-17T18:10:21.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.186+0000 7f57c6890700 1 -- start start 2023-08-17T18:10:21.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c6890700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57c0069800 0x7f57c014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c6890700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57c014e680 0x7f57c013f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c6890700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c014ea60 0x7f57c00a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c6890700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00a0a70 con 0x7f57c014ea60 2023-08-17T18:10:21.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c6890700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00a0460 con 0x7f57c014e680 2023-08-17T18:10:21.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c6890700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00ad590 con 0x7f57c0069800 2023-08-17T18:10:21.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c4e2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c014ea60 0x7f57c00a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c4e2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c014ea60 0x7f57c00a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59388/0 (socket says 172.21.15.78:59388) 2023-08-17T18:10:21.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c4e2d700 1 -- 172.21.15.78:0/2140143301 learned_addr learned my addr 172.21.15.78:0/2140143301 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:21.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57bffff700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57c0069800 0x7f57c014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57bf7fe700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57c014e680 0x7f57c013f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c4e2d700 1 -- 172.21.15.78:0/2140143301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57c0069800 msgr2=0x7f57c014bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c4e2d700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57c0069800 0x7f57c014bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c4e2d700 1 -- 172.21.15.78:0/2140143301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57c014e680 msgr2=0x7f57c013f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c4e2d700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57c014e680 0x7f57c013f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.187+0000 7f57c4e2d700 1 -- 172.21.15.78:0/2140143301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8009a20 con 0x7f57c014ea60 2023-08-17T18:10:21.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.188+0000 7f57c4e2d700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c014ea60 0x7f57c00a0f00 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f57b800b610 tx=0x7f57b8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:21.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.188+0000 7f57a7fff700 1 -- 172.21.15.78:0/2140143301 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8013e70 con 0x7f57c014ea60 2023-08-17T18:10:21.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.188+0000 7f57a7fff700 1 -- 172.21.15.78:0/2140143301 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b801d630 con 0x7f57c014ea60 2023-08-17T18:10:21.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.188+0000 7f57c6890700 1 -- 172.21.15.78:0/2140143301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c00ad870 con 0x7f57c014ea60 2023-08-17T18:10:21.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.188+0000 7f57a7fff700 1 -- 172.21.15.78:0/2140143301 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b801d9f0 con 0x7f57c014ea60 2023-08-17T18:10:21.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.188+0000 7f57c6890700 1 -- 172.21.15.78:0/2140143301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c013fbf0 con 0x7f57c014ea60 2023-08-17T18:10:21.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.189+0000 7f57c6890700 1 -- 172.21.15.78:0/2140143301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c00a0be0 con 0x7f57c014ea60 2023-08-17T18:10:21.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.189+0000 7f57a7fff700 1 -- 172.21.15.78:0/2140143301 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f57b8026410 con 0x7f57c014ea60 2023-08-17T18:10:21.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.189+0000 7f57a7fff700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f57ac05edf0 0x7f57ac0612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.189+0000 7f57bffff700 1 -- 172.21.15.78:0/2140143301 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f57ac05edf0 msgr2=0x7f57ac0612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:21.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.189+0000 7f57a7fff700 1 -- 172.21.15.78:0/2140143301 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6595+0+0 (secure 0 0 0) 0x7f57b807bf30 con 0x7f57c014ea60 2023-08-17T18:10:21.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.189+0000 7f57bffff700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f57ac05edf0 0x7f57ac0612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:21.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.193+0000 7f57a7fff700 1 -- 172.21.15.78:0/2140143301 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57b80aa8f0 con 0x7f57c014ea60 2023-08-17T18:10:21.215 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:21.215+0000 7f131c17f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:10:21.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.364+0000 7f57c6890700 1 -- 172.21.15.78:0/2140143301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f57c0046af0 con 0x7f57c014ea60 2023-08-17T18:10:21.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.364+0000 7f57a7fff700 1 -- 172.21.15.78:0/2140143301 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7f57b804d270 con 0x7f57c014ea60 2023-08-17T18:10:21.364 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T18:10:21.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.366+0000 7f57c6890700 1 -- 172.21.15.78:0/2140143301 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f57ac05edf0 msgr2=0x7f57ac0612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:21.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.366+0000 7f57c6890700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f57ac05edf0 0x7f57ac0612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:21.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.366+0000 7f57c6890700 1 -- 172.21.15.78:0/2140143301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c014ea60 msgr2=0x7f57c00a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.366+0000 7f57c6890700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c014ea60 0x7f57c00a0f00 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f57b800b610 tx=0x7f57b8009780).stop 2023-08-17T18:10:21.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.366+0000 7f57c6890700 1 -- 172.21.15.78:0/2140143301 shutdown_connections 2023-08-17T18:10:21.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.366+0000 7f57c6890700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f57ac05edf0 0x7f57ac0612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:21.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.366+0000 7f57c6890700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c014ea60 0x7f57c00a0f00 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.366+0000 7f57c6890700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57c0069800 0x7f57c014bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.366+0000 7f57c6890700 1 --2- 172.21.15.78:0/2140143301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57c014e680 0x7f57c013f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.366+0000 7f57c6890700 1 -- 172.21.15.78:0/2140143301 >> 172.21.15.78:0/2140143301 conn(0x7f57c00c7b80 msgr2=0x7f57c00bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:21.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.367+0000 7f57c6890700 1 -- 172.21.15.78:0/2140143301 shutdown_connections 2023-08-17T18:10:21.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.367+0000 7f57c6890700 1 -- 172.21.15.78:0/2140143301 wait complete. 2023-08-17T18:10:21.378 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T18:10:21.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.499+0000 7f9b3f32e700 1 Processor -- start 2023-08-17T18:10:21.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.499+0000 7f9b3f32e700 1 -- start start 2023-08-17T18:10:21.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.500+0000 7f9b3f32e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 0x7f9b38155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.500+0000 7f9b3f32e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b381568d0 0x7f9b380bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.500+0000 7f9b3f32e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b380a5a20 con 0x7f9b3813bc70 2023-08-17T18:10:21.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.500+0000 7f9b3f32e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b380c32d0 con 0x7f9b381568d0 2023-08-17T18:10:21.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.500+0000 7f9b3f32e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380c3570 con 0x7f9b3813b890 2023-08-17T18:10:21.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.500+0000 7f9b3d0ca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 0x7f9b38155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.500+0000 7f9b3d8cb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b381568d0 0x7f9b380bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.500+0000 7f9b3d0ca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 0x7f9b38155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:53712/0 (socket says 172.21.15.78:53712) 2023-08-17T18:10:21.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.500+0000 7f9b3c8c9700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9b3813bc70 0x7f9b381561c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:57122/0 (socket says 172.21.15.78:57122) 2023-08-17T18:10:21.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.500+0000 7f9b3d0ca700 1 -- 172.21.15.78:0/1974454287 learned_addr learned my addr 172.21.15.78:0/1974454287 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:21.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.501+0000 7f9b3d0ca700 1 -- 172.21.15.78:0/1974454287 >> v2:172.21.15.150:3300/0 conn(0x7f9b381568d0 msgr2=0x7f9b380bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:21.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.501+0000 7f9b3d0ca700 1 --2- 172.21.15.78:0/1974454287 >> v2:172.21.15.150:3300/0 conn(0x7f9b381568d0 0x7f9b380bdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.501+0000 7f9b3d0ca700 1 -- 172.21.15.78:0/1974454287 >> v1:172.21.15.150:6789/0 conn(0x7f9b3813bc70 legacy=0x7f9b381561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.501+0000 7f9b2ffff700 1 -- 172.21.15.78:0/1974454287 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549103971 0 0) 0x7f9b380a5a20 con 0x7f9b3813bc70 2023-08-17T18:10:21.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.501+0000 7f9b3d0ca700 1 -- 172.21.15.78:0/1974454287 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b380bfad0 con 0x7f9b3813b890 2023-08-17T18:10:21.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.501+0000 7f9b3d8cb700 1 --2- 172.21.15.78:0/1974454287 >> v2:172.21.15.150:3300/0 conn(0x7f9b381568d0 0x7f9b380bdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.501+0000 7f9b3d0ca700 1 --2- 172.21.15.78:0/1974454287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 0x7f9b38155cd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f9b380c3410 tx=0x7f9b280090f0).ready entity=mon.2 client_cookie=64d1f8a096edaf8e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.501+0000 7f9b2ffff700 1 -- 172.21.15.78:0/1974454287 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800b520 con 0x7f9b3813b890 2023-08-17T18:10:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.501+0000 7f9b2ffff700 1 -- 172.21.15.78:0/1974454287 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2800b680 con 0x7f9b3813b890 2023-08-17T18:10:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.501+0000 7f9b2ffff700 1 -- 172.21.15.78:0/1974454287 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800ba00 con 0x7f9b3813b890 2023-08-17T18:10:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.502+0000 7f9b3f32e700 1 -- 172.21.15.78:0/1974454287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 msgr2=0x7f9b38155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.502+0000 7f9b3f32e700 1 --2- 172.21.15.78:0/1974454287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 0x7f9b38155cd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f9b380c3410 tx=0x7f9b280090f0).stop 2023-08-17T18:10:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.502+0000 7f9b3f32e700 1 -- 172.21.15.78:0/1974454287 shutdown_connections 2023-08-17T18:10:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.502+0000 7f9b3f32e700 1 --2- 172.21.15.78:0/1974454287 >> v2:172.21.15.150:3300/0 conn(0x7f9b381568d0 0x7f9b380bdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.502+0000 7f9b3f32e700 1 --2- 172.21.15.78:0/1974454287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 0x7f9b38155cd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.502+0000 7f9b3f32e700 1 -- 172.21.15.78:0/1974454287 >> 172.21.15.78:0/1974454287 conn(0x7f9b38062f80 msgr2=0x7f9b380c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.502+0000 7f9b3f32e700 1 -- 172.21.15.78:0/1974454287 shutdown_connections 2023-08-17T18:10:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.502+0000 7f9b3f32e700 1 -- 172.21.15.78:0/1974454287 wait complete. 2023-08-17T18:10:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.503+0000 7f9b3f32e700 1 Processor -- start 2023-08-17T18:10:21.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.503+0000 7f9b3f32e700 1 -- start start 2023-08-17T18:10:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3f32e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 0x7f9b380abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3f32e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3813bc70 0x7f9b380ab030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3f32e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b381568d0 0x7f9b380ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3f32e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380aa2c0 con 0x7f9b381568d0 2023-08-17T18:10:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3f32e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380ab810 con 0x7f9b3813bc70 2023-08-17T18:10:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3f32e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380a9990 con 0x7f9b3813b890 2023-08-17T18:10:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3d8cb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b381568d0 0x7f9b380ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3d8cb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b381568d0 0x7f9b380ad7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59400/0 (socket says 172.21.15.78:59400) 2023-08-17T18:10:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3d8cb700 1 -- 172.21.15.78:0/2382687008 learned_addr learned my addr 172.21.15.78:0/2382687008 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3d0ca700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 0x7f9b380abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3c8c9700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3813bc70 0x7f9b380ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3d8cb700 1 -- 172.21.15.78:0/2382687008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 msgr2=0x7f9b380abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3d8cb700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 0x7f9b380abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3d8cb700 1 -- 172.21.15.78:0/2382687008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3813bc70 msgr2=0x7f9b380ab030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3d8cb700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3813bc70 0x7f9b380ab030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3d8cb700 1 -- 172.21.15.78:0/2382687008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b30009a20 con 0x7f9b381568d0 2023-08-17T18:10:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.504+0000 7f9b3d8cb700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b381568d0 0x7f9b380ad7e0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7f9b30009e90 tx=0x7f9b3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:21.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.505+0000 7f9b2d7fa700 1 -- 172.21.15.78:0/2382687008 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000caa0 con 0x7f9b381568d0 2023-08-17T18:10:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.505+0000 7f9b2d7fa700 1 -- 172.21.15.78:0/2382687008 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3000f040 con 0x7f9b381568d0 2023-08-17T18:10:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.505+0000 7f9b2d7fa700 1 -- 172.21.15.78:0/2382687008 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000ce30 con 0x7f9b381568d0 2023-08-17T18:10:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.505+0000 7f9b3f32e700 1 -- 172.21.15.78:0/2382687008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b28009370 con 0x7f9b381568d0 2023-08-17T18:10:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.505+0000 7f9b3f32e700 1 -- 172.21.15.78:0/2382687008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b380a9f50 con 0x7f9b381568d0 2023-08-17T18:10:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.506+0000 7f9b3f32e700 1 -- 172.21.15.78:0/2382687008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b380aa470 con 0x7f9b381568d0 2023-08-17T18:10:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.506+0000 7f9b2d7fa700 1 -- 172.21.15.78:0/2382687008 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f9b30013610 con 0x7f9b381568d0 2023-08-17T18:10:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.506+0000 7f9b2d7fa700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9b1c05ee20 0x7f9b1c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.506+0000 7f9b3d0ca700 1 -- 172.21.15.78:0/2382687008 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9b1c05ee20 msgr2=0x7f9b1c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.506+0000 7f9b2d7fa700 1 -- 172.21.15.78:0/2382687008 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6595+0+0 (secure 0 0 0) 0x7f9b3007a780 con 0x7f9b381568d0 2023-08-17T18:10:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.506+0000 7f9b3d0ca700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9b1c05ee20 0x7f9b1c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.510+0000 7f9b2d7fa700 1 -- 172.21.15.78:0/2382687008 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b380aa470 con 0x7f9b381568d0 2023-08-17T18:10:21.563 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:21.562+0000 7fb8e2c5c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:10:21.652 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:21.652+0000 7f131c17f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:10:21.666 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:21.665+0000 7fb8e2c5c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:10:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.680+0000 7f9b3f32e700 1 -- 172.21.15.78:0/2382687008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b380aa650 con 0x7f9b381568d0 2023-08-17T18:10:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.681+0000 7f9b2d7fa700 1 -- 172.21.15.78:0/2382687008 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b380aa650 con 0x7f9b381568d0 2023-08-17T18:10:21.681 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T18:10:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 -- 172.21.15.78:0/2382687008 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9b1c05ee20 msgr2=0x7f9b1c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9b1c05ee20 0x7f9b1c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 -- 172.21.15.78:0/2382687008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b381568d0 msgr2=0x7f9b380ad7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b381568d0 0x7f9b380ad7e0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7f9b30009e90 tx=0x7f9b3000b040).stop 2023-08-17T18:10:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 -- 172.21.15.78:0/2382687008 shutdown_connections 2023-08-17T18:10:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9b1c05ee20 0x7f9b1c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b381568d0 0x7f9b380ad7e0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b3813b890 0x7f9b380abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 --2- 172.21.15.78:0/2382687008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b3813bc70 0x7f9b380ab030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 -- 172.21.15.78:0/2382687008 >> 172.21.15.78:0/2382687008 conn(0x7f9b38062f80 msgr2=0x7f9b38151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 -- 172.21.15.78:0/2382687008 shutdown_connections 2023-08-17T18:10:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.683+0000 7f9b3f32e700 1 -- 172.21.15.78:0/2382687008 wait complete. 2023-08-17T18:10:21.695 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T18:10:21.764 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:21.764+0000 7f131c17f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:10:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.814+0000 7f3b655ac700 1 Processor -- start 2023-08-17T18:10:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.815+0000 7f3b655ac700 1 -- start start 2023-08-17T18:10:21.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.815+0000 7f3b655ac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b60150450 0x7f3b60064d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.815+0000 7f3b655ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60065be0 0x7f3b600c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.815+0000 7f3b655ac700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b600624f0 con 0x7f3b600c2230 2023-08-17T18:10:21.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.815+0000 7f3b655ac700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b60066970 con 0x7f3b60150450 2023-08-17T18:10:21.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.815+0000 7f3b655ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b60063070 con 0x7f3b60065be0 2023-08-17T18:10:21.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5e7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60065be0 0x7f3b600c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b60150450 0x7f3b60064d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5f7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3b600c2230 0x7f3b600bc920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:57130/0 (socket says 172.21.15.78:57130) 2023-08-17T18:10:21.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5f7fe700 1 -- 172.21.15.78:0/2233841127 learned_addr learned my addr 172.21.15.78:0/2233841127 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5effd700 1 -- 172.21.15.78:0/2233841127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60065be0 msgr2=0x7f3b600c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5effd700 1 --2- 172.21.15.78:0/2233841127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60065be0 0x7f3b600c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5dffb700 1 -- 172.21.15.78:0/2233841127 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077627923 0 0) 0x7f3b600624f0 con 0x7f3b600c2230 2023-08-17T18:10:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5effd700 1 -- 172.21.15.78:0/2233841127 >> v1:172.21.15.150:6789/0 conn(0x7f3b600c2230 legacy=0x7f3b600bc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5effd700 1 -- 172.21.15.78:0/2233841127 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b60062740 con 0x7f3b60150450 2023-08-17T18:10:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5e7fc700 1 --2- 172.21.15.78:0/2233841127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60065be0 0x7f3b600c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5effd700 1 --2- 172.21.15.78:0/2233841127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60150450 0x7f3b60064d00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f3b54006fd0 tx=0x7f3b54006f40).ready entity=mon.1 client_cookie=8068638b891f7815 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5dffb700 1 -- 172.21.15.78:0/2233841127 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54005880 con 0x7f3b60150450 2023-08-17T18:10:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5dffb700 1 -- 172.21.15.78:0/2233841127 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b540059e0 con 0x7f3b60150450 2023-08-17T18:10:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.816+0000 7f3b5dffb700 1 -- 172.21.15.78:0/2233841127 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54005d60 con 0x7f3b60150450 2023-08-17T18:10:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.817+0000 7f3b655ac700 1 -- 172.21.15.78:0/2233841127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60150450 msgr2=0x7f3b60064d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.817+0000 7f3b655ac700 1 --2- 172.21.15.78:0/2233841127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60150450 0x7f3b60064d00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f3b54006fd0 tx=0x7f3b54006f40).stop 2023-08-17T18:10:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.817+0000 7f3b655ac700 1 -- 172.21.15.78:0/2233841127 shutdown_connections 2023-08-17T18:10:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.817+0000 7f3b655ac700 1 --2- 172.21.15.78:0/2233841127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60150450 0x7f3b60064d00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.817+0000 7f3b655ac700 1 --2- 172.21.15.78:0/2233841127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60065be0 0x7f3b600c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.817+0000 7f3b655ac700 1 -- 172.21.15.78:0/2233841127 >> 172.21.15.78:0/2233841127 conn(0x7f3b600c3db0 msgr2=0x7f3b600c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.817+0000 7f3b655ac700 1 -- 172.21.15.78:0/2233841127 shutdown_connections 2023-08-17T18:10:21.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.817+0000 7f3b655ac700 1 -- 172.21.15.78:0/2233841127 wait complete. 2023-08-17T18:10:21.820 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:21.818+0000 7fb8e2c5c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:10:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.818+0000 7f3b655ac700 1 Processor -- start 2023-08-17T18:10:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.818+0000 7f3b655ac700 1 -- start start 2023-08-17T18:10:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b655ac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60065be0 0x7f3b600a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b655ac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b600c2230 0x7f3b601624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b655ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60150450 0x7f3b601653f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b655ac700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b600a8ac0 con 0x7f3b600c2230 2023-08-17T18:10:21.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b655ac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6014e5c0 con 0x7f3b60065be0 2023-08-17T18:10:21.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b655ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6014dd20 con 0x7f3b60150450 2023-08-17T18:10:21.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b5e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b600c2230 0x7f3b601624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b5e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b600c2230 0x7f3b601624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59404/0 (socket says 172.21.15.78:59404) 2023-08-17T18:10:21.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b5e7fc700 1 -- 172.21.15.78:0/2646849136 learned_addr learned my addr 172.21.15.78:0/2646849136 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:21.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b5effd700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60065be0 0x7f3b600a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.819+0000 7f3b5f7fe700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60150450 0x7f3b601653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:21.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b5e7fc700 1 -- 172.21.15.78:0/2646849136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60150450 msgr2=0x7f3b601653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b5e7fc700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60150450 0x7f3b601653f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b5e7fc700 1 -- 172.21.15.78:0/2646849136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60065be0 msgr2=0x7f3b600a78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b5e7fc700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60065be0 0x7f3b600a78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b5e7fc700 1 -- 172.21.15.78:0/2646849136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b500092a0 con 0x7f3b600c2230 2023-08-17T18:10:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b5e7fc700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b600c2230 0x7f3b601624e0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f3b5000e980 tx=0x7f3b50009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b46ffd700 1 -- 172.21.15.78:0/2646849136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50012600 con 0x7f3b600c2230 2023-08-17T18:10:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b46ffd700 1 -- 172.21.15.78:0/2646849136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b50012760 con 0x7f3b600c2230 2023-08-17T18:10:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b655ac700 1 -- 172.21.15.78:0/2646849136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b54009250 con 0x7f3b600c2230 2023-08-17T18:10:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b46ffd700 1 -- 172.21.15.78:0/2646849136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50012ae0 con 0x7f3b600c2230 2023-08-17T18:10:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.820+0000 7f3b655ac700 1 -- 172.21.15.78:0/2646849136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6014e2e0 con 0x7f3b600c2230 2023-08-17T18:10:21.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.821+0000 7f3b655ac700 1 -- 172.21.15.78:0/2646849136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b600676a0 con 0x7f3b600c2230 2023-08-17T18:10:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.821+0000 7f3b46ffd700 1 -- 172.21.15.78:0/2646849136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f3b50022070 con 0x7f3b600c2230 2023-08-17T18:10:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.822+0000 7f3b46ffd700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3b4c05ee20 0x7f3b4c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.822+0000 7f3b5effd700 1 -- 172.21.15.78:0/2646849136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3b4c05ee20 msgr2=0x7f3b4c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.822+0000 7f3b46ffd700 1 -- 172.21.15.78:0/2646849136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6595+0+0 (secure 0 0 0) 0x7f3b5007a060 con 0x7f3b600c2230 2023-08-17T18:10:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.822+0000 7f3b5effd700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3b4c05ee20 0x7f3b4c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:21.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.826+0000 7f3b46ffd700 1 -- 172.21.15.78:0/2646849136 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b5004b400 con 0x7f3b600c2230 2023-08-17T18:10:21.894 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:21.893+0000 7fb8e2c5c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:10:21.923 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:21.923+0000 7f131c17f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:10:21.962 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:21.961+0000 7fb8e2c5c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:10:21.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.995+0000 7f3b655ac700 1 -- 172.21.15.78:0/2646849136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b600c0670 con 0x7f3b600c2230 2023-08-17T18:10:21.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.995+0000 7f3b46ffd700 1 -- 172.21.15.78:0/2646849136 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b5004ea20 con 0x7f3b600c2230 2023-08-17T18:10:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T18:10:21.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 -- 172.21.15.78:0/2646849136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3b4c05ee20 msgr2=0x7f3b4c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:21.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3b4c05ee20 0x7f3b4c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:21.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 -- 172.21.15.78:0/2646849136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b600c2230 msgr2=0x7f3b601624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:21.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b600c2230 0x7f3b601624e0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f3b5000e980 tx=0x7f3b50009060).stop 2023-08-17T18:10:21.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 -- 172.21.15.78:0/2646849136 shutdown_connections 2023-08-17T18:10:21.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3b4c05ee20 0x7f3b4c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:21.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b60150450 0x7f3b601653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60065be0 0x7f3b600a78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 --2- 172.21.15.78:0/2646849136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b600c2230 0x7f3b601624e0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:21.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 -- 172.21.15.78:0/2646849136 >> 172.21.15.78:0/2646849136 conn(0x7f3b600c3db0 msgr2=0x7f3b600c5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:21.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 -- 172.21.15.78:0/2646849136 shutdown_connections 2023-08-17T18:10:21.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:21.997+0000 7f3b655ac700 1 -- 172.21.15.78:0/2646849136 wait complete. 2023-08-17T18:10:22.000 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:22.000+0000 7f131c17f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:10:22.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:10:22.073 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:22.073+0000 7f131c17f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:10:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.126+0000 7f7d3b59d700 1 Processor -- start 2023-08-17T18:10:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.126+0000 7f7d3b59d700 1 -- start start 2023-08-17T18:10:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d3b59d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3413a640 0x7f7d34154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d3b59d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d340c2c10 con 0x7f7d3406a2c0 2023-08-17T18:10:22.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d3b59d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d34155010 con 0x7f7d34069760 2023-08-17T18:10:22.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d3b59d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d341552e0 con 0x7f7d3413a640 2023-08-17T18:10:22.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d38b38700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7d3406a2c0 0x7f7d34069050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48012/0 (socket says 172.21.15.78:48012) 2023-08-17T18:10:22.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d38b38700 1 -- 172.21.15.78:0/4146444403 learned_addr learned my addr 172.21.15.78:0/4146444403 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:22.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d39339700 1 --2- 172.21.15.78:0/4146444403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3413a640 0x7f7d34154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d2bfff700 1 -- 172.21.15.78:0/4146444403 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922476087 0 0) 0x7f7d340c2c10 con 0x7f7d3406a2c0 2023-08-17T18:10:22.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d2bfff700 1 -- 172.21.15.78:0/4146444403 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d200033f0 con 0x7f7d3406a2c0 2023-08-17T18:10:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d2bfff700 1 -- 172.21.15.78:0/4146444403 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413410571 0 0) 0x7f7d34155010 con 0x7f7d34069760 2023-08-17T18:10:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d2bfff700 1 -- 172.21.15.78:0/4146444403 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d340c2c10 con 0x7f7d34069760 2023-08-17T18:10:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d39339700 1 -- 172.21.15.78:0/4146444403 >> v1:172.21.15.150:6789/0 conn(0x7f7d34069760 legacy=0x7f7d340c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d39339700 1 -- 172.21.15.78:0/4146444403 >> v1:172.21.15.78:6789/0 conn(0x7f7d3406a2c0 legacy=0x7f7d34069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d39339700 1 -- 172.21.15.78:0/4146444403 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d341555c0 con 0x7f7d3413a640 2023-08-17T18:10:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.127+0000 7f7d39339700 1 --2- 172.21.15.78:0/4146444403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3413a640 0x7f7d34154b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7d30009790 tx=0x7f7d30009060).ready entity=mon.2 client_cookie=7028d296cf91dff1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.128+0000 7f7d2bfff700 1 -- 172.21.15.78:0/4146444403 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000f510 con 0x7f7d3413a640 2023-08-17T18:10:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.128+0000 7f7d2bfff700 1 -- 172.21.15.78:0/4146444403 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3000f670 con 0x7f7d3413a640 2023-08-17T18:10:22.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.128+0000 7f7d2bfff700 1 -- 172.21.15.78:0/4146444403 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000f9f0 con 0x7f7d3413a640 2023-08-17T18:10:22.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.128+0000 7f7d3b59d700 1 -- 172.21.15.78:0/4146444403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3413a640 msgr2=0x7f7d34154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.128+0000 7f7d3b59d700 1 --2- 172.21.15.78:0/4146444403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3413a640 0x7f7d34154b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7d30009790 tx=0x7f7d30009060).stop 2023-08-17T18:10:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.128+0000 7f7d3b59d700 1 -- 172.21.15.78:0/4146444403 shutdown_connections 2023-08-17T18:10:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.128+0000 7f7d3b59d700 1 --2- 172.21.15.78:0/4146444403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d3413a640 0x7f7d34154b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.128+0000 7f7d3b59d700 1 -- 172.21.15.78:0/4146444403 >> 172.21.15.78:0/4146444403 conn(0x7f7d340c7b00 msgr2=0x7f7d340c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.128+0000 7f7d3b59d700 1 -- 172.21.15.78:0/4146444403 shutdown_connections 2023-08-17T18:10:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.128+0000 7f7d3b59d700 1 -- 172.21.15.78:0/4146444403 wait complete. 2023-08-17T18:10:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.129+0000 7f7d3b59d700 1 Processor -- start 2023-08-17T18:10:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.129+0000 7f7d3b59d700 1 -- start start 2023-08-17T18:10:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.130+0000 7f7d3b59d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d34069760 0x7f7d341506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.130+0000 7f7d3b59d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3406a2c0 0x7f7d340bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.130+0000 7f7d3b59d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3413a640 0x7f7d340c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.130+0000 7f7d3b59d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340c13c0 con 0x7f7d3406a2c0 2023-08-17T18:10:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.130+0000 7f7d3b59d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340beba0 con 0x7f7d3413a640 2023-08-17T18:10:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.130+0000 7f7d3b59d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340bf440 con 0x7f7d34069760 2023-08-17T18:10:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d38b38700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3406a2c0 0x7f7d340bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d38b38700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3406a2c0 0x7f7d340bf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59406/0 (socket says 172.21.15.78:59406) 2023-08-17T18:10:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d38b38700 1 -- 172.21.15.78:0/1773373175 learned_addr learned my addr 172.21.15.78:0/1773373175 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d39339700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d34069760 0x7f7d341506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d39b3a700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3413a640 0x7f7d340c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d38b38700 1 -- 172.21.15.78:0/1773373175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d34069760 msgr2=0x7f7d341506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d38b38700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d34069760 0x7f7d341506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d38b38700 1 -- 172.21.15.78:0/1773373175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3413a640 msgr2=0x7f7d340c0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d38b38700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3413a640 0x7f7d340c0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d38b38700 1 -- 172.21.15.78:0/1773373175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d300092a0 con 0x7f7d3406a2c0 2023-08-17T18:10:22.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d38b38700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3406a2c0 0x7f7d340bf8d0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f7d2400c560 tx=0x7f7d24007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:22.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d297fa700 1 -- 172.21.15.78:0/1773373175 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d240072e0 con 0x7f7d3406a2c0 2023-08-17T18:10:22.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d297fa700 1 -- 172.21.15.78:0/1773373175 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d24007440 con 0x7f7d3406a2c0 2023-08-17T18:10:22.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d297fa700 1 -- 172.21.15.78:0/1773373175 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d240057a0 con 0x7f7d3406a2c0 2023-08-17T18:10:22.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d3b59d700 1 -- 172.21.15.78:0/1773373175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d34150bb0 con 0x7f7d3406a2c0 2023-08-17T18:10:22.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.131+0000 7f7d3b59d700 1 -- 172.21.15.78:0/1773373175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d340bee70 con 0x7f7d3406a2c0 2023-08-17T18:10:22.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.132+0000 7f7d3b59d700 1 -- 172.21.15.78:0/1773373175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d34047350 con 0x7f7d3406a2c0 2023-08-17T18:10:22.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.133+0000 7f7d297fa700 1 -- 172.21.15.78:0/1773373175 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f7d24010070 con 0x7f7d3406a2c0 2023-08-17T18:10:22.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.133+0000 7f7d297fa700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f7d1805edf0 0x7f7d180612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.133+0000 7f7d39339700 1 -- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f7d1805edf0 msgr2=0x7f7d180612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:22.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.133+0000 7f7d297fa700 1 -- 172.21.15.78:0/1773373175 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6595+0+0 (secure 0 0 0) 0x7f7d24079430 con 0x7f7d3406a2c0 2023-08-17T18:10:22.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.133+0000 7f7d39339700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f7d1805edf0 0x7f7d180612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:22.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.137+0000 7f7d297fa700 1 -- 172.21.15.78:0/1773373175 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7d2404a6c0 con 0x7f7d3406a2c0 2023-08-17T18:10:22.220 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:22.219+0000 7fb8e2c5c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:10:22.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.334+0000 7f7d39339700 1 -- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f7d1805edf0 msgr2=0x7f7d180612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:22.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.334+0000 7f7d39339700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f7d1805edf0 0x7f7d180612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:10:22.343 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:22.343+0000 7f131c17f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:10:22.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.350+0000 7f7d3b59d700 1 -- 172.21.15.78:0/1773373175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d340bf190 con 0x7f7d3406a2c0 2023-08-17T18:10:22.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.351+0000 7f7d297fa700 1 -- 172.21.15.78:0/1773373175 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f7d2404dce0 con 0x7f7d3406a2c0 2023-08-17T18:10:22.351 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:22.351 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":55,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/948559321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":948559321},{"type":"v1","addr":"172.21.15.150:6834","nonce":948559321}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/323810610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":323810610},{"type":"v1","addr":"172.21.15.78:6836","nonce":323810610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/246455712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":246455712},{"type":"v1","addr":"172.21.15.78:6837","nonce":246455712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:48.889332+0000","modified":"2023-08-17T17:53:50.895449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1383305491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1383305491},{"type":"v1","addr":"172.21.15.150:6835","nonce":1383305491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T18:10:22.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 -- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f7d1805edf0 msgr2=0x7f7d180612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:22.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f7d1805edf0 0x7f7d180612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:22.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 -- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3406a2c0 msgr2=0x7f7d340bf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3406a2c0 0x7f7d340bf8d0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f7d2400c560 tx=0x7f7d24007cc0).stop 2023-08-17T18:10:22.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 -- 172.21.15.78:0/1773373175 shutdown_connections 2023-08-17T18:10:22.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f7d1805edf0 0x7f7d180612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:22.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d3413a640 0x7f7d340c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d34069760 0x7f7d341506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 --2- 172.21.15.78:0/1773373175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d3406a2c0 0x7f7d340bf8d0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 -- 172.21.15.78:0/1773373175 >> 172.21.15.78:0/1773373175 conn(0x7f7d340c7b00 msgr2=0x7f7d340663c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:22.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 -- 172.21.15.78:0/1773373175 shutdown_connections 2023-08-17T18:10:22.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.353+0000 7f7d3b59d700 1 -- 172.21.15.78:0/1773373175 wait complete. 2023-08-17T18:10:22.355 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 55 2023-08-17T18:10:22.365 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:10:22.404 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:22.403+0000 7fb8e2c5c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:10:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.485+0000 7ff4c1076700 1 Processor -- start 2023-08-17T18:10:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.485+0000 7ff4c1076700 1 -- start start 2023-08-17T18:10:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.486+0000 7ff4c1076700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff4bc0643e0 0x7ff4bc157c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.486+0000 7ff4c1076700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc063bb0 con 0x7ff4bc064860 2023-08-17T18:10:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.486+0000 7ff4c1076700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc062fa0 con 0x7ff4bc14e290 2023-08-17T18:10:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.486+0000 7ff4c1076700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc063280 con 0x7ff4bc0643e0 2023-08-17T18:10:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.486+0000 7ff4bb59e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff4bc064860 0x7ff4bc15e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48022/0 (socket says 172.21.15.78:48022) 2023-08-17T18:10:22.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.486+0000 7ff4bb59e700 1 -- 172.21.15.78:0/1887226417 learned_addr learned my addr 172.21.15.78:0/1887226417 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:22.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.486+0000 7ff4ba59c700 1 --2- 172.21.15.78:0/1887226417 >> v2:172.21.15.150:3300/0 conn(0x7ff4bc0643e0 0x7ff4bc157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.486+0000 7ff4b9d9b700 1 -- 172.21.15.78:0/1887226417 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970765309 0 0) 0x7ff4bc063bb0 con 0x7ff4bc064860 2023-08-17T18:10:22.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.486+0000 7ff4b9d9b700 1 -- 172.21.15.78:0/1887226417 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a40033f0 con 0x7ff4bc064860 2023-08-17T18:10:22.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.487+0000 7ff4b9d9b700 1 -- 172.21.15.78:0/1887226417 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881492374 0 0) 0x7ff4bc062fa0 con 0x7ff4bc14e290 2023-08-17T18:10:22.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.487+0000 7ff4b9d9b700 1 -- 172.21.15.78:0/1887226417 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4bc063bb0 con 0x7ff4bc14e290 2023-08-17T18:10:22.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.487+0000 7ff4ba59c700 1 -- 172.21.15.78:0/1887226417 >> v1:172.21.15.150:6789/0 conn(0x7ff4bc14e290 legacy=0x7ff4bc14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.487+0000 7ff4ba59c700 1 -- 172.21.15.78:0/1887226417 >> v1:172.21.15.78:6789/0 conn(0x7ff4bc064860 legacy=0x7ff4bc15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.487+0000 7ff4ba59c700 1 -- 172.21.15.78:0/1887226417 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc063560 con 0x7ff4bc0643e0 2023-08-17T18:10:22.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.487+0000 7ff4ba59c700 1 --2- 172.21.15.78:0/1887226417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4bc0643e0 0x7ff4bc157c60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7ff4ac009760 tx=0x7ff4ac009060).ready entity=mon.1 client_cookie=528fc3c26ebc7902 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:22.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.487+0000 7ff4b9d9b700 1 -- 172.21.15.78:0/1887226417 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00d4a0 con 0x7ff4bc0643e0 2023-08-17T18:10:22.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.487+0000 7ff4b9d9b700 1 -- 172.21.15.78:0/1887226417 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac00d600 con 0x7ff4bc0643e0 2023-08-17T18:10:22.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.487+0000 7ff4b9d9b700 1 -- 172.21.15.78:0/1887226417 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00d980 con 0x7ff4bc0643e0 2023-08-17T18:10:22.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.488+0000 7ff4c1076700 1 -- 172.21.15.78:0/1887226417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4bc0643e0 msgr2=0x7ff4bc157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.488+0000 7ff4c1076700 1 --2- 172.21.15.78:0/1887226417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4bc0643e0 0x7ff4bc157c60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7ff4ac009760 tx=0x7ff4ac009060).stop 2023-08-17T18:10:22.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.488+0000 7ff4c1076700 1 -- 172.21.15.78:0/1887226417 shutdown_connections 2023-08-17T18:10:22.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.488+0000 7ff4c1076700 1 --2- 172.21.15.78:0/1887226417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4bc0643e0 0x7ff4bc157c60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.488+0000 7ff4c1076700 1 -- 172.21.15.78:0/1887226417 >> 172.21.15.78:0/1887226417 conn(0x7ff4bc0c3d40 msgr2=0x7ff4bc0c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:22.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.488+0000 7ff4c1076700 1 -- 172.21.15.78:0/1887226417 shutdown_connections 2023-08-17T18:10:22.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.488+0000 7ff4c1076700 1 -- 172.21.15.78:0/1887226417 wait complete. 2023-08-17T18:10:22.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.489+0000 7ff4c1076700 1 Processor -- start 2023-08-17T18:10:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.489+0000 7ff4c1076700 1 -- start start 2023-08-17T18:10:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4c1076700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4bc0643e0 0x7ff4bc164f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4c1076700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4bc064860 0x7ff4bc0c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4c1076700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4bc14e290 0x7ff4bc0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4c1076700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc1357a0 con 0x7ff4bc0643e0 2023-08-17T18:10:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4c1076700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0c6c00 con 0x7ff4bc064860 2023-08-17T18:10:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4c1076700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc168670 con 0x7ff4bc14e290 2023-08-17T18:10:22.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4bad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4bc0643e0 0x7ff4bc164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4bad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4bc0643e0 0x7ff4bc164f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59410/0 (socket says 172.21.15.78:59410) 2023-08-17T18:10:22.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4bad9d700 1 -- 172.21.15.78:0/3447671543 learned_addr learned my addr 172.21.15.78:0/3447671543 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:22.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4ba59c700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4bc064860 0x7ff4bc0c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4bb59e700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4bc14e290 0x7ff4bc0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4bad9d700 1 -- 172.21.15.78:0/3447671543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4bc14e290 msgr2=0x7ff4bc0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4bad9d700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4bc14e290 0x7ff4bc0c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4bad9d700 1 -- 172.21.15.78:0/3447671543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4bc064860 msgr2=0x7ff4bc0c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4bad9d700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4bc064860 0x7ff4bc0c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4bad9d700 1 -- 172.21.15.78:0/3447671543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0092a0 con 0x7ff4bc0643e0 2023-08-17T18:10:22.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.490+0000 7ff4bad9d700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4bc0643e0 0x7ff4bc164f50 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7ff4b000c440 tx=0x7ff4b0007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:22.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.491+0000 7ff4a2ffd700 1 -- 172.21.15.78:0/3447671543 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0012400 con 0x7ff4bc0643e0 2023-08-17T18:10:22.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.491+0000 7ff4a2ffd700 1 -- 172.21.15.78:0/3447671543 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b0012560 con 0x7ff4bc0643e0 2023-08-17T18:10:22.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.491+0000 7ff4c1076700 1 -- 172.21.15.78:0/3447671543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc167a80 con 0x7ff4bc0643e0 2023-08-17T18:10:22.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.491+0000 7ff4a2ffd700 1 -- 172.21.15.78:0/3447671543 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0012920 con 0x7ff4bc0643e0 2023-08-17T18:10:22.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.491+0000 7ff4c1076700 1 -- 172.21.15.78:0/3447671543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc167d40 con 0x7ff4bc0643e0 2023-08-17T18:10:22.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.492+0000 7ff4c1076700 1 -- 172.21.15.78:0/3447671543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc168950 con 0x7ff4bc0643e0 2023-08-17T18:10:22.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.492+0000 7ff4a2ffd700 1 -- 172.21.15.78:0/3447671543 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff4b0019030 con 0x7ff4bc0643e0 2023-08-17T18:10:22.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.492+0000 7ff4a2ffd700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff4a805ee20 0x7ff4a80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.492+0000 7ff4ba59c700 1 -- 172.21.15.78:0/3447671543 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff4a805ee20 msgr2=0x7ff4a80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:22.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.492+0000 7ff4a2ffd700 1 -- 172.21.15.78:0/3447671543 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6595+0+0 (secure 0 0 0) 0x7ff4b0079570 con 0x7ff4bc0643e0 2023-08-17T18:10:22.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.493+0000 7ff4ba59c700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff4a805ee20 0x7ff4a80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:22.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.501+0000 7ff4a2ffd700 1 -- 172.21.15.78:0/3447671543 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4b004a7a0 con 0x7ff4bc0643e0 2023-08-17T18:10:22.539 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:22.539+0000 7f131c17f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:10:22.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.674+0000 7ff4c1076700 1 -- 172.21.15.78:0/3447671543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4bc047350 con 0x7ff4bc0643e0 2023-08-17T18:10:22.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.674+0000 7ff4a2ffd700 1 -- 172.21.15.78:0/3447671543 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+17718 (secure 0 0 0) 0x7ff4b004ddc0 con 0x7ff4bc0643e0 2023-08-17T18:10:22.675 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:22.675 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":155,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:10:20.716451+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:47.436687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:47.849880+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":155,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.3f","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/3977763008":"2023-08-18T18:05:20.568126+0000","172.21.15.78:0/2748193833":"2023-08-18T18:05:20.568126+0000","172.21.15.78:0/303775003":"2023-08-18T18:05:20.568126+0000","172.21.15.78:0/1641268059":"2023-08-18T18:05:20.568126+0000","172.21.15.78:6833/119464":"2023-08-18T17:54:04.156331+0000","172.21.15.78:0/1601918675":"2023-08-18T17:54:04.156331+0000","172.21.15.78:6832/119464":"2023-08-18T17:54:04.156331+0000","172.21.15.78:0/1263954043":"2023-08-18T17:54:04.156331+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:10:22.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 -- 172.21.15.78:0/3447671543 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff4a805ee20 msgr2=0x7ff4a80612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:22.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff4a805ee20 0x7ff4a80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:22.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 -- 172.21.15.78:0/3447671543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4bc0643e0 msgr2=0x7ff4bc164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4bc0643e0 0x7ff4bc164f50 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7ff4b000c440 tx=0x7ff4b0007c90).stop 2023-08-17T18:10:22.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 -- 172.21.15.78:0/3447671543 shutdown_connections 2023-08-17T18:10:22.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff4a805ee20 0x7ff4a80612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:22.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4bc14e290 0x7ff4bc0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4bc0643e0 0x7ff4bc164f50 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 --2- 172.21.15.78:0/3447671543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4bc064860 0x7ff4bc0c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 -- 172.21.15.78:0/3447671543 >> 172.21.15.78:0/3447671543 conn(0x7ff4bc0c3d40 msgr2=0x7ff4bc0c5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:22.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.676+0000 7ff4c1076700 1 -- 172.21.15.78:0/3447671543 shutdown_connections 2023-08-17T18:10:22.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.677+0000 7ff4c1076700 1 -- 172.21.15.78:0/3447671543 wait complete. 2023-08-17T18:10:22.689 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T18:10:22.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:10:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.807+0000 7f249a85a700 1 Processor -- start 2023-08-17T18:10:22.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.807+0000 7f249a85a700 1 -- start start 2023-08-17T18:10:22.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f249a85a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2494154140 0x7f24940c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f249a85a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f24940c1010 0x7f24940ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f249a85a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2494154520 con 0x7f24940a7c40 2023-08-17T18:10:22.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f249a85a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24940c91e0 con 0x7f24940c1010 2023-08-17T18:10:22.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f249a85a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24940c94c0 con 0x7f2494154140 2023-08-17T18:10:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f24937fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f24940a7c40 0x7f24940c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48032/0 (socket says 172.21.15.78:48032) 2023-08-17T18:10:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f24937fe700 1 -- 172.21.15.78:0/4289632034 learned_addr learned my addr 172.21.15.78:0/4289632034 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f2498df7700 1 --2- 172.21.15.78:0/4289632034 >> v2:172.21.15.150:3300/0 conn(0x7f24940c1010 0x7f24940ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f2493fff700 1 --2- 172.21.15.78:0/4289632034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2494154140 0x7f24940c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f2492ffd700 1 -- 172.21.15.78:0/4289632034 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991616029 0 0) 0x7f2494154520 con 0x7f24940a7c40 2023-08-17T18:10:22.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f2492ffd700 1 -- 172.21.15.78:0/4289632034 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f247c0033f0 con 0x7f24940a7c40 2023-08-17T18:10:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f2498df7700 1 -- 172.21.15.78:0/4289632034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2494154140 msgr2=0x7f24940c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f2498df7700 1 --2- 172.21.15.78:0/4289632034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2494154140 0x7f24940c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f2498df7700 1 -- 172.21.15.78:0/4289632034 >> v1:172.21.15.78:6789/0 conn(0x7f24940a7c40 legacy=0x7f24940c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f2498df7700 1 -- 172.21.15.78:0/4289632034 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940c97a0 con 0x7f24940c1010 2023-08-17T18:10:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.808+0000 7f2493fff700 1 --2- 172.21.15.78:0/4289632034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2494154140 0x7f24940c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f2498df7700 1 --2- 172.21.15.78:0/4289632034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940c1010 0x7f24940ca280 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f248c009e60 tx=0x7f248c009780).ready entity=mon.1 client_cookie=70245e2d86b63ced server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:22.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f2492ffd700 1 -- 172.21.15.78:0/4289632034 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00e070 con 0x7f24940c1010 2023-08-17T18:10:22.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f2492ffd700 1 -- 172.21.15.78:0/4289632034 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c00bab0 con 0x7f24940c1010 2023-08-17T18:10:22.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f2492ffd700 1 -- 172.21.15.78:0/4289632034 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00be30 con 0x7f24940c1010 2023-08-17T18:10:22.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f249a85a700 1 -- 172.21.15.78:0/4289632034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940c1010 msgr2=0x7f24940ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f249a85a700 1 --2- 172.21.15.78:0/4289632034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940c1010 0x7f24940ca280 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f248c009e60 tx=0x7f248c009780).stop 2023-08-17T18:10:22.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f249a85a700 1 -- 172.21.15.78:0/4289632034 shutdown_connections 2023-08-17T18:10:22.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f249a85a700 1 --2- 172.21.15.78:0/4289632034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24940c1010 0x7f24940ca280 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f249a85a700 1 --2- 172.21.15.78:0/4289632034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2494154140 0x7f24940c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f249a85a700 1 -- 172.21.15.78:0/4289632034 >> 172.21.15.78:0/4289632034 conn(0x7f2494094510 msgr2=0x7f249406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:22.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f249a85a700 1 -- 172.21.15.78:0/4289632034 shutdown_connections 2023-08-17T18:10:22.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.809+0000 7f249a85a700 1 -- 172.21.15.78:0/4289632034 wait complete. 2023-08-17T18:10:22.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.810+0000 7f249a85a700 1 Processor -- start 2023-08-17T18:10:22.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.811+0000 7f249a85a700 1 -- start start 2023-08-17T18:10:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.811+0000 7f249a85a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24940a7c40 0x7f24940ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.811+0000 7f249a85a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24940c1010 0x7f24940c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.811+0000 7f249a85a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2494154140 0x7f24940c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.811+0000 7f249a85a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940c4da0 con 0x7f24940c1010 2023-08-17T18:10:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.811+0000 7f249a85a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940ace70 con 0x7f2494154140 2023-08-17T18:10:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.811+0000 7f249a85a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24940abfc0 con 0x7f24940a7c40 2023-08-17T18:10:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f24937fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24940c1010 0x7f24940c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f24937fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24940c1010 0x7f24940c2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59424/0 (socket says 172.21.15.78:59424) 2023-08-17T18:10:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f24937fe700 1 -- 172.21.15.78:0/1845694494 learned_addr learned my addr 172.21.15.78:0/1845694494 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f2493fff700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24940a7c40 0x7f24940ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f2498df7700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2494154140 0x7f24940c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f24937fe700 1 -- 172.21.15.78:0/1845694494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24940a7c40 msgr2=0x7f24940ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f24937fe700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24940a7c40 0x7f24940ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f24937fe700 1 -- 172.21.15.78:0/1845694494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2494154140 msgr2=0x7f24940c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f24937fe700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2494154140 0x7f24940c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f24937fe700 1 -- 172.21.15.78:0/1845694494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24880092a0 con 0x7f24940c1010 2023-08-17T18:10:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f24937fe700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24940c1010 0x7f24940c2c50 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f248400c420 tx=0x7f2484007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f247bfff700 1 -- 172.21.15.78:0/1845694494 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24840070d0 con 0x7f24940c1010 2023-08-17T18:10:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f247bfff700 1 -- 172.21.15.78:0/1845694494 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2484007230 con 0x7f24940c1010 2023-08-17T18:10:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f247bfff700 1 -- 172.21.15.78:0/1845694494 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24840075d0 con 0x7f24940c1010 2023-08-17T18:10:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f249a85a700 1 -- 172.21.15.78:0/1845694494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c009a20 con 0x7f24940c1010 2023-08-17T18:10:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.812+0000 7f249a85a700 1 -- 172.21.15.78:0/1845694494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24940ac820 con 0x7f24940c1010 2023-08-17T18:10:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.813+0000 7f249a85a700 1 -- 172.21.15.78:0/1845694494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24940ad020 con 0x7f24940c1010 2023-08-17T18:10:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.814+0000 7f247bfff700 1 -- 172.21.15.78:0/1845694494 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2484010070 con 0x7f24940c1010 2023-08-17T18:10:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.814+0000 7f247bfff700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f248005ee20 0x7f24800612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.814+0000 7f2493fff700 1 -- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f248005ee20 msgr2=0x7f24800612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.814+0000 7f247bfff700 1 -- 172.21.15.78:0/1845694494 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6595+0+0 (secure 0 0 0) 0x7f24840792a0 con 0x7f24940c1010 2023-08-17T18:10:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.814+0000 7f2493fff700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f248005ee20 0x7f24800612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:22.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:22.822+0000 7f247bfff700 1 -- 172.21.15.78:0/1845694494 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f24940ad020 con 0x7f24940c1010 2023-08-17T18:10:23.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.015+0000 7f2493fff700 1 -- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f248005ee20 msgr2=0x7f24800612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:23.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.015+0000 7f2493fff700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f248005ee20 0x7f24800612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:10:23.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.031+0000 7f249a85a700 1 -- 172.21.15.78:0/1845694494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24940acfe0 con 0x7f24940c1010 2023-08-17T18:10:23.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.032+0000 7f247bfff700 1 -- 172.21.15.78:0/1845694494 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f248404a640 con 0x7f24940c1010 2023-08-17T18:10:23.032 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:23.032 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":55,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/948559321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":948559321},{"type":"v1","addr":"172.21.15.150:6834","nonce":948559321}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/323810610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":323810610},{"type":"v1","addr":"172.21.15.78:6836","nonce":323810610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/246455712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":246455712},{"type":"v1","addr":"172.21.15.78:6837","nonce":246455712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:48.889332+0000","modified":"2023-08-17T17:53:50.895449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1383305491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1383305491},{"type":"v1","addr":"172.21.15.150:6835","nonce":1383305491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T18:10:23.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 -- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f248005ee20 msgr2=0x7f24800612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:23.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f248005ee20 0x7f24800612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:23.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 -- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24940c1010 msgr2=0x7f24940c2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24940c1010 0x7f24940c2c50 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f248400c420 tx=0x7f2484007c50).stop 2023-08-17T18:10:23.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 -- 172.21.15.78:0/1845694494 shutdown_connections 2023-08-17T18:10:23.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f248005ee20 0x7f24800612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:23.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2494154140 0x7f24940c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24940a7c40 0x7f24940ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 --2- 172.21.15.78:0/1845694494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24940c1010 0x7f24940c2c50 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 -- 172.21.15.78:0/1845694494 >> 172.21.15.78:0/1845694494 conn(0x7f2494094510 msgr2=0x7f24940cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:23.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 -- 172.21.15.78:0/1845694494 shutdown_connections 2023-08-17T18:10:23.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.034+0000 7f249a85a700 1 -- 172.21.15.78:0/1845694494 wait complete. 2023-08-17T18:10:23.036 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 55 2023-08-17T18:10:23.046 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:10:23.060 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:23.058+0000 7fb8e2c5c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:10:23.127 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:23.126+0000 7fb8e2c5c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:10:23.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.166+0000 7fe22f59e700 1 Processor -- start 2023-08-17T18:10:23.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.166+0000 7fe22f59e700 1 -- start start 2023-08-17T18:10:23.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22f59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe2300bd140 0x7fe23015b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22f59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe230068110 con 0x7fe2300bd8e0 2023-08-17T18:10:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22f59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2300bdd40 con 0x7fe2300c62f0 2023-08-17T18:10:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22f59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2300638d0 con 0x7fe2300bd140 2023-08-17T18:10:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22dd9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe2300bd8e0 0x7fe2301535e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48038/0 (socket says 172.21.15.78:48038) 2023-08-17T18:10:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22dd9b700 1 -- 172.21.15.78:0/1877488777 learned_addr learned my addr 172.21.15.78:0/1877488777 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22ed9d700 1 --2- 172.21.15.78:0/1877488777 >> v2:172.21.15.150:3300/0 conn(0x7fe2300bd140 0x7fe23015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22d59a700 1 -- 172.21.15.78:0/1877488777 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108576507 0 0) 0x7fe230068110 con 0x7fe2300bd8e0 2023-08-17T18:10:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22d59a700 1 -- 172.21.15.78:0/1877488777 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2180033f0 con 0x7fe2300bd8e0 2023-08-17T18:10:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22d59a700 1 -- 172.21.15.78:0/1877488777 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847464373 0 0) 0x7fe224001110 con 0x7fe2300c62f0 2023-08-17T18:10:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.167+0000 7fe22d59a700 1 -- 172.21.15.78:0/1877488777 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe230068110 con 0x7fe2300c62f0 2023-08-17T18:10:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.168+0000 7fe22ed9d700 1 -- 172.21.15.78:0/1877488777 >> v1:172.21.15.150:6789/0 conn(0x7fe2300c62f0 legacy=0x7fe2300c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.168+0000 7fe22d59a700 1 -- 172.21.15.78:0/1877488777 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 255045871 0 0) 0x7fe2180033f0 con 0x7fe2300bd8e0 2023-08-17T18:10:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.168+0000 7fe22ed9d700 1 -- 172.21.15.78:0/1877488777 >> v1:172.21.15.78:6789/0 conn(0x7fe2300bd8e0 legacy=0x7fe2301535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.168+0000 7fe22ed9d700 1 -- 172.21.15.78:0/1877488777 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2300bdf80 con 0x7fe2300bd140 2023-08-17T18:10:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.168+0000 7fe22ed9d700 1 --2- 172.21.15.78:0/1877488777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2300bd140 0x7fe23015b270 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fe228009e60 tx=0x7fe228009780).ready entity=mon.1 client_cookie=29fd729e54eaaa0a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:23.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.168+0000 7fe22d59a700 1 -- 172.21.15.78:0/1877488777 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22800e070 con 0x7fe2300bd140 2023-08-17T18:10:23.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.168+0000 7fe22d59a700 1 -- 172.21.15.78:0/1877488777 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22800b7a0 con 0x7fe2300bd140 2023-08-17T18:10:23.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.168+0000 7fe22d59a700 1 -- 172.21.15.78:0/1877488777 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220001470 con 0x7fe2300bd140 2023-08-17T18:10:23.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.168+0000 7fe22f59e700 1 -- 172.21.15.78:0/1877488777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2300bd140 msgr2=0x7fe23015b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.168+0000 7fe22f59e700 1 --2- 172.21.15.78:0/1877488777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2300bd140 0x7fe23015b270 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fe228009e60 tx=0x7fe228009780).stop 2023-08-17T18:10:23.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.169+0000 7fe22f59e700 1 -- 172.21.15.78:0/1877488777 shutdown_connections 2023-08-17T18:10:23.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.169+0000 7fe22f59e700 1 --2- 172.21.15.78:0/1877488777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2300bd140 0x7fe23015b270 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.169+0000 7fe22f59e700 1 -- 172.21.15.78:0/1877488777 >> 172.21.15.78:0/1877488777 conn(0x7fe2300aabf0 msgr2=0x7fe2300ac270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:23.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.169+0000 7fe22f59e700 1 -- 172.21.15.78:0/1877488777 shutdown_connections 2023-08-17T18:10:23.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.169+0000 7fe22f59e700 1 -- 172.21.15.78:0/1877488777 wait complete. 2023-08-17T18:10:23.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.170+0000 7fe22f59e700 1 Processor -- start 2023-08-17T18:10:23.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.170+0000 7fe22f59e700 1 -- start start 2023-08-17T18:10:23.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.170+0000 7fe22f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2300bd140 0x7fe2301509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.170+0000 7fe22f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2300bd8e0 0x7fe2300c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.170+0000 7fe22f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2300c62f0 0x7fe2300c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22f59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2300a9070 con 0x7fe2300c62f0 2023-08-17T18:10:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe230150ea0 con 0x7fe2300bd140 2023-08-17T18:10:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2300a87d0 con 0x7fe2300bd8e0 2023-08-17T18:10:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2300c62f0 0x7fe2300c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2300c62f0 0x7fe2300c22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59428/0 (socket says 172.21.15.78:59428) 2023-08-17T18:10:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22ed9d700 1 -- 172.21.15.78:0/3616726210 learned_addr learned my addr 172.21.15.78:0/3616726210 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22e59c700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2300bd140 0x7fe2301509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22dd9b700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2300bd8e0 0x7fe2300c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22ed9d700 1 -- 172.21.15.78:0/3616726210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2300bd8e0 msgr2=0x7fe2300c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22ed9d700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2300bd8e0 0x7fe2300c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22ed9d700 1 -- 172.21.15.78:0/3616726210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2300bd140 msgr2=0x7fe2301509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22ed9d700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2300bd140 0x7fe2301509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22ed9d700 1 -- 172.21.15.78:0/3616726210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe228009a20 con 0x7fe2300c62f0 2023-08-17T18:10:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22ed9d700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2300c62f0 0x7fe2300c22d0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7fe2300a6c10 tx=0x7fe228009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe21e7fc700 1 -- 172.21.15.78:0/3616726210 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22801d440 con 0x7fe2300c62f0 2023-08-17T18:10:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe21e7fc700 1 -- 172.21.15.78:0/3616726210 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22801d5a0 con 0x7fe2300c62f0 2023-08-17T18:10:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe21e7fc700 1 -- 172.21.15.78:0/3616726210 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22801d920 con 0x7fe2300c62f0 2023-08-17T18:10:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22f59e700 1 -- 172.21.15.78:0/3616726210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2300c2ab0 con 0x7fe2300c62f0 2023-08-17T18:10:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.171+0000 7fe22f59e700 1 -- 172.21.15.78:0/3616726210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2300a8d00 con 0x7fe2300c62f0 2023-08-17T18:10:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.172+0000 7fe22f59e700 1 -- 172.21.15.78:0/3616726210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2300a8ec0 con 0x7fe2300c62f0 2023-08-17T18:10:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.173+0000 7fe21e7fc700 1 -- 172.21.15.78:0/3616726210 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fe228024030 con 0x7fe2300c62f0 2023-08-17T18:10:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.173+0000 7fe21e7fc700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe21005edf0 0x7fe2100612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.173+0000 7fe22e59c700 1 -- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe21005edf0 msgr2=0x7fe2100612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.173+0000 7fe21e7fc700 1 -- 172.21.15.78:0/3616726210 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6595+0+0 (secure 0 0 0) 0x7fe22807b540 con 0x7fe2300c62f0 2023-08-17T18:10:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.173+0000 7fe22e59c700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe21005edf0 0x7fe2100612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:23.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.177+0000 7fe21e7fc700 1 -- 172.21.15.78:0/3616726210 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe22804c990 con 0x7fe2300c62f0 2023-08-17T18:10:23.204 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:23.203+0000 7fb8e2c5c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:10:23.226 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:23.227+0000 7f131c17f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:10:23.298 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:23.298+0000 7f131c17f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:10:23.350 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:23.349+0000 7fb8e2c5c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:10:23.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.374+0000 7fe22e59c700 1 -- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe21005edf0 msgr2=0x7fe2100612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:23.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.374+0000 7fe22e59c700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe21005edf0 0x7fe2100612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:10:23.376 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:23.376+0000 7f131c17f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:10:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.389+0000 7fe22f59e700 1 -- 172.21.15.78:0/3616726210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2300c6df0 con 0x7fe2300c62f0 2023-08-17T18:10:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.389+0000 7fe21e7fc700 1 -- 172.21.15.78:0/3616726210 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4488 (secure 0 0 0) 0x7fe228022090 con 0x7fe2300c62f0 2023-08-17T18:10:23.389 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:23.390 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":55,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/948559321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":948559321},{"type":"v1","addr":"172.21.15.150:6834","nonce":948559321}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/323810610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":323810610},{"type":"v1","addr":"172.21.15.78:6836","nonce":323810610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/246455712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":246455712},{"type":"v1","addr":"172.21.15.78:6837","nonce":246455712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T17:53:48.889332+0000","modified":"2023-08-17T17:53:50.895449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/1383305491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1383305491},{"type":"v1","addr":"172.21.15.150:6835","nonce":1383305491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T18:10:23.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 -- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe21005edf0 msgr2=0x7fe2100612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:23.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe21005edf0 0x7fe2100612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:23.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 -- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2300c62f0 msgr2=0x7fe2300c22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2300c62f0 0x7fe2300c22d0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7fe2300a6c10 tx=0x7fe228009780).stop 2023-08-17T18:10:23.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 -- 172.21.15.78:0/3616726210 shutdown_connections 2023-08-17T18:10:23.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe21005edf0 0x7fe2100612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:23.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2300c62f0 0x7fe2300c22d0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2300bd140 0x7fe2301509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 --2- 172.21.15.78:0/3616726210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2300bd8e0 0x7fe2300c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 -- 172.21.15.78:0/3616726210 >> 172.21.15.78:0/3616726210 conn(0x7fe2300aabf0 msgr2=0x7fe2300a5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:23.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 -- 172.21.15.78:0/3616726210 shutdown_connections 2023-08-17T18:10:23.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.392+0000 7fe22f59e700 1 -- 172.21.15.78:0/3616726210 wait complete. 2023-08-17T18:10:23.394 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 55 2023-08-17T18:10:23.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:10:23.421 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:23.420+0000 7fb8e2c5c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:10:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.520+0000 7f31984a5700 1 Processor -- start 2023-08-17T18:10:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.520+0000 7f31984a5700 1 -- start start 2023-08-17T18:10:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.521+0000 7f31984a5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31900c1010 0x7f31900ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.521+0000 7f31984a5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31900c7350 con 0x7f3190154140 2023-08-17T18:10:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.521+0000 7f31984a5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31900a8350 con 0x7f31900c6ee0 2023-08-17T18:10:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.521+0000 7f31984a5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3190154520 con 0x7f31900c1010 2023-08-17T18:10:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.521+0000 7f3196241700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3190154140 0x7f31900a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48050/0 (socket says 172.21.15.78:48050) 2023-08-17T18:10:23.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.521+0000 7f3196241700 1 -- 172.21.15.78:0/2102697710 learned_addr learned my addr 172.21.15.78:0/2102697710 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:23.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.521+0000 7f3196a42700 1 --2- 172.21.15.78:0/2102697710 >> v2:172.21.15.150:3300/0 conn(0x7f31900c1010 0x7f31900ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.521+0000 7f319523f700 1 -- 172.21.15.78:0/2102697710 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181733994 0 0) 0x7f31900c7350 con 0x7f3190154140 2023-08-17T18:10:23.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f319523f700 1 -- 172.21.15.78:0/2102697710 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f317c0033f0 con 0x7f3190154140 2023-08-17T18:10:23.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f3196a42700 1 -- 172.21.15.78:0/2102697710 >> v1:172.21.15.150:6789/0 conn(0x7f31900c6ee0 legacy=0x7f31900c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f319523f700 1 -- 172.21.15.78:0/2102697710 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320025461 0 0) 0x7f31900a8350 con 0x7f31900c6ee0 2023-08-17T18:10:23.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f3196a42700 1 -- 172.21.15.78:0/2102697710 >> v1:172.21.15.78:6789/0 conn(0x7f3190154140 legacy=0x7f31900a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f3196a42700 1 -- 172.21.15.78:0/2102697710 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31900c91e0 con 0x7f31900c1010 2023-08-17T18:10:23.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f3196a42700 1 --2- 172.21.15.78:0/2102697710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c1010 0x7f31900ca280 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f3188009e60 tx=0x7f3188009780).ready entity=mon.1 client_cookie=5debfa76676270b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:23.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f319523f700 1 -- 172.21.15.78:0/2102697710 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800e070 con 0x7f31900c1010 2023-08-17T18:10:23.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f319523f700 1 -- 172.21.15.78:0/2102697710 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800bb60 con 0x7f31900c1010 2023-08-17T18:10:23.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f319523f700 1 -- 172.21.15.78:0/2102697710 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800bee0 con 0x7f31900c1010 2023-08-17T18:10:23.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f31984a5700 1 -- 172.21.15.78:0/2102697710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c1010 msgr2=0x7f31900ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.522+0000 7f31984a5700 1 --2- 172.21.15.78:0/2102697710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c1010 0x7f31900ca280 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f3188009e60 tx=0x7f3188009780).stop 2023-08-17T18:10:23.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.523+0000 7f31984a5700 1 -- 172.21.15.78:0/2102697710 shutdown_connections 2023-08-17T18:10:23.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.523+0000 7f31984a5700 1 --2- 172.21.15.78:0/2102697710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c1010 0x7f31900ca280 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.523+0000 7f31984a5700 1 -- 172.21.15.78:0/2102697710 >> 172.21.15.78:0/2102697710 conn(0x7f3190094510 msgr2=0x7f319006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:23.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.523+0000 7f31984a5700 1 -- 172.21.15.78:0/2102697710 shutdown_connections 2023-08-17T18:10:23.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.523+0000 7f31984a5700 1 -- 172.21.15.78:0/2102697710 wait complete. 2023-08-17T18:10:23.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.524+0000 7f31984a5700 1 Processor -- start 2023-08-17T18:10:23.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.524+0000 7f31984a5700 1 -- start start 2023-08-17T18:10:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.524+0000 7f31984a5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31900c1010 0x7f31901408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.524+0000 7f31984a5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c6ee0 0x7f3190064020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.524+0000 7f31984a5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190154140 0x7f3190064510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.524+0000 7f31984a5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190064a00 con 0x7f3190154140 2023-08-17T18:10:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.524+0000 7f31984a5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31901640f0 con 0x7f31900c6ee0 2023-08-17T18:10:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.524+0000 7f31984a5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3190164c50 con 0x7f31900c1010 2023-08-17T18:10:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.524+0000 7f3196a42700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190154140 0x7f3190064510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f3196a42700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190154140 0x7f3190064510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59434/0 (socket says 172.21.15.78:59434) 2023-08-17T18:10:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f3196a42700 1 -- 172.21.15.78:0/235528734 learned_addr learned my addr 172.21.15.78:0/235528734 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f3195a40700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c6ee0 0x7f3190064020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f3196241700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31900c1010 0x7f31901408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f3196a42700 1 -- 172.21.15.78:0/235528734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31900c1010 msgr2=0x7f31901408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f3196a42700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31900c1010 0x7f31901408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f3196a42700 1 -- 172.21.15.78:0/235528734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c6ee0 msgr2=0x7f3190064020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f3196a42700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c6ee0 0x7f3190064020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f3196a42700 1 -- 172.21.15.78:0/235528734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188009a20 con 0x7f3190154140 2023-08-17T18:10:23.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f3196a42700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190154140 0x7f3190064510 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f318800b6c0 tx=0x7f3188009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:23.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f31867fc700 1 -- 172.21.15.78:0/235528734 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318801d630 con 0x7f3190154140 2023-08-17T18:10:23.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f31867fc700 1 -- 172.21.15.78:0/235528734 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318801d790 con 0x7f3190154140 2023-08-17T18:10:23.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f31984a5700 1 -- 172.21.15.78:0/235528734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3190164320 con 0x7f3190154140 2023-08-17T18:10:23.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f31867fc700 1 -- 172.21.15.78:0/235528734 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318801db10 con 0x7f3190154140 2023-08-17T18:10:23.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.525+0000 7f31984a5700 1 -- 172.21.15.78:0/235528734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31901648e0 con 0x7f3190154140 2023-08-17T18:10:23.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.526+0000 7f31984a5700 1 -- 172.21.15.78:0/235528734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3190164dc0 con 0x7f3190154140 2023-08-17T18:10:23.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.526+0000 7f31867fc700 1 -- 172.21.15.78:0/235528734 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f3188026410 con 0x7f3190154140 2023-08-17T18:10:23.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.527+0000 7f31867fc700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f317405ee50 0x7f3174061310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.527+0000 7f3196241700 1 -- 172.21.15.78:0/235528734 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f317405ee50 msgr2=0x7f3174061310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:23.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.527+0000 7f31867fc700 1 -- 172.21.15.78:0/235528734 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6595+0+0 (secure 0 0 0) 0x7f318807bc70 con 0x7f3190154140 2023-08-17T18:10:23.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.527+0000 7f3196241700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f317405ee50 0x7f3174061310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:23.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.531+0000 7f31867fc700 1 -- 172.21.15.78:0/235528734 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f318804d030 con 0x7f3190154140 2023-08-17T18:10:23.535 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:23.535+0000 7f131c17f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:10:23.536 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:23.535+0000 7fb8e2c5c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:10:23.611 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:23.611+0000 7f131c17f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:10:23.643 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:23.642+0000 7fb8e2c5c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:10:23.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.702+0000 7f31984a5700 1 -- 172.21.15.78:0/235528734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3190047350 con 0x7f3190154140 2023-08-17T18:10:23.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.703+0000 7f31867fc700 1 -- 172.21.15.78:0/235528734 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+17718 (secure 0 0 0) 0x7f3188050650 con 0x7f3190154140 2023-08-17T18:10:23.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:23.703 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":155,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:10:20.716451+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T17:53:47.436687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T17:53:47.849880+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":155,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.3f","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/3977763008":"2023-08-18T18:05:20.568126+0000","172.21.15.78:0/2748193833":"2023-08-18T18:05:20.568126+0000","172.21.15.78:0/303775003":"2023-08-18T18:05:20.568126+0000","172.21.15.78:0/1641268059":"2023-08-18T18:05:20.568126+0000","172.21.15.78:6833/119464":"2023-08-18T17:54:04.156331+0000","172.21.15.78:0/1601918675":"2023-08-18T17:54:04.156331+0000","172.21.15.78:6832/119464":"2023-08-18T17:54:04.156331+0000","172.21.15.78:0/1263954043":"2023-08-18T17:54:04.156331+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:10:23.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 -- 172.21.15.78:0/235528734 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f317405ee50 msgr2=0x7f3174061310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:23.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f317405ee50 0x7f3174061310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:23.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 -- 172.21.15.78:0/235528734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190154140 msgr2=0x7f3190064510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190154140 0x7f3190064510 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f318800b6c0 tx=0x7f3188009780).stop 2023-08-17T18:10:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 -- 172.21.15.78:0/235528734 shutdown_connections 2023-08-17T18:10:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f317405ee50 0x7f3174061310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190154140 0x7f3190064510 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31900c1010 0x7f31901408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 --2- 172.21.15.78:0/235528734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31900c6ee0 0x7f3190064020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 -- 172.21.15.78:0/235528734 >> 172.21.15.78:0/235528734 conn(0x7f3190094510 msgr2=0x7f319014e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:23.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 -- 172.21.15.78:0/235528734 shutdown_connections 2023-08-17T18:10:23.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.705+0000 7f31984a5700 1 -- 172.21.15.78:0/235528734 wait complete. 2023-08-17T18:10:23.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T18:10:23.732 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:23.732+0000 7f131c17f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:10:23.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.835+0000 7f82f1bcd700 1 Processor -- start 2023-08-17T18:10:23.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.835+0000 7f82f1bcd700 1 -- start start 2023-08-17T18:10:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f1bcd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f82ec153c20 0x7f82ec0c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f1bcd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 0x7f82ec0a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f1bcd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ec0630c0 con 0x7f82ec0a4d60 2023-08-17T18:10:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f1bcd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ec0c62c0 con 0x7f82ec153c20 2023-08-17T18:10:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f1bcd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec0624f0 con 0x7f82ec154000 2023-08-17T18:10:23.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82ebfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 0x7f82ec0a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f0bcb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f82ec153c20 0x7f82ec0c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f13cc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f82ec0a4d60 0x7f82ec063550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:57172/0 (socket says 172.21.15.78:57172) 2023-08-17T18:10:23.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f13cc700 1 -- 172.21.15.78:0/3037286199 learned_addr learned my addr 172.21.15.78:0/3037286199 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:23.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f0bcb700 1 -- 172.21.15.78:0/3037286199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 msgr2=0x7f82ec0a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:23.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f0bcb700 1 --2- 172.21.15.78:0/3037286199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 0x7f82ec0a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f0bcb700 1 -- 172.21.15.78:0/3037286199 >> v1:172.21.15.150:6789/0 conn(0x7f82ec0a4d60 legacy=0x7f82ec063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82eb7fe700 1 -- 172.21.15.78:0/3037286199 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507291219 0 0) 0x7f82ec0630c0 con 0x7f82ec0a4d60 2023-08-17T18:10:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82f0bcb700 1 -- 172.21.15.78:0/3037286199 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec0c3aa0 con 0x7f82ec153c20 2023-08-17T18:10:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.836+0000 7f82ebfff700 1 --2- 172.21.15.78:0/3037286199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 0x7f82ec0a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.837+0000 7f82f0bcb700 1 --2- 172.21.15.78:0/3037286199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82ec153c20 0x7f82ec0c35b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f82e0006fd0 tx=0x7f82e0006f40).ready entity=mon.1 client_cookie=3be63fe623422cdf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.837+0000 7f82eb7fe700 1 -- 172.21.15.78:0/3037286199 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0005880 con 0x7f82ec153c20 2023-08-17T18:10:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.837+0000 7f82eb7fe700 1 -- 172.21.15.78:0/3037286199 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e00059e0 con 0x7f82ec153c20 2023-08-17T18:10:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.837+0000 7f82eb7fe700 1 -- 172.21.15.78:0/3037286199 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0005d60 con 0x7f82ec153c20 2023-08-17T18:10:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.837+0000 7f82f1bcd700 1 -- 172.21.15.78:0/3037286199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82ec153c20 msgr2=0x7f82ec0c35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.837+0000 7f82f1bcd700 1 --2- 172.21.15.78:0/3037286199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82ec153c20 0x7f82ec0c35b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f82e0006fd0 tx=0x7f82e0006f40).stop 2023-08-17T18:10:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.838+0000 7f82f1bcd700 1 -- 172.21.15.78:0/3037286199 shutdown_connections 2023-08-17T18:10:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.838+0000 7f82f1bcd700 1 --2- 172.21.15.78:0/3037286199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82ec153c20 0x7f82ec0c35b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.838+0000 7f82f1bcd700 1 --2- 172.21.15.78:0/3037286199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 0x7f82ec0a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.838+0000 7f82f1bcd700 1 -- 172.21.15.78:0/3037286199 >> 172.21.15.78:0/3037286199 conn(0x7f82ec064830 msgr2=0x7f82ec064c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.838+0000 7f82f1bcd700 1 -- 172.21.15.78:0/3037286199 shutdown_connections 2023-08-17T18:10:23.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.838+0000 7f82f1bcd700 1 -- 172.21.15.78:0/3037286199 wait complete. 2023-08-17T18:10:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.840+0000 7f82f1bcd700 1 Processor -- start 2023-08-17T18:10:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.840+0000 7f82f1bcd700 1 -- start start 2023-08-17T18:10:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82f1bcd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82ec0a4d60 0x7f82ec0c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82f1bcd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82ec153c20 0x7f82ec0be480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82f1bcd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 0x7f82ec0be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82f1bcd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec157fe0 con 0x7f82ec153c20 2023-08-17T18:10:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82f1bcd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec1582c0 con 0x7f82ec0a4d60 2023-08-17T18:10:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82f1bcd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec0a7cb0 con 0x7f82ec154000 2023-08-17T18:10:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82ebfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82ec153c20 0x7f82ec0be480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82ebfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82ec153c20 0x7f82ec0be480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59442/0 (socket says 172.21.15.78:59442) 2023-08-17T18:10:23.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82ebfff700 1 -- 172.21.15.78:0/4137468584 learned_addr learned my addr 172.21.15.78:0/4137468584 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:23.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82f0bcb700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82ec0a4d60 0x7f82ec0c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.841+0000 7f82f13cc700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 0x7f82ec0be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:23.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82ebfff700 1 -- 172.21.15.78:0/4137468584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 msgr2=0x7f82ec0be970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82ebfff700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 0x7f82ec0be970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82ebfff700 1 -- 172.21.15.78:0/4137468584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82ec0a4d60 msgr2=0x7f82ec0c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82ebfff700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82ec0a4d60 0x7f82ec0c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82ebfff700 1 -- 172.21.15.78:0/4137468584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80092a0 con 0x7f82ec153c20 2023-08-17T18:10:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82ebfff700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82ec153c20 0x7f82ec0be480 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f82d800e980 tx=0x7f82d8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82e8ff9700 1 -- 172.21.15.78:0/4137468584 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8012600 con 0x7f82ec153c20 2023-08-17T18:10:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82e8ff9700 1 -- 172.21.15.78:0/4137468584 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d8012760 con 0x7f82ec153c20 2023-08-17T18:10:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82f1bcd700 1 -- 172.21.15.78:0/4137468584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e0009250 con 0x7f82ec153c20 2023-08-17T18:10:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82e8ff9700 1 -- 172.21.15.78:0/4137468584 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8012ae0 con 0x7f82ec153c20 2023-08-17T18:10:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.842+0000 7f82f1bcd700 1 -- 172.21.15.78:0/4137468584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ec0a8270 con 0x7f82ec153c20 2023-08-17T18:10:23.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.843+0000 7f82f1bcd700 1 -- 172.21.15.78:0/4137468584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ec0c68a0 con 0x7f82ec153c20 2023-08-17T18:10:23.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.843+0000 7f82e8ff9700 1 -- 172.21.15.78:0/4137468584 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 76) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f82d8022070 con 0x7f82ec153c20 2023-08-17T18:10:23.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.844+0000 7f82e8ff9700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f82d005ee20 0x7f82d00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:23.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.844+0000 7f82f0bcb700 1 -- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f82d005ee20 msgr2=0x7f82d00612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:23.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.844+0000 7f82e8ff9700 1 -- 172.21.15.78:0/4137468584 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6595+0+0 (secure 0 0 0) 0x7f82d807a130 con 0x7f82ec153c20 2023-08-17T18:10:23.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.844+0000 7f82f0bcb700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f82d005ee20 0x7f82d00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:23.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:23.848+0000 7f82e8ff9700 1 -- 172.21.15.78:0/4137468584 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f82d804b400 con 0x7f82ec153c20 2023-08-17T18:10:23.851 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:23.851+0000 7f131c17f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:10:23.936 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:23.934+0000 7fb8e2c5c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:10:24.006 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:24.005+0000 7fb8e2c5c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:10:24.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.044+0000 7f82f0bcb700 1 -- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f82d005ee20 msgr2=0x7f82d00612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:24.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.044+0000 7f82f0bcb700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f82d005ee20 0x7f82d00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:10:24.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.060+0000 7f82f1bcd700 1 -- 172.21.15.78:0/4137468584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f82ec0a9de0 con 0x7f82ec153c20 2023-08-17T18:10:24.150 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.149+0000 7f131c17f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:10:24.220 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.219+0000 7f131c17f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:10:24.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.241+0000 7f82e8ff9700 1 -- 172.21.15.78:0/4137468584 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 77) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f82d8077d60 con 0x7f82ec153c20 2023-08-17T18:10:24.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.241+0000 7f82e8ff9700 1 -- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f82d005ee20 msgr2=0x7f82d00612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:24.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.241+0000 7f82e8ff9700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f82d005ee20 0x7f82d00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:24.244 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-08-17T18:10:24.243+0000 7f49ea49a700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T18:10:24.244 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-08-17T18:10:24.243+0000 7f49ea49a700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T18:10:24.244 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-08-17T18:10:24.243+0000 7f49ea49a700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T18:10:24.259 INFO:tasks.ceph.mds.b.smithi150.stderr: -4> 2023-08-17T18:10:24.243+0000 7f49ea49a700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T18:10:24.259 INFO:tasks.ceph.mds.b.smithi150.stderr: -3> 2023-08-17T18:10:24.243+0000 7f49ea49a700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T18:10:24.259 INFO:tasks.ceph.mds.b.smithi150.stderr: -1> 2023-08-17T18:10:24.243+0000 7f49ea49a700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T18:10:24.278 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T18:10:24.292 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.292+0000 7f129c160700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:24.292 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.292+0000 7f129c160700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:24.293 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.292+0000 7f129c160700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:24.293 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.292+0000 7f129c160700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:24.293 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.292+0000 7f129c160700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:24.293 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.292+0000 7f129f166700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:24.293 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.292+0000 7f129f166700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:24.294 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.292+0000 7f129f166700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:24.294 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.292+0000 7f129f166700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:24.294 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:24.292+0000 7f129f166700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:24.727 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T18:10:24.726+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T18:10:24.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.734+0000 7f82e8ff9700 1 -- 172.21.15.78:0/4137468584 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7f82d806c960 con 0x7f82ec153c20 2023-08-17T18:10:24.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.736+0000 7f82f1bcd700 1 -- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82ec153c20 msgr2=0x7f82ec0be480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.736+0000 7f82f1bcd700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82ec153c20 0x7f82ec0be480 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f82d800e980 tx=0x7f82d8009060).stop 2023-08-17T18:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.736+0000 7f82f1bcd700 1 -- 172.21.15.78:0/4137468584 shutdown_connections 2023-08-17T18:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.736+0000 7f82f1bcd700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f82d005ee20 0x7f82d00612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.736+0000 7f82f1bcd700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82ec154000 0x7f82ec0be970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.736+0000 7f82f1bcd700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82ec0a4d60 0x7f82ec0c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.736+0000 7f82f1bcd700 1 --2- 172.21.15.78:0/4137468584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82ec153c20 0x7f82ec0be480 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.736+0000 7f82f1bcd700 1 -- 172.21.15.78:0/4137468584 >> 172.21.15.78:0/4137468584 conn(0x7f82ec064830 msgr2=0x7f82ec1521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.737+0000 7f82f1bcd700 1 -- 172.21.15.78:0/4137468584 shutdown_connections 2023-08-17T18:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.737+0000 7f82f1bcd700 1 -- 172.21.15.78:0/4137468584 wait complete. 2023-08-17T18:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T18:10:24.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T18:10:24.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.903+0000 7fac0dc9d700 1 Processor -- start 2023-08-17T18:10:24.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.903+0000 7fac0dc9d700 1 -- start start 2023-08-17T18:10:24.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.904+0000 7fac0dc9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fac081578f0 0x7fac080be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:24.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.904+0000 7fac0dc9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac080bf0e0 0x7fac08095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:24.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.904+0000 7fac0dc9d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac080967b0 con 0x7fac08096300 2023-08-17T18:10:24.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.904+0000 7fac0dc9d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac080bf5c0 con 0x7fac081578f0 2023-08-17T18:10:24.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.904+0000 7fac0dc9d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac080c32d0 con 0x7fac080bf0e0 2023-08-17T18:10:24.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac080bf0e0 0x7fac08095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:24.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac077fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fac081578f0 0x7fac080be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:24.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac07fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fac08096300 0x7fac08064330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:57184/0 (socket says 172.21.15.78:57184) 2023-08-17T18:10:24.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac080bf0e0 0x7fac08095e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:53924/0 (socket says 172.21.15.78:53924) 2023-08-17T18:10:24.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac077fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fac081578f0 0x7fac080be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:57078/0 (socket says 172.21.15.78:57078) 2023-08-17T18:10:24.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac07fff700 1 -- 172.21.15.78:0/3902326599 learned_addr learned my addr 172.21.15.78:0/3902326599 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:24.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac067fc700 1 -- 172.21.15.78:0/3902326599 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823540243 0 0) 0x7fac00001490 con 0x7fac08096300 2023-08-17T18:10:24.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac067fc700 1 -- 172.21.15.78:0/3902326599 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf00033f0 con 0x7fac08096300 2023-08-17T18:10:24.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac06ffd700 1 -- 172.21.15.78:0/3902326599 >> v2:172.21.15.150:3300/0 conn(0x7fac081578f0 msgr2=0x7fac080be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:24.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac06ffd700 1 --2- 172.21.15.78:0/3902326599 >> v2:172.21.15.150:3300/0 conn(0x7fac081578f0 0x7fac080be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:24.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac06ffd700 1 -- 172.21.15.78:0/3902326599 >> v1:172.21.15.150:6789/0 conn(0x7fac08096300 legacy=0x7fac08064330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:24.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac06ffd700 1 -- 172.21.15.78:0/3902326599 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac080c3e10 con 0x7fac080bf0e0 2023-08-17T18:10:24.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac077fe700 1 --2- 172.21.15.78:0/3902326599 >> v2:172.21.15.150:3300/0 conn(0x7fac081578f0 0x7fac080be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:24.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac06ffd700 1 --2- 172.21.15.78:0/3902326599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac080bf0e0 0x7fac08095e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fabfc009760 tx=0x7fabfc009060).ready entity=mon.2 client_cookie=af90ab51c78043a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:24.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac067fc700 1 -- 172.21.15.78:0/3902326599 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00d4a0 con 0x7fac080bf0e0 2023-08-17T18:10:24.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac067fc700 1 -- 172.21.15.78:0/3902326599 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc00d600 con 0x7fac080bf0e0 2023-08-17T18:10:24.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.905+0000 7fac067fc700 1 -- 172.21.15.78:0/3902326599 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00d980 con 0x7fac080bf0e0 2023-08-17T18:10:24.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.906+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3902326599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac080bf0e0 msgr2=0x7fac08095e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:24.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.906+0000 7fac0dc9d700 1 --2- 172.21.15.78:0/3902326599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac080bf0e0 0x7fac08095e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fabfc009760 tx=0x7fabfc009060).stop 2023-08-17T18:10:24.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.906+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3902326599 shutdown_connections 2023-08-17T18:10:24.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.906+0000 7fac0dc9d700 1 --2- 172.21.15.78:0/3902326599 >> v2:172.21.15.150:3300/0 conn(0x7fac081578f0 0x7fac080be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:24.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.906+0000 7fac0dc9d700 1 --2- 172.21.15.78:0/3902326599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac080bf0e0 0x7fac08095e10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:24.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.906+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3902326599 >> 172.21.15.78:0/3902326599 conn(0x7fac08062f80 msgr2=0x7fac080c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:24.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.906+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3902326599 shutdown_connections 2023-08-17T18:10:24.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.906+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3902326599 wait complete. 2023-08-17T18:10:24.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.907+0000 7fac0dc9d700 1 Processor -- start 2023-08-17T18:10:24.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.907+0000 7fac0dc9d700 1 -- start start 2023-08-17T18:10:24.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac0dc9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac08096300 0x7fac08157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:24.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac0dc9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac080bf0e0 0x7fac08168b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:24.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac0dc9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac081578f0 0x7fac0814dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:24.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac0dc9d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08169070 con 0x7fac080bf0e0 2023-08-17T18:10:24.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac0dc9d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0814e1a0 con 0x7fac081578f0 2023-08-17T18:10:24.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac0dc9d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac08158470 con 0x7fac08096300 2023-08-17T18:10:24.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac080bf0e0 0x7fac08168b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:24.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac080bf0e0 0x7fac08168b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59550/0 (socket says 172.21.15.78:59550) 2023-08-17T18:10:24.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac07fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac081578f0 0x7fac0814dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:24.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac077fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac08096300 0x7fac08157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:24.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac06ffd700 1 -- 172.21.15.78:0/3417913527 learned_addr learned my addr 172.21.15.78:0/3417913527 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:24.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac06ffd700 1 -- 172.21.15.78:0/3417913527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac08096300 msgr2=0x7fac08157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:24.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac06ffd700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac08096300 0x7fac08157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:24.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac06ffd700 1 -- 172.21.15.78:0/3417913527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac081578f0 msgr2=0x7fac0814dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:24.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac06ffd700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac081578f0 0x7fac0814dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:24.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac06ffd700 1 -- 172.21.15.78:0/3417913527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80092a0 con 0x7fac080bf0e0 2023-08-17T18:10:24.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac077fe700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac08096300 0x7fac08157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:24.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac06ffd700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac080bf0e0 0x7fac08168b80 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7fac080bf700 tx=0x7fabfc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:24.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fabef7fe700 1 -- 172.21.15.78:0/3417913527 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00dd30 con 0x7fac080bf0e0 2023-08-17T18:10:24.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fabef7fe700 1 -- 172.21.15.78:0/3417913527 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc00de90 con 0x7fac080bf0e0 2023-08-17T18:10:24.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3417913527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc0092a0 con 0x7fac080bf0e0 2023-08-17T18:10:24.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.908+0000 7fabef7fe700 1 -- 172.21.15.78:0/3417913527 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00d980 con 0x7fac080bf0e0 2023-08-17T18:10:24.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.909+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3417913527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac08158a30 con 0x7fac080bf0e0 2023-08-17T18:10:24.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.910+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3417913527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac081523e0 con 0x7fac080bf0e0 2023-08-17T18:10:24.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.910+0000 7fabef7fe700 1 -- 172.21.15.78:0/3417913527 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 77) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fabfc00f070 con 0x7fac080bf0e0 2023-08-17T18:10:24.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.910+0000 7fabef7fe700 1 -- 172.21.15.78:0/3417913527 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fabfc07b1b0 con 0x7fac080bf0e0 2023-08-17T18:10:24.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:24.914+0000 7fabef7fe700 1 -- 172.21.15.78:0/3417913527 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac081523e0 con 0x7fac080bf0e0 2023-08-17T18:10:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.118+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3417913527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fac081523e0 con 0x7fac080bf0e0 2023-08-17T18:10:25.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.243+0000 7fabef7fe700 1 -- 172.21.15.78:0/3417913527 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 78) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fabfc078e50 con 0x7fac080bf0e0 2023-08-17T18:10:25.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.244+0000 7fabef7fe700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fabf40301b0 0x7fabf4067a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:25.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.245+0000 7fac077fe700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fabf40301b0 0x7fabf4067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:25.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.246+0000 7fac077fe700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fabf40301b0 0x7fabf4067a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fabf80114c0 tx=0x7fabf8009060).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:25.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.736+0000 7fabef7fe700 1 -- 172.21.15.78:0/3417913527 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7fabfc053170 con 0x7fac080bf0e0 2023-08-17T18:10:25.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3417913527 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fabf40301b0 msgr2=0x7fabf4067a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:25.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fabf40301b0 0x7fabf4067a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fabf80114c0 tx=0x7fabf8009060).stop 2023-08-17T18:10:25.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3417913527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac080bf0e0 msgr2=0x7fac08168b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:25.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac080bf0e0 0x7fac08168b80 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7fac080bf700 tx=0x7fabfc016000).stop 2023-08-17T18:10:25.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3417913527 shutdown_connections 2023-08-17T18:10:25.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fabf40301b0 0x7fabf4067a70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:25.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac081578f0 0x7fac0814dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:25.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac08096300 0x7fac08157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:25.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 --2- 172.21.15.78:0/3417913527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac080bf0e0 0x7fac08168b80 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:25.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3417913527 >> 172.21.15.78:0/3417913527 conn(0x7fac08062f80 msgr2=0x7fac0805e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:25.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3417913527 shutdown_connections 2023-08-17T18:10:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.738+0000 7fac0dc9d700 1 -- 172.21.15.78:0/3417913527 wait complete. 2023-08-17T18:10:25.751 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T18:10:25.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.867+0000 7fcd127e9700 1 Processor -- start 2023-08-17T18:10:25.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.867+0000 7fcd127e9700 1 -- start start 2023-08-17T18:10:25.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd127e9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd0c0aa0f0 0x7fcd0c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:25.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd127e9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd0c0aa4d0 0x7fcd0c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:25.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd127e9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0c0649b0 con 0x7fcd0c0c5810 2023-08-17T18:10:25.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd127e9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c063420 con 0x7fcd0c0aa0f0 2023-08-17T18:10:25.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd127e9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c063700 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd0bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd0c0aa0f0 0x7fcd0c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:25.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd10d86700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcd0c0c5810 0x7fcd0c0c5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48062/0 (socket says 172.21.15.78:48062) 2023-08-17T18:10:25.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd10d86700 1 -- 172.21.15.78:0/516571547 learned_addr learned my addr 172.21.15.78:0/516571547 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd0b7fe700 1 --2- 172.21.15.78:0/516571547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd0c0aa4d0 0x7fcd0c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd0bfff700 1 -- 172.21.15.78:0/516571547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd0c0aa4d0 msgr2=0x7fcd0c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd0bfff700 1 --2- 172.21.15.78:0/516571547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd0c0aa4d0 0x7fcd0c0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd0bfff700 1 -- 172.21.15.78:0/516571547 >> v1:172.21.15.78:6789/0 conn(0x7fcd0c0c5810 legacy=0x7fcd0c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd0bfff700 1 -- 172.21.15.78:0/516571547 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c0639e0 con 0x7fcd0c0aa0f0 2023-08-17T18:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.868+0000 7fcd0affd700 1 -- 172.21.15.78:0/516571547 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557191498 0 0) 0x7fcd0c0649b0 con 0x7fcd0c0c5810 2023-08-17T18:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd0bfff700 1 --2- 172.21.15.78:0/516571547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa0f0 0x7fcd0c0644c0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7fccfc009760 tx=0x7fccfc009060).ready entity=mon.0 client_cookie=c3f20b077f9f6026 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd0affd700 1 -- 172.21.15.78:0/516571547 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00f510 con 0x7fcd0c0aa0f0 2023-08-17T18:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd0affd700 1 -- 172.21.15.78:0/516571547 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc00f670 con 0x7fcd0c0aa0f0 2023-08-17T18:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd0affd700 1 -- 172.21.15.78:0/516571547 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00f9f0 con 0x7fcd0c0aa0f0 2023-08-17T18:10:25.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd127e9700 1 -- 172.21.15.78:0/516571547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa0f0 msgr2=0x7fcd0c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:25.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd127e9700 1 --2- 172.21.15.78:0/516571547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa0f0 0x7fcd0c0644c0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7fccfc009760 tx=0x7fccfc009060).stop 2023-08-17T18:10:25.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd127e9700 1 -- 172.21.15.78:0/516571547 shutdown_connections 2023-08-17T18:10:25.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd127e9700 1 --2- 172.21.15.78:0/516571547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa0f0 0x7fcd0c0644c0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd127e9700 1 --2- 172.21.15.78:0/516571547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd0c0aa4d0 0x7fcd0c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd127e9700 1 -- 172.21.15.78:0/516571547 >> 172.21.15.78:0/516571547 conn(0x7fcd0c06a6a0 msgr2=0x7fcd0c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd127e9700 1 -- 172.21.15.78:0/516571547 shutdown_connections 2023-08-17T18:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.869+0000 7fcd127e9700 1 -- 172.21.15.78:0/516571547 wait complete. 2023-08-17T18:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.870+0000 7fcd127e9700 1 Processor -- start 2023-08-17T18:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.871+0000 7fcd127e9700 1 -- start start 2023-08-17T18:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.871+0000 7fcd127e9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd0c0aa0f0 0x7fcd0c0ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.871+0000 7fcd127e9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa4d0 0x7fcd0c142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.871+0000 7fcd127e9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd0c0c5810 0x7fcd0c1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.871+0000 7fcd127e9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0ad560 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.871+0000 7fcd127e9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0ac950 con 0x7fcd0c0aa0f0 2023-08-17T18:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.871+0000 7fcd127e9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0acc30 con 0x7fcd0c0c5810 2023-08-17T18:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.871+0000 7fcd0b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa4d0 0x7fcd0c142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.871+0000 7fcd0b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa4d0 0x7fcd0c142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59570/0 (socket says 172.21.15.78:59570) 2023-08-17T18:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.871+0000 7fcd0b7fe700 1 -- 172.21.15.78:0/1351298169 learned_addr learned my addr 172.21.15.78:0/1351298169 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fcd10d86700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd0c0c5810 0x7fcd0c1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fcd0bfff700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd0c0aa0f0 0x7fcd0c0ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fcd0b7fe700 1 -- 172.21.15.78:0/1351298169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd0c0c5810 msgr2=0x7fcd0c1521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fcd0b7fe700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd0c0c5810 0x7fcd0c1521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fcd0b7fe700 1 -- 172.21.15.78:0/1351298169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd0c0aa0f0 msgr2=0x7fcd0c0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fcd0b7fe700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd0c0aa0f0 0x7fcd0c0ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fcd0b7fe700 1 -- 172.21.15.78:0/1351298169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0092a0 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fcd0b7fe700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa4d0 0x7fcd0c142b40 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7fcd0000e950 tx=0x7fcd00009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fccf3fff700 1 -- 172.21.15.78:0/1351298169 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000c850 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fccf3fff700 1 -- 172.21.15.78:0/1351298169 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0000c9b0 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fccf3fff700 1 -- 172.21.15.78:0/1351298169 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000cd30 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fcd127e9700 1 -- 172.21.15.78:0/1351298169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0acf10 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.872+0000 7fcd127e9700 1 -- 172.21.15.78:0/1351298169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c0ab8b0 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.873+0000 7fcd127e9700 1 -- 172.21.15.78:0/1351298169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0c083980 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.873+0000 7fccf3fff700 1 -- 172.21.15.78:0/1351298169 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 78) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fcd00022070 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.874+0000 7fccf3fff700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fccf805ed20 0x7fccf80611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:25.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.874+0000 7fccf3fff700 1 -- 172.21.15.78:0/1351298169 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fcd0007a1e0 con 0x7fcd0c0aa4d0 2023-08-17T18:10:25.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.874+0000 7fcd0bfff700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fccf805ed20 0x7fccf80611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:25.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.874+0000 7fcd0bfff700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fccf805ed20 0x7fccf80611e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fccfc009fd0 tx=0x7fccfc017000).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:25.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:25.878+0000 7fccf3fff700 1 -- 172.21.15.78:0/1351298169 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcd0004b520 con 0x7fcd0c0aa4d0 2023-08-17T18:10:26.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.042+0000 7fcd127e9700 1 -- 172.21.15.78:0/1351298169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcd0c0c1170 con 0x7fcd0c0aa4d0 2023-08-17T18:10:26.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.505+0000 7fccf3fff700 1 -- 172.21.15.78:0/1351298169 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v158) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcd000160d0 con 0x7fcd0c0aa4d0 2023-08-17T18:10:26.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.507+0000 7fcd127e9700 1 -- 172.21.15.78:0/1351298169 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fccf805ed20 msgr2=0x7fccf80611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:26.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.507+0000 7fcd127e9700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fccf805ed20 0x7fccf80611e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fccfc009fd0 tx=0x7fccfc017000).stop 2023-08-17T18:10:26.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.507+0000 7fcd127e9700 1 -- 172.21.15.78:0/1351298169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa4d0 msgr2=0x7fcd0c142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:26.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.507+0000 7fcd127e9700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa4d0 0x7fcd0c142b40 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7fcd0000e950 tx=0x7fcd00009060).stop 2023-08-17T18:10:26.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.507+0000 7fcd127e9700 1 -- 172.21.15.78:0/1351298169 shutdown_connections 2023-08-17T18:10:26.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.507+0000 7fcd127e9700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fccf805ed20 0x7fccf80611e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:26.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.507+0000 7fcd127e9700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd0c0c5810 0x7fcd0c1521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:26.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.507+0000 7fcd127e9700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd0c0aa0f0 0x7fcd0c0ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:26.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.507+0000 7fcd127e9700 1 --2- 172.21.15.78:0/1351298169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd0c0aa4d0 0x7fcd0c142b40 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:26.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.508+0000 7fcd127e9700 1 -- 172.21.15.78:0/1351298169 >> 172.21.15.78:0/1351298169 conn(0x7fcd0c06a6a0 msgr2=0x7fcd0c0a8540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:26.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.509+0000 7fcd127e9700 1 -- 172.21.15.78:0/1351298169 shutdown_connections 2023-08-17T18:10:26.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.510+0000 7fcd127e9700 1 -- 172.21.15.78:0/1351298169 wait complete. 2023-08-17T18:10:26.511 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T18:10:26.523 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T18:10:26.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.638+0000 7fa519536700 1 Processor -- start 2023-08-17T18:10:26.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.638+0000 7fa519536700 1 -- start start 2023-08-17T18:10:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.639+0000 7fa519536700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5141578f0 0x7fa5140be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.639+0000 7fa519536700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5140bf0e0 0x7fa514095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.639+0000 7fa519536700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5140c3e10 con 0x7fa514096300 2023-08-17T18:10:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.639+0000 7fa519536700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5140bf5c0 con 0x7fa5140bf0e0 2023-08-17T18:10:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.639+0000 7fa519536700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5140c32d0 con 0x7fa5141578f0 2023-08-17T18:10:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.639+0000 7fa50a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5140bf0e0 0x7fa514095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.639+0000 7fa50a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5140bf0e0 0x7fa514095e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59578/0 (socket says 172.21.15.78:59578) 2023-08-17T18:10:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.639+0000 7fa50a7fc700 1 -- 172.21.15.78:0/2975696627 learned_addr learned my addr 172.21.15.78:0/2975696627 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa512ffd700 1 --2- 172.21.15.78:0/2975696627 >> v2:172.21.15.150:3300/0 conn(0x7fa5141578f0 0x7fa5140be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa50a7fc700 1 -- 172.21.15.78:0/2975696627 >> v2:172.21.15.150:3300/0 conn(0x7fa5141578f0 msgr2=0x7fa5140be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa50a7fc700 1 --2- 172.21.15.78:0/2975696627 >> v2:172.21.15.150:3300/0 conn(0x7fa5141578f0 0x7fa5140be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa50a7fc700 1 -- 172.21.15.78:0/2975696627 >> v1:172.21.15.150:6789/0 conn(0x7fa514096300 legacy=0x7fa514064330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa50a7fc700 1 -- 172.21.15.78:0/2975696627 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa514096750 con 0x7fa5140bf0e0 2023-08-17T18:10:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa50a7fc700 1 --2- 172.21.15.78:0/2975696627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 0x7fa514095e10 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7fa5140605b0 tx=0x7fa4fc0090f0).ready entity=mon.0 client_cookie=9c22a9985ed07b48 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:26.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa5127fc700 1 -- 172.21.15.78:0/2975696627 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00b5a0 con 0x7fa5140bf0e0 2023-08-17T18:10:26.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa5127fc700 1 -- 172.21.15.78:0/2975696627 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00b700 con 0x7fa5140bf0e0 2023-08-17T18:10:26.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa5127fc700 1 -- 172.21.15.78:0/2975696627 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00ba80 con 0x7fa5140bf0e0 2023-08-17T18:10:26.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa519536700 1 -- 172.21.15.78:0/2975696627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 msgr2=0x7fa514095e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:26.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.640+0000 7fa519536700 1 --2- 172.21.15.78:0/2975696627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 0x7fa514095e10 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7fa5140605b0 tx=0x7fa4fc0090f0).stop 2023-08-17T18:10:26.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.641+0000 7fa519536700 1 -- 172.21.15.78:0/2975696627 shutdown_connections 2023-08-17T18:10:26.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.641+0000 7fa519536700 1 --2- 172.21.15.78:0/2975696627 >> v2:172.21.15.150:3300/0 conn(0x7fa5141578f0 0x7fa5140be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.641+0000 7fa519536700 1 --2- 172.21.15.78:0/2975696627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 0x7fa514095e10 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.641+0000 7fa519536700 1 -- 172.21.15.78:0/2975696627 >> 172.21.15.78:0/2975696627 conn(0x7fa514062f80 msgr2=0x7fa5140c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.641+0000 7fa519536700 1 -- 172.21.15.78:0/2975696627 shutdown_connections 2023-08-17T18:10:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.641+0000 7fa519536700 1 -- 172.21.15.78:0/2975696627 wait complete. 2023-08-17T18:10:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.642+0000 7fa519536700 1 Processor -- start 2023-08-17T18:10:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.642+0000 7fa519536700 1 -- start start 2023-08-17T18:10:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.642+0000 7fa519536700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa514096300 0x7fa5140c2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa519536700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 0x7fa514164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa519536700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5141578f0 0x7fa514164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa519536700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140ab5d0 con 0x7fa5140bf0e0 2023-08-17T18:10:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa519536700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140c0ed0 con 0x7fa5141578f0 2023-08-17T18:10:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa519536700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140c02c0 con 0x7fa514096300 2023-08-17T18:10:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 0x7fa514164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 0x7fa514164230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59590/0 (socket says 172.21.15.78:59590) 2023-08-17T18:10:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50a7fc700 1 -- 172.21.15.78:0/713378279 learned_addr learned my addr 172.21.15.78:0/713378279 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:26.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa512ffd700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa514096300 0x7fa5140c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:26.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa5137fe700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5141578f0 0x7fa514164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:26.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50a7fc700 1 -- 172.21.15.78:0/713378279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa514096300 msgr2=0x7fa5140c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:26.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50a7fc700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa514096300 0x7fa5140c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:26.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50a7fc700 1 -- 172.21.15.78:0/713378279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5141578f0 msgr2=0x7fa514164720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:26.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50a7fc700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5141578f0 0x7fa514164720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:26.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50a7fc700 1 -- 172.21.15.78:0/713378279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc009370 con 0x7fa5140bf0e0 2023-08-17T18:10:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50a7fc700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 0x7fa514164230 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7fa4fc009130 tx=0x7fa4fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50b7fe700 1 -- 172.21.15.78:0/713378279 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00b870 con 0x7fa5140bf0e0 2023-08-17T18:10:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50b7fe700 1 -- 172.21.15.78:0/713378279 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00b9d0 con 0x7fa5140bf0e0 2023-08-17T18:10:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa50b7fe700 1 -- 172.21.15.78:0/713378279 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc01c670 con 0x7fa5140bf0e0 2023-08-17T18:10:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa519536700 1 -- 172.21.15.78:0/713378279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5140c05a0 con 0x7fa5140bf0e0 2023-08-17T18:10:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.643+0000 7fa519536700 1 -- 172.21.15.78:0/713378279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5140c0b60 con 0x7fa5140bf0e0 2023-08-17T18:10:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.644+0000 7fa519536700 1 -- 172.21.15.78:0/713378279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5140c1040 con 0x7fa5140bf0e0 2023-08-17T18:10:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.644+0000 7fa50b7fe700 1 -- 172.21.15.78:0/713378279 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 78) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fa4fc02c070 con 0x7fa5140bf0e0 2023-08-17T18:10:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.645+0000 7fa50b7fe700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa4f405ecf0 0x7fa4f40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.645+0000 7fa50b7fe700 1 -- 172.21.15.78:0/713378279 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6399+0+0 (secure 0 0 0) 0x7fa4fc07b770 con 0x7fa5140bf0e0 2023-08-17T18:10:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.645+0000 7fa512ffd700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa4f405ecf0 0x7fa4f40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:26.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.645+0000 7fa512ffd700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa4f405ecf0 0x7fa4f40611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa504006fd0 tx=0x7fa504008040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:26.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.649+0000 7fa50b7fe700 1 -- 172.21.15.78:0/713378279 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa4fc04cca0 con 0x7fa5140bf0e0 2023-08-17T18:10:26.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:26.812+0000 7fa519536700 1 -- 172.21.15.78:0/713378279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa5140695e0 con 0x7fa5140bf0e0 2023-08-17T18:10:27.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.251+0000 7fa50b7fe700 1 -- 172.21.15.78:0/713378279 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa4fc022030 con 0x7fa5140bf0e0 2023-08-17T18:10:27.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.508+0000 7fa50b7fe700 1 -- 172.21.15.78:0/713378279 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v159) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa4fc043940 con 0x7fa5140bf0e0 2023-08-17T18:10:27.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.511+0000 7fa519536700 1 -- 172.21.15.78:0/713378279 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa4f405ecf0 msgr2=0x7fa4f40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.511+0000 7fa519536700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa4f405ecf0 0x7fa4f40611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa504006fd0 tx=0x7fa504008040).stop 2023-08-17T18:10:27.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.511+0000 7fa519536700 1 -- 172.21.15.78:0/713378279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 msgr2=0x7fa514164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.511+0000 7fa519536700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 0x7fa514164230 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7fa4fc009130 tx=0x7fa4fc015000).stop 2023-08-17T18:10:27.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.511+0000 7fa519536700 1 -- 172.21.15.78:0/713378279 shutdown_connections 2023-08-17T18:10:27.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.512+0000 7fa519536700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa4f405ecf0 0x7fa4f40611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.512+0000 7fa519536700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5141578f0 0x7fa514164720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.512+0000 7fa519536700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa514096300 0x7fa5140c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.512+0000 7fa519536700 1 --2- 172.21.15.78:0/713378279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5140bf0e0 0x7fa514164230 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.512+0000 7fa519536700 1 -- 172.21.15.78:0/713378279 >> 172.21.15.78:0/713378279 conn(0x7fa514062f80 msgr2=0x7fa5141568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:27.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.512+0000 7fa519536700 1 -- 172.21.15.78:0/713378279 shutdown_connections 2023-08-17T18:10:27.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.512+0000 7fa519536700 1 -- 172.21.15.78:0/713378279 wait complete. 2023-08-17T18:10:27.514 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T18:10:27.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T18:10:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.638+0000 7fc2eebfe700 1 Processor -- start 2023-08-17T18:10:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.638+0000 7fc2eebfe700 1 -- start start 2023-08-17T18:10:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.639+0000 7fc2eebfe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc2e80aa4d0 0x7fc2e80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.639+0000 7fc2eebfe700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e80649b0 con 0x7fc2e80c5810 2023-08-17T18:10:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.639+0000 7fc2eebfe700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e8063420 con 0x7fc2e80aa0f0 2023-08-17T18:10:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.639+0000 7fc2eebfe700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e8063700 con 0x7fc2e80aa4d0 2023-08-17T18:10:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.639+0000 7fc2ed19b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc2e80c5810 0x7fc2e80a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48078/0 (socket says 172.21.15.78:48078) 2023-08-17T18:10:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.639+0000 7fc2ed19b700 1 -- 172.21.15.78:0/1838393016 learned_addr learned my addr 172.21.15.78:0/1838393016 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.639+0000 7fc2dffff700 1 --2- 172.21.15.78:0/1838393016 >> v2:172.21.15.150:3300/0 conn(0x7fc2e80aa4d0 0x7fc2e80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.639+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002987035 0 0) 0x7fc2e80649b0 con 0x7fc2e80c5810 2023-08-17T18:10:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.639+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d00033f0 con 0x7fc2e80c5810 2023-08-17T18:10:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2469459869 0 0) 0x7fc2d00033f0 con 0x7fc2e80c5810 2023-08-17T18:10:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 >> v2:172.21.15.150:3300/0 conn(0x7fc2e80aa4d0 msgr2=0x7fc2e80644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 --2- 172.21.15.78:0/1838393016 >> v2:172.21.15.150:3300/0 conn(0x7fc2e80aa4d0 0x7fc2e80644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 >> v1:172.21.15.150:6789/0 conn(0x7fc2e80aa0f0 legacy=0x7fc2e80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e80639e0 con 0x7fc2e80c5810 2023-08-17T18:10:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fc2e0001470 con 0x7fc2e80c5810 2023-08-17T18:10:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 >> v1:172.21.15.78:6789/0 conn(0x7fc2e80c5810 legacy=0x7fc2e80a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2d0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d0004690 0x7fc2d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2d0005000 0x7fc2d000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8063700 con 0x7fc2d00038e0 2023-08-17T18:10:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d000beb0 con 0x7fc2d0004690 2023-08-17T18:10:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d000c070 con 0x7fc2d0005000 2023-08-17T18:10:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2ec99a700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2d0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2dffff700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d0004690 0x7fc2d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2ed19b700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2d0005000 0x7fc2d000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2ec99a700 1 -- 172.21.15.78:0/1838393016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2d0005000 msgr2=0x7fc2d000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2ec99a700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2d0005000 0x7fc2d000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2ec99a700 1 -- 172.21.15.78:0/1838393016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d0004690 msgr2=0x7fc2d0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2ec99a700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2d0004690 0x7fc2d0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2ec99a700 1 -- 172.21.15.78:0/1838393016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00033f0 con 0x7fc2d00038e0 2023-08-17T18:10:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2ed19b700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2d0005000 0x7fc2d000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2ed19b700 1 -- 172.21.15.78:0/1838393016 reap_dead start 2023-08-17T18:10:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2ec99a700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2d0003d00 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7fc2e4001e30 tx=0x7fc2e4007f30).ready entity=mon.0 client_cookie=85bff13b61ef40ca server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4006a20 con 0x7fc2d00038e0 2023-08-17T18:10:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4006b80 con 0x7fc2d00038e0 2023-08-17T18:10:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.640+0000 7fc2df7fe700 1 -- 172.21.15.78:0/1838393016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e400c5d0 con 0x7fc2d00038e0 2023-08-17T18:10:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.641+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1838393016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 msgr2=0x7fc2d0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.641+0000 7fc2eebfe700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2d0003d00 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7fc2e4001e30 tx=0x7fc2e4007f30).stop 2023-08-17T18:10:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.641+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1838393016 shutdown_connections 2023-08-17T18:10:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.641+0000 7fc2eebfe700 1 --2- 172.21.15.78:0/1838393016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2d0003d00 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.641+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1838393016 >> 172.21.15.78:0/1838393016 conn(0x7fc2e806a6a0 msgr2=0x7fc2e80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:27.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.641+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1838393016 shutdown_connections 2023-08-17T18:10:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.641+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1838393016 wait complete. 2023-08-17T18:10:27.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.642+0000 7fc2eebfe700 1 Processor -- start 2023-08-17T18:10:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.642+0000 7fc2eebfe700 1 -- start start 2023-08-17T18:10:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2eebfe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2e814cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2eebfe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e80aa9b0 0x7fc2e80aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2eebfe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e80acfd0 0x7fc2e80ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2eebfe700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80ac4d0 con 0x7fc2d00038e0 2023-08-17T18:10:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2eebfe700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80ac040 con 0x7fc2e80aa9b0 2023-08-17T18:10:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2eebfe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80ad940 con 0x7fc2e80acfd0 2023-08-17T18:10:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2ec99a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2e814cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2ec99a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2e814cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59604/0 (socket says 172.21.15.78:59604) 2023-08-17T18:10:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2ec99a700 1 -- 172.21.15.78:0/1903833640 learned_addr learned my addr 172.21.15.78:0/1903833640 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2ed19b700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e80acfd0 0x7fc2e80ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2dffff700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e80aa9b0 0x7fc2e80aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2ec99a700 1 -- 172.21.15.78:0/1903833640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e80acfd0 msgr2=0x7fc2e80ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2ec99a700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e80acfd0 0x7fc2e80ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2ec99a700 1 -- 172.21.15.78:0/1903833640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e80aa9b0 msgr2=0x7fc2e80aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2ec99a700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e80aa9b0 0x7fc2e80aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.643+0000 7fc2ec99a700 1 -- 172.21.15.78:0/1903833640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e814d0d0 con 0x7fc2d00038e0 2023-08-17T18:10:27.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.644+0000 7fc2ec99a700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2e814cbe0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fc2e400c3c0 tx=0x7fc2e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:27.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.644+0000 7fc2dcff9700 1 -- 172.21.15.78:0/1903833640 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4012610 con 0x7fc2d00038e0 2023-08-17T18:10:27.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.644+0000 7fc2dcff9700 1 -- 172.21.15.78:0/1903833640 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4012770 con 0x7fc2d00038e0 2023-08-17T18:10:27.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.644+0000 7fc2dcff9700 1 -- 172.21.15.78:0/1903833640 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4012b30 con 0x7fc2d00038e0 2023-08-17T18:10:27.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.644+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1903833640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e80ab430 con 0x7fc2d00038e0 2023-08-17T18:10:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.644+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1903833640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e80ab9f0 con 0x7fc2d00038e0 2023-08-17T18:10:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.645+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1903833640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e8083980 con 0x7fc2d00038e0 2023-08-17T18:10:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.645+0000 7fc2dcff9700 1 -- 172.21.15.78:0/1903833640 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc2e4025030 con 0x7fc2d00038e0 2023-08-17T18:10:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.645+0000 7fc2dcff9700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2d405ed90 0x7fc2d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.646+0000 7fc2dcff9700 1 -- 172.21.15.78:0/1903833640 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fc2e407a870 con 0x7fc2d00038e0 2023-08-17T18:10:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.646+0000 7fc2dffff700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2d405ed90 0x7fc2d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.646+0000 7fc2dffff700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2d405ed90 0x7fc2d4061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc2d8006be0 tx=0x7fc2d8008040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.650+0000 7fc2dcff9700 1 -- 172.21.15.78:0/1903833640 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc2e404bf30 con 0x7fc2d00038e0 2023-08-17T18:10:27.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.815+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1903833640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc2e8046af0 con 0x7fc2d00038e0 2023-08-17T18:10:27.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.818+0000 7fc2dcff9700 1 -- 172.21.15.78:0/1903833640 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc2e4023020 con 0x7fc2d00038e0 2023-08-17T18:10:27.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1903833640 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2d405ed90 msgr2=0x7fc2d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2d405ed90 0x7fc2d4061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc2d8006be0 tx=0x7fc2d8008040).stop 2023-08-17T18:10:27.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1903833640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 msgr2=0x7fc2e814cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2e814cbe0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fc2e400c3c0 tx=0x7fc2e4016000).stop 2023-08-17T18:10:27.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1903833640 shutdown_connections 2023-08-17T18:10:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2d405ed90 0x7fc2d4061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e80acfd0 0x7fc2e80ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d00038e0 0x7fc2e814cbe0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 --2- 172.21.15.78:0/1903833640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e80aa9b0 0x7fc2e80aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1903833640 >> 172.21.15.78:0/1903833640 conn(0x7fc2e806a6a0 msgr2=0x7fc2e80c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1903833640 shutdown_connections 2023-08-17T18:10:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.820+0000 7fc2eebfe700 1 -- 172.21.15.78:0/1903833640 wait complete. 2023-08-17T18:10:27.833 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-17T18:10:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.946+0000 7ff73145f700 1 Processor -- start 2023-08-17T18:10:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.946+0000 7ff73145f700 1 -- start start 2023-08-17T18:10:27.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.947+0000 7ff73145f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c151e20 0x7ff72c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.947+0000 7ff73145f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72c0c6620 con 0x7ff72c151a40 2023-08-17T18:10:27.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.947+0000 7ff73145f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72c0c6900 con 0x7ff72c157be0 2023-08-17T18:10:27.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.947+0000 7ff73145f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0c6be0 con 0x7ff72c151e20 2023-08-17T18:10:27.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.947+0000 7ff72bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff72c151a40 0x7ff72c0c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48080/0 (socket says 172.21.15.78:48080) 2023-08-17T18:10:27.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.947+0000 7ff72bfff700 1 -- 172.21.15.78:0/4201922991 learned_addr learned my addr 172.21.15.78:0/4201922991 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:27.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.947+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801209983 0 0) 0x7ff72c0c6620 con 0x7ff72c151a40 2023-08-17T18:10:27.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.947+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7140033f0 con 0x7ff72c151a40 2023-08-17T18:10:27.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.947+0000 7ff72b7fe700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c151e20 0x7ff72c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.947+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 179103486 0 0) 0x7ff7140033f0 con 0x7ff72c151a40 2023-08-17T18:10:27.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c151e20 msgr2=0x7ff72c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:27.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c151e20 0x7ff72c0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 >> v1:172.21.15.150:6789/0 conn(0x7ff72c157be0 legacy=0x7ff72c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c0c6ec0 con 0x7ff72c151a40 2023-08-17T18:10:27.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7ff71c0015f0 con 0x7ff72c151a40 2023-08-17T18:10:27.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 >> v1:172.21.15.78:6789/0 conn(0x7ff72c151a40 legacy=0x7ff72c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 0x7ff714003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff714004690 0x7ff714004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c151e20 0x7ff714005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0c6be0 con 0x7ff714003910 2023-08-17T18:10:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71400b910 con 0x7ff714004690 2023-08-17T18:10:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71400bad0 con 0x7ff72c151e20 2023-08-17T18:10:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72bfff700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 0x7ff714003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72b7fe700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff714004690 0x7ff714004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff730c5e700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c151e20 0x7ff714005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72bfff700 1 -- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c151e20 msgr2=0x7ff714005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72bfff700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c151e20 0x7ff714005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72bfff700 1 -- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff714004690 msgr2=0x7ff714004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72bfff700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff714004690 0x7ff714004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72bfff700 1 -- 172.21.15.78:0/4201922991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140033f0 con 0x7ff714003910 2023-08-17T18:10:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72bfff700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 0x7ff714003d30 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7ff71c00c160 tx=0x7ff71c0077a0).ready entity=mon.0 client_cookie=39710f29f5719e5c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0079d0 con 0x7ff714003910 2023-08-17T18:10:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c00ca90 con 0x7ff714003910 2023-08-17T18:10:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.948+0000 7ff72affd700 1 -- 172.21.15.78:0/4201922991 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00ce10 con 0x7ff714003910 2023-08-17T18:10:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.949+0000 7ff73145f700 1 -- 172.21.15.78:0/4201922991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 msgr2=0x7ff714003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.949+0000 7ff73145f700 1 --2- 172.21.15.78:0/4201922991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 0x7ff714003d30 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7ff71c00c160 tx=0x7ff71c0077a0).stop 2023-08-17T18:10:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.949+0000 7ff730c5e700 1 -- 172.21.15.78:0/4201922991 reap_dead start 2023-08-17T18:10:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.949+0000 7ff73145f700 1 -- 172.21.15.78:0/4201922991 shutdown_connections 2023-08-17T18:10:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.949+0000 7ff73145f700 1 -- 172.21.15.78:0/4201922991 >> 172.21.15.78:0/4201922991 conn(0x7ff72c0943b0 msgr2=0x7ff72c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.949+0000 7ff73145f700 1 -- 172.21.15.78:0/4201922991 shutdown_connections 2023-08-17T18:10:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.949+0000 7ff73145f700 1 -- 172.21.15.78:0/4201922991 wait complete. 2023-08-17T18:10:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.950+0000 7ff73145f700 1 Processor -- start 2023-08-17T18:10:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.950+0000 7ff73145f700 1 -- start start 2023-08-17T18:10:27.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff73145f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 0x7ff72c0c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff73145f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c167ed0 0x7ff72c0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff73145f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff72c14c6f0 0x7ff72c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff73145f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c168350 con 0x7ff714003910 2023-08-17T18:10:27.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff73145f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c168e30 con 0x7ff72c14c6f0 2023-08-17T18:10:27.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff73145f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c153620 con 0x7ff72c167ed0 2023-08-17T18:10:27.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff72bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 0x7ff72c0c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff72bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 0x7ff72c0c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59612/0 (socket says 172.21.15.78:59612) 2023-08-17T18:10:27.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff72bfff700 1 -- 172.21.15.78:0/780798328 learned_addr learned my addr 172.21.15.78:0/780798328 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:27.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff72b7fe700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c167ed0 0x7ff72c0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff730c5e700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff72c14c6f0 0x7ff72c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff72bfff700 1 -- 172.21.15.78:0/780798328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c167ed0 msgr2=0x7ff72c0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff72bfff700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c167ed0 0x7ff72c0ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff72bfff700 1 -- 172.21.15.78:0/780798328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff72c14c6f0 msgr2=0x7ff72c157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:27.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff72bfff700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff72c14c6f0 0x7ff72c157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:27.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff72bfff700 1 -- 172.21.15.78:0/780798328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c168590 con 0x7ff714003910 2023-08-17T18:10:27.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff730c5e700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff72c14c6f0 0x7ff72c157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:27.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff72bfff700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 0x7ff72c0c2790 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7ff71400b8e0 tx=0x7ff71c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:27.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff713fff700 1 -- 172.21.15.78:0/780798328 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00cee0 con 0x7ff714003910 2023-08-17T18:10:27.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff713fff700 1 -- 172.21.15.78:0/780798328 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c001b90 con 0x7ff714003910 2023-08-17T18:10:27.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.951+0000 7ff73145f700 1 -- 172.21.15.78:0/780798328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72c168870 con 0x7ff714003910 2023-08-17T18:10:27.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.952+0000 7ff713fff700 1 -- 172.21.15.78:0/780798328 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c005670 con 0x7ff714003910 2023-08-17T18:10:27.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.952+0000 7ff73145f700 1 -- 172.21.15.78:0/780798328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c0ae9b0 con 0x7ff714003910 2023-08-17T18:10:27.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.952+0000 7ff73145f700 1 -- 172.21.15.78:0/780798328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72c082f90 con 0x7ff714003910 2023-08-17T18:10:27.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.953+0000 7ff713fff700 1 -- 172.21.15.78:0/780798328 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff71c01d070 con 0x7ff714003910 2023-08-17T18:10:27.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.953+0000 7ff713fff700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff71805ed60 0x7ff718061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:27.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.953+0000 7ff713fff700 1 -- 172.21.15.78:0/780798328 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5957+0+0 (secure 0 0 0) 0x7ff71c07a6c0 con 0x7ff714003910 2023-08-17T18:10:27.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.953+0000 7ff72b7fe700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff71805ed60 0x7ff718061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:27.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.954+0000 7ff72b7fe700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff71805ed60 0x7ff718061220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff720006fd0 tx=0x7ff720008040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:27.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:27.957+0000 7ff713fff700 1 -- 172.21.15.78:0/780798328 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff71c04bd00 con 0x7ff714003910 2023-08-17T18:10:28.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.124+0000 7ff73145f700 1 -- 172.21.15.78:0/780798328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff72c05f910 con 0x7ff714003910 2023-08-17T18:10:28.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.127+0000 7ff713fff700 1 -- 172.21.15.78:0/780798328 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v33) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff71c01a070 con 0x7ff714003910 2023-08-17T18:10:28.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.129+0000 7ff73145f700 1 -- 172.21.15.78:0/780798328 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff71805ed60 msgr2=0x7ff718061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.129+0000 7ff73145f700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff71805ed60 0x7ff718061220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff720006fd0 tx=0x7ff720008040).stop 2023-08-17T18:10:28.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.129+0000 7ff73145f700 1 -- 172.21.15.78:0/780798328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 msgr2=0x7ff72c0c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.129+0000 7ff73145f700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 0x7ff72c0c2790 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7ff71400b8e0 tx=0x7ff71c015000).stop 2023-08-17T18:10:28.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.129+0000 7ff73145f700 1 -- 172.21.15.78:0/780798328 shutdown_connections 2023-08-17T18:10:28.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.129+0000 7ff73145f700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff71805ed60 0x7ff718061220 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.129+0000 7ff73145f700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff72c14c6f0 0x7ff72c157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.129+0000 7ff73145f700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff714003910 0x7ff72c0c2790 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.129+0000 7ff73145f700 1 --2- 172.21.15.78:0/780798328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff72c167ed0 0x7ff72c0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.129+0000 7ff73145f700 1 -- 172.21.15.78:0/780798328 >> 172.21.15.78:0/780798328 conn(0x7ff72c0943b0 msgr2=0x7ff72c150ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:28.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.130+0000 7ff73145f700 1 -- 172.21.15.78:0/780798328 shutdown_connections 2023-08-17T18:10:28.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.130+0000 7ff73145f700 1 -- 172.21.15.78:0/780798328 wait complete. 2023-08-17T18:10:28.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-08-17T18:10:28.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.255+0000 7fbea3ac5700 1 Processor -- start 2023-08-17T18:10:28.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.255+0000 7fbea3ac5700 1 -- start start 2023-08-17T18:10:28.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea3ac5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe9c13a640 0x7fbe9c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea3ac5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c06a2c0 0x7fbe9c069050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea3ac5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c0c2c10 con 0x7fbe9c13aa20 2023-08-17T18:10:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea3ac5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c155010 con 0x7fbe9c13a640 2023-08-17T18:10:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea3ac5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c1552e0 con 0x7fbe9c06a2c0 2023-08-17T18:10:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea2062700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbe9c13aa20 0x7fbe9c151590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48090/0 (socket says 172.21.15.78:48090) 2023-08-17T18:10:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea2062700 1 -- 172.21.15.78:0/3621673201 learned_addr learned my addr 172.21.15.78:0/3621673201 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea1060700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c06a2c0 0x7fbe9c069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea1861700 1 --2- 172.21.15.78:0/3621673201 >> v2:172.21.15.150:3300/0 conn(0x7fbe9c13a640 0x7fbe9c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510078913 0 0) 0x7fbe9c0c2c10 con 0x7fbe9c13aa20 2023-08-17T18:10:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe880033f0 con 0x7fbe9c13aa20 2023-08-17T18:10:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2520307437 0 0) 0x7fbe880033f0 con 0x7fbe9c13aa20 2023-08-17T18:10:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c06a2c0 msgr2=0x7fbe9c069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c06a2c0 0x7fbe9c069050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 >> v2:172.21.15.150:3300/0 conn(0x7fbe9c13a640 msgr2=0x7fbe9c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 --2- 172.21.15.78:0/3621673201 >> v2:172.21.15.150:3300/0 conn(0x7fbe9c13a640 0x7fbe9c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c1555c0 con 0x7fbe9c13aa20 2023-08-17T18:10:28.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fbe940017f0 con 0x7fbe9c13aa20 2023-08-17T18:10:28.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 >> v1:172.21.15.78:6789/0 conn(0x7fbe9c13aa20 legacy=0x7fbe9c151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 0x7fbe88003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c06a2c0 0x7fbe88004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe88004b80 0x7fbe88005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c155010 con 0x7fbe880038e0 2023-08-17T18:10:28.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c1552e0 con 0x7fbe88004b80 2023-08-17T18:10:28.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.256+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8800b8e0 con 0x7fbe9c06a2c0 2023-08-17T18:10:28.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea1861700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 0x7fbe88003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea1060700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c06a2c0 0x7fbe88004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea2062700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe88004b80 0x7fbe88005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea1861700 1 -- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c06a2c0 msgr2=0x7fbe88004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:28.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea1861700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c06a2c0 0x7fbe88004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea1861700 1 -- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe88004b80 msgr2=0x7fbe88005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:28.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea1861700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe88004b80 0x7fbe88005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea1861700 1 -- 172.21.15.78:0/3621673201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe880033f0 con 0x7fbe880038e0 2023-08-17T18:10:28.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea2062700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe88004b80 0x7fbe88005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:28.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea1861700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 0x7fbe88003d00 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7fbe98009a80 tx=0x7fbe98009060).ready entity=mon.0 client_cookie=836963736a5cea94 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:28.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98009430 con 0x7fbe880038e0 2023-08-17T18:10:28.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9800e640 con 0x7fbe880038e0 2023-08-17T18:10:28.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.257+0000 7fbea085f700 1 -- 172.21.15.78:0/3621673201 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800e9c0 con 0x7fbe880038e0 2023-08-17T18:10:28.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.258+0000 7fbea3ac5700 1 -- 172.21.15.78:0/3621673201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 msgr2=0x7fbe88003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.258+0000 7fbea3ac5700 1 --2- 172.21.15.78:0/3621673201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 0x7fbe88003d00 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7fbe98009a80 tx=0x7fbe98009060).stop 2023-08-17T18:10:28.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.258+0000 7fbea2062700 1 -- 172.21.15.78:0/3621673201 reap_dead start 2023-08-17T18:10:28.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.258+0000 7fbea3ac5700 1 -- 172.21.15.78:0/3621673201 shutdown_connections 2023-08-17T18:10:28.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.258+0000 7fbea3ac5700 1 -- 172.21.15.78:0/3621673201 >> 172.21.15.78:0/3621673201 conn(0x7fbe9c0c7b00 msgr2=0x7fbe9c0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:28.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.258+0000 7fbea3ac5700 1 -- 172.21.15.78:0/3621673201 shutdown_connections 2023-08-17T18:10:28.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.258+0000 7fbea3ac5700 1 -- 172.21.15.78:0/3621673201 wait complete. 2023-08-17T18:10:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.259+0000 7fbea3ac5700 1 Processor -- start 2023-08-17T18:10:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.259+0000 7fbea3ac5700 1 -- start start 2023-08-17T18:10:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea3ac5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 0x7fbe9c066750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea3ac5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe9c130cc0 0x7fbe9c135b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea3ac5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c0c0db0 0x7fbe9c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea3ac5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0ac2e0 con 0x7fbe880038e0 2023-08-17T18:10:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea3ac5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c1362c0 con 0x7fbe9c130cc0 2023-08-17T18:10:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea3ac5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0c1720 con 0x7fbe9c0c0db0 2023-08-17T18:10:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea1861700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 0x7fbe9c066750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea1861700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 0x7fbe9c066750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59626/0 (socket says 172.21.15.78:59626) 2023-08-17T18:10:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea1861700 1 -- 172.21.15.78:0/4242115388 learned_addr learned my addr 172.21.15.78:0/4242115388 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea2062700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c0c0db0 0x7fbe9c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea1861700 1 -- 172.21.15.78:0/4242115388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c0c0db0 msgr2=0x7fbe9c0c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea1060700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe9c130cc0 0x7fbe9c135b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea1861700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c0c0db0 0x7fbe9c0c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea1861700 1 -- 172.21.15.78:0/4242115388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe9c130cc0 msgr2=0x7fbe9c135b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea1861700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe9c130cc0 0x7fbe9c135b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea1861700 1 -- 172.21.15.78:0/4242115388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c131140 con 0x7fbe880038e0 2023-08-17T18:10:28.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea1861700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 0x7fbe9c066750 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fbe98009ec0 tx=0x7fbe9801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:28.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbe91ffb700 1 -- 172.21.15.78:0/4242115388 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800e7b0 con 0x7fbe880038e0 2023-08-17T18:10:28.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbe91ffb700 1 -- 172.21.15.78:0/4242115388 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9800e910 con 0x7fbe880038e0 2023-08-17T18:10:28.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea3ac5700 1 -- 172.21.15.78:0/4242115388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c136040 con 0x7fbe880038e0 2023-08-17T18:10:28.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbe91ffb700 1 -- 172.21.15.78:0/4242115388 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9801b6a0 con 0x7fbe880038e0 2023-08-17T18:10:28.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.260+0000 7fbea3ac5700 1 -- 172.21.15.78:0/4242115388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c0abc20 con 0x7fbe880038e0 2023-08-17T18:10:28.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.261+0000 7fbea3ac5700 1 -- 172.21.15.78:0/4242115388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9c047350 con 0x7fbe880038e0 2023-08-17T18:10:28.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.262+0000 7fbe91ffb700 1 -- 172.21.15.78:0/4242115388 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbe9801ba10 con 0x7fbe880038e0 2023-08-17T18:10:28.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.262+0000 7fbe91ffb700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe8005ed90 0x7fbe80061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.262+0000 7fbe91ffb700 1 -- 172.21.15.78:0/4242115388 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fbe9807b610 con 0x7fbe880038e0 2023-08-17T18:10:28.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.262+0000 7fbea1060700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe8005ed90 0x7fbe80061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.262+0000 7fbea1060700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe8005ed90 0x7fbe80061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbe8c009270 tx=0x7fbe8c008040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:28.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.266+0000 7fbe91ffb700 1 -- 172.21.15.78:0/4242115388 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe9804cbf0 con 0x7fbe880038e0 2023-08-17T18:10:28.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.492+0000 7fbea3ac5700 1 -- 172.21.15.78:0/4242115388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7fbe9c06b670 con 0x7fbe880038e0 2023-08-17T18:10:28.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.734+0000 7fbe91ffb700 1 -- 172.21.15.78:0/4242115388 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v1246) v1 ==== 165+0+0 (secure 0 0 0) 0x7fbe98016070 con 0x7fbe880038e0 2023-08-17T18:10:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.736+0000 7fbea3ac5700 1 -- 172.21.15.78:0/4242115388 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe8005ed90 msgr2=0x7fbe80061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.736+0000 7fbea3ac5700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe8005ed90 0x7fbe80061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbe8c009270 tx=0x7fbe8c008040).stop 2023-08-17T18:10:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.737+0000 7fbea3ac5700 1 -- 172.21.15.78:0/4242115388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 msgr2=0x7fbe9c066750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.737+0000 7fbea3ac5700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 0x7fbe9c066750 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fbe98009ec0 tx=0x7fbe9801a000).stop 2023-08-17T18:10:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.737+0000 7fbea3ac5700 1 -- 172.21.15.78:0/4242115388 shutdown_connections 2023-08-17T18:10:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.737+0000 7fbea3ac5700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe8005ed90 0x7fbe80061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.737+0000 7fbea3ac5700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe9c0c0db0 0x7fbe9c0c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.737+0000 7fbea3ac5700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe880038e0 0x7fbe9c066750 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.737+0000 7fbea3ac5700 1 --2- 172.21.15.78:0/4242115388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe9c130cc0 0x7fbe9c135b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.737+0000 7fbea3ac5700 1 -- 172.21.15.78:0/4242115388 >> 172.21.15.78:0/4242115388 conn(0x7fbe9c0c7b00 msgr2=0x7fbe9c137600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:28.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.737+0000 7fbea3ac5700 1 -- 172.21.15.78:0/4242115388 shutdown_connections 2023-08-17T18:10:28.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.737+0000 7fbea3ac5700 1 -- 172.21.15.78:0/4242115388 wait complete. 2023-08-17T18:10:28.749 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-08-17T18:10:28.750 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-08-17T18:10:28.750 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-17T18:10:28.750 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-08-17T18:10:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.867+0000 7fc2e90cb700 1 Processor -- start 2023-08-17T18:10:28.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.867+0000 7fc2e90cb700 1 -- start start 2023-08-17T18:10:28.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.867+0000 7fc2e90cb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc2e414e290 0x7fc2e414e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.867+0000 7fc2e90cb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e40643e0 0x7fc2e4157c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.867+0000 7fc2e90cb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc2e4064860 0x7fc2e4158150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.867+0000 7fc2e90cb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e4158640 con 0x7fc2e414e290 2023-08-17T18:10:28.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.867+0000 7fc2e90cb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e4063bb0 con 0x7fc2e4064860 2023-08-17T18:10:28.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.867+0000 7fc2e90cb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4062fa0 con 0x7fc2e40643e0 2023-08-17T18:10:28.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e2d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc2e414e290 0x7fc2e414e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e2d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc2e414e290 0x7fc2e414e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38554/0 (socket says 172.21.15.78:38554) 2023-08-17T18:10:28.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e2d9d700 1 -- 172.21.15.78:0/2424612532 learned_addr learned my addr 172.21.15.78:0/2424612532 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:28.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e359e700 1 --2- 172.21.15.78:0/2424612532 >> v2:172.21.15.150:3300/0 conn(0x7fc2e4064860 0x7fc2e4158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2dbfff700 1 --2- 172.21.15.78:0/2424612532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e40643e0 0x7fc2e4157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e2d9d700 1 -- 172.21.15.78:0/2424612532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e40643e0 msgr2=0x7fc2e4157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:28.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e2d9d700 1 --2- 172.21.15.78:0/2424612532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e40643e0 0x7fc2e4157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e2d9d700 1 -- 172.21.15.78:0/2424612532 >> v2:172.21.15.150:3300/0 conn(0x7fc2e4064860 msgr2=0x7fc2e4158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:28.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e2d9d700 1 --2- 172.21.15.78:0/2424612532 >> v2:172.21.15.150:3300/0 conn(0x7fc2e4064860 0x7fc2e4158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e2d9d700 1 -- 172.21.15.78:0/2424612532 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4063280 con 0x7fc2e414e290 2023-08-17T18:10:28.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e359e700 1 --2- 172.21.15.78:0/2424612532 >> v2:172.21.15.150:3300/0 conn(0x7fc2e4064860 0x7fc2e4158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:28.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e2d9d700 1 --2- 172.21.15.78:0/2424612532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 0x7fc2e414e670 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fc2e4067b10 tx=0x7fc2d40090f0).ready entity=mon.0 client_cookie=232976e861d9559 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:28.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e259c700 1 -- 172.21.15.78:0/2424612532 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400b600 con 0x7fc2e414e290 2023-08-17T18:10:28.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e259c700 1 -- 172.21.15.78:0/2424612532 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d400b760 con 0x7fc2e414e290 2023-08-17T18:10:28.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.868+0000 7fc2e259c700 1 -- 172.21.15.78:0/2424612532 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400bae0 con 0x7fc2e414e290 2023-08-17T18:10:28.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.869+0000 7fc2e90cb700 1 -- 172.21.15.78:0/2424612532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 msgr2=0x7fc2e414e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.869+0000 7fc2e90cb700 1 --2- 172.21.15.78:0/2424612532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 0x7fc2e414e670 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fc2e4067b10 tx=0x7fc2d40090f0).stop 2023-08-17T18:10:28.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.869+0000 7fc2e90cb700 1 -- 172.21.15.78:0/2424612532 shutdown_connections 2023-08-17T18:10:28.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.869+0000 7fc2e90cb700 1 --2- 172.21.15.78:0/2424612532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 0x7fc2e414e670 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.869+0000 7fc2e90cb700 1 --2- 172.21.15.78:0/2424612532 >> v2:172.21.15.150:3300/0 conn(0x7fc2e4064860 0x7fc2e4158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.869+0000 7fc2e90cb700 1 --2- 172.21.15.78:0/2424612532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e40643e0 0x7fc2e4157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.869+0000 7fc2e90cb700 1 -- 172.21.15.78:0/2424612532 >> 172.21.15.78:0/2424612532 conn(0x7fc2e40c3d40 msgr2=0x7fc2e40c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:28.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.869+0000 7fc2e90cb700 1 -- 172.21.15.78:0/2424612532 shutdown_connections 2023-08-17T18:10:28.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.869+0000 7fc2e90cb700 1 -- 172.21.15.78:0/2424612532 wait complete. 2023-08-17T18:10:28.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.870+0000 7fc2e90cb700 1 Processor -- start 2023-08-17T18:10:28.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.870+0000 7fc2e90cb700 1 -- start start 2023-08-17T18:10:28.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e90cb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e40643e0 0x7fc2e41552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e90cb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e4064860 0x7fc2e40a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e90cb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 0x7fc2e4135e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e90cb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40abda0 con 0x7fc2e414e290 2023-08-17T18:10:28.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e90cb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4155a20 con 0x7fc2e40643e0 2023-08-17T18:10:28.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e90cb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4156f50 con 0x7fc2e4064860 2023-08-17T18:10:28.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 0x7fc2e4135e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 0x7fc2e4135e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38562/0 (socket says 172.21.15.78:38562) 2023-08-17T18:10:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e359e700 1 -- 172.21.15.78:0/323707519 learned_addr learned my addr 172.21.15.78:0/323707519 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e2d9d700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e40643e0 0x7fc2e41552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2dbfff700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e4064860 0x7fc2e40a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e359e700 1 -- 172.21.15.78:0/323707519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e4064860 msgr2=0x7fc2e40a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e359e700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e4064860 0x7fc2e40a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e359e700 1 -- 172.21.15.78:0/323707519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e40643e0 msgr2=0x7fc2e41552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e359e700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e40643e0 0x7fc2e41552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e359e700 1 -- 172.21.15.78:0/323707519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4009370 con 0x7fc2e414e290 2023-08-17T18:10:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e359e700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 0x7fc2e4135e30 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7fc2dc00cef0 tx=0x7fc2dc007850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2daffd700 1 -- 172.21.15.78:0/323707519 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00acb0 con 0x7fc2e414e290 2023-08-17T18:10:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2daffd700 1 -- 172.21.15.78:0/323707519 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc00ae10 con 0x7fc2e414e290 2023-08-17T18:10:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e90cb700 1 -- 172.21.15.78:0/323707519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e40ac8b0 con 0x7fc2e414e290 2023-08-17T18:10:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2daffd700 1 -- 172.21.15.78:0/323707519 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc016610 con 0x7fc2e414e290 2023-08-17T18:10:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.871+0000 7fc2e90cb700 1 -- 172.21.15.78:0/323707519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e40ac260 con 0x7fc2e414e290 2023-08-17T18:10:28.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.872+0000 7fc2e90cb700 1 -- 172.21.15.78:0/323707519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e40aca40 con 0x7fc2e414e290 2023-08-17T18:10:28.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.872+0000 7fc2daffd700 1 -- 172.21.15.78:0/323707519 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc2dc01d060 con 0x7fc2e414e290 2023-08-17T18:10:28.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.873+0000 7fc2daffd700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2c405ed90 0x7fc2c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:28.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.873+0000 7fc2daffd700 1 -- 172.21.15.78:0/323707519 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fc2dc07a360 con 0x7fc2e414e290 2023-08-17T18:10:28.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.873+0000 7fc2e2d9d700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2c405ed90 0x7fc2c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:28.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.873+0000 7fc2e2d9d700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2c405ed90 0x7fc2c4061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc2d4009130 tx=0x7fc2d4017000).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:28.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:28.877+0000 7fc2daffd700 1 -- 172.21.15.78:0/323707519 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc2dc04b9a0 con 0x7fc2e414e290 2023-08-17T18:10:29.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.108+0000 7fc2e90cb700 1 -- 172.21.15.78:0/323707519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fc2e4047350 con 0x7fc2e414e290 2023-08-17T18:10:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.736+0000 7fc2daffd700 1 -- 172.21.15.78:0/323707519 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1247) v1 ==== 166+0+0 (secure 0 0 0) 0x7fc2dc01b020 con 0x7fc2e414e290 2023-08-17T18:10:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 -- 172.21.15.78:0/323707519 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2c405ed90 msgr2=0x7fc2c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2c405ed90 0x7fc2c4061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc2d4009130 tx=0x7fc2d4017000).stop 2023-08-17T18:10:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 -- 172.21.15.78:0/323707519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 msgr2=0x7fc2e4135e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 0x7fc2e4135e30 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7fc2dc00cef0 tx=0x7fc2dc007850).stop 2023-08-17T18:10:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 -- 172.21.15.78:0/323707519 shutdown_connections 2023-08-17T18:10:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc2c405ed90 0x7fc2c4061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2e414e290 0x7fc2e4135e30 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e40643e0 0x7fc2e41552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 --2- 172.21.15.78:0/323707519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e4064860 0x7fc2e40a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 -- 172.21.15.78:0/323707519 >> 172.21.15.78:0/323707519 conn(0x7fc2e40c3d40 msgr2=0x7fc2e40c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 -- 172.21.15.78:0/323707519 shutdown_connections 2023-08-17T18:10:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.738+0000 7fc2e90cb700 1 -- 172.21.15.78:0/323707519 wait complete. 2023-08-17T18:10:29.752 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T18:10:29.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.868+0000 7f6d2fd30700 1 Processor -- start 2023-08-17T18:10:29.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.868+0000 7f6d2fd30700 1 -- start start 2023-08-17T18:10:29.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2fd30700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6d280aa4d0 0x7f6d280644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:29.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2fd30700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 0x7f6d280c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:29.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2fd30700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d280649b0 con 0x7f6d280aa0f0 2023-08-17T18:10:29.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2fd30700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280c6170 con 0x7f6d280aa4d0 2023-08-17T18:10:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2fd30700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28063420 con 0x7f6d280c5810 2023-08-17T18:10:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2dacc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6d280aa0f0 0x7f6d280c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44968/0 (socket says 172.21.15.78:44968) 2023-08-17T18:10:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2dacc700 1 -- 172.21.15.78:0/3365065790 learned_addr learned my addr 172.21.15.78:0/3365065790 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225907610 0 0) 0x7f6d280649b0 con 0x7f6d280aa0f0 2023-08-17T18:10:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2d2cb700 1 --2- 172.21.15.78:0/3365065790 >> v2:172.21.15.150:3300/0 conn(0x7f6d280aa4d0 0x7f6d280644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2e2cd700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 0x7f6d280c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.869+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d100033f0 con 0x7f6d280aa0f0 2023-08-17T18:10:29.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3803647104 0 0) 0x7f6d100033f0 con 0x7f6d280aa0f0 2023-08-17T18:10:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 msgr2=0x7f6d280c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 0x7f6d280c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 >> v2:172.21.15.150:3300/0 conn(0x7f6d280aa4d0 msgr2=0x7f6d280644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 --2- 172.21.15.78:0/3365065790 >> v2:172.21.15.150:3300/0 conn(0x7f6d280aa4d0 0x7f6d280644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d28063700 con 0x7f6d280aa0f0 2023-08-17T18:10:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f6d20001470 con 0x7f6d280aa0f0 2023-08-17T18:10:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 >> v1:172.21.15.78:6789/0 conn(0x7f6d280aa0f0 legacy=0x7f6d280c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d10003960 0x7f6d10003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 0x7f6d10004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d10004b80 0x7f6d10005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280c6170 con 0x7f6d10004b80 2023-08-17T18:10:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28063420 con 0x7f6d10003960 2023-08-17T18:10:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1000b8e0 con 0x7f6d280c5810 2023-08-17T18:10:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2e2cd700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d10004b80 0x7f6d10005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2dacc700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d10003960 0x7f6d10003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2d2cb700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 0x7f6d10004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2e2cd700 1 -- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 msgr2=0x7f6d10004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2e2cd700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 0x7f6d10004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2e2cd700 1 -- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d10003960 msgr2=0x7f6d10003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2e2cd700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d10003960 0x7f6d10003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2e2cd700 1 -- 172.21.15.78:0/3365065790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d100033f0 con 0x7f6d10004b80 2023-08-17T18:10:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2e2cd700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d10004b80 0x7f6d10005000 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f6d1800e1c0 tx=0x7f6d1800b040).ready entity=mon.0 client_cookie=eacd04c248b6690f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18009ac0 con 0x7f6d10004b80 2023-08-17T18:10:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800f040 con 0x7f6d10004b80 2023-08-17T18:10:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.870+0000 7f6d2caca700 1 -- 172.21.15.78:0/3365065790 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800eca0 con 0x7f6d10004b80 2023-08-17T18:10:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.871+0000 7f6d2fd30700 1 -- 172.21.15.78:0/3365065790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d10004b80 msgr2=0x7f6d10005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.871+0000 7f6d2fd30700 1 --2- 172.21.15.78:0/3365065790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d10004b80 0x7f6d10005000 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f6d1800e1c0 tx=0x7f6d1800b040).stop 2023-08-17T18:10:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.871+0000 7f6d2e2cd700 1 -- 172.21.15.78:0/3365065790 reap_dead start 2023-08-17T18:10:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.871+0000 7f6d2fd30700 1 -- 172.21.15.78:0/3365065790 shutdown_connections 2023-08-17T18:10:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.871+0000 7f6d2fd30700 1 -- 172.21.15.78:0/3365065790 >> 172.21.15.78:0/3365065790 conn(0x7f6d2806a6a0 msgr2=0x7f6d280caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.871+0000 7f6d2fd30700 1 -- 172.21.15.78:0/3365065790 shutdown_connections 2023-08-17T18:10:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.871+0000 7f6d2fd30700 1 -- 172.21.15.78:0/3365065790 wait complete. 2023-08-17T18:10:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.872+0000 7f6d2fd30700 1 Processor -- start 2023-08-17T18:10:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.872+0000 7f6d2fd30700 1 -- start start 2023-08-17T18:10:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2fd30700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d10004b80 0x7f6d28152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2fd30700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d280c2360 0x7f6d280acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2fd30700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c27e0 0x7f6d28168120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:29.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2fd30700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280ac670 con 0x7f6d280c27e0 2023-08-17T18:10:29.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2fd30700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280ac360 con 0x7f6d280c2360 2023-08-17T18:10:29.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2fd30700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280c4ce0 con 0x7f6d10004b80 2023-08-17T18:10:29.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2e2cd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c27e0 0x7f6d28168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:29.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2e2cd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c27e0 0x7f6d28168120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38578/0 (socket says 172.21.15.78:38578) 2023-08-17T18:10:29.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2e2cd700 1 -- 172.21.15.78:0/796177140 learned_addr learned my addr 172.21.15.78:0/796177140 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:29.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2e2cd700 1 -- 172.21.15.78:0/796177140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d10004b80 msgr2=0x7f6d28152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:29.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2dacc700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d10004b80 0x7f6d28152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:29.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2d2cb700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d280c2360 0x7f6d280acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:29.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2e2cd700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d10004b80 0x7f6d28152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:29.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2e2cd700 1 -- 172.21.15.78:0/796177140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d280c2360 msgr2=0x7f6d280acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:29.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2e2cd700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d280c2360 0x7f6d280acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:29.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2e2cd700 1 -- 172.21.15.78:0/796177140 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d280c4fc0 con 0x7f6d280c27e0 2023-08-17T18:10:29.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d2e2cd700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c27e0 0x7f6d28168120 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f6d100055f0 tx=0x7f6d1801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:29.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.873+0000 7f6d25ffb700 1 -- 172.21.15.78:0/796177140 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18013cf0 con 0x7f6d280c27e0 2023-08-17T18:10:29.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.874+0000 7f6d25ffb700 1 -- 172.21.15.78:0/796177140 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d18013e50 con 0x7f6d280c27e0 2023-08-17T18:10:29.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.874+0000 7f6d25ffb700 1 -- 172.21.15.78:0/796177140 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1801c640 con 0x7f6d280c27e0 2023-08-17T18:10:29.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.874+0000 7f6d2fd30700 1 -- 172.21.15.78:0/796177140 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d280c52a0 con 0x7f6d280c27e0 2023-08-17T18:10:29.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.874+0000 7f6d2fd30700 1 -- 172.21.15.78:0/796177140 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d28169050 con 0x7f6d280c27e0 2023-08-17T18:10:29.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.875+0000 7f6d2fd30700 1 -- 172.21.15.78:0/796177140 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d280c5460 con 0x7f6d280c27e0 2023-08-17T18:10:29.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.875+0000 7f6d25ffb700 1 -- 172.21.15.78:0/796177140 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6d1802c070 con 0x7f6d280c27e0 2023-08-17T18:10:29.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.875+0000 7f6d25ffb700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 0x7f6d14061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:29.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.875+0000 7f6d25ffb700 1 -- 172.21.15.78:0/796177140 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f6d1807b680 con 0x7f6d280c27e0 2023-08-17T18:10:29.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.875+0000 7f6d2dacc700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 0x7f6d14061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:29.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.876+0000 7f6d2dacc700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 0x7f6d14061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6d20001ed0 tx=0x7f6d20009040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:29.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:29.879+0000 7f6d25ffb700 1 -- 172.21.15.78:0/796177140 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6d280c5460 con 0x7f6d280c27e0 2023-08-17T18:10:30.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.042+0000 7f6d2fd30700 1 -- 172.21.15.78:0/796177140 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6d280c5430 con 0x7f6d280c27e0 2023-08-17T18:10:30.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.045+0000 7f6d25ffb700 1 -- 172.21.15.78:0/796177140 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6d1802a020 con 0x7f6d280c27e0 2023-08-17T18:10:30.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 -- 172.21.15.78:0/796177140 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 msgr2=0x7f6d14061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 0x7f6d14061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6d20001ed0 tx=0x7f6d20009040).stop 2023-08-17T18:10:30.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 -- 172.21.15.78:0/796177140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c27e0 msgr2=0x7f6d28168120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c27e0 0x7f6d28168120 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f6d100055f0 tx=0x7f6d1801a000).stop 2023-08-17T18:10:30.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 -- 172.21.15.78:0/796177140 shutdown_connections 2023-08-17T18:10:30.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 0x7f6d14061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c27e0 0x7f6d28168120 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d10004b80 0x7f6d28152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 --2- 172.21.15.78:0/796177140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d280c2360 0x7f6d280acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 -- 172.21.15.78:0/796177140 >> 172.21.15.78:0/796177140 conn(0x7f6d2806a6a0 msgr2=0x7f6d280a84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:30.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 -- 172.21.15.78:0/796177140 shutdown_connections 2023-08-17T18:10:30.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.047+0000 7f6d2fd30700 1 -- 172.21.15.78:0/796177140 wait complete. 2023-08-17T18:10:30.060 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T18:10:30.060 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T18:10:30.102 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T18:10:30.147 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T18:10:30.148 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T18:10:30.148 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:10:30.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.261+0000 7efc735dc700 1 Processor -- start 2023-08-17T18:10:30.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.261+0000 7efc735dc700 1 -- start start 2023-08-17T18:10:30.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc735dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc6c154140 0x7efc6c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc735dc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc6c0a7c40 0x7efc6c0c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc735dc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6c154520 con 0x7efc6c0a8080 2023-08-17T18:10:30.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc735dc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0c91e0 con 0x7efc6c0a7c40 2023-08-17T18:10:30.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc735dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0c94c0 con 0x7efc6c154140 2023-08-17T18:10:30.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc70b77700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc6c0a7c40 0x7efc6c0c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc70b77700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc6c0a7c40 0x7efc6c0c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38584/0 (socket says 172.21.15.78:38584) 2023-08-17T18:10:30.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc70b77700 1 -- 172.21.15.78:0/2801701294 learned_addr learned my addr 172.21.15.78:0/2801701294 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:30.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc71378700 1 --2- 172.21.15.78:0/2801701294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc6c154140 0x7efc6c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc70b77700 1 -- 172.21.15.78:0/2801701294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc6c154140 msgr2=0x7efc6c0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:30.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc70b77700 1 --2- 172.21.15.78:0/2801701294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc6c154140 0x7efc6c0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc70b77700 1 -- 172.21.15.78:0/2801701294 >> v1:172.21.15.150:6789/0 conn(0x7efc6c0a8080 legacy=0x7efc6c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:30.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc70b77700 1 -- 172.21.15.78:0/2801701294 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0c97a0 con 0x7efc6c0a7c40 2023-08-17T18:10:30.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc70b77700 1 --2- 172.21.15.78:0/2801701294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c0a7c40 0x7efc6c0c0900 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7efc5c006fd0 tx=0x7efc5c0090f0).ready entity=mon.0 client_cookie=60f36f2a98428d7a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:30.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc63fff700 1 -- 172.21.15.78:0/2801701294 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00b600 con 0x7efc6c0a7c40 2023-08-17T18:10:30.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc63fff700 1 -- 172.21.15.78:0/2801701294 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c00b760 con 0x7efc6c0a7c40 2023-08-17T18:10:30.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.262+0000 7efc63fff700 1 -- 172.21.15.78:0/2801701294 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00bae0 con 0x7efc6c0a7c40 2023-08-17T18:10:30.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.263+0000 7efc735dc700 1 -- 172.21.15.78:0/2801701294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c0a7c40 msgr2=0x7efc6c0c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.263+0000 7efc735dc700 1 --2- 172.21.15.78:0/2801701294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c0a7c40 0x7efc6c0c0900 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7efc5c006fd0 tx=0x7efc5c0090f0).stop 2023-08-17T18:10:30.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.263+0000 7efc735dc700 1 -- 172.21.15.78:0/2801701294 shutdown_connections 2023-08-17T18:10:30.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.263+0000 7efc735dc700 1 --2- 172.21.15.78:0/2801701294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc6c154140 0x7efc6c0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.263+0000 7efc735dc700 1 --2- 172.21.15.78:0/2801701294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c0a7c40 0x7efc6c0c0900 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.263+0000 7efc735dc700 1 -- 172.21.15.78:0/2801701294 >> 172.21.15.78:0/2801701294 conn(0x7efc6c094510 msgr2=0x7efc6c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:30.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.263+0000 7efc735dc700 1 -- 172.21.15.78:0/2801701294 shutdown_connections 2023-08-17T18:10:30.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.263+0000 7efc735dc700 1 -- 172.21.15.78:0/2801701294 wait complete. 2023-08-17T18:10:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.264+0000 7efc735dc700 1 Processor -- start 2023-08-17T18:10:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.264+0000 7efc735dc700 1 -- start start 2023-08-17T18:10:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc735dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc6c0a7c40 0x7efc6c0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc735dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc6c0a8080 0x7efc6c1474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc735dc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c154140 0x7efc6c1479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc735dc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0aee10 con 0x7efc6c154140 2023-08-17T18:10:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc735dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c14f2b0 con 0x7efc6c0a8080 2023-08-17T18:10:30.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc735dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0af7d0 con 0x7efc6c0a7c40 2023-08-17T18:10:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc71b79700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c154140 0x7efc6c1479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc70b77700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc6c0a8080 0x7efc6c1474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc71b79700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c154140 0x7efc6c1479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38592/0 (socket says 172.21.15.78:38592) 2023-08-17T18:10:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc71b79700 1 -- 172.21.15.78:0/3608407220 learned_addr learned my addr 172.21.15.78:0/3608407220 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc71378700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc6c0a7c40 0x7efc6c0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc71b79700 1 -- 172.21.15.78:0/3608407220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc6c0a7c40 msgr2=0x7efc6c0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc71b79700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc6c0a7c40 0x7efc6c0c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc71b79700 1 -- 172.21.15.78:0/3608407220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc6c0a8080 msgr2=0x7efc6c1474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc71b79700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc6c0a8080 0x7efc6c1474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.265+0000 7efc71b79700 1 -- 172.21.15.78:0/3608407220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c009370 con 0x7efc6c154140 2023-08-17T18:10:30.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.266+0000 7efc71b79700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c154140 0x7efc6c1479e0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7efc6400c810 tx=0x7efc64002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:30.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.266+0000 7efc617fa700 1 -- 172.21.15.78:0/3608407220 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400e4a0 con 0x7efc6c154140 2023-08-17T18:10:30.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.266+0000 7efc617fa700 1 -- 172.21.15.78:0/3608407220 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6400e600 con 0x7efc6c154140 2023-08-17T18:10:30.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.266+0000 7efc617fa700 1 -- 172.21.15.78:0/3608407220 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400e9c0 con 0x7efc6c154140 2023-08-17T18:10:30.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.266+0000 7efc735dc700 1 -- 172.21.15.78:0/3608407220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c147ed0 con 0x7efc6c154140 2023-08-17T18:10:30.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.266+0000 7efc735dc700 1 -- 172.21.15.78:0/3608407220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c0af180 con 0x7efc6c154140 2023-08-17T18:10:30.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.267+0000 7efc735dc700 1 -- 172.21.15.78:0/3608407220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c0c72f0 con 0x7efc6c154140 2023-08-17T18:10:30.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.267+0000 7efc617fa700 1 -- 172.21.15.78:0/3608407220 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efc64010070 con 0x7efc6c154140 2023-08-17T18:10:30.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.267+0000 7efc617fa700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc5005ed60 0x7efc50061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.267+0000 7efc71378700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc5005ed60 0x7efc50061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.268+0000 7efc617fa700 1 -- 172.21.15.78:0/3608407220 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5957+0+0 (secure 0 0 0) 0x7efc64079210 con 0x7efc6c154140 2023-08-17T18:10:30.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.268+0000 7efc71378700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc5005ed60 0x7efc50061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7efc6800bb10 tx=0x7efc68008040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:30.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.271+0000 7efc617fa700 1 -- 172.21.15.78:0/3608407220 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc640478f0 con 0x7efc6c154140 2023-08-17T18:10:30.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.473+0000 7efc735dc700 1 -- 172.21.15.78:0/3608407220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc6c047350 con 0x7efc6c154140 2023-08-17T18:10:30.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.474+0000 7efc617fa700 1 -- 172.21.15.78:0/3608407220 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3526 (secure 0 0 0) 0x7efc6404a850 con 0x7efc6c154140 2023-08-17T18:10:30.475 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:30.475 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/948559321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":948559321},{"type":"v1","addr":"172.21.15.150:6834","nonce":948559321}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1682652077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1682652077},{"type":"v1","addr":"172.21.15.150:6835","nonce":1682652077}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/323810610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":323810610},{"type":"v1","addr":"172.21.15.78:6836","nonce":323810610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/246455712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":246455712},{"type":"v1","addr":"172.21.15.78:6837","nonce":246455712}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[]} 2023-08-17T18:10:30.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 -- 172.21.15.78:0/3608407220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc5005ed60 msgr2=0x7efc50061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc5005ed60 0x7efc50061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7efc6800bb10 tx=0x7efc68008040).stop 2023-08-17T18:10:30.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 -- 172.21.15.78:0/3608407220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c154140 msgr2=0x7efc6c1479e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c154140 0x7efc6c1479e0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7efc6400c810 tx=0x7efc64002530).stop 2023-08-17T18:10:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 -- 172.21.15.78:0/3608407220 shutdown_connections 2023-08-17T18:10:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc5005ed60 0x7efc50061220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc6c154140 0x7efc6c1479e0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc6c0a7c40 0x7efc6c0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 --2- 172.21.15.78:0/3608407220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc6c0a8080 0x7efc6c1474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 -- 172.21.15.78:0/3608407220 >> 172.21.15.78:0/3608407220 conn(0x7efc6c094510 msgr2=0x7efc6c063b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 -- 172.21.15.78:0/3608407220 shutdown_connections 2023-08-17T18:10:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.476+0000 7efc735dc700 1 -- 172.21.15.78:0/3608407220 wait complete. 2023-08-17T18:10:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 57 2023-08-17T18:10:30.489 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T18:10:30.489 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T18:10:30.489 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T18:10:30.490 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:10:30.490 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T18:10:30.490 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T18:10:30.490 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T18:10:30.491 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:10:30.491 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T18:10:30.491 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T18:10:30.491 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T18:10:30.491 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:10:30.492 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T18:10:30.492 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T18:10:30.492 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T18:10:30.492 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:10:30.498 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T18:10:30.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T18:10:30.499 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T18:10:30.499 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T18:10:30.501 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T18:10:30.501 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T18:10:30.502 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T18:10:30.503 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T18:10:30.540 INFO:tasks.ceph.mds.a:Started 2023-08-17T18:10:30.541 DEBUG:teuthology.parallel:result is None 2023-08-17T18:10:30.541 INFO:tasks.ceph.mds.c:Started 2023-08-17T18:10:30.542 DEBUG:teuthology.parallel:result is None 2023-08-17T18:10:30.544 INFO:tasks.ceph.mds.b:Started 2023-08-17T18:10:30.544 DEBUG:teuthology.parallel:result is None 2023-08-17T18:10:30.545 INFO:tasks.ceph.mds.d:Started 2023-08-17T18:10:30.545 DEBUG:teuthology.parallel:result is None 2023-08-17T18:10:30.545 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T18:10:30.613 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T18:10:30.613 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T18:10:30.622 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T18:10:30.622 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T18:10:30.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.667+0000 7f5f3c5a6700 1 Processor -- start 2023-08-17T18:10:30.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.667+0000 7f5f3c5a6700 1 -- start start 2023-08-17T18:10:30.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.668+0000 7f5f3c5a6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f3413a950 0x7f5f3413ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.668+0000 7f5f3c5a6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5f340c3fc0 0x7f5f340c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.668+0000 7f5f3c5a6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f340c1740 con 0x7f5f34155590 2023-08-17T18:10:30.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.668+0000 7f5f3c5a6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f34159060 con 0x7f5f3413a950 2023-08-17T18:10:30.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.668+0000 7f5f3c5a6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f341584e0 con 0x7f5f340c3fc0 2023-08-17T18:10:30.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.668+0000 7f5f3a342700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f3413a950 0x7f5f3413ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.668+0000 7f5f39b41700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5f34155590 0x7f5f340c38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44990/0 (socket says 172.21.15.78:44990) 2023-08-17T18:10:30.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.668+0000 7f5f3a342700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f3413a950 0x7f5f3413ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38640/0 (socket says 172.21.15.78:38640) 2023-08-17T18:10:30.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.668+0000 7f5f39b41700 1 -- 172.21.15.78:0/340122779 learned_addr learned my addr 172.21.15.78:0/340122779 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:30.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f3ab43700 1 --2- 172.21.15.78:0/340122779 >> v2:172.21.15.150:3300/0 conn(0x7f5f340c3fc0 0x7f5f340c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f3a342700 1 -- 172.21.15.78:0/340122779 >> v2:172.21.15.150:3300/0 conn(0x7f5f340c3fc0 msgr2=0x7f5f340c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:30.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f3a342700 1 --2- 172.21.15.78:0/340122779 >> v2:172.21.15.150:3300/0 conn(0x7f5f340c3fc0 0x7f5f340c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f3a342700 1 -- 172.21.15.78:0/340122779 >> v1:172.21.15.78:6789/0 conn(0x7f5f34155590 legacy=0x7f5f340c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f3a342700 1 -- 172.21.15.78:0/340122779 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f341587c0 con 0x7f5f3413a950 2023-08-17T18:10:30.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f39340700 1 -- 172.21.15.78:0/340122779 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507398320 0 0) 0x7f5f340c1740 con 0x7f5f34155590 2023-08-17T18:10:30.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f3ab43700 1 --2- 172.21.15.78:0/340122779 >> v2:172.21.15.150:3300/0 conn(0x7f5f340c3fc0 0x7f5f340c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f3a342700 1 --2- 172.21.15.78:0/340122779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f3413a950 0x7f5f3413ad30 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f5f3406aa20 tx=0x7f5f24009060).ready entity=mon.0 client_cookie=376d1ce8db565281 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f39340700 1 -- 172.21.15.78:0/340122779 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2400b580 con 0x7f5f3413a950 2023-08-17T18:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f39340700 1 -- 172.21.15.78:0/340122779 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2400b6e0 con 0x7f5f3413a950 2023-08-17T18:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f39340700 1 -- 172.21.15.78:0/340122779 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2400ba60 con 0x7f5f3413a950 2023-08-17T18:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/340122779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f3413a950 msgr2=0x7f5f3413ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.669+0000 7f5f3c5a6700 1 --2- 172.21.15.78:0/340122779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f3413a950 0x7f5f3413ad30 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f5f3406aa20 tx=0x7f5f24009060).stop 2023-08-17T18:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.670+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/340122779 shutdown_connections 2023-08-17T18:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.670+0000 7f5f3c5a6700 1 --2- 172.21.15.78:0/340122779 >> v2:172.21.15.150:3300/0 conn(0x7f5f340c3fc0 0x7f5f340c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.670+0000 7f5f3c5a6700 1 --2- 172.21.15.78:0/340122779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f3413a950 0x7f5f3413ad30 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.670+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/340122779 >> 172.21.15.78:0/340122779 conn(0x7f5f340624f0 msgr2=0x7f5f34062900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.670+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/340122779 shutdown_connections 2023-08-17T18:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.670+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/340122779 wait complete. 2023-08-17T18:10:30.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.671+0000 7f5f3c5a6700 1 Processor -- start 2023-08-17T18:10:30.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.671+0000 7f5f3c5a6700 1 -- start start 2023-08-17T18:10:30.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.671+0000 7f5f3c5a6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340c3fc0 0x7f5f340a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.671+0000 7f5f3c5a6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f3413a950 0x7f5f34153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.671+0000 7f5f3c5a6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f34155590 0x7f5f340bf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.671+0000 7f5f3c5a6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340a78a0 con 0x7f5f340c3fc0 2023-08-17T18:10:30.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.671+0000 7f5f3c5a6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340aa370 con 0x7f5f3413a950 2023-08-17T18:10:30.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.671+0000 7f5f3c5a6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340a69b0 con 0x7f5f34155590 2023-08-17T18:10:30.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.671+0000 7f5f3a342700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340c3fc0 0x7f5f340a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3a342700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340c3fc0 0x7f5f340a9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38656/0 (socket says 172.21.15.78:38656) 2023-08-17T18:10:30.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3a342700 1 -- 172.21.15.78:0/3175125768 learned_addr learned my addr 172.21.15.78:0/3175125768 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:30.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f39b41700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f3413a950 0x7f5f34153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3ab43700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f34155590 0x7f5f340bf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3a342700 1 -- 172.21.15.78:0/3175125768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f34155590 msgr2=0x7f5f340bf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3a342700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f34155590 0x7f5f340bf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3a342700 1 -- 172.21.15.78:0/3175125768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f3413a950 msgr2=0x7f5f34153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:30.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3a342700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f3413a950 0x7f5f34153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:30.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3a342700 1 -- 172.21.15.78:0/3175125768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f240092a0 con 0x7f5f340c3fc0 2023-08-17T18:10:30.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3a342700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340c3fc0 0x7f5f340a9e80 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f5f24009fd0 tx=0x7f5f24017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:30.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f2a7fc700 1 -- 172.21.15.78:0/3175125768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24000bc0 con 0x7f5f340c3fc0 2023-08-17T18:10:30.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f2a7fc700 1 -- 172.21.15.78:0/3175125768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2400b850 con 0x7f5f340c3fc0 2023-08-17T18:10:30.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f2a7fc700 1 -- 172.21.15.78:0/3175125768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24000d20 con 0x7f5f340c3fc0 2023-08-17T18:10:30.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/3175125768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f340a6c90 con 0x7f5f340c3fc0 2023-08-17T18:10:30.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.672+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/3175125768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f340a7250 con 0x7f5f340c3fc0 2023-08-17T18:10:30.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.673+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/3175125768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3413ad30 con 0x7f5f340c3fc0 2023-08-17T18:10:30.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.673+0000 7f5f2a7fc700 1 -- 172.21.15.78:0/3175125768 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5f2402c070 con 0x7f5f340c3fc0 2023-08-17T18:10:30.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.674+0000 7f5f2a7fc700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5f1805ed90 0x7f5f18061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:30.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.674+0000 7f5f2a7fc700 1 -- 172.21.15.78:0/3175125768 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f5f2407b5e0 con 0x7f5f340c3fc0 2023-08-17T18:10:30.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.674+0000 7f5f39b41700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5f1805ed90 0x7f5f18061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:30.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.674+0000 7f5f39b41700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5f1805ed90 0x7f5f18061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5f340a7f50 tx=0x7f5f30007dd0).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:30.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.678+0000 7f5f2a7fc700 1 -- 172.21.15.78:0/3175125768 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f2404cc20 con 0x7f5f340c3fc0 2023-08-17T18:10:30.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:30.855+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/3175125768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5f34158aa0 con 0x7f5f340c3fc0 2023-08-17T18:10:31.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.738+0000 7f5f2a7fc700 1 -- 172.21.15.78:0/3175125768 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v164) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5f24006b30 con 0x7f5f340c3fc0 2023-08-17T18:10:31.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.740+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/3175125768 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5f1805ed90 msgr2=0x7f5f18061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:31.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.740+0000 7f5f3c5a6700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5f1805ed90 0x7f5f18061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5f340a7f50 tx=0x7f5f30007dd0).stop 2023-08-17T18:10:31.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.740+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/3175125768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340c3fc0 msgr2=0x7f5f340a9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:31.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.740+0000 7f5f3c5a6700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340c3fc0 0x7f5f340a9e80 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f5f24009fd0 tx=0x7f5f24017000).stop 2023-08-17T18:10:31.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.741+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/3175125768 shutdown_connections 2023-08-17T18:10:31.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.741+0000 7f5f3c5a6700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5f1805ed90 0x7f5f18061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:31.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.741+0000 7f5f3c5a6700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f34155590 0x7f5f340bf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:31.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.741+0000 7f5f3c5a6700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340c3fc0 0x7f5f340a9e80 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:31.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.741+0000 7f5f3c5a6700 1 --2- 172.21.15.78:0/3175125768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f3413a950 0x7f5f34153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:31.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.741+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/3175125768 >> 172.21.15.78:0/3175125768 conn(0x7f5f340624f0 msgr2=0x7f5f34154ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:31.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.741+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/3175125768 shutdown_connections 2023-08-17T18:10:31.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.741+0000 7f5f3c5a6700 1 -- 172.21.15.78:0/3175125768 wait complete. 2023-08-17T18:10:31.743 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-08-17T18:10:31.754 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T18:10:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.867+0000 7f58ec9e9700 1 Processor -- start 2023-08-17T18:10:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.867+0000 7f58ec9e9700 1 -- start start 2023-08-17T18:10:31.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58ec9e9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58e80a7bd0 0x7f58e8063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:31.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58ec9e9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e8063960 con 0x7f58e80a8050 2023-08-17T18:10:31.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58ec9e9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e8063030 con 0x7f58e80c01b0 2023-08-17T18:10:31.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58ec9e9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e80649f0 con 0x7f58e80a7bd0 2023-08-17T18:10:31.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58de59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58e80a7bd0 0x7f58e8063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:31.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58e759e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f58e80a8050 0x7f58e80642e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44994/0 (socket says 172.21.15.78:44994) 2023-08-17T18:10:31.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58e759e700 1 -- 172.21.15.78:0/1016927783 learned_addr learned my addr 172.21.15.78:0/1016927783 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:31.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58de59c700 1 -- 172.21.15.78:0/1016927783 >> v1:172.21.15.150:6789/0 conn(0x7f58e80c01b0 legacy=0x7f58e80c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:31.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58de59c700 1 -- 172.21.15.78:0/1016927783 >> v1:172.21.15.78:6789/0 conn(0x7f58e80a8050 legacy=0x7f58e80642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:31.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58e659c700 1 -- 172.21.15.78:0/1016927783 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630185499 0 0) 0x7f58e8063960 con 0x7f58e80a8050 2023-08-17T18:10:31.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58de59c700 1 -- 172.21.15.78:0/1016927783 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8063310 con 0x7f58e80a7bd0 2023-08-17T18:10:31.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.868+0000 7f58de59c700 1 --2- 172.21.15.78:0/1016927783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a7bd0 0x7f58e8063df0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f58d0009760 tx=0x7f58d0009060).ready entity=mon.0 client_cookie=7de528c0a81ca31 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:31.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.869+0000 7f58e659c700 1 -- 172.21.15.78:0/1016927783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d000b520 con 0x7f58e80a7bd0 2023-08-17T18:10:31.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.869+0000 7f58e659c700 1 -- 172.21.15.78:0/1016927783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d000b680 con 0x7f58e80a7bd0 2023-08-17T18:10:31.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.869+0000 7f58e659c700 1 -- 172.21.15.78:0/1016927783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d000ba00 con 0x7f58e80a7bd0 2023-08-17T18:10:31.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.869+0000 7f58ec9e9700 1 -- 172.21.15.78:0/1016927783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a7bd0 msgr2=0x7f58e8063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:31.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.869+0000 7f58ec9e9700 1 --2- 172.21.15.78:0/1016927783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a7bd0 0x7f58e8063df0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f58d0009760 tx=0x7f58d0009060).stop 2023-08-17T18:10:31.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.869+0000 7f58ec9e9700 1 -- 172.21.15.78:0/1016927783 shutdown_connections 2023-08-17T18:10:31.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.869+0000 7f58ec9e9700 1 --2- 172.21.15.78:0/1016927783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a7bd0 0x7f58e8063df0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:31.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.869+0000 7f58ec9e9700 1 -- 172.21.15.78:0/1016927783 >> 172.21.15.78:0/1016927783 conn(0x7f58e806a6c0 msgr2=0x7f58e80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:31.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.869+0000 7f58ec9e9700 1 -- 172.21.15.78:0/1016927783 shutdown_connections 2023-08-17T18:10:31.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.869+0000 7f58ec9e9700 1 -- 172.21.15.78:0/1016927783 wait complete. 2023-08-17T18:10:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.870+0000 7f58ec9e9700 1 Processor -- start 2023-08-17T18:10:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.870+0000 7f58ec9e9700 1 -- start start 2023-08-17T18:10:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58ec9e9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e80a7bd0 0x7f58e80c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58ec9e9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a8050 0x7f58e81459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58ec9e9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80c01b0 0x7f58e8164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58ec9e9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e8165310 con 0x7f58e80a8050 2023-08-17T18:10:31.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58ec9e9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e8164d50 con 0x7f58e80c01b0 2023-08-17T18:10:31.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58ec9e9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e8165030 con 0x7f58e80a7bd0 2023-08-17T18:10:31.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58de59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a8050 0x7f58e81459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:31.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58de59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a8050 0x7f58e81459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38686/0 (socket says 172.21.15.78:38686) 2023-08-17T18:10:31.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58de59c700 1 -- 172.21.15.78:0/2936019268 learned_addr learned my addr 172.21.15.78:0/2936019268 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:31.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58e759e700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80c01b0 0x7f58e8164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:31.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.871+0000 7f58de59c700 1 -- 172.21.15.78:0/2936019268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e80a7bd0 msgr2=0x7f58e80c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:31.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.872+0000 7f58de59c700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e80a7bd0 0x7f58e80c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:31.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.872+0000 7f58de59c700 1 -- 172.21.15.78:0/2936019268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80c01b0 msgr2=0x7f58e8164300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:31.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.872+0000 7f58de59c700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80c01b0 0x7f58e8164300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:31.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.872+0000 7f58de59c700 1 -- 172.21.15.78:0/2936019268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00092a0 con 0x7f58e80a8050 2023-08-17T18:10:31.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.872+0000 7f58de59c700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a8050 0x7f58e81459e0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f58d0009eb0 tx=0x7f58d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:31.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.872+0000 7f58df7fe700 1 -- 172.21.15.78:0/2936019268 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d000b7f0 con 0x7f58e80a8050 2023-08-17T18:10:31.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.872+0000 7f58df7fe700 1 -- 172.21.15.78:0/2936019268 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d000b950 con 0x7f58e80a8050 2023-08-17T18:10:31.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.872+0000 7f58df7fe700 1 -- 172.21.15.78:0/2936019268 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d001b640 con 0x7f58e80a8050 2023-08-17T18:10:31.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.872+0000 7f58ec9e9700 1 -- 172.21.15.78:0/2936019268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e80ae240 con 0x7f58e80a8050 2023-08-17T18:10:31.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.872+0000 7f58ec9e9700 1 -- 172.21.15.78:0/2936019268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e80b0b50 con 0x7f58e80a8050 2023-08-17T18:10:31.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.873+0000 7f58ec9e9700 1 -- 172.21.15.78:0/2936019268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e80ae0a0 con 0x7f58e80a8050 2023-08-17T18:10:31.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.873+0000 7f58df7fe700 1 -- 172.21.15.78:0/2936019268 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f58d000f070 con 0x7f58e80a8050 2023-08-17T18:10:31.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.873+0000 7f58df7fe700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f58c805ed60 0x7f58c8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:31.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.873+0000 7f58df7fe700 1 -- 172.21.15.78:0/2936019268 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f58d007b420 con 0x7f58e80a8050 2023-08-17T18:10:31.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.873+0000 7f58e6d9d700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f58c805ed60 0x7f58c8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:31.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.874+0000 7f58e6d9d700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f58c805ed60 0x7f58c8061220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f58d80095d0 tx=0x7f58d8006ae0).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:31.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:31.878+0000 7f58df7fe700 1 -- 172.21.15.78:0/2936019268 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f58e80ae0a0 con 0x7f58e80a8050 2023-08-17T18:10:32.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.104+0000 7f58ec9e9700 1 -- 172.21.15.78:0/2936019268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f58e80ae0a0 con 0x7f58e80a8050 2023-08-17T18:10:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.104+0000 7f58df7fe700 1 -- 172.21.15.78:0/2936019268 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f58e80ae0a0 con 0x7f58e80a8050 2023-08-17T18:10:32.105 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:32.106 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:10:32.106 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-08-17T18:10:32.106 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.106 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-08-17T18:10:32.106 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA==", 2023-08-17T18:10:32.106 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.106 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:10:32.107 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T18:10:32.107 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T18:10:32.107 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.107 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.107 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.107 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.107 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-08-17T18:10:32.108 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g==", 2023-08-17T18:10:32.108 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.108 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:10:32.108 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T18:10:32.108 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T18:10:32.108 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.108 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.108 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.109 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.109 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-08-17T18:10:32.109 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw==", 2023-08-17T18:10:32.109 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.109 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:10:32.109 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T18:10:32.109 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T18:10:32.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.110 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.110 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.110 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.110 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-08-17T18:10:32.110 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg==", 2023-08-17T18:10:32.110 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.110 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:10:32.111 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T18:10:32.111 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T18:10:32.111 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.111 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.111 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.111 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.111 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-08-17T18:10:32.111 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg==", 2023-08-17T18:10:32.112 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.112 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:10:32.112 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:10:32.112 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.112 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.112 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.112 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.112 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-08-17T18:10:32.113 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw==", 2023-08-17T18:10:32.113 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.113 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:10:32.113 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:10:32.113 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.113 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.113 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.113 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.114 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-08-17T18:10:32.114 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA==", 2023-08-17T18:10:32.114 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.114 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:10:32.114 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:10:32.114 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.114 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.114 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.115 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.115 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-08-17T18:10:32.115 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ==", 2023-08-17T18:10:32.115 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.115 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:10:32.115 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:10:32.116 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.116 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.116 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.116 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.116 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-08-17T18:10:32.116 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA==", 2023-08-17T18:10:32.116 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.116 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:10:32.117 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:10:32.117 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.117 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.117 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.117 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.117 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-08-17T18:10:32.117 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q==", 2023-08-17T18:10:32.117 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.118 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:10:32.118 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:10:32.118 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.118 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.118 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.118 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.118 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-08-17T18:10:32.119 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw==", 2023-08-17T18:10:32.119 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.119 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:10:32.119 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:10:32.119 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.119 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.119 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.119 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.120 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-08-17T18:10:32.120 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg==", 2023-08-17T18:10:32.120 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.120 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:10:32.120 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:10:32.120 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.120 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.120 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.121 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.121 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-08-17T18:10:32.121 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA==", 2023-08-17T18:10:32.121 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.121 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:10:32.121 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-08-17T18:10:32.121 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T18:10:32.121 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.122 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.122 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.122 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-08-17T18:10:32.122 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ==", 2023-08-17T18:10:32.122 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.122 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:10:32.122 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T18:10:32.122 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T18:10:32.123 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T18:10:32.123 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.123 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.123 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.123 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-08-17T18:10:32.123 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ==", 2023-08-17T18:10:32.123 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.124 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:10:32.124 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T18:10:32.124 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T18:10:32.124 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T18:10:32.124 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.124 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.124 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.124 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-08-17T18:10:32.125 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw==", 2023-08-17T18:10:32.125 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.125 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:10:32.125 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T18:10:32.125 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T18:10:32.125 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T18:10:32.125 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.125 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.126 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.126 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-08-17T18:10:32.126 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k6n2yGhAAldYlBQaNGCgXL0HA2ePHVg==", 2023-08-17T18:10:32.126 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.126 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T18:10:32.126 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T18:10:32.126 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T18:10:32.126 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.127 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.127 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.127 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.127 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-08-17T18:10:32.127 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg==", 2023-08-17T18:10:32.127 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.127 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T18:10:32.127 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T18:10:32.128 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.128 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.128 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:32.128 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:32.128 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-08-17T18:10:32.128 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA==", 2023-08-17T18:10:32.128 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:10:32.128 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T18:10:32.129 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T18:10:32.129 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:10:32.129 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.129 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:32.129 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-08-17T18:10:32.129 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:10:32.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 -- 172.21.15.78:0/2936019268 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f58c805ed60 msgr2=0x7f58c8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f58c805ed60 0x7f58c8061220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f58d80095d0 tx=0x7f58d8006ae0).stop 2023-08-17T18:10:32.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 -- 172.21.15.78:0/2936019268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a8050 msgr2=0x7f58e81459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a8050 0x7f58e81459e0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f58d0009eb0 tx=0x7f58d0017000).stop 2023-08-17T18:10:32.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 -- 172.21.15.78:0/2936019268 shutdown_connections 2023-08-17T18:10:32.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f58c805ed60 0x7f58c8061220 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80c01b0 0x7f58e8164300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e80a7bd0 0x7f58e80c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:32.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 --2- 172.21.15.78:0/2936019268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58e80a8050 0x7f58e81459e0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 -- 172.21.15.78:0/2936019268 >> 172.21.15.78:0/2936019268 conn(0x7f58e806a6c0 msgr2=0x7f58e8146480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:32.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 -- 172.21.15.78:0/2936019268 shutdown_connections 2023-08-17T18:10:32.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.106+0000 7f58ec9e9700 1 -- 172.21.15.78:0/2936019268 wait complete. 2023-08-17T18:10:32.133 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:10:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.244+0000 7f2980429700 1 Processor -- start 2023-08-17T18:10:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.244+0000 7f2980429700 1 -- start start 2023-08-17T18:10:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.245+0000 7f2980429700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 0x7f29780c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.245+0000 7f2980429700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29780c0df0 0x7f29780ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.245+0000 7f2980429700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29780a8350 con 0x7f2978154140 2023-08-17T18:10:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.245+0000 7f2980429700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29780c7320 con 0x7f29780c0df0 2023-08-17T18:10:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.245+0000 7f2980429700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29780c1280 con 0x7f29780c6ee0 2023-08-17T18:10:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.245+0000 7f297d9c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 0x7f29780c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.245+0000 7f297e9c6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29780c0df0 0x7f29780ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297d9c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 0x7f29780c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:54714/0 (socket says 172.21.15.78:54714) 2023-08-17T18:10:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297d9c4700 1 -- 172.21.15.78:0/3767194126 learned_addr learned my addr 172.21.15.78:0/3767194126 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:32.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297e9c6700 1 -- 172.21.15.78:0/3767194126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 msgr2=0x7f29780c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:32.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297e9c6700 1 --2- 172.21.15.78:0/3767194126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 0x7f29780c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297e9c6700 1 -- 172.21.15.78:0/3767194126 >> v1:172.21.15.150:6789/0 conn(0x7f2978154140 legacy=0x7f29780a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297e9c6700 1 -- 172.21.15.78:0/3767194126 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978154520 con 0x7f29780c0df0 2023-08-17T18:10:32.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297d9c4700 1 --2- 172.21.15.78:0/3767194126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 0x7f29780c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:32.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297e9c6700 1 --2- 172.21.15.78:0/3767194126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29780c0df0 0x7f29780ca280 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f2970009e60 tx=0x7f2970009780).ready entity=mon.1 client_cookie=7fad8dedb7cd9c02 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:32.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297d1c3700 1 -- 172.21.15.78:0/3767194126 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000e070 con 0x7f29780c0df0 2023-08-17T18:10:32.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297d1c3700 1 -- 172.21.15.78:0/3767194126 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297000bb60 con 0x7f29780c0df0 2023-08-17T18:10:32.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.246+0000 7f297d1c3700 1 -- 172.21.15.78:0/3767194126 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970012410 con 0x7f29780c0df0 2023-08-17T18:10:32.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.247+0000 7f2980429700 1 -- 172.21.15.78:0/3767194126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29780c0df0 msgr2=0x7f29780ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.247+0000 7f2980429700 1 --2- 172.21.15.78:0/3767194126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29780c0df0 0x7f29780ca280 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f2970009e60 tx=0x7f2970009780).stop 2023-08-17T18:10:32.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.247+0000 7f2980429700 1 -- 172.21.15.78:0/3767194126 shutdown_connections 2023-08-17T18:10:32.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.247+0000 7f2980429700 1 --2- 172.21.15.78:0/3767194126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29780c0df0 0x7f29780ca280 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.247+0000 7f2980429700 1 --2- 172.21.15.78:0/3767194126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 0x7f29780c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.247+0000 7f2980429700 1 -- 172.21.15.78:0/3767194126 >> 172.21.15.78:0/3767194126 conn(0x7f2978094510 msgr2=0x7f297806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.247+0000 7f2980429700 1 -- 172.21.15.78:0/3767194126 shutdown_connections 2023-08-17T18:10:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.247+0000 7f2980429700 1 -- 172.21.15.78:0/3767194126 wait complete. 2023-08-17T18:10:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.248+0000 7f2980429700 1 Processor -- start 2023-08-17T18:10:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.248+0000 7f2980429700 1 -- start start 2023-08-17T18:10:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f2980429700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29780c0df0 0x7f29780980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f2980429700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 0x7f29780aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f2980429700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2978154140 0x7f29780a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f2980429700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29780ad000 con 0x7f2978154140 2023-08-17T18:10:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f2980429700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29780ad2e0 con 0x7f29780c0df0 2023-08-17T18:10:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f2980429700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29780ad5c0 con 0x7f29780c6ee0 2023-08-17T18:10:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297e9c6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2978154140 0x7f29780a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297e9c6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2978154140 0x7f29780a8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38688/0 (socket says 172.21.15.78:38688) 2023-08-17T18:10:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297e9c6700 1 -- 172.21.15.78:0/2519647679 learned_addr learned my addr 172.21.15.78:0/2519647679 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297e1c5700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29780c0df0 0x7f29780980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297d9c4700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 0x7f29780aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297e9c6700 1 -- 172.21.15.78:0/2519647679 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 msgr2=0x7f29780aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297e9c6700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 0x7f29780aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297e9c6700 1 -- 172.21.15.78:0/2519647679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29780c0df0 msgr2=0x7f29780980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297e9c6700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29780c0df0 0x7f29780980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297e9c6700 1 -- 172.21.15.78:0/2519647679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2968009370 con 0x7f2978154140 2023-08-17T18:10:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.249+0000 7f297e9c6700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2978154140 0x7f29780a8b10 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f297000b6c0 tx=0x7f2970009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.250+0000 7f296e7fc700 1 -- 172.21.15.78:0/2519647679 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970012410 con 0x7f2978154140 2023-08-17T18:10:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.250+0000 7f296e7fc700 1 -- 172.21.15.78:0/2519647679 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297001d630 con 0x7f2978154140 2023-08-17T18:10:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.250+0000 7f2980429700 1 -- 172.21.15.78:0/2519647679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2970009a20 con 0x7f2978154140 2023-08-17T18:10:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.250+0000 7f296e7fc700 1 -- 172.21.15.78:0/2519647679 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297001d9f0 con 0x7f2978154140 2023-08-17T18:10:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.250+0000 7f2980429700 1 -- 172.21.15.78:0/2519647679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29780985e0 con 0x7f2978154140 2023-08-17T18:10:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.251+0000 7f2980429700 1 -- 172.21.15.78:0/2519647679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29780ad140 con 0x7f2978154140 2023-08-17T18:10:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.251+0000 7f296e7fc700 1 -- 172.21.15.78:0/2519647679 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2970026410 con 0x7f2978154140 2023-08-17T18:10:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.251+0000 7f296e7fc700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f295c05ed90 0x7f295c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.251+0000 7f296e7fc700 1 -- 172.21.15.78:0/2519647679 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f297007b950 con 0x7f2978154140 2023-08-17T18:10:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.251+0000 7f297e1c5700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f295c05ed90 0x7f295c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.252+0000 7f297e1c5700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f295c05ed90 0x7f295c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2974003860 tx=0x7f2974007d40).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.255+0000 7f296e7fc700 1 -- 172.21.15.78:0/2519647679 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29780ad140 con 0x7f2978154140 2023-08-17T18:10:32.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.418+0000 7f2980429700 1 -- 172.21.15.78:0/2519647679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29780ad140 con 0x7f2978154140 2023-08-17T18:10:32.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.418+0000 7f296e7fc700 1 -- 172.21.15.78:0/2519647679 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+13771 (secure 0 0 0) 0x7f29780ad140 con 0x7f2978154140 2023-08-17T18:10:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:32.420 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":164,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:10:31.736912+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:10:32.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.420+0000 7f2980429700 1 -- 172.21.15.78:0/2519647679 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f295c05ed90 msgr2=0x7f295c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.420+0000 7f2980429700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f295c05ed90 0x7f295c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2974003860 tx=0x7f2974007d40).stop 2023-08-17T18:10:32.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.420+0000 7f2980429700 1 -- 172.21.15.78:0/2519647679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2978154140 msgr2=0x7f29780a8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.420+0000 7f2980429700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2978154140 0x7f29780a8b10 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f297000b6c0 tx=0x7f2970009780).stop 2023-08-17T18:10:32.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.420+0000 7f2980429700 1 -- 172.21.15.78:0/2519647679 shutdown_connections 2023-08-17T18:10:32.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.420+0000 7f2980429700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f295c05ed90 0x7f295c061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.420+0000 7f2980429700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2978154140 0x7f29780a8b10 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.420+0000 7f2980429700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29780c0df0 0x7f29780980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.420+0000 7f2980429700 1 --2- 172.21.15.78:0/2519647679 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29780c6ee0 0x7f29780aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.420+0000 7f2980429700 1 -- 172.21.15.78:0/2519647679 >> 172.21.15.78:0/2519647679 conn(0x7f2978094510 msgr2=0x7f297814e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:32.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.421+0000 7f2980429700 1 -- 172.21.15.78:0/2519647679 shutdown_connections 2023-08-17T18:10:32.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.421+0000 7f2980429700 1 -- 172.21.15.78:0/2519647679 wait complete. 2023-08-17T18:10:32.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T18:10:32.434 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T18:10:32.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.550+0000 7fad69108700 1 Processor -- start 2023-08-17T18:10:32.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.550+0000 7fad69108700 1 -- start start 2023-08-17T18:10:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad69108700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad64151a40 0x7fad640c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad69108700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fad64151e20 0x7fad640c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad69108700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad64157be0 0x7fad64158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad69108700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad64158560 con 0x7fad64151a40 2023-08-17T18:10:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad69108700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640c6620 con 0x7fad64151e20 2023-08-17T18:10:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad69108700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad640c6900 con 0x7fad64157be0 2023-08-17T18:10:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad63fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad64151a40 0x7fad640c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad63fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad64151a40 0x7fad640c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38698/0 (socket says 172.21.15.78:38698) 2023-08-17T18:10:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad63fff700 1 -- 172.21.15.78:0/2207292514 learned_addr learned my addr 172.21.15.78:0/2207292514 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad637fe700 1 --2- 172.21.15.78:0/2207292514 >> v2:172.21.15.150:3300/0 conn(0x7fad64151e20 0x7fad640c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad68907700 1 --2- 172.21.15.78:0/2207292514 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad64157be0 0x7fad64158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad63fff700 1 -- 172.21.15.78:0/2207292514 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad64157be0 msgr2=0x7fad64158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad63fff700 1 --2- 172.21.15.78:0/2207292514 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad64157be0 0x7fad64158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad63fff700 1 -- 172.21.15.78:0/2207292514 >> v2:172.21.15.150:3300/0 conn(0x7fad64151e20 msgr2=0x7fad640c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad63fff700 1 --2- 172.21.15.78:0/2207292514 >> v2:172.21.15.150:3300/0 conn(0x7fad64151e20 0x7fad640c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad63fff700 1 -- 172.21.15.78:0/2207292514 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640c6be0 con 0x7fad64151a40 2023-08-17T18:10:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad637fe700 1 --2- 172.21.15.78:0/2207292514 >> v2:172.21.15.150:3300/0 conn(0x7fad64151e20 0x7fad640c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:32.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad63fff700 1 --2- 172.21.15.78:0/2207292514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151a40 0x7fad640c8260 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7fad64065360 tx=0x7fad58009060).ready entity=mon.0 client_cookie=4e75683a424725d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:32.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad62ffd700 1 -- 172.21.15.78:0/2207292514 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58005880 con 0x7fad64151a40 2023-08-17T18:10:32.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad62ffd700 1 -- 172.21.15.78:0/2207292514 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad580059e0 con 0x7fad64151a40 2023-08-17T18:10:32.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.551+0000 7fad62ffd700 1 -- 172.21.15.78:0/2207292514 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58005d60 con 0x7fad64151a40 2023-08-17T18:10:32.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.552+0000 7fad69108700 1 -- 172.21.15.78:0/2207292514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151a40 msgr2=0x7fad640c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.552+0000 7fad69108700 1 --2- 172.21.15.78:0/2207292514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151a40 0x7fad640c8260 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7fad64065360 tx=0x7fad58009060).stop 2023-08-17T18:10:32.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.552+0000 7fad69108700 1 -- 172.21.15.78:0/2207292514 shutdown_connections 2023-08-17T18:10:32.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.552+0000 7fad69108700 1 --2- 172.21.15.78:0/2207292514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151a40 0x7fad640c8260 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.552+0000 7fad69108700 1 --2- 172.21.15.78:0/2207292514 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad64157be0 0x7fad64158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.552+0000 7fad69108700 1 --2- 172.21.15.78:0/2207292514 >> v2:172.21.15.150:3300/0 conn(0x7fad64151e20 0x7fad640c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.552+0000 7fad69108700 1 -- 172.21.15.78:0/2207292514 >> 172.21.15.78:0/2207292514 conn(0x7fad640943b0 msgr2=0x7fad6406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:32.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.552+0000 7fad69108700 1 -- 172.21.15.78:0/2207292514 shutdown_connections 2023-08-17T18:10:32.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.552+0000 7fad69108700 1 -- 172.21.15.78:0/2207292514 wait complete. 2023-08-17T18:10:32.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.553+0000 7fad69108700 1 Processor -- start 2023-08-17T18:10:32.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.553+0000 7fad69108700 1 -- start start 2023-08-17T18:10:32.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad69108700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad64151a40 0x7fad6414ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad69108700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151e20 0x7fad640c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad69108700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad64157be0 0x7fad640c2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad69108700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64168ec0 con 0x7fad64151e20 2023-08-17T18:10:32.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad69108700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64150570 con 0x7fad64151a40 2023-08-17T18:10:32.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad69108700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad64168100 con 0x7fad64157be0 2023-08-17T18:10:32.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad637fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151e20 0x7fad640c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad637fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151e20 0x7fad640c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38710/0 (socket says 172.21.15.78:38710) 2023-08-17T18:10:32.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad637fe700 1 -- 172.21.15.78:0/2046206009 learned_addr learned my addr 172.21.15.78:0/2046206009 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:32.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad63fff700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad64151a40 0x7fad6414ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad68907700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad64157be0 0x7fad640c2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad637fe700 1 -- 172.21.15.78:0/2046206009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad64157be0 msgr2=0x7fad640c2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad637fe700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad64157be0 0x7fad640c2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad637fe700 1 -- 172.21.15.78:0/2046206009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad64151a40 msgr2=0x7fad6414ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad637fe700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad64151a40 0x7fad6414ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.554+0000 7fad637fe700 1 -- 172.21.15.78:0/2046206009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58009300 con 0x7fad64151e20 2023-08-17T18:10:32.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.555+0000 7fad637fe700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151e20 0x7fad640c47c0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7fad5400d890 tx=0x7fad54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:32.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.555+0000 7fad4bfff700 1 -- 172.21.15.78:0/2046206009 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54016070 con 0x7fad64151e20 2023-08-17T18:10:32.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.555+0000 7fad4bfff700 1 -- 172.21.15.78:0/2046206009 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54005880 con 0x7fad64151e20 2023-08-17T18:10:32.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.555+0000 7fad69108700 1 -- 172.21.15.78:0/2046206009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad641683e0 con 0x7fad64151e20 2023-08-17T18:10:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.555+0000 7fad4bfff700 1 -- 172.21.15.78:0/2046206009 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54005c00 con 0x7fad64151e20 2023-08-17T18:10:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.555+0000 7fad69108700 1 -- 172.21.15.78:0/2046206009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad641689a0 con 0x7fad64151e20 2023-08-17T18:10:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.556+0000 7fad69108700 1 -- 172.21.15.78:0/2046206009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad64082f90 con 0x7fad64151e20 2023-08-17T18:10:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.556+0000 7fad4bfff700 1 -- 172.21.15.78:0/2046206009 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fad54005f70 con 0x7fad64151e20 2023-08-17T18:10:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.556+0000 7fad4bfff700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fad5005ed90 0x7fad50061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.556+0000 7fad4bfff700 1 -- 172.21.15.78:0/2046206009 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fad54078f20 con 0x7fad64151e20 2023-08-17T18:10:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.557+0000 7fad63fff700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fad5005ed90 0x7fad50061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.557+0000 7fad63fff700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fad5005ed90 0x7fad50061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fad5800b3c0 tx=0x7fad58016000).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:32.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.560+0000 7fad4bfff700 1 -- 172.21.15.78:0/2046206009 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad540488f0 con 0x7fad64151e20 2023-08-17T18:10:32.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.721+0000 7fad69108700 1 -- 172.21.15.78:0/2046206009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fad6405f910 con 0x7fad64151e20 2023-08-17T18:10:32.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.722+0000 7fad4bfff700 1 -- 172.21.15.78:0/2046206009 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v164) v1 ==== 110+0+10 (secure 0 0 0) 0x7fad5404a810 con 0x7fad64151e20 2023-08-17T18:10:32.723 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T18:10:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 -- 172.21.15.78:0/2046206009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fad5005ed90 msgr2=0x7fad50061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fad5005ed90 0x7fad50061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fad5800b3c0 tx=0x7fad58016000).stop 2023-08-17T18:10:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 -- 172.21.15.78:0/2046206009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151e20 msgr2=0x7fad640c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151e20 0x7fad640c47c0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7fad5400d890 tx=0x7fad54008040).stop 2023-08-17T18:10:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 -- 172.21.15.78:0/2046206009 shutdown_connections 2023-08-17T18:10:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fad5005ed90 0x7fad50061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad64157be0 0x7fad640c2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad64151a40 0x7fad6414ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 --2- 172.21.15.78:0/2046206009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad64151e20 0x7fad640c47c0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 -- 172.21.15.78:0/2046206009 >> 172.21.15.78:0/2046206009 conn(0x7fad640943b0 msgr2=0x7fad6406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 -- 172.21.15.78:0/2046206009 shutdown_connections 2023-08-17T18:10:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.724+0000 7fad69108700 1 -- 172.21.15.78:0/2046206009 wait complete. 2023-08-17T18:10:32.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T18:10:32.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.852+0000 7f6d302d8700 1 Processor -- start 2023-08-17T18:10:32.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.852+0000 7f6d302d8700 1 -- start start 2023-08-17T18:10:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d302d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280aa4d0 0x7f6d280644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d302d8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6d280c5810 0x7f6d280c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d302d8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d280649b0 con 0x7f6d280aa0f0 2023-08-17T18:10:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d302d8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280c6150 con 0x7f6d280c5810 2023-08-17T18:10:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d302d8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28063420 con 0x7f6d280aa4d0 2023-08-17T18:10:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2e875700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6d280c5810 0x7f6d280c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2e074700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6d280aa0f0 0x7f6d280c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45010/0 (socket says 172.21.15.78:45010) 2023-08-17T18:10:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2e074700 1 -- 172.21.15.78:0/4118461235 learned_addr learned my addr 172.21.15.78:0/4118461235 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2d873700 1 --2- 172.21.15.78:0/4118461235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280aa4d0 0x7f6d280644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2e875700 1 -- 172.21.15.78:0/4118461235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280aa4d0 msgr2=0x7f6d280644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2e875700 1 --2- 172.21.15.78:0/4118461235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280aa4d0 0x7f6d280644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2e875700 1 -- 172.21.15.78:0/4118461235 >> v1:172.21.15.78:6789/0 conn(0x7f6d280aa0f0 legacy=0x7f6d280c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2e875700 1 -- 172.21.15.78:0/4118461235 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d28063700 con 0x7f6d280c5810 2023-08-17T18:10:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2d072700 1 -- 172.21.15.78:0/4118461235 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881685705 0 0) 0x7f6d280649b0 con 0x7f6d280aa0f0 2023-08-17T18:10:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2e875700 1 --2- 172.21.15.78:0/4118461235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c5810 0x7f6d280c5c60 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f6d18009760 tx=0x7f6d18009060).ready entity=mon.0 client_cookie=2a0bae6ca1a29f4a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2d072700 1 -- 172.21.15.78:0/4118461235 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800b580 con 0x7f6d280c5810 2023-08-17T18:10:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2d072700 1 -- 172.21.15.78:0/4118461235 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800b6e0 con 0x7f6d280c5810 2023-08-17T18:10:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.853+0000 7f6d2d072700 1 -- 172.21.15.78:0/4118461235 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800ba60 con 0x7f6d280c5810 2023-08-17T18:10:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.854+0000 7f6d302d8700 1 -- 172.21.15.78:0/4118461235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c5810 msgr2=0x7f6d280c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.854+0000 7f6d302d8700 1 --2- 172.21.15.78:0/4118461235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c5810 0x7f6d280c5c60 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f6d18009760 tx=0x7f6d18009060).stop 2023-08-17T18:10:32.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.854+0000 7f6d302d8700 1 -- 172.21.15.78:0/4118461235 shutdown_connections 2023-08-17T18:10:32.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.854+0000 7f6d302d8700 1 --2- 172.21.15.78:0/4118461235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280c5810 0x7f6d280c5c60 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.854+0000 7f6d302d8700 1 --2- 172.21.15.78:0/4118461235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280aa4d0 0x7f6d280644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.854+0000 7f6d302d8700 1 -- 172.21.15.78:0/4118461235 >> 172.21.15.78:0/4118461235 conn(0x7f6d2806a6a0 msgr2=0x7f6d280caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:32.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.854+0000 7f6d302d8700 1 -- 172.21.15.78:0/4118461235 shutdown_connections 2023-08-17T18:10:32.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.854+0000 7f6d302d8700 1 -- 172.21.15.78:0/4118461235 wait complete. 2023-08-17T18:10:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.855+0000 7f6d302d8700 1 Processor -- start 2023-08-17T18:10:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.855+0000 7f6d302d8700 1 -- start start 2023-08-17T18:10:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d302d8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d280aa0f0 0x7f6d28152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d302d8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280aa4d0 0x7f6d280c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d302d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 0x7f6d280c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d302d8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280ac7e0 con 0x7f6d280aa4d0 2023-08-17T18:10:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d302d8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280c2240 con 0x7f6d280aa0f0 2023-08-17T18:10:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d302d8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280abbd0 con 0x7f6d280c5810 2023-08-17T18:10:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2d873700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280aa4d0 0x7f6d280c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2d873700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280aa4d0 0x7f6d280c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38724/0 (socket says 172.21.15.78:38724) 2023-08-17T18:10:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2d873700 1 -- 172.21.15.78:0/2379993661 learned_addr learned my addr 172.21.15.78:0/2379993661 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:32.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2e074700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d280aa0f0 0x7f6d28152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2e875700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 0x7f6d280c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2d873700 1 -- 172.21.15.78:0/2379993661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 msgr2=0x7f6d280c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2d873700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 0x7f6d280c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2d873700 1 -- 172.21.15.78:0/2379993661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d280aa0f0 msgr2=0x7f6d28152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:32.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2d873700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d280aa0f0 0x7f6d28152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:32.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2d873700 1 -- 172.21.15.78:0/2379993661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180092a0 con 0x7f6d280aa4d0 2023-08-17T18:10:32.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d2d873700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280aa4d0 0x7f6d280c31f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f6d1c00e190 tx=0x7f6d1c009920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:32.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d267fc700 1 -- 172.21.15.78:0/2379993661 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c00ed80 con 0x7f6d280aa4d0 2023-08-17T18:10:32.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d267fc700 1 -- 172.21.15.78:0/2379993661 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c014400 con 0x7f6d280aa4d0 2023-08-17T18:10:32.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d302d8700 1 -- 172.21.15.78:0/2379993661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d280abeb0 con 0x7f6d280aa4d0 2023-08-17T18:10:32.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d267fc700 1 -- 172.21.15.78:0/2379993661 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c014780 con 0x7f6d280aa4d0 2023-08-17T18:10:32.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.856+0000 7f6d302d8700 1 -- 172.21.15.78:0/2379993661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d280ac470 con 0x7f6d280aa4d0 2023-08-17T18:10:32.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.857+0000 7f6d302d8700 1 -- 172.21.15.78:0/2379993661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d28083980 con 0x7f6d280aa4d0 2023-08-17T18:10:32.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.858+0000 7f6d267fc700 1 -- 172.21.15.78:0/2379993661 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6d1c01b030 con 0x7f6d280aa4d0 2023-08-17T18:10:32.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.858+0000 7f6d267fc700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 0x7f6d14061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:32.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.858+0000 7f6d2e074700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 0x7f6d14061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:32.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.858+0000 7f6d267fc700 1 -- 172.21.15.78:0/2379993661 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f6d1c079af0 con 0x7f6d280aa4d0 2023-08-17T18:10:32.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.858+0000 7f6d2e074700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 0x7f6d14061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6d20007fd0 tx=0x7f6d20007dd0).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:32.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:32.862+0000 7f6d267fc700 1 -- 172.21.15.78:0/2379993661 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6d1c04b380 con 0x7f6d280aa4d0 2023-08-17T18:10:33.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.023+0000 7f6d302d8700 1 -- 172.21.15.78:0/2379993661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d28046af0 con 0x7f6d280aa4d0 2023-08-17T18:10:33.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.024+0000 7f6d267fc700 1 -- 172.21.15.78:0/2379993661 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v164) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6d1c04e9a0 con 0x7f6d280aa4d0 2023-08-17T18:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T18:10:33.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 -- 172.21.15.78:0/2379993661 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 msgr2=0x7f6d14061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 0x7f6d14061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6d20007fd0 tx=0x7f6d20007dd0).stop 2023-08-17T18:10:33.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 -- 172.21.15.78:0/2379993661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280aa4d0 msgr2=0x7f6d280c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280aa4d0 0x7f6d280c31f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f6d1c00e190 tx=0x7f6d1c009920).stop 2023-08-17T18:10:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 -- 172.21.15.78:0/2379993661 shutdown_connections 2023-08-17T18:10:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f6d1405ed90 0x7f6d14061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d280c5810 0x7f6d280c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d280aa0f0 0x7f6d28152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 --2- 172.21.15.78:0/2379993661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d280aa4d0 0x7f6d280c31f0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 -- 172.21.15.78:0/2379993661 >> 172.21.15.78:0/2379993661 conn(0x7f6d2806a6a0 msgr2=0x7f6d280c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 -- 172.21.15.78:0/2379993661 shutdown_connections 2023-08-17T18:10:33.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.026+0000 7f6d302d8700 1 -- 172.21.15.78:0/2379993661 wait complete. 2023-08-17T18:10:33.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T18:10:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.150+0000 7f4358478700 1 Processor -- start 2023-08-17T18:10:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.150+0000 7f4358478700 1 -- start start 2023-08-17T18:10:33.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.151+0000 7f4358478700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500be4d0 0x7f43500be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.151+0000 7f4358478700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43500bf210 con 0x7f43500a7c90 2023-08-17T18:10:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.151+0000 7f4358478700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43500c5a80 con 0x7f4350151e40 2023-08-17T18:10:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.151+0000 7f4358478700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43500bee30 con 0x7f43500be4d0 2023-08-17T18:10:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.151+0000 7f4355a13700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f43500a7c90 0x7f43500c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45012/0 (socket says 172.21.15.78:45012) 2023-08-17T18:10:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.151+0000 7f4355a13700 1 -- 172.21.15.78:0/774275737 learned_addr learned my addr 172.21.15.78:0/774275737 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4356a15700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500be4d0 0x7f43500be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551905879 0 0) 0x7f43500bf210 con 0x7f43500a7c90 2023-08-17T18:10:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f433c0033f0 con 0x7f43500a7c90 2023-08-17T18:10:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610183361 0 0) 0x7f43500c5a80 con 0x7f4350151e40 2023-08-17T18:10:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43500bf210 con 0x7f4350151e40 2023-08-17T18:10:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3064538652 0 0) 0x7f433c0033f0 con 0x7f43500a7c90 2023-08-17T18:10:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500be4d0 msgr2=0x7f43500be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500be4d0 0x7f43500be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 >> v1:172.21.15.150:6789/0 conn(0x7f4350151e40 legacy=0x7f4350152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43500c5450 con 0x7f43500a7c90 2023-08-17T18:10:33.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f4340001470 con 0x7f43500a7c90 2023-08-17T18:10:33.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 >> v1:172.21.15.78:6789/0 conn(0x7f43500a7c90 legacy=0x7f43500c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f433c003aa0 0x7f433c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500be4d0 0x7f433c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f433c004b80 0x7f433c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500bee30 con 0x7f433c004b80 2023-08-17T18:10:33.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c00b910 con 0x7f433c003aa0 2023-08-17T18:10:33.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433c00bad0 con 0x7f43500be4d0 2023-08-17T18:10:33.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4356a15700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f433c004b80 0x7f433c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4356214700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f433c003aa0 0x7f433c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355a13700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500be4d0 0x7f433c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4356a15700 1 -- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500be4d0 msgr2=0x7f433c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4356a15700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500be4d0 0x7f433c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4356a15700 1 -- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f433c003aa0 msgr2=0x7f433c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4356a15700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f433c003aa0 0x7f433c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4356a15700 1 -- 172.21.15.78:0/774275737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c0033f0 con 0x7f433c004b80 2023-08-17T18:10:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.152+0000 7f4355a13700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500be4d0 0x7f433c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4356a15700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f433c004b80 0x7f433c005000 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f434800e210 tx=0x7f434800b040).ready entity=mon.0 client_cookie=1a00e30cf871a515 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348009ac0 con 0x7f433c004b80 2023-08-17T18:10:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434800f040 con 0x7f433c004b80 2023-08-17T18:10:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4355212700 1 -- 172.21.15.78:0/774275737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434800ecd0 con 0x7f433c004b80 2023-08-17T18:10:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4358478700 1 -- 172.21.15.78:0/774275737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f433c004b80 msgr2=0x7f433c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4358478700 1 --2- 172.21.15.78:0/774275737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f433c004b80 0x7f433c005000 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f434800e210 tx=0x7f434800b040).stop 2023-08-17T18:10:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4356a15700 1 -- 172.21.15.78:0/774275737 reap_dead start 2023-08-17T18:10:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4358478700 1 -- 172.21.15.78:0/774275737 shutdown_connections 2023-08-17T18:10:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4358478700 1 -- 172.21.15.78:0/774275737 >> 172.21.15.78:0/774275737 conn(0x7f4350092330 msgr2=0x7f4350062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4358478700 1 -- 172.21.15.78:0/774275737 shutdown_connections 2023-08-17T18:10:33.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.153+0000 7f4358478700 1 -- 172.21.15.78:0/774275737 wait complete. 2023-08-17T18:10:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.154+0000 7f4358478700 1 Processor -- start 2023-08-17T18:10:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.154+0000 7f4358478700 1 -- start start 2023-08-17T18:10:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4358478700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f433c004b80 0x7f435014cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4358478700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f435014d4c0 0x7f43500c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4358478700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43500c8ec0 0x7f43500a8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4358478700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500c82a0 con 0x7f43500c8ec0 2023-08-17T18:10:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4358478700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4350067d30 con 0x7f433c004b80 2023-08-17T18:10:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4358478700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4350157d90 con 0x7f435014d4c0 2023-08-17T18:10:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4356a15700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43500c8ec0 0x7f43500a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4356a15700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43500c8ec0 0x7f43500a8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38738/0 (socket says 172.21.15.78:38738) 2023-08-17T18:10:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4356a15700 1 -- 172.21.15.78:0/4226412088 learned_addr learned my addr 172.21.15.78:0/4226412088 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4355a13700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f435014d4c0 0x7f43500c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4356214700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f433c004b80 0x7f435014cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.155+0000 7f4356a15700 1 -- 172.21.15.78:0/4226412088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f435014d4c0 msgr2=0x7f43500c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.156+0000 7f4356a15700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f435014d4c0 0x7f43500c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.156+0000 7f4356a15700 1 -- 172.21.15.78:0/4226412088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f433c004b80 msgr2=0x7f435014cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.156+0000 7f4356a15700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f433c004b80 0x7f435014cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.156+0000 7f4356a15700 1 -- 172.21.15.78:0/4226412088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350158070 con 0x7f43500c8ec0 2023-08-17T18:10:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.156+0000 7f4356a15700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43500c8ec0 0x7f43500a8770 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f4348014000 tx=0x7f434801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.156+0000 7f43467fc700 1 -- 172.21.15.78:0/4226412088 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348021030 con 0x7f43500c8ec0 2023-08-17T18:10:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.156+0000 7f43467fc700 1 -- 172.21.15.78:0/4226412088 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4348009ac0 con 0x7f43500c8ec0 2023-08-17T18:10:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.156+0000 7f4358478700 1 -- 172.21.15.78:0/4226412088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43500c84b0 con 0x7f43500c8ec0 2023-08-17T18:10:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.156+0000 7f43467fc700 1 -- 172.21.15.78:0/4226412088 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348013e70 con 0x7f43500c8ec0 2023-08-17T18:10:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.156+0000 7f4358478700 1 -- 172.21.15.78:0/4226412088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435014d170 con 0x7f43500c8ec0 2023-08-17T18:10:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.157+0000 7f4358478700 1 -- 172.21.15.78:0/4226412088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4350158260 con 0x7f43500c8ec0 2023-08-17T18:10:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.157+0000 7f43467fc700 1 -- 172.21.15.78:0/4226412088 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f434801d610 con 0x7f43500c8ec0 2023-08-17T18:10:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.157+0000 7f43467fc700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433405ed90 0x7f4334061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.157+0000 7f43467fc700 1 -- 172.21.15.78:0/4226412088 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4348022070 con 0x7f43500c8ec0 2023-08-17T18:10:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.157+0000 7f4356214700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433405ed90 0x7f4334061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.158+0000 7f4356214700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433405ed90 0x7f4334061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f434c000c00 tx=0x7f434c009040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:33.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.161+0000 7f43467fc700 1 -- 172.21.15.78:0/4226412088 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4350158260 con 0x7f43500c8ec0 2023-08-17T18:10:33.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.329+0000 7f4358478700 1 -- 172.21.15.78:0/4226412088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4350158260 con 0x7f43500c8ec0 2023-08-17T18:10:33.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.329+0000 7f43467fc700 1 -- 172.21.15.78:0/4226412088 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v164) v1 ==== 84+0+143 (secure 0 0 0) 0x7f4350158260 con 0x7f43500c8ec0 2023-08-17T18:10:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:33.331 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T18:10:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T18:10:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T18:10:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:10:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T18:10:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T18:10:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:33.333 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T18:10:33.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 -- 172.21.15.78:0/4226412088 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433405ed90 msgr2=0x7f4334061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433405ed90 0x7f4334061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f434c000c00 tx=0x7f434c009040).stop 2023-08-17T18:10:33.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 -- 172.21.15.78:0/4226412088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43500c8ec0 msgr2=0x7f43500a8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43500c8ec0 0x7f43500a8770 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f4348014000 tx=0x7f434801a000).stop 2023-08-17T18:10:33.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 -- 172.21.15.78:0/4226412088 shutdown_connections 2023-08-17T18:10:33.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433405ed90 0x7f4334061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43500c8ec0 0x7f43500a8770 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f433c004b80 0x7f435014cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 --2- 172.21.15.78:0/4226412088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f435014d4c0 0x7f43500c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 -- 172.21.15.78:0/4226412088 >> 172.21.15.78:0/4226412088 conn(0x7f4350092330 msgr2=0x7f43500c1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:33.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.331+0000 7f4358478700 1 -- 172.21.15.78:0/4226412088 shutdown_connections 2023-08-17T18:10:33.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.332+0000 7f4358478700 1 -- 172.21.15.78:0/4226412088 wait complete. 2023-08-17T18:10:33.344 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T18:10:33.345 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T18:10:33.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.461+0000 7fd86458d700 1 Processor -- start 2023-08-17T18:10:33.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.461+0000 7fd86458d700 1 -- start start 2023-08-17T18:10:33.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd86458d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd85c0aa4d0 0x7fd85c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd86458d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0c5810 0x7fd85c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd86458d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c0649b0 con 0x7fd85c0aa0f0 2023-08-17T18:10:33.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd86458d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c0c6170 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd86458d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c063420 con 0x7fd85c0c5810 2023-08-17T18:10:33.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd861b28700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd85c0aa4d0 0x7fd85c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd862329700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd85c0aa0f0 0x7fd85c0c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45014/0 (socket says 172.21.15.78:45014) 2023-08-17T18:10:33.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd862329700 1 -- 172.21.15.78:0/438304705 learned_addr learned my addr 172.21.15.78:0/438304705 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:33.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd862b2a700 1 --2- 172.21.15.78:0/438304705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0c5810 0x7fd85c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd861b28700 1 -- 172.21.15.78:0/438304705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0c5810 msgr2=0x7fd85c0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:33.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd861b28700 1 --2- 172.21.15.78:0/438304705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0c5810 0x7fd85c0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd861b28700 1 -- 172.21.15.78:0/438304705 >> v1:172.21.15.78:6789/0 conn(0x7fd85c0aa0f0 legacy=0x7fd85c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.462+0000 7fd861327700 1 -- 172.21.15.78:0/438304705 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818117378 0 0) 0x7fd85c0649b0 con 0x7fd85c0aa0f0 2023-08-17T18:10:33.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd861b28700 1 -- 172.21.15.78:0/438304705 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c063700 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd862b2a700 1 --2- 172.21.15.78:0/438304705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0c5810 0x7fd85c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:33.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd861b28700 1 --2- 172.21.15.78:0/438304705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 0x7fd85c0644c0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7fd84c009760 tx=0x7fd84c009060).ready entity=mon.0 client_cookie=55ad9134957b3528 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:33.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd861327700 1 -- 172.21.15.78:0/438304705 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00b580 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd861327700 1 -- 172.21.15.78:0/438304705 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c00b6e0 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd861327700 1 -- 172.21.15.78:0/438304705 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00ba60 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd86458d700 1 -- 172.21.15.78:0/438304705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 msgr2=0x7fd85c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd86458d700 1 --2- 172.21.15.78:0/438304705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 0x7fd85c0644c0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7fd84c009760 tx=0x7fd84c009060).stop 2023-08-17T18:10:33.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd86458d700 1 -- 172.21.15.78:0/438304705 shutdown_connections 2023-08-17T18:10:33.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd86458d700 1 --2- 172.21.15.78:0/438304705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0c5810 0x7fd85c0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd86458d700 1 --2- 172.21.15.78:0/438304705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 0x7fd85c0644c0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd86458d700 1 -- 172.21.15.78:0/438304705 >> 172.21.15.78:0/438304705 conn(0x7fd85c06a6a0 msgr2=0x7fd85c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:33.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd86458d700 1 -- 172.21.15.78:0/438304705 shutdown_connections 2023-08-17T18:10:33.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.463+0000 7fd86458d700 1 -- 172.21.15.78:0/438304705 wait complete. 2023-08-17T18:10:33.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.464+0000 7fd86458d700 1 Processor -- start 2023-08-17T18:10:33.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.465+0000 7fd86458d700 1 -- start start 2023-08-17T18:10:33.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.465+0000 7fd86458d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0aa0f0 0x7fd85c0ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.465+0000 7fd86458d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 0x7fd85c164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.465+0000 7fd86458d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c0c5810 0x7fd85c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.465+0000 7fd86458d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0c1df0 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.465+0000 7fd86458d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0c1ac0 con 0x7fd85c0c5810 2023-08-17T18:10:33.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.465+0000 7fd86458d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0ac1b0 con 0x7fd85c0aa0f0 2023-08-17T18:10:33.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.465+0000 7fd861b28700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 0x7fd85c164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.465+0000 7fd861b28700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 0x7fd85c164300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38754/0 (socket says 172.21.15.78:38754) 2023-08-17T18:10:33.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.465+0000 7fd861b28700 1 -- 172.21.15.78:0/2759668469 learned_addr learned my addr 172.21.15.78:0/2759668469 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:33.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd862b2a700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c0c5810 0x7fd85c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd862329700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0aa0f0 0x7fd85c0ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd861b28700 1 -- 172.21.15.78:0/2759668469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0aa0f0 msgr2=0x7fd85c0ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd861b28700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0aa0f0 0x7fd85c0ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd861b28700 1 -- 172.21.15.78:0/2759668469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c0c5810 msgr2=0x7fd85c151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd861b28700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c0c5810 0x7fd85c151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd861b28700 1 -- 172.21.15.78:0/2759668469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0092a0 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd862b2a700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c0c5810 0x7fd85c151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:33.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd861b28700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 0x7fd85c164300 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7fd85c0c5520 tx=0x7fd84c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:33.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd8527fc700 1 -- 172.21.15.78:0/2759668469 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00b850 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd8527fc700 1 -- 172.21.15.78:0/2759668469 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c00b9b0 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd8527fc700 1 -- 172.21.15.78:0/2759668469 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c01b660 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd86458d700 1 -- 172.21.15.78:0/2759668469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c0ac490 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.466+0000 7fd86458d700 1 -- 172.21.15.78:0/2759668469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c0abe70 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.467+0000 7fd86458d700 1 -- 172.21.15.78:0/2759668469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c0c1f60 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.467+0000 7fd8527fc700 1 -- 172.21.15.78:0/2759668469 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd84c02b070 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.467+0000 7fd8527fc700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd84005ed90 0x7fd840061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.468+0000 7fd8527fc700 1 -- 172.21.15.78:0/2759668469 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd84c07b260 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.468+0000 7fd862329700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd84005ed90 0x7fd840061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.468+0000 7fd862329700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd84005ed90 0x7fd840061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd858007fd0 tx=0x7fd858009040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:33.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.472+0000 7fd8527fc700 1 -- 172.21.15.78:0/2759668469 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd84c04cb50 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.634+0000 7fd86458d700 1 -- 172.21.15.78:0/2759668469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fd85c046af0 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.755+0000 7fd8527fc700 1 -- 172.21.15.78:0/2759668469 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v165) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd84c0290c0 con 0x7fd85c0aa4d0 2023-08-17T18:10:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.759+0000 7fd86458d700 1 -- 172.21.15.78:0/2759668469 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd84005ed90 msgr2=0x7fd840061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.759+0000 7fd86458d700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd84005ed90 0x7fd840061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd858007fd0 tx=0x7fd858009040).stop 2023-08-17T18:10:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.759+0000 7fd86458d700 1 -- 172.21.15.78:0/2759668469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 msgr2=0x7fd85c164300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.759+0000 7fd86458d700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 0x7fd85c164300 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7fd85c0c5520 tx=0x7fd84c017000).stop 2023-08-17T18:10:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.760+0000 7fd86458d700 1 -- 172.21.15.78:0/2759668469 shutdown_connections 2023-08-17T18:10:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.760+0000 7fd86458d700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd84005ed90 0x7fd840061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.760+0000 7fd86458d700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd85c0c5810 0x7fd85c151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.760+0000 7fd86458d700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd85c0aa0f0 0x7fd85c0ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.760+0000 7fd86458d700 1 --2- 172.21.15.78:0/2759668469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd85c0aa4d0 0x7fd85c164300 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.760+0000 7fd86458d700 1 -- 172.21.15.78:0/2759668469 >> 172.21.15.78:0/2759668469 conn(0x7fd85c06a6a0 msgr2=0x7fd85c0b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.761+0000 7fd86458d700 1 -- 172.21.15.78:0/2759668469 shutdown_connections 2023-08-17T18:10:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.761+0000 7fd86458d700 1 -- 172.21.15.78:0/2759668469 wait complete. 2023-08-17T18:10:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T18:10:33.775 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T18:10:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.894+0000 7f54db327700 1 Processor -- start 2023-08-17T18:10:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.894+0000 7f54db327700 1 -- start start 2023-08-17T18:10:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54db327700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54d4154110 0x7f54d40c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54db327700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f54d40c0cf0 0x7f54d40c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54db327700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40ca430 0x7f54d40c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54db327700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d40c6970 con 0x7f54d40c0cf0 2023-08-17T18:10:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54db327700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d40c1150 con 0x7f54d4154110 2023-08-17T18:10:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54db327700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40cac90 con 0x7f54d40ca430 2023-08-17T18:10:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d88c2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f54d40c0cf0 0x7f54d40c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d88c2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f54d40c0cf0 0x7f54d40c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38766/0 (socket says 172.21.15.78:38766) 2023-08-17T18:10:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d88c2700 1 -- 172.21.15.78:0/2494951549 learned_addr learned my addr 172.21.15.78:0/2494951549 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d88c2700 1 -- 172.21.15.78:0/2494951549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40ca430 msgr2=0x7f54d40c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d88c2700 1 --2- 172.21.15.78:0/2494951549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40ca430 0x7f54d40c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d88c2700 1 -- 172.21.15.78:0/2494951549 >> v2:172.21.15.150:3300/0 conn(0x7f54d4154110 msgr2=0x7f54d40c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d90c3700 1 --2- 172.21.15.78:0/2494951549 >> v2:172.21.15.150:3300/0 conn(0x7f54d4154110 0x7f54d40c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d88c2700 1 --2- 172.21.15.78:0/2494951549 >> v2:172.21.15.150:3300/0 conn(0x7f54d4154110 0x7f54d40c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d88c2700 1 -- 172.21.15.78:0/2494951549 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d40c6040 con 0x7f54d40c0cf0 2023-08-17T18:10:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d90c3700 1 --2- 172.21.15.78:0/2494951549 >> v2:172.21.15.150:3300/0 conn(0x7f54d4154110 0x7f54d40c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54d88c2700 1 --2- 172.21.15.78:0/2494951549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40c0cf0 0x7f54d40c9f40 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f54d4065650 tx=0x7f54c40090f0).ready entity=mon.0 client_cookie=24487578110f0534 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54cbfff700 1 -- 172.21.15.78:0/2494951549 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c400b600 con 0x7f54d40c0cf0 2023-08-17T18:10:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54cbfff700 1 -- 172.21.15.78:0/2494951549 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c400b760 con 0x7f54d40c0cf0 2023-08-17T18:10:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.895+0000 7f54cbfff700 1 -- 172.21.15.78:0/2494951549 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c400bae0 con 0x7f54d40c0cf0 2023-08-17T18:10:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.896+0000 7f54db327700 1 -- 172.21.15.78:0/2494951549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40c0cf0 msgr2=0x7f54d40c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.896+0000 7f54db327700 1 --2- 172.21.15.78:0/2494951549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40c0cf0 0x7f54d40c9f40 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f54d4065650 tx=0x7f54c40090f0).stop 2023-08-17T18:10:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.896+0000 7f54db327700 1 -- 172.21.15.78:0/2494951549 shutdown_connections 2023-08-17T18:10:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.896+0000 7f54db327700 1 --2- 172.21.15.78:0/2494951549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40ca430 0x7f54d40c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.896+0000 7f54db327700 1 --2- 172.21.15.78:0/2494951549 >> v2:172.21.15.150:3300/0 conn(0x7f54d4154110 0x7f54d40c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.896+0000 7f54db327700 1 --2- 172.21.15.78:0/2494951549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40c0cf0 0x7f54d40c9f40 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.896+0000 7f54db327700 1 -- 172.21.15.78:0/2494951549 >> 172.21.15.78:0/2494951549 conn(0x7f54d4094650 msgr2=0x7f54d406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.896+0000 7f54db327700 1 -- 172.21.15.78:0/2494951549 shutdown_connections 2023-08-17T18:10:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.896+0000 7f54db327700 1 -- 172.21.15.78:0/2494951549 wait complete. 2023-08-17T18:10:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.897+0000 7f54db327700 1 Processor -- start 2023-08-17T18:10:33.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.897+0000 7f54db327700 1 -- start start 2023-08-17T18:10:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54db327700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40c0cf0 0x7f54d4148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54db327700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40ca430 0x7f54d4095d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54db327700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d4154110 0x7f54d40c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54db327700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4098b90 con 0x7f54d40ca430 2023-08-17T18:10:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54db327700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4097af0 con 0x7f54d4154110 2023-08-17T18:10:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54db327700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4097dd0 con 0x7f54d40c0cf0 2023-08-17T18:10:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54d88c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40ca430 0x7f54d4095d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54d88c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40ca430 0x7f54d4095d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38772/0 (socket says 172.21.15.78:38772) 2023-08-17T18:10:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54d88c2700 1 -- 172.21.15.78:0/1046015686 learned_addr learned my addr 172.21.15.78:0/1046015686 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54d90c3700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40c0cf0 0x7f54d4148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.898+0000 7f54d98c4700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d4154110 0x7f54d40c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54d88c2700 1 -- 172.21.15.78:0/1046015686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40c0cf0 msgr2=0x7f54d4148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54d88c2700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40c0cf0 0x7f54d4148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54d88c2700 1 -- 172.21.15.78:0/1046015686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d4154110 msgr2=0x7f54d40c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54d88c2700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d4154110 0x7f54d40c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54d88c2700 1 -- 172.21.15.78:0/1046015686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4009370 con 0x7f54d40ca430 2023-08-17T18:10:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54d98c4700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d4154110 0x7f54d40c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54d88c2700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40ca430 0x7f54d4095d40 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f54c4006fd0 tx=0x7f54c4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54c97fa700 1 -- 172.21.15.78:0/1046015686 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c400b8d0 con 0x7f54d40ca430 2023-08-17T18:10:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54c97fa700 1 -- 172.21.15.78:0/1046015686 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c400ba30 con 0x7f54d40ca430 2023-08-17T18:10:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54c97fa700 1 -- 172.21.15.78:0/1046015686 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c401b690 con 0x7f54d40ca430 2023-08-17T18:10:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54db327700 1 -- 172.21.15.78:0/1046015686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d40980b0 con 0x7f54d40ca430 2023-08-17T18:10:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.899+0000 7f54db327700 1 -- 172.21.15.78:0/1046015686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d4098670 con 0x7f54d40ca430 2023-08-17T18:10:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.900+0000 7f54db327700 1 -- 172.21.15.78:0/1046015686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d4098860 con 0x7f54d40ca430 2023-08-17T18:10:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.900+0000 7f54c97fa700 1 -- 172.21.15.78:0/1046015686 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f54c400f070 con 0x7f54d40ca430 2023-08-17T18:10:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.901+0000 7f54c97fa700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f54b805ed90 0x7f54b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.901+0000 7f54c97fa700 1 -- 172.21.15.78:0/1046015686 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f54c407af60 con 0x7f54d40ca430 2023-08-17T18:10:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.901+0000 7f54d90c3700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f54b805ed90 0x7f54b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:33.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.901+0000 7f54d90c3700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f54b805ed90 0x7f54b8061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f54d4151070 tx=0x7f54d0007850).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:33.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:33.905+0000 7f54c97fa700 1 -- 172.21.15.78:0/1046015686 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54c40a98f0 con 0x7f54d40ca430 2023-08-17T18:10:34.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.067+0000 7f54db327700 1 -- 172.21.15.78:0/1046015686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f54d4047350 con 0x7f54d40ca430 2023-08-17T18:10:34.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.759+0000 7f54c97fa700 1 -- 172.21.15.78:0/1046015686 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v166) v1 ==== 170+0+0 (secure 0 0 0) 0x7f54c404c810 con 0x7f54d40ca430 2023-08-17T18:10:34.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.762+0000 7f54db327700 1 -- 172.21.15.78:0/1046015686 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f54b805ed90 msgr2=0x7f54b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:34.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.762+0000 7f54db327700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f54b805ed90 0x7f54b8061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f54d4151070 tx=0x7f54d0007850).stop 2023-08-17T18:10:34.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.762+0000 7f54db327700 1 -- 172.21.15.78:0/1046015686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40ca430 msgr2=0x7f54d4095d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:34.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.763+0000 7f54db327700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40ca430 0x7f54d4095d40 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f54c4006fd0 tx=0x7f54c4017000).stop 2023-08-17T18:10:34.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.765+0000 7f54db327700 1 -- 172.21.15.78:0/1046015686 shutdown_connections 2023-08-17T18:10:34.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.765+0000 7f54db327700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f54b805ed90 0x7f54b8061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:34.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.765+0000 7f54db327700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d4154110 0x7f54d40c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:34.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.765+0000 7f54db327700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40c0cf0 0x7f54d4148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:34.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.765+0000 7f54db327700 1 --2- 172.21.15.78:0/1046015686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d40ca430 0x7f54d4095d40 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:34.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.765+0000 7f54db327700 1 -- 172.21.15.78:0/1046015686 >> 172.21.15.78:0/1046015686 conn(0x7f54d4094650 msgr2=0x7f54d40c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:34.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.767+0000 7f54db327700 1 -- 172.21.15.78:0/1046015686 shutdown_connections 2023-08-17T18:10:34.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.768+0000 7f54db327700 1 -- 172.21.15.78:0/1046015686 wait complete. 2023-08-17T18:10:34.772 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T18:10:34.790 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T18:10:34.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.906+0000 7f252b59e700 1 Processor -- start 2023-08-17T18:10:34.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.906+0000 7f252b59e700 1 -- start start 2023-08-17T18:10:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f252c151e20 0x7f252c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252b59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c0c6620 con 0x7f252c151a40 2023-08-17T18:10:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c0c6900 con 0x7f252c157be0 2023-08-17T18:10:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0c6be0 con 0x7f252c151e20 2023-08-17T18:10:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252a59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f252c151a40 0x7f252c0c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45016/0 (socket says 172.21.15.78:45016) 2023-08-17T18:10:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252a59c700 1 -- 172.21.15.78:0/4123439747 learned_addr learned my addr 172.21.15.78:0/4123439747 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:34.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f2529d9b700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f252c151e20 0x7f252c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:34.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064683016 0 0) 0x7f252c0c6620 con 0x7f252c151a40 2023-08-17T18:10:34.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25180033f0 con 0x7f252c151a40 2023-08-17T18:10:34.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3156084768 0 0) 0x7f25180033f0 con 0x7f252c151a40 2023-08-17T18:10:34.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f252c151e20 msgr2=0x7f252c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:34.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f252c151e20 0x7f252c0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:34.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 >> v1:172.21.15.150:6789/0 conn(0x7f252c157be0 legacy=0x7f252c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:34.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c0c6ec0 con 0x7f252c151a40 2023-08-17T18:10:34.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f2524001970 con 0x7f252c151a40 2023-08-17T18:10:34.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 >> v1:172.21.15.78:6789/0 conn(0x7f252c151a40 legacy=0x7f252c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:34.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f252c151e20 0x7f2518003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:34.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003e00 0x7f2518004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:34.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2518004b80 0x7f2518005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:34.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0c6be0 con 0x7f2518003e00 2023-08-17T18:10:34.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251800b8e0 con 0x7f2518004b80 2023-08-17T18:10:34.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.907+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251800baa0 con 0x7f252c151e20 2023-08-17T18:10:34.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f2529d9b700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003e00 0x7f2518004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:34.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f252a59c700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f252c151e20 0x7f2518003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:34.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f252ad9d700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2518004b80 0x7f2518005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:34.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f2529d9b700 1 -- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f252c151e20 msgr2=0x7f2518003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:34.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f2529d9b700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f252c151e20 0x7f2518003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:34.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f2529d9b700 1 -- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2518004b80 msgr2=0x7f2518005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:34.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f2529d9b700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2518004b80 0x7f2518005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:34.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f2529d9b700 1 -- 172.21.15.78:0/4123439747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180033f0 con 0x7f2518003e00 2023-08-17T18:10:34.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f2529d9b700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003e00 0x7f2518004690 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7f2514006fd0 tx=0x7f2514006f40).ready entity=mon.0 client_cookie=38f82a5075642a81 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:34.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514009430 con 0x7f2518003e00 2023-08-17T18:10:34.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400e640 con 0x7f2518003e00 2023-08-17T18:10:34.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.908+0000 7f252959a700 1 -- 172.21.15.78:0/4123439747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400e9c0 con 0x7f2518003e00 2023-08-17T18:10:34.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.909+0000 7f252b59e700 1 -- 172.21.15.78:0/4123439747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003e00 msgr2=0x7f2518004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:34.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.909+0000 7f252b59e700 1 --2- 172.21.15.78:0/4123439747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003e00 0x7f2518004690 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7f2514006fd0 tx=0x7f2514006f40).stop 2023-08-17T18:10:34.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.909+0000 7f252ad9d700 1 -- 172.21.15.78:0/4123439747 reap_dead start 2023-08-17T18:10:34.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.909+0000 7f252b59e700 1 -- 172.21.15.78:0/4123439747 shutdown_connections 2023-08-17T18:10:34.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.909+0000 7f252b59e700 1 -- 172.21.15.78:0/4123439747 >> 172.21.15.78:0/4123439747 conn(0x7f252c0943b0 msgr2=0x7f252c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:34.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.909+0000 7f252b59e700 1 -- 172.21.15.78:0/4123439747 shutdown_connections 2023-08-17T18:10:34.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.909+0000 7f252b59e700 1 -- 172.21.15.78:0/4123439747 wait complete. 2023-08-17T18:10:34.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.910+0000 7f252b59e700 1 Processor -- start 2023-08-17T18:10:34.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.910+0000 7f252b59e700 1 -- start start 2023-08-17T18:10:34.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.910+0000 7f252b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2518003e00 0x7f252c0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:34.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.910+0000 7f252b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f252c0c30d0 0x7f252c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:34.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f252c156da0 0x7f252c0c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:34.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252b59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0c3640 con 0x7f252c156da0 2023-08-17T18:10:34.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0c3920 con 0x7f252c0c30d0 2023-08-17T18:10:34.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c0c3c00 con 0x7f2518003e00 2023-08-17T18:10:34.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f252c156da0 0x7f252c0c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:34.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f252c156da0 0x7f252c0c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38792/0 (socket says 172.21.15.78:38792) 2023-08-17T18:10:34.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252ad9d700 1 -- 172.21.15.78:0/3256610495 learned_addr learned my addr 172.21.15.78:0/3256610495 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:34.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f2529d9b700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f252c0c30d0 0x7f252c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:34.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252a59c700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2518003e00 0x7f252c0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:34.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252ad9d700 1 -- 172.21.15.78:0/3256610495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2518003e00 msgr2=0x7f252c0a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:34.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252ad9d700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2518003e00 0x7f252c0a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:34.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252ad9d700 1 -- 172.21.15.78:0/3256610495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f252c0c30d0 msgr2=0x7f252c1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:34.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252ad9d700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f252c0c30d0 0x7f252c1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:34.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252ad9d700 1 -- 172.21.15.78:0/3256610495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c0c3ee0 con 0x7f252c156da0 2023-08-17T18:10:34.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252ad9d700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f252c156da0 0x7f252c0c1d80 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f252c0aa020 tx=0x7f251c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:34.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f25227fc700 1 -- 172.21.15.78:0/3256610495 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c00f690 con 0x7f252c156da0 2023-08-17T18:10:34.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f25227fc700 1 -- 172.21.15.78:0/3256610495 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c00f7f0 con 0x7f252c156da0 2023-08-17T18:10:34.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252b59e700 1 -- 172.21.15.78:0/3256610495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c0c41c0 con 0x7f252c156da0 2023-08-17T18:10:34.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f25227fc700 1 -- 172.21.15.78:0/3256610495 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c00fb70 con 0x7f252c156da0 2023-08-17T18:10:34.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.911+0000 7f252b59e700 1 -- 172.21.15.78:0/3256610495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c0c46e0 con 0x7f252c156da0 2023-08-17T18:10:34.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.912+0000 7f252b59e700 1 -- 172.21.15.78:0/3256610495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c082f90 con 0x7f252c156da0 2023-08-17T18:10:34.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.913+0000 7f25227fc700 1 -- 172.21.15.78:0/3256610495 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f251c01b030 con 0x7f252c156da0 2023-08-17T18:10:34.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.913+0000 7f25227fc700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f250c05ed90 0x7f250c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:34.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.913+0000 7f25227fc700 1 -- 172.21.15.78:0/3256610495 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f251c0795f0 con 0x7f252c156da0 2023-08-17T18:10:34.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.913+0000 7f252a59c700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f250c05ed90 0x7f250c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:34.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.913+0000 7f252a59c700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f250c05ed90 0x7f250c061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f25240011d0 tx=0x7f2524009040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:34.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:34.917+0000 7f25227fc700 1 -- 172.21.15.78:0/3256610495 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f251c04aca0 con 0x7f252c156da0 2023-08-17T18:10:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.121+0000 7f252b59e700 1 -- 172.21.15.78:0/3256610495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f252c0c43b0 con 0x7f252c156da0 2023-08-17T18:10:35.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.125+0000 7f25227fc700 1 -- 172.21.15.78:0/3256610495 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7f251c04e2c0 con 0x7f252c156da0 2023-08-17T18:10:35.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.133+0000 7f252b59e700 1 -- 172.21.15.78:0/3256610495 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f250c05ed90 msgr2=0x7f250c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.133+0000 7f252b59e700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f250c05ed90 0x7f250c061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f25240011d0 tx=0x7f2524009040).stop 2023-08-17T18:10:35.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.133+0000 7f252b59e700 1 -- 172.21.15.78:0/3256610495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f252c156da0 msgr2=0x7f252c0c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.133+0000 7f252b59e700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f252c156da0 0x7f252c0c1d80 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f252c0aa020 tx=0x7f251c007bb0).stop 2023-08-17T18:10:35.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.134+0000 7f252b59e700 1 -- 172.21.15.78:0/3256610495 shutdown_connections 2023-08-17T18:10:35.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.134+0000 7f252b59e700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f250c05ed90 0x7f250c061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.134+0000 7f252b59e700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f252c156da0 0x7f252c0c1d80 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.134+0000 7f252b59e700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2518003e00 0x7f252c0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.134+0000 7f252b59e700 1 --2- 172.21.15.78:0/3256610495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f252c0c30d0 0x7f252c1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.134+0000 7f252b59e700 1 -- 172.21.15.78:0/3256610495 >> 172.21.15.78:0/3256610495 conn(0x7f252c0943b0 msgr2=0x7f252c0bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:35.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.135+0000 7f252b59e700 1 -- 172.21.15.78:0/3256610495 shutdown_connections 2023-08-17T18:10:35.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.135+0000 7f252b59e700 1 -- 172.21.15.78:0/3256610495 wait complete. 2023-08-17T18:10:35.145 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 21 and data pool 22 2023-08-17T18:10:35.159 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:10:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.271+0000 7fde6e28f700 1 Processor -- start 2023-08-17T18:10:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.271+0000 7fde6e28f700 1 -- start start 2023-08-17T18:10:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.272+0000 7fde6e28f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680c6ee0 0x7fde680c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.272+0000 7fde6e28f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde680a8350 con 0x7fde68154140 2023-08-17T18:10:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.272+0000 7fde6e28f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde680c7320 con 0x7fde680c0df0 2023-08-17T18:10:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.272+0000 7fde6e28f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde680c1280 con 0x7fde680c6ee0 2023-08-17T18:10:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.272+0000 7fde67fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fde68154140 0x7fde680a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45032/0 (socket says 172.21.15.78:45032) 2023-08-17T18:10:35.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.272+0000 7fde67fff700 1 -- 172.21.15.78:0/2109736565 learned_addr learned my addr 172.21.15.78:0/2109736565 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.272+0000 7fde677fe700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680c6ee0 0x7fde680c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.272+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412734762 0 0) 0x7fde680a8350 con 0x7fde68154140 2023-08-17T18:10:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.272+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde500033f0 con 0x7fde68154140 2023-08-17T18:10:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079511122 0 0) 0x7fde680c7320 con 0x7fde680c0df0 2023-08-17T18:10:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde680a8350 con 0x7fde680c0df0 2023-08-17T18:10:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2512030475 0 0) 0x7fde500033f0 con 0x7fde68154140 2023-08-17T18:10:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680c6ee0 msgr2=0x7fde680c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680c6ee0 0x7fde680c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 >> v1:172.21.15.150:6789/0 conn(0x7fde680c0df0 legacy=0x7fde680ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde68154520 con 0x7fde68154140 2023-08-17T18:10:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fde58001470 con 0x7fde68154140 2023-08-17T18:10:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 >> v1:172.21.15.78:6789/0 conn(0x7fde68154140 legacy=0x7fde680a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680c6ee0 0x7fde50003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50003fb0 0x7fde50004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde50004b80 0x7fde50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680c1280 con 0x7fde50004b80 2023-08-17T18:10:35.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5000b990 con 0x7fde50003fb0 2023-08-17T18:10:35.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5000bb50 con 0x7fde680c6ee0 2023-08-17T18:10:35.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde6c82c700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde50004b80 0x7fde50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde67fff700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680c6ee0 0x7fde50003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde677fe700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50003fb0 0x7fde50004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde6c82c700 1 -- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680c6ee0 msgr2=0x7fde50003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde6c82c700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680c6ee0 0x7fde50003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde6c82c700 1 -- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50003fb0 msgr2=0x7fde50004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde6c82c700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50003fb0 0x7fde50004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde6c82c700 1 -- 172.21.15.78:0/2109736565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500033f0 con 0x7fde50004b80 2023-08-17T18:10:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde6c82c700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde50004b80 0x7fde50005000 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7fde60001f90 tx=0x7fde60007f30).ready entity=mon.0 client_cookie=5f9a7187aac1e5d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde600020f0 con 0x7fde50004b80 2023-08-17T18:10:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde60006a20 con 0x7fde50004b80 2023-08-17T18:10:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.273+0000 7fde66ffd700 1 -- 172.21.15.78:0/2109736565 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60006dc0 con 0x7fde50004b80 2023-08-17T18:10:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.274+0000 7fde6e28f700 1 -- 172.21.15.78:0/2109736565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde50004b80 msgr2=0x7fde50005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.274+0000 7fde6e28f700 1 --2- 172.21.15.78:0/2109736565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde50004b80 0x7fde50005000 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7fde60001f90 tx=0x7fde60007f30).stop 2023-08-17T18:10:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.274+0000 7fde6c82c700 1 -- 172.21.15.78:0/2109736565 reap_dead start 2023-08-17T18:10:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.274+0000 7fde6e28f700 1 -- 172.21.15.78:0/2109736565 shutdown_connections 2023-08-17T18:10:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.274+0000 7fde6e28f700 1 -- 172.21.15.78:0/2109736565 >> 172.21.15.78:0/2109736565 conn(0x7fde68094510 msgr2=0x7fde6806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.274+0000 7fde6e28f700 1 -- 172.21.15.78:0/2109736565 shutdown_connections 2023-08-17T18:10:35.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.274+0000 7fde6e28f700 1 -- 172.21.15.78:0/2109736565 wait complete. 2023-08-17T18:10:35.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.275+0000 7fde6e28f700 1 Processor -- start 2023-08-17T18:10:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.275+0000 7fde6e28f700 1 -- start start 2023-08-17T18:10:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6e28f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde680ae670 0x7fde680b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6e28f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680adf50 0x7fde680aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6e28f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde680aef40 0x7fde680c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6e28f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680acbf0 con 0x7fde680aef40 2023-08-17T18:10:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6e28f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680ac310 con 0x7fde680ae670 2023-08-17T18:10:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6e28f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde68164420 con 0x7fde680adf50 2023-08-17T18:10:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6c82c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde680aef40 0x7fde680c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6c82c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde680aef40 0x7fde680c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38814/0 (socket says 172.21.15.78:38814) 2023-08-17T18:10:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6c82c700 1 -- 172.21.15.78:0/1356799759 learned_addr learned my addr 172.21.15.78:0/1356799759 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde67fff700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde680ae670 0x7fde680b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde677fe700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680adf50 0x7fde680aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6c82c700 1 -- 172.21.15.78:0/1356799759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680adf50 msgr2=0x7fde680aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6c82c700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680adf50 0x7fde680aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6c82c700 1 -- 172.21.15.78:0/1356799759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde680ae670 msgr2=0x7fde680b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6c82c700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde680ae670 0x7fde680b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.276+0000 7fde6c82c700 1 -- 172.21.15.78:0/1356799759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680ae3d0 con 0x7fde680aef40 2023-08-17T18:10:35.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.277+0000 7fde6c82c700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde680aef40 0x7fde680c3710 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7fde60001760 tx=0x7fde60016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:35.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.277+0000 7fde4ffff700 1 -- 172.21.15.78:0/1356799759 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60012610 con 0x7fde680aef40 2023-08-17T18:10:35.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.277+0000 7fde4ffff700 1 -- 172.21.15.78:0/1356799759 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde60012770 con 0x7fde680aef40 2023-08-17T18:10:35.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.277+0000 7fde6e28f700 1 -- 172.21.15.78:0/1356799759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde680b0cd0 con 0x7fde680aef40 2023-08-17T18:10:35.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.277+0000 7fde4ffff700 1 -- 172.21.15.78:0/1356799759 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60012b10 con 0x7fde680aef40 2023-08-17T18:10:35.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.277+0000 7fde6e28f700 1 -- 172.21.15.78:0/1356799759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde680ac880 con 0x7fde680aef40 2023-08-17T18:10:35.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.278+0000 7fde6e28f700 1 -- 172.21.15.78:0/1356799759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6806b590 con 0x7fde680aef40 2023-08-17T18:10:35.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.278+0000 7fde4ffff700 1 -- 172.21.15.78:0/1356799759 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fde6001b040 con 0x7fde680aef40 2023-08-17T18:10:35.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.278+0000 7fde4ffff700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fde5405edc0 0x7fde54061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.278+0000 7fde4ffff700 1 -- 172.21.15.78:0/1356799759 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fde6007a5d0 con 0x7fde680aef40 2023-08-17T18:10:35.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.279+0000 7fde67fff700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fde5405edc0 0x7fde54061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.279+0000 7fde67fff700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fde5405edc0 0x7fde54061280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fde58001200 tx=0x7fde58001df0).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:35.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.282+0000 7fde4ffff700 1 -- 172.21.15.78:0/1356799759 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde6004bb10 con 0x7fde680aef40 2023-08-17T18:10:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.445+0000 7fde6e28f700 1 -- 172.21.15.78:0/1356799759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde68047350 con 0x7fde680aef40 2023-08-17T18:10:35.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.446+0000 7fde4ffff700 1 -- 172.21.15.78:0/1356799759 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+17004 (secure 0 0 0) 0x7fde60023020 con 0x7fde680aef40 2023-08-17T18:10:35.448 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:35.448 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":167,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:10:35.122710+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:10:33.660535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T18:10:34.093770+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:10:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 -- 172.21.15.78:0/1356799759 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fde5405edc0 msgr2=0x7fde54061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fde5405edc0 0x7fde54061280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fde58001200 tx=0x7fde58001df0).stop 2023-08-17T18:10:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 -- 172.21.15.78:0/1356799759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde680aef40 msgr2=0x7fde680c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde680aef40 0x7fde680c3710 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7fde60001760 tx=0x7fde60016000).stop 2023-08-17T18:10:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 -- 172.21.15.78:0/1356799759 shutdown_connections 2023-08-17T18:10:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fde5405edc0 0x7fde54061280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde680aef40 0x7fde680c3710 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde680ae670 0x7fde680b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 --2- 172.21.15.78:0/1356799759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680adf50 0x7fde680aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 -- 172.21.15.78:0/1356799759 >> 172.21.15.78:0/1356799759 conn(0x7fde68094510 msgr2=0x7fde68152810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 -- 172.21.15.78:0/1356799759 shutdown_connections 2023-08-17T18:10:35.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.448+0000 7fde6e28f700 1 -- 172.21.15.78:0/1356799759 wait complete. 2023-08-17T18:10:35.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:10:35.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.573+0000 7faa6d9c9700 1 Processor -- start 2023-08-17T18:10:35.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.573+0000 7faa6d9c9700 1 -- start start 2023-08-17T18:10:35.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa6d9c9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa68154140 0x7faa680c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa6d9c9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faa680c1010 0x7faa680ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa6d9c9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa68154520 con 0x7faa680a7c40 2023-08-17T18:10:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa6d9c9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa680c91e0 con 0x7faa68154140 2023-08-17T18:10:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa6d9c9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa680c94c0 con 0x7faa680c1010 2023-08-17T18:10:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa66ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa68154140 0x7faa680c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa66ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa68154140 0x7faa680c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38826/0 (socket says 172.21.15.78:38826) 2023-08-17T18:10:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa5e7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7faa680a7c40 0x7faa680c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45038/0 (socket says 172.21.15.78:45038) 2023-08-17T18:10:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa66ffd700 1 -- 172.21.15.78:0/488573317 learned_addr learned my addr 172.21.15.78:0/488573317 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa677fe700 1 --2- 172.21.15.78:0/488573317 >> v2:172.21.15.150:3300/0 conn(0x7faa680c1010 0x7faa680ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa66ffd700 1 -- 172.21.15.78:0/488573317 >> v2:172.21.15.150:3300/0 conn(0x7faa680c1010 msgr2=0x7faa680ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.574+0000 7faa66ffd700 1 --2- 172.21.15.78:0/488573317 >> v2:172.21.15.150:3300/0 conn(0x7faa680c1010 0x7faa680ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa66ffd700 1 -- 172.21.15.78:0/488573317 >> v1:172.21.15.78:6789/0 conn(0x7faa680a7c40 legacy=0x7faa680c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa66ffd700 1 -- 172.21.15.78:0/488573317 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680c97a0 con 0x7faa68154140 2023-08-17T18:10:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa66ffd700 1 --2- 172.21.15.78:0/488573317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa68154140 0x7faa680c6ee0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7faa680c00d0 tx=0x7faa580090f0).ready entity=mon.0 client_cookie=8a21a43f24cae2a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa667fc700 1 -- 172.21.15.78:0/488573317 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800f510 con 0x7faa68154140 2023-08-17T18:10:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa667fc700 1 -- 172.21.15.78:0/488573317 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5800f670 con 0x7faa68154140 2023-08-17T18:10:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa667fc700 1 -- 172.21.15.78:0/488573317 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800fa10 con 0x7faa68154140 2023-08-17T18:10:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa6d9c9700 1 -- 172.21.15.78:0/488573317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa68154140 msgr2=0x7faa680c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa6d9c9700 1 --2- 172.21.15.78:0/488573317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa68154140 0x7faa680c6ee0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7faa680c00d0 tx=0x7faa580090f0).stop 2023-08-17T18:10:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa6d9c9700 1 -- 172.21.15.78:0/488573317 shutdown_connections 2023-08-17T18:10:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa6d9c9700 1 --2- 172.21.15.78:0/488573317 >> v2:172.21.15.150:3300/0 conn(0x7faa680c1010 0x7faa680ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa6d9c9700 1 --2- 172.21.15.78:0/488573317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa68154140 0x7faa680c6ee0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa6d9c9700 1 -- 172.21.15.78:0/488573317 >> 172.21.15.78:0/488573317 conn(0x7faa68094510 msgr2=0x7faa6806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa6d9c9700 1 -- 172.21.15.78:0/488573317 shutdown_connections 2023-08-17T18:10:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.575+0000 7faa6d9c9700 1 -- 172.21.15.78:0/488573317 wait complete. 2023-08-17T18:10:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa6d9c9700 1 Processor -- start 2023-08-17T18:10:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa6d9c9700 1 -- start start 2023-08-17T18:10:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa6d9c9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa680a7c40 0x7faa680c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa6d9c9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa680c1010 0x7faa680982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa6d9c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa68154140 0x7faa6814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa6d9c9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa68098d90 con 0x7faa680a7c40 2023-08-17T18:10:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa6d9c9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680c3c70 con 0x7faa680c1010 2023-08-17T18:10:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa6d9c9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa68098ab0 con 0x7faa68154140 2023-08-17T18:10:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa66ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa680a7c40 0x7faa680c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa66ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa680a7c40 0x7faa680c29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38832/0 (socket says 172.21.15.78:38832) 2023-08-17T18:10:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.577+0000 7faa66ffd700 1 -- 172.21.15.78:0/3807678136 learned_addr learned my addr 172.21.15.78:0/3807678136 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa66ffd700 1 -- 172.21.15.78:0/3807678136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa68154140 msgr2=0x7faa6814ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa66ffd700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa68154140 0x7faa6814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa66ffd700 1 -- 172.21.15.78:0/3807678136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa680c1010 msgr2=0x7faa680982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa66ffd700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa680c1010 0x7faa680982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa66ffd700 1 -- 172.21.15.78:0/3807678136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58009370 con 0x7faa680a7c40 2023-08-17T18:10:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa66ffd700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa680a7c40 0x7faa680c29f0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7faa58006df0 tx=0x7faa58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa5f7fe700 1 -- 172.21.15.78:0/3807678136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58006950 con 0x7faa680a7c40 2023-08-17T18:10:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa5f7fe700 1 -- 172.21.15.78:0/3807678136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5800f7e0 con 0x7faa680a7c40 2023-08-17T18:10:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa6d9c9700 1 -- 172.21.15.78:0/3807678136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa680c3620 con 0x7faa680a7c40 2023-08-17T18:10:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa5f7fe700 1 -- 172.21.15.78:0/3807678136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800f970 con 0x7faa680a7c40 2023-08-17T18:10:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.578+0000 7faa6d9c9700 1 -- 172.21.15.78:0/3807678136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa68098790 con 0x7faa680a7c40 2023-08-17T18:10:35.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.579+0000 7faa6d9c9700 1 -- 172.21.15.78:0/3807678136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa68047350 con 0x7faa680a7c40 2023-08-17T18:10:35.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.579+0000 7faa5f7fe700 1 -- 172.21.15.78:0/3807678136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faa5800f070 con 0x7faa680a7c40 2023-08-17T18:10:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.580+0000 7faa5f7fe700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faa4805ed60 0x7faa48061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.580+0000 7faa5f7fe700 1 -- 172.21.15.78:0/3807678136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa5807b1a0 con 0x7faa680a7c40 2023-08-17T18:10:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.580+0000 7faa5e7fc700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faa4805ed60 0x7faa48061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.580+0000 7faa5e7fc700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faa4805ed60 0x7faa48061220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faa50007fd0 tx=0x7faa50007970).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.584+0000 7faa5f7fe700 1 -- 172.21.15.78:0/3807678136 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa5804c740 con 0x7faa680a7c40 2023-08-17T18:10:35.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.746+0000 7faa6d9c9700 1 -- 172.21.15.78:0/3807678136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa680c3f50 con 0x7faa680a7c40 2023-08-17T18:10:35.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.747+0000 7faa5f7fe700 1 -- 172.21.15.78:0/3807678136 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+17004 (secure 0 0 0) 0x7faa5802a070 con 0x7faa680a7c40 2023-08-17T18:10:35.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:35.749 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":167,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:10:35.122710+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:10:33.660535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T18:10:34.093770+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:10:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 -- 172.21.15.78:0/3807678136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faa4805ed60 msgr2=0x7faa48061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faa4805ed60 0x7faa48061220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faa50007fd0 tx=0x7faa50007970).stop 2023-08-17T18:10:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 -- 172.21.15.78:0/3807678136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa680a7c40 msgr2=0x7faa680c29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa680a7c40 0x7faa680c29f0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7faa58006df0 tx=0x7faa58017000).stop 2023-08-17T18:10:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 -- 172.21.15.78:0/3807678136 shutdown_connections 2023-08-17T18:10:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faa4805ed60 0x7faa48061220 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa68154140 0x7faa6814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa680a7c40 0x7faa680c29f0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 --2- 172.21.15.78:0/3807678136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa680c1010 0x7faa680982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 -- 172.21.15.78:0/3807678136 >> 172.21.15.78:0/3807678136 conn(0x7faa68094510 msgr2=0x7faa68151b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 -- 172.21.15.78:0/3807678136 shutdown_connections 2023-08-17T18:10:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.749+0000 7faa6d9c9700 1 -- 172.21.15.78:0/3807678136 wait complete. 2023-08-17T18:10:35.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T18:10:35.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.877+0000 7f2178cce700 1 Processor -- start 2023-08-17T18:10:35.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.877+0000 7f2178cce700 1 -- start start 2023-08-17T18:10:35.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.878+0000 7f2178cce700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f217413a870 0x7f21740624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.878+0000 7f2178cce700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21740629e0 0x7f21740c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.878+0000 7f2178cce700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2174062e70 con 0x7f217413a490 2023-08-17T18:10:35.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.878+0000 7f2178cce700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21740c29d0 con 0x7f217413a870 2023-08-17T18:10:35.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.878+0000 7f2178cce700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740c89f0 con 0x7f21740629e0 2023-08-17T18:10:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.878+0000 7f2169d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f217413a870 0x7f21740624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.878+0000 7f2172d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21740629e0 0x7f21740c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.878+0000 7f2169d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f217413a870 0x7f21740624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:33112/0 (socket says 172.21.15.78:33112) 2023-08-17T18:10:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.878+0000 7f2172d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21740629e0 0x7f21740c2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:54896/0 (socket says 172.21.15.78:54896) 2023-08-17T18:10:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.878+0000 7f2169d9b700 1 -- 172.21.15.78:0/1927689246 learned_addr learned my addr 172.21.15.78:0/1927689246 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.879+0000 7f2169d9b700 1 -- 172.21.15.78:0/1927689246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21740629e0 msgr2=0x7f21740c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.879+0000 7f2169d9b700 1 --2- 172.21.15.78:0/1927689246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21740629e0 0x7f21740c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.879+0000 7f2169d9b700 1 -- 172.21.15.78:0/1927689246 >> v1:172.21.15.150:6789/0 conn(0x7f217413a490 legacy=0x7f2174069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.879+0000 7f2169d9b700 1 -- 172.21.15.78:0/1927689246 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21740bcf10 con 0x7f217413a870 2023-08-17T18:10:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.879+0000 7f2172d9d700 1 --2- 172.21.15.78:0/1927689246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21740629e0 0x7f21740c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.879+0000 7f2169d9b700 1 --2- 172.21.15.78:0/1927689246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217413a870 0x7f21740624f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f215c006fd0 tx=0x7f215c0090f0).ready entity=mon.1 client_cookie=b6109df0a1a280f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.879+0000 7f2171d9b700 1 -- 172.21.15.78:0/1927689246 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c00b580 con 0x7f217413a870 2023-08-17T18:10:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.879+0000 7f2171d9b700 1 -- 172.21.15.78:0/1927689246 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c00b6e0 con 0x7f217413a870 2023-08-17T18:10:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.879+0000 7f2171d9b700 1 -- 172.21.15.78:0/1927689246 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c00ba60 con 0x7f217413a870 2023-08-17T18:10:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.880+0000 7f2178cce700 1 -- 172.21.15.78:0/1927689246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217413a870 msgr2=0x7f21740624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.880+0000 7f2178cce700 1 --2- 172.21.15.78:0/1927689246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217413a870 0x7f21740624f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f215c006fd0 tx=0x7f215c0090f0).stop 2023-08-17T18:10:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.880+0000 7f2178cce700 1 -- 172.21.15.78:0/1927689246 shutdown_connections 2023-08-17T18:10:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.880+0000 7f2178cce700 1 --2- 172.21.15.78:0/1927689246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21740629e0 0x7f21740c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.880+0000 7f2178cce700 1 --2- 172.21.15.78:0/1927689246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217413a870 0x7f21740624f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.880+0000 7f2178cce700 1 -- 172.21.15.78:0/1927689246 >> 172.21.15.78:0/1927689246 conn(0x7f21740c7bd0 msgr2=0x7f21740c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.880+0000 7f2178cce700 1 -- 172.21.15.78:0/1927689246 shutdown_connections 2023-08-17T18:10:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.880+0000 7f2178cce700 1 -- 172.21.15.78:0/1927689246 wait complete. 2023-08-17T18:10:35.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.881+0000 7f2178cce700 1 Processor -- start 2023-08-17T18:10:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.881+0000 7f2178cce700 1 -- start start 2023-08-17T18:10:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f2178cce700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21740629e0 0x7f21740bf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f2178cce700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f217413a490 0x7f21741324a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f2178cce700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217413a870 0x7f21741646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f2178cce700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21740be860 con 0x7f21740629e0 2023-08-17T18:10:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f2178cce700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21740bf7a0 con 0x7f217413a870 2023-08-17T18:10:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f2178cce700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21741651d0 con 0x7f217413a490 2023-08-17T18:10:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f217259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21740629e0 0x7f21740bf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f217259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21740629e0 0x7f21740bf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38836/0 (socket says 172.21.15.78:38836) 2023-08-17T18:10:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f217259c700 1 -- 172.21.15.78:0/3229970297 learned_addr learned my addr 172.21.15.78:0/3229970297 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f2169d9b700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f217413a490 0x7f21741324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f2172d9d700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217413a870 0x7f21741646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f217259c700 1 -- 172.21.15.78:0/3229970297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f217413a490 msgr2=0x7f21741324a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f217259c700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f217413a490 0x7f21741324a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f217259c700 1 -- 172.21.15.78:0/3229970297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217413a870 msgr2=0x7f21741646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f217259c700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217413a870 0x7f21741646c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f217259c700 1 -- 172.21.15.78:0/3229970297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c009a20 con 0x7f21740629e0 2023-08-17T18:10:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f217259c700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21740629e0 0x7f21740bf2b0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f216400c4f0 tx=0x7f2164007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f216affd700 1 -- 172.21.15.78:0/3229970297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164007020 con 0x7f21740629e0 2023-08-17T18:10:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f216affd700 1 -- 172.21.15.78:0/3229970297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164001e90 con 0x7f21740629e0 2023-08-17T18:10:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f216affd700 1 -- 172.21.15.78:0/3229970297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21640073d0 con 0x7f21740629e0 2023-08-17T18:10:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f2178cce700 1 -- 172.21.15.78:0/3229970297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c009370 con 0x7f21740629e0 2023-08-17T18:10:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.882+0000 7f2178cce700 1 -- 172.21.15.78:0/3229970297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21740beab0 con 0x7f21740629e0 2023-08-17T18:10:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.883+0000 7f2178cce700 1 -- 172.21.15.78:0/3229970297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21740c57d0 con 0x7f21740629e0 2023-08-17T18:10:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.884+0000 7f216affd700 1 -- 172.21.15.78:0/3229970297 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2164010070 con 0x7f21740629e0 2023-08-17T18:10:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.884+0000 7f216affd700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f215405ed90 0x7f2154061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.884+0000 7f216affd700 1 -- 172.21.15.78:0/3229970297 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2164079220 con 0x7f21740629e0 2023-08-17T18:10:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.884+0000 7f2169d9b700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f215405ed90 0x7f2154061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.884+0000 7f2169d9b700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f215405ed90 0x7f2154061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f215c009130 tx=0x7f215c017000).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:35.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:35.888+0000 7f216affd700 1 -- 172.21.15.78:0/3229970297 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f216404a7c0 con 0x7f21740629e0 2023-08-17T18:10:36.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.092+0000 7f2178cce700 1 -- 172.21.15.78:0/3229970297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f21740bf100 con 0x7f21740629e0 2023-08-17T18:10:36.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.126+0000 7f216affd700 1 -- 172.21.15.78:0/3229970297 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) v1 ==== 118+0+0 (secure 0 0 0) 0x7f216404dde0 con 0x7f21740629e0 2023-08-17T18:10:36.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 -- 172.21.15.78:0/3229970297 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f215405ed90 msgr2=0x7f2154061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:36.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f215405ed90 0x7f2154061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f215c009130 tx=0x7f215c017000).stop 2023-08-17T18:10:36.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 -- 172.21.15.78:0/3229970297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21740629e0 msgr2=0x7f21740bf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:36.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21740629e0 0x7f21740bf2b0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f216400c4f0 tx=0x7f2164007e00).stop 2023-08-17T18:10:36.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 -- 172.21.15.78:0/3229970297 shutdown_connections 2023-08-17T18:10:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f215405ed90 0x7f2154061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f217413a870 0x7f21741646c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21740629e0 0x7f21740bf2b0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 --2- 172.21.15.78:0/3229970297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f217413a490 0x7f21741324a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 -- 172.21.15.78:0/3229970297 >> 172.21.15.78:0/3229970297 conn(0x7f21740c7bd0 msgr2=0x7f21740a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 -- 172.21.15.78:0/3229970297 shutdown_connections 2023-08-17T18:10:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.128+0000 7f2178cce700 1 -- 172.21.15.78:0/3229970297 wait complete. 2023-08-17T18:10:36.141 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T18:10:36.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T18:10:36.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.256+0000 7f2c7b87c700 1 Processor -- start 2023-08-17T18:10:36.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.256+0000 7f2c7b87c700 1 -- start start 2023-08-17T18:10:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.257+0000 7f2c7b87c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c740c5f20 0x7f2c740644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.257+0000 7f2c7b87c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c740649b0 con 0x7f2c740aa4d0 2023-08-17T18:10:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.257+0000 7f2c7b87c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c74063420 con 0x7f2c740aa0f0 2023-08-17T18:10:36.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.257+0000 7f2c7b87c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c74063700 con 0x7f2c740c5f20 2023-08-17T18:10:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.257+0000 7f2c78e17700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2c740aa4d0 0x7f2c740c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45044/0 (socket says 172.21.15.78:45044) 2023-08-17T18:10:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.257+0000 7f2c78e17700 1 -- 172.21.15.78:0/1667249061 learned_addr learned my addr 172.21.15.78:0/1667249061 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:36.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.257+0000 7f2c79e19700 1 --2- 172.21.15.78:0/1667249061 >> v2:172.21.15.150:3300/0 conn(0x7f2c740c5f20 0x7f2c740644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:36.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.257+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701063186 0 0) 0x7f2c740649b0 con 0x7f2c740aa4d0 2023-08-17T18:10:36.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c600033f0 con 0x7f2c740aa4d0 2023-08-17T18:10:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192236118 0 0) 0x7f2c600033f0 con 0x7f2c740aa4d0 2023-08-17T18:10:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 >> v2:172.21.15.150:3300/0 conn(0x7f2c740c5f20 msgr2=0x7f2c740644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 --2- 172.21.15.78:0/1667249061 >> v2:172.21.15.150:3300/0 conn(0x7f2c740c5f20 0x7f2c740644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 >> v1:172.21.15.150:6789/0 conn(0x7f2c740aa0f0 legacy=0x7f2c740c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c740639e0 con 0x7f2c740aa4d0 2023-08-17T18:10:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f2c64001470 con 0x7f2c740aa4d0 2023-08-17T18:10:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 >> v1:172.21.15.78:6789/0 conn(0x7f2c740aa4d0 legacy=0x7f2c740c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c600038e0 0x7f2c60003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c60004690 0x7f2c60004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c6000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c74063700 con 0x7f2c60005000 2023-08-17T18:10:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6000beb0 con 0x7f2c600038e0 2023-08-17T18:10:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6000c070 con 0x7f2c60004690 2023-08-17T18:10:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c79e19700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c6000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c78e17700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c60004690 0x7f2c60004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:36.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c79618700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c600038e0 0x7f2c60003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:36.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c79e19700 1 -- 172.21.15.78:0/1667249061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c60004690 msgr2=0x7f2c60004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:36.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c79e19700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c60004690 0x7f2c60004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:36.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c79e19700 1 -- 172.21.15.78:0/1667249061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c600038e0 msgr2=0x7f2c60003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:36.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c79e19700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c600038e0 0x7f2c60003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:36.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c79e19700 1 -- 172.21.15.78:0/1667249061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c600033f0 con 0x7f2c60005000 2023-08-17T18:10:36.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c79618700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c600038e0 0x7f2c60003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:36.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c79e19700 1 -- 172.21.15.78:0/1667249061 reap_dead start 2023-08-17T18:10:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c79e19700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c6000b8e0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7f2c6c009a60 tx=0x7f2c6c009060).ready entity=mon.0 client_cookie=5bd84643387a3ed2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c009ea0 con 0x7f2c60005000 2023-08-17T18:10:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c009430 con 0x7f2c60005000 2023-08-17T18:10:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.258+0000 7f2c6bfff700 1 -- 172.21.15.78:0/1667249061 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00e850 con 0x7f2c60005000 2023-08-17T18:10:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.259+0000 7f2c7b87c700 1 -- 172.21.15.78:0/1667249061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 msgr2=0x7f2c6000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.259+0000 7f2c7b87c700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c6000b8e0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7f2c6c009a60 tx=0x7f2c6c009060).stop 2023-08-17T18:10:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.259+0000 7f2c7b87c700 1 -- 172.21.15.78:0/1667249061 shutdown_connections 2023-08-17T18:10:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.259+0000 7f2c7b87c700 1 --2- 172.21.15.78:0/1667249061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c6000b8e0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.259+0000 7f2c7b87c700 1 -- 172.21.15.78:0/1667249061 >> 172.21.15.78:0/1667249061 conn(0x7f2c7406a6a0 msgr2=0x7f2c740caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.259+0000 7f2c7b87c700 1 -- 172.21.15.78:0/1667249061 shutdown_connections 2023-08-17T18:10:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.259+0000 7f2c7b87c700 1 -- 172.21.15.78:0/1667249061 wait complete. 2023-08-17T18:10:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.260+0000 7f2c7b87c700 1 Processor -- start 2023-08-17T18:10:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.260+0000 7f2c7b87c700 1 -- start start 2023-08-17T18:10:36.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c7b87c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c74165550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:36.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c7b87c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c74165a90 0x7f2c7414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:36.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c7b87c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c7414f6d0 0x7f2c7414ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:36.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c7b87c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7414fb70 con 0x7f2c60005000 2023-08-17T18:10:36.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c7b87c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740af820 con 0x7f2c74165a90 2023-08-17T18:10:36.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c7b87c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740aeef0 con 0x7f2c7414f6d0 2023-08-17T18:10:36.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c79618700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c74165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:36.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c79618700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c74165550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38846/0 (socket says 172.21.15.78:38846) 2023-08-17T18:10:36.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c79618700 1 -- 172.21.15.78:0/3397730973 learned_addr learned my addr 172.21.15.78:0/3397730973 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:36.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c79e19700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c7414f6d0 0x7f2c7414ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:36.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c78e17700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c74165a90 0x7f2c7414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:36.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c79618700 1 -- 172.21.15.78:0/3397730973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c7414f6d0 msgr2=0x7f2c7414ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:36.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c79618700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c7414f6d0 0x7f2c7414ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:36.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c79618700 1 -- 172.21.15.78:0/3397730973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c74165a90 msgr2=0x7f2c7414f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:36.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.261+0000 7f2c79618700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c74165a90 0x7f2c7414f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:36.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.262+0000 7f2c79618700 1 -- 172.21.15.78:0/3397730973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c740af1d0 con 0x7f2c60005000 2023-08-17T18:10:36.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.262+0000 7f2c79618700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c74165550 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f2c70000f80 tx=0x7f2c70009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:36.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.262+0000 7f2c697fa700 1 -- 172.21.15.78:0/3397730973 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000a4e0 con 0x7f2c60005000 2023-08-17T18:10:36.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.262+0000 7f2c697fa700 1 -- 172.21.15.78:0/3397730973 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c70010040 con 0x7f2c60005000 2023-08-17T18:10:36.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.262+0000 7f2c7b87c700 1 -- 172.21.15.78:0/3397730973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c740af4b0 con 0x7f2c60005000 2023-08-17T18:10:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.262+0000 7f2c697fa700 1 -- 172.21.15.78:0/3397730973 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000a850 con 0x7f2c60005000 2023-08-17T18:10:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.262+0000 7f2c7b87c700 1 -- 172.21.15.78:0/3397730973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c741660d0 con 0x7f2c60005000 2023-08-17T18:10:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.263+0000 7f2c7b87c700 1 -- 172.21.15.78:0/3397730973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c74083980 con 0x7f2c60005000 2023-08-17T18:10:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.263+0000 7f2c697fa700 1 -- 172.21.15.78:0/3397730973 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2c7001b030 con 0x7f2c60005000 2023-08-17T18:10:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.264+0000 7f2c697fa700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2c5805ed90 0x7f2c58061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.264+0000 7f2c697fa700 1 -- 172.21.15.78:0/3397730973 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2c700792d0 con 0x7f2c60005000 2023-08-17T18:10:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.264+0000 7f2c78e17700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2c5805ed90 0x7f2c58061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.264+0000 7f2c78e17700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2c5805ed90 0x7f2c58061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2c64000e10 tx=0x7f2c64009040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:36.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.268+0000 7f2c697fa700 1 -- 172.21.15.78:0/3397730973 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c7004a810 con 0x7f2c60005000 2023-08-17T18:10:36.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:36.471+0000 7f2c7b87c700 1 -- 172.21.15.78:0/3397730973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2c74046af0 con 0x7f2c60005000 2023-08-17T18:10:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.131+0000 7f2c697fa700 1 -- 172.21.15.78:0/3397730973 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v61) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2c7004de30 con 0x7f2c60005000 2023-08-17T18:10:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 -- 172.21.15.78:0/3397730973 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2c5805ed90 msgr2=0x7f2c58061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2c5805ed90 0x7f2c58061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2c64000e10 tx=0x7f2c64009040).stop 2023-08-17T18:10:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 -- 172.21.15.78:0/3397730973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 msgr2=0x7f2c74165550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c74165550 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f2c70000f80 tx=0x7f2c70009040).stop 2023-08-17T18:10:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 -- 172.21.15.78:0/3397730973 shutdown_connections 2023-08-17T18:10:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2c5805ed90 0x7f2c58061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c7414f6d0 0x7f2c7414ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c60005000 0x7f2c74165550 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 --2- 172.21.15.78:0/3397730973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c74165a90 0x7f2c7414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 -- 172.21.15.78:0/3397730973 >> 172.21.15.78:0/3397730973 conn(0x7f2c7406a6a0 msgr2=0x7f2c740a8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:37.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 -- 172.21.15.78:0/3397730973 shutdown_connections 2023-08-17T18:10:37.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.133+0000 7f2c7b87c700 1 -- 172.21.15.78:0/3397730973 wait complete. 2023-08-17T18:10:37.145 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T18:10:37.146 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:10:37.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:10:37.229 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:10:37.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.263+0000 7fad0a3b8700 1 Processor -- start 2023-08-17T18:10:37.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.263+0000 7fad0a3b8700 1 -- start start 2023-08-17T18:10:37.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad0a3b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fad04154140 0x7fad040c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad0a3b8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad040c1010 0x7fad040ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad0a3b8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad04154520 con 0x7fad040a7c40 2023-08-17T18:10:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad0a3b8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad040c91e0 con 0x7fad040c1010 2023-08-17T18:10:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad0a3b8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad040c94c0 con 0x7fad04154140 2023-08-17T18:10:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad08955700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad040c1010 0x7fad040ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad037fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fad040a7c40 0x7fad040c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45052/0 (socket says 172.21.15.78:45052) 2023-08-17T18:10:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad08955700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad040c1010 0x7fad040ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38858/0 (socket says 172.21.15.78:38858) 2023-08-17T18:10:37.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad037fe700 1 -- 172.21.15.78:0/2341913945 learned_addr learned my addr 172.21.15.78:0/2341913945 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:37.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad08955700 1 -- 172.21.15.78:0/2341913945 >> v2:172.21.15.150:3300/0 conn(0x7fad04154140 msgr2=0x7fad040c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:37.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad03fff700 1 --2- 172.21.15.78:0/2341913945 >> v2:172.21.15.150:3300/0 conn(0x7fad04154140 0x7fad040c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad02ffd700 1 -- 172.21.15.78:0/2341913945 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387341823 0 0) 0x7fad04154520 con 0x7fad040a7c40 2023-08-17T18:10:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad08955700 1 --2- 172.21.15.78:0/2341913945 >> v2:172.21.15.150:3300/0 conn(0x7fad04154140 0x7fad040c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad08955700 1 -- 172.21.15.78:0/2341913945 >> v1:172.21.15.78:6789/0 conn(0x7fad040a7c40 legacy=0x7fad040c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad08955700 1 -- 172.21.15.78:0/2341913945 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040c97a0 con 0x7fad040c1010 2023-08-17T18:10:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad03fff700 1 --2- 172.21.15.78:0/2341913945 >> v2:172.21.15.150:3300/0 conn(0x7fad04154140 0x7fad040c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad08955700 1 --2- 172.21.15.78:0/2341913945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 0x7fad040ca280 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7fad040625b0 tx=0x7facfc009780).ready entity=mon.0 client_cookie=9d867dd35b4606c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad02ffd700 1 -- 172.21.15.78:0/2341913945 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00e070 con 0x7fad040c1010 2023-08-17T18:10:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad02ffd700 1 -- 172.21.15.78:0/2341913945 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc00bc30 con 0x7fad040c1010 2023-08-17T18:10:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.264+0000 7fad02ffd700 1 -- 172.21.15.78:0/2341913945 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc012410 con 0x7fad040c1010 2023-08-17T18:10:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.265+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2341913945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 msgr2=0x7fad040ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.265+0000 7fad0a3b8700 1 --2- 172.21.15.78:0/2341913945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 0x7fad040ca280 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7fad040625b0 tx=0x7facfc009780).stop 2023-08-17T18:10:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.265+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2341913945 shutdown_connections 2023-08-17T18:10:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.265+0000 7fad0a3b8700 1 --2- 172.21.15.78:0/2341913945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 0x7fad040ca280 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.265+0000 7fad0a3b8700 1 --2- 172.21.15.78:0/2341913945 >> v2:172.21.15.150:3300/0 conn(0x7fad04154140 0x7fad040c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.265+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2341913945 >> 172.21.15.78:0/2341913945 conn(0x7fad04094510 msgr2=0x7fad0406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.265+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2341913945 shutdown_connections 2023-08-17T18:10:37.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.265+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2341913945 wait complete. 2023-08-17T18:10:37.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.266+0000 7fad0a3b8700 1 Processor -- start 2023-08-17T18:10:37.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.266+0000 7fad0a3b8700 1 -- start start 2023-08-17T18:10:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad0a3b8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040a7c40 0x7fad040aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad0a3b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 0x7fad0414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad0a3b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad04154140 0x7fad040a9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad0a3b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040c47d0 con 0x7fad040c1010 2023-08-17T18:10:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad0a3b8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040af040 con 0x7fad040a7c40 2023-08-17T18:10:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad0a3b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad040c3450 con 0x7fad04154140 2023-08-17T18:10:37.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad037fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 0x7fad0414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad037fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 0x7fad0414e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38862/0 (socket says 172.21.15.78:38862) 2023-08-17T18:10:37.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad037fe700 1 -- 172.21.15.78:0/2158895705 learned_addr learned my addr 172.21.15.78:0/2158895705 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:37.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad03fff700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040a7c40 0x7fad040aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad08955700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad04154140 0x7fad040a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad037fe700 1 -- 172.21.15.78:0/2158895705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad04154140 msgr2=0x7fad040a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad037fe700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad04154140 0x7fad040a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad037fe700 1 -- 172.21.15.78:0/2158895705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040a7c40 msgr2=0x7fad040aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad037fe700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040a7c40 0x7fad040aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.267+0000 7fad037fe700 1 -- 172.21.15.78:0/2158895705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009a20 con 0x7fad040c1010 2023-08-17T18:10:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.268+0000 7fad037fe700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 0x7fad0414e8c0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7facf8001eb0 tx=0x7facf8007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.268+0000 7facebfff700 1 -- 172.21.15.78:0/2158895705 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80070d0 con 0x7fad040c1010 2023-08-17T18:10:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.268+0000 7facebfff700 1 -- 172.21.15.78:0/2158895705 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf8007230 con 0x7fad040c1010 2023-08-17T18:10:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.268+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2158895705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad040c3730 con 0x7fad040c1010 2023-08-17T18:10:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.268+0000 7facebfff700 1 -- 172.21.15.78:0/2158895705 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80075d0 con 0x7fad040c1010 2023-08-17T18:10:37.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.268+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2158895705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad040c3cf0 con 0x7fad040c1010 2023-08-17T18:10:37.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.269+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2158895705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad04047350 con 0x7fad040c1010 2023-08-17T18:10:37.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.269+0000 7facebfff700 1 -- 172.21.15.78:0/2158895705 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7facf801a060 con 0x7fad040c1010 2023-08-17T18:10:37.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.269+0000 7facebfff700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7facf005ed60 0x7facf0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.270+0000 7facebfff700 1 -- 172.21.15.78:0/2158895705 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7facf8079160 con 0x7fad040c1010 2023-08-17T18:10:37.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.270+0000 7fad03fff700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7facf005ed60 0x7facf0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.270+0000 7fad03fff700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7facf005ed60 0x7facf0061220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7facf400abd0 tx=0x7facf4008040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:37.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.273+0000 7facebfff700 1 -- 172.21.15.78:0/2158895705 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7facf804a700 con 0x7fad040c1010 2023-08-17T18:10:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.493+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2158895705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad040a9950 con 0x7fad040c1010 2023-08-17T18:10:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.494+0000 7facebfff700 1 -- 172.21.15.78:0/2158895705 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4487 (secure 0 0 0) 0x7facf8018020 con 0x7fad040c1010 2023-08-17T18:10:37.495 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:37.495 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1301951105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1301951105},{"type":"v1","addr":"172.21.15.150:6834","nonce":1301951105}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3263459818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3263459818},{"type":"v1","addr":"172.21.15.78:6836","nonce":3263459818}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4038964498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4038964498},{"type":"v1","addr":"172.21.15.78:6837","nonce":4038964498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:10:35.123034+0000","modified":"2023-08-17T18:10:37.129045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/607383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":607383},{"type":"v1","addr":"172.21.15.150:6835","nonce":607383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T18:10:37.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2158895705 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7facf005ed60 msgr2=0x7facf0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7facf005ed60 0x7facf0061220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7facf400abd0 tx=0x7facf4008040).stop 2023-08-17T18:10:37.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2158895705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 msgr2=0x7fad0414e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 0x7fad0414e8c0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7facf8001eb0 tx=0x7facf8007e90).stop 2023-08-17T18:10:37.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2158895705 shutdown_connections 2023-08-17T18:10:37.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7facf005ed60 0x7facf0061220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad04154140 0x7fad040a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad040a7c40 0x7fad040aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 --2- 172.21.15.78:0/2158895705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad040c1010 0x7fad0414e8c0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2158895705 >> 172.21.15.78:0/2158895705 conn(0x7fad04094510 msgr2=0x7fad040ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:37.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2158895705 shutdown_connections 2023-08-17T18:10:37.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.496+0000 7fad0a3b8700 1 -- 172.21.15.78:0/2158895705 wait complete. 2023-08-17T18:10:37.499 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 61 2023-08-17T18:10:37.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:10:37.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.621+0000 7f29e65d0700 1 Processor -- start 2023-08-17T18:10:37.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.621+0000 7f29e65d0700 1 -- start start 2023-08-17T18:10:37.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.622+0000 7f29e65d0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29e00a7c90 0x7f29e00c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.622+0000 7f29e65d0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e00bf210 con 0x7f29e0151e40 2023-08-17T18:10:37.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.622+0000 7f29e65d0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e00c5a80 con 0x7f29e00be4d0 2023-08-17T18:10:37.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.622+0000 7f29e65d0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e00c5450 con 0x7f29e00a7c90 2023-08-17T18:10:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.622+0000 7f29dffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f29e0151e40 0x7f29e0152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45064/0 (socket says 172.21.15.78:45064) 2023-08-17T18:10:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.622+0000 7f29dffff700 1 -- 172.21.15.78:0/431878055 learned_addr learned my addr 172.21.15.78:0/431878055 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29df7fe700 1 --2- 172.21.15.78:0/431878055 >> v2:172.21.15.150:3300/0 conn(0x7f29e00a7c90 0x7f29e00c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401096622 0 0) 0x7f29e00bf210 con 0x7f29e0151e40 2023-08-17T18:10:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c80033f0 con 0x7f29e0151e40 2023-08-17T18:10:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 285604851 0 0) 0x7f29c80033f0 con 0x7f29e0151e40 2023-08-17T18:10:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 >> v2:172.21.15.150:3300/0 conn(0x7f29e00a7c90 msgr2=0x7f29e00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 --2- 172.21.15.78:0/431878055 >> v2:172.21.15.150:3300/0 conn(0x7f29e00a7c90 0x7f29e00c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 >> v1:172.21.15.150:6789/0 conn(0x7f29e00be4d0 legacy=0x7f29e00be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00a8190 con 0x7f29e0151e40 2023-08-17T18:10:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f29d0001470 con 0x7f29e0151e40 2023-08-17T18:10:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 >> v1:172.21.15.78:6789/0 conn(0x7f29e0151e40 legacy=0x7f29e0152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80038e0 0x7f29c8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c8004690 0x7f29c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c8005000 0x7f29c800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00c5450 con 0x7f29c80038e0 2023-08-17T18:10:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c800beb0 con 0x7f29c8005000 2023-08-17T18:10:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c800c070 con 0x7f29c8004690 2023-08-17T18:10:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29dffff700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80038e0 0x7f29c8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29e4b6d700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c8005000 0x7f29c800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29df7fe700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c8004690 0x7f29c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29dffff700 1 -- 172.21.15.78:0/431878055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c8004690 msgr2=0x7f29c8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29dffff700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c8004690 0x7f29c8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29dffff700 1 -- 172.21.15.78:0/431878055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c8005000 msgr2=0x7f29c800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29dffff700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c8005000 0x7f29c800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29dffff700 1 -- 172.21.15.78:0/431878055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c80033f0 con 0x7f29c80038e0 2023-08-17T18:10:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29df7fe700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c8004690 0x7f29c8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29e4b6d700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c8005000 0x7f29c800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.623+0000 7f29e4b6d700 1 -- 172.21.15.78:0/431878055 reap_dead start 2023-08-17T18:10:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29dffff700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80038e0 0x7f29c8003d00 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f29d000c190 tx=0x7f29d0001e50).ready entity=mon.0 client_cookie=72426f6c863a784f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0007a20 con 0x7f29c80038e0 2023-08-17T18:10:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d000cac0 con 0x7f29c80038e0 2023-08-17T18:10:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29deffd700 1 -- 172.21.15.78:0/431878055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d000ce40 con 0x7f29c80038e0 2023-08-17T18:10:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29e65d0700 1 -- 172.21.15.78:0/431878055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80038e0 msgr2=0x7f29c8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29e65d0700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80038e0 0x7f29c8003d00 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f29d000c190 tx=0x7f29d0001e50).stop 2023-08-17T18:10:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29e65d0700 1 -- 172.21.15.78:0/431878055 shutdown_connections 2023-08-17T18:10:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29e65d0700 1 --2- 172.21.15.78:0/431878055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80038e0 0x7f29c8003d00 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29e65d0700 1 -- 172.21.15.78:0/431878055 >> 172.21.15.78:0/431878055 conn(0x7f29e0092330 msgr2=0x7f29e0062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:37.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29e65d0700 1 -- 172.21.15.78:0/431878055 shutdown_connections 2023-08-17T18:10:37.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.624+0000 7f29e65d0700 1 -- 172.21.15.78:0/431878055 wait complete. 2023-08-17T18:10:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.625+0000 7f29e65d0700 1 Processor -- start 2023-08-17T18:10:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.626+0000 7f29e65d0700 1 -- start start 2023-08-17T18:10:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.626+0000 7f29e65d0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c80038e0 0x7f29e00ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.626+0000 7f29e65d0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e00c7ff0 0x7f29e00c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.626+0000 7f29e65d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e014a6c0 0x7f29e014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.626+0000 7f29e65d0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00abe30 con 0x7f29e014a6c0 2023-08-17T18:10:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.626+0000 7f29e65d0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00ac9b0 con 0x7f29e00c7ff0 2023-08-17T18:10:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.626+0000 7f29e65d0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00ac080 con 0x7f29c80038e0 2023-08-17T18:10:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.626+0000 7f29e4b6d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e014a6c0 0x7f29e014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.626+0000 7f29e4b6d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e014a6c0 0x7f29e014ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38878/0 (socket says 172.21.15.78:38878) 2023-08-17T18:10:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.626+0000 7f29e4b6d700 1 -- 172.21.15.78:0/1723462055 learned_addr learned my addr 172.21.15.78:0/1723462055 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29e4b6d700 1 -- 172.21.15.78:0/1723462055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c80038e0 msgr2=0x7f29e00ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29df7fe700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e00c7ff0 0x7f29e00c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29dffff700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c80038e0 0x7f29e00ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29e4b6d700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c80038e0 0x7f29e00ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29e4b6d700 1 -- 172.21.15.78:0/1723462055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e00c7ff0 msgr2=0x7f29e00c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29e4b6d700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e00c7ff0 0x7f29e00c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29e4b6d700 1 -- 172.21.15.78:0/1723462055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00ac360 con 0x7f29e014a6c0 2023-08-17T18:10:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29df7fe700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e00c7ff0 0x7f29e00c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29e4b6d700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e014a6c0 0x7f29e014ab20 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f29e0065a50 tx=0x7f29d8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29c7fff700 1 -- 172.21.15.78:0/1723462055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8010520 con 0x7f29e014a6c0 2023-08-17T18:10:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29c7fff700 1 -- 172.21.15.78:0/1723462055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d8010680 con 0x7f29e014a6c0 2023-08-17T18:10:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29e65d0700 1 -- 172.21.15.78:0/1723462055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e00ac640 con 0x7f29e014a6c0 2023-08-17T18:10:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29c7fff700 1 -- 172.21.15.78:0/1723462055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8010a00 con 0x7f29e014a6c0 2023-08-17T18:10:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.627+0000 7f29e65d0700 1 -- 172.21.15.78:0/1723462055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e0067340 con 0x7f29e014a6c0 2023-08-17T18:10:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.628+0000 7f29e65d0700 1 -- 172.21.15.78:0/1723462055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e0047350 con 0x7f29e014a6c0 2023-08-17T18:10:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.628+0000 7f29c7fff700 1 -- 172.21.15.78:0/1723462055 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f29d8014430 con 0x7f29e014a6c0 2023-08-17T18:10:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.629+0000 7f29c7fff700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f29cc05ed90 0x7f29cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.629+0000 7f29c7fff700 1 -- 172.21.15.78:0/1723462055 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f29d80798d0 con 0x7f29e014a6c0 2023-08-17T18:10:37.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.629+0000 7f29dffff700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f29cc05ed90 0x7f29cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.629+0000 7f29dffff700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f29cc05ed90 0x7f29cc061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f29d0001ed0 tx=0x7f29d0015000).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:37.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.633+0000 7f29c7fff700 1 -- 172.21.15.78:0/1723462055 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29d80498f0 con 0x7f29e014a6c0 2023-08-17T18:10:37.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.801+0000 7f29e65d0700 1 -- 172.21.15.78:0/1723462055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29e0096b00 con 0x7f29e014a6c0 2023-08-17T18:10:37.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.802+0000 7f29c7fff700 1 -- 172.21.15.78:0/1723462055 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f29d804ae10 con 0x7f29e014a6c0 2023-08-17T18:10:37.803 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:37.803 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":168,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:10:36.124776+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:10:33.660535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T18:10:34.093770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:10:37.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 -- 172.21.15.78:0/1723462055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f29cc05ed90 msgr2=0x7f29cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f29cc05ed90 0x7f29cc061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f29d0001ed0 tx=0x7f29d0015000).stop 2023-08-17T18:10:37.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 -- 172.21.15.78:0/1723462055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e014a6c0 msgr2=0x7f29e014ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e014a6c0 0x7f29e014ab20 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f29e0065a50 tx=0x7f29d8009040).stop 2023-08-17T18:10:37.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 -- 172.21.15.78:0/1723462055 shutdown_connections 2023-08-17T18:10:37.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f29cc05ed90 0x7f29cc061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e014a6c0 0x7f29e014ab20 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c80038e0 0x7f29e00ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 --2- 172.21.15.78:0/1723462055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e00c7ff0 0x7f29e00c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 -- 172.21.15.78:0/1723462055 >> 172.21.15.78:0/1723462055 conn(0x7f29e0092330 msgr2=0x7f29e00a5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:37.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 -- 172.21.15.78:0/1723462055 shutdown_connections 2023-08-17T18:10:37.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.804+0000 7f29e65d0700 1 -- 172.21.15.78:0/1723462055 wait complete. 2023-08-17T18:10:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T18:10:37.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T18:10:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.930+0000 7f0eb4158700 1 Processor -- start 2023-08-17T18:10:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.931+0000 7f0eb4158700 1 -- start start 2023-08-17T18:10:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.931+0000 7f0eb4158700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0eac0c6ee0 0x7f0eac0c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.931+0000 7f0eb4158700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 0x7f0eac0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.931+0000 7f0eb4158700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac0c7350 con 0x7f0eac154140 2023-08-17T18:10:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.931+0000 7f0eb4158700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac0a8350 con 0x7f0eac0c6ee0 2023-08-17T18:10:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.931+0000 7f0eb4158700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0c1280 con 0x7f0eac0c0df0 2023-08-17T18:10:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb16f3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0eac0c6ee0 0x7f0eac0c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb16f3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0eac0c6ee0 0x7f0eac0c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38880/0 (socket says 172.21.15.78:38880) 2023-08-17T18:10:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb1ef4700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0eac154140 0x7f0eac0a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45074/0 (socket says 172.21.15.78:45074) 2023-08-17T18:10:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb16f3700 1 -- 172.21.15.78:0/1998584266 learned_addr learned my addr 172.21.15.78:0/1998584266 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb26f5700 1 --2- 172.21.15.78:0/1998584266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 0x7f0eac0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb16f3700 1 -- 172.21.15.78:0/1998584266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 msgr2=0x7f0eac0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb16f3700 1 --2- 172.21.15.78:0/1998584266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 0x7f0eac0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb16f3700 1 -- 172.21.15.78:0/1998584266 >> v1:172.21.15.78:6789/0 conn(0x7f0eac154140 legacy=0x7f0eac0a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb16f3700 1 -- 172.21.15.78:0/1998584266 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac154520 con 0x7f0eac0c6ee0 2023-08-17T18:10:37.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb16f3700 1 --2- 172.21.15.78:0/1998584266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac0c6ee0 0x7f0eac0c0900 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7f0e9c006fd0 tx=0x7f0e9c0090f0).ready entity=mon.0 client_cookie=f6956f68bf38be6c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:37.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb0ef2700 1 -- 172.21.15.78:0/1998584266 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00f510 con 0x7f0eac0c6ee0 2023-08-17T18:10:37.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb0ef2700 1 -- 172.21.15.78:0/1998584266 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c00f670 con 0x7f0eac0c6ee0 2023-08-17T18:10:37.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.932+0000 7f0eb0ef2700 1 -- 172.21.15.78:0/1998584266 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00fa10 con 0x7f0eac0c6ee0 2023-08-17T18:10:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.933+0000 7f0eb4158700 1 -- 172.21.15.78:0/1998584266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac0c6ee0 msgr2=0x7f0eac0c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.933+0000 7f0eb4158700 1 --2- 172.21.15.78:0/1998584266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac0c6ee0 0x7f0eac0c0900 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7f0e9c006fd0 tx=0x7f0e9c0090f0).stop 2023-08-17T18:10:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.933+0000 7f0eb4158700 1 -- 172.21.15.78:0/1998584266 shutdown_connections 2023-08-17T18:10:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.933+0000 7f0eb4158700 1 --2- 172.21.15.78:0/1998584266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 0x7f0eac0ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.933+0000 7f0eb4158700 1 --2- 172.21.15.78:0/1998584266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac0c6ee0 0x7f0eac0c0900 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.933+0000 7f0eb4158700 1 -- 172.21.15.78:0/1998584266 >> 172.21.15.78:0/1998584266 conn(0x7f0eac094510 msgr2=0x7f0eac06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.933+0000 7f0eb4158700 1 -- 172.21.15.78:0/1998584266 shutdown_connections 2023-08-17T18:10:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.933+0000 7f0eb4158700 1 -- 172.21.15.78:0/1998584266 wait complete. 2023-08-17T18:10:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.934+0000 7f0eb4158700 1 Processor -- start 2023-08-17T18:10:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.934+0000 7f0eb4158700 1 -- start start 2023-08-17T18:10:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb4158700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 0x7f0eac14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb4158700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eac0c6ee0 0x7f0eac0c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb4158700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac154140 0x7f0eac150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb4158700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1652e0 con 0x7f0eac154140 2023-08-17T18:10:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb4158700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1646d0 con 0x7f0eac0c6ee0 2023-08-17T18:10:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb4158700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1649b0 con 0x7f0eac0c0df0 2023-08-17T18:10:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb26f5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac154140 0x7f0eac150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb26f5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac154140 0x7f0eac150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38894/0 (socket says 172.21.15.78:38894) 2023-08-17T18:10:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb26f5700 1 -- 172.21.15.78:0/1479188393 learned_addr learned my addr 172.21.15.78:0/1479188393 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb16f3700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eac0c6ee0 0x7f0eac0c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb1ef4700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 0x7f0eac14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb26f5700 1 -- 172.21.15.78:0/1479188393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 msgr2=0x7f0eac14dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb26f5700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 0x7f0eac14dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb26f5700 1 -- 172.21.15.78:0/1479188393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eac0c6ee0 msgr2=0x7f0eac0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb26f5700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eac0c6ee0 0x7f0eac0c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb26f5700 1 -- 172.21.15.78:0/1479188393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c009370 con 0x7f0eac154140 2023-08-17T18:10:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb16f3700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eac0c6ee0 0x7f0eac0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb1ef4700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 0x7f0eac14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb26f5700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac154140 0x7f0eac150280 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f0ea4009fa0 tx=0x7f0ea4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0ea1ffb700 1 -- 172.21.15.78:0/1479188393 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea400ed20 con 0x7f0eac154140 2023-08-17T18:10:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0ea1ffb700 1 -- 172.21.15.78:0/1479188393 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea400ee80 con 0x7f0eac154140 2023-08-17T18:10:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0ea1ffb700 1 -- 172.21.15.78:0/1479188393 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4014610 con 0x7f0eac154140 2023-08-17T18:10:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb4158700 1 -- 172.21.15.78:0/1479188393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac164c90 con 0x7f0eac154140 2023-08-17T18:10:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.935+0000 7f0eb4158700 1 -- 172.21.15.78:0/1479188393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac14e130 con 0x7f0eac154140 2023-08-17T18:10:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.936+0000 7f0eb4158700 1 -- 172.21.15.78:0/1479188393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac047350 con 0x7f0eac154140 2023-08-17T18:10:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.937+0000 7f0ea1ffb700 1 -- 172.21.15.78:0/1479188393 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0ea401b030 con 0x7f0eac154140 2023-08-17T18:10:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.937+0000 7f0ea1ffb700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e9005ed90 0x7f0e90061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.937+0000 7f0ea1ffb700 1 -- 172.21.15.78:0/1479188393 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0ea4079fe0 con 0x7f0eac154140 2023-08-17T18:10:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.937+0000 7f0eb1ef4700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e9005ed90 0x7f0e90061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.937+0000 7f0eb1ef4700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e9005ed90 0x7f0e90061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0ea80017a0 tx=0x7f0ea8009040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:37.941+0000 7f0ea1ffb700 1 -- 172.21.15.78:0/1479188393 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ea404b520 con 0x7f0eac154140 2023-08-17T18:10:38.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.101+0000 7f0eb4158700 1 -- 172.21.15.78:0/1479188393 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0eac14e380 con 0x7f0e9005ed90 2023-08-17T18:10:38.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.111+0000 7f0ea1ffb700 1 -- 172.21.15.78:0/1479188393 <== mgr.8919 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362016 (secure 0 0 0) 0x7f0ea8001d30 con 0x7f0e9005ed90 2023-08-17T18:10:38.115 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.114+0000 7f0eb4158700 1 -- 172.21.15.78:0/1479188393 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e9005ed90 msgr2=0x7f0e90061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.114+0000 7f0eb4158700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e9005ed90 0x7f0e90061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0ea80017a0 tx=0x7f0ea8009040).stop 2023-08-17T18:10:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.114+0000 7f0eb4158700 1 -- 172.21.15.78:0/1479188393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac154140 msgr2=0x7f0eac150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.114+0000 7f0eb4158700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac154140 0x7f0eac150280 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f0ea4009fa0 tx=0x7f0ea4009900).stop 2023-08-17T18:10:38.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.115+0000 7f0eb4158700 1 -- 172.21.15.78:0/1479188393 shutdown_connections 2023-08-17T18:10:38.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.115+0000 7f0eb4158700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0e9005ed90 0x7f0e90061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.115+0000 7f0eb4158700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eac154140 0x7f0eac150280 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.115+0000 7f0eb4158700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0eac0c0df0 0x7f0eac14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.115+0000 7f0eb4158700 1 --2- 172.21.15.78:0/1479188393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0eac0c6ee0 0x7f0eac0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.115+0000 7f0eb4158700 1 -- 172.21.15.78:0/1479188393 >> 172.21.15.78:0/1479188393 conn(0x7f0eac094510 msgr2=0x7f0eac153390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:38.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.115+0000 7f0eb4158700 1 -- 172.21.15.78:0/1479188393 shutdown_connections 2023-08-17T18:10:38.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.115+0000 7f0eb4158700 1 -- 172.21.15.78:0/1479188393 wait complete. 2023-08-17T18:10:38.119 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T18:10:38.127 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-17T18:10:36.249999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433904,"kb_used_data":16176,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752540816,"statfs":{"total":773094113280,"available":770601795584,"internally_reserved":0,"allocated":16564224,"data_stored":8281786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-592747,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-206,"num_write_kb":-717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-554,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.374326"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.141754+0000","last_change":"2023-08-17T18:10:35.141754+0000","last_active":"2023-08-17T18:10:35.141754+0000","last_peered":"2023-08-17T18:10:35.141754+0000","last_clean":"2023-08-17T18:10:35.141754+0000","last_became_active":"2023-08-17T18:10:35.141464+0000","last_became_peered":"2023-08-17T18:10:35.141464+0000","last_unstale":"2023-08-17T18:10:35.141754+0000","last_undegraded":"2023-08-17T18:10:35.141754+0000","last_fullsized":"2023-08-17T18:10:35.141754+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"167'3","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.154072+0000","last_change":"2023-08-17T18:10:34.780150+0000","last_active":"2023-08-17T18:10:35.154072+0000","last_peered":"2023-08-17T18:10:35.154072+0000","last_clean":"2023-08-17T18:10:35.154072+0000","last_became_active":"2023-08-17T18:10:34.779873+0000","last_became_peered":"2023-08-17T18:10:34.779873+0000","last_unstale":"2023-08-17T18:10:35.154072+0000","last_undegraded":"2023-08-17T18:10:35.154072+0000","last_fullsized":"2023-08-17T18:10:35.154072+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.154569+0000","last_change":"2023-08-17T18:10:35.154569+0000","last_active":"2023-08-17T18:10:35.154569+0000","last_peered":"2023-08-17T18:10:35.154569+0000","last_clean":"2023-08-17T18:10:35.154569+0000","last_became_active":"2023-08-17T18:10:35.154274+0000","last_became_peered":"2023-08-17T18:10:35.154274+0000","last_unstale":"2023-08-17T18:10:35.154569+0000","last_undegraded":"2023-08-17T18:10:35.154569+0000","last_fullsized":"2023-08-17T18:10:35.154569+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.778660+0000","last_change":"2023-08-17T18:10:34.770595+0000","last_active":"2023-08-17T18:10:34.778660+0000","last_peered":"2023-08-17T18:10:34.778660+0000","last_clean":"2023-08-17T18:10:34.778660+0000","last_became_active":"2023-08-17T18:10:34.770312+0000","last_became_peered":"2023-08-17T18:10:34.770312+0000","last_unstale":"2023-08-17T18:10:34.778660+0000","last_undegraded":"2023-08-17T18:10:34.778660+0000","last_fullsized":"2023-08-17T18:10:34.778660+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142589+0000","last_change":"2023-08-17T18:10:35.142589+0000","last_active":"2023-08-17T18:10:35.142589+0000","last_peered":"2023-08-17T18:10:35.142589+0000","last_clean":"2023-08-17T18:10:35.142589+0000","last_became_active":"2023-08-17T18:10:35.142313+0000","last_became_peered":"2023-08-17T18:10:35.142313+0000","last_unstale":"2023-08-17T18:10:35.142589+0000","last_undegraded":"2023-08-17T18:10:35.142589+0000","last_fullsized":"2023-08-17T18:10:35.142589+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785855+0000","last_change":"2023-08-17T18:10:34.782766+0000","last_active":"2023-08-17T18:10:34.785855+0000","last_peered":"2023-08-17T18:10:34.785855+0000","last_clean":"2023-08-17T18:10:34.785855+0000","last_became_active":"2023-08-17T18:10:34.782485+0000","last_became_peered":"2023-08-17T18:10:34.782485+0000","last_unstale":"2023-08-17T18:10:34.785855+0000","last_undegraded":"2023-08-17T18:10:34.785855+0000","last_fullsized":"2023-08-17T18:10:34.785855+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.151992+0000","last_change":"2023-08-17T18:10:35.151992+0000","last_active":"2023-08-17T18:10:35.151992+0000","last_peered":"2023-08-17T18:10:35.151992+0000","last_clean":"2023-08-17T18:10:35.151992+0000","last_became_active":"2023-08-17T18:10:35.151712+0000","last_became_peered":"2023-08-17T18:10:35.151712+0000","last_unstale":"2023-08-17T18:10:35.151992+0000","last_undegraded":"2023-08-17T18:10:35.151992+0000","last_fullsized":"2023-08-17T18:10:35.151992+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.146283+0000","last_change":"2023-08-17T18:10:34.779291+0000","last_active":"2023-08-17T18:10:35.146283+0000","last_peered":"2023-08-17T18:10:35.146283+0000","last_clean":"2023-08-17T18:10:35.146283+0000","last_became_active":"2023-08-17T18:10:34.778776+0000","last_became_peered":"2023-08-17T18:10:34.778776+0000","last_unstale":"2023-08-17T18:10:35.146283+0000","last_undegraded":"2023-08-17T18:10:35.146283+0000","last_fullsized":"2023-08-17T18:10:35.146283+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148780+0000","last_change":"2023-08-17T18:10:35.148780+0000","last_active":"2023-08-17T18:10:35.148780+0000","last_peered":"2023-08-17T18:10:35.148780+0000","last_clean":"2023-08-17T18:10:35.148780+0000","last_became_active":"2023-08-17T18:10:35.147995+0000","last_became_peered":"2023-08-17T18:10:35.147995+0000","last_unstale":"2023-08-17T18:10:35.148780+0000","last_undegraded":"2023-08-17T18:10:35.148780+0000","last_fullsized":"2023-08-17T18:10:35.148780+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.128027+0000","last_change":"2023-08-17T18:10:34.779533+0000","last_active":"2023-08-17T18:10:35.128027+0000","last_peered":"2023-08-17T18:10:35.128027+0000","last_clean":"2023-08-17T18:10:35.128027+0000","last_became_active":"2023-08-17T18:10:34.779251+0000","last_became_peered":"2023-08-17T18:10:34.779251+0000","last_unstale":"2023-08-17T18:10:35.128027+0000","last_undegraded":"2023-08-17T18:10:35.128027+0000","last_fullsized":"2023-08-17T18:10:35.128027+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143506+0000","last_change":"2023-08-17T18:10:35.143506+0000","last_active":"2023-08-17T18:10:35.143506+0000","last_peered":"2023-08-17T18:10:35.143506+0000","last_clean":"2023-08-17T18:10:35.143506+0000","last_became_active":"2023-08-17T18:10:35.143090+0000","last_became_peered":"2023-08-17T18:10:35.143090+0000","last_unstale":"2023-08-17T18:10:35.143506+0000","last_undegraded":"2023-08-17T18:10:35.143506+0000","last_fullsized":"2023-08-17T18:10:35.143506+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.133971+0000","last_change":"2023-08-17T18:10:34.781414+0000","last_active":"2023-08-17T18:10:35.133971+0000","last_peered":"2023-08-17T18:10:35.133971+0000","last_clean":"2023-08-17T18:10:35.133971+0000","last_became_active":"2023-08-17T18:10:34.781168+0000","last_became_peered":"2023-08-17T18:10:34.781168+0000","last_unstale":"2023-08-17T18:10:35.133971+0000","last_undegraded":"2023-08-17T18:10:35.133971+0000","last_fullsized":"2023-08-17T18:10:35.133971+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.139143+0000","last_change":"2023-08-17T18:10:35.139143+0000","last_active":"2023-08-17T18:10:35.139143+0000","last_peered":"2023-08-17T18:10:35.139143+0000","last_clean":"2023-08-17T18:10:35.139143+0000","last_became_active":"2023-08-17T18:10:35.138987+0000","last_became_peered":"2023-08-17T18:10:35.138987+0000","last_unstale":"2023-08-17T18:10:35.139143+0000","last_undegraded":"2023-08-17T18:10:35.139143+0000","last_fullsized":"2023-08-17T18:10:35.139143+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.780665+0000","last_change":"2023-08-17T18:10:34.775757+0000","last_active":"2023-08-17T18:10:34.780665+0000","last_peered":"2023-08-17T18:10:34.780665+0000","last_clean":"2023-08-17T18:10:34.780665+0000","last_became_active":"2023-08-17T18:10:34.775489+0000","last_became_peered":"2023-08-17T18:10:34.775489+0000","last_unstale":"2023-08-17T18:10:34.780665+0000","last_undegraded":"2023-08-17T18:10:34.780665+0000","last_fullsized":"2023-08-17T18:10:34.780665+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143686+0000","last_change":"2023-08-17T18:10:35.143686+0000","last_active":"2023-08-17T18:10:35.143686+0000","last_peered":"2023-08-17T18:10:35.143686+0000","last_clean":"2023-08-17T18:10:35.143686+0000","last_became_active":"2023-08-17T18:10:35.143421+0000","last_became_peered":"2023-08-17T18:10:35.143421+0000","last_unstale":"2023-08-17T18:10:35.143686+0000","last_undegraded":"2023-08-17T18:10:35.143686+0000","last_fullsized":"2023-08-17T18:10:35.143686+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785186+0000","last_change":"2023-08-17T18:10:34.778932+0000","last_active":"2023-08-17T18:10:34.785186+0000","last_peered":"2023-08-17T18:10:34.785186+0000","last_clean":"2023-08-17T18:10:34.785186+0000","last_became_active":"2023-08-17T18:10:34.778630+0000","last_became_peered":"2023-08-17T18:10:34.778630+0000","last_unstale":"2023-08-17T18:10:34.785186+0000","last_undegraded":"2023-08-17T18:10:34.785186+0000","last_fullsized":"2023-08-17T18:10:34.785186+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144322+0000","last_change":"2023-08-17T18:10:35.144322+0000","last_active":"2023-08-17T18:10:35.144322+0000","last_peered":"2023-08-17T18:10:35.144322+0000","last_clean":"2023-08-17T18:10:35.144322+0000","last_became_active":"2023-08-17T18:10:35.143897+0000","last_became_peered":"2023-08-17T18:10:35.143897+0000","last_unstale":"2023-08-17T18:10:35.144322+0000","last_undegraded":"2023-08-17T18:10:35.144322+0000","last_fullsized":"2023-08-17T18:10:35.144322+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.779852+0000","last_change":"2023-08-17T18:10:34.776850+0000","last_active":"2023-08-17T18:10:34.779852+0000","last_peered":"2023-08-17T18:10:34.779852+0000","last_clean":"2023-08-17T18:10:34.779852+0000","last_became_active":"2023-08-17T18:10:34.776050+0000","last_became_peered":"2023-08-17T18:10:34.776050+0000","last_unstale":"2023-08-17T18:10:34.779852+0000","last_undegraded":"2023-08-17T18:10:34.779852+0000","last_fullsized":"2023-08-17T18:10:34.779852+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148706+0000","last_change":"2023-08-17T18:10:35.148706+0000","last_active":"2023-08-17T18:10:35.148706+0000","last_peered":"2023-08-17T18:10:35.148706+0000","last_clean":"2023-08-17T18:10:35.148706+0000","last_became_active":"2023-08-17T18:10:35.148428+0000","last_became_peered":"2023-08-17T18:10:35.148428+0000","last_unstale":"2023-08-17T18:10:35.148706+0000","last_undegraded":"2023-08-17T18:10:35.148706+0000","last_fullsized":"2023-08-17T18:10:35.148706+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.787880+0000","last_change":"2023-08-17T18:10:34.785056+0000","last_active":"2023-08-17T18:10:34.787880+0000","last_peered":"2023-08-17T18:10:34.787880+0000","last_clean":"2023-08-17T18:10:34.787880+0000","last_became_active":"2023-08-17T18:10:34.784790+0000","last_became_peered":"2023-08-17T18:10:34.784790+0000","last_unstale":"2023-08-17T18:10:34.787880+0000","last_undegraded":"2023-08-17T18:10:34.787880+0000","last_fullsized":"2023-08-17T18:10:34.787880+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.137220+0000","last_change":"2023-08-17T18:10:35.137220+0000","last_active":"2023-08-17T18:10:35.137220+0000","last_peered":"2023-08-17T18:10:35.137220+0000","last_clean":"2023-08-17T18:10:35.137220+0000","last_became_active":"2023-08-17T18:10:35.136912+0000","last_became_peered":"2023-08-17T18:10:35.136912+0000","last_unstale":"2023-08-17T18:10:35.137220+0000","last_undegraded":"2023-08-17T18:10:35.137220+0000","last_fullsized":"2023-08-17T18:10:35.137220+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785374+0000","last_change":"2023-08-17T18:10:34.778326+0000","last_active":"2023-08-17T18:10:34.785374+0000","last_peered":"2023-08-17T18:10:34.785374+0000","last_clean":"2023-08-17T18:10:34.785374+0000","last_became_active":"2023-08-17T18:10:34.778054+0000","last_became_peered":"2023-08-17T18:10:34.778054+0000","last_unstale":"2023-08-17T18:10:34.785374+0000","last_undegraded":"2023-08-17T18:10:34.785374+0000","last_fullsized":"2023-08-17T18:10:34.785374+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.136847+0000","last_change":"2023-08-17T18:10:35.136847+0000","last_active":"2023-08-17T18:10:35.136847+0000","last_peered":"2023-08-17T18:10:35.136847+0000","last_clean":"2023-08-17T18:10:35.136847+0000","last_became_active":"2023-08-17T18:10:35.136573+0000","last_became_peered":"2023-08-17T18:10:35.136573+0000","last_unstale":"2023-08-17T18:10:35.136847+0000","last_undegraded":"2023-08-17T18:10:35.136847+0000","last_fullsized":"2023-08-17T18:10:35.136847+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"167'4","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.153827+0000","last_change":"2023-08-17T18:10:34.782766+0000","last_active":"2023-08-17T18:10:35.153827+0000","last_peered":"2023-08-17T18:10:35.153827+0000","last_clean":"2023-08-17T18:10:35.153827+0000","last_became_active":"2023-08-17T18:10:34.782486+0000","last_became_peered":"2023-08-17T18:10:34.782486+0000","last_unstale":"2023-08-17T18:10:35.153827+0000","last_undegraded":"2023-08-17T18:10:35.153827+0000","last_fullsized":"2023-08-17T18:10:35.153827+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.149959+0000","last_change":"2023-08-17T18:10:35.149959+0000","last_active":"2023-08-17T18:10:35.149959+0000","last_peered":"2023-08-17T18:10:35.149959+0000","last_clean":"2023-08-17T18:10:35.149959+0000","last_became_active":"2023-08-17T18:10:35.149676+0000","last_became_peered":"2023-08-17T18:10:35.149676+0000","last_unstale":"2023-08-17T18:10:35.149959+0000","last_undegraded":"2023-08-17T18:10:35.149959+0000","last_fullsized":"2023-08-17T18:10:35.149959+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.128056+0000","last_change":"2023-08-17T18:10:34.779491+0000","last_active":"2023-08-17T18:10:35.128056+0000","last_peered":"2023-08-17T18:10:35.128056+0000","last_clean":"2023-08-17T18:10:35.128056+0000","last_became_active":"2023-08-17T18:10:34.779147+0000","last_became_peered":"2023-08-17T18:10:34.779147+0000","last_unstale":"2023-08-17T18:10:35.128056+0000","last_undegraded":"2023-08-17T18:10:35.128056+0000","last_fullsized":"2023-08-17T18:10:35.128056+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144165+0000","last_change":"2023-08-17T18:10:35.144165+0000","last_active":"2023-08-17T18:10:35.144165+0000","last_peered":"2023-08-17T18:10:35.144165+0000","last_clean":"2023-08-17T18:10:35.144165+0000","last_became_active":"2023-08-17T18:10:35.143828+0000","last_became_peered":"2023-08-17T18:10:35.143828+0000","last_unstale":"2023-08-17T18:10:35.144165+0000","last_undegraded":"2023-08-17T18:10:35.144165+0000","last_fullsized":"2023-08-17T18:10:35.144165+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784569+0000","last_change":"2023-08-17T18:10:34.778034+0000","last_active":"2023-08-17T18:10:34.784569+0000","last_peered":"2023-08-17T18:10:34.784569+0000","last_clean":"2023-08-17T18:10:34.784569+0000","last_became_active":"2023-08-17T18:10:34.777527+0000","last_became_peered":"2023-08-17T18:10:34.777527+0000","last_unstale":"2023-08-17T18:10:34.784569+0000","last_undegraded":"2023-08-17T18:10:34.784569+0000","last_fullsized":"2023-08-17T18:10:34.784569+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143925+0000","last_change":"2023-08-17T18:10:35.143925+0000","last_active":"2023-08-17T18:10:35.143925+0000","last_peered":"2023-08-17T18:10:35.143925+0000","last_clean":"2023-08-17T18:10:35.143925+0000","last_became_active":"2023-08-17T18:10:35.143620+0000","last_became_peered":"2023-08-17T18:10:35.143620+0000","last_unstale":"2023-08-17T18:10:35.143925+0000","last_undegraded":"2023-08-17T18:10:35.143925+0000","last_fullsized":"2023-08-17T18:10:35.143925+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.786094+0000","last_change":"2023-08-17T18:10:34.783746+0000","last_active":"2023-08-17T18:10:34.786094+0000","last_peered":"2023-08-17T18:10:34.786094+0000","last_clean":"2023-08-17T18:10:34.786094+0000","last_became_active":"2023-08-17T18:10:34.783451+0000","last_became_peered":"2023-08-17T18:10:34.783451+0000","last_unstale":"2023-08-17T18:10:34.786094+0000","last_undegraded":"2023-08-17T18:10:34.786094+0000","last_fullsized":"2023-08-17T18:10:34.786094+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.137726+0000","last_change":"2023-08-17T18:10:35.137726+0000","last_active":"2023-08-17T18:10:35.137726+0000","last_peered":"2023-08-17T18:10:35.137726+0000","last_clean":"2023-08-17T18:10:35.137726+0000","last_became_active":"2023-08-17T18:10:35.137436+0000","last_became_peered":"2023-08-17T18:10:35.137436+0000","last_unstale":"2023-08-17T18:10:35.137726+0000","last_undegraded":"2023-08-17T18:10:35.137726+0000","last_fullsized":"2023-08-17T18:10:35.137726+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"167'4","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.145398+0000","last_change":"2023-08-17T18:10:34.783077+0000","last_active":"2023-08-17T18:10:35.145398+0000","last_peered":"2023-08-17T18:10:35.145398+0000","last_clean":"2023-08-17T18:10:35.145398+0000","last_became_active":"2023-08-17T18:10:34.782763+0000","last_became_peered":"2023-08-17T18:10:34.782763+0000","last_unstale":"2023-08-17T18:10:35.145398+0000","last_undegraded":"2023-08-17T18:10:35.145398+0000","last_fullsized":"2023-08-17T18:10:35.145398+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.138737+0000","last_change":"2023-08-17T18:10:35.138737+0000","last_active":"2023-08-17T18:10:35.138737+0000","last_peered":"2023-08-17T18:10:35.138737+0000","last_clean":"2023-08-17T18:10:35.138737+0000","last_became_active":"2023-08-17T18:10:35.138436+0000","last_became_peered":"2023-08-17T18:10:35.138436+0000","last_unstale":"2023-08-17T18:10:35.138737+0000","last_undegraded":"2023-08-17T18:10:35.138737+0000","last_fullsized":"2023-08-17T18:10:35.138737+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.786085+0000","last_change":"2023-08-17T18:10:34.783522+0000","last_active":"2023-08-17T18:10:34.786085+0000","last_peered":"2023-08-17T18:10:34.786085+0000","last_clean":"2023-08-17T18:10:34.786085+0000","last_became_active":"2023-08-17T18:10:34.783235+0000","last_became_peered":"2023-08-17T18:10:34.783235+0000","last_unstale":"2023-08-17T18:10:34.786085+0000","last_undegraded":"2023-08-17T18:10:34.786085+0000","last_fullsized":"2023-08-17T18:10:34.786085+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.154432+0000","last_change":"2023-08-17T18:10:35.154432+0000","last_active":"2023-08-17T18:10:35.154432+0000","last_peered":"2023-08-17T18:10:35.154432+0000","last_clean":"2023-08-17T18:10:35.154432+0000","last_became_active":"2023-08-17T18:10:35.153939+0000","last_became_peered":"2023-08-17T18:10:35.153939+0000","last_unstale":"2023-08-17T18:10:35.154432+0000","last_undegraded":"2023-08-17T18:10:35.154432+0000","last_fullsized":"2023-08-17T18:10:35.154432+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785814+0000","last_change":"2023-08-17T18:10:34.782259+0000","last_active":"2023-08-17T18:10:34.785814+0000","last_peered":"2023-08-17T18:10:34.785814+0000","last_clean":"2023-08-17T18:10:34.785814+0000","last_became_active":"2023-08-17T18:10:34.782021+0000","last_became_peered":"2023-08-17T18:10:34.782021+0000","last_unstale":"2023-08-17T18:10:34.785814+0000","last_undegraded":"2023-08-17T18:10:34.785814+0000","last_fullsized":"2023-08-17T18:10:34.785814+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.135025+0000","last_change":"2023-08-17T18:10:35.135025+0000","last_active":"2023-08-17T18:10:35.135025+0000","last_peered":"2023-08-17T18:10:35.135025+0000","last_clean":"2023-08-17T18:10:35.135025+0000","last_became_active":"2023-08-17T18:10:35.134736+0000","last_became_peered":"2023-08-17T18:10:35.134736+0000","last_unstale":"2023-08-17T18:10:35.135025+0000","last_undegraded":"2023-08-17T18:10:35.135025+0000","last_fullsized":"2023-08-17T18:10:35.135025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.133957+0000","last_change":"2023-08-17T18:10:34.776382+0000","last_active":"2023-08-17T18:10:35.133957+0000","last_peered":"2023-08-17T18:10:35.133957+0000","last_clean":"2023-08-17T18:10:35.133957+0000","last_became_active":"2023-08-17T18:10:34.776088+0000","last_became_peered":"2023-08-17T18:10:34.776088+0000","last_unstale":"2023-08-17T18:10:35.133957+0000","last_undegraded":"2023-08-17T18:10:35.133957+0000","last_fullsized":"2023-08-17T18:10:35.133957+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.141101+0000","last_change":"2023-08-17T18:10:35.141101+0000","last_active":"2023-08-17T18:10:35.141101+0000","last_peered":"2023-08-17T18:10:35.141101+0000","last_clean":"2023-08-17T18:10:35.141101+0000","last_became_active":"2023-08-17T18:10:35.140734+0000","last_became_peered":"2023-08-17T18:10:35.140734+0000","last_unstale":"2023-08-17T18:10:35.141101+0000","last_undegraded":"2023-08-17T18:10:35.141101+0000","last_fullsized":"2023-08-17T18:10:35.141101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785265+0000","last_change":"2023-08-17T18:10:34.779935+0000","last_active":"2023-08-17T18:10:34.785265+0000","last_peered":"2023-08-17T18:10:34.785265+0000","last_clean":"2023-08-17T18:10:34.785265+0000","last_became_active":"2023-08-17T18:10:34.779665+0000","last_became_peered":"2023-08-17T18:10:34.779665+0000","last_unstale":"2023-08-17T18:10:34.785265+0000","last_undegraded":"2023-08-17T18:10:34.785265+0000","last_fullsized":"2023-08-17T18:10:34.785265+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142161+0000","last_change":"2023-08-17T18:10:35.142161+0000","last_active":"2023-08-17T18:10:35.142161+0000","last_peered":"2023-08-17T18:10:35.142161+0000","last_clean":"2023-08-17T18:10:35.142161+0000","last_became_active":"2023-08-17T18:10:35.141601+0000","last_became_peered":"2023-08-17T18:10:35.141601+0000","last_unstale":"2023-08-17T18:10:35.142161+0000","last_undegraded":"2023-08-17T18:10:35.142161+0000","last_fullsized":"2023-08-17T18:10:35.142161+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142868+0000","last_change":"2023-08-17T18:10:34.784533+0000","last_active":"2023-08-17T18:10:35.142868+0000","last_peered":"2023-08-17T18:10:35.142868+0000","last_clean":"2023-08-17T18:10:35.142868+0000","last_became_active":"2023-08-17T18:10:34.784244+0000","last_became_peered":"2023-08-17T18:10:34.784244+0000","last_unstale":"2023-08-17T18:10:35.142868+0000","last_undegraded":"2023-08-17T18:10:35.142868+0000","last_fullsized":"2023-08-17T18:10:35.142868+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.145273+0000","last_change":"2023-08-17T18:10:35.145273+0000","last_active":"2023-08-17T18:10:35.145273+0000","last_peered":"2023-08-17T18:10:35.145273+0000","last_clean":"2023-08-17T18:10:35.145273+0000","last_became_active":"2023-08-17T18:10:35.144945+0000","last_became_peered":"2023-08-17T18:10:35.144945+0000","last_unstale":"2023-08-17T18:10:35.145273+0000","last_undegraded":"2023-08-17T18:10:35.145273+0000","last_fullsized":"2023-08-17T18:10:35.145273+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784799+0000","last_change":"2023-08-17T18:10:34.780408+0000","last_active":"2023-08-17T18:10:34.784799+0000","last_peered":"2023-08-17T18:10:34.784799+0000","last_clean":"2023-08-17T18:10:34.784799+0000","last_became_active":"2023-08-17T18:10:34.779991+0000","last_became_peered":"2023-08-17T18:10:34.779991+0000","last_unstale":"2023-08-17T18:10:34.784799+0000","last_undegraded":"2023-08-17T18:10:34.784799+0000","last_fullsized":"2023-08-17T18:10:34.784799+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143454+0000","last_change":"2023-08-17T18:10:35.143454+0000","last_active":"2023-08-17T18:10:35.143454+0000","last_peered":"2023-08-17T18:10:35.143454+0000","last_clean":"2023-08-17T18:10:35.143454+0000","last_became_active":"2023-08-17T18:10:35.143146+0000","last_became_peered":"2023-08-17T18:10:35.143146+0000","last_unstale":"2023-08-17T18:10:35.143454+0000","last_undegraded":"2023-08-17T18:10:35.143454+0000","last_fullsized":"2023-08-17T18:10:35.143454+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784782+0000","last_change":"2023-08-17T18:10:34.780035+0000","last_active":"2023-08-17T18:10:34.784782+0000","last_peered":"2023-08-17T18:10:34.784782+0000","last_clean":"2023-08-17T18:10:34.784782+0000","last_became_active":"2023-08-17T18:10:34.779505+0000","last_became_peered":"2023-08-17T18:10:34.779505+0000","last_unstale":"2023-08-17T18:10:34.784782+0000","last_undegraded":"2023-08-17T18:10:34.784782+0000","last_fullsized":"2023-08-17T18:10:34.784782+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143369+0000","last_change":"2023-08-17T18:10:35.143369+0000","last_active":"2023-08-17T18:10:35.143369+0000","last_peered":"2023-08-17T18:10:35.143369+0000","last_clean":"2023-08-17T18:10:35.143369+0000","last_became_active":"2023-08-17T18:10:35.142989+0000","last_became_peered":"2023-08-17T18:10:35.142989+0000","last_unstale":"2023-08-17T18:10:35.143369+0000","last_undegraded":"2023-08-17T18:10:35.143369+0000","last_fullsized":"2023-08-17T18:10:35.143369+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785304+0000","last_change":"2023-08-17T18:10:34.778024+0000","last_active":"2023-08-17T18:10:34.785304+0000","last_peered":"2023-08-17T18:10:34.785304+0000","last_clean":"2023-08-17T18:10:34.785304+0000","last_became_active":"2023-08-17T18:10:34.777751+0000","last_became_peered":"2023-08-17T18:10:34.777751+0000","last_unstale":"2023-08-17T18:10:34.785304+0000","last_undegraded":"2023-08-17T18:10:34.785304+0000","last_fullsized":"2023-08-17T18:10:34.785304+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142679+0000","last_change":"2023-08-17T18:10:35.142679+0000","last_active":"2023-08-17T18:10:35.142679+0000","last_peered":"2023-08-17T18:10:35.142679+0000","last_clean":"2023-08-17T18:10:35.142679+0000","last_became_active":"2023-08-17T18:10:35.142343+0000","last_became_peered":"2023-08-17T18:10:35.142343+0000","last_unstale":"2023-08-17T18:10:35.142679+0000","last_undegraded":"2023-08-17T18:10:35.142679+0000","last_fullsized":"2023-08-17T18:10:35.142679+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785072+0000","last_change":"2023-08-17T18:10:34.776488+0000","last_active":"2023-08-17T18:10:34.785072+0000","last_peered":"2023-08-17T18:10:34.785072+0000","last_clean":"2023-08-17T18:10:34.785072+0000","last_became_active":"2023-08-17T18:10:34.776180+0000","last_became_peered":"2023-08-17T18:10:34.776180+0000","last_unstale":"2023-08-17T18:10:34.785072+0000","last_undegraded":"2023-08-17T18:10:34.785072+0000","last_fullsized":"2023-08-17T18:10:34.785072+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148629+0000","last_change":"2023-08-17T18:10:35.148629+0000","last_active":"2023-08-17T18:10:35.148629+0000","last_peered":"2023-08-17T18:10:35.148629+0000","last_clean":"2023-08-17T18:10:35.148629+0000","last_became_active":"2023-08-17T18:10:35.148384+0000","last_became_peered":"2023-08-17T18:10:35.148384+0000","last_unstale":"2023-08-17T18:10:35.148629+0000","last_undegraded":"2023-08-17T18:10:35.148629+0000","last_fullsized":"2023-08-17T18:10:35.148629+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785203+0000","last_change":"2023-08-17T18:10:34.774830+0000","last_active":"2023-08-17T18:10:34.785203+0000","last_peered":"2023-08-17T18:10:34.785203+0000","last_clean":"2023-08-17T18:10:34.785203+0000","last_became_active":"2023-08-17T18:10:34.774575+0000","last_became_peered":"2023-08-17T18:10:34.774575+0000","last_unstale":"2023-08-17T18:10:34.785203+0000","last_undegraded":"2023-08-17T18:10:34.785203+0000","last_fullsized":"2023-08-17T18:10:34.785203+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.137964+0000","last_change":"2023-08-17T18:10:35.137964+0000","last_active":"2023-08-17T18:10:35.137964+0000","last_peered":"2023-08-17T18:10:35.137964+0000","last_clean":"2023-08-17T18:10:35.137964+0000","last_became_active":"2023-08-17T18:10:35.137380+0000","last_became_peered":"2023-08-17T18:10:35.137380+0000","last_unstale":"2023-08-17T18:10:35.137964+0000","last_undegraded":"2023-08-17T18:10:35.137964+0000","last_fullsized":"2023-08-17T18:10:35.137964+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785168+0000","last_change":"2023-08-17T18:10:34.779025+0000","last_active":"2023-08-17T18:10:34.785168+0000","last_peered":"2023-08-17T18:10:34.785168+0000","last_clean":"2023-08-17T18:10:34.785168+0000","last_became_active":"2023-08-17T18:10:34.778759+0000","last_became_peered":"2023-08-17T18:10:34.778759+0000","last_unstale":"2023-08-17T18:10:34.785168+0000","last_undegraded":"2023-08-17T18:10:34.785168+0000","last_fullsized":"2023-08-17T18:10:34.785168+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.134470+0000","last_change":"2023-08-17T18:10:35.134470+0000","last_active":"2023-08-17T18:10:35.134470+0000","last_peered":"2023-08-17T18:10:35.134470+0000","last_clean":"2023-08-17T18:10:35.134470+0000","last_became_active":"2023-08-17T18:10:35.134195+0000","last_became_peered":"2023-08-17T18:10:35.134195+0000","last_unstale":"2023-08-17T18:10:35.134470+0000","last_undegraded":"2023-08-17T18:10:35.134470+0000","last_fullsized":"2023-08-17T18:10:35.134470+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784740+0000","last_change":"2023-08-17T18:10:34.779492+0000","last_active":"2023-08-17T18:10:34.784740+0000","last_peered":"2023-08-17T18:10:34.784740+0000","last_clean":"2023-08-17T18:10:34.784740+0000","last_became_active":"2023-08-17T18:10:34.779222+0000","last_became_peered":"2023-08-17T18:10:34.779222+0000","last_unstale":"2023-08-17T18:10:34.784740+0000","last_undegraded":"2023-08-17T18:10:34.784740+0000","last_fullsized":"2023-08-17T18:10:34.784740+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148969+0000","last_change":"2023-08-17T18:10:35.148969+0000","last_active":"2023-08-17T18:10:35.148969+0000","last_peered":"2023-08-17T18:10:35.148969+0000","last_clean":"2023-08-17T18:10:35.148969+0000","last_became_active":"2023-08-17T18:10:35.148163+0000","last_became_peered":"2023-08-17T18:10:35.148163+0000","last_unstale":"2023-08-17T18:10:35.148969+0000","last_undegraded":"2023-08-17T18:10:35.148969+0000","last_fullsized":"2023-08-17T18:10:35.148969+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785502+0000","last_change":"2023-08-17T18:10:34.780988+0000","last_active":"2023-08-17T18:10:34.785502+0000","last_peered":"2023-08-17T18:10:34.785502+0000","last_clean":"2023-08-17T18:10:34.785502+0000","last_became_active":"2023-08-17T18:10:34.780586+0000","last_became_peered":"2023-08-17T18:10:34.780586+0000","last_unstale":"2023-08-17T18:10:34.785502+0000","last_undegraded":"2023-08-17T18:10:34.785502+0000","last_fullsized":"2023-08-17T18:10:34.785502+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.146095+0000","last_change":"2023-08-17T18:10:35.146095+0000","last_active":"2023-08-17T18:10:35.146095+0000","last_peered":"2023-08-17T18:10:35.146095+0000","last_clean":"2023-08-17T18:10:35.146095+0000","last_became_active":"2023-08-17T18:10:35.145883+0000","last_became_peered":"2023-08-17T18:10:35.145883+0000","last_unstale":"2023-08-17T18:10:35.146095+0000","last_undegraded":"2023-08-17T18:10:35.146095+0000","last_fullsized":"2023-08-17T18:10:35.146095+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784540+0000","last_change":"2023-08-17T18:10:34.777847+0000","last_active":"2023-08-17T18:10:34.784540+0000","last_peered":"2023-08-17T18:10:34.784540+0000","last_clean":"2023-08-17T18:10:34.784540+0000","last_became_active":"2023-08-17T18:10:34.777473+0000","last_became_peered":"2023-08-17T18:10:34.777473+0000","last_unstale":"2023-08-17T18:10:34.784540+0000","last_undegraded":"2023-08-17T18:10:34.784540+0000","last_fullsized":"2023-08-17T18:10:34.784540+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.141959+0000","last_change":"2023-08-17T18:10:35.141959+0000","last_active":"2023-08-17T18:10:35.141959+0000","last_peered":"2023-08-17T18:10:35.141959+0000","last_clean":"2023-08-17T18:10:35.141959+0000","last_became_active":"2023-08-17T18:10:35.141689+0000","last_became_peered":"2023-08-17T18:10:35.141689+0000","last_unstale":"2023-08-17T18:10:35.141959+0000","last_undegraded":"2023-08-17T18:10:35.141959+0000","last_fullsized":"2023-08-17T18:10:35.141959+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784922+0000","last_change":"2023-08-17T18:10:34.779366+0000","last_active":"2023-08-17T18:10:34.784922+0000","last_peered":"2023-08-17T18:10:34.784922+0000","last_clean":"2023-08-17T18:10:34.784922+0000","last_became_active":"2023-08-17T18:10:34.779075+0000","last_became_peered":"2023-08-17T18:10:34.779075+0000","last_unstale":"2023-08-17T18:10:34.784922+0000","last_undegraded":"2023-08-17T18:10:34.784922+0000","last_fullsized":"2023-08-17T18:10:34.784922+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.147588+0000","last_change":"2023-08-17T18:10:35.147588+0000","last_active":"2023-08-17T18:10:35.147588+0000","last_peered":"2023-08-17T18:10:35.147588+0000","last_clean":"2023-08-17T18:10:35.147588+0000","last_became_active":"2023-08-17T18:10:35.147172+0000","last_became_peered":"2023-08-17T18:10:35.147172+0000","last_unstale":"2023-08-17T18:10:35.147588+0000","last_undegraded":"2023-08-17T18:10:35.147588+0000","last_fullsized":"2023-08-17T18:10:35.147588+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785119+0000","last_change":"2023-08-17T18:10:34.774956+0000","last_active":"2023-08-17T18:10:34.785119+0000","last_peered":"2023-08-17T18:10:34.785119+0000","last_clean":"2023-08-17T18:10:34.785119+0000","last_became_active":"2023-08-17T18:10:34.774676+0000","last_became_peered":"2023-08-17T18:10:34.774676+0000","last_unstale":"2023-08-17T18:10:34.785119+0000","last_undegraded":"2023-08-17T18:10:34.785119+0000","last_fullsized":"2023-08-17T18:10:34.785119+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.145566+0000","last_change":"2023-08-17T18:10:35.145566+0000","last_active":"2023-08-17T18:10:35.145566+0000","last_peered":"2023-08-17T18:10:35.145566+0000","last_clean":"2023-08-17T18:10:35.145566+0000","last_became_active":"2023-08-17T18:10:35.145352+0000","last_became_peered":"2023-08-17T18:10:35.145352+0000","last_unstale":"2023-08-17T18:10:35.145566+0000","last_undegraded":"2023-08-17T18:10:35.145566+0000","last_fullsized":"2023-08-17T18:10:35.145566+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.131600+0000","last_change":"2023-08-17T18:10:34.768333+0000","last_active":"2023-08-17T18:10:35.131600+0000","last_peered":"2023-08-17T18:10:35.131600+0000","last_clean":"2023-08-17T18:10:35.131600+0000","last_became_active":"2023-08-17T18:10:34.768070+0000","last_became_peered":"2023-08-17T18:10:34.768070+0000","last_unstale":"2023-08-17T18:10:35.131600+0000","last_undegraded":"2023-08-17T18:10:35.131600+0000","last_fullsized":"2023-08-17T18:10:35.131600+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.145295+0000","last_change":"2023-08-17T18:10:35.145295+0000","last_active":"2023-08-17T18:10:35.145295+0000","last_peered":"2023-08-17T18:10:35.145295+0000","last_clean":"2023-08-17T18:10:35.145295+0000","last_became_active":"2023-08-17T18:10:35.143889+0000","last_became_peered":"2023-08-17T18:10:35.143889+0000","last_unstale":"2023-08-17T18:10:35.145295+0000","last_undegraded":"2023-08-17T18:10:35.145295+0000","last_fullsized":"2023-08-17T18:10:35.145295+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.147266+0000","last_change":"2023-08-17T18:10:34.783041+0000","last_active":"2023-08-17T18:10:35.147266+0000","last_peered":"2023-08-17T18:10:35.147266+0000","last_clean":"2023-08-17T18:10:35.147266+0000","last_became_active":"2023-08-17T18:10:34.782818+0000","last_became_peered":"2023-08-17T18:10:34.782818+0000","last_unstale":"2023-08-17T18:10:35.147266+0000","last_undegraded":"2023-08-17T18:10:35.147266+0000","last_fullsized":"2023-08-17T18:10:35.147266+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.145356+0000","last_change":"2023-08-17T18:10:35.145356+0000","last_active":"2023-08-17T18:10:35.145356+0000","last_peered":"2023-08-17T18:10:35.145356+0000","last_clean":"2023-08-17T18:10:35.145356+0000","last_became_active":"2023-08-17T18:10:35.145008+0000","last_became_peered":"2023-08-17T18:10:35.145008+0000","last_unstale":"2023-08-17T18:10:35.145356+0000","last_undegraded":"2023-08-17T18:10:35.145356+0000","last_fullsized":"2023-08-17T18:10:35.145356+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.155089+0000","last_change":"2023-08-17T18:10:34.782926+0000","last_active":"2023-08-17T18:10:35.155089+0000","last_peered":"2023-08-17T18:10:35.155089+0000","last_clean":"2023-08-17T18:10:35.155089+0000","last_became_active":"2023-08-17T18:10:34.782582+0000","last_became_peered":"2023-08-17T18:10:34.782582+0000","last_unstale":"2023-08-17T18:10:35.155089+0000","last_undegraded":"2023-08-17T18:10:35.155089+0000","last_fullsized":"2023-08-17T18:10:35.155089+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.156062+0000","last_change":"2023-08-17T18:10:35.156062+0000","last_active":"2023-08-17T18:10:35.156062+0000","last_peered":"2023-08-17T18:10:35.156062+0000","last_clean":"2023-08-17T18:10:35.156062+0000","last_became_active":"2023-08-17T18:10:35.155821+0000","last_became_peered":"2023-08-17T18:10:35.155821+0000","last_unstale":"2023-08-17T18:10:35.156062+0000","last_undegraded":"2023-08-17T18:10:35.156062+0000","last_fullsized":"2023-08-17T18:10:35.156062+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785453+0000","last_change":"2023-08-17T18:10:34.780937+0000","last_active":"2023-08-17T18:10:34.785453+0000","last_peered":"2023-08-17T18:10:34.785453+0000","last_clean":"2023-08-17T18:10:34.785453+0000","last_became_active":"2023-08-17T18:10:34.780637+0000","last_became_peered":"2023-08-17T18:10:34.780637+0000","last_unstale":"2023-08-17T18:10:34.785453+0000","last_undegraded":"2023-08-17T18:10:34.785453+0000","last_fullsized":"2023-08-17T18:10:34.785453+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.137082+0000","last_change":"2023-08-17T18:10:35.137082+0000","last_active":"2023-08-17T18:10:35.137082+0000","last_peered":"2023-08-17T18:10:35.137082+0000","last_clean":"2023-08-17T18:10:35.137082+0000","last_became_active":"2023-08-17T18:10:35.136376+0000","last_became_peered":"2023-08-17T18:10:35.136376+0000","last_unstale":"2023-08-17T18:10:35.137082+0000","last_undegraded":"2023-08-17T18:10:35.137082+0000","last_fullsized":"2023-08-17T18:10:35.137082+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785718+0000","last_change":"2023-08-17T18:10:34.778493+0000","last_active":"2023-08-17T18:10:34.785718+0000","last_peered":"2023-08-17T18:10:34.785718+0000","last_clean":"2023-08-17T18:10:34.785718+0000","last_became_active":"2023-08-17T18:10:34.778225+0000","last_became_peered":"2023-08-17T18:10:34.778225+0000","last_unstale":"2023-08-17T18:10:34.785718+0000","last_undegraded":"2023-08-17T18:10:34.785718+0000","last_fullsized":"2023-08-17T18:10:34.785718+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144742+0000","last_change":"2023-08-17T18:10:35.144742+0000","last_active":"2023-08-17T18:10:35.144742+0000","last_peered":"2023-08-17T18:10:35.144742+0000","last_clean":"2023-08-17T18:10:35.144742+0000","last_became_active":"2023-08-17T18:10:35.143197+0000","last_became_peered":"2023-08-17T18:10:35.143197+0000","last_unstale":"2023-08-17T18:10:35.144742+0000","last_undegraded":"2023-08-17T18:10:35.144742+0000","last_fullsized":"2023-08-17T18:10:35.144742+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784875+0000","last_change":"2023-08-17T18:10:34.779059+0000","last_active":"2023-08-17T18:10:34.784875+0000","last_peered":"2023-08-17T18:10:34.784875+0000","last_clean":"2023-08-17T18:10:34.784875+0000","last_became_active":"2023-08-17T18:10:34.778577+0000","last_became_peered":"2023-08-17T18:10:34.778577+0000","last_unstale":"2023-08-17T18:10:34.784875+0000","last_undegraded":"2023-08-17T18:10:34.784875+0000","last_fullsized":"2023-08-17T18:10:34.784875+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.140162+0000","last_change":"2023-08-17T18:10:35.140162+0000","last_active":"2023-08-17T18:10:35.140162+0000","last_peered":"2023-08-17T18:10:35.140162+0000","last_clean":"2023-08-17T18:10:35.140162+0000","last_became_active":"2023-08-17T18:10:35.139882+0000","last_became_peered":"2023-08-17T18:10:35.139882+0000","last_unstale":"2023-08-17T18:10:35.140162+0000","last_undegraded":"2023-08-17T18:10:35.140162+0000","last_fullsized":"2023-08-17T18:10:35.140162+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785124+0000","last_change":"2023-08-17T18:10:34.780908+0000","last_active":"2023-08-17T18:10:34.785124+0000","last_peered":"2023-08-17T18:10:34.785124+0000","last_clean":"2023-08-17T18:10:34.785124+0000","last_became_active":"2023-08-17T18:10:34.780624+0000","last_became_peered":"2023-08-17T18:10:34.780624+0000","last_unstale":"2023-08-17T18:10:34.785124+0000","last_undegraded":"2023-08-17T18:10:34.785124+0000","last_fullsized":"2023-08-17T18:10:34.785124+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.152356+0000","last_change":"2023-08-17T18:10:35.152356+0000","last_active":"2023-08-17T18:10:35.152356+0000","last_peered":"2023-08-17T18:10:35.152356+0000","last_clean":"2023-08-17T18:10:35.152356+0000","last_became_active":"2023-08-17T18:10:35.152106+0000","last_became_peered":"2023-08-17T18:10:35.152106+0000","last_unstale":"2023-08-17T18:10:35.152356+0000","last_undegraded":"2023-08-17T18:10:35.152356+0000","last_fullsized":"2023-08-17T18:10:35.152356+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.772172+0000","last_change":"2023-08-17T18:10:34.765173+0000","last_active":"2023-08-17T18:10:34.772172+0000","last_peered":"2023-08-17T18:10:34.772172+0000","last_clean":"2023-08-17T18:10:34.772172+0000","last_became_active":"2023-08-17T18:10:34.764895+0000","last_became_peered":"2023-08-17T18:10:34.764895+0000","last_unstale":"2023-08-17T18:10:34.772172+0000","last_undegraded":"2023-08-17T18:10:34.772172+0000","last_fullsized":"2023-08-17T18:10:34.772172+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.151277+0000","last_change":"2023-08-17T18:10:35.151277+0000","last_active":"2023-08-17T18:10:35.151277+0000","last_peered":"2023-08-17T18:10:35.151277+0000","last_clean":"2023-08-17T18:10:35.151277+0000","last_became_active":"2023-08-17T18:10:35.150990+0000","last_became_peered":"2023-08-17T18:10:35.150990+0000","last_unstale":"2023-08-17T18:10:35.151277+0000","last_undegraded":"2023-08-17T18:10:35.151277+0000","last_fullsized":"2023-08-17T18:10:35.151277+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.133072+0000","last_change":"2023-08-17T18:10:34.777879+0000","last_active":"2023-08-17T18:10:35.133072+0000","last_peered":"2023-08-17T18:10:35.133072+0000","last_clean":"2023-08-17T18:10:35.133072+0000","last_became_active":"2023-08-17T18:10:34.777614+0000","last_became_peered":"2023-08-17T18:10:34.777614+0000","last_unstale":"2023-08-17T18:10:35.133072+0000","last_undegraded":"2023-08-17T18:10:35.133072+0000","last_fullsized":"2023-08-17T18:10:35.133072+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.154646+0000","last_change":"2023-08-17T18:10:35.154646+0000","last_active":"2023-08-17T18:10:35.154646+0000","last_peered":"2023-08-17T18:10:35.154646+0000","last_clean":"2023-08-17T18:10:35.154646+0000","last_became_active":"2023-08-17T18:10:35.154188+0000","last_became_peered":"2023-08-17T18:10:35.154188+0000","last_unstale":"2023-08-17T18:10:35.154646+0000","last_undegraded":"2023-08-17T18:10:35.154646+0000","last_fullsized":"2023-08-17T18:10:35.154646+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.153981+0000","last_change":"2023-08-17T18:10:34.786111+0000","last_active":"2023-08-17T18:10:35.153981+0000","last_peered":"2023-08-17T18:10:35.153981+0000","last_clean":"2023-08-17T18:10:35.153981+0000","last_became_active":"2023-08-17T18:10:34.785804+0000","last_became_peered":"2023-08-17T18:10:34.785804+0000","last_unstale":"2023-08-17T18:10:35.153981+0000","last_undegraded":"2023-08-17T18:10:35.153981+0000","last_fullsized":"2023-08-17T18:10:35.153981+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.137799+0000","last_change":"2023-08-17T18:10:35.137799+0000","last_active":"2023-08-17T18:10:35.137799+0000","last_peered":"2023-08-17T18:10:35.137799+0000","last_clean":"2023-08-17T18:10:35.137799+0000","last_became_active":"2023-08-17T18:10:35.136797+0000","last_became_peered":"2023-08-17T18:10:35.136797+0000","last_unstale":"2023-08-17T18:10:35.137799+0000","last_undegraded":"2023-08-17T18:10:35.137799+0000","last_fullsized":"2023-08-17T18:10:35.137799+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785436+0000","last_change":"2023-08-17T18:10:34.780942+0000","last_active":"2023-08-17T18:10:34.785436+0000","last_peered":"2023-08-17T18:10:34.785436+0000","last_clean":"2023-08-17T18:10:34.785436+0000","last_became_active":"2023-08-17T18:10:34.780655+0000","last_became_peered":"2023-08-17T18:10:34.780655+0000","last_unstale":"2023-08-17T18:10:34.785436+0000","last_undegraded":"2023-08-17T18:10:34.785436+0000","last_fullsized":"2023-08-17T18:10:34.785436+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142020+0000","last_change":"2023-08-17T18:10:35.142020+0000","last_active":"2023-08-17T18:10:35.142020+0000","last_peered":"2023-08-17T18:10:35.142020+0000","last_clean":"2023-08-17T18:10:35.142020+0000","last_became_active":"2023-08-17T18:10:35.141720+0000","last_became_peered":"2023-08-17T18:10:35.141720+0000","last_unstale":"2023-08-17T18:10:35.142020+0000","last_undegraded":"2023-08-17T18:10:35.142020+0000","last_fullsized":"2023-08-17T18:10:35.142020+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785724+0000","last_change":"2023-08-17T18:10:34.781961+0000","last_active":"2023-08-17T18:10:34.785724+0000","last_peered":"2023-08-17T18:10:34.785724+0000","last_clean":"2023-08-17T18:10:34.785724+0000","last_became_active":"2023-08-17T18:10:34.781663+0000","last_became_peered":"2023-08-17T18:10:34.781663+0000","last_unstale":"2023-08-17T18:10:34.785724+0000","last_undegraded":"2023-08-17T18:10:34.785724+0000","last_fullsized":"2023-08-17T18:10:34.785724+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.151595+0000","last_change":"2023-08-17T18:10:35.151595+0000","last_active":"2023-08-17T18:10:35.151595+0000","last_peered":"2023-08-17T18:10:35.151595+0000","last_clean":"2023-08-17T18:10:35.151595+0000","last_became_active":"2023-08-17T18:10:35.151326+0000","last_became_peered":"2023-08-17T18:10:35.151326+0000","last_unstale":"2023-08-17T18:10:35.151595+0000","last_undegraded":"2023-08-17T18:10:35.151595+0000","last_fullsized":"2023-08-17T18:10:35.151595+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.126649+0000","last_change":"2023-08-17T18:10:34.776636+0000","last_active":"2023-08-17T18:10:35.126649+0000","last_peered":"2023-08-17T18:10:35.126649+0000","last_clean":"2023-08-17T18:10:35.126649+0000","last_became_active":"2023-08-17T18:10:34.776381+0000","last_became_peered":"2023-08-17T18:10:34.776381+0000","last_unstale":"2023-08-17T18:10:35.126649+0000","last_undegraded":"2023-08-17T18:10:35.126649+0000","last_fullsized":"2023-08-17T18:10:35.126649+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.141499+0000","last_change":"2023-08-17T18:10:35.141499+0000","last_active":"2023-08-17T18:10:35.141499+0000","last_peered":"2023-08-17T18:10:35.141499+0000","last_clean":"2023-08-17T18:10:35.141499+0000","last_became_active":"2023-08-17T18:10:35.141257+0000","last_became_peered":"2023-08-17T18:10:35.141257+0000","last_unstale":"2023-08-17T18:10:35.141499+0000","last_undegraded":"2023-08-17T18:10:35.141499+0000","last_fullsized":"2023-08-17T18:10:35.141499+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.783672+0000","last_change":"2023-08-17T18:10:34.775357+0000","last_active":"2023-08-17T18:10:34.783672+0000","last_peered":"2023-08-17T18:10:34.783672+0000","last_clean":"2023-08-17T18:10:34.783672+0000","last_became_active":"2023-08-17T18:10:34.775055+0000","last_became_peered":"2023-08-17T18:10:34.775055+0000","last_unstale":"2023-08-17T18:10:34.783672+0000","last_undegraded":"2023-08-17T18:10:34.783672+0000","last_fullsized":"2023-08-17T18:10:34.783672+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.151829+0000","last_change":"2023-08-17T18:10:35.151829+0000","last_active":"2023-08-17T18:10:35.151829+0000","last_peered":"2023-08-17T18:10:35.151829+0000","last_clean":"2023-08-17T18:10:35.151829+0000","last_became_active":"2023-08-17T18:10:35.151545+0000","last_became_peered":"2023-08-17T18:10:35.151545+0000","last_unstale":"2023-08-17T18:10:35.151829+0000","last_undegraded":"2023-08-17T18:10:35.151829+0000","last_fullsized":"2023-08-17T18:10:35.151829+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.780637+0000","last_change":"2023-08-17T18:10:34.775679+0000","last_active":"2023-08-17T18:10:34.780637+0000","last_peered":"2023-08-17T18:10:34.780637+0000","last_clean":"2023-08-17T18:10:34.780637+0000","last_became_active":"2023-08-17T18:10:34.775413+0000","last_became_peered":"2023-08-17T18:10:34.775413+0000","last_unstale":"2023-08-17T18:10:34.780637+0000","last_undegraded":"2023-08-17T18:10:34.780637+0000","last_fullsized":"2023-08-17T18:10:34.780637+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142085+0000","last_change":"2023-08-17T18:10:35.142085+0000","last_active":"2023-08-17T18:10:35.142085+0000","last_peered":"2023-08-17T18:10:35.142085+0000","last_clean":"2023-08-17T18:10:35.142085+0000","last_became_active":"2023-08-17T18:10:35.141826+0000","last_became_peered":"2023-08-17T18:10:35.141826+0000","last_unstale":"2023-08-17T18:10:35.142085+0000","last_undegraded":"2023-08-17T18:10:35.142085+0000","last_fullsized":"2023-08-17T18:10:35.142085+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784728+0000","last_change":"2023-08-17T18:10:34.779748+0000","last_active":"2023-08-17T18:10:34.784728+0000","last_peered":"2023-08-17T18:10:34.784728+0000","last_clean":"2023-08-17T18:10:34.784728+0000","last_became_active":"2023-08-17T18:10:34.779258+0000","last_became_peered":"2023-08-17T18:10:34.779258+0000","last_unstale":"2023-08-17T18:10:34.784728+0000","last_undegraded":"2023-08-17T18:10:34.784728+0000","last_fullsized":"2023-08-17T18:10:34.784728+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.135197+0000","last_change":"2023-08-17T18:10:35.135197+0000","last_active":"2023-08-17T18:10:35.135197+0000","last_peered":"2023-08-17T18:10:35.135197+0000","last_clean":"2023-08-17T18:10:35.135197+0000","last_became_active":"2023-08-17T18:10:35.134941+0000","last_became_peered":"2023-08-17T18:10:35.134941+0000","last_unstale":"2023-08-17T18:10:35.135197+0000","last_undegraded":"2023-08-17T18:10:35.135197+0000","last_fullsized":"2023-08-17T18:10:35.135197+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.147004+0000","last_change":"2023-08-17T18:10:34.777122+0000","last_active":"2023-08-17T18:10:35.147004+0000","last_peered":"2023-08-17T18:10:35.147004+0000","last_clean":"2023-08-17T18:10:35.147004+0000","last_became_active":"2023-08-17T18:10:34.776845+0000","last_became_peered":"2023-08-17T18:10:34.776845+0000","last_unstale":"2023-08-17T18:10:35.147004+0000","last_undegraded":"2023-08-17T18:10:35.147004+0000","last_fullsized":"2023-08-17T18:10:35.147004+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144294+0000","last_change":"2023-08-17T18:10:35.144294+0000","last_active":"2023-08-17T18:10:35.144294+0000","last_peered":"2023-08-17T18:10:35.144294+0000","last_clean":"2023-08-17T18:10:35.144294+0000","last_became_active":"2023-08-17T18:10:35.144042+0000","last_became_peered":"2023-08-17T18:10:35.144042+0000","last_unstale":"2023-08-17T18:10:35.144294+0000","last_undegraded":"2023-08-17T18:10:35.144294+0000","last_fullsized":"2023-08-17T18:10:35.144294+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785035+0000","last_change":"2023-08-17T18:10:34.779584+0000","last_active":"2023-08-17T18:10:34.785035+0000","last_peered":"2023-08-17T18:10:34.785035+0000","last_clean":"2023-08-17T18:10:34.785035+0000","last_became_active":"2023-08-17T18:10:34.779162+0000","last_became_peered":"2023-08-17T18:10:34.779162+0000","last_unstale":"2023-08-17T18:10:34.785035+0000","last_undegraded":"2023-08-17T18:10:34.785035+0000","last_fullsized":"2023-08-17T18:10:34.785035+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.150606+0000","last_change":"2023-08-17T18:10:35.150606+0000","last_active":"2023-08-17T18:10:35.150606+0000","last_peered":"2023-08-17T18:10:35.150606+0000","last_clean":"2023-08-17T18:10:35.150606+0000","last_became_active":"2023-08-17T18:10:35.150383+0000","last_became_peered":"2023-08-17T18:10:35.150383+0000","last_unstale":"2023-08-17T18:10:35.150606+0000","last_undegraded":"2023-08-17T18:10:35.150606+0000","last_fullsized":"2023-08-17T18:10:35.150606+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785355+0000","last_change":"2023-08-17T18:10:34.777437+0000","last_active":"2023-08-17T18:10:34.785355+0000","last_peered":"2023-08-17T18:10:34.785355+0000","last_clean":"2023-08-17T18:10:34.785355+0000","last_became_active":"2023-08-17T18:10:34.777125+0000","last_became_peered":"2023-08-17T18:10:34.777125+0000","last_unstale":"2023-08-17T18:10:34.785355+0000","last_undegraded":"2023-08-17T18:10:34.785355+0000","last_fullsized":"2023-08-17T18:10:34.785355+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144350+0000","last_change":"2023-08-17T18:10:35.144350+0000","last_active":"2023-08-17T18:10:35.144350+0000","last_peered":"2023-08-17T18:10:35.144350+0000","last_clean":"2023-08-17T18:10:35.144350+0000","last_became_active":"2023-08-17T18:10:35.143959+0000","last_became_peered":"2023-08-17T18:10:35.143959+0000","last_unstale":"2023-08-17T18:10:35.144350+0000","last_undegraded":"2023-08-17T18:10:35.144350+0000","last_fullsized":"2023-08-17T18:10:35.144350+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.780084+0000","last_change":"2023-08-17T18:10:34.775913+0000","last_active":"2023-08-17T18:10:34.780084+0000","last_peered":"2023-08-17T18:10:34.780084+0000","last_clean":"2023-08-17T18:10:34.780084+0000","last_became_active":"2023-08-17T18:10:34.775645+0000","last_became_peered":"2023-08-17T18:10:34.775645+0000","last_unstale":"2023-08-17T18:10:34.780084+0000","last_undegraded":"2023-08-17T18:10:34.780084+0000","last_fullsized":"2023-08-17T18:10:34.780084+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.149256+0000","last_change":"2023-08-17T18:10:35.149256+0000","last_active":"2023-08-17T18:10:35.149256+0000","last_peered":"2023-08-17T18:10:35.149256+0000","last_clean":"2023-08-17T18:10:35.149256+0000","last_became_active":"2023-08-17T18:10:35.148478+0000","last_became_peered":"2023-08-17T18:10:35.148478+0000","last_unstale":"2023-08-17T18:10:35.149256+0000","last_undegraded":"2023-08-17T18:10:35.149256+0000","last_fullsized":"2023-08-17T18:10:35.149256+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784927+0000","last_change":"2023-08-17T18:10:34.778332+0000","last_active":"2023-08-17T18:10:34.784927+0000","last_peered":"2023-08-17T18:10:34.784927+0000","last_clean":"2023-08-17T18:10:34.784927+0000","last_became_active":"2023-08-17T18:10:34.778033+0000","last_became_peered":"2023-08-17T18:10:34.778033+0000","last_unstale":"2023-08-17T18:10:34.784927+0000","last_undegraded":"2023-08-17T18:10:34.784927+0000","last_fullsized":"2023-08-17T18:10:34.784927+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143885+0000","last_change":"2023-08-17T18:10:35.143885+0000","last_active":"2023-08-17T18:10:35.143885+0000","last_peered":"2023-08-17T18:10:35.143885+0000","last_clean":"2023-08-17T18:10:35.143885+0000","last_became_active":"2023-08-17T18:10:35.143597+0000","last_became_peered":"2023-08-17T18:10:35.143597+0000","last_unstale":"2023-08-17T18:10:35.143885+0000","last_undegraded":"2023-08-17T18:10:35.143885+0000","last_fullsized":"2023-08-17T18:10:35.143885+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785083+0000","last_change":"2023-08-17T18:10:34.777007+0000","last_active":"2023-08-17T18:10:34.785083+0000","last_peered":"2023-08-17T18:10:34.785083+0000","last_clean":"2023-08-17T18:10:34.785083+0000","last_became_active":"2023-08-17T18:10:34.776733+0000","last_became_peered":"2023-08-17T18:10:34.776733+0000","last_unstale":"2023-08-17T18:10:34.785083+0000","last_undegraded":"2023-08-17T18:10:34.785083+0000","last_fullsized":"2023-08-17T18:10:34.785083+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148485+0000","last_change":"2023-08-17T18:10:35.148485+0000","last_active":"2023-08-17T18:10:35.148485+0000","last_peered":"2023-08-17T18:10:35.148485+0000","last_clean":"2023-08-17T18:10:35.148485+0000","last_became_active":"2023-08-17T18:10:35.148188+0000","last_became_peered":"2023-08-17T18:10:35.148188+0000","last_unstale":"2023-08-17T18:10:35.148485+0000","last_undegraded":"2023-08-17T18:10:35.148485+0000","last_fullsized":"2023-08-17T18:10:35.148485+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.776324+0000","last_change":"2023-08-17T18:10:34.773063+0000","last_active":"2023-08-17T18:10:34.776324+0000","last_peered":"2023-08-17T18:10:34.776324+0000","last_clean":"2023-08-17T18:10:34.776324+0000","last_became_active":"2023-08-17T18:10:34.772794+0000","last_became_peered":"2023-08-17T18:10:34.772794+0000","last_unstale":"2023-08-17T18:10:34.776324+0000","last_undegraded":"2023-08-17T18:10:34.776324+0000","last_fullsized":"2023-08-17T18:10:34.776324+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.147399+0000","last_change":"2023-08-17T18:10:35.147399+0000","last_active":"2023-08-17T18:10:35.147399+0000","last_peered":"2023-08-17T18:10:35.147399+0000","last_clean":"2023-08-17T18:10:35.147399+0000","last_became_active":"2023-08-17T18:10:35.146842+0000","last_became_peered":"2023-08-17T18:10:35.146842+0000","last_unstale":"2023-08-17T18:10:35.147399+0000","last_undegraded":"2023-08-17T18:10:35.147399+0000","last_fullsized":"2023-08-17T18:10:35.147399+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785949+0000","last_change":"2023-08-17T18:10:34.783179+0000","last_active":"2023-08-17T18:10:34.785949+0000","last_peered":"2023-08-17T18:10:34.785949+0000","last_clean":"2023-08-17T18:10:34.785949+0000","last_became_active":"2023-08-17T18:10:34.782973+0000","last_became_peered":"2023-08-17T18:10:34.782973+0000","last_unstale":"2023-08-17T18:10:34.785949+0000","last_undegraded":"2023-08-17T18:10:34.785949+0000","last_fullsized":"2023-08-17T18:10:34.785949+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.149153+0000","last_change":"2023-08-17T18:10:35.149153+0000","last_active":"2023-08-17T18:10:35.149153+0000","last_peered":"2023-08-17T18:10:35.149153+0000","last_clean":"2023-08-17T18:10:35.149153+0000","last_became_active":"2023-08-17T18:10:35.148348+0000","last_became_peered":"2023-08-17T18:10:35.148348+0000","last_unstale":"2023-08-17T18:10:35.149153+0000","last_undegraded":"2023-08-17T18:10:35.149153+0000","last_fullsized":"2023-08-17T18:10:35.149153+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.131250+0000","last_change":"2023-08-17T18:10:34.770813+0000","last_active":"2023-08-17T18:10:35.131250+0000","last_peered":"2023-08-17T18:10:35.131250+0000","last_clean":"2023-08-17T18:10:35.131250+0000","last_became_active":"2023-08-17T18:10:34.770090+0000","last_became_peered":"2023-08-17T18:10:34.770090+0000","last_unstale":"2023-08-17T18:10:35.131250+0000","last_undegraded":"2023-08-17T18:10:35.131250+0000","last_fullsized":"2023-08-17T18:10:35.131250+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.766645+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T18:10:34.766645+0000","last_peered":"2023-08-17T18:10:34.766645+0000","last_clean":"2023-08-17T18:10:34.766645+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T18:10:34.766645+0000","last_undegraded":"2023-08-17T18:10:34.766645+0000","last_fullsized":"2023-08-17T18:10:34.766645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.135023+0000","last_change":"2023-08-17T18:10:35.135023+0000","last_active":"2023-08-17T18:10:35.135023+0000","last_peered":"2023-08-17T18:10:35.135023+0000","last_clean":"2023-08-17T18:10:35.135023+0000","last_became_active":"2023-08-17T18:10:35.134693+0000","last_became_peered":"2023-08-17T18:10:35.134693+0000","last_unstale":"2023-08-17T18:10:35.135023+0000","last_undegraded":"2023-08-17T18:10:35.135023+0000","last_fullsized":"2023-08-17T18:10:35.135023+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"167'3","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144305+0000","last_change":"2023-08-17T18:10:34.774595+0000","last_active":"2023-08-17T18:10:35.144305+0000","last_peered":"2023-08-17T18:10:35.144305+0000","last_clean":"2023-08-17T18:10:35.144305+0000","last_became_active":"2023-08-17T18:10:34.774327+0000","last_became_peered":"2023-08-17T18:10:34.774327+0000","last_unstale":"2023-08-17T18:10:35.144305+0000","last_undegraded":"2023-08-17T18:10:35.144305+0000","last_fullsized":"2023-08-17T18:10:35.144305+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.764375+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T18:10:34.764375+0000","last_peered":"2023-08-17T18:10:34.764375+0000","last_clean":"2023-08-17T18:10:34.764375+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T18:10:34.764375+0000","last_undegraded":"2023-08-17T18:10:34.764375+0000","last_fullsized":"2023-08-17T18:10:34.764375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.154303+0000","last_change":"2023-08-17T18:10:35.154303+0000","last_active":"2023-08-17T18:10:35.154303+0000","last_peered":"2023-08-17T18:10:35.154303+0000","last_clean":"2023-08-17T18:10:35.154303+0000","last_became_active":"2023-08-17T18:10:35.153988+0000","last_became_peered":"2023-08-17T18:10:35.153988+0000","last_unstale":"2023-08-17T18:10:35.154303+0000","last_undegraded":"2023-08-17T18:10:35.154303+0000","last_fullsized":"2023-08-17T18:10:35.154303+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.776399+0000","last_change":"2023-08-17T18:10:34.772196+0000","last_active":"2023-08-17T18:10:34.776399+0000","last_peered":"2023-08-17T18:10:34.776399+0000","last_clean":"2023-08-17T18:10:34.776399+0000","last_became_active":"2023-08-17T18:10:34.771884+0000","last_became_peered":"2023-08-17T18:10:34.771884+0000","last_unstale":"2023-08-17T18:10:34.776399+0000","last_undegraded":"2023-08-17T18:10:34.776399+0000","last_fullsized":"2023-08-17T18:10:34.776399+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.761980+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T18:10:34.761980+0000","last_peered":"2023-08-17T18:10:34.761980+0000","last_clean":"2023-08-17T18:10:34.761980+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T18:10:34.761980+0000","last_undegraded":"2023-08-17T18:10:34.761980+0000","last_fullsized":"2023-08-17T18:10:34.761980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.146078+0000","last_change":"2023-08-17T18:10:35.146078+0000","last_active":"2023-08-17T18:10:35.146078+0000","last_peered":"2023-08-17T18:10:35.146078+0000","last_clean":"2023-08-17T18:10:35.146078+0000","last_became_active":"2023-08-17T18:10:35.145722+0000","last_became_peered":"2023-08-17T18:10:35.145722+0000","last_unstale":"2023-08-17T18:10:35.146078+0000","last_undegraded":"2023-08-17T18:10:35.146078+0000","last_fullsized":"2023-08-17T18:10:35.146078+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148792+0000","last_change":"2023-08-17T18:10:34.780266+0000","last_active":"2023-08-17T18:10:35.148792+0000","last_peered":"2023-08-17T18:10:35.148792+0000","last_clean":"2023-08-17T18:10:35.148792+0000","last_became_active":"2023-08-17T18:10:34.780061+0000","last_became_peered":"2023-08-17T18:10:34.780061+0000","last_unstale":"2023-08-17T18:10:35.148792+0000","last_undegraded":"2023-08-17T18:10:35.148792+0000","last_fullsized":"2023-08-17T18:10:35.148792+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.765972+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T18:10:34.765972+0000","last_peered":"2023-08-17T18:10:34.765972+0000","last_clean":"2023-08-17T18:10:34.765972+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T18:10:34.765972+0000","last_undegraded":"2023-08-17T18:10:34.765972+0000","last_fullsized":"2023-08-17T18:10:34.765972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":130,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.770279+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T18:10:34.770279+0000","last_peered":"2023-08-17T18:10:34.770279+0000","last_clean":"2023-08-17T18:10:34.770279+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T18:10:34.770279+0000","last_undegraded":"2023-08-17T18:10:34.770279+0000","last_fullsized":"2023-08-17T18:10:34.770279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.152530+0000","last_change":"2023-08-17T18:10:35.152530+0000","last_active":"2023-08-17T18:10:35.152530+0000","last_peered":"2023-08-17T18:10:35.152530+0000","last_clean":"2023-08-17T18:10:35.152530+0000","last_became_active":"2023-08-17T18:10:35.152260+0000","last_became_peered":"2023-08-17T18:10:35.152260+0000","last_unstale":"2023-08-17T18:10:35.152530+0000","last_undegraded":"2023-08-17T18:10:35.152530+0000","last_fullsized":"2023-08-17T18:10:35.152530+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785995+0000","last_change":"2023-08-17T18:10:34.783519+0000","last_active":"2023-08-17T18:10:34.785995+0000","last_peered":"2023-08-17T18:10:34.785995+0000","last_clean":"2023-08-17T18:10:34.785995+0000","last_became_active":"2023-08-17T18:10:34.783214+0000","last_became_peered":"2023-08-17T18:10:34.783214+0000","last_unstale":"2023-08-17T18:10:34.785995+0000","last_undegraded":"2023-08-17T18:10:34.785995+0000","last_fullsized":"2023-08-17T18:10:34.785995+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.770356+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T18:10:34.770356+0000","last_peered":"2023-08-17T18:10:34.770356+0000","last_clean":"2023-08-17T18:10:34.770356+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T18:10:34.770356+0000","last_undegraded":"2023-08-17T18:10:34.770356+0000","last_fullsized":"2023-08-17T18:10:34.770356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144988+0000","last_change":"2023-08-17T18:10:35.144988+0000","last_active":"2023-08-17T18:10:35.144988+0000","last_peered":"2023-08-17T18:10:35.144988+0000","last_clean":"2023-08-17T18:10:35.144988+0000","last_became_active":"2023-08-17T18:10:35.144069+0000","last_became_peered":"2023-08-17T18:10:35.144069+0000","last_unstale":"2023-08-17T18:10:35.144988+0000","last_undegraded":"2023-08-17T18:10:35.144988+0000","last_fullsized":"2023-08-17T18:10:35.144988+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.780612+0000","last_change":"2023-08-17T18:10:34.778267+0000","last_active":"2023-08-17T18:10:34.780612+0000","last_peered":"2023-08-17T18:10:34.780612+0000","last_clean":"2023-08-17T18:10:34.780612+0000","last_became_active":"2023-08-17T18:10:34.777911+0000","last_became_peered":"2023-08-17T18:10:34.777911+0000","last_unstale":"2023-08-17T18:10:34.780612+0000","last_undegraded":"2023-08-17T18:10:34.780612+0000","last_fullsized":"2023-08-17T18:10:34.780612+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.774496+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T18:10:34.774496+0000","last_peered":"2023-08-17T18:10:34.774496+0000","last_clean":"2023-08-17T18:10:34.774496+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T18:10:34.774496+0000","last_undegraded":"2023-08-17T18:10:34.774496+0000","last_fullsized":"2023-08-17T18:10:34.774496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.135951+0000","last_change":"2023-08-17T18:10:35.135951+0000","last_active":"2023-08-17T18:10:35.135951+0000","last_peered":"2023-08-17T18:10:35.135951+0000","last_clean":"2023-08-17T18:10:35.135951+0000","last_became_active":"2023-08-17T18:10:35.135583+0000","last_became_peered":"2023-08-17T18:10:35.135583+0000","last_unstale":"2023-08-17T18:10:35.135951+0000","last_undegraded":"2023-08-17T18:10:35.135951+0000","last_fullsized":"2023-08-17T18:10:35.135951+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.790851+0000","last_change":"2023-08-17T18:10:34.785756+0000","last_active":"2023-08-17T18:10:34.790851+0000","last_peered":"2023-08-17T18:10:34.790851+0000","last_clean":"2023-08-17T18:10:34.790851+0000","last_became_active":"2023-08-17T18:10:34.785407+0000","last_became_peered":"2023-08-17T18:10:34.785407+0000","last_unstale":"2023-08-17T18:10:34.790851+0000","last_undegraded":"2023-08-17T18:10:34.790851+0000","last_fullsized":"2023-08-17T18:10:34.790851+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.767421+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T18:10:34.767421+0000","last_peered":"2023-08-17T18:10:34.767421+0000","last_clean":"2023-08-17T18:10:34.767421+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T18:10:34.767421+0000","last_undegraded":"2023-08-17T18:10:34.767421+0000","last_fullsized":"2023-08-17T18:10:34.767421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.138003+0000","last_change":"2023-08-17T18:10:35.138003+0000","last_active":"2023-08-17T18:10:35.138003+0000","last_peered":"2023-08-17T18:10:35.138003+0000","last_clean":"2023-08-17T18:10:35.138003+0000","last_became_active":"2023-08-17T18:10:35.137747+0000","last_became_peered":"2023-08-17T18:10:35.137747+0000","last_unstale":"2023-08-17T18:10:35.138003+0000","last_undegraded":"2023-08-17T18:10:35.138003+0000","last_fullsized":"2023-08-17T18:10:35.138003+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"167'4","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.151337+0000","last_change":"2023-08-17T18:10:34.776380+0000","last_active":"2023-08-17T18:10:35.151337+0000","last_peered":"2023-08-17T18:10:35.151337+0000","last_clean":"2023-08-17T18:10:35.151337+0000","last_became_active":"2023-08-17T18:10:34.776040+0000","last_became_peered":"2023-08-17T18:10:34.776040+0000","last_unstale":"2023-08-17T18:10:35.151337+0000","last_undegraded":"2023-08-17T18:10:35.151337+0000","last_fullsized":"2023-08-17T18:10:35.151337+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.767343+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T18:10:34.767343+0000","last_peered":"2023-08-17T18:10:34.767343+0000","last_clean":"2023-08-17T18:10:34.767343+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T18:10:34.767343+0000","last_undegraded":"2023-08-17T18:10:34.767343+0000","last_fullsized":"2023-08-17T18:10:34.767343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575278,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303204,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068636,"statfs":{"total":96636764160,"available":96326283264,"internally_reserved":0,"allocated":2060288,"data_stored":1030071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.313},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.29299999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.77100000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.372},"max":{"1min":0.73499999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.35499999999999998,"15min":0.315},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.5},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.47699999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78600000000000003,"5min":0.80400000000000005,"15min":0.81699999999999995},"last":0.622},{"interface":"front","average":{"1min":0.625,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.47599999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.34399999999999997,"5min":0.29499999999999998,"15min":0.247},"max":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.32300000000000001},"max":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.76900000000000002},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.28299999999999997},"max":{"1min":0.76700000000000002,"5min":0.79800000000000004,"15min":0.81699999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.32900000000000001},"max":{"1min":0.752,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.82999999999999996,"15min":0.84199999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.44700000000000001,"5min":0.36899999999999999,"15min":0.32700000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.82099999999999995},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575278,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303216,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068624,"statfs":{"total":96636764160,"available":96326270976,"internally_reserved":0,"allocated":2072576,"data_stored":1036750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52600000000000002,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.312},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.625},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59999999999999998},"min":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.371},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45100000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.88700000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47999999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.373}]},{"osd":5,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":1.0269999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.84299999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.32300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.37},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.97699999999999998},"last":0.433}]}]},{"osd":1,"up_from":13,"seq":55834575279,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303204,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068636,"statfs":{"total":96636764160,"available":96326283264,"internally_reserved":0,"allocated":2060288,"data_stored":1030071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35599999999999998,"15min":0.35499999999999998},"min":{"1min":0.24399999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.497,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.39300000000000002,"15min":0.38500000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.215},"max":{"1min":0.47899999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38300000000000001,"15min":0.372},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.504,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.41199999999999998,"15min":0.40899999999999997},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.621},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.59099999999999997,"5min":1.095,"15min":1.095},"last":0.375},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":0.57799999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.311}]},{"osd":4,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.47499999999999998,"5min":0.39500000000000002,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61599999999999999,"15min":0.61899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.96199999999999997},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.40899999999999997,"15min":0.38300000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.94499999999999995},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.40300000000000002},"max":{"1min":0.82099999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.42199999999999999,"15min":0.42099999999999999},"max":{"1min":0.82799999999999996,"5min":0.89500000000000002,"15min":0.91800000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89300000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575278,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303216,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068624,"statfs":{"total":96636764160,"available":96326270976,"internally_reserved":0,"allocated":2072576,"data_stored":1036750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35199999999999998,"15min":0.36199999999999999},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.54800000000000004,"5min":0.64100000000000001,"15min":0.77600000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38600000000000001,"15min":0.40100000000000002},"min":{"1min":0.29799999999999999,"5min":0.27900000000000003,"15min":0.24399999999999999},"max":{"1min":0.46800000000000003,"5min":0.63500000000000001,"15min":0.70899999999999996},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.374,"15min":0.378},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.56000000000000005,"5min":0.61199999999999999,"15min":0.61399999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40899999999999997,"15min":0.42299999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":0.70299999999999996,"15min":0.754},"last":0.313}]},{"osd":3,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.25800000000000001},"max":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.66100000000000003},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.42899999999999999},"min":{"1min":0.29099999999999998,"5min":0.26300000000000001,"15min":0.253},"max":{"1min":0.60199999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.376}]},{"osd":4,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.627,"15min":0.63400000000000001},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.379},"max":{"1min":0.80400000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76400000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.627,"15min":0.63400000000000001},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.38300000000000001},"max":{"1min":0.82899999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.621,"15min":0.624},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.35199999999999998},"max":{"1min":0.752,"5min":1.079,"15min":1.079},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.42399999999999999,"15min":0.371},"max":{"1min":0.81499999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65600000000000003,"15min":0.67800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":1.0549999999999999,"15min":1.0820000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.53300000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.872,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834575278,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303216,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068624,"statfs":{"total":96636764160,"available":96326270976,"internally_reserved":0,"allocated":2072576,"data_stored":1036750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.20300000000000001},"max":{"1min":0.41999999999999998,"5min":0.62,"15min":0.623},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.377,"15min":0.36899999999999999},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.249},"max":{"1min":0.46700000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.28100000000000003,"15min":0.26100000000000001},"max":{"1min":0.53200000000000003,"5min":0.61599999999999999,"15min":0.68100000000000005},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42499999999999999,"15min":0.42399999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25600000000000001},"max":{"1min":0.504,"5min":0.60299999999999998,"15min":0.72999999999999998},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.26700000000000002},"max":{"1min":0.54400000000000004,"5min":0.64000000000000001,"15min":0.67000000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.26700000000000002},"max":{"1min":0.58699999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.38500000000000001},"max":{"1min":0.71199999999999997,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.627},"min":{"1min":0.44,"5min":0.438,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":1.21}]},{"osd":5,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.41999999999999998},"max":{"1min":0.90400000000000003,"5min":0.91000000000000003,"15min":0.94799999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63900000000000001,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81499999999999995,"5min":0.91500000000000004,"15min":1.3100000000000001},"last":1.254}]},{"osd":6,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.79200000000000004,"5min":0.89900000000000002,"15min":0.96099999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82999999999999996,"5min":0.94199999999999995,"15min":1.0549999999999999},"last":0.749}]},{"osd":7,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.65800000000000003,"15min":0.65500000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.42099999999999999},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":1.353},"last":1.234},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.93500000000000005,"15min":1.0469999999999999},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575278,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307312,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064528,"statfs":{"total":96636764160,"available":96322076672,"internally_reserved":0,"allocated":2072576,"data_stored":1036750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.27400000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.44800000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"last":0.433},{"interface":"front","average":{"1min":0.376,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.504,"5min":0.59899999999999998,"15min":0.625},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38400000000000001,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54200000000000004,"5min":0.59399999999999997,"15min":0.72299999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.40899999999999997},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63400000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.314,"5min":0.28399999999999997,"15min":0.24199999999999999},"max":{"1min":0.56899999999999995,"5min":0.58999999999999997,"15min":0.98699999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.32900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.96399999999999997},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.622,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.437,"15min":0.39500000000000002},"max":{"1min":0.87,"5min":0.89900000000000002,"15min":0.95499999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.50800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.93100000000000005},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.49299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.96299999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.90700000000000003},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.57299999999999995,"5min":0.378,"15min":0.378},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94399999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.52100000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94899999999999995},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.60899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.97099999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.52400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303236,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068604,"statfs":{"total":96636764160,"available":96326250496,"internally_reserved":0,"allocated":2093056,"data_stored":1044573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.33900000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.437}]},{"osd":1,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.69999999999999996,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.51100000000000001,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.83799999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.81999999999999995},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.58599999999999997,"15min":0.56899999999999995},"min":{"1min":0.45600000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.47299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.5}]},{"osd":5,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54800000000000004,"5min":0.72099999999999997,"15min":0.79700000000000004},"last":0.75},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.28799999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.629}]},{"osd":7,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.379,"5min":0.33600000000000002,"15min":0.33300000000000002},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.872,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575277,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307300,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064540,"statfs":{"total":96636764160,"available":96322088960,"internally_reserved":0,"allocated":2060288,"data_stored":1030071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.72599999999999998,"15min":0.80300000000000005},"last":0.497},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.39900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.76500000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.38700000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.78200000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72699999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72099999999999997,"5min":0.79500000000000004,"15min":0.83899999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.34300000000000003},"max":{"1min":0.72999999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68200000000000005,"5min":0.76100000000000001,"15min":0.79900000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.378},"max":{"1min":0.70299999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.437,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28000000000000003},"max":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.71599999999999997},"last":0.433},{"interface":"front","average":{"1min":0.439,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.622,"5min":0.71599999999999997,"15min":0.76200000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.73599999999999999,"15min":0.79500000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.76700000000000002},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72199999999999998,"5min":0.752,"15min":0.81499999999999995},"last":0.623},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.77000000000000002,"15min":0.82999999999999996},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T18:10:38.136 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T18:10:38.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.280+0000 7ff874b9a700 1 Processor -- start 2023-08-17T18:10:38.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.280+0000 7ff874b9a700 1 -- start start 2023-08-17T18:10:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.281+0000 7ff874b9a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 0x7ff870063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.281+0000 7ff874b9a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8700a8050 0x7ff8700642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.281+0000 7ff874b9a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff870063960 con 0x7ff8700c01b0 2023-08-17T18:10:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.281+0000 7ff874b9a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff870063030 con 0x7ff8700a8050 2023-08-17T18:10:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.281+0000 7ff874b9a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff870063310 con 0x7ff8700a7bd0 2023-08-17T18:10:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.281+0000 7ff86ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8700a8050 0x7ff8700642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.281+0000 7ff86ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8700a8050 0x7ff8700642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:33224/0 (socket says 172.21.15.78:33224) 2023-08-17T18:10:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.281+0000 7ff86ffff700 1 -- 172.21.15.78:0/3246741120 learned_addr learned my addr 172.21.15.78:0/3246741120 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.281+0000 7ff86effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 0x7ff870063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff86effd700 1 -- 172.21.15.78:0/3246741120 >> v2:172.21.15.150:3300/0 conn(0x7ff8700a8050 msgr2=0x7ff8700642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:38.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff86effd700 1 --2- 172.21.15.78:0/3246741120 >> v2:172.21.15.150:3300/0 conn(0x7ff8700a8050 0x7ff8700642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff86effd700 1 -- 172.21.15.78:0/3246741120 >> v1:172.21.15.150:6789/0 conn(0x7ff8700c01b0 legacy=0x7ff8700c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff86effd700 1 -- 172.21.15.78:0/3246741120 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700635f0 con 0x7ff8700a7bd0 2023-08-17T18:10:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff86ffff700 1 --2- 172.21.15.78:0/3246741120 >> v2:172.21.15.150:3300/0 conn(0x7ff8700a8050 0x7ff8700642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff86effd700 1 --2- 172.21.15.78:0/3246741120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 0x7ff870063df0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff864009760 tx=0x7ff864009060).ready entity=mon.2 client_cookie=147be768d33bf604 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff86e7fc700 1 -- 172.21.15.78:0/3246741120 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86400f510 con 0x7ff8700a7bd0 2023-08-17T18:10:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff86e7fc700 1 -- 172.21.15.78:0/3246741120 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86400f670 con 0x7ff8700a7bd0 2023-08-17T18:10:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff86e7fc700 1 -- 172.21.15.78:0/3246741120 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86400f9f0 con 0x7ff8700a7bd0 2023-08-17T18:10:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff874b9a700 1 -- 172.21.15.78:0/3246741120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 msgr2=0x7ff870063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.282+0000 7ff874b9a700 1 --2- 172.21.15.78:0/3246741120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 0x7ff870063df0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff864009760 tx=0x7ff864009060).stop 2023-08-17T18:10:38.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.283+0000 7ff874b9a700 1 -- 172.21.15.78:0/3246741120 shutdown_connections 2023-08-17T18:10:38.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.283+0000 7ff874b9a700 1 --2- 172.21.15.78:0/3246741120 >> v2:172.21.15.150:3300/0 conn(0x7ff8700a8050 0x7ff8700642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.283+0000 7ff874b9a700 1 --2- 172.21.15.78:0/3246741120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 0x7ff870063df0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.283+0000 7ff874b9a700 1 -- 172.21.15.78:0/3246741120 >> 172.21.15.78:0/3246741120 conn(0x7ff87006a6c0 msgr2=0x7ff8700cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:38.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.283+0000 7ff874b9a700 1 -- 172.21.15.78:0/3246741120 shutdown_connections 2023-08-17T18:10:38.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.283+0000 7ff874b9a700 1 -- 172.21.15.78:0/3246741120 wait complete. 2023-08-17T18:10:38.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.284+0000 7ff874b9a700 1 Processor -- start 2023-08-17T18:10:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.284+0000 7ff874b9a700 1 -- start start 2023-08-17T18:10:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff874b9a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 0x7ff8700abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff874b9a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8700a8050 0x7ff8700b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff874b9a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8700c01b0 0x7ff8700aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff874b9a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700aba40 con 0x7ff8700a8050 2023-08-17T18:10:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff874b9a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700aabb0 con 0x7ff8700c01b0 2023-08-17T18:10:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff874b9a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700aae30 con 0x7ff8700a7bd0 2023-08-17T18:10:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8700a8050 0x7ff8700b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8700a8050 0x7ff8700b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38900/0 (socket says 172.21.15.78:38900) 2023-08-17T18:10:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86effd700 1 -- 172.21.15.78:0/1610192904 learned_addr learned my addr 172.21.15.78:0/1610192904 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86ffff700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8700c01b0 0x7ff8700aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86f7fe700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 0x7ff8700abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86effd700 1 -- 172.21.15.78:0/1610192904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 msgr2=0x7ff8700abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86effd700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 0x7ff8700abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86effd700 1 -- 172.21.15.78:0/1610192904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8700c01b0 msgr2=0x7ff8700aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86effd700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8700c01b0 0x7ff8700aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86effd700 1 -- 172.21.15.78:0/1610192904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff868009370 con 0x7ff8700a8050 2023-08-17T18:10:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86ffff700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8700c01b0 0x7ff8700aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff86effd700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8700a8050 0x7ff8700b09a0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7ff8700843d0 tx=0x7ff864017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff8577fe700 1 -- 172.21.15.78:0/1610192904 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86400f7e0 con 0x7ff8700a8050 2023-08-17T18:10:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff8577fe700 1 -- 172.21.15.78:0/1610192904 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86400f940 con 0x7ff8700a8050 2023-08-17T18:10:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff8577fe700 1 -- 172.21.15.78:0/1610192904 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86401b660 con 0x7ff8700a8050 2023-08-17T18:10:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff874b9a700 1 -- 172.21.15.78:0/1610192904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8640092a0 con 0x7ff8700a8050 2023-08-17T18:10:38.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.285+0000 7ff874b9a700 1 -- 172.21.15.78:0/1610192904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8700ab3f0 con 0x7ff8700a8050 2023-08-17T18:10:38.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.286+0000 7ff874b9a700 1 -- 172.21.15.78:0/1610192904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff870083af0 con 0x7ff8700a8050 2023-08-17T18:10:38.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.287+0000 7ff8577fe700 1 -- 172.21.15.78:0/1610192904 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff86400f070 con 0x7ff8700a8050 2023-08-17T18:10:38.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.287+0000 7ff8577fe700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff85c05ed90 0x7ff85c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.287+0000 7ff8577fe700 1 -- 172.21.15.78:0/1610192904 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff86407b620 con 0x7ff8700a8050 2023-08-17T18:10:38.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.287+0000 7ff86f7fe700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff85c05ed90 0x7ff85c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.288+0000 7ff86f7fe700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff85c05ed90 0x7ff85c061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff860003dd0 tx=0x7ff860009040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:38.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.291+0000 7ff8577fe700 1 -- 172.21.15.78:0/1610192904 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff86404cbc0 con 0x7ff8700a8050 2023-08-17T18:10:38.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.451+0000 7ff874b9a700 1 -- 172.21.15.78:0/1610192904 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8700c63e0 con 0x7ff85c05ed90 2023-08-17T18:10:38.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.460+0000 7ff8577fe700 1 -- 172.21.15.78:0/1610192904 <== mgr.8919 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362016 (secure 0 0 0) 0x7ff8700c63e0 con 0x7ff85c05ed90 2023-08-17T18:10:38.464 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:38.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 -- 172.21.15.78:0/1610192904 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff85c05ed90 msgr2=0x7ff85c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff85c05ed90 0x7ff85c061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff860003dd0 tx=0x7ff860009040).stop 2023-08-17T18:10:38.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 -- 172.21.15.78:0/1610192904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8700a8050 msgr2=0x7ff8700b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8700a8050 0x7ff8700b09a0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7ff8700843d0 tx=0x7ff864017000).stop 2023-08-17T18:10:38.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 -- 172.21.15.78:0/1610192904 shutdown_connections 2023-08-17T18:10:38.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff85c05ed90 0x7ff85c061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8700c01b0 0x7ff8700aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8700a7bd0 0x7ff8700abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 --2- 172.21.15.78:0/1610192904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8700a8050 0x7ff8700b09a0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 -- 172.21.15.78:0/1610192904 >> 172.21.15.78:0/1610192904 conn(0x7ff87006a6c0 msgr2=0x7ff8700a9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:38.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 -- 172.21.15.78:0/1610192904 shutdown_connections 2023-08-17T18:10:38.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.464+0000 7ff874b9a700 1 -- 172.21.15.78:0/1610192904 wait complete. 2023-08-17T18:10:38.468 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T18:10:38.477 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T18:10:38.250364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433904,"kb_used_data":16176,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752540816,"statfs":{"total":773094113280,"available":770601795584,"internally_reserved":0,"allocated":16564224,"data_stored":8281786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-592747,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-206,"num_write_kb":-717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-554,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.374691"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.141754+0000","last_change":"2023-08-17T18:10:35.141754+0000","last_active":"2023-08-17T18:10:35.141754+0000","last_peered":"2023-08-17T18:10:35.141754+0000","last_clean":"2023-08-17T18:10:35.141754+0000","last_became_active":"2023-08-17T18:10:35.141464+0000","last_became_peered":"2023-08-17T18:10:35.141464+0000","last_unstale":"2023-08-17T18:10:35.141754+0000","last_undegraded":"2023-08-17T18:10:35.141754+0000","last_fullsized":"2023-08-17T18:10:35.141754+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"167'3","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.154072+0000","last_change":"2023-08-17T18:10:34.780150+0000","last_active":"2023-08-17T18:10:35.154072+0000","last_peered":"2023-08-17T18:10:35.154072+0000","last_clean":"2023-08-17T18:10:35.154072+0000","last_became_active":"2023-08-17T18:10:34.779873+0000","last_became_peered":"2023-08-17T18:10:34.779873+0000","last_unstale":"2023-08-17T18:10:35.154072+0000","last_undegraded":"2023-08-17T18:10:35.154072+0000","last_fullsized":"2023-08-17T18:10:35.154072+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.154569+0000","last_change":"2023-08-17T18:10:35.154569+0000","last_active":"2023-08-17T18:10:35.154569+0000","last_peered":"2023-08-17T18:10:35.154569+0000","last_clean":"2023-08-17T18:10:35.154569+0000","last_became_active":"2023-08-17T18:10:35.154274+0000","last_became_peered":"2023-08-17T18:10:35.154274+0000","last_unstale":"2023-08-17T18:10:35.154569+0000","last_undegraded":"2023-08-17T18:10:35.154569+0000","last_fullsized":"2023-08-17T18:10:35.154569+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.778660+0000","last_change":"2023-08-17T18:10:34.770595+0000","last_active":"2023-08-17T18:10:34.778660+0000","last_peered":"2023-08-17T18:10:34.778660+0000","last_clean":"2023-08-17T18:10:34.778660+0000","last_became_active":"2023-08-17T18:10:34.770312+0000","last_became_peered":"2023-08-17T18:10:34.770312+0000","last_unstale":"2023-08-17T18:10:34.778660+0000","last_undegraded":"2023-08-17T18:10:34.778660+0000","last_fullsized":"2023-08-17T18:10:34.778660+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142589+0000","last_change":"2023-08-17T18:10:35.142589+0000","last_active":"2023-08-17T18:10:35.142589+0000","last_peered":"2023-08-17T18:10:35.142589+0000","last_clean":"2023-08-17T18:10:35.142589+0000","last_became_active":"2023-08-17T18:10:35.142313+0000","last_became_peered":"2023-08-17T18:10:35.142313+0000","last_unstale":"2023-08-17T18:10:35.142589+0000","last_undegraded":"2023-08-17T18:10:35.142589+0000","last_fullsized":"2023-08-17T18:10:35.142589+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785855+0000","last_change":"2023-08-17T18:10:34.782766+0000","last_active":"2023-08-17T18:10:34.785855+0000","last_peered":"2023-08-17T18:10:34.785855+0000","last_clean":"2023-08-17T18:10:34.785855+0000","last_became_active":"2023-08-17T18:10:34.782485+0000","last_became_peered":"2023-08-17T18:10:34.782485+0000","last_unstale":"2023-08-17T18:10:34.785855+0000","last_undegraded":"2023-08-17T18:10:34.785855+0000","last_fullsized":"2023-08-17T18:10:34.785855+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.151992+0000","last_change":"2023-08-17T18:10:35.151992+0000","last_active":"2023-08-17T18:10:35.151992+0000","last_peered":"2023-08-17T18:10:35.151992+0000","last_clean":"2023-08-17T18:10:35.151992+0000","last_became_active":"2023-08-17T18:10:35.151712+0000","last_became_peered":"2023-08-17T18:10:35.151712+0000","last_unstale":"2023-08-17T18:10:35.151992+0000","last_undegraded":"2023-08-17T18:10:35.151992+0000","last_fullsized":"2023-08-17T18:10:35.151992+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.146283+0000","last_change":"2023-08-17T18:10:34.779291+0000","last_active":"2023-08-17T18:10:35.146283+0000","last_peered":"2023-08-17T18:10:35.146283+0000","last_clean":"2023-08-17T18:10:35.146283+0000","last_became_active":"2023-08-17T18:10:34.778776+0000","last_became_peered":"2023-08-17T18:10:34.778776+0000","last_unstale":"2023-08-17T18:10:35.146283+0000","last_undegraded":"2023-08-17T18:10:35.146283+0000","last_fullsized":"2023-08-17T18:10:35.146283+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148780+0000","last_change":"2023-08-17T18:10:35.148780+0000","last_active":"2023-08-17T18:10:35.148780+0000","last_peered":"2023-08-17T18:10:35.148780+0000","last_clean":"2023-08-17T18:10:35.148780+0000","last_became_active":"2023-08-17T18:10:35.147995+0000","last_became_peered":"2023-08-17T18:10:35.147995+0000","last_unstale":"2023-08-17T18:10:35.148780+0000","last_undegraded":"2023-08-17T18:10:35.148780+0000","last_fullsized":"2023-08-17T18:10:35.148780+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.128027+0000","last_change":"2023-08-17T18:10:34.779533+0000","last_active":"2023-08-17T18:10:35.128027+0000","last_peered":"2023-08-17T18:10:35.128027+0000","last_clean":"2023-08-17T18:10:35.128027+0000","last_became_active":"2023-08-17T18:10:34.779251+0000","last_became_peered":"2023-08-17T18:10:34.779251+0000","last_unstale":"2023-08-17T18:10:35.128027+0000","last_undegraded":"2023-08-17T18:10:35.128027+0000","last_fullsized":"2023-08-17T18:10:35.128027+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143506+0000","last_change":"2023-08-17T18:10:35.143506+0000","last_active":"2023-08-17T18:10:35.143506+0000","last_peered":"2023-08-17T18:10:35.143506+0000","last_clean":"2023-08-17T18:10:35.143506+0000","last_became_active":"2023-08-17T18:10:35.143090+0000","last_became_peered":"2023-08-17T18:10:35.143090+0000","last_unstale":"2023-08-17T18:10:35.143506+0000","last_undegraded":"2023-08-17T18:10:35.143506+0000","last_fullsized":"2023-08-17T18:10:35.143506+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.133971+0000","last_change":"2023-08-17T18:10:34.781414+0000","last_active":"2023-08-17T18:10:35.133971+0000","last_peered":"2023-08-17T18:10:35.133971+0000","last_clean":"2023-08-17T18:10:35.133971+0000","last_became_active":"2023-08-17T18:10:34.781168+0000","last_became_peered":"2023-08-17T18:10:34.781168+0000","last_unstale":"2023-08-17T18:10:35.133971+0000","last_undegraded":"2023-08-17T18:10:35.133971+0000","last_fullsized":"2023-08-17T18:10:35.133971+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.139143+0000","last_change":"2023-08-17T18:10:35.139143+0000","last_active":"2023-08-17T18:10:35.139143+0000","last_peered":"2023-08-17T18:10:35.139143+0000","last_clean":"2023-08-17T18:10:35.139143+0000","last_became_active":"2023-08-17T18:10:35.138987+0000","last_became_peered":"2023-08-17T18:10:35.138987+0000","last_unstale":"2023-08-17T18:10:35.139143+0000","last_undegraded":"2023-08-17T18:10:35.139143+0000","last_fullsized":"2023-08-17T18:10:35.139143+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.780665+0000","last_change":"2023-08-17T18:10:34.775757+0000","last_active":"2023-08-17T18:10:34.780665+0000","last_peered":"2023-08-17T18:10:34.780665+0000","last_clean":"2023-08-17T18:10:34.780665+0000","last_became_active":"2023-08-17T18:10:34.775489+0000","last_became_peered":"2023-08-17T18:10:34.775489+0000","last_unstale":"2023-08-17T18:10:34.780665+0000","last_undegraded":"2023-08-17T18:10:34.780665+0000","last_fullsized":"2023-08-17T18:10:34.780665+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143686+0000","last_change":"2023-08-17T18:10:35.143686+0000","last_active":"2023-08-17T18:10:35.143686+0000","last_peered":"2023-08-17T18:10:35.143686+0000","last_clean":"2023-08-17T18:10:35.143686+0000","last_became_active":"2023-08-17T18:10:35.143421+0000","last_became_peered":"2023-08-17T18:10:35.143421+0000","last_unstale":"2023-08-17T18:10:35.143686+0000","last_undegraded":"2023-08-17T18:10:35.143686+0000","last_fullsized":"2023-08-17T18:10:35.143686+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785186+0000","last_change":"2023-08-17T18:10:34.778932+0000","last_active":"2023-08-17T18:10:34.785186+0000","last_peered":"2023-08-17T18:10:34.785186+0000","last_clean":"2023-08-17T18:10:34.785186+0000","last_became_active":"2023-08-17T18:10:34.778630+0000","last_became_peered":"2023-08-17T18:10:34.778630+0000","last_unstale":"2023-08-17T18:10:34.785186+0000","last_undegraded":"2023-08-17T18:10:34.785186+0000","last_fullsized":"2023-08-17T18:10:34.785186+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144322+0000","last_change":"2023-08-17T18:10:35.144322+0000","last_active":"2023-08-17T18:10:35.144322+0000","last_peered":"2023-08-17T18:10:35.144322+0000","last_clean":"2023-08-17T18:10:35.144322+0000","last_became_active":"2023-08-17T18:10:35.143897+0000","last_became_peered":"2023-08-17T18:10:35.143897+0000","last_unstale":"2023-08-17T18:10:35.144322+0000","last_undegraded":"2023-08-17T18:10:35.144322+0000","last_fullsized":"2023-08-17T18:10:35.144322+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.779852+0000","last_change":"2023-08-17T18:10:34.776850+0000","last_active":"2023-08-17T18:10:34.779852+0000","last_peered":"2023-08-17T18:10:34.779852+0000","last_clean":"2023-08-17T18:10:34.779852+0000","last_became_active":"2023-08-17T18:10:34.776050+0000","last_became_peered":"2023-08-17T18:10:34.776050+0000","last_unstale":"2023-08-17T18:10:34.779852+0000","last_undegraded":"2023-08-17T18:10:34.779852+0000","last_fullsized":"2023-08-17T18:10:34.779852+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148706+0000","last_change":"2023-08-17T18:10:35.148706+0000","last_active":"2023-08-17T18:10:35.148706+0000","last_peered":"2023-08-17T18:10:35.148706+0000","last_clean":"2023-08-17T18:10:35.148706+0000","last_became_active":"2023-08-17T18:10:35.148428+0000","last_became_peered":"2023-08-17T18:10:35.148428+0000","last_unstale":"2023-08-17T18:10:35.148706+0000","last_undegraded":"2023-08-17T18:10:35.148706+0000","last_fullsized":"2023-08-17T18:10:35.148706+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.787880+0000","last_change":"2023-08-17T18:10:34.785056+0000","last_active":"2023-08-17T18:10:34.787880+0000","last_peered":"2023-08-17T18:10:34.787880+0000","last_clean":"2023-08-17T18:10:34.787880+0000","last_became_active":"2023-08-17T18:10:34.784790+0000","last_became_peered":"2023-08-17T18:10:34.784790+0000","last_unstale":"2023-08-17T18:10:34.787880+0000","last_undegraded":"2023-08-17T18:10:34.787880+0000","last_fullsized":"2023-08-17T18:10:34.787880+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.137220+0000","last_change":"2023-08-17T18:10:35.137220+0000","last_active":"2023-08-17T18:10:35.137220+0000","last_peered":"2023-08-17T18:10:35.137220+0000","last_clean":"2023-08-17T18:10:35.137220+0000","last_became_active":"2023-08-17T18:10:35.136912+0000","last_became_peered":"2023-08-17T18:10:35.136912+0000","last_unstale":"2023-08-17T18:10:35.137220+0000","last_undegraded":"2023-08-17T18:10:35.137220+0000","last_fullsized":"2023-08-17T18:10:35.137220+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785374+0000","last_change":"2023-08-17T18:10:34.778326+0000","last_active":"2023-08-17T18:10:34.785374+0000","last_peered":"2023-08-17T18:10:34.785374+0000","last_clean":"2023-08-17T18:10:34.785374+0000","last_became_active":"2023-08-17T18:10:34.778054+0000","last_became_peered":"2023-08-17T18:10:34.778054+0000","last_unstale":"2023-08-17T18:10:34.785374+0000","last_undegraded":"2023-08-17T18:10:34.785374+0000","last_fullsized":"2023-08-17T18:10:34.785374+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.136847+0000","last_change":"2023-08-17T18:10:35.136847+0000","last_active":"2023-08-17T18:10:35.136847+0000","last_peered":"2023-08-17T18:10:35.136847+0000","last_clean":"2023-08-17T18:10:35.136847+0000","last_became_active":"2023-08-17T18:10:35.136573+0000","last_became_peered":"2023-08-17T18:10:35.136573+0000","last_unstale":"2023-08-17T18:10:35.136847+0000","last_undegraded":"2023-08-17T18:10:35.136847+0000","last_fullsized":"2023-08-17T18:10:35.136847+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"167'4","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.153827+0000","last_change":"2023-08-17T18:10:34.782766+0000","last_active":"2023-08-17T18:10:35.153827+0000","last_peered":"2023-08-17T18:10:35.153827+0000","last_clean":"2023-08-17T18:10:35.153827+0000","last_became_active":"2023-08-17T18:10:34.782486+0000","last_became_peered":"2023-08-17T18:10:34.782486+0000","last_unstale":"2023-08-17T18:10:35.153827+0000","last_undegraded":"2023-08-17T18:10:35.153827+0000","last_fullsized":"2023-08-17T18:10:35.153827+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.149959+0000","last_change":"2023-08-17T18:10:35.149959+0000","last_active":"2023-08-17T18:10:35.149959+0000","last_peered":"2023-08-17T18:10:35.149959+0000","last_clean":"2023-08-17T18:10:35.149959+0000","last_became_active":"2023-08-17T18:10:35.149676+0000","last_became_peered":"2023-08-17T18:10:35.149676+0000","last_unstale":"2023-08-17T18:10:35.149959+0000","last_undegraded":"2023-08-17T18:10:35.149959+0000","last_fullsized":"2023-08-17T18:10:35.149959+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.128056+0000","last_change":"2023-08-17T18:10:34.779491+0000","last_active":"2023-08-17T18:10:35.128056+0000","last_peered":"2023-08-17T18:10:35.128056+0000","last_clean":"2023-08-17T18:10:35.128056+0000","last_became_active":"2023-08-17T18:10:34.779147+0000","last_became_peered":"2023-08-17T18:10:34.779147+0000","last_unstale":"2023-08-17T18:10:35.128056+0000","last_undegraded":"2023-08-17T18:10:35.128056+0000","last_fullsized":"2023-08-17T18:10:35.128056+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144165+0000","last_change":"2023-08-17T18:10:35.144165+0000","last_active":"2023-08-17T18:10:35.144165+0000","last_peered":"2023-08-17T18:10:35.144165+0000","last_clean":"2023-08-17T18:10:35.144165+0000","last_became_active":"2023-08-17T18:10:35.143828+0000","last_became_peered":"2023-08-17T18:10:35.143828+0000","last_unstale":"2023-08-17T18:10:35.144165+0000","last_undegraded":"2023-08-17T18:10:35.144165+0000","last_fullsized":"2023-08-17T18:10:35.144165+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784569+0000","last_change":"2023-08-17T18:10:34.778034+0000","last_active":"2023-08-17T18:10:34.784569+0000","last_peered":"2023-08-17T18:10:34.784569+0000","last_clean":"2023-08-17T18:10:34.784569+0000","last_became_active":"2023-08-17T18:10:34.777527+0000","last_became_peered":"2023-08-17T18:10:34.777527+0000","last_unstale":"2023-08-17T18:10:34.784569+0000","last_undegraded":"2023-08-17T18:10:34.784569+0000","last_fullsized":"2023-08-17T18:10:34.784569+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143925+0000","last_change":"2023-08-17T18:10:35.143925+0000","last_active":"2023-08-17T18:10:35.143925+0000","last_peered":"2023-08-17T18:10:35.143925+0000","last_clean":"2023-08-17T18:10:35.143925+0000","last_became_active":"2023-08-17T18:10:35.143620+0000","last_became_peered":"2023-08-17T18:10:35.143620+0000","last_unstale":"2023-08-17T18:10:35.143925+0000","last_undegraded":"2023-08-17T18:10:35.143925+0000","last_fullsized":"2023-08-17T18:10:35.143925+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.786094+0000","last_change":"2023-08-17T18:10:34.783746+0000","last_active":"2023-08-17T18:10:34.786094+0000","last_peered":"2023-08-17T18:10:34.786094+0000","last_clean":"2023-08-17T18:10:34.786094+0000","last_became_active":"2023-08-17T18:10:34.783451+0000","last_became_peered":"2023-08-17T18:10:34.783451+0000","last_unstale":"2023-08-17T18:10:34.786094+0000","last_undegraded":"2023-08-17T18:10:34.786094+0000","last_fullsized":"2023-08-17T18:10:34.786094+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.137726+0000","last_change":"2023-08-17T18:10:35.137726+0000","last_active":"2023-08-17T18:10:35.137726+0000","last_peered":"2023-08-17T18:10:35.137726+0000","last_clean":"2023-08-17T18:10:35.137726+0000","last_became_active":"2023-08-17T18:10:35.137436+0000","last_became_peered":"2023-08-17T18:10:35.137436+0000","last_unstale":"2023-08-17T18:10:35.137726+0000","last_undegraded":"2023-08-17T18:10:35.137726+0000","last_fullsized":"2023-08-17T18:10:35.137726+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"167'4","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.145398+0000","last_change":"2023-08-17T18:10:34.783077+0000","last_active":"2023-08-17T18:10:35.145398+0000","last_peered":"2023-08-17T18:10:35.145398+0000","last_clean":"2023-08-17T18:10:35.145398+0000","last_became_active":"2023-08-17T18:10:34.782763+0000","last_became_peered":"2023-08-17T18:10:34.782763+0000","last_unstale":"2023-08-17T18:10:35.145398+0000","last_undegraded":"2023-08-17T18:10:35.145398+0000","last_fullsized":"2023-08-17T18:10:35.145398+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.138737+0000","last_change":"2023-08-17T18:10:35.138737+0000","last_active":"2023-08-17T18:10:35.138737+0000","last_peered":"2023-08-17T18:10:35.138737+0000","last_clean":"2023-08-17T18:10:35.138737+0000","last_became_active":"2023-08-17T18:10:35.138436+0000","last_became_peered":"2023-08-17T18:10:35.138436+0000","last_unstale":"2023-08-17T18:10:35.138737+0000","last_undegraded":"2023-08-17T18:10:35.138737+0000","last_fullsized":"2023-08-17T18:10:35.138737+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.786085+0000","last_change":"2023-08-17T18:10:34.783522+0000","last_active":"2023-08-17T18:10:34.786085+0000","last_peered":"2023-08-17T18:10:34.786085+0000","last_clean":"2023-08-17T18:10:34.786085+0000","last_became_active":"2023-08-17T18:10:34.783235+0000","last_became_peered":"2023-08-17T18:10:34.783235+0000","last_unstale":"2023-08-17T18:10:34.786085+0000","last_undegraded":"2023-08-17T18:10:34.786085+0000","last_fullsized":"2023-08-17T18:10:34.786085+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.154432+0000","last_change":"2023-08-17T18:10:35.154432+0000","last_active":"2023-08-17T18:10:35.154432+0000","last_peered":"2023-08-17T18:10:35.154432+0000","last_clean":"2023-08-17T18:10:35.154432+0000","last_became_active":"2023-08-17T18:10:35.153939+0000","last_became_peered":"2023-08-17T18:10:35.153939+0000","last_unstale":"2023-08-17T18:10:35.154432+0000","last_undegraded":"2023-08-17T18:10:35.154432+0000","last_fullsized":"2023-08-17T18:10:35.154432+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785814+0000","last_change":"2023-08-17T18:10:34.782259+0000","last_active":"2023-08-17T18:10:34.785814+0000","last_peered":"2023-08-17T18:10:34.785814+0000","last_clean":"2023-08-17T18:10:34.785814+0000","last_became_active":"2023-08-17T18:10:34.782021+0000","last_became_peered":"2023-08-17T18:10:34.782021+0000","last_unstale":"2023-08-17T18:10:34.785814+0000","last_undegraded":"2023-08-17T18:10:34.785814+0000","last_fullsized":"2023-08-17T18:10:34.785814+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.135025+0000","last_change":"2023-08-17T18:10:35.135025+0000","last_active":"2023-08-17T18:10:35.135025+0000","last_peered":"2023-08-17T18:10:35.135025+0000","last_clean":"2023-08-17T18:10:35.135025+0000","last_became_active":"2023-08-17T18:10:35.134736+0000","last_became_peered":"2023-08-17T18:10:35.134736+0000","last_unstale":"2023-08-17T18:10:35.135025+0000","last_undegraded":"2023-08-17T18:10:35.135025+0000","last_fullsized":"2023-08-17T18:10:35.135025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.133957+0000","last_change":"2023-08-17T18:10:34.776382+0000","last_active":"2023-08-17T18:10:35.133957+0000","last_peered":"2023-08-17T18:10:35.133957+0000","last_clean":"2023-08-17T18:10:35.133957+0000","last_became_active":"2023-08-17T18:10:34.776088+0000","last_became_peered":"2023-08-17T18:10:34.776088+0000","last_unstale":"2023-08-17T18:10:35.133957+0000","last_undegraded":"2023-08-17T18:10:35.133957+0000","last_fullsized":"2023-08-17T18:10:35.133957+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.141101+0000","last_change":"2023-08-17T18:10:35.141101+0000","last_active":"2023-08-17T18:10:35.141101+0000","last_peered":"2023-08-17T18:10:35.141101+0000","last_clean":"2023-08-17T18:10:35.141101+0000","last_became_active":"2023-08-17T18:10:35.140734+0000","last_became_peered":"2023-08-17T18:10:35.140734+0000","last_unstale":"2023-08-17T18:10:35.141101+0000","last_undegraded":"2023-08-17T18:10:35.141101+0000","last_fullsized":"2023-08-17T18:10:35.141101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785265+0000","last_change":"2023-08-17T18:10:34.779935+0000","last_active":"2023-08-17T18:10:34.785265+0000","last_peered":"2023-08-17T18:10:34.785265+0000","last_clean":"2023-08-17T18:10:34.785265+0000","last_became_active":"2023-08-17T18:10:34.779665+0000","last_became_peered":"2023-08-17T18:10:34.779665+0000","last_unstale":"2023-08-17T18:10:34.785265+0000","last_undegraded":"2023-08-17T18:10:34.785265+0000","last_fullsized":"2023-08-17T18:10:34.785265+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142161+0000","last_change":"2023-08-17T18:10:35.142161+0000","last_active":"2023-08-17T18:10:35.142161+0000","last_peered":"2023-08-17T18:10:35.142161+0000","last_clean":"2023-08-17T18:10:35.142161+0000","last_became_active":"2023-08-17T18:10:35.141601+0000","last_became_peered":"2023-08-17T18:10:35.141601+0000","last_unstale":"2023-08-17T18:10:35.142161+0000","last_undegraded":"2023-08-17T18:10:35.142161+0000","last_fullsized":"2023-08-17T18:10:35.142161+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142868+0000","last_change":"2023-08-17T18:10:34.784533+0000","last_active":"2023-08-17T18:10:35.142868+0000","last_peered":"2023-08-17T18:10:35.142868+0000","last_clean":"2023-08-17T18:10:35.142868+0000","last_became_active":"2023-08-17T18:10:34.784244+0000","last_became_peered":"2023-08-17T18:10:34.784244+0000","last_unstale":"2023-08-17T18:10:35.142868+0000","last_undegraded":"2023-08-17T18:10:35.142868+0000","last_fullsized":"2023-08-17T18:10:35.142868+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.145273+0000","last_change":"2023-08-17T18:10:35.145273+0000","last_active":"2023-08-17T18:10:35.145273+0000","last_peered":"2023-08-17T18:10:35.145273+0000","last_clean":"2023-08-17T18:10:35.145273+0000","last_became_active":"2023-08-17T18:10:35.144945+0000","last_became_peered":"2023-08-17T18:10:35.144945+0000","last_unstale":"2023-08-17T18:10:35.145273+0000","last_undegraded":"2023-08-17T18:10:35.145273+0000","last_fullsized":"2023-08-17T18:10:35.145273+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784799+0000","last_change":"2023-08-17T18:10:34.780408+0000","last_active":"2023-08-17T18:10:34.784799+0000","last_peered":"2023-08-17T18:10:34.784799+0000","last_clean":"2023-08-17T18:10:34.784799+0000","last_became_active":"2023-08-17T18:10:34.779991+0000","last_became_peered":"2023-08-17T18:10:34.779991+0000","last_unstale":"2023-08-17T18:10:34.784799+0000","last_undegraded":"2023-08-17T18:10:34.784799+0000","last_fullsized":"2023-08-17T18:10:34.784799+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143454+0000","last_change":"2023-08-17T18:10:35.143454+0000","last_active":"2023-08-17T18:10:35.143454+0000","last_peered":"2023-08-17T18:10:35.143454+0000","last_clean":"2023-08-17T18:10:35.143454+0000","last_became_active":"2023-08-17T18:10:35.143146+0000","last_became_peered":"2023-08-17T18:10:35.143146+0000","last_unstale":"2023-08-17T18:10:35.143454+0000","last_undegraded":"2023-08-17T18:10:35.143454+0000","last_fullsized":"2023-08-17T18:10:35.143454+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784782+0000","last_change":"2023-08-17T18:10:34.780035+0000","last_active":"2023-08-17T18:10:34.784782+0000","last_peered":"2023-08-17T18:10:34.784782+0000","last_clean":"2023-08-17T18:10:34.784782+0000","last_became_active":"2023-08-17T18:10:34.779505+0000","last_became_peered":"2023-08-17T18:10:34.779505+0000","last_unstale":"2023-08-17T18:10:34.784782+0000","last_undegraded":"2023-08-17T18:10:34.784782+0000","last_fullsized":"2023-08-17T18:10:34.784782+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143369+0000","last_change":"2023-08-17T18:10:35.143369+0000","last_active":"2023-08-17T18:10:35.143369+0000","last_peered":"2023-08-17T18:10:35.143369+0000","last_clean":"2023-08-17T18:10:35.143369+0000","last_became_active":"2023-08-17T18:10:35.142989+0000","last_became_peered":"2023-08-17T18:10:35.142989+0000","last_unstale":"2023-08-17T18:10:35.143369+0000","last_undegraded":"2023-08-17T18:10:35.143369+0000","last_fullsized":"2023-08-17T18:10:35.143369+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785304+0000","last_change":"2023-08-17T18:10:34.778024+0000","last_active":"2023-08-17T18:10:34.785304+0000","last_peered":"2023-08-17T18:10:34.785304+0000","last_clean":"2023-08-17T18:10:34.785304+0000","last_became_active":"2023-08-17T18:10:34.777751+0000","last_became_peered":"2023-08-17T18:10:34.777751+0000","last_unstale":"2023-08-17T18:10:34.785304+0000","last_undegraded":"2023-08-17T18:10:34.785304+0000","last_fullsized":"2023-08-17T18:10:34.785304+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142679+0000","last_change":"2023-08-17T18:10:35.142679+0000","last_active":"2023-08-17T18:10:35.142679+0000","last_peered":"2023-08-17T18:10:35.142679+0000","last_clean":"2023-08-17T18:10:35.142679+0000","last_became_active":"2023-08-17T18:10:35.142343+0000","last_became_peered":"2023-08-17T18:10:35.142343+0000","last_unstale":"2023-08-17T18:10:35.142679+0000","last_undegraded":"2023-08-17T18:10:35.142679+0000","last_fullsized":"2023-08-17T18:10:35.142679+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785072+0000","last_change":"2023-08-17T18:10:34.776488+0000","last_active":"2023-08-17T18:10:34.785072+0000","last_peered":"2023-08-17T18:10:34.785072+0000","last_clean":"2023-08-17T18:10:34.785072+0000","last_became_active":"2023-08-17T18:10:34.776180+0000","last_became_peered":"2023-08-17T18:10:34.776180+0000","last_unstale":"2023-08-17T18:10:34.785072+0000","last_undegraded":"2023-08-17T18:10:34.785072+0000","last_fullsized":"2023-08-17T18:10:34.785072+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148629+0000","last_change":"2023-08-17T18:10:35.148629+0000","last_active":"2023-08-17T18:10:35.148629+0000","last_peered":"2023-08-17T18:10:35.148629+0000","last_clean":"2023-08-17T18:10:35.148629+0000","last_became_active":"2023-08-17T18:10:35.148384+0000","last_became_peered":"2023-08-17T18:10:35.148384+0000","last_unstale":"2023-08-17T18:10:35.148629+0000","last_undegraded":"2023-08-17T18:10:35.148629+0000","last_fullsized":"2023-08-17T18:10:35.148629+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785203+0000","last_change":"2023-08-17T18:10:34.774830+0000","last_active":"2023-08-17T18:10:34.785203+0000","last_peered":"2023-08-17T18:10:34.785203+0000","last_clean":"2023-08-17T18:10:34.785203+0000","last_became_active":"2023-08-17T18:10:34.774575+0000","last_became_peered":"2023-08-17T18:10:34.774575+0000","last_unstale":"2023-08-17T18:10:34.785203+0000","last_undegraded":"2023-08-17T18:10:34.785203+0000","last_fullsized":"2023-08-17T18:10:34.785203+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.137964+0000","last_change":"2023-08-17T18:10:35.137964+0000","last_active":"2023-08-17T18:10:35.137964+0000","last_peered":"2023-08-17T18:10:35.137964+0000","last_clean":"2023-08-17T18:10:35.137964+0000","last_became_active":"2023-08-17T18:10:35.137380+0000","last_became_peered":"2023-08-17T18:10:35.137380+0000","last_unstale":"2023-08-17T18:10:35.137964+0000","last_undegraded":"2023-08-17T18:10:35.137964+0000","last_fullsized":"2023-08-17T18:10:35.137964+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785168+0000","last_change":"2023-08-17T18:10:34.779025+0000","last_active":"2023-08-17T18:10:34.785168+0000","last_peered":"2023-08-17T18:10:34.785168+0000","last_clean":"2023-08-17T18:10:34.785168+0000","last_became_active":"2023-08-17T18:10:34.778759+0000","last_became_peered":"2023-08-17T18:10:34.778759+0000","last_unstale":"2023-08-17T18:10:34.785168+0000","last_undegraded":"2023-08-17T18:10:34.785168+0000","last_fullsized":"2023-08-17T18:10:34.785168+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.134470+0000","last_change":"2023-08-17T18:10:35.134470+0000","last_active":"2023-08-17T18:10:35.134470+0000","last_peered":"2023-08-17T18:10:35.134470+0000","last_clean":"2023-08-17T18:10:35.134470+0000","last_became_active":"2023-08-17T18:10:35.134195+0000","last_became_peered":"2023-08-17T18:10:35.134195+0000","last_unstale":"2023-08-17T18:10:35.134470+0000","last_undegraded":"2023-08-17T18:10:35.134470+0000","last_fullsized":"2023-08-17T18:10:35.134470+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784740+0000","last_change":"2023-08-17T18:10:34.779492+0000","last_active":"2023-08-17T18:10:34.784740+0000","last_peered":"2023-08-17T18:10:34.784740+0000","last_clean":"2023-08-17T18:10:34.784740+0000","last_became_active":"2023-08-17T18:10:34.779222+0000","last_became_peered":"2023-08-17T18:10:34.779222+0000","last_unstale":"2023-08-17T18:10:34.784740+0000","last_undegraded":"2023-08-17T18:10:34.784740+0000","last_fullsized":"2023-08-17T18:10:34.784740+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148969+0000","last_change":"2023-08-17T18:10:35.148969+0000","last_active":"2023-08-17T18:10:35.148969+0000","last_peered":"2023-08-17T18:10:35.148969+0000","last_clean":"2023-08-17T18:10:35.148969+0000","last_became_active":"2023-08-17T18:10:35.148163+0000","last_became_peered":"2023-08-17T18:10:35.148163+0000","last_unstale":"2023-08-17T18:10:35.148969+0000","last_undegraded":"2023-08-17T18:10:35.148969+0000","last_fullsized":"2023-08-17T18:10:35.148969+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785502+0000","last_change":"2023-08-17T18:10:34.780988+0000","last_active":"2023-08-17T18:10:34.785502+0000","last_peered":"2023-08-17T18:10:34.785502+0000","last_clean":"2023-08-17T18:10:34.785502+0000","last_became_active":"2023-08-17T18:10:34.780586+0000","last_became_peered":"2023-08-17T18:10:34.780586+0000","last_unstale":"2023-08-17T18:10:34.785502+0000","last_undegraded":"2023-08-17T18:10:34.785502+0000","last_fullsized":"2023-08-17T18:10:34.785502+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.146095+0000","last_change":"2023-08-17T18:10:35.146095+0000","last_active":"2023-08-17T18:10:35.146095+0000","last_peered":"2023-08-17T18:10:35.146095+0000","last_clean":"2023-08-17T18:10:35.146095+0000","last_became_active":"2023-08-17T18:10:35.145883+0000","last_became_peered":"2023-08-17T18:10:35.145883+0000","last_unstale":"2023-08-17T18:10:35.146095+0000","last_undegraded":"2023-08-17T18:10:35.146095+0000","last_fullsized":"2023-08-17T18:10:35.146095+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784540+0000","last_change":"2023-08-17T18:10:34.777847+0000","last_active":"2023-08-17T18:10:34.784540+0000","last_peered":"2023-08-17T18:10:34.784540+0000","last_clean":"2023-08-17T18:10:34.784540+0000","last_became_active":"2023-08-17T18:10:34.777473+0000","last_became_peered":"2023-08-17T18:10:34.777473+0000","last_unstale":"2023-08-17T18:10:34.784540+0000","last_undegraded":"2023-08-17T18:10:34.784540+0000","last_fullsized":"2023-08-17T18:10:34.784540+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.141959+0000","last_change":"2023-08-17T18:10:35.141959+0000","last_active":"2023-08-17T18:10:35.141959+0000","last_peered":"2023-08-17T18:10:35.141959+0000","last_clean":"2023-08-17T18:10:35.141959+0000","last_became_active":"2023-08-17T18:10:35.141689+0000","last_became_peered":"2023-08-17T18:10:35.141689+0000","last_unstale":"2023-08-17T18:10:35.141959+0000","last_undegraded":"2023-08-17T18:10:35.141959+0000","last_fullsized":"2023-08-17T18:10:35.141959+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784922+0000","last_change":"2023-08-17T18:10:34.779366+0000","last_active":"2023-08-17T18:10:34.784922+0000","last_peered":"2023-08-17T18:10:34.784922+0000","last_clean":"2023-08-17T18:10:34.784922+0000","last_became_active":"2023-08-17T18:10:34.779075+0000","last_became_peered":"2023-08-17T18:10:34.779075+0000","last_unstale":"2023-08-17T18:10:34.784922+0000","last_undegraded":"2023-08-17T18:10:34.784922+0000","last_fullsized":"2023-08-17T18:10:34.784922+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.147588+0000","last_change":"2023-08-17T18:10:35.147588+0000","last_active":"2023-08-17T18:10:35.147588+0000","last_peered":"2023-08-17T18:10:35.147588+0000","last_clean":"2023-08-17T18:10:35.147588+0000","last_became_active":"2023-08-17T18:10:35.147172+0000","last_became_peered":"2023-08-17T18:10:35.147172+0000","last_unstale":"2023-08-17T18:10:35.147588+0000","last_undegraded":"2023-08-17T18:10:35.147588+0000","last_fullsized":"2023-08-17T18:10:35.147588+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785119+0000","last_change":"2023-08-17T18:10:34.774956+0000","last_active":"2023-08-17T18:10:34.785119+0000","last_peered":"2023-08-17T18:10:34.785119+0000","last_clean":"2023-08-17T18:10:34.785119+0000","last_became_active":"2023-08-17T18:10:34.774676+0000","last_became_peered":"2023-08-17T18:10:34.774676+0000","last_unstale":"2023-08-17T18:10:34.785119+0000","last_undegraded":"2023-08-17T18:10:34.785119+0000","last_fullsized":"2023-08-17T18:10:34.785119+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.145566+0000","last_change":"2023-08-17T18:10:35.145566+0000","last_active":"2023-08-17T18:10:35.145566+0000","last_peered":"2023-08-17T18:10:35.145566+0000","last_clean":"2023-08-17T18:10:35.145566+0000","last_became_active":"2023-08-17T18:10:35.145352+0000","last_became_peered":"2023-08-17T18:10:35.145352+0000","last_unstale":"2023-08-17T18:10:35.145566+0000","last_undegraded":"2023-08-17T18:10:35.145566+0000","last_fullsized":"2023-08-17T18:10:35.145566+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.131600+0000","last_change":"2023-08-17T18:10:34.768333+0000","last_active":"2023-08-17T18:10:35.131600+0000","last_peered":"2023-08-17T18:10:35.131600+0000","last_clean":"2023-08-17T18:10:35.131600+0000","last_became_active":"2023-08-17T18:10:34.768070+0000","last_became_peered":"2023-08-17T18:10:34.768070+0000","last_unstale":"2023-08-17T18:10:35.131600+0000","last_undegraded":"2023-08-17T18:10:35.131600+0000","last_fullsized":"2023-08-17T18:10:35.131600+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.145295+0000","last_change":"2023-08-17T18:10:35.145295+0000","last_active":"2023-08-17T18:10:35.145295+0000","last_peered":"2023-08-17T18:10:35.145295+0000","last_clean":"2023-08-17T18:10:35.145295+0000","last_became_active":"2023-08-17T18:10:35.143889+0000","last_became_peered":"2023-08-17T18:10:35.143889+0000","last_unstale":"2023-08-17T18:10:35.145295+0000","last_undegraded":"2023-08-17T18:10:35.145295+0000","last_fullsized":"2023-08-17T18:10:35.145295+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.147266+0000","last_change":"2023-08-17T18:10:34.783041+0000","last_active":"2023-08-17T18:10:35.147266+0000","last_peered":"2023-08-17T18:10:35.147266+0000","last_clean":"2023-08-17T18:10:35.147266+0000","last_became_active":"2023-08-17T18:10:34.782818+0000","last_became_peered":"2023-08-17T18:10:34.782818+0000","last_unstale":"2023-08-17T18:10:35.147266+0000","last_undegraded":"2023-08-17T18:10:35.147266+0000","last_fullsized":"2023-08-17T18:10:35.147266+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.145356+0000","last_change":"2023-08-17T18:10:35.145356+0000","last_active":"2023-08-17T18:10:35.145356+0000","last_peered":"2023-08-17T18:10:35.145356+0000","last_clean":"2023-08-17T18:10:35.145356+0000","last_became_active":"2023-08-17T18:10:35.145008+0000","last_became_peered":"2023-08-17T18:10:35.145008+0000","last_unstale":"2023-08-17T18:10:35.145356+0000","last_undegraded":"2023-08-17T18:10:35.145356+0000","last_fullsized":"2023-08-17T18:10:35.145356+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.155089+0000","last_change":"2023-08-17T18:10:34.782926+0000","last_active":"2023-08-17T18:10:35.155089+0000","last_peered":"2023-08-17T18:10:35.155089+0000","last_clean":"2023-08-17T18:10:35.155089+0000","last_became_active":"2023-08-17T18:10:34.782582+0000","last_became_peered":"2023-08-17T18:10:34.782582+0000","last_unstale":"2023-08-17T18:10:35.155089+0000","last_undegraded":"2023-08-17T18:10:35.155089+0000","last_fullsized":"2023-08-17T18:10:35.155089+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.156062+0000","last_change":"2023-08-17T18:10:35.156062+0000","last_active":"2023-08-17T18:10:35.156062+0000","last_peered":"2023-08-17T18:10:35.156062+0000","last_clean":"2023-08-17T18:10:35.156062+0000","last_became_active":"2023-08-17T18:10:35.155821+0000","last_became_peered":"2023-08-17T18:10:35.155821+0000","last_unstale":"2023-08-17T18:10:35.156062+0000","last_undegraded":"2023-08-17T18:10:35.156062+0000","last_fullsized":"2023-08-17T18:10:35.156062+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785453+0000","last_change":"2023-08-17T18:10:34.780937+0000","last_active":"2023-08-17T18:10:34.785453+0000","last_peered":"2023-08-17T18:10:34.785453+0000","last_clean":"2023-08-17T18:10:34.785453+0000","last_became_active":"2023-08-17T18:10:34.780637+0000","last_became_peered":"2023-08-17T18:10:34.780637+0000","last_unstale":"2023-08-17T18:10:34.785453+0000","last_undegraded":"2023-08-17T18:10:34.785453+0000","last_fullsized":"2023-08-17T18:10:34.785453+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.137082+0000","last_change":"2023-08-17T18:10:35.137082+0000","last_active":"2023-08-17T18:10:35.137082+0000","last_peered":"2023-08-17T18:10:35.137082+0000","last_clean":"2023-08-17T18:10:35.137082+0000","last_became_active":"2023-08-17T18:10:35.136376+0000","last_became_peered":"2023-08-17T18:10:35.136376+0000","last_unstale":"2023-08-17T18:10:35.137082+0000","last_undegraded":"2023-08-17T18:10:35.137082+0000","last_fullsized":"2023-08-17T18:10:35.137082+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785718+0000","last_change":"2023-08-17T18:10:34.778493+0000","last_active":"2023-08-17T18:10:34.785718+0000","last_peered":"2023-08-17T18:10:34.785718+0000","last_clean":"2023-08-17T18:10:34.785718+0000","last_became_active":"2023-08-17T18:10:34.778225+0000","last_became_peered":"2023-08-17T18:10:34.778225+0000","last_unstale":"2023-08-17T18:10:34.785718+0000","last_undegraded":"2023-08-17T18:10:34.785718+0000","last_fullsized":"2023-08-17T18:10:34.785718+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144742+0000","last_change":"2023-08-17T18:10:35.144742+0000","last_active":"2023-08-17T18:10:35.144742+0000","last_peered":"2023-08-17T18:10:35.144742+0000","last_clean":"2023-08-17T18:10:35.144742+0000","last_became_active":"2023-08-17T18:10:35.143197+0000","last_became_peered":"2023-08-17T18:10:35.143197+0000","last_unstale":"2023-08-17T18:10:35.144742+0000","last_undegraded":"2023-08-17T18:10:35.144742+0000","last_fullsized":"2023-08-17T18:10:35.144742+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784875+0000","last_change":"2023-08-17T18:10:34.779059+0000","last_active":"2023-08-17T18:10:34.784875+0000","last_peered":"2023-08-17T18:10:34.784875+0000","last_clean":"2023-08-17T18:10:34.784875+0000","last_became_active":"2023-08-17T18:10:34.778577+0000","last_became_peered":"2023-08-17T18:10:34.778577+0000","last_unstale":"2023-08-17T18:10:34.784875+0000","last_undegraded":"2023-08-17T18:10:34.784875+0000","last_fullsized":"2023-08-17T18:10:34.784875+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.140162+0000","last_change":"2023-08-17T18:10:35.140162+0000","last_active":"2023-08-17T18:10:35.140162+0000","last_peered":"2023-08-17T18:10:35.140162+0000","last_clean":"2023-08-17T18:10:35.140162+0000","last_became_active":"2023-08-17T18:10:35.139882+0000","last_became_peered":"2023-08-17T18:10:35.139882+0000","last_unstale":"2023-08-17T18:10:35.140162+0000","last_undegraded":"2023-08-17T18:10:35.140162+0000","last_fullsized":"2023-08-17T18:10:35.140162+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785124+0000","last_change":"2023-08-17T18:10:34.780908+0000","last_active":"2023-08-17T18:10:34.785124+0000","last_peered":"2023-08-17T18:10:34.785124+0000","last_clean":"2023-08-17T18:10:34.785124+0000","last_became_active":"2023-08-17T18:10:34.780624+0000","last_became_peered":"2023-08-17T18:10:34.780624+0000","last_unstale":"2023-08-17T18:10:34.785124+0000","last_undegraded":"2023-08-17T18:10:34.785124+0000","last_fullsized":"2023-08-17T18:10:34.785124+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.152356+0000","last_change":"2023-08-17T18:10:35.152356+0000","last_active":"2023-08-17T18:10:35.152356+0000","last_peered":"2023-08-17T18:10:35.152356+0000","last_clean":"2023-08-17T18:10:35.152356+0000","last_became_active":"2023-08-17T18:10:35.152106+0000","last_became_peered":"2023-08-17T18:10:35.152106+0000","last_unstale":"2023-08-17T18:10:35.152356+0000","last_undegraded":"2023-08-17T18:10:35.152356+0000","last_fullsized":"2023-08-17T18:10:35.152356+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.772172+0000","last_change":"2023-08-17T18:10:34.765173+0000","last_active":"2023-08-17T18:10:34.772172+0000","last_peered":"2023-08-17T18:10:34.772172+0000","last_clean":"2023-08-17T18:10:34.772172+0000","last_became_active":"2023-08-17T18:10:34.764895+0000","last_became_peered":"2023-08-17T18:10:34.764895+0000","last_unstale":"2023-08-17T18:10:34.772172+0000","last_undegraded":"2023-08-17T18:10:34.772172+0000","last_fullsized":"2023-08-17T18:10:34.772172+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.151277+0000","last_change":"2023-08-17T18:10:35.151277+0000","last_active":"2023-08-17T18:10:35.151277+0000","last_peered":"2023-08-17T18:10:35.151277+0000","last_clean":"2023-08-17T18:10:35.151277+0000","last_became_active":"2023-08-17T18:10:35.150990+0000","last_became_peered":"2023-08-17T18:10:35.150990+0000","last_unstale":"2023-08-17T18:10:35.151277+0000","last_undegraded":"2023-08-17T18:10:35.151277+0000","last_fullsized":"2023-08-17T18:10:35.151277+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.133072+0000","last_change":"2023-08-17T18:10:34.777879+0000","last_active":"2023-08-17T18:10:35.133072+0000","last_peered":"2023-08-17T18:10:35.133072+0000","last_clean":"2023-08-17T18:10:35.133072+0000","last_became_active":"2023-08-17T18:10:34.777614+0000","last_became_peered":"2023-08-17T18:10:34.777614+0000","last_unstale":"2023-08-17T18:10:35.133072+0000","last_undegraded":"2023-08-17T18:10:35.133072+0000","last_fullsized":"2023-08-17T18:10:35.133072+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.154646+0000","last_change":"2023-08-17T18:10:35.154646+0000","last_active":"2023-08-17T18:10:35.154646+0000","last_peered":"2023-08-17T18:10:35.154646+0000","last_clean":"2023-08-17T18:10:35.154646+0000","last_became_active":"2023-08-17T18:10:35.154188+0000","last_became_peered":"2023-08-17T18:10:35.154188+0000","last_unstale":"2023-08-17T18:10:35.154646+0000","last_undegraded":"2023-08-17T18:10:35.154646+0000","last_fullsized":"2023-08-17T18:10:35.154646+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.153981+0000","last_change":"2023-08-17T18:10:34.786111+0000","last_active":"2023-08-17T18:10:35.153981+0000","last_peered":"2023-08-17T18:10:35.153981+0000","last_clean":"2023-08-17T18:10:35.153981+0000","last_became_active":"2023-08-17T18:10:34.785804+0000","last_became_peered":"2023-08-17T18:10:34.785804+0000","last_unstale":"2023-08-17T18:10:35.153981+0000","last_undegraded":"2023-08-17T18:10:35.153981+0000","last_fullsized":"2023-08-17T18:10:35.153981+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.137799+0000","last_change":"2023-08-17T18:10:35.137799+0000","last_active":"2023-08-17T18:10:35.137799+0000","last_peered":"2023-08-17T18:10:35.137799+0000","last_clean":"2023-08-17T18:10:35.137799+0000","last_became_active":"2023-08-17T18:10:35.136797+0000","last_became_peered":"2023-08-17T18:10:35.136797+0000","last_unstale":"2023-08-17T18:10:35.137799+0000","last_undegraded":"2023-08-17T18:10:35.137799+0000","last_fullsized":"2023-08-17T18:10:35.137799+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785436+0000","last_change":"2023-08-17T18:10:34.780942+0000","last_active":"2023-08-17T18:10:34.785436+0000","last_peered":"2023-08-17T18:10:34.785436+0000","last_clean":"2023-08-17T18:10:34.785436+0000","last_became_active":"2023-08-17T18:10:34.780655+0000","last_became_peered":"2023-08-17T18:10:34.780655+0000","last_unstale":"2023-08-17T18:10:34.785436+0000","last_undegraded":"2023-08-17T18:10:34.785436+0000","last_fullsized":"2023-08-17T18:10:34.785436+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142020+0000","last_change":"2023-08-17T18:10:35.142020+0000","last_active":"2023-08-17T18:10:35.142020+0000","last_peered":"2023-08-17T18:10:35.142020+0000","last_clean":"2023-08-17T18:10:35.142020+0000","last_became_active":"2023-08-17T18:10:35.141720+0000","last_became_peered":"2023-08-17T18:10:35.141720+0000","last_unstale":"2023-08-17T18:10:35.142020+0000","last_undegraded":"2023-08-17T18:10:35.142020+0000","last_fullsized":"2023-08-17T18:10:35.142020+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785724+0000","last_change":"2023-08-17T18:10:34.781961+0000","last_active":"2023-08-17T18:10:34.785724+0000","last_peered":"2023-08-17T18:10:34.785724+0000","last_clean":"2023-08-17T18:10:34.785724+0000","last_became_active":"2023-08-17T18:10:34.781663+0000","last_became_peered":"2023-08-17T18:10:34.781663+0000","last_unstale":"2023-08-17T18:10:34.785724+0000","last_undegraded":"2023-08-17T18:10:34.785724+0000","last_fullsized":"2023-08-17T18:10:34.785724+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.151595+0000","last_change":"2023-08-17T18:10:35.151595+0000","last_active":"2023-08-17T18:10:35.151595+0000","last_peered":"2023-08-17T18:10:35.151595+0000","last_clean":"2023-08-17T18:10:35.151595+0000","last_became_active":"2023-08-17T18:10:35.151326+0000","last_became_peered":"2023-08-17T18:10:35.151326+0000","last_unstale":"2023-08-17T18:10:35.151595+0000","last_undegraded":"2023-08-17T18:10:35.151595+0000","last_fullsized":"2023-08-17T18:10:35.151595+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.126649+0000","last_change":"2023-08-17T18:10:34.776636+0000","last_active":"2023-08-17T18:10:35.126649+0000","last_peered":"2023-08-17T18:10:35.126649+0000","last_clean":"2023-08-17T18:10:35.126649+0000","last_became_active":"2023-08-17T18:10:34.776381+0000","last_became_peered":"2023-08-17T18:10:34.776381+0000","last_unstale":"2023-08-17T18:10:35.126649+0000","last_undegraded":"2023-08-17T18:10:35.126649+0000","last_fullsized":"2023-08-17T18:10:35.126649+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.141499+0000","last_change":"2023-08-17T18:10:35.141499+0000","last_active":"2023-08-17T18:10:35.141499+0000","last_peered":"2023-08-17T18:10:35.141499+0000","last_clean":"2023-08-17T18:10:35.141499+0000","last_became_active":"2023-08-17T18:10:35.141257+0000","last_became_peered":"2023-08-17T18:10:35.141257+0000","last_unstale":"2023-08-17T18:10:35.141499+0000","last_undegraded":"2023-08-17T18:10:35.141499+0000","last_fullsized":"2023-08-17T18:10:35.141499+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.783672+0000","last_change":"2023-08-17T18:10:34.775357+0000","last_active":"2023-08-17T18:10:34.783672+0000","last_peered":"2023-08-17T18:10:34.783672+0000","last_clean":"2023-08-17T18:10:34.783672+0000","last_became_active":"2023-08-17T18:10:34.775055+0000","last_became_peered":"2023-08-17T18:10:34.775055+0000","last_unstale":"2023-08-17T18:10:34.783672+0000","last_undegraded":"2023-08-17T18:10:34.783672+0000","last_fullsized":"2023-08-17T18:10:34.783672+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.151829+0000","last_change":"2023-08-17T18:10:35.151829+0000","last_active":"2023-08-17T18:10:35.151829+0000","last_peered":"2023-08-17T18:10:35.151829+0000","last_clean":"2023-08-17T18:10:35.151829+0000","last_became_active":"2023-08-17T18:10:35.151545+0000","last_became_peered":"2023-08-17T18:10:35.151545+0000","last_unstale":"2023-08-17T18:10:35.151829+0000","last_undegraded":"2023-08-17T18:10:35.151829+0000","last_fullsized":"2023-08-17T18:10:35.151829+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.780637+0000","last_change":"2023-08-17T18:10:34.775679+0000","last_active":"2023-08-17T18:10:34.780637+0000","last_peered":"2023-08-17T18:10:34.780637+0000","last_clean":"2023-08-17T18:10:34.780637+0000","last_became_active":"2023-08-17T18:10:34.775413+0000","last_became_peered":"2023-08-17T18:10:34.775413+0000","last_unstale":"2023-08-17T18:10:34.780637+0000","last_undegraded":"2023-08-17T18:10:34.780637+0000","last_fullsized":"2023-08-17T18:10:34.780637+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.142085+0000","last_change":"2023-08-17T18:10:35.142085+0000","last_active":"2023-08-17T18:10:35.142085+0000","last_peered":"2023-08-17T18:10:35.142085+0000","last_clean":"2023-08-17T18:10:35.142085+0000","last_became_active":"2023-08-17T18:10:35.141826+0000","last_became_peered":"2023-08-17T18:10:35.141826+0000","last_unstale":"2023-08-17T18:10:35.142085+0000","last_undegraded":"2023-08-17T18:10:35.142085+0000","last_fullsized":"2023-08-17T18:10:35.142085+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784728+0000","last_change":"2023-08-17T18:10:34.779748+0000","last_active":"2023-08-17T18:10:34.784728+0000","last_peered":"2023-08-17T18:10:34.784728+0000","last_clean":"2023-08-17T18:10:34.784728+0000","last_became_active":"2023-08-17T18:10:34.779258+0000","last_became_peered":"2023-08-17T18:10:34.779258+0000","last_unstale":"2023-08-17T18:10:34.784728+0000","last_undegraded":"2023-08-17T18:10:34.784728+0000","last_fullsized":"2023-08-17T18:10:34.784728+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.135197+0000","last_change":"2023-08-17T18:10:35.135197+0000","last_active":"2023-08-17T18:10:35.135197+0000","last_peered":"2023-08-17T18:10:35.135197+0000","last_clean":"2023-08-17T18:10:35.135197+0000","last_became_active":"2023-08-17T18:10:35.134941+0000","last_became_peered":"2023-08-17T18:10:35.134941+0000","last_unstale":"2023-08-17T18:10:35.135197+0000","last_undegraded":"2023-08-17T18:10:35.135197+0000","last_fullsized":"2023-08-17T18:10:35.135197+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.147004+0000","last_change":"2023-08-17T18:10:34.777122+0000","last_active":"2023-08-17T18:10:35.147004+0000","last_peered":"2023-08-17T18:10:35.147004+0000","last_clean":"2023-08-17T18:10:35.147004+0000","last_became_active":"2023-08-17T18:10:34.776845+0000","last_became_peered":"2023-08-17T18:10:34.776845+0000","last_unstale":"2023-08-17T18:10:35.147004+0000","last_undegraded":"2023-08-17T18:10:35.147004+0000","last_fullsized":"2023-08-17T18:10:35.147004+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144294+0000","last_change":"2023-08-17T18:10:35.144294+0000","last_active":"2023-08-17T18:10:35.144294+0000","last_peered":"2023-08-17T18:10:35.144294+0000","last_clean":"2023-08-17T18:10:35.144294+0000","last_became_active":"2023-08-17T18:10:35.144042+0000","last_became_peered":"2023-08-17T18:10:35.144042+0000","last_unstale":"2023-08-17T18:10:35.144294+0000","last_undegraded":"2023-08-17T18:10:35.144294+0000","last_fullsized":"2023-08-17T18:10:35.144294+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785035+0000","last_change":"2023-08-17T18:10:34.779584+0000","last_active":"2023-08-17T18:10:34.785035+0000","last_peered":"2023-08-17T18:10:34.785035+0000","last_clean":"2023-08-17T18:10:34.785035+0000","last_became_active":"2023-08-17T18:10:34.779162+0000","last_became_peered":"2023-08-17T18:10:34.779162+0000","last_unstale":"2023-08-17T18:10:34.785035+0000","last_undegraded":"2023-08-17T18:10:34.785035+0000","last_fullsized":"2023-08-17T18:10:34.785035+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.150606+0000","last_change":"2023-08-17T18:10:35.150606+0000","last_active":"2023-08-17T18:10:35.150606+0000","last_peered":"2023-08-17T18:10:35.150606+0000","last_clean":"2023-08-17T18:10:35.150606+0000","last_became_active":"2023-08-17T18:10:35.150383+0000","last_became_peered":"2023-08-17T18:10:35.150383+0000","last_unstale":"2023-08-17T18:10:35.150606+0000","last_undegraded":"2023-08-17T18:10:35.150606+0000","last_fullsized":"2023-08-17T18:10:35.150606+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785355+0000","last_change":"2023-08-17T18:10:34.777437+0000","last_active":"2023-08-17T18:10:34.785355+0000","last_peered":"2023-08-17T18:10:34.785355+0000","last_clean":"2023-08-17T18:10:34.785355+0000","last_became_active":"2023-08-17T18:10:34.777125+0000","last_became_peered":"2023-08-17T18:10:34.777125+0000","last_unstale":"2023-08-17T18:10:34.785355+0000","last_undegraded":"2023-08-17T18:10:34.785355+0000","last_fullsized":"2023-08-17T18:10:34.785355+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144350+0000","last_change":"2023-08-17T18:10:35.144350+0000","last_active":"2023-08-17T18:10:35.144350+0000","last_peered":"2023-08-17T18:10:35.144350+0000","last_clean":"2023-08-17T18:10:35.144350+0000","last_became_active":"2023-08-17T18:10:35.143959+0000","last_became_peered":"2023-08-17T18:10:35.143959+0000","last_unstale":"2023-08-17T18:10:35.144350+0000","last_undegraded":"2023-08-17T18:10:35.144350+0000","last_fullsized":"2023-08-17T18:10:35.144350+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.780084+0000","last_change":"2023-08-17T18:10:34.775913+0000","last_active":"2023-08-17T18:10:34.780084+0000","last_peered":"2023-08-17T18:10:34.780084+0000","last_clean":"2023-08-17T18:10:34.780084+0000","last_became_active":"2023-08-17T18:10:34.775645+0000","last_became_peered":"2023-08-17T18:10:34.775645+0000","last_unstale":"2023-08-17T18:10:34.780084+0000","last_undegraded":"2023-08-17T18:10:34.780084+0000","last_fullsized":"2023-08-17T18:10:34.780084+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.149256+0000","last_change":"2023-08-17T18:10:35.149256+0000","last_active":"2023-08-17T18:10:35.149256+0000","last_peered":"2023-08-17T18:10:35.149256+0000","last_clean":"2023-08-17T18:10:35.149256+0000","last_became_active":"2023-08-17T18:10:35.148478+0000","last_became_peered":"2023-08-17T18:10:35.148478+0000","last_unstale":"2023-08-17T18:10:35.149256+0000","last_undegraded":"2023-08-17T18:10:35.149256+0000","last_fullsized":"2023-08-17T18:10:35.149256+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.784927+0000","last_change":"2023-08-17T18:10:34.778332+0000","last_active":"2023-08-17T18:10:34.784927+0000","last_peered":"2023-08-17T18:10:34.784927+0000","last_clean":"2023-08-17T18:10:34.784927+0000","last_became_active":"2023-08-17T18:10:34.778033+0000","last_became_peered":"2023-08-17T18:10:34.778033+0000","last_unstale":"2023-08-17T18:10:34.784927+0000","last_undegraded":"2023-08-17T18:10:34.784927+0000","last_fullsized":"2023-08-17T18:10:34.784927+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.143885+0000","last_change":"2023-08-17T18:10:35.143885+0000","last_active":"2023-08-17T18:10:35.143885+0000","last_peered":"2023-08-17T18:10:35.143885+0000","last_clean":"2023-08-17T18:10:35.143885+0000","last_became_active":"2023-08-17T18:10:35.143597+0000","last_became_peered":"2023-08-17T18:10:35.143597+0000","last_unstale":"2023-08-17T18:10:35.143885+0000","last_undegraded":"2023-08-17T18:10:35.143885+0000","last_fullsized":"2023-08-17T18:10:35.143885+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785083+0000","last_change":"2023-08-17T18:10:34.777007+0000","last_active":"2023-08-17T18:10:34.785083+0000","last_peered":"2023-08-17T18:10:34.785083+0000","last_clean":"2023-08-17T18:10:34.785083+0000","last_became_active":"2023-08-17T18:10:34.776733+0000","last_became_peered":"2023-08-17T18:10:34.776733+0000","last_unstale":"2023-08-17T18:10:34.785083+0000","last_undegraded":"2023-08-17T18:10:34.785083+0000","last_fullsized":"2023-08-17T18:10:34.785083+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148485+0000","last_change":"2023-08-17T18:10:35.148485+0000","last_active":"2023-08-17T18:10:35.148485+0000","last_peered":"2023-08-17T18:10:35.148485+0000","last_clean":"2023-08-17T18:10:35.148485+0000","last_became_active":"2023-08-17T18:10:35.148188+0000","last_became_peered":"2023-08-17T18:10:35.148188+0000","last_unstale":"2023-08-17T18:10:35.148485+0000","last_undegraded":"2023-08-17T18:10:35.148485+0000","last_fullsized":"2023-08-17T18:10:35.148485+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.776324+0000","last_change":"2023-08-17T18:10:34.773063+0000","last_active":"2023-08-17T18:10:34.776324+0000","last_peered":"2023-08-17T18:10:34.776324+0000","last_clean":"2023-08-17T18:10:34.776324+0000","last_became_active":"2023-08-17T18:10:34.772794+0000","last_became_peered":"2023-08-17T18:10:34.772794+0000","last_unstale":"2023-08-17T18:10:34.776324+0000","last_undegraded":"2023-08-17T18:10:34.776324+0000","last_fullsized":"2023-08-17T18:10:34.776324+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.147399+0000","last_change":"2023-08-17T18:10:35.147399+0000","last_active":"2023-08-17T18:10:35.147399+0000","last_peered":"2023-08-17T18:10:35.147399+0000","last_clean":"2023-08-17T18:10:35.147399+0000","last_became_active":"2023-08-17T18:10:35.146842+0000","last_became_peered":"2023-08-17T18:10:35.146842+0000","last_unstale":"2023-08-17T18:10:35.147399+0000","last_undegraded":"2023-08-17T18:10:35.147399+0000","last_fullsized":"2023-08-17T18:10:35.147399+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785949+0000","last_change":"2023-08-17T18:10:34.783179+0000","last_active":"2023-08-17T18:10:34.785949+0000","last_peered":"2023-08-17T18:10:34.785949+0000","last_clean":"2023-08-17T18:10:34.785949+0000","last_became_active":"2023-08-17T18:10:34.782973+0000","last_became_peered":"2023-08-17T18:10:34.782973+0000","last_unstale":"2023-08-17T18:10:34.785949+0000","last_undegraded":"2023-08-17T18:10:34.785949+0000","last_fullsized":"2023-08-17T18:10:34.785949+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.149153+0000","last_change":"2023-08-17T18:10:35.149153+0000","last_active":"2023-08-17T18:10:35.149153+0000","last_peered":"2023-08-17T18:10:35.149153+0000","last_clean":"2023-08-17T18:10:35.149153+0000","last_became_active":"2023-08-17T18:10:35.148348+0000","last_became_peered":"2023-08-17T18:10:35.148348+0000","last_unstale":"2023-08-17T18:10:35.149153+0000","last_undegraded":"2023-08-17T18:10:35.149153+0000","last_fullsized":"2023-08-17T18:10:35.149153+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.131250+0000","last_change":"2023-08-17T18:10:34.770813+0000","last_active":"2023-08-17T18:10:35.131250+0000","last_peered":"2023-08-17T18:10:35.131250+0000","last_clean":"2023-08-17T18:10:35.131250+0000","last_became_active":"2023-08-17T18:10:34.770090+0000","last_became_peered":"2023-08-17T18:10:34.770090+0000","last_unstale":"2023-08-17T18:10:35.131250+0000","last_undegraded":"2023-08-17T18:10:35.131250+0000","last_fullsized":"2023-08-17T18:10:35.131250+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.766645+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T18:10:34.766645+0000","last_peered":"2023-08-17T18:10:34.766645+0000","last_clean":"2023-08-17T18:10:34.766645+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T18:10:34.766645+0000","last_undegraded":"2023-08-17T18:10:34.766645+0000","last_fullsized":"2023-08-17T18:10:34.766645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.135023+0000","last_change":"2023-08-17T18:10:35.135023+0000","last_active":"2023-08-17T18:10:35.135023+0000","last_peered":"2023-08-17T18:10:35.135023+0000","last_clean":"2023-08-17T18:10:35.135023+0000","last_became_active":"2023-08-17T18:10:35.134693+0000","last_became_peered":"2023-08-17T18:10:35.134693+0000","last_unstale":"2023-08-17T18:10:35.135023+0000","last_undegraded":"2023-08-17T18:10:35.135023+0000","last_fullsized":"2023-08-17T18:10:35.135023+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"167'3","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144305+0000","last_change":"2023-08-17T18:10:34.774595+0000","last_active":"2023-08-17T18:10:35.144305+0000","last_peered":"2023-08-17T18:10:35.144305+0000","last_clean":"2023-08-17T18:10:35.144305+0000","last_became_active":"2023-08-17T18:10:34.774327+0000","last_became_peered":"2023-08-17T18:10:34.774327+0000","last_unstale":"2023-08-17T18:10:35.144305+0000","last_undegraded":"2023-08-17T18:10:35.144305+0000","last_fullsized":"2023-08-17T18:10:35.144305+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.764375+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T18:10:34.764375+0000","last_peered":"2023-08-17T18:10:34.764375+0000","last_clean":"2023-08-17T18:10:34.764375+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T18:10:34.764375+0000","last_undegraded":"2023-08-17T18:10:34.764375+0000","last_fullsized":"2023-08-17T18:10:34.764375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.154303+0000","last_change":"2023-08-17T18:10:35.154303+0000","last_active":"2023-08-17T18:10:35.154303+0000","last_peered":"2023-08-17T18:10:35.154303+0000","last_clean":"2023-08-17T18:10:35.154303+0000","last_became_active":"2023-08-17T18:10:35.153988+0000","last_became_peered":"2023-08-17T18:10:35.153988+0000","last_unstale":"2023-08-17T18:10:35.154303+0000","last_undegraded":"2023-08-17T18:10:35.154303+0000","last_fullsized":"2023-08-17T18:10:35.154303+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.776399+0000","last_change":"2023-08-17T18:10:34.772196+0000","last_active":"2023-08-17T18:10:34.776399+0000","last_peered":"2023-08-17T18:10:34.776399+0000","last_clean":"2023-08-17T18:10:34.776399+0000","last_became_active":"2023-08-17T18:10:34.771884+0000","last_became_peered":"2023-08-17T18:10:34.771884+0000","last_unstale":"2023-08-17T18:10:34.776399+0000","last_undegraded":"2023-08-17T18:10:34.776399+0000","last_fullsized":"2023-08-17T18:10:34.776399+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.761980+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T18:10:34.761980+0000","last_peered":"2023-08-17T18:10:34.761980+0000","last_clean":"2023-08-17T18:10:34.761980+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T18:10:34.761980+0000","last_undegraded":"2023-08-17T18:10:34.761980+0000","last_fullsized":"2023-08-17T18:10:34.761980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.146078+0000","last_change":"2023-08-17T18:10:35.146078+0000","last_active":"2023-08-17T18:10:35.146078+0000","last_peered":"2023-08-17T18:10:35.146078+0000","last_clean":"2023-08-17T18:10:35.146078+0000","last_became_active":"2023-08-17T18:10:35.145722+0000","last_became_peered":"2023-08-17T18:10:35.145722+0000","last_unstale":"2023-08-17T18:10:35.146078+0000","last_undegraded":"2023-08-17T18:10:35.146078+0000","last_fullsized":"2023-08-17T18:10:35.146078+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.148792+0000","last_change":"2023-08-17T18:10:34.780266+0000","last_active":"2023-08-17T18:10:35.148792+0000","last_peered":"2023-08-17T18:10:35.148792+0000","last_clean":"2023-08-17T18:10:35.148792+0000","last_became_active":"2023-08-17T18:10:34.780061+0000","last_became_peered":"2023-08-17T18:10:34.780061+0000","last_unstale":"2023-08-17T18:10:35.148792+0000","last_undegraded":"2023-08-17T18:10:35.148792+0000","last_fullsized":"2023-08-17T18:10:35.148792+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.765972+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T18:10:34.765972+0000","last_peered":"2023-08-17T18:10:34.765972+0000","last_clean":"2023-08-17T18:10:34.765972+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T18:10:34.765972+0000","last_undegraded":"2023-08-17T18:10:34.765972+0000","last_fullsized":"2023-08-17T18:10:34.765972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":130,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.770279+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T18:10:34.770279+0000","last_peered":"2023-08-17T18:10:34.770279+0000","last_clean":"2023-08-17T18:10:34.770279+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T18:10:34.770279+0000","last_undegraded":"2023-08-17T18:10:34.770279+0000","last_fullsized":"2023-08-17T18:10:34.770279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.152530+0000","last_change":"2023-08-17T18:10:35.152530+0000","last_active":"2023-08-17T18:10:35.152530+0000","last_peered":"2023-08-17T18:10:35.152530+0000","last_clean":"2023-08-17T18:10:35.152530+0000","last_became_active":"2023-08-17T18:10:35.152260+0000","last_became_peered":"2023-08-17T18:10:35.152260+0000","last_unstale":"2023-08-17T18:10:35.152530+0000","last_undegraded":"2023-08-17T18:10:35.152530+0000","last_fullsized":"2023-08-17T18:10:35.152530+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.785995+0000","last_change":"2023-08-17T18:10:34.783519+0000","last_active":"2023-08-17T18:10:34.785995+0000","last_peered":"2023-08-17T18:10:34.785995+0000","last_clean":"2023-08-17T18:10:34.785995+0000","last_became_active":"2023-08-17T18:10:34.783214+0000","last_became_peered":"2023-08-17T18:10:34.783214+0000","last_unstale":"2023-08-17T18:10:34.785995+0000","last_undegraded":"2023-08-17T18:10:34.785995+0000","last_fullsized":"2023-08-17T18:10:34.785995+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.770356+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T18:10:34.770356+0000","last_peered":"2023-08-17T18:10:34.770356+0000","last_clean":"2023-08-17T18:10:34.770356+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T18:10:34.770356+0000","last_undegraded":"2023-08-17T18:10:34.770356+0000","last_fullsized":"2023-08-17T18:10:34.770356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.144988+0000","last_change":"2023-08-17T18:10:35.144988+0000","last_active":"2023-08-17T18:10:35.144988+0000","last_peered":"2023-08-17T18:10:35.144988+0000","last_clean":"2023-08-17T18:10:35.144988+0000","last_became_active":"2023-08-17T18:10:35.144069+0000","last_became_peered":"2023-08-17T18:10:35.144069+0000","last_unstale":"2023-08-17T18:10:35.144988+0000","last_undegraded":"2023-08-17T18:10:35.144988+0000","last_fullsized":"2023-08-17T18:10:35.144988+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.780612+0000","last_change":"2023-08-17T18:10:34.778267+0000","last_active":"2023-08-17T18:10:34.780612+0000","last_peered":"2023-08-17T18:10:34.780612+0000","last_clean":"2023-08-17T18:10:34.780612+0000","last_became_active":"2023-08-17T18:10:34.777911+0000","last_became_peered":"2023-08-17T18:10:34.777911+0000","last_unstale":"2023-08-17T18:10:34.780612+0000","last_undegraded":"2023-08-17T18:10:34.780612+0000","last_fullsized":"2023-08-17T18:10:34.780612+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.774496+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T18:10:34.774496+0000","last_peered":"2023-08-17T18:10:34.774496+0000","last_clean":"2023-08-17T18:10:34.774496+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T18:10:34.774496+0000","last_undegraded":"2023-08-17T18:10:34.774496+0000","last_fullsized":"2023-08-17T18:10:34.774496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.135951+0000","last_change":"2023-08-17T18:10:35.135951+0000","last_active":"2023-08-17T18:10:35.135951+0000","last_peered":"2023-08-17T18:10:35.135951+0000","last_clean":"2023-08-17T18:10:35.135951+0000","last_became_active":"2023-08-17T18:10:35.135583+0000","last_became_peered":"2023-08-17T18:10:35.135583+0000","last_unstale":"2023-08-17T18:10:35.135951+0000","last_undegraded":"2023-08-17T18:10:35.135951+0000","last_fullsized":"2023-08-17T18:10:35.135951+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.790851+0000","last_change":"2023-08-17T18:10:34.785756+0000","last_active":"2023-08-17T18:10:34.790851+0000","last_peered":"2023-08-17T18:10:34.790851+0000","last_clean":"2023-08-17T18:10:34.790851+0000","last_became_active":"2023-08-17T18:10:34.785407+0000","last_became_peered":"2023-08-17T18:10:34.785407+0000","last_unstale":"2023-08-17T18:10:34.790851+0000","last_undegraded":"2023-08-17T18:10:34.790851+0000","last_fullsized":"2023-08-17T18:10:34.790851+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.767421+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T18:10:34.767421+0000","last_peered":"2023-08-17T18:10:34.767421+0000","last_clean":"2023-08-17T18:10:34.767421+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T18:10:34.767421+0000","last_undegraded":"2023-08-17T18:10:34.767421+0000","last_fullsized":"2023-08-17T18:10:34.767421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.138003+0000","last_change":"2023-08-17T18:10:35.138003+0000","last_active":"2023-08-17T18:10:35.138003+0000","last_peered":"2023-08-17T18:10:35.138003+0000","last_clean":"2023-08-17T18:10:35.138003+0000","last_became_active":"2023-08-17T18:10:35.137747+0000","last_became_peered":"2023-08-17T18:10:35.137747+0000","last_unstale":"2023-08-17T18:10:35.138003+0000","last_undegraded":"2023-08-17T18:10:35.138003+0000","last_fullsized":"2023-08-17T18:10:35.138003+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:34.752962+0000","last_clean_scrub_stamp":"2023-08-17T18:10:34.752962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"167'4","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-17T18:10:35.151337+0000","last_change":"2023-08-17T18:10:34.776380+0000","last_active":"2023-08-17T18:10:35.151337+0000","last_peered":"2023-08-17T18:10:35.151337+0000","last_clean":"2023-08-17T18:10:35.151337+0000","last_became_active":"2023-08-17T18:10:34.776040+0000","last_became_peered":"2023-08-17T18:10:34.776040+0000","last_unstale":"2023-08-17T18:10:35.151337+0000","last_undegraded":"2023-08-17T18:10:35.151337+0000","last_fullsized":"2023-08-17T18:10:35.151337+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:10:33.745556+0000","last_clean_scrub_stamp":"2023-08-17T18:10:33.745556+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-08-17T18:10:34.767343+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T18:10:34.767343+0000","last_peered":"2023-08-17T18:10:34.767343+0000","last_clean":"2023-08-17T18:10:34.767343+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T18:10:34.767343+0000","last_undegraded":"2023-08-17T18:10:34.767343+0000","last_fullsized":"2023-08-17T18:10:34.767343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575278,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303204,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068636,"statfs":{"total":96636764160,"available":96326283264,"internally_reserved":0,"allocated":2060288,"data_stored":1030071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.313},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.29299999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.77100000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.372},"max":{"1min":0.73499999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.35499999999999998,"15min":0.315},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.5},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.47699999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78600000000000003,"5min":0.80400000000000005,"15min":0.81699999999999995},"last":0.622},{"interface":"front","average":{"1min":0.625,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.47599999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.34399999999999997,"5min":0.29499999999999998,"15min":0.247},"max":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.32300000000000001},"max":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.76900000000000002},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.28299999999999997},"max":{"1min":0.76700000000000002,"5min":0.79800000000000004,"15min":0.81699999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.32900000000000001},"max":{"1min":0.752,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.82999999999999996,"15min":0.84199999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.44700000000000001,"5min":0.36899999999999999,"15min":0.32700000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.82099999999999995},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575278,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303216,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068624,"statfs":{"total":96636764160,"available":96326270976,"internally_reserved":0,"allocated":2072576,"data_stored":1036750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52600000000000002,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.312},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.625},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.59999999999999998},"min":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.371},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.58499999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45100000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.88700000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47999999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.373}]},{"osd":5,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":1.0269999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.84299999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.32300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.37},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.97699999999999998},"last":0.433}]}]},{"osd":1,"up_from":13,"seq":55834575279,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303204,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068636,"statfs":{"total":96636764160,"available":96326283264,"internally_reserved":0,"allocated":2060288,"data_stored":1030071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35599999999999998,"15min":0.35499999999999998},"min":{"1min":0.24399999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.497,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.39300000000000002,"15min":0.38500000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.215},"max":{"1min":0.47899999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38300000000000001,"15min":0.372},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.504,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.41199999999999998,"15min":0.40899999999999997},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.621},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.59099999999999997,"5min":1.095,"15min":1.095},"last":0.375},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":0.57799999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.311}]},{"osd":4,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.47499999999999998,"5min":0.39500000000000002,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61599999999999999,"15min":0.61899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.96199999999999997},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.40899999999999997,"15min":0.38300000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.94499999999999995},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.40300000000000002},"max":{"1min":0.82099999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Aug 17 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.42199999999999999,"15min":0.42099999999999999},"max":{"1min":0.82799999999999996,"5min":0.89500000000000002,"15min":0.91800000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89300000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575278,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303216,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068624,"statfs":{"total":96636764160,"available":96326270976,"internally_reserved":0,"allocated":2072576,"data_stored":1036750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35199999999999998,"15min":0.36199999999999999},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.54800000000000004,"5min":0.64100000000000001,"15min":0.77600000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38600000000000001,"15min":0.40100000000000002},"min":{"1min":0.29799999999999999,"5min":0.27900000000000003,"15min":0.24399999999999999},"max":{"1min":0.46800000000000003,"5min":0.63500000000000001,"15min":0.70899999999999996},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.374,"15min":0.378},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.56000000000000005,"5min":0.61199999999999999,"15min":0.61399999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40899999999999997,"15min":0.42299999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":0.70299999999999996,"15min":0.754},"last":0.313}]},{"osd":3,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.25800000000000001},"max":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.66100000000000003},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.42899999999999999},"min":{"1min":0.29099999999999998,"5min":0.26300000000000001,"15min":0.253},"max":{"1min":0.60199999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.376}]},{"osd":4,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.627,"15min":0.63400000000000001},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.379},"max":{"1min":0.80400000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76400000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.627,"15min":0.63400000000000001},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.38300000000000001},"max":{"1min":0.82899999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.621,"15min":0.624},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.35199999999999998},"max":{"1min":0.752,"5min":1.079,"15min":1.079},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.42399999999999999,"15min":0.371},"max":{"1min":0.81499999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Aug 17 18:09:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65600000000000003,"15min":0.67800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":1.0549999999999999,"15min":1.0820000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.53300000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.872,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834575278,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303216,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068624,"statfs":{"total":96636764160,"available":96326270976,"internally_reserved":0,"allocated":2072576,"data_stored":1036750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.20300000000000001},"max":{"1min":0.41999999999999998,"5min":0.62,"15min":0.623},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.377,"15min":0.36899999999999999},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.249},"max":{"1min":0.46700000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.28100000000000003,"15min":0.26100000000000001},"max":{"1min":0.53200000000000003,"5min":0.61599999999999999,"15min":0.68100000000000005},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42499999999999999,"15min":0.42399999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25600000000000001},"max":{"1min":0.504,"5min":0.60299999999999998,"15min":0.72999999999999998},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.26700000000000002},"max":{"1min":0.54400000000000004,"5min":0.64000000000000001,"15min":0.67000000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.26700000000000002},"max":{"1min":0.58699999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.38500000000000001},"max":{"1min":0.71199999999999997,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.627},"min":{"1min":0.44,"5min":0.438,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":1.21}]},{"osd":5,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.41999999999999998},"max":{"1min":0.90400000000000003,"5min":0.91000000000000003,"15min":0.94799999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63900000000000001,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81499999999999995,"5min":0.91500000000000004,"15min":1.3100000000000001},"last":1.254}]},{"osd":6,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40899999999999997},"max":{"1min":0.79200000000000004,"5min":0.89900000000000002,"15min":0.96099999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82999999999999996,"5min":0.94199999999999995,"15min":1.0549999999999999},"last":0.749}]},{"osd":7,"last update":"Thu Aug 17 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.65800000000000003,"15min":0.65500000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.42099999999999999},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":1.353},"last":1.234},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.93500000000000005,"15min":1.0469999999999999},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575278,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307312,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064528,"statfs":{"total":96636764160,"available":96322076672,"internally_reserved":0,"allocated":2072576,"data_stored":1036750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.27400000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.44800000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"last":0.433},{"interface":"front","average":{"1min":0.376,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.504,"5min":0.59899999999999998,"15min":0.625},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38400000000000001,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54200000000000004,"5min":0.59399999999999997,"15min":0.72299999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.40899999999999997},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63400000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.314,"5min":0.28399999999999997,"15min":0.24199999999999999},"max":{"1min":0.56899999999999995,"5min":0.58999999999999997,"15min":0.98699999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.32900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.96399999999999997},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.622,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.437,"15min":0.39500000000000002},"max":{"1min":0.87,"5min":0.89900000000000002,"15min":0.95499999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.50800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.93100000000000005},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.49299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.96299999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.90700000000000003},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.57299999999999995,"5min":0.378,"15min":0.378},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94399999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.52100000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94899999999999995},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:09:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.60899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.97099999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.52400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303236,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068604,"statfs":{"total":96636764160,"available":96326250496,"internally_reserved":0,"allocated":2093056,"data_stored":1044573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.33900000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.437}]},{"osd":1,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.69999999999999996,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.51100000000000001,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.83799999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.81999999999999995},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.58599999999999997,"15min":0.56899999999999995},"min":{"1min":0.45600000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.47299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.5}]},{"osd":5,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54800000000000004,"5min":0.72099999999999997,"15min":0.79700000000000004},"last":0.75},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.28799999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.629}]},{"osd":7,"last update":"Thu Aug 17 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.379,"5min":0.33600000000000002,"15min":0.33300000000000002},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.872,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575277,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307300,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064540,"statfs":{"total":96636764160,"available":96322088960,"internally_reserved":0,"allocated":2060288,"data_stored":1030071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.72599999999999998,"15min":0.80300000000000005},"last":0.497},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.39900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.76500000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.38700000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.78200000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72699999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72099999999999997,"5min":0.79500000000000004,"15min":0.83899999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.34300000000000003},"max":{"1min":0.72999999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68200000000000005,"5min":0.76100000000000001,"15min":0.79900000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.378},"max":{"1min":0.70299999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.437,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28000000000000003},"max":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.71599999999999997},"last":0.433},{"interface":"front","average":{"1min":0.439,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.622,"5min":0.71599999999999997,"15min":0.76200000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.73599999999999999,"15min":0.79500000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.76700000000000002},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Aug 17 18:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72199999999999998,"5min":0.752,"15min":0.81499999999999995},"last":0.623},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.77000000000000002,"15min":0.82999999999999996},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T18:10:38.484 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T18:10:38.485 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T18:10:38.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.645+0000 7f33bab37700 1 Processor -- start 2023-08-17T18:10:38.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.645+0000 7f33bab37700 1 -- start start 2023-08-17T18:10:38.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.646+0000 7f33bab37700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 0x7f33b40c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.646+0000 7f33bab37700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f33b4155880 0x7f33b40c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.646+0000 7f33bab37700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b41553f0 con 0x7f33b413aae0 2023-08-17T18:10:38.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.646+0000 7f33bab37700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b40c7290 con 0x7f33b4155880 2023-08-17T18:10:38.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.646+0000 7f33bab37700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b41523f0 con 0x7f33b413a700 2023-08-17T18:10:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.646+0000 7f33b3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f33b4155880 0x7f33b40c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.646+0000 7f33b3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f33b4155880 0x7f33b40c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51540/0 (socket says 172.21.15.78:51540) 2023-08-17T18:10:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.646+0000 7f33b3fff700 1 -- 172.21.15.78:0/1964137065 learned_addr learned my addr 172.21.15.78:0/1964137065 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.646+0000 7f33b88d3700 1 --2- 172.21.15.78:0/1964137065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 0x7f33b40c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.647+0000 7f33b3fff700 1 -- 172.21.15.78:0/1964137065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 msgr2=0x7f33b40c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.647+0000 7f33b3fff700 1 --2- 172.21.15.78:0/1964137065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 0x7f33b40c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.647+0000 7f33b3fff700 1 -- 172.21.15.78:0/1964137065 >> v1:172.21.15.150:6789/0 conn(0x7f33b413aae0 legacy=0x7f33b4151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.647+0000 7f33b3fff700 1 -- 172.21.15.78:0/1964137065 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b4154da0 con 0x7f33b4155880 2023-08-17T18:10:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.647+0000 7f33b88d3700 1 --2- 172.21.15.78:0/1964137065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 0x7f33b40c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.647+0000 7f33b3fff700 1 --2- 172.21.15.78:0/1964137065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b4155880 0x7f33b40c6da0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f33a0006fd0 tx=0x7f33a00090f0).ready entity=mon.0 client_cookie=f082ae7a6512e7c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.647+0000 7f33b37fe700 1 -- 172.21.15.78:0/1964137065 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a000b600 con 0x7f33b4155880 2023-08-17T18:10:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.647+0000 7f33b37fe700 1 -- 172.21.15.78:0/1964137065 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a000b760 con 0x7f33b4155880 2023-08-17T18:10:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.647+0000 7f33b37fe700 1 -- 172.21.15.78:0/1964137065 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a000bb00 con 0x7f33b4155880 2023-08-17T18:10:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.648+0000 7f33bab37700 1 -- 172.21.15.78:0/1964137065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b4155880 msgr2=0x7f33b40c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.648+0000 7f33bab37700 1 --2- 172.21.15.78:0/1964137065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b4155880 0x7f33b40c6da0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f33a0006fd0 tx=0x7f33a00090f0).stop 2023-08-17T18:10:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.648+0000 7f33bab37700 1 -- 172.21.15.78:0/1964137065 shutdown_connections 2023-08-17T18:10:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.648+0000 7f33bab37700 1 --2- 172.21.15.78:0/1964137065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 0x7f33b40c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.648+0000 7f33bab37700 1 --2- 172.21.15.78:0/1964137065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b4155880 0x7f33b40c6da0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.648+0000 7f33bab37700 1 -- 172.21.15.78:0/1964137065 >> 172.21.15.78:0/1964137065 conn(0x7f33b4064070 msgr2=0x7f33b40c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.648+0000 7f33bab37700 1 -- 172.21.15.78:0/1964137065 shutdown_connections 2023-08-17T18:10:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.648+0000 7f33bab37700 1 -- 172.21.15.78:0/1964137065 wait complete. 2023-08-17T18:10:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.649+0000 7f33bab37700 1 Processor -- start 2023-08-17T18:10:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.649+0000 7f33bab37700 1 -- start start 2023-08-17T18:10:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33bab37700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 0x7f33b40a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33bab37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b413aae0 0x7f33b4062b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33bab37700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b4155880 0x7f33b40aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33bab37700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40a9bf0 con 0x7f33b413aae0 2023-08-17T18:10:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33bab37700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4063000 con 0x7f33b4155880 2023-08-17T18:10:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33bab37700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40abf30 con 0x7f33b413a700 2023-08-17T18:10:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33b3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b413aae0 0x7f33b4062b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33b3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b413aae0 0x7f33b4062b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51556/0 (socket says 172.21.15.78:51556) 2023-08-17T18:10:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33b3fff700 1 -- 172.21.15.78:0/1074712675 learned_addr learned my addr 172.21.15.78:0/1074712675 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33b88d3700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 0x7f33b40a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33b90d4700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b4155880 0x7f33b40aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33b3fff700 1 -- 172.21.15.78:0/1074712675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 msgr2=0x7f33b40a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33b3fff700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 0x7f33b40a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33b3fff700 1 -- 172.21.15.78:0/1074712675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b4155880 msgr2=0x7f33b40aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33b3fff700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b4155880 0x7f33b40aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.650+0000 7f33b3fff700 1 -- 172.21.15.78:0/1074712675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a0009370 con 0x7f33b413aae0 2023-08-17T18:10:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.651+0000 7f33b3fff700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b413aae0 0x7f33b4062b10 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f33b40bec00 tx=0x7f33a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.651+0000 7f33b0ff9700 1 -- 172.21.15.78:0/1074712675 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a000bec0 con 0x7f33b413aae0 2023-08-17T18:10:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.651+0000 7f33b0ff9700 1 -- 172.21.15.78:0/1074712675 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a000b8d0 con 0x7f33b413aae0 2023-08-17T18:10:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.651+0000 7f33bab37700 1 -- 172.21.15.78:0/1074712675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b40a9e00 con 0x7f33b413aae0 2023-08-17T18:10:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.651+0000 7f33b0ff9700 1 -- 172.21.15.78:0/1074712675 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a001d430 con 0x7f33b413aae0 2023-08-17T18:10:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.651+0000 7f33bab37700 1 -- 172.21.15.78:0/1074712675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b40a7710 con 0x7f33b413aae0 2023-08-17T18:10:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.652+0000 7f33bab37700 1 -- 172.21.15.78:0/1074712675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b4047350 con 0x7f33b413aae0 2023-08-17T18:10:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.653+0000 7f33b0ff9700 1 -- 172.21.15.78:0/1074712675 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f33a000f070 con 0x7f33b413aae0 2023-08-17T18:10:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.653+0000 7f33b0ff9700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f339805ed90 0x7f3398061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.653+0000 7f33b0ff9700 1 -- 172.21.15.78:0/1074712675 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f33a007bf10 con 0x7f33b413aae0 2023-08-17T18:10:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.653+0000 7f33b88d3700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f339805ed90 0x7f3398061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.653+0000 7f33b88d3700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f339805ed90 0x7f3398061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f33a8006fd0 tx=0x7f33a8008040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.657+0000 7f33b0ff9700 1 -- 172.21.15.78:0/1074712675 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f33a004d620 con 0x7f33b413aae0 2023-08-17T18:10:38.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.895+0000 7f33bab37700 1 -- 172.21.15.78:0/1074712675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f33b4155080 con 0x7f33b413aae0 2023-08-17T18:10:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.899+0000 7f33b0ff9700 1 -- 172.21.15.78:0/1074712675 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v33) v1 ==== 190+0+0 (secure 0 0 0) 0x7f33a0050c00 con 0x7f33b413aae0 2023-08-17T18:10:38.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.901+0000 7f33bab37700 1 -- 172.21.15.78:0/1074712675 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f339805ed90 msgr2=0x7f3398061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.901+0000 7f33bab37700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f339805ed90 0x7f3398061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f33a8006fd0 tx=0x7f33a8008040).stop 2023-08-17T18:10:38.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.901+0000 7f33bab37700 1 -- 172.21.15.78:0/1074712675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b413aae0 msgr2=0x7f33b4062b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:38.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.901+0000 7f33bab37700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b413aae0 0x7f33b4062b10 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f33b40bec00 tx=0x7f33a0017000).stop 2023-08-17T18:10:38.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.901+0000 7f33bab37700 1 -- 172.21.15.78:0/1074712675 shutdown_connections 2023-08-17T18:10:38.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.901+0000 7f33bab37700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f339805ed90 0x7f3398061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.901+0000 7f33bab37700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b4155880 0x7f33b40aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.901+0000 7f33bab37700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33b413a700 0x7f33b40a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.901+0000 7f33bab37700 1 --2- 172.21.15.78:0/1074712675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33b413aae0 0x7f33b4062b10 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.902+0000 7f33bab37700 1 -- 172.21.15.78:0/1074712675 >> 172.21.15.78:0/1074712675 conn(0x7f33b4064070 msgr2=0x7f33b4134a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.902+0000 7f33bab37700 1 -- 172.21.15.78:0/1074712675 shutdown_connections 2023-08-17T18:10:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:38.902+0000 7f33bab37700 1 -- 172.21.15.78:0/1074712675 wait complete. 2023-08-17T18:10:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-08-17T18:10:38.915 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:10:39.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.033+0000 7f45ace68700 1 Processor -- start 2023-08-17T18:10:39.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.033+0000 7f45ace68700 1 -- start start 2023-08-17T18:10:39.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.034+0000 7f45ace68700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f45a814dd20 0x7f45a80c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.034+0000 7f45ace68700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 0x7f45a80a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.034+0000 7f45ace68700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a8068c60 con 0x7f45a814e100 2023-08-17T18:10:39.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.034+0000 7f45ace68700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a8154d70 con 0x7f45a814dd20 2023-08-17T18:10:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.034+0000 7f45ace68700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80c20c0 con 0x7f45a81545f0 2023-08-17T18:10:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.034+0000 7f45a77fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f45a814dd20 0x7f45a80c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.034+0000 7f45a77fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f45a814dd20 0x7f45a80c0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:60624/0 (socket says 172.21.15.78:60624) 2023-08-17T18:10:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.034+0000 7f45a7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 0x7f45a80a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.034+0000 7f45a77fe700 1 -- 172.21.15.78:0/528403592 learned_addr learned my addr 172.21.15.78:0/528403592 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:39.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.035+0000 7f45a77fe700 1 -- 172.21.15.78:0/528403592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 msgr2=0x7f45a80a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.035+0000 7f45a77fe700 1 --2- 172.21.15.78:0/528403592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 0x7f45a80a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.035+0000 7f45a77fe700 1 -- 172.21.15.78:0/528403592 >> v1:172.21.15.150:6789/0 conn(0x7f45a814e100 legacy=0x7f45a8153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.035+0000 7f45a77fe700 1 -- 172.21.15.78:0/528403592 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a80694f0 con 0x7f45a814dd20 2023-08-17T18:10:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.035+0000 7f45a6ffd700 1 -- 172.21.15.78:0/528403592 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736190112 0 0) 0x7f4590001110 con 0x7f45a814e100 2023-08-17T18:10:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.035+0000 7f45a7fff700 1 --2- 172.21.15.78:0/528403592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 0x7f45a80a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.035+0000 7f45a77fe700 1 --2- 172.21.15.78:0/528403592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45a814dd20 0x7f45a80c0ea0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f4598009810 tx=0x7f4598009060).ready entity=mon.1 client_cookie=ed080b5b22269e93 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.035+0000 7f45a6ffd700 1 -- 172.21.15.78:0/528403592 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598005880 con 0x7f45a814dd20 2023-08-17T18:10:39.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.035+0000 7f45a6ffd700 1 -- 172.21.15.78:0/528403592 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45980059e0 con 0x7f45a814dd20 2023-08-17T18:10:39.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.035+0000 7f45a6ffd700 1 -- 172.21.15.78:0/528403592 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598005d60 con 0x7f45a814dd20 2023-08-17T18:10:39.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.036+0000 7f45ace68700 1 -- 172.21.15.78:0/528403592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45a814dd20 msgr2=0x7f45a80c0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.036+0000 7f45ace68700 1 --2- 172.21.15.78:0/528403592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45a814dd20 0x7f45a80c0ea0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f4598009810 tx=0x7f4598009060).stop 2023-08-17T18:10:39.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.036+0000 7f45ace68700 1 -- 172.21.15.78:0/528403592 shutdown_connections 2023-08-17T18:10:39.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.036+0000 7f45ace68700 1 --2- 172.21.15.78:0/528403592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 0x7f45a80a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.036+0000 7f45ace68700 1 --2- 172.21.15.78:0/528403592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45a814dd20 0x7f45a80c0ea0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.036+0000 7f45ace68700 1 -- 172.21.15.78:0/528403592 >> 172.21.15.78:0/528403592 conn(0x7f45a80c7320 msgr2=0x7f45a80c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:39.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.036+0000 7f45ace68700 1 -- 172.21.15.78:0/528403592 shutdown_connections 2023-08-17T18:10:39.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.036+0000 7f45ace68700 1 -- 172.21.15.78:0/528403592 wait complete. 2023-08-17T18:10:39.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.037+0000 7f45ace68700 1 Processor -- start 2023-08-17T18:10:39.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.037+0000 7f45ace68700 1 -- start start 2023-08-17T18:10:39.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45ace68700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45a814dd20 0x7f45a8149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45ace68700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45a814e100 0x7f45a80ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45ace68700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 0x7f45a80ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45ace68700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8148c20 con 0x7f45a814dd20 2023-08-17T18:10:39.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45ace68700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8064e60 con 0x7f45a814e100 2023-08-17T18:10:39.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45ace68700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8063f70 con 0x7f45a81545f0 2023-08-17T18:10:39.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45a77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45a814dd20 0x7f45a8149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45a77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45a814dd20 0x7f45a8149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51566/0 (socket says 172.21.15.78:51566) 2023-08-17T18:10:39.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45a77fe700 1 -- 172.21.15.78:0/1822227818 learned_addr learned my addr 172.21.15.78:0/1822227818 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:39.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f459effd700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45a814e100 0x7f45a80ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45a7fff700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 0x7f45a80ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45a77fe700 1 -- 172.21.15.78:0/1822227818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 msgr2=0x7f45a80ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45a77fe700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 0x7f45a80ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45a77fe700 1 -- 172.21.15.78:0/1822227818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45a814e100 msgr2=0x7f45a80ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45a77fe700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45a814e100 0x7f45a80ac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.038+0000 7f45a77fe700 1 -- 172.21.15.78:0/1822227818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0009a20 con 0x7f45a814dd20 2023-08-17T18:10:39.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.039+0000 7f45a77fe700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45a814dd20 0x7f45a8149620 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f4598009eb0 tx=0x7f4598016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.039+0000 7f459ffff700 1 -- 172.21.15.78:0/1822227818 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980067e0 con 0x7f45a814dd20 2023-08-17T18:10:39.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.039+0000 7f459ffff700 1 -- 172.21.15.78:0/1822227818 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459800b790 con 0x7f45a814dd20 2023-08-17T18:10:39.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.039+0000 7f459ffff700 1 -- 172.21.15.78:0/1822227818 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459800bb10 con 0x7f45a814dd20 2023-08-17T18:10:39.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.039+0000 7f45ace68700 1 -- 172.21.15.78:0/1822227818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4598009300 con 0x7f45a814dd20 2023-08-17T18:10:39.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.039+0000 7f45ace68700 1 -- 172.21.15.78:0/1822227818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a8064530 con 0x7f45a814dd20 2023-08-17T18:10:39.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.040+0000 7f45ace68700 1 -- 172.21.15.78:0/1822227818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a80bca50 con 0x7f45a814dd20 2023-08-17T18:10:39.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.040+0000 7f459ffff700 1 -- 172.21.15.78:0/1822227818 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f459800f070 con 0x7f45a814dd20 2023-08-17T18:10:39.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.041+0000 7f459ffff700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f458805ed60 0x7f4588061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.041+0000 7f459ffff700 1 -- 172.21.15.78:0/1822227818 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f459807ac30 con 0x7f45a814dd20 2023-08-17T18:10:39.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.041+0000 7f459effd700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f458805ed60 0x7f4588061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.041+0000 7f459effd700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f458805ed60 0x7f4588061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f45a8148fb0 tx=0x7f4590007a20).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.045+0000 7f459ffff700 1 -- 172.21.15.78:0/1822227818 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f459804c1d0 con 0x7f45a814dd20 2023-08-17T18:10:39.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.272+0000 7f45ace68700 1 -- 172.21.15.78:0/1822227818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45a80c7730 con 0x7f45a814dd20 2023-08-17T18:10:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.273+0000 7f459ffff700 1 -- 172.21.15.78:0/1822227818 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f459804f7f0 con 0x7f45a814dd20 2023-08-17T18:10:39.274 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:39.274 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1301951105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1301951105},{"type":"v1","addr":"172.21.15.150:6834","nonce":1301951105}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3263459818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3263459818},{"type":"v1","addr":"172.21.15.78:6836","nonce":3263459818}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4038964498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4038964498},{"type":"v1","addr":"172.21.15.78:6837","nonce":4038964498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:10:35.123034+0000","modified":"2023-08-17T18:10:37.129045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/607383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":607383},{"type":"v1","addr":"172.21.15.150:6835","nonce":607383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T18:10:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 -- 172.21.15.78:0/1822227818 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f458805ed60 msgr2=0x7f4588061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f458805ed60 0x7f4588061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f45a8148fb0 tx=0x7f4590007a20).stop 2023-08-17T18:10:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 -- 172.21.15.78:0/1822227818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45a814dd20 msgr2=0x7f45a8149620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45a814dd20 0x7f45a8149620 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f4598009eb0 tx=0x7f4598016000).stop 2023-08-17T18:10:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 -- 172.21.15.78:0/1822227818 shutdown_connections 2023-08-17T18:10:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f458805ed60 0x7f4588061220 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45a81545f0 0x7f45a80ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45a814dd20 0x7f45a8149620 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 --2- 172.21.15.78:0/1822227818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45a814e100 0x7f45a80ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 -- 172.21.15.78:0/1822227818 >> 172.21.15.78:0/1822227818 conn(0x7f45a80c7320 msgr2=0x7f45a80bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 -- 172.21.15.78:0/1822227818 shutdown_connections 2023-08-17T18:10:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.275+0000 7f45ace68700 1 -- 172.21.15.78:0/1822227818 wait complete. 2023-08-17T18:10:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 61 2023-08-17T18:10:39.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T18:10:35.123034+0000', 'modified': '2023-08-17T18:10:37.129045+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9090}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9090': {'gid': 9090, 'name': 'b', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/607383', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 607383}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 607383}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T18:10:39.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T18:10:39.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-17T18:10:39.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.807+0000 7f2781270700 1 Processor -- start 2023-08-17T18:10:39.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.807+0000 7f2781270700 1 -- start start 2023-08-17T18:10:39.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f2781270700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f277c069310 0x7f277c0696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f2781270700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f277c066480 0x7f277c0c3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f2781270700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c065ff0 con 0x7f277c0c3d10 2023-08-17T18:10:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f2781270700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c0c41a0 con 0x7f277c066480 2023-08-17T18:10:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f2781270700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c0653e0 con 0x7f277c069310 2023-08-17T18:10:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f277a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f277c066480 0x7f277c0c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f277a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f277c066480 0x7f277c0c3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51572/0 (socket says 172.21.15.78:51572) 2023-08-17T18:10:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f277b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f277c0c3d10 0x7f277c0c5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42238/0 (socket says 172.21.15.78:42238) 2023-08-17T18:10:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f277a7fc700 1 -- 172.21.15.78:0/2613828282 learned_addr learned my addr 172.21.15.78:0/2613828282 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f277affd700 1 --2- 172.21.15.78:0/2613828282 >> v2:172.21.15.150:3300/0 conn(0x7f277c069310 0x7f277c0696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f277a7fc700 1 -- 172.21.15.78:0/2613828282 >> v2:172.21.15.150:3300/0 conn(0x7f277c069310 msgr2=0x7f277c0696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f277a7fc700 1 --2- 172.21.15.78:0/2613828282 >> v2:172.21.15.150:3300/0 conn(0x7f277c069310 0x7f277c0696f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f277a7fc700 1 -- 172.21.15.78:0/2613828282 >> v1:172.21.15.78:6789/0 conn(0x7f277c0c3d10 legacy=0x7f277c0c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f2779ffb700 1 -- 172.21.15.78:0/2613828282 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721614640 0 0) 0x7f277c065ff0 con 0x7f277c0c3d10 2023-08-17T18:10:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.808+0000 7f277a7fc700 1 -- 172.21.15.78:0/2613828282 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c0656c0 con 0x7f277c066480 2023-08-17T18:10:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f277a7fc700 1 --2- 172.21.15.78:0/2613828282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c066480 0x7f277c0c3820 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f277c05faf0 tx=0x7f27700090f0).ready entity=mon.0 client_cookie=2a476731c272d779 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f2779ffb700 1 -- 172.21.15.78:0/2613828282 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000b600 con 0x7f277c066480 2023-08-17T18:10:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f2779ffb700 1 -- 172.21.15.78:0/2613828282 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277000b760 con 0x7f277c066480 2023-08-17T18:10:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f2779ffb700 1 -- 172.21.15.78:0/2613828282 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000bae0 con 0x7f277c066480 2023-08-17T18:10:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f2781270700 1 -- 172.21.15.78:0/2613828282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c066480 msgr2=0x7f277c0c3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f2781270700 1 --2- 172.21.15.78:0/2613828282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c066480 0x7f277c0c3820 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f277c05faf0 tx=0x7f27700090f0).stop 2023-08-17T18:10:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f2781270700 1 -- 172.21.15.78:0/2613828282 shutdown_connections 2023-08-17T18:10:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f2781270700 1 --2- 172.21.15.78:0/2613828282 >> v2:172.21.15.150:3300/0 conn(0x7f277c069310 0x7f277c0696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f2781270700 1 --2- 172.21.15.78:0/2613828282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c066480 0x7f277c0c3820 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f2781270700 1 -- 172.21.15.78:0/2613828282 >> 172.21.15.78:0/2613828282 conn(0x7f277c0c8680 msgr2=0x7f277c0c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:39.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.809+0000 7f2781270700 1 -- 172.21.15.78:0/2613828282 shutdown_connections 2023-08-17T18:10:39.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.810+0000 7f2781270700 1 -- 172.21.15.78:0/2613828282 wait complete. 2023-08-17T18:10:39.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.811+0000 7f2781270700 1 Processor -- start 2023-08-17T18:10:39.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.811+0000 7f2781270700 1 -- start start 2023-08-17T18:10:39.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f2781270700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f277c066480 0x7f277c0626b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f2781270700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c069310 0x7f277c135d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f2781270700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f277c0c3d10 0x7f277c136200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f2781270700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c167670 con 0x7f277c069310 2023-08-17T18:10:39.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f2781270700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c167950 con 0x7f277c066480 2023-08-17T18:10:39.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f2781270700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c167c30 con 0x7f277c0c3d10 2023-08-17T18:10:39.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c069310 0x7f277c135d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c069310 0x7f277c135d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51578/0 (socket says 172.21.15.78:51578) 2023-08-17T18:10:39.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277a7fc700 1 -- 172.21.15.78:0/3877071113 learned_addr learned my addr 172.21.15.78:0/3877071113 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:39.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277affd700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f277c066480 0x7f277c0626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277b7fe700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f277c0c3d10 0x7f277c136200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277a7fc700 1 -- 172.21.15.78:0/3877071113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f277c0c3d10 msgr2=0x7f277c136200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277a7fc700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f277c0c3d10 0x7f277c136200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277a7fc700 1 -- 172.21.15.78:0/3877071113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f277c066480 msgr2=0x7f277c0626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277a7fc700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f277c066480 0x7f277c0626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277a7fc700 1 -- 172.21.15.78:0/3877071113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009370 con 0x7f277c069310 2023-08-17T18:10:39.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277affd700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f277c066480 0x7f277c0626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:39.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f277a7fc700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c069310 0x7f277c135d10 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f2770009130 tx=0x7f2770017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.812+0000 7f2762ffd700 1 -- 172.21.15.78:0/3877071113 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000b8d0 con 0x7f277c069310 2023-08-17T18:10:39.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.813+0000 7f2762ffd700 1 -- 172.21.15.78:0/3877071113 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277000ba30 con 0x7f277c069310 2023-08-17T18:10:39.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.813+0000 7f2762ffd700 1 -- 172.21.15.78:0/3877071113 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277001c670 con 0x7f277c069310 2023-08-17T18:10:39.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.813+0000 7f2781270700 1 -- 172.21.15.78:0/3877071113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c167f10 con 0x7f277c069310 2023-08-17T18:10:39.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.813+0000 7f2781270700 1 -- 172.21.15.78:0/3877071113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c1366f0 con 0x7f277c069310 2023-08-17T18:10:39.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.817+0000 7f2762ffd700 1 -- 172.21.15.78:0/3877071113 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f277002c070 con 0x7f277c069310 2023-08-17T18:10:39.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.817+0000 7f2762ffd700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f276805ed90 0x7f2768061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.817+0000 7f2762ffd700 1 -- 172.21.15.78:0/3877071113 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f277007b7c0 con 0x7f277c069310 2023-08-17T18:10:39.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.818+0000 7f2792c05b80 1 Processor -- start 2023-08-17T18:10:39.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.818+0000 7f277affd700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f276805ed90 0x7f2768061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.818+0000 7f2792c05b80 1 -- start start 2023-08-17T18:10:39.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.818+0000 7f277affd700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f276805ed90 0x7f2768061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f276c00bb60 tx=0x7f276c008040).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde42c20 0x55fbfde43000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 0x55fbfde3df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde3e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f2792c05b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfde08d00 con 0x55fbfde3e3f0 2023-08-17T18:10:39.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f2792c05b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfdd7fcb0 con 0x55fbfde42c20 2023-08-17T18:10:39.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f2792c05b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbfdd94c90 con 0x55fbfde8b8c0 2023-08-17T18:10:39.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde3e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde3e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51594/0 (socket says 172.21.15.78:51594) 2023-08-17T18:10:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277a7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 0x55fbfde3df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277b7fe700 1 -- 172.21.15.78:0/1320661913 learned_addr learned my addr 172.21.15.78:0/1320661913 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde42c20 0x55fbfde43000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277b7fe700 1 -- 172.21.15.78:0/1320661913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 msgr2=0x55fbfde3df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277b7fe700 1 --2- 172.21.15.78:0/1320661913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 0x55fbfde3df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277b7fe700 1 -- 172.21.15.78:0/1320661913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde42c20 msgr2=0x55fbfde43000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277b7fe700 1 --2- 172.21.15.78:0/1320661913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde42c20 0x55fbfde43000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277b7fe700 1 -- 172.21.15.78:0/1320661913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbfdc37310 con 0x55fbfde3e3f0 2023-08-17T18:10:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.819+0000 7f277affd700 1 --2- 172.21.15.78:0/1320661913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde42c20 0x55fbfde43000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f277b7fe700 1 --2- 172.21.15.78:0/1320661913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde3e870 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f2774007340 tx=0x7f2774005d40).ready entity=mon.0 client_cookie=16cc60952c80c4c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f275bfff700 1 -- 172.21.15.78:0/1320661913 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400e580 con 0x55fbfde3e3f0 2023-08-17T18:10:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f275bfff700 1 -- 172.21.15.78:0/1320661913 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277400e6e0 con 0x55fbfde3e3f0 2023-08-17T18:10:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f275bfff700 1 -- 172.21.15.78:0/1320661913 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400eaa0 con 0x55fbfde3e3f0 2023-08-17T18:10:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f2792c05b80 1 -- 172.21.15.78:0/1320661913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 msgr2=0x55fbfde3e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f2792c05b80 1 --2- 172.21.15.78:0/1320661913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde3e870 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f2774007340 tx=0x7f2774005d40).stop 2023-08-17T18:10:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f2792c05b80 1 -- 172.21.15.78:0/1320661913 shutdown_connections 2023-08-17T18:10:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f2792c05b80 1 --2- 172.21.15.78:0/1320661913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde3e870 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f2792c05b80 1 --2- 172.21.15.78:0/1320661913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde42c20 0x55fbfde43000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f2792c05b80 1 --2- 172.21.15.78:0/1320661913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 0x55fbfde3df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.820+0000 7f2792c05b80 1 -- 172.21.15.78:0/1320661913 >> 172.21.15.78:0/1320661913 conn(0x55fbfdbffe40 msgr2=0x55fbfde8bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.821+0000 7f2792c05b80 1 -- 172.21.15.78:0/1320661913 shutdown_connections 2023-08-17T18:10:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.821+0000 7f2792c05b80 1 -- 172.21.15.78:0/1320661913 wait complete. 2023-08-17T18:10:39.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.821+0000 7f2792c05b80 1 -- start start 2023-08-17T18:10:39.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.821+0000 7f2792c05b80 1 Processor -- start 2023-08-17T18:10:39.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.822+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde3e3f0 0x55fbfde82ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.822+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde70e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.822+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 0x55fbfde71360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.822+0000 7f2792c05b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfdd5bef0 con 0x55fbfde42c20 2023-08-17T18:10:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.822+0000 7f2792c05b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfdd608d0 con 0x55fbfde3e3f0 2023-08-17T18:10:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.822+0000 7f2792c05b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbfde83090 con 0x55fbfde8b8c0 2023-08-17T18:10:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.822+0000 7f2792c05b80 10 client.0 ll_register_callbacks cb 0x55fbfde02ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T18:10:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.822+0000 7f277a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde70e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde70e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51598/0 (socket says 172.21.15.78:51598) 2023-08-17T18:10:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277a7fc700 1 -- 172.21.15.78:0/4035006033 learned_addr learned my addr 172.21.15.78:0/4035006033 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277b7fe700 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 0x55fbfde71360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277affd700 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde3e3f0 0x55fbfde82ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277a7fc700 1 -- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 msgr2=0x55fbfde71360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277a7fc700 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 0x55fbfde71360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277a7fc700 1 -- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde3e3f0 msgr2=0x55fbfde82ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277a7fc700 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde3e3f0 0x55fbfde82ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277a7fc700 1 -- 172.21.15.78:0/4035006033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c00e040 con 0x55fbfde42c20 2023-08-17T18:10:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277b7fe700 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 0x55fbfde71360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f277a7fc700 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde70e70 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f2770050720 tx=0x7f277007b040).ready entity=mon.0 client_cookie=5d50f411664ce7e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f27597fa700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T18:10:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f27597fa700 1 -- 172.21.15.78:0/4035006033 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277004ff10 con 0x55fbfde42c20 2023-08-17T18:10:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f2792c05b80 1 -- 172.21.15.78:0/4035006033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fbfde3d0f0 con 0x55fbfde42c20 2023-08-17T18:10:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f27597fa700 1 -- 172.21.15.78:0/4035006033 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2770050070 con 0x55fbfde42c20 2023-08-17T18:10:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f27597fa700 1 -- 172.21.15.78:0/4035006033 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f277004c810 con 0x55fbfde42c20 2023-08-17T18:10:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f2792c05b80 10 client.9228 fetch_fsmap learned FSMap version 61 2023-08-17T18:10:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f2792c05b80 1 -- 172.21.15.78:0/4035006033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x7f277400f040 con 0x55fbfde42c20 2023-08-17T18:10:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.823+0000 7f27597fa700 1 -- 172.21.15.78:0/4035006033 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2770038020 con 0x55fbfde42c20 2023-08-17T18:10:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.824+0000 7f27597fa700 1 -- 172.21.15.78:0/4035006033 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 61) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f277004c970 con 0x55fbfde42c20 2023-08-17T18:10:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.824+0000 7f2792c05b80 10 client.9228 fetch_fsmap finished waiting for FSMap version 61 2023-08-17T18:10:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.824+0000 7f2792c05b80 10 client.9228 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-17T18:10:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.824+0000 7f2792c05b80 20 client.9228 populate_metadata read hostname 'smithi078' 2023-08-17T18:10:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.824+0000 7f2792c05b80 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:6833/607383,v1:172.21.15.150:6835/607383] conn(0x55fbfde856d0 0x55fbfde6d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.824+0000 7f2792c05b80 4 client.9228 mds_command: new command op to 9090 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T18:10:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.824+0000 7f2792c05b80 1 -- 172.21.15.78:0/4035006033 --> [v2:172.21.15.150:6833/607383,v1:172.21.15.150:6835/607383] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fbfde0cb50 con 0x55fbfde856d0 2023-08-17T18:10:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.824+0000 7f277affd700 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:6833/607383,v1:172.21.15.150:6835/607383] conn(0x55fbfde856d0 0x55fbfde6d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.824+0000 7f277affd700 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:6833/607383,v1:172.21.15.150:6835/607383] conn(0x55fbfde856d0 0x55fbfde6d270 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ee2fad693f88a1ce server_cookie=2530e70ac65dd1fb in_seq=0 out_seq=0 2023-08-17T18:10:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.824+0000 7f27597fa700 10 client.9228 ms_handle_connect on v2:172.21.15.150:6833/607383 2023-08-17T18:10:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f27597fa700 1 -- 172.21.15.78:0/4035006033 <== mds.0 v2:172.21.15.150:6833/607383 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55fbfde0cb50 con 0x55fbfde856d0 2023-08-17T18:10:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f27597fa700 10 client.9228 handle_command_reply: tid=0 2023-08-17T18:10:39.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 client.9228 shutdown 2023-08-17T18:10:39.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 -- 172.21.15.78:0/4035006033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 msgr2=0x55fbfde70e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde70e70 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f2770050720 tx=0x7f277007b040).stop 2023-08-17T18:10:39.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 -- 172.21.15.78:0/4035006033 shutdown_connections 2023-08-17T18:10:39.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:6833/607383,v1:172.21.15.150:6835/607383] conn(0x55fbfde856d0 0x55fbfde6d270 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde8b8c0 0x55fbfde71360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f27597fa700 0 client.9228 ms_handle_reset on v2:172.21.15.150:6833/607383 2023-08-17T18:10:39.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde3e3f0 0x55fbfde82ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 --2- 172.21.15.78:0/4035006033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde70e70 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 -- 172.21.15.78:0/4035006033 >> 172.21.15.78:0/4035006033 conn(0x55fbfdbffe40 msgr2=0x55fbfde40c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:39.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 -- 172.21.15.78:0/4035006033 shutdown_connections 2023-08-17T18:10:39.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 1 -- 172.21.15.78:0/4035006033 wait complete. 2023-08-17T18:10:39.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.825+0000 7f2792c05b80 20 client.9228 trim_cache size 0 max 16384 2023-08-17T18:10:39.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.842+0000 7f2792c05b80 1 Processor -- start 2023-08-17T18:10:39.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.842+0000 7f2792c05b80 1 -- start start 2023-08-17T18:10:39.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.843+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde40b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.843+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde42c20 0x55fbfde96f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.843+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 0x55fbfde97480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.843+0000 7f2792c05b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfde40510 con 0x55fbfde3e3f0 2023-08-17T18:10:39.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.843+0000 7f2792c05b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfde840a0 con 0x55fbfde8b8c0 2023-08-17T18:10:39.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.843+0000 7f2792c05b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbfde41000 con 0x55fbfde42c20 2023-08-17T18:10:39.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.843+0000 7f277affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde40b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.843+0000 7f277affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde40b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51612/0 (socket says 172.21.15.78:51612) 2023-08-17T18:10:39.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.843+0000 7f277affd700 1 -- 172.21.15.78:0/2769798738 learned_addr learned my addr 172.21.15.78:0/2769798738 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:39.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.843+0000 7f277a7fc700 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde42c20 0x55fbfde96f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f277b7fe700 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 0x55fbfde97480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f277affd700 1 -- 172.21.15.78:0/2769798738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde42c20 msgr2=0x55fbfde96f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f277affd700 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde42c20 0x55fbfde96f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f277affd700 1 -- 172.21.15.78:0/2769798738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 msgr2=0x55fbfde97480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f277affd700 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 0x55fbfde97480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f277affd700 1 -- 172.21.15.78:0/2769798738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbfdd8de70 con 0x55fbfde3e3f0 2023-08-17T18:10:39.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f277a7fc700 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde42c20 0x55fbfde96f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:39.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f277b7fe700 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 0x55fbfde97480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:39.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f277affd700 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde40b10 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x55fbfde85db0 tx=0x7f276c014000).ready entity=mon.0 client_cookie=49adc69bb8de4d9f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f2760ff9700 1 -- 172.21.15.78:0/2769798738 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c026070 con 0x55fbfde3e3f0 2023-08-17T18:10:39.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f2760ff9700 1 -- 172.21.15.78:0/2769798738 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c021c80 con 0x55fbfde3e3f0 2023-08-17T18:10:39.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.844+0000 7f2760ff9700 1 -- 172.21.15.78:0/2769798738 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c021df0 con 0x55fbfde3e3f0 2023-08-17T18:10:39.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.845+0000 7f2792c05b80 1 -- 172.21.15.78:0/2769798738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 msgr2=0x55fbfde40b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.845+0000 7f2792c05b80 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde40b10 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x55fbfde85db0 tx=0x7f276c014000).stop 2023-08-17T18:10:39.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.845+0000 7f2792c05b80 1 -- 172.21.15.78:0/2769798738 shutdown_connections 2023-08-17T18:10:39.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.845+0000 7f2792c05b80 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 0x55fbfde97480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.845+0000 7f2792c05b80 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde3e3f0 0x55fbfde40b10 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.845+0000 7f2792c05b80 1 --2- 172.21.15.78:0/2769798738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde42c20 0x55fbfde96f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.845+0000 7f2792c05b80 1 -- 172.21.15.78:0/2769798738 >> 172.21.15.78:0/2769798738 conn(0x55fbfdbffe40 msgr2=0x55fbfde440e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:39.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.845+0000 7f2792c05b80 1 -- 172.21.15.78:0/2769798738 shutdown_connections 2023-08-17T18:10:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.845+0000 7f2792c05b80 1 -- 172.21.15.78:0/2769798738 wait complete. 2023-08-17T18:10:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.846+0000 7f2792c05b80 1 -- start start 2023-08-17T18:10:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.846+0000 7f2792c05b80 1 Processor -- start 2023-08-17T18:10:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde3e3f0 0x55fbfdeed500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde3f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f2792c05b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 0x55fbfde70e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f2792c05b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfde83470 con 0x55fbfde42c20 2023-08-17T18:10:39.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f2792c05b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfde445d0 con 0x55fbfde8b8c0 2023-08-17T18:10:39.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f2792c05b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbfdeedd50 con 0x55fbfde3e3f0 2023-08-17T18:10:39.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f2792c05b80 10 client.0 ll_register_callbacks cb 0x55fbfde02ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T18:10:39.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde3f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde3f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51614/0 (socket says 172.21.15.78:51614) 2023-08-17T18:10:39.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277a7fc700 1 -- 172.21.15.78:0/3286139352 learned_addr learned my addr 172.21.15.78:0/3286139352 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:39.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277affd700 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde3e3f0 0x55fbfdeed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277b7fe700 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 0x55fbfde70e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277a7fc700 1 -- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde3e3f0 msgr2=0x55fbfdeed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277a7fc700 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde3e3f0 0x55fbfdeed500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277a7fc700 1 -- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 msgr2=0x55fbfde70e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277a7fc700 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 0x55fbfde70e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277a7fc700 1 -- 172.21.15.78:0/3286139352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c00fdf0 con 0x55fbfde42c20 2023-08-17T18:10:39.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f277a7fc700 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde3f170 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f277000c010 tx=0x7f2770027000).ready entity=mon.0 client_cookie=90b1b8ef450463b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f27597fa700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T18:10:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f27597fa700 1 -- 172.21.15.78:0/3286139352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770050a20 con 0x55fbfde42c20 2023-08-17T18:10:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.847+0000 7f27597fa700 1 -- 172.21.15.78:0/3286139352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2770039080 con 0x55fbfde42c20 2023-08-17T18:10:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f2792c05b80 1 -- 172.21.15.78:0/3286139352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f277400e6e0 con 0x55fbfde42c20 2023-08-17T18:10:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f27597fa700 1 -- 172.21.15.78:0/3286139352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f277004f980 con 0x55fbfde42c20 2023-08-17T18:10:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f2792c05b80 10 client.9234 fetch_fsmap learned FSMap version 61 2023-08-17T18:10:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f2792c05b80 1 -- 172.21.15.78:0/3286139352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x55fbfdd89480 con 0x55fbfde42c20 2023-08-17T18:10:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f27597fa700 1 -- 172.21.15.78:0/3286139352 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277400e6e0 con 0x55fbfde42c20 2023-08-17T18:10:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f27597fa700 1 -- 172.21.15.78:0/3286139352 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 61) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f277004fae0 con 0x55fbfde42c20 2023-08-17T18:10:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f2792c05b80 10 client.9234 fetch_fsmap finished waiting for FSMap version 61 2023-08-17T18:10:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f2792c05b80 10 client.9234 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-17T18:10:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f2792c05b80 20 client.9234 populate_metadata read hostname 'smithi078' 2023-08-17T18:10:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f2792c05b80 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:6833/607383,v1:172.21.15.150:6835/607383] conn(0x55fbfde71320 0x55fbfdee7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f2792c05b80 4 client.9234 mds_command: new command op to 9090 tid=0[{"prefix": "status"}] 2023-08-17T18:10:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f2792c05b80 1 -- 172.21.15.78:0/3286139352 --> [v2:172.21.15.150:6833/607383,v1:172.21.15.150:6835/607383] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fbfdbfbca0 con 0x55fbfde71320 2023-08-17T18:10:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.848+0000 7f277affd700 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:6833/607383,v1:172.21.15.150:6835/607383] conn(0x55fbfde71320 0x55fbfdee7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f27597fa700 10 client.9234 ms_handle_connect on v2:172.21.15.150:6833/607383 2023-08-17T18:10:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f277affd700 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:6833/607383,v1:172.21.15.150:6835/607383] conn(0x55fbfde71320 0x55fbfdee7080 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b801bc6313e9e78d server_cookie=f302791802b21457 in_seq=0 out_seq=0 2023-08-17T18:10:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f27597fa700 1 -- 172.21.15.78:0/3286139352 <== mds.0 v2:172.21.15.150:6833/607383 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55fbfdbfbca0 con 0x55fbfde71320 2023-08-17T18:10:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f27597fa700 10 client.9234 handle_command_reply: tid=0 2023-08-17T18:10:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 client.9234 shutdown 2023-08-17T18:10:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 -- 172.21.15.78:0/3286139352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 msgr2=0x55fbfde3f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde3f170 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f277000c010 tx=0x7f2770027000).stop 2023-08-17T18:10:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 -- 172.21.15.78:0/3286139352 shutdown_connections 2023-08-17T18:10:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:6833/607383,v1:172.21.15.150:6835/607383] conn(0x55fbfde71320 0x55fbfdee7080 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbfde8b8c0 0x55fbfde70e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbfde3e3f0 0x55fbfdeed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 --2- 172.21.15.78:0/3286139352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbfde42c20 0x55fbfde3f170 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f27597fa700 0 client.9234 ms_handle_reset on v2:172.21.15.150:6833/607383 2023-08-17T18:10:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 -- 172.21.15.78:0/3286139352 >> 172.21.15.78:0/3286139352 conn(0x55fbfdbffe40 msgr2=0x55fbfde698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 -- 172.21.15.78:0/3286139352 shutdown_connections 2023-08-17T18:10:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 1 -- 172.21.15.78:0/3286139352 wait complete. 2023-08-17T18:10:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.849+0000 7f2792c05b80 20 client.9234 trim_cache size 0 max 16384 2023-08-17T18:10:39.859 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:10:39.859 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T18:10:39.859 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T18:10:39.859 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 9090, 2023-08-17T18:10:39.859 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T18:10:39.860 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T18:10:39.860 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T18:10:39.860 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 4.7256887470000004, 2023-08-17T18:10:39.860 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 61, 2023-08-17T18:10:39.860 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 168, 2023-08-17T18:10:39.860 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 168, 2023-08-17T18:10:39.860 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 9.2263940069999997 2023-08-17T18:10:39.861 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:10:39.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.850+0000 7f2781270700 1 -- 172.21.15.78:0/3877071113 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f276805ed90 msgr2=0x7f2768061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.850+0000 7f2781270700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f276805ed90 0x7f2768061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f276c00bb60 tx=0x7f276c008040).stop 2023-08-17T18:10:39.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.850+0000 7f2781270700 1 -- 172.21.15.78:0/3877071113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c069310 msgr2=0x7f277c135d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.850+0000 7f2781270700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c069310 0x7f277c135d10 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f2770009130 tx=0x7f2770017000).stop 2023-08-17T18:10:39.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.854+0000 7f2781270700 1 -- 172.21.15.78:0/3877071113 shutdown_connections 2023-08-17T18:10:39.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.854+0000 7f2781270700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f276805ed90 0x7f2768061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.854+0000 7f2781270700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f277c0c3d10 0x7f277c136200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.854+0000 7f2781270700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f277c066480 0x7f277c0626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.854+0000 7f2781270700 1 --2- 172.21.15.78:0/3877071113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277c069310 0x7f277c135d10 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.854+0000 7f2781270700 1 -- 172.21.15.78:0/3877071113 >> 172.21.15.78:0/3877071113 conn(0x7f277c0c8680 msgr2=0x7f277c14e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:39.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.854+0000 7f2781270700 1 -- 172.21.15.78:0/3877071113 shutdown_connections 2023-08-17T18:10:39.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.854+0000 7f2781270700 1 -- 172.21.15.78:0/3877071113 wait complete. 2023-08-17T18:10:39.872 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T18:10:39.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.980+0000 7f55f145e700 1 Processor -- start 2023-08-17T18:10:39.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.980+0000 7f55f145e700 1 -- start start 2023-08-17T18:10:39.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.981+0000 7f55f145e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55ec0c8290 0x7f55ec0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.981+0000 7f55f145e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f55ec154dc0 0x7f55ec0c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.981+0000 7f55f145e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ec0c1390 con 0x7f55ec0c09f0 2023-08-17T18:10:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.981+0000 7f55f145e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec0c8670 con 0x7f55ec0c8290 2023-08-17T18:10:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.981+0000 7f55f145e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec0c5f50 con 0x7f55ec154dc0 2023-08-17T18:10:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.981+0000 7f55eaffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55ec0c8290 0x7f55ec0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.981+0000 7f55eaffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55ec0c8290 0x7f55ec0c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51626/0 (socket says 172.21.15.78:51626) 2023-08-17T18:10:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.981+0000 7f55eaffd700 1 -- 172.21.15.78:0/3628932923 learned_addr learned my addr 172.21.15.78:0/3628932923 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.981+0000 7f55eb7fe700 1 --2- 172.21.15.78:0/3628932923 >> v2:172.21.15.150:3300/0 conn(0x7f55ec154dc0 0x7f55ec0c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.982+0000 7f55eaffd700 1 -- 172.21.15.78:0/3628932923 >> v2:172.21.15.150:3300/0 conn(0x7f55ec154dc0 msgr2=0x7f55ec0c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.982+0000 7f55eaffd700 1 --2- 172.21.15.78:0/3628932923 >> v2:172.21.15.150:3300/0 conn(0x7f55ec154dc0 0x7f55ec0c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.982+0000 7f55eaffd700 1 -- 172.21.15.78:0/3628932923 >> v1:172.21.15.150:6789/0 conn(0x7f55ec0c09f0 legacy=0x7f55ec1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.982+0000 7f55eaffd700 1 -- 172.21.15.78:0/3628932923 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec1552f0 con 0x7f55ec0c8290 2023-08-17T18:10:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.982+0000 7f55eaffd700 1 --2- 172.21.15.78:0/3628932923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 0x7f55ec0c8f10 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f55ec065dc0 tx=0x7f55dc0090f0).ready entity=mon.0 client_cookie=4fa25637970caad3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.982+0000 7f55e9ffb700 1 -- 172.21.15.78:0/3628932923 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00b520 con 0x7f55ec0c8290 2023-08-17T18:10:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.982+0000 7f55e9ffb700 1 -- 172.21.15.78:0/3628932923 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc00b680 con 0x7f55ec0c8290 2023-08-17T18:10:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.982+0000 7f55e9ffb700 1 -- 172.21.15.78:0/3628932923 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00ba20 con 0x7f55ec0c8290 2023-08-17T18:10:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.983+0000 7f55f145e700 1 -- 172.21.15.78:0/3628932923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 msgr2=0x7f55ec0c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.983+0000 7f55f145e700 1 --2- 172.21.15.78:0/3628932923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 0x7f55ec0c8f10 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f55ec065dc0 tx=0x7f55dc0090f0).stop 2023-08-17T18:10:39.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.983+0000 7f55f145e700 1 -- 172.21.15.78:0/3628932923 shutdown_connections 2023-08-17T18:10:39.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.983+0000 7f55f145e700 1 --2- 172.21.15.78:0/3628932923 >> v2:172.21.15.150:3300/0 conn(0x7f55ec154dc0 0x7f55ec0c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.983+0000 7f55f145e700 1 --2- 172.21.15.78:0/3628932923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 0x7f55ec0c8f10 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.983+0000 7f55f145e700 1 -- 172.21.15.78:0/3628932923 >> 172.21.15.78:0/3628932923 conn(0x7f55ec084df0 msgr2=0x7f55ec094710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:39.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.983+0000 7f55f145e700 1 -- 172.21.15.78:0/3628932923 shutdown_connections 2023-08-17T18:10:39.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.983+0000 7f55f145e700 1 -- 172.21.15.78:0/3628932923 wait complete. 2023-08-17T18:10:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.985+0000 7f55f145e700 1 Processor -- start 2023-08-17T18:10:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.985+0000 7f55f145e700 1 -- start start 2023-08-17T18:10:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55f145e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55ec0c09f0 0x7f55ec0644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55f145e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 0x7f55ec152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55f145e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55ec154dc0 0x7f55ec164a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55f145e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0af0e0 con 0x7f55ec0c8290 2023-08-17T18:10:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55f145e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec064990 con 0x7f55ec0c09f0 2023-08-17T18:10:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55f145e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0af360 con 0x7f55ec154dc0 2023-08-17T18:10:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55ea7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 0x7f55ec152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55ea7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 0x7f55ec152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51628/0 (socket says 172.21.15.78:51628) 2023-08-17T18:10:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55ea7fc700 1 -- 172.21.15.78:0/372586004 learned_addr learned my addr 172.21.15.78:0/372586004 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:39.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55eaffd700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55ec0c09f0 0x7f55ec0644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.986+0000 7f55eb7fe700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55ec154dc0 0x7f55ec164a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55ea7fc700 1 -- 172.21.15.78:0/372586004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55ec154dc0 msgr2=0x7f55ec164a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55ea7fc700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55ec154dc0 0x7f55ec164a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55ea7fc700 1 -- 172.21.15.78:0/372586004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55ec0c09f0 msgr2=0x7f55ec0644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:39.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55ea7fc700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55ec0c09f0 0x7f55ec0644a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:39.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55ea7fc700 1 -- 172.21.15.78:0/372586004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc009370 con 0x7f55ec0c8290 2023-08-17T18:10:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55ea7fc700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 0x7f55ec152230 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f55e000c440 tx=0x7f55e0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55d2ffd700 1 -- 172.21.15.78:0/372586004 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00123f0 con 0x7f55ec0c8290 2023-08-17T18:10:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55d2ffd700 1 -- 172.21.15.78:0/372586004 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e0001e90 con 0x7f55ec0c8290 2023-08-17T18:10:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55f145e700 1 -- 172.21.15.78:0/372586004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec0abe40 con 0x7f55ec0c8290 2023-08-17T18:10:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55d2ffd700 1 -- 172.21.15.78:0/372586004 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0012780 con 0x7f55ec0c8290 2023-08-17T18:10:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.987+0000 7f55f145e700 1 -- 172.21.15.78:0/372586004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec0ab650 con 0x7f55ec0c8290 2023-08-17T18:10:39.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.988+0000 7f55f145e700 1 -- 172.21.15.78:0/372586004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec0af4d0 con 0x7f55ec0c8290 2023-08-17T18:10:39.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.989+0000 7f55d2ffd700 1 -- 172.21.15.78:0/372586004 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f55e0010070 con 0x7f55ec0c8290 2023-08-17T18:10:39.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.989+0000 7f55d2ffd700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f55d805ed90 0x7f55d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:39.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.989+0000 7f55d2ffd700 1 -- 172.21.15.78:0/372586004 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f55e0079260 con 0x7f55ec0c8290 2023-08-17T18:10:39.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.989+0000 7f55eaffd700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f55d805ed90 0x7f55d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:39.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.990+0000 7f55eaffd700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f55d805ed90 0x7f55d8061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f55dc00b2e0 tx=0x7f55dc017000).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:39.996+0000 7f55d2ffd700 1 -- 172.21.15.78:0/372586004 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55e004a820 con 0x7f55ec0c8290 2023-08-17T18:10:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.208+0000 7f55f145e700 1 -- 172.21.15.78:0/372586004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f55ec047350 con 0x7f55ec0c8290 2023-08-17T18:10:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.209+0000 7f55d2ffd700 1 -- 172.21.15.78:0/372586004 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) v1 ==== 53+0+73 (secure 0 0 0) 0x7f55e0020020 con 0x7f55ec0c8290 2023-08-17T18:10:40.210 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T18:10:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.210+0000 7f55f145e700 1 -- 172.21.15.78:0/372586004 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f55d805ed90 msgr2=0x7f55d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f55d805ed90 0x7f55d8061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f55dc00b2e0 tx=0x7f55dc017000).stop 2023-08-17T18:10:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 -- 172.21.15.78:0/372586004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 msgr2=0x7f55ec152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 0x7f55ec152230 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f55e000c440 tx=0x7f55e0007db0).stop 2023-08-17T18:10:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 -- 172.21.15.78:0/372586004 shutdown_connections 2023-08-17T18:10:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f55d805ed90 0x7f55d8061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:40.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55ec154dc0 0x7f55ec164a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55ec0c09f0 0x7f55ec0644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 --2- 172.21.15.78:0/372586004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0c8290 0x7f55ec152230 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 -- 172.21.15.78:0/372586004 >> 172.21.15.78:0/372586004 conn(0x7f55ec084df0 msgr2=0x7f55ec064b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 -- 172.21.15.78:0/372586004 shutdown_connections 2023-08-17T18:10:40.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.211+0000 7f55f145e700 1 -- 172.21.15.78:0/372586004 wait complete. 2023-08-17T18:10:40.222 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T18:10:40.222 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T18:10:40.223 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T18:10:40.223 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T18:10:40.223 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T18:10:40.223 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T18:10:40.224 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T18:10:40.224 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T18:10:40.224 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T18:10:40.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:10:40.225 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T18:10:40.241 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T18:10:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T18:10:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T18:10:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:10:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T18:10:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:10:40.242 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T18:10:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T18:10:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T18:10:40.242 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T18:10:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T18:10:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T18:10:40.242 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T18:10:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T18:10:40.243 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T18:10:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T18:10:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T18:10:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 40039sec preferred_lft 40039sec 2023-08-17T18:10:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T18:10:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:10:40.243 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T18:10:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff 2023-08-17T18:10:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T18:10:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:10:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T18:10:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:10:40.244 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T18:10:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T18:10:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link 2023-08-17T18:10:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:10:40.245 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T18:10:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T18:10:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::54:39ff:fe93:1c36/64 scope link 2023-08-17T18:10:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:10:40.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:10:40.246 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T18:10:40.307 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T18:10:40.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:10:40.309 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T18:10:40.364 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T18:10:40.364 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T18:10:40.364 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T18:10:40.365 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T18:10:40.365 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T18:10:40.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:10:40.365 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T18:10:40.366 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T18:10:40.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T18:10:40.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T18:10:40.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T18:10:40.367 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T18:10:40.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:10:40.469 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T18:10:40.482 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T18:10:40.482 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T18:10:40.482 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T18:10:40.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:10:40.483 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T18:10:40.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:10:40.546 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T18:10:40.601 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T18:10:40.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T18:10:40.681 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T18:10:40.681 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T18:10:40.707 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T18:10:40.707 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T18:10:40.710 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T18:10:40.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:10:40.710 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T18:10:40.775 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-17T18:10:40.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.928+0000 7f29283d4700 1 Processor -- start 2023-08-17T18:10:40.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.928+0000 7f29283d4700 1 -- start start 2023-08-17T18:10:40.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.929+0000 7f29283d4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2920150ea0 0x7f2920151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:40.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.929+0000 7f29283d4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29200691c0 con 0x7f29200c2040 2023-08-17T18:10:40.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.929+0000 7f29283d4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29200688b0 con 0x7f2920069650 2023-08-17T18:10:40.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.929+0000 7f29283d4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29200c2510 con 0x7f2920150ea0 2023-08-17T18:10:40.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.929+0000 7f2926971700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f29200c2040 0x7f29200c2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42240/0 (socket says 172.21.15.78:42240) 2023-08-17T18:10:40.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.929+0000 7f2926971700 1 -- 172.21.15.78:0/2015393569 learned_addr learned my addr 172.21.15.78:0/2015393569 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:10:40.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.929+0000 7f2926170700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2920150ea0 0x7f2920151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:40.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459548549 0 0) 0x7f29200691c0 con 0x7f29200c2040 2023-08-17T18:10:40.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f290c0033f0 con 0x7f29200c2040 2023-08-17T18:10:40.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644201898 0 0) 0x7f29200688b0 con 0x7f2920069650 2023-08-17T18:10:40.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29200691c0 con 0x7f2920069650 2023-08-17T18:10:40.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2002956670 0 0) 0x7f290c0033f0 con 0x7f29200c2040 2023-08-17T18:10:40.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2920150ea0 msgr2=0x7f2920151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:40.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2920150ea0 0x7f2920151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:40.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 >> v1:172.21.15.150:6789/0 conn(0x7f2920069650 legacy=0x7f29200c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:40.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920068b70 con 0x7f29200c2040 2023-08-17T18:10:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f29180017f0 con 0x7f29200c2040 2023-08-17T18:10:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 >> v1:172.21.15.78:6789/0 conn(0x7f29200c2040 legacy=0x7f29200c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f290c003aa0 0x7f290c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2920150ea0 0x7f290c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c004b80 0x7f290c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200c2510 con 0x7f290c003aa0 2023-08-17T18:10:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c00b910 con 0x7f290c004b80 2023-08-17T18:10:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290c00bad0 con 0x7f2920150ea0 2023-08-17T18:10:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f2926170700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f290c003aa0 0x7f290c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f2926971700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c004b80 0x7f290c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f292596f700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2920150ea0 0x7f290c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f2926170700 1 -- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2920150ea0 msgr2=0x7f290c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f2926170700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2920150ea0 0x7f290c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f2926170700 1 -- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c004b80 msgr2=0x7f290c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f2926170700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c004b80 0x7f290c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:40.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f2926170700 1 -- 172.21.15.78:0/2015393569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c0033f0 con 0x7f290c003aa0 2023-08-17T18:10:40.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f2926971700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c004b80 0x7f290c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:40.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.930+0000 7f2926170700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f290c003aa0 0x7f290c003ea0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f2910009260 tx=0x7f2910009060).ready entity=mon.0 client_cookie=3870e3e395400774 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:40.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.931+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910009430 con 0x7f290c003aa0 2023-08-17T18:10:40.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.931+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2910009e70 con 0x7f290c003aa0 2023-08-17T18:10:40.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.931+0000 7f292516e700 1 -- 172.21.15.78:0/2015393569 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000e850 con 0x7f290c003aa0 2023-08-17T18:10:40.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.931+0000 7f29283d4700 1 -- 172.21.15.78:0/2015393569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f290c003aa0 msgr2=0x7f290c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:40.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.931+0000 7f29283d4700 1 --2- 172.21.15.78:0/2015393569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f290c003aa0 0x7f290c003ea0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f2910009260 tx=0x7f2910009060).stop 2023-08-17T18:10:40.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.931+0000 7f2926971700 1 -- 172.21.15.78:0/2015393569 reap_dead start 2023-08-17T18:10:40.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.931+0000 7f29283d4700 1 -- 172.21.15.78:0/2015393569 shutdown_connections 2023-08-17T18:10:40.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.931+0000 7f29283d4700 1 -- 172.21.15.78:0/2015393569 >> 172.21.15.78:0/2015393569 conn(0x7f29200c7330 msgr2=0x7f29200c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:40.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.932+0000 7f29283d4700 1 -- 172.21.15.78:0/2015393569 shutdown_connections 2023-08-17T18:10:40.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.932+0000 7f29283d4700 1 -- 172.21.15.78:0/2015393569 wait complete. 2023-08-17T18:10:40.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.933+0000 7f29283d4700 1 Processor -- start 2023-08-17T18:10:40.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.933+0000 7f29283d4700 1 -- start start 2023-08-17T18:10:40.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29283d4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c003aa0 0x7f2920152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:40.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29283d4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f292014b920 0x7f292014fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:40.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29283d4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f292014bda0 0x7f2920150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:40.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29283d4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2920150660 con 0x7f292014bda0 2023-08-17T18:10:40.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29283d4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29201521d0 con 0x7f290c003aa0 2023-08-17T18:10:40.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29283d4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29201518a0 con 0x7f292014b920 2023-08-17T18:10:40.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926971700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f292014bda0 0x7f2920150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:40.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926971700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f292014bda0 0x7f2920150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51658/0 (socket says 172.21.15.78:51658) 2023-08-17T18:10:40.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926971700 1 -- 172.21.15.78:0/3313207106 learned_addr learned my addr 172.21.15.78:0/3313207106 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:40.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926971700 1 -- 172.21.15.78:0/3313207106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f292014b920 msgr2=0x7f292014fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:40.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926170700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c003aa0 0x7f2920152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:40.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926971700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f292014b920 0x7f292014fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:40.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926971700 1 -- 172.21.15.78:0/3313207106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c003aa0 msgr2=0x7f2920152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:40.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926971700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c003aa0 0x7f2920152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:40.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926971700 1 -- 172.21.15.78:0/3313207106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920151b80 con 0x7f292014bda0 2023-08-17T18:10:40.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926170700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c003aa0 0x7f2920152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:40.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f2926971700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f292014bda0 0x7f2920150170 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f2918001460 tx=0x7f29180016f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:40.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29167fc700 1 -- 172.21.15.78:0/3313207106 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291800e830 con 0x7f292014bda0 2023-08-17T18:10:40.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29167fc700 1 -- 172.21.15.78:0/3313207106 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291800e990 con 0x7f292014bda0 2023-08-17T18:10:40.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29283d4700 1 -- 172.21.15.78:0/3313207106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2920151e60 con 0x7f292014bda0 2023-08-17T18:10:40.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29167fc700 1 -- 172.21.15.78:0/3313207106 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291800ed50 con 0x7f292014bda0 2023-08-17T18:10:40.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.935+0000 7f29283d4700 1 -- 172.21.15.78:0/3313207106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29200be450 con 0x7f292014bda0 2023-08-17T18:10:40.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.936+0000 7f29283d4700 1 -- 172.21.15.78:0/3313207106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2920152340 con 0x7f292014bda0 2023-08-17T18:10:40.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.937+0000 7f29167fc700 1 -- 172.21.15.78:0/3313207106 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2918014640 con 0x7f292014bda0 2023-08-17T18:10:40.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.937+0000 7f29167fc700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f290405ed90 0x7f2904061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:40.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.937+0000 7f29167fc700 1 -- 172.21.15.78:0/3313207106 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2918079ae0 con 0x7f292014bda0 2023-08-17T18:10:40.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.937+0000 7f2926170700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f290405ed90 0x7f2904061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:40.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.938+0000 7f2926170700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f290405ed90 0x7f2904061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2910009820 tx=0x7f291001a000).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:40.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:40.941+0000 7f29167fc700 1 -- 172.21.15.78:0/3313207106 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29180498f0 con 0x7f292014bda0 2023-08-17T18:10:41.056 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-08-17T18:10:41.056+0000 7f77f2eed700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T18:10:41.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.137+0000 7f29283d4700 1 -- 172.21.15.78:0/3313207106 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f292006bcb0 con 0x7f290405ed90 2023-08-17T18:10:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.139+0000 7f29167fc700 1 -- 172.21.15.78:0/3313207106 <== mgr.8919 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f292006bcb0 con 0x7f290405ed90 2023-08-17T18:10:41.140 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T18:10:41.140 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:10:41.140 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephfs" 2023-08-17T18:10:41.140 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:10:41.140 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T18:10:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.140+0000 7f29283d4700 1 -- 172.21.15.78:0/3313207106 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f290405ed90 msgr2=0x7f2904061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.140+0000 7f29283d4700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f290405ed90 0x7f2904061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2910009820 tx=0x7f291001a000).stop 2023-08-17T18:10:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.140+0000 7f29283d4700 1 -- 172.21.15.78:0/3313207106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f292014bda0 msgr2=0x7f2920150170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.140+0000 7f29283d4700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f292014bda0 0x7f2920150170 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f2918001460 tx=0x7f29180016f0).stop 2023-08-17T18:10:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.141+0000 7f29283d4700 1 -- 172.21.15.78:0/3313207106 shutdown_connections 2023-08-17T18:10:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.141+0000 7f29283d4700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f290405ed90 0x7f2904061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.141+0000 7f29283d4700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f292014bda0 0x7f2920150170 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.141+0000 7f29283d4700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c003aa0 0x7f2920152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.141+0000 7f29283d4700 1 --2- 172.21.15.78:0/3313207106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f292014b920 0x7f292014fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.141+0000 7f29283d4700 1 -- 172.21.15.78:0/3313207106 >> 172.21.15.78:0/3313207106 conn(0x7f29200c7330 msgr2=0x7f29200c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.141+0000 7f29283d4700 1 -- 172.21.15.78:0/3313207106 shutdown_connections 2023-08-17T18:10:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.141+0000 7f29283d4700 1 -- 172.21.15.78:0/3313207106 wait complete. 2023-08-17T18:10:41.153 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-17T18:10:41.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.268+0000 7f793926f700 1 Processor -- start 2023-08-17T18:10:41.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.268+0000 7f793926f700 1 -- start start 2023-08-17T18:10:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.269+0000 7f793926f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f793413a490 0x7f7934069c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.269+0000 7f793926f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f793413a870 0x7f79340624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.269+0000 7f793926f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7934062e70 con 0x7f79340629e0 2023-08-17T18:10:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.269+0000 7f793926f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79340c29d0 con 0x7f793413a490 2023-08-17T18:10:41.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.269+0000 7f793926f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79340c89f0 con 0x7f793413a870 2023-08-17T18:10:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.269+0000 7f7932ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f793413a490 0x7f7934069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.269+0000 7f7932ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f793413a490 0x7f7934069c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51668/0 (socket says 172.21.15.78:51668) 2023-08-17T18:10:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.270+0000 7f7932ffd700 1 -- 172.21.15.78:0/3955396600 learned_addr learned my addr 172.21.15.78:0/3955396600 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.270+0000 7f79327fc700 1 --2- 172.21.15.78:0/3955396600 >> v2:172.21.15.150:3300/0 conn(0x7f793413a870 0x7f79340624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.270+0000 7f7932ffd700 1 -- 172.21.15.78:0/3955396600 >> v2:172.21.15.150:3300/0 conn(0x7f793413a870 msgr2=0x7f79340624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.270+0000 7f7932ffd700 1 --2- 172.21.15.78:0/3955396600 >> v2:172.21.15.150:3300/0 conn(0x7f793413a870 0x7f79340624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.270+0000 7f7932ffd700 1 -- 172.21.15.78:0/3955396600 >> v1:172.21.15.150:6789/0 conn(0x7f79340629e0 legacy=0x7f7934157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.270+0000 7f7932ffd700 1 -- 172.21.15.78:0/3955396600 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79340bcf10 con 0x7f793413a490 2023-08-17T18:10:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.270+0000 7f7932ffd700 1 --2- 172.21.15.78:0/3955396600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a490 0x7f7934069c60 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f79340a7260 tx=0x7f791c0090f0).ready entity=mon.0 client_cookie=36412cc388bfb5f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.270+0000 7f7931ffb700 1 -- 172.21.15.78:0/3955396600 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00b5a0 con 0x7f793413a490 2023-08-17T18:10:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.270+0000 7f7931ffb700 1 -- 172.21.15.78:0/3955396600 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00b700 con 0x7f793413a490 2023-08-17T18:10:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.270+0000 7f7931ffb700 1 -- 172.21.15.78:0/3955396600 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00ba80 con 0x7f793413a490 2023-08-17T18:10:41.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.271+0000 7f793926f700 1 -- 172.21.15.78:0/3955396600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a490 msgr2=0x7f7934069c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.271+0000 7f793926f700 1 --2- 172.21.15.78:0/3955396600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a490 0x7f7934069c60 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f79340a7260 tx=0x7f791c0090f0).stop 2023-08-17T18:10:41.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.271+0000 7f793926f700 1 -- 172.21.15.78:0/3955396600 shutdown_connections 2023-08-17T18:10:41.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.271+0000 7f793926f700 1 --2- 172.21.15.78:0/3955396600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a490 0x7f7934069c60 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.271+0000 7f793926f700 1 --2- 172.21.15.78:0/3955396600 >> v2:172.21.15.150:3300/0 conn(0x7f793413a870 0x7f79340624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.271+0000 7f793926f700 1 -- 172.21.15.78:0/3955396600 >> 172.21.15.78:0/3955396600 conn(0x7f79340c7bd0 msgr2=0x7f79340c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:41.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.271+0000 7f793926f700 1 -- 172.21.15.78:0/3955396600 shutdown_connections 2023-08-17T18:10:41.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.271+0000 7f793926f700 1 -- 172.21.15.78:0/3955396600 wait complete. 2023-08-17T18:10:41.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.272+0000 7f793926f700 1 Processor -- start 2023-08-17T18:10:41.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.272+0000 7f793926f700 1 -- start start 2023-08-17T18:10:41.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f793926f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79340629e0 0x7f79340a9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f793926f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793413a490 0x7f7934167d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f793926f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a870 0x7f79340a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f793926f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79340a9700 con 0x7f793413a870 2023-08-17T18:10:41.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f793926f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79340a78b0 con 0x7f79340629e0 2023-08-17T18:10:41.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f793926f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7934168220 con 0x7f793413a490 2023-08-17T18:10:41.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f79337fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a870 0x7f79340a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f7932ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79340629e0 0x7f79340a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f7932ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79340629e0 0x7f79340a9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:60752/0 (socket says 172.21.15.78:60752) 2023-08-17T18:10:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f79337fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a870 0x7f79340a7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51680/0 (socket says 172.21.15.78:51680) 2023-08-17T18:10:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f7932ffd700 1 -- 172.21.15.78:0/3857064763 learned_addr learned my addr 172.21.15.78:0/3857064763 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f79327fc700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793413a490 0x7f7934167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f79337fe700 1 -- 172.21.15.78:0/3857064763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793413a490 msgr2=0x7f7934167d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f79337fe700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793413a490 0x7f7934167d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f79337fe700 1 -- 172.21.15.78:0/3857064763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79340629e0 msgr2=0x7f79340a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f79337fe700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79340629e0 0x7f79340a9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f79337fe700 1 -- 172.21.15.78:0/3857064763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009370 con 0x7f793413a870 2023-08-17T18:10:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f79337fe700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a870 0x7f79340a7d40 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f792c00c810 tx=0x7f792c0024b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f792affd700 1 -- 172.21.15.78:0/3857064763 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00e4a0 con 0x7f793413a870 2023-08-17T18:10:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f792affd700 1 -- 172.21.15.78:0/3857064763 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c00e600 con 0x7f793413a870 2023-08-17T18:10:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f792affd700 1 -- 172.21.15.78:0/3857064763 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00e9c0 con 0x7f793413a870 2023-08-17T18:10:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.273+0000 7f793926f700 1 -- 172.21.15.78:0/3857064763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7934168480 con 0x7f793413a870 2023-08-17T18:10:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.274+0000 7f793926f700 1 -- 172.21.15.78:0/3857064763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7934168a40 con 0x7f793413a870 2023-08-17T18:10:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.274+0000 7f793926f700 1 -- 172.21.15.78:0/3857064763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79340a7a60 con 0x7f793413a870 2023-08-17T18:10:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.275+0000 7f792affd700 1 -- 172.21.15.78:0/3857064763 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f792c010070 con 0x7f793413a870 2023-08-17T18:10:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.275+0000 7f792affd700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f791405ed90 0x7f7914061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.275+0000 7f792affd700 1 -- 172.21.15.78:0/3857064763 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f792c079340 con 0x7f793413a870 2023-08-17T18:10:41.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.275+0000 7f7932ffd700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f791405ed90 0x7f7914061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.276+0000 7f7932ffd700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f791405ed90 0x7f7914061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f791c00b360 tx=0x7f791c015000).ready entity=mgr.8919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:41.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.279+0000 7f792affd700 1 -- 172.21.15.78:0/3857064763 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f792c0478f0 con 0x7f793413a870 2023-08-17T18:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.494+0000 7f793926f700 1 -- 172.21.15.78:0/3857064763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f79340a8650 con 0x7f793413a870 2023-08-17T18:10:41.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.781+0000 7f792affd700 1 -- 172.21.15.78:0/3857064763 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 80) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f792c077130 con 0x7f793413a870 2023-08-17T18:10:41.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.782+0000 7f792affd700 1 -- 172.21.15.78:0/3857064763 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v80) v1 ==== 92+0+0 (secure 0 0 0) 0x7f792c0745d0 con 0x7f793413a870 2023-08-17T18:10:41.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 -- 172.21.15.78:0/3857064763 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f791405ed90 msgr2=0x7f7914061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f791405ed90 0x7f7914061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f791c00b360 tx=0x7f791c015000).stop 2023-08-17T18:10:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 -- 172.21.15.78:0/3857064763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a870 msgr2=0x7f79340a7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a870 0x7f79340a7d40 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f792c00c810 tx=0x7f792c0024b0).stop 2023-08-17T18:10:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 -- 172.21.15.78:0/3857064763 shutdown_connections 2023-08-17T18:10:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f791405ed90 0x7f7914061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f793413a870 0x7f79340a7d40 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79340629e0 0x7f79340a9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 --2- 172.21.15.78:0/3857064763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793413a490 0x7f7934167d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 -- 172.21.15.78:0/3857064763 >> 172.21.15.78:0/3857064763 conn(0x7f79340c7bd0 msgr2=0x7f79340c59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 -- 172.21.15.78:0/3857064763 shutdown_connections 2023-08-17T18:10:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.784+0000 7f793926f700 1 -- 172.21.15.78:0/3857064763 wait complete. 2023-08-17T18:10:41.798 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-17T18:10:41.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.917+0000 7f315b33f700 1 Processor -- start 2023-08-17T18:10:41.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.917+0000 7f315b33f700 1 -- start start 2023-08-17T18:10:41.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f315b33f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31541578f0 0x7f31540be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f315b33f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31540bf0e0 0x7f3154095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f315b33f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31540c3e10 con 0x7f3154096300 2023-08-17T18:10:41.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f315b33f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31540bf5c0 con 0x7f31540bf0e0 2023-08-17T18:10:41.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f315b33f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31540c32d0 con 0x7f31541578f0 2023-08-17T18:10:41.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f31588da700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31540bf0e0 0x7f3154095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f31588da700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31540bf0e0 0x7f3154095e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51694/0 (socket says 172.21.15.78:51694) 2023-08-17T18:10:41.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f31588da700 1 -- 172.21.15.78:0/2590027148 learned_addr learned my addr 172.21.15.78:0/2590027148 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:41.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f31590db700 1 --2- 172.21.15.78:0/2590027148 >> v2:172.21.15.150:3300/0 conn(0x7f31541578f0 0x7f31540be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f31588da700 1 -- 172.21.15.78:0/2590027148 >> v2:172.21.15.150:3300/0 conn(0x7f31541578f0 msgr2=0x7f31540be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:41.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f31588da700 1 --2- 172.21.15.78:0/2590027148 >> v2:172.21.15.150:3300/0 conn(0x7f31541578f0 0x7f31540be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f31588da700 1 -- 172.21.15.78:0/2590027148 >> v1:172.21.15.150:6789/0 conn(0x7f3154096300 legacy=0x7f3154064330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.918+0000 7f31588da700 1 -- 172.21.15.78:0/2590027148 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154096750 con 0x7f31540bf0e0 2023-08-17T18:10:41.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.919+0000 7f31588da700 1 --2- 172.21.15.78:0/2590027148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 0x7f3154095e10 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7f31540605b0 tx=0x7f31440090f0).ready entity=mon.0 client_cookie=bc65c35e0866619c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:41.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.919+0000 7f314bfff700 1 -- 172.21.15.78:0/2590027148 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400b520 con 0x7f31540bf0e0 2023-08-17T18:10:41.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.919+0000 7f314bfff700 1 -- 172.21.15.78:0/2590027148 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314400b680 con 0x7f31540bf0e0 2023-08-17T18:10:41.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.919+0000 7f314bfff700 1 -- 172.21.15.78:0/2590027148 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400ba00 con 0x7f31540bf0e0 2023-08-17T18:10:41.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.920+0000 7f315b33f700 1 -- 172.21.15.78:0/2590027148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 msgr2=0x7f3154095e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.920+0000 7f315b33f700 1 --2- 172.21.15.78:0/2590027148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 0x7f3154095e10 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7f31540605b0 tx=0x7f31440090f0).stop 2023-08-17T18:10:41.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.920+0000 7f315b33f700 1 -- 172.21.15.78:0/2590027148 shutdown_connections 2023-08-17T18:10:41.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.920+0000 7f315b33f700 1 --2- 172.21.15.78:0/2590027148 >> v2:172.21.15.150:3300/0 conn(0x7f31541578f0 0x7f31540be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.920+0000 7f315b33f700 1 --2- 172.21.15.78:0/2590027148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 0x7f3154095e10 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.920+0000 7f315b33f700 1 -- 172.21.15.78:0/2590027148 >> 172.21.15.78:0/2590027148 conn(0x7f3154062f80 msgr2=0x7f31540c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:41.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.920+0000 7f315b33f700 1 -- 172.21.15.78:0/2590027148 shutdown_connections 2023-08-17T18:10:41.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.920+0000 7f315b33f700 1 -- 172.21.15.78:0/2590027148 wait complete. 2023-08-17T18:10:41.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.922+0000 7f315b33f700 1 Processor -- start 2023-08-17T18:10:41.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.922+0000 7f315b33f700 1 -- start start 2023-08-17T18:10:41.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.923+0000 7f315b33f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3154096300 0x7f31540a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.923+0000 7f315b33f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 0x7f31540abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.923+0000 7f315b33f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31541578f0 0x7f31541498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.923+0000 7f315b33f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3154156220 con 0x7f31540bf0e0 2023-08-17T18:10:41.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.923+0000 7f315b33f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540ac170 con 0x7f3154096300 2023-08-17T18:10:41.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.923+0000 7f315b33f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31540a8bb0 con 0x7f31541578f0 2023-08-17T18:10:41.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.923+0000 7f31588da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 0x7f31540abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.923+0000 7f31588da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 0x7f31540abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51696/0 (socket says 172.21.15.78:51696) 2023-08-17T18:10:41.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.923+0000 7f31588da700 1 -- 172.21.15.78:0/171688098 learned_addr learned my addr 172.21.15.78:0/171688098 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:41.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.923+0000 7f31590db700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3154096300 0x7f31540a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31598dc700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31541578f0 0x7f31541498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:41.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31588da700 1 -- 172.21.15.78:0/171688098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31541578f0 msgr2=0x7f31541498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31588da700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31541578f0 0x7f31541498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31588da700 1 -- 172.21.15.78:0/171688098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3154096300 msgr2=0x7f31540a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:41.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31588da700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3154096300 0x7f31540a8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:41.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31588da700 1 -- 172.21.15.78:0/171688098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3144009370 con 0x7f31540bf0e0 2023-08-17T18:10:41.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31590db700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3154096300 0x7f31540a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:10:41.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31588da700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 0x7f31540abc80 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f3144009130 tx=0x7f3144017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:41.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31497fa700 1 -- 172.21.15.78:0/171688098 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144000bc0 con 0x7f31540bf0e0 2023-08-17T18:10:41.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31497fa700 1 -- 172.21.15.78:0/171688098 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314400b7f0 con 0x7f31540bf0e0 2023-08-17T18:10:41.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f31497fa700 1 -- 172.21.15.78:0/171688098 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144000d20 con 0x7f31540bf0e0 2023-08-17T18:10:41.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f315b33f700 1 -- 172.21.15.78:0/171688098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31540a8e90 con 0x7f31540bf0e0 2023-08-17T18:10:41.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.924+0000 7f315b33f700 1 -- 172.21.15.78:0/171688098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31540a9450 con 0x7f31540bf0e0 2023-08-17T18:10:41.929 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:41.925+0000 7f54c096f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:10:41.930 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:41.925+0000 7f6ed3802680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:10:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.925+0000 7f315b33f700 1 -- 172.21.15.78:0/171688098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31540695e0 con 0x7f31540bf0e0 2023-08-17T18:10:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.925+0000 7f31497fa700 1 -- 172.21.15.78:0/171688098 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 80) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f314402c070 con 0x7f31540bf0e0 2023-08-17T18:10:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.926+0000 7f31497fa700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313805ede0 0x7f31380612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.926+0000 7f31590db700 1 -- 172.21.15.78:0/171688098 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313805ede0 msgr2=0x7f31380612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:41.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.926+0000 7f31497fa700 1 -- 172.21.15.78:0/171688098 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f314407b5e0 con 0x7f31540bf0e0 2023-08-17T18:10:41.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.926+0000 7f31590db700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313805ede0 0x7f31380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:41.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:41.930+0000 7f31497fa700 1 -- 172.21.15.78:0/171688098 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f314404cb80 con 0x7f31540bf0e0 2023-08-17T18:10:41.988 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:41.988+0000 7f6ed3802680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:10:41.990 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:41.990+0000 7f54c096f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:10:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.102+0000 7f315b33f700 1 -- 172.21.15.78:0/171688098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f3154046af0 con 0x7f31540bf0e0 2023-08-17T18:10:42.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.106+0000 7f31497fa700 1 -- 172.21.15.78:0/171688098 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f314402a020 con 0x7f31540bf0e0 2023-08-17T18:10:42.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.108+0000 7f315b33f700 1 -- 172.21.15.78:0/171688098 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313805ede0 msgr2=0x7f31380612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:42.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.108+0000 7f315b33f700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313805ede0 0x7f31380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:42.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.108+0000 7f315b33f700 1 -- 172.21.15.78:0/171688098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 msgr2=0x7f31540abc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:42.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.108+0000 7f315b33f700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 0x7f31540abc80 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f3144009130 tx=0x7f3144017000).stop 2023-08-17T18:10:42.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.108+0000 7f315b33f700 1 -- 172.21.15.78:0/171688098 shutdown_connections 2023-08-17T18:10:42.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.108+0000 7f315b33f700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313805ede0 0x7f31380612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:42.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.108+0000 7f315b33f700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31541578f0 0x7f31541498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:42.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.108+0000 7f315b33f700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3154096300 0x7f31540a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:42.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.108+0000 7f315b33f700 1 --2- 172.21.15.78:0/171688098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31540bf0e0 0x7f31540abc80 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:42.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.109+0000 7f315b33f700 1 -- 172.21.15.78:0/171688098 >> 172.21.15.78:0/171688098 conn(0x7f3154062f80 msgr2=0x7f31540a7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:42.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.109+0000 7f315b33f700 1 -- 172.21.15.78:0/171688098 shutdown_connections 2023-08-17T18:10:42.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.109+0000 7f315b33f700 1 -- 172.21.15.78:0/171688098 wait complete. 2023-08-17T18:10:42.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:42.122 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-17T18:10:42.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-17T18:10:42.265 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:42.265+0000 7f6ed3802680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:10:42.277 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:42.276+0000 7f54c096f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:10:42.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.304+0000 7f96f1d98700 1 Processor -- start 2023-08-17T18:10:42.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.304+0000 7f96f1d98700 1 -- start start 2023-08-17T18:10:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96f1d98700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96ec0aa4d0 0x7f96ec0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96f1d98700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96ec0c5810 0x7f96ec0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96f1d98700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec0649b0 con 0x7f96ec0aa0f0 2023-08-17T18:10:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96f1d98700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec0c6150 con 0x7f96ec0c5810 2023-08-17T18:10:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96f1d98700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec063420 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96ebfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96ec0c5810 0x7f96ec0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96ebfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96ec0c5810 0x7f96ec0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51704/0 (socket says 172.21.15.78:51704) 2023-08-17T18:10:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96ebfff700 1 -- 172.21.15.78:0/1611900261 learned_addr learned my addr 172.21.15.78:0/1611900261 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96eaffd700 1 --2- 172.21.15.78:0/1611900261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96ec0aa4d0 0x7f96ec0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96ebfff700 1 -- 172.21.15.78:0/1611900261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96ec0aa4d0 msgr2=0x7f96ec0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:42.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96ebfff700 1 --2- 172.21.15.78:0/1611900261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96ec0aa4d0 0x7f96ec0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:42.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96ebfff700 1 -- 172.21.15.78:0/1611900261 >> v1:172.21.15.150:6789/0 conn(0x7f96ec0aa0f0 legacy=0x7f96ec0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:42.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96ebfff700 1 -- 172.21.15.78:0/1611900261 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec063700 con 0x7f96ec0c5810 2023-08-17T18:10:42.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.305+0000 7f96ebfff700 1 --2- 172.21.15.78:0/1611900261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0c5810 0x7f96ec0c5c60 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f96dc009f20 tx=0x7f96dc009840).ready entity=mon.0 client_cookie=8481fd1c521ad18e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:42.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96ea7fc700 1 -- 172.21.15.78:0/1611900261 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc00e070 con 0x7f96ec0c5810 2023-08-17T18:10:42.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96ea7fc700 1 -- 172.21.15.78:0/1611900261 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc00b9d0 con 0x7f96ec0c5810 2023-08-17T18:10:42.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96ea7fc700 1 -- 172.21.15.78:0/1611900261 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc00bd50 con 0x7f96ec0c5810 2023-08-17T18:10:42.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96f1d98700 1 -- 172.21.15.78:0/1611900261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0c5810 msgr2=0x7f96ec0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:42.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96f1d98700 1 --2- 172.21.15.78:0/1611900261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0c5810 0x7f96ec0c5c60 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f96dc009f20 tx=0x7f96dc009840).stop 2023-08-17T18:10:42.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96f1d98700 1 -- 172.21.15.78:0/1611900261 shutdown_connections 2023-08-17T18:10:42.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96f1d98700 1 --2- 172.21.15.78:0/1611900261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0c5810 0x7f96ec0c5c60 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:42.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96f1d98700 1 --2- 172.21.15.78:0/1611900261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96ec0aa4d0 0x7f96ec0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:42.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96f1d98700 1 -- 172.21.15.78:0/1611900261 >> 172.21.15.78:0/1611900261 conn(0x7f96ec06a6a0 msgr2=0x7f96ec0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:42.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96f1d98700 1 -- 172.21.15.78:0/1611900261 shutdown_connections 2023-08-17T18:10:42.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.306+0000 7f96f1d98700 1 -- 172.21.15.78:0/1611900261 wait complete. 2023-08-17T18:10:42.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.307+0000 7f96f1d98700 1 Processor -- start 2023-08-17T18:10:42.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96f1d98700 1 -- start start 2023-08-17T18:10:42.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96f1d98700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96ec0aa0f0 0x7f96ec151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:42.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96f1d98700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0aa4d0 0x7f96ec0c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:42.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96f1d98700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96ec0c5810 0x7f96ec0ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:42.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96f1d98700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c4570 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96f1d98700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c4ef0 con 0x7f96ec0c5810 2023-08-17T18:10:42.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96f1d98700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c3960 con 0x7f96ec0aa0f0 2023-08-17T18:10:42.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96eaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0aa4d0 0x7f96ec0c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:42.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96eaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0aa4d0 0x7f96ec0c4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51712/0 (socket says 172.21.15.78:51712) 2023-08-17T18:10:42.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96eaffd700 1 -- 172.21.15.78:0/1032271011 learned_addr learned my addr 172.21.15.78:0/1032271011 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:42.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96ebfff700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96ec0c5810 0x7f96ec0ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:42.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.308+0000 7f96eb7fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96ec0aa0f0 0x7f96ec151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:42.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96eaffd700 1 -- 172.21.15.78:0/1032271011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96ec0aa0f0 msgr2=0x7f96ec151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:42.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96eaffd700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96ec0aa0f0 0x7f96ec151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96eaffd700 1 -- 172.21.15.78:0/1032271011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96ec0c5810 msgr2=0x7f96ec0ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96eaffd700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96ec0c5810 0x7f96ec0ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96eaffd700 1 -- 172.21.15.78:0/1032271011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc009ae0 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96eaffd700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0aa4d0 0x7f96ec0c4a00 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f96d400e960 tx=0x7f96d4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4012600 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d4012760 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4012ae0 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96f1d98700 1 -- 172.21.15.78:0/1032271011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec0c3c40 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.309+0000 7f96f1d98700 1 -- 172.21.15.78:0/1032271011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec0c4200 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.310+0000 7f96f1d98700 1 -- 172.21.15.78:0/1032271011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec0c46e0 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.311+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 80) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f96d4022070 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.311+0000 7f96e37fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:42.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.311+0000 7f96eb7fe700 1 -- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 msgr2=0x7f96cc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:42.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.311+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f96d4079e60 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.311+0000 7f96eb7fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:10:42.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.315+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f96d404b400 con 0x7f96ec0aa4d0 2023-08-17T18:10:42.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.512+0000 7f96eb7fe700 1 -- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 msgr2=0x7f96cc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:42.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.512+0000 7f96eb7fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:10:42.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.532+0000 7f96f1d98700 1 -- 172.21.15.78:0/1032271011 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f96ec046af0 con 0x7f96cc05ede0 2023-08-17T18:10:42.883 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:42.883+0000 7f6ed3802680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:10:42.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.913+0000 7f96eb7fe700 1 -- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 msgr2=0x7f96cc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:42.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:42.913+0000 7f96eb7fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T18:10:42.929 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:42.928+0000 7f54c096f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:10:42.955 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:42.955+0000 7f6ed3802680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:10:43.002 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:43.001+0000 7f54c096f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:10:43.144 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:43.144+0000 7f6ed3802680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:10:43.198 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:43.197+0000 7f54c096f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:10:43.567 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:43.567+0000 7f6ed3802680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:10:43.628 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:43.628+0000 7f54c096f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:10:43.671 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:43.671+0000 7f6ed3802680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:10:43.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:43.714+0000 7f96eb7fe700 1 -- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 msgr2=0x7f96cc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:43.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:43.714+0000 7f96eb7fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T18:10:43.735 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:43.734+0000 7f54c096f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:10:43.824 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:43.824+0000 7f6ed3802680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:10:43.893 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:43.892+0000 7f54c096f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:10:43.899 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:43.899+0000 7f6ed3802680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:10:43.967 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:43.966+0000 7f6ed3802680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:10:43.969 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:43.968+0000 7f54c096f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:10:44.038 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:44.037+0000 7f54c096f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:10:44.225 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:44.225+0000 7f6ed3802680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:10:44.303 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:44.302+0000 7f54c096f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:10:44.409 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:44.408+0000 7f6ed3802680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:10:44.495 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:44.494+0000 7f54c096f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:10:45.061 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:45.061+0000 7f6ed3802680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:10:45.130 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:45.130+0000 7f6ed3802680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:10:45.165 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:45.164+0000 7f54c096f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:10:45.207 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:45.207+0000 7f6ed3802680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:10:45.235 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:45.234+0000 7f54c096f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:10:45.313 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:45.312+0000 7f54c096f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:10:45.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:45.315+0000 7f96eb7fe700 1 -- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 msgr2=0x7f96cc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:10:45.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:45.315+0000 7f96eb7fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-17T18:10:45.354 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:45.354+0000 7f6ed3802680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:10:45.426 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:45.426+0000 7f6ed3802680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:10:45.465 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:45.464+0000 7f54c096f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:10:45.539 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:45.538+0000 7f54c096f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:10:45.541 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:45.541+0000 7f6ed3802680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:10:45.650 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:45.650+0000 7f6ed3802680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:10:45.657 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:45.657+0000 7f54c096f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:10:45.769 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:45.769+0000 7f54c096f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:10:45.942 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:45.942+0000 7f6ed3802680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:10:46.014 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:10:46.014+0000 7f6ed3802680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:10:46.068 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.068+0000 7f54c096f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:10:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:46.084+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 81) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f96d4077d60 con 0x7f96ec0aa4d0 2023-08-17T18:10:46.145 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.145+0000 7f54c096f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:10:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:46.164+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mgrmap(e 82) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f96d40780e0 con 0x7f96ec0aa4d0 2023-08-17T18:10:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:46.164+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 msgr2=0x7f96cc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:10:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:46.164+0000 7f96e37fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:10:46.234 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.233+0000 7f543c147700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:46.234 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.233+0000 7f543c147700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:46.235 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.233+0000 7f543c147700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:46.235 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.233+0000 7f543c147700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:46.235 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.233+0000 7f543c147700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:46.235 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.233+0000 7f543f14d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:46.235 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.233+0000 7f543f14d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:46.235 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.233+0000 7f543f14d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:46.235 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.233+0000 7f543f14d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:46.235 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:10:46.233+0000 7f543f14d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:10:47.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.169+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 <== mon.0 v2:172.21.15.78:3300/0 9 ==== mgrmap(e 83) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f96d4046260 con 0x7f96ec0aa4d0 2023-08-17T18:10:47.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.170+0000 7f96e37fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc02f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.170+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f96ec046af0 con 0x7f96cc05ede0 2023-08-17T18:10:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.171+0000 7f96eb7fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc02f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.173+0000 7f96eb7fe700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc02f260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f96e4001120 tx=0x7f96e4007d40).ready entity=mgr.9264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:47.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.185+0000 7f96e37fe700 1 -- 172.21.15.78:0/1032271011 <== mgr.9264 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f96ec046af0 con 0x7f96cc05ede0 2023-08-17T18:10:47.186 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path snap_test_dir1 2023-08-17T18:10:47.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.186+0000 7f96f1d98700 1 -- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 msgr2=0x7f96cc02f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.186+0000 7f96f1d98700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc02f260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f96e4001120 tx=0x7f96e4007d40).stop 2023-08-17T18:10:47.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.186+0000 7f96f1d98700 1 -- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0aa4d0 msgr2=0x7f96ec0c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.186+0000 7f96f1d98700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0aa4d0 0x7f96ec0c4a00 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f96d400e960 tx=0x7f96d4009060).stop 2023-08-17T18:10:47.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.186+0000 7f96f1d98700 1 -- 172.21.15.78:0/1032271011 shutdown_connections 2023-08-17T18:10:47.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.186+0000 7f96f1d98700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96cc05ede0 0x7f96cc02f260 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.186+0000 7f96f1d98700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96ec0c5810 0x7f96ec0ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.186+0000 7f96f1d98700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96ec0aa0f0 0x7f96ec151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.186+0000 7f96f1d98700 1 --2- 172.21.15.78:0/1032271011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ec0aa4d0 0x7f96ec0c4a00 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.187+0000 7f96f1d98700 1 -- 172.21.15.78:0/1032271011 >> 172.21.15.78:0/1032271011 conn(0x7f96ec06a6a0 msgr2=0x7f96ec153860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:47.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.187+0000 7f96f1d98700 1 -- 172.21.15.78:0/1032271011 shutdown_connections 2023-08-17T18:10:47.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.187+0000 7f96f1d98700 1 -- 172.21.15.78:0/1032271011 wait complete. 2023-08-17T18:10:47.199 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-17T18:10:47.200 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-08-17T18:10:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.325+0000 7fd1959aa700 1 Processor -- start 2023-08-17T18:10:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.325+0000 7fd1959aa700 1 -- start start 2023-08-17T18:10:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.325+0000 7fd1959aa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd190151a40 0x7fd1900c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.325+0000 7fd1959aa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd190151e20 0x7fd1900c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.325+0000 7fd1959aa700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1900c6620 con 0x7fd190157be0 2023-08-17T18:10:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.325+0000 7fd1959aa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1900c6900 con 0x7fd190151e20 2023-08-17T18:10:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.325+0000 7fd1959aa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1900c6be0 con 0x7fd190151a40 2023-08-17T18:10:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd190151e20 0x7fd1900c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd190151e20 0x7fd1900c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51834/0 (socket says 172.21.15.78:51834) 2023-08-17T18:10:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18ffff700 1 -- 172.21.15.78:0/1563998687 learned_addr learned my addr 172.21.15.78:0/1563998687 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd1951a9700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd190157be0 0x7fd190154610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42252/0 (socket says 172.21.15.78:42252) 2023-08-17T18:10:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd1949a8700 1 --2- 172.21.15.78:0/1563998687 >> v2:172.21.15.150:3300/0 conn(0x7fd190151a40 0x7fd1900c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18ffff700 1 -- 172.21.15.78:0/1563998687 >> v2:172.21.15.150:3300/0 conn(0x7fd190151a40 msgr2=0x7fd1900c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18ffff700 1 --2- 172.21.15.78:0/1563998687 >> v2:172.21.15.150:3300/0 conn(0x7fd190151a40 0x7fd1900c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18ffff700 1 -- 172.21.15.78:0/1563998687 >> v1:172.21.15.78:6789/0 conn(0x7fd190157be0 legacy=0x7fd190154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18f7fe700 1 -- 172.21.15.78:0/1563998687 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792551580 0 0) 0x7fd1900c6620 con 0x7fd190157be0 2023-08-17T18:10:47.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18ffff700 1 -- 172.21.15.78:0/1563998687 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1900c6ec0 con 0x7fd190151e20 2023-08-17T18:10:47.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd1949a8700 1 --2- 172.21.15.78:0/1563998687 >> v2:172.21.15.150:3300/0 conn(0x7fd190151a40 0x7fd1900c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:47.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18ffff700 1 --2- 172.21.15.78:0/1563998687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190151e20 0x7fd1900c5d60 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7fd190083860 tx=0x7fd17c009060).ready entity=mon.0 client_cookie=4aee9cac4326a12d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:47.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18f7fe700 1 -- 172.21.15.78:0/1563998687 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c005880 con 0x7fd190151e20 2023-08-17T18:10:47.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18f7fe700 1 -- 172.21.15.78:0/1563998687 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c0059e0 con 0x7fd190151e20 2023-08-17T18:10:47.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.326+0000 7fd18f7fe700 1 -- 172.21.15.78:0/1563998687 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c005d60 con 0x7fd190151e20 2023-08-17T18:10:47.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.327+0000 7fd1959aa700 1 -- 172.21.15.78:0/1563998687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190151e20 msgr2=0x7fd1900c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.327+0000 7fd1959aa700 1 --2- 172.21.15.78:0/1563998687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190151e20 0x7fd1900c5d60 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7fd190083860 tx=0x7fd17c009060).stop 2023-08-17T18:10:47.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.327+0000 7fd1959aa700 1 -- 172.21.15.78:0/1563998687 shutdown_connections 2023-08-17T18:10:47.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.327+0000 7fd1959aa700 1 --2- 172.21.15.78:0/1563998687 >> v2:172.21.15.150:3300/0 conn(0x7fd190151a40 0x7fd1900c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.327+0000 7fd1959aa700 1 --2- 172.21.15.78:0/1563998687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190151e20 0x7fd1900c5d60 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.327+0000 7fd1959aa700 1 -- 172.21.15.78:0/1563998687 >> 172.21.15.78:0/1563998687 conn(0x7fd1900943b0 msgr2=0x7fd19006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.327+0000 7fd1959aa700 1 -- 172.21.15.78:0/1563998687 shutdown_connections 2023-08-17T18:10:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.327+0000 7fd1959aa700 1 -- 172.21.15.78:0/1563998687 wait complete. 2023-08-17T18:10:47.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.328+0000 7fd1959aa700 1 Processor -- start 2023-08-17T18:10:47.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.328+0000 7fd1959aa700 1 -- start start 2023-08-17T18:10:47.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1959aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd190151a40 0x7fd190164020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1959aa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd190151e20 0x7fd19014c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1959aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190157be0 0x7fd1900c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1959aa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd190167690 con 0x7fd190157be0 2023-08-17T18:10:47.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1959aa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd190164610 con 0x7fd190151e20 2023-08-17T18:10:47.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1959aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1901648f0 con 0x7fd190151a40 2023-08-17T18:10:47.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1951a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190157be0 0x7fd1900c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1951a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190157be0 0x7fd1900c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51846/0 (socket says 172.21.15.78:51846) 2023-08-17T18:10:47.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1951a9700 1 -- 172.21.15.78:0/2249786771 learned_addr learned my addr 172.21.15.78:0/2249786771 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:47.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd18ffff700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd190151e20 0x7fd19014c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1949a8700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd190151a40 0x7fd190164020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1951a9700 1 -- 172.21.15.78:0/2249786771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd190151a40 msgr2=0x7fd190164020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1951a9700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd190151a40 0x7fd190164020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1951a9700 1 -- 172.21.15.78:0/2249786771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd190151e20 msgr2=0x7fd19014c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1951a9700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd190151e20 0x7fd19014c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1951a9700 1 -- 172.21.15.78:0/2249786771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c009300 con 0x7fd190157be0 2023-08-17T18:10:47.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd18ffff700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd190151e20 0x7fd19014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:47.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1949a8700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd190151a40 0x7fd190164020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:10:47.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.329+0000 7fd1951a9700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190157be0 0x7fd1900c37b0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7fd18800c730 tx=0x7fd188001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:47.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.330+0000 7fd18cff9700 1 -- 172.21.15.78:0/2249786771 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188005c70 con 0x7fd190157be0 2023-08-17T18:10:47.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.330+0000 7fd18cff9700 1 -- 172.21.15.78:0/2249786771 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd188005dd0 con 0x7fd190157be0 2023-08-17T18:10:47.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.330+0000 7fd1959aa700 1 -- 172.21.15.78:0/2249786771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd190164bd0 con 0x7fd190157be0 2023-08-17T18:10:47.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.330+0000 7fd18cff9700 1 -- 172.21.15.78:0/2249786771 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188007340 con 0x7fd190157be0 2023-08-17T18:10:47.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.330+0000 7fd1959aa700 1 -- 172.21.15.78:0/2249786771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19014cd40 con 0x7fd190157be0 2023-08-17T18:10:47.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.331+0000 7fd18cff9700 1 -- 172.21.15.78:0/2249786771 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 83) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fd188010030 con 0x7fd190157be0 2023-08-17T18:10:47.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.331+0000 7fd1959aa700 1 -- 172.21.15.78:0/2249786771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd190082f90 con 0x7fd190157be0 2023-08-17T18:10:47.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.331+0000 7fd18cff9700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd17405ed40 0x7fd174061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.331+0000 7fd18cff9700 1 -- 172.21.15.78:0/2249786771 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd188079a20 con 0x7fd190157be0 2023-08-17T18:10:47.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.331+0000 7fd1949a8700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd17405ed40 0x7fd174061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.332+0000 7fd1949a8700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd17405ed40 0x7fd174061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd184006fd0 tx=0x7fd184008040).ready entity=mgr.9264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:47.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.335+0000 7fd18cff9700 1 -- 172.21.15.78:0/2249786771 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd18804afb0 con 0x7fd190157be0 2023-08-17T18:10:47.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.558+0000 7fd1959aa700 1 -- 172.21.15.78:0/2249786771 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd19005f910 con 0x7fd17405ed40 2023-08-17T18:10:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.563+0000 7fd18cff9700 1 -- 172.21.15.78:0/2249786771 <== mgr.9264 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fd19005f910 con 0x7fd17405ed40 2023-08-17T18:10:47.564 INFO:teuthology.orchestra.run.smithi078.stdout:Retention added to path snap_test_dir1 2023-08-17T18:10:47.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 -- 172.21.15.78:0/2249786771 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd17405ed40 msgr2=0x7fd174061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd17405ed40 0x7fd174061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd184006fd0 tx=0x7fd184008040).stop 2023-08-17T18:10:47.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 -- 172.21.15.78:0/2249786771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190157be0 msgr2=0x7fd1900c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190157be0 0x7fd1900c37b0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7fd18800c730 tx=0x7fd188001520).stop 2023-08-17T18:10:47.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 -- 172.21.15.78:0/2249786771 shutdown_connections 2023-08-17T18:10:47.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd17405ed40 0x7fd174061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd190157be0 0x7fd1900c37b0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd190151a40 0x7fd190164020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 --2- 172.21.15.78:0/2249786771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd190151e20 0x7fd19014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 -- 172.21.15.78:0/2249786771 >> 172.21.15.78:0/2249786771 conn(0x7fd1900943b0 msgr2=0x7fd190150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 -- 172.21.15.78:0/2249786771 shutdown_connections 2023-08-17T18:10:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.565+0000 7fd1959aa700 1 -- 172.21.15.78:0/2249786771 wait complete. 2023-08-17T18:10:47.578 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-08-17T18:10:47.578 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-17-18_11_00 in ~13s... 2023-08-17T18:10:47.579 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-08-17T18:10:47.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-17T18:10:47.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.697+0000 7f96d1048700 1 Processor -- start 2023-08-17T18:10:47.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.697+0000 7f96d1048700 1 -- start start 2023-08-17T18:10:47.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.698+0000 7f96d1048700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96cc0626b0 0x7f96cc0bc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.698+0000 7f96d1048700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96cc14ea10 0x7f96cc157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.698+0000 7f96d1048700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc0649f0 con 0x7f96cc062a90 2023-08-17T18:10:47.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.698+0000 7f96d1048700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc063450 con 0x7f96cc0626b0 2023-08-17T18:10:47.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.698+0000 7f96d1048700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc063730 con 0x7f96cc14ea10 2023-08-17T18:10:47.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.698+0000 7f96cad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96cc0626b0 0x7f96cc0bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.698+0000 7f96cad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96cc0626b0 0x7f96cc0bc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51860/0 (socket says 172.21.15.78:51860) 2023-08-17T18:10:47.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.698+0000 7f96cad9d700 1 -- 172.21.15.78:0/1949047454 learned_addr learned my addr 172.21.15.78:0/1949047454 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:47.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96cb59e700 1 --2- 172.21.15.78:0/1949047454 >> v2:172.21.15.150:3300/0 conn(0x7f96cc14ea10 0x7f96cc157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96cad9d700 1 -- 172.21.15.78:0/1949047454 >> v2:172.21.15.150:3300/0 conn(0x7f96cc14ea10 msgr2=0x7f96cc157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:47.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96cad9d700 1 --2- 172.21.15.78:0/1949047454 >> v2:172.21.15.150:3300/0 conn(0x7f96cc14ea10 0x7f96cc157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96cad9d700 1 -- 172.21.15.78:0/1949047454 >> v1:172.21.15.150:6789/0 conn(0x7f96cc062a90 legacy=0x7f96cc14e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:10:47.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96cad9d700 1 -- 172.21.15.78:0/1949047454 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc063a10 con 0x7f96cc0626b0 2023-08-17T18:10:47.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96cad9d700 1 --2- 172.21.15.78:0/1949047454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 0x7f96cc0bc430 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f96cc155710 tx=0x7f96c0009060).ready entity=mon.0 client_cookie=fd614c89884e5249 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:47.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96c9d9b700 1 -- 172.21.15.78:0/1949047454 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0005880 con 0x7f96cc0626b0 2023-08-17T18:10:47.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96c9d9b700 1 -- 172.21.15.78:0/1949047454 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c00059e0 con 0x7f96cc0626b0 2023-08-17T18:10:47.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96c9d9b700 1 -- 172.21.15.78:0/1949047454 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0005d60 con 0x7f96cc0626b0 2023-08-17T18:10:47.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96d1048700 1 -- 172.21.15.78:0/1949047454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 msgr2=0x7f96cc0bc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96d1048700 1 --2- 172.21.15.78:0/1949047454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 0x7f96cc0bc430 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f96cc155710 tx=0x7f96c0009060).stop 2023-08-17T18:10:47.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96d1048700 1 -- 172.21.15.78:0/1949047454 shutdown_connections 2023-08-17T18:10:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96d1048700 1 --2- 172.21.15.78:0/1949047454 >> v2:172.21.15.150:3300/0 conn(0x7f96cc14ea10 0x7f96cc157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96d1048700 1 --2- 172.21.15.78:0/1949047454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 0x7f96cc0bc430 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96d1048700 1 -- 172.21.15.78:0/1949047454 >> 172.21.15.78:0/1949047454 conn(0x7f96cc0c3db0 msgr2=0x7f96cc0c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96d1048700 1 -- 172.21.15.78:0/1949047454 shutdown_connections 2023-08-17T18:10:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.699+0000 7f96d1048700 1 -- 172.21.15.78:0/1949047454 wait complete. 2023-08-17T18:10:47.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96d1048700 1 Processor -- start 2023-08-17T18:10:47.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96d1048700 1 -- start start 2023-08-17T18:10:47.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96d1048700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 0x7f96cc1654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96d1048700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc062a90 0x7f96cc1685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96d1048700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc14ea10 0x7f96cc14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96d1048700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc168a90 con 0x7f96cc0626b0 2023-08-17T18:10:47.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96d1048700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc1648c0 con 0x7f96cc062a90 2023-08-17T18:10:47.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96d1048700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc164ba0 con 0x7f96cc14ea10 2023-08-17T18:10:47.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96cad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 0x7f96cc1654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96cad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 0x7f96cc1654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51870/0 (socket says 172.21.15.78:51870) 2023-08-17T18:10:47.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.701+0000 7f96cad9d700 1 -- 172.21.15.78:0/351847917 learned_addr learned my addr 172.21.15.78:0/351847917 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:10:47.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96ca59c700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc062a90 0x7f96cc1685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96cb59e700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc14ea10 0x7f96cc14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96cad9d700 1 -- 172.21.15.78:0/351847917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc14ea10 msgr2=0x7f96cc14da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96cad9d700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc14ea10 0x7f96cc14da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96cad9d700 1 -- 172.21.15.78:0/351847917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc062a90 msgr2=0x7f96cc1685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96cad9d700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc062a90 0x7f96cc1685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96cad9d700 1 -- 172.21.15.78:0/351847917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c0009300 con 0x7f96cc0626b0 2023-08-17T18:10:47.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96cb59e700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc14ea10 0x7f96cc14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:47.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96ca59c700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc062a90 0x7f96cc1685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:10:47.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96cad9d700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 0x7f96cc1654d0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f96cc06a020 tx=0x7f96c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:47.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96b2ffd700 1 -- 172.21.15.78:0/351847917 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000b880 con 0x7f96cc0626b0 2023-08-17T18:10:47.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96b2ffd700 1 -- 172.21.15.78:0/351847917 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c000b9e0 con 0x7f96cc0626b0 2023-08-17T18:10:47.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96b2ffd700 1 -- 172.21.15.78:0/351847917 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000bd60 con 0x7f96cc0626b0 2023-08-17T18:10:47.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96d1048700 1 -- 172.21.15.78:0/351847917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc164e80 con 0x7f96cc0626b0 2023-08-17T18:10:47.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.702+0000 7f96d1048700 1 -- 172.21.15.78:0/351847917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc1645c0 con 0x7f96cc0626b0 2023-08-17T18:10:47.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.703+0000 7f96d1048700 1 -- 172.21.15.78:0/351847917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc0ac100 con 0x7f96cc0626b0 2023-08-17T18:10:47.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.703+0000 7f96b2ffd700 1 -- 172.21.15.78:0/351847917 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 83) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f96c000f070 con 0x7f96cc0626b0 2023-08-17T18:10:47.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.704+0000 7f96b2ffd700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96b805ed40 0x7f96b8061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:10:47.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.704+0000 7f96b2ffd700 1 -- 172.21.15.78:0/351847917 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f96c007ae10 con 0x7f96cc0626b0 2023-08-17T18:10:47.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.704+0000 7f96ca59c700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96b805ed40 0x7f96b8061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:10:47.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.704+0000 7f96ca59c700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96b805ed40 0x7f96b8061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f96cc162180 tx=0x7f96bc009040).ready entity=mgr.9264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:10:47.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.708+0000 7f96b2ffd700 1 -- 172.21.15.78:0/351847917 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f96c004c3a0 con 0x7f96cc0626b0 2023-08-17T18:10:47.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.902+0000 7f96d1048700 1 -- 172.21.15.78:0/351847917 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96cc063cf0 con 0x7f96b805ed40 2023-08-17T18:10:47.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.904+0000 7f96b2ffd700 1 -- 172.21.15.78:0/351847917 <== mgr.9264 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f96cc063cf0 con 0x7f96b805ed40 2023-08-17T18:10:47.905 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:10:47.905 INFO:teuthology.orchestra.run.smithi078.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-17T18:10:47.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 -- 172.21.15.78:0/351847917 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96b805ed40 msgr2=0x7f96b8061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96b805ed40 0x7f96b8061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f96cc162180 tx=0x7f96bc009040).stop 2023-08-17T18:10:47.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 -- 172.21.15.78:0/351847917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 msgr2=0x7f96cc1654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:10:47.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 0x7f96cc1654d0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f96cc06a020 tx=0x7f96c0016000).stop 2023-08-17T18:10:47.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 -- 172.21.15.78:0/351847917 shutdown_connections 2023-08-17T18:10:47.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f96b805ed40 0x7f96b8061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc14ea10 0x7f96cc14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96cc0626b0 0x7f96cc1654d0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 --2- 172.21.15.78:0/351847917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc062a90 0x7f96cc1685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:10:47.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 -- 172.21.15.78:0/351847917 >> 172.21.15.78:0/351847917 conn(0x7f96cc0c3db0 msgr2=0x7f96cc1527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:10:47.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 -- 172.21.15.78:0/351847917 shutdown_connections 2023-08-17T18:10:47.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:10:47.906+0000 7f96d1048700 1 -- 172.21.15.78:0/351847917 wait complete. 2023-08-17T18:10:47.918 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-17T18:10:47.919 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-08-17T18:10:47.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:47.919 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:48.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:48.936 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:49.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:49.954 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:50.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:50.970 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:51.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:51.987 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:53.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:53.003 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:54.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:54.020 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:55.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:55.037 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:56.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:56.053 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:57.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:57.069 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:58.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:58.087 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:10:59.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:10:59.103 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:00.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:00.120 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:00.567 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:11:00.566+0000 7f542e92c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:11:00.567 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:11:00.566+0000 7f542e92c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:11:00.567 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:11:00.566+0000 7f542e92c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:11:00.568 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:11:00.566+0000 7f542e92c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:11:00.568 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:11:00.566+0000 7f542e92c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:11:01.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:01.136 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:01.151 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:01.152 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-17-18_11_00_UTC'] 2023-08-17T18:11:01.152 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692295847.578841, now = 1692295861.1527724, timo = 13 2023-08-17T18:11:02.153 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-08-17-18_11_00 in ~73s... 2023-08-17T18:11:02.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:02.154 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:02.169 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:03.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:03.171 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:03.185 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:04.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:04.187 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:04.203 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:05.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:05.206 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:05.224 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:06.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:06.226 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:06.244 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:07.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:07.245 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:07.263 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:07.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:11:07.377 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:11:08.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:08.265 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:08.284 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:09.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:09.286 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:09.304 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:10.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:10.306 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:10.323 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:11.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:11.325 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:11.343 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:12.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:12.346 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:13.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:13.366 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:13.384 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:14.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:14.388 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:14.406 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:15.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:15.408 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:15.426 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:16.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:16.429 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:16.446 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:17.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:17.448 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:17.467 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:18.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:18.469 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:18.486 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:19.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:19.488 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:19.505 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:20.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:20.507 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:20.525 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:21.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:21.527 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:21.545 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:22.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:22.547 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:22.566 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:23.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:23.568 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:23.585 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:24.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:24.587 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:24.605 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:25.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:25.607 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:25.624 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:26.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:26.625 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:26.643 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:27.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:27.646 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:27.664 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:28.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:28.665 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:28.684 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:29.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:29.686 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:29.704 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:30.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:30.706 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:30.723 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:31.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:31.726 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:32.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:32.746 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:32.764 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:33.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:33.766 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:33.784 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:34.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:34.786 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:34.804 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:35.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:35.807 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:35.824 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:36.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:36.826 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:36.844 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:37.444 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:11:37.446 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:11:37.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:37.846 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:37.863 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:38.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:38.865 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:38.882 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:39.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:39.884 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:39.902 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:40.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:40.905 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:40.923 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:41.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:41.925 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:41.943 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:42.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:42.945 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:42.962 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:43.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:43.964 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:43.982 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:44.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:44.985 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:45.003 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:46.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:46.005 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:46.023 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:47.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:47.025 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:47.044 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:48.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:48.047 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:48.065 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:49.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:49.067 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:49.085 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:50.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:50.088 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:50.106 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:51.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:51.108 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:51.126 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:52.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:52.127 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:52.145 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:53.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:53.147 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:53.165 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:54.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:54.168 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:54.185 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:55.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:55.187 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:55.206 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:56.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:56.208 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:56.226 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:57.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:57.228 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:57.246 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:58.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:58.247 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:58.265 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:11:59.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:11:59.267 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:11:59.285 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:12:00.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:12:00.287 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:12:00.305 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_11_00_UTC 2023-08-17T18:12:01.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:12:01.307 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:12:01.324 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_12_00_UTC 2023-08-17T18:12:01.325 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-08-17-18_11_00_UTC'] 2023-08-17T18:12:01.326 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692295847.578841, now = 1692295921.3260415, timo = 73 2023-08-17T18:12:02.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-17T18:12:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.461+0000 7fd9ceef7700 1 Processor -- start 2023-08-17T18:12:02.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.462+0000 7fd9ceef7700 1 -- start start 2023-08-17T18:12:02.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.462+0000 7fd9ceef7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9c80aa4d0 0x7fd9c80644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.462+0000 7fd9ceef7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 0x7fd9c80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.462+0000 7fd9ceef7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c80649b0 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.462+0000 7fd9ceef7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c80c6170 con 0x7fd9c80aa4d0 2023-08-17T18:12:02.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.462+0000 7fd9ceef7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c8063420 con 0x7fd9c80c5810 2023-08-17T18:12:02.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9cd494700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 0x7fd9c80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9bffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9c80aa4d0 0x7fd9c80644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9cd494700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 0x7fd9c80c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:42392/0 (socket says 172.21.15.78:42392) 2023-08-17T18:12:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9bffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9c80aa4d0 0x7fd9c80644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:50012/0 (socket says 172.21.15.78:50012) 2023-08-17T18:12:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9ccc93700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd9c80aa0f0 0x7fd9c80c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:46306/0 (socket says 172.21.15.78:46306) 2023-08-17T18:12:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9cd494700 1 -- 172.21.15.78:0/1614537924 learned_addr learned my addr 172.21.15.78:0/1614537924 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9bffff700 1 -- 172.21.15.78:0/1614537924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 msgr2=0x7fd9c80c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9bffff700 1 --2- 172.21.15.78:0/1614537924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 0x7fd9c80c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9bffff700 1 -- 172.21.15.78:0/1614537924 >> v1:172.21.15.150:6789/0 conn(0x7fd9c80aa0f0 legacy=0x7fd9c80c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9bffff700 1 -- 172.21.15.78:0/1614537924 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c8063700 con 0x7fd9c80aa4d0 2023-08-17T18:12:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9bf7fe700 1 -- 172.21.15.78:0/1614537924 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999609432 0 0) 0x7fd9c80649b0 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9cd494700 1 --2- 172.21.15.78:0/1614537924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 0x7fd9c80c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.463+0000 7fd9bffff700 1 --2- 172.21.15.78:0/1614537924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9c80aa4d0 0x7fd9c80644c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fd9b8009760 tx=0x7fd9b8009060).ready entity=mon.1 client_cookie=80d65c81ef4f51a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9bf7fe700 1 -- 172.21.15.78:0/1614537924 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800f510 con 0x7fd9c80aa4d0 2023-08-17T18:12:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9bf7fe700 1 -- 172.21.15.78:0/1614537924 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b800f670 con 0x7fd9c80aa4d0 2023-08-17T18:12:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9bf7fe700 1 -- 172.21.15.78:0/1614537924 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800f9f0 con 0x7fd9c80aa4d0 2023-08-17T18:12:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9ceef7700 1 -- 172.21.15.78:0/1614537924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9c80aa4d0 msgr2=0x7fd9c80644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9ceef7700 1 --2- 172.21.15.78:0/1614537924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9c80aa4d0 0x7fd9c80644c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fd9b8009760 tx=0x7fd9b8009060).stop 2023-08-17T18:12:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9ceef7700 1 -- 172.21.15.78:0/1614537924 shutdown_connections 2023-08-17T18:12:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9ceef7700 1 --2- 172.21.15.78:0/1614537924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 0x7fd9c80c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9ceef7700 1 --2- 172.21.15.78:0/1614537924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9c80aa4d0 0x7fd9c80644c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9ceef7700 1 -- 172.21.15.78:0/1614537924 >> 172.21.15.78:0/1614537924 conn(0x7fd9c806a6a0 msgr2=0x7fd9c80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9ceef7700 1 -- 172.21.15.78:0/1614537924 shutdown_connections 2023-08-17T18:12:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.464+0000 7fd9ceef7700 1 -- 172.21.15.78:0/1614537924 wait complete. 2023-08-17T18:12:02.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.465+0000 7fd9ceef7700 1 Processor -- start 2023-08-17T18:12:02.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.466+0000 7fd9ceef7700 1 -- start start 2023-08-17T18:12:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.466+0000 7fd9ceef7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9c80aa0f0 0x7fd9c814bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.466+0000 7fd9ceef7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9c80aa4d0 0x7fd9c814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.466+0000 7fd9ceef7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 0x7fd9c814ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.466+0000 7fd9ceef7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c814c240 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.466+0000 7fd9ceef7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80ab8a0 con 0x7fd9c80aa4d0 2023-08-17T18:12:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.466+0000 7fd9ceef7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80aa9b0 con 0x7fd9c80c5810 2023-08-17T18:12:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.466+0000 7fd9ccc93700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9c80aa0f0 0x7fd9c814bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.466+0000 7fd9ccc93700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9c80aa0f0 0x7fd9c814bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59932/0 (socket says 172.21.15.78:59932) 2023-08-17T18:12:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.466+0000 7fd9ccc93700 1 -- 172.21.15.78:0/987138478 learned_addr learned my addr 172.21.15.78:0/987138478 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9bffff700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9c80aa4d0 0x7fd9c814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9cd494700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 0x7fd9c814ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9ccc93700 1 -- 172.21.15.78:0/987138478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 msgr2=0x7fd9c814ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9ccc93700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 0x7fd9c814ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9ccc93700 1 -- 172.21.15.78:0/987138478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9c80aa4d0 msgr2=0x7fd9c814e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9ccc93700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9c80aa4d0 0x7fd9c814e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9ccc93700 1 -- 172.21.15.78:0/987138478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c0009ae0 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9ccc93700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9c80aa0f0 0x7fd9c814bd50 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fd9c400c440 tx=0x7fd9c4007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9bcff9700 1 -- 172.21.15.78:0/987138478 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40070d0 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9bcff9700 1 -- 172.21.15.78:0/987138478 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c4007230 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9ceef7700 1 -- 172.21.15.78:0/987138478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b80092a0 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9bcff9700 1 -- 172.21.15.78:0/987138478 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40056e0 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.467+0000 7fd9ceef7700 1 -- 172.21.15.78:0/987138478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c80aaf70 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.468+0000 7fd9ceef7700 1 -- 172.21.15.78:0/987138478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c8083980 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.469+0000 7fd9bcff9700 1 -- 172.21.15.78:0/987138478 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 85) v1 ==== 75419+0+0 (secure 0 0 0) 0x7fd9c4010070 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.469+0000 7fd9bcff9700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd9b405ef00 0x7fd9b40613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.469+0000 7fd9bcff9700 1 -- 172.21.15.78:0/987138478 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fd9c40792d0 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.469+0000 7fd9bffff700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd9b405ef00 0x7fd9b40613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.469+0000 7fd9bffff700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd9b405ef00 0x7fd9b40613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd9b8009760 tx=0x7fd9b8017000).ready entity=mgr.9264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.473+0000 7fd9bcff9700 1 -- 172.21.15.78:0/987138478 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd9c404a6f0 con 0x7fd9c80aa0f0 2023-08-17T18:12:02.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.662+0000 7fd9ceef7700 1 -- 172.21.15.78:0/987138478 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9c80cbd40 con 0x7fd9b405ef00 2023-08-17T18:12:02.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.666+0000 7fd9bcff9700 1 -- 172.21.15.78:0/987138478 <== mgr.9264 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd9c80cbd40 con 0x7fd9b405ef00 2023-08-17T18:12:02.667 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path snap_test_dir1 2023-08-17T18:12:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 -- 172.21.15.78:0/987138478 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd9b405ef00 msgr2=0x7fd9b40613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd9b405ef00 0x7fd9b40613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd9b8009760 tx=0x7fd9b8017000).stop 2023-08-17T18:12:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 -- 172.21.15.78:0/987138478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9c80aa0f0 msgr2=0x7fd9c814bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9c80aa0f0 0x7fd9c814bd50 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fd9c400c440 tx=0x7fd9c4007e30).stop 2023-08-17T18:12:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 -- 172.21.15.78:0/987138478 shutdown_connections 2023-08-17T18:12:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd9b405ef00 0x7fd9b40613c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9c80c5810 0x7fd9c814ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9c80aa0f0 0x7fd9c814bd50 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 --2- 172.21.15.78:0/987138478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9c80aa4d0 0x7fd9c814e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 -- 172.21.15.78:0/987138478 >> 172.21.15.78:0/987138478 conn(0x7fd9c806a6a0 msgr2=0x7fd9c81529d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:02.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 -- 172.21.15.78:0/987138478 shutdown_connections 2023-08-17T18:12:02.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.668+0000 7fd9ceef7700 1 -- 172.21.15.78:0/987138478 wait complete. 2023-08-17T18:12:02.681 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-17T18:12:02.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:12:02.681 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:12:02.696 INFO:teuthology.orchestra.run.smithi078.stdout:scheduled-2023-08-17-18_12_00_UTC 2023-08-17T18:12:02.697 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-17-18_12_00_UTC 2023-08-17T18:12:02.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:12:02.698 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-17-18_12_00_UTC) 2023-08-17T18:12:02.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:12:02.757 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-17T18:12:02.814 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-17T18:12:02.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.966+0000 7fee4e821700 1 Processor -- start 2023-08-17T18:12:02.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.967+0000 7fee4e821700 1 -- start start 2023-08-17T18:12:02.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.967+0000 7fee4e821700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fee48151a40 0x7fee480c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4e821700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee480c6620 con 0x7fee48151e20 2023-08-17T18:12:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4e821700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee480c6900 con 0x7fee48157be0 2023-08-17T18:12:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4e821700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee480c6be0 con 0x7fee48151a40 2023-08-17T18:12:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4d01e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fee48151e20 0x7fee480c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38936/0 (socket says 172.21.15.78:38936) 2023-08-17T18:12:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4d01e700 1 -- 172.21.15.78:0/3365413975 learned_addr learned my addr 172.21.15.78:0/3365413975 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051788743 0 0) 0x7fee480c6620 con 0x7fee48151e20 2023-08-17T18:12:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee340033f0 con 0x7fee48151e20 2023-08-17T18:12:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4d81f700 1 --2- 172.21.15.78:0/3365413975 >> v2:172.21.15.150:3300/0 conn(0x7fee48151a40 0x7fee480c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1227536359 0 0) 0x7fee340033f0 con 0x7fee48151e20 2023-08-17T18:12:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 >> v2:172.21.15.150:3300/0 conn(0x7fee48151a40 msgr2=0x7fee480c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 --2- 172.21.15.78:0/3365413975 >> v2:172.21.15.150:3300/0 conn(0x7fee48151a40 0x7fee480c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 >> v1:172.21.15.150:6789/0 conn(0x7fee48157be0 legacy=0x7fee480c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee480c6ec0 con 0x7fee48151e20 2023-08-17T18:12:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fee380015f0 con 0x7fee48151e20 2023-08-17T18:12:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 >> v1:172.21.15.78:6789/0 conn(0x7fee48151e20 legacy=0x7fee480c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee340038e0 0x7fee34003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee34004690 0x7fee34004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee34005000 0x7fee3400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee480c6be0 con 0x7fee34004690 2023-08-17T18:12:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3400beb0 con 0x7fee340038e0 2023-08-17T18:12:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3400c070 con 0x7fee34005000 2023-08-17T18:12:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.968+0000 7fee4d01e700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee34004690 0x7fee34004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4d81f700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee340038e0 0x7fee34003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4e020700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee34005000 0x7fee3400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4d01e700 1 -- 172.21.15.78:0/3365413975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee34005000 msgr2=0x7fee3400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4d01e700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee34005000 0x7fee3400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4d01e700 1 -- 172.21.15.78:0/3365413975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee340038e0 msgr2=0x7fee34003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4d01e700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee340038e0 0x7fee34003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4d01e700 1 -- 172.21.15.78:0/3365413975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee340033f0 con 0x7fee34004690 2023-08-17T18:12:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4e020700 1 -- 172.21.15.78:0/3365413975 reap_dead start 2023-08-17T18:12:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4d01e700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee34004690 0x7fee34004b10 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7fee3800c160 tx=0x7fee380077a0).ready entity=mon.0 client_cookie=c60e5c8799837150 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380079d0 con 0x7fee34004690 2023-08-17T18:12:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3800ca90 con 0x7fee34004690 2023-08-17T18:12:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4c81d700 1 -- 172.21.15.78:0/3365413975 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3800ce10 con 0x7fee34004690 2023-08-17T18:12:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4e821700 1 -- 172.21.15.78:0/3365413975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee34004690 msgr2=0x7fee34004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.969+0000 7fee4e821700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee34004690 0x7fee34004b10 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7fee3800c160 tx=0x7fee380077a0).stop 2023-08-17T18:12:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.970+0000 7fee4e821700 1 -- 172.21.15.78:0/3365413975 shutdown_connections 2023-08-17T18:12:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.970+0000 7fee4e821700 1 --2- 172.21.15.78:0/3365413975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee34004690 0x7fee34004b10 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.970+0000 7fee4e821700 1 -- 172.21.15.78:0/3365413975 >> 172.21.15.78:0/3365413975 conn(0x7fee480943b0 msgr2=0x7fee4806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.970+0000 7fee4e821700 1 -- 172.21.15.78:0/3365413975 shutdown_connections 2023-08-17T18:12:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.970+0000 7fee4e821700 1 -- 172.21.15.78:0/3365413975 wait complete. 2023-08-17T18:12:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.971+0000 7fee4e821700 1 Processor -- start 2023-08-17T18:12:02.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.971+0000 7fee4e821700 1 -- start start 2023-08-17T18:12:02.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4e821700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee34004690 0x7fee4814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4e821700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee480b03c0 0x7fee480b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4e821700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee480ac0a0 0x7fee480ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4e821700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee480ae2d0 con 0x7fee480b03c0 2023-08-17T18:12:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4e821700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee480b0d30 con 0x7fee480ac0a0 2023-08-17T18:12:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4e821700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee480acdf0 con 0x7fee34004690 2023-08-17T18:12:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4d01e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee480b03c0 0x7fee480b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4d01e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee480b03c0 0x7fee480b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59954/0 (socket says 172.21.15.78:59954) 2023-08-17T18:12:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4d01e700 1 -- 172.21.15.78:0/1883603461 learned_addr learned my addr 172.21.15.78:0/1883603461 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4d81f700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee34004690 0x7fee4814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4e020700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee480ac0a0 0x7fee480ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4d01e700 1 -- 172.21.15.78:0/1883603461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee34004690 msgr2=0x7fee4814ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4d01e700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee34004690 0x7fee4814ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4d01e700 1 -- 172.21.15.78:0/1883603461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee480ac0a0 msgr2=0x7fee480ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4d01e700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee480ac0a0 0x7fee480ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4d01e700 1 -- 172.21.15.78:0/1883603461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee480ad0d0 con 0x7fee480b03c0 2023-08-17T18:12:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4d01e700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee480b03c0 0x7fee480b0840 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7fee38001ac0 tx=0x7fee38015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee3dffb700 1 -- 172.21.15.78:0/1883603461 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3800cee0 con 0x7fee480b03c0 2023-08-17T18:12:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee3dffb700 1 -- 172.21.15.78:0/1883603461 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38005670 con 0x7fee480b03c0 2023-08-17T18:12:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4e821700 1 -- 172.21.15.78:0/1883603461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee480ad3b0 con 0x7fee480b03c0 2023-08-17T18:12:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee3dffb700 1 -- 172.21.15.78:0/1883603461 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380059f0 con 0x7fee480b03c0 2023-08-17T18:12:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.972+0000 7fee4e821700 1 -- 172.21.15.78:0/1883603461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4814b2f0 con 0x7fee480b03c0 2023-08-17T18:12:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.973+0000 7fee4e821700 1 -- 172.21.15.78:0/1883603461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee480ae480 con 0x7fee480b03c0 2023-08-17T18:12:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.974+0000 7fee3dffb700 1 -- 172.21.15.78:0/1883603461 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 85) v1 ==== 75419+0+0 (secure 0 0 0) 0x7fee38027070 con 0x7fee480b03c0 2023-08-17T18:12:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.974+0000 7fee3dffb700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fee2c05ef30 0x7fee2c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.974+0000 7fee3dffb700 1 -- 172.21.15.78:0/1883603461 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fee3807a630 con 0x7fee480b03c0 2023-08-17T18:12:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.974+0000 7fee4d81f700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fee2c05ef30 0x7fee2c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.974+0000 7fee4d81f700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fee2c05ef30 0x7fee2c0613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fee4805db00 tx=0x7fee44006f40).ready entity=mgr.9264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:02.978+0000 7fee3dffb700 1 -- 172.21.15.78:0/1883603461 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fee480ae480 con 0x7fee480b03c0 2023-08-17T18:12:03.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.190+0000 7fee4e821700 1 -- 172.21.15.78:0/1883603461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fee480ae480 con 0x7fee480b03c0 2023-08-17T18:12:03.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.693+0000 7fee3dffb700 1 -- 172.21.15.78:0/1883603461 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fee38010070 con 0x7fee480b03c0 2023-08-17T18:12:03.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.694+0000 7fee3dffb700 1 -- 172.21.15.78:0/1883603461 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v86) v1 ==== 93+0+0 (secure 0 0 0) 0x7fee38054de0 con 0x7fee480b03c0 2023-08-17T18:12:03.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.696+0000 7fee4e821700 1 -- 172.21.15.78:0/1883603461 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fee2c05ef30 msgr2=0x7fee2c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:03.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.696+0000 7fee4e821700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fee2c05ef30 0x7fee2c0613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fee4805db00 tx=0x7fee44006f40).stop 2023-08-17T18:12:03.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.696+0000 7fee4e821700 1 -- 172.21.15.78:0/1883603461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee480b03c0 msgr2=0x7fee480b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:03.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.696+0000 7fee4e821700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee480b03c0 0x7fee480b0840 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7fee38001ac0 tx=0x7fee38015000).stop 2023-08-17T18:12:03.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.696+0000 7fee4e821700 1 -- 172.21.15.78:0/1883603461 shutdown_connections 2023-08-17T18:12:03.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.696+0000 7fee4e821700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fee2c05ef30 0x7fee2c0613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:03.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.696+0000 7fee4e821700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee480ac0a0 0x7fee480ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:03.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.696+0000 7fee4e821700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee34004690 0x7fee4814ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:03.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.696+0000 7fee4e821700 1 --2- 172.21.15.78:0/1883603461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee480b03c0 0x7fee480b0840 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:03.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.697+0000 7fee4e821700 1 -- 172.21.15.78:0/1883603461 >> 172.21.15.78:0/1883603461 conn(0x7fee480943b0 msgr2=0x7fee480bfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:03.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.697+0000 7fee4e821700 1 -- 172.21.15.78:0/1883603461 shutdown_connections 2023-08-17T18:12:03.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:03.697+0000 7fee4e821700 1 -- 172.21.15.78:0/1883603461 wait complete. 2023-08-17T18:12:03.710 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T18:12:03.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T18:12:03.749 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T18:12:03.790 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T18:12:03.791 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T18:12:03.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:12:03.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T18:12:03.830 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T18:12:03.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:03.831 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T18:12:03.840 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:03.839+0000 7f6ca17a0680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:12:03.844 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:03.844+0000 7f605145d680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:12:03.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:03.906 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:03.905+0000 7f6ca17a0680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:12:03.906 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:03.906+0000 7f605145d680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.009+0000 7f84cf9f3700 1 Processor -- start 2023-08-17T18:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.009+0000 7f84cf9f3700 1 -- start start 2023-08-17T18:12:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.010+0000 7f84cf9f3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84c80c2110 0x7f84c81516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.010+0000 7f84cf9f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c80c4ee0 0x7f84c80c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.010+0000 7f84cf9f3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c8151be0 con 0x7f84c80650a0 2023-08-17T18:12:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.010+0000 7f84cf9f3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c80699f0 con 0x7f84c80c2110 2023-08-17T18:12:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.010+0000 7f84cf9f3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8068950 con 0x7f84c80c4ee0 2023-08-17T18:12:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.010+0000 7f84ccf8e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84c80c2110 0x7f84c81516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.010+0000 7f84ccf8e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84c80c2110 0x7f84c81516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59988/0 (socket says 172.21.15.78:59988) 2023-08-17T18:12:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.010+0000 7f84ccf8e700 1 -- 172.21.15.78:0/1717101200 learned_addr learned my addr 172.21.15.78:0/1717101200 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.010+0000 7f84cd78f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f84c80650a0 0x7f84c80c1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38952/0 (socket says 172.21.15.78:38952) 2023-08-17T18:12:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.011+0000 7f84cdf90700 1 --2- 172.21.15.78:0/1717101200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c80c4ee0 0x7f84c80c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.011+0000 7f84ccf8e700 1 -- 172.21.15.78:0/1717101200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c80c4ee0 msgr2=0x7f84c80c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:04.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.011+0000 7f84ccf8e700 1 --2- 172.21.15.78:0/1717101200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c80c4ee0 0x7f84c80c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.011+0000 7f84ccf8e700 1 -- 172.21.15.78:0/1717101200 >> v1:172.21.15.78:6789/0 conn(0x7f84c80650a0 legacy=0x7f84c80c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.011+0000 7f84bffff700 1 -- 172.21.15.78:0/1717101200 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351987080 0 0) 0x7f84c8151be0 con 0x7f84c80650a0 2023-08-17T18:12:04.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.011+0000 7f84ccf8e700 1 -- 172.21.15.78:0/1717101200 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c8068c30 con 0x7f84c80c2110 2023-08-17T18:12:04.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.011+0000 7f84ccf8e700 1 --2- 172.21.15.78:0/1717101200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80c2110 0x7f84c81516f0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f84c4006fd0 tx=0x7f84c400b3b0).ready entity=mon.0 client_cookie=35e6b98ea5a64947 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:04.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.011+0000 7f84bffff700 1 -- 172.21.15.78:0/1717101200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c400da70 con 0x7f84c80c2110 2023-08-17T18:12:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.011+0000 7f84bffff700 1 -- 172.21.15.78:0/1717101200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c400dbd0 con 0x7f84c80c2110 2023-08-17T18:12:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.011+0000 7f84bffff700 1 -- 172.21.15.78:0/1717101200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4010470 con 0x7f84c80c2110 2023-08-17T18:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.012+0000 7f84cf9f3700 1 -- 172.21.15.78:0/1717101200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80c2110 msgr2=0x7f84c81516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.012+0000 7f84cf9f3700 1 --2- 172.21.15.78:0/1717101200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80c2110 0x7f84c81516f0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f84c4006fd0 tx=0x7f84c400b3b0).stop 2023-08-17T18:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.012+0000 7f84cf9f3700 1 -- 172.21.15.78:0/1717101200 shutdown_connections 2023-08-17T18:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.012+0000 7f84cf9f3700 1 --2- 172.21.15.78:0/1717101200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c80c4ee0 0x7f84c80c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.012+0000 7f84cf9f3700 1 --2- 172.21.15.78:0/1717101200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80c2110 0x7f84c81516f0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.012+0000 7f84cf9f3700 1 -- 172.21.15.78:0/1717101200 >> 172.21.15.78:0/1717101200 conn(0x7f84c8062fc0 msgr2=0x7f84c80c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.012+0000 7f84cf9f3700 1 -- 172.21.15.78:0/1717101200 shutdown_connections 2023-08-17T18:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.012+0000 7f84cf9f3700 1 -- 172.21.15.78:0/1717101200 wait complete. 2023-08-17T18:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.013+0000 7f84cf9f3700 1 Processor -- start 2023-08-17T18:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.013+0000 7f84cf9f3700 1 -- start start 2023-08-17T18:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cf9f3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80650a0 0x7f84c80aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cf9f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84c80c2110 0x7f84c8163380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cf9f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c80c4ee0 0x7f84c8135d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cf9f3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80bf580 con 0x7f84c80650a0 2023-08-17T18:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cf9f3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8163870 con 0x7f84c80c2110 2023-08-17T18:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cf9f3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80ab630 con 0x7f84c80c4ee0 2023-08-17T18:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cd78f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80650a0 0x7f84c80aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cd78f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80650a0 0x7f84c80aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59996/0 (socket says 172.21.15.78:59996) 2023-08-17T18:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cd78f700 1 -- 172.21.15.78:0/3187976504 learned_addr learned my addr 172.21.15.78:0/3187976504 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cdf90700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c80c4ee0 0x7f84c8135d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84ccf8e700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84c80c2110 0x7f84c8163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cd78f700 1 -- 172.21.15.78:0/3187976504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c80c4ee0 msgr2=0x7f84c8135d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cd78f700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c80c4ee0 0x7f84c8135d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cd78f700 1 -- 172.21.15.78:0/3187976504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84c80c2110 msgr2=0x7f84c8163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cd78f700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84c80c2110 0x7f84c8163380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cd78f700 1 -- 172.21.15.78:0/3187976504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c400b610 con 0x7f84c80650a0 2023-08-17T18:12:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.014+0000 7f84cd78f700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80650a0 0x7f84c80aa470 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f84b800c470 tx=0x7f84b8007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.015+0000 7f84bd7fa700 1 -- 172.21.15.78:0/3187976504 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b80070d0 con 0x7f84c80650a0 2023-08-17T18:12:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.015+0000 7f84bd7fa700 1 -- 172.21.15.78:0/3187976504 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b8007250 con 0x7f84c80650a0 2023-08-17T18:12:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.015+0000 7f84cf9f3700 1 -- 172.21.15.78:0/3187976504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c8163af0 con 0x7f84c80650a0 2023-08-17T18:12:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.015+0000 7f84bd7fa700 1 -- 172.21.15.78:0/3187976504 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b80056e0 con 0x7f84c80650a0 2023-08-17T18:12:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.015+0000 7f84cf9f3700 1 -- 172.21.15.78:0/3187976504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c81640b0 con 0x7f84c80650a0 2023-08-17T18:12:04.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.016+0000 7f84cf9f3700 1 -- 172.21.15.78:0/3187976504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c80bf350 con 0x7f84c80650a0 2023-08-17T18:12:04.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.016+0000 7f84bd7fa700 1 -- 172.21.15.78:0/3187976504 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f84b8010070 con 0x7f84c80650a0 2023-08-17T18:12:04.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.017+0000 7f84bd7fa700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84ac05ee80 0x7f84ac061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.017+0000 7f84ccf8e700 1 -- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84ac05ee80 msgr2=0x7f84ac061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.017+0000 7f84bd7fa700 1 -- 172.21.15.78:0/3187976504 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f84b8079320 con 0x7f84c80650a0 2023-08-17T18:12:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.017+0000 7f84ccf8e700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84ac05ee80 0x7f84ac061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.021+0000 7f84bd7fa700 1 -- 172.21.15.78:0/3187976504 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84c80bf350 con 0x7f84c80650a0 2023-08-17T18:12:04.178 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:04.178+0000 7f605145d680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:12:04.191 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:04.190+0000 7f6ca17a0680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:12:04.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.218+0000 7f84ccf8e700 1 -- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84ac05ee80 msgr2=0x7f84ac061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:04.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.218+0000 7f84ccf8e700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84ac05ee80 0x7f84ac061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:04.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.236+0000 7f84cf9f3700 1 -- 172.21.15.78:0/3187976504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84c80bf350 con 0x7f84c80650a0 2023-08-17T18:12:04.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.236+0000 7f84bd7fa700 1 -- 172.21.15.78:0/3187976504 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f84c80bf350 con 0x7f84c80650a0 2023-08-17T18:12:04.237 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:04.237 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1301951105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1301951105},{"type":"v1","addr":"172.21.15.150:6834","nonce":1301951105}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3263459818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3263459818},{"type":"v1","addr":"172.21.15.78:6836","nonce":3263459818}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4038964498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4038964498},{"type":"v1","addr":"172.21.15.78:6837","nonce":4038964498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:10:35.123034+0000","modified":"2023-08-17T18:10:37.129045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/607383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":607383},{"type":"v1","addr":"172.21.15.150:6835","nonce":607383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T18:12:04.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 -- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84ac05ee80 msgr2=0x7f84ac061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:04.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84ac05ee80 0x7f84ac061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:04.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 -- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80650a0 msgr2=0x7f84c80aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80650a0 0x7f84c80aa470 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f84b800c470 tx=0x7f84b8007e30).stop 2023-08-17T18:12:04.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 -- 172.21.15.78:0/3187976504 shutdown_connections 2023-08-17T18:12:04.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84ac05ee80 0x7f84ac061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:04.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c80c4ee0 0x7f84c8135d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c80650a0 0x7f84c80aa470 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 --2- 172.21.15.78:0/3187976504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84c80c2110 0x7f84c8163380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 -- 172.21.15.78:0/3187976504 >> 172.21.15.78:0/3187976504 conn(0x7f84c8062fc0 msgr2=0x7f84c80c3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:04.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 -- 172.21.15.78:0/3187976504 shutdown_connections 2023-08-17T18:12:04.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.238+0000 7f84cf9f3700 1 -- 172.21.15.78:0/3187976504 wait complete. 2023-08-17T18:12:04.241 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 61 2023-08-17T18:12:04.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.406+0000 7f917c852700 1 Processor -- start 2023-08-17T18:12:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.406+0000 7f917c852700 1 -- start start 2023-08-17T18:12:04.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.407+0000 7f917c852700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9178062c00 0x7f9178151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.407+0000 7f917c852700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91780c6040 con 0x7f9178066a40 2023-08-17T18:12:04.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.407+0000 7f917c852700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9178069b00 con 0x7f9178066660 2023-08-17T18:12:04.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.407+0000 7f917c852700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9178069f90 con 0x7f9178062c00 2023-08-17T18:12:04.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.407+0000 7f9175d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9178066a40 0x7f91780624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38956/0 (socket says 172.21.15.78:38956) 2023-08-17T18:12:04.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.407+0000 7f9175d9b700 1 -- 172.21.15.78:0/778251698 learned_addr learned my addr 172.21.15.78:0/778251698 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:04.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.407+0000 7f9176d9d700 1 --2- 172.21.15.78:0/778251698 >> v2:172.21.15.150:3300/0 conn(0x7f9178062c00 0x7f9178151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f917559a700 1 -- 172.21.15.78:0/778251698 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668394561 0 0) 0x7f9168001110 con 0x7f9178066a40 2023-08-17T18:12:04.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f917559a700 1 -- 172.21.15.78:0/778251698 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91600033f0 con 0x7f9178066a40 2023-08-17T18:12:04.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f917559a700 1 -- 172.21.15.78:0/778251698 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752020543 0 0) 0x7f9178069b00 con 0x7f9178066660 2023-08-17T18:12:04.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f917559a700 1 -- 172.21.15.78:0/778251698 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9168001110 con 0x7f9178066660 2023-08-17T18:12:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f9176d9d700 1 -- 172.21.15.78:0/778251698 >> v1:172.21.15.150:6789/0 conn(0x7f9178066660 legacy=0x7f91780c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f9176d9d700 1 -- 172.21.15.78:0/778251698 >> v1:172.21.15.78:6789/0 conn(0x7f9178066a40 legacy=0x7f91780624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f9176d9d700 1 -- 172.21.15.78:0/778251698 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780c5d70 con 0x7f9178062c00 2023-08-17T18:12:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f9176d9d700 1 --2- 172.21.15.78:0/778251698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9178062c00 0x7f9178151570 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f9170009e60 tx=0x7f9170009780).ready entity=mon.1 client_cookie=6eabef19790ee3a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f917559a700 1 -- 172.21.15.78:0/778251698 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917000e070 con 0x7f9178062c00 2023-08-17T18:12:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f917559a700 1 -- 172.21.15.78:0/778251698 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917000bab0 con 0x7f9178062c00 2023-08-17T18:12:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.408+0000 7f917559a700 1 -- 172.21.15.78:0/778251698 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917000be30 con 0x7f9178062c00 2023-08-17T18:12:04.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.409+0000 7f917c852700 1 -- 172.21.15.78:0/778251698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9178062c00 msgr2=0x7f9178151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.409+0000 7f917c852700 1 --2- 172.21.15.78:0/778251698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9178062c00 0x7f9178151570 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f9170009e60 tx=0x7f9170009780).stop 2023-08-17T18:12:04.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.409+0000 7f917c852700 1 -- 172.21.15.78:0/778251698 shutdown_connections 2023-08-17T18:12:04.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.409+0000 7f917c852700 1 --2- 172.21.15.78:0/778251698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9178062c00 0x7f9178151570 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.409+0000 7f917c852700 1 -- 172.21.15.78:0/778251698 >> 172.21.15.78:0/778251698 conn(0x7f91780c7b00 msgr2=0x7f91780c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:04.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.409+0000 7f917c852700 1 -- 172.21.15.78:0/778251698 shutdown_connections 2023-08-17T18:12:04.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.409+0000 7f917c852700 1 -- 172.21.15.78:0/778251698 wait complete. 2023-08-17T18:12:04.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.410+0000 7f917c852700 1 Processor -- start 2023-08-17T18:12:04.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.410+0000 7f917c852700 1 -- start start 2023-08-17T18:12:04.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917c852700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9178062c00 0x7f91781519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917c852700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9178066660 0x7f91781524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917c852700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9178066a40 0x7f9178152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917c852700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9178152e80 con 0x7f9178062c00 2023-08-17T18:12:04.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917c852700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780a7d90 con 0x7f9178066a40 2023-08-17T18:12:04.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917c852700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91780aac90 con 0x7f9178066660 2023-08-17T18:12:04.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9178062c00 0x7f91781519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9178062c00 0x7f91781519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60006/0 (socket says 172.21.15.78:60006) 2023-08-17T18:12:04.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917659c700 1 -- 172.21.15.78:0/980943174 learned_addr learned my addr 172.21.15.78:0/980943174 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f9176d9d700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9178066a40 0x7f9178152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f9175d9b700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9178066660 0x7f91781524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917659c700 1 -- 172.21.15.78:0/980943174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9178066660 msgr2=0x7f91781524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917659c700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9178066660 0x7f91781524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917659c700 1 -- 172.21.15.78:0/980943174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9178066a40 msgr2=0x7f9178152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917659c700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9178066a40 0x7f9178152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917659c700 1 -- 172.21.15.78:0/980943174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170009a20 con 0x7f9178062c00 2023-08-17T18:12:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917659c700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9178062c00 0x7f91781519b0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f916c00c4c0 tx=0x7f916c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f91667fc700 1 -- 172.21.15.78:0/980943174 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00ce30 con 0x7f9178062c00 2023-08-17T18:12:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f91667fc700 1 -- 172.21.15.78:0/980943174 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00f470 con 0x7f9178062c00 2023-08-17T18:12:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.411+0000 7f917c852700 1 -- 172.21.15.78:0/980943174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91780a7760 con 0x7f9178062c00 2023-08-17T18:12:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.412+0000 7f91667fc700 1 -- 172.21.15.78:0/980943174 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00f810 con 0x7f9178062c00 2023-08-17T18:12:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.412+0000 7f917c852700 1 -- 172.21.15.78:0/980943174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91780a7a20 con 0x7f9178062c00 2023-08-17T18:12:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.412+0000 7f917c852700 1 -- 172.21.15.78:0/980943174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9178047350 con 0x7f9178062c00 2023-08-17T18:12:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.413+0000 7f91667fc700 1 -- 172.21.15.78:0/980943174 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f916c019030 con 0x7f9178062c00 2023-08-17T18:12:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.413+0000 7f91667fc700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f915805eeb0 0x7f9158061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.413+0000 7f9175d9b700 1 -- 172.21.15.78:0/980943174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f915805eeb0 msgr2=0x7f9158061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.413+0000 7f91667fc700 1 -- 172.21.15.78:0/980943174 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f916c0791f0 con 0x7f9178062c00 2023-08-17T18:12:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.413+0000 7f9175d9b700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f915805eeb0 0x7f9158061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:04.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.418+0000 7f91667fc700 1 -- 172.21.15.78:0/980943174 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f916c04a610 con 0x7f9178062c00 2023-08-17T18:12:04.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.589+0000 7f917c852700 1 -- 172.21.15.78:0/980943174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91780691d0 con 0x7f9178062c00 2023-08-17T18:12:04.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.590+0000 7f91667fc700 1 -- 172.21.15.78:0/980943174 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+17382 (secure 0 0 0) 0x7f916c04dc30 con 0x7f9178062c00 2023-08-17T18:12:04.591 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:04.591 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":171,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:11:47.603203+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:10:33.660535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T18:10:34.093770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.22","mappings":[{"from":4,"to":3}]},{"pgid":"22.23","mappings":[{"from":3,"to":0}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6833/158925":"2023-08-18T18:10:46.159099+0000","172.21.15.78:6832/158925":"2023-08-18T18:10:46.159099+0000","172.21.15.78:0/1117008278":"2023-08-18T18:10:46.159099+0000","172.21.15.78:0/3007657595":"2023-08-18T18:10:46.159099+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 -- 172.21.15.78:0/980943174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f915805eeb0 msgr2=0x7f9158061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f915805eeb0 0x7f9158061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 -- 172.21.15.78:0/980943174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9178062c00 msgr2=0x7f91781519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9178062c00 0x7f91781519b0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f916c00c4c0 tx=0x7f916c007c90).stop 2023-08-17T18:12:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 -- 172.21.15.78:0/980943174 shutdown_connections 2023-08-17T18:12:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f915805eeb0 0x7f9158061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9178066a40 0x7f9178152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9178062c00 0x7f91781519b0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 --2- 172.21.15.78:0/980943174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9178066660 0x7f91781524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 -- 172.21.15.78:0/980943174 >> 172.21.15.78:0/980943174 conn(0x7f91780c7b00 msgr2=0x7f9178156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 -- 172.21.15.78:0/980943174 shutdown_connections 2023-08-17T18:12:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.593+0000 7f917c852700 1 -- 172.21.15.78:0/980943174 wait complete. 2023-08-17T18:12:04.605 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T18:10:33.660535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T18:10:34.093770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T18:12:04.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T18:12:04.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.727+0000 7fcf55a2c700 1 Processor -- start 2023-08-17T18:12:04.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.727+0000 7fcf55a2c700 1 -- start start 2023-08-17T18:12:04.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf55a2c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf501376c0 0x7fcf500674f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf55a2c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500bdbc0 0x7fcf500be020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf55a2c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf50067060 con 0x7fcf5006a340 2023-08-17T18:12:04.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf55a2c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500be510 con 0x7fcf501376c0 2023-08-17T18:12:04.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf55a2c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50066450 con 0x7fcf500bdbc0 2023-08-17T18:12:04.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf4effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf501376c0 0x7fcf500674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf4f7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500bdbc0 0x7fcf500be020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf4e7fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fcf5006a340 0x7fcf50069620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:46336/0 (socket says 172.21.15.78:46336) 2023-08-17T18:12:04.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf4e7fc700 1 -- 172.21.15.78:0/1284727715 learned_addr learned my addr 172.21.15.78:0/1284727715 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:04.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf4effd700 1 -- 172.21.15.78:0/1284727715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500bdbc0 msgr2=0x7fcf500be020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:04.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf4effd700 1 --2- 172.21.15.78:0/1284727715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500bdbc0 0x7fcf500be020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf4effd700 1 -- 172.21.15.78:0/1284727715 >> v1:172.21.15.150:6789/0 conn(0x7fcf5006a340 legacy=0x7fcf50069620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf4effd700 1 -- 172.21.15.78:0/1284727715 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50066730 con 0x7fcf501376c0 2023-08-17T18:12:04.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.728+0000 7fcf4dffb700 1 -- 172.21.15.78:0/1284727715 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518776177 0 0) 0x7fcf50067060 con 0x7fcf5006a340 2023-08-17T18:12:04.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf4effd700 1 --2- 172.21.15.78:0/1284727715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf501376c0 0x7fcf500674f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fcf40009760 tx=0x7fcf40009060).ready entity=mon.1 client_cookie=b9e953b5234adedb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:04.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf4dffb700 1 -- 172.21.15.78:0/1284727715 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000f510 con 0x7fcf501376c0 2023-08-17T18:12:04.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf4dffb700 1 -- 172.21.15.78:0/1284727715 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4000f670 con 0x7fcf501376c0 2023-08-17T18:12:04.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf4dffb700 1 -- 172.21.15.78:0/1284727715 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000f9f0 con 0x7fcf501376c0 2023-08-17T18:12:04.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf55a2c700 1 -- 172.21.15.78:0/1284727715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf501376c0 msgr2=0x7fcf500674f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf55a2c700 1 --2- 172.21.15.78:0/1284727715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf501376c0 0x7fcf500674f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fcf40009760 tx=0x7fcf40009060).stop 2023-08-17T18:12:04.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf55a2c700 1 -- 172.21.15.78:0/1284727715 shutdown_connections 2023-08-17T18:12:04.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf55a2c700 1 --2- 172.21.15.78:0/1284727715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500bdbc0 0x7fcf500be020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf55a2c700 1 --2- 172.21.15.78:0/1284727715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf501376c0 0x7fcf500674f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf55a2c700 1 -- 172.21.15.78:0/1284727715 >> 172.21.15.78:0/1284727715 conn(0x7fcf500c7a30 msgr2=0x7fcf500c7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:04.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf55a2c700 1 -- 172.21.15.78:0/1284727715 shutdown_connections 2023-08-17T18:12:04.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.729+0000 7fcf55a2c700 1 -- 172.21.15.78:0/1284727715 wait complete. 2023-08-17T18:12:04.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.730+0000 7fcf55a2c700 1 Processor -- start 2023-08-17T18:12:04.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf55a2c700 1 -- start start 2023-08-17T18:12:04.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf55a2c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf500bdbc0 0x7fcf5014dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf55a2c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf501376c0 0x7fcf500c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf55a2c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500c3810 0x7fcf50156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf55a2c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5014dfa0 con 0x7fcf500bdbc0 2023-08-17T18:12:04.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf55a2c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500ab890 con 0x7fcf501376c0 2023-08-17T18:12:04.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf55a2c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500aa9e0 con 0x7fcf500c3810 2023-08-17T18:12:04.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf4effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf500bdbc0 0x7fcf5014dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf4effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf500bdbc0 0x7fcf5014dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60014/0 (socket says 172.21.15.78:60014) 2023-08-17T18:12:04.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf4effd700 1 -- 172.21.15.78:0/2582552318 learned_addr learned my addr 172.21.15.78:0/2582552318 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:04.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf4f7fe700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500c3810 0x7fcf50156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.731+0000 7fcf4e7fc700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf501376c0 0x7fcf500c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:04.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf4effd700 1 -- 172.21.15.78:0/2582552318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500c3810 msgr2=0x7fcf50156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf4effd700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500c3810 0x7fcf50156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf4effd700 1 -- 172.21.15.78:0/2582552318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf501376c0 msgr2=0x7fcf500c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf4effd700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf501376c0 0x7fcf500c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf4effd700 1 -- 172.21.15.78:0/2582552318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400092a0 con 0x7fcf500bdbc0 2023-08-17T18:12:04.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf4f7fe700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500c3810 0x7fcf50156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:04.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf4e7fc700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf501376c0 0x7fcf500c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:04.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf4effd700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf500bdbc0 0x7fcf5014dab0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fcf40009e00 tx=0x7fcf40017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:04.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf36ffd700 1 -- 172.21.15.78:0/2582552318 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000fe80 con 0x7fcf500bdbc0 2023-08-17T18:12:04.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf36ffd700 1 -- 172.21.15.78:0/2582552318 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4000f7e0 con 0x7fcf500bdbc0 2023-08-17T18:12:04.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf36ffd700 1 -- 172.21.15.78:0/2582552318 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4001b670 con 0x7fcf500bdbc0 2023-08-17T18:12:04.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf55a2c700 1 -- 172.21.15.78:0/2582552318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf500aac80 con 0x7fcf500bdbc0 2023-08-17T18:12:04.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.732+0000 7fcf55a2c700 1 -- 172.21.15.78:0/2582552318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf500ab240 con 0x7fcf500bdbc0 2023-08-17T18:12:04.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.733+0000 7fcf55a2c700 1 -- 172.21.15.78:0/2582552318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf500c3bf0 con 0x7fcf500bdbc0 2023-08-17T18:12:04.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.733+0000 7fcf36ffd700 1 -- 172.21.15.78:0/2582552318 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fcf4000f070 con 0x7fcf500bdbc0 2023-08-17T18:12:04.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.734+0000 7fcf36ffd700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf3c05ee80 0x7fcf3c061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:04.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.734+0000 7fcf4e7fc700 1 -- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf3c05ee80 msgr2=0x7fcf3c061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:04.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.734+0000 7fcf36ffd700 1 -- 172.21.15.78:0/2582552318 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fcf4007b2d0 con 0x7fcf500bdbc0 2023-08-17T18:12:04.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.734+0000 7fcf4e7fc700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf3c05ee80 0x7fcf3c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:04.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.738+0000 7fcf36ffd700 1 -- 172.21.15.78:0/2582552318 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf4004c7a0 con 0x7fcf500bdbc0 2023-08-17T18:12:04.790 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:04.790+0000 7f605145d680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:12:04.840 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:04.833+0000 7f6ca17a0680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:12:04.862 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:04.862+0000 7f605145d680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:12:04.906 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:04.906+0000 7f6ca17a0680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:12:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.935+0000 7fcf4e7fc700 1 -- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf3c05ee80 msgr2=0x7fcf3c061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:04.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.935+0000 7fcf4e7fc700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf3c05ee80 0x7fcf3c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:04.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.941+0000 7fcf55a2c700 1 -- 172.21.15.78:0/2582552318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcf5005f910 con 0x7fcf500bdbc0 2023-08-17T18:12:04.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.941+0000 7fcf36ffd700 1 -- 172.21.15.78:0/2582552318 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v171) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcf4004fdc0 con 0x7fcf500bdbc0 2023-08-17T18:12:04.941 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T18:12:04.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 -- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf3c05ee80 msgr2=0x7fcf3c061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:04.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf3c05ee80 0x7fcf3c061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:04.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 -- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf500bdbc0 msgr2=0x7fcf5014dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:04.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf500bdbc0 0x7fcf5014dab0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fcf40009e00 tx=0x7fcf40017000).stop 2023-08-17T18:12:04.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 -- 172.21.15.78:0/2582552318 shutdown_connections 2023-08-17T18:12:04.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf3c05ee80 0x7fcf3c061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:04.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf500c3810 0x7fcf50156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf500bdbc0 0x7fcf5014dab0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 --2- 172.21.15.78:0/2582552318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf501376c0 0x7fcf500c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:04.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 -- 172.21.15.78:0/2582552318 >> 172.21.15.78:0/2582552318 conn(0x7fcf500c7a30 msgr2=0x7fcf50150ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:04.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 -- 172.21.15.78:0/2582552318 shutdown_connections 2023-08-17T18:12:04.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:04.943+0000 7fcf55a2c700 1 -- 172.21.15.78:0/2582552318 wait complete. 2023-08-17T18:12:04.956 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T18:12:05.048 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:05.048+0000 7f605145d680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:12:05.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.076+0000 7f8c5a573700 1 Processor -- start 2023-08-17T18:12:05.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.076+0000 7f8c5a573700 1 -- start start 2023-08-17T18:12:05.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.077+0000 7f8c5a573700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c54069f90 0x7f8c54154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.077+0000 7f8c5a573700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c54069b00 con 0x7f8c5413a740 2023-08-17T18:12:05.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.077+0000 7f8c5a573700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5413ab20 con 0x7f8c54062c00 2023-08-17T18:12:05.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.077+0000 7f8c5a573700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c54155640 con 0x7f8c54069f90 2023-08-17T18:12:05.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.077+0000 7f8c58b10700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c54069f90 0x7f8c54154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.077+0000 7f8c53fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8c5413a740 0x7f8c540624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38970/0 (socket says 172.21.15.78:38970) 2023-08-17T18:12:05.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.077+0000 7f8c58b10700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c54069f90 0x7f8c54154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60018/0 (socket says 172.21.15.78:60018) 2023-08-17T18:12:05.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.077+0000 7f8c53fff700 1 -- 172.21.15.78:0/910525258 learned_addr learned my addr 172.21.15.78:0/910525258 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:05.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.078+0000 7f8c58b10700 1 -- 172.21.15.78:0/910525258 >> v1:172.21.15.150:6789/0 conn(0x7f8c54062c00 legacy=0x7f8c541545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.078+0000 7f8c58b10700 1 -- 172.21.15.78:0/910525258 >> v1:172.21.15.78:6789/0 conn(0x7f8c5413a740 legacy=0x7f8c540624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.078+0000 7f8c52ffd700 1 -- 172.21.15.78:0/910525258 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154197240 0 0) 0x7f8c54069b00 con 0x7f8c5413a740 2023-08-17T18:12:05.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.078+0000 7f8c58b10700 1 -- 172.21.15.78:0/910525258 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c54155360 con 0x7f8c54069f90 2023-08-17T18:12:05.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.078+0000 7f8c58b10700 1 --2- 172.21.15.78:0/910525258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54069f90 0x7f8c54154cf0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f8c4c009e60 tx=0x7f8c4c009780).ready entity=mon.0 client_cookie=93a56c81545a04ed server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:05.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.078+0000 7f8c52ffd700 1 -- 172.21.15.78:0/910525258 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c00e070 con 0x7f8c54069f90 2023-08-17T18:12:05.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.078+0000 7f8c52ffd700 1 -- 172.21.15.78:0/910525258 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c00bc30 con 0x7f8c54069f90 2023-08-17T18:12:05.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.078+0000 7f8c52ffd700 1 -- 172.21.15.78:0/910525258 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c012410 con 0x7f8c54069f90 2023-08-17T18:12:05.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.079+0000 7f8c5a573700 1 -- 172.21.15.78:0/910525258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54069f90 msgr2=0x7f8c54154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.079+0000 7f8c5a573700 1 --2- 172.21.15.78:0/910525258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54069f90 0x7f8c54154cf0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f8c4c009e60 tx=0x7f8c4c009780).stop 2023-08-17T18:12:05.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.079+0000 7f8c5a573700 1 -- 172.21.15.78:0/910525258 shutdown_connections 2023-08-17T18:12:05.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.079+0000 7f8c5a573700 1 --2- 172.21.15.78:0/910525258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54069f90 0x7f8c54154cf0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.079+0000 7f8c5a573700 1 -- 172.21.15.78:0/910525258 >> 172.21.15.78:0/910525258 conn(0x7f8c540c7b80 msgr2=0x7f8c540c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:05.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.079+0000 7f8c5a573700 1 -- 172.21.15.78:0/910525258 shutdown_connections 2023-08-17T18:12:05.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.079+0000 7f8c5a573700 1 -- 172.21.15.78:0/910525258 wait complete. 2023-08-17T18:12:05.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.080+0000 7f8c5a573700 1 Processor -- start 2023-08-17T18:12:05.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.080+0000 7f8c5a573700 1 -- start start 2023-08-17T18:12:05.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c5a573700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54062c00 0x7f8c541396a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c5a573700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c54069f90 0x7f8c540ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c5a573700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c5413a740 0x7f8c540ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c5a573700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c540a8510 con 0x7f8c54062c00 2023-08-17T18:12:05.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c5a573700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c54139b90 con 0x7f8c54069f90 2023-08-17T18:12:05.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c5a573700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c540a9300 con 0x7f8c5413a740 2023-08-17T18:12:05.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c53fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54062c00 0x7f8c541396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c53fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54062c00 0x7f8c541396a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60026/0 (socket says 172.21.15.78:60026) 2023-08-17T18:12:05.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c53fff700 1 -- 172.21.15.78:0/867956684 learned_addr learned my addr 172.21.15.78:0/867956684 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:05.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c537fe700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c54069f90 0x7f8c540ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c58b10700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c5413a740 0x7f8c540ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c53fff700 1 -- 172.21.15.78:0/867956684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c5413a740 msgr2=0x7f8c540ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c53fff700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c5413a740 0x7f8c540ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c53fff700 1 -- 172.21.15.78:0/867956684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c54069f90 msgr2=0x7f8c540ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c53fff700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c54069f90 0x7f8c540ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c53fff700 1 -- 172.21.15.78:0/867956684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c009a20 con 0x7f8c54062c00 2023-08-17T18:12:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c53fff700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54062c00 0x7f8c541396a0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f8c4800c4c0 tx=0x7f8c48007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c3bfff700 1 -- 172.21.15.78:0/867956684 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c480070d0 con 0x7f8c54062c00 2023-08-17T18:12:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c3bfff700 1 -- 172.21.15.78:0/867956684 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c48007230 con 0x7f8c54062c00 2023-08-17T18:12:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c5a573700 1 -- 172.21.15.78:0/867956684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c540a9790 con 0x7f8c54062c00 2023-08-17T18:12:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c3bfff700 1 -- 172.21.15.78:0/867956684 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c480075d0 con 0x7f8c54062c00 2023-08-17T18:12:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.081+0000 7f8c5a573700 1 -- 172.21.15.78:0/867956684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c540a89d0 con 0x7f8c54062c00 2023-08-17T18:12:05.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.082+0000 7f8c5a573700 1 -- 172.21.15.78:0/867956684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c540a95e0 con 0x7f8c54062c00 2023-08-17T18:12:05.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.083+0000 7f8c3bfff700 1 -- 172.21.15.78:0/867956684 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f8c48010070 con 0x7f8c54062c00 2023-08-17T18:12:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.083+0000 7f8c3bfff700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8c4005eeb0 0x7f8c40061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.083+0000 7f8c537fe700 1 -- 172.21.15.78:0/867956684 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8c4005eeb0 msgr2=0x7f8c40061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.083+0000 7f8c3bfff700 1 -- 172.21.15.78:0/867956684 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f8c48079240 con 0x7f8c54062c00 2023-08-17T18:12:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.083+0000 7f8c537fe700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8c4005eeb0 0x7f8c40061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.087+0000 7f8c3bfff700 1 -- 172.21.15.78:0/867956684 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c4804a710 con 0x7f8c54062c00 2023-08-17T18:12:05.103 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:05.103+0000 7f6ca17a0680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:12:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.258+0000 7f8c5a573700 1 -- 172.21.15.78:0/867956684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8c54068270 con 0x7f8c54062c00 2023-08-17T18:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.259+0000 7f8c3bfff700 1 -- 172.21.15.78:0/867956684 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v171) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8c4804dd30 con 0x7f8c54062c00 2023-08-17T18:12:05.259 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T18:12:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 -- 172.21.15.78:0/867956684 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8c4005eeb0 msgr2=0x7f8c40061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8c4005eeb0 0x7f8c40061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 -- 172.21.15.78:0/867956684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54062c00 msgr2=0x7f8c541396a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54062c00 0x7f8c541396a0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f8c4800c4c0 tx=0x7f8c48007e40).stop 2023-08-17T18:12:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 -- 172.21.15.78:0/867956684 shutdown_connections 2023-08-17T18:12:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8c4005eeb0 0x7f8c40061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c5413a740 0x7f8c540ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c54062c00 0x7f8c541396a0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 --2- 172.21.15.78:0/867956684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c54069f90 0x7f8c540ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 -- 172.21.15.78:0/867956684 >> 172.21.15.78:0/867956684 conn(0x7f8c540c7b80 msgr2=0x7f8c541542f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 -- 172.21.15.78:0/867956684 shutdown_connections 2023-08-17T18:12:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.261+0000 7f8c5a573700 1 -- 172.21.15.78:0/867956684 wait complete. 2023-08-17T18:12:05.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T18:12:05.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.394+0000 7f85764c4700 1 Processor -- start 2023-08-17T18:12:05.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.394+0000 7f85764c4700 1 -- start start 2023-08-17T18:12:05.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85764c4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85701520c0 0x7f85700c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85764c4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85700c6390 0x7f85700a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85764c4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85700c3a90 con 0x7f85700c6810 2023-08-17T18:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85764c4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85700c2e80 con 0x7f85701520c0 2023-08-17T18:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85764c4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85700c3160 con 0x7f85700c6390 2023-08-17T18:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85754c2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85701520c0 0x7f85700c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85754c2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85701520c0 0x7f85700c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60038/0 (socket says 172.21.15.78:60038) 2023-08-17T18:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85754c2700 1 -- 172.21.15.78:0/920137337 learned_addr learned my addr 172.21.15.78:0/920137337 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f8574cc1700 1 --2- 172.21.15.78:0/920137337 >> v2:172.21.15.150:3300/0 conn(0x7f85700c6390 0x7f85700a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85754c2700 1 -- 172.21.15.78:0/920137337 >> v2:172.21.15.150:3300/0 conn(0x7f85700c6390 msgr2=0x7f85700a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85754c2700 1 --2- 172.21.15.78:0/920137337 >> v2:172.21.15.150:3300/0 conn(0x7f85700c6390 0x7f85700a9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85754c2700 1 -- 172.21.15.78:0/920137337 >> v1:172.21.15.150:6789/0 conn(0x7f85700c6810 legacy=0x7f8570155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85754c2700 1 -- 172.21.15.78:0/920137337 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700c3440 con 0x7f85701520c0 2023-08-17T18:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.395+0000 7f85754c2700 1 --2- 172.21.15.78:0/920137337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85701520c0 0x7f85700c2880 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f8570064250 tx=0x7f856c0090f0).ready entity=mon.0 client_cookie=2b1f5e0f04338cde server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f8567fff700 1 -- 172.21.15.78:0/920137337 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c00b520 con 0x7f85701520c0 2023-08-17T18:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f8567fff700 1 -- 172.21.15.78:0/920137337 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c00b680 con 0x7f85701520c0 2023-08-17T18:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f8567fff700 1 -- 172.21.15.78:0/920137337 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c00ba00 con 0x7f85701520c0 2023-08-17T18:12:05.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f85764c4700 1 -- 172.21.15.78:0/920137337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85701520c0 msgr2=0x7f85700c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f85764c4700 1 --2- 172.21.15.78:0/920137337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85701520c0 0x7f85700c2880 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f8570064250 tx=0x7f856c0090f0).stop 2023-08-17T18:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f85764c4700 1 -- 172.21.15.78:0/920137337 shutdown_connections 2023-08-17T18:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f85764c4700 1 --2- 172.21.15.78:0/920137337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85701520c0 0x7f85700c2880 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f85764c4700 1 --2- 172.21.15.78:0/920137337 >> v2:172.21.15.150:3300/0 conn(0x7f85700c6390 0x7f85700a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f85764c4700 1 -- 172.21.15.78:0/920137337 >> 172.21.15.78:0/920137337 conn(0x7f85700c3e20 msgr2=0x7f85700c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f85764c4700 1 -- 172.21.15.78:0/920137337 shutdown_connections 2023-08-17T18:12:05.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.396+0000 7f85764c4700 1 -- 172.21.15.78:0/920137337 wait complete. 2023-08-17T18:12:05.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.398+0000 7f85764c4700 1 Processor -- start 2023-08-17T18:12:05.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.398+0000 7f85764c4700 1 -- start start 2023-08-17T18:12:05.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.398+0000 7f85764c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85700c6390 0x7f85700a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.398+0000 7f85764c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85700c6810 0x7f8570152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.398+0000 7f85764c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85701520c0 0x7f85701649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.398+0000 7f85764c4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85701658f0 con 0x7f85700c6390 2023-08-17T18:12:05.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.398+0000 7f85764c4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700a5650 con 0x7f85700c6810 2023-08-17T18:12:05.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.398+0000 7f85764c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8570165330 con 0x7f85701520c0 2023-08-17T18:12:05.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85754c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85700c6390 0x7f85700a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85754c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85700c6390 0x7f85700a6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60044/0 (socket says 172.21.15.78:60044) 2023-08-17T18:12:05.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85754c2700 1 -- 172.21.15.78:0/3748664178 learned_addr learned my addr 172.21.15.78:0/3748664178 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:05.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f8574cc1700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85700c6810 0x7f8570152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f8575cc3700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85701520c0 0x7f85701649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85754c2700 1 -- 172.21.15.78:0/3748664178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85701520c0 msgr2=0x7f85701649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85754c2700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85701520c0 0x7f85701649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85754c2700 1 -- 172.21.15.78:0/3748664178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85700c6810 msgr2=0x7f8570152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85754c2700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85700c6810 0x7f8570152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85754c2700 1 -- 172.21.15.78:0/3748664178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c009370 con 0x7f85700c6390 2023-08-17T18:12:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f8574cc1700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85700c6810 0x7f8570152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85754c2700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85700c6390 0x7f85700a6f30 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f856c009700 tx=0x7f856c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85657fa700 1 -- 172.21.15.78:0/3748664178 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c000bc0 con 0x7f85700c6390 2023-08-17T18:12:05.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85657fa700 1 -- 172.21.15.78:0/3748664178 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c00b7f0 con 0x7f85700c6390 2023-08-17T18:12:05.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85657fa700 1 -- 172.21.15.78:0/3748664178 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c000d20 con 0x7f85700c6390 2023-08-17T18:12:05.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85764c4700 1 -- 172.21.15.78:0/3748664178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8570165610 con 0x7f85700c6390 2023-08-17T18:12:05.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.399+0000 7f85764c4700 1 -- 172.21.15.78:0/3748664178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8570152ff0 con 0x7f85700c6390 2023-08-17T18:12:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.400+0000 7f85764c4700 1 -- 172.21.15.78:0/3748664178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857005f910 con 0x7f85700c6390 2023-08-17T18:12:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.401+0000 7f85657fa700 1 -- 172.21.15.78:0/3748664178 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f856c02b070 con 0x7f85700c6390 2023-08-17T18:12:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.401+0000 7f85657fa700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f855405eeb0 0x7f8554061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.401+0000 7f8574cc1700 1 -- 172.21.15.78:0/3748664178 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f855405eeb0 msgr2=0x7f8554061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.401+0000 7f85657fa700 1 -- 172.21.15.78:0/3748664178 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f856c07b850 con 0x7f85700c6390 2023-08-17T18:12:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.401+0000 7f8574cc1700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f855405eeb0 0x7f8554061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:05.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.405+0000 7f85657fa700 1 -- 172.21.15.78:0/3748664178 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f856c04cc70 con 0x7f85700c6390 2023-08-17T18:12:05.469 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:05.469+0000 7f605145d680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:12:05.543 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:05.544+0000 7f6ca17a0680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:12:05.572 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:05.572+0000 7f605145d680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:05.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.575+0000 7f85764c4700 1 -- 172.21.15.78:0/3748664178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85700c3720 con 0x7f85700c6390 2023-08-17T18:12:05.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.575+0000 7f85657fa700 1 -- 172.21.15.78:0/3748664178 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v171) v1 ==== 104+0+11 (secure 0 0 0) 0x7f856c029020 con 0x7f85700c6390 2023-08-17T18:12:05.575 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T18:12:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 -- 172.21.15.78:0/3748664178 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f855405eeb0 msgr2=0x7f8554061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f855405eeb0 0x7f8554061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 -- 172.21.15.78:0/3748664178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85700c6390 msgr2=0x7f85700a6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85700c6390 0x7f85700a6f30 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f856c009700 tx=0x7f856c017000).stop 2023-08-17T18:12:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 -- 172.21.15.78:0/3748664178 shutdown_connections 2023-08-17T18:12:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f855405eeb0 0x7f8554061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85701520c0 0x7f85701649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85700c6390 0x7f85700a6f30 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 --2- 172.21.15.78:0/3748664178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85700c6810 0x7f8570152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 -- 172.21.15.78:0/3748664178 >> 172.21.15.78:0/3748664178 conn(0x7f85700c3e20 msgr2=0x7f85701512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 -- 172.21.15.78:0/3748664178 shutdown_connections 2023-08-17T18:12:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.577+0000 7f85764c4700 1 -- 172.21.15.78:0/3748664178 wait complete. 2023-08-17T18:12:05.589 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T18:12:05.657 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:05.657+0000 7f6ca17a0680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:05.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.711+0000 7f83e2e8f700 1 Processor -- start 2023-08-17T18:12:05.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.711+0000 7f83e2e8f700 1 -- start start 2023-08-17T18:12:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.712+0000 7f83e2e8f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f83dc150a20 0x7f83dc0c6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.712+0000 7f83e2e8f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83dc06a390 0x7f83dc0c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.712+0000 7f83e2e8f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc0c5ba0 0x7f83dc068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.712+0000 7f83e2e8f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc0c6d60 con 0x7f83dc06a390 2023-08-17T18:12:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.712+0000 7f83e2e8f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc0c6b50 con 0x7f83dc150a20 2023-08-17T18:12:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.712+0000 7f83e2e8f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0bc8e0 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.712+0000 7f83dbfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83dc06a390 0x7f83dc0c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.712+0000 7f83dbfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83dc06a390 0x7f83dc0c56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60052/0 (socket says 172.21.15.78:60052) 2023-08-17T18:12:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.712+0000 7f83dbfff700 1 -- 172.21.15.78:0/357247939 learned_addr learned my addr 172.21.15.78:0/357247939 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.712+0000 7f83e0c2b700 1 --2- 172.21.15.78:0/357247939 >> v2:172.21.15.150:3300/0 conn(0x7f83dc150a20 0x7f83dc0c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83e142c700 1 --2- 172.21.15.78:0/357247939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc0c5ba0 0x7f83dc068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83dbfff700 1 -- 172.21.15.78:0/357247939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc0c5ba0 msgr2=0x7f83dc068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83dbfff700 1 --2- 172.21.15.78:0/357247939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc0c5ba0 0x7f83dc068bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83dbfff700 1 -- 172.21.15.78:0/357247939 >> v2:172.21.15.150:3300/0 conn(0x7f83dc150a20 msgr2=0x7f83dc0c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83dbfff700 1 --2- 172.21.15.78:0/357247939 >> v2:172.21.15.150:3300/0 conn(0x7f83dc150a20 0x7f83dc0c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83dbfff700 1 -- 172.21.15.78:0/357247939 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc069f70 con 0x7f83dc06a390 2023-08-17T18:12:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83e142c700 1 --2- 172.21.15.78:0/357247939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc0c5ba0 0x7f83dc068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83dbfff700 1 --2- 172.21.15.78:0/357247939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc06a390 0x7f83dc0c56b0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f83dc068270 tx=0x7f83c80090f0).ready entity=mon.0 client_cookie=e5463b7cb6c1a4cd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83db7fe700 1 -- 172.21.15.78:0/357247939 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800b520 con 0x7f83dc06a390 2023-08-17T18:12:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83db7fe700 1 -- 172.21.15.78:0/357247939 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c800b680 con 0x7f83dc06a390 2023-08-17T18:12:05.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.713+0000 7f83db7fe700 1 -- 172.21.15.78:0/357247939 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800ba00 con 0x7f83dc06a390 2023-08-17T18:12:05.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.714+0000 7f83e2e8f700 1 -- 172.21.15.78:0/357247939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc06a390 msgr2=0x7f83dc0c56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.714+0000 7f83e2e8f700 1 --2- 172.21.15.78:0/357247939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc06a390 0x7f83dc0c56b0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f83dc068270 tx=0x7f83c80090f0).stop 2023-08-17T18:12:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.714+0000 7f83e2e8f700 1 -- 172.21.15.78:0/357247939 shutdown_connections 2023-08-17T18:12:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.714+0000 7f83e2e8f700 1 --2- 172.21.15.78:0/357247939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc0c5ba0 0x7f83dc068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.714+0000 7f83e2e8f700 1 --2- 172.21.15.78:0/357247939 >> v2:172.21.15.150:3300/0 conn(0x7f83dc150a20 0x7f83dc0c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.714+0000 7f83e2e8f700 1 --2- 172.21.15.78:0/357247939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc06a390 0x7f83dc0c56b0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.714+0000 7f83e2e8f700 1 -- 172.21.15.78:0/357247939 >> 172.21.15.78:0/357247939 conn(0x7f83dc0c6f20 msgr2=0x7f83dc0c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:05.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.714+0000 7f83e2e8f700 1 -- 172.21.15.78:0/357247939 shutdown_connections 2023-08-17T18:12:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.714+0000 7f83e2e8f700 1 -- 172.21.15.78:0/357247939 wait complete. 2023-08-17T18:12:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.715+0000 7f83e2e8f700 1 Processor -- start 2023-08-17T18:12:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.715+0000 7f83e2e8f700 1 -- start start 2023-08-17T18:12:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83e2e8f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc06a390 0x7f83dc14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83e2e8f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc0c5ba0 0x7f83dc0aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83e2e8f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83dc150a20 0x7f83dc155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83e2e8f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc14e210 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83e2e8f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc14e480 con 0x7f83dc150a20 2023-08-17T18:12:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83e2e8f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0aaac0 con 0x7f83dc06a390 2023-08-17T18:12:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83dbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc0c5ba0 0x7f83dc0aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83dbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc0c5ba0 0x7f83dc0aa0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60066/0 (socket says 172.21.15.78:60066) 2023-08-17T18:12:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83dbfff700 1 -- 172.21.15.78:0/3163527031 learned_addr learned my addr 172.21.15.78:0/3163527031 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83e142c700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83dc150a20 0x7f83dc155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.716+0000 7f83e0c2b700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc06a390 0x7f83dc14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:05.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83dbfff700 1 -- 172.21.15.78:0/3163527031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc06a390 msgr2=0x7f83dc14a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83dbfff700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc06a390 0x7f83dc14a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83dbfff700 1 -- 172.21.15.78:0/3163527031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83dc150a20 msgr2=0x7f83dc155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83dbfff700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83dc150a20 0x7f83dc155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83dbfff700 1 -- 172.21.15.78:0/3163527031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009370 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83dbfff700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc0c5ba0 0x7f83dc0aa0e0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f83c8009130 tx=0x7f83c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83d8ff9700 1 -- 172.21.15.78:0/3163527031 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8006a40 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83d8ff9700 1 -- 172.21.15.78:0/3163527031 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c8000bc0 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83e2e8f700 1 -- 172.21.15.78:0/3163527031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc0aada0 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83d8ff9700 1 -- 172.21.15.78:0/3163527031 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c801b410 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.717+0000 7f83e2e8f700 1 -- 172.21.15.78:0/3163527031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc0a69c0 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.718+0000 7f83e2e8f700 1 -- 172.21.15.78:0/3163527031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc0ab2c0 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.718+0000 7f83d8ff9700 1 -- 172.21.15.78:0/3163527031 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f83c802b070 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.719+0000 7f83d8ff9700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f83c005eeb0 0x7f83c0061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.719+0000 7f83e0c2b700 1 -- 172.21.15.78:0/3163527031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f83c005eeb0 msgr2=0x7f83c0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.719+0000 7f83d8ff9700 1 -- 172.21.15.78:0/3163527031 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f83c807b550 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.719+0000 7f83e0c2b700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f83c005eeb0 0x7f83c0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:05.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.723+0000 7f83d8ff9700 1 -- 172.21.15.78:0/3163527031 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f83dc0ab2c0 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.732 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:05.732+0000 7f605145d680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:05.808 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:05.808+0000 7f605145d680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:12:05.818 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:05.819+0000 7f6ca17a0680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:05.876 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:05.876+0000 7f605145d680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:12:05.895 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:05.895+0000 7f6ca17a0680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:12:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.896+0000 7f83e2e8f700 1 -- 172.21.15.78:0/3163527031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83dc0ab2c0 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.896+0000 7f83d8ff9700 1 -- 172.21.15.78:0/3163527031 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v172) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83dc0ab2c0 con 0x7f83dc0c5ba0 2023-08-17T18:12:05.896 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T18:12:05.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 -- 172.21.15.78:0/3163527031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f83c005eeb0 msgr2=0x7f83c0061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:05.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f83c005eeb0 0x7f83c0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:05.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 -- 172.21.15.78:0/3163527031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc0c5ba0 msgr2=0x7f83dc0aa0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:05.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc0c5ba0 0x7f83dc0aa0e0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f83c8009130 tx=0x7f83c8017000).stop 2023-08-17T18:12:05.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 -- 172.21.15.78:0/3163527031 shutdown_connections 2023-08-17T18:12:05.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f83c005eeb0 0x7f83c0061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:05.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83dc150a20 0x7f83dc155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83dc06a390 0x7f83dc14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 --2- 172.21.15.78:0/3163527031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83dc0c5ba0 0x7f83dc0aa0e0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:05.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 -- 172.21.15.78:0/3163527031 >> 172.21.15.78:0/3163527031 conn(0x7f83dc0c6f20 msgr2=0x7f83dc065830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:05.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 -- 172.21.15.78:0/3163527031 shutdown_connections 2023-08-17T18:12:05.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:05.898+0000 7f83e2e8f700 1 -- 172.21.15.78:0/3163527031 wait complete. 2023-08-17T18:12:05.911 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:05.968 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:05.969+0000 7f6ca17a0680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:12:06.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.027+0000 7fe405a2f700 1 Processor -- start 2023-08-17T18:12:06.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.027+0000 7fe405a2f700 1 -- start start 2023-08-17T18:12:06.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe405a2f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe400154140 0x7fe4000c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe405a2f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4000a7c40 0x7fe4000c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe405a2f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe400154520 con 0x7fe4000a8080 2023-08-17T18:12:06.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe405a2f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4000c91e0 con 0x7fe4000a7c40 2023-08-17T18:12:06.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe405a2f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000c94c0 con 0x7fe400154140 2023-08-17T18:12:06.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3fe7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4000a7c40 0x7fe4000c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3ff7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe4000a8080 0x7fe4000ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38984/0 (socket says 172.21.15.78:38984) 2023-08-17T18:12:06.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3fe7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4000a7c40 0x7fe4000c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60070/0 (socket says 172.21.15.78:60070) 2023-08-17T18:12:06.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3ff7fe700 1 -- 172.21.15.78:0/667937170 learned_addr learned my addr 172.21.15.78:0/667937170 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:06.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3feffd700 1 --2- 172.21.15.78:0/667937170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe400154140 0x7fe4000c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3fe7fc700 1 -- 172.21.15.78:0/667937170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe400154140 msgr2=0x7fe4000c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:06.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3fe7fc700 1 --2- 172.21.15.78:0/667937170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe400154140 0x7fe4000c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3fe7fc700 1 -- 172.21.15.78:0/667937170 >> v1:172.21.15.78:6789/0 conn(0x7fe4000a8080 legacy=0x7fe4000ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3fdffb700 1 -- 172.21.15.78:0/667937170 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474360782 0 0) 0x7fe400154520 con 0x7fe4000a8080 2023-08-17T18:12:06.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3fe7fc700 1 -- 172.21.15.78:0/667937170 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4000c97a0 con 0x7fe4000a7c40 2023-08-17T18:12:06.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3feffd700 1 --2- 172.21.15.78:0/667937170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe400154140 0x7fe4000c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.028+0000 7fe3fe7fc700 1 --2- 172.21.15.78:0/667937170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 0x7fe4000c0900 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7fe3f0009760 tx=0x7fe3f0009060).ready entity=mon.0 client_cookie=8bf5091cd880d47d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe3fdffb700 1 -- 172.21.15.78:0/667937170 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000b580 con 0x7fe4000a7c40 2023-08-17T18:12:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe3fdffb700 1 -- 172.21.15.78:0/667937170 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000b6e0 con 0x7fe4000a7c40 2023-08-17T18:12:06.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe3fdffb700 1 -- 172.21.15.78:0/667937170 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000ba60 con 0x7fe4000a7c40 2023-08-17T18:12:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe405a2f700 1 -- 172.21.15.78:0/667937170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 msgr2=0x7fe4000c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe405a2f700 1 --2- 172.21.15.78:0/667937170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 0x7fe4000c0900 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7fe3f0009760 tx=0x7fe3f0009060).stop 2023-08-17T18:12:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe405a2f700 1 -- 172.21.15.78:0/667937170 shutdown_connections 2023-08-17T18:12:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe405a2f700 1 --2- 172.21.15.78:0/667937170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe400154140 0x7fe4000c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe405a2f700 1 --2- 172.21.15.78:0/667937170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 0x7fe4000c0900 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe405a2f700 1 -- 172.21.15.78:0/667937170 >> 172.21.15.78:0/667937170 conn(0x7fe400094510 msgr2=0x7fe40006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe405a2f700 1 -- 172.21.15.78:0/667937170 shutdown_connections 2023-08-17T18:12:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.029+0000 7fe405a2f700 1 -- 172.21.15.78:0/667937170 wait complete. 2023-08-17T18:12:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.030+0000 7fe405a2f700 1 Processor -- start 2023-08-17T18:12:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.031+0000 7fe405a2f700 1 -- start start 2023-08-17T18:12:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.031+0000 7fe405a2f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 0x7fe4000afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.031+0000 7fe405a2f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4000a8080 0x7fe4001646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.031+0000 7fe405a2f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe400154140 0x7fe400164ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.031+0000 7fe405a2f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe400165090 con 0x7fe4000a7c40 2023-08-17T18:12:06.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.031+0000 7fe405a2f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000aeb80 con 0x7fe400154140 2023-08-17T18:12:06.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.031+0000 7fe405a2f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000adf70 con 0x7fe4000a8080 2023-08-17T18:12:06.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.031+0000 7fe3feffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 0x7fe4000afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3feffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 0x7fe4000afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60080/0 (socket says 172.21.15.78:60080) 2023-08-17T18:12:06.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3feffd700 1 -- 172.21.15.78:0/22026201 learned_addr learned my addr 172.21.15.78:0/22026201 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:06.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3ff7fe700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe400154140 0x7fe400164ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3fe7fc700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4000a8080 0x7fe4001646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3feffd700 1 -- 172.21.15.78:0/22026201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4000a8080 msgr2=0x7fe4001646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3feffd700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4000a8080 0x7fe4001646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3feffd700 1 -- 172.21.15.78:0/22026201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe400154140 msgr2=0x7fe400164ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3feffd700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe400154140 0x7fe400164ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3feffd700 1 -- 172.21.15.78:0/22026201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f00092a0 con 0x7fe4000a7c40 2023-08-17T18:12:06.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3feffd700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 0x7fe4000afa00 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fe3f400d860 tx=0x7fe3f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:06.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3e6ffd700 1 -- 172.21.15.78:0/22026201 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400f520 con 0x7fe4000a7c40 2023-08-17T18:12:06.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3e6ffd700 1 -- 172.21.15.78:0/22026201 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f400f680 con 0x7fe4000a7c40 2023-08-17T18:12:06.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe3e6ffd700 1 -- 172.21.15.78:0/22026201 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400fa00 con 0x7fe4000a7c40 2023-08-17T18:12:06.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe405a2f700 1 -- 172.21.15.78:0/22026201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4000ae250 con 0x7fe4000a7c40 2023-08-17T18:12:06.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.032+0000 7fe405a2f700 1 -- 172.21.15.78:0/22026201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4000ae810 con 0x7fe4000a7c40 2023-08-17T18:12:06.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.033+0000 7fe405a2f700 1 -- 172.21.15.78:0/22026201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4000aee60 con 0x7fe4000a7c40 2023-08-17T18:12:06.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.034+0000 7fe3e6ffd700 1 -- 172.21.15.78:0/22026201 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fe3f401a030 con 0x7fe4000a7c40 2023-08-17T18:12:06.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.034+0000 7fe3e6ffd700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe3ec05eeb0 0x7fe3ec061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.034+0000 7fe3e6ffd700 1 -- 172.21.15.78:0/22026201 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe3f4079860 con 0x7fe4000a7c40 2023-08-17T18:12:06.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.034+0000 7fe3fe7fc700 1 -- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe3ec05eeb0 msgr2=0x7fe3ec061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:06.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.034+0000 7fe3fe7fc700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe3ec05eeb0 0x7fe3ec061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:06.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.038+0000 7fe3e6ffd700 1 -- 172.21.15.78:0/22026201 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3f404abf0 con 0x7fe4000a7c40 2023-08-17T18:12:06.134 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:06.134+0000 7f605145d680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:12:06.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.235+0000 7fe3fe7fc700 1 -- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe3ec05eeb0 msgr2=0x7fe3ec061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:06.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.235+0000 7fe3fe7fc700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe3ec05eeb0 0x7fe3ec061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:06.258 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:06.258+0000 7f6ca17a0680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:12:06.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.278+0000 7fe405a2f700 1 -- 172.21.15.78:0/22026201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe400047350 con 0x7fe4000a7c40 2023-08-17T18:12:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.278+0000 7fe3e6ffd700 1 -- 172.21.15.78:0/22026201 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4487 (secure 0 0 0) 0x7fe3f404e210 con 0x7fe4000a7c40 2023-08-17T18:12:06.278 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:06.278 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1301951105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1301951105},{"type":"v1","addr":"172.21.15.150:6834","nonce":1301951105}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3263459818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3263459818},{"type":"v1","addr":"172.21.15.78:6836","nonce":3263459818}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4038964498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4038964498},{"type":"v1","addr":"172.21.15.78:6837","nonce":4038964498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:10:35.123034+0000","modified":"2023-08-17T18:10:37.129045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/607383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":607383},{"type":"v1","addr":"172.21.15.150:6835","nonce":607383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T18:12:06.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 -- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe3ec05eeb0 msgr2=0x7fe3ec061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:06.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe3ec05eeb0 0x7fe3ec061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:06.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 -- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 msgr2=0x7fe4000afa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 0x7fe4000afa00 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fe3f400d860 tx=0x7fe3f4008040).stop 2023-08-17T18:12:06.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 -- 172.21.15.78:0/22026201 shutdown_connections 2023-08-17T18:12:06.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe3ec05eeb0 0x7fe3ec061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:06.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe400154140 0x7fe400164ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4000a7c40 0x7fe4000afa00 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 --2- 172.21.15.78:0/22026201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4000a8080 0x7fe4001646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 -- 172.21.15.78:0/22026201 >> 172.21.15.78:0/22026201 conn(0x7fe400094510 msgr2=0x7fe4000648e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:06.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 -- 172.21.15.78:0/22026201 shutdown_connections 2023-08-17T18:12:06.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.280+0000 7fe405a2f700 1 -- 172.21.15.78:0/22026201 wait complete. 2023-08-17T18:12:06.282 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 61 2023-08-17T18:12:06.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:06.321 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:06.321+0000 7f605145d680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:06.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.412+0000 7f755f24e700 1 Processor -- start 2023-08-17T18:12:06.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.413+0000 7f755f24e700 1 -- start start 2023-08-17T18:12:06.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.413+0000 7f755f24e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 0x7f7558152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.413+0000 7f755f24e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f75580a7c90 0x7f75580c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.413+0000 7f755f24e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75580bf210 con 0x7f75580be4d0 2023-08-17T18:12:06.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.413+0000 7f755f24e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75580c5a80 con 0x7f75580a7c90 2023-08-17T18:12:06.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.413+0000 7f755f24e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75580c5450 con 0x7f7558151e40 2023-08-17T18:12:06.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f755cfea700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 0x7f7558152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f7557fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f75580a7c90 0x7f75580c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f755d7eb700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f75580be4d0 0x7f75580c3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:46352/0 (socket says 172.21.15.78:46352) 2023-08-17T18:12:06.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f755d7eb700 1 -- 172.21.15.78:0/3563943019 learned_addr learned my addr 172.21.15.78:0/3563943019 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:06.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f755cfea700 1 -- 172.21.15.78:0/3563943019 >> v2:172.21.15.150:3300/0 conn(0x7f75580a7c90 msgr2=0x7f75580c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:06.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f755cfea700 1 --2- 172.21.15.78:0/3563943019 >> v2:172.21.15.150:3300/0 conn(0x7f75580a7c90 0x7f75580c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f755cfea700 1 -- 172.21.15.78:0/3563943019 >> v1:172.21.15.150:6789/0 conn(0x7f75580be4d0 legacy=0x7f75580c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f755cfea700 1 -- 172.21.15.78:0/3563943019 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75581533f0 con 0x7f7558151e40 2023-08-17T18:12:06.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f75577fe700 1 -- 172.21.15.78:0/3563943019 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519831899 0 0) 0x7f75580bf210 con 0x7f75580be4d0 2023-08-17T18:12:06.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f7557fff700 1 --2- 172.21.15.78:0/3563943019 >> v2:172.21.15.150:3300/0 conn(0x7f75580a7c90 0x7f75580c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f755cfea700 1 --2- 172.21.15.78:0/3563943019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 0x7f7558152f00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f754c009760 tx=0x7f754c009060).ready entity=mon.2 client_cookie=68b3c63e426abb90 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f75577fe700 1 -- 172.21.15.78:0/3563943019 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00f510 con 0x7f7558151e40 2023-08-17T18:12:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f75577fe700 1 -- 172.21.15.78:0/3563943019 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00f670 con 0x7f7558151e40 2023-08-17T18:12:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.414+0000 7f75577fe700 1 -- 172.21.15.78:0/3563943019 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00f9f0 con 0x7f7558151e40 2023-08-17T18:12:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.415+0000 7f755f24e700 1 -- 172.21.15.78:0/3563943019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 msgr2=0x7f7558152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.415+0000 7f755f24e700 1 --2- 172.21.15.78:0/3563943019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 0x7f7558152f00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f754c009760 tx=0x7f754c009060).stop 2023-08-17T18:12:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.415+0000 7f755f24e700 1 -- 172.21.15.78:0/3563943019 shutdown_connections 2023-08-17T18:12:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.415+0000 7f755f24e700 1 --2- 172.21.15.78:0/3563943019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 0x7f7558152f00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.415+0000 7f755f24e700 1 --2- 172.21.15.78:0/3563943019 >> v2:172.21.15.150:3300/0 conn(0x7f75580a7c90 0x7f75580c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.415+0000 7f755f24e700 1 -- 172.21.15.78:0/3563943019 >> 172.21.15.78:0/3563943019 conn(0x7f7558092330 msgr2=0x7f7558062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.415+0000 7f755f24e700 1 -- 172.21.15.78:0/3563943019 shutdown_connections 2023-08-17T18:12:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.415+0000 7f755f24e700 1 -- 172.21.15.78:0/3563943019 wait complete. 2023-08-17T18:12:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.416+0000 7f755f24e700 1 Processor -- start 2023-08-17T18:12:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755f24e700 1 -- start start 2023-08-17T18:12:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755f24e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75580a7c90 0x7f75580c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755f24e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75580be4d0 0x7f755814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755f24e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 0x7f75580a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755f24e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75580c7d80 con 0x7f75580a7c90 2023-08-17T18:12:06.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755f24e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75580c8060 con 0x7f75580be4d0 2023-08-17T18:12:06.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755f24e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75580c8340 con 0x7f7558151e40 2023-08-17T18:12:06.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755cfea700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75580a7c90 0x7f75580c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755cfea700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75580a7c90 0x7f75580c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60090/0 (socket says 172.21.15.78:60090) 2023-08-17T18:12:06.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755cfea700 1 -- 172.21.15.78:0/191062824 learned_addr learned my addr 172.21.15.78:0/191062824 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:06.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f755d7eb700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 0x7f75580a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.417+0000 7f7557fff700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75580be4d0 0x7f755814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f755cfea700 1 -- 172.21.15.78:0/191062824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 msgr2=0x7f75580a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f755cfea700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 0x7f75580a6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f755cfea700 1 -- 172.21.15.78:0/191062824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75580be4d0 msgr2=0x7f755814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f755cfea700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75580be4d0 0x7f755814b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f755cfea700 1 -- 172.21.15.78:0/191062824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75440092a0 con 0x7f75580a7c90 2023-08-17T18:12:06.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f755cfea700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75580a7c90 0x7f75580c77e0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f754c009e00 tx=0x7f754c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:06.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f7554ff9700 1 -- 172.21.15.78:0/191062824 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00f7e0 con 0x7f75580a7c90 2023-08-17T18:12:06.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f7554ff9700 1 -- 172.21.15.78:0/191062824 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00f940 con 0x7f75580a7c90 2023-08-17T18:12:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f755f24e700 1 -- 172.21.15.78:0/191062824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c0092a0 con 0x7f75580a7c90 2023-08-17T18:12:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f7554ff9700 1 -- 172.21.15.78:0/191062824 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c01b660 con 0x7f75580a7c90 2023-08-17T18:12:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.418+0000 7f755f24e700 1 -- 172.21.15.78:0/191062824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75580c8620 con 0x7f75580a7c90 2023-08-17T18:12:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.419+0000 7f755f24e700 1 -- 172.21.15.78:0/191062824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7558047350 con 0x7f75580a7c90 2023-08-17T18:12:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.420+0000 7f7554ff9700 1 -- 172.21.15.78:0/191062824 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f754c00f070 con 0x7f75580a7c90 2023-08-17T18:12:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.420+0000 7f7554ff9700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f753c05eeb0 0x7f753c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.420+0000 7f7557fff700 1 -- 172.21.15.78:0/191062824 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f753c05eeb0 msgr2=0x7f753c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:06.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.420+0000 7f7554ff9700 1 -- 172.21.15.78:0/191062824 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f754c07afc0 con 0x7f75580a7c90 2023-08-17T18:12:06.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.420+0000 7f7557fff700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f753c05eeb0 0x7f753c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:06.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.430+0000 7f7554ff9700 1 -- 172.21.15.78:0/191062824 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f754c04c450 con 0x7f75580a7c90 2023-08-17T18:12:06.453 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:06.453+0000 7f6ca17a0680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.605+0000 7f755f24e700 1 -- 172.21.15.78:0/191062824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75580a8190 con 0x7f75580a7c90 2023-08-17T18:12:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.606+0000 7f7554ff9700 1 -- 172.21.15.78:0/191062824 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+17493 (secure 0 0 0) 0x7f754c01f020 con 0x7f75580a7c90 2023-08-17T18:12:06.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:06.606 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":172,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:05.701849+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:10:33.660535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T18:10:34.093770+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":172,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.22","mappings":[{"from":4,"to":3}]},{"pgid":"22.23","mappings":[{"from":3,"to":0}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6833/158925":"2023-08-18T18:10:46.159099+0000","172.21.15.78:6832/158925":"2023-08-18T18:10:46.159099+0000","172.21.15.78:0/1117008278":"2023-08-18T18:10:46.159099+0000","172.21.15.78:0/3007657595":"2023-08-18T18:10:46.159099+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:06.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 -- 172.21.15.78:0/191062824 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f753c05eeb0 msgr2=0x7f753c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:06.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f753c05eeb0 0x7f753c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 -- 172.21.15.78:0/191062824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75580a7c90 msgr2=0x7f75580c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75580a7c90 0x7f75580c77e0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f754c009e00 tx=0x7f754c017000).stop 2023-08-17T18:12:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 -- 172.21.15.78:0/191062824 shutdown_connections 2023-08-17T18:12:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f753c05eeb0 0x7f753c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7558151e40 0x7f75580a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75580a7c90 0x7f75580c77e0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 --2- 172.21.15.78:0/191062824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75580be4d0 0x7f755814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 -- 172.21.15.78:0/191062824 >> 172.21.15.78:0/191062824 conn(0x7f7558092330 msgr2=0x7f75580a5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 -- 172.21.15.78:0/191062824 shutdown_connections 2023-08-17T18:12:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.608+0000 7f755f24e700 1 -- 172.21.15.78:0/191062824 wait complete. 2023-08-17T18:12:06.621 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T18:12:06.621 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:06.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.748+0000 7fa165804700 1 Processor -- start 2023-08-17T18:12:06.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.748+0000 7fa165804700 1 -- start start 2023-08-17T18:12:06.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.749+0000 7fa165804700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa160154040 0x7fa160069a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.749+0000 7fa165804700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 0x7fa1600c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.749+0000 7fa165804700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600695b0 con 0x7fa1600be5c0 2023-08-17T18:12:06.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.749+0000 7fa165804700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1600c5860 con 0x7fa160154040 2023-08-17T18:12:06.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.749+0000 7fa165804700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600c5b40 con 0x7fa160062c00 2023-08-17T18:12:06.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.749+0000 7fa15e7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa1600be5c0 0x7fa1600624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38986/0 (socket says 172.21.15.78:38986) 2023-08-17T18:12:06.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.749+0000 7fa15e7fc700 1 -- 172.21.15.78:0/2619053406 learned_addr learned my addr 172.21.15.78:0/2619053406 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:06.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.749+0000 7fa15effd700 1 --2- 172.21.15.78:0/2619053406 >> v2:172.21.15.150:3300/0 conn(0x7fa160154040 0x7fa160069a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.749+0000 7fa15f7fe700 1 --2- 172.21.15.78:0/2619053406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 0x7fa1600c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15dffb700 1 -- 172.21.15.78:0/2619053406 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452186855 0 0) 0x7fa1600695b0 con 0x7fa1600be5c0 2023-08-17T18:12:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15dffb700 1 -- 172.21.15.78:0/2619053406 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa14c0033f0 con 0x7fa1600be5c0 2023-08-17T18:12:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15effd700 1 -- 172.21.15.78:0/2619053406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 msgr2=0x7fa1600c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15effd700 1 --2- 172.21.15.78:0/2619053406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 0x7fa1600c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15effd700 1 -- 172.21.15.78:0/2619053406 >> v1:172.21.15.78:6789/0 conn(0x7fa1600be5c0 legacy=0x7fa1600624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15effd700 1 -- 172.21.15.78:0/2619053406 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa160068f60 con 0x7fa160154040 2023-08-17T18:12:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15f7fe700 1 --2- 172.21.15.78:0/2619053406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 0x7fa1600c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15effd700 1 --2- 172.21.15.78:0/2619053406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa160154040 0x7fa160069a40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fa150009760 tx=0x7fa150009060).ready entity=mon.1 client_cookie=c1fce05cf9ebc95b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15dffb700 1 -- 172.21.15.78:0/2619053406 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000d4a0 con 0x7fa160154040 2023-08-17T18:12:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15dffb700 1 -- 172.21.15.78:0/2619053406 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15000d600 con 0x7fa160154040 2023-08-17T18:12:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.750+0000 7fa15dffb700 1 -- 172.21.15.78:0/2619053406 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000d980 con 0x7fa160154040 2023-08-17T18:12:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.751+0000 7fa165804700 1 -- 172.21.15.78:0/2619053406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa160154040 msgr2=0x7fa160069a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.751+0000 7fa165804700 1 --2- 172.21.15.78:0/2619053406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa160154040 0x7fa160069a40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fa150009760 tx=0x7fa150009060).stop 2023-08-17T18:12:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.751+0000 7fa165804700 1 -- 172.21.15.78:0/2619053406 shutdown_connections 2023-08-17T18:12:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.751+0000 7fa165804700 1 --2- 172.21.15.78:0/2619053406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 0x7fa1600c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.751+0000 7fa165804700 1 --2- 172.21.15.78:0/2619053406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa160154040 0x7fa160069a40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.751+0000 7fa165804700 1 -- 172.21.15.78:0/2619053406 >> 172.21.15.78:0/2619053406 conn(0x7fa1600640d0 msgr2=0x7fa1600c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.751+0000 7fa165804700 1 -- 172.21.15.78:0/2619053406 shutdown_connections 2023-08-17T18:12:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.751+0000 7fa165804700 1 -- 172.21.15.78:0/2619053406 wait complete. 2023-08-17T18:12:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.752+0000 7fa165804700 1 Processor -- start 2023-08-17T18:12:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.752+0000 7fa165804700 1 -- start start 2023-08-17T18:12:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa165804700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 0x7fa1600a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa165804700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1600be5c0 0x7fa1600a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa165804700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa160154040 0x7fa1600a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa165804700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600a8b10 con 0x7fa160154040 2023-08-17T18:12:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa165804700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160150260 con 0x7fa1600be5c0 2023-08-17T18:12:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa165804700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600a7f00 con 0x7fa160062c00 2023-08-17T18:12:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa160154040 0x7fa1600a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa160154040 0x7fa1600a76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60096/0 (socket says 172.21.15.78:60096) 2023-08-17T18:12:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15f7fe700 1 -- 172.21.15.78:0/853392644 learned_addr learned my addr 172.21.15.78:0/853392644 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:06.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15effd700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 0x7fa1600a8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15e7fc700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1600be5c0 0x7fa1600a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:06.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15f7fe700 1 -- 172.21.15.78:0/853392644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 msgr2=0x7fa1600a8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15f7fe700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 0x7fa1600a8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15f7fe700 1 -- 172.21.15.78:0/853392644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1600be5c0 msgr2=0x7fa1600a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15f7fe700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1600be5c0 0x7fa1600a71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15f7fe700 1 -- 172.21.15.78:0/853392644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa158009a20 con 0x7fa160154040 2023-08-17T18:12:06.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa15f7fe700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa160154040 0x7fa1600a76c0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7fa158009f90 tx=0x7fa15800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:06.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.753+0000 7fa156ffd700 1 -- 172.21.15.78:0/853392644 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800cd30 con 0x7fa160154040 2023-08-17T18:12:06.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.754+0000 7fa156ffd700 1 -- 172.21.15.78:0/853392644 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15800f040 con 0x7fa160154040 2023-08-17T18:12:06.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.754+0000 7fa165804700 1 -- 172.21.15.78:0/853392644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1500092a0 con 0x7fa160154040 2023-08-17T18:12:06.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.754+0000 7fa156ffd700 1 -- 172.21.15.78:0/853392644 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158013610 con 0x7fa160154040 2023-08-17T18:12:06.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.754+0000 7fa165804700 1 -- 172.21.15.78:0/853392644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1600a84c0 con 0x7fa160154040 2023-08-17T18:12:06.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.755+0000 7fa165804700 1 -- 172.21.15.78:0/853392644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1600a8c80 con 0x7fa160154040 2023-08-17T18:12:06.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.755+0000 7fa156ffd700 1 -- 172.21.15.78:0/853392644 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fa158013980 con 0x7fa160154040 2023-08-17T18:12:06.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.755+0000 7fa156ffd700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa14005eeb0 0x7fa140061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:06.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.755+0000 7fa15effd700 1 -- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa14005eeb0 msgr2=0x7fa140061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:06.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.755+0000 7fa156ffd700 1 -- 172.21.15.78:0/853392644 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fa15807a940 con 0x7fa160154040 2023-08-17T18:12:06.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.755+0000 7fa15effd700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa14005eeb0 0x7fa140061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:06.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.760+0000 7fa156ffd700 1 -- 172.21.15.78:0/853392644 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa15804bd20 con 0x7fa160154040 2023-08-17T18:12:06.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.956+0000 7fa15effd700 1 -- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa14005eeb0 msgr2=0x7fa140061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:06.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.956+0000 7fa15effd700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa14005eeb0 0x7fa140061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:06.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.970+0000 7fa165804700 1 -- 172.21.15.78:0/853392644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa160046af0 con 0x7fa160154040 2023-08-17T18:12:06.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.971+0000 7fa156ffd700 1 -- 172.21.15.78:0/853392644 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4487 (secure 0 0 0) 0x7fa15804f340 con 0x7fa160154040 2023-08-17T18:12:06.971 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:06.971 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1301951105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1301951105},{"type":"v1","addr":"172.21.15.150:6834","nonce":1301951105}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3263459818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3263459818},{"type":"v1","addr":"172.21.15.78:6836","nonce":3263459818}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4038964498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4038964498},{"type":"v1","addr":"172.21.15.78:6837","nonce":4038964498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:10:35.123034+0000","modified":"2023-08-17T18:10:37.129045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/607383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":607383},{"type":"v1","addr":"172.21.15.150:6835","nonce":607383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T18:12:06.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 -- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa14005eeb0 msgr2=0x7fa140061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:06.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa14005eeb0 0x7fa140061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:06.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 -- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa160154040 msgr2=0x7fa1600a76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:06.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa160154040 0x7fa1600a76c0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7fa158009f90 tx=0x7fa15800b040).stop 2023-08-17T18:12:06.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 -- 172.21.15.78:0/853392644 shutdown_connections 2023-08-17T18:12:06.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa14005eeb0 0x7fa140061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:06.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa160154040 0x7fa1600a76c0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa160062c00 0x7fa1600a8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 --2- 172.21.15.78:0/853392644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1600be5c0 0x7fa1600a71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:06.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 -- 172.21.15.78:0/853392644 >> 172.21.15.78:0/853392644 conn(0x7fa1600640d0 msgr2=0x7fa1600a4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:06.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 -- 172.21.15.78:0/853392644 shutdown_connections 2023-08-17T18:12:06.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:06.973+0000 7fa165804700 1 -- 172.21.15.78:0/853392644 wait complete. 2023-08-17T18:12:06.975 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 61 2023-08-17T18:12:06.981 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:06.981+0000 7f605145d680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:12:06.985 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:07.049 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:07.049+0000 7f605145d680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:12:07.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.105+0000 7f2390f8a700 1 Processor -- start 2023-08-17T18:12:07.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.105+0000 7f2390f8a700 1 -- start start 2023-08-17T18:12:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.106+0000 7f2390f8a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 0x7f238c0628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.106+0000 7f2390f8a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f238c062dc0 0x7f238c0c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.106+0000 7f2390f8a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c0c3580 con 0x7f238c0c2070 2023-08-17T18:12:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.106+0000 7f2390f8a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c0c3a10 con 0x7f238c062dc0 2023-08-17T18:12:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.106+0000 7f2390f8a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0c2970 con 0x7f238c0624f0 2023-08-17T18:12:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.106+0000 7f2389d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f238c062dc0 0x7f238c0c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.106+0000 7f2389d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f238c062dc0 0x7f238c0c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60106/0 (socket says 172.21.15.78:60106) 2023-08-17T18:12:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.106+0000 7f2389d9b700 1 -- 172.21.15.78:0/1982455944 learned_addr learned my addr 172.21.15.78:0/1982455944 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.106+0000 7f238a59c700 1 --2- 172.21.15.78:0/1982455944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 0x7f238c0628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.107+0000 7f2389d9b700 1 -- 172.21.15.78:0/1982455944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 msgr2=0x7f238c0628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.107+0000 7f2389d9b700 1 --2- 172.21.15.78:0/1982455944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 0x7f238c0628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.107+0000 7f2389d9b700 1 -- 172.21.15.78:0/1982455944 >> v1:172.21.15.150:6789/0 conn(0x7f238c0c2070 legacy=0x7f238c0bc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.107+0000 7f238959a700 1 -- 172.21.15.78:0/1982455944 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981699982 0 0) 0x7f238c0c3580 con 0x7f238c0c2070 2023-08-17T18:12:07.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.107+0000 7f2389d9b700 1 -- 172.21.15.78:0/1982455944 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0c2c50 con 0x7f238c062dc0 2023-08-17T18:12:07.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.107+0000 7f2389d9b700 1 --2- 172.21.15.78:0/1982455944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 0x7f238c0c1b80 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f237c00bac0 tx=0x7f237c00b370).ready entity=mon.0 client_cookie=e523119c2e29a844 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:07.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.107+0000 7f238959a700 1 -- 172.21.15.78:0/1982455944 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00db70 con 0x7f238c062dc0 2023-08-17T18:12:07.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.107+0000 7f238959a700 1 -- 172.21.15.78:0/1982455944 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c00dcd0 con 0x7f238c062dc0 2023-08-17T18:12:07.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.107+0000 7f238959a700 1 -- 172.21.15.78:0/1982455944 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c015600 con 0x7f238c062dc0 2023-08-17T18:12:07.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.108+0000 7f2390f8a700 1 -- 172.21.15.78:0/1982455944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 msgr2=0x7f238c0c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.108+0000 7f2390f8a700 1 --2- 172.21.15.78:0/1982455944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 0x7f238c0c1b80 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f237c00bac0 tx=0x7f237c00b370).stop 2023-08-17T18:12:07.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.108+0000 7f2390f8a700 1 -- 172.21.15.78:0/1982455944 shutdown_connections 2023-08-17T18:12:07.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.108+0000 7f2390f8a700 1 --2- 172.21.15.78:0/1982455944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 0x7f238c0628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.108+0000 7f2390f8a700 1 --2- 172.21.15.78:0/1982455944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 0x7f238c0c1b80 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.108+0000 7f2390f8a700 1 -- 172.21.15.78:0/1982455944 >> 172.21.15.78:0/1982455944 conn(0x7f238c0c3d40 msgr2=0x7f238c0c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:07.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.108+0000 7f2390f8a700 1 -- 172.21.15.78:0/1982455944 shutdown_connections 2023-08-17T18:12:07.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.108+0000 7f2390f8a700 1 -- 172.21.15.78:0/1982455944 wait complete. 2023-08-17T18:12:07.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.109+0000 7f2390f8a700 1 Processor -- start 2023-08-17T18:12:07.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.109+0000 7f2390f8a700 1 -- start start 2023-08-17T18:12:07.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2390f8a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 0x7f238c0acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2390f8a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 0x7f238c0aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2390f8a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f238c0c2070 0x7f238c0aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2390f8a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0ad280 con 0x7f238c062dc0 2023-08-17T18:12:07.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2390f8a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0c0c20 con 0x7f238c0c2070 2023-08-17T18:12:07.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2390f8a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c152210 con 0x7f238c0624f0 2023-08-17T18:12:07.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2389d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 0x7f238c0aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f238a59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 0x7f238c0acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2389d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 0x7f238c0aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60108/0 (socket says 172.21.15.78:60108) 2023-08-17T18:12:07.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2389d9b700 1 -- 172.21.15.78:0/1818582333 learned_addr learned my addr 172.21.15.78:0/1818582333 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:07.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f238ad9d700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f238c0c2070 0x7f238c0aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f238a59c700 1 -- 172.21.15.78:0/1818582333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f238c0c2070 msgr2=0x7f238c0aa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f238a59c700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f238c0c2070 0x7f238c0aa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f238a59c700 1 -- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 msgr2=0x7f238c0aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f238a59c700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 0x7f238c0aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f238a59c700 1 -- 172.21.15.78:0/1818582333 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c00b6a0 con 0x7f238c0624f0 2023-08-17T18:12:07.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2389d9b700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 0x7f238c0aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:07.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f238a59c700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 0x7f238c0acd90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f237400e6d0 tx=0x7f2374009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:07.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f23827fc700 1 -- 172.21.15.78:0/1818582333 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374012600 con 0x7f238c0624f0 2023-08-17T18:12:07.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f23827fc700 1 -- 172.21.15.78:0/1818582333 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374012760 con 0x7f238c0624f0 2023-08-17T18:12:07.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2390f8a700 1 -- 172.21.15.78:0/1818582333 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c1524f0 con 0x7f238c0624f0 2023-08-17T18:12:07.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f23827fc700 1 -- 172.21.15.78:0/1818582333 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374012ae0 con 0x7f238c0624f0 2023-08-17T18:12:07.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.110+0000 7f2390f8a700 1 -- 172.21.15.78:0/1818582333 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c151e70 con 0x7f238c0624f0 2023-08-17T18:12:07.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.111+0000 7f2390f8a700 1 -- 172.21.15.78:0/1818582333 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c047350 con 0x7f238c0624f0 2023-08-17T18:12:07.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.112+0000 7f23827fc700 1 -- 172.21.15.78:0/1818582333 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f2374022070 con 0x7f238c0624f0 2023-08-17T18:12:07.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.112+0000 7f23827fc700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f236c05eeb0 0x7f236c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.112+0000 7f2389d9b700 1 -- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f236c05eeb0 msgr2=0x7f236c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:07.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.112+0000 7f23827fc700 1 -- 172.21.15.78:0/1818582333 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f2374079e90 con 0x7f238c0624f0 2023-08-17T18:12:07.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.112+0000 7f2389d9b700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f236c05eeb0 0x7f236c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:07.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.117+0000 7f23827fc700 1 -- 172.21.15.78:0/1818582333 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f237404b270 con 0x7f238c0624f0 2023-08-17T18:12:07.126 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:07.126+0000 7f605145d680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:12:07.151 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:07.151+0000 7f6ca17a0680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:12:07.223 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:07.223+0000 7f6ca17a0680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:12:07.273 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:07.272+0000 7f605145d680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:12:07.301 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:07.302+0000 7f6ca17a0680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:12:07.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.313+0000 7f2389d9b700 1 -- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f236c05eeb0 msgr2=0x7f236c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:07.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.313+0000 7f2389d9b700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f236c05eeb0 0x7f236c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:07.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.331+0000 7f2390f8a700 1 -- 172.21.15.78:0/1818582333 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f238c0c2f30 con 0x7f238c0624f0 2023-08-17T18:12:07.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.332+0000 7f23827fc700 1 -- 172.21.15.78:0/1818582333 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f2374016020 con 0x7f238c0624f0 2023-08-17T18:12:07.332 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:07.332 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1301951105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1301951105},{"type":"v1","addr":"172.21.15.150:6834","nonce":1301951105}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3263459818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3263459818},{"type":"v1","addr":"172.21.15.78:6836","nonce":3263459818}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4038964498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4038964498},{"type":"v1","addr":"172.21.15.78:6837","nonce":4038964498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:10:35.123034+0000","modified":"2023-08-17T18:10:37.129045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"b","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/607383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":607383},{"type":"v1","addr":"172.21.15.150:6835","nonce":607383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T18:12:07.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 -- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f236c05eeb0 msgr2=0x7f236c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:07.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f236c05eeb0 0x7f236c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:07.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 -- 172.21.15.78:0/1818582333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 msgr2=0x7f238c0acd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 0x7f238c0acd90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f237400e6d0 tx=0x7f2374009060).stop 2023-08-17T18:12:07.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 -- 172.21.15.78:0/1818582333 shutdown_connections 2023-08-17T18:12:07.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f236c05eeb0 0x7f236c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:07.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f238c0c2070 0x7f238c0aa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238c0624f0 0x7f238c0acd90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 --2- 172.21.15.78:0/1818582333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238c062dc0 0x7f238c0aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 -- 172.21.15.78:0/1818582333 >> 172.21.15.78:0/1818582333 conn(0x7f238c0c3d40 msgr2=0x7f238c0c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 -- 172.21.15.78:0/1818582333 shutdown_connections 2023-08-17T18:12:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.334+0000 7f2390f8a700 1 -- 172.21.15.78:0/1818582333 wait complete. 2023-08-17T18:12:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 61 2023-08-17T18:12:07.344 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:07.344+0000 7f605145d680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:12:07.346 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:07.459 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:07.459+0000 7f605145d680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:12:07.459 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:07.460+0000 7f6ca17a0680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:12:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.462+0000 7ff53d8ed700 1 Processor -- start 2023-08-17T18:12:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.462+0000 7ff53d8ed700 1 -- start start 2023-08-17T18:12:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff53d8ed700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5380c6ee0 0x7ff5380c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff53d8ed700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5380c0df0 0x7ff5380ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff53d8ed700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5380a8350 con 0x7ff538154140 2023-08-17T18:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff53d8ed700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5380c7320 con 0x7ff5380c0df0 2023-08-17T18:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff53d8ed700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380c1280 con 0x7ff5380c6ee0 2023-08-17T18:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff5377fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5380c0df0 0x7ff5380ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff5377fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5380c0df0 0x7ff5380ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60110/0 (socket says 172.21.15.78:60110) 2023-08-17T18:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff5377fe700 1 -- 172.21.15.78:0/2733875709 learned_addr learned my addr 172.21.15.78:0/2733875709 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff5367fc700 1 --2- 172.21.15.78:0/2733875709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5380c6ee0 0x7ff5380c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff5377fe700 1 -- 172.21.15.78:0/2733875709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5380c6ee0 msgr2=0x7ff5380c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff5377fe700 1 --2- 172.21.15.78:0/2733875709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5380c6ee0 0x7ff5380c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff5377fe700 1 -- 172.21.15.78:0/2733875709 >> v1:172.21.15.150:6789/0 conn(0x7ff538154140 legacy=0x7ff5380a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff5377fe700 1 -- 172.21.15.78:0/2733875709 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff538154520 con 0x7ff5380c0df0 2023-08-17T18:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff5377fe700 1 --2- 172.21.15.78:0/2733875709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c0df0 0x7ff5380ca280 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7ff530009f20 tx=0x7ff530009840).ready entity=mon.0 client_cookie=f3860c93fd332ab6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.463+0000 7ff535ffb700 1 -- 172.21.15.78:0/2733875709 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53000e070 con 0x7ff5380c0df0 2023-08-17T18:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.464+0000 7ff535ffb700 1 -- 172.21.15.78:0/2733875709 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53000b9d0 con 0x7ff5380c0df0 2023-08-17T18:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.464+0000 7ff535ffb700 1 -- 172.21.15.78:0/2733875709 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53000bd50 con 0x7ff5380c0df0 2023-08-17T18:12:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.464+0000 7ff53d8ed700 1 -- 172.21.15.78:0/2733875709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c0df0 msgr2=0x7ff5380ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.464+0000 7ff53d8ed700 1 --2- 172.21.15.78:0/2733875709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c0df0 0x7ff5380ca280 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7ff530009f20 tx=0x7ff530009840).stop 2023-08-17T18:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.464+0000 7ff53d8ed700 1 -- 172.21.15.78:0/2733875709 shutdown_connections 2023-08-17T18:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.464+0000 7ff53d8ed700 1 --2- 172.21.15.78:0/2733875709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c0df0 0x7ff5380ca280 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.464+0000 7ff53d8ed700 1 --2- 172.21.15.78:0/2733875709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5380c6ee0 0x7ff5380c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.464+0000 7ff53d8ed700 1 -- 172.21.15.78:0/2733875709 >> 172.21.15.78:0/2733875709 conn(0x7ff538094510 msgr2=0x7ff53806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.464+0000 7ff53d8ed700 1 -- 172.21.15.78:0/2733875709 shutdown_connections 2023-08-17T18:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.464+0000 7ff53d8ed700 1 -- 172.21.15.78:0/2733875709 wait complete. 2023-08-17T18:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.465+0000 7ff53d8ed700 1 Processor -- start 2023-08-17T18:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.465+0000 7ff53d8ed700 1 -- start start 2023-08-17T18:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff53d8ed700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5380c0df0 0x7ff5380afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff53d8ed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c6ee0 0x7ff53814f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff53d8ed700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff538154140 0x7ff53814cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff53d8ed700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53814f7a0 con 0x7ff5380c6ee0 2023-08-17T18:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff53d8ed700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380a9b30 con 0x7ff5380c0df0 2023-08-17T18:12:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff53d8ed700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5381505c0 con 0x7ff538154140 2023-08-17T18:12:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff5367fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c6ee0 0x7ff53814f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff5367fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c6ee0 0x7ff53814f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60120/0 (socket says 172.21.15.78:60120) 2023-08-17T18:12:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff536ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5380c0df0 0x7ff5380afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff5367fc700 1 -- 172.21.15.78:0/3448944783 learned_addr learned my addr 172.21.15.78:0/3448944783 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.466+0000 7ff5377fe700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff538154140 0x7ff53814cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff5367fc700 1 -- 172.21.15.78:0/3448944783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff538154140 msgr2=0x7ff53814cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff5367fc700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff538154140 0x7ff53814cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff5367fc700 1 -- 172.21.15.78:0/3448944783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5380c0df0 msgr2=0x7ff5380afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff5367fc700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5380c0df0 0x7ff5380afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff5367fc700 1 -- 172.21.15.78:0/3448944783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff530009ae0 con 0x7ff5380c6ee0 2023-08-17T18:12:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff5377fe700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff538154140 0x7ff53814cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff5367fc700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c6ee0 0x7ff53814f2b0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7ff52800e950 tx=0x7ff528009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff51effd700 1 -- 172.21.15.78:0/3448944783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528009530 con 0x7ff5380c6ee0 2023-08-17T18:12:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff51effd700 1 -- 172.21.15.78:0/3448944783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff528012600 con 0x7ff5380c6ee0 2023-08-17T18:12:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff53d8ed700 1 -- 172.21.15.78:0/3448944783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53814d020 con 0x7ff5380c6ee0 2023-08-17T18:12:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff51effd700 1 -- 172.21.15.78:0/3448944783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528012980 con 0x7ff5380c6ee0 2023-08-17T18:12:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.467+0000 7ff53d8ed700 1 -- 172.21.15.78:0/3448944783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53814fc90 con 0x7ff5380c6ee0 2023-08-17T18:12:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.468+0000 7ff53d8ed700 1 -- 172.21.15.78:0/3448944783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff538047350 con 0x7ff5380c6ee0 2023-08-17T18:12:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.469+0000 7ff51effd700 1 -- 172.21.15.78:0/3448944783 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7ff528022070 con 0x7ff5380c6ee0 2023-08-17T18:12:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.469+0000 7ff51effd700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff52405eeb0 0x7ff524061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.469+0000 7ff536ffd700 1 -- 172.21.15.78:0/3448944783 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff52405eeb0 msgr2=0x7ff524061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.469+0000 7ff51effd700 1 -- 172.21.15.78:0/3448944783 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff52807a120 con 0x7ff5380c6ee0 2023-08-17T18:12:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.469+0000 7ff536ffd700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff52405eeb0 0x7ff524061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.473+0000 7ff51effd700 1 -- 172.21.15.78:0/3448944783 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff52804b500 con 0x7ff5380c6ee0 2023-08-17T18:12:07.517 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:12:07.519 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:12:07.536 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:07.537+0000 7f6ca17a0680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:12:07.571 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:07.571+0000 7f605145d680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:07.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.647+0000 7ff53d8ed700 1 -- 172.21.15.78:0/3448944783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff538150700 con 0x7ff5380c6ee0 2023-08-17T18:12:07.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.648+0000 7ff51effd700 1 -- 172.21.15.78:0/3448944783 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+17493 (secure 0 0 0) 0x7ff52804eb20 con 0x7ff5380c6ee0 2023-08-17T18:12:07.648 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:07.648 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":172,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:05.701849+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:10:33.660535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T18:10:34.093770+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":172,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.22","mappings":[{"from":4,"to":3}]},{"pgid":"22.23","mappings":[{"from":3,"to":0}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6833/158925":"2023-08-18T18:10:46.159099+0000","172.21.15.78:6832/158925":"2023-08-18T18:10:46.159099+0000","172.21.15.78:0/1117008278":"2023-08-18T18:10:46.159099+0000","172.21.15.78:0/3007657595":"2023-08-18T18:10:46.159099+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 -- 172.21.15.78:0/3448944783 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff52405eeb0 msgr2=0x7ff524061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff52405eeb0 0x7ff524061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 -- 172.21.15.78:0/3448944783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c6ee0 msgr2=0x7ff53814f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c6ee0 0x7ff53814f2b0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7ff52800e950 tx=0x7ff528009060).stop 2023-08-17T18:12:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 -- 172.21.15.78:0/3448944783 shutdown_connections 2023-08-17T18:12:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff52405eeb0 0x7ff524061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff538154140 0x7ff53814cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5380c0df0 0x7ff5380afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 --2- 172.21.15.78:0/3448944783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5380c6ee0 0x7ff53814f2b0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 -- 172.21.15.78:0/3448944783 >> 172.21.15.78:0/3448944783 conn(0x7ff538094510 msgr2=0x7ff5380a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 -- 172.21.15.78:0/3448944783 shutdown_connections 2023-08-17T18:12:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.649+0000 7ff53d8ed700 1 -- 172.21.15.78:0/3448944783 wait complete. 2023-08-17T18:12:07.658 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:07.658+0000 7f6ca17a0680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:12:07.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T18:12:07.776 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:07.776+0000 7f6ca17a0680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:07.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.782+0000 7f72b9ca0700 1 Processor -- start 2023-08-17T18:12:07.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.782+0000 7f72b9ca0700 1 -- start start 2023-08-17T18:12:07.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.782+0000 7f72b9ca0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f72b4065700 0x7f72b41543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b9ca0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b4158930 con 0x7f72b40650c0 2023-08-17T18:12:07.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b9ca0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b4158dc0 con 0x7f72b4154010 2023-08-17T18:12:07.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b9ca0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b4065ce0 con 0x7f72b4065700 2023-08-17T18:12:07.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f72b4065700 0x7f72b41543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f72b4065700 0x7f72b41543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60126/0 (socket says 172.21.15.78:60126) 2023-08-17T18:12:07.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b2ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f72b40650c0 0x7f72b40688b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38994/0 (socket says 172.21.15.78:38994) 2023-08-17T18:12:07.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b3fff700 1 -- 172.21.15.78:0/149137364 learned_addr learned my addr 172.21.15.78:0/149137364 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:07.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b3fff700 1 -- 172.21.15.78:0/149137364 >> v1:172.21.15.150:6789/0 conn(0x7f72b4154010 legacy=0x7f72b40649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b3fff700 1 -- 172.21.15.78:0/149137364 >> v1:172.21.15.78:6789/0 conn(0x7f72b40650c0 legacy=0x7f72b40688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b27fc700 1 -- 172.21.15.78:0/149137364 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107534844 0 0) 0x7f72b4158930 con 0x7f72b40650c0 2023-08-17T18:12:07.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b3fff700 1 -- 172.21.15.78:0/149137364 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4158040 con 0x7f72b4065700 2023-08-17T18:12:07.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b3fff700 1 --2- 172.21.15.78:0/149137364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4065700 0x7f72b41543f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f72ac009f20 tx=0x7f72ac009840).ready entity=mon.0 client_cookie=bf828bb2a93bcc60 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:07.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b27fc700 1 -- 172.21.15.78:0/149137364 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00e070 con 0x7f72b4065700 2023-08-17T18:12:07.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b27fc700 1 -- 172.21.15.78:0/149137364 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac00ba80 con 0x7f72b4065700 2023-08-17T18:12:07.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.783+0000 7f72b27fc700 1 -- 172.21.15.78:0/149137364 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00be00 con 0x7f72b4065700 2023-08-17T18:12:07.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.784+0000 7f72b9ca0700 1 -- 172.21.15.78:0/149137364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4065700 msgr2=0x7f72b41543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.784+0000 7f72b9ca0700 1 --2- 172.21.15.78:0/149137364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4065700 0x7f72b41543f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f72ac009f20 tx=0x7f72ac009840).stop 2023-08-17T18:12:07.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.784+0000 7f72b9ca0700 1 -- 172.21.15.78:0/149137364 shutdown_connections 2023-08-17T18:12:07.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.784+0000 7f72b9ca0700 1 --2- 172.21.15.78:0/149137364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4065700 0x7f72b41543f0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.784+0000 7f72b9ca0700 1 -- 172.21.15.78:0/149137364 >> 172.21.15.78:0/149137364 conn(0x7f72b40c7330 msgr2=0x7f72b40c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:07.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.784+0000 7f72b9ca0700 1 -- 172.21.15.78:0/149137364 shutdown_connections 2023-08-17T18:12:07.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.784+0000 7f72b9ca0700 1 -- 172.21.15.78:0/149137364 wait complete. 2023-08-17T18:12:07.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.786+0000 7f72b9ca0700 1 Processor -- start 2023-08-17T18:12:07.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.786+0000 7f72b9ca0700 1 -- start start 2023-08-17T18:12:07.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b9ca0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b40650c0 0x7f72b4168450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b9ca0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72b4065700 0x7f72b40acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b9ca0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4154010 0x7f72b40c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b9ca0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40beb10 con 0x7f72b4154010 2023-08-17T18:12:07.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b9ca0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40ac330 con 0x7f72b40650c0 2023-08-17T18:12:07.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b9ca0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4168940 con 0x7f72b4065700 2023-08-17T18:12:07.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4154010 0x7f72b40c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4154010 0x7f72b40c1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60138/0 (socket says 172.21.15.78:60138) 2023-08-17T18:12:07.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b3fff700 1 -- 172.21.15.78:0/951133433 learned_addr learned my addr 172.21.15.78:0/951133433 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:07.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b37fe700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b40650c0 0x7f72b4168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.787+0000 7f72b2ffd700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72b4065700 0x7f72b40acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:07.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f72b3fff700 1 -- 172.21.15.78:0/951133433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72b4065700 msgr2=0x7f72b40acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f72b3fff700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72b4065700 0x7f72b40acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f72b3fff700 1 -- 172.21.15.78:0/951133433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b40650c0 msgr2=0x7f72b4168450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:07.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f72b3fff700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b40650c0 0x7f72b4168450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:07.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f72b3fff700 1 -- 172.21.15.78:0/951133433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac009ae0 con 0x7f72b4154010 2023-08-17T18:12:07.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f72b3fff700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4154010 0x7f72b40c1040 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f72ac00b6c0 tx=0x7f72ac009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:07.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f729b7fe700 1 -- 172.21.15.78:0/951133433 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0092e0 con 0x7f72b4154010 2023-08-17T18:12:07.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f729b7fe700 1 -- 172.21.15.78:0/951133433 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac01d410 con 0x7f72b4154010 2023-08-17T18:12:07.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f72b9ca0700 1 -- 172.21.15.78:0/951133433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b40aaab0 con 0x7f72b4154010 2023-08-17T18:12:07.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f729b7fe700 1 -- 172.21.15.78:0/951133433 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac01d790 con 0x7f72b4154010 2023-08-17T18:12:07.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.788+0000 7f72b9ca0700 1 -- 172.21.15.78:0/951133433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b40ac5d0 con 0x7f72b4154010 2023-08-17T18:12:07.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.789+0000 7f72b9ca0700 1 -- 172.21.15.78:0/951133433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b4047350 con 0x7f72b4154010 2023-08-17T18:12:07.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.789+0000 7f729b7fe700 1 -- 172.21.15.78:0/951133433 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 86) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f72ac01b040 con 0x7f72b4154010 2023-08-17T18:12:07.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.790+0000 7f729b7fe700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f72a005eeb0 0x7f72a0061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:07.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.790+0000 7f72b37fe700 1 -- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f72a005eeb0 msgr2=0x7f72a0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:07.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.790+0000 7f729b7fe700 1 -- 172.21.15.78:0/951133433 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f72ac07c390 con 0x7f72b4154010 2023-08-17T18:12:07.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.790+0000 7f72b37fe700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f72a005eeb0 0x7f72a0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:07.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.797+0000 7f729b7fe700 1 -- 172.21.15.78:0/951133433 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f72ac04d7f0 con 0x7f72b4154010 2023-08-17T18:12:07.867 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:07.867+0000 7f605145d680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:12:07.939 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:07.939+0000 7f605145d680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:12:07.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.991+0000 7f72b37fe700 1 -- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f72a005eeb0 msgr2=0x7f72a0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:07.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:07.991+0000 7f72b37fe700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f72a005eeb0 0x7f72a0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.011+0000 7f72b9ca0700 1 -- 172.21.15.78:0/951133433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f72b4064350 con 0x7f72b4154010 2023-08-17T18:12:08.083 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.083+0000 7f6ca17a0680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:12:08.155 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.155+0000 7f6ca17a0680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:12:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.174+0000 7f729b7fe700 1 -- 172.21.15.78:0/951133433 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 87) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f72ac07a150 con 0x7f72b4154010 2023-08-17T18:12:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.174+0000 7f729b7fe700 1 -- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f72a005eeb0 msgr2=0x7f72a0061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.174+0000 7f729b7fe700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f72a005eeb0 0x7f72a0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:08.179 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-08-17T18:12:08.179+0000 7f77ef6e6700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T18:12:08.179 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-08-17T18:12:08.179+0000 7f77ef6e6700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T18:12:08.180 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-08-17T18:12:08.179+0000 7f77ef6e6700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T18:12:08.195 INFO:tasks.ceph.mds.b.smithi150.stderr: -5> 2023-08-17T18:12:08.179+0000 7f77ef6e6700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T18:12:08.195 INFO:tasks.ceph.mds.b.smithi150.stderr: -4> 2023-08-17T18:12:08.179+0000 7f77ef6e6700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T18:12:08.195 INFO:tasks.ceph.mds.b.smithi150.stderr: -2> 2023-08-17T18:12:08.179+0000 7f77ef6e6700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T18:12:08.213 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T18:12:08.231 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.231+0000 7f6c20f80700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:08.231 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.231+0000 7f6c20f80700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:08.231 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.231+0000 7f6c20f80700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:08.231 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.231+0000 7f6c20f80700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:08.232 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.231+0000 7f6c20f80700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:08.232 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.231+0000 7f6c24787700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:08.232 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.231+0000 7f6c24787700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:08.232 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.231+0000 7f6c24787700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:08.232 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.231+0000 7f6c24787700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:08.232 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:08.231+0000 7f6c24787700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:08.708 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T18:12:08.708+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T18:12:08.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.714+0000 7f729b7fe700 1 -- 172.21.15.78:0/951133433 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) v1 ==== 161+0+0 (secure 0 0 0) 0x7f72ac049070 con 0x7f72b4154010 2023-08-17T18:12:08.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.716+0000 7f72b9ca0700 1 -- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4154010 msgr2=0x7f72b40c1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:08.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.716+0000 7f72b9ca0700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4154010 0x7f72b40c1040 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f72ac00b6c0 tx=0x7f72ac009840).stop 2023-08-17T18:12:08.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.717+0000 7f72b9ca0700 1 -- 172.21.15.78:0/951133433 shutdown_connections 2023-08-17T18:12:08.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.717+0000 7f72b9ca0700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f72a005eeb0 0x7f72a0061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:08.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.717+0000 7f72b9ca0700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72b4154010 0x7f72b40c1040 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:08.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.717+0000 7f72b9ca0700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72b40650c0 0x7f72b4168450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:08.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.717+0000 7f72b9ca0700 1 --2- 172.21.15.78:0/951133433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72b4065700 0x7f72b40acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:08.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.717+0000 7f72b9ca0700 1 -- 172.21.15.78:0/951133433 >> 172.21.15.78:0/951133433 conn(0x7f72b40c7330 msgr2=0x7f72b4144900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:08.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.717+0000 7f72b9ca0700 1 -- 172.21.15.78:0/951133433 shutdown_connections 2023-08-17T18:12:08.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.717+0000 7f72b9ca0700 1 -- 172.21.15.78:0/951133433 wait complete. 2023-08-17T18:12:08.718 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T18:12:08.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T18:12:08.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.846+0000 7fa30dbe9700 1 Processor -- start 2023-08-17T18:12:08.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.847+0000 7fa30dbe9700 1 -- start start 2023-08-17T18:12:08.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.847+0000 7fa30dbe9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3080aa4d0 0x7fa3080644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:08.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.847+0000 7fa30dbe9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3080c5810 0x7fa3080c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:08.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.847+0000 7fa30dbe9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3080649b0 con 0x7fa3080aa0f0 2023-08-17T18:12:08.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.847+0000 7fa30dbe9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3080c6150 con 0x7fa3080c5810 2023-08-17T18:12:08.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.847+0000 7fa30dbe9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa308063420 con 0x7fa3080aa4d0 2023-08-17T18:12:08.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.847+0000 7fa307fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3080c5810 0x7fa3080c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:08.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa307fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3080c5810 0x7fa3080c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55602/0 (socket says 172.21.15.78:55602) 2023-08-17T18:12:08.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa307fff700 1 -- 172.21.15.78:0/2697523536 learned_addr learned my addr 172.21.15.78:0/2697523536 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:08.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa306ffd700 1 --2- 172.21.15.78:0/2697523536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3080aa4d0 0x7fa3080644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:08.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa307fff700 1 -- 172.21.15.78:0/2697523536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3080aa4d0 msgr2=0x7fa3080644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:08.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa307fff700 1 --2- 172.21.15.78:0/2697523536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3080aa4d0 0x7fa3080644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:08.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa307fff700 1 -- 172.21.15.78:0/2697523536 >> v1:172.21.15.78:6789/0 conn(0x7fa3080aa0f0 legacy=0x7fa3080c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:08.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa307fff700 1 -- 172.21.15.78:0/2697523536 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa308063700 con 0x7fa3080c5810 2023-08-17T18:12:08.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa307fff700 1 --2- 172.21.15.78:0/2697523536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 0x7fa3080c5c60 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7fa300006fd0 tx=0x7fa3000090f0).ready entity=mon.0 client_cookie=7f5e542d9659aa31 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:08.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa3067fc700 1 -- 172.21.15.78:0/2697523536 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000b580 con 0x7fa3080c5810 2023-08-17T18:12:08.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa3067fc700 1 -- 172.21.15.78:0/2697523536 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000b6e0 con 0x7fa3080c5810 2023-08-17T18:12:08.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa3067fc700 1 -- 172.21.15.78:0/2697523536 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000ba60 con 0x7fa3080c5810 2023-08-17T18:12:08.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa30dbe9700 1 -- 172.21.15.78:0/2697523536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 msgr2=0x7fa3080c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:08.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.848+0000 7fa30dbe9700 1 --2- 172.21.15.78:0/2697523536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 0x7fa3080c5c60 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7fa300006fd0 tx=0x7fa3000090f0).stop 2023-08-17T18:12:08.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.849+0000 7fa30dbe9700 1 -- 172.21.15.78:0/2697523536 shutdown_connections 2023-08-17T18:12:08.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.849+0000 7fa30dbe9700 1 --2- 172.21.15.78:0/2697523536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 0x7fa3080c5c60 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:08.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.849+0000 7fa30dbe9700 1 --2- 172.21.15.78:0/2697523536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3080aa4d0 0x7fa3080644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:08.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.849+0000 7fa30dbe9700 1 -- 172.21.15.78:0/2697523536 >> 172.21.15.78:0/2697523536 conn(0x7fa30806a6a0 msgr2=0x7fa3080caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:08.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.849+0000 7fa30dbe9700 1 -- 172.21.15.78:0/2697523536 shutdown_connections 2023-08-17T18:12:08.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.849+0000 7fa30dbe9700 1 -- 172.21.15.78:0/2697523536 wait complete. 2023-08-17T18:12:08.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.850+0000 7fa30dbe9700 1 Processor -- start 2023-08-17T18:12:08.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.850+0000 7fa30dbe9700 1 -- start start 2023-08-17T18:12:08.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa30dbe9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3080aa0f0 0x7fa308146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:08.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa30dbe9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3080aa4d0 0x7fa3080acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:08.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa30dbe9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 0x7fa3080c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:08.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa30dbe9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa308147350 con 0x7fa3080c5810 2023-08-17T18:12:08.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa30dbe9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080ac170 con 0x7fa3080aa4d0 2023-08-17T18:12:08.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa30dbe9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080ab560 con 0x7fa3080aa0f0 2023-08-17T18:12:08.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa307fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 0x7fa3080c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:08.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa307fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 0x7fa3080c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55606/0 (socket says 172.21.15.78:55606) 2023-08-17T18:12:08.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa307fff700 1 -- 172.21.15.78:0/507464922 learned_addr learned my addr 172.21.15.78:0/507464922 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:08.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa3077fe700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3080aa0f0 0x7fa308146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:08.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa306ffd700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3080aa4d0 0x7fa3080acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:08.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa307fff700 1 -- 172.21.15.78:0/507464922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3080aa0f0 msgr2=0x7fa308146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa307fff700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3080aa0f0 0x7fa308146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa307fff700 1 -- 172.21.15.78:0/507464922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3080aa4d0 msgr2=0x7fa3080acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa307fff700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3080aa4d0 0x7fa3080acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa307fff700 1 -- 172.21.15.78:0/507464922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300009370 con 0x7fa3080c5810 2023-08-17T18:12:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa306ffd700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3080aa4d0 0x7fa3080acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa307fff700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 0x7fa3080c36f0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7fa300009130 tx=0x7fa300017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/507464922 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000ba60 con 0x7fa3080c5810 2023-08-17T18:12:08.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/507464922 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30001d430 con 0x7fa3080c5810 2023-08-17T18:12:08.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa30dbe9700 1 -- 172.21.15.78:0/507464922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3080ab840 con 0x7fa3080c5810 2023-08-17T18:12:08.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/507464922 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30001d7f0 con 0x7fa3080c5810 2023-08-17T18:12:08.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.851+0000 7fa30dbe9700 1 -- 172.21.15.78:0/507464922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3080abe00 con 0x7fa3080c5810 2023-08-17T18:12:08.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.852+0000 7fa30dbe9700 1 -- 172.21.15.78:0/507464922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3080ac2e0 con 0x7fa3080c5810 2023-08-17T18:12:08.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.852+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/507464922 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 87) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fa30000f070 con 0x7fa3080c5810 2023-08-17T18:12:08.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.853+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/507464922 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6752+0+0 (secure 0 0 0) 0x7fa30007b910 con 0x7fa3080c5810 2023-08-17T18:12:08.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:08.857+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/507464922 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa30004cce0 con 0x7fa3080c5810 2023-08-17T18:12:09.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.058+0000 7fa30dbe9700 1 -- 172.21.15.78:0/507464922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa308046af0 con 0x7fa3080c5810 2023-08-17T18:12:09.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.178+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/507464922 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 88) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fa300079640 con 0x7fa3080c5810 2023-08-17T18:12:09.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.178+0000 7fa2ef7fe700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2f40301b0 0x7fa2f40679d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:09.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.179+0000 7fa3077fe700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2f40301b0 0x7fa2f40679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:09.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.180+0000 7fa3077fe700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2f40301b0 0x7fa2f40679d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa308155070 tx=0x7fa2f8009040).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:09.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.715+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/507464922 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa30003fac0 con 0x7fa3080c5810 2023-08-17T18:12:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.717+0000 7fa30dbe9700 1 -- 172.21.15.78:0/507464922 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2f40301b0 msgr2=0x7fa2f40679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.717+0000 7fa30dbe9700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2f40301b0 0x7fa2f40679d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa308155070 tx=0x7fa2f8009040).stop 2023-08-17T18:12:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.717+0000 7fa30dbe9700 1 -- 172.21.15.78:0/507464922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 msgr2=0x7fa3080c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.717+0000 7fa30dbe9700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 0x7fa3080c36f0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7fa300009130 tx=0x7fa300017000).stop 2023-08-17T18:12:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.717+0000 7fa30dbe9700 1 -- 172.21.15.78:0/507464922 shutdown_connections 2023-08-17T18:12:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.717+0000 7fa30dbe9700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2f40301b0 0x7fa2f40679d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.717+0000 7fa30dbe9700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5810 0x7fa3080c36f0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:09.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.717+0000 7fa30dbe9700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3080aa0f0 0x7fa308146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:09.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.717+0000 7fa30dbe9700 1 --2- 172.21.15.78:0/507464922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3080aa4d0 0x7fa3080acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:09.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.717+0000 7fa30dbe9700 1 -- 172.21.15.78:0/507464922 >> 172.21.15.78:0/507464922 conn(0x7fa30806a6a0 msgr2=0x7fa3080ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:09.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.718+0000 7fa30dbe9700 1 -- 172.21.15.78:0/507464922 shutdown_connections 2023-08-17T18:12:09.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.718+0000 7fa30dbe9700 1 -- 172.21.15.78:0/507464922 wait complete. 2023-08-17T18:12:09.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T18:12:09.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.847+0000 7f0fb13b7700 1 Processor -- start 2023-08-17T18:12:09.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.847+0000 7f0fb13b7700 1 -- start start 2023-08-17T18:12:09.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.848+0000 7f0fb13b7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0fac0aa4d0 0x7f0fac0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:09.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.848+0000 7f0fb13b7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac0649b0 con 0x7f0fac0c5810 2023-08-17T18:12:09.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.848+0000 7f0fb13b7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac063420 con 0x7f0fac0aa0f0 2023-08-17T18:12:09.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.848+0000 7f0fb13b7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac063700 con 0x7f0fac0aa4d0 2023-08-17T18:12:09.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.848+0000 7f0fab7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0fac0c5810 0x7f0fac0a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41652/0 (socket says 172.21.15.78:41652) 2023-08-17T18:12:09.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.848+0000 7f0fab7fe700 1 -- 172.21.15.78:0/76201126 learned_addr learned my addr 172.21.15.78:0/76201126 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:09.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.848+0000 7f0faa7fc700 1 --2- 172.21.15.78:0/76201126 >> v2:172.21.15.150:3300/0 conn(0x7f0fac0aa4d0 0x7f0fac0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:09.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444586122 0 0) 0x7f0fac0649b0 con 0x7f0fac0c5810 2023-08-17T18:12:09.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f940033f0 con 0x7f0fac0c5810 2023-08-17T18:12:09.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1834552718 0 0) 0x7f0f940033f0 con 0x7f0fac0c5810 2023-08-17T18:12:09.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 >> v2:172.21.15.150:3300/0 conn(0x7f0fac0aa4d0 msgr2=0x7f0fac0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:09.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 --2- 172.21.15.78:0/76201126 >> v2:172.21.15.150:3300/0 conn(0x7f0fac0aa4d0 0x7f0fac0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:09.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 >> v1:172.21.15.150:6789/0 conn(0x7f0fac0aa0f0 legacy=0x7f0fac0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:09.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0639e0 con 0x7f0fac0c5810 2023-08-17T18:12:09.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f0fa4001470 con 0x7f0fac0c5810 2023-08-17T18:12:09.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 >> v1:172.21.15.78:6789/0 conn(0x7f0fac0c5810 legacy=0x7f0fac0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:09.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f940038e0 0x7f0f94003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:09.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f94004690 0x7f0f94004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:09.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f94005000 0x7f0f9400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:09.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac063700 con 0x7f0f940038e0 2023-08-17T18:12:09.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9400beb0 con 0x7f0f94004690 2023-08-17T18:12:09.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9400c070 con 0x7f0f94005000 2023-08-17T18:12:09.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0faaffd700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f940038e0 0x7f0f94003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:09.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0faa7fc700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f94004690 0x7f0f94004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:09.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fab7fe700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f94005000 0x7f0f9400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:09.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0faaffd700 1 -- 172.21.15.78:0/76201126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f94005000 msgr2=0x7f0f9400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:09.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0faaffd700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f94005000 0x7f0f9400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:09.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0faaffd700 1 -- 172.21.15.78:0/76201126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f94004690 msgr2=0x7f0f94004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:09.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0faaffd700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f94004690 0x7f0f94004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:09.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0faaffd700 1 -- 172.21.15.78:0/76201126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f940033f0 con 0x7f0f940038e0 2023-08-17T18:12:09.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0fab7fe700 1 -- 172.21.15.78:0/76201126 reap_dead start 2023-08-17T18:12:09.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0faa7fc700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f94004690 0x7f0f94004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:09.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.849+0000 7f0faaffd700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f940038e0 0x7f0f94003d00 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f0f9c001e30 tx=0x7f0f9c007f30).ready entity=mon.0 client_cookie=16bace4aa9905ba6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:09.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.850+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c006a20 con 0x7f0f940038e0 2023-08-17T18:12:09.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.850+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c006b80 con 0x7f0f940038e0 2023-08-17T18:12:09.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.850+0000 7f0fa9ffb700 1 -- 172.21.15.78:0/76201126 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c00c5d0 con 0x7f0f940038e0 2023-08-17T18:12:09.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.850+0000 7f0fb13b7700 1 -- 172.21.15.78:0/76201126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f940038e0 msgr2=0x7f0f94003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:09.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.850+0000 7f0fb13b7700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f940038e0 0x7f0f94003d00 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f0f9c001e30 tx=0x7f0f9c007f30).stop 2023-08-17T18:12:09.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.850+0000 7f0fb13b7700 1 -- 172.21.15.78:0/76201126 shutdown_connections 2023-08-17T18:12:09.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.850+0000 7f0fb13b7700 1 --2- 172.21.15.78:0/76201126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f940038e0 0x7f0f94003d00 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:09.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.850+0000 7f0fb13b7700 1 -- 172.21.15.78:0/76201126 >> 172.21.15.78:0/76201126 conn(0x7f0fac06a6a0 msgr2=0x7f0fac0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:09.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.850+0000 7f0fb13b7700 1 -- 172.21.15.78:0/76201126 shutdown_connections 2023-08-17T18:12:09.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.850+0000 7f0fb13b7700 1 -- 172.21.15.78:0/76201126 wait complete. 2023-08-17T18:12:09.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.851+0000 7f0fb13b7700 1 Processor -- start 2023-08-17T18:12:09.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.851+0000 7f0fb13b7700 1 -- start start 2023-08-17T18:12:09.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0fb13b7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f940038e0 0x7f0fac14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:09.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0fb13b7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fac14bf60 0x7f0fac14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:09.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0fb13b7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac14e530 0x7f0fac0acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:09.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0fb13b7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac14e970 con 0x7f0fac14bf60 2023-08-17T18:12:09.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0fb13b7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0ade80 con 0x7f0f940038e0 2023-08-17T18:12:09.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0fb13b7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0ae140 con 0x7f0fac14e530 2023-08-17T18:12:09.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0faa7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fac14bf60 0x7f0fac14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:09.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0faa7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fac14bf60 0x7f0fac14e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55612/0 (socket says 172.21.15.78:55612) 2023-08-17T18:12:09.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0faa7fc700 1 -- 172.21.15.78:0/1159609261 learned_addr learned my addr 172.21.15.78:0/1159609261 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0faaffd700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f940038e0 0x7f0fac14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0fab7fe700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac14e530 0x7f0fac0acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0faa7fc700 1 -- 172.21.15.78:0/1159609261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac14e530 msgr2=0x7f0fac0acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.852+0000 7f0faa7fc700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac14e530 0x7f0fac0acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.853+0000 7f0faa7fc700 1 -- 172.21.15.78:0/1159609261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f940038e0 msgr2=0x7f0fac14ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.853+0000 7f0faa7fc700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f940038e0 0x7f0fac14ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.853+0000 7f0faa7fc700 1 -- 172.21.15.78:0/1159609261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0ae420 con 0x7f0fac14bf60 2023-08-17T18:12:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.853+0000 7f0fab7fe700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac14e530 0x7f0fac0acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.853+0000 7f0faa7fc700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fac14bf60 0x7f0fac14e040 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f0fa0011540 tx=0x7f0fa0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.853+0000 7f0f92ffd700 1 -- 172.21.15.78:0/1159609261 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00145f0 con 0x7f0fac14bf60 2023-08-17T18:12:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.853+0000 7f0f92ffd700 1 -- 172.21.15.78:0/1159609261 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa0014750 con 0x7f0fac14bf60 2023-08-17T18:12:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.853+0000 7f0fb13b7700 1 -- 172.21.15.78:0/1159609261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac0ae700 con 0x7f0fac14bf60 2023-08-17T18:12:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.853+0000 7f0f92ffd700 1 -- 172.21.15.78:0/1159609261 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0014b10 con 0x7f0fac14bf60 2023-08-17T18:12:09.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.853+0000 7f0fb13b7700 1 -- 172.21.15.78:0/1159609261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac0ad050 con 0x7f0fac14bf60 2023-08-17T18:12:09.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.854+0000 7f0fb13b7700 1 -- 172.21.15.78:0/1159609261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac0aec20 con 0x7f0fac14bf60 2023-08-17T18:12:09.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.854+0000 7f0f92ffd700 1 -- 172.21.15.78:0/1159609261 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 88) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f0fa0012040 con 0x7f0fac14bf60 2023-08-17T18:12:09.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.854+0000 7f0f92ffd700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0f9805ecf0 0x7f0f980611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:09.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.854+0000 7f0f92ffd700 1 -- 172.21.15.78:0/1159609261 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6752+0+0 (secure 0 0 0) 0x7f0fa007a090 con 0x7f0fac14bf60 2023-08-17T18:12:09.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.854+0000 7f0faaffd700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0f9805ecf0 0x7f0f980611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:09.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.855+0000 7f0faaffd700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0f9805ecf0 0x7f0f980611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0f9c001350 tx=0x7f0f9c016000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:09.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:09.859+0000 7f0f92ffd700 1 -- 172.21.15.78:0/1159609261 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fac0aec20 con 0x7f0fac14bf60 2023-08-17T18:12:10.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.022+0000 7f0fb13b7700 1 -- 172.21.15.78:0/1159609261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0fac083980 con 0x7f0fac14bf60 2023-08-17T18:12:10.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.721+0000 7f0f92ffd700 1 -- 172.21.15.78:0/1159609261 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v175) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0fa004b460 con 0x7f0fac14bf60 2023-08-17T18:12:10.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 -- 172.21.15.78:0/1159609261 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0f9805ecf0 msgr2=0x7f0f980611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:10.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0f9805ecf0 0x7f0f980611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0f9c001350 tx=0x7f0f9c016000).stop 2023-08-17T18:12:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 -- 172.21.15.78:0/1159609261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fac14bf60 msgr2=0x7f0fac14e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fac14bf60 0x7f0fac14e040 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f0fa0011540 tx=0x7f0fa0008040).stop 2023-08-17T18:12:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 -- 172.21.15.78:0/1159609261 shutdown_connections 2023-08-17T18:12:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f0f9805ecf0 0x7f0f980611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fac14e530 0x7f0fac0acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f940038e0 0x7f0fac14ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 --2- 172.21.15.78:0/1159609261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fac14bf60 0x7f0fac14e040 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 -- 172.21.15.78:0/1159609261 >> 172.21.15.78:0/1159609261 conn(0x7f0fac06a6a0 msgr2=0x7f0fac0b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:10.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 -- 172.21.15.78:0/1159609261 shutdown_connections 2023-08-17T18:12:10.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.724+0000 7f0fb13b7700 1 -- 172.21.15.78:0/1159609261 wait complete. 2023-08-17T18:12:10.726 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T18:12:10.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T18:12:10.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.858+0000 7fc05ce56700 1 Processor -- start 2023-08-17T18:12:10.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.858+0000 7fc05ce56700 1 -- start start 2023-08-17T18:12:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.859+0000 7fc05ce56700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0580aa4d0 0x7fc0580644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.859+0000 7fc05ce56700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0580c5810 0x7fc0580c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.859+0000 7fc05ce56700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0580649b0 con 0x7fc0580aa0f0 2023-08-17T18:12:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.859+0000 7fc05ce56700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0580c6170 con 0x7fc0580aa4d0 2023-08-17T18:12:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.859+0000 7fc05ce56700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc058063420 con 0x7fc0580c5810 2023-08-17T18:12:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.859+0000 7fc05659c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc0580aa0f0 0x7fc0580c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41656/0 (socket says 172.21.15.78:41656) 2023-08-17T18:12:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.859+0000 7fc055d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0580aa4d0 0x7fc0580644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.859+0000 7fc05659c700 1 -- 172.21.15.78:0/886568738 learned_addr learned my addr 172.21.15.78:0/886568738 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05559a700 1 -- 172.21.15.78:0/886568738 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081526260 0 0) 0x7fc0580649b0 con 0x7fc0580aa0f0 2023-08-17T18:12:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05559a700 1 -- 172.21.15.78:0/886568738 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0400033f0 con 0x7fc0580aa0f0 2023-08-17T18:12:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc055d9b700 1 -- 172.21.15.78:0/886568738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0580c5810 msgr2=0x7fc0580c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc055d9b700 1 --2- 172.21.15.78:0/886568738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0580c5810 0x7fc0580c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc055d9b700 1 -- 172.21.15.78:0/886568738 >> v1:172.21.15.78:6789/0 conn(0x7fc0580aa0f0 legacy=0x7fc0580c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc055d9b700 1 -- 172.21.15.78:0/886568738 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058063700 con 0x7fc0580aa4d0 2023-08-17T18:12:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc055d9b700 1 --2- 172.21.15.78:0/886568738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580aa4d0 0x7fc0580644c0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fc04c009760 tx=0x7fc04c009060).ready entity=mon.0 client_cookie=7236b363019d4104 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05559a700 1 -- 172.21.15.78:0/886568738 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00f510 con 0x7fc0580aa4d0 2023-08-17T18:12:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05559a700 1 -- 172.21.15.78:0/886568738 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c00f670 con 0x7fc0580aa4d0 2023-08-17T18:12:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05559a700 1 -- 172.21.15.78:0/886568738 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00f9f0 con 0x7fc0580aa4d0 2023-08-17T18:12:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05ce56700 1 -- 172.21.15.78:0/886568738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580aa4d0 msgr2=0x7fc0580644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05ce56700 1 --2- 172.21.15.78:0/886568738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580aa4d0 0x7fc0580644c0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fc04c009760 tx=0x7fc04c009060).stop 2023-08-17T18:12:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05ce56700 1 -- 172.21.15.78:0/886568738 shutdown_connections 2023-08-17T18:12:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05ce56700 1 --2- 172.21.15.78:0/886568738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0580c5810 0x7fc0580c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05ce56700 1 --2- 172.21.15.78:0/886568738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580aa4d0 0x7fc0580644c0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05ce56700 1 -- 172.21.15.78:0/886568738 >> 172.21.15.78:0/886568738 conn(0x7fc05806a6a0 msgr2=0x7fc0580caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05ce56700 1 -- 172.21.15.78:0/886568738 shutdown_connections 2023-08-17T18:12:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.860+0000 7fc05ce56700 1 -- 172.21.15.78:0/886568738 wait complete. 2023-08-17T18:12:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc05ce56700 1 Processor -- start 2023-08-17T18:12:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc05ce56700 1 -- start start 2023-08-17T18:12:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc05ce56700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0580aa0f0 0x7fc058158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc05ce56700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0580aa4d0 0x7fc05814fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc05ce56700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580c5810 0x7fc0580c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc05ce56700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05814f8f0 con 0x7fc0580c5810 2023-08-17T18:12:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc05ce56700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0580c4d70 con 0x7fc0580aa4d0 2023-08-17T18:12:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc05ce56700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc058158830 con 0x7fc0580aa0f0 2023-08-17T18:12:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc056d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580c5810 0x7fc0580c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc056d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580c5810 0x7fc0580c4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55636/0 (socket says 172.21.15.78:55636) 2023-08-17T18:12:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.862+0000 7fc056d9d700 1 -- 172.21.15.78:0/3997566432 learned_addr learned my addr 172.21.15.78:0/3997566432 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc05659c700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0580aa0f0 0x7fc058158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc055d9b700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0580aa4d0 0x7fc05814fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc056d9d700 1 -- 172.21.15.78:0/3997566432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0580aa0f0 msgr2=0x7fc058158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc056d9d700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0580aa0f0 0x7fc058158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc056d9d700 1 -- 172.21.15.78:0/3997566432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0580aa4d0 msgr2=0x7fc05814fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc056d9d700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0580aa4d0 0x7fc05814fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc056d9d700 1 -- 172.21.15.78:0/3997566432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c0092a0 con 0x7fc0580c5810 2023-08-17T18:12:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc055d9b700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0580aa4d0 0x7fc05814fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc056d9d700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580c5810 0x7fc0580c4390 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fc05000b5e0 tx=0x7fc050009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc0467fc700 1 -- 172.21.15.78:0/3997566432 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05000d4a0 con 0x7fc0580c5810 2023-08-17T18:12:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc0467fc700 1 -- 172.21.15.78:0/3997566432 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05000d620 con 0x7fc0580c5810 2023-08-17T18:12:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc05ce56700 1 -- 172.21.15.78:0/3997566432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0580abb20 con 0x7fc0580c5810 2023-08-17T18:12:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc0467fc700 1 -- 172.21.15.78:0/3997566432 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05000d9e0 con 0x7fc0580c5810 2023-08-17T18:12:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.863+0000 7fc05ce56700 1 -- 172.21.15.78:0/3997566432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0580ac0e0 con 0x7fc0580c5810 2023-08-17T18:12:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.864+0000 7fc05ce56700 1 -- 172.21.15.78:0/3997566432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc058083980 con 0x7fc0580c5810 2023-08-17T18:12:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.864+0000 7fc0467fc700 1 -- 172.21.15.78:0/3997566432 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 88) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fc05000f030 con 0x7fc0580c5810 2023-08-17T18:12:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.864+0000 7fc0467fc700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc03805ecf0 0x7fc0380611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.865+0000 7fc0467fc700 1 -- 172.21.15.78:0/3997566432 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6285+0+0 (secure 0 0 0) 0x7fc050079880 con 0x7fc0580c5810 2023-08-17T18:12:10.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.865+0000 7fc05659c700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc03805ecf0 0x7fc0380611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:10.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.865+0000 7fc05659c700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc03805ecf0 0x7fc0380611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc048005ad0 tx=0x7fc048009040).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:10.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:10.869+0000 7fc0467fc700 1 -- 172.21.15.78:0/3997566432 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc05004ae20 con 0x7fc0580c5810 2023-08-17T18:12:11.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.032+0000 7fc05ce56700 1 -- 172.21.15.78:0/3997566432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc058046af0 con 0x7fc0580c5810 2023-08-17T18:12:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.182+0000 7fc0467fc700 1 -- 172.21.15.78:0/3997566432 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc05000dd50 con 0x7fc0580c5810 2023-08-17T18:12:11.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.531+0000 7fc0467fc700 1 -- 172.21.15.78:0/3997566432 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v176) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc050073020 con 0x7fc0580c5810 2023-08-17T18:12:11.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.535+0000 7fc05ce56700 1 -- 172.21.15.78:0/3997566432 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc03805ecf0 msgr2=0x7fc0380611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.535+0000 7fc05ce56700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc03805ecf0 0x7fc0380611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc048005ad0 tx=0x7fc048009040).stop 2023-08-17T18:12:11.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.535+0000 7fc05ce56700 1 -- 172.21.15.78:0/3997566432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580c5810 msgr2=0x7fc0580c4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.535+0000 7fc05ce56700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580c5810 0x7fc0580c4390 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fc05000b5e0 tx=0x7fc050009060).stop 2023-08-17T18:12:11.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.536+0000 7fc05ce56700 1 -- 172.21.15.78:0/3997566432 shutdown_connections 2023-08-17T18:12:11.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.536+0000 7fc05ce56700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc03805ecf0 0x7fc0380611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.536+0000 7fc05ce56700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0580c5810 0x7fc0580c4390 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.536+0000 7fc05ce56700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0580aa0f0 0x7fc058158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.536+0000 7fc05ce56700 1 --2- 172.21.15.78:0/3997566432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0580aa4d0 0x7fc05814fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.536+0000 7fc05ce56700 1 -- 172.21.15.78:0/3997566432 >> 172.21.15.78:0/3997566432 conn(0x7fc05806a6a0 msgr2=0x7fc0580b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:11.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.536+0000 7fc05ce56700 1 -- 172.21.15.78:0/3997566432 shutdown_connections 2023-08-17T18:12:11.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.536+0000 7fc05ce56700 1 -- 172.21.15.78:0/3997566432 wait complete. 2023-08-17T18:12:11.537 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T18:12:11.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T18:12:11.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.669+0000 7f5dc8290700 1 Processor -- start 2023-08-17T18:12:11.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.669+0000 7f5dc8290700 1 -- start start 2023-08-17T18:12:11.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.670+0000 7f5dc8290700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5dc00aa0f0 0x7f5dc00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.670+0000 7f5dc8290700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00c5810 0x7f5dc00c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.670+0000 7f5dc8290700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc00649b0 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.670+0000 7f5dc8290700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc00c6170 con 0x7f5dc00aa0f0 2023-08-17T18:12:11.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.670+0000 7f5dc8290700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0063420 con 0x7f5dc00c5810 2023-08-17T18:12:11.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc602c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5dc00aa0f0 0x7f5dc00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc582b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5dc00aa4d0 0x7f5dc00c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41662/0 (socket says 172.21.15.78:41662) 2023-08-17T18:12:11.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc582b700 1 -- 172.21.15.78:0/1132290174 learned_addr learned my addr 172.21.15.78:0/1132290174 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:11.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc602c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5dc00aa0f0 0x7f5dc00644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55644/0 (socket says 172.21.15.78:55644) 2023-08-17T18:12:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc682d700 1 --2- 172.21.15.78:0/1132290174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00c5810 0x7f5dc00c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc602c700 1 -- 172.21.15.78:0/1132290174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00c5810 msgr2=0x7f5dc00c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc602c700 1 --2- 172.21.15.78:0/1132290174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00c5810 0x7f5dc00c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc602c700 1 -- 172.21.15.78:0/1132290174 >> v1:172.21.15.78:6789/0 conn(0x7f5dc00aa4d0 legacy=0x7f5dc00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc602c700 1 -- 172.21.15.78:0/1132290174 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc0063700 con 0x7f5dc00aa0f0 2023-08-17T18:12:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc502a700 1 -- 172.21.15.78:0/1132290174 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565761537 0 0) 0x7f5dc00649b0 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc602c700 1 --2- 172.21.15.78:0/1132290174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa0f0 0x7f5dc00644c0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f5dbc009760 tx=0x7f5dbc009060).ready entity=mon.0 client_cookie=df1e3c14f77f926c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:11.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc502a700 1 -- 172.21.15.78:0/1132290174 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00b580 con 0x7f5dc00aa0f0 2023-08-17T18:12:11.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc502a700 1 -- 172.21.15.78:0/1132290174 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc00b6e0 con 0x7f5dc00aa0f0 2023-08-17T18:12:11.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.671+0000 7f5dc502a700 1 -- 172.21.15.78:0/1132290174 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00ba60 con 0x7f5dc00aa0f0 2023-08-17T18:12:11.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.672+0000 7f5dc8290700 1 -- 172.21.15.78:0/1132290174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa0f0 msgr2=0x7f5dc00644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.672+0000 7f5dc8290700 1 --2- 172.21.15.78:0/1132290174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa0f0 0x7f5dc00644c0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f5dbc009760 tx=0x7f5dbc009060).stop 2023-08-17T18:12:11.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.672+0000 7f5dc8290700 1 -- 172.21.15.78:0/1132290174 shutdown_connections 2023-08-17T18:12:11.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.672+0000 7f5dc8290700 1 --2- 172.21.15.78:0/1132290174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00c5810 0x7f5dc00c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.672+0000 7f5dc8290700 1 --2- 172.21.15.78:0/1132290174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa0f0 0x7f5dc00644c0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.672+0000 7f5dc8290700 1 -- 172.21.15.78:0/1132290174 >> 172.21.15.78:0/1132290174 conn(0x7f5dc006a6a0 msgr2=0x7f5dc00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:11.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.672+0000 7f5dc8290700 1 -- 172.21.15.78:0/1132290174 shutdown_connections 2023-08-17T18:12:11.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.672+0000 7f5dc8290700 1 -- 172.21.15.78:0/1132290174 wait complete. 2023-08-17T18:12:11.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.673+0000 7f5dc8290700 1 Processor -- start 2023-08-17T18:12:11.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.673+0000 7f5dc8290700 1 -- start start 2023-08-17T18:12:11.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.673+0000 7f5dc8290700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00aa0f0 0x7f5dc00ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.673+0000 7f5dc8290700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa4d0 0x7f5dc00c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.673+0000 7f5dc8290700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc00c5810 0x7f5dc0140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.673+0000 7f5dc8290700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00c2290 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc8290700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00c2570 con 0x7f5dc00c5810 2023-08-17T18:12:11.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc8290700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00c2850 con 0x7f5dc00aa0f0 2023-08-17T18:12:11.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc582b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa4d0 0x7f5dc00c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc582b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa4d0 0x7f5dc00c4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55648/0 (socket says 172.21.15.78:55648) 2023-08-17T18:12:11.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc582b700 1 -- 172.21.15.78:0/2598258303 learned_addr learned my addr 172.21.15.78:0/2598258303 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:11.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc582b700 1 -- 172.21.15.78:0/2598258303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00aa0f0 msgr2=0x7f5dc00ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc582b700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00aa0f0 0x7f5dc00ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:11.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc582b700 1 -- 172.21.15.78:0/2598258303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc00c5810 msgr2=0x7f5dc0140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc582b700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc00c5810 0x7f5dc0140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:11.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc582b700 1 -- 172.21.15.78:0/2598258303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc0092a0 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc582b700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa4d0 0x7f5dc00c4900 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f5db0001eb0 tx=0x7f5db0007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:11.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5db67fc700 1 -- 172.21.15.78:0/2598258303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db00072e0 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5db67fc700 1 -- 172.21.15.78:0/2598258303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db0007460 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc8290700 1 -- 172.21.15.78:0/2598258303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc00c2b30 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5db67fc700 1 -- 172.21.15.78:0/2598258303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db00059f0 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.674+0000 7f5dc8290700 1 -- 172.21.15.78:0/2598258303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc00ac710 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.675+0000 7f5dc8290700 1 -- 172.21.15.78:0/2598258303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc0083980 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.675+0000 7f5db67fc700 1 -- 172.21.15.78:0/2598258303 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5db001a060 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.676+0000 7f5db67fc700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5da405ed90 0x7f5da4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.676+0000 7f5db67fc700 1 -- 172.21.15.78:0/2598258303 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f5db00791a0 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.676+0000 7f5dc602c700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5da405ed90 0x7f5da4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.676+0000 7f5dc602c700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5da405ed90 0x7f5da4061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5dbc00b340 tx=0x7f5dbc017000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:11.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.680+0000 7f5db67fc700 1 -- 172.21.15.78:0/2598258303 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5db004a870 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.850+0000 7f5dc8290700 1 -- 172.21.15.78:0/2598258303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5dc00cbd40 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.853+0000 7f5db67fc700 1 -- 172.21.15.78:0/2598258303 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5db00180a0 con 0x7f5dc00aa4d0 2023-08-17T18:12:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 -- 172.21.15.78:0/2598258303 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5da405ed90 msgr2=0x7f5da4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5da405ed90 0x7f5da4061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5dbc00b340 tx=0x7f5dbc017000).stop 2023-08-17T18:12:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 -- 172.21.15.78:0/2598258303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa4d0 msgr2=0x7f5dc00c4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa4d0 0x7f5dc00c4900 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f5db0001eb0 tx=0x7f5db0007bf0).stop 2023-08-17T18:12:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 -- 172.21.15.78:0/2598258303 shutdown_connections 2023-08-17T18:12:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5da405ed90 0x7f5da4061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc00c5810 0x7f5dc0140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00aa0f0 0x7f5dc00ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 --2- 172.21.15.78:0/2598258303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc00aa4d0 0x7f5dc00c4900 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 -- 172.21.15.78:0/2598258303 >> 172.21.15.78:0/2598258303 conn(0x7f5dc006a6a0 msgr2=0x7f5dc00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 -- 172.21.15.78:0/2598258303 shutdown_connections 2023-08-17T18:12:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.855+0000 7f5dc8290700 1 -- 172.21.15.78:0/2598258303 wait complete. 2023-08-17T18:12:11.866 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-17T18:12:11.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.985+0000 7fbe2ab28700 1 Processor -- start 2023-08-17T18:12:11.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.985+0000 7fbe2ab28700 1 -- start start 2023-08-17T18:12:11.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.986+0000 7fbe2ab28700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe2414ea60 0x7fbe24069310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.986+0000 7fbe2ab28700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe24069800 0x7fbe240bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.986+0000 7fbe2ab28700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe240c5990 con 0x7fbe2414e680 2023-08-17T18:12:11.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.986+0000 7fbe2ab28700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe240bcc10 con 0x7fbe2414ea60 2023-08-17T18:12:11.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.986+0000 7fbe2ab28700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe24069c90 con 0x7fbe24069800 2023-08-17T18:12:11.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.986+0000 7fbe288c4700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbe2414e680 0x7fbe240c2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41672/0 (socket says 172.21.15.78:41672) 2023-08-17T18:12:11.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.986+0000 7fbe288c4700 1 -- 172.21.15.78:0/1876761907 learned_addr learned my addr 172.21.15.78:0/1876761907 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:11.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe290c5700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe24069800 0x7fbe240bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1bfff700 1 --2- 172.21.15.78:0/1876761907 >> v2:172.21.15.150:3300/0 conn(0x7fbe2414ea60 0x7fbe24069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128834031 0 0) 0x7fbe240c5990 con 0x7fbe2414e680 2023-08-17T18:12:11.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe0c0033f0 con 0x7fbe2414e680 2023-08-17T18:12:11.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2079764917 0 0) 0x7fbe0c0033f0 con 0x7fbe2414e680 2023-08-17T18:12:11.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe24069800 msgr2=0x7fbe240bd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:11.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe24069800 0x7fbe240bd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 >> v2:172.21.15.150:3300/0 conn(0x7fbe2414ea60 msgr2=0x7fbe24069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:11.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 --2- 172.21.15.78:0/1876761907 >> v2:172.21.15.150:3300/0 conn(0x7fbe2414ea60 0x7fbe24069310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240c4120 con 0x7fbe2414e680 2023-08-17T18:12:11.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fbe20001470 con 0x7fbe2414e680 2023-08-17T18:12:11.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 >> v1:172.21.15.78:6789/0 conn(0x7fbe2414e680 legacy=0x7fbe240c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe24069800 0x7fbe0c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c003e10 0x7fbe0c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c004b80 0x7fbe0c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe240bcc10 con 0x7fbe0c003e10 2023-08-17T18:12:11.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe24069c90 con 0x7fbe0c004b80 2023-08-17T18:12:11.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c00b8e0 con 0x7fbe24069800 2023-08-17T18:12:11.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1bfff700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c003e10 0x7fbe0c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe288c4700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe24069800 0x7fbe0c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe290c5700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c004b80 0x7fbe0c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1bfff700 1 -- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe24069800 msgr2=0x7fbe0c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:11.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1bfff700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe24069800 0x7fbe0c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1bfff700 1 -- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c004b80 msgr2=0x7fbe0c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:11.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1bfff700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c004b80 0x7fbe0c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.987+0000 7fbe1bfff700 1 -- 172.21.15.78:0/1876761907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0033f0 con 0x7fbe0c003e10 2023-08-17T18:12:11.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe1bfff700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c003e10 0x7fbe0c004690 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7fbe14009ab0 tx=0x7fbe14009060).ready entity=mon.0 client_cookie=c5e1967ca33a90f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:11.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14009430 con 0x7fbe0c003e10 2023-08-17T18:12:11.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1400e640 con 0x7fbe0c003e10 2023-08-17T18:12:11.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe1b7fe700 1 -- 172.21.15.78:0/1876761907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400e9c0 con 0x7fbe0c003e10 2023-08-17T18:12:11.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1876761907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c003e10 msgr2=0x7fbe0c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe2ab28700 1 --2- 172.21.15.78:0/1876761907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c003e10 0x7fbe0c004690 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7fbe14009ab0 tx=0x7fbe14009060).stop 2023-08-17T18:12:11.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe290c5700 1 -- 172.21.15.78:0/1876761907 reap_dead start 2023-08-17T18:12:11.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1876761907 shutdown_connections 2023-08-17T18:12:11.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1876761907 >> 172.21.15.78:0/1876761907 conn(0x7fbe240c7b80 msgr2=0x7fbe240c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:11.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1876761907 shutdown_connections 2023-08-17T18:12:11.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.988+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1876761907 wait complete. 2023-08-17T18:12:11.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.989+0000 7fbe2ab28700 1 Processor -- start 2023-08-17T18:12:11.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.989+0000 7fbe2ab28700 1 -- start start 2023-08-17T18:12:11.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe2ab28700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe0c003e10 0x7fbe240bec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe2ab28700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe241518b0 0x7fbe2414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe2ab28700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe24162290 0x7fbe241626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:11.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe2ab28700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe24151d10 con 0x7fbe24162290 2023-08-17T18:12:11.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe2ab28700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe240bfb10 con 0x7fbe241518b0 2023-08-17T18:12:11.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe2ab28700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe241612f0 con 0x7fbe0c003e10 2023-08-17T18:12:11.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe290c5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe24162290 0x7fbe241626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe290c5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe24162290 0x7fbe241626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55664/0 (socket says 172.21.15.78:55664) 2023-08-17T18:12:11.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe290c5700 1 -- 172.21.15.78:0/1315000537 learned_addr learned my addr 172.21.15.78:0/1315000537 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:11.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe1bfff700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe241518b0 0x7fbe2414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.990+0000 7fbe288c4700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe0c003e10 0x7fbe240bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe290c5700 1 -- 172.21.15.78:0/1315000537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe0c003e10 msgr2=0x7fbe240bec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe290c5700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe0c003e10 0x7fbe240bec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe290c5700 1 -- 172.21.15.78:0/1315000537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe241518b0 msgr2=0x7fbe2414cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe290c5700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe241518b0 0x7fbe2414cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe290c5700 1 -- 172.21.15.78:0/1315000537 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240c07a0 con 0x7fbe24162290 2023-08-17T18:12:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe288c4700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe0c003e10 0x7fbe240bec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe290c5700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe24162290 0x7fbe241626f0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7fbe1c0094d0 tx=0x7fbe1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:11.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe18ff9700 1 -- 172.21.15.78:0/1315000537 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00e040 con 0x7fbe24162290 2023-08-17T18:12:11.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe18ff9700 1 -- 172.21.15.78:0/1315000537 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c00f040 con 0x7fbe24162290 2023-08-17T18:12:11.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1315000537 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2414d1f0 con 0x7fbe24162290 2023-08-17T18:12:11.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe18ff9700 1 -- 172.21.15.78:0/1315000537 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00fe50 con 0x7fbe24162290 2023-08-17T18:12:11.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.991+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1315000537 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe240bf550 con 0x7fbe24162290 2023-08-17T18:12:11.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.992+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1315000537 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe24161480 con 0x7fbe24162290 2023-08-17T18:12:11.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.992+0000 7fbe18ff9700 1 -- 172.21.15.78:0/1315000537 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbe1c015660 con 0x7fbe24162290 2023-08-17T18:12:11.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.992+0000 7fbe18ff9700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe1005ed90 0x7fbe10061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.993+0000 7fbe18ff9700 1 -- 172.21.15.78:0/1315000537 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fbe1c07a4e0 con 0x7fbe24162290 2023-08-17T18:12:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.993+0000 7fbe288c4700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe1005ed90 0x7fbe10061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.993+0000 7fbe288c4700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe1005ed90 0x7fbe10061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbe20000e10 tx=0x7fbe20009040).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:11.996+0000 7fbe18ff9700 1 -- 172.21.15.78:0/1315000537 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe1c04bb50 con 0x7fbe24162290 2023-08-17T18:12:12.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.162+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1315000537 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fbe24068270 con 0x7fbe24162290 2023-08-17T18:12:12.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.165+0000 7fbe18ff9700 1 -- 172.21.15.78:0/1315000537 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v37) v1 ==== 120+0+0 (secure 0 0 0) 0x7fbe1c04f170 con 0x7fbe24162290 2023-08-17T18:12:12.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1315000537 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe1005ed90 msgr2=0x7fbe10061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe1005ed90 0x7fbe10061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbe20000e10 tx=0x7fbe20009040).stop 2023-08-17T18:12:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1315000537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe24162290 msgr2=0x7fbe241626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe24162290 0x7fbe241626f0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7fbe1c0094d0 tx=0x7fbe1c00b040).stop 2023-08-17T18:12:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1315000537 shutdown_connections 2023-08-17T18:12:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbe1005ed90 0x7fbe10061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe24162290 0x7fbe241626f0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe0c003e10 0x7fbe240bec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 --2- 172.21.15.78:0/1315000537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe241518b0 0x7fbe2414cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1315000537 >> 172.21.15.78:0/1315000537 conn(0x7fbe240c7b80 msgr2=0x7fbe240bd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:12.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.167+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1315000537 shutdown_connections 2023-08-17T18:12:12.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.168+0000 7fbe2ab28700 1 -- 172.21.15.78:0/1315000537 wait complete. 2023-08-17T18:12:12.179 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-08-17T18:12:12.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.291+0000 7f400e209700 1 Processor -- start 2023-08-17T18:12:12.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.292+0000 7f400e209700 1 -- start start 2023-08-17T18:12:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.292+0000 7f400e209700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4008154140 0x7f40080c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.292+0000 7f400e209700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40080c1010 0x7f40080ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.292+0000 7f400e209700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4008154520 con 0x7f40080a7c40 2023-08-17T18:12:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.292+0000 7f400e209700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40080c91e0 con 0x7f40080c1010 2023-08-17T18:12:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.292+0000 7f400e209700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40080c94c0 con 0x7f4008154140 2023-08-17T18:12:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.292+0000 7f4007fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40080c1010 0x7f40080ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4007fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40080c1010 0x7f40080ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55672/0 (socket says 172.21.15.78:55672) 2023-08-17T18:12:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4007fff700 1 -- 172.21.15.78:0/3439969180 learned_addr learned my addr 172.21.15.78:0/3439969180 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f40077fe700 1 --2- 172.21.15.78:0/3439969180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4008154140 0x7f40080c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4007fff700 1 -- 172.21.15.78:0/3439969180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4008154140 msgr2=0x7f40080c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4007fff700 1 --2- 172.21.15.78:0/3439969180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4008154140 0x7f40080c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4007fff700 1 -- 172.21.15.78:0/3439969180 >> v1:172.21.15.150:6789/0 conn(0x7f40080a7c40 legacy=0x7f40080c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4007fff700 1 -- 172.21.15.78:0/3439969180 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080c97a0 con 0x7f40080c1010 2023-08-17T18:12:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4006ffd700 1 -- 172.21.15.78:0/3439969180 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424944338 0 0) 0x7f4008154520 con 0x7f40080a7c40 2023-08-17T18:12:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4007fff700 1 --2- 172.21.15.78:0/3439969180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 0x7f40080ca280 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f4000009f20 tx=0x7f4000009840).ready entity=mon.0 client_cookie=d47bfa7e5d088e83 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4006ffd700 1 -- 172.21.15.78:0/3439969180 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000e070 con 0x7f40080c1010 2023-08-17T18:12:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4006ffd700 1 -- 172.21.15.78:0/3439969180 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000b9d0 con 0x7f40080c1010 2023-08-17T18:12:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.293+0000 7f4006ffd700 1 -- 172.21.15.78:0/3439969180 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000bd50 con 0x7f40080c1010 2023-08-17T18:12:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.294+0000 7f400e209700 1 -- 172.21.15.78:0/3439969180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 msgr2=0x7f40080ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.294+0000 7f400e209700 1 --2- 172.21.15.78:0/3439969180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 0x7f40080ca280 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f4000009f20 tx=0x7f4000009840).stop 2023-08-17T18:12:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.294+0000 7f400e209700 1 -- 172.21.15.78:0/3439969180 shutdown_connections 2023-08-17T18:12:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.294+0000 7f400e209700 1 --2- 172.21.15.78:0/3439969180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 0x7f40080ca280 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.294+0000 7f400e209700 1 --2- 172.21.15.78:0/3439969180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4008154140 0x7f40080c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.294+0000 7f400e209700 1 -- 172.21.15.78:0/3439969180 >> 172.21.15.78:0/3439969180 conn(0x7f4008094510 msgr2=0x7f400806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.294+0000 7f400e209700 1 -- 172.21.15.78:0/3439969180 shutdown_connections 2023-08-17T18:12:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.294+0000 7f400e209700 1 -- 172.21.15.78:0/3439969180 wait complete. 2023-08-17T18:12:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.295+0000 7f400e209700 1 Processor -- start 2023-08-17T18:12:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.295+0000 7f400e209700 1 -- start start 2023-08-17T18:12:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f400e209700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080a7c40 0x7f40081409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f400e209700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 0x7f400814f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f400e209700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4008154140 0x7f40080c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f400e209700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40081508a0 con 0x7f40080c1010 2023-08-17T18:12:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f400e209700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400814fc90 con 0x7f40080a7c40 2023-08-17T18:12:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f400e209700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400814ff70 con 0x7f4008154140 2023-08-17T18:12:12.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f3ffeffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 0x7f400814f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f3ffeffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 0x7f400814f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55680/0 (socket says 172.21.15.78:55680) 2023-08-17T18:12:12.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f3ffeffd700 1 -- 172.21.15.78:0/3376838510 learned_addr learned my addr 172.21.15.78:0/3376838510 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:12.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f4007fff700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4008154140 0x7f40080c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f40077fe700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080a7c40 0x7f40081409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f3ffeffd700 1 -- 172.21.15.78:0/3376838510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4008154140 msgr2=0x7f40080c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f3ffeffd700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4008154140 0x7f40080c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f3ffeffd700 1 -- 172.21.15.78:0/3376838510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080a7c40 msgr2=0x7f40081409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f3ffeffd700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080a7c40 0x7f40081409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f3ffeffd700 1 -- 172.21.15.78:0/3376838510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4000009ae0 con 0x7f40080c1010 2023-08-17T18:12:12.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f3ffeffd700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 0x7f400814f2b0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7f3ff000c490 tx=0x7f3ff0007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:12.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.296+0000 7f3ffffff700 1 -- 172.21.15.78:0/3376838510 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0001ea0 con 0x7f40080c1010 2023-08-17T18:12:12.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.297+0000 7f3ffffff700 1 -- 172.21.15.78:0/3376838510 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0007020 con 0x7f40080c1010 2023-08-17T18:12:12.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.297+0000 7f400e209700 1 -- 172.21.15.78:0/3376838510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4008150250 con 0x7f40080c1010 2023-08-17T18:12:12.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.297+0000 7f3ffffff700 1 -- 172.21.15.78:0/3376838510 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff00073c0 con 0x7f40080c1010 2023-08-17T18:12:12.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.297+0000 7f400e209700 1 -- 172.21.15.78:0/3376838510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4008140ed0 con 0x7f40080c1010 2023-08-17T18:12:12.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.297+0000 7f400e209700 1 -- 172.21.15.78:0/3376838510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4008150a10 con 0x7f40080c1010 2023-08-17T18:12:12.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.298+0000 7f3ffffff700 1 -- 172.21.15.78:0/3376838510 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3ff0010070 con 0x7f40080c1010 2023-08-17T18:12:12.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.298+0000 7f3ffffff700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3fe805ed90 0x7f3fe8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.298+0000 7f3ffffff700 1 -- 172.21.15.78:0/3376838510 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f3ff00792c0 con 0x7f40080c1010 2023-08-17T18:12:12.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.298+0000 7f40077fe700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3fe805ed90 0x7f3fe8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.299+0000 7f40077fe700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3fe805ed90 0x7f3fe8061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f40080c6b00 tx=0x7f3ff8009060).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:12.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.302+0000 7f3ffffff700 1 -- 172.21.15.78:0/3376838510 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ff004a990 con 0x7f40080c1010 2023-08-17T18:12:12.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.529+0000 7f400e209700 1 -- 172.21.15.78:0/3376838510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f4008047350 con 0x7f40080c1010 2023-08-17T18:12:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.720+0000 7f3ffffff700 1 -- 172.21.15.78:0/3376838510 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1314) v1 ==== 163+0+0 (secure 0 0 0) 0x7f3ff004dfb0 con 0x7f40080c1010 2023-08-17T18:12:12.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.722+0000 7f400e209700 1 -- 172.21.15.78:0/3376838510 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3fe805ed90 msgr2=0x7f3fe8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.722+0000 7f400e209700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3fe805ed90 0x7f3fe8061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f40080c6b00 tx=0x7f3ff8009060).stop 2023-08-17T18:12:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.722+0000 7f400e209700 1 -- 172.21.15.78:0/3376838510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 msgr2=0x7f400814f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.722+0000 7f400e209700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 0x7f400814f2b0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7f3ff000c490 tx=0x7f3ff0007dd0).stop 2023-08-17T18:12:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.722+0000 7f400e209700 1 -- 172.21.15.78:0/3376838510 shutdown_connections 2023-08-17T18:12:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.722+0000 7f400e209700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3fe805ed90 0x7f3fe8061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.722+0000 7f400e209700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4008154140 0x7f40080c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.722+0000 7f400e209700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080a7c40 0x7f40081409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.722+0000 7f400e209700 1 --2- 172.21.15.78:0/3376838510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40080c1010 0x7f400814f2b0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.722+0000 7f400e209700 1 -- 172.21.15.78:0/3376838510 >> 172.21.15.78:0/3376838510 conn(0x7f4008094510 msgr2=0x7f40080caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:12.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.723+0000 7f400e209700 1 -- 172.21.15.78:0/3376838510 shutdown_connections 2023-08-17T18:12:12.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.723+0000 7f400e209700 1 -- 172.21.15.78:0/3376838510 wait complete. 2023-08-17T18:12:12.734 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-08-17T18:12:12.735 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-08-17T18:12:12.735 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-08-17T18:12:12.735 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-08-17T18:12:12.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.848+0000 7fb86fcc6700 1 Processor -- start 2023-08-17T18:12:12.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.848+0000 7fb86fcc6700 1 -- start start 2023-08-17T18:12:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86fcc6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb868154140 0x7fb8680c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86fcc6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8680a7c40 0x7fb8680c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86fcc6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb868154520 con 0x7fb8680a8080 2023-08-17T18:12:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86fcc6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8680c91e0 con 0x7fb8680a7c40 2023-08-17T18:12:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86fcc6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680c94c0 con 0x7fb868154140 2023-08-17T18:12:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86d261700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8680a7c40 0x7fb8680c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86d261700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8680a7c40 0x7fb8680c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55696/0 (socket says 172.21.15.78:55696) 2023-08-17T18:12:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86d261700 1 -- 172.21.15.78:0/2778320321 learned_addr learned my addr 172.21.15.78:0/2778320321 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86d261700 1 -- 172.21.15.78:0/2778320321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb868154140 msgr2=0x7fb8680c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86d261700 1 --2- 172.21.15.78:0/2778320321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb868154140 0x7fb8680c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86d261700 1 -- 172.21.15.78:0/2778320321 >> v1:172.21.15.150:6789/0 conn(0x7fb8680a8080 legacy=0x7fb8680ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86d261700 1 -- 172.21.15.78:0/2778320321 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8680c97a0 con 0x7fb8680a7c40 2023-08-17T18:12:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86d261700 1 --2- 172.21.15.78:0/2778320321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a7c40 0x7fb8680c0900 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7fb858006fd0 tx=0x7fb8580090f0).ready entity=mon.0 client_cookie=a8c2825750eeec71 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86ca60700 1 -- 172.21.15.78:0/2778320321 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800b600 con 0x7fb8680a7c40 2023-08-17T18:12:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86ca60700 1 -- 172.21.15.78:0/2778320321 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800b760 con 0x7fb8680a7c40 2023-08-17T18:12:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.849+0000 7fb86ca60700 1 -- 172.21.15.78:0/2778320321 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800bae0 con 0x7fb8680a7c40 2023-08-17T18:12:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.850+0000 7fb86fcc6700 1 -- 172.21.15.78:0/2778320321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a7c40 msgr2=0x7fb8680c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.850+0000 7fb86fcc6700 1 --2- 172.21.15.78:0/2778320321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a7c40 0x7fb8680c0900 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7fb858006fd0 tx=0x7fb8580090f0).stop 2023-08-17T18:12:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.850+0000 7fb86fcc6700 1 -- 172.21.15.78:0/2778320321 shutdown_connections 2023-08-17T18:12:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.850+0000 7fb86fcc6700 1 --2- 172.21.15.78:0/2778320321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb868154140 0x7fb8680c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.850+0000 7fb86fcc6700 1 --2- 172.21.15.78:0/2778320321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a7c40 0x7fb8680c0900 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.850+0000 7fb86fcc6700 1 -- 172.21.15.78:0/2778320321 >> 172.21.15.78:0/2778320321 conn(0x7fb868094510 msgr2=0x7fb86806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.850+0000 7fb86fcc6700 1 -- 172.21.15.78:0/2778320321 shutdown_connections 2023-08-17T18:12:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.850+0000 7fb86fcc6700 1 -- 172.21.15.78:0/2778320321 wait complete. 2023-08-17T18:12:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.851+0000 7fb86fcc6700 1 Processor -- start 2023-08-17T18:12:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.851+0000 7fb86fcc6700 1 -- start start 2023-08-17T18:12:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86fcc6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a8080 0x7fb8681439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86fcc6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb868154140 0x7fb8680c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86fcc6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8680ab230 0x7fb8680ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86fcc6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680ac340 con 0x7fb8680a8080 2023-08-17T18:12:12.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86fcc6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb868143e90 con 0x7fb8680ab230 2023-08-17T18:12:12.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86fcc6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680ab730 con 0x7fb868154140 2023-08-17T18:12:12.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86da62700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a8080 0x7fb8681439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86da62700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a8080 0x7fb8681439a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55704/0 (socket says 172.21.15.78:55704) 2023-08-17T18:12:12.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86da62700 1 -- 172.21.15.78:0/1002787875 learned_addr learned my addr 172.21.15.78:0/1002787875 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:12.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86e263700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8680ab230 0x7fb8680ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86d261700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb868154140 0x7fb8680c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86da62700 1 -- 172.21.15.78:0/1002787875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb868154140 msgr2=0x7fb8680c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86da62700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb868154140 0x7fb8680c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86da62700 1 -- 172.21.15.78:0/1002787875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8680ab230 msgr2=0x7fb8680ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86da62700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8680ab230 0x7fb8680ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86da62700 1 -- 172.21.15.78:0/1002787875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009370 con 0x7fb8680a8080 2023-08-17T18:12:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86e263700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8680ab230 0x7fb8680ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb86da62700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a8080 0x7fb8681439a0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fb86000b560 tx=0x7fb8600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.852+0000 7fb85dffb700 1 -- 172.21.15.78:0/1002787875 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000d4a0 con 0x7fb8680a8080 2023-08-17T18:12:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.853+0000 7fb85dffb700 1 -- 172.21.15.78:0/1002787875 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86000d620 con 0x7fb8680a8080 2023-08-17T18:12:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.853+0000 7fb86fcc6700 1 -- 172.21.15.78:0/1002787875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8680aba10 con 0x7fb8680a8080 2023-08-17T18:12:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.853+0000 7fb85dffb700 1 -- 172.21.15.78:0/1002787875 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000d9e0 con 0x7fb8680a8080 2023-08-17T18:12:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.853+0000 7fb86fcc6700 1 -- 172.21.15.78:0/1002787875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8680abfd0 con 0x7fb8680a8080 2023-08-17T18:12:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.854+0000 7fb86fcc6700 1 -- 172.21.15.78:0/1002787875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb868047350 con 0x7fb8680a8080 2023-08-17T18:12:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.854+0000 7fb85dffb700 1 -- 172.21.15.78:0/1002787875 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb86000f030 con 0x7fb8680a8080 2023-08-17T18:12:12.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.854+0000 7fb85dffb700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb84c05ed90 0x7fb84c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:12.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.854+0000 7fb85dffb700 1 -- 172.21.15.78:0/1002787875 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fb860079780 con 0x7fb8680a8080 2023-08-17T18:12:12.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.854+0000 7fb86d261700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb84c05ed90 0x7fb84c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:12.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.855+0000 7fb86d261700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb84c05ed90 0x7fb84c061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb858006fd0 tx=0x7fb858017000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:12.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:12.858+0000 7fb85dffb700 1 -- 172.21.15.78:0/1002787875 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb86004ae50 con 0x7fb8680a8080 2023-08-17T18:12:13.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.085+0000 7fb86fcc6700 1 -- 172.21.15.78:0/1002787875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fb8680ae750 con 0x7fb8680a8080 2023-08-17T18:12:13.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.722+0000 7fb85dffb700 1 -- 172.21.15.78:0/1002787875 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1315) v1 ==== 158+0+0 (secure 0 0 0) 0x7fb86004e470 con 0x7fb8680a8080 2023-08-17T18:12:13.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 -- 172.21.15.78:0/1002787875 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb84c05ed90 msgr2=0x7fb84c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:13.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb84c05ed90 0x7fb84c061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb858006fd0 tx=0x7fb858017000).stop 2023-08-17T18:12:13.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 -- 172.21.15.78:0/1002787875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a8080 msgr2=0x7fb8681439a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a8080 0x7fb8681439a0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fb86000b560 tx=0x7fb8600090f0).stop 2023-08-17T18:12:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 -- 172.21.15.78:0/1002787875 shutdown_connections 2023-08-17T18:12:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb84c05ed90 0x7fb84c061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8680ab230 0x7fb8680ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8680a8080 0x7fb8681439a0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 --2- 172.21.15.78:0/1002787875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb868154140 0x7fb8680c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 -- 172.21.15.78:0/1002787875 >> 172.21.15.78:0/1002787875 conn(0x7fb868094510 msgr2=0x7fb868063050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 -- 172.21.15.78:0/1002787875 shutdown_connections 2023-08-17T18:12:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.724+0000 7fb86fcc6700 1 -- 172.21.15.78:0/1002787875 wait complete. 2023-08-17T18:12:13.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T18:12:13.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.852+0000 7efc4620e700 1 Processor -- start 2023-08-17T18:12:13.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.852+0000 7efc4620e700 1 -- start start 2023-08-17T18:12:13.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.853+0000 7efc4620e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc400bcb30 0x7efc4013a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:13.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.853+0000 7efc4620e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc400652c0 con 0x7efc4013a500 2023-08-17T18:12:13.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.853+0000 7efc4620e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc40065560 con 0x7efc400bdf40 2023-08-17T18:12:13.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.853+0000 7efc4620e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc40065840 con 0x7efc400bcb30 2023-08-17T18:12:13.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.853+0000 7efc3ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc400bcb30 0x7efc4013a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:13.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.853+0000 7efc3ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc400bcb30 0x7efc4013a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55710/0 (socket says 172.21.15.78:55710) 2023-08-17T18:12:13.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.853+0000 7efc3f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efc4013a500 0x7efc400bd830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41674/0 (socket says 172.21.15.78:41674) 2023-08-17T18:12:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.853+0000 7efc3ffff700 1 -- 172.21.15.78:0/80184618 learned_addr learned my addr 172.21.15.78:0/80184618 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc3ffff700 1 -- 172.21.15.78:0/80184618 >> v1:172.21.15.150:6789/0 conn(0x7efc400bdf40 legacy=0x7efc40066320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc3ffff700 1 -- 172.21.15.78:0/80184618 >> v1:172.21.15.78:6789/0 conn(0x7efc4013a500 legacy=0x7efc400bd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc3ffff700 1 -- 172.21.15.78:0/80184618 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40065b20 con 0x7efc400bcb30 2023-08-17T18:12:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc3e7fc700 1 -- 172.21.15.78:0/80184618 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226882307 0 0) 0x7efc400652c0 con 0x7efc4013a500 2023-08-17T18:12:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc3ffff700 1 --2- 172.21.15.78:0/80184618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bcb30 0x7efc4013a8e0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7efc38009f20 tx=0x7efc38009840).ready entity=mon.0 client_cookie=534b697baac80c3c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc3e7fc700 1 -- 172.21.15.78:0/80184618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800e070 con 0x7efc400bcb30 2023-08-17T18:12:13.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc3e7fc700 1 -- 172.21.15.78:0/80184618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3800ba40 con 0x7efc400bcb30 2023-08-17T18:12:13.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc3e7fc700 1 -- 172.21.15.78:0/80184618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800bdc0 con 0x7efc400bcb30 2023-08-17T18:12:13.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc4620e700 1 -- 172.21.15.78:0/80184618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bcb30 msgr2=0x7efc4013a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:13.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc4620e700 1 --2- 172.21.15.78:0/80184618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bcb30 0x7efc4013a8e0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7efc38009f20 tx=0x7efc38009840).stop 2023-08-17T18:12:13.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc4620e700 1 -- 172.21.15.78:0/80184618 shutdown_connections 2023-08-17T18:12:13.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc4620e700 1 --2- 172.21.15.78:0/80184618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bcb30 0x7efc4013a8e0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc4620e700 1 -- 172.21.15.78:0/80184618 >> 172.21.15.78:0/80184618 conn(0x7efc400c7bd0 msgr2=0x7efc400c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc4620e700 1 -- 172.21.15.78:0/80184618 shutdown_connections 2023-08-17T18:12:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.854+0000 7efc4620e700 1 -- 172.21.15.78:0/80184618 wait complete. 2023-08-17T18:12:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.856+0000 7efc4620e700 1 Processor -- start 2023-08-17T18:12:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.856+0000 7efc4620e700 1 -- start start 2023-08-17T18:12:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.856+0000 7efc4620e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc400bcb30 0x7efc40150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.856+0000 7efc4620e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bdf40 0x7efc400c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.856+0000 7efc4620e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc4013a500 0x7efc400bfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.856+0000 7efc4620e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc40134030 con 0x7efc400bdf40 2023-08-17T18:12:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.856+0000 7efc4620e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc40131fa0 con 0x7efc400bcb30 2023-08-17T18:12:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.856+0000 7efc4620e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc40150430 con 0x7efc4013a500 2023-08-17T18:12:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bdf40 0x7efc400c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bdf40 0x7efc400c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55720/0 (socket says 172.21.15.78:55720) 2023-08-17T18:12:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3effd700 1 -- 172.21.15.78:0/2879666162 learned_addr learned my addr 172.21.15.78:0/2879666162 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3ffff700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc4013a500 0x7efc400bfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3f7fe700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc400bcb30 0x7efc40150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3effd700 1 -- 172.21.15.78:0/2879666162 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc4013a500 msgr2=0x7efc400bfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3effd700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc4013a500 0x7efc400bfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3effd700 1 -- 172.21.15.78:0/2879666162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc400bcb30 msgr2=0x7efc40150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3effd700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc400bcb30 0x7efc40150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3effd700 1 -- 172.21.15.78:0/2879666162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc38009ae0 con 0x7efc400bdf40 2023-08-17T18:12:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3f7fe700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc400bcb30 0x7efc40150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc3effd700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bdf40 0x7efc400c6fc0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7efc3400c470 tx=0x7efc34007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc277fe700 1 -- 172.21.15.78:0/2879666162 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3400ce90 con 0x7efc400bdf40 2023-08-17T18:12:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc277fe700 1 -- 172.21.15.78:0/2879666162 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3400f470 con 0x7efc400bdf40 2023-08-17T18:12:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc4620e700 1 -- 172.21.15.78:0/2879666162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc40134240 con 0x7efc400bdf40 2023-08-17T18:12:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc277fe700 1 -- 172.21.15.78:0/2879666162 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3400f810 con 0x7efc400bdf40 2023-08-17T18:12:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.857+0000 7efc4620e700 1 -- 172.21.15.78:0/2879666162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc40134800 con 0x7efc400bdf40 2023-08-17T18:12:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.858+0000 7efc4620e700 1 -- 172.21.15.78:0/2879666162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc40132150 con 0x7efc400bdf40 2023-08-17T18:12:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.858+0000 7efc277fe700 1 -- 172.21.15.78:0/2879666162 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efc34019030 con 0x7efc400bdf40 2023-08-17T18:12:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.859+0000 7efc277fe700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc2c05ed90 0x7efc2c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.859+0000 7efc277fe700 1 -- 172.21.15.78:0/2879666162 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5813+0+0 (secure 0 0 0) 0x7efc34078cf0 con 0x7efc400bdf40 2023-08-17T18:12:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.859+0000 7efc3f7fe700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc2c05ed90 0x7efc2c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.859+0000 7efc3f7fe700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc2c05ed90 0x7efc2c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7efc300057e0 tx=0x7efc30007cb0).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:13.863+0000 7efc277fe700 1 -- 172.21.15.78:0/2879666162 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc340488f0 con 0x7efc400bdf40 2023-08-17T18:12:14.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.025+0000 7efc4620e700 1 -- 172.21.15.78:0/2879666162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efc400c57d0 con 0x7efc400bdf40 2023-08-17T18:12:14.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.028+0000 7efc277fe700 1 -- 172.21.15.78:0/2879666162 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7efc40132150 con 0x7efc400bdf40 2023-08-17T18:12:14.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 -- 172.21.15.78:0/2879666162 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc2c05ed90 msgr2=0x7efc2c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc2c05ed90 0x7efc2c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7efc300057e0 tx=0x7efc30007cb0).stop 2023-08-17T18:12:14.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 -- 172.21.15.78:0/2879666162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bdf40 msgr2=0x7efc400c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bdf40 0x7efc400c6fc0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7efc3400c470 tx=0x7efc34007de0).stop 2023-08-17T18:12:14.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 -- 172.21.15.78:0/2879666162 shutdown_connections 2023-08-17T18:12:14.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7efc2c05ed90 0x7efc2c061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc4013a500 0x7efc400bfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc400bcb30 0x7efc40150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 --2- 172.21.15.78:0/2879666162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc400bdf40 0x7efc400c6fc0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 -- 172.21.15.78:0/2879666162 >> 172.21.15.78:0/2879666162 conn(0x7efc400c7bd0 msgr2=0x7efc400acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:14.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.030+0000 7efc4620e700 1 -- 172.21.15.78:0/2879666162 shutdown_connections 2023-08-17T18:12:14.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.031+0000 7efc4620e700 1 -- 172.21.15.78:0/2879666162 wait complete. 2023-08-17T18:12:14.042 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T18:12:14.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T18:12:14.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T18:12:14.127 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T18:12:14.128 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T18:12:14.128 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:14.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.243+0000 7fb20fa0d700 1 Processor -- start 2023-08-17T18:12:14.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.243+0000 7fb20fa0d700 1 -- start start 2023-08-17T18:12:14.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb20fa0d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb208154140 0x7fb2080c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb20fa0d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb208154520 con 0x7fb2080c1010 2023-08-17T18:12:14.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb20fa0d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2080c91e0 con 0x7fb2080a7c40 2023-08-17T18:12:14.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb20fa0d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2080c94c0 con 0x7fb208154140 2023-08-17T18:12:14.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb20dfaa700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb2080c1010 0x7fb2080ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41690/0 (socket says 172.21.15.78:41690) 2023-08-17T18:12:14.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb20dfaa700 1 -- 172.21.15.78:0/865219799 learned_addr learned my addr 172.21.15.78:0/865219799 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:14.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958393852 0 0) 0x7fb208154520 con 0x7fb2080c1010 2023-08-17T18:12:14.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1f40033f0 con 0x7fb2080c1010 2023-08-17T18:12:14.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb20d7a9700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb208154140 0x7fb2080c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3715916342 0 0) 0x7fb1f40033f0 con 0x7fb2080c1010 2023-08-17T18:12:14.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb208154140 msgr2=0x7fb2080c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:14.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb208154140 0x7fb2080c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 >> v1:172.21.15.150:6789/0 conn(0x7fb2080a7c40 legacy=0x7fb2080c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2080c97a0 con 0x7fb2080c1010 2023-08-17T18:12:14.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fb200001470 con 0x7fb2080c1010 2023-08-17T18:12:14.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 >> v1:172.21.15.78:6789/0 conn(0x7fb2080c1010 legacy=0x7fb2080ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 0x7fb1f4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f4004690 0x7fb1f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb208154140 0x7fb1f4005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2080c94c0 con 0x7fb1f4003910 2023-08-17T18:12:14.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f400b9c0 con 0x7fb1f4004690 2023-08-17T18:12:14.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f400bb80 con 0x7fb208154140 2023-08-17T18:12:14.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.244+0000 7fb20d7a9700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 0x7fb1f4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20cfa8700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f4004690 0x7fb1f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20dfaa700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb208154140 0x7fb1f4005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20d7a9700 1 -- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb208154140 msgr2=0x7fb1f4005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:14.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20d7a9700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb208154140 0x7fb1f4005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20d7a9700 1 -- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f4004690 msgr2=0x7fb1f4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:14.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20d7a9700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1f4004690 0x7fb1f4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20d7a9700 1 -- 172.21.15.78:0/865219799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40033f0 con 0x7fb1f4003910 2023-08-17T18:12:14.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20d7a9700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 0x7fb1f4003d30 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7fb204007470 tx=0x7fb2040096f0).ready entity=mon.0 client_cookie=217d3592409bd7da server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:14.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204009a20 con 0x7fb1f4003910 2023-08-17T18:12:14.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb204007d20 con 0x7fb1f4003910 2023-08-17T18:12:14.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb1fffff700 1 -- 172.21.15.78:0/865219799 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204015640 con 0x7fb1f4003910 2023-08-17T18:12:14.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20fa0d700 1 -- 172.21.15.78:0/865219799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 msgr2=0x7fb1f4003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20fa0d700 1 --2- 172.21.15.78:0/865219799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 0x7fb1f4003d30 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7fb204007470 tx=0x7fb2040096f0).stop 2023-08-17T18:12:14.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.245+0000 7fb20dfaa700 1 -- 172.21.15.78:0/865219799 reap_dead start 2023-08-17T18:12:14.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.246+0000 7fb20fa0d700 1 -- 172.21.15.78:0/865219799 shutdown_connections 2023-08-17T18:12:14.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.246+0000 7fb20fa0d700 1 -- 172.21.15.78:0/865219799 >> 172.21.15.78:0/865219799 conn(0x7fb208094510 msgr2=0x7fb20806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:14.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.246+0000 7fb20fa0d700 1 -- 172.21.15.78:0/865219799 shutdown_connections 2023-08-17T18:12:14.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.246+0000 7fb20fa0d700 1 -- 172.21.15.78:0/865219799 wait complete. 2023-08-17T18:12:14.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.247+0000 7fb20fa0d700 1 Processor -- start 2023-08-17T18:12:14.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.247+0000 7fb20fa0d700 1 -- start start 2023-08-17T18:12:14.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20fa0d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 0x7fb2080ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20fa0d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2080c4f50 0x7fb208150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20fa0d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2080aee50 0x7fb208098150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20fa0d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2080ada60 con 0x7fb1f4003910 2023-08-17T18:12:14.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20fa0d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2080c2870 con 0x7fb2080aee50 2023-08-17T18:12:14.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20fa0d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2080ac050 con 0x7fb2080c4f50 2023-08-17T18:12:14.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20d7a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 0x7fb2080ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20d7a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 0x7fb2080ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55746/0 (socket says 172.21.15.78:55746) 2023-08-17T18:12:14.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20d7a9700 1 -- 172.21.15.78:0/2512658307 learned_addr learned my addr 172.21.15.78:0/2512658307 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:14.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20dfaa700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2080aee50 0x7fb208098150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20cfa8700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2080c4f50 0x7fb208150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20d7a9700 1 -- 172.21.15.78:0/2512658307 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2080c4f50 msgr2=0x7fb208150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20d7a9700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2080c4f50 0x7fb208150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20d7a9700 1 -- 172.21.15.78:0/2512658307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2080aee50 msgr2=0x7fb208098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20d7a9700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2080aee50 0x7fb208098150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20d7a9700 1 -- 172.21.15.78:0/2512658307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2080c2ac0 con 0x7fb1f4003910 2023-08-17T18:12:14.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20d7a9700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 0x7fb2080ab7b0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fb2040146e0 tx=0x7fb204018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:14.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb1fd7fa700 1 -- 172.21.15.78:0/2512658307 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204009a20 con 0x7fb1f4003910 2023-08-17T18:12:14.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb1fd7fa700 1 -- 172.21.15.78:0/2512658307 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb204007e90 con 0x7fb1f4003910 2023-08-17T18:12:14.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20fa0d700 1 -- 172.21.15.78:0/2512658307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2080c2da0 con 0x7fb1f4003910 2023-08-17T18:12:14.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb1fd7fa700 1 -- 172.21.15.78:0/2512658307 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2040096f0 con 0x7fb1f4003910 2023-08-17T18:12:14.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.248+0000 7fb20fa0d700 1 -- 172.21.15.78:0/2512658307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2080ac580 con 0x7fb1f4003910 2023-08-17T18:12:14.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.249+0000 7fb20fa0d700 1 -- 172.21.15.78:0/2512658307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2080ac770 con 0x7fb1f4003910 2023-08-17T18:12:14.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.250+0000 7fb1fd7fa700 1 -- 172.21.15.78:0/2512658307 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb204027030 con 0x7fb1f4003910 2023-08-17T18:12:14.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.250+0000 7fb1fd7fa700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb1ec05edc0 0x7fb1ec061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.250+0000 7fb1fd7fa700 1 -- 172.21.15.78:0/2512658307 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fb20407b5f0 con 0x7fb1f4003910 2023-08-17T18:12:14.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.250+0000 7fb20cfa8700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb1ec05edc0 0x7fb1ec061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.251+0000 7fb20cfa8700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb1ec05edc0 0x7fb1ec061280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb1f8000f60 tx=0x7fb1f8009040).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:14.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.254+0000 7fb1fd7fa700 1 -- 172.21.15.78:0/2512658307 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb20404ccc0 con 0x7fb1f4003910 2023-08-17T18:12:14.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.455+0000 7fb20fa0d700 1 -- 172.21.15.78:0/2512658307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb208047350 con 0x7fb1f4003910 2023-08-17T18:12:14.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.456+0000 7fb1fd7fa700 1 -- 172.21.15.78:0/2512658307 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fb204025070 con 0x7fb1f4003910 2023-08-17T18:12:14.456 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:14.456 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1301951105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1301951105},{"type":"v1","addr":"172.21.15.150:6834","nonce":1301951105}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7463,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3403830869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3403830869},{"type":"v1","addr":"172.21.15.150:6835","nonce":3403830869}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3263459818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3263459818},{"type":"v1","addr":"172.21.15.78:6836","nonce":3263459818}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9078,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4038964498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4038964498},{"type":"v1","addr":"172.21.15.78:6837","nonce":4038964498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[]} 2023-08-17T18:12:14.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 -- 172.21.15.78:0/2512658307 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb1ec05edc0 msgr2=0x7fb1ec061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb1ec05edc0 0x7fb1ec061280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb1f8000f60 tx=0x7fb1f8009040).stop 2023-08-17T18:12:14.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 -- 172.21.15.78:0/2512658307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 msgr2=0x7fb2080ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 0x7fb2080ab7b0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fb2040146e0 tx=0x7fb204018000).stop 2023-08-17T18:12:14.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 -- 172.21.15.78:0/2512658307 shutdown_connections 2023-08-17T18:12:14.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb1ec05edc0 0x7fb1ec061280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2080aee50 0x7fb208098150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1f4003910 0x7fb2080ab7b0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 --2- 172.21.15.78:0/2512658307 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2080c4f50 0x7fb208150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 -- 172.21.15.78:0/2512658307 >> 172.21.15.78:0/2512658307 conn(0x7fb208094510 msgr2=0x7fb2080cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:14.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 -- 172.21.15.78:0/2512658307 shutdown_connections 2023-08-17T18:12:14.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.457+0000 7fb20fa0d700 1 -- 172.21.15.78:0/2512658307 wait complete. 2023-08-17T18:12:14.459 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 63 2023-08-17T18:12:14.469 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T18:12:14.469 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T18:12:14.470 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T18:12:14.470 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:12:14.470 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T18:12:14.470 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T18:12:14.471 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T18:12:14.471 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:12:14.471 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T18:12:14.471 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T18:12:14.471 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T18:12:14.472 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:12:14.472 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T18:12:14.472 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T18:12:14.472 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T18:12:14.472 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:12:14.478 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T18:12:14.478 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T18:12:14.479 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T18:12:14.479 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T18:12:14.484 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T18:12:14.485 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T18:12:14.485 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T18:12:14.486 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T18:12:14.520 INFO:tasks.ceph.mds.a:Started 2023-08-17T18:12:14.520 DEBUG:teuthology.parallel:result is None 2023-08-17T18:12:14.521 INFO:tasks.ceph.mds.c:Started 2023-08-17T18:12:14.521 DEBUG:teuthology.parallel:result is None 2023-08-17T18:12:14.527 INFO:tasks.ceph.mds.d:Started 2023-08-17T18:12:14.527 DEBUG:teuthology.parallel:result is None 2023-08-17T18:12:14.528 INFO:tasks.ceph.mds.b:Started 2023-08-17T18:12:14.528 DEBUG:teuthology.parallel:result is None 2023-08-17T18:12:14.529 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T18:12:14.592 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-08-17T18:12:14.592 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-08-17T18:12:14.609 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T18:12:14.609 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-08-17T18:12:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.652+0000 7f7324672700 1 Processor -- start 2023-08-17T18:12:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.652+0000 7f7324672700 1 -- start start 2023-08-17T18:12:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.653+0000 7f7324672700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f731c1555d0 0x7f731c0a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7324672700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f731c062c00 0x7f731c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7324672700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c065890 con 0x7f731c069150 2023-08-17T18:12:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7324672700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c0c3b90 con 0x7f731c062c00 2023-08-17T18:12:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7324672700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c0a7cb0 con 0x7f731c1555d0 2023-08-17T18:12:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7322c0f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f731c062c00 0x7f731c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7321c0d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f731c069150 0x7f731c0624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41716/0 (socket says 172.21.15.78:41716) 2023-08-17T18:12:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7321c0d700 1 -- 172.21.15.78:0/4071870116 learned_addr learned my addr 172.21.15.78:0/4071870116 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f732240e700 1 --2- 172.21.15.78:0/4071870116 >> v2:172.21.15.150:3300/0 conn(0x7f731c1555d0 0x7f731c0a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7322c0f700 1 -- 172.21.15.78:0/4071870116 >> v2:172.21.15.150:3300/0 conn(0x7f731c1555d0 msgr2=0x7f731c0a77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:14.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7322c0f700 1 --2- 172.21.15.78:0/4071870116 >> v2:172.21.15.150:3300/0 conn(0x7f731c1555d0 0x7f731c0a77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7322c0f700 1 -- 172.21.15.78:0/4071870116 >> v1:172.21.15.78:6789/0 conn(0x7f731c069150 legacy=0x7f731c0624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f732140c700 1 -- 172.21.15.78:0/4071870116 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659847544 0 0) 0x7f731c065890 con 0x7f731c069150 2023-08-17T18:12:14.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7322c0f700 1 -- 172.21.15.78:0/4071870116 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0c5230 con 0x7f731c062c00 2023-08-17T18:12:14.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f7322c0f700 1 --2- 172.21.15.78:0/4071870116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 0x7f731c0695e0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f731c05f890 tx=0x7f7314009780).ready entity=mon.0 client_cookie=c759d40d977d9160 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:14.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f732140c700 1 -- 172.21.15.78:0/4071870116 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400e070 con 0x7f731c062c00 2023-08-17T18:12:14.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f732140c700 1 -- 172.21.15.78:0/4071870116 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731400bc30 con 0x7f731c062c00 2023-08-17T18:12:14.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.654+0000 7f732140c700 1 -- 172.21.15.78:0/4071870116 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314012410 con 0x7f731c062c00 2023-08-17T18:12:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.655+0000 7f7324672700 1 -- 172.21.15.78:0/4071870116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 msgr2=0x7f731c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.655+0000 7f7324672700 1 --2- 172.21.15.78:0/4071870116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 0x7f731c0695e0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f731c05f890 tx=0x7f7314009780).stop 2023-08-17T18:12:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.655+0000 7f7324672700 1 -- 172.21.15.78:0/4071870116 shutdown_connections 2023-08-17T18:12:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.655+0000 7f7324672700 1 --2- 172.21.15.78:0/4071870116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 0x7f731c0695e0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.655+0000 7f7324672700 1 --2- 172.21.15.78:0/4071870116 >> v2:172.21.15.150:3300/0 conn(0x7f731c1555d0 0x7f731c0a77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.655+0000 7f7324672700 1 -- 172.21.15.78:0/4071870116 >> 172.21.15.78:0/4071870116 conn(0x7f731c0c8680 msgr2=0x7f731c0c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.655+0000 7f7324672700 1 -- 172.21.15.78:0/4071870116 shutdown_connections 2023-08-17T18:12:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.655+0000 7f7324672700 1 -- 172.21.15.78:0/4071870116 wait complete. 2023-08-17T18:12:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.656+0000 7f7324672700 1 Processor -- start 2023-08-17T18:12:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.656+0000 7f7324672700 1 -- start start 2023-08-17T18:12:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f7324672700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 0x7f731c151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f7324672700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731c069150 0x7f731c0a7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f7324672700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731c1555d0 0x7f731c13a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f7324672700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c152f60 con 0x7f731c062c00 2023-08-17T18:12:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f7324672700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c1523e0 con 0x7f731c1555d0 2023-08-17T18:12:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f7324672700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c1526c0 con 0x7f731c069150 2023-08-17T18:12:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f732240e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 0x7f731c151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f732240e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 0x7f731c151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55786/0 (socket says 172.21.15.78:55786) 2023-08-17T18:12:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f732240e700 1 -- 172.21.15.78:0/4110468462 learned_addr learned my addr 172.21.15.78:0/4110468462 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f7322c0f700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731c1555d0 0x7f731c13a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f7321c0d700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731c069150 0x7f731c0a7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f732240e700 1 -- 172.21.15.78:0/4110468462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731c069150 msgr2=0x7f731c0a7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f732240e700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731c069150 0x7f731c0a7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f732240e700 1 -- 172.21.15.78:0/4110468462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731c1555d0 msgr2=0x7f731c13a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f732240e700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731c1555d0 0x7f731c13a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f732240e700 1 -- 172.21.15.78:0/4110468462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314009a20 con 0x7f731c062c00 2023-08-17T18:12:14.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.658+0000 7f732240e700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 0x7f731c151ae0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f731800d890 tx=0x7f7318008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.659+0000 7f73127fc700 1 -- 172.21.15.78:0/4110468462 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318011590 con 0x7f731c062c00 2023-08-17T18:12:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.659+0000 7f73127fc700 1 -- 172.21.15.78:0/4110468462 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73180116f0 con 0x7f731c062c00 2023-08-17T18:12:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.659+0000 7f73127fc700 1 -- 172.21.15.78:0/4110468462 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318011a70 con 0x7f731c062c00 2023-08-17T18:12:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.659+0000 7f7324672700 1 -- 172.21.15.78:0/4110468462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c1529a0 con 0x7f731c062c00 2023-08-17T18:12:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.659+0000 7f7324672700 1 -- 172.21.15.78:0/4110468462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c151fd0 con 0x7f731c062c00 2023-08-17T18:12:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.660+0000 7f7324672700 1 -- 172.21.15.78:0/4110468462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c0aad90 con 0x7f731c062c00 2023-08-17T18:12:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.661+0000 7f73127fc700 1 -- 172.21.15.78:0/4110468462 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7318012420 con 0x7f731c062c00 2023-08-17T18:12:14.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.661+0000 7f73127fc700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f730005ed90 0x7f7300061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:14.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.661+0000 7f73127fc700 1 -- 172.21.15.78:0/4110468462 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5785+0+0 (secure 0 0 0) 0x7f7318079430 con 0x7f731c062c00 2023-08-17T18:12:14.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.661+0000 7f7321c0d700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f730005ed90 0x7f7300061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:14.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.661+0000 7f7321c0d700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f730005ed90 0x7f7300061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f730c0011e0 tx=0x7f730c007bb0).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:14.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.665+0000 7f73127fc700 1 -- 172.21.15.78:0/4110468462 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f731804aac0 con 0x7f731c062c00 2023-08-17T18:12:14.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:14.844+0000 7f7324672700 1 -- 172.21.15.78:0/4110468462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f731c047350 con 0x7f731c062c00 2023-08-17T18:12:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.727+0000 7f73127fc700 1 -- 172.21.15.78:0/4110468462 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v181) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7318011e60 con 0x7f731c062c00 2023-08-17T18:12:15.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 -- 172.21.15.78:0/4110468462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f730005ed90 msgr2=0x7f7300061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:15.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f730005ed90 0x7f7300061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f730c0011e0 tx=0x7f730c007bb0).stop 2023-08-17T18:12:15.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 -- 172.21.15.78:0/4110468462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 msgr2=0x7f731c151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:15.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 0x7f731c151ae0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f731800d890 tx=0x7f7318008040).stop 2023-08-17T18:12:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 -- 172.21.15.78:0/4110468462 shutdown_connections 2023-08-17T18:12:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f730005ed90 0x7f7300061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731c1555d0 0x7f731c13a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f731c062c00 0x7f731c151ae0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 --2- 172.21.15.78:0/4110468462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731c069150 0x7f731c0a7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 -- 172.21.15.78:0/4110468462 >> 172.21.15.78:0/4110468462 conn(0x7f731c0c8680 msgr2=0x7f731c13b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 -- 172.21.15.78:0/4110468462 shutdown_connections 2023-08-17T18:12:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.730+0000 7f7324672700 1 -- 172.21.15.78:0/4110468462 wait complete. 2023-08-17T18:12:15.732 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-08-17T18:12:15.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T18:12:15.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.858+0000 7f4613f91700 1 Processor -- start 2023-08-17T18:12:15.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.859+0000 7f4613f91700 1 -- start start 2023-08-17T18:12:15.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.859+0000 7f4613f91700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f460c0a7fe0 0x7f460c064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:15.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.859+0000 7f4613f91700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f460c065140 0x7f460c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:15.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.859+0000 7f4613f91700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 0x7f460c0bec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:15.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.859+0000 7f4613f91700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c0c4040 con 0x7f460c065140 2023-08-17T18:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.859+0000 7f4613f91700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c0bf170 con 0x7f460c0a7fe0 2023-08-17T18:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.859+0000 7f4613f91700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0c7080 con 0x7f460c0be7f0 2023-08-17T18:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.859+0000 7f461152c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f460c065140 0x7f460c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f461152c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f460c065140 0x7f460c0c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55800/0 (socket says 172.21.15.78:55800) 2023-08-17T18:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f461152c700 1 -- 172.21.15.78:0/1951178332 learned_addr learned my addr 172.21.15.78:0/1951178332 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f461252e700 1 --2- 172.21.15.78:0/1951178332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 0x7f460c0bec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f4611d2d700 1 --2- 172.21.15.78:0/1951178332 >> v2:172.21.15.150:3300/0 conn(0x7f460c0a7fe0 0x7f460c064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f461152c700 1 -- 172.21.15.78:0/1951178332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 msgr2=0x7f460c0bec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:15.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f461152c700 1 --2- 172.21.15.78:0/1951178332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 0x7f460c0bec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f461152c700 1 -- 172.21.15.78:0/1951178332 >> v2:172.21.15.150:3300/0 conn(0x7f460c0a7fe0 msgr2=0x7f460c064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:15.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f461152c700 1 --2- 172.21.15.78:0/1951178332 >> v2:172.21.15.150:3300/0 conn(0x7f460c0a7fe0 0x7f460c064180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f461152c700 1 -- 172.21.15.78:0/1951178332 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c0c3430 con 0x7f460c065140 2023-08-17T18:12:15.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f461152c700 1 --2- 172.21.15.78:0/1951178332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 0x7f460c0c6b90 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f460c06bd40 tx=0x7f45fc0090f0).ready entity=mon.0 client_cookie=df7d68efc6f69b1c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:15.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f4610d2b700 1 -- 172.21.15.78:0/1951178332 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00b600 con 0x7f460c065140 2023-08-17T18:12:15.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f4610d2b700 1 -- 172.21.15.78:0/1951178332 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc00b760 con 0x7f460c065140 2023-08-17T18:12:15.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f4610d2b700 1 -- 172.21.15.78:0/1951178332 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00bae0 con 0x7f460c065140 2023-08-17T18:12:15.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f4613f91700 1 -- 172.21.15.78:0/1951178332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 msgr2=0x7f460c0c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:15.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.860+0000 7f4613f91700 1 --2- 172.21.15.78:0/1951178332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 0x7f460c0c6b90 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f460c06bd40 tx=0x7f45fc0090f0).stop 2023-08-17T18:12:15.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.861+0000 7f4613f91700 1 -- 172.21.15.78:0/1951178332 shutdown_connections 2023-08-17T18:12:15.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.861+0000 7f4613f91700 1 --2- 172.21.15.78:0/1951178332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 0x7f460c0bec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.861+0000 7f4613f91700 1 --2- 172.21.15.78:0/1951178332 >> v2:172.21.15.150:3300/0 conn(0x7f460c0a7fe0 0x7f460c064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.861+0000 7f4613f91700 1 --2- 172.21.15.78:0/1951178332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 0x7f460c0c6b90 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.861+0000 7f4613f91700 1 -- 172.21.15.78:0/1951178332 >> 172.21.15.78:0/1951178332 conn(0x7f460c092330 msgr2=0x7f460c062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:15.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.861+0000 7f4613f91700 1 -- 172.21.15.78:0/1951178332 shutdown_connections 2023-08-17T18:12:15.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.861+0000 7f4613f91700 1 -- 172.21.15.78:0/1951178332 wait complete. 2023-08-17T18:12:15.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.862+0000 7f4613f91700 1 Processor -- start 2023-08-17T18:12:15.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.862+0000 7f4613f91700 1 -- start start 2023-08-17T18:12:15.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.862+0000 7f4613f91700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 0x7f460c0c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:15.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.862+0000 7f4613f91700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f460c0a7fe0 0x7f460c153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:15.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.862+0000 7f4613f91700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 0x7f460c153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:15.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.862+0000 7f4613f91700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c1540f0 con 0x7f460c065140 2023-08-17T18:12:15.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.862+0000 7f4613f91700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0c1c00 con 0x7f460c0a7fe0 2023-08-17T18:12:15.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.862+0000 7f4613f91700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0c1ee0 con 0x7f460c0be7f0 2023-08-17T18:12:15.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4611d2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 0x7f460c0c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:15.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4611d2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 0x7f460c0c1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55802/0 (socket says 172.21.15.78:55802) 2023-08-17T18:12:15.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4611d2d700 1 -- 172.21.15.78:0/1979100018 learned_addr learned my addr 172.21.15.78:0/1979100018 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:15.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f461252e700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 0x7f460c153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:15.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f461152c700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f460c0a7fe0 0x7f460c153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:15.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4611d2d700 1 -- 172.21.15.78:0/1979100018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 msgr2=0x7f460c153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:15.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4611d2d700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 0x7f460c153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4611d2d700 1 -- 172.21.15.78:0/1979100018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f460c0a7fe0 msgr2=0x7f460c153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:15.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4611d2d700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f460c0a7fe0 0x7f460c153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:15.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4611d2d700 1 -- 172.21.15.78:0/1979100018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc009370 con 0x7f460c065140 2023-08-17T18:12:15.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f461252e700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 0x7f460c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:15.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4611d2d700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 0x7f460c0c1580 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f460800c850 tx=0x7f4608008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:15.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4601ffb700 1 -- 172.21.15.78:0/1979100018 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608010580 con 0x7f460c065140 2023-08-17T18:12:15.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4601ffb700 1 -- 172.21.15.78:0/1979100018 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46080106e0 con 0x7f460c065140 2023-08-17T18:12:15.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4613f91700 1 -- 172.21.15.78:0/1979100018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c0c21c0 con 0x7f460c065140 2023-08-17T18:12:15.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4601ffb700 1 -- 172.21.15.78:0/1979100018 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608010a60 con 0x7f460c065140 2023-08-17T18:12:15.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.863+0000 7f4613f91700 1 -- 172.21.15.78:0/1979100018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c0c2780 con 0x7f460c065140 2023-08-17T18:12:15.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.864+0000 7f4613f91700 1 -- 172.21.15.78:0/1979100018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c047350 con 0x7f460c065140 2023-08-17T18:12:15.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.865+0000 7f4601ffb700 1 -- 172.21.15.78:0/1979100018 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f460801b460 con 0x7f460c065140 2023-08-17T18:12:15.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.865+0000 7f4601ffb700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f45f005ed90 0x7f45f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:15.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.865+0000 7f4601ffb700 1 -- 172.21.15.78:0/1979100018 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f46080798a0 con 0x7f460c065140 2023-08-17T18:12:15.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.865+0000 7f461152c700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f45f005ed90 0x7f45f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:15.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.865+0000 7f461152c700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f45f005ed90 0x7f45f0061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f45fc009130 tx=0x7f45fc017000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:15.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:15.869+0000 7f4601ffb700 1 -- 172.21.15.78:0/1979100018 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f460804b130 con 0x7f460c065140 2023-08-17T18:12:16.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.092+0000 7f4613f91700 1 -- 172.21.15.78:0/1979100018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f460c05f3f0 con 0x7f460c065140 2023-08-17T18:12:16.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.093+0000 7f4601ffb700 1 -- 172.21.15.78:0/1979100018 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v33) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f460804e750 con 0x7f460c065140 2023-08-17T18:12:16.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:16.093 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:12:16.094 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-08-17T18:12:16.094 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.094 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-08-17T18:12:16.094 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kISzhNhAAxWFetD0Gvuo/mlpLBYU8JA==", 2023-08-17T18:12:16.094 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.094 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:12:16.094 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T18:12:16.095 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T18:12:16.095 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.095 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.095 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.095 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.095 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-08-17T18:12:16.095 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kNalzBhAA/qm4o5qCFRwsLp4NGmcv7g==", 2023-08-17T18:12:16.095 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.096 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:12:16.096 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T18:12:16.096 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T18:12:16.096 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.096 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.096 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.096 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.096 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-08-17T18:12:16.097 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kWoUSAhAAWJhw3yMl14w2ex/T3gNYhw==", 2023-08-17T18:12:16.097 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:12:16.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T18:12:16.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T18:12:16.097 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.097 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.098 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.098 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.098 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-08-17T18:12:16.098 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kgSoiDRAAEzNHRXHssFEyLXawZR9Hgg==", 2023-08-17T18:12:16.098 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.098 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:12:16.098 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T18:12:16.098 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T18:12:16.099 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.099 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.099 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.099 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.099 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-08-17T18:12:16.099 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDwWd5kKcaZIhAAPoU3AdwVMfqdR+s3ML1kYg==", 2023-08-17T18:12:16.099 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.099 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:12:16.100 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:12:16.100 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.100 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.100 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.100 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.100 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-08-17T18:12:16.100 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDzWd5k8hUZIhAAqIJCNkV7YMnhQPd3OmM1hw==", 2023-08-17T18:12:16.101 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.101 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:12:16.101 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:12:16.101 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.101 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.101 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.101 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.101 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-08-17T18:12:16.102 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD2Wd5kFCrVJBAAE5aX8C9krbUtnfJhqXbOgA==", 2023-08-17T18:12:16.102 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.102 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:12:16.102 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:12:16.102 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.102 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.102 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.102 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.103 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-08-17T18:12:16.103 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD5Wd5kXGJYJBAAQKgCZwaA4OMz2TziTIDLYQ==", 2023-08-17T18:12:16.103 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.103 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:12:16.103 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:12:16.103 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.103 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.103 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.104 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.104 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-08-17T18:12:16.104 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQD/Wd5kFcRaJxAAs4xyCOKhtoVQNuA39qLxHA==", 2023-08-17T18:12:16.104 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.104 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:12:16.104 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:12:16.104 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.105 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.105 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.105 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.105 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-08-17T18:12:16.105 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQACWt5k73SdJBAAjTDsYmsIPQINCvMoXymV6Q==", 2023-08-17T18:12:16.105 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.105 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:12:16.105 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:12:16.106 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.106 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.106 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.106 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.106 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-08-17T18:12:16.106 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAFWt5kpsuiJBAAbEG2/xueGzWsH5U32S76bw==", 2023-08-17T18:12:16.106 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.106 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:12:16.107 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:12:16.107 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.107 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.107 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.107 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.107 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-08-17T18:12:16.107 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAIWt5kDJJuJBAAhu2wyqA9oPSKnHKpEmLTeg==", 2023-08-17T18:12:16.107 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.108 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-08-17T18:12:16.108 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-08-17T18:12:16.108 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.108 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.108 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.108 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.108 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-08-17T18:12:16.108 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kRxLzEBAA1aexX9gCmfT4IbSOUL+AXA==", 2023-08-17T18:12:16.109 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.109 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:12:16.109 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-08-17T18:12:16.109 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T18:12:16.109 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.109 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.109 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.110 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-08-17T18:12:16.110 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kSk0wGRAAWIhOmVgXbqOZpm0UYNawUQ==", 2023-08-17T18:12:16.110 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.110 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:12:16.110 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T18:12:16.110 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T18:12:16.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T18:12:16.110 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.111 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.111 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.111 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-08-17T18:12:16.111 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5ko7g9FhAAHPvvsei5r5P3Tx6ba2EtBQ==", 2023-08-17T18:12:16.111 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.111 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:12:16.111 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T18:12:16.111 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T18:12:16.112 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T18:12:16.112 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.112 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.112 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.112 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-08-17T18:12:16.112 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtWd5kDfV6HhAAr5LIehDJ4WeIuzWQ1JahYw==", 2023-08-17T18:12:16.112 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.112 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-08-17T18:12:16.113 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-08-17T18:12:16.113 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-08-17T18:12:16.113 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-08-17T18:12:16.113 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.113 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.113 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.113 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-08-17T18:12:16.113 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k6n2yGhAAldYlBQaNGCgXL0HA2ePHVg==", 2023-08-17T18:12:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T18:12:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-08-17T18:12:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-08-17T18:12:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-08-17T18:12:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5k/qO1MxAAizoEsZEFi/u96Pk1ZkeeMg==", 2023-08-17T18:12:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T18:12:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T18:12:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-08-17T18:12:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDsWd5kqbrXLhAAB6TWmmq82wi+2JoWflRnnA==", 2023-08-17T18:12:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-08-17T18:12:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-08-17T18:12:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-08-17T18:12:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-08-17T18:12:16.117 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.117 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:16.117 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-08-17T18:12:16.117 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:12:16.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.094+0000 7f4613f91700 1 -- 172.21.15.78:0/1979100018 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f45f005ed90 msgr2=0x7f45f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.094+0000 7f4613f91700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f45f005ed90 0x7f45f0061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f45fc009130 tx=0x7f45fc017000).stop 2023-08-17T18:12:16.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.095+0000 7f4613f91700 1 -- 172.21.15.78:0/1979100018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 msgr2=0x7f460c0c1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.095+0000 7f4613f91700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 0x7f460c0c1580 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f460800c850 tx=0x7f4608008040).stop 2023-08-17T18:12:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.095+0000 7f4613f91700 1 -- 172.21.15.78:0/1979100018 shutdown_connections 2023-08-17T18:12:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.095+0000 7f4613f91700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f45f005ed90 0x7f45f0061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.095+0000 7f4613f91700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f460c0be7f0 0x7f460c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.095+0000 7f4613f91700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c065140 0x7f460c0c1580 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.095+0000 7f4613f91700 1 --2- 172.21.15.78:0/1979100018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f460c0a7fe0 0x7f460c153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.095+0000 7f4613f91700 1 -- 172.21.15.78:0/1979100018 >> 172.21.15.78:0/1979100018 conn(0x7f460c092330 msgr2=0x7f460c0c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:16.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.095+0000 7f4613f91700 1 -- 172.21.15.78:0/1979100018 shutdown_connections 2023-08-17T18:12:16.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.095+0000 7f4613f91700 1 -- 172.21.15.78:0/1979100018 wait complete. 2023-08-17T18:12:16.120 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:16.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.234+0000 7f441b6e6700 1 Processor -- start 2023-08-17T18:12:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.235+0000 7f441b6e6700 1 -- start start 2023-08-17T18:12:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.235+0000 7f441b6e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 0x7f44140c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.235+0000 7f441b6e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4414066a40 0x7f4414151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.235+0000 7f441b6e6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44140c6040 con 0x7f44140c5b50 2023-08-17T18:12:16.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.235+0000 7f441b6e6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4414069b00 con 0x7f4414066a40 2023-08-17T18:12:16.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.235+0000 7f441b6e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4414069f90 con 0x7f4414066660 2023-08-17T18:12:16.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f4419482700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 0x7f44140c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f4419c83700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4414066a40 0x7f4414151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f4419482700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 0x7f44140c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:39932/0 (socket says 172.21.15.78:39932) 2023-08-17T18:12:16.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f4419482700 1 -- 172.21.15.78:0/1446167287 learned_addr learned my addr 172.21.15.78:0/1446167287 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:16.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f4419c83700 1 -- 172.21.15.78:0/1446167287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 msgr2=0x7f44140c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:16.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f4419c83700 1 --2- 172.21.15.78:0/1446167287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 0x7f44140c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f4419c83700 1 -- 172.21.15.78:0/1446167287 >> v1:172.21.15.150:6789/0 conn(0x7f44140c5b50 legacy=0x7f44140624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f4419c83700 1 -- 172.21.15.78:0/1446167287 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44140691d0 con 0x7f4414066a40 2023-08-17T18:12:16.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f440bfff700 1 -- 172.21.15.78:0/1446167287 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625499670 0 0) 0x7f4404001110 con 0x7f44140c5b50 2023-08-17T18:12:16.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f4419482700 1 --2- 172.21.15.78:0/1446167287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 0x7f44140c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:16.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f4419c83700 1 --2- 172.21.15.78:0/1446167287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4414066a40 0x7f4414151570 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f440c009e60 tx=0x7f440c009780).ready entity=mon.1 client_cookie=c4f39c5d9772660a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:16.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f440bfff700 1 -- 172.21.15.78:0/1446167287 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00e070 con 0x7f4414066a40 2023-08-17T18:12:16.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f440bfff700 1 -- 172.21.15.78:0/1446167287 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00bb60 con 0x7f4414066a40 2023-08-17T18:12:16.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.236+0000 7f440bfff700 1 -- 172.21.15.78:0/1446167287 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c012410 con 0x7f4414066a40 2023-08-17T18:12:16.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.237+0000 7f441b6e6700 1 -- 172.21.15.78:0/1446167287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4414066a40 msgr2=0x7f4414151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.237+0000 7f441b6e6700 1 --2- 172.21.15.78:0/1446167287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4414066a40 0x7f4414151570 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f440c009e60 tx=0x7f440c009780).stop 2023-08-17T18:12:16.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.237+0000 7f441b6e6700 1 -- 172.21.15.78:0/1446167287 shutdown_connections 2023-08-17T18:12:16.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.237+0000 7f441b6e6700 1 --2- 172.21.15.78:0/1446167287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4414066a40 0x7f4414151570 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.237+0000 7f441b6e6700 1 --2- 172.21.15.78:0/1446167287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 0x7f44140c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.237+0000 7f441b6e6700 1 -- 172.21.15.78:0/1446167287 >> 172.21.15.78:0/1446167287 conn(0x7f44140c7b00 msgr2=0x7f44140c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:16.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.237+0000 7f441b6e6700 1 -- 172.21.15.78:0/1446167287 shutdown_connections 2023-08-17T18:12:16.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.237+0000 7f441b6e6700 1 -- 172.21.15.78:0/1446167287 wait complete. 2023-08-17T18:12:16.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.238+0000 7f441b6e6700 1 Processor -- start 2023-08-17T18:12:16.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.238+0000 7f441b6e6700 1 -- start start 2023-08-17T18:12:16.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f441b6e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 0x7f44141459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f441b6e6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414066a40 0x7f44140ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f441b6e6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44140c5b50 0x7f44140a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f441b6e6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44140ab330 con 0x7f4414066a40 2023-08-17T18:12:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f441b6e6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44140ab5d0 con 0x7f44140c5b50 2023-08-17T18:12:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f441b6e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44140ab8b0 con 0x7f4414066660 2023-08-17T18:12:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f4418c81700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414066a40 0x7f44140ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f4419c83700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44140c5b50 0x7f44140a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f4418c81700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414066a40 0x7f44140ad470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55806/0 (socket says 172.21.15.78:55806) 2023-08-17T18:12:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f4419482700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 0x7f44141459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f4418c81700 1 -- 172.21.15.78:0/2777105174 learned_addr learned my addr 172.21.15.78:0/2777105174 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f4418c81700 1 -- 172.21.15.78:0/2777105174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 msgr2=0x7f44141459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f4418c81700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 0x7f44141459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f4418c81700 1 -- 172.21.15.78:0/2777105174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44140c5b50 msgr2=0x7f44140a8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f4418c81700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44140c5b50 0x7f44140a8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.239+0000 7f4418c81700 1 -- 172.21.15.78:0/2777105174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4410009370 con 0x7f4414066a40 2023-08-17T18:12:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.240+0000 7f4418c81700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414066a40 0x7f44140ad470 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f440400c490 tx=0x7f4404007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.240+0000 7f44097fa700 1 -- 172.21.15.78:0/2777105174 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404007020 con 0x7f4414066a40 2023-08-17T18:12:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.240+0000 7f44097fa700 1 -- 172.21.15.78:0/2777105174 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44040071a0 con 0x7f4414066a40 2023-08-17T18:12:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.240+0000 7f441b6e6700 1 -- 172.21.15.78:0/2777105174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c009a20 con 0x7f4414066a40 2023-08-17T18:12:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.240+0000 7f44097fa700 1 -- 172.21.15.78:0/2777105174 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404007560 con 0x7f4414066a40 2023-08-17T18:12:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.240+0000 7f441b6e6700 1 -- 172.21.15.78:0/2777105174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44140abe70 con 0x7f4414066a40 2023-08-17T18:12:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.241+0000 7f441b6e6700 1 -- 172.21.15.78:0/2777105174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4414047350 con 0x7f4414066a40 2023-08-17T18:12:16.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.241+0000 7f44097fa700 1 -- 172.21.15.78:0/2777105174 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4404010070 con 0x7f4414066a40 2023-08-17T18:12:16.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.241+0000 7f44097fa700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f43f805edc0 0x7f43f8061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.241+0000 7f44097fa700 1 -- 172.21.15.78:0/2777105174 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4404001e40 con 0x7f4414066a40 2023-08-17T18:12:16.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.241+0000 7f4419482700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f43f805edc0 0x7f43f8061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.242+0000 7f4419482700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f43f805edc0 0x7f43f8061280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4410006fd0 tx=0x7f44100090f0).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:16.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.245+0000 7f44097fa700 1 -- 172.21.15.78:0/2777105174 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f440404a9c0 con 0x7f4414066a40 2023-08-17T18:12:16.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.408+0000 7f441b6e6700 1 -- 172.21.15.78:0/2777105174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44140c6040 con 0x7f4414066a40 2023-08-17T18:12:16.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.409+0000 7f44097fa700 1 -- 172.21.15.78:0/2777105174 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+13771 (secure 0 0 0) 0x7f44140c6040 con 0x7f4414066a40 2023-08-17T18:12:16.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:16.409 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":181,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:15.725032+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:16.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 -- 172.21.15.78:0/2777105174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f43f805edc0 msgr2=0x7f43f8061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f43f805edc0 0x7f43f8061280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4410006fd0 tx=0x7f44100090f0).stop 2023-08-17T18:12:16.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 -- 172.21.15.78:0/2777105174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414066a40 msgr2=0x7f44140ad470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414066a40 0x7f44140ad470 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f440400c490 tx=0x7f4404007d70).stop 2023-08-17T18:12:16.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 -- 172.21.15.78:0/2777105174 shutdown_connections 2023-08-17T18:12:16.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f43f805edc0 0x7f43f8061280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44140c5b50 0x7f44140a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4414066660 0x7f44141459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 --2- 172.21.15.78:0/2777105174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414066a40 0x7f44140ad470 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 -- 172.21.15.78:0/2777105174 >> 172.21.15.78:0/2777105174 conn(0x7f44140c7b00 msgr2=0x7f4414155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:16.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 -- 172.21.15.78:0/2777105174 shutdown_connections 2023-08-17T18:12:16.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.411+0000 7f441b6e6700 1 -- 172.21.15.78:0/2777105174 wait complete. 2023-08-17T18:12:16.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T18:12:16.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T18:12:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.539+0000 7f03c5fcb700 1 Processor -- start 2023-08-17T18:12:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.539+0000 7f03c5fcb700 1 -- start start 2023-08-17T18:12:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.540+0000 7f03c5fcb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00aa0f0 0x7f03c00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.540+0000 7f03c5fcb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f03c00aa4d0 0x7f03c00c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.540+0000 7f03c5fcb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c00649b0 con 0x7f03c00c5810 2023-08-17T18:12:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.540+0000 7f03c5fcb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c0063420 con 0x7f03c00aa4d0 2023-08-17T18:12:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.540+0000 7f03c5fcb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0063700 con 0x7f03c00aa0f0 2023-08-17T18:12:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.540+0000 7f03beffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f03c00aa4d0 0x7f03c00c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.540+0000 7f03bffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f03c00c5810 0x7f03c00a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41718/0 (socket says 172.21.15.78:41718) 2023-08-17T18:12:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.540+0000 7f03bffff700 1 -- 172.21.15.78:0/3439866151 learned_addr learned my addr 172.21.15.78:0/3439866151 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.540+0000 7f03bf7fe700 1 --2- 172.21.15.78:0/3439866151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00aa0f0 0x7f03c00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03beffd700 1 -- 172.21.15.78:0/3439866151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00aa0f0 msgr2=0x7f03c00644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03beffd700 1 --2- 172.21.15.78:0/3439866151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00aa0f0 0x7f03c00644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03beffd700 1 -- 172.21.15.78:0/3439866151 >> v1:172.21.15.78:6789/0 conn(0x7f03c00c5810 legacy=0x7f03c00a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03be7fc700 1 -- 172.21.15.78:0/3439866151 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708902247 0 0) 0x7f03c00649b0 con 0x7f03c00c5810 2023-08-17T18:12:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03beffd700 1 -- 172.21.15.78:0/3439866151 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00639e0 con 0x7f03c00aa4d0 2023-08-17T18:12:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03beffd700 1 --2- 172.21.15.78:0/3439866151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa4d0 0x7f03c00c0e10 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f03b4009760 tx=0x7f03b4009060).ready entity=mon.0 client_cookie=5da5a5c9d5b9b10c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03be7fc700 1 -- 172.21.15.78:0/3439866151 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b400f510 con 0x7f03c00aa4d0 2023-08-17T18:12:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03be7fc700 1 -- 172.21.15.78:0/3439866151 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b400f670 con 0x7f03c00aa4d0 2023-08-17T18:12:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03be7fc700 1 -- 172.21.15.78:0/3439866151 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b400f9f0 con 0x7f03c00aa4d0 2023-08-17T18:12:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03c5fcb700 1 -- 172.21.15.78:0/3439866151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa4d0 msgr2=0x7f03c00c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03c5fcb700 1 --2- 172.21.15.78:0/3439866151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa4d0 0x7f03c00c0e10 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f03b4009760 tx=0x7f03b4009060).stop 2023-08-17T18:12:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03c5fcb700 1 -- 172.21.15.78:0/3439866151 shutdown_connections 2023-08-17T18:12:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03c5fcb700 1 --2- 172.21.15.78:0/3439866151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00aa0f0 0x7f03c00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03c5fcb700 1 --2- 172.21.15.78:0/3439866151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa4d0 0x7f03c00c0e10 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03c5fcb700 1 -- 172.21.15.78:0/3439866151 >> 172.21.15.78:0/3439866151 conn(0x7f03c006a6a0 msgr2=0x7f03c00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03c5fcb700 1 -- 172.21.15.78:0/3439866151 shutdown_connections 2023-08-17T18:12:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.541+0000 7f03c5fcb700 1 -- 172.21.15.78:0/3439866151 wait complete. 2023-08-17T18:12:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.543+0000 7f03c5fcb700 1 Processor -- start 2023-08-17T18:12:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.543+0000 7f03c5fcb700 1 -- start start 2023-08-17T18:12:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.543+0000 7f03c5fcb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa0f0 0x7f03c00c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.543+0000 7f03c5fcb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03c00aa4d0 0x7f03c0151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.543+0000 7f03c5fcb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00c5810 0x7f03c00ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.543+0000 7f03c5fcb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00c5330 con 0x7f03c00aa0f0 2023-08-17T18:12:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.543+0000 7f03c5fcb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00c1da0 con 0x7f03c00aa4d0 2023-08-17T18:12:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.543+0000 7f03c5fcb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00c2920 con 0x7f03c00c5810 2023-08-17T18:12:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa0f0 0x7f03c00c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa0f0 0x7f03c00c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55826/0 (socket says 172.21.15.78:55826) 2023-08-17T18:12:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bf7fe700 1 -- 172.21.15.78:0/827867420 learned_addr learned my addr 172.21.15.78:0/827867420 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03beffd700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03c00aa4d0 0x7f03c0151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bffff700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00c5810 0x7f03c00ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bf7fe700 1 -- 172.21.15.78:0/827867420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00c5810 msgr2=0x7f03c00ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bf7fe700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00c5810 0x7f03c00ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bf7fe700 1 -- 172.21.15.78:0/827867420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03c00aa4d0 msgr2=0x7f03c0151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bf7fe700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03c00aa4d0 0x7f03c0151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bf7fe700 1 -- 172.21.15.78:0/827867420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40092a0 con 0x7f03c00aa0f0 2023-08-17T18:12:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bffff700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00c5810 0x7f03c00ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03bf7fe700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa0f0 0x7f03c00c4a30 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f03b0009e70 tx=0x7f03b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03a77fe700 1 -- 172.21.15.78:0/827867420 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b000cb50 con 0x7f03c00aa0f0 2023-08-17T18:12:16.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03a77fe700 1 -- 172.21.15.78:0/827867420 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b000f040 con 0x7f03c00aa0f0 2023-08-17T18:12:16.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03c5fcb700 1 -- 172.21.15.78:0/827867420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c00c1ff0 con 0x7f03c00aa0f0 2023-08-17T18:12:16.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03a77fe700 1 -- 172.21.15.78:0/827867420 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b000cec0 con 0x7f03c00aa0f0 2023-08-17T18:12:16.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.544+0000 7f03c5fcb700 1 -- 172.21.15.78:0/827867420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c00c4f20 con 0x7f03c00aa0f0 2023-08-17T18:12:16.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.545+0000 7f03c5fcb700 1 -- 172.21.15.78:0/827867420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c00cbb40 con 0x7f03c00aa0f0 2023-08-17T18:12:16.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.545+0000 7f03a77fe700 1 -- 172.21.15.78:0/827867420 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f03b0013610 con 0x7f03c00aa0f0 2023-08-17T18:12:16.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.546+0000 7f03a77fe700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f03ac05edc0 0x7f03ac061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.546+0000 7f03a77fe700 1 -- 172.21.15.78:0/827867420 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f03b007a160 con 0x7f03c00aa0f0 2023-08-17T18:12:16.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.546+0000 7f03beffd700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f03ac05edc0 0x7f03ac061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.546+0000 7f03beffd700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f03ac05edc0 0x7f03ac061280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f03b4009760 tx=0x7f03b4017000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:16.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.550+0000 7f03a77fe700 1 -- 172.21.15.78:0/827867420 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f03b004ba50 con 0x7f03c00aa0f0 2023-08-17T18:12:16.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.712+0000 7f03c5fcb700 1 -- 172.21.15.78:0/827867420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f03c0046af0 con 0x7f03c00aa0f0 2023-08-17T18:12:16.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.712+0000 7f03a77fe700 1 -- 172.21.15.78:0/827867420 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v181) v1 ==== 110+0+10 (secure 0 0 0) 0x7f03b004f070 con 0x7f03c00aa0f0 2023-08-17T18:12:16.713 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T18:12:16.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 -- 172.21.15.78:0/827867420 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f03ac05edc0 msgr2=0x7f03ac061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f03ac05edc0 0x7f03ac061280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f03b4009760 tx=0x7f03b4017000).stop 2023-08-17T18:12:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 -- 172.21.15.78:0/827867420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa0f0 msgr2=0x7f03c00c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa0f0 0x7f03c00c4a30 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f03b0009e70 tx=0x7f03b000b040).stop 2023-08-17T18:12:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 -- 172.21.15.78:0/827867420 shutdown_connections 2023-08-17T18:12:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f03ac05edc0 0x7f03ac061280 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03c00c5810 0x7f03c00ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00aa0f0 0x7f03c00c4a30 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 --2- 172.21.15.78:0/827867420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03c00aa4d0 0x7f03c0151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 -- 172.21.15.78:0/827867420 >> 172.21.15.78:0/827867420 conn(0x7f03c006a6a0 msgr2=0x7f03c00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:16.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 -- 172.21.15.78:0/827867420 shutdown_connections 2023-08-17T18:12:16.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.714+0000 7f03c5fcb700 1 -- 172.21.15.78:0/827867420 wait complete. 2023-08-17T18:12:16.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T18:12:16.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.842+0000 7ff607f85700 1 Processor -- start 2023-08-17T18:12:16.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.842+0000 7ff607f85700 1 -- start start 2023-08-17T18:12:16.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.843+0000 7ff607f85700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff6000aa4d0 0x7ff6000644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.843+0000 7ff607f85700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6000649b0 con 0x7ff6000aa0f0 2023-08-17T18:12:16.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.843+0000 7ff607f85700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff600063420 con 0x7ff6000c5810 2023-08-17T18:12:16.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.843+0000 7ff607f85700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff600063700 con 0x7ff6000aa4d0 2023-08-17T18:12:16.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.843+0000 7ff605d21700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff6000aa0f0 0x7ff6000c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41734/0 (socket says 172.21.15.78:41734) 2023-08-17T18:12:16.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.843+0000 7ff605d21700 1 -- 172.21.15.78:0/4103312216 learned_addr learned my addr 172.21.15.78:0/4103312216 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:16.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.843+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957265768 0 0) 0x7ff6000649b0 con 0x7ff6000aa0f0 2023-08-17T18:12:16.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.843+0000 7ff605520700 1 --2- 172.21.15.78:0/4103312216 >> v2:172.21.15.150:3300/0 conn(0x7ff6000aa4d0 0x7ff6000644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.843+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e80033f0 con 0x7ff6000aa0f0 2023-08-17T18:12:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3765077487 0 0) 0x7ff5e80033f0 con 0x7ff6000aa0f0 2023-08-17T18:12:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 >> v2:172.21.15.150:3300/0 conn(0x7ff6000aa4d0 msgr2=0x7ff6000644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 --2- 172.21.15.78:0/4103312216 >> v2:172.21.15.150:3300/0 conn(0x7ff6000aa4d0 0x7ff6000644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 >> v1:172.21.15.150:6789/0 conn(0x7ff6000c5810 legacy=0x7ff6000a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6000639e0 con 0x7ff6000aa0f0 2023-08-17T18:12:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7ff5f00017f0 con 0x7ff6000aa0f0 2023-08-17T18:12:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 >> v1:172.21.15.78:6789/0 conn(0x7ff6000aa0f0 legacy=0x7ff6000c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e80038e0 0x7ff5e8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e8004690 0x7ff5e8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e8005000 0x7ff5e800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff600063700 con 0x7ff5e80038e0 2023-08-17T18:12:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e800beb0 con 0x7ff5e8004690 2023-08-17T18:12:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e800c070 con 0x7ff5e8005000 2023-08-17T18:12:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff605d21700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e80038e0 0x7ff5e8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff605520700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e8004690 0x7ff5e8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff606522700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e8005000 0x7ff5e800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff605d21700 1 -- 172.21.15.78:0/4103312216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e8005000 msgr2=0x7ff5e800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff605d21700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e8005000 0x7ff5e800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff605d21700 1 -- 172.21.15.78:0/4103312216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e8004690 msgr2=0x7ff5e8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff605d21700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5e8004690 0x7ff5e8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff605d21700 1 -- 172.21.15.78:0/4103312216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e80033f0 con 0x7ff5e80038e0 2023-08-17T18:12:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff606522700 1 -- 172.21.15.78:0/4103312216 reap_dead start 2023-08-17T18:12:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff605d21700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e80038e0 0x7ff5e8003d00 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7ff5f000c480 tx=0x7ff5f000c790).ready entity=mon.0 client_cookie=3e6d857416f3f483 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.844+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0002030 con 0x7ff5e80038e0 2023-08-17T18:12:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.845+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f000ce20 con 0x7ff5e80038e0 2023-08-17T18:12:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.845+0000 7ff604d1f700 1 -- 172.21.15.78:0/4103312216 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0005d70 con 0x7ff5e80038e0 2023-08-17T18:12:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.845+0000 7ff607f85700 1 -- 172.21.15.78:0/4103312216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e80038e0 msgr2=0x7ff5e8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.845+0000 7ff607f85700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e80038e0 0x7ff5e8003d00 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7ff5f000c480 tx=0x7ff5f000c790).stop 2023-08-17T18:12:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.845+0000 7ff607f85700 1 -- 172.21.15.78:0/4103312216 shutdown_connections 2023-08-17T18:12:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.845+0000 7ff607f85700 1 --2- 172.21.15.78:0/4103312216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e80038e0 0x7ff5e8003d00 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.845+0000 7ff607f85700 1 -- 172.21.15.78:0/4103312216 >> 172.21.15.78:0/4103312216 conn(0x7ff60006a6a0 msgr2=0x7ff6000caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.845+0000 7ff607f85700 1 -- 172.21.15.78:0/4103312216 shutdown_connections 2023-08-17T18:12:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.845+0000 7ff607f85700 1 -- 172.21.15.78:0/4103312216 wait complete. 2023-08-17T18:12:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.846+0000 7ff607f85700 1 Processor -- start 2023-08-17T18:12:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.846+0000 7ff607f85700 1 -- start start 2023-08-17T18:12:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff607f85700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e80038e0 0x7ff600151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff607f85700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000c2080 0x7ff6000c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff607f85700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6001524e0 0x7ff6000afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff607f85700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000c4e80 con 0x7ff6001524e0 2023-08-17T18:12:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff607f85700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000c4270 con 0x7ff6000c2080 2023-08-17T18:12:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff607f85700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000c4550 con 0x7ff5e80038e0 2023-08-17T18:12:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff606522700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6001524e0 0x7ff6000afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff606522700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6001524e0 0x7ff6000afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55844/0 (socket says 172.21.15.78:55844) 2023-08-17T18:12:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff606522700 1 -- 172.21.15.78:0/32372216 learned_addr learned my addr 172.21.15.78:0/32372216 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:16.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff605520700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000c2080 0x7ff6000c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff605d21700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e80038e0 0x7ff600151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff606522700 1 -- 172.21.15.78:0/32372216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e80038e0 msgr2=0x7ff600151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff606522700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e80038e0 0x7ff600151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff606522700 1 -- 172.21.15.78:0/32372216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000c2080 msgr2=0x7ff6000c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:16.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff606522700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000c2080 0x7ff6000c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:16.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff606522700 1 -- 172.21.15.78:0/32372216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6000c4830 con 0x7ff6001524e0 2023-08-17T18:12:16.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.847+0000 7ff606522700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6001524e0 0x7ff6000afe90 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7ff6000650f0 tx=0x7ff5f8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:16.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.848+0000 7ff5fdffb700 1 -- 172.21.15.78:0/32372216 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800ece0 con 0x7ff6001524e0 2023-08-17T18:12:16.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.848+0000 7ff5fdffb700 1 -- 172.21.15.78:0/32372216 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800ee40 con 0x7ff6001524e0 2023-08-17T18:12:16.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.848+0000 7ff607f85700 1 -- 172.21.15.78:0/32372216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6000c4b10 con 0x7ff6001524e0 2023-08-17T18:12:16.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.848+0000 7ff5fdffb700 1 -- 172.21.15.78:0/32372216 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8014660 con 0x7ff6001524e0 2023-08-17T18:12:16.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.848+0000 7ff607f85700 1 -- 172.21.15.78:0/32372216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6000c3f30 con 0x7ff6001524e0 2023-08-17T18:12:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.849+0000 7ff607f85700 1 -- 172.21.15.78:0/32372216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff600083980 con 0x7ff6001524e0 2023-08-17T18:12:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.849+0000 7ff5fdffb700 1 -- 172.21.15.78:0/32372216 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff5f8014a50 con 0x7ff6001524e0 2023-08-17T18:12:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.849+0000 7ff5fdffb700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff5ec05ed90 0x7ff5ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.850+0000 7ff605d21700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff5ec05ed90 0x7ff5ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.850+0000 7ff5fdffb700 1 -- 172.21.15.78:0/32372216 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff5f8078fa0 con 0x7ff6001524e0 2023-08-17T18:12:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.850+0000 7ff605d21700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff5ec05ed90 0x7ff5ec061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff5f000c7d0 tx=0x7ff5f0015000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:16.854+0000 7ff5fdffb700 1 -- 172.21.15.78:0/32372216 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff5f80498f0 con 0x7ff6001524e0 2023-08-17T18:12:17.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.015+0000 7ff607f85700 1 -- 172.21.15.78:0/32372216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff600046af0 con 0x7ff6001524e0 2023-08-17T18:12:17.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.016+0000 7ff5fdffb700 1 -- 172.21.15.78:0/32372216 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v181) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff5f804e2c0 con 0x7ff6001524e0 2023-08-17T18:12:17.016 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T18:12:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 -- 172.21.15.78:0/32372216 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff5ec05ed90 msgr2=0x7ff5ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff5ec05ed90 0x7ff5ec061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff5f000c7d0 tx=0x7ff5f0015000).stop 2023-08-17T18:12:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 -- 172.21.15.78:0/32372216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6001524e0 msgr2=0x7ff6000afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6001524e0 0x7ff6000afe90 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7ff6000650f0 tx=0x7ff5f8009040).stop 2023-08-17T18:12:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 -- 172.21.15.78:0/32372216 shutdown_connections 2023-08-17T18:12:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff5ec05ed90 0x7ff5ec061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6001524e0 0x7ff6000afe90 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5e80038e0 0x7ff600151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 --2- 172.21.15.78:0/32372216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6000c2080 0x7ff6000c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 -- 172.21.15.78:0/32372216 >> 172.21.15.78:0/32372216 conn(0x7ff60006a6a0 msgr2=0x7ff6000a9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 -- 172.21.15.78:0/32372216 shutdown_connections 2023-08-17T18:12:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.018+0000 7ff607f85700 1 -- 172.21.15.78:0/32372216 wait complete. 2023-08-17T18:12:17.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T18:12:17.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.142+0000 7f193305c700 1 Processor -- start 2023-08-17T18:12:17.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.142+0000 7f193305c700 1 -- start start 2023-08-17T18:12:17.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f193305c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f192c0c6ee0 0x7f192c0c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f193305c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f192c0c0df0 0x7f192c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f193305c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192c0a8350 con 0x7f192c154140 2023-08-17T18:12:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f193305c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c0c7320 con 0x7f192c0c0df0 2023-08-17T18:12:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f193305c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c0c1280 con 0x7f192c0c6ee0 2023-08-17T18:12:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f19315f9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f192c0c0df0 0x7f192c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f19315f9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f192c0c0df0 0x7f192c0ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55860/0 (socket says 172.21.15.78:55860) 2023-08-17T18:12:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f19315f9700 1 -- 172.21.15.78:0/2397647165 learned_addr learned my addr 172.21.15.78:0/2397647165 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f1923fff700 1 --2- 172.21.15.78:0/2397647165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f192c0c6ee0 0x7f192c0c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f19315f9700 1 -- 172.21.15.78:0/2397647165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f192c0c6ee0 msgr2=0x7f192c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f19315f9700 1 --2- 172.21.15.78:0/2397647165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f192c0c6ee0 0x7f192c0c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f19315f9700 1 -- 172.21.15.78:0/2397647165 >> v1:172.21.15.150:6789/0 conn(0x7f192c154140 legacy=0x7f192c0a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.143+0000 7f19315f9700 1 -- 172.21.15.78:0/2397647165 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c154520 con 0x7f192c0c0df0 2023-08-17T18:12:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f19315f9700 1 --2- 172.21.15.78:0/2397647165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 0x7f192c0ca280 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f1924006fd0 tx=0x7f19240090f0).ready entity=mon.0 client_cookie=240e9812e40a1521 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f19237fe700 1 -- 172.21.15.78:0/2397647165 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400b600 con 0x7f192c0c0df0 2023-08-17T18:12:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f19237fe700 1 -- 172.21.15.78:0/2397647165 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400b760 con 0x7f192c0c0df0 2023-08-17T18:12:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f19237fe700 1 -- 172.21.15.78:0/2397647165 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400bae0 con 0x7f192c0c0df0 2023-08-17T18:12:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f193305c700 1 -- 172.21.15.78:0/2397647165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 msgr2=0x7f192c0ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f193305c700 1 --2- 172.21.15.78:0/2397647165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 0x7f192c0ca280 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f1924006fd0 tx=0x7f19240090f0).stop 2023-08-17T18:12:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f193305c700 1 -- 172.21.15.78:0/2397647165 shutdown_connections 2023-08-17T18:12:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f193305c700 1 --2- 172.21.15.78:0/2397647165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 0x7f192c0ca280 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f193305c700 1 --2- 172.21.15.78:0/2397647165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f192c0c6ee0 0x7f192c0c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f193305c700 1 -- 172.21.15.78:0/2397647165 >> 172.21.15.78:0/2397647165 conn(0x7f192c094510 msgr2=0x7f192c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f193305c700 1 -- 172.21.15.78:0/2397647165 shutdown_connections 2023-08-17T18:12:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.144+0000 7f193305c700 1 -- 172.21.15.78:0/2397647165 wait complete. 2023-08-17T18:12:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.145+0000 7f193305c700 1 Processor -- start 2023-08-17T18:12:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.146+0000 7f193305c700 1 -- start start 2023-08-17T18:12:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.146+0000 7f193305c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 0x7f192c14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.146+0000 7f193305c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f192c0c6ee0 0x7f192c0aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.146+0000 7f193305c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f192c154140 0x7f192c0a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.146+0000 7f193305c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c0b0f20 con 0x7f192c0c0df0 2023-08-17T18:12:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.146+0000 7f193305c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c14fd10 con 0x7f192c154140 2023-08-17T18:12:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.146+0000 7f193305c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c0b0960 con 0x7f192c0c6ee0 2023-08-17T18:12:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.146+0000 7f1930df8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 0x7f192c14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.146+0000 7f1930df8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 0x7f192c14c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55872/0 (socket says 172.21.15.78:55872) 2023-08-17T18:12:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1930df8700 1 -- 172.21.15.78:0/2380748373 learned_addr learned my addr 172.21.15.78:0/2380748373 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f19315f9700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f192c154140 0x7f192c0a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1923fff700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f192c0c6ee0 0x7f192c0aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1930df8700 1 -- 172.21.15.78:0/2380748373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f192c0c6ee0 msgr2=0x7f192c0aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1930df8700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f192c0c6ee0 0x7f192c0aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1930df8700 1 -- 172.21.15.78:0/2380748373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f192c154140 msgr2=0x7f192c0a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1930df8700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f192c154140 0x7f192c0a9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1930df8700 1 -- 172.21.15.78:0/2380748373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009370 con 0x7f192c0c0df0 2023-08-17T18:12:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1930df8700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 0x7f192c14c830 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f192800b7e0 tx=0x7f1928009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1920ff9700 1 -- 172.21.15.78:0/2380748373 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800d4a0 con 0x7f192c0c0df0 2023-08-17T18:12:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1920ff9700 1 -- 172.21.15.78:0/2380748373 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192800d640 con 0x7f192c0c0df0 2023-08-17T18:12:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f193305c700 1 -- 172.21.15.78:0/2380748373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c0b0c40 con 0x7f192c0c0df0 2023-08-17T18:12:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f1920ff9700 1 -- 172.21.15.78:0/2380748373 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800da00 con 0x7f192c0c0df0 2023-08-17T18:12:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.147+0000 7f193305c700 1 -- 172.21.15.78:0/2380748373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192c14cd20 con 0x7f192c0c0df0 2023-08-17T18:12:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.148+0000 7f193305c700 1 -- 172.21.15.78:0/2380748373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192c14f800 con 0x7f192c0c0df0 2023-08-17T18:12:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.148+0000 7f1920ff9700 1 -- 172.21.15.78:0/2380748373 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1928018030 con 0x7f192c0c0df0 2023-08-17T18:12:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.149+0000 7f1920ff9700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f191805edc0 0x7f1918061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.149+0000 7f1920ff9700 1 -- 172.21.15.78:0/2380748373 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1928078e70 con 0x7f192c0c0df0 2023-08-17T18:12:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.149+0000 7f1923fff700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f191805edc0 0x7f1918061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.149+0000 7f1923fff700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f191805edc0 0x7f1918061280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f192c159b40 tx=0x7f191c008040).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.153+0000 7f1920ff9700 1 -- 172.21.15.78:0/2380748373 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19280478f0 con 0x7f192c0c0df0 2023-08-17T18:12:17.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.319+0000 7f193305c700 1 -- 172.21.15.78:0/2380748373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f192c0c6970 con 0x7f192c0c0df0 2023-08-17T18:12:17.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.320+0000 7f1920ff9700 1 -- 172.21.15.78:0/2380748373 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v181) v1 ==== 84+0+143 (secure 0 0 0) 0x7f192c14f800 con 0x7f192c0c0df0 2023-08-17T18:12:17.320 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:17.320 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T18:12:17.320 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:17.320 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-08-17T18:12:17.320 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2023-08-17T18:12:17.321 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-08-17T18:12:17.321 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:17.321 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-08-17T18:12:17.321 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-08-17T18:12:17.321 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:17.321 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T18:12:17.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.321+0000 7f193305c700 1 -- 172.21.15.78:0/2380748373 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f191805edc0 msgr2=0x7f1918061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.321+0000 7f193305c700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f191805edc0 0x7f1918061280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f192c159b40 tx=0x7f191c008040).stop 2023-08-17T18:12:17.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.321+0000 7f193305c700 1 -- 172.21.15.78:0/2380748373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 msgr2=0x7f192c14c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.321+0000 7f193305c700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 0x7f192c14c830 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f192800b7e0 tx=0x7f1928009310).stop 2023-08-17T18:12:17.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.321+0000 7f193305c700 1 -- 172.21.15.78:0/2380748373 shutdown_connections 2023-08-17T18:12:17.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.321+0000 7f193305c700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f191805edc0 0x7f1918061280 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.321+0000 7f193305c700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f192c154140 0x7f192c0a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.321+0000 7f193305c700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f192c0c0df0 0x7f192c14c830 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.321+0000 7f193305c700 1 --2- 172.21.15.78:0/2380748373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f192c0c6ee0 0x7f192c0aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.321+0000 7f193305c700 1 -- 172.21.15.78:0/2380748373 >> 172.21.15.78:0/2380748373 conn(0x7f192c094510 msgr2=0x7f192c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:17.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.322+0000 7f193305c700 1 -- 172.21.15.78:0/2380748373 shutdown_connections 2023-08-17T18:12:17.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.322+0000 7f193305c700 1 -- 172.21.15.78:0/2380748373 wait complete. 2023-08-17T18:12:17.333 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T18:12:17.333 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T18:12:17.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.451+0000 7f9ed56cc700 1 Processor -- start 2023-08-17T18:12:17.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.451+0000 7f9ed56cc700 1 -- start start 2023-08-17T18:12:17.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ed56cc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ed0151a40 0x7f9ed00c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ed56cc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ed0151e20 0x7f9ed00c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ed56cc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9ed0157be0 0x7f9ed0158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ed56cc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed0158560 con 0x7f9ed0151a40 2023-08-17T18:12:17.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ed56cc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00c6620 con 0x7f9ed0157be0 2023-08-17T18:12:17.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ed56cc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed00c6900 con 0x7f9ed0151e20 2023-08-17T18:12:17.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ecffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ed0151a40 0x7f9ed00c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ecffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ed0151a40 0x7f9ed00c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55876/0 (socket says 172.21.15.78:55876) 2023-08-17T18:12:17.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ecffff700 1 -- 172.21.15.78:0/1406507169 learned_addr learned my addr 172.21.15.78:0/1406507169 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:17.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ed4ecb700 1 --2- 172.21.15.78:0/1406507169 >> v2:172.21.15.150:3300/0 conn(0x7f9ed0157be0 0x7f9ed0158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ecf7fe700 1 --2- 172.21.15.78:0/1406507169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ed0151e20 0x7f9ed00c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ecffff700 1 -- 172.21.15.78:0/1406507169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ed0151e20 msgr2=0x7f9ed00c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:17.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ecffff700 1 --2- 172.21.15.78:0/1406507169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ed0151e20 0x7f9ed00c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ecffff700 1 -- 172.21.15.78:0/1406507169 >> v2:172.21.15.150:3300/0 conn(0x7f9ed0157be0 msgr2=0x7f9ed0158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:17.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ecffff700 1 --2- 172.21.15.78:0/1406507169 >> v2:172.21.15.150:3300/0 conn(0x7f9ed0157be0 0x7f9ed0158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ecffff700 1 -- 172.21.15.78:0/1406507169 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed00c6be0 con 0x7f9ed0151a40 2023-08-17T18:12:17.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ed4ecb700 1 --2- 172.21.15.78:0/1406507169 >> v2:172.21.15.150:3300/0 conn(0x7f9ed0157be0 0x7f9ed0158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:17.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9ecffff700 1 --2- 172.21.15.78:0/1406507169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151a40 0x7f9ed00c8260 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f9ed0158be0 tx=0x7f9ec0009060).ready entity=mon.0 client_cookie=2c9d9f568e1a0391 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:17.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9eceffd700 1 -- 172.21.15.78:0/1406507169 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0005880 con 0x7f9ed0151a40 2023-08-17T18:12:17.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9eceffd700 1 -- 172.21.15.78:0/1406507169 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec00059e0 con 0x7f9ed0151a40 2023-08-17T18:12:17.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.452+0000 7f9eceffd700 1 -- 172.21.15.78:0/1406507169 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0005d60 con 0x7f9ed0151a40 2023-08-17T18:12:17.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.453+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1406507169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151a40 msgr2=0x7f9ed00c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.453+0000 7f9ed56cc700 1 --2- 172.21.15.78:0/1406507169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151a40 0x7f9ed00c8260 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f9ed0158be0 tx=0x7f9ec0009060).stop 2023-08-17T18:12:17.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.453+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1406507169 shutdown_connections 2023-08-17T18:12:17.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.453+0000 7f9ed56cc700 1 --2- 172.21.15.78:0/1406507169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151a40 0x7f9ed00c8260 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.453+0000 7f9ed56cc700 1 --2- 172.21.15.78:0/1406507169 >> v2:172.21.15.150:3300/0 conn(0x7f9ed0157be0 0x7f9ed0158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.453+0000 7f9ed56cc700 1 --2- 172.21.15.78:0/1406507169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ed0151e20 0x7f9ed00c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.453+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1406507169 >> 172.21.15.78:0/1406507169 conn(0x7f9ed00943b0 msgr2=0x7f9ed006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:17.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.453+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1406507169 shutdown_connections 2023-08-17T18:12:17.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.453+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1406507169 wait complete. 2023-08-17T18:12:17.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.454+0000 7f9ed56cc700 1 Processor -- start 2023-08-17T18:12:17.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.454+0000 7f9ed56cc700 1 -- start start 2023-08-17T18:12:17.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ed56cc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ed0151a40 0x7f9ed0154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ed56cc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151e20 0x7f9ed0152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ed56cc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ed0157be0 0x7f9ed0153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ed56cc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed00aa510 con 0x7f9ed0151e20 2023-08-17T18:12:17.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ed56cc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed00ab330 con 0x7f9ed0157be0 2023-08-17T18:12:17.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ed56cc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed00aa720 con 0x7f9ed0151a40 2023-08-17T18:12:17.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ecf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151e20 0x7f9ed0152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ecf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151e20 0x7f9ed0152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55890/0 (socket says 172.21.15.78:55890) 2023-08-17T18:12:17.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ecf7fe700 1 -- 172.21.15.78:0/1769188176 learned_addr learned my addr 172.21.15.78:0/1769188176 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ecffff700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ed0151a40 0x7f9ed0154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ed4ecb700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ed0157be0 0x7f9ed0153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ecf7fe700 1 -- 172.21.15.78:0/1769188176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ed0151a40 msgr2=0x7f9ed0154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ecf7fe700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ed0151a40 0x7f9ed0154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ecf7fe700 1 -- 172.21.15.78:0/1769188176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ed0157be0 msgr2=0x7f9ed0153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ecf7fe700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ed0157be0 0x7f9ed0153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ecf7fe700 1 -- 172.21.15.78:0/1769188176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec0009300 con 0x7f9ed0151e20 2023-08-17T18:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.455+0000 7f9ecf7fe700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151e20 0x7f9ed0152fa0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7f9ec400d860 tx=0x7f9ec4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:17.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.456+0000 7f9eb7fff700 1 -- 172.21.15.78:0/1769188176 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4011590 con 0x7f9ed0151e20 2023-08-17T18:12:17.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.456+0000 7f9eb7fff700 1 -- 172.21.15.78:0/1769188176 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec40116f0 con 0x7f9ed0151e20 2023-08-17T18:12:17.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.456+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1769188176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed00aaa00 con 0x7f9ed0151e20 2023-08-17T18:12:17.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.456+0000 7f9eb7fff700 1 -- 172.21.15.78:0/1769188176 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4011a70 con 0x7f9ed0151e20 2023-08-17T18:12:17.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.456+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1769188176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed00aafc0 con 0x7f9ed0151e20 2023-08-17T18:12:17.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.456+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1769188176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed0082f90 con 0x7f9ed0151e20 2023-08-17T18:12:17.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.457+0000 7f9eb7fff700 1 -- 172.21.15.78:0/1769188176 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9ec401c460 con 0x7f9ed0151e20 2023-08-17T18:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.457+0000 7f9eb7fff700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9ebc05ed90 0x7f9ebc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.457+0000 7f9eb7fff700 1 -- 172.21.15.78:0/1769188176 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9ec4079a90 con 0x7f9ed0151e20 2023-08-17T18:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.457+0000 7f9ecffff700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9ebc05ed90 0x7f9ebc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.458+0000 7f9ecffff700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9ebc05ed90 0x7f9ebc061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9ec000b3c0 tx=0x7f9ec0016000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.461+0000 7f9eb7fff700 1 -- 172.21.15.78:0/1769188176 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ec404b210 con 0x7f9ed0151e20 2023-08-17T18:12:17.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.625+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1769188176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f9ed005f980 con 0x7f9ed0151e20 2023-08-17T18:12:17.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.752+0000 7f9eb7fff700 1 -- 172.21.15.78:0/1769188176 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v182) v1 ==== 152+0+0 (secure 0 0 0) 0x7f9ed005f980 con 0x7f9ed0151e20 2023-08-17T18:12:17.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.755+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1769188176 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9ebc05ed90 msgr2=0x7f9ebc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.755+0000 7f9ed56cc700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9ebc05ed90 0x7f9ebc061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9ec000b3c0 tx=0x7f9ec0016000).stop 2023-08-17T18:12:17.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.755+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1769188176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151e20 msgr2=0x7f9ed0152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.755+0000 7f9ed56cc700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151e20 0x7f9ed0152fa0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7f9ec400d860 tx=0x7f9ec4008040).stop 2023-08-17T18:12:17.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.756+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1769188176 shutdown_connections 2023-08-17T18:12:17.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.756+0000 7f9ed56cc700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9ebc05ed90 0x7f9ebc061250 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0x7f9ec000b3c0 tx=0x7f9ec0016000).stop 2023-08-17T18:12:17.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.756+0000 7f9ed56cc700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ed0157be0 0x7f9ed0153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.756+0000 7f9ed56cc700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ed0151a40 0x7f9ed0154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.756+0000 7f9ed56cc700 1 --2- 172.21.15.78:0/1769188176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed0151e20 0x7f9ed0152fa0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.756+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1769188176 >> 172.21.15.78:0/1769188176 conn(0x7f9ed00943b0 msgr2=0x7f9ed0150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:17.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.757+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1769188176 shutdown_connections 2023-08-17T18:12:17.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.757+0000 7f9ed56cc700 1 -- 172.21.15.78:0/1769188176 wait complete. 2023-08-17T18:12:17.758 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-08-17T18:12:17.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T18:12:17.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.890+0000 7fe895f63700 1 Processor -- start 2023-08-17T18:12:17.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.890+0000 7fe895f63700 1 -- start start 2023-08-17T18:12:17.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.891+0000 7fe895f63700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 0x7fe8900c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.891+0000 7fe895f63700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe890062a90 0x7fe8900a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.891+0000 7fe895f63700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8900a74f0 con 0x7fe890153dd0 2023-08-17T18:12:17.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.891+0000 7fe895f63700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe890062ef0 con 0x7fe890062a90 2023-08-17T18:12:17.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.891+0000 7fe895f63700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900662c0 con 0x7fe8900626b0 2023-08-17T18:12:17.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.891+0000 7fe886ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe890062a90 0x7fe8900a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.891+0000 7fe886ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe890062a90 0x7fe8900a6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:53278/0 (socket says 172.21.15.78:53278) 2023-08-17T18:12:17.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.891+0000 7fe886ffd700 1 -- 172.21.15.78:0/1264358735 learned_addr learned my addr 172.21.15.78:0/1264358735 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:17.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.891+0000 7fe88ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe890153dd0 0x7fe890154280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:59942/0 (socket says 172.21.15.78:59942) 2023-08-17T18:12:17.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.891+0000 7fe88f7fe700 1 --2- 172.21.15.78:0/1264358735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 0x7fe8900c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe88f7fe700 1 -- 172.21.15.78:0/1264358735 >> v2:172.21.15.150:3300/0 conn(0x7fe890062a90 msgr2=0x7fe8900a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:17.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe88f7fe700 1 --2- 172.21.15.78:0/1264358735 >> v2:172.21.15.150:3300/0 conn(0x7fe890062a90 0x7fe8900a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe88f7fe700 1 -- 172.21.15.78:0/1264358735 >> v1:172.21.15.150:6789/0 conn(0x7fe890153dd0 legacy=0x7fe890154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe88f7fe700 1 -- 172.21.15.78:0/1264358735 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890069260 con 0x7fe8900626b0 2023-08-17T18:12:17.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe88effd700 1 -- 172.21.15.78:0/1264358735 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162159841 0 0) 0x7fe8900a74f0 con 0x7fe890153dd0 2023-08-17T18:12:17.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe886ffd700 1 --2- 172.21.15.78:0/1264358735 >> v2:172.21.15.150:3300/0 conn(0x7fe890062a90 0x7fe8900a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:17.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe88f7fe700 1 --2- 172.21.15.78:0/1264358735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 0x7fe8900c8340 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fe880009760 tx=0x7fe880009060).ready entity=mon.2 client_cookie=a08c9acbdbdd9332 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:17.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe88effd700 1 -- 172.21.15.78:0/1264358735 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88000f510 con 0x7fe8900626b0 2023-08-17T18:12:17.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe88effd700 1 -- 172.21.15.78:0/1264358735 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88000f670 con 0x7fe8900626b0 2023-08-17T18:12:17.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe88effd700 1 -- 172.21.15.78:0/1264358735 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88000f9f0 con 0x7fe8900626b0 2023-08-17T18:12:17.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe895f63700 1 -- 172.21.15.78:0/1264358735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 msgr2=0x7fe8900c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.892+0000 7fe895f63700 1 --2- 172.21.15.78:0/1264358735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 0x7fe8900c8340 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fe880009760 tx=0x7fe880009060).stop 2023-08-17T18:12:17.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.893+0000 7fe895f63700 1 -- 172.21.15.78:0/1264358735 shutdown_connections 2023-08-17T18:12:17.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.893+0000 7fe895f63700 1 --2- 172.21.15.78:0/1264358735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 0x7fe8900c8340 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.893+0000 7fe895f63700 1 --2- 172.21.15.78:0/1264358735 >> v2:172.21.15.150:3300/0 conn(0x7fe890062a90 0x7fe8900a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.893+0000 7fe895f63700 1 -- 172.21.15.78:0/1264358735 >> 172.21.15.78:0/1264358735 conn(0x7fe890064070 msgr2=0x7fe8900c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:17.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.893+0000 7fe895f63700 1 -- 172.21.15.78:0/1264358735 shutdown_connections 2023-08-17T18:12:17.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.893+0000 7fe895f63700 1 -- 172.21.15.78:0/1264358735 wait complete. 2023-08-17T18:12:17.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.894+0000 7fe895f63700 1 Processor -- start 2023-08-17T18:12:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.894+0000 7fe895f63700 1 -- start start 2023-08-17T18:12:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe895f63700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 0x7fe890164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe895f63700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe890062a90 0x7fe890163760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe895f63700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe890153dd0 0x7fe8900acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe895f63700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe890152fe0 con 0x7fe890153dd0 2023-08-17T18:12:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe895f63700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8901683c0 con 0x7fe890062a90 2023-08-17T18:12:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe895f63700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe890164e50 con 0x7fe8900626b0 2023-08-17T18:12:17.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe88ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe890153dd0 0x7fe8900acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe88ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe890153dd0 0x7fe8900acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55892/0 (socket says 172.21.15.78:55892) 2023-08-17T18:12:17.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe88ffff700 1 -- 172.21.15.78:0/4245883473 learned_addr learned my addr 172.21.15.78:0/4245883473 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:17.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe886ffd700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe890062a90 0x7fe890163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe88f7fe700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 0x7fe890164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe88ffff700 1 -- 172.21.15.78:0/4245883473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 msgr2=0x7fe890164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe88ffff700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 0x7fe890164960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe88ffff700 1 -- 172.21.15.78:0/4245883473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe890062a90 msgr2=0x7fe890163760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:17.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe88ffff700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe890062a90 0x7fe890163760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:17.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe88ffff700 1 -- 172.21.15.78:0/4245883473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878009370 con 0x7fe890153dd0 2023-08-17T18:12:17.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe88ffff700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe890153dd0 0x7fe8900acbf0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7fe88800c810 tx=0x7fe8880014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:17.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe887fff700 1 -- 172.21.15.78:0/4245883473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888005c70 con 0x7fe890153dd0 2023-08-17T18:12:17.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe887fff700 1 -- 172.21.15.78:0/4245883473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888005dd0 con 0x7fe890153dd0 2023-08-17T18:12:17.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe887fff700 1 -- 172.21.15.78:0/4245883473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888007320 con 0x7fe890153dd0 2023-08-17T18:12:17.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe895f63700 1 -- 172.21.15.78:0/4245883473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8800092a0 con 0x7fe890153dd0 2023-08-17T18:12:17.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.895+0000 7fe895f63700 1 -- 172.21.15.78:0/4245883473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe890167830 con 0x7fe890153dd0 2023-08-17T18:12:17.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.896+0000 7fe895f63700 1 -- 172.21.15.78:0/4245883473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe890047350 con 0x7fe890153dd0 2023-08-17T18:12:17.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.897+0000 7fe887fff700 1 -- 172.21.15.78:0/4245883473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe888010070 con 0x7fe890153dd0 2023-08-17T18:12:17.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.897+0000 7fe887fff700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe87005ed60 0x7fe870061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:17.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.897+0000 7fe887fff700 1 -- 172.21.15.78:0/4245883473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fe888079150 con 0x7fe890153dd0 2023-08-17T18:12:17.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.897+0000 7fe88f7fe700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe87005ed60 0x7fe870061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:17.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.898+0000 7fe88f7fe700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe87005ed60 0x7fe870061220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe890063090 tx=0x7fe880017000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:17.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:17.902+0000 7fe887fff700 1 -- 172.21.15.78:0/4245883473 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe88804a8d0 con 0x7fe890153dd0 2023-08-17T18:12:18.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.064+0000 7fe895f63700 1 -- 172.21.15.78:0/4245883473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe890064c60 con 0x7fe890153dd0 2023-08-17T18:12:18.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.757+0000 7fe887fff700 1 -- 172.21.15.78:0/4245883473 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v183) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe88804def0 con 0x7fe890153dd0 2023-08-17T18:12:18.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.767+0000 7fe895f63700 1 -- 172.21.15.78:0/4245883473 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe87005ed60 msgr2=0x7fe870061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:18.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.767+0000 7fe895f63700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe87005ed60 0x7fe870061220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe890063090 tx=0x7fe880017000).stop 2023-08-17T18:12:18.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.767+0000 7fe895f63700 1 -- 172.21.15.78:0/4245883473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe890153dd0 msgr2=0x7fe8900acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:18.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.767+0000 7fe895f63700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe890153dd0 0x7fe8900acbf0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7fe88800c810 tx=0x7fe8880014a0).stop 2023-08-17T18:12:18.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.769+0000 7fe895f63700 1 -- 172.21.15.78:0/4245883473 shutdown_connections 2023-08-17T18:12:18.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.769+0000 7fe895f63700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe87005ed60 0x7fe870061220 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:18.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.769+0000 7fe895f63700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe890153dd0 0x7fe8900acbf0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:18.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.769+0000 7fe895f63700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8900626b0 0x7fe890164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:18.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.769+0000 7fe895f63700 1 --2- 172.21.15.78:0/4245883473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe890062a90 0x7fe890163760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:18.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.769+0000 7fe895f63700 1 -- 172.21.15.78:0/4245883473 >> 172.21.15.78:0/4245883473 conn(0x7fe890064070 msgr2=0x7fe8900a4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:18.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.771+0000 7fe895f63700 1 -- 172.21.15.78:0/4245883473 shutdown_connections 2023-08-17T18:12:18.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.772+0000 7fe895f63700 1 -- 172.21.15.78:0/4245883473 wait complete. 2023-08-17T18:12:18.777 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-08-17T18:12:18.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T18:12:18.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.907+0000 7fae152fa700 1 Processor -- start 2023-08-17T18:12:18.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.907+0000 7fae152fa700 1 -- start start 2023-08-17T18:12:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.908+0000 7fae152fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fae100aa0f0 0x7fae100644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.908+0000 7fae152fa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae100aa4d0 0x7fae100c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:18.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.908+0000 7fae152fa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae100649b0 con 0x7fae100c5810 2023-08-17T18:12:18.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.908+0000 7fae152fa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae10063420 con 0x7fae100aa4d0 2023-08-17T18:12:18.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.908+0000 7fae152fa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae10063700 con 0x7fae100aa0f0 2023-08-17T18:12:18.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.908+0000 7fae067fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae100aa4d0 0x7fae100c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:18.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.908+0000 7fae067fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae100aa4d0 0x7fae100c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47228/0 (socket says 172.21.15.78:47228) 2023-08-17T18:12:18.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.908+0000 7fae067fc700 1 -- 172.21.15.78:0/1235076154 learned_addr learned my addr 172.21.15.78:0/1235076154 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:18.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.908+0000 7fae0effd700 1 --2- 172.21.15.78:0/1235076154 >> v2:172.21.15.150:3300/0 conn(0x7fae100aa0f0 0x7fae100644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:18.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae067fc700 1 -- 172.21.15.78:0/1235076154 >> v2:172.21.15.150:3300/0 conn(0x7fae100aa0f0 msgr2=0x7fae100644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:18.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae067fc700 1 --2- 172.21.15.78:0/1235076154 >> v2:172.21.15.150:3300/0 conn(0x7fae100aa0f0 0x7fae100644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:18.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae067fc700 1 -- 172.21.15.78:0/1235076154 >> v1:172.21.15.150:6789/0 conn(0x7fae100c5810 legacy=0x7fae100a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:18.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae067fc700 1 -- 172.21.15.78:0/1235076154 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100639e0 con 0x7fae100aa4d0 2023-08-17T18:12:18.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae0effd700 1 --2- 172.21.15.78:0/1235076154 >> v2:172.21.15.150:3300/0 conn(0x7fae100aa0f0 0x7fae100644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:18.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae067fc700 1 --2- 172.21.15.78:0/1235076154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100aa4d0 0x7fae100c0e10 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7fae100cade0 tx=0x7fadf80090f0).ready entity=mon.0 client_cookie=3da475d479d68f74 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:18.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae0e7fc700 1 -- 172.21.15.78:0/1235076154 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800b600 con 0x7fae100aa4d0 2023-08-17T18:12:18.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae0e7fc700 1 -- 172.21.15.78:0/1235076154 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf800b760 con 0x7fae100aa4d0 2023-08-17T18:12:18.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae0e7fc700 1 -- 172.21.15.78:0/1235076154 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800bae0 con 0x7fae100aa4d0 2023-08-17T18:12:18.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae152fa700 1 -- 172.21.15.78:0/1235076154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100aa4d0 msgr2=0x7fae100c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:18.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae152fa700 1 --2- 172.21.15.78:0/1235076154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100aa4d0 0x7fae100c0e10 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7fae100cade0 tx=0x7fadf80090f0).stop 2023-08-17T18:12:18.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae152fa700 1 -- 172.21.15.78:0/1235076154 shutdown_connections 2023-08-17T18:12:18.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae152fa700 1 --2- 172.21.15.78:0/1235076154 >> v2:172.21.15.150:3300/0 conn(0x7fae100aa0f0 0x7fae100644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:18.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae152fa700 1 --2- 172.21.15.78:0/1235076154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100aa4d0 0x7fae100c0e10 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:18.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae152fa700 1 -- 172.21.15.78:0/1235076154 >> 172.21.15.78:0/1235076154 conn(0x7fae1006a6a0 msgr2=0x7fae100caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:18.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae152fa700 1 -- 172.21.15.78:0/1235076154 shutdown_connections 2023-08-17T18:12:18.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.909+0000 7fae152fa700 1 -- 172.21.15.78:0/1235076154 wait complete. 2023-08-17T18:12:18.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.911+0000 7fae152fa700 1 Processor -- start 2023-08-17T18:12:18.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.911+0000 7fae152fa700 1 -- start start 2023-08-17T18:12:18.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.911+0000 7fae152fa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae100aa0f0 0x7fae10152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:18.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.911+0000 7fae152fa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae100aa4d0 0x7fae10165850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:18.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.911+0000 7fae152fa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100c5810 0x7fae100c0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:18.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.911+0000 7fae152fa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10152b80 con 0x7fae100c5810 2023-08-17T18:12:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.911+0000 7fae152fa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae100c1fe0 con 0x7fae100aa4d0 2023-08-17T18:12:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.911+0000 7fae152fa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae100c22a0 con 0x7fae100aa0f0 2023-08-17T18:12:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae0f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100c5810 0x7fae100c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae0f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100c5810 0x7fae100c0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47240/0 (socket says 172.21.15.78:47240) 2023-08-17T18:12:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae0f7fe700 1 -- 172.21.15.78:0/3699081945 learned_addr learned my addr 172.21.15.78:0/3699081945 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae067fc700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae100aa4d0 0x7fae10165850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae0effd700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae100aa0f0 0x7fae10152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae0f7fe700 1 -- 172.21.15.78:0/3699081945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae100aa0f0 msgr2=0x7fae10152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae0f7fe700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae100aa0f0 0x7fae10152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae0f7fe700 1 -- 172.21.15.78:0/3699081945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae100aa4d0 msgr2=0x7fae10165850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae0f7fe700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae100aa4d0 0x7fae10165850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae0f7fe700 1 -- 172.21.15.78:0/3699081945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8009370 con 0x7fae100c5810 2023-08-17T18:12:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae067fc700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae100aa4d0 0x7fae10165850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae0f7fe700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100c5810 0x7fae100c0200 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7fae0800c7c0 tx=0x7fae08001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae077fe700 1 -- 172.21.15.78:0/3699081945 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08010510 con 0x7fae100c5810 2023-08-17T18:12:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae077fe700 1 -- 172.21.15.78:0/3699081945 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae08010670 con 0x7fae100c5810 2023-08-17T18:12:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae152fa700 1 -- 172.21.15.78:0/3699081945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae100c2580 con 0x7fae100c5810 2023-08-17T18:12:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae077fe700 1 -- 172.21.15.78:0/3699081945 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae080109f0 con 0x7fae100c5810 2023-08-17T18:12:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.912+0000 7fae152fa700 1 -- 172.21.15.78:0/3699081945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae100c2b40 con 0x7fae100c5810 2023-08-17T18:12:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.913+0000 7fae152fa700 1 -- 172.21.15.78:0/3699081945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae100c2d30 con 0x7fae100c5810 2023-08-17T18:12:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.913+0000 7fae077fe700 1 -- 172.21.15.78:0/3699081945 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fae08010070 con 0x7fae100c5810 2023-08-17T18:12:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.914+0000 7fae077fe700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fadf005ed90 0x7fadf0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:18.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.914+0000 7fae077fe700 1 -- 172.21.15.78:0/3699081945 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fae08079700 con 0x7fae100c5810 2023-08-17T18:12:18.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.914+0000 7fae0effd700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fadf005ed90 0x7fadf0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:18.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.914+0000 7fae0effd700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fadf005ed90 0x7fadf0061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fae00006d80 tx=0x7fae00008040).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:18.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:18.918+0000 7fae077fe700 1 -- 172.21.15.78:0/3699081945 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae0804ad00 con 0x7fae100c5810 2023-08-17T18:12:19.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.123+0000 7fae152fa700 1 -- 172.21.15.78:0/3699081945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fae10083980 con 0x7fae100c5810 2023-08-17T18:12:19.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.129+0000 7fae077fe700 1 -- 172.21.15.78:0/3699081945 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v65) v1 ==== 174+0+0 (secure 0 0 0) 0x7fae0804e320 con 0x7fae100c5810 2023-08-17T18:12:19.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.132+0000 7fae152fa700 1 -- 172.21.15.78:0/3699081945 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fadf005ed90 msgr2=0x7fadf0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.132+0000 7fae152fa700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fadf005ed90 0x7fadf0061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fae00006d80 tx=0x7fae00008040).stop 2023-08-17T18:12:19.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.132+0000 7fae152fa700 1 -- 172.21.15.78:0/3699081945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100c5810 msgr2=0x7fae100c0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.132+0000 7fae152fa700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100c5810 0x7fae100c0200 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7fae0800c7c0 tx=0x7fae08001510).stop 2023-08-17T18:12:19.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.137+0000 7fae152fa700 1 -- 172.21.15.78:0/3699081945 shutdown_connections 2023-08-17T18:12:19.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.137+0000 7fae152fa700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fadf005ed90 0x7fadf0061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.137+0000 7fae152fa700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae100c5810 0x7fae100c0200 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.137+0000 7fae152fa700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae100aa0f0 0x7fae10152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.137+0000 7fae152fa700 1 --2- 172.21.15.78:0/3699081945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae100aa4d0 0x7fae10165850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.137+0000 7fae152fa700 1 -- 172.21.15.78:0/3699081945 >> 172.21.15.78:0/3699081945 conn(0x7fae1006a6a0 msgr2=0x7fae100ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:19.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.137+0000 7fae152fa700 1 -- 172.21.15.78:0/3699081945 shutdown_connections 2023-08-17T18:12:19.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.138+0000 7fae152fa700 1 -- 172.21.15.78:0/3699081945 wait complete. 2023-08-17T18:12:19.143 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 23 and data pool 24 2023-08-17T18:12:19.159 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:19.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.273+0000 7f1172198700 1 Processor -- start 2023-08-17T18:12:19.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.273+0000 7f1172198700 1 -- start start 2023-08-17T18:12:19.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.274+0000 7f1172198700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f116c0c1010 0x7f116c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.274+0000 7f1172198700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116c0c7350 con 0x7f116c154140 2023-08-17T18:12:19.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.274+0000 7f1172198700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116c0a8350 con 0x7f116c0c6ee0 2023-08-17T18:12:19.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.274+0000 7f1172198700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116c154520 con 0x7f116c0c1010 2023-08-17T18:12:19.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.274+0000 7f116bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f116c0c1010 0x7f116c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.274+0000 7f116b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f116c154140 0x7f116c0a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53192/0 (socket says 172.21.15.78:53192) 2023-08-17T18:12:19.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.274+0000 7f116b7fe700 1 -- 172.21.15.78:0/2720181215 learned_addr learned my addr 172.21.15.78:0/2720181215 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:19.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.274+0000 7f116bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f116c0c1010 0x7f116c0ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47252/0 (socket says 172.21.15.78:47252) 2023-08-17T18:12:19.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f116bfff700 1 -- 172.21.15.78:0/2720181215 >> v1:172.21.15.150:6789/0 conn(0x7f116c0c6ee0 legacy=0x7f116c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f116bfff700 1 -- 172.21.15.78:0/2720181215 >> v1:172.21.15.78:6789/0 conn(0x7f116c154140 legacy=0x7f116c0a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f116bfff700 1 -- 172.21.15.78:0/2720181215 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c0c91e0 con 0x7f116c0c1010 2023-08-17T18:12:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f116a7fc700 1 -- 172.21.15.78:0/2720181215 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876289579 0 0) 0x7f116c0c7350 con 0x7f116c154140 2023-08-17T18:12:19.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f116bfff700 1 --2- 172.21.15.78:0/2720181215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c1010 0x7f116c0ca280 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f1164009760 tx=0x7f1164009060).ready entity=mon.0 client_cookie=9ca85a37eed7286c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:19.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f116a7fc700 1 -- 172.21.15.78:0/2720181215 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116400b520 con 0x7f116c0c1010 2023-08-17T18:12:19.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f116a7fc700 1 -- 172.21.15.78:0/2720181215 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116400b680 con 0x7f116c0c1010 2023-08-17T18:12:19.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f116a7fc700 1 -- 172.21.15.78:0/2720181215 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116400ba00 con 0x7f116c0c1010 2023-08-17T18:12:19.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f1172198700 1 -- 172.21.15.78:0/2720181215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c1010 msgr2=0x7f116c0ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f1172198700 1 --2- 172.21.15.78:0/2720181215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c1010 0x7f116c0ca280 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f1164009760 tx=0x7f1164009060).stop 2023-08-17T18:12:19.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f1172198700 1 -- 172.21.15.78:0/2720181215 shutdown_connections 2023-08-17T18:12:19.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f1172198700 1 --2- 172.21.15.78:0/2720181215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c1010 0x7f116c0ca280 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f1172198700 1 -- 172.21.15.78:0/2720181215 >> 172.21.15.78:0/2720181215 conn(0x7f116c094510 msgr2=0x7f116c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:19.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f1172198700 1 -- 172.21.15.78:0/2720181215 shutdown_connections 2023-08-17T18:12:19.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.275+0000 7f1172198700 1 -- 172.21.15.78:0/2720181215 wait complete. 2023-08-17T18:12:19.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.277+0000 7f1172198700 1 Processor -- start 2023-08-17T18:12:19.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.277+0000 7f1172198700 1 -- start start 2023-08-17T18:12:19.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.277+0000 7f1172198700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c0c1010 0x7f116c14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.277+0000 7f1172198700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c6ee0 0x7f116c14cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.277+0000 7f1172198700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f116c154140 0x7f116c0acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.277+0000 7f1172198700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c0ab6a0 con 0x7f116c0c6ee0 2023-08-17T18:12:19.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.277+0000 7f1172198700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c0aae00 con 0x7f116c0c1010 2023-08-17T18:12:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.277+0000 7f1172198700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116c0ab0e0 con 0x7f116c154140 2023-08-17T18:12:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c6ee0 0x7f116c14cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c6ee0 0x7f116c14cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47268/0 (socket says 172.21.15.78:47268) 2023-08-17T18:12:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116affd700 1 -- 172.21.15.78:0/3887970712 learned_addr learned my addr 172.21.15.78:0/3887970712 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116b7fe700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c0c1010 0x7f116c14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116bfff700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f116c154140 0x7f116c0acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116affd700 1 -- 172.21.15.78:0/3887970712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f116c154140 msgr2=0x7f116c0acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116affd700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f116c154140 0x7f116c0acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116affd700 1 -- 172.21.15.78:0/3887970712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c0c1010 msgr2=0x7f116c14c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116affd700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c0c1010 0x7f116c14c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116affd700 1 -- 172.21.15.78:0/3887970712 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640092a0 con 0x7f116c0c6ee0 2023-08-17T18:12:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f116affd700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c6ee0 0x7f116c14cb40 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f116000c440 tx=0x7f1160007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f11537fe700 1 -- 172.21.15.78:0/3887970712 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160012400 con 0x7f116c0c6ee0 2023-08-17T18:12:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f11537fe700 1 -- 172.21.15.78:0/3887970712 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1160012580 con 0x7f116c0c6ee0 2023-08-17T18:12:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f11537fe700 1 -- 172.21.15.78:0/3887970712 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160012940 con 0x7f116c0c6ee0 2023-08-17T18:12:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f1172198700 1 -- 172.21.15.78:0/3887970712 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f116c0ab3c0 con 0x7f116c0c6ee0 2023-08-17T18:12:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.278+0000 7f1172198700 1 -- 172.21.15.78:0/3887970712 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116c14c790 con 0x7f116c0c6ee0 2023-08-17T18:12:19.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.279+0000 7f1172198700 1 -- 172.21.15.78:0/3887970712 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116c047350 con 0x7f116c0c6ee0 2023-08-17T18:12:19.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.280+0000 7f11537fe700 1 -- 172.21.15.78:0/3887970712 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1160019030 con 0x7f116c0c6ee0 2023-08-17T18:12:19.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.280+0000 7f11537fe700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f115805ed60 0x7f1158061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.280+0000 7f11537fe700 1 -- 172.21.15.78:0/3887970712 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1160078da0 con 0x7f116c0c6ee0 2023-08-17T18:12:19.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.280+0000 7f116b7fe700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f115805ed60 0x7f1158061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.280+0000 7f116b7fe700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f115805ed60 0x7f1158061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f115c001a90 tx=0x7f115c0014d0).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:19.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.284+0000 7f11537fe700 1 -- 172.21.15.78:0/3887970712 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f11600488f0 con 0x7f116c0c6ee0 2023-08-17T18:12:19.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.446+0000 7f1172198700 1 -- 172.21.15.78:0/3887970712 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f116c0c94c0 con 0x7f116c0c6ee0 2023-08-17T18:12:19.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.447+0000 7f11537fe700 1 -- 172.21.15.78:0/3887970712 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+17004 (secure 0 0 0) 0x7f116004a3f0 con 0x7f116c0c6ee0 2023-08-17T18:12:19.447 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:19.447 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":184,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:19.124531+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:12:17.650042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T18:12:18.089352+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:19.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 -- 172.21.15.78:0/3887970712 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f115805ed60 msgr2=0x7f1158061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f115805ed60 0x7f1158061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f115c001a90 tx=0x7f115c0014d0).stop 2023-08-17T18:12:19.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 -- 172.21.15.78:0/3887970712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c6ee0 msgr2=0x7f116c14cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c6ee0 0x7f116c14cb40 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f116000c440 tx=0x7f1160007de0).stop 2023-08-17T18:12:19.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 -- 172.21.15.78:0/3887970712 shutdown_connections 2023-08-17T18:12:19.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f115805ed60 0x7f1158061220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f116c154140 0x7f116c0acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c0c1010 0x7f116c14c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 --2- 172.21.15.78:0/3887970712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c0c6ee0 0x7f116c14cb40 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 -- 172.21.15.78:0/3887970712 >> 172.21.15.78:0/3887970712 conn(0x7f116c094510 msgr2=0x7f116c152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:19.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 -- 172.21.15.78:0/3887970712 shutdown_connections 2023-08-17T18:12:19.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.449+0000 7f1172198700 1 -- 172.21.15.78:0/3887970712 wait complete. 2023-08-17T18:12:19.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:19.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.574+0000 7f4550c71700 1 Processor -- start 2023-08-17T18:12:19.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.574+0000 7f4550c71700 1 -- start start 2023-08-17T18:12:19.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.575+0000 7f4550c71700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f454c13a640 0x7f454c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.575+0000 7f4550c71700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f454c06a2c0 0x7f454c069050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.575+0000 7f4550c71700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454c0c2c10 con 0x7f454c13aa20 2023-08-17T18:12:19.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.575+0000 7f4550c71700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c155010 con 0x7f454c13a640 2023-08-17T18:12:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.575+0000 7f4550c71700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c1552e0 con 0x7f454c06a2c0 2023-08-17T18:12:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f454c13a640 0x7f454c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454ad9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f454c13aa20 0x7f454c151590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53200/0 (socket says 172.21.15.78:53200) 2023-08-17T18:12:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f454c13a640 0x7f454c154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47282/0 (socket says 172.21.15.78:47282) 2023-08-17T18:12:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454ad9d700 1 -- 172.21.15.78:0/1815058179 learned_addr learned my addr 172.21.15.78:0/1815058179 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f4549d9b700 1 --2- 172.21.15.78:0/1815058179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f454c06a2c0 0x7f454c069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454a59c700 1 -- 172.21.15.78:0/1815058179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f454c06a2c0 msgr2=0x7f454c069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454a59c700 1 --2- 172.21.15.78:0/1815058179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f454c06a2c0 0x7f454c069050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454a59c700 1 -- 172.21.15.78:0/1815058179 >> v1:172.21.15.78:6789/0 conn(0x7f454c13aa20 legacy=0x7f454c151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454959a700 1 -- 172.21.15.78:0/1815058179 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646965435 0 0) 0x7f454c0c2c10 con 0x7f454c13aa20 2023-08-17T18:12:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454a59c700 1 -- 172.21.15.78:0/1815058179 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c1555c0 con 0x7f454c13a640 2023-08-17T18:12:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454a59c700 1 --2- 172.21.15.78:0/1815058179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 0x7f454c154b20 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7f453c009e60 tx=0x7f453c009780).ready entity=mon.0 client_cookie=bf11d7e45ca526bb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454959a700 1 -- 172.21.15.78:0/1815058179 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c00e070 con 0x7f454c13a640 2023-08-17T18:12:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454959a700 1 -- 172.21.15.78:0/1815058179 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c00bc30 con 0x7f454c13a640 2023-08-17T18:12:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.576+0000 7f454959a700 1 -- 172.21.15.78:0/1815058179 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c012410 con 0x7f454c13a640 2023-08-17T18:12:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.577+0000 7f4550c71700 1 -- 172.21.15.78:0/1815058179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 msgr2=0x7f454c154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.577+0000 7f4550c71700 1 --2- 172.21.15.78:0/1815058179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 0x7f454c154b20 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7f453c009e60 tx=0x7f453c009780).stop 2023-08-17T18:12:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.577+0000 7f4550c71700 1 -- 172.21.15.78:0/1815058179 shutdown_connections 2023-08-17T18:12:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.577+0000 7f4550c71700 1 --2- 172.21.15.78:0/1815058179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 0x7f454c154b20 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.577+0000 7f4550c71700 1 --2- 172.21.15.78:0/1815058179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f454c06a2c0 0x7f454c069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.577+0000 7f4550c71700 1 -- 172.21.15.78:0/1815058179 >> 172.21.15.78:0/1815058179 conn(0x7f454c0c7b00 msgr2=0x7f454c0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.577+0000 7f4550c71700 1 -- 172.21.15.78:0/1815058179 shutdown_connections 2023-08-17T18:12:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.577+0000 7f4550c71700 1 -- 172.21.15.78:0/1815058179 wait complete. 2023-08-17T18:12:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.578+0000 7f4550c71700 1 Processor -- start 2023-08-17T18:12:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.578+0000 7f4550c71700 1 -- start start 2023-08-17T18:12:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4550c71700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f454c06a2c0 0x7f454c066080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4550c71700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 0x7f454c0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4550c71700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f454c13aa20 0x7f454c0ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4550c71700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0ac730 con 0x7f454c13a640 2023-08-17T18:12:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4550c71700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0abb20 con 0x7f454c13aa20 2023-08-17T18:12:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4550c71700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0abe00 con 0x7f454c06a2c0 2023-08-17T18:12:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4549d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 0x7f454c0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4549d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 0x7f454c0acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47288/0 (socket says 172.21.15.78:47288) 2023-08-17T18:12:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4549d9b700 1 -- 172.21.15.78:0/4096868220 learned_addr learned my addr 172.21.15.78:0/4096868220 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f454ad9d700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f454c13aa20 0x7f454c0ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f454a59c700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f454c06a2c0 0x7f454c066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4549d9b700 1 -- 172.21.15.78:0/4096868220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f454c06a2c0 msgr2=0x7f454c066080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4549d9b700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f454c06a2c0 0x7f454c066080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4549d9b700 1 -- 172.21.15.78:0/4096868220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f454c13aa20 msgr2=0x7f454c0ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4549d9b700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f454c13aa20 0x7f454c0ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4549d9b700 1 -- 172.21.15.78:0/4096868220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c009a20 con 0x7f454c13a640 2023-08-17T18:12:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4549d9b700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 0x7f454c0acd60 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f454000c850 tx=0x7f4540008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f453a7fc700 1 -- 172.21.15.78:0/4096868220 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540010580 con 0x7f454c13a640 2023-08-17T18:12:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f453a7fc700 1 -- 172.21.15.78:0/4096868220 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45400106e0 con 0x7f454c13a640 2023-08-17T18:12:19.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4550c71700 1 -- 172.21.15.78:0/4096868220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c0ac0e0 con 0x7f454c13a640 2023-08-17T18:12:19.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f453a7fc700 1 -- 172.21.15.78:0/4096868220 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540010a60 con 0x7f454c13a640 2023-08-17T18:12:19.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.579+0000 7f4550c71700 1 -- 172.21.15.78:0/4096868220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c0ad740 con 0x7f454c13a640 2023-08-17T18:12:19.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.580+0000 7f4550c71700 1 -- 172.21.15.78:0/4096868220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c047350 con 0x7f454c13a640 2023-08-17T18:12:19.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.581+0000 7f453a7fc700 1 -- 172.21.15.78:0/4096868220 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f454001b460 con 0x7f454c13a640 2023-08-17T18:12:19.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.581+0000 7f453a7fc700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f452c05ed60 0x7f452c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.581+0000 7f453a7fc700 1 -- 172.21.15.78:0/4096868220 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4540079bf0 con 0x7f454c13a640 2023-08-17T18:12:19.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.581+0000 7f454a59c700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f452c05ed60 0x7f452c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.581+0000 7f454a59c700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f452c05ed60 0x7f452c061220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f453c00b9f0 tx=0x7f453c009780).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:19.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.585+0000 7f453a7fc700 1 -- 172.21.15.78:0/4096868220 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f454004b130 con 0x7f454c13a640 2023-08-17T18:12:19.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.751+0000 7f4550c71700 1 -- 172.21.15.78:0/4096868220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f454c0adae0 con 0x7f454c13a640 2023-08-17T18:12:19.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.751+0000 7f453a7fc700 1 -- 172.21.15.78:0/4096868220 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+17004 (secure 0 0 0) 0x7f454004e750 con 0x7f454c13a640 2023-08-17T18:12:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:19.752 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":184,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:19.124531+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:12:17.650042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T18:12:18.089352+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:19.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 -- 172.21.15.78:0/4096868220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f452c05ed60 msgr2=0x7f452c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f452c05ed60 0x7f452c061220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f453c00b9f0 tx=0x7f453c009780).stop 2023-08-17T18:12:19.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 -- 172.21.15.78:0/4096868220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 msgr2=0x7f454c0acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 0x7f454c0acd60 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f454000c850 tx=0x7f4540008040).stop 2023-08-17T18:12:19.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 -- 172.21.15.78:0/4096868220 shutdown_connections 2023-08-17T18:12:19.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f452c05ed60 0x7f452c061220 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f454c13aa20 0x7f454c0ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f454c06a2c0 0x7f454c066080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 --2- 172.21.15.78:0/4096868220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c13a640 0x7f454c0acd60 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 -- 172.21.15.78:0/4096868220 >> 172.21.15.78:0/4096868220 conn(0x7f454c0c7b00 msgr2=0x7f454c0c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:19.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 -- 172.21.15.78:0/4096868220 shutdown_connections 2023-08-17T18:12:19.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.754+0000 7f4550c71700 1 -- 172.21.15.78:0/4096868220 wait complete. 2023-08-17T18:12:19.766 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T18:12:19.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.882+0000 7f8a73da7700 1 Processor -- start 2023-08-17T18:12:19.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.882+0000 7f8a73da7700 1 -- start start 2023-08-17T18:12:19.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.883+0000 7f8a73da7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a6c0bec40 0x7f8a6c15ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.883+0000 7f8a73da7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c0a5a20 con 0x7f8a6c13bc70 2023-08-17T18:12:19.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.883+0000 7f8a73da7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c0c3570 con 0x7f8a6c13b890 2023-08-17T18:12:19.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.883+0000 7f8a73da7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0c32d0 con 0x7f8a6c0bec40 2023-08-17T18:12:19.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.883+0000 7f8a72344700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a6c0bec40 0x7f8a6c15ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.883+0000 7f8a72344700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a6c0bec40 0x7f8a6c15ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47294/0 (socket says 172.21.15.78:47294) 2023-08-17T18:12:19.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.883+0000 7f8a72344700 1 -- 172.21.15.78:0/810905476 learned_addr learned my addr 172.21.15.78:0/810905476 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:19.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.883+0000 7f8a71342700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8a6c13bc70 0x7f8a6c1563e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53210/0 (socket says 172.21.15.78:53210) 2023-08-17T18:12:19.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a72344700 1 -- 172.21.15.78:0/810905476 >> v1:172.21.15.150:6789/0 conn(0x7f8a6c13b890 legacy=0x7f8a6c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a72344700 1 -- 172.21.15.78:0/810905476 >> v1:172.21.15.78:6789/0 conn(0x7f8a6c13bc70 legacy=0x7f8a6c1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a72344700 1 -- 172.21.15.78:0/810905476 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0bfad0 con 0x7f8a6c0bec40 2023-08-17T18:12:19.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a70b41700 1 -- 172.21.15.78:0/810905476 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521767594 0 0) 0x7f8a6c0a5a20 con 0x7f8a6c13bc70 2023-08-17T18:12:19.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a72344700 1 --2- 172.21.15.78:0/810905476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 0x7f8a6c15ce80 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7f8a64006fd0 tx=0x7f8a640090f0).ready entity=mon.0 client_cookie=5c9d5000456ac73e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:19.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a70b41700 1 -- 172.21.15.78:0/810905476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400b600 con 0x7f8a6c0bec40 2023-08-17T18:12:19.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a70b41700 1 -- 172.21.15.78:0/810905476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6400b760 con 0x7f8a6c0bec40 2023-08-17T18:12:19.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a70b41700 1 -- 172.21.15.78:0/810905476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400bae0 con 0x7f8a6c0bec40 2023-08-17T18:12:19.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a73da7700 1 -- 172.21.15.78:0/810905476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 msgr2=0x7f8a6c15ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a73da7700 1 --2- 172.21.15.78:0/810905476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 0x7f8a6c15ce80 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7f8a64006fd0 tx=0x7f8a640090f0).stop 2023-08-17T18:12:19.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a73da7700 1 -- 172.21.15.78:0/810905476 shutdown_connections 2023-08-17T18:12:19.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a73da7700 1 --2- 172.21.15.78:0/810905476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 0x7f8a6c15ce80 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a73da7700 1 -- 172.21.15.78:0/810905476 >> 172.21.15.78:0/810905476 conn(0x7f8a6c062f80 msgr2=0x7f8a6c0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:19.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a73da7700 1 -- 172.21.15.78:0/810905476 shutdown_connections 2023-08-17T18:12:19.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.884+0000 7f8a73da7700 1 -- 172.21.15.78:0/810905476 wait complete. 2023-08-17T18:12:19.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.885+0000 7f8a73da7700 1 Processor -- start 2023-08-17T18:12:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.886+0000 7f8a73da7700 1 -- start start 2023-08-17T18:12:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.886+0000 7f8a73da7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 0x7f8a6c155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.886+0000 7f8a73da7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a6c13b890 0x7f8a6c151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.886+0000 7f8a73da7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a6c13bc70 0x7f8a6c0c1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.886+0000 7f8a73da7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c155200 con 0x7f8a6c0bec40 2023-08-17T18:12:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.886+0000 7f8a73da7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c1548d0 con 0x7f8a6c13b890 2023-08-17T18:12:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.886+0000 7f8a73da7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c154bb0 con 0x7f8a6c13bc70 2023-08-17T18:12:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.886+0000 7f8a71b43700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 0x7f8a6c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.886+0000 7f8a71b43700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 0x7f8a6c155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47304/0 (socket says 172.21.15.78:47304) 2023-08-17T18:12:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.886+0000 7f8a71b43700 1 -- 172.21.15.78:0/2845299882 learned_addr learned my addr 172.21.15.78:0/2845299882 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a72344700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a6c13bc70 0x7f8a6c0c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a71342700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a6c13b890 0x7f8a6c151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a71b43700 1 -- 172.21.15.78:0/2845299882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a6c13bc70 msgr2=0x7f8a6c0c1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a71b43700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a6c13bc70 0x7f8a6c0c1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a71b43700 1 -- 172.21.15.78:0/2845299882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a6c13b890 msgr2=0x7f8a6c151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a71b43700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a6c13b890 0x7f8a6c151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:19.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a71b43700 1 -- 172.21.15.78:0/2845299882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a64009370 con 0x7f8a6c0bec40 2023-08-17T18:12:19.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a71b43700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 0x7f8a6c155690 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f8a6800c840 tx=0x7f8a68001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:19.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a61ffb700 1 -- 172.21.15.78:0/2845299882 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68006a20 con 0x7f8a6c0bec40 2023-08-17T18:12:19.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a61ffb700 1 -- 172.21.15.78:0/2845299882 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68006b80 con 0x7f8a6c0bec40 2023-08-17T18:12:19.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a73da7700 1 -- 172.21.15.78:0/2845299882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c154e90 con 0x7f8a6c0bec40 2023-08-17T18:12:19.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a61ffb700 1 -- 172.21.15.78:0/2845299882 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68007020 con 0x7f8a6c0bec40 2023-08-17T18:12:19.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.887+0000 7f8a73da7700 1 -- 172.21.15.78:0/2845299882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c0c1e80 con 0x7f8a6c0bec40 2023-08-17T18:12:19.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.888+0000 7f8a73da7700 1 -- 172.21.15.78:0/2845299882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c1554e0 con 0x7f8a6c0bec40 2023-08-17T18:12:19.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.888+0000 7f8a61ffb700 1 -- 172.21.15.78:0/2845299882 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8a68018020 con 0x7f8a6c0bec40 2023-08-17T18:12:19.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.888+0000 7f8a61ffb700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8a5005ed90 0x7f8a50061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:19.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.889+0000 7f8a61ffb700 1 -- 172.21.15.78:0/2845299882 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8a680791c0 con 0x7f8a6c0bec40 2023-08-17T18:12:19.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.889+0000 7f8a71342700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8a5005ed90 0x7f8a50061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:19.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.889+0000 7f8a71342700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8a5005ed90 0x7f8a50061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8a6c0aeee0 tx=0x7f8a5c007c30).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:19.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:19.893+0000 7f8a61ffb700 1 -- 172.21.15.78:0/2845299882 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a680488f0 con 0x7f8a6c0bec40 2023-08-17T18:12:20.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.098+0000 7f8a73da7700 1 -- 172.21.15.78:0/2845299882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8a6c046af0 con 0x7f8a6c0bec40 2023-08-17T18:12:20.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.129+0000 7f8a61ffb700 1 -- 172.21.15.78:0/2845299882 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8a6804a760 con 0x7f8a6c0bec40 2023-08-17T18:12:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 -- 172.21.15.78:0/2845299882 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8a5005ed90 msgr2=0x7f8a50061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8a5005ed90 0x7f8a50061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8a6c0aeee0 tx=0x7f8a5c007c30).stop 2023-08-17T18:12:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 -- 172.21.15.78:0/2845299882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 msgr2=0x7f8a6c155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 0x7f8a6c155690 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f8a6800c840 tx=0x7f8a68001660).stop 2023-08-17T18:12:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 -- 172.21.15.78:0/2845299882 shutdown_connections 2023-08-17T18:12:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8a5005ed90 0x7f8a50061250 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0x7f8a6c0aeee0 tx=0x7f8a5c007c30).stop 2023-08-17T18:12:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a6c13bc70 0x7f8a6c0c1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6c0bec40 0x7f8a6c155690 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 --2- 172.21.15.78:0/2845299882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a6c13b890 0x7f8a6c151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 -- 172.21.15.78:0/2845299882 >> 172.21.15.78:0/2845299882 conn(0x7f8a6c062f80 msgr2=0x7f8a6c0c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 -- 172.21.15.78:0/2845299882 shutdown_connections 2023-08-17T18:12:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.131+0000 7f8a73da7700 1 -- 172.21.15.78:0/2845299882 wait complete. 2023-08-17T18:12:20.143 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T18:12:20.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T18:12:20.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.260+0000 7f1967b15700 1 Processor -- start 2023-08-17T18:12:20.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.260+0000 7f1967b15700 1 -- start start 2023-08-17T18:12:20.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.261+0000 7f1967b15700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19600aa4d0 0x7f19600644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:20.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.261+0000 7f1967b15700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19600c5810 0x7f19600c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:20.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.261+0000 7f1967b15700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19600649b0 con 0x7f19600aa0f0 2023-08-17T18:12:20.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.261+0000 7f1967b15700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19600c6150 con 0x7f19600c5810 2023-08-17T18:12:20.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.261+0000 7f1967b15700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1960063420 con 0x7f19600aa4d0 2023-08-17T18:12:20.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.261+0000 7f19658b1700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f19600aa0f0 0x7f19600c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53214/0 (socket says 172.21.15.78:53214) 2023-08-17T18:12:20.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.261+0000 7f19660b2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19600c5810 0x7f19600c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:20.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.261+0000 7f19658b1700 1 -- 172.21.15.78:0/1102625921 learned_addr learned my addr 172.21.15.78:0/1102625921 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f19660b2700 1 -- 172.21.15.78:0/1102625921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19600aa4d0 msgr2=0x7f19600644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f19650b0700 1 --2- 172.21.15.78:0/1102625921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19600aa4d0 0x7f19600644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:20.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f19660b2700 1 --2- 172.21.15.78:0/1102625921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19600aa4d0 0x7f19600644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:20.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f19648af700 1 -- 172.21.15.78:0/1102625921 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116863307 0 0) 0x7f19600649b0 con 0x7f19600aa0f0 2023-08-17T18:12:20.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f19660b2700 1 -- 172.21.15.78:0/1102625921 >> v1:172.21.15.78:6789/0 conn(0x7f19600aa0f0 legacy=0x7f19600c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:20.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f19660b2700 1 -- 172.21.15.78:0/1102625921 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1960063700 con 0x7f19600c5810 2023-08-17T18:12:20.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f19660b2700 1 --2- 172.21.15.78:0/1102625921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 0x7f19600c5c60 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f1958009760 tx=0x7f1958009060).ready entity=mon.0 client_cookie=c54c1bb97a334afd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:20.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f19648af700 1 -- 172.21.15.78:0/1102625921 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195800b580 con 0x7f19600c5810 2023-08-17T18:12:20.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f19648af700 1 -- 172.21.15.78:0/1102625921 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195800b6e0 con 0x7f19600c5810 2023-08-17T18:12:20.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f19648af700 1 -- 172.21.15.78:0/1102625921 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195800ba60 con 0x7f19600c5810 2023-08-17T18:12:20.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f1967b15700 1 -- 172.21.15.78:0/1102625921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 msgr2=0x7f19600c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:20.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f1967b15700 1 --2- 172.21.15.78:0/1102625921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 0x7f19600c5c60 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f1958009760 tx=0x7f1958009060).stop 2023-08-17T18:12:20.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f1967b15700 1 -- 172.21.15.78:0/1102625921 shutdown_connections 2023-08-17T18:12:20.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f1967b15700 1 --2- 172.21.15.78:0/1102625921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 0x7f19600c5c60 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:20.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f1967b15700 1 --2- 172.21.15.78:0/1102625921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19600aa4d0 0x7f19600644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:20.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f1967b15700 1 -- 172.21.15.78:0/1102625921 >> 172.21.15.78:0/1102625921 conn(0x7f196006a6a0 msgr2=0x7f19600caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:20.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.262+0000 7f1967b15700 1 -- 172.21.15.78:0/1102625921 shutdown_connections 2023-08-17T18:12:20.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.263+0000 7f1967b15700 1 -- 172.21.15.78:0/1102625921 wait complete. 2023-08-17T18:12:20.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f1967b15700 1 Processor -- start 2023-08-17T18:12:20.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f1967b15700 1 -- start start 2023-08-17T18:12:20.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f1967b15700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19600aa0f0 0x7f1960152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:20.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f1967b15700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19600aa4d0 0x7f19600c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:20.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f1967b15700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 0x7f19600c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:20.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f1967b15700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19600ac7e0 con 0x7f19600c5810 2023-08-17T18:12:20.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f1967b15700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19600c2240 con 0x7f19600aa0f0 2023-08-17T18:12:20.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f1967b15700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19600abbd0 con 0x7f19600aa4d0 2023-08-17T18:12:20.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f19660b2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 0x7f19600c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:20.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f19660b2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 0x7f19600c36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47316/0 (socket says 172.21.15.78:47316) 2023-08-17T18:12:20.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.264+0000 7f19660b2700 1 -- 172.21.15.78:0/1689188333 learned_addr learned my addr 172.21.15.78:0/1689188333 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:20.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f19650b0700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19600aa4d0 0x7f19600c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:20.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f19658b1700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19600aa0f0 0x7f1960152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:20.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f19660b2700 1 -- 172.21.15.78:0/1689188333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19600aa4d0 msgr2=0x7f19600c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:20.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f19660b2700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19600aa4d0 0x7f19600c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:20.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f19660b2700 1 -- 172.21.15.78:0/1689188333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19600aa0f0 msgr2=0x7f1960152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:20.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f19660b2700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19600aa0f0 0x7f1960152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:20.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f19660b2700 1 -- 172.21.15.78:0/1689188333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580092a0 con 0x7f19600c5810 2023-08-17T18:12:20.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f19660b2700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 0x7f19600c36e0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f1958009eb0 tx=0x7f1958017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:20.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f1955ffb700 1 -- 172.21.15.78:0/1689188333 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195800ba60 con 0x7f19600c5810 2023-08-17T18:12:20.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f1955ffb700 1 -- 172.21.15.78:0/1689188333 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195801c420 con 0x7f19600c5810 2023-08-17T18:12:20.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f1967b15700 1 -- 172.21.15.78:0/1689188333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19600abeb0 con 0x7f19600c5810 2023-08-17T18:12:20.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f1955ffb700 1 -- 172.21.15.78:0/1689188333 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195801c7c0 con 0x7f19600c5810 2023-08-17T18:12:20.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.265+0000 7f1967b15700 1 -- 172.21.15.78:0/1689188333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19600ac470 con 0x7f19600c5810 2023-08-17T18:12:20.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.266+0000 7f1967b15700 1 -- 172.21.15.78:0/1689188333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1960083980 con 0x7f19600c5810 2023-08-17T18:12:20.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.267+0000 7f1955ffb700 1 -- 172.21.15.78:0/1689188333 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f195802c070 con 0x7f19600c5810 2023-08-17T18:12:20.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.267+0000 7f1955ffb700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f194405ed90 0x7f1944061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:20.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.267+0000 7f1955ffb700 1 -- 172.21.15.78:0/1689188333 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f195807bd10 con 0x7f19600c5810 2023-08-17T18:12:20.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.267+0000 7f19658b1700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f194405ed90 0x7f1944061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:20.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.267+0000 7f19658b1700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f194405ed90 0x7f1944061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f195c001a90 tx=0x7f195c0014d0).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:20.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.271+0000 7f1955ffb700 1 -- 172.21.15.78:0/1689188333 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f195804d2b0 con 0x7f19600c5810 2023-08-17T18:12:20.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:20.477+0000 7f1967b15700 1 -- 172.21.15.78:0/1689188333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1960046af0 con 0x7f19600c5810 2023-08-17T18:12:21.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.136+0000 7f1955ffb700 1 -- 172.21.15.78:0/1689188333 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v67) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1958020020 con 0x7f19600c5810 2023-08-17T18:12:21.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 -- 172.21.15.78:0/1689188333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f194405ed90 msgr2=0x7f1944061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f194405ed90 0x7f1944061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f195c001a90 tx=0x7f195c0014d0).stop 2023-08-17T18:12:21.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 -- 172.21.15.78:0/1689188333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 msgr2=0x7f19600c36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 0x7f19600c36e0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f1958009eb0 tx=0x7f1958017000).stop 2023-08-17T18:12:21.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 -- 172.21.15.78:0/1689188333 shutdown_connections 2023-08-17T18:12:21.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f194405ed90 0x7f1944061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19600c5810 0x7f19600c36e0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19600aa0f0 0x7f1960152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 --2- 172.21.15.78:0/1689188333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19600aa4d0 0x7f19600c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 -- 172.21.15.78:0/1689188333 >> 172.21.15.78:0/1689188333 conn(0x7f196006a6a0 msgr2=0x7f19600c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:21.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 -- 172.21.15.78:0/1689188333 shutdown_connections 2023-08-17T18:12:21.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.138+0000 7f1967b15700 1 -- 172.21.15.78:0/1689188333 wait complete. 2023-08-17T18:12:21.150 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T18:12:21.151 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:21.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.264+0000 7ff67ca84700 1 Processor -- start 2023-08-17T18:12:21.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.264+0000 7ff67ca84700 1 -- start start 2023-08-17T18:12:21.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.264+0000 7ff67ca84700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6780c1010 0x7ff6780ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.264+0000 7ff67ca84700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6780c7350 con 0x7ff6780c6ee0 2023-08-17T18:12:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.264+0000 7ff67ca84700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6780a8350 con 0x7ff678154140 2023-08-17T18:12:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.264+0000 7ff67ca84700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff678154520 con 0x7ff6780c1010 2023-08-17T18:12:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff676d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6780c1010 0x7ff6780ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff66dd9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff6780c6ee0 0x7ff6780c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53216/0 (socket says 172.21.15.78:53216) 2023-08-17T18:12:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff66dd9b700 1 -- 172.21.15.78:0/2084300918 learned_addr learned my addr 172.21.15.78:0/2084300918 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff676d9d700 1 -- 172.21.15.78:0/2084300918 >> v1:172.21.15.150:6789/0 conn(0x7ff678154140 legacy=0x7ff6780a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff675d9b700 1 -- 172.21.15.78:0/2084300918 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140431419 0 0) 0x7ff6780c7350 con 0x7ff6780c6ee0 2023-08-17T18:12:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff676d9d700 1 -- 172.21.15.78:0/2084300918 >> v1:172.21.15.78:6789/0 conn(0x7ff6780c6ee0 legacy=0x7ff6780c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff676d9d700 1 -- 172.21.15.78:0/2084300918 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6780c91e0 con 0x7ff6780c1010 2023-08-17T18:12:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff676d9d700 1 --2- 172.21.15.78:0/2084300918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6780c1010 0x7ff6780ca280 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7ff670009e60 tx=0x7ff670009780).ready entity=mon.0 client_cookie=11cd44e82f98f6f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff675d9b700 1 -- 172.21.15.78:0/2084300918 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67000e070 con 0x7ff6780c1010 2023-08-17T18:12:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff675d9b700 1 -- 172.21.15.78:0/2084300918 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67000bbf0 con 0x7ff6780c1010 2023-08-17T18:12:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.265+0000 7ff675d9b700 1 -- 172.21.15.78:0/2084300918 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670012410 con 0x7ff6780c1010 2023-08-17T18:12:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.266+0000 7ff67ca84700 1 -- 172.21.15.78:0/2084300918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6780c1010 msgr2=0x7ff6780ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.266+0000 7ff67ca84700 1 --2- 172.21.15.78:0/2084300918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6780c1010 0x7ff6780ca280 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7ff670009e60 tx=0x7ff670009780).stop 2023-08-17T18:12:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.266+0000 7ff67ca84700 1 -- 172.21.15.78:0/2084300918 shutdown_connections 2023-08-17T18:12:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.266+0000 7ff67ca84700 1 --2- 172.21.15.78:0/2084300918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6780c1010 0x7ff6780ca280 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.266+0000 7ff67ca84700 1 -- 172.21.15.78:0/2084300918 >> 172.21.15.78:0/2084300918 conn(0x7ff678094510 msgr2=0x7ff67806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.266+0000 7ff67ca84700 1 -- 172.21.15.78:0/2084300918 shutdown_connections 2023-08-17T18:12:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.266+0000 7ff67ca84700 1 -- 172.21.15.78:0/2084300918 wait complete. 2023-08-17T18:12:21.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.267+0000 7ff67ca84700 1 Processor -- start 2023-08-17T18:12:21.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.267+0000 7ff67ca84700 1 -- start start 2023-08-17T18:12:21.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff67ca84700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6780c1010 0x7ff67814f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff67ca84700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6780c6ee0 0x7ff67814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff67ca84700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff678154140 0x7ff6781510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff67ca84700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff678150de0 con 0x7ff678154140 2023-08-17T18:12:21.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff67ca84700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67814f870 con 0x7ff6780c6ee0 2023-08-17T18:12:21.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff67ca84700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67814fb50 con 0x7ff6780c1010 2023-08-17T18:12:21.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff676d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff678154140 0x7ff6781510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff676d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff678154140 0x7ff6781510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47334/0 (socket says 172.21.15.78:47334) 2023-08-17T18:12:21.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff676d9d700 1 -- 172.21.15.78:0/3022704094 learned_addr learned my addr 172.21.15.78:0/3022704094 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:21.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff66dd9b700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6780c6ee0 0x7ff67814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff67659c700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6780c1010 0x7ff67814f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff676d9d700 1 -- 172.21.15.78:0/3022704094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6780c1010 msgr2=0x7ff67814f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff676d9d700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6780c1010 0x7ff67814f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff676d9d700 1 -- 172.21.15.78:0/3022704094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6780c6ee0 msgr2=0x7ff67814cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff676d9d700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6780c6ee0 0x7ff67814cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff676d9d700 1 -- 172.21.15.78:0/3022704094 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff670009a20 con 0x7ff678154140 2023-08-17T18:12:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff67659c700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6780c1010 0x7ff67814f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff676d9d700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff678154140 0x7ff6781510c0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7ff67000b6c0 tx=0x7ff670009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff66effd700 1 -- 172.21.15.78:0/3022704094 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6700117d0 con 0x7ff678154140 2023-08-17T18:12:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff66effd700 1 -- 172.21.15.78:0/3022704094 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff670011930 con 0x7ff678154140 2023-08-17T18:12:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff67ca84700 1 -- 172.21.15.78:0/3022704094 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67814fe30 con 0x7ff678154140 2023-08-17T18:12:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff66effd700 1 -- 172.21.15.78:0/3022704094 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670011cf0 con 0x7ff678154140 2023-08-17T18:12:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.268+0000 7ff67ca84700 1 -- 172.21.15.78:0/3022704094 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6780c2880 con 0x7ff678154140 2023-08-17T18:12:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.269+0000 7ff67ca84700 1 -- 172.21.15.78:0/3022704094 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff678047350 con 0x7ff678154140 2023-08-17T18:12:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.270+0000 7ff66effd700 1 -- 172.21.15.78:0/3022704094 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff67001d630 con 0x7ff678154140 2023-08-17T18:12:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.270+0000 7ff66effd700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff65805ed90 0x7ff658061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.270+0000 7ff66effd700 1 -- 172.21.15.78:0/3022704094 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff67007bcf0 con 0x7ff678154140 2023-08-17T18:12:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.270+0000 7ff67659c700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff65805ed90 0x7ff658061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.270+0000 7ff67659c700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff65805ed90 0x7ff658061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff66800a820 tx=0x7ff668008040).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:21.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.274+0000 7ff66effd700 1 -- 172.21.15.78:0/3022704094 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff67004d290 con 0x7ff678154140 2023-08-17T18:12:21.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.475+0000 7ff67ca84700 1 -- 172.21.15.78:0/3022704094 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff678047350 con 0x7ff678154140 2023-08-17T18:12:21.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.476+0000 7ff66effd700 1 -- 172.21.15.78:0/3022704094 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4496 (secure 0 0 0) 0x7ff6700508b0 con 0x7ff678154140 2023-08-17T18:12:21.476 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:21.476 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":67,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1111956777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1111956777},{"type":"v1","addr":"172.21.15.78:6837","nonce":1111956777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1739806080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1739806080},{"type":"v1","addr":"172.21.15.150:6834","nonce":1739806080}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":9528,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/168802869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":168802869},{"type":"v1","addr":"172.21.15.78:6836","nonce":168802869}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:12:19.124866+0000","modified":"2023-08-17T18:12:21.130921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9537":{"gid":9537,"name":"d","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2525491694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2525491694},{"type":"v1","addr":"172.21.15.150:6835","nonce":2525491694}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T18:12:21.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 -- 172.21.15.78:0/3022704094 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff65805ed90 msgr2=0x7ff658061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff65805ed90 0x7ff658061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff66800a820 tx=0x7ff668008040).stop 2023-08-17T18:12:21.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 -- 172.21.15.78:0/3022704094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff678154140 msgr2=0x7ff6781510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff678154140 0x7ff6781510c0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7ff67000b6c0 tx=0x7ff670009780).stop 2023-08-17T18:12:21.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 -- 172.21.15.78:0/3022704094 shutdown_connections 2023-08-17T18:12:21.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff65805ed90 0x7ff658061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff678154140 0x7ff6781510c0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6780c1010 0x7ff67814f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 --2- 172.21.15.78:0/3022704094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6780c6ee0 0x7ff67814cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 -- 172.21.15.78:0/3022704094 >> 172.21.15.78:0/3022704094 conn(0x7ff678094510 msgr2=0x7ff67814e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:21.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 -- 172.21.15.78:0/3022704094 shutdown_connections 2023-08-17T18:12:21.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.478+0000 7ff67ca84700 1 -- 172.21.15.78:0/3022704094 wait complete. 2023-08-17T18:12:21.480 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 67 2023-08-17T18:12:21.490 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:21.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.603+0000 7f41c65e6700 1 Processor -- start 2023-08-17T18:12:21.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.603+0000 7f41c65e6700 1 -- start start 2023-08-17T18:12:21.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.604+0000 7f41c65e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f41c0151e40 0x7f41c0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.604+0000 7f41c65e6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f41c00a7c90 0x7f41c00c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.604+0000 7f41c65e6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c00bf210 con 0x7f41c00be4d0 2023-08-17T18:12:21.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.604+0000 7f41c65e6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c00c5a80 con 0x7f41c00a7c90 2023-08-17T18:12:21.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.604+0000 7f41c65e6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c00c5450 con 0x7f41c0151e40 2023-08-17T18:12:21.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41bf7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f41c00a7c90 0x7f41c00c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41c4b83700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f41c00be4d0 0x7f41c00be900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53226/0 (socket says 172.21.15.78:53226) 2023-08-17T18:12:21.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41c4b83700 1 -- 172.21.15.78:0/1802580 learned_addr learned my addr 172.21.15.78:0/1802580 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:21.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41bf7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f41c00a7c90 0x7f41c00c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47344/0 (socket says 172.21.15.78:47344) 2023-08-17T18:12:21.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41bffff700 1 --2- 172.21.15.78:0/1802580 >> v2:172.21.15.150:3300/0 conn(0x7f41c0151e40 0x7f41c0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41bf7fe700 1 -- 172.21.15.78:0/1802580 >> v2:172.21.15.150:3300/0 conn(0x7f41c0151e40 msgr2=0x7f41c0152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:21.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41bf7fe700 1 --2- 172.21.15.78:0/1802580 >> v2:172.21.15.150:3300/0 conn(0x7f41c0151e40 0x7f41c0152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41bf7fe700 1 -- 172.21.15.78:0/1802580 >> v1:172.21.15.78:6789/0 conn(0x7f41c00be4d0 legacy=0x7f41c00be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41beffd700 1 -- 172.21.15.78:0/1802580 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621454449 0 0) 0x7f41c00bf210 con 0x7f41c00be4d0 2023-08-17T18:12:21.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41bf7fe700 1 -- 172.21.15.78:0/1802580 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c01533f0 con 0x7f41c00a7c90 2023-08-17T18:12:21.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41bf7fe700 1 --2- 172.21.15.78:0/1802580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 0x7f41c00c5f10 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7f41c00685c0 tx=0x7f41b4009060).ready entity=mon.0 client_cookie=639d794ae097dd75 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:21.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41beffd700 1 -- 172.21.15.78:0/1802580 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b400b580 con 0x7f41c00a7c90 2023-08-17T18:12:21.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41beffd700 1 -- 172.21.15.78:0/1802580 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b400b6e0 con 0x7f41c00a7c90 2023-08-17T18:12:21.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.605+0000 7f41beffd700 1 -- 172.21.15.78:0/1802580 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b400ba60 con 0x7f41c00a7c90 2023-08-17T18:12:21.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.606+0000 7f41c65e6700 1 -- 172.21.15.78:0/1802580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 msgr2=0x7f41c00c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.606+0000 7f41c65e6700 1 --2- 172.21.15.78:0/1802580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 0x7f41c00c5f10 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7f41c00685c0 tx=0x7f41b4009060).stop 2023-08-17T18:12:21.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.606+0000 7f41c65e6700 1 -- 172.21.15.78:0/1802580 shutdown_connections 2023-08-17T18:12:21.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.606+0000 7f41c65e6700 1 --2- 172.21.15.78:0/1802580 >> v2:172.21.15.150:3300/0 conn(0x7f41c0151e40 0x7f41c0152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.606+0000 7f41c65e6700 1 --2- 172.21.15.78:0/1802580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 0x7f41c00c5f10 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.606+0000 7f41c65e6700 1 -- 172.21.15.78:0/1802580 >> 172.21.15.78:0/1802580 conn(0x7f41c0092330 msgr2=0x7f41c0062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:21.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.606+0000 7f41c65e6700 1 -- 172.21.15.78:0/1802580 shutdown_connections 2023-08-17T18:12:21.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.606+0000 7f41c65e6700 1 -- 172.21.15.78:0/1802580 wait complete. 2023-08-17T18:12:21.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.607+0000 7f41c65e6700 1 Processor -- start 2023-08-17T18:12:21.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.607+0000 7f41c65e6700 1 -- start start 2023-08-17T18:12:21.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41c65e6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 0x7f41c014d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41c65e6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41c00be4d0 0x7f41c00aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41c65e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41c0151e40 0x7f41c00ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41c65e6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00c95b0 con 0x7f41c00a7c90 2023-08-17T18:12:21.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41c65e6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c014df40 con 0x7f41c00be4d0 2023-08-17T18:12:21.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41c65e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00ab5f0 con 0x7f41c0151e40 2023-08-17T18:12:21.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41bffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 0x7f41c014d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41bffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 0x7f41c014d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47358/0 (socket says 172.21.15.78:47358) 2023-08-17T18:12:21.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41bffff700 1 -- 172.21.15.78:0/3805146230 learned_addr learned my addr 172.21.15.78:0/3805146230 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:21.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41bf7fe700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41c00be4d0 0x7f41c00aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41c4b83700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41c0151e40 0x7f41c00ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41bffff700 1 -- 172.21.15.78:0/3805146230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41c0151e40 msgr2=0x7f41c00ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41bffff700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41c0151e40 0x7f41c00ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41bffff700 1 -- 172.21.15.78:0/3805146230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41c00be4d0 msgr2=0x7f41c00aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41bffff700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41c00be4d0 0x7f41c00aaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41bffff700 1 -- 172.21.15.78:0/3805146230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b40092a0 con 0x7f41c00a7c90 2023-08-17T18:12:21.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41bffff700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 0x7f41c014d8a0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7f41b000d860 tx=0x7f41b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:21.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41a7fff700 1 -- 172.21.15.78:0/3805146230 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0011590 con 0x7f41c00a7c90 2023-08-17T18:12:21.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41a7fff700 1 -- 172.21.15.78:0/3805146230 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b00116f0 con 0x7f41c00a7c90 2023-08-17T18:12:21.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41c65e6700 1 -- 172.21.15.78:0/3805146230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c00c8c80 con 0x7f41c00a7c90 2023-08-17T18:12:21.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41a7fff700 1 -- 172.21.15.78:0/3805146230 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0011a70 con 0x7f41c00a7c90 2023-08-17T18:12:21.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.608+0000 7f41c65e6700 1 -- 172.21.15.78:0/3805146230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c00c9240 con 0x7f41c00a7c90 2023-08-17T18:12:21.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.609+0000 7f41c65e6700 1 -- 172.21.15.78:0/3805146230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c0047350 con 0x7f41c00a7c90 2023-08-17T18:12:21.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.610+0000 7f41a7fff700 1 -- 172.21.15.78:0/3805146230 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f41b0012420 con 0x7f41c00a7c90 2023-08-17T18:12:21.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.610+0000 7f41a7fff700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f41ac05edc0 0x7f41ac061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.610+0000 7f41a7fff700 1 -- 172.21.15.78:0/3805146230 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f41b00796a0 con 0x7f41c00a7c90 2023-08-17T18:12:21.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.610+0000 7f41bf7fe700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f41ac05edc0 0x7f41ac061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.611+0000 7f41bf7fe700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f41ac05edc0 0x7f41ac061280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f41b4009fd0 tx=0x7f41b4017000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:21.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.614+0000 7f41a7fff700 1 -- 172.21.15.78:0/3805146230 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f41b004abe0 con 0x7f41c00a7c90 2023-08-17T18:12:21.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.777+0000 7f41c65e6700 1 -- 172.21.15.78:0/3805146230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41c00a8190 con 0x7f41c00a7c90 2023-08-17T18:12:21.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.778+0000 7f41a7fff700 1 -- 172.21.15.78:0/3805146230 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f41b0011e60 con 0x7f41c00a7c90 2023-08-17T18:12:21.778 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:21.778 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":185,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:20.126750+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:12:17.650042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T18:12:18.089352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:21.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 -- 172.21.15.78:0/3805146230 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f41ac05edc0 msgr2=0x7f41ac061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f41ac05edc0 0x7f41ac061280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f41b4009fd0 tx=0x7f41b4017000).stop 2023-08-17T18:12:21.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 -- 172.21.15.78:0/3805146230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 msgr2=0x7f41c014d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 0x7f41c014d8a0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7f41b000d860 tx=0x7f41b0008040).stop 2023-08-17T18:12:21.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 -- 172.21.15.78:0/3805146230 shutdown_connections 2023-08-17T18:12:21.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f41ac05edc0 0x7f41ac061280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41c0151e40 0x7f41c00ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c00a7c90 0x7f41c014d8a0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 --2- 172.21.15.78:0/3805146230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41c00be4d0 0x7f41c00aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 -- 172.21.15.78:0/3805146230 >> 172.21.15.78:0/3805146230 conn(0x7f41c0092330 msgr2=0x7f41c01545f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:21.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 -- 172.21.15.78:0/3805146230 shutdown_connections 2023-08-17T18:12:21.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.780+0000 7f41c65e6700 1 -- 172.21.15.78:0/3805146230 wait complete. 2023-08-17T18:12:21.792 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T18:12:21.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T18:12:21.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.905+0000 7fcfb1746700 1 Processor -- start 2023-08-17T18:12:21.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.905+0000 7fcfb1746700 1 -- start start 2023-08-17T18:12:21.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfb1746700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcfac154140 0x7fcfac0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfb1746700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a7c40 0x7fcfac0c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfb1746700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcfac0a8080 0x7fcfac0c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfb1746700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac0c12e0 con 0x7fcfac0a8080 2023-08-17T18:12:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfb1746700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac154520 con 0x7fcfac154140 2023-08-17T18:12:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfb1746700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0c91e0 con 0x7fcfac0a7c40 2023-08-17T18:12:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfab7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcfac0a8080 0x7fcfac0c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfab7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcfac0a8080 0x7fcfac0c0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47374/0 (socket says 172.21.15.78:47374) 2023-08-17T18:12:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfab7fe700 1 -- 172.21.15.78:0/4280680990 learned_addr learned my addr 172.21.15.78:0/4280680990 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfaaffd700 1 --2- 172.21.15.78:0/4280680990 >> v2:172.21.15.150:3300/0 conn(0x7fcfac154140 0x7fcfac0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.906+0000 7fcfa27fc700 1 --2- 172.21.15.78:0/4280680990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a7c40 0x7fcfac0c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfab7fe700 1 -- 172.21.15.78:0/4280680990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a7c40 msgr2=0x7fcfac0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfab7fe700 1 --2- 172.21.15.78:0/4280680990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a7c40 0x7fcfac0c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfab7fe700 1 -- 172.21.15.78:0/4280680990 >> v2:172.21.15.150:3300/0 conn(0x7fcfac154140 msgr2=0x7fcfac0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfab7fe700 1 --2- 172.21.15.78:0/4280680990 >> v2:172.21.15.150:3300/0 conn(0x7fcfac154140 0x7fcfac0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfab7fe700 1 -- 172.21.15.78:0/4280680990 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac0c94c0 con 0x7fcfac0a8080 2023-08-17T18:12:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfa27fc700 1 --2- 172.21.15.78:0/4280680990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a7c40 0x7fcfac0c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfab7fe700 1 --2- 172.21.15.78:0/4280680990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac0a8080 0x7fcfac0c0df0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7fcfac0625b0 tx=0x7fcfa4009840).ready entity=mon.0 client_cookie=10e98076603c18c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfaa7fc700 1 -- 172.21.15.78:0/4280680990 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400e070 con 0x7fcfac0a8080 2023-08-17T18:12:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfaa7fc700 1 -- 172.21.15.78:0/4280680990 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa400ba20 con 0x7fcfac0a8080 2023-08-17T18:12:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfaa7fc700 1 -- 172.21.15.78:0/4280680990 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400bda0 con 0x7fcfac0a8080 2023-08-17T18:12:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfb1746700 1 -- 172.21.15.78:0/4280680990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac0a8080 msgr2=0x7fcfac0c0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfb1746700 1 --2- 172.21.15.78:0/4280680990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac0a8080 0x7fcfac0c0df0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7fcfac0625b0 tx=0x7fcfa4009840).stop 2023-08-17T18:12:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfb1746700 1 -- 172.21.15.78:0/4280680990 shutdown_connections 2023-08-17T18:12:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfb1746700 1 --2- 172.21.15.78:0/4280680990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac0a8080 0x7fcfac0c0df0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfb1746700 1 --2- 172.21.15.78:0/4280680990 >> v2:172.21.15.150:3300/0 conn(0x7fcfac154140 0x7fcfac0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfb1746700 1 --2- 172.21.15.78:0/4280680990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a7c40 0x7fcfac0c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfb1746700 1 -- 172.21.15.78:0/4280680990 >> 172.21.15.78:0/4280680990 conn(0x7fcfac094510 msgr2=0x7fcfac06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfb1746700 1 -- 172.21.15.78:0/4280680990 shutdown_connections 2023-08-17T18:12:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.907+0000 7fcfb1746700 1 -- 172.21.15.78:0/4280680990 wait complete. 2023-08-17T18:12:21.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.909+0000 7fcfb1746700 1 Processor -- start 2023-08-17T18:12:21.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.909+0000 7fcfb1746700 1 -- start start 2023-08-17T18:12:21.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.909+0000 7fcfb1746700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfac0a7c40 0x7fcfac13c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.909+0000 7fcfb1746700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a8080 0x7fcfac0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.909+0000 7fcfb1746700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac154140 0x7fcfac0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.909+0000 7fcfb1746700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0cbbf0 con 0x7fcfac154140 2023-08-17T18:12:21.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.909+0000 7fcfb1746700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0ad940 con 0x7fcfac0a7c40 2023-08-17T18:12:21.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.909+0000 7fcfb1746700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0ad660 con 0x7fcfac0a8080 2023-08-17T18:12:21.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.909+0000 7fcfab7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac154140 0x7fcfac0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfab7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac154140 0x7fcfac0cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47388/0 (socket says 172.21.15.78:47388) 2023-08-17T18:12:21.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfab7fe700 1 -- 172.21.15.78:0/1231407187 learned_addr learned my addr 172.21.15.78:0/1231407187 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:21.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfa27fc700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a8080 0x7fcfac0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfaaffd700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfac0a7c40 0x7fcfac13c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfab7fe700 1 -- 172.21.15.78:0/1231407187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a8080 msgr2=0x7fcfac0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfab7fe700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a8080 0x7fcfac0cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfab7fe700 1 -- 172.21.15.78:0/1231407187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfac0a7c40 msgr2=0x7fcfac13c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:21.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfab7fe700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfac0a7c40 0x7fcfac13c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:21.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfab7fe700 1 -- 172.21.15.78:0/1231407187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa4009ae0 con 0x7fcfac154140 2023-08-17T18:12:21.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfa27fc700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a8080 0x7fcfac0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:21.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfaaffd700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfac0a7c40 0x7fcfac13c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:21.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfab7fe700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac154140 0x7fcfac0cb700 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7fcfac06c200 tx=0x7fcfa4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:21.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfa37fe700 1 -- 172.21.15.78:0/1231407187 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40032f0 con 0x7fcfac154140 2023-08-17T18:12:21.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfa37fe700 1 -- 172.21.15.78:0/1231407187 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa40092e0 con 0x7fcfac154140 2023-08-17T18:12:21.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfb1746700 1 -- 172.21.15.78:0/1231407187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac0c2470 con 0x7fcfac154140 2023-08-17T18:12:21.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfa37fe700 1 -- 172.21.15.78:0/1231407187 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa401e6a0 con 0x7fcfac154140 2023-08-17T18:12:21.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.910+0000 7fcfb1746700 1 -- 172.21.15.78:0/1231407187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac0c2a30 con 0x7fcfac154140 2023-08-17T18:12:21.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.911+0000 7fcfb1746700 1 -- 172.21.15.78:0/1231407187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac0c2c20 con 0x7fcfac154140 2023-08-17T18:12:21.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.911+0000 7fcfa37fe700 1 -- 172.21.15.78:0/1231407187 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcfa4025030 con 0x7fcfac154140 2023-08-17T18:12:21.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.912+0000 7fcfa37fe700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf8c05ed90 0x7fcf8c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:21.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.912+0000 7fcfa37fe700 1 -- 172.21.15.78:0/1231407187 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcfa407b160 con 0x7fcfac154140 2023-08-17T18:12:21.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.912+0000 7fcfaaffd700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf8c05ed90 0x7fcf8c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:21.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.912+0000 7fcfaaffd700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf8c05ed90 0x7fcf8c061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fcf9c009c00 tx=0x7fcf9c008040).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:21.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:21.916+0000 7fcfa37fe700 1 -- 172.21.15.78:0/1231407187 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcfa404c7b0 con 0x7fcfac154140 2023-08-17T18:12:22.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.074+0000 7fcfb1746700 1 -- 172.21.15.78:0/1231407187 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfac047350 con 0x7fcf8c05ed90 2023-08-17T18:12:22.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.084+0000 7fcfa37fe700 1 -- 172.21.15.78:0/1231407187 <== mgr.9348 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361948 (secure 0 0 0) 0x7fcfac047350 con 0x7fcf8c05ed90 2023-08-17T18:12:22.087 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:22.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 -- 172.21.15.78:0/1231407187 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf8c05ed90 msgr2=0x7fcf8c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf8c05ed90 0x7fcf8c061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fcf9c009c00 tx=0x7fcf9c008040).stop 2023-08-17T18:12:22.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 -- 172.21.15.78:0/1231407187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac154140 msgr2=0x7fcfac0cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac154140 0x7fcfac0cb700 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7fcfac06c200 tx=0x7fcfa4009840).stop 2023-08-17T18:12:22.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 -- 172.21.15.78:0/1231407187 shutdown_connections 2023-08-17T18:12:22.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf8c05ed90 0x7fcf8c061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfac154140 0x7fcfac0cb700 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfac0a7c40 0x7fcfac13c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 --2- 172.21.15.78:0/1231407187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfac0a8080 0x7fcfac0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 -- 172.21.15.78:0/1231407187 >> 172.21.15.78:0/1231407187 conn(0x7fcfac094510 msgr2=0x7fcfac0637b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:22.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 -- 172.21.15.78:0/1231407187 shutdown_connections 2023-08-17T18:12:22.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.088+0000 7fcfb1746700 1 -- 172.21.15.78:0/1231407187 wait complete. 2023-08-17T18:12:22.091 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T18:12:22.100 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-17T18:12:20.182051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2435556,"kb_used_data":17828,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752539164,"statfs":{"total":773094113280,"available":770600103936,"internally_reserved":0,"allocated":18255872,"data_stored":9155393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27323,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-76,"num_write_kb":-58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.586848"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145366+0000","last_change":"2023-08-17T18:12:19.145366+0000","last_active":"2023-08-17T18:12:19.145366+0000","last_peered":"2023-08-17T18:12:19.145366+0000","last_clean":"2023-08-17T18:12:19.145366+0000","last_became_active":"2023-08-17T18:12:19.144926+0000","last_became_peered":"2023-08-17T18:12:19.144926+0000","last_unstale":"2023-08-17T18:12:19.145366+0000","last_undegraded":"2023-08-17T18:12:19.145366+0000","last_fullsized":"2023-08-17T18:12:19.145366+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"184'3","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146491+0000","last_change":"2023-08-17T18:12:18.779324+0000","last_active":"2023-08-17T18:12:19.146491+0000","last_peered":"2023-08-17T18:12:19.146491+0000","last_clean":"2023-08-17T18:12:19.146491+0000","last_became_active":"2023-08-17T18:12:18.778475+0000","last_became_peered":"2023-08-17T18:12:18.778475+0000","last_unstale":"2023-08-17T18:12:19.146491+0000","last_undegraded":"2023-08-17T18:12:19.146491+0000","last_fullsized":"2023-08-17T18:12:19.146491+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.156214+0000","last_change":"2023-08-17T18:12:19.156214+0000","last_active":"2023-08-17T18:12:19.156214+0000","last_peered":"2023-08-17T18:12:19.156214+0000","last_clean":"2023-08-17T18:12:19.156214+0000","last_became_active":"2023-08-17T18:12:19.155743+0000","last_became_peered":"2023-08-17T18:12:19.155743+0000","last_unstale":"2023-08-17T18:12:19.156214+0000","last_undegraded":"2023-08-17T18:12:19.156214+0000","last_fullsized":"2023-08-17T18:12:19.156214+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.779938+0000","last_change":"2023-08-17T18:12:18.778282+0000","last_active":"2023-08-17T18:12:18.779938+0000","last_peered":"2023-08-17T18:12:18.779938+0000","last_clean":"2023-08-17T18:12:18.779938+0000","last_became_active":"2023-08-17T18:12:18.777985+0000","last_became_peered":"2023-08-17T18:12:18.777985+0000","last_unstale":"2023-08-17T18:12:18.779938+0000","last_undegraded":"2023-08-17T18:12:18.779938+0000","last_fullsized":"2023-08-17T18:12:18.779938+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.154963+0000","last_change":"2023-08-17T18:12:19.154963+0000","last_active":"2023-08-17T18:12:19.154963+0000","last_peered":"2023-08-17T18:12:19.154963+0000","last_clean":"2023-08-17T18:12:19.154963+0000","last_became_active":"2023-08-17T18:12:19.154689+0000","last_became_peered":"2023-08-17T18:12:19.154689+0000","last_unstale":"2023-08-17T18:12:19.154963+0000","last_undegraded":"2023-08-17T18:12:19.154963+0000","last_fullsized":"2023-08-17T18:12:19.154963+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781462+0000","last_change":"2023-08-17T18:12:18.777105+0000","last_active":"2023-08-17T18:12:18.781462+0000","last_peered":"2023-08-17T18:12:18.781462+0000","last_clean":"2023-08-17T18:12:18.781462+0000","last_became_active":"2023-08-17T18:12:18.776359+0000","last_became_peered":"2023-08-17T18:12:18.776359+0000","last_unstale":"2023-08-17T18:12:18.781462+0000","last_undegraded":"2023-08-17T18:12:18.781462+0000","last_fullsized":"2023-08-17T18:12:18.781462+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149644+0000","last_change":"2023-08-17T18:12:19.149644+0000","last_active":"2023-08-17T18:12:19.149644+0000","last_peered":"2023-08-17T18:12:19.149644+0000","last_clean":"2023-08-17T18:12:19.149644+0000","last_became_active":"2023-08-17T18:12:19.149366+0000","last_became_peered":"2023-08-17T18:12:19.149366+0000","last_unstale":"2023-08-17T18:12:19.149644+0000","last_undegraded":"2023-08-17T18:12:19.149644+0000","last_fullsized":"2023-08-17T18:12:19.149644+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"184'2","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155391+0000","last_change":"2023-08-17T18:12:18.778800+0000","last_active":"2023-08-17T18:12:19.155391+0000","last_peered":"2023-08-17T18:12:19.155391+0000","last_clean":"2023-08-17T18:12:19.155391+0000","last_became_active":"2023-08-17T18:12:18.778531+0000","last_became_peered":"2023-08-17T18:12:18.778531+0000","last_unstale":"2023-08-17T18:12:19.155391+0000","last_undegraded":"2023-08-17T18:12:19.155391+0000","last_fullsized":"2023-08-17T18:12:19.155391+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.148279+0000","last_change":"2023-08-17T18:12:19.148279+0000","last_active":"2023-08-17T18:12:19.148279+0000","last_peered":"2023-08-17T18:12:19.148279+0000","last_clean":"2023-08-17T18:12:19.148279+0000","last_became_active":"2023-08-17T18:12:19.147975+0000","last_became_peered":"2023-08-17T18:12:19.147975+0000","last_unstale":"2023-08-17T18:12:19.148279+0000","last_undegraded":"2023-08-17T18:12:19.148279+0000","last_fullsized":"2023-08-17T18:12:19.148279+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.139881+0000","last_change":"2023-08-17T18:12:18.773218+0000","last_active":"2023-08-17T18:12:19.139881+0000","last_peered":"2023-08-17T18:12:19.139881+0000","last_clean":"2023-08-17T18:12:19.139881+0000","last_became_active":"2023-08-17T18:12:18.772720+0000","last_became_peered":"2023-08-17T18:12:18.772720+0000","last_unstale":"2023-08-17T18:12:19.139881+0000","last_undegraded":"2023-08-17T18:12:19.139881+0000","last_fullsized":"2023-08-17T18:12:19.139881+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155239+0000","last_change":"2023-08-17T18:12:19.155239+0000","last_active":"2023-08-17T18:12:19.155239+0000","last_peered":"2023-08-17T18:12:19.155239+0000","last_clean":"2023-08-17T18:12:19.155239+0000","last_became_active":"2023-08-17T18:12:19.154948+0000","last_became_peered":"2023-08-17T18:12:19.154948+0000","last_unstale":"2023-08-17T18:12:19.155239+0000","last_undegraded":"2023-08-17T18:12:19.155239+0000","last_fullsized":"2023-08-17T18:12:19.155239+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.128337+0000","last_change":"2023-08-17T18:12:18.782989+0000","last_active":"2023-08-17T18:12:19.128337+0000","last_peered":"2023-08-17T18:12:19.128337+0000","last_clean":"2023-08-17T18:12:19.128337+0000","last_became_active":"2023-08-17T18:12:18.782492+0000","last_became_peered":"2023-08-17T18:12:18.782492+0000","last_unstale":"2023-08-17T18:12:19.128337+0000","last_undegraded":"2023-08-17T18:12:19.128337+0000","last_fullsized":"2023-08-17T18:12:19.128337+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142783+0000","last_change":"2023-08-17T18:12:19.142783+0000","last_active":"2023-08-17T18:12:19.142783+0000","last_peered":"2023-08-17T18:12:19.142783+0000","last_clean":"2023-08-17T18:12:19.142783+0000","last_became_active":"2023-08-17T18:12:19.142524+0000","last_became_peered":"2023-08-17T18:12:19.142524+0000","last_unstale":"2023-08-17T18:12:19.142783+0000","last_undegraded":"2023-08-17T18:12:19.142783+0000","last_fullsized":"2023-08-17T18:12:19.142783+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.780120+0000","last_change":"2023-08-17T18:12:18.774036+0000","last_active":"2023-08-17T18:12:18.780120+0000","last_peered":"2023-08-17T18:12:18.780120+0000","last_clean":"2023-08-17T18:12:18.780120+0000","last_became_active":"2023-08-17T18:12:18.773760+0000","last_became_peered":"2023-08-17T18:12:18.773760+0000","last_unstale":"2023-08-17T18:12:18.780120+0000","last_undegraded":"2023-08-17T18:12:18.780120+0000","last_fullsized":"2023-08-17T18:12:18.780120+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147649+0000","last_change":"2023-08-17T18:12:19.147649+0000","last_active":"2023-08-17T18:12:19.147649+0000","last_peered":"2023-08-17T18:12:19.147649+0000","last_clean":"2023-08-17T18:12:19.147649+0000","last_became_active":"2023-08-17T18:12:19.147470+0000","last_became_peered":"2023-08-17T18:12:19.147470+0000","last_unstale":"2023-08-17T18:12:19.147649+0000","last_undegraded":"2023-08-17T18:12:19.147649+0000","last_fullsized":"2023-08-17T18:12:19.147649+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775345+0000","last_change":"2023-08-17T18:12:18.772770+0000","last_active":"2023-08-17T18:12:18.775345+0000","last_peered":"2023-08-17T18:12:18.775345+0000","last_clean":"2023-08-17T18:12:18.775345+0000","last_became_active":"2023-08-17T18:12:18.772480+0000","last_became_peered":"2023-08-17T18:12:18.772480+0000","last_unstale":"2023-08-17T18:12:18.775345+0000","last_undegraded":"2023-08-17T18:12:18.775345+0000","last_fullsized":"2023-08-17T18:12:18.775345+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142263+0000","last_change":"2023-08-17T18:12:19.142263+0000","last_active":"2023-08-17T18:12:19.142263+0000","last_peered":"2023-08-17T18:12:19.142263+0000","last_clean":"2023-08-17T18:12:19.142263+0000","last_became_active":"2023-08-17T18:12:19.141793+0000","last_became_peered":"2023-08-17T18:12:19.141793+0000","last_unstale":"2023-08-17T18:12:19.142263+0000","last_undegraded":"2023-08-17T18:12:19.142263+0000","last_fullsized":"2023-08-17T18:12:19.142263+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775587+0000","last_change":"2023-08-17T18:12:18.773804+0000","last_active":"2023-08-17T18:12:18.775587+0000","last_peered":"2023-08-17T18:12:18.775587+0000","last_clean":"2023-08-17T18:12:18.775587+0000","last_became_active":"2023-08-17T18:12:18.773534+0000","last_became_peered":"2023-08-17T18:12:18.773534+0000","last_unstale":"2023-08-17T18:12:18.775587+0000","last_undegraded":"2023-08-17T18:12:18.775587+0000","last_fullsized":"2023-08-17T18:12:18.775587+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146461+0000","last_change":"2023-08-17T18:12:19.146461+0000","last_active":"2023-08-17T18:12:19.146461+0000","last_peered":"2023-08-17T18:12:19.146461+0000","last_clean":"2023-08-17T18:12:19.146461+0000","last_became_active":"2023-08-17T18:12:19.146185+0000","last_became_peered":"2023-08-17T18:12:19.146185+0000","last_unstale":"2023-08-17T18:12:19.146461+0000","last_undegraded":"2023-08-17T18:12:19.146461+0000","last_fullsized":"2023-08-17T18:12:19.146461+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.789178+0000","last_change":"2023-08-17T18:12:18.788038+0000","last_active":"2023-08-17T18:12:18.789178+0000","last_peered":"2023-08-17T18:12:18.789178+0000","last_clean":"2023-08-17T18:12:18.789178+0000","last_became_active":"2023-08-17T18:12:18.787783+0000","last_became_peered":"2023-08-17T18:12:18.787783+0000","last_unstale":"2023-08-17T18:12:18.789178+0000","last_undegraded":"2023-08-17T18:12:18.789178+0000","last_fullsized":"2023-08-17T18:12:18.789178+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147662+0000","last_change":"2023-08-17T18:12:19.147662+0000","last_active":"2023-08-17T18:12:19.147662+0000","last_peered":"2023-08-17T18:12:19.147662+0000","last_clean":"2023-08-17T18:12:19.147662+0000","last_became_active":"2023-08-17T18:12:19.147394+0000","last_became_peered":"2023-08-17T18:12:19.147394+0000","last_unstale":"2023-08-17T18:12:19.147662+0000","last_undegraded":"2023-08-17T18:12:19.147662+0000","last_fullsized":"2023-08-17T18:12:19.147662+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775504+0000","last_change":"2023-08-17T18:12:18.772890+0000","last_active":"2023-08-17T18:12:18.775504+0000","last_peered":"2023-08-17T18:12:18.775504+0000","last_clean":"2023-08-17T18:12:18.775504+0000","last_became_active":"2023-08-17T18:12:18.772542+0000","last_became_peered":"2023-08-17T18:12:18.772542+0000","last_unstale":"2023-08-17T18:12:18.775504+0000","last_undegraded":"2023-08-17T18:12:18.775504+0000","last_fullsized":"2023-08-17T18:12:18.775504+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.148971+0000","last_change":"2023-08-17T18:12:19.148971+0000","last_active":"2023-08-17T18:12:19.148971+0000","last_peered":"2023-08-17T18:12:19.148971+0000","last_clean":"2023-08-17T18:12:19.148971+0000","last_became_active":"2023-08-17T18:12:19.148682+0000","last_became_peered":"2023-08-17T18:12:19.148682+0000","last_unstale":"2023-08-17T18:12:19.148971+0000","last_undegraded":"2023-08-17T18:12:19.148971+0000","last_fullsized":"2023-08-17T18:12:19.148971+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"184'4","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.151982+0000","last_change":"2023-08-17T18:12:18.778268+0000","last_active":"2023-08-17T18:12:19.151982+0000","last_peered":"2023-08-17T18:12:19.151982+0000","last_clean":"2023-08-17T18:12:19.151982+0000","last_became_active":"2023-08-17T18:12:18.777987+0000","last_became_peered":"2023-08-17T18:12:18.777987+0000","last_unstale":"2023-08-17T18:12:19.151982+0000","last_undegraded":"2023-08-17T18:12:19.151982+0000","last_fullsized":"2023-08-17T18:12:19.151982+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147508+0000","last_change":"2023-08-17T18:12:19.147508+0000","last_active":"2023-08-17T18:12:19.147508+0000","last_peered":"2023-08-17T18:12:19.147508+0000","last_clean":"2023-08-17T18:12:19.147508+0000","last_became_active":"2023-08-17T18:12:19.147208+0000","last_became_peered":"2023-08-17T18:12:19.147208+0000","last_unstale":"2023-08-17T18:12:19.147508+0000","last_undegraded":"2023-08-17T18:12:19.147508+0000","last_fullsized":"2023-08-17T18:12:19.147508+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.131766+0000","last_change":"2023-08-17T18:12:18.769897+0000","last_active":"2023-08-17T18:12:19.131766+0000","last_peered":"2023-08-17T18:12:19.131766+0000","last_clean":"2023-08-17T18:12:19.131766+0000","last_became_active":"2023-08-17T18:12:18.769566+0000","last_became_peered":"2023-08-17T18:12:18.769566+0000","last_unstale":"2023-08-17T18:12:19.131766+0000","last_undegraded":"2023-08-17T18:12:19.131766+0000","last_fullsized":"2023-08-17T18:12:19.131766+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146485+0000","last_change":"2023-08-17T18:12:19.146485+0000","last_active":"2023-08-17T18:12:19.146485+0000","last_peered":"2023-08-17T18:12:19.146485+0000","last_clean":"2023-08-17T18:12:19.146485+0000","last_became_active":"2023-08-17T18:12:19.145999+0000","last_became_peered":"2023-08-17T18:12:19.145999+0000","last_unstale":"2023-08-17T18:12:19.146485+0000","last_undegraded":"2023-08-17T18:12:19.146485+0000","last_fullsized":"2023-08-17T18:12:19.146485+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.777786+0000","last_change":"2023-08-17T18:12:18.774093+0000","last_active":"2023-08-17T18:12:18.777786+0000","last_peered":"2023-08-17T18:12:18.777786+0000","last_clean":"2023-08-17T18:12:18.777786+0000","last_became_active":"2023-08-17T18:12:18.773651+0000","last_became_peered":"2023-08-17T18:12:18.773651+0000","last_unstale":"2023-08-17T18:12:18.777786+0000","last_undegraded":"2023-08-17T18:12:18.777786+0000","last_fullsized":"2023-08-17T18:12:18.777786+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146342+0000","last_change":"2023-08-17T18:12:19.146342+0000","last_active":"2023-08-17T18:12:19.146342+0000","last_peered":"2023-08-17T18:12:19.146342+0000","last_clean":"2023-08-17T18:12:19.146342+0000","last_became_active":"2023-08-17T18:12:19.145188+0000","last_became_peered":"2023-08-17T18:12:19.145188+0000","last_unstale":"2023-08-17T18:12:19.146342+0000","last_undegraded":"2023-08-17T18:12:19.146342+0000","last_fullsized":"2023-08-17T18:12:19.146342+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.784394+0000","last_change":"2023-08-17T18:12:18.783333+0000","last_active":"2023-08-17T18:12:18.784394+0000","last_peered":"2023-08-17T18:12:18.784394+0000","last_clean":"2023-08-17T18:12:18.784394+0000","last_became_active":"2023-08-17T18:12:18.783106+0000","last_became_peered":"2023-08-17T18:12:18.783106+0000","last_unstale":"2023-08-17T18:12:18.784394+0000","last_undegraded":"2023-08-17T18:12:18.784394+0000","last_fullsized":"2023-08-17T18:12:18.784394+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149104+0000","last_change":"2023-08-17T18:12:19.149104+0000","last_active":"2023-08-17T18:12:19.149104+0000","last_peered":"2023-08-17T18:12:19.149104+0000","last_clean":"2023-08-17T18:12:19.149104+0000","last_became_active":"2023-08-17T18:12:19.148825+0000","last_became_peered":"2023-08-17T18:12:19.148825+0000","last_unstale":"2023-08-17T18:12:19.149104+0000","last_undegraded":"2023-08-17T18:12:19.149104+0000","last_fullsized":"2023-08-17T18:12:19.149104+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"184'4","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.154569+0000","last_change":"2023-08-17T18:12:18.776961+0000","last_active":"2023-08-17T18:12:19.154569+0000","last_peered":"2023-08-17T18:12:19.154569+0000","last_clean":"2023-08-17T18:12:19.154569+0000","last_became_active":"2023-08-17T18:12:18.776581+0000","last_became_peered":"2023-08-17T18:12:18.776581+0000","last_unstale":"2023-08-17T18:12:19.154569+0000","last_undegraded":"2023-08-17T18:12:19.154569+0000","last_fullsized":"2023-08-17T18:12:19.154569+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147530+0000","last_change":"2023-08-17T18:12:19.147530+0000","last_active":"2023-08-17T18:12:19.147530+0000","last_peered":"2023-08-17T18:12:19.147530+0000","last_clean":"2023-08-17T18:12:19.147530+0000","last_became_active":"2023-08-17T18:12:19.147215+0000","last_became_peered":"2023-08-17T18:12:19.147215+0000","last_unstale":"2023-08-17T18:12:19.147530+0000","last_undegraded":"2023-08-17T18:12:19.147530+0000","last_fullsized":"2023-08-17T18:12:19.147530+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.778963+0000","last_change":"2023-08-17T18:12:18.773594+0000","last_active":"2023-08-17T18:12:18.778963+0000","last_peered":"2023-08-17T18:12:18.778963+0000","last_clean":"2023-08-17T18:12:18.778963+0000","last_became_active":"2023-08-17T18:12:18.773305+0000","last_became_peered":"2023-08-17T18:12:18.773305+0000","last_unstale":"2023-08-17T18:12:18.778963+0000","last_undegraded":"2023-08-17T18:12:18.778963+0000","last_fullsized":"2023-08-17T18:12:18.778963+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155836+0000","last_change":"2023-08-17T18:12:19.155836+0000","last_active":"2023-08-17T18:12:19.155836+0000","last_peered":"2023-08-17T18:12:19.155836+0000","last_clean":"2023-08-17T18:12:19.155836+0000","last_became_active":"2023-08-17T18:12:19.152942+0000","last_became_peered":"2023-08-17T18:12:19.152942+0000","last_unstale":"2023-08-17T18:12:19.155836+0000","last_undegraded":"2023-08-17T18:12:19.155836+0000","last_fullsized":"2023-08-17T18:12:19.155836+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.783515+0000","last_change":"2023-08-17T18:12:18.776084+0000","last_active":"2023-08-17T18:12:18.783515+0000","last_peered":"2023-08-17T18:12:18.783515+0000","last_clean":"2023-08-17T18:12:18.783515+0000","last_became_active":"2023-08-17T18:12:18.775824+0000","last_became_peered":"2023-08-17T18:12:18.775824+0000","last_unstale":"2023-08-17T18:12:18.783515+0000","last_undegraded":"2023-08-17T18:12:18.783515+0000","last_fullsized":"2023-08-17T18:12:18.783515+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155256+0000","last_change":"2023-08-17T18:12:19.155256+0000","last_active":"2023-08-17T18:12:19.155256+0000","last_peered":"2023-08-17T18:12:19.155256+0000","last_clean":"2023-08-17T18:12:19.155256+0000","last_became_active":"2023-08-17T18:12:19.154926+0000","last_became_peered":"2023-08-17T18:12:19.154926+0000","last_unstale":"2023-08-17T18:12:19.155256+0000","last_undegraded":"2023-08-17T18:12:19.155256+0000","last_fullsized":"2023-08-17T18:12:19.155256+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.128786+0000","last_change":"2023-08-17T18:12:18.777890+0000","last_active":"2023-08-17T18:12:19.128786+0000","last_peered":"2023-08-17T18:12:19.128786+0000","last_clean":"2023-08-17T18:12:19.128786+0000","last_became_active":"2023-08-17T18:12:18.777579+0000","last_became_peered":"2023-08-17T18:12:18.777579+0000","last_unstale":"2023-08-17T18:12:19.128786+0000","last_undegraded":"2023-08-17T18:12:19.128786+0000","last_fullsized":"2023-08-17T18:12:19.128786+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.148205+0000","last_change":"2023-08-17T18:12:19.148205+0000","last_active":"2023-08-17T18:12:19.148205+0000","last_peered":"2023-08-17T18:12:19.148205+0000","last_clean":"2023-08-17T18:12:19.148205+0000","last_became_active":"2023-08-17T18:12:19.147938+0000","last_became_peered":"2023-08-17T18:12:19.147938+0000","last_unstale":"2023-08-17T18:12:19.148205+0000","last_undegraded":"2023-08-17T18:12:19.148205+0000","last_fullsized":"2023-08-17T18:12:19.148205+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781520+0000","last_change":"2023-08-17T18:12:18.778445+0000","last_active":"2023-08-17T18:12:18.781520+0000","last_peered":"2023-08-17T18:12:18.781520+0000","last_clean":"2023-08-17T18:12:18.781520+0000","last_became_active":"2023-08-17T18:12:18.778177+0000","last_became_peered":"2023-08-17T18:12:18.778177+0000","last_unstale":"2023-08-17T18:12:18.781520+0000","last_undegraded":"2023-08-17T18:12:18.781520+0000","last_fullsized":"2023-08-17T18:12:18.781520+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.154897+0000","last_change":"2023-08-17T18:12:19.154897+0000","last_active":"2023-08-17T18:12:19.154897+0000","last_peered":"2023-08-17T18:12:19.154897+0000","last_clean":"2023-08-17T18:12:19.154897+0000","last_became_active":"2023-08-17T18:12:19.154637+0000","last_became_peered":"2023-08-17T18:12:19.154637+0000","last_unstale":"2023-08-17T18:12:19.154897+0000","last_undegraded":"2023-08-17T18:12:19.154897+0000","last_fullsized":"2023-08-17T18:12:19.154897+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.128640+0000","last_change":"2023-08-17T18:12:18.773696+0000","last_active":"2023-08-17T18:12:19.128640+0000","last_peered":"2023-08-17T18:12:19.128640+0000","last_clean":"2023-08-17T18:12:19.128640+0000","last_became_active":"2023-08-17T18:12:18.773420+0000","last_became_peered":"2023-08-17T18:12:18.773420+0000","last_unstale":"2023-08-17T18:12:19.128640+0000","last_undegraded":"2023-08-17T18:12:19.128640+0000","last_fullsized":"2023-08-17T18:12:19.128640+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155746+0000","last_change":"2023-08-17T18:12:19.155746+0000","last_active":"2023-08-17T18:12:19.155746+0000","last_peered":"2023-08-17T18:12:19.155746+0000","last_clean":"2023-08-17T18:12:19.155746+0000","last_became_active":"2023-08-17T18:12:19.155445+0000","last_became_peered":"2023-08-17T18:12:19.155445+0000","last_unstale":"2023-08-17T18:12:19.155746+0000","last_undegraded":"2023-08-17T18:12:19.155746+0000","last_fullsized":"2023-08-17T18:12:19.155746+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.783110+0000","last_change":"2023-08-17T18:12:18.782576+0000","last_active":"2023-08-17T18:12:18.783110+0000","last_peered":"2023-08-17T18:12:18.783110+0000","last_clean":"2023-08-17T18:12:18.783110+0000","last_became_active":"2023-08-17T18:12:18.782364+0000","last_became_peered":"2023-08-17T18:12:18.782364+0000","last_unstale":"2023-08-17T18:12:18.783110+0000","last_undegraded":"2023-08-17T18:12:18.783110+0000","last_fullsized":"2023-08-17T18:12:18.783110+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.141183+0000","last_change":"2023-08-17T18:12:19.141183+0000","last_active":"2023-08-17T18:12:19.141183+0000","last_peered":"2023-08-17T18:12:19.141183+0000","last_clean":"2023-08-17T18:12:19.141183+0000","last_became_active":"2023-08-17T18:12:19.140901+0000","last_became_peered":"2023-08-17T18:12:19.140901+0000","last_unstale":"2023-08-17T18:12:19.141183+0000","last_undegraded":"2023-08-17T18:12:19.141183+0000","last_fullsized":"2023-08-17T18:12:19.141183+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775246+0000","last_change":"2023-08-17T18:12:18.771843+0000","last_active":"2023-08-17T18:12:18.775246+0000","last_peered":"2023-08-17T18:12:18.775246+0000","last_clean":"2023-08-17T18:12:18.775246+0000","last_became_active":"2023-08-17T18:12:18.771540+0000","last_became_peered":"2023-08-17T18:12:18.771540+0000","last_unstale":"2023-08-17T18:12:18.775246+0000","last_undegraded":"2023-08-17T18:12:18.775246+0000","last_fullsized":"2023-08-17T18:12:18.775246+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145835+0000","last_change":"2023-08-17T18:12:19.145835+0000","last_active":"2023-08-17T18:12:19.145835+0000","last_peered":"2023-08-17T18:12:19.145835+0000","last_clean":"2023-08-17T18:12:19.145835+0000","last_became_active":"2023-08-17T18:12:19.145565+0000","last_became_peered":"2023-08-17T18:12:19.145565+0000","last_unstale":"2023-08-17T18:12:19.145835+0000","last_undegraded":"2023-08-17T18:12:19.145835+0000","last_fullsized":"2023-08-17T18:12:19.145835+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.772855+0000","last_change":"2023-08-17T18:12:18.767885+0000","last_active":"2023-08-17T18:12:18.772855+0000","last_peered":"2023-08-17T18:12:18.772855+0000","last_clean":"2023-08-17T18:12:18.772855+0000","last_became_active":"2023-08-17T18:12:18.767549+0000","last_became_peered":"2023-08-17T18:12:18.767549+0000","last_unstale":"2023-08-17T18:12:18.772855+0000","last_undegraded":"2023-08-17T18:12:18.772855+0000","last_fullsized":"2023-08-17T18:12:18.772855+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145181+0000","last_change":"2023-08-17T18:12:19.145181+0000","last_active":"2023-08-17T18:12:19.145181+0000","last_peered":"2023-08-17T18:12:19.145181+0000","last_clean":"2023-08-17T18:12:19.145181+0000","last_became_active":"2023-08-17T18:12:19.144509+0000","last_became_peered":"2023-08-17T18:12:19.144509+0000","last_unstale":"2023-08-17T18:12:19.145181+0000","last_undegraded":"2023-08-17T18:12:19.145181+0000","last_fullsized":"2023-08-17T18:12:19.145181+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781428+0000","last_change":"2023-08-17T18:12:18.776768+0000","last_active":"2023-08-17T18:12:18.781428+0000","last_peered":"2023-08-17T18:12:18.781428+0000","last_clean":"2023-08-17T18:12:18.781428+0000","last_became_active":"2023-08-17T18:12:18.776477+0000","last_became_peered":"2023-08-17T18:12:18.776477+0000","last_unstale":"2023-08-17T18:12:18.781428+0000","last_undegraded":"2023-08-17T18:12:18.781428+0000","last_fullsized":"2023-08-17T18:12:18.781428+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155037+0000","last_change":"2023-08-17T18:12:19.155037+0000","last_active":"2023-08-17T18:12:19.155037+0000","last_peered":"2023-08-17T18:12:19.155037+0000","last_clean":"2023-08-17T18:12:19.155037+0000","last_became_active":"2023-08-17T18:12:19.154790+0000","last_became_peered":"2023-08-17T18:12:19.154790+0000","last_unstale":"2023-08-17T18:12:19.155037+0000","last_undegraded":"2023-08-17T18:12:19.155037+0000","last_fullsized":"2023-08-17T18:12:19.155037+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.786307+0000","last_change":"2023-08-17T18:12:18.782761+0000","last_active":"2023-08-17T18:12:18.786307+0000","last_peered":"2023-08-17T18:12:18.786307+0000","last_clean":"2023-08-17T18:12:18.786307+0000","last_became_active":"2023-08-17T18:12:18.782500+0000","last_became_peered":"2023-08-17T18:12:18.782500+0000","last_unstale":"2023-08-17T18:12:18.786307+0000","last_undegraded":"2023-08-17T18:12:18.786307+0000","last_fullsized":"2023-08-17T18:12:18.786307+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155263+0000","last_change":"2023-08-17T18:12:19.155263+0000","last_active":"2023-08-17T18:12:19.155263+0000","last_peered":"2023-08-17T18:12:19.155263+0000","last_clean":"2023-08-17T18:12:19.155263+0000","last_became_active":"2023-08-17T18:12:19.154940+0000","last_became_peered":"2023-08-17T18:12:19.154940+0000","last_unstale":"2023-08-17T18:12:19.155263+0000","last_undegraded":"2023-08-17T18:12:19.155263+0000","last_fullsized":"2023-08-17T18:12:19.155263+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781485+0000","last_change":"2023-08-17T18:12:18.777312+0000","last_active":"2023-08-17T18:12:18.781485+0000","last_peered":"2023-08-17T18:12:18.781485+0000","last_clean":"2023-08-17T18:12:18.781485+0000","last_became_active":"2023-08-17T18:12:18.776714+0000","last_became_peered":"2023-08-17T18:12:18.776714+0000","last_unstale":"2023-08-17T18:12:18.781485+0000","last_undegraded":"2023-08-17T18:12:18.781485+0000","last_fullsized":"2023-08-17T18:12:18.781485+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147308+0000","last_change":"2023-08-17T18:12:19.147308+0000","last_active":"2023-08-17T18:12:19.147308+0000","last_peered":"2023-08-17T18:12:19.147308+0000","last_clean":"2023-08-17T18:12:19.147308+0000","last_became_active":"2023-08-17T18:12:19.147046+0000","last_became_peered":"2023-08-17T18:12:19.147046+0000","last_unstale":"2023-08-17T18:12:19.147308+0000","last_undegraded":"2023-08-17T18:12:19.147308+0000","last_fullsized":"2023-08-17T18:12:19.147308+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.785960+0000","last_change":"2023-08-17T18:12:18.778031+0000","last_active":"2023-08-17T18:12:18.785960+0000","last_peered":"2023-08-17T18:12:18.785960+0000","last_clean":"2023-08-17T18:12:18.785960+0000","last_became_active":"2023-08-17T18:12:18.775302+0000","last_became_peered":"2023-08-17T18:12:18.775302+0000","last_unstale":"2023-08-17T18:12:18.785960+0000","last_undegraded":"2023-08-17T18:12:18.785960+0000","last_fullsized":"2023-08-17T18:12:18.785960+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155819+0000","last_change":"2023-08-17T18:12:19.155819+0000","last_active":"2023-08-17T18:12:19.155819+0000","last_peered":"2023-08-17T18:12:19.155819+0000","last_clean":"2023-08-17T18:12:19.155819+0000","last_became_active":"2023-08-17T18:12:19.155494+0000","last_became_peered":"2023-08-17T18:12:19.155494+0000","last_unstale":"2023-08-17T18:12:19.155819+0000","last_undegraded":"2023-08-17T18:12:19.155819+0000","last_fullsized":"2023-08-17T18:12:19.155819+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781378+0000","last_change":"2023-08-17T18:12:18.775382+0000","last_active":"2023-08-17T18:12:18.781378+0000","last_peered":"2023-08-17T18:12:18.781378+0000","last_clean":"2023-08-17T18:12:18.781378+0000","last_became_active":"2023-08-17T18:12:18.774892+0000","last_became_peered":"2023-08-17T18:12:18.774892+0000","last_unstale":"2023-08-17T18:12:18.781378+0000","last_undegraded":"2023-08-17T18:12:18.781378+0000","last_fullsized":"2023-08-17T18:12:18.781378+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.152334+0000","last_change":"2023-08-17T18:12:19.152334+0000","last_active":"2023-08-17T18:12:19.152334+0000","last_peered":"2023-08-17T18:12:19.152334+0000","last_clean":"2023-08-17T18:12:19.152334+0000","last_became_active":"2023-08-17T18:12:19.152074+0000","last_became_peered":"2023-08-17T18:12:19.152074+0000","last_unstale":"2023-08-17T18:12:19.152334+0000","last_undegraded":"2023-08-17T18:12:19.152334+0000","last_fullsized":"2023-08-17T18:12:19.152334+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.777400+0000","last_change":"2023-08-17T18:12:18.773638+0000","last_active":"2023-08-17T18:12:18.777400+0000","last_peered":"2023-08-17T18:12:18.777400+0000","last_clean":"2023-08-17T18:12:18.777400+0000","last_became_active":"2023-08-17T18:12:18.773368+0000","last_became_peered":"2023-08-17T18:12:18.773368+0000","last_unstale":"2023-08-17T18:12:18.777400+0000","last_undegraded":"2023-08-17T18:12:18.777400+0000","last_fullsized":"2023-08-17T18:12:18.777400+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.151272+0000","last_change":"2023-08-17T18:12:19.151272+0000","last_active":"2023-08-17T18:12:19.151272+0000","last_peered":"2023-08-17T18:12:19.151272+0000","last_clean":"2023-08-17T18:12:19.151272+0000","last_became_active":"2023-08-17T18:12:19.150980+0000","last_became_peered":"2023-08-17T18:12:19.150980+0000","last_unstale":"2023-08-17T18:12:19.151272+0000","last_undegraded":"2023-08-17T18:12:19.151272+0000","last_fullsized":"2023-08-17T18:12:19.151272+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775802+0000","last_change":"2023-08-17T18:12:18.770183+0000","last_active":"2023-08-17T18:12:18.775802+0000","last_peered":"2023-08-17T18:12:18.775802+0000","last_clean":"2023-08-17T18:12:18.775802+0000","last_became_active":"2023-08-17T18:12:18.769889+0000","last_became_peered":"2023-08-17T18:12:18.769889+0000","last_unstale":"2023-08-17T18:12:18.775802+0000","last_undegraded":"2023-08-17T18:12:18.775802+0000","last_fullsized":"2023-08-17T18:12:18.775802+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145959+0000","last_change":"2023-08-17T18:12:19.145959+0000","last_active":"2023-08-17T18:12:19.145959+0000","last_peered":"2023-08-17T18:12:19.145959+0000","last_clean":"2023-08-17T18:12:19.145959+0000","last_became_active":"2023-08-17T18:12:19.145689+0000","last_became_peered":"2023-08-17T18:12:19.145689+0000","last_unstale":"2023-08-17T18:12:19.145959+0000","last_undegraded":"2023-08-17T18:12:19.145959+0000","last_fullsized":"2023-08-17T18:12:19.145959+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.777605+0000","last_change":"2023-08-17T18:12:18.769174+0000","last_active":"2023-08-17T18:12:18.777605+0000","last_peered":"2023-08-17T18:12:18.777605+0000","last_clean":"2023-08-17T18:12:18.777605+0000","last_became_active":"2023-08-17T18:12:18.768886+0000","last_became_peered":"2023-08-17T18:12:18.768886+0000","last_unstale":"2023-08-17T18:12:18.777605+0000","last_undegraded":"2023-08-17T18:12:18.777605+0000","last_fullsized":"2023-08-17T18:12:18.777605+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142837+0000","last_change":"2023-08-17T18:12:19.142837+0000","last_active":"2023-08-17T18:12:19.142837+0000","last_peered":"2023-08-17T18:12:19.142837+0000","last_clean":"2023-08-17T18:12:19.142837+0000","last_became_active":"2023-08-17T18:12:19.142374+0000","last_became_peered":"2023-08-17T18:12:19.142374+0000","last_unstale":"2023-08-17T18:12:19.142837+0000","last_undegraded":"2023-08-17T18:12:19.142837+0000","last_fullsized":"2023-08-17T18:12:19.142837+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142334+0000","last_change":"2023-08-17T18:12:18.776978+0000","last_active":"2023-08-17T18:12:19.142334+0000","last_peered":"2023-08-17T18:12:19.142334+0000","last_clean":"2023-08-17T18:12:19.142334+0000","last_became_active":"2023-08-17T18:12:18.776707+0000","last_became_peered":"2023-08-17T18:12:18.776707+0000","last_unstale":"2023-08-17T18:12:19.142334+0000","last_undegraded":"2023-08-17T18:12:19.142334+0000","last_fullsized":"2023-08-17T18:12:19.142334+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149983+0000","last_change":"2023-08-17T18:12:19.149983+0000","last_active":"2023-08-17T18:12:19.149983+0000","last_peered":"2023-08-17T18:12:19.149983+0000","last_clean":"2023-08-17T18:12:19.149983+0000","last_became_active":"2023-08-17T18:12:19.149726+0000","last_became_peered":"2023-08-17T18:12:19.149726+0000","last_unstale":"2023-08-17T18:12:19.149983+0000","last_undegraded":"2023-08-17T18:12:19.149983+0000","last_fullsized":"2023-08-17T18:12:19.149983+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.133978+0000","last_change":"2023-08-17T18:12:18.782730+0000","last_active":"2023-08-17T18:12:19.133978+0000","last_peered":"2023-08-17T18:12:19.133978+0000","last_clean":"2023-08-17T18:12:19.133978+0000","last_became_active":"2023-08-17T18:12:18.782459+0000","last_became_peered":"2023-08-17T18:12:18.782459+0000","last_unstale":"2023-08-17T18:12:19.133978+0000","last_undegraded":"2023-08-17T18:12:19.133978+0000","last_fullsized":"2023-08-17T18:12:19.133978+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142802+0000","last_change":"2023-08-17T18:12:19.142802+0000","last_active":"2023-08-17T18:12:19.142802+0000","last_peered":"2023-08-17T18:12:19.142802+0000","last_clean":"2023-08-17T18:12:19.142802+0000","last_became_active":"2023-08-17T18:12:19.142134+0000","last_became_peered":"2023-08-17T18:12:19.142134+0000","last_unstale":"2023-08-17T18:12:19.142802+0000","last_undegraded":"2023-08-17T18:12:19.142802+0000","last_fullsized":"2023-08-17T18:12:19.142802+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"184'2","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.152493+0000","last_change":"2023-08-17T18:12:18.769247+0000","last_active":"2023-08-17T18:12:19.152493+0000","last_peered":"2023-08-17T18:12:19.152493+0000","last_clean":"2023-08-17T18:12:19.152493+0000","last_became_active":"2023-08-17T18:12:18.768965+0000","last_became_peered":"2023-08-17T18:12:18.768965+0000","last_unstale":"2023-08-17T18:12:19.152493+0000","last_undegraded":"2023-08-17T18:12:19.152493+0000","last_fullsized":"2023-08-17T18:12:19.152493+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.144024+0000","last_change":"2023-08-17T18:12:19.144024+0000","last_active":"2023-08-17T18:12:19.144024+0000","last_peered":"2023-08-17T18:12:19.144024+0000","last_clean":"2023-08-17T18:12:19.144024+0000","last_became_active":"2023-08-17T18:12:19.143823+0000","last_became_peered":"2023-08-17T18:12:19.143823+0000","last_unstale":"2023-08-17T18:12:19.144024+0000","last_undegraded":"2023-08-17T18:12:19.144024+0000","last_fullsized":"2023-08-17T18:12:19.144024+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.779458+0000","last_change":"2023-08-17T18:12:18.777332+0000","last_active":"2023-08-17T18:12:18.779458+0000","last_peered":"2023-08-17T18:12:18.779458+0000","last_clean":"2023-08-17T18:12:18.779458+0000","last_became_active":"2023-08-17T18:12:18.777053+0000","last_became_peered":"2023-08-17T18:12:18.777053+0000","last_unstale":"2023-08-17T18:12:18.779458+0000","last_undegraded":"2023-08-17T18:12:18.779458+0000","last_fullsized":"2023-08-17T18:12:18.779458+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149260+0000","last_change":"2023-08-17T18:12:19.149260+0000","last_active":"2023-08-17T18:12:19.149260+0000","last_peered":"2023-08-17T18:12:19.149260+0000","last_clean":"2023-08-17T18:12:19.149260+0000","last_became_active":"2023-08-17T18:12:19.148867+0000","last_became_peered":"2023-08-17T18:12:19.148867+0000","last_unstale":"2023-08-17T18:12:19.149260+0000","last_undegraded":"2023-08-17T18:12:19.149260+0000","last_fullsized":"2023-08-17T18:12:19.149260+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.786063+0000","last_change":"2023-08-17T18:12:18.780577+0000","last_active":"2023-08-17T18:12:18.786063+0000","last_peered":"2023-08-17T18:12:18.786063+0000","last_clean":"2023-08-17T18:12:18.786063+0000","last_became_active":"2023-08-17T18:12:18.780277+0000","last_became_peered":"2023-08-17T18:12:18.780277+0000","last_unstale":"2023-08-17T18:12:18.786063+0000","last_undegraded":"2023-08-17T18:12:18.786063+0000","last_fullsized":"2023-08-17T18:12:18.786063+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.141698+0000","last_change":"2023-08-17T18:12:19.141698+0000","last_active":"2023-08-17T18:12:19.141698+0000","last_peered":"2023-08-17T18:12:19.141698+0000","last_clean":"2023-08-17T18:12:19.141698+0000","last_became_active":"2023-08-17T18:12:19.141446+0000","last_became_peered":"2023-08-17T18:12:19.141446+0000","last_unstale":"2023-08-17T18:12:19.141698+0000","last_undegraded":"2023-08-17T18:12:19.141698+0000","last_fullsized":"2023-08-17T18:12:19.141698+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.780811+0000","last_change":"2023-08-17T18:12:18.777298+0000","last_active":"2023-08-17T18:12:18.780811+0000","last_peered":"2023-08-17T18:12:18.780811+0000","last_clean":"2023-08-17T18:12:18.780811+0000","last_became_active":"2023-08-17T18:12:18.776872+0000","last_became_peered":"2023-08-17T18:12:18.776872+0000","last_unstale":"2023-08-17T18:12:18.780811+0000","last_undegraded":"2023-08-17T18:12:18.780811+0000","last_fullsized":"2023-08-17T18:12:18.780811+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.150236+0000","last_change":"2023-08-17T18:12:19.150236+0000","last_active":"2023-08-17T18:12:19.150236+0000","last_peered":"2023-08-17T18:12:19.150236+0000","last_clean":"2023-08-17T18:12:19.150236+0000","last_became_active":"2023-08-17T18:12:19.149898+0000","last_became_peered":"2023-08-17T18:12:19.149898+0000","last_unstale":"2023-08-17T18:12:19.150236+0000","last_undegraded":"2023-08-17T18:12:19.150236+0000","last_fullsized":"2023-08-17T18:12:19.150236+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775262+0000","last_change":"2023-08-17T18:12:18.772539+0000","last_active":"2023-08-17T18:12:18.775262+0000","last_peered":"2023-08-17T18:12:18.775262+0000","last_clean":"2023-08-17T18:12:18.775262+0000","last_became_active":"2023-08-17T18:12:18.772099+0000","last_became_peered":"2023-08-17T18:12:18.772099+0000","last_unstale":"2023-08-17T18:12:18.775262+0000","last_undegraded":"2023-08-17T18:12:18.775262+0000","last_fullsized":"2023-08-17T18:12:18.775262+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147612+0000","last_change":"2023-08-17T18:12:19.147612+0000","last_active":"2023-08-17T18:12:19.147612+0000","last_peered":"2023-08-17T18:12:19.147612+0000","last_clean":"2023-08-17T18:12:19.147612+0000","last_became_active":"2023-08-17T18:12:19.147245+0000","last_became_peered":"2023-08-17T18:12:19.147245+0000","last_unstale":"2023-08-17T18:12:19.147612+0000","last_undegraded":"2023-08-17T18:12:19.147612+0000","last_fullsized":"2023-08-17T18:12:19.147612+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.785888+0000","last_change":"2023-08-17T18:12:18.774276+0000","last_active":"2023-08-17T18:12:18.785888+0000","last_peered":"2023-08-17T18:12:18.785888+0000","last_clean":"2023-08-17T18:12:18.785888+0000","last_became_active":"2023-08-17T18:12:18.774015+0000","last_became_peered":"2023-08-17T18:12:18.774015+0000","last_unstale":"2023-08-17T18:12:18.785888+0000","last_undegraded":"2023-08-17T18:12:18.785888+0000","last_fullsized":"2023-08-17T18:12:18.785888+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142064+0000","last_change":"2023-08-17T18:12:19.142064+0000","last_active":"2023-08-17T18:12:19.142064+0000","last_peered":"2023-08-17T18:12:19.142064+0000","last_clean":"2023-08-17T18:12:19.142064+0000","last_became_active":"2023-08-17T18:12:19.141438+0000","last_became_peered":"2023-08-17T18:12:19.141438+0000","last_unstale":"2023-08-17T18:12:19.142064+0000","last_undegraded":"2023-08-17T18:12:19.142064+0000","last_fullsized":"2023-08-17T18:12:19.142064+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.137525+0000","last_change":"2023-08-17T18:12:18.774546+0000","last_active":"2023-08-17T18:12:19.137525+0000","last_peered":"2023-08-17T18:12:19.137525+0000","last_clean":"2023-08-17T18:12:19.137525+0000","last_became_active":"2023-08-17T18:12:18.774270+0000","last_became_peered":"2023-08-17T18:12:18.774270+0000","last_unstale":"2023-08-17T18:12:19.137525+0000","last_undegraded":"2023-08-17T18:12:19.137525+0000","last_fullsized":"2023-08-17T18:12:19.137525+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149807+0000","last_change":"2023-08-17T18:12:19.149807+0000","last_active":"2023-08-17T18:12:19.149807+0000","last_peered":"2023-08-17T18:12:19.149807+0000","last_clean":"2023-08-17T18:12:19.149807+0000","last_became_active":"2023-08-17T18:12:19.148664+0000","last_became_peered":"2023-08-17T18:12:19.148664+0000","last_unstale":"2023-08-17T18:12:19.149807+0000","last_undegraded":"2023-08-17T18:12:19.149807+0000","last_fullsized":"2023-08-17T18:12:19.149807+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"184'2","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.152753+0000","last_change":"2023-08-17T18:12:18.775310+0000","last_active":"2023-08-17T18:12:19.152753+0000","last_peered":"2023-08-17T18:12:19.152753+0000","last_clean":"2023-08-17T18:12:19.152753+0000","last_became_active":"2023-08-17T18:12:18.775036+0000","last_became_peered":"2023-08-17T18:12:18.775036+0000","last_unstale":"2023-08-17T18:12:19.152753+0000","last_undegraded":"2023-08-17T18:12:19.152753+0000","last_fullsized":"2023-08-17T18:12:19.152753+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.139570+0000","last_change":"2023-08-17T18:12:19.139570+0000","last_active":"2023-08-17T18:12:19.139570+0000","last_peered":"2023-08-17T18:12:19.139570+0000","last_clean":"2023-08-17T18:12:19.139570+0000","last_became_active":"2023-08-17T18:12:19.139333+0000","last_became_peered":"2023-08-17T18:12:19.139333+0000","last_unstale":"2023-08-17T18:12:19.139570+0000","last_undegraded":"2023-08-17T18:12:19.139570+0000","last_fullsized":"2023-08-17T18:12:19.139570+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.780721+0000","last_change":"2023-08-17T18:12:18.777538+0000","last_active":"2023-08-17T18:12:18.780721+0000","last_peered":"2023-08-17T18:12:18.780721+0000","last_clean":"2023-08-17T18:12:18.780721+0000","last_became_active":"2023-08-17T18:12:18.777289+0000","last_became_peered":"2023-08-17T18:12:18.777289+0000","last_unstale":"2023-08-17T18:12:18.780721+0000","last_undegraded":"2023-08-17T18:12:18.780721+0000","last_fullsized":"2023-08-17T18:12:18.780721+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155345+0000","last_change":"2023-08-17T18:12:19.155345+0000","last_active":"2023-08-17T18:12:19.155345+0000","last_peered":"2023-08-17T18:12:19.155345+0000","last_clean":"2023-08-17T18:12:19.155345+0000","last_became_active":"2023-08-17T18:12:19.154934+0000","last_became_peered":"2023-08-17T18:12:19.154934+0000","last_unstale":"2023-08-17T18:12:19.155345+0000","last_undegraded":"2023-08-17T18:12:19.155345+0000","last_fullsized":"2023-08-17T18:12:19.155345+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.785880+0000","last_change":"2023-08-17T18:12:18.775007+0000","last_active":"2023-08-17T18:12:18.785880+0000","last_peered":"2023-08-17T18:12:18.785880+0000","last_clean":"2023-08-17T18:12:18.785880+0000","last_became_active":"2023-08-17T18:12:18.769826+0000","last_became_peered":"2023-08-17T18:12:18.769826+0000","last_unstale":"2023-08-17T18:12:18.785880+0000","last_undegraded":"2023-08-17T18:12:18.785880+0000","last_fullsized":"2023-08-17T18:12:18.785880+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.153093+0000","last_change":"2023-08-17T18:12:19.153093+0000","last_active":"2023-08-17T18:12:19.153093+0000","last_peered":"2023-08-17T18:12:19.153093+0000","last_clean":"2023-08-17T18:12:19.153093+0000","last_became_active":"2023-08-17T18:12:19.152760+0000","last_became_peered":"2023-08-17T18:12:19.152760+0000","last_unstale":"2023-08-17T18:12:19.153093+0000","last_undegraded":"2023-08-17T18:12:19.153093+0000","last_fullsized":"2023-08-17T18:12:19.153093+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.138835+0000","last_change":"2023-08-17T18:12:18.776466+0000","last_active":"2023-08-17T18:12:19.138835+0000","last_peered":"2023-08-17T18:12:19.138835+0000","last_clean":"2023-08-17T18:12:19.138835+0000","last_became_active":"2023-08-17T18:12:18.776173+0000","last_became_peered":"2023-08-17T18:12:18.776173+0000","last_unstale":"2023-08-17T18:12:19.138835+0000","last_undegraded":"2023-08-17T18:12:19.138835+0000","last_fullsized":"2023-08-17T18:12:19.138835+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.150189+0000","last_change":"2023-08-17T18:12:19.150189+0000","last_active":"2023-08-17T18:12:19.150189+0000","last_peered":"2023-08-17T18:12:19.150189+0000","last_clean":"2023-08-17T18:12:19.150189+0000","last_became_active":"2023-08-17T18:12:19.149813+0000","last_became_peered":"2023-08-17T18:12:19.149813+0000","last_unstale":"2023-08-17T18:12:19.150189+0000","last_undegraded":"2023-08-17T18:12:19.150189+0000","last_fullsized":"2023-08-17T18:12:19.150189+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.777565+0000","last_change":"2023-08-17T18:12:18.771256+0000","last_active":"2023-08-17T18:12:18.777565+0000","last_peered":"2023-08-17T18:12:18.777565+0000","last_clean":"2023-08-17T18:12:18.777565+0000","last_became_active":"2023-08-17T18:12:18.770945+0000","last_became_peered":"2023-08-17T18:12:18.770945+0000","last_unstale":"2023-08-17T18:12:18.777565+0000","last_undegraded":"2023-08-17T18:12:18.777565+0000","last_fullsized":"2023-08-17T18:12:18.777565+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149684+0000","last_change":"2023-08-17T18:12:19.149684+0000","last_active":"2023-08-17T18:12:19.149684+0000","last_peered":"2023-08-17T18:12:19.149684+0000","last_clean":"2023-08-17T18:12:19.149684+0000","last_became_active":"2023-08-17T18:12:19.149429+0000","last_became_peered":"2023-08-17T18:12:19.149429+0000","last_unstale":"2023-08-17T18:12:19.149684+0000","last_undegraded":"2023-08-17T18:12:19.149684+0000","last_fullsized":"2023-08-17T18:12:19.149684+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775227+0000","last_change":"2023-08-17T18:12:18.768930+0000","last_active":"2023-08-17T18:12:18.775227+0000","last_peered":"2023-08-17T18:12:18.775227+0000","last_clean":"2023-08-17T18:12:18.775227+0000","last_became_active":"2023-08-17T18:12:18.768590+0000","last_became_peered":"2023-08-17T18:12:18.768590+0000","last_unstale":"2023-08-17T18:12:18.775227+0000","last_undegraded":"2023-08-17T18:12:18.775227+0000","last_fullsized":"2023-08-17T18:12:18.775227+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.144553+0000","last_change":"2023-08-17T18:12:19.144553+0000","last_active":"2023-08-17T18:12:19.144553+0000","last_peered":"2023-08-17T18:12:19.144553+0000","last_clean":"2023-08-17T18:12:19.144553+0000","last_became_active":"2023-08-17T18:12:19.144294+0000","last_became_peered":"2023-08-17T18:12:19.144294+0000","last_unstale":"2023-08-17T18:12:19.144553+0000","last_undegraded":"2023-08-17T18:12:19.144553+0000","last_fullsized":"2023-08-17T18:12:19.144553+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.779517+0000","last_change":"2023-08-17T18:12:18.777249+0000","last_active":"2023-08-17T18:12:18.779517+0000","last_peered":"2023-08-17T18:12:18.779517+0000","last_clean":"2023-08-17T18:12:18.779517+0000","last_became_active":"2023-08-17T18:12:18.776958+0000","last_became_peered":"2023-08-17T18:12:18.776958+0000","last_unstale":"2023-08-17T18:12:18.779517+0000","last_undegraded":"2023-08-17T18:12:18.779517+0000","last_fullsized":"2023-08-17T18:12:18.779517+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.154641+0000","last_change":"2023-08-17T18:12:19.154641+0000","last_active":"2023-08-17T18:12:19.154641+0000","last_peered":"2023-08-17T18:12:19.154641+0000","last_clean":"2023-08-17T18:12:19.154641+0000","last_became_active":"2023-08-17T18:12:19.154354+0000","last_became_peered":"2023-08-17T18:12:19.154354+0000","last_unstale":"2023-08-17T18:12:19.154641+0000","last_undegraded":"2023-08-17T18:12:19.154641+0000","last_fullsized":"2023-08-17T18:12:19.154641+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"184'2","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145139+0000","last_change":"2023-08-17T18:12:18.776002+0000","last_active":"2023-08-17T18:12:19.145139+0000","last_peered":"2023-08-17T18:12:19.145139+0000","last_clean":"2023-08-17T18:12:19.145139+0000","last_became_active":"2023-08-17T18:12:18.775730+0000","last_became_peered":"2023-08-17T18:12:18.775730+0000","last_unstale":"2023-08-17T18:12:19.145139+0000","last_undegraded":"2023-08-17T18:12:19.145139+0000","last_fullsized":"2023-08-17T18:12:19.145139+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146456+0000","last_change":"2023-08-17T18:12:19.146456+0000","last_active":"2023-08-17T18:12:19.146456+0000","last_peered":"2023-08-17T18:12:19.146456+0000","last_clean":"2023-08-17T18:12:19.146456+0000","last_became_active":"2023-08-17T18:12:19.146150+0000","last_became_peered":"2023-08-17T18:12:19.146150+0000","last_unstale":"2023-08-17T18:12:19.146456+0000","last_undegraded":"2023-08-17T18:12:19.146456+0000","last_fullsized":"2023-08-17T18:12:19.146456+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.786110+0000","last_change":"2023-08-17T18:12:18.783213+0000","last_active":"2023-08-17T18:12:18.786110+0000","last_peered":"2023-08-17T18:12:18.786110+0000","last_clean":"2023-08-17T18:12:18.786110+0000","last_became_active":"2023-08-17T18:12:18.782619+0000","last_became_peered":"2023-08-17T18:12:18.782619+0000","last_unstale":"2023-08-17T18:12:18.786110+0000","last_undegraded":"2023-08-17T18:12:18.786110+0000","last_fullsized":"2023-08-17T18:12:18.786110+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149687+0000","last_change":"2023-08-17T18:12:19.149687+0000","last_active":"2023-08-17T18:12:19.149687+0000","last_peered":"2023-08-17T18:12:19.149687+0000","last_clean":"2023-08-17T18:12:19.149687+0000","last_became_active":"2023-08-17T18:12:19.149386+0000","last_became_peered":"2023-08-17T18:12:19.149386+0000","last_unstale":"2023-08-17T18:12:19.149687+0000","last_undegraded":"2023-08-17T18:12:19.149687+0000","last_fullsized":"2023-08-17T18:12:19.149687+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.785814+0000","last_change":"2023-08-17T18:12:18.781434+0000","last_active":"2023-08-17T18:12:18.785814+0000","last_peered":"2023-08-17T18:12:18.785814+0000","last_clean":"2023-08-17T18:12:18.785814+0000","last_became_active":"2023-08-17T18:12:18.778449+0000","last_became_peered":"2023-08-17T18:12:18.778449+0000","last_unstale":"2023-08-17T18:12:18.785814+0000","last_undegraded":"2023-08-17T18:12:18.785814+0000","last_fullsized":"2023-08-17T18:12:18.785814+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146707+0000","last_change":"2023-08-17T18:12:19.146707+0000","last_active":"2023-08-17T18:12:19.146707+0000","last_peered":"2023-08-17T18:12:19.146707+0000","last_clean":"2023-08-17T18:12:19.146707+0000","last_became_active":"2023-08-17T18:12:19.146438+0000","last_became_peered":"2023-08-17T18:12:19.146438+0000","last_unstale":"2023-08-17T18:12:19.146707+0000","last_undegraded":"2023-08-17T18:12:19.146707+0000","last_fullsized":"2023-08-17T18:12:19.146707+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.793830+0000","last_change":"2023-08-17T18:12:18.786610+0000","last_active":"2023-08-17T18:12:18.793830+0000","last_peered":"2023-08-17T18:12:18.793830+0000","last_clean":"2023-08-17T18:12:18.793830+0000","last_became_active":"2023-08-17T18:12:18.786312+0000","last_became_peered":"2023-08-17T18:12:18.786312+0000","last_unstale":"2023-08-17T18:12:18.793830+0000","last_undegraded":"2023-08-17T18:12:18.793830+0000","last_fullsized":"2023-08-17T18:12:18.793830+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.148104+0000","last_change":"2023-08-17T18:12:19.148104+0000","last_active":"2023-08-17T18:12:19.148104+0000","last_peered":"2023-08-17T18:12:19.148104+0000","last_clean":"2023-08-17T18:12:19.148104+0000","last_became_active":"2023-08-17T18:12:19.147784+0000","last_became_peered":"2023-08-17T18:12:19.147784+0000","last_unstale":"2023-08-17T18:12:19.148104+0000","last_undegraded":"2023-08-17T18:12:19.148104+0000","last_fullsized":"2023-08-17T18:12:19.148104+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.777462+0000","last_change":"2023-08-17T18:12:18.773766+0000","last_active":"2023-08-17T18:12:18.777462+0000","last_peered":"2023-08-17T18:12:18.777462+0000","last_clean":"2023-08-17T18:12:18.777462+0000","last_became_active":"2023-08-17T18:12:18.773484+0000","last_became_peered":"2023-08-17T18:12:18.773484+0000","last_unstale":"2023-08-17T18:12:18.777462+0000","last_undegraded":"2023-08-17T18:12:18.777462+0000","last_fullsized":"2023-08-17T18:12:18.777462+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142937+0000","last_change":"2023-08-17T18:12:19.142937+0000","last_active":"2023-08-17T18:12:19.142937+0000","last_peered":"2023-08-17T18:12:19.142937+0000","last_clean":"2023-08-17T18:12:19.142937+0000","last_became_active":"2023-08-17T18:12:19.142649+0000","last_became_peered":"2023-08-17T18:12:19.142649+0000","last_unstale":"2023-08-17T18:12:19.142937+0000","last_undegraded":"2023-08-17T18:12:19.142937+0000","last_fullsized":"2023-08-17T18:12:19.142937+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.778875+0000","last_change":"2023-08-17T18:12:18.770938+0000","last_active":"2023-08-17T18:12:18.778875+0000","last_peered":"2023-08-17T18:12:18.778875+0000","last_clean":"2023-08-17T18:12:18.778875+0000","last_became_active":"2023-08-17T18:12:18.770661+0000","last_became_peered":"2023-08-17T18:12:18.770661+0000","last_unstale":"2023-08-17T18:12:18.778875+0000","last_undegraded":"2023-08-17T18:12:18.778875+0000","last_fullsized":"2023-08-17T18:12:18.778875+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.153018+0000","last_change":"2023-08-17T18:12:19.153018+0000","last_active":"2023-08-17T18:12:19.153018+0000","last_peered":"2023-08-17T18:12:19.153018+0000","last_clean":"2023-08-17T18:12:19.153018+0000","last_became_active":"2023-08-17T18:12:19.152690+0000","last_became_peered":"2023-08-17T18:12:19.152690+0000","last_unstale":"2023-08-17T18:12:19.153018+0000","last_undegraded":"2023-08-17T18:12:19.153018+0000","last_fullsized":"2023-08-17T18:12:19.153018+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781403+0000","last_change":"2023-08-17T18:12:18.775345+0000","last_active":"2023-08-17T18:12:18.781403+0000","last_peered":"2023-08-17T18:12:18.781403+0000","last_clean":"2023-08-17T18:12:18.781403+0000","last_became_active":"2023-08-17T18:12:18.774474+0000","last_became_peered":"2023-08-17T18:12:18.774474+0000","last_unstale":"2023-08-17T18:12:18.781403+0000","last_undegraded":"2023-08-17T18:12:18.781403+0000","last_fullsized":"2023-08-17T18:12:18.781403+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.141746+0000","last_change":"2023-08-17T18:12:19.141746+0000","last_active":"2023-08-17T18:12:19.141746+0000","last_peered":"2023-08-17T18:12:19.141746+0000","last_clean":"2023-08-17T18:12:19.141746+0000","last_became_active":"2023-08-17T18:12:19.141345+0000","last_became_peered":"2023-08-17T18:12:19.141345+0000","last_unstale":"2023-08-17T18:12:19.141746+0000","last_undegraded":"2023-08-17T18:12:19.141746+0000","last_fullsized":"2023-08-17T18:12:19.141746+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.780566+0000","last_change":"2023-08-17T18:12:18.776804+0000","last_active":"2023-08-17T18:12:18.780566+0000","last_peered":"2023-08-17T18:12:18.780566+0000","last_clean":"2023-08-17T18:12:18.780566+0000","last_became_active":"2023-08-17T18:12:18.776248+0000","last_became_peered":"2023-08-17T18:12:18.776248+0000","last_unstale":"2023-08-17T18:12:18.780566+0000","last_undegraded":"2023-08-17T18:12:18.780566+0000","last_fullsized":"2023-08-17T18:12:18.780566+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145448+0000","last_change":"2023-08-17T18:12:19.145448+0000","last_active":"2023-08-17T18:12:19.145448+0000","last_peered":"2023-08-17T18:12:19.145448+0000","last_clean":"2023-08-17T18:12:19.145448+0000","last_became_active":"2023-08-17T18:12:19.145156+0000","last_became_peered":"2023-08-17T18:12:19.145156+0000","last_unstale":"2023-08-17T18:12:19.145448+0000","last_undegraded":"2023-08-17T18:12:19.145448+0000","last_fullsized":"2023-08-17T18:12:19.145448+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781425+0000","last_change":"2023-08-17T18:12:18.775527+0000","last_active":"2023-08-17T18:12:18.781425+0000","last_peered":"2023-08-17T18:12:18.781425+0000","last_clean":"2023-08-17T18:12:18.781425+0000","last_became_active":"2023-08-17T18:12:18.774835+0000","last_became_peered":"2023-08-17T18:12:18.774835+0000","last_unstale":"2023-08-17T18:12:18.781425+0000","last_undegraded":"2023-08-17T18:12:18.781425+0000","last_fullsized":"2023-08-17T18:12:18.781425+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.760439+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T18:12:18.760439+0000","last_peered":"2023-08-17T18:12:18.760439+0000","last_clean":"2023-08-17T18:12:18.760439+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T18:12:18.760439+0000","last_undegraded":"2023-08-17T18:12:18.760439+0000","last_fullsized":"2023-08-17T18:12:18.760439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142655+0000","last_change":"2023-08-17T18:12:19.142655+0000","last_active":"2023-08-17T18:12:19.142655+0000","last_peered":"2023-08-17T18:12:19.142655+0000","last_clean":"2023-08-17T18:12:19.142655+0000","last_became_active":"2023-08-17T18:12:19.142004+0000","last_became_peered":"2023-08-17T18:12:19.142004+0000","last_unstale":"2023-08-17T18:12:19.142655+0000","last_undegraded":"2023-08-17T18:12:19.142655+0000","last_fullsized":"2023-08-17T18:12:19.142655+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.782011+0000","last_change":"2023-08-17T18:12:18.775068+0000","last_active":"2023-08-17T18:12:18.782011+0000","last_peered":"2023-08-17T18:12:18.782011+0000","last_clean":"2023-08-17T18:12:18.782011+0000","last_became_active":"2023-08-17T18:12:18.774795+0000","last_became_peered":"2023-08-17T18:12:18.774795+0000","last_unstale":"2023-08-17T18:12:18.782011+0000","last_undegraded":"2023-08-17T18:12:18.782011+0000","last_fullsized":"2023-08-17T18:12:18.782011+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.761073+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T18:12:18.761073+0000","last_peered":"2023-08-17T18:12:18.761073+0000","last_clean":"2023-08-17T18:12:18.761073+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T18:12:18.761073+0000","last_undegraded":"2023-08-17T18:12:18.761073+0000","last_fullsized":"2023-08-17T18:12:18.761073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155915+0000","last_change":"2023-08-17T18:12:19.155915+0000","last_active":"2023-08-17T18:12:19.155915+0000","last_peered":"2023-08-17T18:12:19.155915+0000","last_clean":"2023-08-17T18:12:19.155915+0000","last_became_active":"2023-08-17T18:12:19.155650+0000","last_became_peered":"2023-08-17T18:12:19.155650+0000","last_unstale":"2023-08-17T18:12:19.155915+0000","last_undegraded":"2023-08-17T18:12:19.155915+0000","last_fullsized":"2023-08-17T18:12:19.155915+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"184'2","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.154768+0000","last_change":"2023-08-17T18:12:18.779486+0000","last_active":"2023-08-17T18:12:19.154768+0000","last_peered":"2023-08-17T18:12:19.154768+0000","last_clean":"2023-08-17T18:12:19.154768+0000","last_became_active":"2023-08-17T18:12:18.778932+0000","last_became_peered":"2023-08-17T18:12:18.778932+0000","last_unstale":"2023-08-17T18:12:19.154768+0000","last_undegraded":"2023-08-17T18:12:19.154768+0000","last_fullsized":"2023-08-17T18:12:19.154768+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.760047+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T18:12:18.760047+0000","last_peered":"2023-08-17T18:12:18.760047+0000","last_clean":"2023-08-17T18:12:18.760047+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T18:12:18.760047+0000","last_undegraded":"2023-08-17T18:12:18.760047+0000","last_fullsized":"2023-08-17T18:12:18.760047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.150117+0000","last_change":"2023-08-17T18:12:19.150117+0000","last_active":"2023-08-17T18:12:19.150117+0000","last_peered":"2023-08-17T18:12:19.150117+0000","last_clean":"2023-08-17T18:12:19.150117+0000","last_became_active":"2023-08-17T18:12:19.149831+0000","last_became_peered":"2023-08-17T18:12:19.149831+0000","last_unstale":"2023-08-17T18:12:19.150117+0000","last_undegraded":"2023-08-17T18:12:19.150117+0000","last_fullsized":"2023-08-17T18:12:19.150117+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.786132+0000","last_change":"2023-08-17T18:12:18.783404+0000","last_active":"2023-08-17T18:12:18.786132+0000","last_peered":"2023-08-17T18:12:18.786132+0000","last_clean":"2023-08-17T18:12:18.786132+0000","last_became_active":"2023-08-17T18:12:18.782949+0000","last_became_peered":"2023-08-17T18:12:18.782949+0000","last_unstale":"2023-08-17T18:12:18.786132+0000","last_undegraded":"2023-08-17T18:12:18.786132+0000","last_fullsized":"2023-08-17T18:12:18.786132+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":166,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.759728+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T18:12:18.759728+0000","last_peered":"2023-08-17T18:12:18.759728+0000","last_clean":"2023-08-17T18:12:18.759728+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T18:12:18.759728+0000","last_undegraded":"2023-08-17T18:12:18.759728+0000","last_fullsized":"2023-08-17T18:12:18.759728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":143,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.769358+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T18:12:18.769358+0000","last_peered":"2023-08-17T18:12:18.769358+0000","last_clean":"2023-08-17T18:12:18.769358+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T18:12:18.769358+0000","last_undegraded":"2023-08-17T18:12:18.769358+0000","last_fullsized":"2023-08-17T18:12:18.769358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.150166+0000","last_change":"2023-08-17T18:12:19.150166+0000","last_active":"2023-08-17T18:12:19.150166+0000","last_peered":"2023-08-17T18:12:19.150166+0000","last_clean":"2023-08-17T18:12:19.150166+0000","last_became_active":"2023-08-17T18:12:19.149889+0000","last_became_peered":"2023-08-17T18:12:19.149889+0000","last_unstale":"2023-08-17T18:12:19.150166+0000","last_undegraded":"2023-08-17T18:12:19.150166+0000","last_fullsized":"2023-08-17T18:12:19.150166+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"184'3","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.156890+0000","last_change":"2023-08-17T18:12:18.767892+0000","last_active":"2023-08-17T18:12:19.156890+0000","last_peered":"2023-08-17T18:12:19.156890+0000","last_clean":"2023-08-17T18:12:19.156890+0000","last_became_active":"2023-08-17T18:12:18.767527+0000","last_became_peered":"2023-08-17T18:12:18.767527+0000","last_unstale":"2023-08-17T18:12:19.156890+0000","last_undegraded":"2023-08-17T18:12:19.156890+0000","last_fullsized":"2023-08-17T18:12:19.156890+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":141,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.769473+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T18:12:18.769473+0000","last_peered":"2023-08-17T18:12:18.769473+0000","last_clean":"2023-08-17T18:12:18.769473+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T18:12:18.769473+0000","last_undegraded":"2023-08-17T18:12:18.769473+0000","last_fullsized":"2023-08-17T18:12:18.769473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.141598+0000","last_change":"2023-08-17T18:12:19.141598+0000","last_active":"2023-08-17T18:12:19.141598+0000","last_peered":"2023-08-17T18:12:19.141598+0000","last_clean":"2023-08-17T18:12:19.141598+0000","last_became_active":"2023-08-17T18:12:19.141006+0000","last_became_peered":"2023-08-17T18:12:19.141006+0000","last_unstale":"2023-08-17T18:12:19.141598+0000","last_undegraded":"2023-08-17T18:12:19.141598+0000","last_fullsized":"2023-08-17T18:12:19.141598+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"184'4","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.152128+0000","last_change":"2023-08-17T18:12:18.768450+0000","last_active":"2023-08-17T18:12:19.152128+0000","last_peered":"2023-08-17T18:12:19.152128+0000","last_clean":"2023-08-17T18:12:19.152128+0000","last_became_active":"2023-08-17T18:12:18.768157+0000","last_became_peered":"2023-08-17T18:12:18.768157+0000","last_unstale":"2023-08-17T18:12:19.152128+0000","last_undegraded":"2023-08-17T18:12:19.152128+0000","last_fullsized":"2023-08-17T18:12:19.152128+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.768728+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T18:12:18.768728+0000","last_peered":"2023-08-17T18:12:18.768728+0000","last_clean":"2023-08-17T18:12:18.768728+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T18:12:18.768728+0000","last_undegraded":"2023-08-17T18:12:18.768728+0000","last_fullsized":"2023-08-17T18:12:18.768728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149419+0000","last_change":"2023-08-17T18:12:19.149419+0000","last_active":"2023-08-17T18:12:19.149419+0000","last_peered":"2023-08-17T18:12:19.149419+0000","last_clean":"2023-08-17T18:12:19.149419+0000","last_became_active":"2023-08-17T18:12:19.149068+0000","last_became_peered":"2023-08-17T18:12:19.149068+0000","last_unstale":"2023-08-17T18:12:19.149419+0000","last_undegraded":"2023-08-17T18:12:19.149419+0000","last_fullsized":"2023-08-17T18:12:19.149419+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.138742+0000","last_change":"2023-08-17T18:12:18.771570+0000","last_active":"2023-08-17T18:12:19.138742+0000","last_peered":"2023-08-17T18:12:19.138742+0000","last_clean":"2023-08-17T18:12:19.138742+0000","last_became_active":"2023-08-17T18:12:18.770364+0000","last_became_peered":"2023-08-17T18:12:18.770364+0000","last_unstale":"2023-08-17T18:12:19.138742+0000","last_undegraded":"2023-08-17T18:12:19.138742+0000","last_fullsized":"2023-08-17T18:12:19.138742+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.760760+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T18:12:18.760760+0000","last_peered":"2023-08-17T18:12:18.760760+0000","last_clean":"2023-08-17T18:12:18.760760+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T18:12:18.760760+0000","last_undegraded":"2023-08-17T18:12:18.760760+0000","last_fullsized":"2023-08-17T18:12:18.760760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149924+0000","last_change":"2023-08-17T18:12:19.149924+0000","last_active":"2023-08-17T18:12:19.149924+0000","last_peered":"2023-08-17T18:12:19.149924+0000","last_clean":"2023-08-17T18:12:19.149924+0000","last_became_active":"2023-08-17T18:12:19.149021+0000","last_became_peered":"2023-08-17T18:12:19.149021+0000","last_unstale":"2023-08-17T18:12:19.149924+0000","last_undegraded":"2023-08-17T18:12:19.149924+0000","last_fullsized":"2023-08-17T18:12:19.149924+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781981+0000","last_change":"2023-08-17T18:12:18.772234+0000","last_active":"2023-08-17T18:12:18.781981+0000","last_peered":"2023-08-17T18:12:18.781981+0000","last_clean":"2023-08-17T18:12:18.781981+0000","last_became_active":"2023-08-17T18:12:18.771970+0000","last_became_peered":"2023-08-17T18:12:18.771970+0000","last_unstale":"2023-08-17T18:12:18.781981+0000","last_undegraded":"2023-08-17T18:12:18.781981+0000","last_fullsized":"2023-08-17T18:12:18.781981+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.762055+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T18:12:18.762055+0000","last_peered":"2023-08-17T18:12:18.762055+0000","last_clean":"2023-08-17T18:12:18.762055+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T18:12:18.762055+0000","last_undegraded":"2023-08-17T18:12:18.762055+0000","last_fullsized":"2023-08-17T18:12:18.762055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575298,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71299999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63100000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.69799999999999995,"5min":0.76300000000000001,"15min":0.77100000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.501,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.372},"max":{"1min":0.65700000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61699999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.66100000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.36799999999999999},"max":{"1min":0.68000000000000005,"5min":0.78600000000000003,"15min":0.81699999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.627,"15min":0.629},"min":{"1min":0.42699999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.73699999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.247},"max":{"1min":0.66100000000000003,"5min":0.68799999999999994,"15min":0.77600000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48199999999999998},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.32300000000000001},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.76900000000000002},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.28299999999999997},"max":{"1min":0.72399999999999998,"5min":0.78900000000000003,"15min":0.81699999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.86499999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.754,"5min":0.79600000000000004,"15min":0.84199999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.68200000000000005,"5min":0.76300000000000001,"15min":0.82099999999999995},"last":0.51000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575298,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303440,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068400,"statfs":{"total":96636764160,"available":96326041600,"internally_reserved":0,"allocated":2301952,"data_stored":1155715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.36599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71099999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66100000000000003,"5min":1.214,"15min":1.214},"last":0.628}]},{"osd":1,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.38300000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64800000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36299999999999999,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.748,"5min":1.208,"15min":1.208},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.505},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.58299999999999996},"min":{"1min":0.39500000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":1.304,"15min":1.304},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73699999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.29499999999999998},"max":{"1min":0.73099999999999998,"5min":0.78600000000000003,"15min":0.88700000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48999999999999999,"15min":0.47799999999999998},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.74299999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.495,"15min":0.47899999999999998},"min":{"1min":0.34300000000000003,"5min":0.33600000000000002,"15min":0.30499999999999999},"max":{"1min":0.72999999999999998,"5min":0.75800000000000001,"15min":1.0269999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57199999999999995,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.77300000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54400000000000004,"15min":0.53300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32300000000000001},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.87},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.372,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.80700000000000005,"15min":0.97699999999999998},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2289664,"data_stored":1148536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35399999999999998,"15min":0.35299999999999998},"min":{"1min":0.245,"5min":0.216,"15min":0.216},"max":{"1min":0.63300000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.308}]},{"osd":2,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.22700000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.443,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40600000000000003,"15min":0.40699999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":0.56399999999999995,"5min":0.59599999999999997,"15min":0.621},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.437,"15min":0.438},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58799999999999997,"5min":1.095,"15min":1.095},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.25900000000000001},"max":{"1min":0.51400000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78800000000000003,"5min":0.88400000000000001,"15min":0.96199999999999997},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.621,"15min":0.623},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72999999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.623,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80700000000000005,"5min":0.90400000000000003,"15min":0.94499999999999995},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.45300000000000001,"5min":0.42399999999999999,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.502}]},{"osd":7,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.754,"5min":0.88800000000000001,"15min":0.91800000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.48999999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575298,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34499999999999997,"15min":0.35699999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45800000000000002,"5min":0.64100000000000001,"15min":0.77600000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.378,"15min":0.39300000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.498,"5min":0.58099999999999996,"15min":0.70899999999999996},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.36399999999999999,"15min":0.373},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.61399999999999999},"last":0.309},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64700000000000002,"5min":0.70299999999999996,"15min":0.754},"last":0.373}]},{"osd":3,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.39100000000000001,"15min":0.40799999999999997},"min":{"1min":0.247,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.66100000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.41699999999999998,"15min":0.42399999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58899999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.375,"5min":0.375,"15min":0.35399999999999998},"max":{"1min":0.82699999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63400000000000001,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.39700000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.62,"15min":0.627},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.38300000000000001},"max":{"1min":0.78500000000000003,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.39600000000000002},"max":{"1min":0.77500000000000002,"5min":1.079,"15min":1.079},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.622,"15min":0.64000000000000001},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83699999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.45900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.89200000000000002,"5min":1.0549999999999999,"15min":1.0820000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.69799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575298,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.222,"5min":0.221,"15min":0.20300000000000001},"max":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.623},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.371,"15min":0.36799999999999999},"min":{"1min":0.255,"5min":0.254,"15min":0.249},"max":{"1min":0.51700000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57499999999999996,"5min":0.61599999999999999,"15min":0.68100000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.25600000000000001},"max":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.72999999999999998},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41999999999999998,"15min":0.42299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.67000000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.311}]},{"osd":4,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":1.0169999999999999},"last":0.505},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38400000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.73399999999999999,"5min":0.91000000000000003,"15min":0.94799999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59799999999999998,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.40899999999999997},"max":{"1min":0.72599999999999998,"5min":0.89900000000000002,"15min":0.96099999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77600000000000002,"5min":0.94199999999999995,"15min":0.97999999999999998},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.44600000000000001,"15min":0.42099999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.75,"5min":0.93500000000000005,"15min":1.0469999999999999},"last":0.52400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575298,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307512,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064328,"statfs":{"total":96636764160,"available":96321871872,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35599999999999998,"15min":0.34899999999999998},"min":{"1min":0.23100000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.52400000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.38700000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.57299999999999995,"5min":0.59899999999999998,"15min":0.61299999999999999},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.377},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55300000000000005,"5min":0.59399999999999997,"15min":0.72299999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41599999999999998,"15min":0.40699999999999997},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59099999999999997,"5min":0.63100000000000001,"15min":0.63400000000000001},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40600000000000003,"15min":0.40699999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":0.48699999999999999,"5min":0.58999999999999997,"15min":0.68899999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.70699999999999996},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.87,"15min":0.95499999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.42799999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":0.879,"15min":0.93100000000000005},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.60799999999999998},"min":{"1min":0.46300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.84199999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64800000000000002,"15min":0.64300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.89100000000000001,"15min":0.90700000000000003},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.88900000000000001,"5min":0.92800000000000005,"15min":0.94399999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.82699999999999996,"5min":0.93200000000000005,"15min":0.94899999999999995},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86199999999999999,"5min":0.96599999999999997,"15min":0.97099999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.48499999999999999,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575299,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.315},"max":{"1min":0.66100000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.432},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55300000000000005,"15min":0.56200000000000006},"min":{"1min":0.41599999999999998,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.40500000000000003,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.81399999999999995,"15min":0.83799999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73499999999999999,"5min":0.81200000000000006,"15min":0.81999999999999995},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68700000000000006,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.61899999999999999,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.30599999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.79700000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.28799999999999998},"max":{"1min":0.64700000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33300000000000002},"max":{"1min":0.72599999999999998,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.44400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.63300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575297,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307512,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064328,"statfs":{"total":96636764160,"available":96321871872,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.80300000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.34300000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.378},"max":{"1min":0.82899999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.45400000000000001,"15min":0.443},"min":{"1min":0.32400000000000001,"5min":0.28100000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.71599999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.49299999999999999,"15min":0.47899999999999998},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.496,"15min":0.495},"min":{"1min":0.307,"5min":0.307,"15min":0.29899999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.79500000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.34300000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60799999999999998,"15min":0.59099999999999997},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.32600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.83399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T18:12:22.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T18:12:22.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.253+0000 7f47a3e9d700 1 Processor -- start 2023-08-17T18:12:22.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.253+0000 7f47a3e9d700 1 -- start start 2023-08-17T18:12:22.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.254+0000 7f47a3e9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f479c0a7fe0 0x7f479c064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.254+0000 7f47a3e9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f479c065140 0x7f479c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.254+0000 7f47a3e9d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0c4040 con 0x7f479c0be7f0 2023-08-17T18:12:22.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.254+0000 7f47a3e9d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c0c7080 con 0x7f479c065140 2023-08-17T18:12:22.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.254+0000 7f47a3e9d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c0c3430 con 0x7f479c0a7fe0 2023-08-17T18:12:22.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.254+0000 7f47a1438700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f479c065140 0x7f479c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.254+0000 7f47a1438700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f479c065140 0x7f479c0c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47402/0 (socket says 172.21.15.78:47402) 2023-08-17T18:12:22.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.254+0000 7f47a1438700 1 -- 172.21.15.78:0/1535224524 learned_addr learned my addr 172.21.15.78:0/1535224524 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:22.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a1c39700 1 --2- 172.21.15.78:0/1535224524 >> v2:172.21.15.150:3300/0 conn(0x7f479c0a7fe0 0x7f479c064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a1438700 1 -- 172.21.15.78:0/1535224524 >> v2:172.21.15.150:3300/0 conn(0x7f479c0a7fe0 msgr2=0x7f479c064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:22.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a1438700 1 --2- 172.21.15.78:0/1535224524 >> v2:172.21.15.150:3300/0 conn(0x7f479c0a7fe0 0x7f479c064180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a1438700 1 -- 172.21.15.78:0/1535224524 >> v1:172.21.15.150:6789/0 conn(0x7f479c0be7f0 legacy=0x7f479c0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:22.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a1438700 1 -- 172.21.15.78:0/1535224524 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0c3710 con 0x7f479c065140 2023-08-17T18:12:22.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a1438700 1 --2- 172.21.15.78:0/1535224524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 0x7f479c0c6b90 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f479c06bd40 tx=0x7f478c0090f0).ready entity=mon.0 client_cookie=bc371dcb1c308d94 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:22.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a0c37700 1 -- 172.21.15.78:0/1535224524 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00b5a0 con 0x7f479c065140 2023-08-17T18:12:22.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a0c37700 1 -- 172.21.15.78:0/1535224524 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00b700 con 0x7f479c065140 2023-08-17T18:12:22.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a0c37700 1 -- 172.21.15.78:0/1535224524 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00ba80 con 0x7f479c065140 2023-08-17T18:12:22.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a3e9d700 1 -- 172.21.15.78:0/1535224524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 msgr2=0x7f479c0c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a3e9d700 1 --2- 172.21.15.78:0/1535224524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 0x7f479c0c6b90 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f479c06bd40 tx=0x7f478c0090f0).stop 2023-08-17T18:12:22.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a3e9d700 1 -- 172.21.15.78:0/1535224524 shutdown_connections 2023-08-17T18:12:22.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a3e9d700 1 --2- 172.21.15.78:0/1535224524 >> v2:172.21.15.150:3300/0 conn(0x7f479c0a7fe0 0x7f479c064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a3e9d700 1 --2- 172.21.15.78:0/1535224524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 0x7f479c0c6b90 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a3e9d700 1 -- 172.21.15.78:0/1535224524 >> 172.21.15.78:0/1535224524 conn(0x7f479c092330 msgr2=0x7f479c062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:22.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.255+0000 7f47a3e9d700 1 -- 172.21.15.78:0/1535224524 shutdown_connections 2023-08-17T18:12:22.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.256+0000 7f47a3e9d700 1 -- 172.21.15.78:0/1535224524 wait complete. 2023-08-17T18:12:22.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a3e9d700 1 Processor -- start 2023-08-17T18:12:22.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a3e9d700 1 -- start start 2023-08-17T18:12:22.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a3e9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 0x7f479c1403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a3e9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f479c0a7fe0 0x7f479c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a3e9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f479c0be7f0 0x7f479c140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a3e9d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0c2010 con 0x7f479c065140 2023-08-17T18:12:22.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a3e9d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0c1400 con 0x7f479c0be7f0 2023-08-17T18:12:22.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a3e9d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0c16e0 con 0x7f479c0a7fe0 2023-08-17T18:12:22.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a1c39700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 0x7f479c1403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a1c39700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 0x7f479c1403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47410/0 (socket says 172.21.15.78:47410) 2023-08-17T18:12:22.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.257+0000 7f47a1c39700 1 -- 172.21.15.78:0/2788053599 learned_addr learned my addr 172.21.15.78:0/2788053599 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f47a1438700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f479c0a7fe0 0x7f479c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f47a1c39700 1 -- 172.21.15.78:0/2788053599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f479c0a7fe0 msgr2=0x7f479c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f47a1c39700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f479c0a7fe0 0x7f479c0c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f47a243a700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f479c0be7f0 0x7f479c140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f47a1c39700 1 -- 172.21.15.78:0/2788053599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f479c0be7f0 msgr2=0x7f479c140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f47a1c39700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f479c0be7f0 0x7f479c140cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f47a1c39700 1 -- 172.21.15.78:0/2788053599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009370 con 0x7f479c065140 2023-08-17T18:12:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f47a1c39700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 0x7f479c1403d0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7f479800c880 tx=0x7f4798008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f4791ffb700 1 -- 172.21.15.78:0/2788053599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798010580 con 0x7f479c065140 2023-08-17T18:12:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f4791ffb700 1 -- 172.21.15.78:0/2788053599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47980106e0 con 0x7f479c065140 2023-08-17T18:12:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f47a3e9d700 1 -- 172.21.15.78:0/2788053599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c0c19c0 con 0x7f479c065140 2023-08-17T18:12:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f4791ffb700 1 -- 172.21.15.78:0/2788053599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798010a60 con 0x7f479c065140 2023-08-17T18:12:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.258+0000 7f47a3e9d700 1 -- 172.21.15.78:0/2788053599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c1408c0 con 0x7f479c065140 2023-08-17T18:12:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.259+0000 7f47a3e9d700 1 -- 172.21.15.78:0/2788053599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c0c22f0 con 0x7f479c065140 2023-08-17T18:12:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.259+0000 7f4791ffb700 1 -- 172.21.15.78:0/2788053599 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f479801b460 con 0x7f479c065140 2023-08-17T18:12:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.260+0000 7f4791ffb700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f478005ed60 0x7f4780061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.260+0000 7f4791ffb700 1 -- 172.21.15.78:0/2788053599 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4798079d00 con 0x7f479c065140 2023-08-17T18:12:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.260+0000 7f47a1438700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f478005ed60 0x7f4780061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.260+0000 7f47a1438700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f478005ed60 0x7f4780061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f479c159780 tx=0x7f478c015000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:22.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.264+0000 7f4791ffb700 1 -- 172.21.15.78:0/2788053599 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f479807d030 con 0x7f479c065140 2023-08-17T18:12:22.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.423+0000 7f47a3e9d700 1 -- 172.21.15.78:0/2788053599 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f479c0c2150 con 0x7f478005ed60 2023-08-17T18:12:22.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.433+0000 7f4791ffb700 1 -- 172.21.15.78:0/2788053599 <== mgr.9348 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361948 (secure 0 0 0) 0x7f478c00b870 con 0x7f478005ed60 2023-08-17T18:12:22.436 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 -- 172.21.15.78:0/2788053599 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f478005ed60 msgr2=0x7f4780061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f478005ed60 0x7f4780061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f479c159780 tx=0x7f478c015000).stop 2023-08-17T18:12:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 -- 172.21.15.78:0/2788053599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 msgr2=0x7f479c1403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 0x7f479c1403d0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7f479800c880 tx=0x7f4798008040).stop 2023-08-17T18:12:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 -- 172.21.15.78:0/2788053599 shutdown_connections 2023-08-17T18:12:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f478005ed60 0x7f4780061220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f479c0be7f0 0x7f479c140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f479c065140 0x7f479c1403d0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 --2- 172.21.15.78:0/2788053599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f479c0a7fe0 0x7f479c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 -- 172.21.15.78:0/2788053599 >> 172.21.15.78:0/2788053599 conn(0x7f479c092330 msgr2=0x7f479c0c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 -- 172.21.15.78:0/2788053599 shutdown_connections 2023-08-17T18:12:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.437+0000 7f47a3e9d700 1 -- 172.21.15.78:0/2788053599 wait complete. 2023-08-17T18:12:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T18:12:22.448 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T18:12:22.182396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2435556,"kb_used_data":17828,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752539164,"statfs":{"total":773094113280,"available":770600103936,"internally_reserved":0,"allocated":18255872,"data_stored":9155393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27323,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-76,"num_write_kb":-58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.587192"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145366+0000","last_change":"2023-08-17T18:12:19.145366+0000","last_active":"2023-08-17T18:12:19.145366+0000","last_peered":"2023-08-17T18:12:19.145366+0000","last_clean":"2023-08-17T18:12:19.145366+0000","last_became_active":"2023-08-17T18:12:19.144926+0000","last_became_peered":"2023-08-17T18:12:19.144926+0000","last_unstale":"2023-08-17T18:12:19.145366+0000","last_undegraded":"2023-08-17T18:12:19.145366+0000","last_fullsized":"2023-08-17T18:12:19.145366+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"184'3","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146491+0000","last_change":"2023-08-17T18:12:18.779324+0000","last_active":"2023-08-17T18:12:19.146491+0000","last_peered":"2023-08-17T18:12:19.146491+0000","last_clean":"2023-08-17T18:12:19.146491+0000","last_became_active":"2023-08-17T18:12:18.778475+0000","last_became_peered":"2023-08-17T18:12:18.778475+0000","last_unstale":"2023-08-17T18:12:19.146491+0000","last_undegraded":"2023-08-17T18:12:19.146491+0000","last_fullsized":"2023-08-17T18:12:19.146491+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.156214+0000","last_change":"2023-08-17T18:12:19.156214+0000","last_active":"2023-08-17T18:12:19.156214+0000","last_peered":"2023-08-17T18:12:19.156214+0000","last_clean":"2023-08-17T18:12:19.156214+0000","last_became_active":"2023-08-17T18:12:19.155743+0000","last_became_peered":"2023-08-17T18:12:19.155743+0000","last_unstale":"2023-08-17T18:12:19.156214+0000","last_undegraded":"2023-08-17T18:12:19.156214+0000","last_fullsized":"2023-08-17T18:12:19.156214+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.779938+0000","last_change":"2023-08-17T18:12:18.778282+0000","last_active":"2023-08-17T18:12:18.779938+0000","last_peered":"2023-08-17T18:12:18.779938+0000","last_clean":"2023-08-17T18:12:18.779938+0000","last_became_active":"2023-08-17T18:12:18.777985+0000","last_became_peered":"2023-08-17T18:12:18.777985+0000","last_unstale":"2023-08-17T18:12:18.779938+0000","last_undegraded":"2023-08-17T18:12:18.779938+0000","last_fullsized":"2023-08-17T18:12:18.779938+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.154963+0000","last_change":"2023-08-17T18:12:19.154963+0000","last_active":"2023-08-17T18:12:19.154963+0000","last_peered":"2023-08-17T18:12:19.154963+0000","last_clean":"2023-08-17T18:12:19.154963+0000","last_became_active":"2023-08-17T18:12:19.154689+0000","last_became_peered":"2023-08-17T18:12:19.154689+0000","last_unstale":"2023-08-17T18:12:19.154963+0000","last_undegraded":"2023-08-17T18:12:19.154963+0000","last_fullsized":"2023-08-17T18:12:19.154963+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781462+0000","last_change":"2023-08-17T18:12:18.777105+0000","last_active":"2023-08-17T18:12:18.781462+0000","last_peered":"2023-08-17T18:12:18.781462+0000","last_clean":"2023-08-17T18:12:18.781462+0000","last_became_active":"2023-08-17T18:12:18.776359+0000","last_became_peered":"2023-08-17T18:12:18.776359+0000","last_unstale":"2023-08-17T18:12:18.781462+0000","last_undegraded":"2023-08-17T18:12:18.781462+0000","last_fullsized":"2023-08-17T18:12:18.781462+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149644+0000","last_change":"2023-08-17T18:12:19.149644+0000","last_active":"2023-08-17T18:12:19.149644+0000","last_peered":"2023-08-17T18:12:19.149644+0000","last_clean":"2023-08-17T18:12:19.149644+0000","last_became_active":"2023-08-17T18:12:19.149366+0000","last_became_peered":"2023-08-17T18:12:19.149366+0000","last_unstale":"2023-08-17T18:12:19.149644+0000","last_undegraded":"2023-08-17T18:12:19.149644+0000","last_fullsized":"2023-08-17T18:12:19.149644+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"184'2","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155391+0000","last_change":"2023-08-17T18:12:18.778800+0000","last_active":"2023-08-17T18:12:19.155391+0000","last_peered":"2023-08-17T18:12:19.155391+0000","last_clean":"2023-08-17T18:12:19.155391+0000","last_became_active":"2023-08-17T18:12:18.778531+0000","last_became_peered":"2023-08-17T18:12:18.778531+0000","last_unstale":"2023-08-17T18:12:19.155391+0000","last_undegraded":"2023-08-17T18:12:19.155391+0000","last_fullsized":"2023-08-17T18:12:19.155391+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.148279+0000","last_change":"2023-08-17T18:12:19.148279+0000","last_active":"2023-08-17T18:12:19.148279+0000","last_peered":"2023-08-17T18:12:19.148279+0000","last_clean":"2023-08-17T18:12:19.148279+0000","last_became_active":"2023-08-17T18:12:19.147975+0000","last_became_peered":"2023-08-17T18:12:19.147975+0000","last_unstale":"2023-08-17T18:12:19.148279+0000","last_undegraded":"2023-08-17T18:12:19.148279+0000","last_fullsized":"2023-08-17T18:12:19.148279+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.139881+0000","last_change":"2023-08-17T18:12:18.773218+0000","last_active":"2023-08-17T18:12:19.139881+0000","last_peered":"2023-08-17T18:12:19.139881+0000","last_clean":"2023-08-17T18:12:19.139881+0000","last_became_active":"2023-08-17T18:12:18.772720+0000","last_became_peered":"2023-08-17T18:12:18.772720+0000","last_unstale":"2023-08-17T18:12:19.139881+0000","last_undegraded":"2023-08-17T18:12:19.139881+0000","last_fullsized":"2023-08-17T18:12:19.139881+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155239+0000","last_change":"2023-08-17T18:12:19.155239+0000","last_active":"2023-08-17T18:12:19.155239+0000","last_peered":"2023-08-17T18:12:19.155239+0000","last_clean":"2023-08-17T18:12:19.155239+0000","last_became_active":"2023-08-17T18:12:19.154948+0000","last_became_peered":"2023-08-17T18:12:19.154948+0000","last_unstale":"2023-08-17T18:12:19.155239+0000","last_undegraded":"2023-08-17T18:12:19.155239+0000","last_fullsized":"2023-08-17T18:12:19.155239+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.128337+0000","last_change":"2023-08-17T18:12:18.782989+0000","last_active":"2023-08-17T18:12:19.128337+0000","last_peered":"2023-08-17T18:12:19.128337+0000","last_clean":"2023-08-17T18:12:19.128337+0000","last_became_active":"2023-08-17T18:12:18.782492+0000","last_became_peered":"2023-08-17T18:12:18.782492+0000","last_unstale":"2023-08-17T18:12:19.128337+0000","last_undegraded":"2023-08-17T18:12:19.128337+0000","last_fullsized":"2023-08-17T18:12:19.128337+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142783+0000","last_change":"2023-08-17T18:12:19.142783+0000","last_active":"2023-08-17T18:12:19.142783+0000","last_peered":"2023-08-17T18:12:19.142783+0000","last_clean":"2023-08-17T18:12:19.142783+0000","last_became_active":"2023-08-17T18:12:19.142524+0000","last_became_peered":"2023-08-17T18:12:19.142524+0000","last_unstale":"2023-08-17T18:12:19.142783+0000","last_undegraded":"2023-08-17T18:12:19.142783+0000","last_fullsized":"2023-08-17T18:12:19.142783+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.780120+0000","last_change":"2023-08-17T18:12:18.774036+0000","last_active":"2023-08-17T18:12:18.780120+0000","last_peered":"2023-08-17T18:12:18.780120+0000","last_clean":"2023-08-17T18:12:18.780120+0000","last_became_active":"2023-08-17T18:12:18.773760+0000","last_became_peered":"2023-08-17T18:12:18.773760+0000","last_unstale":"2023-08-17T18:12:18.780120+0000","last_undegraded":"2023-08-17T18:12:18.780120+0000","last_fullsized":"2023-08-17T18:12:18.780120+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147649+0000","last_change":"2023-08-17T18:12:19.147649+0000","last_active":"2023-08-17T18:12:19.147649+0000","last_peered":"2023-08-17T18:12:19.147649+0000","last_clean":"2023-08-17T18:12:19.147649+0000","last_became_active":"2023-08-17T18:12:19.147470+0000","last_became_peered":"2023-08-17T18:12:19.147470+0000","last_unstale":"2023-08-17T18:12:19.147649+0000","last_undegraded":"2023-08-17T18:12:19.147649+0000","last_fullsized":"2023-08-17T18:12:19.147649+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775345+0000","last_change":"2023-08-17T18:12:18.772770+0000","last_active":"2023-08-17T18:12:18.775345+0000","last_peered":"2023-08-17T18:12:18.775345+0000","last_clean":"2023-08-17T18:12:18.775345+0000","last_became_active":"2023-08-17T18:12:18.772480+0000","last_became_peered":"2023-08-17T18:12:18.772480+0000","last_unstale":"2023-08-17T18:12:18.775345+0000","last_undegraded":"2023-08-17T18:12:18.775345+0000","last_fullsized":"2023-08-17T18:12:18.775345+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142263+0000","last_change":"2023-08-17T18:12:19.142263+0000","last_active":"2023-08-17T18:12:19.142263+0000","last_peered":"2023-08-17T18:12:19.142263+0000","last_clean":"2023-08-17T18:12:19.142263+0000","last_became_active":"2023-08-17T18:12:19.141793+0000","last_became_peered":"2023-08-17T18:12:19.141793+0000","last_unstale":"2023-08-17T18:12:19.142263+0000","last_undegraded":"2023-08-17T18:12:19.142263+0000","last_fullsized":"2023-08-17T18:12:19.142263+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775587+0000","last_change":"2023-08-17T18:12:18.773804+0000","last_active":"2023-08-17T18:12:18.775587+0000","last_peered":"2023-08-17T18:12:18.775587+0000","last_clean":"2023-08-17T18:12:18.775587+0000","last_became_active":"2023-08-17T18:12:18.773534+0000","last_became_peered":"2023-08-17T18:12:18.773534+0000","last_unstale":"2023-08-17T18:12:18.775587+0000","last_undegraded":"2023-08-17T18:12:18.775587+0000","last_fullsized":"2023-08-17T18:12:18.775587+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146461+0000","last_change":"2023-08-17T18:12:19.146461+0000","last_active":"2023-08-17T18:12:19.146461+0000","last_peered":"2023-08-17T18:12:19.146461+0000","last_clean":"2023-08-17T18:12:19.146461+0000","last_became_active":"2023-08-17T18:12:19.146185+0000","last_became_peered":"2023-08-17T18:12:19.146185+0000","last_unstale":"2023-08-17T18:12:19.146461+0000","last_undegraded":"2023-08-17T18:12:19.146461+0000","last_fullsized":"2023-08-17T18:12:19.146461+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.789178+0000","last_change":"2023-08-17T18:12:18.788038+0000","last_active":"2023-08-17T18:12:18.789178+0000","last_peered":"2023-08-17T18:12:18.789178+0000","last_clean":"2023-08-17T18:12:18.789178+0000","last_became_active":"2023-08-17T18:12:18.787783+0000","last_became_peered":"2023-08-17T18:12:18.787783+0000","last_unstale":"2023-08-17T18:12:18.789178+0000","last_undegraded":"2023-08-17T18:12:18.789178+0000","last_fullsized":"2023-08-17T18:12:18.789178+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147662+0000","last_change":"2023-08-17T18:12:19.147662+0000","last_active":"2023-08-17T18:12:19.147662+0000","last_peered":"2023-08-17T18:12:19.147662+0000","last_clean":"2023-08-17T18:12:19.147662+0000","last_became_active":"2023-08-17T18:12:19.147394+0000","last_became_peered":"2023-08-17T18:12:19.147394+0000","last_unstale":"2023-08-17T18:12:19.147662+0000","last_undegraded":"2023-08-17T18:12:19.147662+0000","last_fullsized":"2023-08-17T18:12:19.147662+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775504+0000","last_change":"2023-08-17T18:12:18.772890+0000","last_active":"2023-08-17T18:12:18.775504+0000","last_peered":"2023-08-17T18:12:18.775504+0000","last_clean":"2023-08-17T18:12:18.775504+0000","last_became_active":"2023-08-17T18:12:18.772542+0000","last_became_peered":"2023-08-17T18:12:18.772542+0000","last_unstale":"2023-08-17T18:12:18.775504+0000","last_undegraded":"2023-08-17T18:12:18.775504+0000","last_fullsized":"2023-08-17T18:12:18.775504+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.148971+0000","last_change":"2023-08-17T18:12:19.148971+0000","last_active":"2023-08-17T18:12:19.148971+0000","last_peered":"2023-08-17T18:12:19.148971+0000","last_clean":"2023-08-17T18:12:19.148971+0000","last_became_active":"2023-08-17T18:12:19.148682+0000","last_became_peered":"2023-08-17T18:12:19.148682+0000","last_unstale":"2023-08-17T18:12:19.148971+0000","last_undegraded":"2023-08-17T18:12:19.148971+0000","last_fullsized":"2023-08-17T18:12:19.148971+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"184'4","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.151982+0000","last_change":"2023-08-17T18:12:18.778268+0000","last_active":"2023-08-17T18:12:19.151982+0000","last_peered":"2023-08-17T18:12:19.151982+0000","last_clean":"2023-08-17T18:12:19.151982+0000","last_became_active":"2023-08-17T18:12:18.777987+0000","last_became_peered":"2023-08-17T18:12:18.777987+0000","last_unstale":"2023-08-17T18:12:19.151982+0000","last_undegraded":"2023-08-17T18:12:19.151982+0000","last_fullsized":"2023-08-17T18:12:19.151982+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147508+0000","last_change":"2023-08-17T18:12:19.147508+0000","last_active":"2023-08-17T18:12:19.147508+0000","last_peered":"2023-08-17T18:12:19.147508+0000","last_clean":"2023-08-17T18:12:19.147508+0000","last_became_active":"2023-08-17T18:12:19.147208+0000","last_became_peered":"2023-08-17T18:12:19.147208+0000","last_unstale":"2023-08-17T18:12:19.147508+0000","last_undegraded":"2023-08-17T18:12:19.147508+0000","last_fullsized":"2023-08-17T18:12:19.147508+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.131766+0000","last_change":"2023-08-17T18:12:18.769897+0000","last_active":"2023-08-17T18:12:19.131766+0000","last_peered":"2023-08-17T18:12:19.131766+0000","last_clean":"2023-08-17T18:12:19.131766+0000","last_became_active":"2023-08-17T18:12:18.769566+0000","last_became_peered":"2023-08-17T18:12:18.769566+0000","last_unstale":"2023-08-17T18:12:19.131766+0000","last_undegraded":"2023-08-17T18:12:19.131766+0000","last_fullsized":"2023-08-17T18:12:19.131766+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146485+0000","last_change":"2023-08-17T18:12:19.146485+0000","last_active":"2023-08-17T18:12:19.146485+0000","last_peered":"2023-08-17T18:12:19.146485+0000","last_clean":"2023-08-17T18:12:19.146485+0000","last_became_active":"2023-08-17T18:12:19.145999+0000","last_became_peered":"2023-08-17T18:12:19.145999+0000","last_unstale":"2023-08-17T18:12:19.146485+0000","last_undegraded":"2023-08-17T18:12:19.146485+0000","last_fullsized":"2023-08-17T18:12:19.146485+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.777786+0000","last_change":"2023-08-17T18:12:18.774093+0000","last_active":"2023-08-17T18:12:18.777786+0000","last_peered":"2023-08-17T18:12:18.777786+0000","last_clean":"2023-08-17T18:12:18.777786+0000","last_became_active":"2023-08-17T18:12:18.773651+0000","last_became_peered":"2023-08-17T18:12:18.773651+0000","last_unstale":"2023-08-17T18:12:18.777786+0000","last_undegraded":"2023-08-17T18:12:18.777786+0000","last_fullsized":"2023-08-17T18:12:18.777786+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146342+0000","last_change":"2023-08-17T18:12:19.146342+0000","last_active":"2023-08-17T18:12:19.146342+0000","last_peered":"2023-08-17T18:12:19.146342+0000","last_clean":"2023-08-17T18:12:19.146342+0000","last_became_active":"2023-08-17T18:12:19.145188+0000","last_became_peered":"2023-08-17T18:12:19.145188+0000","last_unstale":"2023-08-17T18:12:19.146342+0000","last_undegraded":"2023-08-17T18:12:19.146342+0000","last_fullsized":"2023-08-17T18:12:19.146342+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.784394+0000","last_change":"2023-08-17T18:12:18.783333+0000","last_active":"2023-08-17T18:12:18.784394+0000","last_peered":"2023-08-17T18:12:18.784394+0000","last_clean":"2023-08-17T18:12:18.784394+0000","last_became_active":"2023-08-17T18:12:18.783106+0000","last_became_peered":"2023-08-17T18:12:18.783106+0000","last_unstale":"2023-08-17T18:12:18.784394+0000","last_undegraded":"2023-08-17T18:12:18.784394+0000","last_fullsized":"2023-08-17T18:12:18.784394+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149104+0000","last_change":"2023-08-17T18:12:19.149104+0000","last_active":"2023-08-17T18:12:19.149104+0000","last_peered":"2023-08-17T18:12:19.149104+0000","last_clean":"2023-08-17T18:12:19.149104+0000","last_became_active":"2023-08-17T18:12:19.148825+0000","last_became_peered":"2023-08-17T18:12:19.148825+0000","last_unstale":"2023-08-17T18:12:19.149104+0000","last_undegraded":"2023-08-17T18:12:19.149104+0000","last_fullsized":"2023-08-17T18:12:19.149104+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"184'4","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.154569+0000","last_change":"2023-08-17T18:12:18.776961+0000","last_active":"2023-08-17T18:12:19.154569+0000","last_peered":"2023-08-17T18:12:19.154569+0000","last_clean":"2023-08-17T18:12:19.154569+0000","last_became_active":"2023-08-17T18:12:18.776581+0000","last_became_peered":"2023-08-17T18:12:18.776581+0000","last_unstale":"2023-08-17T18:12:19.154569+0000","last_undegraded":"2023-08-17T18:12:19.154569+0000","last_fullsized":"2023-08-17T18:12:19.154569+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147530+0000","last_change":"2023-08-17T18:12:19.147530+0000","last_active":"2023-08-17T18:12:19.147530+0000","last_peered":"2023-08-17T18:12:19.147530+0000","last_clean":"2023-08-17T18:12:19.147530+0000","last_became_active":"2023-08-17T18:12:19.147215+0000","last_became_peered":"2023-08-17T18:12:19.147215+0000","last_unstale":"2023-08-17T18:12:19.147530+0000","last_undegraded":"2023-08-17T18:12:19.147530+0000","last_fullsized":"2023-08-17T18:12:19.147530+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.778963+0000","last_change":"2023-08-17T18:12:18.773594+0000","last_active":"2023-08-17T18:12:18.778963+0000","last_peered":"2023-08-17T18:12:18.778963+0000","last_clean":"2023-08-17T18:12:18.778963+0000","last_became_active":"2023-08-17T18:12:18.773305+0000","last_became_peered":"2023-08-17T18:12:18.773305+0000","last_unstale":"2023-08-17T18:12:18.778963+0000","last_undegraded":"2023-08-17T18:12:18.778963+0000","last_fullsized":"2023-08-17T18:12:18.778963+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155836+0000","last_change":"2023-08-17T18:12:19.155836+0000","last_active":"2023-08-17T18:12:19.155836+0000","last_peered":"2023-08-17T18:12:19.155836+0000","last_clean":"2023-08-17T18:12:19.155836+0000","last_became_active":"2023-08-17T18:12:19.152942+0000","last_became_peered":"2023-08-17T18:12:19.152942+0000","last_unstale":"2023-08-17T18:12:19.155836+0000","last_undegraded":"2023-08-17T18:12:19.155836+0000","last_fullsized":"2023-08-17T18:12:19.155836+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.783515+0000","last_change":"2023-08-17T18:12:18.776084+0000","last_active":"2023-08-17T18:12:18.783515+0000","last_peered":"2023-08-17T18:12:18.783515+0000","last_clean":"2023-08-17T18:12:18.783515+0000","last_became_active":"2023-08-17T18:12:18.775824+0000","last_became_peered":"2023-08-17T18:12:18.775824+0000","last_unstale":"2023-08-17T18:12:18.783515+0000","last_undegraded":"2023-08-17T18:12:18.783515+0000","last_fullsized":"2023-08-17T18:12:18.783515+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155256+0000","last_change":"2023-08-17T18:12:19.155256+0000","last_active":"2023-08-17T18:12:19.155256+0000","last_peered":"2023-08-17T18:12:19.155256+0000","last_clean":"2023-08-17T18:12:19.155256+0000","last_became_active":"2023-08-17T18:12:19.154926+0000","last_became_peered":"2023-08-17T18:12:19.154926+0000","last_unstale":"2023-08-17T18:12:19.155256+0000","last_undegraded":"2023-08-17T18:12:19.155256+0000","last_fullsized":"2023-08-17T18:12:19.155256+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.128786+0000","last_change":"2023-08-17T18:12:18.777890+0000","last_active":"2023-08-17T18:12:19.128786+0000","last_peered":"2023-08-17T18:12:19.128786+0000","last_clean":"2023-08-17T18:12:19.128786+0000","last_became_active":"2023-08-17T18:12:18.777579+0000","last_became_peered":"2023-08-17T18:12:18.777579+0000","last_unstale":"2023-08-17T18:12:19.128786+0000","last_undegraded":"2023-08-17T18:12:19.128786+0000","last_fullsized":"2023-08-17T18:12:19.128786+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.148205+0000","last_change":"2023-08-17T18:12:19.148205+0000","last_active":"2023-08-17T18:12:19.148205+0000","last_peered":"2023-08-17T18:12:19.148205+0000","last_clean":"2023-08-17T18:12:19.148205+0000","last_became_active":"2023-08-17T18:12:19.147938+0000","last_became_peered":"2023-08-17T18:12:19.147938+0000","last_unstale":"2023-08-17T18:12:19.148205+0000","last_undegraded":"2023-08-17T18:12:19.148205+0000","last_fullsized":"2023-08-17T18:12:19.148205+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781520+0000","last_change":"2023-08-17T18:12:18.778445+0000","last_active":"2023-08-17T18:12:18.781520+0000","last_peered":"2023-08-17T18:12:18.781520+0000","last_clean":"2023-08-17T18:12:18.781520+0000","last_became_active":"2023-08-17T18:12:18.778177+0000","last_became_peered":"2023-08-17T18:12:18.778177+0000","last_unstale":"2023-08-17T18:12:18.781520+0000","last_undegraded":"2023-08-17T18:12:18.781520+0000","last_fullsized":"2023-08-17T18:12:18.781520+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.154897+0000","last_change":"2023-08-17T18:12:19.154897+0000","last_active":"2023-08-17T18:12:19.154897+0000","last_peered":"2023-08-17T18:12:19.154897+0000","last_clean":"2023-08-17T18:12:19.154897+0000","last_became_active":"2023-08-17T18:12:19.154637+0000","last_became_peered":"2023-08-17T18:12:19.154637+0000","last_unstale":"2023-08-17T18:12:19.154897+0000","last_undegraded":"2023-08-17T18:12:19.154897+0000","last_fullsized":"2023-08-17T18:12:19.154897+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.128640+0000","last_change":"2023-08-17T18:12:18.773696+0000","last_active":"2023-08-17T18:12:19.128640+0000","last_peered":"2023-08-17T18:12:19.128640+0000","last_clean":"2023-08-17T18:12:19.128640+0000","last_became_active":"2023-08-17T18:12:18.773420+0000","last_became_peered":"2023-08-17T18:12:18.773420+0000","last_unstale":"2023-08-17T18:12:19.128640+0000","last_undegraded":"2023-08-17T18:12:19.128640+0000","last_fullsized":"2023-08-17T18:12:19.128640+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155746+0000","last_change":"2023-08-17T18:12:19.155746+0000","last_active":"2023-08-17T18:12:19.155746+0000","last_peered":"2023-08-17T18:12:19.155746+0000","last_clean":"2023-08-17T18:12:19.155746+0000","last_became_active":"2023-08-17T18:12:19.155445+0000","last_became_peered":"2023-08-17T18:12:19.155445+0000","last_unstale":"2023-08-17T18:12:19.155746+0000","last_undegraded":"2023-08-17T18:12:19.155746+0000","last_fullsized":"2023-08-17T18:12:19.155746+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.783110+0000","last_change":"2023-08-17T18:12:18.782576+0000","last_active":"2023-08-17T18:12:18.783110+0000","last_peered":"2023-08-17T18:12:18.783110+0000","last_clean":"2023-08-17T18:12:18.783110+0000","last_became_active":"2023-08-17T18:12:18.782364+0000","last_became_peered":"2023-08-17T18:12:18.782364+0000","last_unstale":"2023-08-17T18:12:18.783110+0000","last_undegraded":"2023-08-17T18:12:18.783110+0000","last_fullsized":"2023-08-17T18:12:18.783110+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.141183+0000","last_change":"2023-08-17T18:12:19.141183+0000","last_active":"2023-08-17T18:12:19.141183+0000","last_peered":"2023-08-17T18:12:19.141183+0000","last_clean":"2023-08-17T18:12:19.141183+0000","last_became_active":"2023-08-17T18:12:19.140901+0000","last_became_peered":"2023-08-17T18:12:19.140901+0000","last_unstale":"2023-08-17T18:12:19.141183+0000","last_undegraded":"2023-08-17T18:12:19.141183+0000","last_fullsized":"2023-08-17T18:12:19.141183+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775246+0000","last_change":"2023-08-17T18:12:18.771843+0000","last_active":"2023-08-17T18:12:18.775246+0000","last_peered":"2023-08-17T18:12:18.775246+0000","last_clean":"2023-08-17T18:12:18.775246+0000","last_became_active":"2023-08-17T18:12:18.771540+0000","last_became_peered":"2023-08-17T18:12:18.771540+0000","last_unstale":"2023-08-17T18:12:18.775246+0000","last_undegraded":"2023-08-17T18:12:18.775246+0000","last_fullsized":"2023-08-17T18:12:18.775246+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145835+0000","last_change":"2023-08-17T18:12:19.145835+0000","last_active":"2023-08-17T18:12:19.145835+0000","last_peered":"2023-08-17T18:12:19.145835+0000","last_clean":"2023-08-17T18:12:19.145835+0000","last_became_active":"2023-08-17T18:12:19.145565+0000","last_became_peered":"2023-08-17T18:12:19.145565+0000","last_unstale":"2023-08-17T18:12:19.145835+0000","last_undegraded":"2023-08-17T18:12:19.145835+0000","last_fullsized":"2023-08-17T18:12:19.145835+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.772855+0000","last_change":"2023-08-17T18:12:18.767885+0000","last_active":"2023-08-17T18:12:18.772855+0000","last_peered":"2023-08-17T18:12:18.772855+0000","last_clean":"2023-08-17T18:12:18.772855+0000","last_became_active":"2023-08-17T18:12:18.767549+0000","last_became_peered":"2023-08-17T18:12:18.767549+0000","last_unstale":"2023-08-17T18:12:18.772855+0000","last_undegraded":"2023-08-17T18:12:18.772855+0000","last_fullsized":"2023-08-17T18:12:18.772855+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145181+0000","last_change":"2023-08-17T18:12:19.145181+0000","last_active":"2023-08-17T18:12:19.145181+0000","last_peered":"2023-08-17T18:12:19.145181+0000","last_clean":"2023-08-17T18:12:19.145181+0000","last_became_active":"2023-08-17T18:12:19.144509+0000","last_became_peered":"2023-08-17T18:12:19.144509+0000","last_unstale":"2023-08-17T18:12:19.145181+0000","last_undegraded":"2023-08-17T18:12:19.145181+0000","last_fullsized":"2023-08-17T18:12:19.145181+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781428+0000","last_change":"2023-08-17T18:12:18.776768+0000","last_active":"2023-08-17T18:12:18.781428+0000","last_peered":"2023-08-17T18:12:18.781428+0000","last_clean":"2023-08-17T18:12:18.781428+0000","last_became_active":"2023-08-17T18:12:18.776477+0000","last_became_peered":"2023-08-17T18:12:18.776477+0000","last_unstale":"2023-08-17T18:12:18.781428+0000","last_undegraded":"2023-08-17T18:12:18.781428+0000","last_fullsized":"2023-08-17T18:12:18.781428+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155037+0000","last_change":"2023-08-17T18:12:19.155037+0000","last_active":"2023-08-17T18:12:19.155037+0000","last_peered":"2023-08-17T18:12:19.155037+0000","last_clean":"2023-08-17T18:12:19.155037+0000","last_became_active":"2023-08-17T18:12:19.154790+0000","last_became_peered":"2023-08-17T18:12:19.154790+0000","last_unstale":"2023-08-17T18:12:19.155037+0000","last_undegraded":"2023-08-17T18:12:19.155037+0000","last_fullsized":"2023-08-17T18:12:19.155037+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.786307+0000","last_change":"2023-08-17T18:12:18.782761+0000","last_active":"2023-08-17T18:12:18.786307+0000","last_peered":"2023-08-17T18:12:18.786307+0000","last_clean":"2023-08-17T18:12:18.786307+0000","last_became_active":"2023-08-17T18:12:18.782500+0000","last_became_peered":"2023-08-17T18:12:18.782500+0000","last_unstale":"2023-08-17T18:12:18.786307+0000","last_undegraded":"2023-08-17T18:12:18.786307+0000","last_fullsized":"2023-08-17T18:12:18.786307+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155263+0000","last_change":"2023-08-17T18:12:19.155263+0000","last_active":"2023-08-17T18:12:19.155263+0000","last_peered":"2023-08-17T18:12:19.155263+0000","last_clean":"2023-08-17T18:12:19.155263+0000","last_became_active":"2023-08-17T18:12:19.154940+0000","last_became_peered":"2023-08-17T18:12:19.154940+0000","last_unstale":"2023-08-17T18:12:19.155263+0000","last_undegraded":"2023-08-17T18:12:19.155263+0000","last_fullsized":"2023-08-17T18:12:19.155263+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781485+0000","last_change":"2023-08-17T18:12:18.777312+0000","last_active":"2023-08-17T18:12:18.781485+0000","last_peered":"2023-08-17T18:12:18.781485+0000","last_clean":"2023-08-17T18:12:18.781485+0000","last_became_active":"2023-08-17T18:12:18.776714+0000","last_became_peered":"2023-08-17T18:12:18.776714+0000","last_unstale":"2023-08-17T18:12:18.781485+0000","last_undegraded":"2023-08-17T18:12:18.781485+0000","last_fullsized":"2023-08-17T18:12:18.781485+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147308+0000","last_change":"2023-08-17T18:12:19.147308+0000","last_active":"2023-08-17T18:12:19.147308+0000","last_peered":"2023-08-17T18:12:19.147308+0000","last_clean":"2023-08-17T18:12:19.147308+0000","last_became_active":"2023-08-17T18:12:19.147046+0000","last_became_peered":"2023-08-17T18:12:19.147046+0000","last_unstale":"2023-08-17T18:12:19.147308+0000","last_undegraded":"2023-08-17T18:12:19.147308+0000","last_fullsized":"2023-08-17T18:12:19.147308+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.785960+0000","last_change":"2023-08-17T18:12:18.778031+0000","last_active":"2023-08-17T18:12:18.785960+0000","last_peered":"2023-08-17T18:12:18.785960+0000","last_clean":"2023-08-17T18:12:18.785960+0000","last_became_active":"2023-08-17T18:12:18.775302+0000","last_became_peered":"2023-08-17T18:12:18.775302+0000","last_unstale":"2023-08-17T18:12:18.785960+0000","last_undegraded":"2023-08-17T18:12:18.785960+0000","last_fullsized":"2023-08-17T18:12:18.785960+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155819+0000","last_change":"2023-08-17T18:12:19.155819+0000","last_active":"2023-08-17T18:12:19.155819+0000","last_peered":"2023-08-17T18:12:19.155819+0000","last_clean":"2023-08-17T18:12:19.155819+0000","last_became_active":"2023-08-17T18:12:19.155494+0000","last_became_peered":"2023-08-17T18:12:19.155494+0000","last_unstale":"2023-08-17T18:12:19.155819+0000","last_undegraded":"2023-08-17T18:12:19.155819+0000","last_fullsized":"2023-08-17T18:12:19.155819+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781378+0000","last_change":"2023-08-17T18:12:18.775382+0000","last_active":"2023-08-17T18:12:18.781378+0000","last_peered":"2023-08-17T18:12:18.781378+0000","last_clean":"2023-08-17T18:12:18.781378+0000","last_became_active":"2023-08-17T18:12:18.774892+0000","last_became_peered":"2023-08-17T18:12:18.774892+0000","last_unstale":"2023-08-17T18:12:18.781378+0000","last_undegraded":"2023-08-17T18:12:18.781378+0000","last_fullsized":"2023-08-17T18:12:18.781378+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.152334+0000","last_change":"2023-08-17T18:12:19.152334+0000","last_active":"2023-08-17T18:12:19.152334+0000","last_peered":"2023-08-17T18:12:19.152334+0000","last_clean":"2023-08-17T18:12:19.152334+0000","last_became_active":"2023-08-17T18:12:19.152074+0000","last_became_peered":"2023-08-17T18:12:19.152074+0000","last_unstale":"2023-08-17T18:12:19.152334+0000","last_undegraded":"2023-08-17T18:12:19.152334+0000","last_fullsized":"2023-08-17T18:12:19.152334+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.777400+0000","last_change":"2023-08-17T18:12:18.773638+0000","last_active":"2023-08-17T18:12:18.777400+0000","last_peered":"2023-08-17T18:12:18.777400+0000","last_clean":"2023-08-17T18:12:18.777400+0000","last_became_active":"2023-08-17T18:12:18.773368+0000","last_became_peered":"2023-08-17T18:12:18.773368+0000","last_unstale":"2023-08-17T18:12:18.777400+0000","last_undegraded":"2023-08-17T18:12:18.777400+0000","last_fullsized":"2023-08-17T18:12:18.777400+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.151272+0000","last_change":"2023-08-17T18:12:19.151272+0000","last_active":"2023-08-17T18:12:19.151272+0000","last_peered":"2023-08-17T18:12:19.151272+0000","last_clean":"2023-08-17T18:12:19.151272+0000","last_became_active":"2023-08-17T18:12:19.150980+0000","last_became_peered":"2023-08-17T18:12:19.150980+0000","last_unstale":"2023-08-17T18:12:19.151272+0000","last_undegraded":"2023-08-17T18:12:19.151272+0000","last_fullsized":"2023-08-17T18:12:19.151272+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775802+0000","last_change":"2023-08-17T18:12:18.770183+0000","last_active":"2023-08-17T18:12:18.775802+0000","last_peered":"2023-08-17T18:12:18.775802+0000","last_clean":"2023-08-17T18:12:18.775802+0000","last_became_active":"2023-08-17T18:12:18.769889+0000","last_became_peered":"2023-08-17T18:12:18.769889+0000","last_unstale":"2023-08-17T18:12:18.775802+0000","last_undegraded":"2023-08-17T18:12:18.775802+0000","last_fullsized":"2023-08-17T18:12:18.775802+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145959+0000","last_change":"2023-08-17T18:12:19.145959+0000","last_active":"2023-08-17T18:12:19.145959+0000","last_peered":"2023-08-17T18:12:19.145959+0000","last_clean":"2023-08-17T18:12:19.145959+0000","last_became_active":"2023-08-17T18:12:19.145689+0000","last_became_peered":"2023-08-17T18:12:19.145689+0000","last_unstale":"2023-08-17T18:12:19.145959+0000","last_undegraded":"2023-08-17T18:12:19.145959+0000","last_fullsized":"2023-08-17T18:12:19.145959+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.777605+0000","last_change":"2023-08-17T18:12:18.769174+0000","last_active":"2023-08-17T18:12:18.777605+0000","last_peered":"2023-08-17T18:12:18.777605+0000","last_clean":"2023-08-17T18:12:18.777605+0000","last_became_active":"2023-08-17T18:12:18.768886+0000","last_became_peered":"2023-08-17T18:12:18.768886+0000","last_unstale":"2023-08-17T18:12:18.777605+0000","last_undegraded":"2023-08-17T18:12:18.777605+0000","last_fullsized":"2023-08-17T18:12:18.777605+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142837+0000","last_change":"2023-08-17T18:12:19.142837+0000","last_active":"2023-08-17T18:12:19.142837+0000","last_peered":"2023-08-17T18:12:19.142837+0000","last_clean":"2023-08-17T18:12:19.142837+0000","last_became_active":"2023-08-17T18:12:19.142374+0000","last_became_peered":"2023-08-17T18:12:19.142374+0000","last_unstale":"2023-08-17T18:12:19.142837+0000","last_undegraded":"2023-08-17T18:12:19.142837+0000","last_fullsized":"2023-08-17T18:12:19.142837+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142334+0000","last_change":"2023-08-17T18:12:18.776978+0000","last_active":"2023-08-17T18:12:19.142334+0000","last_peered":"2023-08-17T18:12:19.142334+0000","last_clean":"2023-08-17T18:12:19.142334+0000","last_became_active":"2023-08-17T18:12:18.776707+0000","last_became_peered":"2023-08-17T18:12:18.776707+0000","last_unstale":"2023-08-17T18:12:19.142334+0000","last_undegraded":"2023-08-17T18:12:19.142334+0000","last_fullsized":"2023-08-17T18:12:19.142334+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149983+0000","last_change":"2023-08-17T18:12:19.149983+0000","last_active":"2023-08-17T18:12:19.149983+0000","last_peered":"2023-08-17T18:12:19.149983+0000","last_clean":"2023-08-17T18:12:19.149983+0000","last_became_active":"2023-08-17T18:12:19.149726+0000","last_became_peered":"2023-08-17T18:12:19.149726+0000","last_unstale":"2023-08-17T18:12:19.149983+0000","last_undegraded":"2023-08-17T18:12:19.149983+0000","last_fullsized":"2023-08-17T18:12:19.149983+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.133978+0000","last_change":"2023-08-17T18:12:18.782730+0000","last_active":"2023-08-17T18:12:19.133978+0000","last_peered":"2023-08-17T18:12:19.133978+0000","last_clean":"2023-08-17T18:12:19.133978+0000","last_became_active":"2023-08-17T18:12:18.782459+0000","last_became_peered":"2023-08-17T18:12:18.782459+0000","last_unstale":"2023-08-17T18:12:19.133978+0000","last_undegraded":"2023-08-17T18:12:19.133978+0000","last_fullsized":"2023-08-17T18:12:19.133978+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142802+0000","last_change":"2023-08-17T18:12:19.142802+0000","last_active":"2023-08-17T18:12:19.142802+0000","last_peered":"2023-08-17T18:12:19.142802+0000","last_clean":"2023-08-17T18:12:19.142802+0000","last_became_active":"2023-08-17T18:12:19.142134+0000","last_became_peered":"2023-08-17T18:12:19.142134+0000","last_unstale":"2023-08-17T18:12:19.142802+0000","last_undegraded":"2023-08-17T18:12:19.142802+0000","last_fullsized":"2023-08-17T18:12:19.142802+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"184'2","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.152493+0000","last_change":"2023-08-17T18:12:18.769247+0000","last_active":"2023-08-17T18:12:19.152493+0000","last_peered":"2023-08-17T18:12:19.152493+0000","last_clean":"2023-08-17T18:12:19.152493+0000","last_became_active":"2023-08-17T18:12:18.768965+0000","last_became_peered":"2023-08-17T18:12:18.768965+0000","last_unstale":"2023-08-17T18:12:19.152493+0000","last_undegraded":"2023-08-17T18:12:19.152493+0000","last_fullsized":"2023-08-17T18:12:19.152493+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.144024+0000","last_change":"2023-08-17T18:12:19.144024+0000","last_active":"2023-08-17T18:12:19.144024+0000","last_peered":"2023-08-17T18:12:19.144024+0000","last_clean":"2023-08-17T18:12:19.144024+0000","last_became_active":"2023-08-17T18:12:19.143823+0000","last_became_peered":"2023-08-17T18:12:19.143823+0000","last_unstale":"2023-08-17T18:12:19.144024+0000","last_undegraded":"2023-08-17T18:12:19.144024+0000","last_fullsized":"2023-08-17T18:12:19.144024+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.779458+0000","last_change":"2023-08-17T18:12:18.777332+0000","last_active":"2023-08-17T18:12:18.779458+0000","last_peered":"2023-08-17T18:12:18.779458+0000","last_clean":"2023-08-17T18:12:18.779458+0000","last_became_active":"2023-08-17T18:12:18.777053+0000","last_became_peered":"2023-08-17T18:12:18.777053+0000","last_unstale":"2023-08-17T18:12:18.779458+0000","last_undegraded":"2023-08-17T18:12:18.779458+0000","last_fullsized":"2023-08-17T18:12:18.779458+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149260+0000","last_change":"2023-08-17T18:12:19.149260+0000","last_active":"2023-08-17T18:12:19.149260+0000","last_peered":"2023-08-17T18:12:19.149260+0000","last_clean":"2023-08-17T18:12:19.149260+0000","last_became_active":"2023-08-17T18:12:19.148867+0000","last_became_peered":"2023-08-17T18:12:19.148867+0000","last_unstale":"2023-08-17T18:12:19.149260+0000","last_undegraded":"2023-08-17T18:12:19.149260+0000","last_fullsized":"2023-08-17T18:12:19.149260+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.786063+0000","last_change":"2023-08-17T18:12:18.780577+0000","last_active":"2023-08-17T18:12:18.786063+0000","last_peered":"2023-08-17T18:12:18.786063+0000","last_clean":"2023-08-17T18:12:18.786063+0000","last_became_active":"2023-08-17T18:12:18.780277+0000","last_became_peered":"2023-08-17T18:12:18.780277+0000","last_unstale":"2023-08-17T18:12:18.786063+0000","last_undegraded":"2023-08-17T18:12:18.786063+0000","last_fullsized":"2023-08-17T18:12:18.786063+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.141698+0000","last_change":"2023-08-17T18:12:19.141698+0000","last_active":"2023-08-17T18:12:19.141698+0000","last_peered":"2023-08-17T18:12:19.141698+0000","last_clean":"2023-08-17T18:12:19.141698+0000","last_became_active":"2023-08-17T18:12:19.141446+0000","last_became_peered":"2023-08-17T18:12:19.141446+0000","last_unstale":"2023-08-17T18:12:19.141698+0000","last_undegraded":"2023-08-17T18:12:19.141698+0000","last_fullsized":"2023-08-17T18:12:19.141698+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.780811+0000","last_change":"2023-08-17T18:12:18.777298+0000","last_active":"2023-08-17T18:12:18.780811+0000","last_peered":"2023-08-17T18:12:18.780811+0000","last_clean":"2023-08-17T18:12:18.780811+0000","last_became_active":"2023-08-17T18:12:18.776872+0000","last_became_peered":"2023-08-17T18:12:18.776872+0000","last_unstale":"2023-08-17T18:12:18.780811+0000","last_undegraded":"2023-08-17T18:12:18.780811+0000","last_fullsized":"2023-08-17T18:12:18.780811+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.150236+0000","last_change":"2023-08-17T18:12:19.150236+0000","last_active":"2023-08-17T18:12:19.150236+0000","last_peered":"2023-08-17T18:12:19.150236+0000","last_clean":"2023-08-17T18:12:19.150236+0000","last_became_active":"2023-08-17T18:12:19.149898+0000","last_became_peered":"2023-08-17T18:12:19.149898+0000","last_unstale":"2023-08-17T18:12:19.150236+0000","last_undegraded":"2023-08-17T18:12:19.150236+0000","last_fullsized":"2023-08-17T18:12:19.150236+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775262+0000","last_change":"2023-08-17T18:12:18.772539+0000","last_active":"2023-08-17T18:12:18.775262+0000","last_peered":"2023-08-17T18:12:18.775262+0000","last_clean":"2023-08-17T18:12:18.775262+0000","last_became_active":"2023-08-17T18:12:18.772099+0000","last_became_peered":"2023-08-17T18:12:18.772099+0000","last_unstale":"2023-08-17T18:12:18.775262+0000","last_undegraded":"2023-08-17T18:12:18.775262+0000","last_fullsized":"2023-08-17T18:12:18.775262+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.147612+0000","last_change":"2023-08-17T18:12:19.147612+0000","last_active":"2023-08-17T18:12:19.147612+0000","last_peered":"2023-08-17T18:12:19.147612+0000","last_clean":"2023-08-17T18:12:19.147612+0000","last_became_active":"2023-08-17T18:12:19.147245+0000","last_became_peered":"2023-08-17T18:12:19.147245+0000","last_unstale":"2023-08-17T18:12:19.147612+0000","last_undegraded":"2023-08-17T18:12:19.147612+0000","last_fullsized":"2023-08-17T18:12:19.147612+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.785888+0000","last_change":"2023-08-17T18:12:18.774276+0000","last_active":"2023-08-17T18:12:18.785888+0000","last_peered":"2023-08-17T18:12:18.785888+0000","last_clean":"2023-08-17T18:12:18.785888+0000","last_became_active":"2023-08-17T18:12:18.774015+0000","last_became_peered":"2023-08-17T18:12:18.774015+0000","last_unstale":"2023-08-17T18:12:18.785888+0000","last_undegraded":"2023-08-17T18:12:18.785888+0000","last_fullsized":"2023-08-17T18:12:18.785888+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142064+0000","last_change":"2023-08-17T18:12:19.142064+0000","last_active":"2023-08-17T18:12:19.142064+0000","last_peered":"2023-08-17T18:12:19.142064+0000","last_clean":"2023-08-17T18:12:19.142064+0000","last_became_active":"2023-08-17T18:12:19.141438+0000","last_became_peered":"2023-08-17T18:12:19.141438+0000","last_unstale":"2023-08-17T18:12:19.142064+0000","last_undegraded":"2023-08-17T18:12:19.142064+0000","last_fullsized":"2023-08-17T18:12:19.142064+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.137525+0000","last_change":"2023-08-17T18:12:18.774546+0000","last_active":"2023-08-17T18:12:19.137525+0000","last_peered":"2023-08-17T18:12:19.137525+0000","last_clean":"2023-08-17T18:12:19.137525+0000","last_became_active":"2023-08-17T18:12:18.774270+0000","last_became_peered":"2023-08-17T18:12:18.774270+0000","last_unstale":"2023-08-17T18:12:19.137525+0000","last_undegraded":"2023-08-17T18:12:19.137525+0000","last_fullsized":"2023-08-17T18:12:19.137525+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149807+0000","last_change":"2023-08-17T18:12:19.149807+0000","last_active":"2023-08-17T18:12:19.149807+0000","last_peered":"2023-08-17T18:12:19.149807+0000","last_clean":"2023-08-17T18:12:19.149807+0000","last_became_active":"2023-08-17T18:12:19.148664+0000","last_became_peered":"2023-08-17T18:12:19.148664+0000","last_unstale":"2023-08-17T18:12:19.149807+0000","last_undegraded":"2023-08-17T18:12:19.149807+0000","last_fullsized":"2023-08-17T18:12:19.149807+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"184'2","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.152753+0000","last_change":"2023-08-17T18:12:18.775310+0000","last_active":"2023-08-17T18:12:19.152753+0000","last_peered":"2023-08-17T18:12:19.152753+0000","last_clean":"2023-08-17T18:12:19.152753+0000","last_became_active":"2023-08-17T18:12:18.775036+0000","last_became_peered":"2023-08-17T18:12:18.775036+0000","last_unstale":"2023-08-17T18:12:19.152753+0000","last_undegraded":"2023-08-17T18:12:19.152753+0000","last_fullsized":"2023-08-17T18:12:19.152753+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.139570+0000","last_change":"2023-08-17T18:12:19.139570+0000","last_active":"2023-08-17T18:12:19.139570+0000","last_peered":"2023-08-17T18:12:19.139570+0000","last_clean":"2023-08-17T18:12:19.139570+0000","last_became_active":"2023-08-17T18:12:19.139333+0000","last_became_peered":"2023-08-17T18:12:19.139333+0000","last_unstale":"2023-08-17T18:12:19.139570+0000","last_undegraded":"2023-08-17T18:12:19.139570+0000","last_fullsized":"2023-08-17T18:12:19.139570+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.780721+0000","last_change":"2023-08-17T18:12:18.777538+0000","last_active":"2023-08-17T18:12:18.780721+0000","last_peered":"2023-08-17T18:12:18.780721+0000","last_clean":"2023-08-17T18:12:18.780721+0000","last_became_active":"2023-08-17T18:12:18.777289+0000","last_became_peered":"2023-08-17T18:12:18.777289+0000","last_unstale":"2023-08-17T18:12:18.780721+0000","last_undegraded":"2023-08-17T18:12:18.780721+0000","last_fullsized":"2023-08-17T18:12:18.780721+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155345+0000","last_change":"2023-08-17T18:12:19.155345+0000","last_active":"2023-08-17T18:12:19.155345+0000","last_peered":"2023-08-17T18:12:19.155345+0000","last_clean":"2023-08-17T18:12:19.155345+0000","last_became_active":"2023-08-17T18:12:19.154934+0000","last_became_peered":"2023-08-17T18:12:19.154934+0000","last_unstale":"2023-08-17T18:12:19.155345+0000","last_undegraded":"2023-08-17T18:12:19.155345+0000","last_fullsized":"2023-08-17T18:12:19.155345+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.785880+0000","last_change":"2023-08-17T18:12:18.775007+0000","last_active":"2023-08-17T18:12:18.785880+0000","last_peered":"2023-08-17T18:12:18.785880+0000","last_clean":"2023-08-17T18:12:18.785880+0000","last_became_active":"2023-08-17T18:12:18.769826+0000","last_became_peered":"2023-08-17T18:12:18.769826+0000","last_unstale":"2023-08-17T18:12:18.785880+0000","last_undegraded":"2023-08-17T18:12:18.785880+0000","last_fullsized":"2023-08-17T18:12:18.785880+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.153093+0000","last_change":"2023-08-17T18:12:19.153093+0000","last_active":"2023-08-17T18:12:19.153093+0000","last_peered":"2023-08-17T18:12:19.153093+0000","last_clean":"2023-08-17T18:12:19.153093+0000","last_became_active":"2023-08-17T18:12:19.152760+0000","last_became_peered":"2023-08-17T18:12:19.152760+0000","last_unstale":"2023-08-17T18:12:19.153093+0000","last_undegraded":"2023-08-17T18:12:19.153093+0000","last_fullsized":"2023-08-17T18:12:19.153093+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.138835+0000","last_change":"2023-08-17T18:12:18.776466+0000","last_active":"2023-08-17T18:12:19.138835+0000","last_peered":"2023-08-17T18:12:19.138835+0000","last_clean":"2023-08-17T18:12:19.138835+0000","last_became_active":"2023-08-17T18:12:18.776173+0000","last_became_peered":"2023-08-17T18:12:18.776173+0000","last_unstale":"2023-08-17T18:12:19.138835+0000","last_undegraded":"2023-08-17T18:12:19.138835+0000","last_fullsized":"2023-08-17T18:12:19.138835+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.150189+0000","last_change":"2023-08-17T18:12:19.150189+0000","last_active":"2023-08-17T18:12:19.150189+0000","last_peered":"2023-08-17T18:12:19.150189+0000","last_clean":"2023-08-17T18:12:19.150189+0000","last_became_active":"2023-08-17T18:12:19.149813+0000","last_became_peered":"2023-08-17T18:12:19.149813+0000","last_unstale":"2023-08-17T18:12:19.150189+0000","last_undegraded":"2023-08-17T18:12:19.150189+0000","last_fullsized":"2023-08-17T18:12:19.150189+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.777565+0000","last_change":"2023-08-17T18:12:18.771256+0000","last_active":"2023-08-17T18:12:18.777565+0000","last_peered":"2023-08-17T18:12:18.777565+0000","last_clean":"2023-08-17T18:12:18.777565+0000","last_became_active":"2023-08-17T18:12:18.770945+0000","last_became_peered":"2023-08-17T18:12:18.770945+0000","last_unstale":"2023-08-17T18:12:18.777565+0000","last_undegraded":"2023-08-17T18:12:18.777565+0000","last_fullsized":"2023-08-17T18:12:18.777565+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149684+0000","last_change":"2023-08-17T18:12:19.149684+0000","last_active":"2023-08-17T18:12:19.149684+0000","last_peered":"2023-08-17T18:12:19.149684+0000","last_clean":"2023-08-17T18:12:19.149684+0000","last_became_active":"2023-08-17T18:12:19.149429+0000","last_became_peered":"2023-08-17T18:12:19.149429+0000","last_unstale":"2023-08-17T18:12:19.149684+0000","last_undegraded":"2023-08-17T18:12:19.149684+0000","last_fullsized":"2023-08-17T18:12:19.149684+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.775227+0000","last_change":"2023-08-17T18:12:18.768930+0000","last_active":"2023-08-17T18:12:18.775227+0000","last_peered":"2023-08-17T18:12:18.775227+0000","last_clean":"2023-08-17T18:12:18.775227+0000","last_became_active":"2023-08-17T18:12:18.768590+0000","last_became_peered":"2023-08-17T18:12:18.768590+0000","last_unstale":"2023-08-17T18:12:18.775227+0000","last_undegraded":"2023-08-17T18:12:18.775227+0000","last_fullsized":"2023-08-17T18:12:18.775227+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.144553+0000","last_change":"2023-08-17T18:12:19.144553+0000","last_active":"2023-08-17T18:12:19.144553+0000","last_peered":"2023-08-17T18:12:19.144553+0000","last_clean":"2023-08-17T18:12:19.144553+0000","last_became_active":"2023-08-17T18:12:19.144294+0000","last_became_peered":"2023-08-17T18:12:19.144294+0000","last_unstale":"2023-08-17T18:12:19.144553+0000","last_undegraded":"2023-08-17T18:12:19.144553+0000","last_fullsized":"2023-08-17T18:12:19.144553+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.779517+0000","last_change":"2023-08-17T18:12:18.777249+0000","last_active":"2023-08-17T18:12:18.779517+0000","last_peered":"2023-08-17T18:12:18.779517+0000","last_clean":"2023-08-17T18:12:18.779517+0000","last_became_active":"2023-08-17T18:12:18.776958+0000","last_became_peered":"2023-08-17T18:12:18.776958+0000","last_unstale":"2023-08-17T18:12:18.779517+0000","last_undegraded":"2023-08-17T18:12:18.779517+0000","last_fullsized":"2023-08-17T18:12:18.779517+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.154641+0000","last_change":"2023-08-17T18:12:19.154641+0000","last_active":"2023-08-17T18:12:19.154641+0000","last_peered":"2023-08-17T18:12:19.154641+0000","last_clean":"2023-08-17T18:12:19.154641+0000","last_became_active":"2023-08-17T18:12:19.154354+0000","last_became_peered":"2023-08-17T18:12:19.154354+0000","last_unstale":"2023-08-17T18:12:19.154641+0000","last_undegraded":"2023-08-17T18:12:19.154641+0000","last_fullsized":"2023-08-17T18:12:19.154641+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"184'2","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145139+0000","last_change":"2023-08-17T18:12:18.776002+0000","last_active":"2023-08-17T18:12:19.145139+0000","last_peered":"2023-08-17T18:12:19.145139+0000","last_clean":"2023-08-17T18:12:19.145139+0000","last_became_active":"2023-08-17T18:12:18.775730+0000","last_became_peered":"2023-08-17T18:12:18.775730+0000","last_unstale":"2023-08-17T18:12:19.145139+0000","last_undegraded":"2023-08-17T18:12:19.145139+0000","last_fullsized":"2023-08-17T18:12:19.145139+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146456+0000","last_change":"2023-08-17T18:12:19.146456+0000","last_active":"2023-08-17T18:12:19.146456+0000","last_peered":"2023-08-17T18:12:19.146456+0000","last_clean":"2023-08-17T18:12:19.146456+0000","last_became_active":"2023-08-17T18:12:19.146150+0000","last_became_peered":"2023-08-17T18:12:19.146150+0000","last_unstale":"2023-08-17T18:12:19.146456+0000","last_undegraded":"2023-08-17T18:12:19.146456+0000","last_fullsized":"2023-08-17T18:12:19.146456+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.786110+0000","last_change":"2023-08-17T18:12:18.783213+0000","last_active":"2023-08-17T18:12:18.786110+0000","last_peered":"2023-08-17T18:12:18.786110+0000","last_clean":"2023-08-17T18:12:18.786110+0000","last_became_active":"2023-08-17T18:12:18.782619+0000","last_became_peered":"2023-08-17T18:12:18.782619+0000","last_unstale":"2023-08-17T18:12:18.786110+0000","last_undegraded":"2023-08-17T18:12:18.786110+0000","last_fullsized":"2023-08-17T18:12:18.786110+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149687+0000","last_change":"2023-08-17T18:12:19.149687+0000","last_active":"2023-08-17T18:12:19.149687+0000","last_peered":"2023-08-17T18:12:19.149687+0000","last_clean":"2023-08-17T18:12:19.149687+0000","last_became_active":"2023-08-17T18:12:19.149386+0000","last_became_peered":"2023-08-17T18:12:19.149386+0000","last_unstale":"2023-08-17T18:12:19.149687+0000","last_undegraded":"2023-08-17T18:12:19.149687+0000","last_fullsized":"2023-08-17T18:12:19.149687+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.785814+0000","last_change":"2023-08-17T18:12:18.781434+0000","last_active":"2023-08-17T18:12:18.785814+0000","last_peered":"2023-08-17T18:12:18.785814+0000","last_clean":"2023-08-17T18:12:18.785814+0000","last_became_active":"2023-08-17T18:12:18.778449+0000","last_became_peered":"2023-08-17T18:12:18.778449+0000","last_unstale":"2023-08-17T18:12:18.785814+0000","last_undegraded":"2023-08-17T18:12:18.785814+0000","last_fullsized":"2023-08-17T18:12:18.785814+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.146707+0000","last_change":"2023-08-17T18:12:19.146707+0000","last_active":"2023-08-17T18:12:19.146707+0000","last_peered":"2023-08-17T18:12:19.146707+0000","last_clean":"2023-08-17T18:12:19.146707+0000","last_became_active":"2023-08-17T18:12:19.146438+0000","last_became_peered":"2023-08-17T18:12:19.146438+0000","last_unstale":"2023-08-17T18:12:19.146707+0000","last_undegraded":"2023-08-17T18:12:19.146707+0000","last_fullsized":"2023-08-17T18:12:19.146707+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.793830+0000","last_change":"2023-08-17T18:12:18.786610+0000","last_active":"2023-08-17T18:12:18.793830+0000","last_peered":"2023-08-17T18:12:18.793830+0000","last_clean":"2023-08-17T18:12:18.793830+0000","last_became_active":"2023-08-17T18:12:18.786312+0000","last_became_peered":"2023-08-17T18:12:18.786312+0000","last_unstale":"2023-08-17T18:12:18.793830+0000","last_undegraded":"2023-08-17T18:12:18.793830+0000","last_fullsized":"2023-08-17T18:12:18.793830+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.148104+0000","last_change":"2023-08-17T18:12:19.148104+0000","last_active":"2023-08-17T18:12:19.148104+0000","last_peered":"2023-08-17T18:12:19.148104+0000","last_clean":"2023-08-17T18:12:19.148104+0000","last_became_active":"2023-08-17T18:12:19.147784+0000","last_became_peered":"2023-08-17T18:12:19.147784+0000","last_unstale":"2023-08-17T18:12:19.148104+0000","last_undegraded":"2023-08-17T18:12:19.148104+0000","last_fullsized":"2023-08-17T18:12:19.148104+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.777462+0000","last_change":"2023-08-17T18:12:18.773766+0000","last_active":"2023-08-17T18:12:18.777462+0000","last_peered":"2023-08-17T18:12:18.777462+0000","last_clean":"2023-08-17T18:12:18.777462+0000","last_became_active":"2023-08-17T18:12:18.773484+0000","last_became_peered":"2023-08-17T18:12:18.773484+0000","last_unstale":"2023-08-17T18:12:18.777462+0000","last_undegraded":"2023-08-17T18:12:18.777462+0000","last_fullsized":"2023-08-17T18:12:18.777462+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142937+0000","last_change":"2023-08-17T18:12:19.142937+0000","last_active":"2023-08-17T18:12:19.142937+0000","last_peered":"2023-08-17T18:12:19.142937+0000","last_clean":"2023-08-17T18:12:19.142937+0000","last_became_active":"2023-08-17T18:12:19.142649+0000","last_became_peered":"2023-08-17T18:12:19.142649+0000","last_unstale":"2023-08-17T18:12:19.142937+0000","last_undegraded":"2023-08-17T18:12:19.142937+0000","last_fullsized":"2023-08-17T18:12:19.142937+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.778875+0000","last_change":"2023-08-17T18:12:18.770938+0000","last_active":"2023-08-17T18:12:18.778875+0000","last_peered":"2023-08-17T18:12:18.778875+0000","last_clean":"2023-08-17T18:12:18.778875+0000","last_became_active":"2023-08-17T18:12:18.770661+0000","last_became_peered":"2023-08-17T18:12:18.770661+0000","last_unstale":"2023-08-17T18:12:18.778875+0000","last_undegraded":"2023-08-17T18:12:18.778875+0000","last_fullsized":"2023-08-17T18:12:18.778875+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.153018+0000","last_change":"2023-08-17T18:12:19.153018+0000","last_active":"2023-08-17T18:12:19.153018+0000","last_peered":"2023-08-17T18:12:19.153018+0000","last_clean":"2023-08-17T18:12:19.153018+0000","last_became_active":"2023-08-17T18:12:19.152690+0000","last_became_peered":"2023-08-17T18:12:19.152690+0000","last_unstale":"2023-08-17T18:12:19.153018+0000","last_undegraded":"2023-08-17T18:12:19.153018+0000","last_fullsized":"2023-08-17T18:12:19.153018+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781403+0000","last_change":"2023-08-17T18:12:18.775345+0000","last_active":"2023-08-17T18:12:18.781403+0000","last_peered":"2023-08-17T18:12:18.781403+0000","last_clean":"2023-08-17T18:12:18.781403+0000","last_became_active":"2023-08-17T18:12:18.774474+0000","last_became_peered":"2023-08-17T18:12:18.774474+0000","last_unstale":"2023-08-17T18:12:18.781403+0000","last_undegraded":"2023-08-17T18:12:18.781403+0000","last_fullsized":"2023-08-17T18:12:18.781403+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.141746+0000","last_change":"2023-08-17T18:12:19.141746+0000","last_active":"2023-08-17T18:12:19.141746+0000","last_peered":"2023-08-17T18:12:19.141746+0000","last_clean":"2023-08-17T18:12:19.141746+0000","last_became_active":"2023-08-17T18:12:19.141345+0000","last_became_peered":"2023-08-17T18:12:19.141345+0000","last_unstale":"2023-08-17T18:12:19.141746+0000","last_undegraded":"2023-08-17T18:12:19.141746+0000","last_fullsized":"2023-08-17T18:12:19.141746+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.780566+0000","last_change":"2023-08-17T18:12:18.776804+0000","last_active":"2023-08-17T18:12:18.780566+0000","last_peered":"2023-08-17T18:12:18.780566+0000","last_clean":"2023-08-17T18:12:18.780566+0000","last_became_active":"2023-08-17T18:12:18.776248+0000","last_became_peered":"2023-08-17T18:12:18.776248+0000","last_unstale":"2023-08-17T18:12:18.780566+0000","last_undegraded":"2023-08-17T18:12:18.780566+0000","last_fullsized":"2023-08-17T18:12:18.780566+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.145448+0000","last_change":"2023-08-17T18:12:19.145448+0000","last_active":"2023-08-17T18:12:19.145448+0000","last_peered":"2023-08-17T18:12:19.145448+0000","last_clean":"2023-08-17T18:12:19.145448+0000","last_became_active":"2023-08-17T18:12:19.145156+0000","last_became_peered":"2023-08-17T18:12:19.145156+0000","last_unstale":"2023-08-17T18:12:19.145448+0000","last_undegraded":"2023-08-17T18:12:19.145448+0000","last_fullsized":"2023-08-17T18:12:19.145448+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781425+0000","last_change":"2023-08-17T18:12:18.775527+0000","last_active":"2023-08-17T18:12:18.781425+0000","last_peered":"2023-08-17T18:12:18.781425+0000","last_clean":"2023-08-17T18:12:18.781425+0000","last_became_active":"2023-08-17T18:12:18.774835+0000","last_became_peered":"2023-08-17T18:12:18.774835+0000","last_unstale":"2023-08-17T18:12:18.781425+0000","last_undegraded":"2023-08-17T18:12:18.781425+0000","last_fullsized":"2023-08-17T18:12:18.781425+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.760439+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T18:12:18.760439+0000","last_peered":"2023-08-17T18:12:18.760439+0000","last_clean":"2023-08-17T18:12:18.760439+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T18:12:18.760439+0000","last_undegraded":"2023-08-17T18:12:18.760439+0000","last_fullsized":"2023-08-17T18:12:18.760439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.142655+0000","last_change":"2023-08-17T18:12:19.142655+0000","last_active":"2023-08-17T18:12:19.142655+0000","last_peered":"2023-08-17T18:12:19.142655+0000","last_clean":"2023-08-17T18:12:19.142655+0000","last_became_active":"2023-08-17T18:12:19.142004+0000","last_became_peered":"2023-08-17T18:12:19.142004+0000","last_unstale":"2023-08-17T18:12:19.142655+0000","last_undegraded":"2023-08-17T18:12:19.142655+0000","last_fullsized":"2023-08-17T18:12:19.142655+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.782011+0000","last_change":"2023-08-17T18:12:18.775068+0000","last_active":"2023-08-17T18:12:18.782011+0000","last_peered":"2023-08-17T18:12:18.782011+0000","last_clean":"2023-08-17T18:12:18.782011+0000","last_became_active":"2023-08-17T18:12:18.774795+0000","last_became_peered":"2023-08-17T18:12:18.774795+0000","last_unstale":"2023-08-17T18:12:18.782011+0000","last_undegraded":"2023-08-17T18:12:18.782011+0000","last_fullsized":"2023-08-17T18:12:18.782011+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.761073+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T18:12:18.761073+0000","last_peered":"2023-08-17T18:12:18.761073+0000","last_clean":"2023-08-17T18:12:18.761073+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T18:12:18.761073+0000","last_undegraded":"2023-08-17T18:12:18.761073+0000","last_fullsized":"2023-08-17T18:12:18.761073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.155915+0000","last_change":"2023-08-17T18:12:19.155915+0000","last_active":"2023-08-17T18:12:19.155915+0000","last_peered":"2023-08-17T18:12:19.155915+0000","last_clean":"2023-08-17T18:12:19.155915+0000","last_became_active":"2023-08-17T18:12:19.155650+0000","last_became_peered":"2023-08-17T18:12:19.155650+0000","last_unstale":"2023-08-17T18:12:19.155915+0000","last_undegraded":"2023-08-17T18:12:19.155915+0000","last_fullsized":"2023-08-17T18:12:19.155915+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"184'2","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.154768+0000","last_change":"2023-08-17T18:12:18.779486+0000","last_active":"2023-08-17T18:12:19.154768+0000","last_peered":"2023-08-17T18:12:19.154768+0000","last_clean":"2023-08-17T18:12:19.154768+0000","last_became_active":"2023-08-17T18:12:18.778932+0000","last_became_peered":"2023-08-17T18:12:18.778932+0000","last_unstale":"2023-08-17T18:12:19.154768+0000","last_undegraded":"2023-08-17T18:12:19.154768+0000","last_fullsized":"2023-08-17T18:12:19.154768+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.760047+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T18:12:18.760047+0000","last_peered":"2023-08-17T18:12:18.760047+0000","last_clean":"2023-08-17T18:12:18.760047+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T18:12:18.760047+0000","last_undegraded":"2023-08-17T18:12:18.760047+0000","last_fullsized":"2023-08-17T18:12:18.760047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.150117+0000","last_change":"2023-08-17T18:12:19.150117+0000","last_active":"2023-08-17T18:12:19.150117+0000","last_peered":"2023-08-17T18:12:19.150117+0000","last_clean":"2023-08-17T18:12:19.150117+0000","last_became_active":"2023-08-17T18:12:19.149831+0000","last_became_peered":"2023-08-17T18:12:19.149831+0000","last_unstale":"2023-08-17T18:12:19.150117+0000","last_undegraded":"2023-08-17T18:12:19.150117+0000","last_fullsized":"2023-08-17T18:12:19.150117+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.786132+0000","last_change":"2023-08-17T18:12:18.783404+0000","last_active":"2023-08-17T18:12:18.786132+0000","last_peered":"2023-08-17T18:12:18.786132+0000","last_clean":"2023-08-17T18:12:18.786132+0000","last_became_active":"2023-08-17T18:12:18.782949+0000","last_became_peered":"2023-08-17T18:12:18.782949+0000","last_unstale":"2023-08-17T18:12:18.786132+0000","last_undegraded":"2023-08-17T18:12:18.786132+0000","last_fullsized":"2023-08-17T18:12:18.786132+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":166,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.759728+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T18:12:18.759728+0000","last_peered":"2023-08-17T18:12:18.759728+0000","last_clean":"2023-08-17T18:12:18.759728+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T18:12:18.759728+0000","last_undegraded":"2023-08-17T18:12:18.759728+0000","last_fullsized":"2023-08-17T18:12:18.759728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":143,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.769358+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T18:12:18.769358+0000","last_peered":"2023-08-17T18:12:18.769358+0000","last_clean":"2023-08-17T18:12:18.769358+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T18:12:18.769358+0000","last_undegraded":"2023-08-17T18:12:18.769358+0000","last_fullsized":"2023-08-17T18:12:18.769358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.150166+0000","last_change":"2023-08-17T18:12:19.150166+0000","last_active":"2023-08-17T18:12:19.150166+0000","last_peered":"2023-08-17T18:12:19.150166+0000","last_clean":"2023-08-17T18:12:19.150166+0000","last_became_active":"2023-08-17T18:12:19.149889+0000","last_became_peered":"2023-08-17T18:12:19.149889+0000","last_unstale":"2023-08-17T18:12:19.150166+0000","last_undegraded":"2023-08-17T18:12:19.150166+0000","last_fullsized":"2023-08-17T18:12:19.150166+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"184'3","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.156890+0000","last_change":"2023-08-17T18:12:18.767892+0000","last_active":"2023-08-17T18:12:19.156890+0000","last_peered":"2023-08-17T18:12:19.156890+0000","last_clean":"2023-08-17T18:12:19.156890+0000","last_became_active":"2023-08-17T18:12:18.767527+0000","last_became_peered":"2023-08-17T18:12:18.767527+0000","last_unstale":"2023-08-17T18:12:19.156890+0000","last_undegraded":"2023-08-17T18:12:19.156890+0000","last_fullsized":"2023-08-17T18:12:19.156890+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":141,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.769473+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T18:12:18.769473+0000","last_peered":"2023-08-17T18:12:18.769473+0000","last_clean":"2023-08-17T18:12:18.769473+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T18:12:18.769473+0000","last_undegraded":"2023-08-17T18:12:18.769473+0000","last_fullsized":"2023-08-17T18:12:18.769473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.141598+0000","last_change":"2023-08-17T18:12:19.141598+0000","last_active":"2023-08-17T18:12:19.141598+0000","last_peered":"2023-08-17T18:12:19.141598+0000","last_clean":"2023-08-17T18:12:19.141598+0000","last_became_active":"2023-08-17T18:12:19.141006+0000","last_became_peered":"2023-08-17T18:12:19.141006+0000","last_unstale":"2023-08-17T18:12:19.141598+0000","last_undegraded":"2023-08-17T18:12:19.141598+0000","last_fullsized":"2023-08-17T18:12:19.141598+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"184'4","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.152128+0000","last_change":"2023-08-17T18:12:18.768450+0000","last_active":"2023-08-17T18:12:19.152128+0000","last_peered":"2023-08-17T18:12:19.152128+0000","last_clean":"2023-08-17T18:12:19.152128+0000","last_became_active":"2023-08-17T18:12:18.768157+0000","last_became_peered":"2023-08-17T18:12:18.768157+0000","last_unstale":"2023-08-17T18:12:19.152128+0000","last_undegraded":"2023-08-17T18:12:19.152128+0000","last_fullsized":"2023-08-17T18:12:19.152128+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.768728+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T18:12:18.768728+0000","last_peered":"2023-08-17T18:12:18.768728+0000","last_clean":"2023-08-17T18:12:18.768728+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T18:12:18.768728+0000","last_undegraded":"2023-08-17T18:12:18.768728+0000","last_fullsized":"2023-08-17T18:12:18.768728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149419+0000","last_change":"2023-08-17T18:12:19.149419+0000","last_active":"2023-08-17T18:12:19.149419+0000","last_peered":"2023-08-17T18:12:19.149419+0000","last_clean":"2023-08-17T18:12:19.149419+0000","last_became_active":"2023-08-17T18:12:19.149068+0000","last_became_peered":"2023-08-17T18:12:19.149068+0000","last_unstale":"2023-08-17T18:12:19.149419+0000","last_undegraded":"2023-08-17T18:12:19.149419+0000","last_fullsized":"2023-08-17T18:12:19.149419+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"184'1","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.138742+0000","last_change":"2023-08-17T18:12:18.771570+0000","last_active":"2023-08-17T18:12:19.138742+0000","last_peered":"2023-08-17T18:12:19.138742+0000","last_clean":"2023-08-17T18:12:19.138742+0000","last_became_active":"2023-08-17T18:12:18.770364+0000","last_became_peered":"2023-08-17T18:12:18.770364+0000","last_unstale":"2023-08-17T18:12:19.138742+0000","last_undegraded":"2023-08-17T18:12:19.138742+0000","last_fullsized":"2023-08-17T18:12:19.138742+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.760760+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T18:12:18.760760+0000","last_peered":"2023-08-17T18:12:18.760760+0000","last_clean":"2023-08-17T18:12:18.760760+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T18:12:18.760760+0000","last_undegraded":"2023-08-17T18:12:18.760760+0000","last_fullsized":"2023-08-17T18:12:18.760760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":8,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-08-17T18:12:19.149924+0000","last_change":"2023-08-17T18:12:19.149924+0000","last_active":"2023-08-17T18:12:19.149924+0000","last_peered":"2023-08-17T18:12:19.149924+0000","last_clean":"2023-08-17T18:12:19.149924+0000","last_became_active":"2023-08-17T18:12:19.149021+0000","last_became_peered":"2023-08-17T18:12:19.149021+0000","last_unstale":"2023-08-17T18:12:19.149924+0000","last_undegraded":"2023-08-17T18:12:19.149924+0000","last_fullsized":"2023-08-17T18:12:19.149924+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:18.748874+0000","last_clean_scrub_stamp":"2023-08-17T18:12:18.748874+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.781981+0000","last_change":"2023-08-17T18:12:18.772234+0000","last_active":"2023-08-17T18:12:18.781981+0000","last_peered":"2023-08-17T18:12:18.781981+0000","last_clean":"2023-08-17T18:12:18.781981+0000","last_became_active":"2023-08-17T18:12:18.771970+0000","last_became_peered":"2023-08-17T18:12:18.771970+0000","last_unstale":"2023-08-17T18:12:18.781981+0000","last_undegraded":"2023-08-17T18:12:18.781981+0000","last_fullsized":"2023-08-17T18:12:18.781981+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:17.741769+0000","last_clean_scrub_stamp":"2023-08-17T18:12:17.741769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-08-17T18:12:18.762055+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T18:12:18.762055+0000","last_peered":"2023-08-17T18:12:18.762055+0000","last_clean":"2023-08-17T18:12:18.762055+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T18:12:18.762055+0000","last_undegraded":"2023-08-17T18:12:18.762055+0000","last_fullsized":"2023-08-17T18:12:18.762055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575298,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71299999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63100000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.69799999999999995,"5min":0.76300000000000001,"15min":0.77100000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.501,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.372},"max":{"1min":0.65700000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61699999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.66100000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.36799999999999999},"max":{"1min":0.68000000000000005,"5min":0.78600000000000003,"15min":0.81699999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.627,"15min":0.629},"min":{"1min":0.42699999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.73699999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.247},"max":{"1min":0.66100000000000003,"5min":0.68799999999999994,"15min":0.77600000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48199999999999998},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.32300000000000001},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.76900000000000002},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.28299999999999997},"max":{"1min":0.72399999999999998,"5min":0.78900000000000003,"15min":0.81699999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.86499999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.754,"5min":0.79600000000000004,"15min":0.84199999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.68200000000000005,"5min":0.76300000000000001,"15min":0.82099999999999995},"last":0.51000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575298,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303440,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068400,"statfs":{"total":96636764160,"available":96326041600,"internally_reserved":0,"allocated":2301952,"data_stored":1155715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.36599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71099999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66100000000000003,"5min":1.214,"15min":1.214},"last":0.628}]},{"osd":1,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.38300000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64800000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36299999999999999,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.748,"5min":1.208,"15min":1.208},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.505},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.58299999999999996},"min":{"1min":0.39500000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":1.304,"15min":1.304},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73699999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.29499999999999998},"max":{"1min":0.73099999999999998,"5min":0.78600000000000003,"15min":0.88700000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48999999999999999,"15min":0.47799999999999998},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.74299999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.495,"15min":0.47899999999999998},"min":{"1min":0.34300000000000003,"5min":0.33600000000000002,"15min":0.30499999999999999},"max":{"1min":0.72999999999999998,"5min":0.75800000000000001,"15min":1.0269999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57199999999999995,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.77300000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Aug 17 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54400000000000004,"15min":0.53300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32300000000000001},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.87},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.372,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.80700000000000005,"15min":0.97699999999999998},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2289664,"data_stored":1148536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35399999999999998,"15min":0.35299999999999998},"min":{"1min":0.245,"5min":0.216,"15min":0.216},"max":{"1min":0.63300000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.308}]},{"osd":2,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.22700000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.443,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40600000000000003,"15min":0.40699999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":0.56399999999999995,"5min":0.59599999999999997,"15min":0.621},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.437,"15min":0.438},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58799999999999997,"5min":1.095,"15min":1.095},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.25900000000000001},"max":{"1min":0.51400000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78800000000000003,"5min":0.88400000000000001,"15min":0.96199999999999997},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.621,"15min":0.623},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72999999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.623,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80700000000000005,"5min":0.90400000000000003,"15min":0.94499999999999995},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.45300000000000001,"5min":0.42399999999999999,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.502}]},{"osd":7,"last update":"Thu Aug 17 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.754,"5min":0.88800000000000001,"15min":0.91800000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.48999999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575298,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34499999999999997,"15min":0.35699999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45800000000000002,"5min":0.64100000000000001,"15min":0.77600000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.378,"15min":0.39300000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.498,"5min":0.58099999999999996,"15min":0.70899999999999996},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.36399999999999999,"15min":0.373},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.61399999999999999},"last":0.309},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64700000000000002,"5min":0.70299999999999996,"15min":0.754},"last":0.373}]},{"osd":3,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.39100000000000001,"15min":0.40799999999999997},"min":{"1min":0.247,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.66100000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.41699999999999998,"15min":0.42399999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58899999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.375,"5min":0.375,"15min":0.35399999999999998},"max":{"1min":0.82699999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63400000000000001,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.39700000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.62,"15min":0.627},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.38300000000000001},"max":{"1min":0.78500000000000003,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.39600000000000002},"max":{"1min":0.77500000000000002,"5min":1.079,"15min":1.079},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.622,"15min":0.64000000000000001},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83699999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Aug 17 18:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.45900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.89200000000000002,"5min":1.0549999999999999,"15min":1.0820000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.69799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575298,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.222,"5min":0.221,"15min":0.20300000000000001},"max":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.623},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.371,"15min":0.36799999999999999},"min":{"1min":0.255,"5min":0.254,"15min":0.249},"max":{"1min":0.51700000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57499999999999996,"5min":0.61599999999999999,"15min":0.68100000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.25600000000000001},"max":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.72999999999999998},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41999999999999998,"15min":0.42299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.67000000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.53600000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.311}]},{"osd":4,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":1.0169999999999999},"last":0.505},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38400000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.73399999999999999,"5min":0.91000000000000003,"15min":0.94799999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59799999999999998,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.40899999999999997},"max":{"1min":0.72599999999999998,"5min":0.89900000000000002,"15min":0.96099999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77600000000000002,"5min":0.94199999999999995,"15min":0.97999999999999998},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.44600000000000001,"15min":0.42099999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.75,"5min":0.93500000000000005,"15min":1.0469999999999999},"last":0.52400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575298,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307512,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064328,"statfs":{"total":96636764160,"available":96321871872,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35599999999999998,"15min":0.34899999999999998},"min":{"1min":0.23100000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.52400000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.38700000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.57299999999999995,"5min":0.59899999999999998,"15min":0.61299999999999999},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.377},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55300000000000005,"5min":0.59399999999999997,"15min":0.72299999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41599999999999998,"15min":0.40699999999999997},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59099999999999997,"5min":0.63100000000000001,"15min":0.63400000000000001},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40600000000000003,"15min":0.40699999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":0.48699999999999999,"5min":0.58999999999999997,"15min":0.68899999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.70699999999999996},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.87,"15min":0.95499999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.42799999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":0.879,"15min":0.93100000000000005},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.60799999999999998},"min":{"1min":0.46300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.84199999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64800000000000002,"15min":0.64300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.89100000000000001,"15min":0.90700000000000003},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.88900000000000001,"5min":0.92800000000000005,"15min":0.94399999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.82699999999999996,"5min":0.93200000000000005,"15min":0.94899999999999995},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Aug 17 18:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86199999999999999,"5min":0.96599999999999997,"15min":0.97099999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.48499999999999999,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575299,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303416,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.315},"max":{"1min":0.66100000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.432},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55300000000000005,"15min":0.56200000000000006},"min":{"1min":0.41599999999999998,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.40500000000000003,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.68500000000000005,"5min":0.81399999999999995,"15min":0.83799999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73499999999999999,"5min":0.81200000000000006,"15min":0.81999999999999995},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68700000000000006,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.61899999999999999,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.30599999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.79700000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.28799999999999998},"max":{"1min":0.64700000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Aug 17 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33300000000000002},"max":{"1min":0.72599999999999998,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.44400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.63300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575297,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307512,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064328,"statfs":{"total":96636764160,"available":96321871872,"internally_reserved":0,"allocated":2277376,"data_stored":1141857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.80300000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.34300000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.378},"max":{"1min":0.82899999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.45400000000000001,"15min":0.443},"min":{"1min":0.32400000000000001,"5min":0.28100000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.71599999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.49299999999999999,"15min":0.47899999999999998},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.496,"15min":0.495},"min":{"1min":0.307,"5min":0.307,"15min":0.29899999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.79500000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Aug 17 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.34300000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60799999999999998,"15min":0.59099999999999997},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.32600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.83399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T18:12:22.456 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T18:12:22.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T18:12:22.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.608+0000 7f9a014cc700 1 Processor -- start 2023-08-17T18:12:22.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.608+0000 7f9a014cc700 1 -- start start 2023-08-17T18:12:22.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.609+0000 7f9a014cc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f99fc1540a0 0x7f99fc0a7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.609+0000 7f9a014cc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc154480 0x7f99fc065020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.609+0000 7f9a014cc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc064b90 con 0x7f99fc0bdca0 2023-08-17T18:12:22.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.609+0000 7f9a014cc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc0a8480 con 0x7f99fc1540a0 2023-08-17T18:12:22.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.609+0000 7f9a014cc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc064540 con 0x7f99fc154480 2023-08-17T18:12:22.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.609+0000 7f99fb7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f99fc0bdca0 0x7f99fc095e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53230/0 (socket says 172.21.15.78:53230) 2023-08-17T18:12:22.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.609+0000 7f99fb7fe700 1 -- 172.21.15.78:0/2836030720 learned_addr learned my addr 172.21.15.78:0/2836030720 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:22.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.609+0000 7f99f27fc700 1 --2- 172.21.15.78:0/2836030720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc154480 0x7f99fc065020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.609+0000 7f99faffd700 1 --2- 172.21.15.78:0/2836030720 >> v2:172.21.15.150:3300/0 conn(0x7f99fc1540a0 0x7f99fc0a7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99fa7fc700 1 -- 172.21.15.78:0/2836030720 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526687467 0 0) 0x7f99fc064b90 con 0x7f99fc0bdca0 2023-08-17T18:12:22.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99fa7fc700 1 -- 172.21.15.78:0/2836030720 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e80033f0 con 0x7f99fc0bdca0 2023-08-17T18:12:22.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99f27fc700 1 -- 172.21.15.78:0/2836030720 >> v2:172.21.15.150:3300/0 conn(0x7f99fc1540a0 msgr2=0x7f99fc0a7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:22.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99f27fc700 1 --2- 172.21.15.78:0/2836030720 >> v2:172.21.15.150:3300/0 conn(0x7f99fc1540a0 0x7f99fc0a7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99f27fc700 1 -- 172.21.15.78:0/2836030720 >> v1:172.21.15.78:6789/0 conn(0x7f99fc0bdca0 legacy=0x7f99fc095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99fa7fc700 1 -- 172.21.15.78:0/2836030720 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1948051196 0 0) 0x7f99e80033f0 con 0x7f99fc0bdca0 2023-08-17T18:12:22.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99f27fc700 1 -- 172.21.15.78:0/2836030720 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc064820 con 0x7f99fc154480 2023-08-17T18:12:22.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99faffd700 1 --2- 172.21.15.78:0/2836030720 >> v2:172.21.15.150:3300/0 conn(0x7f99fc1540a0 0x7f99fc0a7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:22.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99f27fc700 1 --2- 172.21.15.78:0/2836030720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc154480 0x7f99fc065020 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f99e4009760 tx=0x7f99e4009060).ready entity=mon.2 client_cookie=574a59954756c5da server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:22.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99fa7fc700 1 -- 172.21.15.78:0/2836030720 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e40090d0 con 0x7f99fc154480 2023-08-17T18:12:22.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99fa7fc700 1 -- 172.21.15.78:0/2836030720 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e400d4a0 con 0x7f99fc154480 2023-08-17T18:12:22.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.610+0000 7f99fa7fc700 1 -- 172.21.15.78:0/2836030720 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e400d820 con 0x7f99fc154480 2023-08-17T18:12:22.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.611+0000 7f9a014cc700 1 -- 172.21.15.78:0/2836030720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc154480 msgr2=0x7f99fc065020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.611+0000 7f9a014cc700 1 --2- 172.21.15.78:0/2836030720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc154480 0x7f99fc065020 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f99e4009760 tx=0x7f99e4009060).stop 2023-08-17T18:12:22.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.611+0000 7f9a014cc700 1 -- 172.21.15.78:0/2836030720 shutdown_connections 2023-08-17T18:12:22.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.611+0000 7f9a014cc700 1 --2- 172.21.15.78:0/2836030720 >> v2:172.21.15.150:3300/0 conn(0x7f99fc1540a0 0x7f99fc0a7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.611+0000 7f9a014cc700 1 --2- 172.21.15.78:0/2836030720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc154480 0x7f99fc065020 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.611+0000 7f9a014cc700 1 -- 172.21.15.78:0/2836030720 >> 172.21.15.78:0/2836030720 conn(0x7f99fc062fc0 msgr2=0x7f99fc0c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:22.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.611+0000 7f9a014cc700 1 -- 172.21.15.78:0/2836030720 shutdown_connections 2023-08-17T18:12:22.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.611+0000 7f9a014cc700 1 -- 172.21.15.78:0/2836030720 wait complete. 2023-08-17T18:12:22.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.612+0000 7f9a014cc700 1 Processor -- start 2023-08-17T18:12:22.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.612+0000 7f9a014cc700 1 -- start start 2023-08-17T18:12:22.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f9a014cc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc0bdca0 0x7f99fc14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f9a014cc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99fc1540a0 0x7f99fc0ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f9a014cc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99fc1682b0 0x7f99fc066da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f9a014cc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0adce0 con 0x7f99fc1540a0 2023-08-17T18:12:22.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f9a014cc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc167e20 con 0x7f99fc1682b0 2023-08-17T18:12:22.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f9a014cc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0aecf0 con 0x7f99fc0bdca0 2023-08-17T18:12:22.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f27fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99fc1540a0 0x7f99fc0ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f27fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99fc1540a0 0x7f99fc0ae800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47418/0 (socket says 172.21.15.78:47418) 2023-08-17T18:12:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f27fc700 1 -- 172.21.15.78:0/3594449758 learned_addr learned my addr 172.21.15.78:0/3594449758 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99fb7fe700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99fc1682b0 0x7f99fc066da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99faffd700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc0bdca0 0x7f99fc14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f27fc700 1 -- 172.21.15.78:0/3594449758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc0bdca0 msgr2=0x7f99fc14d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f27fc700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc0bdca0 0x7f99fc14d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f27fc700 1 -- 172.21.15.78:0/3594449758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99fc1682b0 msgr2=0x7f99fc066da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f27fc700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99fc1682b0 0x7f99fc066da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f27fc700 1 -- 172.21.15.78:0/3594449758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec0092a0 con 0x7f99fc1540a0 2023-08-17T18:12:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99faffd700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc0bdca0 0x7f99fc14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f27fc700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99fc1540a0 0x7f99fc0ae800 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7f99e4009d50 tx=0x7f99e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f37fe700 1 -- 172.21.15.78:0/3594449758 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4012950 con 0x7f99fc1540a0 2023-08-17T18:12:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f37fe700 1 -- 172.21.15.78:0/3594449758 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e4012ab0 con 0x7f99fc1540a0 2023-08-17T18:12:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f9a014cc700 1 -- 172.21.15.78:0/3594449758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e40092a0 con 0x7f99fc1540a0 2023-08-17T18:12:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f99f37fe700 1 -- 172.21.15.78:0/3594449758 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4012e30 con 0x7f99fc1540a0 2023-08-17T18:12:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.613+0000 7f9a014cc700 1 -- 172.21.15.78:0/3594449758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc0ada00 con 0x7f99fc1540a0 2023-08-17T18:12:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.614+0000 7f9a014cc700 1 -- 172.21.15.78:0/3594449758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc047350 con 0x7f99fc1540a0 2023-08-17T18:12:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.615+0000 7f99f37fe700 1 -- 172.21.15.78:0/3594449758 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f99e400f070 con 0x7f99fc1540a0 2023-08-17T18:12:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.615+0000 7f99f37fe700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f99dc05ed90 0x7f99dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.615+0000 7f99f37fe700 1 -- 172.21.15.78:0/3594449758 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f99e407ae30 con 0x7f99fc1540a0 2023-08-17T18:12:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.615+0000 7f99faffd700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f99dc05ed90 0x7f99dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.615+0000 7f99faffd700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f99dc05ed90 0x7f99dc061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f99ec009270 tx=0x7f99ec008040).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:22.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.619+0000 7f99f37fe700 1 -- 172.21.15.78:0/3594449758 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99e404c3d0 con 0x7f99fc1540a0 2023-08-17T18:12:22.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.844+0000 7f9a014cc700 1 -- 172.21.15.78:0/3594449758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f99fc05f530 con 0x7f99fc1540a0 2023-08-17T18:12:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.848+0000 7f99f37fe700 1 -- 172.21.15.78:0/3594449758 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v34) v1 ==== 190+0+0 (secure 0 0 0) 0x7f99e404f9f0 con 0x7f99fc1540a0 2023-08-17T18:12:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 -- 172.21.15.78:0/3594449758 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f99dc05ed90 msgr2=0x7f99dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f99dc05ed90 0x7f99dc061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f99ec009270 tx=0x7f99ec008040).stop 2023-08-17T18:12:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 -- 172.21.15.78:0/3594449758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99fc1540a0 msgr2=0x7f99fc0ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99fc1540a0 0x7f99fc0ae800 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7f99e4009d50 tx=0x7f99e4016000).stop 2023-08-17T18:12:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 -- 172.21.15.78:0/3594449758 shutdown_connections 2023-08-17T18:12:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f99dc05ed90 0x7f99dc061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99fc1682b0 0x7f99fc066da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc0bdca0 0x7f99fc14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 --2- 172.21.15.78:0/3594449758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99fc1540a0 0x7f99fc0ae800 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 -- 172.21.15.78:0/3594449758 >> 172.21.15.78:0/3594449758 conn(0x7f99fc062fc0 msgr2=0x7f99fc14f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 -- 172.21.15.78:0/3594449758 shutdown_connections 2023-08-17T18:12:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.850+0000 7f9a014cc700 1 -- 172.21.15.78:0/3594449758 wait complete. 2023-08-17T18:12:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-08-17T18:12:22.861 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:22.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.974+0000 7ff8e4898700 1 Processor -- start 2023-08-17T18:12:22.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.974+0000 7ff8e4898700 1 -- start start 2023-08-17T18:12:22.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.975+0000 7ff8e4898700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8e0066660 0x7ff8e00c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.975+0000 7ff8e4898700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8e0066a40 0x7ff8e0151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.975+0000 7ff8e4898700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e00c6040 con 0x7ff8e00c5b50 2023-08-17T18:12:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.975+0000 7ff8e4898700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e0069b00 con 0x7ff8e0066660 2023-08-17T18:12:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.975+0000 7ff8e4898700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0069f90 con 0x7ff8e0066a40 2023-08-17T18:12:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.975+0000 7ff8d5d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff8e00c5b50 0x7ff8e00624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53234/0 (socket says 172.21.15.78:53234) 2023-08-17T18:12:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.975+0000 7ff8d5d9b700 1 -- 172.21.15.78:0/258744462 learned_addr learned my addr 172.21.15.78:0/258744462 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8de59c700 1 --2- 172.21.15.78:0/258744462 >> v2:172.21.15.150:3300/0 conn(0x7ff8e0066660 0x7ff8e00c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ded9d700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8e0066a40 0x7ff8e0151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273902916 0 0) 0x7ff8c8001110 con 0x7ff8e00c5b50 2023-08-17T18:12:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8cc0033f0 con 0x7ff8e00c5b50 2023-08-17T18:12:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 407406308 0 0) 0x7ff8cc0033f0 con 0x7ff8e00c5b50 2023-08-17T18:12:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8e0066a40 msgr2=0x7ff8e0151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8e0066a40 0x7ff8e0151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 >> v2:172.21.15.150:3300/0 conn(0x7ff8e0066660 msgr2=0x7ff8e00c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 --2- 172.21.15.78:0/258744462 >> v2:172.21.15.150:3300/0 conn(0x7ff8e0066660 0x7ff8e00c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e00691d0 con 0x7ff8e00c5b50 2023-08-17T18:12:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7ff8c8001600 con 0x7ff8e00c5b50 2023-08-17T18:12:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 >> v1:172.21.15.78:6789/0 conn(0x7ff8e00c5b50 legacy=0x7ff8e00624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc0038e0 0x7ff8cc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8e0066a40 0x7ff8cc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc004b80 0x7ff8cc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0069b00 con 0x7ff8cc0038e0 2023-08-17T18:12:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0069f90 con 0x7ff8cc004b80 2023-08-17T18:12:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc00b8e0 con 0x7ff8e0066a40 2023-08-17T18:12:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8de59c700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc0038e0 0x7ff8cc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8d5d9b700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8e0066a40 0x7ff8cc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8ded9d700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc004b80 0x7ff8cc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8de59c700 1 -- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8e0066a40 msgr2=0x7ff8cc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8de59c700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8e0066a40 0x7ff8cc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8de59c700 1 -- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc004b80 msgr2=0x7ff8cc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8de59c700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc004b80 0x7ff8cc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.976+0000 7ff8de59c700 1 -- 172.21.15.78:0/258744462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0033f0 con 0x7ff8cc0038e0 2023-08-17T18:12:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8ded9d700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc004b80 0x7ff8cc005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8de59c700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc0038e0 0x7ff8cc003d00 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7ff8d0009a80 tx=0x7ff8d0009060).ready entity=mon.0 client_cookie=5e750c47331f8aa8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0009430 con 0x7ff8cc0038e0 2023-08-17T18:12:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d000e640 con 0x7ff8cc0038e0 2023-08-17T18:12:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8ddd9b700 1 -- 172.21.15.78:0/258744462 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000e9c0 con 0x7ff8cc0038e0 2023-08-17T18:12:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8e4898700 1 -- 172.21.15.78:0/258744462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc0038e0 msgr2=0x7ff8cc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8e4898700 1 --2- 172.21.15.78:0/258744462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc0038e0 0x7ff8cc003d00 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7ff8d0009a80 tx=0x7ff8d0009060).stop 2023-08-17T18:12:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8ded9d700 1 -- 172.21.15.78:0/258744462 reap_dead start 2023-08-17T18:12:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8e4898700 1 -- 172.21.15.78:0/258744462 shutdown_connections 2023-08-17T18:12:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8e4898700 1 -- 172.21.15.78:0/258744462 >> 172.21.15.78:0/258744462 conn(0x7ff8e00c7b00 msgr2=0x7ff8e00c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8e4898700 1 -- 172.21.15.78:0/258744462 shutdown_connections 2023-08-17T18:12:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.977+0000 7ff8e4898700 1 -- 172.21.15.78:0/258744462 wait complete. 2023-08-17T18:12:22.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8e4898700 1 Processor -- start 2023-08-17T18:12:22.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8e4898700 1 -- start start 2023-08-17T18:12:22.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8e4898700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc0038e0 0x7ff8e00a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8e4898700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8e00a64e0 0x7ff8e013dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8e4898700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e00624f0 0x7ff8e0062930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8e4898700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0062e20 con 0x7ff8e00624f0 2023-08-17T18:12:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8e4898700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00a9710 con 0x7ff8e00a64e0 2023-08-17T18:12:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8e4898700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00a99f0 con 0x7ff8cc0038e0 2023-08-17T18:12:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8ded9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e00624f0 0x7ff8e0062930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8ded9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e00624f0 0x7ff8e0062930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47432/0 (socket says 172.21.15.78:47432) 2023-08-17T18:12:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.979+0000 7ff8ded9d700 1 -- 172.21.15.78:0/2237803802 learned_addr learned my addr 172.21.15.78:0/2237803802 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8ded9d700 1 -- 172.21.15.78:0/2237803802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc0038e0 msgr2=0x7ff8e00a7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8ded9d700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc0038e0 0x7ff8e00a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8d5d9b700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8e00a64e0 0x7ff8e013dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8ded9d700 1 -- 172.21.15.78:0/2237803802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8e00a64e0 msgr2=0x7ff8e013dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8ded9d700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8e00a64e0 0x7ff8e013dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8ded9d700 1 -- 172.21.15.78:0/2237803802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e00a9cd0 con 0x7ff8e00624f0 2023-08-17T18:12:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8ded9d700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e00624f0 0x7ff8e0062930 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7ff8e0064910 tx=0x7ff8d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/2237803802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800e030 con 0x7ff8e00624f0 2023-08-17T18:12:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/2237803802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d800f040 con 0x7ff8e00624f0 2023-08-17T18:12:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/2237803802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8010ea0 con 0x7ff8e00624f0 2023-08-17T18:12:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8e4898700 1 -- 172.21.15.78:0/2237803802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e00a9fb0 con 0x7ff8e00624f0 2023-08-17T18:12:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.980+0000 7ff8e4898700 1 -- 172.21.15.78:0/2237803802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e00aa4d0 con 0x7ff8e00624f0 2023-08-17T18:12:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.981+0000 7ff8e4898700 1 -- 172.21.15.78:0/2237803802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e0069c90 con 0x7ff8e00624f0 2023-08-17T18:12:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.981+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/2237803802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff8d8015690 con 0x7ff8e00624f0 2023-08-17T18:12:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.981+0000 7ff8d6ffd700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff8c005ed90 0x7ff8c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.982+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/2237803802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff8d807a510 con 0x7ff8e00624f0 2023-08-17T18:12:22.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.982+0000 7ff8de59c700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff8c005ed90 0x7ff8c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:22.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.982+0000 7ff8de59c700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff8c005ed90 0x7ff8c0061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff8e00c1f30 tx=0x7ff8d001a000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:22.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:22.986+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/2237803802 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff8d804bab0 con 0x7ff8e00624f0 2023-08-17T18:12:23.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.192+0000 7ff8e4898700 1 -- 172.21.15.78:0/2237803802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8e00aa1a0 con 0x7ff8e00624f0 2023-08-17T18:12:23.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.193+0000 7ff8d6ffd700 1 -- 172.21.15.78:0/2237803802 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4496 (secure 0 0 0) 0x7ff8d804f0d0 con 0x7ff8e00624f0 2023-08-17T18:12:23.193 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:23.193 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":67,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1111956777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1111956777},{"type":"v1","addr":"172.21.15.78:6837","nonce":1111956777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1739806080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1739806080},{"type":"v1","addr":"172.21.15.150:6834","nonce":1739806080}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":9528,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/168802869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":168802869},{"type":"v1","addr":"172.21.15.78:6836","nonce":168802869}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:12:19.124866+0000","modified":"2023-08-17T18:12:21.130921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9537":{"gid":9537,"name":"d","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2525491694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2525491694},{"type":"v1","addr":"172.21.15.150:6835","nonce":2525491694}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T18:12:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.194+0000 7ff8e4898700 1 -- 172.21.15.78:0/2237803802 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff8c005ed90 msgr2=0x7ff8c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.194+0000 7ff8e4898700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff8c005ed90 0x7ff8c0061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff8e00c1f30 tx=0x7ff8d001a000).stop 2023-08-17T18:12:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.195+0000 7ff8e4898700 1 -- 172.21.15.78:0/2237803802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e00624f0 msgr2=0x7ff8e0062930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.195+0000 7ff8e4898700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e00624f0 0x7ff8e0062930 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7ff8e0064910 tx=0x7ff8d800b040).stop 2023-08-17T18:12:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.195+0000 7ff8e4898700 1 -- 172.21.15.78:0/2237803802 shutdown_connections 2023-08-17T18:12:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.195+0000 7ff8e4898700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff8c005ed90 0x7ff8c0061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.195+0000 7ff8e4898700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e00624f0 0x7ff8e0062930 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.195+0000 7ff8e4898700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc0038e0 0x7ff8e00a7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.195+0000 7ff8e4898700 1 --2- 172.21.15.78:0/2237803802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8e00a64e0 0x7ff8e013dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.195+0000 7ff8e4898700 1 -- 172.21.15.78:0/2237803802 >> 172.21.15.78:0/2237803802 conn(0x7ff8e00c7b00 msgr2=0x7ff8e0152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.195+0000 7ff8e4898700 1 -- 172.21.15.78:0/2237803802 shutdown_connections 2023-08-17T18:12:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.195+0000 7ff8e4898700 1 -- 172.21.15.78:0/2237803802 wait complete. 2023-08-17T18:12:23.197 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 67 2023-08-17T18:12:23.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T18:12:19.124866+0000', 'modified': '2023-08-17T18:12:21.130921+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9537}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9537': {'gid': 9537, 'name': 'd', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/2525491694', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 2525491694}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 2525491694}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T18:12:23.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T18:12:23.609 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-17T18:12:23.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.722+0000 7f84cc70f700 1 Processor -- start 2023-08-17T18:12:23.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.722+0000 7f84cc70f700 1 -- start start 2023-08-17T18:12:23.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.723+0000 7f84cc70f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4064340 0x7f84c4064720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.723+0000 7f84cc70f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c40c7860 con 0x7f84c40bec60 2023-08-17T18:12:23.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.723+0000 7f84cc70f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c40c6c90 con 0x7f84c40c98b0 2023-08-17T18:12:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.723+0000 7f84cc70f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40638b0 con 0x7f84c4064340 2023-08-17T18:12:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.723+0000 7f84cacac700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f84c40bec60 0x7f84c40c32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53248/0 (socket says 172.21.15.78:53248) 2023-08-17T18:12:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.723+0000 7f84cacac700 1 -- 172.21.15.78:0/3888337490 learned_addr learned my addr 172.21.15.78:0/3888337490 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4064340 0x7f84c4064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285349779 0 0) 0x7f84c40c7860 con 0x7f84c40bec60 2023-08-17T18:12:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b00033f0 con 0x7f84c40bec60 2023-08-17T18:12:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063010483 0 0) 0x7f84c40c6c90 con 0x7f84c40c98b0 2023-08-17T18:12:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84c40c7860 con 0x7f84c40c98b0 2023-08-17T18:12:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334808779 0 0) 0x7f84b00033f0 con 0x7f84c40bec60 2023-08-17T18:12:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4064340 msgr2=0x7f84c4064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4064340 0x7f84c4064720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 >> v1:172.21.15.150:6789/0 conn(0x7f84c40c98b0 legacy=0x7f84c40c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c40c6f30 con 0x7f84c40bec60 2023-08-17T18:12:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f84bc001470 con 0x7f84c40bec60 2023-08-17T18:12:23.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4064340 0x7f84c4064720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:23.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 >> v1:172.21.15.78:6789/0 conn(0x7f84c40bec60 legacy=0x7f84c40c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4064340 0x7f84b0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b0003f90 0x7f84b0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b0004b80 0x7f84b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40638b0 con 0x7f84b0003f90 2023-08-17T18:12:23.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b000b940 con 0x7f84b0004b80 2023-08-17T18:12:23.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b000bb00 con 0x7f84c4064340 2023-08-17T18:12:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c9caa700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b0003f90 0x7f84b0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4064340 0x7f84b0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84cacac700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b0004b80 0x7f84b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c9caa700 1 -- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4064340 msgr2=0x7f84b0003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c9caa700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4064340 0x7f84b0003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c9caa700 1 -- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b0004b80 msgr2=0x7f84b0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.724+0000 7f84c9caa700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b0004b80 0x7f84b0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84c9caa700 1 -- 172.21.15.78:0/3888337490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c0009a20 con 0x7f84b0003f90 2023-08-17T18:12:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84c9caa700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b0003f90 0x7f84b0004690 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f84c4068aa0 tx=0x7f84b4007bb0).ready entity=mon.0 client_cookie=9decc8fad14cf717 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4007020 con 0x7f84b0003f90 2023-08-17T18:12:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b4007180 con 0x7f84b0003f90 2023-08-17T18:12:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84c94a9700 1 -- 172.21.15.78:0/3888337490 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4007500 con 0x7f84b0003f90 2023-08-17T18:12:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84cc70f700 1 -- 172.21.15.78:0/3888337490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b0003f90 msgr2=0x7f84b0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84cc70f700 1 --2- 172.21.15.78:0/3888337490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b0003f90 0x7f84b0004690 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f84c4068aa0 tx=0x7f84b4007bb0).stop 2023-08-17T18:12:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84cacac700 1 -- 172.21.15.78:0/3888337490 reap_dead start 2023-08-17T18:12:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84cc70f700 1 -- 172.21.15.78:0/3888337490 shutdown_connections 2023-08-17T18:12:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84cc70f700 1 -- 172.21.15.78:0/3888337490 >> 172.21.15.78:0/3888337490 conn(0x7f84c4062cd0 msgr2=0x7f84c40c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84cc70f700 1 -- 172.21.15.78:0/3888337490 shutdown_connections 2023-08-17T18:12:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.725+0000 7f84cc70f700 1 -- 172.21.15.78:0/3888337490 wait complete. 2023-08-17T18:12:23.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.726+0000 7f84cc70f700 1 Processor -- start 2023-08-17T18:12:23.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.727+0000 7f84cc70f700 1 -- start start 2023-08-17T18:12:23.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.727+0000 7f84cc70f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b0003f90 0x7f84c414f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.727+0000 7f84cc70f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4165400 0x7f84c4167f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.727+0000 7f84cc70f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4168440 0x7f84c40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.727+0000 7f84cc70f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40aca20 con 0x7f84c4165400 2023-08-17T18:12:23.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.727+0000 7f84cc70f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c414f850 con 0x7f84b0003f90 2023-08-17T18:12:23.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.727+0000 7f84cc70f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c4164950 con 0x7f84c4168440 2023-08-17T18:12:23.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.727+0000 7f84c9caa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4165400 0x7f84c4167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.727+0000 7f84c9caa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4165400 0x7f84c4167f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47444/0 (socket says 172.21.15.78:47444) 2023-08-17T18:12:23.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.727+0000 7f84c9caa700 1 -- 172.21.15.78:0/2308902380 learned_addr learned my addr 172.21.15.78:0/2308902380 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:23.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b0003f90 0x7f84c414f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84cacac700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4168440 0x7f84c40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84c9caa700 1 -- 172.21.15.78:0/2308902380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4168440 msgr2=0x7f84c40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84c9caa700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4168440 0x7f84c40c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84c9caa700 1 -- 172.21.15.78:0/2308902380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b0003f90 msgr2=0x7f84c414f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84c9caa700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b0003f90 0x7f84c414f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84c9caa700 1 -- 172.21.15.78:0/2308902380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c41689a0 con 0x7f84c4165400 2023-08-17T18:12:23.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b0003f90 0x7f84c414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:23.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84c9caa700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4165400 0x7f84c4167f50 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f84c40c5760 tx=0x7f84b4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:23.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84ba7fc700 1 -- 172.21.15.78:0/2308902380 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b401e440 con 0x7f84c4165400 2023-08-17T18:12:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84ba7fc700 1 -- 172.21.15.78:0/2308902380 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b401e5a0 con 0x7f84c4165400 2023-08-17T18:12:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84cc70f700 1 -- 172.21.15.78:0/2308902380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c4168c80 con 0x7f84c4165400 2023-08-17T18:12:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84ba7fc700 1 -- 172.21.15.78:0/2308902380 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b401e960 con 0x7f84c4165400 2023-08-17T18:12:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.728+0000 7f84cc70f700 1 -- 172.21.15.78:0/2308902380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c4164ee0 con 0x7f84c4165400 2023-08-17T18:12:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.729+0000 7f84ba7fc700 1 -- 172.21.15.78:0/2308902380 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f84b4018070 con 0x7f84c4165400 2023-08-17T18:12:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.729+0000 7f84ba7fc700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84a805ed90 0x7f84a8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.730+0000 7f84ba7fc700 1 -- 172.21.15.78:0/2308902380 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f84b407a8f0 con 0x7f84c4165400 2023-08-17T18:12:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.730+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84a805ed90 0x7f84a8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.730+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84a805ed90 0x7f84a8061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f84c0009390 tx=0x7f84c000b040).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.732+0000 7f84de0a4b80 1 Processor -- start 2023-08-17T18:12:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.732+0000 7f84de0a4b80 1 -- start start 2023-08-17T18:12:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.732+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.732+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3092168c0 0x55a3091c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.732+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 0x55a3091c9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.732+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a309193d00 con 0x55a3091cdc20 2023-08-17T18:12:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.732+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30910acb0 con 0x55a3092168c0 2023-08-17T18:12:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.732+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a30911fc90 con 0x55a3091c93f0 2023-08-17T18:12:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84ca4ab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84ca4ab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47458/0 (socket says 172.21.15.78:47458) 2023-08-17T18:12:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84ca4ab700 1 -- 172.21.15.78:0/1598290413 learned_addr learned my addr 172.21.15.78:0/1598290413 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84cacac700 1 --2- 172.21.15.78:0/1598290413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 0x55a3091c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84c9caa700 1 --2- 172.21.15.78:0/1598290413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3092168c0 0x55a3091c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84ca4ab700 1 -- 172.21.15.78:0/1598290413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 msgr2=0x55a3091c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/1598290413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 0x55a3091c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84ca4ab700 1 -- 172.21.15.78:0/1598290413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3092168c0 msgr2=0x55a3091c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/1598290413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3092168c0 0x55a3091c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84ca4ab700 1 -- 172.21.15.78:0/1598290413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a308fc2310 con 0x55a3091cdc20 2023-08-17T18:12:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84c9caa700 1 --2- 172.21.15.78:0/1598290413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3092168c0 0x55a3091c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/1598290413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ce000 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f84c0016640 tx=0x7f84c0017000).ready entity=mon.0 client_cookie=f6073498ce034dba server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84a77fe700 1 -- 172.21.15.78:0/1598290413 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c000e040 con 0x55a3091cdc20 2023-08-17T18:12:23.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84a77fe700 1 -- 172.21.15.78:0/1598290413 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c000f040 con 0x55a3091cdc20 2023-08-17T18:12:23.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.733+0000 7f84a77fe700 1 -- 172.21.15.78:0/1598290413 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0021610 con 0x55a3091cdc20 2023-08-17T18:12:23.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.734+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1598290413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 msgr2=0x55a3091ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.734+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/1598290413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ce000 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f84c0016640 tx=0x7f84c0017000).stop 2023-08-17T18:12:23.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.734+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1598290413 shutdown_connections 2023-08-17T18:12:23.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.734+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/1598290413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 0x55a3091c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.734+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/1598290413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ce000 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.734+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/1598290413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3092168c0 0x55a3091c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.734+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1598290413 >> 172.21.15.78:0/1598290413 conn(0x55a308f8ae40 msgr2=0x55a309216d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:23.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.734+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1598290413 shutdown_connections 2023-08-17T18:12:23.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.734+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1598290413 wait complete. 2023-08-17T18:12:23.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.734+0000 7f84de0a4b80 1 -- start start 2023-08-17T18:12:23.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.735+0000 7f84de0a4b80 1 Processor -- start 2023-08-17T18:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.735+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 0x55a3091eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.735+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091cdc20 0x55a309211330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.735+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3092168c0 0x55a309226a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.735+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3090e6ef0 con 0x55a3092168c0 2023-08-17T18:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.735+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3090eb8d0 con 0x55a3091c93f0 2023-08-17T18:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.735+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3091ee260 con 0x55a3091cdc20 2023-08-17T18:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.735+0000 7f84de0a4b80 10 client.0 ll_register_callbacks cb 0x55a30918dce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T18:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84cacac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3092168c0 0x55a309226a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84cacac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3092168c0 0x55a309226a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47466/0 (socket says 172.21.15.78:47466) 2023-08-17T18:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84cacac700 1 -- 172.21.15.78:0/4219562874 learned_addr learned my addr 172.21.15.78:0/4219562874 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 0x55a3091eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84c9caa700 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091cdc20 0x55a309211330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84cacac700 1 -- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091cdc20 msgr2=0x55a309211330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84cacac700 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091cdc20 0x55a309211330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84cacac700 1 -- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 msgr2=0x55a3091eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84cacac700 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 0x55a3091eb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84cacac700 1 -- 172.21.15.78:0/4219562874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c0016460 con 0x55a3092168c0 2023-08-17T18:12:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84cacac700 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3092168c0 0x55a309226a00 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f84c40634f0 tx=0x7f84bc009040).ready entity=mon.0 client_cookie=2495c644b7c10620 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T18:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84a4ff9700 1 -- 172.21.15.78:0/4219562874 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc007610 con 0x55a3092168c0 2023-08-17T18:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84a4ff9700 1 -- 172.21.15.78:0/4219562874 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f84bc015c30 con 0x55a3092168c0 2023-08-17T18:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84de0a4b80 1 -- 172.21.15.78:0/4219562874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3091c80f0 con 0x55a3092168c0 2023-08-17T18:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84a4ff9700 1 -- 172.21.15.78:0/4219562874 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84bc016430 con 0x55a3092168c0 2023-08-17T18:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84de0a4b80 10 client.9684 fetch_fsmap learned FSMap version 67 2023-08-17T18:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84de0a4b80 1 -- 172.21.15.78:0/4219562874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55a309118e70 con 0x55a3092168c0 2023-08-17T18:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84a4ff9700 1 -- 172.21.15.78:0/4219562874 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a3091c80f0 con 0x55a3092168c0 2023-08-17T18:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.736+0000 7f84a4ff9700 1 -- 172.21.15.78:0/4219562874 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 67) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f84bc016590 con 0x55a3092168c0 2023-08-17T18:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.737+0000 7f84de0a4b80 10 client.9684 fetch_fsmap finished waiting for FSMap version 67 2023-08-17T18:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.737+0000 7f84de0a4b80 10 client.9684 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-17T18:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.737+0000 7f84de0a4b80 20 client.9684 populate_metadata read hostname 'smithi078' 2023-08-17T18:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.737+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:6833/2525491694,v1:172.21.15.150:6835/2525491694] conn(0x55a3091eed70 0x55a3091ef150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.737+0000 7f84de0a4b80 4 client.9684 mds_command: new command op to 9537 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T18:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.737+0000 7f84de0a4b80 1 -- 172.21.15.78:0/4219562874 --> [v2:172.21.15.150:6833/2525491694,v1:172.21.15.150:6835/2525491694] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a309197b50 con 0x55a3091eed70 2023-08-17T18:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.737+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:6833/2525491694,v1:172.21.15.150:6835/2525491694] conn(0x55a3091eed70 0x55a3091ef150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.737+0000 7f84a4ff9700 10 client.9684 ms_handle_connect on v2:172.21.15.150:6833/2525491694 2023-08-17T18:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.737+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:6833/2525491694,v1:172.21.15.150:6835/2525491694] conn(0x55a3091eed70 0x55a3091ef150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2005d5313dc8574f server_cookie=62162668b0104090 in_seq=0 out_seq=0 2023-08-17T18:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84a4ff9700 1 -- 172.21.15.78:0/4219562874 <== mds.0 v2:172.21.15.150:6833/2525491694 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55a309197b50 con 0x55a3091eed70 2023-08-17T18:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84a4ff9700 10 client.9684 handle_command_reply: tid=0 2023-08-17T18:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 client.9684 shutdown 2023-08-17T18:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 -- 172.21.15.78:0/4219562874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3092168c0 msgr2=0x55a309226a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3092168c0 0x55a309226a00 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f84c40634f0 tx=0x7f84bc009040).stop 2023-08-17T18:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 -- 172.21.15.78:0/4219562874 shutdown_connections 2023-08-17T18:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:6833/2525491694,v1:172.21.15.150:6835/2525491694] conn(0x55a3091eed70 0x55a3091ef150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3092168c0 0x55a309226a00 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84a4ff9700 0 client.9684 ms_handle_reset on v2:172.21.15.150:6833/2525491694 2023-08-17T18:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 0x55a3091eb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/4219562874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091cdc20 0x55a309211330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 -- 172.21.15.78:0/4219562874 >> 172.21.15.78:0/4219562874 conn(0x55a308f8ae40 msgr2=0x55a3091cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 -- 172.21.15.78:0/4219562874 shutdown_connections 2023-08-17T18:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 1 -- 172.21.15.78:0/4219562874 wait complete. 2023-08-17T18:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.738+0000 7f84de0a4b80 20 client.9684 trim_cache size 0 max 16384 2023-08-17T18:12:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.754+0000 7f84de0a4b80 1 Processor -- start 2023-08-17T18:12:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.755+0000 7f84de0a4b80 1 -- start start 2023-08-17T18:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.755+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 0x55a3091cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.755+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091cdc20 0x55a3091f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.755+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091eed70 0x55a3091ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.755+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3091cec50 con 0x55a3091eed70 2023-08-17T18:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.755+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3091eb090 con 0x55a3091c93f0 2023-08-17T18:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.755+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3091ea8d0 con 0x55a3091cdc20 2023-08-17T18:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.755+0000 7f84cacac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091eed70 0x55a3091ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.755+0000 7f84cacac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091eed70 0x55a3091ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47468/0 (socket says 172.21.15.78:47468) 2023-08-17T18:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.755+0000 7f84cacac700 1 -- 172.21.15.78:0/2870893863 learned_addr learned my addr 172.21.15.78:0/2870893863 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84c9caa700 1 --2- 172.21.15.78:0/2870893863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091cdc20 0x55a3091f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/2870893863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 0x55a3091cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84cacac700 1 -- 172.21.15.78:0/2870893863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091cdc20 msgr2=0x55a3091f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84cacac700 1 --2- 172.21.15.78:0/2870893863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091cdc20 0x55a3091f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84cacac700 1 -- 172.21.15.78:0/2870893863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 msgr2=0x55a3091cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84cacac700 1 --2- 172.21.15.78:0/2870893863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 0x55a3091cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84cacac700 1 -- 172.21.15.78:0/2870893863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3091f9350 con 0x55a3091eed70 2023-08-17T18:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/2870893863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 0x55a3091cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84cacac700 1 --2- 172.21.15.78:0/2870893863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091eed70 0x55a3091ce760 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f84bc023050 tx=0x7f84bc01d000).ready entity=mon.0 client_cookie=7dddba5cd87780f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84a7fff700 1 -- 172.21.15.78:0/2870893863 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc007570 con 0x55a3091eed70 2023-08-17T18:12:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84a7fff700 1 -- 172.21.15.78:0/2870893863 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc001650 con 0x55a3091eed70 2023-08-17T18:12:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84a7fff700 1 -- 172.21.15.78:0/2870893863 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc016430 con 0x55a3091eed70 2023-08-17T18:12:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84de0a4b80 1 -- 172.21.15.78:0/2870893863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091eed70 msgr2=0x55a3091ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/2870893863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091eed70 0x55a3091ce760 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f84bc023050 tx=0x7f84bc01d000).stop 2023-08-17T18:12:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84de0a4b80 1 -- 172.21.15.78:0/2870893863 shutdown_connections 2023-08-17T18:12:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/2870893863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091eed70 0x55a3091ce760 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/2870893863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091c93f0 0x55a3091cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/2870893863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091cdc20 0x55a3091f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84de0a4b80 1 -- 172.21.15.78:0/2870893863 >> 172.21.15.78:0/2870893863 conn(0x55a308f8ae40 msgr2=0x55a3091c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84de0a4b80 1 -- 172.21.15.78:0/2870893863 shutdown_connections 2023-08-17T18:12:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.756+0000 7f84de0a4b80 1 -- 172.21.15.78:0/2870893863 wait complete. 2023-08-17T18:12:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.757+0000 7f84de0a4b80 1 -- start start 2023-08-17T18:12:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.757+0000 7f84de0a4b80 1 Processor -- start 2023-08-17T18:12:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 0x55a30920ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84de0a4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091eed70 0x55a3091ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3091edcd0 con 0x55a3091cdc20 2023-08-17T18:12:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3091ca000 con 0x55a3091eed70 2023-08-17T18:12:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84de0a4b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a309222830 con 0x55a3091c93f0 2023-08-17T18:12:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84de0a4b80 10 client.0 ll_register_callbacks cb 0x55a30918dce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T18:12:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84c9caa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84c9caa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ed2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47478/0 (socket says 172.21.15.78:47478) 2023-08-17T18:12:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84c9caa700 1 -- 172.21.15.78:0/1212662447 learned_addr learned my addr 172.21.15.78:0/1212662447 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84cacac700 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091eed70 0x55a3091ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 0x55a30920ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84c9caa700 1 -- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 msgr2=0x55a30920ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84c9caa700 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 0x55a30920ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84c9caa700 1 -- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091eed70 msgr2=0x55a3091ed7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84c9caa700 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091eed70 0x55a3091ed7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84c9caa700 1 -- 172.21.15.78:0/1212662447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a309118e70 con 0x55a3091cdc20 2023-08-17T18:12:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.758+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 0x55a30920ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84c9caa700 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ed2f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f84b404f850 tx=0x7f84b4029040).ready entity=mon.0 client_cookie=c5cedd820928e8f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-08-17T18:12:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84a4ff9700 1 -- 172.21.15.78:0/1212662447 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b400cc40 con 0x55a3091cdc20 2023-08-17T18:12:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84a4ff9700 1 -- 172.21.15.78:0/1212662447 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f84b400cda0 con 0x55a3091cdc20 2023-08-17T18:12:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1212662447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84c000f040 con 0x55a3091cdc20 2023-08-17T18:12:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84a4ff9700 1 -- 172.21.15.78:0/1212662447 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84b404f250 con 0x55a3091cdc20 2023-08-17T18:12:23.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84de0a4b80 10 client.9690 fetch_fsmap learned FSMap version 67 2023-08-17T18:12:23.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1212662447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55a309114480 con 0x55a3091cdc20 2023-08-17T18:12:23.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84a4ff9700 1 -- 172.21.15.78:0/1212662447 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c000f040 con 0x55a3091cdc20 2023-08-17T18:12:23.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84a4ff9700 1 -- 172.21.15.78:0/1212662447 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 67) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f84b404b940 con 0x55a3091cdc20 2023-08-17T18:12:23.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84de0a4b80 10 client.9690 fetch_fsmap finished waiting for FSMap version 67 2023-08-17T18:12:23.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84de0a4b80 10 client.9690 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-17T18:12:23.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84de0a4b80 20 client.9690 populate_metadata read hostname 'smithi078' 2023-08-17T18:12:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:6833/2525491694,v1:172.21.15.150:6835/2525491694] conn(0x55a3092168c0 0x55a3092782c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84de0a4b80 4 client.9690 mds_command: new command op to 9537 tid=0[{"prefix": "status"}] 2023-08-17T18:12:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1212662447 --> [v2:172.21.15.150:6833/2525491694,v1:172.21.15.150:6835/2525491694] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a308f86ca0 con 0x55a3092168c0 2023-08-17T18:12:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.759+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:6833/2525491694,v1:172.21.15.150:6835/2525491694] conn(0x55a3092168c0 0x55a3092782c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84a4ff9700 10 client.9690 ms_handle_connect on v2:172.21.15.150:6833/2525491694 2023-08-17T18:12:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84ca4ab700 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:6833/2525491694,v1:172.21.15.150:6835/2525491694] conn(0x55a3092168c0 0x55a3092782c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4f1fa2da0f7bf8c6 server_cookie=d2b410620c724af2 in_seq=0 out_seq=0 2023-08-17T18:12:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84a4ff9700 1 -- 172.21.15.78:0/1212662447 <== mds.0 v2:172.21.15.150:6833/2525491694 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55a308f86ca0 con 0x55a3092168c0 2023-08-17T18:12:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84a4ff9700 10 client.9690 handle_command_reply: tid=0 2023-08-17T18:12:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 client.9690 shutdown 2023-08-17T18:12:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1212662447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 msgr2=0x55a3091ed2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ed2f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f84b404f850 tx=0x7f84b4029040).stop 2023-08-17T18:12:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1212662447 shutdown_connections 2023-08-17T18:12:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:6833/2525491694,v1:172.21.15.150:6835/2525491694] conn(0x55a3092168c0 0x55a3092782c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3091eed70 0x55a3091ed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84a4ff9700 0 client.9690 ms_handle_reset on v2:172.21.15.150:6833/2525491694 2023-08-17T18:12:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a3091c93f0 0x55a30920ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 --2- 172.21.15.78:0/1212662447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a3091cdc20 0x55a3091ed2f0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1212662447 >> 172.21.15.78:0/1212662447 conn(0x55a308f8ae40 msgr2=0x55a309222f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1212662447 shutdown_connections 2023-08-17T18:12:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 1 -- 172.21.15.78:0/1212662447 wait complete. 2023-08-17T18:12:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.760+0000 7f84de0a4b80 20 client.9690 trim_cache size 0 max 16384 2023-08-17T18:12:23.771 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:12:23.772 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c71a8d58-9c80-42ad-9365-61f3329fa340", 2023-08-17T18:12:23.772 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-08-17T18:12:23.772 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 9537, 2023-08-17T18:12:23.772 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-08-17T18:12:23.772 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-08-17T18:12:23.772 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-08-17T18:12:23.772 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 4.6344517190000003, 2023-08-17T18:12:23.773 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 67, 2023-08-17T18:12:23.773 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 185, 2023-08-17T18:12:23.773 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 185, 2023-08-17T18:12:23.773 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 9.1506573820000003 2023-08-17T18:12:23.773 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:12:23.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 -- 172.21.15.78:0/2308902380 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84a805ed90 msgr2=0x7f84a8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84a805ed90 0x7f84a8061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f84c0009390 tx=0x7f84c000b040).stop 2023-08-17T18:12:23.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 -- 172.21.15.78:0/2308902380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4165400 msgr2=0x7f84c4167f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4165400 0x7f84c4167f50 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f84c40c5760 tx=0x7f84b4016000).stop 2023-08-17T18:12:23.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 -- 172.21.15.78:0/2308902380 shutdown_connections 2023-08-17T18:12:23.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f84a805ed90 0x7f84a8061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84c4168440 0x7f84c40c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84b0003f90 0x7f84c414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 --2- 172.21.15.78:0/2308902380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4165400 0x7f84c4167f50 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 -- 172.21.15.78:0/2308902380 >> 172.21.15.78:0/2308902380 conn(0x7f84c4062cd0 msgr2=0x7f84c40a5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:23.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 -- 172.21.15.78:0/2308902380 shutdown_connections 2023-08-17T18:12:23.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.761+0000 7f84cc70f700 1 -- 172.21.15.78:0/2308902380 wait complete. 2023-08-17T18:12:23.776 DEBUG:teuthology.orchestra.run.smithi078:> ceph fs ls 2023-08-17T18:12:23.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.876+0000 7f97a7fff700 1 Processor -- start 2023-08-17T18:12:23.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.876+0000 7f97a7fff700 1 -- start start 2023-08-17T18:12:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97a8154fe0 0x7f97a80c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a80c62c0 0x7f97a8063980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a7fff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a8158a50 con 0x7f97a8063e70 2023-08-17T18:12:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a7fff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a8157c00 con 0x7f97a8154fe0 2023-08-17T18:12:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a7fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a8064300 con 0x7f97a80c62c0 2023-08-17T18:12:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97a8154fe0 0x7f97a80c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97a8154fe0 0x7f97a80c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47492/0 (socket says 172.21.15.78:47492) 2023-08-17T18:12:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a6ffd700 1 -- 172.21.15.78:0/221037155 learned_addr learned my addr 172.21.15.78:0/221037155 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a6ffd700 1 -- 172.21.15.78:0/221037155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a80c62c0 msgr2=0x7f97a8063980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f979e7fc700 1 --2- 172.21.15.78:0/221037155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a80c62c0 0x7f97a8063980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a6ffd700 1 --2- 172.21.15.78:0/221037155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a80c62c0 0x7f97a8063980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a6ffd700 1 -- 172.21.15.78:0/221037155 >> v1:172.21.15.150:6789/0 conn(0x7f97a8063e70 legacy=0x7f97a8064f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.877+0000 7f97a6ffd700 1 -- 172.21.15.78:0/221037155 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a81544b0 con 0x7f97a8154fe0 2023-08-17T18:12:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a6ffd700 1 --2- 172.21.15.78:0/221037155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a8154fe0 0x7f97a80c5dd0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7f9798006fd0 tx=0x7f97980090f0).ready entity=mon.0 client_cookie=c14bb3ba1cdd7887 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a67fc700 1 -- 172.21.15.78:0/221037155 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800b600 con 0x7f97a8154fe0 2023-08-17T18:12:23.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a67fc700 1 -- 172.21.15.78:0/221037155 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800b760 con 0x7f97a8154fe0 2023-08-17T18:12:23.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a67fc700 1 -- 172.21.15.78:0/221037155 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800bb00 con 0x7f97a8154fe0 2023-08-17T18:12:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a7fff700 1 -- 172.21.15.78:0/221037155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a8154fe0 msgr2=0x7f97a80c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a7fff700 1 --2- 172.21.15.78:0/221037155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a8154fe0 0x7f97a80c5dd0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7f9798006fd0 tx=0x7f97980090f0).stop 2023-08-17T18:12:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a7fff700 1 -- 172.21.15.78:0/221037155 shutdown_connections 2023-08-17T18:12:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a7fff700 1 --2- 172.21.15.78:0/221037155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a8154fe0 0x7f97a80c5dd0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a7fff700 1 --2- 172.21.15.78:0/221037155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a80c62c0 0x7f97a8063980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a7fff700 1 -- 172.21.15.78:0/221037155 >> 172.21.15.78:0/221037155 conn(0x7f97a80cae00 msgr2=0x7f97a80cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a7fff700 1 -- 172.21.15.78:0/221037155 shutdown_connections 2023-08-17T18:12:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.878+0000 7f97a7fff700 1 -- 172.21.15.78:0/221037155 wait complete. 2023-08-17T18:12:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.879+0000 7f97a7fff700 1 Processor -- start 2023-08-17T18:12:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.880+0000 7f97a7fff700 1 -- start start 2023-08-17T18:12:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.880+0000 7f97a7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a8063e70 0x7f97a80c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.880+0000 7f97a7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c62c0 0x7f97a8147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.880+0000 7f97a7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8154fe0 0x7f97a80c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.880+0000 7f97a7fff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81482f0 con 0x7f97a80c62c0 2023-08-17T18:12:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.880+0000 7f97a7fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80add90 con 0x7f97a8154fe0 2023-08-17T18:12:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.880+0000 7f97a7fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80c36c0 con 0x7f97a8063e70 2023-08-17T18:12:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.880+0000 7f979e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c62c0 0x7f97a8147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.880+0000 7f979e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c62c0 0x7f97a8147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47496/0 (socket says 172.21.15.78:47496) 2023-08-17T18:12:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.880+0000 7f979e7fc700 1 -- 172.21.15.78:0/2453229463 learned_addr learned my addr 172.21.15.78:0/2453229463 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f97a77fe700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8154fe0 0x7f97a80c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f97a6ffd700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a8063e70 0x7f97a80c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f979e7fc700 1 -- 172.21.15.78:0/2453229463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a8063e70 msgr2=0x7f97a80c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f979e7fc700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a8063e70 0x7f97a80c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f979e7fc700 1 -- 172.21.15.78:0/2453229463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8154fe0 msgr2=0x7f97a80c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f979e7fc700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8154fe0 0x7f97a80c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f979e7fc700 1 -- 172.21.15.78:0/2453229463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798009370 con 0x7f97a80c62c0 2023-08-17T18:12:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f97a77fe700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8154fe0 0x7f97a80c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f979e7fc700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c62c0 0x7f97a8147e00 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f979000c880 tx=0x7f9790008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f979f7fe700 1 -- 172.21.15.78:0/2453229463 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790010580 con 0x7f97a80c62c0 2023-08-17T18:12:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f979f7fe700 1 -- 172.21.15.78:0/2453229463 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97900106e0 con 0x7f97a80c62c0 2023-08-17T18:12:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f97a7fff700 1 -- 172.21.15.78:0/2453229463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a80c39a0 con 0x7f97a80c62c0 2023-08-17T18:12:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f979f7fe700 1 -- 172.21.15.78:0/2453229463 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790010a60 con 0x7f97a80c62c0 2023-08-17T18:12:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.881+0000 7f97a7fff700 1 -- 172.21.15.78:0/2453229463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a80adfe0 con 0x7f97a80c62c0 2023-08-17T18:12:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.882+0000 7f97a7fff700 1 -- 172.21.15.78:0/2453229463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a8154a90 con 0x7f97a80c62c0 2023-08-17T18:12:23.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.882+0000 7f979f7fe700 1 -- 172.21.15.78:0/2453229463 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f979001b460 con 0x7f97a80c62c0 2023-08-17T18:12:23.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.883+0000 7f979f7fe700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f978805ed90 0x7f9788061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:23.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.883+0000 7f97a6ffd700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f978805ed90 0x7f9788061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:23.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.883+0000 7f979f7fe700 1 -- 172.21.15.78:0/2453229463 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9790079bf0 con 0x7f97a80c62c0 2023-08-17T18:12:23.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.883+0000 7f97a6ffd700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f978805ed90 0x7f9788061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f979800b3c0 tx=0x7f9798017000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:23.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:23.887+0000 7f979f7fe700 1 -- 172.21.15.78:0/2453229463 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f979004b130 con 0x7f97a80c62c0 2023-08-17T18:12:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.089+0000 7f97a7fff700 1 -- 172.21.15.78:0/2453229463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f97a805f1a0 con 0x7f97a80c62c0 2023-08-17T18:12:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.090+0000 7f979f7fe700 1 -- 172.21.15.78:0/2453229463 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7f979004e750 con 0x7f97a80c62c0 2023-08-17T18:12:24.091 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T18:12:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 -- 172.21.15.78:0/2453229463 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f978805ed90 msgr2=0x7f9788061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f978805ed90 0x7f9788061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f979800b3c0 tx=0x7f9798017000).stop 2023-08-17T18:12:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 -- 172.21.15.78:0/2453229463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c62c0 msgr2=0x7f97a8147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c62c0 0x7f97a8147e00 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f979000c880 tx=0x7f9790008040).stop 2023-08-17T18:12:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 -- 172.21.15.78:0/2453229463 shutdown_connections 2023-08-17T18:12:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f978805ed90 0x7f9788061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97a8154fe0 0x7f97a80c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97a8063e70 0x7f97a80c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 --2- 172.21.15.78:0/2453229463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c62c0 0x7f97a8147e00 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 -- 172.21.15.78:0/2453229463 >> 172.21.15.78:0/2453229463 conn(0x7f97a80cae00 msgr2=0x7f97a81539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 -- 172.21.15.78:0/2453229463 shutdown_connections 2023-08-17T18:12:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.092+0000 7f97a7fff700 1 -- 172.21.15.78:0/2453229463 wait complete. 2023-08-17T18:12:24.103 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T18:12:24.104 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T18:12:24.104 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-08-17T18:12:24.104 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T18:12:24.105 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T18:12:24.105 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T18:12:24.105 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T18:12:24.105 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T18:12:24.106 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T18:12:24.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:24.106 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-08-17T18:12:24.121 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T18:12:24.121 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T18:12:24.121 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T18:12:24.121 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:12:24.122 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-08-17T18:12:24.122 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:12:24.122 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T18:12:24.122 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-08-17T18:12:24.122 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-08-17T18:12:24.122 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T18:12:24.122 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-08-17T18:12:24.123 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-08-17T18:12:24.123 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-17T18:12:24.123 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-08-17T18:12:24.123 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T18:12:24.123 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-08-17T18:12:24.123 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-17T18:12:24.123 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 39935sec preferred_lft 39935sec 2023-08-17T18:12:24.123 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-08-17T18:12:24.124 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:12:24.124 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T18:12:24.124 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff 2023-08-17T18:12:24.124 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T18:12:24.124 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:12:24.124 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::94c6:30ff:fe81:8e85/64 scope link 2023-08-17T18:12:24.124 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:12:24.125 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T18:12:24.125 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 92:a2:f2:dd:11:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T18:12:24.125 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::90a2:f2ff:fedd:11d6/64 scope link 2023-08-17T18:12:24.125 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:12:24.125 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T18:12:24.125 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:54:39:93:1c:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T18:12:24.125 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::54:39ff:fe93:1c36/64 scope link 2023-08-17T18:12:24.125 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-08-17T18:12:24.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:24.126 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T18:12:24.185 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-08-17T18:12:24.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:24.187 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-08-17T18:12:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-08-17T18:12:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T18:12:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T18:12:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-17T18:12:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T18:12:24.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:24.245 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-08-17T18:12:24.245 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-08-17T18:12:24.245 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T18:12:24.245 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T18:12:24.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T18:12:24.246 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-08-17T18:12:24.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:24.343 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T18:12:24.357 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T18:12:24.357 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T18:12:24.358 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T18:12:24.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:24.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-08-17T18:12:24.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:24.422 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T18:12:24.476 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T18:12:24.476 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T18:12:24.554 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T18:12:24.554 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T18:12:24.580 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T18:12:24.580 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T18:12:24.583 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T18:12:24.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:24.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T18:12:24.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-17T18:12:24.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.800+0000 7f07fe2f3700 1 Processor -- start 2023-08-17T18:12:24.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.800+0000 7f07fe2f3700 1 -- start start 2023-08-17T18:12:24.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.801+0000 7f07fe2f3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07f8154580 0x7f07f80a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:24.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.801+0000 7f07fe2f3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f07f80c0560 0x7f07f80c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:24.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.801+0000 7f07fe2f3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f80c8df0 con 0x7f07f81541a0 2023-08-17T18:12:24.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.801+0000 7f07fe2f3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f80a8190 con 0x7f07f8154580 2023-08-17T18:12:24.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.801+0000 7f07fe2f3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f80c9970 con 0x7f07f80c0560 2023-08-17T18:12:24.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.801+0000 7f07f77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07f8154580 0x7f07f80a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:24.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.801+0000 7f07f7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f07f81541a0 0x7f07f80bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53264/0 (socket says 172.21.15.78:53264) 2023-08-17T18:12:24.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.801+0000 7f07f77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07f8154580 0x7f07f80a7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47500/0 (socket says 172.21.15.78:47500) 2023-08-17T18:12:24.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.801+0000 7f07f7fff700 1 -- 172.21.15.78:0/2744262472 learned_addr learned my addr 172.21.15.78:0/2744262472 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:24.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.801+0000 7f07fc890700 1 --2- 172.21.15.78:0/2744262472 >> v2:172.21.15.150:3300/0 conn(0x7f07f80c0560 0x7f07f80c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:24.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07f77fe700 1 -- 172.21.15.78:0/2744262472 >> v2:172.21.15.150:3300/0 conn(0x7f07f80c0560 msgr2=0x7f07f80c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:24.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07f77fe700 1 --2- 172.21.15.78:0/2744262472 >> v2:172.21.15.150:3300/0 conn(0x7f07f80c0560 0x7f07f80c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:24.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07f77fe700 1 -- 172.21.15.78:0/2744262472 >> v1:172.21.15.78:6789/0 conn(0x7f07f81541a0 legacy=0x7f07f80bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:24.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07f77fe700 1 -- 172.21.15.78:0/2744262472 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80c9040 con 0x7f07f8154580 2023-08-17T18:12:24.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07f6ffd700 1 -- 172.21.15.78:0/2744262472 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859471885 0 0) 0x7f07f80c8df0 con 0x7f07f81541a0 2023-08-17T18:12:24.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07f77fe700 1 --2- 172.21.15.78:0/2744262472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f8154580 0x7f07f80a7ca0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7f07f8157d80 tx=0x7f07ec009060).ready entity=mon.0 client_cookie=90542f9eccb6808d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:24.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07f6ffd700 1 -- 172.21.15.78:0/2744262472 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0090d0 con 0x7f07f8154580 2023-08-17T18:12:24.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07f6ffd700 1 -- 172.21.15.78:0/2744262472 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec00f510 con 0x7f07f8154580 2023-08-17T18:12:24.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07f6ffd700 1 -- 172.21.15.78:0/2744262472 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec00f890 con 0x7f07f8154580 2023-08-17T18:12:24.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07fe2f3700 1 -- 172.21.15.78:0/2744262472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f8154580 msgr2=0x7f07f80a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:24.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07fe2f3700 1 --2- 172.21.15.78:0/2744262472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f8154580 0x7f07f80a7ca0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7f07f8157d80 tx=0x7f07ec009060).stop 2023-08-17T18:12:24.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07fe2f3700 1 -- 172.21.15.78:0/2744262472 shutdown_connections 2023-08-17T18:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07fe2f3700 1 --2- 172.21.15.78:0/2744262472 >> v2:172.21.15.150:3300/0 conn(0x7f07f80c0560 0x7f07f80c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07fe2f3700 1 --2- 172.21.15.78:0/2744262472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f8154580 0x7f07f80a7ca0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07fe2f3700 1 -- 172.21.15.78:0/2744262472 >> 172.21.15.78:0/2744262472 conn(0x7f07f806a400 msgr2=0x7f07f80caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.802+0000 7f07fe2f3700 1 -- 172.21.15.78:0/2744262472 shutdown_connections 2023-08-17T18:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.803+0000 7f07fe2f3700 1 -- 172.21.15.78:0/2744262472 wait complete. 2023-08-17T18:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.804+0000 7f07fe2f3700 1 Processor -- start 2023-08-17T18:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.804+0000 7f07fe2f3700 1 -- start start 2023-08-17T18:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.804+0000 7f07fe2f3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c0560 0x7f07f80ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.804+0000 7f07fe2f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07f81541a0 0x7f07f814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.804+0000 7f07fe2f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07f8154580 0x7f07f81669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07fe2f3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f814fff0 con 0x7f07f80c0560 2023-08-17T18:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07fe2f3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80aef00 con 0x7f07f8154580 2023-08-17T18:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07fe2f3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80af1e0 con 0x7f07f81541a0 2023-08-17T18:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07f7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c0560 0x7f07f80ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07f7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c0560 0x7f07f80ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47510/0 (socket says 172.21.15.78:47510) 2023-08-17T18:12:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07f7fff700 1 -- 172.21.15.78:0/1642446691 learned_addr learned my addr 172.21.15.78:0/1642446691 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07f7fff700 1 -- 172.21.15.78:0/1642446691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07f81541a0 msgr2=0x7f07f814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07f7fff700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07f81541a0 0x7f07f814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07f7fff700 1 -- 172.21.15.78:0/1642446691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07f8154580 msgr2=0x7f07f81669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07f7fff700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07f8154580 0x7f07f81669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07f7fff700 1 -- 172.21.15.78:0/1642446691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0092a0 con 0x7f07f80c0560 2023-08-17T18:12:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07f7fff700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c0560 0x7f07f80ae870 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7f07e800c4e0 tx=0x7f07e8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07dffff700 1 -- 172.21.15.78:0/1642446691 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80072e0 con 0x7f07f80c0560 2023-08-17T18:12:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07dffff700 1 -- 172.21.15.78:0/1642446691 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e8007440 con 0x7f07f80c0560 2023-08-17T18:12:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07fe2f3700 1 -- 172.21.15.78:0/1642446691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f80af4c0 con 0x7f07f80c0560 2023-08-17T18:12:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07dffff700 1 -- 172.21.15.78:0/1642446691 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80057a0 con 0x7f07f80c0560 2023-08-17T18:12:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.805+0000 7f07fe2f3700 1 -- 172.21.15.78:0/1642446691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f80afa80 con 0x7f07f80c0560 2023-08-17T18:12:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.806+0000 7f07fe2f3700 1 -- 172.21.15.78:0/1642446691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f8163be0 con 0x7f07f80c0560 2023-08-17T18:12:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.806+0000 7f07dffff700 1 -- 172.21.15.78:0/1642446691 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f07e801a060 con 0x7f07f80c0560 2023-08-17T18:12:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.807+0000 7f07dffff700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f07e405ed90 0x7f07e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.807+0000 7f07dffff700 1 -- 172.21.15.78:0/1642446691 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f07e80793d0 con 0x7f07f80c0560 2023-08-17T18:12:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.807+0000 7f07f77fe700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f07e405ed90 0x7f07e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.807+0000 7f07f77fe700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f07e405ed90 0x7f07e4061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f07f8157d80 tx=0x7f07ec017000).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.811+0000 7f07dffff700 1 -- 172.21.15.78:0/1642446691 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f07e804a970 con 0x7f07f80c0560 2023-08-17T18:12:24.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:24.999+0000 7f07fe2f3700 1 -- 172.21.15.78:0/1642446691 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f07f80af070 con 0x7f07e405ed90 2023-08-17T18:12:25.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.000+0000 7f07dffff700 1 -- 172.21.15.78:0/1642446691 <== mgr.9348 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f07f80af070 con 0x7f07e405ed90 2023-08-17T18:12:25.001 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-08-17T18:12:25.001 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-08-17T18:12:25.001 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephfs" 2023-08-17T18:12:25.001 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-08-17T18:12:25.001 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-08-17T18:12:25.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 -- 172.21.15.78:0/1642446691 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f07e405ed90 msgr2=0x7f07e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:25.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f07e405ed90 0x7f07e4061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f07f8157d80 tx=0x7f07ec017000).stop 2023-08-17T18:12:25.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 -- 172.21.15.78:0/1642446691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c0560 msgr2=0x7f07f80ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:25.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c0560 0x7f07f80ae870 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7f07e800c4e0 tx=0x7f07e8007c70).stop 2023-08-17T18:12:25.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 -- 172.21.15.78:0/1642446691 shutdown_connections 2023-08-17T18:12:25.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f07e405ed90 0x7f07e4061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:25.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07f8154580 0x7f07f81669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:25.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c0560 0x7f07f80ae870 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:25.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 --2- 172.21.15.78:0/1642446691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07f81541a0 0x7f07f814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:25.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 -- 172.21.15.78:0/1642446691 >> 172.21.15.78:0/1642446691 conn(0x7f07f806a400 msgr2=0x7f07f8063cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:25.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 -- 172.21.15.78:0/1642446691 shutdown_connections 2023-08-17T18:12:25.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.002+0000 7f07fe2f3700 1 -- 172.21.15.78:0/1642446691 wait complete. 2023-08-17T18:12:25.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-17T18:12:25.036 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T18:12:25.037+0000 7f8bb21d7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T18:12:25.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.128+0000 7f23690ab700 1 Processor -- start 2023-08-17T18:12:25.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.128+0000 7f23690ab700 1 -- start start 2023-08-17T18:12:25.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.129+0000 7f23690ab700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f23640a5860 0x7f23640a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:25.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.129+0000 7f23690ab700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23640a6a10 con 0x7f23640a7390 2023-08-17T18:12:25.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.129+0000 7f23690ab700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23640a5e00 con 0x7f2364151c80 2023-08-17T18:12:25.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.129+0000 7f23690ab700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23640a60e0 con 0x7f23640a5860 2023-08-17T18:12:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.129+0000 7f23688aa700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f23640a7390 0x7f23640bda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53266/0 (socket says 172.21.15.78:53266) 2023-08-17T18:12:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.129+0000 7f23688aa700 1 -- 172.21.15.78:0/2930222854 learned_addr learned my addr 172.21.15.78:0/2930222854 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.129+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466845692 0 0) 0x7f23640a6a10 con 0x7f23640a7390 2023-08-17T18:12:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.129+0000 7f23637fe700 1 --2- 172.21.15.78:0/2930222854 >> v2:172.21.15.150:3300/0 conn(0x7f23640a5860 0x7f23640a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.129+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f234c0033f0 con 0x7f23640a7390 2023-08-17T18:12:25.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3571049568 0 0) 0x7f234c0033f0 con 0x7f23640a7390 2023-08-17T18:12:25.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 >> v2:172.21.15.150:3300/0 conn(0x7f23640a5860 msgr2=0x7f23640a6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:25.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 --2- 172.21.15.78:0/2930222854 >> v2:172.21.15.150:3300/0 conn(0x7f23640a5860 0x7f23640a6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 >> v1:172.21.15.150:6789/0 conn(0x7f2364151c80 legacy=0x7f2364062db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640a63c0 con 0x7f23640a7390 2023-08-17T18:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f235c0017f0 con 0x7f23640a7390 2023-08-17T18:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 >> v1:172.21.15.78:6789/0 conn(0x7f23640a7390 legacy=0x7f23640bda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f234c0038e0 0x7f234c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f234c004690 0x7f234c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f234c005000 0x7f234c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640a60e0 con 0x7f234c005000 2023-08-17T18:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00be00 con 0x7f234c0038e0 2023-08-17T18:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00bfc0 con 0x7f234c004690 2023-08-17T18:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f23688aa700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f234c005000 0x7f234c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2363fff700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f234c0038e0 0x7f234c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f23637fe700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f234c004690 0x7f234c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f23688aa700 1 -- 172.21.15.78:0/2930222854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f234c004690 msgr2=0x7f234c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f23688aa700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f234c004690 0x7f234c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:25.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f23688aa700 1 -- 172.21.15.78:0/2930222854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f234c0038e0 msgr2=0x7f234c003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:25.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f23688aa700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f234c0038e0 0x7f234c003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:25.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f23688aa700 1 -- 172.21.15.78:0/2930222854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c0033f0 con 0x7f234c005000 2023-08-17T18:12:25.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f23688aa700 1 -- 172.21.15.78:0/2930222854 reap_dead start 2023-08-17T18:12:25.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f23688aa700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f234c005000 0x7f234c00b8e0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f235c00c5c0 tx=0x7f235c001d90).ready entity=mon.0 client_cookie=168266cbbc4c73b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:25.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00ce90 con 0x7f234c005000 2023-08-17T18:12:25.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c001fc0 con 0x7f234c005000 2023-08-17T18:12:25.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.130+0000 7f2362ffd700 1 -- 172.21.15.78:0/2930222854 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c005d50 con 0x7f234c005000 2023-08-17T18:12:25.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.131+0000 7f23690ab700 1 -- 172.21.15.78:0/2930222854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f234c005000 msgr2=0x7f234c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:25.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.131+0000 7f23690ab700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f234c005000 0x7f234c00b8e0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f235c00c5c0 tx=0x7f235c001d90).stop 2023-08-17T18:12:25.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.131+0000 7f23690ab700 1 -- 172.21.15.78:0/2930222854 shutdown_connections 2023-08-17T18:12:25.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.131+0000 7f23690ab700 1 --2- 172.21.15.78:0/2930222854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f234c005000 0x7f234c00b8e0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:25.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.131+0000 7f23690ab700 1 -- 172.21.15.78:0/2930222854 >> 172.21.15.78:0/2930222854 conn(0x7f236406a660 msgr2=0x7f23640921a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:25.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.131+0000 7f23690ab700 1 -- 172.21.15.78:0/2930222854 shutdown_connections 2023-08-17T18:12:25.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.131+0000 7f23690ab700 1 -- 172.21.15.78:0/2930222854 wait complete. 2023-08-17T18:12:25.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.132+0000 7f23690ab700 1 Processor -- start 2023-08-17T18:12:25.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.132+0000 7f23690ab700 1 -- start start 2023-08-17T18:12:25.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23690ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f234c005000 0x7f23640ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:25.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23690ab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640a8b30 0x7f23640a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:25.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23690ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23640a9770 0x7f2364153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:25.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23690ab700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2364153320 con 0x7f23640a8b30 2023-08-17T18:12:25.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23690ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2364152730 con 0x7f23640a9770 2023-08-17T18:12:25.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23690ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23640ab5a0 con 0x7f234c005000 2023-08-17T18:12:25.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23637fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640a8b30 0x7f23640a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:25.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23637fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640a8b30 0x7f23640a9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47526/0 (socket says 172.21.15.78:47526) 2023-08-17T18:12:25.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23637fe700 1 -- 172.21.15.78:0/1358618291 learned_addr learned my addr 172.21.15.78:0/1358618291 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:25.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f2363fff700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f234c005000 0x7f23640ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:25.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23688aa700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23640a9770 0x7f2364153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:25.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23637fe700 1 -- 172.21.15.78:0/1358618291 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f234c005000 msgr2=0x7f23640ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:25.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23637fe700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f234c005000 0x7f23640ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:25.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23637fe700 1 -- 172.21.15.78:0/1358618291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23640a9770 msgr2=0x7f2364153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:25.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23637fe700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23640a9770 0x7f2364153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:25.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.133+0000 7f23637fe700 1 -- 172.21.15.78:0/1358618291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364152980 con 0x7f23640a8b30 2023-08-17T18:12:25.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.134+0000 7f23637fe700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640a8b30 0x7f23640a9280 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7f23580119c0 tx=0x7f2358009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:25.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.134+0000 7f234bfff700 1 -- 172.21.15.78:0/1358618291 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358011e50 con 0x7f23640a8b30 2023-08-17T18:12:25.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.134+0000 7f234bfff700 1 -- 172.21.15.78:0/1358618291 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235800f940 con 0x7f23640a8b30 2023-08-17T18:12:25.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.134+0000 7f234bfff700 1 -- 172.21.15.78:0/1358618291 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235800fd00 con 0x7f23640a8b30 2023-08-17T18:12:25.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.134+0000 7f23690ab700 1 -- 172.21.15.78:0/1358618291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2364152c60 con 0x7f23640a8b30 2023-08-17T18:12:25.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.134+0000 7f23690ab700 1 -- 172.21.15.78:0/1358618291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236414db00 con 0x7f23640a8b30 2023-08-17T18:12:25.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.135+0000 7f23690ab700 1 -- 172.21.15.78:0/1358618291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23641552a0 con 0x7f23640a8b30 2023-08-17T18:12:25.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.135+0000 7f234bfff700 1 -- 172.21.15.78:0/1358618291 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 89) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2358024070 con 0x7f23640a8b30 2023-08-17T18:12:25.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.135+0000 7f234bfff700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f235005ed90 0x7f2350061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:25.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.135+0000 7f234bfff700 1 -- 172.21.15.78:0/1358618291 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f235807a1f0 con 0x7f23640a8b30 2023-08-17T18:12:25.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.135+0000 7f2363fff700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f235005ed90 0x7f2350061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:25.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.136+0000 7f2363fff700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f235005ed90 0x7f2350061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2354007cf0 tx=0x7f2354007be0).ready entity=mgr.9348 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:25.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.139+0000 7f234bfff700 1 -- 172.21.15.78:0/1358618291 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f235804b790 con 0x7f23640a8b30 2023-08-17T18:12:25.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:25.346+0000 7f23690ab700 1 -- 172.21.15.78:0/1358618291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f2364153460 con 0x7f23640a8b30 2023-08-17T18:12:26.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.162+0000 7f234bfff700 1 -- 172.21.15.78:0/1358618291 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 90) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f235801a030 con 0x7f23640a8b30 2023-08-17T18:12:26.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.163+0000 7f234bfff700 1 -- 172.21.15.78:0/1358618291 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v90) v1 ==== 92+0+0 (secure 0 0 0) 0x7f235806f980 con 0x7f23640a8b30 2023-08-17T18:12:26.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 -- 172.21.15.78:0/1358618291 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f235005ed90 msgr2=0x7f2350061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f235005ed90 0x7f2350061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2354007cf0 tx=0x7f2354007be0).stop 2023-08-17T18:12:26.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 -- 172.21.15.78:0/1358618291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640a8b30 msgr2=0x7f23640a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640a8b30 0x7f23640a9280 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7f23580119c0 tx=0x7f2358009060).stop 2023-08-17T18:12:26.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 -- 172.21.15.78:0/1358618291 shutdown_connections 2023-08-17T18:12:26.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f235005ed90 0x7f2350061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23640a9770 0x7f2364153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f234c005000 0x7f23640ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 --2- 172.21.15.78:0/1358618291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640a8b30 0x7f23640a9280 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 -- 172.21.15.78:0/1358618291 >> 172.21.15.78:0/1358618291 conn(0x7f236406a660 msgr2=0x7f23640bda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:26.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 -- 172.21.15.78:0/1358618291 shutdown_connections 2023-08-17T18:12:26.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.165+0000 7f23690ab700 1 -- 172.21.15.78:0/1358618291 wait complete. 2023-08-17T18:12:26.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-17T18:12:26.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.302+0000 7fa2ea82a700 1 Processor -- start 2023-08-17T18:12:26.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.302+0000 7fa2ea82a700 1 -- start start 2023-08-17T18:12:26.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2ea82a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 0x7fa2e406b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2ea82a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e40bd260 con 0x7fa2e4063600 2023-08-17T18:12:26.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2ea82a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e4151d70 con 0x7fa2e40c51b0 2023-08-17T18:12:26.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2ea82a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4152050 con 0x7fa2e414ea30 2023-08-17T18:12:26.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2ea029700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa2e4063600 0x7fa2e40bd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53284/0 (socket says 172.21.15.78:53284) 2023-08-17T18:12:26.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2ea029700 1 -- 172.21.15.78:0/2515431009 learned_addr learned my addr 172.21.15.78:0/2515431009 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:26.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2e9828700 1 --2- 172.21.15.78:0/2515431009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 0x7fa2e406b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:26.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2e8826700 1 -- 172.21.15.78:0/2515431009 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998498639 0 0) 0x7fa2e40bd260 con 0x7fa2e4063600 2023-08-17T18:12:26.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2e8826700 1 -- 172.21.15.78:0/2515431009 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d00033f0 con 0x7fa2e4063600 2023-08-17T18:12:26.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2e8826700 1 -- 172.21.15.78:0/2515431009 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47078513 0 0) 0x7fa2e4151d70 con 0x7fa2e40c51b0 2023-08-17T18:12:26.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2e8826700 1 -- 172.21.15.78:0/2515431009 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e40bd260 con 0x7fa2e40c51b0 2023-08-17T18:12:26.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2e9828700 1 -- 172.21.15.78:0/2515431009 >> v1:172.21.15.150:6789/0 conn(0x7fa2e40c51b0 legacy=0x7fa2e41514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2e9828700 1 -- 172.21.15.78:0/2515431009 >> v1:172.21.15.78:6789/0 conn(0x7fa2e4063600 legacy=0x7fa2e40bd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.303+0000 7fa2e9828700 1 -- 172.21.15.78:0/2515431009 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e4152330 con 0x7fa2e414ea30 2023-08-17T18:12:26.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2e9828700 1 --2- 172.21.15.78:0/2515431009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 0x7fa2e406b280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fa2e0009790 tx=0x7fa2e0009060).ready entity=mon.2 client_cookie=2bc3b6324ccef0a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:26.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2e8826700 1 -- 172.21.15.78:0/2515431009 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e000f510 con 0x7fa2e414ea30 2023-08-17T18:12:26.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2e8826700 1 -- 172.21.15.78:0/2515431009 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e000f670 con 0x7fa2e414ea30 2023-08-17T18:12:26.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2e8826700 1 -- 172.21.15.78:0/2515431009 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e000f9f0 con 0x7fa2e414ea30 2023-08-17T18:12:26.307 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:26.306+0000 7fdda4f2c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:12:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2ea82a700 1 -- 172.21.15.78:0/2515431009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 msgr2=0x7fa2e406b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2ea82a700 1 --2- 172.21.15.78:0/2515431009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 0x7fa2e406b280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fa2e0009790 tx=0x7fa2e0009060).stop 2023-08-17T18:12:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2ea82a700 1 -- 172.21.15.78:0/2515431009 shutdown_connections 2023-08-17T18:12:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2ea82a700 1 --2- 172.21.15.78:0/2515431009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 0x7fa2e406b280 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2ea82a700 1 -- 172.21.15.78:0/2515431009 >> 172.21.15.78:0/2515431009 conn(0x7fa2e40c3e20 msgr2=0x7fa2e40c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2ea82a700 1 -- 172.21.15.78:0/2515431009 shutdown_connections 2023-08-17T18:12:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.304+0000 7fa2ea82a700 1 -- 172.21.15.78:0/2515431009 wait complete. 2023-08-17T18:12:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2ea82a700 1 Processor -- start 2023-08-17T18:12:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2ea82a700 1 -- start start 2023-08-17T18:12:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2ea82a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4063600 0x7fa2e413fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2ea82a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40c51b0 0x7fa2e40a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2ea82a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 0x7fa2e40a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2ea82a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4168820 con 0x7fa2e4063600 2023-08-17T18:12:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2ea82a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40a95d0 con 0x7fa2e40c51b0 2023-08-17T18:12:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2ea82a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4167e80 con 0x7fa2e414ea30 2023-08-17T18:12:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2e9828700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4063600 0x7fa2e413fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2e9828700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4063600 0x7fa2e413fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47554/0 (socket says 172.21.15.78:47554) 2023-08-17T18:12:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2e9828700 1 -- 172.21.15.78:0/1606331864 learned_addr learned my addr 172.21.15.78:0/1606331864 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.306+0000 7fa2ea029700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 0x7fa2e40a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2e9027700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40c51b0 0x7fa2e40a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2e9828700 1 -- 172.21.15.78:0/1606331864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 msgr2=0x7fa2e40a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2e9828700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 0x7fa2e40a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2e9828700 1 -- 172.21.15.78:0/1606331864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40c51b0 msgr2=0x7fa2e40a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2e9828700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40c51b0 0x7fa2e40a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2e9828700 1 -- 172.21.15.78:0/1606331864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00092a0 con 0x7fa2e4063600 2023-08-17T18:12:26.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2e9828700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4063600 0x7fa2e413fca0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7fa2e40c5180 tx=0x7fa2e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:26.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2d9ffb700 1 -- 172.21.15.78:0/1606331864 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e000fe80 con 0x7fa2e4063600 2023-08-17T18:12:26.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2d9ffb700 1 -- 172.21.15.78:0/1606331864 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e000f7e0 con 0x7fa2e4063600 2023-08-17T18:12:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2ea82a700 1 -- 172.21.15.78:0/1606331864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e4168160 con 0x7fa2e4063600 2023-08-17T18:12:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2d9ffb700 1 -- 172.21.15.78:0/1606331864 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e001b640 con 0x7fa2e4063600 2023-08-17T18:12:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.307+0000 7fa2ea82a700 1 -- 172.21.15.78:0/1606331864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e4168c40 con 0x7fa2e4063600 2023-08-17T18:12:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.308+0000 7fa2ea82a700 1 -- 172.21.15.78:0/1606331864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e405f910 con 0x7fa2e4063600 2023-08-17T18:12:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.308+0000 7fa2d9ffb700 1 -- 172.21.15.78:0/1606331864 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 90) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fa2e000f070 con 0x7fa2e4063600 2023-08-17T18:12:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.309+0000 7fa2d9ffb700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2c805ede0 0x7fa2c80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.309+0000 7fa2e9027700 1 -- 172.21.15.78:0/1606331864 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2c805ede0 msgr2=0x7fa2c80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.309+0000 7fa2d9ffb700 1 -- 172.21.15.78:0/1606331864 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa2e007b100 con 0x7fa2e4063600 2023-08-17T18:12:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.309+0000 7fa2e9027700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2c805ede0 0x7fa2c80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:26.315 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:26.311+0000 7f807a315680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:12:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.313+0000 7fa2d9ffb700 1 -- 172.21.15.78:0/1606331864 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa2e004c6a0 con 0x7fa2e4063600 2023-08-17T18:12:26.370 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:26.370+0000 7fdda4f2c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:12:26.376 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:26.376+0000 7f807a315680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:12:26.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.485+0000 7fa2ea82a700 1 -- 172.21.15.78:0/1606331864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fa2e4046af0 con 0x7fa2e4063600 2023-08-17T18:12:26.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.489+0000 7fa2d9ffb700 1 -- 172.21.15.78:0/1606331864 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v39)=0 v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa2e0024360 con 0x7fa2e4063600 2023-08-17T18:12:26.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 -- 172.21.15.78:0/1606331864 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2c805ede0 msgr2=0x7fa2c80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:26.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2c805ede0 0x7fa2c80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:26.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 -- 172.21.15.78:0/1606331864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4063600 msgr2=0x7fa2e413fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4063600 0x7fa2e413fca0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7fa2e40c5180 tx=0x7fa2e0017000).stop 2023-08-17T18:12:26.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 -- 172.21.15.78:0/1606331864 shutdown_connections 2023-08-17T18:12:26.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2c805ede0 0x7fa2c80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e414ea30 0x7fa2e40a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4063600 0x7fa2e413fca0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 --2- 172.21.15.78:0/1606331864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40c51b0 0x7fa2e40a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 -- 172.21.15.78:0/1606331864 >> 172.21.15.78:0/1606331864 conn(0x7fa2e40c3e20 msgr2=0x7fa2e4151110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 -- 172.21.15.78:0/1606331864 shutdown_connections 2023-08-17T18:12:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.491+0000 7fa2ea82a700 1 -- 172.21.15.78:0/1606331864 wait complete. 2023-08-17T18:12:26.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:12:26.504 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-17T18:12:26.523 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-17T18:12:26.650 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:26.650+0000 7fdda4f2c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:12:26.664 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:26.664+0000 7f807a315680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:12:26.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.684+0000 7fd6def73700 1 Processor -- start 2023-08-17T18:12:26.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.684+0000 7fd6def73700 1 -- start start 2023-08-17T18:12:26.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6def73700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6d8154440 0x7fd6d80a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6def73700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6d80ca920 0x7fd6d80c0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6def73700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80c9d80 con 0x7fd6d80bfea0 2023-08-17T18:12:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6def73700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d80c07f0 con 0x7fd6d80ca920 2023-08-17T18:12:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6def73700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d80c9170 con 0x7fd6d8154440 2023-08-17T18:12:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6dd510700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6d80ca920 0x7fd6d80c0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6dd510700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6d80ca920 0x7fd6d80c0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47568/0 (socket says 172.21.15.78:47568) 2023-08-17T18:12:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6dd510700 1 -- 172.21.15.78:0/592488511 learned_addr learned my addr 172.21.15.78:0/592488511 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6dcd0f700 1 --2- 172.21.15.78:0/592488511 >> v2:172.21.15.150:3300/0 conn(0x7fd6d8154440 0x7fd6d80a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6dd510700 1 -- 172.21.15.78:0/592488511 >> v2:172.21.15.150:3300/0 conn(0x7fd6d8154440 msgr2=0x7fd6d80a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:26.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6dd510700 1 --2- 172.21.15.78:0/592488511 >> v2:172.21.15.150:3300/0 conn(0x7fd6d8154440 0x7fd6d80a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6dd510700 1 -- 172.21.15.78:0/592488511 >> v1:172.21.15.150:6789/0 conn(0x7fd6d80bfea0 legacy=0x7fd6d80ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6dd510700 1 -- 172.21.15.78:0/592488511 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80c9450 con 0x7fd6d80ca920 2023-08-17T18:12:26.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6dd510700 1 --2- 172.21.15.78:0/592488511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 0x7fd6d80c0300 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7fd6d80628c0 tx=0x7fd6d0009840).ready entity=mon.0 client_cookie=51d2c34f00df3c5d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:26.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6d77fe700 1 -- 172.21.15.78:0/592488511 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000e070 con 0x7fd6d80ca920 2023-08-17T18:12:26.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6d77fe700 1 -- 172.21.15.78:0/592488511 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d000ba20 con 0x7fd6d80ca920 2023-08-17T18:12:26.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.685+0000 7fd6d77fe700 1 -- 172.21.15.78:0/592488511 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000bda0 con 0x7fd6d80ca920 2023-08-17T18:12:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.686+0000 7fd6def73700 1 -- 172.21.15.78:0/592488511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 msgr2=0x7fd6d80c0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.686+0000 7fd6def73700 1 --2- 172.21.15.78:0/592488511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 0x7fd6d80c0300 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7fd6d80628c0 tx=0x7fd6d0009840).stop 2023-08-17T18:12:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.686+0000 7fd6def73700 1 -- 172.21.15.78:0/592488511 shutdown_connections 2023-08-17T18:12:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.686+0000 7fd6def73700 1 --2- 172.21.15.78:0/592488511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 0x7fd6d80c0300 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.686+0000 7fd6def73700 1 --2- 172.21.15.78:0/592488511 >> v2:172.21.15.150:3300/0 conn(0x7fd6d8154440 0x7fd6d80a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.686+0000 7fd6def73700 1 -- 172.21.15.78:0/592488511 >> 172.21.15.78:0/592488511 conn(0x7fd6d806a400 msgr2=0x7fd6d80caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.686+0000 7fd6def73700 1 -- 172.21.15.78:0/592488511 shutdown_connections 2023-08-17T18:12:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.686+0000 7fd6def73700 1 -- 172.21.15.78:0/592488511 wait complete. 2023-08-17T18:12:26.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.688+0000 7fd6def73700 1 Processor -- start 2023-08-17T18:12:26.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.688+0000 7fd6def73700 1 -- start start 2023-08-17T18:12:26.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.689+0000 7fd6def73700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d80bfea0 0x7fd6d80af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.689+0000 7fd6def73700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 0x7fd6d8168ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.689+0000 7fd6def73700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8154440 0x7fd6d81469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.689+0000 7fd6def73700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d81504a0 con 0x7fd6d80ca920 2023-08-17T18:12:26.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.689+0000 7fd6def73700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80afca0 con 0x7fd6d80bfea0 2023-08-17T18:12:26.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.689+0000 7fd6def73700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8168fc0 con 0x7fd6d8154440 2023-08-17T18:12:26.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.689+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 0x7fd6d8168ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:26.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 0x7fd6d8168ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47580/0 (socket says 172.21.15.78:47580) 2023-08-17T18:12:26.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d7fff700 1 -- 172.21.15.78:0/4116577246 learned_addr learned my addr 172.21.15.78:0/4116577246 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:26.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6dcd0f700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d80bfea0 0x7fd6d80af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:26.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6dd510700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8154440 0x7fd6d81469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:26.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d7fff700 1 -- 172.21.15.78:0/4116577246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8154440 msgr2=0x7fd6d81469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d7fff700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8154440 0x7fd6d81469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d7fff700 1 -- 172.21.15.78:0/4116577246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d80bfea0 msgr2=0x7fd6d80af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:26.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d7fff700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d80bfea0 0x7fd6d80af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:26.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d7fff700 1 -- 172.21.15.78:0/4116577246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0009ae0 con 0x7fd6d80ca920 2023-08-17T18:12:26.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d7fff700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 0x7fd6d8168ad0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7fd6c400c4c0 tx=0x7fd6c4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:26.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400ce70 con 0x7fd6d80ca920 2023-08-17T18:12:26.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4001e90 con 0x7fd6d80ca920 2023-08-17T18:12:26.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6def73700 1 -- 172.21.15.78:0/4116577246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80ae710 con 0x7fd6d80ca920 2023-08-17T18:12:26.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4007250 con 0x7fd6d80ca920 2023-08-17T18:12:26.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.690+0000 7fd6def73700 1 -- 172.21.15.78:0/4116577246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d80aecd0 con 0x7fd6d80ca920 2023-08-17T18:12:26.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.691+0000 7fd6def73700 1 -- 172.21.15.78:0/4116577246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d8065620 con 0x7fd6d80ca920 2023-08-17T18:12:26.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.691+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 90) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fd6c4010070 con 0x7fd6d80ca920 2023-08-17T18:12:26.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.692+0000 7fd6d4ff9700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:26.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.692+0000 7fd6dcd0f700 1 -- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 msgr2=0x7fd6bc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:26.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.692+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd6c40792b0 con 0x7fd6d80ca920 2023-08-17T18:12:26.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.692+0000 7fd6dcd0f700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:26.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.696+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd6c404a850 con 0x7fd6d80ca920 2023-08-17T18:12:26.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.893+0000 7fd6dcd0f700 1 -- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 msgr2=0x7fd6bc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:26.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.893+0000 7fd6dcd0f700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:26.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:26.894+0000 7fd6def73700 1 -- 172.21.15.78:0/4116577246 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6d8065140 con 0x7fd6bc05ede0 2023-08-17T18:12:27.274 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:27.274+0000 7fdda4f2c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:12:27.289 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:27.289+0000 7f807a315680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:12:27.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:27.294+0000 7fd6dcd0f700 1 -- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 msgr2=0x7fd6bc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:27.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:27.294+0000 7fd6dcd0f700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T18:12:27.346 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:27.346+0000 7fdda4f2c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:12:27.362 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:27.361+0000 7f807a315680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:12:27.534 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:27.534+0000 7fdda4f2c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:12:27.547 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:27.546+0000 7f807a315680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:12:27.955 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:27.955+0000 7fdda4f2c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:12:27.965 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:27.965+0000 7f807a315680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:12:28.059 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:28.059+0000 7fdda4f2c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:28.069 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:28.068+0000 7f807a315680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:28.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:28.095+0000 7fd6dcd0f700 1 -- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 msgr2=0x7fd6bc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:28.095+0000 7fd6dcd0f700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T18:12:28.212 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:28.212+0000 7fdda4f2c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:28.221 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:28.220+0000 7f807a315680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:28.287 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:28.287+0000 7fdda4f2c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:12:28.295 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:28.294+0000 7f807a315680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:12:28.355 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:28.354+0000 7fdda4f2c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:12:28.363 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:28.362+0000 7f807a315680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:12:28.615 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:28.615+0000 7fdda4f2c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:12:28.620 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:28.619+0000 7f807a315680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:12:28.801 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:28.801+0000 7fdda4f2c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:28.802 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:28.801+0000 7f807a315680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:29.448 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:29.448+0000 7f807a315680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:12:29.456 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:29.456+0000 7fdda4f2c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:12:29.517 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:29.516+0000 7f807a315680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:12:29.525 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:29.525+0000 7fdda4f2c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:12:29.592 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:29.592+0000 7f807a315680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:12:29.602 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:29.602+0000 7fdda4f2c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:12:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:29.696+0000 7fd6dcd0f700 1 -- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 msgr2=0x7fd6bc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:29.696+0000 7fd6dcd0f700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-17T18:12:29.740 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:29.739+0000 7f807a315680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:12:29.751 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:29.750+0000 7fdda4f2c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:12:29.810 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:29.809+0000 7f807a315680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:12:29.823 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:29.823+0000 7fdda4f2c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:12:29.925 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:29.925+0000 7f807a315680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:12:29.939 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:29.939+0000 7fdda4f2c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:12:30.033 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.032+0000 7f807a315680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:30.047 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:30.047+0000 7fdda4f2c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:30.321 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.320+0000 7f807a315680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:12:30.338 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:30.338+0000 7fdda4f2c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:12:30.393 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.392+0000 7f807a315680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:12:30.410 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:30.410+0000 7fdda4f2c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:12:30.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:30.411+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 91) v1 ==== 75109+0+0 (secure 0 0 0) 0x7fd6c40771b0 con 0x7fd6d80ca920 2023-08-17T18:12:30.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:30.411+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 msgr2=0x7fd6bc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:30.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:30.411+0000 7fd6d4ff9700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:30.481 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.480+0000 7f7ff5aed700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:30.481 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.480+0000 7f7ff5aed700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:30.481 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.480+0000 7f7ff5aed700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:30.481 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.480+0000 7f7ff5aed700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:30.481 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.480+0000 7f7ff5aed700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:30.482 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.480+0000 7f7ff8af3700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:30.482 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.480+0000 7f7ff8af3700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:30.482 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.480+0000 7f7ff8af3700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:30.482 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.480+0000 7f7ff8af3700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:30.482 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:30.480+0000 7f7ff8af3700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:31.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.415+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mgrmap(e 92) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fd6c4006d90 con 0x7fd6d80ca920 2023-08-17T18:12:31.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.416+0000 7fd6d4ff9700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc02fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.416+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6d8065140 con 0x7fd6bc05ede0 2023-08-17T18:12:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.416+0000 7fd6dcd0f700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc02fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.417+0000 7fd6dcd0f700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc02fd40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd6cc0094f0 tx=0x7fd6cc009060).ready entity=mgr.9723 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:31.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.435+0000 7fd6d4ff9700 1 -- 172.21.15.78:0/4116577246 <== mgr.9723 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd6d8065140 con 0x7fd6bc05ede0 2023-08-17T18:12:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path snap_test_dir1 2023-08-17T18:12:31.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 -- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 msgr2=0x7fd6bc02fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc02fd40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd6cc0094f0 tx=0x7fd6cc009060).stop 2023-08-17T18:12:31.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 -- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 msgr2=0x7fd6d8168ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 0x7fd6d8168ad0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7fd6c400c4c0 tx=0x7fd6c4007e00).stop 2023-08-17T18:12:31.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 -- 172.21.15.78:0/4116577246 shutdown_connections 2023-08-17T18:12:31.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd6bc05ede0 0x7fd6bc02fd40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8154440 0x7fd6d81469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d80bfea0 0x7fd6d80af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 --2- 172.21.15.78:0/4116577246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6d80ca920 0x7fd6d8168ad0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 -- 172.21.15.78:0/4116577246 >> 172.21.15.78:0/4116577246 conn(0x7fd6d806a400 msgr2=0x7fd6d80c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:31.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 -- 172.21.15.78:0/4116577246 shutdown_connections 2023-08-17T18:12:31.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.437+0000 7fd6def73700 1 -- 172.21.15.78:0/4116577246 wait complete. 2023-08-17T18:12:31.452 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-17T18:12:31.452 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-08-17T18:12:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.576+0000 7f68f719e700 1 Processor -- start 2023-08-17T18:12:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.576+0000 7f68f719e700 1 -- start start 2023-08-17T18:12:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.577+0000 7f68f719e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f68f0151e20 0x7f68f00c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.577+0000 7f68f719e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f68f0157be0 0x7f68f0158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.577+0000 7f68f719e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f0158520 con 0x7f68f0151a40 2023-08-17T18:12:31.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.577+0000 7f68f719e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00c6620 con 0x7f68f0151e20 2023-08-17T18:12:31.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.577+0000 7f68f719e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00c6900 con 0x7f68f0157be0 2023-08-17T18:12:31.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.577+0000 7f68f619c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f68f0151a40 0x7f68f00c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54800/0 (socket says 172.21.15.78:54800) 2023-08-17T18:12:31.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.577+0000 7f68f619c700 1 -- 172.21.15.78:0/1844388314 learned_addr learned my addr 172.21.15.78:0/1844388314 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.577+0000 7f68f599b700 1 --2- 172.21.15.78:0/1844388314 >> v2:172.21.15.78:3300/0 conn(0x7f68f0151e20 0x7f68f00c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.577+0000 7f68f699d700 1 --2- 172.21.15.78:0/1844388314 >> v2:172.21.15.150:3300/0 conn(0x7f68f0157be0 0x7f68f0158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f599b700 1 -- 172.21.15.78:0/1844388314 >> v2:172.21.15.150:3300/0 conn(0x7f68f0157be0 msgr2=0x7f68f0158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f599b700 1 --2- 172.21.15.78:0/1844388314 >> v2:172.21.15.150:3300/0 conn(0x7f68f0157be0 0x7f68f0158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f599b700 1 -- 172.21.15.78:0/1844388314 >> v1:172.21.15.78:6789/0 conn(0x7f68f0151a40 legacy=0x7f68f00c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f519a700 1 -- 172.21.15.78:0/1844388314 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698306435 0 0) 0x7f68f0158520 con 0x7f68f0151a40 2023-08-17T18:12:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f599b700 1 -- 172.21.15.78:0/1844388314 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00c6be0 con 0x7f68f0151e20 2023-08-17T18:12:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f599b700 1 --2- 172.21.15.78:0/1844388314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0151e20 0x7f68f00c8260 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f68f0155770 tx=0x7f68e0006f40).ready entity=mon.0 client_cookie=8da92d4c85179a77 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:31.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f519a700 1 -- 172.21.15.78:0/1844388314 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0005880 con 0x7f68f0151e20 2023-08-17T18:12:31.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f519a700 1 -- 172.21.15.78:0/1844388314 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e00059e0 con 0x7f68f0151e20 2023-08-17T18:12:31.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f519a700 1 -- 172.21.15.78:0/1844388314 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0005d60 con 0x7f68f0151e20 2023-08-17T18:12:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f719e700 1 -- 172.21.15.78:0/1844388314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0151e20 msgr2=0x7f68f00c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f719e700 1 --2- 172.21.15.78:0/1844388314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0151e20 0x7f68f00c8260 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f68f0155770 tx=0x7f68e0006f40).stop 2023-08-17T18:12:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f719e700 1 -- 172.21.15.78:0/1844388314 shutdown_connections 2023-08-17T18:12:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f719e700 1 --2- 172.21.15.78:0/1844388314 >> v2:172.21.15.150:3300/0 conn(0x7f68f0157be0 0x7f68f0158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f719e700 1 --2- 172.21.15.78:0/1844388314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0151e20 0x7f68f00c8260 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f719e700 1 -- 172.21.15.78:0/1844388314 >> 172.21.15.78:0/1844388314 conn(0x7f68f00943b0 msgr2=0x7f68f006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f719e700 1 -- 172.21.15.78:0/1844388314 shutdown_connections 2023-08-17T18:12:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.578+0000 7f68f719e700 1 -- 172.21.15.78:0/1844388314 wait complete. 2023-08-17T18:12:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f719e700 1 Processor -- start 2023-08-17T18:12:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f719e700 1 -- start start 2023-08-17T18:12:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f719e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68f0151a40 0x7f68f0152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f719e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f0151e20 0x7f68f00c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f719e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0157be0 0x7f68f014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f719e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f0167cc0 con 0x7f68f0157be0 2023-08-17T18:12:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f719e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c4290 con 0x7f68f0151a40 2023-08-17T18:12:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f719e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f01527e0 con 0x7f68f0151e20 2023-08-17T18:12:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f699d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0157be0 0x7f68f014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f699d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0157be0 0x7f68f014b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34616/0 (socket says 172.21.15.78:34616) 2023-08-17T18:12:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.580+0000 7f68f699d700 1 -- 172.21.15.78:0/3595423645 learned_addr learned my addr 172.21.15.78:0/3595423645 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68f619c700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68f0151a40 0x7f68f0152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68f599b700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f0151e20 0x7f68f00c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68f699d700 1 -- 172.21.15.78:0/3595423645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f0151e20 msgr2=0x7f68f00c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68f699d700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f0151e20 0x7f68f00c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68f699d700 1 -- 172.21.15.78:0/3595423645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68f0151a40 msgr2=0x7f68f0152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68f699d700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68f0151a40 0x7f68f0152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68f699d700 1 -- 172.21.15.78:0/3595423645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0009250 con 0x7f68f0157be0 2023-08-17T18:12:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68f699d700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0157be0 0x7f68f014b9e0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f68e8007f20 tx=0x7f68e8009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68e67fc700 1 -- 172.21.15.78:0/3595423645 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e800eb90 con 0x7f68f0157be0 2023-08-17T18:12:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68e67fc700 1 -- 172.21.15.78:0/3595423645 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e800ecf0 con 0x7f68f0157be0 2023-08-17T18:12:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68f719e700 1 -- 172.21.15.78:0/3595423645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f0152ac0 con 0x7f68f0157be0 2023-08-17T18:12:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68e67fc700 1 -- 172.21.15.78:0/3595423645 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8014610 con 0x7f68f0157be0 2023-08-17T18:12:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.581+0000 7f68f719e700 1 -- 172.21.15.78:0/3595423645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f0153080 con 0x7f68f0157be0 2023-08-17T18:12:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.582+0000 7f68f719e700 1 -- 172.21.15.78:0/3595423645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f0082f90 con 0x7f68f0157be0 2023-08-17T18:12:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.583+0000 7f68e67fc700 1 -- 172.21.15.78:0/3595423645 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 92) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f68e801b030 con 0x7f68f0157be0 2023-08-17T18:12:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.583+0000 7f68e67fc700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f68d405ed40 0x7f68d4061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.583+0000 7f68e67fc700 1 -- 172.21.15.78:0/3595423645 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f68e8079d80 con 0x7f68f0157be0 2023-08-17T18:12:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.583+0000 7f68f619c700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f68d405ed40 0x7f68d4061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.583+0000 7f68f619c700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f68d405ed40 0x7f68d4061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f68ec001360 tx=0x7f68ec009040).ready entity=mgr.9723 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.587+0000 7f68e67fc700 1 -- 172.21.15.78:0/3595423645 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f68e804b310 con 0x7f68f0157be0 2023-08-17T18:12:31.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.774+0000 7f68f719e700 1 -- 172.21.15.78:0/3595423645 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f68f005f910 con 0x7f68d405ed40 2023-08-17T18:12:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.778+0000 7f68e67fc700 1 -- 172.21.15.78:0/3595423645 <== mgr.9723 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f68f005f910 con 0x7f68d405ed40 2023-08-17T18:12:31.779 INFO:teuthology.orchestra.run.smithi078.stdout:Retention added to path snap_test_dir1 2023-08-17T18:12:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 -- 172.21.15.78:0/3595423645 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f68d405ed40 msgr2=0x7f68d4061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f68d405ed40 0x7f68d4061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f68ec001360 tx=0x7f68ec009040).stop 2023-08-17T18:12:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 -- 172.21.15.78:0/3595423645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0157be0 msgr2=0x7f68f014b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0157be0 0x7f68f014b9e0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f68e8007f20 tx=0x7f68e8009860).stop 2023-08-17T18:12:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 -- 172.21.15.78:0/3595423645 shutdown_connections 2023-08-17T18:12:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f68d405ed40 0x7f68d4061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f0157be0 0x7f68f014b9e0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68f0151a40 0x7f68f0152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 --2- 172.21.15.78:0/3595423645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f0151e20 0x7f68f00c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 -- 172.21.15.78:0/3595423645 >> 172.21.15.78:0/3595423645 conn(0x7f68f00943b0 msgr2=0x7f68f014c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 -- 172.21.15.78:0/3595423645 shutdown_connections 2023-08-17T18:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.780+0000 7f68f719e700 1 -- 172.21.15.78:0/3595423645 wait complete. 2023-08-17T18:12:31.792 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-08-17T18:12:31.797 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-17-18_13_00 in ~29s... 2023-08-17T18:12:31.797 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-08-17T18:12:31.797 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-17T18:12:31.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.914+0000 7f812dd27700 1 Processor -- start 2023-08-17T18:12:31.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.914+0000 7f812dd27700 1 -- start start 2023-08-17T18:12:31.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f812dd27700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f81280aa0f0 0x7f81280644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f812dd27700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f81280c5810 0x7f81280c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f812dd27700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81280649b0 con 0x7f81280aa4d0 2023-08-17T18:12:31.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f812dd27700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81280c6170 con 0x7f81280c5810 2023-08-17T18:12:31.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f812dd27700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8128063420 con 0x7f81280aa0f0 2023-08-17T18:12:31.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f8127fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f81280c5810 0x7f81280c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f8127fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f81280c5810 0x7f81280c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34622/0 (socket says 172.21.15.78:34622) 2023-08-17T18:12:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f8127fff700 1 -- 172.21.15.78:0/633313719 learned_addr learned my addr 172.21.15.78:0/633313719 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f81277fe700 1 --2- 172.21.15.78:0/633313719 >> v2:172.21.15.150:3300/0 conn(0x7f81280aa0f0 0x7f81280644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f8127fff700 1 -- 172.21.15.78:0/633313719 >> v2:172.21.15.150:3300/0 conn(0x7f81280aa0f0 msgr2=0x7f81280644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f8127fff700 1 --2- 172.21.15.78:0/633313719 >> v2:172.21.15.150:3300/0 conn(0x7f81280aa0f0 0x7f81280644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f8127fff700 1 -- 172.21.15.78:0/633313719 >> v1:172.21.15.78:6789/0 conn(0x7f81280aa4d0 legacy=0x7f81280c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f8127fff700 1 -- 172.21.15.78:0/633313719 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8128063700 con 0x7f81280c5810 2023-08-17T18:12:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.915+0000 7f81267fc700 1 -- 172.21.15.78:0/633313719 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957180169 0 0) 0x7f81280649b0 con 0x7f81280aa4d0 2023-08-17T18:12:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f8127fff700 1 --2- 172.21.15.78:0/633313719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280c5810 0x7f81280c5c80 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f81280cade0 tx=0x7f81200090f0).ready entity=mon.0 client_cookie=c98ffc3df1b6032a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f81267fc700 1 -- 172.21.15.78:0/633313719 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000b520 con 0x7f81280c5810 2023-08-17T18:12:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f81267fc700 1 -- 172.21.15.78:0/633313719 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812000b680 con 0x7f81280c5810 2023-08-17T18:12:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f81267fc700 1 -- 172.21.15.78:0/633313719 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000ba00 con 0x7f81280c5810 2023-08-17T18:12:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f812dd27700 1 -- 172.21.15.78:0/633313719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280c5810 msgr2=0x7f81280c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f812dd27700 1 --2- 172.21.15.78:0/633313719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280c5810 0x7f81280c5c80 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f81280cade0 tx=0x7f81200090f0).stop 2023-08-17T18:12:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f812dd27700 1 -- 172.21.15.78:0/633313719 shutdown_connections 2023-08-17T18:12:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f812dd27700 1 --2- 172.21.15.78:0/633313719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280c5810 0x7f81280c5c80 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f812dd27700 1 --2- 172.21.15.78:0/633313719 >> v2:172.21.15.150:3300/0 conn(0x7f81280aa0f0 0x7f81280644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f812dd27700 1 -- 172.21.15.78:0/633313719 >> 172.21.15.78:0/633313719 conn(0x7f812806a6a0 msgr2=0x7f81280caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f812dd27700 1 -- 172.21.15.78:0/633313719 shutdown_connections 2023-08-17T18:12:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.916+0000 7f812dd27700 1 -- 172.21.15.78:0/633313719 wait complete. 2023-08-17T18:12:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.917+0000 7f812dd27700 1 Processor -- start 2023-08-17T18:12:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.918+0000 7f812dd27700 1 -- start start 2023-08-17T18:12:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.918+0000 7f812dd27700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81280aa0f0 0x7f81280c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.918+0000 7f812dd27700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280aa4d0 0x7f81280a86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.918+0000 7f812dd27700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81280c5810 0x7f8128150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.918+0000 7f812dd27700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81280c4220 con 0x7f81280aa4d0 2023-08-17T18:12:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.918+0000 7f812dd27700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8128154bf0 con 0x7f81280aa0f0 2023-08-17T18:12:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.918+0000 7f812dd27700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81281515b0 con 0x7f81280c5810 2023-08-17T18:12:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.918+0000 7f8126ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280aa4d0 0x7f81280a86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.918+0000 7f8126ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280aa4d0 0x7f81280a86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34638/0 (socket says 172.21.15.78:34638) 2023-08-17T18:12:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.918+0000 7f8126ffd700 1 -- 172.21.15.78:0/4069657258 learned_addr learned my addr 172.21.15.78:0/4069657258 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f81277fe700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81280aa0f0 0x7f81280c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f8127fff700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81280c5810 0x7f8128150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f8126ffd700 1 -- 172.21.15.78:0/4069657258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81280c5810 msgr2=0x7f8128150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f8126ffd700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81280c5810 0x7f8128150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f8126ffd700 1 -- 172.21.15.78:0/4069657258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81280aa0f0 msgr2=0x7f81280c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f8126ffd700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81280aa0f0 0x7f81280c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f8126ffd700 1 -- 172.21.15.78:0/4069657258 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009370 con 0x7f81280aa4d0 2023-08-17T18:12:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f8127fff700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81280c5810 0x7f8128150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f81277fe700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81280aa0f0 0x7f81280c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f8126ffd700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280aa4d0 0x7f81280a86f0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7f811c001eb0 tx=0x7f811c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f810f7fe700 1 -- 172.21.15.78:0/4069657258 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00e4a0 con 0x7f81280aa4d0 2023-08-17T18:12:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f810f7fe700 1 -- 172.21.15.78:0/4069657258 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c00e620 con 0x7f81280aa4d0 2023-08-17T18:12:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f812dd27700 1 -- 172.21.15.78:0/4069657258 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81280a83c0 con 0x7f81280aa4d0 2023-08-17T18:12:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f810f7fe700 1 -- 172.21.15.78:0/4069657258 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00e9e0 con 0x7f81280aa4d0 2023-08-17T18:12:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.919+0000 7f812dd27700 1 -- 172.21.15.78:0/4069657258 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81280c3c60 con 0x7f81280aa4d0 2023-08-17T18:12:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.920+0000 7f812dd27700 1 -- 172.21.15.78:0/4069657258 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8128083980 con 0x7f81280aa4d0 2023-08-17T18:12:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.920+0000 7f810f7fe700 1 -- 172.21.15.78:0/4069657258 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 92) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f811c019030 con 0x7f81280aa4d0 2023-08-17T18:12:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.921+0000 7f810f7fe700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f811405ed40 0x7f8114061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.921+0000 7f810f7fe700 1 -- 172.21.15.78:0/4069657258 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f811c079110 con 0x7f81280aa4d0 2023-08-17T18:12:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.921+0000 7f81277fe700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f811405ed40 0x7f8114061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.921+0000 7f81277fe700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f811405ed40 0x7f8114061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f81180076c0 tx=0x7f811800b040).ready entity=mgr.9723 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:31.925+0000 7f810f7fe700 1 -- 172.21.15.78:0/4069657258 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f811c04a6a0 con 0x7f81280aa4d0 2023-08-17T18:12:32.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.112+0000 7f812dd27700 1 -- 172.21.15.78:0/4069657258 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8128046af0 con 0x7f811405ed40 2023-08-17T18:12:32.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.115+0000 7f810f7fe700 1 -- 172.21.15.78:0/4069657258 <== mgr.9723 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f8128046af0 con 0x7f811405ed40 2023-08-17T18:12:32.115 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:32.116 INFO:teuthology.orchestra.run.smithi078.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-17T18:12:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 -- 172.21.15.78:0/4069657258 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f811405ed40 msgr2=0x7f8114061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f811405ed40 0x7f8114061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f81180076c0 tx=0x7f811800b040).stop 2023-08-17T18:12:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 -- 172.21.15.78:0/4069657258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280aa4d0 msgr2=0x7f81280a86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280aa4d0 0x7f81280a86f0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7f811c001eb0 tx=0x7f811c007c40).stop 2023-08-17T18:12:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 -- 172.21.15.78:0/4069657258 shutdown_connections 2023-08-17T18:12:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f811405ed40 0x7f8114061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81280c5810 0x7f8128150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81280aa0f0 0x7f81280c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 --2- 172.21.15.78:0/4069657258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81280aa4d0 0x7f81280a86f0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 -- 172.21.15.78:0/4069657258 >> 172.21.15.78:0/4069657258 conn(0x7f812806a6a0 msgr2=0x7f81280643c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 -- 172.21.15.78:0/4069657258 shutdown_connections 2023-08-17T18:12:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.116+0000 7f812dd27700 1 -- 172.21.15.78:0/4069657258 wait complete. 2023-08-17T18:12:32.129 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-17T18:12:32.129 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-08-17T18:12:32.130 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-17T18:12:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.245+0000 7f89d87f7700 1 Processor -- start 2023-08-17T18:12:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.245+0000 7f89d87f7700 1 -- start start 2023-08-17T18:12:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.246+0000 7f89d87f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89d00aa0f0 0x7f89d00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.246+0000 7f89d87f7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f89d00aa4d0 0x7f89d00c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.246+0000 7f89d87f7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d00649b0 con 0x7f89d00c5810 2023-08-17T18:12:32.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.246+0000 7f89d87f7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d0063420 con 0x7f89d00aa4d0 2023-08-17T18:12:32.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.246+0000 7f89d87f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d0063700 con 0x7f89d00aa0f0 2023-08-17T18:12:32.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.246+0000 7f89d6d94700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f89d00c5810 0x7f89d00a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54816/0 (socket says 172.21.15.78:54816) 2023-08-17T18:12:32.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.246+0000 7f89d6d94700 1 -- 172.21.15.78:0/2675342623 learned_addr learned my addr 172.21.15.78:0/2675342623 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:32.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.246+0000 7f89d5d92700 1 --2- 172.21.15.78:0/2675342623 >> v2:172.21.15.150:3300/0 conn(0x7f89d00aa4d0 0x7f89d00c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:32.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.246+0000 7f89d6593700 1 --2- 172.21.15.78:0/2675342623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89d00aa0f0 0x7f89d00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:32.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d5591700 1 -- 172.21.15.78:0/2675342623 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013932916 0 0) 0x7f89d00649b0 con 0x7f89d00c5810 2023-08-17T18:12:32.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d5591700 1 -- 172.21.15.78:0/2675342623 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89bc0033f0 con 0x7f89d00c5810 2023-08-17T18:12:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d5d92700 1 -- 172.21.15.78:0/2675342623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89d00aa0f0 msgr2=0x7f89d00644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d5d92700 1 --2- 172.21.15.78:0/2675342623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89d00aa0f0 0x7f89d00644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d5d92700 1 -- 172.21.15.78:0/2675342623 >> v1:172.21.15.78:6789/0 conn(0x7f89d00c5810 legacy=0x7f89d00a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d5d92700 1 -- 172.21.15.78:0/2675342623 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00639e0 con 0x7f89d00aa4d0 2023-08-17T18:12:32.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d6593700 1 --2- 172.21.15.78:0/2675342623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89d00aa0f0 0x7f89d00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:32.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d5d92700 1 --2- 172.21.15.78:0/2675342623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89d00aa4d0 0x7f89d00c0e10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f89c0009760 tx=0x7f89c0009060).ready entity=mon.1 client_cookie=62501e76eac11ed7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:32.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d5591700 1 -- 172.21.15.78:0/2675342623 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000d4a0 con 0x7f89d00aa4d0 2023-08-17T18:12:32.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d5591700 1 -- 172.21.15.78:0/2675342623 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c000d600 con 0x7f89d00aa4d0 2023-08-17T18:12:32.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.247+0000 7f89d5591700 1 -- 172.21.15.78:0/2675342623 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000d980 con 0x7f89d00aa4d0 2023-08-17T18:12:32.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.248+0000 7f89d87f7700 1 -- 172.21.15.78:0/2675342623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89d00aa4d0 msgr2=0x7f89d00c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.248+0000 7f89d87f7700 1 --2- 172.21.15.78:0/2675342623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89d00aa4d0 0x7f89d00c0e10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f89c0009760 tx=0x7f89c0009060).stop 2023-08-17T18:12:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.248+0000 7f89d87f7700 1 -- 172.21.15.78:0/2675342623 shutdown_connections 2023-08-17T18:12:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.248+0000 7f89d87f7700 1 --2- 172.21.15.78:0/2675342623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89d00aa0f0 0x7f89d00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.248+0000 7f89d87f7700 1 --2- 172.21.15.78:0/2675342623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89d00aa4d0 0x7f89d00c0e10 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.248+0000 7f89d87f7700 1 -- 172.21.15.78:0/2675342623 >> 172.21.15.78:0/2675342623 conn(0x7f89d006a6a0 msgr2=0x7f89d00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.248+0000 7f89d87f7700 1 -- 172.21.15.78:0/2675342623 shutdown_connections 2023-08-17T18:12:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.248+0000 7f89d87f7700 1 -- 172.21.15.78:0/2675342623 wait complete. 2023-08-17T18:12:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.249+0000 7f89d87f7700 1 Processor -- start 2023-08-17T18:12:32.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.249+0000 7f89d87f7700 1 -- start start 2023-08-17T18:12:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d87f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89d00aa0f0 0x7f89d00c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d87f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89d00aa4d0 0x7f89d0145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d87f7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d00c5810 0x7f89d00c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d87f7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c5080 con 0x7f89d00c5810 2023-08-17T18:12:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d87f7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00abe90 con 0x7f89d00aa4d0 2023-08-17T18:12:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d87f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c4e00 con 0x7f89d00aa0f0 2023-08-17T18:12:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d6d94700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d00c5810 0x7f89d00c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:32.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d6d94700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d00c5810 0x7f89d00c2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34644/0 (socket says 172.21.15.78:34644) 2023-08-17T18:12:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d6d94700 1 -- 172.21.15.78:0/167433055 learned_addr learned my addr 172.21.15.78:0/167433055 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d6d94700 1 -- 172.21.15.78:0/167433055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89d00aa0f0 msgr2=0x7f89d00c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d6d94700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89d00aa0f0 0x7f89d00c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d6d94700 1 -- 172.21.15.78:0/167433055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89d00aa4d0 msgr2=0x7f89d0145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d6d94700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89d00aa4d0 0x7f89d0145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d6d94700 1 -- 172.21.15.78:0/167433055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc009a20 con 0x7f89d00c5810 2023-08-17T18:12:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d6d94700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d00c5810 0x7f89d00c2700 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f89c80010e0 tx=0x7f89c8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89c67fc700 1 -- 172.21.15.78:0/167433055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80072e0 con 0x7f89d00c5810 2023-08-17T18:12:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89c67fc700 1 -- 172.21.15.78:0/167433055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c8007440 con 0x7f89d00c5810 2023-08-17T18:12:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d87f7700 1 -- 172.21.15.78:0/167433055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c00092a0 con 0x7f89d00c5810 2023-08-17T18:12:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89c67fc700 1 -- 172.21.15.78:0/167433055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80057a0 con 0x7f89d00c5810 2023-08-17T18:12:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.250+0000 7f89d87f7700 1 -- 172.21.15.78:0/167433055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d00ab560 con 0x7f89d00c5810 2023-08-17T18:12:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.251+0000 7f89d87f7700 1 -- 172.21.15.78:0/167433055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d0083980 con 0x7f89d00c5810 2023-08-17T18:12:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.251+0000 7f89c67fc700 1 -- 172.21.15.78:0/167433055 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 92) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f89c801a060 con 0x7f89d00c5810 2023-08-17T18:12:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.252+0000 7f89c67fc700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f89b405ed40 0x7f89b4061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.252+0000 7f89c67fc700 1 -- 172.21.15.78:0/167433055 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f89c8079290 con 0x7f89d00c5810 2023-08-17T18:12:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.252+0000 7f89d6593700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f89b405ed40 0x7f89b4061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.252+0000 7f89d6593700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f89b405ed40 0x7f89b4061200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f89cc00e4a0 tx=0x7f89cc00b040).ready entity=mgr.9723 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:32.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.256+0000 7f89c67fc700 1 -- 172.21.15.78:0/167433055 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89c804a820 con 0x7f89d00c5810 2023-08-17T18:12:32.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.444+0000 7f89d87f7700 1 -- 172.21.15.78:0/167433055 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f89d00cbd40 con 0x7f89b405ed40 2023-08-17T18:12:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.447+0000 7f89c67fc700 1 -- 172.21.15.78:0/167433055 <== mgr.9723 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f89d00cbd40 con 0x7f89b405ed40 2023-08-17T18:12:32.448 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule removed for path snap_test_dir1 2023-08-17T18:12:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 -- 172.21.15.78:0/167433055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f89b405ed40 msgr2=0x7f89b4061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f89b405ed40 0x7f89b4061200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f89cc00e4a0 tx=0x7f89cc00b040).stop 2023-08-17T18:12:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 -- 172.21.15.78:0/167433055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d00c5810 msgr2=0x7f89d00c2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d00c5810 0x7f89d00c2700 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f89c80010e0 tx=0x7f89c8007c50).stop 2023-08-17T18:12:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 -- 172.21.15.78:0/167433055 shutdown_connections 2023-08-17T18:12:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f89b405ed40 0x7f89b4061200 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d00c5810 0x7f89d00c2700 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89d00aa0f0 0x7f89d00c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 --2- 172.21.15.78:0/167433055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89d00aa4d0 0x7f89d0145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 -- 172.21.15.78:0/167433055 >> 172.21.15.78:0/167433055 conn(0x7f89d006a6a0 msgr2=0x7f89d0152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 -- 172.21.15.78:0/167433055 shutdown_connections 2023-08-17T18:12:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.449+0000 7f89d87f7700 1 -- 172.21.15.78:0/167433055 wait complete. 2023-08-17T18:12:32.461 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-17T18:12:32.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:12:32.462 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-17T18:12:32.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:12:32.478 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-17T18:12:32.535 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-17T18:12:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.689+0000 7fec8714b700 1 Processor -- start 2023-08-17T18:12:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.689+0000 7fec8714b700 1 -- start start 2023-08-17T18:12:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec8714b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec80151a40 0x7fec800c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec8714b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151e20 0x7fec800c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec8714b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800c6620 con 0x7fec80157be0 2023-08-17T18:12:32.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec8714b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec800c6900 con 0x7fec80151a40 2023-08-17T18:12:32.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec8714b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec800c6be0 con 0x7fec80151e20 2023-08-17T18:12:32.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec86149700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec80151a40 0x7fec800c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:32.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec86149700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec80151a40 0x7fec800c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34650/0 (socket says 172.21.15.78:34650) 2023-08-17T18:12:32.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec86149700 1 -- 172.21.15.78:0/3240709074 learned_addr learned my addr 172.21.15.78:0/3240709074 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:32.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec8694a700 1 --1- 172.21.15.78:0/3240709074 >> v1:172.21.15.78:6789/0 conn(0x7fec80157be0 0x7fec80154610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54818/0 (socket says 172.21.15.78:54818) 2023-08-17T18:12:32.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec85948700 1 --2- 172.21.15.78:0/3240709074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151e20 0x7fec800c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:32.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec86149700 1 -- 172.21.15.78:0/3240709074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151e20 msgr2=0x7fec800c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:32.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec86149700 1 --2- 172.21.15.78:0/3240709074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151e20 0x7fec800c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec86149700 1 -- 172.21.15.78:0/3240709074 >> v1:172.21.15.78:6789/0 conn(0x7fec80157be0 legacy=0x7fec80154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec86149700 1 -- 172.21.15.78:0/3240709074 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800c6ec0 con 0x7fec80151a40 2023-08-17T18:12:32.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec85147700 1 -- 172.21.15.78:0/3240709074 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987143434 0 0) 0x7fec800c6620 con 0x7fec80157be0 2023-08-17T18:12:32.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec85948700 1 --2- 172.21.15.78:0/3240709074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151e20 0x7fec800c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:32.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec86149700 1 --2- 172.21.15.78:0/3240709074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80151a40 0x7fec800c8260 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7fec7c009810 tx=0x7fec7c009060).ready entity=mon.0 client_cookie=643b9cf0fa8c5fb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:32.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.690+0000 7fec85147700 1 -- 172.21.15.78:0/3240709074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c005880 con 0x7fec80151a40 2023-08-17T18:12:32.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.691+0000 7fec85147700 1 -- 172.21.15.78:0/3240709074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c0059e0 con 0x7fec80151a40 2023-08-17T18:12:32.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.691+0000 7fec85147700 1 -- 172.21.15.78:0/3240709074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c005d60 con 0x7fec80151a40 2023-08-17T18:12:32.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.691+0000 7fec8714b700 1 -- 172.21.15.78:0/3240709074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80151a40 msgr2=0x7fec800c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.691+0000 7fec8714b700 1 --2- 172.21.15.78:0/3240709074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80151a40 0x7fec800c8260 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7fec7c009810 tx=0x7fec7c009060).stop 2023-08-17T18:12:32.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.691+0000 7fec8714b700 1 -- 172.21.15.78:0/3240709074 shutdown_connections 2023-08-17T18:12:32.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.691+0000 7fec8714b700 1 --2- 172.21.15.78:0/3240709074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80151a40 0x7fec800c8260 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.691+0000 7fec8714b700 1 --2- 172.21.15.78:0/3240709074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151e20 0x7fec800c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.691+0000 7fec8714b700 1 -- 172.21.15.78:0/3240709074 >> 172.21.15.78:0/3240709074 conn(0x7fec800943b0 msgr2=0x7fec8006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:32.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.691+0000 7fec8714b700 1 -- 172.21.15.78:0/3240709074 shutdown_connections 2023-08-17T18:12:32.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.691+0000 7fec8714b700 1 -- 172.21.15.78:0/3240709074 wait complete. 2023-08-17T18:12:32.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.692+0000 7fec8714b700 1 Processor -- start 2023-08-17T18:12:32.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.692+0000 7fec8714b700 1 -- start start 2023-08-17T18:12:32.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8714b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151a40 0x7fec8014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8714b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec80151e20 0x7fec80164c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8714b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80157be0 0x7fec800c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8714b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec80165b70 con 0x7fec80157be0 2023-08-17T18:12:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8714b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec80154560 con 0x7fec80151e20 2023-08-17T18:12:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8714b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec80154840 con 0x7fec80151a40 2023-08-17T18:12:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8694a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80157be0 0x7fec800c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8694a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80157be0 0x7fec800c10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34656/0 (socket says 172.21.15.78:34656) 2023-08-17T18:12:32.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8694a700 1 -- 172.21.15.78:0/2099630180 learned_addr learned my addr 172.21.15.78:0/2099630180 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:32.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec86149700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151a40 0x7fec8014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:32.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8694a700 1 -- 172.21.15.78:0/2099630180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151a40 msgr2=0x7fec8014c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8694a700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151a40 0x7fec8014c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec85948700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec80151e20 0x7fec80164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:32.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8694a700 1 -- 172.21.15.78:0/2099630180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec80151e20 msgr2=0x7fec80164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:32.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8694a700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec80151e20 0x7fec80164c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:32.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8694a700 1 -- 172.21.15.78:0/2099630180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c009300 con 0x7fec80157be0 2023-08-17T18:12:32.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.693+0000 7fec8694a700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80157be0 0x7fec800c10f0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7fec7800c730 tx=0x7fec78001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:32.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.694+0000 7fec767fc700 1 -- 172.21.15.78:0/2099630180 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78005c70 con 0x7fec80157be0 2023-08-17T18:12:32.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.694+0000 7fec767fc700 1 -- 172.21.15.78:0/2099630180 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec78005dd0 con 0x7fec80157be0 2023-08-17T18:12:32.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.694+0000 7fec8714b700 1 -- 172.21.15.78:0/2099630180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec80165520 con 0x7fec80157be0 2023-08-17T18:12:32.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.694+0000 7fec767fc700 1 -- 172.21.15.78:0/2099630180 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78007340 con 0x7fec80157be0 2023-08-17T18:12:32.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.694+0000 7fec8714b700 1 -- 172.21.15.78:0/2099630180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8014c8d0 con 0x7fec80157be0 2023-08-17T18:12:32.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.695+0000 7fec8714b700 1 -- 172.21.15.78:0/2099630180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec80165d20 con 0x7fec80157be0 2023-08-17T18:12:32.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.695+0000 7fec767fc700 1 -- 172.21.15.78:0/2099630180 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 92) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fec78010030 con 0x7fec80157be0 2023-08-17T18:12:32.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.695+0000 7fec767fc700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fec6405ed40 0x7fec64061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:32.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.695+0000 7fec767fc700 1 -- 172.21.15.78:0/2099630180 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fec780799e0 con 0x7fec80157be0 2023-08-17T18:12:32.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.695+0000 7fec86149700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fec6405ed40 0x7fec64061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:32.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.696+0000 7fec86149700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fec6405ed40 0x7fec64061200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fec7c00b400 tx=0x7fec7c016000).ready entity=mgr.9723 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:32.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.699+0000 7fec767fc700 1 -- 172.21.15.78:0/2099630180 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec80165d20 con 0x7fec80157be0 2023-08-17T18:12:32.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:32.906+0000 7fec8714b700 1 -- 172.21.15.78:0/2099630180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fec80082f90 con 0x7fec80157be0 2023-08-17T18:12:33.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.420+0000 7fec767fc700 1 -- 172.21.15.78:0/2099630180 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fec780778d0 con 0x7fec80157be0 2023-08-17T18:12:33.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.421+0000 7fec767fc700 1 -- 172.21.15.78:0/2099630180 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v93) v1 ==== 93+0+0 (secure 0 0 0) 0x7fec780731f0 con 0x7fec80157be0 2023-08-17T18:12:33.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 -- 172.21.15.78:0/2099630180 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fec6405ed40 msgr2=0x7fec64061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:33.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fec6405ed40 0x7fec64061200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fec7c00b400 tx=0x7fec7c016000).stop 2023-08-17T18:12:33.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 -- 172.21.15.78:0/2099630180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80157be0 msgr2=0x7fec800c10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:33.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80157be0 0x7fec800c10f0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7fec7800c730 tx=0x7fec78001520).stop 2023-08-17T18:12:33.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 -- 172.21.15.78:0/2099630180 shutdown_connections 2023-08-17T18:12:33.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fec6405ed40 0x7fec64061200 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec80157be0 0x7fec800c10f0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec80151a40 0x7fec8014c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 --2- 172.21.15.78:0/2099630180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec80151e20 0x7fec80164c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 -- 172.21.15.78:0/2099630180 >> 172.21.15.78:0/2099630180 conn(0x7fec800943b0 msgr2=0x7fec800c0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:33.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 -- 172.21.15.78:0/2099630180 shutdown_connections 2023-08-17T18:12:33.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.423+0000 7fec8714b700 1 -- 172.21.15.78:0/2099630180 wait complete. 2023-08-17T18:12:33.436 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T18:12:33.437 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T18:12:33.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T18:12:33.510 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T18:12:33.511 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T18:12:33.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T18:12:33.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T18:12:33.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T18:12:33.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:33.558 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T18:12:33.564 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:33.564+0000 7fc7777d9680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:12:33.569 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:33.568+0000 7f7fc5259680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T18:12:33.574 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:33.631 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:33.630+0000 7fc7777d9680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:12:33.632 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:33.631+0000 7f7fc5259680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T18:12:33.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.730+0000 7f225dfc9700 1 Processor -- start 2023-08-17T18:12:33.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.730+0000 7f225dfc9700 1 -- start start 2023-08-17T18:12:33.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.731+0000 7f225dfc9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2258154140 0x7f22580c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:33.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.731+0000 7f225dfc9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f22580a7c40 0x7f22580c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:33.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.731+0000 7f225dfc9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2258154520 con 0x7f22580a8080 2023-08-17T18:12:33.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.731+0000 7f225dfc9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22580c91e0 con 0x7f22580a7c40 2023-08-17T18:12:33.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.731+0000 7f225dfc9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22580c94c0 con 0x7f2258154140 2023-08-17T18:12:33.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f2256ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f22580a7c40 0x7f22580c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:33.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f2256ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f22580a7c40 0x7f22580c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34688/0 (socket says 172.21.15.78:34688) 2023-08-17T18:12:33.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f2256ffd700 1 -- 172.21.15.78:0/3308666647 learned_addr learned my addr 172.21.15.78:0/3308666647 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:33.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f22577fe700 1 --2- 172.21.15.78:0/3308666647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2258154140 0x7f22580c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:33.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f2256ffd700 1 -- 172.21.15.78:0/3308666647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2258154140 msgr2=0x7f22580c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:33.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f2256ffd700 1 --2- 172.21.15.78:0/3308666647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2258154140 0x7f22580c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f2256ffd700 1 -- 172.21.15.78:0/3308666647 >> v1:172.21.15.150:6789/0 conn(0x7f22580a8080 legacy=0x7f22580ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:33.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f2256ffd700 1 -- 172.21.15.78:0/3308666647 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22580c97a0 con 0x7f22580a7c40 2023-08-17T18:12:33.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f2256ffd700 1 --2- 172.21.15.78:0/3308666647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22580a7c40 0x7f22580c0900 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7f2248006fd0 tx=0x7f22480090f0).ready entity=mon.0 client_cookie=7f3005ac56cab412 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:33.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f22567fc700 1 -- 172.21.15.78:0/3308666647 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224800b580 con 0x7f22580a7c40 2023-08-17T18:12:33.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f22567fc700 1 -- 172.21.15.78:0/3308666647 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224800b6e0 con 0x7f22580a7c40 2023-08-17T18:12:33.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.732+0000 7f22567fc700 1 -- 172.21.15.78:0/3308666647 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224800ba60 con 0x7f22580a7c40 2023-08-17T18:12:33.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.733+0000 7f225dfc9700 1 -- 172.21.15.78:0/3308666647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22580a7c40 msgr2=0x7f22580c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:33.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.733+0000 7f225dfc9700 1 --2- 172.21.15.78:0/3308666647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22580a7c40 0x7f22580c0900 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7f2248006fd0 tx=0x7f22480090f0).stop 2023-08-17T18:12:33.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.733+0000 7f225dfc9700 1 -- 172.21.15.78:0/3308666647 shutdown_connections 2023-08-17T18:12:33.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.733+0000 7f225dfc9700 1 --2- 172.21.15.78:0/3308666647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2258154140 0x7f22580c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.733+0000 7f225dfc9700 1 --2- 172.21.15.78:0/3308666647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22580a7c40 0x7f22580c0900 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.733+0000 7f225dfc9700 1 -- 172.21.15.78:0/3308666647 >> 172.21.15.78:0/3308666647 conn(0x7f2258094510 msgr2=0x7f225806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:33.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.733+0000 7f225dfc9700 1 -- 172.21.15.78:0/3308666647 shutdown_connections 2023-08-17T18:12:33.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.733+0000 7f225dfc9700 1 -- 172.21.15.78:0/3308666647 wait complete. 2023-08-17T18:12:33.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.734+0000 7f225dfc9700 1 Processor -- start 2023-08-17T18:12:33.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.734+0000 7f225dfc9700 1 -- start start 2023-08-17T18:12:33.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f225dfc9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22580a7c40 0x7f225814ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:33.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f225dfc9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22580a8080 0x7f22580ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:33.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f225dfc9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2258154140 0x7f22581506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:33.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f225dfc9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580ab720 con 0x7f2258154140 2023-08-17T18:12:33.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f225dfc9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580aab10 con 0x7f22580a7c40 2023-08-17T18:12:33.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f225dfc9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22580aadf0 con 0x7f22580a8080 2023-08-17T18:12:33.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f2257fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2258154140 0x7f22581506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:33.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f2257fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2258154140 0x7f22581506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34694/0 (socket says 172.21.15.78:34694) 2023-08-17T18:12:33.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f2257fff700 1 -- 172.21.15.78:0/1236047143 learned_addr learned my addr 172.21.15.78:0/1236047143 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:33.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f2256ffd700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22580a8080 0x7f22580ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:33.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f22577fe700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22580a7c40 0x7f225814ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:33.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f2257fff700 1 -- 172.21.15.78:0/1236047143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22580a8080 msgr2=0x7f22580ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:33.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f2257fff700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22580a8080 0x7f22580ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f2257fff700 1 -- 172.21.15.78:0/1236047143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22580a7c40 msgr2=0x7f225814ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:33.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f2257fff700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22580a7c40 0x7f225814ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f2257fff700 1 -- 172.21.15.78:0/1236047143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248009370 con 0x7f2258154140 2023-08-17T18:12:33.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f2257fff700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2258154140 0x7f22581506b0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f225000c7c0 tx=0x7f2250001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:33.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.735+0000 7f223f7fe700 1 -- 172.21.15.78:0/1236047143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000e4a0 con 0x7f2258154140 2023-08-17T18:12:33.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.736+0000 7f223f7fe700 1 -- 172.21.15.78:0/1236047143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225000e600 con 0x7f2258154140 2023-08-17T18:12:33.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.736+0000 7f225dfc9700 1 -- 172.21.15.78:0/1236047143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22580ab0d0 con 0x7f2258154140 2023-08-17T18:12:33.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.736+0000 7f223f7fe700 1 -- 172.21.15.78:0/1236047143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000e980 con 0x7f2258154140 2023-08-17T18:12:33.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.736+0000 7f225dfc9700 1 -- 172.21.15.78:0/1236047143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225814ef40 con 0x7f2258154140 2023-08-17T18:12:33.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.736+0000 7f225dfc9700 1 -- 172.21.15.78:0/1236047143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2258047350 con 0x7f2258154140 2023-08-17T18:12:33.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.737+0000 7f223f7fe700 1 -- 172.21.15.78:0/1236047143 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f2250019030 con 0x7f2258154140 2023-08-17T18:12:33.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.737+0000 7f223f7fe700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f224405ede0 0x7f22440612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:33.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.737+0000 7f22577fe700 1 -- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f224405ede0 msgr2=0x7f22440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:33.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.737+0000 7f223f7fe700 1 -- 172.21.15.78:0/1236047143 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f22500791b0 con 0x7f2258154140 2023-08-17T18:12:33.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.737+0000 7f22577fe700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f224405ede0 0x7f22440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:33.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.741+0000 7f223f7fe700 1 -- 172.21.15.78:0/1236047143 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22500488f0 con 0x7f2258154140 2023-08-17T18:12:33.908 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:33.906+0000 7f7fc5259680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:12:33.913 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:33.912+0000 7fc7777d9680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T18:12:33.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.938+0000 7f22577fe700 1 -- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f224405ede0 msgr2=0x7f22440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:33.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.938+0000 7f22577fe700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f224405ede0 0x7f22440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:33.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.947+0000 7f225dfc9700 1 -- 172.21.15.78:0/1236047143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2258150fc0 con 0x7f2258154140 2023-08-17T18:12:33.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.948+0000 7f223f7fe700 1 -- 172.21.15.78:0/1236047143 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f225004a680 con 0x7f2258154140 2023-08-17T18:12:33.949 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:33.949 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":67,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1111956777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1111956777},{"type":"v1","addr":"172.21.15.78:6837","nonce":1111956777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1739806080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1739806080},{"type":"v1","addr":"172.21.15.150:6834","nonce":1739806080}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":9528,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/168802869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":168802869},{"type":"v1","addr":"172.21.15.78:6836","nonce":168802869}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:12:19.124866+0000","modified":"2023-08-17T18:12:21.130921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9537":{"gid":9537,"name":"d","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2525491694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2525491694},{"type":"v1","addr":"172.21.15.150:6835","nonce":2525491694}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T18:12:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.949+0000 7f225dfc9700 1 -- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f224405ede0 msgr2=0x7f22440612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:33.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.949+0000 7f225dfc9700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f224405ede0 0x7f22440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:33.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.949+0000 7f225dfc9700 1 -- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2258154140 msgr2=0x7f22581506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:33.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.949+0000 7f225dfc9700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2258154140 0x7f22581506b0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f225000c7c0 tx=0x7f2250001530).stop 2023-08-17T18:12:33.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.950+0000 7f225dfc9700 1 -- 172.21.15.78:0/1236047143 shutdown_connections 2023-08-17T18:12:33.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.950+0000 7f225dfc9700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f224405ede0 0x7f22440612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:33.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.950+0000 7f225dfc9700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2258154140 0x7f22581506b0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.950+0000 7f225dfc9700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22580a7c40 0x7f225814ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.950+0000 7f225dfc9700 1 --2- 172.21.15.78:0/1236047143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22580a8080 0x7f22580ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:33.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.950+0000 7f225dfc9700 1 -- 172.21.15.78:0/1236047143 >> 172.21.15.78:0/1236047143 conn(0x7f2258094510 msgr2=0x7f22581530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:33.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.950+0000 7f225dfc9700 1 -- 172.21.15.78:0/1236047143 shutdown_connections 2023-08-17T18:12:33.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:33.950+0000 7f225dfc9700 1 -- 172.21.15.78:0/1236047143 wait complete. 2023-08-17T18:12:33.953 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 67 2023-08-17T18:12:33.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:34.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.118+0000 7febb2534700 1 Processor -- start 2023-08-17T18:12:34.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.118+0000 7febb2534700 1 -- start start 2023-08-17T18:12:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb2534700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0a7c90 0x7febac0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb2534700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7febac0be4d0 0x7febac0be960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb2534700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac0bf210 con 0x7febac151e40 2023-08-17T18:12:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb2534700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac0c5a80 con 0x7febac0be4d0 2023-08-17T18:12:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb2534700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0bee50 con 0x7febac0a7c90 2023-08-17T18:12:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb0ad1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7febac0be4d0 0x7febac0be960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febabfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7febac151e40 0x7febac152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54826/0 (socket says 172.21.15.78:54826) 2023-08-17T18:12:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febabfff700 1 -- 172.21.15.78:0/4237897809 learned_addr learned my addr 172.21.15.78:0/4237897809 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febab7fe700 1 --2- 172.21.15.78:0/4237897809 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0a7c90 0x7febac0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb0ad1700 1 -- 172.21.15.78:0/4237897809 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0a7c90 msgr2=0x7febac0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb0ad1700 1 --2- 172.21.15.78:0/4237897809 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0a7c90 0x7febac0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb0ad1700 1 -- 172.21.15.78:0/4237897809 >> v1:172.21.15.78:6789/0 conn(0x7febac151e40 legacy=0x7febac152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb0ad1700 1 -- 172.21.15.78:0/4237897809 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0c5450 con 0x7febac0be4d0 2023-08-17T18:12:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febaaffd700 1 -- 172.21.15.78:0/4237897809 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799126862 0 0) 0x7febac0bf210 con 0x7febac151e40 2023-08-17T18:12:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febab7fe700 1 --2- 172.21.15.78:0/4237897809 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0a7c90 0x7febac0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.119+0000 7febb0ad1700 1 --2- 172.21.15.78:0/4237897809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac0be4d0 0x7febac0be960 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7feba4009e60 tx=0x7feba4009780).ready entity=mon.0 client_cookie=c74a718c33a2d361 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:34.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febaaffd700 1 -- 172.21.15.78:0/4237897809 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba400e070 con 0x7febac0be4d0 2023-08-17T18:12:34.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febaaffd700 1 -- 172.21.15.78:0/4237897809 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba400bc30 con 0x7febac0be4d0 2023-08-17T18:12:34.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febaaffd700 1 -- 172.21.15.78:0/4237897809 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4012410 con 0x7febac0be4d0 2023-08-17T18:12:34.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febb2534700 1 -- 172.21.15.78:0/4237897809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac0be4d0 msgr2=0x7febac0be960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febb2534700 1 --2- 172.21.15.78:0/4237897809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac0be4d0 0x7febac0be960 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7feba4009e60 tx=0x7feba4009780).stop 2023-08-17T18:12:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febb2534700 1 -- 172.21.15.78:0/4237897809 shutdown_connections 2023-08-17T18:12:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febb2534700 1 --2- 172.21.15.78:0/4237897809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac0be4d0 0x7febac0be960 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febb2534700 1 --2- 172.21.15.78:0/4237897809 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0a7c90 0x7febac0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febb2534700 1 -- 172.21.15.78:0/4237897809 >> 172.21.15.78:0/4237897809 conn(0x7febac092330 msgr2=0x7febac062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febb2534700 1 -- 172.21.15.78:0/4237897809 shutdown_connections 2023-08-17T18:12:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.120+0000 7febb2534700 1 -- 172.21.15.78:0/4237897809 wait complete. 2023-08-17T18:12:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.121+0000 7febb2534700 1 Processor -- start 2023-08-17T18:12:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.122+0000 7febb2534700 1 -- start start 2023-08-17T18:12:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.122+0000 7febb2534700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac0a7c90 0x7febac14d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.122+0000 7febb2534700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0be4d0 0x7febac1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.122+0000 7febb2534700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac151e40 0x7febac0c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.122+0000 7febb2534700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac14ddf0 con 0x7febac151e40 2023-08-17T18:12:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.122+0000 7febb2534700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac156c30 con 0x7febac0a7c90 2023-08-17T18:12:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.122+0000 7febb2534700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac156300 con 0x7febac0be4d0 2023-08-17T18:12:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.122+0000 7febb0ad1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac151e40 0x7febac0c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.122+0000 7febb0ad1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac151e40 0x7febac0c23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34710/0 (socket says 172.21.15.78:34710) 2023-08-17T18:12:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.122+0000 7febb0ad1700 1 -- 172.21.15.78:0/139566155 learned_addr learned my addr 172.21.15.78:0/139566155 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7febabfff700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac0a7c90 0x7febac14d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7febab7fe700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0be4d0 0x7febac1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7febb0ad1700 1 -- 172.21.15.78:0/139566155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0be4d0 msgr2=0x7febac1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7febb0ad1700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0be4d0 0x7febac1570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7febb0ad1700 1 -- 172.21.15.78:0/139566155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac0a7c90 msgr2=0x7febac14d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7febb0ad1700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac0a7c90 0x7febac14d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7febb0ad1700 1 -- 172.21.15.78:0/139566155 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba4009a20 con 0x7febac151e40 2023-08-17T18:12:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7febb0ad1700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac151e40 0x7febac0c23f0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7febac06c200 tx=0x7feba4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7feb93fff700 1 -- 172.21.15.78:0/139566155 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4012410 con 0x7febac151e40 2023-08-17T18:12:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7feb93fff700 1 -- 172.21.15.78:0/139566155 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba400b6f0 con 0x7febac151e40 2023-08-17T18:12:34.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7febb2534700 1 -- 172.21.15.78:0/139566155 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac1565e0 con 0x7febac151e40 2023-08-17T18:12:34.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7feb93fff700 1 -- 172.21.15.78:0/139566155 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4011c80 con 0x7febac151e40 2023-08-17T18:12:34.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.123+0000 7febb2534700 1 -- 172.21.15.78:0/139566155 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac0c2e20 con 0x7febac151e40 2023-08-17T18:12:34.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.124+0000 7feb93fff700 1 -- 172.21.15.78:0/139566155 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7feba401d630 con 0x7febac151e40 2023-08-17T18:12:34.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.124+0000 7febb2534700 1 -- 172.21.15.78:0/139566155 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac155850 con 0x7febac151e40 2023-08-17T18:12:34.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.125+0000 7feb93fff700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feb9805edb0 0x7feb98061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.125+0000 7febabfff700 1 -- 172.21.15.78:0/139566155 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feb9805edb0 msgr2=0x7feb98061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.125+0000 7feb93fff700 1 -- 172.21.15.78:0/139566155 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7feba407bfe0 con 0x7febac151e40 2023-08-17T18:12:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.125+0000 7febabfff700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feb9805edb0 0x7feb98061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.129+0000 7feb93fff700 1 -- 172.21.15.78:0/139566155 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feba404d400 con 0x7febac151e40 2023-08-17T18:12:34.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.302+0000 7febb2534700 1 -- 172.21.15.78:0/139566155 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febac047350 con 0x7febac151e40 2023-08-17T18:12:34.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.303+0000 7feb93fff700 1 -- 172.21.15.78:0/139566155 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+17235 (secure 0 0 0) 0x7feba4050a20 con 0x7febac151e40 2023-08-17T18:12:34.305 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:34.305 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":186,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:30.406194+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:12:17.650042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T18:12:18.089352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6833/158925":"2023-08-18T18:12:30.406163+0000","172.21.15.78:6832/158925":"2023-08-18T18:12:30.406163+0000","172.21.15.78:0/831867818":"2023-08-18T18:12:30.406163+0000","172.21.15.78:0/2706117257":"2023-08-18T18:12:30.406163+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:34.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.305+0000 7febb2534700 1 -- 172.21.15.78:0/139566155 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feb9805edb0 msgr2=0x7feb98061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:34.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.305+0000 7febb2534700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feb9805edb0 0x7feb98061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:34.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.305+0000 7febb2534700 1 -- 172.21.15.78:0/139566155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac151e40 msgr2=0x7febac0c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.305+0000 7febb2534700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac151e40 0x7febac0c23f0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7febac06c200 tx=0x7feba4009780).stop 2023-08-17T18:12:34.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.305+0000 7febb2534700 1 -- 172.21.15.78:0/139566155 shutdown_connections 2023-08-17T18:12:34.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.306+0000 7febb2534700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feb9805edb0 0x7feb98061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:34.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.306+0000 7febb2534700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febac151e40 0x7febac0c23f0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.306+0000 7febb2534700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7febac0a7c90 0x7febac14d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.306+0000 7febb2534700 1 --2- 172.21.15.78:0/139566155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febac0be4d0 0x7febac1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.306+0000 7febb2534700 1 -- 172.21.15.78:0/139566155 >> 172.21.15.78:0/139566155 conn(0x7febac092330 msgr2=0x7febac0ad5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:34.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.306+0000 7febb2534700 1 -- 172.21.15.78:0/139566155 shutdown_connections 2023-08-17T18:12:34.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.306+0000 7febb2534700 1 -- 172.21.15.78:0/139566155 wait complete. 2023-08-17T18:12:34.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T17:34:15.061543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T17:34:17.465105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T18:12:17.650042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T18:12:18.089352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T18:12:34.321 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T18:12:34.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.441+0000 7f434bfff700 1 Processor -- start 2023-08-17T18:12:34.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.441+0000 7f434bfff700 1 -- start start 2023-08-17T18:12:34.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f434c151e20 0x7f434c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f434c157be0 0x7f434c158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434bfff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434c158520 con 0x7f434c151a40 2023-08-17T18:12:34.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434bfff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434c0c6620 con 0x7f434c151e20 2023-08-17T18:12:34.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434bfff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434c0c6900 con 0x7f434c157be0 2023-08-17T18:12:34.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f434c151e20 0x7f434c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f434c151e20 0x7f434c0c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34718/0 (socket says 172.21.15.78:34718) 2023-08-17T18:12:34.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434a7fc700 1 -- 172.21.15.78:0/3957053925 learned_addr learned my addr 172.21.15.78:0/3957053925 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434b7fe700 1 --2- 172.21.15.78:0/3957053925 >> v2:172.21.15.150:3300/0 conn(0x7f434c157be0 0x7f434c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434a7fc700 1 -- 172.21.15.78:0/3957053925 >> v2:172.21.15.150:3300/0 conn(0x7f434c157be0 msgr2=0x7f434c158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434a7fc700 1 --2- 172.21.15.78:0/3957053925 >> v2:172.21.15.150:3300/0 conn(0x7f434c157be0 0x7f434c158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434a7fc700 1 -- 172.21.15.78:0/3957053925 >> v1:172.21.15.150:6789/0 conn(0x7f434c151a40 legacy=0x7f434c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434a7fc700 1 -- 172.21.15.78:0/3957053925 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c0c6be0 con 0x7f434c151e20 2023-08-17T18:12:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.442+0000 7f434a7fc700 1 --2- 172.21.15.78:0/3957053925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c151e20 0x7f434c0c8260 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7f434c155770 tx=0x7f433c009060).ready entity=mon.0 client_cookie=ee019ede20c74c71 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f4349ffb700 1 -- 172.21.15.78:0/3957053925 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c005880 con 0x7f434c151e20 2023-08-17T18:12:34.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f4349ffb700 1 -- 172.21.15.78:0/3957053925 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c0059e0 con 0x7f434c151e20 2023-08-17T18:12:34.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f4349ffb700 1 -- 172.21.15.78:0/3957053925 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c005d60 con 0x7f434c151e20 2023-08-17T18:12:34.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f434bfff700 1 -- 172.21.15.78:0/3957053925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c151e20 msgr2=0x7f434c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f434bfff700 1 --2- 172.21.15.78:0/3957053925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c151e20 0x7f434c0c8260 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7f434c155770 tx=0x7f433c009060).stop 2023-08-17T18:12:34.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f434bfff700 1 -- 172.21.15.78:0/3957053925 shutdown_connections 2023-08-17T18:12:34.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f434bfff700 1 --2- 172.21.15.78:0/3957053925 >> v2:172.21.15.150:3300/0 conn(0x7f434c157be0 0x7f434c158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f434bfff700 1 --2- 172.21.15.78:0/3957053925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c151e20 0x7f434c0c8260 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f434bfff700 1 -- 172.21.15.78:0/3957053925 >> 172.21.15.78:0/3957053925 conn(0x7f434c0943b0 msgr2=0x7f434c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f434bfff700 1 -- 172.21.15.78:0/3957053925 shutdown_connections 2023-08-17T18:12:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.443+0000 7f434bfff700 1 -- 172.21.15.78:0/3957053925 wait complete. 2023-08-17T18:12:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.444+0000 7f434bfff700 1 Processor -- start 2023-08-17T18:12:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.444+0000 7f434bfff700 1 -- start start 2023-08-17T18:12:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f434c151a40 0x7f434c14c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f434c151e20 0x7f434c0aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c157be0 0x7f434c156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434bfff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0ac510 con 0x7f434c157be0 2023-08-17T18:12:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434bfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0ab900 con 0x7f434c151e20 2023-08-17T18:12:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0abbe0 con 0x7f434c151a40 2023-08-17T18:12:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c157be0 0x7f434c156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c157be0 0x7f434c156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34722/0 (socket says 172.21.15.78:34722) 2023-08-17T18:12:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434b7fe700 1 -- 172.21.15.78:0/1355249673 learned_addr learned my addr 172.21.15.78:0/1355249673 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434a7fc700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f434c151e20 0x7f434c0aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.445+0000 7f434affd700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f434c151a40 0x7f434c14c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f434b7fe700 1 -- 172.21.15.78:0/1355249673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f434c151a40 msgr2=0x7f434c14c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f434b7fe700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f434c151a40 0x7f434c14c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f434b7fe700 1 -- 172.21.15.78:0/1355249673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f434c151e20 msgr2=0x7f434c0aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f434b7fe700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f434c151e20 0x7f434c0aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f434b7fe700 1 -- 172.21.15.78:0/1355249673 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c009300 con 0x7f434c157be0 2023-08-17T18:12:34.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f434b7fe700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c157be0 0x7f434c156a10 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7f4344009df0 tx=0x7f434400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:34.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f4332ffd700 1 -- 172.21.15.78:0/1355249673 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434400caa0 con 0x7f434c157be0 2023-08-17T18:12:34.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f4332ffd700 1 -- 172.21.15.78:0/1355249673 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434400f040 con 0x7f434c157be0 2023-08-17T18:12:34.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f434bfff700 1 -- 172.21.15.78:0/1355249673 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c0abec0 con 0x7f434c157be0 2023-08-17T18:12:34.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f4332ffd700 1 -- 172.21.15.78:0/1355249673 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434400ce10 con 0x7f434c157be0 2023-08-17T18:12:34.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.446+0000 7f434bfff700 1 -- 172.21.15.78:0/1355249673 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c0ac9a0 con 0x7f434c157be0 2023-08-17T18:12:34.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.447+0000 7f434bfff700 1 -- 172.21.15.78:0/1355249673 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434c082f90 con 0x7f434c157be0 2023-08-17T18:12:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.448+0000 7f4332ffd700 1 -- 172.21.15.78:0/1355249673 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f4344013610 con 0x7f434c157be0 2023-08-17T18:12:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.448+0000 7f4332ffd700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433805ede0 0x7f43380612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.448+0000 7f434affd700 1 -- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433805ede0 msgr2=0x7f43380612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.448+0000 7f4332ffd700 1 -- 172.21.15.78:0/1355249673 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f434407b010 con 0x7f434c157be0 2023-08-17T18:12:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.448+0000 7f434affd700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433805ede0 0x7f43380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.452+0000 7f4332ffd700 1 -- 172.21.15.78:0/1355249673 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f434404c500 con 0x7f434c157be0 2023-08-17T18:12:34.529 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:34.527+0000 7f7fc5259680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:12:34.557 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:34.557+0000 7fc7777d9680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-17T18:12:34.601 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:34.600+0000 7f7fc5259680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:12:34.632 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:34.631+0000 7fc7777d9680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T18:12:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.649+0000 7f434affd700 1 -- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433805ede0 msgr2=0x7f43380612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.649+0000 7f434affd700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433805ede0 0x7f43380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:34.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.655+0000 7f434bfff700 1 -- 172.21.15.78:0/1355249673 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f434c05f910 con 0x7f434c157be0 2023-08-17T18:12:34.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.655+0000 7f4332ffd700 1 -- 172.21.15.78:0/1355249673 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v186) v1 ==== 110+0+10 (secure 0 0 0) 0x7f434404fb20 con 0x7f434c157be0 2023-08-17T18:12:34.656 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-08-17T18:12:34.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.657+0000 7f434bfff700 1 -- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433805ede0 msgr2=0x7f43380612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.657+0000 7f434bfff700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433805ede0 0x7f43380612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.657+0000 7f434bfff700 1 -- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c157be0 msgr2=0x7f434c156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.657+0000 7f434bfff700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c157be0 0x7f434c156a10 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7f4344009df0 tx=0x7f434400b040).stop 2023-08-17T18:12:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.657+0000 7f434bfff700 1 -- 172.21.15.78:0/1355249673 shutdown_connections 2023-08-17T18:12:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.657+0000 7f434bfff700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f433805ede0 0x7f43380612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.657+0000 7f434bfff700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f434c157be0 0x7f434c156a10 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.657+0000 7f434bfff700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f434c151a40 0x7f434c14c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.657+0000 7f434bfff700 1 --2- 172.21.15.78:0/1355249673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f434c151e20 0x7f434c0aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.657+0000 7f434bfff700 1 -- 172.21.15.78:0/1355249673 >> 172.21.15.78:0/1355249673 conn(0x7f434c0943b0 msgr2=0x7f434c0bff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.658+0000 7f434bfff700 1 -- 172.21.15.78:0/1355249673 shutdown_connections 2023-08-17T18:12:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.658+0000 7f434bfff700 1 -- 172.21.15.78:0/1355249673 wait complete. 2023-08-17T18:12:34.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T18:12:34.791 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:34.790+0000 7f7fc5259680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:12:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.793+0000 7f9c4efdc700 1 Processor -- start 2023-08-17T18:12:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.793+0000 7f9c4efdc700 1 -- start start 2023-08-17T18:12:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.794+0000 7f9c4efdc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9c48153ee0 0x7f9c480c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.794+0000 7f9c4efdc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9c481542c0 0x7f9c480c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.794+0000 7f9c4efdc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4806b420 con 0x7f9c480bc2e0 2023-08-17T18:12:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.794+0000 7f9c4efdc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c480c7170 con 0x7f9c48153ee0 2023-08-17T18:12:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.794+0000 7f9c4efdc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c48062ec0 con 0x7f9c481542c0 2023-08-17T18:12:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.794+0000 7f9c4dfda700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9c48153ee0 0x7f9c480c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.794+0000 7f9c4e7db700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9c480bc2e0 0x7f9c480635c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54834/0 (socket says 172.21.15.78:54834) 2023-08-17T18:12:34.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.794+0000 7f9c4dfda700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9c48153ee0 0x7f9c480c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34736/0 (socket says 172.21.15.78:34736) 2023-08-17T18:12:34.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.794+0000 7f9c4e7db700 1 -- 172.21.15.78:0/965140478 learned_addr learned my addr 172.21.15.78:0/965140478 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:34.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.794+0000 7f9c4d7d9700 1 --2- 172.21.15.78:0/965140478 >> v2:172.21.15.150:3300/0 conn(0x7f9c481542c0 0x7f9c480c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.795+0000 7f9c4dfda700 1 -- 172.21.15.78:0/965140478 >> v2:172.21.15.150:3300/0 conn(0x7f9c481542c0 msgr2=0x7f9c480c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:34.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.795+0000 7f9c4dfda700 1 --2- 172.21.15.78:0/965140478 >> v2:172.21.15.150:3300/0 conn(0x7f9c481542c0 0x7f9c480c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.795+0000 7f9c4dfda700 1 -- 172.21.15.78:0/965140478 >> v1:172.21.15.78:6789/0 conn(0x7f9c480bc2e0 legacy=0x7f9c480635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.795+0000 7f9c4cfd8700 1 -- 172.21.15.78:0/965140478 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863310330 0 0) 0x7f9c4806b420 con 0x7f9c480bc2e0 2023-08-17T18:12:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.795+0000 7f9c4dfda700 1 -- 172.21.15.78:0/965140478 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4806b700 con 0x7f9c48153ee0 2023-08-17T18:12:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.795+0000 7f9c4dfda700 1 --2- 172.21.15.78:0/965140478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c48153ee0 0x7f9c480c6bd0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7f9c48069b50 tx=0x7f9c38009060).ready entity=mon.0 client_cookie=6e1acfd80c1d559f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.795+0000 7f9c4cfd8700 1 -- 172.21.15.78:0/965140478 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800f510 con 0x7f9c48153ee0 2023-08-17T18:12:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.795+0000 7f9c4cfd8700 1 -- 172.21.15.78:0/965140478 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3800f670 con 0x7f9c48153ee0 2023-08-17T18:12:34.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.795+0000 7f9c4cfd8700 1 -- 172.21.15.78:0/965140478 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800f9f0 con 0x7f9c48153ee0 2023-08-17T18:12:34.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.796+0000 7f9c4efdc700 1 -- 172.21.15.78:0/965140478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c48153ee0 msgr2=0x7f9c480c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.796+0000 7f9c4efdc700 1 --2- 172.21.15.78:0/965140478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c48153ee0 0x7f9c480c6bd0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7f9c48069b50 tx=0x7f9c38009060).stop 2023-08-17T18:12:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.796+0000 7f9c4efdc700 1 -- 172.21.15.78:0/965140478 shutdown_connections 2023-08-17T18:12:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.796+0000 7f9c4efdc700 1 --2- 172.21.15.78:0/965140478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c48153ee0 0x7f9c480c6bd0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.796+0000 7f9c4efdc700 1 --2- 172.21.15.78:0/965140478 >> v2:172.21.15.150:3300/0 conn(0x7f9c481542c0 0x7f9c480c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.796+0000 7f9c4efdc700 1 -- 172.21.15.78:0/965140478 >> 172.21.15.78:0/965140478 conn(0x7f9c480c3e20 msgr2=0x7f9c480c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.796+0000 7f9c4efdc700 1 -- 172.21.15.78:0/965140478 shutdown_connections 2023-08-17T18:12:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.796+0000 7f9c4efdc700 1 -- 172.21.15.78:0/965140478 wait complete. 2023-08-17T18:12:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.797+0000 7f9c4efdc700 1 Processor -- start 2023-08-17T18:12:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.797+0000 7f9c4efdc700 1 -- start start 2023-08-17T18:12:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4efdc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c480bc2e0 0x7f9c4814f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4efdc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c48153ee0 0x7f9c4814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4efdc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c481542c0 0x7f9c480ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4efdc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4814e5d0 con 0x7f9c480bc2e0 2023-08-17T18:12:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4efdc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4814fbf0 con 0x7f9c481542c0 2023-08-17T18:12:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4efdc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480a7250 con 0x7f9c48153ee0 2023-08-17T18:12:34.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4dfda700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c480bc2e0 0x7f9c4814f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4dfda700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c480bc2e0 0x7f9c4814f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34738/0 (socket says 172.21.15.78:34738) 2023-08-17T18:12:34.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4dfda700 1 -- 172.21.15.78:0/1827611907 learned_addr learned my addr 172.21.15.78:0/1827611907 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:34.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4e7db700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c481542c0 0x7f9c480ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4d7d9700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c48153ee0 0x7f9c4814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:34.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4dfda700 1 -- 172.21.15.78:0/1827611907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c48153ee0 msgr2=0x7f9c4814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4dfda700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c48153ee0 0x7f9c4814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4dfda700 1 -- 172.21.15.78:0/1827611907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c481542c0 msgr2=0x7f9c480ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4dfda700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c481542c0 0x7f9c480ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4dfda700 1 -- 172.21.15.78:0/1827611907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c380092a0 con 0x7f9c480bc2e0 2023-08-17T18:12:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4dfda700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c480bc2e0 0x7f9c4814f210 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f9c38009dd0 tx=0x7f9c38017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c3dffb700 1 -- 172.21.15.78:0/1827611907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800f7e0 con 0x7f9c480bc2e0 2023-08-17T18:12:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c3dffb700 1 -- 172.21.15.78:0/1827611907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3800f940 con 0x7f9c480bc2e0 2023-08-17T18:12:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c4efdc700 1 -- 172.21.15.78:0/1827611907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4814fdf0 con 0x7f9c480bc2e0 2023-08-17T18:12:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.798+0000 7f9c3dffb700 1 -- 172.21.15.78:0/1827611907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3801b660 con 0x7f9c480bc2e0 2023-08-17T18:12:34.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.799+0000 7f9c4efdc700 1 -- 172.21.15.78:0/1827611907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c481503b0 con 0x7f9c480bc2e0 2023-08-17T18:12:34.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.800+0000 7f9c4efdc700 1 -- 172.21.15.78:0/1827611907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4805f910 con 0x7f9c480bc2e0 2023-08-17T18:12:34.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.800+0000 7f9c3dffb700 1 -- 172.21.15.78:0/1827611907 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f9c3800f070 con 0x7f9c480bc2e0 2023-08-17T18:12:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.800+0000 7f9c3dffb700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9c2c05ede0 0x7f9c2c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.800+0000 7f9c4d7d9700 1 -- 172.21.15.78:0/1827611907 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9c2c05ede0 msgr2=0x7f9c2c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.800+0000 7f9c3dffb700 1 -- 172.21.15.78:0/1827611907 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9c3807b6a0 con 0x7f9c480bc2e0 2023-08-17T18:12:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.800+0000 7f9c4d7d9700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9c2c05ede0 0x7f9c2c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.804+0000 7f9c3dffb700 1 -- 172.21.15.78:0/1827611907 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c3804c9b0 con 0x7f9c480bc2e0 2023-08-17T18:12:34.832 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:34.831+0000 7fc7777d9680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T18:12:34.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.973+0000 7f9c4efdc700 1 -- 172.21.15.78:0/1827611907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c48046af0 con 0x7f9c480bc2e0 2023-08-17T18:12:34.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.973+0000 7f9c3dffb700 1 -- 172.21.15.78:0/1827611907 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v186) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c3804ffd0 con 0x7f9c480bc2e0 2023-08-17T18:12:34.974 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-08-17T18:12:34.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 -- 172.21.15.78:0/1827611907 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9c2c05ede0 msgr2=0x7f9c2c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:34.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9c2c05ede0 0x7f9c2c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:34.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 -- 172.21.15.78:0/1827611907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c480bc2e0 msgr2=0x7f9c4814f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:34.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c480bc2e0 0x7f9c4814f210 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f9c38009dd0 tx=0x7f9c38017000).stop 2023-08-17T18:12:34.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 -- 172.21.15.78:0/1827611907 shutdown_connections 2023-08-17T18:12:34.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f9c2c05ede0 0x7f9c2c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:34.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c481542c0 0x7f9c480ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c480bc2e0 0x7f9c4814f210 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 --2- 172.21.15.78:0/1827611907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c48153ee0 0x7f9c4814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:34.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 -- 172.21.15.78:0/1827611907 >> 172.21.15.78:0/1827611907 conn(0x7f9c480c3e20 msgr2=0x7f9c481526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:34.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 -- 172.21.15.78:0/1827611907 shutdown_connections 2023-08-17T18:12:34.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:34.975+0000 7f9c4efdc700 1 -- 172.21.15.78:0/1827611907 wait complete. 2023-08-17T18:12:34.988 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T18:12:35.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.109+0000 7fcff0d78700 1 Processor -- start 2023-08-17T18:12:35.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.109+0000 7fcff0d78700 1 -- start start 2023-08-17T18:12:35.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcff0d78700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcfec13a500 0x7fcfec0bcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcff0d78700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcfec0bdf40 0x7fcfec0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcff0d78700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec0652c0 con 0x7fcfec13a8e0 2023-08-17T18:12:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcff0d78700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec065560 con 0x7fcfec0bdf40 2023-08-17T18:12:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcff0d78700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec065840 con 0x7fcfec13a500 2023-08-17T18:12:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfead9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcfec0bdf40 0x7fcfec0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfe9d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcfec13a8e0 0x7fcfec0bd830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54840/0 (socket says 172.21.15.78:54840) 2023-08-17T18:12:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfe9d9b700 1 -- 172.21.15.78:0/424682797 learned_addr learned my addr 172.21.15.78:0/424682797 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfea59c700 1 --2- 172.21.15.78:0/424682797 >> v2:172.21.15.150:3300/0 conn(0x7fcfec13a500 0x7fcfec0bcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfe959a700 1 -- 172.21.15.78:0/424682797 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959310734 0 0) 0x7fcfec0652c0 con 0x7fcfec13a8e0 2023-08-17T18:12:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfe959a700 1 -- 172.21.15.78:0/424682797 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfd40033f0 con 0x7fcfec13a8e0 2023-08-17T18:12:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfead9d700 1 -- 172.21.15.78:0/424682797 >> v2:172.21.15.150:3300/0 conn(0x7fcfec13a500 msgr2=0x7fcfec0bcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfead9d700 1 --2- 172.21.15.78:0/424682797 >> v2:172.21.15.150:3300/0 conn(0x7fcfec13a500 0x7fcfec0bcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfead9d700 1 -- 172.21.15.78:0/424682797 >> v1:172.21.15.78:6789/0 conn(0x7fcfec13a8e0 legacy=0x7fcfec0bd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfead9d700 1 -- 172.21.15.78:0/424682797 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec065b20 con 0x7fcfec0bdf40 2023-08-17T18:12:35.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfead9d700 1 --2- 172.21.15.78:0/424682797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec0bdf40 0x7fcfec0c3e00 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7fcfec0c89e0 tx=0x7fcfe4009780).ready entity=mon.0 client_cookie=f8e49814ebed58b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:35.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfe959a700 1 -- 172.21.15.78:0/424682797 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400e070 con 0x7fcfec0bdf40 2023-08-17T18:12:35.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfe959a700 1 -- 172.21.15.78:0/424682797 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400bab0 con 0x7fcfec0bdf40 2023-08-17T18:12:35.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.110+0000 7fcfe959a700 1 -- 172.21.15.78:0/424682797 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400be30 con 0x7fcfec0bdf40 2023-08-17T18:12:35.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.111+0000 7fcff0d78700 1 -- 172.21.15.78:0/424682797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec0bdf40 msgr2=0x7fcfec0c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.111+0000 7fcff0d78700 1 --2- 172.21.15.78:0/424682797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec0bdf40 0x7fcfec0c3e00 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7fcfec0c89e0 tx=0x7fcfe4009780).stop 2023-08-17T18:12:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.111+0000 7fcff0d78700 1 -- 172.21.15.78:0/424682797 shutdown_connections 2023-08-17T18:12:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.111+0000 7fcff0d78700 1 --2- 172.21.15.78:0/424682797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec0bdf40 0x7fcfec0c3e00 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.111+0000 7fcff0d78700 1 --2- 172.21.15.78:0/424682797 >> v2:172.21.15.150:3300/0 conn(0x7fcfec13a500 0x7fcfec0bcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.111+0000 7fcff0d78700 1 -- 172.21.15.78:0/424682797 >> 172.21.15.78:0/424682797 conn(0x7fcfec0c7bd0 msgr2=0x7fcfec0c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.111+0000 7fcff0d78700 1 -- 172.21.15.78:0/424682797 shutdown_connections 2023-08-17T18:12:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.111+0000 7fcff0d78700 1 -- 172.21.15.78:0/424682797 wait complete. 2023-08-17T18:12:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.112+0000 7fcff0d78700 1 Processor -- start 2023-08-17T18:12:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.112+0000 7fcff0d78700 1 -- start start 2023-08-17T18:12:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcff0d78700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfec0bdf40 0x7fcfec154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcff0d78700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec13a500 0x7fcfec152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcff0d78700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfec13a8e0 0x7fcfec0c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcff0d78700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec136690 con 0x7fcfec13a500 2023-08-17T18:12:35.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcff0d78700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec155670 con 0x7fcfec0bdf40 2023-08-17T18:12:35.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcff0d78700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec155950 con 0x7fcfec13a8e0 2023-08-17T18:12:35.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfe9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec13a500 0x7fcfec152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfea59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfec0bdf40 0x7fcfec154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfea59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfec0bdf40 0x7fcfec154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:53410/0 (socket says 172.21.15.78:53410) 2023-08-17T18:12:35.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfea59c700 1 -- 172.21.15.78:0/4036939147 learned_addr learned my addr 172.21.15.78:0/4036939147 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:35.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfe9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec13a500 0x7fcfec152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34764/0 (socket says 172.21.15.78:34764) 2023-08-17T18:12:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfead9d700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfec13a8e0 0x7fcfec0c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfea59c700 1 -- 172.21.15.78:0/4036939147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfec13a8e0 msgr2=0x7fcfec0c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfea59c700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfec13a8e0 0x7fcfec0c0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfea59c700 1 -- 172.21.15.78:0/4036939147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec13a500 msgr2=0x7fcfec152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfea59c700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec13a500 0x7fcfec152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfea59c700 1 -- 172.21.15.78:0/4036939147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe4009a20 con 0x7fcfec0bdf40 2023-08-17T18:12:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.113+0000 7fcfe9d9b700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec13a500 0x7fcfec152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.114+0000 7fcfea59c700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfec0bdf40 0x7fcfec154d90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fcfdc00e950 tx=0x7fcfdc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.114+0000 7fcfda7fc700 1 -- 172.21.15.78:0/4036939147 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc009530 con 0x7fcfec0bdf40 2023-08-17T18:12:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.114+0000 7fcfda7fc700 1 -- 172.21.15.78:0/4036939147 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc012600 con 0x7fcfec0bdf40 2023-08-17T18:12:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.114+0000 7fcff0d78700 1 -- 172.21.15.78:0/4036939147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec155c30 con 0x7fcfec0bdf40 2023-08-17T18:12:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.114+0000 7fcfda7fc700 1 -- 172.21.15.78:0/4036939147 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc012980 con 0x7fcfec0bdf40 2023-08-17T18:12:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.114+0000 7fcff0d78700 1 -- 172.21.15.78:0/4036939147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec155280 con 0x7fcfec0bdf40 2023-08-17T18:12:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.115+0000 7fcff0d78700 1 -- 172.21.15.78:0/4036939147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec0c57d0 con 0x7fcfec0bdf40 2023-08-17T18:12:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.115+0000 7fcfda7fc700 1 -- 172.21.15.78:0/4036939147 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fcfdc022070 con 0x7fcfec0bdf40 2023-08-17T18:12:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.115+0000 7fcfda7fc700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcfcc05ede0 0x7fcfcc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.116+0000 7fcfe9d9b700 1 -- 172.21.15.78:0/4036939147 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcfcc05ede0 msgr2=0x7fcfcc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.116+0000 7fcfda7fc700 1 -- 172.21.15.78:0/4036939147 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fcfdc07a350 con 0x7fcfec0bdf40 2023-08-17T18:12:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.116+0000 7fcfe9d9b700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcfcc05ede0 0x7fcfcc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:35.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.123+0000 7fcfda7fc700 1 -- 172.21.15.78:0/4036939147 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcfdc04b6f0 con 0x7fcfec0bdf40 2023-08-17T18:12:35.220 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:35.219+0000 7f7fc5259680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:12:35.273 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:35.272+0000 7fc7777d9680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T18:12:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.296+0000 7fcff0d78700 1 -- 172.21.15.78:0/4036939147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcfec06be70 con 0x7fcfec0bdf40 2023-08-17T18:12:35.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.297+0000 7fcfda7fc700 1 -- 172.21.15.78:0/4036939147 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v186) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcfec06be70 con 0x7fcfec0bdf40 2023-08-17T18:12:35.298 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T18:12:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 -- 172.21.15.78:0/4036939147 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcfcc05ede0 msgr2=0x7fcfcc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcfcc05ede0 0x7fcfcc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 -- 172.21.15.78:0/4036939147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfec0bdf40 msgr2=0x7fcfec154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfec0bdf40 0x7fcfec154d90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fcfdc00e950 tx=0x7fcfdc009060).stop 2023-08-17T18:12:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 -- 172.21.15.78:0/4036939147 shutdown_connections 2023-08-17T18:12:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcfcc05ede0 0x7fcfcc0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfec13a8e0 0x7fcfec0c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfec0bdf40 0x7fcfec154d90 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 --2- 172.21.15.78:0/4036939147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfec13a500 0x7fcfec152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 -- 172.21.15.78:0/4036939147 >> 172.21.15.78:0/4036939147 conn(0x7fcfec0c7bd0 msgr2=0x7fcfec139640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 -- 172.21.15.78:0/4036939147 shutdown_connections 2023-08-17T18:12:35.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.299+0000 7fcff0d78700 1 -- 172.21.15.78:0/4036939147 wait complete. 2023-08-17T18:12:35.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T18:12:35.324 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:35.322+0000 7f7fc5259680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:35.383 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:35.382+0000 7fc7777d9680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:35.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.430+0000 7f25a0f5c700 1 Processor -- start 2023-08-17T18:12:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.430+0000 7f25a0f5c700 1 -- start start 2023-08-17T18:12:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.431+0000 7f25a0f5c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f259c0aa0f0 0x7f259c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.431+0000 7f25a0f5c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 0x7f259c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.431+0000 7f25a0f5c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c0649b0 con 0x7f259c0c5810 2023-08-17T18:12:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.431+0000 7f25a0f5c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c063420 con 0x7f259c0aa0f0 2023-08-17T18:12:35.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.431+0000 7f25a0f5c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c063700 con 0x7f259c0aa4d0 2023-08-17T18:12:35.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.431+0000 7f2599d9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 0x7f259c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.431+0000 7f259a59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f259c0aa0f0 0x7f259c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.431+0000 7f259ad9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f259c0c5810 0x7f259c0c5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:48816/0 (socket says 172.21.15.78:48816) 2023-08-17T18:12:35.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.431+0000 7f259ad9d700 1 -- 172.21.15.78:0/2970569433 learned_addr learned my addr 172.21.15.78:0/2970569433 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:35.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.432+0000 7f259a59c700 1 -- 172.21.15.78:0/2970569433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 msgr2=0x7f259c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:35.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.432+0000 7f259a59c700 1 --2- 172.21.15.78:0/2970569433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 0x7f259c0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.432+0000 7f259a59c700 1 -- 172.21.15.78:0/2970569433 >> v1:172.21.15.150:6789/0 conn(0x7f259c0c5810 legacy=0x7f259c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.432+0000 7f259a59c700 1 -- 172.21.15.78:0/2970569433 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c0639e0 con 0x7f259c0aa0f0 2023-08-17T18:12:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.432+0000 7f259959a700 1 -- 172.21.15.78:0/2970569433 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62485795 0 0) 0x7f259c0649b0 con 0x7f259c0c5810 2023-08-17T18:12:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.432+0000 7f2599d9b700 1 --2- 172.21.15.78:0/2970569433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 0x7f259c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.432+0000 7f259a59c700 1 --2- 172.21.15.78:0/2970569433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f259c0aa0f0 0x7f259c0644c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f2590009760 tx=0x7f2590009060).ready entity=mon.1 client_cookie=e02baeeb27268902 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.432+0000 7f259959a700 1 -- 172.21.15.78:0/2970569433 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000f510 con 0x7f259c0aa0f0 2023-08-17T18:12:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.432+0000 7f259959a700 1 -- 172.21.15.78:0/2970569433 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259000f670 con 0x7f259c0aa0f0 2023-08-17T18:12:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.432+0000 7f259959a700 1 -- 172.21.15.78:0/2970569433 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000f9f0 con 0x7f259c0aa0f0 2023-08-17T18:12:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.433+0000 7f25a0f5c700 1 -- 172.21.15.78:0/2970569433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f259c0aa0f0 msgr2=0x7f259c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.433+0000 7f25a0f5c700 1 --2- 172.21.15.78:0/2970569433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f259c0aa0f0 0x7f259c0644c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f2590009760 tx=0x7f2590009060).stop 2023-08-17T18:12:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.433+0000 7f25a0f5c700 1 -- 172.21.15.78:0/2970569433 shutdown_connections 2023-08-17T18:12:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.433+0000 7f25a0f5c700 1 --2- 172.21.15.78:0/2970569433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f259c0aa0f0 0x7f259c0644c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.433+0000 7f25a0f5c700 1 --2- 172.21.15.78:0/2970569433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 0x7f259c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.433+0000 7f25a0f5c700 1 -- 172.21.15.78:0/2970569433 >> 172.21.15.78:0/2970569433 conn(0x7f259c06a6a0 msgr2=0x7f259c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.433+0000 7f25a0f5c700 1 -- 172.21.15.78:0/2970569433 shutdown_connections 2023-08-17T18:12:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.433+0000 7f25a0f5c700 1 -- 172.21.15.78:0/2970569433 wait complete. 2023-08-17T18:12:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.434+0000 7f25a0f5c700 1 Processor -- start 2023-08-17T18:12:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.434+0000 7f25a0f5c700 1 -- start start 2023-08-17T18:12:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f25a0f5c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f259c0aa0f0 0x7f259c1649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f25a0f5c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 0x7f259c0c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f25a0f5c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c0c5810 0x7f259c0c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f25a0f5c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0c3d00 con 0x7f259c0c5810 2023-08-17T18:12:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f25a0f5c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0ade80 con 0x7f259c0aa0f0 2023-08-17T18:12:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f25a0f5c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c1514c0 con 0x7f259c0aa4d0 2023-08-17T18:12:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f259ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c0c5810 0x7f259c0c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f259a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f259c0aa0f0 0x7f259c1649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f2599d9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 0x7f259c0c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f259ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c0c5810 0x7f259c0c3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34780/0 (socket says 172.21.15.78:34780) 2023-08-17T18:12:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f259ad9d700 1 -- 172.21.15.78:0/4179449135 learned_addr learned my addr 172.21.15.78:0/4179449135 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f259ad9d700 1 -- 172.21.15.78:0/4179449135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 msgr2=0x7f259c0c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f259ad9d700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 0x7f259c0c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f259ad9d700 1 -- 172.21.15.78:0/4179449135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f259c0aa0f0 msgr2=0x7f259c1649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f259ad9d700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f259c0aa0f0 0x7f259c1649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f259ad9d700 1 -- 172.21.15.78:0/4179449135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0092a0 con 0x7f259c0c5810 2023-08-17T18:12:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f259a59c700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f259c0aa0f0 0x7f259c1649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.435+0000 7f2599d9b700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 0x7f259c0c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.436+0000 7f259ad9d700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c0c5810 0x7f259c0c3810 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7f259400c790 tx=0x7f2594007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.436+0000 7f258a7fc700 1 -- 172.21.15.78:0/4179449135 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594005d30 con 0x7f259c0c5810 2023-08-17T18:12:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.436+0000 7f258a7fc700 1 -- 172.21.15.78:0/4179449135 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2594007110 con 0x7f259c0c5810 2023-08-17T18:12:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.436+0000 7f25a0f5c700 1 -- 172.21.15.78:0/4179449135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25900092a0 con 0x7f259c0c5810 2023-08-17T18:12:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.436+0000 7f258a7fc700 1 -- 172.21.15.78:0/4179449135 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25940074d0 con 0x7f259c0c5810 2023-08-17T18:12:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.436+0000 7f25a0f5c700 1 -- 172.21.15.78:0/4179449135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c165240 con 0x7f259c0c5810 2023-08-17T18:12:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.437+0000 7f25a0f5c700 1 -- 172.21.15.78:0/4179449135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c0ae030 con 0x7f259c0c5810 2023-08-17T18:12:35.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.438+0000 7f258a7fc700 1 -- 172.21.15.78:0/4179449135 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f2594010030 con 0x7f259c0c5810 2023-08-17T18:12:35.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.438+0000 7f258a7fc700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f257c05ede0 0x7f257c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.438+0000 7f259a59c700 1 -- 172.21.15.78:0/4179449135 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f257c05ede0 msgr2=0x7f257c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:35.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.438+0000 7f258a7fc700 1 -- 172.21.15.78:0/4179449135 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f259407a030 con 0x7f259c0c5810 2023-08-17T18:12:35.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.439+0000 7f259a59c700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f257c05ede0 0x7f257c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:35.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.442+0000 7f258a7fc700 1 -- 172.21.15.78:0/4179449135 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f259404b450 con 0x7f259c0c5810 2023-08-17T18:12:35.478 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:35.477+0000 7f7fc5259680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:35.541 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:35.540+0000 7fc7777d9680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:35.554 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:35.553+0000 7f7fc5259680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:12:35.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.609+0000 7f25a0f5c700 1 -- 172.21.15.78:0/4179449135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f259c0ae030 con 0x7f259c0c5810 2023-08-17T18:12:35.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.609+0000 7f258a7fc700 1 -- 172.21.15.78:0/4179449135 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v186) v1 ==== 100+0+11 (secure 0 0 0) 0x7f259c0ae030 con 0x7f259c0c5810 2023-08-17T18:12:35.610 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-08-17T18:12:35.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 -- 172.21.15.78:0/4179449135 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f257c05ede0 msgr2=0x7f257c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:35.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f257c05ede0 0x7f257c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:35.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 -- 172.21.15.78:0/4179449135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c0c5810 msgr2=0x7f259c0c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c0c5810 0x7f259c0c3810 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7f259400c790 tx=0x7f2594007f30).stop 2023-08-17T18:12:35.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 -- 172.21.15.78:0/4179449135 shutdown_connections 2023-08-17T18:12:35.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f257c05ede0 0x7f257c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:35.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c0c5810 0x7f259c0c3810 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f259c0aa0f0 0x7f259c1649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 --2- 172.21.15.78:0/4179449135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f259c0aa4d0 0x7f259c0c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 -- 172.21.15.78:0/4179449135 >> 172.21.15.78:0/4179449135 conn(0x7f259c06a6a0 msgr2=0x7f259c151840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:35.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 -- 172.21.15.78:0/4179449135 shutdown_connections 2023-08-17T18:12:35.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.611+0000 7f25a0f5c700 1 -- 172.21.15.78:0/4179449135 wait complete. 2023-08-17T18:12:35.621 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:35.620+0000 7f7fc5259680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:12:35.622 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:35.621+0000 7fc7777d9680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T18:12:35.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:35.697 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:35.696+0000 7fc7777d9680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T18:12:35.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.744+0000 7f4525940700 1 Processor -- start 2023-08-17T18:12:35.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.744+0000 7f4525940700 1 -- start start 2023-08-17T18:12:35.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.745+0000 7f4525940700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4520062c00 0x7f45201353d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.745+0000 7f4525940700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4520152b50 0x7f4520152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.745+0000 7f4525940700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4520069050 con 0x7f4520134ff0 2023-08-17T18:12:35.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.745+0000 7f4525940700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4520066d50 con 0x7f4520062c00 2023-08-17T18:12:35.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.745+0000 7f4525940700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452006a060 con 0x7f4520152b50 2023-08-17T18:12:35.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.745+0000 7f451e7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4520062c00 0x7f45201353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.745+0000 7f451effd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4520134ff0 0x7f45200624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54844/0 (socket says 172.21.15.78:54844) 2023-08-17T18:12:35.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.745+0000 7f451e7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4520062c00 0x7f45201353d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34792/0 (socket says 172.21.15.78:34792) 2023-08-17T18:12:35.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.745+0000 7f451effd700 1 -- 172.21.15.78:0/3866504799 learned_addr learned my addr 172.21.15.78:0/3866504799 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:35.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.746+0000 7f451f7fe700 1 --2- 172.21.15.78:0/3866504799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4520152b50 0x7f4520152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.746+0000 7f451e7fc700 1 -- 172.21.15.78:0/3866504799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4520152b50 msgr2=0x7f4520152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:35.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.746+0000 7f451e7fc700 1 --2- 172.21.15.78:0/3866504799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4520152b50 0x7f4520152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.746+0000 7f451e7fc700 1 -- 172.21.15.78:0/3866504799 >> v1:172.21.15.78:6789/0 conn(0x7f4520134ff0 legacy=0x7f45200624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.746+0000 7f451e7fc700 1 -- 172.21.15.78:0/3866504799 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45200692a0 con 0x7f4520062c00 2023-08-17T18:12:35.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.746+0000 7f451e7fc700 1 --2- 172.21.15.78:0/3866504799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 0x7f45201353d0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f4510009790 tx=0x7f4510009060).ready entity=mon.0 client_cookie=29a8a1dfd594d722 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:35.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.746+0000 7f451dffb700 1 -- 172.21.15.78:0/3866504799 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000b580 con 0x7f4520062c00 2023-08-17T18:12:35.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.746+0000 7f451dffb700 1 -- 172.21.15.78:0/3866504799 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451000b6e0 con 0x7f4520062c00 2023-08-17T18:12:35.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.746+0000 7f451dffb700 1 -- 172.21.15.78:0/3866504799 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000ba60 con 0x7f4520062c00 2023-08-17T18:12:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.747+0000 7f4525940700 1 -- 172.21.15.78:0/3866504799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 msgr2=0x7f45201353d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.747+0000 7f4525940700 1 --2- 172.21.15.78:0/3866504799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 0x7f45201353d0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f4510009790 tx=0x7f4510009060).stop 2023-08-17T18:12:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.747+0000 7f4525940700 1 -- 172.21.15.78:0/3866504799 shutdown_connections 2023-08-17T18:12:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.747+0000 7f4525940700 1 --2- 172.21.15.78:0/3866504799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4520152b50 0x7f4520152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.747+0000 7f4525940700 1 --2- 172.21.15.78:0/3866504799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 0x7f45201353d0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.747+0000 7f4525940700 1 -- 172.21.15.78:0/3866504799 >> 172.21.15.78:0/3866504799 conn(0x7f45200c7b00 msgr2=0x7f45200c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:35.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.747+0000 7f4525940700 1 -- 172.21.15.78:0/3866504799 shutdown_connections 2023-08-17T18:12:35.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.747+0000 7f4525940700 1 -- 172.21.15.78:0/3866504799 wait complete. 2023-08-17T18:12:35.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.748+0000 7f4525940700 1 Processor -- start 2023-08-17T18:12:35.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.748+0000 7f4525940700 1 -- start start 2023-08-17T18:12:35.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f4525940700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 0x7f4520144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f4525940700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4520134ff0 0x7f4520164a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f4525940700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4520152b50 0x7f45200c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f4525940700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45200c5a70 con 0x7f4520062c00 2023-08-17T18:12:35.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f4525940700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4520144a80 con 0x7f4520152b50 2023-08-17T18:12:35.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f4525940700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45201652d0 con 0x7f4520134ff0 2023-08-17T18:12:35.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 0x7f4520144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 0x7f4520144590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34798/0 (socket says 172.21.15.78:34798) 2023-08-17T18:12:35.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451effd700 1 -- 172.21.15.78:0/4044581999 learned_addr learned my addr 172.21.15.78:0/4044581999 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:35.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451f7fe700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4520152b50 0x7f45200c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451e7fc700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4520134ff0 0x7f4520164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:35.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451effd700 1 -- 172.21.15.78:0/4044581999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4520134ff0 msgr2=0x7f4520164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451effd700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4520134ff0 0x7f4520164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451effd700 1 -- 172.21.15.78:0/4044581999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4520152b50 msgr2=0x7f45200c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451effd700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4520152b50 0x7f45200c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451effd700 1 -- 172.21.15.78:0/4044581999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100092a0 con 0x7f4520062c00 2023-08-17T18:12:35.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f451effd700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 0x7f4520144590 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f451400c490 tx=0x7f4514007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:35.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f4506ffd700 1 -- 172.21.15.78:0/4044581999 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451400ce00 con 0x7f4520062c00 2023-08-17T18:12:35.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f4506ffd700 1 -- 172.21.15.78:0/4044581999 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45140072e0 con 0x7f4520062c00 2023-08-17T18:12:35.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.749+0000 7f4506ffd700 1 -- 172.21.15.78:0/4044581999 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514007660 con 0x7f4520062c00 2023-08-17T18:12:35.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.750+0000 7f4525940700 1 -- 172.21.15.78:0/4044581999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45201655b0 con 0x7f4520062c00 2023-08-17T18:12:35.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.750+0000 7f4525940700 1 -- 172.21.15.78:0/4044581999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45200c5700 con 0x7f4520062c00 2023-08-17T18:12:35.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.751+0000 7f4525940700 1 -- 172.21.15.78:0/4044581999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45200c5d50 con 0x7f4520062c00 2023-08-17T18:12:35.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.751+0000 7f4506ffd700 1 -- 172.21.15.78:0/4044581999 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f4514010070 con 0x7f4520062c00 2023-08-17T18:12:35.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.751+0000 7f4506ffd700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f450c05ede0 0x7f450c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:35.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.751+0000 7f451e7fc700 1 -- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f450c05ede0 msgr2=0x7f450c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:35.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.751+0000 7f4506ffd700 1 -- 172.21.15.78:0/4044581999 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f4514079210 con 0x7f4520062c00 2023-08-17T18:12:35.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.751+0000 7f451e7fc700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f450c05ede0 0x7f450c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:35.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.756+0000 7f4506ffd700 1 -- 172.21.15.78:0/4044581999 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f451404a630 con 0x7f4520062c00 2023-08-17T18:12:35.883 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:35.882+0000 7f7fc5259680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:12:35.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.952+0000 7f451e7fc700 1 -- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f450c05ede0 msgr2=0x7f450c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:35.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.952+0000 7f451e7fc700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f450c05ede0 0x7f450c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.968+0000 7f4525940700 1 -- 172.21.15.78:0/4044581999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4520138960 con 0x7f4520062c00 2023-08-17T18:12:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.968+0000 7f4506ffd700 1 -- 172.21.15.78:0/4044581999 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f451404dc50 con 0x7f4520062c00 2023-08-17T18:12:35.969 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:35.970 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":67,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1111956777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1111956777},{"type":"v1","addr":"172.21.15.78:6837","nonce":1111956777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1739806080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1739806080},{"type":"v1","addr":"172.21.15.150:6834","nonce":1739806080}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":9528,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/168802869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":168802869},{"type":"v1","addr":"172.21.15.78:6836","nonce":168802869}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:12:19.124866+0000","modified":"2023-08-17T18:12:21.130921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9537":{"gid":9537,"name":"d","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2525491694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2525491694},{"type":"v1","addr":"172.21.15.150:6835","nonce":2525491694}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T18:12:35.970 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:35.969+0000 7fc7777d9680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T18:12:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 -- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f450c05ede0 msgr2=0x7f450c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f450c05ede0 0x7f450c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 -- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 msgr2=0x7f4520144590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 0x7f4520144590 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f451400c490 tx=0x7f4514007df0).stop 2023-08-17T18:12:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 -- 172.21.15.78:0/4044581999 shutdown_connections 2023-08-17T18:12:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f450c05ede0 0x7f450c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4520152b50 0x7f45200c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520062c00 0x7f4520144590 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 --2- 172.21.15.78:0/4044581999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4520134ff0 0x7f4520164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 -- 172.21.15.78:0/4044581999 >> 172.21.15.78:0/4044581999 conn(0x7f45200c7b00 msgr2=0x7f45201345f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 -- 172.21.15.78:0/4044581999 shutdown_connections 2023-08-17T18:12:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:35.970+0000 7f4525940700 1 -- 172.21.15.78:0/4044581999 wait complete. 2023-08-17T18:12:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 67 2023-08-17T18:12:35.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:36.067 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:36.065+0000 7f7fc5259680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.101+0000 7f5ce8690700 1 Processor -- start 2023-08-17T18:12:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.101+0000 7f5ce8690700 1 -- start start 2023-08-17T18:12:36.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.102+0000 7f5ce8690700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ce0066660 0x7f5ce00c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.102+0000 7f5ce8690700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce00c5b50 0x7f5ce00624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.102+0000 7f5ce8690700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce00c6040 con 0x7f5ce0066a40 2023-08-17T18:12:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.102+0000 7f5ce8690700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce0069b00 con 0x7f5ce0066660 2023-08-17T18:12:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.102+0000 7f5ce8690700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0069f90 con 0x7f5ce00c5b50 2023-08-17T18:12:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce5c2b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce00c5b50 0x7f5ce00624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce642c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ce0066660 0x7f5ce00c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce6c2d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5ce0066a40 0x7f5ce0151570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:48824/0 (socket says 172.21.15.78:48824) 2023-08-17T18:12:36.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce5c2b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce00c5b50 0x7f5ce00624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:58364/0 (socket says 172.21.15.78:58364) 2023-08-17T18:12:36.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce6c2d700 1 -- 172.21.15.78:0/1797582971 learned_addr learned my addr 172.21.15.78:0/1797582971 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:36.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce642c700 1 -- 172.21.15.78:0/1797582971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce00c5b50 msgr2=0x7f5ce00624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:36.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce642c700 1 --2- 172.21.15.78:0/1797582971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce00c5b50 0x7f5ce00624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce642c700 1 -- 172.21.15.78:0/1797582971 >> v1:172.21.15.150:6789/0 conn(0x7f5ce0066a40 legacy=0x7f5ce0151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce642c700 1 -- 172.21.15.78:0/1797582971 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00691d0 con 0x7f5ce0066660 2023-08-17T18:12:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce542a700 1 -- 172.21.15.78:0/1797582971 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171958411 0 0) 0x7f5cd8001490 con 0x7f5ce0066a40 2023-08-17T18:12:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce642c700 1 --2- 172.21.15.78:0/1797582971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ce0066660 0x7f5ce00c5660 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f5cd0009760 tx=0x7f5cd0009060).ready entity=mon.1 client_cookie=4bed0d5e405e4ba6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce542a700 1 -- 172.21.15.78:0/1797582971 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd000f510 con 0x7f5ce0066660 2023-08-17T18:12:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce542a700 1 -- 172.21.15.78:0/1797582971 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd000f670 con 0x7f5ce0066660 2023-08-17T18:12:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.103+0000 7f5ce542a700 1 -- 172.21.15.78:0/1797582971 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd000f9f0 con 0x7f5ce0066660 2023-08-17T18:12:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.104+0000 7f5ce8690700 1 -- 172.21.15.78:0/1797582971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ce0066660 msgr2=0x7f5ce00c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.104+0000 7f5ce8690700 1 --2- 172.21.15.78:0/1797582971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ce0066660 0x7f5ce00c5660 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f5cd0009760 tx=0x7f5cd0009060).stop 2023-08-17T18:12:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.104+0000 7f5ce8690700 1 -- 172.21.15.78:0/1797582971 shutdown_connections 2023-08-17T18:12:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.104+0000 7f5ce8690700 1 --2- 172.21.15.78:0/1797582971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ce0066660 0x7f5ce00c5660 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.104+0000 7f5ce8690700 1 --2- 172.21.15.78:0/1797582971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce00c5b50 0x7f5ce00624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.104+0000 7f5ce8690700 1 -- 172.21.15.78:0/1797582971 >> 172.21.15.78:0/1797582971 conn(0x7f5ce00c7b00 msgr2=0x7f5ce00c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.104+0000 7f5ce8690700 1 -- 172.21.15.78:0/1797582971 shutdown_connections 2023-08-17T18:12:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.104+0000 7f5ce8690700 1 -- 172.21.15.78:0/1797582971 wait complete. 2023-08-17T18:12:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.105+0000 7f5ce8690700 1 Processor -- start 2023-08-17T18:12:36.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.105+0000 7f5ce8690700 1 -- start start 2023-08-17T18:12:36.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce8690700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ce0066660 0x7f5ce00aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce8690700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce0066a40 0x7f5ce01647e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce8690700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ce00c5b50 0x7f5ce0164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce8690700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00ab210 con 0x7f5ce00c5b50 2023-08-17T18:12:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce8690700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00a86e0 con 0x7f5ce0066660 2023-08-17T18:12:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce8690700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce01651c0 con 0x7f5ce0066a40 2023-08-17T18:12:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce6c2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ce00c5b50 0x7f5ce0164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce6c2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ce00c5b50 0x7f5ce0164cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34810/0 (socket says 172.21.15.78:34810) 2023-08-17T18:12:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce6c2d700 1 -- 172.21.15.78:0/947315462 learned_addr learned my addr 172.21.15.78:0/947315462 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:36.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce642c700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ce0066660 0x7f5ce00aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.106+0000 7f5ce5c2b700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce0066a40 0x7f5ce01647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5ce6c2d700 1 -- 172.21.15.78:0/947315462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce0066a40 msgr2=0x7f5ce01647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5ce6c2d700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce0066a40 0x7f5ce01647e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5ce6c2d700 1 -- 172.21.15.78:0/947315462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ce0066660 msgr2=0x7f5ce00aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5ce6c2d700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ce0066660 0x7f5ce00aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5ce6c2d700 1 -- 172.21.15.78:0/947315462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd00092a0 con 0x7f5ce00c5b50 2023-08-17T18:12:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5ce642c700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ce0066660 0x7f5ce00aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5ce6c2d700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ce00c5b50 0x7f5ce0164cd0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f5cd800c840 tx=0x7f5cd8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5cd67fc700 1 -- 172.21.15.78:0/947315462 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8005d30 con 0x7f5ce00c5b50 2023-08-17T18:12:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5cd67fc700 1 -- 172.21.15.78:0/947315462 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd8005e90 con 0x7f5ce00c5b50 2023-08-17T18:12:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5cd67fc700 1 -- 172.21.15.78:0/947315462 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80072e0 con 0x7f5ce00c5b50 2023-08-17T18:12:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5ce8690700 1 -- 172.21.15.78:0/947315462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce00c1570 con 0x7f5ce00c5b50 2023-08-17T18:12:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.107+0000 7f5ce8690700 1 -- 172.21.15.78:0/947315462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce00c1b30 con 0x7f5ce00c5b50 2023-08-17T18:12:36.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.108+0000 7f5ce8690700 1 -- 172.21.15.78:0/947315462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce00a8850 con 0x7f5ce00c5b50 2023-08-17T18:12:36.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.108+0000 7f5cd67fc700 1 -- 172.21.15.78:0/947315462 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f5cd8010070 con 0x7f5ce00c5b50 2023-08-17T18:12:36.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.109+0000 7f5cd67fc700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5cc405ede0 0x7f5cc40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.109+0000 7f5ce642c700 1 -- 172.21.15.78:0/947315462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5cc405ede0 msgr2=0x7f5cc40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:36.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.109+0000 7f5cd67fc700 1 -- 172.21.15.78:0/947315462 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5cd8079500 con 0x7f5ce00c5b50 2023-08-17T18:12:36.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.109+0000 7f5ce642c700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5cc405ede0 0x7f5cc40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:36.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.116+0000 7f5cd67fc700 1 -- 172.21.15.78:0/947315462 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5cd804a920 con 0x7f5ce00c5b50 2023-08-17T18:12:36.167 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:36.166+0000 7fc7777d9680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T18:12:36.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.286+0000 7f5ce8690700 1 -- 172.21.15.78:0/947315462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ce00c6040 con 0x7f5ce00c5b50 2023-08-17T18:12:36.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.288+0000 7f5cd67fc700 1 -- 172.21.15.78:0/947315462 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+17235 (secure 0 0 0) 0x7f5ce00c6040 con 0x7f5ce00c5b50 2023-08-17T18:12:36.289 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:36.289 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":186,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:30.406194+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:12:17.650042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T18:12:18.089352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6833/158925":"2023-08-18T18:12:30.406163+0000","172.21.15.78:6832/158925":"2023-08-18T18:12:30.406163+0000","172.21.15.78:0/831867818":"2023-08-18T18:12:30.406163+0000","172.21.15.78:0/2706117257":"2023-08-18T18:12:30.406163+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 -- 172.21.15.78:0/947315462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5cc405ede0 msgr2=0x7f5cc40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5cc405ede0 0x7f5cc40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 -- 172.21.15.78:0/947315462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ce00c5b50 msgr2=0x7f5ce0164cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ce00c5b50 0x7f5ce0164cd0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f5cd800c840 tx=0x7f5cd8007d70).stop 2023-08-17T18:12:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 -- 172.21.15.78:0/947315462 shutdown_connections 2023-08-17T18:12:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5cc405ede0 0x7f5cc40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ce00c5b50 0x7f5ce0164cd0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ce0066660 0x7f5ce00aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 --2- 172.21.15.78:0/947315462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ce0066a40 0x7f5ce01647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 -- 172.21.15.78:0/947315462 >> 172.21.15.78:0/947315462 conn(0x7f5ce00c7b00 msgr2=0x7f5ce00a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 -- 172.21.15.78:0/947315462 shutdown_connections 2023-08-17T18:12:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.290+0000 7f5ce8690700 1 -- 172.21.15.78:0/947315462 wait complete. 2023-08-17T18:12:36.303 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T18:12:36.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:36.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.419+0000 7fc657579700 1 Processor -- start 2023-08-17T18:12:36.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.419+0000 7fc657579700 1 -- start start 2023-08-17T18:12:36.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.420+0000 7fc657579700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc650157200 0x7fc6500a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.420+0000 7fc657579700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6501575e0 0x7fc650095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.420+0000 7fc657579700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6500c57f0 con 0x7fc6500a8130 2023-08-17T18:12:36.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.420+0000 7fc657579700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6500c5ad0 con 0x7fc650157200 2023-08-17T18:12:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.420+0000 7fc657579700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6500c5db0 con 0x7fc6501575e0 2023-08-17T18:12:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.420+0000 7fc656577700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc650157200 0x7fc6500a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.420+0000 7fc655d76700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6501575e0 0x7fc650095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.420+0000 7fc656d78700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc6500a8130 0x7fc650157ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:48830/0 (socket says 172.21.15.78:48830) 2023-08-17T18:12:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.420+0000 7fc656d78700 1 -- 172.21.15.78:0/1209137106 learned_addr learned my addr 172.21.15.78:0/1209137106 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc656577700 1 -- 172.21.15.78:0/1209137106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6501575e0 msgr2=0x7fc650095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc656577700 1 --2- 172.21.15.78:0/1209137106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6501575e0 0x7fc650095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc656577700 1 -- 172.21.15.78:0/1209137106 >> v1:172.21.15.150:6789/0 conn(0x7fc6500a8130 legacy=0x7fc650157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc656577700 1 -- 172.21.15.78:0/1209137106 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6500c6090 con 0x7fc650157200 2023-08-17T18:12:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc655575700 1 -- 172.21.15.78:0/1209137106 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737829415 0 0) 0x7fc6500c57f0 con 0x7fc6500a8130 2023-08-17T18:12:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc655d76700 1 --2- 172.21.15.78:0/1209137106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6501575e0 0x7fc650095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:36.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc656577700 1 --2- 172.21.15.78:0/1209137106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc650157200 0x7fc6500a7c40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fc640009760 tx=0x7fc640009060).ready entity=mon.1 client_cookie=3c6974fced5a0966 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:36.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc655575700 1 -- 172.21.15.78:0/1209137106 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000f510 con 0x7fc650157200 2023-08-17T18:12:36.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc655575700 1 -- 172.21.15.78:0/1209137106 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64000f670 con 0x7fc650157200 2023-08-17T18:12:36.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc655575700 1 -- 172.21.15.78:0/1209137106 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000f9f0 con 0x7fc650157200 2023-08-17T18:12:36.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc657579700 1 -- 172.21.15.78:0/1209137106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc650157200 msgr2=0x7fc6500a7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.421+0000 7fc657579700 1 --2- 172.21.15.78:0/1209137106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc650157200 0x7fc6500a7c40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fc640009760 tx=0x7fc640009060).stop 2023-08-17T18:12:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.422+0000 7fc657579700 1 -- 172.21.15.78:0/1209137106 shutdown_connections 2023-08-17T18:12:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.422+0000 7fc657579700 1 --2- 172.21.15.78:0/1209137106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc650157200 0x7fc6500a7c40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.422+0000 7fc657579700 1 --2- 172.21.15.78:0/1209137106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6501575e0 0x7fc650095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.422+0000 7fc657579700 1 -- 172.21.15.78:0/1209137106 >> 172.21.15.78:0/1209137106 conn(0x7fc6500624f0 msgr2=0x7fc650062900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.422+0000 7fc657579700 1 -- 172.21.15.78:0/1209137106 shutdown_connections 2023-08-17T18:12:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.422+0000 7fc657579700 1 -- 172.21.15.78:0/1209137106 wait complete. 2023-08-17T18:12:36.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.423+0000 7fc657579700 1 Processor -- start 2023-08-17T18:12:36.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.423+0000 7fc657579700 1 -- start start 2023-08-17T18:12:36.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.423+0000 7fc657579700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6500a8130 0x7fc6500a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.423+0000 7fc657579700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc650157200 0x7fc6500c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.423+0000 7fc657579700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6501575e0 0x7fc6500c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.423+0000 7fc657579700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6500bff00 con 0x7fc650157200 2023-08-17T18:12:36.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.423+0000 7fc657579700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6500c7a10 con 0x7fc6501575e0 2023-08-17T18:12:36.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.423+0000 7fc657579700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc650164750 con 0x7fc6500a8130 2023-08-17T18:12:36.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc655d76700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc650157200 0x7fc6500c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc655d76700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc650157200 0x7fc6500c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34824/0 (socket says 172.21.15.78:34824) 2023-08-17T18:12:36.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc655d76700 1 -- 172.21.15.78:0/1622908389 learned_addr learned my addr 172.21.15.78:0/1622908389 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:36.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc656d78700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6501575e0 0x7fc6500c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc656577700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6500a8130 0x7fc6500a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc655d76700 1 -- 172.21.15.78:0/1622908389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6500a8130 msgr2=0x7fc6500a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc655d76700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6500a8130 0x7fc6500a9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc655d76700 1 -- 172.21.15.78:0/1622908389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6501575e0 msgr2=0x7fc6500c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc655d76700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6501575e0 0x7fc6500c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc655d76700 1 -- 172.21.15.78:0/1622908389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0092a0 con 0x7fc650157200 2023-08-17T18:12:36.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc655d76700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc650157200 0x7fc6500c7030 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7fc64c00ea50 tx=0x7fc64c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:36.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc6467fc700 1 -- 172.21.15.78:0/1622908389 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00c640 con 0x7fc650157200 2023-08-17T18:12:36.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc6467fc700 1 -- 172.21.15.78:0/1622908389 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c00c7a0 con 0x7fc650157200 2023-08-17T18:12:36.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc6467fc700 1 -- 172.21.15.78:0/1622908389 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00cb20 con 0x7fc650157200 2023-08-17T18:12:36.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc657579700 1 -- 172.21.15.78:0/1622908389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6400092a0 con 0x7fc650157200 2023-08-17T18:12:36.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.424+0000 7fc657579700 1 -- 172.21.15.78:0/1622908389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc650164960 con 0x7fc650157200 2023-08-17T18:12:36.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.425+0000 7fc657579700 1 -- 172.21.15.78:0/1622908389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc650069430 con 0x7fc650157200 2023-08-17T18:12:36.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.425+0000 7fc6467fc700 1 -- 172.21.15.78:0/1622908389 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc64c0123f0 con 0x7fc650157200 2023-08-17T18:12:36.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.426+0000 7fc6467fc700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc63405ede0 0x7fc6340612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.426+0000 7fc656577700 1 -- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc63405ede0 msgr2=0x7fc6340612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:36.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.426+0000 7fc6467fc700 1 -- 172.21.15.78:0/1622908389 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc64c079d40 con 0x7fc650157200 2023-08-17T18:12:36.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.426+0000 7fc656577700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc63405ede0 0x7fc6340612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:36.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.433+0000 7fc6467fc700 1 -- 172.21.15.78:0/1622908389 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc64c04b100 con 0x7fc650157200 2023-08-17T18:12:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.627+0000 7fc656577700 1 -- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc63405ede0 msgr2=0x7fc6340612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.627+0000 7fc656577700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc63405ede0 0x7fc6340612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:36.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.656+0000 7fc657579700 1 -- 172.21.15.78:0/1622908389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc650046af0 con 0x7fc650157200 2023-08-17T18:12:36.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.657+0000 7fc6467fc700 1 -- 172.21.15.78:0/1622908389 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fc64c04e720 con 0x7fc650157200 2023-08-17T18:12:36.658 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:36.658 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":67,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1111956777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1111956777},{"type":"v1","addr":"172.21.15.78:6837","nonce":1111956777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1739806080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1739806080},{"type":"v1","addr":"172.21.15.150:6834","nonce":1739806080}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":9528,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/168802869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":168802869},{"type":"v1","addr":"172.21.15.78:6836","nonce":168802869}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:12:19.124866+0000","modified":"2023-08-17T18:12:21.130921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9537":{"gid":9537,"name":"d","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2525491694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2525491694},{"type":"v1","addr":"172.21.15.150:6835","nonce":2525491694}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T18:12:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 -- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc63405ede0 msgr2=0x7fc6340612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc63405ede0 0x7fc6340612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 -- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc650157200 msgr2=0x7fc6500c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc650157200 0x7fc6500c7030 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7fc64c00ea50 tx=0x7fc64c009060).stop 2023-08-17T18:12:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 -- 172.21.15.78:0/1622908389 shutdown_connections 2023-08-17T18:12:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc63405ede0 0x7fc6340612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6501575e0 0x7fc6500c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6500a8130 0x7fc6500a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 --2- 172.21.15.78:0/1622908389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc650157200 0x7fc6500c7030 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 -- 172.21.15.78:0/1622908389 >> 172.21.15.78:0/1622908389 conn(0x7fc6500624f0 msgr2=0x7fc6500c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 -- 172.21.15.78:0/1622908389 shutdown_connections 2023-08-17T18:12:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.659+0000 7fc657579700 1 -- 172.21.15.78:0/1622908389 wait complete. 2023-08-17T18:12:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 67 2023-08-17T18:12:36.672 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:12:36.721 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:36.720+0000 7f7fc5259680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:12:36.790 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:36.789+0000 7f7fc5259680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:12:36.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.791+0000 7f3c8954c700 1 Processor -- start 2023-08-17T18:12:36.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.792+0000 7f3c8954c700 1 -- start start 2023-08-17T18:12:36.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.792+0000 7f3c8954c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3c84151e40 0x7f3c84152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.792+0000 7f3c8954c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840a7c90 0x7f3c840c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.792+0000 7f3c8954c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c840bf210 con 0x7f3c840be4d0 2023-08-17T18:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.792+0000 7f3c8954c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c840c5a80 con 0x7f3c84151e40 2023-08-17T18:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.792+0000 7f3c8954c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c840c5450 con 0x7f3c840a7c90 2023-08-17T18:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c837fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3c840be4d0 0x7f3c840c3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54858/0 (socket says 172.21.15.78:54858) 2023-08-17T18:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c837fe700 1 -- 172.21.15.78:0/707073361 learned_addr learned my addr 172.21.15.78:0/707073361 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c82ffd700 1 --2- 172.21.15.78:0/707073361 >> v2:172.21.15.150:3300/0 conn(0x7f3c84151e40 0x7f3c84152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c827fc700 1 --2- 172.21.15.78:0/707073361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840a7c90 0x7f3c840c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c81ffb700 1 -- 172.21.15.78:0/707073361 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547639872 0 0) 0x7f3c840bf210 con 0x7f3c840be4d0 2023-08-17T18:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c81ffb700 1 -- 172.21.15.78:0/707073361 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c6c0033f0 con 0x7f3c840be4d0 2023-08-17T18:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c827fc700 1 -- 172.21.15.78:0/707073361 >> v2:172.21.15.150:3300/0 conn(0x7f3c84151e40 msgr2=0x7f3c84152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c827fc700 1 --2- 172.21.15.78:0/707073361 >> v2:172.21.15.150:3300/0 conn(0x7f3c84151e40 0x7f3c84152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c827fc700 1 -- 172.21.15.78:0/707073361 >> v1:172.21.15.78:6789/0 conn(0x7f3c840be4d0 legacy=0x7f3c840c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c81ffb700 1 -- 172.21.15.78:0/707073361 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710039738 0 0) 0x7f3c6c0033f0 con 0x7f3c840be4d0 2023-08-17T18:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c827fc700 1 -- 172.21.15.78:0/707073361 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c841533f0 con 0x7f3c840a7c90 2023-08-17T18:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c82ffd700 1 --2- 172.21.15.78:0/707073361 >> v2:172.21.15.150:3300/0 conn(0x7f3c84151e40 0x7f3c84152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c827fc700 1 --2- 172.21.15.78:0/707073361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840a7c90 0x7f3c840c5f10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f3c74009760 tx=0x7f3c74009060).ready entity=mon.2 client_cookie=cab6833b7decc21f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:36.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c81ffb700 1 -- 172.21.15.78:0/707073361 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400d4a0 con 0x7f3c840a7c90 2023-08-17T18:12:36.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c81ffb700 1 -- 172.21.15.78:0/707073361 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7400d600 con 0x7f3c840a7c90 2023-08-17T18:12:36.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.793+0000 7f3c81ffb700 1 -- 172.21.15.78:0/707073361 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400d980 con 0x7f3c840a7c90 2023-08-17T18:12:36.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.794+0000 7f3c8954c700 1 -- 172.21.15.78:0/707073361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840a7c90 msgr2=0x7f3c840c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.794+0000 7f3c8954c700 1 --2- 172.21.15.78:0/707073361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840a7c90 0x7f3c840c5f10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f3c74009760 tx=0x7f3c74009060).stop 2023-08-17T18:12:36.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.794+0000 7f3c8954c700 1 -- 172.21.15.78:0/707073361 shutdown_connections 2023-08-17T18:12:36.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.794+0000 7f3c8954c700 1 --2- 172.21.15.78:0/707073361 >> v2:172.21.15.150:3300/0 conn(0x7f3c84151e40 0x7f3c84152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.794+0000 7f3c8954c700 1 --2- 172.21.15.78:0/707073361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840a7c90 0x7f3c840c5f10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.794+0000 7f3c8954c700 1 -- 172.21.15.78:0/707073361 >> 172.21.15.78:0/707073361 conn(0x7f3c84092330 msgr2=0x7f3c84062cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:36.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.794+0000 7f3c8954c700 1 -- 172.21.15.78:0/707073361 shutdown_connections 2023-08-17T18:12:36.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.794+0000 7f3c8954c700 1 -- 172.21.15.78:0/707073361 wait complete. 2023-08-17T18:12:36.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.795+0000 7f3c8954c700 1 Processor -- start 2023-08-17T18:12:36.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.795+0000 7f3c8954c700 1 -- start start 2023-08-17T18:12:36.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c8954c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c840a7c90 0x7f3c840c0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c8954c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840be4d0 0x7f3c84161b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c8954c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c84151e40 0x7f3c840c2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c8954c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c840a9a90 con 0x7f3c840a7c90 2023-08-17T18:12:36.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c8954c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c84162cc0 con 0x7f3c84151e40 2023-08-17T18:12:36.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c8954c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c84162470 con 0x7f3c840be4d0 2023-08-17T18:12:36.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c82ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c840a7c90 0x7f3c840c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c82ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c840a7c90 0x7f3c840c0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34826/0 (socket says 172.21.15.78:34826) 2023-08-17T18:12:36.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c82ffd700 1 -- 172.21.15.78:0/473086587 learned_addr learned my addr 172.21.15.78:0/473086587 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:36.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c827fc700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840be4d0 0x7f3c84161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.796+0000 7f3c837fe700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c84151e40 0x7f3c840c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:36.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c82ffd700 1 -- 172.21.15.78:0/473086587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840be4d0 msgr2=0x7f3c84161b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c82ffd700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840be4d0 0x7f3c84161b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c82ffd700 1 -- 172.21.15.78:0/473086587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c84151e40 msgr2=0x7f3c840c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:36.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c82ffd700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c84151e40 0x7f3c840c2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c82ffd700 1 -- 172.21.15.78:0/473086587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780092a0 con 0x7f3c840a7c90 2023-08-17T18:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c82ffd700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c840a7c90 0x7f3c840c0800 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f3c7800ea20 tx=0x7f3c78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c6affd700 1 -- 172.21.15.78:0/473086587 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800ee60 con 0x7f3c840a7c90 2023-08-17T18:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c6affd700 1 -- 172.21.15.78:0/473086587 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78009600 con 0x7f3c840a7c90 2023-08-17T18:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c6affd700 1 -- 172.21.15.78:0/473086587 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800ca60 con 0x7f3c840a7c90 2023-08-17T18:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c8954c700 1 -- 172.21.15.78:0/473086587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c740092a0 con 0x7f3c840a7c90 2023-08-17T18:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.797+0000 7f3c8954c700 1 -- 172.21.15.78:0/473086587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c84162a30 con 0x7f3c840a7c90 2023-08-17T18:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.798+0000 7f3c8954c700 1 -- 172.21.15.78:0/473086587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c84047350 con 0x7f3c840a7c90 2023-08-17T18:12:36.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.799+0000 7f3c6affd700 1 -- 172.21.15.78:0/473086587 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f3c78022070 con 0x7f3c840a7c90 2023-08-17T18:12:36.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.799+0000 7f3c6affd700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3c7005ede0 0x7f3c700612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.799+0000 7f3c827fc700 1 -- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3c7005ede0 msgr2=0x7f3c700612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.799+0000 7f3c6affd700 1 -- 172.21.15.78:0/473086587 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f3c7807a060 con 0x7f3c840a7c90 2023-08-17T18:12:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.799+0000 7f3c827fc700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3c7005ede0 0x7f3c700612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:36.803+0000 7f3c6affd700 1 -- 172.21.15.78:0/473086587 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c7804b480 con 0x7f3c840a7c90 2023-08-17T18:12:36.864 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:36.863+0000 7fc7777d9680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-17T18:12:36.867 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:36.866+0000 7f7fc5259680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:12:36.936 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:36.935+0000 7fc7777d9680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T18:12:37.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.000+0000 7f3c827fc700 1 -- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3c7005ede0 msgr2=0x7f3c700612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:37.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.000+0000 7f3c827fc700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3c7005ede0 0x7f3c700612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:37.013 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.013+0000 7fc7777d9680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T18:12:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.013+0000 7f3c8954c700 1 -- 172.21.15.78:0/473086587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c840a8190 con 0x7f3c840a7c90 2023-08-17T18:12:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.014+0000 7f3c6affd700 1 -- 172.21.15.78:0/473086587 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f3c78016020 con 0x7f3c840a7c90 2023-08-17T18:12:37.015 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:37.015 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":67,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1111956777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1111956777},{"type":"v1","addr":"172.21.15.78:6837","nonce":1111956777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1739806080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1739806080},{"type":"v1","addr":"172.21.15.150:6834","nonce":1739806080}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":9528,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/168802869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":168802869},{"type":"v1","addr":"172.21.15.78:6836","nonce":168802869}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T18:12:19.124866+0000","modified":"2023-08-17T18:12:21.130921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9537":{"gid":9537,"name":"d","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2525491694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2525491694},{"type":"v1","addr":"172.21.15.150:6835","nonce":2525491694}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T18:12:37.016 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:37.015+0000 7f7fc5259680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:12:37.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 -- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3c7005ede0 msgr2=0x7f3c700612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:37.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3c7005ede0 0x7f3c700612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:37.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 -- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c840a7c90 msgr2=0x7f3c840c0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:37.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c840a7c90 0x7f3c840c0800 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f3c7800ea20 tx=0x7f3c78009060).stop 2023-08-17T18:12:37.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 -- 172.21.15.78:0/473086587 shutdown_connections 2023-08-17T18:12:37.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3c7005ede0 0x7f3c700612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:37.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c84151e40 0x7f3c840c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c840a7c90 0x7f3c840c0800 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 --2- 172.21.15.78:0/473086587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c840be4d0 0x7f3c84161b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 -- 172.21.15.78:0/473086587 >> 172.21.15.78:0/473086587 conn(0x7f3c84092330 msgr2=0x7f3c84153610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:37.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 -- 172.21.15.78:0/473086587 shutdown_connections 2023-08-17T18:12:37.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.016+0000 7f3c8954c700 1 -- 172.21.15.78:0/473086587 wait complete. 2023-08-17T18:12:37.019 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 67 2023-08-17T18:12:37.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:37.087 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:37.086+0000 7f7fc5259680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:12:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.145+0000 7f42dac68700 1 Processor -- start 2023-08-17T18:12:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.145+0000 7f42dac68700 1 -- start start 2023-08-17T18:12:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.146+0000 7f42dac68700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4066660 0x7f42d40c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.146+0000 7f42dac68700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f42d4066a40 0x7f42d4151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.146+0000 7f42dac68700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d40c6040 con 0x7f42d40c5b50 2023-08-17T18:12:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.146+0000 7f42dac68700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d4069b00 con 0x7f42d4066a40 2023-08-17T18:12:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.146+0000 7f42dac68700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4069f90 con 0x7f42d4066660 2023-08-17T18:12:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.146+0000 7f42d9205700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f42d4066a40 0x7f42d4151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.146+0000 7f42d9205700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f42d4066a40 0x7f42d4151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34828/0 (socket says 172.21.15.78:34828) 2023-08-17T18:12:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.146+0000 7f42d9205700 1 -- 172.21.15.78:0/865955618 learned_addr learned my addr 172.21.15.78:0/865955618 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.146+0000 7f42d8a04700 1 --2- 172.21.15.78:0/865955618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4066660 0x7f42d40c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.147+0000 7f42d37fe700 1 -- 172.21.15.78:0/865955618 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534035678 0 0) 0x7f42c0001110 con 0x7f42d40c5b50 2023-08-17T18:12:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.147+0000 7f42d37fe700 1 -- 172.21.15.78:0/865955618 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c40033f0 con 0x7f42d40c5b50 2023-08-17T18:12:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.147+0000 7f42d9205700 1 -- 172.21.15.78:0/865955618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4066660 msgr2=0x7f42d40c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.147+0000 7f42d9205700 1 --2- 172.21.15.78:0/865955618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4066660 0x7f42d40c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.147+0000 7f42d9205700 1 -- 172.21.15.78:0/865955618 >> v1:172.21.15.150:6789/0 conn(0x7f42d40c5b50 legacy=0x7f42d40624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.147+0000 7f42d9205700 1 -- 172.21.15.78:0/865955618 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40691d0 con 0x7f42d4066a40 2023-08-17T18:12:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.147+0000 7f42d9205700 1 --2- 172.21.15.78:0/865955618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066a40 0x7f42d4151570 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f42cc009f20 tx=0x7f42cc009840).ready entity=mon.0 client_cookie=6f226e253e527fef server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.147+0000 7f42d37fe700 1 -- 172.21.15.78:0/865955618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00e070 con 0x7f42d4066a40 2023-08-17T18:12:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.147+0000 7f42d37fe700 1 -- 172.21.15.78:0/865955618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc00b970 con 0x7f42d4066a40 2023-08-17T18:12:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.147+0000 7f42d37fe700 1 -- 172.21.15.78:0/865955618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00bcf0 con 0x7f42d4066a40 2023-08-17T18:12:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.148+0000 7f42dac68700 1 -- 172.21.15.78:0/865955618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066a40 msgr2=0x7f42d4151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.148+0000 7f42dac68700 1 --2- 172.21.15.78:0/865955618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066a40 0x7f42d4151570 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f42cc009f20 tx=0x7f42cc009840).stop 2023-08-17T18:12:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.148+0000 7f42dac68700 1 -- 172.21.15.78:0/865955618 shutdown_connections 2023-08-17T18:12:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.148+0000 7f42dac68700 1 --2- 172.21.15.78:0/865955618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066a40 0x7f42d4151570 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.148+0000 7f42dac68700 1 --2- 172.21.15.78:0/865955618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4066660 0x7f42d40c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.148+0000 7f42dac68700 1 -- 172.21.15.78:0/865955618 >> 172.21.15.78:0/865955618 conn(0x7f42d40c7b00 msgr2=0x7f42d40c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.148+0000 7f42dac68700 1 -- 172.21.15.78:0/865955618 shutdown_connections 2023-08-17T18:12:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.148+0000 7f42dac68700 1 -- 172.21.15.78:0/865955618 wait complete. 2023-08-17T18:12:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.149+0000 7f42dac68700 1 Processor -- start 2023-08-17T18:12:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.149+0000 7f42dac68700 1 -- start start 2023-08-17T18:12:37.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42dac68700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066660 0x7f42d40a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42dac68700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4066a40 0x7f42d40aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42dac68700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40c5b50 0x7f42d41487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42dac68700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40abf10 con 0x7f42d4066660 2023-08-17T18:12:37.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42dac68700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40ab300 con 0x7f42d40c5b50 2023-08-17T18:12:37.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42dac68700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40ab5e0 con 0x7f42d4066a40 2023-08-17T18:12:37.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d8a04700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066660 0x7f42d40a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:37.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d8a04700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066660 0x7f42d40a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34832/0 (socket says 172.21.15.78:34832) 2023-08-17T18:12:37.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d8a04700 1 -- 172.21.15.78:0/2506144792 learned_addr learned my addr 172.21.15.78:0/2506144792 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d3fff700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4066a40 0x7f42d40aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d9205700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40c5b50 0x7f42d41487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d8a04700 1 -- 172.21.15.78:0/2506144792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4066a40 msgr2=0x7f42d40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d8a04700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4066a40 0x7f42d40aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d8a04700 1 -- 172.21.15.78:0/2506144792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40c5b50 msgr2=0x7f42d41487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d8a04700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40c5b50 0x7f42d41487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d8a04700 1 -- 172.21.15.78:0/2506144792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009ae0 con 0x7f42d4066660 2023-08-17T18:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d8a04700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066660 0x7f42d40a98d0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f42c800e950 tx=0x7f42c8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d0ff9700 1 -- 172.21.15.78:0/2506144792 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8012600 con 0x7f42d4066660 2023-08-17T18:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d0ff9700 1 -- 172.21.15.78:0/2506144792 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8012760 con 0x7f42d4066660 2023-08-17T18:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42dac68700 1 -- 172.21.15.78:0/2506144792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d40ab8c0 con 0x7f42d4066660 2023-08-17T18:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.150+0000 7f42d0ff9700 1 -- 172.21.15.78:0/2506144792 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8012ae0 con 0x7f42d4066660 2023-08-17T18:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.151+0000 7f42dac68700 1 -- 172.21.15.78:0/2506144792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d40aafa0 con 0x7f42d4066660 2023-08-17T18:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.151+0000 7f42dac68700 1 -- 172.21.15.78:0/2506144792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d4047350 con 0x7f42d4066660 2023-08-17T18:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.152+0000 7f42d0ff9700 1 -- 172.21.15.78:0/2506144792 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f42c8022070 con 0x7f42d4066660 2023-08-17T18:12:37.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.152+0000 7f42d0ff9700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f42b805ede0 0x7f42b80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.152+0000 7f42d3fff700 1 -- 172.21.15.78:0/2506144792 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f42b805ede0 msgr2=0x7f42b80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:37.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.152+0000 7f42d0ff9700 1 -- 172.21.15.78:0/2506144792 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f42c807a090 con 0x7f42d4066660 2023-08-17T18:12:37.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.152+0000 7f42d3fff700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f42b805ede0 0x7f42b80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:37.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.156+0000 7f42d0ff9700 1 -- 172.21.15.78:0/2506144792 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42c804b4b0 con 0x7f42d4066660 2023-08-17T18:12:37.173 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.172+0000 7fc7777d9680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T18:12:37.204 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:37.203+0000 7f7fc5259680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:12:37.247 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.247+0000 7fc7777d9680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T18:12:37.312 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:37.311+0000 7f7fc5259680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:37.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.328+0000 7f42dac68700 1 -- 172.21.15.78:0/2506144792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42d40694b0 con 0x7f42d4066660 2023-08-17T18:12:37.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.329+0000 7f42d0ff9700 1 -- 172.21.15.78:0/2506144792 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+17235 (secure 0 0 0) 0x7f42c8016090 con 0x7f42d4066660 2023-08-17T18:12:37.330 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:37.330 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":186,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:30.406194+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T18:12:17.650042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T18:12:18.089352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6833/158925":"2023-08-18T18:12:30.406163+0000","172.21.15.78:6832/158925":"2023-08-18T18:12:30.406163+0000","172.21.15.78:0/831867818":"2023-08-18T18:12:30.406163+0000","172.21.15.78:0/2706117257":"2023-08-18T18:12:30.406163+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:37.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 -- 172.21.15.78:0/2506144792 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f42b805ede0 msgr2=0x7f42b80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:37.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f42b805ede0 0x7f42b80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:37.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 -- 172.21.15.78:0/2506144792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066660 msgr2=0x7f42d40a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066660 0x7f42d40a98d0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f42c800e950 tx=0x7f42c8009060).stop 2023-08-17T18:12:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 -- 172.21.15.78:0/2506144792 shutdown_connections 2023-08-17T18:12:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f42b805ede0 0x7f42b80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40c5b50 0x7f42d41487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d4066660 0x7f42d40a98d0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 --2- 172.21.15.78:0/2506144792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4066a40 0x7f42d40aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 -- 172.21.15.78:0/2506144792 >> 172.21.15.78:0/2506144792 conn(0x7f42d40c7b00 msgr2=0x7f42d4153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:37.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 -- 172.21.15.78:0/2506144792 shutdown_connections 2023-08-17T18:12:37.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.331+0000 7f42dac68700 1 -- 172.21.15.78:0/2506144792 wait complete. 2023-08-17T18:12:37.345 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T18:12:37.369 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.368+0000 7fc7777d9680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T18:12:37.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.461+0000 7fac962b5700 1 Processor -- start 2023-08-17T18:12:37.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.461+0000 7fac962b5700 1 -- start start 2023-08-17T18:12:37.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac962b5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fac901555d0 0x7fac900a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac962b5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac90062c00 0x7fac900695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac962b5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac90065890 con 0x7fac90069150 2023-08-17T18:12:37.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac962b5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac900c3b90 con 0x7fac90062c00 2023-08-17T18:12:37.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac962b5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac900a7cb0 con 0x7fac901555d0 2023-08-17T18:12:37.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac94852700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac90062c00 0x7fac900695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:37.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac8f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fac90069150 0x7fac900624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54872/0 (socket says 172.21.15.78:54872) 2023-08-17T18:12:37.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac8f7fe700 1 -- 172.21.15.78:0/461991402 learned_addr learned my addr 172.21.15.78:0/461991402 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:37.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac94852700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac90062c00 0x7fac900695e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34846/0 (socket says 172.21.15.78:34846) 2023-08-17T18:12:37.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac8ffff700 1 --2- 172.21.15.78:0/461991402 >> v2:172.21.15.150:3300/0 conn(0x7fac901555d0 0x7fac900a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:37.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac94852700 1 -- 172.21.15.78:0/461991402 >> v2:172.21.15.150:3300/0 conn(0x7fac901555d0 msgr2=0x7fac900a77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:37.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac94852700 1 --2- 172.21.15.78:0/461991402 >> v2:172.21.15.150:3300/0 conn(0x7fac901555d0 0x7fac900a77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac94852700 1 -- 172.21.15.78:0/461991402 >> v1:172.21.15.78:6789/0 conn(0x7fac90069150 legacy=0x7fac900624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:37.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac8effd700 1 -- 172.21.15.78:0/461991402 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766756084 0 0) 0x7fac90065890 con 0x7fac90069150 2023-08-17T18:12:37.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac94852700 1 -- 172.21.15.78:0/461991402 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac900c5230 con 0x7fac90062c00 2023-08-17T18:12:37.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac94852700 1 --2- 172.21.15.78:0/461991402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90062c00 0x7fac900695e0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7fac9005f890 tx=0x7fac88009780).ready entity=mon.0 client_cookie=b86fe80894183655 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:37.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac8effd700 1 -- 172.21.15.78:0/461991402 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8800e070 con 0x7fac90062c00 2023-08-17T18:12:37.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac8effd700 1 -- 172.21.15.78:0/461991402 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8800bc30 con 0x7fac90062c00 2023-08-17T18:12:37.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.462+0000 7fac8effd700 1 -- 172.21.15.78:0/461991402 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88012410 con 0x7fac90062c00 2023-08-17T18:12:37.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.463+0000 7fac962b5700 1 -- 172.21.15.78:0/461991402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90062c00 msgr2=0x7fac900695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:37.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.463+0000 7fac962b5700 1 --2- 172.21.15.78:0/461991402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90062c00 0x7fac900695e0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7fac9005f890 tx=0x7fac88009780).stop 2023-08-17T18:12:37.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.463+0000 7fac962b5700 1 -- 172.21.15.78:0/461991402 shutdown_connections 2023-08-17T18:12:37.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.463+0000 7fac962b5700 1 --2- 172.21.15.78:0/461991402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90062c00 0x7fac900695e0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.463+0000 7fac962b5700 1 --2- 172.21.15.78:0/461991402 >> v2:172.21.15.150:3300/0 conn(0x7fac901555d0 0x7fac900a77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.463+0000 7fac962b5700 1 -- 172.21.15.78:0/461991402 >> 172.21.15.78:0/461991402 conn(0x7fac900c8680 msgr2=0x7fac900c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:37.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.463+0000 7fac962b5700 1 -- 172.21.15.78:0/461991402 shutdown_connections 2023-08-17T18:12:37.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.463+0000 7fac962b5700 1 -- 172.21.15.78:0/461991402 wait complete. 2023-08-17T18:12:37.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.464+0000 7fac962b5700 1 Processor -- start 2023-08-17T18:12:37.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.464+0000 7fac962b5700 1 -- start start 2023-08-17T18:12:37.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac962b5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac90062c00 0x7fac90151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac962b5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90069150 0x7fac900a7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac962b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac901555d0 0x7fac9013a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac962b5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac90152f60 con 0x7fac90069150 2023-08-17T18:12:37.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac962b5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac901523e0 con 0x7fac90062c00 2023-08-17T18:12:37.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac962b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac901526c0 con 0x7fac901555d0 2023-08-17T18:12:37.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac8f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90069150 0x7fac900a7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:37.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac8f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90069150 0x7fac900a7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34856/0 (socket says 172.21.15.78:34856) 2023-08-17T18:12:37.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac8f7fe700 1 -- 172.21.15.78:0/1058652729 learned_addr learned my addr 172.21.15.78:0/1058652729 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:37.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac8ffff700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac90062c00 0x7fac90151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:37.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac94852700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac901555d0 0x7fac9013a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac8f7fe700 1 -- 172.21.15.78:0/1058652729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac901555d0 msgr2=0x7fac9013a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac8f7fe700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac901555d0 0x7fac9013a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac8f7fe700 1 -- 172.21.15.78:0/1058652729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac90062c00 msgr2=0x7fac90151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac8f7fe700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac90062c00 0x7fac90151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.465+0000 7fac8f7fe700 1 -- 172.21.15.78:0/1058652729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac88009a20 con 0x7fac90069150 2023-08-17T18:12:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.466+0000 7fac8f7fe700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90069150 0x7fac900a7210 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7fac8400c4e0 tx=0x7fac84007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.466+0000 7fac77fff700 1 -- 172.21.15.78:0/1058652729 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8400ce90 con 0x7fac90069150 2023-08-17T18:12:37.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.466+0000 7fac77fff700 1 -- 172.21.15.78:0/1058652729 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac840072e0 con 0x7fac90069150 2023-08-17T18:12:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.466+0000 7fac962b5700 1 -- 172.21.15.78:0/1058652729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac901529a0 con 0x7fac90069150 2023-08-17T18:12:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.466+0000 7fac77fff700 1 -- 172.21.15.78:0/1058652729 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84007660 con 0x7fac90069150 2023-08-17T18:12:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.466+0000 7fac962b5700 1 -- 172.21.15.78:0/1058652729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac90151fd0 con 0x7fac90069150 2023-08-17T18:12:37.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.467+0000 7fac962b5700 1 -- 172.21.15.78:0/1058652729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac90047350 con 0x7fac90069150 2023-08-17T18:12:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.468+0000 7fac77fff700 1 -- 172.21.15.78:0/1058652729 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 93) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fac8401a060 con 0x7fac90069150 2023-08-17T18:12:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.468+0000 7fac77fff700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fac7c05ede0 0x7fac7c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.468+0000 7fac8ffff700 1 -- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fac7c05ede0 msgr2=0x7fac7c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.468+0000 7fac77fff700 1 -- 172.21.15.78:0/1058652729 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fac84079400 con 0x7fac90069150 2023-08-17T18:12:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.468+0000 7fac8ffff700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fac7c05ede0 0x7fac7c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T18:12:37.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.472+0000 7fac77fff700 1 -- 172.21.15.78:0/1058652729 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac8404a820 con 0x7fac90069150 2023-08-17T18:12:37.486 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.485+0000 7fc7777d9680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T18:12:37.605 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:37.604+0000 7f7fc5259680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:12:37.634 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:12:37.636 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:12:37.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.669+0000 7fac8ffff700 1 -- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fac7c05ede0 msgr2=0x7fac7c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6832/158925 2023-08-17T18:12:37.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.669+0000 7fac8ffff700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fac7c05ede0 0x7fac7c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T18:12:37.679 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-08-17T18:12:37.678+0000 7f7fc5259680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:12:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.683+0000 7fac962b5700 1 -- 172.21.15.78:0/1058652729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fac901518c0 con 0x7fac90069150 2023-08-17T18:12:37.782 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.782+0000 7fc7777d9680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T18:12:37.855 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.854+0000 7fc7777d9680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T18:12:37.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.879+0000 7fac77fff700 1 -- 172.21.15.78:0/1058652729 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 94) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fac84010070 con 0x7fac90069150 2023-08-17T18:12:37.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.879+0000 7fac77fff700 1 -- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fac7c05ede0 msgr2=0x7fac7c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T18:12:37.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:37.879+0000 7fac77fff700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fac7c05ede0 0x7fac7c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:37.881 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T18:12:37.880+0000 7f8bae9d0700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T18:12:37.882 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T18:12:37.880+0000 7f8bae9d0700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T18:12:37.882 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-08-17T18:12:37.880+0000 7f8bae9d0700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T18:12:37.885 INFO:tasks.ceph.mds.d.smithi150.stderr: -2230> 2023-08-17T18:12:25.037+0000 7f8bb21d7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T18:12:37.888 INFO:tasks.ceph.mds.d.smithi150.stderr: -4> 2023-08-17T18:12:37.880+0000 7f8bae9d0700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-08-17T18:12:37.888 INFO:tasks.ceph.mds.d.smithi150.stderr: -3> 2023-08-17T18:12:37.880+0000 7f8bae9d0700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T18:12:37.888 INFO:tasks.ceph.mds.d.smithi150.stderr: -1> 2023-08-17T18:12:37.880+0000 7f8bae9d0700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T18:12:37.906 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-08-17T18:12:37.938 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.937+0000 7fc6fa7c0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:37.938 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.937+0000 7fc6f77ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:37.938 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.937+0000 7fc6fa7c0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:37.938 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.937+0000 7fc6f77ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:37.939 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.937+0000 7fc6fa7c0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:37.939 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.937+0000 7fc6f77ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:37.939 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.937+0000 7fc6fa7c0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:37.939 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.937+0000 7fc6f77ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:37.939 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.937+0000 7fc6fa7c0700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:37.939 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-08-17T18:12:37.937+0000 7fc6f77ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-17T18:12:38.543 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-08-17T18:12:38.542+0000 7ff92c7a8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T18:12:38.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.547+0000 7fac77fff700 1 -- 172.21.15.78:0/1058652729 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) v1 ==== 161+0+0 (secure 0 0 0) 0x7fac84072840 con 0x7fac90069150 2023-08-17T18:12:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.549+0000 7fac962b5700 1 -- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90069150 msgr2=0x7fac900a7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.549+0000 7fac962b5700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90069150 0x7fac900a7210 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7fac8400c4e0 tx=0x7fac84007c70).stop 2023-08-17T18:12:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.549+0000 7fac962b5700 1 -- 172.21.15.78:0/1058652729 shutdown_connections 2023-08-17T18:12:38.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.549+0000 7fac962b5700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fac7c05ede0 0x7fac7c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:38.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.549+0000 7fac962b5700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac901555d0 0x7fac9013a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:38.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.549+0000 7fac962b5700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac90062c00 0x7fac90151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:38.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.549+0000 7fac962b5700 1 --2- 172.21.15.78:0/1058652729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac90069150 0x7fac900a7210 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:38.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.549+0000 7fac962b5700 1 -- 172.21.15.78:0/1058652729 >> 172.21.15.78:0/1058652729 conn(0x7fac900c8680 msgr2=0x7fac9013b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:38.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.549+0000 7fac962b5700 1 -- 172.21.15.78:0/1058652729 shutdown_connections 2023-08-17T18:12:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.549+0000 7fac962b5700 1 -- 172.21.15.78:0/1058652729 wait complete. 2023-08-17T18:12:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T18:12:38.563 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T18:12:38.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.678+0000 7fc003d19700 1 Processor -- start 2023-08-17T18:12:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.678+0000 7fc003d19700 1 -- start start 2023-08-17T18:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc003d19700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbffc0aa0f0 0x7fbffc0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc003d19700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbffc0aa4d0 0x7fbffc0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc003d19700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbffc0c5810 0x7fbffc0c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc003d19700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0649b0 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc003d19700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0c6140 con 0x7fbffc0aa0f0 2023-08-17T18:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc003d19700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc063420 con 0x7fbffc0c5810 2023-08-17T18:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc0012b4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbffc0aa4d0 0x7fbffc0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc0012b4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbffc0aa4d0 0x7fbffc0c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37780/0 (socket says 172.21.15.78:37780) 2023-08-17T18:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc0012b4700 1 -- 172.21.15.78:0/3793689324 learned_addr learned my addr 172.21.15.78:0/3793689324 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc0022b6700 1 --2- 172.21.15.78:0/3793689324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbffc0c5810 0x7fbffc0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc001ab5700 1 --2- 172.21.15.78:0/3793689324 >> v2:172.21.15.150:3300/0 conn(0x7fbffc0aa0f0 0x7fbffc0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc0012b4700 1 -- 172.21.15.78:0/3793689324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbffc0c5810 msgr2=0x7fbffc0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc0012b4700 1 --2- 172.21.15.78:0/3793689324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbffc0c5810 0x7fbffc0c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc0012b4700 1 -- 172.21.15.78:0/3793689324 >> v2:172.21.15.150:3300/0 conn(0x7fbffc0aa0f0 msgr2=0x7fbffc0644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc0012b4700 1 --2- 172.21.15.78:0/3793689324 >> v2:172.21.15.150:3300/0 conn(0x7fbffc0aa0f0 0x7fbffc0644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc0012b4700 1 -- 172.21.15.78:0/3793689324 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc063700 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc001ab5700 1 --2- 172.21.15.78:0/3793689324 >> v2:172.21.15.150:3300/0 conn(0x7fbffc0aa0f0 0x7fbffc0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc0012b4700 1 --2- 172.21.15.78:0/3793689324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 0x7fbffc0c0e10 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7fbffc0cade0 tx=0x7fbfec0090f0).ready entity=mon.0 client_cookie=cb1a72b13e591afc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc000ab3700 1 -- 172.21.15.78:0/3793689324 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00b520 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc000ab3700 1 -- 172.21.15.78:0/3793689324 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec00b680 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.679+0000 7fc000ab3700 1 -- 172.21.15.78:0/3793689324 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00ba00 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.680+0000 7fc003d19700 1 -- 172.21.15.78:0/3793689324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 msgr2=0x7fbffc0c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:38.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.680+0000 7fc003d19700 1 --2- 172.21.15.78:0/3793689324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 0x7fbffc0c0e10 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7fbffc0cade0 tx=0x7fbfec0090f0).stop 2023-08-17T18:12:38.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.680+0000 7fc003d19700 1 -- 172.21.15.78:0/3793689324 shutdown_connections 2023-08-17T18:12:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.680+0000 7fc003d19700 1 --2- 172.21.15.78:0/3793689324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbffc0c5810 0x7fbffc0c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.680+0000 7fc003d19700 1 --2- 172.21.15.78:0/3793689324 >> v2:172.21.15.150:3300/0 conn(0x7fbffc0aa0f0 0x7fbffc0644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.680+0000 7fc003d19700 1 --2- 172.21.15.78:0/3793689324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 0x7fbffc0c0e10 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.680+0000 7fc003d19700 1 -- 172.21.15.78:0/3793689324 >> 172.21.15.78:0/3793689324 conn(0x7fbffc06a6a0 msgr2=0x7fbffc0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.680+0000 7fc003d19700 1 -- 172.21.15.78:0/3793689324 shutdown_connections 2023-08-17T18:12:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.680+0000 7fc003d19700 1 -- 172.21.15.78:0/3793689324 wait complete. 2023-08-17T18:12:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.681+0000 7fc003d19700 1 Processor -- start 2023-08-17T18:12:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.681+0000 7fc003d19700 1 -- start start 2023-08-17T18:12:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc003d19700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbffc0aa0f0 0x7fbffc1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc003d19700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 0x7fbffc158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc003d19700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbffc0c5810 0x7fbffc153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc003d19700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc168740 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc003d19700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc167b30 con 0x7fbffc0c5810 2023-08-17T18:12:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc003d19700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc167e10 con 0x7fbffc0aa0f0 2023-08-17T18:12:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc0012b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 0x7fbffc158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc0012b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 0x7fbffc158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37788/0 (socket says 172.21.15.78:37788) 2023-08-17T18:12:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc0012b4700 1 -- 172.21.15.78:0/3607000609 learned_addr learned my addr 172.21.15.78:0/3607000609 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc001ab5700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbffc0aa0f0 0x7fbffc1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc0022b6700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbffc0c5810 0x7fbffc153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc0012b4700 1 -- 172.21.15.78:0/3607000609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbffc0aa0f0 msgr2=0x7fbffc1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc0012b4700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbffc0aa0f0 0x7fbffc1516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc0012b4700 1 -- 172.21.15.78:0/3607000609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbffc0c5810 msgr2=0x7fbffc153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc0012b4700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbffc0c5810 0x7fbffc153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc0012b4700 1 -- 172.21.15.78:0/3607000609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec009370 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc0012b4700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 0x7fbffc158590 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7fbfec011000 tx=0x7fbfec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fbff1ffb700 1 -- 172.21.15.78:0/3607000609 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00be90 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fbff1ffb700 1 -- 172.21.15.78:0/3607000609 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec00b7f0 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.682+0000 7fc003d19700 1 -- 172.21.15.78:0/3607000609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc1680f0 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.683+0000 7fbff1ffb700 1 -- 172.21.15.78:0/3607000609 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec01c630 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.683+0000 7fc003d19700 1 -- 172.21.15.78:0/3607000609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc151be0 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.684+0000 7fc003d19700 1 -- 172.21.15.78:0/3607000609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc1688b0 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.684+0000 7fbff1ffb700 1 -- 172.21.15.78:0/3607000609 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 94) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fbfec022020 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.684+0000 7fbff1ffb700 1 -- 172.21.15.78:0/3607000609 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fbfec07b610 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.688+0000 7fbff1ffb700 1 -- 172.21.15.78:0/3607000609 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbfec04ca70 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.880+0000 7fbff1ffb700 1 -- 172.21.15.78:0/3607000609 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 95) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fbfec00f070 con 0x7fbffc0aa4d0 2023-08-17T18:12:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.881+0000 7fbff1ffb700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbfe00301b0 0x7fbfe0067760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.881+0000 7fc001ab5700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbfe00301b0 0x7fbfe0067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.883+0000 7fc001ab5700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbfe00301b0 0x7fbfe0067760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fbff8006d80 tx=0x7fbff8008040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:38.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:38.896+0000 7fc003d19700 1 -- 172.21.15.78:0/3607000609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbffc083980 con 0x7fbffc0aa4d0 2023-08-17T18:12:39.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.885+0000 7fbff1ffb700 1 -- 172.21.15.78:0/3607000609 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbfec0558a0 con 0x7fbffc0aa4d0 2023-08-17T18:12:39.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.887+0000 7fc003d19700 1 -- 172.21.15.78:0/3607000609 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbfe00301b0 msgr2=0x7fbfe0067760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.887+0000 7fc003d19700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbfe00301b0 0x7fbfe0067760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fbff8006d80 tx=0x7fbff8008040).stop 2023-08-17T18:12:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.887+0000 7fc003d19700 1 -- 172.21.15.78:0/3607000609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 msgr2=0x7fbffc158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.887+0000 7fc003d19700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 0x7fbffc158590 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7fbfec011000 tx=0x7fbfec017000).stop 2023-08-17T18:12:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.887+0000 7fc003d19700 1 -- 172.21.15.78:0/3607000609 shutdown_connections 2023-08-17T18:12:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.887+0000 7fc003d19700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fbfe00301b0 0x7fbfe0067760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:39.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.887+0000 7fc003d19700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbffc0c5810 0x7fbffc153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.887+0000 7fc003d19700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbffc0aa0f0 0x7fbffc1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.887+0000 7fc003d19700 1 --2- 172.21.15.78:0/3607000609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbffc0aa4d0 0x7fbffc158590 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.887+0000 7fc003d19700 1 -- 172.21.15.78:0/3607000609 >> 172.21.15.78:0/3607000609 conn(0x7fbffc06a6a0 msgr2=0x7fbffc153080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.888+0000 7fc003d19700 1 -- 172.21.15.78:0/3607000609 shutdown_connections 2023-08-17T18:12:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:39.888+0000 7fc003d19700 1 -- 172.21.15.78:0/3607000609 wait complete. 2023-08-17T18:12:39.902 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T18:12:40.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.021+0000 7f7503bb6700 1 Processor -- start 2023-08-17T18:12:40.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.021+0000 7f7503bb6700 1 -- start start 2023-08-17T18:12:40.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.022+0000 7f7503bb6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74fc0c5f20 0x7f74fc0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:40.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.022+0000 7f7503bb6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc0649b0 con 0x7f74fc0aa0f0 2023-08-17T18:12:40.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.022+0000 7f7503bb6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc063420 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.022+0000 7f7503bb6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc063700 con 0x7f74fc0c5f20 2023-08-17T18:12:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.022+0000 7f7502153700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74fc0c5f20 0x7f74fc0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.022+0000 7f7502153700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74fc0c5f20 0x7f74fc0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37792/0 (socket says 172.21.15.78:37792) 2023-08-17T18:12:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.022+0000 7f7502153700 1 -- 172.21.15.78:0/3122330076 learned_addr learned my addr 172.21.15.78:0/3122330076 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.022+0000 7f7502153700 1 -- 172.21.15.78:0/3122330076 >> v1:172.21.15.150:6789/0 conn(0x7f74fc0aa4d0 legacy=0x7f74fc0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.022+0000 7f7502153700 1 -- 172.21.15.78:0/3122330076 >> v1:172.21.15.78:6789/0 conn(0x7f74fc0aa0f0 legacy=0x7f74fc0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7502153700 1 -- 172.21.15.78:0/3122330076 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc0639e0 con 0x7f74fc0c5f20 2023-08-17T18:12:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7502153700 1 --2- 172.21.15.78:0/3122330076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0c5f20 0x7f74fc0644c0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7f74f4009f20 tx=0x7f74f4009840).ready entity=mon.0 client_cookie=b6db92f2b7ad9c00 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7500950700 1 -- 172.21.15.78:0/3122330076 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400e070 con 0x7f74fc0c5f20 2023-08-17T18:12:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7500950700 1 -- 172.21.15.78:0/3122330076 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f400ba80 con 0x7f74fc0c5f20 2023-08-17T18:12:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7500950700 1 -- 172.21.15.78:0/3122330076 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400be00 con 0x7f74fc0c5f20 2023-08-17T18:12:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7503bb6700 1 -- 172.21.15.78:0/3122330076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0c5f20 msgr2=0x7f74fc0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7503bb6700 1 --2- 172.21.15.78:0/3122330076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0c5f20 0x7f74fc0644c0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7f74f4009f20 tx=0x7f74f4009840).stop 2023-08-17T18:12:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7503bb6700 1 -- 172.21.15.78:0/3122330076 shutdown_connections 2023-08-17T18:12:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7503bb6700 1 --2- 172.21.15.78:0/3122330076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0c5f20 0x7f74fc0644c0 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:40.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7503bb6700 1 -- 172.21.15.78:0/3122330076 >> 172.21.15.78:0/3122330076 conn(0x7f74fc06a6a0 msgr2=0x7f74fc0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:40.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7503bb6700 1 -- 172.21.15.78:0/3122330076 shutdown_connections 2023-08-17T18:12:40.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.023+0000 7f7503bb6700 1 -- 172.21.15.78:0/3122330076 wait complete. 2023-08-17T18:12:40.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.024+0000 7f7503bb6700 1 Processor -- start 2023-08-17T18:12:40.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.024+0000 7f7503bb6700 1 -- start start 2023-08-17T18:12:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.025+0000 7f7503bb6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74fc0aa0f0 0x7f74fc0aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.025+0000 7f7503bb6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0aa4d0 0x7f74fc153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.025+0000 7f7503bb6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74fc0c5f20 0x7f74fc153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.025+0000 7f7503bb6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc154220 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.025+0000 7f7503bb6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc16cca0 con 0x7f74fc0aa0f0 2023-08-17T18:12:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.025+0000 7f7503bb6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0ad800 con 0x7f74fc0c5f20 2023-08-17T18:12:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.025+0000 7f7501151700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0aa4d0 0x7f74fc153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.025+0000 7f7501151700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0aa4d0 0x7f74fc153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37796/0 (socket says 172.21.15.78:37796) 2023-08-17T18:12:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.025+0000 7f7501151700 1 -- 172.21.15.78:0/603757851 learned_addr learned my addr 172.21.15.78:0/603757851 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f7501151700 1 -- 172.21.15.78:0/603757851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74fc0c5f20 msgr2=0x7f74fc153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f7502153700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74fc0c5f20 0x7f74fc153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f7501151700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74fc0c5f20 0x7f74fc153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f7501151700 1 -- 172.21.15.78:0/603757851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74fc0aa0f0 msgr2=0x7f74fc0aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f7501151700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74fc0aa0f0 0x7f74fc0aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f7501151700 1 -- 172.21.15.78:0/603757851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f4009ae0 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f7501151700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0aa4d0 0x7f74fc153840 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f74ec00c4c0 tx=0x7f74ec007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f74f1ffb700 1 -- 172.21.15.78:0/603757851 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec007020 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f74f1ffb700 1 -- 172.21.15.78:0/603757851 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec007180 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f7503bb6700 1 -- 172.21.15.78:0/603757851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc16d130 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f74f1ffb700 1 -- 172.21.15.78:0/603757851 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec007520 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.026+0000 7f7503bb6700 1 -- 172.21.15.78:0/603757851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc16c650 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.027+0000 7f7503bb6700 1 -- 172.21.15.78:0/603757851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc16cf80 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.027+0000 7f74f1ffb700 1 -- 172.21.15.78:0/603757851 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 95) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f74ec010070 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.028+0000 7f74f1ffb700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f74e005ecf0 0x7f74e00611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.028+0000 7f74f1ffb700 1 -- 172.21.15.78:0/603757851 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f74ec078f30 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.028+0000 7f7501952700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f74e005ecf0 0x7f74e00611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.028+0000 7f7501952700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f74e005ecf0 0x7f74e00611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f74f8001510 tx=0x7f74f80079c0).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.032+0000 7f74f1ffb700 1 -- 172.21.15.78:0/603757851 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f74ec0478f0 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.194+0000 7f7503bb6700 1 -- 172.21.15.78:0/603757851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f74fc046af0 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.886+0000 7f74f1ffb700 1 -- 172.21.15.78:0/603757851 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f74ec076cf0 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.899+0000 7f74f1ffb700 1 -- 172.21.15.78:0/603757851 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v189) v1 ==== 181+0+0 (secure 0 0 0) 0x7f74ec074060 con 0x7f74fc0aa4d0 2023-08-17T18:12:40.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 -- 172.21.15.78:0/603757851 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f74e005ecf0 msgr2=0x7f74e00611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:40.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f74e005ecf0 0x7f74e00611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f74f8001510 tx=0x7f74f80079c0).stop 2023-08-17T18:12:40.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 -- 172.21.15.78:0/603757851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0aa4d0 msgr2=0x7f74fc153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:40.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0aa4d0 0x7f74fc153840 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f74ec00c4c0 tx=0x7f74ec007dd0).stop 2023-08-17T18:12:40.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 -- 172.21.15.78:0/603757851 shutdown_connections 2023-08-17T18:12:40.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f74e005ecf0 0x7f74e00611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:40.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74fc0c5f20 0x7f74fc153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:40.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74fc0aa0f0 0x7f74fc0aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:40.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 --2- 172.21.15.78:0/603757851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74fc0aa4d0 0x7f74fc153840 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:40.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 -- 172.21.15.78:0/603757851 >> 172.21.15.78:0/603757851 conn(0x7f74fc06a6a0 msgr2=0x7f74fc0a7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:40.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 -- 172.21.15.78:0/603757851 shutdown_connections 2023-08-17T18:12:40.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:40.902+0000 7f7503bb6700 1 -- 172.21.15.78:0/603757851 wait complete. 2023-08-17T18:12:40.906 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-08-17T18:12:40.917 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T18:12:41.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.042+0000 7fca4997c700 1 Processor -- start 2023-08-17T18:12:41.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.042+0000 7fca4997c700 1 -- start start 2023-08-17T18:12:41.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca4997c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44151a40 0x7fca440c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:41.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca4997c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440c6620 con 0x7fca44157be0 2023-08-17T18:12:41.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca4997c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440c6900 con 0x7fca44151e20 2023-08-17T18:12:41.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca4997c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440c6be0 con 0x7fca44151a40 2023-08-17T18:12:41.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca4917b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fca44157be0 0x7fca440c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37100/0 (socket says 172.21.15.78:37100) 2023-08-17T18:12:41.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca4917b700 1 -- 172.21.15.78:0/3534836645 learned_addr learned my addr 172.21.15.78:0/3534836645 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:41.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550459333 0 0) 0x7fca440c6620 con 0x7fca44157be0 2023-08-17T18:12:41.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca300033f0 con 0x7fca44157be0 2023-08-17T18:12:41.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca4897a700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44151a40 0x7fca440c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:41.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3695711238 0 0) 0x7fca300033f0 con 0x7fca44157be0 2023-08-17T18:12:41.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44151a40 msgr2=0x7fca440c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44151a40 0x7fca440c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 >> v1:172.21.15.150:6789/0 conn(0x7fca44151e20 legacy=0x7fca440c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440c6ec0 con 0x7fca44157be0 2023-08-17T18:12:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fca2c001470 con 0x7fca44157be0 2023-08-17T18:12:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 >> v1:172.21.15.78:6789/0 conn(0x7fca44157be0 legacy=0x7fca440c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca30003910 0x7fca30003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44151a40 0x7fca30004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca30004b80 0x7fca30005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440c6be0 con 0x7fca30004b80 2023-08-17T18:12:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3000b910 con 0x7fca30003910 2023-08-17T18:12:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.043+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3000bad0 con 0x7fca44151a40 2023-08-17T18:12:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca4917b700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca30004b80 0x7fca30005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca4897a700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca30003910 0x7fca30003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca43fff700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44151a40 0x7fca30004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca4917b700 1 -- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44151a40 msgr2=0x7fca30004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca4917b700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44151a40 0x7fca30004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca4917b700 1 -- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca30003910 msgr2=0x7fca30003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca4917b700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca30003910 0x7fca30003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca4917b700 1 -- 172.21.15.78:0/3534836645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300033f0 con 0x7fca30004b80 2023-08-17T18:12:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca4917b700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca30004b80 0x7fca30005000 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7fca2c00c190 tx=0x7fca2c001e50).ready entity=mon.0 client_cookie=214d06b80ab4bea5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c007a20 con 0x7fca30004b80 2023-08-17T18:12:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c00cac0 con 0x7fca30004b80 2023-08-17T18:12:41.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.044+0000 7fca437fe700 1 -- 172.21.15.78:0/3534836645 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c00ce40 con 0x7fca30004b80 2023-08-17T18:12:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.045+0000 7fca4997c700 1 -- 172.21.15.78:0/3534836645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca30004b80 msgr2=0x7fca30005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.045+0000 7fca4997c700 1 --2- 172.21.15.78:0/3534836645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca30004b80 0x7fca30005000 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7fca2c00c190 tx=0x7fca2c001e50).stop 2023-08-17T18:12:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.045+0000 7fca4917b700 1 -- 172.21.15.78:0/3534836645 reap_dead start 2023-08-17T18:12:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.045+0000 7fca4997c700 1 -- 172.21.15.78:0/3534836645 shutdown_connections 2023-08-17T18:12:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.045+0000 7fca4997c700 1 -- 172.21.15.78:0/3534836645 >> 172.21.15.78:0/3534836645 conn(0x7fca440943b0 msgr2=0x7fca4406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.045+0000 7fca4997c700 1 -- 172.21.15.78:0/3534836645 shutdown_connections 2023-08-17T18:12:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.045+0000 7fca4997c700 1 -- 172.21.15.78:0/3534836645 wait complete. 2023-08-17T18:12:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.046+0000 7fca4997c700 1 Processor -- start 2023-08-17T18:12:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.046+0000 7fca4997c700 1 -- start start 2023-08-17T18:12:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4997c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca441488b0 0x7fca440adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4997c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44148c90 0x7fca440c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4997c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44157690 0x7fca440c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:41.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4997c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440c2bc0 con 0x7fca44157690 2023-08-17T18:12:41.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4997c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca44155c30 con 0x7fca441488b0 2023-08-17T18:12:41.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4997c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440c2600 con 0x7fca44148c90 2023-08-17T18:12:41.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4917b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44157690 0x7fca440c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:41.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4917b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44157690 0x7fca440c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37808/0 (socket says 172.21.15.78:37808) 2023-08-17T18:12:41.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4917b700 1 -- 172.21.15.78:0/3785579959 learned_addr learned my addr 172.21.15.78:0/3785579959 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:41.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca43fff700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44148c90 0x7fca440c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4897a700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca441488b0 0x7fca440adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4917b700 1 -- 172.21.15.78:0/3785579959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44148c90 msgr2=0x7fca440c1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4917b700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44148c90 0x7fca440c1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4917b700 1 -- 172.21.15.78:0/3785579959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca441488b0 msgr2=0x7fca440adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4917b700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca441488b0 0x7fca440adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4917b700 1 -- 172.21.15.78:0/3785579959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440c28e0 con 0x7fca44157690 2023-08-17T18:12:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4917b700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44157690 0x7fca440c40f0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7fca2c00a000 tx=0x7fca2c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca40ff9700 1 -- 172.21.15.78:0/3785579959 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0072e0 con 0x7fca44157690 2023-08-17T18:12:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca40ff9700 1 -- 172.21.15.78:0/3785579959 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c007440 con 0x7fca44157690 2023-08-17T18:12:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca40ff9700 1 -- 172.21.15.78:0/3785579959 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c004770 con 0x7fca44157690 2023-08-17T18:12:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4997c700 1 -- 172.21.15.78:0/3785579959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca441558c0 con 0x7fca44157690 2023-08-17T18:12:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.047+0000 7fca4997c700 1 -- 172.21.15.78:0/3785579959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca440c45e0 con 0x7fca44157690 2023-08-17T18:12:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.048+0000 7fca4997c700 1 -- 172.21.15.78:0/3785579959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca44082f90 con 0x7fca44157690 2023-08-17T18:12:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.049+0000 7fca40ff9700 1 -- 172.21.15.78:0/3785579959 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fca2c010070 con 0x7fca44157690 2023-08-17T18:12:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.049+0000 7fca40ff9700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fca2405ed90 0x7fca24061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:41.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.049+0000 7fca40ff9700 1 -- 172.21.15.78:0/3785579959 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fca2c079e00 con 0x7fca44157690 2023-08-17T18:12:41.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.049+0000 7fca4897a700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fca2405ed90 0x7fca24061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:41.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.050+0000 7fca4897a700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fca2405ed90 0x7fca24061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fca3c0094d0 tx=0x7fca3c00b040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:41.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.053+0000 7fca40ff9700 1 -- 172.21.15.78:0/3785579959 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca2c04b380 con 0x7fca44157690 2023-08-17T18:12:41.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.215+0000 7fca4997c700 1 -- 172.21.15.78:0/3785579959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca4405f910 con 0x7fca44157690 2023-08-17T18:12:41.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.897+0000 7fca40ff9700 1 -- 172.21.15.78:0/3785579959 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v190) v1 ==== 169+0+0 (secure 0 0 0) 0x7fca2c023030 con 0x7fca44157690 2023-08-17T18:12:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 -- 172.21.15.78:0/3785579959 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fca2405ed90 msgr2=0x7fca24061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fca2405ed90 0x7fca24061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fca3c0094d0 tx=0x7fca3c00b040).stop 2023-08-17T18:12:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 -- 172.21.15.78:0/3785579959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44157690 msgr2=0x7fca440c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44157690 0x7fca440c40f0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7fca2c00a000 tx=0x7fca2c015000).stop 2023-08-17T18:12:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 -- 172.21.15.78:0/3785579959 shutdown_connections 2023-08-17T18:12:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fca2405ed90 0x7fca24061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:41.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44157690 0x7fca440c40f0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:41.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca441488b0 0x7fca440adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:41.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 --2- 172.21.15.78:0/3785579959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca44148c90 0x7fca440c1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:41.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 -- 172.21.15.78:0/3785579959 >> 172.21.15.78:0/3785579959 conn(0x7fca440943b0 msgr2=0x7fca440c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:41.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 -- 172.21.15.78:0/3785579959 shutdown_connections 2023-08-17T18:12:41.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:41.900+0000 7fca4997c700 1 -- 172.21.15.78:0/3785579959 wait complete. 2023-08-17T18:12:41.903 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-08-17T18:12:41.914 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T18:12:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.030+0000 7f83604ae700 1 Processor -- start 2023-08-17T18:12:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.030+0000 7f83604ae700 1 -- start start 2023-08-17T18:12:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.031+0000 7f83604ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83580aa4d0 0x7f83580644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.031+0000 7f83604ae700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83580649b0 con 0x7f83580c5810 2023-08-17T18:12:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.031+0000 7f83604ae700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8358063420 con 0x7f83580aa0f0 2023-08-17T18:12:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.031+0000 7f83604ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8358063700 con 0x7f83580aa4d0 2023-08-17T18:12:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.031+0000 7f835ea4b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f83580c5810 0x7f83580a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37114/0 (socket says 172.21.15.78:37114) 2023-08-17T18:12:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.031+0000 7f835ea4b700 1 -- 172.21.15.78:0/1045337450 learned_addr learned my addr 172.21.15.78:0/1045337450 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.031+0000 7f835da49700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83580aa4d0 0x7f83580644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.031+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417035734 0 0) 0x7f83580649b0 con 0x7f83580c5810 2023-08-17T18:12:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.031+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83440033f0 con 0x7f83580c5810 2023-08-17T18:12:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784658011 0 0) 0x7f8358063420 con 0x7f83580aa0f0 2023-08-17T18:12:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83580649b0 con 0x7f83580aa0f0 2023-08-17T18:12:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503777468 0 0) 0x7f83440033f0 con 0x7f83580c5810 2023-08-17T18:12:42.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83580aa4d0 msgr2=0x7f83580644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:42.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83580aa4d0 0x7f83580644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 >> v1:172.21.15.150:6789/0 conn(0x7f83580aa0f0 legacy=0x7f83580c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580639e0 con 0x7f83580c5810 2023-08-17T18:12:42.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f83500017f0 con 0x7f83580c5810 2023-08-17T18:12:42.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 >> v1:172.21.15.78:6789/0 conn(0x7f83580c5810 legacy=0x7f83580a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8344003aa0 0x7f8344003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83580aa4d0 0x7f8344004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8344004b80 0x7f8344005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8358063700 con 0x7f8344003aa0 2023-08-17T18:12:42.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834400b940 con 0x7f8344004b80 2023-08-17T18:12:42.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834400bb00 con 0x7f83580aa4d0 2023-08-17T18:12:42.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835e24a700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8344003aa0 0x7f8344003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835da49700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83580aa4d0 0x7f8344004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835ea4b700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8344004b80 0x7f8344005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835e24a700 1 -- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83580aa4d0 msgr2=0x7f8344004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:42.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835e24a700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83580aa4d0 0x7f8344004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835e24a700 1 -- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8344004b80 msgr2=0x7f8344005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:42.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835e24a700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8344004b80 0x7f8344005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835e24a700 1 -- 172.21.15.78:0/1045337450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83440033f0 con 0x7f8344003aa0 2023-08-17T18:12:42.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835e24a700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8344003aa0 0x7f8344003ea0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7f8354001890 tx=0x7f8354007bb0).ready entity=mon.0 client_cookie=3f32582587a9b11c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:42.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354007020 con 0x7f8344003aa0 2023-08-17T18:12:42.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8354007180 con 0x7f8344003aa0 2023-08-17T18:12:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.032+0000 7f835d248700 1 -- 172.21.15.78:0/1045337450 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354007500 con 0x7f8344003aa0 2023-08-17T18:12:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.033+0000 7f83604ae700 1 -- 172.21.15.78:0/1045337450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8344003aa0 msgr2=0x7f8344003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.033+0000 7f83604ae700 1 --2- 172.21.15.78:0/1045337450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8344003aa0 0x7f8344003ea0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7f8354001890 tx=0x7f8354007bb0).stop 2023-08-17T18:12:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.033+0000 7f835ea4b700 1 -- 172.21.15.78:0/1045337450 reap_dead start 2023-08-17T18:12:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.033+0000 7f83604ae700 1 -- 172.21.15.78:0/1045337450 shutdown_connections 2023-08-17T18:12:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.033+0000 7f83604ae700 1 -- 172.21.15.78:0/1045337450 >> 172.21.15.78:0/1045337450 conn(0x7f835806a6a0 msgr2=0x7f83580caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.033+0000 7f83604ae700 1 -- 172.21.15.78:0/1045337450 shutdown_connections 2023-08-17T18:12:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.033+0000 7f83604ae700 1 -- 172.21.15.78:0/1045337450 wait complete. 2023-08-17T18:12:42.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.034+0000 7f83604ae700 1 Processor -- start 2023-08-17T18:12:42.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.034+0000 7f83604ae700 1 -- start start 2023-08-17T18:12:42.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f83604ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8344003aa0 0x7f83580ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f83604ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83580ab4c0 0x7f8358158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f83604ae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83580ac4e0 0x7f83580c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f83604ae700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580ad5c0 con 0x7f83580ac4e0 2023-08-17T18:12:42.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f83604ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580ad2e0 con 0x7f83580ab4c0 2023-08-17T18:12:42.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f83604ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83580aa9e0 con 0x7f8344003aa0 2023-08-17T18:12:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835ea4b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83580ac4e0 0x7f83580c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835ea4b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83580ac4e0 0x7f83580c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37832/0 (socket says 172.21.15.78:37832) 2023-08-17T18:12:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835ea4b700 1 -- 172.21.15.78:0/1952785348 learned_addr learned my addr 172.21.15.78:0/1952785348 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835e24a700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8344003aa0 0x7f83580ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835da49700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83580ab4c0 0x7f8358158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835ea4b700 1 -- 172.21.15.78:0/1952785348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8344003aa0 msgr2=0x7f83580ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835ea4b700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8344003aa0 0x7f83580ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835ea4b700 1 -- 172.21.15.78:0/1952785348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83580ab4c0 msgr2=0x7f8358158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835ea4b700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83580ab4c0 0x7f8358158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835ea4b700 1 -- 172.21.15.78:0/1952785348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580aacc0 con 0x7f83580ac4e0 2023-08-17T18:12:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.035+0000 7f835ea4b700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83580ac4e0 0x7f83580c9740 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7f83580c5520 tx=0x7f8350007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.036+0000 7f834e7fc700 1 -- 172.21.15.78:0/1952785348 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350011590 con 0x7f83580ac4e0 2023-08-17T18:12:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.036+0000 7f834e7fc700 1 -- 172.21.15.78:0/1952785348 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83500116f0 con 0x7f83580ac4e0 2023-08-17T18:12:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.036+0000 7f83604ae700 1 -- 172.21.15.78:0/1952785348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83580aafa0 con 0x7f83580ac4e0 2023-08-17T18:12:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.036+0000 7f834e7fc700 1 -- 172.21.15.78:0/1952785348 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350011a70 con 0x7f83580ac4e0 2023-08-17T18:12:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.036+0000 7f83604ae700 1 -- 172.21.15.78:0/1952785348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83581586f0 con 0x7f83580ac4e0 2023-08-17T18:12:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.036+0000 7f83604ae700 1 -- 172.21.15.78:0/1952785348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8358158910 con 0x7f83580ac4e0 2023-08-17T18:12:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.037+0000 7f834e7fc700 1 -- 172.21.15.78:0/1952785348 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f835001b030 con 0x7f83580ac4e0 2023-08-17T18:12:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.037+0000 7f834e7fc700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f833c05ed90 0x7f833c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.037+0000 7f834e7fc700 1 -- 172.21.15.78:0/1952785348 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f8350079080 con 0x7f83580ac4e0 2023-08-17T18:12:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.037+0000 7f835e24a700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f833c05ed90 0x7f833c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.038+0000 7f835e24a700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f833c05ed90 0x7f833c061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8354001670 tx=0x7f8354016000).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:42.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.041+0000 7f834e7fc700 1 -- 172.21.15.78:0/1952785348 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f835004a850 con 0x7f83580ac4e0 2023-08-17T18:12:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.203+0000 7f83604ae700 1 -- 172.21.15.78:0/1952785348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f83580ab190 con 0x7f83580ac4e0 2023-08-17T18:12:42.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.206+0000 7f834e7fc700 1 -- 172.21.15.78:0/1952785348 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8350019030 con 0x7f83580ac4e0 2023-08-17T18:12:42.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 -- 172.21.15.78:0/1952785348 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f833c05ed90 msgr2=0x7f833c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f833c05ed90 0x7f833c061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8354001670 tx=0x7f8354016000).stop 2023-08-17T18:12:42.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 -- 172.21.15.78:0/1952785348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83580ac4e0 msgr2=0x7f83580c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83580ac4e0 0x7f83580c9740 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7f83580c5520 tx=0x7f8350007f20).stop 2023-08-17T18:12:42.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 -- 172.21.15.78:0/1952785348 shutdown_connections 2023-08-17T18:12:42.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f833c05ed90 0x7f833c061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83580ac4e0 0x7f83580c9740 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8344003aa0 0x7f83580ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 --2- 172.21.15.78:0/1952785348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83580ab4c0 0x7f8358158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 -- 172.21.15.78:0/1952785348 >> 172.21.15.78:0/1952785348 conn(0x7f835806a6a0 msgr2=0x7f8358151ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:42.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 -- 172.21.15.78:0/1952785348 shutdown_connections 2023-08-17T18:12:42.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.208+0000 7f83604ae700 1 -- 172.21.15.78:0/1952785348 wait complete. 2023-08-17T18:12:42.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-17T18:12:42.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.335+0000 7f2b8d475700 1 Processor -- start 2023-08-17T18:12:42.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.335+0000 7f2b8d475700 1 -- start start 2023-08-17T18:12:42.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8d475700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88151e20 0x7f2b880c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8d475700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b88157be0 0x7f2b88158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8d475700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b88158560 con 0x7f2b88151a40 2023-08-17T18:12:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8d475700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b880c6620 con 0x7f2b88157be0 2023-08-17T18:12:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8d475700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b880c6900 con 0x7f2b88151e20 2023-08-17T18:12:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8cc74700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b88157be0 0x7f2b88158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8cc74700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b88157be0 0x7f2b88158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37836/0 (socket says 172.21.15.78:37836) 2023-08-17T18:12:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8cc74700 1 -- 172.21.15.78:0/2349108043 learned_addr learned my addr 172.21.15.78:0/2349108043 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:42.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b877fe700 1 --2- 172.21.15.78:0/2349108043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88151e20 0x7f2b880c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8cc74700 1 -- 172.21.15.78:0/2349108043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88151e20 msgr2=0x7f2b880c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:42.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8cc74700 1 --2- 172.21.15.78:0/2349108043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88151e20 0x7f2b880c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8cc74700 1 -- 172.21.15.78:0/2349108043 >> v1:172.21.15.150:6789/0 conn(0x7f2b88151a40 legacy=0x7f2b880c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.336+0000 7f2b8cc74700 1 -- 172.21.15.78:0/2349108043 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b880c6be0 con 0x7f2b88157be0 2023-08-17T18:12:42.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b8cc74700 1 --2- 172.21.15.78:0/2349108043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88157be0 0x7f2b88158070 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7f2b80009f20 tx=0x7f2b80009840).ready entity=mon.0 client_cookie=540522aeea3cf05e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:42.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b86ffd700 1 -- 172.21.15.78:0/2349108043 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000e070 con 0x7f2b88157be0 2023-08-17T18:12:42.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b86ffd700 1 -- 172.21.15.78:0/2349108043 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8000ba80 con 0x7f2b88157be0 2023-08-17T18:12:42.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b86ffd700 1 -- 172.21.15.78:0/2349108043 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000be00 con 0x7f2b88157be0 2023-08-17T18:12:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b8d475700 1 -- 172.21.15.78:0/2349108043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88157be0 msgr2=0x7f2b88158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b8d475700 1 --2- 172.21.15.78:0/2349108043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88157be0 0x7f2b88158070 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7f2b80009f20 tx=0x7f2b80009840).stop 2023-08-17T18:12:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b8d475700 1 -- 172.21.15.78:0/2349108043 shutdown_connections 2023-08-17T18:12:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b8d475700 1 --2- 172.21.15.78:0/2349108043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88157be0 0x7f2b88158070 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b8d475700 1 --2- 172.21.15.78:0/2349108043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88151e20 0x7f2b880c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b8d475700 1 -- 172.21.15.78:0/2349108043 >> 172.21.15.78:0/2349108043 conn(0x7f2b880943b0 msgr2=0x7f2b8806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b8d475700 1 -- 172.21.15.78:0/2349108043 shutdown_connections 2023-08-17T18:12:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.337+0000 7f2b8d475700 1 -- 172.21.15.78:0/2349108043 wait complete. 2023-08-17T18:12:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.338+0000 7f2b8d475700 1 Processor -- start 2023-08-17T18:12:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.339+0000 7f2b8d475700 1 -- start start 2023-08-17T18:12:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.339+0000 7f2b8d475700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88151a40 0x7f2b8814bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.339+0000 7f2b8d475700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88151e20 0x7f2b880c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.339+0000 7f2b8d475700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88157be0 0x7f2b880abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.339+0000 7f2b8d475700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b880ab690 con 0x7f2b88151e20 2023-08-17T18:12:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.339+0000 7f2b8d475700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8814c100 con 0x7f2b88151a40 2023-08-17T18:12:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.339+0000 7f2b8d475700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b880aaa80 con 0x7f2b88157be0 2023-08-17T18:12:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.339+0000 7f2b877fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88151e20 0x7f2b880c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.339+0000 7f2b877fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88151e20 0x7f2b880c3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37850/0 (socket says 172.21.15.78:37850) 2023-08-17T18:12:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.339+0000 7f2b877fe700 1 -- 172.21.15.78:0/361479565 learned_addr learned my addr 172.21.15.78:0/361479565 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b877fe700 1 -- 172.21.15.78:0/361479565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88157be0 msgr2=0x7f2b880abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b87fff700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88151a40 0x7f2b8814bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b8cc74700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88157be0 0x7f2b880abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b877fe700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88157be0 0x7f2b880abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b877fe700 1 -- 172.21.15.78:0/361479565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88151a40 msgr2=0x7f2b8814bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b877fe700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88151a40 0x7f2b8814bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b877fe700 1 -- 172.21.15.78:0/361479565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b80009ae0 con 0x7f2b88151e20 2023-08-17T18:12:42.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b87fff700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88151a40 0x7f2b8814bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:42.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b8cc74700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88157be0 0x7f2b880abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:42.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b877fe700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88151e20 0x7f2b880c3d00 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7f2b7800d860 tx=0x7f2b78008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:42.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b6ffff700 1 -- 172.21.15.78:0/361479565 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780125f0 con 0x7f2b88151e20 2023-08-17T18:12:42.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b6ffff700 1 -- 172.21.15.78:0/361479565 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78012750 con 0x7f2b88151e20 2023-08-17T18:12:42.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b6ffff700 1 -- 172.21.15.78:0/361479565 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78012ad0 con 0x7f2b88151e20 2023-08-17T18:12:42.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b8d475700 1 -- 172.21.15.78:0/361479565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b880aad60 con 0x7f2b88151e20 2023-08-17T18:12:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.340+0000 7f2b8d475700 1 -- 172.21.15.78:0/361479565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b880ab320 con 0x7f2b88151e20 2023-08-17T18:12:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.341+0000 7f2b8d475700 1 -- 172.21.15.78:0/361479565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b880ab840 con 0x7f2b88151e20 2023-08-17T18:12:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.341+0000 7f2b6ffff700 1 -- 172.21.15.78:0/361479565 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2b78013480 con 0x7f2b88151e20 2023-08-17T18:12:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.342+0000 7f2b6ffff700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2b7405ed90 0x7f2b74061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.342+0000 7f2b6ffff700 1 -- 172.21.15.78:0/361479565 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f2b78079f80 con 0x7f2b88151e20 2023-08-17T18:12:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.342+0000 7f2b87fff700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2b7405ed90 0x7f2b74061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.342+0000 7f2b87fff700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2b7405ed90 0x7f2b74061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2b7c001700 tx=0x7f2b7c009040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.346+0000 7f2b6ffff700 1 -- 172.21.15.78:0/361479565 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b880ab840 con 0x7f2b88151e20 2023-08-17T18:12:42.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.508+0000 7f2b8d475700 1 -- 172.21.15.78:0/361479565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f2b88082f90 con 0x7f2b88151e20 2023-08-17T18:12:42.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.512+0000 7f2b6ffff700 1 -- 172.21.15.78:0/361479565 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v41) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2b7804b640 con 0x7f2b88151e20 2023-08-17T18:12:42.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 -- 172.21.15.78:0/361479565 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2b7405ed90 msgr2=0x7f2b74061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2b7405ed90 0x7f2b74061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2b7c001700 tx=0x7f2b7c009040).stop 2023-08-17T18:12:42.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 -- 172.21.15.78:0/361479565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88151e20 msgr2=0x7f2b880c3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88151e20 0x7f2b880c3d00 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7f2b7800d860 tx=0x7f2b78008040).stop 2023-08-17T18:12:42.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 -- 172.21.15.78:0/361479565 shutdown_connections 2023-08-17T18:12:42.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f2b7405ed90 0x7f2b74061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b88157be0 0x7f2b880abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b88151a40 0x7f2b8814bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 --2- 172.21.15.78:0/361479565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88151e20 0x7f2b880c3d00 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 -- 172.21.15.78:0/361479565 >> 172.21.15.78:0/361479565 conn(0x7f2b880943b0 msgr2=0x7f2b8814c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:42.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 -- 172.21.15.78:0/361479565 shutdown_connections 2023-08-17T18:12:42.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.514+0000 7f2b8d475700 1 -- 172.21.15.78:0/361479565 wait complete. 2023-08-17T18:12:42.527 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-08-17T18:12:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.639+0000 7ff9aeb74700 1 Processor -- start 2023-08-17T18:12:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.639+0000 7ff9aeb74700 1 -- start start 2023-08-17T18:12:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.640+0000 7ff9aeb74700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff9a8154140 0x7ff9a80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.640+0000 7ff9aeb74700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff9a80a7c40 0x7ff9a80c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.640+0000 7ff9aeb74700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a8154520 con 0x7ff9a80a80b0 2023-08-17T18:12:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.640+0000 7ff9aeb74700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a80c91e0 con 0x7ff9a80a7c40 2023-08-17T18:12:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.640+0000 7ff9aeb74700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a80c94c0 con 0x7ff9a8154140 2023-08-17T18:12:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.640+0000 7ff99ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff9a80a7c40 0x7ff9a80c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.640+0000 7ff99ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff9a80a7c40 0x7ff9a80c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37864/0 (socket says 172.21.15.78:37864) 2023-08-17T18:12:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.640+0000 7ff99ffff700 1 -- 172.21.15.78:0/2417409782 learned_addr learned my addr 172.21.15.78:0/2417409782 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff9ac910700 1 --2- 172.21.15.78:0/2417409782 >> v2:172.21.15.150:3300/0 conn(0x7ff9a8154140 0x7ff9a80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff99ffff700 1 -- 172.21.15.78:0/2417409782 >> v2:172.21.15.150:3300/0 conn(0x7ff9a8154140 msgr2=0x7ff9a80c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff99ffff700 1 --2- 172.21.15.78:0/2417409782 >> v2:172.21.15.150:3300/0 conn(0x7ff9a8154140 0x7ff9a80c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff99ffff700 1 -- 172.21.15.78:0/2417409782 >> v1:172.21.15.78:6789/0 conn(0x7ff9a80a80b0 legacy=0x7ff9a80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff99ffff700 1 -- 172.21.15.78:0/2417409782 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80c97a0 con 0x7ff9a80a7c40 2023-08-17T18:12:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff9ac910700 1 --2- 172.21.15.78:0/2417409782 >> v2:172.21.15.150:3300/0 conn(0x7ff9a8154140 0x7ff9a80c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff99ffff700 1 --2- 172.21.15.78:0/2417409782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 0x7ff9a80c0900 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7ff9a80625b0 tx=0x7ff9980090f0).ready entity=mon.0 client_cookie=b645c00a61726fb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff99f7fe700 1 -- 172.21.15.78:0/2417409782 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99800b600 con 0x7ff9a80a7c40 2023-08-17T18:12:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff99f7fe700 1 -- 172.21.15.78:0/2417409782 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99800b760 con 0x7ff9a80a7c40 2023-08-17T18:12:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff99f7fe700 1 -- 172.21.15.78:0/2417409782 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99800bae0 con 0x7ff9a80a7c40 2023-08-17T18:12:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff9aeb74700 1 -- 172.21.15.78:0/2417409782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 msgr2=0x7ff9a80c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff9aeb74700 1 --2- 172.21.15.78:0/2417409782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 0x7ff9a80c0900 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7ff9a80625b0 tx=0x7ff9980090f0).stop 2023-08-17T18:12:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff9aeb74700 1 -- 172.21.15.78:0/2417409782 shutdown_connections 2023-08-17T18:12:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff9aeb74700 1 --2- 172.21.15.78:0/2417409782 >> v2:172.21.15.150:3300/0 conn(0x7ff9a8154140 0x7ff9a80c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff9aeb74700 1 --2- 172.21.15.78:0/2417409782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 0x7ff9a80c0900 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.641+0000 7ff9aeb74700 1 -- 172.21.15.78:0/2417409782 >> 172.21.15.78:0/2417409782 conn(0x7ff9a8094510 msgr2=0x7ff9a806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.642+0000 7ff9aeb74700 1 -- 172.21.15.78:0/2417409782 shutdown_connections 2023-08-17T18:12:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.642+0000 7ff9aeb74700 1 -- 172.21.15.78:0/2417409782 wait complete. 2023-08-17T18:12:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.643+0000 7ff9aeb74700 1 Processor -- start 2023-08-17T18:12:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.643+0000 7ff9aeb74700 1 -- start start 2023-08-17T18:12:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.643+0000 7ff9aeb74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 0x7ff9a80c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.643+0000 7ff9aeb74700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9a80a80b0 0x7ff9a80c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9aeb74700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9a8154140 0x7ff9a80ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9aeb74700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a814e2c0 con 0x7ff9a80a7c40 2023-08-17T18:12:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9aeb74700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80aea70 con 0x7ff9a8154140 2023-08-17T18:12:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9aeb74700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80c2040 con 0x7ff9a80a80b0 2023-08-17T18:12:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9ac910700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 0x7ff9a80c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9ac910700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 0x7ff9a80c2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37866/0 (socket says 172.21.15.78:37866) 2023-08-17T18:12:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9ac910700 1 -- 172.21.15.78:0/1919585157 learned_addr learned my addr 172.21.15.78:0/1919585157 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9ac910700 1 -- 172.21.15.78:0/1919585157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9a80a80b0 msgr2=0x7ff9a80c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9ac910700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9a80a80b0 0x7ff9a80c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9ac910700 1 -- 172.21.15.78:0/1919585157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9a8154140 msgr2=0x7ff9a80ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9ac910700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9a8154140 0x7ff9a80ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9ac910700 1 -- 172.21.15.78:0/1919585157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998009370 con 0x7ff9a80a7c40 2023-08-17T18:12:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9ac910700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 0x7ff9a80c2e00 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7ff9a400cf70 tx=0x7ff9a4007910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff99cff9700 1 -- 172.21.15.78:0/1919585157 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400ae40 con 0x7ff9a80a7c40 2023-08-17T18:12:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff99cff9700 1 -- 172.21.15.78:0/1919585157 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a400d650 con 0x7ff9a80a7c40 2023-08-17T18:12:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9aeb74700 1 -- 172.21.15.78:0/1919585157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a80c2320 con 0x7ff9a80a7c40 2023-08-17T18:12:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff99cff9700 1 -- 172.21.15.78:0/1919585157 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400d9d0 con 0x7ff9a80a7c40 2023-08-17T18:12:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.644+0000 7ff9aeb74700 1 -- 172.21.15.78:0/1919585157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a80c28e0 con 0x7ff9a80a7c40 2023-08-17T18:12:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.645+0000 7ff9aeb74700 1 -- 172.21.15.78:0/1919585157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a80aedb0 con 0x7ff9a80a7c40 2023-08-17T18:12:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.645+0000 7ff99cff9700 1 -- 172.21.15.78:0/1919585157 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff9a4016470 con 0x7ff9a80a7c40 2023-08-17T18:12:42.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.646+0000 7ff99cff9700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff99405ed90 0x7ff994061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:42.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.646+0000 7ff99cff9700 1 -- 172.21.15.78:0/1919585157 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7ff9a407a880 con 0x7ff9a80a7c40 2023-08-17T18:12:42.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.646+0000 7ff99ffff700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff99405ed90 0x7ff994061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:42.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.646+0000 7ff99ffff700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff99405ed90 0x7ff994061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff998009fd0 tx=0x7ff998017000).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:42.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.650+0000 7ff99cff9700 1 -- 172.21.15.78:0/1919585157 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9a404bf40 con 0x7ff9a80a7c40 2023-08-17T18:12:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.879+0000 7ff9aeb74700 1 -- 172.21.15.78:0/1919585157 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7ff9a8047350 con 0x7ff9a80a7c40 2023-08-17T18:12:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.899+0000 7ff99cff9700 1 -- 172.21.15.78:0/1919585157 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1341) v1 ==== 155+0+0 (secure 0 0 0) 0x7ff9a404f560 con 0x7ff9a80a7c40 2023-08-17T18:12:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 -- 172.21.15.78:0/1919585157 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff99405ed90 msgr2=0x7ff994061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff99405ed90 0x7ff994061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff998009fd0 tx=0x7ff998017000).stop 2023-08-17T18:12:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 -- 172.21.15.78:0/1919585157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 msgr2=0x7ff9a80c2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 0x7ff9a80c2e00 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7ff9a400cf70 tx=0x7ff9a4007910).stop 2023-08-17T18:12:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 -- 172.21.15.78:0/1919585157 shutdown_connections 2023-08-17T18:12:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff99405ed90 0x7ff994061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9a8154140 0x7ff9a80ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9a80a7c40 0x7ff9a80c2e00 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 --2- 172.21.15.78:0/1919585157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9a80a80b0 0x7ff9a80c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 -- 172.21.15.78:0/1919585157 >> 172.21.15.78:0/1919585157 conn(0x7ff9a8094510 msgr2=0x7ff9a8063a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 -- 172.21.15.78:0/1919585157 shutdown_connections 2023-08-17T18:12:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:42.901+0000 7ff9aeb74700 1 -- 172.21.15.78:0/1919585157 wait complete. 2023-08-17T18:12:42.913 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-08-17T18:12:42.914 INFO:tasks.cephfs_test_runner: 2023-08-17T18:12:42.914 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-17T18:12:42.914 INFO:tasks.cephfs_test_runner:Ran 10 tests in 2268.682s 2023-08-17T18:12:42.915 INFO:tasks.cephfs_test_runner: 2023-08-17T18:12:42.915 INFO:tasks.cephfs_test_runner:OK 2023-08-17T18:12:42.915 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-08-17T18:12:42.924 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-17T18:12:42.945 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-17T18:12:42.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:42.945 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T18:12:42.959 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T18:12:42.960 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T18:12:42.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:42.960 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T18:12:43.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:43.034 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T18:12:43.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:43.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-08-17T18:12:43.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:43.208 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-08-17T18:12:43.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:43.223 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-08-17T18:12:43.289 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2023-08-17T18:12:43.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T18:12:43.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:43.291 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-08-17T18:12:43.309 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-17T18:12:43.309 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-17T18:12:43.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:43.310 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-17T18:12:43.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:43.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-17T18:12:43.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:43.463 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-08-17T18:12:43.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:43.566 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-08-17T18:12:43.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T18:12:43.581 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-08-17T18:12:43.648 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2023-08-17T18:12:43.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T18:12:43.650 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-17T18:12:43.659 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-08-17T18:12:43.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.771+0000 7f143d794700 1 Processor -- start 2023-08-17T18:12:43.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.771+0000 7f143d794700 1 -- start start 2023-08-17T18:12:43.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.772+0000 7f143d794700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f14381553c0 0x7f1438069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:43.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.772+0000 7f143d794700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1438068650 0x7f143815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:43.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.772+0000 7f143d794700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14380a65a0 con 0x7f14380c1f10 2023-08-17T18:12:43.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.772+0000 7f143d794700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1438069480 con 0x7f14381553c0 2023-08-17T18:12:43.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.772+0000 7f143d794700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14380c2d20 con 0x7f1438068650 2023-08-17T18:12:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f14377fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1438068650 0x7f143815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f1436ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f14381553c0 0x7f1438069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f142e7fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f14380c1f10 0x7f1438067f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:51208/0 (socket says 172.21.15.78:51208) 2023-08-17T18:12:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f142e7fc700 1 -- 172.21.15.78:0/3365153460 learned_addr learned my addr 172.21.15.78:0/3365153460 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f14377fe700 1 --2- 172.21.15.78:0/3365153460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1438068650 0x7f143815bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:44562/0 (socket says 172.21.15.78:44562) 2023-08-17T18:12:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f1436ffd700 1 -- 172.21.15.78:0/3365153460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1438068650 msgr2=0x7f143815bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:43.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f1436ffd700 1 --2- 172.21.15.78:0/3365153460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1438068650 0x7f143815bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f1436ffd700 1 -- 172.21.15.78:0/3365153460 >> v1:172.21.15.150:6789/0 conn(0x7f14380c1f10 legacy=0x7f1438067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f1436ffd700 1 -- 172.21.15.78:0/3365153460 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1438064040 con 0x7f14381553c0 2023-08-17T18:12:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f14367fc700 1 -- 172.21.15.78:0/3365153460 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470829618 0 0) 0x7f14380a65a0 con 0x7f14380c1f10 2023-08-17T18:12:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f1436ffd700 1 --2- 172.21.15.78:0/3365153460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14381553c0 0x7f1438069f30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f1428009760 tx=0x7f1428009060).ready entity=mon.1 client_cookie=b3313fce7fe5e230 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f14367fc700 1 -- 172.21.15.78:0/3365153460 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800f510 con 0x7f14381553c0 2023-08-17T18:12:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f14367fc700 1 -- 172.21.15.78:0/3365153460 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800f670 con 0x7f14381553c0 2023-08-17T18:12:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.773+0000 7f14367fc700 1 -- 172.21.15.78:0/3365153460 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800f9f0 con 0x7f14381553c0 2023-08-17T18:12:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.774+0000 7f143d794700 1 -- 172.21.15.78:0/3365153460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14381553c0 msgr2=0x7f1438069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.774+0000 7f143d794700 1 --2- 172.21.15.78:0/3365153460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14381553c0 0x7f1438069f30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f1428009760 tx=0x7f1428009060).stop 2023-08-17T18:12:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.774+0000 7f143d794700 1 -- 172.21.15.78:0/3365153460 shutdown_connections 2023-08-17T18:12:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.774+0000 7f143d794700 1 --2- 172.21.15.78:0/3365153460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1438068650 0x7f143815bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.774+0000 7f143d794700 1 --2- 172.21.15.78:0/3365153460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14381553c0 0x7f1438069f30 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.774+0000 7f143d794700 1 -- 172.21.15.78:0/3365153460 >> 172.21.15.78:0/3365153460 conn(0x7f1438062fc0 msgr2=0x7f14380c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.774+0000 7f143d794700 1 -- 172.21.15.78:0/3365153460 shutdown_connections 2023-08-17T18:12:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.774+0000 7f143d794700 1 -- 172.21.15.78:0/3365153460 wait complete. 2023-08-17T18:12:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.775+0000 7f143d794700 1 Processor -- start 2023-08-17T18:12:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.775+0000 7f143d794700 1 -- start start 2023-08-17T18:12:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f143d794700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1438068650 0x7f14380a7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f143d794700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14380c1f10 0x7f14380a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f143d794700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14381553c0 0x7f14380a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f143d794700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380a1e40 con 0x7f1438068650 2023-08-17T18:12:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f143d794700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380a1b60 con 0x7f14381553c0 2023-08-17T18:12:43.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f143d794700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14380a2860 con 0x7f14380c1f10 2023-08-17T18:12:43.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f1436ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1438068650 0x7f14380a7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:43.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f1436ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1438068650 0x7f14380a7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37868/0 (socket says 172.21.15.78:37868) 2023-08-17T18:12:43.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f1436ffd700 1 -- 172.21.15.78:0/3962964031 learned_addr learned my addr 172.21.15.78:0/3962964031 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:43.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f14377fe700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14381553c0 0x7f14380a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:43.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f142e7fc700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14380c1f10 0x7f14380a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:43.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f1436ffd700 1 -- 172.21.15.78:0/3962964031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14380c1f10 msgr2=0x7f14380a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:43.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f1436ffd700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14380c1f10 0x7f14380a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:43.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f1436ffd700 1 -- 172.21.15.78:0/3962964031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14381553c0 msgr2=0x7f14380a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:43.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f1436ffd700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14381553c0 0x7f14380a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:43.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f1436ffd700 1 -- 172.21.15.78:0/3962964031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280092a0 con 0x7f1438068650 2023-08-17T18:12:43.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f1436ffd700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1438068650 0x7f14380a7060 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f1438063400 tx=0x7f1428017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:43.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f142f7fe700 1 -- 172.21.15.78:0/3962964031 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800f7e0 con 0x7f1438068650 2023-08-17T18:12:43.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f142f7fe700 1 -- 172.21.15.78:0/3962964031 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800f940 con 0x7f1438068650 2023-08-17T18:12:43.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f143d794700 1 -- 172.21.15.78:0/3962964031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14380a2b40 con 0x7f1438068650 2023-08-17T18:12:43.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.776+0000 7f142f7fe700 1 -- 172.21.15.78:0/3962964031 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142801b690 con 0x7f1438068650 2023-08-17T18:12:43.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.777+0000 7f143d794700 1 -- 172.21.15.78:0/3962964031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14380a1810 con 0x7f1438068650 2023-08-17T18:12:43.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.777+0000 7f143d794700 1 -- 172.21.15.78:0/3962964031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14380a26c0 con 0x7f1438068650 2023-08-17T18:12:43.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.778+0000 7f142f7fe700 1 -- 172.21.15.78:0/3962964031 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f142802a070 con 0x7f1438068650 2023-08-17T18:12:43.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.778+0000 7f142f7fe700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f141805ed90 0x7f1418061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:43.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.778+0000 7f142f7fe700 1 -- 172.21.15.78:0/3962964031 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f142807af60 con 0x7f1438068650 2023-08-17T18:12:43.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.778+0000 7f142e7fc700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f141805ed90 0x7f1418061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:43.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.779+0000 7f142e7fc700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f141805ed90 0x7f1418061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f14380c0fc0 tx=0x7f1420007bb0).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:43.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.782+0000 7f142f7fe700 1 -- 172.21.15.78:0/3962964031 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f14380a26c0 con 0x7f1438068650 2023-08-17T18:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.952+0000 7f143d794700 1 -- 172.21.15.78:0/3962964031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14380a26c0 con 0x7f1438068650 2023-08-17T18:12:43.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.953+0000 7f142f7fe700 1 -- 172.21.15.78:0/3962964031 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+14455 (secure 0 0 0) 0x7f14380a26c0 con 0x7f1438068650 2023-08-17T18:12:43.954 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:43.954 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":190,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:41.895383+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1487845098":"2023-08-18T18:12:37.868296+0000","172.21.15.78:0/3820557982":"2023-08-18T18:12:37.868296+0000","172.21.15.78:0/977567379":"2023-08-18T18:12:37.868296+0000","172.21.15.78:0/1323508470":"2023-08-18T18:12:37.868296+0000","172.21.15.150:6835/2525491694":"2023-08-18T18:12:37.685436+0000","172.21.15.150:6833/2525491694":"2023-08-18T18:12:37.685436+0000","172.21.15.78:0/267357351":"2023-08-18T18:12:37.868296+0000","172.21.15.78:6833/158925":"2023-08-18T18:12:30.406163+0000","172.21.15.78:6832/158925":"2023-08-18T18:12:30.406163+0000","172.21.15.78:0/831867818":"2023-08-18T18:12:30.406163+0000","172.21.15.78:0/2706117257":"2023-08-18T18:12:30.406163+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:43.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.954+0000 7f143d794700 1 -- 172.21.15.78:0/3962964031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f141805ed90 msgr2=0x7f1418061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:43.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.954+0000 7f143d794700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f141805ed90 0x7f1418061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f14380c0fc0 tx=0x7f1420007bb0).stop 2023-08-17T18:12:43.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.955+0000 7f143d794700 1 -- 172.21.15.78:0/3962964031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1438068650 msgr2=0x7f14380a7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:43.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.955+0000 7f143d794700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1438068650 0x7f14380a7060 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f1438063400 tx=0x7f1428017000).stop 2023-08-17T18:12:43.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.955+0000 7f143d794700 1 -- 172.21.15.78:0/3962964031 shutdown_connections 2023-08-17T18:12:43.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.955+0000 7f143d794700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f141805ed90 0x7f1418061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:43.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.955+0000 7f143d794700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14381553c0 0x7f14380a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.955+0000 7f143d794700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1438068650 0x7f14380a7060 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.955+0000 7f143d794700 1 --2- 172.21.15.78:0/3962964031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14380c1f10 0x7f14380a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.955+0000 7f143d794700 1 -- 172.21.15.78:0/3962964031 >> 172.21.15.78:0/3962964031 conn(0x7f1438062fc0 msgr2=0x7f14380c1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.955+0000 7f143d794700 1 -- 172.21.15.78:0/3962964031 shutdown_connections 2023-08-17T18:12:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:43.955+0000 7f143d794700 1 -- 172.21.15.78:0/3962964031 wait complete. 2023-08-17T18:12:43.967 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-17T18:12:43.968 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T18:12:44.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.079+0000 7f93e223e700 1 Processor -- start 2023-08-17T18:12:44.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.080+0000 7f93e223e700 1 -- start start 2023-08-17T18:12:44.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.080+0000 7f93e223e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc154140 0x7f93dc0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.080+0000 7f93e223e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93dc0a7c40 0x7f93dc0c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.080+0000 7f93e223e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93dc154520 con 0x7f93dc0a8080 2023-08-17T18:12:44.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.080+0000 7f93e223e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93dc0c91e0 con 0x7f93dc0a7c40 2023-08-17T18:12:44.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.080+0000 7f93e223e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc0c94c0 con 0x7f93dc154140 2023-08-17T18:12:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93db7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc154140 0x7f93dc0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93daffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93dc0a7c40 0x7f93dc0c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93daffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93dc0a7c40 0x7f93dc0c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.78:45214/0 (socket says 172.21.15.78:45214) 2023-08-17T18:12:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93dbfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f93dc0a8080 0x7f93dc0ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:51224/0 (socket says 172.21.15.78:51224) 2023-08-17T18:12:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93db7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc154140 0x7f93dc0c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.78:44586/0 (socket says 172.21.15.78:44586) 2023-08-17T18:12:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93daffd700 1 -- 172.21.15.78:0/4100378560 learned_addr learned my addr 172.21.15.78:0/4100378560 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93da7fc700 1 -- 172.21.15.78:0/4100378560 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832851827 0 0) 0x7f93dc154520 con 0x7f93dc0a8080 2023-08-17T18:12:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93da7fc700 1 -- 172.21.15.78:0/4100378560 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c40033f0 con 0x7f93dc0a8080 2023-08-17T18:12:44.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93db7fe700 1 -- 172.21.15.78:0/4100378560 >> v2:172.21.15.150:3300/0 conn(0x7f93dc0a7c40 msgr2=0x7f93dc0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:44.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93db7fe700 1 --2- 172.21.15.78:0/4100378560 >> v2:172.21.15.150:3300/0 conn(0x7f93dc0a7c40 0x7f93dc0c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93db7fe700 1 -- 172.21.15.78:0/4100378560 >> v1:172.21.15.150:6789/0 conn(0x7f93dc0a8080 legacy=0x7f93dc0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93db7fe700 1 -- 172.21.15.78:0/4100378560 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc0c97a0 con 0x7f93dc154140 2023-08-17T18:12:44.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93daffd700 1 --2- 172.21.15.78:0/4100378560 >> v2:172.21.15.150:3300/0 conn(0x7f93dc0a7c40 0x7f93dc0c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:44.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93db7fe700 1 --2- 172.21.15.78:0/4100378560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc154140 0x7f93dc0c6ee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f93cc009e60 tx=0x7f93cc009780).ready entity=mon.2 client_cookie=5f407301837cace2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93da7fc700 1 -- 172.21.15.78:0/4100378560 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00e070 con 0x7f93dc154140 2023-08-17T18:12:44.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93da7fc700 1 -- 172.21.15.78:0/4100378560 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc00bab0 con 0x7f93dc154140 2023-08-17T18:12:44.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.081+0000 7f93da7fc700 1 -- 172.21.15.78:0/4100378560 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00be30 con 0x7f93dc154140 2023-08-17T18:12:44.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.082+0000 7f93e223e700 1 -- 172.21.15.78:0/4100378560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc154140 msgr2=0x7f93dc0c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.082+0000 7f93e223e700 1 --2- 172.21.15.78:0/4100378560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc154140 0x7f93dc0c6ee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f93cc009e60 tx=0x7f93cc009780).stop 2023-08-17T18:12:44.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.082+0000 7f93e223e700 1 -- 172.21.15.78:0/4100378560 shutdown_connections 2023-08-17T18:12:44.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.082+0000 7f93e223e700 1 --2- 172.21.15.78:0/4100378560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc154140 0x7f93dc0c6ee0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.082+0000 7f93e223e700 1 --2- 172.21.15.78:0/4100378560 >> v2:172.21.15.150:3300/0 conn(0x7f93dc0a7c40 0x7f93dc0c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.082+0000 7f93e223e700 1 -- 172.21.15.78:0/4100378560 >> 172.21.15.78:0/4100378560 conn(0x7f93dc094510 msgr2=0x7f93dc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:44.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.082+0000 7f93e223e700 1 -- 172.21.15.78:0/4100378560 shutdown_connections 2023-08-17T18:12:44.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.082+0000 7f93e223e700 1 -- 172.21.15.78:0/4100378560 wait complete. 2023-08-17T18:12:44.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.083+0000 7f93e223e700 1 Processor -- start 2023-08-17T18:12:44.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.083+0000 7f93e223e700 1 -- start start 2023-08-17T18:12:44.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93e223e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93dc0a7c40 0x7f93dc0abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93e223e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc0a8080 0x7f93dc1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93e223e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93dc154140 0x7f93dc0af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93e223e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc0ae070 con 0x7f93dc0a7c40 2023-08-17T18:12:44.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93e223e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc0b0ba0 con 0x7f93dc154140 2023-08-17T18:12:44.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93e223e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc0b0300 con 0x7f93dc0a8080 2023-08-17T18:12:44.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93db7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93dc0a7c40 0x7f93dc0abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93db7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93dc0a7c40 0x7f93dc0abb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37878/0 (socket says 172.21.15.78:37878) 2023-08-17T18:12:44.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93db7fe700 1 -- 172.21.15.78:0/1896534124 learned_addr learned my addr 172.21.15.78:0/1896534124 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:44.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93daffd700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc0a8080 0x7f93dc1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93dbfff700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93dc154140 0x7f93dc0af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93db7fe700 1 -- 172.21.15.78:0/1896534124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc0a8080 msgr2=0x7f93dc1531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93db7fe700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc0a8080 0x7f93dc1531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93db7fe700 1 -- 172.21.15.78:0/1896534124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93dc154140 msgr2=0x7f93dc0af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93db7fe700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93dc154140 0x7f93dc0af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.084+0000 7f93db7fe700 1 -- 172.21.15.78:0/1896534124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d0009370 con 0x7f93dc0a7c40 2023-08-17T18:12:44.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.085+0000 7f93db7fe700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93dc0a7c40 0x7f93dc0abb60 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f93cc00b610 tx=0x7f93cc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.085+0000 7f93c37fe700 1 -- 172.21.15.78:0/1896534124 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc01d420 con 0x7f93dc0a7c40 2023-08-17T18:12:44.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.085+0000 7f93c37fe700 1 -- 172.21.15.78:0/1896534124 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc01d580 con 0x7f93dc0a7c40 2023-08-17T18:12:44.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.085+0000 7f93e223e700 1 -- 172.21.15.78:0/1896534124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc009a20 con 0x7f93dc0a7c40 2023-08-17T18:12:44.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.085+0000 7f93c37fe700 1 -- 172.21.15.78:0/1896534124 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc01d940 con 0x7f93dc0a7c40 2023-08-17T18:12:44.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.085+0000 7f93e223e700 1 -- 172.21.15.78:0/1896534124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93dc0b08c0 con 0x7f93dc0a7c40 2023-08-17T18:12:44.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.086+0000 7f93e223e700 1 -- 172.21.15.78:0/1896534124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93dc0ade40 con 0x7f93dc0a7c40 2023-08-17T18:12:44.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.086+0000 7f93c37fe700 1 -- 172.21.15.78:0/1896534124 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f93cc01dd30 con 0x7f93dc0a7c40 2023-08-17T18:12:44.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.086+0000 7f93c37fe700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f93c805ed90 0x7f93c8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.086+0000 7f93c37fe700 1 -- 172.21.15.78:0/1896534124 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f93cc07bac0 con 0x7f93dc0a7c40 2023-08-17T18:12:44.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.087+0000 7f93daffd700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f93c805ed90 0x7f93c8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.087+0000 7f93daffd700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f93c805ed90 0x7f93c8061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f93dc0cb4c0 tx=0x7f93d00090f0).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.091+0000 7f93c37fe700 1 -- 172.21.15.78:0/1896534124 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f93dc0ade40 con 0x7f93dc0a7c40 2023-08-17T18:12:44.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.251+0000 7f93e223e700 1 -- 172.21.15.78:0/1896534124 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93dc0ae1b0 con 0x7f93c805ed90 2023-08-17T18:12:44.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.254+0000 7f93c37fe700 1 -- 172.21.15.78:0/1896534124 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71320 (secure 0 0 0) 0x7f93d0009af0 con 0x7f93c805ed90 2023-08-17T18:12:44.255 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.255+0000 7f93e223e700 1 -- 172.21.15.78:0/1896534124 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f93c805ed90 msgr2=0x7f93c8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.255+0000 7f93e223e700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f93c805ed90 0x7f93c8061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f93dc0cb4c0 tx=0x7f93d00090f0).stop 2023-08-17T18:12:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.255+0000 7f93e223e700 1 -- 172.21.15.78:0/1896534124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93dc0a7c40 msgr2=0x7f93dc0abb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.255+0000 7f93e223e700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93dc0a7c40 0x7f93dc0abb60 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f93cc00b610 tx=0x7f93cc009780).stop 2023-08-17T18:12:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.255+0000 7f93e223e700 1 -- 172.21.15.78:0/1896534124 shutdown_connections 2023-08-17T18:12:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.255+0000 7f93e223e700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f93c805ed90 0x7f93c8061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.255+0000 7f93e223e700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93dc154140 0x7f93dc0af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.255+0000 7f93e223e700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93dc0a7c40 0x7f93dc0abb60 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.255+0000 7f93e223e700 1 --2- 172.21.15.78:0/1896534124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93dc0a8080 0x7f93dc1531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.255+0000 7f93e223e700 1 -- 172.21.15.78:0/1896534124 >> 172.21.15.78:0/1896534124 conn(0x7f93dc094510 msgr2=0x7f93dc156850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.256+0000 7f93e223e700 1 -- 172.21.15.78:0/1896534124 shutdown_connections 2023-08-17T18:12:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.256+0000 7f93e223e700 1 -- 172.21.15.78:0/1896534124 wait complete. 2023-08-17T18:12:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T18:12:44.268 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-08-17T18:12:43.885643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2436288,"kb_used_data":18560,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752538432,"statfs":{"total":773094113280,"available":770599354368,"internally_reserved":0,"allocated":19005440,"data_stored":9543868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11959,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.012522"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.968942+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T18:12:40.968942+0000","last_peered":"2023-08-17T18:12:40.968942+0000","last_clean":"2023-08-17T18:12:40.968942+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T18:12:40.968942+0000","last_undegraded":"2023-08-17T18:12:40.968942+0000","last_fullsized":"2023-08-17T18:12:40.968942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.898528+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T18:12:40.898528+0000","last_peered":"2023-08-17T18:12:40.898528+0000","last_clean":"2023-08-17T18:12:40.898528+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T18:12:40.898528+0000","last_undegraded":"2023-08-17T18:12:40.898528+0000","last_fullsized":"2023-08-17T18:12:40.898528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.965810+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T18:12:40.965810+0000","last_peered":"2023-08-17T18:12:40.965810+0000","last_clean":"2023-08-17T18:12:40.965810+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T18:12:40.965810+0000","last_undegraded":"2023-08-17T18:12:40.965810+0000","last_fullsized":"2023-08-17T18:12:40.965810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.899701+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T18:12:40.899701+0000","last_peered":"2023-08-17T18:12:40.899701+0000","last_clean":"2023-08-17T18:12:40.899701+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T18:12:40.899701+0000","last_undegraded":"2023-08-17T18:12:40.899701+0000","last_fullsized":"2023-08-17T18:12:40.899701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.971027+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T18:12:40.971027+0000","last_peered":"2023-08-17T18:12:40.971027+0000","last_clean":"2023-08-17T18:12:40.971027+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T18:12:40.971027+0000","last_undegraded":"2023-08-17T18:12:40.971027+0000","last_fullsized":"2023-08-17T18:12:40.971027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.971108+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T18:12:40.971108+0000","last_peered":"2023-08-17T18:12:40.971108+0000","last_clean":"2023-08-17T18:12:40.971108+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T18:12:40.971108+0000","last_undegraded":"2023-08-17T18:12:40.971108+0000","last_fullsized":"2023-08-17T18:12:40.971108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.969121+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T18:12:40.969121+0000","last_peered":"2023-08-17T18:12:40.969121+0000","last_clean":"2023-08-17T18:12:40.969121+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T18:12:40.969121+0000","last_undegraded":"2023-08-17T18:12:40.969121+0000","last_fullsized":"2023-08-17T18:12:40.969121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.970816+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T18:12:40.970816+0000","last_peered":"2023-08-17T18:12:40.970816+0000","last_clean":"2023-08-17T18:12:40.970816+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T18:12:40.970816+0000","last_undegraded":"2023-08-17T18:12:40.970816+0000","last_fullsized":"2023-08-17T18:12:40.970816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-17T18:12:37.882587+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T18:12:37.882587+0000","last_peered":"2023-08-17T18:12:37.882587+0000","last_clean":"2023-08-17T18:12:37.882587+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T18:12:37.882587+0000","last_undegraded":"2023-08-17T18:12:37.882587+0000","last_fullsized":"2023-08-17T18:12:37.882587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575302,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68600000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41699999999999998,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.76300000000000001,"15min":0.77100000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.69699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.434}]},{"osd":2,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66500000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.374,"15min":0.374},"max":{"1min":0.70399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36799999999999999},"max":{"1min":0.70999999999999996,"5min":0.78600000000000003,"15min":0.81699999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.747,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.312,"15min":0.247},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.76900000000000002},"last":0.628}]},{"osd":5,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51600000000000001,"15min":0.497},"min":{"1min":0.314,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.81699999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.86499999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.67200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575302,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068336,"statfs":{"total":96636764160,"available":96325976064,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.42199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79000000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.31900000000000001},"max":{"1min":0.71899999999999997,"5min":1.214,"15min":1.214},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.84799999999999998,"5min":1.208,"15min":1.208},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77100000000000002,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.82399999999999995,"5min":1.304,"15min":1.304},"last":0.625},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.78600000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29499999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.88700000000000001},"last":0.432},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69499999999999995,"5min":0.75700000000000001,"15min":1.0269999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.32300000000000001},"max":{"1min":0.80100000000000005,"5min":0.87,"15min":0.87},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.42299999999999999,"5min":0.372,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.97699999999999998},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575303,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.26800000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.57199999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.47199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.318},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40899999999999997},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.44},"min":{"1min":0.33800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65500000000000003,"5min":1.095,"15min":1.095},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80500000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.96199999999999997},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78600000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.48499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78500000000000003,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40300000000000002},"max":{"1min":0.82699999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.44500000000000001,"15min":0.41599999999999998},"max":{"1min":0.82299999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63300000000000001,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82599999999999996,"5min":0.872,"15min":0.91800000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.65000000000000002},"min":{"1min":0.42199999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89200000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575302,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068336,"statfs":{"total":96636764160,"available":96325976064,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34399999999999997,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.40999999999999998,"5min":0.64100000000000001,"15min":0.77600000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36499999999999999,"15min":0.38900000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.505,"5min":0.58099999999999996,"15min":0.70899999999999996},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.36899999999999999},"min":{"1min":0.249,"5min":0.214,"15min":0.214},"max":{"1min":0.40999999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"last":0.254},{"interface":"front","average":{"1min":0.37,"5min":0.39900000000000002,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.499,"5min":0.70299999999999996,"15min":0.754},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38400000000000001,"15min":0.40400000000000003},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.48399999999999999,"5min":0.59699999999999998,"15min":0.66100000000000003},"last":0.315},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.307,"5min":0.254,"15min":0.254},"max":{"1min":0.46700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.307}]},{"osd":4,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35399999999999998},"max":{"1min":0.85999999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88300000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39600000000000002},"max":{"1min":0.755,"5min":1.079,"15min":1.079},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82499999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.622}]},{"osd":7,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92000000000000004,"5min":1.0549999999999999,"15min":1.0820000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.65600000000000003,"15min":0.67900000000000005},"min":{"1min":0.497,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.78600000000000003,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575302,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068336,"statfs":{"total":96636764160,"available":96325976064,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.26500000000000001,"5min":0.221,"15min":0.21099999999999999},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.623},"last":0.246},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36799999999999999,"15min":0.36899999999999999},"min":{"1min":0.26700000000000002,"5min":0.254,"15min":0.25},"max":{"1min":0.50800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40899999999999997,"15min":0.40999999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.68100000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.72999999999999998},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.36699999999999999,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.67000000000000004},"last":0.377},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.41499999999999998},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53000000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":1.0169999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.21,"15min":1.21},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.79600000000000004,"5min":0.91000000000000003,"15min":0.94799999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.629,"15min":0.64200000000000002},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76300000000000001,"5min":1.254,"15min":1.254},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58899999999999997,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80100000000000005,"5min":0.89900000000000002,"15min":0.96099999999999997},"last":0.497},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.97999999999999998},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.42099999999999999},"max":{"1min":0.78500000000000003,"5min":1.234,"15min":1.234},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.625,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.93500000000000005,"15min":1.0469999999999999},"last":0.52400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575302,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307600,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064240,"statfs":{"total":96636764160,"available":96321781760,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.217},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.38600000000000001},"min":{"1min":0.23100000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.61299999999999999},"last":0.308}]},{"osd":1,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.373,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52000000000000002,"5min":0.59399999999999997,"15min":0.72299999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63400000000000001},"last":0.373}]},{"osd":2,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.68899999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63300000000000001,"5min":0.66700000000000004,"15min":0.70699999999999996},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.44900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71099999999999997,"5min":0.87,"15min":0.95499999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.93100000000000005},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.40300000000000002,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.64000000000000001},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80100000000000005,"5min":0.89100000000000001,"15min":0.90700000000000003},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.92800000000000005,"15min":0.94399999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.77800000000000002,"5min":0.93200000000000005,"15min":0.94899999999999995},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42199999999999999},"max":{"1min":0.78700000000000003,"5min":0.96599999999999997,"15min":0.97099999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.502,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":0.83699999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575303,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.30499999999999999},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79400000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.315},"max":{"1min":0.755,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.746,"5min":0.76300000000000001,"15min":0.79400000000000004},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.81399999999999995,"15min":0.83799999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78400000000000003,"5min":0.79300000000000004,"15min":0.81999999999999995},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83999999999999997,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.47599999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81000000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.35999999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69999999999999996,"5min":0.75,"15min":0.79700000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32700000000000001,"15min":0.28799999999999998},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34399999999999997,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.86299999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.502}]},{"osd":7,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84999999999999998,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89700000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.54400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575301,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307616,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064224,"statfs":{"total":96636764160,"available":96321765376,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.80300000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.755,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.378,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68100000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78600000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79900000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.82899999999999996,"15min":0.86399999999999999},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.71599999999999997},"last":0.629},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.307,"15min":0.29899999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.85299999999999998,"5min":0.873,"15min":0.873},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T18:12:44.270 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T18:12:44.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.382+0000 7f3ce779a700 1 Processor -- start 2023-08-17T18:12:44.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.382+0000 7f3ce779a700 1 -- start start 2023-08-17T18:12:44.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.383+0000 7f3ce779a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce0154140 0x7f3ce00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.383+0000 7f3ce779a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3ce00a7c40 0x7f3ce00c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.383+0000 7f3ce779a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce0154520 con 0x7f3ce00a8080 2023-08-17T18:12:44.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.383+0000 7f3ce779a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce00c91e0 con 0x7f3ce00a7c40 2023-08-17T18:12:44.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.383+0000 7f3ce779a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c94c0 con 0x7f3ce0154140 2023-08-17T18:12:44.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.383+0000 7f3ce5d37700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3ce00a8080 0x7f3ce00ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37136/0 (socket says 172.21.15.78:37136) 2023-08-17T18:12:44.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.383+0000 7f3ce5d37700 1 -- 172.21.15.78:0/4077977988 learned_addr learned my addr 172.21.15.78:0/4077977988 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:44.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.383+0000 7f3ce5536700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce0154140 0x7f3ce00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.383+0000 7f3ce4d35700 1 --2- 172.21.15.78:0/4077977988 >> v2:172.21.15.150:3300/0 conn(0x7f3ce00a7c40 0x7f3ce00c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682077926 0 0) 0x7f3ce0154520 con 0x7f3ce00a8080 2023-08-17T18:12:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ccc0033f0 con 0x7f3ce00a8080 2023-08-17T18:12:44.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804108005 0 0) 0x7f3ccc0033f0 con 0x7f3ce00a8080 2023-08-17T18:12:44.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce0154140 msgr2=0x7f3ce00c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:44.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce0154140 0x7f3ce00c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 >> v2:172.21.15.150:3300/0 conn(0x7f3ce00a7c40 msgr2=0x7f3ce00c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:44.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 --2- 172.21.15.78:0/4077977988 >> v2:172.21.15.150:3300/0 conn(0x7f3ce00a7c40 0x7f3ce00c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce00c97a0 con 0x7f3ce00a8080 2023-08-17T18:12:44.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3cd8001470 con 0x7f3ce00a8080 2023-08-17T18:12:44.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 >> v1:172.21.15.78:6789/0 conn(0x7f3ce00a8080 legacy=0x7f3ce00ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc0038e0 0x7f3ccc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce0154140 0x7f3ccc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ccc004b80 0x7f3ccc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c91e0 con 0x7f3ccc004b80 2023-08-17T18:12:44.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c94c0 con 0x7f3ccc0038e0 2023-08-17T18:12:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc00b8e0 con 0x7f3ce0154140 2023-08-17T18:12:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3ce5d37700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ccc004b80 0x7f3ccc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3ce5536700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc0038e0 0x7f3ccc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3ce4d35700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce0154140 0x7f3ccc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3ce5d37700 1 -- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce0154140 msgr2=0x7f3ccc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3ce5d37700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce0154140 0x7f3ccc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3ce5d37700 1 -- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc0038e0 msgr2=0x7f3ccc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3ce5d37700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc0038e0 0x7f3ccc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3ce5d37700 1 -- 172.21.15.78:0/4077977988 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0033f0 con 0x7f3ccc004b80 2023-08-17T18:12:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.384+0000 7f3ce5d37700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ccc004b80 0x7f3ccc005000 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f3ce00a84d0 tx=0x7f3cd8001e90).ready entity=mon.0 client_cookie=aa7798fc79de2a89 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.385+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8007a60 con 0x7f3ccc004b80 2023-08-17T18:12:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.385+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd800ca80 con 0x7f3ccc004b80 2023-08-17T18:12:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.385+0000 7f3cd7fff700 1 -- 172.21.15.78:0/4077977988 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800ce00 con 0x7f3ccc004b80 2023-08-17T18:12:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.385+0000 7f3ce779a700 1 -- 172.21.15.78:0/4077977988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ccc004b80 msgr2=0x7f3ccc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.385+0000 7f3ce779a700 1 --2- 172.21.15.78:0/4077977988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ccc004b80 0x7f3ccc005000 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f3ce00a84d0 tx=0x7f3cd8001e90).stop 2023-08-17T18:12:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.385+0000 7f3ce5d37700 1 -- 172.21.15.78:0/4077977988 reap_dead start 2023-08-17T18:12:44.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.385+0000 7f3ce779a700 1 -- 172.21.15.78:0/4077977988 shutdown_connections 2023-08-17T18:12:44.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.385+0000 7f3ce779a700 1 -- 172.21.15.78:0/4077977988 >> 172.21.15.78:0/4077977988 conn(0x7f3ce0094510 msgr2=0x7f3ce006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:44.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.385+0000 7f3ce779a700 1 -- 172.21.15.78:0/4077977988 shutdown_connections 2023-08-17T18:12:44.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.385+0000 7f3ce779a700 1 -- 172.21.15.78:0/4077977988 wait complete. 2023-08-17T18:12:44.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.386+0000 7f3ce779a700 1 Processor -- start 2023-08-17T18:12:44.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.386+0000 7f3ce779a700 1 -- start start 2023-08-17T18:12:44.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce779a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc004b80 0x7f3ce0168210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce779a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce00ade40 0x7f3ce0142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce779a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce01675f0 0x7f3ce0167a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce779a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00ae650 con 0x7f3ce01675f0 2023-08-17T18:12:44.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce779a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c2e90 con 0x7f3ccc004b80 2023-08-17T18:12:44.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce779a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c3a10 con 0x7f3ce00ade40 2023-08-17T18:12:44.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce5d37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce01675f0 0x7f3ce0167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce5d37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce01675f0 0x7f3ce0167a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37896/0 (socket says 172.21.15.78:37896) 2023-08-17T18:12:44.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce5d37700 1 -- 172.21.15.78:0/1035410895 learned_addr learned my addr 172.21.15.78:0/1035410895 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:44.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce5536700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc004b80 0x7f3ce0168210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.387+0000 7f3ce4d35700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce00ade40 0x7f3ce0142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3ce5d37700 1 -- 172.21.15.78:0/1035410895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce00ade40 msgr2=0x7f3ce0142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3ce5d37700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce00ade40 0x7f3ce0142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3ce5d37700 1 -- 172.21.15.78:0/1035410895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc004b80 msgr2=0x7f3ce0168210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3ce5d37700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc004b80 0x7f3ce0168210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3ce5d37700 1 -- 172.21.15.78:0/1035410895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce0167f60 con 0x7f3ce01675f0 2023-08-17T18:12:44.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3ce5d37700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce01675f0 0x7f3ce0167a70 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f3ccc004490 tx=0x7f3cd8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3cd57fa700 1 -- 172.21.15.78:0/1035410895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8007a60 con 0x7f3ce01675f0 2023-08-17T18:12:44.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3cd57fa700 1 -- 172.21.15.78:0/1035410895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd8001430 con 0x7f3ce01675f0 2023-08-17T18:12:44.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3cd57fa700 1 -- 172.21.15.78:0/1035410895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8004ad0 con 0x7f3ce01675f0 2023-08-17T18:12:44.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3ce779a700 1 -- 172.21.15.78:0/1035410895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce00c30e0 con 0x7f3ce01675f0 2023-08-17T18:12:44.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.388+0000 7f3ce779a700 1 -- 172.21.15.78:0/1035410895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce00c36a0 con 0x7f3ce01675f0 2023-08-17T18:12:44.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.389+0000 7f3ce779a700 1 -- 172.21.15.78:0/1035410895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce0153920 con 0x7f3ce01675f0 2023-08-17T18:12:44.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.389+0000 7f3cd57fa700 1 -- 172.21.15.78:0/1035410895 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3cd801d070 con 0x7f3ce01675f0 2023-08-17T18:12:44.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.390+0000 7f3cd57fa700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3cc405ed90 0x7f3cc4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.390+0000 7f3cd57fa700 1 -- 172.21.15.78:0/1035410895 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f3cd8079e50 con 0x7f3ce01675f0 2023-08-17T18:12:44.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.390+0000 7f3ce5536700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3cc405ed90 0x7f3cc4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.390+0000 7f3ce5536700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3cc405ed90 0x7f3cc4061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3cdc0094d0 tx=0x7f3cdc00b040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.394+0000 7f3cd57fa700 1 -- 172.21.15.78:0/1035410895 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3cd804b510 con 0x7f3ce01675f0 2023-08-17T18:12:44.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.553+0000 7f3ce779a700 1 -- 172.21.15.78:0/1035410895 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ce0047350 con 0x7f3cc405ed90 2023-08-17T18:12:44.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.556+0000 7f3cd57fa700 1 -- 172.21.15.78:0/1035410895 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71320 (secure 0 0 0) 0x7f3ce0047350 con 0x7f3cc405ed90 2023-08-17T18:12:44.557 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:44.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.557+0000 7f3ce779a700 1 -- 172.21.15.78:0/1035410895 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3cc405ed90 msgr2=0x7f3cc4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.557+0000 7f3ce779a700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3cc405ed90 0x7f3cc4061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3cdc0094d0 tx=0x7f3cdc00b040).stop 2023-08-17T18:12:44.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.557+0000 7f3ce779a700 1 -- 172.21.15.78:0/1035410895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce01675f0 msgr2=0x7f3ce0167a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.557+0000 7f3ce779a700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce01675f0 0x7f3ce0167a70 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f3ccc004490 tx=0x7f3cd8015000).stop 2023-08-17T18:12:44.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.558+0000 7f3ce779a700 1 -- 172.21.15.78:0/1035410895 shutdown_connections 2023-08-17T18:12:44.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.558+0000 7f3ce779a700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3cc405ed90 0x7f3cc4061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.558+0000 7f3ce779a700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce01675f0 0x7f3ce0167a70 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.558+0000 7f3ce779a700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ccc004b80 0x7f3ce0168210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.558+0000 7f3ce779a700 1 --2- 172.21.15.78:0/1035410895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ce00ade40 0x7f3ce0142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.558+0000 7f3ce779a700 1 -- 172.21.15.78:0/1035410895 >> 172.21.15.78:0/1035410895 conn(0x7f3ce0094510 msgr2=0x7f3ce0063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:44.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.558+0000 7f3ce779a700 1 -- 172.21.15.78:0/1035410895 shutdown_connections 2023-08-17T18:12:44.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.558+0000 7f3ce779a700 1 -- 172.21.15.78:0/1035410895 wait complete. 2023-08-17T18:12:44.560 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T18:12:44.570 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-08-17T18:12:43.885643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2436288,"kb_used_data":18560,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752538432,"statfs":{"total":773094113280,"available":770599354368,"internally_reserved":0,"allocated":19005440,"data_stored":9543868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11959,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.012522"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.968942+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T18:12:40.968942+0000","last_peered":"2023-08-17T18:12:40.968942+0000","last_clean":"2023-08-17T18:12:40.968942+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T18:12:40.968942+0000","last_undegraded":"2023-08-17T18:12:40.968942+0000","last_fullsized":"2023-08-17T18:12:40.968942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.898528+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T18:12:40.898528+0000","last_peered":"2023-08-17T18:12:40.898528+0000","last_clean":"2023-08-17T18:12:40.898528+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T18:12:40.898528+0000","last_undegraded":"2023-08-17T18:12:40.898528+0000","last_fullsized":"2023-08-17T18:12:40.898528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.965810+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T18:12:40.965810+0000","last_peered":"2023-08-17T18:12:40.965810+0000","last_clean":"2023-08-17T18:12:40.965810+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T18:12:40.965810+0000","last_undegraded":"2023-08-17T18:12:40.965810+0000","last_fullsized":"2023-08-17T18:12:40.965810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.899701+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T18:12:40.899701+0000","last_peered":"2023-08-17T18:12:40.899701+0000","last_clean":"2023-08-17T18:12:40.899701+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T18:12:40.899701+0000","last_undegraded":"2023-08-17T18:12:40.899701+0000","last_fullsized":"2023-08-17T18:12:40.899701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.971027+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T18:12:40.971027+0000","last_peered":"2023-08-17T18:12:40.971027+0000","last_clean":"2023-08-17T18:12:40.971027+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T18:12:40.971027+0000","last_undegraded":"2023-08-17T18:12:40.971027+0000","last_fullsized":"2023-08-17T18:12:40.971027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.971108+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T18:12:40.971108+0000","last_peered":"2023-08-17T18:12:40.971108+0000","last_clean":"2023-08-17T18:12:40.971108+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T18:12:40.971108+0000","last_undegraded":"2023-08-17T18:12:40.971108+0000","last_fullsized":"2023-08-17T18:12:40.971108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.969121+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T18:12:40.969121+0000","last_peered":"2023-08-17T18:12:40.969121+0000","last_clean":"2023-08-17T18:12:40.969121+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T18:12:40.969121+0000","last_undegraded":"2023-08-17T18:12:40.969121+0000","last_fullsized":"2023-08-17T18:12:40.969121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.970816+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T18:12:40.970816+0000","last_peered":"2023-08-17T18:12:40.970816+0000","last_clean":"2023-08-17T18:12:40.970816+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T18:12:40.970816+0000","last_undegraded":"2023-08-17T18:12:40.970816+0000","last_fullsized":"2023-08-17T18:12:40.970816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-17T18:12:37.882587+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T18:12:37.882587+0000","last_peered":"2023-08-17T18:12:37.882587+0000","last_clean":"2023-08-17T18:12:37.882587+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T18:12:37.882587+0000","last_undegraded":"2023-08-17T18:12:37.882587+0000","last_fullsized":"2023-08-17T18:12:37.882587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575302,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68600000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41699999999999998,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.76300000000000001,"15min":0.77100000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.69699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.434}]},{"osd":2,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66500000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.374,"15min":0.374},"max":{"1min":0.70399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36799999999999999},"max":{"1min":0.70999999999999996,"5min":0.78600000000000003,"15min":0.81699999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.747,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.312,"15min":0.247},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.76900000000000002},"last":0.628}]},{"osd":5,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51600000000000001,"15min":0.497},"min":{"1min":0.314,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.81699999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.86499999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.67200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575302,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068336,"statfs":{"total":96636764160,"available":96325976064,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.42199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79000000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.31900000000000001},"max":{"1min":0.71899999999999997,"5min":1.214,"15min":1.214},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.84799999999999998,"5min":1.208,"15min":1.208},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77100000000000002,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.82399999999999995,"5min":1.304,"15min":1.304},"last":0.625},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.78600000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29499999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.88700000000000001},"last":0.432},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69499999999999995,"5min":0.75700000000000001,"15min":1.0269999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.32300000000000001},"max":{"1min":0.80100000000000005,"5min":0.87,"15min":0.87},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.42299999999999999,"5min":0.372,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.97699999999999998},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575303,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.26800000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.57199999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.47199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.318},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40899999999999997},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.44},"min":{"1min":0.33800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65500000000000003,"5min":1.095,"15min":1.095},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80500000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.96199999999999997},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78600000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.48499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78500000000000003,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40300000000000002},"max":{"1min":0.82699999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.44500000000000001,"15min":0.41599999999999998},"max":{"1min":0.82299999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63300000000000001,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82599999999999996,"5min":0.872,"15min":0.91800000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.65000000000000002},"min":{"1min":0.42199999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89200000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575302,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068336,"statfs":{"total":96636764160,"available":96325976064,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34399999999999997,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.40999999999999998,"5min":0.64100000000000001,"15min":0.77600000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36499999999999999,"15min":0.38900000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.505,"5min":0.58099999999999996,"15min":0.70899999999999996},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.36899999999999999},"min":{"1min":0.249,"5min":0.214,"15min":0.214},"max":{"1min":0.40999999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"last":0.254},{"interface":"front","average":{"1min":0.37,"5min":0.39900000000000002,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.499,"5min":0.70299999999999996,"15min":0.754},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38400000000000001,"15min":0.40400000000000003},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.48399999999999999,"5min":0.59699999999999998,"15min":0.66100000000000003},"last":0.315},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.307,"5min":0.254,"15min":0.254},"max":{"1min":0.46700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.307}]},{"osd":4,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35399999999999998},"max":{"1min":0.85999999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88300000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39600000000000002},"max":{"1min":0.755,"5min":1.079,"15min":1.079},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82499999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.622}]},{"osd":7,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92000000000000004,"5min":1.0549999999999999,"15min":1.0820000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.65600000000000003,"15min":0.67900000000000005},"min":{"1min":0.497,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.78600000000000003,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575302,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068336,"statfs":{"total":96636764160,"available":96325976064,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.26500000000000001,"5min":0.221,"15min":0.21099999999999999},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.623},"last":0.246},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36799999999999999,"15min":0.36899999999999999},"min":{"1min":0.26700000000000002,"5min":0.254,"15min":0.25},"max":{"1min":0.50800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40899999999999997,"15min":0.40999999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.68100000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.72999999999999998},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.36699999999999999,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.67000000000000004},"last":0.377},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.41499999999999998},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53000000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":1.0169999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.21,"15min":1.21},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.79600000000000004,"5min":0.91000000000000003,"15min":0.94799999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.629,"15min":0.64200000000000002},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76300000000000001,"5min":1.254,"15min":1.254},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58899999999999997,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80100000000000005,"5min":0.89900000000000002,"15min":0.96099999999999997},"last":0.497},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.97999999999999998},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.42099999999999999},"max":{"1min":0.78500000000000003,"5min":1.234,"15min":1.234},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.625,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.93500000000000005,"15min":1.0469999999999999},"last":0.52400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575302,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307600,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064240,"statfs":{"total":96636764160,"available":96321781760,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.217},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.38600000000000001},"min":{"1min":0.23100000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.61299999999999999},"last":0.308}]},{"osd":1,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.373,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52000000000000002,"5min":0.59399999999999997,"15min":0.72299999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63400000000000001},"last":0.373}]},{"osd":2,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.68899999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63300000000000001,"5min":0.66700000000000004,"15min":0.70699999999999996},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.44900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71099999999999997,"5min":0.87,"15min":0.95499999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.93100000000000005},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.40300000000000002,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.64000000000000001},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80100000000000005,"5min":0.89100000000000001,"15min":0.90700000000000003},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.92800000000000005,"15min":0.94399999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.77800000000000002,"5min":0.93200000000000005,"15min":0.94899999999999995},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42199999999999999},"max":{"1min":0.78700000000000003,"5min":0.96599999999999997,"15min":0.97099999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.502,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":0.83699999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575303,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.30499999999999999},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79400000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.315},"max":{"1min":0.755,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.746,"5min":0.76300000000000001,"15min":0.79400000000000004},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.81399999999999995,"15min":0.83799999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78400000000000003,"5min":0.79300000000000004,"15min":0.81999999999999995},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83999999999999997,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.47599999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81000000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.35999999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69999999999999996,"5min":0.75,"15min":0.79700000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32700000000000001,"15min":0.28799999999999998},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34399999999999997,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.86299999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.502}]},{"osd":7,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84999999999999998,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89700000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.54400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575301,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307616,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064224,"statfs":{"total":96636764160,"available":96321765376,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.80300000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.755,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.378,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68100000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78600000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79900000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.82899999999999996,"15min":0.86399999999999999},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.71599999999999997},"last":0.629},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.307,"15min":0.29899999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.85299999999999998,"5min":0.873,"15min":0.873},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T18:12:44.572 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-17T18:12:44.572 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T18:12:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.683+0000 7fa30f53e700 1 Processor -- start 2023-08-17T18:12:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.684+0000 7fa30f53e700 1 -- start start 2023-08-17T18:12:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.684+0000 7fa30f53e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066660 0x7fa3080c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.684+0000 7fa30f53e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa308066a40 0x7fa308151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.684+0000 7fa30f53e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3080c6040 con 0x7fa3080c5b50 2023-08-17T18:12:44.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.684+0000 7fa30f53e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa308069b00 con 0x7fa308066a40 2023-08-17T18:12:44.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.684+0000 7fa30f53e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa308069f90 con 0x7fa308066660 2023-08-17T18:12:44.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa30cad9700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa3080c5b50 0x7fa3080624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37150/0 (socket says 172.21.15.78:37150) 2023-08-17T18:12:44.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa30cad9700 1 -- 172.21.15.78:0/2340161084 learned_addr learned my addr 172.21.15.78:0/2340161084 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:44.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa30dadb700 1 --2- 172.21.15.78:0/2340161084 >> v2:172.21.15.150:3300/0 conn(0x7fa308066a40 0x7fa308151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa30d2da700 1 --2- 172.21.15.78:0/2340161084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066660 0x7fa3080c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa2fffff700 1 -- 172.21.15.78:0/2340161084 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000781392 0 0) 0x7fa2f8001110 con 0x7fa3080c5b50 2023-08-17T18:12:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa2fffff700 1 -- 172.21.15.78:0/2340161084 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f40033f0 con 0x7fa3080c5b50 2023-08-17T18:12:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa30d2da700 1 -- 172.21.15.78:0/2340161084 >> v2:172.21.15.150:3300/0 conn(0x7fa308066a40 msgr2=0x7fa308151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa30d2da700 1 --2- 172.21.15.78:0/2340161084 >> v2:172.21.15.150:3300/0 conn(0x7fa308066a40 0x7fa308151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa30d2da700 1 -- 172.21.15.78:0/2340161084 >> v1:172.21.15.78:6789/0 conn(0x7fa3080c5b50 legacy=0x7fa3080624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa30d2da700 1 -- 172.21.15.78:0/2340161084 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080691d0 con 0x7fa308066660 2023-08-17T18:12:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa30dadb700 1 --2- 172.21.15.78:0/2340161084 >> v2:172.21.15.150:3300/0 conn(0x7fa308066a40 0x7fa308151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa30d2da700 1 --2- 172.21.15.78:0/2340161084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066660 0x7fa3080c5660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fa304009760 tx=0x7fa304009060).ready entity=mon.2 client_cookie=404830b705cd026f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa2fffff700 1 -- 172.21.15.78:0/2340161084 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30400d4a0 con 0x7fa308066660 2023-08-17T18:12:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa2fffff700 1 -- 172.21.15.78:0/2340161084 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30400d600 con 0x7fa308066660 2023-08-17T18:12:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.685+0000 7fa2fffff700 1 -- 172.21.15.78:0/2340161084 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30400d980 con 0x7fa308066660 2023-08-17T18:12:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.686+0000 7fa30f53e700 1 -- 172.21.15.78:0/2340161084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066660 msgr2=0x7fa3080c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.686+0000 7fa30f53e700 1 --2- 172.21.15.78:0/2340161084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066660 0x7fa3080c5660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fa304009760 tx=0x7fa304009060).stop 2023-08-17T18:12:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.686+0000 7fa30f53e700 1 -- 172.21.15.78:0/2340161084 shutdown_connections 2023-08-17T18:12:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.686+0000 7fa30f53e700 1 --2- 172.21.15.78:0/2340161084 >> v2:172.21.15.150:3300/0 conn(0x7fa308066a40 0x7fa308151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.686+0000 7fa30f53e700 1 --2- 172.21.15.78:0/2340161084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066660 0x7fa3080c5660 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.686+0000 7fa30f53e700 1 -- 172.21.15.78:0/2340161084 >> 172.21.15.78:0/2340161084 conn(0x7fa3080c7b00 msgr2=0x7fa3080c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.686+0000 7fa30f53e700 1 -- 172.21.15.78:0/2340161084 shutdown_connections 2023-08-17T18:12:44.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.686+0000 7fa30f53e700 1 -- 172.21.15.78:0/2340161084 wait complete. 2023-08-17T18:12:44.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.687+0000 7fa30f53e700 1 Processor -- start 2023-08-17T18:12:44.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.687+0000 7fa30f53e700 1 -- start start 2023-08-17T18:12:44.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30f53e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa308066660 0x7fa3080ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30f53e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066a40 0x7fa308167f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30f53e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5b50 0x7fa308155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30f53e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080acae0 con 0x7fa3080c5b50 2023-08-17T18:12:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30f53e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa308164880 con 0x7fa308066660 2023-08-17T18:12:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30f53e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa308168870 con 0x7fa308066a40 2023-08-17T18:12:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30dadb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5b50 0x7fa308155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30dadb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5b50 0x7fa308155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37910/0 (socket says 172.21.15.78:37910) 2023-08-17T18:12:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30dadb700 1 -- 172.21.15.78:0/1282653874 learned_addr learned my addr 172.21.15.78:0/1282653874 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30d2da700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa308066660 0x7fa3080ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30cad9700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066a40 0x7fa308167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30dadb700 1 -- 172.21.15.78:0/1282653874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066a40 msgr2=0x7fa308167f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30dadb700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066a40 0x7fa308167f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30dadb700 1 -- 172.21.15.78:0/1282653874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa308066660 msgr2=0x7fa3080ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30dadb700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa308066660 0x7fa3080ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.688+0000 7fa30dadb700 1 -- 172.21.15.78:0/1282653874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300009a20 con 0x7fa3080c5b50 2023-08-17T18:12:44.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.689+0000 7fa30dadb700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5b50 0x7fa308155cb0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7fa300009fc0 tx=0x7fa30000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.689+0000 7fa2fd7fa700 1 -- 172.21.15.78:0/1282653874 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000cbd0 con 0x7fa3080c5b50 2023-08-17T18:12:44.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.689+0000 7fa2fd7fa700 1 -- 172.21.15.78:0/1282653874 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000f040 con 0x7fa3080c5b50 2023-08-17T18:12:44.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.689+0000 7fa30f53e700 1 -- 172.21.15.78:0/1282653874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3040092a0 con 0x7fa3080c5b50 2023-08-17T18:12:44.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.689+0000 7fa2fd7fa700 1 -- 172.21.15.78:0/1282653874 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300013400 con 0x7fa3080c5b50 2023-08-17T18:12:44.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.689+0000 7fa30f53e700 1 -- 172.21.15.78:0/1282653874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3080acfd0 con 0x7fa3080c5b50 2023-08-17T18:12:44.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.690+0000 7fa30f53e700 1 -- 172.21.15.78:0/1282653874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa308047350 con 0x7fa3080c5b50 2023-08-17T18:12:44.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.690+0000 7fa2fd7fa700 1 -- 172.21.15.78:0/1282653874 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa3000137f0 con 0x7fa3080c5b50 2023-08-17T18:12:44.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.690+0000 7fa2fd7fa700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2ec05ed90 0x7fa2ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.690+0000 7fa2fd7fa700 1 -- 172.21.15.78:0/1282653874 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fa30007a400 con 0x7fa3080c5b50 2023-08-17T18:12:44.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.690+0000 7fa30d2da700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2ec05ed90 0x7fa2ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.691+0000 7fa30d2da700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2ec05ed90 0x7fa2ec061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa30400d260 tx=0x7fa304016000).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.694+0000 7fa2fd7fa700 1 -- 172.21.15.78:0/1282653874 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa30004bb20 con 0x7fa3080c5b50 2023-08-17T18:12:44.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.852+0000 7fa30f53e700 1 -- 172.21.15.78:0/1282653874 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3080694b0 con 0x7fa2ec05ed90 2023-08-17T18:12:44.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.855+0000 7fa2fd7fa700 1 -- 172.21.15.78:0/1282653874 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71320 (secure 0 0 0) 0x7fa3080694b0 con 0x7fa2ec05ed90 2023-08-17T18:12:44.857 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 -- 172.21.15.78:0/1282653874 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2ec05ed90 msgr2=0x7fa2ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2ec05ed90 0x7fa2ec061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa30400d260 tx=0x7fa304016000).stop 2023-08-17T18:12:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 -- 172.21.15.78:0/1282653874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5b50 msgr2=0x7fa308155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5b50 0x7fa308155cb0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7fa300009fc0 tx=0x7fa30000b040).stop 2023-08-17T18:12:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 -- 172.21.15.78:0/1282653874 shutdown_connections 2023-08-17T18:12:44.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa2ec05ed90 0x7fa2ec061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3080c5b50 0x7fa308155cb0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa308066660 0x7fa3080ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 --2- 172.21.15.78:0/1282653874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa308066a40 0x7fa308167f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 -- 172.21.15.78:0/1282653874 >> 172.21.15.78:0/1282653874 conn(0x7fa3080c7b00 msgr2=0x7fa3080c8190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:44.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 -- 172.21.15.78:0/1282653874 shutdown_connections 2023-08-17T18:12:44.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.857+0000 7fa30f53e700 1 -- 172.21.15.78:0/1282653874 wait complete. 2023-08-17T18:12:44.860 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T18:12:44.869 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-08-17T18:12:43.885643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2436288,"kb_used_data":18560,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752538432,"statfs":{"total":773094113280,"available":770599354368,"internally_reserved":0,"allocated":19005440,"data_stored":9543868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11959,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.012522"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.968942+0000","last_change":"2023-08-17T17:34:19.063202+0000","last_active":"2023-08-17T18:12:40.968942+0000","last_peered":"2023-08-17T18:12:40.968942+0000","last_clean":"2023-08-17T18:12:40.968942+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T18:12:40.968942+0000","last_undegraded":"2023-08-17T18:12:40.968942+0000","last_fullsized":"2023-08-17T18:12:40.968942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.898528+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T18:12:40.898528+0000","last_peered":"2023-08-17T18:12:40.898528+0000","last_clean":"2023-08-17T18:12:40.898528+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T18:12:40.898528+0000","last_undegraded":"2023-08-17T18:12:40.898528+0000","last_fullsized":"2023-08-17T18:12:40.898528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.965810+0000","last_change":"2023-08-17T17:34:19.804074+0000","last_active":"2023-08-17T18:12:40.965810+0000","last_peered":"2023-08-17T18:12:40.965810+0000","last_clean":"2023-08-17T18:12:40.965810+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T18:12:40.965810+0000","last_undegraded":"2023-08-17T18:12:40.965810+0000","last_fullsized":"2023-08-17T18:12:40.965810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.899701+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T18:12:40.899701+0000","last_peered":"2023-08-17T18:12:40.899701+0000","last_clean":"2023-08-17T18:12:40.899701+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T18:12:40.899701+0000","last_undegraded":"2023-08-17T18:12:40.899701+0000","last_fullsized":"2023-08-17T18:12:40.899701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.971027+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T18:12:40.971027+0000","last_peered":"2023-08-17T18:12:40.971027+0000","last_clean":"2023-08-17T18:12:40.971027+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T18:12:40.971027+0000","last_undegraded":"2023-08-17T18:12:40.971027+0000","last_fullsized":"2023-08-17T18:12:40.971027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.971108+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T18:12:40.971108+0000","last_peered":"2023-08-17T18:12:40.971108+0000","last_clean":"2023-08-17T18:12:40.971108+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T18:12:40.971108+0000","last_undegraded":"2023-08-17T18:12:40.971108+0000","last_fullsized":"2023-08-17T18:12:40.971108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.969121+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T18:12:40.969121+0000","last_peered":"2023-08-17T18:12:40.969121+0000","last_clean":"2023-08-17T18:12:40.969121+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T18:12:40.969121+0000","last_undegraded":"2023-08-17T18:12:40.969121+0000","last_fullsized":"2023-08-17T18:12:40.969121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.970816+0000","last_change":"2023-08-17T17:34:19.065828+0000","last_active":"2023-08-17T18:12:40.970816+0000","last_peered":"2023-08-17T18:12:40.970816+0000","last_clean":"2023-08-17T18:12:40.970816+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T18:12:40.970816+0000","last_undegraded":"2023-08-17T18:12:40.970816+0000","last_fullsized":"2023-08-17T18:12:40.970816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-17T18:12:37.882587+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T18:12:37.882587+0000","last_peered":"2023-08-17T18:12:37.882587+0000","last_clean":"2023-08-17T18:12:37.882587+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T18:12:37.882587+0000","last_undegraded":"2023-08-17T18:12:37.882587+0000","last_fullsized":"2023-08-17T18:12:37.882587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575302,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68600000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41699999999999998,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.76300000000000001,"15min":0.77100000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.69699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.434}]},{"osd":2,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66500000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.374,"15min":0.374},"max":{"1min":0.70399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36799999999999999},"max":{"1min":0.70999999999999996,"5min":0.78600000000000003,"15min":0.81699999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.747,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.312,"15min":0.247},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.76900000000000002},"last":0.628}]},{"osd":5,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51600000000000001,"15min":0.497},"min":{"1min":0.314,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.81699999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.86499999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.67200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575302,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068336,"statfs":{"total":96636764160,"available":96325976064,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.42199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79000000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.31900000000000001},"max":{"1min":0.71899999999999997,"5min":1.214,"15min":1.214},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.84799999999999998,"5min":1.208,"15min":1.208},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77100000000000002,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.82399999999999995,"5min":1.304,"15min":1.304},"last":0.625},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.78600000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29499999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.88700000000000001},"last":0.432},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69499999999999995,"5min":0.75700000000000001,"15min":1.0269999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.32300000000000001},"max":{"1min":0.80100000000000005,"5min":0.87,"15min":0.87},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.42299999999999999,"5min":0.372,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.97699999999999998},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575303,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.26800000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.57199999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.47199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.318},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40899999999999997},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.44},"min":{"1min":0.33800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65500000000000003,"5min":1.095,"15min":1.095},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80500000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.96199999999999997},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78600000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.48499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78500000000000003,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40300000000000002},"max":{"1min":0.82699999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.44500000000000001,"15min":0.41599999999999998},"max":{"1min":0.82299999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63300000000000001,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82599999999999996,"5min":0.872,"15min":0.91800000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.65000000000000002},"min":{"1min":0.42199999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89200000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575302,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068336,"statfs":{"total":96636764160,"available":96325976064,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34399999999999997,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.40999999999999998,"5min":0.64100000000000001,"15min":0.77600000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36499999999999999,"15min":0.38900000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.505,"5min":0.58099999999999996,"15min":0.70899999999999996},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.36899999999999999},"min":{"1min":0.249,"5min":0.214,"15min":0.214},"max":{"1min":0.40999999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"last":0.254},{"interface":"front","average":{"1min":0.37,"5min":0.39900000000000002,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.499,"5min":0.70299999999999996,"15min":0.754},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38400000000000001,"15min":0.40400000000000003},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.48399999999999999,"5min":0.59699999999999998,"15min":0.66100000000000003},"last":0.315},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.307,"5min":0.254,"15min":0.254},"max":{"1min":0.46700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.307}]},{"osd":4,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35399999999999998},"max":{"1min":0.85999999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88300000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39600000000000002},"max":{"1min":0.755,"5min":1.079,"15min":1.079},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82499999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.622}]},{"osd":7,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92000000000000004,"5min":1.0549999999999999,"15min":1.0820000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.65600000000000003,"15min":0.67900000000000005},"min":{"1min":0.497,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.78600000000000003,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575302,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068336,"statfs":{"total":96636764160,"available":96325976064,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.26500000000000001,"5min":0.221,"15min":0.21099999999999999},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.623},"last":0.246},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36799999999999999,"15min":0.36899999999999999},"min":{"1min":0.26700000000000002,"5min":0.254,"15min":0.25},"max":{"1min":0.50800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40899999999999997,"15min":0.40999999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.68100000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.72999999999999998},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.36699999999999999,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.67000000000000004},"last":0.377},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.41499999999999998},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53000000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":1.0169999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.21,"15min":1.21},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.79600000000000004,"5min":0.91000000000000003,"15min":0.94799999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.629,"15min":0.64200000000000002},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76300000000000001,"5min":1.254,"15min":1.254},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58899999999999997,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80100000000000005,"5min":0.89900000000000002,"15min":0.96099999999999997},"last":0.497},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.97999999999999998},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.42099999999999999},"max":{"1min":0.78500000000000003,"5min":1.234,"15min":1.234},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.625,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.93500000000000005,"15min":1.0469999999999999},"last":0.52400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575302,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307600,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064240,"statfs":{"total":96636764160,"available":96321781760,"internally_reserved":0,"allocated":2367488,"data_stored":1189614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.217},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.38600000000000001},"min":{"1min":0.23100000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.61299999999999999},"last":0.308}]},{"osd":1,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.373,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52000000000000002,"5min":0.59399999999999997,"15min":0.72299999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63400000000000001},"last":0.373}]},{"osd":2,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.68899999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63300000000000001,"5min":0.66700000000000004,"15min":0.70699999999999996},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.44900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71099999999999997,"5min":0.87,"15min":0.95499999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.93100000000000005},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.40300000000000002,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.64000000000000001},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80100000000000005,"5min":0.89100000000000001,"15min":0.90700000000000003},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.92800000000000005,"15min":0.94399999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.77800000000000002,"5min":0.93200000000000005,"15min":0.94899999999999995},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42199999999999999},"max":{"1min":0.78700000000000003,"5min":0.96599999999999997,"15min":0.97099999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.502,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":0.83699999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575303,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.30499999999999999},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79400000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.315},"max":{"1min":0.755,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.746,"5min":0.76300000000000001,"15min":0.79400000000000004},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.81399999999999995,"15min":0.83799999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78400000000000003,"5min":0.79300000000000004,"15min":0.81999999999999995},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83999999999999997,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.47599999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81000000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.35999999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69999999999999996,"5min":0.75,"15min":0.79700000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32700000000000001,"15min":0.28799999999999998},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34399999999999997,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.86299999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.502}]},{"osd":7,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84999999999999998,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89700000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.54400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575301,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307616,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064224,"statfs":{"total":96636764160,"available":96321765376,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.80300000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.755,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.378,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68100000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78600000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79900000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.82899999999999996,"15min":0.86399999999999999},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.71599999999999997},"last":0.629},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.307,"15min":0.29899999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.85299999999999998,"5min":0.873,"15min":0.873},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T18:12:44.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T18:12:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.984+0000 7f48425f1700 1 Processor -- start 2023-08-17T18:12:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.984+0000 7f48425f1700 1 -- start start 2023-08-17T18:12:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f48425f1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f483c13a640 0x7f483c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f48425f1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f483c069760 0x7f483c0c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f48425f1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483c0c2c10 con 0x7f483c06a2c0 2023-08-17T18:12:44.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f48425f1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483c155010 con 0x7f483c069760 2023-08-17T18:12:44.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f48425f1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483c1552e0 con 0x7f483c13a640 2023-08-17T18:12:44.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f4840b8e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f483c069760 0x7f483c0c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f4840b8e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f483c069760 0x7f483c0c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37916/0 (socket says 172.21.15.78:37916) 2023-08-17T18:12:44.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f4840b8e700 1 -- 172.21.15.78:0/3094631009 learned_addr learned my addr 172.21.15.78:0/3094631009 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:44.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f483bfff700 1 --2- 172.21.15.78:0/3094631009 >> v2:172.21.15.150:3300/0 conn(0x7f483c13a640 0x7f483c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f4840b8e700 1 -- 172.21.15.78:0/3094631009 >> v2:172.21.15.150:3300/0 conn(0x7f483c13a640 msgr2=0x7f483c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:44.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f4840b8e700 1 --2- 172.21.15.78:0/3094631009 >> v2:172.21.15.150:3300/0 conn(0x7f483c13a640 0x7f483c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f4840b8e700 1 -- 172.21.15.78:0/3094631009 >> v1:172.21.15.150:6789/0 conn(0x7f483c06a2c0 legacy=0x7f483c069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f4840b8e700 1 -- 172.21.15.78:0/3094631009 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c1555c0 con 0x7f483c069760 2023-08-17T18:12:44.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f4840b8e700 1 --2- 172.21.15.78:0/3094631009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c069760 0x7f483c0c33b0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f483c068550 tx=0x7f483400ba50).ready entity=mon.0 client_cookie=2c49581dd54b8366 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f483affd700 1 -- 172.21.15.78:0/3094631009 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834010070 con 0x7f483c069760 2023-08-17T18:12:44.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f483affd700 1 -- 172.21.15.78:0/3094631009 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483400de90 con 0x7f483c069760 2023-08-17T18:12:44.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.985+0000 7f483affd700 1 -- 172.21.15.78:0/3094631009 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483400b2e0 con 0x7f483c069760 2023-08-17T18:12:44.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.986+0000 7f48425f1700 1 -- 172.21.15.78:0/3094631009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c069760 msgr2=0x7f483c0c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.986+0000 7f48425f1700 1 --2- 172.21.15.78:0/3094631009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c069760 0x7f483c0c33b0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f483c068550 tx=0x7f483400ba50).stop 2023-08-17T18:12:44.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.986+0000 7f48425f1700 1 -- 172.21.15.78:0/3094631009 shutdown_connections 2023-08-17T18:12:44.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.986+0000 7f48425f1700 1 --2- 172.21.15.78:0/3094631009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c069760 0x7f483c0c33b0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.986+0000 7f48425f1700 1 --2- 172.21.15.78:0/3094631009 >> v2:172.21.15.150:3300/0 conn(0x7f483c13a640 0x7f483c154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.986+0000 7f48425f1700 1 -- 172.21.15.78:0/3094631009 >> 172.21.15.78:0/3094631009 conn(0x7f483c0c7b00 msgr2=0x7f483c0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:44.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.986+0000 7f48425f1700 1 -- 172.21.15.78:0/3094631009 shutdown_connections 2023-08-17T18:12:44.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.986+0000 7f48425f1700 1 -- 172.21.15.78:0/3094631009 wait complete. 2023-08-17T18:12:44.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.987+0000 7f48425f1700 1 Processor -- start 2023-08-17T18:12:44.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.987+0000 7f48425f1700 1 -- start start 2023-08-17T18:12:44.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f48425f1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f483c069760 0x7f483c1362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f48425f1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f483c06a2c0 0x7f483c0a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f48425f1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c13a640 0x7f483c065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f48425f1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0c32b0 con 0x7f483c13a640 2023-08-17T18:12:44.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f48425f1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0c3b50 con 0x7f483c06a2c0 2023-08-17T18:12:44.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f48425f1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0a6f40 con 0x7f483c069760 2023-08-17T18:12:44.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f4840b8e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c13a640 0x7f483c065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f4840b8e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c13a640 0x7f483c065d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37932/0 (socket says 172.21.15.78:37932) 2023-08-17T18:12:44.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f4840b8e700 1 -- 172.21.15.78:0/2831515668 learned_addr learned my addr 172.21.15.78:0/2831515668 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:44.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f483bfff700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f483c069760 0x7f483c1362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f483b7fe700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f483c06a2c0 0x7f483c0a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f4840b8e700 1 -- 172.21.15.78:0/2831515668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f483c069760 msgr2=0x7f483c1362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f4840b8e700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f483c069760 0x7f483c1362d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.988+0000 7f4840b8e700 1 -- 172.21.15.78:0/2831515668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f483c06a2c0 msgr2=0x7f483c0a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:44.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.989+0000 7f4840b8e700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f483c06a2c0 0x7f483c0a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:44.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.989+0000 7f4840b8e700 1 -- 172.21.15.78:0/2831515668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483400bcf0 con 0x7f483c13a640 2023-08-17T18:12:44.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.989+0000 7f4840b8e700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c13a640 0x7f483c065d10 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f483c046c70 tx=0x7f483400ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.989+0000 7f4823fff700 1 -- 172.21.15.78:0/2831515668 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483400b1a0 con 0x7f483c13a640 2023-08-17T18:12:44.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.989+0000 7f4823fff700 1 -- 172.21.15.78:0/2831515668 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483400b300 con 0x7f483c13a640 2023-08-17T18:12:44.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.989+0000 7f48425f1700 1 -- 172.21.15.78:0/2831515668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c0c3500 con 0x7f483c13a640 2023-08-17T18:12:44.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.989+0000 7f4823fff700 1 -- 172.21.15.78:0/2831515668 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483401e660 con 0x7f483c13a640 2023-08-17T18:12:44.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.989+0000 7f48425f1700 1 -- 172.21.15.78:0/2831515668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c0c3fe0 con 0x7f483c13a640 2023-08-17T18:12:44.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.990+0000 7f48425f1700 1 -- 172.21.15.78:0/2831515668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c0c3cc0 con 0x7f483c13a640 2023-08-17T18:12:44.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.990+0000 7f4823fff700 1 -- 172.21.15.78:0/2831515668 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4834025030 con 0x7f483c13a640 2023-08-17T18:12:44.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.990+0000 7f4823fff700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f482805ed90 0x7f4828061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:44.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.991+0000 7f483bfff700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f482805ed90 0x7f4828061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:44.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.991+0000 7f4823fff700 1 -- 172.21.15.78:0/2831515668 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f483407af80 con 0x7f483c13a640 2023-08-17T18:12:44.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.991+0000 7f483bfff700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f482805ed90 0x7f4828061250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f483c167a60 tx=0x7f482c008040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:44.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:44.995+0000 7f4823fff700 1 -- 172.21.15.78:0/2831515668 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f483404c6a0 con 0x7f483c13a640 2023-08-17T18:12:45.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.156+0000 7f48425f1700 1 -- 172.21.15.78:0/2831515668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f483c047350 con 0x7f483c13a640 2023-08-17T18:12:45.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.157+0000 7f4823fff700 1 -- 172.21.15.78:0/2831515668 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+14455 (secure 0 0 0) 0x7f4834023030 con 0x7f483c13a640 2023-08-17T18:12:45.158 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:45.158 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":190,"fsid":"c71a8d58-9c80-42ad-9365-61f3329fa340","created":"2023-08-17T17:34:06.317933+0000","modified":"2023-08-17T18:12:41.895383+0000","last_up_change":"2023-08-17T17:34:15.024728+0000","last_in_change":"2023-08-17T17:34:08.741737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T17:34:15.061543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T17:34:17.465105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"42c2b385-06e5-4d89-97bd-8c3dccec45d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":119685},{"type":"v1","addr":"172.21.15.78:6801","nonce":119685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":119685},{"type":"v1","addr":"172.21.15.78:6803","nonce":119685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":119685},{"type":"v1","addr":"172.21.15.78:6807","nonce":119685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":119685},{"type":"v1","addr":"172.21.15.78:6805","nonce":119685}]},"public_addr":"172.21.15.78:6801/119685","cluster_addr":"172.21.15.78:6803/119685","heartbeat_back_addr":"172.21.15.78:6807/119685","heartbeat_front_addr":"172.21.15.78:6805/119685","state":["exists","up"]},{"osd":1,"uuid":"4ac7311a-0a2a-4db4-b60e-0b6158830160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":119710},{"type":"v1","addr":"172.21.15.78:6817","nonce":119710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":119710},{"type":"v1","addr":"172.21.15.78:6819","nonce":119710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":119710},{"type":"v1","addr":"172.21.15.78:6823","nonce":119710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":119710},{"type":"v1","addr":"172.21.15.78:6821","nonce":119710}]},"public_addr":"172.21.15.78:6817/119710","cluster_addr":"172.21.15.78:6819/119710","heartbeat_back_addr":"172.21.15.78:6823/119710","heartbeat_front_addr":"172.21.15.78:6821/119710","state":["exists","up"]},{"osd":2,"uuid":"2a1affbb-4a49-4cb8-8b99-b250458ee6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":119693},{"type":"v1","addr":"172.21.15.78:6809","nonce":119693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":119693},{"type":"v1","addr":"172.21.15.78:6811","nonce":119693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":119693},{"type":"v1","addr":"172.21.15.78:6815","nonce":119693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":119693},{"type":"v1","addr":"172.21.15.78:6813","nonce":119693}]},"public_addr":"172.21.15.78:6809/119693","cluster_addr":"172.21.15.78:6811/119693","heartbeat_back_addr":"172.21.15.78:6815/119693","heartbeat_front_addr":"172.21.15.78:6813/119693","state":["exists","up"]},{"osd":3,"uuid":"0cf5f55a-5d37-4964-97db-0a93a0aa12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":119728},{"type":"v1","addr":"172.21.15.78:6825","nonce":119728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":119728},{"type":"v1","addr":"172.21.15.78:6827","nonce":119728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":119728},{"type":"v1","addr":"172.21.15.78:6831","nonce":119728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":119728},{"type":"v1","addr":"172.21.15.78:6829","nonce":119728}]},"public_addr":"172.21.15.78:6825/119728","cluster_addr":"172.21.15.78:6827/119728","heartbeat_back_addr":"172.21.15.78:6831/119728","heartbeat_front_addr":"172.21.15.78:6829/119728","state":["exists","up"]},{"osd":4,"uuid":"c7a4f57f-b4d3-4269-817e-b37ec5fe07eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":90933},{"type":"v1","addr":"172.21.15.150:6809","nonce":90933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":90933},{"type":"v1","addr":"172.21.15.150:6811","nonce":90933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":90933},{"type":"v1","addr":"172.21.15.150:6815","nonce":90933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":90933},{"type":"v1","addr":"172.21.15.150:6813","nonce":90933}]},"public_addr":"172.21.15.150:6809/90933","cluster_addr":"172.21.15.150:6811/90933","heartbeat_back_addr":"172.21.15.150:6815/90933","heartbeat_front_addr":"172.21.15.150:6813/90933","state":["exists","up"]},{"osd":5,"uuid":"a6a24c9a-ea70-4685-90bc-2f4c8c05e248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":90972},{"type":"v1","addr":"172.21.15.150:6825","nonce":90972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":90972},{"type":"v1","addr":"172.21.15.150:6827","nonce":90972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":90972},{"type":"v1","addr":"172.21.15.150:6831","nonce":90972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":90972},{"type":"v1","addr":"172.21.15.150:6829","nonce":90972}]},"public_addr":"172.21.15.150:6825/90972","cluster_addr":"172.21.15.150:6827/90972","heartbeat_back_addr":"172.21.15.150:6831/90972","heartbeat_front_addr":"172.21.15.150:6829/90972","state":["exists","up"]},{"osd":6,"uuid":"6c04079f-c4fe-4202-85a6-ca205083bdb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":90934},{"type":"v1","addr":"172.21.15.150:6801","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":90934},{"type":"v1","addr":"172.21.15.150:6803","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":90934},{"type":"v1","addr":"172.21.15.150:6807","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":90934},{"type":"v1","addr":"172.21.15.150:6805","nonce":90934}]},"public_addr":"172.21.15.150:6801/90934","cluster_addr":"172.21.15.150:6803/90934","heartbeat_back_addr":"172.21.15.150:6807/90934","heartbeat_front_addr":"172.21.15.150:6805/90934","state":["exists","up"]},{"osd":7,"uuid":"2718c194-480c-47c9-8b27-4880105bce34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":90935},{"type":"v1","addr":"172.21.15.150:6817","nonce":90935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":90935},{"type":"v1","addr":"172.21.15.150:6819","nonce":90935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":90935},{"type":"v1","addr":"172.21.15.150:6823","nonce":90935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":90935},{"type":"v1","addr":"172.21.15.150:6821","nonce":90935}]},"public_addr":"172.21.15.150:6817/90935","cluster_addr":"172.21.15.150:6819/90935","heartbeat_back_addr":"172.21.15.150:6823/90935","heartbeat_front_addr":"172.21.15.150:6821/90935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.889769+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.932417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.893633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.881798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.921337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.918244+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.871473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T17:34:13.927928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/1487845098":"2023-08-18T18:12:37.868296+0000","172.21.15.78:0/3820557982":"2023-08-18T18:12:37.868296+0000","172.21.15.78:0/977567379":"2023-08-18T18:12:37.868296+0000","172.21.15.78:0/1323508470":"2023-08-18T18:12:37.868296+0000","172.21.15.150:6835/2525491694":"2023-08-18T18:12:37.685436+0000","172.21.15.150:6833/2525491694":"2023-08-18T18:12:37.685436+0000","172.21.15.78:0/267357351":"2023-08-18T18:12:37.868296+0000","172.21.15.78:6833/158925":"2023-08-18T18:12:30.406163+0000","172.21.15.78:6832/158925":"2023-08-18T18:12:30.406163+0000","172.21.15.78:0/831867818":"2023-08-18T18:12:30.406163+0000","172.21.15.78:0/2706117257":"2023-08-18T18:12:30.406163+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T18:12:45.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.158+0000 7f48425f1700 1 -- 172.21.15.78:0/2831515668 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f482805ed90 msgr2=0x7f4828061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:45.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.158+0000 7f48425f1700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f482805ed90 0x7f4828061250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f483c167a60 tx=0x7f482c008040).stop 2023-08-17T18:12:45.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.158+0000 7f48425f1700 1 -- 172.21.15.78:0/2831515668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c13a640 msgr2=0x7f483c065d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:45.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.158+0000 7f48425f1700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c13a640 0x7f483c065d10 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f483c046c70 tx=0x7f483400ba50).stop 2023-08-17T18:12:45.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.159+0000 7f48425f1700 1 -- 172.21.15.78:0/2831515668 shutdown_connections 2023-08-17T18:12:45.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.159+0000 7f48425f1700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f482805ed90 0x7f4828061250 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:45.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.159+0000 7f48425f1700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f483c13a640 0x7f483c065d10 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:45.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.159+0000 7f48425f1700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f483c069760 0x7f483c1362d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:45.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.159+0000 7f48425f1700 1 --2- 172.21.15.78:0/2831515668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f483c06a2c0 0x7f483c0a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:45.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.159+0000 7f48425f1700 1 -- 172.21.15.78:0/2831515668 >> 172.21.15.78:0/2831515668 conn(0x7f483c0c7b00 msgr2=0x7f483c0bd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:45.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.159+0000 7f48425f1700 1 -- 172.21.15.78:0/2831515668 shutdown_connections 2023-08-17T18:12:45.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:45.159+0000 7f48425f1700 1 -- 172.21.15.78:0/2831515668 wait complete. 2023-08-17T18:12:46.172 INFO:tasks.ceph:Scrubbing osd.0 2023-08-17T18:12:46.173 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-17T18:12:46.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.294+0000 7faee4a2d700 1 Processor -- start 2023-08-17T18:12:46.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.294+0000 7faee4a2d700 1 -- start start 2023-08-17T18:12:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.294+0000 7faee4a2d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faee0151a40 0x7faee00c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.294+0000 7faee4a2d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee0151e20 0x7faee00c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.294+0000 7faee4a2d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faee0157be0 0x7faee0158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.294+0000 7faee4a2d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee0158560 con 0x7faee0151a40 2023-08-17T18:12:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.294+0000 7faee4a2d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee00c6620 con 0x7faee0157be0 2023-08-17T18:12:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.294+0000 7faee4a2d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee00c6900 con 0x7faee0151e20 2023-08-17T18:12:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeded9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faee0151a40 0x7faee00c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeded9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faee0151a40 0x7faee00c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37936/0 (socket says 172.21.15.78:37936) 2023-08-17T18:12:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeded9d700 1 -- 172.21.15.78:0/81798362 learned_addr learned my addr 172.21.15.78:0/81798362 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faedf59e700 1 --2- 172.21.15.78:0/81798362 >> v2:172.21.15.150:3300/0 conn(0x7faee0157be0 0x7faee0158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faede59c700 1 --2- 172.21.15.78:0/81798362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee0151e20 0x7faee00c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeded9d700 1 -- 172.21.15.78:0/81798362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee0151e20 msgr2=0x7faee00c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:46.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeded9d700 1 --2- 172.21.15.78:0/81798362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee0151e20 0x7faee00c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeded9d700 1 -- 172.21.15.78:0/81798362 >> v2:172.21.15.150:3300/0 conn(0x7faee0157be0 msgr2=0x7faee0158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:46.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeded9d700 1 --2- 172.21.15.78:0/81798362 >> v2:172.21.15.150:3300/0 conn(0x7faee0157be0 0x7faee0158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeded9d700 1 -- 172.21.15.78:0/81798362 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00c6be0 con 0x7faee0151a40 2023-08-17T18:12:46.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeded9d700 1 --2- 172.21.15.78:0/81798362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee0151a40 0x7faee00c8260 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7faee0158be0 tx=0x7faed0009060).ready entity=mon.0 client_cookie=87b028d05dd092d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeddd9b700 1 -- 172.21.15.78:0/81798362 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0005880 con 0x7faee0151a40 2023-08-17T18:12:46.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeddd9b700 1 -- 172.21.15.78:0/81798362 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed00059e0 con 0x7faee0151a40 2023-08-17T18:12:46.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.295+0000 7faeddd9b700 1 -- 172.21.15.78:0/81798362 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0005d60 con 0x7faee0151a40 2023-08-17T18:12:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.296+0000 7faee4a2d700 1 -- 172.21.15.78:0/81798362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee0151a40 msgr2=0x7faee00c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.296+0000 7faee4a2d700 1 --2- 172.21.15.78:0/81798362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee0151a40 0x7faee00c8260 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7faee0158be0 tx=0x7faed0009060).stop 2023-08-17T18:12:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.296+0000 7faee4a2d700 1 -- 172.21.15.78:0/81798362 shutdown_connections 2023-08-17T18:12:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.296+0000 7faee4a2d700 1 --2- 172.21.15.78:0/81798362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee0151a40 0x7faee00c8260 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.296+0000 7faee4a2d700 1 --2- 172.21.15.78:0/81798362 >> v2:172.21.15.150:3300/0 conn(0x7faee0157be0 0x7faee0158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.296+0000 7faee4a2d700 1 --2- 172.21.15.78:0/81798362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee0151e20 0x7faee00c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.296+0000 7faee4a2d700 1 -- 172.21.15.78:0/81798362 >> 172.21.15.78:0/81798362 conn(0x7faee00943b0 msgr2=0x7faee006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.296+0000 7faee4a2d700 1 -- 172.21.15.78:0/81798362 shutdown_connections 2023-08-17T18:12:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.296+0000 7faee4a2d700 1 -- 172.21.15.78:0/81798362 wait complete. 2023-08-17T18:12:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.297+0000 7faee4a2d700 1 Processor -- start 2023-08-17T18:12:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.297+0000 7faee4a2d700 1 -- start start 2023-08-17T18:12:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faee4a2d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee0151a40 0x7faee00ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faee4a2d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faee0151e20 0x7faee00c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faee4a2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee0157be0 0x7faee014bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faee4a2d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00ac860 con 0x7faee0157be0 2023-08-17T18:12:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faee4a2d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00ade50 con 0x7faee0151e20 2023-08-17T18:12:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faee4a2d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee014cbc0 con 0x7faee0151a40 2023-08-17T18:12:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faedf59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee0157be0 0x7faee014bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faedf59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee0157be0 0x7faee014bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37942/0 (socket says 172.21.15.78:37942) 2023-08-17T18:12:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faedf59e700 1 -- 172.21.15.78:0/4023499729 learned_addr learned my addr 172.21.15.78:0/4023499729 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faeded9d700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee0151a40 0x7faee00ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faede59c700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faee0151e20 0x7faee00c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faedf59e700 1 -- 172.21.15.78:0/4023499729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee0151a40 msgr2=0x7faee00ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faedf59e700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee0151a40 0x7faee00ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faedf59e700 1 -- 172.21.15.78:0/4023499729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faee0151e20 msgr2=0x7faee00c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faedf59e700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faee0151e20 0x7faee00c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faedf59e700 1 -- 172.21.15.78:0/4023499729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0009300 con 0x7faee0157be0 2023-08-17T18:12:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.298+0000 7faedf59e700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee0157be0 0x7faee014bb90 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7faed8007f20 tx=0x7faed8009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.299+0000 7faec6ffd700 1 -- 172.21.15.78:0/4023499729 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800eb90 con 0x7faee0157be0 2023-08-17T18:12:46.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.299+0000 7faec6ffd700 1 -- 172.21.15.78:0/4023499729 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed800ecf0 con 0x7faee0157be0 2023-08-17T18:12:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.299+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee00abfc0 con 0x7faee0157be0 2023-08-17T18:12:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.299+0000 7faec6ffd700 1 -- 172.21.15.78:0/4023499729 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8014610 con 0x7faee0157be0 2023-08-17T18:12:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.299+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee00ac580 con 0x7faee0157be0 2023-08-17T18:12:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.299+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faee0082f90 con 0x7faee0157be0 2023-08-17T18:12:46.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.300+0000 7faec6ffd700 1 -- 172.21.15.78:0/4023499729 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faed801b030 con 0x7faee0157be0 2023-08-17T18:12:46.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.300+0000 7faec6ffd700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faecc05ed90 0x7faecc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.300+0000 7faec6ffd700 1 -- 172.21.15.78:0/4023499729 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7faed8079c10 con 0x7faee0157be0 2023-08-17T18:12:46.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.300+0000 7faeded9d700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faecc05ed90 0x7faecc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.300+0000 7faec6ffd700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] conn(0x7faecc065670 0x7faecc067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.300+0000 7faec6ffd700 1 -- 172.21.15.78:0/4023499729 --> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faecc068150 con 0x7faecc065670 2023-08-17T18:12:46.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.300+0000 7faec6ffd700 1 -- 172.21.15.78:0/4023499729 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) v2 ==== 24+0+0 (secure 0 0 0) 0x7faed807f070 con 0x7faee0157be0 2023-08-17T18:12:46.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.300+0000 7faede59c700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] conn(0x7faecc065670 0x7faecc067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.301+0000 7faeded9d700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faecc05ed90 0x7faecc061250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7faed000b3c0 tx=0x7faed0016000).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.301+0000 7faede59c700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] conn(0x7faecc065670 0x7faecc067ad0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.301+0000 7faec6ffd700 1 -- 172.21.15.78:0/4023499729 <== osd.0 v2:172.21.15.78:6800/119685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7faecc068150 con 0x7faecc065670 2023-08-17T18:12:46.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.314+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 --> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faee00adfc0 con 0x7faecc065670 2023-08-17T18:12:46.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faec6ffd700 1 -- 172.21.15.78:0/4023499729 <== osd.0 v2:172.21.15.78:6800/119685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7faee00adfc0 con 0x7faecc065670 2023-08-17T18:12:46.316 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:12:46.316 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T18:12:46.316 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:12:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] conn(0x7faecc065670 msgr2=0x7faecc067ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faee4a2d700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:6800/119685,v1:172.21.15.78:6801/119685] conn(0x7faecc065670 0x7faecc067ad0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faecc05ed90 msgr2=0x7faecc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faee4a2d700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7faecc05ed90 0x7faecc061250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7faed000b3c0 tx=0x7faed0016000).stop 2023-08-17T18:12:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee0157be0 msgr2=0x7faee014bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faee4a2d700 1 --2- 172.21.15.78:0/4023499729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee0157be0 0x7faee014bb90 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7faed8007f20 tx=0x7faed8009860).stop 2023-08-17T18:12:46.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faedf59e700 1 -- 172.21.15.78:0/4023499729 reap_dead start 2023-08-17T18:12:46.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 shutdown_connections 2023-08-17T18:12:46.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 >> 172.21.15.78:0/4023499729 conn(0x7faee00943b0 msgr2=0x7faee00c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:46.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 shutdown_connections 2023-08-17T18:12:46.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.315+0000 7faee4a2d700 1 -- 172.21.15.78:0/4023499729 wait complete. 2023-08-17T18:12:46.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-17T18:12:46.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.439+0000 7fb8a0658700 1 Processor -- start 2023-08-17T18:12:46.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.439+0000 7fb8a0658700 1 -- start start 2023-08-17T18:12:46.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.440+0000 7fb8a0658700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8980c10a0 0x7fb898150810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.440+0000 7fb8a0658700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb898069540 con 0x7fb8980690b0 2023-08-17T18:12:46.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.440+0000 7fb8a0658700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8980c5770 con 0x7fb898150430 2023-08-17T18:12:46.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.440+0000 7fb8a0658700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb898069780 con 0x7fb8980c10a0 2023-08-17T18:12:46.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.440+0000 7fb89ebf5700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb8980690b0 0x7fb8980c1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37166/0 (socket says 172.21.15.78:37166) 2023-08-17T18:12:46.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.440+0000 7fb89ebf5700 1 -- 172.21.15.78:0/832220419 learned_addr learned my addr 172.21.15.78:0/832220419 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:46.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.440+0000 7fb89dbf3700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8980c10a0 0x7fb898150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.440+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281417151 0 0) 0x7fb890001110 con 0x7fb8980690b0 2023-08-17T18:12:46.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.440+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8840033f0 con 0x7fb8980690b0 2023-08-17T18:12:46.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2181105019 0 0) 0x7fb8840033f0 con 0x7fb8980690b0 2023-08-17T18:12:46.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8980c10a0 msgr2=0x7fb898150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:46.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8980c10a0 0x7fb898150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 >> v1:172.21.15.150:6789/0 conn(0x7fb898150430 legacy=0x7fb898064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8980c5120 con 0x7fb8980690b0 2023-08-17T18:12:46.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7fb890001600 con 0x7fb8980690b0 2023-08-17T18:12:46.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 >> v1:172.21.15.78:6789/0 conn(0x7fb8980690b0 legacy=0x7fb8980c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8980c10a0 0x7fb884003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb884003e40 0x7fb884004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 0x7fb884005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb898069780 con 0x7fb884004b80 2023-08-17T18:12:46.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88400b990 con 0x7fb884003e40 2023-08-17T18:12:46.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88400bb50 con 0x7fb8980c10a0 2023-08-17T18:12:46.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89ebf5700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 0x7fb884005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89dbf3700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb884003e40 0x7fb884004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89e3f4700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8980c10a0 0x7fb884003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89ebf5700 1 -- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8980c10a0 msgr2=0x7fb884003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:46.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89ebf5700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8980c10a0 0x7fb884003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89ebf5700 1 -- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb884003e40 msgr2=0x7fb884004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:46.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89ebf5700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb884003e40 0x7fb884004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89ebf5700 1 -- 172.21.15.78:0/832220419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8840033f0 con 0x7fb884004b80 2023-08-17T18:12:46.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89ebf5700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 0x7fb884005000 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7fb89000c390 tx=0x7fb8900078d0).ready entity=mon.0 client_cookie=85ffe24facc86e79 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.441+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89000cc60 con 0x7fb884004b80 2023-08-17T18:12:46.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.442+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89000cdc0 con 0x7fb884004b80 2023-08-17T18:12:46.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.442+0000 7fb89d3f2700 1 -- 172.21.15.78:0/832220419 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8900072e0 con 0x7fb884004b80 2023-08-17T18:12:46.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.442+0000 7fb8a0658700 1 -- 172.21.15.78:0/832220419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 msgr2=0x7fb884005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.442+0000 7fb8a0658700 1 --2- 172.21.15.78:0/832220419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 0x7fb884005000 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7fb89000c390 tx=0x7fb8900078d0).stop 2023-08-17T18:12:46.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.442+0000 7fb89ebf5700 1 -- 172.21.15.78:0/832220419 reap_dead start 2023-08-17T18:12:46.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.442+0000 7fb8a0658700 1 -- 172.21.15.78:0/832220419 shutdown_connections 2023-08-17T18:12:46.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.442+0000 7fb8a0658700 1 -- 172.21.15.78:0/832220419 >> 172.21.15.78:0/832220419 conn(0x7fb8980c7520 msgr2=0x7fb8980c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:46.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.442+0000 7fb8a0658700 1 -- 172.21.15.78:0/832220419 shutdown_connections 2023-08-17T18:12:46.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.442+0000 7fb8a0658700 1 -- 172.21.15.78:0/832220419 wait complete. 2023-08-17T18:12:46.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.443+0000 7fb8a0658700 1 Processor -- start 2023-08-17T18:12:46.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.443+0000 7fb8a0658700 1 -- start start 2023-08-17T18:12:46.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb8a0658700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 0x7fb898149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb8a0658700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8980bf4e0 0x7fb89814d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb8a0658700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb89814de90 0x7fb8980bc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb8a0658700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980bdb40 con 0x7fb884004b80 2023-08-17T18:12:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb8a0658700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb898168400 con 0x7fb8980bf4e0 2023-08-17T18:12:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb8a0658700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8981686e0 con 0x7fb89814de90 2023-08-17T18:12:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89e3f4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 0x7fb898149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89e3f4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 0x7fb898149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37958/0 (socket says 172.21.15.78:37958) 2023-08-17T18:12:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89e3f4700 1 -- 172.21.15.78:0/75876299 learned_addr learned my addr 172.21.15.78:0/75876299 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89dbf3700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8980bf4e0 0x7fb89814d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89ebf5700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb89814de90 0x7fb8980bc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89e3f4700 1 -- 172.21.15.78:0/75876299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb89814de90 msgr2=0x7fb8980bc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89e3f4700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb89814de90 0x7fb8980bc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89e3f4700 1 -- 172.21.15.78:0/75876299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8980bf4e0 msgr2=0x7fb89814d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89e3f4700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8980bf4e0 0x7fb89814d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89e3f4700 1 -- 172.21.15.78:0/75876299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8981689c0 con 0x7fb884004b80 2023-08-17T18:12:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.444+0000 7fb89dbf3700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8980bf4e0 0x7fb89814d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.445+0000 7fb89e3f4700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 0x7fb898149f30 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7fb89400e970 tx=0x7fb894007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.445+0000 7fb88e7fc700 1 -- 172.21.15.78:0/75876299 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894017070 con 0x7fb884004b80 2023-08-17T18:12:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.445+0000 7fb88e7fc700 1 -- 172.21.15.78:0/75876299 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894001830 con 0x7fb884004b80 2023-08-17T18:12:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.445+0000 7fb8a0658700 1 -- 172.21.15.78:0/75876299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb898168ca0 con 0x7fb884004b80 2023-08-17T18:12:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.445+0000 7fb88e7fc700 1 -- 172.21.15.78:0/75876299 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894001bb0 con 0x7fb884004b80 2023-08-17T18:12:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.445+0000 7fb8a0658700 1 -- 172.21.15.78:0/75876299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89814f800 con 0x7fb884004b80 2023-08-17T18:12:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.446+0000 7fb8a0658700 1 -- 172.21.15.78:0/75876299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8980bdde0 con 0x7fb884004b80 2023-08-17T18:12:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.446+0000 7fb88e7fc700 1 -- 172.21.15.78:0/75876299 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb89400c7e0 con 0x7fb884004b80 2023-08-17T18:12:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.446+0000 7fb88e7fc700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb87c05ed90 0x7fb87c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.447+0000 7fb89dbf3700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb87c05ed90 0x7fb87c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.447+0000 7fb88e7fc700 1 -- 172.21.15.78:0/75876299 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fb894079a10 con 0x7fb884004b80 2023-08-17T18:12:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.447+0000 7fb89dbf3700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb87c05ed90 0x7fb87c061250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb888006d30 tx=0x7fb888008040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.451+0000 7fb88e7fc700 1 -- 172.21.15.78:0/75876299 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb89404b130 con 0x7fb884004b80 2023-08-17T18:12:46.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.615+0000 7fb8a0658700 1 -- 172.21.15.78:0/75876299 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb898168e90 con 0x7fb87c05ed90 2023-08-17T18:12:46.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.616+0000 7fb88e7fc700 1 -- 172.21.15.78:0/75876299 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb898168e90 con 0x7fb87c05ed90 2023-08-17T18:12:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.617+0000 7fb8a0658700 1 -- 172.21.15.78:0/75876299 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb87c05ed90 msgr2=0x7fb87c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.617+0000 7fb8a0658700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb87c05ed90 0x7fb87c061250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb888006d30 tx=0x7fb888008040).stop 2023-08-17T18:12:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.618+0000 7fb8a0658700 1 -- 172.21.15.78:0/75876299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 msgr2=0x7fb898149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.618+0000 7fb8a0658700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 0x7fb898149f30 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7fb89400e970 tx=0x7fb894007f30).stop 2023-08-17T18:12:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.618+0000 7fb8a0658700 1 -- 172.21.15.78:0/75876299 shutdown_connections 2023-08-17T18:12:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.618+0000 7fb8a0658700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fb87c05ed90 0x7fb87c061250 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.618+0000 7fb8a0658700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb89814de90 0x7fb8980bc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.618+0000 7fb8a0658700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb884004b80 0x7fb898149f30 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.618+0000 7fb8a0658700 1 --2- 172.21.15.78:0/75876299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8980bf4e0 0x7fb89814d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.618+0000 7fb8a0658700 1 -- 172.21.15.78:0/75876299 >> 172.21.15.78:0/75876299 conn(0x7fb8980c7520 msgr2=0x7fb8980624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.618+0000 7fb8a0658700 1 -- 172.21.15.78:0/75876299 shutdown_connections 2023-08-17T18:12:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.618+0000 7fb8a0658700 1 -- 172.21.15.78:0/75876299 wait complete. 2023-08-17T18:12:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2023-08-17T18:12:46.630 INFO:tasks.ceph:Scrubbing osd.1 2023-08-17T18:12:46.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-17T18:12:46.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.745+0000 7fe994875700 1 Processor -- start 2023-08-17T18:12:46.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.745+0000 7fe994875700 1 -- start start 2023-08-17T18:12:46.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.746+0000 7fe994875700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9900bf0e0 0x7fe9900be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.746+0000 7fe994875700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9900c3e10 con 0x7fe990096520 2023-08-17T18:12:46.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.746+0000 7fe994875700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9900c34e0 con 0x7fe9901578f0 2023-08-17T18:12:46.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.746+0000 7fe994875700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9900bf5c0 con 0x7fe9900bf0e0 2023-08-17T18:12:46.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.747+0000 7fe98ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9900bf0e0 0x7fe9900be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.747+0000 7fe98ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9900bf0e0 0x7fe9900be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37968/0 (socket says 172.21.15.78:37968) 2023-08-17T18:12:46.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.747+0000 7fe98ed9d700 1 -- 172.21.15.78:0/300893075 learned_addr learned my addr 172.21.15.78:0/300893075 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:46.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.747+0000 7fe98ed9d700 1 -- 172.21.15.78:0/300893075 >> v1:172.21.15.150:6789/0 conn(0x7fe9901578f0 legacy=0x7fe990095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.747+0000 7fe98ed9d700 1 -- 172.21.15.78:0/300893075 >> v1:172.21.15.78:6789/0 conn(0x7fe990096520 legacy=0x7fe9900c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.747+0000 7fe98ed9d700 1 -- 172.21.15.78:0/300893075 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9900c37c0 con 0x7fe9900bf0e0 2023-08-17T18:12:46.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.747+0000 7fe98ed9d700 1 --2- 172.21.15.78:0/300893075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9900bf0e0 0x7fe9900be210 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 rx=0x7fe988009f20 tx=0x7fe988009840).ready entity=mon.0 client_cookie=22ad17ec994796bb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.747+0000 7fe98d59a700 1 -- 172.21.15.78:0/300893075 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98800e070 con 0x7fe9900bf0e0 2023-08-17T18:12:46.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.747+0000 7fe98d59a700 1 -- 172.21.15.78:0/300893075 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98800ba80 con 0x7fe9900bf0e0 2023-08-17T18:12:46.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.747+0000 7fe98d59a700 1 -- 172.21.15.78:0/300893075 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98800be00 con 0x7fe9900bf0e0 2023-08-17T18:12:46.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.748+0000 7fe994875700 1 -- 172.21.15.78:0/300893075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9900bf0e0 msgr2=0x7fe9900be210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.748+0000 7fe994875700 1 --2- 172.21.15.78:0/300893075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9900bf0e0 0x7fe9900be210 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 rx=0x7fe988009f20 tx=0x7fe988009840).stop 2023-08-17T18:12:46.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.748+0000 7fe994875700 1 -- 172.21.15.78:0/300893075 shutdown_connections 2023-08-17T18:12:46.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.748+0000 7fe994875700 1 --2- 172.21.15.78:0/300893075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9900bf0e0 0x7fe9900be210 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.748+0000 7fe994875700 1 -- 172.21.15.78:0/300893075 >> 172.21.15.78:0/300893075 conn(0x7fe990062f80 msgr2=0x7fe9900c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:46.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.748+0000 7fe994875700 1 -- 172.21.15.78:0/300893075 shutdown_connections 2023-08-17T18:12:46.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.748+0000 7fe994875700 1 -- 172.21.15.78:0/300893075 wait complete. 2023-08-17T18:12:46.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.749+0000 7fe994875700 1 Processor -- start 2023-08-17T18:12:46.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.749+0000 7fe994875700 1 -- start start 2023-08-17T18:12:46.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe994875700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe990096520 0x7fe9901469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe994875700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9900bf0e0 0x7fe9900a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe994875700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9901578f0 0x7fe9900a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe994875700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9900a73d0 con 0x7fe9900bf0e0 2023-08-17T18:12:46.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe994875700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9900c2450 con 0x7fe990096520 2023-08-17T18:12:46.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe994875700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9900c1840 con 0x7fe9901578f0 2023-08-17T18:12:46.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9900bf0e0 0x7fe9900a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9900bf0e0 0x7fe9900a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37978/0 (socket says 172.21.15.78:37978) 2023-08-17T18:12:46.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98dd9b700 1 -- 172.21.15.78:0/2273670026 learned_addr learned my addr 172.21.15.78:0/2273670026 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:46.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98e59c700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe990096520 0x7fe9901469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98ed9d700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9901578f0 0x7fe9900a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98dd9b700 1 -- 172.21.15.78:0/2273670026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9901578f0 msgr2=0x7fe9900a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98dd9b700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9901578f0 0x7fe9900a6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98dd9b700 1 -- 172.21.15.78:0/2273670026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe990096520 msgr2=0x7fe9901469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98dd9b700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe990096520 0x7fe9901469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98dd9b700 1 -- 172.21.15.78:0/2273670026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988009ae0 con 0x7fe9900bf0e0 2023-08-17T18:12:46.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98e59c700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe990096520 0x7fe9901469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:46.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe98dd9b700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9900bf0e0 0x7fe9900a69f0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7fe98400c4c0 tx=0x7fe984007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe97e7fc700 1 -- 172.21.15.78:0/2273670026 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984007020 con 0x7fe9900bf0e0 2023-08-17T18:12:46.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe97e7fc700 1 -- 172.21.15.78:0/2273670026 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe984007180 con 0x7fe9900bf0e0 2023-08-17T18:12:46.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9900c1b20 con 0x7fe9900bf0e0 2023-08-17T18:12:46.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe97e7fc700 1 -- 172.21.15.78:0/2273670026 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984007520 con 0x7fe9900bf0e0 2023-08-17T18:12:46.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.750+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9900c20e0 con 0x7fe9900bf0e0 2023-08-17T18:12:46.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.751+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9900695e0 con 0x7fe9900bf0e0 2023-08-17T18:12:46.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.752+0000 7fe97e7fc700 1 -- 172.21.15.78:0/2273670026 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe984010070 con 0x7fe9900bf0e0 2023-08-17T18:12:46.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.752+0000 7fe97e7fc700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe97005ed90 0x7fe970061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.752+0000 7fe97e7fc700 1 -- 172.21.15.78:0/2273670026 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fe984078c60 con 0x7fe9900bf0e0 2023-08-17T18:12:46.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.752+0000 7fe98e59c700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe97005ed90 0x7fe970061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.752+0000 7fe97e7fc700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] conn(0x7fe970065670 0x7fe970067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.752+0000 7fe97e7fc700 1 -- 172.21.15.78:0/2273670026 --> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe970068150 con 0x7fe970065670 2023-08-17T18:12:46.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.752+0000 7fe97e7fc700 1 -- 172.21.15.78:0/2273670026 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe98407b2d0 con 0x7fe9900bf0e0 2023-08-17T18:12:46.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.752+0000 7fe98ed9d700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] conn(0x7fe970065670 0x7fe970067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.752+0000 7fe98e59c700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe97005ed90 0x7fe970061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe980001690 tx=0x7fe980009040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.752+0000 7fe98ed9d700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] conn(0x7fe970065670 0x7fe970067ad0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.753+0000 7fe97e7fc700 1 -- 172.21.15.78:0/2273670026 <== osd.1 v2:172.21.15.78:6816/119710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe970068150 con 0x7fe970065670 2023-08-17T18:12:46.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.766+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 --> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe990068240 con 0x7fe970065670 2023-08-17T18:12:46.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.766+0000 7fe97e7fc700 1 -- 172.21.15.78:0/2273670026 <== osd.1 v2:172.21.15.78:6816/119710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe990068240 con 0x7fe970065670 2023-08-17T18:12:46.768 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:12:46.768 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T18:12:46.769 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:12:46.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] conn(0x7fe970065670 msgr2=0x7fe970067ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe994875700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:6816/119710,v1:172.21.15.78:6817/119710] conn(0x7fe970065670 0x7fe970067ad0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe97005ed90 msgr2=0x7fe970061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe994875700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fe97005ed90 0x7fe970061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe980001690 tx=0x7fe980009040).stop 2023-08-17T18:12:46.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9900bf0e0 msgr2=0x7fe9900a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe994875700 1 --2- 172.21.15.78:0/2273670026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9900bf0e0 0x7fe9900a69f0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7fe98400c4c0 tx=0x7fe984007dd0).stop 2023-08-17T18:12:46.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe98ed9d700 1 -- 172.21.15.78:0/2273670026 reap_dead start 2023-08-17T18:12:46.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 shutdown_connections 2023-08-17T18:12:46.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 >> 172.21.15.78:0/2273670026 conn(0x7fe990062f80 msgr2=0x7fe9900bdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:46.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 shutdown_connections 2023-08-17T18:12:46.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.767+0000 7fe994875700 1 -- 172.21.15.78:0/2273670026 wait complete. 2023-08-17T18:12:46.779 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-17T18:12:46.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.892+0000 7f0705522700 1 Processor -- start 2023-08-17T18:12:46.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.892+0000 7f0705522700 1 -- start start 2023-08-17T18:12:46.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.893+0000 7f0705522700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0700153ea0 0x7f0700154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.893+0000 7f0705522700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f07000a6bd0 0x7f07000c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.893+0000 7f0705522700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0700069e90 con 0x7f07000624f0 2023-08-17T18:12:46.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.893+0000 7f0705522700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07000c5460 con 0x7f0700153ea0 2023-08-17T18:12:46.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.893+0000 7f0705522700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0700069280 con 0x7f07000a6bd0 2023-08-17T18:12:46.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.893+0000 7f06feffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0700153ea0 0x7f0700154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.893+0000 7f06feffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0700153ea0 0x7f0700154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37994/0 (socket says 172.21.15.78:37994) 2023-08-17T18:12:46.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.893+0000 7f06feffd700 1 -- 172.21.15.78:0/3477079684 learned_addr learned my addr 172.21.15.78:0/3477079684 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:46.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.893+0000 7f06ff7fe700 1 --1- 172.21.15.78:0/3477079684 >> v1:172.21.15.78:6789/0 conn(0x7f07000624f0 0x7f0700157dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37180/0 (socket says 172.21.15.78:37180) 2023-08-17T18:12:46.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.894+0000 7f06f67fc700 1 --2- 172.21.15.78:0/3477079684 >> v2:172.21.15.150:3300/0 conn(0x7f07000a6bd0 0x7f07000c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.894+0000 7f06feffd700 1 -- 172.21.15.78:0/3477079684 >> v2:172.21.15.150:3300/0 conn(0x7f07000a6bd0 msgr2=0x7f07000c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:46.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.894+0000 7f06feffd700 1 --2- 172.21.15.78:0/3477079684 >> v2:172.21.15.150:3300/0 conn(0x7f07000a6bd0 0x7f07000c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.894+0000 7f06feffd700 1 -- 172.21.15.78:0/3477079684 >> v1:172.21.15.78:6789/0 conn(0x7f07000624f0 legacy=0x7f0700157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.894+0000 7f06fe7fc700 1 -- 172.21.15.78:0/3477079684 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138698243 0 0) 0x7f0700069e90 con 0x7f07000624f0 2023-08-17T18:12:46.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.894+0000 7f06feffd700 1 -- 172.21.15.78:0/3477079684 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700069560 con 0x7f0700153ea0 2023-08-17T18:12:46.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.894+0000 7f06feffd700 1 --2- 172.21.15.78:0/3477079684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0700153ea0 0x7f0700154280 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7f0700157d20 tx=0x7f06f00090f0).ready entity=mon.0 client_cookie=9523a2bbd895a2de server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.894+0000 7f06fe7fc700 1 -- 172.21.15.78:0/3477079684 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f000b520 con 0x7f0700153ea0 2023-08-17T18:12:46.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.894+0000 7f06fe7fc700 1 -- 172.21.15.78:0/3477079684 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f000b680 con 0x7f0700153ea0 2023-08-17T18:12:46.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.894+0000 7f06fe7fc700 1 -- 172.21.15.78:0/3477079684 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f000ba00 con 0x7f0700153ea0 2023-08-17T18:12:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.895+0000 7f0705522700 1 -- 172.21.15.78:0/3477079684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0700153ea0 msgr2=0x7f0700154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.895+0000 7f0705522700 1 --2- 172.21.15.78:0/3477079684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0700153ea0 0x7f0700154280 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7f0700157d20 tx=0x7f06f00090f0).stop 2023-08-17T18:12:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.895+0000 7f0705522700 1 -- 172.21.15.78:0/3477079684 shutdown_connections 2023-08-17T18:12:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.895+0000 7f0705522700 1 --2- 172.21.15.78:0/3477079684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0700153ea0 0x7f0700154280 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.895+0000 7f0705522700 1 --2- 172.21.15.78:0/3477079684 >> v2:172.21.15.150:3300/0 conn(0x7f07000a6bd0 0x7f07000c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.895+0000 7f0705522700 1 -- 172.21.15.78:0/3477079684 >> 172.21.15.78:0/3477079684 conn(0x7f07000c8680 msgr2=0x7f07000c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:46.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.895+0000 7f0705522700 1 -- 172.21.15.78:0/3477079684 shutdown_connections 2023-08-17T18:12:46.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.895+0000 7f0705522700 1 -- 172.21.15.78:0/3477079684 wait complete. 2023-08-17T18:12:46.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.896+0000 7f0705522700 1 Processor -- start 2023-08-17T18:12:46.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.896+0000 7f0705522700 1 -- start start 2023-08-17T18:12:46.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f0705522700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07000624f0 0x7f07001502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f0705522700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07000a6bd0 0x7f0700155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f0705522700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0700153ea0 0x7f070014dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f0705522700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07001564a0 con 0x7f07000624f0 2023-08-17T18:12:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f0705522700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07000ab350 con 0x7f0700153ea0 2023-08-17T18:12:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f0705522700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0700155700 con 0x7f07000a6bd0 2023-08-17T18:12:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06feffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07000624f0 0x7f07001502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06feffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07000624f0 0x7f07001502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38006/0 (socket says 172.21.15.78:38006) 2023-08-17T18:12:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06feffd700 1 -- 172.21.15.78:0/3992946171 learned_addr learned my addr 172.21.15.78:0/3992946171 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06ff7fe700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0700153ea0 0x7f070014dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06f67fc700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07000a6bd0 0x7f0700155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06feffd700 1 -- 172.21.15.78:0/3992946171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07000a6bd0 msgr2=0x7f0700155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06feffd700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07000a6bd0 0x7f0700155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06feffd700 1 -- 172.21.15.78:0/3992946171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0700153ea0 msgr2=0x7f070014dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:46.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06feffd700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0700153ea0 0x7f070014dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:46.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06feffd700 1 -- 172.21.15.78:0/3992946171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f0009370 con 0x7f07000624f0 2023-08-17T18:12:46.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06feffd700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07000624f0 0x7f07001502f0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f06f0009130 tx=0x7f06f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06f77fe700 1 -- 172.21.15.78:0/3992946171 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0000bc0 con 0x7f07000624f0 2023-08-17T18:12:46.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06f77fe700 1 -- 172.21.15.78:0/3992946171 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f000b7f0 con 0x7f07000624f0 2023-08-17T18:12:46.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f0705522700 1 -- 172.21.15.78:0/3992946171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07001561c0 con 0x7f07000624f0 2023-08-17T18:12:46.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f06f77fe700 1 -- 172.21.15.78:0/3992946171 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0000d20 con 0x7f07000624f0 2023-08-17T18:12:46.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.897+0000 7f0705522700 1 -- 172.21.15.78:0/3992946171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07000aafe0 con 0x7f07000624f0 2023-08-17T18:12:46.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.898+0000 7f0705522700 1 -- 172.21.15.78:0/3992946171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07000aab60 con 0x7f07000624f0 2023-08-17T18:12:46.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.899+0000 7f06f77fe700 1 -- 172.21.15.78:0/3992946171 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f06f002b070 con 0x7f07000624f0 2023-08-17T18:12:46.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.899+0000 7f06f77fe700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f06e005ed90 0x7f06e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:46.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.899+0000 7f06f77fe700 1 -- 172.21.15.78:0/3992946171 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f06f007b260 con 0x7f07000624f0 2023-08-17T18:12:46.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.899+0000 7f06f67fc700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f06e005ed90 0x7f06e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:46.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.899+0000 7f06f67fc700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f06e005ed90 0x7f06e0061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f070014e6e0 tx=0x7f06e8009060).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:46.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:46.903+0000 7f06f77fe700 1 -- 172.21.15.78:0/3992946171 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f07000aab60 con 0x7f07000624f0 2023-08-17T18:12:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.067+0000 7f0705522700 1 -- 172.21.15.78:0/3992946171 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f07000aab60 con 0x7f06e005ed90 2023-08-17T18:12:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.067+0000 7f06f77fe700 1 -- 172.21.15.78:0/3992946171 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f07000aab60 con 0x7f06e005ed90 2023-08-17T18:12:47.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 -- 172.21.15.78:0/3992946171 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f06e005ed90 msgr2=0x7f06e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f06e005ed90 0x7f06e0061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f070014e6e0 tx=0x7f06e8009060).stop 2023-08-17T18:12:47.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 -- 172.21.15.78:0/3992946171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07000624f0 msgr2=0x7f07001502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07000624f0 0x7f07001502f0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f06f0009130 tx=0x7f06f0017000).stop 2023-08-17T18:12:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 -- 172.21.15.78:0/3992946171 shutdown_connections 2023-08-17T18:12:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f06e005ed90 0x7f06e0061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0700153ea0 0x7f070014dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07000624f0 0x7f07001502f0 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 --2- 172.21.15.78:0/3992946171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07000a6bd0 0x7f0700155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 -- 172.21.15.78:0/3992946171 >> 172.21.15.78:0/3992946171 conn(0x7f07000c8680 msgr2=0x7f070014eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:47.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 -- 172.21.15.78:0/3992946171 shutdown_connections 2023-08-17T18:12:47.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.069+0000 7f0705522700 1 -- 172.21.15.78:0/3992946171 wait complete. 2023-08-17T18:12:47.072 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2023-08-17T18:12:47.082 INFO:tasks.ceph:Scrubbing osd.2 2023-08-17T18:12:47.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-17T18:12:47.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.197+0000 7fc77f59e700 1 Processor -- start 2023-08-17T18:12:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.198+0000 7fc77f59e700 1 -- start start 2023-08-17T18:12:47.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.198+0000 7fc77f59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc780151e20 0x7fc7800c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.198+0000 7fc77f59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc780157be0 0x7fc780158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.198+0000 7fc77f59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc780158520 con 0x7fc780151a40 2023-08-17T18:12:47.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.198+0000 7fc77f59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7800c6620 con 0x7fc780151e20 2023-08-17T18:12:47.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.198+0000 7fc77f59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7800c6900 con 0x7fc780157be0 2023-08-17T18:12:47.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.198+0000 7fc775d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc780151e20 0x7fc7800c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc775d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc780151e20 0x7fc7800c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38014/0 (socket says 172.21.15.78:38014) 2023-08-17T18:12:47.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc775d9b700 1 -- 172.21.15.78:0/575595896 learned_addr learned my addr 172.21.15.78:0/575595896 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:47.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc77ed9d700 1 --2- 172.21.15.78:0/575595896 >> v2:172.21.15.150:3300/0 conn(0x7fc780157be0 0x7fc780158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc775d9b700 1 -- 172.21.15.78:0/575595896 >> v2:172.21.15.150:3300/0 conn(0x7fc780157be0 msgr2=0x7fc780158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:47.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc775d9b700 1 --2- 172.21.15.78:0/575595896 >> v2:172.21.15.150:3300/0 conn(0x7fc780157be0 0x7fc780158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc775d9b700 1 -- 172.21.15.78:0/575595896 >> v1:172.21.15.150:6789/0 conn(0x7fc780151a40 legacy=0x7fc7800c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc775d9b700 1 -- 172.21.15.78:0/575595896 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7800c6be0 con 0x7fc780151e20 2023-08-17T18:12:47.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc775d9b700 1 --2- 172.21.15.78:0/575595896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc780151e20 0x7fc7800c8260 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7fc780155770 tx=0x7fc768009060).ready entity=mon.0 client_cookie=ef7494bcdfd37d64 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc77dd9b700 1 -- 172.21.15.78:0/575595896 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768005880 con 0x7fc780151e20 2023-08-17T18:12:47.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc77dd9b700 1 -- 172.21.15.78:0/575595896 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7680059e0 con 0x7fc780151e20 2023-08-17T18:12:47.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc77dd9b700 1 -- 172.21.15.78:0/575595896 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768005d60 con 0x7fc780151e20 2023-08-17T18:12:47.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc77f59e700 1 -- 172.21.15.78:0/575595896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc780151e20 msgr2=0x7fc7800c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.199+0000 7fc77f59e700 1 --2- 172.21.15.78:0/575595896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc780151e20 0x7fc7800c8260 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7fc780155770 tx=0x7fc768009060).stop 2023-08-17T18:12:47.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.200+0000 7fc77f59e700 1 -- 172.21.15.78:0/575595896 shutdown_connections 2023-08-17T18:12:47.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.200+0000 7fc77f59e700 1 --2- 172.21.15.78:0/575595896 >> v2:172.21.15.150:3300/0 conn(0x7fc780157be0 0x7fc780158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.200+0000 7fc77f59e700 1 --2- 172.21.15.78:0/575595896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc780151e20 0x7fc7800c8260 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.200+0000 7fc77f59e700 1 -- 172.21.15.78:0/575595896 >> 172.21.15.78:0/575595896 conn(0x7fc7800943b0 msgr2=0x7fc78006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:47.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.200+0000 7fc77f59e700 1 -- 172.21.15.78:0/575595896 shutdown_connections 2023-08-17T18:12:47.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.200+0000 7fc77f59e700 1 -- 172.21.15.78:0/575595896 wait complete. 2023-08-17T18:12:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.201+0000 7fc77f59e700 1 Processor -- start 2023-08-17T18:12:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.201+0000 7fc77f59e700 1 -- start start 2023-08-17T18:12:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.201+0000 7fc77f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc780151a40 0x7fc78014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc780151e20 0x7fc7800aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc780157be0 0x7fc780156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77f59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800ac510 con 0x7fc780151a40 2023-08-17T18:12:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800ab900 con 0x7fc780157be0 2023-08-17T18:12:47.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800abbe0 con 0x7fc780151e20 2023-08-17T18:12:47.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc780151a40 0x7fc78014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc780151a40 0x7fc78014c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38018/0 (socket says 172.21.15.78:38018) 2023-08-17T18:12:47.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77e59c700 1 -- 172.21.15.78:0/670375227 learned_addr learned my addr 172.21.15.78:0/670375227 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:47.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77ed9d700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc780157be0 0x7fc780156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc775d9b700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc780151e20 0x7fc7800aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77e59c700 1 -- 172.21.15.78:0/670375227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc780151e20 msgr2=0x7fc7800aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77e59c700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc780151e20 0x7fc7800aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77e59c700 1 -- 172.21.15.78:0/670375227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc780157be0 msgr2=0x7fc780156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77e59c700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc780157be0 0x7fc780156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77e59c700 1 -- 172.21.15.78:0/670375227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768009300 con 0x7fc780151a40 2023-08-17T18:12:47.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77e59c700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc780151a40 0x7fc78014c780 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7fc77000c4c0 tx=0x7fc770007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc776ffd700 1 -- 172.21.15.78:0/670375227 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000ce70 con 0x7fc780151a40 2023-08-17T18:12:47.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc776ffd700 1 -- 172.21.15.78:0/670375227 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc770007020 con 0x7fc780151a40 2023-08-17T18:12:47.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7800abec0 con 0x7fc780151a40 2023-08-17T18:12:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc776ffd700 1 -- 172.21.15.78:0/670375227 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700073c0 con 0x7fc780151a40 2023-08-17T18:12:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.202+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7800ac9a0 con 0x7fc780151a40 2023-08-17T18:12:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.203+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc780082f90 con 0x7fc780151a40 2023-08-17T18:12:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.203+0000 7fc776ffd700 1 -- 172.21.15.78:0/670375227 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc770010070 con 0x7fc780151a40 2023-08-17T18:12:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.204+0000 7fc776ffd700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc76005ed90 0x7fc760061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.204+0000 7fc776ffd700 1 -- 172.21.15.78:0/670375227 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fc770079210 con 0x7fc780151a40 2023-08-17T18:12:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.204+0000 7fc775d9b700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc76005ed90 0x7fc760061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.204+0000 7fc776ffd700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] conn(0x7fc760065670 0x7fc760067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.204+0000 7fc776ffd700 1 -- 172.21.15.78:0/670375227 --> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc760068150 con 0x7fc760065670 2023-08-17T18:12:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.204+0000 7fc776ffd700 1 -- 172.21.15.78:0/670375227 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc77007b880 con 0x7fc780151a40 2023-08-17T18:12:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.204+0000 7fc77ed9d700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] conn(0x7fc760065670 0x7fc760067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.204+0000 7fc775d9b700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc76005ed90 0x7fc760061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc768009fd0 tx=0x7fc768016000).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.204+0000 7fc77ed9d700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] conn(0x7fc760065670 0x7fc760067ad0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.205+0000 7fc776ffd700 1 -- 172.21.15.78:0/670375227 <== osd.2 v2:172.21.15.78:6808/119693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fc760068150 con 0x7fc760065670 2023-08-17T18:12:47.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.218+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 --> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc7800ac650 con 0x7fc760065670 2023-08-17T18:12:47.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.218+0000 7fc776ffd700 1 -- 172.21.15.78:0/670375227 <== osd.2 v2:172.21.15.78:6808/119693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc77800f040 con 0x7fc760065670 2023-08-17T18:12:47.220 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:12:47.220 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T18:12:47.220 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:12:47.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.218+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] conn(0x7fc760065670 msgr2=0x7fc760067ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.218+0000 7fc77f59e700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:6808/119693,v1:172.21.15.78:6809/119693] conn(0x7fc760065670 0x7fc760067ad0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.218+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc76005ed90 msgr2=0x7fc760061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.218+0000 7fc77f59e700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fc76005ed90 0x7fc760061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc768009fd0 tx=0x7fc768016000).stop 2023-08-17T18:12:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.219+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc780151a40 msgr2=0x7fc78014c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.219+0000 7fc77f59e700 1 --2- 172.21.15.78:0/670375227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc780151a40 0x7fc78014c780 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7fc77000c4c0 tx=0x7fc770007df0).stop 2023-08-17T18:12:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.219+0000 7fc77ed9d700 1 -- 172.21.15.78:0/670375227 reap_dead start 2023-08-17T18:12:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.219+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 shutdown_connections 2023-08-17T18:12:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.219+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 >> 172.21.15.78:0/670375227 conn(0x7fc7800943b0 msgr2=0x7fc7800bff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.219+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 shutdown_connections 2023-08-17T18:12:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.219+0000 7fc77f59e700 1 -- 172.21.15.78:0/670375227 wait complete. 2023-08-17T18:12:47.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-17T18:12:47.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.344+0000 7f5dbc965700 1 Processor -- start 2023-08-17T18:12:47.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.344+0000 7f5dbc965700 1 -- start start 2023-08-17T18:12:47.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.345+0000 7f5dbc965700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5db8154580 0x7f5db80a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.345+0000 7f5dbc965700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5db80c0560 0x7f5db80c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.345+0000 7f5dbc965700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db80c8df0 con 0x7f5db81541a0 2023-08-17T18:12:47.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.345+0000 7f5dbc965700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db80a8190 con 0x7f5db80c0560 2023-08-17T18:12:47.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.345+0000 7f5dbc965700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db80c9970 con 0x7f5db8154580 2023-08-17T18:12:47.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.345+0000 7f5db659c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5db81541a0 0x7f5db80bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37194/0 (socket says 172.21.15.78:37194) 2023-08-17T18:12:47.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.345+0000 7f5db659c700 1 -- 172.21.15.78:0/3963871297 learned_addr learned my addr 172.21.15.78:0/3963871297 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:47.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.345+0000 7f5db6d9d700 1 --2- 172.21.15.78:0/3963871297 >> v2:172.21.15.78:3300/0 conn(0x7f5db80c0560 0x7f5db80c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.345+0000 7f5dadd9b700 1 --2- 172.21.15.78:0/3963871297 >> v2:172.21.15.150:3300/0 conn(0x7f5db8154580 0x7f5db80a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5db6d9d700 1 -- 172.21.15.78:0/3963871297 >> v2:172.21.15.150:3300/0 conn(0x7f5db8154580 msgr2=0x7f5db80a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:47.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5db6d9d700 1 --2- 172.21.15.78:0/3963871297 >> v2:172.21.15.150:3300/0 conn(0x7f5db8154580 0x7f5db80a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5db6d9d700 1 -- 172.21.15.78:0/3963871297 >> v1:172.21.15.78:6789/0 conn(0x7f5db81541a0 legacy=0x7f5db80bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5db5d9b700 1 -- 172.21.15.78:0/3963871297 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563377129 0 0) 0x7f5db80c8df0 con 0x7f5db81541a0 2023-08-17T18:12:47.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5db6d9d700 1 -- 172.21.15.78:0/3963871297 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80c9040 con 0x7f5db80c0560 2023-08-17T18:12:47.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5db6d9d700 1 --2- 172.21.15.78:0/3963871297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db80c0560 0x7f5db80c6f80 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7f5db80c8cf0 tx=0x7f5db0009780).ready entity=mon.0 client_cookie=d8064017249dfb5f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5db5d9b700 1 -- 172.21.15.78:0/3963871297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db000e070 con 0x7f5db80c0560 2023-08-17T18:12:47.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5db5d9b700 1 -- 172.21.15.78:0/3963871297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db000bc30 con 0x7f5db80c0560 2023-08-17T18:12:47.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5db5d9b700 1 -- 172.21.15.78:0/3963871297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0012410 con 0x7f5db80c0560 2023-08-17T18:12:47.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5dbc965700 1 -- 172.21.15.78:0/3963871297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db80c0560 msgr2=0x7f5db80c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5dbc965700 1 --2- 172.21.15.78:0/3963871297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db80c0560 0x7f5db80c6f80 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7f5db80c8cf0 tx=0x7f5db0009780).stop 2023-08-17T18:12:47.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5dbc965700 1 -- 172.21.15.78:0/3963871297 shutdown_connections 2023-08-17T18:12:47.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5dbc965700 1 --2- 172.21.15.78:0/3963871297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db80c0560 0x7f5db80c6f80 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5dbc965700 1 --2- 172.21.15.78:0/3963871297 >> v2:172.21.15.150:3300/0 conn(0x7f5db8154580 0x7f5db80a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5dbc965700 1 -- 172.21.15.78:0/3963871297 >> 172.21.15.78:0/3963871297 conn(0x7f5db806a400 msgr2=0x7f5db80caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:47.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5dbc965700 1 -- 172.21.15.78:0/3963871297 shutdown_connections 2023-08-17T18:12:47.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.346+0000 7f5dbc965700 1 -- 172.21.15.78:0/3963871297 wait complete. 2023-08-17T18:12:47.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.348+0000 7f5dbc965700 1 Processor -- start 2023-08-17T18:12:47.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.348+0000 7f5dbc965700 1 -- start start 2023-08-17T18:12:47.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.348+0000 7f5dbc965700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5db80c0560 0x7f5db8146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.348+0000 7f5dbc965700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db81541a0 0x7f5db814bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.348+0000 7f5dbc965700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5db8154580 0x7f5db814c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.348+0000 7f5dbc965700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db814cfd0 con 0x7f5db81541a0 2023-08-17T18:12:47.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.348+0000 7f5dbc965700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db814d460 con 0x7f5db80c0560 2023-08-17T18:12:47.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.348+0000 7f5dbc965700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db80ae2a0 con 0x7f5db8154580 2023-08-17T18:12:47.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.348+0000 7f5dadd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db81541a0 0x7f5db814bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.348+0000 7f5dadd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db81541a0 0x7f5db814bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38028/0 (socket says 172.21.15.78:38028) 2023-08-17T18:12:47.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5dadd9b700 1 -- 172.21.15.78:0/3220457800 learned_addr learned my addr 172.21.15.78:0/3220457800 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:47.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5db659c700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5db80c0560 0x7f5db8146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5db6d9d700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5db8154580 0x7f5db814c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5dadd9b700 1 -- 172.21.15.78:0/3220457800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5db8154580 msgr2=0x7f5db814c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5dadd9b700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5db8154580 0x7f5db814c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5dadd9b700 1 -- 172.21.15.78:0/3220457800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5db80c0560 msgr2=0x7f5db8146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5dadd9b700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5db80c0560 0x7f5db8146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5dadd9b700 1 -- 172.21.15.78:0/3220457800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db0009a20 con 0x7f5db81541a0 2023-08-17T18:12:47.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5dadd9b700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db81541a0 0x7f5db814bd60 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7f5da000d860 tx=0x7f5da0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5daeffd700 1 -- 172.21.15.78:0/3220457800 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000f520 con 0x7f5db81541a0 2023-08-17T18:12:47.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5daeffd700 1 -- 172.21.15.78:0/3220457800 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da000f680 con 0x7f5db81541a0 2023-08-17T18:12:47.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5dbc965700 1 -- 172.21.15.78:0/3220457800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db80ae580 con 0x7f5db81541a0 2023-08-17T18:12:47.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5daeffd700 1 -- 172.21.15.78:0/3220457800 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000fa00 con 0x7f5db81541a0 2023-08-17T18:12:47.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.349+0000 7f5dbc965700 1 -- 172.21.15.78:0/3220457800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db81472e0 con 0x7f5db81541a0 2023-08-17T18:12:47.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.350+0000 7f5dbc965700 1 -- 172.21.15.78:0/3220457800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db8047350 con 0x7f5db81541a0 2023-08-17T18:12:47.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.350+0000 7f5daeffd700 1 -- 172.21.15.78:0/3220457800 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5da001a030 con 0x7f5db81541a0 2023-08-17T18:12:47.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.351+0000 7f5daeffd700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5d9805ed90 0x7f5d98061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.351+0000 7f5daeffd700 1 -- 172.21.15.78:0/3220457800 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f5da0079390 con 0x7f5db81541a0 2023-08-17T18:12:47.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.351+0000 7f5db659c700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5d9805ed90 0x7f5d98061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.351+0000 7f5db659c700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5d9805ed90 0x7f5d98061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5db8064e90 tx=0x7f5da8007bb0).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.355+0000 7f5daeffd700 1 -- 172.21.15.78:0/3220457800 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5da004aab0 con 0x7f5db81541a0 2023-08-17T18:12:47.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.518+0000 7f5dbc965700 1 -- 172.21.15.78:0/3220457800 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5db80c9320 con 0x7f5d9805ed90 2023-08-17T18:12:47.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.519+0000 7f5daeffd700 1 -- 172.21.15.78:0/3220457800 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5db80c9320 con 0x7f5d9805ed90 2023-08-17T18:12:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 -- 172.21.15.78:0/3220457800 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5d9805ed90 msgr2=0x7f5d98061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5d9805ed90 0x7f5d98061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5db8064e90 tx=0x7f5da8007bb0).stop 2023-08-17T18:12:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 -- 172.21.15.78:0/3220457800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db81541a0 msgr2=0x7f5db814bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db81541a0 0x7f5db814bd60 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7f5da000d860 tx=0x7f5da0008040).stop 2023-08-17T18:12:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 -- 172.21.15.78:0/3220457800 shutdown_connections 2023-08-17T18:12:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f5d9805ed90 0x7f5d98061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5db8154580 0x7f5db814c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5db80c0560 0x7f5db8146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 --2- 172.21.15.78:0/3220457800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5db81541a0 0x7f5db814bd60 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 -- 172.21.15.78:0/3220457800 >> 172.21.15.78:0/3220457800 conn(0x7f5db806a400 msgr2=0x7f5db8151680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:47.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 -- 172.21.15.78:0/3220457800 shutdown_connections 2023-08-17T18:12:47.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.520+0000 7f5dbc965700 1 -- 172.21.15.78:0/3220457800 wait complete. 2023-08-17T18:12:47.523 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2023-08-17T18:12:47.533 INFO:tasks.ceph:Scrubbing osd.3 2023-08-17T18:12:47.533 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-17T18:12:47.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.651+0000 7fa5a9ed4700 1 Processor -- start 2023-08-17T18:12:47.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.651+0000 7fa5a9ed4700 1 -- start start 2023-08-17T18:12:47.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a9ed4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5a4151a40 0x7fa5a40c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a9ed4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a40c6620 con 0x7fa5a4157be0 2023-08-17T18:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a9ed4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a40c6900 con 0x7fa5a4151e20 2023-08-17T18:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a9ed4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a40c6be0 con 0x7fa5a4151a40 2023-08-17T18:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a8ed2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5a4151a40 0x7fa5a40c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a8ed2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5a4151a40 0x7fa5a40c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38036/0 (socket says 172.21.15.78:38036) 2023-08-17T18:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a96d3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa5a4157be0 0x7fa5a40c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37210/0 (socket says 172.21.15.78:37210) 2023-08-17T18:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a8ed2700 1 -- 172.21.15.78:0/611833995 learned_addr learned my addr 172.21.15.78:0/611833995 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a8ed2700 1 -- 172.21.15.78:0/611833995 >> v1:172.21.15.150:6789/0 conn(0x7fa5a4151e20 legacy=0x7fa5a40c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a8ed2700 1 -- 172.21.15.78:0/611833995 >> v1:172.21.15.78:6789/0 conn(0x7fa5a4157be0 legacy=0x7fa5a40c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a37fe700 1 -- 172.21.15.78:0/611833995 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578420279 0 0) 0x7fa5a40c6620 con 0x7fa5a4157be0 2023-08-17T18:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a8ed2700 1 -- 172.21.15.78:0/611833995 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40c6ec0 con 0x7fa5a4151a40 2023-08-17T18:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.652+0000 7fa5a8ed2700 1 --2- 172.21.15.78:0/611833995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a4151a40 0x7fa5a40c8260 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7fa598009810 tx=0x7fa598009060).ready entity=mon.0 client_cookie=d32b5f8abc712847 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.653+0000 7fa5a37fe700 1 -- 172.21.15.78:0/611833995 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598005880 con 0x7fa5a4151a40 2023-08-17T18:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.653+0000 7fa5a37fe700 1 -- 172.21.15.78:0/611833995 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5980059e0 con 0x7fa5a4151a40 2023-08-17T18:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.653+0000 7fa5a37fe700 1 -- 172.21.15.78:0/611833995 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598005d60 con 0x7fa5a4151a40 2023-08-17T18:12:47.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.653+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/611833995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a4151a40 msgr2=0x7fa5a40c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.653+0000 7fa5a9ed4700 1 --2- 172.21.15.78:0/611833995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a4151a40 0x7fa5a40c8260 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7fa598009810 tx=0x7fa598009060).stop 2023-08-17T18:12:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.653+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/611833995 shutdown_connections 2023-08-17T18:12:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.653+0000 7fa5a9ed4700 1 --2- 172.21.15.78:0/611833995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a4151a40 0x7fa5a40c8260 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.653+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/611833995 >> 172.21.15.78:0/611833995 conn(0x7fa5a40943b0 msgr2=0x7fa5a406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.653+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/611833995 shutdown_connections 2023-08-17T18:12:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.653+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/611833995 wait complete. 2023-08-17T18:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.654+0000 7fa5a9ed4700 1 Processor -- start 2023-08-17T18:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.654+0000 7fa5a9ed4700 1 -- start start 2023-08-17T18:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a9ed4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a4151a40 0x7fa5a414b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a9ed4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a4151e20 0x7fa5a4164600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a9ed4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5a4157be0 0x7fa5a40accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a9ed4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40c46a0 con 0x7fa5a4151e20 2023-08-17T18:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a9ed4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4167c60 con 0x7fa5a4157be0 2023-08-17T18:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a9ed4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a414d940 con 0x7fa5a4151a40 2023-08-17T18:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a4151e20 0x7fa5a4164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a4151e20 0x7fa5a4164600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38048/0 (socket says 172.21.15.78:38048) 2023-08-17T18:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a3fff700 1 -- 172.21.15.78:0/785541206 learned_addr learned my addr 172.21.15.78:0/785541206 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a96d3700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5a4157be0 0x7fa5a40accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.655+0000 7fa5a8ed2700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a4151a40 0x7fa5a414b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a3fff700 1 -- 172.21.15.78:0/785541206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a4151a40 msgr2=0x7fa5a414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a3fff700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a4151a40 0x7fa5a414b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a3fff700 1 -- 172.21.15.78:0/785541206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5a4157be0 msgr2=0x7fa5a40accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a3fff700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5a4157be0 0x7fa5a40accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a3fff700 1 -- 172.21.15.78:0/785541206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa598009300 con 0x7fa5a4151e20 2023-08-17T18:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a8ed2700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5a4151a40 0x7fa5a414b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a3fff700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a4151e20 0x7fa5a4164600 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7fa59000c4f0 tx=0x7fa590007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a0ff9700 1 -- 172.21.15.78:0/785541206 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590007020 con 0x7fa5a4151e20 2023-08-17T18:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a0ff9700 1 -- 172.21.15.78:0/785541206 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa590007180 con 0x7fa5a4151e20 2023-08-17T18:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a414dc20 con 0x7fa5a4151e20 2023-08-17T18:12:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a0ff9700 1 -- 172.21.15.78:0/785541206 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590007520 con 0x7fa5a4151e20 2023-08-17T18:12:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.656+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a414e1e0 con 0x7fa5a4151e20 2023-08-17T18:12:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.657+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5a4082f90 con 0x7fa5a4151e20 2023-08-17T18:12:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.657+0000 7fa5a0ff9700 1 -- 172.21.15.78:0/785541206 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa590010070 con 0x7fa5a4151e20 2023-08-17T18:12:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.657+0000 7fa5a0ff9700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa58805ed90 0x7fa588061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.657+0000 7fa5a0ff9700 1 -- 172.21.15.78:0/785541206 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fa590079330 con 0x7fa5a4151e20 2023-08-17T18:12:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.658+0000 7fa5a8ed2700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa58805ed90 0x7fa588061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.658+0000 7fa5a0ff9700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] conn(0x7fa588065670 0x7fa588067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.658+0000 7fa5a0ff9700 1 -- 172.21.15.78:0/785541206 --> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa588068150 con 0x7fa588065670 2023-08-17T18:12:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.658+0000 7fa5a0ff9700 1 -- 172.21.15.78:0/785541206 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa59007b9a0 con 0x7fa5a4151e20 2023-08-17T18:12:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.658+0000 7fa5a96d3700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] conn(0x7fa588065670 0x7fa588067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.658+0000 7fa5a8ed2700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa58805ed90 0x7fa588061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa598009fd0 tx=0x7fa598016000).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.658+0000 7fa5a96d3700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] conn(0x7fa588065670 0x7fa588067ad0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.659+0000 7fa5a0ff9700 1 -- 172.21.15.78:0/785541206 <== osd.3 v2:172.21.15.78:6824/119728 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa588068150 con 0x7fa588065670 2023-08-17T18:12:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.671+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 --> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5a4167df0 con 0x7fa588065670 2023-08-17T18:12:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a0ff9700 1 -- 172.21.15.78:0/785541206 <== osd.3 v2:172.21.15.78:6824/119728 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa5a4167df0 con 0x7fa588065670 2023-08-17T18:12:47.673 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:12:47.673 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T18:12:47.673 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:12:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] conn(0x7fa588065670 msgr2=0x7fa588067ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a9ed4700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:6824/119728,v1:172.21.15.78:6825/119728] conn(0x7fa588065670 0x7fa588067ad0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa58805ed90 msgr2=0x7fa588061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a9ed4700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fa58805ed90 0x7fa588061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa598009fd0 tx=0x7fa598016000).stop 2023-08-17T18:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a4151e20 msgr2=0x7fa5a4164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a9ed4700 1 --2- 172.21.15.78:0/785541206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5a4151e20 0x7fa5a4164600 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7fa59000c4f0 tx=0x7fa590007df0).stop 2023-08-17T18:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a96d3700 1 -- 172.21.15.78:0/785541206 reap_dead start 2023-08-17T18:12:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 shutdown_connections 2023-08-17T18:12:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 >> 172.21.15.78:0/785541206 conn(0x7fa5a40943b0 msgr2=0x7fa5a406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 shutdown_connections 2023-08-17T18:12:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.672+0000 7fa5a9ed4700 1 -- 172.21.15.78:0/785541206 wait complete. 2023-08-17T18:12:47.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-17T18:12:47.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.797+0000 7fcfae74b700 1 Processor -- start 2023-08-17T18:12:47.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.798+0000 7fcfae74b700 1 -- start start 2023-08-17T18:12:47.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.798+0000 7fcfae74b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa80c98b0 0x7fcfa8064720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.798+0000 7fcfae74b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcfa80bec60 0x7fcfa80c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.798+0000 7fcfae74b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa80c7860 con 0x7fcfa8064340 2023-08-17T18:12:47.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.798+0000 7fcfae74b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa80638b0 con 0x7fcfa80bec60 2023-08-17T18:12:47.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.798+0000 7fcfae74b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80a8680 con 0x7fcfa80c98b0 2023-08-17T18:12:47.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfacce8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcfa80bec60 0x7fcfa80c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfacce8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcfa80bec60 0x7fcfa80c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38056/0 (socket says 172.21.15.78:38056) 2023-08-17T18:12:47.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfacce8700 1 -- 172.21.15.78:0/2841966046 learned_addr learned my addr 172.21.15.78:0/2841966046 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:47.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfa77fe700 1 --2- 172.21.15.78:0/2841966046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa80c98b0 0x7fcfa8064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfacce8700 1 -- 172.21.15.78:0/2841966046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa80c98b0 msgr2=0x7fcfa8064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:47.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfacce8700 1 --2- 172.21.15.78:0/2841966046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa80c98b0 0x7fcfa8064720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfacce8700 1 -- 172.21.15.78:0/2841966046 >> v1:172.21.15.150:6789/0 conn(0x7fcfa8064340 legacy=0x7fcfa80c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfacce8700 1 -- 172.21.15.78:0/2841966046 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80c6c90 con 0x7fcfa80bec60 2023-08-17T18:12:47.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfa77fe700 1 --2- 172.21.15.78:0/2841966046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa80c98b0 0x7fcfa8064720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:47.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfacce8700 1 --2- 172.21.15.78:0/2841966046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 0x7fcfa80c32f0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7fcfa0009f20 tx=0x7fcfa0009840).ready entity=mon.0 client_cookie=75907127e5a9ee66 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfa6ffd700 1 -- 172.21.15.78:0/2841966046 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000e070 con 0x7fcfa80bec60 2023-08-17T18:12:47.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfa6ffd700 1 -- 172.21.15.78:0/2841966046 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa000ba80 con 0x7fcfa80bec60 2023-08-17T18:12:47.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.799+0000 7fcfa6ffd700 1 -- 172.21.15.78:0/2841966046 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000be00 con 0x7fcfa80bec60 2023-08-17T18:12:47.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.800+0000 7fcfae74b700 1 -- 172.21.15.78:0/2841966046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 msgr2=0x7fcfa80c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.800+0000 7fcfae74b700 1 --2- 172.21.15.78:0/2841966046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 0x7fcfa80c32f0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7fcfa0009f20 tx=0x7fcfa0009840).stop 2023-08-17T18:12:47.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.800+0000 7fcfae74b700 1 -- 172.21.15.78:0/2841966046 shutdown_connections 2023-08-17T18:12:47.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.800+0000 7fcfae74b700 1 --2- 172.21.15.78:0/2841966046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 0x7fcfa80c32f0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.800+0000 7fcfae74b700 1 --2- 172.21.15.78:0/2841966046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa80c98b0 0x7fcfa8064720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.800+0000 7fcfae74b700 1 -- 172.21.15.78:0/2841966046 >> 172.21.15.78:0/2841966046 conn(0x7fcfa8062cd0 msgr2=0x7fcfa80c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:47.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.800+0000 7fcfae74b700 1 -- 172.21.15.78:0/2841966046 shutdown_connections 2023-08-17T18:12:47.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.800+0000 7fcfae74b700 1 -- 172.21.15.78:0/2841966046 wait complete. 2023-08-17T18:12:47.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.801+0000 7fcfae74b700 1 Processor -- start 2023-08-17T18:12:47.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.801+0000 7fcfae74b700 1 -- start start 2023-08-17T18:12:47.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfae74b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa8064340 0x7fcfa8145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfae74b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 0x7fcfa80aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfae74b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfa80c98b0 0x7fcfa80a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfae74b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80abca0 con 0x7fcfa80bec60 2023-08-17T18:12:47.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfae74b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80ac260 con 0x7fcfa80c98b0 2023-08-17T18:12:47.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfae74b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81653b0 con 0x7fcfa8064340 2023-08-17T18:12:47.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 0x7fcfa80aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 0x7fcfa80aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38066/0 (socket says 172.21.15.78:38066) 2023-08-17T18:12:47.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfa77fe700 1 -- 172.21.15.78:0/3362824901 learned_addr learned my addr 172.21.15.78:0/3362824901 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:47.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfa7fff700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa8064340 0x7fcfa8145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfacce8700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfa80c98b0 0x7fcfa80a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfa77fe700 1 -- 172.21.15.78:0/3362824901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa8064340 msgr2=0x7fcfa8145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfa77fe700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa8064340 0x7fcfa8145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfa77fe700 1 -- 172.21.15.78:0/3362824901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfa80c98b0 msgr2=0x7fcfa80a87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfa77fe700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfa80c98b0 0x7fcfa80a87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfa77fe700 1 -- 172.21.15.78:0/3362824901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0009ae0 con 0x7fcfa80bec60 2023-08-17T18:12:47.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcfa77fe700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 0x7fcfa80aaca0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7fcf9c006fd0 tx=0x7fcf9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcf8ffff700 1 -- 172.21.15.78:0/3362824901 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c016070 con 0x7fcfa80bec60 2023-08-17T18:12:47.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcf8ffff700 1 -- 172.21.15.78:0/3362824901 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c011590 con 0x7fcfa80bec60 2023-08-17T18:12:47.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.802+0000 7fcf8ffff700 1 -- 172.21.15.78:0/3362824901 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c011910 con 0x7fcfa80bec60 2023-08-17T18:12:47.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.803+0000 7fcfae74b700 1 -- 172.21.15.78:0/3362824901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa8152b90 con 0x7fcfa80bec60 2023-08-17T18:12:47.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.803+0000 7fcfae74b700 1 -- 172.21.15.78:0/3362824901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa8153150 con 0x7fcfa80bec60 2023-08-17T18:12:47.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.803+0000 7fcfae74b700 1 -- 172.21.15.78:0/3362824901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa80ac3d0 con 0x7fcfa80bec60 2023-08-17T18:12:47.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.804+0000 7fcf8ffff700 1 -- 172.21.15.78:0/3362824901 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcf9c011d00 con 0x7fcfa80bec60 2023-08-17T18:12:47.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.804+0000 7fcf8ffff700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf9405ed60 0x7fcf94061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:47.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.804+0000 7fcf8ffff700 1 -- 172.21.15.78:0/3362824901 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fcf9c0791e0 con 0x7fcfa80bec60 2023-08-17T18:12:47.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.804+0000 7fcfa7fff700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf9405ed60 0x7fcf94061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:47.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.804+0000 7fcfa7fff700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf9405ed60 0x7fcf94061220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcf98003860 tx=0x7fcf98007d40).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:47.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.808+0000 7fcf8ffff700 1 -- 172.21.15.78:0/3362824901 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf9c04a8a0 con 0x7fcfa80bec60 2023-08-17T18:12:47.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.978+0000 7fcfae74b700 1 -- 172.21.15.78:0/3362824901 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfa8047350 con 0x7fcf9405ed60 2023-08-17T18:12:47.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.978+0000 7fcf8ffff700 1 -- 172.21.15.78:0/3362824901 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcfa8047350 con 0x7fcf9405ed60 2023-08-17T18:12:47.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 -- 172.21.15.78:0/3362824901 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf9405ed60 msgr2=0x7fcf94061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf9405ed60 0x7fcf94061220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcf98003860 tx=0x7fcf98007d40).stop 2023-08-17T18:12:47.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 -- 172.21.15.78:0/3362824901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 msgr2=0x7fcfa80aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:47.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 0x7fcfa80aaca0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7fcf9c006fd0 tx=0x7fcf9c008040).stop 2023-08-17T18:12:47.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 -- 172.21.15.78:0/3362824901 shutdown_connections 2023-08-17T18:12:47.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fcf9405ed60 0x7fcf94061220 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfa80c98b0 0x7fcfa80a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfa8064340 0x7fcfa8145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 --2- 172.21.15.78:0/3362824901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80bec60 0x7fcfa80aaca0 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:47.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 -- 172.21.15.78:0/3362824901 >> 172.21.15.78:0/3362824901 conn(0x7fcfa8062cd0 msgr2=0x7fcfa8064c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:47.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 -- 172.21.15.78:0/3362824901 shutdown_connections 2023-08-17T18:12:47.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:47.980+0000 7fcfae74b700 1 -- 172.21.15.78:0/3362824901 wait complete. 2023-08-17T18:12:47.983 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2023-08-17T18:12:47.993 INFO:tasks.ceph:Scrubbing osd.4 2023-08-17T18:12:47.993 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-17T18:12:48.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.107+0000 7f3e2359e700 1 Processor -- start 2023-08-17T18:12:48.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.107+0000 7f3e2359e700 1 -- start start 2023-08-17T18:12:48.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.108+0000 7f3e2359e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3e241520c0 0x7f3e240c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.108+0000 7f3e2359e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3e240c6810 0x7f3e240625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.108+0000 7f3e2359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240c3a90 con 0x7f3e240c6390 2023-08-17T18:12:48.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.108+0000 7f3e2359e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e240c2e80 con 0x7f3e240c6810 2023-08-17T18:12:48.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.108+0000 7f3e2359e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e240c3160 con 0x7f3e241520c0 2023-08-17T18:12:48.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e22d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3e240c6810 0x7f3e240625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e22d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3e240c6810 0x7f3e240625f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38078/0 (socket says 172.21.15.78:38078) 2023-08-17T18:12:48.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e22d9d700 1 -- 172.21.15.78:0/3363224559 learned_addr learned my addr 172.21.15.78:0/3363224559 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:48.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e2259c700 1 --2- 172.21.15.78:0/3363224559 >> v2:172.21.15.150:3300/0 conn(0x7f3e241520c0 0x7f3e240c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e22d9d700 1 -- 172.21.15.78:0/3363224559 >> v2:172.21.15.150:3300/0 conn(0x7f3e241520c0 msgr2=0x7f3e240c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:48.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e22d9d700 1 --2- 172.21.15.78:0/3363224559 >> v2:172.21.15.150:3300/0 conn(0x7f3e241520c0 0x7f3e240c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e22d9d700 1 -- 172.21.15.78:0/3363224559 >> v1:172.21.15.150:6789/0 conn(0x7f3e240c6390 legacy=0x7f3e240a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e22d9d700 1 -- 172.21.15.78:0/3363224559 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240c3440 con 0x7f3e240c6810 2023-08-17T18:12:48.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e22d9d700 1 --2- 172.21.15.78:0/3363224559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c6810 0x7f3e240625f0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7f3e2406ad00 tx=0x7f3e1c009840).ready entity=mon.0 client_cookie=e82cf6431f0738a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e21d9b700 1 -- 172.21.15.78:0/3363224559 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00e070 con 0x7f3e240c6810 2023-08-17T18:12:48.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e21d9b700 1 -- 172.21.15.78:0/3363224559 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00ba20 con 0x7f3e240c6810 2023-08-17T18:12:48.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.109+0000 7f3e21d9b700 1 -- 172.21.15.78:0/3363224559 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00bda0 con 0x7f3e240c6810 2023-08-17T18:12:48.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.110+0000 7f3e2359e700 1 -- 172.21.15.78:0/3363224559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c6810 msgr2=0x7f3e240625f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.110+0000 7f3e2359e700 1 --2- 172.21.15.78:0/3363224559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c6810 0x7f3e240625f0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7f3e2406ad00 tx=0x7f3e1c009840).stop 2023-08-17T18:12:48.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.110+0000 7f3e2359e700 1 -- 172.21.15.78:0/3363224559 shutdown_connections 2023-08-17T18:12:48.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.110+0000 7f3e2359e700 1 --2- 172.21.15.78:0/3363224559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c6810 0x7f3e240625f0 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.110+0000 7f3e2359e700 1 --2- 172.21.15.78:0/3363224559 >> v2:172.21.15.150:3300/0 conn(0x7f3e241520c0 0x7f3e240c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.110+0000 7f3e2359e700 1 -- 172.21.15.78:0/3363224559 >> 172.21.15.78:0/3363224559 conn(0x7f3e240c3e20 msgr2=0x7f3e240c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:48.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.110+0000 7f3e2359e700 1 -- 172.21.15.78:0/3363224559 shutdown_connections 2023-08-17T18:12:48.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.110+0000 7f3e2359e700 1 -- 172.21.15.78:0/3363224559 wait complete. 2023-08-17T18:12:48.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.111+0000 7f3e2359e700 1 Processor -- start 2023-08-17T18:12:48.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.111+0000 7f3e2359e700 1 -- start start 2023-08-17T18:12:48.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c6390 0x7f3e24145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e240c6810 0x7f3e240a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e241520c0 0x7f3e2414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2359e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240a4cd0 con 0x7f3e240c6390 2023-08-17T18:12:48.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240a7fd0 con 0x7f3e240c6810 2023-08-17T18:12:48.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240a73c0 con 0x7f3e241520c0 2023-08-17T18:12:48.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c6390 0x7f3e24145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c6390 0x7f3e24145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38084/0 (socket says 172.21.15.78:38084) 2023-08-17T18:12:48.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2259c700 1 -- 172.21.15.78:0/441919914 learned_addr learned my addr 172.21.15.78:0/441919914 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:48.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e19d9b700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e240c6810 0x7f3e240a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e22d9d700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e241520c0 0x7f3e2414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2259c700 1 -- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e241520c0 msgr2=0x7f3e2414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2259c700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e241520c0 0x7f3e2414fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2259c700 1 -- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e240c6810 msgr2=0x7f3e240a5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2259c700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e240c6810 0x7f3e240a5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2259c700 1 -- 172.21.15.78:0/441919914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c009ae0 con 0x7f3e240c6390 2023-08-17T18:12:48.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2259c700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c6390 0x7f3e24145ed0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f3e1400e900 tx=0x7f3e14009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e1affd700 1 -- 172.21.15.78:0/441919914 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14012600 con 0x7f3e240c6390 2023-08-17T18:12:48.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e1affd700 1 -- 172.21.15.78:0/441919914 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14012760 con 0x7f3e240c6390 2023-08-17T18:12:48.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e240a76a0 con 0x7f3e240c6390 2023-08-17T18:12:48.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.112+0000 7f3e1affd700 1 -- 172.21.15.78:0/441919914 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14012ae0 con 0x7f3e240c6390 2023-08-17T18:12:48.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.113+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e240a7c60 con 0x7f3e240c6390 2023-08-17T18:12:48.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.113+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e2405f910 con 0x7f3e240c6390 2023-08-17T18:12:48.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.114+0000 7f3e1affd700 1 -- 172.21.15.78:0/441919914 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3e14022070 con 0x7f3e240c6390 2023-08-17T18:12:48.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.114+0000 7f3e1affd700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3e0405ed60 0x7f3e04061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.114+0000 7f3e1affd700 1 -- 172.21.15.78:0/441919914 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f3e1407a2d0 con 0x7f3e240c6390 2023-08-17T18:12:48.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.114+0000 7f3e19d9b700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3e0405ed60 0x7f3e04061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.114+0000 7f3e1affd700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] conn(0x7f3e04065640 0x7f3e04067aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.114+0000 7f3e1affd700 1 -- 172.21.15.78:0/441919914 --> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e04068120 con 0x7f3e04065640 2023-08-17T18:12:48.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.114+0000 7f3e1affd700 1 -- 172.21.15.78:0/441919914 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e1407a6d0 con 0x7f3e240c6390 2023-08-17T18:12:48.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.115+0000 7f3e22d9d700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] conn(0x7f3e04065640 0x7f3e04067aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.115+0000 7f3e19d9b700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3e0405ed60 0x7f3e04061220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3e240ad5e0 tx=0x7f3e0c007d40).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.115+0000 7f3e22d9d700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] conn(0x7f3e04065640 0x7f3e04067aa0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.115+0000 7f3e1affd700 1 -- 172.21.15.78:0/441919914 <== osd.4 v2:172.21.15.150:6808/90933 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f3e04068120 con 0x7f3e04065640 2023-08-17T18:12:48.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 --> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3e240a82b0 con 0x7f3e04065640 2023-08-17T18:12:48.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e1affd700 1 -- 172.21.15.78:0/441919914 <== osd.4 v2:172.21.15.150:6808/90933 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3e240a82b0 con 0x7f3e04065640 2023-08-17T18:12:48.130 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:12:48.130 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T18:12:48.130 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:12:48.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] conn(0x7f3e04065640 msgr2=0x7f3e04067aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e2359e700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.150:6808/90933,v1:172.21.15.150:6809/90933] conn(0x7f3e04065640 0x7f3e04067aa0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3e0405ed60 msgr2=0x7f3e04061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e2359e700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f3e0405ed60 0x7f3e04061220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3e240ad5e0 tx=0x7f3e0c007d40).stop 2023-08-17T18:12:48.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c6390 msgr2=0x7f3e24145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e2359e700 1 --2- 172.21.15.78:0/441919914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c6390 0x7f3e24145ed0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f3e1400e900 tx=0x7f3e14009060).stop 2023-08-17T18:12:48.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e22d9d700 1 -- 172.21.15.78:0/441919914 reap_dead start 2023-08-17T18:12:48.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 shutdown_connections 2023-08-17T18:12:48.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.129+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 >> 172.21.15.78:0/441919914 conn(0x7f3e240c3e20 msgr2=0x7f3e240bd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:48.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.130+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 shutdown_connections 2023-08-17T18:12:48.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.130+0000 7f3e2359e700 1 -- 172.21.15.78:0/441919914 wait complete. 2023-08-17T18:12:48.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-17T18:12:48.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.254+0000 7f924dce8700 1 Processor -- start 2023-08-17T18:12:48.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.254+0000 7f924dce8700 1 -- start start 2023-08-17T18:12:48.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f924dce8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92481541a0 0x7f92480a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f924dce8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f92480c0560 0x7f92480c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f924dce8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92480c8df0 con 0x7f9248154580 2023-08-17T18:12:48.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f924dce8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92480a8190 con 0x7f92480c0560 2023-08-17T18:12:48.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f924dce8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92480c9970 con 0x7f92481541a0 2023-08-17T18:12:48.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f9246ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9248154580 0x7f92480bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37214/0 (socket says 172.21.15.78:37214) 2023-08-17T18:12:48.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f9246ffd700 1 -- 172.21.15.78:0/3895039351 learned_addr learned my addr 172.21.15.78:0/3895039351 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:48.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f92477fe700 1 --2- 172.21.15.78:0/3895039351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92481541a0 0x7f92480a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f9247fff700 1 --2- 172.21.15.78:0/3895039351 >> v2:172.21.15.150:3300/0 conn(0x7f92480c0560 0x7f92480c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f92467fc700 1 -- 172.21.15.78:0/3895039351 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474031280 0 0) 0x7f92480c8df0 con 0x7f9248154580 2023-08-17T18:12:48.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f92467fc700 1 -- 172.21.15.78:0/3895039351 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92300033f0 con 0x7f9248154580 2023-08-17T18:12:48.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f9247fff700 1 -- 172.21.15.78:0/3895039351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92481541a0 msgr2=0x7f92480a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:48.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f9247fff700 1 --2- 172.21.15.78:0/3895039351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92481541a0 0x7f92480a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f9247fff700 1 -- 172.21.15.78:0/3895039351 >> v1:172.21.15.78:6789/0 conn(0x7f9248154580 legacy=0x7f92480bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f9247fff700 1 -- 172.21.15.78:0/3895039351 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92480c9040 con 0x7f92480c0560 2023-08-17T18:12:48.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f92477fe700 1 --2- 172.21.15.78:0/3895039351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92481541a0 0x7f92480a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:48.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.255+0000 7f9247fff700 1 --2- 172.21.15.78:0/3895039351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92480c0560 0x7f92480c6f80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f9240009e60 tx=0x7f9240009780).ready entity=mon.1 client_cookie=e79d02e04bdf3476 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f92467fc700 1 -- 172.21.15.78:0/3895039351 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000e070 con 0x7f92480c0560 2023-08-17T18:12:48.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f92467fc700 1 -- 172.21.15.78:0/3895039351 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924000bab0 con 0x7f92480c0560 2023-08-17T18:12:48.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f92467fc700 1 -- 172.21.15.78:0/3895039351 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000be30 con 0x7f92480c0560 2023-08-17T18:12:48.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f924dce8700 1 -- 172.21.15.78:0/3895039351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92480c0560 msgr2=0x7f92480c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f924dce8700 1 --2- 172.21.15.78:0/3895039351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92480c0560 0x7f92480c6f80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f9240009e60 tx=0x7f9240009780).stop 2023-08-17T18:12:48.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f924dce8700 1 -- 172.21.15.78:0/3895039351 shutdown_connections 2023-08-17T18:12:48.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f924dce8700 1 --2- 172.21.15.78:0/3895039351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92480c0560 0x7f92480c6f80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f924dce8700 1 --2- 172.21.15.78:0/3895039351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92481541a0 0x7f92480a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f924dce8700 1 -- 172.21.15.78:0/3895039351 >> 172.21.15.78:0/3895039351 conn(0x7f924806a400 msgr2=0x7f92480caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:48.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f924dce8700 1 -- 172.21.15.78:0/3895039351 shutdown_connections 2023-08-17T18:12:48.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.256+0000 7f924dce8700 1 -- 172.21.15.78:0/3895039351 wait complete. 2023-08-17T18:12:48.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.257+0000 7f924dce8700 1 Processor -- start 2023-08-17T18:12:48.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.257+0000 7f924dce8700 1 -- start start 2023-08-17T18:12:48.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f924dce8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92480c0560 0x7f9248063050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f924dce8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92481541a0 0x7f9248063540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f924dce8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9248154580 0x7f92481638f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f924dce8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9248063a30 con 0x7f92481541a0 2023-08-17T18:12:48.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f924dce8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480afa00 con 0x7f92480c0560 2023-08-17T18:12:48.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f924dce8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9248156890 con 0x7f9248154580 2023-08-17T18:12:48.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f9246ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92481541a0 0x7f9248063540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f9246ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92481541a0 0x7f9248063540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38088/0 (socket says 172.21.15.78:38088) 2023-08-17T18:12:48.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f9246ffd700 1 -- 172.21.15.78:0/946199095 learned_addr learned my addr 172.21.15.78:0/946199095 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:48.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f92477fe700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92480c0560 0x7f9248063050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.258+0000 7f9247fff700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9248154580 0x7f92481638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f9246ffd700 1 -- 172.21.15.78:0/946199095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9248154580 msgr2=0x7f92481638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f9246ffd700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9248154580 0x7f92481638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f9246ffd700 1 -- 172.21.15.78:0/946199095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92480c0560 msgr2=0x7f9248063050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f9246ffd700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92480c0560 0x7f9248063050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f9246ffd700 1 -- 172.21.15.78:0/946199095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92380092a0 con 0x7f92481541a0 2023-08-17T18:12:48.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f9246ffd700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92481541a0 0x7f9248063540 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f923c00c4c0 tx=0x7f923c007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f922f7fe700 1 -- 172.21.15.78:0/946199095 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c00ce10 con 0x7f92481541a0 2023-08-17T18:12:48.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f922f7fe700 1 -- 172.21.15.78:0/946199095 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c0072e0 con 0x7f92481541a0 2023-08-17T18:12:48.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f924dce8700 1 -- 172.21.15.78:0/946199095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9240009a20 con 0x7f92481541a0 2023-08-17T18:12:48.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f922f7fe700 1 -- 172.21.15.78:0/946199095 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c0057a0 con 0x7f92481541a0 2023-08-17T18:12:48.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.259+0000 7f924dce8700 1 -- 172.21.15.78:0/946199095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92481565b0 con 0x7f92481541a0 2023-08-17T18:12:48.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.260+0000 7f924dce8700 1 -- 172.21.15.78:0/946199095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92480b0110 con 0x7f92481541a0 2023-08-17T18:12:48.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.260+0000 7f922f7fe700 1 -- 172.21.15.78:0/946199095 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f923c010070 con 0x7f92481541a0 2023-08-17T18:12:48.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.261+0000 7f922f7fe700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f923405ed90 0x7f9234061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.261+0000 7f92477fe700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f923405ed90 0x7f9234061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.261+0000 7f922f7fe700 1 -- 172.21.15.78:0/946199095 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f923c078fd0 con 0x7f92481541a0 2023-08-17T18:12:48.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.261+0000 7f92477fe700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f923405ed90 0x7f9234061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9238009d20 tx=0x7f9238009060).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.265+0000 7f922f7fe700 1 -- 172.21.15.78:0/946199095 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f923c04a6f0 con 0x7f92481541a0 2023-08-17T18:12:48.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.427+0000 7f924dce8700 1 -- 172.21.15.78:0/946199095 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9248047350 con 0x7f923405ed90 2023-08-17T18:12:48.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.427+0000 7f922f7fe700 1 -- 172.21.15.78:0/946199095 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9248047350 con 0x7f923405ed90 2023-08-17T18:12:48.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 -- 172.21.15.78:0/946199095 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f923405ed90 msgr2=0x7f9234061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f923405ed90 0x7f9234061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9238009d20 tx=0x7f9238009060).stop 2023-08-17T18:12:48.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 -- 172.21.15.78:0/946199095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92481541a0 msgr2=0x7f9248063540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92481541a0 0x7f9248063540 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f923c00c4c0 tx=0x7f923c007bf0).stop 2023-08-17T18:12:48.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 -- 172.21.15.78:0/946199095 shutdown_connections 2023-08-17T18:12:48.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f923405ed90 0x7f9234061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9248154580 0x7f92481638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92480c0560 0x7f9248063050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 --2- 172.21.15.78:0/946199095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92481541a0 0x7f9248063540 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 -- 172.21.15.78:0/946199095 >> 172.21.15.78:0/946199095 conn(0x7f924806a400 msgr2=0x7f92480bfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:48.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 -- 172.21.15.78:0/946199095 shutdown_connections 2023-08-17T18:12:48.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.429+0000 7f924dce8700 1 -- 172.21.15.78:0/946199095 wait complete. 2023-08-17T18:12:48.432 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2023-08-17T18:12:48.442 INFO:tasks.ceph:Scrubbing osd.5 2023-08-17T18:12:48.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-17T18:12:48.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.558+0000 7fd841a2e700 1 Processor -- start 2023-08-17T18:12:48.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.558+0000 7fd841a2e700 1 -- start start 2023-08-17T18:12:48.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd841a2e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd83c0aa0f0 0x7fd83c0644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd841a2e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c0649b0 con 0x7fd83c0c5810 2023-08-17T18:12:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd841a2e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c063420 con 0x7fd83c0aa4d0 2023-08-17T18:12:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd841a2e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c063700 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd83affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd83c0aa0f0 0x7fd83c0644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd83affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd83c0aa0f0 0x7fd83c0644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44336/0 (socket says 172.21.15.78:44336) 2023-08-17T18:12:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd83affd700 1 -- 172.21.15.78:0/1897356241 learned_addr learned my addr 172.21.15.78:0/1897356241 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd83b7fe700 1 --1- 172.21.15.78:0/1897356241 >> v1:172.21.15.78:6789/0 conn(0x7fd83c0c5810 0x7fd83c0a7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41794/0 (socket says 172.21.15.78:41794) 2023-08-17T18:12:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd83affd700 1 -- 172.21.15.78:0/1897356241 >> v1:172.21.15.150:6789/0 conn(0x7fd83c0aa4d0 legacy=0x7fd83c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd83affd700 1 -- 172.21.15.78:0/1897356241 >> v1:172.21.15.78:6789/0 conn(0x7fd83c0c5810 legacy=0x7fd83c0a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd83affd700 1 -- 172.21.15.78:0/1897356241 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0639e0 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.559+0000 7fd83affd700 1 --2- 172.21.15.78:0/1897356241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83c0aa0f0 0x7fd83c0644c0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7fd82c006fd0 tx=0x7fd82c0090f0).ready entity=mon.0 client_cookie=42a142d1c7cfd000 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.560+0000 7fd83a7fc700 1 -- 172.21.15.78:0/1897356241 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00b600 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.560+0000 7fd83a7fc700 1 -- 172.21.15.78:0/1897356241 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c00b760 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.560+0000 7fd83a7fc700 1 -- 172.21.15.78:0/1897356241 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00bae0 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.560+0000 7fd841a2e700 1 -- 172.21.15.78:0/1897356241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83c0aa0f0 msgr2=0x7fd83c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.560+0000 7fd841a2e700 1 --2- 172.21.15.78:0/1897356241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83c0aa0f0 0x7fd83c0644c0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7fd82c006fd0 tx=0x7fd82c0090f0).stop 2023-08-17T18:12:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.560+0000 7fd841a2e700 1 -- 172.21.15.78:0/1897356241 shutdown_connections 2023-08-17T18:12:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.560+0000 7fd841a2e700 1 --2- 172.21.15.78:0/1897356241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83c0aa0f0 0x7fd83c0644c0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.560+0000 7fd841a2e700 1 -- 172.21.15.78:0/1897356241 >> 172.21.15.78:0/1897356241 conn(0x7fd83c06a6a0 msgr2=0x7fd83c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.560+0000 7fd841a2e700 1 -- 172.21.15.78:0/1897356241 shutdown_connections 2023-08-17T18:12:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.560+0000 7fd841a2e700 1 -- 172.21.15.78:0/1897356241 wait complete. 2023-08-17T18:12:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.561+0000 7fd841a2e700 1 Processor -- start 2023-08-17T18:12:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.561+0000 7fd841a2e700 1 -- start start 2023-08-17T18:12:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd841a2e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83c0aa0f0 0x7fd83c0aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd841a2e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd83c0aa4d0 0x7fd83c0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd841a2e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd83c0c5810 0x7fd83c164a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd841a2e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c1520d0 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd841a2e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0ab690 con 0x7fd83c0aa4d0 2023-08-17T18:12:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd841a2e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0ab970 con 0x7fd83c0c5810 2023-08-17T18:12:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd83affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83c0aa0f0 0x7fd83c0aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd83affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83c0aa0f0 0x7fd83c0aabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44350/0 (socket says 172.21.15.78:44350) 2023-08-17T18:12:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd83affd700 1 -- 172.21.15.78:0/522931366 learned_addr learned my addr 172.21.15.78:0/522931366 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd83b7fe700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd83c0c5810 0x7fd83c164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.562+0000 7fd8327fc700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd83c0aa4d0 0x7fd83c0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd83affd700 1 -- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd83c0c5810 msgr2=0x7fd83c164a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd83affd700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd83c0c5810 0x7fd83c164a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd83affd700 1 -- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd83c0aa4d0 msgr2=0x7fd83c0ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd83affd700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd83c0aa4d0 0x7fd83c0ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd83affd700 1 -- 172.21.15.78:0/522931366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009370 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd8327fc700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd83c0aa4d0 0x7fd83c0ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd83b7fe700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd83c0c5810 0x7fd83c164a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd83affd700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83c0aa0f0 0x7fd83c0aabf0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7fd83c05e180 tx=0x7fd82c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd8337fe700 1 -- 172.21.15.78:0/522931366 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00bae0 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd8337fe700 1 -- 172.21.15.78:0/522931366 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c000c90 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c0abc50 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd8337fe700 1 -- 172.21.15.78:0/522931366 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c01c650 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.563+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c0ac210 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.564+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd83c083980 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.564+0000 7fd8337fe700 1 -- 172.21.15.78:0/522931366 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd82c02c070 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.565+0000 7fd8337fe700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd81c05ed90 0x7fd81c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.565+0000 7fd8337fe700 1 -- 172.21.15.78:0/522931366 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7fd82c07b740 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.565+0000 7fd8327fc700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd81c05ed90 0x7fd81c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.565+0000 7fd8337fe700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] conn(0x7fd81c065670 0x7fd81c067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.565+0000 7fd8337fe700 1 -- 172.21.15.78:0/522931366 --> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd81c068150 con 0x7fd81c065670 2023-08-17T18:12:48.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.565+0000 7fd8337fe700 1 -- 172.21.15.78:0/522931366 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd82c07ddb0 con 0x7fd83c0aa0f0 2023-08-17T18:12:48.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.565+0000 7fd83b7fe700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] conn(0x7fd81c065670 0x7fd81c067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.565+0000 7fd8327fc700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd81c05ed90 0x7fd81c061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd83c155590 tx=0x7fd824009040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.565+0000 7fd83b7fe700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] conn(0x7fd81c065670 0x7fd81c067ad0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.566+0000 7fd8337fe700 1 -- 172.21.15.78:0/522931366 <== osd.5 v2:172.21.15.150:6824/90972 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd81c068150 con 0x7fd81c065670 2023-08-17T18:12:48.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.579+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 --> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd83c046af0 con 0x7fd81c065670 2023-08-17T18:12:48.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.579+0000 7fd8337fe700 1 -- 172.21.15.78:0/522931366 <== osd.5 v2:172.21.15.150:6824/90972 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd83c046af0 con 0x7fd81c065670 2023-08-17T18:12:48.580 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:12:48.581 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T18:12:48.581 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:12:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] conn(0x7fd81c065670 msgr2=0x7fd81c067ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd841a2e700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.150:6824/90972,v1:172.21.15.150:6825/90972] conn(0x7fd81c065670 0x7fd81c067ad0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd81c05ed90 msgr2=0x7fd81c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd841a2e700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7fd81c05ed90 0x7fd81c061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd83c155590 tx=0x7fd824009040).stop 2023-08-17T18:12:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83c0aa0f0 msgr2=0x7fd83c0aabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd841a2e700 1 --2- 172.21.15.78:0/522931366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83c0aa0f0 0x7fd83c0aabf0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7fd83c05e180 tx=0x7fd82c017000).stop 2023-08-17T18:12:48.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd83b7fe700 1 -- 172.21.15.78:0/522931366 reap_dead start 2023-08-17T18:12:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 shutdown_connections 2023-08-17T18:12:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 >> 172.21.15.78:0/522931366 conn(0x7fd83c06a6a0 msgr2=0x7fd83c153bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 shutdown_connections 2023-08-17T18:12:48.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.580+0000 7fd841a2e700 1 -- 172.21.15.78:0/522931366 wait complete. 2023-08-17T18:12:48.592 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-17T18:12:48.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.704+0000 7f1e8807f700 1 Processor -- start 2023-08-17T18:12:48.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.704+0000 7f1e8807f700 1 -- start start 2023-08-17T18:12:48.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8807f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1e80154580 0x7f1e800a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8807f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1e800c0560 0x7f1e800c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8807f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e800c8df0 con 0x7f1e801541a0 2023-08-17T18:12:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8807f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e800a8190 con 0x7f1e80154580 2023-08-17T18:12:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8807f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e800c9970 con 0x7f1e800c0560 2023-08-17T18:12:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8561a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1e80154580 0x7f1e800a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8561a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1e80154580 0x7f1e800a7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44352/0 (socket says 172.21.15.78:44352) 2023-08-17T18:12:48.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8561a700 1 -- 172.21.15.78:0/2539340226 learned_addr learned my addr 172.21.15.78:0/2539340226 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:48.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e85e1b700 1 --1- 172.21.15.78:0/2539340226 >> v1:172.21.15.78:6789/0 conn(0x7f1e801541a0 0x7f1e800bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41804/0 (socket says 172.21.15.78:41804) 2023-08-17T18:12:48.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8661c700 1 --2- 172.21.15.78:0/2539340226 >> v2:172.21.15.150:3300/0 conn(0x7f1e800c0560 0x7f1e800c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8561a700 1 -- 172.21.15.78:0/2539340226 >> v2:172.21.15.150:3300/0 conn(0x7f1e800c0560 msgr2=0x7f1e800c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:48.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.705+0000 7f1e8561a700 1 --2- 172.21.15.78:0/2539340226 >> v2:172.21.15.150:3300/0 conn(0x7f1e800c0560 0x7f1e800c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8561a700 1 -- 172.21.15.78:0/2539340226 >> v1:172.21.15.78:6789/0 conn(0x7f1e801541a0 legacy=0x7f1e800bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8561a700 1 -- 172.21.15.78:0/2539340226 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800c9040 con 0x7f1e80154580 2023-08-17T18:12:48.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8561a700 1 --2- 172.21.15.78:0/2539340226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e80154580 0x7f1e800a7ca0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f1e80157d80 tx=0x7f1e700090f0).ready entity=mon.0 client_cookie=e6831b1338c44b13 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e84e19700 1 -- 172.21.15.78:0/2539340226 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000b600 con 0x7f1e80154580 2023-08-17T18:12:48.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e84e19700 1 -- 172.21.15.78:0/2539340226 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7000b760 con 0x7f1e80154580 2023-08-17T18:12:48.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e84e19700 1 -- 172.21.15.78:0/2539340226 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000bb00 con 0x7f1e80154580 2023-08-17T18:12:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8807f700 1 -- 172.21.15.78:0/2539340226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e80154580 msgr2=0x7f1e800a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8807f700 1 --2- 172.21.15.78:0/2539340226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e80154580 0x7f1e800a7ca0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f1e80157d80 tx=0x7f1e700090f0).stop 2023-08-17T18:12:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8807f700 1 -- 172.21.15.78:0/2539340226 shutdown_connections 2023-08-17T18:12:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8807f700 1 --2- 172.21.15.78:0/2539340226 >> v2:172.21.15.150:3300/0 conn(0x7f1e800c0560 0x7f1e800c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8807f700 1 --2- 172.21.15.78:0/2539340226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e80154580 0x7f1e800a7ca0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8807f700 1 -- 172.21.15.78:0/2539340226 >> 172.21.15.78:0/2539340226 conn(0x7f1e8006a400 msgr2=0x7f1e800caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8807f700 1 -- 172.21.15.78:0/2539340226 shutdown_connections 2023-08-17T18:12:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.706+0000 7f1e8807f700 1 -- 172.21.15.78:0/2539340226 wait complete. 2023-08-17T18:12:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.707+0000 7f1e8807f700 1 Processor -- start 2023-08-17T18:12:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.707+0000 7f1e8807f700 1 -- start start 2023-08-17T18:12:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.708+0000 7f1e8807f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e800c0560 0x7f1e800ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.708+0000 7f1e8807f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e801541a0 0x7f1e80146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.708+0000 7f1e8807f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e80154580 0x7f1e80152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.708+0000 7f1e8807f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80167730 con 0x7f1e800c0560 2023-08-17T18:12:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.708+0000 7f1e8807f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e801682b0 con 0x7f1e80154580 2023-08-17T18:12:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.708+0000 7f1e8807f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80167980 con 0x7f1e801541a0 2023-08-17T18:12:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.708+0000 7f1e85e1b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e800c0560 0x7f1e800ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.708+0000 7f1e85e1b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e800c0560 0x7f1e800ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44368/0 (socket says 172.21.15.78:44368) 2023-08-17T18:12:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.708+0000 7f1e85e1b700 1 -- 172.21.15.78:0/205957778 learned_addr learned my addr 172.21.15.78:0/205957778 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e8661c700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e80154580 0x7f1e80152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e8561a700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e801541a0 0x7f1e80146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e85e1b700 1 -- 172.21.15.78:0/205957778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e801541a0 msgr2=0x7f1e80146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e85e1b700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e801541a0 0x7f1e80146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e85e1b700 1 -- 172.21.15.78:0/205957778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e80154580 msgr2=0x7f1e80152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e85e1b700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e80154580 0x7f1e80152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e85e1b700 1 -- 172.21.15.78:0/205957778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70009370 con 0x7f1e800c0560 2023-08-17T18:12:48.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e8561a700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e801541a0 0x7f1e80146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:12:48.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e85e1b700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e800c0560 0x7f1e800ad6c0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7f1e7c00c4c0 tx=0x7f1e7c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e75ffb700 1 -- 172.21.15.78:0/205957778 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0072e0 con 0x7f1e800c0560 2023-08-17T18:12:48.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e75ffb700 1 -- 172.21.15.78:0/205957778 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c007440 con 0x7f1e800c0560 2023-08-17T18:12:48.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e75ffb700 1 -- 172.21.15.78:0/205957778 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0058f0 con 0x7f1e800c0560 2023-08-17T18:12:48.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e8807f700 1 -- 172.21.15.78:0/205957778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e80167c60 con 0x7f1e800c0560 2023-08-17T18:12:48.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.709+0000 7f1e8807f700 1 -- 172.21.15.78:0/205957778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e80146ef0 con 0x7f1e800c0560 2023-08-17T18:12:48.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.710+0000 7f1e8807f700 1 -- 172.21.15.78:0/205957778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e80047350 con 0x7f1e800c0560 2023-08-17T18:12:48.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.710+0000 7f1e75ffb700 1 -- 172.21.15.78:0/205957778 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1e7c010070 con 0x7f1e800c0560 2023-08-17T18:12:48.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.710+0000 7f1e75ffb700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f1e6405ed90 0x7f1e64061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:48.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.711+0000 7f1e75ffb700 1 -- 172.21.15.78:0/205957778 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f1e7c078f80 con 0x7f1e800c0560 2023-08-17T18:12:48.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.711+0000 7f1e8561a700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f1e6405ed90 0x7f1e64061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:48.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.711+0000 7f1e8561a700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f1e6405ed90 0x7f1e64061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1e80157d80 tx=0x7f1e70017000).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:48.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.714+0000 7f1e75ffb700 1 -- 172.21.15.78:0/205957778 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e7c04a6a0 con 0x7f1e800c0560 2023-08-17T18:12:48.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.876+0000 7f1e8807f700 1 -- 172.21.15.78:0/205957778 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e801683f0 con 0x7f1e6405ed90 2023-08-17T18:12:48.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.876+0000 7f1e75ffb700 1 -- 172.21.15.78:0/205957778 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1e70000bc0 con 0x7f1e6405ed90 2023-08-17T18:12:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 -- 172.21.15.78:0/205957778 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f1e6405ed90 msgr2=0x7f1e64061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f1e6405ed90 0x7f1e64061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1e80157d80 tx=0x7f1e70017000).stop 2023-08-17T18:12:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 -- 172.21.15.78:0/205957778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e800c0560 msgr2=0x7f1e800ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e800c0560 0x7f1e800ad6c0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7f1e7c00c4c0 tx=0x7f1e7c007db0).stop 2023-08-17T18:12:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 -- 172.21.15.78:0/205957778 shutdown_connections 2023-08-17T18:12:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f1e6405ed90 0x7f1e64061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e80154580 0x7f1e80152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e800c0560 0x7f1e800ad6c0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 --2- 172.21.15.78:0/205957778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e801541a0 0x7f1e80146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 -- 172.21.15.78:0/205957778 >> 172.21.15.78:0/205957778 conn(0x7f1e8006a400 msgr2=0x7f1e80159ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 -- 172.21.15.78:0/205957778 shutdown_connections 2023-08-17T18:12:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:48.878+0000 7f1e8807f700 1 -- 172.21.15.78:0/205957778 wait complete. 2023-08-17T18:12:48.881 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2023-08-17T18:12:48.890 INFO:tasks.ceph:Scrubbing osd.6 2023-08-17T18:12:48.891 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-17T18:12:49.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.008+0000 7f31568e3700 1 Processor -- start 2023-08-17T18:12:49.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.008+0000 7f31568e3700 1 -- start start 2023-08-17T18:12:49.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.008+0000 7f31568e3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31500c5f20 0x7f31500644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.008+0000 7f31568e3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31500649b0 con 0x7f31500aa0f0 2023-08-17T18:12:49.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.008+0000 7f31568e3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3150063420 con 0x7f31500aa4d0 2023-08-17T18:12:49.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f31568e3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3150063700 con 0x7f31500c5f20 2023-08-17T18:12:49.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f31500aa0f0 0x7f31500c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41806/0 (socket says 172.21.15.78:41806) 2023-08-17T18:12:49.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314ffff700 1 -- 172.21.15.78:0/4039368658 learned_addr learned my addr 172.21.15.78:0/4039368658 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:49.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f3154e80700 1 --2- 172.21.15.78:0/4039368658 >> v2:172.21.15.150:3300/0 conn(0x7f31500c5f20 0x7f31500644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725971047 0 0) 0x7f31500649b0 con 0x7f31500aa0f0 2023-08-17T18:12:49.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31380033f0 con 0x7f31500aa0f0 2023-08-17T18:12:49.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469976814 0 0) 0x7f3150063420 con 0x7f31500aa4d0 2023-08-17T18:12:49.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31500649b0 con 0x7f31500aa4d0 2023-08-17T18:12:49.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 357966439 0 0) 0x7f31380033f0 con 0x7f31500aa0f0 2023-08-17T18:12:49.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 >> v2:172.21.15.150:3300/0 conn(0x7f31500c5f20 msgr2=0x7f31500644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:49.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 --2- 172.21.15.78:0/4039368658 >> v2:172.21.15.150:3300/0 conn(0x7f31500c5f20 0x7f31500644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 >> v1:172.21.15.150:6789/0 conn(0x7f31500aa4d0 legacy=0x7f31500c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31500639e0 con 0x7f31500aa0f0 2023-08-17T18:12:49.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1022515631 0 0) 0x7f3140001470 con 0x7f31500aa0f0 2023-08-17T18:12:49.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 >> v1:172.21.15.78:6789/0 conn(0x7f31500aa0f0 legacy=0x7f31500c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3138003ac0 0x7f3138003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3138004690 0x7f3138004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3138005000 0x7f313800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3150063700 con 0x7f3138004690 2023-08-17T18:12:49.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313800beb0 con 0x7f3138005000 2023-08-17T18:12:49.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313800c070 con 0x7f3138003ac0 2023-08-17T18:12:49.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314f7fe700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3138004690 0x7f3138004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.009+0000 7f314ffff700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3138003ac0 0x7f3138003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f3154e80700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3138005000 0x7f313800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f314f7fe700 1 -- 172.21.15.78:0/4039368658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3138003ac0 msgr2=0x7f3138003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:49.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f314f7fe700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3138003ac0 0x7f3138003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f314f7fe700 1 -- 172.21.15.78:0/4039368658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3138005000 msgr2=0x7f313800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:49.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f314f7fe700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3138005000 0x7f313800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f314f7fe700 1 -- 172.21.15.78:0/4039368658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31380033f0 con 0x7f3138004690 2023-08-17T18:12:49.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f3154e80700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3138005000 0x7f313800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:49.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f3154e80700 1 -- 172.21.15.78:0/4039368658 reap_dead start 2023-08-17T18:12:49.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f314f7fe700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3138004690 0x7f3138004b10 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7f3144001860 tx=0x7f3144007bb0).ready entity=mon.0 client_cookie=b954f2258a79faa2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144007020 con 0x7f3138004690 2023-08-17T18:12:49.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144007180 con 0x7f3138004690 2023-08-17T18:12:49.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f314effd700 1 -- 172.21.15.78:0/4039368658 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144007520 con 0x7f3138004690 2023-08-17T18:12:49.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f31568e3700 1 -- 172.21.15.78:0/4039368658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3138004690 msgr2=0x7f3138004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f31568e3700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3138004690 0x7f3138004b10 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7f3144001860 tx=0x7f3144007bb0).stop 2023-08-17T18:12:49.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f31568e3700 1 -- 172.21.15.78:0/4039368658 shutdown_connections 2023-08-17T18:12:49.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f31568e3700 1 --2- 172.21.15.78:0/4039368658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3138004690 0x7f3138004b10 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f31568e3700 1 -- 172.21.15.78:0/4039368658 >> 172.21.15.78:0/4039368658 conn(0x7f315006a6a0 msgr2=0x7f31500caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:49.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f31568e3700 1 -- 172.21.15.78:0/4039368658 shutdown_connections 2023-08-17T18:12:49.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.010+0000 7f31568e3700 1 -- 172.21.15.78:0/4039368658 wait complete. 2023-08-17T18:12:49.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.012+0000 7f31568e3700 1 Processor -- start 2023-08-17T18:12:49.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.012+0000 7f31568e3700 1 -- start start 2023-08-17T18:12:49.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.012+0000 7f31568e3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3138004690 0x7f3150165b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.012+0000 7f31568e3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f315014f860 0x7f31500c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.012+0000 7f31568e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31500c28c0 0x7f31500a8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f31568e3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3150166050 con 0x7f31500c28c0 2023-08-17T18:12:49.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f31568e3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31500c4eb0 con 0x7f315014f860 2023-08-17T18:12:49.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f31568e3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31500c4020 con 0x7f3138004690 2023-08-17T18:12:49.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3154e80700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31500c28c0 0x7f31500a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3154e80700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31500c28c0 0x7f31500a8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44382/0 (socket says 172.21.15.78:44382) 2023-08-17T18:12:49.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3154e80700 1 -- 172.21.15.78:0/2679557963 learned_addr learned my addr 172.21.15.78:0/2679557963 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:49.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3154e80700 1 -- 172.21.15.78:0/2679557963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3138004690 msgr2=0x7f3150165b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3154e80700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3138004690 0x7f3150165b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T18:12:49.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f314f7fe700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f315014f860 0x7f31500c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3154e80700 1 -- 172.21.15.78:0/2679557963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f315014f860 msgr2=0x7f31500c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3154e80700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f315014f860 0x7f31500c23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3154e80700 1 -- 172.21.15.78:0/2679557963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31500c42a0 con 0x7f31500c28c0 2023-08-17T18:12:49.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3154e80700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31500c28c0 0x7f31500a8130 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7f315005e200 tx=0x7f314800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3137fff700 1 -- 172.21.15.78:0/2679557963 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800e030 con 0x7f31500c28c0 2023-08-17T18:12:49.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3137fff700 1 -- 172.21.15.78:0/2679557963 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800f040 con 0x7f31500c28c0 2023-08-17T18:12:49.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31500c4580 con 0x7f31500c28c0 2023-08-17T18:12:49.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f3137fff700 1 -- 172.21.15.78:0/2679557963 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148010e30 con 0x7f31500c28c0 2023-08-17T18:12:49.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.013+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31500c4b40 con 0x7f31500c28c0 2023-08-17T18:12:49.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.014+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3150083980 con 0x7f31500c28c0 2023-08-17T18:12:49.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.014+0000 7f3137fff700 1 -- 172.21.15.78:0/2679557963 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3148015690 con 0x7f31500c28c0 2023-08-17T18:12:49.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.015+0000 7f3137fff700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313c05ed90 0x7f313c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.015+0000 7f3137fff700 1 -- 172.21.15.78:0/2679557963 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f314807a3b0 con 0x7f31500c28c0 2023-08-17T18:12:49.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.015+0000 7f314ffff700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313c05ed90 0x7f313c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.015+0000 7f3137fff700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] conn(0x7f313c065670 0x7f313c067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.015+0000 7f3137fff700 1 -- 172.21.15.78:0/2679557963 --> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f313c068150 con 0x7f313c065670 2023-08-17T18:12:49.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.015+0000 7f3137fff700 1 -- 172.21.15.78:0/2679557963 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) v2 ==== 24+0+0 (secure 0 0 0) 0x7f314807ca20 con 0x7f31500c28c0 2023-08-17T18:12:49.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.015+0000 7f314ffff700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313c05ed90 0x7f313c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3140007a60 tx=0x7f3140001d20).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.015+0000 7f314f7fe700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] conn(0x7f313c065670 0x7f313c067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.016+0000 7f314f7fe700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] conn(0x7f313c065670 0x7f313c067ad0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.016+0000 7f3137fff700 1 -- 172.21.15.78:0/2679557963 <== osd.6 v2:172.21.15.150:6800/90934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f313c068150 con 0x7f313c065670 2023-08-17T18:12:49.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.029+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 --> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3150046af0 con 0x7f313c065670 2023-08-17T18:12:49.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.030+0000 7f3137fff700 1 -- 172.21.15.78:0/2679557963 <== osd.6 v2:172.21.15.150:6800/90934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3150046af0 con 0x7f313c065670 2023-08-17T18:12:49.031 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:12:49.031 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T18:12:49.031 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:12:49.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.030+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 >> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] conn(0x7f313c065670 msgr2=0x7f313c067ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.030+0000 7f31568e3700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.150:6800/90934,v1:172.21.15.150:6801/90934] conn(0x7f313c065670 0x7f313c067ad0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.030+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313c05ed90 msgr2=0x7f313c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.030+0000 7f31568e3700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f313c05ed90 0x7f313c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3140007a60 tx=0x7f3140001d20).stop 2023-08-17T18:12:49.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.030+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31500c28c0 msgr2=0x7f31500a8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.030+0000 7f31568e3700 1 --2- 172.21.15.78:0/2679557963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31500c28c0 0x7f31500a8130 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7f315005e200 tx=0x7f314800b040).stop 2023-08-17T18:12:49.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.030+0000 7f3154e80700 1 -- 172.21.15.78:0/2679557963 reap_dead start 2023-08-17T18:12:49.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.030+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 shutdown_connections 2023-08-17T18:12:49.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.030+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 >> 172.21.15.78:0/2679557963 conn(0x7f315006a6a0 msgr2=0x7f31500c5810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:49.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.031+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 shutdown_connections 2023-08-17T18:12:49.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.031+0000 7f31568e3700 1 -- 172.21.15.78:0/2679557963 wait complete. 2023-08-17T18:12:49.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-17T18:12:49.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.156+0000 7ff573c3f700 1 Processor -- start 2023-08-17T18:12:49.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.156+0000 7ff573c3f700 1 -- start start 2023-08-17T18:12:49.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.157+0000 7ff573c3f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 0x7ff56c064720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.157+0000 7ff573c3f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff56c0bec60 0x7ff56c0c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.157+0000 7ff573c3f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c0c7860 con 0x7ff56c064340 2023-08-17T18:12:49.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.157+0000 7ff573c3f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0638b0 con 0x7ff56c0bec60 2023-08-17T18:12:49.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.157+0000 7ff573c3f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0a8680 con 0x7ff56c0c98b0 2023-08-17T18:12:49.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5721dc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff56c0bec60 0x7ff56c0c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5719db700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff56c064340 0x7ff56c0c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.78:34294/0 (socket says 172.21.15.78:34294) 2023-08-17T18:12:49.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5711da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 0x7ff56c064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5719db700 1 -- 172.21.15.78:0/1409445289 learned_addr learned my addr 172.21.15.78:0/1409445289 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:49.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5711da700 1 -- 172.21.15.78:0/1409445289 >> v2:172.21.15.150:3300/0 conn(0x7ff56c0bec60 msgr2=0x7ff56c0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:49.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5711da700 1 --2- 172.21.15.78:0/1409445289 >> v2:172.21.15.150:3300/0 conn(0x7ff56c0bec60 0x7ff56c0c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5711da700 1 -- 172.21.15.78:0/1409445289 >> v1:172.21.15.150:6789/0 conn(0x7ff56c064340 legacy=0x7ff56c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5711da700 1 -- 172.21.15.78:0/1409445289 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c0c6c90 con 0x7ff56c0c98b0 2023-08-17T18:12:49.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5711da700 1 --2- 172.21.15.78:0/1409445289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 0x7ff56c064720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff55c009760 tx=0x7ff55c009060).ready entity=mon.2 client_cookie=7cd322e71fe655b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5709d9700 1 -- 172.21.15.78:0/1409445289 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00f510 con 0x7ff56c0c98b0 2023-08-17T18:12:49.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5709d9700 1 -- 172.21.15.78:0/1409445289 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00f670 con 0x7ff56c0c98b0 2023-08-17T18:12:49.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.158+0000 7ff5709d9700 1 -- 172.21.15.78:0/1409445289 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00f9f0 con 0x7ff56c0c98b0 2023-08-17T18:12:49.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.159+0000 7ff573c3f700 1 -- 172.21.15.78:0/1409445289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 msgr2=0x7ff56c064720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.159+0000 7ff573c3f700 1 --2- 172.21.15.78:0/1409445289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 0x7ff56c064720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff55c009760 tx=0x7ff55c009060).stop 2023-08-17T18:12:49.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.159+0000 7ff573c3f700 1 -- 172.21.15.78:0/1409445289 shutdown_connections 2023-08-17T18:12:49.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.159+0000 7ff573c3f700 1 --2- 172.21.15.78:0/1409445289 >> v2:172.21.15.150:3300/0 conn(0x7ff56c0bec60 0x7ff56c0c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.159+0000 7ff573c3f700 1 --2- 172.21.15.78:0/1409445289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 0x7ff56c064720 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.159+0000 7ff573c3f700 1 -- 172.21.15.78:0/1409445289 >> 172.21.15.78:0/1409445289 conn(0x7ff56c062cd0 msgr2=0x7ff56c0c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:49.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.159+0000 7ff573c3f700 1 -- 172.21.15.78:0/1409445289 shutdown_connections 2023-08-17T18:12:49.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.159+0000 7ff573c3f700 1 -- 172.21.15.78:0/1409445289 wait complete. 2023-08-17T18:12:49.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.160+0000 7ff573c3f700 1 Processor -- start 2023-08-17T18:12:49.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.160+0000 7ff573c3f700 1 -- start start 2023-08-17T18:12:49.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff573c3f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff56c064340 0x7ff56c0a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff573c3f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff56c0bec60 0x7ff56c0ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff573c3f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 0x7ff56c164980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff573c3f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c157ce0 con 0x7ff56c064340 2023-08-17T18:12:49.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff573c3f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c153410 con 0x7ff56c0bec60 2023-08-17T18:12:49.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff573c3f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c157e50 con 0x7ff56c0c98b0 2023-08-17T18:12:49.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5719db700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff56c064340 0x7ff56c0a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5719db700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff56c064340 0x7ff56c0a91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44396/0 (socket says 172.21.15.78:44396) 2023-08-17T18:12:49.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5719db700 1 -- 172.21.15.78:0/3101612255 learned_addr learned my addr 172.21.15.78:0/3101612255 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:49.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5721dc700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 0x7ff56c164980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5711da700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff56c0bec60 0x7ff56c0ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5719db700 1 -- 172.21.15.78:0/3101612255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 msgr2=0x7ff56c164980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5719db700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 0x7ff56c164980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5719db700 1 -- 172.21.15.78:0/3101612255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff56c0bec60 msgr2=0x7ff56c0ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5719db700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff56c0bec60 0x7ff56c0ab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5719db700 1 -- 172.21.15.78:0/3101612255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c0092a0 con 0x7ff56c064340 2023-08-17T18:12:49.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5711da700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff56c0bec60 0x7ff56c0ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T18:12:49.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff5719db700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff56c064340 0x7ff56c0a91a0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7ff56800c7c0 tx=0x7ff568001590).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff561ffb700 1 -- 172.21.15.78:0/3101612255 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568005d30 con 0x7ff56c064340 2023-08-17T18:12:49.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff561ffb700 1 -- 172.21.15.78:0/3101612255 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff568005e90 con 0x7ff56c064340 2023-08-17T18:12:49.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff573c3f700 1 -- 172.21.15.78:0/3101612255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c0a97a0 con 0x7ff56c064340 2023-08-17T18:12:49.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.161+0000 7ff561ffb700 1 -- 172.21.15.78:0/3101612255 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680072e0 con 0x7ff56c064340 2023-08-17T18:12:49.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.162+0000 7ff573c3f700 1 -- 172.21.15.78:0/3101612255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c0a9de0 con 0x7ff56c064340 2023-08-17T18:12:49.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.163+0000 7ff573c3f700 1 -- 172.21.15.78:0/3101612255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c047350 con 0x7ff56c064340 2023-08-17T18:12:49.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.163+0000 7ff561ffb700 1 -- 172.21.15.78:0/3101612255 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff568010070 con 0x7ff56c064340 2023-08-17T18:12:49.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.163+0000 7ff561ffb700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff55005ed90 0x7ff550061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.163+0000 7ff561ffb700 1 -- 172.21.15.78:0/3101612255 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7ff568079290 con 0x7ff56c064340 2023-08-17T18:12:49.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.163+0000 7ff5711da700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff55005ed90 0x7ff550061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.164+0000 7ff5711da700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff55005ed90 0x7ff550061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff56c0c9cf0 tx=0x7ff55c017000).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.167+0000 7ff561ffb700 1 -- 172.21.15.78:0/3101612255 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff56804a9b0 con 0x7ff56c064340 2023-08-17T18:12:49.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.332+0000 7ff573c3f700 1 -- 172.21.15.78:0/3101612255 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ff56c0c6f30 con 0x7ff55005ed90 2023-08-17T18:12:49.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.333+0000 7ff561ffb700 1 -- 172.21.15.78:0/3101612255 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff56c0c6f30 con 0x7ff55005ed90 2023-08-17T18:12:49.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.334+0000 7ff573c3f700 1 -- 172.21.15.78:0/3101612255 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff55005ed90 msgr2=0x7ff550061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.334+0000 7ff573c3f700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff55005ed90 0x7ff550061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff56c0c9cf0 tx=0x7ff55c017000).stop 2023-08-17T18:12:49.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.334+0000 7ff573c3f700 1 -- 172.21.15.78:0/3101612255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff56c064340 msgr2=0x7ff56c0a91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.334+0000 7ff573c3f700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff56c064340 0x7ff56c0a91a0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7ff56800c7c0 tx=0x7ff568001590).stop 2023-08-17T18:12:49.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.334+0000 7ff573c3f700 1 -- 172.21.15.78:0/3101612255 shutdown_connections 2023-08-17T18:12:49.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.334+0000 7ff573c3f700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7ff55005ed90 0x7ff550061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.334+0000 7ff573c3f700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff56c0c98b0 0x7ff56c164980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.334+0000 7ff573c3f700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff56c064340 0x7ff56c0a91a0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.334+0000 7ff573c3f700 1 --2- 172.21.15.78:0/3101612255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff56c0bec60 0x7ff56c0ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.334+0000 7ff573c3f700 1 -- 172.21.15.78:0/3101612255 >> 172.21.15.78:0/3101612255 conn(0x7ff56c062cd0 msgr2=0x7ff56c15a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:49.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.335+0000 7ff573c3f700 1 -- 172.21.15.78:0/3101612255 shutdown_connections 2023-08-17T18:12:49.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.335+0000 7ff573c3f700 1 -- 172.21.15.78:0/3101612255 wait complete. 2023-08-17T18:12:49.337 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2023-08-17T18:12:49.347 INFO:tasks.ceph:Scrubbing osd.7 2023-08-17T18:12:49.347 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-17T18:12:49.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.462+0000 7f8bb9823700 1 Processor -- start 2023-08-17T18:12:49.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.462+0000 7f8bb9823700 1 -- start start 2023-08-17T18:12:49.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb9823700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb413a740 0x7f8bb4069f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb9823700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8bb40624f0 0x7f8bb4062970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb9823700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8bb41545e0 0x7f8bb4154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb9823700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb4155640 con 0x7f8bb41545e0 2023-08-17T18:12:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb9823700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb4069b00 con 0x7f8bb40624f0 2023-08-17T18:12:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb9823700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4062e60 con 0x7f8bb413a740 2023-08-17T18:12:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8bb41545e0 0x7f8bb4154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8bb41545e0 0x7f8bb4154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44398/0 (socket says 172.21.15.78:44398) 2023-08-17T18:12:49.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb37fe700 1 -- 172.21.15.78:0/338387766 learned_addr learned my addr 172.21.15.78:0/338387766 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:49.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8baa7fc700 1 --2- 172.21.15.78:0/338387766 >> v2:172.21.15.150:3300/0 conn(0x7f8bb40624f0 0x7f8bb4062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb2ffd700 1 --2- 172.21.15.78:0/338387766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb413a740 0x7f8bb4069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb37fe700 1 -- 172.21.15.78:0/338387766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb413a740 msgr2=0x7f8bb4069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:49.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb37fe700 1 --2- 172.21.15.78:0/338387766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb413a740 0x7f8bb4069f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb37fe700 1 -- 172.21.15.78:0/338387766 >> v2:172.21.15.150:3300/0 conn(0x7f8bb40624f0 msgr2=0x7f8bb4062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:49.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb37fe700 1 --2- 172.21.15.78:0/338387766 >> v2:172.21.15.150:3300/0 conn(0x7f8bb40624f0 0x7f8bb4062970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb37fe700 1 -- 172.21.15.78:0/338387766 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb413ab20 con 0x7f8bb41545e0 2023-08-17T18:12:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.463+0000 7f8bb2ffd700 1 --2- 172.21.15.78:0/338387766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb413a740 0x7f8bb4069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb37fe700 1 --2- 172.21.15.78:0/338387766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb41545e0 0x7f8bb4154a90 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f8bb40672f0 tx=0x7f8bac009840).ready entity=mon.0 client_cookie=48f498b7c0db5cf9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb27fc700 1 -- 172.21.15.78:0/338387766 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00e070 con 0x7f8bb41545e0 2023-08-17T18:12:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb27fc700 1 -- 172.21.15.78:0/338387766 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac00ba20 con 0x7f8bb41545e0 2023-08-17T18:12:49.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb27fc700 1 -- 172.21.15.78:0/338387766 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00bda0 con 0x7f8bb41545e0 2023-08-17T18:12:49.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb9823700 1 -- 172.21.15.78:0/338387766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb41545e0 msgr2=0x7f8bb4154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb9823700 1 --2- 172.21.15.78:0/338387766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb41545e0 0x7f8bb4154a90 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f8bb40672f0 tx=0x7f8bac009840).stop 2023-08-17T18:12:49.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb9823700 1 -- 172.21.15.78:0/338387766 shutdown_connections 2023-08-17T18:12:49.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb9823700 1 --2- 172.21.15.78:0/338387766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb41545e0 0x7f8bb4154a90 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb9823700 1 --2- 172.21.15.78:0/338387766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb413a740 0x7f8bb4069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb9823700 1 --2- 172.21.15.78:0/338387766 >> v2:172.21.15.150:3300/0 conn(0x7f8bb40624f0 0x7f8bb4062970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb9823700 1 -- 172.21.15.78:0/338387766 >> 172.21.15.78:0/338387766 conn(0x7f8bb40c7b80 msgr2=0x7f8bb40c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb9823700 1 -- 172.21.15.78:0/338387766 shutdown_connections 2023-08-17T18:12:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.464+0000 7f8bb9823700 1 -- 172.21.15.78:0/338387766 wait complete. 2023-08-17T18:12:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.465+0000 7f8bb9823700 1 Processor -- start 2023-08-17T18:12:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.465+0000 7f8bb9823700 1 -- start start 2023-08-17T18:12:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8bb9823700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb40624f0 0x7f8bb4153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8bb9823700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb413a740 0x7f8bb40a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8bb9823700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb41545e0 0x7f8bb40a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8bb9823700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40a8560 con 0x7f8bb413a740 2023-08-17T18:12:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8bb9823700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4153d30 con 0x7f8bb40624f0 2023-08-17T18:12:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8bb9823700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40a7950 con 0x7f8bb41545e0 2023-08-17T18:12:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8baa7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb413a740 0x7f8bb40a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8baa7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb413a740 0x7f8bb40a9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44408/0 (socket says 172.21.15.78:44408) 2023-08-17T18:12:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8baa7fc700 1 -- 172.21.15.78:0/857349119 learned_addr learned my addr 172.21.15.78:0/857349119 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8bb2ffd700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb40624f0 0x7f8bb4153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.466+0000 7f8bb37fe700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb41545e0 0x7f8bb40a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8baa7fc700 1 -- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb41545e0 msgr2=0x7f8bb40a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8baa7fc700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bb41545e0 0x7f8bb40a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8baa7fc700 1 -- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb40624f0 msgr2=0x7f8bb4153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8baa7fc700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bb40624f0 0x7f8bb4153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8baa7fc700 1 -- 172.21.15.78:0/857349119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac009ae0 con 0x7f8bb413a740 2023-08-17T18:12:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8baa7fc700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb413a740 0x7f8bb40a9f50 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f8b9c00e900 tx=0x7f8b9c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8bab7fe700 1 -- 172.21.15.78:0/857349119 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c012600 con 0x7f8bb413a740 2023-08-17T18:12:49.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8bab7fe700 1 -- 172.21.15.78:0/857349119 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c012760 con 0x7f8bb413a740 2023-08-17T18:12:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb40a7c30 con 0x7f8bb413a740 2023-08-17T18:12:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8bab7fe700 1 -- 172.21.15.78:0/857349119 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c012ae0 con 0x7f8bb413a740 2023-08-17T18:12:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.467+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb40a81f0 con 0x7f8bb413a740 2023-08-17T18:12:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.468+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bb4068270 con 0x7f8bb413a740 2023-08-17T18:12:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.468+0000 7f8bab7fe700 1 -- 172.21.15.78:0/857349119 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8b9c022070 con 0x7f8bb413a740 2023-08-17T18:12:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.468+0000 7f8bab7fe700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8b9405ed90 0x7f8b94061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.468+0000 7f8bab7fe700 1 -- 172.21.15.78:0/857349119 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f8b9c079ce0 con 0x7f8bb413a740 2023-08-17T18:12:49.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.468+0000 7f8bb2ffd700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8b9405ed90 0x7f8b94061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.469+0000 7f8bab7fe700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] conn(0x7f8b94065670 0x7f8b94067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.469+0000 7f8bab7fe700 1 -- 172.21.15.78:0/857349119 --> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b94068150 con 0x7f8b94065670 2023-08-17T18:12:49.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.469+0000 7f8bab7fe700 1 -- 172.21.15.78:0/857349119 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b9c07c350 con 0x7f8bb413a740 2023-08-17T18:12:49.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.469+0000 7f8bb2ffd700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8b9405ed90 0x7f8b94061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8ba4006d80 tx=0x7f8ba4008040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.469+0000 7f8bb37fe700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] conn(0x7f8b94065670 0x7f8b94067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.469+0000 7f8bb37fe700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] conn(0x7f8b94065670 0x7f8b94067ad0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.470+0000 7f8bab7fe700 1 -- 172.21.15.78:0/857349119 <== osd.7 v2:172.21.15.150:6816/90935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f8b94068150 con 0x7f8b94065670 2023-08-17T18:12:49.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.483+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 --> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8bb40a86a0 con 0x7f8b94065670 2023-08-17T18:12:49.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.483+0000 7f8bab7fe700 1 -- 172.21.15.78:0/857349119 <== osd.7 v2:172.21.15.150:6816/90935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8bb40a86a0 con 0x7f8b94065670 2023-08-17T18:12:49.484 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-08-17T18:12:49.485 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T18:12:49.485 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-08-17T18:12:49.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] conn(0x7f8b94065670 msgr2=0x7f8b94067ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb9823700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.150:6816/90935,v1:172.21.15.150:6817/90935] conn(0x7f8b94065670 0x7f8b94067ad0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8b9405ed90 msgr2=0x7f8b94061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb9823700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f8b9405ed90 0x7f8b94061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8ba4006d80 tx=0x7f8ba4008040).stop 2023-08-17T18:12:49.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb413a740 msgr2=0x7f8bb40a9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb9823700 1 --2- 172.21.15.78:0/857349119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb413a740 0x7f8bb40a9f50 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f8b9c00e900 tx=0x7f8b9c009060).stop 2023-08-17T18:12:49.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb37fe700 1 -- 172.21.15.78:0/857349119 reap_dead start 2023-08-17T18:12:49.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 shutdown_connections 2023-08-17T18:12:49.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 >> 172.21.15.78:0/857349119 conn(0x7f8bb40c7b80 msgr2=0x7f8bb41396b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:49.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 shutdown_connections 2023-08-17T18:12:49.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.484+0000 7f8bb9823700 1 -- 172.21.15.78:0/857349119 wait complete. 2023-08-17T18:12:49.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-17T18:12:49.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.608+0000 7f585f433700 1 Processor -- start 2023-08-17T18:12:49.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.609+0000 7f585f433700 1 -- start start 2023-08-17T18:12:49.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.609+0000 7f585f433700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5858154580 0x7f58580a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.609+0000 7f585f433700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58580c7690 con 0x7f58581541a0 2023-08-17T18:12:49.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.609+0000 7f585f433700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58580c8df0 con 0x7f58580c0560 2023-08-17T18:12:49.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.609+0000 7f585f433700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58580a8190 con 0x7f5858154580 2023-08-17T18:12:49.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f585d1cf700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f58581541a0 0x7f58580bfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41808/0 (socket says 172.21.15.78:41808) 2023-08-17T18:12:49.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f585d1cf700 1 -- 172.21.15.78:0/703659705 learned_addr learned my addr 172.21.15.78:0/703659705 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:12:49.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f585c9ce700 1 --2- 172.21.15.78:0/703659705 >> v2:172.21.15.78:3300/0 conn(0x7f5858154580 0x7f58580a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f585c9ce700 1 -- 172.21.15.78:0/703659705 >> v1:172.21.15.150:6789/0 conn(0x7f58580c0560 legacy=0x7f58580c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:12:49.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f585c9ce700 1 -- 172.21.15.78:0/703659705 >> v1:172.21.15.78:6789/0 conn(0x7f58581541a0 legacy=0x7f58580bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f584ffff700 1 -- 172.21.15.78:0/703659705 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325863147 0 0) 0x7f5854001110 con 0x7f58581541a0 2023-08-17T18:12:49.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f585c9ce700 1 -- 172.21.15.78:0/703659705 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580c9970 con 0x7f5858154580 2023-08-17T18:12:49.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f585c9ce700 1 --2- 172.21.15.78:0/703659705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5858154580 0x7f58580a7ca0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f5848009760 tx=0x7f5848009060).ready entity=mon.0 client_cookie=4c93b9d2bacbc37e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f584ffff700 1 -- 172.21.15.78:0/703659705 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480090d0 con 0x7f5858154580 2023-08-17T18:12:49.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f584ffff700 1 -- 172.21.15.78:0/703659705 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584800b580 con 0x7f5858154580 2023-08-17T18:12:49.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.610+0000 7f584ffff700 1 -- 172.21.15.78:0/703659705 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584800b900 con 0x7f5858154580 2023-08-17T18:12:49.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.611+0000 7f585f433700 1 -- 172.21.15.78:0/703659705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5858154580 msgr2=0x7f58580a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.611+0000 7f585f433700 1 --2- 172.21.15.78:0/703659705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5858154580 0x7f58580a7ca0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f5848009760 tx=0x7f5848009060).stop 2023-08-17T18:12:49.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.611+0000 7f585f433700 1 -- 172.21.15.78:0/703659705 shutdown_connections 2023-08-17T18:12:49.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.611+0000 7f585f433700 1 --2- 172.21.15.78:0/703659705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5858154580 0x7f58580a7ca0 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.611+0000 7f585f433700 1 -- 172.21.15.78:0/703659705 >> 172.21.15.78:0/703659705 conn(0x7f585806a400 msgr2=0x7f58580caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:49.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.611+0000 7f585f433700 1 -- 172.21.15.78:0/703659705 shutdown_connections 2023-08-17T18:12:49.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.611+0000 7f585f433700 1 -- 172.21.15.78:0/703659705 wait complete. 2023-08-17T18:12:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.612+0000 7f585f433700 1 Processor -- start 2023-08-17T18:12:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.612+0000 7f585f433700 1 -- start start 2023-08-17T18:12:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585f433700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58580c0560 0x7f5858152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585f433700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58581541a0 0x7f5858151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585f433700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5858154580 0x7f58581519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585f433700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580c2120 con 0x7f58580c0560 2023-08-17T18:12:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585f433700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580c2300 con 0x7f58581541a0 2023-08-17T18:12:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585f433700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58580c25e0 con 0x7f5858154580 2023-08-17T18:12:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585d1cf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58580c0560 0x7f5858152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585d1cf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58580c0560 0x7f5858152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44432/0 (socket says 172.21.15.78:44432) 2023-08-17T18:12:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585d1cf700 1 -- 172.21.15.78:0/1767271205 learned_addr learned my addr 172.21.15.78:0/1767271205 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585c9ce700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58581541a0 0x7f5858151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585d9d0700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5858154580 0x7f58581519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585d1cf700 1 -- 172.21.15.78:0/1767271205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5858154580 msgr2=0x7f58581519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585d1cf700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5858154580 0x7f58581519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585d1cf700 1 -- 172.21.15.78:0/1767271205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58581541a0 msgr2=0x7f5858151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585d1cf700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58581541a0 0x7f5858151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.613+0000 7f585d1cf700 1 -- 172.21.15.78:0/1767271205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480092a0 con 0x7f58580c0560 2023-08-17T18:12:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.614+0000 7f585d1cf700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58580c0560 0x7f5858152c00 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f585400c510 tx=0x7f5854007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.614+0000 7f584d7fa700 1 -- 172.21.15.78:0/1767271205 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400ce80 con 0x7f58580c0560 2023-08-17T18:12:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.614+0000 7f584d7fa700 1 -- 172.21.15.78:0/1767271205 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58540072e0 con 0x7f58580c0560 2023-08-17T18:12:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.614+0000 7f585f433700 1 -- 172.21.15.78:0/1767271205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58580c28c0 con 0x7f58580c0560 2023-08-17T18:12:49.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.614+0000 7f584d7fa700 1 -- 172.21.15.78:0/1767271205 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854007660 con 0x7f58580c0560 2023-08-17T18:12:49.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.614+0000 7f585f433700 1 -- 172.21.15.78:0/1767271205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58581530f0 con 0x7f58580c0560 2023-08-17T18:12:49.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.615+0000 7f585f433700 1 -- 172.21.15.78:0/1767271205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5858047350 con 0x7f58580c0560 2023-08-17T18:12:49.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.615+0000 7f584d7fa700 1 -- 172.21.15.78:0/1767271205 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5854010070 con 0x7f58580c0560 2023-08-17T18:12:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.615+0000 7f584d7fa700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f583c05ed90 0x7f583c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.615+0000 7f584d7fa700 1 -- 172.21.15.78:0/1767271205 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f5854078dd0 con 0x7f58580c0560 2023-08-17T18:12:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.615+0000 7f585c9ce700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f583c05ed90 0x7f583c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.616+0000 7f585c9ce700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f583c05ed90 0x7f583c061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5848009760 tx=0x7f5848017000).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.619+0000 7f584d7fa700 1 -- 172.21.15.78:0/1767271205 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f585404a5a0 con 0x7f58580c0560 2023-08-17T18:12:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.781+0000 7f585f433700 1 -- 172.21.15.78:0/1767271205 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f58580c7690 con 0x7f583c05ed90 2023-08-17T18:12:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.781+0000 7f584d7fa700 1 -- 172.21.15.78:0/1767271205 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f58580c7690 con 0x7f583c05ed90 2023-08-17T18:12:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 -- 172.21.15.78:0/1767271205 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f583c05ed90 msgr2=0x7f583c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f583c05ed90 0x7f583c061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5848009760 tx=0x7f5848017000).stop 2023-08-17T18:12:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 -- 172.21.15.78:0/1767271205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58580c0560 msgr2=0x7f5858152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58580c0560 0x7f5858152c00 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f585400c510 tx=0x7f5854007ad0).stop 2023-08-17T18:12:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 -- 172.21.15.78:0/1767271205 shutdown_connections 2023-08-17T18:12:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f583c05ed90 0x7f583c061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5858154580 0x7f58581519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58580c0560 0x7f5858152c00 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 --2- 172.21.15.78:0/1767271205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58581541a0 0x7f5858151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 -- 172.21.15.78:0/1767271205 >> 172.21.15.78:0/1767271205 conn(0x7f585806a400 msgr2=0x7f5858063050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:49.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 -- 172.21.15.78:0/1767271205 shutdown_connections 2023-08-17T18:12:49.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.783+0000 7f585f433700 1 -- 172.21.15.78:0/1767271205 wait complete. 2023-08-17T18:12:49.786 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2023-08-17T18:12:49.795 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T18:12:49.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.907+0000 7feaceba1700 1 Processor -- start 2023-08-17T18:12:49.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.908+0000 7feaceba1700 1 -- start start 2023-08-17T18:12:49.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.908+0000 7feaceba1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feac81545f0 0x7feac80a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.908+0000 7feaceba1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac8068c60 con 0x7feac814e100 2023-08-17T18:12:49.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.908+0000 7feaceba1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac80694f0 con 0x7feac814dd20 2023-08-17T18:12:49.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.908+0000 7feaceba1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac8154d70 con 0x7feac81545f0 2023-08-17T18:12:49.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.909+0000 7feace3a0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feac81545f0 0x7feac80a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.909+0000 7feace3a0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feac81545f0 0x7feac80a54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44446/0 (socket says 172.21.15.78:44446) 2023-08-17T18:12:49.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.909+0000 7feace3a0700 1 -- 172.21.15.78:0/2310445377 learned_addr learned my addr 172.21.15.78:0/2310445377 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:49.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.909+0000 7feace3a0700 1 -- 172.21.15.78:0/2310445377 >> v1:172.21.15.150:6789/0 conn(0x7feac814dd20 legacy=0x7feac80c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.909+0000 7feace3a0700 1 -- 172.21.15.78:0/2310445377 >> v1:172.21.15.78:6789/0 conn(0x7feac814e100 legacy=0x7feac8153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.909+0000 7feace3a0700 1 -- 172.21.15.78:0/2310445377 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac80c1de0 con 0x7feac81545f0 2023-08-17T18:12:49.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.909+0000 7feace3a0700 1 --2- 172.21.15.78:0/2310445377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 0x7feac80a54b0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7feac0006fd0 tx=0x7feac00090f0).ready entity=mon.0 client_cookie=52b1949ac661a13a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.909+0000 7feaccb9d700 1 -- 172.21.15.78:0/2310445377 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000b600 con 0x7feac81545f0 2023-08-17T18:12:49.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.909+0000 7feaccb9d700 1 -- 172.21.15.78:0/2310445377 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac000b760 con 0x7feac81545f0 2023-08-17T18:12:49.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.909+0000 7feaccb9d700 1 -- 172.21.15.78:0/2310445377 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000bae0 con 0x7feac81545f0 2023-08-17T18:12:49.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.910+0000 7feaceba1700 1 -- 172.21.15.78:0/2310445377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 msgr2=0x7feac80a54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.910+0000 7feaceba1700 1 --2- 172.21.15.78:0/2310445377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 0x7feac80a54b0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7feac0006fd0 tx=0x7feac00090f0).stop 2023-08-17T18:12:49.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.910+0000 7feaceba1700 1 -- 172.21.15.78:0/2310445377 shutdown_connections 2023-08-17T18:12:49.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.910+0000 7feaceba1700 1 --2- 172.21.15.78:0/2310445377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 0x7feac80a54b0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.910+0000 7feaceba1700 1 -- 172.21.15.78:0/2310445377 >> 172.21.15.78:0/2310445377 conn(0x7feac80c7320 msgr2=0x7feac80c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:49.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.910+0000 7feaceba1700 1 -- 172.21.15.78:0/2310445377 shutdown_connections 2023-08-17T18:12:49.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.910+0000 7feaceba1700 1 -- 172.21.15.78:0/2310445377 wait complete. 2023-08-17T18:12:49.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.911+0000 7feaceba1700 1 Processor -- start 2023-08-17T18:12:49.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.911+0000 7feaceba1700 1 -- start start 2023-08-17T18:12:49.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.911+0000 7feaceba1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac814dd20 0x7feac8139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.911+0000 7feaceba1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feac814e100 0x7feac813aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feaceba1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 0x7feac813af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feaceba1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac813b480 con 0x7feac81545f0 2023-08-17T18:12:49.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feaceba1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac8151990 con 0x7feac814dd20 2023-08-17T18:12:49.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feaceba1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac80bdcb0 con 0x7feac814e100 2023-08-17T18:12:49.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feace3a0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 0x7feac813af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feace3a0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 0x7feac813af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44458/0 (socket says 172.21.15.78:44458) 2023-08-17T18:12:49.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feace3a0700 1 -- 172.21.15.78:0/1072462773 learned_addr learned my addr 172.21.15.78:0/1072462773 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:12:49.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feacdb9f700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac814dd20 0x7feac8139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feacd39e700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feac814e100 0x7feac813aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feace3a0700 1 -- 172.21.15.78:0/1072462773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feac814e100 msgr2=0x7feac813aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feace3a0700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feac814e100 0x7feac813aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feace3a0700 1 -- 172.21.15.78:0/1072462773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac814dd20 msgr2=0x7feac8139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feace3a0700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac814dd20 0x7feac8139eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feace3a0700 1 -- 172.21.15.78:0/1072462773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac0009370 con 0x7feac81545f0 2023-08-17T18:12:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feacd39e700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feac814e100 0x7feac813aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feacdb9f700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac814dd20 0x7feac8139eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T18:12:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feace3a0700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 0x7feac813af90 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7feac80bd8f0 tx=0x7feac0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feabdffb700 1 -- 172.21.15.78:0/1072462773 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac001b410 con 0x7feac81545f0 2023-08-17T18:12:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feabdffb700 1 -- 172.21.15.78:0/1072462773 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac001b570 con 0x7feac81545f0 2023-08-17T18:12:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feaceba1700 1 -- 172.21.15.78:0/1072462773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac80bdf90 con 0x7feac81545f0 2023-08-17T18:12:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feabdffb700 1 -- 172.21.15.78:0/1072462773 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac001b8f0 con 0x7feac81545f0 2023-08-17T18:12:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.912+0000 7feaceba1700 1 -- 172.21.15.78:0/1072462773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac8151ec0 con 0x7feac81545f0 2023-08-17T18:12:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.913+0000 7feaceba1700 1 -- 172.21.15.78:0/1072462773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac81520e0 con 0x7feac81545f0 2023-08-17T18:12:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.914+0000 7feabdffb700 1 -- 172.21.15.78:0/1072462773 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feac000f070 con 0x7feac81545f0 2023-08-17T18:12:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.914+0000 7feabdffb700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feaac05ed90 0x7feaac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:12:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.914+0000 7feabdffb700 1 -- 172.21.15.78:0/1072462773 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7feac007b430 con 0x7feac81545f0 2023-08-17T18:12:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.914+0000 7feacdb9f700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feaac05ed90 0x7feaac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:12:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.914+0000 7feacdb9f700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feaac05ed90 0x7feaac061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7feac8153aa0 tx=0x7feac4009040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:12:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:49.918+0000 7feabdffb700 1 -- 172.21.15.78:0/1072462773 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feac004cb50 con 0x7feac81545f0 2023-08-17T18:12:50.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.077+0000 7feaceba1700 1 -- 172.21.15.78:0/1072462773 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feac80c7730 con 0x7feaac05ed90 2023-08-17T18:12:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.079+0000 7feabdffb700 1 -- 172.21.15.78:0/1072462773 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71249 (secure 0 0 0) 0x7feac80c7730 con 0x7feaac05ed90 2023-08-17T18:12:50.081 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:12:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 -- 172.21.15.78:0/1072462773 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feaac05ed90 msgr2=0x7feaac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feaac05ed90 0x7feaac061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7feac8153aa0 tx=0x7feac4009040).stop 2023-08-17T18:12:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 -- 172.21.15.78:0/1072462773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 msgr2=0x7feac813af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:12:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 0x7feac813af90 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7feac80bd8f0 tx=0x7feac0017000).stop 2023-08-17T18:12:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 -- 172.21.15.78:0/1072462773 shutdown_connections 2023-08-17T18:12:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7feaac05ed90 0x7feaac061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feac81545f0 0x7feac813af90 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feac814dd20 0x7feac8139eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 --2- 172.21.15.78:0/1072462773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feac814e100 0x7feac813aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:12:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 -- 172.21.15.78:0/1072462773 >> 172.21.15.78:0/1072462773 conn(0x7feac80c7320 msgr2=0x7feac80c50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:12:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 -- 172.21.15.78:0/1072462773 shutdown_connections 2023-08-17T18:12:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:12:50.081+0000 7feaceba1700 1 -- 172.21.15.78:0/1072462773 wait complete. 2023-08-17T18:12:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T18:12:50.094 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-08-17T18:12:49.886537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2436352,"kb_used_data":18624,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752538368,"statfs":{"total":773094113280,"available":770599288832,"internally_reserved":0,"allocated":19070976,"data_stored":9570824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11959,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.012522"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:47.266168+0000","last_change":"2023-08-17T18:12:47.266168+0000","last_active":"2023-08-17T18:12:47.266168+0000","last_peered":"2023-08-17T18:12:47.266168+0000","last_clean":"2023-08-17T18:12:47.266168+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T18:12:47.266168+0000","last_undegraded":"2023-08-17T18:12:47.266168+0000","last_fullsized":"2023-08-17T18:12:47.266168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:47.266080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:47.266080+0000","last_clean_scrub_stamp":"2023-08-17T18:12:47.266080+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.898528+0000","last_change":"2023-08-17T17:34:19.072437+0000","last_active":"2023-08-17T18:12:40.898528+0000","last_peered":"2023-08-17T18:12:40.898528+0000","last_clean":"2023-08-17T18:12:40.898528+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T18:12:40.898528+0000","last_undegraded":"2023-08-17T18:12:40.898528+0000","last_fullsized":"2023-08-17T18:12:40.898528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:47.626020+0000","last_change":"2023-08-17T18:12:47.626020+0000","last_active":"2023-08-17T18:12:47.626020+0000","last_peered":"2023-08-17T18:12:47.626020+0000","last_clean":"2023-08-17T18:12:47.626020+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T18:12:47.626020+0000","last_undegraded":"2023-08-17T18:12:47.626020+0000","last_fullsized":"2023-08-17T18:12:47.626020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:47.625878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:47.625878+0000","last_clean_scrub_stamp":"2023-08-17T18:12:47.625878+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.899701+0000","last_change":"2023-08-17T17:34:19.066922+0000","last_active":"2023-08-17T18:12:40.899701+0000","last_peered":"2023-08-17T18:12:40.899701+0000","last_clean":"2023-08-17T18:12:40.899701+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T18:12:40.899701+0000","last_undegraded":"2023-08-17T18:12:40.899701+0000","last_fullsized":"2023-08-17T18:12:40.899701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":148,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.971027+0000","last_change":"2023-08-17T17:34:17.046351+0000","last_active":"2023-08-17T18:12:40.971027+0000","last_peered":"2023-08-17T18:12:40.971027+0000","last_clean":"2023-08-17T18:12:40.971027+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T18:12:40.971027+0000","last_undegraded":"2023-08-17T18:12:40.971027+0000","last_fullsized":"2023-08-17T18:12:40.971027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:16.032227+0000","last_clean_scrub_stamp":"2023-08-17T17:34:16.032227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.971108+0000","last_change":"2023-08-17T17:34:19.062857+0000","last_active":"2023-08-17T18:12:40.971108+0000","last_peered":"2023-08-17T18:12:40.971108+0000","last_clean":"2023-08-17T18:12:40.971108+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T18:12:40.971108+0000","last_undegraded":"2023-08-17T18:12:40.971108+0000","last_fullsized":"2023-08-17T18:12:40.971108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.969121+0000","last_change":"2023-08-17T17:34:19.061686+0000","last_active":"2023-08-17T18:12:40.969121+0000","last_peered":"2023-08-17T18:12:40.969121+0000","last_clean":"2023-08-17T18:12:40.969121+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T18:12:40.969121+0000","last_undegraded":"2023-08-17T18:12:40.969121+0000","last_fullsized":"2023-08-17T18:12:40.969121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:48.233062+0000","last_change":"2023-08-17T18:12:48.233062+0000","last_active":"2023-08-17T18:12:48.233062+0000","last_peered":"2023-08-17T18:12:48.233062+0000","last_clean":"2023-08-17T18:12:48.233062+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T18:12:48.233062+0000","last_undegraded":"2023-08-17T18:12:48.233062+0000","last_fullsized":"2023-08-17T18:12:48.233062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:48.232971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:48.232971+0000","last_clean_scrub_stamp":"2023-08-17T18:12:48.232971+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-08-17T18:12:40.968935+0000","last_change":"2023-08-17T17:34:19.062757+0000","last_active":"2023-08-17T18:12:40.968935+0000","last_peered":"2023-08-17T18:12:40.968935+0000","last_clean":"2023-08-17T18:12:40.968935+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T18:12:40.968935+0000","last_undegraded":"2023-08-17T18:12:40.968935+0000","last_fullsized":"2023-08-17T18:12:40.968935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T17:34:18.047488+0000","last_clean_scrub_stamp":"2023-08-17T17:34:18.047488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575303,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68600000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41699999999999998,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.76300000000000001,"15min":0.77100000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.69699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66500000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.374,"15min":0.374},"max":{"1min":0.70399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36799999999999999},"max":{"1min":0.70999999999999996,"5min":0.78600000000000003,"15min":0.81699999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.747,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.312,"15min":0.247},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.76900000000000002},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51600000000000001,"15min":0.497},"min":{"1min":0.314,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.81699999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.86499999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"last":0.624},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.60299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575303,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.42199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79000000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.31900000000000001},"max":{"1min":0.71899999999999997,"5min":1.214,"15min":1.214},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.84799999999999998,"5min":1.208,"15min":1.208},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77100000000000002,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.82399999999999995,"5min":1.304,"15min":1.304},"last":0.622},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.78600000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29499999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.88700000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69499999999999995,"5min":0.75700000000000001,"15min":1.0269999999999999},"last":0.5},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.32300000000000001},"max":{"1min":0.80100000000000005,"5min":0.87,"15min":0.87},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.42299999999999999,"5min":0.372,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.97699999999999998},"last":0.70999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.221},{"interface":"front","average":{"1min":0.377,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.26800000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.57199999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.371}]},{"osd":2,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.47199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40899999999999997},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.44},"min":{"1min":0.33800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65500000000000003,"5min":1.095,"15min":1.095},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80500000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.96199999999999997},"last":0.434}]},{"osd":5,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78600000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.48499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78500000000000003,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40300000000000002},"max":{"1min":0.82699999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.44500000000000001,"15min":0.41599999999999998},"max":{"1min":0.82299999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.441}]},{"osd":7,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63300000000000001,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82599999999999996,"5min":0.872,"15min":0.91800000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.65000000000000002},"min":{"1min":0.42199999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89200000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.51000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575303,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34399999999999997,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.40999999999999998,"5min":0.64100000000000001,"15min":0.77600000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36499999999999999,"15min":0.38900000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.505,"5min":0.58099999999999996,"15min":0.70899999999999996},"last":0.372}]},{"osd":2,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.36899999999999999},"min":{"1min":0.249,"5min":0.214,"15min":0.214},"max":{"1min":0.40999999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.37,"5min":0.39900000000000002,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.499,"5min":0.70299999999999996,"15min":0.754},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38400000000000001,"15min":0.40400000000000003},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.48399999999999999,"5min":0.59699999999999998,"15min":0.66100000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.307,"5min":0.254,"15min":0.254},"max":{"1min":0.46700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35399999999999998},"max":{"1min":0.85999999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88300000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39600000000000002},"max":{"1min":0.755,"5min":1.079,"15min":1.079},"last":0.62},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82499999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92000000000000004,"5min":1.0549999999999999,"15min":1.0820000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.65600000000000003,"15min":0.67900000000000005},"min":{"1min":0.497,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.78600000000000003,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575303,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.26500000000000001,"5min":0.221,"15min":0.21099999999999999},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.623},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36799999999999999,"15min":0.36899999999999999},"min":{"1min":0.26700000000000002,"5min":0.254,"15min":0.25},"max":{"1min":0.50800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40899999999999997,"15min":0.40999999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.68100000000000005},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.72999999999999998},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.36699999999999999,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.67000000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.41499999999999998},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53000000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":1.0169999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.21,"15min":1.21},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.79600000000000004,"5min":0.91000000000000003,"15min":0.94799999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.629,"15min":0.64200000000000002},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76300000000000001,"5min":1.254,"15min":1.254},"last":0.497}]},{"osd":6,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58899999999999997,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80100000000000005,"5min":0.89900000000000002,"15min":0.96099999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.97999999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.42099999999999999},"max":{"1min":0.78500000000000003,"5min":1.234,"15min":1.234},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.625,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.93500000000000005,"15min":1.0469999999999999},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575303,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307616,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064224,"statfs":{"total":96636764160,"available":96321765376,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.217},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.38600000000000001},"min":{"1min":0.23100000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.61299999999999999},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.373,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52000000000000002,"5min":0.59399999999999997,"15min":0.72299999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63400000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.68899999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63300000000000001,"5min":0.66700000000000004,"15min":0.70699999999999996},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.44900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71099999999999997,"5min":0.87,"15min":0.95499999999999996},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.93100000000000005},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.40300000000000002,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.64000000000000001},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80100000000000005,"5min":0.89100000000000001,"15min":0.90700000000000003},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.92800000000000005,"15min":0.94399999999999995},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.77800000000000002,"5min":0.93200000000000005,"15min":0.94899999999999995},"last":0.86899999999999999}]},{"osd":7,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42199999999999999},"max":{"1min":0.78700000000000003,"5min":0.96599999999999997,"15min":0.97099999999999997},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.502,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":0.83699999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.89900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575304,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.30499999999999999},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79400000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.503}]},{"osd":1,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.315},"max":{"1min":0.755,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.746,"5min":0.76300000000000001,"15min":0.79400000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.81399999999999995,"15min":0.83799999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78400000000000003,"5min":0.79300000000000004,"15min":0.81999999999999995},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83999999999999997,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.47599999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81000000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.35999999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69999999999999996,"5min":0.75,"15min":0.79700000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32700000000000001,"15min":0.28799999999999998},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.378}]},{"osd":6,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34399999999999997,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.86299999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84999999999999998,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89700000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575302,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307616,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064224,"statfs":{"total":96636764160,"available":96321765376,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.80300000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.755,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.434},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.378,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68100000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78600000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79900000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.82899999999999996,"15min":0.86399999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.71599999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.307,"15min":0.29899999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.621}]},{"osd":7,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.85299999999999998,"5min":0.873,"15min":0.873},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T18:12:50.098 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-17T17:34:18.047488+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=17, tm_min=34, tm_sec=18, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=18, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T18:12:50.098 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-17T17:34:18.047488+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=17, tm_min=34, tm_sec=18, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=18, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T18:12:50.098 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-17T17:34:16.032227+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=17, tm_min=34, tm_sec=16, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=18, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T18:12:50.098 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-08-17T17:34:18.047488+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=17, tm_min=34, tm_sec=18, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=18, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T18:12:50.099 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-17T17:34:18.047488+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=17, tm_min=34, tm_sec=18, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=18, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T18:12:50.099 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-17T17:34:18.047488+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=17, tm_min=34, tm_sec=18, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=18, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T18:12:50.099 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-17T18:13:07.766 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:13:07.769 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:13:10.100 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T18:13:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.224+0000 7f7387558700 1 Processor -- start 2023-08-17T18:13:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.224+0000 7f7387558700 1 -- start start 2023-08-17T18:13:10.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.225+0000 7f7387558700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7380150d30 0x7f73800c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.225+0000 7f7387558700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7380069680 con 0x7f73800a5d90 2023-08-17T18:13:10.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.225+0000 7f7387558700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7380068ab0 con 0x7f73800a59b0 2023-08-17T18:13:10.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.225+0000 7f7387558700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73800c28f0 con 0x7f7380150d30 2023-08-17T18:13:10.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7386d57700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7380150d30 0x7f73800c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7386d57700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7380150d30 0x7f73800c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36524/0 (socket says 172.21.15.78:36524) 2023-08-17T18:13:10.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7386d57700 1 -- 172.21.15.78:0/1611295334 learned_addr learned my addr 172.21.15.78:0/1611295334 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:13:10.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7386d57700 1 -- 172.21.15.78:0/1611295334 >> v1:172.21.15.150:6789/0 conn(0x7f73800a59b0 legacy=0x7f7380069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:13:10.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7386d57700 1 -- 172.21.15.78:0/1611295334 >> v1:172.21.15.78:6789/0 conn(0x7f73800a5d90 legacy=0x7f7380150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7385554700 1 -- 172.21.15.78:0/1611295334 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380255151 0 0) 0x7f7380069680 con 0x7f73800a5d90 2023-08-17T18:13:10.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7386d57700 1 -- 172.21.15.78:0/1611295334 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7380068d50 con 0x7f7380150d30 2023-08-17T18:13:10.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7386d57700 1 --2- 172.21.15.78:0/1611295334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7380150d30 0x7f73800c1c00 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7f7378009f20 tx=0x7f7378009840).ready entity=mon.0 client_cookie=cdb4c9af797a7eb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:13:10.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7385554700 1 -- 172.21.15.78:0/1611295334 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737800e070 con 0x7f7380150d30 2023-08-17T18:13:10.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7385554700 1 -- 172.21.15.78:0/1611295334 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737800ba40 con 0x7f7380150d30 2023-08-17T18:13:10.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.226+0000 7f7385554700 1 -- 172.21.15.78:0/1611295334 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737800bdc0 con 0x7f7380150d30 2023-08-17T18:13:10.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.227+0000 7f7387558700 1 -- 172.21.15.78:0/1611295334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7380150d30 msgr2=0x7f73800c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.227+0000 7f7387558700 1 --2- 172.21.15.78:0/1611295334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7380150d30 0x7f73800c1c00 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7f7378009f20 tx=0x7f7378009840).stop 2023-08-17T18:13:10.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.227+0000 7f7387558700 1 -- 172.21.15.78:0/1611295334 shutdown_connections 2023-08-17T18:13:10.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.227+0000 7f7387558700 1 --2- 172.21.15.78:0/1611295334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7380150d30 0x7f73800c1c00 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.227+0000 7f7387558700 1 -- 172.21.15.78:0/1611295334 >> 172.21.15.78:0/1611295334 conn(0x7f73800c7320 msgr2=0x7f73800c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:13:10.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.227+0000 7f7387558700 1 -- 172.21.15.78:0/1611295334 shutdown_connections 2023-08-17T18:13:10.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.227+0000 7f7387558700 1 -- 172.21.15.78:0/1611295334 wait complete. 2023-08-17T18:13:10.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.228+0000 7f7387558700 1 Processor -- start 2023-08-17T18:13:10.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.228+0000 7f7387558700 1 -- start start 2023-08-17T18:13:10.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7387558700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73800a59b0 0x7f7380151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7387558700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73800a5d90 0x7f73801441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7387558700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7380150d30 0x7f73801648c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7387558700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73800aa820 con 0x7f73800a5d90 2023-08-17T18:13:10.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7387558700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73801537c0 con 0x7f73800a59b0 2023-08-17T18:13:10.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7387558700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7380153a50 con 0x7f7380150d30 2023-08-17T18:13:10.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7385d55700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73800a5d90 0x7f73801441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7385d55700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73800a5d90 0x7f73801441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36528/0 (socket says 172.21.15.78:36528) 2023-08-17T18:13:10.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7385d55700 1 -- 172.21.15.78:0/1189051121 learned_addr learned my addr 172.21.15.78:0/1189051121 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:13:10.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7386556700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73800a59b0 0x7f7380151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7385d55700 1 -- 172.21.15.78:0/1189051121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7380150d30 msgr2=0x7f73801648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7386d57700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7380150d30 0x7f73801648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7385d55700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7380150d30 0x7f73801648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7385d55700 1 -- 172.21.15.78:0/1189051121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73800a59b0 msgr2=0x7f7380151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7385d55700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73800a59b0 0x7f7380151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7385d55700 1 -- 172.21.15.78:0/1189051121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7378009ae0 con 0x7f73800a5d90 2023-08-17T18:13:10.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7386556700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73800a59b0 0x7f7380151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:13:10.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.229+0000 7f7385d55700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73800a5d90 0x7f73801441b0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7f7370001eb0 tx=0x7f7370007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:13:10.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.230+0000 7f73767fc700 1 -- 172.21.15.78:0/1189051121 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000f470 con 0x7f73800a5d90 2023-08-17T18:13:10.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.230+0000 7f73767fc700 1 -- 172.21.15.78:0/1189051121 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737000f5f0 con 0x7f73800a5d90 2023-08-17T18:13:10.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.230+0000 7f73767fc700 1 -- 172.21.15.78:0/1189051121 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000f9b0 con 0x7f73800a5d90 2023-08-17T18:13:10.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.230+0000 7f7387558700 1 -- 172.21.15.78:0/1189051121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7380153d30 con 0x7f73800a5d90 2023-08-17T18:13:10.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.230+0000 7f7387558700 1 -- 172.21.15.78:0/1189051121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73801542f0 con 0x7f73800a5d90 2023-08-17T18:13:10.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.231+0000 7f7387558700 1 -- 172.21.15.78:0/1189051121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73800c7730 con 0x7f73800a5d90 2023-08-17T18:13:10.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.231+0000 7f73767fc700 1 -- 172.21.15.78:0/1189051121 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7370019030 con 0x7f73800a5d90 2023-08-17T18:13:10.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.231+0000 7f73767fc700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f736405ed90 0x7f7364061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.231+0000 7f73767fc700 1 -- 172.21.15.78:0/1189051121 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f7370078ef0 con 0x7f73800a5d90 2023-08-17T18:13:10.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.231+0000 7f7386556700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f736405ed90 0x7f7364061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.232+0000 7f7386556700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f736405ed90 0x7f7364061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f737c00a800 tx=0x7f737c008040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:13:10.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.235+0000 7f73767fc700 1 -- 172.21.15.78:0/1189051121 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f737004a610 con 0x7f73800a5d90 2023-08-17T18:13:10.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.395+0000 7f7387558700 1 -- 172.21.15.78:0/1189051121 --> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73800aa960 con 0x7f736405ed90 2023-08-17T18:13:10.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.398+0000 7f73767fc700 1 -- 172.21.15.78:0/1189051121 <== mgr.9804 v2:172.21.15.78:6832/158925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71227 (secure 0 0 0) 0x7f737c012420 con 0x7f736405ed90 2023-08-17T18:13:10.399 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:13:10.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 -- 172.21.15.78:0/1189051121 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f736405ed90 msgr2=0x7f7364061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f736405ed90 0x7f7364061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f737c00a800 tx=0x7f737c008040).stop 2023-08-17T18:13:10.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 -- 172.21.15.78:0/1189051121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73800a5d90 msgr2=0x7f73801441b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73800a5d90 0x7f73801441b0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7f7370001eb0 tx=0x7f7370007c70).stop 2023-08-17T18:13:10.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 -- 172.21.15.78:0/1189051121 shutdown_connections 2023-08-17T18:13:10.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f736405ed90 0x7f7364061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7380150d30 0x7f73801648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73800a59b0 0x7f7380151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 --2- 172.21.15.78:0/1189051121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73800a5d90 0x7f73801441b0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 -- 172.21.15.78:0/1189051121 >> 172.21.15.78:0/1189051121 conn(0x7f73800c7320 msgr2=0x7f7380065590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:13:10.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 -- 172.21.15.78:0/1189051121 shutdown_connections 2023-08-17T18:13:10.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.400+0000 7f7387558700 1 -- 172.21.15.78:0/1189051121 wait complete. 2023-08-17T18:13:10.402 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-08-17T18:13:10.411 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T18:13:09.890910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2436352,"kb_used_data":18624,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752538368,"statfs":{"total":773094113280,"available":770599288832,"internally_reserved":0,"allocated":19070976,"data_stored":9570824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11959,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.012522"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:47.266168+0000","last_change":"2023-08-17T18:12:47.266168+0000","last_active":"2023-08-17T18:12:47.266168+0000","last_peered":"2023-08-17T18:12:47.266168+0000","last_clean":"2023-08-17T18:12:47.266168+0000","last_became_active":"2023-08-17T17:34:19.062888+0000","last_became_peered":"2023-08-17T17:34:19.062888+0000","last_unstale":"2023-08-17T18:12:47.266168+0000","last_undegraded":"2023-08-17T18:12:47.266168+0000","last_fullsized":"2023-08-17T18:12:47.266168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:47.266080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:47.266080+0000","last_clean_scrub_stamp":"2023-08-17T18:12:47.266080+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:49.521575+0000","last_change":"2023-08-17T18:12:49.521575+0000","last_active":"2023-08-17T18:12:49.521575+0000","last_peered":"2023-08-17T18:12:49.521575+0000","last_clean":"2023-08-17T18:12:49.521575+0000","last_became_active":"2023-08-17T17:34:19.072148+0000","last_became_peered":"2023-08-17T17:34:19.072148+0000","last_unstale":"2023-08-17T18:12:49.521575+0000","last_undegraded":"2023-08-17T18:12:49.521575+0000","last_fullsized":"2023-08-17T18:12:49.521575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:49.521457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:49.521457+0000","last_clean_scrub_stamp":"2023-08-17T18:12:49.521457+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:47.626020+0000","last_change":"2023-08-17T18:12:47.626020+0000","last_active":"2023-08-17T18:12:47.626020+0000","last_peered":"2023-08-17T18:12:47.626020+0000","last_clean":"2023-08-17T18:12:47.626020+0000","last_became_active":"2023-08-17T17:34:19.803709+0000","last_became_peered":"2023-08-17T17:34:19.803709+0000","last_unstale":"2023-08-17T18:12:47.626020+0000","last_undegraded":"2023-08-17T18:12:47.626020+0000","last_fullsized":"2023-08-17T18:12:47.626020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:47.625878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:47.625878+0000","last_clean_scrub_stamp":"2023-08-17T18:12:47.625878+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:50.548061+0000","last_change":"2023-08-17T18:12:50.548061+0000","last_active":"2023-08-17T18:12:50.548061+0000","last_peered":"2023-08-17T18:12:50.548061+0000","last_clean":"2023-08-17T18:12:50.548061+0000","last_became_active":"2023-08-17T17:34:19.066646+0000","last_became_peered":"2023-08-17T17:34:19.066646+0000","last_unstale":"2023-08-17T18:12:50.548061+0000","last_undegraded":"2023-08-17T18:12:50.548061+0000","last_fullsized":"2023-08-17T18:12:50.548061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:50.547921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:50.547921+0000","last_clean_scrub_stamp":"2023-08-17T18:12:50.547921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":153,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:51.461860+0000","last_change":"2023-08-17T18:12:51.461860+0000","last_active":"2023-08-17T18:12:51.461860+0000","last_peered":"2023-08-17T18:12:51.461860+0000","last_clean":"2023-08-17T18:12:51.461860+0000","last_became_active":"2023-08-17T17:34:17.046052+0000","last_became_peered":"2023-08-17T17:34:17.046052+0000","last_unstale":"2023-08-17T18:12:51.461860+0000","last_undegraded":"2023-08-17T18:12:51.461860+0000","last_fullsized":"2023-08-17T18:12:51.461860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:51.461744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:51.461744+0000","last_clean_scrub_stamp":"2023-08-17T18:12:51.461744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:53.437600+0000","last_change":"2023-08-17T18:12:53.437600+0000","last_active":"2023-08-17T18:12:53.437600+0000","last_peered":"2023-08-17T18:12:53.437600+0000","last_clean":"2023-08-17T18:12:53.437600+0000","last_became_active":"2023-08-17T17:34:19.062509+0000","last_became_peered":"2023-08-17T17:34:19.062509+0000","last_unstale":"2023-08-17T18:12:53.437600+0000","last_undegraded":"2023-08-17T18:12:53.437600+0000","last_fullsized":"2023-08-17T18:12:53.437600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:53.437488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:53.437488+0000","last_clean_scrub_stamp":"2023-08-17T18:12:53.437488+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:56.490806+0000","last_change":"2023-08-17T18:12:56.490806+0000","last_active":"2023-08-17T18:12:56.490806+0000","last_peered":"2023-08-17T18:12:56.490806+0000","last_clean":"2023-08-17T18:12:56.490806+0000","last_became_active":"2023-08-17T17:34:19.061369+0000","last_became_peered":"2023-08-17T17:34:19.061369+0000","last_unstale":"2023-08-17T18:12:56.490806+0000","last_undegraded":"2023-08-17T18:12:56.490806+0000","last_fullsized":"2023-08-17T18:12:56.490806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:56.490643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:56.490643+0000","last_clean_scrub_stamp":"2023-08-17T18:12:56.490643+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:48.233062+0000","last_change":"2023-08-17T18:12:48.233062+0000","last_active":"2023-08-17T18:12:48.233062+0000","last_peered":"2023-08-17T18:12:48.233062+0000","last_clean":"2023-08-17T18:12:48.233062+0000","last_became_active":"2023-08-17T17:34:19.065516+0000","last_became_peered":"2023-08-17T17:34:19.065516+0000","last_unstale":"2023-08-17T18:12:48.233062+0000","last_undegraded":"2023-08-17T18:12:48.233062+0000","last_fullsized":"2023-08-17T18:12:48.233062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:48.232971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:48.232971+0000","last_clean_scrub_stamp":"2023-08-17T18:12:48.232971+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":150,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T18:12:49.910529+0000","last_change":"2023-08-17T18:12:49.910529+0000","last_active":"2023-08-17T18:12:49.910529+0000","last_peered":"2023-08-17T18:12:49.910529+0000","last_clean":"2023-08-17T18:12:49.910529+0000","last_became_active":"2023-08-17T17:34:19.062411+0000","last_became_peered":"2023-08-17T17:34:19.062411+0000","last_unstale":"2023-08-17T18:12:49.910529+0000","last_undegraded":"2023-08-17T18:12:49.910529+0000","last_fullsized":"2023-08-17T18:12:49.910529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T18:12:49.910401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T18:12:49.910401+0000","last_clean_scrub_stamp":"2023-08-17T18:12:49.910401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575307,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.499},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68600000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41699999999999998,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.68799999999999994,"5min":0.76300000000000001,"15min":0.77100000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.69699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.623}]},{"osd":2,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66500000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.374,"15min":0.374},"max":{"1min":0.70399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36799999999999999},"max":{"1min":0.70999999999999996,"5min":0.78600000000000003,"15min":0.81699999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.747,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.312,"15min":0.247},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.76900000000000002},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51600000000000001,"15min":0.497},"min":{"1min":0.314,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.81699999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.86499999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Aug 17 18:12:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.82099999999999995},"last":0.41099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575307,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.42199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79000000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.31900000000000001},"max":{"1min":0.71899999999999997,"5min":1.214,"15min":1.214},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.496},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.84799999999999998,"5min":1.208,"15min":1.208},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77100000000000002,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.82399999999999995,"5min":1.304,"15min":1.304},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.78600000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29499999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.88700000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.41899999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69499999999999995,"5min":0.75700000000000001,"15min":1.0269999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Aug 17 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.32300000000000001},"max":{"1min":0.80100000000000005,"5min":0.87,"15min":0.87},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.42299999999999999,"5min":0.372,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.97699999999999998},"last":0.55500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575308,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.377,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.26800000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.57199999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.47199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40899999999999997},"min":{"1min":0.26600000000000001,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.44},"min":{"1min":0.33800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65500000000000003,"5min":1.095,"15min":1.095},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.504}]},{"osd":4,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80500000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.96199999999999997},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78600000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.48499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78500000000000003,"5min":0.90400000000000003,"15min":0.93600000000000005},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40300000000000002},"max":{"1min":0.82699999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.44500000000000001,"15min":0.41599999999999998},"max":{"1min":0.82299999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Aug 17 18:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63300000000000001,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82599999999999996,"5min":0.872,"15min":0.91800000000000004},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.65000000000000002},"min":{"1min":0.42199999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89200000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834575307,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34399999999999997,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.40999999999999998,"5min":0.64100000000000001,"15min":0.77600000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36499999999999999,"15min":0.38900000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.505,"5min":0.58099999999999996,"15min":0.70899999999999996},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35599999999999998,"15min":0.36899999999999999},"min":{"1min":0.249,"5min":0.214,"15min":0.214},"max":{"1min":0.40999999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"last":0.375},{"interface":"front","average":{"1min":0.37,"5min":0.39900000000000002,"15min":0.41399999999999998},"min":{"1min":0.28199999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.499,"5min":0.70299999999999996,"15min":0.754},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38400000000000001,"15min":0.40400000000000003},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.48399999999999999,"5min":0.59699999999999998,"15min":0.66100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.307,"5min":0.254,"15min":0.254},"max":{"1min":0.46700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.433}]},{"osd":4,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35399999999999998},"max":{"1min":0.85999999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88300000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39600000000000002},"max":{"1min":0.755,"5min":1.079,"15min":1.079},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82499999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92000000000000004,"5min":1.0549999999999999,"15min":1.0820000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.65600000000000003,"15min":0.67900000000000005},"min":{"1min":0.497,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":0.78600000000000003,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575307,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.26500000000000001,"5min":0.221,"15min":0.21099999999999999},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.623},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36799999999999999,"15min":0.36899999999999999},"min":{"1min":0.26700000000000002,"5min":0.254,"15min":0.25},"max":{"1min":0.50800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40899999999999997,"15min":0.40999999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.68100000000000005},"last":0.372},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.72999999999999998},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.36699999999999999,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.67000000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.41499999999999998},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53000000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":1.0169999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.21,"15min":1.21},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.79600000000000004,"5min":0.91000000000000003,"15min":0.94799999999999995},"last":0.495},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.629,"15min":0.64200000000000002},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76300000000000001,"5min":1.254,"15min":1.254},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58899999999999997,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80100000000000005,"5min":0.89900000000000002,"15min":0.96099999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.97999999999999998},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Aug 17 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.42099999999999999},"max":{"1min":0.78500000000000003,"5min":1.234,"15min":1.234},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.625,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.93500000000000005,"15min":1.0469999999999999},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575307,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307616,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064224,"statfs":{"total":96636764160,"available":96321765376,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.217},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.38600000000000001},"min":{"1min":0.23100000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.61299999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.373,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52000000000000002,"5min":0.59399999999999997,"15min":0.72299999999999998},"last":0.317},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63400000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.68899999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63300000000000001,"5min":0.66700000000000004,"15min":0.70699999999999996},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.44900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71099999999999997,"5min":0.87,"15min":0.95499999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.93100000000000005},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.40300000000000002,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.64000000000000001},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80100000000000005,"5min":0.89100000000000001,"15min":0.90700000000000003},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.92800000000000005,"15min":0.94399999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.77800000000000002,"5min":0.93200000000000005,"15min":0.94899999999999995},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Aug 17 18:12:41 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42199999999999999},"max":{"1min":0.78700000000000003,"5min":0.96599999999999997,"15min":0.97099999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.502,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":0.83699999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.61099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575308,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303520,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068320,"statfs":{"total":96636764160,"available":96325959680,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.30499999999999999},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.628},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79400000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.315},"max":{"1min":0.755,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.746,"5min":0.76300000000000001,"15min":0.79400000000000004},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.81399999999999995,"15min":0.83799999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78400000000000003,"5min":0.79300000000000004,"15min":0.81999999999999995},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83999999999999997,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.47599999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81000000000000005,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.35999999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69999999999999996,"5min":0.75,"15min":0.79700000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32700000000000001,"15min":0.28799999999999998},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34399999999999997,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.86299999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.496},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Aug 17 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84999999999999998,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89700000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575306,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307616,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064224,"statfs":{"total":96636764160,"available":96321765376,"internally_reserved":0,"allocated":2383872,"data_stored":1196353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.80300000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.755,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.378,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68100000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78600000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79900000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.82899999999999996,"15min":0.86399999999999999},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.71599999999999997},"last":0.44},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.501}]},{"osd":6,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.307,"15min":0.29899999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Aug 17 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.85299999999999998,"5min":0.873,"15min":0.873},"last":0.627},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T18:13:10.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-17T18:13:10.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.526+0000 7f4c4c4d0700 1 Processor -- start 2023-08-17T18:13:10.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.526+0000 7f4c4c4d0700 1 -- start start 2023-08-17T18:13:10.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.527+0000 7f4c4c4d0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4c440aa0f0 0x7f4c440644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.527+0000 7f4c4c4d0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c440649b0 con 0x7f4c440aa4d0 2023-08-17T18:13:10.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.527+0000 7f4c4c4d0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c44063420 con 0x7f4c440c5810 2023-08-17T18:13:10.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.527+0000 7f4c4c4d0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c44063700 con 0x7f4c440aa0f0 2023-08-17T18:13:10.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.527+0000 7f4c49a6b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4c440aa4d0 0x7f4c440c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54152/0 (socket says 172.21.15.78:54152) 2023-08-17T18:13:10.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.527+0000 7f4c49a6b700 1 -- 172.21.15.78:0/1805581774 learned_addr learned my addr 172.21.15.78:0/1805581774 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-08-17T18:13:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.527+0000 7f4c4a26c700 1 --2- 172.21.15.78:0/1805581774 >> v2:172.21.15.150:3300/0 conn(0x7f4c440aa0f0 0x7f4c440644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.527+0000 7f4c4926a700 1 -- 172.21.15.78:0/1805581774 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252130801 0 0) 0x7f4c440649b0 con 0x7f4c440aa4d0 2023-08-17T18:13:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.527+0000 7f4c4926a700 1 -- 172.21.15.78:0/1805581774 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c300033f0 con 0x7f4c440aa4d0 2023-08-17T18:13:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.528+0000 7f4c4a26c700 1 -- 172.21.15.78:0/1805581774 >> v1:172.21.15.150:6789/0 conn(0x7f4c440c5810 legacy=0x7f4c440a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.528+0000 7f4c4926a700 1 -- 172.21.15.78:0/1805581774 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3631866424 0 0) 0x7f4c300033f0 con 0x7f4c440aa4d0 2023-08-17T18:13:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.528+0000 7f4c4a26c700 1 -- 172.21.15.78:0/1805581774 >> v1:172.21.15.78:6789/0 conn(0x7f4c440aa4d0 legacy=0x7f4c440c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.528+0000 7f4c4a26c700 1 -- 172.21.15.78:0/1805581774 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c440639e0 con 0x7f4c440aa0f0 2023-08-17T18:13:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.528+0000 7f4c4a26c700 1 --2- 172.21.15.78:0/1805581774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c440aa0f0 0x7f4c440644c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f4c40009e60 tx=0x7f4c40009780).ready entity=mon.1 client_cookie=f3f552508e0cc925 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:13:10.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.528+0000 7f4c4926a700 1 -- 172.21.15.78:0/1805581774 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000e070 con 0x7f4c440aa0f0 2023-08-17T18:13:10.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.528+0000 7f4c4926a700 1 -- 172.21.15.78:0/1805581774 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4000b850 con 0x7f4c440aa0f0 2023-08-17T18:13:10.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.528+0000 7f4c4926a700 1 -- 172.21.15.78:0/1805581774 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34001470 con 0x7f4c440aa0f0 2023-08-17T18:13:10.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.528+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1805581774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c440aa0f0 msgr2=0x7f4c440644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.528+0000 7f4c4c4d0700 1 --2- 172.21.15.78:0/1805581774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c440aa0f0 0x7f4c440644c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f4c40009e60 tx=0x7f4c40009780).stop 2023-08-17T18:13:10.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.529+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1805581774 shutdown_connections 2023-08-17T18:13:10.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.529+0000 7f4c4c4d0700 1 --2- 172.21.15.78:0/1805581774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c440aa0f0 0x7f4c440644c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.529+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1805581774 >> 172.21.15.78:0/1805581774 conn(0x7f4c4406a6a0 msgr2=0x7f4c440caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:13:10.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.529+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1805581774 shutdown_connections 2023-08-17T18:13:10.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.529+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1805581774 wait complete. 2023-08-17T18:13:10.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.530+0000 7f4c4c4d0700 1 Processor -- start 2023-08-17T18:13:10.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.530+0000 7f4c4c4d0700 1 -- start start 2023-08-17T18:13:10.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.530+0000 7f4c4c4d0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c440aa0f0 0x7f4c44140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.530+0000 7f4c4c4d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c440aa4d0 0x7f4c4414bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.530+0000 7f4c4c4d0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c440c5810 0x7f4c44168750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.530+0000 7f4c4c4d0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4414c130 con 0x7f4c440aa4d0 2023-08-17T18:13:10.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.530+0000 7f4c4c4d0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44164a90 con 0x7f4c440c5810 2023-08-17T18:13:10.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.530+0000 7f4c4c4d0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44168c40 con 0x7f4c440aa0f0 2023-08-17T18:13:10.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.530+0000 7f4c49a6b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c440aa4d0 0x7f4c4414bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c49a6b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c440aa4d0 0x7f4c4414bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36542/0 (socket says 172.21.15.78:36542) 2023-08-17T18:13:10.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c49a6b700 1 -- 172.21.15.78:0/1677380431 learned_addr learned my addr 172.21.15.78:0/1677380431 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:13:10.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c4aa6d700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c440c5810 0x7f4c44168750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c4a26c700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c440aa0f0 0x7f4c44140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c49a6b700 1 -- 172.21.15.78:0/1677380431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c440aa0f0 msgr2=0x7f4c44140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c49a6b700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c440aa0f0 0x7f4c44140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c49a6b700 1 -- 172.21.15.78:0/1677380431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c440c5810 msgr2=0x7f4c44168750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c49a6b700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c440c5810 0x7f4c44168750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c49a6b700 1 -- 172.21.15.78:0/1677380431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40009a20 con 0x7f4c440aa4d0 2023-08-17T18:13:10.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c4aa6d700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c440c5810 0x7f4c44168750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:13:10.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c49a6b700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c440aa4d0 0x7f4c4414bc40 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7f4c3400c810 tx=0x7f4c34001b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:13:10.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c3a7fc700 1 -- 172.21.15.78:0/1677380431 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34007170 con 0x7f4c440aa4d0 2023-08-17T18:13:10.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c3a7fc700 1 -- 172.21.15.78:0/1677380431 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c340072d0 con 0x7f4c440aa4d0 2023-08-17T18:13:10.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1677380431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c440b0610 con 0x7f4c440aa4d0 2023-08-17T18:13:10.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c3a7fc700 1 -- 172.21.15.78:0/1677380431 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c340048c0 con 0x7f4c440aa4d0 2023-08-17T18:13:10.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.531+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1677380431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c440b0bd0 con 0x7f4c440aa4d0 2023-08-17T18:13:10.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.532+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1677380431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c44164c20 con 0x7f4c440aa4d0 2023-08-17T18:13:10.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.532+0000 7f4c3a7fc700 1 -- 172.21.15.78:0/1677380431 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4c3401b060 con 0x7f4c440aa4d0 2023-08-17T18:13:10.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.533+0000 7f4c3a7fc700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f4c2805ed60 0x7f4c28061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.533+0000 7f4c3a7fc700 1 -- 172.21.15.78:0/1677380431 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f4c34079540 con 0x7f4c440aa4d0 2023-08-17T18:13:10.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.533+0000 7f4c4a26c700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f4c2805ed60 0x7f4c28061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.533+0000 7f4c4a26c700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f4c2805ed60 0x7f4c28061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4c440c80e0 tx=0x7f4c40009780).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:13:10.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.537+0000 7f4c3a7fc700 1 -- 172.21.15.78:0/1677380431 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4c3404ac60 con 0x7f4c440aa4d0 2023-08-17T18:13:10.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.701+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1677380431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f4c44046af0 con 0x7f4c440aa4d0 2023-08-17T18:13:10.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.704+0000 7f4c3a7fc700 1 -- 172.21.15.78:0/1677380431 <== mon.0 v2:172.21.15.78:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4c3404ac60 con 0x7f4c440aa4d0 2023-08-17T18:13:10.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.704+0000 7f4c3a7fc700 1 -- 172.21.15.78:0/1677380431 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v42)=0 v42) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4c34019070 con 0x7f4c440aa4d0 2023-08-17T18:13:10.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1677380431 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f4c2805ed60 msgr2=0x7f4c28061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f4c2805ed60 0x7f4c28061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4c440c80e0 tx=0x7f4c40009780).stop 2023-08-17T18:13:10.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1677380431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c440aa4d0 msgr2=0x7f4c4414bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c440aa4d0 0x7f4c4414bc40 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7f4c3400c810 tx=0x7f4c34001b80).stop 2023-08-17T18:13:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1677380431 shutdown_connections 2023-08-17T18:13:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f4c2805ed60 0x7f4c28061220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c440c5810 0x7f4c44168750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c440aa0f0 0x7f4c44140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 --2- 172.21.15.78:0/1677380431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c440aa4d0 0x7f4c4414bc40 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1677380431 >> 172.21.15.78:0/1677380431 conn(0x7f4c4406a6a0 msgr2=0x7f4c440ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:13:10.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1677380431 shutdown_connections 2023-08-17T18:13:10.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.707+0000 7f4c4c4d0700 1 -- 172.21.15.78:0/1677380431 wait complete. 2023-08-17T18:13:10.719 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T18:13:10.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T18:13:10.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.831+0000 7f3662265700 1 Processor -- start 2023-08-17T18:13:10.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.831+0000 7f3662265700 1 -- start start 2023-08-17T18:13:10.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f3662265700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c154140 0x7f365c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f3662265700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f365c0a7c40 0x7f365c0c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f3662265700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c154520 con 0x7f365c0a8080 2023-08-17T18:13:10.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f3662265700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c0c91e0 con 0x7f365c0a7c40 2023-08-17T18:13:10.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f3662265700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0c94c0 con 0x7f365c154140 2023-08-17T18:13:10.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f365b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f365c0a7c40 0x7f365c0c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f365b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f365c0a7c40 0x7f365c0c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36546/0 (socket says 172.21.15.78:36546) 2023-08-17T18:13:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f365b7fe700 1 -- 172.21.15.78:0/3016359573 learned_addr learned my addr 172.21.15.78:0/3016359573 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:13:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f365bfff700 1 --2- 172.21.15.78:0/3016359573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c154140 0x7f365c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f365b7fe700 1 -- 172.21.15.78:0/3016359573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c154140 msgr2=0x7f365c0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:13:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f365b7fe700 1 --2- 172.21.15.78:0/3016359573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c154140 0x7f365c0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f365b7fe700 1 -- 172.21.15.78:0/3016359573 >> v1:172.21.15.150:6789/0 conn(0x7f365c0a8080 legacy=0x7f365c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T18:13:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.832+0000 7f365b7fe700 1 -- 172.21.15.78:0/3016359573 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0c97a0 con 0x7f365c0a7c40 2023-08-17T18:13:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f365bfff700 1 --2- 172.21.15.78:0/3016359573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c154140 0x7f365c0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T18:13:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f365b7fe700 1 --2- 172.21.15.78:0/3016359573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c0a7c40 0x7f365c0c0900 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7f3650006fd0 tx=0x7f36500090f0).ready entity=mon.0 client_cookie=2d2ae03d7f24fbe8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:13:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f365affd700 1 -- 172.21.15.78:0/3016359573 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365000b600 con 0x7f365c0a7c40 2023-08-17T18:13:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f365affd700 1 -- 172.21.15.78:0/3016359573 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f365000b760 con 0x7f365c0a7c40 2023-08-17T18:13:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f365affd700 1 -- 172.21.15.78:0/3016359573 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365000bb00 con 0x7f365c0a7c40 2023-08-17T18:13:10.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f3662265700 1 -- 172.21.15.78:0/3016359573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c0a7c40 msgr2=0x7f365c0c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f3662265700 1 --2- 172.21.15.78:0/3016359573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c0a7c40 0x7f365c0c0900 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7f3650006fd0 tx=0x7f36500090f0).stop 2023-08-17T18:13:10.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f3662265700 1 -- 172.21.15.78:0/3016359573 shutdown_connections 2023-08-17T18:13:10.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f3662265700 1 --2- 172.21.15.78:0/3016359573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c154140 0x7f365c0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f3662265700 1 --2- 172.21.15.78:0/3016359573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c0a7c40 0x7f365c0c0900 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f3662265700 1 -- 172.21.15.78:0/3016359573 >> 172.21.15.78:0/3016359573 conn(0x7f365c094510 msgr2=0x7f365c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:13:10.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f3662265700 1 -- 172.21.15.78:0/3016359573 shutdown_connections 2023-08-17T18:13:10.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.833+0000 7f3662265700 1 -- 172.21.15.78:0/3016359573 wait complete. 2023-08-17T18:13:10.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.834+0000 7f3662265700 1 Processor -- start 2023-08-17T18:13:10.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.835+0000 7f3662265700 1 -- start start 2023-08-17T18:13:10.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.835+0000 7f3662265700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f365c0a7c40 0x7f365c165490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.835+0000 7f3662265700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c0a8080 0x7f365c14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.835+0000 7f3662265700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c154140 0x7f365c14dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.835+0000 7f3662265700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0aede0 con 0x7f365c154140 2023-08-17T18:13:10.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.835+0000 7f3662265700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c150520 con 0x7f365c0a7c40 2023-08-17T18:13:10.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.835+0000 7f3662265700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c14f9b0 con 0x7f365c0a8080 2023-08-17T18:13:10.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3660802700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c154140 0x7f365c14dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3660802700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c154140 0x7f365c14dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36556/0 (socket says 172.21.15.78:36556) 2023-08-17T18:13:10.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3660802700 1 -- 172.21.15.78:0/4129724226 learned_addr learned my addr 172.21.15.78:0/4129724226 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-08-17T18:13:10.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f365b7fe700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c0a8080 0x7f365c14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f365bfff700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f365c0a7c40 0x7f365c165490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3660802700 1 -- 172.21.15.78:0/4129724226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c0a8080 msgr2=0x7f365c14f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3660802700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c0a8080 0x7f365c14f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3660802700 1 -- 172.21.15.78:0/4129724226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f365c0a7c40 msgr2=0x7f365c165490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:10.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3660802700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f365c0a7c40 0x7f365c165490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:10.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3660802700 1 -- 172.21.15.78:0/4129724226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650009370 con 0x7f365c154140 2023-08-17T18:13:10.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3660802700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c154140 0x7f365c14dbc0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f365400c810 tx=0x7f3654002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:13:10.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3643fff700 1 -- 172.21.15.78:0/4129724226 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654010510 con 0x7f365c154140 2023-08-17T18:13:10.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3643fff700 1 -- 172.21.15.78:0/4129724226 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3654010690 con 0x7f365c154140 2023-08-17T18:13:10.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3662265700 1 -- 172.21.15.78:0/4129724226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c14fc80 con 0x7f365c154140 2023-08-17T18:13:10.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3643fff700 1 -- 172.21.15.78:0/4129724226 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654010a70 con 0x7f365c154140 2023-08-17T18:13:10.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.836+0000 7f3662265700 1 -- 172.21.15.78:0/4129724226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c150240 con 0x7f365c154140 2023-08-17T18:13:10.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.837+0000 7f3662265700 1 -- 172.21.15.78:0/4129724226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c0aebb0 con 0x7f365c154140 2023-08-17T18:13:10.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.837+0000 7f3643fff700 1 -- 172.21.15.78:0/4129724226 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 96) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3654010070 con 0x7f365c154140 2023-08-17T18:13:10.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.838+0000 7f3643fff700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f364805ed90 0x7f3648061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T18:13:10.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.838+0000 7f3643fff700 1 -- 172.21.15.78:0/4129724226 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5742+0+0 (secure 0 0 0) 0x7f3654079720 con 0x7f365c154140 2023-08-17T18:13:10.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.838+0000 7f365bfff700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f364805ed90 0x7f3648061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T18:13:10.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.838+0000 7f365bfff700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f364805ed90 0x7f3648061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f365c159e80 tx=0x7f364c008040).ready entity=mgr.9804 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T18:13:10.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:10.842+0000 7f3643fff700 1 -- 172.21.15.78:0/4129724226 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f365c0aebb0 con 0x7f365c154140 2023-08-17T18:13:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.043+0000 7f3662265700 1 -- 172.21.15.78:0/4129724226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f365c0aebb0 con 0x7f365c154140 2023-08-17T18:13:11.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.044+0000 7f3643fff700 1 -- 172.21.15.78:0/4129724226 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f365c0aebb0 con 0x7f365c154140 2023-08-17T18:13:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-17T18:13:11.044 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1111956777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1111956777},{"type":"v1","addr":"172.21.15.78:6837","nonce":1111956777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1739806080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1739806080},{"type":"v1","addr":"172.21.15.150:6834","nonce":1739806080}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":8866,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/444360088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":444360088},{"type":"v1","addr":"172.21.15.150:6835","nonce":444360088}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":9528,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/168802869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":168802869},{"type":"v1","addr":"172.21.15.78:6836","nonce":168802869}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[]} 2023-08-17T18:13:11.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 -- 172.21.15.78:0/4129724226 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f364805ed90 msgr2=0x7f3648061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f364805ed90 0x7f3648061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f365c159e80 tx=0x7f364c008040).stop 2023-08-17T18:13:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 -- 172.21.15.78:0/4129724226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c154140 msgr2=0x7f365c14dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T18:13:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c154140 0x7f365c14dbc0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f365400c810 tx=0x7f3654002530).stop 2023-08-17T18:13:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 -- 172.21.15.78:0/4129724226 shutdown_connections 2023-08-17T18:13:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.78:6832/158925,v1:172.21.15.78:6833/158925] conn(0x7f364805ed90 0x7f3648061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c154140 0x7f365c14dbc0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f365c0a7c40 0x7f365c165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 --2- 172.21.15.78:0/4129724226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f365c0a8080 0x7f365c14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T18:13:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 -- 172.21.15.78:0/4129724226 >> 172.21.15.78:0/4129724226 conn(0x7f365c094510 msgr2=0x7f365c159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T18:13:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 -- 172.21.15.78:0/4129724226 shutdown_connections 2023-08-17T18:13:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-08-17T18:13:11.046+0000 7f3662265700 1 -- 172.21.15.78:0/4129724226 wait complete. 2023-08-17T18:13:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 69 2023-08-17T18:13:11.057 DEBUG:tasks.cephfs.filesystem:already dead... 2023-08-17T18:13:11.057 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-17T18:13:11.058 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T18:13:11.058 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.065 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T18:13:11.066 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T18:13:11.066 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.114 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T18:13:11.114 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T18:13:11.114 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.125 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T18:13:11.125 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T18:13:11.125 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.175 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T18:13:11.176 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-17T18:13:11.176 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-17T18:13:11.176 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.203 INFO:tasks.ceph.osd.0:Stopped 2023-08-17T18:13:11.204 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-17T18:13:11.204 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.272 INFO:tasks.ceph.osd.1:Stopped 2023-08-17T18:13:11.273 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-17T18:13:11.273 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.344 INFO:tasks.ceph.osd.2:Stopped 2023-08-17T18:13:11.344 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-17T18:13:11.344 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.414 INFO:tasks.ceph.osd.3:Stopped 2023-08-17T18:13:11.414 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-17T18:13:11.414 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.453 INFO:tasks.ceph.osd.4:Stopped 2023-08-17T18:13:11.453 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-17T18:13:11.453 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.521 INFO:tasks.ceph.osd.5:Stopped 2023-08-17T18:13:11.521 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-17T18:13:11.521 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.591 INFO:tasks.ceph.osd.6:Stopped 2023-08-17T18:13:11.592 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-17T18:13:11.592 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.662 INFO:tasks.ceph.osd.7:Stopped 2023-08-17T18:13:11.662 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-17T18:13:11.662 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-17T18:13:11.663 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.688 INFO:tasks.ceph.mgr.y:Stopped 2023-08-17T18:13:11.689 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-17T18:13:11.689 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.728 INFO:tasks.ceph.mgr.x:Stopped 2023-08-17T18:13:11.729 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-17T18:13:11.729 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-17T18:13:11.729 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.743 INFO:tasks.ceph.mon.a:Stopped 2023-08-17T18:13:11.743 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-17T18:13:11.744 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.783 INFO:tasks.ceph.mon.b:Stopped 2023-08-17T18:13:11.783 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-17T18:13:11.783 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T18:13:11.836 INFO:tasks.ceph.mon.c:Stopped 2023-08-17T18:13:11.837 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-17T18:13:11.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-17T18:13:11.863 INFO:teuthology.orchestra.run.smithi078.stdout:2023-08-17T17:48:12.261883+0000 mon.a (mon.0) 585 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-08-17T18:13:11.864 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-08-17T18:13:11.864 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-17T18:13:11.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-17T18:13:11.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-17T18:13:12.065 INFO:teuthology.orchestra.run.smithi078.stdout:2023-08-17T17:48:12.261883+0000 mon.a (mon.0) 585 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-08-17T18:13:12.066 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T18:13:12.066 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-17T18:13:12.365 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T18:13:12.365 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-17T18:13:12.480 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T18:13:12.480 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-17T18:13:12.553 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T18:13:12.553 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-17T18:13:12.625 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T18:13:12.625 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-17T18:13:12.841 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T18:13:12.842 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-17T18:13:12.902 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T18:13:12.902 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-17T18:13:12.958 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T18:13:12.958 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-17T18:13:13.018 INFO:tasks.ceph:Archiving mon data... 2023-08-17T18:13:13.020 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890/data/mon.a.tgz 2023-08-17T18:13:13.020 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-08-17T18:13:13.035 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.TmTFk7niyT 2023-08-17T18:13:13.035 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.TmTFk7niyT 2023-08-17T18:13:13.547 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.TmTFk7niyT 2023-08-17T18:13:13.627 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.TmTFk7niyT is 2MB 2023-08-17T18:13:13.743 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.TmTFk7niyT 2023-08-17T18:13:13.757 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890/data/mon.b.tgz 2023-08-17T18:13:13.757 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2023-08-17T18:13:13.772 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.pByCNmflak 2023-08-17T18:13:13.772 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.pByCNmflak 2023-08-17T18:13:14.274 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.pByCNmflak 2023-08-17T18:13:14.353 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.pByCNmflak is 2MB 2023-08-17T18:13:14.443 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.pByCNmflak 2023-08-17T18:13:14.457 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890/data/mon.c.tgz 2023-08-17T18:13:14.457 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2023-08-17T18:13:14.510 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.ebWmC1d7j2 2023-08-17T18:13:14.511 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ebWmC1d7j2 2023-08-17T18:13:15.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.ebWmC1d7j2 2023-08-17T18:13:15.082 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.ebWmC1d7j2 is 2MB 2023-08-17T18:13:15.171 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.ebWmC1d7j2 2023-08-17T18:13:15.185 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-17T18:13:15.186 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-17T18:13:15.188 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-17T18:13:15.248 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-17T18:13:15.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-17T18:13:15.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-17T18:13:15.284 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-17T18:13:15.312 INFO:teuthology.orchestra.run.smithi150.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-17T18:13:15.318 INFO:tasks.ceph:Archiving crash dumps... 2023-08-17T18:13:15.319 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890/remote/smithi078/crash 2023-08-17T18:13:15.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-17T18:13:15.360 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890/remote/smithi150/crash 2023-08-17T18:13:15.361 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-17T18:13:15.384 INFO:tasks.ceph:Shutting down logrotate 2023-08-17T18:13:15.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:13:15.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T18:13:15.474 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-17T18:13:15.500 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-17T18:13:15.523 INFO:tasks.ceph:Compressing logs... 2023-08-17T18:13:15.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-17T18:13:15.541 DEBUG:teuthology.orchestra.run.smithi150:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-17T18:13:23.847 INFO:tasks.ceph:Archiving logs... 2023-08-17T18:13:23.847 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890/remote/smithi078/log 2023-08-17T18:13:23.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-17T18:13:25.021 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890/remote/smithi150/log 2023-08-17T18:13:25.022 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-17T18:13:25.682 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-17T18:13:25.691 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-17T18:13:25.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-17T18:13:25.694 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-17T18:13:25.782 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-17T18:13:25.791 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-17T18:13:25.791 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-17T18:13:25.793 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-17T18:13:25.806 INFO:teuthology.orchestra.run.smithi078.stderr:bash: ntpq: command not found 2023-08-17T18:13:25.808 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2023-08-17T18:13:25.809 INFO:teuthology.orchestra.run.smithi078.stdout:210 Number of sources = 4 2023-08-17T18:13:25.809 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-17T18:13:25.809 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2023-08-17T18:13:25.810 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 +1853us[+1853us] +/- 97ms 2023-08-17T18:13:25.810 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv02.front.sepia.ceph.com 3 6 377 25 -1186us[-1186us] +/- 52ms 2023-08-17T18:13:25.810 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +360us[ +359us] +/- 86ms 2023-08-17T18:13:25.810 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-17T18:13:25.811 INFO:teuthology.orchestra.run.smithi150.stdout:210 Number of sources = 4 2023-08-17T18:13:25.811 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-17T18:13:25.811 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2023-08-17T18:13:25.811 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 +1872us[+1877us] +/- 97ms 2023-08-17T18:13:25.812 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv02.front.sepia.ceph.com 3 6 377 23 -1181us[-1176us] +/- 52ms 2023-08-17T18:13:25.812 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +361us[ +361us] +/- 86ms 2023-08-17T18:13:25.812 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-17T18:13:25.813 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-17T18:13:25.845 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-17T18:13:25.846 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-17T18:13:25.855 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-17T18:13:25.893 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-17T18:13:25.986 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-17T18:13:26.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T18:13:26.011 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-17T18:13:26.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T18:13:26.040 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-17T18:13:26.049 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-17T18:13:26.058 INFO:teuthology.task.internal:Duration was 3268.127434 seconds 2023-08-17T18:13:26.058 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-17T18:13:26.067 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-17T18:13:26.067 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-17T18:13:26.069 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-17T18:13:26.111 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-17T18:13:26.123 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-17T18:13:26.364 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-17T18:13:26.364 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2023-08-17T18:13:26.364 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-17T18:13:26.382 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2023-08-17T18:13:26.382 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-17T18:13:26.401 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-17T18:13:26.402 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-17T18:13:26.424 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-17T18:13:26.480 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-17T18:13:26.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-17T18:13:26.483 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-17T18:13:26.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-17T18:13:26.605 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-17T18:13:26.605 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-17T18:13:26.629 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-17T18:13:26.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-17T18:13:26.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-17T18:13:26.672 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-17T18:13:26.693 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2023-08-17T18:13:26.717 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2023-08-17T18:13:26.730 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-17T18:13:26.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T18:13:26.759 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-17T18:13:26.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T18:13:26.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-17T18:13:26.793 INFO:teuthology.task.internal:Transferring archived files... 2023-08-17T18:13:26.794 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890/remote/smithi078 2023-08-17T18:13:26.794 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-17T18:13:26.830 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890/remote/smithi150 2023-08-17T18:13:26.830 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-17T18:13:26.861 INFO:teuthology.task.internal:Removing archive directory... 2023-08-17T18:13:26.862 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-17T18:13:26.868 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-17T18:13:26.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-17T18:13:26.922 INFO:teuthology.task.internal:Not uploading archives. 2023-08-17T18:13:26.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-17T18:13:26.932 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-17T18:13:26.932 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-17T18:13:26.934 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-17T18:13:26.946 INFO:teuthology.orchestra.run.smithi078.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 18:13 /home/ubuntu/cephtest 2023-08-17T18:13:26.965 INFO:teuthology.orchestra.run.smithi150.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 18:13 /home/ubuntu/cephtest 2023-08-17T18:13:26.967 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-17T18:13:26.977 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-17T18:13:26.996 INFO:teuthology.nuke:Checking targets against current locks 2023-08-17T18:13:27.021 DEBUG:teuthology.nuke:shortname: smithi078 2023-08-17T18:13:27.022 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-17T18:13:27.038 DEBUG:teuthology.nuke:shortname: smithi150 2023-08-17T18:13:27.039 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-17T18:13:27.048 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 17:06:44.760025', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsDGtIqaxjr03N79mLKJ8UPJGouDKoCJ1LKv7RoXHRxbRSRaafkGgQHYccvzwL3C7FkR0DB9llVzsImWBEK+MYsJOUPu+lpP1WDGLDuLCEoqBkZkGhuYc1kN0Dr7ClhWywWMkt8QTryRdL7aHQFCXmtC5J5sb7D8mexu8098EXB/f1Df36Yax08PEyuy8VM+XAwFQ1GVhRMn9FXoIoM8XaNdGQc2g7pcaKk6CDUH+il2Hqm5knxiVDo0yGzlTcLRbUk+Zyj8WOX7QTynRr7g00SQ8OcXAt1xfnUoh85+XUZA1tERmQ4JdXXkBFJLKRQ8Df5rNpZwFZp8WsWdnawcBprodP7Eehw32STaO8g6TqzsU9yt+3VLq+awBP/TMhoToA934h0l2D/YjvklOoZ+BNuEI9ohmhmiim7VViuvr6yqoR1VtIiC5XT2l3VQQYRChqShiQiHRPM3ZNwNgVutmoO+cz/MzEYNbkFOhPBKIw8J4mJAKWNJDqKktplH+Zhmk='} 2023-08-17T18:13:27.060 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_17:05:57-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7371890', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 17:06:44.761664', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVjfehMjwxiIvigPtEzGMQN7B7FPvL9sTrJPt5rST2Xv2secLTpMre3TkGT1HZmD6kF04/gNrLbfkGICXrv6k47U7f6+J6zui0Os7XlyystDRH161BOCo4ak1qQ9ZcvXJHxM0qzMIZMpS7mjQVsBqnGJDV2kcUxd7YfKgJk7UsgEhDZL87rozi65LqZuYhxMkKJ0P7bQYU12OeOlDtYBHud/f8rw56TZsICtu1hseD68COo4RW7fW5qflbg+1wfgG6ZdtaZcqdX/qH3SXjLcqieUkdha1eYtxpY+ezjMdIPr+Vj4ORHmJHX6S67+4C2V7gOSQ4Hx6wONibawOzATh8NCGj9Mb27eZVzlW9N8NeayqqXiq5b8CB2Ix1HElXhExpHwd69UNpwRjIPdmRGQbnK8IzEBLt9/MNqwPYxND/OL+WeMlu4fon4LEUr12DESnFw62EHFGKlPJvk8LBVdlJUmRDX1Do5PXCRybeXgng57dMRGea2/hMDC5qUEoVPmE='} 2023-08-17T18:13:27.099 INFO:teuthology.orchestra.console.smithi078:Power off 2023-08-17T18:13:27.100 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T18:13:27.116 INFO:teuthology.orchestra.console.smithi150:Power off 2023-08-17T18:13:27.117 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T18:13:27.127 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-08-17T18:13:27.127 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T18:13:27.138 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2023-08-17T18:13:27.138 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T18:13:27.148 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-08-17T18:13:27.158 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-08-17T18:13:31.149 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T18:13:31.159 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T18:13:31.261 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-08-17T18:13:31.270 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-08-17T18:13:35.265 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T18:13:35.275 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T18:13:35.377 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-08-17T18:13:35.387 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2023-08-17T18:13:35.488 INFO:teuthology.orchestra.console.smithi150:Power off completed 2023-08-17T18:13:39.380 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T18:13:39.491 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-08-17T18:13:39.592 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-08-17T18:13:39.697 INFO:teuthology.run:Summary data: description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 3268.127434015274 failure_reason: '"2023-08-17T17:48:12.261883+0000 mon.a (mon.0) 585 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-08-17T18:13:39.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T18:13:39.777 INFO:teuthology.run:FAIL